2024-04-18T20:47:30.258 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-18T20:47:30.259 DEBUG:teuthology.run:Teuthology command: teuthology --description powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-bitmap powercycle/default supported-distros/ubuntu_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health} --name teuthology-2024-04-18_20:32:14-powercycle-main-distro-default-smithi --verbose --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-18_20:32:14-powercycle-main-distro-default-smithi/7662458 -- /home/teuthworker/archive/teuthology-2024-04-18_20:32:14-powercycle-main-distro-default-smithi/7662458/orig.config.yaml 2024-04-18T20:47:30.294 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T20:47:30.378 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-18_20:32:14-powercycle-main-distro-default-smithi/7662458 branch: main description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-bitmap powercycle/default supported-distros/ubuntu_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health} email: ceph-qa@ceph.com first_in_suite: false job_id: '7662458' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-04-18_20:32:14-powercycle-main-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: main ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MDS_TRIM\) - \(MDS_SLOW_REQUEST\) - MDS_SLOW_METADATA_IO - Behind on trimming - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum sha1: 5be49cd9e6fca1ff6a05f2473aa3b399da760600 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 5be49cd9e6fca1ff6a05f2473aa3b399da760600 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: c46a99d99fa3e2dad10a5ce96141fec909e651df owner: scheduled_teuthology@teuthology priority: 950 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - client.0 - - osd.0 - - osd.1 - - osd.2 seed: 3165 sha1: 5be49cd9e6fca1ff6a05f2473aa3b399da760600 sleep_before_teardown: 0 subset: 2/4 suite: powercycle suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph_c46a99d99fa3e2dad10a5ce96141fec909e651df/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: c46a99d99fa3e2dad10a5ce96141fec909e651df targets: smithi078.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIiyrm9csKsNsKj7xDXE+aNZyvWTQS3gA1ugoSkLTS8vTnm+wU1fPBOCH0ahR4c0Lt4CZSt1UkKAVbN9dUWnDPg= smithi132.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIrgP7QcwZdwb++8hCo39QH2d5ZPvfvleOsY2KDlnX6jIDGB+34ght1jvmfiYamQoMFDa5kaffPkHbVSoY27UF8= smithi150.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEfi/GPD09CDYsZs5i7Td8w7yI17zJ0edKeheRdVTVXklcDBY+726nFxvD+ly3SCL5Xmg/Mqv7ZRXOp+RkJUr7Y= smithi187.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLAYrEICoF51OKaKhnoY4+7Mn3RFVlVeq+LchGulXI8ph260tG0CupOnCPaAR8RQmi9eWE6PufRjA2XWPCTomr0= tasks: - install: extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - thrashosds: chance_down: 1.0 powercycle: true timeout: 600 - ceph-fuse: null - workunit: clients: all: - suites/fsstress.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-18_20:32:14 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-18T20:47:30.378 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_c46a99d99fa3e2dad10a5ce96141fec909e651df/qa; will attempt to use it 2024-04-18T20:47:30.379 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_c46a99d99fa3e2dad10a5ce96141fec909e651df/qa/tasks 2024-04-18T20:47:30.379 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-18T20:47:30.381 INFO:teuthology.task.internal:Checking packages... 2024-04-18T20:47:30.405 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '5be49cd9e6fca1ff6a05f2473aa3b399da760600' 2024-04-18T20:47:30.405 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-18T20:47:30.405 INFO:teuthology.packaging:ref: None 2024-04-18T20:47:30.405 INFO:teuthology.packaging:tag: None 2024-04-18T20:47:30.405 INFO:teuthology.packaging:branch: main 2024-04-18T20:47:30.405 INFO:teuthology.packaging:sha1: 5be49cd9e6fca1ff6a05f2473aa3b399da760600 2024-04-18T20:47:30.406 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=main 2024-04-18T20:47:30.641 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3141-g5be49cd9-1jammy 2024-04-18T20:47:30.642 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-18T20:47:30.649 INFO:teuthology.task.internal:no buildpackages task found 2024-04-18T20:47:30.649 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-18T20:47:30.654 INFO:teuthology.task.internal:Saving configuration 2024-04-18T20:47:30.667 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-18T20:47:30.673 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-18T20:47:30.699 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi078.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-18_20:32:14-powercycle-main-distro-default-smithi/7662458', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-18 20:35:25.262662', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGZ6K2dOU391kPq9vrwqXh9HWkeKo+3FsN0xUJca3UAf'} 2024-04-18T20:47:30.717 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi132.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-18_20:32:14-powercycle-main-distro-default-smithi/7662458', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-18 20:35:25.260773', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBUjf2VzENG2wOHgZbiy2PV31/1o2R1+FNSPG0BG6Dy8'} 2024-04-18T20:47:30.736 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi150.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-18_20:32:14-powercycle-main-distro-default-smithi/7662458', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-18 20:35:25.261761', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBw+OqqhRxZKVapMaYMrTpuQP7+q3nldyEyBatycqjO6'} 2024-04-18T20:47:30.758 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi187.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-18_20:32:14-powercycle-main-distro-default-smithi/7662458', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-18 20:35:25.259581', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIchiNFVuSDnLq/YPEgez60YgkONGTyJyVZVHWTtW+10'} 2024-04-18T20:47:30.758 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-18T20:47:30.764 INFO:teuthology.task.internal:roles: ubuntu@smithi078.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'] 2024-04-18T20:47:30.764 INFO:teuthology.task.internal:roles: ubuntu@smithi132.front.sepia.ceph.com - ['osd.0'] 2024-04-18T20:47:30.764 INFO:teuthology.task.internal:roles: ubuntu@smithi150.front.sepia.ceph.com - ['osd.1'] 2024-04-18T20:47:30.764 INFO:teuthology.task.internal:roles: ubuntu@smithi187.front.sepia.ceph.com - ['osd.2'] 2024-04-18T20:47:30.764 INFO:teuthology.run_tasks:Running task console_log... 2024-04-18T20:47:30.882 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f0d80b73280>, signals=[15]) 2024-04-18T20:47:30.882 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-18T20:47:30.891 INFO:teuthology.task.internal:Opening connections... 2024-04-18T20:47:30.891 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi078.front.sepia.ceph.com 2024-04-18T20:47:30.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T20:47:30.979 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi132.front.sepia.ceph.com 2024-04-18T20:47:30.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T20:47:31.056 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi150.front.sepia.ceph.com 2024-04-18T20:47:31.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T20:47:31.137 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi187.front.sepia.ceph.com 2024-04-18T20:47:31.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T20:47:31.213 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-18T20:47:31.221 DEBUG:teuthology.orchestra.run.smithi078:> uname -m 2024-04-18T20:47:31.226 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64 2024-04-18T20:47:31.226 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release 2024-04-18T20:47:31.272 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-18T20:47:31.272 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="Ubuntu" 2024-04-18T20:47:31.272 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="22.04" 2024-04-18T20:47:31.273 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-18T20:47:31.273 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_CODENAME=jammy 2024-04-18T20:47:31.273 INFO:teuthology.orchestra.run.smithi078.stdout:ID=ubuntu 2024-04-18T20:47:31.273 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE=debian 2024-04-18T20:47:31.273 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-18T20:47:31.273 INFO:teuthology.orchestra.run.smithi078.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-18T20:47:31.273 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-18T20:47:31.273 INFO:teuthology.orchestra.run.smithi078.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-18T20:47:31.273 INFO:teuthology.orchestra.run.smithi078.stdout:UBUNTU_CODENAME=jammy 2024-04-18T20:47:31.273 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2024-04-18T20:47:31.295 DEBUG:teuthology.orchestra.run.smithi132:> uname -m 2024-04-18T20:47:31.301 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64 2024-04-18T20:47:31.301 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2024-04-18T20:47:31.347 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-18T20:47:31.347 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="Ubuntu" 2024-04-18T20:47:31.347 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="22.04" 2024-04-18T20:47:31.347 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-18T20:47:31.347 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_CODENAME=jammy 2024-04-18T20:47:31.348 INFO:teuthology.orchestra.run.smithi132.stdout:ID=ubuntu 2024-04-18T20:47:31.348 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE=debian 2024-04-18T20:47:31.348 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-18T20:47:31.348 INFO:teuthology.orchestra.run.smithi132.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-18T20:47:31.348 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-18T20:47:31.348 INFO:teuthology.orchestra.run.smithi132.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-18T20:47:31.348 INFO:teuthology.orchestra.run.smithi132.stdout:UBUNTU_CODENAME=jammy 2024-04-18T20:47:31.348 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2024-04-18T20:47:31.362 DEBUG:teuthology.orchestra.run.smithi150:> uname -m 2024-04-18T20:47:31.367 INFO:teuthology.orchestra.run.smithi150.stdout:x86_64 2024-04-18T20:47:31.367 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release 2024-04-18T20:47:31.412 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-18T20:47:31.412 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="Ubuntu" 2024-04-18T20:47:31.412 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="22.04" 2024-04-18T20:47:31.413 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-18T20:47:31.413 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_CODENAME=jammy 2024-04-18T20:47:31.413 INFO:teuthology.orchestra.run.smithi150.stdout:ID=ubuntu 2024-04-18T20:47:31.413 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE=debian 2024-04-18T20:47:31.413 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-18T20:47:31.413 INFO:teuthology.orchestra.run.smithi150.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-18T20:47:31.413 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-18T20:47:31.413 INFO:teuthology.orchestra.run.smithi150.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-18T20:47:31.413 INFO:teuthology.orchestra.run.smithi150.stdout:UBUNTU_CODENAME=jammy 2024-04-18T20:47:31.413 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server 2024-04-18T20:47:31.437 DEBUG:teuthology.orchestra.run.smithi187:> uname -m 2024-04-18T20:47:31.443 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64 2024-04-18T20:47:31.443 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2024-04-18T20:47:31.491 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-18T20:47:31.491 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="Ubuntu" 2024-04-18T20:47:31.491 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="22.04" 2024-04-18T20:47:31.491 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-18T20:47:31.491 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_CODENAME=jammy 2024-04-18T20:47:31.491 INFO:teuthology.orchestra.run.smithi187.stdout:ID=ubuntu 2024-04-18T20:47:31.491 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE=debian 2024-04-18T20:47:31.492 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-18T20:47:31.492 INFO:teuthology.orchestra.run.smithi187.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-18T20:47:31.492 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-18T20:47:31.492 INFO:teuthology.orchestra.run.smithi187.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-18T20:47:31.492 INFO:teuthology.orchestra.run.smithi187.stdout:UBUNTU_CODENAME=jammy 2024-04-18T20:47:31.492 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2024-04-18T20:47:31.512 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-18T20:47:31.521 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-18T20:47:31.526 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-18T20:47:31.526 DEBUG:teuthology.orchestra.run.smithi078:> test '!' -e /home/ubuntu/cephtest 2024-04-18T20:47:31.529 DEBUG:teuthology.orchestra.run.smithi132:> test '!' -e /home/ubuntu/cephtest 2024-04-18T20:47:31.531 DEBUG:teuthology.orchestra.run.smithi150:> test '!' -e /home/ubuntu/cephtest 2024-04-18T20:47:31.534 DEBUG:teuthology.orchestra.run.smithi187:> test '!' -e /home/ubuntu/cephtest 2024-04-18T20:47:31.538 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-18T20:47:31.546 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-18T20:47:31.547 DEBUG:teuthology.orchestra.run.smithi078:> test -z $(ls -A /var/lib/ceph) 2024-04-18T20:47:31.578 DEBUG:teuthology.orchestra.run.smithi132:> test -z $(ls -A /var/lib/ceph) 2024-04-18T20:47:31.580 DEBUG:teuthology.orchestra.run.smithi150:> test -z $(ls -A /var/lib/ceph) 2024-04-18T20:47:31.582 DEBUG:teuthology.orchestra.run.smithi187:> test -z $(ls -A /var/lib/ceph) 2024-04-18T20:47:31.663 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-18T20:47:31.759 INFO:teuthology.run_tasks:Running task kernel... 2024-04-18T20:47:31.772 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-18T20:47:31.773 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'osd.0': {'kdb': 1, 'sha1': 'distro'}, 'osd.1': {'kdb': 1, 'sha1': 'distro'}, 'osd.2': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-18T20:47:31.773 DEBUG:teuthology.orchestra.run.smithi078:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-18T20:47:31.773 DEBUG:teuthology.orchestra.run.smithi132:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-18T20:47:31.774 DEBUG:teuthology.orchestra.run.smithi150:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-18T20:47:31.774 DEBUG:teuthology.orchestra.run.smithi187:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-18T20:47:31.779 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T20:47:31.779 DEBUG:teuthology.orchestra.run.smithi132:> uname -r 2024-04-18T20:47:31.781 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T20:47:31.781 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T20:47:31.781 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T20:47:31.782 DEBUG:teuthology.orchestra.run.smithi187:> uname -r 2024-04-18T20:47:31.782 DEBUG:teuthology.orchestra.run.smithi078:> uname -r 2024-04-18T20:47:31.782 DEBUG:teuthology.orchestra.run.smithi150:> uname -r 2024-04-18T20:47:31.828 INFO:teuthology.orchestra.run.smithi187.stdout:5.15.0-56-generic 2024-04-18T20:47:31.828 INFO:teuthology.task.kernel:Running kernel on smithi187: 5.15.0-56-generic 2024-04-18T20:47:31.828 DEBUG:teuthology.orchestra.run.smithi187:> sudo apt-get clean 2024-04-18T20:47:31.830 INFO:teuthology.orchestra.run.smithi078.stdout:5.15.0-56-generic 2024-04-18T20:47:31.830 INFO:teuthology.orchestra.run.smithi132.stdout:5.15.0-56-generic 2024-04-18T20:47:31.830 INFO:teuthology.orchestra.run.smithi150.stdout:5.15.0-56-generic 2024-04-18T20:47:31.831 INFO:teuthology.task.kernel:Running kernel on smithi078: 5.15.0-56-generic 2024-04-18T20:47:31.831 DEBUG:teuthology.orchestra.run.smithi078:> sudo apt-get clean 2024-04-18T20:47:31.831 INFO:teuthology.task.kernel:Running kernel on smithi132: 5.15.0-56-generic 2024-04-18T20:47:31.831 DEBUG:teuthology.orchestra.run.smithi132:> sudo apt-get clean 2024-04-18T20:47:31.831 INFO:teuthology.task.kernel:Running kernel on smithi150: 5.15.0-56-generic 2024-04-18T20:47:31.832 DEBUG:teuthology.orchestra.run.smithi150:> sudo apt-get clean 2024-04-18T20:47:31.961 DEBUG:teuthology.orchestra.run.smithi150:> sudo apt-get update 2024-04-18T20:47:31.971 DEBUG:teuthology.orchestra.run.smithi187:> sudo apt-get update 2024-04-18T20:47:31.991 DEBUG:teuthology.orchestra.run.smithi078:> sudo apt-get update 2024-04-18T20:47:31.994 DEBUG:teuthology.orchestra.run.smithi132:> sudo apt-get update 2024-04-18T20:47:32.136 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-18T20:47:32.143 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-18T20:47:32.144 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-18T20:47:32.147 INFO:teuthology.orchestra.run.smithi078.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-18T20:47:32.149 INFO:teuthology.orchestra.run.smithi078.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-18T20:47:32.155 INFO:teuthology.orchestra.run.smithi187.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-18T20:47:32.155 INFO:teuthology.orchestra.run.smithi187.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-18T20:47:32.159 INFO:teuthology.orchestra.run.smithi150.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-18T20:47:32.231 INFO:teuthology.orchestra.run.smithi187.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-18T20:47:32.236 INFO:teuthology.orchestra.run.smithi078.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-18T20:47:32.238 INFO:teuthology.orchestra.run.smithi150.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-18T20:47:32.245 INFO:teuthology.orchestra.run.smithi150.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-18T20:47:32.297 INFO:teuthology.orchestra.run.smithi132.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-18T20:47:32.297 INFO:teuthology.orchestra.run.smithi132.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-18T20:47:32.354 INFO:teuthology.orchestra.run.smithi132.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-18T20:47:32.369 INFO:teuthology.orchestra.run.smithi150.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,562 kB] 2024-04-18T20:47:32.375 INFO:teuthology.orchestra.run.smithi187.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,346 kB] 2024-04-18T20:47:32.400 INFO:teuthology.orchestra.run.smithi078.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,346 kB] 2024-04-18T20:47:32.443 INFO:teuthology.orchestra.run.smithi187.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [611 kB] 2024-04-18T20:47:32.481 INFO:teuthology.orchestra.run.smithi078.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [611 kB] 2024-04-18T20:47:32.488 INFO:teuthology.orchestra.run.smithi150.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [611 kB] 2024-04-18T20:47:32.497 INFO:teuthology.orchestra.run.smithi187.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [445 kB] 2024-04-18T20:47:32.501 INFO:teuthology.orchestra.run.smithi150.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [298 kB] 2024-04-18T20:47:32.506 INFO:teuthology.orchestra.run.smithi150.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-18T20:47:32.506 INFO:teuthology.orchestra.run.smithi187.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [237 kB] 2024-04-18T20:47:32.507 INFO:teuthology.orchestra.run.smithi150.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,754 kB] 2024-04-18T20:47:32.511 INFO:teuthology.orchestra.run.smithi187.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-18T20:47:32.511 INFO:teuthology.orchestra.run.smithi187.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [34.1 kB] 2024-04-18T20:47:32.512 INFO:teuthology.orchestra.run.smithi187.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,670 kB] 2024-04-18T20:47:32.535 INFO:teuthology.orchestra.run.smithi078.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [445 kB] 2024-04-18T20:47:32.544 INFO:teuthology.orchestra.run.smithi078.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [237 kB] 2024-04-18T20:47:32.549 INFO:teuthology.orchestra.run.smithi187.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,562 kB] 2024-04-18T20:47:32.550 INFO:teuthology.orchestra.run.smithi150.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-18T20:47:32.551 INFO:teuthology.orchestra.run.smithi078.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-18T20:47:32.551 INFO:teuthology.orchestra.run.smithi078.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,670 kB] 2024-04-18T20:47:32.553 INFO:teuthology.orchestra.run.smithi150.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [295 kB] 2024-04-18T20:47:32.565 INFO:teuthology.orchestra.run.smithi150.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-18T20:47:32.566 INFO:teuthology.orchestra.run.smithi150.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,074 kB] 2024-04-18T20:47:32.571 INFO:teuthology.orchestra.run.smithi187.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [280 kB] 2024-04-18T20:47:32.578 INFO:teuthology.orchestra.run.smithi187.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-18T20:47:32.579 INFO:teuthology.orchestra.run.smithi187.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [600 kB] 2024-04-18T20:47:32.594 INFO:teuthology.orchestra.run.smithi187.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [852 kB] 2024-04-18T20:47:32.609 INFO:teuthology.orchestra.run.smithi150.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [699 kB] 2024-04-18T20:47:32.649 INFO:teuthology.orchestra.run.smithi078.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,562 kB] 2024-04-18T20:47:32.669 INFO:teuthology.orchestra.run.smithi078.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [34.1 kB] 2024-04-18T20:47:32.670 INFO:teuthology.orchestra.run.smithi078.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [280 kB] 2024-04-18T20:47:32.676 INFO:teuthology.orchestra.run.smithi078.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-18T20:47:32.676 INFO:teuthology.orchestra.run.smithi078.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [600 kB] 2024-04-18T20:47:32.687 INFO:teuthology.orchestra.run.smithi078.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [852 kB] 2024-04-18T20:47:32.688 INFO:teuthology.orchestra.run.smithi150.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [245 kB] 2024-04-18T20:47:32.690 INFO:teuthology.orchestra.run.smithi187.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [298 kB] 2024-04-18T20:47:32.690 INFO:teuthology.orchestra.run.smithi187.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-18T20:47:32.693 INFO:teuthology.orchestra.run.smithi187.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-18T20:47:32.694 INFO:teuthology.orchestra.run.smithi187.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-18T20:47:32.694 INFO:teuthology.orchestra.run.smithi187.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-18T20:47:32.695 INFO:teuthology.orchestra.run.smithi187.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-18T20:47:32.695 INFO:teuthology.orchestra.run.smithi187.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-18T20:47:32.696 INFO:teuthology.orchestra.run.smithi187.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-18T20:47:32.697 INFO:teuthology.orchestra.run.smithi187.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-18T20:47:32.698 INFO:teuthology.orchestra.run.smithi187.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,754 kB] 2024-04-18T20:47:32.702 INFO:teuthology.orchestra.run.smithi150.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-18T20:47:32.702 INFO:teuthology.orchestra.run.smithi150.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-18T20:47:32.702 INFO:teuthology.orchestra.run.smithi150.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-18T20:47:32.703 INFO:teuthology.orchestra.run.smithi150.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-18T20:47:32.703 INFO:teuthology.orchestra.run.smithi150.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-18T20:47:32.704 INFO:teuthology.orchestra.run.smithi150.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-18T20:47:32.706 INFO:teuthology.orchestra.run.smithi132.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-18T20:47:32.709 INFO:teuthology.orchestra.run.smithi132.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [445 kB] 2024-04-18T20:47:32.718 INFO:teuthology.orchestra.run.smithi150.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-04-18T20:47:32.718 INFO:teuthology.orchestra.run.smithi150.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,346 kB] 2024-04-18T20:47:32.718 INFO:teuthology.orchestra.run.smithi150.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-18T20:47:32.720 INFO:teuthology.orchestra.run.smithi150.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-18T20:47:32.723 INFO:teuthology.orchestra.run.smithi078.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-18T20:47:32.726 INFO:teuthology.orchestra.run.smithi078.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-18T20:47:32.727 INFO:teuthology.orchestra.run.smithi078.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-18T20:47:32.727 INFO:teuthology.orchestra.run.smithi078.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-18T20:47:32.740 INFO:teuthology.orchestra.run.smithi187.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [295 kB] 2024-04-18T20:47:32.746 INFO:teuthology.orchestra.run.smithi187.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-18T20:47:32.747 INFO:teuthology.orchestra.run.smithi187.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,074 kB] 2024-04-18T20:47:32.753 INFO:teuthology.orchestra.run.smithi078.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [298 kB] 2024-04-18T20:47:32.757 INFO:teuthology.orchestra.run.smithi150.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-04-18T20:47:32.758 INFO:teuthology.orchestra.run.smithi150.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-04-18T20:47:32.758 INFO:teuthology.orchestra.run.smithi150.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-18T20:47:32.759 INFO:teuthology.orchestra.run.smithi150.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-18T20:47:32.762 INFO:teuthology.orchestra.run.smithi078.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-18T20:47:32.763 INFO:teuthology.orchestra.run.smithi078.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-18T20:47:32.765 INFO:teuthology.orchestra.run.smithi078.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,754 kB] 2024-04-18T20:47:32.775 INFO:teuthology.orchestra.run.smithi187.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [699 kB] 2024-04-18T20:47:32.787 INFO:teuthology.orchestra.run.smithi187.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [245 kB] 2024-04-18T20:47:32.791 INFO:teuthology.orchestra.run.smithi187.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-18T20:47:32.792 INFO:teuthology.orchestra.run.smithi187.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-18T20:47:32.792 INFO:teuthology.orchestra.run.smithi187.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-18T20:47:32.793 INFO:teuthology.orchestra.run.smithi078.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-18T20:47:32.793 INFO:teuthology.orchestra.run.smithi187.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-18T20:47:32.794 INFO:teuthology.orchestra.run.smithi078.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-18T20:47:32.807 INFO:teuthology.orchestra.run.smithi187.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-18T20:47:32.808 INFO:teuthology.orchestra.run.smithi187.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-18T20:47:32.809 INFO:teuthology.orchestra.run.smithi187.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-04-18T20:47:32.821 INFO:teuthology.orchestra.run.smithi078.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [295 kB] 2024-04-18T20:47:32.833 INFO:teuthology.orchestra.run.smithi078.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-18T20:47:32.833 INFO:teuthology.orchestra.run.smithi078.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,074 kB] 2024-04-18T20:47:32.833 INFO:teuthology.orchestra.run.smithi187.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-18T20:47:32.834 INFO:teuthology.orchestra.run.smithi187.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-18T20:47:32.834 INFO:teuthology.orchestra.run.smithi187.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-04-18T20:47:32.835 INFO:teuthology.orchestra.run.smithi187.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-04-18T20:47:32.836 INFO:teuthology.orchestra.run.smithi187.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-18T20:47:32.852 INFO:teuthology.orchestra.run.smithi078.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [699 kB] 2024-04-18T20:47:32.852 INFO:teuthology.orchestra.run.smithi187.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-18T20:47:32.869 INFO:teuthology.orchestra.run.smithi078.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [245 kB] 2024-04-18T20:47:32.876 INFO:teuthology.orchestra.run.smithi078.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-18T20:47:32.876 INFO:teuthology.orchestra.run.smithi078.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-18T20:47:32.878 INFO:teuthology.orchestra.run.smithi078.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-18T20:47:32.878 INFO:teuthology.orchestra.run.smithi078.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-18T20:47:32.885 INFO:teuthology.orchestra.run.smithi078.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-18T20:47:32.886 INFO:teuthology.orchestra.run.smithi078.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-18T20:47:32.887 INFO:teuthology.orchestra.run.smithi078.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-04-18T20:47:32.921 INFO:teuthology.orchestra.run.smithi132.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [611 kB] 2024-04-18T20:47:32.925 INFO:teuthology.orchestra.run.smithi078.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-18T20:47:32.925 INFO:teuthology.orchestra.run.smithi078.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-18T20:47:32.925 INFO:teuthology.orchestra.run.smithi078.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-04-18T20:47:32.926 INFO:teuthology.orchestra.run.smithi078.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-04-18T20:47:32.926 INFO:teuthology.orchestra.run.smithi078.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-18T20:47:32.932 INFO:teuthology.orchestra.run.smithi078.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-18T20:47:32.999 INFO:teuthology.orchestra.run.smithi132.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,346 kB] 2024-04-18T20:47:33.166 INFO:teuthology.orchestra.run.smithi132.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [237 kB] 2024-04-18T20:47:33.178 INFO:teuthology.orchestra.run.smithi132.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-18T20:47:33.179 INFO:teuthology.orchestra.run.smithi132.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,670 kB] 2024-04-18T20:47:33.260 INFO:teuthology.orchestra.run.smithi132.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [34.1 kB] 2024-04-18T20:47:33.261 INFO:teuthology.orchestra.run.smithi132.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [280 kB] 2024-04-18T20:47:33.269 INFO:teuthology.orchestra.run.smithi132.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-18T20:47:33.270 INFO:teuthology.orchestra.run.smithi132.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [852 kB] 2024-04-18T20:47:33.292 INFO:teuthology.orchestra.run.smithi132.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [600 kB] 2024-04-18T20:47:33.469 INFO:teuthology.orchestra.run.smithi132.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-18T20:47:33.515 INFO:teuthology.orchestra.run.smithi132.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,562 kB] 2024-04-18T20:47:33.876 INFO:teuthology.orchestra.run.smithi132.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-18T20:47:33.881 INFO:teuthology.orchestra.run.smithi132.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-18T20:47:33.882 INFO:teuthology.orchestra.run.smithi132.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-18T20:47:33.895 INFO:teuthology.orchestra.run.smithi132.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-18T20:47:33.899 INFO:teuthology.orchestra.run.smithi132.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-18T20:47:35.028 INFO:teuthology.orchestra.run.smithi150.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [445 kB] 2024-04-18T20:47:35.157 INFO:teuthology.orchestra.run.smithi150.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [237 kB] 2024-04-18T20:47:35.185 INFO:teuthology.orchestra.run.smithi150.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-18T20:47:35.206 INFO:teuthology.orchestra.run.smithi150.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,670 kB] 2024-04-18T20:47:35.275 INFO:teuthology.orchestra.run.smithi150.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [34.1 kB] 2024-04-18T20:47:35.296 INFO:teuthology.orchestra.run.smithi150.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [280 kB] 2024-04-18T20:47:35.321 INFO:teuthology.orchestra.run.smithi150.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-18T20:47:35.342 INFO:teuthology.orchestra.run.smithi150.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [852 kB] 2024-04-18T20:47:35.377 INFO:teuthology.orchestra.run.smithi150.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [600 kB] 2024-04-18T20:47:35.407 INFO:teuthology.orchestra.run.smithi150.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-18T20:47:35.431 INFO:teuthology.orchestra.run.smithi150.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-18T20:47:35.453 INFO:teuthology.orchestra.run.smithi150.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-18T20:47:35.478 INFO:teuthology.orchestra.run.smithi150.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-18T20:47:35.515 INFO:teuthology.orchestra.run.smithi150.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-18T20:47:35.550 INFO:teuthology.orchestra.run.smithi150.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-18T20:47:35.599 INFO:teuthology.orchestra.run.smithi132.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [298 kB] 2024-04-18T20:47:36.032 INFO:teuthology.orchestra.run.smithi132.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-18T20:47:36.054 INFO:teuthology.orchestra.run.smithi132.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-18T20:47:36.096 INFO:teuthology.orchestra.run.smithi132.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,754 kB] 2024-04-18T20:47:38.165 INFO:teuthology.orchestra.run.smithi132.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [295 kB] 2024-04-18T20:47:38.246 INFO:teuthology.orchestra.run.smithi187.stdout:Fetched 12.9 MB in 2s (7,100 kB/s) 2024-04-18T20:47:38.325 INFO:teuthology.orchestra.run.smithi132.stdout:Ign:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en 2024-04-18T20:47:38.335 INFO:teuthology.orchestra.run.smithi078.stdout:Fetched 12.9 MB in 2s (7,060 kB/s) 2024-04-18T20:47:38.490 INFO:teuthology.orchestra.run.smithi132.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-18T20:47:38.490 INFO:teuthology.orchestra.run.smithi132.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [699 kB] 2024-04-18T20:47:38.984 INFO:teuthology.orchestra.run.smithi132.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,074 kB] 2024-04-18T20:47:39.097 INFO:teuthology.orchestra.run.smithi132.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [245 kB] 2024-04-18T20:47:39.114 INFO:teuthology.orchestra.run.smithi132.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-18T20:47:39.115 INFO:teuthology.orchestra.run.smithi132.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-18T20:47:39.115 INFO:teuthology.orchestra.run.smithi132.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-18T20:47:39.118 INFO:teuthology.orchestra.run.smithi132.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-18T20:47:39.118 INFO:teuthology.orchestra.run.smithi132.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-18T20:47:39.119 INFO:teuthology.orchestra.run.smithi132.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-18T20:47:39.122 INFO:teuthology.orchestra.run.smithi132.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-04-18T20:47:39.289 INFO:teuthology.orchestra.run.smithi132.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-18T20:47:39.377 INFO:teuthology.orchestra.run.smithi132.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-18T20:47:39.378 INFO:teuthology.orchestra.run.smithi132.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-04-18T20:47:39.469 INFO:teuthology.orchestra.run.smithi132.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-04-18T20:47:39.507 INFO:teuthology.orchestra.run.smithi132.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-18T20:47:39.544 INFO:teuthology.orchestra.run.smithi132.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-18T20:47:39.545 INFO:teuthology.orchestra.run.smithi132.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [295 kB] 2024-04-18T20:47:39.618 INFO:teuthology.orchestra.run.smithi187.stdout:Reading package lists... 2024-04-18T20:47:39.636 DEBUG:teuthology.orchestra.run.smithi187:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-18T20:47:39.687 INFO:teuthology.orchestra.run.smithi187.stdout:Reading package lists... 2024-04-18T20:47:39.766 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2024-04-18T20:47:39.783 DEBUG:teuthology.orchestra.run.smithi078:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-18T20:47:39.847 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2024-04-18T20:47:39.872 INFO:teuthology.orchestra.run.smithi187.stdout:Building dependency tree... 2024-04-18T20:47:39.872 INFO:teuthology.orchestra.run.smithi187.stdout:Reading state information... 2024-04-18T20:47:39.895 INFO:teuthology.orchestra.run.smithi150.stdout:Fetched 12.9 MB in 4s (3,582 kB/s) 2024-04-18T20:47:40.029 INFO:teuthology.orchestra.run.smithi187.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T20:47:40.029 INFO:teuthology.orchestra.run.smithi187.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T20:47:40.029 INFO:teuthology.orchestra.run.smithi187.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T20:47:40.030 INFO:teuthology.orchestra.run.smithi187.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T20:47:40.030 INFO:teuthology.orchestra.run.smithi187.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-18T20:47:40.030 INFO:teuthology.orchestra.run.smithi187.stdout: python2.7-minimal 2024-04-18T20:47:40.030 INFO:teuthology.orchestra.run.smithi187.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T20:47:40.031 INFO:teuthology.orchestra.run.smithi187.stdout:The following additional packages will be installed: 2024-04-18T20:47:40.031 INFO:teuthology.orchestra.run.smithi187.stdout: linux-generic linux-headers-5.15.0-102 linux-headers-5.15.0-102-generic 2024-04-18T20:47:40.031 INFO:teuthology.orchestra.run.smithi187.stdout: linux-headers-generic linux-image-5.15.0-102-generic 2024-04-18T20:47:40.031 INFO:teuthology.orchestra.run.smithi187.stdout: linux-modules-5.15.0-102-generic linux-modules-extra-5.15.0-102-generic 2024-04-18T20:47:40.032 INFO:teuthology.orchestra.run.smithi187.stdout:Suggested packages: 2024-04-18T20:47:40.032 INFO:teuthology.orchestra.run.smithi187.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-18T20:47:40.033 INFO:teuthology.orchestra.run.smithi187.stdout:Recommended packages: 2024-04-18T20:47:40.033 INFO:teuthology.orchestra.run.smithi187.stdout: thermald 2024-04-18T20:47:40.047 INFO:teuthology.orchestra.run.smithi078.stdout:Building dependency tree... 2024-04-18T20:47:40.048 INFO:teuthology.orchestra.run.smithi078.stdout:Reading state information... 2024-04-18T20:47:40.079 INFO:teuthology.orchestra.run.smithi187.stdout:The following NEW packages will be installed: 2024-04-18T20:47:40.079 INFO:teuthology.orchestra.run.smithi187.stdout: linux-headers-5.15.0-102 linux-headers-5.15.0-102-generic 2024-04-18T20:47:40.079 INFO:teuthology.orchestra.run.smithi187.stdout: linux-image-5.15.0-102-generic linux-modules-5.15.0-102-generic 2024-04-18T20:47:40.080 INFO:teuthology.orchestra.run.smithi187.stdout: linux-modules-extra-5.15.0-102-generic 2024-04-18T20:47:40.081 INFO:teuthology.orchestra.run.smithi187.stdout:The following packages will be upgraded: 2024-04-18T20:47:40.081 INFO:teuthology.orchestra.run.smithi187.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-18T20:47:40.204 INFO:teuthology.orchestra.run.smithi078.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T20:47:40.205 INFO:teuthology.orchestra.run.smithi078.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T20:47:40.205 INFO:teuthology.orchestra.run.smithi078.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T20:47:40.205 INFO:teuthology.orchestra.run.smithi078.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T20:47:40.205 INFO:teuthology.orchestra.run.smithi078.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-18T20:47:40.205 INFO:teuthology.orchestra.run.smithi078.stdout: python2.7-minimal 2024-04-18T20:47:40.205 INFO:teuthology.orchestra.run.smithi078.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T20:47:40.206 INFO:teuthology.orchestra.run.smithi078.stdout:The following additional packages will be installed: 2024-04-18T20:47:40.207 INFO:teuthology.orchestra.run.smithi078.stdout: linux-generic linux-headers-5.15.0-102 linux-headers-5.15.0-102-generic 2024-04-18T20:47:40.207 INFO:teuthology.orchestra.run.smithi078.stdout: linux-headers-generic linux-image-5.15.0-102-generic 2024-04-18T20:47:40.207 INFO:teuthology.orchestra.run.smithi078.stdout: linux-modules-5.15.0-102-generic linux-modules-extra-5.15.0-102-generic 2024-04-18T20:47:40.208 INFO:teuthology.orchestra.run.smithi078.stdout:Suggested packages: 2024-04-18T20:47:40.208 INFO:teuthology.orchestra.run.smithi078.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-18T20:47:40.208 INFO:teuthology.orchestra.run.smithi078.stdout:Recommended packages: 2024-04-18T20:47:40.208 INFO:teuthology.orchestra.run.smithi078.stdout: thermald 2024-04-18T20:47:40.261 INFO:teuthology.orchestra.run.smithi187.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-18T20:47:40.261 INFO:teuthology.orchestra.run.smithi187.stdout:Need to get 113 MB of archives. 2024-04-18T20:47:40.262 INFO:teuthology.orchestra.run.smithi187.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-18T20:47:40.262 INFO:teuthology.orchestra.run.smithi187.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-102-generic amd64 5.15.0-102.112 [22.7 MB] 2024-04-18T20:47:40.272 INFO:teuthology.orchestra.run.smithi078.stdout:The following NEW packages will be installed: 2024-04-18T20:47:40.272 INFO:teuthology.orchestra.run.smithi078.stdout: linux-headers-5.15.0-102 linux-headers-5.15.0-102-generic 2024-04-18T20:47:40.272 INFO:teuthology.orchestra.run.smithi078.stdout: linux-image-5.15.0-102-generic linux-modules-5.15.0-102-generic 2024-04-18T20:47:40.272 INFO:teuthology.orchestra.run.smithi078.stdout: linux-modules-extra-5.15.0-102-generic 2024-04-18T20:47:40.274 INFO:teuthology.orchestra.run.smithi078.stdout:The following packages will be upgraded: 2024-04-18T20:47:40.274 INFO:teuthology.orchestra.run.smithi078.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-18T20:47:40.334 INFO:teuthology.orchestra.run.smithi078.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-18T20:47:40.334 INFO:teuthology.orchestra.run.smithi078.stdout:Need to get 113 MB of archives. 2024-04-18T20:47:40.334 INFO:teuthology.orchestra.run.smithi078.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-18T20:47:40.334 INFO:teuthology.orchestra.run.smithi078.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-102-generic amd64 5.15.0-102.112 [22.7 MB] 2024-04-18T20:47:41.054 INFO:teuthology.orchestra.run.smithi078.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-102-generic amd64 5.15.0-102.112 [11.5 MB] 2024-04-18T20:47:41.313 INFO:teuthology.orchestra.run.smithi150.stdout:Reading package lists... 2024-04-18T20:47:41.314 INFO:teuthology.orchestra.run.smithi078.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-102-generic amd64 5.15.0-102.112 [63.9 MB] 2024-04-18T20:47:41.330 DEBUG:teuthology.orchestra.run.smithi150:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-18T20:47:41.391 INFO:teuthology.orchestra.run.smithi150.stdout:Reading package lists... 2024-04-18T20:47:41.590 INFO:teuthology.orchestra.run.smithi150.stdout:Building dependency tree... 2024-04-18T20:47:41.591 INFO:teuthology.orchestra.run.smithi150.stdout:Reading state information... 2024-04-18T20:47:41.688 INFO:teuthology.orchestra.run.smithi187.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-102-generic amd64 5.15.0-102.112 [11.5 MB] 2024-04-18T20:47:41.763 INFO:teuthology.orchestra.run.smithi150.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T20:47:41.763 INFO:teuthology.orchestra.run.smithi150.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T20:47:41.763 INFO:teuthology.orchestra.run.smithi150.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T20:47:41.764 INFO:teuthology.orchestra.run.smithi150.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T20:47:41.764 INFO:teuthology.orchestra.run.smithi150.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-18T20:47:41.764 INFO:teuthology.orchestra.run.smithi150.stdout: python2.7-minimal 2024-04-18T20:47:41.764 INFO:teuthology.orchestra.run.smithi150.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T20:47:41.766 INFO:teuthology.orchestra.run.smithi150.stdout:The following additional packages will be installed: 2024-04-18T20:47:41.766 INFO:teuthology.orchestra.run.smithi150.stdout: linux-generic linux-headers-5.15.0-102 linux-headers-5.15.0-102-generic 2024-04-18T20:47:41.766 INFO:teuthology.orchestra.run.smithi150.stdout: linux-headers-generic linux-image-5.15.0-102-generic 2024-04-18T20:47:41.766 INFO:teuthology.orchestra.run.smithi150.stdout: linux-modules-5.15.0-102-generic linux-modules-extra-5.15.0-102-generic 2024-04-18T20:47:41.767 INFO:teuthology.orchestra.run.smithi150.stdout:Suggested packages: 2024-04-18T20:47:41.767 INFO:teuthology.orchestra.run.smithi150.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-18T20:47:41.767 INFO:teuthology.orchestra.run.smithi150.stdout:Recommended packages: 2024-04-18T20:47:41.768 INFO:teuthology.orchestra.run.smithi150.stdout: thermald 2024-04-18T20:47:41.817 INFO:teuthology.orchestra.run.smithi150.stdout:The following NEW packages will be installed: 2024-04-18T20:47:41.818 INFO:teuthology.orchestra.run.smithi150.stdout: linux-headers-5.15.0-102 linux-headers-5.15.0-102-generic 2024-04-18T20:47:41.818 INFO:teuthology.orchestra.run.smithi150.stdout: linux-image-5.15.0-102-generic linux-modules-5.15.0-102-generic 2024-04-18T20:47:41.818 INFO:teuthology.orchestra.run.smithi150.stdout: linux-modules-extra-5.15.0-102-generic 2024-04-18T20:47:41.819 INFO:teuthology.orchestra.run.smithi150.stdout:The following packages will be upgraded: 2024-04-18T20:47:41.820 INFO:teuthology.orchestra.run.smithi150.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-18T20:47:41.999 INFO:teuthology.orchestra.run.smithi150.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-18T20:47:41.999 INFO:teuthology.orchestra.run.smithi150.stdout:Need to get 113 MB of archives. 2024-04-18T20:47:41.999 INFO:teuthology.orchestra.run.smithi150.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-18T20:47:42.000 INFO:teuthology.orchestra.run.smithi150.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-102-generic amd64 5.15.0-102.112 [22.7 MB] 2024-04-18T20:47:42.091 INFO:teuthology.orchestra.run.smithi187.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-102-generic amd64 5.15.0-102.112 [63.9 MB] 2024-04-18T20:47:43.398 INFO:teuthology.orchestra.run.smithi150.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-102-generic amd64 5.15.0-102.112 [11.5 MB] 2024-04-18T20:47:43.517 INFO:teuthology.orchestra.run.smithi078.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.102.99 [1,700 B] 2024-04-18T20:47:43.517 INFO:teuthology.orchestra.run.smithi078.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.102.99 [2,512 B] 2024-04-18T20:47:43.517 INFO:teuthology.orchestra.run.smithi078.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-102 all 5.15.0-102.112 [12.4 MB] 2024-04-18T20:47:43.802 INFO:teuthology.orchestra.run.smithi150.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-102-generic amd64 5.15.0-102.112 [63.9 MB] 2024-04-18T20:47:43.966 INFO:teuthology.orchestra.run.smithi078.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-102-generic amd64 5.15.0-102.112 [2,877 kB] 2024-04-18T20:47:44.052 INFO:teuthology.orchestra.run.smithi078.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.102.99 [2,360 B] 2024-04-18T20:47:44.113 INFO:teuthology.orchestra.run.smithi132.stdout:Fetched 12.8 MB in 8s (1,657 kB/s) 2024-04-18T20:47:44.200 INFO:teuthology.orchestra.run.smithi187.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.102.99 [1,700 B] 2024-04-18T20:47:44.200 INFO:teuthology.orchestra.run.smithi187.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.102.99 [2,512 B] 2024-04-18T20:47:44.200 INFO:teuthology.orchestra.run.smithi187.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-102 all 5.15.0-102.112 [12.4 MB] 2024-04-18T20:47:44.453 INFO:teuthology.orchestra.run.smithi078.stdout:Fetched 113 MB in 4s (30.1 MB/s) 2024-04-18T20:47:44.670 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package linux-modules-5.15.0-102-generic. 2024-04-18T20:47:44.954 INFO:teuthology.orchestra.run.smithi187.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-102-generic amd64 5.15.0-102.112 [2,877 kB] 2024-04-18T20:47:45.087 INFO:teuthology.orchestra.run.smithi187.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.102.99 [2,360 B] 2024-04-18T20:47:45.482 INFO:teuthology.orchestra.run.smithi187.stdout:Fetched 113 MB in 5s (22.7 MB/s) 2024-04-18T20:47:45.578 INFO:teuthology.orchestra.run.smithi132.stdout:Reading package lists... 2024-04-18T20:47:45.598 DEBUG:teuthology.orchestra.run.smithi132:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-18T20:47:45.660 INFO:teuthology.orchestra.run.smithi132.stdout:Reading package lists... 2024-04-18T20:47:45.671 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package linux-modules-5.15.0-102-generic. 2024-04-18T20:47:45.861 INFO:teuthology.orchestra.run.smithi132.stdout:Building dependency tree... 2024-04-18T20:47:45.861 INFO:teuthology.orchestra.run.smithi132.stdout:Reading state information... 2024-04-18T20:47:45.897 INFO:teuthology.orchestra.run.smithi150.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.102.99 [1,700 B] 2024-04-18T20:47:45.897 INFO:teuthology.orchestra.run.smithi150.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.102.99 [2,512 B] 2024-04-18T20:47:45.897 INFO:teuthology.orchestra.run.smithi150.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-102 all 5.15.0-102.112 [12.4 MB] 2024-04-18T20:47:46.026 INFO:teuthology.orchestra.run.smithi132.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T20:47:46.027 INFO:teuthology.orchestra.run.smithi132.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T20:47:46.027 INFO:teuthology.orchestra.run.smithi132.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T20:47:46.027 INFO:teuthology.orchestra.run.smithi132.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T20:47:46.027 INFO:teuthology.orchestra.run.smithi132.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-18T20:47:46.027 INFO:teuthology.orchestra.run.smithi132.stdout: python2.7-minimal 2024-04-18T20:47:46.027 INFO:teuthology.orchestra.run.smithi132.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T20:47:46.029 INFO:teuthology.orchestra.run.smithi132.stdout:The following additional packages will be installed: 2024-04-18T20:47:46.029 INFO:teuthology.orchestra.run.smithi132.stdout: linux-generic linux-headers-5.15.0-102 linux-headers-5.15.0-102-generic 2024-04-18T20:47:46.029 INFO:teuthology.orchestra.run.smithi132.stdout: linux-headers-generic linux-image-5.15.0-102-generic 2024-04-18T20:47:46.029 INFO:teuthology.orchestra.run.smithi132.stdout: linux-modules-5.15.0-102-generic linux-modules-extra-5.15.0-102-generic 2024-04-18T20:47:46.030 INFO:teuthology.orchestra.run.smithi132.stdout:Suggested packages: 2024-04-18T20:47:46.030 INFO:teuthology.orchestra.run.smithi132.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-18T20:47:46.030 INFO:teuthology.orchestra.run.smithi132.stdout:Recommended packages: 2024-04-18T20:47:46.030 INFO:teuthology.orchestra.run.smithi132.stdout: thermald 2024-04-18T20:47:46.076 INFO:teuthology.orchestra.run.smithi132.stdout:The following NEW packages will be installed: 2024-04-18T20:47:46.076 INFO:teuthology.orchestra.run.smithi132.stdout: linux-headers-5.15.0-102 linux-headers-5.15.0-102-generic 2024-04-18T20:47:46.076 INFO:teuthology.orchestra.run.smithi132.stdout: linux-image-5.15.0-102-generic linux-modules-5.15.0-102-generic 2024-04-18T20:47:46.076 INFO:teuthology.orchestra.run.smithi132.stdout: linux-modules-extra-5.15.0-102-generic 2024-04-18T20:47:46.078 INFO:teuthology.orchestra.run.smithi132.stdout:The following packages will be upgraded: 2024-04-18T20:47:46.078 INFO:teuthology.orchestra.run.smithi132.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-18T20:47:46.136 INFO:teuthology.orchestra.run.smithi132.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-18T20:47:46.136 INFO:teuthology.orchestra.run.smithi132.stdout:Need to get 113 MB of archives. 2024-04-18T20:47:46.136 INFO:teuthology.orchestra.run.smithi132.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-18T20:47:46.136 INFO:teuthology.orchestra.run.smithi132.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-102-generic amd64 5.15.0-102.112 [22.7 MB] 2024-04-18T20:47:46.508 INFO:teuthology.orchestra.run.smithi150.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-102-generic amd64 5.15.0-102.112 [2,877 kB] 2024-04-18T20:47:46.613 INFO:teuthology.orchestra.run.smithi150.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.102.99 [2,360 B] 2024-04-18T20:47:46.652 INFO:teuthology.orchestra.run.smithi132.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-102-generic amd64 5.15.0-102.112 [11.5 MB] 2024-04-18T20:47:46.768 INFO:teuthology.orchestra.run.smithi132.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-102-generic amd64 5.15.0-102.112 [63.9 MB] 2024-04-18T20:47:46.812 INFO:teuthology.orchestra.run.smithi078.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-18T20:47:46.817 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../0-linux-modules-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T20:47:46.950 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking linux-modules-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:47:47.003 INFO:teuthology.orchestra.run.smithi150.stdout:Fetched 113 MB in 5s (23.7 MB/s) 2024-04-18T20:47:47.181 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package linux-modules-5.15.0-102-generic. 2024-04-18T20:47:47.772 INFO:teuthology.orchestra.run.smithi187.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-18T20:47:47.776 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../0-linux-modules-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T20:47:47.985 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking linux-modules-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:47:49.178 INFO:teuthology.orchestra.run.smithi132.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.102.99 [1,700 B] 2024-04-18T20:47:49.178 INFO:teuthology.orchestra.run.smithi132.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.102.99 [2,512 B] 2024-04-18T20:47:49.178 INFO:teuthology.orchestra.run.smithi132.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-102 all 5.15.0-102.112 [12.4 MB] 2024-04-18T20:47:49.229 INFO:teuthology.orchestra.run.smithi150.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-18T20:47:49.234 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../0-linux-modules-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T20:47:49.355 INFO:teuthology.orchestra.run.smithi132.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-102-generic amd64 5.15.0-102.112 [2,877 kB] 2024-04-18T20:47:49.362 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking linux-modules-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:47:49.385 INFO:teuthology.orchestra.run.smithi132.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.102.99 [2,360 B] 2024-04-18T20:47:49.517 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package linux-image-5.15.0-102-generic. 2024-04-18T20:47:49.538 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../1-linux-image-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T20:47:49.630 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:47:49.764 INFO:teuthology.orchestra.run.smithi132.stdout:Fetched 113 MB in 3s (34.4 MB/s) 2024-04-18T20:47:49.942 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package linux-modules-5.15.0-102-generic. 2024-04-18T20:47:50.129 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-102-generic. 2024-04-18T20:47:50.149 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T20:47:50.187 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking linux-modules-extra-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:47:50.238 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package linux-image-5.15.0-102-generic. 2024-04-18T20:47:50.260 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../1-linux-image-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T20:47:50.344 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:47:50.800 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-102-generic. 2024-04-18T20:47:50.820 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T20:47:50.858 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking linux-modules-extra-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:47:51.664 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package linux-image-5.15.0-102-generic. 2024-04-18T20:47:51.685 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../1-linux-image-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T20:47:51.773 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:47:51.947 INFO:teuthology.orchestra.run.smithi132.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-18T20:47:51.951 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../0-linux-modules-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T20:47:52.098 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking linux-modules-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:47:52.250 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-102-generic. 2024-04-18T20:47:52.271 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T20:47:52.300 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking linux-modules-extra-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:47:54.257 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package linux-image-5.15.0-102-generic. 2024-04-18T20:47:54.278 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../1-linux-image-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T20:47:54.396 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:47:54.878 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-102-generic. 2024-04-18T20:47:54.898 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T20:47:54.952 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking linux-modules-extra-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:47:56.755 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../3-linux-generic_5.15.0.102.99_amd64.deb ... 2024-04-18T20:47:56.873 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking linux-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-18T20:47:57.240 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.102.99_amd64.deb ... 2024-04-18T20:47:57.402 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking linux-image-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-18T20:47:57.603 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../3-linux-generic_5.15.0.102.99_amd64.deb ... 2024-04-18T20:47:57.730 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking linux-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-18T20:47:57.731 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package linux-headers-5.15.0-102. 2024-04-18T20:47:57.753 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../5-linux-headers-5.15.0-102_5.15.0-102.112_all.deb ... 2024-04-18T20:47:57.796 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking linux-headers-5.15.0-102 (5.15.0-102.112) ... 2024-04-18T20:47:58.053 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.102.99_amd64.deb ... 2024-04-18T20:47:58.158 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking linux-image-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-18T20:47:58.428 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package linux-headers-5.15.0-102. 2024-04-18T20:47:58.450 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../5-linux-headers-5.15.0-102_5.15.0-102.112_all.deb ... 2024-04-18T20:47:58.494 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking linux-headers-5.15.0-102 (5.15.0-102.112) ... 2024-04-18T20:47:59.269 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../3-linux-generic_5.15.0.102.99_amd64.deb ... 2024-04-18T20:47:59.386 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking linux-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-18T20:47:59.728 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.102.99_amd64.deb ... 2024-04-18T20:47:59.856 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking linux-image-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-18T20:48:00.168 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package linux-headers-5.15.0-102. 2024-04-18T20:48:00.179 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../5-linux-headers-5.15.0-102_5.15.0-102.112_all.deb ... 2024-04-18T20:48:00.218 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking linux-headers-5.15.0-102 (5.15.0-102.112) ... 2024-04-18T20:48:02.085 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../3-linux-generic_5.15.0.102.99_amd64.deb ... 2024-04-18T20:48:02.204 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking linux-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-18T20:48:02.520 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.102.99_amd64.deb ... 2024-04-18T20:48:02.683 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking linux-image-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-18T20:48:03.003 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package linux-headers-5.15.0-102. 2024-04-18T20:48:03.025 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../5-linux-headers-5.15.0-102_5.15.0-102.112_all.deb ... 2024-04-18T20:48:03.069 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking linux-headers-5.15.0-102 (5.15.0-102.112) ... 2024-04-18T20:48:03.521 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package linux-headers-5.15.0-102-generic. 2024-04-18T20:48:03.558 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../6-linux-headers-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T20:48:03.587 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking linux-headers-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:03.897 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package linux-headers-5.15.0-102-generic. 2024-04-18T20:48:03.937 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../6-linux-headers-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T20:48:04.213 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking linux-headers-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:05.897 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package linux-headers-5.15.0-102-generic. 2024-04-18T20:48:05.935 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../6-linux-headers-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T20:48:05.997 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking linux-headers-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:06.834 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.102.99_amd64.deb ... 2024-04-18T20:48:06.879 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.102.99_amd64.deb ... 2024-04-18T20:48:06.957 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking linux-headers-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-18T20:48:07.001 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking linux-headers-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-18T20:48:07.324 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up linux-headers-5.15.0-102 (5.15.0-102.112) ... 2024-04-18T20:48:07.375 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up linux-headers-5.15.0-102 (5.15.0-102.112) ... 2024-04-18T20:48:07.437 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up linux-headers-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:07.939 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up linux-headers-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:08.153 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up linux-headers-generic (5.15.0.102.99) ... 2024-04-18T20:48:08.467 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:08.473 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up linux-headers-generic (5.15.0.102.99) ... 2024-04-18T20:48:08.586 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:09.682 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package linux-headers-5.15.0-102-generic. 2024-04-18T20:48:09.701 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.102.99_amd64.deb ... 2024-04-18T20:48:09.719 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../6-linux-headers-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T20:48:09.757 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking linux-headers-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:09.775 INFO:teuthology.orchestra.run.smithi187.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-18T20:48:09.775 INFO:teuthology.orchestra.run.smithi187.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-18T20:48:09.775 INFO:teuthology.orchestra.run.smithi187.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-102-generic 2024-04-18T20:48:09.775 INFO:teuthology.orchestra.run.smithi187.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-102-generic 2024-04-18T20:48:09.826 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking linux-headers-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-18T20:48:09.922 INFO:teuthology.orchestra.run.smithi078.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-18T20:48:09.922 INFO:teuthology.orchestra.run.smithi078.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-18T20:48:09.922 INFO:teuthology.orchestra.run.smithi078.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-102-generic 2024-04-18T20:48:09.922 INFO:teuthology.orchestra.run.smithi078.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-102-generic 2024-04-18T20:48:09.927 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up linux-modules-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:10.096 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up linux-modules-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:10.193 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up linux-headers-5.15.0-102 (5.15.0-102.112) ... 2024-04-18T20:48:10.306 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up linux-headers-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:10.415 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up linux-headers-generic (5.15.0.102.99) ... 2024-04-18T20:48:10.544 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:11.345 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up linux-modules-extra-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:11.514 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up linux-modules-extra-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:11.848 INFO:teuthology.orchestra.run.smithi150.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-18T20:48:11.849 INFO:teuthology.orchestra.run.smithi150.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-18T20:48:11.849 INFO:teuthology.orchestra.run.smithi150.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-102-generic 2024-04-18T20:48:11.849 INFO:teuthology.orchestra.run.smithi150.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-102-generic 2024-04-18T20:48:12.029 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up linux-modules-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:12.730 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up linux-image-generic (5.15.0.102.99) ... 2024-04-18T20:48:12.777 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.102.99_amd64.deb ... 2024-04-18T20:48:12.856 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up linux-generic (5.15.0.102.99) ... 2024-04-18T20:48:12.902 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking linux-headers-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-18T20:48:12.932 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up linux-image-generic (5.15.0.102.99) ... 2024-04-18T20:48:12.982 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:13.049 INFO:teuthology.orchestra.run.smithi187.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-18T20:48:13.049 INFO:teuthology.orchestra.run.smithi187.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-102-generic 2024-04-18T20:48:13.058 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up linux-generic (5.15.0.102.99) ... 2024-04-18T20:48:13.209 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:13.262 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up linux-headers-5.15.0-102 (5.15.0-102.112) ... 2024-04-18T20:48:13.276 INFO:teuthology.orchestra.run.smithi078.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-18T20:48:13.276 INFO:teuthology.orchestra.run.smithi078.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-102-generic 2024-04-18T20:48:13.390 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up linux-headers-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:13.447 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up linux-modules-extra-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:13.525 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up linux-headers-generic (5.15.0.102.99) ... 2024-04-18T20:48:13.653 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:14.832 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up linux-image-generic (5.15.0.102.99) ... 2024-04-18T20:48:14.933 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up linux-generic (5.15.0.102.99) ... 2024-04-18T20:48:15.006 INFO:teuthology.orchestra.run.smithi132.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-18T20:48:15.006 INFO:teuthology.orchestra.run.smithi132.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-18T20:48:15.006 INFO:teuthology.orchestra.run.smithi132.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-102-generic 2024-04-18T20:48:15.006 INFO:teuthology.orchestra.run.smithi132.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-102-generic 2024-04-18T20:48:15.084 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:15.145 INFO:teuthology.orchestra.run.smithi150.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-18T20:48:15.145 INFO:teuthology.orchestra.run.smithi150.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-102-generic 2024-04-18T20:48:15.164 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up linux-modules-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:16.574 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up linux-modules-extra-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:18.326 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up linux-image-generic (5.15.0.102.99) ... 2024-04-18T20:48:18.451 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up linux-generic (5.15.0.102.99) ... 2024-04-18T20:48:18.594 INFO:teuthology.orchestra.run.smithi132.stdout:Processing triggers for linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T20:48:18.655 INFO:teuthology.orchestra.run.smithi132.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-18T20:48:18.655 INFO:teuthology.orchestra.run.smithi132.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-102-generic 2024-04-18T20:48:27.008 INFO:teuthology.orchestra.run.smithi187.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-18T20:48:27.008 INFO:teuthology.orchestra.run.smithi187.stdout:Sourcing file `/etc/default/grub' 2024-04-18T20:48:27.026 INFO:teuthology.orchestra.run.smithi187.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-18T20:48:27.054 INFO:teuthology.orchestra.run.smithi187.stdout:Generating grub configuration file ... 2024-04-18T20:48:27.387 INFO:teuthology.orchestra.run.smithi187.stdout:Found linux image: /boot/vmlinuz-5.15.0-102-generic 2024-04-18T20:48:27.408 INFO:teuthology.orchestra.run.smithi187.stdout:Found initrd image: /boot/initrd.img-5.15.0-102-generic 2024-04-18T20:48:27.798 INFO:teuthology.orchestra.run.smithi187.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-18T20:48:27.804 INFO:teuthology.orchestra.run.smithi187.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-18T20:48:27.874 INFO:teuthology.orchestra.run.smithi187.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-18T20:48:27.879 INFO:teuthology.orchestra.run.smithi187.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-18T20:48:27.946 INFO:teuthology.orchestra.run.smithi078.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-18T20:48:27.946 INFO:teuthology.orchestra.run.smithi078.stdout:Sourcing file `/etc/default/grub' 2024-04-18T20:48:27.970 INFO:teuthology.orchestra.run.smithi078.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-18T20:48:27.992 INFO:teuthology.orchestra.run.smithi078.stdout:Generating grub configuration file ... 2024-04-18T20:48:28.044 INFO:teuthology.orchestra.run.smithi187.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-18T20:48:28.044 INFO:teuthology.orchestra.run.smithi187.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-18T20:48:28.044 INFO:teuthology.orchestra.run.smithi187.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-18T20:48:28.086 INFO:teuthology.orchestra.run.smithi187.stdout:done 2024-04-18T20:48:28.296 INFO:teuthology.orchestra.run.smithi078.stdout:Found linux image: /boot/vmlinuz-5.15.0-102-generic 2024-04-18T20:48:28.317 INFO:teuthology.orchestra.run.smithi078.stdout:Found initrd image: /boot/initrd.img-5.15.0-102-generic 2024-04-18T20:48:28.547 DEBUG:teuthology.orchestra.run.smithi187:> dpkg -s linux-image-generic 2024-04-18T20:48:28.566 INFO:teuthology.orchestra.run.smithi187.stdout:Package: linux-image-generic 2024-04-18T20:48:28.566 INFO:teuthology.orchestra.run.smithi187.stdout:Status: install ok installed 2024-04-18T20:48:28.567 INFO:teuthology.orchestra.run.smithi187.stdout:Priority: optional 2024-04-18T20:48:28.567 INFO:teuthology.orchestra.run.smithi187.stdout:Section: kernel 2024-04-18T20:48:28.567 INFO:teuthology.orchestra.run.smithi187.stdout:Installed-Size: 21 2024-04-18T20:48:28.567 INFO:teuthology.orchestra.run.smithi187.stdout:Maintainer: Ubuntu Kernel Team 2024-04-18T20:48:28.567 INFO:teuthology.orchestra.run.smithi187.stdout:Architecture: amd64 2024-04-18T20:48:28.567 INFO:teuthology.orchestra.run.smithi187.stdout:Source: linux-meta 2024-04-18T20:48:28.567 INFO:teuthology.orchestra.run.smithi187.stdout:Version: 5.15.0.102.99 2024-04-18T20:48:28.567 INFO:teuthology.orchestra.run.smithi187.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-102), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-18T20:48:28.567 INFO:teuthology.orchestra.run.smithi187.stdout:Depends: linux-image-5.15.0-102-generic, linux-modules-extra-5.15.0-102-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-18T20:48:28.567 INFO:teuthology.orchestra.run.smithi187.stdout:Recommends: thermald 2024-04-18T20:48:28.567 INFO:teuthology.orchestra.run.smithi187.stdout:Description: Generic Linux kernel image 2024-04-18T20:48:28.567 INFO:teuthology.orchestra.run.smithi187.stdout: This package will always depend on the latest generic kernel image 2024-04-18T20:48:28.567 INFO:teuthology.orchestra.run.smithi187.stdout: available. 2024-04-18T20:48:28.568 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-102-generic 2024-04-18T20:48:28.568 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-18T20:48:28.568 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-18T20:48:28.568 INFO:teuthology.task.kernel:Installing distro kernel on osd.2... 2024-04-18T20:48:28.569 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi187.front.sepia.ceph.com, path=None, version=distro) 2024-04-18T20:48:28.569 DEBUG:teuthology.orchestra.run.smithi187:> sudo apt-get clean 2024-04-18T20:48:28.611 INFO:teuthology.orchestra.run.smithi078.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-18T20:48:28.618 INFO:teuthology.orchestra.run.smithi078.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-18T20:48:28.694 INFO:teuthology.orchestra.run.smithi078.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-18T20:48:28.699 INFO:teuthology.orchestra.run.smithi078.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-18T20:48:28.742 DEBUG:teuthology.orchestra.run.smithi187:> sudo apt-get update 2024-04-18T20:48:28.858 INFO:teuthology.orchestra.run.smithi078.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-18T20:48:28.858 INFO:teuthology.orchestra.run.smithi078.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-18T20:48:28.858 INFO:teuthology.orchestra.run.smithi078.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-18T20:48:28.891 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-18T20:48:28.902 INFO:teuthology.orchestra.run.smithi078.stdout:done 2024-04-18T20:48:29.004 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-18T20:48:29.060 INFO:teuthology.orchestra.run.smithi150.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-18T20:48:29.061 INFO:teuthology.orchestra.run.smithi150.stdout:Sourcing file `/etc/default/grub' 2024-04-18T20:48:29.076 INFO:teuthology.orchestra.run.smithi150.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-18T20:48:29.085 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-18T20:48:29.100 INFO:teuthology.orchestra.run.smithi150.stdout:Generating grub configuration file ... 2024-04-18T20:48:29.167 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-18T20:48:29.395 DEBUG:teuthology.orchestra.run.smithi078:> dpkg -s linux-image-generic 2024-04-18T20:48:29.412 INFO:teuthology.orchestra.run.smithi078.stdout:Package: linux-image-generic 2024-04-18T20:48:29.412 INFO:teuthology.orchestra.run.smithi078.stdout:Status: install ok installed 2024-04-18T20:48:29.412 INFO:teuthology.orchestra.run.smithi078.stdout:Priority: optional 2024-04-18T20:48:29.412 INFO:teuthology.orchestra.run.smithi078.stdout:Section: kernel 2024-04-18T20:48:29.412 INFO:teuthology.orchestra.run.smithi078.stdout:Installed-Size: 21 2024-04-18T20:48:29.412 INFO:teuthology.orchestra.run.smithi078.stdout:Maintainer: Ubuntu Kernel Team 2024-04-18T20:48:29.412 INFO:teuthology.orchestra.run.smithi078.stdout:Architecture: amd64 2024-04-18T20:48:29.412 INFO:teuthology.orchestra.run.smithi078.stdout:Source: linux-meta 2024-04-18T20:48:29.412 INFO:teuthology.orchestra.run.smithi078.stdout:Version: 5.15.0.102.99 2024-04-18T20:48:29.413 INFO:teuthology.orchestra.run.smithi078.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-102), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-18T20:48:29.413 INFO:teuthology.orchestra.run.smithi078.stdout:Depends: linux-image-5.15.0-102-generic, linux-modules-extra-5.15.0-102-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-18T20:48:29.413 INFO:teuthology.orchestra.run.smithi078.stdout:Recommends: thermald 2024-04-18T20:48:29.413 INFO:teuthology.orchestra.run.smithi078.stdout:Description: Generic Linux kernel image 2024-04-18T20:48:29.413 INFO:teuthology.orchestra.run.smithi078.stdout: This package will always depend on the latest generic kernel image 2024-04-18T20:48:29.413 INFO:teuthology.orchestra.run.smithi078.stdout: available. 2024-04-18T20:48:29.413 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-102-generic 2024-04-18T20:48:29.413 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-18T20:48:29.413 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-18T20:48:29.413 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-18T20:48:29.413 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi078.front.sepia.ceph.com, path=None, version=distro) 2024-04-18T20:48:29.414 DEBUG:teuthology.orchestra.run.smithi078:> sudo apt-get clean 2024-04-18T20:48:29.414 INFO:teuthology.orchestra.run.smithi150.stdout:Found linux image: /boot/vmlinuz-5.15.0-102-generic 2024-04-18T20:48:29.440 INFO:teuthology.orchestra.run.smithi150.stdout:Found initrd image: /boot/initrd.img-5.15.0-102-generic 2024-04-18T20:48:29.596 DEBUG:teuthology.orchestra.run.smithi078:> sudo apt-get update 2024-04-18T20:48:29.714 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-18T20:48:29.753 INFO:teuthology.orchestra.run.smithi150.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-18T20:48:29.759 INFO:teuthology.orchestra.run.smithi150.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-18T20:48:29.827 INFO:teuthology.orchestra.run.smithi150.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-18T20:48:29.828 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-18T20:48:29.832 INFO:teuthology.orchestra.run.smithi150.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-18T20:48:29.924 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-18T20:48:29.991 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-18T20:48:30.007 INFO:teuthology.orchestra.run.smithi150.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-18T20:48:30.007 INFO:teuthology.orchestra.run.smithi150.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-18T20:48:30.007 INFO:teuthology.orchestra.run.smithi150.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-18T20:48:30.053 INFO:teuthology.orchestra.run.smithi150.stdout:done 2024-04-18T20:48:30.218 INFO:teuthology.orchestra.run.smithi187.stdout:Reading package lists... 2024-04-18T20:48:30.236 DEBUG:teuthology.orchestra.run.smithi187:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-18T20:48:30.286 INFO:teuthology.orchestra.run.smithi187.stdout:Reading package lists... 2024-04-18T20:48:30.480 INFO:teuthology.orchestra.run.smithi187.stdout:Building dependency tree... 2024-04-18T20:48:30.480 INFO:teuthology.orchestra.run.smithi187.stdout:Reading state information... 2024-04-18T20:48:30.529 DEBUG:teuthology.orchestra.run.smithi150:> dpkg -s linux-image-generic 2024-04-18T20:48:30.553 INFO:teuthology.orchestra.run.smithi150.stdout:Package: linux-image-generic 2024-04-18T20:48:30.553 INFO:teuthology.orchestra.run.smithi150.stdout:Status: install ok installed 2024-04-18T20:48:30.553 INFO:teuthology.orchestra.run.smithi150.stdout:Priority: optional 2024-04-18T20:48:30.553 INFO:teuthology.orchestra.run.smithi150.stdout:Section: kernel 2024-04-18T20:48:30.553 INFO:teuthology.orchestra.run.smithi150.stdout:Installed-Size: 21 2024-04-18T20:48:30.553 INFO:teuthology.orchestra.run.smithi150.stdout:Maintainer: Ubuntu Kernel Team 2024-04-18T20:48:30.553 INFO:teuthology.orchestra.run.smithi150.stdout:Architecture: amd64 2024-04-18T20:48:30.553 INFO:teuthology.orchestra.run.smithi150.stdout:Source: linux-meta 2024-04-18T20:48:30.553 INFO:teuthology.orchestra.run.smithi150.stdout:Version: 5.15.0.102.99 2024-04-18T20:48:30.554 INFO:teuthology.orchestra.run.smithi150.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-102), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-18T20:48:30.554 INFO:teuthology.orchestra.run.smithi150.stdout:Depends: linux-image-5.15.0-102-generic, linux-modules-extra-5.15.0-102-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-18T20:48:30.554 INFO:teuthology.orchestra.run.smithi150.stdout:Recommends: thermald 2024-04-18T20:48:30.554 INFO:teuthology.orchestra.run.smithi150.stdout:Description: Generic Linux kernel image 2024-04-18T20:48:30.554 INFO:teuthology.orchestra.run.smithi150.stdout: This package will always depend on the latest generic kernel image 2024-04-18T20:48:30.554 INFO:teuthology.orchestra.run.smithi150.stdout: available. 2024-04-18T20:48:30.554 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-102-generic 2024-04-18T20:48:30.554 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-18T20:48:30.554 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-18T20:48:30.554 INFO:teuthology.task.kernel:Installing distro kernel on osd.1... 2024-04-18T20:48:30.554 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi150.front.sepia.ceph.com, path=None, version=distro) 2024-04-18T20:48:30.554 DEBUG:teuthology.orchestra.run.smithi150:> sudo apt-get clean 2024-04-18T20:48:30.635 INFO:teuthology.orchestra.run.smithi187.stdout:linux-image-generic is already the newest version (5.15.0.102.99). 2024-04-18T20:48:30.635 INFO:teuthology.orchestra.run.smithi187.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T20:48:30.635 INFO:teuthology.orchestra.run.smithi187.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T20:48:30.635 INFO:teuthology.orchestra.run.smithi187.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T20:48:30.635 INFO:teuthology.orchestra.run.smithi187.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T20:48:30.636 INFO:teuthology.orchestra.run.smithi187.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-18T20:48:30.636 INFO:teuthology.orchestra.run.smithi187.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-18T20:48:30.636 INFO:teuthology.orchestra.run.smithi187.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T20:48:30.672 INFO:teuthology.orchestra.run.smithi187.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-18T20:48:30.674 DEBUG:teuthology.orchestra.run.smithi187:> dpkg -s linux-image-generic 2024-04-18T20:48:30.722 DEBUG:teuthology.orchestra.run.smithi150:> sudo apt-get update 2024-04-18T20:48:30.732 INFO:teuthology.orchestra.run.smithi187.stdout:Package: linux-image-generic 2024-04-18T20:48:30.732 INFO:teuthology.orchestra.run.smithi187.stdout:Status: install ok installed 2024-04-18T20:48:30.732 INFO:teuthology.orchestra.run.smithi187.stdout:Priority: optional 2024-04-18T20:48:30.732 INFO:teuthology.orchestra.run.smithi187.stdout:Section: kernel 2024-04-18T20:48:30.733 INFO:teuthology.orchestra.run.smithi187.stdout:Installed-Size: 21 2024-04-18T20:48:30.733 INFO:teuthology.orchestra.run.smithi187.stdout:Maintainer: Ubuntu Kernel Team 2024-04-18T20:48:30.733 INFO:teuthology.orchestra.run.smithi187.stdout:Architecture: amd64 2024-04-18T20:48:30.733 INFO:teuthology.orchestra.run.smithi187.stdout:Source: linux-meta 2024-04-18T20:48:30.733 INFO:teuthology.orchestra.run.smithi187.stdout:Version: 5.15.0.102.99 2024-04-18T20:48:30.733 INFO:teuthology.orchestra.run.smithi187.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-102), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-18T20:48:30.733 INFO:teuthology.orchestra.run.smithi187.stdout:Depends: linux-image-5.15.0-102-generic, linux-modules-extra-5.15.0-102-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-18T20:48:30.733 INFO:teuthology.orchestra.run.smithi187.stdout:Recommends: thermald 2024-04-18T20:48:30.733 INFO:teuthology.orchestra.run.smithi187.stdout:Description: Generic Linux kernel image 2024-04-18T20:48:30.733 INFO:teuthology.orchestra.run.smithi187.stdout: This package will always depend on the latest generic kernel image 2024-04-18T20:48:30.733 INFO:teuthology.orchestra.run.smithi187.stdout: available. 2024-04-18T20:48:30.733 DEBUG:teuthology.orchestra.run.smithi187:> mktemp 2024-04-18T20:48:30.777 INFO:teuthology.orchestra.run.smithi187.stdout:/tmp/tmp.zSUIYwvE32 2024-04-18T20:48:30.777 DEBUG:teuthology.orchestra.run.smithi187:> sudo cp /boot/grub/grub.cfg /tmp/tmp.zSUIYwvE32 2024-04-18T20:48:30.852 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 0666 /tmp/tmp.zSUIYwvE32 2024-04-18T20:48:30.879 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-18T20:48:30.963 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-18T20:48:30.973 DEBUG:teuthology.orchestra.remote:smithi187:/tmp/tmp.zSUIYwvE32 is 10KB 2024-04-18T20:48:30.986 DEBUG:teuthology.orchestra.run.smithi187:> rm -fr /tmp/tmp.zSUIYwvE32 2024-04-18T20:48:30.991 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-18T20:48:31.046 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-18T20:48:31.047 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-04-18T20:48:31.047 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-18T20:48:31.047 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-18T20:48:31.106 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2024-04-18T20:48:31.123 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-102-generic 2024-04-18T20:48:31.123 DEBUG:teuthology.orchestra.run.smithi187:> sudo update-grub 2024-04-18T20:48:31.124 DEBUG:teuthology.orchestra.run.smithi078:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-18T20:48:31.127 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-18T20:48:31.186 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2024-04-18T20:48:31.384 INFO:teuthology.orchestra.run.smithi078.stdout:Building dependency tree... 2024-04-18T20:48:31.385 INFO:teuthology.orchestra.run.smithi078.stdout:Reading state information... 2024-04-18T20:48:31.549 INFO:teuthology.orchestra.run.smithi078.stdout:linux-image-generic is already the newest version (5.15.0.102.99). 2024-04-18T20:48:31.549 INFO:teuthology.orchestra.run.smithi078.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T20:48:31.549 INFO:teuthology.orchestra.run.smithi078.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T20:48:31.549 INFO:teuthology.orchestra.run.smithi078.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T20:48:31.549 INFO:teuthology.orchestra.run.smithi078.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T20:48:31.550 INFO:teuthology.orchestra.run.smithi078.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-18T20:48:31.550 INFO:teuthology.orchestra.run.smithi078.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-18T20:48:31.550 INFO:teuthology.orchestra.run.smithi078.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T20:48:31.587 INFO:teuthology.orchestra.run.smithi078.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-18T20:48:31.588 DEBUG:teuthology.orchestra.run.smithi078:> dpkg -s linux-image-generic 2024-04-18T20:48:31.604 INFO:teuthology.orchestra.run.smithi078.stdout:Package: linux-image-generic 2024-04-18T20:48:31.604 INFO:teuthology.orchestra.run.smithi078.stdout:Status: install ok installed 2024-04-18T20:48:31.604 INFO:teuthology.orchestra.run.smithi078.stdout:Priority: optional 2024-04-18T20:48:31.604 INFO:teuthology.orchestra.run.smithi078.stdout:Section: kernel 2024-04-18T20:48:31.604 INFO:teuthology.orchestra.run.smithi078.stdout:Installed-Size: 21 2024-04-18T20:48:31.604 INFO:teuthology.orchestra.run.smithi078.stdout:Maintainer: Ubuntu Kernel Team 2024-04-18T20:48:31.604 INFO:teuthology.orchestra.run.smithi078.stdout:Architecture: amd64 2024-04-18T20:48:31.604 INFO:teuthology.orchestra.run.smithi078.stdout:Source: linux-meta 2024-04-18T20:48:31.604 INFO:teuthology.orchestra.run.smithi078.stdout:Version: 5.15.0.102.99 2024-04-18T20:48:31.604 INFO:teuthology.orchestra.run.smithi078.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-102), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-18T20:48:31.604 INFO:teuthology.orchestra.run.smithi078.stdout:Depends: linux-image-5.15.0-102-generic, linux-modules-extra-5.15.0-102-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-18T20:48:31.605 INFO:teuthology.orchestra.run.smithi078.stdout:Recommends: thermald 2024-04-18T20:48:31.605 INFO:teuthology.orchestra.run.smithi078.stdout:Description: Generic Linux kernel image 2024-04-18T20:48:31.605 INFO:teuthology.orchestra.run.smithi078.stdout: This package will always depend on the latest generic kernel image 2024-04-18T20:48:31.605 INFO:teuthology.orchestra.run.smithi078.stdout: available. 2024-04-18T20:48:31.605 DEBUG:teuthology.orchestra.run.smithi078:> mktemp 2024-04-18T20:48:31.651 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.15cffVvYO0 2024-04-18T20:48:31.652 DEBUG:teuthology.orchestra.run.smithi078:> sudo cp /boot/grub/grub.cfg /tmp/tmp.15cffVvYO0 2024-04-18T20:48:31.707 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.15cffVvYO0 2024-04-18T20:48:31.820 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.15cffVvYO0 is 10KB 2024-04-18T20:48:31.832 DEBUG:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.15cffVvYO0 2024-04-18T20:48:31.839 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-18T20:48:31.891 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-04-18T20:48:31.892 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-18T20:48:31.892 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-18T20:48:31.977 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-102-generic 2024-04-18T20:48:31.977 DEBUG:teuthology.orchestra.run.smithi078:> sudo update-grub 2024-04-18T20:48:32.248 INFO:teuthology.orchestra.run.smithi150.stdout:Reading package lists... 2024-04-18T20:48:32.266 DEBUG:teuthology.orchestra.run.smithi150:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-18T20:48:32.328 INFO:teuthology.orchestra.run.smithi150.stdout:Reading package lists... 2024-04-18T20:48:32.356 INFO:teuthology.orchestra.run.smithi187.stderr:Sourcing file `/etc/default/grub' 2024-04-18T20:48:32.357 INFO:teuthology.orchestra.run.smithi187.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-18T20:48:32.360 INFO:teuthology.orchestra.run.smithi187.stderr:Generating grub configuration file ... 2024-04-18T20:48:32.538 INFO:teuthology.orchestra.run.smithi150.stdout:Building dependency tree... 2024-04-18T20:48:32.539 INFO:teuthology.orchestra.run.smithi150.stdout:Reading state information... 2024-04-18T20:48:32.611 INFO:teuthology.orchestra.run.smithi187.stderr:Found linux image: /boot/vmlinuz-5.15.0-102-generic 2024-04-18T20:48:32.617 INFO:teuthology.orchestra.run.smithi187.stderr:Found initrd image: /boot/initrd.img-5.15.0-102-generic 2024-04-18T20:48:32.717 INFO:teuthology.orchestra.run.smithi150.stdout:linux-image-generic is already the newest version (5.15.0.102.99). 2024-04-18T20:48:32.717 INFO:teuthology.orchestra.run.smithi150.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T20:48:32.717 INFO:teuthology.orchestra.run.smithi150.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T20:48:32.717 INFO:teuthology.orchestra.run.smithi150.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T20:48:32.717 INFO:teuthology.orchestra.run.smithi150.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T20:48:32.718 INFO:teuthology.orchestra.run.smithi150.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-18T20:48:32.718 INFO:teuthology.orchestra.run.smithi150.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-18T20:48:32.718 INFO:teuthology.orchestra.run.smithi150.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T20:48:32.761 INFO:teuthology.orchestra.run.smithi150.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-18T20:48:32.763 DEBUG:teuthology.orchestra.run.smithi150:> dpkg -s linux-image-generic 2024-04-18T20:48:32.776 INFO:teuthology.orchestra.run.smithi150.stdout:Package: linux-image-generic 2024-04-18T20:48:32.776 INFO:teuthology.orchestra.run.smithi150.stdout:Status: install ok installed 2024-04-18T20:48:32.776 INFO:teuthology.orchestra.run.smithi150.stdout:Priority: optional 2024-04-18T20:48:32.776 INFO:teuthology.orchestra.run.smithi150.stdout:Section: kernel 2024-04-18T20:48:32.776 INFO:teuthology.orchestra.run.smithi150.stdout:Installed-Size: 21 2024-04-18T20:48:32.777 INFO:teuthology.orchestra.run.smithi150.stdout:Maintainer: Ubuntu Kernel Team 2024-04-18T20:48:32.777 INFO:teuthology.orchestra.run.smithi150.stdout:Architecture: amd64 2024-04-18T20:48:32.777 INFO:teuthology.orchestra.run.smithi150.stdout:Source: linux-meta 2024-04-18T20:48:32.777 INFO:teuthology.orchestra.run.smithi150.stdout:Version: 5.15.0.102.99 2024-04-18T20:48:32.777 INFO:teuthology.orchestra.run.smithi150.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-102), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-18T20:48:32.777 INFO:teuthology.orchestra.run.smithi150.stdout:Depends: linux-image-5.15.0-102-generic, linux-modules-extra-5.15.0-102-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-18T20:48:32.777 INFO:teuthology.orchestra.run.smithi150.stdout:Recommends: thermald 2024-04-18T20:48:32.777 INFO:teuthology.orchestra.run.smithi150.stdout:Description: Generic Linux kernel image 2024-04-18T20:48:32.777 INFO:teuthology.orchestra.run.smithi150.stdout: This package will always depend on the latest generic kernel image 2024-04-18T20:48:32.777 INFO:teuthology.orchestra.run.smithi150.stdout: available. 2024-04-18T20:48:32.777 DEBUG:teuthology.orchestra.run.smithi150:> mktemp 2024-04-18T20:48:32.824 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.HCUXvxir1J 2024-04-18T20:48:32.824 DEBUG:teuthology.orchestra.run.smithi150:> sudo cp /boot/grub/grub.cfg /tmp/tmp.HCUXvxir1J 2024-04-18T20:48:32.879 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.HCUXvxir1J 2024-04-18T20:48:32.914 INFO:teuthology.orchestra.run.smithi132.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-18T20:48:32.914 INFO:teuthology.orchestra.run.smithi132.stdout:Sourcing file `/etc/default/grub' 2024-04-18T20:48:32.927 INFO:teuthology.orchestra.run.smithi187.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-18T20:48:32.929 INFO:teuthology.orchestra.run.smithi132.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-18T20:48:32.933 INFO:teuthology.orchestra.run.smithi187.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-18T20:48:32.940 INFO:teuthology.orchestra.run.smithi132.stdout:Generating grub configuration file ... 2024-04-18T20:48:32.975 INFO:teuthology.orchestra.run.smithi187.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-18T20:48:32.981 INFO:teuthology.orchestra.run.smithi187.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-18T20:48:33.009 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.HCUXvxir1J is 10KB 2024-04-18T20:48:33.023 DEBUG:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.HCUXvxir1J 2024-04-18T20:48:33.028 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-18T20:48:33.084 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-04-18T20:48:33.085 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-18T20:48:33.085 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-18T20:48:33.110 INFO:teuthology.orchestra.run.smithi187.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-18T20:48:33.110 INFO:teuthology.orchestra.run.smithi187.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-18T20:48:33.110 INFO:teuthology.orchestra.run.smithi187.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-18T20:48:33.122 INFO:teuthology.orchestra.run.smithi187.stderr:done 2024-04-18T20:48:33.140 DEBUG:teuthology.orchestra.run.smithi187:> sudo shutdown -r now 2024-04-18T20:48:33.152 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-102-generic 2024-04-18T20:48:33.152 DEBUG:teuthology.orchestra.run.smithi150:> sudo update-grub 2024-04-18T20:48:33.284 INFO:teuthology.orchestra.run.smithi132.stdout:Found linux image: /boot/vmlinuz-5.15.0-102-generic 2024-04-18T20:48:33.298 INFO:teuthology.orchestra.run.smithi132.stdout:Found initrd image: /boot/initrd.img-5.15.0-102-generic 2024-04-18T20:48:33.345 INFO:teuthology.orchestra.run.smithi078.stderr:Sourcing file `/etc/default/grub' 2024-04-18T20:48:33.346 INFO:teuthology.orchestra.run.smithi078.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-18T20:48:33.349 INFO:teuthology.orchestra.run.smithi078.stderr:Generating grub configuration file ... 2024-04-18T20:48:33.530 INFO:teuthology.orchestra.run.smithi078.stderr:Found linux image: /boot/vmlinuz-5.15.0-102-generic 2024-04-18T20:48:33.535 INFO:teuthology.orchestra.run.smithi078.stderr:Found initrd image: /boot/initrd.img-5.15.0-102-generic 2024-04-18T20:48:33.636 INFO:teuthology.orchestra.run.smithi132.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-18T20:48:33.642 INFO:teuthology.orchestra.run.smithi132.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-18T20:48:33.702 INFO:teuthology.orchestra.run.smithi132.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-18T20:48:33.707 INFO:teuthology.orchestra.run.smithi132.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-18T20:48:33.803 INFO:teuthology.orchestra.run.smithi078.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-18T20:48:33.808 INFO:teuthology.orchestra.run.smithi078.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-18T20:48:33.846 INFO:teuthology.orchestra.run.smithi078.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-18T20:48:33.852 INFO:teuthology.orchestra.run.smithi078.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-18T20:48:33.878 INFO:teuthology.orchestra.run.smithi132.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-18T20:48:33.879 INFO:teuthology.orchestra.run.smithi132.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-18T20:48:33.879 INFO:teuthology.orchestra.run.smithi132.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-18T20:48:33.919 INFO:teuthology.orchestra.run.smithi132.stdout:done 2024-04-18T20:48:33.977 INFO:teuthology.orchestra.run.smithi078.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-18T20:48:33.977 INFO:teuthology.orchestra.run.smithi078.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-18T20:48:33.977 INFO:teuthology.orchestra.run.smithi078.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-18T20:48:33.987 INFO:teuthology.orchestra.run.smithi078.stderr:done 2024-04-18T20:48:34.003 DEBUG:teuthology.orchestra.run.smithi078:> sudo shutdown -r now 2024-04-18T20:48:34.397 DEBUG:teuthology.orchestra.run.smithi132:> dpkg -s linux-image-generic 2024-04-18T20:48:34.413 INFO:teuthology.orchestra.run.smithi132.stdout:Package: linux-image-generic 2024-04-18T20:48:34.413 INFO:teuthology.orchestra.run.smithi132.stdout:Status: install ok installed 2024-04-18T20:48:34.413 INFO:teuthology.orchestra.run.smithi132.stdout:Priority: optional 2024-04-18T20:48:34.413 INFO:teuthology.orchestra.run.smithi132.stdout:Section: kernel 2024-04-18T20:48:34.414 INFO:teuthology.orchestra.run.smithi132.stdout:Installed-Size: 21 2024-04-18T20:48:34.414 INFO:teuthology.orchestra.run.smithi132.stdout:Maintainer: Ubuntu Kernel Team 2024-04-18T20:48:34.414 INFO:teuthology.orchestra.run.smithi132.stdout:Architecture: amd64 2024-04-18T20:48:34.414 INFO:teuthology.orchestra.run.smithi132.stdout:Source: linux-meta 2024-04-18T20:48:34.414 INFO:teuthology.orchestra.run.smithi132.stdout:Version: 5.15.0.102.99 2024-04-18T20:48:34.414 INFO:teuthology.orchestra.run.smithi132.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-102), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-18T20:48:34.414 INFO:teuthology.orchestra.run.smithi132.stdout:Depends: linux-image-5.15.0-102-generic, linux-modules-extra-5.15.0-102-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-18T20:48:34.414 INFO:teuthology.orchestra.run.smithi132.stdout:Recommends: thermald 2024-04-18T20:48:34.414 INFO:teuthology.orchestra.run.smithi132.stdout:Description: Generic Linux kernel image 2024-04-18T20:48:34.414 INFO:teuthology.orchestra.run.smithi132.stdout: This package will always depend on the latest generic kernel image 2024-04-18T20:48:34.414 INFO:teuthology.orchestra.run.smithi132.stdout: available. 2024-04-18T20:48:34.415 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-102-generic 2024-04-18T20:48:34.415 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-18T20:48:34.415 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-18T20:48:34.415 INFO:teuthology.task.kernel:Installing distro kernel on osd.0... 2024-04-18T20:48:34.415 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi132.front.sepia.ceph.com, path=None, version=distro) 2024-04-18T20:48:34.415 DEBUG:teuthology.orchestra.run.smithi132:> sudo apt-get clean 2024-04-18T20:48:34.432 INFO:teuthology.orchestra.run.smithi150.stderr:Sourcing file `/etc/default/grub' 2024-04-18T20:48:34.433 INFO:teuthology.orchestra.run.smithi150.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-18T20:48:34.435 INFO:teuthology.orchestra.run.smithi150.stderr:Generating grub configuration file ... 2024-04-18T20:48:34.595 DEBUG:teuthology.orchestra.run.smithi132:> sudo apt-get update 2024-04-18T20:48:34.662 INFO:teuthology.orchestra.run.smithi150.stderr:Found linux image: /boot/vmlinuz-5.15.0-102-generic 2024-04-18T20:48:34.668 INFO:teuthology.orchestra.run.smithi150.stderr:Found initrd image: /boot/initrd.img-5.15.0-102-generic 2024-04-18T20:48:34.731 INFO:teuthology.orchestra.run.smithi132.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-18T20:48:34.731 INFO:teuthology.orchestra.run.smithi132.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-18T20:48:34.731 INFO:teuthology.orchestra.run.smithi132.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-18T20:48:34.751 INFO:teuthology.orchestra.run.smithi132.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-18T20:48:34.907 INFO:teuthology.orchestra.run.smithi150.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-18T20:48:34.912 INFO:teuthology.orchestra.run.smithi150.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-18T20:48:34.952 INFO:teuthology.orchestra.run.smithi150.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-18T20:48:34.957 INFO:teuthology.orchestra.run.smithi150.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-18T20:48:35.089 INFO:teuthology.orchestra.run.smithi150.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-18T20:48:35.089 INFO:teuthology.orchestra.run.smithi150.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-18T20:48:35.089 INFO:teuthology.orchestra.run.smithi150.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-18T20:48:35.109 INFO:teuthology.orchestra.run.smithi150.stderr:done 2024-04-18T20:48:35.111 DEBUG:teuthology.orchestra.run.smithi150:> sudo shutdown -r now 2024-04-18T20:48:36.026 INFO:teuthology.orchestra.run.smithi132.stdout:Reading package lists... 2024-04-18T20:48:36.045 DEBUG:teuthology.orchestra.run.smithi132:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-18T20:48:36.095 INFO:teuthology.orchestra.run.smithi132.stdout:Reading package lists... 2024-04-18T20:48:36.274 INFO:teuthology.orchestra.run.smithi132.stdout:Building dependency tree... 2024-04-18T20:48:36.274 INFO:teuthology.orchestra.run.smithi132.stdout:Reading state information... 2024-04-18T20:48:36.432 INFO:teuthology.orchestra.run.smithi132.stdout:linux-image-generic is already the newest version (5.15.0.102.99). 2024-04-18T20:48:36.432 INFO:teuthology.orchestra.run.smithi132.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T20:48:36.432 INFO:teuthology.orchestra.run.smithi132.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T20:48:36.432 INFO:teuthology.orchestra.run.smithi132.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T20:48:36.433 INFO:teuthology.orchestra.run.smithi132.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T20:48:36.433 INFO:teuthology.orchestra.run.smithi132.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-18T20:48:36.433 INFO:teuthology.orchestra.run.smithi132.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-18T20:48:36.433 INFO:teuthology.orchestra.run.smithi132.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T20:48:36.471 INFO:teuthology.orchestra.run.smithi132.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-18T20:48:36.473 DEBUG:teuthology.orchestra.run.smithi132:> dpkg -s linux-image-generic 2024-04-18T20:48:36.526 INFO:teuthology.orchestra.run.smithi132.stdout:Package: linux-image-generic 2024-04-18T20:48:36.526 INFO:teuthology.orchestra.run.smithi132.stdout:Status: install ok installed 2024-04-18T20:48:36.526 INFO:teuthology.orchestra.run.smithi132.stdout:Priority: optional 2024-04-18T20:48:36.526 INFO:teuthology.orchestra.run.smithi132.stdout:Section: kernel 2024-04-18T20:48:36.526 INFO:teuthology.orchestra.run.smithi132.stdout:Installed-Size: 21 2024-04-18T20:48:36.526 INFO:teuthology.orchestra.run.smithi132.stdout:Maintainer: Ubuntu Kernel Team 2024-04-18T20:48:36.526 INFO:teuthology.orchestra.run.smithi132.stdout:Architecture: amd64 2024-04-18T20:48:36.526 INFO:teuthology.orchestra.run.smithi132.stdout:Source: linux-meta 2024-04-18T20:48:36.526 INFO:teuthology.orchestra.run.smithi132.stdout:Version: 5.15.0.102.99 2024-04-18T20:48:36.526 INFO:teuthology.orchestra.run.smithi132.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-102), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-18T20:48:36.527 INFO:teuthology.orchestra.run.smithi132.stdout:Depends: linux-image-5.15.0-102-generic, linux-modules-extra-5.15.0-102-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-18T20:48:36.527 INFO:teuthology.orchestra.run.smithi132.stdout:Recommends: thermald 2024-04-18T20:48:36.527 INFO:teuthology.orchestra.run.smithi132.stdout:Description: Generic Linux kernel image 2024-04-18T20:48:36.527 INFO:teuthology.orchestra.run.smithi132.stdout: This package will always depend on the latest generic kernel image 2024-04-18T20:48:36.527 INFO:teuthology.orchestra.run.smithi132.stdout: available. 2024-04-18T20:48:36.527 DEBUG:teuthology.orchestra.run.smithi132:> mktemp 2024-04-18T20:48:36.574 INFO:teuthology.orchestra.run.smithi132.stdout:/tmp/tmp.tE1BwGf5VU 2024-04-18T20:48:36.574 DEBUG:teuthology.orchestra.run.smithi132:> sudo cp /boot/grub/grub.cfg /tmp/tmp.tE1BwGf5VU 2024-04-18T20:48:36.631 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 0666 /tmp/tmp.tE1BwGf5VU 2024-04-18T20:48:36.748 DEBUG:teuthology.orchestra.remote:smithi132:/tmp/tmp.tE1BwGf5VU is 10KB 2024-04-18T20:48:36.761 DEBUG:teuthology.orchestra.run.smithi132:> rm -fr /tmp/tmp.tE1BwGf5VU 2024-04-18T20:48:36.766 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-18T20:48:36.822 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-18T20:48:36.822 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-18T20:48:36.822 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-18T20:48:36.890 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-102-generic 2024-04-18T20:48:36.890 DEBUG:teuthology.orchestra.run.smithi132:> sudo update-grub 2024-04-18T20:48:38.138 INFO:teuthology.orchestra.run.smithi132.stderr:Sourcing file `/etc/default/grub' 2024-04-18T20:48:38.139 INFO:teuthology.orchestra.run.smithi132.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-18T20:48:38.141 INFO:teuthology.orchestra.run.smithi132.stderr:Generating grub configuration file ... 2024-04-18T20:48:38.326 INFO:teuthology.orchestra.run.smithi132.stderr:Found linux image: /boot/vmlinuz-5.15.0-102-generic 2024-04-18T20:48:38.332 INFO:teuthology.orchestra.run.smithi132.stderr:Found initrd image: /boot/initrd.img-5.15.0-102-generic 2024-04-18T20:48:38.618 INFO:teuthology.orchestra.run.smithi132.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-18T20:48:38.624 INFO:teuthology.orchestra.run.smithi132.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-18T20:48:38.664 INFO:teuthology.orchestra.run.smithi132.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-18T20:48:38.669 INFO:teuthology.orchestra.run.smithi132.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-18T20:48:38.803 INFO:teuthology.orchestra.run.smithi132.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-18T20:48:38.803 INFO:teuthology.orchestra.run.smithi132.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-18T20:48:38.803 INFO:teuthology.orchestra.run.smithi132.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-18T20:48:38.821 INFO:teuthology.orchestra.run.smithi132.stderr:done 2024-04-18T20:48:38.823 DEBUG:teuthology.orchestra.run.smithi132:> sudo shutdown -r now 2024-04-18T20:49:03.166 INFO:teuthology.task.kernel:Checking client osd.2 for new kernel version... 2024-04-18T20:49:03.166 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-04-18T20:49:03.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T20:49:04.006 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T20:49:04.006 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-04-18T20:49:04.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T20:49:05.115 INFO:teuthology.task.kernel:Checking client osd.1 for new kernel version... 2024-04-18T20:49:05.115 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-04-18T20:49:05.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T20:49:08.826 INFO:teuthology.task.kernel:Checking client osd.0 for new kernel version... 2024-04-18T20:49:08.826 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2024-04-18T20:49:08.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T20:49:21.694 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-04-18T20:49:22.462 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.78 2024-04-18T20:49:23.486 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-04-18T20:49:27.326 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.132 2024-04-18T20:49:30.699 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-04-18T20:49:30.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T20:49:31.464 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-04-18T20:49:31.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T20:49:32.488 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-04-18T20:49:32.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T20:49:33.758 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-04-18T20:49:34.526 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.78 2024-04-18T20:49:35.550 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-04-18T20:49:36.328 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2024-04-18T20:49:36.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T20:49:39.394 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.132 2024-04-18T20:49:45.950 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-04-18T20:49:45.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T20:49:46.528 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-04-18T20:49:46.529 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T20:49:47.552 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-04-18T20:49:47.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T20:49:51.398 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2024-04-18T20:49:51.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T20:50:04.958 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.78 2024-04-18T20:50:09.829 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.132 2024-04-18T20:50:18.297 DEBUG:teuthology.orchestra.run.smithi187:> true 2024-04-18T20:50:18.877 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-04-18T20:50:18.877 INFO:teuthology.task.kernel:Checking kernel version of osd.2, want "5.15.0-102-generic"... 2024-04-18T20:50:18.877 DEBUG:teuthology.orchestra.run.smithi187:> uname -r 2024-04-18T20:50:18.923 INFO:teuthology.orchestra.run.smithi187.stdout:5.15.0-102-generic 2024-04-18T20:50:18.923 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-102-generic vs 5.15.0-102-generic 2024-04-18T20:50:18.923 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-18T20:50:18.923 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T20:50:19.924 INFO:teuthology.task.kernel:Enabling kdb on osd.2... 2024-04-18T20:50:19.924 DEBUG:teuthology.orchestra.run.smithi187:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-18T20:50:19.959 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-04-18T20:50:19.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T20:50:19.996 INFO:teuthology.orchestra.run.smithi187.stdout:ttyS1 2024-04-18T20:50:20.067 DEBUG:teuthology.parallel:result is None 2024-04-18T20:50:20.376 DEBUG:teuthology.orchestra.run.smithi078:> true 2024-04-18T20:50:21.347 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-04-18T20:50:21.348 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T20:50:21.348 DEBUG:teuthology.orchestra.run.smithi078:> uname -r 2024-04-18T20:50:21.354 INFO:teuthology.orchestra.run.smithi078.stdout:5.15.0-102-generic 2024-04-18T20:50:21.354 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-102-generic vs 5.15.0-102-generic 2024-04-18T20:50:21.354 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-18T20:50:21.354 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T20:50:22.355 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-18T20:50:22.355 DEBUG:teuthology.orchestra.run.smithi078:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-18T20:50:22.707 INFO:teuthology.orchestra.run.smithi078.stdout:ttyS1 2024-04-18T20:50:22.743 DEBUG:teuthology.parallel:result is None 2024-04-18T20:50:24.830 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2024-04-18T20:50:24.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T20:50:25.142 DEBUG:teuthology.orchestra.run.smithi132:> true 2024-04-18T20:50:25.730 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi132.front.sepia.ceph.com' 2024-04-18T20:50:25.730 INFO:teuthology.task.kernel:Checking kernel version of osd.0, want "5.15.0-102-generic"... 2024-04-18T20:50:25.730 DEBUG:teuthology.orchestra.run.smithi132:> uname -r 2024-04-18T20:50:25.778 INFO:teuthology.orchestra.run.smithi132.stdout:5.15.0-102-generic 2024-04-18T20:50:25.778 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-102-generic vs 5.15.0-102-generic 2024-04-18T20:50:25.778 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-18T20:50:25.778 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T20:50:26.779 INFO:teuthology.task.kernel:Enabling kdb on osd.0... 2024-04-18T20:50:26.779 DEBUG:teuthology.orchestra.run.smithi132:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-18T20:50:26.847 INFO:teuthology.orchestra.run.smithi132.stdout:ttyS1 2024-04-18T20:50:26.887 DEBUG:teuthology.parallel:result is None 2024-04-18T20:50:47.557 DEBUG:teuthology.orchestra.remote:timed out 2024-04-18T20:51:02.558 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-04-18T20:51:02.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T20:51:02.822 DEBUG:teuthology.orchestra.run.smithi150:> true 2024-04-18T20:51:03.423 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-04-18T20:51:03.423 INFO:teuthology.task.kernel:Checking kernel version of osd.1, want "5.15.0-102-generic"... 2024-04-18T20:51:03.424 DEBUG:teuthology.orchestra.run.smithi150:> uname -r 2024-04-18T20:51:03.472 INFO:teuthology.orchestra.run.smithi150.stdout:5.15.0-102-generic 2024-04-18T20:51:03.472 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-102-generic vs 5.15.0-102-generic 2024-04-18T20:51:03.472 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-18T20:51:03.472 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T20:51:04.473 INFO:teuthology.task.kernel:Enabling kdb on osd.1... 2024-04-18T20:51:04.474 DEBUG:teuthology.orchestra.run.smithi150:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-18T20:51:04.835 INFO:teuthology.orchestra.run.smithi150.stdout:ttyS1 2024-04-18T20:51:04.873 DEBUG:teuthology.parallel:result is None 2024-04-18T20:51:04.874 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-18T20:51:04.881 INFO:teuthology.task.internal:Creating test directory... 2024-04-18T20:51:04.881 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-18T20:51:04.884 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-18T20:51:04.886 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-18T20:51:04.889 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-18T20:51:04.895 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-18T20:51:04.905 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-18T20:51:04.911 INFO:teuthology.task.internal:Creating archive directory... 2024-04-18T20:51:04.911 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-18T20:51:04.932 DEBUG:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-18T20:51:04.935 DEBUG:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-18T20:51:04.941 DEBUG:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-18T20:51:05.052 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-18T20:51:05.059 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-18T20:51:05.059 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-18T20:51:05.061 DEBUG:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-18T20:51:05.064 DEBUG:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-18T20:51:05.066 DEBUG:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-18T20:51:05.083 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-18T20:51:05.088 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-18T20:51:05.089 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-18T20:51:05.102 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-18T20:51:05.104 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-18T20:51:05.104 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-18T20:51:05.104 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-18T20:51:05.108 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-18T20:51:05.110 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-18T20:51:05.117 INFO:teuthology.task.internal:Configuring sudo... 2024-04-18T20:51:05.118 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-18T20:51:05.151 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-18T20:51:05.154 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-18T20:51:05.157 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-18T20:51:05.173 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-18T20:51:05.184 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-18T20:51:05.184 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-18T20:51:05.206 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-18T20:51:05.212 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-18T20:51:05.217 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-18T20:51:05.223 DEBUG:teuthology.orchestra.run.smithi078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-18T20:51:05.256 DEBUG:teuthology.orchestra.run.smithi078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-18T20:51:05.302 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-04-18T20:51:05.302 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-18T20:51:05.366 DEBUG:teuthology.orchestra.run.smithi132:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-18T20:51:05.380 DEBUG:teuthology.orchestra.run.smithi132:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-18T20:51:05.430 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-18T20:51:05.430 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-18T20:51:05.500 DEBUG:teuthology.orchestra.run.smithi150:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-18T20:51:05.506 DEBUG:teuthology.orchestra.run.smithi150:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-18T20:51:05.554 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-04-18T20:51:05.555 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-18T20:51:05.620 DEBUG:teuthology.orchestra.run.smithi187:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-18T20:51:05.626 DEBUG:teuthology.orchestra.run.smithi187:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-18T20:51:05.675 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-04-18T20:51:05.675 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-18T20:51:05.768 DEBUG:teuthology.orchestra.run.smithi078:> sudo service rsyslog restart 2024-04-18T20:51:05.770 DEBUG:teuthology.orchestra.run.smithi132:> sudo service rsyslog restart 2024-04-18T20:51:05.773 DEBUG:teuthology.orchestra.run.smithi150:> sudo service rsyslog restart 2024-04-18T20:51:05.776 DEBUG:teuthology.orchestra.run.smithi187:> sudo service rsyslog restart 2024-04-18T20:51:05.859 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-18T20:51:05.894 INFO:teuthology.task.internal:Starting timer... 2024-04-18T20:51:05.894 INFO:teuthology.run_tasks:Running task pcp... 2024-04-18T20:51:05.909 INFO:teuthology.run_tasks:Running task selinux... 2024-04-18T20:51:05.957 DEBUG:teuthology.task.selinux:Excluding smithi078: OS 'ubuntu' does not support SELinux 2024-04-18T20:51:05.957 DEBUG:teuthology.task.selinux:Excluding smithi132: OS 'ubuntu' does not support SELinux 2024-04-18T20:51:05.957 DEBUG:teuthology.task.selinux:Excluding smithi150: OS 'ubuntu' does not support SELinux 2024-04-18T20:51:05.957 DEBUG:teuthology.task.selinux:Excluding smithi187: OS 'ubuntu' does not support SELinux 2024-04-18T20:51:05.958 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-18T20:51:05.958 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-18T20:51:05.958 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-18T20:51:05.959 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-18T20:51:05.968 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-18T20:51:06.008 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-18T20:51:06.010 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi078.front.sepia.ceph.com,smithi132.front.sepia.ceph.com,smithi150.front.sepia.ceph.com,smithi187.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-18T20:59:13.195 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi078.front.sepia.ceph.com'), Remote(name='ubuntu@smithi132.front.sepia.ceph.com'), Remote(name='ubuntu@smithi150.front.sepia.ceph.com'), Remote(name='ubuntu@smithi187.front.sepia.ceph.com')] 2024-04-18T20:59:13.196 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-04-18T20:59:13.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T20:59:13.293 DEBUG:teuthology.orchestra.run.smithi078:> true 2024-04-18T20:59:13.370 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-04-18T20:59:13.371 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2024-04-18T20:59:13.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T20:59:13.451 DEBUG:teuthology.orchestra.run.smithi132:> true 2024-04-18T20:59:13.526 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi132.front.sepia.ceph.com' 2024-04-18T20:59:13.526 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-04-18T20:59:13.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T20:59:13.608 DEBUG:teuthology.orchestra.run.smithi150:> true 2024-04-18T20:59:13.682 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-04-18T20:59:13.682 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-04-18T20:59:13.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T20:59:13.783 DEBUG:teuthology.orchestra.run.smithi187:> true 2024-04-18T20:59:13.858 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-04-18T20:59:13.860 INFO:teuthology.run_tasks:Running task clock... 2024-04-18T20:59:13.869 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-18T20:59:13.870 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-18T20:59:13.870 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-18T20:59:13.873 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-18T20:59:13.873 DEBUG:teuthology.orchestra.run.smithi132:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-18T20:59:13.876 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-18T20:59:13.877 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-18T20:59:13.880 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-18T20:59:13.880 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-18T20:59:13.902 INFO:teuthology.orchestra.run.smithi078.stdout:18 Apr 20:59:13 ntpd[17201]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-18T20:59:13.902 INFO:teuthology.orchestra.run.smithi078.stdout:18 Apr 20:59:13 ntpd[17201]: Command line: ntpd -gq 2024-04-18T20:59:13.902 INFO:teuthology.orchestra.run.smithi078.stdout:18 Apr 20:59:13 ntpd[17201]: ---------------------------------------------------- 2024-04-18T20:59:13.902 INFO:teuthology.orchestra.run.smithi078.stdout:18 Apr 20:59:13 ntpd[17201]: ntp-4 is maintained by Network Time Foundation, 2024-04-18T20:59:13.902 INFO:teuthology.orchestra.run.smithi078.stdout:18 Apr 20:59:13 ntpd[17201]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-18T20:59:13.902 INFO:teuthology.orchestra.run.smithi078.stdout:18 Apr 20:59:13 ntpd[17201]: corporation. Support and training for ntp-4 are 2024-04-18T20:59:13.903 INFO:teuthology.orchestra.run.smithi078.stdout:18 Apr 20:59:13 ntpd[17201]: available at https://www.nwtime.org/support 2024-04-18T20:59:13.903 INFO:teuthology.orchestra.run.smithi078.stdout:18 Apr 20:59:13 ntpd[17201]: ---------------------------------------------------- 2024-04-18T20:59:13.903 INFO:teuthology.orchestra.run.smithi078.stdout:18 Apr 20:59:13 ntpd[17201]: proto: precision = 0.044 usec (-24) 2024-04-18T20:59:13.903 INFO:teuthology.orchestra.run.smithi078.stdout:18 Apr 20:59:13 ntpd[17201]: basedate set to 2022-02-04 2024-04-18T20:59:13.903 INFO:teuthology.orchestra.run.smithi078.stdout:18 Apr 20:59:13 ntpd[17201]: gps base set to 2022-02-06 (week 2196) 2024-04-18T20:59:13.903 INFO:teuthology.orchestra.run.smithi078.stdout:18 Apr 20:59:13 ntpd[17201]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-18T20:59:13.904 INFO:teuthology.orchestra.run.smithi078.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-18T20:59:13.904 INFO:teuthology.orchestra.run.smithi078.stdout:18 Apr 20:59:13 ntpd[17201]: restrict ::: KOD does nothing without LIMITED. 2024-04-18T20:59:13.905 INFO:teuthology.orchestra.run.smithi078.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-18T20:59:13.906 INFO:teuthology.orchestra.run.smithi078.stdout:18 Apr 20:59:13 ntpd[17201]: Listen and drop on 0 v6wildcard [::]:123 2024-04-18T20:59:13.906 INFO:teuthology.orchestra.run.smithi078.stdout:18 Apr 20:59:13 ntpd[17201]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-18T20:59:13.907 INFO:teuthology.orchestra.run.smithi078.stdout:18 Apr 20:59:13 ntpd[17201]: Listen normally on 2 lo 127.0.0.1:123 2024-04-18T20:59:13.907 INFO:teuthology.orchestra.run.smithi078.stdout:18 Apr 20:59:13 ntpd[17201]: Listen normally on 3 enp3s0f1 172.21.15.78:123 2024-04-18T20:59:13.907 INFO:teuthology.orchestra.run.smithi078.stdout:18 Apr 20:59:13 ntpd[17201]: Listen normally on 4 lo [::1]:123 2024-04-18T20:59:13.907 INFO:teuthology.orchestra.run.smithi078.stdout:18 Apr 20:59:13 ntpd[17201]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d4dd%5]:123 2024-04-18T20:59:13.907 INFO:teuthology.orchestra.run.smithi078.stdout:18 Apr 20:59:13 ntpd[17201]: Listening on routing socket on fd #22 for interface updates 2024-04-18T20:59:13.911 INFO:teuthology.orchestra.run.smithi150.stdout:18 Apr 20:59:13 ntpd[17223]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-18T20:59:13.911 INFO:teuthology.orchestra.run.smithi150.stdout:18 Apr 20:59:13 ntpd[17223]: Command line: ntpd -gq 2024-04-18T20:59:13.911 INFO:teuthology.orchestra.run.smithi150.stdout:18 Apr 20:59:13 ntpd[17223]: ---------------------------------------------------- 2024-04-18T20:59:13.911 INFO:teuthology.orchestra.run.smithi150.stdout:18 Apr 20:59:13 ntpd[17223]: ntp-4 is maintained by Network Time Foundation, 2024-04-18T20:59:13.911 INFO:teuthology.orchestra.run.smithi150.stdout:18 Apr 20:59:13 ntpd[17223]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-18T20:59:13.911 INFO:teuthology.orchestra.run.smithi150.stdout:18 Apr 20:59:13 ntpd[17223]: corporation. Support and training for ntp-4 are 2024-04-18T20:59:13.912 INFO:teuthology.orchestra.run.smithi150.stdout:18 Apr 20:59:13 ntpd[17223]: available at https://www.nwtime.org/support 2024-04-18T20:59:13.912 INFO:teuthology.orchestra.run.smithi150.stdout:18 Apr 20:59:13 ntpd[17223]: ---------------------------------------------------- 2024-04-18T20:59:13.912 INFO:teuthology.orchestra.run.smithi150.stdout:18 Apr 20:59:13 ntpd[17223]: proto: precision = 0.068 usec (-24) 2024-04-18T20:59:13.912 INFO:teuthology.orchestra.run.smithi150.stdout:18 Apr 20:59:13 ntpd[17223]: basedate set to 2022-02-04 2024-04-18T20:59:13.912 INFO:teuthology.orchestra.run.smithi150.stdout:18 Apr 20:59:13 ntpd[17223]: gps base set to 2022-02-06 (week 2196) 2024-04-18T20:59:13.913 INFO:teuthology.orchestra.run.smithi150.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-18T20:59:13.913 INFO:teuthology.orchestra.run.smithi132.stdout:18 Apr 20:59:13 ntpd[17244]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-18T20:59:13.913 INFO:teuthology.orchestra.run.smithi132.stdout:18 Apr 20:59:13 ntpd[17244]: Command line: ntpd -gq 2024-04-18T20:59:13.913 INFO:teuthology.orchestra.run.smithi132.stdout:18 Apr 20:59:13 ntpd[17244]: ---------------------------------------------------- 2024-04-18T20:59:13.913 INFO:teuthology.orchestra.run.smithi132.stdout:18 Apr 20:59:13 ntpd[17244]: ntp-4 is maintained by Network Time Foundation, 2024-04-18T20:59:13.913 INFO:teuthology.orchestra.run.smithi132.stdout:18 Apr 20:59:13 ntpd[17244]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-18T20:59:13.914 INFO:teuthology.orchestra.run.smithi132.stdout:18 Apr 20:59:13 ntpd[17244]: corporation. Support and training for ntp-4 are 2024-04-18T20:59:13.914 INFO:teuthology.orchestra.run.smithi132.stdout:18 Apr 20:59:13 ntpd[17244]: available at https://www.nwtime.org/support 2024-04-18T20:59:13.914 INFO:teuthology.orchestra.run.smithi132.stdout:18 Apr 20:59:13 ntpd[17244]: ---------------------------------------------------- 2024-04-18T20:59:13.914 INFO:teuthology.orchestra.run.smithi132.stdout:18 Apr 20:59:13 ntpd[17244]: proto: precision = 0.061 usec (-24) 2024-04-18T20:59:13.914 INFO:teuthology.orchestra.run.smithi132.stdout:18 Apr 20:59:13 ntpd[17244]: basedate set to 2022-02-04 2024-04-18T20:59:13.914 INFO:teuthology.orchestra.run.smithi132.stdout:18 Apr 20:59:13 ntpd[17244]: gps base set to 2022-02-06 (week 2196) 2024-04-18T20:59:13.915 INFO:teuthology.orchestra.run.smithi132.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-18T20:59:13.915 INFO:teuthology.orchestra.run.smithi150.stdout:18 Apr 20:59:13 ntpd[17223]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-18T20:59:13.916 INFO:teuthology.orchestra.run.smithi150.stdout:18 Apr 20:59:13 ntpd[17223]: restrict ::: KOD does nothing without LIMITED. 2024-04-18T20:59:13.916 INFO:teuthology.orchestra.run.smithi150.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-18T20:59:13.917 INFO:teuthology.orchestra.run.smithi132.stdout:18 Apr 20:59:13 ntpd[17244]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-18T20:59:13.917 INFO:teuthology.orchestra.run.smithi132.stdout:18 Apr 20:59:13 ntpd[17244]: restrict ::: KOD does nothing without LIMITED. 2024-04-18T20:59:13.917 INFO:teuthology.orchestra.run.smithi132.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-18T20:59:13.921 INFO:teuthology.orchestra.run.smithi150.stdout:18 Apr 20:59:13 ntpd[17223]: Listen and drop on 0 v6wildcard [::]:123 2024-04-18T20:59:13.921 INFO:teuthology.orchestra.run.smithi150.stdout:18 Apr 20:59:13 ntpd[17223]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-18T20:59:13.921 INFO:teuthology.orchestra.run.smithi150.stdout:18 Apr 20:59:13 ntpd[17223]: Listen normally on 2 lo 127.0.0.1:123 2024-04-18T20:59:13.921 INFO:teuthology.orchestra.run.smithi150.stdout:18 Apr 20:59:13 ntpd[17223]: Listen normally on 3 enp3s0f1 172.21.15.150:123 2024-04-18T20:59:13.921 INFO:teuthology.orchestra.run.smithi150.stdout:18 Apr 20:59:13 ntpd[17223]: Listen normally on 4 lo [::1]:123 2024-04-18T20:59:13.921 INFO:teuthology.orchestra.run.smithi150.stdout:18 Apr 20:59:13 ntpd[17223]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6e35%5]:123 2024-04-18T20:59:13.922 INFO:teuthology.orchestra.run.smithi150.stdout:18 Apr 20:59:13 ntpd[17223]: Listening on routing socket on fd #22 for interface updates 2024-04-18T20:59:13.922 INFO:teuthology.orchestra.run.smithi132.stdout:18 Apr 20:59:13 ntpd[17244]: Listen and drop on 0 v6wildcard [::]:123 2024-04-18T20:59:13.922 INFO:teuthology.orchestra.run.smithi132.stdout:18 Apr 20:59:13 ntpd[17244]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-18T20:59:13.922 INFO:teuthology.orchestra.run.smithi132.stdout:18 Apr 20:59:13 ntpd[17244]: Listen normally on 2 lo 127.0.0.1:123 2024-04-18T20:59:13.922 INFO:teuthology.orchestra.run.smithi132.stdout:18 Apr 20:59:13 ntpd[17244]: Listen normally on 3 enp3s0f1 172.21.15.132:123 2024-04-18T20:59:13.922 INFO:teuthology.orchestra.run.smithi132.stdout:18 Apr 20:59:13 ntpd[17244]: Listen normally on 4 lo [::1]:123 2024-04-18T20:59:13.922 INFO:teuthology.orchestra.run.smithi132.stdout:18 Apr 20:59:13 ntpd[17244]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:773f%5]:123 2024-04-18T20:59:13.922 INFO:teuthology.orchestra.run.smithi132.stdout:18 Apr 20:59:13 ntpd[17244]: Listening on routing socket on fd #22 for interface updates 2024-04-18T20:59:13.928 INFO:teuthology.orchestra.run.smithi187.stdout:18 Apr 20:59:13 ntpd[17249]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-18T20:59:13.928 INFO:teuthology.orchestra.run.smithi187.stdout:18 Apr 20:59:13 ntpd[17249]: Command line: ntpd -gq 2024-04-18T20:59:13.928 INFO:teuthology.orchestra.run.smithi187.stdout:18 Apr 20:59:13 ntpd[17249]: ---------------------------------------------------- 2024-04-18T20:59:13.928 INFO:teuthology.orchestra.run.smithi187.stdout:18 Apr 20:59:13 ntpd[17249]: ntp-4 is maintained by Network Time Foundation, 2024-04-18T20:59:13.929 INFO:teuthology.orchestra.run.smithi187.stdout:18 Apr 20:59:13 ntpd[17249]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-18T20:59:13.929 INFO:teuthology.orchestra.run.smithi187.stdout:18 Apr 20:59:13 ntpd[17249]: corporation. Support and training for ntp-4 are 2024-04-18T20:59:13.929 INFO:teuthology.orchestra.run.smithi187.stdout:18 Apr 20:59:13 ntpd[17249]: available at https://www.nwtime.org/support 2024-04-18T20:59:13.929 INFO:teuthology.orchestra.run.smithi187.stdout:18 Apr 20:59:13 ntpd[17249]: ---------------------------------------------------- 2024-04-18T20:59:13.929 INFO:teuthology.orchestra.run.smithi187.stdout:18 Apr 20:59:13 ntpd[17249]: proto: precision = 0.045 usec (-24) 2024-04-18T20:59:13.929 INFO:teuthology.orchestra.run.smithi187.stdout:18 Apr 20:59:13 ntpd[17249]: basedate set to 2022-02-04 2024-04-18T20:59:13.929 INFO:teuthology.orchestra.run.smithi187.stdout:18 Apr 20:59:13 ntpd[17249]: gps base set to 2022-02-06 (week 2196) 2024-04-18T20:59:13.930 INFO:teuthology.orchestra.run.smithi187.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-18T20:59:13.930 INFO:teuthology.orchestra.run.smithi187.stdout:18 Apr 20:59:13 ntpd[17249]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-18T20:59:13.931 INFO:teuthology.orchestra.run.smithi187.stdout:18 Apr 20:59:13 ntpd[17249]: restrict ::: KOD does nothing without LIMITED. 2024-04-18T20:59:13.931 INFO:teuthology.orchestra.run.smithi187.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-18T20:59:13.933 INFO:teuthology.orchestra.run.smithi187.stdout:18 Apr 20:59:13 ntpd[17249]: Listen and drop on 0 v6wildcard [::]:123 2024-04-18T20:59:13.933 INFO:teuthology.orchestra.run.smithi187.stdout:18 Apr 20:59:13 ntpd[17249]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-18T20:59:13.933 INFO:teuthology.orchestra.run.smithi187.stdout:18 Apr 20:59:13 ntpd[17249]: Listen normally on 2 lo 127.0.0.1:123 2024-04-18T20:59:13.933 INFO:teuthology.orchestra.run.smithi187.stdout:18 Apr 20:59:13 ntpd[17249]: Listen normally on 3 enp3s0f1 172.21.15.187:123 2024-04-18T20:59:13.933 INFO:teuthology.orchestra.run.smithi187.stdout:18 Apr 20:59:13 ntpd[17249]: Listen normally on 4 lo [::1]:123 2024-04-18T20:59:13.933 INFO:teuthology.orchestra.run.smithi187.stdout:18 Apr 20:59:13 ntpd[17249]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:77b1%5]:123 2024-04-18T20:59:13.934 INFO:teuthology.orchestra.run.smithi187.stdout:18 Apr 20:59:13 ntpd[17249]: Listening on routing socket on fd #22 for interface updates 2024-04-18T20:59:14.901 INFO:teuthology.orchestra.run.smithi078.stderr:18 Apr 20:59:14 ntpd[17201]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:14.901 INFO:teuthology.orchestra.run.smithi078.stderr:18 Apr 20:59:14 ntpd[17201]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:14.901 INFO:teuthology.orchestra.run.smithi078.stderr:18 Apr 20:59:14 ntpd[17201]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:14.901 INFO:teuthology.orchestra.run.smithi078.stderr:18 Apr 20:59:14 ntpd[17201]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:14.901 INFO:teuthology.orchestra.run.smithi078.stderr:18 Apr 20:59:14 ntpd[17201]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:14.901 INFO:teuthology.orchestra.run.smithi078.stderr:18 Apr 20:59:14 ntpd[17201]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:14.908 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:14 ntpd[17223]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:14.908 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:14 ntpd[17223]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:14.908 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:14 ntpd[17223]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:14.908 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:14 ntpd[17223]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:14.908 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:14 ntpd[17223]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:14.908 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:14 ntpd[17223]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:14.908 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:14 ntpd[17223]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:14.908 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:14 ntpd[17223]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:14.908 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:14 ntpd[17223]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:14.908 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:14 ntpd[17223]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:14.909 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:14 ntpd[17223]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:14.909 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:14 ntpd[17223]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:14.930 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:14 ntpd[17249]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:14.930 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:14 ntpd[17249]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:14.930 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:14 ntpd[17249]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:14.930 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:14 ntpd[17249]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:14.931 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:14 ntpd[17249]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:14.931 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:14 ntpd[17249]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:14.931 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:14 ntpd[17249]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:14.931 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:14 ntpd[17249]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:14.931 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:14 ntpd[17249]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:14.931 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:14 ntpd[17249]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:14.931 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:14 ntpd[17249]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:14.932 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:14 ntpd[17249]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:14.932 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:14 ntpd[17249]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:14.932 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:14 ntpd[17249]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:14.932 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:14 ntpd[17249]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:14.932 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:14 ntpd[17249]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:14.932 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:14 ntpd[17249]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:14.932 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:14 ntpd[17249]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:15.907 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:15 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:15.907 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:15 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:15.907 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:15 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:15.907 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:15 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:15.907 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:15 ntpd[17244]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:15.907 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:15 ntpd[17244]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:16.901 INFO:teuthology.orchestra.run.smithi078.stderr:18 Apr 20:59:16 ntpd[17201]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:16.901 INFO:teuthology.orchestra.run.smithi078.stderr:18 Apr 20:59:16 ntpd[17201]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:16.901 INFO:teuthology.orchestra.run.smithi078.stderr:18 Apr 20:59:16 ntpd[17201]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:16.901 INFO:teuthology.orchestra.run.smithi078.stderr:18 Apr 20:59:16 ntpd[17201]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:16.901 INFO:teuthology.orchestra.run.smithi078.stderr:18 Apr 20:59:16 ntpd[17201]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:16.902 INFO:teuthology.orchestra.run.smithi078.stderr:18 Apr 20:59:16 ntpd[17201]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:16.907 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:16 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:16.907 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:16 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:16.907 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:16 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:16.907 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:16 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:16.907 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:16 ntpd[17244]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:16.907 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:16 ntpd[17244]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:16.909 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:16 ntpd[17223]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:16.909 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:16 ntpd[17223]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:16.909 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:16 ntpd[17223]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:16.909 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:16 ntpd[17223]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:16.909 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:16 ntpd[17223]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:16.909 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:16 ntpd[17223]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:16.909 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:16 ntpd[17223]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:16.909 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:16 ntpd[17223]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:16.910 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:16 ntpd[17223]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:16.910 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:16 ntpd[17223]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:16.910 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:16 ntpd[17223]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:16.910 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:16 ntpd[17223]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:16.910 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:16 ntpd[17223]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:16.910 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:16 ntpd[17223]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:16.929 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:16 ntpd[17249]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:16.930 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:16 ntpd[17249]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:16.930 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:16 ntpd[17249]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:16.930 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:16 ntpd[17249]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:16.930 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:16 ntpd[17249]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:16.930 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:16 ntpd[17249]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:16.930 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:16 ntpd[17249]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:16.930 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:16 ntpd[17249]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:16.930 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:16 ntpd[17249]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:16.930 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:16 ntpd[17249]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:16.930 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:16 ntpd[17249]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:16.930 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:16 ntpd[17249]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:16.931 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:16 ntpd[17249]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:16.931 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:16 ntpd[17249]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:16.931 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:16 ntpd[17249]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:16.931 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:16 ntpd[17249]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:16.931 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:16 ntpd[17249]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:16.931 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:16 ntpd[17249]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:17.907 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:17 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:17.907 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:17 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:17.907 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:17 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:17.907 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:17 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:17.907 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:17 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:17.907 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:17 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:17.908 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:17 ntpd[17244]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:17.908 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:17 ntpd[17244]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:17.927 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:17 ntpd[17249]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:17.927 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:17 ntpd[17249]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:18.902 INFO:teuthology.orchestra.run.smithi078.stderr:18 Apr 20:59:18 ntpd[17201]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:18.903 INFO:teuthology.orchestra.run.smithi078.stderr:18 Apr 20:59:18 ntpd[17201]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:18.903 INFO:teuthology.orchestra.run.smithi078.stderr:18 Apr 20:59:18 ntpd[17201]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:18.903 INFO:teuthology.orchestra.run.smithi078.stderr:18 Apr 20:59:18 ntpd[17201]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:18.903 INFO:teuthology.orchestra.run.smithi078.stderr:18 Apr 20:59:18 ntpd[17201]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:18.903 INFO:teuthology.orchestra.run.smithi078.stderr:18 Apr 20:59:18 ntpd[17201]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:18.903 INFO:teuthology.orchestra.run.smithi078.stderr:18 Apr 20:59:18 ntpd[17201]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:18.903 INFO:teuthology.orchestra.run.smithi078.stderr:18 Apr 20:59:18 ntpd[17201]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:18.903 INFO:teuthology.orchestra.run.smithi078.stderr:18 Apr 20:59:18 ntpd[17201]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:18.903 INFO:teuthology.orchestra.run.smithi078.stderr:18 Apr 20:59:18 ntpd[17201]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:18.903 INFO:teuthology.orchestra.run.smithi078.stderr:18 Apr 20:59:18 ntpd[17201]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:18.903 INFO:teuthology.orchestra.run.smithi078.stderr:18 Apr 20:59:18 ntpd[17201]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:18.903 INFO:teuthology.orchestra.run.smithi078.stderr:18 Apr 20:59:18 ntpd[17201]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:18.903 INFO:teuthology.orchestra.run.smithi078.stderr:18 Apr 20:59:18 ntpd[17201]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:18.903 INFO:teuthology.orchestra.run.smithi078.stderr:18 Apr 20:59:18 ntpd[17201]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:18.903 INFO:teuthology.orchestra.run.smithi078.stderr:18 Apr 20:59:18 ntpd[17201]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:18.904 INFO:teuthology.orchestra.run.smithi078.stderr:18 Apr 20:59:18 ntpd[17201]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:18.904 INFO:teuthology.orchestra.run.smithi078.stderr:18 Apr 20:59:18 ntpd[17201]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:18.904 INFO:teuthology.orchestra.run.smithi078.stderr:18 Apr 20:59:18 ntpd[17201]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:18.904 INFO:teuthology.orchestra.run.smithi078.stderr:18 Apr 20:59:18 ntpd[17201]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:18.907 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:18 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:18.907 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:18 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:18.907 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:18 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:18.907 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:18 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:18.907 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:18 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:18.907 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:18 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:18.907 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:18 ntpd[17244]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:18.907 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:18 ntpd[17244]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:18.907 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:18 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:18.907 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:18 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:18.908 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:18 ntpd[17244]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:18.908 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:18 ntpd[17244]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:18.910 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:18 ntpd[17223]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:18.910 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:18 ntpd[17223]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:18.910 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:18 ntpd[17223]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:18.910 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:18 ntpd[17223]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:18.910 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:18 ntpd[17223]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:18.910 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:18 ntpd[17223]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:18.910 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:18 ntpd[17223]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:18.910 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:18 ntpd[17223]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:18.910 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:18 ntpd[17223]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:18.910 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:18 ntpd[17223]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:18.910 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:18 ntpd[17223]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:18.910 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:18 ntpd[17223]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:18.910 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:18 ntpd[17223]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:18.911 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:18 ntpd[17223]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:18.911 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:18 ntpd[17223]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:18.911 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:18 ntpd[17223]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:18.911 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:18 ntpd[17223]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:18.911 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:18 ntpd[17223]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:18.929 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:18 ntpd[17249]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:18.929 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:18 ntpd[17249]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:18.930 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:18 ntpd[17249]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:18.930 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:18 ntpd[17249]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:18.930 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:18 ntpd[17249]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:18.930 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:18 ntpd[17249]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:18.930 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:18 ntpd[17249]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:18.930 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:18 ntpd[17249]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:18.930 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:18 ntpd[17249]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:18.930 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:18 ntpd[17249]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:18.930 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:18 ntpd[17249]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:18.930 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:18 ntpd[17249]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:18.930 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:18 ntpd[17249]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:18.930 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:18 ntpd[17249]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:18.930 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:18 ntpd[17249]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:18.931 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:18 ntpd[17249]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:18.931 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:18 ntpd[17249]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:18.931 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:18 ntpd[17249]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:19.907 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:19 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:19.907 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:19 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:19.907 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:19 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:19.907 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:19 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:19.907 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:19 ntpd[17244]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:19.907 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:19 ntpd[17244]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:20.901 INFO:teuthology.orchestra.run.smithi078.stderr:18 Apr 20:59:20 ntpd[17201]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:20.901 INFO:teuthology.orchestra.run.smithi078.stderr:18 Apr 20:59:20 ntpd[17201]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:20.901 INFO:teuthology.orchestra.run.smithi078.stderr:18 Apr 20:59:20 ntpd[17201]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:20.902 INFO:teuthology.orchestra.run.smithi078.stderr:18 Apr 20:59:20 ntpd[17201]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:20.902 INFO:teuthology.orchestra.run.smithi078.stderr:18 Apr 20:59:20 ntpd[17201]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:20.902 INFO:teuthology.orchestra.run.smithi078.stderr:18 Apr 20:59:20 ntpd[17201]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:20.902 INFO:teuthology.orchestra.run.smithi078.stderr:18 Apr 20:59:20 ntpd[17201]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:20.902 INFO:teuthology.orchestra.run.smithi078.stderr:18 Apr 20:59:20 ntpd[17201]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:20.902 INFO:teuthology.orchestra.run.smithi078.stderr:18 Apr 20:59:20 ntpd[17201]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:20.902 INFO:teuthology.orchestra.run.smithi078.stderr:18 Apr 20:59:20 ntpd[17201]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:20.902 INFO:teuthology.orchestra.run.smithi078.stdout:18 Apr 20:59:20 ntpd[17201]: ntpd: time slew -0.001288 s 2024-04-18T20:59:20.902 INFO:teuthology.orchestra.run.smithi078.stdout:ntpd: time slew -0.001288s 2024-04-18T20:59:20.903 INFO:teuthology.orchestra.run.smithi078.stderr:18 Apr 20:59:20 ntpd[17201]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-18T20:59:20.903 INFO:teuthology.orchestra.run.smithi078.stderr:18 Apr 20:59:20 ntpd[17201]: can't open /var/log/ntpstats/loopstats.20240418: Permission denied 2024-04-18T20:59:20.907 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:20 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:20.907 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:20 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:20.907 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:20 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:20.907 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:20 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:20.907 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:20 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:20.907 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:20 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:20.907 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:20 ntpd[17244]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:20.907 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:20 ntpd[17244]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:20.908 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:20 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:20.908 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:20 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:20.908 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:20 ntpd[17244]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:20.908 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:20 ntpd[17244]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:20.909 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:20 ntpd[17223]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:20.909 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:20 ntpd[17223]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:20.909 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:20 ntpd[17223]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:20.909 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:20 ntpd[17223]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:20.909 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:20 ntpd[17223]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:20.909 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:20 ntpd[17223]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:20.909 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:20 ntpd[17223]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:20.909 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:20 ntpd[17223]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:20.909 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:20 ntpd[17223]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:20.910 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:20 ntpd[17223]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:20.910 INFO:teuthology.orchestra.run.smithi150.stdout:18 Apr 20:59:20 ntpd[17223]: ntpd: time slew -0.001884 s 2024-04-18T20:59:20.910 INFO:teuthology.orchestra.run.smithi150.stdout:ntpd: time slew -0.001884s 2024-04-18T20:59:20.910 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:20 ntpd[17223]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-18T20:59:20.910 INFO:teuthology.orchestra.run.smithi150.stderr:18 Apr 20:59:20 ntpd[17223]: can't open /var/log/ntpstats/loopstats.20240418: Permission denied 2024-04-18T20:59:20.928 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:20 ntpd[17249]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:20.928 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:20 ntpd[17249]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:20.928 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:20 ntpd[17249]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:20.928 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:20 ntpd[17249]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:20.928 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:20 ntpd[17249]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:20.928 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:20 ntpd[17249]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:20.929 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:20 ntpd[17249]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:20.929 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:20 ntpd[17249]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:20.929 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:20 ntpd[17249]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:20.929 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:20 ntpd[17249]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:20.929 INFO:teuthology.orchestra.run.smithi187.stdout:18 Apr 20:59:20 ntpd[17249]: ntpd: time slew -0.002092 s 2024-04-18T20:59:20.929 INFO:teuthology.orchestra.run.smithi187.stdout:ntpd: time slew -0.002092s 2024-04-18T20:59:20.930 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:20 ntpd[17249]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-18T20:59:20.930 INFO:teuthology.orchestra.run.smithi187.stderr:18 Apr 20:59:20 ntpd[17249]: can't open /var/log/ntpstats/loopstats.20240418: Permission denied 2024-04-18T20:59:20.957 INFO:teuthology.orchestra.run.smithi078.stdout: remote refid st t when poll reach delay offset jitter 2024-04-18T20:59:20.957 INFO:teuthology.orchestra.run.smithi078.stdout:============================================================================== 2024-04-18T20:59:20.957 INFO:teuthology.orchestra.run.smithi078.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T20:59:20.957 INFO:teuthology.orchestra.run.smithi078.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T20:59:20.957 INFO:teuthology.orchestra.run.smithi078.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T20:59:20.957 INFO:teuthology.orchestra.run.smithi078.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T20:59:20.992 INFO:teuthology.orchestra.run.smithi187.stdout: remote refid st t when poll reach delay offset jitter 2024-04-18T20:59:20.992 INFO:teuthology.orchestra.run.smithi187.stdout:============================================================================== 2024-04-18T20:59:20.992 INFO:teuthology.orchestra.run.smithi187.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T20:59:20.992 INFO:teuthology.orchestra.run.smithi187.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T20:59:20.992 INFO:teuthology.orchestra.run.smithi187.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T20:59:20.992 INFO:teuthology.orchestra.run.smithi187.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T20:59:21.022 INFO:teuthology.orchestra.run.smithi150.stdout: remote refid st t when poll reach delay offset jitter 2024-04-18T20:59:21.022 INFO:teuthology.orchestra.run.smithi150.stdout:============================================================================== 2024-04-18T20:59:21.023 INFO:teuthology.orchestra.run.smithi150.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T20:59:21.023 INFO:teuthology.orchestra.run.smithi150.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T20:59:21.023 INFO:teuthology.orchestra.run.smithi150.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T20:59:21.023 INFO:teuthology.orchestra.run.smithi150.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T20:59:21.907 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:21 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:21.907 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:21 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:21.907 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:21 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T20:59:21.907 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:21 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T20:59:21.907 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:21 ntpd[17244]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T20:59:21.907 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:21 ntpd[17244]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T20:59:21.907 INFO:teuthology.orchestra.run.smithi132.stdout:18 Apr 20:59:21 ntpd[17244]: ntpd: time slew -0.000411 s 2024-04-18T20:59:21.908 INFO:teuthology.orchestra.run.smithi132.stdout:ntpd: time slew -0.000411s 2024-04-18T20:59:21.908 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:21 ntpd[17244]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-18T20:59:21.908 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 20:59:21 ntpd[17244]: can't open /var/log/ntpstats/loopstats.20240418: Permission denied 2024-04-18T20:59:21.956 INFO:teuthology.orchestra.run.smithi132.stdout: remote refid st t when poll reach delay offset jitter 2024-04-18T20:59:21.956 INFO:teuthology.orchestra.run.smithi132.stdout:============================================================================== 2024-04-18T20:59:21.956 INFO:teuthology.orchestra.run.smithi132.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T20:59:21.956 INFO:teuthology.orchestra.run.smithi132.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T20:59:21.956 INFO:teuthology.orchestra.run.smithi132.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T20:59:21.956 INFO:teuthology.orchestra.run.smithi132.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T20:59:21.957 INFO:teuthology.run_tasks:Running task install... 2024-04-18T20:59:21.966 DEBUG:teuthology.task.install:project ceph 2024-04-18T20:59:21.966 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '5be49cd9e6fca1ff6a05f2473aa3b399da760600'}} 2024-04-18T20:59:21.966 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '5be49cd9e6fca1ff6a05f2473aa3b399da760600'} 2024-04-18T20:59:21.966 INFO:teuthology.task.install:Using flavor: default 2024-04-18T20:59:21.971 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-18T20:59:21.972 INFO:teuthology.task.install:extra packages: [] 2024-04-18T20:59:21.972 DEBUG:teuthology.orchestra.run.smithi078:> sudo apt-key list | grep Ceph 2024-04-18T20:59:21.972 DEBUG:teuthology.orchestra.run.smithi132:> sudo apt-key list | grep Ceph 2024-04-18T20:59:21.973 DEBUG:teuthology.orchestra.run.smithi150:> sudo apt-key list | grep Ceph 2024-04-18T20:59:21.973 DEBUG:teuthology.orchestra.run.smithi187:> sudo apt-key list | grep Ceph 2024-04-18T20:59:22.036 INFO:teuthology.orchestra.run.smithi187.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-18T20:59:22.036 INFO:teuthology.orchestra.run.smithi078.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-18T20:59:22.037 INFO:teuthology.orchestra.run.smithi150.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-18T20:59:22.055 INFO:teuthology.orchestra.run.smithi132.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-18T20:59:22.062 INFO:teuthology.orchestra.run.smithi187.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-18T20:59:22.062 INFO:teuthology.orchestra.run.smithi187.stdout:uid [ unknown] Ceph.com (release key) 2024-04-18T20:59:22.063 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-18T20:59:22.064 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-04-18T20:59:22.064 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=5be49cd9e6fca1ff6a05f2473aa3b399da760600 2024-04-18T20:59:22.069 INFO:teuthology.orchestra.run.smithi150.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-18T20:59:22.070 INFO:teuthology.orchestra.run.smithi150.stdout:uid [ unknown] Ceph.com (release key) 2024-04-18T20:59:22.070 INFO:teuthology.orchestra.run.smithi078.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-18T20:59:22.070 INFO:teuthology.orchestra.run.smithi078.stdout:uid [ unknown] Ceph.com (release key) 2024-04-18T20:59:22.070 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-18T20:59:22.070 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-04-18T20:59:22.070 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=5be49cd9e6fca1ff6a05f2473aa3b399da760600 2024-04-18T20:59:22.071 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-18T20:59:22.071 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-04-18T20:59:22.071 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=5be49cd9e6fca1ff6a05f2473aa3b399da760600 2024-04-18T20:59:22.084 INFO:teuthology.orchestra.run.smithi132.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-18T20:59:22.084 INFO:teuthology.orchestra.run.smithi132.stdout:uid [ unknown] Ceph.com (release key) 2024-04-18T20:59:22.085 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-18T20:59:22.085 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-04-18T20:59:22.086 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=5be49cd9e6fca1ff6a05f2473aa3b399da760600 2024-04-18T20:59:22.210 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default/ 2024-04-18T20:59:22.211 INFO:teuthology.task.install.deb:Package version is 19.0.0-3141-g5be49cd9-1jammy 2024-04-18T20:59:22.279 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default/ 2024-04-18T20:59:22.280 INFO:teuthology.task.install.deb:Package version is 19.0.0-3141-g5be49cd9-1jammy 2024-04-18T20:59:22.283 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default/ 2024-04-18T20:59:22.283 INFO:teuthology.task.install.deb:Package version is 19.0.0-3141-g5be49cd9-1jammy 2024-04-18T20:59:22.291 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default/ 2024-04-18T20:59:22.291 INFO:teuthology.task.install.deb:Package version is 19.0.0-3141-g5be49cd9-1jammy 2024-04-18T20:59:22.609 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-04-18T20:59:22.609 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-18T20:59:22.615 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-04-18T20:59:22.615 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-18T20:59:22.623 DEBUG:teuthology.orchestra.run.smithi150:> sudo apt-get update 2024-04-18T20:59:22.625 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-04-18T20:59:22.625 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-18T20:59:22.629 DEBUG:teuthology.orchestra.run.smithi187:> sudo apt-get update 2024-04-18T20:59:22.632 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-18T20:59:22.632 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-18T20:59:22.639 DEBUG:teuthology.orchestra.run.smithi078:> sudo apt-get update 2024-04-18T20:59:22.646 DEBUG:teuthology.orchestra.run.smithi132:> sudo apt-get update 2024-04-18T20:59:22.795 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-18T20:59:22.800 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-18T20:59:22.800 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-18T20:59:22.807 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-18T20:59:22.815 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-18T20:59:22.816 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-18T20:59:22.817 INFO:teuthology.orchestra.run.smithi132.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-18T20:59:22.817 INFO:teuthology.orchestra.run.smithi132.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-18T20:59:22.827 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-18T20:59:22.830 INFO:teuthology.orchestra.run.smithi132.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-18T20:59:22.836 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-18T20:59:22.850 INFO:teuthology.orchestra.run.smithi132.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-18T20:59:22.910 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-18T20:59:22.930 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-18T20:59:23.012 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-18T20:59:23.055 INFO:teuthology.orchestra.run.smithi187.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy InRelease 2024-04-18T20:59:23.080 INFO:teuthology.orchestra.run.smithi078.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy InRelease 2024-04-18T20:59:23.099 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-18T20:59:23.115 INFO:teuthology.orchestra.run.smithi150.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy InRelease 2024-04-18T20:59:23.123 INFO:teuthology.orchestra.run.smithi187.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-18T20:59:23.138 INFO:teuthology.orchestra.run.smithi132.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy InRelease 2024-04-18T20:59:23.149 INFO:teuthology.orchestra.run.smithi078.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-18T20:59:23.188 INFO:teuthology.orchestra.run.smithi187.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-18T20:59:23.194 INFO:teuthology.orchestra.run.smithi150.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-18T20:59:23.212 INFO:teuthology.orchestra.run.smithi078.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-18T20:59:23.213 INFO:teuthology.orchestra.run.smithi132.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-18T20:59:23.250 INFO:teuthology.orchestra.run.smithi187.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-18T20:59:23.273 INFO:teuthology.orchestra.run.smithi150.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-18T20:59:23.274 INFO:teuthology.orchestra.run.smithi078.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-04-18T20:59:23.292 INFO:teuthology.orchestra.run.smithi132.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-18T20:59:23.324 INFO:teuthology.orchestra.run.smithi187.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-04-18T20:59:23.348 INFO:teuthology.orchestra.run.smithi078.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-18T20:59:23.350 INFO:teuthology.orchestra.run.smithi150.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-18T20:59:23.372 INFO:teuthology.orchestra.run.smithi132.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-18T20:59:23.412 INFO:teuthology.orchestra.run.smithi187.stdout:Fetched 29.2 kB in 1s (49.6 kB/s) 2024-04-18T20:59:23.440 INFO:teuthology.orchestra.run.smithi150.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-04-18T20:59:23.461 INFO:teuthology.orchestra.run.smithi132.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-04-18T20:59:23.506 INFO:teuthology.orchestra.run.smithi078.stdout:Fetched 29.2 kB in 1s (43.7 kB/s) 2024-04-18T20:59:23.528 INFO:teuthology.orchestra.run.smithi150.stdout:Fetched 29.2 kB in 1s (41.1 kB/s) 2024-04-18T20:59:23.545 INFO:teuthology.orchestra.run.smithi132.stdout:Fetched 29.2 kB in 1s (41.2 kB/s) 2024-04-18T20:59:24.409 INFO:teuthology.orchestra.run.smithi187.stdout:Reading package lists... 2024-04-18T20:59:24.426 DEBUG:teuthology.orchestra.run.smithi187:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3141-g5be49cd9-1jammy cephadm=19.0.0-3141-g5be49cd9-1jammy ceph-mds=19.0.0-3141-g5be49cd9-1jammy ceph-mgr=19.0.0-3141-g5be49cd9-1jammy ceph-common=19.0.0-3141-g5be49cd9-1jammy ceph-fuse=19.0.0-3141-g5be49cd9-1jammy ceph-test=19.0.0-3141-g5be49cd9-1jammy ceph-volume=19.0.0-3141-g5be49cd9-1jammy radosgw=19.0.0-3141-g5be49cd9-1jammy python3-rados=19.0.0-3141-g5be49cd9-1jammy python3-rgw=19.0.0-3141-g5be49cd9-1jammy python3-cephfs=19.0.0-3141-g5be49cd9-1jammy python3-rbd=19.0.0-3141-g5be49cd9-1jammy libcephfs2=19.0.0-3141-g5be49cd9-1jammy libcephfs-dev=19.0.0-3141-g5be49cd9-1jammy librados2=19.0.0-3141-g5be49cd9-1jammy librbd1=19.0.0-3141-g5be49cd9-1jammy rbd-fuse=19.0.0-3141-g5be49cd9-1jammy 2024-04-18T20:59:24.472 INFO:teuthology.orchestra.run.smithi132.stdout:Reading package lists... 2024-04-18T20:59:24.478 INFO:teuthology.orchestra.run.smithi187.stdout:Reading package lists... 2024-04-18T20:59:24.485 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2024-04-18T20:59:24.488 DEBUG:teuthology.orchestra.run.smithi132:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3141-g5be49cd9-1jammy cephadm=19.0.0-3141-g5be49cd9-1jammy ceph-mds=19.0.0-3141-g5be49cd9-1jammy ceph-mgr=19.0.0-3141-g5be49cd9-1jammy ceph-common=19.0.0-3141-g5be49cd9-1jammy ceph-fuse=19.0.0-3141-g5be49cd9-1jammy ceph-test=19.0.0-3141-g5be49cd9-1jammy ceph-volume=19.0.0-3141-g5be49cd9-1jammy radosgw=19.0.0-3141-g5be49cd9-1jammy python3-rados=19.0.0-3141-g5be49cd9-1jammy python3-rgw=19.0.0-3141-g5be49cd9-1jammy python3-cephfs=19.0.0-3141-g5be49cd9-1jammy python3-rbd=19.0.0-3141-g5be49cd9-1jammy libcephfs2=19.0.0-3141-g5be49cd9-1jammy libcephfs-dev=19.0.0-3141-g5be49cd9-1jammy librados2=19.0.0-3141-g5be49cd9-1jammy librbd1=19.0.0-3141-g5be49cd9-1jammy rbd-fuse=19.0.0-3141-g5be49cd9-1jammy 2024-04-18T20:59:24.500 DEBUG:teuthology.orchestra.run.smithi078:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3141-g5be49cd9-1jammy cephadm=19.0.0-3141-g5be49cd9-1jammy ceph-mds=19.0.0-3141-g5be49cd9-1jammy ceph-mgr=19.0.0-3141-g5be49cd9-1jammy ceph-common=19.0.0-3141-g5be49cd9-1jammy ceph-fuse=19.0.0-3141-g5be49cd9-1jammy ceph-test=19.0.0-3141-g5be49cd9-1jammy ceph-volume=19.0.0-3141-g5be49cd9-1jammy radosgw=19.0.0-3141-g5be49cd9-1jammy python3-rados=19.0.0-3141-g5be49cd9-1jammy python3-rgw=19.0.0-3141-g5be49cd9-1jammy python3-cephfs=19.0.0-3141-g5be49cd9-1jammy python3-rbd=19.0.0-3141-g5be49cd9-1jammy libcephfs2=19.0.0-3141-g5be49cd9-1jammy libcephfs-dev=19.0.0-3141-g5be49cd9-1jammy librados2=19.0.0-3141-g5be49cd9-1jammy librbd1=19.0.0-3141-g5be49cd9-1jammy rbd-fuse=19.0.0-3141-g5be49cd9-1jammy 2024-04-18T20:59:24.515 INFO:teuthology.orchestra.run.smithi150.stdout:Reading package lists... 2024-04-18T20:59:24.531 DEBUG:teuthology.orchestra.run.smithi150:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3141-g5be49cd9-1jammy cephadm=19.0.0-3141-g5be49cd9-1jammy ceph-mds=19.0.0-3141-g5be49cd9-1jammy ceph-mgr=19.0.0-3141-g5be49cd9-1jammy ceph-common=19.0.0-3141-g5be49cd9-1jammy ceph-fuse=19.0.0-3141-g5be49cd9-1jammy ceph-test=19.0.0-3141-g5be49cd9-1jammy ceph-volume=19.0.0-3141-g5be49cd9-1jammy radosgw=19.0.0-3141-g5be49cd9-1jammy python3-rados=19.0.0-3141-g5be49cd9-1jammy python3-rgw=19.0.0-3141-g5be49cd9-1jammy python3-cephfs=19.0.0-3141-g5be49cd9-1jammy python3-rbd=19.0.0-3141-g5be49cd9-1jammy libcephfs2=19.0.0-3141-g5be49cd9-1jammy libcephfs-dev=19.0.0-3141-g5be49cd9-1jammy librados2=19.0.0-3141-g5be49cd9-1jammy librbd1=19.0.0-3141-g5be49cd9-1jammy rbd-fuse=19.0.0-3141-g5be49cd9-1jammy 2024-04-18T20:59:24.550 INFO:teuthology.orchestra.run.smithi132.stdout:Reading package lists... 2024-04-18T20:59:24.559 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2024-04-18T20:59:24.582 INFO:teuthology.orchestra.run.smithi150.stdout:Reading package lists... 2024-04-18T20:59:24.655 INFO:teuthology.orchestra.run.smithi187.stdout:Building dependency tree... 2024-04-18T20:59:24.655 INFO:teuthology.orchestra.run.smithi187.stdout:Reading state information... 2024-04-18T20:59:24.750 INFO:teuthology.orchestra.run.smithi132.stdout:Building dependency tree... 2024-04-18T20:59:24.751 INFO:teuthology.orchestra.run.smithi132.stdout:Reading state information... 2024-04-18T20:59:24.752 INFO:teuthology.orchestra.run.smithi078.stdout:Building dependency tree... 2024-04-18T20:59:24.753 INFO:teuthology.orchestra.run.smithi078.stdout:Reading state information... 2024-04-18T20:59:24.766 INFO:teuthology.orchestra.run.smithi150.stdout:Building dependency tree... 2024-04-18T20:59:24.767 INFO:teuthology.orchestra.run.smithi150.stdout:Reading state information... 2024-04-18T20:59:24.827 INFO:teuthology.orchestra.run.smithi187.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T20:59:24.827 INFO:teuthology.orchestra.run.smithi187.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T20:59:24.827 INFO:teuthology.orchestra.run.smithi187.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T20:59:24.827 INFO:teuthology.orchestra.run.smithi187.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T20:59:24.827 INFO:teuthology.orchestra.run.smithi187.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-18T20:59:24.831 INFO:teuthology.orchestra.run.smithi187.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-18T20:59:24.831 INFO:teuthology.orchestra.run.smithi187.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T20:59:24.832 INFO:teuthology.orchestra.run.smithi187.stdout:The following additional packages will be installed: 2024-04-18T20:59:24.832 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-18T20:59:24.832 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-18T20:59:24.832 INFO:teuthology.orchestra.run.smithi187.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-18T20:59:24.832 INFO:teuthology.orchestra.run.smithi187.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-18T20:59:24.832 INFO:teuthology.orchestra.run.smithi187.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-18T20:59:24.832 INFO:teuthology.orchestra.run.smithi187.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-18T20:59:24.833 INFO:teuthology.orchestra.run.smithi187.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-18T20:59:24.833 INFO:teuthology.orchestra.run.smithi187.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-18T20:59:24.833 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-18T20:59:24.833 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-18T20:59:24.833 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-18T20:59:24.833 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-18T20:59:24.833 INFO:teuthology.orchestra.run.smithi187.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-18T20:59:24.834 INFO:teuthology.orchestra.run.smithi187.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-18T20:59:24.834 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-18T20:59:24.834 INFO:teuthology.orchestra.run.smithi187.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-18T20:59:24.834 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-18T20:59:24.834 INFO:teuthology.orchestra.run.smithi187.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-18T20:59:24.834 INFO:teuthology.orchestra.run.smithi187.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-18T20:59:24.835 INFO:teuthology.orchestra.run.smithi187.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-18T20:59:24.835 INFO:teuthology.orchestra.run.smithi187.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-18T20:59:24.835 INFO:teuthology.orchestra.run.smithi187.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-18T20:59:24.835 INFO:teuthology.orchestra.run.smithi187.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-04-18T20:59:24.835 INFO:teuthology.orchestra.run.smithi187.stdout: xmlstarlet zip 2024-04-18T20:59:24.835 INFO:teuthology.orchestra.run.smithi187.stdout:Suggested packages: 2024-04-18T20:59:24.835 INFO:teuthology.orchestra.run.smithi187.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-18T20:59:24.835 INFO:teuthology.orchestra.run.smithi187.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-18T20:59:24.836 INFO:teuthology.orchestra.run.smithi187.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-18T20:59:24.836 INFO:teuthology.orchestra.run.smithi187.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-18T20:59:24.836 INFO:teuthology.orchestra.run.smithi187.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-18T20:59:24.836 INFO:teuthology.orchestra.run.smithi187.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-18T20:59:24.836 INFO:teuthology.orchestra.run.smithi187.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-18T20:59:24.836 INFO:teuthology.orchestra.run.smithi187.stdout:Recommended packages: 2024-04-18T20:59:24.836 INFO:teuthology.orchestra.run.smithi187.stdout: btrfs-tools 2024-04-18T20:59:24.929 INFO:teuthology.orchestra.run.smithi187.stdout:The following NEW packages will be installed: 2024-04-18T20:59:24.929 INFO:teuthology.orchestra.run.smithi187.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-18T20:59:24.930 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-18T20:59:24.930 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-18T20:59:24.930 INFO:teuthology.orchestra.run.smithi187.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-04-18T20:59:24.930 INFO:teuthology.orchestra.run.smithi187.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-18T20:59:24.930 INFO:teuthology.orchestra.run.smithi187.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-04-18T20:59:24.931 INFO:teuthology.orchestra.run.smithi187.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-04-18T20:59:24.931 INFO:teuthology.orchestra.run.smithi187.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-04-18T20:59:24.931 INFO:teuthology.orchestra.run.smithi187.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-04-18T20:59:24.931 INFO:teuthology.orchestra.run.smithi187.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-04-18T20:59:24.931 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-04-18T20:59:24.931 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-18T20:59:24.931 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-18T20:59:24.932 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-18T20:59:24.932 INFO:teuthology.orchestra.run.smithi187.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-18T20:59:24.932 INFO:teuthology.orchestra.run.smithi187.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-18T20:59:24.932 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-18T20:59:24.932 INFO:teuthology.orchestra.run.smithi187.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-18T20:59:24.932 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-04-18T20:59:24.933 INFO:teuthology.orchestra.run.smithi187.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-04-18T20:59:24.933 INFO:teuthology.orchestra.run.smithi187.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-04-18T20:59:24.933 INFO:teuthology.orchestra.run.smithi187.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-04-18T20:59:24.933 INFO:teuthology.orchestra.run.smithi187.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-04-18T20:59:24.933 INFO:teuthology.orchestra.run.smithi187.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-04-18T20:59:24.933 INFO:teuthology.orchestra.run.smithi187.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-04-18T20:59:24.933 INFO:teuthology.orchestra.run.smithi187.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-04-18T20:59:24.935 INFO:teuthology.orchestra.run.smithi078.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T20:59:24.935 INFO:teuthology.orchestra.run.smithi078.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T20:59:24.935 INFO:teuthology.orchestra.run.smithi078.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T20:59:24.935 INFO:teuthology.orchestra.run.smithi078.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T20:59:24.936 INFO:teuthology.orchestra.run.smithi078.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-18T20:59:24.936 INFO:teuthology.orchestra.run.smithi078.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-18T20:59:24.936 INFO:teuthology.orchestra.run.smithi078.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T20:59:24.938 INFO:teuthology.orchestra.run.smithi078.stdout:The following additional packages will be installed: 2024-04-18T20:59:24.938 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-18T20:59:24.938 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-18T20:59:24.938 INFO:teuthology.orchestra.run.smithi078.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-18T20:59:24.938 INFO:teuthology.orchestra.run.smithi078.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-18T20:59:24.938 INFO:teuthology.orchestra.run.smithi078.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-18T20:59:24.938 INFO:teuthology.orchestra.run.smithi078.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-18T20:59:24.938 INFO:teuthology.orchestra.run.smithi078.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-18T20:59:24.939 INFO:teuthology.orchestra.run.smithi078.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-18T20:59:24.939 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-18T20:59:24.939 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-18T20:59:24.939 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-18T20:59:24.939 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-18T20:59:24.939 INFO:teuthology.orchestra.run.smithi078.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-18T20:59:24.939 INFO:teuthology.orchestra.run.smithi078.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-18T20:59:24.939 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-18T20:59:24.939 INFO:teuthology.orchestra.run.smithi078.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-18T20:59:24.939 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-18T20:59:24.939 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-18T20:59:24.939 INFO:teuthology.orchestra.run.smithi078.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-18T20:59:24.939 INFO:teuthology.orchestra.run.smithi078.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-18T20:59:24.939 INFO:teuthology.orchestra.run.smithi078.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-18T20:59:24.939 INFO:teuthology.orchestra.run.smithi078.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-18T20:59:24.940 INFO:teuthology.orchestra.run.smithi078.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-04-18T20:59:24.940 INFO:teuthology.orchestra.run.smithi078.stdout: xmlstarlet zip 2024-04-18T20:59:24.940 INFO:teuthology.orchestra.run.smithi078.stdout:Suggested packages: 2024-04-18T20:59:24.940 INFO:teuthology.orchestra.run.smithi078.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-18T20:59:24.940 INFO:teuthology.orchestra.run.smithi078.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-18T20:59:24.940 INFO:teuthology.orchestra.run.smithi078.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-18T20:59:24.940 INFO:teuthology.orchestra.run.smithi078.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-18T20:59:24.940 INFO:teuthology.orchestra.run.smithi078.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-18T20:59:24.940 INFO:teuthology.orchestra.run.smithi078.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-18T20:59:24.941 INFO:teuthology.orchestra.run.smithi078.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-18T20:59:24.941 INFO:teuthology.orchestra.run.smithi078.stdout:Recommended packages: 2024-04-18T20:59:24.941 INFO:teuthology.orchestra.run.smithi078.stdout: btrfs-tools 2024-04-18T20:59:24.942 INFO:teuthology.orchestra.run.smithi150.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T20:59:24.943 INFO:teuthology.orchestra.run.smithi150.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T20:59:24.943 INFO:teuthology.orchestra.run.smithi150.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T20:59:24.943 INFO:teuthology.orchestra.run.smithi150.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T20:59:24.943 INFO:teuthology.orchestra.run.smithi150.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-18T20:59:24.945 INFO:teuthology.orchestra.run.smithi150.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-18T20:59:24.945 INFO:teuthology.orchestra.run.smithi150.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T20:59:24.945 INFO:teuthology.orchestra.run.smithi150.stdout:The following additional packages will be installed: 2024-04-18T20:59:24.946 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-18T20:59:24.946 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-18T20:59:24.946 INFO:teuthology.orchestra.run.smithi150.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-18T20:59:24.946 INFO:teuthology.orchestra.run.smithi150.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-18T20:59:24.946 INFO:teuthology.orchestra.run.smithi150.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-18T20:59:24.946 INFO:teuthology.orchestra.run.smithi150.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-18T20:59:24.946 INFO:teuthology.orchestra.run.smithi150.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-18T20:59:24.946 INFO:teuthology.orchestra.run.smithi150.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-18T20:59:24.946 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-18T20:59:24.946 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-18T20:59:24.946 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-18T20:59:24.946 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-18T20:59:24.947 INFO:teuthology.orchestra.run.smithi150.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-18T20:59:24.947 INFO:teuthology.orchestra.run.smithi150.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-18T20:59:24.947 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-18T20:59:24.947 INFO:teuthology.orchestra.run.smithi150.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-18T20:59:24.947 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-18T20:59:24.947 INFO:teuthology.orchestra.run.smithi150.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-18T20:59:24.947 INFO:teuthology.orchestra.run.smithi150.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-18T20:59:24.947 INFO:teuthology.orchestra.run.smithi150.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-18T20:59:24.947 INFO:teuthology.orchestra.run.smithi150.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-18T20:59:24.947 INFO:teuthology.orchestra.run.smithi150.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-18T20:59:24.947 INFO:teuthology.orchestra.run.smithi150.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-04-18T20:59:24.948 INFO:teuthology.orchestra.run.smithi150.stdout: xmlstarlet zip 2024-04-18T20:59:24.948 INFO:teuthology.orchestra.run.smithi150.stdout:Suggested packages: 2024-04-18T20:59:24.948 INFO:teuthology.orchestra.run.smithi150.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-18T20:59:24.948 INFO:teuthology.orchestra.run.smithi150.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-18T20:59:24.948 INFO:teuthology.orchestra.run.smithi150.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-18T20:59:24.949 INFO:teuthology.orchestra.run.smithi150.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-18T20:59:24.949 INFO:teuthology.orchestra.run.smithi150.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-18T20:59:24.949 INFO:teuthology.orchestra.run.smithi150.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-18T20:59:24.949 INFO:teuthology.orchestra.run.smithi150.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-18T20:59:24.949 INFO:teuthology.orchestra.run.smithi150.stdout:Recommended packages: 2024-04-18T20:59:24.949 INFO:teuthology.orchestra.run.smithi150.stdout: btrfs-tools 2024-04-18T20:59:24.951 INFO:teuthology.orchestra.run.smithi132.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T20:59:24.951 INFO:teuthology.orchestra.run.smithi132.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T20:59:24.951 INFO:teuthology.orchestra.run.smithi132.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T20:59:24.951 INFO:teuthology.orchestra.run.smithi132.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T20:59:24.951 INFO:teuthology.orchestra.run.smithi132.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-18T20:59:24.951 INFO:teuthology.orchestra.run.smithi132.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-18T20:59:24.951 INFO:teuthology.orchestra.run.smithi132.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T20:59:24.952 INFO:teuthology.orchestra.run.smithi132.stdout:The following additional packages will be installed: 2024-04-18T20:59:24.952 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-18T20:59:24.952 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-18T20:59:24.952 INFO:teuthology.orchestra.run.smithi132.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-18T20:59:24.952 INFO:teuthology.orchestra.run.smithi132.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-18T20:59:24.952 INFO:teuthology.orchestra.run.smithi132.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-18T20:59:24.952 INFO:teuthology.orchestra.run.smithi132.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-18T20:59:24.952 INFO:teuthology.orchestra.run.smithi132.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-18T20:59:24.952 INFO:teuthology.orchestra.run.smithi132.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-18T20:59:24.952 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-18T20:59:24.952 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-18T20:59:24.952 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-18T20:59:24.952 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-18T20:59:24.952 INFO:teuthology.orchestra.run.smithi132.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-18T20:59:24.953 INFO:teuthology.orchestra.run.smithi132.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-18T20:59:24.953 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-18T20:59:24.953 INFO:teuthology.orchestra.run.smithi132.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-18T20:59:24.953 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-18T20:59:24.953 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-18T20:59:24.953 INFO:teuthology.orchestra.run.smithi132.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-18T20:59:24.953 INFO:teuthology.orchestra.run.smithi132.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-18T20:59:24.953 INFO:teuthology.orchestra.run.smithi132.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-18T20:59:24.953 INFO:teuthology.orchestra.run.smithi132.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-18T20:59:24.953 INFO:teuthology.orchestra.run.smithi132.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-04-18T20:59:24.953 INFO:teuthology.orchestra.run.smithi132.stdout: xmlstarlet zip 2024-04-18T20:59:24.953 INFO:teuthology.orchestra.run.smithi132.stdout:Suggested packages: 2024-04-18T20:59:24.953 INFO:teuthology.orchestra.run.smithi132.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-18T20:59:24.953 INFO:teuthology.orchestra.run.smithi132.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-18T20:59:24.954 INFO:teuthology.orchestra.run.smithi132.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-18T20:59:24.954 INFO:teuthology.orchestra.run.smithi132.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-18T20:59:24.954 INFO:teuthology.orchestra.run.smithi132.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-18T20:59:24.954 INFO:teuthology.orchestra.run.smithi132.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-18T20:59:24.954 INFO:teuthology.orchestra.run.smithi132.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-18T20:59:24.954 INFO:teuthology.orchestra.run.smithi132.stdout:Recommended packages: 2024-04-18T20:59:24.954 INFO:teuthology.orchestra.run.smithi132.stdout: btrfs-tools 2024-04-18T20:59:24.998 INFO:teuthology.orchestra.run.smithi187.stdout:0 upgraded, 118 newly installed, 0 to remove and 302 not upgraded. 2024-04-18T20:59:24.998 INFO:teuthology.orchestra.run.smithi187.stdout:Need to get 181 MB of archives. 2024-04-18T20:59:24.998 INFO:teuthology.orchestra.run.smithi187.stdout:After this operation, 829 MB of additional disk space will be used. 2024-04-18T20:59:24.998 INFO:teuthology.orchestra.run.smithi187.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-18T20:59:25.038 INFO:teuthology.orchestra.run.smithi078.stdout:The following NEW packages will be installed: 2024-04-18T20:59:25.038 INFO:teuthology.orchestra.run.smithi078.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-18T20:59:25.038 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-18T20:59:25.038 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-18T20:59:25.038 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-04-18T20:59:25.039 INFO:teuthology.orchestra.run.smithi078.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-18T20:59:25.039 INFO:teuthology.orchestra.run.smithi078.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-04-18T20:59:25.040 INFO:teuthology.orchestra.run.smithi078.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-04-18T20:59:25.040 INFO:teuthology.orchestra.run.smithi078.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-04-18T20:59:25.040 INFO:teuthology.orchestra.run.smithi078.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-04-18T20:59:25.040 INFO:teuthology.orchestra.run.smithi078.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-04-18T20:59:25.040 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-04-18T20:59:25.040 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-18T20:59:25.040 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-18T20:59:25.040 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-18T20:59:25.040 INFO:teuthology.orchestra.run.smithi078.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-18T20:59:25.040 INFO:teuthology.orchestra.run.smithi078.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-18T20:59:25.040 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-18T20:59:25.041 INFO:teuthology.orchestra.run.smithi078.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-18T20:59:25.041 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-04-18T20:59:25.041 INFO:teuthology.orchestra.run.smithi078.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-04-18T20:59:25.041 INFO:teuthology.orchestra.run.smithi078.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-04-18T20:59:25.041 INFO:teuthology.orchestra.run.smithi078.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-04-18T20:59:25.041 INFO:teuthology.orchestra.run.smithi078.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-04-18T20:59:25.041 INFO:teuthology.orchestra.run.smithi078.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-04-18T20:59:25.041 INFO:teuthology.orchestra.run.smithi078.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-04-18T20:59:25.041 INFO:teuthology.orchestra.run.smithi078.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-04-18T20:59:25.048 INFO:teuthology.orchestra.run.smithi150.stdout:The following NEW packages will be installed: 2024-04-18T20:59:25.048 INFO:teuthology.orchestra.run.smithi150.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-18T20:59:25.048 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-18T20:59:25.048 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-18T20:59:25.048 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-04-18T20:59:25.048 INFO:teuthology.orchestra.run.smithi150.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-18T20:59:25.048 INFO:teuthology.orchestra.run.smithi150.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-04-18T20:59:25.049 INFO:teuthology.orchestra.run.smithi150.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-04-18T20:59:25.050 INFO:teuthology.orchestra.run.smithi150.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-04-18T20:59:25.050 INFO:teuthology.orchestra.run.smithi150.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-04-18T20:59:25.050 INFO:teuthology.orchestra.run.smithi150.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-04-18T20:59:25.050 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-04-18T20:59:25.050 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-18T20:59:25.050 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-18T20:59:25.050 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-18T20:59:25.050 INFO:teuthology.orchestra.run.smithi150.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-18T20:59:25.050 INFO:teuthology.orchestra.run.smithi150.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-18T20:59:25.050 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-18T20:59:25.050 INFO:teuthology.orchestra.run.smithi150.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-18T20:59:25.050 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-04-18T20:59:25.050 INFO:teuthology.orchestra.run.smithi150.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-04-18T20:59:25.051 INFO:teuthology.orchestra.run.smithi150.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-04-18T20:59:25.051 INFO:teuthology.orchestra.run.smithi150.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-04-18T20:59:25.051 INFO:teuthology.orchestra.run.smithi150.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-04-18T20:59:25.051 INFO:teuthology.orchestra.run.smithi150.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-04-18T20:59:25.051 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-04-18T20:59:25.051 INFO:teuthology.orchestra.run.smithi150.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-04-18T20:59:25.052 INFO:teuthology.orchestra.run.smithi132.stdout:The following NEW packages will be installed: 2024-04-18T20:59:25.052 INFO:teuthology.orchestra.run.smithi132.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-18T20:59:25.052 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-18T20:59:25.052 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-18T20:59:25.053 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-04-18T20:59:25.053 INFO:teuthology.orchestra.run.smithi132.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-18T20:59:25.053 INFO:teuthology.orchestra.run.smithi132.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-04-18T20:59:25.054 INFO:teuthology.orchestra.run.smithi132.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-04-18T20:59:25.054 INFO:teuthology.orchestra.run.smithi132.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-04-18T20:59:25.054 INFO:teuthology.orchestra.run.smithi132.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-04-18T20:59:25.054 INFO:teuthology.orchestra.run.smithi132.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-04-18T20:59:25.054 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-04-18T20:59:25.054 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-18T20:59:25.054 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-18T20:59:25.054 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-18T20:59:25.054 INFO:teuthology.orchestra.run.smithi132.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-18T20:59:25.055 INFO:teuthology.orchestra.run.smithi132.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-18T20:59:25.055 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-18T20:59:25.055 INFO:teuthology.orchestra.run.smithi132.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-18T20:59:25.055 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-04-18T20:59:25.055 INFO:teuthology.orchestra.run.smithi132.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-04-18T20:59:25.055 INFO:teuthology.orchestra.run.smithi132.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-04-18T20:59:25.055 INFO:teuthology.orchestra.run.smithi132.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-04-18T20:59:25.055 INFO:teuthology.orchestra.run.smithi132.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-04-18T20:59:25.055 INFO:teuthology.orchestra.run.smithi132.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-04-18T20:59:25.055 INFO:teuthology.orchestra.run.smithi132.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-04-18T20:59:25.055 INFO:teuthology.orchestra.run.smithi132.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-04-18T20:59:25.106 INFO:teuthology.orchestra.run.smithi187.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-18T20:59:25.110 INFO:teuthology.orchestra.run.smithi187.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-18T20:59:25.130 INFO:teuthology.orchestra.run.smithi187.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-18T20:59:25.197 INFO:teuthology.orchestra.run.smithi187.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-18T20:59:25.202 INFO:teuthology.orchestra.run.smithi187.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-18T20:59:25.215 INFO:teuthology.orchestra.run.smithi187.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-18T20:59:25.219 INFO:teuthology.orchestra.run.smithi187.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-18T20:59:25.219 INFO:teuthology.orchestra.run.smithi187.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-18T20:59:25.220 INFO:teuthology.orchestra.run.smithi187.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-18T20:59:25.225 INFO:teuthology.orchestra.run.smithi078.stdout:0 upgraded, 118 newly installed, 0 to remove and 302 not upgraded. 2024-04-18T20:59:25.225 INFO:teuthology.orchestra.run.smithi078.stdout:Need to get 181 MB of archives. 2024-04-18T20:59:25.225 INFO:teuthology.orchestra.run.smithi078.stdout:After this operation, 829 MB of additional disk space will be used. 2024-04-18T20:59:25.225 INFO:teuthology.orchestra.run.smithi078.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-18T20:59:25.229 INFO:teuthology.orchestra.run.smithi187.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-18T20:59:25.231 INFO:teuthology.orchestra.run.smithi187.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-18T20:59:25.234 INFO:teuthology.orchestra.run.smithi187.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-18T20:59:25.235 INFO:teuthology.orchestra.run.smithi187.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-18T20:59:25.241 INFO:teuthology.orchestra.run.smithi150.stdout:0 upgraded, 118 newly installed, 0 to remove and 302 not upgraded. 2024-04-18T20:59:25.242 INFO:teuthology.orchestra.run.smithi150.stdout:Need to get 181 MB of archives. 2024-04-18T20:59:25.242 INFO:teuthology.orchestra.run.smithi150.stdout:After this operation, 829 MB of additional disk space will be used. 2024-04-18T20:59:25.242 INFO:teuthology.orchestra.run.smithi150.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-18T20:59:25.242 INFO:teuthology.orchestra.run.smithi132.stdout:0 upgraded, 118 newly installed, 0 to remove and 302 not upgraded. 2024-04-18T20:59:25.242 INFO:teuthology.orchestra.run.smithi132.stdout:Need to get 181 MB of archives. 2024-04-18T20:59:25.242 INFO:teuthology.orchestra.run.smithi132.stdout:After this operation, 829 MB of additional disk space will be used. 2024-04-18T20:59:25.243 INFO:teuthology.orchestra.run.smithi132.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-18T20:59:25.244 INFO:teuthology.orchestra.run.smithi187.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-18T20:59:25.246 INFO:teuthology.orchestra.run.smithi187.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-18T20:59:25.248 INFO:teuthology.orchestra.run.smithi187.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-18T20:59:25.250 INFO:teuthology.orchestra.run.smithi187.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-18T20:59:25.265 INFO:teuthology.orchestra.run.smithi187.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-18T20:59:25.265 INFO:teuthology.orchestra.run.smithi187.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-18T20:59:25.266 INFO:teuthology.orchestra.run.smithi187.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-18T20:59:25.267 INFO:teuthology.orchestra.run.smithi187.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-18T20:59:25.267 INFO:teuthology.orchestra.run.smithi187.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-18T20:59:25.267 INFO:teuthology.orchestra.run.smithi187.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-18T20:59:25.286 INFO:teuthology.orchestra.run.smithi187.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-18T20:59:25.286 INFO:teuthology.orchestra.run.smithi187.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-18T20:59:25.287 INFO:teuthology.orchestra.run.smithi187.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-18T20:59:25.289 INFO:teuthology.orchestra.run.smithi187.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-18T20:59:25.307 INFO:teuthology.orchestra.run.smithi187.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-18T20:59:25.307 INFO:teuthology.orchestra.run.smithi187.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-18T20:59:25.308 INFO:teuthology.orchestra.run.smithi187.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-18T20:59:25.309 INFO:teuthology.orchestra.run.smithi187.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-18T20:59:25.309 INFO:teuthology.orchestra.run.smithi187.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-18T20:59:25.309 INFO:teuthology.orchestra.run.smithi187.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-18T20:59:25.325 INFO:teuthology.orchestra.run.smithi187.stdout:Get:35 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3141-g5be49cd9-1jammy [3,552 kB] 2024-04-18T20:59:25.328 INFO:teuthology.orchestra.run.smithi187.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-18T20:59:25.329 INFO:teuthology.orchestra.run.smithi187.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-18T20:59:25.329 INFO:teuthology.orchestra.run.smithi187.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-18T20:59:25.334 INFO:teuthology.orchestra.run.smithi187.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-18T20:59:25.349 INFO:teuthology.orchestra.run.smithi187.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-18T20:59:25.349 INFO:teuthology.orchestra.run.smithi187.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-18T20:59:25.350 INFO:teuthology.orchestra.run.smithi187.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-18T20:59:25.351 INFO:teuthology.orchestra.run.smithi187.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-18T20:59:25.353 INFO:teuthology.orchestra.run.smithi187.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-18T20:59:25.354 INFO:teuthology.orchestra.run.smithi187.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-18T20:59:25.370 INFO:teuthology.orchestra.run.smithi187.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-18T20:59:25.371 INFO:teuthology.orchestra.run.smithi187.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-18T20:59:25.373 INFO:teuthology.orchestra.run.smithi187.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-18T20:59:25.373 INFO:teuthology.orchestra.run.smithi187.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-18T20:59:25.391 INFO:teuthology.orchestra.run.smithi187.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-18T20:59:25.393 INFO:teuthology.orchestra.run.smithi187.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-18T20:59:25.447 INFO:teuthology.orchestra.run.smithi187.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-18T20:59:25.447 INFO:teuthology.orchestra.run.smithi187.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-18T20:59:25.449 INFO:teuthology.orchestra.run.smithi187.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-18T20:59:25.449 INFO:teuthology.orchestra.run.smithi187.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-18T20:59:25.450 INFO:teuthology.orchestra.run.smithi187.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-18T20:59:25.450 INFO:teuthology.orchestra.run.smithi150.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3141-g5be49cd9-1jammy [3,552 kB] 2024-04-18T20:59:25.458 INFO:teuthology.orchestra.run.smithi132.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3141-g5be49cd9-1jammy [3,552 kB] 2024-04-18T20:59:25.467 INFO:teuthology.orchestra.run.smithi187.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-18T20:59:25.469 INFO:teuthology.orchestra.run.smithi187.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-18T20:59:25.469 INFO:teuthology.orchestra.run.smithi187.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-18T20:59:25.484 INFO:teuthology.orchestra.run.smithi187.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-18T20:59:25.484 INFO:teuthology.orchestra.run.smithi187.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-18T20:59:25.495 INFO:teuthology.orchestra.run.smithi187.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-18T20:59:25.495 INFO:teuthology.orchestra.run.smithi187.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-18T20:59:25.496 INFO:teuthology.orchestra.run.smithi187.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-18T20:59:25.496 INFO:teuthology.orchestra.run.smithi187.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-18T20:59:25.496 INFO:teuthology.orchestra.run.smithi187.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-18T20:59:25.497 INFO:teuthology.orchestra.run.smithi187.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-18T20:59:25.500 INFO:teuthology.orchestra.run.smithi187.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-18T20:59:25.516 INFO:teuthology.orchestra.run.smithi187.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-18T20:59:25.517 INFO:teuthology.orchestra.run.smithi187.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-18T20:59:25.517 INFO:teuthology.orchestra.run.smithi187.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-18T20:59:25.523 INFO:teuthology.orchestra.run.smithi078.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3141-g5be49cd9-1jammy [3,552 kB] 2024-04-18T20:59:25.537 INFO:teuthology.orchestra.run.smithi187.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-18T20:59:25.539 INFO:teuthology.orchestra.run.smithi187.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-18T20:59:25.540 INFO:teuthology.orchestra.run.smithi187.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-18T20:59:25.540 INFO:teuthology.orchestra.run.smithi187.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-18T20:59:25.545 INFO:teuthology.orchestra.run.smithi187.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-18T20:59:25.546 INFO:teuthology.orchestra.run.smithi187.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-18T20:59:25.549 INFO:teuthology.orchestra.run.smithi187.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-18T20:59:25.558 INFO:teuthology.orchestra.run.smithi187.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-18T20:59:25.558 INFO:teuthology.orchestra.run.smithi187.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-18T20:59:25.559 INFO:teuthology.orchestra.run.smithi187.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-18T20:59:25.579 INFO:teuthology.orchestra.run.smithi187.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-18T20:59:25.579 INFO:teuthology.orchestra.run.smithi187.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-18T20:59:25.586 INFO:teuthology.orchestra.run.smithi187.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-18T20:59:25.586 INFO:teuthology.orchestra.run.smithi187.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-18T20:59:25.587 INFO:teuthology.orchestra.run.smithi187.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-18T20:59:25.589 INFO:teuthology.orchestra.run.smithi187.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-18T20:59:25.589 INFO:teuthology.orchestra.run.smithi187.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-18T20:59:25.652 INFO:teuthology.orchestra.run.smithi078.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-18T20:59:25.664 INFO:teuthology.orchestra.run.smithi132.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-18T20:59:25.664 INFO:teuthology.orchestra.run.smithi078.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-18T20:59:25.675 INFO:teuthology.orchestra.run.smithi150.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-18T20:59:25.676 INFO:teuthology.orchestra.run.smithi132.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-18T20:59:25.687 INFO:teuthology.orchestra.run.smithi150.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-18T20:59:25.746 INFO:teuthology.orchestra.run.smithi078.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-18T20:59:25.757 INFO:teuthology.orchestra.run.smithi132.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-18T20:59:25.775 INFO:teuthology.orchestra.run.smithi150.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-18T20:59:25.975 INFO:teuthology.orchestra.run.smithi078.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-18T20:59:25.987 INFO:teuthology.orchestra.run.smithi132.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-18T20:59:25.988 INFO:teuthology.orchestra.run.smithi078.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-18T20:59:25.999 INFO:teuthology.orchestra.run.smithi132.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-18T20:59:26.013 INFO:teuthology.orchestra.run.smithi150.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-18T20:59:26.017 INFO:teuthology.orchestra.run.smithi078.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-18T20:59:26.025 INFO:teuthology.orchestra.run.smithi150.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-18T20:59:26.026 INFO:teuthology.orchestra.run.smithi078.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-18T20:59:26.027 INFO:teuthology.orchestra.run.smithi078.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-18T20:59:26.029 INFO:teuthology.orchestra.run.smithi078.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-18T20:59:26.029 INFO:teuthology.orchestra.run.smithi132.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-18T20:59:26.038 INFO:teuthology.orchestra.run.smithi132.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-18T20:59:26.039 INFO:teuthology.orchestra.run.smithi132.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-18T20:59:26.040 INFO:teuthology.orchestra.run.smithi132.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-18T20:59:26.049 INFO:teuthology.orchestra.run.smithi078.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-18T20:59:26.056 INFO:teuthology.orchestra.run.smithi150.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-18T20:59:26.059 INFO:teuthology.orchestra.run.smithi132.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-18T20:59:26.065 INFO:teuthology.orchestra.run.smithi150.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-18T20:59:26.066 INFO:teuthology.orchestra.run.smithi150.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-18T20:59:26.068 INFO:teuthology.orchestra.run.smithi150.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-18T20:59:26.086 INFO:teuthology.orchestra.run.smithi150.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-18T20:59:26.217 INFO:teuthology.orchestra.run.smithi078.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-18T20:59:26.227 INFO:teuthology.orchestra.run.smithi132.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-18T20:59:26.257 INFO:teuthology.orchestra.run.smithi150.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-18T20:59:26.506 INFO:teuthology.orchestra.run.smithi150.stdout:Get:14 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3141-g5be49cd9-1jammy [3,224 kB] 2024-04-18T20:59:26.629 INFO:teuthology.orchestra.run.smithi078.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-18T20:59:26.636 INFO:teuthology.orchestra.run.smithi132.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-18T20:59:26.664 INFO:teuthology.orchestra.run.smithi078.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-18T20:59:26.666 INFO:teuthology.orchestra.run.smithi078.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-18T20:59:26.670 INFO:teuthology.orchestra.run.smithi132.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-18T20:59:26.672 INFO:teuthology.orchestra.run.smithi132.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-18T20:59:26.681 INFO:teuthology.orchestra.run.smithi150.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-18T20:59:26.719 INFO:teuthology.orchestra.run.smithi150.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-18T20:59:26.721 INFO:teuthology.orchestra.run.smithi150.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-18T20:59:26.747 INFO:teuthology.orchestra.run.smithi078.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-18T20:59:26.753 INFO:teuthology.orchestra.run.smithi132.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-18T20:59:26.797 INFO:teuthology.orchestra.run.smithi078.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-18T20:59:26.803 INFO:teuthology.orchestra.run.smithi132.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-18T20:59:26.819 INFO:teuthology.orchestra.run.smithi078.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-18T20:59:26.825 INFO:teuthology.orchestra.run.smithi132.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-18T20:59:26.826 INFO:teuthology.orchestra.run.smithi078.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-18T20:59:26.827 INFO:teuthology.orchestra.run.smithi078.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-18T20:59:26.827 INFO:teuthology.orchestra.run.smithi150.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-18T20:59:26.832 INFO:teuthology.orchestra.run.smithi132.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-18T20:59:26.833 INFO:teuthology.orchestra.run.smithi132.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-18T20:59:26.838 INFO:teuthology.orchestra.run.smithi078.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-18T20:59:26.839 INFO:teuthology.orchestra.run.smithi078.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-18T20:59:26.845 INFO:teuthology.orchestra.run.smithi132.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-18T20:59:26.845 INFO:teuthology.orchestra.run.smithi132.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-18T20:59:26.864 INFO:teuthology.orchestra.run.smithi187.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3141-g5be49cd9-1jammy [3,224 kB] 2024-04-18T20:59:27.005 INFO:teuthology.orchestra.run.smithi078.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-18T20:59:27.011 INFO:teuthology.orchestra.run.smithi132.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-18T20:59:27.043 INFO:teuthology.orchestra.run.smithi150.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-18T20:59:27.088 INFO:teuthology.orchestra.run.smithi078.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-18T20:59:27.094 INFO:teuthology.orchestra.run.smithi132.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-18T20:59:27.117 INFO:teuthology.orchestra.run.smithi078.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-18T20:59:27.122 INFO:teuthology.orchestra.run.smithi132.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-18T20:59:27.134 INFO:teuthology.orchestra.run.smithi078.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-18T20:59:27.139 INFO:teuthology.orchestra.run.smithi132.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-18T20:59:27.143 INFO:teuthology.orchestra.run.smithi150.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-18T20:59:27.179 INFO:teuthology.orchestra.run.smithi078.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-18T20:59:27.185 INFO:teuthology.orchestra.run.smithi132.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-18T20:59:27.226 INFO:teuthology.orchestra.run.smithi150.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-18T20:59:27.279 INFO:teuthology.orchestra.run.smithi150.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-18T20:59:27.381 INFO:teuthology.orchestra.run.smithi078.stdout:Get:29 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3141-g5be49cd9-1jammy [3,224 kB] 2024-04-18T20:59:27.394 INFO:teuthology.orchestra.run.smithi078.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-18T20:59:27.401 INFO:teuthology.orchestra.run.smithi132.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-18T20:59:27.409 INFO:teuthology.orchestra.run.smithi078.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-18T20:59:27.415 INFO:teuthology.orchestra.run.smithi132.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-18T20:59:27.415 INFO:teuthology.orchestra.run.smithi078.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-18T20:59:27.421 INFO:teuthology.orchestra.run.smithi150.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-18T20:59:27.421 INFO:teuthology.orchestra.run.smithi078.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-18T20:59:27.422 INFO:teuthology.orchestra.run.smithi132.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-18T20:59:27.423 INFO:teuthology.orchestra.run.smithi150.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-18T20:59:27.427 INFO:teuthology.orchestra.run.smithi132.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-18T20:59:27.442 INFO:teuthology.orchestra.run.smithi078.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-18T20:59:27.446 INFO:teuthology.orchestra.run.smithi078.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-18T20:59:27.449 INFO:teuthology.orchestra.run.smithi132.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-18T20:59:27.452 INFO:teuthology.orchestra.run.smithi132.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-18T20:59:27.593 INFO:teuthology.orchestra.run.smithi150.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-18T20:59:27.613 INFO:teuthology.orchestra.run.smithi078.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-18T20:59:27.618 INFO:teuthology.orchestra.run.smithi132.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-18T20:59:27.677 INFO:teuthology.orchestra.run.smithi150.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-18T20:59:27.706 INFO:teuthology.orchestra.run.smithi150.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-18T20:59:27.723 INFO:teuthology.orchestra.run.smithi150.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-18T20:59:27.768 INFO:teuthology.orchestra.run.smithi150.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-18T20:59:27.815 INFO:teuthology.orchestra.run.smithi150.stdout:Get:30 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3141-g5be49cd9-1jammy [712 kB] 2024-04-18T20:59:27.949 INFO:teuthology.orchestra.run.smithi132.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-18T20:59:27.950 INFO:teuthology.orchestra.run.smithi078.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-18T20:59:27.981 INFO:teuthology.orchestra.run.smithi078.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-18T20:59:27.984 INFO:teuthology.orchestra.run.smithi150.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-18T20:59:27.989 INFO:teuthology.orchestra.run.smithi132.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-18T20:59:27.991 INFO:teuthology.orchestra.run.smithi078.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-18T20:59:27.999 INFO:teuthology.orchestra.run.smithi150.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-18T20:59:28.002 INFO:teuthology.orchestra.run.smithi132.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-18T20:59:28.006 INFO:teuthology.orchestra.run.smithi150.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-18T20:59:28.011 INFO:teuthology.orchestra.run.smithi150.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-18T20:59:28.027 INFO:teuthology.orchestra.run.smithi187.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3141-g5be49cd9-1jammy [712 kB] 2024-04-18T20:59:28.032 INFO:teuthology.orchestra.run.smithi150.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-18T20:59:28.038 INFO:teuthology.orchestra.run.smithi150.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-18T20:59:28.087 INFO:teuthology.orchestra.run.smithi132.stdout:Get:39 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3141-g5be49cd9-1jammy [3,224 kB] 2024-04-18T20:59:28.112 INFO:teuthology.orchestra.run.smithi150.stdout:Get:37 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3141-g5be49cd9-1jammy [356 kB] 2024-04-18T20:59:28.195 INFO:teuthology.orchestra.run.smithi078.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-18T20:59:28.197 INFO:teuthology.orchestra.run.smithi078.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-18T20:59:28.202 INFO:teuthology.orchestra.run.smithi150.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-18T20:59:28.203 INFO:teuthology.orchestra.run.smithi078.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-18T20:59:28.208 INFO:teuthology.orchestra.run.smithi078.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-18T20:59:28.210 INFO:teuthology.orchestra.run.smithi132.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-18T20:59:28.211 INFO:teuthology.orchestra.run.smithi132.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-18T20:59:28.217 INFO:teuthology.orchestra.run.smithi132.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-18T20:59:28.222 INFO:teuthology.orchestra.run.smithi132.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-18T20:59:28.224 INFO:teuthology.orchestra.run.smithi078.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-18T20:59:28.237 INFO:teuthology.orchestra.run.smithi132.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-18T20:59:28.245 INFO:teuthology.orchestra.run.smithi078.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-18T20:59:28.251 INFO:teuthology.orchestra.run.smithi078.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-18T20:59:28.258 INFO:teuthology.orchestra.run.smithi132.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-18T20:59:28.264 INFO:teuthology.orchestra.run.smithi132.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-18T20:59:28.338 INFO:teuthology.orchestra.run.smithi150.stdout:Get:39 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3141-g5be49cd9-1jammy [32.8 kB] 2024-04-18T20:59:28.341 INFO:teuthology.orchestra.run.smithi150.stdout:Get:40 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3141-g5be49cd9-1jammy [180 kB] 2024-04-18T20:59:28.405 INFO:teuthology.orchestra.run.smithi187.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3141-g5be49cd9-1jammy [356 kB] 2024-04-18T20:59:28.426 INFO:teuthology.orchestra.run.smithi078.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-18T20:59:28.439 INFO:teuthology.orchestra.run.smithi132.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-18T20:59:28.486 INFO:teuthology.orchestra.run.smithi150.stdout:Get:41 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3141-g5be49cd9-1jammy [66.9 kB] 2024-04-18T20:59:28.489 INFO:teuthology.orchestra.run.smithi150.stdout:Get:42 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3141-g5be49cd9-1jammy [330 kB] 2024-04-18T20:59:28.521 INFO:teuthology.orchestra.run.smithi150.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-18T20:59:28.559 INFO:teuthology.orchestra.run.smithi150.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-18T20:59:28.562 INFO:teuthology.orchestra.run.smithi187.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3141-g5be49cd9-1jammy [32.8 kB] 2024-04-18T20:59:28.570 INFO:teuthology.orchestra.run.smithi150.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-18T20:59:28.676 INFO:teuthology.orchestra.run.smithi187.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3141-g5be49cd9-1jammy [180 kB] 2024-04-18T20:59:28.689 INFO:teuthology.orchestra.run.smithi078.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-18T20:59:28.695 INFO:teuthology.orchestra.run.smithi132.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-18T20:59:28.703 INFO:teuthology.orchestra.run.smithi187.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3141-g5be49cd9-1jammy [66.9 kB] 2024-04-18T20:59:28.705 INFO:teuthology.orchestra.run.smithi187.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3141-g5be49cd9-1jammy [330 kB] 2024-04-18T20:59:28.710 INFO:teuthology.orchestra.run.smithi150.stdout:Get:46 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3141-g5be49cd9-1jammy [6,895 kB] 2024-04-18T20:59:28.776 INFO:teuthology.orchestra.run.smithi150.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-18T20:59:28.777 INFO:teuthology.orchestra.run.smithi150.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-18T20:59:28.782 INFO:teuthology.orchestra.run.smithi150.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-18T20:59:28.788 INFO:teuthology.orchestra.run.smithi150.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-18T20:59:28.803 INFO:teuthology.orchestra.run.smithi150.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-18T20:59:28.824 INFO:teuthology.orchestra.run.smithi150.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-18T20:59:28.831 INFO:teuthology.orchestra.run.smithi150.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-18T20:59:28.866 INFO:teuthology.orchestra.run.smithi078.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-18T20:59:28.873 INFO:teuthology.orchestra.run.smithi132.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-18T20:59:28.881 INFO:teuthology.orchestra.run.smithi078.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-18T20:59:28.885 INFO:teuthology.orchestra.run.smithi187.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3141-g5be49cd9-1jammy [6,895 kB] 2024-04-18T20:59:28.887 INFO:teuthology.orchestra.run.smithi132.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-18T20:59:28.900 INFO:teuthology.orchestra.run.smithi078.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-18T20:59:28.907 INFO:teuthology.orchestra.run.smithi132.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-18T20:59:28.965 INFO:teuthology.orchestra.run.smithi078.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-18T20:59:28.971 INFO:teuthology.orchestra.run.smithi132.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-18T20:59:29.006 INFO:teuthology.orchestra.run.smithi150.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-18T20:59:29.114 INFO:teuthology.orchestra.run.smithi078.stdout:Get:53 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3141-g5be49cd9-1jammy [712 kB] 2024-04-18T20:59:29.260 INFO:teuthology.orchestra.run.smithi132.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-18T20:59:29.262 INFO:teuthology.orchestra.run.smithi132.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-18T20:59:29.264 INFO:teuthology.orchestra.run.smithi132.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-18T20:59:29.265 INFO:teuthology.orchestra.run.smithi132.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-18T20:59:29.267 INFO:teuthology.orchestra.run.smithi132.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-18T20:59:29.270 INFO:teuthology.orchestra.run.smithi150.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-18T20:59:29.277 INFO:teuthology.orchestra.run.smithi078.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-18T20:59:29.280 INFO:teuthology.orchestra.run.smithi078.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-18T20:59:29.283 INFO:teuthology.orchestra.run.smithi078.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-18T20:59:29.284 INFO:teuthology.orchestra.run.smithi078.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-18T20:59:29.286 INFO:teuthology.orchestra.run.smithi078.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-18T20:59:29.443 INFO:teuthology.orchestra.run.smithi078.stdout:Get:59 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3141-g5be49cd9-1jammy [356 kB] 2024-04-18T20:59:29.450 INFO:teuthology.orchestra.run.smithi150.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-18T20:59:29.464 INFO:teuthology.orchestra.run.smithi150.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-18T20:59:29.484 INFO:teuthology.orchestra.run.smithi150.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-18T20:59:29.486 INFO:teuthology.orchestra.run.smithi078.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-18T20:59:29.486 INFO:teuthology.orchestra.run.smithi132.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-18T20:59:29.549 INFO:teuthology.orchestra.run.smithi150.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-18T20:59:29.611 INFO:teuthology.orchestra.run.smithi078.stdout:Get:61 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3141-g5be49cd9-1jammy [32.8 kB] 2024-04-18T20:59:29.681 INFO:teuthology.orchestra.run.smithi078.stdout:Get:62 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3141-g5be49cd9-1jammy [180 kB] 2024-04-18T20:59:29.766 INFO:teuthology.orchestra.run.smithi078.stdout:Get:63 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3141-g5be49cd9-1jammy [66.9 kB] 2024-04-18T20:59:29.772 INFO:teuthology.orchestra.run.smithi078.stdout:Get:64 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3141-g5be49cd9-1jammy [330 kB] 2024-04-18T20:59:29.837 INFO:teuthology.orchestra.run.smithi150.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-18T20:59:29.842 INFO:teuthology.orchestra.run.smithi150.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-18T20:59:29.842 INFO:teuthology.orchestra.run.smithi150.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-18T20:59:29.843 INFO:teuthology.orchestra.run.smithi150.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-18T20:59:29.845 INFO:teuthology.orchestra.run.smithi150.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-18T20:59:29.924 INFO:teuthology.orchestra.run.smithi132.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-18T20:59:29.925 INFO:teuthology.orchestra.run.smithi078.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-18T20:59:29.930 INFO:teuthology.orchestra.run.smithi078.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-18T20:59:29.931 INFO:teuthology.orchestra.run.smithi132.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-18T20:59:29.940 INFO:teuthology.orchestra.run.smithi078.stdout:Get:67 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3141-g5be49cd9-1jammy [6,895 kB] 2024-04-18T20:59:30.063 INFO:teuthology.orchestra.run.smithi150.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-18T20:59:30.221 INFO:teuthology.orchestra.run.smithi078.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-18T20:59:30.221 INFO:teuthology.orchestra.run.smithi132.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-18T20:59:30.221 INFO:teuthology.orchestra.run.smithi078.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-18T20:59:30.222 INFO:teuthology.orchestra.run.smithi132.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-18T20:59:30.223 INFO:teuthology.orchestra.run.smithi078.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-18T20:59:30.223 INFO:teuthology.orchestra.run.smithi132.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-18T20:59:30.225 INFO:teuthology.orchestra.run.smithi078.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-18T20:59:30.225 INFO:teuthology.orchestra.run.smithi132.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-18T20:59:30.226 INFO:teuthology.orchestra.run.smithi078.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-18T20:59:30.227 INFO:teuthology.orchestra.run.smithi132.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-18T20:59:30.228 INFO:teuthology.orchestra.run.smithi078.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-18T20:59:30.229 INFO:teuthology.orchestra.run.smithi132.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-18T20:59:30.230 INFO:teuthology.orchestra.run.smithi078.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-18T20:59:30.230 INFO:teuthology.orchestra.run.smithi132.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-18T20:59:30.231 INFO:teuthology.orchestra.run.smithi078.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-18T20:59:30.232 INFO:teuthology.orchestra.run.smithi132.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-18T20:59:30.357 INFO:teuthology.orchestra.run.smithi132.stdout:Get:69 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3141-g5be49cd9-1jammy [712 kB] 2024-04-18T20:59:30.412 INFO:teuthology.orchestra.run.smithi078.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-18T20:59:30.413 INFO:teuthology.orchestra.run.smithi132.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-18T20:59:30.509 INFO:teuthology.orchestra.run.smithi150.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-18T20:59:30.522 INFO:teuthology.orchestra.run.smithi150.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-18T20:59:30.794 INFO:teuthology.orchestra.run.smithi132.stdout:Get:71 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3141-g5be49cd9-1jammy [356 kB] 2024-04-18T20:59:30.824 INFO:teuthology.orchestra.run.smithi078.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-18T20:59:30.825 INFO:teuthology.orchestra.run.smithi132.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-18T20:59:30.870 INFO:teuthology.orchestra.run.smithi078.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-18T20:59:30.871 INFO:teuthology.orchestra.run.smithi132.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-18T20:59:30.885 INFO:teuthology.orchestra.run.smithi150.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-18T20:59:30.886 INFO:teuthology.orchestra.run.smithi150.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-18T20:59:30.889 INFO:teuthology.orchestra.run.smithi150.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-18T20:59:30.891 INFO:teuthology.orchestra.run.smithi150.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-18T20:59:30.892 INFO:teuthology.orchestra.run.smithi150.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-18T20:59:30.895 INFO:teuthology.orchestra.run.smithi150.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-18T20:59:30.896 INFO:teuthology.orchestra.run.smithi150.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-18T20:59:30.898 INFO:teuthology.orchestra.run.smithi150.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-18T20:59:30.906 INFO:teuthology.orchestra.run.smithi078.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-18T20:59:30.907 INFO:teuthology.orchestra.run.smithi132.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-18T20:59:31.002 INFO:teuthology.orchestra.run.smithi078.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-18T20:59:31.003 INFO:teuthology.orchestra.run.smithi132.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-18T20:59:31.016 INFO:teuthology.orchestra.run.smithi132.stdout:Get:76 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3141-g5be49cd9-1jammy [32.8 kB] 2024-04-18T20:59:31.019 INFO:teuthology.orchestra.run.smithi132.stdout:Get:77 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3141-g5be49cd9-1jammy [180 kB] 2024-04-18T20:59:31.042 INFO:teuthology.orchestra.run.smithi078.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-18T20:59:31.043 INFO:teuthology.orchestra.run.smithi132.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-18T20:59:31.054 INFO:teuthology.orchestra.run.smithi078.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-18T20:59:31.055 INFO:teuthology.orchestra.run.smithi132.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-18T20:59:31.059 INFO:teuthology.orchestra.run.smithi078.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-18T20:59:31.061 INFO:teuthology.orchestra.run.smithi132.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-18T20:59:31.079 INFO:teuthology.orchestra.run.smithi150.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-18T20:59:31.106 INFO:teuthology.orchestra.run.smithi078.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-18T20:59:31.107 INFO:teuthology.orchestra.run.smithi132.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-18T20:59:31.109 INFO:teuthology.orchestra.run.smithi078.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-18T20:59:31.110 INFO:teuthology.orchestra.run.smithi132.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-18T20:59:31.130 INFO:teuthology.orchestra.run.smithi078.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-18T20:59:31.132 INFO:teuthology.orchestra.run.smithi132.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-18T20:59:31.164 INFO:teuthology.orchestra.run.smithi132.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3141-g5be49cd9-1jammy [66.9 kB] 2024-04-18T20:59:31.202 INFO:teuthology.orchestra.run.smithi132.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3141-g5be49cd9-1jammy [330 kB] 2024-04-18T20:59:31.294 INFO:teuthology.orchestra.run.smithi078.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-18T20:59:31.296 INFO:teuthology.orchestra.run.smithi132.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-18T20:59:31.389 INFO:teuthology.orchestra.run.smithi132.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3141-g5be49cd9-1jammy [6,895 kB] 2024-04-18T20:59:31.492 INFO:teuthology.orchestra.run.smithi150.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-18T20:59:31.567 INFO:teuthology.orchestra.run.smithi078.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-18T20:59:31.569 INFO:teuthology.orchestra.run.smithi132.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-18T20:59:31.585 INFO:teuthology.orchestra.run.smithi078.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-18T20:59:31.586 INFO:teuthology.orchestra.run.smithi132.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-18T20:59:31.596 INFO:teuthology.orchestra.run.smithi150.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-18T20:59:31.615 INFO:teuthology.orchestra.run.smithi150.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-18T20:59:31.722 INFO:teuthology.orchestra.run.smithi150.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-18T20:59:31.739 INFO:teuthology.orchestra.run.smithi078.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-18T20:59:31.740 INFO:teuthology.orchestra.run.smithi132.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-18T20:59:31.765 INFO:teuthology.orchestra.run.smithi150.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-18T20:59:31.768 INFO:teuthology.orchestra.run.smithi078.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-18T20:59:31.769 INFO:teuthology.orchestra.run.smithi132.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-18T20:59:31.774 INFO:teuthology.orchestra.run.smithi150.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-18T20:59:31.779 INFO:teuthology.orchestra.run.smithi150.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-18T20:59:31.827 INFO:teuthology.orchestra.run.smithi150.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-18T20:59:31.831 INFO:teuthology.orchestra.run.smithi150.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-18T20:59:31.854 INFO:teuthology.orchestra.run.smithi150.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-18T20:59:31.925 INFO:teuthology.orchestra.run.smithi078.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-18T20:59:31.926 INFO:teuthology.orchestra.run.smithi132.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-18T20:59:31.929 INFO:teuthology.orchestra.run.smithi078.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-18T20:59:31.929 INFO:teuthology.orchestra.run.smithi132.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-18T20:59:31.930 INFO:teuthology.orchestra.run.smithi078.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-18T20:59:31.931 INFO:teuthology.orchestra.run.smithi132.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-18T20:59:31.952 INFO:teuthology.orchestra.run.smithi078.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-18T20:59:31.953 INFO:teuthology.orchestra.run.smithi132.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-18T20:59:31.956 INFO:teuthology.orchestra.run.smithi078.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-18T20:59:31.958 INFO:teuthology.orchestra.run.smithi132.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-18T20:59:32.018 INFO:teuthology.orchestra.run.smithi150.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-18T20:59:32.292 INFO:teuthology.orchestra.run.smithi150.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-18T20:59:32.309 INFO:teuthology.orchestra.run.smithi150.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-18T20:59:32.458 INFO:teuthology.orchestra.run.smithi187.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3141-g5be49cd9-1jammy [112 kB] 2024-04-18T20:59:32.462 INFO:teuthology.orchestra.run.smithi150.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-18T20:59:32.481 INFO:teuthology.orchestra.run.smithi187.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3141-g5be49cd9-1jammy [466 kB] 2024-04-18T20:59:32.491 INFO:teuthology.orchestra.run.smithi150.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-18T20:59:32.649 INFO:teuthology.orchestra.run.smithi150.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-18T20:59:32.652 INFO:teuthology.orchestra.run.smithi150.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-18T20:59:32.654 INFO:teuthology.orchestra.run.smithi150.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-18T20:59:32.676 INFO:teuthology.orchestra.run.smithi150.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-18T20:59:32.681 INFO:teuthology.orchestra.run.smithi150.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-18T20:59:32.712 INFO:teuthology.orchestra.run.smithi187.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3141-g5be49cd9-1jammy [25.8 MB] 2024-04-18T20:59:32.850 INFO:teuthology.orchestra.run.smithi150.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3141-g5be49cd9-1jammy [112 kB] 2024-04-18T20:59:32.913 INFO:teuthology.orchestra.run.smithi150.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3141-g5be49cd9-1jammy [466 kB] 2024-04-18T20:59:33.152 INFO:teuthology.orchestra.run.smithi150.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3141-g5be49cd9-1jammy [25.8 MB] 2024-04-18T20:59:33.522 INFO:teuthology.orchestra.run.smithi078.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3141-g5be49cd9-1jammy [112 kB] 2024-04-18T20:59:33.613 INFO:teuthology.orchestra.run.smithi078.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3141-g5be49cd9-1jammy [466 kB] 2024-04-18T20:59:33.871 INFO:teuthology.orchestra.run.smithi078.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3141-g5be49cd9-1jammy [25.8 MB] 2024-04-18T20:59:35.200 INFO:teuthology.orchestra.run.smithi132.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3141-g5be49cd9-1jammy [112 kB] 2024-04-18T20:59:35.274 INFO:teuthology.orchestra.run.smithi132.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3141-g5be49cd9-1jammy [466 kB] 2024-04-18T20:59:35.531 INFO:teuthology.orchestra.run.smithi132.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3141-g5be49cd9-1jammy [25.8 MB] 2024-04-18T20:59:54.793 INFO:teuthology.orchestra.run.smithi187.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3141-g5be49cd9-1jammy [5,092 kB] 2024-04-18T20:59:57.534 INFO:teuthology.orchestra.run.smithi078.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3141-g5be49cd9-1jammy [5,092 kB] 2024-04-18T21:00:00.124 INFO:teuthology.orchestra.run.smithi187.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3141-g5be49cd9-1jammy [244 kB] 2024-04-18T21:00:00.360 INFO:teuthology.orchestra.run.smithi187.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3141-g5be49cd9-1jammy [124 kB] 2024-04-18T21:00:00.483 INFO:teuthology.orchestra.run.smithi187.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3141-g5be49cd9-1jammy [1,526 kB] 2024-04-18T21:00:01.776 INFO:teuthology.orchestra.run.smithi187.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3141-g5be49cd9-1jammy [6,257 kB] 2024-04-18T21:00:03.028 INFO:teuthology.orchestra.run.smithi150.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3141-g5be49cd9-1jammy [5,092 kB] 2024-04-18T21:00:03.511 INFO:teuthology.orchestra.run.smithi078.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3141-g5be49cd9-1jammy [244 kB] 2024-04-18T21:00:03.830 INFO:teuthology.orchestra.run.smithi078.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3141-g5be49cd9-1jammy [124 kB] 2024-04-18T21:00:04.017 INFO:teuthology.orchestra.run.smithi078.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3141-g5be49cd9-1jammy [1,526 kB] 2024-04-18T21:00:06.056 INFO:teuthology.orchestra.run.smithi078.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3141-g5be49cd9-1jammy [6,257 kB] 2024-04-18T21:00:07.591 INFO:teuthology.orchestra.run.smithi187.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3141-g5be49cd9-1jammy [22.8 MB] 2024-04-18T21:00:09.372 INFO:teuthology.orchestra.run.smithi132.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3141-g5be49cd9-1jammy [5,092 kB] 2024-04-18T21:00:10.244 INFO:teuthology.orchestra.run.smithi150.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3141-g5be49cd9-1jammy [244 kB] 2024-04-18T21:00:10.533 INFO:teuthology.orchestra.run.smithi150.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3141-g5be49cd9-1jammy [124 kB] 2024-04-18T21:00:10.648 INFO:teuthology.orchestra.run.smithi150.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3141-g5be49cd9-1jammy [1,526 kB] 2024-04-18T21:00:12.625 INFO:teuthology.orchestra.run.smithi150.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3141-g5be49cd9-1jammy [6,257 kB] 2024-04-18T21:00:13.556 INFO:teuthology.orchestra.run.smithi078.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3141-g5be49cd9-1jammy [22.8 MB] 2024-04-18T21:00:16.248 INFO:teuthology.orchestra.run.smithi132.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3141-g5be49cd9-1jammy [244 kB] 2024-04-18T21:00:16.577 INFO:teuthology.orchestra.run.smithi132.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3141-g5be49cd9-1jammy [124 kB] 2024-04-18T21:00:16.738 INFO:teuthology.orchestra.run.smithi132.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3141-g5be49cd9-1jammy [1,526 kB] 2024-04-18T21:00:18.867 INFO:teuthology.orchestra.run.smithi132.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3141-g5be49cd9-1jammy [6,257 kB] 2024-04-18T21:00:21.194 INFO:teuthology.orchestra.run.smithi150.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3141-g5be49cd9-1jammy [22.8 MB] 2024-04-18T21:00:27.463 INFO:teuthology.orchestra.run.smithi132.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3141-g5be49cd9-1jammy [22.8 MB] 2024-04-18T21:00:36.866 INFO:teuthology.orchestra.run.smithi187.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3141-g5be49cd9-1jammy [14.1 kB] 2024-04-18T21:00:36.898 INFO:teuthology.orchestra.run.smithi187.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3141-g5be49cd9-1jammy [870 kB] 2024-04-18T21:00:37.712 INFO:teuthology.orchestra.run.smithi187.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3141-g5be49cd9-1jammy [2,436 kB] 2024-04-18T21:00:38.624 INFO:teuthology.orchestra.run.smithi078.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3141-g5be49cd9-1jammy [14.1 kB] 2024-04-18T21:00:38.625 INFO:teuthology.orchestra.run.smithi078.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3141-g5be49cd9-1jammy [870 kB] 2024-04-18T21:00:39.327 INFO:teuthology.orchestra.run.smithi078.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3141-g5be49cd9-1jammy [2,436 kB] 2024-04-18T21:00:40.021 INFO:teuthology.orchestra.run.smithi187.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3141-g5be49cd9-1jammy [791 kB] 2024-04-18T21:00:40.842 INFO:teuthology.orchestra.run.smithi187.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3141-g5be49cd9-1jammy [148 kB] 2024-04-18T21:00:41.002 INFO:teuthology.orchestra.run.smithi187.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3141-g5be49cd9-1jammy [2,297 kB] 2024-04-18T21:00:41.256 INFO:teuthology.orchestra.run.smithi078.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3141-g5be49cd9-1jammy [791 kB] 2024-04-18T21:00:41.816 INFO:teuthology.orchestra.run.smithi078.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3141-g5be49cd9-1jammy [148 kB] 2024-04-18T21:00:41.908 INFO:teuthology.orchestra.run.smithi078.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3141-g5be49cd9-1jammy [2,297 kB] 2024-04-18T21:00:43.057 INFO:teuthology.orchestra.run.smithi187.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3141-g5be49cd9-1jammy [8,625 kB] 2024-04-18T21:00:43.822 INFO:teuthology.orchestra.run.smithi078.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3141-g5be49cd9-1jammy [8,625 kB] 2024-04-18T21:00:48.869 INFO:teuthology.orchestra.run.smithi150.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3141-g5be49cd9-1jammy [14.1 kB] 2024-04-18T21:00:48.911 INFO:teuthology.orchestra.run.smithi150.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3141-g5be49cd9-1jammy [870 kB] 2024-04-18T21:00:49.934 INFO:teuthology.orchestra.run.smithi150.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3141-g5be49cd9-1jammy [2,436 kB] 2024-04-18T21:00:52.636 INFO:teuthology.orchestra.run.smithi150.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3141-g5be49cd9-1jammy [791 kB] 2024-04-18T21:00:53.391 INFO:teuthology.orchestra.run.smithi078.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3141-g5be49cd9-1jammy [14.2 kB] 2024-04-18T21:00:53.417 INFO:teuthology.orchestra.run.smithi078.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3141-g5be49cd9-1jammy [51.6 MB] 2024-04-18T21:00:53.455 INFO:teuthology.orchestra.run.smithi150.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3141-g5be49cd9-1jammy [148 kB] 2024-04-18T21:00:53.568 INFO:teuthology.orchestra.run.smithi150.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3141-g5be49cd9-1jammy [2,297 kB] 2024-04-18T21:00:53.743 INFO:teuthology.orchestra.run.smithi187.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3141-g5be49cd9-1jammy [14.2 kB] 2024-04-18T21:00:53.759 INFO:teuthology.orchestra.run.smithi187.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3141-g5be49cd9-1jammy [51.6 MB] 2024-04-18T21:00:55.687 INFO:teuthology.orchestra.run.smithi150.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3141-g5be49cd9-1jammy [8,625 kB] 2024-04-18T21:01:02.819 INFO:teuthology.orchestra.run.smithi150.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3141-g5be49cd9-1jammy [14.2 kB] 2024-04-18T21:01:02.820 INFO:teuthology.orchestra.run.smithi150.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3141-g5be49cd9-1jammy [51.6 MB] 2024-04-18T21:01:03.668 INFO:teuthology.orchestra.run.smithi132.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3141-g5be49cd9-1jammy [14.1 kB] 2024-04-18T21:01:03.707 INFO:teuthology.orchestra.run.smithi132.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3141-g5be49cd9-1jammy [870 kB] 2024-04-18T21:01:04.505 INFO:teuthology.orchestra.run.smithi132.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3141-g5be49cd9-1jammy [2,436 kB] 2024-04-18T21:01:06.724 INFO:teuthology.orchestra.run.smithi132.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3141-g5be49cd9-1jammy [791 kB] 2024-04-18T21:01:07.428 INFO:teuthology.orchestra.run.smithi132.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3141-g5be49cd9-1jammy [148 kB] 2024-04-18T21:01:07.565 INFO:teuthology.orchestra.run.smithi132.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3141-g5be49cd9-1jammy [2,297 kB] 2024-04-18T21:01:09.789 INFO:teuthology.orchestra.run.smithi132.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3141-g5be49cd9-1jammy [8,625 kB] 2024-04-18T21:01:24.035 INFO:teuthology.orchestra.run.smithi132.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3141-g5be49cd9-1jammy [14.2 kB] 2024-04-18T21:01:24.036 INFO:teuthology.orchestra.run.smithi132.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3141-g5be49cd9-1jammy [51.6 MB] 2024-04-18T21:01:38.871 INFO:teuthology.orchestra.run.smithi187.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3141-g5be49cd9-1jammy [124 kB] 2024-04-18T21:01:38.995 INFO:teuthology.orchestra.run.smithi187.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3141-g5be49cd9-1jammy [38.9 kB] 2024-04-18T21:01:39.059 INFO:teuthology.orchestra.run.smithi187.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3141-g5be49cd9-1jammy [13.6 MB] 2024-04-18T21:01:54.302 INFO:teuthology.orchestra.run.smithi187.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3141-g5be49cd9-1jammy [91.2 kB] 2024-04-18T21:01:54.931 INFO:teuthology.orchestra.run.smithi187.stdout:Fetched 181 MB in 2min 29s (1,212 kB/s) 2024-04-18T21:01:55.101 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-18T21:01:55.202 INFO:teuthology.orchestra.run.smithi187.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-18T21:01:55.208 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-18T21:01:55.299 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-18T21:01:55.595 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-18T21:01:55.610 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-18T21:01:55.644 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-18T21:01:55.964 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-18T21:01:55.991 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-18T21:01:56.031 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-18T21:01:56.467 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-18T21:01:56.494 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-18T21:01:56.542 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T21:01:56.946 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-18T21:01:56.972 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-18T21:01:57.012 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T21:01:57.349 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-18T21:01:57.375 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-18T21:01:57.415 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T21:01:57.776 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-18T21:01:57.802 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-18T21:01:57.851 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-18T21:01:58.121 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package librados2. 2024-04-18T21:01:58.147 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../007-librados2_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:01:58.188 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking librados2 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:01:58.623 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package librbd1. 2024-04-18T21:01:58.650 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../008-librbd1_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:01:58.690 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking librbd1 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:01:59.134 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libcephfs2. 2024-04-18T21:01:59.160 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:01:59.201 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libcephfs2 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:01:59.470 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-rados. 2024-04-18T21:01:59.485 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../010-python3-rados_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:01:59.520 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-rados (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:01:59.956 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-18T21:01:59.982 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:02:00.023 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-ceph-argparse (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:00.259 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-cephfs. 2024-04-18T21:02:00.274 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:00.317 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-cephfs (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:00.571 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-18T21:02:00.598 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:02:00.630 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-ceph-common (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:00.941 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-18T21:02:00.968 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-18T21:02:01.008 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-18T21:02:01.345 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-prettytable. 2024-04-18T21:02:01.371 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-04-18T21:02:01.411 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-18T21:02:01.664 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-rbd. 2024-04-18T21:02:01.690 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:01.730 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-rbd (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:02.091 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-18T21:02:02.118 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-18T21:02:02.158 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-18T21:02:02.436 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-18T21:02:02.459 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-18T21:02:02.502 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-18T21:02:02.789 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-18T21:02:02.804 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-18T21:02:02.839 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-18T21:02:03.159 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package lua5.1. 2024-04-18T21:02:03.185 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-18T21:02:03.225 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-18T21:02:03.537 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package lua-any. 2024-04-18T21:02:03.552 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-04-18T21:02:03.595 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-18T21:02:03.831 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package zip. 2024-04-18T21:02:03.846 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-04-18T21:02:03.881 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking zip (3.0-12build2) ... 2024-04-18T21:02:04.151 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package unzip. 2024-04-18T21:02:04.177 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-18T21:02:04.217 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-18T21:02:04.613 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package luarocks. 2024-04-18T21:02:04.639 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-18T21:02:04.680 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-18T21:02:05.085 INFO:teuthology.orchestra.run.smithi078.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3141-g5be49cd9-1jammy [124 kB] 2024-04-18T21:02:05.098 INFO:teuthology.orchestra.run.smithi078.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3141-g5be49cd9-1jammy [38.9 kB] 2024-04-18T21:02:05.105 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package librgw2. 2024-04-18T21:02:05.131 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../025-librgw2_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:05.149 INFO:teuthology.orchestra.run.smithi078.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3141-g5be49cd9-1jammy [13.6 MB] 2024-04-18T21:02:05.171 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking librgw2 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:05.716 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-rgw. 2024-04-18T21:02:05.742 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:05.774 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-rgw (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:06.085 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-18T21:02:06.111 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-18T21:02:06.152 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-18T21:02:06.463 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libradosstriper1. 2024-04-18T21:02:06.489 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:06.530 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libradosstriper1 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:06.883 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-common. 2024-04-18T21:02:06.909 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../029-ceph-common_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:06.950 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-common (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:08.338 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-base. 2024-04-18T21:02:08.365 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../030-ceph-base_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:08.414 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-base (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:08.943 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-18T21:02:08.958 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-18T21:02:08.992 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-18T21:02:09.279 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-cheroot. 2024-04-18T21:02:09.305 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-18T21:02:09.345 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-18T21:02:09.674 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-18T21:02:09.701 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-18T21:02:09.740 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-18T21:02:10.043 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-18T21:02:10.070 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-18T21:02:10.110 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-18T21:02:10.380 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-18T21:02:10.406 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-18T21:02:10.446 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-18T21:02:10.766 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-tempora. 2024-04-18T21:02:10.792 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-04-18T21:02:10.832 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-18T21:02:11.135 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-portend. 2024-04-18T21:02:11.162 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-04-18T21:02:11.202 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-18T21:02:11.463 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-18T21:02:11.490 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-18T21:02:11.521 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-18T21:02:11.816 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-18T21:02:11.843 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-18T21:02:11.883 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-18T21:02:12.270 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-natsort. 2024-04-18T21:02:12.296 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-04-18T21:02:12.336 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-18T21:02:12.648 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-logutils. 2024-04-18T21:02:12.674 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-04-18T21:02:12.715 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-18T21:02:12.968 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-18T21:02:12.994 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-18T21:02:13.026 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-18T21:02:13.329 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-mako. 2024-04-18T21:02:13.356 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-18T21:02:13.395 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-18T21:02:13.724 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-18T21:02:13.751 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-18T21:02:13.790 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-18T21:02:14.093 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-18T21:02:14.120 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-18T21:02:14.160 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-18T21:02:14.429 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-webob. 2024-04-18T21:02:14.456 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-18T21:02:14.496 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-18T21:02:14.816 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-waitress. 2024-04-18T21:02:14.843 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-18T21:02:14.886 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-18T21:02:15.202 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-tempita. 2024-04-18T21:02:15.229 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-18T21:02:15.269 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-18T21:02:15.564 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-paste. 2024-04-18T21:02:15.590 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-18T21:02:15.630 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-18T21:02:15.967 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-18T21:02:15.993 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-18T21:02:16.033 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-18T21:02:16.336 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-18T21:02:16.363 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-18T21:02:16.402 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-18T21:02:16.681 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-webtest. 2024-04-18T21:02:16.708 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-04-18T21:02:16.747 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-18T21:02:17.017 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pecan. 2024-04-18T21:02:17.044 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-18T21:02:17.083 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-18T21:02:17.405 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-certifi. 2024-04-18T21:02:17.432 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-04-18T21:02:17.472 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-18T21:02:17.600 INFO:teuthology.orchestra.run.smithi150.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3141-g5be49cd9-1jammy [124 kB] 2024-04-18T21:02:17.645 INFO:teuthology.orchestra.run.smithi150.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3141-g5be49cd9-1jammy [38.9 kB] 2024-04-18T21:02:17.722 INFO:teuthology.orchestra.run.smithi150.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3141-g5be49cd9-1jammy [13.6 MB] 2024-04-18T21:02:17.800 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-idna. 2024-04-18T21:02:17.827 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-04-18T21:02:17.866 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-18T21:02:18.178 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-urllib3. 2024-04-18T21:02:18.204 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-18T21:02:18.244 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-18T21:02:18.589 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-requests. 2024-04-18T21:02:18.616 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-18T21:02:18.656 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-18T21:02:18.926 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-18T21:02:18.953 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-18T21:02:18.984 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-18T21:02:19.312 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-18T21:02:19.339 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:02:19.378 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:19.767 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-18T21:02:19.794 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:19.833 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:20.145 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-18T21:02:20.171 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-18T21:02:20.211 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-18T21:02:20.416 INFO:teuthology.orchestra.run.smithi078.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3141-g5be49cd9-1jammy [91.2 kB] 2024-04-18T21:02:20.498 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-openssl. 2024-04-18T21:02:20.524 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-04-18T21:02:20.564 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-18T21:02:20.867 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mgr. 2024-04-18T21:02:20.894 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:20.933 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mgr (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:20.972 INFO:teuthology.orchestra.run.smithi078.stdout:Fetched 181 MB in 2min 55s (1,033 kB/s) 2024-04-18T21:02:21.111 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-18T21:02:21.205 INFO:teuthology.orchestra.run.smithi078.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-18T21:02:21.211 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-18T21:02:21.293 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-18T21:02:21.303 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mon. 2024-04-18T21:02:21.330 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:21.370 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mon (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:21.630 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-18T21:02:21.656 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-18T21:02:21.696 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-18T21:02:21.991 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-osd. 2024-04-18T21:02:21.991 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-18T21:02:22.017 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-18T21:02:22.018 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:22.049 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-18T21:02:22.057 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-osd (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:22.486 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-18T21:02:22.512 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-18T21:02:22.560 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T21:02:22.972 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-18T21:02:22.998 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-18T21:02:23.039 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T21:02:23.119 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph. 2024-04-18T21:02:23.134 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../066-ceph_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:23.177 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:23.334 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-18T21:02:23.360 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-18T21:02:23.392 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T21:02:23.496 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-fuse. 2024-04-18T21:02:23.523 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:23.563 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-fuse (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:23.900 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mds. 2024-04-18T21:02:23.907 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-18T21:02:23.926 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:23.933 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-18T21:02:23.958 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mds (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:23.978 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-18T21:02:24.050 INFO:teuthology.orchestra.run.smithi132.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3141-g5be49cd9-1jammy [124 kB] 2024-04-18T21:02:24.141 INFO:teuthology.orchestra.run.smithi132.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3141-g5be49cd9-1jammy [38.9 kB] 2024-04-18T21:02:24.155 INFO:teuthology.orchestra.run.smithi132.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3141-g5be49cd9-1jammy [13.6 MB] 2024-04-18T21:02:24.297 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package librados2. 2024-04-18T21:02:24.324 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../007-librados2_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:24.352 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package cephadm. 2024-04-18T21:02:24.364 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking librados2 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:24.379 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../069-cephadm_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:24.419 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking cephadm (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:24.738 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-18T21:02:24.765 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-18T21:02:24.813 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-18T21:02:24.825 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package librbd1. 2024-04-18T21:02:24.852 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../008-librbd1_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:24.892 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking librbd1 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:25.133 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-18T21:02:25.148 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-18T21:02:25.191 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-18T21:02:25.286 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libcephfs2. 2024-04-18T21:02:25.312 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:25.353 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libcephfs2 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:25.638 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-rados. 2024-04-18T21:02:25.653 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../010-python3-rados_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:25.697 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-rados (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:26.025 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-18T21:02:26.051 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:02:26.091 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-ceph-argparse (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:26.221 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-babel. 2024-04-18T21:02:26.249 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-18T21:02:26.287 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-18T21:02:26.335 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-cephfs. 2024-04-18T21:02:26.361 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:26.402 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-cephfs (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:26.633 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-jinja2. 2024-04-18T21:02:26.660 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-18T21:02:26.679 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-18T21:02:26.699 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-18T21:02:26.705 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:02:26.746 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-ceph-common (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:27.002 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-18T21:02:27.018 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:02:27.052 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:27.074 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-18T21:02:27.100 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-18T21:02:27.141 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-18T21:02:27.372 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-18T21:02:27.399 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-04-18T21:02:27.439 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-18T21:02:27.468 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-prettytable. 2024-04-18T21:02:27.495 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-04-18T21:02:27.535 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-18T21:02:27.725 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-routes. 2024-04-18T21:02:27.752 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-18T21:02:27.791 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-18T21:02:27.804 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-rbd. 2024-04-18T21:02:27.819 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:27.862 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-rbd (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:28.095 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-18T21:02:28.122 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:02:28.161 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:28.173 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-18T21:02:28.200 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-18T21:02:28.232 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-18T21:02:28.526 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-18T21:02:28.552 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-18T21:02:28.593 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-18T21:02:28.879 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-18T21:02:28.894 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-18T21:02:28.937 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-18T21:02:29.265 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package lua5.1. 2024-04-18T21:02:29.291 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-18T21:02:29.331 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-18T21:02:29.372 INFO:teuthology.orchestra.run.smithi150.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3141-g5be49cd9-1jammy [91.2 kB] 2024-04-18T21:02:29.383 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-18T21:02:29.399 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-18T21:02:29.441 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-18T21:02:29.645 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package lua-any. 2024-04-18T21:02:29.671 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-04-18T21:02:29.712 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-18T21:02:29.923 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package zip. 2024-04-18T21:02:29.929 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-joblib. 2024-04-18T21:02:29.932 INFO:teuthology.orchestra.run.smithi150.stdout:Fetched 181 MB in 3min 4s (982 kB/s) 2024-04-18T21:02:29.938 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-04-18T21:02:29.955 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-18T21:02:29.981 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking zip (3.0-12build2) ... 2024-04-18T21:02:30.028 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-18T21:02:30.094 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-18T21:02:30.194 INFO:teuthology.orchestra.run.smithi150.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-18T21:02:30.200 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-18T21:02:30.284 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-18T21:02:30.309 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package unzip. 2024-04-18T21:02:30.335 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-18T21:02:30.376 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-18T21:02:30.390 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-18T21:02:30.417 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-18T21:02:30.457 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-18T21:02:30.621 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-18T21:02:30.648 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-18T21:02:30.687 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-18T21:02:30.726 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-sklearn. 2024-04-18T21:02:30.754 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-18T21:02:30.772 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package luarocks. 2024-04-18T21:02:30.798 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-18T21:02:30.838 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-18T21:02:30.976 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-18T21:02:31.049 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-18T21:02:31.059 INFO:teuthology.orchestra.run.smithi132.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/main/5be49cd9e6fca1ff6a05f2473aa3b399da760600/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3141-g5be49cd9-1jammy [91.2 kB] 2024-04-18T21:02:31.075 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-18T21:02:31.115 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-18T21:02:31.180 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package librgw2. 2024-04-18T21:02:31.206 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../025-librgw2_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:31.238 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking librgw2 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:31.485 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-18T21:02:31.512 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-18T21:02:31.560 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T21:02:31.620 INFO:teuthology.orchestra.run.smithi132.stdout:Fetched 181 MB in 3min 6s (974 kB/s) 2024-04-18T21:02:31.644 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-18T21:02:31.671 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:02:31.734 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-18T21:02:31.782 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-rgw. 2024-04-18T21:02:31.795 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:31.808 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:31.831 INFO:teuthology.orchestra.run.smithi132.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-18T21:02:31.837 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-18T21:02:31.849 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-rgw (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:31.916 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-18T21:02:31.947 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-18T21:02:31.973 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-18T21:02:32.013 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T21:02:32.227 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-18T21:02:32.253 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-18T21:02:32.261 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-18T21:02:32.288 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-18T21:02:32.293 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-18T21:02:32.328 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-18T21:02:32.341 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-18T21:02:32.368 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-18T21:02:32.400 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T21:02:32.580 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libradosstriper1. 2024-04-18T21:02:32.606 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:32.646 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libradosstriper1 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:32.673 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-18T21:02:32.700 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-18T21:02:32.716 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-cachetools. 2024-04-18T21:02:32.736 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-18T21:02:32.739 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-18T21:02:32.743 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-04-18T21:02:32.762 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-18T21:02:32.782 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-18T21:02:32.803 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-18T21:02:33.050 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-common. 2024-04-18T21:02:33.069 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-18T21:02:33.076 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../029-ceph-common_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:33.096 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-18T21:02:33.116 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-common (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:33.135 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-18T21:02:33.147 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package librados2. 2024-04-18T21:02:33.153 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-18T21:02:33.174 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../007-librados2_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:33.178 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-18T21:02:33.214 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking librados2 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:33.226 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T21:02:33.481 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-18T21:02:33.508 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-18T21:02:33.577 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-18T21:02:33.647 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-18T21:02:33.667 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package librbd1. 2024-04-18T21:02:33.673 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-18T21:02:33.693 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../008-librbd1_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:33.713 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T21:02:33.733 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking librbd1 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:33.892 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-rsa. 2024-04-18T21:02:33.919 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-04-18T21:02:33.958 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-18T21:02:34.033 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-18T21:02:34.060 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-18T21:02:34.091 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T21:02:34.128 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libcephfs2. 2024-04-18T21:02:34.154 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:34.194 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libcephfs2 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:34.279 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-google-auth. 2024-04-18T21:02:34.306 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-04-18T21:02:34.337 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-18T21:02:34.470 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-18T21:02:34.480 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-rados. 2024-04-18T21:02:34.495 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../010-python3-rados_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:34.496 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-18T21:02:34.536 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-18T21:02:34.539 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-rados (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:34.639 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-base. 2024-04-18T21:02:34.649 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-18T21:02:34.665 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../030-ceph-base_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:34.676 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-18T21:02:34.715 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-base (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:34.715 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-18T21:02:34.856 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package librados2. 2024-04-18T21:02:34.882 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../007-librados2_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:34.923 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking librados2 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:35.027 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-websocket. 2024-04-18T21:02:35.054 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-04-18T21:02:35.058 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-18T21:02:35.084 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:02:35.093 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-18T21:02:35.125 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-ceph-argparse (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:35.235 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-18T21:02:35.262 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-18T21:02:35.318 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-18T21:02:35.352 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-cephfs. 2024-04-18T21:02:35.359 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package librbd1. 2024-04-18T21:02:35.368 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:35.381 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../008-librbd1_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:35.396 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-18T21:02:35.402 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-cephfs (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:35.417 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking librbd1 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:35.423 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-18T21:02:35.463 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-18T21:02:35.621 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-cheroot. 2024-04-18T21:02:35.648 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-18T21:02:35.688 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-18T21:02:35.730 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-18T21:02:35.757 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:02:35.797 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-ceph-common (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:35.812 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libcephfs2. 2024-04-18T21:02:35.827 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:35.862 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libcephfs2 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:36.041 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-18T21:02:36.068 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-18T21:02:36.094 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-18T21:02:36.108 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-18T21:02:36.110 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:02:36.125 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-18T21:02:36.139 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-rados. 2024-04-18T21:02:36.151 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-18T21:02:36.152 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:36.154 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../010-python3-rados_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:36.192 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-18T21:02:36.197 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-rados (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:36.353 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-18T21:02:36.379 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-18T21:02:36.411 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-18T21:02:36.446 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-18T21:02:36.463 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-18T21:02:36.505 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-18T21:02:36.511 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-prettytable. 2024-04-18T21:02:36.525 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-18T21:02:36.537 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-04-18T21:02:36.552 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:02:36.577 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-18T21:02:36.592 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-ceph-argparse (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:36.705 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-18T21:02:36.731 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-18T21:02:36.772 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-18T21:02:36.814 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-rbd. 2024-04-18T21:02:36.828 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-cephfs. 2024-04-18T21:02:36.829 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:36.843 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:36.852 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-18T21:02:36.864 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-rbd (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:36.878 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-cephfs (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:36.879 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-18T21:02:36.918 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-18T21:02:37.083 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-tempora. 2024-04-18T21:02:37.109 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-04-18T21:02:37.139 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-18T21:02:37.149 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-18T21:02:37.165 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:02:37.166 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-18T21:02:37.182 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-18T21:02:37.196 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package jq. 2024-04-18T21:02:37.206 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-ceph-common (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:37.216 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-18T21:02:37.223 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-18T21:02:37.262 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-18T21:02:37.461 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-portend. 2024-04-18T21:02:37.477 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-18T21:02:37.487 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-04-18T21:02:37.504 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-18T21:02:37.506 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package socat. 2024-04-18T21:02:37.526 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-18T21:02:37.528 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-18T21:02:37.534 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-18T21:02:37.544 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-18T21:02:37.552 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-18T21:02:37.564 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-18T21:02:37.592 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-18T21:02:37.814 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-18T21:02:37.840 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-18T21:02:37.849 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-18T21:02:37.859 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package xmlstarlet. 2024-04-18T21:02:37.864 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-18T21:02:37.872 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-18T21:02:37.884 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-18T21:02:37.907 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-18T21:02:37.926 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-18T21:02:37.945 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-prettytable. 2024-04-18T21:02:37.972 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-04-18T21:02:38.012 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-18T21:02:38.159 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-18T21:02:38.185 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-18T21:02:38.210 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package lua5.1. 2024-04-18T21:02:38.225 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-18T21:02:38.225 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-18T21:02:38.256 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-rbd. 2024-04-18T21:02:38.260 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-18T21:02:38.271 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:38.272 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-test. 2024-04-18T21:02:38.300 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../097-ceph-test_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:38.306 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-rbd (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:38.338 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-test (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:38.555 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package lua-any. 2024-04-18T21:02:38.570 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-04-18T21:02:38.571 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-natsort. 2024-04-18T21:02:38.597 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-04-18T21:02:38.613 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-18T21:02:38.618 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-18T21:02:38.629 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-18T21:02:38.644 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-18T21:02:38.684 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-18T21:02:38.857 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package zip. 2024-04-18T21:02:38.872 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-04-18T21:02:38.916 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking zip (3.0-12build2) ... 2024-04-18T21:02:38.924 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-logutils. 2024-04-18T21:02:38.950 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-04-18T21:02:38.962 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-18T21:02:38.977 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-18T21:02:38.990 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-18T21:02:39.020 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-18T21:02:39.244 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package unzip. 2024-04-18T21:02:39.270 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-18T21:02:39.293 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-18T21:02:39.310 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-18T21:02:39.319 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-18T21:02:39.332 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-18T21:02:39.358 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-18T21:02:39.360 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-18T21:02:39.398 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-18T21:02:39.672 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-mako. 2024-04-18T21:02:39.681 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package luarocks. 2024-04-18T21:02:39.698 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-18T21:02:39.707 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-18T21:02:39.738 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-18T21:02:39.747 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-18T21:02:39.785 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package lua5.1. 2024-04-18T21:02:39.811 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-18T21:02:39.860 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-18T21:02:40.083 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-18T21:02:40.110 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-18T21:02:40.130 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package librgw2. 2024-04-18T21:02:40.141 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-18T21:02:40.157 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../025-librgw2_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:40.197 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking librgw2 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:40.222 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package lua-any. 2024-04-18T21:02:40.248 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-04-18T21:02:40.289 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-18T21:02:40.428 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-18T21:02:40.454 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-18T21:02:40.494 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-18T21:02:40.516 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package zip. 2024-04-18T21:02:40.534 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-04-18T21:02:40.535 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-volume. 2024-04-18T21:02:40.562 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:02:40.574 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking zip (3.0-12build2) ... 2024-04-18T21:02:40.601 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-volume (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:40.766 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-rgw. 2024-04-18T21:02:40.781 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:40.797 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-webob. 2024-04-18T21:02:40.823 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-18T21:02:40.824 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-rgw (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:40.863 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-18T21:02:40.913 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-18T21:02:40.928 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package unzip. 2024-04-18T21:02:40.941 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:40.954 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-18T21:02:40.979 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libcephfs-dev (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:41.003 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-18T21:02:41.144 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-18T21:02:41.170 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-18T21:02:41.202 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-18T21:02:41.208 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-waitress. 2024-04-18T21:02:41.235 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-18T21:02:41.278 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-18T21:02:41.291 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-18T21:02:41.318 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-18T21:02:41.357 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-18T21:02:41.515 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package luarocks. 2024-04-18T21:02:41.521 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libradosstriper1. 2024-04-18T21:02:41.541 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-18T21:02:41.548 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:41.588 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libradosstriper1 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:41.590 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-18T21:02:41.595 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-tempita. 2024-04-18T21:02:41.621 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-18T21:02:41.661 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-18T21:02:41.687 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-18T21:02:41.715 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-04-18T21:02:41.753 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-18T21:02:41.939 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-paste. 2024-04-18T21:02:41.965 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package librgw2. 2024-04-18T21:02:41.966 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-18T21:02:41.992 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../025-librgw2_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:42.006 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-18T21:02:42.025 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-common. 2024-04-18T21:02:42.032 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking librgw2 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:42.051 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../029-ceph-common_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:42.057 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package nvme-cli. 2024-04-18T21:02:42.084 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-18T21:02:42.091 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-common (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:42.115 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-18T21:02:42.342 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-18T21:02:42.358 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-18T21:02:42.401 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-18T21:02:42.529 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package pkg-config. 2024-04-18T21:02:42.556 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-18T21:02:42.585 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-rgw. 2024-04-18T21:02:42.595 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-18T21:02:42.611 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:42.659 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-rgw (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:42.670 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-18T21:02:42.686 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-18T21:02:42.720 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-18T21:02:42.864 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-18T21:02:42.880 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-18T21:02:42.922 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-18T21:02:43.032 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-webtest. 2024-04-18T21:02:43.058 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-04-18T21:02:43.071 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-18T21:02:43.097 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-18T21:02:43.098 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-18T21:02:43.146 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-18T21:02:43.368 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-18T21:02:43.395 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-18T21:02:43.410 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pecan. 2024-04-18T21:02:43.434 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-18T21:02:43.436 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-18T21:02:43.438 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-base. 2024-04-18T21:02:43.464 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../030-ceph-base_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:43.474 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libradosstriper1. 2024-04-18T21:02:43.476 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-18T21:02:43.500 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:43.514 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-base (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:43.540 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libradosstriper1 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:43.737 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pastescript. 2024-04-18T21:02:43.764 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-04-18T21:02:43.803 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-18T21:02:43.865 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-certifi. 2024-04-18T21:02:43.891 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-04-18T21:02:43.931 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-18T21:02:43.994 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-common. 2024-04-18T21:02:44.020 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../029-ceph-common_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:44.051 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-18T21:02:44.069 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-common (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:44.077 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-18T21:02:44.117 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-18T21:02:44.131 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pluggy. 2024-04-18T21:02:44.148 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-18T21:02:44.189 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-18T21:02:44.242 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-idna. 2024-04-18T21:02:44.258 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-04-18T21:02:44.292 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-18T21:02:44.403 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-cheroot. 2024-04-18T21:02:44.430 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-18T21:02:44.470 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-18T21:02:44.526 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-psutil. 2024-04-18T21:02:44.554 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-18T21:02:44.587 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-urllib3. 2024-04-18T21:02:44.592 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-18T21:02:44.614 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-18T21:02:44.654 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-18T21:02:44.790 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-18T21:02:44.816 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-18T21:02:44.856 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-18T21:02:44.895 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-py. 2024-04-18T21:02:44.923 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-04-18T21:02:44.957 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-requests. 2024-04-18T21:02:44.961 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-18T21:02:44.984 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-18T21:02:45.024 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-18T21:02:45.159 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-18T21:02:45.190 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-18T21:02:45.265 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pygments. 2024-04-18T21:02:45.293 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-18T21:02:45.331 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-18T21:02:45.335 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-18T21:02:45.362 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-18T21:02:45.401 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-18T21:02:45.401 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-18T21:02:45.516 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-base. 2024-04-18T21:02:45.543 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../030-ceph-base_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:45.592 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-base (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:45.662 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-18T21:02:45.688 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-18T21:02:45.697 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-18T21:02:45.720 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-18T21:02:45.723 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:02:45.763 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:45.802 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-18T21:02:45.831 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-18T21:02:45.869 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-18T21:02:46.023 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-tempora. 2024-04-18T21:02:46.049 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-04-18T21:02:46.089 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-18T21:02:46.152 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-18T21:02:46.178 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:46.180 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-toml. 2024-04-18T21:02:46.204 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-18T21:02:46.208 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-04-18T21:02:46.209 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:46.231 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-18T21:02:46.246 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-18T21:02:46.271 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-18T21:02:46.392 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-portend. 2024-04-18T21:02:46.419 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-04-18T21:02:46.459 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-18T21:02:46.507 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pytest. 2024-04-18T21:02:46.524 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-18T21:02:46.529 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-18T21:02:46.557 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-18T21:02:46.557 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-18T21:02:46.596 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-18T21:02:46.641 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-cheroot. 2024-04-18T21:02:46.667 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-18T21:02:46.715 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-18T21:02:46.720 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-18T21:02:46.735 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-18T21:02:46.770 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-18T21:02:46.886 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-simplejson. 2024-04-18T21:02:46.899 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-openssl. 2024-04-18T21:02:46.914 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-18T21:02:46.926 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-04-18T21:02:46.952 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-18T21:02:46.965 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-18T21:02:47.039 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-18T21:02:47.066 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-18T21:02:47.102 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-18T21:02:47.106 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-18T21:02:47.128 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-18T21:02:47.177 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-18T21:02:47.230 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-18T21:02:47.244 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-18T21:02:47.288 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-18T21:02:47.310 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr. 2024-04-18T21:02:47.337 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:47.377 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:47.485 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-natsort. 2024-04-18T21:02:47.497 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-18T21:02:47.511 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-04-18T21:02:47.523 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-18T21:02:47.551 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-18T21:02:47.563 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-18T21:02:47.806 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mon. 2024-04-18T21:02:47.829 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-logutils. 2024-04-18T21:02:47.832 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:47.856 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-04-18T21:02:47.858 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-18T21:02:47.872 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mon (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:47.884 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-18T21:02:47.887 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-18T21:02:47.933 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-18T21:02:48.000 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package radosgw. 2024-04-18T21:02:48.028 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../116-radosgw_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:48.067 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking radosgw (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:48.190 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-18T21:02:48.216 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-18T21:02:48.257 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-18T21:02:48.302 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-tempora. 2024-04-18T21:02:48.329 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-04-18T21:02:48.377 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-18T21:02:48.459 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-osd. 2024-04-18T21:02:48.485 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:48.525 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-osd (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:48.560 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-mako. 2024-04-18T21:02:48.586 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-18T21:02:48.626 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-18T21:02:48.739 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-portend. 2024-04-18T21:02:48.765 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-04-18T21:02:48.822 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-18T21:02:48.853 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package rbd-fuse. 2024-04-18T21:02:48.866 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:48.903 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking rbd-fuse (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:48.946 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-18T21:02:48.973 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-18T21:02:49.013 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-18T21:02:49.125 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-18T21:02:49.151 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-18T21:02:49.192 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-18T21:02:49.199 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-18T21:02:49.274 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-18T21:02:49.300 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-18T21:02:49.332 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-18T21:02:49.466 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-18T21:02:49.561 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-18T21:02:49.588 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-18T21:02:49.600 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-18T21:02:49.604 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph. 2024-04-18T21:02:49.610 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-webob. 2024-04-18T21:02:49.619 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../066-ceph_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:49.637 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-18T21:02:49.637 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-18T21:02:49.662 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:49.676 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-18T21:02:49.841 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-18T21:02:50.016 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-natsort. 2024-04-18T21:02:50.029 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-waitress. 2024-04-18T21:02:50.042 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-04-18T21:02:50.056 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-18T21:02:50.082 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-18T21:02:50.099 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-18T21:02:50.157 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-fuse. 2024-04-18T21:02:50.184 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:50.195 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-18T21:02:50.223 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-fuse (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:50.377 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-logutils. 2024-04-18T21:02:50.403 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-04-18T21:02:50.407 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-tempita. 2024-04-18T21:02:50.433 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-18T21:02:50.444 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-18T21:02:50.482 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-18T21:02:50.598 INFO:teuthology.orchestra.run.smithi187.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-18T21:02:50.601 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mds. 2024-04-18T21:02:50.628 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:50.660 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up cephadm (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:50.668 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mds (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:50.705 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-18T21:02:50.731 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-18T21:02:50.763 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-18T21:02:50.785 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-paste. 2024-04-18T21:02:50.811 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-18T21:02:50.851 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-18T21:02:51.050 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-mako. 2024-04-18T21:02:51.076 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-18T21:02:51.080 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package cephadm. 2024-04-18T21:02:51.106 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../069-cephadm_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:51.108 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-18T21:02:51.146 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking cephadm (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:51.171 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-18T21:02:51.185 INFO:teuthology.orchestra.run.smithi187.stdout:Adding system user cephadm....done 2024-04-18T21:02:51.186 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-18T21:02:51.230 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-18T21:02:51.341 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-18T21:02:51.394 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-18T21:02:51.421 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-18T21:02:51.453 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-18T21:02:51.491 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-18T21:02:51.517 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-18T21:02:51.557 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-18T21:02:51.557 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-18T21:02:51.584 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-18T21:02:51.593 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-18T21:02:51.632 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-18T21:02:51.739 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-18T21:02:51.766 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-18T21:02:51.806 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-18T21:02:51.818 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-18T21:02:51.876 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-18T21:02:51.891 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-18T21:02:51.902 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-webtest. 2024-04-18T21:02:51.928 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-04-18T21:02:51.936 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-18T21:02:51.959 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-18T21:02:51.960 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-18T21:02:52.100 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-webob. 2024-04-18T21:02:52.127 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-18T21:02:52.175 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-18T21:02:52.196 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-18T21:02:52.263 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pecan. 2024-04-18T21:02:52.289 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-18T21:02:52.329 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-18T21:02:52.463 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-18T21:02:52.545 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-waitress. 2024-04-18T21:02:52.571 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-18T21:02:52.589 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-18T21:02:52.614 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-18T21:02:52.701 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-certifi. 2024-04-18T21:02:52.728 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-04-18T21:02:52.768 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-18T21:02:52.890 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-tempita. 2024-04-18T21:02:52.908 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-18T21:02:52.916 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-18T21:02:52.948 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-18T21:02:53.015 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-babel. 2024-04-18T21:02:53.042 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-18T21:02:53.081 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-18T21:02:53.095 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-idna. 2024-04-18T21:02:53.122 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-04-18T21:02:53.162 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-18T21:02:53.234 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-paste. 2024-04-18T21:02:53.261 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-18T21:02:53.268 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-18T21:02:53.301 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-18T21:02:53.409 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-jinja2. 2024-04-18T21:02:53.437 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-18T21:02:53.476 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-18T21:02:53.481 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-urllib3. 2024-04-18T21:02:53.508 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-18T21:02:53.528 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-18T21:02:53.548 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-18T21:02:53.604 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-18T21:02:53.620 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-18T21:02:53.654 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-18T21:02:53.796 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-18T21:02:53.804 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-18T21:02:53.812 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:02:53.846 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:53.860 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-requests. 2024-04-18T21:02:53.886 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-18T21:02:53.926 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-18T21:02:53.949 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-18T21:02:53.976 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-18T21:02:54.015 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-18T21:02:54.130 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-18T21:02:54.166 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-18T21:02:54.182 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-04-18T21:02:54.204 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-18T21:02:54.215 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-18T21:02:54.219 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-18T21:02:54.253 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-18T21:02:54.319 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-webtest. 2024-04-18T21:02:54.346 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-04-18T21:02:54.385 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-18T21:02:54.398 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-18T21:02:54.477 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-routes. 2024-04-18T21:02:54.504 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-18T21:02:54.540 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-18T21:02:54.543 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-18T21:02:54.556 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:02:54.598 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:54.666 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-18T21:02:54.697 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-pecan. 2024-04-18T21:02:54.723 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-18T21:02:54.763 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-18T21:02:54.831 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-18T21:02:54.857 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:02:54.888 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:54.925 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-ceph-argparse (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:54.970 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-18T21:02:54.997 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:55.036 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:55.118 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-certifi. 2024-04-18T21:02:55.145 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-04-18T21:02:55.185 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-18T21:02:55.243 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-18T21:02:55.347 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-18T21:02:55.369 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-18T21:02:55.374 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-18T21:02:55.439 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-18T21:02:55.463 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-idna. 2024-04-18T21:02:55.490 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-04-18T21:02:55.495 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-18T21:02:55.530 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-18T21:02:55.621 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-18T21:02:55.717 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-openssl. 2024-04-18T21:02:55.743 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-04-18T21:02:55.775 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-18T21:02:55.858 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-urllib3. 2024-04-18T21:02:55.880 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-18T21:02:55.884 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-18T21:02:55.924 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-18T21:02:56.111 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mgr. 2024-04-18T21:02:56.127 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-18T21:02:56.138 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:56.155 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-18T21:02:56.178 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mgr (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:56.185 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-18T21:02:56.244 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-requests. 2024-04-18T21:02:56.271 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-18T21:02:56.311 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-18T21:02:56.411 INFO:teuthology.orchestra.run.smithi187.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-18T21:02:56.445 INFO:teuthology.orchestra.run.smithi187.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-18T21:02:56.492 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-18T21:02:56.572 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mon. 2024-04-18T21:02:56.593 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-18T21:02:56.599 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:56.639 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mon (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:56.639 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-18T21:02:56.665 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-18T21:02:56.681 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-joblib. 2024-04-18T21:02:56.705 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-18T21:02:56.708 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-18T21:02:56.747 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-18T21:02:56.936 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-18T21:02:57.000 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-18T21:02:57.016 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:02:57.062 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-18T21:02:57.067 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:57.109 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-18T21:02:57.137 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-18T21:02:57.176 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-18T21:02:57.201 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-osd. 2024-04-18T21:02:57.228 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:57.267 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-osd (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:57.329 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-18T21:02:57.454 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-sklearn. 2024-04-18T21:02:57.457 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-18T21:02:57.469 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-18T21:02:57.484 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:57.503 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-18T21:02:57.524 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:57.606 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-18T21:02:57.827 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-18T21:02:57.853 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-18T21:02:57.885 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-18T21:02:57.915 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up zip (3.0-12build2) ... 2024-04-18T21:02:58.066 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-18T21:02:58.163 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-openssl. 2024-04-18T21:02:58.171 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-18T21:02:58.189 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-04-18T21:02:58.198 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:02:58.229 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-18T21:02:58.323 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:58.329 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph. 2024-04-18T21:02:58.355 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../066-ceph_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:58.395 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:58.574 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-mgr. 2024-04-18T21:02:58.601 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:58.641 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-mgr (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:58.723 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-fuse. 2024-04-18T21:02:58.735 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-18T21:02:58.750 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:58.789 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-fuse (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:58.986 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-18T21:02:59.036 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-mon. 2024-04-18T21:02:59.062 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:59.102 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-mon (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:59.112 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-18T21:02:59.168 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mds. 2024-04-18T21:02:59.195 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:59.234 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mds (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:59.238 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-18T21:02:59.368 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-cachetools. 2024-04-18T21:02:59.396 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-04-18T21:02:59.435 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-18T21:02:59.539 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-18T21:02:59.612 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package cephadm. 2024-04-18T21:02:59.639 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../069-cephadm_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:59.647 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-osd. 2024-04-18T21:02:59.662 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:02:59.670 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking cephadm (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:59.705 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-18T21:02:59.705 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-osd (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:02:59.733 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-18T21:02:59.763 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-18T21:02:59.923 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-18T21:02:59.990 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-18T21:03:00.005 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-18T21:03:00.048 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-18T21:03:00.083 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-18T21:03:00.110 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-18T21:03:00.149 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-18T21:03:00.166 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-18T21:03:00.384 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-18T21:03:00.400 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-18T21:03:00.419 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-rsa. 2024-04-18T21:03:00.442 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-18T21:03:00.446 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-04-18T21:03:00.485 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-18T21:03:00.526 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-18T21:03:00.776 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph. 2024-04-18T21:03:00.790 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-google-auth. 2024-04-18T21:03:00.791 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../066-ceph_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:03:00.803 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-18T21:03:00.817 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-04-18T21:03:00.834 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:00.856 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-18T21:03:01.146 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-18T21:03:01.151 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-18T21:03:01.153 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-fuse. 2024-04-18T21:03:01.178 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-18T21:03:01.180 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:03:01.218 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-18T21:03:01.219 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-fuse (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:01.397 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-18T21:03:01.479 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-websocket. 2024-04-18T21:03:01.481 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-babel. 2024-04-18T21:03:01.506 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-04-18T21:03:01.508 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-18T21:03:01.522 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-ceph-common (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:01.545 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-18T21:03:01.547 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-18T21:03:01.831 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-mds. 2024-04-18T21:03:01.858 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:03:01.884 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-jinja2. 2024-04-18T21:03:01.889 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-mds (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:01.899 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-18T21:03:01.910 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-18T21:03:01.926 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-18T21:03:01.950 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-18T21:03:01.965 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-18T21:03:02.091 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-idna (3.3-1) ... 2024-04-18T21:03:02.286 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-18T21:03:02.301 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package cephadm. 2024-04-18T21:03:02.314 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:03:02.327 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../069-cephadm_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:03:02.367 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking cephadm (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:02.378 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:02.400 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-18T21:03:02.653 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-18T21:03:02.655 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-18T21:03:02.671 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:03:02.680 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-18T21:03:02.704 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:02.711 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-18T21:03:02.731 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-18T21:03:02.758 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-04-18T21:03:02.797 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-18T21:03:03.008 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-18T21:03:03.035 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-18T21:03:03.056 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-18T21:03:03.074 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-18T21:03:03.082 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-18T21:03:03.109 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-routes. 2024-04-18T21:03:03.122 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-18T21:03:03.136 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-18T21:03:03.175 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-18T21:03:03.411 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-18T21:03:03.438 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-18T21:03:03.477 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-18T21:03:03.489 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-18T21:03:03.512 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-18T21:03:03.539 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:03:03.578 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:03.741 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T21:03:03.746 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package jq. 2024-04-18T21:03:03.762 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-18T21:03:03.805 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-18T21:03:03.850 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-18T21:03:04.033 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package socat. 2024-04-18T21:03:04.048 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-18T21:03:04.091 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-18T21:03:04.110 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-18T21:03:04.152 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-babel. 2024-04-18T21:03:04.168 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-18T21:03:04.202 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-18T21:03:04.236 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-18T21:03:04.362 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-18T21:03:04.411 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package xmlstarlet. 2024-04-18T21:03:04.426 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-18T21:03:04.469 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-18T21:03:04.488 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-jinja2. 2024-04-18T21:03:04.515 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-18T21:03:04.555 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-18T21:03:04.655 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-18T21:03:04.792 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-18T21:03:04.807 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-18T21:03:04.815 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-test. 2024-04-18T21:03:04.831 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../097-ceph-test_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:03:04.850 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-18T21:03:04.865 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-test (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:04.867 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-18T21:03:04.882 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:03:04.925 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:04.931 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-18T21:03:05.190 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T21:03:05.236 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-18T21:03:05.251 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-04-18T21:03:05.286 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-18T21:03:05.308 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-18T21:03:05.353 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-joblib. 2024-04-18T21:03:05.381 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-18T21:03:05.420 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-18T21:03:05.589 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-routes. 2024-04-18T21:03:05.609 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-18T21:03:05.616 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-18T21:03:05.655 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-18T21:03:05.877 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-18T21:03:05.976 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-18T21:03:05.999 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-18T21:03:06.003 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:03:06.026 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-18T21:03:06.042 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:06.056 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-18T21:03:06.137 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-18T21:03:06.343 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-sklearn. 2024-04-18T21:03:06.370 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-18T21:03:06.396 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-18T21:03:06.409 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-18T21:03:06.647 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-18T21:03:06.906 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-18T21:03:07.033 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-18T21:03:07.095 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-volume. 2024-04-18T21:03:07.122 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:03:07.126 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-18T21:03:07.153 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:03:07.161 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-volume (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:07.278 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:07.317 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-18T21:03:07.347 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-18T21:03:07.363 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-18T21:03:07.405 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-18T21:03:07.443 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-18T21:03:07.484 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-18T21:03:07.500 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:03:07.542 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libcephfs-dev (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:07.728 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-18T21:03:07.828 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-18T21:03:07.856 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-18T21:03:07.886 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-18T21:03:07.926 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-joblib. 2024-04-18T21:03:07.953 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-18T21:03:07.992 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-18T21:03:08.029 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-18T21:03:08.225 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-18T21:03:08.252 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-04-18T21:03:08.257 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-cachetools. 2024-04-18T21:03:08.284 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-04-18T21:03:08.288 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-18T21:03:08.291 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-18T21:03:08.323 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-18T21:03:08.329 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-18T21:03:08.354 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-18T21:03:08.387 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-18T21:03:08.414 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-18T21:03:08.540 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-18T21:03:08.601 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-18T21:03:08.629 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-18T21:03:08.629 INFO:teuthology.orchestra.run.smithi187.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-18T21:03:08.662 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package nvme-cli. 2024-04-18T21:03:08.665 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-sklearn. 2024-04-18T21:03:08.667 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-18T21:03:08.689 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-18T21:03:08.692 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-18T21:03:08.728 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-18T21:03:08.740 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-18T21:03:08.859 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-18T21:03:08.985 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-18T21:03:08.996 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-18T21:03:09.023 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-18T21:03:09.062 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-18T21:03:09.142 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package pkg-config. 2024-04-18T21:03:09.170 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-18T21:03:09.208 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-18T21:03:09.369 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-18T21:03:09.374 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-rsa. 2024-04-18T21:03:09.401 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-04-18T21:03:09.440 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-18T21:03:09.453 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-18T21:03:09.465 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-18T21:03:09.480 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-18T21:03:09.493 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:03:09.520 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-18T21:03:09.626 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:09.654 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-18T21:03:09.752 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-google-auth. 2024-04-18T21:03:09.779 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-04-18T21:03:09.780 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-18T21:03:09.819 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-18T21:03:09.956 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-18T21:03:09.983 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-18T21:03:10.023 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-18T21:03:10.031 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T21:03:10.122 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-18T21:03:10.149 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-18T21:03:10.157 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-18T21:03:10.188 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-18T21:03:10.301 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pastescript. 2024-04-18T21:03:10.328 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-04-18T21:03:10.367 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-18T21:03:10.466 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-websocket. 2024-04-18T21:03:10.482 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-04-18T21:03:10.491 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-18T21:03:10.516 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-18T21:03:10.589 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-cachetools. 2024-04-18T21:03:10.603 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-04-18T21:03:10.637 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-18T21:03:10.654 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pluggy. 2024-04-18T21:03:10.670 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-18T21:03:10.712 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-18T21:03:10.784 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-18T21:03:10.803 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-18T21:03:10.830 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-18T21:03:10.869 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-18T21:03:10.941 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-18T21:03:10.967 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-18T21:03:11.015 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-18T21:03:11.024 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-psutil. 2024-04-18T21:03:11.051 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-18T21:03:11.052 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-18T21:03:11.091 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-18T21:03:11.178 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-18T21:03:11.344 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-18T21:03:11.371 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-18T21:03:11.410 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-18T21:03:11.427 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-py. 2024-04-18T21:03:11.454 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-18T21:03:11.455 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-04-18T21:03:11.493 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-18T21:03:11.499 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-18T21:03:11.515 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:03:11.558 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:11.722 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-rsa. 2024-04-18T21:03:11.722 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-18T21:03:11.749 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-04-18T21:03:11.788 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-18T21:03:11.805 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pygments. 2024-04-18T21:03:11.832 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-18T21:03:11.871 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-18T21:03:11.911 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-18T21:03:11.938 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-18T21:03:11.977 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-18T21:03:12.075 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-18T21:03:12.092 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-google-auth. 2024-04-18T21:03:12.108 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-04-18T21:03:12.142 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-18T21:03:12.314 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-18T21:03:12.341 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-18T21:03:12.343 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-18T21:03:12.371 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-18T21:03:12.380 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-18T21:03:12.409 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-18T21:03:12.412 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-18T21:03:12.440 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-18T21:03:12.460 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-18T21:03:12.470 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-18T21:03:12.591 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package jq. 2024-04-18T21:03:12.607 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-18T21:03:12.641 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-18T21:03:12.729 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-toml. 2024-04-18T21:03:12.745 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-18T21:03:12.756 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-04-18T21:03:12.781 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-websocket. 2024-04-18T21:03:12.795 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-18T21:03:12.809 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-04-18T21:03:12.847 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-18T21:03:12.877 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package socat. 2024-04-18T21:03:12.893 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-18T21:03:12.935 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-18T21:03:13.073 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pytest. 2024-04-18T21:03:13.081 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-18T21:03:13.101 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-18T21:03:13.139 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-18T21:03:13.176 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-18T21:03:13.204 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-18T21:03:13.206 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up librados2 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:13.242 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-18T21:03:13.246 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package xmlstarlet. 2024-04-18T21:03:13.262 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-18T21:03:13.305 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-18T21:03:13.324 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:13.425 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-18T21:03:13.485 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-simplejson. 2024-04-18T21:03:13.513 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-18T21:03:13.551 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-18T21:03:13.642 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-test. 2024-04-18T21:03:13.658 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../097-ceph-test_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:03:13.700 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-test (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:13.761 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libcephfs2 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:13.821 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-18T21:03:13.849 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-18T21:03:13.881 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-18T21:03:13.887 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-18T21:03:13.887 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libradosstriper1 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:13.897 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:03:13.940 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:14.013 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-18T21:03:14.226 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-18T21:03:14.254 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-18T21:03:14.292 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-18T21:03:14.298 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up librbd1 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:14.424 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mgr-modules-core (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:14.533 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-fuse (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:14.595 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-18T21:03:14.623 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-18T21:03:14.662 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-18T21:03:14.684 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package radosgw. 2024-04-18T21:03:14.711 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../116-radosgw_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:03:14.732 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-18T21:03:14.732 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-18T21:03:14.750 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking radosgw (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:14.923 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package jq. 2024-04-18T21:03:14.939 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-18T21:03:14.981 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-18T21:03:15.243 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libcephfs-dev (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:15.259 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package socat. 2024-04-18T21:03:15.286 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-18T21:03:15.325 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-18T21:03:15.378 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-rados (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:15.537 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up librgw2 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:15.552 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package rbd-fuse. 2024-04-18T21:03:15.568 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:03:15.602 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking rbd-fuse (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:15.629 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package xmlstarlet. 2024-04-18T21:03:15.656 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-18T21:03:15.672 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-18T21:03:15.695 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-18T21:03:15.899 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-18T21:03:15.988 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-volume. 2024-04-18T21:03:16.016 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:03:16.055 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-volume (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:16.058 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-test. 2024-04-18T21:03:16.086 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../097-ceph-test_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:03:16.124 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-test (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:16.158 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-18T21:03:16.259 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-18T21:03:16.509 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-18T21:03:16.617 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-18T21:03:16.632 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:03:16.675 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libcephfs-dev (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:16.857 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-18T21:03:16.976 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-rbd (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:16.979 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-18T21:03:16.995 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-18T21:03:17.029 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-18T21:03:17.102 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up rbd-fuse (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:17.228 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-rgw (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:17.269 INFO:teuthology.orchestra.run.smithi078.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-18T21:03:17.309 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-18T21:03:17.325 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-04-18T21:03:17.336 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up cephadm (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:17.354 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-cephfs (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:17.358 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-18T21:03:17.480 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-common (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:17.738 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package nvme-cli. 2024-04-18T21:03:17.765 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-18T21:03:17.804 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-18T21:03:17.852 INFO:teuthology.orchestra.run.smithi078.stdout:Adding system user cephadm....done 2024-04-18T21:03:18.001 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-18T21:03:18.023 INFO:teuthology.orchestra.run.smithi187.stdout:Adding group ceph....done 2024-04-18T21:03:18.234 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package pkg-config. 2024-04-18T21:03:18.262 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-18T21:03:18.294 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-18T21:03:18.300 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-18T21:03:18.412 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-volume. 2024-04-18T21:03:18.416 INFO:teuthology.orchestra.run.smithi187.stdout:Adding system user ceph....done 2024-04-18T21:03:18.440 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-3141-g5be49cd9-1jammy_all.deb ... 2024-04-18T21:03:18.478 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-volume (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:18.545 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-18T21:03:18.553 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-18T21:03:18.561 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-18T21:03:18.585 INFO:teuthology.orchestra.run.smithi187.stdout:Setting system user ceph properties....done 2024-04-18T21:03:18.595 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-18T21:03:18.601 INFO:teuthology.orchestra.run.smithi187.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-18T21:03:18.679 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-18T21:03:18.739 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-18T21:03:18.766 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-18T21:03:18.782 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:03:18.832 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libcephfs-dev (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:18.931 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-18T21:03:19.024 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-18T21:03:19.051 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-18T21:03:19.089 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-18T21:03:19.105 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-18T21:03:19.160 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-18T21:03:19.188 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-18T21:03:19.190 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-18T21:03:19.227 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-18T21:03:19.325 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-18T21:03:19.359 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pastescript. 2024-04-18T21:03:19.387 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-04-18T21:03:19.417 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-18T21:03:19.556 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-18T21:03:19.581 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-test (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:19.583 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-04-18T21:03:19.622 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-18T21:03:19.627 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-18T21:03:19.679 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pluggy. 2024-04-18T21:03:19.695 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-18T21:03:19.707 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up radosgw (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:19.737 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-18T21:03:19.944 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package nvme-cli. 2024-04-18T21:03:19.971 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-18T21:03:19.989 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-18T21:03:20.010 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-18T21:03:20.082 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-psutil. 2024-04-18T21:03:20.110 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-18T21:03:20.148 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-18T21:03:20.172 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-18T21:03:20.172 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-18T21:03:20.246 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-18T21:03:20.407 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package pkg-config. 2024-04-18T21:03:20.434 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-18T21:03:20.473 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-18T21:03:20.476 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-py. 2024-04-18T21:03:20.504 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-04-18T21:03:20.539 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-18T21:03:20.542 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-18T21:03:20.642 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-base (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:20.735 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-18T21:03:20.762 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-18T21:03:20.834 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-18T21:03:20.863 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pygments. 2024-04-18T21:03:20.891 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-18T21:03:20.929 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-18T21:03:20.992 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-18T21:03:21.166 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-18T21:03:21.254 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-18T21:03:21.282 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-18T21:03:21.321 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-18T21:03:21.392 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-18T21:03:21.400 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-18T21:03:21.428 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-18T21:03:21.444 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mds (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:21.466 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-18T21:03:21.607 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-pastescript. 2024-04-18T21:03:21.627 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-18T21:03:21.634 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-04-18T21:03:21.670 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-18T21:03:21.670 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-18T21:03:21.673 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-18T21:03:21.752 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-toml. 2024-04-18T21:03:21.768 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-04-18T21:03:21.802 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-18T21:03:21.878 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-ceph-argparse (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:22.002 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-pluggy. 2024-04-18T21:03:22.029 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-18T21:03:22.068 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-18T21:03:22.088 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pytest. 2024-04-18T21:03:22.096 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mgr (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:22.116 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-18T21:03:22.146 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-18T21:03:22.155 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-18T21:03:22.272 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-18T21:03:22.309 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-18T21:03:22.309 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-18T21:03:22.321 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-psutil. 2024-04-18T21:03:22.337 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-18T21:03:22.371 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-18T21:03:22.398 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-18T21:03:22.467 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-simplejson. 2024-04-18T21:03:22.495 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-18T21:03:22.523 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-18T21:03:22.533 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-18T21:03:22.682 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-py. 2024-04-18T21:03:22.710 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-04-18T21:03:22.748 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-18T21:03:22.783 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-18T21:03:22.785 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-18T21:03:22.813 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-18T21:03:22.843 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-18T21:03:23.010 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-osd (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:23.077 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-pygments. 2024-04-18T21:03:23.105 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-18T21:03:23.144 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-18T21:03:23.146 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-18T21:03:23.173 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-18T21:03:23.237 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-18T21:03:23.281 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-18T21:03:23.281 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-18T21:03:23.363 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-18T21:03:23.573 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package radosgw. 2024-04-18T21:03:23.598 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-18T21:03:23.601 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../116-radosgw_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:03:23.626 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-18T21:03:23.639 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking radosgw (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:23.664 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-18T21:03:23.739 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-18T21:03:23.795 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:23.865 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-18T21:03:23.921 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:24.001 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-toml. 2024-04-18T21:03:24.028 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-04-18T21:03:24.067 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-18T21:03:24.072 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mon (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:24.150 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-18T21:03:24.274 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-18T21:03:24.274 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-18T21:03:24.320 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-pytest. 2024-04-18T21:03:24.336 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-18T21:03:24.392 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-18T21:03:24.417 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-18T21:03:24.467 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package rbd-fuse. 2024-04-18T21:03:24.483 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:03:24.525 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking rbd-fuse (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:24.702 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up zip (3.0-12build2) ... 2024-04-18T21:03:24.740 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-simplejson. 2024-04-18T21:03:24.768 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-18T21:03:24.799 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mgr-cephadm (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:24.806 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-18T21:03:24.811 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-18T21:03:24.830 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-18T21:03:25.016 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:25.080 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-18T21:03:25.093 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-18T21:03:25.120 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-18T21:03:25.159 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-18T21:03:25.206 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-18T21:03:25.208 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mgr-dashboard (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:25.455 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-18T21:03:25.460 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-18T21:03:25.466 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-volume (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:25.706 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-18T21:03:25.797 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-18T21:03:25.832 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-18T21:03:25.838 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package radosgw. 2024-04-18T21:03:25.866 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../116-radosgw_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:03:25.882 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-18T21:03:25.896 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking radosgw (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:25.983 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-18T21:03:25.991 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-18T21:03:26.135 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-18T21:03:26.213 INFO:teuthology.orchestra.run.smithi150.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-18T21:03:26.267 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-18T21:03:26.275 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up cephadm (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:26.636 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-18T21:03:26.715 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package rbd-fuse. 2024-04-18T21:03:26.732 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-3141-g5be49cd9-1jammy_amd64.deb ... 2024-04-18T21:03:26.774 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking rbd-fuse (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:26.792 INFO:teuthology.orchestra.run.smithi150.stdout:Adding system user cephadm....done 2024-04-18T21:03:26.878 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-18T21:03:26.926 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-18T21:03:26.948 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-18T21:03:27.095 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-18T21:03:27.232 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-18T21:03:27.238 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-18T21:03:27.337 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-18T21:03:27.447 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-18T21:03:27.492 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-18T21:03:27.523 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-18T21:03:27.593 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-18T21:03:27.623 INFO:teuthology.orchestra.run.smithi187.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-18T21:03:27.626 DEBUG:teuthology.orchestra.run.smithi187:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-04-18T21:03:27.701 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-18T21:03:27.721 INFO:teuthology.orchestra.run.smithi187.stdout:Reading package lists... 2024-04-18T21:03:27.827 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-18T21:03:27.866 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-18T21:03:27.922 INFO:teuthology.orchestra.run.smithi187.stdout:Building dependency tree... 2024-04-18T21:03:27.924 INFO:teuthology.orchestra.run.smithi187.stdout:Reading state information... 2024-04-18T21:03:28.035 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-18T21:03:28.079 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-18T21:03:28.109 INFO:teuthology.orchestra.run.smithi187.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-18T21:03:28.109 INFO:teuthology.orchestra.run.smithi187.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-18T21:03:28.109 INFO:teuthology.orchestra.run.smithi187.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T21:03:28.109 INFO:teuthology.orchestra.run.smithi187.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T21:03:28.109 INFO:teuthology.orchestra.run.smithi187.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T21:03:28.109 INFO:teuthology.orchestra.run.smithi187.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T21:03:28.110 INFO:teuthology.orchestra.run.smithi187.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-18T21:03:28.110 INFO:teuthology.orchestra.run.smithi187.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-18T21:03:28.110 INFO:teuthology.orchestra.run.smithi187.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T21:03:28.110 INFO:teuthology.orchestra.run.smithi187.stdout:The following additional packages will be installed: 2024-04-18T21:03:28.111 INFO:teuthology.orchestra.run.smithi187.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-04-18T21:03:28.112 INFO:teuthology.orchestra.run.smithi187.stdout:Suggested packages: 2024-04-18T21:03:28.112 INFO:teuthology.orchestra.run.smithi187.stdout: bison-doc flex-doc libssl-doc 2024-04-18T21:03:28.117 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-18T21:03:28.140 INFO:teuthology.orchestra.run.smithi187.stdout:The following NEW packages will be installed: 2024-04-18T21:03:28.142 INFO:teuthology.orchestra.run.smithi187.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-04-18T21:03:28.143 INFO:teuthology.orchestra.run.smithi187.stdout:The following packages will be upgraded: 2024-04-18T21:03:28.143 INFO:teuthology.orchestra.run.smithi187.stdout: libssl3 libuuid1 uuid-dev 2024-04-18T21:03:28.214 INFO:teuthology.orchestra.run.smithi187.stdout:3 upgraded, 7 newly installed, 0 to remove and 299 not upgraded. 2024-04-18T21:03:28.214 INFO:teuthology.orchestra.run.smithi187.stdout:Need to get 5,495 kB of archives. 2024-04-18T21:03:28.214 INFO:teuthology.orchestra.run.smithi187.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-04-18T21:03:28.214 INFO:teuthology.orchestra.run.smithi187.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-18T21:03:28.230 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-18T21:03:28.243 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-ceph-common (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:28.380 INFO:teuthology.orchestra.run.smithi187.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-18T21:03:28.486 INFO:teuthology.orchestra.run.smithi187.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-18T21:03:28.487 INFO:teuthology.orchestra.run.smithi187.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-18T21:03:28.488 INFO:teuthology.orchestra.run.smithi187.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-18T21:03:28.490 INFO:teuthology.orchestra.run.smithi132.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-18T21:03:28.505 INFO:teuthology.orchestra.run.smithi187.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-18T21:03:28.506 INFO:teuthology.orchestra.run.smithi187.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-18T21:03:28.508 INFO:teuthology.orchestra.run.smithi187.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-18T21:03:28.508 INFO:teuthology.orchestra.run.smithi187.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-18T21:03:28.508 INFO:teuthology.orchestra.run.smithi187.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-18T21:03:28.540 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-18T21:03:28.545 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-idna (3.3-1) ... 2024-04-18T21:03:28.557 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up cephadm (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:28.862 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-18T21:03:28.875 INFO:teuthology.orchestra.run.smithi187.stdout:Preconfiguring packages ... 2024-04-18T21:03:28.892 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-18T21:03:28.971 INFO:teuthology.orchestra.run.smithi187.stdout:Fetched 5,495 kB in 0s (13.7 MB/s) 2024-04-18T21:03:29.032 INFO:teuthology.orchestra.run.smithi132.stdout:Adding system user cephadm....done 2024-04-18T21:03:29.115 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package flex. 2024-04-18T21:03:29.126 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-18T21:03:29.188 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-18T21:03:29.209 INFO:teuthology.orchestra.run.smithi187.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173902 files and directories currently installed.) 2024-04-18T21:03:29.214 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-18T21:03:29.255 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-18T21:03:29.378 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-18T21:03:29.473 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-18T21:03:29.646 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-18T21:03:29.724 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-18T21:03:29.806 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-18T21:03:29.867 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-18T21:03:29.897 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-18T21:03:29.978 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-18T21:03:30.036 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-18T21:03:30.135 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-18T21:03:30.164 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-18T21:03:30.287 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T21:03:30.355 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-18T21:03:30.394 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-18T21:03:30.421 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-18T21:03:30.424 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-ceph-argparse (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:30.504 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-18T21:03:30.672 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-18T21:03:30.683 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-18T21:03:30.784 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-18T21:03:30.790 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-18T21:03:30.825 INFO:teuthology.orchestra.run.smithi187.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173975 files and directories currently installed.) 2024-04-18T21:03:30.830 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-18T21:03:30.839 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-18T21:03:30.902 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-18T21:03:30.916 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-18T21:03:30.985 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-18T21:03:31.028 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-18T21:03:31.199 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-18T21:03:31.209 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-18T21:03:31.287 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-18T21:03:31.393 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-18T21:03:31.467 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-18T21:03:31.469 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-18T21:03:31.525 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-18T21:03:31.655 INFO:teuthology.orchestra.run.smithi150.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-18T21:03:31.685 INFO:teuthology.orchestra.run.smithi150.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-18T21:03:31.720 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T21:03:31.748 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-18T21:03:31.776 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-18T21:03:31.838 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-18T21:03:31.852 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-18T21:03:32.037 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-18T21:03:32.114 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-18T21:03:32.200 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package bison. 2024-04-18T21:03:32.208 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-18T21:03:32.271 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-18T21:03:32.300 INFO:teuthology.orchestra.run.smithi187.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173975 files and directories currently installed.) 2024-04-18T21:03:32.306 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-18T21:03:32.348 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-18T21:03:32.353 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-18T21:03:32.576 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-18T21:03:32.591 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-18T21:03:32.686 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-18T21:03:32.702 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-18T21:03:32.714 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-18T21:03:32.753 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-18T21:03:32.788 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-18T21:03:32.834 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-18T21:03:32.978 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-18T21:03:33.006 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-18T21:03:33.022 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-18T21:03:33.065 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-18T21:03:33.085 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-18T21:03:33.164 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-ceph-argparse (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:33.254 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-18T21:03:33.353 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-18T21:03:33.368 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-18T21:03:33.396 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-18T21:03:33.424 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-18T21:03:33.426 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-18T21:03:33.471 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-18T21:03:33.558 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-18T21:03:33.572 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up zip (3.0-12build2) ... 2024-04-18T21:03:33.679 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-18T21:03:33.684 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-18T21:03:33.698 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-18T21:03:33.706 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-18T21:03:33.739 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-18T21:03:33.745 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-18T21:03:33.810 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-18T21:03:33.840 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-18T21:03:33.998 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-18T21:03:34.014 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-18T21:03:34.056 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-18T21:03:34.069 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-18T21:03:34.149 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-18T21:03:34.400 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-18T21:03:34.432 INFO:teuthology.orchestra.run.smithi132.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-18T21:03:34.459 INFO:teuthology.orchestra.run.smithi132.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-18T21:03:34.459 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-18T21:03:34.523 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-18T21:03:34.600 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-18T21:03:34.634 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-18T21:03:34.649 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-18T21:03:34.702 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-18T21:03:34.718 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-18T21:03:34.760 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-18T21:03:34.828 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-18T21:03:34.844 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-18T21:03:34.886 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-18T21:03:34.954 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-18T21:03:34.987 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-18T21:03:35.017 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-18T21:03:35.077 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-18T21:03:35.080 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-18T21:03:35.159 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-18T21:03:35.196 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-18T21:03:35.206 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-18T21:03:35.332 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-18T21:03:35.339 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-18T21:03:35.421 INFO:teuthology.orchestra.run.smithi187.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-18T21:03:35.427 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-18T21:03:35.440 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-18T21:03:35.484 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-18T21:03:35.580 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-18T21:03:35.678 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-18T21:03:35.769 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-18T21:03:35.817 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-18T21:03:35.831 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-18T21:03:35.912 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-18T21:03:35.979 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up zip (3.0-12build2) ... 2024-04-18T21:03:36.068 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-18T21:03:36.122 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-18T21:03:36.194 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-18T21:03:36.199 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-18T21:03:36.454 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T21:03:36.476 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-18T21:03:36.579 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-18T21:03:36.802 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-18T21:03:36.816 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-18T21:03:36.880 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-18T21:03:37.053 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-18T21:03:37.075 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-18T21:03:37.129 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-18T21:03:37.179 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-ceph-common (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:37.198 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-18T21:03:37.201 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-18T21:03:37.328 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-18T21:03:37.489 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-idna (3.3-1) ... 2024-04-18T21:03:37.492 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-18T21:03:37.612 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-18T21:03:37.617 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-18T21:03:37.631 INFO:teuthology.orchestra.run.smithi187.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-18T21:03:37.636 DEBUG:teuthology.parallel:result is None 2024-04-18T21:03:37.815 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-18T21:03:37.885 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-18T21:03:38.030 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-18T21:03:38.153 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-18T21:03:38.281 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-18T21:03:38.498 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-18T21:03:38.641 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-18T21:03:38.867 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-18T21:03:38.921 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-18T21:03:38.959 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-18T21:03:39.143 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-18T21:03:39.172 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T21:03:39.306 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-18T21:03:39.310 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-18T21:03:39.496 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-18T21:03:39.561 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-18T21:03:39.566 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-18T21:03:39.597 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up librados2 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:39.662 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-ceph-common (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:39.675 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-18T21:03:39.706 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:39.776 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-18T21:03:39.824 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-18T21:03:39.955 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-idna (3.3-1) ... 2024-04-18T21:03:40.061 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-18T21:03:40.169 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libcephfs2 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:40.273 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-18T21:03:40.295 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libradosstriper1 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:40.312 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-18T21:03:40.421 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-18T21:03:40.563 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T21:03:40.681 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up librbd1 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:40.689 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-18T21:03:40.782 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-modules-core (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:40.909 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-fuse (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:40.982 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-18T21:03:41.128 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-18T21:03:41.129 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-18T21:03:41.242 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-18T21:03:41.396 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-18T21:03:41.467 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-18T21:03:41.585 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libcephfs-dev (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:41.622 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T21:03:41.702 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-18T21:03:41.737 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-rados (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:41.756 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-18T21:03:41.871 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up librgw2 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:41.953 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-18T21:03:41.997 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-18T21:03:42.016 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-18T21:03:42.142 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-18T21:03:42.229 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-18T21:03:42.268 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-18T21:03:42.355 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-18T21:03:42.578 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-18T21:03:42.631 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-18T21:03:42.749 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-18T21:03:42.812 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-18T21:03:43.017 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-18T21:03:43.046 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T21:03:43.173 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-18T21:03:43.230 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-rbd (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:43.301 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-18T21:03:43.331 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up rbd-fuse (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:43.432 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-rgw (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:43.474 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-18T21:03:43.535 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-18T21:03:43.550 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-cephfs (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:43.645 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-18T21:03:43.684 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-common (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:43.727 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-18T21:03:43.771 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-18T21:03:43.861 INFO:teuthology.orchestra.run.smithi150.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-18T21:03:43.970 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-18T21:03:44.097 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-18T21:03:44.204 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-18T21:03:44.210 INFO:teuthology.orchestra.run.smithi078.stdout:Adding group ceph....done 2024-04-18T21:03:44.223 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-18T21:03:44.455 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-18T21:03:44.570 INFO:teuthology.orchestra.run.smithi078.stdout:Adding system user ceph....done 2024-04-18T21:03:44.625 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-18T21:03:44.723 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-18T21:03:44.748 INFO:teuthology.orchestra.run.smithi078.stdout:Setting system user ceph properties....done 2024-04-18T21:03:44.767 INFO:teuthology.orchestra.run.smithi078.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-18T21:03:44.849 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-18T21:03:44.868 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-18T21:03:44.903 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-18T21:03:44.994 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-18T21:03:45.142 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-18T21:03:45.253 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T21:03:45.268 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-18T21:03:45.272 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-18T21:03:45.388 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-18T21:03:45.553 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-18T21:03:45.705 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-18T21:03:45.719 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-test (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:45.828 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-18T21:03:45.845 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up radosgw (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:45.998 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-18T21:03:46.105 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-18T21:03:46.231 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-18T21:03:46.283 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-18T21:03:46.299 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-18T21:03:46.300 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-18T21:03:46.357 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-18T21:03:46.409 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-18T21:03:46.446 INFO:teuthology.orchestra.run.smithi132.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-18T21:03:46.676 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-18T21:03:46.683 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-18T21:03:46.747 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-base (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:46.809 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-18T21:03:46.944 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-18T21:03:47.074 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-18T21:03:47.186 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-18T21:03:47.289 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-18T21:03:47.429 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-18T21:03:47.524 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mds (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:47.530 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-18T21:03:47.666 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-18T21:03:47.755 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-18T21:03:47.755 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-18T21:03:47.789 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T21:03:47.915 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-18T21:03:47.934 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-18T21:03:48.225 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-18T21:03:48.251 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:48.261 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-18T21:03:48.396 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up librados2 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:48.471 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-18T21:03:48.471 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-18T21:03:48.522 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:48.525 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-18T21:03:48.648 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-18T21:03:48.810 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-18T21:03:48.920 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-18T21:03:48.944 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-osd (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:48.959 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libcephfs2 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:49.068 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libradosstriper1 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:49.162 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-18T21:03:49.186 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-18T21:03:49.245 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-18T21:03:49.245 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-18T21:03:49.430 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-18T21:03:49.446 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up librbd1 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:49.572 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mgr-modules-core (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:49.679 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:49.698 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-fuse (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:49.800 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-18T21:03:49.805 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:49.908 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-18T21:03:49.908 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-18T21:03:49.939 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mon (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:50.135 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-18T21:03:50.135 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-18T21:03:50.202 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-18T21:03:50.391 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libcephfs-dev (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:50.495 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-18T21:03:50.517 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-rados (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:50.607 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-cephadm (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:50.643 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up librgw2 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:50.759 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:50.769 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-18T21:03:50.831 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-18T21:03:50.885 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-dashboard (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:50.957 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up librados2 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:51.028 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-volume (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:51.083 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:51.209 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-18T21:03:51.364 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-18T21:03:51.465 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-18T21:03:51.520 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libcephfs2 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:51.638 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libradosstriper1 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:51.764 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-18T21:03:51.940 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-18T21:03:51.989 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-rbd (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:52.041 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up librbd1 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:52.115 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up rbd-fuse (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:52.167 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-mgr-modules-core (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:52.241 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-rgw (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:52.293 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-fuse (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:52.367 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-cephfs (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:52.507 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-common (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:52.514 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-18T21:03:52.514 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-18T21:03:52.685 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-18T21:03:53.011 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libcephfs-dev (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:53.036 INFO:teuthology.orchestra.run.smithi150.stdout:Adding group ceph....done 2024-04-18T21:03:53.145 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-rados (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:53.246 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up librgw2 (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:53.371 INFO:teuthology.orchestra.run.smithi078.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-18T21:03:53.372 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-18T21:03:53.374 DEBUG:teuthology.orchestra.run.smithi078:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-04-18T21:03:53.413 INFO:teuthology.orchestra.run.smithi150.stdout:Adding system user ceph....done 2024-04-18T21:03:53.427 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2024-04-18T21:03:53.532 INFO:teuthology.orchestra.run.smithi150.stdout:Setting system user ceph properties....done 2024-04-18T21:03:53.550 INFO:teuthology.orchestra.run.smithi150.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-18T21:03:53.628 INFO:teuthology.orchestra.run.smithi078.stdout:Building dependency tree... 2024-04-18T21:03:53.629 INFO:teuthology.orchestra.run.smithi078.stdout:Reading state information... 2024-04-18T21:03:53.690 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-18T21:03:53.811 INFO:teuthology.orchestra.run.smithi078.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-18T21:03:53.811 INFO:teuthology.orchestra.run.smithi078.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-18T21:03:53.811 INFO:teuthology.orchestra.run.smithi078.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T21:03:53.811 INFO:teuthology.orchestra.run.smithi078.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T21:03:53.811 INFO:teuthology.orchestra.run.smithi078.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T21:03:53.811 INFO:teuthology.orchestra.run.smithi078.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T21:03:53.811 INFO:teuthology.orchestra.run.smithi078.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-18T21:03:53.812 INFO:teuthology.orchestra.run.smithi078.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-18T21:03:53.812 INFO:teuthology.orchestra.run.smithi078.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T21:03:53.812 INFO:teuthology.orchestra.run.smithi078.stdout:The following additional packages will be installed: 2024-04-18T21:03:53.813 INFO:teuthology.orchestra.run.smithi078.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-04-18T21:03:53.814 INFO:teuthology.orchestra.run.smithi078.stdout:Suggested packages: 2024-04-18T21:03:53.814 INFO:teuthology.orchestra.run.smithi078.stdout: bison-doc flex-doc libssl-doc 2024-04-18T21:03:53.842 INFO:teuthology.orchestra.run.smithi078.stdout:The following NEW packages will be installed: 2024-04-18T21:03:53.844 INFO:teuthology.orchestra.run.smithi078.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-04-18T21:03:53.845 INFO:teuthology.orchestra.run.smithi078.stdout:The following packages will be upgraded: 2024-04-18T21:03:53.845 INFO:teuthology.orchestra.run.smithi078.stdout: libssl3 libuuid1 uuid-dev 2024-04-18T21:03:54.022 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-18T21:03:54.025 INFO:teuthology.orchestra.run.smithi078.stdout:3 upgraded, 7 newly installed, 0 to remove and 299 not upgraded. 2024-04-18T21:03:54.025 INFO:teuthology.orchestra.run.smithi078.stdout:Need to get 5,495 kB of archives. 2024-04-18T21:03:54.025 INFO:teuthology.orchestra.run.smithi078.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-04-18T21:03:54.025 INFO:teuthology.orchestra.run.smithi078.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-18T21:03:54.503 INFO:teuthology.orchestra.run.smithi078.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-18T21:03:54.528 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-test (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:54.559 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-rbd (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:54.654 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up radosgw (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:54.685 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up rbd-fuse (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:54.760 INFO:teuthology.orchestra.run.smithi078.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-18T21:03:54.762 INFO:teuthology.orchestra.run.smithi078.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-18T21:03:54.762 INFO:teuthology.orchestra.run.smithi078.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-18T21:03:54.794 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-rgw (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:54.797 INFO:teuthology.orchestra.run.smithi078.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-18T21:03:54.798 INFO:teuthology.orchestra.run.smithi078.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-18T21:03:54.800 INFO:teuthology.orchestra.run.smithi078.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-18T21:03:54.801 INFO:teuthology.orchestra.run.smithi078.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-18T21:03:54.801 INFO:teuthology.orchestra.run.smithi078.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-18T21:03:54.904 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-cephfs (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:55.013 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-common (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:55.117 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-18T21:03:55.117 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-18T21:03:55.202 INFO:teuthology.orchestra.run.smithi078.stdout:Preconfiguring packages ... 2024-04-18T21:03:55.297 INFO:teuthology.orchestra.run.smithi078.stdout:Fetched 5,495 kB in 1s (5,388 kB/s) 2024-04-18T21:03:55.435 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package flex. 2024-04-18T21:03:55.537 INFO:teuthology.orchestra.run.smithi078.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173902 files and directories currently installed.) 2024-04-18T21:03:55.542 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-18T21:03:55.548 INFO:teuthology.orchestra.run.smithi132.stdout:Adding group ceph....done 2024-04-18T21:03:55.564 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-base (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:55.591 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-18T21:03:55.904 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-18T21:03:55.949 INFO:teuthology.orchestra.run.smithi132.stdout:Adding system user ceph....done 2024-04-18T21:03:56.125 INFO:teuthology.orchestra.run.smithi132.stdout:Setting system user ceph properties....done 2024-04-18T21:03:56.139 INFO:teuthology.orchestra.run.smithi132.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-18T21:03:56.157 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-18T21:03:56.280 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-18T21:03:56.313 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-18T21:03:56.358 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mds (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:56.571 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-18T21:03:56.571 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-18T21:03:56.631 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-18T21:03:56.724 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-18T21:03:57.018 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mgr (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:57.181 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-test (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:57.218 INFO:teuthology.orchestra.run.smithi078.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173975 files and directories currently installed.) 2024-04-18T21:03:57.223 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-18T21:03:57.233 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-18T21:03:57.234 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-18T21:03:57.307 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up radosgw (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:57.363 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-18T21:03:57.686 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-osd (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:57.755 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-18T21:03:57.793 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-18T21:03:57.793 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-18T21:03:57.869 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-18T21:03:57.966 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-18T21:03:57.966 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-18T21:03:58.205 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-18T21:03:58.275 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-base (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:58.413 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:58.530 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:58.586 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package bison. 2024-04-18T21:03:58.671 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-18T21:03:58.681 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mon (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:58.689 INFO:teuthology.orchestra.run.smithi078.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173975 files and directories currently installed.) 2024-04-18T21:03:58.695 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-18T21:03:58.738 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-18T21:03:58.890 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-18T21:03:58.891 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-18T21:03:59.080 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-18T21:03:59.108 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-18T21:03:59.147 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-18T21:03:59.195 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-mds (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:59.333 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mgr-cephadm (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:59.400 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-18T21:03:59.416 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-18T21:03:59.421 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-18T21:03:59.421 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-18T21:03:59.450 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-18T21:03:59.475 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:59.593 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mgr-dashboard (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:59.737 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-18T21:03:59.744 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-volume (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:03:59.765 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-18T21:03:59.804 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-18T21:04:00.056 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-18T21:04:00.068 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-mgr (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:04:00.084 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-18T21:04:00.105 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-18T21:04:00.122 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-18T21:04:00.206 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-18T21:04:00.297 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-18T21:04:00.298 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-18T21:04:00.358 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-18T21:04:00.375 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-18T21:04:00.402 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-18T21:04:00.441 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-18T21:04:00.794 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-osd (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:04:00.935 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-18T21:04:01.063 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-18T21:04:01.069 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-18T21:04:01.069 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-18T21:04:01.189 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-18T21:04:01.315 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-18T21:04:01.441 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-18T21:04:01.526 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-18T21:04:01.566 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-18T21:04:01.589 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:04:01.692 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-18T21:04:01.773 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-18T21:04:01.819 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-18T21:04:01.833 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:04:01.920 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-18T21:04:02.072 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-18T21:04:02.094 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-mon (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:04:02.152 INFO:teuthology.orchestra.run.smithi150.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-18T21:04:02.155 DEBUG:teuthology.orchestra.run.smithi150:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-04-18T21:04:02.256 INFO:teuthology.orchestra.run.smithi150.stdout:Reading package lists... 2024-04-18T21:04:02.390 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-18T21:04:02.390 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-18T21:04:02.455 INFO:teuthology.orchestra.run.smithi150.stdout:Building dependency tree... 2024-04-18T21:04:02.456 INFO:teuthology.orchestra.run.smithi150.stdout:Reading state information... 2024-04-18T21:04:02.644 INFO:teuthology.orchestra.run.smithi150.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-18T21:04:02.644 INFO:teuthology.orchestra.run.smithi150.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-18T21:04:02.644 INFO:teuthology.orchestra.run.smithi150.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T21:04:02.644 INFO:teuthology.orchestra.run.smithi150.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T21:04:02.644 INFO:teuthology.orchestra.run.smithi150.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T21:04:02.644 INFO:teuthology.orchestra.run.smithi150.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T21:04:02.644 INFO:teuthology.orchestra.run.smithi150.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-18T21:04:02.645 INFO:teuthology.orchestra.run.smithi150.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-18T21:04:02.645 INFO:teuthology.orchestra.run.smithi150.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T21:04:02.645 INFO:teuthology.orchestra.run.smithi150.stdout:The following additional packages will be installed: 2024-04-18T21:04:02.646 INFO:teuthology.orchestra.run.smithi150.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-04-18T21:04:02.647 INFO:teuthology.orchestra.run.smithi150.stdout:Suggested packages: 2024-04-18T21:04:02.647 INFO:teuthology.orchestra.run.smithi150.stdout: bison-doc flex-doc libssl-doc 2024-04-18T21:04:02.677 INFO:teuthology.orchestra.run.smithi150.stdout:The following NEW packages will be installed: 2024-04-18T21:04:02.678 INFO:teuthology.orchestra.run.smithi150.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-04-18T21:04:02.679 INFO:teuthology.orchestra.run.smithi150.stdout:The following packages will be upgraded: 2024-04-18T21:04:02.680 INFO:teuthology.orchestra.run.smithi150.stdout: libssl3 libuuid1 uuid-dev 2024-04-18T21:04:02.917 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-mgr-cephadm (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:04:03.030 INFO:teuthology.orchestra.run.smithi150.stdout:3 upgraded, 7 newly installed, 0 to remove and 299 not upgraded. 2024-04-18T21:04:03.031 INFO:teuthology.orchestra.run.smithi150.stdout:Need to get 5,495 kB of archives. 2024-04-18T21:04:03.031 INFO:teuthology.orchestra.run.smithi150.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-04-18T21:04:03.031 INFO:teuthology.orchestra.run.smithi150.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-18T21:04:03.060 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:04:03.178 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-mgr-dashboard (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:04:03.257 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-18T21:04:03.509 INFO:teuthology.orchestra.run.smithi150.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-18T21:04:03.581 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-volume (19.0.0-3141-g5be49cd9-1jammy) ... 2024-04-18T21:04:03.749 INFO:teuthology.orchestra.run.smithi078.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-18T21:04:03.754 DEBUG:teuthology.parallel:result is None 2024-04-18T21:04:03.767 INFO:teuthology.orchestra.run.smithi150.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-18T21:04:03.768 INFO:teuthology.orchestra.run.smithi150.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-18T21:04:03.769 INFO:teuthology.orchestra.run.smithi150.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-18T21:04:03.803 INFO:teuthology.orchestra.run.smithi150.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-18T21:04:03.804 INFO:teuthology.orchestra.run.smithi150.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-18T21:04:03.807 INFO:teuthology.orchestra.run.smithi150.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-18T21:04:03.807 INFO:teuthology.orchestra.run.smithi150.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-18T21:04:03.808 INFO:teuthology.orchestra.run.smithi150.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-18T21:04:04.032 INFO:teuthology.orchestra.run.smithi132.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-18T21:04:04.133 INFO:teuthology.orchestra.run.smithi132.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-18T21:04:04.212 INFO:teuthology.orchestra.run.smithi150.stdout:Preconfiguring packages ... 2024-04-18T21:04:04.260 INFO:teuthology.orchestra.run.smithi132.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-18T21:04:04.320 INFO:teuthology.orchestra.run.smithi150.stdout:Fetched 5,495 kB in 1s (4,610 kB/s) 2024-04-18T21:04:04.466 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package flex. 2024-04-18T21:04:04.569 INFO:teuthology.orchestra.run.smithi150.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173902 files and directories currently installed.) 2024-04-18T21:04:04.575 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-18T21:04:04.614 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-18T21:04:05.043 INFO:teuthology.orchestra.run.smithi132.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-18T21:04:05.156 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-18T21:04:05.303 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-18T21:04:05.676 INFO:teuthology.orchestra.run.smithi132.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-18T21:04:05.679 DEBUG:teuthology.orchestra.run.smithi132:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-04-18T21:04:05.723 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-18T21:04:05.734 INFO:teuthology.orchestra.run.smithi132.stdout:Reading package lists... 2024-04-18T21:04:05.934 INFO:teuthology.orchestra.run.smithi132.stdout:Building dependency tree... 2024-04-18T21:04:05.935 INFO:teuthology.orchestra.run.smithi132.stdout:Reading state information... 2024-04-18T21:04:06.122 INFO:teuthology.orchestra.run.smithi132.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-18T21:04:06.123 INFO:teuthology.orchestra.run.smithi132.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-18T21:04:06.123 INFO:teuthology.orchestra.run.smithi132.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T21:04:06.123 INFO:teuthology.orchestra.run.smithi132.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T21:04:06.123 INFO:teuthology.orchestra.run.smithi132.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T21:04:06.123 INFO:teuthology.orchestra.run.smithi132.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T21:04:06.123 INFO:teuthology.orchestra.run.smithi132.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-18T21:04:06.123 INFO:teuthology.orchestra.run.smithi132.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-18T21:04:06.124 INFO:teuthology.orchestra.run.smithi132.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T21:04:06.124 INFO:teuthology.orchestra.run.smithi132.stdout:The following additional packages will be installed: 2024-04-18T21:04:06.125 INFO:teuthology.orchestra.run.smithi132.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-04-18T21:04:06.126 INFO:teuthology.orchestra.run.smithi132.stdout:Suggested packages: 2024-04-18T21:04:06.126 INFO:teuthology.orchestra.run.smithi132.stdout: bison-doc flex-doc libssl-doc 2024-04-18T21:04:06.157 INFO:teuthology.orchestra.run.smithi132.stdout:The following NEW packages will be installed: 2024-04-18T21:04:06.159 INFO:teuthology.orchestra.run.smithi132.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-04-18T21:04:06.160 INFO:teuthology.orchestra.run.smithi132.stdout:The following packages will be upgraded: 2024-04-18T21:04:06.161 INFO:teuthology.orchestra.run.smithi132.stdout: libssl3 libuuid1 uuid-dev 2024-04-18T21:04:06.220 INFO:teuthology.orchestra.run.smithi132.stdout:3 upgraded, 7 newly installed, 0 to remove and 299 not upgraded. 2024-04-18T21:04:06.221 INFO:teuthology.orchestra.run.smithi132.stdout:Need to get 5,495 kB of archives. 2024-04-18T21:04:06.221 INFO:teuthology.orchestra.run.smithi132.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-04-18T21:04:06.221 INFO:teuthology.orchestra.run.smithi132.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-18T21:04:06.233 INFO:teuthology.orchestra.run.smithi150.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173975 files and directories currently installed.) 2024-04-18T21:04:06.238 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-18T21:04:06.339 INFO:teuthology.orchestra.run.smithi132.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-18T21:04:06.369 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-18T21:04:06.406 INFO:teuthology.orchestra.run.smithi132.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-18T21:04:06.407 INFO:teuthology.orchestra.run.smithi132.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-18T21:04:06.408 INFO:teuthology.orchestra.run.smithi132.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-18T21:04:06.423 INFO:teuthology.orchestra.run.smithi132.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-18T21:04:06.424 INFO:teuthology.orchestra.run.smithi132.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-18T21:04:06.425 INFO:teuthology.orchestra.run.smithi132.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-18T21:04:06.426 INFO:teuthology.orchestra.run.smithi132.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-18T21:04:06.426 INFO:teuthology.orchestra.run.smithi132.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-18T21:04:06.786 INFO:teuthology.orchestra.run.smithi132.stdout:Preconfiguring packages ... 2024-04-18T21:04:06.795 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-18T21:04:06.894 INFO:teuthology.orchestra.run.smithi132.stdout:Fetched 5,495 kB in 0s (19.2 MB/s) 2024-04-18T21:04:06.926 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-18T21:04:07.024 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package flex. 2024-04-18T21:04:07.122 INFO:teuthology.orchestra.run.smithi132.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173902 files and directories currently installed.) 2024-04-18T21:04:07.127 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-18T21:04:07.164 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-18T21:04:07.261 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-18T21:04:07.593 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package bison. 2024-04-18T21:04:07.657 INFO:teuthology.orchestra.run.smithi150.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173975 files and directories currently installed.) 2024-04-18T21:04:07.663 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-18T21:04:07.705 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-18T21:04:07.772 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-18T21:04:07.947 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-18T21:04:08.022 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-18T21:04:08.038 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-18T21:04:08.072 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-18T21:04:08.373 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-18T21:04:08.436 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-18T21:04:08.452 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-18T21:04:08.494 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-18T21:04:08.839 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-18T21:04:08.867 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-18T21:04:08.893 INFO:teuthology.orchestra.run.smithi132.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173975 files and directories currently installed.) 2024-04-18T21:04:08.898 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-18T21:04:08.906 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-18T21:04:09.028 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-18T21:04:09.192 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-18T21:04:09.219 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-18T21:04:09.259 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-18T21:04:09.428 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-18T21:04:09.505 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-18T21:04:09.530 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-18T21:04:09.543 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-18T21:04:09.569 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-18T21:04:09.854 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-18T21:04:10.047 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-18T21:04:10.168 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package bison. 2024-04-18T21:04:10.182 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-18T21:04:10.273 INFO:teuthology.orchestra.run.smithi132.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173975 files and directories currently installed.) 2024-04-18T21:04:10.277 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-18T21:04:10.308 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-18T21:04:10.320 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-18T21:04:10.434 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-18T21:04:10.560 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-18T21:04:10.637 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-18T21:04:10.654 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-18T21:04:10.686 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-18T21:04:10.696 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-18T21:04:10.796 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-18T21:04:10.867 INFO:teuthology.orchestra.run.smithi150.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-18T21:04:10.914 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-18T21:04:10.950 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-18T21:04:10.977 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-18T21:04:11.025 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-18T21:04:11.032 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-18T21:04:11.184 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-18T21:04:11.345 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-18T21:04:11.372 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-18T21:04:11.403 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-18T21:04:11.630 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-18T21:04:11.658 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-18T21:04:11.697 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-18T21:04:11.949 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-18T21:04:11.966 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-18T21:04:12.008 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-18T21:04:12.368 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-18T21:04:12.469 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-18T21:04:12.596 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-18T21:04:12.722 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-18T21:04:12.831 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-18T21:04:12.871 INFO:teuthology.orchestra.run.smithi150.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-18T21:04:12.876 DEBUG:teuthology.parallel:result is None 2024-04-18T21:04:12.932 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-18T21:04:13.050 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-18T21:04:13.176 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-18T21:04:13.264 INFO:teuthology.orchestra.run.smithi132.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-18T21:04:13.328 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-18T21:04:13.454 INFO:teuthology.orchestra.run.smithi132.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-18T21:04:13.597 INFO:teuthology.orchestra.run.smithi132.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-18T21:04:14.832 INFO:teuthology.orchestra.run.smithi132.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-18T21:04:15.337 INFO:teuthology.orchestra.run.smithi132.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-18T21:04:15.341 DEBUG:teuthology.parallel:result is None 2024-04-18T21:04:15.342 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=5be49cd9e6fca1ff6a05f2473aa3b399da760600 2024-04-18T21:04:15.580 DEBUG:teuthology.orchestra.run.smithi078:> dpkg-query -W -f '${Version}' ceph 2024-04-18T21:04:15.599 INFO:teuthology.orchestra.run.smithi078.stdout:19.0.0-3141-g5be49cd9-1jammy 2024-04-18T21:04:15.599 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3141-g5be49cd9-1jammy 2024-04-18T21:04:15.599 INFO:teuthology.task.install:The correct ceph version 19.0.0-3141-g5be49cd9-1jammy is installed. 2024-04-18T21:04:15.601 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=5be49cd9e6fca1ff6a05f2473aa3b399da760600 2024-04-18T21:04:15.826 DEBUG:teuthology.orchestra.run.smithi132:> dpkg-query -W -f '${Version}' ceph 2024-04-18T21:04:15.845 INFO:teuthology.orchestra.run.smithi132.stdout:19.0.0-3141-g5be49cd9-1jammy 2024-04-18T21:04:15.845 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3141-g5be49cd9-1jammy 2024-04-18T21:04:15.845 INFO:teuthology.task.install:The correct ceph version 19.0.0-3141-g5be49cd9-1jammy is installed. 2024-04-18T21:04:15.847 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=5be49cd9e6fca1ff6a05f2473aa3b399da760600 2024-04-18T21:04:16.072 DEBUG:teuthology.orchestra.run.smithi150:> dpkg-query -W -f '${Version}' ceph 2024-04-18T21:04:16.091 INFO:teuthology.orchestra.run.smithi150.stdout:19.0.0-3141-g5be49cd9-1jammy 2024-04-18T21:04:16.091 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3141-g5be49cd9-1jammy 2024-04-18T21:04:16.092 INFO:teuthology.task.install:The correct ceph version 19.0.0-3141-g5be49cd9-1jammy is installed. 2024-04-18T21:04:16.093 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=5be49cd9e6fca1ff6a05f2473aa3b399da760600 2024-04-18T21:04:16.236 DEBUG:teuthology.orchestra.run.smithi187:> dpkg-query -W -f '${Version}' ceph 2024-04-18T21:04:16.255 INFO:teuthology.orchestra.run.smithi187.stdout:19.0.0-3141-g5be49cd9-1jammy 2024-04-18T21:04:16.255 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3141-g5be49cd9-1jammy 2024-04-18T21:04:16.256 INFO:teuthology.task.install:The correct ceph version 19.0.0-3141-g5be49cd9-1jammy is installed. 2024-04-18T21:04:16.257 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-18T21:04:16.257 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-04-18T21:04:16.257 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-18T21:04:16.271 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-18T21:04:16.271 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-18T21:04:16.286 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-04-18T21:04:16.286 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-18T21:04:16.300 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-04-18T21:04:16.300 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-18T21:04:16.314 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-18T21:04:16.314 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-04-18T21:04:16.314 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/daemon-helper 2024-04-18T21:04:16.327 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-18T21:04:16.378 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-18T21:04:16.379 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/usr/bin/daemon-helper 2024-04-18T21:04:16.392 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-18T21:04:16.446 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-04-18T21:04:16.446 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/daemon-helper 2024-04-18T21:04:16.459 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-18T21:04:16.513 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-04-18T21:04:16.513 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/daemon-helper 2024-04-18T21:04:16.527 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-18T21:04:16.580 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-18T21:04:16.580 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-04-18T21:04:16.580 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-18T21:04:16.593 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-18T21:04:16.646 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-18T21:04:16.646 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-18T21:04:16.660 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-18T21:04:16.713 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-04-18T21:04:16.713 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-18T21:04:16.727 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-18T21:04:16.780 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-04-18T21:04:16.780 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-18T21:04:16.793 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-18T21:04:16.848 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-18T21:04:16.848 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-04-18T21:04:16.848 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/stdin-killer 2024-04-18T21:04:16.861 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-18T21:04:16.915 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-18T21:04:16.915 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/usr/bin/stdin-killer 2024-04-18T21:04:16.928 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-18T21:04:16.981 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-04-18T21:04:16.981 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/stdin-killer 2024-04-18T21:04:16.995 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-18T21:04:17.052 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-04-18T21:04:17.052 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/stdin-killer 2024-04-18T21:04:17.066 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-18T21:04:17.119 INFO:teuthology.run_tasks:Running task ceph... 2024-04-18T21:04:17.199 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-18T21:04:17.199 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 777 /var/log/ceph 2024-04-18T21:04:17.202 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 777 /var/log/ceph 2024-04-18T21:04:17.204 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 777 /var/log/ceph 2024-04-18T21:04:17.206 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 777 /var/log/ceph 2024-04-18T21:04:17.218 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-18T21:04:17.219 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-18T21:04:17.257 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-18T21:04:17.259 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-18T21:04:17.267 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-18T21:04:17.280 INFO:tasks.ceph:Creating extra log directories... 2024-04-18T21:04:17.280 DEBUG:teuthology.orchestra.run.smithi078:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-18T21:04:17.309 DEBUG:teuthology.orchestra.run.smithi132:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-18T21:04:17.315 DEBUG:teuthology.orchestra.run.smithi150:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-18T21:04:17.319 DEBUG:teuthology.orchestra.run.smithi187:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-18T21:04:17.346 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-18T21:04:17.346 INFO:tasks.ceph:config {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-18T21:04:17.346 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-18_20:32:14-powercycle-main-distro-default-smithi/7662458', 'branch': 'main', 'description': 'powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-bitmap powercycle/default supported-distros/ubuntu_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7662458', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-04-18_20:32:14-powercycle-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': '5be49cd9e6fca1ff6a05f2473aa3b399da760600'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '5be49cd9e6fca1ff6a05f2473aa3b399da760600'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': 'c46a99d99fa3e2dad10a5ce96141fec909e651df'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 950, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'], ['osd.0'], ['osd.1'], ['osd.2']], 'seed': 3165, 'sha1': '5be49cd9e6fca1ff6a05f2473aa3b399da760600', 'sleep_before_teardown': 0, 'subset': '2/4', 'suite': 'powercycle', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_c46a99d99fa3e2dad10a5ce96141fec909e651df/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'c46a99d99fa3e2dad10a5ce96141fec909e651df', 'targets': {'smithi078.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIiyrm9csKsNsKj7xDXE+aNZyvWTQS3gA1ugoSkLTS8vTnm+wU1fPBOCH0ahR4c0Lt4CZSt1UkKAVbN9dUWnDPg=', 'smithi132.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIrgP7QcwZdwb++8hCo39QH2d5ZPvfvleOsY2KDlnX6jIDGB+34ght1jvmfiYamQoMFDa5kaffPkHbVSoY27UF8=', 'smithi150.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEfi/GPD09CDYsZs5i7Td8w7yI17zJ0edKeheRdVTVXklcDBY+726nFxvD+ly3SCL5Xmg/Mqv7ZRXOp+RkJUr7Y=', 'smithi187.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLAYrEICoF51OKaKhnoY4+7Mn3RFVlVeq+LchGulXI8ph260tG0CupOnCPaAR8RQmi9eWE6PufRjA2XWPCTomr0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '5be49cd9e6fca1ff6a05f2473aa3b399da760600'}}, {'ceph': None}, {'thrashosds': {'chance_down': 1.0, 'powercycle': True, 'timeout': 600}}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/fsstress.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-18_20:32:14', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-18T21:04:17.347 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-18T21:04:17.361 DEBUG:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-18T21:04:17.371 DEBUG:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-18T21:04:17.373 DEBUG:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-18T21:04:17.384 DEBUG:teuthology.orchestra.run.smithi078:> sudo install -d -m0777 -- /var/run/ceph 2024-04-18T21:04:17.409 DEBUG:teuthology.orchestra.run.smithi132:> sudo install -d -m0777 -- /var/run/ceph 2024-04-18T21:04:17.420 DEBUG:teuthology.orchestra.run.smithi150:> sudo install -d -m0777 -- /var/run/ceph 2024-04-18T21:04:17.423 DEBUG:teuthology.orchestra.run.smithi187:> sudo install -d -m0777 -- /var/run/ceph 2024-04-18T21:04:17.440 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-18T21:04:17.440 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/scratch_devs of=/dev/stdout 2024-04-18T21:04:17.478 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-18T21:04:17.479 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_1 2024-04-18T21:04:17.528 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-18T21:04:17.528 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T21:04:17.528 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 885 Links: 1 2024-04-18T21:04:17.528 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T21:04:17.528 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2024-04-18 20:55:49.385053402 +0000 2024-04-18T21:04:17.528 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2024-04-18 20:55:49.113055832 +0000 2024-04-18T21:04:17.529 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2024-04-18 20:55:49.113055832 +0000 2024-04-18T21:04:17.529 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: - 2024-04-18T21:04:17.529 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-18T21:04:17.581 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2024-04-18T21:04:17.581 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2024-04-18T21:04:17.581 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000379418 s, 1.3 MB/s 2024-04-18T21:04:17.582 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-18T21:04:17.632 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_2 2024-04-18T21:04:17.678 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-18T21:04:17.678 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T21:04:17.679 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 903 Links: 1 2024-04-18T21:04:17.679 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T21:04:17.679 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2024-04-18 20:55:49.873049044 +0000 2024-04-18T21:04:17.679 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2024-04-18 20:55:49.605051437 +0000 2024-04-18T21:04:17.679 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2024-04-18 20:55:49.605051437 +0000 2024-04-18T21:04:17.679 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: - 2024-04-18T21:04:17.679 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-18T21:04:17.733 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2024-04-18T21:04:17.733 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2024-04-18T21:04:17.733 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000332822 s, 1.5 MB/s 2024-04-18T21:04:17.734 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-18T21:04:17.783 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_3 2024-04-18T21:04:17.830 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-18T21:04:17.831 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T21:04:17.831 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 920 Links: 1 2024-04-18T21:04:17.831 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T21:04:17.831 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2024-04-18 20:55:50.361044684 +0000 2024-04-18T21:04:17.831 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2024-04-18 20:55:50.097047043 +0000 2024-04-18T21:04:17.831 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2024-04-18 20:55:50.097047043 +0000 2024-04-18T21:04:17.831 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: - 2024-04-18T21:04:17.831 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-18T21:04:17.884 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2024-04-18T21:04:17.884 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2024-04-18T21:04:17.884 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000437033 s, 1.2 MB/s 2024-04-18T21:04:17.886 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-18T21:04:17.936 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_4 2024-04-18T21:04:17.982 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-18T21:04:17.982 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T21:04:17.982 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 935 Links: 1 2024-04-18T21:04:17.983 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T21:04:17.983 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2024-04-18 20:55:50.877040076 +0000 2024-04-18T21:04:17.983 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2024-04-18 20:55:50.597042576 +0000 2024-04-18T21:04:17.983 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2024-04-18 20:55:50.597042576 +0000 2024-04-18T21:04:17.983 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: - 2024-04-18T21:04:17.983 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-18T21:04:18.036 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2024-04-18T21:04:18.036 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2024-04-18T21:04:18.036 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000415184 s, 1.2 MB/s 2024-04-18T21:04:18.037 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-18T21:04:18.084 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-18T21:04:18.084 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-04-18T21:04:18.084 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/scratch_devs of=/dev/stdout 2024-04-18T21:04:18.089 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-18T21:04:18.089 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_1 2024-04-18T21:04:18.138 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-18T21:04:18.138 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T21:04:18.138 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 5h/5d Inode: 886 Links: 1 2024-04-18T21:04:18.138 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T21:04:18.138 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2024-04-18 20:55:49.967101919 +0000 2024-04-18T21:04:18.138 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2024-04-18 20:55:49.719104134 +0000 2024-04-18T21:04:18.138 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2024-04-18 20:55:49.719104134 +0000 2024-04-18T21:04:18.138 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: - 2024-04-18T21:04:18.138 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-18T21:04:18.191 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2024-04-18T21:04:18.192 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2024-04-18T21:04:18.192 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000342126 s, 1.5 MB/s 2024-04-18T21:04:18.193 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-18T21:04:18.243 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_2 2024-04-18T21:04:18.293 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-18T21:04:18.293 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T21:04:18.293 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 5h/5d Inode: 902 Links: 1 2024-04-18T21:04:18.293 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T21:04:18.294 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2024-04-18 20:55:50.215099704 +0000 2024-04-18T21:04:18.294 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2024-04-18 20:55:50.211099740 +0000 2024-04-18T21:04:18.294 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2024-04-18 20:55:50.211099740 +0000 2024-04-18T21:04:18.294 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: - 2024-04-18T21:04:18.294 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-18T21:04:18.348 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2024-04-18T21:04:18.348 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2024-04-18T21:04:18.348 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000410754 s, 1.2 MB/s 2024-04-18T21:04:18.350 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-18T21:04:18.399 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_3 2024-04-18T21:04:18.445 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-18T21:04:18.445 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T21:04:18.445 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 5h/5d Inode: 920 Links: 1 2024-04-18T21:04:18.445 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T21:04:18.445 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2024-04-18 20:55:50.983092844 +0000 2024-04-18T21:04:18.445 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2024-04-18 20:55:50.703095345 +0000 2024-04-18T21:04:18.445 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2024-04-18 20:55:50.703095345 +0000 2024-04-18T21:04:18.445 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: - 2024-04-18T21:04:18.446 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-18T21:04:18.500 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2024-04-18T21:04:18.500 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2024-04-18T21:04:18.500 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000407549 s, 1.3 MB/s 2024-04-18T21:04:18.501 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-18T21:04:18.551 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_4 2024-04-18T21:04:18.597 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-18T21:04:18.597 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T21:04:18.597 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 5h/5d Inode: 935 Links: 1 2024-04-18T21:04:18.597 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T21:04:18.597 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2024-04-18 20:55:51.519088057 +0000 2024-04-18T21:04:18.597 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2024-04-18 20:55:51.263090343 +0000 2024-04-18T21:04:18.598 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2024-04-18 20:55:51.263090343 +0000 2024-04-18T21:04:18.598 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: - 2024-04-18T21:04:18.598 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-18T21:04:18.651 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2024-04-18T21:04:18.651 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2024-04-18T21:04:18.652 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000419436 s, 1.2 MB/s 2024-04-18T21:04:18.653 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-18T21:04:18.702 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-04-18T21:04:18.702 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-04-18T21:04:18.702 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/scratch_devs of=/dev/stdout 2024-04-18T21:04:18.708 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-18T21:04:18.708 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_1 2024-04-18T21:04:18.757 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-18T21:04:18.758 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T21:04:18.758 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 874 Links: 1 2024-04-18T21:04:18.758 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T21:04:18.758 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2024-04-18 20:55:49.852652407 +0000 2024-04-18T21:04:18.758 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2024-04-18 20:55:49.588654766 +0000 2024-04-18T21:04:18.758 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2024-04-18 20:55:49.588654766 +0000 2024-04-18T21:04:18.758 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: - 2024-04-18T21:04:18.758 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-18T21:04:18.811 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2024-04-18T21:04:18.812 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2024-04-18T21:04:18.812 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000441692 s, 1.2 MB/s 2024-04-18T21:04:18.813 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-18T21:04:18.862 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_2 2024-04-18T21:04:18.908 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-18T21:04:18.908 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T21:04:18.909 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 886 Links: 1 2024-04-18T21:04:18.909 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T21:04:18.909 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2024-04-18 20:55:50.332648121 +0000 2024-04-18T21:04:18.909 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2024-04-18 20:55:50.088650299 +0000 2024-04-18T21:04:18.909 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2024-04-18 20:55:50.088650299 +0000 2024-04-18T21:04:18.909 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: - 2024-04-18T21:04:18.909 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-18T21:04:18.963 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2024-04-18T21:04:18.963 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2024-04-18T21:04:18.963 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000418938 s, 1.2 MB/s 2024-04-18T21:04:18.964 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-18T21:04:19.013 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_3 2024-04-18T21:04:19.060 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-18T21:04:19.060 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T21:04:19.060 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 903 Links: 1 2024-04-18T21:04:19.060 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T21:04:19.060 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2024-04-18 20:55:50.600645727 +0000 2024-04-18T21:04:19.061 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2024-04-18 20:55:50.596645762 +0000 2024-04-18T21:04:19.061 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2024-04-18 20:55:50.596645762 +0000 2024-04-18T21:04:19.061 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: - 2024-04-18T21:04:19.061 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-18T21:04:19.114 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2024-04-18T21:04:19.115 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2024-04-18T21:04:19.115 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000434395 s, 1.2 MB/s 2024-04-18T21:04:19.116 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-18T21:04:19.166 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_4 2024-04-18T21:04:19.212 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-18T21:04:19.212 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T21:04:19.212 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 928 Links: 1 2024-04-18T21:04:19.212 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T21:04:19.212 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2024-04-18 20:55:51.380638760 +0000 2024-04-18T21:04:19.213 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2024-04-18 20:55:51.100641261 +0000 2024-04-18T21:04:19.213 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2024-04-18 20:55:51.100641261 +0000 2024-04-18T21:04:19.213 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: - 2024-04-18T21:04:19.213 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-18T21:04:19.266 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2024-04-18T21:04:19.267 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2024-04-18T21:04:19.267 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000392382 s, 1.3 MB/s 2024-04-18T21:04:19.268 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-18T21:04:19.317 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-04-18T21:04:19.318 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi132.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi150.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi187.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-04-18T21:04:19.318 INFO:tasks.ceph:Generating config... 2024-04-18T21:04:19.319 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-18T21:04:19.319 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-18T21:04:19.319 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-18T21:04:19.319 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-18T21:04:19.319 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-18T21:04:19.319 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-18T21:04:19.319 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-18T21:04:19.319 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-18T21:04:19.319 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-18T21:04:19.319 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-18T21:04:19.319 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-18T21:04:19.319 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-18T21:04:19.320 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-18T21:04:19.320 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-18T21:04:19.320 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-18T21:04:19.320 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-18T21:04:19.320 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-18T21:04:19.320 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-18T21:04:19.320 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-18T21:04:19.320 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-18T21:04:19.320 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-18T21:04:19.320 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-18T21:04:19.320 INFO:tasks.ceph:Setting up mon.a... 2024-04-18T21:04:19.320 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-18T21:04:19.355 INFO:teuthology.orchestra.run.smithi078.stdout:creating /etc/ceph/ceph.keyring 2024-04-18T21:04:19.365 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-18T21:04:19.443 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-18T21:04:19.495 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.78'), ('mon.b', '[v2:172.21.15.78:3301,v1:172.21.15.78:6790]'), ('mon.c', '[v2:172.21.15.78:3302,v1:172.21.15.78:6791]')] 2024-04-18T21:04:19.495 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.78,[v2:172.21.15.78:3301,v1:172.21.15.78:6790],[v2:172.21.15.78:3302,v1:172.21.15.78:6791]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}} 2024-04-18T21:04:19.496 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-04-18T21:04:19.496 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-18T21:04:19.540 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.78 --addv b '[v2:172.21.15.78:3301,v1:172.21.15.78:6790]' --addv c '[v2:172.21.15.78:3302,v1:172.21.15.78:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-18T21:04:19.624 INFO:teuthology.orchestra.run.smithi078.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-18T21:04:19.625 INFO:teuthology.orchestra.run.smithi078.stdout:monmaptool: generated fsid dc017990-0393-4ab0-b604-5e7052fdc7bd 2024-04-18T21:04:19.625 INFO:teuthology.orchestra.run.smithi078.stdout:setting min_mon_release = quincy 2024-04-18T21:04:19.625 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 0 2024-04-18T21:04:19.625 INFO:teuthology.orchestra.run.smithi078.stdout:fsid dc017990-0393-4ab0-b604-5e7052fdc7bd 2024-04-18T21:04:19.625 INFO:teuthology.orchestra.run.smithi078.stdout:last_changed 2024-04-18T21:04:19.629521+0000 2024-04-18T21:04:19.625 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-04-18T21:04:19.629521+0000 2024-04-18T21:04:19.625 INFO:teuthology.orchestra.run.smithi078.stdout:min_mon_release 17 (quincy) 2024-04-18T21:04:19.625 INFO:teuthology.orchestra.run.smithi078.stdout:election_strategy: 1 2024-04-18T21:04:19.625 INFO:teuthology.orchestra.run.smithi078.stdout:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-04-18T21:04:19.625 INFO:teuthology.orchestra.run.smithi078.stdout:1: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.b 2024-04-18T21:04:19.625 INFO:teuthology.orchestra.run.smithi078.stdout:2: [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] mon.c 2024-04-18T21:04:19.626 INFO:teuthology.orchestra.run.smithi078.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-18T21:04:19.627 DEBUG:teuthology.orchestra.run.smithi078:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-18T21:04:19.672 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID dc017990-0393-4ab0-b604-5e7052fdc7bd... 2024-04-18T21:04:19.673 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-18T21:04:19.717 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-18T21:04:19.719 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-18T21:04:19.721 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-18T21:04:19.743 INFO:teuthology.orchestra.run.smithi078.stdout:[global] 2024-04-18T21:04:19.743 INFO:teuthology.orchestra.run.smithi078.stdout: chdir = "" 2024-04-18T21:04:19.743 INFO:teuthology.orchestra.run.smithi078.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-18T21:04:19.744 INFO:teuthology.orchestra.run.smithi078.stdout: auth supported = cephx 2024-04-18T21:04:19.744 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:04:19.744 INFO:teuthology.orchestra.run.smithi078.stdout: filestore xattr use omap = true 2024-04-18T21:04:19.744 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:04:19.744 INFO:teuthology.orchestra.run.smithi078.stdout: mon clock drift allowed = 1.000 2024-04-18T21:04:19.744 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:04:19.744 INFO:teuthology.orchestra.run.smithi078.stdout: osd crush chooseleaf type = 0 2024-04-18T21:04:19.744 INFO:teuthology.orchestra.run.smithi078.stdout: auth debug = true 2024-04-18T21:04:19.744 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:04:19.744 INFO:teuthology.orchestra.run.smithi078.stdout: ms die on old message = true 2024-04-18T21:04:19.744 INFO:teuthology.orchestra.run.smithi078.stdout: ms die on bug = true 2024-04-18T21:04:19.744 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:04:19.744 INFO:teuthology.orchestra.run.smithi078.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-18T21:04:19.745 INFO:teuthology.orchestra.run.smithi078.stdout: mon pg warn max object skew = 0 2024-04-18T21:04:19.745 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:04:19.745 INFO:teuthology.orchestra.run.smithi078.stdout: # disable pg_autoscaler by default for new pools 2024-04-18T21:04:19.745 INFO:teuthology.orchestra.run.smithi078.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-18T21:04:19.745 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:04:19.745 INFO:teuthology.orchestra.run.smithi078.stdout: osd pool default size = 2 2024-04-18T21:04:19.745 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:04:19.745 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd allow primary affinity = true 2024-04-18T21:04:19.745 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd allow pg remap = true 2024-04-18T21:04:19.745 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on legacy crush tunables = false 2024-04-18T21:04:19.745 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on crush straw calc version zero = false 2024-04-18T21:04:19.745 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on no sortbitwise = false 2024-04-18T21:04:19.745 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on osd down out interval zero = false 2024-04-18T21:04:19.746 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on too few osds = false 2024-04-18T21:04:19.746 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-18T21:04:19.746 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-18T21:04:19.746 INFO:teuthology.orchestra.run.smithi078.stdout: mon_allow_pool_size_one = true 2024-04-18T21:04:19.746 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:04:19.746 INFO:teuthology.orchestra.run.smithi078.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-18T21:04:19.746 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:04:19.746 INFO:teuthology.orchestra.run.smithi078.stdout: osd default data pool replay window = 5 2024-04-18T21:04:19.746 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:04:19.746 INFO:teuthology.orchestra.run.smithi078.stdout: mon allow pool delete = true 2024-04-18T21:04:19.746 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:04:19.746 INFO:teuthology.orchestra.run.smithi078.stdout: mon cluster log file level = debug 2024-04-18T21:04:19.746 INFO:teuthology.orchestra.run.smithi078.stdout: debug asserts on shutdown = true 2024-04-18T21:04:19.746 INFO:teuthology.orchestra.run.smithi078.stdout: mon health detail to clog = false 2024-04-18T21:04:19.747 INFO:teuthology.orchestra.run.smithi078.stdout: mon host = "172.21.15.78,[v2:172.21.15.78:3301,v1:172.21.15.78:6790],[v2:172.21.15.78:3302,v1:172.21.15.78:6791]" 2024-04-18T21:04:19.747 INFO:teuthology.orchestra.run.smithi078.stdout: fsid = dc017990-0393-4ab0-b604-5e7052fdc7bd 2024-04-18T21:04:19.747 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:04:19.747 INFO:teuthology.orchestra.run.smithi078.stdout:[osd] 2024-04-18T21:04:19.747 INFO:teuthology.orchestra.run.smithi078.stdout: osd journal size = 100 2024-04-18T21:04:19.747 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:04:19.747 INFO:teuthology.orchestra.run.smithi078.stdout: osd scrub load threshold = 5.0 2024-04-18T21:04:19.747 INFO:teuthology.orchestra.run.smithi078.stdout: osd scrub max interval = 600 2024-04-18T21:04:19.747 INFO:teuthology.orchestra.run.smithi078.stdout: osd mclock profile = high_recovery_ops 2024-04-18T21:04:19.747 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:04:19.747 INFO:teuthology.orchestra.run.smithi078.stdout: osd recover clone overlap = true 2024-04-18T21:04:19.747 INFO:teuthology.orchestra.run.smithi078.stdout: osd recovery max chunk = 1048576 2024-04-18T21:04:19.747 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:04:19.747 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug shutdown = true 2024-04-18T21:04:19.747 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug op order = true 2024-04-18T21:04:19.748 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug verify stray on activate = true 2024-04-18T21:04:19.748 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug trim objects = true 2024-04-18T21:04:19.748 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:04:19.748 INFO:teuthology.orchestra.run.smithi078.stdout: osd open classes on start = true 2024-04-18T21:04:19.748 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug pg log writeout = true 2024-04-18T21:04:19.748 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:04:19.748 INFO:teuthology.orchestra.run.smithi078.stdout: osd deep scrub update digest min age = 30 2024-04-18T21:04:19.748 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:04:19.748 INFO:teuthology.orchestra.run.smithi078.stdout: osd map max advance = 10 2024-04-18T21:04:19.748 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:04:19.748 INFO:teuthology.orchestra.run.smithi078.stdout: journal zero on create = true 2024-04-18T21:04:19.748 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:04:19.748 INFO:teuthology.orchestra.run.smithi078.stdout: filestore ondisk finisher threads = 3 2024-04-18T21:04:19.749 INFO:teuthology.orchestra.run.smithi078.stdout: filestore apply finisher threads = 3 2024-04-18T21:04:19.749 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:04:19.749 INFO:teuthology.orchestra.run.smithi078.stdout: bdev debug aio = true 2024-04-18T21:04:19.749 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug misdirected ops = true 2024-04-18T21:04:19.749 INFO:teuthology.orchestra.run.smithi078.stdout: bdev async discard = True 2024-04-18T21:04:19.749 INFO:teuthology.orchestra.run.smithi078.stdout: bdev enable discard = True 2024-04-18T21:04:19.749 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore allocator = bitmap 2024-04-18T21:04:19.749 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore block size = 96636764160 2024-04-18T21:04:19.749 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore fsck on mount = True 2024-04-18T21:04:19.749 INFO:teuthology.orchestra.run.smithi078.stdout: debug bluefs = 1/20 2024-04-18T21:04:19.749 INFO:teuthology.orchestra.run.smithi078.stdout: debug bluestore = 1/20 2024-04-18T21:04:19.749 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2024-04-18T21:04:19.749 INFO:teuthology.orchestra.run.smithi078.stdout: debug osd = 20 2024-04-18T21:04:19.749 INFO:teuthology.orchestra.run.smithi078.stdout: debug rocksdb = 4/10 2024-04-18T21:04:19.750 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd backfillfull_ratio = 0.85 2024-04-18T21:04:19.750 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd full ratio = 0.9 2024-04-18T21:04:19.750 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd nearfull ratio = 0.8 2024-04-18T21:04:19.750 INFO:teuthology.orchestra.run.smithi078.stdout: osd blocked scrub grace period = 3600 2024-04-18T21:04:19.750 INFO:teuthology.orchestra.run.smithi078.stdout: osd failsafe full ratio = 0.95 2024-04-18T21:04:19.750 INFO:teuthology.orchestra.run.smithi078.stdout: osd max markdown count = 1000 2024-04-18T21:04:19.750 INFO:teuthology.orchestra.run.smithi078.stdout: osd objectstore = bluestore 2024-04-18T21:04:19.750 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:04:19.750 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr] 2024-04-18T21:04:19.750 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2024-04-18T21:04:19.750 INFO:teuthology.orchestra.run.smithi078.stdout: debug mgr = 20 2024-04-18T21:04:19.750 INFO:teuthology.orchestra.run.smithi078.stdout: debug mon = 20 2024-04-18T21:04:19.750 INFO:teuthology.orchestra.run.smithi078.stdout: debug auth = 20 2024-04-18T21:04:19.750 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min pgs per osd = 4 2024-04-18T21:04:19.751 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min bytes per osd = 10 2024-04-18T21:04:19.751 INFO:teuthology.orchestra.run.smithi078.stdout: mgr/telemetry/nag = false 2024-04-18T21:04:19.751 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:04:19.751 INFO:teuthology.orchestra.run.smithi078.stdout:[mon] 2024-04-18T21:04:19.751 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2024-04-18T21:04:19.751 INFO:teuthology.orchestra.run.smithi078.stdout: debug mon = 20 2024-04-18T21:04:19.751 INFO:teuthology.orchestra.run.smithi078.stdout: debug paxos = 20 2024-04-18T21:04:19.751 INFO:teuthology.orchestra.run.smithi078.stdout: debug auth = 20 2024-04-18T21:04:19.751 INFO:teuthology.orchestra.run.smithi078.stdout: mon data avail warn = 5 2024-04-18T21:04:19.751 INFO:teuthology.orchestra.run.smithi078.stdout: mon mgr mkfs grace = 240 2024-04-18T21:04:19.751 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min pgs per osd = 4 2024-04-18T21:04:19.751 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd reporter subtree level = osd 2024-04-18T21:04:19.751 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd prime pg temp = true 2024-04-18T21:04:19.751 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min bytes per osd = 10 2024-04-18T21:04:19.751 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:04:19.752 INFO:teuthology.orchestra.run.smithi078.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-18T21:04:19.752 INFO:teuthology.orchestra.run.smithi078.stdout: auth mon ticket ttl = 660 # 11m 2024-04-18T21:04:19.752 INFO:teuthology.orchestra.run.smithi078.stdout: auth service ticket ttl = 240 # 4m 2024-04-18T21:04:19.752 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:04:19.752 INFO:teuthology.orchestra.run.smithi078.stdout: # don't complain about insecure global_id in the test suite 2024-04-18T21:04:19.752 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-18T21:04:19.752 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-18T21:04:19.752 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:04:19.752 INFO:teuthology.orchestra.run.smithi078.stdout: # 1m isn't quite enough 2024-04-18T21:04:19.752 INFO:teuthology.orchestra.run.smithi078.stdout: mon_down_mkfs_grace = 2m 2024-04-18T21:04:19.752 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:04:19.752 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_filestore_osds = false 2024-04-18T21:04:19.752 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:04:19.752 INFO:teuthology.orchestra.run.smithi078.stdout:[client] 2024-04-18T21:04:19.753 INFO:teuthology.orchestra.run.smithi078.stdout: rgw cache enabled = true 2024-04-18T21:04:19.753 INFO:teuthology.orchestra.run.smithi078.stdout: rgw enable ops log = true 2024-04-18T21:04:19.753 INFO:teuthology.orchestra.run.smithi078.stdout: rgw enable usage log = true 2024-04-18T21:04:19.753 INFO:teuthology.orchestra.run.smithi078.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-18T21:04:19.753 INFO:teuthology.orchestra.run.smithi078.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-18T21:04:19.753 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.a] 2024-04-18T21:04:19.753 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.b] 2024-04-18T21:04:19.753 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.c] 2024-04-18T21:04:19.753 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.a] 2024-04-18T21:04:19.754 INFO:teuthology.orchestra.run.smithi187.stdout:[global] 2024-04-18T21:04:19.754 INFO:teuthology.orchestra.run.smithi187.stdout: chdir = "" 2024-04-18T21:04:19.754 INFO:teuthology.orchestra.run.smithi187.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-18T21:04:19.754 INFO:teuthology.orchestra.run.smithi187.stdout: auth supported = cephx 2024-04-18T21:04:19.754 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-18T21:04:19.754 INFO:teuthology.orchestra.run.smithi187.stdout: filestore xattr use omap = true 2024-04-18T21:04:19.754 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-18T21:04:19.755 INFO:teuthology.orchestra.run.smithi187.stdout: mon clock drift allowed = 1.000 2024-04-18T21:04:19.755 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-18T21:04:19.755 INFO:teuthology.orchestra.run.smithi187.stdout: osd crush chooseleaf type = 0 2024-04-18T21:04:19.755 INFO:teuthology.orchestra.run.smithi187.stdout: auth debug = true 2024-04-18T21:04:19.755 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-18T21:04:19.755 INFO:teuthology.orchestra.run.smithi187.stdout: ms die on old message = true 2024-04-18T21:04:19.755 INFO:teuthology.orchestra.run.smithi187.stdout: ms die on bug = true 2024-04-18T21:04:19.755 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-18T21:04:19.755 INFO:teuthology.orchestra.run.smithi187.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-18T21:04:19.755 INFO:teuthology.orchestra.run.smithi187.stdout: mon pg warn max object skew = 0 2024-04-18T21:04:19.755 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-18T21:04:19.755 INFO:teuthology.orchestra.run.smithi187.stdout: # disable pg_autoscaler by default for new pools 2024-04-18T21:04:19.755 INFO:teuthology.orchestra.run.smithi187.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-18T21:04:19.755 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-18T21:04:19.755 INFO:teuthology.orchestra.run.smithi187.stdout: osd pool default size = 2 2024-04-18T21:04:19.755 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-18T21:04:19.756 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd allow primary affinity = true 2024-04-18T21:04:19.756 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd allow pg remap = true 2024-04-18T21:04:19.756 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on legacy crush tunables = false 2024-04-18T21:04:19.756 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on crush straw calc version zero = false 2024-04-18T21:04:19.756 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on no sortbitwise = false 2024-04-18T21:04:19.756 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on osd down out interval zero = false 2024-04-18T21:04:19.756 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on too few osds = false 2024-04-18T21:04:19.756 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-18T21:04:19.756 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-18T21:04:19.756 INFO:teuthology.orchestra.run.smithi187.stdout: mon_allow_pool_size_one = true 2024-04-18T21:04:19.756 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-18T21:04:19.756 INFO:teuthology.orchestra.run.smithi187.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-18T21:04:19.756 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-18T21:04:19.756 INFO:teuthology.orchestra.run.smithi187.stdout: osd default data pool replay window = 5 2024-04-18T21:04:19.756 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-18T21:04:19.756 INFO:teuthology.orchestra.run.smithi187.stdout: mon allow pool delete = true 2024-04-18T21:04:19.757 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-18T21:04:19.757 INFO:teuthology.orchestra.run.smithi187.stdout: mon cluster log file level = debug 2024-04-18T21:04:19.757 INFO:teuthology.orchestra.run.smithi187.stdout: debug asserts on shutdown = true 2024-04-18T21:04:19.757 INFO:teuthology.orchestra.run.smithi187.stdout: mon health detail to clog = false 2024-04-18T21:04:19.757 INFO:teuthology.orchestra.run.smithi187.stdout: mon host = "172.21.15.78,[v2:172.21.15.78:3301,v1:172.21.15.78:6790],[v2:172.21.15.78:3302,v1:172.21.15.78:6791]" 2024-04-18T21:04:19.757 INFO:teuthology.orchestra.run.smithi187.stdout: fsid = dc017990-0393-4ab0-b604-5e7052fdc7bd 2024-04-18T21:04:19.757 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-18T21:04:19.757 INFO:teuthology.orchestra.run.smithi187.stdout:[osd] 2024-04-18T21:04:19.757 INFO:teuthology.orchestra.run.smithi187.stdout: osd journal size = 100 2024-04-18T21:04:19.757 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-18T21:04:19.757 INFO:teuthology.orchestra.run.smithi187.stdout: osd scrub load threshold = 5.0 2024-04-18T21:04:19.757 INFO:teuthology.orchestra.run.smithi187.stdout: osd scrub max interval = 600 2024-04-18T21:04:19.757 INFO:teuthology.orchestra.run.smithi187.stdout: osd mclock profile = high_recovery_ops 2024-04-18T21:04:19.758 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-18T21:04:19.758 INFO:teuthology.orchestra.run.smithi187.stdout: osd recover clone overlap = true 2024-04-18T21:04:19.758 INFO:teuthology.orchestra.run.smithi187.stdout: osd recovery max chunk = 1048576 2024-04-18T21:04:19.758 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-18T21:04:19.758 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug shutdown = true 2024-04-18T21:04:19.758 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug op order = true 2024-04-18T21:04:19.758 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug verify stray on activate = true 2024-04-18T21:04:19.758 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug trim objects = true 2024-04-18T21:04:19.758 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-18T21:04:19.758 INFO:teuthology.orchestra.run.smithi187.stdout: osd open classes on start = true 2024-04-18T21:04:19.758 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug pg log writeout = true 2024-04-18T21:04:19.758 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-18T21:04:19.758 INFO:teuthology.orchestra.run.smithi187.stdout: osd deep scrub update digest min age = 30 2024-04-18T21:04:19.758 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-18T21:04:19.759 INFO:teuthology.orchestra.run.smithi187.stdout: osd map max advance = 10 2024-04-18T21:04:19.759 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-18T21:04:19.759 INFO:teuthology.orchestra.run.smithi187.stdout: journal zero on create = true 2024-04-18T21:04:19.759 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-18T21:04:19.759 INFO:teuthology.orchestra.run.smithi187.stdout: filestore ondisk finisher threads = 3 2024-04-18T21:04:19.759 INFO:teuthology.orchestra.run.smithi187.stdout: filestore apply finisher threads = 3 2024-04-18T21:04:19.759 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-18T21:04:19.759 INFO:teuthology.orchestra.run.smithi187.stdout: bdev debug aio = true 2024-04-18T21:04:19.759 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug misdirected ops = true 2024-04-18T21:04:19.759 INFO:teuthology.orchestra.run.smithi187.stdout: bdev async discard = True 2024-04-18T21:04:19.759 INFO:teuthology.orchestra.run.smithi187.stdout: bdev enable discard = True 2024-04-18T21:04:19.759 INFO:teuthology.orchestra.run.smithi187.stdout: bluestore allocator = bitmap 2024-04-18T21:04:19.759 INFO:teuthology.orchestra.run.smithi187.stdout: bluestore block size = 96636764160 2024-04-18T21:04:19.759 INFO:teuthology.orchestra.run.smithi187.stdout: bluestore fsck on mount = True 2024-04-18T21:04:19.759 INFO:teuthology.orchestra.run.smithi187.stdout: debug bluefs = 1/20 2024-04-18T21:04:19.759 INFO:teuthology.orchestra.run.smithi187.stdout: debug bluestore = 1/20 2024-04-18T21:04:19.760 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2024-04-18T21:04:19.760 INFO:teuthology.orchestra.run.smithi187.stdout: debug osd = 20 2024-04-18T21:04:19.760 INFO:teuthology.orchestra.run.smithi187.stdout: debug rocksdb = 4/10 2024-04-18T21:04:19.760 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd backfillfull_ratio = 0.85 2024-04-18T21:04:19.760 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd full ratio = 0.9 2024-04-18T21:04:19.760 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd nearfull ratio = 0.8 2024-04-18T21:04:19.760 INFO:teuthology.orchestra.run.smithi187.stdout: osd blocked scrub grace period = 3600 2024-04-18T21:04:19.760 INFO:teuthology.orchestra.run.smithi187.stdout: osd failsafe full ratio = 0.95 2024-04-18T21:04:19.760 INFO:teuthology.orchestra.run.smithi187.stdout: osd max markdown count = 1000 2024-04-18T21:04:19.760 INFO:teuthology.orchestra.run.smithi187.stdout: osd objectstore = bluestore 2024-04-18T21:04:19.760 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-18T21:04:19.760 INFO:teuthology.orchestra.run.smithi187.stdout:[mgr] 2024-04-18T21:04:19.760 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2024-04-18T21:04:19.761 INFO:teuthology.orchestra.run.smithi187.stdout: debug mgr = 20 2024-04-18T21:04:19.761 INFO:teuthology.orchestra.run.smithi187.stdout: debug mon = 20 2024-04-18T21:04:19.761 INFO:teuthology.orchestra.run.smithi187.stdout: debug auth = 20 2024-04-18T21:04:19.761 INFO:teuthology.orchestra.run.smithi187.stdout: mon reweight min pgs per osd = 4 2024-04-18T21:04:19.761 INFO:teuthology.orchestra.run.smithi187.stdout: mon reweight min bytes per osd = 10 2024-04-18T21:04:19.761 INFO:teuthology.orchestra.run.smithi187.stdout: mgr/telemetry/nag = false 2024-04-18T21:04:19.761 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-18T21:04:19.761 INFO:teuthology.orchestra.run.smithi187.stdout:[mon] 2024-04-18T21:04:19.761 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2024-04-18T21:04:19.761 INFO:teuthology.orchestra.run.smithi187.stdout: debug mon = 20 2024-04-18T21:04:19.761 INFO:teuthology.orchestra.run.smithi187.stdout: debug paxos = 20 2024-04-18T21:04:19.761 INFO:teuthology.orchestra.run.smithi187.stdout: debug auth = 20 2024-04-18T21:04:19.761 INFO:teuthology.orchestra.run.smithi187.stdout: mon data avail warn = 5 2024-04-18T21:04:19.761 INFO:teuthology.orchestra.run.smithi187.stdout: mon mgr mkfs grace = 240 2024-04-18T21:04:19.761 INFO:teuthology.orchestra.run.smithi187.stdout: mon reweight min pgs per osd = 4 2024-04-18T21:04:19.761 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd reporter subtree level = osd 2024-04-18T21:04:19.762 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd prime pg temp = true 2024-04-18T21:04:19.762 INFO:teuthology.orchestra.run.smithi187.stdout: mon reweight min bytes per osd = 10 2024-04-18T21:04:19.762 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-18T21:04:19.762 INFO:teuthology.orchestra.run.smithi187.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-18T21:04:19.762 INFO:teuthology.orchestra.run.smithi187.stdout: auth mon ticket ttl = 660 # 11m 2024-04-18T21:04:19.762 INFO:teuthology.orchestra.run.smithi187.stdout: auth service ticket ttl = 240 # 4m 2024-04-18T21:04:19.762 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-18T21:04:19.762 INFO:teuthology.orchestra.run.smithi187.stdout: # don't complain about insecure global_id in the test suite 2024-04-18T21:04:19.762 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-18T21:04:19.762 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-18T21:04:19.762 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-18T21:04:19.762 INFO:teuthology.orchestra.run.smithi187.stdout: # 1m isn't quite enough 2024-04-18T21:04:19.762 INFO:teuthology.orchestra.run.smithi187.stdout: mon_down_mkfs_grace = 2m 2024-04-18T21:04:19.762 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-18T21:04:19.762 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_filestore_osds = false 2024-04-18T21:04:19.763 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-18T21:04:19.763 INFO:teuthology.orchestra.run.smithi187.stdout:[client] 2024-04-18T21:04:19.763 INFO:teuthology.orchestra.run.smithi187.stdout: rgw cache enabled = true 2024-04-18T21:04:19.763 INFO:teuthology.orchestra.run.smithi187.stdout: rgw enable ops log = true 2024-04-18T21:04:19.763 INFO:teuthology.orchestra.run.smithi187.stdout: rgw enable usage log = true 2024-04-18T21:04:19.763 INFO:teuthology.orchestra.run.smithi187.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-18T21:04:19.763 INFO:teuthology.orchestra.run.smithi187.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-18T21:04:19.763 INFO:teuthology.orchestra.run.smithi187.stdout:[mon.a] 2024-04-18T21:04:19.763 INFO:teuthology.orchestra.run.smithi187.stdout:[mon.b] 2024-04-18T21:04:19.763 INFO:teuthology.orchestra.run.smithi187.stdout:[mon.c] 2024-04-18T21:04:19.763 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.a] 2024-04-18T21:04:19.763 INFO:teuthology.orchestra.run.smithi150.stdout:[global] 2024-04-18T21:04:19.763 INFO:teuthology.orchestra.run.smithi150.stdout: chdir = "" 2024-04-18T21:04:19.763 INFO:teuthology.orchestra.run.smithi150.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-18T21:04:19.764 INFO:teuthology.orchestra.run.smithi150.stdout: auth supported = cephx 2024-04-18T21:04:19.764 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-04-18T21:04:19.764 INFO:teuthology.orchestra.run.smithi150.stdout: filestore xattr use omap = true 2024-04-18T21:04:19.764 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-04-18T21:04:19.764 INFO:teuthology.orchestra.run.smithi150.stdout: mon clock drift allowed = 1.000 2024-04-18T21:04:19.764 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-04-18T21:04:19.764 INFO:teuthology.orchestra.run.smithi150.stdout: osd crush chooseleaf type = 0 2024-04-18T21:04:19.764 INFO:teuthology.orchestra.run.smithi150.stdout: auth debug = true 2024-04-18T21:04:19.764 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-04-18T21:04:19.764 INFO:teuthology.orchestra.run.smithi150.stdout: ms die on old message = true 2024-04-18T21:04:19.764 INFO:teuthology.orchestra.run.smithi150.stdout: ms die on bug = true 2024-04-18T21:04:19.764 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-04-18T21:04:19.764 INFO:teuthology.orchestra.run.smithi150.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-18T21:04:19.764 INFO:teuthology.orchestra.run.smithi150.stdout: mon pg warn max object skew = 0 2024-04-18T21:04:19.764 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-04-18T21:04:19.764 INFO:teuthology.orchestra.run.smithi150.stdout: # disable pg_autoscaler by default for new pools 2024-04-18T21:04:19.764 INFO:teuthology.orchestra.run.smithi150.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-18T21:04:19.765 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-04-18T21:04:19.765 INFO:teuthology.orchestra.run.smithi150.stdout: osd pool default size = 2 2024-04-18T21:04:19.765 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-04-18T21:04:19.765 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd allow primary affinity = true 2024-04-18T21:04:19.765 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd allow pg remap = true 2024-04-18T21:04:19.765 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on legacy crush tunables = false 2024-04-18T21:04:19.765 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on crush straw calc version zero = false 2024-04-18T21:04:19.765 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on no sortbitwise = false 2024-04-18T21:04:19.765 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on osd down out interval zero = false 2024-04-18T21:04:19.765 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on too few osds = false 2024-04-18T21:04:19.765 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-18T21:04:19.765 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-18T21:04:19.765 INFO:teuthology.orchestra.run.smithi150.stdout: mon_allow_pool_size_one = true 2024-04-18T21:04:19.765 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-04-18T21:04:19.766 INFO:teuthology.orchestra.run.smithi150.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-18T21:04:19.766 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-04-18T21:04:19.766 INFO:teuthology.orchestra.run.smithi150.stdout: osd default data pool replay window = 5 2024-04-18T21:04:19.766 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-04-18T21:04:19.766 INFO:teuthology.orchestra.run.smithi150.stdout: mon allow pool delete = true 2024-04-18T21:04:19.766 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-04-18T21:04:19.766 INFO:teuthology.orchestra.run.smithi150.stdout: mon cluster log file level = debug 2024-04-18T21:04:19.766 INFO:teuthology.orchestra.run.smithi150.stdout: debug asserts on shutdown = true 2024-04-18T21:04:19.766 INFO:teuthology.orchestra.run.smithi150.stdout: mon health detail to clog = false 2024-04-18T21:04:19.766 INFO:teuthology.orchestra.run.smithi150.stdout: mon host = "172.21.15.78,[v2:172.21.15.78:3301,v1:172.21.15.78:6790],[v2:172.21.15.78:3302,v1:172.21.15.78:6791]" 2024-04-18T21:04:19.766 INFO:teuthology.orchestra.run.smithi150.stdout: fsid = dc017990-0393-4ab0-b604-5e7052fdc7bd 2024-04-18T21:04:19.766 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-04-18T21:04:19.766 INFO:teuthology.orchestra.run.smithi150.stdout:[osd] 2024-04-18T21:04:19.766 INFO:teuthology.orchestra.run.smithi150.stdout: osd journal size = 100 2024-04-18T21:04:19.767 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-04-18T21:04:19.767 INFO:teuthology.orchestra.run.smithi150.stdout: osd scrub load threshold = 5.0 2024-04-18T21:04:19.767 INFO:teuthology.orchestra.run.smithi150.stdout: osd scrub max interval = 600 2024-04-18T21:04:19.767 INFO:teuthology.orchestra.run.smithi150.stdout: osd mclock profile = high_recovery_ops 2024-04-18T21:04:19.767 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-04-18T21:04:19.767 INFO:teuthology.orchestra.run.smithi150.stdout: osd recover clone overlap = true 2024-04-18T21:04:19.767 INFO:teuthology.orchestra.run.smithi150.stdout: osd recovery max chunk = 1048576 2024-04-18T21:04:19.767 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-04-18T21:04:19.767 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug shutdown = true 2024-04-18T21:04:19.767 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug op order = true 2024-04-18T21:04:19.767 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug verify stray on activate = true 2024-04-18T21:04:19.767 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug trim objects = true 2024-04-18T21:04:19.767 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-04-18T21:04:19.767 INFO:teuthology.orchestra.run.smithi150.stdout: osd open classes on start = true 2024-04-18T21:04:19.767 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug pg log writeout = true 2024-04-18T21:04:19.767 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-04-18T21:04:19.768 INFO:teuthology.orchestra.run.smithi150.stdout: osd deep scrub update digest min age = 30 2024-04-18T21:04:19.768 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-04-18T21:04:19.768 INFO:teuthology.orchestra.run.smithi150.stdout: osd map max advance = 10 2024-04-18T21:04:19.768 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-04-18T21:04:19.768 INFO:teuthology.orchestra.run.smithi150.stdout: journal zero on create = true 2024-04-18T21:04:19.768 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-04-18T21:04:19.768 INFO:teuthology.orchestra.run.smithi150.stdout: filestore ondisk finisher threads = 3 2024-04-18T21:04:19.768 INFO:teuthology.orchestra.run.smithi150.stdout: filestore apply finisher threads = 3 2024-04-18T21:04:19.768 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-04-18T21:04:19.768 INFO:teuthology.orchestra.run.smithi150.stdout: bdev debug aio = true 2024-04-18T21:04:19.768 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug misdirected ops = true 2024-04-18T21:04:19.768 INFO:teuthology.orchestra.run.smithi150.stdout: bdev async discard = True 2024-04-18T21:04:19.768 INFO:teuthology.orchestra.run.smithi150.stdout: bdev enable discard = True 2024-04-18T21:04:19.768 INFO:teuthology.orchestra.run.smithi150.stdout: bluestore allocator = bitmap 2024-04-18T21:04:19.768 INFO:teuthology.orchestra.run.smithi150.stdout: bluestore block size = 96636764160 2024-04-18T21:04:19.768 INFO:teuthology.orchestra.run.smithi150.stdout: bluestore fsck on mount = True 2024-04-18T21:04:19.769 INFO:teuthology.orchestra.run.smithi150.stdout: debug bluefs = 1/20 2024-04-18T21:04:19.769 INFO:teuthology.orchestra.run.smithi150.stdout: debug bluestore = 1/20 2024-04-18T21:04:19.769 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2024-04-18T21:04:19.769 INFO:teuthology.orchestra.run.smithi150.stdout: debug osd = 20 2024-04-18T21:04:19.769 INFO:teuthology.orchestra.run.smithi150.stdout: debug rocksdb = 4/10 2024-04-18T21:04:19.769 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd backfillfull_ratio = 0.85 2024-04-18T21:04:19.769 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd full ratio = 0.9 2024-04-18T21:04:19.769 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd nearfull ratio = 0.8 2024-04-18T21:04:19.769 INFO:teuthology.orchestra.run.smithi150.stdout: osd blocked scrub grace period = 3600 2024-04-18T21:04:19.769 INFO:teuthology.orchestra.run.smithi150.stdout: osd failsafe full ratio = 0.95 2024-04-18T21:04:19.769 INFO:teuthology.orchestra.run.smithi150.stdout: osd max markdown count = 1000 2024-04-18T21:04:19.769 INFO:teuthology.orchestra.run.smithi150.stdout: osd objectstore = bluestore 2024-04-18T21:04:19.769 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-04-18T21:04:19.769 INFO:teuthology.orchestra.run.smithi150.stdout:[mgr] 2024-04-18T21:04:19.769 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2024-04-18T21:04:19.769 INFO:teuthology.orchestra.run.smithi150.stdout: debug mgr = 20 2024-04-18T21:04:19.770 INFO:teuthology.orchestra.run.smithi150.stdout: debug mon = 20 2024-04-18T21:04:19.770 INFO:teuthology.orchestra.run.smithi150.stdout: debug auth = 20 2024-04-18T21:04:19.770 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min pgs per osd = 4 2024-04-18T21:04:19.770 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min bytes per osd = 10 2024-04-18T21:04:19.770 INFO:teuthology.orchestra.run.smithi150.stdout: mgr/telemetry/nag = false 2024-04-18T21:04:19.770 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-04-18T21:04:19.770 INFO:teuthology.orchestra.run.smithi150.stdout:[mon] 2024-04-18T21:04:19.770 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2024-04-18T21:04:19.770 INFO:teuthology.orchestra.run.smithi150.stdout: debug mon = 20 2024-04-18T21:04:19.770 INFO:teuthology.orchestra.run.smithi150.stdout: debug paxos = 20 2024-04-18T21:04:19.770 INFO:teuthology.orchestra.run.smithi150.stdout: debug auth = 20 2024-04-18T21:04:19.770 INFO:teuthology.orchestra.run.smithi150.stdout: mon data avail warn = 5 2024-04-18T21:04:19.770 INFO:teuthology.orchestra.run.smithi150.stdout: mon mgr mkfs grace = 240 2024-04-18T21:04:19.770 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min pgs per osd = 4 2024-04-18T21:04:19.771 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd reporter subtree level = osd 2024-04-18T21:04:19.771 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd prime pg temp = true 2024-04-18T21:04:19.771 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min bytes per osd = 10 2024-04-18T21:04:19.771 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-04-18T21:04:19.771 INFO:teuthology.orchestra.run.smithi150.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-18T21:04:19.771 INFO:teuthology.orchestra.run.smithi150.stdout: auth mon ticket ttl = 660 # 11m 2024-04-18T21:04:19.771 INFO:teuthology.orchestra.run.smithi150.stdout: auth service ticket ttl = 240 # 4m 2024-04-18T21:04:19.771 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-04-18T21:04:19.771 INFO:teuthology.orchestra.run.smithi150.stdout: # don't complain about insecure global_id in the test suite 2024-04-18T21:04:19.771 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-18T21:04:19.771 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-18T21:04:19.771 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-04-18T21:04:19.771 INFO:teuthology.orchestra.run.smithi150.stdout: # 1m isn't quite enough 2024-04-18T21:04:19.771 INFO:teuthology.orchestra.run.smithi150.stdout: mon_down_mkfs_grace = 2m 2024-04-18T21:04:19.771 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-04-18T21:04:19.771 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_filestore_osds = false 2024-04-18T21:04:19.771 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-04-18T21:04:19.772 INFO:teuthology.orchestra.run.smithi150.stdout:[client] 2024-04-18T21:04:19.772 INFO:teuthology.orchestra.run.smithi150.stdout: rgw cache enabled = true 2024-04-18T21:04:19.772 INFO:teuthology.orchestra.run.smithi150.stdout: rgw enable ops log = true 2024-04-18T21:04:19.772 INFO:teuthology.orchestra.run.smithi150.stdout: rgw enable usage log = true 2024-04-18T21:04:19.772 INFO:teuthology.orchestra.run.smithi150.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-18T21:04:19.772 INFO:teuthology.orchestra.run.smithi150.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-18T21:04:19.772 INFO:teuthology.orchestra.run.smithi150.stdout:[mon.a] 2024-04-18T21:04:19.772 INFO:teuthology.orchestra.run.smithi150.stdout:[mon.b] 2024-04-18T21:04:19.772 INFO:teuthology.orchestra.run.smithi150.stdout:[mon.c] 2024-04-18T21:04:19.772 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.a] 2024-04-18T21:04:19.772 INFO:teuthology.orchestra.run.smithi132.stdout:[global] 2024-04-18T21:04:19.772 INFO:teuthology.orchestra.run.smithi132.stdout: chdir = "" 2024-04-18T21:04:19.772 INFO:teuthology.orchestra.run.smithi132.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-18T21:04:19.772 INFO:teuthology.orchestra.run.smithi132.stdout: auth supported = cephx 2024-04-18T21:04:19.772 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T21:04:19.773 INFO:teuthology.orchestra.run.smithi132.stdout: filestore xattr use omap = true 2024-04-18T21:04:19.773 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T21:04:19.773 INFO:teuthology.orchestra.run.smithi132.stdout: mon clock drift allowed = 1.000 2024-04-18T21:04:19.773 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T21:04:19.773 INFO:teuthology.orchestra.run.smithi132.stdout: osd crush chooseleaf type = 0 2024-04-18T21:04:19.773 INFO:teuthology.orchestra.run.smithi132.stdout: auth debug = true 2024-04-18T21:04:19.773 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T21:04:19.773 INFO:teuthology.orchestra.run.smithi132.stdout: ms die on old message = true 2024-04-18T21:04:19.773 INFO:teuthology.orchestra.run.smithi132.stdout: ms die on bug = true 2024-04-18T21:04:19.773 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T21:04:19.773 INFO:teuthology.orchestra.run.smithi132.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-18T21:04:19.773 INFO:teuthology.orchestra.run.smithi132.stdout: mon pg warn max object skew = 0 2024-04-18T21:04:19.773 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T21:04:19.773 INFO:teuthology.orchestra.run.smithi132.stdout: # disable pg_autoscaler by default for new pools 2024-04-18T21:04:19.773 INFO:teuthology.orchestra.run.smithi132.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-18T21:04:19.774 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T21:04:19.774 INFO:teuthology.orchestra.run.smithi132.stdout: osd pool default size = 2 2024-04-18T21:04:19.774 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T21:04:19.774 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd allow primary affinity = true 2024-04-18T21:04:19.774 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd allow pg remap = true 2024-04-18T21:04:19.774 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on legacy crush tunables = false 2024-04-18T21:04:19.774 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on crush straw calc version zero = false 2024-04-18T21:04:19.774 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on no sortbitwise = false 2024-04-18T21:04:19.774 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on osd down out interval zero = false 2024-04-18T21:04:19.774 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on too few osds = false 2024-04-18T21:04:19.774 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-18T21:04:19.774 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-18T21:04:19.774 INFO:teuthology.orchestra.run.smithi132.stdout: mon_allow_pool_size_one = true 2024-04-18T21:04:19.774 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T21:04:19.774 INFO:teuthology.orchestra.run.smithi132.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-18T21:04:19.775 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T21:04:19.775 INFO:teuthology.orchestra.run.smithi132.stdout: osd default data pool replay window = 5 2024-04-18T21:04:19.775 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T21:04:19.775 INFO:teuthology.orchestra.run.smithi132.stdout: mon allow pool delete = true 2024-04-18T21:04:19.775 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T21:04:19.775 INFO:teuthology.orchestra.run.smithi132.stdout: mon cluster log file level = debug 2024-04-18T21:04:19.775 INFO:teuthology.orchestra.run.smithi132.stdout: debug asserts on shutdown = true 2024-04-18T21:04:19.775 INFO:teuthology.orchestra.run.smithi132.stdout: mon health detail to clog = false 2024-04-18T21:04:19.775 INFO:teuthology.orchestra.run.smithi132.stdout: mon host = "172.21.15.78,[v2:172.21.15.78:3301,v1:172.21.15.78:6790],[v2:172.21.15.78:3302,v1:172.21.15.78:6791]" 2024-04-18T21:04:19.775 INFO:teuthology.orchestra.run.smithi132.stdout: fsid = dc017990-0393-4ab0-b604-5e7052fdc7bd 2024-04-18T21:04:19.775 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T21:04:19.775 INFO:teuthology.orchestra.run.smithi132.stdout:[osd] 2024-04-18T21:04:19.775 INFO:teuthology.orchestra.run.smithi132.stdout: osd journal size = 100 2024-04-18T21:04:19.775 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T21:04:19.775 INFO:teuthology.orchestra.run.smithi132.stdout: osd scrub load threshold = 5.0 2024-04-18T21:04:19.775 INFO:teuthology.orchestra.run.smithi132.stdout: osd scrub max interval = 600 2024-04-18T21:04:19.776 INFO:teuthology.orchestra.run.smithi132.stdout: osd mclock profile = high_recovery_ops 2024-04-18T21:04:19.776 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T21:04:19.776 INFO:teuthology.orchestra.run.smithi132.stdout: osd recover clone overlap = true 2024-04-18T21:04:19.776 INFO:teuthology.orchestra.run.smithi132.stdout: osd recovery max chunk = 1048576 2024-04-18T21:04:19.776 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T21:04:19.776 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug shutdown = true 2024-04-18T21:04:19.776 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug op order = true 2024-04-18T21:04:19.776 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug verify stray on activate = true 2024-04-18T21:04:19.776 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug trim objects = true 2024-04-18T21:04:19.776 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T21:04:19.776 INFO:teuthology.orchestra.run.smithi132.stdout: osd open classes on start = true 2024-04-18T21:04:19.776 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug pg log writeout = true 2024-04-18T21:04:19.776 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T21:04:19.776 INFO:teuthology.orchestra.run.smithi132.stdout: osd deep scrub update digest min age = 30 2024-04-18T21:04:19.776 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T21:04:19.777 INFO:teuthology.orchestra.run.smithi132.stdout: osd map max advance = 10 2024-04-18T21:04:19.777 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T21:04:19.777 INFO:teuthology.orchestra.run.smithi132.stdout: journal zero on create = true 2024-04-18T21:04:19.777 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T21:04:19.777 INFO:teuthology.orchestra.run.smithi132.stdout: filestore ondisk finisher threads = 3 2024-04-18T21:04:19.777 INFO:teuthology.orchestra.run.smithi132.stdout: filestore apply finisher threads = 3 2024-04-18T21:04:19.777 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T21:04:19.777 INFO:teuthology.orchestra.run.smithi132.stdout: bdev debug aio = true 2024-04-18T21:04:19.777 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug misdirected ops = true 2024-04-18T21:04:19.777 INFO:teuthology.orchestra.run.smithi132.stdout: bdev async discard = True 2024-04-18T21:04:19.777 INFO:teuthology.orchestra.run.smithi132.stdout: bdev enable discard = True 2024-04-18T21:04:19.777 INFO:teuthology.orchestra.run.smithi132.stdout: bluestore allocator = bitmap 2024-04-18T21:04:19.777 INFO:teuthology.orchestra.run.smithi132.stdout: bluestore block size = 96636764160 2024-04-18T21:04:19.777 INFO:teuthology.orchestra.run.smithi132.stdout: bluestore fsck on mount = True 2024-04-18T21:04:19.777 INFO:teuthology.orchestra.run.smithi132.stdout: debug bluefs = 1/20 2024-04-18T21:04:19.777 INFO:teuthology.orchestra.run.smithi132.stdout: debug bluestore = 1/20 2024-04-18T21:04:19.778 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2024-04-18T21:04:19.778 INFO:teuthology.orchestra.run.smithi132.stdout: debug osd = 20 2024-04-18T21:04:19.778 INFO:teuthology.orchestra.run.smithi132.stdout: debug rocksdb = 4/10 2024-04-18T21:04:19.778 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd backfillfull_ratio = 0.85 2024-04-18T21:04:19.778 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd full ratio = 0.9 2024-04-18T21:04:19.778 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd nearfull ratio = 0.8 2024-04-18T21:04:19.778 INFO:teuthology.orchestra.run.smithi132.stdout: osd blocked scrub grace period = 3600 2024-04-18T21:04:19.778 INFO:teuthology.orchestra.run.smithi132.stdout: osd failsafe full ratio = 0.95 2024-04-18T21:04:19.778 INFO:teuthology.orchestra.run.smithi132.stdout: osd max markdown count = 1000 2024-04-18T21:04:19.778 INFO:teuthology.orchestra.run.smithi132.stdout: osd objectstore = bluestore 2024-04-18T21:04:19.778 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T21:04:19.778 INFO:teuthology.orchestra.run.smithi132.stdout:[mgr] 2024-04-18T21:04:19.778 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2024-04-18T21:04:19.778 INFO:teuthology.orchestra.run.smithi132.stdout: debug mgr = 20 2024-04-18T21:04:19.778 INFO:teuthology.orchestra.run.smithi132.stdout: debug mon = 20 2024-04-18T21:04:19.779 INFO:teuthology.orchestra.run.smithi132.stdout: debug auth = 20 2024-04-18T21:04:19.779 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min pgs per osd = 4 2024-04-18T21:04:19.779 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min bytes per osd = 10 2024-04-18T21:04:19.779 INFO:teuthology.orchestra.run.smithi132.stdout: mgr/telemetry/nag = false 2024-04-18T21:04:19.779 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T21:04:19.779 INFO:teuthology.orchestra.run.smithi132.stdout:[mon] 2024-04-18T21:04:19.779 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2024-04-18T21:04:19.779 INFO:teuthology.orchestra.run.smithi132.stdout: debug mon = 20 2024-04-18T21:04:19.779 INFO:teuthology.orchestra.run.smithi132.stdout: debug paxos = 20 2024-04-18T21:04:19.779 INFO:teuthology.orchestra.run.smithi132.stdout: debug auth = 20 2024-04-18T21:04:19.779 INFO:teuthology.orchestra.run.smithi132.stdout: mon data avail warn = 5 2024-04-18T21:04:19.779 INFO:teuthology.orchestra.run.smithi132.stdout: mon mgr mkfs grace = 240 2024-04-18T21:04:19.779 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min pgs per osd = 4 2024-04-18T21:04:19.779 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd reporter subtree level = osd 2024-04-18T21:04:19.779 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd prime pg temp = true 2024-04-18T21:04:19.779 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min bytes per osd = 10 2024-04-18T21:04:19.780 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T21:04:19.780 INFO:teuthology.orchestra.run.smithi132.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-18T21:04:19.780 INFO:teuthology.orchestra.run.smithi132.stdout: auth mon ticket ttl = 660 # 11m 2024-04-18T21:04:19.780 INFO:teuthology.orchestra.run.smithi132.stdout: auth service ticket ttl = 240 # 4m 2024-04-18T21:04:19.780 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T21:04:19.780 INFO:teuthology.orchestra.run.smithi132.stdout: # don't complain about insecure global_id in the test suite 2024-04-18T21:04:19.780 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-18T21:04:19.780 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-18T21:04:19.780 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T21:04:19.780 INFO:teuthology.orchestra.run.smithi132.stdout: # 1m isn't quite enough 2024-04-18T21:04:19.780 INFO:teuthology.orchestra.run.smithi132.stdout: mon_down_mkfs_grace = 2m 2024-04-18T21:04:19.780 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T21:04:19.780 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_filestore_osds = false 2024-04-18T21:04:19.780 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T21:04:19.781 INFO:teuthology.orchestra.run.smithi132.stdout:[client] 2024-04-18T21:04:19.781 INFO:teuthology.orchestra.run.smithi132.stdout: rgw cache enabled = true 2024-04-18T21:04:19.781 INFO:teuthology.orchestra.run.smithi132.stdout: rgw enable ops log = true 2024-04-18T21:04:19.781 INFO:teuthology.orchestra.run.smithi132.stdout: rgw enable usage log = true 2024-04-18T21:04:19.781 INFO:teuthology.orchestra.run.smithi132.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-18T21:04:19.781 INFO:teuthology.orchestra.run.smithi132.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-18T21:04:19.781 INFO:teuthology.orchestra.run.smithi132.stdout:[mon.a] 2024-04-18T21:04:19.781 INFO:teuthology.orchestra.run.smithi132.stdout:[mon.b] 2024-04-18T21:04:19.781 INFO:teuthology.orchestra.run.smithi132.stdout:[mon.c] 2024-04-18T21:04:19.781 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.a] 2024-04-18T21:04:19.783 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-18T21:04:19.783 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-18T21:04:19.876 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-18T21:04:19.876 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-04-18T21:04:19.876 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-18T21:04:19.882 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-04-18T21:04:19.882 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-18T21:04:19.928 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi078.front.sepia.ceph.com 2024-04-18T21:04:19.928 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-04-18T21:04:19.928 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-18T21:04:19.928 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-18T21:04:19.993 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-04-18T21:04:19.993 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-18T21:04:20.040 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi132.front.sepia.ceph.com 2024-04-18T21:04:20.040 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-18T21:04:20.040 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-18T21:04:20.040 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-18T21:04:20.062 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-18T21:04:20.063 DEBUG:teuthology.orchestra.run.smithi132:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-18T21:04:20.111 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi150.front.sepia.ceph.com 2024-04-18T21:04:20.111 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-04-18T21:04:20.111 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-18T21:04:20.111 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-18T21:04:20.133 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-04-18T21:04:20.133 DEBUG:teuthology.orchestra.run.smithi150:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-18T21:04:20.181 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi187.front.sepia.ceph.com 2024-04-18T21:04:20.182 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-04-18T21:04:20.182 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-18T21:04:20.182 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-18T21:04:20.205 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-04-18T21:04:20.205 DEBUG:teuthology.orchestra.run.smithi187:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-18T21:04:20.252 INFO:tasks.ceph:Setting up mon nodes... 2024-04-18T21:04:20.253 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-18T21:04:20.253 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-18T21:04:20.297 INFO:teuthology.orchestra.run.smithi078.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-18T21:04:20.300 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-18T21:04:20.382 INFO:teuthology.orchestra.run.smithi078.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-18T21:04:20.384 INFO:tasks.ceph:Setting up mds nodes... 2024-04-18T21:04:20.385 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-18T21:04:20.463 INFO:teuthology.orchestra.run.smithi078.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-18T21:04:20.466 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-18T21:04:20.519 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-18T21:04:20.519 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-18T21:04:20.591 INFO:teuthology.orchestra.run.smithi078.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-18T21:04:20.601 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-18T21:04:20.601 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi132.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi150.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi187.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-04-18T21:04:20.601 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-18T21:04:20.615 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-18T21:04:20.615 INFO:tasks.ceph:role: osd.0 2024-04-18T21:04:20.615 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi132.front.sepia.ceph.com 2024-04-18T21:04:20.615 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-18T21:04:20.677 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-18T21:04:20.677 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-18T21:04:20.677 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-18T21:04:20.677 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-18T21:04:20.678 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-18T21:04:20.678 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2024-04-18T21:04:20.678 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-18T21:04:20.678 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-18T21:04:20.678 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-18T21:04:20.678 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-18T21:04:21.125 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2024-04-18T21:04:21.127 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2024-04-18T21:04:21.127 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-18T21:04:21.222 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-18T21:04:21.231 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T21:04:21.232 INFO:teuthology.orchestra.run.smithi132.stderr:sudo: /sbin/restorecon: command not found 2024-04-18T21:04:21.232 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-18T21:04:21.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T21:04:21.345+0000 7fa4351ed7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-18T21:04:21.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T21:04:21.349+0000 7fa4351ed7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-18T21:04:21.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T21:04:21.349+0000 7fa4351ed7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-18T21:04:21.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T21:04:21.349+0000 7fa4351ed7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-18T21:04:21.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T21:04:21.349+0000 7fa4351ed7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-18T21:04:21.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T21:04:21.357+0000 7fa4351ed7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-18T21:04:24.337 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-18T21:04:24.349 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-18T21:04:24.363 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-04-18T21:04:24.363 INFO:tasks.ceph:role: osd.1 2024-04-18T21:04:24.363 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi150.front.sepia.ceph.com 2024-04-18T21:04:24.364 DEBUG:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-18T21:04:24.424 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-18T21:04:24.424 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-18T21:04:24.425 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-18T21:04:24.425 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-18T21:04:24.425 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-18T21:04:24.425 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2024-04-18T21:04:24.425 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-18T21:04:24.425 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-18T21:04:24.425 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-18T21:04:24.425 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-18T21:04:24.881 INFO:teuthology.orchestra.run.smithi150.stdout:Discarding blocks...Done. 2024-04-18T21:04:24.884 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2024-04-18T21:04:24.884 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-04-18T21:04:24.995 DEBUG:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-18T21:04:25.006 INFO:teuthology.orchestra.run.smithi150.stderr:sudo: /sbin/restorecon: command not found 2024-04-18T21:04:25.007 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T21:04:25.007 DEBUG:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-18T21:04:25.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-04-18T21:04:25.124+0000 7fac448767c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-18T21:04:25.128 INFO:teuthology.orchestra.run.smithi150.stderr:2024-04-18T21:04:25.128+0000 7fac448767c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-18T21:04:25.128 INFO:teuthology.orchestra.run.smithi150.stderr:2024-04-18T21:04:25.128+0000 7fac448767c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-18T21:04:25.128 INFO:teuthology.orchestra.run.smithi150.stderr:2024-04-18T21:04:25.128+0000 7fac448767c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-18T21:04:25.128 INFO:teuthology.orchestra.run.smithi150.stderr:2024-04-18T21:04:25.128+0000 7fac448767c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-18T21:04:25.130 INFO:teuthology.orchestra.run.smithi150.stderr:2024-04-18T21:04:25.132+0000 7fac448767c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-18T21:04:28.116 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-18T21:04:28.131 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-18T21:04:28.145 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-04-18T21:04:28.145 INFO:tasks.ceph:role: osd.2 2024-04-18T21:04:28.145 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi187.front.sepia.ceph.com 2024-04-18T21:04:28.145 DEBUG:teuthology.orchestra.run.smithi187:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-18T21:04:28.208 INFO:teuthology.orchestra.run.smithi187.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-18T21:04:28.208 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-18T21:04:28.208 INFO:teuthology.orchestra.run.smithi187.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-18T21:04:28.209 INFO:teuthology.orchestra.run.smithi187.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-18T21:04:28.209 INFO:teuthology.orchestra.run.smithi187.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-18T21:04:28.209 INFO:teuthology.orchestra.run.smithi187.stdout: = sunit=0 swidth=0 blks 2024-04-18T21:04:28.209 INFO:teuthology.orchestra.run.smithi187.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-18T21:04:28.209 INFO:teuthology.orchestra.run.smithi187.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-18T21:04:28.209 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-18T21:04:28.209 INFO:teuthology.orchestra.run.smithi187.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-18T21:04:28.671 INFO:teuthology.orchestra.run.smithi187.stdout:Discarding blocks...Done. 2024-04-18T21:04:28.673 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi187.front.sepia.ceph.com -o noatime 2024-04-18T21:04:28.674 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-04-18T21:04:28.808 DEBUG:teuthology.orchestra.run.smithi187:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-18T21:04:28.819 INFO:teuthology.orchestra.run.smithi187.stderr:sudo: /sbin/restorecon: command not found 2024-04-18T21:04:28.819 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T21:04:28.820 DEBUG:teuthology.orchestra.run.smithi187:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-18T21:04:28.948 INFO:teuthology.orchestra.run.smithi187.stderr:2024-04-18T21:04:28.944+0000 7fac99b8a7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-18T21:04:28.952 INFO:teuthology.orchestra.run.smithi187.stderr:2024-04-18T21:04:28.952+0000 7fac99b8a7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-18T21:04:28.952 INFO:teuthology.orchestra.run.smithi187.stderr:2024-04-18T21:04:28.952+0000 7fac99b8a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-18T21:04:28.953 INFO:teuthology.orchestra.run.smithi187.stderr:2024-04-18T21:04:28.952+0000 7fac99b8a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-18T21:04:28.953 INFO:teuthology.orchestra.run.smithi187.stderr:2024-04-18T21:04:28.952+0000 7fac99b8a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-18T21:04:28.958 INFO:teuthology.orchestra.run.smithi187.stderr:2024-04-18T21:04:28.956+0000 7fac99b8a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-18T21:04:31.931 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-18T21:04:31.945 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-18T21:04:31.945 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-04-18T21:04:31.945 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-18T21:04:31.959 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-04-18T21:04:31.959 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-18T21:04:32.015 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-04-18T21:04:32.015 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-18T21:04:32.067 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-18T21:04:32.067 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-18T21:04:32.080 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-04-18T21:04:32.081 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-18T21:04:32.095 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-04-18T21:04:32.095 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-18T21:04:32.108 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-04-18T21:04:32.108 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-18T21:04:32.114 INFO:tasks.ceph:Adding keys to all mons... 2024-04-18T21:04:32.114 DEBUG:teuthology.orchestra.run.smithi078:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-18T21:04:32.166 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr.x] 2024-04-18T21:04:32.166 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDUiiFmnTEFEhAACVUApaqZ6UayxJMzskCO6A== 2024-04-18T21:04:32.166 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr.y] 2024-04-18T21:04:32.166 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDUiiFmItwNFxAAkURZQ0e45J/nnv6SomIC8g== 2024-04-18T21:04:32.166 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.a] 2024-04-18T21:04:32.166 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDUiiFmLEPoGxAApCl0YfdJh3HHz7RKy02L7A== 2024-04-18T21:04:32.167 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.0] 2024-04-18T21:04:32.167 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDViiFmM5/JFBAAkfvUYqb6XTm8KYKM1/1bJg== 2024-04-18T21:04:32.167 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.1] 2024-04-18T21:04:32.167 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDZiiFmgDx5BxAAPweaSflgDM233ntvEhaElw== 2024-04-18T21:04:32.167 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.2] 2024-04-18T21:04:32.167 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDciiFmHGa+OBAAjHZEKNvdGScWL56Pxq70Yg== 2024-04-18T21:04:32.167 INFO:teuthology.orchestra.run.smithi078.stdout:[client.0] 2024-04-18T21:04:32.167 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDUiiFm2KGJIxAA6k8F//yHVNbUbPSkrH2v9g== 2024-04-18T21:04:32.168 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-18T21:04:32.259 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-18T21:04:32.298 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-18T21:04:32.382 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T21:04:32.467 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T21:04:32.553 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T21:04:32.633 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-18T21:04:32.721 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-18T21:04:32.721 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-18T21:04:32.732 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-18T21:04:32.844 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-18T21:04:32.854 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-18T21:04:32.909 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-18T21:04:32.999 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-18T21:04:33.053 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-18T21:04:33.105 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-18T21:04:33.198 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-18T21:04:33.210 DEBUG:teuthology.orchestra.run.smithi078:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-18T21:04:33.255 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-18T21:04:33.256 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-18T21:04:33.256 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-18T21:04:33.301 INFO:tasks.ceph.mon.a:Started 2024-04-18T21:04:33.301 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-18T21:04:33.301 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-18T21:04:33.303 INFO:tasks.ceph.mon.b:Started 2024-04-18T21:04:33.303 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-18T21:04:33.303 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-18T21:04:33.305 INFO:tasks.ceph.mon.c:Started 2024-04-18T21:04:33.305 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-18T21:04:33.305 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-18T21:04:33.305 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-18T21:04:33.307 INFO:tasks.ceph.mgr.x:Started 2024-04-18T21:04:33.307 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-18T21:04:33.308 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-18T21:04:33.310 INFO:tasks.ceph.mgr.y:Started 2024-04-18T21:04:33.310 INFO:tasks.ceph:Setting crush tunables to default 2024-04-18T21:04:33.310 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd crush tunables default 2024-04-18T21:04:43.627 INFO:teuthology.orchestra.run.smithi078.stderr:adjusted tunables profile to default 2024-04-18T21:04:43.647 INFO:tasks.ceph:check_enable_crimson: False 2024-04-18T21:04:43.647 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-18T21:04:43.648 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-18T21:04:43.648 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-18T21:04:43.662 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-04-18T21:04:43.662 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-18T21:04:43.676 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-04-18T21:04:43.676 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-18T21:04:43.690 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 1854d737-3a67-416a-8c88-0f126505a0f2 0 2024-04-18T21:04:43.936 INFO:teuthology.orchestra.run.smithi187.stdout:0 2024-04-18T21:04:43.953 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new dfeae661-3f8a-4d41-b287-7eb02c16b91a 1 2024-04-18T21:04:44.044 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-04-18T21:04:44.044+0000 7ffbb3b7f180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-18T21:04:44.044 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-04-18T21:04:44.044+0000 7fbe5b521180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-18T21:04:44.174 INFO:teuthology.orchestra.run.smithi187.stdout:1 2024-04-18T21:04:44.194 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 56a34021-e2dc-41ff-822c-7ec123466f25 2 2024-04-18T21:04:44.409 INFO:teuthology.orchestra.run.smithi187.stdout:2 2024-04-18T21:04:44.427 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-18T21:04:44.427 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-18T21:04:44.429 INFO:tasks.ceph.osd.0:Started 2024-04-18T21:04:44.429 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-18T21:04:44.429 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-18T21:04:44.432 INFO:tasks.ceph.osd.1:Started 2024-04-18T21:04:44.432 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-18T21:04:44.432 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-18T21:04:44.434 INFO:tasks.ceph.osd.2:Started 2024-04-18T21:04:44.434 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T21:04:44.511 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-04-18T21:04:44.512+0000 7fbe5b521180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-18T21:04:44.515 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-04-18T21:04:44.512+0000 7ffbb3b7f180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-18T21:04:44.619 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:04:44.619 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":5,"fsid":"dc017990-0393-4ab0-b604-5e7052fdc7bd","created":"2024-04-18T21:04:43.507538+0000","modified":"2024-04-18T21:04:44.402191+0000","last_up_change":"0.000000","last_in_change":"2024-04-18T21:04:44.402191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1854d737-3a67-416a-8c88-0f126505a0f2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"dfeae661-3f8a-4d41-b287-7eb02c16b91a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"56a34021-e2dc-41ff-822c-7ec123466f25","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T21:04:44.636 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-18T21:04:44.636 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-18T21:04:44.695 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-04-18T21:04:44.692+0000 7fbe5b521180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-18T21:04:44.696 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-04-18T21:04:44.692+0000 7ffbb3b7f180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-18T21:04:44.938 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-18T21:04:45.042 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:04:45.040+0000 7f35d5c327c0 -1 Falling back to public interface 2024-04-18T21:04:45.067 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:04:45.068+0000 7f9431e5a7c0 -1 Falling back to public interface 2024-04-18T21:04:45.118 INFO:teuthology.misc.health.smithi078.stdout: 2024-04-18T21:04:45.118 INFO:teuthology.misc.health.smithi078.stdout:{"epoch":5,"fsid":"dc017990-0393-4ab0-b604-5e7052fdc7bd","created":"2024-04-18T21:04:43.507538+0000","modified":"2024-04-18T21:04:44.402191+0000","last_up_change":"0.000000","last_in_change":"2024-04-18T21:04:44.402191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1854d737-3a67-416a-8c88-0f126505a0f2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"dfeae661-3f8a-4d41-b287-7eb02c16b91a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"56a34021-e2dc-41ff-822c-7ec123466f25","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T21:04:45.135 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-04-18T21:04:45.148 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:04:45.148+0000 7f11d94137c0 -1 Falling back to public interface 2024-04-18T21:04:45.255 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-04-18T21:04:45.252+0000 7ffbb3b7f180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-18T21:04:45.256 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-04-18T21:04:45.256+0000 7fbe5b521180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-18T21:04:45.310 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-04-18T21:04:45.308+0000 7fbe5b521180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-18T21:04:45.310 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-04-18T21:04:45.308+0000 7ffbb3b7f180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-18T21:04:45.363 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-04-18T21:04:45.360+0000 7fbe5b521180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-18T21:04:45.363 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-04-18T21:04:45.360+0000 7ffbb3b7f180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-18T21:04:45.442 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-04-18T21:04:45.440+0000 7ffbb3b7f180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-18T21:04:45.442 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-04-18T21:04:45.440+0000 7fbe5b521180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-18T21:04:45.495 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-04-18T21:04:45.492+0000 7ffbb3b7f180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-18T21:04:45.495 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-04-18T21:04:45.492+0000 7fbe5b521180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-18T21:04:45.574 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-04-18T21:04:45.572+0000 7fbe5b521180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-18T21:04:45.575 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-04-18T21:04:45.572+0000 7ffbb3b7f180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-18T21:04:45.628 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-04-18T21:04:45.628+0000 7ffbb3b7f180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-18T21:04:45.629 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-04-18T21:04:45.628+0000 7fbe5b521180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-18T21:04:45.780 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-04-18T21:04:45.780+0000 7fbe5b521180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-18T21:04:45.780 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-04-18T21:04:45.780+0000 7ffbb3b7f180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-18T21:04:45.843 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-04-18T21:04:45.840+0000 7ffbb3b7f180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-18T21:04:45.843 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-04-18T21:04:45.840+0000 7fbe5b521180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-18T21:04:46.589 INFO:tasks.ceph.mgr.x.smithi078.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-18T21:04:46.590 INFO:tasks.ceph.mgr.x.smithi078.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-18T21:04:46.590 INFO:tasks.ceph.mgr.x.smithi078.stderr: from numpy import show_config as show_numpy_config 2024-04-18T21:04:46.590 INFO:tasks.ceph.mgr.y.smithi078.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-18T21:04:46.590 INFO:tasks.ceph.mgr.y.smithi078.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-18T21:04:46.590 INFO:tasks.ceph.mgr.y.smithi078.stderr: from numpy import show_config as show_numpy_config 2024-04-18T21:04:46.646 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-04-18T21:04:46.644+0000 7ffbb3b7f180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-18T21:04:46.646 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-04-18T21:04:46.644+0000 7fbe5b521180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-18T21:04:46.805 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-04-18T21:04:46.804+0000 7ffbb3b7f180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-18T21:04:46.811 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-04-18T21:04:46.808+0000 7fbe5b521180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-18T21:04:46.965 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-04-18T21:04:46.964+0000 7ffbb3b7f180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-18T21:04:46.966 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-04-18T21:04:46.964+0000 7fbe5b521180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-18T21:04:47.029 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-04-18T21:04:47.028+0000 7ffbb3b7f180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-18T21:04:47.032 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-04-18T21:04:47.032+0000 7fbe5b521180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-18T21:04:47.164 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-04-18T21:04:47.164+0000 7ffbb3b7f180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-18T21:04:47.174 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-04-18T21:04:47.172+0000 7fbe5b521180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-18T21:04:47.792 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-04-18T21:04:47.792+0000 7ffbb3b7f180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-18T21:04:47.792 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-04-18T21:04:47.792+0000 7fbe5b521180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-18T21:04:47.868 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-04-18T21:04:47.868+0000 7ffbb3b7f180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-18T21:04:47.868 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-04-18T21:04:47.868+0000 7fbe5b521180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-18T21:04:48.052 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-04-18T21:04:48.048+0000 7ffbb3b7f180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-18T21:04:48.052 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-04-18T21:04:48.052+0000 7fbe5b521180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-18T21:04:48.126 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-04-18T21:04:48.124+0000 7ffbb3b7f180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-18T21:04:48.127 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-04-18T21:04:48.124+0000 7fbe5b521180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-18T21:04:48.416 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-04-18T21:04:48.416+0000 7ffbb3b7f180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-18T21:04:48.416 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-04-18T21:04:48.416+0000 7fbe5b521180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-18T21:04:48.479 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-04-18T21:04:48.476+0000 7ffbb3b7f180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-18T21:04:48.479 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-04-18T21:04:48.476+0000 7fbe5b521180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-18T21:04:48.714 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:04:48.712+0000 7f35d5c327c0 -1 osd.2 0 log_to_monitors true 2024-04-18T21:04:48.746 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:04:48.748+0000 7f9431e5a7c0 -1 osd.1 0 log_to_monitors true 2024-04-18T21:04:48.790 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:04:48.792+0000 7f11d94137c0 -1 osd.0 0 log_to_monitors true 2024-04-18T21:04:49.514 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-04-18T21:04:49.512+0000 7fbe02969640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-18T21:04:49.515 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-04-18T21:04:49.512+0000 7fbe02969640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-18T21:04:51.438 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-18T21:04:51.485 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:04:51.484+0000 7f11d53bc640 -1 osd.0 0 waiting for initial osdmap 2024-04-18T21:04:51.503 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:04:51.504+0000 7f11cd1f0640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T21:04:51.585 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:04:51.588+0000 7f942e615640 -1 osd.1 0 waiting for initial osdmap 2024-04-18T21:04:51.618 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:04:51.620+0000 7f9425c37640 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T21:04:51.622 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:04:51.620+0000 7f35d23ed640 -1 osd.2 0 waiting for initial osdmap 2024-04-18T21:04:51.642 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:04:51.640+0000 7f35c9a0f640 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T21:04:51.742 INFO:teuthology.misc.health.smithi078.stdout: 2024-04-18T21:04:51.742 INFO:teuthology.misc.health.smithi078.stdout:{"epoch":7,"fsid":"dc017990-0393-4ab0-b604-5e7052fdc7bd","created":"2024-04-18T21:04:43.507538+0000","modified":"2024-04-18T21:04:50.563166+0000","last_up_change":"0.000000","last_in_change":"2024-04-18T21:04:44.402191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1854d737-3a67-416a-8c88-0f126505a0f2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"dfeae661-3f8a-4d41-b287-7eb02c16b91a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"56a34021-e2dc-41ff-822c-7ec123466f25","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T21:04:51.759 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-04-18T21:04:58.063 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-18T21:04:58.354 INFO:teuthology.misc.health.smithi078.stdout: 2024-04-18T21:04:58.355 INFO:teuthology.misc.health.smithi078.stdout:{"epoch":11,"fsid":"dc017990-0393-4ab0-b604-5e7052fdc7bd","created":"2024-04-18T21:04:43.507538+0000","modified":"2024-04-18T21:04:55.501782+0000","last_up_change":"2024-04-18T21:04:52.492503+0000","last_in_change":"2024-04-18T21:04:44.402191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T21:04:52.538153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1854d737-3a67-416a-8c88-0f126505a0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6801","nonce":1948809768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6803","nonce":1948809768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6807","nonce":1948809768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6805","nonce":1948809768}]},"public_addr":"172.21.15.132:6801/1948809768","cluster_addr":"172.21.15.132:6803/1948809768","heartbeat_back_addr":"172.21.15.132:6807/1948809768","heartbeat_front_addr":"172.21.15.132:6805/1948809768","state":["exists","up"]},{"osd":1,"uuid":"dfeae661-3f8a-4d41-b287-7eb02c16b91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":2040503167},{"type":"v1","addr":"172.21.15.150:6801","nonce":2040503167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":2040503167},{"type":"v1","addr":"172.21.15.150:6803","nonce":2040503167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":2040503167},{"type":"v1","addr":"172.21.15.150:6807","nonce":2040503167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":2040503167},{"type":"v1","addr":"172.21.15.150:6805","nonce":2040503167}]},"public_addr":"172.21.15.150:6801/2040503167","cluster_addr":"172.21.15.150:6803/2040503167","heartbeat_back_addr":"172.21.15.150:6807/2040503167","heartbeat_front_addr":"172.21.15.150:6805/2040503167","state":["exists","up"]},{"osd":2,"uuid":"56a34021-e2dc-41ff-822c-7ec123466f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6801","nonce":429896900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6803","nonce":429896900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6807","nonce":429896900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6805","nonce":429896900}]},"public_addr":"172.21.15.187:6801/429896900","cluster_addr":"172.21.15.187:6803/429896900","heartbeat_back_addr":"172.21.15.187:6807/429896900","heartbeat_front_addr":"172.21.15.187:6805/429896900","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:49.804359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:49.790978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:49.762943+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T21:04:58.372 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-04-18T21:04:58.372 INFO:tasks.ceph:Creating RBD pool 2024-04-18T21:04:58.372 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-18T21:04:59.559 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'rbd' created 2024-04-18T21:04:59.581 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-18T21:05:00.566 INFO:teuthology.orchestra.run.smithi078.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-18T21:05:00.589 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-18T21:05:00.589 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-18T21:05:00.589 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-18T21:05:00.591 INFO:tasks.ceph.mds.a:Started 2024-04-18T21:05:00.591 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-18T21:05:00.592 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T21:05:00.748 INFO:tasks.ceph.mds.a.smithi078.stdout:starting mds.a at 2024-04-18T21:05:00.883 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:05:00.883 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":13,"fsid":"dc017990-0393-4ab0-b604-5e7052fdc7bd","created":"2024-04-18T21:04:43.507538+0000","modified":"2024-04-18T21:05:00.562794+0000","last_up_change":"2024-04-18T21:04:52.492503+0000","last_in_change":"2024-04-18T21:04:44.402191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T21:04:52.538153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T21:04:58.673793+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1854d737-3a67-416a-8c88-0f126505a0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6801","nonce":1948809768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6803","nonce":1948809768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6807","nonce":1948809768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6805","nonce":1948809768}]},"public_addr":"172.21.15.132:6801/1948809768","cluster_addr":"172.21.15.132:6803/1948809768","heartbeat_back_addr":"172.21.15.132:6807/1948809768","heartbeat_front_addr":"172.21.15.132:6805/1948809768","state":["exists","up"]},{"osd":1,"uuid":"dfeae661-3f8a-4d41-b287-7eb02c16b91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":2040503167},{"type":"v1","addr":"172.21.15.150:6801","nonce":2040503167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":2040503167},{"type":"v1","addr":"172.21.15.150:6803","nonce":2040503167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":2040503167},{"type":"v1","addr":"172.21.15.150:6807","nonce":2040503167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":2040503167},{"type":"v1","addr":"172.21.15.150:6805","nonce":2040503167}]},"public_addr":"172.21.15.150:6801/2040503167","cluster_addr":"172.21.15.150:6803/2040503167","heartbeat_back_addr":"172.21.15.150:6807/2040503167","heartbeat_front_addr":"172.21.15.150:6805/2040503167","state":["exists","up"]},{"osd":2,"uuid":"56a34021-e2dc-41ff-822c-7ec123466f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6801","nonce":429896900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6803","nonce":429896900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6807","nonce":429896900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6805","nonce":429896900}]},"public_addr":"172.21.15.187:6801/429896900","cluster_addr":"172.21.15.187:6803/429896900","heartbeat_back_addr":"172.21.15.187:6807/429896900","heartbeat_front_addr":"172.21.15.187:6805/429896900","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:49.804359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:49.790978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:49.762943+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T21:05:00.900 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T21:04:52.538153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-18T21:04:58.673793+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-18T21:05:00.900 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T21:05:01.196 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2024-04-18T21:05:01.215 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-18T21:05:01.501 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2024-04-18T21:05:01.518 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T21:05:01.829 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:05:01.829 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4202,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6803/1197504751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1197504751},{"type":"v1","addr":"172.21.15.78:6803","nonce":1197504751}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-18T21:05:01.829 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 2 2024-04-18T21:05:01.846 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T21:05:02.126 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:05:02.126 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":14,"fsid":"dc017990-0393-4ab0-b604-5e7052fdc7bd","created":"2024-04-18T21:04:43.507538+0000","modified":"2024-04-18T21:05:01.572081+0000","last_up_change":"2024-04-18T21:04:52.492503+0000","last_in_change":"2024-04-18T21:04:44.402191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T21:04:52.538153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T21:04:58.673793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1854d737-3a67-416a-8c88-0f126505a0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6801","nonce":1948809768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6803","nonce":1948809768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6807","nonce":1948809768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6805","nonce":1948809768}]},"public_addr":"172.21.15.132:6801/1948809768","cluster_addr":"172.21.15.132:6803/1948809768","heartbeat_back_addr":"172.21.15.132:6807/1948809768","heartbeat_front_addr":"172.21.15.132:6805/1948809768","state":["exists","up"]},{"osd":1,"uuid":"dfeae661-3f8a-4d41-b287-7eb02c16b91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":2040503167},{"type":"v1","addr":"172.21.15.150:6801","nonce":2040503167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":2040503167},{"type":"v1","addr":"172.21.15.150:6803","nonce":2040503167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":2040503167},{"type":"v1","addr":"172.21.15.150:6807","nonce":2040503167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":2040503167},{"type":"v1","addr":"172.21.15.150:6805","nonce":2040503167}]},"public_addr":"172.21.15.150:6801/2040503167","cluster_addr":"172.21.15.150:6803/2040503167","heartbeat_back_addr":"172.21.15.150:6807/2040503167","heartbeat_front_addr":"172.21.15.150:6805/2040503167","state":["exists","up"]},{"osd":2,"uuid":"56a34021-e2dc-41ff-822c-7ec123466f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6801","nonce":429896900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6803","nonce":429896900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6807","nonce":429896900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6805","nonce":429896900}]},"public_addr":"172.21.15.187:6801/429896900","cluster_addr":"172.21.15.187:6803/429896900","heartbeat_back_addr":"172.21.15.187:6807/429896900","heartbeat_front_addr":"172.21.15.187:6805/429896900","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:49.804359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:49.790978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:49.762943+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T21:05:02.143 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T21:04:52.538153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-18T21:04:58.673793+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-18T21:05:02.144 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T21:05:02.412 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2024-04-18T21:05:02.430 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-18T21:05:02.711 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2024-04-18T21:05:02.728 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-18T21:05:03.012 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:05:03.012 INFO:teuthology.orchestra.run.smithi078.stdout:[ 2024-04-18T21:05:03.012 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:03.012 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 1, 2024-04-18T21:05:03.012 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": ".mgr" 2024-04-18T21:05:03.012 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:03.012 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:03.012 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 2, 2024-04-18T21:05:03.012 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": "rbd" 2024-04-18T21:05:03.012 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:03.012 INFO:teuthology.orchestra.run.smithi078.stdout:] 2024-04-18T21:05:03.029 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-18T21:05:03.029 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-18T21:05:03.595 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' created 2024-04-18T21:05:03.619 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-18T21:05:04.611 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' created 2024-04-18T21:05:04.635 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-18T21:05:05.603 INFO:teuthology.orchestra.run.smithi078.stderr:new fs with metadata pool 3 and data pool 4 2024-04-18T21:05:05.630 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T21:05:05.912 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:05:05.912 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":17,"fsid":"dc017990-0393-4ab0-b604-5e7052fdc7bd","created":"2024-04-18T21:04:43.507538+0000","modified":"2024-04-18T21:05:04.973776+0000","last_up_change":"2024-04-18T21:04:52.492503+0000","last_in_change":"2024-04-18T21:04:44.402191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T21:04:52.538153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T21:04:58.673793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T21:05:03.314171+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T21:05:03.931699+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1854d737-3a67-416a-8c88-0f126505a0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6801","nonce":1948809768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6803","nonce":1948809768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6807","nonce":1948809768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6805","nonce":1948809768}]},"public_addr":"172.21.15.132:6801/1948809768","cluster_addr":"172.21.15.132:6803/1948809768","heartbeat_back_addr":"172.21.15.132:6807/1948809768","heartbeat_front_addr":"172.21.15.132:6805/1948809768","state":["exists","up"]},{"osd":1,"uuid":"dfeae661-3f8a-4d41-b287-7eb02c16b91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":2040503167},{"type":"v1","addr":"172.21.15.150:6801","nonce":2040503167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":2040503167},{"type":"v1","addr":"172.21.15.150:6803","nonce":2040503167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":2040503167},{"type":"v1","addr":"172.21.15.150:6807","nonce":2040503167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":2040503167},{"type":"v1","addr":"172.21.15.150:6805","nonce":2040503167}]},"public_addr":"172.21.15.150:6801/2040503167","cluster_addr":"172.21.15.150:6803/2040503167","heartbeat_back_addr":"172.21.15.150:6807/2040503167","heartbeat_front_addr":"172.21.15.150:6805/2040503167","state":["exists","up"]},{"osd":2,"uuid":"56a34021-e2dc-41ff-822c-7ec123466f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6801","nonce":429896900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6803","nonce":429896900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6807","nonce":429896900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6805","nonce":429896900}]},"public_addr":"172.21.15.187:6801/429896900","cluster_addr":"172.21.15.187:6803/429896900","heartbeat_back_addr":"172.21.15.187:6807/429896900","heartbeat_front_addr":"172.21.15.187:6805/429896900","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:49.804359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:49.790978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:49.762943+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T21:05:05.929 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T21:05:06.219 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:05:06.219 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":17,"fsid":"dc017990-0393-4ab0-b604-5e7052fdc7bd","created":"2024-04-18T21:04:43.507538+0000","modified":"2024-04-18T21:05:04.973776+0000","last_up_change":"2024-04-18T21:04:52.492503+0000","last_in_change":"2024-04-18T21:04:44.402191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T21:04:52.538153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T21:04:58.673793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T21:05:03.314171+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T21:05:03.931699+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1854d737-3a67-416a-8c88-0f126505a0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6801","nonce":1948809768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6803","nonce":1948809768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6807","nonce":1948809768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6805","nonce":1948809768}]},"public_addr":"172.21.15.132:6801/1948809768","cluster_addr":"172.21.15.132:6803/1948809768","heartbeat_back_addr":"172.21.15.132:6807/1948809768","heartbeat_front_addr":"172.21.15.132:6805/1948809768","state":["exists","up"]},{"osd":1,"uuid":"dfeae661-3f8a-4d41-b287-7eb02c16b91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":2040503167},{"type":"v1","addr":"172.21.15.150:6801","nonce":2040503167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":2040503167},{"type":"v1","addr":"172.21.15.150:6803","nonce":2040503167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":2040503167},{"type":"v1","addr":"172.21.15.150:6807","nonce":2040503167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":2040503167},{"type":"v1","addr":"172.21.15.150:6805","nonce":2040503167}]},"public_addr":"172.21.15.150:6801/2040503167","cluster_addr":"172.21.15.150:6803/2040503167","heartbeat_back_addr":"172.21.15.150:6807/2040503167","heartbeat_front_addr":"172.21.15.150:6805/2040503167","state":["exists","up"]},{"osd":2,"uuid":"56a34021-e2dc-41ff-822c-7ec123466f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6801","nonce":429896900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6803","nonce":429896900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6807","nonce":429896900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6805","nonce":429896900}]},"public_addr":"172.21.15.187:6801/429896900","cluster_addr":"172.21.15.187:6803/429896900","heartbeat_back_addr":"172.21.15.187:6807/429896900","heartbeat_front_addr":"172.21.15.187:6805/429896900","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:49.804359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:49.790978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:49.762943+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T21:05:06.236 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-18T21:05:06.648 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-18T21:05:06.649 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-18T21:05:07.656 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-18T21:05:07.657 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T21:05:07.989 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:05:07.989 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T21:05:04.973678+0000","modified":"2024-04-18T21:05:06.980882+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4202},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4202":{"gid":4202,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6803/1197504751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1197504751},{"type":"v1","addr":"172.21.15.78:6803","nonce":1197504751}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4202,"qdb_cluster":[4202]},"id":1}]} 2024-04-18T21:05:07.989 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 5 2024-04-18T21:05:08.007 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T21:05:08.279 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:05:08.279 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":18,"fsid":"dc017990-0393-4ab0-b604-5e7052fdc7bd","created":"2024-04-18T21:04:43.507538+0000","modified":"2024-04-18T21:05:06.615695+0000","last_up_change":"2024-04-18T21:04:52.492503+0000","last_in_change":"2024-04-18T21:04:44.402191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T21:04:52.538153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T21:04:58.673793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T21:05:03.314171+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T21:05:03.931699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1854d737-3a67-416a-8c88-0f126505a0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6801","nonce":1948809768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6803","nonce":1948809768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6807","nonce":1948809768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6805","nonce":1948809768}]},"public_addr":"172.21.15.132:6801/1948809768","cluster_addr":"172.21.15.132:6803/1948809768","heartbeat_back_addr":"172.21.15.132:6807/1948809768","heartbeat_front_addr":"172.21.15.132:6805/1948809768","state":["exists","up"]},{"osd":1,"uuid":"dfeae661-3f8a-4d41-b287-7eb02c16b91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":2040503167},{"type":"v1","addr":"172.21.15.150:6801","nonce":2040503167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":2040503167},{"type":"v1","addr":"172.21.15.150:6803","nonce":2040503167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":2040503167},{"type":"v1","addr":"172.21.15.150:6807","nonce":2040503167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":2040503167},{"type":"v1","addr":"172.21.15.150:6805","nonce":2040503167}]},"public_addr":"172.21.15.150:6801/2040503167","cluster_addr":"172.21.15.150:6803/2040503167","heartbeat_back_addr":"172.21.15.150:6807/2040503167","heartbeat_front_addr":"172.21.15.150:6805/2040503167","state":["exists","up"]},{"osd":2,"uuid":"56a34021-e2dc-41ff-822c-7ec123466f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6801","nonce":429896900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6803","nonce":429896900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6807","nonce":429896900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6805","nonce":429896900}]},"public_addr":"172.21.15.187:6801/429896900","cluster_addr":"172.21.15.187:6803/429896900","heartbeat_back_addr":"172.21.15.187:6807/429896900","heartbeat_front_addr":"172.21.15.187:6805/429896900","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:49.804359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:49.790978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:49.762943+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T21:05:08.296 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-18T21:05:08.296 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:05:08.583 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:05:08.585 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-04-18T21:05:08.601 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-18T21:05:08.503095+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":247,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":125,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91056,"kb_used_data":1672,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024464,"statfs":{"total":289910292480,"available":289817051136,"internally_reserved":0,"allocated":1712128,"data_stored":1346289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.906378"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637590+0000","last_change":"2024-04-18T21:05:05.652795+0000","last_active":"2024-04-18T21:05:06.637590+0000","last_peered":"2024-04-18T21:05:06.637590+0000","last_clean":"2024-04-18T21:05:06.637590+0000","last_became_active":"2024-04-18T21:05:05.650121+0000","last_became_peered":"2024-04-18T21:05:05.650121+0000","last_unstale":"2024-04-18T21:05:06.637590+0000","last_undegraded":"2024-04-18T21:05:06.637590+0000","last_fullsized":"2024-04-18T21:05:06.637590+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637298+0000","last_change":"2024-04-18T21:05:05.657531+0000","last_active":"2024-04-18T21:05:06.637298+0000","last_peered":"2024-04-18T21:05:06.637298+0000","last_clean":"2024-04-18T21:05:06.637298+0000","last_became_active":"2024-04-18T21:05:05.653101+0000","last_became_peered":"2024-04-18T21:05:05.653101+0000","last_unstale":"2024-04-18T21:05:06.637298+0000","last_undegraded":"2024-04-18T21:05:06.637298+0000","last_fullsized":"2024-04-18T21:05:06.637298+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:32:23.929877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636411+0000","last_change":"2024-04-18T21:05:05.647965+0000","last_active":"2024-04-18T21:05:06.636411+0000","last_peered":"2024-04-18T21:05:06.636411+0000","last_clean":"2024-04-18T21:05:06.636411+0000","last_became_active":"2024-04-18T21:05:05.645931+0000","last_became_peered":"2024-04-18T21:05:05.645931+0000","last_unstale":"2024-04-18T21:05:06.636411+0000","last_undegraded":"2024-04-18T21:05:06.636411+0000","last_fullsized":"2024-04-18T21:05:06.636411+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:04.350492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637673+0000","last_change":"2024-04-18T21:05:05.629321+0000","last_active":"2024-04-18T21:05:06.637673+0000","last_peered":"2024-04-18T21:05:06.637673+0000","last_clean":"2024-04-18T21:05:06.637673+0000","last_became_active":"2024-04-18T21:05:05.627956+0000","last_became_peered":"2024-04-18T21:05:05.627956+0000","last_unstale":"2024-04-18T21:05:06.637673+0000","last_undegraded":"2024-04-18T21:05:06.637673+0000","last_fullsized":"2024-04-18T21:05:06.637673+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:15:28.458476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636510+0000","last_change":"2024-04-18T21:05:05.648710+0000","last_active":"2024-04-18T21:05:06.636510+0000","last_peered":"2024-04-18T21:05:06.636510+0000","last_clean":"2024-04-18T21:05:06.636510+0000","last_became_active":"2024-04-18T21:05:05.647801+0000","last_became_peered":"2024-04-18T21:05:05.647801+0000","last_unstale":"2024-04-18T21:05:06.636510+0000","last_undegraded":"2024-04-18T21:05:06.636510+0000","last_fullsized":"2024-04-18T21:05:06.636510+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:46:36.339289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635784+0000","last_change":"2024-04-18T21:05:05.629095+0000","last_active":"2024-04-18T21:05:06.635784+0000","last_peered":"2024-04-18T21:05:06.635784+0000","last_clean":"2024-04-18T21:05:06.635784+0000","last_became_active":"2024-04-18T21:05:05.627664+0000","last_became_peered":"2024-04-18T21:05:05.627664+0000","last_unstale":"2024-04-18T21:05:06.635784+0000","last_undegraded":"2024-04-18T21:05:06.635784+0000","last_fullsized":"2024-04-18T21:05:06.635784+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:51:28.440070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635525+0000","last_change":"2024-04-18T21:05:05.625047+0000","last_active":"2024-04-18T21:05:06.635525+0000","last_peered":"2024-04-18T21:05:06.635525+0000","last_clean":"2024-04-18T21:05:06.635525+0000","last_became_active":"2024-04-18T21:05:05.622781+0000","last_became_peered":"2024-04-18T21:05:05.622781+0000","last_unstale":"2024-04-18T21:05:06.635525+0000","last_undegraded":"2024-04-18T21:05:06.635525+0000","last_fullsized":"2024-04-18T21:05:06.635525+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:12.944469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.634795+0000","last_change":"2024-04-18T21:05:05.640390+0000","last_active":"2024-04-18T21:05:06.634795+0000","last_peered":"2024-04-18T21:05:06.634795+0000","last_clean":"2024-04-18T21:05:06.634795+0000","last_became_active":"2024-04-18T21:05:05.638295+0000","last_became_peered":"2024-04-18T21:05:05.638295+0000","last_unstale":"2024-04-18T21:05:06.634795+0000","last_undegraded":"2024-04-18T21:05:06.634795+0000","last_fullsized":"2024-04-18T21:05:06.634795+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:34:31.132458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359217+0000","last_change":"2024-04-18T21:05:05.660752+0000","last_active":"2024-04-18T21:05:07.359217+0000","last_peered":"2024-04-18T21:05:07.359217+0000","last_clean":"2024-04-18T21:05:07.359217+0000","last_became_active":"2024-04-18T21:05:05.659226+0000","last_became_peered":"2024-04-18T21:05:05.659226+0000","last_unstale":"2024-04-18T21:05:07.359217+0000","last_undegraded":"2024-04-18T21:05:07.359217+0000","last_fullsized":"2024-04-18T21:05:07.359217+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:20:45.938503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637371+0000","last_change":"2024-04-18T21:05:05.656660+0000","last_active":"2024-04-18T21:05:06.637371+0000","last_peered":"2024-04-18T21:05:06.637371+0000","last_clean":"2024-04-18T21:05:06.637371+0000","last_became_active":"2024-04-18T21:05:05.653829+0000","last_became_peered":"2024-04-18T21:05:05.653829+0000","last_unstale":"2024-04-18T21:05:06.637371+0000","last_undegraded":"2024-04-18T21:05:06.637371+0000","last_fullsized":"2024-04-18T21:05:06.637371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:50:40.920146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636818+0000","last_change":"2024-04-18T21:05:05.646721+0000","last_active":"2024-04-18T21:05:06.636818+0000","last_peered":"2024-04-18T21:05:06.636818+0000","last_clean":"2024-04-18T21:05:06.636818+0000","last_became_active":"2024-04-18T21:05:05.643421+0000","last_became_peered":"2024-04-18T21:05:05.643421+0000","last_unstale":"2024-04-18T21:05:06.636818+0000","last_undegraded":"2024-04-18T21:05:06.636818+0000","last_fullsized":"2024-04-18T21:05:06.636818+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:14:51.873741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636882+0000","last_change":"2024-04-18T21:05:05.656320+0000","last_active":"2024-04-18T21:05:06.636882+0000","last_peered":"2024-04-18T21:05:06.636882+0000","last_clean":"2024-04-18T21:05:06.636882+0000","last_became_active":"2024-04-18T21:05:05.655508+0000","last_became_peered":"2024-04-18T21:05:05.655508+0000","last_unstale":"2024-04-18T21:05:06.636882+0000","last_undegraded":"2024-04-18T21:05:06.636882+0000","last_fullsized":"2024-04-18T21:05:06.636882+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:51.225379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636068+0000","last_change":"2024-04-18T21:05:05.649001+0000","last_active":"2024-04-18T21:05:06.636068+0000","last_peered":"2024-04-18T21:05:06.636068+0000","last_clean":"2024-04-18T21:05:06.636068+0000","last_became_active":"2024-04-18T21:05:05.648070+0000","last_became_peered":"2024-04-18T21:05:05.648070+0000","last_unstale":"2024-04-18T21:05:06.636068+0000","last_undegraded":"2024-04-18T21:05:06.636068+0000","last_fullsized":"2024-04-18T21:05:06.636068+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:56.408234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636128+0000","last_change":"2024-04-18T21:05:05.635880+0000","last_active":"2024-04-18T21:05:06.636128+0000","last_peered":"2024-04-18T21:05:06.636128+0000","last_clean":"2024-04-18T21:05:06.636128+0000","last_became_active":"2024-04-18T21:05:05.635089+0000","last_became_peered":"2024-04-18T21:05:05.635089+0000","last_unstale":"2024-04-18T21:05:06.636128+0000","last_undegraded":"2024-04-18T21:05:06.636128+0000","last_fullsized":"2024-04-18T21:05:06.636128+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:50:40.920146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635604+0000","last_change":"2024-04-18T21:05:05.639640+0000","last_active":"2024-04-18T21:05:06.635604+0000","last_peered":"2024-04-18T21:05:06.635604+0000","last_clean":"2024-04-18T21:05:06.635604+0000","last_became_active":"2024-04-18T21:05:05.637311+0000","last_became_peered":"2024-04-18T21:05:05.637311+0000","last_unstale":"2024-04-18T21:05:06.635604+0000","last_undegraded":"2024-04-18T21:05:06.635604+0000","last_fullsized":"2024-04-18T21:05:06.635604+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:20:45.938503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.634796+0000","last_change":"2024-04-18T21:05:05.638203+0000","last_active":"2024-04-18T21:05:06.634796+0000","last_peered":"2024-04-18T21:05:06.634796+0000","last_clean":"2024-04-18T21:05:06.634796+0000","last_became_active":"2024-04-18T21:05:05.637352+0000","last_became_peered":"2024-04-18T21:05:05.637352+0000","last_unstale":"2024-04-18T21:05:06.634796+0000","last_undegraded":"2024-04-18T21:05:06.634796+0000","last_fullsized":"2024-04-18T21:05:06.634796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.360278+0000","last_change":"2024-04-18T21:05:05.661613+0000","last_active":"2024-04-18T21:05:07.360278+0000","last_peered":"2024-04-18T21:05:07.360278+0000","last_clean":"2024-04-18T21:05:07.360278+0000","last_became_active":"2024-04-18T21:05:05.660496+0000","last_became_peered":"2024-04-18T21:05:05.660496+0000","last_unstale":"2024-04-18T21:05:07.360278+0000","last_undegraded":"2024-04-18T21:05:07.360278+0000","last_fullsized":"2024-04-18T21:05:07.360278+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:31:31.842528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637954+0000","last_change":"2024-04-18T21:05:05.655261+0000","last_active":"2024-04-18T21:05:06.637954+0000","last_peered":"2024-04-18T21:05:06.637954+0000","last_clean":"2024-04-18T21:05:06.637954+0000","last_became_active":"2024-04-18T21:05:05.651388+0000","last_became_peered":"2024-04-18T21:05:05.651388+0000","last_unstale":"2024-04-18T21:05:06.637954+0000","last_undegraded":"2024-04-18T21:05:06.637954+0000","last_fullsized":"2024-04-18T21:05:06.637954+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:53.850184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359241+0000","last_change":"2024-04-18T21:05:05.652710+0000","last_active":"2024-04-18T21:05:07.359241+0000","last_peered":"2024-04-18T21:05:07.359241+0000","last_clean":"2024-04-18T21:05:07.359241+0000","last_became_active":"2024-04-18T21:05:05.651929+0000","last_became_peered":"2024-04-18T21:05:05.651929+0000","last_unstale":"2024-04-18T21:05:07.359241+0000","last_undegraded":"2024-04-18T21:05:07.359241+0000","last_fullsized":"2024-04-18T21:05:07.359241+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:12.944469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636438+0000","last_change":"2024-04-18T21:05:05.638338+0000","last_active":"2024-04-18T21:05:06.636438+0000","last_peered":"2024-04-18T21:05:06.636438+0000","last_clean":"2024-04-18T21:05:06.636438+0000","last_became_active":"2024-04-18T21:05:05.637567+0000","last_became_peered":"2024-04-18T21:05:05.637567+0000","last_unstale":"2024-04-18T21:05:06.636438+0000","last_undegraded":"2024-04-18T21:05:06.636438+0000","last_fullsized":"2024-04-18T21:05:06.636438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637117+0000","last_change":"2024-04-18T21:05:05.643606+0000","last_active":"2024-04-18T21:05:06.637117+0000","last_peered":"2024-04-18T21:05:06.637117+0000","last_clean":"2024-04-18T21:05:06.637117+0000","last_became_active":"2024-04-18T21:05:05.642991+0000","last_became_peered":"2024-04-18T21:05:05.642991+0000","last_unstale":"2024-04-18T21:05:06.637117+0000","last_undegraded":"2024-04-18T21:05:06.637117+0000","last_fullsized":"2024-04-18T21:05:06.637117+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:01.841786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636035+0000","last_change":"2024-04-18T21:05:05.650896+0000","last_active":"2024-04-18T21:05:06.636035+0000","last_peered":"2024-04-18T21:05:06.636035+0000","last_clean":"2024-04-18T21:05:06.636035+0000","last_became_active":"2024-04-18T21:05:05.650083+0000","last_became_peered":"2024-04-18T21:05:05.650083+0000","last_unstale":"2024-04-18T21:05:06.636035+0000","last_undegraded":"2024-04-18T21:05:06.636035+0000","last_fullsized":"2024-04-18T21:05:06.636035+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:43:55.788425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.357454+0000","last_change":"2024-04-18T21:05:05.640362+0000","last_active":"2024-04-18T21:05:07.357454+0000","last_peered":"2024-04-18T21:05:07.357454+0000","last_clean":"2024-04-18T21:05:07.357454+0000","last_became_active":"2024-04-18T21:05:05.635643+0000","last_became_peered":"2024-04-18T21:05:05.635643+0000","last_unstale":"2024-04-18T21:05:07.357454+0000","last_undegraded":"2024-04-18T21:05:07.357454+0000","last_fullsized":"2024-04-18T21:05:07.357454+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:43:55.788425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635029+0000","last_change":"2024-04-18T21:05:05.642755+0000","last_active":"2024-04-18T21:05:06.635029+0000","last_peered":"2024-04-18T21:05:06.635029+0000","last_clean":"2024-04-18T21:05:06.635029+0000","last_became_active":"2024-04-18T21:05:05.642150+0000","last_became_peered":"2024-04-18T21:05:05.642150+0000","last_unstale":"2024-04-18T21:05:06.635029+0000","last_undegraded":"2024-04-18T21:05:06.635029+0000","last_fullsized":"2024-04-18T21:05:06.635029+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:29:22.647425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637381+0000","last_change":"2024-04-18T21:05:05.653741+0000","last_active":"2024-04-18T21:05:06.637381+0000","last_peered":"2024-04-18T21:05:06.637381+0000","last_clean":"2024-04-18T21:05:06.637381+0000","last_became_active":"2024-04-18T21:05:05.650174+0000","last_became_peered":"2024-04-18T21:05:05.650174+0000","last_unstale":"2024-04-18T21:05:06.637381+0000","last_undegraded":"2024-04-18T21:05:06.637381+0000","last_fullsized":"2024-04-18T21:05:06.637381+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:04.350492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.360000+0000","last_change":"2024-04-18T21:05:05.649581+0000","last_active":"2024-04-18T21:05:07.360000+0000","last_peered":"2024-04-18T21:05:07.360000+0000","last_clean":"2024-04-18T21:05:07.360000+0000","last_became_active":"2024-04-18T21:05:05.648233+0000","last_became_peered":"2024-04-18T21:05:05.648233+0000","last_unstale":"2024-04-18T21:05:07.360000+0000","last_undegraded":"2024-04-18T21:05:07.360000+0000","last_fullsized":"2024-04-18T21:05:07.360000+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637099+0000","last_change":"2024-04-18T21:05:05.646926+0000","last_active":"2024-04-18T21:05:06.637099+0000","last_peered":"2024-04-18T21:05:06.637099+0000","last_clean":"2024-04-18T21:05:06.637099+0000","last_became_active":"2024-04-18T21:05:05.644942+0000","last_became_peered":"2024-04-18T21:05:05.644942+0000","last_unstale":"2024-04-18T21:05:06.637099+0000","last_undegraded":"2024-04-18T21:05:06.637099+0000","last_fullsized":"2024-04-18T21:05:06.637099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:53.850184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637629+0000","last_change":"2024-04-18T21:05:05.656314+0000","last_active":"2024-04-18T21:05:06.637629+0000","last_peered":"2024-04-18T21:05:06.637629+0000","last_clean":"2024-04-18T21:05:06.637629+0000","last_became_active":"2024-04-18T21:05:05.655364+0000","last_became_peered":"2024-04-18T21:05:05.655364+0000","last_unstale":"2024-04-18T21:05:06.637629+0000","last_undegraded":"2024-04-18T21:05:06.637629+0000","last_fullsized":"2024-04-18T21:05:06.637629+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:27:17.530889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358862+0000","last_change":"2024-04-18T21:05:05.653532+0000","last_active":"2024-04-18T21:05:07.358862+0000","last_peered":"2024-04-18T21:05:07.358862+0000","last_clean":"2024-04-18T21:05:07.358862+0000","last_became_active":"2024-04-18T21:05:05.652950+0000","last_became_peered":"2024-04-18T21:05:05.652950+0000","last_unstale":"2024-04-18T21:05:07.358862+0000","last_undegraded":"2024-04-18T21:05:07.358862+0000","last_fullsized":"2024-04-18T21:05:07.358862+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:51.225379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636535+0000","last_change":"2024-04-18T21:05:05.648084+0000","last_active":"2024-04-18T21:05:06.636535+0000","last_peered":"2024-04-18T21:05:06.636535+0000","last_clean":"2024-04-18T21:05:06.636535+0000","last_became_active":"2024-04-18T21:05:05.645340+0000","last_became_peered":"2024-04-18T21:05:05.645340+0000","last_unstale":"2024-04-18T21:05:06.636535+0000","last_undegraded":"2024-04-18T21:05:06.636535+0000","last_fullsized":"2024-04-18T21:05:06.636535+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:34:31.132458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.357930+0000","last_change":"2024-04-18T21:05:05.655034+0000","last_active":"2024-04-18T21:05:07.357930+0000","last_peered":"2024-04-18T21:05:07.357930+0000","last_clean":"2024-04-18T21:05:07.357930+0000","last_became_active":"2024-04-18T21:05:05.654517+0000","last_became_peered":"2024-04-18T21:05:05.654517+0000","last_unstale":"2024-04-18T21:05:07.357930+0000","last_undegraded":"2024-04-18T21:05:07.357930+0000","last_fullsized":"2024-04-18T21:05:07.357930+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:34:38.427319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635266+0000","last_change":"2024-04-18T21:05:05.626677+0000","last_active":"2024-04-18T21:05:06.635266+0000","last_peered":"2024-04-18T21:05:06.635266+0000","last_clean":"2024-04-18T21:05:06.635266+0000","last_became_active":"2024-04-18T21:05:05.624250+0000","last_became_peered":"2024-04-18T21:05:05.624250+0000","last_unstale":"2024-04-18T21:05:06.635266+0000","last_undegraded":"2024-04-18T21:05:06.635266+0000","last_fullsized":"2024-04-18T21:05:06.635266+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:51.225379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637347+0000","last_change":"2024-04-18T21:05:05.649918+0000","last_active":"2024-04-18T21:05:06.637347+0000","last_peered":"2024-04-18T21:05:06.637347+0000","last_clean":"2024-04-18T21:05:06.637347+0000","last_became_active":"2024-04-18T21:05:05.647147+0000","last_became_peered":"2024-04-18T21:05:05.647147+0000","last_unstale":"2024-04-18T21:05:06.637347+0000","last_undegraded":"2024-04-18T21:05:06.637347+0000","last_fullsized":"2024-04-18T21:05:06.637347+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:51:28.440070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637900+0000","last_change":"2024-04-18T21:05:04.632748+0000","last_active":"2024-04-18T21:05:06.637900+0000","last_peered":"2024-04-18T21:05:06.637900+0000","last_clean":"2024-04-18T21:05:06.637900+0000","last_became_active":"2024-04-18T21:05:04.628407+0000","last_became_peered":"2024-04-18T21:05:04.628407+0000","last_unstale":"2024-04-18T21:05:06.637900+0000","last_undegraded":"2024-04-18T21:05:06.637900+0000","last_fullsized":"2024-04-18T21:05:06.637900+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:42:45.392908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637688+0000","last_change":"2024-04-18T21:05:05.649199+0000","last_active":"2024-04-18T21:05:06.637688+0000","last_peered":"2024-04-18T21:05:06.637688+0000","last_clean":"2024-04-18T21:05:06.637688+0000","last_became_active":"2024-04-18T21:05:05.646898+0000","last_became_peered":"2024-04-18T21:05:05.646898+0000","last_unstale":"2024-04-18T21:05:06.637688+0000","last_undegraded":"2024-04-18T21:05:06.637688+0000","last_fullsized":"2024-04-18T21:05:06.637688+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:31:31.842528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358409+0000","last_change":"2024-04-18T21:05:04.638017+0000","last_active":"2024-04-18T21:05:07.358409+0000","last_peered":"2024-04-18T21:05:07.358409+0000","last_clean":"2024-04-18T21:05:07.358409+0000","last_became_active":"2024-04-18T21:05:04.637287+0000","last_became_peered":"2024-04-18T21:05:04.637287+0000","last_unstale":"2024-04-18T21:05:07.358409+0000","last_undegraded":"2024-04-18T21:05:07.358409+0000","last_fullsized":"2024-04-18T21:05:07.358409+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:25.891472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.360516+0000","last_change":"2024-04-18T21:05:05.650757+0000","last_active":"2024-04-18T21:05:07.360516+0000","last_peered":"2024-04-18T21:05:07.360516+0000","last_clean":"2024-04-18T21:05:07.360516+0000","last_became_active":"2024-04-18T21:05:05.650143+0000","last_became_peered":"2024-04-18T21:05:05.650143+0000","last_unstale":"2024-04-18T21:05:07.360516+0000","last_undegraded":"2024-04-18T21:05:07.360516+0000","last_fullsized":"2024-04-18T21:05:07.360516+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:14:51.873741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635796+0000","last_change":"2024-04-18T21:05:04.628489+0000","last_active":"2024-04-18T21:05:06.635796+0000","last_peered":"2024-04-18T21:05:06.635796+0000","last_clean":"2024-04-18T21:05:06.635796+0000","last_became_active":"2024-04-18T21:05:04.627279+0000","last_became_peered":"2024-04-18T21:05:04.627279+0000","last_unstale":"2024-04-18T21:05:06.635796+0000","last_undegraded":"2024-04-18T21:05:06.635796+0000","last_fullsized":"2024-04-18T21:05:06.635796+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:43:23.420744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359664+0000","last_change":"2024-04-18T21:05:05.649347+0000","last_active":"2024-04-18T21:05:07.359664+0000","last_peered":"2024-04-18T21:05:07.359664+0000","last_clean":"2024-04-18T21:05:07.359664+0000","last_became_active":"2024-04-18T21:05:05.648144+0000","last_became_peered":"2024-04-18T21:05:05.648144+0000","last_unstale":"2024-04-18T21:05:07.359664+0000","last_undegraded":"2024-04-18T21:05:07.359664+0000","last_fullsized":"2024-04-18T21:05:07.359664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:51:28.440070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":22,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635267+0000","last_change":"2024-04-18T21:05:04.624089+0000","last_active":"2024-04-18T21:05:06.635267+0000","last_peered":"2024-04-18T21:05:06.635267+0000","last_clean":"2024-04-18T21:05:06.635267+0000","last_became_active":"2024-04-18T21:05:04.623238+0000","last_became_peered":"2024-04-18T21:05:04.623238+0000","last_unstale":"2024-04-18T21:05:06.635267+0000","last_undegraded":"2024-04-18T21:05:06.635267+0000","last_fullsized":"2024-04-18T21:05:06.635267+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:44:19.076499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637569+0000","last_change":"2024-04-18T21:05:04.633907+0000","last_active":"2024-04-18T21:05:06.637569+0000","last_peered":"2024-04-18T21:05:06.637569+0000","last_clean":"2024-04-18T21:05:06.637569+0000","last_became_active":"2024-04-18T21:05:04.630308+0000","last_became_peered":"2024-04-18T21:05:04.630308+0000","last_unstale":"2024-04-18T21:05:06.637569+0000","last_undegraded":"2024-04-18T21:05:06.637569+0000","last_fullsized":"2024-04-18T21:05:06.637569+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:55:46.219812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635046+0000","last_change":"2024-04-18T21:05:05.658572+0000","last_active":"2024-04-18T21:05:06.635046+0000","last_peered":"2024-04-18T21:05:06.635046+0000","last_clean":"2024-04-18T21:05:06.635046+0000","last_became_active":"2024-04-18T21:05:05.657842+0000","last_became_peered":"2024-04-18T21:05:05.657842+0000","last_unstale":"2024-04-18T21:05:06.635046+0000","last_undegraded":"2024-04-18T21:05:06.635046+0000","last_fullsized":"2024-04-18T21:05:06.635046+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:26:38.636530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.638161+0000","last_change":"2024-04-18T21:05:04.628541+0000","last_active":"2024-04-18T21:05:06.638161+0000","last_peered":"2024-04-18T21:05:06.638161+0000","last_clean":"2024-04-18T21:05:06.638161+0000","last_became_active":"2024-04-18T21:05:04.627407+0000","last_became_peered":"2024-04-18T21:05:04.627407+0000","last_unstale":"2024-04-18T21:05:06.638161+0000","last_undegraded":"2024-04-18T21:05:06.638161+0000","last_fullsized":"2024-04-18T21:05:06.638161+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:55:48.643174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635639+0000","last_change":"2024-04-18T21:05:05.651649+0000","last_active":"2024-04-18T21:05:06.635639+0000","last_peered":"2024-04-18T21:05:06.635639+0000","last_clean":"2024-04-18T21:05:06.635639+0000","last_became_active":"2024-04-18T21:05:05.646809+0000","last_became_peered":"2024-04-18T21:05:05.646809+0000","last_unstale":"2024-04-18T21:05:06.635639+0000","last_undegraded":"2024-04-18T21:05:06.635639+0000","last_fullsized":"2024-04-18T21:05:06.635639+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:23.698827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637684+0000","last_change":"2024-04-18T21:05:04.634055+0000","last_active":"2024-04-18T21:05:06.637684+0000","last_peered":"2024-04-18T21:05:06.637684+0000","last_clean":"2024-04-18T21:05:06.637684+0000","last_became_active":"2024-04-18T21:05:04.630736+0000","last_became_peered":"2024-04-18T21:05:04.630736+0000","last_unstale":"2024-04-18T21:05:06.637684+0000","last_undegraded":"2024-04-18T21:05:06.637684+0000","last_fullsized":"2024-04-18T21:05:06.637684+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:06:44.001512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636585+0000","last_change":"2024-04-18T21:05:05.628869+0000","last_active":"2024-04-18T21:05:06.636585+0000","last_peered":"2024-04-18T21:05:06.636585+0000","last_clean":"2024-04-18T21:05:06.636585+0000","last_became_active":"2024-04-18T21:05:05.627071+0000","last_became_peered":"2024-04-18T21:05:05.627071+0000","last_unstale":"2024-04-18T21:05:06.636585+0000","last_undegraded":"2024-04-18T21:05:06.636585+0000","last_fullsized":"2024-04-18T21:05:06.636585+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:31:31.842528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.638123+0000","last_change":"2024-04-18T21:05:04.625520+0000","last_active":"2024-04-18T21:05:06.638123+0000","last_peered":"2024-04-18T21:05:06.638123+0000","last_clean":"2024-04-18T21:05:06.638123+0000","last_became_active":"2024-04-18T21:05:04.624656+0000","last_became_peered":"2024-04-18T21:05:04.624656+0000","last_unstale":"2024-04-18T21:05:06.638123+0000","last_undegraded":"2024-04-18T21:05:06.638123+0000","last_fullsized":"2024-04-18T21:05:06.638123+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:56:05.795125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358238+0000","last_change":"2024-04-18T21:05:05.649406+0000","last_active":"2024-04-18T21:05:07.358238+0000","last_peered":"2024-04-18T21:05:07.358238+0000","last_clean":"2024-04-18T21:05:07.358238+0000","last_became_active":"2024-04-18T21:05:05.648380+0000","last_became_peered":"2024-04-18T21:05:05.648380+0000","last_unstale":"2024-04-18T21:05:07.358238+0000","last_undegraded":"2024-04-18T21:05:07.358238+0000","last_fullsized":"2024-04-18T21:05:07.358238+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359521+0000","last_change":"2024-04-18T21:05:04.640216+0000","last_active":"2024-04-18T21:05:07.359521+0000","last_peered":"2024-04-18T21:05:07.359521+0000","last_clean":"2024-04-18T21:05:07.359521+0000","last_became_active":"2024-04-18T21:05:04.639349+0000","last_became_peered":"2024-04-18T21:05:04.639349+0000","last_unstale":"2024-04-18T21:05:07.359521+0000","last_undegraded":"2024-04-18T21:05:07.359521+0000","last_fullsized":"2024-04-18T21:05:07.359521+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:09:18.466987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637709+0000","last_change":"2024-04-18T21:05:05.628850+0000","last_active":"2024-04-18T21:05:06.637709+0000","last_peered":"2024-04-18T21:05:06.637709+0000","last_clean":"2024-04-18T21:05:06.637709+0000","last_became_active":"2024-04-18T21:05:05.627521+0000","last_became_peered":"2024-04-18T21:05:05.627521+0000","last_unstale":"2024-04-18T21:05:06.637709+0000","last_undegraded":"2024-04-18T21:05:06.637709+0000","last_fullsized":"2024-04-18T21:05:06.637709+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:14:37.912032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636946+0000","last_change":"2024-04-18T21:05:04.634674+0000","last_active":"2024-04-18T21:05:06.636946+0000","last_peered":"2024-04-18T21:05:06.636946+0000","last_clean":"2024-04-18T21:05:06.636946+0000","last_became_active":"2024-04-18T21:05:04.632284+0000","last_became_peered":"2024-04-18T21:05:04.632284+0000","last_unstale":"2024-04-18T21:05:06.636946+0000","last_undegraded":"2024-04-18T21:05:06.636946+0000","last_fullsized":"2024-04-18T21:05:06.636946+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:09:18.466987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637414+0000","last_change":"2024-04-18T21:05:05.647377+0000","last_active":"2024-04-18T21:05:06.637414+0000","last_peered":"2024-04-18T21:05:06.637414+0000","last_clean":"2024-04-18T21:05:06.637414+0000","last_became_active":"2024-04-18T21:05:05.645067+0000","last_became_peered":"2024-04-18T21:05:05.645067+0000","last_unstale":"2024-04-18T21:05:06.637414+0000","last_undegraded":"2024-04-18T21:05:06.637414+0000","last_fullsized":"2024-04-18T21:05:06.637414+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:29:30.243751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636012+0000","last_change":"2024-04-18T21:05:04.627578+0000","last_active":"2024-04-18T21:05:06.636012+0000","last_peered":"2024-04-18T21:05:06.636012+0000","last_clean":"2024-04-18T21:05:06.636012+0000","last_became_active":"2024-04-18T21:05:04.626786+0000","last_became_peered":"2024-04-18T21:05:04.626786+0000","last_unstale":"2024-04-18T21:05:06.636012+0000","last_undegraded":"2024-04-18T21:05:06.636012+0000","last_fullsized":"2024-04-18T21:05:06.636012+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:55:59.563512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637217+0000","last_change":"2024-04-18T21:05:05.640817+0000","last_active":"2024-04-18T21:05:06.637217+0000","last_peered":"2024-04-18T21:05:06.637217+0000","last_clean":"2024-04-18T21:05:06.637217+0000","last_became_active":"2024-04-18T21:05:05.635526+0000","last_became_peered":"2024-04-18T21:05:05.635526+0000","last_unstale":"2024-04-18T21:05:06.637217+0000","last_undegraded":"2024-04-18T21:05:06.637217+0000","last_fullsized":"2024-04-18T21:05:06.637217+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:44:29.823511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635339+0000","last_change":"2024-04-18T21:05:04.636499+0000","last_active":"2024-04-18T21:05:06.635339+0000","last_peered":"2024-04-18T21:05:06.635339+0000","last_clean":"2024-04-18T21:05:06.635339+0000","last_became_active":"2024-04-18T21:05:04.635830+0000","last_became_peered":"2024-04-18T21:05:04.635830+0000","last_unstale":"2024-04-18T21:05:06.635339+0000","last_undegraded":"2024-04-18T21:05:06.635339+0000","last_fullsized":"2024-04-18T21:05:06.635339+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:26:30.565175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359678+0000","last_change":"2024-04-18T21:05:05.660974+0000","last_active":"2024-04-18T21:05:07.359678+0000","last_peered":"2024-04-18T21:05:07.359678+0000","last_clean":"2024-04-18T21:05:07.359678+0000","last_became_active":"2024-04-18T21:05:05.659287+0000","last_became_peered":"2024-04-18T21:05:05.659287+0000","last_unstale":"2024-04-18T21:05:07.359678+0000","last_undegraded":"2024-04-18T21:05:07.359678+0000","last_fullsized":"2024-04-18T21:05:07.359678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:50:40.920146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":222,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636126+0000","last_change":"2024-04-18T21:04:54.511605+0000","last_active":"2024-04-18T21:05:06.636126+0000","last_peered":"2024-04-18T21:05:06.636126+0000","last_clean":"2024-04-18T21:05:06.636126+0000","last_became_active":"2024-04-18T21:04:54.510791+0000","last_became_peered":"2024-04-18T21:04:54.510791+0000","last_unstale":"2024-04-18T21:05:06.636126+0000","last_undegraded":"2024-04-18T21:05:06.636126+0000","last_fullsized":"2024-04-18T21:05:06.636126+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_clean_scrub_stamp":"2024-04-18T21:04:53.494814+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:46.262250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.638030+0000","last_change":"2024-04-18T21:05:00.576671+0000","last_active":"2024-04-18T21:05:06.638030+0000","last_peered":"2024-04-18T21:05:06.638030+0000","last_clean":"2024-04-18T21:05:06.638030+0000","last_became_active":"2024-04-18T21:05:00.575933+0000","last_became_peered":"2024-04-18T21:05:00.575933+0000","last_unstale":"2024-04-18T21:05:06.638030+0000","last_undegraded":"2024-04-18T21:05:06.638030+0000","last_fullsized":"2024-04-18T21:05:06.638030+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:14:59.207959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358678+0000","last_change":"2024-04-18T21:05:04.639528+0000","last_active":"2024-04-18T21:05:07.358678+0000","last_peered":"2024-04-18T21:05:07.358678+0000","last_clean":"2024-04-18T21:05:07.358678+0000","last_became_active":"2024-04-18T21:05:04.638517+0000","last_became_peered":"2024-04-18T21:05:04.638517+0000","last_unstale":"2024-04-18T21:05:07.358678+0000","last_undegraded":"2024-04-18T21:05:07.358678+0000","last_fullsized":"2024-04-18T21:05:07.358678+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:55:46.219812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637482+0000","last_change":"2024-04-18T21:05:05.647623+0000","last_active":"2024-04-18T21:05:06.637482+0000","last_peered":"2024-04-18T21:05:06.637482+0000","last_clean":"2024-04-18T21:05:06.637482+0000","last_became_active":"2024-04-18T21:05:05.645640+0000","last_became_peered":"2024-04-18T21:05:05.645640+0000","last_unstale":"2024-04-18T21:05:06.637482+0000","last_undegraded":"2024-04-18T21:05:06.637482+0000","last_fullsized":"2024-04-18T21:05:06.637482+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:59.950421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635615+0000","last_change":"2024-04-18T21:05:00.571960+0000","last_active":"2024-04-18T21:05:06.635615+0000","last_peered":"2024-04-18T21:05:06.635615+0000","last_clean":"2024-04-18T21:05:06.635615+0000","last_became_active":"2024-04-18T21:05:00.571301+0000","last_became_peered":"2024-04-18T21:05:00.571301+0000","last_unstale":"2024-04-18T21:05:06.635615+0000","last_undegraded":"2024-04-18T21:05:06.635615+0000","last_fullsized":"2024-04-18T21:05:06.635615+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:31:59.262440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358645+0000","last_change":"2024-04-18T21:05:04.638026+0000","last_active":"2024-04-18T21:05:07.358645+0000","last_peered":"2024-04-18T21:05:07.358645+0000","last_clean":"2024-04-18T21:05:07.358645+0000","last_became_active":"2024-04-18T21:05:04.637160+0000","last_became_peered":"2024-04-18T21:05:04.637160+0000","last_unstale":"2024-04-18T21:05:07.358645+0000","last_undegraded":"2024-04-18T21:05:07.358645+0000","last_fullsized":"2024-04-18T21:05:07.358645+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:33:48.703994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.638058+0000","last_change":"2024-04-18T21:05:05.654121+0000","last_active":"2024-04-18T21:05:06.638058+0000","last_peered":"2024-04-18T21:05:06.638058+0000","last_clean":"2024-04-18T21:05:06.638058+0000","last_became_active":"2024-04-18T21:05:05.651310+0000","last_became_peered":"2024-04-18T21:05:05.651310+0000","last_unstale":"2024-04-18T21:05:06.638058+0000","last_undegraded":"2024-04-18T21:05:06.638058+0000","last_fullsized":"2024-04-18T21:05:06.638058+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:01.841786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359064+0000","last_change":"2024-04-18T21:05:00.578604+0000","last_active":"2024-04-18T21:05:07.359064+0000","last_peered":"2024-04-18T21:05:07.359064+0000","last_clean":"2024-04-18T21:05:07.359064+0000","last_became_active":"2024-04-18T21:05:00.577988+0000","last_became_peered":"2024-04-18T21:05:00.577988+0000","last_unstale":"2024-04-18T21:05:07.359064+0000","last_undegraded":"2024-04-18T21:05:07.359064+0000","last_fullsized":"2024-04-18T21:05:07.359064+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:54:54.201759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635569+0000","last_change":"2024-04-18T21:05:04.627627+0000","last_active":"2024-04-18T21:05:06.635569+0000","last_peered":"2024-04-18T21:05:06.635569+0000","last_clean":"2024-04-18T21:05:06.635569+0000","last_became_active":"2024-04-18T21:05:04.626850+0000","last_became_peered":"2024-04-18T21:05:04.626850+0000","last_unstale":"2024-04-18T21:05:06.635569+0000","last_undegraded":"2024-04-18T21:05:06.635569+0000","last_fullsized":"2024-04-18T21:05:06.635569+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:43:31.453080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359914+0000","last_change":"2024-04-18T21:05:05.661488+0000","last_active":"2024-04-18T21:05:07.359914+0000","last_peered":"2024-04-18T21:05:07.359914+0000","last_clean":"2024-04-18T21:05:07.359914+0000","last_became_active":"2024-04-18T21:05:05.660283+0000","last_became_peered":"2024-04-18T21:05:05.660283+0000","last_unstale":"2024-04-18T21:05:07.359914+0000","last_undegraded":"2024-04-18T21:05:07.359914+0000","last_fullsized":"2024-04-18T21:05:07.359914+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:04.350492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637285+0000","last_change":"2024-04-18T21:05:00.576606+0000","last_active":"2024-04-18T21:05:06.637285+0000","last_peered":"2024-04-18T21:05:06.637285+0000","last_clean":"2024-04-18T21:05:06.637285+0000","last_became_active":"2024-04-18T21:05:00.575951+0000","last_became_peered":"2024-04-18T21:05:00.575951+0000","last_unstale":"2024-04-18T21:05:06.637285+0000","last_undegraded":"2024-04-18T21:05:06.637285+0000","last_fullsized":"2024-04-18T21:05:06.637285+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:32:17.612481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637939+0000","last_change":"2024-04-18T21:05:04.627296+0000","last_active":"2024-04-18T21:05:06.637939+0000","last_peered":"2024-04-18T21:05:06.637939+0000","last_clean":"2024-04-18T21:05:06.637939+0000","last_became_active":"2024-04-18T21:05:04.626801+0000","last_became_peered":"2024-04-18T21:05:04.626801+0000","last_unstale":"2024-04-18T21:05:06.637939+0000","last_undegraded":"2024-04-18T21:05:06.637939+0000","last_fullsized":"2024-04-18T21:05:06.637939+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:46:36.285416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359434+0000","last_change":"2024-04-18T21:05:05.655152+0000","last_active":"2024-04-18T21:05:07.359434+0000","last_peered":"2024-04-18T21:05:07.359434+0000","last_clean":"2024-04-18T21:05:07.359434+0000","last_became_active":"2024-04-18T21:05:05.654506+0000","last_became_peered":"2024-04-18T21:05:05.654506+0000","last_unstale":"2024-04-18T21:05:07.359434+0000","last_undegraded":"2024-04-18T21:05:07.359434+0000","last_fullsized":"2024-04-18T21:05:07.359434+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:32:23.929877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637718+0000","last_change":"2024-04-18T21:05:04.628916+0000","last_active":"2024-04-18T21:05:06.637718+0000","last_peered":"2024-04-18T21:05:06.637718+0000","last_clean":"2024-04-18T21:05:06.637718+0000","last_became_active":"2024-04-18T21:05:04.628245+0000","last_became_peered":"2024-04-18T21:05:04.628245+0000","last_unstale":"2024-04-18T21:05:06.637718+0000","last_undegraded":"2024-04-18T21:05:06.637718+0000","last_fullsized":"2024-04-18T21:05:06.637718+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:34:58.562540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359757+0000","last_change":"2024-04-18T21:05:00.578563+0000","last_active":"2024-04-18T21:05:07.359757+0000","last_peered":"2024-04-18T21:05:07.359757+0000","last_clean":"2024-04-18T21:05:07.359757+0000","last_became_active":"2024-04-18T21:05:00.577960+0000","last_became_peered":"2024-04-18T21:05:00.577960+0000","last_unstale":"2024-04-18T21:05:07.359757+0000","last_undegraded":"2024-04-18T21:05:07.359757+0000","last_fullsized":"2024-04-18T21:05:07.359757+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:31:59.262440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636313+0000","last_change":"2024-04-18T21:05:05.646076+0000","last_active":"2024-04-18T21:05:06.636313+0000","last_peered":"2024-04-18T21:05:06.636313+0000","last_clean":"2024-04-18T21:05:06.636313+0000","last_became_active":"2024-04-18T21:05:05.645104+0000","last_became_peered":"2024-04-18T21:05:05.645104+0000","last_unstale":"2024-04-18T21:05:06.636313+0000","last_undegraded":"2024-04-18T21:05:06.636313+0000","last_fullsized":"2024-04-18T21:05:06.636313+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:34:38.427319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359695+0000","last_change":"2024-04-18T21:05:04.639700+0000","last_active":"2024-04-18T21:05:07.359695+0000","last_peered":"2024-04-18T21:05:07.359695+0000","last_clean":"2024-04-18T21:05:07.359695+0000","last_became_active":"2024-04-18T21:05:04.638928+0000","last_became_peered":"2024-04-18T21:05:04.638928+0000","last_unstale":"2024-04-18T21:05:07.359695+0000","last_undegraded":"2024-04-18T21:05:07.359695+0000","last_fullsized":"2024-04-18T21:05:07.359695+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:00:08.877854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.638177+0000","last_change":"2024-04-18T21:05:00.576907+0000","last_active":"2024-04-18T21:05:06.638177+0000","last_peered":"2024-04-18T21:05:06.638177+0000","last_clean":"2024-04-18T21:05:06.638177+0000","last_became_active":"2024-04-18T21:05:00.576152+0000","last_became_peered":"2024-04-18T21:05:00.576152+0000","last_unstale":"2024-04-18T21:05:06.638177+0000","last_undegraded":"2024-04-18T21:05:06.638177+0000","last_fullsized":"2024-04-18T21:05:06.638177+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:25:07.270023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636117+0000","last_change":"2024-04-18T21:05:05.646026+0000","last_active":"2024-04-18T21:05:06.636117+0000","last_peered":"2024-04-18T21:05:06.636117+0000","last_clean":"2024-04-18T21:05:06.636117+0000","last_became_active":"2024-04-18T21:05:05.645192+0000","last_became_peered":"2024-04-18T21:05:05.645192+0000","last_unstale":"2024-04-18T21:05:06.636117+0000","last_undegraded":"2024-04-18T21:05:06.636117+0000","last_fullsized":"2024-04-18T21:05:06.636117+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:05:46.009381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.360443+0000","last_change":"2024-04-18T21:05:04.640732+0000","last_active":"2024-04-18T21:05:07.360443+0000","last_peered":"2024-04-18T21:05:07.360443+0000","last_clean":"2024-04-18T21:05:07.360443+0000","last_became_active":"2024-04-18T21:05:04.638505+0000","last_became_peered":"2024-04-18T21:05:04.638505+0000","last_unstale":"2024-04-18T21:05:07.360443+0000","last_undegraded":"2024-04-18T21:05:07.360443+0000","last_fullsized":"2024-04-18T21:05:07.360443+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:34:58.562540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.360549+0000","last_change":"2024-04-18T21:05:00.579869+0000","last_active":"2024-04-18T21:05:07.360549+0000","last_peered":"2024-04-18T21:05:07.360549+0000","last_clean":"2024-04-18T21:05:07.360549+0000","last_became_active":"2024-04-18T21:05:00.579351+0000","last_became_peered":"2024-04-18T21:05:00.579351+0000","last_unstale":"2024-04-18T21:05:07.360549+0000","last_undegraded":"2024-04-18T21:05:07.360549+0000","last_fullsized":"2024-04-18T21:05:07.360549+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:15:02.061128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.357811+0000","last_change":"2024-04-18T21:05:05.642730+0000","last_active":"2024-04-18T21:05:07.357811+0000","last_peered":"2024-04-18T21:05:07.357811+0000","last_clean":"2024-04-18T21:05:07.357811+0000","last_became_active":"2024-04-18T21:05:05.641890+0000","last_became_peered":"2024-04-18T21:05:05.641890+0000","last_unstale":"2024-04-18T21:05:07.357811+0000","last_undegraded":"2024-04-18T21:05:07.357811+0000","last_fullsized":"2024-04-18T21:05:07.357811+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:05:46.009381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.360476+0000","last_change":"2024-04-18T21:05:04.639898+0000","last_active":"2024-04-18T21:05:07.360476+0000","last_peered":"2024-04-18T21:05:07.360476+0000","last_clean":"2024-04-18T21:05:07.360476+0000","last_became_active":"2024-04-18T21:05:04.639115+0000","last_became_peered":"2024-04-18T21:05:04.639115+0000","last_unstale":"2024-04-18T21:05:07.360476+0000","last_undegraded":"2024-04-18T21:05:07.360476+0000","last_fullsized":"2024-04-18T21:05:07.360476+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:44:19.076499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637757+0000","last_change":"2024-04-18T21:05:00.572414+0000","last_active":"2024-04-18T21:05:06.637757+0000","last_peered":"2024-04-18T21:05:06.637757+0000","last_clean":"2024-04-18T21:05:06.637757+0000","last_became_active":"2024-04-18T21:05:00.571755+0000","last_became_peered":"2024-04-18T21:05:00.571755+0000","last_unstale":"2024-04-18T21:05:06.637757+0000","last_undegraded":"2024-04-18T21:05:06.637757+0000","last_fullsized":"2024-04-18T21:05:06.637757+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:15:02.061128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635489+0000","last_change":"2024-04-18T21:05:05.655898+0000","last_active":"2024-04-18T21:05:06.635489+0000","last_peered":"2024-04-18T21:05:06.635489+0000","last_clean":"2024-04-18T21:05:06.635489+0000","last_became_active":"2024-04-18T21:05:05.654111+0000","last_became_peered":"2024-04-18T21:05:05.654111+0000","last_unstale":"2024-04-18T21:05:06.635489+0000","last_undegraded":"2024-04-18T21:05:06.635489+0000","last_fullsized":"2024-04-18T21:05:06.635489+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:19:38.537080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637592+0000","last_change":"2024-04-18T21:05:05.641373+0000","last_active":"2024-04-18T21:05:06.637592+0000","last_peered":"2024-04-18T21:05:06.637592+0000","last_clean":"2024-04-18T21:05:06.637592+0000","last_became_active":"2024-04-18T21:05:05.634204+0000","last_became_peered":"2024-04-18T21:05:05.634204+0000","last_unstale":"2024-04-18T21:05:06.637592+0000","last_undegraded":"2024-04-18T21:05:06.637592+0000","last_fullsized":"2024-04-18T21:05:06.637592+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:27:35.995004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637977+0000","last_change":"2024-04-18T21:05:04.631271+0000","last_active":"2024-04-18T21:05:06.637977+0000","last_peered":"2024-04-18T21:05:06.637977+0000","last_clean":"2024-04-18T21:05:06.637977+0000","last_became_active":"2024-04-18T21:05:04.630442+0000","last_became_peered":"2024-04-18T21:05:04.630442+0000","last_unstale":"2024-04-18T21:05:06.637977+0000","last_undegraded":"2024-04-18T21:05:06.637977+0000","last_fullsized":"2024-04-18T21:05:06.637977+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:33:48.703994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358112+0000","last_change":"2024-04-18T21:05:05.637894+0000","last_active":"2024-04-18T21:05:07.358112+0000","last_peered":"2024-04-18T21:05:07.358112+0000","last_clean":"2024-04-18T21:05:07.358112+0000","last_became_active":"2024-04-18T21:05:05.636846+0000","last_became_peered":"2024-04-18T21:05:05.636846+0000","last_unstale":"2024-04-18T21:05:07.358112+0000","last_undegraded":"2024-04-18T21:05:07.358112+0000","last_fullsized":"2024-04-18T21:05:07.358112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:34:31.132458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637990+0000","last_change":"2024-04-18T21:05:04.631152+0000","last_active":"2024-04-18T21:05:06.637990+0000","last_peered":"2024-04-18T21:05:06.637990+0000","last_clean":"2024-04-18T21:05:06.637990+0000","last_became_active":"2024-04-18T21:05:04.628900+0000","last_became_peered":"2024-04-18T21:05:04.628900+0000","last_unstale":"2024-04-18T21:05:06.637990+0000","last_undegraded":"2024-04-18T21:05:06.637990+0000","last_fullsized":"2024-04-18T21:05:06.637990+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:40:21.452052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637452+0000","last_change":"2024-04-18T21:05:04.629470+0000","last_active":"2024-04-18T21:05:06.637452+0000","last_peered":"2024-04-18T21:05:06.637452+0000","last_clean":"2024-04-18T21:05:06.637452+0000","last_became_active":"2024-04-18T21:05:04.628286+0000","last_became_peered":"2024-04-18T21:05:04.628286+0000","last_unstale":"2024-04-18T21:05:06.637452+0000","last_undegraded":"2024-04-18T21:05:06.637452+0000","last_fullsized":"2024-04-18T21:05:06.637452+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:00:08.877854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358071+0000","last_change":"2024-04-18T21:05:05.642793+0000","last_active":"2024-04-18T21:05:07.358071+0000","last_peered":"2024-04-18T21:05:07.358071+0000","last_clean":"2024-04-18T21:05:07.358071+0000","last_became_active":"2024-04-18T21:05:05.641983+0000","last_became_peered":"2024-04-18T21:05:05.641983+0000","last_unstale":"2024-04-18T21:05:07.358071+0000","last_undegraded":"2024-04-18T21:05:07.358071+0000","last_fullsized":"2024-04-18T21:05:07.358071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:46:36.339289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.360264+0000","last_change":"2024-04-18T21:05:04.641445+0000","last_active":"2024-04-18T21:05:07.360264+0000","last_peered":"2024-04-18T21:05:07.360264+0000","last_clean":"2024-04-18T21:05:07.360264+0000","last_became_active":"2024-04-18T21:05:04.640682+0000","last_became_peered":"2024-04-18T21:05:04.640682+0000","last_unstale":"2024-04-18T21:05:07.360264+0000","last_undegraded":"2024-04-18T21:05:07.360264+0000","last_fullsized":"2024-04-18T21:05:07.360264+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:46:36.285416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.357743+0000","last_change":"2024-04-18T21:05:05.641561+0000","last_active":"2024-04-18T21:05:07.357743+0000","last_peered":"2024-04-18T21:05:07.357743+0000","last_clean":"2024-04-18T21:05:07.357743+0000","last_became_active":"2024-04-18T21:05:05.640922+0000","last_became_peered":"2024-04-18T21:05:05.640922+0000","last_unstale":"2024-04-18T21:05:07.357743+0000","last_undegraded":"2024-04-18T21:05:07.357743+0000","last_fullsized":"2024-04-18T21:05:07.357743+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:56.408234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637829+0000","last_change":"2024-04-18T21:05:05.651530+0000","last_active":"2024-04-18T21:05:06.637829+0000","last_peered":"2024-04-18T21:05:06.637829+0000","last_clean":"2024-04-18T21:05:06.637829+0000","last_became_active":"2024-04-18T21:05:05.648167+0000","last_became_peered":"2024-04-18T21:05:05.648167+0000","last_unstale":"2024-04-18T21:05:06.637829+0000","last_undegraded":"2024-04-18T21:05:06.637829+0000","last_fullsized":"2024-04-18T21:05:06.637829+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:14:51.873741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358019+0000","last_change":"2024-04-18T21:05:04.637369+0000","last_active":"2024-04-18T21:05:07.358019+0000","last_peered":"2024-04-18T21:05:07.358019+0000","last_clean":"2024-04-18T21:05:07.358019+0000","last_became_active":"2024-04-18T21:05:04.636468+0000","last_became_peered":"2024-04-18T21:05:04.636468+0000","last_unstale":"2024-04-18T21:05:07.358019+0000","last_undegraded":"2024-04-18T21:05:07.358019+0000","last_fullsized":"2024-04-18T21:05:07.358019+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:40:21.452052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.360014+0000","last_change":"2024-04-18T21:05:05.651245+0000","last_active":"2024-04-18T21:05:07.360014+0000","last_peered":"2024-04-18T21:05:07.360014+0000","last_clean":"2024-04-18T21:05:07.360014+0000","last_became_active":"2024-04-18T21:05:05.650463+0000","last_became_peered":"2024-04-18T21:05:05.650463+0000","last_unstale":"2024-04-18T21:05:07.360014+0000","last_undegraded":"2024-04-18T21:05:07.360014+0000","last_fullsized":"2024-04-18T21:05:07.360014+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:27:17.530889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358504+0000","last_change":"2024-04-18T21:05:04.637597+0000","last_active":"2024-04-18T21:05:07.358504+0000","last_peered":"2024-04-18T21:05:07.358504+0000","last_clean":"2024-04-18T21:05:07.358504+0000","last_became_active":"2024-04-18T21:05:04.636827+0000","last_became_peered":"2024-04-18T21:05:04.636827+0000","last_unstale":"2024-04-18T21:05:07.358504+0000","last_undegraded":"2024-04-18T21:05:07.358504+0000","last_fullsized":"2024-04-18T21:05:07.358504+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:43.511952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636925+0000","last_change":"2024-04-18T21:05:05.658971+0000","last_active":"2024-04-18T21:05:06.636925+0000","last_peered":"2024-04-18T21:05:06.636925+0000","last_clean":"2024-04-18T21:05:06.636925+0000","last_became_active":"2024-04-18T21:05:05.658363+0000","last_became_peered":"2024-04-18T21:05:05.658363+0000","last_unstale":"2024-04-18T21:05:06.636925+0000","last_undegraded":"2024-04-18T21:05:06.636925+0000","last_fullsized":"2024-04-18T21:05:06.636925+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:12.944469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636616+0000","last_change":"2024-04-18T21:05:04.636585+0000","last_active":"2024-04-18T21:05:06.636616+0000","last_peered":"2024-04-18T21:05:06.636616+0000","last_clean":"2024-04-18T21:05:06.636616+0000","last_became_active":"2024-04-18T21:05:04.635670+0000","last_became_peered":"2024-04-18T21:05:04.635670+0000","last_unstale":"2024-04-18T21:05:06.636616+0000","last_undegraded":"2024-04-18T21:05:06.636616+0000","last_fullsized":"2024-04-18T21:05:06.636616+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:34:33.779063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636955+0000","last_change":"2024-04-18T21:05:05.649960+0000","last_active":"2024-04-18T21:05:06.636955+0000","last_peered":"2024-04-18T21:05:06.636955+0000","last_clean":"2024-04-18T21:05:06.636955+0000","last_became_active":"2024-04-18T21:05:05.648528+0000","last_became_peered":"2024-04-18T21:05:05.648528+0000","last_unstale":"2024-04-18T21:05:06.636955+0000","last_undegraded":"2024-04-18T21:05:06.636955+0000","last_fullsized":"2024-04-18T21:05:06.636955+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:20:45.938503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636493+0000","last_change":"2024-04-18T21:05:04.630151+0000","last_active":"2024-04-18T21:05:06.636493+0000","last_peered":"2024-04-18T21:05:06.636493+0000","last_clean":"2024-04-18T21:05:06.636493+0000","last_became_active":"2024-04-18T21:05:04.627968+0000","last_became_peered":"2024-04-18T21:05:04.627968+0000","last_unstale":"2024-04-18T21:05:06.636493+0000","last_undegraded":"2024-04-18T21:05:06.636493+0000","last_fullsized":"2024-04-18T21:05:06.636493+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:00:33.393636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636522+0000","last_change":"2024-04-18T21:05:05.624840+0000","last_active":"2024-04-18T21:05:06.636522+0000","last_peered":"2024-04-18T21:05:06.636522+0000","last_clean":"2024-04-18T21:05:06.636522+0000","last_became_active":"2024-04-18T21:05:05.622950+0000","last_became_peered":"2024-04-18T21:05:05.622950+0000","last_unstale":"2024-04-18T21:05:06.636522+0000","last_undegraded":"2024-04-18T21:05:06.636522+0000","last_fullsized":"2024-04-18T21:05:06.636522+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:27:17.530889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637987+0000","last_change":"2024-04-18T21:05:04.626715+0000","last_active":"2024-04-18T21:05:06.637987+0000","last_peered":"2024-04-18T21:05:06.637987+0000","last_clean":"2024-04-18T21:05:06.637987+0000","last_became_active":"2024-04-18T21:05:04.625270+0000","last_became_peered":"2024-04-18T21:05:04.625270+0000","last_unstale":"2024-04-18T21:05:06.637987+0000","last_undegraded":"2024-04-18T21:05:06.637987+0000","last_fullsized":"2024-04-18T21:05:06.637987+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:43.511952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637167+0000","last_change":"2024-04-18T21:05:05.627962+0000","last_active":"2024-04-18T21:05:06.637167+0000","last_peered":"2024-04-18T21:05:06.637167+0000","last_clean":"2024-04-18T21:05:06.637167+0000","last_became_active":"2024-04-18T21:05:05.626698+0000","last_became_peered":"2024-04-18T21:05:05.626698+0000","last_unstale":"2024-04-18T21:05:06.637167+0000","last_undegraded":"2024-04-18T21:05:06.637167+0000","last_fullsized":"2024-04-18T21:05:06.637167+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:48:48.973087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637569+0000","last_change":"2024-04-18T21:05:04.632776+0000","last_active":"2024-04-18T21:05:06.637569+0000","last_peered":"2024-04-18T21:05:06.637569+0000","last_clean":"2024-04-18T21:05:06.637569+0000","last_became_active":"2024-04-18T21:05:04.630142+0000","last_became_peered":"2024-04-18T21:05:04.630142+0000","last_unstale":"2024-04-18T21:05:06.637569+0000","last_undegraded":"2024-04-18T21:05:06.637569+0000","last_fullsized":"2024-04-18T21:05:06.637569+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:19:36.721897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636797+0000","last_change":"2024-04-18T21:05:05.653025+0000","last_active":"2024-04-18T21:05:06.636797+0000","last_peered":"2024-04-18T21:05:06.636797+0000","last_clean":"2024-04-18T21:05:06.636797+0000","last_became_active":"2024-04-18T21:05:05.645039+0000","last_became_peered":"2024-04-18T21:05:05.645039+0000","last_unstale":"2024-04-18T21:05:06.636797+0000","last_undegraded":"2024-04-18T21:05:06.636797+0000","last_fullsized":"2024-04-18T21:05:06.636797+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.360315+0000","last_change":"2024-04-18T21:05:04.640134+0000","last_active":"2024-04-18T21:05:07.360315+0000","last_peered":"2024-04-18T21:05:07.360315+0000","last_clean":"2024-04-18T21:05:07.360315+0000","last_became_active":"2024-04-18T21:05:04.638597+0000","last_became_peered":"2024-04-18T21:05:04.638597+0000","last_unstale":"2024-04-18T21:05:07.360315+0000","last_undegraded":"2024-04-18T21:05:07.360315+0000","last_fullsized":"2024-04-18T21:05:07.360315+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:56:05.795125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635677+0000","last_change":"2024-04-18T21:05:05.629022+0000","last_active":"2024-04-18T21:05:06.635677+0000","last_peered":"2024-04-18T21:05:06.635677+0000","last_clean":"2024-04-18T21:05:06.635677+0000","last_became_active":"2024-04-18T21:05:05.627643+0000","last_became_peered":"2024-04-18T21:05:05.627643+0000","last_unstale":"2024-04-18T21:05:06.635677+0000","last_undegraded":"2024-04-18T21:05:06.635677+0000","last_fullsized":"2024-04-18T21:05:06.635677+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:32:23.929877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359950+0000","last_change":"2024-04-18T21:05:04.641338+0000","last_active":"2024-04-18T21:05:07.359950+0000","last_peered":"2024-04-18T21:05:07.359950+0000","last_clean":"2024-04-18T21:05:07.359950+0000","last_became_active":"2024-04-18T21:05:04.639958+0000","last_became_peered":"2024-04-18T21:05:04.639958+0000","last_unstale":"2024-04-18T21:05:07.359950+0000","last_undegraded":"2024-04-18T21:05:07.359950+0000","last_fullsized":"2024-04-18T21:05:07.359950+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:42:45.392908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31340,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340500,"statfs":{"total":96636764160,"available":96604672000,"internally_reserved":0,"allocated":163840,"data_stored":55728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31928,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339912,"statfs":{"total":96636764160,"available":96604069888,"internally_reserved":0,"allocated":765952,"data_stored":642671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":782336,"data_stored":647890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:05:08.605 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:05:08.948 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:05:08.949 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-04-18T21:05:08.966 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-18T21:05:08.503095+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":247,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":125,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91056,"kb_used_data":1672,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024464,"statfs":{"total":289910292480,"available":289817051136,"internally_reserved":0,"allocated":1712128,"data_stored":1346289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.906378"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637590+0000","last_change":"2024-04-18T21:05:05.652795+0000","last_active":"2024-04-18T21:05:06.637590+0000","last_peered":"2024-04-18T21:05:06.637590+0000","last_clean":"2024-04-18T21:05:06.637590+0000","last_became_active":"2024-04-18T21:05:05.650121+0000","last_became_peered":"2024-04-18T21:05:05.650121+0000","last_unstale":"2024-04-18T21:05:06.637590+0000","last_undegraded":"2024-04-18T21:05:06.637590+0000","last_fullsized":"2024-04-18T21:05:06.637590+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637298+0000","last_change":"2024-04-18T21:05:05.657531+0000","last_active":"2024-04-18T21:05:06.637298+0000","last_peered":"2024-04-18T21:05:06.637298+0000","last_clean":"2024-04-18T21:05:06.637298+0000","last_became_active":"2024-04-18T21:05:05.653101+0000","last_became_peered":"2024-04-18T21:05:05.653101+0000","last_unstale":"2024-04-18T21:05:06.637298+0000","last_undegraded":"2024-04-18T21:05:06.637298+0000","last_fullsized":"2024-04-18T21:05:06.637298+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:32:23.929877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636411+0000","last_change":"2024-04-18T21:05:05.647965+0000","last_active":"2024-04-18T21:05:06.636411+0000","last_peered":"2024-04-18T21:05:06.636411+0000","last_clean":"2024-04-18T21:05:06.636411+0000","last_became_active":"2024-04-18T21:05:05.645931+0000","last_became_peered":"2024-04-18T21:05:05.645931+0000","last_unstale":"2024-04-18T21:05:06.636411+0000","last_undegraded":"2024-04-18T21:05:06.636411+0000","last_fullsized":"2024-04-18T21:05:06.636411+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:04.350492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637673+0000","last_change":"2024-04-18T21:05:05.629321+0000","last_active":"2024-04-18T21:05:06.637673+0000","last_peered":"2024-04-18T21:05:06.637673+0000","last_clean":"2024-04-18T21:05:06.637673+0000","last_became_active":"2024-04-18T21:05:05.627956+0000","last_became_peered":"2024-04-18T21:05:05.627956+0000","last_unstale":"2024-04-18T21:05:06.637673+0000","last_undegraded":"2024-04-18T21:05:06.637673+0000","last_fullsized":"2024-04-18T21:05:06.637673+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:15:28.458476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636510+0000","last_change":"2024-04-18T21:05:05.648710+0000","last_active":"2024-04-18T21:05:06.636510+0000","last_peered":"2024-04-18T21:05:06.636510+0000","last_clean":"2024-04-18T21:05:06.636510+0000","last_became_active":"2024-04-18T21:05:05.647801+0000","last_became_peered":"2024-04-18T21:05:05.647801+0000","last_unstale":"2024-04-18T21:05:06.636510+0000","last_undegraded":"2024-04-18T21:05:06.636510+0000","last_fullsized":"2024-04-18T21:05:06.636510+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:46:36.339289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635784+0000","last_change":"2024-04-18T21:05:05.629095+0000","last_active":"2024-04-18T21:05:06.635784+0000","last_peered":"2024-04-18T21:05:06.635784+0000","last_clean":"2024-04-18T21:05:06.635784+0000","last_became_active":"2024-04-18T21:05:05.627664+0000","last_became_peered":"2024-04-18T21:05:05.627664+0000","last_unstale":"2024-04-18T21:05:06.635784+0000","last_undegraded":"2024-04-18T21:05:06.635784+0000","last_fullsized":"2024-04-18T21:05:06.635784+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:51:28.440070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635525+0000","last_change":"2024-04-18T21:05:05.625047+0000","last_active":"2024-04-18T21:05:06.635525+0000","last_peered":"2024-04-18T21:05:06.635525+0000","last_clean":"2024-04-18T21:05:06.635525+0000","last_became_active":"2024-04-18T21:05:05.622781+0000","last_became_peered":"2024-04-18T21:05:05.622781+0000","last_unstale":"2024-04-18T21:05:06.635525+0000","last_undegraded":"2024-04-18T21:05:06.635525+0000","last_fullsized":"2024-04-18T21:05:06.635525+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:12.944469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.634795+0000","last_change":"2024-04-18T21:05:05.640390+0000","last_active":"2024-04-18T21:05:06.634795+0000","last_peered":"2024-04-18T21:05:06.634795+0000","last_clean":"2024-04-18T21:05:06.634795+0000","last_became_active":"2024-04-18T21:05:05.638295+0000","last_became_peered":"2024-04-18T21:05:05.638295+0000","last_unstale":"2024-04-18T21:05:06.634795+0000","last_undegraded":"2024-04-18T21:05:06.634795+0000","last_fullsized":"2024-04-18T21:05:06.634795+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:34:31.132458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359217+0000","last_change":"2024-04-18T21:05:05.660752+0000","last_active":"2024-04-18T21:05:07.359217+0000","last_peered":"2024-04-18T21:05:07.359217+0000","last_clean":"2024-04-18T21:05:07.359217+0000","last_became_active":"2024-04-18T21:05:05.659226+0000","last_became_peered":"2024-04-18T21:05:05.659226+0000","last_unstale":"2024-04-18T21:05:07.359217+0000","last_undegraded":"2024-04-18T21:05:07.359217+0000","last_fullsized":"2024-04-18T21:05:07.359217+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:20:45.938503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637371+0000","last_change":"2024-04-18T21:05:05.656660+0000","last_active":"2024-04-18T21:05:06.637371+0000","last_peered":"2024-04-18T21:05:06.637371+0000","last_clean":"2024-04-18T21:05:06.637371+0000","last_became_active":"2024-04-18T21:05:05.653829+0000","last_became_peered":"2024-04-18T21:05:05.653829+0000","last_unstale":"2024-04-18T21:05:06.637371+0000","last_undegraded":"2024-04-18T21:05:06.637371+0000","last_fullsized":"2024-04-18T21:05:06.637371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:50:40.920146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636818+0000","last_change":"2024-04-18T21:05:05.646721+0000","last_active":"2024-04-18T21:05:06.636818+0000","last_peered":"2024-04-18T21:05:06.636818+0000","last_clean":"2024-04-18T21:05:06.636818+0000","last_became_active":"2024-04-18T21:05:05.643421+0000","last_became_peered":"2024-04-18T21:05:05.643421+0000","last_unstale":"2024-04-18T21:05:06.636818+0000","last_undegraded":"2024-04-18T21:05:06.636818+0000","last_fullsized":"2024-04-18T21:05:06.636818+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:14:51.873741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636882+0000","last_change":"2024-04-18T21:05:05.656320+0000","last_active":"2024-04-18T21:05:06.636882+0000","last_peered":"2024-04-18T21:05:06.636882+0000","last_clean":"2024-04-18T21:05:06.636882+0000","last_became_active":"2024-04-18T21:05:05.655508+0000","last_became_peered":"2024-04-18T21:05:05.655508+0000","last_unstale":"2024-04-18T21:05:06.636882+0000","last_undegraded":"2024-04-18T21:05:06.636882+0000","last_fullsized":"2024-04-18T21:05:06.636882+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:51.225379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636068+0000","last_change":"2024-04-18T21:05:05.649001+0000","last_active":"2024-04-18T21:05:06.636068+0000","last_peered":"2024-04-18T21:05:06.636068+0000","last_clean":"2024-04-18T21:05:06.636068+0000","last_became_active":"2024-04-18T21:05:05.648070+0000","last_became_peered":"2024-04-18T21:05:05.648070+0000","last_unstale":"2024-04-18T21:05:06.636068+0000","last_undegraded":"2024-04-18T21:05:06.636068+0000","last_fullsized":"2024-04-18T21:05:06.636068+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:56.408234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636128+0000","last_change":"2024-04-18T21:05:05.635880+0000","last_active":"2024-04-18T21:05:06.636128+0000","last_peered":"2024-04-18T21:05:06.636128+0000","last_clean":"2024-04-18T21:05:06.636128+0000","last_became_active":"2024-04-18T21:05:05.635089+0000","last_became_peered":"2024-04-18T21:05:05.635089+0000","last_unstale":"2024-04-18T21:05:06.636128+0000","last_undegraded":"2024-04-18T21:05:06.636128+0000","last_fullsized":"2024-04-18T21:05:06.636128+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:50:40.920146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635604+0000","last_change":"2024-04-18T21:05:05.639640+0000","last_active":"2024-04-18T21:05:06.635604+0000","last_peered":"2024-04-18T21:05:06.635604+0000","last_clean":"2024-04-18T21:05:06.635604+0000","last_became_active":"2024-04-18T21:05:05.637311+0000","last_became_peered":"2024-04-18T21:05:05.637311+0000","last_unstale":"2024-04-18T21:05:06.635604+0000","last_undegraded":"2024-04-18T21:05:06.635604+0000","last_fullsized":"2024-04-18T21:05:06.635604+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:20:45.938503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.634796+0000","last_change":"2024-04-18T21:05:05.638203+0000","last_active":"2024-04-18T21:05:06.634796+0000","last_peered":"2024-04-18T21:05:06.634796+0000","last_clean":"2024-04-18T21:05:06.634796+0000","last_became_active":"2024-04-18T21:05:05.637352+0000","last_became_peered":"2024-04-18T21:05:05.637352+0000","last_unstale":"2024-04-18T21:05:06.634796+0000","last_undegraded":"2024-04-18T21:05:06.634796+0000","last_fullsized":"2024-04-18T21:05:06.634796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.360278+0000","last_change":"2024-04-18T21:05:05.661613+0000","last_active":"2024-04-18T21:05:07.360278+0000","last_peered":"2024-04-18T21:05:07.360278+0000","last_clean":"2024-04-18T21:05:07.360278+0000","last_became_active":"2024-04-18T21:05:05.660496+0000","last_became_peered":"2024-04-18T21:05:05.660496+0000","last_unstale":"2024-04-18T21:05:07.360278+0000","last_undegraded":"2024-04-18T21:05:07.360278+0000","last_fullsized":"2024-04-18T21:05:07.360278+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:31:31.842528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637954+0000","last_change":"2024-04-18T21:05:05.655261+0000","last_active":"2024-04-18T21:05:06.637954+0000","last_peered":"2024-04-18T21:05:06.637954+0000","last_clean":"2024-04-18T21:05:06.637954+0000","last_became_active":"2024-04-18T21:05:05.651388+0000","last_became_peered":"2024-04-18T21:05:05.651388+0000","last_unstale":"2024-04-18T21:05:06.637954+0000","last_undegraded":"2024-04-18T21:05:06.637954+0000","last_fullsized":"2024-04-18T21:05:06.637954+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:53.850184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359241+0000","last_change":"2024-04-18T21:05:05.652710+0000","last_active":"2024-04-18T21:05:07.359241+0000","last_peered":"2024-04-18T21:05:07.359241+0000","last_clean":"2024-04-18T21:05:07.359241+0000","last_became_active":"2024-04-18T21:05:05.651929+0000","last_became_peered":"2024-04-18T21:05:05.651929+0000","last_unstale":"2024-04-18T21:05:07.359241+0000","last_undegraded":"2024-04-18T21:05:07.359241+0000","last_fullsized":"2024-04-18T21:05:07.359241+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:12.944469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636438+0000","last_change":"2024-04-18T21:05:05.638338+0000","last_active":"2024-04-18T21:05:06.636438+0000","last_peered":"2024-04-18T21:05:06.636438+0000","last_clean":"2024-04-18T21:05:06.636438+0000","last_became_active":"2024-04-18T21:05:05.637567+0000","last_became_peered":"2024-04-18T21:05:05.637567+0000","last_unstale":"2024-04-18T21:05:06.636438+0000","last_undegraded":"2024-04-18T21:05:06.636438+0000","last_fullsized":"2024-04-18T21:05:06.636438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637117+0000","last_change":"2024-04-18T21:05:05.643606+0000","last_active":"2024-04-18T21:05:06.637117+0000","last_peered":"2024-04-18T21:05:06.637117+0000","last_clean":"2024-04-18T21:05:06.637117+0000","last_became_active":"2024-04-18T21:05:05.642991+0000","last_became_peered":"2024-04-18T21:05:05.642991+0000","last_unstale":"2024-04-18T21:05:06.637117+0000","last_undegraded":"2024-04-18T21:05:06.637117+0000","last_fullsized":"2024-04-18T21:05:06.637117+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:01.841786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636035+0000","last_change":"2024-04-18T21:05:05.650896+0000","last_active":"2024-04-18T21:05:06.636035+0000","last_peered":"2024-04-18T21:05:06.636035+0000","last_clean":"2024-04-18T21:05:06.636035+0000","last_became_active":"2024-04-18T21:05:05.650083+0000","last_became_peered":"2024-04-18T21:05:05.650083+0000","last_unstale":"2024-04-18T21:05:06.636035+0000","last_undegraded":"2024-04-18T21:05:06.636035+0000","last_fullsized":"2024-04-18T21:05:06.636035+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:43:55.788425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.357454+0000","last_change":"2024-04-18T21:05:05.640362+0000","last_active":"2024-04-18T21:05:07.357454+0000","last_peered":"2024-04-18T21:05:07.357454+0000","last_clean":"2024-04-18T21:05:07.357454+0000","last_became_active":"2024-04-18T21:05:05.635643+0000","last_became_peered":"2024-04-18T21:05:05.635643+0000","last_unstale":"2024-04-18T21:05:07.357454+0000","last_undegraded":"2024-04-18T21:05:07.357454+0000","last_fullsized":"2024-04-18T21:05:07.357454+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:43:55.788425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635029+0000","last_change":"2024-04-18T21:05:05.642755+0000","last_active":"2024-04-18T21:05:06.635029+0000","last_peered":"2024-04-18T21:05:06.635029+0000","last_clean":"2024-04-18T21:05:06.635029+0000","last_became_active":"2024-04-18T21:05:05.642150+0000","last_became_peered":"2024-04-18T21:05:05.642150+0000","last_unstale":"2024-04-18T21:05:06.635029+0000","last_undegraded":"2024-04-18T21:05:06.635029+0000","last_fullsized":"2024-04-18T21:05:06.635029+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:29:22.647425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637381+0000","last_change":"2024-04-18T21:05:05.653741+0000","last_active":"2024-04-18T21:05:06.637381+0000","last_peered":"2024-04-18T21:05:06.637381+0000","last_clean":"2024-04-18T21:05:06.637381+0000","last_became_active":"2024-04-18T21:05:05.650174+0000","last_became_peered":"2024-04-18T21:05:05.650174+0000","last_unstale":"2024-04-18T21:05:06.637381+0000","last_undegraded":"2024-04-18T21:05:06.637381+0000","last_fullsized":"2024-04-18T21:05:06.637381+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:04.350492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.360000+0000","last_change":"2024-04-18T21:05:05.649581+0000","last_active":"2024-04-18T21:05:07.360000+0000","last_peered":"2024-04-18T21:05:07.360000+0000","last_clean":"2024-04-18T21:05:07.360000+0000","last_became_active":"2024-04-18T21:05:05.648233+0000","last_became_peered":"2024-04-18T21:05:05.648233+0000","last_unstale":"2024-04-18T21:05:07.360000+0000","last_undegraded":"2024-04-18T21:05:07.360000+0000","last_fullsized":"2024-04-18T21:05:07.360000+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637099+0000","last_change":"2024-04-18T21:05:05.646926+0000","last_active":"2024-04-18T21:05:06.637099+0000","last_peered":"2024-04-18T21:05:06.637099+0000","last_clean":"2024-04-18T21:05:06.637099+0000","last_became_active":"2024-04-18T21:05:05.644942+0000","last_became_peered":"2024-04-18T21:05:05.644942+0000","last_unstale":"2024-04-18T21:05:06.637099+0000","last_undegraded":"2024-04-18T21:05:06.637099+0000","last_fullsized":"2024-04-18T21:05:06.637099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:53.850184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637629+0000","last_change":"2024-04-18T21:05:05.656314+0000","last_active":"2024-04-18T21:05:06.637629+0000","last_peered":"2024-04-18T21:05:06.637629+0000","last_clean":"2024-04-18T21:05:06.637629+0000","last_became_active":"2024-04-18T21:05:05.655364+0000","last_became_peered":"2024-04-18T21:05:05.655364+0000","last_unstale":"2024-04-18T21:05:06.637629+0000","last_undegraded":"2024-04-18T21:05:06.637629+0000","last_fullsized":"2024-04-18T21:05:06.637629+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:27:17.530889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358862+0000","last_change":"2024-04-18T21:05:05.653532+0000","last_active":"2024-04-18T21:05:07.358862+0000","last_peered":"2024-04-18T21:05:07.358862+0000","last_clean":"2024-04-18T21:05:07.358862+0000","last_became_active":"2024-04-18T21:05:05.652950+0000","last_became_peered":"2024-04-18T21:05:05.652950+0000","last_unstale":"2024-04-18T21:05:07.358862+0000","last_undegraded":"2024-04-18T21:05:07.358862+0000","last_fullsized":"2024-04-18T21:05:07.358862+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:51.225379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636535+0000","last_change":"2024-04-18T21:05:05.648084+0000","last_active":"2024-04-18T21:05:06.636535+0000","last_peered":"2024-04-18T21:05:06.636535+0000","last_clean":"2024-04-18T21:05:06.636535+0000","last_became_active":"2024-04-18T21:05:05.645340+0000","last_became_peered":"2024-04-18T21:05:05.645340+0000","last_unstale":"2024-04-18T21:05:06.636535+0000","last_undegraded":"2024-04-18T21:05:06.636535+0000","last_fullsized":"2024-04-18T21:05:06.636535+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:34:31.132458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.357930+0000","last_change":"2024-04-18T21:05:05.655034+0000","last_active":"2024-04-18T21:05:07.357930+0000","last_peered":"2024-04-18T21:05:07.357930+0000","last_clean":"2024-04-18T21:05:07.357930+0000","last_became_active":"2024-04-18T21:05:05.654517+0000","last_became_peered":"2024-04-18T21:05:05.654517+0000","last_unstale":"2024-04-18T21:05:07.357930+0000","last_undegraded":"2024-04-18T21:05:07.357930+0000","last_fullsized":"2024-04-18T21:05:07.357930+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:34:38.427319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635266+0000","last_change":"2024-04-18T21:05:05.626677+0000","last_active":"2024-04-18T21:05:06.635266+0000","last_peered":"2024-04-18T21:05:06.635266+0000","last_clean":"2024-04-18T21:05:06.635266+0000","last_became_active":"2024-04-18T21:05:05.624250+0000","last_became_peered":"2024-04-18T21:05:05.624250+0000","last_unstale":"2024-04-18T21:05:06.635266+0000","last_undegraded":"2024-04-18T21:05:06.635266+0000","last_fullsized":"2024-04-18T21:05:06.635266+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:51.225379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637347+0000","last_change":"2024-04-18T21:05:05.649918+0000","last_active":"2024-04-18T21:05:06.637347+0000","last_peered":"2024-04-18T21:05:06.637347+0000","last_clean":"2024-04-18T21:05:06.637347+0000","last_became_active":"2024-04-18T21:05:05.647147+0000","last_became_peered":"2024-04-18T21:05:05.647147+0000","last_unstale":"2024-04-18T21:05:06.637347+0000","last_undegraded":"2024-04-18T21:05:06.637347+0000","last_fullsized":"2024-04-18T21:05:06.637347+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:51:28.440070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637900+0000","last_change":"2024-04-18T21:05:04.632748+0000","last_active":"2024-04-18T21:05:06.637900+0000","last_peered":"2024-04-18T21:05:06.637900+0000","last_clean":"2024-04-18T21:05:06.637900+0000","last_became_active":"2024-04-18T21:05:04.628407+0000","last_became_peered":"2024-04-18T21:05:04.628407+0000","last_unstale":"2024-04-18T21:05:06.637900+0000","last_undegraded":"2024-04-18T21:05:06.637900+0000","last_fullsized":"2024-04-18T21:05:06.637900+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:42:45.392908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637688+0000","last_change":"2024-04-18T21:05:05.649199+0000","last_active":"2024-04-18T21:05:06.637688+0000","last_peered":"2024-04-18T21:05:06.637688+0000","last_clean":"2024-04-18T21:05:06.637688+0000","last_became_active":"2024-04-18T21:05:05.646898+0000","last_became_peered":"2024-04-18T21:05:05.646898+0000","last_unstale":"2024-04-18T21:05:06.637688+0000","last_undegraded":"2024-04-18T21:05:06.637688+0000","last_fullsized":"2024-04-18T21:05:06.637688+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:31:31.842528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358409+0000","last_change":"2024-04-18T21:05:04.638017+0000","last_active":"2024-04-18T21:05:07.358409+0000","last_peered":"2024-04-18T21:05:07.358409+0000","last_clean":"2024-04-18T21:05:07.358409+0000","last_became_active":"2024-04-18T21:05:04.637287+0000","last_became_peered":"2024-04-18T21:05:04.637287+0000","last_unstale":"2024-04-18T21:05:07.358409+0000","last_undegraded":"2024-04-18T21:05:07.358409+0000","last_fullsized":"2024-04-18T21:05:07.358409+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:25.891472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.360516+0000","last_change":"2024-04-18T21:05:05.650757+0000","last_active":"2024-04-18T21:05:07.360516+0000","last_peered":"2024-04-18T21:05:07.360516+0000","last_clean":"2024-04-18T21:05:07.360516+0000","last_became_active":"2024-04-18T21:05:05.650143+0000","last_became_peered":"2024-04-18T21:05:05.650143+0000","last_unstale":"2024-04-18T21:05:07.360516+0000","last_undegraded":"2024-04-18T21:05:07.360516+0000","last_fullsized":"2024-04-18T21:05:07.360516+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:14:51.873741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635796+0000","last_change":"2024-04-18T21:05:04.628489+0000","last_active":"2024-04-18T21:05:06.635796+0000","last_peered":"2024-04-18T21:05:06.635796+0000","last_clean":"2024-04-18T21:05:06.635796+0000","last_became_active":"2024-04-18T21:05:04.627279+0000","last_became_peered":"2024-04-18T21:05:04.627279+0000","last_unstale":"2024-04-18T21:05:06.635796+0000","last_undegraded":"2024-04-18T21:05:06.635796+0000","last_fullsized":"2024-04-18T21:05:06.635796+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:43:23.420744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359664+0000","last_change":"2024-04-18T21:05:05.649347+0000","last_active":"2024-04-18T21:05:07.359664+0000","last_peered":"2024-04-18T21:05:07.359664+0000","last_clean":"2024-04-18T21:05:07.359664+0000","last_became_active":"2024-04-18T21:05:05.648144+0000","last_became_peered":"2024-04-18T21:05:05.648144+0000","last_unstale":"2024-04-18T21:05:07.359664+0000","last_undegraded":"2024-04-18T21:05:07.359664+0000","last_fullsized":"2024-04-18T21:05:07.359664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:51:28.440070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":22,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635267+0000","last_change":"2024-04-18T21:05:04.624089+0000","last_active":"2024-04-18T21:05:06.635267+0000","last_peered":"2024-04-18T21:05:06.635267+0000","last_clean":"2024-04-18T21:05:06.635267+0000","last_became_active":"2024-04-18T21:05:04.623238+0000","last_became_peered":"2024-04-18T21:05:04.623238+0000","last_unstale":"2024-04-18T21:05:06.635267+0000","last_undegraded":"2024-04-18T21:05:06.635267+0000","last_fullsized":"2024-04-18T21:05:06.635267+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:44:19.076499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637569+0000","last_change":"2024-04-18T21:05:04.633907+0000","last_active":"2024-04-18T21:05:06.637569+0000","last_peered":"2024-04-18T21:05:06.637569+0000","last_clean":"2024-04-18T21:05:06.637569+0000","last_became_active":"2024-04-18T21:05:04.630308+0000","last_became_peered":"2024-04-18T21:05:04.630308+0000","last_unstale":"2024-04-18T21:05:06.637569+0000","last_undegraded":"2024-04-18T21:05:06.637569+0000","last_fullsized":"2024-04-18T21:05:06.637569+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:55:46.219812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635046+0000","last_change":"2024-04-18T21:05:05.658572+0000","last_active":"2024-04-18T21:05:06.635046+0000","last_peered":"2024-04-18T21:05:06.635046+0000","last_clean":"2024-04-18T21:05:06.635046+0000","last_became_active":"2024-04-18T21:05:05.657842+0000","last_became_peered":"2024-04-18T21:05:05.657842+0000","last_unstale":"2024-04-18T21:05:06.635046+0000","last_undegraded":"2024-04-18T21:05:06.635046+0000","last_fullsized":"2024-04-18T21:05:06.635046+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:26:38.636530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.638161+0000","last_change":"2024-04-18T21:05:04.628541+0000","last_active":"2024-04-18T21:05:06.638161+0000","last_peered":"2024-04-18T21:05:06.638161+0000","last_clean":"2024-04-18T21:05:06.638161+0000","last_became_active":"2024-04-18T21:05:04.627407+0000","last_became_peered":"2024-04-18T21:05:04.627407+0000","last_unstale":"2024-04-18T21:05:06.638161+0000","last_undegraded":"2024-04-18T21:05:06.638161+0000","last_fullsized":"2024-04-18T21:05:06.638161+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:55:48.643174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635639+0000","last_change":"2024-04-18T21:05:05.651649+0000","last_active":"2024-04-18T21:05:06.635639+0000","last_peered":"2024-04-18T21:05:06.635639+0000","last_clean":"2024-04-18T21:05:06.635639+0000","last_became_active":"2024-04-18T21:05:05.646809+0000","last_became_peered":"2024-04-18T21:05:05.646809+0000","last_unstale":"2024-04-18T21:05:06.635639+0000","last_undegraded":"2024-04-18T21:05:06.635639+0000","last_fullsized":"2024-04-18T21:05:06.635639+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:23.698827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637684+0000","last_change":"2024-04-18T21:05:04.634055+0000","last_active":"2024-04-18T21:05:06.637684+0000","last_peered":"2024-04-18T21:05:06.637684+0000","last_clean":"2024-04-18T21:05:06.637684+0000","last_became_active":"2024-04-18T21:05:04.630736+0000","last_became_peered":"2024-04-18T21:05:04.630736+0000","last_unstale":"2024-04-18T21:05:06.637684+0000","last_undegraded":"2024-04-18T21:05:06.637684+0000","last_fullsized":"2024-04-18T21:05:06.637684+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:06:44.001512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636585+0000","last_change":"2024-04-18T21:05:05.628869+0000","last_active":"2024-04-18T21:05:06.636585+0000","last_peered":"2024-04-18T21:05:06.636585+0000","last_clean":"2024-04-18T21:05:06.636585+0000","last_became_active":"2024-04-18T21:05:05.627071+0000","last_became_peered":"2024-04-18T21:05:05.627071+0000","last_unstale":"2024-04-18T21:05:06.636585+0000","last_undegraded":"2024-04-18T21:05:06.636585+0000","last_fullsized":"2024-04-18T21:05:06.636585+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:31:31.842528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.638123+0000","last_change":"2024-04-18T21:05:04.625520+0000","last_active":"2024-04-18T21:05:06.638123+0000","last_peered":"2024-04-18T21:05:06.638123+0000","last_clean":"2024-04-18T21:05:06.638123+0000","last_became_active":"2024-04-18T21:05:04.624656+0000","last_became_peered":"2024-04-18T21:05:04.624656+0000","last_unstale":"2024-04-18T21:05:06.638123+0000","last_undegraded":"2024-04-18T21:05:06.638123+0000","last_fullsized":"2024-04-18T21:05:06.638123+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:56:05.795125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358238+0000","last_change":"2024-04-18T21:05:05.649406+0000","last_active":"2024-04-18T21:05:07.358238+0000","last_peered":"2024-04-18T21:05:07.358238+0000","last_clean":"2024-04-18T21:05:07.358238+0000","last_became_active":"2024-04-18T21:05:05.648380+0000","last_became_peered":"2024-04-18T21:05:05.648380+0000","last_unstale":"2024-04-18T21:05:07.358238+0000","last_undegraded":"2024-04-18T21:05:07.358238+0000","last_fullsized":"2024-04-18T21:05:07.358238+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359521+0000","last_change":"2024-04-18T21:05:04.640216+0000","last_active":"2024-04-18T21:05:07.359521+0000","last_peered":"2024-04-18T21:05:07.359521+0000","last_clean":"2024-04-18T21:05:07.359521+0000","last_became_active":"2024-04-18T21:05:04.639349+0000","last_became_peered":"2024-04-18T21:05:04.639349+0000","last_unstale":"2024-04-18T21:05:07.359521+0000","last_undegraded":"2024-04-18T21:05:07.359521+0000","last_fullsized":"2024-04-18T21:05:07.359521+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:09:18.466987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637709+0000","last_change":"2024-04-18T21:05:05.628850+0000","last_active":"2024-04-18T21:05:06.637709+0000","last_peered":"2024-04-18T21:05:06.637709+0000","last_clean":"2024-04-18T21:05:06.637709+0000","last_became_active":"2024-04-18T21:05:05.627521+0000","last_became_peered":"2024-04-18T21:05:05.627521+0000","last_unstale":"2024-04-18T21:05:06.637709+0000","last_undegraded":"2024-04-18T21:05:06.637709+0000","last_fullsized":"2024-04-18T21:05:06.637709+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:14:37.912032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636946+0000","last_change":"2024-04-18T21:05:04.634674+0000","last_active":"2024-04-18T21:05:06.636946+0000","last_peered":"2024-04-18T21:05:06.636946+0000","last_clean":"2024-04-18T21:05:06.636946+0000","last_became_active":"2024-04-18T21:05:04.632284+0000","last_became_peered":"2024-04-18T21:05:04.632284+0000","last_unstale":"2024-04-18T21:05:06.636946+0000","last_undegraded":"2024-04-18T21:05:06.636946+0000","last_fullsized":"2024-04-18T21:05:06.636946+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:09:18.466987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637414+0000","last_change":"2024-04-18T21:05:05.647377+0000","last_active":"2024-04-18T21:05:06.637414+0000","last_peered":"2024-04-18T21:05:06.637414+0000","last_clean":"2024-04-18T21:05:06.637414+0000","last_became_active":"2024-04-18T21:05:05.645067+0000","last_became_peered":"2024-04-18T21:05:05.645067+0000","last_unstale":"2024-04-18T21:05:06.637414+0000","last_undegraded":"2024-04-18T21:05:06.637414+0000","last_fullsized":"2024-04-18T21:05:06.637414+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:29:30.243751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636012+0000","last_change":"2024-04-18T21:05:04.627578+0000","last_active":"2024-04-18T21:05:06.636012+0000","last_peered":"2024-04-18T21:05:06.636012+0000","last_clean":"2024-04-18T21:05:06.636012+0000","last_became_active":"2024-04-18T21:05:04.626786+0000","last_became_peered":"2024-04-18T21:05:04.626786+0000","last_unstale":"2024-04-18T21:05:06.636012+0000","last_undegraded":"2024-04-18T21:05:06.636012+0000","last_fullsized":"2024-04-18T21:05:06.636012+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:55:59.563512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637217+0000","last_change":"2024-04-18T21:05:05.640817+0000","last_active":"2024-04-18T21:05:06.637217+0000","last_peered":"2024-04-18T21:05:06.637217+0000","last_clean":"2024-04-18T21:05:06.637217+0000","last_became_active":"2024-04-18T21:05:05.635526+0000","last_became_peered":"2024-04-18T21:05:05.635526+0000","last_unstale":"2024-04-18T21:05:06.637217+0000","last_undegraded":"2024-04-18T21:05:06.637217+0000","last_fullsized":"2024-04-18T21:05:06.637217+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:44:29.823511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635339+0000","last_change":"2024-04-18T21:05:04.636499+0000","last_active":"2024-04-18T21:05:06.635339+0000","last_peered":"2024-04-18T21:05:06.635339+0000","last_clean":"2024-04-18T21:05:06.635339+0000","last_became_active":"2024-04-18T21:05:04.635830+0000","last_became_peered":"2024-04-18T21:05:04.635830+0000","last_unstale":"2024-04-18T21:05:06.635339+0000","last_undegraded":"2024-04-18T21:05:06.635339+0000","last_fullsized":"2024-04-18T21:05:06.635339+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:26:30.565175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359678+0000","last_change":"2024-04-18T21:05:05.660974+0000","last_active":"2024-04-18T21:05:07.359678+0000","last_peered":"2024-04-18T21:05:07.359678+0000","last_clean":"2024-04-18T21:05:07.359678+0000","last_became_active":"2024-04-18T21:05:05.659287+0000","last_became_peered":"2024-04-18T21:05:05.659287+0000","last_unstale":"2024-04-18T21:05:07.359678+0000","last_undegraded":"2024-04-18T21:05:07.359678+0000","last_fullsized":"2024-04-18T21:05:07.359678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:50:40.920146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":222,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636126+0000","last_change":"2024-04-18T21:04:54.511605+0000","last_active":"2024-04-18T21:05:06.636126+0000","last_peered":"2024-04-18T21:05:06.636126+0000","last_clean":"2024-04-18T21:05:06.636126+0000","last_became_active":"2024-04-18T21:04:54.510791+0000","last_became_peered":"2024-04-18T21:04:54.510791+0000","last_unstale":"2024-04-18T21:05:06.636126+0000","last_undegraded":"2024-04-18T21:05:06.636126+0000","last_fullsized":"2024-04-18T21:05:06.636126+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_clean_scrub_stamp":"2024-04-18T21:04:53.494814+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:46.262250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.638030+0000","last_change":"2024-04-18T21:05:00.576671+0000","last_active":"2024-04-18T21:05:06.638030+0000","last_peered":"2024-04-18T21:05:06.638030+0000","last_clean":"2024-04-18T21:05:06.638030+0000","last_became_active":"2024-04-18T21:05:00.575933+0000","last_became_peered":"2024-04-18T21:05:00.575933+0000","last_unstale":"2024-04-18T21:05:06.638030+0000","last_undegraded":"2024-04-18T21:05:06.638030+0000","last_fullsized":"2024-04-18T21:05:06.638030+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:14:59.207959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358678+0000","last_change":"2024-04-18T21:05:04.639528+0000","last_active":"2024-04-18T21:05:07.358678+0000","last_peered":"2024-04-18T21:05:07.358678+0000","last_clean":"2024-04-18T21:05:07.358678+0000","last_became_active":"2024-04-18T21:05:04.638517+0000","last_became_peered":"2024-04-18T21:05:04.638517+0000","last_unstale":"2024-04-18T21:05:07.358678+0000","last_undegraded":"2024-04-18T21:05:07.358678+0000","last_fullsized":"2024-04-18T21:05:07.358678+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:55:46.219812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637482+0000","last_change":"2024-04-18T21:05:05.647623+0000","last_active":"2024-04-18T21:05:06.637482+0000","last_peered":"2024-04-18T21:05:06.637482+0000","last_clean":"2024-04-18T21:05:06.637482+0000","last_became_active":"2024-04-18T21:05:05.645640+0000","last_became_peered":"2024-04-18T21:05:05.645640+0000","last_unstale":"2024-04-18T21:05:06.637482+0000","last_undegraded":"2024-04-18T21:05:06.637482+0000","last_fullsized":"2024-04-18T21:05:06.637482+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:59.950421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635615+0000","last_change":"2024-04-18T21:05:00.571960+0000","last_active":"2024-04-18T21:05:06.635615+0000","last_peered":"2024-04-18T21:05:06.635615+0000","last_clean":"2024-04-18T21:05:06.635615+0000","last_became_active":"2024-04-18T21:05:00.571301+0000","last_became_peered":"2024-04-18T21:05:00.571301+0000","last_unstale":"2024-04-18T21:05:06.635615+0000","last_undegraded":"2024-04-18T21:05:06.635615+0000","last_fullsized":"2024-04-18T21:05:06.635615+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:31:59.262440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358645+0000","last_change":"2024-04-18T21:05:04.638026+0000","last_active":"2024-04-18T21:05:07.358645+0000","last_peered":"2024-04-18T21:05:07.358645+0000","last_clean":"2024-04-18T21:05:07.358645+0000","last_became_active":"2024-04-18T21:05:04.637160+0000","last_became_peered":"2024-04-18T21:05:04.637160+0000","last_unstale":"2024-04-18T21:05:07.358645+0000","last_undegraded":"2024-04-18T21:05:07.358645+0000","last_fullsized":"2024-04-18T21:05:07.358645+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:33:48.703994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.638058+0000","last_change":"2024-04-18T21:05:05.654121+0000","last_active":"2024-04-18T21:05:06.638058+0000","last_peered":"2024-04-18T21:05:06.638058+0000","last_clean":"2024-04-18T21:05:06.638058+0000","last_became_active":"2024-04-18T21:05:05.651310+0000","last_became_peered":"2024-04-18T21:05:05.651310+0000","last_unstale":"2024-04-18T21:05:06.638058+0000","last_undegraded":"2024-04-18T21:05:06.638058+0000","last_fullsized":"2024-04-18T21:05:06.638058+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:01.841786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359064+0000","last_change":"2024-04-18T21:05:00.578604+0000","last_active":"2024-04-18T21:05:07.359064+0000","last_peered":"2024-04-18T21:05:07.359064+0000","last_clean":"2024-04-18T21:05:07.359064+0000","last_became_active":"2024-04-18T21:05:00.577988+0000","last_became_peered":"2024-04-18T21:05:00.577988+0000","last_unstale":"2024-04-18T21:05:07.359064+0000","last_undegraded":"2024-04-18T21:05:07.359064+0000","last_fullsized":"2024-04-18T21:05:07.359064+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:54:54.201759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635569+0000","last_change":"2024-04-18T21:05:04.627627+0000","last_active":"2024-04-18T21:05:06.635569+0000","last_peered":"2024-04-18T21:05:06.635569+0000","last_clean":"2024-04-18T21:05:06.635569+0000","last_became_active":"2024-04-18T21:05:04.626850+0000","last_became_peered":"2024-04-18T21:05:04.626850+0000","last_unstale":"2024-04-18T21:05:06.635569+0000","last_undegraded":"2024-04-18T21:05:06.635569+0000","last_fullsized":"2024-04-18T21:05:06.635569+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:43:31.453080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359914+0000","last_change":"2024-04-18T21:05:05.661488+0000","last_active":"2024-04-18T21:05:07.359914+0000","last_peered":"2024-04-18T21:05:07.359914+0000","last_clean":"2024-04-18T21:05:07.359914+0000","last_became_active":"2024-04-18T21:05:05.660283+0000","last_became_peered":"2024-04-18T21:05:05.660283+0000","last_unstale":"2024-04-18T21:05:07.359914+0000","last_undegraded":"2024-04-18T21:05:07.359914+0000","last_fullsized":"2024-04-18T21:05:07.359914+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:04.350492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637285+0000","last_change":"2024-04-18T21:05:00.576606+0000","last_active":"2024-04-18T21:05:06.637285+0000","last_peered":"2024-04-18T21:05:06.637285+0000","last_clean":"2024-04-18T21:05:06.637285+0000","last_became_active":"2024-04-18T21:05:00.575951+0000","last_became_peered":"2024-04-18T21:05:00.575951+0000","last_unstale":"2024-04-18T21:05:06.637285+0000","last_undegraded":"2024-04-18T21:05:06.637285+0000","last_fullsized":"2024-04-18T21:05:06.637285+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:32:17.612481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637939+0000","last_change":"2024-04-18T21:05:04.627296+0000","last_active":"2024-04-18T21:05:06.637939+0000","last_peered":"2024-04-18T21:05:06.637939+0000","last_clean":"2024-04-18T21:05:06.637939+0000","last_became_active":"2024-04-18T21:05:04.626801+0000","last_became_peered":"2024-04-18T21:05:04.626801+0000","last_unstale":"2024-04-18T21:05:06.637939+0000","last_undegraded":"2024-04-18T21:05:06.637939+0000","last_fullsized":"2024-04-18T21:05:06.637939+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:46:36.285416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359434+0000","last_change":"2024-04-18T21:05:05.655152+0000","last_active":"2024-04-18T21:05:07.359434+0000","last_peered":"2024-04-18T21:05:07.359434+0000","last_clean":"2024-04-18T21:05:07.359434+0000","last_became_active":"2024-04-18T21:05:05.654506+0000","last_became_peered":"2024-04-18T21:05:05.654506+0000","last_unstale":"2024-04-18T21:05:07.359434+0000","last_undegraded":"2024-04-18T21:05:07.359434+0000","last_fullsized":"2024-04-18T21:05:07.359434+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:32:23.929877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637718+0000","last_change":"2024-04-18T21:05:04.628916+0000","last_active":"2024-04-18T21:05:06.637718+0000","last_peered":"2024-04-18T21:05:06.637718+0000","last_clean":"2024-04-18T21:05:06.637718+0000","last_became_active":"2024-04-18T21:05:04.628245+0000","last_became_peered":"2024-04-18T21:05:04.628245+0000","last_unstale":"2024-04-18T21:05:06.637718+0000","last_undegraded":"2024-04-18T21:05:06.637718+0000","last_fullsized":"2024-04-18T21:05:06.637718+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:34:58.562540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359757+0000","last_change":"2024-04-18T21:05:00.578563+0000","last_active":"2024-04-18T21:05:07.359757+0000","last_peered":"2024-04-18T21:05:07.359757+0000","last_clean":"2024-04-18T21:05:07.359757+0000","last_became_active":"2024-04-18T21:05:00.577960+0000","last_became_peered":"2024-04-18T21:05:00.577960+0000","last_unstale":"2024-04-18T21:05:07.359757+0000","last_undegraded":"2024-04-18T21:05:07.359757+0000","last_fullsized":"2024-04-18T21:05:07.359757+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:31:59.262440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636313+0000","last_change":"2024-04-18T21:05:05.646076+0000","last_active":"2024-04-18T21:05:06.636313+0000","last_peered":"2024-04-18T21:05:06.636313+0000","last_clean":"2024-04-18T21:05:06.636313+0000","last_became_active":"2024-04-18T21:05:05.645104+0000","last_became_peered":"2024-04-18T21:05:05.645104+0000","last_unstale":"2024-04-18T21:05:06.636313+0000","last_undegraded":"2024-04-18T21:05:06.636313+0000","last_fullsized":"2024-04-18T21:05:06.636313+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:34:38.427319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359695+0000","last_change":"2024-04-18T21:05:04.639700+0000","last_active":"2024-04-18T21:05:07.359695+0000","last_peered":"2024-04-18T21:05:07.359695+0000","last_clean":"2024-04-18T21:05:07.359695+0000","last_became_active":"2024-04-18T21:05:04.638928+0000","last_became_peered":"2024-04-18T21:05:04.638928+0000","last_unstale":"2024-04-18T21:05:07.359695+0000","last_undegraded":"2024-04-18T21:05:07.359695+0000","last_fullsized":"2024-04-18T21:05:07.359695+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:00:08.877854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.638177+0000","last_change":"2024-04-18T21:05:00.576907+0000","last_active":"2024-04-18T21:05:06.638177+0000","last_peered":"2024-04-18T21:05:06.638177+0000","last_clean":"2024-04-18T21:05:06.638177+0000","last_became_active":"2024-04-18T21:05:00.576152+0000","last_became_peered":"2024-04-18T21:05:00.576152+0000","last_unstale":"2024-04-18T21:05:06.638177+0000","last_undegraded":"2024-04-18T21:05:06.638177+0000","last_fullsized":"2024-04-18T21:05:06.638177+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:25:07.270023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636117+0000","last_change":"2024-04-18T21:05:05.646026+0000","last_active":"2024-04-18T21:05:06.636117+0000","last_peered":"2024-04-18T21:05:06.636117+0000","last_clean":"2024-04-18T21:05:06.636117+0000","last_became_active":"2024-04-18T21:05:05.645192+0000","last_became_peered":"2024-04-18T21:05:05.645192+0000","last_unstale":"2024-04-18T21:05:06.636117+0000","last_undegraded":"2024-04-18T21:05:06.636117+0000","last_fullsized":"2024-04-18T21:05:06.636117+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:05:46.009381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.360443+0000","last_change":"2024-04-18T21:05:04.640732+0000","last_active":"2024-04-18T21:05:07.360443+0000","last_peered":"2024-04-18T21:05:07.360443+0000","last_clean":"2024-04-18T21:05:07.360443+0000","last_became_active":"2024-04-18T21:05:04.638505+0000","last_became_peered":"2024-04-18T21:05:04.638505+0000","last_unstale":"2024-04-18T21:05:07.360443+0000","last_undegraded":"2024-04-18T21:05:07.360443+0000","last_fullsized":"2024-04-18T21:05:07.360443+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:34:58.562540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.360549+0000","last_change":"2024-04-18T21:05:00.579869+0000","last_active":"2024-04-18T21:05:07.360549+0000","last_peered":"2024-04-18T21:05:07.360549+0000","last_clean":"2024-04-18T21:05:07.360549+0000","last_became_active":"2024-04-18T21:05:00.579351+0000","last_became_peered":"2024-04-18T21:05:00.579351+0000","last_unstale":"2024-04-18T21:05:07.360549+0000","last_undegraded":"2024-04-18T21:05:07.360549+0000","last_fullsized":"2024-04-18T21:05:07.360549+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:15:02.061128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.357811+0000","last_change":"2024-04-18T21:05:05.642730+0000","last_active":"2024-04-18T21:05:07.357811+0000","last_peered":"2024-04-18T21:05:07.357811+0000","last_clean":"2024-04-18T21:05:07.357811+0000","last_became_active":"2024-04-18T21:05:05.641890+0000","last_became_peered":"2024-04-18T21:05:05.641890+0000","last_unstale":"2024-04-18T21:05:07.357811+0000","last_undegraded":"2024-04-18T21:05:07.357811+0000","last_fullsized":"2024-04-18T21:05:07.357811+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:05:46.009381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.360476+0000","last_change":"2024-04-18T21:05:04.639898+0000","last_active":"2024-04-18T21:05:07.360476+0000","last_peered":"2024-04-18T21:05:07.360476+0000","last_clean":"2024-04-18T21:05:07.360476+0000","last_became_active":"2024-04-18T21:05:04.639115+0000","last_became_peered":"2024-04-18T21:05:04.639115+0000","last_unstale":"2024-04-18T21:05:07.360476+0000","last_undegraded":"2024-04-18T21:05:07.360476+0000","last_fullsized":"2024-04-18T21:05:07.360476+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:44:19.076499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637757+0000","last_change":"2024-04-18T21:05:00.572414+0000","last_active":"2024-04-18T21:05:06.637757+0000","last_peered":"2024-04-18T21:05:06.637757+0000","last_clean":"2024-04-18T21:05:06.637757+0000","last_became_active":"2024-04-18T21:05:00.571755+0000","last_became_peered":"2024-04-18T21:05:00.571755+0000","last_unstale":"2024-04-18T21:05:06.637757+0000","last_undegraded":"2024-04-18T21:05:06.637757+0000","last_fullsized":"2024-04-18T21:05:06.637757+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:15:02.061128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635489+0000","last_change":"2024-04-18T21:05:05.655898+0000","last_active":"2024-04-18T21:05:06.635489+0000","last_peered":"2024-04-18T21:05:06.635489+0000","last_clean":"2024-04-18T21:05:06.635489+0000","last_became_active":"2024-04-18T21:05:05.654111+0000","last_became_peered":"2024-04-18T21:05:05.654111+0000","last_unstale":"2024-04-18T21:05:06.635489+0000","last_undegraded":"2024-04-18T21:05:06.635489+0000","last_fullsized":"2024-04-18T21:05:06.635489+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:19:38.537080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637592+0000","last_change":"2024-04-18T21:05:05.641373+0000","last_active":"2024-04-18T21:05:06.637592+0000","last_peered":"2024-04-18T21:05:06.637592+0000","last_clean":"2024-04-18T21:05:06.637592+0000","last_became_active":"2024-04-18T21:05:05.634204+0000","last_became_peered":"2024-04-18T21:05:05.634204+0000","last_unstale":"2024-04-18T21:05:06.637592+0000","last_undegraded":"2024-04-18T21:05:06.637592+0000","last_fullsized":"2024-04-18T21:05:06.637592+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:27:35.995004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637977+0000","last_change":"2024-04-18T21:05:04.631271+0000","last_active":"2024-04-18T21:05:06.637977+0000","last_peered":"2024-04-18T21:05:06.637977+0000","last_clean":"2024-04-18T21:05:06.637977+0000","last_became_active":"2024-04-18T21:05:04.630442+0000","last_became_peered":"2024-04-18T21:05:04.630442+0000","last_unstale":"2024-04-18T21:05:06.637977+0000","last_undegraded":"2024-04-18T21:05:06.637977+0000","last_fullsized":"2024-04-18T21:05:06.637977+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:33:48.703994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358112+0000","last_change":"2024-04-18T21:05:05.637894+0000","last_active":"2024-04-18T21:05:07.358112+0000","last_peered":"2024-04-18T21:05:07.358112+0000","last_clean":"2024-04-18T21:05:07.358112+0000","last_became_active":"2024-04-18T21:05:05.636846+0000","last_became_peered":"2024-04-18T21:05:05.636846+0000","last_unstale":"2024-04-18T21:05:07.358112+0000","last_undegraded":"2024-04-18T21:05:07.358112+0000","last_fullsized":"2024-04-18T21:05:07.358112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:34:31.132458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637990+0000","last_change":"2024-04-18T21:05:04.631152+0000","last_active":"2024-04-18T21:05:06.637990+0000","last_peered":"2024-04-18T21:05:06.637990+0000","last_clean":"2024-04-18T21:05:06.637990+0000","last_became_active":"2024-04-18T21:05:04.628900+0000","last_became_peered":"2024-04-18T21:05:04.628900+0000","last_unstale":"2024-04-18T21:05:06.637990+0000","last_undegraded":"2024-04-18T21:05:06.637990+0000","last_fullsized":"2024-04-18T21:05:06.637990+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:40:21.452052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637452+0000","last_change":"2024-04-18T21:05:04.629470+0000","last_active":"2024-04-18T21:05:06.637452+0000","last_peered":"2024-04-18T21:05:06.637452+0000","last_clean":"2024-04-18T21:05:06.637452+0000","last_became_active":"2024-04-18T21:05:04.628286+0000","last_became_peered":"2024-04-18T21:05:04.628286+0000","last_unstale":"2024-04-18T21:05:06.637452+0000","last_undegraded":"2024-04-18T21:05:06.637452+0000","last_fullsized":"2024-04-18T21:05:06.637452+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:00:08.877854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358071+0000","last_change":"2024-04-18T21:05:05.642793+0000","last_active":"2024-04-18T21:05:07.358071+0000","last_peered":"2024-04-18T21:05:07.358071+0000","last_clean":"2024-04-18T21:05:07.358071+0000","last_became_active":"2024-04-18T21:05:05.641983+0000","last_became_peered":"2024-04-18T21:05:05.641983+0000","last_unstale":"2024-04-18T21:05:07.358071+0000","last_undegraded":"2024-04-18T21:05:07.358071+0000","last_fullsized":"2024-04-18T21:05:07.358071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:46:36.339289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.360264+0000","last_change":"2024-04-18T21:05:04.641445+0000","last_active":"2024-04-18T21:05:07.360264+0000","last_peered":"2024-04-18T21:05:07.360264+0000","last_clean":"2024-04-18T21:05:07.360264+0000","last_became_active":"2024-04-18T21:05:04.640682+0000","last_became_peered":"2024-04-18T21:05:04.640682+0000","last_unstale":"2024-04-18T21:05:07.360264+0000","last_undegraded":"2024-04-18T21:05:07.360264+0000","last_fullsized":"2024-04-18T21:05:07.360264+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:46:36.285416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.357743+0000","last_change":"2024-04-18T21:05:05.641561+0000","last_active":"2024-04-18T21:05:07.357743+0000","last_peered":"2024-04-18T21:05:07.357743+0000","last_clean":"2024-04-18T21:05:07.357743+0000","last_became_active":"2024-04-18T21:05:05.640922+0000","last_became_peered":"2024-04-18T21:05:05.640922+0000","last_unstale":"2024-04-18T21:05:07.357743+0000","last_undegraded":"2024-04-18T21:05:07.357743+0000","last_fullsized":"2024-04-18T21:05:07.357743+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:56.408234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637829+0000","last_change":"2024-04-18T21:05:05.651530+0000","last_active":"2024-04-18T21:05:06.637829+0000","last_peered":"2024-04-18T21:05:06.637829+0000","last_clean":"2024-04-18T21:05:06.637829+0000","last_became_active":"2024-04-18T21:05:05.648167+0000","last_became_peered":"2024-04-18T21:05:05.648167+0000","last_unstale":"2024-04-18T21:05:06.637829+0000","last_undegraded":"2024-04-18T21:05:06.637829+0000","last_fullsized":"2024-04-18T21:05:06.637829+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:14:51.873741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358019+0000","last_change":"2024-04-18T21:05:04.637369+0000","last_active":"2024-04-18T21:05:07.358019+0000","last_peered":"2024-04-18T21:05:07.358019+0000","last_clean":"2024-04-18T21:05:07.358019+0000","last_became_active":"2024-04-18T21:05:04.636468+0000","last_became_peered":"2024-04-18T21:05:04.636468+0000","last_unstale":"2024-04-18T21:05:07.358019+0000","last_undegraded":"2024-04-18T21:05:07.358019+0000","last_fullsized":"2024-04-18T21:05:07.358019+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:40:21.452052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.360014+0000","last_change":"2024-04-18T21:05:05.651245+0000","last_active":"2024-04-18T21:05:07.360014+0000","last_peered":"2024-04-18T21:05:07.360014+0000","last_clean":"2024-04-18T21:05:07.360014+0000","last_became_active":"2024-04-18T21:05:05.650463+0000","last_became_peered":"2024-04-18T21:05:05.650463+0000","last_unstale":"2024-04-18T21:05:07.360014+0000","last_undegraded":"2024-04-18T21:05:07.360014+0000","last_fullsized":"2024-04-18T21:05:07.360014+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:27:17.530889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358504+0000","last_change":"2024-04-18T21:05:04.637597+0000","last_active":"2024-04-18T21:05:07.358504+0000","last_peered":"2024-04-18T21:05:07.358504+0000","last_clean":"2024-04-18T21:05:07.358504+0000","last_became_active":"2024-04-18T21:05:04.636827+0000","last_became_peered":"2024-04-18T21:05:04.636827+0000","last_unstale":"2024-04-18T21:05:07.358504+0000","last_undegraded":"2024-04-18T21:05:07.358504+0000","last_fullsized":"2024-04-18T21:05:07.358504+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:43.511952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636925+0000","last_change":"2024-04-18T21:05:05.658971+0000","last_active":"2024-04-18T21:05:06.636925+0000","last_peered":"2024-04-18T21:05:06.636925+0000","last_clean":"2024-04-18T21:05:06.636925+0000","last_became_active":"2024-04-18T21:05:05.658363+0000","last_became_peered":"2024-04-18T21:05:05.658363+0000","last_unstale":"2024-04-18T21:05:06.636925+0000","last_undegraded":"2024-04-18T21:05:06.636925+0000","last_fullsized":"2024-04-18T21:05:06.636925+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:12.944469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636616+0000","last_change":"2024-04-18T21:05:04.636585+0000","last_active":"2024-04-18T21:05:06.636616+0000","last_peered":"2024-04-18T21:05:06.636616+0000","last_clean":"2024-04-18T21:05:06.636616+0000","last_became_active":"2024-04-18T21:05:04.635670+0000","last_became_peered":"2024-04-18T21:05:04.635670+0000","last_unstale":"2024-04-18T21:05:06.636616+0000","last_undegraded":"2024-04-18T21:05:06.636616+0000","last_fullsized":"2024-04-18T21:05:06.636616+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:34:33.779063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636955+0000","last_change":"2024-04-18T21:05:05.649960+0000","last_active":"2024-04-18T21:05:06.636955+0000","last_peered":"2024-04-18T21:05:06.636955+0000","last_clean":"2024-04-18T21:05:06.636955+0000","last_became_active":"2024-04-18T21:05:05.648528+0000","last_became_peered":"2024-04-18T21:05:05.648528+0000","last_unstale":"2024-04-18T21:05:06.636955+0000","last_undegraded":"2024-04-18T21:05:06.636955+0000","last_fullsized":"2024-04-18T21:05:06.636955+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:20:45.938503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636493+0000","last_change":"2024-04-18T21:05:04.630151+0000","last_active":"2024-04-18T21:05:06.636493+0000","last_peered":"2024-04-18T21:05:06.636493+0000","last_clean":"2024-04-18T21:05:06.636493+0000","last_became_active":"2024-04-18T21:05:04.627968+0000","last_became_peered":"2024-04-18T21:05:04.627968+0000","last_unstale":"2024-04-18T21:05:06.636493+0000","last_undegraded":"2024-04-18T21:05:06.636493+0000","last_fullsized":"2024-04-18T21:05:06.636493+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:00:33.393636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636522+0000","last_change":"2024-04-18T21:05:05.624840+0000","last_active":"2024-04-18T21:05:06.636522+0000","last_peered":"2024-04-18T21:05:06.636522+0000","last_clean":"2024-04-18T21:05:06.636522+0000","last_became_active":"2024-04-18T21:05:05.622950+0000","last_became_peered":"2024-04-18T21:05:05.622950+0000","last_unstale":"2024-04-18T21:05:06.636522+0000","last_undegraded":"2024-04-18T21:05:06.636522+0000","last_fullsized":"2024-04-18T21:05:06.636522+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:27:17.530889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637987+0000","last_change":"2024-04-18T21:05:04.626715+0000","last_active":"2024-04-18T21:05:06.637987+0000","last_peered":"2024-04-18T21:05:06.637987+0000","last_clean":"2024-04-18T21:05:06.637987+0000","last_became_active":"2024-04-18T21:05:04.625270+0000","last_became_peered":"2024-04-18T21:05:04.625270+0000","last_unstale":"2024-04-18T21:05:06.637987+0000","last_undegraded":"2024-04-18T21:05:06.637987+0000","last_fullsized":"2024-04-18T21:05:06.637987+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:43.511952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637167+0000","last_change":"2024-04-18T21:05:05.627962+0000","last_active":"2024-04-18T21:05:06.637167+0000","last_peered":"2024-04-18T21:05:06.637167+0000","last_clean":"2024-04-18T21:05:06.637167+0000","last_became_active":"2024-04-18T21:05:05.626698+0000","last_became_peered":"2024-04-18T21:05:05.626698+0000","last_unstale":"2024-04-18T21:05:06.637167+0000","last_undegraded":"2024-04-18T21:05:06.637167+0000","last_fullsized":"2024-04-18T21:05:06.637167+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:48:48.973087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637569+0000","last_change":"2024-04-18T21:05:04.632776+0000","last_active":"2024-04-18T21:05:06.637569+0000","last_peered":"2024-04-18T21:05:06.637569+0000","last_clean":"2024-04-18T21:05:06.637569+0000","last_became_active":"2024-04-18T21:05:04.630142+0000","last_became_peered":"2024-04-18T21:05:04.630142+0000","last_unstale":"2024-04-18T21:05:06.637569+0000","last_undegraded":"2024-04-18T21:05:06.637569+0000","last_fullsized":"2024-04-18T21:05:06.637569+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:19:36.721897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636797+0000","last_change":"2024-04-18T21:05:05.653025+0000","last_active":"2024-04-18T21:05:06.636797+0000","last_peered":"2024-04-18T21:05:06.636797+0000","last_clean":"2024-04-18T21:05:06.636797+0000","last_became_active":"2024-04-18T21:05:05.645039+0000","last_became_peered":"2024-04-18T21:05:05.645039+0000","last_unstale":"2024-04-18T21:05:06.636797+0000","last_undegraded":"2024-04-18T21:05:06.636797+0000","last_fullsized":"2024-04-18T21:05:06.636797+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.360315+0000","last_change":"2024-04-18T21:05:04.640134+0000","last_active":"2024-04-18T21:05:07.360315+0000","last_peered":"2024-04-18T21:05:07.360315+0000","last_clean":"2024-04-18T21:05:07.360315+0000","last_became_active":"2024-04-18T21:05:04.638597+0000","last_became_peered":"2024-04-18T21:05:04.638597+0000","last_unstale":"2024-04-18T21:05:07.360315+0000","last_undegraded":"2024-04-18T21:05:07.360315+0000","last_fullsized":"2024-04-18T21:05:07.360315+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:56:05.795125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635677+0000","last_change":"2024-04-18T21:05:05.629022+0000","last_active":"2024-04-18T21:05:06.635677+0000","last_peered":"2024-04-18T21:05:06.635677+0000","last_clean":"2024-04-18T21:05:06.635677+0000","last_became_active":"2024-04-18T21:05:05.627643+0000","last_became_peered":"2024-04-18T21:05:05.627643+0000","last_unstale":"2024-04-18T21:05:06.635677+0000","last_undegraded":"2024-04-18T21:05:06.635677+0000","last_fullsized":"2024-04-18T21:05:06.635677+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:32:23.929877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359950+0000","last_change":"2024-04-18T21:05:04.641338+0000","last_active":"2024-04-18T21:05:07.359950+0000","last_peered":"2024-04-18T21:05:07.359950+0000","last_clean":"2024-04-18T21:05:07.359950+0000","last_became_active":"2024-04-18T21:05:04.639958+0000","last_became_peered":"2024-04-18T21:05:04.639958+0000","last_unstale":"2024-04-18T21:05:07.359950+0000","last_undegraded":"2024-04-18T21:05:07.359950+0000","last_fullsized":"2024-04-18T21:05:07.359950+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:42:45.392908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31340,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340500,"statfs":{"total":96636764160,"available":96604672000,"internally_reserved":0,"allocated":163840,"data_stored":55728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31928,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339912,"statfs":{"total":96636764160,"available":96604069888,"internally_reserved":0,"allocated":765952,"data_stored":642671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":782336,"data_stored":647890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:05:08.970 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-18T21:05:08.971 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-18T21:05:08.971 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-18T21:05:08.971 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-18T21:05:08.971 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-18T21:05:09.334 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:05:09.351 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":5,"flags":0,"active_gid":4108,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2478578102},{"type":"v1","addr":"172.21.15.78:6801","nonce":2478578102}]},"active_addr":"172.21.15.78:6801/2478578102","active_change":"2024-04-18T21:04:48.486288+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4107,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":3743995619}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":1530874597}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":1753877229}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":3630378497}]}]} 2024-04-18T21:05:09.354 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-18T21:05:09.354 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-18T21:05:09.354 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T21:05:09.626 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:05:09.626 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":18,"fsid":"dc017990-0393-4ab0-b604-5e7052fdc7bd","created":"2024-04-18T21:04:43.507538+0000","modified":"2024-04-18T21:05:06.615695+0000","last_up_change":"2024-04-18T21:04:52.492503+0000","last_in_change":"2024-04-18T21:04:44.402191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T21:04:52.538153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T21:04:58.673793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T21:05:03.314171+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T21:05:03.931699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1854d737-3a67-416a-8c88-0f126505a0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6801","nonce":1948809768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6803","nonce":1948809768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6807","nonce":1948809768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6805","nonce":1948809768}]},"public_addr":"172.21.15.132:6801/1948809768","cluster_addr":"172.21.15.132:6803/1948809768","heartbeat_back_addr":"172.21.15.132:6807/1948809768","heartbeat_front_addr":"172.21.15.132:6805/1948809768","state":["exists","up"]},{"osd":1,"uuid":"dfeae661-3f8a-4d41-b287-7eb02c16b91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":2040503167},{"type":"v1","addr":"172.21.15.150:6801","nonce":2040503167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":2040503167},{"type":"v1","addr":"172.21.15.150:6803","nonce":2040503167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":2040503167},{"type":"v1","addr":"172.21.15.150:6807","nonce":2040503167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":2040503167},{"type":"v1","addr":"172.21.15.150:6805","nonce":2040503167}]},"public_addr":"172.21.15.150:6801/2040503167","cluster_addr":"172.21.15.150:6803/2040503167","heartbeat_back_addr":"172.21.15.150:6807/2040503167","heartbeat_front_addr":"172.21.15.150:6805/2040503167","state":["exists","up"]},{"osd":2,"uuid":"56a34021-e2dc-41ff-822c-7ec123466f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6801","nonce":429896900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6803","nonce":429896900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6807","nonce":429896900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6805","nonce":429896900}]},"public_addr":"172.21.15.187:6801/429896900","cluster_addr":"172.21.15.187:6803/429896900","heartbeat_back_addr":"172.21.15.187:6807/429896900","heartbeat_front_addr":"172.21.15.187:6805/429896900","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:49.804359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:49.790978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:49.762943+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T21:05:09.644 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-18T21:05:09.644 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T21:05:09.909 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:05:09.909 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":18,"fsid":"dc017990-0393-4ab0-b604-5e7052fdc7bd","created":"2024-04-18T21:04:43.507538+0000","modified":"2024-04-18T21:05:06.615695+0000","last_up_change":"2024-04-18T21:04:52.492503+0000","last_in_change":"2024-04-18T21:04:44.402191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T21:04:52.538153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T21:04:58.673793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T21:05:03.314171+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T21:05:03.931699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1854d737-3a67-416a-8c88-0f126505a0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6801","nonce":1948809768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6803","nonce":1948809768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6807","nonce":1948809768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6805","nonce":1948809768}]},"public_addr":"172.21.15.132:6801/1948809768","cluster_addr":"172.21.15.132:6803/1948809768","heartbeat_back_addr":"172.21.15.132:6807/1948809768","heartbeat_front_addr":"172.21.15.132:6805/1948809768","state":["exists","up"]},{"osd":1,"uuid":"dfeae661-3f8a-4d41-b287-7eb02c16b91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":2040503167},{"type":"v1","addr":"172.21.15.150:6801","nonce":2040503167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":2040503167},{"type":"v1","addr":"172.21.15.150:6803","nonce":2040503167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":2040503167},{"type":"v1","addr":"172.21.15.150:6807","nonce":2040503167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":2040503167},{"type":"v1","addr":"172.21.15.150:6805","nonce":2040503167}]},"public_addr":"172.21.15.150:6801/2040503167","cluster_addr":"172.21.15.150:6803/2040503167","heartbeat_back_addr":"172.21.15.150:6807/2040503167","heartbeat_front_addr":"172.21.15.150:6805/2040503167","state":["exists","up"]},{"osd":2,"uuid":"56a34021-e2dc-41ff-822c-7ec123466f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6801","nonce":429896900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6803","nonce":429896900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6807","nonce":429896900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6805","nonce":429896900}]},"public_addr":"172.21.15.187:6801/429896900","cluster_addr":"172.21.15.187:6803/429896900","heartbeat_back_addr":"172.21.15.187:6807/429896900","heartbeat_front_addr":"172.21.15.187:6805/429896900","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:49.804359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:49.790978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:49.762943+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T21:05:09.927 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-18T21:05:09.927 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-18T21:05:09.927 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-18T21:05:10.078 INFO:teuthology.orchestra.run.smithi078.stdout:34359738373 2024-04-18T21:05:10.078 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-18T21:05:10.098 INFO:teuthology.orchestra.run.smithi078.stdout:34359738375 2024-04-18T21:05:10.098 INFO:teuthology.orchestra.run.smithi078.stdout:34359738375 2024-04-18T21:05:10.099 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-18T21:05:10.099 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-18T21:05:10.367 INFO:teuthology.orchestra.run.smithi078.stdout:34359738372 2024-04-18T21:05:10.384 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738372 for osd.0 2024-04-18T21:05:10.422 INFO:teuthology.orchestra.run.smithi078.stdout:34359738374 2024-04-18T21:05:10.427 INFO:teuthology.orchestra.run.smithi078.stdout:34359738374 2024-04-18T21:05:10.440 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738374 for osd.2 2024-04-18T21:05:10.445 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738374 for osd.1 2024-04-18T21:05:10.758 INFO:tasks.ceph.mds.a.smithi078.stderr:2024-04-18T21:05:10.760+0000 7f2711384640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-18T21:05:11.385 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-18T21:05:11.441 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-18T21:05:11.446 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-18T21:05:11.725 INFO:teuthology.orchestra.run.smithi078.stdout:34359738375 2024-04-18T21:05:11.725 INFO:teuthology.orchestra.run.smithi078.stdout:34359738373 2024-04-18T21:05:11.743 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738375 for osd.2 2024-04-18T21:05:11.744 DEBUG:teuthology.parallel:result is None 2024-04-18T21:05:11.751 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738373 for osd.0 2024-04-18T21:05:11.752 DEBUG:teuthology.parallel:result is None 2024-04-18T21:05:11.811 INFO:teuthology.orchestra.run.smithi078.stdout:34359738375 2024-04-18T21:05:11.827 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738375 for osd.1 2024-04-18T21:05:11.827 DEBUG:teuthology.parallel:result is None 2024-04-18T21:05:11.827 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-18T21:05:11.828 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:05:12.114 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:05:12.115 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-04-18T21:05:12.131 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-04-18T21:05:10.503852+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91068,"kb_used_data":1680,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024452,"statfs":{"total":289910292480,"available":289817038848,"internally_reserved":0,"allocated":1720320,"data_stored":1350892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001975"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637590+0000","last_change":"2024-04-18T21:05:05.652795+0000","last_active":"2024-04-18T21:05:06.637590+0000","last_peered":"2024-04-18T21:05:06.637590+0000","last_clean":"2024-04-18T21:05:06.637590+0000","last_became_active":"2024-04-18T21:05:05.650121+0000","last_became_peered":"2024-04-18T21:05:05.650121+0000","last_unstale":"2024-04-18T21:05:06.637590+0000","last_undegraded":"2024-04-18T21:05:06.637590+0000","last_fullsized":"2024-04-18T21:05:06.637590+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637298+0000","last_change":"2024-04-18T21:05:05.657531+0000","last_active":"2024-04-18T21:05:06.637298+0000","last_peered":"2024-04-18T21:05:06.637298+0000","last_clean":"2024-04-18T21:05:06.637298+0000","last_became_active":"2024-04-18T21:05:05.653101+0000","last_became_peered":"2024-04-18T21:05:05.653101+0000","last_unstale":"2024-04-18T21:05:06.637298+0000","last_undegraded":"2024-04-18T21:05:06.637298+0000","last_fullsized":"2024-04-18T21:05:06.637298+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:32:23.929877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636411+0000","last_change":"2024-04-18T21:05:05.647965+0000","last_active":"2024-04-18T21:05:06.636411+0000","last_peered":"2024-04-18T21:05:06.636411+0000","last_clean":"2024-04-18T21:05:06.636411+0000","last_became_active":"2024-04-18T21:05:05.645931+0000","last_became_peered":"2024-04-18T21:05:05.645931+0000","last_unstale":"2024-04-18T21:05:06.636411+0000","last_undegraded":"2024-04-18T21:05:06.636411+0000","last_fullsized":"2024-04-18T21:05:06.636411+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:04.350492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637673+0000","last_change":"2024-04-18T21:05:05.629321+0000","last_active":"2024-04-18T21:05:06.637673+0000","last_peered":"2024-04-18T21:05:06.637673+0000","last_clean":"2024-04-18T21:05:06.637673+0000","last_became_active":"2024-04-18T21:05:05.627956+0000","last_became_peered":"2024-04-18T21:05:05.627956+0000","last_unstale":"2024-04-18T21:05:06.637673+0000","last_undegraded":"2024-04-18T21:05:06.637673+0000","last_fullsized":"2024-04-18T21:05:06.637673+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:15:28.458476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636510+0000","last_change":"2024-04-18T21:05:05.648710+0000","last_active":"2024-04-18T21:05:06.636510+0000","last_peered":"2024-04-18T21:05:06.636510+0000","last_clean":"2024-04-18T21:05:06.636510+0000","last_became_active":"2024-04-18T21:05:05.647801+0000","last_became_peered":"2024-04-18T21:05:05.647801+0000","last_unstale":"2024-04-18T21:05:06.636510+0000","last_undegraded":"2024-04-18T21:05:06.636510+0000","last_fullsized":"2024-04-18T21:05:06.636510+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:46:36.339289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635784+0000","last_change":"2024-04-18T21:05:05.629095+0000","last_active":"2024-04-18T21:05:06.635784+0000","last_peered":"2024-04-18T21:05:06.635784+0000","last_clean":"2024-04-18T21:05:06.635784+0000","last_became_active":"2024-04-18T21:05:05.627664+0000","last_became_peered":"2024-04-18T21:05:05.627664+0000","last_unstale":"2024-04-18T21:05:06.635784+0000","last_undegraded":"2024-04-18T21:05:06.635784+0000","last_fullsized":"2024-04-18T21:05:06.635784+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:51:28.440070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635525+0000","last_change":"2024-04-18T21:05:05.625047+0000","last_active":"2024-04-18T21:05:06.635525+0000","last_peered":"2024-04-18T21:05:06.635525+0000","last_clean":"2024-04-18T21:05:06.635525+0000","last_became_active":"2024-04-18T21:05:05.622781+0000","last_became_peered":"2024-04-18T21:05:05.622781+0000","last_unstale":"2024-04-18T21:05:06.635525+0000","last_undegraded":"2024-04-18T21:05:06.635525+0000","last_fullsized":"2024-04-18T21:05:06.635525+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:12.944469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.634795+0000","last_change":"2024-04-18T21:05:05.640390+0000","last_active":"2024-04-18T21:05:06.634795+0000","last_peered":"2024-04-18T21:05:06.634795+0000","last_clean":"2024-04-18T21:05:06.634795+0000","last_became_active":"2024-04-18T21:05:05.638295+0000","last_became_peered":"2024-04-18T21:05:05.638295+0000","last_unstale":"2024-04-18T21:05:06.634795+0000","last_undegraded":"2024-04-18T21:05:06.634795+0000","last_fullsized":"2024-04-18T21:05:06.634795+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:34:31.132458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359217+0000","last_change":"2024-04-18T21:05:05.660752+0000","last_active":"2024-04-18T21:05:07.359217+0000","last_peered":"2024-04-18T21:05:07.359217+0000","last_clean":"2024-04-18T21:05:07.359217+0000","last_became_active":"2024-04-18T21:05:05.659226+0000","last_became_peered":"2024-04-18T21:05:05.659226+0000","last_unstale":"2024-04-18T21:05:07.359217+0000","last_undegraded":"2024-04-18T21:05:07.359217+0000","last_fullsized":"2024-04-18T21:05:07.359217+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:20:45.938503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637371+0000","last_change":"2024-04-18T21:05:05.656660+0000","last_active":"2024-04-18T21:05:06.637371+0000","last_peered":"2024-04-18T21:05:06.637371+0000","last_clean":"2024-04-18T21:05:06.637371+0000","last_became_active":"2024-04-18T21:05:05.653829+0000","last_became_peered":"2024-04-18T21:05:05.653829+0000","last_unstale":"2024-04-18T21:05:06.637371+0000","last_undegraded":"2024-04-18T21:05:06.637371+0000","last_fullsized":"2024-04-18T21:05:06.637371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:50:40.920146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636818+0000","last_change":"2024-04-18T21:05:05.646721+0000","last_active":"2024-04-18T21:05:06.636818+0000","last_peered":"2024-04-18T21:05:06.636818+0000","last_clean":"2024-04-18T21:05:06.636818+0000","last_became_active":"2024-04-18T21:05:05.643421+0000","last_became_peered":"2024-04-18T21:05:05.643421+0000","last_unstale":"2024-04-18T21:05:06.636818+0000","last_undegraded":"2024-04-18T21:05:06.636818+0000","last_fullsized":"2024-04-18T21:05:06.636818+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:14:51.873741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636882+0000","last_change":"2024-04-18T21:05:05.656320+0000","last_active":"2024-04-18T21:05:06.636882+0000","last_peered":"2024-04-18T21:05:06.636882+0000","last_clean":"2024-04-18T21:05:06.636882+0000","last_became_active":"2024-04-18T21:05:05.655508+0000","last_became_peered":"2024-04-18T21:05:05.655508+0000","last_unstale":"2024-04-18T21:05:06.636882+0000","last_undegraded":"2024-04-18T21:05:06.636882+0000","last_fullsized":"2024-04-18T21:05:06.636882+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:51.225379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636068+0000","last_change":"2024-04-18T21:05:05.649001+0000","last_active":"2024-04-18T21:05:06.636068+0000","last_peered":"2024-04-18T21:05:06.636068+0000","last_clean":"2024-04-18T21:05:06.636068+0000","last_became_active":"2024-04-18T21:05:05.648070+0000","last_became_peered":"2024-04-18T21:05:05.648070+0000","last_unstale":"2024-04-18T21:05:06.636068+0000","last_undegraded":"2024-04-18T21:05:06.636068+0000","last_fullsized":"2024-04-18T21:05:06.636068+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:56.408234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636128+0000","last_change":"2024-04-18T21:05:05.635880+0000","last_active":"2024-04-18T21:05:06.636128+0000","last_peered":"2024-04-18T21:05:06.636128+0000","last_clean":"2024-04-18T21:05:06.636128+0000","last_became_active":"2024-04-18T21:05:05.635089+0000","last_became_peered":"2024-04-18T21:05:05.635089+0000","last_unstale":"2024-04-18T21:05:06.636128+0000","last_undegraded":"2024-04-18T21:05:06.636128+0000","last_fullsized":"2024-04-18T21:05:06.636128+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:50:40.920146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635604+0000","last_change":"2024-04-18T21:05:05.639640+0000","last_active":"2024-04-18T21:05:06.635604+0000","last_peered":"2024-04-18T21:05:06.635604+0000","last_clean":"2024-04-18T21:05:06.635604+0000","last_became_active":"2024-04-18T21:05:05.637311+0000","last_became_peered":"2024-04-18T21:05:05.637311+0000","last_unstale":"2024-04-18T21:05:06.635604+0000","last_undegraded":"2024-04-18T21:05:06.635604+0000","last_fullsized":"2024-04-18T21:05:06.635604+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:20:45.938503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.634796+0000","last_change":"2024-04-18T21:05:05.638203+0000","last_active":"2024-04-18T21:05:06.634796+0000","last_peered":"2024-04-18T21:05:06.634796+0000","last_clean":"2024-04-18T21:05:06.634796+0000","last_became_active":"2024-04-18T21:05:05.637352+0000","last_became_peered":"2024-04-18T21:05:05.637352+0000","last_unstale":"2024-04-18T21:05:06.634796+0000","last_undegraded":"2024-04-18T21:05:06.634796+0000","last_fullsized":"2024-04-18T21:05:06.634796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.360278+0000","last_change":"2024-04-18T21:05:05.661613+0000","last_active":"2024-04-18T21:05:07.360278+0000","last_peered":"2024-04-18T21:05:07.360278+0000","last_clean":"2024-04-18T21:05:07.360278+0000","last_became_active":"2024-04-18T21:05:05.660496+0000","last_became_peered":"2024-04-18T21:05:05.660496+0000","last_unstale":"2024-04-18T21:05:07.360278+0000","last_undegraded":"2024-04-18T21:05:07.360278+0000","last_fullsized":"2024-04-18T21:05:07.360278+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:31:31.842528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637954+0000","last_change":"2024-04-18T21:05:05.655261+0000","last_active":"2024-04-18T21:05:06.637954+0000","last_peered":"2024-04-18T21:05:06.637954+0000","last_clean":"2024-04-18T21:05:06.637954+0000","last_became_active":"2024-04-18T21:05:05.651388+0000","last_became_peered":"2024-04-18T21:05:05.651388+0000","last_unstale":"2024-04-18T21:05:06.637954+0000","last_undegraded":"2024-04-18T21:05:06.637954+0000","last_fullsized":"2024-04-18T21:05:06.637954+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:53.850184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359241+0000","last_change":"2024-04-18T21:05:05.652710+0000","last_active":"2024-04-18T21:05:07.359241+0000","last_peered":"2024-04-18T21:05:07.359241+0000","last_clean":"2024-04-18T21:05:07.359241+0000","last_became_active":"2024-04-18T21:05:05.651929+0000","last_became_peered":"2024-04-18T21:05:05.651929+0000","last_unstale":"2024-04-18T21:05:07.359241+0000","last_undegraded":"2024-04-18T21:05:07.359241+0000","last_fullsized":"2024-04-18T21:05:07.359241+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:12.944469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636438+0000","last_change":"2024-04-18T21:05:05.638338+0000","last_active":"2024-04-18T21:05:06.636438+0000","last_peered":"2024-04-18T21:05:06.636438+0000","last_clean":"2024-04-18T21:05:06.636438+0000","last_became_active":"2024-04-18T21:05:05.637567+0000","last_became_peered":"2024-04-18T21:05:05.637567+0000","last_unstale":"2024-04-18T21:05:06.636438+0000","last_undegraded":"2024-04-18T21:05:06.636438+0000","last_fullsized":"2024-04-18T21:05:06.636438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637117+0000","last_change":"2024-04-18T21:05:05.643606+0000","last_active":"2024-04-18T21:05:06.637117+0000","last_peered":"2024-04-18T21:05:06.637117+0000","last_clean":"2024-04-18T21:05:06.637117+0000","last_became_active":"2024-04-18T21:05:05.642991+0000","last_became_peered":"2024-04-18T21:05:05.642991+0000","last_unstale":"2024-04-18T21:05:06.637117+0000","last_undegraded":"2024-04-18T21:05:06.637117+0000","last_fullsized":"2024-04-18T21:05:06.637117+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:01.841786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636035+0000","last_change":"2024-04-18T21:05:05.650896+0000","last_active":"2024-04-18T21:05:06.636035+0000","last_peered":"2024-04-18T21:05:06.636035+0000","last_clean":"2024-04-18T21:05:06.636035+0000","last_became_active":"2024-04-18T21:05:05.650083+0000","last_became_peered":"2024-04-18T21:05:05.650083+0000","last_unstale":"2024-04-18T21:05:06.636035+0000","last_undegraded":"2024-04-18T21:05:06.636035+0000","last_fullsized":"2024-04-18T21:05:06.636035+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:43:55.788425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.357454+0000","last_change":"2024-04-18T21:05:05.640362+0000","last_active":"2024-04-18T21:05:07.357454+0000","last_peered":"2024-04-18T21:05:07.357454+0000","last_clean":"2024-04-18T21:05:07.357454+0000","last_became_active":"2024-04-18T21:05:05.635643+0000","last_became_peered":"2024-04-18T21:05:05.635643+0000","last_unstale":"2024-04-18T21:05:07.357454+0000","last_undegraded":"2024-04-18T21:05:07.357454+0000","last_fullsized":"2024-04-18T21:05:07.357454+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:43:55.788425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635029+0000","last_change":"2024-04-18T21:05:05.642755+0000","last_active":"2024-04-18T21:05:06.635029+0000","last_peered":"2024-04-18T21:05:06.635029+0000","last_clean":"2024-04-18T21:05:06.635029+0000","last_became_active":"2024-04-18T21:05:05.642150+0000","last_became_peered":"2024-04-18T21:05:05.642150+0000","last_unstale":"2024-04-18T21:05:06.635029+0000","last_undegraded":"2024-04-18T21:05:06.635029+0000","last_fullsized":"2024-04-18T21:05:06.635029+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:29:22.647425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637381+0000","last_change":"2024-04-18T21:05:05.653741+0000","last_active":"2024-04-18T21:05:06.637381+0000","last_peered":"2024-04-18T21:05:06.637381+0000","last_clean":"2024-04-18T21:05:06.637381+0000","last_became_active":"2024-04-18T21:05:05.650174+0000","last_became_peered":"2024-04-18T21:05:05.650174+0000","last_unstale":"2024-04-18T21:05:06.637381+0000","last_undegraded":"2024-04-18T21:05:06.637381+0000","last_fullsized":"2024-04-18T21:05:06.637381+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:04.350492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.360000+0000","last_change":"2024-04-18T21:05:05.649581+0000","last_active":"2024-04-18T21:05:07.360000+0000","last_peered":"2024-04-18T21:05:07.360000+0000","last_clean":"2024-04-18T21:05:07.360000+0000","last_became_active":"2024-04-18T21:05:05.648233+0000","last_became_peered":"2024-04-18T21:05:05.648233+0000","last_unstale":"2024-04-18T21:05:07.360000+0000","last_undegraded":"2024-04-18T21:05:07.360000+0000","last_fullsized":"2024-04-18T21:05:07.360000+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637099+0000","last_change":"2024-04-18T21:05:05.646926+0000","last_active":"2024-04-18T21:05:06.637099+0000","last_peered":"2024-04-18T21:05:06.637099+0000","last_clean":"2024-04-18T21:05:06.637099+0000","last_became_active":"2024-04-18T21:05:05.644942+0000","last_became_peered":"2024-04-18T21:05:05.644942+0000","last_unstale":"2024-04-18T21:05:06.637099+0000","last_undegraded":"2024-04-18T21:05:06.637099+0000","last_fullsized":"2024-04-18T21:05:06.637099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:53.850184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637629+0000","last_change":"2024-04-18T21:05:05.656314+0000","last_active":"2024-04-18T21:05:06.637629+0000","last_peered":"2024-04-18T21:05:06.637629+0000","last_clean":"2024-04-18T21:05:06.637629+0000","last_became_active":"2024-04-18T21:05:05.655364+0000","last_became_peered":"2024-04-18T21:05:05.655364+0000","last_unstale":"2024-04-18T21:05:06.637629+0000","last_undegraded":"2024-04-18T21:05:06.637629+0000","last_fullsized":"2024-04-18T21:05:06.637629+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:27:17.530889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358862+0000","last_change":"2024-04-18T21:05:05.653532+0000","last_active":"2024-04-18T21:05:07.358862+0000","last_peered":"2024-04-18T21:05:07.358862+0000","last_clean":"2024-04-18T21:05:07.358862+0000","last_became_active":"2024-04-18T21:05:05.652950+0000","last_became_peered":"2024-04-18T21:05:05.652950+0000","last_unstale":"2024-04-18T21:05:07.358862+0000","last_undegraded":"2024-04-18T21:05:07.358862+0000","last_fullsized":"2024-04-18T21:05:07.358862+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:51.225379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636535+0000","last_change":"2024-04-18T21:05:05.648084+0000","last_active":"2024-04-18T21:05:06.636535+0000","last_peered":"2024-04-18T21:05:06.636535+0000","last_clean":"2024-04-18T21:05:06.636535+0000","last_became_active":"2024-04-18T21:05:05.645340+0000","last_became_peered":"2024-04-18T21:05:05.645340+0000","last_unstale":"2024-04-18T21:05:06.636535+0000","last_undegraded":"2024-04-18T21:05:06.636535+0000","last_fullsized":"2024-04-18T21:05:06.636535+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:34:31.132458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.357930+0000","last_change":"2024-04-18T21:05:05.655034+0000","last_active":"2024-04-18T21:05:07.357930+0000","last_peered":"2024-04-18T21:05:07.357930+0000","last_clean":"2024-04-18T21:05:07.357930+0000","last_became_active":"2024-04-18T21:05:05.654517+0000","last_became_peered":"2024-04-18T21:05:05.654517+0000","last_unstale":"2024-04-18T21:05:07.357930+0000","last_undegraded":"2024-04-18T21:05:07.357930+0000","last_fullsized":"2024-04-18T21:05:07.357930+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:34:38.427319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635266+0000","last_change":"2024-04-18T21:05:05.626677+0000","last_active":"2024-04-18T21:05:06.635266+0000","last_peered":"2024-04-18T21:05:06.635266+0000","last_clean":"2024-04-18T21:05:06.635266+0000","last_became_active":"2024-04-18T21:05:05.624250+0000","last_became_peered":"2024-04-18T21:05:05.624250+0000","last_unstale":"2024-04-18T21:05:06.635266+0000","last_undegraded":"2024-04-18T21:05:06.635266+0000","last_fullsized":"2024-04-18T21:05:06.635266+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:51.225379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637347+0000","last_change":"2024-04-18T21:05:05.649918+0000","last_active":"2024-04-18T21:05:06.637347+0000","last_peered":"2024-04-18T21:05:06.637347+0000","last_clean":"2024-04-18T21:05:06.637347+0000","last_became_active":"2024-04-18T21:05:05.647147+0000","last_became_peered":"2024-04-18T21:05:05.647147+0000","last_unstale":"2024-04-18T21:05:06.637347+0000","last_undegraded":"2024-04-18T21:05:06.637347+0000","last_fullsized":"2024-04-18T21:05:06.637347+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:51:28.440070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637900+0000","last_change":"2024-04-18T21:05:04.632748+0000","last_active":"2024-04-18T21:05:06.637900+0000","last_peered":"2024-04-18T21:05:06.637900+0000","last_clean":"2024-04-18T21:05:06.637900+0000","last_became_active":"2024-04-18T21:05:04.628407+0000","last_became_peered":"2024-04-18T21:05:04.628407+0000","last_unstale":"2024-04-18T21:05:06.637900+0000","last_undegraded":"2024-04-18T21:05:06.637900+0000","last_fullsized":"2024-04-18T21:05:06.637900+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:42:45.392908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637688+0000","last_change":"2024-04-18T21:05:05.649199+0000","last_active":"2024-04-18T21:05:06.637688+0000","last_peered":"2024-04-18T21:05:06.637688+0000","last_clean":"2024-04-18T21:05:06.637688+0000","last_became_active":"2024-04-18T21:05:05.646898+0000","last_became_peered":"2024-04-18T21:05:05.646898+0000","last_unstale":"2024-04-18T21:05:06.637688+0000","last_undegraded":"2024-04-18T21:05:06.637688+0000","last_fullsized":"2024-04-18T21:05:06.637688+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:31:31.842528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358409+0000","last_change":"2024-04-18T21:05:04.638017+0000","last_active":"2024-04-18T21:05:07.358409+0000","last_peered":"2024-04-18T21:05:07.358409+0000","last_clean":"2024-04-18T21:05:07.358409+0000","last_became_active":"2024-04-18T21:05:04.637287+0000","last_became_peered":"2024-04-18T21:05:04.637287+0000","last_unstale":"2024-04-18T21:05:07.358409+0000","last_undegraded":"2024-04-18T21:05:07.358409+0000","last_fullsized":"2024-04-18T21:05:07.358409+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:25.891472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.360516+0000","last_change":"2024-04-18T21:05:05.650757+0000","last_active":"2024-04-18T21:05:07.360516+0000","last_peered":"2024-04-18T21:05:07.360516+0000","last_clean":"2024-04-18T21:05:07.360516+0000","last_became_active":"2024-04-18T21:05:05.650143+0000","last_became_peered":"2024-04-18T21:05:05.650143+0000","last_unstale":"2024-04-18T21:05:07.360516+0000","last_undegraded":"2024-04-18T21:05:07.360516+0000","last_fullsized":"2024-04-18T21:05:07.360516+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:14:51.873741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635796+0000","last_change":"2024-04-18T21:05:04.628489+0000","last_active":"2024-04-18T21:05:06.635796+0000","last_peered":"2024-04-18T21:05:06.635796+0000","last_clean":"2024-04-18T21:05:06.635796+0000","last_became_active":"2024-04-18T21:05:04.627279+0000","last_became_peered":"2024-04-18T21:05:04.627279+0000","last_unstale":"2024-04-18T21:05:06.635796+0000","last_undegraded":"2024-04-18T21:05:06.635796+0000","last_fullsized":"2024-04-18T21:05:06.635796+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:43:23.420744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359664+0000","last_change":"2024-04-18T21:05:05.649347+0000","last_active":"2024-04-18T21:05:07.359664+0000","last_peered":"2024-04-18T21:05:07.359664+0000","last_clean":"2024-04-18T21:05:07.359664+0000","last_became_active":"2024-04-18T21:05:05.648144+0000","last_became_peered":"2024-04-18T21:05:05.648144+0000","last_unstale":"2024-04-18T21:05:07.359664+0000","last_undegraded":"2024-04-18T21:05:07.359664+0000","last_fullsized":"2024-04-18T21:05:07.359664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:51:28.440070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":22,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635267+0000","last_change":"2024-04-18T21:05:04.624089+0000","last_active":"2024-04-18T21:05:06.635267+0000","last_peered":"2024-04-18T21:05:06.635267+0000","last_clean":"2024-04-18T21:05:06.635267+0000","last_became_active":"2024-04-18T21:05:04.623238+0000","last_became_peered":"2024-04-18T21:05:04.623238+0000","last_unstale":"2024-04-18T21:05:06.635267+0000","last_undegraded":"2024-04-18T21:05:06.635267+0000","last_fullsized":"2024-04-18T21:05:06.635267+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:44:19.076499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637569+0000","last_change":"2024-04-18T21:05:04.633907+0000","last_active":"2024-04-18T21:05:06.637569+0000","last_peered":"2024-04-18T21:05:06.637569+0000","last_clean":"2024-04-18T21:05:06.637569+0000","last_became_active":"2024-04-18T21:05:04.630308+0000","last_became_peered":"2024-04-18T21:05:04.630308+0000","last_unstale":"2024-04-18T21:05:06.637569+0000","last_undegraded":"2024-04-18T21:05:06.637569+0000","last_fullsized":"2024-04-18T21:05:06.637569+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:55:46.219812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635046+0000","last_change":"2024-04-18T21:05:05.658572+0000","last_active":"2024-04-18T21:05:06.635046+0000","last_peered":"2024-04-18T21:05:06.635046+0000","last_clean":"2024-04-18T21:05:06.635046+0000","last_became_active":"2024-04-18T21:05:05.657842+0000","last_became_peered":"2024-04-18T21:05:05.657842+0000","last_unstale":"2024-04-18T21:05:06.635046+0000","last_undegraded":"2024-04-18T21:05:06.635046+0000","last_fullsized":"2024-04-18T21:05:06.635046+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:26:38.636530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.638161+0000","last_change":"2024-04-18T21:05:04.628541+0000","last_active":"2024-04-18T21:05:06.638161+0000","last_peered":"2024-04-18T21:05:06.638161+0000","last_clean":"2024-04-18T21:05:06.638161+0000","last_became_active":"2024-04-18T21:05:04.627407+0000","last_became_peered":"2024-04-18T21:05:04.627407+0000","last_unstale":"2024-04-18T21:05:06.638161+0000","last_undegraded":"2024-04-18T21:05:06.638161+0000","last_fullsized":"2024-04-18T21:05:06.638161+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:55:48.643174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635639+0000","last_change":"2024-04-18T21:05:05.651649+0000","last_active":"2024-04-18T21:05:06.635639+0000","last_peered":"2024-04-18T21:05:06.635639+0000","last_clean":"2024-04-18T21:05:06.635639+0000","last_became_active":"2024-04-18T21:05:05.646809+0000","last_became_peered":"2024-04-18T21:05:05.646809+0000","last_unstale":"2024-04-18T21:05:06.635639+0000","last_undegraded":"2024-04-18T21:05:06.635639+0000","last_fullsized":"2024-04-18T21:05:06.635639+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:23.698827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637684+0000","last_change":"2024-04-18T21:05:04.634055+0000","last_active":"2024-04-18T21:05:06.637684+0000","last_peered":"2024-04-18T21:05:06.637684+0000","last_clean":"2024-04-18T21:05:06.637684+0000","last_became_active":"2024-04-18T21:05:04.630736+0000","last_became_peered":"2024-04-18T21:05:04.630736+0000","last_unstale":"2024-04-18T21:05:06.637684+0000","last_undegraded":"2024-04-18T21:05:06.637684+0000","last_fullsized":"2024-04-18T21:05:06.637684+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:06:44.001512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636585+0000","last_change":"2024-04-18T21:05:05.628869+0000","last_active":"2024-04-18T21:05:06.636585+0000","last_peered":"2024-04-18T21:05:06.636585+0000","last_clean":"2024-04-18T21:05:06.636585+0000","last_became_active":"2024-04-18T21:05:05.627071+0000","last_became_peered":"2024-04-18T21:05:05.627071+0000","last_unstale":"2024-04-18T21:05:06.636585+0000","last_undegraded":"2024-04-18T21:05:06.636585+0000","last_fullsized":"2024-04-18T21:05:06.636585+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:31:31.842528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.638123+0000","last_change":"2024-04-18T21:05:04.625520+0000","last_active":"2024-04-18T21:05:06.638123+0000","last_peered":"2024-04-18T21:05:06.638123+0000","last_clean":"2024-04-18T21:05:06.638123+0000","last_became_active":"2024-04-18T21:05:04.624656+0000","last_became_peered":"2024-04-18T21:05:04.624656+0000","last_unstale":"2024-04-18T21:05:06.638123+0000","last_undegraded":"2024-04-18T21:05:06.638123+0000","last_fullsized":"2024-04-18T21:05:06.638123+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:56:05.795125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358238+0000","last_change":"2024-04-18T21:05:05.649406+0000","last_active":"2024-04-18T21:05:07.358238+0000","last_peered":"2024-04-18T21:05:07.358238+0000","last_clean":"2024-04-18T21:05:07.358238+0000","last_became_active":"2024-04-18T21:05:05.648380+0000","last_became_peered":"2024-04-18T21:05:05.648380+0000","last_unstale":"2024-04-18T21:05:07.358238+0000","last_undegraded":"2024-04-18T21:05:07.358238+0000","last_fullsized":"2024-04-18T21:05:07.358238+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359521+0000","last_change":"2024-04-18T21:05:04.640216+0000","last_active":"2024-04-18T21:05:07.359521+0000","last_peered":"2024-04-18T21:05:07.359521+0000","last_clean":"2024-04-18T21:05:07.359521+0000","last_became_active":"2024-04-18T21:05:04.639349+0000","last_became_peered":"2024-04-18T21:05:04.639349+0000","last_unstale":"2024-04-18T21:05:07.359521+0000","last_undegraded":"2024-04-18T21:05:07.359521+0000","last_fullsized":"2024-04-18T21:05:07.359521+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:09:18.466987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637709+0000","last_change":"2024-04-18T21:05:05.628850+0000","last_active":"2024-04-18T21:05:06.637709+0000","last_peered":"2024-04-18T21:05:06.637709+0000","last_clean":"2024-04-18T21:05:06.637709+0000","last_became_active":"2024-04-18T21:05:05.627521+0000","last_became_peered":"2024-04-18T21:05:05.627521+0000","last_unstale":"2024-04-18T21:05:06.637709+0000","last_undegraded":"2024-04-18T21:05:06.637709+0000","last_fullsized":"2024-04-18T21:05:06.637709+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:14:37.912032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636946+0000","last_change":"2024-04-18T21:05:04.634674+0000","last_active":"2024-04-18T21:05:06.636946+0000","last_peered":"2024-04-18T21:05:06.636946+0000","last_clean":"2024-04-18T21:05:06.636946+0000","last_became_active":"2024-04-18T21:05:04.632284+0000","last_became_peered":"2024-04-18T21:05:04.632284+0000","last_unstale":"2024-04-18T21:05:06.636946+0000","last_undegraded":"2024-04-18T21:05:06.636946+0000","last_fullsized":"2024-04-18T21:05:06.636946+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:09:18.466987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637414+0000","last_change":"2024-04-18T21:05:05.647377+0000","last_active":"2024-04-18T21:05:06.637414+0000","last_peered":"2024-04-18T21:05:06.637414+0000","last_clean":"2024-04-18T21:05:06.637414+0000","last_became_active":"2024-04-18T21:05:05.645067+0000","last_became_peered":"2024-04-18T21:05:05.645067+0000","last_unstale":"2024-04-18T21:05:06.637414+0000","last_undegraded":"2024-04-18T21:05:06.637414+0000","last_fullsized":"2024-04-18T21:05:06.637414+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:29:30.243751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636012+0000","last_change":"2024-04-18T21:05:04.627578+0000","last_active":"2024-04-18T21:05:06.636012+0000","last_peered":"2024-04-18T21:05:06.636012+0000","last_clean":"2024-04-18T21:05:06.636012+0000","last_became_active":"2024-04-18T21:05:04.626786+0000","last_became_peered":"2024-04-18T21:05:04.626786+0000","last_unstale":"2024-04-18T21:05:06.636012+0000","last_undegraded":"2024-04-18T21:05:06.636012+0000","last_fullsized":"2024-04-18T21:05:06.636012+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:55:59.563512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637217+0000","last_change":"2024-04-18T21:05:05.640817+0000","last_active":"2024-04-18T21:05:06.637217+0000","last_peered":"2024-04-18T21:05:06.637217+0000","last_clean":"2024-04-18T21:05:06.637217+0000","last_became_active":"2024-04-18T21:05:05.635526+0000","last_became_peered":"2024-04-18T21:05:05.635526+0000","last_unstale":"2024-04-18T21:05:06.637217+0000","last_undegraded":"2024-04-18T21:05:06.637217+0000","last_fullsized":"2024-04-18T21:05:06.637217+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:44:29.823511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635339+0000","last_change":"2024-04-18T21:05:04.636499+0000","last_active":"2024-04-18T21:05:06.635339+0000","last_peered":"2024-04-18T21:05:06.635339+0000","last_clean":"2024-04-18T21:05:06.635339+0000","last_became_active":"2024-04-18T21:05:04.635830+0000","last_became_peered":"2024-04-18T21:05:04.635830+0000","last_unstale":"2024-04-18T21:05:06.635339+0000","last_undegraded":"2024-04-18T21:05:06.635339+0000","last_fullsized":"2024-04-18T21:05:06.635339+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:26:30.565175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359678+0000","last_change":"2024-04-18T21:05:05.660974+0000","last_active":"2024-04-18T21:05:07.359678+0000","last_peered":"2024-04-18T21:05:07.359678+0000","last_clean":"2024-04-18T21:05:07.359678+0000","last_became_active":"2024-04-18T21:05:05.659287+0000","last_became_peered":"2024-04-18T21:05:05.659287+0000","last_unstale":"2024-04-18T21:05:07.359678+0000","last_undegraded":"2024-04-18T21:05:07.359678+0000","last_fullsized":"2024-04-18T21:05:07.359678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:50:40.920146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":222,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636126+0000","last_change":"2024-04-18T21:04:54.511605+0000","last_active":"2024-04-18T21:05:06.636126+0000","last_peered":"2024-04-18T21:05:06.636126+0000","last_clean":"2024-04-18T21:05:06.636126+0000","last_became_active":"2024-04-18T21:04:54.510791+0000","last_became_peered":"2024-04-18T21:04:54.510791+0000","last_unstale":"2024-04-18T21:05:06.636126+0000","last_undegraded":"2024-04-18T21:05:06.636126+0000","last_fullsized":"2024-04-18T21:05:06.636126+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_clean_scrub_stamp":"2024-04-18T21:04:53.494814+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:46.262250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.638030+0000","last_change":"2024-04-18T21:05:00.576671+0000","last_active":"2024-04-18T21:05:06.638030+0000","last_peered":"2024-04-18T21:05:06.638030+0000","last_clean":"2024-04-18T21:05:06.638030+0000","last_became_active":"2024-04-18T21:05:00.575933+0000","last_became_peered":"2024-04-18T21:05:00.575933+0000","last_unstale":"2024-04-18T21:05:06.638030+0000","last_undegraded":"2024-04-18T21:05:06.638030+0000","last_fullsized":"2024-04-18T21:05:06.638030+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:14:59.207959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358678+0000","last_change":"2024-04-18T21:05:04.639528+0000","last_active":"2024-04-18T21:05:07.358678+0000","last_peered":"2024-04-18T21:05:07.358678+0000","last_clean":"2024-04-18T21:05:07.358678+0000","last_became_active":"2024-04-18T21:05:04.638517+0000","last_became_peered":"2024-04-18T21:05:04.638517+0000","last_unstale":"2024-04-18T21:05:07.358678+0000","last_undegraded":"2024-04-18T21:05:07.358678+0000","last_fullsized":"2024-04-18T21:05:07.358678+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:55:46.219812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637482+0000","last_change":"2024-04-18T21:05:05.647623+0000","last_active":"2024-04-18T21:05:06.637482+0000","last_peered":"2024-04-18T21:05:06.637482+0000","last_clean":"2024-04-18T21:05:06.637482+0000","last_became_active":"2024-04-18T21:05:05.645640+0000","last_became_peered":"2024-04-18T21:05:05.645640+0000","last_unstale":"2024-04-18T21:05:06.637482+0000","last_undegraded":"2024-04-18T21:05:06.637482+0000","last_fullsized":"2024-04-18T21:05:06.637482+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:59.950421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635615+0000","last_change":"2024-04-18T21:05:00.571960+0000","last_active":"2024-04-18T21:05:06.635615+0000","last_peered":"2024-04-18T21:05:06.635615+0000","last_clean":"2024-04-18T21:05:06.635615+0000","last_became_active":"2024-04-18T21:05:00.571301+0000","last_became_peered":"2024-04-18T21:05:00.571301+0000","last_unstale":"2024-04-18T21:05:06.635615+0000","last_undegraded":"2024-04-18T21:05:06.635615+0000","last_fullsized":"2024-04-18T21:05:06.635615+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:31:59.262440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358645+0000","last_change":"2024-04-18T21:05:04.638026+0000","last_active":"2024-04-18T21:05:07.358645+0000","last_peered":"2024-04-18T21:05:07.358645+0000","last_clean":"2024-04-18T21:05:07.358645+0000","last_became_active":"2024-04-18T21:05:04.637160+0000","last_became_peered":"2024-04-18T21:05:04.637160+0000","last_unstale":"2024-04-18T21:05:07.358645+0000","last_undegraded":"2024-04-18T21:05:07.358645+0000","last_fullsized":"2024-04-18T21:05:07.358645+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:33:48.703994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.638058+0000","last_change":"2024-04-18T21:05:05.654121+0000","last_active":"2024-04-18T21:05:06.638058+0000","last_peered":"2024-04-18T21:05:06.638058+0000","last_clean":"2024-04-18T21:05:06.638058+0000","last_became_active":"2024-04-18T21:05:05.651310+0000","last_became_peered":"2024-04-18T21:05:05.651310+0000","last_unstale":"2024-04-18T21:05:06.638058+0000","last_undegraded":"2024-04-18T21:05:06.638058+0000","last_fullsized":"2024-04-18T21:05:06.638058+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:01.841786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359064+0000","last_change":"2024-04-18T21:05:00.578604+0000","last_active":"2024-04-18T21:05:07.359064+0000","last_peered":"2024-04-18T21:05:07.359064+0000","last_clean":"2024-04-18T21:05:07.359064+0000","last_became_active":"2024-04-18T21:05:00.577988+0000","last_became_peered":"2024-04-18T21:05:00.577988+0000","last_unstale":"2024-04-18T21:05:07.359064+0000","last_undegraded":"2024-04-18T21:05:07.359064+0000","last_fullsized":"2024-04-18T21:05:07.359064+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:54:54.201759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635569+0000","last_change":"2024-04-18T21:05:04.627627+0000","last_active":"2024-04-18T21:05:06.635569+0000","last_peered":"2024-04-18T21:05:06.635569+0000","last_clean":"2024-04-18T21:05:06.635569+0000","last_became_active":"2024-04-18T21:05:04.626850+0000","last_became_peered":"2024-04-18T21:05:04.626850+0000","last_unstale":"2024-04-18T21:05:06.635569+0000","last_undegraded":"2024-04-18T21:05:06.635569+0000","last_fullsized":"2024-04-18T21:05:06.635569+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:43:31.453080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359914+0000","last_change":"2024-04-18T21:05:05.661488+0000","last_active":"2024-04-18T21:05:07.359914+0000","last_peered":"2024-04-18T21:05:07.359914+0000","last_clean":"2024-04-18T21:05:07.359914+0000","last_became_active":"2024-04-18T21:05:05.660283+0000","last_became_peered":"2024-04-18T21:05:05.660283+0000","last_unstale":"2024-04-18T21:05:07.359914+0000","last_undegraded":"2024-04-18T21:05:07.359914+0000","last_fullsized":"2024-04-18T21:05:07.359914+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:04.350492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637285+0000","last_change":"2024-04-18T21:05:00.576606+0000","last_active":"2024-04-18T21:05:06.637285+0000","last_peered":"2024-04-18T21:05:06.637285+0000","last_clean":"2024-04-18T21:05:06.637285+0000","last_became_active":"2024-04-18T21:05:00.575951+0000","last_became_peered":"2024-04-18T21:05:00.575951+0000","last_unstale":"2024-04-18T21:05:06.637285+0000","last_undegraded":"2024-04-18T21:05:06.637285+0000","last_fullsized":"2024-04-18T21:05:06.637285+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:32:17.612481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637939+0000","last_change":"2024-04-18T21:05:04.627296+0000","last_active":"2024-04-18T21:05:06.637939+0000","last_peered":"2024-04-18T21:05:06.637939+0000","last_clean":"2024-04-18T21:05:06.637939+0000","last_became_active":"2024-04-18T21:05:04.626801+0000","last_became_peered":"2024-04-18T21:05:04.626801+0000","last_unstale":"2024-04-18T21:05:06.637939+0000","last_undegraded":"2024-04-18T21:05:06.637939+0000","last_fullsized":"2024-04-18T21:05:06.637939+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:46:36.285416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359434+0000","last_change":"2024-04-18T21:05:05.655152+0000","last_active":"2024-04-18T21:05:07.359434+0000","last_peered":"2024-04-18T21:05:07.359434+0000","last_clean":"2024-04-18T21:05:07.359434+0000","last_became_active":"2024-04-18T21:05:05.654506+0000","last_became_peered":"2024-04-18T21:05:05.654506+0000","last_unstale":"2024-04-18T21:05:07.359434+0000","last_undegraded":"2024-04-18T21:05:07.359434+0000","last_fullsized":"2024-04-18T21:05:07.359434+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:32:23.929877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637718+0000","last_change":"2024-04-18T21:05:04.628916+0000","last_active":"2024-04-18T21:05:06.637718+0000","last_peered":"2024-04-18T21:05:06.637718+0000","last_clean":"2024-04-18T21:05:06.637718+0000","last_became_active":"2024-04-18T21:05:04.628245+0000","last_became_peered":"2024-04-18T21:05:04.628245+0000","last_unstale":"2024-04-18T21:05:06.637718+0000","last_undegraded":"2024-04-18T21:05:06.637718+0000","last_fullsized":"2024-04-18T21:05:06.637718+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:34:58.562540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359757+0000","last_change":"2024-04-18T21:05:00.578563+0000","last_active":"2024-04-18T21:05:07.359757+0000","last_peered":"2024-04-18T21:05:07.359757+0000","last_clean":"2024-04-18T21:05:07.359757+0000","last_became_active":"2024-04-18T21:05:00.577960+0000","last_became_peered":"2024-04-18T21:05:00.577960+0000","last_unstale":"2024-04-18T21:05:07.359757+0000","last_undegraded":"2024-04-18T21:05:07.359757+0000","last_fullsized":"2024-04-18T21:05:07.359757+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:31:59.262440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636313+0000","last_change":"2024-04-18T21:05:05.646076+0000","last_active":"2024-04-18T21:05:06.636313+0000","last_peered":"2024-04-18T21:05:06.636313+0000","last_clean":"2024-04-18T21:05:06.636313+0000","last_became_active":"2024-04-18T21:05:05.645104+0000","last_became_peered":"2024-04-18T21:05:05.645104+0000","last_unstale":"2024-04-18T21:05:06.636313+0000","last_undegraded":"2024-04-18T21:05:06.636313+0000","last_fullsized":"2024-04-18T21:05:06.636313+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:34:38.427319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359695+0000","last_change":"2024-04-18T21:05:04.639700+0000","last_active":"2024-04-18T21:05:07.359695+0000","last_peered":"2024-04-18T21:05:07.359695+0000","last_clean":"2024-04-18T21:05:07.359695+0000","last_became_active":"2024-04-18T21:05:04.638928+0000","last_became_peered":"2024-04-18T21:05:04.638928+0000","last_unstale":"2024-04-18T21:05:07.359695+0000","last_undegraded":"2024-04-18T21:05:07.359695+0000","last_fullsized":"2024-04-18T21:05:07.359695+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:00:08.877854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.638177+0000","last_change":"2024-04-18T21:05:00.576907+0000","last_active":"2024-04-18T21:05:06.638177+0000","last_peered":"2024-04-18T21:05:06.638177+0000","last_clean":"2024-04-18T21:05:06.638177+0000","last_became_active":"2024-04-18T21:05:00.576152+0000","last_became_peered":"2024-04-18T21:05:00.576152+0000","last_unstale":"2024-04-18T21:05:06.638177+0000","last_undegraded":"2024-04-18T21:05:06.638177+0000","last_fullsized":"2024-04-18T21:05:06.638177+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:25:07.270023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636117+0000","last_change":"2024-04-18T21:05:05.646026+0000","last_active":"2024-04-18T21:05:06.636117+0000","last_peered":"2024-04-18T21:05:06.636117+0000","last_clean":"2024-04-18T21:05:06.636117+0000","last_became_active":"2024-04-18T21:05:05.645192+0000","last_became_peered":"2024-04-18T21:05:05.645192+0000","last_unstale":"2024-04-18T21:05:06.636117+0000","last_undegraded":"2024-04-18T21:05:06.636117+0000","last_fullsized":"2024-04-18T21:05:06.636117+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:05:46.009381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.360443+0000","last_change":"2024-04-18T21:05:04.640732+0000","last_active":"2024-04-18T21:05:07.360443+0000","last_peered":"2024-04-18T21:05:07.360443+0000","last_clean":"2024-04-18T21:05:07.360443+0000","last_became_active":"2024-04-18T21:05:04.638505+0000","last_became_peered":"2024-04-18T21:05:04.638505+0000","last_unstale":"2024-04-18T21:05:07.360443+0000","last_undegraded":"2024-04-18T21:05:07.360443+0000","last_fullsized":"2024-04-18T21:05:07.360443+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:34:58.562540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.360549+0000","last_change":"2024-04-18T21:05:00.579869+0000","last_active":"2024-04-18T21:05:07.360549+0000","last_peered":"2024-04-18T21:05:07.360549+0000","last_clean":"2024-04-18T21:05:07.360549+0000","last_became_active":"2024-04-18T21:05:00.579351+0000","last_became_peered":"2024-04-18T21:05:00.579351+0000","last_unstale":"2024-04-18T21:05:07.360549+0000","last_undegraded":"2024-04-18T21:05:07.360549+0000","last_fullsized":"2024-04-18T21:05:07.360549+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:15:02.061128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.357811+0000","last_change":"2024-04-18T21:05:05.642730+0000","last_active":"2024-04-18T21:05:07.357811+0000","last_peered":"2024-04-18T21:05:07.357811+0000","last_clean":"2024-04-18T21:05:07.357811+0000","last_became_active":"2024-04-18T21:05:05.641890+0000","last_became_peered":"2024-04-18T21:05:05.641890+0000","last_unstale":"2024-04-18T21:05:07.357811+0000","last_undegraded":"2024-04-18T21:05:07.357811+0000","last_fullsized":"2024-04-18T21:05:07.357811+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:05:46.009381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.583432+0000","last_change":"2024-04-18T21:05:04.639898+0000","last_active":"2024-04-18T21:05:07.583432+0000","last_peered":"2024-04-18T21:05:07.583432+0000","last_clean":"2024-04-18T21:05:07.583432+0000","last_became_active":"2024-04-18T21:05:04.639115+0000","last_became_peered":"2024-04-18T21:05:04.639115+0000","last_unstale":"2024-04-18T21:05:07.583432+0000","last_undegraded":"2024-04-18T21:05:07.583432+0000","last_fullsized":"2024-04-18T21:05:07.583432+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:44:19.076499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637757+0000","last_change":"2024-04-18T21:05:00.572414+0000","last_active":"2024-04-18T21:05:06.637757+0000","last_peered":"2024-04-18T21:05:06.637757+0000","last_clean":"2024-04-18T21:05:06.637757+0000","last_became_active":"2024-04-18T21:05:00.571755+0000","last_became_peered":"2024-04-18T21:05:00.571755+0000","last_unstale":"2024-04-18T21:05:06.637757+0000","last_undegraded":"2024-04-18T21:05:06.637757+0000","last_fullsized":"2024-04-18T21:05:06.637757+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:15:02.061128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635489+0000","last_change":"2024-04-18T21:05:05.655898+0000","last_active":"2024-04-18T21:05:06.635489+0000","last_peered":"2024-04-18T21:05:06.635489+0000","last_clean":"2024-04-18T21:05:06.635489+0000","last_became_active":"2024-04-18T21:05:05.654111+0000","last_became_peered":"2024-04-18T21:05:05.654111+0000","last_unstale":"2024-04-18T21:05:06.635489+0000","last_undegraded":"2024-04-18T21:05:06.635489+0000","last_fullsized":"2024-04-18T21:05:06.635489+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:19:38.537080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637592+0000","last_change":"2024-04-18T21:05:05.641373+0000","last_active":"2024-04-18T21:05:06.637592+0000","last_peered":"2024-04-18T21:05:06.637592+0000","last_clean":"2024-04-18T21:05:06.637592+0000","last_became_active":"2024-04-18T21:05:05.634204+0000","last_became_peered":"2024-04-18T21:05:05.634204+0000","last_unstale":"2024-04-18T21:05:06.637592+0000","last_undegraded":"2024-04-18T21:05:06.637592+0000","last_fullsized":"2024-04-18T21:05:06.637592+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:27:35.995004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637977+0000","last_change":"2024-04-18T21:05:04.631271+0000","last_active":"2024-04-18T21:05:06.637977+0000","last_peered":"2024-04-18T21:05:06.637977+0000","last_clean":"2024-04-18T21:05:06.637977+0000","last_became_active":"2024-04-18T21:05:04.630442+0000","last_became_peered":"2024-04-18T21:05:04.630442+0000","last_unstale":"2024-04-18T21:05:06.637977+0000","last_undegraded":"2024-04-18T21:05:06.637977+0000","last_fullsized":"2024-04-18T21:05:06.637977+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:33:48.703994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358112+0000","last_change":"2024-04-18T21:05:05.637894+0000","last_active":"2024-04-18T21:05:07.358112+0000","last_peered":"2024-04-18T21:05:07.358112+0000","last_clean":"2024-04-18T21:05:07.358112+0000","last_became_active":"2024-04-18T21:05:05.636846+0000","last_became_peered":"2024-04-18T21:05:05.636846+0000","last_unstale":"2024-04-18T21:05:07.358112+0000","last_undegraded":"2024-04-18T21:05:07.358112+0000","last_fullsized":"2024-04-18T21:05:07.358112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:34:31.132458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637990+0000","last_change":"2024-04-18T21:05:04.631152+0000","last_active":"2024-04-18T21:05:06.637990+0000","last_peered":"2024-04-18T21:05:06.637990+0000","last_clean":"2024-04-18T21:05:06.637990+0000","last_became_active":"2024-04-18T21:05:04.628900+0000","last_became_peered":"2024-04-18T21:05:04.628900+0000","last_unstale":"2024-04-18T21:05:06.637990+0000","last_undegraded":"2024-04-18T21:05:06.637990+0000","last_fullsized":"2024-04-18T21:05:06.637990+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:40:21.452052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637452+0000","last_change":"2024-04-18T21:05:04.629470+0000","last_active":"2024-04-18T21:05:06.637452+0000","last_peered":"2024-04-18T21:05:06.637452+0000","last_clean":"2024-04-18T21:05:06.637452+0000","last_became_active":"2024-04-18T21:05:04.628286+0000","last_became_peered":"2024-04-18T21:05:04.628286+0000","last_unstale":"2024-04-18T21:05:06.637452+0000","last_undegraded":"2024-04-18T21:05:06.637452+0000","last_fullsized":"2024-04-18T21:05:06.637452+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:00:08.877854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358071+0000","last_change":"2024-04-18T21:05:05.642793+0000","last_active":"2024-04-18T21:05:07.358071+0000","last_peered":"2024-04-18T21:05:07.358071+0000","last_clean":"2024-04-18T21:05:07.358071+0000","last_became_active":"2024-04-18T21:05:05.641983+0000","last_became_peered":"2024-04-18T21:05:05.641983+0000","last_unstale":"2024-04-18T21:05:07.358071+0000","last_undegraded":"2024-04-18T21:05:07.358071+0000","last_fullsized":"2024-04-18T21:05:07.358071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:46:36.339289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.360264+0000","last_change":"2024-04-18T21:05:04.641445+0000","last_active":"2024-04-18T21:05:07.360264+0000","last_peered":"2024-04-18T21:05:07.360264+0000","last_clean":"2024-04-18T21:05:07.360264+0000","last_became_active":"2024-04-18T21:05:04.640682+0000","last_became_peered":"2024-04-18T21:05:04.640682+0000","last_unstale":"2024-04-18T21:05:07.360264+0000","last_undegraded":"2024-04-18T21:05:07.360264+0000","last_fullsized":"2024-04-18T21:05:07.360264+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:46:36.285416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.357743+0000","last_change":"2024-04-18T21:05:05.641561+0000","last_active":"2024-04-18T21:05:07.357743+0000","last_peered":"2024-04-18T21:05:07.357743+0000","last_clean":"2024-04-18T21:05:07.357743+0000","last_became_active":"2024-04-18T21:05:05.640922+0000","last_became_peered":"2024-04-18T21:05:05.640922+0000","last_unstale":"2024-04-18T21:05:07.357743+0000","last_undegraded":"2024-04-18T21:05:07.357743+0000","last_fullsized":"2024-04-18T21:05:07.357743+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:56.408234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637829+0000","last_change":"2024-04-18T21:05:05.651530+0000","last_active":"2024-04-18T21:05:06.637829+0000","last_peered":"2024-04-18T21:05:06.637829+0000","last_clean":"2024-04-18T21:05:06.637829+0000","last_became_active":"2024-04-18T21:05:05.648167+0000","last_became_peered":"2024-04-18T21:05:05.648167+0000","last_unstale":"2024-04-18T21:05:06.637829+0000","last_undegraded":"2024-04-18T21:05:06.637829+0000","last_fullsized":"2024-04-18T21:05:06.637829+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:14:51.873741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358019+0000","last_change":"2024-04-18T21:05:04.637369+0000","last_active":"2024-04-18T21:05:07.358019+0000","last_peered":"2024-04-18T21:05:07.358019+0000","last_clean":"2024-04-18T21:05:07.358019+0000","last_became_active":"2024-04-18T21:05:04.636468+0000","last_became_peered":"2024-04-18T21:05:04.636468+0000","last_unstale":"2024-04-18T21:05:07.358019+0000","last_undegraded":"2024-04-18T21:05:07.358019+0000","last_fullsized":"2024-04-18T21:05:07.358019+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:40:21.452052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.360014+0000","last_change":"2024-04-18T21:05:05.651245+0000","last_active":"2024-04-18T21:05:07.360014+0000","last_peered":"2024-04-18T21:05:07.360014+0000","last_clean":"2024-04-18T21:05:07.360014+0000","last_became_active":"2024-04-18T21:05:05.650463+0000","last_became_peered":"2024-04-18T21:05:05.650463+0000","last_unstale":"2024-04-18T21:05:07.360014+0000","last_undegraded":"2024-04-18T21:05:07.360014+0000","last_fullsized":"2024-04-18T21:05:07.360014+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:27:17.530889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358504+0000","last_change":"2024-04-18T21:05:04.637597+0000","last_active":"2024-04-18T21:05:07.358504+0000","last_peered":"2024-04-18T21:05:07.358504+0000","last_clean":"2024-04-18T21:05:07.358504+0000","last_became_active":"2024-04-18T21:05:04.636827+0000","last_became_peered":"2024-04-18T21:05:04.636827+0000","last_unstale":"2024-04-18T21:05:07.358504+0000","last_undegraded":"2024-04-18T21:05:07.358504+0000","last_fullsized":"2024-04-18T21:05:07.358504+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:43.511952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636925+0000","last_change":"2024-04-18T21:05:05.658971+0000","last_active":"2024-04-18T21:05:06.636925+0000","last_peered":"2024-04-18T21:05:06.636925+0000","last_clean":"2024-04-18T21:05:06.636925+0000","last_became_active":"2024-04-18T21:05:05.658363+0000","last_became_peered":"2024-04-18T21:05:05.658363+0000","last_unstale":"2024-04-18T21:05:06.636925+0000","last_undegraded":"2024-04-18T21:05:06.636925+0000","last_fullsized":"2024-04-18T21:05:06.636925+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:12.944469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636616+0000","last_change":"2024-04-18T21:05:04.636585+0000","last_active":"2024-04-18T21:05:06.636616+0000","last_peered":"2024-04-18T21:05:06.636616+0000","last_clean":"2024-04-18T21:05:06.636616+0000","last_became_active":"2024-04-18T21:05:04.635670+0000","last_became_peered":"2024-04-18T21:05:04.635670+0000","last_unstale":"2024-04-18T21:05:06.636616+0000","last_undegraded":"2024-04-18T21:05:06.636616+0000","last_fullsized":"2024-04-18T21:05:06.636616+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:34:33.779063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636955+0000","last_change":"2024-04-18T21:05:05.649960+0000","last_active":"2024-04-18T21:05:06.636955+0000","last_peered":"2024-04-18T21:05:06.636955+0000","last_clean":"2024-04-18T21:05:06.636955+0000","last_became_active":"2024-04-18T21:05:05.648528+0000","last_became_peered":"2024-04-18T21:05:05.648528+0000","last_unstale":"2024-04-18T21:05:06.636955+0000","last_undegraded":"2024-04-18T21:05:06.636955+0000","last_fullsized":"2024-04-18T21:05:06.636955+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:20:45.938503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636493+0000","last_change":"2024-04-18T21:05:04.630151+0000","last_active":"2024-04-18T21:05:06.636493+0000","last_peered":"2024-04-18T21:05:06.636493+0000","last_clean":"2024-04-18T21:05:06.636493+0000","last_became_active":"2024-04-18T21:05:04.627968+0000","last_became_peered":"2024-04-18T21:05:04.627968+0000","last_unstale":"2024-04-18T21:05:06.636493+0000","last_undegraded":"2024-04-18T21:05:06.636493+0000","last_fullsized":"2024-04-18T21:05:06.636493+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:00:33.393636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636522+0000","last_change":"2024-04-18T21:05:05.624840+0000","last_active":"2024-04-18T21:05:06.636522+0000","last_peered":"2024-04-18T21:05:06.636522+0000","last_clean":"2024-04-18T21:05:06.636522+0000","last_became_active":"2024-04-18T21:05:05.622950+0000","last_became_peered":"2024-04-18T21:05:05.622950+0000","last_unstale":"2024-04-18T21:05:06.636522+0000","last_undegraded":"2024-04-18T21:05:06.636522+0000","last_fullsized":"2024-04-18T21:05:06.636522+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:27:17.530889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637987+0000","last_change":"2024-04-18T21:05:04.626715+0000","last_active":"2024-04-18T21:05:06.637987+0000","last_peered":"2024-04-18T21:05:06.637987+0000","last_clean":"2024-04-18T21:05:06.637987+0000","last_became_active":"2024-04-18T21:05:04.625270+0000","last_became_peered":"2024-04-18T21:05:04.625270+0000","last_unstale":"2024-04-18T21:05:06.637987+0000","last_undegraded":"2024-04-18T21:05:06.637987+0000","last_fullsized":"2024-04-18T21:05:06.637987+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:43.511952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637167+0000","last_change":"2024-04-18T21:05:05.627962+0000","last_active":"2024-04-18T21:05:06.637167+0000","last_peered":"2024-04-18T21:05:06.637167+0000","last_clean":"2024-04-18T21:05:06.637167+0000","last_became_active":"2024-04-18T21:05:05.626698+0000","last_became_peered":"2024-04-18T21:05:05.626698+0000","last_unstale":"2024-04-18T21:05:06.637167+0000","last_undegraded":"2024-04-18T21:05:06.637167+0000","last_fullsized":"2024-04-18T21:05:06.637167+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:48:48.973087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637569+0000","last_change":"2024-04-18T21:05:04.632776+0000","last_active":"2024-04-18T21:05:06.637569+0000","last_peered":"2024-04-18T21:05:06.637569+0000","last_clean":"2024-04-18T21:05:06.637569+0000","last_became_active":"2024-04-18T21:05:04.630142+0000","last_became_peered":"2024-04-18T21:05:04.630142+0000","last_unstale":"2024-04-18T21:05:06.637569+0000","last_undegraded":"2024-04-18T21:05:06.637569+0000","last_fullsized":"2024-04-18T21:05:06.637569+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:19:36.721897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636797+0000","last_change":"2024-04-18T21:05:05.653025+0000","last_active":"2024-04-18T21:05:06.636797+0000","last_peered":"2024-04-18T21:05:06.636797+0000","last_clean":"2024-04-18T21:05:06.636797+0000","last_became_active":"2024-04-18T21:05:05.645039+0000","last_became_peered":"2024-04-18T21:05:05.645039+0000","last_unstale":"2024-04-18T21:05:06.636797+0000","last_undegraded":"2024-04-18T21:05:06.636797+0000","last_fullsized":"2024-04-18T21:05:06.636797+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.360315+0000","last_change":"2024-04-18T21:05:04.640134+0000","last_active":"2024-04-18T21:05:07.360315+0000","last_peered":"2024-04-18T21:05:07.360315+0000","last_clean":"2024-04-18T21:05:07.360315+0000","last_became_active":"2024-04-18T21:05:04.638597+0000","last_became_peered":"2024-04-18T21:05:04.638597+0000","last_unstale":"2024-04-18T21:05:07.360315+0000","last_undegraded":"2024-04-18T21:05:07.360315+0000","last_fullsized":"2024-04-18T21:05:07.360315+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:56:05.795125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635677+0000","last_change":"2024-04-18T21:05:05.629022+0000","last_active":"2024-04-18T21:05:06.635677+0000","last_peered":"2024-04-18T21:05:06.635677+0000","last_clean":"2024-04-18T21:05:06.635677+0000","last_became_active":"2024-04-18T21:05:05.627643+0000","last_became_peered":"2024-04-18T21:05:05.627643+0000","last_unstale":"2024-04-18T21:05:06.635677+0000","last_undegraded":"2024-04-18T21:05:06.635677+0000","last_fullsized":"2024-04-18T21:05:06.635677+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:32:23.929877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359950+0000","last_change":"2024-04-18T21:05:04.641338+0000","last_active":"2024-04-18T21:05:07.359950+0000","last_peered":"2024-04-18T21:05:07.359950+0000","last_clean":"2024-04-18T21:05:07.359950+0000","last_became_active":"2024-04-18T21:05:04.639958+0000","last_became_peered":"2024-04-18T21:05:04.639958+0000","last_unstale":"2024-04-18T21:05:07.359950+0000","last_undegraded":"2024-04-18T21:05:07.359950+0000","last_fullsized":"2024-04-18T21:05:07.359950+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:42:45.392908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738375,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31340,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340500,"statfs":{"total":96636764160,"available":96604672000,"internally_reserved":0,"allocated":163840,"data_stored":55728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31940,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339900,"statfs":{"total":96636764160,"available":96604057600,"internally_reserved":0,"allocated":774144,"data_stored":647274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":782336,"data_stored":647890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:05:12.135 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:05:12.464 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:05:12.465 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-04-18T21:05:12.480 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-04-18T21:05:10.503852+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91068,"kb_used_data":1680,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024452,"statfs":{"total":289910292480,"available":289817038848,"internally_reserved":0,"allocated":1720320,"data_stored":1350892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001975"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637590+0000","last_change":"2024-04-18T21:05:05.652795+0000","last_active":"2024-04-18T21:05:06.637590+0000","last_peered":"2024-04-18T21:05:06.637590+0000","last_clean":"2024-04-18T21:05:06.637590+0000","last_became_active":"2024-04-18T21:05:05.650121+0000","last_became_peered":"2024-04-18T21:05:05.650121+0000","last_unstale":"2024-04-18T21:05:06.637590+0000","last_undegraded":"2024-04-18T21:05:06.637590+0000","last_fullsized":"2024-04-18T21:05:06.637590+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637298+0000","last_change":"2024-04-18T21:05:05.657531+0000","last_active":"2024-04-18T21:05:06.637298+0000","last_peered":"2024-04-18T21:05:06.637298+0000","last_clean":"2024-04-18T21:05:06.637298+0000","last_became_active":"2024-04-18T21:05:05.653101+0000","last_became_peered":"2024-04-18T21:05:05.653101+0000","last_unstale":"2024-04-18T21:05:06.637298+0000","last_undegraded":"2024-04-18T21:05:06.637298+0000","last_fullsized":"2024-04-18T21:05:06.637298+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:32:23.929877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636411+0000","last_change":"2024-04-18T21:05:05.647965+0000","last_active":"2024-04-18T21:05:06.636411+0000","last_peered":"2024-04-18T21:05:06.636411+0000","last_clean":"2024-04-18T21:05:06.636411+0000","last_became_active":"2024-04-18T21:05:05.645931+0000","last_became_peered":"2024-04-18T21:05:05.645931+0000","last_unstale":"2024-04-18T21:05:06.636411+0000","last_undegraded":"2024-04-18T21:05:06.636411+0000","last_fullsized":"2024-04-18T21:05:06.636411+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:04.350492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637673+0000","last_change":"2024-04-18T21:05:05.629321+0000","last_active":"2024-04-18T21:05:06.637673+0000","last_peered":"2024-04-18T21:05:06.637673+0000","last_clean":"2024-04-18T21:05:06.637673+0000","last_became_active":"2024-04-18T21:05:05.627956+0000","last_became_peered":"2024-04-18T21:05:05.627956+0000","last_unstale":"2024-04-18T21:05:06.637673+0000","last_undegraded":"2024-04-18T21:05:06.637673+0000","last_fullsized":"2024-04-18T21:05:06.637673+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:15:28.458476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636510+0000","last_change":"2024-04-18T21:05:05.648710+0000","last_active":"2024-04-18T21:05:06.636510+0000","last_peered":"2024-04-18T21:05:06.636510+0000","last_clean":"2024-04-18T21:05:06.636510+0000","last_became_active":"2024-04-18T21:05:05.647801+0000","last_became_peered":"2024-04-18T21:05:05.647801+0000","last_unstale":"2024-04-18T21:05:06.636510+0000","last_undegraded":"2024-04-18T21:05:06.636510+0000","last_fullsized":"2024-04-18T21:05:06.636510+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:46:36.339289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635784+0000","last_change":"2024-04-18T21:05:05.629095+0000","last_active":"2024-04-18T21:05:06.635784+0000","last_peered":"2024-04-18T21:05:06.635784+0000","last_clean":"2024-04-18T21:05:06.635784+0000","last_became_active":"2024-04-18T21:05:05.627664+0000","last_became_peered":"2024-04-18T21:05:05.627664+0000","last_unstale":"2024-04-18T21:05:06.635784+0000","last_undegraded":"2024-04-18T21:05:06.635784+0000","last_fullsized":"2024-04-18T21:05:06.635784+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:51:28.440070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635525+0000","last_change":"2024-04-18T21:05:05.625047+0000","last_active":"2024-04-18T21:05:06.635525+0000","last_peered":"2024-04-18T21:05:06.635525+0000","last_clean":"2024-04-18T21:05:06.635525+0000","last_became_active":"2024-04-18T21:05:05.622781+0000","last_became_peered":"2024-04-18T21:05:05.622781+0000","last_unstale":"2024-04-18T21:05:06.635525+0000","last_undegraded":"2024-04-18T21:05:06.635525+0000","last_fullsized":"2024-04-18T21:05:06.635525+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:12.944469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.634795+0000","last_change":"2024-04-18T21:05:05.640390+0000","last_active":"2024-04-18T21:05:06.634795+0000","last_peered":"2024-04-18T21:05:06.634795+0000","last_clean":"2024-04-18T21:05:06.634795+0000","last_became_active":"2024-04-18T21:05:05.638295+0000","last_became_peered":"2024-04-18T21:05:05.638295+0000","last_unstale":"2024-04-18T21:05:06.634795+0000","last_undegraded":"2024-04-18T21:05:06.634795+0000","last_fullsized":"2024-04-18T21:05:06.634795+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:34:31.132458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359217+0000","last_change":"2024-04-18T21:05:05.660752+0000","last_active":"2024-04-18T21:05:07.359217+0000","last_peered":"2024-04-18T21:05:07.359217+0000","last_clean":"2024-04-18T21:05:07.359217+0000","last_became_active":"2024-04-18T21:05:05.659226+0000","last_became_peered":"2024-04-18T21:05:05.659226+0000","last_unstale":"2024-04-18T21:05:07.359217+0000","last_undegraded":"2024-04-18T21:05:07.359217+0000","last_fullsized":"2024-04-18T21:05:07.359217+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:20:45.938503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637371+0000","last_change":"2024-04-18T21:05:05.656660+0000","last_active":"2024-04-18T21:05:06.637371+0000","last_peered":"2024-04-18T21:05:06.637371+0000","last_clean":"2024-04-18T21:05:06.637371+0000","last_became_active":"2024-04-18T21:05:05.653829+0000","last_became_peered":"2024-04-18T21:05:05.653829+0000","last_unstale":"2024-04-18T21:05:06.637371+0000","last_undegraded":"2024-04-18T21:05:06.637371+0000","last_fullsized":"2024-04-18T21:05:06.637371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:50:40.920146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636818+0000","last_change":"2024-04-18T21:05:05.646721+0000","last_active":"2024-04-18T21:05:06.636818+0000","last_peered":"2024-04-18T21:05:06.636818+0000","last_clean":"2024-04-18T21:05:06.636818+0000","last_became_active":"2024-04-18T21:05:05.643421+0000","last_became_peered":"2024-04-18T21:05:05.643421+0000","last_unstale":"2024-04-18T21:05:06.636818+0000","last_undegraded":"2024-04-18T21:05:06.636818+0000","last_fullsized":"2024-04-18T21:05:06.636818+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:14:51.873741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636882+0000","last_change":"2024-04-18T21:05:05.656320+0000","last_active":"2024-04-18T21:05:06.636882+0000","last_peered":"2024-04-18T21:05:06.636882+0000","last_clean":"2024-04-18T21:05:06.636882+0000","last_became_active":"2024-04-18T21:05:05.655508+0000","last_became_peered":"2024-04-18T21:05:05.655508+0000","last_unstale":"2024-04-18T21:05:06.636882+0000","last_undegraded":"2024-04-18T21:05:06.636882+0000","last_fullsized":"2024-04-18T21:05:06.636882+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:51.225379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636068+0000","last_change":"2024-04-18T21:05:05.649001+0000","last_active":"2024-04-18T21:05:06.636068+0000","last_peered":"2024-04-18T21:05:06.636068+0000","last_clean":"2024-04-18T21:05:06.636068+0000","last_became_active":"2024-04-18T21:05:05.648070+0000","last_became_peered":"2024-04-18T21:05:05.648070+0000","last_unstale":"2024-04-18T21:05:06.636068+0000","last_undegraded":"2024-04-18T21:05:06.636068+0000","last_fullsized":"2024-04-18T21:05:06.636068+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:56.408234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636128+0000","last_change":"2024-04-18T21:05:05.635880+0000","last_active":"2024-04-18T21:05:06.636128+0000","last_peered":"2024-04-18T21:05:06.636128+0000","last_clean":"2024-04-18T21:05:06.636128+0000","last_became_active":"2024-04-18T21:05:05.635089+0000","last_became_peered":"2024-04-18T21:05:05.635089+0000","last_unstale":"2024-04-18T21:05:06.636128+0000","last_undegraded":"2024-04-18T21:05:06.636128+0000","last_fullsized":"2024-04-18T21:05:06.636128+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:50:40.920146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635604+0000","last_change":"2024-04-18T21:05:05.639640+0000","last_active":"2024-04-18T21:05:06.635604+0000","last_peered":"2024-04-18T21:05:06.635604+0000","last_clean":"2024-04-18T21:05:06.635604+0000","last_became_active":"2024-04-18T21:05:05.637311+0000","last_became_peered":"2024-04-18T21:05:05.637311+0000","last_unstale":"2024-04-18T21:05:06.635604+0000","last_undegraded":"2024-04-18T21:05:06.635604+0000","last_fullsized":"2024-04-18T21:05:06.635604+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:20:45.938503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.634796+0000","last_change":"2024-04-18T21:05:05.638203+0000","last_active":"2024-04-18T21:05:06.634796+0000","last_peered":"2024-04-18T21:05:06.634796+0000","last_clean":"2024-04-18T21:05:06.634796+0000","last_became_active":"2024-04-18T21:05:05.637352+0000","last_became_peered":"2024-04-18T21:05:05.637352+0000","last_unstale":"2024-04-18T21:05:06.634796+0000","last_undegraded":"2024-04-18T21:05:06.634796+0000","last_fullsized":"2024-04-18T21:05:06.634796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.360278+0000","last_change":"2024-04-18T21:05:05.661613+0000","last_active":"2024-04-18T21:05:07.360278+0000","last_peered":"2024-04-18T21:05:07.360278+0000","last_clean":"2024-04-18T21:05:07.360278+0000","last_became_active":"2024-04-18T21:05:05.660496+0000","last_became_peered":"2024-04-18T21:05:05.660496+0000","last_unstale":"2024-04-18T21:05:07.360278+0000","last_undegraded":"2024-04-18T21:05:07.360278+0000","last_fullsized":"2024-04-18T21:05:07.360278+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:31:31.842528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637954+0000","last_change":"2024-04-18T21:05:05.655261+0000","last_active":"2024-04-18T21:05:06.637954+0000","last_peered":"2024-04-18T21:05:06.637954+0000","last_clean":"2024-04-18T21:05:06.637954+0000","last_became_active":"2024-04-18T21:05:05.651388+0000","last_became_peered":"2024-04-18T21:05:05.651388+0000","last_unstale":"2024-04-18T21:05:06.637954+0000","last_undegraded":"2024-04-18T21:05:06.637954+0000","last_fullsized":"2024-04-18T21:05:06.637954+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:53.850184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359241+0000","last_change":"2024-04-18T21:05:05.652710+0000","last_active":"2024-04-18T21:05:07.359241+0000","last_peered":"2024-04-18T21:05:07.359241+0000","last_clean":"2024-04-18T21:05:07.359241+0000","last_became_active":"2024-04-18T21:05:05.651929+0000","last_became_peered":"2024-04-18T21:05:05.651929+0000","last_unstale":"2024-04-18T21:05:07.359241+0000","last_undegraded":"2024-04-18T21:05:07.359241+0000","last_fullsized":"2024-04-18T21:05:07.359241+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:12.944469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636438+0000","last_change":"2024-04-18T21:05:05.638338+0000","last_active":"2024-04-18T21:05:06.636438+0000","last_peered":"2024-04-18T21:05:06.636438+0000","last_clean":"2024-04-18T21:05:06.636438+0000","last_became_active":"2024-04-18T21:05:05.637567+0000","last_became_peered":"2024-04-18T21:05:05.637567+0000","last_unstale":"2024-04-18T21:05:06.636438+0000","last_undegraded":"2024-04-18T21:05:06.636438+0000","last_fullsized":"2024-04-18T21:05:06.636438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637117+0000","last_change":"2024-04-18T21:05:05.643606+0000","last_active":"2024-04-18T21:05:06.637117+0000","last_peered":"2024-04-18T21:05:06.637117+0000","last_clean":"2024-04-18T21:05:06.637117+0000","last_became_active":"2024-04-18T21:05:05.642991+0000","last_became_peered":"2024-04-18T21:05:05.642991+0000","last_unstale":"2024-04-18T21:05:06.637117+0000","last_undegraded":"2024-04-18T21:05:06.637117+0000","last_fullsized":"2024-04-18T21:05:06.637117+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:01.841786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636035+0000","last_change":"2024-04-18T21:05:05.650896+0000","last_active":"2024-04-18T21:05:06.636035+0000","last_peered":"2024-04-18T21:05:06.636035+0000","last_clean":"2024-04-18T21:05:06.636035+0000","last_became_active":"2024-04-18T21:05:05.650083+0000","last_became_peered":"2024-04-18T21:05:05.650083+0000","last_unstale":"2024-04-18T21:05:06.636035+0000","last_undegraded":"2024-04-18T21:05:06.636035+0000","last_fullsized":"2024-04-18T21:05:06.636035+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:43:55.788425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.357454+0000","last_change":"2024-04-18T21:05:05.640362+0000","last_active":"2024-04-18T21:05:07.357454+0000","last_peered":"2024-04-18T21:05:07.357454+0000","last_clean":"2024-04-18T21:05:07.357454+0000","last_became_active":"2024-04-18T21:05:05.635643+0000","last_became_peered":"2024-04-18T21:05:05.635643+0000","last_unstale":"2024-04-18T21:05:07.357454+0000","last_undegraded":"2024-04-18T21:05:07.357454+0000","last_fullsized":"2024-04-18T21:05:07.357454+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:43:55.788425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635029+0000","last_change":"2024-04-18T21:05:05.642755+0000","last_active":"2024-04-18T21:05:06.635029+0000","last_peered":"2024-04-18T21:05:06.635029+0000","last_clean":"2024-04-18T21:05:06.635029+0000","last_became_active":"2024-04-18T21:05:05.642150+0000","last_became_peered":"2024-04-18T21:05:05.642150+0000","last_unstale":"2024-04-18T21:05:06.635029+0000","last_undegraded":"2024-04-18T21:05:06.635029+0000","last_fullsized":"2024-04-18T21:05:06.635029+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:29:22.647425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637381+0000","last_change":"2024-04-18T21:05:05.653741+0000","last_active":"2024-04-18T21:05:06.637381+0000","last_peered":"2024-04-18T21:05:06.637381+0000","last_clean":"2024-04-18T21:05:06.637381+0000","last_became_active":"2024-04-18T21:05:05.650174+0000","last_became_peered":"2024-04-18T21:05:05.650174+0000","last_unstale":"2024-04-18T21:05:06.637381+0000","last_undegraded":"2024-04-18T21:05:06.637381+0000","last_fullsized":"2024-04-18T21:05:06.637381+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:04.350492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.360000+0000","last_change":"2024-04-18T21:05:05.649581+0000","last_active":"2024-04-18T21:05:07.360000+0000","last_peered":"2024-04-18T21:05:07.360000+0000","last_clean":"2024-04-18T21:05:07.360000+0000","last_became_active":"2024-04-18T21:05:05.648233+0000","last_became_peered":"2024-04-18T21:05:05.648233+0000","last_unstale":"2024-04-18T21:05:07.360000+0000","last_undegraded":"2024-04-18T21:05:07.360000+0000","last_fullsized":"2024-04-18T21:05:07.360000+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637099+0000","last_change":"2024-04-18T21:05:05.646926+0000","last_active":"2024-04-18T21:05:06.637099+0000","last_peered":"2024-04-18T21:05:06.637099+0000","last_clean":"2024-04-18T21:05:06.637099+0000","last_became_active":"2024-04-18T21:05:05.644942+0000","last_became_peered":"2024-04-18T21:05:05.644942+0000","last_unstale":"2024-04-18T21:05:06.637099+0000","last_undegraded":"2024-04-18T21:05:06.637099+0000","last_fullsized":"2024-04-18T21:05:06.637099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:53.850184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637629+0000","last_change":"2024-04-18T21:05:05.656314+0000","last_active":"2024-04-18T21:05:06.637629+0000","last_peered":"2024-04-18T21:05:06.637629+0000","last_clean":"2024-04-18T21:05:06.637629+0000","last_became_active":"2024-04-18T21:05:05.655364+0000","last_became_peered":"2024-04-18T21:05:05.655364+0000","last_unstale":"2024-04-18T21:05:06.637629+0000","last_undegraded":"2024-04-18T21:05:06.637629+0000","last_fullsized":"2024-04-18T21:05:06.637629+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:27:17.530889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358862+0000","last_change":"2024-04-18T21:05:05.653532+0000","last_active":"2024-04-18T21:05:07.358862+0000","last_peered":"2024-04-18T21:05:07.358862+0000","last_clean":"2024-04-18T21:05:07.358862+0000","last_became_active":"2024-04-18T21:05:05.652950+0000","last_became_peered":"2024-04-18T21:05:05.652950+0000","last_unstale":"2024-04-18T21:05:07.358862+0000","last_undegraded":"2024-04-18T21:05:07.358862+0000","last_fullsized":"2024-04-18T21:05:07.358862+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:51.225379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636535+0000","last_change":"2024-04-18T21:05:05.648084+0000","last_active":"2024-04-18T21:05:06.636535+0000","last_peered":"2024-04-18T21:05:06.636535+0000","last_clean":"2024-04-18T21:05:06.636535+0000","last_became_active":"2024-04-18T21:05:05.645340+0000","last_became_peered":"2024-04-18T21:05:05.645340+0000","last_unstale":"2024-04-18T21:05:06.636535+0000","last_undegraded":"2024-04-18T21:05:06.636535+0000","last_fullsized":"2024-04-18T21:05:06.636535+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:34:31.132458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.357930+0000","last_change":"2024-04-18T21:05:05.655034+0000","last_active":"2024-04-18T21:05:07.357930+0000","last_peered":"2024-04-18T21:05:07.357930+0000","last_clean":"2024-04-18T21:05:07.357930+0000","last_became_active":"2024-04-18T21:05:05.654517+0000","last_became_peered":"2024-04-18T21:05:05.654517+0000","last_unstale":"2024-04-18T21:05:07.357930+0000","last_undegraded":"2024-04-18T21:05:07.357930+0000","last_fullsized":"2024-04-18T21:05:07.357930+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:34:38.427319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635266+0000","last_change":"2024-04-18T21:05:05.626677+0000","last_active":"2024-04-18T21:05:06.635266+0000","last_peered":"2024-04-18T21:05:06.635266+0000","last_clean":"2024-04-18T21:05:06.635266+0000","last_became_active":"2024-04-18T21:05:05.624250+0000","last_became_peered":"2024-04-18T21:05:05.624250+0000","last_unstale":"2024-04-18T21:05:06.635266+0000","last_undegraded":"2024-04-18T21:05:06.635266+0000","last_fullsized":"2024-04-18T21:05:06.635266+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:51.225379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637347+0000","last_change":"2024-04-18T21:05:05.649918+0000","last_active":"2024-04-18T21:05:06.637347+0000","last_peered":"2024-04-18T21:05:06.637347+0000","last_clean":"2024-04-18T21:05:06.637347+0000","last_became_active":"2024-04-18T21:05:05.647147+0000","last_became_peered":"2024-04-18T21:05:05.647147+0000","last_unstale":"2024-04-18T21:05:06.637347+0000","last_undegraded":"2024-04-18T21:05:06.637347+0000","last_fullsized":"2024-04-18T21:05:06.637347+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:51:28.440070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637900+0000","last_change":"2024-04-18T21:05:04.632748+0000","last_active":"2024-04-18T21:05:06.637900+0000","last_peered":"2024-04-18T21:05:06.637900+0000","last_clean":"2024-04-18T21:05:06.637900+0000","last_became_active":"2024-04-18T21:05:04.628407+0000","last_became_peered":"2024-04-18T21:05:04.628407+0000","last_unstale":"2024-04-18T21:05:06.637900+0000","last_undegraded":"2024-04-18T21:05:06.637900+0000","last_fullsized":"2024-04-18T21:05:06.637900+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:42:45.392908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637688+0000","last_change":"2024-04-18T21:05:05.649199+0000","last_active":"2024-04-18T21:05:06.637688+0000","last_peered":"2024-04-18T21:05:06.637688+0000","last_clean":"2024-04-18T21:05:06.637688+0000","last_became_active":"2024-04-18T21:05:05.646898+0000","last_became_peered":"2024-04-18T21:05:05.646898+0000","last_unstale":"2024-04-18T21:05:06.637688+0000","last_undegraded":"2024-04-18T21:05:06.637688+0000","last_fullsized":"2024-04-18T21:05:06.637688+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:31:31.842528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358409+0000","last_change":"2024-04-18T21:05:04.638017+0000","last_active":"2024-04-18T21:05:07.358409+0000","last_peered":"2024-04-18T21:05:07.358409+0000","last_clean":"2024-04-18T21:05:07.358409+0000","last_became_active":"2024-04-18T21:05:04.637287+0000","last_became_peered":"2024-04-18T21:05:04.637287+0000","last_unstale":"2024-04-18T21:05:07.358409+0000","last_undegraded":"2024-04-18T21:05:07.358409+0000","last_fullsized":"2024-04-18T21:05:07.358409+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:25.891472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.360516+0000","last_change":"2024-04-18T21:05:05.650757+0000","last_active":"2024-04-18T21:05:07.360516+0000","last_peered":"2024-04-18T21:05:07.360516+0000","last_clean":"2024-04-18T21:05:07.360516+0000","last_became_active":"2024-04-18T21:05:05.650143+0000","last_became_peered":"2024-04-18T21:05:05.650143+0000","last_unstale":"2024-04-18T21:05:07.360516+0000","last_undegraded":"2024-04-18T21:05:07.360516+0000","last_fullsized":"2024-04-18T21:05:07.360516+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:14:51.873741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635796+0000","last_change":"2024-04-18T21:05:04.628489+0000","last_active":"2024-04-18T21:05:06.635796+0000","last_peered":"2024-04-18T21:05:06.635796+0000","last_clean":"2024-04-18T21:05:06.635796+0000","last_became_active":"2024-04-18T21:05:04.627279+0000","last_became_peered":"2024-04-18T21:05:04.627279+0000","last_unstale":"2024-04-18T21:05:06.635796+0000","last_undegraded":"2024-04-18T21:05:06.635796+0000","last_fullsized":"2024-04-18T21:05:06.635796+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:43:23.420744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359664+0000","last_change":"2024-04-18T21:05:05.649347+0000","last_active":"2024-04-18T21:05:07.359664+0000","last_peered":"2024-04-18T21:05:07.359664+0000","last_clean":"2024-04-18T21:05:07.359664+0000","last_became_active":"2024-04-18T21:05:05.648144+0000","last_became_peered":"2024-04-18T21:05:05.648144+0000","last_unstale":"2024-04-18T21:05:07.359664+0000","last_undegraded":"2024-04-18T21:05:07.359664+0000","last_fullsized":"2024-04-18T21:05:07.359664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:51:28.440070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":22,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635267+0000","last_change":"2024-04-18T21:05:04.624089+0000","last_active":"2024-04-18T21:05:06.635267+0000","last_peered":"2024-04-18T21:05:06.635267+0000","last_clean":"2024-04-18T21:05:06.635267+0000","last_became_active":"2024-04-18T21:05:04.623238+0000","last_became_peered":"2024-04-18T21:05:04.623238+0000","last_unstale":"2024-04-18T21:05:06.635267+0000","last_undegraded":"2024-04-18T21:05:06.635267+0000","last_fullsized":"2024-04-18T21:05:06.635267+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:44:19.076499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637569+0000","last_change":"2024-04-18T21:05:04.633907+0000","last_active":"2024-04-18T21:05:06.637569+0000","last_peered":"2024-04-18T21:05:06.637569+0000","last_clean":"2024-04-18T21:05:06.637569+0000","last_became_active":"2024-04-18T21:05:04.630308+0000","last_became_peered":"2024-04-18T21:05:04.630308+0000","last_unstale":"2024-04-18T21:05:06.637569+0000","last_undegraded":"2024-04-18T21:05:06.637569+0000","last_fullsized":"2024-04-18T21:05:06.637569+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:55:46.219812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635046+0000","last_change":"2024-04-18T21:05:05.658572+0000","last_active":"2024-04-18T21:05:06.635046+0000","last_peered":"2024-04-18T21:05:06.635046+0000","last_clean":"2024-04-18T21:05:06.635046+0000","last_became_active":"2024-04-18T21:05:05.657842+0000","last_became_peered":"2024-04-18T21:05:05.657842+0000","last_unstale":"2024-04-18T21:05:06.635046+0000","last_undegraded":"2024-04-18T21:05:06.635046+0000","last_fullsized":"2024-04-18T21:05:06.635046+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:26:38.636530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.638161+0000","last_change":"2024-04-18T21:05:04.628541+0000","last_active":"2024-04-18T21:05:06.638161+0000","last_peered":"2024-04-18T21:05:06.638161+0000","last_clean":"2024-04-18T21:05:06.638161+0000","last_became_active":"2024-04-18T21:05:04.627407+0000","last_became_peered":"2024-04-18T21:05:04.627407+0000","last_unstale":"2024-04-18T21:05:06.638161+0000","last_undegraded":"2024-04-18T21:05:06.638161+0000","last_fullsized":"2024-04-18T21:05:06.638161+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:55:48.643174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635639+0000","last_change":"2024-04-18T21:05:05.651649+0000","last_active":"2024-04-18T21:05:06.635639+0000","last_peered":"2024-04-18T21:05:06.635639+0000","last_clean":"2024-04-18T21:05:06.635639+0000","last_became_active":"2024-04-18T21:05:05.646809+0000","last_became_peered":"2024-04-18T21:05:05.646809+0000","last_unstale":"2024-04-18T21:05:06.635639+0000","last_undegraded":"2024-04-18T21:05:06.635639+0000","last_fullsized":"2024-04-18T21:05:06.635639+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:23.698827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637684+0000","last_change":"2024-04-18T21:05:04.634055+0000","last_active":"2024-04-18T21:05:06.637684+0000","last_peered":"2024-04-18T21:05:06.637684+0000","last_clean":"2024-04-18T21:05:06.637684+0000","last_became_active":"2024-04-18T21:05:04.630736+0000","last_became_peered":"2024-04-18T21:05:04.630736+0000","last_unstale":"2024-04-18T21:05:06.637684+0000","last_undegraded":"2024-04-18T21:05:06.637684+0000","last_fullsized":"2024-04-18T21:05:06.637684+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:06:44.001512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636585+0000","last_change":"2024-04-18T21:05:05.628869+0000","last_active":"2024-04-18T21:05:06.636585+0000","last_peered":"2024-04-18T21:05:06.636585+0000","last_clean":"2024-04-18T21:05:06.636585+0000","last_became_active":"2024-04-18T21:05:05.627071+0000","last_became_peered":"2024-04-18T21:05:05.627071+0000","last_unstale":"2024-04-18T21:05:06.636585+0000","last_undegraded":"2024-04-18T21:05:06.636585+0000","last_fullsized":"2024-04-18T21:05:06.636585+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:31:31.842528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.638123+0000","last_change":"2024-04-18T21:05:04.625520+0000","last_active":"2024-04-18T21:05:06.638123+0000","last_peered":"2024-04-18T21:05:06.638123+0000","last_clean":"2024-04-18T21:05:06.638123+0000","last_became_active":"2024-04-18T21:05:04.624656+0000","last_became_peered":"2024-04-18T21:05:04.624656+0000","last_unstale":"2024-04-18T21:05:06.638123+0000","last_undegraded":"2024-04-18T21:05:06.638123+0000","last_fullsized":"2024-04-18T21:05:06.638123+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:56:05.795125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358238+0000","last_change":"2024-04-18T21:05:05.649406+0000","last_active":"2024-04-18T21:05:07.358238+0000","last_peered":"2024-04-18T21:05:07.358238+0000","last_clean":"2024-04-18T21:05:07.358238+0000","last_became_active":"2024-04-18T21:05:05.648380+0000","last_became_peered":"2024-04-18T21:05:05.648380+0000","last_unstale":"2024-04-18T21:05:07.358238+0000","last_undegraded":"2024-04-18T21:05:07.358238+0000","last_fullsized":"2024-04-18T21:05:07.358238+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359521+0000","last_change":"2024-04-18T21:05:04.640216+0000","last_active":"2024-04-18T21:05:07.359521+0000","last_peered":"2024-04-18T21:05:07.359521+0000","last_clean":"2024-04-18T21:05:07.359521+0000","last_became_active":"2024-04-18T21:05:04.639349+0000","last_became_peered":"2024-04-18T21:05:04.639349+0000","last_unstale":"2024-04-18T21:05:07.359521+0000","last_undegraded":"2024-04-18T21:05:07.359521+0000","last_fullsized":"2024-04-18T21:05:07.359521+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:09:18.466987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637709+0000","last_change":"2024-04-18T21:05:05.628850+0000","last_active":"2024-04-18T21:05:06.637709+0000","last_peered":"2024-04-18T21:05:06.637709+0000","last_clean":"2024-04-18T21:05:06.637709+0000","last_became_active":"2024-04-18T21:05:05.627521+0000","last_became_peered":"2024-04-18T21:05:05.627521+0000","last_unstale":"2024-04-18T21:05:06.637709+0000","last_undegraded":"2024-04-18T21:05:06.637709+0000","last_fullsized":"2024-04-18T21:05:06.637709+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:14:37.912032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636946+0000","last_change":"2024-04-18T21:05:04.634674+0000","last_active":"2024-04-18T21:05:06.636946+0000","last_peered":"2024-04-18T21:05:06.636946+0000","last_clean":"2024-04-18T21:05:06.636946+0000","last_became_active":"2024-04-18T21:05:04.632284+0000","last_became_peered":"2024-04-18T21:05:04.632284+0000","last_unstale":"2024-04-18T21:05:06.636946+0000","last_undegraded":"2024-04-18T21:05:06.636946+0000","last_fullsized":"2024-04-18T21:05:06.636946+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:09:18.466987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637414+0000","last_change":"2024-04-18T21:05:05.647377+0000","last_active":"2024-04-18T21:05:06.637414+0000","last_peered":"2024-04-18T21:05:06.637414+0000","last_clean":"2024-04-18T21:05:06.637414+0000","last_became_active":"2024-04-18T21:05:05.645067+0000","last_became_peered":"2024-04-18T21:05:05.645067+0000","last_unstale":"2024-04-18T21:05:06.637414+0000","last_undegraded":"2024-04-18T21:05:06.637414+0000","last_fullsized":"2024-04-18T21:05:06.637414+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:29:30.243751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636012+0000","last_change":"2024-04-18T21:05:04.627578+0000","last_active":"2024-04-18T21:05:06.636012+0000","last_peered":"2024-04-18T21:05:06.636012+0000","last_clean":"2024-04-18T21:05:06.636012+0000","last_became_active":"2024-04-18T21:05:04.626786+0000","last_became_peered":"2024-04-18T21:05:04.626786+0000","last_unstale":"2024-04-18T21:05:06.636012+0000","last_undegraded":"2024-04-18T21:05:06.636012+0000","last_fullsized":"2024-04-18T21:05:06.636012+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:55:59.563512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637217+0000","last_change":"2024-04-18T21:05:05.640817+0000","last_active":"2024-04-18T21:05:06.637217+0000","last_peered":"2024-04-18T21:05:06.637217+0000","last_clean":"2024-04-18T21:05:06.637217+0000","last_became_active":"2024-04-18T21:05:05.635526+0000","last_became_peered":"2024-04-18T21:05:05.635526+0000","last_unstale":"2024-04-18T21:05:06.637217+0000","last_undegraded":"2024-04-18T21:05:06.637217+0000","last_fullsized":"2024-04-18T21:05:06.637217+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:44:29.823511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635339+0000","last_change":"2024-04-18T21:05:04.636499+0000","last_active":"2024-04-18T21:05:06.635339+0000","last_peered":"2024-04-18T21:05:06.635339+0000","last_clean":"2024-04-18T21:05:06.635339+0000","last_became_active":"2024-04-18T21:05:04.635830+0000","last_became_peered":"2024-04-18T21:05:04.635830+0000","last_unstale":"2024-04-18T21:05:06.635339+0000","last_undegraded":"2024-04-18T21:05:06.635339+0000","last_fullsized":"2024-04-18T21:05:06.635339+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:26:30.565175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359678+0000","last_change":"2024-04-18T21:05:05.660974+0000","last_active":"2024-04-18T21:05:07.359678+0000","last_peered":"2024-04-18T21:05:07.359678+0000","last_clean":"2024-04-18T21:05:07.359678+0000","last_became_active":"2024-04-18T21:05:05.659287+0000","last_became_peered":"2024-04-18T21:05:05.659287+0000","last_unstale":"2024-04-18T21:05:07.359678+0000","last_undegraded":"2024-04-18T21:05:07.359678+0000","last_fullsized":"2024-04-18T21:05:07.359678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:50:40.920146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":222,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636126+0000","last_change":"2024-04-18T21:04:54.511605+0000","last_active":"2024-04-18T21:05:06.636126+0000","last_peered":"2024-04-18T21:05:06.636126+0000","last_clean":"2024-04-18T21:05:06.636126+0000","last_became_active":"2024-04-18T21:04:54.510791+0000","last_became_peered":"2024-04-18T21:04:54.510791+0000","last_unstale":"2024-04-18T21:05:06.636126+0000","last_undegraded":"2024-04-18T21:05:06.636126+0000","last_fullsized":"2024-04-18T21:05:06.636126+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_clean_scrub_stamp":"2024-04-18T21:04:53.494814+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:46.262250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.638030+0000","last_change":"2024-04-18T21:05:00.576671+0000","last_active":"2024-04-18T21:05:06.638030+0000","last_peered":"2024-04-18T21:05:06.638030+0000","last_clean":"2024-04-18T21:05:06.638030+0000","last_became_active":"2024-04-18T21:05:00.575933+0000","last_became_peered":"2024-04-18T21:05:00.575933+0000","last_unstale":"2024-04-18T21:05:06.638030+0000","last_undegraded":"2024-04-18T21:05:06.638030+0000","last_fullsized":"2024-04-18T21:05:06.638030+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:14:59.207959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358678+0000","last_change":"2024-04-18T21:05:04.639528+0000","last_active":"2024-04-18T21:05:07.358678+0000","last_peered":"2024-04-18T21:05:07.358678+0000","last_clean":"2024-04-18T21:05:07.358678+0000","last_became_active":"2024-04-18T21:05:04.638517+0000","last_became_peered":"2024-04-18T21:05:04.638517+0000","last_unstale":"2024-04-18T21:05:07.358678+0000","last_undegraded":"2024-04-18T21:05:07.358678+0000","last_fullsized":"2024-04-18T21:05:07.358678+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:55:46.219812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637482+0000","last_change":"2024-04-18T21:05:05.647623+0000","last_active":"2024-04-18T21:05:06.637482+0000","last_peered":"2024-04-18T21:05:06.637482+0000","last_clean":"2024-04-18T21:05:06.637482+0000","last_became_active":"2024-04-18T21:05:05.645640+0000","last_became_peered":"2024-04-18T21:05:05.645640+0000","last_unstale":"2024-04-18T21:05:06.637482+0000","last_undegraded":"2024-04-18T21:05:06.637482+0000","last_fullsized":"2024-04-18T21:05:06.637482+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:59.950421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635615+0000","last_change":"2024-04-18T21:05:00.571960+0000","last_active":"2024-04-18T21:05:06.635615+0000","last_peered":"2024-04-18T21:05:06.635615+0000","last_clean":"2024-04-18T21:05:06.635615+0000","last_became_active":"2024-04-18T21:05:00.571301+0000","last_became_peered":"2024-04-18T21:05:00.571301+0000","last_unstale":"2024-04-18T21:05:06.635615+0000","last_undegraded":"2024-04-18T21:05:06.635615+0000","last_fullsized":"2024-04-18T21:05:06.635615+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:31:59.262440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358645+0000","last_change":"2024-04-18T21:05:04.638026+0000","last_active":"2024-04-18T21:05:07.358645+0000","last_peered":"2024-04-18T21:05:07.358645+0000","last_clean":"2024-04-18T21:05:07.358645+0000","last_became_active":"2024-04-18T21:05:04.637160+0000","last_became_peered":"2024-04-18T21:05:04.637160+0000","last_unstale":"2024-04-18T21:05:07.358645+0000","last_undegraded":"2024-04-18T21:05:07.358645+0000","last_fullsized":"2024-04-18T21:05:07.358645+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:33:48.703994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.638058+0000","last_change":"2024-04-18T21:05:05.654121+0000","last_active":"2024-04-18T21:05:06.638058+0000","last_peered":"2024-04-18T21:05:06.638058+0000","last_clean":"2024-04-18T21:05:06.638058+0000","last_became_active":"2024-04-18T21:05:05.651310+0000","last_became_peered":"2024-04-18T21:05:05.651310+0000","last_unstale":"2024-04-18T21:05:06.638058+0000","last_undegraded":"2024-04-18T21:05:06.638058+0000","last_fullsized":"2024-04-18T21:05:06.638058+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:01.841786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359064+0000","last_change":"2024-04-18T21:05:00.578604+0000","last_active":"2024-04-18T21:05:07.359064+0000","last_peered":"2024-04-18T21:05:07.359064+0000","last_clean":"2024-04-18T21:05:07.359064+0000","last_became_active":"2024-04-18T21:05:00.577988+0000","last_became_peered":"2024-04-18T21:05:00.577988+0000","last_unstale":"2024-04-18T21:05:07.359064+0000","last_undegraded":"2024-04-18T21:05:07.359064+0000","last_fullsized":"2024-04-18T21:05:07.359064+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:54:54.201759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635569+0000","last_change":"2024-04-18T21:05:04.627627+0000","last_active":"2024-04-18T21:05:06.635569+0000","last_peered":"2024-04-18T21:05:06.635569+0000","last_clean":"2024-04-18T21:05:06.635569+0000","last_became_active":"2024-04-18T21:05:04.626850+0000","last_became_peered":"2024-04-18T21:05:04.626850+0000","last_unstale":"2024-04-18T21:05:06.635569+0000","last_undegraded":"2024-04-18T21:05:06.635569+0000","last_fullsized":"2024-04-18T21:05:06.635569+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:43:31.453080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359914+0000","last_change":"2024-04-18T21:05:05.661488+0000","last_active":"2024-04-18T21:05:07.359914+0000","last_peered":"2024-04-18T21:05:07.359914+0000","last_clean":"2024-04-18T21:05:07.359914+0000","last_became_active":"2024-04-18T21:05:05.660283+0000","last_became_peered":"2024-04-18T21:05:05.660283+0000","last_unstale":"2024-04-18T21:05:07.359914+0000","last_undegraded":"2024-04-18T21:05:07.359914+0000","last_fullsized":"2024-04-18T21:05:07.359914+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:04.350492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637285+0000","last_change":"2024-04-18T21:05:00.576606+0000","last_active":"2024-04-18T21:05:06.637285+0000","last_peered":"2024-04-18T21:05:06.637285+0000","last_clean":"2024-04-18T21:05:06.637285+0000","last_became_active":"2024-04-18T21:05:00.575951+0000","last_became_peered":"2024-04-18T21:05:00.575951+0000","last_unstale":"2024-04-18T21:05:06.637285+0000","last_undegraded":"2024-04-18T21:05:06.637285+0000","last_fullsized":"2024-04-18T21:05:06.637285+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:32:17.612481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637939+0000","last_change":"2024-04-18T21:05:04.627296+0000","last_active":"2024-04-18T21:05:06.637939+0000","last_peered":"2024-04-18T21:05:06.637939+0000","last_clean":"2024-04-18T21:05:06.637939+0000","last_became_active":"2024-04-18T21:05:04.626801+0000","last_became_peered":"2024-04-18T21:05:04.626801+0000","last_unstale":"2024-04-18T21:05:06.637939+0000","last_undegraded":"2024-04-18T21:05:06.637939+0000","last_fullsized":"2024-04-18T21:05:06.637939+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:46:36.285416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359434+0000","last_change":"2024-04-18T21:05:05.655152+0000","last_active":"2024-04-18T21:05:07.359434+0000","last_peered":"2024-04-18T21:05:07.359434+0000","last_clean":"2024-04-18T21:05:07.359434+0000","last_became_active":"2024-04-18T21:05:05.654506+0000","last_became_peered":"2024-04-18T21:05:05.654506+0000","last_unstale":"2024-04-18T21:05:07.359434+0000","last_undegraded":"2024-04-18T21:05:07.359434+0000","last_fullsized":"2024-04-18T21:05:07.359434+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:32:23.929877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637718+0000","last_change":"2024-04-18T21:05:04.628916+0000","last_active":"2024-04-18T21:05:06.637718+0000","last_peered":"2024-04-18T21:05:06.637718+0000","last_clean":"2024-04-18T21:05:06.637718+0000","last_became_active":"2024-04-18T21:05:04.628245+0000","last_became_peered":"2024-04-18T21:05:04.628245+0000","last_unstale":"2024-04-18T21:05:06.637718+0000","last_undegraded":"2024-04-18T21:05:06.637718+0000","last_fullsized":"2024-04-18T21:05:06.637718+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:34:58.562540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359757+0000","last_change":"2024-04-18T21:05:00.578563+0000","last_active":"2024-04-18T21:05:07.359757+0000","last_peered":"2024-04-18T21:05:07.359757+0000","last_clean":"2024-04-18T21:05:07.359757+0000","last_became_active":"2024-04-18T21:05:00.577960+0000","last_became_peered":"2024-04-18T21:05:00.577960+0000","last_unstale":"2024-04-18T21:05:07.359757+0000","last_undegraded":"2024-04-18T21:05:07.359757+0000","last_fullsized":"2024-04-18T21:05:07.359757+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:31:59.262440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636313+0000","last_change":"2024-04-18T21:05:05.646076+0000","last_active":"2024-04-18T21:05:06.636313+0000","last_peered":"2024-04-18T21:05:06.636313+0000","last_clean":"2024-04-18T21:05:06.636313+0000","last_became_active":"2024-04-18T21:05:05.645104+0000","last_became_peered":"2024-04-18T21:05:05.645104+0000","last_unstale":"2024-04-18T21:05:06.636313+0000","last_undegraded":"2024-04-18T21:05:06.636313+0000","last_fullsized":"2024-04-18T21:05:06.636313+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:34:38.427319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359695+0000","last_change":"2024-04-18T21:05:04.639700+0000","last_active":"2024-04-18T21:05:07.359695+0000","last_peered":"2024-04-18T21:05:07.359695+0000","last_clean":"2024-04-18T21:05:07.359695+0000","last_became_active":"2024-04-18T21:05:04.638928+0000","last_became_peered":"2024-04-18T21:05:04.638928+0000","last_unstale":"2024-04-18T21:05:07.359695+0000","last_undegraded":"2024-04-18T21:05:07.359695+0000","last_fullsized":"2024-04-18T21:05:07.359695+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:00:08.877854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.638177+0000","last_change":"2024-04-18T21:05:00.576907+0000","last_active":"2024-04-18T21:05:06.638177+0000","last_peered":"2024-04-18T21:05:06.638177+0000","last_clean":"2024-04-18T21:05:06.638177+0000","last_became_active":"2024-04-18T21:05:00.576152+0000","last_became_peered":"2024-04-18T21:05:00.576152+0000","last_unstale":"2024-04-18T21:05:06.638177+0000","last_undegraded":"2024-04-18T21:05:06.638177+0000","last_fullsized":"2024-04-18T21:05:06.638177+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:25:07.270023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636117+0000","last_change":"2024-04-18T21:05:05.646026+0000","last_active":"2024-04-18T21:05:06.636117+0000","last_peered":"2024-04-18T21:05:06.636117+0000","last_clean":"2024-04-18T21:05:06.636117+0000","last_became_active":"2024-04-18T21:05:05.645192+0000","last_became_peered":"2024-04-18T21:05:05.645192+0000","last_unstale":"2024-04-18T21:05:06.636117+0000","last_undegraded":"2024-04-18T21:05:06.636117+0000","last_fullsized":"2024-04-18T21:05:06.636117+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:05:46.009381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.360443+0000","last_change":"2024-04-18T21:05:04.640732+0000","last_active":"2024-04-18T21:05:07.360443+0000","last_peered":"2024-04-18T21:05:07.360443+0000","last_clean":"2024-04-18T21:05:07.360443+0000","last_became_active":"2024-04-18T21:05:04.638505+0000","last_became_peered":"2024-04-18T21:05:04.638505+0000","last_unstale":"2024-04-18T21:05:07.360443+0000","last_undegraded":"2024-04-18T21:05:07.360443+0000","last_fullsized":"2024-04-18T21:05:07.360443+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:34:58.562540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.360549+0000","last_change":"2024-04-18T21:05:00.579869+0000","last_active":"2024-04-18T21:05:07.360549+0000","last_peered":"2024-04-18T21:05:07.360549+0000","last_clean":"2024-04-18T21:05:07.360549+0000","last_became_active":"2024-04-18T21:05:00.579351+0000","last_became_peered":"2024-04-18T21:05:00.579351+0000","last_unstale":"2024-04-18T21:05:07.360549+0000","last_undegraded":"2024-04-18T21:05:07.360549+0000","last_fullsized":"2024-04-18T21:05:07.360549+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:15:02.061128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.357811+0000","last_change":"2024-04-18T21:05:05.642730+0000","last_active":"2024-04-18T21:05:07.357811+0000","last_peered":"2024-04-18T21:05:07.357811+0000","last_clean":"2024-04-18T21:05:07.357811+0000","last_became_active":"2024-04-18T21:05:05.641890+0000","last_became_peered":"2024-04-18T21:05:05.641890+0000","last_unstale":"2024-04-18T21:05:07.357811+0000","last_undegraded":"2024-04-18T21:05:07.357811+0000","last_fullsized":"2024-04-18T21:05:07.357811+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:05:46.009381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.583432+0000","last_change":"2024-04-18T21:05:04.639898+0000","last_active":"2024-04-18T21:05:07.583432+0000","last_peered":"2024-04-18T21:05:07.583432+0000","last_clean":"2024-04-18T21:05:07.583432+0000","last_became_active":"2024-04-18T21:05:04.639115+0000","last_became_peered":"2024-04-18T21:05:04.639115+0000","last_unstale":"2024-04-18T21:05:07.583432+0000","last_undegraded":"2024-04-18T21:05:07.583432+0000","last_fullsized":"2024-04-18T21:05:07.583432+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:44:19.076499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637757+0000","last_change":"2024-04-18T21:05:00.572414+0000","last_active":"2024-04-18T21:05:06.637757+0000","last_peered":"2024-04-18T21:05:06.637757+0000","last_clean":"2024-04-18T21:05:06.637757+0000","last_became_active":"2024-04-18T21:05:00.571755+0000","last_became_peered":"2024-04-18T21:05:00.571755+0000","last_unstale":"2024-04-18T21:05:06.637757+0000","last_undegraded":"2024-04-18T21:05:06.637757+0000","last_fullsized":"2024-04-18T21:05:06.637757+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:15:02.061128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635489+0000","last_change":"2024-04-18T21:05:05.655898+0000","last_active":"2024-04-18T21:05:06.635489+0000","last_peered":"2024-04-18T21:05:06.635489+0000","last_clean":"2024-04-18T21:05:06.635489+0000","last_became_active":"2024-04-18T21:05:05.654111+0000","last_became_peered":"2024-04-18T21:05:05.654111+0000","last_unstale":"2024-04-18T21:05:06.635489+0000","last_undegraded":"2024-04-18T21:05:06.635489+0000","last_fullsized":"2024-04-18T21:05:06.635489+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:19:38.537080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637592+0000","last_change":"2024-04-18T21:05:05.641373+0000","last_active":"2024-04-18T21:05:06.637592+0000","last_peered":"2024-04-18T21:05:06.637592+0000","last_clean":"2024-04-18T21:05:06.637592+0000","last_became_active":"2024-04-18T21:05:05.634204+0000","last_became_peered":"2024-04-18T21:05:05.634204+0000","last_unstale":"2024-04-18T21:05:06.637592+0000","last_undegraded":"2024-04-18T21:05:06.637592+0000","last_fullsized":"2024-04-18T21:05:06.637592+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:27:35.995004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637977+0000","last_change":"2024-04-18T21:05:04.631271+0000","last_active":"2024-04-18T21:05:06.637977+0000","last_peered":"2024-04-18T21:05:06.637977+0000","last_clean":"2024-04-18T21:05:06.637977+0000","last_became_active":"2024-04-18T21:05:04.630442+0000","last_became_peered":"2024-04-18T21:05:04.630442+0000","last_unstale":"2024-04-18T21:05:06.637977+0000","last_undegraded":"2024-04-18T21:05:06.637977+0000","last_fullsized":"2024-04-18T21:05:06.637977+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:33:48.703994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358112+0000","last_change":"2024-04-18T21:05:05.637894+0000","last_active":"2024-04-18T21:05:07.358112+0000","last_peered":"2024-04-18T21:05:07.358112+0000","last_clean":"2024-04-18T21:05:07.358112+0000","last_became_active":"2024-04-18T21:05:05.636846+0000","last_became_peered":"2024-04-18T21:05:05.636846+0000","last_unstale":"2024-04-18T21:05:07.358112+0000","last_undegraded":"2024-04-18T21:05:07.358112+0000","last_fullsized":"2024-04-18T21:05:07.358112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:34:31.132458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637990+0000","last_change":"2024-04-18T21:05:04.631152+0000","last_active":"2024-04-18T21:05:06.637990+0000","last_peered":"2024-04-18T21:05:06.637990+0000","last_clean":"2024-04-18T21:05:06.637990+0000","last_became_active":"2024-04-18T21:05:04.628900+0000","last_became_peered":"2024-04-18T21:05:04.628900+0000","last_unstale":"2024-04-18T21:05:06.637990+0000","last_undegraded":"2024-04-18T21:05:06.637990+0000","last_fullsized":"2024-04-18T21:05:06.637990+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:40:21.452052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637452+0000","last_change":"2024-04-18T21:05:04.629470+0000","last_active":"2024-04-18T21:05:06.637452+0000","last_peered":"2024-04-18T21:05:06.637452+0000","last_clean":"2024-04-18T21:05:06.637452+0000","last_became_active":"2024-04-18T21:05:04.628286+0000","last_became_peered":"2024-04-18T21:05:04.628286+0000","last_unstale":"2024-04-18T21:05:06.637452+0000","last_undegraded":"2024-04-18T21:05:06.637452+0000","last_fullsized":"2024-04-18T21:05:06.637452+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:00:08.877854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358071+0000","last_change":"2024-04-18T21:05:05.642793+0000","last_active":"2024-04-18T21:05:07.358071+0000","last_peered":"2024-04-18T21:05:07.358071+0000","last_clean":"2024-04-18T21:05:07.358071+0000","last_became_active":"2024-04-18T21:05:05.641983+0000","last_became_peered":"2024-04-18T21:05:05.641983+0000","last_unstale":"2024-04-18T21:05:07.358071+0000","last_undegraded":"2024-04-18T21:05:07.358071+0000","last_fullsized":"2024-04-18T21:05:07.358071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:46:36.339289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.360264+0000","last_change":"2024-04-18T21:05:04.641445+0000","last_active":"2024-04-18T21:05:07.360264+0000","last_peered":"2024-04-18T21:05:07.360264+0000","last_clean":"2024-04-18T21:05:07.360264+0000","last_became_active":"2024-04-18T21:05:04.640682+0000","last_became_peered":"2024-04-18T21:05:04.640682+0000","last_unstale":"2024-04-18T21:05:07.360264+0000","last_undegraded":"2024-04-18T21:05:07.360264+0000","last_fullsized":"2024-04-18T21:05:07.360264+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:46:36.285416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.357743+0000","last_change":"2024-04-18T21:05:05.641561+0000","last_active":"2024-04-18T21:05:07.357743+0000","last_peered":"2024-04-18T21:05:07.357743+0000","last_clean":"2024-04-18T21:05:07.357743+0000","last_became_active":"2024-04-18T21:05:05.640922+0000","last_became_peered":"2024-04-18T21:05:05.640922+0000","last_unstale":"2024-04-18T21:05:07.357743+0000","last_undegraded":"2024-04-18T21:05:07.357743+0000","last_fullsized":"2024-04-18T21:05:07.357743+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:56.408234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637829+0000","last_change":"2024-04-18T21:05:05.651530+0000","last_active":"2024-04-18T21:05:06.637829+0000","last_peered":"2024-04-18T21:05:06.637829+0000","last_clean":"2024-04-18T21:05:06.637829+0000","last_became_active":"2024-04-18T21:05:05.648167+0000","last_became_peered":"2024-04-18T21:05:05.648167+0000","last_unstale":"2024-04-18T21:05:06.637829+0000","last_undegraded":"2024-04-18T21:05:06.637829+0000","last_fullsized":"2024-04-18T21:05:06.637829+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:14:51.873741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358019+0000","last_change":"2024-04-18T21:05:04.637369+0000","last_active":"2024-04-18T21:05:07.358019+0000","last_peered":"2024-04-18T21:05:07.358019+0000","last_clean":"2024-04-18T21:05:07.358019+0000","last_became_active":"2024-04-18T21:05:04.636468+0000","last_became_peered":"2024-04-18T21:05:04.636468+0000","last_unstale":"2024-04-18T21:05:07.358019+0000","last_undegraded":"2024-04-18T21:05:07.358019+0000","last_fullsized":"2024-04-18T21:05:07.358019+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:40:21.452052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.360014+0000","last_change":"2024-04-18T21:05:05.651245+0000","last_active":"2024-04-18T21:05:07.360014+0000","last_peered":"2024-04-18T21:05:07.360014+0000","last_clean":"2024-04-18T21:05:07.360014+0000","last_became_active":"2024-04-18T21:05:05.650463+0000","last_became_peered":"2024-04-18T21:05:05.650463+0000","last_unstale":"2024-04-18T21:05:07.360014+0000","last_undegraded":"2024-04-18T21:05:07.360014+0000","last_fullsized":"2024-04-18T21:05:07.360014+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:27:17.530889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358504+0000","last_change":"2024-04-18T21:05:04.637597+0000","last_active":"2024-04-18T21:05:07.358504+0000","last_peered":"2024-04-18T21:05:07.358504+0000","last_clean":"2024-04-18T21:05:07.358504+0000","last_became_active":"2024-04-18T21:05:04.636827+0000","last_became_peered":"2024-04-18T21:05:04.636827+0000","last_unstale":"2024-04-18T21:05:07.358504+0000","last_undegraded":"2024-04-18T21:05:07.358504+0000","last_fullsized":"2024-04-18T21:05:07.358504+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:43.511952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636925+0000","last_change":"2024-04-18T21:05:05.658971+0000","last_active":"2024-04-18T21:05:06.636925+0000","last_peered":"2024-04-18T21:05:06.636925+0000","last_clean":"2024-04-18T21:05:06.636925+0000","last_became_active":"2024-04-18T21:05:05.658363+0000","last_became_peered":"2024-04-18T21:05:05.658363+0000","last_unstale":"2024-04-18T21:05:06.636925+0000","last_undegraded":"2024-04-18T21:05:06.636925+0000","last_fullsized":"2024-04-18T21:05:06.636925+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:12.944469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636616+0000","last_change":"2024-04-18T21:05:04.636585+0000","last_active":"2024-04-18T21:05:06.636616+0000","last_peered":"2024-04-18T21:05:06.636616+0000","last_clean":"2024-04-18T21:05:06.636616+0000","last_became_active":"2024-04-18T21:05:04.635670+0000","last_became_peered":"2024-04-18T21:05:04.635670+0000","last_unstale":"2024-04-18T21:05:06.636616+0000","last_undegraded":"2024-04-18T21:05:06.636616+0000","last_fullsized":"2024-04-18T21:05:06.636616+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:34:33.779063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636955+0000","last_change":"2024-04-18T21:05:05.649960+0000","last_active":"2024-04-18T21:05:06.636955+0000","last_peered":"2024-04-18T21:05:06.636955+0000","last_clean":"2024-04-18T21:05:06.636955+0000","last_became_active":"2024-04-18T21:05:05.648528+0000","last_became_peered":"2024-04-18T21:05:05.648528+0000","last_unstale":"2024-04-18T21:05:06.636955+0000","last_undegraded":"2024-04-18T21:05:06.636955+0000","last_fullsized":"2024-04-18T21:05:06.636955+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:20:45.938503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636493+0000","last_change":"2024-04-18T21:05:04.630151+0000","last_active":"2024-04-18T21:05:06.636493+0000","last_peered":"2024-04-18T21:05:06.636493+0000","last_clean":"2024-04-18T21:05:06.636493+0000","last_became_active":"2024-04-18T21:05:04.627968+0000","last_became_peered":"2024-04-18T21:05:04.627968+0000","last_unstale":"2024-04-18T21:05:06.636493+0000","last_undegraded":"2024-04-18T21:05:06.636493+0000","last_fullsized":"2024-04-18T21:05:06.636493+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:00:33.393636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636522+0000","last_change":"2024-04-18T21:05:05.624840+0000","last_active":"2024-04-18T21:05:06.636522+0000","last_peered":"2024-04-18T21:05:06.636522+0000","last_clean":"2024-04-18T21:05:06.636522+0000","last_became_active":"2024-04-18T21:05:05.622950+0000","last_became_peered":"2024-04-18T21:05:05.622950+0000","last_unstale":"2024-04-18T21:05:06.636522+0000","last_undegraded":"2024-04-18T21:05:06.636522+0000","last_fullsized":"2024-04-18T21:05:06.636522+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:27:17.530889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637987+0000","last_change":"2024-04-18T21:05:04.626715+0000","last_active":"2024-04-18T21:05:06.637987+0000","last_peered":"2024-04-18T21:05:06.637987+0000","last_clean":"2024-04-18T21:05:06.637987+0000","last_became_active":"2024-04-18T21:05:04.625270+0000","last_became_peered":"2024-04-18T21:05:04.625270+0000","last_unstale":"2024-04-18T21:05:06.637987+0000","last_undegraded":"2024-04-18T21:05:06.637987+0000","last_fullsized":"2024-04-18T21:05:06.637987+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:43.511952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637167+0000","last_change":"2024-04-18T21:05:05.627962+0000","last_active":"2024-04-18T21:05:06.637167+0000","last_peered":"2024-04-18T21:05:06.637167+0000","last_clean":"2024-04-18T21:05:06.637167+0000","last_became_active":"2024-04-18T21:05:05.626698+0000","last_became_peered":"2024-04-18T21:05:05.626698+0000","last_unstale":"2024-04-18T21:05:06.637167+0000","last_undegraded":"2024-04-18T21:05:06.637167+0000","last_fullsized":"2024-04-18T21:05:06.637167+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:48:48.973087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637569+0000","last_change":"2024-04-18T21:05:04.632776+0000","last_active":"2024-04-18T21:05:06.637569+0000","last_peered":"2024-04-18T21:05:06.637569+0000","last_clean":"2024-04-18T21:05:06.637569+0000","last_became_active":"2024-04-18T21:05:04.630142+0000","last_became_peered":"2024-04-18T21:05:04.630142+0000","last_unstale":"2024-04-18T21:05:06.637569+0000","last_undegraded":"2024-04-18T21:05:06.637569+0000","last_fullsized":"2024-04-18T21:05:06.637569+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:19:36.721897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636797+0000","last_change":"2024-04-18T21:05:05.653025+0000","last_active":"2024-04-18T21:05:06.636797+0000","last_peered":"2024-04-18T21:05:06.636797+0000","last_clean":"2024-04-18T21:05:06.636797+0000","last_became_active":"2024-04-18T21:05:05.645039+0000","last_became_peered":"2024-04-18T21:05:05.645039+0000","last_unstale":"2024-04-18T21:05:06.636797+0000","last_undegraded":"2024-04-18T21:05:06.636797+0000","last_fullsized":"2024-04-18T21:05:06.636797+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.360315+0000","last_change":"2024-04-18T21:05:04.640134+0000","last_active":"2024-04-18T21:05:07.360315+0000","last_peered":"2024-04-18T21:05:07.360315+0000","last_clean":"2024-04-18T21:05:07.360315+0000","last_became_active":"2024-04-18T21:05:04.638597+0000","last_became_peered":"2024-04-18T21:05:04.638597+0000","last_unstale":"2024-04-18T21:05:07.360315+0000","last_undegraded":"2024-04-18T21:05:07.360315+0000","last_fullsized":"2024-04-18T21:05:07.360315+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:56:05.795125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635677+0000","last_change":"2024-04-18T21:05:05.629022+0000","last_active":"2024-04-18T21:05:06.635677+0000","last_peered":"2024-04-18T21:05:06.635677+0000","last_clean":"2024-04-18T21:05:06.635677+0000","last_became_active":"2024-04-18T21:05:05.627643+0000","last_became_peered":"2024-04-18T21:05:05.627643+0000","last_unstale":"2024-04-18T21:05:06.635677+0000","last_undegraded":"2024-04-18T21:05:06.635677+0000","last_fullsized":"2024-04-18T21:05:06.635677+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:32:23.929877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359950+0000","last_change":"2024-04-18T21:05:04.641338+0000","last_active":"2024-04-18T21:05:07.359950+0000","last_peered":"2024-04-18T21:05:07.359950+0000","last_clean":"2024-04-18T21:05:07.359950+0000","last_became_active":"2024-04-18T21:05:04.639958+0000","last_became_peered":"2024-04-18T21:05:04.639958+0000","last_unstale":"2024-04-18T21:05:07.359950+0000","last_undegraded":"2024-04-18T21:05:07.359950+0000","last_fullsized":"2024-04-18T21:05:07.359950+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:42:45.392908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738375,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31340,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340500,"statfs":{"total":96636764160,"available":96604672000,"internally_reserved":0,"allocated":163840,"data_stored":55728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31940,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339900,"statfs":{"total":96636764160,"available":96604057600,"internally_reserved":0,"allocated":774144,"data_stored":647274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":782336,"data_stored":647890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:05:12.484 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-18T21:05:12.484 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-18T21:05:12.484 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-18T21:05:12.484 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-18T21:05:12.824 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:05:12.825 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-18T21:05:12.841 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-18T21:05:12.842 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T21:05:13.129 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:05:13.129 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":18,"fsid":"dc017990-0393-4ab0-b604-5e7052fdc7bd","created":"2024-04-18T21:04:43.507538+0000","modified":"2024-04-18T21:05:06.615695+0000","last_up_change":"2024-04-18T21:04:52.492503+0000","last_in_change":"2024-04-18T21:04:44.402191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T21:04:52.538153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T21:04:58.673793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T21:05:03.314171+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T21:05:03.931699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1854d737-3a67-416a-8c88-0f126505a0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6801","nonce":1948809768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6803","nonce":1948809768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6807","nonce":1948809768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6805","nonce":1948809768}]},"public_addr":"172.21.15.132:6801/1948809768","cluster_addr":"172.21.15.132:6803/1948809768","heartbeat_back_addr":"172.21.15.132:6807/1948809768","heartbeat_front_addr":"172.21.15.132:6805/1948809768","state":["exists","up"]},{"osd":1,"uuid":"dfeae661-3f8a-4d41-b287-7eb02c16b91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":2040503167},{"type":"v1","addr":"172.21.15.150:6801","nonce":2040503167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":2040503167},{"type":"v1","addr":"172.21.15.150:6803","nonce":2040503167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":2040503167},{"type":"v1","addr":"172.21.15.150:6807","nonce":2040503167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":2040503167},{"type":"v1","addr":"172.21.15.150:6805","nonce":2040503167}]},"public_addr":"172.21.15.150:6801/2040503167","cluster_addr":"172.21.15.150:6803/2040503167","heartbeat_back_addr":"172.21.15.150:6807/2040503167","heartbeat_front_addr":"172.21.15.150:6805/2040503167","state":["exists","up"]},{"osd":2,"uuid":"56a34021-e2dc-41ff-822c-7ec123466f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6801","nonce":429896900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6803","nonce":429896900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6807","nonce":429896900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6805","nonce":429896900}]},"public_addr":"172.21.15.187:6801/429896900","cluster_addr":"172.21.15.187:6803/429896900","heartbeat_back_addr":"172.21.15.187:6807/429896900","heartbeat_front_addr":"172.21.15.187:6805/429896900","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:49.804359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:49.790978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:49.762943+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T21:05:13.146 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T21:04:52.538153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-18T21:04:58.673793+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T21:05:03.314171+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T21:05:03.931699+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-18T21:05:13.146 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T21:05:13.417 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2024-04-18T21:05:13.434 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-18T21:05:13.716 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2024-04-18T21:05:13.733 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-18T21:05:14.011 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2024-04-18T21:05:14.028 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-18T21:05:14.297 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2024-04-18T21:05:14.314 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T21:05:14.637 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:05:14.637 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T21:05:04.973678+0000","modified":"2024-04-18T21:05:06.980882+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4202},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4202":{"gid":4202,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6803/1197504751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1197504751},{"type":"v1","addr":"172.21.15.78:6803","nonce":1197504751}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4202,"qdb_cluster":[4202]},"id":1}]} 2024-04-18T21:05:14.637 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 5 2024-04-18T21:05:14.655 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T21:05:14.933 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:05:14.933 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":18,"fsid":"dc017990-0393-4ab0-b604-5e7052fdc7bd","created":"2024-04-18T21:04:43.507538+0000","modified":"2024-04-18T21:05:06.615695+0000","last_up_change":"2024-04-18T21:04:52.492503+0000","last_in_change":"2024-04-18T21:04:44.402191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T21:04:52.538153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T21:04:58.673793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T21:05:03.314171+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T21:05:03.931699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1854d737-3a67-416a-8c88-0f126505a0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6801","nonce":1948809768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6803","nonce":1948809768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6807","nonce":1948809768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6805","nonce":1948809768}]},"public_addr":"172.21.15.132:6801/1948809768","cluster_addr":"172.21.15.132:6803/1948809768","heartbeat_back_addr":"172.21.15.132:6807/1948809768","heartbeat_front_addr":"172.21.15.132:6805/1948809768","state":["exists","up"]},{"osd":1,"uuid":"dfeae661-3f8a-4d41-b287-7eb02c16b91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":2040503167},{"type":"v1","addr":"172.21.15.150:6801","nonce":2040503167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":2040503167},{"type":"v1","addr":"172.21.15.150:6803","nonce":2040503167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":2040503167},{"type":"v1","addr":"172.21.15.150:6807","nonce":2040503167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":2040503167},{"type":"v1","addr":"172.21.15.150:6805","nonce":2040503167}]},"public_addr":"172.21.15.150:6801/2040503167","cluster_addr":"172.21.15.150:6803/2040503167","heartbeat_back_addr":"172.21.15.150:6807/2040503167","heartbeat_front_addr":"172.21.15.150:6805/2040503167","state":["exists","up"]},{"osd":2,"uuid":"56a34021-e2dc-41ff-822c-7ec123466f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6801","nonce":429896900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6803","nonce":429896900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6807","nonce":429896900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6805","nonce":429896900}]},"public_addr":"172.21.15.187:6801/429896900","cluster_addr":"172.21.15.187:6803/429896900","heartbeat_back_addr":"172.21.15.187:6807/429896900","heartbeat_front_addr":"172.21.15.187:6805/429896900","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:49.804359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:49.790978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:49.762943+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T21:05:14.950 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T21:04:52.538153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-18T21:04:58.673793+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T21:05:03.314171+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T21:05:03.931699+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-18T21:05:14.951 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T21:05:15.231 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2024-04-18T21:05:15.248 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-18T21:05:15.520 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2024-04-18T21:05:15.538 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-18T21:05:15.833 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2024-04-18T21:05:15.851 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-18T21:05:16.134 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2024-04-18T21:05:16.152 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T21:05:16.448 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:05:16.448 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T21:05:04.973678+0000","modified":"2024-04-18T21:05:06.980882+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4202},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4202":{"gid":4202,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6803/1197504751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1197504751},{"type":"v1","addr":"172.21.15.78:6803","nonce":1197504751}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4202,"qdb_cluster":[4202]},"id":1}]} 2024-04-18T21:05:16.448 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 5 2024-04-18T21:05:16.465 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T21:05:16.745 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:05:16.745 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":18,"fsid":"dc017990-0393-4ab0-b604-5e7052fdc7bd","created":"2024-04-18T21:04:43.507538+0000","modified":"2024-04-18T21:05:06.615695+0000","last_up_change":"2024-04-18T21:04:52.492503+0000","last_in_change":"2024-04-18T21:04:44.402191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T21:04:52.538153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T21:04:58.673793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T21:05:03.314171+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T21:05:03.931699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1854d737-3a67-416a-8c88-0f126505a0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6801","nonce":1948809768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6803","nonce":1948809768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6807","nonce":1948809768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6805","nonce":1948809768}]},"public_addr":"172.21.15.132:6801/1948809768","cluster_addr":"172.21.15.132:6803/1948809768","heartbeat_back_addr":"172.21.15.132:6807/1948809768","heartbeat_front_addr":"172.21.15.132:6805/1948809768","state":["exists","up"]},{"osd":1,"uuid":"dfeae661-3f8a-4d41-b287-7eb02c16b91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":2040503167},{"type":"v1","addr":"172.21.15.150:6801","nonce":2040503167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":2040503167},{"type":"v1","addr":"172.21.15.150:6803","nonce":2040503167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":2040503167},{"type":"v1","addr":"172.21.15.150:6807","nonce":2040503167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":2040503167},{"type":"v1","addr":"172.21.15.150:6805","nonce":2040503167}]},"public_addr":"172.21.15.150:6801/2040503167","cluster_addr":"172.21.15.150:6803/2040503167","heartbeat_back_addr":"172.21.15.150:6807/2040503167","heartbeat_front_addr":"172.21.15.150:6805/2040503167","state":["exists","up"]},{"osd":2,"uuid":"56a34021-e2dc-41ff-822c-7ec123466f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6801","nonce":429896900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6803","nonce":429896900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6807","nonce":429896900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6805","nonce":429896900}]},"public_addr":"172.21.15.187:6801/429896900","cluster_addr":"172.21.15.187:6803/429896900","heartbeat_back_addr":"172.21.15.187:6807/429896900","heartbeat_front_addr":"172.21.15.187:6805/429896900","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:49.804359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:49.790978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:49.762943+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T21:05:16.763 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T21:05:17.058 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:05:17.058 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T21:05:04.973678+0000","modified":"2024-04-18T21:05:06.980882+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4202},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4202":{"gid":4202,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6803/1197504751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1197504751},{"type":"v1","addr":"172.21.15.78:6803","nonce":1197504751}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4202,"qdb_cluster":[4202]},"id":1}]} 2024-04-18T21:05:17.058 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 5 2024-04-18T21:05:17.176 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-18T21:05:04.973678+0000', 'modified': '2024-04-18T21:05:06.980882+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4202}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4202': {'gid': 4202, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.78:6803/1197504751', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6802', 'nonce': 1197504751}, {'type': 'v1', 'addr': '172.21.15.78:6803', 'nonce': 1197504751}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4202, 'qdb_cluster': [4202]} 2024-04-18T21:05:17.176 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-18T21:05:17.176 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-18T21:05:17.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-18T21:05:17.312+0000 7f2f5bfff640 0 client.4617 ms_handle_reset on v2:172.21.15.78:6802/1197504751 2024-04-18T21:05:17.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-18T21:05:17.332+0000 7f2f5bfff640 0 client.4451 ms_handle_reset on v2:172.21.15.78:6802/1197504751 2024-04-18T21:05:17.330 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-04-18T21:05:17.330 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "dc017990-0393-4ab0-b604-5e7052fdc7bd", 2024-04-18T21:05:17.330 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2024-04-18T21:05:17.330 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 4202, 2024-04-18T21:05:17.330 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2024-04-18T21:05:17.330 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2024-04-18T21:05:17.330 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2024-04-18T21:05:17.330 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 11.725238559999999, 2024-04-18T21:05:17.330 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 5, 2024-04-18T21:05:17.330 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 18, 2024-04-18T21:05:17.331 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 18, 2024-04-18T21:05:17.331 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 16.581456624000001 2024-04-18T21:05:17.331 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-04-18T21:05:17.345 INFO:teuthology.run_tasks:Running task thrashosds... 2024-04-18T21:05:17.355 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-04-18T21:05:17.355 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': '5be49cd9e6fca1ff6a05f2473aa3b399da760600'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '5be49cd9e6fca1ff6a05f2473aa3b399da760600'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': 'c46a99d99fa3e2dad10a5ce96141fec909e651df'}} 2024-04-18T21:05:17.355 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-04-18T21:05:17.355 INFO:tasks.thrashosds:Doing preliminary sync to avoid collateral damage... 2024-04-18T21:05:17.355 DEBUG:teuthology.orchestra.run.smithi078:> sync 2024-04-18T21:05:17.655 DEBUG:teuthology.orchestra.run.smithi132:> sync 2024-04-18T21:05:17.871 DEBUG:teuthology.orchestra.run.smithi150:> sync 2024-04-18T21:05:18.115 DEBUG:teuthology.orchestra.run.smithi187:> sync 2024-04-18T21:05:18.286 DEBUG:tasks.thrashosds:checking console status of smithi078 2024-04-18T21:05:18.287 DEBUG:teuthology.orchestra.console.smithi078:Waiting for login prompt 2024-04-18T21:05:18.287 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi078 2024-04-18T21:05:18.380 DEBUG:teuthology.orchestra.console.smithi078:expect before: [Enter `^Ec?' for help] 2024-04-18T21:05:18.380 DEBUG:teuthology.orchestra.console.smithi078:expect after: smithi078 login: 2024-04-18T21:05:18.432 DEBUG:teuthology.orchestra.console.smithi078:console disconnect output: [Enter `^Ec?' for help] smithi078 login: [disconnect] 2024-04-18T21:05:18.533 DEBUG:tasks.thrashosds:checking console status of smithi132 2024-04-18T21:05:18.533 DEBUG:teuthology.orchestra.console.smithi132:Waiting for login prompt 2024-04-18T21:05:18.533 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi132 2024-04-18T21:05:18.639 DEBUG:teuthology.orchestra.console.smithi132:expect before: [Enter `^Ec?' for help] 2024-04-18T21:05:18.639 DEBUG:teuthology.orchestra.console.smithi132:expect after: smithi132 login: 2024-04-18T21:05:18.692 DEBUG:teuthology.orchestra.console.smithi132:console disconnect output: [Enter `^Ec?' for help] smithi132 login: [disconnect] 2024-04-18T21:05:18.793 DEBUG:tasks.thrashosds:checking console status of smithi150 2024-04-18T21:05:18.793 DEBUG:teuthology.orchestra.console.smithi150:Waiting for login prompt 2024-04-18T21:05:18.793 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi150 2024-04-18T21:05:18.937 DEBUG:teuthology.orchestra.console.smithi150:expect before: [Enter `^Ec?' for help] 2024-04-18T21:05:18.938 DEBUG:teuthology.orchestra.console.smithi150:expect after: smithi150 login: 2024-04-18T21:05:18.990 DEBUG:teuthology.orchestra.console.smithi150:console disconnect output: [Enter `^Ec?' for help] smithi150 login: [disconnect] 2024-04-18T21:05:19.090 DEBUG:tasks.thrashosds:checking console status of smithi187 2024-04-18T21:05:19.090 DEBUG:teuthology.orchestra.console.smithi187:Waiting for login prompt 2024-04-18T21:05:19.090 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi187 2024-04-18T21:05:19.259 DEBUG:teuthology.orchestra.console.smithi187:expect before: [Enter `^Ec?' for help] 2024-04-18T21:05:19.260 DEBUG:teuthology.orchestra.console.smithi187:expect after: smithi187 login: 2024-04-18T21:05:19.313 DEBUG:teuthology.orchestra.console.smithi187:console disconnect output: [Enter `^Ec?' for help] smithi187 login: [disconnect] 2024-04-18T21:05:19.414 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-04-18T21:05:19.753 INFO:tasks.thrashosds:Beginning thrashosds... 2024-04-18T21:05:19.754 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-18T21:05:19.754 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:05:20.062 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:05:20.064 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-04-18T21:05:20.078 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-04-18T21:05:18.505888+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91068,"kb_used_data":1680,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024452,"statfs":{"total":289910292480,"available":289817038848,"internally_reserved":0,"allocated":1720320,"data_stored":1350892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.873284"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637590+0000","last_change":"2024-04-18T21:05:05.652795+0000","last_active":"2024-04-18T21:05:06.637590+0000","last_peered":"2024-04-18T21:05:06.637590+0000","last_clean":"2024-04-18T21:05:06.637590+0000","last_became_active":"2024-04-18T21:05:05.650121+0000","last_became_peered":"2024-04-18T21:05:05.650121+0000","last_unstale":"2024-04-18T21:05:06.637590+0000","last_undegraded":"2024-04-18T21:05:06.637590+0000","last_fullsized":"2024-04-18T21:05:06.637590+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637298+0000","last_change":"2024-04-18T21:05:05.657531+0000","last_active":"2024-04-18T21:05:06.637298+0000","last_peered":"2024-04-18T21:05:06.637298+0000","last_clean":"2024-04-18T21:05:06.637298+0000","last_became_active":"2024-04-18T21:05:05.653101+0000","last_became_peered":"2024-04-18T21:05:05.653101+0000","last_unstale":"2024-04-18T21:05:06.637298+0000","last_undegraded":"2024-04-18T21:05:06.637298+0000","last_fullsized":"2024-04-18T21:05:06.637298+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:32:23.929877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636411+0000","last_change":"2024-04-18T21:05:05.647965+0000","last_active":"2024-04-18T21:05:06.636411+0000","last_peered":"2024-04-18T21:05:06.636411+0000","last_clean":"2024-04-18T21:05:06.636411+0000","last_became_active":"2024-04-18T21:05:05.645931+0000","last_became_peered":"2024-04-18T21:05:05.645931+0000","last_unstale":"2024-04-18T21:05:06.636411+0000","last_undegraded":"2024-04-18T21:05:06.636411+0000","last_fullsized":"2024-04-18T21:05:06.636411+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:04.350492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637673+0000","last_change":"2024-04-18T21:05:05.629321+0000","last_active":"2024-04-18T21:05:06.637673+0000","last_peered":"2024-04-18T21:05:06.637673+0000","last_clean":"2024-04-18T21:05:06.637673+0000","last_became_active":"2024-04-18T21:05:05.627956+0000","last_became_peered":"2024-04-18T21:05:05.627956+0000","last_unstale":"2024-04-18T21:05:06.637673+0000","last_undegraded":"2024-04-18T21:05:06.637673+0000","last_fullsized":"2024-04-18T21:05:06.637673+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:15:28.458476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636510+0000","last_change":"2024-04-18T21:05:05.648710+0000","last_active":"2024-04-18T21:05:06.636510+0000","last_peered":"2024-04-18T21:05:06.636510+0000","last_clean":"2024-04-18T21:05:06.636510+0000","last_became_active":"2024-04-18T21:05:05.647801+0000","last_became_peered":"2024-04-18T21:05:05.647801+0000","last_unstale":"2024-04-18T21:05:06.636510+0000","last_undegraded":"2024-04-18T21:05:06.636510+0000","last_fullsized":"2024-04-18T21:05:06.636510+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:46:36.339289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635784+0000","last_change":"2024-04-18T21:05:05.629095+0000","last_active":"2024-04-18T21:05:06.635784+0000","last_peered":"2024-04-18T21:05:06.635784+0000","last_clean":"2024-04-18T21:05:06.635784+0000","last_became_active":"2024-04-18T21:05:05.627664+0000","last_became_peered":"2024-04-18T21:05:05.627664+0000","last_unstale":"2024-04-18T21:05:06.635784+0000","last_undegraded":"2024-04-18T21:05:06.635784+0000","last_fullsized":"2024-04-18T21:05:06.635784+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:51:28.440070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635525+0000","last_change":"2024-04-18T21:05:05.625047+0000","last_active":"2024-04-18T21:05:06.635525+0000","last_peered":"2024-04-18T21:05:06.635525+0000","last_clean":"2024-04-18T21:05:06.635525+0000","last_became_active":"2024-04-18T21:05:05.622781+0000","last_became_peered":"2024-04-18T21:05:05.622781+0000","last_unstale":"2024-04-18T21:05:06.635525+0000","last_undegraded":"2024-04-18T21:05:06.635525+0000","last_fullsized":"2024-04-18T21:05:06.635525+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:12.944469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.634795+0000","last_change":"2024-04-18T21:05:05.640390+0000","last_active":"2024-04-18T21:05:06.634795+0000","last_peered":"2024-04-18T21:05:06.634795+0000","last_clean":"2024-04-18T21:05:06.634795+0000","last_became_active":"2024-04-18T21:05:05.638295+0000","last_became_peered":"2024-04-18T21:05:05.638295+0000","last_unstale":"2024-04-18T21:05:06.634795+0000","last_undegraded":"2024-04-18T21:05:06.634795+0000","last_fullsized":"2024-04-18T21:05:06.634795+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:34:31.132458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359217+0000","last_change":"2024-04-18T21:05:05.660752+0000","last_active":"2024-04-18T21:05:07.359217+0000","last_peered":"2024-04-18T21:05:07.359217+0000","last_clean":"2024-04-18T21:05:07.359217+0000","last_became_active":"2024-04-18T21:05:05.659226+0000","last_became_peered":"2024-04-18T21:05:05.659226+0000","last_unstale":"2024-04-18T21:05:07.359217+0000","last_undegraded":"2024-04-18T21:05:07.359217+0000","last_fullsized":"2024-04-18T21:05:07.359217+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:20:45.938503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637371+0000","last_change":"2024-04-18T21:05:05.656660+0000","last_active":"2024-04-18T21:05:06.637371+0000","last_peered":"2024-04-18T21:05:06.637371+0000","last_clean":"2024-04-18T21:05:06.637371+0000","last_became_active":"2024-04-18T21:05:05.653829+0000","last_became_peered":"2024-04-18T21:05:05.653829+0000","last_unstale":"2024-04-18T21:05:06.637371+0000","last_undegraded":"2024-04-18T21:05:06.637371+0000","last_fullsized":"2024-04-18T21:05:06.637371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:50:40.920146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636818+0000","last_change":"2024-04-18T21:05:05.646721+0000","last_active":"2024-04-18T21:05:06.636818+0000","last_peered":"2024-04-18T21:05:06.636818+0000","last_clean":"2024-04-18T21:05:06.636818+0000","last_became_active":"2024-04-18T21:05:05.643421+0000","last_became_peered":"2024-04-18T21:05:05.643421+0000","last_unstale":"2024-04-18T21:05:06.636818+0000","last_undegraded":"2024-04-18T21:05:06.636818+0000","last_fullsized":"2024-04-18T21:05:06.636818+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:14:51.873741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636882+0000","last_change":"2024-04-18T21:05:05.656320+0000","last_active":"2024-04-18T21:05:06.636882+0000","last_peered":"2024-04-18T21:05:06.636882+0000","last_clean":"2024-04-18T21:05:06.636882+0000","last_became_active":"2024-04-18T21:05:05.655508+0000","last_became_peered":"2024-04-18T21:05:05.655508+0000","last_unstale":"2024-04-18T21:05:06.636882+0000","last_undegraded":"2024-04-18T21:05:06.636882+0000","last_fullsized":"2024-04-18T21:05:06.636882+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:51.225379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636068+0000","last_change":"2024-04-18T21:05:05.649001+0000","last_active":"2024-04-18T21:05:06.636068+0000","last_peered":"2024-04-18T21:05:06.636068+0000","last_clean":"2024-04-18T21:05:06.636068+0000","last_became_active":"2024-04-18T21:05:05.648070+0000","last_became_peered":"2024-04-18T21:05:05.648070+0000","last_unstale":"2024-04-18T21:05:06.636068+0000","last_undegraded":"2024-04-18T21:05:06.636068+0000","last_fullsized":"2024-04-18T21:05:06.636068+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:56.408234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636128+0000","last_change":"2024-04-18T21:05:05.635880+0000","last_active":"2024-04-18T21:05:06.636128+0000","last_peered":"2024-04-18T21:05:06.636128+0000","last_clean":"2024-04-18T21:05:06.636128+0000","last_became_active":"2024-04-18T21:05:05.635089+0000","last_became_peered":"2024-04-18T21:05:05.635089+0000","last_unstale":"2024-04-18T21:05:06.636128+0000","last_undegraded":"2024-04-18T21:05:06.636128+0000","last_fullsized":"2024-04-18T21:05:06.636128+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:50:40.920146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635604+0000","last_change":"2024-04-18T21:05:05.639640+0000","last_active":"2024-04-18T21:05:06.635604+0000","last_peered":"2024-04-18T21:05:06.635604+0000","last_clean":"2024-04-18T21:05:06.635604+0000","last_became_active":"2024-04-18T21:05:05.637311+0000","last_became_peered":"2024-04-18T21:05:05.637311+0000","last_unstale":"2024-04-18T21:05:06.635604+0000","last_undegraded":"2024-04-18T21:05:06.635604+0000","last_fullsized":"2024-04-18T21:05:06.635604+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:20:45.938503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.634796+0000","last_change":"2024-04-18T21:05:05.638203+0000","last_active":"2024-04-18T21:05:06.634796+0000","last_peered":"2024-04-18T21:05:06.634796+0000","last_clean":"2024-04-18T21:05:06.634796+0000","last_became_active":"2024-04-18T21:05:05.637352+0000","last_became_peered":"2024-04-18T21:05:05.637352+0000","last_unstale":"2024-04-18T21:05:06.634796+0000","last_undegraded":"2024-04-18T21:05:06.634796+0000","last_fullsized":"2024-04-18T21:05:06.634796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.360278+0000","last_change":"2024-04-18T21:05:05.661613+0000","last_active":"2024-04-18T21:05:07.360278+0000","last_peered":"2024-04-18T21:05:07.360278+0000","last_clean":"2024-04-18T21:05:07.360278+0000","last_became_active":"2024-04-18T21:05:05.660496+0000","last_became_peered":"2024-04-18T21:05:05.660496+0000","last_unstale":"2024-04-18T21:05:07.360278+0000","last_undegraded":"2024-04-18T21:05:07.360278+0000","last_fullsized":"2024-04-18T21:05:07.360278+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:31:31.842528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637954+0000","last_change":"2024-04-18T21:05:05.655261+0000","last_active":"2024-04-18T21:05:06.637954+0000","last_peered":"2024-04-18T21:05:06.637954+0000","last_clean":"2024-04-18T21:05:06.637954+0000","last_became_active":"2024-04-18T21:05:05.651388+0000","last_became_peered":"2024-04-18T21:05:05.651388+0000","last_unstale":"2024-04-18T21:05:06.637954+0000","last_undegraded":"2024-04-18T21:05:06.637954+0000","last_fullsized":"2024-04-18T21:05:06.637954+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:53.850184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359241+0000","last_change":"2024-04-18T21:05:05.652710+0000","last_active":"2024-04-18T21:05:07.359241+0000","last_peered":"2024-04-18T21:05:07.359241+0000","last_clean":"2024-04-18T21:05:07.359241+0000","last_became_active":"2024-04-18T21:05:05.651929+0000","last_became_peered":"2024-04-18T21:05:05.651929+0000","last_unstale":"2024-04-18T21:05:07.359241+0000","last_undegraded":"2024-04-18T21:05:07.359241+0000","last_fullsized":"2024-04-18T21:05:07.359241+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:12.944469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636438+0000","last_change":"2024-04-18T21:05:05.638338+0000","last_active":"2024-04-18T21:05:06.636438+0000","last_peered":"2024-04-18T21:05:06.636438+0000","last_clean":"2024-04-18T21:05:06.636438+0000","last_became_active":"2024-04-18T21:05:05.637567+0000","last_became_peered":"2024-04-18T21:05:05.637567+0000","last_unstale":"2024-04-18T21:05:06.636438+0000","last_undegraded":"2024-04-18T21:05:06.636438+0000","last_fullsized":"2024-04-18T21:05:06.636438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637117+0000","last_change":"2024-04-18T21:05:05.643606+0000","last_active":"2024-04-18T21:05:06.637117+0000","last_peered":"2024-04-18T21:05:06.637117+0000","last_clean":"2024-04-18T21:05:06.637117+0000","last_became_active":"2024-04-18T21:05:05.642991+0000","last_became_peered":"2024-04-18T21:05:05.642991+0000","last_unstale":"2024-04-18T21:05:06.637117+0000","last_undegraded":"2024-04-18T21:05:06.637117+0000","last_fullsized":"2024-04-18T21:05:06.637117+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:01.841786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636035+0000","last_change":"2024-04-18T21:05:05.650896+0000","last_active":"2024-04-18T21:05:06.636035+0000","last_peered":"2024-04-18T21:05:06.636035+0000","last_clean":"2024-04-18T21:05:06.636035+0000","last_became_active":"2024-04-18T21:05:05.650083+0000","last_became_peered":"2024-04-18T21:05:05.650083+0000","last_unstale":"2024-04-18T21:05:06.636035+0000","last_undegraded":"2024-04-18T21:05:06.636035+0000","last_fullsized":"2024-04-18T21:05:06.636035+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:43:55.788425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.357454+0000","last_change":"2024-04-18T21:05:05.640362+0000","last_active":"2024-04-18T21:05:07.357454+0000","last_peered":"2024-04-18T21:05:07.357454+0000","last_clean":"2024-04-18T21:05:07.357454+0000","last_became_active":"2024-04-18T21:05:05.635643+0000","last_became_peered":"2024-04-18T21:05:05.635643+0000","last_unstale":"2024-04-18T21:05:07.357454+0000","last_undegraded":"2024-04-18T21:05:07.357454+0000","last_fullsized":"2024-04-18T21:05:07.357454+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:43:55.788425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635029+0000","last_change":"2024-04-18T21:05:05.642755+0000","last_active":"2024-04-18T21:05:06.635029+0000","last_peered":"2024-04-18T21:05:06.635029+0000","last_clean":"2024-04-18T21:05:06.635029+0000","last_became_active":"2024-04-18T21:05:05.642150+0000","last_became_peered":"2024-04-18T21:05:05.642150+0000","last_unstale":"2024-04-18T21:05:06.635029+0000","last_undegraded":"2024-04-18T21:05:06.635029+0000","last_fullsized":"2024-04-18T21:05:06.635029+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:29:22.647425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637381+0000","last_change":"2024-04-18T21:05:05.653741+0000","last_active":"2024-04-18T21:05:06.637381+0000","last_peered":"2024-04-18T21:05:06.637381+0000","last_clean":"2024-04-18T21:05:06.637381+0000","last_became_active":"2024-04-18T21:05:05.650174+0000","last_became_peered":"2024-04-18T21:05:05.650174+0000","last_unstale":"2024-04-18T21:05:06.637381+0000","last_undegraded":"2024-04-18T21:05:06.637381+0000","last_fullsized":"2024-04-18T21:05:06.637381+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:04.350492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.360000+0000","last_change":"2024-04-18T21:05:05.649581+0000","last_active":"2024-04-18T21:05:07.360000+0000","last_peered":"2024-04-18T21:05:07.360000+0000","last_clean":"2024-04-18T21:05:07.360000+0000","last_became_active":"2024-04-18T21:05:05.648233+0000","last_became_peered":"2024-04-18T21:05:05.648233+0000","last_unstale":"2024-04-18T21:05:07.360000+0000","last_undegraded":"2024-04-18T21:05:07.360000+0000","last_fullsized":"2024-04-18T21:05:07.360000+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637099+0000","last_change":"2024-04-18T21:05:05.646926+0000","last_active":"2024-04-18T21:05:06.637099+0000","last_peered":"2024-04-18T21:05:06.637099+0000","last_clean":"2024-04-18T21:05:06.637099+0000","last_became_active":"2024-04-18T21:05:05.644942+0000","last_became_peered":"2024-04-18T21:05:05.644942+0000","last_unstale":"2024-04-18T21:05:06.637099+0000","last_undegraded":"2024-04-18T21:05:06.637099+0000","last_fullsized":"2024-04-18T21:05:06.637099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:53.850184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637629+0000","last_change":"2024-04-18T21:05:05.656314+0000","last_active":"2024-04-18T21:05:06.637629+0000","last_peered":"2024-04-18T21:05:06.637629+0000","last_clean":"2024-04-18T21:05:06.637629+0000","last_became_active":"2024-04-18T21:05:05.655364+0000","last_became_peered":"2024-04-18T21:05:05.655364+0000","last_unstale":"2024-04-18T21:05:06.637629+0000","last_undegraded":"2024-04-18T21:05:06.637629+0000","last_fullsized":"2024-04-18T21:05:06.637629+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:27:17.530889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358862+0000","last_change":"2024-04-18T21:05:05.653532+0000","last_active":"2024-04-18T21:05:07.358862+0000","last_peered":"2024-04-18T21:05:07.358862+0000","last_clean":"2024-04-18T21:05:07.358862+0000","last_became_active":"2024-04-18T21:05:05.652950+0000","last_became_peered":"2024-04-18T21:05:05.652950+0000","last_unstale":"2024-04-18T21:05:07.358862+0000","last_undegraded":"2024-04-18T21:05:07.358862+0000","last_fullsized":"2024-04-18T21:05:07.358862+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:51.225379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636535+0000","last_change":"2024-04-18T21:05:05.648084+0000","last_active":"2024-04-18T21:05:06.636535+0000","last_peered":"2024-04-18T21:05:06.636535+0000","last_clean":"2024-04-18T21:05:06.636535+0000","last_became_active":"2024-04-18T21:05:05.645340+0000","last_became_peered":"2024-04-18T21:05:05.645340+0000","last_unstale":"2024-04-18T21:05:06.636535+0000","last_undegraded":"2024-04-18T21:05:06.636535+0000","last_fullsized":"2024-04-18T21:05:06.636535+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:34:31.132458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.357930+0000","last_change":"2024-04-18T21:05:05.655034+0000","last_active":"2024-04-18T21:05:07.357930+0000","last_peered":"2024-04-18T21:05:07.357930+0000","last_clean":"2024-04-18T21:05:07.357930+0000","last_became_active":"2024-04-18T21:05:05.654517+0000","last_became_peered":"2024-04-18T21:05:05.654517+0000","last_unstale":"2024-04-18T21:05:07.357930+0000","last_undegraded":"2024-04-18T21:05:07.357930+0000","last_fullsized":"2024-04-18T21:05:07.357930+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:34:38.427319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635266+0000","last_change":"2024-04-18T21:05:05.626677+0000","last_active":"2024-04-18T21:05:06.635266+0000","last_peered":"2024-04-18T21:05:06.635266+0000","last_clean":"2024-04-18T21:05:06.635266+0000","last_became_active":"2024-04-18T21:05:05.624250+0000","last_became_peered":"2024-04-18T21:05:05.624250+0000","last_unstale":"2024-04-18T21:05:06.635266+0000","last_undegraded":"2024-04-18T21:05:06.635266+0000","last_fullsized":"2024-04-18T21:05:06.635266+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:51.225379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637347+0000","last_change":"2024-04-18T21:05:05.649918+0000","last_active":"2024-04-18T21:05:06.637347+0000","last_peered":"2024-04-18T21:05:06.637347+0000","last_clean":"2024-04-18T21:05:06.637347+0000","last_became_active":"2024-04-18T21:05:05.647147+0000","last_became_peered":"2024-04-18T21:05:05.647147+0000","last_unstale":"2024-04-18T21:05:06.637347+0000","last_undegraded":"2024-04-18T21:05:06.637347+0000","last_fullsized":"2024-04-18T21:05:06.637347+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:51:28.440070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637900+0000","last_change":"2024-04-18T21:05:04.632748+0000","last_active":"2024-04-18T21:05:06.637900+0000","last_peered":"2024-04-18T21:05:06.637900+0000","last_clean":"2024-04-18T21:05:06.637900+0000","last_became_active":"2024-04-18T21:05:04.628407+0000","last_became_peered":"2024-04-18T21:05:04.628407+0000","last_unstale":"2024-04-18T21:05:06.637900+0000","last_undegraded":"2024-04-18T21:05:06.637900+0000","last_fullsized":"2024-04-18T21:05:06.637900+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:42:45.392908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637688+0000","last_change":"2024-04-18T21:05:05.649199+0000","last_active":"2024-04-18T21:05:06.637688+0000","last_peered":"2024-04-18T21:05:06.637688+0000","last_clean":"2024-04-18T21:05:06.637688+0000","last_became_active":"2024-04-18T21:05:05.646898+0000","last_became_peered":"2024-04-18T21:05:05.646898+0000","last_unstale":"2024-04-18T21:05:06.637688+0000","last_undegraded":"2024-04-18T21:05:06.637688+0000","last_fullsized":"2024-04-18T21:05:06.637688+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:31:31.842528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358409+0000","last_change":"2024-04-18T21:05:04.638017+0000","last_active":"2024-04-18T21:05:07.358409+0000","last_peered":"2024-04-18T21:05:07.358409+0000","last_clean":"2024-04-18T21:05:07.358409+0000","last_became_active":"2024-04-18T21:05:04.637287+0000","last_became_peered":"2024-04-18T21:05:04.637287+0000","last_unstale":"2024-04-18T21:05:07.358409+0000","last_undegraded":"2024-04-18T21:05:07.358409+0000","last_fullsized":"2024-04-18T21:05:07.358409+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:25.891472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.360516+0000","last_change":"2024-04-18T21:05:05.650757+0000","last_active":"2024-04-18T21:05:07.360516+0000","last_peered":"2024-04-18T21:05:07.360516+0000","last_clean":"2024-04-18T21:05:07.360516+0000","last_became_active":"2024-04-18T21:05:05.650143+0000","last_became_peered":"2024-04-18T21:05:05.650143+0000","last_unstale":"2024-04-18T21:05:07.360516+0000","last_undegraded":"2024-04-18T21:05:07.360516+0000","last_fullsized":"2024-04-18T21:05:07.360516+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:14:51.873741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635796+0000","last_change":"2024-04-18T21:05:04.628489+0000","last_active":"2024-04-18T21:05:06.635796+0000","last_peered":"2024-04-18T21:05:06.635796+0000","last_clean":"2024-04-18T21:05:06.635796+0000","last_became_active":"2024-04-18T21:05:04.627279+0000","last_became_peered":"2024-04-18T21:05:04.627279+0000","last_unstale":"2024-04-18T21:05:06.635796+0000","last_undegraded":"2024-04-18T21:05:06.635796+0000","last_fullsized":"2024-04-18T21:05:06.635796+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:43:23.420744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359664+0000","last_change":"2024-04-18T21:05:05.649347+0000","last_active":"2024-04-18T21:05:07.359664+0000","last_peered":"2024-04-18T21:05:07.359664+0000","last_clean":"2024-04-18T21:05:07.359664+0000","last_became_active":"2024-04-18T21:05:05.648144+0000","last_became_peered":"2024-04-18T21:05:05.648144+0000","last_unstale":"2024-04-18T21:05:07.359664+0000","last_undegraded":"2024-04-18T21:05:07.359664+0000","last_fullsized":"2024-04-18T21:05:07.359664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:51:28.440070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":22,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635267+0000","last_change":"2024-04-18T21:05:04.624089+0000","last_active":"2024-04-18T21:05:06.635267+0000","last_peered":"2024-04-18T21:05:06.635267+0000","last_clean":"2024-04-18T21:05:06.635267+0000","last_became_active":"2024-04-18T21:05:04.623238+0000","last_became_peered":"2024-04-18T21:05:04.623238+0000","last_unstale":"2024-04-18T21:05:06.635267+0000","last_undegraded":"2024-04-18T21:05:06.635267+0000","last_fullsized":"2024-04-18T21:05:06.635267+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:44:19.076499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637569+0000","last_change":"2024-04-18T21:05:04.633907+0000","last_active":"2024-04-18T21:05:06.637569+0000","last_peered":"2024-04-18T21:05:06.637569+0000","last_clean":"2024-04-18T21:05:06.637569+0000","last_became_active":"2024-04-18T21:05:04.630308+0000","last_became_peered":"2024-04-18T21:05:04.630308+0000","last_unstale":"2024-04-18T21:05:06.637569+0000","last_undegraded":"2024-04-18T21:05:06.637569+0000","last_fullsized":"2024-04-18T21:05:06.637569+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:55:46.219812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635046+0000","last_change":"2024-04-18T21:05:05.658572+0000","last_active":"2024-04-18T21:05:06.635046+0000","last_peered":"2024-04-18T21:05:06.635046+0000","last_clean":"2024-04-18T21:05:06.635046+0000","last_became_active":"2024-04-18T21:05:05.657842+0000","last_became_peered":"2024-04-18T21:05:05.657842+0000","last_unstale":"2024-04-18T21:05:06.635046+0000","last_undegraded":"2024-04-18T21:05:06.635046+0000","last_fullsized":"2024-04-18T21:05:06.635046+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:26:38.636530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.638161+0000","last_change":"2024-04-18T21:05:04.628541+0000","last_active":"2024-04-18T21:05:06.638161+0000","last_peered":"2024-04-18T21:05:06.638161+0000","last_clean":"2024-04-18T21:05:06.638161+0000","last_became_active":"2024-04-18T21:05:04.627407+0000","last_became_peered":"2024-04-18T21:05:04.627407+0000","last_unstale":"2024-04-18T21:05:06.638161+0000","last_undegraded":"2024-04-18T21:05:06.638161+0000","last_fullsized":"2024-04-18T21:05:06.638161+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:55:48.643174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635639+0000","last_change":"2024-04-18T21:05:05.651649+0000","last_active":"2024-04-18T21:05:06.635639+0000","last_peered":"2024-04-18T21:05:06.635639+0000","last_clean":"2024-04-18T21:05:06.635639+0000","last_became_active":"2024-04-18T21:05:05.646809+0000","last_became_peered":"2024-04-18T21:05:05.646809+0000","last_unstale":"2024-04-18T21:05:06.635639+0000","last_undegraded":"2024-04-18T21:05:06.635639+0000","last_fullsized":"2024-04-18T21:05:06.635639+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:23.698827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637684+0000","last_change":"2024-04-18T21:05:04.634055+0000","last_active":"2024-04-18T21:05:06.637684+0000","last_peered":"2024-04-18T21:05:06.637684+0000","last_clean":"2024-04-18T21:05:06.637684+0000","last_became_active":"2024-04-18T21:05:04.630736+0000","last_became_peered":"2024-04-18T21:05:04.630736+0000","last_unstale":"2024-04-18T21:05:06.637684+0000","last_undegraded":"2024-04-18T21:05:06.637684+0000","last_fullsized":"2024-04-18T21:05:06.637684+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:06:44.001512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636585+0000","last_change":"2024-04-18T21:05:05.628869+0000","last_active":"2024-04-18T21:05:06.636585+0000","last_peered":"2024-04-18T21:05:06.636585+0000","last_clean":"2024-04-18T21:05:06.636585+0000","last_became_active":"2024-04-18T21:05:05.627071+0000","last_became_peered":"2024-04-18T21:05:05.627071+0000","last_unstale":"2024-04-18T21:05:06.636585+0000","last_undegraded":"2024-04-18T21:05:06.636585+0000","last_fullsized":"2024-04-18T21:05:06.636585+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:31:31.842528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.638123+0000","last_change":"2024-04-18T21:05:04.625520+0000","last_active":"2024-04-18T21:05:06.638123+0000","last_peered":"2024-04-18T21:05:06.638123+0000","last_clean":"2024-04-18T21:05:06.638123+0000","last_became_active":"2024-04-18T21:05:04.624656+0000","last_became_peered":"2024-04-18T21:05:04.624656+0000","last_unstale":"2024-04-18T21:05:06.638123+0000","last_undegraded":"2024-04-18T21:05:06.638123+0000","last_fullsized":"2024-04-18T21:05:06.638123+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:56:05.795125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358238+0000","last_change":"2024-04-18T21:05:05.649406+0000","last_active":"2024-04-18T21:05:07.358238+0000","last_peered":"2024-04-18T21:05:07.358238+0000","last_clean":"2024-04-18T21:05:07.358238+0000","last_became_active":"2024-04-18T21:05:05.648380+0000","last_became_peered":"2024-04-18T21:05:05.648380+0000","last_unstale":"2024-04-18T21:05:07.358238+0000","last_undegraded":"2024-04-18T21:05:07.358238+0000","last_fullsized":"2024-04-18T21:05:07.358238+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359521+0000","last_change":"2024-04-18T21:05:04.640216+0000","last_active":"2024-04-18T21:05:07.359521+0000","last_peered":"2024-04-18T21:05:07.359521+0000","last_clean":"2024-04-18T21:05:07.359521+0000","last_became_active":"2024-04-18T21:05:04.639349+0000","last_became_peered":"2024-04-18T21:05:04.639349+0000","last_unstale":"2024-04-18T21:05:07.359521+0000","last_undegraded":"2024-04-18T21:05:07.359521+0000","last_fullsized":"2024-04-18T21:05:07.359521+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:09:18.466987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637709+0000","last_change":"2024-04-18T21:05:05.628850+0000","last_active":"2024-04-18T21:05:06.637709+0000","last_peered":"2024-04-18T21:05:06.637709+0000","last_clean":"2024-04-18T21:05:06.637709+0000","last_became_active":"2024-04-18T21:05:05.627521+0000","last_became_peered":"2024-04-18T21:05:05.627521+0000","last_unstale":"2024-04-18T21:05:06.637709+0000","last_undegraded":"2024-04-18T21:05:06.637709+0000","last_fullsized":"2024-04-18T21:05:06.637709+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:14:37.912032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636946+0000","last_change":"2024-04-18T21:05:04.634674+0000","last_active":"2024-04-18T21:05:06.636946+0000","last_peered":"2024-04-18T21:05:06.636946+0000","last_clean":"2024-04-18T21:05:06.636946+0000","last_became_active":"2024-04-18T21:05:04.632284+0000","last_became_peered":"2024-04-18T21:05:04.632284+0000","last_unstale":"2024-04-18T21:05:06.636946+0000","last_undegraded":"2024-04-18T21:05:06.636946+0000","last_fullsized":"2024-04-18T21:05:06.636946+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:09:18.466987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637414+0000","last_change":"2024-04-18T21:05:05.647377+0000","last_active":"2024-04-18T21:05:06.637414+0000","last_peered":"2024-04-18T21:05:06.637414+0000","last_clean":"2024-04-18T21:05:06.637414+0000","last_became_active":"2024-04-18T21:05:05.645067+0000","last_became_peered":"2024-04-18T21:05:05.645067+0000","last_unstale":"2024-04-18T21:05:06.637414+0000","last_undegraded":"2024-04-18T21:05:06.637414+0000","last_fullsized":"2024-04-18T21:05:06.637414+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:29:30.243751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636012+0000","last_change":"2024-04-18T21:05:04.627578+0000","last_active":"2024-04-18T21:05:06.636012+0000","last_peered":"2024-04-18T21:05:06.636012+0000","last_clean":"2024-04-18T21:05:06.636012+0000","last_became_active":"2024-04-18T21:05:04.626786+0000","last_became_peered":"2024-04-18T21:05:04.626786+0000","last_unstale":"2024-04-18T21:05:06.636012+0000","last_undegraded":"2024-04-18T21:05:06.636012+0000","last_fullsized":"2024-04-18T21:05:06.636012+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:55:59.563512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637217+0000","last_change":"2024-04-18T21:05:05.640817+0000","last_active":"2024-04-18T21:05:06.637217+0000","last_peered":"2024-04-18T21:05:06.637217+0000","last_clean":"2024-04-18T21:05:06.637217+0000","last_became_active":"2024-04-18T21:05:05.635526+0000","last_became_peered":"2024-04-18T21:05:05.635526+0000","last_unstale":"2024-04-18T21:05:06.637217+0000","last_undegraded":"2024-04-18T21:05:06.637217+0000","last_fullsized":"2024-04-18T21:05:06.637217+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:44:29.823511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635339+0000","last_change":"2024-04-18T21:05:04.636499+0000","last_active":"2024-04-18T21:05:06.635339+0000","last_peered":"2024-04-18T21:05:06.635339+0000","last_clean":"2024-04-18T21:05:06.635339+0000","last_became_active":"2024-04-18T21:05:04.635830+0000","last_became_peered":"2024-04-18T21:05:04.635830+0000","last_unstale":"2024-04-18T21:05:06.635339+0000","last_undegraded":"2024-04-18T21:05:06.635339+0000","last_fullsized":"2024-04-18T21:05:06.635339+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:26:30.565175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359678+0000","last_change":"2024-04-18T21:05:05.660974+0000","last_active":"2024-04-18T21:05:07.359678+0000","last_peered":"2024-04-18T21:05:07.359678+0000","last_clean":"2024-04-18T21:05:07.359678+0000","last_became_active":"2024-04-18T21:05:05.659287+0000","last_became_peered":"2024-04-18T21:05:05.659287+0000","last_unstale":"2024-04-18T21:05:07.359678+0000","last_undegraded":"2024-04-18T21:05:07.359678+0000","last_fullsized":"2024-04-18T21:05:07.359678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:50:40.920146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":222,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636126+0000","last_change":"2024-04-18T21:04:54.511605+0000","last_active":"2024-04-18T21:05:06.636126+0000","last_peered":"2024-04-18T21:05:06.636126+0000","last_clean":"2024-04-18T21:05:06.636126+0000","last_became_active":"2024-04-18T21:04:54.510791+0000","last_became_peered":"2024-04-18T21:04:54.510791+0000","last_unstale":"2024-04-18T21:05:06.636126+0000","last_undegraded":"2024-04-18T21:05:06.636126+0000","last_fullsized":"2024-04-18T21:05:06.636126+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_clean_scrub_stamp":"2024-04-18T21:04:53.494814+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:46.262250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.638030+0000","last_change":"2024-04-18T21:05:00.576671+0000","last_active":"2024-04-18T21:05:06.638030+0000","last_peered":"2024-04-18T21:05:06.638030+0000","last_clean":"2024-04-18T21:05:06.638030+0000","last_became_active":"2024-04-18T21:05:00.575933+0000","last_became_peered":"2024-04-18T21:05:00.575933+0000","last_unstale":"2024-04-18T21:05:06.638030+0000","last_undegraded":"2024-04-18T21:05:06.638030+0000","last_fullsized":"2024-04-18T21:05:06.638030+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:14:59.207959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358678+0000","last_change":"2024-04-18T21:05:04.639528+0000","last_active":"2024-04-18T21:05:07.358678+0000","last_peered":"2024-04-18T21:05:07.358678+0000","last_clean":"2024-04-18T21:05:07.358678+0000","last_became_active":"2024-04-18T21:05:04.638517+0000","last_became_peered":"2024-04-18T21:05:04.638517+0000","last_unstale":"2024-04-18T21:05:07.358678+0000","last_undegraded":"2024-04-18T21:05:07.358678+0000","last_fullsized":"2024-04-18T21:05:07.358678+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:55:46.219812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637482+0000","last_change":"2024-04-18T21:05:05.647623+0000","last_active":"2024-04-18T21:05:06.637482+0000","last_peered":"2024-04-18T21:05:06.637482+0000","last_clean":"2024-04-18T21:05:06.637482+0000","last_became_active":"2024-04-18T21:05:05.645640+0000","last_became_peered":"2024-04-18T21:05:05.645640+0000","last_unstale":"2024-04-18T21:05:06.637482+0000","last_undegraded":"2024-04-18T21:05:06.637482+0000","last_fullsized":"2024-04-18T21:05:06.637482+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:59.950421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635615+0000","last_change":"2024-04-18T21:05:00.571960+0000","last_active":"2024-04-18T21:05:06.635615+0000","last_peered":"2024-04-18T21:05:06.635615+0000","last_clean":"2024-04-18T21:05:06.635615+0000","last_became_active":"2024-04-18T21:05:00.571301+0000","last_became_peered":"2024-04-18T21:05:00.571301+0000","last_unstale":"2024-04-18T21:05:06.635615+0000","last_undegraded":"2024-04-18T21:05:06.635615+0000","last_fullsized":"2024-04-18T21:05:06.635615+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:31:59.262440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358645+0000","last_change":"2024-04-18T21:05:04.638026+0000","last_active":"2024-04-18T21:05:07.358645+0000","last_peered":"2024-04-18T21:05:07.358645+0000","last_clean":"2024-04-18T21:05:07.358645+0000","last_became_active":"2024-04-18T21:05:04.637160+0000","last_became_peered":"2024-04-18T21:05:04.637160+0000","last_unstale":"2024-04-18T21:05:07.358645+0000","last_undegraded":"2024-04-18T21:05:07.358645+0000","last_fullsized":"2024-04-18T21:05:07.358645+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:33:48.703994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.638058+0000","last_change":"2024-04-18T21:05:05.654121+0000","last_active":"2024-04-18T21:05:06.638058+0000","last_peered":"2024-04-18T21:05:06.638058+0000","last_clean":"2024-04-18T21:05:06.638058+0000","last_became_active":"2024-04-18T21:05:05.651310+0000","last_became_peered":"2024-04-18T21:05:05.651310+0000","last_unstale":"2024-04-18T21:05:06.638058+0000","last_undegraded":"2024-04-18T21:05:06.638058+0000","last_fullsized":"2024-04-18T21:05:06.638058+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:01.841786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359064+0000","last_change":"2024-04-18T21:05:00.578604+0000","last_active":"2024-04-18T21:05:07.359064+0000","last_peered":"2024-04-18T21:05:07.359064+0000","last_clean":"2024-04-18T21:05:07.359064+0000","last_became_active":"2024-04-18T21:05:00.577988+0000","last_became_peered":"2024-04-18T21:05:00.577988+0000","last_unstale":"2024-04-18T21:05:07.359064+0000","last_undegraded":"2024-04-18T21:05:07.359064+0000","last_fullsized":"2024-04-18T21:05:07.359064+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:54:54.201759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635569+0000","last_change":"2024-04-18T21:05:04.627627+0000","last_active":"2024-04-18T21:05:06.635569+0000","last_peered":"2024-04-18T21:05:06.635569+0000","last_clean":"2024-04-18T21:05:06.635569+0000","last_became_active":"2024-04-18T21:05:04.626850+0000","last_became_peered":"2024-04-18T21:05:04.626850+0000","last_unstale":"2024-04-18T21:05:06.635569+0000","last_undegraded":"2024-04-18T21:05:06.635569+0000","last_fullsized":"2024-04-18T21:05:06.635569+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:43:31.453080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359914+0000","last_change":"2024-04-18T21:05:05.661488+0000","last_active":"2024-04-18T21:05:07.359914+0000","last_peered":"2024-04-18T21:05:07.359914+0000","last_clean":"2024-04-18T21:05:07.359914+0000","last_became_active":"2024-04-18T21:05:05.660283+0000","last_became_peered":"2024-04-18T21:05:05.660283+0000","last_unstale":"2024-04-18T21:05:07.359914+0000","last_undegraded":"2024-04-18T21:05:07.359914+0000","last_fullsized":"2024-04-18T21:05:07.359914+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:04.350492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637285+0000","last_change":"2024-04-18T21:05:00.576606+0000","last_active":"2024-04-18T21:05:06.637285+0000","last_peered":"2024-04-18T21:05:06.637285+0000","last_clean":"2024-04-18T21:05:06.637285+0000","last_became_active":"2024-04-18T21:05:00.575951+0000","last_became_peered":"2024-04-18T21:05:00.575951+0000","last_unstale":"2024-04-18T21:05:06.637285+0000","last_undegraded":"2024-04-18T21:05:06.637285+0000","last_fullsized":"2024-04-18T21:05:06.637285+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:32:17.612481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637939+0000","last_change":"2024-04-18T21:05:04.627296+0000","last_active":"2024-04-18T21:05:06.637939+0000","last_peered":"2024-04-18T21:05:06.637939+0000","last_clean":"2024-04-18T21:05:06.637939+0000","last_became_active":"2024-04-18T21:05:04.626801+0000","last_became_peered":"2024-04-18T21:05:04.626801+0000","last_unstale":"2024-04-18T21:05:06.637939+0000","last_undegraded":"2024-04-18T21:05:06.637939+0000","last_fullsized":"2024-04-18T21:05:06.637939+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:46:36.285416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359434+0000","last_change":"2024-04-18T21:05:05.655152+0000","last_active":"2024-04-18T21:05:07.359434+0000","last_peered":"2024-04-18T21:05:07.359434+0000","last_clean":"2024-04-18T21:05:07.359434+0000","last_became_active":"2024-04-18T21:05:05.654506+0000","last_became_peered":"2024-04-18T21:05:05.654506+0000","last_unstale":"2024-04-18T21:05:07.359434+0000","last_undegraded":"2024-04-18T21:05:07.359434+0000","last_fullsized":"2024-04-18T21:05:07.359434+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:32:23.929877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637718+0000","last_change":"2024-04-18T21:05:04.628916+0000","last_active":"2024-04-18T21:05:06.637718+0000","last_peered":"2024-04-18T21:05:06.637718+0000","last_clean":"2024-04-18T21:05:06.637718+0000","last_became_active":"2024-04-18T21:05:04.628245+0000","last_became_peered":"2024-04-18T21:05:04.628245+0000","last_unstale":"2024-04-18T21:05:06.637718+0000","last_undegraded":"2024-04-18T21:05:06.637718+0000","last_fullsized":"2024-04-18T21:05:06.637718+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:34:58.562540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359757+0000","last_change":"2024-04-18T21:05:00.578563+0000","last_active":"2024-04-18T21:05:07.359757+0000","last_peered":"2024-04-18T21:05:07.359757+0000","last_clean":"2024-04-18T21:05:07.359757+0000","last_became_active":"2024-04-18T21:05:00.577960+0000","last_became_peered":"2024-04-18T21:05:00.577960+0000","last_unstale":"2024-04-18T21:05:07.359757+0000","last_undegraded":"2024-04-18T21:05:07.359757+0000","last_fullsized":"2024-04-18T21:05:07.359757+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:31:59.262440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636313+0000","last_change":"2024-04-18T21:05:05.646076+0000","last_active":"2024-04-18T21:05:06.636313+0000","last_peered":"2024-04-18T21:05:06.636313+0000","last_clean":"2024-04-18T21:05:06.636313+0000","last_became_active":"2024-04-18T21:05:05.645104+0000","last_became_peered":"2024-04-18T21:05:05.645104+0000","last_unstale":"2024-04-18T21:05:06.636313+0000","last_undegraded":"2024-04-18T21:05:06.636313+0000","last_fullsized":"2024-04-18T21:05:06.636313+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:34:38.427319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359695+0000","last_change":"2024-04-18T21:05:04.639700+0000","last_active":"2024-04-18T21:05:07.359695+0000","last_peered":"2024-04-18T21:05:07.359695+0000","last_clean":"2024-04-18T21:05:07.359695+0000","last_became_active":"2024-04-18T21:05:04.638928+0000","last_became_peered":"2024-04-18T21:05:04.638928+0000","last_unstale":"2024-04-18T21:05:07.359695+0000","last_undegraded":"2024-04-18T21:05:07.359695+0000","last_fullsized":"2024-04-18T21:05:07.359695+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:00:08.877854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.638177+0000","last_change":"2024-04-18T21:05:00.576907+0000","last_active":"2024-04-18T21:05:06.638177+0000","last_peered":"2024-04-18T21:05:06.638177+0000","last_clean":"2024-04-18T21:05:06.638177+0000","last_became_active":"2024-04-18T21:05:00.576152+0000","last_became_peered":"2024-04-18T21:05:00.576152+0000","last_unstale":"2024-04-18T21:05:06.638177+0000","last_undegraded":"2024-04-18T21:05:06.638177+0000","last_fullsized":"2024-04-18T21:05:06.638177+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:25:07.270023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636117+0000","last_change":"2024-04-18T21:05:05.646026+0000","last_active":"2024-04-18T21:05:06.636117+0000","last_peered":"2024-04-18T21:05:06.636117+0000","last_clean":"2024-04-18T21:05:06.636117+0000","last_became_active":"2024-04-18T21:05:05.645192+0000","last_became_peered":"2024-04-18T21:05:05.645192+0000","last_unstale":"2024-04-18T21:05:06.636117+0000","last_undegraded":"2024-04-18T21:05:06.636117+0000","last_fullsized":"2024-04-18T21:05:06.636117+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:05:46.009381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.360443+0000","last_change":"2024-04-18T21:05:04.640732+0000","last_active":"2024-04-18T21:05:07.360443+0000","last_peered":"2024-04-18T21:05:07.360443+0000","last_clean":"2024-04-18T21:05:07.360443+0000","last_became_active":"2024-04-18T21:05:04.638505+0000","last_became_peered":"2024-04-18T21:05:04.638505+0000","last_unstale":"2024-04-18T21:05:07.360443+0000","last_undegraded":"2024-04-18T21:05:07.360443+0000","last_fullsized":"2024-04-18T21:05:07.360443+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:34:58.562540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.360549+0000","last_change":"2024-04-18T21:05:00.579869+0000","last_active":"2024-04-18T21:05:07.360549+0000","last_peered":"2024-04-18T21:05:07.360549+0000","last_clean":"2024-04-18T21:05:07.360549+0000","last_became_active":"2024-04-18T21:05:00.579351+0000","last_became_peered":"2024-04-18T21:05:00.579351+0000","last_unstale":"2024-04-18T21:05:07.360549+0000","last_undegraded":"2024-04-18T21:05:07.360549+0000","last_fullsized":"2024-04-18T21:05:07.360549+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:15:02.061128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.357811+0000","last_change":"2024-04-18T21:05:05.642730+0000","last_active":"2024-04-18T21:05:07.357811+0000","last_peered":"2024-04-18T21:05:07.357811+0000","last_clean":"2024-04-18T21:05:07.357811+0000","last_became_active":"2024-04-18T21:05:05.641890+0000","last_became_peered":"2024-04-18T21:05:05.641890+0000","last_unstale":"2024-04-18T21:05:07.357811+0000","last_undegraded":"2024-04-18T21:05:07.357811+0000","last_fullsized":"2024-04-18T21:05:07.357811+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:05:46.009381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.583432+0000","last_change":"2024-04-18T21:05:04.639898+0000","last_active":"2024-04-18T21:05:07.583432+0000","last_peered":"2024-04-18T21:05:07.583432+0000","last_clean":"2024-04-18T21:05:07.583432+0000","last_became_active":"2024-04-18T21:05:04.639115+0000","last_became_peered":"2024-04-18T21:05:04.639115+0000","last_unstale":"2024-04-18T21:05:07.583432+0000","last_undegraded":"2024-04-18T21:05:07.583432+0000","last_fullsized":"2024-04-18T21:05:07.583432+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:44:19.076499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637757+0000","last_change":"2024-04-18T21:05:00.572414+0000","last_active":"2024-04-18T21:05:06.637757+0000","last_peered":"2024-04-18T21:05:06.637757+0000","last_clean":"2024-04-18T21:05:06.637757+0000","last_became_active":"2024-04-18T21:05:00.571755+0000","last_became_peered":"2024-04-18T21:05:00.571755+0000","last_unstale":"2024-04-18T21:05:06.637757+0000","last_undegraded":"2024-04-18T21:05:06.637757+0000","last_fullsized":"2024-04-18T21:05:06.637757+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:15:02.061128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635489+0000","last_change":"2024-04-18T21:05:05.655898+0000","last_active":"2024-04-18T21:05:06.635489+0000","last_peered":"2024-04-18T21:05:06.635489+0000","last_clean":"2024-04-18T21:05:06.635489+0000","last_became_active":"2024-04-18T21:05:05.654111+0000","last_became_peered":"2024-04-18T21:05:05.654111+0000","last_unstale":"2024-04-18T21:05:06.635489+0000","last_undegraded":"2024-04-18T21:05:06.635489+0000","last_fullsized":"2024-04-18T21:05:06.635489+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:19:38.537080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637592+0000","last_change":"2024-04-18T21:05:05.641373+0000","last_active":"2024-04-18T21:05:06.637592+0000","last_peered":"2024-04-18T21:05:06.637592+0000","last_clean":"2024-04-18T21:05:06.637592+0000","last_became_active":"2024-04-18T21:05:05.634204+0000","last_became_peered":"2024-04-18T21:05:05.634204+0000","last_unstale":"2024-04-18T21:05:06.637592+0000","last_undegraded":"2024-04-18T21:05:06.637592+0000","last_fullsized":"2024-04-18T21:05:06.637592+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:27:35.995004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637977+0000","last_change":"2024-04-18T21:05:04.631271+0000","last_active":"2024-04-18T21:05:06.637977+0000","last_peered":"2024-04-18T21:05:06.637977+0000","last_clean":"2024-04-18T21:05:06.637977+0000","last_became_active":"2024-04-18T21:05:04.630442+0000","last_became_peered":"2024-04-18T21:05:04.630442+0000","last_unstale":"2024-04-18T21:05:06.637977+0000","last_undegraded":"2024-04-18T21:05:06.637977+0000","last_fullsized":"2024-04-18T21:05:06.637977+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:33:48.703994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358112+0000","last_change":"2024-04-18T21:05:05.637894+0000","last_active":"2024-04-18T21:05:07.358112+0000","last_peered":"2024-04-18T21:05:07.358112+0000","last_clean":"2024-04-18T21:05:07.358112+0000","last_became_active":"2024-04-18T21:05:05.636846+0000","last_became_peered":"2024-04-18T21:05:05.636846+0000","last_unstale":"2024-04-18T21:05:07.358112+0000","last_undegraded":"2024-04-18T21:05:07.358112+0000","last_fullsized":"2024-04-18T21:05:07.358112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:34:31.132458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637990+0000","last_change":"2024-04-18T21:05:04.631152+0000","last_active":"2024-04-18T21:05:06.637990+0000","last_peered":"2024-04-18T21:05:06.637990+0000","last_clean":"2024-04-18T21:05:06.637990+0000","last_became_active":"2024-04-18T21:05:04.628900+0000","last_became_peered":"2024-04-18T21:05:04.628900+0000","last_unstale":"2024-04-18T21:05:06.637990+0000","last_undegraded":"2024-04-18T21:05:06.637990+0000","last_fullsized":"2024-04-18T21:05:06.637990+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:40:21.452052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637452+0000","last_change":"2024-04-18T21:05:04.629470+0000","last_active":"2024-04-18T21:05:06.637452+0000","last_peered":"2024-04-18T21:05:06.637452+0000","last_clean":"2024-04-18T21:05:06.637452+0000","last_became_active":"2024-04-18T21:05:04.628286+0000","last_became_peered":"2024-04-18T21:05:04.628286+0000","last_unstale":"2024-04-18T21:05:06.637452+0000","last_undegraded":"2024-04-18T21:05:06.637452+0000","last_fullsized":"2024-04-18T21:05:06.637452+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:00:08.877854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358071+0000","last_change":"2024-04-18T21:05:05.642793+0000","last_active":"2024-04-18T21:05:07.358071+0000","last_peered":"2024-04-18T21:05:07.358071+0000","last_clean":"2024-04-18T21:05:07.358071+0000","last_became_active":"2024-04-18T21:05:05.641983+0000","last_became_peered":"2024-04-18T21:05:05.641983+0000","last_unstale":"2024-04-18T21:05:07.358071+0000","last_undegraded":"2024-04-18T21:05:07.358071+0000","last_fullsized":"2024-04-18T21:05:07.358071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:46:36.339289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.360264+0000","last_change":"2024-04-18T21:05:04.641445+0000","last_active":"2024-04-18T21:05:07.360264+0000","last_peered":"2024-04-18T21:05:07.360264+0000","last_clean":"2024-04-18T21:05:07.360264+0000","last_became_active":"2024-04-18T21:05:04.640682+0000","last_became_peered":"2024-04-18T21:05:04.640682+0000","last_unstale":"2024-04-18T21:05:07.360264+0000","last_undegraded":"2024-04-18T21:05:07.360264+0000","last_fullsized":"2024-04-18T21:05:07.360264+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:46:36.285416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.357743+0000","last_change":"2024-04-18T21:05:05.641561+0000","last_active":"2024-04-18T21:05:07.357743+0000","last_peered":"2024-04-18T21:05:07.357743+0000","last_clean":"2024-04-18T21:05:07.357743+0000","last_became_active":"2024-04-18T21:05:05.640922+0000","last_became_peered":"2024-04-18T21:05:05.640922+0000","last_unstale":"2024-04-18T21:05:07.357743+0000","last_undegraded":"2024-04-18T21:05:07.357743+0000","last_fullsized":"2024-04-18T21:05:07.357743+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:56.408234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637829+0000","last_change":"2024-04-18T21:05:05.651530+0000","last_active":"2024-04-18T21:05:06.637829+0000","last_peered":"2024-04-18T21:05:06.637829+0000","last_clean":"2024-04-18T21:05:06.637829+0000","last_became_active":"2024-04-18T21:05:05.648167+0000","last_became_peered":"2024-04-18T21:05:05.648167+0000","last_unstale":"2024-04-18T21:05:06.637829+0000","last_undegraded":"2024-04-18T21:05:06.637829+0000","last_fullsized":"2024-04-18T21:05:06.637829+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:14:51.873741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358019+0000","last_change":"2024-04-18T21:05:04.637369+0000","last_active":"2024-04-18T21:05:07.358019+0000","last_peered":"2024-04-18T21:05:07.358019+0000","last_clean":"2024-04-18T21:05:07.358019+0000","last_became_active":"2024-04-18T21:05:04.636468+0000","last_became_peered":"2024-04-18T21:05:04.636468+0000","last_unstale":"2024-04-18T21:05:07.358019+0000","last_undegraded":"2024-04-18T21:05:07.358019+0000","last_fullsized":"2024-04-18T21:05:07.358019+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:40:21.452052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.360014+0000","last_change":"2024-04-18T21:05:05.651245+0000","last_active":"2024-04-18T21:05:07.360014+0000","last_peered":"2024-04-18T21:05:07.360014+0000","last_clean":"2024-04-18T21:05:07.360014+0000","last_became_active":"2024-04-18T21:05:05.650463+0000","last_became_peered":"2024-04-18T21:05:05.650463+0000","last_unstale":"2024-04-18T21:05:07.360014+0000","last_undegraded":"2024-04-18T21:05:07.360014+0000","last_fullsized":"2024-04-18T21:05:07.360014+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:27:17.530889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358504+0000","last_change":"2024-04-18T21:05:04.637597+0000","last_active":"2024-04-18T21:05:07.358504+0000","last_peered":"2024-04-18T21:05:07.358504+0000","last_clean":"2024-04-18T21:05:07.358504+0000","last_became_active":"2024-04-18T21:05:04.636827+0000","last_became_peered":"2024-04-18T21:05:04.636827+0000","last_unstale":"2024-04-18T21:05:07.358504+0000","last_undegraded":"2024-04-18T21:05:07.358504+0000","last_fullsized":"2024-04-18T21:05:07.358504+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:43.511952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636925+0000","last_change":"2024-04-18T21:05:05.658971+0000","last_active":"2024-04-18T21:05:06.636925+0000","last_peered":"2024-04-18T21:05:06.636925+0000","last_clean":"2024-04-18T21:05:06.636925+0000","last_became_active":"2024-04-18T21:05:05.658363+0000","last_became_peered":"2024-04-18T21:05:05.658363+0000","last_unstale":"2024-04-18T21:05:06.636925+0000","last_undegraded":"2024-04-18T21:05:06.636925+0000","last_fullsized":"2024-04-18T21:05:06.636925+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:12.944469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636616+0000","last_change":"2024-04-18T21:05:04.636585+0000","last_active":"2024-04-18T21:05:06.636616+0000","last_peered":"2024-04-18T21:05:06.636616+0000","last_clean":"2024-04-18T21:05:06.636616+0000","last_became_active":"2024-04-18T21:05:04.635670+0000","last_became_peered":"2024-04-18T21:05:04.635670+0000","last_unstale":"2024-04-18T21:05:06.636616+0000","last_undegraded":"2024-04-18T21:05:06.636616+0000","last_fullsized":"2024-04-18T21:05:06.636616+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:34:33.779063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636955+0000","last_change":"2024-04-18T21:05:05.649960+0000","last_active":"2024-04-18T21:05:06.636955+0000","last_peered":"2024-04-18T21:05:06.636955+0000","last_clean":"2024-04-18T21:05:06.636955+0000","last_became_active":"2024-04-18T21:05:05.648528+0000","last_became_peered":"2024-04-18T21:05:05.648528+0000","last_unstale":"2024-04-18T21:05:06.636955+0000","last_undegraded":"2024-04-18T21:05:06.636955+0000","last_fullsized":"2024-04-18T21:05:06.636955+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:20:45.938503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636493+0000","last_change":"2024-04-18T21:05:04.630151+0000","last_active":"2024-04-18T21:05:06.636493+0000","last_peered":"2024-04-18T21:05:06.636493+0000","last_clean":"2024-04-18T21:05:06.636493+0000","last_became_active":"2024-04-18T21:05:04.627968+0000","last_became_peered":"2024-04-18T21:05:04.627968+0000","last_unstale":"2024-04-18T21:05:06.636493+0000","last_undegraded":"2024-04-18T21:05:06.636493+0000","last_fullsized":"2024-04-18T21:05:06.636493+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:00:33.393636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636522+0000","last_change":"2024-04-18T21:05:05.624840+0000","last_active":"2024-04-18T21:05:06.636522+0000","last_peered":"2024-04-18T21:05:06.636522+0000","last_clean":"2024-04-18T21:05:06.636522+0000","last_became_active":"2024-04-18T21:05:05.622950+0000","last_became_peered":"2024-04-18T21:05:05.622950+0000","last_unstale":"2024-04-18T21:05:06.636522+0000","last_undegraded":"2024-04-18T21:05:06.636522+0000","last_fullsized":"2024-04-18T21:05:06.636522+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:27:17.530889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637987+0000","last_change":"2024-04-18T21:05:04.626715+0000","last_active":"2024-04-18T21:05:06.637987+0000","last_peered":"2024-04-18T21:05:06.637987+0000","last_clean":"2024-04-18T21:05:06.637987+0000","last_became_active":"2024-04-18T21:05:04.625270+0000","last_became_peered":"2024-04-18T21:05:04.625270+0000","last_unstale":"2024-04-18T21:05:06.637987+0000","last_undegraded":"2024-04-18T21:05:06.637987+0000","last_fullsized":"2024-04-18T21:05:06.637987+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:43.511952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637167+0000","last_change":"2024-04-18T21:05:05.627962+0000","last_active":"2024-04-18T21:05:06.637167+0000","last_peered":"2024-04-18T21:05:06.637167+0000","last_clean":"2024-04-18T21:05:06.637167+0000","last_became_active":"2024-04-18T21:05:05.626698+0000","last_became_peered":"2024-04-18T21:05:05.626698+0000","last_unstale":"2024-04-18T21:05:06.637167+0000","last_undegraded":"2024-04-18T21:05:06.637167+0000","last_fullsized":"2024-04-18T21:05:06.637167+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:48:48.973087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637569+0000","last_change":"2024-04-18T21:05:04.632776+0000","last_active":"2024-04-18T21:05:06.637569+0000","last_peered":"2024-04-18T21:05:06.637569+0000","last_clean":"2024-04-18T21:05:06.637569+0000","last_became_active":"2024-04-18T21:05:04.630142+0000","last_became_peered":"2024-04-18T21:05:04.630142+0000","last_unstale":"2024-04-18T21:05:06.637569+0000","last_undegraded":"2024-04-18T21:05:06.637569+0000","last_fullsized":"2024-04-18T21:05:06.637569+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:19:36.721897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636797+0000","last_change":"2024-04-18T21:05:05.653025+0000","last_active":"2024-04-18T21:05:06.636797+0000","last_peered":"2024-04-18T21:05:06.636797+0000","last_clean":"2024-04-18T21:05:06.636797+0000","last_became_active":"2024-04-18T21:05:05.645039+0000","last_became_peered":"2024-04-18T21:05:05.645039+0000","last_unstale":"2024-04-18T21:05:06.636797+0000","last_undegraded":"2024-04-18T21:05:06.636797+0000","last_fullsized":"2024-04-18T21:05:06.636797+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.360315+0000","last_change":"2024-04-18T21:05:04.640134+0000","last_active":"2024-04-18T21:05:07.360315+0000","last_peered":"2024-04-18T21:05:07.360315+0000","last_clean":"2024-04-18T21:05:07.360315+0000","last_became_active":"2024-04-18T21:05:04.638597+0000","last_became_peered":"2024-04-18T21:05:04.638597+0000","last_unstale":"2024-04-18T21:05:07.360315+0000","last_undegraded":"2024-04-18T21:05:07.360315+0000","last_fullsized":"2024-04-18T21:05:07.360315+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:56:05.795125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635677+0000","last_change":"2024-04-18T21:05:05.629022+0000","last_active":"2024-04-18T21:05:06.635677+0000","last_peered":"2024-04-18T21:05:06.635677+0000","last_clean":"2024-04-18T21:05:06.635677+0000","last_became_active":"2024-04-18T21:05:05.627643+0000","last_became_peered":"2024-04-18T21:05:05.627643+0000","last_unstale":"2024-04-18T21:05:06.635677+0000","last_undegraded":"2024-04-18T21:05:06.635677+0000","last_fullsized":"2024-04-18T21:05:06.635677+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:32:23.929877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359950+0000","last_change":"2024-04-18T21:05:04.641338+0000","last_active":"2024-04-18T21:05:07.359950+0000","last_peered":"2024-04-18T21:05:07.359950+0000","last_clean":"2024-04-18T21:05:07.359950+0000","last_became_active":"2024-04-18T21:05:04.639958+0000","last_became_peered":"2024-04-18T21:05:04.639958+0000","last_unstale":"2024-04-18T21:05:07.359950+0000","last_undegraded":"2024-04-18T21:05:07.359950+0000","last_fullsized":"2024-04-18T21:05:07.359950+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:42:45.392908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738377,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31340,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340500,"statfs":{"total":96636764160,"available":96604672000,"internally_reserved":0,"allocated":163840,"data_stored":55728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738377,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31940,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339900,"statfs":{"total":96636764160,"available":96604057600,"internally_reserved":0,"allocated":774144,"data_stored":647274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":782336,"data_stored":647890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:05:20.082 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:05:20.415 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:05:20.416 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-04-18T21:05:20.431 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-04-18T21:05:18.505888+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91068,"kb_used_data":1680,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024452,"statfs":{"total":289910292480,"available":289817038848,"internally_reserved":0,"allocated":1720320,"data_stored":1350892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.873284"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637590+0000","last_change":"2024-04-18T21:05:05.652795+0000","last_active":"2024-04-18T21:05:06.637590+0000","last_peered":"2024-04-18T21:05:06.637590+0000","last_clean":"2024-04-18T21:05:06.637590+0000","last_became_active":"2024-04-18T21:05:05.650121+0000","last_became_peered":"2024-04-18T21:05:05.650121+0000","last_unstale":"2024-04-18T21:05:06.637590+0000","last_undegraded":"2024-04-18T21:05:06.637590+0000","last_fullsized":"2024-04-18T21:05:06.637590+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637298+0000","last_change":"2024-04-18T21:05:05.657531+0000","last_active":"2024-04-18T21:05:06.637298+0000","last_peered":"2024-04-18T21:05:06.637298+0000","last_clean":"2024-04-18T21:05:06.637298+0000","last_became_active":"2024-04-18T21:05:05.653101+0000","last_became_peered":"2024-04-18T21:05:05.653101+0000","last_unstale":"2024-04-18T21:05:06.637298+0000","last_undegraded":"2024-04-18T21:05:06.637298+0000","last_fullsized":"2024-04-18T21:05:06.637298+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:32:23.929877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636411+0000","last_change":"2024-04-18T21:05:05.647965+0000","last_active":"2024-04-18T21:05:06.636411+0000","last_peered":"2024-04-18T21:05:06.636411+0000","last_clean":"2024-04-18T21:05:06.636411+0000","last_became_active":"2024-04-18T21:05:05.645931+0000","last_became_peered":"2024-04-18T21:05:05.645931+0000","last_unstale":"2024-04-18T21:05:06.636411+0000","last_undegraded":"2024-04-18T21:05:06.636411+0000","last_fullsized":"2024-04-18T21:05:06.636411+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:04.350492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637673+0000","last_change":"2024-04-18T21:05:05.629321+0000","last_active":"2024-04-18T21:05:06.637673+0000","last_peered":"2024-04-18T21:05:06.637673+0000","last_clean":"2024-04-18T21:05:06.637673+0000","last_became_active":"2024-04-18T21:05:05.627956+0000","last_became_peered":"2024-04-18T21:05:05.627956+0000","last_unstale":"2024-04-18T21:05:06.637673+0000","last_undegraded":"2024-04-18T21:05:06.637673+0000","last_fullsized":"2024-04-18T21:05:06.637673+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:15:28.458476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636510+0000","last_change":"2024-04-18T21:05:05.648710+0000","last_active":"2024-04-18T21:05:06.636510+0000","last_peered":"2024-04-18T21:05:06.636510+0000","last_clean":"2024-04-18T21:05:06.636510+0000","last_became_active":"2024-04-18T21:05:05.647801+0000","last_became_peered":"2024-04-18T21:05:05.647801+0000","last_unstale":"2024-04-18T21:05:06.636510+0000","last_undegraded":"2024-04-18T21:05:06.636510+0000","last_fullsized":"2024-04-18T21:05:06.636510+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:46:36.339289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635784+0000","last_change":"2024-04-18T21:05:05.629095+0000","last_active":"2024-04-18T21:05:06.635784+0000","last_peered":"2024-04-18T21:05:06.635784+0000","last_clean":"2024-04-18T21:05:06.635784+0000","last_became_active":"2024-04-18T21:05:05.627664+0000","last_became_peered":"2024-04-18T21:05:05.627664+0000","last_unstale":"2024-04-18T21:05:06.635784+0000","last_undegraded":"2024-04-18T21:05:06.635784+0000","last_fullsized":"2024-04-18T21:05:06.635784+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:51:28.440070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635525+0000","last_change":"2024-04-18T21:05:05.625047+0000","last_active":"2024-04-18T21:05:06.635525+0000","last_peered":"2024-04-18T21:05:06.635525+0000","last_clean":"2024-04-18T21:05:06.635525+0000","last_became_active":"2024-04-18T21:05:05.622781+0000","last_became_peered":"2024-04-18T21:05:05.622781+0000","last_unstale":"2024-04-18T21:05:06.635525+0000","last_undegraded":"2024-04-18T21:05:06.635525+0000","last_fullsized":"2024-04-18T21:05:06.635525+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:12.944469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.634795+0000","last_change":"2024-04-18T21:05:05.640390+0000","last_active":"2024-04-18T21:05:06.634795+0000","last_peered":"2024-04-18T21:05:06.634795+0000","last_clean":"2024-04-18T21:05:06.634795+0000","last_became_active":"2024-04-18T21:05:05.638295+0000","last_became_peered":"2024-04-18T21:05:05.638295+0000","last_unstale":"2024-04-18T21:05:06.634795+0000","last_undegraded":"2024-04-18T21:05:06.634795+0000","last_fullsized":"2024-04-18T21:05:06.634795+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:34:31.132458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359217+0000","last_change":"2024-04-18T21:05:05.660752+0000","last_active":"2024-04-18T21:05:07.359217+0000","last_peered":"2024-04-18T21:05:07.359217+0000","last_clean":"2024-04-18T21:05:07.359217+0000","last_became_active":"2024-04-18T21:05:05.659226+0000","last_became_peered":"2024-04-18T21:05:05.659226+0000","last_unstale":"2024-04-18T21:05:07.359217+0000","last_undegraded":"2024-04-18T21:05:07.359217+0000","last_fullsized":"2024-04-18T21:05:07.359217+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:20:45.938503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637371+0000","last_change":"2024-04-18T21:05:05.656660+0000","last_active":"2024-04-18T21:05:06.637371+0000","last_peered":"2024-04-18T21:05:06.637371+0000","last_clean":"2024-04-18T21:05:06.637371+0000","last_became_active":"2024-04-18T21:05:05.653829+0000","last_became_peered":"2024-04-18T21:05:05.653829+0000","last_unstale":"2024-04-18T21:05:06.637371+0000","last_undegraded":"2024-04-18T21:05:06.637371+0000","last_fullsized":"2024-04-18T21:05:06.637371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:50:40.920146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636818+0000","last_change":"2024-04-18T21:05:05.646721+0000","last_active":"2024-04-18T21:05:06.636818+0000","last_peered":"2024-04-18T21:05:06.636818+0000","last_clean":"2024-04-18T21:05:06.636818+0000","last_became_active":"2024-04-18T21:05:05.643421+0000","last_became_peered":"2024-04-18T21:05:05.643421+0000","last_unstale":"2024-04-18T21:05:06.636818+0000","last_undegraded":"2024-04-18T21:05:06.636818+0000","last_fullsized":"2024-04-18T21:05:06.636818+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:14:51.873741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636882+0000","last_change":"2024-04-18T21:05:05.656320+0000","last_active":"2024-04-18T21:05:06.636882+0000","last_peered":"2024-04-18T21:05:06.636882+0000","last_clean":"2024-04-18T21:05:06.636882+0000","last_became_active":"2024-04-18T21:05:05.655508+0000","last_became_peered":"2024-04-18T21:05:05.655508+0000","last_unstale":"2024-04-18T21:05:06.636882+0000","last_undegraded":"2024-04-18T21:05:06.636882+0000","last_fullsized":"2024-04-18T21:05:06.636882+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:51.225379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636068+0000","last_change":"2024-04-18T21:05:05.649001+0000","last_active":"2024-04-18T21:05:06.636068+0000","last_peered":"2024-04-18T21:05:06.636068+0000","last_clean":"2024-04-18T21:05:06.636068+0000","last_became_active":"2024-04-18T21:05:05.648070+0000","last_became_peered":"2024-04-18T21:05:05.648070+0000","last_unstale":"2024-04-18T21:05:06.636068+0000","last_undegraded":"2024-04-18T21:05:06.636068+0000","last_fullsized":"2024-04-18T21:05:06.636068+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:56.408234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636128+0000","last_change":"2024-04-18T21:05:05.635880+0000","last_active":"2024-04-18T21:05:06.636128+0000","last_peered":"2024-04-18T21:05:06.636128+0000","last_clean":"2024-04-18T21:05:06.636128+0000","last_became_active":"2024-04-18T21:05:05.635089+0000","last_became_peered":"2024-04-18T21:05:05.635089+0000","last_unstale":"2024-04-18T21:05:06.636128+0000","last_undegraded":"2024-04-18T21:05:06.636128+0000","last_fullsized":"2024-04-18T21:05:06.636128+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:50:40.920146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635604+0000","last_change":"2024-04-18T21:05:05.639640+0000","last_active":"2024-04-18T21:05:06.635604+0000","last_peered":"2024-04-18T21:05:06.635604+0000","last_clean":"2024-04-18T21:05:06.635604+0000","last_became_active":"2024-04-18T21:05:05.637311+0000","last_became_peered":"2024-04-18T21:05:05.637311+0000","last_unstale":"2024-04-18T21:05:06.635604+0000","last_undegraded":"2024-04-18T21:05:06.635604+0000","last_fullsized":"2024-04-18T21:05:06.635604+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:20:45.938503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.634796+0000","last_change":"2024-04-18T21:05:05.638203+0000","last_active":"2024-04-18T21:05:06.634796+0000","last_peered":"2024-04-18T21:05:06.634796+0000","last_clean":"2024-04-18T21:05:06.634796+0000","last_became_active":"2024-04-18T21:05:05.637352+0000","last_became_peered":"2024-04-18T21:05:05.637352+0000","last_unstale":"2024-04-18T21:05:06.634796+0000","last_undegraded":"2024-04-18T21:05:06.634796+0000","last_fullsized":"2024-04-18T21:05:06.634796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.360278+0000","last_change":"2024-04-18T21:05:05.661613+0000","last_active":"2024-04-18T21:05:07.360278+0000","last_peered":"2024-04-18T21:05:07.360278+0000","last_clean":"2024-04-18T21:05:07.360278+0000","last_became_active":"2024-04-18T21:05:05.660496+0000","last_became_peered":"2024-04-18T21:05:05.660496+0000","last_unstale":"2024-04-18T21:05:07.360278+0000","last_undegraded":"2024-04-18T21:05:07.360278+0000","last_fullsized":"2024-04-18T21:05:07.360278+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:31:31.842528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637954+0000","last_change":"2024-04-18T21:05:05.655261+0000","last_active":"2024-04-18T21:05:06.637954+0000","last_peered":"2024-04-18T21:05:06.637954+0000","last_clean":"2024-04-18T21:05:06.637954+0000","last_became_active":"2024-04-18T21:05:05.651388+0000","last_became_peered":"2024-04-18T21:05:05.651388+0000","last_unstale":"2024-04-18T21:05:06.637954+0000","last_undegraded":"2024-04-18T21:05:06.637954+0000","last_fullsized":"2024-04-18T21:05:06.637954+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:53.850184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359241+0000","last_change":"2024-04-18T21:05:05.652710+0000","last_active":"2024-04-18T21:05:07.359241+0000","last_peered":"2024-04-18T21:05:07.359241+0000","last_clean":"2024-04-18T21:05:07.359241+0000","last_became_active":"2024-04-18T21:05:05.651929+0000","last_became_peered":"2024-04-18T21:05:05.651929+0000","last_unstale":"2024-04-18T21:05:07.359241+0000","last_undegraded":"2024-04-18T21:05:07.359241+0000","last_fullsized":"2024-04-18T21:05:07.359241+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:12.944469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636438+0000","last_change":"2024-04-18T21:05:05.638338+0000","last_active":"2024-04-18T21:05:06.636438+0000","last_peered":"2024-04-18T21:05:06.636438+0000","last_clean":"2024-04-18T21:05:06.636438+0000","last_became_active":"2024-04-18T21:05:05.637567+0000","last_became_peered":"2024-04-18T21:05:05.637567+0000","last_unstale":"2024-04-18T21:05:06.636438+0000","last_undegraded":"2024-04-18T21:05:06.636438+0000","last_fullsized":"2024-04-18T21:05:06.636438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637117+0000","last_change":"2024-04-18T21:05:05.643606+0000","last_active":"2024-04-18T21:05:06.637117+0000","last_peered":"2024-04-18T21:05:06.637117+0000","last_clean":"2024-04-18T21:05:06.637117+0000","last_became_active":"2024-04-18T21:05:05.642991+0000","last_became_peered":"2024-04-18T21:05:05.642991+0000","last_unstale":"2024-04-18T21:05:06.637117+0000","last_undegraded":"2024-04-18T21:05:06.637117+0000","last_fullsized":"2024-04-18T21:05:06.637117+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:01.841786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636035+0000","last_change":"2024-04-18T21:05:05.650896+0000","last_active":"2024-04-18T21:05:06.636035+0000","last_peered":"2024-04-18T21:05:06.636035+0000","last_clean":"2024-04-18T21:05:06.636035+0000","last_became_active":"2024-04-18T21:05:05.650083+0000","last_became_peered":"2024-04-18T21:05:05.650083+0000","last_unstale":"2024-04-18T21:05:06.636035+0000","last_undegraded":"2024-04-18T21:05:06.636035+0000","last_fullsized":"2024-04-18T21:05:06.636035+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:43:55.788425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.357454+0000","last_change":"2024-04-18T21:05:05.640362+0000","last_active":"2024-04-18T21:05:07.357454+0000","last_peered":"2024-04-18T21:05:07.357454+0000","last_clean":"2024-04-18T21:05:07.357454+0000","last_became_active":"2024-04-18T21:05:05.635643+0000","last_became_peered":"2024-04-18T21:05:05.635643+0000","last_unstale":"2024-04-18T21:05:07.357454+0000","last_undegraded":"2024-04-18T21:05:07.357454+0000","last_fullsized":"2024-04-18T21:05:07.357454+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:43:55.788425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635029+0000","last_change":"2024-04-18T21:05:05.642755+0000","last_active":"2024-04-18T21:05:06.635029+0000","last_peered":"2024-04-18T21:05:06.635029+0000","last_clean":"2024-04-18T21:05:06.635029+0000","last_became_active":"2024-04-18T21:05:05.642150+0000","last_became_peered":"2024-04-18T21:05:05.642150+0000","last_unstale":"2024-04-18T21:05:06.635029+0000","last_undegraded":"2024-04-18T21:05:06.635029+0000","last_fullsized":"2024-04-18T21:05:06.635029+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:29:22.647425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637381+0000","last_change":"2024-04-18T21:05:05.653741+0000","last_active":"2024-04-18T21:05:06.637381+0000","last_peered":"2024-04-18T21:05:06.637381+0000","last_clean":"2024-04-18T21:05:06.637381+0000","last_became_active":"2024-04-18T21:05:05.650174+0000","last_became_peered":"2024-04-18T21:05:05.650174+0000","last_unstale":"2024-04-18T21:05:06.637381+0000","last_undegraded":"2024-04-18T21:05:06.637381+0000","last_fullsized":"2024-04-18T21:05:06.637381+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:04.350492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.360000+0000","last_change":"2024-04-18T21:05:05.649581+0000","last_active":"2024-04-18T21:05:07.360000+0000","last_peered":"2024-04-18T21:05:07.360000+0000","last_clean":"2024-04-18T21:05:07.360000+0000","last_became_active":"2024-04-18T21:05:05.648233+0000","last_became_peered":"2024-04-18T21:05:05.648233+0000","last_unstale":"2024-04-18T21:05:07.360000+0000","last_undegraded":"2024-04-18T21:05:07.360000+0000","last_fullsized":"2024-04-18T21:05:07.360000+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637099+0000","last_change":"2024-04-18T21:05:05.646926+0000","last_active":"2024-04-18T21:05:06.637099+0000","last_peered":"2024-04-18T21:05:06.637099+0000","last_clean":"2024-04-18T21:05:06.637099+0000","last_became_active":"2024-04-18T21:05:05.644942+0000","last_became_peered":"2024-04-18T21:05:05.644942+0000","last_unstale":"2024-04-18T21:05:06.637099+0000","last_undegraded":"2024-04-18T21:05:06.637099+0000","last_fullsized":"2024-04-18T21:05:06.637099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:53.850184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637629+0000","last_change":"2024-04-18T21:05:05.656314+0000","last_active":"2024-04-18T21:05:06.637629+0000","last_peered":"2024-04-18T21:05:06.637629+0000","last_clean":"2024-04-18T21:05:06.637629+0000","last_became_active":"2024-04-18T21:05:05.655364+0000","last_became_peered":"2024-04-18T21:05:05.655364+0000","last_unstale":"2024-04-18T21:05:06.637629+0000","last_undegraded":"2024-04-18T21:05:06.637629+0000","last_fullsized":"2024-04-18T21:05:06.637629+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:27:17.530889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358862+0000","last_change":"2024-04-18T21:05:05.653532+0000","last_active":"2024-04-18T21:05:07.358862+0000","last_peered":"2024-04-18T21:05:07.358862+0000","last_clean":"2024-04-18T21:05:07.358862+0000","last_became_active":"2024-04-18T21:05:05.652950+0000","last_became_peered":"2024-04-18T21:05:05.652950+0000","last_unstale":"2024-04-18T21:05:07.358862+0000","last_undegraded":"2024-04-18T21:05:07.358862+0000","last_fullsized":"2024-04-18T21:05:07.358862+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:51.225379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636535+0000","last_change":"2024-04-18T21:05:05.648084+0000","last_active":"2024-04-18T21:05:06.636535+0000","last_peered":"2024-04-18T21:05:06.636535+0000","last_clean":"2024-04-18T21:05:06.636535+0000","last_became_active":"2024-04-18T21:05:05.645340+0000","last_became_peered":"2024-04-18T21:05:05.645340+0000","last_unstale":"2024-04-18T21:05:06.636535+0000","last_undegraded":"2024-04-18T21:05:06.636535+0000","last_fullsized":"2024-04-18T21:05:06.636535+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:34:31.132458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.357930+0000","last_change":"2024-04-18T21:05:05.655034+0000","last_active":"2024-04-18T21:05:07.357930+0000","last_peered":"2024-04-18T21:05:07.357930+0000","last_clean":"2024-04-18T21:05:07.357930+0000","last_became_active":"2024-04-18T21:05:05.654517+0000","last_became_peered":"2024-04-18T21:05:05.654517+0000","last_unstale":"2024-04-18T21:05:07.357930+0000","last_undegraded":"2024-04-18T21:05:07.357930+0000","last_fullsized":"2024-04-18T21:05:07.357930+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:34:38.427319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635266+0000","last_change":"2024-04-18T21:05:05.626677+0000","last_active":"2024-04-18T21:05:06.635266+0000","last_peered":"2024-04-18T21:05:06.635266+0000","last_clean":"2024-04-18T21:05:06.635266+0000","last_became_active":"2024-04-18T21:05:05.624250+0000","last_became_peered":"2024-04-18T21:05:05.624250+0000","last_unstale":"2024-04-18T21:05:06.635266+0000","last_undegraded":"2024-04-18T21:05:06.635266+0000","last_fullsized":"2024-04-18T21:05:06.635266+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:51.225379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637347+0000","last_change":"2024-04-18T21:05:05.649918+0000","last_active":"2024-04-18T21:05:06.637347+0000","last_peered":"2024-04-18T21:05:06.637347+0000","last_clean":"2024-04-18T21:05:06.637347+0000","last_became_active":"2024-04-18T21:05:05.647147+0000","last_became_peered":"2024-04-18T21:05:05.647147+0000","last_unstale":"2024-04-18T21:05:06.637347+0000","last_undegraded":"2024-04-18T21:05:06.637347+0000","last_fullsized":"2024-04-18T21:05:06.637347+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:51:28.440070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637900+0000","last_change":"2024-04-18T21:05:04.632748+0000","last_active":"2024-04-18T21:05:06.637900+0000","last_peered":"2024-04-18T21:05:06.637900+0000","last_clean":"2024-04-18T21:05:06.637900+0000","last_became_active":"2024-04-18T21:05:04.628407+0000","last_became_peered":"2024-04-18T21:05:04.628407+0000","last_unstale":"2024-04-18T21:05:06.637900+0000","last_undegraded":"2024-04-18T21:05:06.637900+0000","last_fullsized":"2024-04-18T21:05:06.637900+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:42:45.392908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637688+0000","last_change":"2024-04-18T21:05:05.649199+0000","last_active":"2024-04-18T21:05:06.637688+0000","last_peered":"2024-04-18T21:05:06.637688+0000","last_clean":"2024-04-18T21:05:06.637688+0000","last_became_active":"2024-04-18T21:05:05.646898+0000","last_became_peered":"2024-04-18T21:05:05.646898+0000","last_unstale":"2024-04-18T21:05:06.637688+0000","last_undegraded":"2024-04-18T21:05:06.637688+0000","last_fullsized":"2024-04-18T21:05:06.637688+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:31:31.842528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358409+0000","last_change":"2024-04-18T21:05:04.638017+0000","last_active":"2024-04-18T21:05:07.358409+0000","last_peered":"2024-04-18T21:05:07.358409+0000","last_clean":"2024-04-18T21:05:07.358409+0000","last_became_active":"2024-04-18T21:05:04.637287+0000","last_became_peered":"2024-04-18T21:05:04.637287+0000","last_unstale":"2024-04-18T21:05:07.358409+0000","last_undegraded":"2024-04-18T21:05:07.358409+0000","last_fullsized":"2024-04-18T21:05:07.358409+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:25.891472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.360516+0000","last_change":"2024-04-18T21:05:05.650757+0000","last_active":"2024-04-18T21:05:07.360516+0000","last_peered":"2024-04-18T21:05:07.360516+0000","last_clean":"2024-04-18T21:05:07.360516+0000","last_became_active":"2024-04-18T21:05:05.650143+0000","last_became_peered":"2024-04-18T21:05:05.650143+0000","last_unstale":"2024-04-18T21:05:07.360516+0000","last_undegraded":"2024-04-18T21:05:07.360516+0000","last_fullsized":"2024-04-18T21:05:07.360516+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:14:51.873741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635796+0000","last_change":"2024-04-18T21:05:04.628489+0000","last_active":"2024-04-18T21:05:06.635796+0000","last_peered":"2024-04-18T21:05:06.635796+0000","last_clean":"2024-04-18T21:05:06.635796+0000","last_became_active":"2024-04-18T21:05:04.627279+0000","last_became_peered":"2024-04-18T21:05:04.627279+0000","last_unstale":"2024-04-18T21:05:06.635796+0000","last_undegraded":"2024-04-18T21:05:06.635796+0000","last_fullsized":"2024-04-18T21:05:06.635796+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:43:23.420744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359664+0000","last_change":"2024-04-18T21:05:05.649347+0000","last_active":"2024-04-18T21:05:07.359664+0000","last_peered":"2024-04-18T21:05:07.359664+0000","last_clean":"2024-04-18T21:05:07.359664+0000","last_became_active":"2024-04-18T21:05:05.648144+0000","last_became_peered":"2024-04-18T21:05:05.648144+0000","last_unstale":"2024-04-18T21:05:07.359664+0000","last_undegraded":"2024-04-18T21:05:07.359664+0000","last_fullsized":"2024-04-18T21:05:07.359664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:51:28.440070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":22,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635267+0000","last_change":"2024-04-18T21:05:04.624089+0000","last_active":"2024-04-18T21:05:06.635267+0000","last_peered":"2024-04-18T21:05:06.635267+0000","last_clean":"2024-04-18T21:05:06.635267+0000","last_became_active":"2024-04-18T21:05:04.623238+0000","last_became_peered":"2024-04-18T21:05:04.623238+0000","last_unstale":"2024-04-18T21:05:06.635267+0000","last_undegraded":"2024-04-18T21:05:06.635267+0000","last_fullsized":"2024-04-18T21:05:06.635267+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:44:19.076499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637569+0000","last_change":"2024-04-18T21:05:04.633907+0000","last_active":"2024-04-18T21:05:06.637569+0000","last_peered":"2024-04-18T21:05:06.637569+0000","last_clean":"2024-04-18T21:05:06.637569+0000","last_became_active":"2024-04-18T21:05:04.630308+0000","last_became_peered":"2024-04-18T21:05:04.630308+0000","last_unstale":"2024-04-18T21:05:06.637569+0000","last_undegraded":"2024-04-18T21:05:06.637569+0000","last_fullsized":"2024-04-18T21:05:06.637569+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:55:46.219812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635046+0000","last_change":"2024-04-18T21:05:05.658572+0000","last_active":"2024-04-18T21:05:06.635046+0000","last_peered":"2024-04-18T21:05:06.635046+0000","last_clean":"2024-04-18T21:05:06.635046+0000","last_became_active":"2024-04-18T21:05:05.657842+0000","last_became_peered":"2024-04-18T21:05:05.657842+0000","last_unstale":"2024-04-18T21:05:06.635046+0000","last_undegraded":"2024-04-18T21:05:06.635046+0000","last_fullsized":"2024-04-18T21:05:06.635046+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:26:38.636530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.638161+0000","last_change":"2024-04-18T21:05:04.628541+0000","last_active":"2024-04-18T21:05:06.638161+0000","last_peered":"2024-04-18T21:05:06.638161+0000","last_clean":"2024-04-18T21:05:06.638161+0000","last_became_active":"2024-04-18T21:05:04.627407+0000","last_became_peered":"2024-04-18T21:05:04.627407+0000","last_unstale":"2024-04-18T21:05:06.638161+0000","last_undegraded":"2024-04-18T21:05:06.638161+0000","last_fullsized":"2024-04-18T21:05:06.638161+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:55:48.643174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635639+0000","last_change":"2024-04-18T21:05:05.651649+0000","last_active":"2024-04-18T21:05:06.635639+0000","last_peered":"2024-04-18T21:05:06.635639+0000","last_clean":"2024-04-18T21:05:06.635639+0000","last_became_active":"2024-04-18T21:05:05.646809+0000","last_became_peered":"2024-04-18T21:05:05.646809+0000","last_unstale":"2024-04-18T21:05:06.635639+0000","last_undegraded":"2024-04-18T21:05:06.635639+0000","last_fullsized":"2024-04-18T21:05:06.635639+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:23.698827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637684+0000","last_change":"2024-04-18T21:05:04.634055+0000","last_active":"2024-04-18T21:05:06.637684+0000","last_peered":"2024-04-18T21:05:06.637684+0000","last_clean":"2024-04-18T21:05:06.637684+0000","last_became_active":"2024-04-18T21:05:04.630736+0000","last_became_peered":"2024-04-18T21:05:04.630736+0000","last_unstale":"2024-04-18T21:05:06.637684+0000","last_undegraded":"2024-04-18T21:05:06.637684+0000","last_fullsized":"2024-04-18T21:05:06.637684+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:06:44.001512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636585+0000","last_change":"2024-04-18T21:05:05.628869+0000","last_active":"2024-04-18T21:05:06.636585+0000","last_peered":"2024-04-18T21:05:06.636585+0000","last_clean":"2024-04-18T21:05:06.636585+0000","last_became_active":"2024-04-18T21:05:05.627071+0000","last_became_peered":"2024-04-18T21:05:05.627071+0000","last_unstale":"2024-04-18T21:05:06.636585+0000","last_undegraded":"2024-04-18T21:05:06.636585+0000","last_fullsized":"2024-04-18T21:05:06.636585+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:31:31.842528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.638123+0000","last_change":"2024-04-18T21:05:04.625520+0000","last_active":"2024-04-18T21:05:06.638123+0000","last_peered":"2024-04-18T21:05:06.638123+0000","last_clean":"2024-04-18T21:05:06.638123+0000","last_became_active":"2024-04-18T21:05:04.624656+0000","last_became_peered":"2024-04-18T21:05:04.624656+0000","last_unstale":"2024-04-18T21:05:06.638123+0000","last_undegraded":"2024-04-18T21:05:06.638123+0000","last_fullsized":"2024-04-18T21:05:06.638123+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:56:05.795125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358238+0000","last_change":"2024-04-18T21:05:05.649406+0000","last_active":"2024-04-18T21:05:07.358238+0000","last_peered":"2024-04-18T21:05:07.358238+0000","last_clean":"2024-04-18T21:05:07.358238+0000","last_became_active":"2024-04-18T21:05:05.648380+0000","last_became_peered":"2024-04-18T21:05:05.648380+0000","last_unstale":"2024-04-18T21:05:07.358238+0000","last_undegraded":"2024-04-18T21:05:07.358238+0000","last_fullsized":"2024-04-18T21:05:07.358238+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359521+0000","last_change":"2024-04-18T21:05:04.640216+0000","last_active":"2024-04-18T21:05:07.359521+0000","last_peered":"2024-04-18T21:05:07.359521+0000","last_clean":"2024-04-18T21:05:07.359521+0000","last_became_active":"2024-04-18T21:05:04.639349+0000","last_became_peered":"2024-04-18T21:05:04.639349+0000","last_unstale":"2024-04-18T21:05:07.359521+0000","last_undegraded":"2024-04-18T21:05:07.359521+0000","last_fullsized":"2024-04-18T21:05:07.359521+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:09:18.466987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637709+0000","last_change":"2024-04-18T21:05:05.628850+0000","last_active":"2024-04-18T21:05:06.637709+0000","last_peered":"2024-04-18T21:05:06.637709+0000","last_clean":"2024-04-18T21:05:06.637709+0000","last_became_active":"2024-04-18T21:05:05.627521+0000","last_became_peered":"2024-04-18T21:05:05.627521+0000","last_unstale":"2024-04-18T21:05:06.637709+0000","last_undegraded":"2024-04-18T21:05:06.637709+0000","last_fullsized":"2024-04-18T21:05:06.637709+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:14:37.912032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636946+0000","last_change":"2024-04-18T21:05:04.634674+0000","last_active":"2024-04-18T21:05:06.636946+0000","last_peered":"2024-04-18T21:05:06.636946+0000","last_clean":"2024-04-18T21:05:06.636946+0000","last_became_active":"2024-04-18T21:05:04.632284+0000","last_became_peered":"2024-04-18T21:05:04.632284+0000","last_unstale":"2024-04-18T21:05:06.636946+0000","last_undegraded":"2024-04-18T21:05:06.636946+0000","last_fullsized":"2024-04-18T21:05:06.636946+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:09:18.466987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637414+0000","last_change":"2024-04-18T21:05:05.647377+0000","last_active":"2024-04-18T21:05:06.637414+0000","last_peered":"2024-04-18T21:05:06.637414+0000","last_clean":"2024-04-18T21:05:06.637414+0000","last_became_active":"2024-04-18T21:05:05.645067+0000","last_became_peered":"2024-04-18T21:05:05.645067+0000","last_unstale":"2024-04-18T21:05:06.637414+0000","last_undegraded":"2024-04-18T21:05:06.637414+0000","last_fullsized":"2024-04-18T21:05:06.637414+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:29:30.243751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636012+0000","last_change":"2024-04-18T21:05:04.627578+0000","last_active":"2024-04-18T21:05:06.636012+0000","last_peered":"2024-04-18T21:05:06.636012+0000","last_clean":"2024-04-18T21:05:06.636012+0000","last_became_active":"2024-04-18T21:05:04.626786+0000","last_became_peered":"2024-04-18T21:05:04.626786+0000","last_unstale":"2024-04-18T21:05:06.636012+0000","last_undegraded":"2024-04-18T21:05:06.636012+0000","last_fullsized":"2024-04-18T21:05:06.636012+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:55:59.563512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637217+0000","last_change":"2024-04-18T21:05:05.640817+0000","last_active":"2024-04-18T21:05:06.637217+0000","last_peered":"2024-04-18T21:05:06.637217+0000","last_clean":"2024-04-18T21:05:06.637217+0000","last_became_active":"2024-04-18T21:05:05.635526+0000","last_became_peered":"2024-04-18T21:05:05.635526+0000","last_unstale":"2024-04-18T21:05:06.637217+0000","last_undegraded":"2024-04-18T21:05:06.637217+0000","last_fullsized":"2024-04-18T21:05:06.637217+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:44:29.823511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635339+0000","last_change":"2024-04-18T21:05:04.636499+0000","last_active":"2024-04-18T21:05:06.635339+0000","last_peered":"2024-04-18T21:05:06.635339+0000","last_clean":"2024-04-18T21:05:06.635339+0000","last_became_active":"2024-04-18T21:05:04.635830+0000","last_became_peered":"2024-04-18T21:05:04.635830+0000","last_unstale":"2024-04-18T21:05:06.635339+0000","last_undegraded":"2024-04-18T21:05:06.635339+0000","last_fullsized":"2024-04-18T21:05:06.635339+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:26:30.565175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359678+0000","last_change":"2024-04-18T21:05:05.660974+0000","last_active":"2024-04-18T21:05:07.359678+0000","last_peered":"2024-04-18T21:05:07.359678+0000","last_clean":"2024-04-18T21:05:07.359678+0000","last_became_active":"2024-04-18T21:05:05.659287+0000","last_became_peered":"2024-04-18T21:05:05.659287+0000","last_unstale":"2024-04-18T21:05:07.359678+0000","last_undegraded":"2024-04-18T21:05:07.359678+0000","last_fullsized":"2024-04-18T21:05:07.359678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:50:40.920146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":222,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636126+0000","last_change":"2024-04-18T21:04:54.511605+0000","last_active":"2024-04-18T21:05:06.636126+0000","last_peered":"2024-04-18T21:05:06.636126+0000","last_clean":"2024-04-18T21:05:06.636126+0000","last_became_active":"2024-04-18T21:04:54.510791+0000","last_became_peered":"2024-04-18T21:04:54.510791+0000","last_unstale":"2024-04-18T21:05:06.636126+0000","last_undegraded":"2024-04-18T21:05:06.636126+0000","last_fullsized":"2024-04-18T21:05:06.636126+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_clean_scrub_stamp":"2024-04-18T21:04:53.494814+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:46.262250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.638030+0000","last_change":"2024-04-18T21:05:00.576671+0000","last_active":"2024-04-18T21:05:06.638030+0000","last_peered":"2024-04-18T21:05:06.638030+0000","last_clean":"2024-04-18T21:05:06.638030+0000","last_became_active":"2024-04-18T21:05:00.575933+0000","last_became_peered":"2024-04-18T21:05:00.575933+0000","last_unstale":"2024-04-18T21:05:06.638030+0000","last_undegraded":"2024-04-18T21:05:06.638030+0000","last_fullsized":"2024-04-18T21:05:06.638030+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:14:59.207959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358678+0000","last_change":"2024-04-18T21:05:04.639528+0000","last_active":"2024-04-18T21:05:07.358678+0000","last_peered":"2024-04-18T21:05:07.358678+0000","last_clean":"2024-04-18T21:05:07.358678+0000","last_became_active":"2024-04-18T21:05:04.638517+0000","last_became_peered":"2024-04-18T21:05:04.638517+0000","last_unstale":"2024-04-18T21:05:07.358678+0000","last_undegraded":"2024-04-18T21:05:07.358678+0000","last_fullsized":"2024-04-18T21:05:07.358678+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:55:46.219812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637482+0000","last_change":"2024-04-18T21:05:05.647623+0000","last_active":"2024-04-18T21:05:06.637482+0000","last_peered":"2024-04-18T21:05:06.637482+0000","last_clean":"2024-04-18T21:05:06.637482+0000","last_became_active":"2024-04-18T21:05:05.645640+0000","last_became_peered":"2024-04-18T21:05:05.645640+0000","last_unstale":"2024-04-18T21:05:06.637482+0000","last_undegraded":"2024-04-18T21:05:06.637482+0000","last_fullsized":"2024-04-18T21:05:06.637482+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:59.950421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635615+0000","last_change":"2024-04-18T21:05:00.571960+0000","last_active":"2024-04-18T21:05:06.635615+0000","last_peered":"2024-04-18T21:05:06.635615+0000","last_clean":"2024-04-18T21:05:06.635615+0000","last_became_active":"2024-04-18T21:05:00.571301+0000","last_became_peered":"2024-04-18T21:05:00.571301+0000","last_unstale":"2024-04-18T21:05:06.635615+0000","last_undegraded":"2024-04-18T21:05:06.635615+0000","last_fullsized":"2024-04-18T21:05:06.635615+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:31:59.262440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358645+0000","last_change":"2024-04-18T21:05:04.638026+0000","last_active":"2024-04-18T21:05:07.358645+0000","last_peered":"2024-04-18T21:05:07.358645+0000","last_clean":"2024-04-18T21:05:07.358645+0000","last_became_active":"2024-04-18T21:05:04.637160+0000","last_became_peered":"2024-04-18T21:05:04.637160+0000","last_unstale":"2024-04-18T21:05:07.358645+0000","last_undegraded":"2024-04-18T21:05:07.358645+0000","last_fullsized":"2024-04-18T21:05:07.358645+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:33:48.703994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.638058+0000","last_change":"2024-04-18T21:05:05.654121+0000","last_active":"2024-04-18T21:05:06.638058+0000","last_peered":"2024-04-18T21:05:06.638058+0000","last_clean":"2024-04-18T21:05:06.638058+0000","last_became_active":"2024-04-18T21:05:05.651310+0000","last_became_peered":"2024-04-18T21:05:05.651310+0000","last_unstale":"2024-04-18T21:05:06.638058+0000","last_undegraded":"2024-04-18T21:05:06.638058+0000","last_fullsized":"2024-04-18T21:05:06.638058+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:01.841786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359064+0000","last_change":"2024-04-18T21:05:00.578604+0000","last_active":"2024-04-18T21:05:07.359064+0000","last_peered":"2024-04-18T21:05:07.359064+0000","last_clean":"2024-04-18T21:05:07.359064+0000","last_became_active":"2024-04-18T21:05:00.577988+0000","last_became_peered":"2024-04-18T21:05:00.577988+0000","last_unstale":"2024-04-18T21:05:07.359064+0000","last_undegraded":"2024-04-18T21:05:07.359064+0000","last_fullsized":"2024-04-18T21:05:07.359064+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:54:54.201759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635569+0000","last_change":"2024-04-18T21:05:04.627627+0000","last_active":"2024-04-18T21:05:06.635569+0000","last_peered":"2024-04-18T21:05:06.635569+0000","last_clean":"2024-04-18T21:05:06.635569+0000","last_became_active":"2024-04-18T21:05:04.626850+0000","last_became_peered":"2024-04-18T21:05:04.626850+0000","last_unstale":"2024-04-18T21:05:06.635569+0000","last_undegraded":"2024-04-18T21:05:06.635569+0000","last_fullsized":"2024-04-18T21:05:06.635569+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:43:31.453080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359914+0000","last_change":"2024-04-18T21:05:05.661488+0000","last_active":"2024-04-18T21:05:07.359914+0000","last_peered":"2024-04-18T21:05:07.359914+0000","last_clean":"2024-04-18T21:05:07.359914+0000","last_became_active":"2024-04-18T21:05:05.660283+0000","last_became_peered":"2024-04-18T21:05:05.660283+0000","last_unstale":"2024-04-18T21:05:07.359914+0000","last_undegraded":"2024-04-18T21:05:07.359914+0000","last_fullsized":"2024-04-18T21:05:07.359914+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:04.350492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637285+0000","last_change":"2024-04-18T21:05:00.576606+0000","last_active":"2024-04-18T21:05:06.637285+0000","last_peered":"2024-04-18T21:05:06.637285+0000","last_clean":"2024-04-18T21:05:06.637285+0000","last_became_active":"2024-04-18T21:05:00.575951+0000","last_became_peered":"2024-04-18T21:05:00.575951+0000","last_unstale":"2024-04-18T21:05:06.637285+0000","last_undegraded":"2024-04-18T21:05:06.637285+0000","last_fullsized":"2024-04-18T21:05:06.637285+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:32:17.612481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637939+0000","last_change":"2024-04-18T21:05:04.627296+0000","last_active":"2024-04-18T21:05:06.637939+0000","last_peered":"2024-04-18T21:05:06.637939+0000","last_clean":"2024-04-18T21:05:06.637939+0000","last_became_active":"2024-04-18T21:05:04.626801+0000","last_became_peered":"2024-04-18T21:05:04.626801+0000","last_unstale":"2024-04-18T21:05:06.637939+0000","last_undegraded":"2024-04-18T21:05:06.637939+0000","last_fullsized":"2024-04-18T21:05:06.637939+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:46:36.285416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359434+0000","last_change":"2024-04-18T21:05:05.655152+0000","last_active":"2024-04-18T21:05:07.359434+0000","last_peered":"2024-04-18T21:05:07.359434+0000","last_clean":"2024-04-18T21:05:07.359434+0000","last_became_active":"2024-04-18T21:05:05.654506+0000","last_became_peered":"2024-04-18T21:05:05.654506+0000","last_unstale":"2024-04-18T21:05:07.359434+0000","last_undegraded":"2024-04-18T21:05:07.359434+0000","last_fullsized":"2024-04-18T21:05:07.359434+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:32:23.929877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637718+0000","last_change":"2024-04-18T21:05:04.628916+0000","last_active":"2024-04-18T21:05:06.637718+0000","last_peered":"2024-04-18T21:05:06.637718+0000","last_clean":"2024-04-18T21:05:06.637718+0000","last_became_active":"2024-04-18T21:05:04.628245+0000","last_became_peered":"2024-04-18T21:05:04.628245+0000","last_unstale":"2024-04-18T21:05:06.637718+0000","last_undegraded":"2024-04-18T21:05:06.637718+0000","last_fullsized":"2024-04-18T21:05:06.637718+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:34:58.562540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359757+0000","last_change":"2024-04-18T21:05:00.578563+0000","last_active":"2024-04-18T21:05:07.359757+0000","last_peered":"2024-04-18T21:05:07.359757+0000","last_clean":"2024-04-18T21:05:07.359757+0000","last_became_active":"2024-04-18T21:05:00.577960+0000","last_became_peered":"2024-04-18T21:05:00.577960+0000","last_unstale":"2024-04-18T21:05:07.359757+0000","last_undegraded":"2024-04-18T21:05:07.359757+0000","last_fullsized":"2024-04-18T21:05:07.359757+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:31:59.262440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636313+0000","last_change":"2024-04-18T21:05:05.646076+0000","last_active":"2024-04-18T21:05:06.636313+0000","last_peered":"2024-04-18T21:05:06.636313+0000","last_clean":"2024-04-18T21:05:06.636313+0000","last_became_active":"2024-04-18T21:05:05.645104+0000","last_became_peered":"2024-04-18T21:05:05.645104+0000","last_unstale":"2024-04-18T21:05:06.636313+0000","last_undegraded":"2024-04-18T21:05:06.636313+0000","last_fullsized":"2024-04-18T21:05:06.636313+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:34:38.427319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359695+0000","last_change":"2024-04-18T21:05:04.639700+0000","last_active":"2024-04-18T21:05:07.359695+0000","last_peered":"2024-04-18T21:05:07.359695+0000","last_clean":"2024-04-18T21:05:07.359695+0000","last_became_active":"2024-04-18T21:05:04.638928+0000","last_became_peered":"2024-04-18T21:05:04.638928+0000","last_unstale":"2024-04-18T21:05:07.359695+0000","last_undegraded":"2024-04-18T21:05:07.359695+0000","last_fullsized":"2024-04-18T21:05:07.359695+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:00:08.877854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.638177+0000","last_change":"2024-04-18T21:05:00.576907+0000","last_active":"2024-04-18T21:05:06.638177+0000","last_peered":"2024-04-18T21:05:06.638177+0000","last_clean":"2024-04-18T21:05:06.638177+0000","last_became_active":"2024-04-18T21:05:00.576152+0000","last_became_peered":"2024-04-18T21:05:00.576152+0000","last_unstale":"2024-04-18T21:05:06.638177+0000","last_undegraded":"2024-04-18T21:05:06.638177+0000","last_fullsized":"2024-04-18T21:05:06.638177+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:25:07.270023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636117+0000","last_change":"2024-04-18T21:05:05.646026+0000","last_active":"2024-04-18T21:05:06.636117+0000","last_peered":"2024-04-18T21:05:06.636117+0000","last_clean":"2024-04-18T21:05:06.636117+0000","last_became_active":"2024-04-18T21:05:05.645192+0000","last_became_peered":"2024-04-18T21:05:05.645192+0000","last_unstale":"2024-04-18T21:05:06.636117+0000","last_undegraded":"2024-04-18T21:05:06.636117+0000","last_fullsized":"2024-04-18T21:05:06.636117+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:05:46.009381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.360443+0000","last_change":"2024-04-18T21:05:04.640732+0000","last_active":"2024-04-18T21:05:07.360443+0000","last_peered":"2024-04-18T21:05:07.360443+0000","last_clean":"2024-04-18T21:05:07.360443+0000","last_became_active":"2024-04-18T21:05:04.638505+0000","last_became_peered":"2024-04-18T21:05:04.638505+0000","last_unstale":"2024-04-18T21:05:07.360443+0000","last_undegraded":"2024-04-18T21:05:07.360443+0000","last_fullsized":"2024-04-18T21:05:07.360443+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:34:58.562540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.360549+0000","last_change":"2024-04-18T21:05:00.579869+0000","last_active":"2024-04-18T21:05:07.360549+0000","last_peered":"2024-04-18T21:05:07.360549+0000","last_clean":"2024-04-18T21:05:07.360549+0000","last_became_active":"2024-04-18T21:05:00.579351+0000","last_became_peered":"2024-04-18T21:05:00.579351+0000","last_unstale":"2024-04-18T21:05:07.360549+0000","last_undegraded":"2024-04-18T21:05:07.360549+0000","last_fullsized":"2024-04-18T21:05:07.360549+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:15:02.061128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.357811+0000","last_change":"2024-04-18T21:05:05.642730+0000","last_active":"2024-04-18T21:05:07.357811+0000","last_peered":"2024-04-18T21:05:07.357811+0000","last_clean":"2024-04-18T21:05:07.357811+0000","last_became_active":"2024-04-18T21:05:05.641890+0000","last_became_peered":"2024-04-18T21:05:05.641890+0000","last_unstale":"2024-04-18T21:05:07.357811+0000","last_undegraded":"2024-04-18T21:05:07.357811+0000","last_fullsized":"2024-04-18T21:05:07.357811+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:05:46.009381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.583432+0000","last_change":"2024-04-18T21:05:04.639898+0000","last_active":"2024-04-18T21:05:07.583432+0000","last_peered":"2024-04-18T21:05:07.583432+0000","last_clean":"2024-04-18T21:05:07.583432+0000","last_became_active":"2024-04-18T21:05:04.639115+0000","last_became_peered":"2024-04-18T21:05:04.639115+0000","last_unstale":"2024-04-18T21:05:07.583432+0000","last_undegraded":"2024-04-18T21:05:07.583432+0000","last_fullsized":"2024-04-18T21:05:07.583432+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:44:19.076499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637757+0000","last_change":"2024-04-18T21:05:00.572414+0000","last_active":"2024-04-18T21:05:06.637757+0000","last_peered":"2024-04-18T21:05:06.637757+0000","last_clean":"2024-04-18T21:05:06.637757+0000","last_became_active":"2024-04-18T21:05:00.571755+0000","last_became_peered":"2024-04-18T21:05:00.571755+0000","last_unstale":"2024-04-18T21:05:06.637757+0000","last_undegraded":"2024-04-18T21:05:06.637757+0000","last_fullsized":"2024-04-18T21:05:06.637757+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:15:02.061128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635489+0000","last_change":"2024-04-18T21:05:05.655898+0000","last_active":"2024-04-18T21:05:06.635489+0000","last_peered":"2024-04-18T21:05:06.635489+0000","last_clean":"2024-04-18T21:05:06.635489+0000","last_became_active":"2024-04-18T21:05:05.654111+0000","last_became_peered":"2024-04-18T21:05:05.654111+0000","last_unstale":"2024-04-18T21:05:06.635489+0000","last_undegraded":"2024-04-18T21:05:06.635489+0000","last_fullsized":"2024-04-18T21:05:06.635489+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:19:38.537080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637592+0000","last_change":"2024-04-18T21:05:05.641373+0000","last_active":"2024-04-18T21:05:06.637592+0000","last_peered":"2024-04-18T21:05:06.637592+0000","last_clean":"2024-04-18T21:05:06.637592+0000","last_became_active":"2024-04-18T21:05:05.634204+0000","last_became_peered":"2024-04-18T21:05:05.634204+0000","last_unstale":"2024-04-18T21:05:06.637592+0000","last_undegraded":"2024-04-18T21:05:06.637592+0000","last_fullsized":"2024-04-18T21:05:06.637592+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:27:35.995004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637977+0000","last_change":"2024-04-18T21:05:04.631271+0000","last_active":"2024-04-18T21:05:06.637977+0000","last_peered":"2024-04-18T21:05:06.637977+0000","last_clean":"2024-04-18T21:05:06.637977+0000","last_became_active":"2024-04-18T21:05:04.630442+0000","last_became_peered":"2024-04-18T21:05:04.630442+0000","last_unstale":"2024-04-18T21:05:06.637977+0000","last_undegraded":"2024-04-18T21:05:06.637977+0000","last_fullsized":"2024-04-18T21:05:06.637977+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:33:48.703994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358112+0000","last_change":"2024-04-18T21:05:05.637894+0000","last_active":"2024-04-18T21:05:07.358112+0000","last_peered":"2024-04-18T21:05:07.358112+0000","last_clean":"2024-04-18T21:05:07.358112+0000","last_became_active":"2024-04-18T21:05:05.636846+0000","last_became_peered":"2024-04-18T21:05:05.636846+0000","last_unstale":"2024-04-18T21:05:07.358112+0000","last_undegraded":"2024-04-18T21:05:07.358112+0000","last_fullsized":"2024-04-18T21:05:07.358112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:34:31.132458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637990+0000","last_change":"2024-04-18T21:05:04.631152+0000","last_active":"2024-04-18T21:05:06.637990+0000","last_peered":"2024-04-18T21:05:06.637990+0000","last_clean":"2024-04-18T21:05:06.637990+0000","last_became_active":"2024-04-18T21:05:04.628900+0000","last_became_peered":"2024-04-18T21:05:04.628900+0000","last_unstale":"2024-04-18T21:05:06.637990+0000","last_undegraded":"2024-04-18T21:05:06.637990+0000","last_fullsized":"2024-04-18T21:05:06.637990+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:40:21.452052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637452+0000","last_change":"2024-04-18T21:05:04.629470+0000","last_active":"2024-04-18T21:05:06.637452+0000","last_peered":"2024-04-18T21:05:06.637452+0000","last_clean":"2024-04-18T21:05:06.637452+0000","last_became_active":"2024-04-18T21:05:04.628286+0000","last_became_peered":"2024-04-18T21:05:04.628286+0000","last_unstale":"2024-04-18T21:05:06.637452+0000","last_undegraded":"2024-04-18T21:05:06.637452+0000","last_fullsized":"2024-04-18T21:05:06.637452+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:00:08.877854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358071+0000","last_change":"2024-04-18T21:05:05.642793+0000","last_active":"2024-04-18T21:05:07.358071+0000","last_peered":"2024-04-18T21:05:07.358071+0000","last_clean":"2024-04-18T21:05:07.358071+0000","last_became_active":"2024-04-18T21:05:05.641983+0000","last_became_peered":"2024-04-18T21:05:05.641983+0000","last_unstale":"2024-04-18T21:05:07.358071+0000","last_undegraded":"2024-04-18T21:05:07.358071+0000","last_fullsized":"2024-04-18T21:05:07.358071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:46:36.339289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.360264+0000","last_change":"2024-04-18T21:05:04.641445+0000","last_active":"2024-04-18T21:05:07.360264+0000","last_peered":"2024-04-18T21:05:07.360264+0000","last_clean":"2024-04-18T21:05:07.360264+0000","last_became_active":"2024-04-18T21:05:04.640682+0000","last_became_peered":"2024-04-18T21:05:04.640682+0000","last_unstale":"2024-04-18T21:05:07.360264+0000","last_undegraded":"2024-04-18T21:05:07.360264+0000","last_fullsized":"2024-04-18T21:05:07.360264+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:46:36.285416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.357743+0000","last_change":"2024-04-18T21:05:05.641561+0000","last_active":"2024-04-18T21:05:07.357743+0000","last_peered":"2024-04-18T21:05:07.357743+0000","last_clean":"2024-04-18T21:05:07.357743+0000","last_became_active":"2024-04-18T21:05:05.640922+0000","last_became_peered":"2024-04-18T21:05:05.640922+0000","last_unstale":"2024-04-18T21:05:07.357743+0000","last_undegraded":"2024-04-18T21:05:07.357743+0000","last_fullsized":"2024-04-18T21:05:07.357743+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:56.408234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637829+0000","last_change":"2024-04-18T21:05:05.651530+0000","last_active":"2024-04-18T21:05:06.637829+0000","last_peered":"2024-04-18T21:05:06.637829+0000","last_clean":"2024-04-18T21:05:06.637829+0000","last_became_active":"2024-04-18T21:05:05.648167+0000","last_became_peered":"2024-04-18T21:05:05.648167+0000","last_unstale":"2024-04-18T21:05:06.637829+0000","last_undegraded":"2024-04-18T21:05:06.637829+0000","last_fullsized":"2024-04-18T21:05:06.637829+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:14:51.873741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358019+0000","last_change":"2024-04-18T21:05:04.637369+0000","last_active":"2024-04-18T21:05:07.358019+0000","last_peered":"2024-04-18T21:05:07.358019+0000","last_clean":"2024-04-18T21:05:07.358019+0000","last_became_active":"2024-04-18T21:05:04.636468+0000","last_became_peered":"2024-04-18T21:05:04.636468+0000","last_unstale":"2024-04-18T21:05:07.358019+0000","last_undegraded":"2024-04-18T21:05:07.358019+0000","last_fullsized":"2024-04-18T21:05:07.358019+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:40:21.452052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.360014+0000","last_change":"2024-04-18T21:05:05.651245+0000","last_active":"2024-04-18T21:05:07.360014+0000","last_peered":"2024-04-18T21:05:07.360014+0000","last_clean":"2024-04-18T21:05:07.360014+0000","last_became_active":"2024-04-18T21:05:05.650463+0000","last_became_peered":"2024-04-18T21:05:05.650463+0000","last_unstale":"2024-04-18T21:05:07.360014+0000","last_undegraded":"2024-04-18T21:05:07.360014+0000","last_fullsized":"2024-04-18T21:05:07.360014+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:27:17.530889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.358504+0000","last_change":"2024-04-18T21:05:04.637597+0000","last_active":"2024-04-18T21:05:07.358504+0000","last_peered":"2024-04-18T21:05:07.358504+0000","last_clean":"2024-04-18T21:05:07.358504+0000","last_became_active":"2024-04-18T21:05:04.636827+0000","last_became_peered":"2024-04-18T21:05:04.636827+0000","last_unstale":"2024-04-18T21:05:07.358504+0000","last_undegraded":"2024-04-18T21:05:07.358504+0000","last_fullsized":"2024-04-18T21:05:07.358504+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:43.511952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636925+0000","last_change":"2024-04-18T21:05:05.658971+0000","last_active":"2024-04-18T21:05:06.636925+0000","last_peered":"2024-04-18T21:05:06.636925+0000","last_clean":"2024-04-18T21:05:06.636925+0000","last_became_active":"2024-04-18T21:05:05.658363+0000","last_became_peered":"2024-04-18T21:05:05.658363+0000","last_unstale":"2024-04-18T21:05:06.636925+0000","last_undegraded":"2024-04-18T21:05:06.636925+0000","last_fullsized":"2024-04-18T21:05:06.636925+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:12.944469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636616+0000","last_change":"2024-04-18T21:05:04.636585+0000","last_active":"2024-04-18T21:05:06.636616+0000","last_peered":"2024-04-18T21:05:06.636616+0000","last_clean":"2024-04-18T21:05:06.636616+0000","last_became_active":"2024-04-18T21:05:04.635670+0000","last_became_peered":"2024-04-18T21:05:04.635670+0000","last_unstale":"2024-04-18T21:05:06.636616+0000","last_undegraded":"2024-04-18T21:05:06.636616+0000","last_fullsized":"2024-04-18T21:05:06.636616+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:34:33.779063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636955+0000","last_change":"2024-04-18T21:05:05.649960+0000","last_active":"2024-04-18T21:05:06.636955+0000","last_peered":"2024-04-18T21:05:06.636955+0000","last_clean":"2024-04-18T21:05:06.636955+0000","last_became_active":"2024-04-18T21:05:05.648528+0000","last_became_peered":"2024-04-18T21:05:05.648528+0000","last_unstale":"2024-04-18T21:05:06.636955+0000","last_undegraded":"2024-04-18T21:05:06.636955+0000","last_fullsized":"2024-04-18T21:05:06.636955+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:20:45.938503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636493+0000","last_change":"2024-04-18T21:05:04.630151+0000","last_active":"2024-04-18T21:05:06.636493+0000","last_peered":"2024-04-18T21:05:06.636493+0000","last_clean":"2024-04-18T21:05:06.636493+0000","last_became_active":"2024-04-18T21:05:04.627968+0000","last_became_peered":"2024-04-18T21:05:04.627968+0000","last_unstale":"2024-04-18T21:05:06.636493+0000","last_undegraded":"2024-04-18T21:05:06.636493+0000","last_fullsized":"2024-04-18T21:05:06.636493+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:00:33.393636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636522+0000","last_change":"2024-04-18T21:05:05.624840+0000","last_active":"2024-04-18T21:05:06.636522+0000","last_peered":"2024-04-18T21:05:06.636522+0000","last_clean":"2024-04-18T21:05:06.636522+0000","last_became_active":"2024-04-18T21:05:05.622950+0000","last_became_peered":"2024-04-18T21:05:05.622950+0000","last_unstale":"2024-04-18T21:05:06.636522+0000","last_undegraded":"2024-04-18T21:05:06.636522+0000","last_fullsized":"2024-04-18T21:05:06.636522+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:27:17.530889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637987+0000","last_change":"2024-04-18T21:05:04.626715+0000","last_active":"2024-04-18T21:05:06.637987+0000","last_peered":"2024-04-18T21:05:06.637987+0000","last_clean":"2024-04-18T21:05:06.637987+0000","last_became_active":"2024-04-18T21:05:04.625270+0000","last_became_peered":"2024-04-18T21:05:04.625270+0000","last_unstale":"2024-04-18T21:05:06.637987+0000","last_undegraded":"2024-04-18T21:05:06.637987+0000","last_fullsized":"2024-04-18T21:05:06.637987+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:43.511952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637167+0000","last_change":"2024-04-18T21:05:05.627962+0000","last_active":"2024-04-18T21:05:06.637167+0000","last_peered":"2024-04-18T21:05:06.637167+0000","last_clean":"2024-04-18T21:05:06.637167+0000","last_became_active":"2024-04-18T21:05:05.626698+0000","last_became_peered":"2024-04-18T21:05:05.626698+0000","last_unstale":"2024-04-18T21:05:06.637167+0000","last_undegraded":"2024-04-18T21:05:06.637167+0000","last_fullsized":"2024-04-18T21:05:06.637167+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:48:48.973087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.637569+0000","last_change":"2024-04-18T21:05:04.632776+0000","last_active":"2024-04-18T21:05:06.637569+0000","last_peered":"2024-04-18T21:05:06.637569+0000","last_clean":"2024-04-18T21:05:06.637569+0000","last_became_active":"2024-04-18T21:05:04.630142+0000","last_became_peered":"2024-04-18T21:05:04.630142+0000","last_unstale":"2024-04-18T21:05:06.637569+0000","last_undegraded":"2024-04-18T21:05:06.637569+0000","last_fullsized":"2024-04-18T21:05:06.637569+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:19:36.721897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.636797+0000","last_change":"2024-04-18T21:05:05.653025+0000","last_active":"2024-04-18T21:05:06.636797+0000","last_peered":"2024-04-18T21:05:06.636797+0000","last_clean":"2024-04-18T21:05:06.636797+0000","last_became_active":"2024-04-18T21:05:05.645039+0000","last_became_peered":"2024-04-18T21:05:05.645039+0000","last_unstale":"2024-04-18T21:05:06.636797+0000","last_undegraded":"2024-04-18T21:05:06.636797+0000","last_fullsized":"2024-04-18T21:05:06.636797+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.360315+0000","last_change":"2024-04-18T21:05:04.640134+0000","last_active":"2024-04-18T21:05:07.360315+0000","last_peered":"2024-04-18T21:05:07.360315+0000","last_clean":"2024-04-18T21:05:07.360315+0000","last_became_active":"2024-04-18T21:05:04.638597+0000","last_became_peered":"2024-04-18T21:05:04.638597+0000","last_unstale":"2024-04-18T21:05:07.360315+0000","last_undegraded":"2024-04-18T21:05:07.360315+0000","last_fullsized":"2024-04-18T21:05:07.360315+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:56:05.795125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:06.635677+0000","last_change":"2024-04-18T21:05:05.629022+0000","last_active":"2024-04-18T21:05:06.635677+0000","last_peered":"2024-04-18T21:05:06.635677+0000","last_clean":"2024-04-18T21:05:06.635677+0000","last_became_active":"2024-04-18T21:05:05.627643+0000","last_became_peered":"2024-04-18T21:05:05.627643+0000","last_unstale":"2024-04-18T21:05:06.635677+0000","last_undegraded":"2024-04-18T21:05:06.635677+0000","last_fullsized":"2024-04-18T21:05:06.635677+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:32:23.929877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T21:05:07.359950+0000","last_change":"2024-04-18T21:05:04.641338+0000","last_active":"2024-04-18T21:05:07.359950+0000","last_peered":"2024-04-18T21:05:07.359950+0000","last_clean":"2024-04-18T21:05:07.359950+0000","last_became_active":"2024-04-18T21:05:04.639958+0000","last_became_peered":"2024-04-18T21:05:04.639958+0000","last_unstale":"2024-04-18T21:05:07.359950+0000","last_undegraded":"2024-04-18T21:05:07.359950+0000","last_fullsized":"2024-04-18T21:05:07.359950+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:42:45.392908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738377,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31340,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340500,"statfs":{"total":96636764160,"available":96604672000,"internally_reserved":0,"allocated":163840,"data_stored":55728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738377,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31940,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339900,"statfs":{"total":96636764160,"available":96604057600,"internally_reserved":0,"allocated":774144,"data_stored":647274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":782336,"data_stored":647890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:05:20.434 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-18T21:05:20.435 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-04-18T21:05:20.768 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 18 2024-04-18T21:05:20.768 INFO:teuthology.orchestra.run.smithi078.stdout:fsid dc017990-0393-4ab0-b604-5e7052fdc7bd 2024-04-18T21:05:20.769 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-04-18T21:04:43.507538+0000 2024-04-18T21:05:20.769 INFO:teuthology.orchestra.run.smithi078.stdout:modified 2024-04-18T21:05:06.615695+0000 2024-04-18T21:05:20.769 INFO:teuthology.orchestra.run.smithi078.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-04-18T21:05:20.769 INFO:teuthology.orchestra.run.smithi078.stdout:crush_version 4 2024-04-18T21:05:20.769 INFO:teuthology.orchestra.run.smithi078.stdout:full_ratio 0.95 2024-04-18T21:05:20.769 INFO:teuthology.orchestra.run.smithi078.stdout:backfillfull_ratio 0.9 2024-04-18T21:05:20.769 INFO:teuthology.orchestra.run.smithi078.stdout:nearfull_ratio 0.85 2024-04-18T21:05:20.769 INFO:teuthology.orchestra.run.smithi078.stdout:require_min_compat_client luminous 2024-04-18T21:05:20.769 INFO:teuthology.orchestra.run.smithi078.stdout:min_compat_client jewel 2024-04-18T21:05:20.769 INFO:teuthology.orchestra.run.smithi078.stdout:require_osd_release squid 2024-04-18T21:05:20.769 INFO:teuthology.orchestra.run.smithi078.stdout:stretch_mode_enabled false 2024-04-18T21:05:20.769 INFO:teuthology.orchestra.run.smithi078.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 11 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 2.99 2024-04-18T21:05:20.769 INFO:teuthology.orchestra.run.smithi078.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 14 flags hashpspool stripe_width 0 application rbd read_balance_score 1.50 2024-04-18T21:05:20.770 INFO:teuthology.orchestra.run.smithi078.stdout:pool 3 'cephfs_metadata' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 17 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.13 2024-04-18T21:05:20.770 INFO:teuthology.orchestra.run.smithi078.stdout:pool 4 'cephfs_data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 18 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.13 2024-04-18T21:05:20.770 INFO:teuthology.orchestra.run.smithi078.stdout:max_osd 3 2024-04-18T21:05:20.770 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 up in weight 1 up_from 8 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.132:6800/1948809768,v1:172.21.15.132:6801/1948809768] [v2:172.21.15.132:6802/1948809768,v1:172.21.15.132:6803/1948809768] exists,up 1854d737-3a67-416a-8c88-0f126505a0f2 2024-04-18T21:05:20.770 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 up in weight 1 up_from 8 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.150:6800/2040503167,v1:172.21.15.150:6801/2040503167] [v2:172.21.15.150:6802/2040503167,v1:172.21.15.150:6803/2040503167] exists,up dfeae661-3f8a-4d41-b287-7eb02c16b91a 2024-04-18T21:05:20.770 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 up in weight 1 up_from 8 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.187:6800/429896900,v1:172.21.15.187:6801/429896900] [v2:172.21.15.187:6802/429896900,v1:172.21.15.187:6803/429896900] exists,up 56a34021-e2dc-41ff-822c-7ec123466f25 2024-04-18T21:05:20.787 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 8 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.132:6800/1948809768,v1:172.21.15.132:6801/1948809768] [v2:172.21.15.132:6802/1948809768,v1:172.21.15.132:6803/1948809768] exists,up 1854d737-3a67-416a-8c88-0f126505a0f2', 'osd.1 up in weight 1 up_from 8 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.150:6800/2040503167,v1:172.21.15.150:6801/2040503167] [v2:172.21.15.150:6802/2040503167,v1:172.21.15.150:6803/2040503167] exists,up dfeae661-3f8a-4d41-b287-7eb02c16b91a', 'osd.2 up in weight 1 up_from 8 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.187:6800/429896900,v1:172.21.15.187:6801/429896900] [v2:172.21.15.187:6802/429896900,v1:172.21.15.187:6803/429896900] exists,up 56a34021-e2dc-41ff-822c-7ec123466f25'] 2024-04-18T21:05:20.787 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-04-18T21:05:20.900 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-04-18T21:05:20.900 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "mon.a", 2024-04-18T21:05:20.900 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster": "ceph", 2024-04-18T21:05:20.900 INFO:teuthology.orchestra.run.smithi078.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-04-18T21:05:20.900 INFO:teuthology.orchestra.run.smithi078.stdout: "admin_socket_mode": "", 2024-04-18T21:05:20.900 INFO:teuthology.orchestra.run.smithi078.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-04-18T21:05:20.900 INFO:teuthology.orchestra.run.smithi078.stdout: "auth_client_required": "cephx, none", 2024-04-18T21:05:20.900 INFO:teuthology.orchestra.run.smithi078.stdout: "auth_cluster_required": "cephx", 2024-04-18T21:05:20.901 INFO:teuthology.orchestra.run.smithi078.stdout: "auth_debug": "true", 2024-04-18T21:05:20.901 INFO:teuthology.orchestra.run.smithi078.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-04-18T21:05:20.901 INFO:teuthology.orchestra.run.smithi078.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-04-18T21:05:20.901 INFO:teuthology.orchestra.run.smithi078.stdout: "auth_service_required": "cephx", 2024-04-18T21:05:20.901 INFO:teuthology.orchestra.run.smithi078.stdout: "auth_service_ticket_ttl": "240.000000", 2024-04-18T21:05:20.901 INFO:teuthology.orchestra.run.smithi078.stdout: "auth_supported": "cephx", 2024-04-18T21:05:20.901 INFO:teuthology.orchestra.run.smithi078.stdout: "bdev_aio": "true", 2024-04-18T21:05:20.901 INFO:teuthology.orchestra.run.smithi078.stdout: "bdev_aio_max_queue_depth": "1024", 2024-04-18T21:05:20.901 INFO:teuthology.orchestra.run.smithi078.stdout: "bdev_aio_poll_ms": "250", 2024-04-18T21:05:20.901 INFO:teuthology.orchestra.run.smithi078.stdout: "bdev_aio_reap_max": "16", 2024-04-18T21:05:20.901 INFO:teuthology.orchestra.run.smithi078.stdout: "bdev_async_discard_threads": "0", 2024-04-18T21:05:20.901 INFO:teuthology.orchestra.run.smithi078.stdout: "bdev_block_size": "4096", 2024-04-18T21:05:20.901 INFO:teuthology.orchestra.run.smithi078.stdout: "bdev_debug_aio": "false", 2024-04-18T21:05:20.901 INFO:teuthology.orchestra.run.smithi078.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-04-18T21:05:20.902 INFO:teuthology.orchestra.run.smithi078.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-04-18T21:05:20.902 INFO:teuthology.orchestra.run.smithi078.stdout: "bdev_debug_inflight_ios": "false", 2024-04-18T21:05:20.902 INFO:teuthology.orchestra.run.smithi078.stdout: "bdev_enable_discard": "false", 2024-04-18T21:05:20.902 INFO:teuthology.orchestra.run.smithi078.stdout: "bdev_flock_retry": "3", 2024-04-18T21:05:20.902 INFO:teuthology.orchestra.run.smithi078.stdout: "bdev_flock_retry_interval": "0.100000", 2024-04-18T21:05:20.902 INFO:teuthology.orchestra.run.smithi078.stdout: "bdev_inject_crash": "0", 2024-04-18T21:05:20.902 INFO:teuthology.orchestra.run.smithi078.stdout: "bdev_inject_crash_flush_delay": "2", 2024-04-18T21:05:20.902 INFO:teuthology.orchestra.run.smithi078.stdout: "bdev_ioring": "false", 2024-04-18T21:05:20.902 INFO:teuthology.orchestra.run.smithi078.stdout: "bdev_ioring_hipri": "false", 2024-04-18T21:05:20.902 INFO:teuthology.orchestra.run.smithi078.stdout: "bdev_ioring_sqthread_poll": "false", 2024-04-18T21:05:20.902 INFO:teuthology.orchestra.run.smithi078.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-04-18T21:05:20.902 INFO:teuthology.orchestra.run.smithi078.stdout: "bdev_read_buffer_alignment": "4096", 2024-04-18T21:05:20.902 INFO:teuthology.orchestra.run.smithi078.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-04-18T21:05:20.902 INFO:teuthology.orchestra.run.smithi078.stdout: "bdev_type": "", 2024-04-18T21:05:20.903 INFO:teuthology.orchestra.run.smithi078.stdout: "bluefs_alloc_size": "1048576", 2024-04-18T21:05:20.903 INFO:teuthology.orchestra.run.smithi078.stdout: "bluefs_allocator": "hybrid", 2024-04-18T21:05:20.903 INFO:teuthology.orchestra.run.smithi078.stdout: "bluefs_buffered_io": "true", 2024-04-18T21:05:20.903 INFO:teuthology.orchestra.run.smithi078.stdout: "bluefs_check_for_zeros": "false", 2024-04-18T21:05:20.903 INFO:teuthology.orchestra.run.smithi078.stdout: "bluefs_check_volume_selector_often": "false", 2024-04-18T21:05:20.903 INFO:teuthology.orchestra.run.smithi078.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-04-18T21:05:20.903 INFO:teuthology.orchestra.run.smithi078.stdout: "bluefs_compact_log_sync": "false", 2024-04-18T21:05:20.903 INFO:teuthology.orchestra.run.smithi078.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-04-18T21:05:20.903 INFO:teuthology.orchestra.run.smithi078.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-04-18T21:05:20.903 INFO:teuthology.orchestra.run.smithi078.stdout: "bluefs_log_compact_min_size": "16777216", 2024-04-18T21:05:20.903 INFO:teuthology.orchestra.run.smithi078.stdout: "bluefs_log_replay_check_allocations": "true", 2024-04-18T21:05:20.903 INFO:teuthology.orchestra.run.smithi078.stdout: "bluefs_max_log_runway": "4194304", 2024-04-18T21:05:20.903 INFO:teuthology.orchestra.run.smithi078.stdout: "bluefs_max_prefetch": "1048576", 2024-04-18T21:05:20.903 INFO:teuthology.orchestra.run.smithi078.stdout: "bluefs_min_flush_size": "524288", 2024-04-18T21:05:20.904 INFO:teuthology.orchestra.run.smithi078.stdout: "bluefs_min_log_runway": "1048576", 2024-04-18T21:05:20.904 INFO:teuthology.orchestra.run.smithi078.stdout: "bluefs_replay_recovery": "false", 2024-04-18T21:05:20.904 INFO:teuthology.orchestra.run.smithi078.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-04-18T21:05:20.904 INFO:teuthology.orchestra.run.smithi078.stdout: "bluefs_shared_alloc_size": "65536", 2024-04-18T21:05:20.904 INFO:teuthology.orchestra.run.smithi078.stdout: "bluefs_sync_write": "false", 2024-04-18T21:05:20.904 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-04-18T21:05:20.904 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-04-18T21:05:20.904 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-04-18T21:05:20.904 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_allocation_from_file": "true", 2024-04-18T21:05:20.904 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_allocator": "hybrid", 2024-04-18T21:05:20.904 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-04-18T21:05:20.904 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-04-18T21:05:20.904 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-04-18T21:05:20.904 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-04-18T21:05:20.905 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-04-18T21:05:20.905 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-04-18T21:05:20.905 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_blobid_prealloc": "10240", 2024-04-18T21:05:20.905 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_block_create": "true", 2024-04-18T21:05:20.905 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_block_db_create": "false", 2024-04-18T21:05:20.905 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_block_db_path": "", 2024-04-18T21:05:20.905 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_block_db_size": "0", 2024-04-18T21:05:20.905 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_block_path": "", 2024-04-18T21:05:20.905 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_block_preallocate_file": "false", 2024-04-18T21:05:20.905 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_block_size": "107374182400", 2024-04-18T21:05:20.905 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_block_wal_create": "false", 2024-04-18T21:05:20.905 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_block_wal_path": "", 2024-04-18T21:05:20.905 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_block_wal_size": "100663296", 2024-04-18T21:05:20.905 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_bluefs": "true", 2024-04-18T21:05:20.906 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-04-18T21:05:20.906 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_bluefs_env_mirror": "false", 2024-04-18T21:05:20.906 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-04-18T21:05:20.906 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-04-18T21:05:20.906 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-04-18T21:05:20.906 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-04-18T21:05:20.906 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-04-18T21:05:20.906 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-04-18T21:05:20.906 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_autotune": "true", 2024-04-18T21:05:20.906 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-04-18T21:05:20.906 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-04-18T21:05:20.906 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-04-18T21:05:20.906 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-04-18T21:05:20.907 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_size": "0", 2024-04-18T21:05:20.907 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-04-18T21:05:20.907 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-04-18T21:05:20.907 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-04-18T21:05:20.907 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-04-18T21:05:20.907 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_type": "2q", 2024-04-18T21:05:20.907 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-04-18T21:05:20.907 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_clone_cow": "true", 2024-04-18T21:05:20.907 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_compression_algorithm": "snappy", 2024-04-18T21:05:20.907 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_compression_max_blob_size": "0", 2024-04-18T21:05:20.907 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-04-18T21:05:20.907 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-04-18T21:05:20.907 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_compression_min_blob_size": "0", 2024-04-18T21:05:20.907 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-04-18T21:05:20.908 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-04-18T21:05:20.908 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_compression_mode": "none", 2024-04-18T21:05:20.908 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-04-18T21:05:20.908 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_csum_type": "crc32c", 2024-04-18T21:05:20.908 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_debug_enforce_min_alloc_size": "0", 2024-04-18T21:05:20.908 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_debug_enforce_settings": "default", 2024-04-18T21:05:20.908 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_debug_freelist": "false", 2024-04-18T21:05:20.908 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_debug_fsck_abort": "false", 2024-04-18T21:05:20.908 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-04-18T21:05:20.908 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-04-18T21:05:20.908 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_debug_inject_read_err": "false", 2024-04-18T21:05:20.908 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_debug_legacy_omap": "false", 2024-04-18T21:05:20.908 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-04-18T21:05:20.908 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-04-18T21:05:20.909 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-04-18T21:05:20.909 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-04-18T21:05:20.909 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_debug_prefill": "0.000000", 2024-04-18T21:05:20.909 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-04-18T21:05:20.909 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-04-18T21:05:20.909 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-04-18T21:05:20.909 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_debug_small_allocations": "0", 2024-04-18T21:05:20.909 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-04-18T21:05:20.909 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_default_buffered_read": "true", 2024-04-18T21:05:20.909 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_default_buffered_write": "false", 2024-04-18T21:05:20.909 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_deferred_batch_ops": "0", 2024-04-18T21:05:20.909 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-04-18T21:05:20.909 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-04-18T21:05:20.910 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_elastic_shared_blobs": "true", 2024-04-18T21:05:20.910 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-04-18T21:05:20.910 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-04-18T21:05:20.910 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-04-18T21:05:20.910 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-04-18T21:05:20.910 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-04-18T21:05:20.910 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_fail_eio": "false", 2024-04-18T21:05:20.910 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-04-18T21:05:20.910 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-04-18T21:05:20.910 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-04-18T21:05:20.910 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-04-18T21:05:20.910 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_fsck_on_mkfs": "true", 2024-04-18T21:05:20.910 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-04-18T21:05:20.910 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_fsck_on_mount": "false", 2024-04-18T21:05:20.911 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-04-18T21:05:20.911 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_fsck_on_umount": "false", 2024-04-18T21:05:20.911 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-04-18T21:05:20.911 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-04-18T21:05:20.911 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-04-18T21:05:20.911 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-04-18T21:05:20.911 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-04-18T21:05:20.911 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-04-18T21:05:20.911 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-04-18T21:05:20.911 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-04-18T21:05:20.911 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_ignore_data_csum": "false", 2024-04-18T21:05:20.911 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-04-18T21:05:20.911 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_kvbackend": "rocksdb", 2024-04-18T21:05:20.911 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-04-18T21:05:20.912 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-04-18T21:05:20.912 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_log_op_age": "5.000000", 2024-04-18T21:05:20.912 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_max_alloc_size": "0", 2024-04-18T21:05:20.912 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_max_blob_size": "0", 2024-04-18T21:05:20.912 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-04-18T21:05:20.912 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-04-18T21:05:20.912 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_max_defer_interval": "3.000000", 2024-04-18T21:05:20.912 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_max_deferred_txc": "32", 2024-04-18T21:05:20.912 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_min_alloc_size": "0", 2024-04-18T21:05:20.912 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-04-18T21:05:20.912 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-04-18T21:05:20.912 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_nid_prealloc": "1024", 2024-04-18T21:05:20.912 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_prefer_deferred_size": "0", 2024-04-18T21:05:20.912 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-04-18T21:05:20.913 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-04-18T21:05:20.913 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_qfsck_on_mount": "true", 2024-04-18T21:05:20.913 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_retry_disk_reads": "3", 2024-04-18T21:05:20.913 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_rocksdb_cf": "true", 2024-04-18T21:05:20.913 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-04-18T21:05:20.913 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-04-18T21:05:20.913 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_rocksdb_options_annex": "", 2024-04-18T21:05:20.913 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_spdk_coremask": "0x1", 2024-04-18T21:05:20.913 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_spdk_io_sleep": "5", 2024-04-18T21:05:20.913 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_spdk_max_io_completion": "0", 2024-04-18T21:05:20.913 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_spdk_mem": "512", 2024-04-18T21:05:20.913 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_sync_submit_transaction": "false", 2024-04-18T21:05:20.913 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_throttle_bytes": "67108864", 2024-04-18T21:05:20.913 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_throttle_cost_per_io": "0", 2024-04-18T21:05:20.914 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-04-18T21:05:20.914 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-04-18T21:05:20.914 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-04-18T21:05:20.914 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-04-18T21:05:20.914 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_tracing": "false", 2024-04-18T21:05:20.914 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-04-18T21:05:20.914 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-04-18T21:05:20.914 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_volume_selection_reserved": "0", 2024-04-18T21:05:20.914 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-04-18T21:05:20.914 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-04-18T21:05:20.914 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-04-18T21:05:20.914 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-04-18T21:05:20.914 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-04-18T21:05:20.915 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-04-18T21:05:20.915 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_zero_block_detection": "false", 2024-04-18T21:05:20.915 INFO:teuthology.orchestra.run.smithi078.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-04-18T21:05:20.915 INFO:teuthology.orchestra.run.smithi078.stdout: "cephfs_mirror_action_update_interval": "2", 2024-04-18T21:05:20.915 INFO:teuthology.orchestra.run.smithi078.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-04-18T21:05:20.915 INFO:teuthology.orchestra.run.smithi078.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-04-18T21:05:20.915 INFO:teuthology.orchestra.run.smithi078.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-04-18T21:05:20.915 INFO:teuthology.orchestra.run.smithi078.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-04-18T21:05:20.915 INFO:teuthology.orchestra.run.smithi078.stdout: "cephfs_mirror_mount_timeout": "10", 2024-04-18T21:05:20.915 INFO:teuthology.orchestra.run.smithi078.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-04-18T21:05:20.915 INFO:teuthology.orchestra.run.smithi078.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-04-18T21:05:20.915 INFO:teuthology.orchestra.run.smithi078.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-04-18T21:05:20.915 INFO:teuthology.orchestra.run.smithi078.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-04-18T21:05:20.916 INFO:teuthology.orchestra.run.smithi078.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-04-18T21:05:20.916 INFO:teuthology.orchestra.run.smithi078.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-04-18T21:05:20.916 INFO:teuthology.orchestra.run.smithi078.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-04-18T21:05:20.916 INFO:teuthology.orchestra.run.smithi078.stdout: "cephx_cluster_require_signatures": "false", 2024-04-18T21:05:20.916 INFO:teuthology.orchestra.run.smithi078.stdout: "cephx_cluster_require_version": "2", 2024-04-18T21:05:20.916 INFO:teuthology.orchestra.run.smithi078.stdout: "cephx_require_signatures": "false", 2024-04-18T21:05:20.916 INFO:teuthology.orchestra.run.smithi078.stdout: "cephx_require_version": "2", 2024-04-18T21:05:20.916 INFO:teuthology.orchestra.run.smithi078.stdout: "cephx_service_require_signatures": "false", 2024-04-18T21:05:20.916 INFO:teuthology.orchestra.run.smithi078.stdout: "cephx_service_require_version": "2", 2024-04-18T21:05:20.916 INFO:teuthology.orchestra.run.smithi078.stdout: "cephx_sign_messages": "true", 2024-04-18T21:05:20.916 INFO:teuthology.orchestra.run.smithi078.stdout: "chdir": "", 2024-04-18T21:05:20.916 INFO:teuthology.orchestra.run.smithi078.stdout: "client_acl_type": "", 2024-04-18T21:05:20.916 INFO:teuthology.orchestra.run.smithi078.stdout: "client_asio_thread_count": "2", 2024-04-18T21:05:20.916 INFO:teuthology.orchestra.run.smithi078.stdout: "client_cache_mid": "0.750000", 2024-04-18T21:05:20.917 INFO:teuthology.orchestra.run.smithi078.stdout: "client_cache_size": "16384", 2024-04-18T21:05:20.917 INFO:teuthology.orchestra.run.smithi078.stdout: "client_caps_release_delay": "5", 2024-04-18T21:05:20.917 INFO:teuthology.orchestra.run.smithi078.stdout: "client_check_pool_perm": "true", 2024-04-18T21:05:20.917 INFO:teuthology.orchestra.run.smithi078.stdout: "client_collect_and_send_global_metrics": "false", 2024-04-18T21:05:20.917 INFO:teuthology.orchestra.run.smithi078.stdout: "client_debug_force_sync_read": "false", 2024-04-18T21:05:20.917 INFO:teuthology.orchestra.run.smithi078.stdout: "client_debug_getattr_caps": "false", 2024-04-18T21:05:20.917 INFO:teuthology.orchestra.run.smithi078.stdout: "client_debug_inject_tick_delay": "0", 2024-04-18T21:05:20.917 INFO:teuthology.orchestra.run.smithi078.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-04-18T21:05:20.917 INFO:teuthology.orchestra.run.smithi078.stdout: "client_die_on_failed_remount": "false", 2024-04-18T21:05:20.917 INFO:teuthology.orchestra.run.smithi078.stdout: "client_dirsize_rbytes": "true", 2024-04-18T21:05:20.917 INFO:teuthology.orchestra.run.smithi078.stdout: "client_force_lazyio": "false", 2024-04-18T21:05:20.917 INFO:teuthology.orchestra.run.smithi078.stdout: "client_fs": "", 2024-04-18T21:05:20.917 INFO:teuthology.orchestra.run.smithi078.stdout: "client_inject_fixed_oldest_tid": "false", 2024-04-18T21:05:20.917 INFO:teuthology.orchestra.run.smithi078.stdout: "client_inject_release_failure": "false", 2024-04-18T21:05:20.917 INFO:teuthology.orchestra.run.smithi078.stdout: "client_max_inline_size": "4096", 2024-04-18T21:05:20.918 INFO:teuthology.orchestra.run.smithi078.stdout: "client_max_retries_on_remount_failure": "5", 2024-04-18T21:05:20.918 INFO:teuthology.orchestra.run.smithi078.stdout: "client_mds_namespace": "", 2024-04-18T21:05:20.918 INFO:teuthology.orchestra.run.smithi078.stdout: "client_metadata": "", 2024-04-18T21:05:20.918 INFO:teuthology.orchestra.run.smithi078.stdout: "client_mount_gid": "-1", 2024-04-18T21:05:20.918 INFO:teuthology.orchestra.run.smithi078.stdout: "client_mount_timeout": "300", 2024-04-18T21:05:20.918 INFO:teuthology.orchestra.run.smithi078.stdout: "client_mount_uid": "-1", 2024-04-18T21:05:20.918 INFO:teuthology.orchestra.run.smithi078.stdout: "client_mountpoint": "/", 2024-04-18T21:05:20.918 INFO:teuthology.orchestra.run.smithi078.stdout: "client_notify_timeout": "10", 2024-04-18T21:05:20.918 INFO:teuthology.orchestra.run.smithi078.stdout: "client_oc": "true", 2024-04-18T21:05:20.918 INFO:teuthology.orchestra.run.smithi078.stdout: "client_oc_max_dirty": "104857600", 2024-04-18T21:05:20.918 INFO:teuthology.orchestra.run.smithi078.stdout: "client_oc_max_dirty_age": "5.000000", 2024-04-18T21:05:20.918 INFO:teuthology.orchestra.run.smithi078.stdout: "client_oc_max_objects": "1000", 2024-04-18T21:05:20.918 INFO:teuthology.orchestra.run.smithi078.stdout: "client_oc_size": "209715200", 2024-04-18T21:05:20.919 INFO:teuthology.orchestra.run.smithi078.stdout: "client_oc_target_dirty": "8388608", 2024-04-18T21:05:20.919 INFO:teuthology.orchestra.run.smithi078.stdout: "client_permissions": "true", 2024-04-18T21:05:20.919 INFO:teuthology.orchestra.run.smithi078.stdout: "client_quota": "true", 2024-04-18T21:05:20.919 INFO:teuthology.orchestra.run.smithi078.stdout: "client_quota_df": "true", 2024-04-18T21:05:20.919 INFO:teuthology.orchestra.run.smithi078.stdout: "client_readahead_max_bytes": "0", 2024-04-18T21:05:20.919 INFO:teuthology.orchestra.run.smithi078.stdout: "client_readahead_max_periods": "4", 2024-04-18T21:05:20.919 INFO:teuthology.orchestra.run.smithi078.stdout: "client_readahead_min": "131072", 2024-04-18T21:05:20.919 INFO:teuthology.orchestra.run.smithi078.stdout: "client_reconnect_stale": "false", 2024-04-18T21:05:20.919 INFO:teuthology.orchestra.run.smithi078.stdout: "client_shutdown_timeout": "30", 2024-04-18T21:05:20.919 INFO:teuthology.orchestra.run.smithi078.stdout: "client_snapdir": ".snap", 2024-04-18T21:05:20.919 INFO:teuthology.orchestra.run.smithi078.stdout: "client_tick_interval": "1", 2024-04-18T21:05:20.919 INFO:teuthology.orchestra.run.smithi078.stdout: "client_trace": "", 2024-04-18T21:05:20.919 INFO:teuthology.orchestra.run.smithi078.stdout: "client_try_dentry_invalidate": "false", 2024-04-18T21:05:20.919 INFO:teuthology.orchestra.run.smithi078.stdout: "client_use_faked_inos": "false", 2024-04-18T21:05:20.919 INFO:teuthology.orchestra.run.smithi078.stdout: "client_use_random_mds": "false", 2024-04-18T21:05:20.920 INFO:teuthology.orchestra.run.smithi078.stdout: "clog_to_graylog": "false", 2024-04-18T21:05:20.920 INFO:teuthology.orchestra.run.smithi078.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-04-18T21:05:20.920 INFO:teuthology.orchestra.run.smithi078.stdout: "clog_to_graylog_port": "12201", 2024-04-18T21:05:20.920 INFO:teuthology.orchestra.run.smithi078.stdout: "clog_to_monitors": "default=true", 2024-04-18T21:05:20.920 INFO:teuthology.orchestra.run.smithi078.stdout: "clog_to_syslog": "false", 2024-04-18T21:05:20.920 INFO:teuthology.orchestra.run.smithi078.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-04-18T21:05:20.920 INFO:teuthology.orchestra.run.smithi078.stdout: "clog_to_syslog_level": "info", 2024-04-18T21:05:20.920 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_addr": "-", 2024-04-18T21:05:20.920 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_network": "", 2024-04-18T21:05:20.920 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_network_interface": "", 2024-04-18T21:05:20.920 INFO:teuthology.orchestra.run.smithi078.stdout: "compressor_zlib_isal": "false", 2024-04-18T21:05:20.920 INFO:teuthology.orchestra.run.smithi078.stdout: "compressor_zlib_level": "5", 2024-04-18T21:05:20.920 INFO:teuthology.orchestra.run.smithi078.stdout: "compressor_zlib_winsize": "-15", 2024-04-18T21:05:20.920 INFO:teuthology.orchestra.run.smithi078.stdout: "compressor_zstd_level": "1", 2024-04-18T21:05:20.921 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-04-18T21:05:20.921 INFO:teuthology.orchestra.run.smithi078.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-04-18T21:05:20.921 INFO:teuthology.orchestra.run.smithi078.stdout: "crimson_alien_op_num_threads": "6", 2024-04-18T21:05:20.921 INFO:teuthology.orchestra.run.smithi078.stdout: "crimson_alien_thread_cpu_cores": "", 2024-04-18T21:05:20.921 INFO:teuthology.orchestra.run.smithi078.stdout: "crimson_osd_obc_lru_size": "512", 2024-04-18T21:05:20.921 INFO:teuthology.orchestra.run.smithi078.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-04-18T21:05:20.921 INFO:teuthology.orchestra.run.smithi078.stdout: "crimson_osd_stat_interval": "0", 2024-04-18T21:05:20.921 INFO:teuthology.orchestra.run.smithi078.stdout: "crimson_seastar_cpu_cores": "", 2024-04-18T21:05:20.921 INFO:teuthology.orchestra.run.smithi078.stdout: "crush_location": "", 2024-04-18T21:05:20.921 INFO:teuthology.orchestra.run.smithi078.stdout: "crush_location_hook": "", 2024-04-18T21:05:20.921 INFO:teuthology.orchestra.run.smithi078.stdout: "crush_location_hook_timeout": "10", 2024-04-18T21:05:20.921 INFO:teuthology.orchestra.run.smithi078.stdout: "daemonize": "false", 2024-04-18T21:05:20.921 INFO:teuthology.orchestra.run.smithi078.stdout: "daos_pool": "tank", 2024-04-18T21:05:20.921 INFO:teuthology.orchestra.run.smithi078.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-04-18T21:05:20.922 INFO:teuthology.orchestra.run.smithi078.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-04-18T21:05:20.922 INFO:teuthology.orchestra.run.smithi078.stdout: "dbstore_db_name_prefix": "dbstore", 2024-04-18T21:05:20.922 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_alienstore": "0/5", 2024-04-18T21:05:20.922 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_allow_any_pool_priority": "false", 2024-04-18T21:05:20.922 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_asok": "1/5", 2024-04-18T21:05:20.922 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_asok_assert_abort": "false", 2024-04-18T21:05:20.922 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_asserts_on_shutdown": "true", 2024-04-18T21:05:20.922 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_auth": "20/20", 2024-04-18T21:05:20.922 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_bdev": "1/3", 2024-04-18T21:05:20.922 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_bluefs": "1/5", 2024-04-18T21:05:20.922 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_bluestore": "1/5", 2024-04-18T21:05:20.922 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_buffer": "0/1", 2024-04-18T21:05:20.922 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_ceph_exporter": "1/5", 2024-04-18T21:05:20.923 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_cephfs_mirror": "0/5", 2024-04-18T21:05:20.923 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_cephsqlite": "0/5", 2024-04-18T21:05:20.923 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_client": "0/5", 2024-04-18T21:05:20.923 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_compressor": "1/5", 2024-04-18T21:05:20.923 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_context": "0/1", 2024-04-18T21:05:20.923 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_crimson_interrupt": "0/5", 2024-04-18T21:05:20.923 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_crush": "1/1", 2024-04-18T21:05:20.923 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_crypto": "1/5", 2024-04-18T21:05:20.923 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_cyanstore": "0/5", 2024-04-18T21:05:20.923 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_deliberately_leak_memory": "false", 2024-04-18T21:05:20.923 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_disable_randomized_ping": "false", 2024-04-18T21:05:20.923 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_dpdk": "1/5", 2024-04-18T21:05:20.923 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_eventtrace": "1/5", 2024-04-18T21:05:20.923 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_filer": "0/1", 2024-04-18T21:05:20.923 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_filestore": "1/3", 2024-04-18T21:05:20.924 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_finisher": "1/1", 2024-04-18T21:05:20.924 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_fuse": "1/5", 2024-04-18T21:05:20.924 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_heartbeat_testing_span": "0", 2024-04-18T21:05:20.924 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_heartbeatmap": "1/5", 2024-04-18T21:05:20.924 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_immutable_obj_cache": "0/5", 2024-04-18T21:05:20.924 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_javaclient": "1/5", 2024-04-18T21:05:20.924 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_journal": "1/3", 2024-04-18T21:05:20.924 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_journaler": "0/5", 2024-04-18T21:05:20.924 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_kstore": "1/5", 2024-04-18T21:05:20.924 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_lockdep": "0/1", 2024-04-18T21:05:20.924 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_mclock": "1/5", 2024-04-18T21:05:20.924 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_mds": "1/5", 2024-04-18T21:05:20.924 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_mds_balancer": "1/5", 2024-04-18T21:05:20.924 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_mds_locker": "1/5", 2024-04-18T21:05:20.925 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_mds_log": "1/5", 2024-04-18T21:05:20.925 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_mds_log_expire": "1/5", 2024-04-18T21:05:20.925 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_mds_migrator": "1/5", 2024-04-18T21:05:20.925 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_mds_quiesce": "3/5", 2024-04-18T21:05:20.925 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_memstore": "1/5", 2024-04-18T21:05:20.925 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_mgr": "2/5", 2024-04-18T21:05:20.925 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_mgrc": "1/5", 2024-04-18T21:05:20.925 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_mon": "20/20", 2024-04-18T21:05:20.925 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_monc": "0/10", 2024-04-18T21:05:20.925 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_ms": "1/1", 2024-04-18T21:05:20.925 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_none": "0/5", 2024-04-18T21:05:20.925 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_objclass": "0/5", 2024-04-18T21:05:20.925 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_objectcacher": "0/5", 2024-04-18T21:05:20.925 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_objecter": "0/1", 2024-04-18T21:05:20.926 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_optracker": "0/5", 2024-04-18T21:05:20.926 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_osd": "1/5", 2024-04-18T21:05:20.926 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_paxos": "20/20", 2024-04-18T21:05:20.926 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_perfcounter": "1/5", 2024-04-18T21:05:20.926 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_prioritycache": "1/5", 2024-04-18T21:05:20.926 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_rados": "0/5", 2024-04-18T21:05:20.926 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_rbd": "0/5", 2024-04-18T21:05:20.926 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_rbd_mirror": "0/5", 2024-04-18T21:05:20.926 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_rbd_pwl": "0/5", 2024-04-18T21:05:20.926 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_rbd_replay": "0/5", 2024-04-18T21:05:20.926 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_refs": "0/0", 2024-04-18T21:05:20.926 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_reserver": "1/1", 2024-04-18T21:05:20.926 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_rgw": "1/5", 2024-04-18T21:05:20.927 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_rgw_access": "1/5", 2024-04-18T21:05:20.927 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_rgw_datacache": "1/5", 2024-04-18T21:05:20.927 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_rgw_dbstore": "1/5", 2024-04-18T21:05:20.927 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_rgw_flight": "1/5", 2024-04-18T21:05:20.927 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_rgw_lifecycle": "1/5", 2024-04-18T21:05:20.927 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_rgw_notification": "1/5", 2024-04-18T21:05:20.927 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_rgw_sync": "1/5", 2024-04-18T21:05:20.927 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_rocksdb": "4/5", 2024-04-18T21:05:20.927 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_seastore": "0/5", 2024-04-18T21:05:20.927 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_seastore_backref": "0/5", 2024-04-18T21:05:20.927 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_seastore_cache": "0/5", 2024-04-18T21:05:20.927 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_seastore_cleaner": "0/5", 2024-04-18T21:05:20.927 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_seastore_device": "0/5", 2024-04-18T21:05:20.927 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_seastore_epm": "0/5", 2024-04-18T21:05:20.927 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-04-18T21:05:20.928 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_seastore_journal": "0/5", 2024-04-18T21:05:20.928 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_seastore_lba": "0/5", 2024-04-18T21:05:20.928 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_seastore_odata": "0/5", 2024-04-18T21:05:20.928 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_seastore_omap": "0/5", 2024-04-18T21:05:20.928 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_seastore_onode": "0/5", 2024-04-18T21:05:20.928 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_seastore_t": "0/5", 2024-04-18T21:05:20.928 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_seastore_tm": "0/5", 2024-04-18T21:05:20.928 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_striper": "0/1", 2024-04-18T21:05:20.928 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_test": "0/5", 2024-04-18T21:05:20.928 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_throttle": "1/1", 2024-04-18T21:05:20.928 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_timer": "0/1", 2024-04-18T21:05:20.928 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_tp": "0/5", 2024-04-18T21:05:20.928 INFO:teuthology.orchestra.run.smithi078.stdout: "debug_trace": "1/5", 2024-04-18T21:05:20.928 INFO:teuthology.orchestra.run.smithi078.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-04-18T21:05:20.929 INFO:teuthology.orchestra.run.smithi078.stdout: "device_failure_prediction_mode": "none", 2024-04-18T21:05:20.929 INFO:teuthology.orchestra.run.smithi078.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-04-18T21:05:20.929 INFO:teuthology.orchestra.run.smithi078.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-04-18T21:05:20.929 INFO:teuthology.orchestra.run.smithi078.stdout: "err_to_graylog": "false", 2024-04-18T21:05:20.929 INFO:teuthology.orchestra.run.smithi078.stdout: "err_to_journald": "false", 2024-04-18T21:05:20.929 INFO:teuthology.orchestra.run.smithi078.stdout: "err_to_stderr": "true", 2024-04-18T21:05:20.929 INFO:teuthology.orchestra.run.smithi078.stdout: "err_to_syslog": "false", 2024-04-18T21:05:20.929 INFO:teuthology.orchestra.run.smithi078.stdout: "event_tracing": "false", 2024-04-18T21:05:20.929 INFO:teuthology.orchestra.run.smithi078.stdout: "exporter_addr": "0.0.0.0", 2024-04-18T21:05:20.929 INFO:teuthology.orchestra.run.smithi078.stdout: "exporter_http_port": "9926", 2024-04-18T21:05:20.929 INFO:teuthology.orchestra.run.smithi078.stdout: "exporter_prio_limit": "5", 2024-04-18T21:05:20.929 INFO:teuthology.orchestra.run.smithi078.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-04-18T21:05:20.929 INFO:teuthology.orchestra.run.smithi078.stdout: "exporter_sort_metrics": "true", 2024-04-18T21:05:20.929 INFO:teuthology.orchestra.run.smithi078.stdout: "exporter_stats_period": "5", 2024-04-18T21:05:20.930 INFO:teuthology.orchestra.run.smithi078.stdout: "fake_statfs_for_testing": "0", 2024-04-18T21:05:20.930 INFO:teuthology.orchestra.run.smithi078.stdout: "fatal_signal_handlers": "true", 2024-04-18T21:05:20.930 INFO:teuthology.orchestra.run.smithi078.stdout: "filer_max_purge_ops": "10", 2024-04-18T21:05:20.930 INFO:teuthology.orchestra.run.smithi078.stdout: "filer_max_truncate_ops": "128", 2024-04-18T21:05:20.930 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_apply_finisher_threads": "1", 2024-04-18T21:05:20.930 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_blackhole": "false", 2024-04-18T21:05:20.930 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_btrfs_clone_range": "true", 2024-04-18T21:05:20.930 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_btrfs_snap": "true", 2024-04-18T21:05:20.930 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_caller_concurrency": "10", 2024-04-18T21:05:20.930 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_collect_device_partition_information": "true", 2024-04-18T21:05:20.930 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_commit_timeout": "600.000000", 2024-04-18T21:05:20.930 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_debug_inject_read_err": "false", 2024-04-18T21:05:20.930 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_debug_omap_check": "false", 2024-04-18T21:05:20.930 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_debug_verify_split": "false", 2024-04-18T21:05:20.931 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_dump_file": "", 2024-04-18T21:05:20.993 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-04-18T21:05:20.993 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-04-18T21:05:20.993 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_fadvise": "true", 2024-04-18T21:05:20.993 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_fail_eio": "true", 2024-04-18T21:05:20.993 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_fd_cache_shards": "16", 2024-04-18T21:05:20.993 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_fd_cache_size": "128", 2024-04-18T21:05:20.993 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_fiemap": "false", 2024-04-18T21:05:20.993 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_fiemap_threshold": "4096", 2024-04-18T21:05:20.993 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-04-18T21:05:20.993 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_index_retry_probability": "0.000000", 2024-04-18T21:05:20.993 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_inject_stall": "0", 2024-04-18T21:05:20.993 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_journal_parallel": "false", 2024-04-18T21:05:20.994 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_journal_trailing": "false", 2024-04-18T21:05:20.994 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_journal_writeahead": "false", 2024-04-18T21:05:20.994 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_kill_at": "0", 2024-04-18T21:05:20.994 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-04-18T21:05:20.994 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_max_inline_xattr_size": "0", 2024-04-18T21:05:20.994 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-04-18T21:05:20.994 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-04-18T21:05:20.994 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-04-18T21:05:20.994 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_max_inline_xattrs": "0", 2024-04-18T21:05:20.994 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-04-18T21:05:20.994 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_max_inline_xattrs_other": "2", 2024-04-18T21:05:20.994 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-04-18T21:05:20.994 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_max_sync_interval": "5.000000", 2024-04-18T21:05:20.995 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_max_xattr_value_size": "0", 2024-04-18T21:05:20.995 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-04-18T21:05:20.995 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-04-18T21:05:20.995 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-04-18T21:05:20.995 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_merge_threshold": "-10", 2024-04-18T21:05:20.995 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_min_sync_interval": "0.010000", 2024-04-18T21:05:20.995 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_odsync_write": "false", 2024-04-18T21:05:20.995 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_omap_backend": "rocksdb", 2024-04-18T21:05:20.995 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_omap_backend_path": "", 2024-04-18T21:05:20.995 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_omap_header_cache_size": "1024", 2024-04-18T21:05:20.995 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_ondisk_finisher_threads": "1", 2024-04-18T21:05:20.995 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-04-18T21:05:20.995 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_op_thread_timeout": "60", 2024-04-18T21:05:20.995 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_op_threads": "2", 2024-04-18T21:05:20.996 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_punch_hole": "false", 2024-04-18T21:05:20.996 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-04-18T21:05:20.996 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-04-18T21:05:20.996 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-04-18T21:05:20.996 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-04-18T21:05:20.996 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-04-18T21:05:20.996 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_queue_max_bytes": "104857600", 2024-04-18T21:05:20.996 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-04-18T21:05:20.996 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-04-18T21:05:20.996 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-04-18T21:05:20.996 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_queue_max_ops": "50", 2024-04-18T21:05:20.996 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-04-18T21:05:20.996 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_seek_data_hole": "false", 2024-04-18T21:05:20.996 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_sloppy_crc": "false", 2024-04-18T21:05:20.996 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-04-18T21:05:20.997 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_splice": "false", 2024-04-18T21:05:20.997 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_split_multiple": "2", 2024-04-18T21:05:20.997 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_split_rand_factor": "20", 2024-04-18T21:05:20.997 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_update_to": "1000", 2024-04-18T21:05:20.997 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-04-18T21:05:20.997 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-04-18T21:05:20.997 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-04-18T21:05:20.997 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-04-18T21:05:20.997 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-04-18T21:05:20.997 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-04-18T21:05:20.997 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_wbthrottle_enable": "true", 2024-04-18T21:05:20.997 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-04-18T21:05:20.997 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-04-18T21:05:20.997 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-04-18T21:05:20.997 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-04-18T21:05:20.998 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-04-18T21:05:20.998 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-04-18T21:05:20.998 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_xfs_extsize": "false", 2024-04-18T21:05:20.998 INFO:teuthology.orchestra.run.smithi078.stdout: "filestore_zfs_snap": "false", 2024-04-18T21:05:20.998 INFO:teuthology.orchestra.run.smithi078.stdout: "fio_dir": "/tmp/fio", 2024-04-18T21:05:20.998 INFO:teuthology.orchestra.run.smithi078.stdout: "fsid": "dc017990-0393-4ab0-b604-5e7052fdc7bd", 2024-04-18T21:05:20.998 INFO:teuthology.orchestra.run.smithi078.stdout: "fuse_allow_other": "true", 2024-04-18T21:05:20.998 INFO:teuthology.orchestra.run.smithi078.stdout: "fuse_atomic_o_trunc": "true", 2024-04-18T21:05:20.998 INFO:teuthology.orchestra.run.smithi078.stdout: "fuse_big_writes": "true", 2024-04-18T21:05:20.998 INFO:teuthology.orchestra.run.smithi078.stdout: "fuse_debug": "false", 2024-04-18T21:05:20.998 INFO:teuthology.orchestra.run.smithi078.stdout: "fuse_default_permissions": "false", 2024-04-18T21:05:20.998 INFO:teuthology.orchestra.run.smithi078.stdout: "fuse_disable_pagecache": "false", 2024-04-18T21:05:20.998 INFO:teuthology.orchestra.run.smithi078.stdout: "fuse_max_write": "0", 2024-04-18T21:05:20.999 INFO:teuthology.orchestra.run.smithi078.stdout: "fuse_multithreaded": "true", 2024-04-18T21:05:20.999 INFO:teuthology.orchestra.run.smithi078.stdout: "fuse_require_active_mds": "true", 2024-04-18T21:05:20.999 INFO:teuthology.orchestra.run.smithi078.stdout: "fuse_set_user_groups": "true", 2024-04-18T21:05:20.999 INFO:teuthology.orchestra.run.smithi078.stdout: "fuse_splice_move": "true", 2024-04-18T21:05:20.999 INFO:teuthology.orchestra.run.smithi078.stdout: "fuse_splice_read": "true", 2024-04-18T21:05:20.999 INFO:teuthology.orchestra.run.smithi078.stdout: "fuse_splice_write": "true", 2024-04-18T21:05:20.999 INFO:teuthology.orchestra.run.smithi078.stdout: "fuse_syncfs_on_mksnap": "true", 2024-04-18T21:05:20.999 INFO:teuthology.orchestra.run.smithi078.stdout: "fuse_use_invalidate_cb": "true", 2024-04-18T21:05:20.999 INFO:teuthology.orchestra.run.smithi078.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-04-18T21:05:20.999 INFO:teuthology.orchestra.run.smithi078.stdout: "gss_target_name": "ceph", 2024-04-18T21:05:20.999 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_file": "", 2024-04-18T21:05:20.999 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_inject_failure": "0", 2024-04-18T21:05:20.999 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_interval": "5", 2024-04-18T21:05:20.999 INFO:teuthology.orchestra.run.smithi078.stdout: "host": "smithi078", 2024-04-18T21:05:20.999 INFO:teuthology.orchestra.run.smithi078.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-04-18T21:05:20.999 INFO:teuthology.orchestra.run.smithi078.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-04-18T21:05:21.000 INFO:teuthology.orchestra.run.smithi078.stdout: "immutable_object_cache_max_size": "1073741824", 2024-04-18T21:05:21.000 INFO:teuthology.orchestra.run.smithi078.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-04-18T21:05:21.000 INFO:teuthology.orchestra.run.smithi078.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-04-18T21:05:21.000 INFO:teuthology.orchestra.run.smithi078.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-04-18T21:05:21.000 INFO:teuthology.orchestra.run.smithi078.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-04-18T21:05:21.000 INFO:teuthology.orchestra.run.smithi078.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-04-18T21:05:21.000 INFO:teuthology.orchestra.run.smithi078.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-04-18T21:05:21.000 INFO:teuthology.orchestra.run.smithi078.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-04-18T21:05:21.000 INFO:teuthology.orchestra.run.smithi078.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-04-18T21:05:21.000 INFO:teuthology.orchestra.run.smithi078.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-04-18T21:05:21.000 INFO:teuthology.orchestra.run.smithi078.stdout: "immutable_object_cache_watermark": "0.900000", 2024-04-18T21:05:21.000 INFO:teuthology.orchestra.run.smithi078.stdout: "inject_early_sigterm": "false", 2024-04-18T21:05:21.000 INFO:teuthology.orchestra.run.smithi078.stdout: "jaeger_agent_port": "6799", 2024-04-18T21:05:21.000 INFO:teuthology.orchestra.run.smithi078.stdout: "jaeger_tracing_enable": "false", 2024-04-18T21:05:21.000 INFO:teuthology.orchestra.run.smithi078.stdout: "journal_aio": "true", 2024-04-18T21:05:21.001 INFO:teuthology.orchestra.run.smithi078.stdout: "journal_align_min_size": "65536", 2024-04-18T21:05:21.001 INFO:teuthology.orchestra.run.smithi078.stdout: "journal_block_align": "true", 2024-04-18T21:05:21.001 INFO:teuthology.orchestra.run.smithi078.stdout: "journal_block_size": "4096", 2024-04-18T21:05:21.001 INFO:teuthology.orchestra.run.smithi078.stdout: "journal_dio": "true", 2024-04-18T21:05:21.001 INFO:teuthology.orchestra.run.smithi078.stdout: "journal_discard": "false", 2024-04-18T21:05:21.001 INFO:teuthology.orchestra.run.smithi078.stdout: "journal_force_aio": "false", 2024-04-18T21:05:21.001 INFO:teuthology.orchestra.run.smithi078.stdout: "journal_ignore_corruption": "false", 2024-04-18T21:05:21.001 INFO:teuthology.orchestra.run.smithi078.stdout: "journal_max_write_bytes": "10485760", 2024-04-18T21:05:21.001 INFO:teuthology.orchestra.run.smithi078.stdout: "journal_max_write_entries": "100", 2024-04-18T21:05:21.001 INFO:teuthology.orchestra.run.smithi078.stdout: "journal_replay_from": "0", 2024-04-18T21:05:21.001 INFO:teuthology.orchestra.run.smithi078.stdout: "journal_throttle_high_multiple": "0.000000", 2024-04-18T21:05:21.001 INFO:teuthology.orchestra.run.smithi078.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-04-18T21:05:21.001 INFO:teuthology.orchestra.run.smithi078.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-04-18T21:05:21.001 INFO:teuthology.orchestra.run.smithi078.stdout: "journal_throttle_max_multiple": "0.000000", 2024-04-18T21:05:21.002 INFO:teuthology.orchestra.run.smithi078.stdout: "journal_write_header_frequency": "0", 2024-04-18T21:05:21.002 INFO:teuthology.orchestra.run.smithi078.stdout: "journal_zero_on_create": "false", 2024-04-18T21:05:21.002 INFO:teuthology.orchestra.run.smithi078.stdout: "journaler_prefetch_periods": "10", 2024-04-18T21:05:21.002 INFO:teuthology.orchestra.run.smithi078.stdout: "journaler_prezero_periods": "5", 2024-04-18T21:05:21.002 INFO:teuthology.orchestra.run.smithi078.stdout: "journaler_write_head_interval": "15", 2024-04-18T21:05:21.002 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "", 2024-04-18T21:05:21.002 INFO:teuthology.orchestra.run.smithi078.stdout: "keyfile": "", 2024-04-18T21:05:21.002 INFO:teuthology.orchestra.run.smithi078.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-04-18T21:05:21.002 INFO:teuthology.orchestra.run.smithi078.stdout: "kstore_backend": "rocksdb", 2024-04-18T21:05:21.002 INFO:teuthology.orchestra.run.smithi078.stdout: "kstore_default_stripe_size": "65536", 2024-04-18T21:05:21.002 INFO:teuthology.orchestra.run.smithi078.stdout: "kstore_fsck_on_mount": "false", 2024-04-18T21:05:21.002 INFO:teuthology.orchestra.run.smithi078.stdout: "kstore_fsck_on_mount_deep": "true", 2024-04-18T21:05:21.002 INFO:teuthology.orchestra.run.smithi078.stdout: "kstore_max_bytes": "67108864", 2024-04-18T21:05:21.002 INFO:teuthology.orchestra.run.smithi078.stdout: "kstore_max_ops": "512", 2024-04-18T21:05:21.003 INFO:teuthology.orchestra.run.smithi078.stdout: "kstore_nid_prealloc": "1024", 2024-04-18T21:05:21.003 INFO:teuthology.orchestra.run.smithi078.stdout: "kstore_onode_map_size": "1024", 2024-04-18T21:05:21.003 INFO:teuthology.orchestra.run.smithi078.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-04-18T21:05:21.003 INFO:teuthology.orchestra.run.smithi078.stdout: "kstore_sync_submit_transaction": "false", 2024-04-18T21:05:21.003 INFO:teuthology.orchestra.run.smithi078.stdout: "kstore_sync_transaction": "false", 2024-04-18T21:05:21.003 INFO:teuthology.orchestra.run.smithi078.stdout: "librados_thread_count": "2", 2024-04-18T21:05:21.003 INFO:teuthology.orchestra.run.smithi078.stdout: "lockdep": "false", 2024-04-18T21:05:21.003 INFO:teuthology.orchestra.run.smithi078.stdout: "lockdep_force_backtrace": "false", 2024-04-18T21:05:21.003 INFO:teuthology.orchestra.run.smithi078.stdout: "log_coarse_timestamps": "true", 2024-04-18T21:05:21.003 INFO:teuthology.orchestra.run.smithi078.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-04-18T21:05:21.003 INFO:teuthology.orchestra.run.smithi078.stdout: "log_flush_on_exit": "false", 2024-04-18T21:05:21.003 INFO:teuthology.orchestra.run.smithi078.stdout: "log_graylog_host": "127.0.0.1", 2024-04-18T21:05:21.003 INFO:teuthology.orchestra.run.smithi078.stdout: "log_graylog_port": "12201", 2024-04-18T21:05:21.003 INFO:teuthology.orchestra.run.smithi078.stdout: "log_max_new": "1000", 2024-04-18T21:05:21.004 INFO:teuthology.orchestra.run.smithi078.stdout: "log_max_recent": "10000", 2024-04-18T21:05:21.004 INFO:teuthology.orchestra.run.smithi078.stdout: "log_stderr_prefix": "", 2024-04-18T21:05:21.004 INFO:teuthology.orchestra.run.smithi078.stdout: "log_stop_at_utilization": "0.970000", 2024-04-18T21:05:21.004 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": "true", 2024-04-18T21:05:21.004 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_graylog": "false", 2024-04-18T21:05:21.004 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_journald": "false", 2024-04-18T21:05:21.004 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_stderr": "false", 2024-04-18T21:05:21.004 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_syslog": "false", 2024-04-18T21:05:21.004 INFO:teuthology.orchestra.run.smithi078.stdout: "max_rotating_auth_attempts": "10", 2024-04-18T21:05:21.004 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-04-18T21:05:21.004 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_action_on_write_error": "1", 2024-04-18T21:05:21.004 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_alternate_name_max": "8192", 2024-04-18T21:05:21.004 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_asio_thread_count": "2", 2024-04-18T21:05:21.004 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_bal_export_pin": "true", 2024-04-18T21:05:21.005 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_bal_fragment_dirs": "true", 2024-04-18T21:05:21.005 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-04-18T21:05:21.005 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_bal_fragment_interval": "5", 2024-04-18T21:05:21.005 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_bal_fragment_size_max": "100000", 2024-04-18T21:05:21.005 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_bal_idle_threshold": "0.000000", 2024-04-18T21:05:21.005 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_bal_interval": "10", 2024-04-18T21:05:21.005 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_bal_max": "-1", 2024-04-18T21:05:21.005 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_bal_max_until": "-1", 2024-04-18T21:05:21.005 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_bal_merge_size": "50", 2024-04-18T21:05:21.005 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_bal_midchunk": "0.300000", 2024-04-18T21:05:21.005 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_bal_min_rebalance": "0.100000", 2024-04-18T21:05:21.005 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_bal_min_start": "0.200000", 2024-04-18T21:05:21.005 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_bal_minchunk": "0.001000", 2024-04-18T21:05:21.005 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_bal_mode": "0", 2024-04-18T21:05:21.006 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_bal_need_max": "1.200000", 2024-04-18T21:05:21.006 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_bal_need_min": "0.800000", 2024-04-18T21:05:21.006 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_bal_overload_epochs": "2", 2024-04-18T21:05:21.006 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-04-18T21:05:21.006 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_bal_sample_interval": "3.000000", 2024-04-18T21:05:21.006 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_bal_split_bits": "3", 2024-04-18T21:05:21.006 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_bal_split_rd": "25000.000000", 2024-04-18T21:05:21.006 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_bal_split_size": "10000", 2024-04-18T21:05:21.006 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_bal_split_wr": "10000.000000", 2024-04-18T21:05:21.006 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_bal_target_decay": "10.000000", 2024-04-18T21:05:21.006 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-04-18T21:05:21.006 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_beacon_grace": "15.000000", 2024-04-18T21:05:21.006 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_beacon_interval": "4.000000", 2024-04-18T21:05:21.007 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_beacon_mon_down_grace": "60", 2024-04-18T21:05:21.007 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_cache_memory_limit": "4294967296", 2024-04-18T21:05:21.007 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_cache_mid": "0.700000", 2024-04-18T21:05:21.007 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-04-18T21:05:21.007 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_cache_quiesce_delay": "0", 2024-04-18T21:05:21.007 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_cache_quiesce_sleep": "200", 2024-04-18T21:05:21.007 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_cache_quiesce_splitauth": "true", 2024-04-18T21:05:21.007 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_cache_quiesce_threshold": "524288", 2024-04-18T21:05:21.007 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_cache_release_free_interval": "10", 2024-04-18T21:05:21.007 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_cache_reservation": "0.050000", 2024-04-18T21:05:21.007 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-04-18T21:05:21.007 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_cache_trim_interval": "1", 2024-04-18T21:05:21.007 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_cache_trim_threshold": "262144", 2024-04-18T21:05:21.007 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-04-18T21:05:21.008 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-04-18T21:05:21.008 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_client_delegate_inos_pct": "50", 2024-04-18T21:05:21.008 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_client_prealloc_inos": "1000", 2024-04-18T21:05:21.008 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-04-18T21:05:21.008 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_connect_bootstrapping": "false", 2024-04-18T21:05:21.008 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_damage_table_max_entries": "10000", 2024-04-18T21:05:21.008 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-04-18T21:05:21.008 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_debug_auth_pins": "false", 2024-04-18T21:05:21.008 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_debug_frag": "false", 2024-04-18T21:05:21.008 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_debug_scatterstat": "false", 2024-04-18T21:05:21.008 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_debug_subtrees": "false", 2024-04-18T21:05:21.008 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_decay_halflife": "5.000000", 2024-04-18T21:05:21.008 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_default_dir_hash": "2", 2024-04-18T21:05:21.008 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_defer_session_stale": "true", 2024-04-18T21:05:21.009 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_deny_all_reconnect": "false", 2024-04-18T21:05:21.009 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_dir_keys_per_op": "16384", 2024-04-18T21:05:21.009 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_dir_max_commit_size": "10", 2024-04-18T21:05:21.009 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_dir_max_entries": "0", 2024-04-18T21:05:21.009 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_dir_prefetch": "true", 2024-04-18T21:05:21.009 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_dirstat_min_interval": "1.000000", 2024-04-18T21:05:21.009 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_dump_cache_after_rejoin": "false", 2024-04-18T21:05:21.009 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_dump_cache_on_map": "false", 2024-04-18T21:05:21.009 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_dump_cache_threshold_file": "0", 2024-04-18T21:05:21.009 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-04-18T21:05:21.009 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_early_reply": "true", 2024-04-18T21:05:21.009 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_enable_op_tracker": "true", 2024-04-18T21:05:21.009 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_enforce_unique_name": "true", 2024-04-18T21:05:21.009 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_export_ephemeral_distributed": "true", 2024-04-18T21:05:21.010 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-04-18T21:05:21.010 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_export_ephemeral_random": "true", 2024-04-18T21:05:21.010 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-04-18T21:05:21.010 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-04-18T21:05:21.010 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_forward_all_requests_to_auth": "false", 2024-04-18T21:05:21.010 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-04-18T21:05:21.010 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-04-18T21:05:21.010 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-04-18T21:05:21.010 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-04-18T21:05:21.010 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_health_cache_threshold": "1.500000", 2024-04-18T21:05:21.010 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_health_summarize_threshold": "10", 2024-04-18T21:05:21.010 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_heartbeat_grace": "15.000000", 2024-04-18T21:05:21.010 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_heartbeat_reset_grace": "1000", 2024-04-18T21:05:21.010 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_inject_health_dummy": "false", 2024-04-18T21:05:21.011 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-04-18T21:05:21.011 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_inject_migrator_session_race": "false", 2024-04-18T21:05:21.011 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-04-18T21:05:21.011 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-04-18T21:05:21.011 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-04-18T21:05:21.011 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_join_fs": "", 2024-04-18T21:05:21.011 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_journal_format": "1", 2024-04-18T21:05:21.011 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_kill_create_at": "0", 2024-04-18T21:05:21.011 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_kill_export_at": "0", 2024-04-18T21:05:21.011 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_kill_import_at": "0", 2024-04-18T21:05:21.011 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_kill_journal_at": "0", 2024-04-18T21:05:21.011 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_kill_journal_expire_at": "0", 2024-04-18T21:05:21.011 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_kill_journal_replay_at": "0", 2024-04-18T21:05:21.011 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_kill_link_at": "0", 2024-04-18T21:05:21.012 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_kill_mdstable_at": "0", 2024-04-18T21:05:21.012 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_kill_openc_at": "0", 2024-04-18T21:05:21.012 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_kill_rename_at": "0", 2024-04-18T21:05:21.012 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_kill_shutdown_at": "0", 2024-04-18T21:05:21.012 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_kill_skip_replaying_inotable": "false", 2024-04-18T21:05:21.012 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_log_event_large_threshold": "524288", 2024-04-18T21:05:21.012 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_log_events_per_segment": "1024", 2024-04-18T21:05:21.012 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_log_major_segment_event_ratio": "12", 2024-04-18T21:05:21.012 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_log_max_events": "-1", 2024-04-18T21:05:21.012 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_log_max_segments": "128", 2024-04-18T21:05:21.012 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_log_pause": "false", 2024-04-18T21:05:21.012 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_log_segment_size": "0", 2024-04-18T21:05:21.012 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_log_skip_corrupt_events": "false", 2024-04-18T21:05:21.012 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_log_skip_unbounded_events": "false", 2024-04-18T21:05:21.013 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-04-18T21:05:21.013 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_log_trim_threshold": "128", 2024-04-18T21:05:21.013 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-04-18T21:05:21.013 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_log_warn_factor": "2.000000", 2024-04-18T21:05:21.013 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_max_caps_per_client": "1048576", 2024-04-18T21:05:21.013 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_max_completed_flushes": "100000", 2024-04-18T21:05:21.013 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_max_completed_requests": "100000", 2024-04-18T21:05:21.013 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_max_export_size": "20971520", 2024-04-18T21:05:21.013 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_max_file_recover": "32", 2024-04-18T21:05:21.013 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_max_purge_files": "64", 2024-04-18T21:05:21.013 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_max_purge_ops": "8192", 2024-04-18T21:05:21.013 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-04-18T21:05:21.013 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-04-18T21:05:21.013 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_max_snaps_per_dir": "100", 2024-04-18T21:05:21.014 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_metrics_update_interval": "2", 2024-04-18T21:05:21.014 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_min_caps_per_client": "100", 2024-04-18T21:05:21.014 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_min_caps_working_set": "10000", 2024-04-18T21:05:21.014 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-04-18T21:05:21.014 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_numa_node": "-1", 2024-04-18T21:05:21.014 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-04-18T21:05:21.014 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_op_complaint_time": "30.000000", 2024-04-18T21:05:21.014 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_op_history_duration": "600", 2024-04-18T21:05:21.014 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_op_history_size": "20", 2024-04-18T21:05:21.014 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_op_history_slow_op_size": "20", 2024-04-18T21:05:21.014 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_op_history_slow_op_threshold": "10", 2024-04-18T21:05:21.014 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_op_log_threshold": "5", 2024-04-18T21:05:21.014 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_ping_grace": "15", 2024-04-18T21:05:21.014 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_ping_interval": "5", 2024-04-18T21:05:21.015 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-04-18T21:05:21.015 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-04-18T21:05:21.015 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_recall_max_caps": "30000", 2024-04-18T21:05:21.015 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-04-18T21:05:21.015 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_recall_max_decay_threshold": "131072", 2024-04-18T21:05:21.015 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-04-18T21:05:21.015 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_recall_warning_threshold": "262144", 2024-04-18T21:05:21.015 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_reconnect_timeout": "45.000000", 2024-04-18T21:05:21.015 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_replay_interval": "1.000000", 2024-04-18T21:05:21.015 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-04-18T21:05:21.015 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-04-18T21:05:21.015 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_root_ino_gid": "0", 2024-04-18T21:05:21.015 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_root_ino_uid": "0", 2024-04-18T21:05:21.015 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-04-18T21:05:21.016 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_session_blocklist_on_evict": "true", 2024-04-18T21:05:21.016 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_session_blocklist_on_timeout": "true", 2024-04-18T21:05:21.016 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-04-18T21:05:21.016 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-04-18T21:05:21.016 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-04-18T21:05:21.016 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-04-18T21:05:21.016 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-04-18T21:05:21.016 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_session_metadata_threshold": "16777216", 2024-04-18T21:05:21.016 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-04-18T21:05:21.016 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_shutdown_check": "0", 2024-04-18T21:05:21.016 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_skip_ino": "0", 2024-04-18T21:05:21.016 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_sleep_rank_change": "0.000000", 2024-04-18T21:05:21.016 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_snap_max_uid": "4294967294", 2024-04-18T21:05:21.016 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_snap_min_uid": "0", 2024-04-18T21:05:21.017 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_snap_rstat": "false", 2024-04-18T21:05:21.017 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_standby_replay_damaged": "false", 2024-04-18T21:05:21.017 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_symlink_recovery": "true", 2024-04-18T21:05:21.017 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_task_status_update_interval": "2.000000", 2024-04-18T21:05:21.017 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_thrash_exports": "0", 2024-04-18T21:05:21.017 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_thrash_fragments": "0", 2024-04-18T21:05:21.017 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_tick_interval": "5.000000", 2024-04-18T21:05:21.017 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_valgrind_exit": "false", 2024-04-18T21:05:21.017 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_verify_backtrace": "1", 2024-04-18T21:05:21.017 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_verify_scatter": "false", 2024-04-18T21:05:21.017 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_wipe_ino_prealloc": "false", 2024-04-18T21:05:21.017 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_wipe_sessions": "false", 2024-04-18T21:05:21.017 INFO:teuthology.orchestra.run.smithi078.stdout: "mempool_debug": "false", 2024-04-18T21:05:21.017 INFO:teuthology.orchestra.run.smithi078.stdout: "memstore_debug_omit_block_device_write": "false", 2024-04-18T21:05:21.018 INFO:teuthology.orchestra.run.smithi078.stdout: "memstore_device_bytes": "1073741824", 2024-04-18T21:05:21.018 INFO:teuthology.orchestra.run.smithi078.stdout: "memstore_page_set": "false", 2024-04-18T21:05:21.018 INFO:teuthology.orchestra.run.smithi078.stdout: "memstore_page_size": "65536", 2024-04-18T21:05:21.018 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr_client_bytes": "134217728", 2024-04-18T21:05:21.018 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr_client_messages": "512", 2024-04-18T21:05:21.018 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-04-18T21:05:21.018 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr_connect_retry_interval": "1.000000", 2024-04-18T21:05:21.018 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-04-18T21:05:21.018 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-04-18T21:05:21.018 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr_disabled_modules": "", 2024-04-18T21:05:21.018 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-04-18T21:05:21.018 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr_max_pg_creating": "1024", 2024-04-18T21:05:21.018 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr_max_pg_num_change": "128", 2024-04-18T21:05:21.018 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr_mds_bytes": "134217728", 2024-04-18T21:05:21.019 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr_mds_messages": "128", 2024-04-18T21:05:21.019 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-04-18T21:05:21.019 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr_mon_bytes": "134217728", 2024-04-18T21:05:21.019 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr_mon_messages": "128", 2024-04-18T21:05:21.019 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr_osd_bytes": "536870912", 2024-04-18T21:05:21.019 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr_osd_messages": "8192", 2024-04-18T21:05:21.019 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr_pool": "true", 2024-04-18T21:05:21.019 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr_service_beacon_grace": "60.000000", 2024-04-18T21:05:21.019 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr_standby_modules": "true", 2024-04-18T21:05:21.019 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr_stats_period": "5", 2024-04-18T21:05:21.019 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr_stats_threshold": "5", 2024-04-18T21:05:21.019 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr_tick_period": "2", 2024-04-18T21:05:21.019 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-04-18T21:05:21.019 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_accept_timeout_factor": "2.000000", 2024-04-18T21:05:21.020 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_allow_pool_delete": "true", 2024-04-18T21:05:21.020 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_allow_pool_size_one": "true", 2024-04-18T21:05:21.020 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_auth_validate_all_caps": "true", 2024-04-18T21:05:21.020 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-04-18T21:05:21.020 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-04-18T21:05:21.020 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_client_bytes": "104857600", 2024-04-18T21:05:21.020 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_client_directed_command_retry": "2", 2024-04-18T21:05:21.020 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_client_hunt_interval": "3.000000", 2024-04-18T21:05:21.020 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-04-18T21:05:21.020 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-04-18T21:05:21.020 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-04-18T21:05:21.020 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_client_hunt_parallel": "3", 2024-04-18T21:05:21.020 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_client_log_interval": "1.000000", 2024-04-18T21:05:21.020 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-04-18T21:05:21.020 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_client_ping_interval": "10.000000", 2024-04-18T21:05:21.021 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_client_ping_timeout": "30.000000", 2024-04-18T21:05:21.021 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_client_target_rank": "-1", 2024-04-18T21:05:21.021 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_clock_drift_allowed": "1.000000", 2024-04-18T21:05:21.021 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-04-18T21:05:21.021 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-04-18T21:05:21.021 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_cluster_log_level": "debug", 2024-04-18T21:05:21.021 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_cluster_log_to_file": "true", 2024-04-18T21:05:21.021 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_cluster_log_to_graylog": "false", 2024-04-18T21:05:21.021 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-04-18T21:05:21.021 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-04-18T21:05:21.021 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_cluster_log_to_journald": "false", 2024-04-18T21:05:21.021 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_cluster_log_to_stderr": "false", 2024-04-18T21:05:21.021 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-04-18T21:05:21.021 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-04-18T21:05:21.022 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_compact_on_bootstrap": "false", 2024-04-18T21:05:21.022 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_compact_on_start": "false", 2024-04-18T21:05:21.022 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_compact_on_trim": "true", 2024-04-18T21:05:21.022 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_con_tracker_persist_interval": "10", 2024-04-18T21:05:21.022 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_con_tracker_score_halflife": "43200", 2024-04-18T21:05:21.022 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_config_key_max_entry_size": "65536", 2024-04-18T21:05:21.022 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_cpu_threads": "4", 2024-04-18T21:05:21.022 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_crush_min_required_version": "hammer", 2024-04-18T21:05:21.022 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_daemon_bytes": "419430400", 2024-04-18T21:05:21.022 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-04-18T21:05:21.022 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_data_avail_crit": "5", 2024-04-18T21:05:21.022 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_data_avail_warn": "5", 2024-04-18T21:05:21.022 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_data_size_warn": "16106127360", 2024-04-18T21:05:21.023 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_debug_block_osdmap_trim": "false", 2024-04-18T21:05:21.023 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-04-18T21:05:21.023 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_debug_dump_json": "false", 2024-04-18T21:05:21.023 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-04-18T21:05:21.023 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_debug_dump_transactions": "false", 2024-04-18T21:05:21.023 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_debug_extra_checks": "false", 2024-04-18T21:05:21.023 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-04-18T21:05:21.023 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-04-18T21:05:21.023 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_debug_no_require_reef": "false", 2024-04-18T21:05:21.023 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_debug_no_require_squid": "false", 2024-04-18T21:05:21.023 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-04-18T21:05:21.023 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_delta_reset_interval": "10.000000", 2024-04-18T21:05:21.023 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_dns_srv_name": "ceph-mon", 2024-04-18T21:05:21.023 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_down_mkfs_grace": "120", 2024-04-18T21:05:21.024 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_down_uptime_grace": "60", 2024-04-18T21:05:21.024 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_election_default_strategy": "1", 2024-04-18T21:05:21.024 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_election_timeout": "5.000000", 2024-04-18T21:05:21.024 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-04-18T21:05:21.024 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_elector_ping_divisor": "2", 2024-04-18T21:05:21.024 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_elector_ping_timeout": "2.000000", 2024-04-18T21:05:21.024 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_enable_op_tracker": "true", 2024-04-18T21:05:21.024 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_fake_pool_delete": "false", 2024-04-18T21:05:21.024 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_force_quorum_join": "false", 2024-04-18T21:05:21.024 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_globalid_prealloc": "10000", 2024-04-18T21:05:21.024 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_health_detail_to_clog": "false", 2024-04-18T21:05:21.024 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_health_log_update_period": "5", 2024-04-18T21:05:21.024 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_health_max_detail": "50", 2024-04-18T21:05:21.024 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_health_to_clog": "true", 2024-04-18T21:05:21.025 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_health_to_clog_interval": "600", 2024-04-18T21:05:21.025 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-04-18T21:05:21.025 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_host": "172.21.15.78,[v2:172.21.15.78:3301,v1:172.21.15.78:6790],[v2:172.21.15.78:3302,v1:172.21.15.78:6791]", 2024-04-18T21:05:21.025 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_host_override": "", 2024-04-18T21:05:21.025 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_initial_members": "", 2024-04-18T21:05:21.025 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-04-18T21:05:21.025 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-04-18T21:05:21.025 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-04-18T21:05:21.025 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-04-18T21:05:21.025 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_keyvaluedb": "rocksdb", 2024-04-18T21:05:21.025 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_lease": "5.000000", 2024-04-18T21:05:21.025 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-04-18T21:05:21.025 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-04-18T21:05:21.025 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_log_full_interval": "50", 2024-04-18T21:05:21.026 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_log_max": "10000", 2024-04-18T21:05:21.026 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_log_max_summary": "50", 2024-04-18T21:05:21.026 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_max_log_entries_per_event": "4096", 2024-04-18T21:05:21.026 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_max_log_epochs": "500", 2024-04-18T21:05:21.026 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_max_mdsmap_epochs": "500", 2024-04-18T21:05:21.026 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_max_mgrmap_epochs": "500", 2024-04-18T21:05:21.026 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_max_osd": "10000", 2024-04-18T21:05:21.026 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_max_pg_per_osd": "10000", 2024-04-18T21:05:21.026 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_max_pool_pg_num": "65536", 2024-04-18T21:05:21.026 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-04-18T21:05:21.026 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-04-18T21:05:21.026 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_mds_force_trim_to": "0", 2024-04-18T21:05:21.026 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_mds_skip_sanity": "false", 2024-04-18T21:05:21.027 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_memory_autotune": "true", 2024-04-18T21:05:21.027 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_memory_target": "2147483648", 2024-04-18T21:05:21.027 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_mgr_beacon_grace": "30", 2024-04-18T21:05:21.027 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-04-18T21:05:21.027 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_mgr_digest_period": "5", 2024-04-18T21:05:21.027 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_mgr_inactive_grace": "60", 2024-04-18T21:05:21.027 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_mgr_mkfs_grace": "240", 2024-04-18T21:05:21.027 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-04-18T21:05:21.027 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_min_osdmap_epochs": "500", 2024-04-18T21:05:21.027 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_op_complaint_time": "30", 2024-04-18T21:05:21.027 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_op_history_duration": "600", 2024-04-18T21:05:21.027 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_op_history_size": "20", 2024-04-18T21:05:21.027 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_op_history_slow_op_size": "20", 2024-04-18T21:05:21.027 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_op_history_slow_op_threshold": "10", 2024-04-18T21:05:21.027 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_op_log_threshold": "5", 2024-04-18T21:05:21.028 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-04-18T21:05:21.028 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-04-18T21:05:21.028 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-04-18T21:05:21.028 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_osd_auto_mark_in": "false", 2024-04-18T21:05:21.028 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_osd_auto_mark_new_in": "true", 2024-04-18T21:05:21.028 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-04-18T21:05:21.028 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-04-18T21:05:21.028 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_osd_cache_size": "500", 2024-04-18T21:05:21.028 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_osd_cache_size_min": "134217728", 2024-04-18T21:05:21.028 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_osd_crush_smoke_test": "true", 2024-04-18T21:05:21.028 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_osd_destroyed_out_interval": "600", 2024-04-18T21:05:21.028 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_osd_down_out_interval": "600", 2024-04-18T21:05:21.028 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-04-18T21:05:21.028 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-04-18T21:05:21.029 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_osd_force_trim_to": "0", 2024-04-18T21:05:21.029 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_osd_full_ratio": "0.950000", 2024-04-18T21:05:21.029 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-04-18T21:05:21.029 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_osd_laggy_halflife": "3600", 2024-04-18T21:05:21.029 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_osd_laggy_max_interval": "300", 2024-04-18T21:05:21.029 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_osd_laggy_weight": "0.300000", 2024-04-18T21:05:21.029 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-04-18T21:05:21.029 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_osd_max_initial_pgs": "1024", 2024-04-18T21:05:21.029 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_osd_min_down_reporters": "2", 2024-04-18T21:05:21.029 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-04-18T21:05:21.029 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-04-18T21:05:21.029 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-04-18T21:05:21.029 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_osd_prime_pg_temp": "true", 2024-04-18T21:05:21.029 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-04-18T21:05:21.030 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-04-18T21:05:21.030 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_osd_report_timeout": "900", 2024-04-18T21:05:21.030 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-04-18T21:05:21.030 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-04-18T21:05:21.030 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_osd_warn_num_repaired": "10", 2024-04-18T21:05:21.030 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_osd_warn_op_age": "32.000000", 2024-04-18T21:05:21.030 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-04-18T21:05:21.030 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_osdmap_full_prune_interval": "10", 2024-04-18T21:05:21.030 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_osdmap_full_prune_min": "10000", 2024-04-18T21:05:21.030 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-04-18T21:05:21.030 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-04-18T21:05:21.030 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_pg_stuck_threshold": "60", 2024-04-18T21:05:21.030 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-04-18T21:05:21.030 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_pg_warn_min_objects": "10000", 2024-04-18T21:05:21.031 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_pg_warn_min_per_osd": "0", 2024-04-18T21:05:21.031 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-04-18T21:05:21.031 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_pool_quota_crit_threshold": "0", 2024-04-18T21:05:21.031 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_pool_quota_warn_threshold": "0", 2024-04-18T21:05:21.031 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_probe_timeout": "2.000000", 2024-04-18T21:05:21.031 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_reweight_max_change": "0.050000", 2024-04-18T21:05:21.031 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_reweight_max_osds": "4", 2024-04-18T21:05:21.031 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-04-18T21:05:21.031 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-04-18T21:05:21.031 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-04-18T21:05:21.031 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-04-18T21:05:21.031 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-04-18T21:05:21.031 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_scrub_interval": "86400", 2024-04-18T21:05:21.031 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_scrub_max_keys": "100", 2024-04-18T21:05:21.032 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_scrub_timeout": "300", 2024-04-18T21:05:21.032 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_session_timeout": "300", 2024-04-18T21:05:21.032 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_smart_report_timeout": "5", 2024-04-18T21:05:21.032 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_stat_smooth_intervals": "6", 2024-04-18T21:05:21.032 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-04-18T21:05:21.032 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_stretch_pool_min_size": "2", 2024-04-18T21:05:21.032 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_stretch_pool_size": "4", 2024-04-18T21:05:21.032 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-04-18T21:05:21.032 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_subscribe_interval": "86400.000000", 2024-04-18T21:05:21.032 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_sync_debug": "false", 2024-04-18T21:05:21.032 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_sync_max_payload_keys": "2000", 2024-04-18T21:05:21.032 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_sync_max_payload_size": "1048576", 2024-04-18T21:05:21.032 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_sync_provider_kill_at": "0", 2024-04-18T21:05:21.032 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_sync_requester_kill_at": "0", 2024-04-18T21:05:21.033 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_sync_timeout": "60.000000", 2024-04-18T21:05:21.033 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_target_pg_per_osd": "100", 2024-04-18T21:05:21.033 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_tick_interval": "5", 2024-04-18T21:05:21.033 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_timecheck_interval": "300.000000", 2024-04-18T21:05:21.033 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-04-18T21:05:21.033 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_use_min_delay_socket": "false", 2024-04-18T21:05:21.033 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_warn_older_version_delay": "604800", 2024-04-18T21:05:21.033 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-04-18T21:05:21.033 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-04-18T21:05:21.033 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-04-18T21:05:21.033 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_warn_on_filestore_osds": "false", 2024-04-18T21:05:21.033 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-04-18T21:05:21.033 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-04-18T21:05:21.033 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-04-18T21:05:21.033 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_warn_on_misplaced": "false", 2024-04-18T21:05:21.034 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-04-18T21:05:21.034 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_warn_on_older_version": "true", 2024-04-18T21:05:21.034 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-04-18T21:05:21.034 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_warn_on_pool_no_app": "true", 2024-04-18T21:05:21.034 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-04-18T21:05:21.034 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-04-18T21:05:21.034 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-04-18T21:05:21.034 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-04-18T21:05:21.034 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_warn_on_too_few_osds": "false", 2024-04-18T21:05:21.034 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-04-18T21:05:21.034 INFO:teuthology.orchestra.run.smithi078.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-04-18T21:05:21.034 INFO:teuthology.orchestra.run.smithi078.stdout: "monmap": "", 2024-04-18T21:05:21.034 INFO:teuthology.orchestra.run.smithi078.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-18T21:05:21.035 INFO:teuthology.orchestra.run.smithi078.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-04-18T21:05:21.035 INFO:teuthology.orchestra.run.smithi078.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-04-18T21:05:21.035 INFO:teuthology.orchestra.run.smithi078.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-18T21:05:21.035 INFO:teuthology.orchestra.run.smithi078.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-04-18T21:05:21.035 INFO:teuthology.orchestra.run.smithi078.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-04-18T21:05:21.035 INFO:teuthology.orchestra.run.smithi078.stdout: "motr_tracing_enabled": "false", 2024-04-18T21:05:21.035 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_async_op_threads": "3", 2024-04-18T21:05:21.035 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_async_rdma_buffer_size": "131072", 2024-04-18T21:05:21.035 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_async_rdma_cm": "false", 2024-04-18T21:05:21.035 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_async_rdma_device_name": "", 2024-04-18T21:05:21.035 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_async_rdma_dscp": "96", 2024-04-18T21:05:21.035 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-04-18T21:05:21.035 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_async_rdma_gid_idx": "0", 2024-04-18T21:05:21.035 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_async_rdma_local_gid": "", 2024-04-18T21:05:21.035 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_async_rdma_polling_us": "1000", 2024-04-18T21:05:21.036 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_async_rdma_port_num": "1", 2024-04-18T21:05:21.036 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-04-18T21:05:21.036 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-04-18T21:05:21.036 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_async_rdma_roce_ver": "1", 2024-04-18T21:05:21.036 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_async_rdma_send_buffers": "1024", 2024-04-18T21:05:21.036 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_async_rdma_sl": "3", 2024-04-18T21:05:21.036 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_async_rdma_support_srq": "true", 2024-04-18T21:05:21.036 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_async_rdma_type": "ib", 2024-04-18T21:05:21.036 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_async_reap_threshold": "5", 2024-04-18T21:05:21.036 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_bind_before_connect": "false", 2024-04-18T21:05:21.036 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_bind_ipv4": "true", 2024-04-18T21:05:21.036 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_bind_ipv6": "false", 2024-04-18T21:05:21.036 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_bind_msgr1": "true", 2024-04-18T21:05:21.036 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_bind_msgr2": "true", 2024-04-18T21:05:21.037 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_bind_port_max": "7568", 2024-04-18T21:05:21.037 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_bind_port_min": "6800", 2024-04-18T21:05:21.037 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_bind_prefer_ipv4": "false", 2024-04-18T21:05:21.037 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_bind_retry_count": "3", 2024-04-18T21:05:21.037 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_bind_retry_delay": "5", 2024-04-18T21:05:21.037 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_blackhole_client": "false", 2024-04-18T21:05:21.037 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_blackhole_mds": "false", 2024-04-18T21:05:21.037 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_blackhole_mgr": "false", 2024-04-18T21:05:21.037 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_blackhole_mon": "false", 2024-04-18T21:05:21.037 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_blackhole_osd": "false", 2024-04-18T21:05:21.037 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_client_mode": "crc secure", 2024-04-18T21:05:21.037 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_cluster_mode": "crc secure", 2024-04-18T21:05:21.037 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_cluster_type": "", 2024-04-18T21:05:21.037 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_compress_secure": "false", 2024-04-18T21:05:21.037 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_connection_idle_timeout": "900", 2024-04-18T21:05:21.038 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_connection_ready_timeout": "10", 2024-04-18T21:05:21.038 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_crc_data": "true", 2024-04-18T21:05:21.038 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_crc_header": "true", 2024-04-18T21:05:21.038 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_die_on_bad_msg": "false", 2024-04-18T21:05:21.038 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_die_on_bug": "true", 2024-04-18T21:05:21.038 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_die_on_old_message": "true", 2024-04-18T21:05:21.038 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_die_on_skipped_message": "false", 2024-04-18T21:05:21.038 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_die_on_unhandled_msg": "false", 2024-04-18T21:05:21.038 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-04-18T21:05:21.038 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_dpdk_coremask": "0xF", 2024-04-18T21:05:21.038 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-04-18T21:05:21.038 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_dpdk_devs_allowlist": "", 2024-04-18T21:05:21.038 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_dpdk_enable_tso": "true", 2024-04-18T21:05:21.039 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-04-18T21:05:21.039 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-04-18T21:05:21.039 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_dpdk_hugepages": "", 2024-04-18T21:05:21.039 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_dpdk_hw_flow_control": "true", 2024-04-18T21:05:21.039 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-04-18T21:05:21.039 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_dpdk_lro": "true", 2024-04-18T21:05:21.039 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_dpdk_memory_channel": "4", 2024-04-18T21:05:21.039 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-04-18T21:05:21.039 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_dpdk_pmd": "", 2024-04-18T21:05:21.039 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_dpdk_port_id": "0", 2024-04-18T21:05:21.039 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-04-18T21:05:21.039 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_dump_corrupt_message_level": "1", 2024-04-18T21:05:21.039 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_dump_on_send": "false", 2024-04-18T21:05:21.039 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_initial_backoff": "0.200000", 2024-04-18T21:05:21.039 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_inject_delay_max": "1.000000", 2024-04-18T21:05:21.040 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_inject_delay_probability": "0.000000", 2024-04-18T21:05:21.040 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_inject_delay_type": "", 2024-04-18T21:05:21.040 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_inject_internal_delays": "0.000000", 2024-04-18T21:05:21.040 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_inject_network_congestion": "0", 2024-04-18T21:05:21.040 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_inject_socket_failures": "0", 2024-04-18T21:05:21.040 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_learn_addr_from_peer": "true", 2024-04-18T21:05:21.040 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_max_accept_failures": "4", 2024-04-18T21:05:21.040 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_max_backoff": "15.000000", 2024-04-18T21:05:21.040 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_mon_client_mode": "secure crc", 2024-04-18T21:05:21.040 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_mon_cluster_mode": "secure crc", 2024-04-18T21:05:21.040 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_mon_service_mode": "secure crc", 2024-04-18T21:05:21.040 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_osd_compress_min_size": "1024", 2024-04-18T21:05:21.040 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_osd_compress_mode": "none", 2024-04-18T21:05:21.040 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_osd_compression_algorithm": "snappy", 2024-04-18T21:05:21.041 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-04-18T21:05:21.041 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_pq_min_cost": "65536", 2024-04-18T21:05:21.041 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_public_type": "", 2024-04-18T21:05:21.041 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_service_mode": "crc secure", 2024-04-18T21:05:21.041 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_tcp_listen_backlog": "512", 2024-04-18T21:05:21.041 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_tcp_nodelay": "true", 2024-04-18T21:05:21.041 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-04-18T21:05:21.041 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_tcp_rcvbuf": "0", 2024-04-18T21:05:21.041 INFO:teuthology.orchestra.run.smithi078.stdout: "ms_type": "async+posix", 2024-04-18T21:05:21.041 INFO:teuthology.orchestra.run.smithi078.stdout: "no_config_file": "false", 2024-04-18T21:05:21.041 INFO:teuthology.orchestra.run.smithi078.stdout: "objecter_completion_locks_per_session": "32", 2024-04-18T21:05:21.041 INFO:teuthology.orchestra.run.smithi078.stdout: "objecter_debug_inject_relock_delay": "false", 2024-04-18T21:05:21.041 INFO:teuthology.orchestra.run.smithi078.stdout: "objecter_inflight_op_bytes": "104857600", 2024-04-18T21:05:21.041 INFO:teuthology.orchestra.run.smithi078.stdout: "objecter_inflight_ops": "1024", 2024-04-18T21:05:21.042 INFO:teuthology.orchestra.run.smithi078.stdout: "objecter_inject_no_watch_ping": "false", 2024-04-18T21:05:21.042 INFO:teuthology.orchestra.run.smithi078.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-04-18T21:05:21.042 INFO:teuthology.orchestra.run.smithi078.stdout: "objecter_tick_interval": "5.000000", 2024-04-18T21:05:21.042 INFO:teuthology.orchestra.run.smithi078.stdout: "objecter_timeout": "10.000000", 2024-04-18T21:05:21.042 INFO:teuthology.orchestra.run.smithi078.stdout: "objectstore_blackhole": "false", 2024-04-18T21:05:21.042 INFO:teuthology.orchestra.run.smithi078.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-04-18T21:05:21.042 INFO:teuthology.orchestra.run.smithi078.stdout: "openssl_engine_opts": "", 2024-04-18T21:05:21.042 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_agent_delay_time": "5.000000", 2024-04-18T21:05:21.042 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_agent_hist_halflife": "1000", 2024-04-18T21:05:21.042 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_agent_max_low_ops": "2", 2024-04-18T21:05:21.042 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_agent_max_ops": "4", 2024-04-18T21:05:21.042 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-04-18T21:05:21.042 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_agent_quantize_effort": "0.100000", 2024-04-18T21:05:21.043 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_agent_slop": "0.020000", 2024-04-18T21:05:21.043 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-04-18T21:05:21.043 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_allow_recovery_below_min_size": "true", 2024-04-18T21:05:21.043 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_asio_thread_count": "2", 2024-04-18T21:05:21.043 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_async_recovery_min_cost": "100", 2024-04-18T21:05:21.043 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_auto_mark_unfound_lost": "false", 2024-04-18T21:05:21.043 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_backfill_retry_interval": "30.000000", 2024-04-18T21:05:21.043 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_backfill_scan_max": "512", 2024-04-18T21:05:21.043 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_backfill_scan_min": "64", 2024-04-18T21:05:21.043 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_backoff_on_degraded": "false", 2024-04-18T21:05:21.043 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_backoff_on_peering": "false", 2024-04-18T21:05:21.043 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_backoff_on_unfound": "true", 2024-04-18T21:05:21.043 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_beacon_report_interval": "300", 2024-04-18T21:05:21.043 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_bench_duration": "30", 2024-04-18T21:05:21.043 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-04-18T21:05:21.044 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_bench_max_block_size": "67108864", 2024-04-18T21:05:21.044 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_bench_small_size_max_iops": "100", 2024-04-18T21:05:21.044 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_blkin_trace_all": "false", 2024-04-18T21:05:21.044 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_blocked_scrub_grace_period": "120", 2024-04-18T21:05:21.044 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-04-18T21:05:21.044 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-04-18T21:05:21.044 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-04-18T21:05:21.044 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_check_for_log_corruption": "false", 2024-04-18T21:05:21.044 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-04-18T21:05:21.044 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-18T21:05:21.044 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-04-18T21:05:21.044 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-18T21:05:21.044 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_class_update_on_start": "true", 2024-04-18T21:05:21.044 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_client_message_cap": "256", 2024-04-18T21:05:21.045 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_client_message_size_cap": "524288000", 2024-04-18T21:05:21.045 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_client_op_priority": "63", 2024-04-18T21:05:21.045 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_client_watch_timeout": "30", 2024-04-18T21:05:21.045 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_command_max_records": "256", 2024-04-18T21:05:21.045 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_compact_on_start": "false", 2024-04-18T21:05:21.045 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-04-18T21:05:21.045 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_crush_chooseleaf_type": "0", 2024-04-18T21:05:21.045 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_crush_initial_weight": "-1.000000", 2024-04-18T21:05:21.045 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_crush_update_on_start": "true", 2024-04-18T21:05:21.045 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_crush_update_weight_set": "true", 2024-04-18T21:05:21.045 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-04-18T21:05:21.045 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-04-18T21:05:21.045 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-04-18T21:05:21.045 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_debug_drop_ping_duration": "0", 2024-04-18T21:05:21.045 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-04-18T21:05:21.046 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_debug_feed_pullee": "-1", 2024-04-18T21:05:21.046 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-04-18T21:05:21.046 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-04-18T21:05:21.046 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-04-18T21:05:21.046 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_debug_misdirected_ops": "false", 2024-04-18T21:05:21.046 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_debug_no_acting_change": "false", 2024-04-18T21:05:21.046 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_debug_no_purge_strays": "false", 2024-04-18T21:05:21.046 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_debug_op_order": "false", 2024-04-18T21:05:21.046 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_debug_pg_log_writeout": "false", 2024-04-18T21:05:21.046 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_debug_pretend_recovery_active": "false", 2024-04-18T21:05:21.046 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-04-18T21:05:21.046 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-04-18T21:05:21.047 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_debug_shutdown": "false", 2024-04-18T21:05:21.047 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-04-18T21:05:21.047 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-04-18T21:05:21.047 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_debug_trim_objects": "false", 2024-04-18T21:05:21.047 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_debug_verify_cached_snaps": "false", 2024-04-18T21:05:21.047 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_debug_verify_missing_on_start": "false", 2024-04-18T21:05:21.047 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_debug_verify_snaps": "false", 2024-04-18T21:05:21.047 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-04-18T21:05:21.047 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-04-18T21:05:21.047 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_deep_scrub_keys": "1024", 2024-04-18T21:05:21.047 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-04-18T21:05:21.047 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-04-18T21:05:21.047 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-04-18T21:05:21.047 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_deep_scrub_stride": "524288", 2024-04-18T21:05:21.048 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-04-18T21:05:21.048 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_default_data_pool_replay_window": "5", 2024-04-18T21:05:21.048 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_default_notify_timeout": "30", 2024-04-18T21:05:21.048 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_delete_sleep": "0.000000", 2024-04-18T21:05:21.048 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-04-18T21:05:21.048 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-04-18T21:05:21.048 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-04-18T21:05:21.048 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_discard_disconnected_ops": "true", 2024-04-18T21:05:21.048 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_enable_op_tracker": "true", 2024-04-18T21:05:21.048 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-04-18T21:05:21.048 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_extblkdev_plugins": "vdo", 2024-04-18T21:05:21.048 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-04-18T21:05:21.048 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-04-18T21:05:21.048 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_fast_info": "true", 2024-04-18T21:05:21.049 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_fast_shutdown": "true", 2024-04-18T21:05:21.049 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-04-18T21:05:21.049 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_fast_shutdown_timeout": "15", 2024-04-18T21:05:21.049 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-04-18T21:05:21.049 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-04-18T21:05:21.049 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-04-18T21:05:21.049 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_function_tracing": "false", 2024-04-18T21:05:21.049 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_heartbeat_grace": "20", 2024-04-18T21:05:21.049 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_heartbeat_interval": "6", 2024-04-18T21:05:21.049 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-04-18T21:05:21.049 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_heartbeat_min_peers": "10", 2024-04-18T21:05:21.049 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_heartbeat_min_size": "2000", 2024-04-18T21:05:21.049 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_heartbeat_stale": "600", 2024-04-18T21:05:21.049 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-04-18T21:05:21.050 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_hit_set_max_size": "100000", 2024-04-18T21:05:21.050 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_hit_set_min_size": "1000", 2024-04-18T21:05:21.050 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-04-18T21:05:21.050 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-04-18T21:05:21.050 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-04-18T21:05:21.050 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-04-18T21:05:21.050 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-04-18T21:05:21.050 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_journal_flush_on_shutdown": "true", 2024-04-18T21:05:21.050 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_journal_size": "5120", 2024-04-18T21:05:21.050 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_kill_backfill_at": "0", 2024-04-18T21:05:21.050 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_loop_before_reset_tphandle": "64", 2024-04-18T21:05:21.050 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_map_cache_size": "50", 2024-04-18T21:05:21.050 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_map_dedup": "true", 2024-04-18T21:05:21.050 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_map_message_max": "40", 2024-04-18T21:05:21.051 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_map_message_max_bytes": "10485760", 2024-04-18T21:05:21.051 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_map_share_max_epochs": "40", 2024-04-18T21:05:21.051 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_max_attr_name_len": "100", 2024-04-18T21:05:21.051 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_max_attr_size": "0", 2024-04-18T21:05:21.051 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_max_backfills": "1", 2024-04-18T21:05:21.051 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_max_markdown_count": "5", 2024-04-18T21:05:21.051 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_max_markdown_period": "600", 2024-04-18T21:05:21.051 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_max_object_name_len": "2048", 2024-04-18T21:05:21.051 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_max_object_namespace_len": "256", 2024-04-18T21:05:21.051 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_max_object_size": "134217728", 2024-04-18T21:05:21.051 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-04-18T21:05:21.051 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_max_omap_entries_per_request": "1024", 2024-04-18T21:05:21.051 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_max_pg_blocked_by": "16", 2024-04-18T21:05:21.051 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_max_pg_log_entries": "10000", 2024-04-18T21:05:21.051 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-04-18T21:05:21.052 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_max_pgls": "1024", 2024-04-18T21:05:21.052 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_max_push_cost": "8388608", 2024-04-18T21:05:21.052 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_max_push_objects": "10", 2024-04-18T21:05:21.052 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_max_scrubs": "3", 2024-04-18T21:05:21.052 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-04-18T21:05:21.052 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_max_trimming_pgs": "2", 2024-04-18T21:05:21.052 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_max_write_op_reply_len": "64", 2024-04-18T21:05:21.052 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_max_write_size": "90", 2024-04-18T21:05:21.052 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-04-18T21:05:21.052 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-04-18T21:05:21.052 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-04-18T21:05:21.052 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-04-18T21:05:21.052 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-04-18T21:05:21.052 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-04-18T21:05:21.053 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-04-18T21:05:21.053 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_mclock_override_recovery_settings": "false", 2024-04-18T21:05:21.053 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_mclock_profile": "balanced", 2024-04-18T21:05:21.053 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-04-18T21:05:21.053 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-04-18T21:05:21.053 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-04-18T21:05:21.053 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-04-18T21:05:21.053 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-04-18T21:05:21.053 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-04-18T21:05:21.053 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-04-18T21:05:21.053 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-04-18T21:05:21.053 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-04-18T21:05:21.053 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-04-18T21:05:21.053 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_mclock_skip_benchmark": "false", 2024-04-18T21:05:21.054 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_memory_base": "805306368", 2024-04-18T21:05:21.054 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_memory_cache_min": "134217728", 2024-04-18T21:05:21.054 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-04-18T21:05:21.054 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-04-18T21:05:21.054 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_memory_target": "4294967296", 2024-04-18T21:05:21.054 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_memory_target_autotune": "false", 2024-04-18T21:05:21.054 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-04-18T21:05:21.054 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_min_pg_log_entries": "250", 2024-04-18T21:05:21.054 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_min_recovery_priority": "0", 2024-04-18T21:05:21.054 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_mon_heartbeat_interval": "30", 2024-04-18T21:05:21.054 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-04-18T21:05:21.054 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_mon_report_interval": "5", 2024-04-18T21:05:21.054 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_mon_report_max_in_flight": "2", 2024-04-18T21:05:21.055 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-04-18T21:05:21.055 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_num_cache_shards": "32", 2024-04-18T21:05:21.055 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_num_op_tracker_shard": "32", 2024-04-18T21:05:21.055 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_numa_auto_affinity": "true", 2024-04-18T21:05:21.055 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_numa_node": "-1", 2024-04-18T21:05:21.055 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_numa_prefer_iface": "true", 2024-04-18T21:05:21.055 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-04-18T21:05:21.055 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_objecter_finishers": "1", 2024-04-18T21:05:21.055 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_objectstore": "bluestore", 2024-04-18T21:05:21.055 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_objectstore_fuse": "false", 2024-04-18T21:05:21.055 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_objectstore_tracing": "false", 2024-04-18T21:05:21.055 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_op_complaint_time": "30.000000", 2024-04-18T21:05:21.055 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_op_history_duration": "600", 2024-04-18T21:05:21.055 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_op_history_size": "20", 2024-04-18T21:05:21.055 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_op_history_slow_op_size": "20", 2024-04-18T21:05:21.056 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-04-18T21:05:21.056 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_op_log_threshold": "5", 2024-04-18T21:05:21.056 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_op_num_shards": "0", 2024-04-18T21:05:21.056 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_op_num_shards_hdd": "5", 2024-04-18T21:05:21.056 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_op_num_shards_ssd": "8", 2024-04-18T21:05:21.056 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_op_num_threads_per_shard": "0", 2024-04-18T21:05:21.056 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-04-18T21:05:21.056 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-04-18T21:05:21.056 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-04-18T21:05:21.056 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_op_pq_min_cost": "65536", 2024-04-18T21:05:21.056 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_op_queue": "mclock_scheduler", 2024-04-18T21:05:21.056 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_op_queue_cut_off": "high", 2024-04-18T21:05:21.056 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_op_thread_suicide_timeout": "150", 2024-04-18T21:05:21.056 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_op_thread_timeout": "15", 2024-04-18T21:05:21.057 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_open_classes_on_start": "true", 2024-04-18T21:05:21.057 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_os_flags": "0", 2024-04-18T21:05:21.057 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_peering_op_priority": "255", 2024-04-18T21:05:21.057 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_pg_delete_cost": "1048576", 2024-04-18T21:05:21.057 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_pg_delete_priority": "5", 2024-04-18T21:05:21.057 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-04-18T21:05:21.057 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-04-18T21:05:21.057 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_pg_log_dups_tracked": "3000", 2024-04-18T21:05:21.057 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_pg_log_trim_max": "10000", 2024-04-18T21:05:21.057 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_pg_log_trim_min": "100", 2024-04-18T21:05:21.057 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-04-18T21:05:21.057 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_pg_object_context_cache_count": "64", 2024-04-18T21:05:21.057 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-04-18T21:05:21.057 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-04-18T21:05:21.058 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-04-18T21:05:21.058 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-04-18T21:05:21.058 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-04-18T21:05:21.058 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-04-18T21:05:21.058 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-04-18T21:05:21.058 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-04-18T21:05:21.058 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_pool_default_crimson": "false", 2024-04-18T21:05:21.058 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_pool_default_crush_rule": "-1", 2024-04-18T21:05:21.058 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_pool_default_ec_fast_read": "false", 2024-04-18T21:05:21.058 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-04-18T21:05:21.058 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_pool_default_flag_bulk": "false", 2024-04-18T21:05:21.058 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-04-18T21:05:21.058 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_pool_default_flag_nodelete": "false", 2024-04-18T21:05:21.058 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-04-18T21:05:21.059 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-04-18T21:05:21.059 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_pool_default_flags": "0", 2024-04-18T21:05:21.059 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-04-18T21:05:21.059 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_pool_default_min_size": "0", 2024-04-18T21:05:21.059 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-04-18T21:05:21.059 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_pool_default_pg_num": "32", 2024-04-18T21:05:21.059 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_pool_default_pgp_num": "0", 2024-04-18T21:05:21.059 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-04-18T21:05:21.059 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_pool_default_read_ratio": "70", 2024-04-18T21:05:21.059 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_pool_default_size": "2", 2024-04-18T21:05:21.059 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_pool_default_type": "replicated", 2024-04-18T21:05:21.059 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-04-18T21:05:21.059 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_pool_use_gmt_hitset": "true", 2024-04-18T21:05:21.059 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_push_per_object_cost": "1000", 2024-04-18T21:05:21.060 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_read_ec_check_for_errors": "false", 2024-04-18T21:05:21.060 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_recover_clone_overlap": "true", 2024-04-18T21:05:21.060 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_recover_clone_overlap_limit": "10", 2024-04-18T21:05:21.060 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_recovery_cost": "20971520", 2024-04-18T21:05:21.060 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_recovery_delay_start": "0.000000", 2024-04-18T21:05:21.060 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_recovery_max_active": "0", 2024-04-18T21:05:21.060 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_recovery_max_active_hdd": "3", 2024-04-18T21:05:21.060 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_recovery_max_active_ssd": "10", 2024-04-18T21:05:21.060 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_recovery_max_chunk": "8388608", 2024-04-18T21:05:21.060 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-04-18T21:05:21.060 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_recovery_max_single_start": "1", 2024-04-18T21:05:21.060 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_recovery_op_priority": "3", 2024-04-18T21:05:21.060 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_recovery_op_warn_multiple": "16", 2024-04-18T21:05:21.060 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_recovery_priority": "5", 2024-04-18T21:05:21.061 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_recovery_retry_interval": "30.000000", 2024-04-18T21:05:21.061 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_recovery_sleep": "0.000000", 2024-04-18T21:05:21.061 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-04-18T21:05:21.061 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-04-18T21:05:21.061 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-04-18T21:05:21.061 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_repair_during_recovery": "false", 2024-04-18T21:05:21.061 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_requested_scrub_priority": "120", 2024-04-18T21:05:21.061 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-04-18T21:05:21.061 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_rollback_to_cluster_snap": "", 2024-04-18T21:05:21.061 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_scrub_auto_repair": "false", 2024-04-18T21:05:21.061 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-04-18T21:05:21.061 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-04-18T21:05:21.061 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_scrub_begin_hour": "0", 2024-04-18T21:05:21.061 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_scrub_begin_week_day": "0", 2024-04-18T21:05:21.061 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_scrub_chunk_max": "25", 2024-04-18T21:05:21.062 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_scrub_chunk_min": "5", 2024-04-18T21:05:21.062 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_scrub_cost": "52428800", 2024-04-18T21:05:21.062 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-04-18T21:05:21.062 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_scrub_during_recovery": "false", 2024-04-18T21:05:21.062 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_scrub_end_hour": "0", 2024-04-18T21:05:21.062 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_scrub_end_week_day": "0", 2024-04-18T21:05:21.062 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_scrub_event_cost": "4096", 2024-04-18T21:05:21.062 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-04-18T21:05:21.062 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-04-18T21:05:21.062 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_scrub_invalid_stats": "true", 2024-04-18T21:05:21.062 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_scrub_load_threshold": "0.500000", 2024-04-18T21:05:21.062 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_scrub_max_interval": "604800.000000", 2024-04-18T21:05:21.062 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_scrub_max_preemptions": "5", 2024-04-18T21:05:21.062 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_scrub_min_interval": "86400.000000", 2024-04-18T21:05:21.063 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_scrub_priority": "5", 2024-04-18T21:05:21.063 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_scrub_reservation_timeout": "300000", 2024-04-18T21:05:21.063 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_scrub_sleep": "0.000000", 2024-04-18T21:05:21.063 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-04-18T21:05:21.063 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-04-18T21:05:21.063 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_shutdown_pgref_assert": "false", 2024-04-18T21:05:21.063 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_skip_check_past_interval_bounds": "false", 2024-04-18T21:05:21.063 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_skip_data_digest": "false", 2024-04-18T21:05:21.063 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_smart_report_timeout": "5", 2024-04-18T21:05:21.063 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_snap_trim_cost": "1048576", 2024-04-18T21:05:21.063 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_snap_trim_priority": "5", 2024-04-18T21:05:21.063 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_snap_trim_sleep": "0.000000", 2024-04-18T21:05:21.063 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-04-18T21:05:21.063 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-04-18T21:05:21.064 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-04-18T21:05:21.064 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-04-18T21:05:21.064 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_stats_update_period_scrubbing": "15", 2024-04-18T21:05:21.064 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-04-18T21:05:21.064 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_target_transaction_size": "30", 2024-04-18T21:05:21.064 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-04-18T21:05:21.064 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-04-18T21:05:21.064 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-04-18T21:05:21.064 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-04-18T21:05:21.064 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-04-18T21:05:21.064 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-04-18T21:05:21.064 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-04-18T21:05:21.064 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_tier_default_cache_mode": "writeback", 2024-04-18T21:05:21.064 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-04-18T21:05:21.065 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-04-18T21:05:21.065 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_tracing": "false", 2024-04-18T21:05:21.065 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_use_stale_snap": "false", 2024-04-18T21:05:21.065 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-04-18T21:05:21.065 INFO:teuthology.orchestra.run.smithi078.stdout: "osdc_blkin_trace_all": "false", 2024-04-18T21:05:21.065 INFO:teuthology.orchestra.run.smithi078.stdout: "paxos_kill_at": "0", 2024-04-18T21:05:21.065 INFO:teuthology.orchestra.run.smithi078.stdout: "paxos_max_join_drift": "10", 2024-04-18T21:05:21.065 INFO:teuthology.orchestra.run.smithi078.stdout: "paxos_min": "500", 2024-04-18T21:05:21.065 INFO:teuthology.orchestra.run.smithi078.stdout: "paxos_min_wait": "0.050000", 2024-04-18T21:05:21.065 INFO:teuthology.orchestra.run.smithi078.stdout: "paxos_propose_interval": "1.000000", 2024-04-18T21:05:21.065 INFO:teuthology.orchestra.run.smithi078.stdout: "paxos_service_trim_max": "500", 2024-04-18T21:05:21.065 INFO:teuthology.orchestra.run.smithi078.stdout: "paxos_service_trim_max_multiplier": "20", 2024-04-18T21:05:21.065 INFO:teuthology.orchestra.run.smithi078.stdout: "paxos_service_trim_min": "250", 2024-04-18T21:05:21.066 INFO:teuthology.orchestra.run.smithi078.stdout: "paxos_stash_full_interval": "25", 2024-04-18T21:05:21.066 INFO:teuthology.orchestra.run.smithi078.stdout: "paxos_trim_max": "500", 2024-04-18T21:05:21.066 INFO:teuthology.orchestra.run.smithi078.stdout: "paxos_trim_min": "250", 2024-04-18T21:05:21.066 INFO:teuthology.orchestra.run.smithi078.stdout: "perf": "true", 2024-04-18T21:05:21.066 INFO:teuthology.orchestra.run.smithi078.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-04-18T21:05:21.066 INFO:teuthology.orchestra.run.smithi078.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-04-18T21:05:21.066 INFO:teuthology.orchestra.run.smithi078.stdout: "plugin_dir": "/usr/lib/ceph", 2024-04-18T21:05:21.066 INFO:teuthology.orchestra.run.smithi078.stdout: "public_addr": "-", 2024-04-18T21:05:21.066 INFO:teuthology.orchestra.run.smithi078.stdout: "public_addrv": "", 2024-04-18T21:05:21.066 INFO:teuthology.orchestra.run.smithi078.stdout: "public_bind_addr": "-", 2024-04-18T21:05:21.066 INFO:teuthology.orchestra.run.smithi078.stdout: "public_network": "", 2024-04-18T21:05:21.066 INFO:teuthology.orchestra.run.smithi078.stdout: "public_network_interface": "", 2024-04-18T21:05:21.066 INFO:teuthology.orchestra.run.smithi078.stdout: "qat_compressor_enabled": "false", 2024-04-18T21:05:21.066 INFO:teuthology.orchestra.run.smithi078.stdout: "qat_compressor_session_max_number": "256", 2024-04-18T21:05:21.066 INFO:teuthology.orchestra.run.smithi078.stdout: "rados_mon_op_timeout": "0", 2024-04-18T21:05:21.067 INFO:teuthology.orchestra.run.smithi078.stdout: "rados_osd_op_timeout": "0", 2024-04-18T21:05:21.067 INFO:teuthology.orchestra.run.smithi078.stdout: "rados_tracing": "false", 2024-04-18T21:05:21.067 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_atime_update_interval": "60", 2024-04-18T21:05:21.067 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-04-18T21:05:21.067 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_balance_parent_reads": "false", 2024-04-18T21:05:21.067 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_balance_snap_reads": "false", 2024-04-18T21:05:21.067 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_blkin_trace_all": "false", 2024-04-18T21:05:21.067 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_blocklist_expire_seconds": "0", 2024-04-18T21:05:21.067 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_blocklist_on_break_lock": "true", 2024-04-18T21:05:21.067 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_cache": "true", 2024-04-18T21:05:21.067 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_cache_block_writes_upfront": "false", 2024-04-18T21:05:21.067 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_cache_max_dirty": "25165824", 2024-04-18T21:05:21.067 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-04-18T21:05:21.067 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_cache_max_dirty_object": "0", 2024-04-18T21:05:21.068 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_cache_policy": "writearound", 2024-04-18T21:05:21.068 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_cache_size": "33554432", 2024-04-18T21:05:21.068 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_cache_target_dirty": "16777216", 2024-04-18T21:05:21.068 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-04-18T21:05:21.068 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_clone_copy_on_read": "false", 2024-04-18T21:05:21.068 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_compression_hint": "none", 2024-04-18T21:05:21.068 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_concurrent_management_ops": "10", 2024-04-18T21:05:21.068 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-04-18T21:05:21.068 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_default_clone_format": "auto", 2024-04-18T21:05:21.068 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_default_data_pool": "", 2024-04-18T21:05:21.068 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_default_features": "61", 2024-04-18T21:05:21.068 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_default_format": "2", 2024-04-18T21:05:21.068 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_default_map_options": "", 2024-04-18T21:05:21.068 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_default_order": "22", 2024-04-18T21:05:21.069 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_default_pool": "rbd", 2024-04-18T21:05:21.069 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-04-18T21:05:21.069 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_default_stripe_count": "0", 2024-04-18T21:05:21.069 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_default_stripe_unit": "0", 2024-04-18T21:05:21.069 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_disable_zero_copy_writes": "true", 2024-04-18T21:05:21.069 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_discard_granularity_bytes": "65536", 2024-04-18T21:05:21.069 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-04-18T21:05:21.069 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_enable_alloc_hint": "true", 2024-04-18T21:05:21.069 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-04-18T21:05:21.069 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_io_scheduler": "simple", 2024-04-18T21:05:21.069 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-04-18T21:05:21.069 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_journal_commit_age": "5.000000", 2024-04-18T21:05:21.069 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-04-18T21:05:21.069 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-04-18T21:05:21.070 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-04-18T21:05:21.070 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-04-18T21:05:21.070 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_journal_object_flush_interval": "0", 2024-04-18T21:05:21.070 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-04-18T21:05:21.070 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-04-18T21:05:21.070 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_journal_order": "24", 2024-04-18T21:05:21.070 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_journal_pool": "", 2024-04-18T21:05:21.070 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_journal_splay_width": "4", 2024-04-18T21:05:21.070 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_localize_parent_reads": "false", 2024-04-18T21:05:21.070 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_localize_snap_reads": "false", 2024-04-18T21:05:21.070 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-04-18T21:05:21.070 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-04-18T21:05:21.070 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-04-18T21:05:21.070 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-04-18T21:05:21.071 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-04-18T21:05:21.071 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-04-18T21:05:21.071 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_mirror_image_policy_type": "simple", 2024-04-18T21:05:21.071 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-04-18T21:05:21.071 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-04-18T21:05:21.071 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-04-18T21:05:21.071 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-04-18T21:05:21.071 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-04-18T21:05:21.071 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-04-18T21:05:21.071 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-04-18T21:05:21.071 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_mirror_memory_autotune": "true", 2024-04-18T21:05:21.071 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_mirror_memory_base": "805306368", 2024-04-18T21:05:21.071 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-04-18T21:05:21.071 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-04-18T21:05:21.072 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-04-18T21:05:21.072 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-04-18T21:05:21.072 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_mirror_memory_target": "4294967296", 2024-04-18T21:05:21.072 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-04-18T21:05:21.072 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-04-18T21:05:21.072 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-04-18T21:05:21.072 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_mirroring_delete_delay": "0", 2024-04-18T21:05:21.072 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-04-18T21:05:21.072 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_mirroring_replay_delay": "0", 2024-04-18T21:05:21.072 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-04-18T21:05:21.072 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-04-18T21:05:21.072 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_move_to_trash_on_remove": "false", 2024-04-18T21:05:21.072 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-04-18T21:05:21.072 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_mtime_update_interval": "60", 2024-04-18T21:05:21.073 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_non_blocking_aio": "true", 2024-04-18T21:05:21.073 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_op_thread_timeout": "60", 2024-04-18T21:05:21.073 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_op_threads": "1", 2024-04-18T21:05:21.073 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_parent_cache_enabled": "false", 2024-04-18T21:05:21.073 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_persistent_cache_mode": "disabled", 2024-04-18T21:05:21.073 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_persistent_cache_path": "/tmp", 2024-04-18T21:05:21.073 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_persistent_cache_size": "1073741824", 2024-04-18T21:05:21.073 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_plugins": "", 2024-04-18T21:05:21.073 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_qos_bps_burst": "0", 2024-04-18T21:05:21.073 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-04-18T21:05:21.073 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_qos_bps_limit": "0", 2024-04-18T21:05:21.073 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_qos_exclude_ops": "0", 2024-04-18T21:05:21.073 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_qos_iops_burst": "0", 2024-04-18T21:05:21.074 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-04-18T21:05:21.074 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_qos_iops_limit": "0", 2024-04-18T21:05:21.074 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_qos_read_bps_burst": "0", 2024-04-18T21:05:21.074 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-04-18T21:05:21.074 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_qos_read_bps_limit": "0", 2024-04-18T21:05:21.074 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_qos_read_iops_burst": "0", 2024-04-18T21:05:21.074 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-04-18T21:05:21.074 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_qos_read_iops_limit": "0", 2024-04-18T21:05:21.074 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_qos_schedule_tick_min": "50", 2024-04-18T21:05:21.074 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_qos_write_bps_burst": "0", 2024-04-18T21:05:21.074 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-04-18T21:05:21.074 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_qos_write_bps_limit": "0", 2024-04-18T21:05:21.074 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_qos_write_iops_burst": "0", 2024-04-18T21:05:21.074 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-04-18T21:05:21.075 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_qos_write_iops_limit": "0", 2024-04-18T21:05:21.075 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_quiesce_notification_attempts": "10", 2024-04-18T21:05:21.075 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_read_from_replica_policy": "default", 2024-04-18T21:05:21.075 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-04-18T21:05:21.075 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_readahead_max_bytes": "524288", 2024-04-18T21:05:21.075 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_readahead_trigger_requests": "10", 2024-04-18T21:05:21.075 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_request_timed_out_seconds": "30", 2024-04-18T21:05:21.075 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_skip_partial_discard": "true", 2024-04-18T21:05:21.075 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-04-18T21:05:21.075 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_tracing": "false", 2024-04-18T21:05:21.075 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_validate_names": "true", 2024-04-18T21:05:21.075 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_validate_pool": "true", 2024-04-18T21:05:21.075 INFO:teuthology.orchestra.run.smithi078.stdout: "restapi_base_url": "", 2024-04-18T21:05:21.075 INFO:teuthology.orchestra.run.smithi078.stdout: "restapi_log_level": "", 2024-04-18T21:05:21.076 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_acl_grants_max_num": "100", 2024-04-18T21:05:21.076 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_admin_entry": "admin", 2024-04-18T21:05:21.076 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-04-18T21:05:21.076 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_backend_store": "rados", 2024-04-18T21:05:21.076 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_barbican_url": "", 2024-04-18T21:05:21.076 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_beast_enable_async": "true", 2024-04-18T21:05:21.076 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_bucket_counters_cache": "false", 2024-04-18T21:05:21.076 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-04-18T21:05:21.076 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-04-18T21:05:21.076 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-04-18T21:05:21.076 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_bucket_index_max_aio": "128", 2024-04-18T21:05:21.076 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-04-18T21:05:21.076 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-04-18T21:05:21.077 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_bucket_quota_ttl": "600", 2024-04-18T21:05:21.077 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-04-18T21:05:21.077 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_cache_enabled": "true", 2024-04-18T21:05:21.077 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_cache_expiry_interval": "900", 2024-04-18T21:05:21.077 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_cache_lru_size": "10000", 2024-04-18T21:05:21.077 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_config_store": "rados", 2024-04-18T21:05:21.077 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_content_length_compat": "false", 2024-04-18T21:05:21.077 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_copy_obj_progress": "true", 2024-04-18T21:05:21.077 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-04-18T21:05:21.077 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_cors_rules_max_num": "100", 2024-04-18T21:05:21.077 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_cross_domain_policy": "", 2024-04-18T21:05:21.077 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_crypt_default_encryption_key": "", 2024-04-18T21:05:21.077 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_crypt_kmip_addr": "", 2024-04-18T21:05:21.077 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_crypt_kmip_ca_path": "", 2024-04-18T21:05:21.078 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_crypt_kmip_client_cert": "", 2024-04-18T21:05:21.078 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_crypt_kmip_client_key": "", 2024-04-18T21:05:21.078 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-04-18T21:05:21.078 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_crypt_kmip_password": "", 2024-04-18T21:05:21.078 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-04-18T21:05:21.078 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_crypt_kmip_username": "", 2024-04-18T21:05:21.078 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_crypt_require_ssl": "true", 2024-04-18T21:05:21.078 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-04-18T21:05:21.078 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-04-18T21:05:21.078 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-04-18T21:05:21.078 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-04-18T21:05:21.078 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-04-18T21:05:21.078 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-04-18T21:05:21.078 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-04-18T21:05:21.079 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-04-18T21:05:21.079 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-04-18T21:05:21.079 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-04-18T21:05:21.079 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-04-18T21:05:21.079 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-04-18T21:05:21.079 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-04-18T21:05:21.079 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-04-18T21:05:21.079 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_crypt_suppress_logs": "true", 2024-04-18T21:05:21.079 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_crypt_vault_addr": "", 2024-04-18T21:05:21.079 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_crypt_vault_auth": "token", 2024-04-18T21:05:21.079 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_crypt_vault_namespace": "", 2024-04-18T21:05:21.079 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_crypt_vault_prefix": "", 2024-04-18T21:05:21.079 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-04-18T21:05:21.080 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-04-18T21:05:21.080 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-04-18T21:05:21.080 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-04-18T21:05:21.080 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_crypt_vault_token_file": "", 2024-04-18T21:05:21.080 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-04-18T21:05:21.080 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_curl_buffersize": "524288", 2024-04-18T21:05:21.080 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_curl_low_speed_limit": "1024", 2024-04-18T21:05:21.080 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_curl_low_speed_time": "300", 2024-04-18T21:05:21.080 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_curl_tcp_keepalive": "0", 2024-04-18T21:05:21.080 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-04-18T21:05:21.080 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-04-18T21:05:21.080 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-04-18T21:05:21.080 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-04-18T21:05:21.080 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-04-18T21:05:21.081 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_d3n_l1_fadvise": "4", 2024-04-18T21:05:21.081 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-04-18T21:05:21.081 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-04-18T21:05:21.081 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-04-18T21:05:21.081 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_d4n_host": "127.0.0.1", 2024-04-18T21:05:21.081 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_d4n_l1_datacache_persistent_path": "/tmp/rgw_d4n_datacache/", 2024-04-18T21:05:21.081 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_d4n_l1_datacache_size": "1073741824", 2024-04-18T21:05:21.081 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_d4n_l1_evict_cache_on_start": "true", 2024-04-18T21:05:21.081 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_d4n_l1_fadvise": "4", 2024-04-18T21:05:21.081 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_d4n_libaio_aio_num": "64", 2024-04-18T21:05:21.081 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_d4n_libaio_aio_threads": "20", 2024-04-18T21:05:21.081 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_d4n_port": "6379", 2024-04-18T21:05:21.081 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-04-18T21:05:21.081 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_data_log_changes_size": "1000", 2024-04-18T21:05:21.082 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_data_log_num_shards": "128", 2024-04-18T21:05:21.082 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-04-18T21:05:21.082 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_data_log_window": "30", 2024-04-18T21:05:21.082 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_data_notify_interval_msec": "0", 2024-04-18T21:05:21.082 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_data_sync_poll_interval": "20", 2024-04-18T21:05:21.082 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_data_sync_spawn_window": "20", 2024-04-18T21:05:21.082 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-04-18T21:05:21.082 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-04-18T21:05:21.082 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-04-18T21:05:21.082 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_default_data_log_backing": "fifo", 2024-04-18T21:05:21.082 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-04-18T21:05:21.082 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_default_region_info_oid": "default.region", 2024-04-18T21:05:21.082 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-04-18T21:05:21.083 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-04-18T21:05:21.083 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_defer_to_bucket_acls": "", 2024-04-18T21:05:21.083 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-04-18T21:05:21.083 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-04-18T21:05:21.083 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-04-18T21:05:21.083 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-04-18T21:05:21.083 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-04-18T21:05:21.083 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-04-18T21:05:21.083 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-04-18T21:05:21.083 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-04-18T21:05:21.083 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_dmclock_data_res": "500.000000", 2024-04-18T21:05:21.083 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-04-18T21:05:21.083 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-04-18T21:05:21.083 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-04-18T21:05:21.084 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-04-18T21:05:21.084 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_dns_name": "", 2024-04-18T21:05:21.084 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_dns_s3website_name": "", 2024-04-18T21:05:21.084 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_dynamic_resharding": "true", 2024-04-18T21:05:21.084 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-04-18T21:05:21.084 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_enable_gc_threads": "true", 2024-04-18T21:05:21.084 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_enable_lc_threads": "true", 2024-04-18T21:05:21.084 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_enable_ops_log": "false", 2024-04-18T21:05:21.084 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_enable_quota_threads": "true", 2024-04-18T21:05:21.084 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_enable_static_website": "false", 2024-04-18T21:05:21.084 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_enable_usage_log": "false", 2024-04-18T21:05:21.084 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_enforce_swift_acls": "true", 2024-04-18T21:05:21.084 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_exit_timeout_secs": "120", 2024-04-18T21:05:21.084 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_expose_bucket": "false", 2024-04-18T21:05:21.085 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_extended_http_attrs": "", 2024-04-18T21:05:21.085 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_filter": "none", 2024-04-18T21:05:21.085 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-04-18T21:05:21.085 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_frontends": "beast port=7480", 2024-04-18T21:05:21.085 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_gc_max_concurrent_io": "10", 2024-04-18T21:05:21.085 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_gc_max_deferred": "50", 2024-04-18T21:05:21.085 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-04-18T21:05:21.085 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_gc_max_objs": "32", 2024-04-18T21:05:21.085 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_gc_max_queue_size": "134213632", 2024-04-18T21:05:21.085 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_gc_max_trim_chunk": "16", 2024-04-18T21:05:21.085 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_gc_obj_min_wait": "7200", 2024-04-18T21:05:21.085 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_gc_processor_max_time": "3600", 2024-04-18T21:05:21.085 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_gc_processor_period": "3600", 2024-04-18T21:05:21.085 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-04-18T21:05:21.086 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_get_obj_window_size": "16777216", 2024-04-18T21:05:21.086 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_healthcheck_disabling_path": "", 2024-04-18T21:05:21.086 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_ignore_get_invalid_range": "false", 2024-04-18T21:05:21.086 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_init_timeout": "300", 2024-04-18T21:05:21.086 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-04-18T21:05:21.086 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-04-18T21:05:21.086 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_kafka_connection_idle": "300", 2024-04-18T21:05:21.086 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_kafka_message_timeout": "5000", 2024-04-18T21:05:21.086 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_kafka_sleep_timeout": "10", 2024-04-18T21:05:21.086 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-04-18T21:05:21.086 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-04-18T21:05:21.086 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-04-18T21:05:21.086 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_keystone_admin_domain": "", 2024-04-18T21:05:21.086 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_keystone_admin_password": "", 2024-04-18T21:05:21.087 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_keystone_admin_password_path": "", 2024-04-18T21:05:21.087 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_keystone_admin_project": "", 2024-04-18T21:05:21.087 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_keystone_admin_tenant": "", 2024-04-18T21:05:21.087 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_keystone_admin_token": "", 2024-04-18T21:05:21.087 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_keystone_admin_token_path": "", 2024-04-18T21:05:21.087 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_keystone_admin_user": "", 2024-04-18T21:05:21.087 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_keystone_api_version": "2", 2024-04-18T21:05:21.087 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_keystone_barbican_domain": "", 2024-04-18T21:05:21.087 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_keystone_barbican_password": "", 2024-04-18T21:05:21.087 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_keystone_barbican_project": "", 2024-04-18T21:05:21.087 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_keystone_barbican_tenant": "", 2024-04-18T21:05:21.087 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_keystone_barbican_user": "", 2024-04-18T21:05:21.087 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-04-18T21:05:21.087 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_keystone_implicit_tenants": "false", 2024-04-18T21:05:21.088 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-04-18T21:05:21.088 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_keystone_service_token_enabled": "false", 2024-04-18T21:05:21.088 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_keystone_token_cache_size": "10000", 2024-04-18T21:05:21.088 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_keystone_url": "", 2024-04-18T21:05:21.088 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_keystone_verify_ssl": "true", 2024-04-18T21:05:21.088 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_lc_debug_interval": "-1", 2024-04-18T21:05:21.088 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_lc_lock_max_time": "90", 2024-04-18T21:05:21.088 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_lc_max_objs": "32", 2024-04-18T21:05:21.088 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_lc_max_rules": "1000", 2024-04-18T21:05:21.088 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_lc_max_worker": "3", 2024-04-18T21:05:21.088 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_lc_max_wp_worker": "3", 2024-04-18T21:05:21.088 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_lc_thread_delay": "0", 2024-04-18T21:05:21.088 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-04-18T21:05:21.088 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_ldap_dnattr": "uid", 2024-04-18T21:05:21.089 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-04-18T21:05:21.089 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_ldap_searchfilter": "", 2024-04-18T21:05:21.089 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-04-18T21:05:21.089 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_ldap_uri": "", 2024-04-18T21:05:21.089 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_lfuda_sync_frequency": "60", 2024-04-18T21:05:21.089 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-04-18T21:05:21.089 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-04-18T21:05:21.089 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-04-18T21:05:21.089 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_local_cache_address": "127.0.0.1:6379", 2024-04-18T21:05:21.089 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_log_http_headers": "", 2024-04-18T21:05:21.089 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_log_nonexistent_bucket": "false", 2024-04-18T21:05:21.089 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-04-18T21:05:21.089 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_log_object_name_utc": "false", 2024-04-18T21:05:21.090 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-04-18T21:05:21.090 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-04-18T21:05:21.090 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_max_attr_name_len": "0", 2024-04-18T21:05:21.090 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_max_attr_size": "0", 2024-04-18T21:05:21.090 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_max_attrs_num_in_req": "0", 2024-04-18T21:05:21.090 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_max_chunk_size": "4194304", 2024-04-18T21:05:21.090 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_max_concurrent_requests": "1024", 2024-04-18T21:05:21.090 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-04-18T21:05:21.090 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_max_dynamic_shards": "1999", 2024-04-18T21:05:21.090 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_max_listing_results": "1000", 2024-04-18T21:05:21.090 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_max_notify_retries": "10", 2024-04-18T21:05:21.090 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_max_objs_per_shard": "100000", 2024-04-18T21:05:21.090 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_max_put_param_size": "1048576", 2024-04-18T21:05:21.090 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_max_put_size": "5368709120", 2024-04-18T21:05:21.091 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_max_slo_entries": "1000", 2024-04-18T21:05:21.091 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_md_log_max_shards": "64", 2024-04-18T21:05:21.091 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_md_notify_interval_msec": "200", 2024-04-18T21:05:21.091 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_meta_sync_poll_interval": "20", 2024-04-18T21:05:21.091 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_meta_sync_spawn_window": "20", 2024-04-18T21:05:21.091 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-04-18T21:05:21.091 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_mp_lock_max_time": "600", 2024-04-18T21:05:21.091 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-04-18T21:05:21.091 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_multipart_min_part_size": "5242880", 2024-04-18T21:05:21.091 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-04-18T21:05:21.091 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-04-18T21:05:21.091 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_nfs_fhcache_size": "2017", 2024-04-18T21:05:21.091 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-04-18T21:05:21.091 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-04-18T21:05:21.092 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_nfs_lru_lanes": "5", 2024-04-18T21:05:21.092 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_nfs_max_gc": "300", 2024-04-18T21:05:21.092 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-04-18T21:05:21.092 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_nfs_run_gc_threads": "false", 2024-04-18T21:05:21.092 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_nfs_run_lc_threads": "false", 2024-04-18T21:05:21.092 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_nfs_run_quota_threads": "false", 2024-04-18T21:05:21.092 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_nfs_run_sync_thread": "false", 2024-04-18T21:05:21.092 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-04-18T21:05:21.092 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-04-18T21:05:21.092 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_num_async_rados_threads": "32", 2024-04-18T21:05:21.092 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_num_control_oids": "8", 2024-04-18T21:05:21.092 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_numa_node": "-1", 2024-04-18T21:05:21.092 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_obj_stripe_size": "4194304", 2024-04-18T21:05:21.093 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-04-18T21:05:21.093 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_objexp_chunk_size": "100", 2024-04-18T21:05:21.093 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_objexp_gc_interval": "600", 2024-04-18T21:05:21.093 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_objexp_hints_num_shards": "127", 2024-04-18T21:05:21.093 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-04-18T21:05:21.093 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-04-18T21:05:21.093 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_op_thread_timeout": "600", 2024-04-18T21:05:21.093 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_op_tracing": "false", 2024-04-18T21:05:21.093 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_opa_token": "", 2024-04-18T21:05:21.093 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_opa_url": "", 2024-04-18T21:05:21.093 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_opa_verify_ssl": "true", 2024-04-18T21:05:21.093 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-04-18T21:05:21.093 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-04-18T21:05:21.093 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_ops_log_rados": "false", 2024-04-18T21:05:21.094 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_ops_log_socket_path": "", 2024-04-18T21:05:21.094 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-04-18T21:05:21.094 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-04-18T21:05:21.094 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-04-18T21:05:21.094 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_period_push_interval": "2.000000", 2024-04-18T21:05:21.094 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_period_push_interval_max": "30.000000", 2024-04-18T21:05:21.094 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_period_root_pool": ".rgw.root", 2024-04-18T21:05:21.094 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-04-18T21:05:21.094 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-04-18T21:05:21.094 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_posix_cache_lanes": "3", 2024-04-18T21:05:21.094 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-04-18T21:05:21.094 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_posix_cache_max_buckets": "100", 2024-04-18T21:05:21.094 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_posix_cache_partitions": "3", 2024-04-18T21:05:21.094 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-04-18T21:05:21.095 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_print_continue": "true", 2024-04-18T21:05:21.095 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_print_prohibited_content_length": "false", 2024-04-18T21:05:21.095 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-04-18T21:05:21.095 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-04-18T21:05:21.095 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-04-18T21:05:21.095 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-04-18T21:05:21.095 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_rados_tracing": "false", 2024-04-18T21:05:21.095 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_realm": "", 2024-04-18T21:05:21.095 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_realm_id": "", 2024-04-18T21:05:21.095 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-04-18T21:05:21.095 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_region": "", 2024-04-18T21:05:21.095 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_region_root_pool": ".rgw.root", 2024-04-18T21:05:21.095 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_relaxed_region_enforcement": "false", 2024-04-18T21:05:21.095 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-04-18T21:05:21.096 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-04-18T21:05:21.096 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_request_uri": "", 2024-04-18T21:05:21.096 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_reshard_batch_size": "64", 2024-04-18T21:05:21.096 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-04-18T21:05:21.096 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_reshard_max_aio": "128", 2024-04-18T21:05:21.096 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_reshard_num_logs": "16", 2024-04-18T21:05:21.096 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_reshard_thread_interval": "600", 2024-04-18T21:05:21.096 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_resolve_cname": "false", 2024-04-18T21:05:21.096 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_rest_getusage_op_compat": "false", 2024-04-18T21:05:21.096 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_run_sync_thread": "true", 2024-04-18T21:05:21.096 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-04-18T21:05:21.096 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-04-18T21:05:21.096 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_s3_auth_use_keystone": "false", 2024-04-18T21:05:21.096 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_s3_auth_use_ldap": "false", 2024-04-18T21:05:21.097 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_s3_auth_use_rados": "true", 2024-04-18T21:05:21.097 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_s3_auth_use_sts": "false", 2024-04-18T21:05:21.097 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-04-18T21:05:21.097 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_s3_success_create_obj_status": "0", 2024-04-18T21:05:21.097 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-04-18T21:05:21.097 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_scheduler_type": "throttler", 2024-04-18T21:05:21.097 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_script_uri": "", 2024-04-18T21:05:21.097 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_service_provider_name": "", 2024-04-18T21:05:21.097 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-04-18T21:05:21.097 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_sts_client_id": "", 2024-04-18T21:05:21.097 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_sts_client_secret": "", 2024-04-18T21:05:21.097 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_sts_entry": "sts", 2024-04-18T21:05:21.097 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_sts_key": "sts", 2024-04-18T21:05:21.097 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_sts_max_session_duration": "43200", 2024-04-18T21:05:21.098 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_sts_min_session_duration": "900", 2024-04-18T21:05:21.098 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_sts_token_introspection_url": "", 2024-04-18T21:05:21.098 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_swift_account_in_url": "false", 2024-04-18T21:05:21.098 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_swift_auth_entry": "auth", 2024-04-18T21:05:21.098 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_swift_auth_url": "", 2024-04-18T21:05:21.098 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_swift_custom_header": "", 2024-04-18T21:05:21.098 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_swift_enforce_content_length": "false", 2024-04-18T21:05:21.098 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_swift_need_stats": "true", 2024-04-18T21:05:21.098 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_swift_tenant_name": "", 2024-04-18T21:05:21.098 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_swift_token_expiration": "86400", 2024-04-18T21:05:21.098 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_swift_url": "", 2024-04-18T21:05:21.098 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_swift_url_prefix": "swift", 2024-04-18T21:05:21.098 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_swift_versioning_enabled": "false", 2024-04-18T21:05:21.098 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-04-18T21:05:21.099 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-04-18T21:05:21.099 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_sync_lease_period": "120", 2024-04-18T21:05:21.099 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-04-18T21:05:21.099 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_sync_log_trim_interval": "1200", 2024-04-18T21:05:21.099 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-04-18T21:05:21.099 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-04-18T21:05:21.099 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-04-18T21:05:21.099 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_sync_obj_etag_verify": "false", 2024-04-18T21:05:21.099 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_sync_trace_history_size": "4096", 2024-04-18T21:05:21.099 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-04-18T21:05:21.099 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-04-18T21:05:21.099 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_thread_pool_size": "512", 2024-04-18T21:05:21.099 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_topic_persistency_max_retries": "0", 2024-04-18T21:05:21.099 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-04-18T21:05:21.100 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-04-18T21:05:21.100 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_topic_require_publish_policy": "false", 2024-04-18T21:05:21.100 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_torrent_comment": "", 2024-04-18T21:05:21.100 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_torrent_createby": "", 2024-04-18T21:05:21.100 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_torrent_encoding": "", 2024-04-18T21:05:21.100 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_torrent_flag": "false", 2024-04-18T21:05:21.100 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_torrent_max_size": "5368709120", 2024-04-18T21:05:21.100 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_torrent_origin": "", 2024-04-18T21:05:21.100 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_torrent_sha_unit": "524288", 2024-04-18T21:05:21.100 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_torrent_tracker": "", 2024-04-18T21:05:21.100 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_trust_forwarded_https": "false", 2024-04-18T21:05:21.100 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-04-18T21:05:21.100 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_usage_log_tick_interval": "30", 2024-04-18T21:05:21.100 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_usage_max_shards": "32", 2024-04-18T21:05:21.101 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_usage_max_user_shards": "1", 2024-04-18T21:05:21.101 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_use_opa_authz": "false", 2024-04-18T21:05:21.101 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_user_counters_cache": "false", 2024-04-18T21:05:21.101 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_user_counters_cache_size": "10000", 2024-04-18T21:05:21.101 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-04-18T21:05:21.101 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_user_default_quota_max_size": "-1", 2024-04-18T21:05:21.101 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_user_max_buckets": "1000", 2024-04-18T21:05:21.101 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_user_policies_max_num": "100", 2024-04-18T21:05:21.101 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-04-18T21:05:21.101 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-04-18T21:05:21.101 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_user_quota_sync_interval": "86400", 2024-04-18T21:05:21.101 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-04-18T21:05:21.101 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_user_unique_email": "true", 2024-04-18T21:05:21.101 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_verify_ssl": "true", 2024-04-18T21:05:21.102 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_website_routing_rules_max_num": "50", 2024-04-18T21:05:21.102 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_zone": "", 2024-04-18T21:05:21.102 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_zone_id": "", 2024-04-18T21:05:21.102 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-04-18T21:05:21.102 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_zonegroup": "", 2024-04-18T21:05:21.102 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_zonegroup_id": "", 2024-04-18T21:05:21.102 INFO:teuthology.orchestra.run.smithi078.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-04-18T21:05:21.102 INFO:teuthology.orchestra.run.smithi078.stdout: "rgwlc_auto_session_clear": "true", 2024-04-18T21:05:21.102 INFO:teuthology.orchestra.run.smithi078.stdout: "rgwlc_skip_bucket_step": "false", 2024-04-18T21:05:21.102 INFO:teuthology.orchestra.run.smithi078.stdout: "rocksdb_block_size": "4096", 2024-04-18T21:05:21.102 INFO:teuthology.orchestra.run.smithi078.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-04-18T21:05:21.102 INFO:teuthology.orchestra.run.smithi078.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-04-18T21:05:21.102 INFO:teuthology.orchestra.run.smithi078.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-04-18T21:05:21.102 INFO:teuthology.orchestra.run.smithi078.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-04-18T21:05:21.103 INFO:teuthology.orchestra.run.smithi078.stdout: "rocksdb_cache_shard_bits": "4", 2024-04-18T21:05:21.103 INFO:teuthology.orchestra.run.smithi078.stdout: "rocksdb_cache_size": "536870912", 2024-04-18T21:05:21.103 INFO:teuthology.orchestra.run.smithi078.stdout: "rocksdb_cache_type": "binned_lru", 2024-04-18T21:05:21.103 INFO:teuthology.orchestra.run.smithi078.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-04-18T21:05:21.103 INFO:teuthology.orchestra.run.smithi078.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-04-18T21:05:21.103 INFO:teuthology.orchestra.run.smithi078.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-04-18T21:05:21.103 INFO:teuthology.orchestra.run.smithi078.stdout: "rocksdb_collect_compaction_stats": "false", 2024-04-18T21:05:21.103 INFO:teuthology.orchestra.run.smithi078.stdout: "rocksdb_collect_extended_stats": "false", 2024-04-18T21:05:21.103 INFO:teuthology.orchestra.run.smithi078.stdout: "rocksdb_collect_memory_stats": "false", 2024-04-18T21:05:21.103 INFO:teuthology.orchestra.run.smithi078.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-04-18T21:05:21.103 INFO:teuthology.orchestra.run.smithi078.stdout: "rocksdb_index_type": "binary_search", 2024-04-18T21:05:21.103 INFO:teuthology.orchestra.run.smithi078.stdout: "rocksdb_log_to_ceph_log": "true", 2024-04-18T21:05:21.103 INFO:teuthology.orchestra.run.smithi078.stdout: "rocksdb_metadata_block_size": "4096", 2024-04-18T21:05:21.103 INFO:teuthology.orchestra.run.smithi078.stdout: "rocksdb_partition_filters": "false", 2024-04-18T21:05:21.104 INFO:teuthology.orchestra.run.smithi078.stdout: "rocksdb_perf": "false", 2024-04-18T21:05:21.104 INFO:teuthology.orchestra.run.smithi078.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-04-18T21:05:21.104 INFO:teuthology.orchestra.run.smithi078.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-04-18T21:05:21.104 INFO:teuthology.orchestra.run.smithi078.stdout: "rotating_keys_renewal_timeout": "10", 2024-04-18T21:05:21.104 INFO:teuthology.orchestra.run.smithi078.stdout: "run_dir": "/var/run/ceph", 2024-04-18T21:05:21.104 INFO:teuthology.orchestra.run.smithi078.stdout: "seastore_block_create": "true", 2024-04-18T21:05:21.104 INFO:teuthology.orchestra.run.smithi078.stdout: "seastore_cache_lru_size": "67108864", 2024-04-18T21:05:21.104 INFO:teuthology.orchestra.run.smithi078.stdout: "seastore_cbjournal_size": "5368709120", 2024-04-18T21:05:21.104 INFO:teuthology.orchestra.run.smithi078.stdout: "seastore_data_delta_based_overwrite": "0", 2024-04-18T21:05:21.104 INFO:teuthology.orchestra.run.smithi078.stdout: "seastore_default_max_object_size": "16777216", 2024-04-18T21:05:21.104 INFO:teuthology.orchestra.run.smithi078.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-04-18T21:05:21.104 INFO:teuthology.orchestra.run.smithi078.stdout: "seastore_device_size": "53687091200", 2024-04-18T21:05:21.104 INFO:teuthology.orchestra.run.smithi078.stdout: "seastore_journal_batch_capacity": "16", 2024-04-18T21:05:21.105 INFO:teuthology.orchestra.run.smithi078.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-04-18T21:05:21.105 INFO:teuthology.orchestra.run.smithi078.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-04-18T21:05:21.105 INFO:teuthology.orchestra.run.smithi078.stdout: "seastore_journal_iodepth_limit": "5", 2024-04-18T21:05:21.105 INFO:teuthology.orchestra.run.smithi078.stdout: "seastore_main_device_type": "SSD", 2024-04-18T21:05:21.105 INFO:teuthology.orchestra.run.smithi078.stdout: "seastore_max_concurrent_transactions": "8", 2024-04-18T21:05:21.105 INFO:teuthology.orchestra.run.smithi078.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-04-18T21:05:21.105 INFO:teuthology.orchestra.run.smithi078.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-04-18T21:05:21.105 INFO:teuthology.orchestra.run.smithi078.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-04-18T21:05:21.105 INFO:teuthology.orchestra.run.smithi078.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-04-18T21:05:21.105 INFO:teuthology.orchestra.run.smithi078.stdout: "seastore_segment_size": "67108864", 2024-04-18T21:05:21.105 INFO:teuthology.orchestra.run.smithi078.stdout: "set_keepcaps": "false", 2024-04-18T21:05:21.105 INFO:teuthology.orchestra.run.smithi078.stdout: "setgroup": "", 2024-04-18T21:05:21.105 INFO:teuthology.orchestra.run.smithi078.stdout: "setuser": "", 2024-04-18T21:05:21.105 INFO:teuthology.orchestra.run.smithi078.stdout: "setuser_match_path": "", 2024-04-18T21:05:21.105 INFO:teuthology.orchestra.run.smithi078.stdout: "target_max_misplaced_ratio": "0.050000", 2024-04-18T21:05:21.106 INFO:teuthology.orchestra.run.smithi078.stdout: "thp": "false", 2024-04-18T21:05:21.106 INFO:teuthology.orchestra.run.smithi078.stdout: "threadpool_default_timeout": "60", 2024-04-18T21:05:21.106 INFO:teuthology.orchestra.run.smithi078.stdout: "threadpool_empty_queue_max_wait": "2", 2024-04-18T21:05:21.106 INFO:teuthology.orchestra.run.smithi078.stdout: "throttler_perf_counter": "true" 2024-04-18T21:05:21.106 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-04-18T21:05:21.108 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-04-18T21:05:21.250 INFO:teuthology.orchestra.run.smithi078.stdout:mon.a: {} 2024-04-18T21:05:21.251 INFO:teuthology.orchestra.run.smithi078.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-18T21:05:21.259 INFO:teuthology.orchestra.run.smithi078.stdout:mon.b: {} 2024-04-18T21:05:21.259 INFO:teuthology.orchestra.run.smithi078.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-18T21:05:21.268 INFO:teuthology.orchestra.run.smithi078.stdout:mon.c: {} 2024-04-18T21:05:21.268 INFO:teuthology.orchestra.run.smithi078.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-18T21:05:21.283 INFO:tasks.thrashosds.thrasher:Unable to test ceph-objectstore-tool, powercycle testing 2024-04-18T21:05:21.283 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-18T21:05:21.307 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-18T21:05:21.308 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-04-18T21:05:21.308 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-18T21:05:21.308 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-18T21:05:21.308 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-18T21:05:21.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T21:05:21.308 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2024-04-18T21:05:21.308 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-04-18T21:05:21.309 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-18T21:05:21.309 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-18T21:05:21.309 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-04-18T21:05:21.309 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-18T21:05:21.309 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-18T21:05:21.309 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-04-18T21:05:21.309 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-04-18T21:05:21.310 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-04-18T21:05:21.310 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:05:21.310 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-04-18T21:05:21.311 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:05:21.311 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-04-18T21:05:21.311 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-18T21:05:21.313 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:21.311+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:21.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T21:05:21.317 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link delete ceph-brx 2024-04-18T21:05:21.374 INFO:teuthology.orchestra.run.smithi078.stderr:Cannot find device "ceph-brx" 2024-04-18T21:05:21.375 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T21:05:21.375 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-18T21:05:21.375 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-18T21:05:21.412 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:21.411+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:21.441 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:05:21.441 INFO:teuthology.orchestra.run.smithi187.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-18T21:05:21.441 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:05:21.442 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:05:21.443 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:05:21.443 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:21.443 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:21.457 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:05:21.463 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1: {} 2024-04-18T21:05:21.464 INFO:teuthology.orchestra.run.smithi078.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:05:21.484 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:05:21.484 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:05:21.513 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:21.515+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:21.576 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:21.576 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:21.590 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:05:21.613 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:21.615+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:21.706 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:21.706 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:21.715 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:21.715+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:21.721 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:05:21.741 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-18T21:05:21.747 INFO:teuthology.orchestra.run.smithi078.stderr:noscrub is set 2024-04-18T21:05:21.763 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-18T21:05:21.763 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-18T21:05:21.763 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi078.front.sepia.ceph.com 2024-04-18T21:05:21.763 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-18T21:05:21.763 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-18T21:05:21.763 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-18T21:05:21.764 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-18T21:05:21.764 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-18T21:05:21.764 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-18T21:05:21.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T21:05:21.764 DEBUG:teuthology.orchestra.run.smithi078:> ip addr 2024-04-18T21:05:21.768 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-18T21:05:21.768 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-18T21:05:21.768 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2024-04-18T21:05:21.769 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-04-18T21:05:21.769 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2024-04-18T21:05:21.769 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-04-18T21:05:21.769 INFO:teuthology.orchestra.run.smithi078.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-18T21:05:21.769 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:22 brd ff:ff:ff:ff:ff:ff 2024-04-18T21:05:21.769 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f0 2024-04-18T21:05:21.769 INFO:teuthology.orchestra.run.smithi078.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-18T21:05:21.769 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:23 brd ff:ff:ff:ff:ff:ff 2024-04-18T21:05:21.769 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f1 2024-04-18T21:05:21.769 INFO:teuthology.orchestra.run.smithi078.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-18T21:05:21.769 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dc brd ff:ff:ff:ff:ff:ff 2024-04-18T21:05:21.769 INFO:teuthology.orchestra.run.smithi078.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-18T21:05:21.769 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dd brd ff:ff:ff:ff:ff:ff 2024-04-18T21:05:21.769 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.21.15.78/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-18T21:05:21.770 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft 42287sec preferred_lft 42287sec 2024-04-18T21:05:21.770 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::ec4:7aff:fe8f:d4dd/64 scope link 2024-04-18T21:05:21.770 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-04-18T21:05:21.770 INFO:teuthology.orchestra.run.smithi078.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-18T21:05:21.770 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 02:42:06:1d:bc:16 brd ff:ff:ff:ff:ff:ff 2024-04-18T21:05:21.770 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-18T21:05:21.770 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-04-18T21:05:21.770 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-18T21:05:21.770 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-18T21:05:21.771 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2024-04-18T21:05:21.771 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link add name ceph-brx type bridge 2024-04-18T21:05:21.771 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip addr flush dev ceph-brx 2024-04-18T21:05:21.771 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set ceph-brx up 2024-04-18T21:05:21.771 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-18T21:05:21.771 DEBUG:teuthology.orchestra.run.smithi078:> ') 2024-04-18T21:05:21.815 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:21.815+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:21.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-18T21:05:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-18T21:05:21.849 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:21.849 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:21.865 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:05:21.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-18T21:05:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-18T21:05:21.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T21:05:21.880 DEBUG:teuthology.orchestra.run.smithi078:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-18T21:05:21.916 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:21.915+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:21.931 INFO:teuthology.orchestra.run.smithi078.stdout:1 2024-04-18T21:05:21.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T21:05:21.933 DEBUG:teuthology.orchestra.run.smithi078:> route 2024-04-18T21:05:21.992 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:21.993 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:21.995 INFO:teuthology.orchestra.run.smithi078.stdout:Kernel IP routing table 2024-04-18T21:05:21.995 INFO:teuthology.orchestra.run.smithi078.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-18T21:05:21.995 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-18T21:05:21.995 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-18T21:05:21.995 INFO:teuthology.orchestra.run.smithi078.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-18T21:05:21.996 INFO:teuthology.orchestra.run.smithi078.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-18T21:05:21.996 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-18T21:05:21.996 INFO:teuthology.orchestra.run.smithi078.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-18T21:05:21.996 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-18T21:05:21.996 INFO:teuthology.orchestra.run.smithi078.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-18T21:05:21.996 INFO:teuthology.orchestra.run.smithi078.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-18T21:05:21.996 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-18T21:05:21.996 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2024-04-18T21:05:21.996 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-18T21:05:21.996 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-18T21:05:21.997 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-18T21:05:21.997 DEBUG:teuthology.orchestra.run.smithi078:> ') 2024-04-18T21:05:22.007 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:05:22.017 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:22.019+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:22.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-18T21:05:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-18T21:05:22.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-18T21:05:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-18T21:05:22.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T21:05:22.113 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2024-04-18T21:05:22.118 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:22.119+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:22.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T21:05:22.161 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list-id 2024-04-18T21:05:22.162 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:22.162 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:22.176 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:05:22.208 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-18T21:05:22.208 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2024-04-18T21:05:22.208 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-18T21:05:22.208 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-18T21:05:22.208 DEBUG:teuthology.orchestra.run.smithi078:> ') 2024-04-18T21:05:22.219 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:22.219+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:22.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-18T21:05:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-18T21:05:22.311 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:22.311 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:22.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-18T21:05:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-18T21:05:22.320 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:22.319+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:22.324 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-18T21:05:22.324 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-18T21:05:22.324 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2024-04-18T21:05:22.324 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-18T21:05:22.324 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-18T21:05:22.324 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-18T21:05:22.324 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-18T21:05:22.324 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-18T21:05:22.324 DEBUG:teuthology.orchestra.run.smithi078:> ') 2024-04-18T21:05:22.325 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:05:22.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-18T21:05:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-18T21:05:22.420 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:22.423+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:22.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-18T21:05:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-18T21:05:22.462 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-18T21:05:22.462 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2024-04-18T21:05:22.462 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set brx.0 up 2024-04-18T21:05:22.462 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set dev brx.0 master ceph-brx 2024-04-18T21:05:22.462 DEBUG:teuthology.orchestra.run.smithi078:> ') 2024-04-18T21:05:22.490 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:22.490 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:22.504 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:05:22.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-18T21:05:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-18T21:05:22.545 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:22.547+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:22.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-18T21:05:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-18T21:05:22.568 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-18T21:05:22.568 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-18T21:05:22.568 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-18T21:05:22.620 INFO:teuthology.orchestra.run.smithi078.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-18T21:05:22.620 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-18T21:05:22.621 DEBUG:teuthology.orchestra.run.smithi078:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-18T21:05:22.622 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:22.619+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:22.665 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:22.665 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:22.670 DEBUG:teuthology.orchestra.run.smithi078:> sudo modprobe fuse 2024-04-18T21:05:22.679 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:05:22.722 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:22.723+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:22.725 DEBUG:teuthology.orchestra.run.smithi078:> cat /proc/self/mounts | awk '{print $2}' 2024-04-18T21:05:22.773 INFO:teuthology.orchestra.run.smithi078.stdout:/sys 2024-04-18T21:05:22.773 INFO:teuthology.orchestra.run.smithi078.stdout:/proc 2024-04-18T21:05:22.773 INFO:teuthology.orchestra.run.smithi078.stdout:/dev 2024-04-18T21:05:22.773 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/pts 2024-04-18T21:05:22.773 INFO:teuthology.orchestra.run.smithi078.stdout:/run 2024-04-18T21:05:22.773 INFO:teuthology.orchestra.run.smithi078.stdout:/ 2024-04-18T21:05:22.774 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/security 2024-04-18T21:05:22.774 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/shm 2024-04-18T21:05:22.774 INFO:teuthology.orchestra.run.smithi078.stdout:/run/lock 2024-04-18T21:05:22.774 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/cgroup 2024-04-18T21:05:22.774 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/pstore 2024-04-18T21:05:22.774 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/bpf 2024-04-18T21:05:22.774 INFO:teuthology.orchestra.run.smithi078.stdout:/proc/sys/fs/binfmt_misc 2024-04-18T21:05:22.774 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/hugepages 2024-04-18T21:05:22.774 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/mqueue 2024-04-18T21:05:22.774 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/debug 2024-04-18T21:05:22.774 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/tracing 2024-04-18T21:05:22.774 INFO:teuthology.orchestra.run.smithi078.stdout:/proc/fs/nfsd 2024-04-18T21:05:22.774 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/fuse/connections 2024-04-18T21:05:22.774 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/config 2024-04-18T21:05:22.775 INFO:teuthology.orchestra.run.smithi078.stdout:/run/credentials/systemd-sysusers.service 2024-04-18T21:05:22.775 INFO:teuthology.orchestra.run.smithi078.stdout:/run/rpc_pipefs 2024-04-18T21:05:22.775 INFO:teuthology.orchestra.run.smithi078.stdout:/run/user/1000 2024-04-18T21:05:22.775 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph 2024-04-18T21:05:22.775 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns 2024-04-18T21:05:22.775 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-18T21:05:22.775 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-18T21:05:22.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T21:05:22.776 DEBUG:teuthology.orchestra.run.smithi078:> ls /sys/fs/fuse/connections 2024-04-18T21:05:22.808 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:22.808 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:22.822 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:05:22.824 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-18T21:05:22.824 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-18T21:05:22.825 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:22.823+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:22.869 DEBUG:teuthology.orchestra.run.smithi078:> sudo modprobe fuse 2024-04-18T21:05:22.882 DEBUG:teuthology.orchestra.run.smithi078:> cat /proc/self/mounts | awk '{print $2}' 2024-04-18T21:05:22.924 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:22.923+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:22.928 INFO:teuthology.orchestra.run.smithi078.stdout:/sys 2024-04-18T21:05:22.929 INFO:teuthology.orchestra.run.smithi078.stdout:/proc 2024-04-18T21:05:22.929 INFO:teuthology.orchestra.run.smithi078.stdout:/dev 2024-04-18T21:05:22.929 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/pts 2024-04-18T21:05:22.929 INFO:teuthology.orchestra.run.smithi078.stdout:/run 2024-04-18T21:05:22.929 INFO:teuthology.orchestra.run.smithi078.stdout:/ 2024-04-18T21:05:22.929 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/security 2024-04-18T21:05:22.929 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/shm 2024-04-18T21:05:22.929 INFO:teuthology.orchestra.run.smithi078.stdout:/run/lock 2024-04-18T21:05:22.929 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/cgroup 2024-04-18T21:05:22.929 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/pstore 2024-04-18T21:05:22.929 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/bpf 2024-04-18T21:05:22.929 INFO:teuthology.orchestra.run.smithi078.stdout:/proc/sys/fs/binfmt_misc 2024-04-18T21:05:22.929 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/hugepages 2024-04-18T21:05:22.929 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/mqueue 2024-04-18T21:05:22.930 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/debug 2024-04-18T21:05:22.930 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/tracing 2024-04-18T21:05:22.930 INFO:teuthology.orchestra.run.smithi078.stdout:/proc/fs/nfsd 2024-04-18T21:05:22.930 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/fuse/connections 2024-04-18T21:05:22.930 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/config 2024-04-18T21:05:22.930 INFO:teuthology.orchestra.run.smithi078.stdout:/run/credentials/systemd-sysusers.service 2024-04-18T21:05:22.930 INFO:teuthology.orchestra.run.smithi078.stdout:/run/rpc_pipefs 2024-04-18T21:05:22.930 INFO:teuthology.orchestra.run.smithi078.stdout:/run/user/1000 2024-04-18T21:05:22.930 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph 2024-04-18T21:05:22.930 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns 2024-04-18T21:05:22.930 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-18T21:05:22.930 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-18T21:05:22.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T21:05:22.931 DEBUG:teuthology.orchestra.run.smithi078:> ls /sys/fs/fuse/connections 2024-04-18T21:05:22.938 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:22.938 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:22.952 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:05:22.961 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi078.stderr:2024-04-18T21:05:22.963+0000 7f6ff0958580 -1 init, newargv = 0x55b8f7cb83e0 newargc=15 2024-04-18T21:05:22.962 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi078.stderr:ceph-fuse[22801]: starting ceph client 2024-04-18T21:05:22.967 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi078.stderr:ceph-fuse[22801]: starting fuse 2024-04-18T21:05:23.025 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:23.027+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:23.069 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:23.069 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:23.084 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:05:23.129 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:23.131+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:23.215 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:23.215 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:23.225 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:23.227+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:23.230 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:05:23.326 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:23.327+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:23.396 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:23.396 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:23.410 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:05:23.427 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:23.427+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:23.501 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:05:23.528 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:23.528 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:23.528 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:23.527+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:23.542 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:05:23.628 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:23.631+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:23.658 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:05:23.659 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:05:23.671 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:23.672 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:23.679 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1: {} 2024-04-18T21:05:23.679 INFO:teuthology.orchestra.run.smithi078.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:05:23.686 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:05:23.698 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:05:23.699 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:05:23.729 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:23.731+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:23.767 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-18T21:05:23.830 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:23.831+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:23.848 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:05:23.848 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:05:23.848 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-18T21:05:23.848 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-18T21:05:23.848 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:05:23.864 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:05:23.931 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:23.931+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:23.985 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:05:23.985 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-18T21:05:23.985 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-18T21:05:23.985 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:05:23.985 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:23.985 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:23.985 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:05:23.986 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.368892606999999, 2024-04-18T21:05:23.986 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.034065303999999998, 2024-04-18T21:05:23.986 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:23.986 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:23.986 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:23.986 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:23.986 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:23.986 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:23.986 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:05:23.986 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:23.986 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:23.986 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:23.986 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:23.986 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:05:23.987 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:23.987 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:23.987 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:23.987 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:23.987 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615254+0000", 2024-04-18T21:05:23.987 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7829999999999999e-06 2024-04-18T21:05:23.987 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:23.987 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:23.987 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:23.987 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615267+0000", 2024-04-18T21:05:23.987 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3334e-05 2024-04-18T21:05:23.987 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:23.987 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:23.988 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:23.988 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615294+0000", 2024-04-18T21:05:23.988 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7271999999999999e-05 2024-04-18T21:05:23.988 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:23.988 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:23.988 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:23.988 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615321+0000", 2024-04-18T21:05:23.988 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.637e-05 2024-04-18T21:05:23.988 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:23.988 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:23.988 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:23.988 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615479+0000", 2024-04-18T21:05:23.988 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000158493 2024-04-18T21:05:23.988 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:23.989 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:23.989 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:23.989 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615498+0000", 2024-04-18T21:05:23.989 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9148999999999999e-05 2024-04-18T21:05:23.989 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:23.989 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:23.989 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:23.989 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632915+0000", 2024-04-18T21:05:23.989 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.017416551999999998 2024-04-18T21:05:23.989 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:23.989 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:23.989 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:23.989 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633302+0000", 2024-04-18T21:05:23.989 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00038725000000000001 2024-04-18T21:05:23.989 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:23.990 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:23.990 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:23.990 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633638+0000", 2024-04-18T21:05:23.990 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000335946 2024-04-18T21:05:23.990 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:23.990 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:23.990 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:23.990 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645976+0000", 2024-04-18T21:05:23.990 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012337617 2024-04-18T21:05:23.990 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:23.990 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:23.990 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:23.990 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649080+0000", 2024-04-18T21:05:23.990 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031038929999999999 2024-04-18T21:05:23.991 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:23.991 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:23.991 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:23.991 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649207+0000", 2024-04-18T21:05:23.991 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000127537 2024-04-18T21:05:23.991 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:23.991 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:23.991 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:23.991 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649316+0000", 2024-04-18T21:05:23.991 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109108 2024-04-18T21:05:23.991 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:23.991 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:23.991 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:23.992 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:23.992 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:23.992 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:23.992 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:05:23.992 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.368759229999998, 2024-04-18T21:05:23.992 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036275764000000002, 2024-04-18T21:05:23.992 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:23.992 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:23.992 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:23.992 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:23.992 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:23.992 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:23.992 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:05:23.992 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:23.992 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:23.993 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:23.993 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:23.993 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:05:23.993 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:23.993 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:23.993 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:23.993 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:23.993 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615386+0000", 2024-04-18T21:05:23.993 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.573e-06 2024-04-18T21:05:23.993 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:23.993 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:23.993 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:23.993 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:05:23.993 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0723999999999999e-05 2024-04-18T21:05:23.994 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:23.994 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:23.994 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:23.994 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615418+0000", 2024-04-18T21:05:23.994 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0902000000000001e-05 2024-04-18T21:05:23.994 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:23.994 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:23.994 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:23.994 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615433+0000", 2024-04-18T21:05:23.994 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5319999999999999e-05 2024-04-18T21:05:23.994 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:23.994 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:23.994 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:23.994 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615659+0000", 2024-04-18T21:05:23.994 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000226095 2024-04-18T21:05:23.995 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:23.995 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:23.995 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:23.995 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:23.995 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1276e-05 2024-04-18T21:05:23.995 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:23.995 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:23.995 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:23.995 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643654+0000", 2024-04-18T21:05:23.995 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027983238000000001 2024-04-18T21:05:23.995 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:23.995 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:23.995 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:23.995 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643868+0000", 2024-04-18T21:05:23.995 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000214305 2024-04-18T21:05:23.995 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:23.996 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:23.996 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:23.996 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:05:23.996 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035892200000000002 2024-04-18T21:05:23.996 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:23.996 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:23.996 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:23.996 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646056+0000", 2024-04-18T21:05:23.996 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001829172 2024-04-18T21:05:23.996 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:23.996 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:23.996 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:23.997 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651406+0000", 2024-04-18T21:05:23.997 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0053504800000000003 2024-04-18T21:05:23.997 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:23.997 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:23.997 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:23.997 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651551+0000", 2024-04-18T21:05:23.997 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014427999999999999 2024-04-18T21:05:23.997 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:23.997 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:23.997 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:23.997 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651660+0000", 2024-04-18T21:05:23.997 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109477 2024-04-18T21:05:23.997 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:23.997 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:23.997 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:23.998 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:23.998 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:23.998 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:23.998 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:05:23.998 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.368685847999998, 2024-04-18T21:05:23.998 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045668994999999997, 2024-04-18T21:05:23.998 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:23.998 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:23.998 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:23.998 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:23.998 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:23.998 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:23.998 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:05:23.998 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:23.999 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:23.999 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:23.999 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:23.999 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:05:23.999 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:23.999 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:23.999 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:23.999 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:23.999 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615459+0000", 2024-04-18T21:05:23.999 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5030000000000001e-06 2024-04-18T21:05:23.999 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:23.999 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.000 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:24.000 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615506+0000", 2024-04-18T21:05:24.000 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6872000000000001e-05 2024-04-18T21:05:24.000 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.000 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.000 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:24.000 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615527+0000", 2024-04-18T21:05:24.000 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0763000000000001e-05 2024-04-18T21:05:24.000 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.000 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.000 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:24.000 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615551+0000", 2024-04-18T21:05:24.000 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4159e-05 2024-04-18T21:05:24.000 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.001 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.001 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:24.001 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615736+0000", 2024-04-18T21:05:24.001 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018499599999999999 2024-04-18T21:05:24.001 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.001 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.001 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:24.001 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615748+0000", 2024-04-18T21:05:24.001 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2272999999999999e-05 2024-04-18T21:05:24.001 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.001 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.001 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:24.001 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635481+0000", 2024-04-18T21:05:24.001 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019732772999999999 2024-04-18T21:05:24.001 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.001 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.002 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:24.002 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635791+0000", 2024-04-18T21:05:24.002 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031013299999999998 2024-04-18T21:05:24.002 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.002 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.002 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:24.002 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636101+0000", 2024-04-18T21:05:24.002 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030943300000000002 2024-04-18T21:05:24.002 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.002 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.002 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:24.002 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646043+0000", 2024-04-18T21:05:24.002 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099428139999999995 2024-04-18T21:05:24.003 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.003 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.003 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:24.003 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660991+0000", 2024-04-18T21:05:24.003 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014947142 2024-04-18T21:05:24.003 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.003 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.003 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:24.003 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661061+0000", 2024-04-18T21:05:24.003 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0438000000000006e-05 2024-04-18T21:05:24.003 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.003 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.003 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:24.003 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661127+0000", 2024-04-18T21:05:24.004 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5696000000000003e-05 2024-04-18T21:05:24.004 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:24.004 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:24.004 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:24.004 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.004 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.004 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:24.004 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:24.004 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.368473420000001, 2024-04-18T21:05:24.004 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045745085999999997, 2024-04-18T21:05:24.004 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:24.004 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:24.004 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:24.004 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:24.004 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.005 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:24.005 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:24.005 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:24.005 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.005 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.005 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:24.005 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:24.005 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:24.005 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.005 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.005 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:24.005 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:05:24.005 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7400000000000001e-06 2024-04-18T21:05:24.005 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.006 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.006 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:24.006 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:05:24.006 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8133e-05 2024-04-18T21:05:24.006 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.006 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.006 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:24.006 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615726+0000", 2024-04-18T21:05:24.006 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6132e-05 2024-04-18T21:05:24.006 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.006 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.006 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:24.006 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615742+0000", 2024-04-18T21:05:24.006 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6157000000000001e-05 2024-04-18T21:05:24.007 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.007 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.007 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:24.007 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615937+0000", 2024-04-18T21:05:24.007 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000194768 2024-04-18T21:05:24.007 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.007 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.007 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:24.007 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615950+0000", 2024-04-18T21:05:24.007 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3084e-05 2024-04-18T21:05:24.007 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.007 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.007 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:24.007 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643676+0000", 2024-04-18T21:05:24.007 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027725639999999999 2024-04-18T21:05:24.008 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.008 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.008 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:24.008 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643867+0000", 2024-04-18T21:05:24.008 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019075900000000001 2024-04-18T21:05:24.008 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.008 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.008 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:24.008 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:05:24.008 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036013799999999997 2024-04-18T21:05:24.008 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.008 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.008 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:24.008 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646068+0000", 2024-04-18T21:05:24.008 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001841536 2024-04-18T21:05:24.009 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.009 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.009 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:24.009 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661184+0000", 2024-04-18T21:05:24.009 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015115458999999999 2024-04-18T21:05:24.009 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.009 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.009 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:24.009 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661283+0000", 2024-04-18T21:05:24.009 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9502999999999999e-05 2024-04-18T21:05:24.009 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.009 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.009 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:24.009 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661415+0000", 2024-04-18T21:05:24.010 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000132037 2024-04-18T21:05:24.010 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:24.010 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:24.010 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:24.010 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.010 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.010 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:24.010 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:05:24.010 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.368351733000001, 2024-04-18T21:05:24.010 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036185947000000003, 2024-04-18T21:05:24.010 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:24.010 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:24.010 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:24.010 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:24.010 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.011 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:24.011 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:05:24.011 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:24.011 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.011 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.011 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:24.011 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:05:24.011 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:24.011 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.011 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.011 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:24.011 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615794+0000", 2024-04-18T21:05:24.011 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6440000000000001e-06 2024-04-18T21:05:24.011 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.011 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.011 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:24.012 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615803+0000", 2024-04-18T21:05:24.012 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1220000000000001e-06 2024-04-18T21:05:24.012 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.012 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.012 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:24.012 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615827+0000", 2024-04-18T21:05:24.012 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3997000000000001e-05 2024-04-18T21:05:24.012 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.012 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.012 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:24.012 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615899+0000", 2024-04-18T21:05:24.012 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2741e-05 2024-04-18T21:05:24.012 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.012 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.012 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:24.013 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616019+0000", 2024-04-18T21:05:24.013 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119874 2024-04-18T21:05:24.013 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.013 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.013 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:24.013 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616029+0000", 2024-04-18T21:05:24.013 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:05:24.013 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.013 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.013 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:24.013 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644823+0000", 2024-04-18T21:05:24.013 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.028793151999999999 2024-04-18T21:05:24.013 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.013 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.013 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:24.014 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645106+0000", 2024-04-18T21:05:24.014 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028379700000000002 2024-04-18T21:05:24.014 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.014 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.014 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:24.014 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645294+0000", 2024-04-18T21:05:24.014 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000187181 2024-04-18T21:05:24.014 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.014 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.014 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:24.014 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646763+0000", 2024-04-18T21:05:24.014 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0014691050000000001 2024-04-18T21:05:24.014 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.014 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.014 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:24.014 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651784+0000", 2024-04-18T21:05:24.015 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050211650000000002 2024-04-18T21:05:24.015 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.015 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.015 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:24.015 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651876+0000", 2024-04-18T21:05:24.015 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2503999999999994e-05 2024-04-18T21:05:24.015 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.015 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.015 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:24.015 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651978+0000", 2024-04-18T21:05:24.015 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000101475 2024-04-18T21:05:24.015 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:24.015 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:24.015 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:24.015 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.015 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.015 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:24.016 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:24.016 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.368203126000001, 2024-04-18T21:05:24.016 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032262322000000003, 2024-04-18T21:05:24.016 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:24.016 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:24.016 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:24.016 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:24.016 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.016 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:24.016 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:24.016 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:24.016 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.016 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.016 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:24.016 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:24.016 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:24.017 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.017 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.017 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:24.017 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615943+0000", 2024-04-18T21:05:24.017 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1959999999999998e-06 2024-04-18T21:05:24.017 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.017 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.017 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:24.017 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615956+0000", 2024-04-18T21:05:24.017 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3424000000000001e-05 2024-04-18T21:05:24.017 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.017 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.017 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:24.017 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615983+0000", 2024-04-18T21:05:24.017 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7072000000000001e-05 2024-04-18T21:05:24.017 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.018 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.018 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:24.018 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616006+0000", 2024-04-18T21:05:24.018 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2823000000000002e-05 2024-04-18T21:05:24.018 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.018 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.018 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:24.018 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616156+0000", 2024-04-18T21:05:24.018 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014962299999999999 2024-04-18T21:05:24.018 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.018 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.018 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:24.018 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616174+0000", 2024-04-18T21:05:24.018 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8082999999999999e-05 2024-04-18T21:05:24.019 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.019 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.019 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:24.019 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.629952+0000", 2024-04-18T21:05:24.019 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013778514 2024-04-18T21:05:24.019 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.019 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.019 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:24.019 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630201+0000", 2024-04-18T21:05:24.019 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024918100000000001 2024-04-18T21:05:24.019 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.019 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.019 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:24.019 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630386+0000", 2024-04-18T21:05:24.019 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018436900000000001 2024-04-18T21:05:24.020 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.020 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.020 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:24.020 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643169+0000", 2024-04-18T21:05:24.020 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012782774 2024-04-18T21:05:24.020 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.020 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.020 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:24.020 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.647924+0000", 2024-04-18T21:05:24.020 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004755787 2024-04-18T21:05:24.020 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.020 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.020 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:24.020 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648069+0000", 2024-04-18T21:05:24.020 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014459600000000001 2024-04-18T21:05:24.020 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.020 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.021 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:24.021 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648203+0000", 2024-04-18T21:05:24.021 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013388000000000001 2024-04-18T21:05:24.021 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:24.021 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:24.021 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:24.021 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.021 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.021 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:24.021 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:05:24.021 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.368094862, 2024-04-18T21:05:24.021 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032489736999999998, 2024-04-18T21:05:24.021 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:24.021 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:24.021 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:24.022 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:24.022 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.022 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:24.022 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:05:24.022 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:24.022 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.022 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.022 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:24.022 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:05:24.022 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:24.022 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.022 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.022 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:24.023 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616050+0000", 2024-04-18T21:05:24.023 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.606e-06 2024-04-18T21:05:24.023 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.023 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.023 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:24.023 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616061+0000", 2024-04-18T21:05:24.023 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0463e-05 2024-04-18T21:05:24.023 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.023 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.023 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:24.023 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616092+0000", 2024-04-18T21:05:24.023 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1415999999999999e-05 2024-04-18T21:05:24.023 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.023 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.024 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:24.024 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616109+0000", 2024-04-18T21:05:24.024 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6557000000000001e-05 2024-04-18T21:05:24.024 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.024 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.024 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:24.024 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616358+0000", 2024-04-18T21:05:24.024 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000249077 2024-04-18T21:05:24.024 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.024 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.024 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:24.025 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616370+0000", 2024-04-18T21:05:24.025 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2037e-05 2024-04-18T21:05:24.025 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.025 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.025 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:24.025 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.634920+0000", 2024-04-18T21:05:24.025 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018550397 2024-04-18T21:05:24.025 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.025 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.025 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:24.025 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640420+0000", 2024-04-18T21:05:24.025 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055000539999999999 2024-04-18T21:05:24.025 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.026 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.026 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:24.026 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648538+0000", 2024-04-18T21:05:24.026 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0081181299999999994 2024-04-18T21:05:24.026 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:24.026 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:24.026 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:24.026 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.026 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.026 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:24.026 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:05:24.026 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.368010541, 2024-04-18T21:05:24.026 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036090029000000003, 2024-04-18T21:05:24.026 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:24.026 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:24.026 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:24.027 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:24.027 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.027 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:24.027 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:05:24.027 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:24.027 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.027 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.027 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:24.027 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:05:24.027 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:24.027 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.027 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.027 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:24.027 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616134+0000", 2024-04-18T21:05:24.028 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.353e-06 2024-04-18T21:05:24.028 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.028 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.028 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:24.028 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616141+0000", 2024-04-18T21:05:24.028 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2770000000000002e-06 2024-04-18T21:05:24.028 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.028 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.028 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:24.028 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616160+0000", 2024-04-18T21:05:24.028 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.91e-05 2024-04-18T21:05:24.028 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.028 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.029 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:24.029 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616170+0000", 2024-04-18T21:05:24.029 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7699999999999996e-06 2024-04-18T21:05:24.029 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.029 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.029 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:24.029 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616275+0000", 2024-04-18T21:05:24.029 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105313 2024-04-18T21:05:24.029 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.029 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.029 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:24.029 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616288+0000", 2024-04-18T21:05:24.029 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3027000000000001e-05 2024-04-18T21:05:24.029 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.029 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.030 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:24.030 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646160+0000", 2024-04-18T21:05:24.030 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.029872019 2024-04-18T21:05:24.030 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.030 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.030 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:24.030 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646368+0000", 2024-04-18T21:05:24.030 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020811899999999999 2024-04-18T21:05:24.030 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.030 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.030 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:24.030 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652223+0000", 2024-04-18T21:05:24.030 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.005855051 2024-04-18T21:05:24.031 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:24.031 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:24.031 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:24.031 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.031 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.031 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:24.031 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:05:24.031 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.367952972000001, 2024-04-18T21:05:24.031 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043572403000000003, 2024-04-18T21:05:24.031 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:24.031 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:24.031 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:24.031 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:24.031 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.031 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:24.032 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:05:24.032 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:24.032 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.032 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.032 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:24.032 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:05:24.032 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:24.032 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.032 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.032 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:24.032 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616192+0000", 2024-04-18T21:05:24.032 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:05:24.032 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.032 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.032 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:24.033 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616203+0000", 2024-04-18T21:05:24.033 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0890000000000001e-05 2024-04-18T21:05:24.033 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.033 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.033 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:24.033 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616223+0000", 2024-04-18T21:05:24.033 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0409000000000001e-05 2024-04-18T21:05:24.033 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.033 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.033 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:24.033 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616238+0000", 2024-04-18T21:05:24.033 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5160000000000001e-05 2024-04-18T21:05:24.033 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.033 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.033 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:24.034 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616343+0000", 2024-04-18T21:05:24.034 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000104831 2024-04-18T21:05:24.034 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.034 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.034 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:24.034 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616357+0000", 2024-04-18T21:05:24.034 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3686000000000001e-05 2024-04-18T21:05:24.034 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.034 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.034 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:24.034 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635912+0000", 2024-04-18T21:05:24.034 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019554944000000001 2024-04-18T21:05:24.034 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.034 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.034 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:24.035 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636231+0000", 2024-04-18T21:05:24.035 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000318766 2024-04-18T21:05:24.035 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.035 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.035 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:24.035 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659763+0000", 2024-04-18T21:05:24.035 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023532474000000001 2024-04-18T21:05:24.035 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:24.035 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:24.035 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:24.035 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.035 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.035 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:24.035 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:05:24.035 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.364024265000001, 2024-04-18T21:05:24.035 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015007971, 2024-04-18T21:05:24.036 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:24.036 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:24.036 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:24.036 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:24.036 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.036 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:24.036 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:05:24.036 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:24.036 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.036 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.036 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:24.036 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:05:24.036 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:24.036 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.037 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.037 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:24.037 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620120+0000", 2024-04-18T21:05:24.037 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0359999999999999e-06 2024-04-18T21:05:24.037 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.037 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.037 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:24.037 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620157+0000", 2024-04-18T21:05:24.037 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6636e-05 2024-04-18T21:05:24.037 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.037 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.037 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:24.037 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620177+0000", 2024-04-18T21:05:24.037 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0247000000000001e-05 2024-04-18T21:05:24.038 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.038 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.038 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:24.038 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620195+0000", 2024-04-18T21:05:24.038 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7819e-05 2024-04-18T21:05:24.038 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.038 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.038 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:24.038 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620342+0000", 2024-04-18T21:05:24.038 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014643300000000001 2024-04-18T21:05:24.038 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.038 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.038 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:24.039 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620405+0000", 2024-04-18T21:05:24.039 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3522000000000006e-05 2024-04-18T21:05:24.039 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.039 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.039 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:24.039 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635016+0000", 2024-04-18T21:05:24.039 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014610840999999999 2024-04-18T21:05:24.039 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.039 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.039 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:24.039 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635127+0000", 2024-04-18T21:05:24.039 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111437 2024-04-18T21:05:24.039 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:24.039 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:24.040 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:24.040 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.040 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.040 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:24.040 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:05:24.040 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.363916997, 2024-04-18T21:05:24.040 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012693296, 2024-04-18T21:05:24.040 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:24.040 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:24.040 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:24.040 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:24.040 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.040 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:24.040 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:05:24.041 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:24.041 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.041 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.041 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:24.041 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:05:24.041 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:24.041 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.041 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.041 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:24.041 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620228+0000", 2024-04-18T21:05:24.041 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:05:24.041 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.041 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.041 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:24.041 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620236+0000", 2024-04-18T21:05:24.042 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.303e-06 2024-04-18T21:05:24.042 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.042 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.042 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:24.042 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620255+0000", 2024-04-18T21:05:24.042 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9406e-05 2024-04-18T21:05:24.042 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.042 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.042 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:24.042 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620274+0000", 2024-04-18T21:05:24.042 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8940000000000002e-05 2024-04-18T21:05:24.042 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.042 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.043 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:24.043 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:05:24.043 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001558753 2024-04-18T21:05:24.043 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.043 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.043 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:24.043 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621879+0000", 2024-04-18T21:05:24.043 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6359000000000001e-05 2024-04-18T21:05:24.043 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.043 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.043 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:24.043 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632841+0000", 2024-04-18T21:05:24.043 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010961907 2024-04-18T21:05:24.043 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.043 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.043 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:24.044 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632920+0000", 2024-04-18T21:05:24.044 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8714999999999994e-05 2024-04-18T21:05:24.044 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:24.044 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:24.044 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:24.044 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.044 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.044 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:24.044 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:05:24.044 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.362371234000001, 2024-04-18T21:05:24.044 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013445702, 2024-04-18T21:05:24.044 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:24.044 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:24.044 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:24.045 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:24.045 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.045 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:24.045 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:05:24.045 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:24.045 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.045 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.045 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:24.045 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:05:24.045 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:24.045 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.045 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.045 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:24.045 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621774+0000", 2024-04-18T21:05:24.045 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2500000000000001e-06 2024-04-18T21:05:24.046 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.046 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.046 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:24.046 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621786+0000", 2024-04-18T21:05:24.046 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2636000000000001e-05 2024-04-18T21:05:24.046 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.046 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.046 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:24.046 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621814+0000", 2024-04-18T21:05:24.046 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7823000000000001e-05 2024-04-18T21:05:24.046 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.046 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.046 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:24.046 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621844+0000", 2024-04-18T21:05:24.047 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9589000000000001e-05 2024-04-18T21:05:24.047 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.047 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.047 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:24.047 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622253+0000", 2024-04-18T21:05:24.047 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040963700000000002 2024-04-18T21:05:24.047 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.047 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.047 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:24.047 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622304+0000", 2024-04-18T21:05:24.047 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0868999999999997e-05 2024-04-18T21:05:24.047 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.047 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.047 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:24.047 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635133+0000", 2024-04-18T21:05:24.048 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012829136 2024-04-18T21:05:24.048 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.048 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.048 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:24.048 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635218+0000", 2024-04-18T21:05:24.048 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4761999999999999e-05 2024-04-18T21:05:24.048 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:24.048 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:24.048 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:24.048 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.048 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.048 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:24.048 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:05:24.048 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.362244474000001, 2024-04-18T21:05:24.048 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014162065, 2024-04-18T21:05:24.048 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:24.049 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:24.049 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:24.049 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:24.049 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.049 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:24.049 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:05:24.049 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:24.049 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.049 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.049 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:24.049 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:05:24.049 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:24.049 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.049 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.049 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:24.049 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621900+0000", 2024-04-18T21:05:24.050 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:05:24.050 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.050 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.050 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:24.050 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621910+0000", 2024-04-18T21:05:24.050 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0207000000000001e-05 2024-04-18T21:05:24.050 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.050 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.050 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:24.050 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621932+0000", 2024-04-18T21:05:24.050 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1789000000000001e-05 2024-04-18T21:05:24.050 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.050 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.050 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:24.050 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621946+0000", 2024-04-18T21:05:24.050 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4212999999999999e-05 2024-04-18T21:05:24.051 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.051 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.051 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:24.051 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624477+0000", 2024-04-18T21:05:24.051 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025303470000000001 2024-04-18T21:05:24.051 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.051 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.051 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:24.051 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624525+0000", 2024-04-18T21:05:24.051 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8084999999999998e-05 2024-04-18T21:05:24.051 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.051 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.051 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:24.051 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635976+0000", 2024-04-18T21:05:24.051 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.011451368999999999 2024-04-18T21:05:24.051 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.052 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.052 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:24.052 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636061+0000", 2024-04-18T21:05:24.052 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5094999999999998e-05 2024-04-18T21:05:24.052 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:24.052 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:24.052 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:24.052 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.052 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.052 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:05:24.052 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:05:24.052 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.353008848999998, 2024-04-18T21:05:24.052 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0098014739999999993, 2024-04-18T21:05:24.052 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:24.052 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:24.052 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:05:24.053 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:24.053 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.053 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:24.053 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:05:24.053 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:24.053 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.053 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.053 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:24.053 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:05:24.053 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:24.053 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.053 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.053 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:24.053 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631136+0000", 2024-04-18T21:05:24.054 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0139999999999999e-06 2024-04-18T21:05:24.054 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.054 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.054 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:24.054 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631152+0000", 2024-04-18T21:05:24.054 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6365999999999999e-05 2024-04-18T21:05:24.054 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.054 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.054 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:24.054 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631961+0000", 2024-04-18T21:05:24.054 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00080873100000000003 2024-04-18T21:05:24.054 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.054 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.054 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:24.054 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632021+0000", 2024-04-18T21:05:24.054 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0541999999999997e-05 2024-04-18T21:05:24.055 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.055 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.055 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:24.055 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633539+0000", 2024-04-18T21:05:24.055 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015175639999999999 2024-04-18T21:05:24.055 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.055 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.055 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:24.055 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640936+0000", 2024-04-18T21:05:24.055 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007397257 2024-04-18T21:05:24.055 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:24.055 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:24.055 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:24.055 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.055 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.056 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-18T21:05:24.056 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:05:24.056 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.335547416000001, 2024-04-18T21:05:24.056 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00073592199999999997, 2024-04-18T21:05:24.056 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:24.056 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:24.056 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:24.056 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:24.056 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.056 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:24.056 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:05:24.056 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:24.056 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.056 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.057 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:24.057 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:05:24.057 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:24.057 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.057 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.057 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:24.057 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648597+0000", 2024-04-18T21:05:24.057 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:05:24.057 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.057 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.057 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:24.057 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648605+0000", 2024-04-18T21:05:24.057 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3960000000000006e-06 2024-04-18T21:05:24.057 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.057 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.057 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:24.058 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648625+0000", 2024-04-18T21:05:24.058 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9987e-05 2024-04-18T21:05:24.058 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.058 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.058 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:24.058 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648643+0000", 2024-04-18T21:05:24.058 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7079e-05 2024-04-18T21:05:24.058 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.058 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.058 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:24.058 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649043+0000", 2024-04-18T21:05:24.058 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040083399999999998 2024-04-18T21:05:24.058 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.059 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.059 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:24.059 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649062+0000", 2024-04-18T21:05:24.059 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9052999999999999e-05 2024-04-18T21:05:24.059 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.059 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.059 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:24.059 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649332+0000", 2024-04-18T21:05:24.059 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026971999999999999 2024-04-18T21:05:24.059 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:24.059 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:24.059 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:24.059 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.059 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.059 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-18T21:05:24.060 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.651309+0000", 2024-04-18T21:05:24.060 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.332834577, 2024-04-18T21:05:24.060 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00068160699999999998, 2024-04-18T21:05:24.060 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:24.060 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:24.060 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:24.060 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:24.060 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.060 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:24.060 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651309+0000", 2024-04-18T21:05:24.060 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:24.060 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.060 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.060 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:24.061 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651309+0000", 2024-04-18T21:05:24.061 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:24.061 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.061 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.061 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:24.061 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651310+0000", 2024-04-18T21:05:24.061 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0160000000000001e-06 2024-04-18T21:05:24.061 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.061 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.061 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:24.061 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651316+0000", 2024-04-18T21:05:24.061 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4069999999999998e-06 2024-04-18T21:05:24.061 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.061 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.062 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:24.062 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651334+0000", 2024-04-18T21:05:24.062 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7186000000000001e-05 2024-04-18T21:05:24.062 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.062 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.062 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:24.062 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651350+0000", 2024-04-18T21:05:24.062 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.668e-05 2024-04-18T21:05:24.062 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.062 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.062 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:24.062 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651754+0000", 2024-04-18T21:05:24.062 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040365399999999998 2024-04-18T21:05:24.062 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.062 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.063 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:24.063 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651771+0000", 2024-04-18T21:05:24.063 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7059e-05 2024-04-18T21:05:24.063 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.063 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.063 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:24.063 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651991+0000", 2024-04-18T21:05:24.063 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000219605 2024-04-18T21:05:24.063 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:24.063 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:24.063 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:24.063 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.063 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.063 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:05:24.063 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:05:24.063 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.332772514999998, 2024-04-18T21:05:24.064 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00086123999999999999, 2024-04-18T21:05:24.064 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:24.064 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:24.064 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:05:24.064 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:24.064 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.064 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:24.064 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:05:24.064 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:24.064 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.064 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.064 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:24.064 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:05:24.064 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:24.064 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.065 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.065 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:24.065 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651372+0000", 2024-04-18T21:05:24.065 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7599999999999997e-07 2024-04-18T21:05:24.065 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.065 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.065 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:24.065 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651377+0000", 2024-04-18T21:05:24.065 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.22e-06 2024-04-18T21:05:24.065 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.065 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.065 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:24.066 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651394+0000", 2024-04-18T21:05:24.066 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6646999999999998e-05 2024-04-18T21:05:24.066 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.066 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.066 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:24.066 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651427+0000", 2024-04-18T21:05:24.066 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3682e-05 2024-04-18T21:05:24.066 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.066 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.066 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:24.066 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652029+0000", 2024-04-18T21:05:24.066 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00060152199999999995 2024-04-18T21:05:24.066 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.067 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.067 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:24.067 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652232+0000", 2024-04-18T21:05:24.067 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020359299999999999 2024-04-18T21:05:24.067 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:24.067 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:24.067 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:24.067 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.067 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.067 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:05:24.067 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:05:24.067 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.324745553, 2024-04-18T21:05:24.067 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0017426200000000001, 2024-04-18T21:05:24.067 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:24.067 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:24.068 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:24.068 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:24.068 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.068 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:24.068 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:05:24.068 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:24.068 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.068 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.068 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:24.068 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:05:24.068 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:24.068 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.068 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.068 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:24.069 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659399+0000", 2024-04-18T21:05:24.069 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6000000000000002e-07 2024-04-18T21:05:24.069 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.069 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.069 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:24.069 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659405+0000", 2024-04-18T21:05:24.069 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5069999999999997e-06 2024-04-18T21:05:24.069 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.069 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.069 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:24.069 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659425+0000", 2024-04-18T21:05:24.069 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.927e-05 2024-04-18T21:05:24.069 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.069 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.069 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:24.070 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659443+0000", 2024-04-18T21:05:24.070 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8051999999999999e-05 2024-04-18T21:05:24.070 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.070 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.070 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:24.070 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660973+0000", 2024-04-18T21:05:24.070 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001530106 2024-04-18T21:05:24.070 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.070 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.070 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:24.070 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660983+0000", 2024-04-18T21:05:24.070 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0516999999999999e-05 2024-04-18T21:05:24.070 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.070 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.071 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:24.071 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661141+0000", 2024-04-18T21:05:24.071 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015730799999999999 2024-04-18T21:05:24.071 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:24.071 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:24.071 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:24.071 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.071 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.071 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:05:24.071 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:05:24.071 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.324528927999999, 2024-04-18T21:05:24.071 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001812311, 2024-04-18T21:05:24.071 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:24.071 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:24.072 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:24.072 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:24.072 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.072 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:24.072 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:05:24.072 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:24.072 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.072 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.072 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:24.072 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:05:24.072 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:24.072 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.072 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.072 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:24.072 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659616+0000", 2024-04-18T21:05:24.073 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.277e-06 2024-04-18T21:05:24.073 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.073 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.073 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:24.073 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659625+0000", 2024-04-18T21:05:24.073 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5359999999999998e-06 2024-04-18T21:05:24.073 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.073 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.073 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:24.073 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659647+0000", 2024-04-18T21:05:24.073 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1857000000000001e-05 2024-04-18T21:05:24.073 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.073 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.073 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:24.073 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659664+0000", 2024-04-18T21:05:24.074 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6405999999999998e-05 2024-04-18T21:05:24.074 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.074 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.074 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:24.074 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661169+0000", 2024-04-18T21:05:24.074 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015054179999999999 2024-04-18T21:05:24.074 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.074 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.074 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:24.074 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661177+0000", 2024-04-18T21:05:24.074 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9680000000000006e-06 2024-04-18T21:05:24.074 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.074 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.075 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:24.075 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661427+0000", 2024-04-18T21:05:24.075 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024984900000000001 2024-04-18T21:05:24.075 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:24.075 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:24.075 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:24.075 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.075 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.075 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-18T21:05:24.075 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:05:24.075 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 16.37160832, 2024-04-18T21:05:24.075 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0030975030000000001, 2024-04-18T21:05:24.075 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:24.075 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:24.076 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:24.076 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:24.076 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.076 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:24.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:05:24.076 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:24.076 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.076 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.076 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:24.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:05:24.076 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:24.076 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.076 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.076 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:24.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612538+0000", 2024-04-18T21:05:24.076 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6259999999999999e-06 2024-04-18T21:05:24.077 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.077 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.077 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:24.077 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612552+0000", 2024-04-18T21:05:24.077 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4073999999999999e-05 2024-04-18T21:05:24.077 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.077 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.077 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:24.077 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612585+0000", 2024-04-18T21:05:24.077 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3504999999999999e-05 2024-04-18T21:05:24.077 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.077 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.077 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:24.077 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612601+0000", 2024-04-18T21:05:24.078 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5194000000000001e-05 2024-04-18T21:05:24.078 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.078 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.078 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:24.078 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612746+0000", 2024-04-18T21:05:24.078 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145666 2024-04-18T21:05:24.078 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.078 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.078 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:24.078 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612953+0000", 2024-04-18T21:05:24.078 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000207109 2024-04-18T21:05:24.078 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.078 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.078 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:24.078 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.613134+0000", 2024-04-18T21:05:24.079 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018041300000000001 2024-04-18T21:05:24.079 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.079 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.079 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:24.079 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.614411+0000", 2024-04-18T21:05:24.079 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0012769929999999999 2024-04-18T21:05:24.079 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.079 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.079 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:24.079 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615441+0000", 2024-04-18T21:05:24.079 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001029917 2024-04-18T21:05:24.079 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.079 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.080 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:24.080 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615522+0000", 2024-04-18T21:05:24.080 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1142000000000003e-05 2024-04-18T21:05:24.080 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:24.080 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:24.080 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:24.080 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615633+0000", 2024-04-18T21:05:24.080 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000110864 2024-04-18T21:05:24.080 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:24.080 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:24.080 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:24.080 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:24.080 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:24.080 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:05:24.081 DEBUG:teuthology.orchestra.run.smithi078:> sudo modprobe fuse 2024-04-18T21:05:24.082 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:24.083+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:24.083 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:05:24.094 DEBUG:teuthology.orchestra.run.smithi078:> cat /proc/self/mounts | awk '{print $2}' 2024-04-18T21:05:24.145 INFO:teuthology.orchestra.run.smithi078.stdout:/sys 2024-04-18T21:05:24.145 INFO:teuthology.orchestra.run.smithi078.stdout:/proc 2024-04-18T21:05:24.145 INFO:teuthology.orchestra.run.smithi078.stdout:/dev 2024-04-18T21:05:24.145 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/pts 2024-04-18T21:05:24.145 INFO:teuthology.orchestra.run.smithi078.stdout:/run 2024-04-18T21:05:24.145 INFO:teuthology.orchestra.run.smithi078.stdout:/ 2024-04-18T21:05:24.145 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/security 2024-04-18T21:05:24.145 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/shm 2024-04-18T21:05:24.145 INFO:teuthology.orchestra.run.smithi078.stdout:/run/lock 2024-04-18T21:05:24.145 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/cgroup 2024-04-18T21:05:24.145 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/pstore 2024-04-18T21:05:24.145 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/bpf 2024-04-18T21:05:24.146 INFO:teuthology.orchestra.run.smithi078.stdout:/proc/sys/fs/binfmt_misc 2024-04-18T21:05:24.146 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/hugepages 2024-04-18T21:05:24.146 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/mqueue 2024-04-18T21:05:24.146 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/debug 2024-04-18T21:05:24.146 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/tracing 2024-04-18T21:05:24.146 INFO:teuthology.orchestra.run.smithi078.stdout:/proc/fs/nfsd 2024-04-18T21:05:24.146 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/fuse/connections 2024-04-18T21:05:24.146 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/config 2024-04-18T21:05:24.146 INFO:teuthology.orchestra.run.smithi078.stdout:/run/credentials/systemd-sysusers.service 2024-04-18T21:05:24.146 INFO:teuthology.orchestra.run.smithi078.stdout:/run/rpc_pipefs 2024-04-18T21:05:24.146 INFO:teuthology.orchestra.run.smithi078.stdout:/run/user/1000 2024-04-18T21:05:24.146 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph 2024-04-18T21:05:24.146 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns 2024-04-18T21:05:24.146 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-18T21:05:24.147 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-18T21:05:24.147 INFO:teuthology.orchestra.run.smithi078.stdout:/home/ubuntu/cephtest/mnt.0 2024-04-18T21:05:24.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T21:05:24.147 DEBUG:teuthology.orchestra.run.smithi078:> ls /sys/fs/fuse/connections 2024-04-18T21:05:24.182 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:24.179+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:24.196 INFO:teuthology.orchestra.run.smithi078.stdout:45 2024-04-18T21:05:24.196 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-04-18T21:05:24.196 DEBUG:teuthology.orchestra.run.smithi078:> sudo stdin-killer -- python3 -c ' 2024-04-18T21:05:24.196 DEBUG:teuthology.orchestra.run.smithi078:> import glob 2024-04-18T21:05:24.196 DEBUG:teuthology.orchestra.run.smithi078:> import re 2024-04-18T21:05:24.196 DEBUG:teuthology.orchestra.run.smithi078:> import os 2024-04-18T21:05:24.196 DEBUG:teuthology.orchestra.run.smithi078:> import subprocess 2024-04-18T21:05:24.196 DEBUG:teuthology.orchestra.run.smithi078:> 2024-04-18T21:05:24.197 DEBUG:teuthology.orchestra.run.smithi078:> def _find_admin_socket(client_name): 2024-04-18T21:05:24.197 DEBUG:teuthology.orchestra.run.smithi078:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-18T21:05:24.197 DEBUG:teuthology.orchestra.run.smithi078:> files = glob.glob(asok_path) 2024-04-18T21:05:24.197 DEBUG:teuthology.orchestra.run.smithi078:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-18T21:05:24.197 DEBUG:teuthology.orchestra.run.smithi078:> 2024-04-18T21:05:24.197 DEBUG:teuthology.orchestra.run.smithi078:> # Given a non-glob path, it better be there 2024-04-18T21:05:24.197 DEBUG:teuthology.orchestra.run.smithi078:> if "*" not in asok_path: 2024-04-18T21:05:24.197 DEBUG:teuthology.orchestra.run.smithi078:> assert(len(files) == 1) 2024-04-18T21:05:24.197 DEBUG:teuthology.orchestra.run.smithi078:> return files[0] 2024-04-18T21:05:24.197 DEBUG:teuthology.orchestra.run.smithi078:> 2024-04-18T21:05:24.197 DEBUG:teuthology.orchestra.run.smithi078:> for f in files: 2024-04-18T21:05:24.197 DEBUG:teuthology.orchestra.run.smithi078:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-18T21:05:24.197 DEBUG:teuthology.orchestra.run.smithi078:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-18T21:05:24.197 DEBUG:teuthology.orchestra.run.smithi078:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-18T21:05:24.197 DEBUG:teuthology.orchestra.run.smithi078:> contents = proc_f.read() 2024-04-18T21:05:24.197 DEBUG:teuthology.orchestra.run.smithi078:> if mountpoint in contents: 2024-04-18T21:05:24.197 DEBUG:teuthology.orchestra.run.smithi078:> return f 2024-04-18T21:05:24.198 DEBUG:teuthology.orchestra.run.smithi078:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-18T21:05:24.198 DEBUG:teuthology.orchestra.run.smithi078:> 2024-04-18T21:05:24.198 DEBUG:teuthology.orchestra.run.smithi078:> print(_find_admin_socket("client.0")) 2024-04-18T21:05:24.198 DEBUG:teuthology.orchestra.run.smithi078:> ' 2024-04-18T21:05:24.216 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:05:24.216 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:05:24.216 INFO:teuthology.orchestra.run.smithi132.stdout: "num_ops": 0 2024-04-18T21:05:24.216 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:05:24.232 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:05:24.283 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:24.283+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:24.319 INFO:teuthology.orchestra.run.smithi078.stdout:/var/run/ceph/ceph-client.0.22801.asok 2024-04-18T21:05:24.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-18T21:05:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-18T21:05:24.331 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.22801.asok 2024-04-18T21:05:24.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T21:05:24.331 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.22801.asok status 2024-04-18T21:05:24.384 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:24.383+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:24.398 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:05:24.398 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:05:24.398 INFO:teuthology.orchestra.run.smithi132.stdout: "complaint_time": 30, 2024-04-18T21:05:24.399 INFO:teuthology.orchestra.run.smithi132.stdout: "num_blocked_ops": 0 2024-04-18T21:05:24.399 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:05:24.412 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:05:24.482 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-04-18T21:05:24.482 INFO:teuthology.orchestra.run.smithi078.stdout: "metadata": { 2024-04-18T21:05:24.482 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph_sha1": "5be49cd9e6fca1ff6a05f2473aa3b399da760600", 2024-04-18T21:05:24.482 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph_version": "ceph version 19.0.0-3141-g5be49cd9 (5be49cd9e6fca1ff6a05f2473aa3b399da760600) squid (dev)", 2024-04-18T21:05:24.482 INFO:teuthology.orchestra.run.smithi078.stdout: "entity_id": "0", 2024-04-18T21:05:24.482 INFO:teuthology.orchestra.run.smithi078.stdout: "hostname": "smithi078", 2024-04-18T21:05:24.482 INFO:teuthology.orchestra.run.smithi078.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-18T21:05:24.483 INFO:teuthology.orchestra.run.smithi078.stdout: "pid": "22801", 2024-04-18T21:05:24.483 INFO:teuthology.orchestra.run.smithi078.stdout: "root": "/" 2024-04-18T21:05:24.483 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:24.483 INFO:teuthology.orchestra.run.smithi078.stdout: "dentry_count": 0, 2024-04-18T21:05:24.483 INFO:teuthology.orchestra.run.smithi078.stdout: "dentry_pinned_count": 0, 2024-04-18T21:05:24.483 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 4534, 2024-04-18T21:05:24.483 INFO:teuthology.orchestra.run.smithi078.stdout: "inst": { 2024-04-18T21:05:24.483 INFO:teuthology.orchestra.run.smithi078.stdout: "name": { 2024-04-18T21:05:24.483 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "client", 2024-04-18T21:05:24.483 INFO:teuthology.orchestra.run.smithi078.stdout: "num": 4534 2024-04-18T21:05:24.483 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:24.483 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": { 2024-04-18T21:05:24.483 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:05:24.483 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "192.168.0.1:0", 2024-04-18T21:05:24.484 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 2547679229 2024-04-18T21:05:24.484 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:24.484 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:24.484 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": { 2024-04-18T21:05:24.484 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:05:24.484 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "192.168.0.1:0", 2024-04-18T21:05:24.484 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 2547679229 2024-04-18T21:05:24.484 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:24.484 INFO:teuthology.orchestra.run.smithi078.stdout: "inst_str": "client.4534 192.168.0.1:0/2547679229", 2024-04-18T21:05:24.484 INFO:teuthology.orchestra.run.smithi078.stdout: "addr_str": "192.168.0.1:0/2547679229", 2024-04-18T21:05:24.484 INFO:teuthology.orchestra.run.smithi078.stdout: "inode_count": 1, 2024-04-18T21:05:24.484 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_epoch": 5, 2024-04-18T21:05:24.484 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_epoch": 19, 2024-04-18T21:05:24.484 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_epoch_barrier": 0, 2024-04-18T21:05:24.485 INFO:teuthology.orchestra.run.smithi078.stdout: "blocklisted": false, 2024-04-18T21:05:24.485 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs" 2024-04-18T21:05:24.485 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-04-18T21:05:24.486 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:24.487+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:24.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T21:05:24.497 DEBUG:teuthology.orchestra.run.smithi078:> stat --file-system '--printf=%T 2024-04-18T21:05:24.497 DEBUG:teuthology.orchestra.run.smithi078:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-18T21:05:24.503 INFO:teuthology.orchestra.run.smithi078.stdout:fuseblk 2024-04-18T21:05:24.503 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-18T21:05:24.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T21:05:24.503 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-18T21:05:24.538 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:05:24.538 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 20, 2024-04-18T21:05:24.539 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 600, 2024-04-18T21:05:24.539 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [ 2024-04-18T21:05:24.539 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.539 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:24.539 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:05:24.539 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 29.626048205, 2024-04-18T21:05:24.539 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.02518273, 2024-04-18T21:05:24.539 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:24.539 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:24.539 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:24.539 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:24.539 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:24.539 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:24.539 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 141 2024-04-18T21:05:24.540 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.540 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:24.540 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.540 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:24.540 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:05:24.540 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:24.540 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.540 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.540 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:24.540 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:05:24.540 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:24.540 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.540 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.540 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:24.540 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911562+0000", 2024-04-18T21:05:24.541 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9300000000000006e-07 2024-04-18T21:05:24.541 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.541 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.541 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:24.541 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911569+0000", 2024-04-18T21:05:24.541 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0169999999999999e-06 2024-04-18T21:05:24.541 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.541 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.541 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:24.541 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911582+0000", 2024-04-18T21:05:24.541 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.343e-05 2024-04-18T21:05:24.541 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.541 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.542 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:24.542 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911590+0000", 2024-04-18T21:05:24.542 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.413e-06 2024-04-18T21:05:24.542 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.542 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.542 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:24.542 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.933922+0000", 2024-04-18T21:05:24.542 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.022332093000000001 2024-04-18T21:05:24.542 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.542 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.542 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:24.542 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.934155+0000", 2024-04-18T21:05:24.542 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023378900000000001 2024-04-18T21:05:24.543 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.543 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.543 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:24.543 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.934514+0000", 2024-04-18T21:05:24.543 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00035859200000000003 2024-04-18T21:05:24.543 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.543 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.543 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:24.543 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.935973+0000", 2024-04-18T21:05:24.543 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001458705 2024-04-18T21:05:24.543 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.544 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.544 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:24.544 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936488+0000", 2024-04-18T21:05:24.544 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00051550000000000001 2024-04-18T21:05:24.544 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.544 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.544 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:24.544 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936636+0000", 2024-04-18T21:05:24.544 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014779800000000001 2024-04-18T21:05:24.544 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.544 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.544 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:24.544 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936743+0000", 2024-04-18T21:05:24.544 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010739999999999999 2024-04-18T21:05:24.545 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:24.545 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:24.545 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:24.545 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.545 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.545 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:24.545 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:05:24.545 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 29.508849230999999, 2024-04-18T21:05:24.545 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023654959999999999, 2024-04-18T21:05:24.545 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:24.545 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:24.545 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:24.545 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:24.546 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:24.546 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:24.546 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 163 2024-04-18T21:05:24.546 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.546 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:24.546 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.546 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:24.546 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:05:24.546 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:24.546 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.546 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.546 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:24.546 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:05:24.546 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:24.547 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.547 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.547 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:24.547 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:05:24.547 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0999999999999998e-07 2024-04-18T21:05:24.547 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.547 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.547 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:24.547 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028766+0000", 2024-04-18T21:05:24.547 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4700000000000001e-06 2024-04-18T21:05:24.547 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.547 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.547 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:24.547 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028775+0000", 2024-04-18T21:05:24.547 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.3190000000000001e-06 2024-04-18T21:05:24.548 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.548 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.548 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:24.548 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028782+0000", 2024-04-18T21:05:24.548 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.2300000000000002e-06 2024-04-18T21:05:24.548 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.548 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.548 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:24.548 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046667+0000", 2024-04-18T21:05:24.548 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017884356000000001 2024-04-18T21:05:24.548 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.548 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.548 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:24.548 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046788+0000", 2024-04-18T21:05:24.549 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012125000000000001 2024-04-18T21:05:24.549 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.549 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.549 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:24.549 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046982+0000", 2024-04-18T21:05:24.549 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019394 2024-04-18T21:05:24.549 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.549 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.549 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:24.549 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051969+0000", 2024-04-18T21:05:24.549 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0049868150000000003 2024-04-18T21:05:24.549 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.549 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.550 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:24.550 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052089+0000", 2024-04-18T21:05:24.550 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011993 2024-04-18T21:05:24.550 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.550 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.550 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:24.550 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052292+0000", 2024-04-18T21:05:24.550 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020345699999999999 2024-04-18T21:05:24.550 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.550 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.550 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:24.550 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052415+0000", 2024-04-18T21:05:24.550 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000122483 2024-04-18T21:05:24.550 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:24.551 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:24.551 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:24.551 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.551 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.551 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:24.551 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:05:24.551 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 29.508814998999998, 2024-04-18T21:05:24.551 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023864586, 2024-04-18T21:05:24.551 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:24.551 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:24.551 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:24.551 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:24.551 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:24.551 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:24.552 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 164 2024-04-18T21:05:24.552 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.552 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:24.552 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.552 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:24.552 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:05:24.552 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:24.552 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.552 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.552 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:24.552 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:05:24.552 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:24.552 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.552 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.552 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:24.552 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028795+0000", 2024-04-18T21:05:24.553 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7999999999999995e-07 2024-04-18T21:05:24.553 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.553 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.553 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:24.553 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028884+0000", 2024-04-18T21:05:24.553 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8997000000000002e-05 2024-04-18T21:05:24.553 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.553 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.553 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:24.553 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028895+0000", 2024-04-18T21:05:24.553 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1647e-05 2024-04-18T21:05:24.553 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.553 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.553 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:24.553 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028903+0000", 2024-04-18T21:05:24.554 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.909e-06 2024-04-18T21:05:24.554 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.554 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.554 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:24.554 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.047818+0000", 2024-04-18T21:05:24.554 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018914337 2024-04-18T21:05:24.554 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.554 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.554 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:24.554 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.048094+0000", 2024-04-18T21:05:24.554 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00027653500000000001 2024-04-18T21:05:24.554 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.554 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.554 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:24.554 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.048471+0000", 2024-04-18T21:05:24.555 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00037705799999999999 2024-04-18T21:05:24.555 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.555 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.555 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:24.555 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052516+0000", 2024-04-18T21:05:24.555 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0040452739999999997 2024-04-18T21:05:24.555 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.555 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.555 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:24.555 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052535+0000", 2024-04-18T21:05:24.555 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.84e-05 2024-04-18T21:05:24.555 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.555 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.556 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:24.556 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052603+0000", 2024-04-18T21:05:24.556 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.8095000000000004e-05 2024-04-18T21:05:24.556 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.556 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.556 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:24.556 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052659+0000", 2024-04-18T21:05:24.556 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5653999999999999e-05 2024-04-18T21:05:24.556 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:24.556 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:24.556 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:24.556 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.556 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.556 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:24.556 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:05:24.557 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 29.508691555999999, 2024-04-18T21:05:24.557 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024516458000000001, 2024-04-18T21:05:24.557 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:24.557 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:24.557 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:24.557 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:24.557 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:24.557 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:24.557 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 165 2024-04-18T21:05:24.557 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.557 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:24.557 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.557 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:24.558 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:05:24.558 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:24.558 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.558 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.558 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:24.558 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:05:24.558 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:24.558 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.558 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.558 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:24.558 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028918+0000", 2024-04-18T21:05:24.558 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8000000000000005e-07 2024-04-18T21:05:24.558 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.559 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.559 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:24.559 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028924+0000", 2024-04-18T21:05:24.559 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5659999999999997e-06 2024-04-18T21:05:24.559 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.559 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.559 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:24.559 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028933+0000", 2024-04-18T21:05:24.559 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.38e-06 2024-04-18T21:05:24.559 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.559 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.559 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:24.559 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028940+0000", 2024-04-18T21:05:24.559 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0060000000000003e-06 2024-04-18T21:05:24.559 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.560 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.560 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:24.560 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.050846+0000", 2024-04-18T21:05:24.560 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021906119000000002 2024-04-18T21:05:24.560 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.560 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.560 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:24.560 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051025+0000", 2024-04-18T21:05:24.560 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017850799999999999 2024-04-18T21:05:24.560 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.560 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.560 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:24.560 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051221+0000", 2024-04-18T21:05:24.561 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019608700000000001 2024-04-18T21:05:24.561 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.561 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.561 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:24.561 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052675+0000", 2024-04-18T21:05:24.561 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0014537899999999999 2024-04-18T21:05:24.561 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.561 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.561 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:24.561 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053311+0000", 2024-04-18T21:05:24.561 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00063613299999999999 2024-04-18T21:05:24.561 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.561 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.562 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:24.562 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053381+0000", 2024-04-18T21:05:24.562 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0074999999999996e-05 2024-04-18T21:05:24.562 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.562 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.562 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:24.562 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053434+0000", 2024-04-18T21:05:24.562 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3013999999999998e-05 2024-04-18T21:05:24.562 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:24.562 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:24.562 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:24.562 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.562 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.562 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:24.562 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:05:24.563 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 29.395386077000001, 2024-04-18T21:05:24.563 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023772793, 2024-04-18T21:05:24.563 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:24.563 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:24.563 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:24.563 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:24.563 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:24.563 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:24.563 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 187 2024-04-18T21:05:24.563 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.563 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:24.563 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.563 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:24.563 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:05:24.563 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:24.564 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.564 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.564 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:24.564 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:05:24.564 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:24.564 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.564 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.564 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:24.564 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142224+0000", 2024-04-18T21:05:24.564 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.47e-07 2024-04-18T21:05:24.564 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.564 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.564 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:24.564 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142233+0000", 2024-04-18T21:05:24.564 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0729999999999994e-06 2024-04-18T21:05:24.565 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.565 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.565 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:24.565 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142255+0000", 2024-04-18T21:05:24.565 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.2535999999999999e-05 2024-04-18T21:05:24.565 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.565 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.565 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:24.565 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142268+0000", 2024-04-18T21:05:24.565 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2686e-05 2024-04-18T21:05:24.565 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.565 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.565 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:24.565 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160497+0000", 2024-04-18T21:05:24.565 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018228779000000001 2024-04-18T21:05:24.565 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.566 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.566 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:24.566 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160634+0000", 2024-04-18T21:05:24.566 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000137315 2024-04-18T21:05:24.566 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.566 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.566 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:24.566 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160831+0000", 2024-04-18T21:05:24.566 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019683100000000001 2024-04-18T21:05:24.566 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.566 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.566 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:24.567 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165129+0000", 2024-04-18T21:05:24.567 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0042981299999999998 2024-04-18T21:05:24.567 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.567 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.567 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:24.567 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165776+0000", 2024-04-18T21:05:24.567 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00064702900000000003 2024-04-18T21:05:24.567 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.567 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.567 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:24.567 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165921+0000", 2024-04-18T21:05:24.567 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014506 2024-04-18T21:05:24.567 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.568 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.568 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:24.568 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165996+0000", 2024-04-18T21:05:24.568 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.4406999999999994e-05 2024-04-18T21:05:24.568 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:24.568 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:24.568 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:24.568 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.568 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.568 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:24.568 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:05:24.568 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 29.395325479, 2024-04-18T21:05:24.568 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026802157, 2024-04-18T21:05:24.568 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:24.569 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:24.569 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:24.569 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:24.569 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:24.569 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:24.569 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 188 2024-04-18T21:05:24.569 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.569 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:24.569 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.569 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:24.569 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:05:24.569 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:24.569 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.569 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.569 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:24.570 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:05:24.570 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:24.570 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.570 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.570 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:24.570 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142284+0000", 2024-04-18T21:05:24.570 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4e-07 2024-04-18T21:05:24.570 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.570 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.570 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:24.570 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142374+0000", 2024-04-18T21:05:24.570 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0099999999999995e-05 2024-04-18T21:05:24.570 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.571 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.571 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:24.571 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142386+0000", 2024-04-18T21:05:24.571 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1770000000000001e-05 2024-04-18T21:05:24.571 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.571 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.571 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:24.571 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142394+0000", 2024-04-18T21:05:24.571 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.2130000000000008e-06 2024-04-18T21:05:24.571 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.571 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.571 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:24.571 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.161743+0000", 2024-04-18T21:05:24.571 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019348644000000002 2024-04-18T21:05:24.572 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.572 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.572 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:24.572 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.161865+0000", 2024-04-18T21:05:24.572 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012210899999999999 2024-04-18T21:05:24.572 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.572 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.572 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:24.572 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.162055+0000", 2024-04-18T21:05:24.572 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000189994 2024-04-18T21:05:24.572 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.572 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.572 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:24.573 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165735+0000", 2024-04-18T21:05:24.573 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0036803270000000002 2024-04-18T21:05:24.573 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.573 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.573 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:24.573 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.168911+0000", 2024-04-18T21:05:24.573 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0031753689999999999 2024-04-18T21:05:24.573 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.573 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.573 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:24.573 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169012+0000", 2024-04-18T21:05:24.573 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010157699999999999 2024-04-18T21:05:24.573 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.573 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.573 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:24.573 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169086+0000", 2024-04-18T21:05:24.574 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3213999999999994e-05 2024-04-18T21:05:24.574 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:24.574 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:24.574 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:24.574 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.574 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.574 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:24.574 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:05:24.574 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 29.395200172999999, 2024-04-18T21:05:24.574 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026811423000000001, 2024-04-18T21:05:24.574 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:24.574 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:24.574 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:24.574 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:24.574 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:24.575 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:24.575 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 189 2024-04-18T21:05:24.575 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.575 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:24.575 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.575 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:24.575 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:05:24.575 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:24.575 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.575 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.575 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:24.575 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:05:24.575 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:24.575 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.576 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.576 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:24.576 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142410+0000", 2024-04-18T21:05:24.576 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:05:24.576 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.576 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.576 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:24.576 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142415+0000", 2024-04-18T21:05:24.576 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.7939999999999999e-06 2024-04-18T21:05:24.576 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.576 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.576 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:24.576 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142470+0000", 2024-04-18T21:05:24.576 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4537999999999999e-05 2024-04-18T21:05:24.577 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.577 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.577 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:24.577 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142481+0000", 2024-04-18T21:05:24.577 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0966e-05 2024-04-18T21:05:24.577 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.577 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.577 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:24.577 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.163493+0000", 2024-04-18T21:05:24.577 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021012444000000002 2024-04-18T21:05:24.577 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.577 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.577 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:24.577 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.163727+0000", 2024-04-18T21:05:24.577 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000233339 2024-04-18T21:05:24.578 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.578 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.578 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:24.578 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.164102+0000", 2024-04-18T21:05:24.578 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000374872 2024-04-18T21:05:24.578 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.578 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.578 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:24.578 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.166528+0000", 2024-04-18T21:05:24.578 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0024258729999999998 2024-04-18T21:05:24.578 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.578 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.578 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:24.579 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169101+0000", 2024-04-18T21:05:24.579 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0025737680000000001 2024-04-18T21:05:24.579 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.579 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.579 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:24.579 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169171+0000", 2024-04-18T21:05:24.579 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0148000000000007e-05 2024-04-18T21:05:24.579 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.579 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.579 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:24.579 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169220+0000", 2024-04-18T21:05:24.579 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8767999999999998e-05 2024-04-18T21:05:24.579 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:24.579 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:24.579 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:24.580 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.580 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.580 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:24.580 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:05:24.580 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 18.921627620999999, 2024-04-18T21:05:24.580 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024082777999999999, 2024-04-18T21:05:24.580 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:24.580 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:24.580 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:24.580 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:24.580 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.580 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:24.580 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:05:24.580 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:24.580 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.580 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.581 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:24.581 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:05:24.581 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:24.581 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.581 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.581 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:24.581 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615984+0000", 2024-04-18T21:05:24.581 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.9869999999999999e-06 2024-04-18T21:05:24.581 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.581 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.581 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:24.581 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615999+0000", 2024-04-18T21:05:24.581 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4646e-05 2024-04-18T21:05:24.581 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.581 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.581 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:24.582 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616028+0000", 2024-04-18T21:05:24.582 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8952999999999999e-05 2024-04-18T21:05:24.582 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.582 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.582 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:24.582 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616052+0000", 2024-04-18T21:05:24.582 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.3941999999999999e-05 2024-04-18T21:05:24.582 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.582 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.582 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:24.582 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618010+0000", 2024-04-18T21:05:24.582 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0019581780000000001 2024-04-18T21:05:24.582 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.583 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.583 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:24.583 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618322+0000", 2024-04-18T21:05:24.583 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00031158899999999997 2024-04-18T21:05:24.583 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.583 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.583 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:24.583 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618587+0000", 2024-04-18T21:05:24.583 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00026495700000000002 2024-04-18T21:05:24.583 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.583 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.583 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:24.583 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629262+0000", 2024-04-18T21:05:24.583 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010675877 2024-04-18T21:05:24.583 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.584 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.584 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:24.584 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.639773+0000", 2024-04-18T21:05:24.584 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0105109 2024-04-18T21:05:24.584 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.584 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.584 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:24.584 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.639926+0000", 2024-04-18T21:05:24.584 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000152349 2024-04-18T21:05:24.584 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.584 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.584 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:24.584 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640064+0000", 2024-04-18T21:05:24.584 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0001384 2024-04-18T21:05:24.585 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:24.585 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:24.585 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:24.585 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.585 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.585 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:24.585 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:05:24.585 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 18.921514946999999, 2024-04-18T21:05:24.585 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030215005999999999, 2024-04-18T21:05:24.585 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:24.585 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:24.585 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:24.585 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:24.586 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.586 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:24.586 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:05:24.586 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:24.586 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.586 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.586 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:24.586 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:05:24.586 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:24.586 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.586 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.586 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:24.587 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616095+0000", 2024-04-18T21:05:24.587 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.446e-06 2024-04-18T21:05:24.587 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.587 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.587 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:24.587 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616104+0000", 2024-04-18T21:05:24.587 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6200000000000005e-06 2024-04-18T21:05:24.587 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.587 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.587 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:24.587 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616132+0000", 2024-04-18T21:05:24.587 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7668999999999999e-05 2024-04-18T21:05:24.587 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.587 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.588 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:24.588 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616149+0000", 2024-04-18T21:05:24.588 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7047000000000001e-05 2024-04-18T21:05:24.588 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.588 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.588 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:24.588 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619287+0000", 2024-04-18T21:05:24.588 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0031381450000000002 2024-04-18T21:05:24.588 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.588 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.588 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:24.588 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619503+0000", 2024-04-18T21:05:24.588 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000216522 2024-04-18T21:05:24.588 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.589 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.589 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:24.589 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619930+0000", 2024-04-18T21:05:24.589 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00042604900000000001 2024-04-18T21:05:24.589 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.589 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.589 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:24.589 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629281+0000", 2024-04-18T21:05:24.589 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0093512230000000005 2024-04-18T21:05:24.589 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.589 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.589 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:24.589 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646022+0000", 2024-04-18T21:05:24.590 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016741156 2024-04-18T21:05:24.590 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.590 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.590 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:24.590 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646198+0000", 2024-04-18T21:05:24.590 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000176009 2024-04-18T21:05:24.590 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.590 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.590 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:24.591 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646309+0000", 2024-04-18T21:05:24.591 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011112000000000001 2024-04-18T21:05:24.591 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:24.591 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:24.591 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:24.591 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.591 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.591 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:24.591 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:05:24.591 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 18.921430123, 2024-04-18T21:05:24.591 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030501176000000001, 2024-04-18T21:05:24.591 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:24.591 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:24.592 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:24.592 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:24.592 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.592 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:24.592 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:05:24.592 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:24.592 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.592 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.592 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:24.592 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:05:24.592 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:24.592 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.592 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.592 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:24.593 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616180+0000", 2024-04-18T21:05:24.593 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1000000000000001e-06 2024-04-18T21:05:24.593 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.593 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.593 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:24.593 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616188+0000", 2024-04-18T21:05:24.593 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4069999999999993e-06 2024-04-18T21:05:24.593 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.593 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.593 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:24.593 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616207+0000", 2024-04-18T21:05:24.593 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8335999999999999e-05 2024-04-18T21:05:24.593 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.593 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.594 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:24.594 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616225+0000", 2024-04-18T21:05:24.594 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8652999999999999e-05 2024-04-18T21:05:24.594 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.594 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.594 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:24.594 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620977+0000", 2024-04-18T21:05:24.594 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047512220000000003 2024-04-18T21:05:24.594 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.594 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.594 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:24.594 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621279+0000", 2024-04-18T21:05:24.595 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000302646 2024-04-18T21:05:24.595 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.595 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.595 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:24.595 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621584+0000", 2024-04-18T21:05:24.595 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000305142 2024-04-18T21:05:24.595 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.595 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.595 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:24.595 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629352+0000", 2024-04-18T21:05:24.595 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0077673689999999997 2024-04-18T21:05:24.595 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.595 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.595 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:24.595 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646480+0000", 2024-04-18T21:05:24.596 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017128259 2024-04-18T21:05:24.596 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.596 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.596 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:24.596 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646591+0000", 2024-04-18T21:05:24.596 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011113899999999999 2024-04-18T21:05:24.596 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.596 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.596 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:24.596 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646680+0000", 2024-04-18T21:05:24.596 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8902999999999999e-05 2024-04-18T21:05:24.596 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:24.596 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:24.596 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:24.597 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.597 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.597 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:24.597 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:05:24.597 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 18.921363624000001, 2024-04-18T21:05:24.597 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030779760999999999, 2024-04-18T21:05:24.597 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:24.597 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:24.597 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:24.597 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:24.597 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.597 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:24.597 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:05:24.597 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:24.598 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.598 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.598 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:24.598 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:05:24.598 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:24.598 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.598 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.598 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:24.598 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616246+0000", 2024-04-18T21:05:24.598 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0499999999999999e-06 2024-04-18T21:05:24.598 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.598 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.598 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:24.598 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616253+0000", 2024-04-18T21:05:24.599 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.5989999999999998e-06 2024-04-18T21:05:24.599 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.599 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.599 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:24.599 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616273+0000", 2024-04-18T21:05:24.599 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9916999999999999e-05 2024-04-18T21:05:24.599 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.599 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.599 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:24.599 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616287+0000", 2024-04-18T21:05:24.599 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3669000000000001e-05 2024-04-18T21:05:24.599 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.599 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.599 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:24.600 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622203+0000", 2024-04-18T21:05:24.600 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.005916737 2024-04-18T21:05:24.600 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.600 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.600 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:24.600 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622379+0000", 2024-04-18T21:05:24.600 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000175596 2024-04-18T21:05:24.600 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.600 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.600 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:24.600 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622707+0000", 2024-04-18T21:05:24.600 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00032784600000000002 2024-04-18T21:05:24.600 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.600 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.600 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:24.601 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629366+0000", 2024-04-18T21:05:24.601 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0066593279999999999 2024-04-18T21:05:24.601 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.601 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.601 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:24.601 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646813+0000", 2024-04-18T21:05:24.601 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017447059000000001 2024-04-18T21:05:24.601 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.601 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.601 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:24.601 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646946+0000", 2024-04-18T21:05:24.601 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013301200000000001 2024-04-18T21:05:24.601 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.601 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.602 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:24.602 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647025+0000", 2024-04-18T21:05:24.602 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8948000000000004e-05 2024-04-18T21:05:24.602 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:24.602 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:24.602 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:24.602 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.602 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.602 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:24.602 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:05:24.602 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 18.921279806000001, 2024-04-18T21:05:24.602 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.031512165000000002, 2024-04-18T21:05:24.602 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:24.602 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:24.603 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:24.603 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:24.603 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.603 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:24.603 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:05:24.603 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:24.603 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.603 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.603 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:24.603 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:05:24.603 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:24.603 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.603 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.603 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:24.604 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616330+0000", 2024-04-18T21:05:24.604 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.15e-06 2024-04-18T21:05:24.604 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.604 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.604 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:24.604 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616337+0000", 2024-04-18T21:05:24.604 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.1289999999999998e-06 2024-04-18T21:05:24.604 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.604 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.604 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:24.604 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616447+0000", 2024-04-18T21:05:24.604 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109561 2024-04-18T21:05:24.604 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.604 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.605 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:24.605 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616496+0000", 2024-04-18T21:05:24.605 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8591999999999998e-05 2024-04-18T21:05:24.605 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.605 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.605 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:24.605 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.623786+0000", 2024-04-18T21:05:24.605 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0072906799999999999 2024-04-18T21:05:24.605 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.605 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.605 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:24.605 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.623973+0000", 2024-04-18T21:05:24.605 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018717199999999999 2024-04-18T21:05:24.605 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.606 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.606 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:24.606 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624260+0000", 2024-04-18T21:05:24.606 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00028630600000000001 2024-04-18T21:05:24.606 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.606 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.606 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:24.606 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629381+0000", 2024-04-18T21:05:24.606 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0051211340000000003 2024-04-18T21:05:24.606 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.606 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.606 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:24.606 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647631+0000", 2024-04-18T21:05:24.606 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018249771000000001 2024-04-18T21:05:24.607 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.607 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.607 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:24.607 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647761+0000", 2024-04-18T21:05:24.607 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013037300000000001 2024-04-18T21:05:24.607 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.607 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.607 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:24.607 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647841+0000", 2024-04-18T21:05:24.607 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.0296999999999994e-05 2024-04-18T21:05:24.607 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:24.607 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:24.607 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:24.607 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.607 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.608 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:24.608 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:05:24.608 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 18.921074321999999, 2024-04-18T21:05:24.608 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043251955000000002, 2024-04-18T21:05:24.608 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:24.608 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:24.608 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:24.608 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:24.608 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.608 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:24.608 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:05:24.608 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:24.608 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.609 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.609 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:24.609 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:05:24.609 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:24.609 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.609 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.609 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:24.609 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616536+0000", 2024-04-18T21:05:24.609 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2869999999999999e-06 2024-04-18T21:05:24.609 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.609 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.609 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:24.609 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616572+0000", 2024-04-18T21:05:24.610 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.6261999999999999e-05 2024-04-18T21:05:24.610 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.610 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.610 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:24.610 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616593+0000", 2024-04-18T21:05:24.610 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1310000000000001e-05 2024-04-18T21:05:24.610 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.610 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.610 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:24.610 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616614+0000", 2024-04-18T21:05:24.610 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.0936000000000001e-05 2024-04-18T21:05:24.610 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.610 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.611 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:24.611 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629501+0000", 2024-04-18T21:05:24.611 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.012886819000000001 2024-04-18T21:05:24.611 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.611 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.611 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:24.611 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629696+0000", 2024-04-18T21:05:24.611 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019485499999999999 2024-04-18T21:05:24.611 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.611 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.611 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:24.611 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629940+0000", 2024-04-18T21:05:24.611 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00024386399999999999 2024-04-18T21:05:24.611 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.611 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.612 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:24.612 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640100+0000", 2024-04-18T21:05:24.612 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010159645 2024-04-18T21:05:24.612 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.612 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.612 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:24.612 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659516+0000", 2024-04-18T21:05:24.612 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019416563000000001 2024-04-18T21:05:24.612 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.612 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.612 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:24.612 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659684+0000", 2024-04-18T21:05:24.612 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016750900000000001 2024-04-18T21:05:24.612 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.613 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.613 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:24.613 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659787+0000", 2024-04-18T21:05:24.613 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000102905 2024-04-18T21:05:24.613 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:24.613 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:24.613 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:24.613 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.613 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.613 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:24.613 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:05:24.613 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 18.920969200000002, 2024-04-18T21:05:24.613 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043581898000000001, 2024-04-18T21:05:24.613 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:24.614 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:24.614 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:24.614 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:24.614 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.614 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:24.614 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:05:24.614 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:24.614 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.614 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.614 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:24.614 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:05:24.614 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:24.614 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.614 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.615 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:24.615 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616641+0000", 2024-04-18T21:05:24.615 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:05:24.615 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.615 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.615 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:24.615 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616648+0000", 2024-04-18T21:05:24.615 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3860000000000001e-06 2024-04-18T21:05:24.615 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.615 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.615 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:24.615 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616666+0000", 2024-04-18T21:05:24.615 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7583000000000001e-05 2024-04-18T21:05:24.615 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.615 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.616 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:24.616 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616679+0000", 2024-04-18T21:05:24.616 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3322999999999999e-05 2024-04-18T21:05:24.616 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.616 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.616 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:24.616 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630373+0000", 2024-04-18T21:05:24.616 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013694207999999999 2024-04-18T21:05:24.616 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.616 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.616 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:24.616 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630545+0000", 2024-04-18T21:05:24.616 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000171683 2024-04-18T21:05:24.616 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.617 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.617 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:24.617 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630728+0000", 2024-04-18T21:05:24.617 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000182599 2024-04-18T21:05:24.617 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.617 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.617 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:24.617 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640600+0000", 2024-04-18T21:05:24.617 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0098726119999999994 2024-04-18T21:05:24.617 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.617 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.617 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:24.617 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659927+0000", 2024-04-18T21:05:24.617 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019326724999999999 2024-04-18T21:05:24.617 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.618 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.618 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:24.618 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660112+0000", 2024-04-18T21:05:24.618 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000185203 2024-04-18T21:05:24.618 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.618 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.618 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:24.618 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660222+0000", 2024-04-18T21:05:24.618 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109343 2024-04-18T21:05:24.618 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:24.618 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:24.618 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:24.618 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.619 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.619 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:24.619 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:05:24.619 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 18.920103842, 2024-04-18T21:05:24.619 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043121310000000003, 2024-04-18T21:05:24.619 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:24.619 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:24.619 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:24.619 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:24.619 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.619 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:24.619 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:05:24.619 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:24.619 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.620 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.620 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:24.620 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:05:24.620 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:24.620 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.620 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.620 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:24.620 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617506+0000", 2024-04-18T21:05:24.620 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9999999999999995e-07 2024-04-18T21:05:24.620 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.620 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.620 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:24.620 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617513+0000", 2024-04-18T21:05:24.620 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.9700000000000002e-06 2024-04-18T21:05:24.620 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.621 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.621 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:24.621 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617531+0000", 2024-04-18T21:05:24.621 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8105999999999999e-05 2024-04-18T21:05:24.621 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.621 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.621 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:24.621 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617545+0000", 2024-04-18T21:05:24.621 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3703000000000001e-05 2024-04-18T21:05:24.621 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.621 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.621 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:24.621 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632129+0000", 2024-04-18T21:05:24.621 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.014584135999999999 2024-04-18T21:05:24.622 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.622 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.622 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:24.622 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632361+0000", 2024-04-18T21:05:24.622 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023171800000000001 2024-04-18T21:05:24.622 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.622 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.622 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:24.622 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632804+0000", 2024-04-18T21:05:24.622 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000443549 2024-04-18T21:05:24.622 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.622 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.622 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:24.622 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646340+0000", 2024-04-18T21:05:24.622 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013535902000000001 2024-04-18T21:05:24.623 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.623 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.623 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:24.623 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660363+0000", 2024-04-18T21:05:24.623 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01402318 2024-04-18T21:05:24.623 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.623 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.623 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:24.623 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660523+0000", 2024-04-18T21:05:24.623 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00015989899999999999 2024-04-18T21:05:24.623 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.623 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.623 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:24.624 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660626+0000", 2024-04-18T21:05:24.624 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010314699999999999 2024-04-18T21:05:24.624 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:24.624 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:24.624 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:24.624 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.624 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.624 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:24.624 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:05:24.624 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 18.919964148999998, 2024-04-18T21:05:24.624 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024927483, 2024-04-18T21:05:24.624 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:24.624 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:24.624 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:24.625 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:24.625 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.625 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:24.625 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:05:24.625 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:24.625 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.625 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.625 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:24.625 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:05:24.625 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:24.625 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.625 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.625 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:24.625 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617646+0000", 2024-04-18T21:05:24.625 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3030000000000001e-06 2024-04-18T21:05:24.626 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.626 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.626 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:24.626 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617653+0000", 2024-04-18T21:05:24.626 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7530000000000004e-06 2024-04-18T21:05:24.626 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.626 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.626 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:24.626 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617673+0000", 2024-04-18T21:05:24.626 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9967e-05 2024-04-18T21:05:24.626 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.626 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.626 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:24.627 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617688+0000", 2024-04-18T21:05:24.627 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5153e-05 2024-04-18T21:05:24.627 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.627 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.627 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:24.627 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619244+0000", 2024-04-18T21:05:24.627 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001555531 2024-04-18T21:05:24.627 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.627 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.627 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:24.627 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619361+0000", 2024-04-18T21:05:24.627 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011784400000000001 2024-04-18T21:05:24.627 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.627 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.628 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:24.628 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619604+0000", 2024-04-18T21:05:24.628 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000243007 2024-04-18T21:05:24.628 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.628 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.628 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:24.628 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.625480+0000", 2024-04-18T21:05:24.628 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0058759349999999997 2024-04-18T21:05:24.628 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.628 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.628 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:24.628 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642342+0000", 2024-04-18T21:05:24.628 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016861373999999998 2024-04-18T21:05:24.629 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.629 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.629 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:24.629 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642484+0000", 2024-04-18T21:05:24.629 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000142423 2024-04-18T21:05:24.629 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.629 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.629 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:24.629 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642572+0000", 2024-04-18T21:05:24.629 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8193000000000001e-05 2024-04-18T21:05:24.629 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:24.629 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:24.629 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:24.629 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.629 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.630 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:24.630 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:05:24.630 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 18.919682645999998, 2024-04-18T21:05:24.630 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024956974999999999, 2024-04-18T21:05:24.630 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:24.630 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:24.630 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:24.630 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:24.630 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.630 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:24.630 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:05:24.630 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:24.630 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.631 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.631 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:24.631 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:05:24.631 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:24.631 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.631 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.631 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:24.631 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617928+0000", 2024-04-18T21:05:24.631 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5430000000000001e-06 2024-04-18T21:05:24.631 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.631 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.631 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:24.631 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617937+0000", 2024-04-18T21:05:24.631 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6629999999999999e-06 2024-04-18T21:05:24.632 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.632 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.632 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:24.632 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617955+0000", 2024-04-18T21:05:24.632 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8749999999999998e-05 2024-04-18T21:05:24.632 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.632 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.632 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:24.632 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617971+0000", 2024-04-18T21:05:24.632 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.605e-05 2024-04-18T21:05:24.632 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.632 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.632 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:24.633 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621019+0000", 2024-04-18T21:05:24.633 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0030472369999999999 2024-04-18T21:05:24.633 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.633 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.633 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:24.633 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621249+0000", 2024-04-18T21:05:24.633 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000230075 2024-04-18T21:05:24.633 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.633 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.633 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:24.633 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621450+0000", 2024-04-18T21:05:24.633 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020166499999999999 2024-04-18T21:05:24.633 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.633 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.634 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:24.634 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.626233+0000", 2024-04-18T21:05:24.634 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047827390000000003 2024-04-18T21:05:24.634 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.634 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.634 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:24.634 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642693+0000", 2024-04-18T21:05:24.634 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01645961 2024-04-18T21:05:24.634 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.634 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.634 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:24.634 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642798+0000", 2024-04-18T21:05:24.634 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010559499999999999 2024-04-18T21:05:24.635 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.635 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.635 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:24.635 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642883+0000", 2024-04-18T21:05:24.635 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5048000000000003e-05 2024-04-18T21:05:24.635 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:24.635 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:24.635 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:24.635 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.635 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.635 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:24.635 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:05:24.635 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 18.917987018000002, 2024-04-18T21:05:24.636 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024086478000000001, 2024-04-18T21:05:24.636 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:24.636 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:24.636 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:24.636 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:24.636 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.636 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:24.636 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:05:24.636 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:24.636 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.636 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.636 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:24.636 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:05:24.636 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:24.637 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.637 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.637 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:24.637 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619624+0000", 2024-04-18T21:05:24.637 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.75e-06 2024-04-18T21:05:24.637 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.637 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.637 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:24.637 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619637+0000", 2024-04-18T21:05:24.637 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3540000000000001e-05 2024-04-18T21:05:24.637 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.637 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.637 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:24.637 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619666+0000", 2024-04-18T21:05:24.638 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8685999999999999e-05 2024-04-18T21:05:24.638 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.638 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.638 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:24.638 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619685+0000", 2024-04-18T21:05:24.638 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8681999999999998e-05 2024-04-18T21:05:24.638 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.638 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.638 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:24.638 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622275+0000", 2024-04-18T21:05:24.638 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0025899260000000002 2024-04-18T21:05:24.638 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.638 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.638 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:24.639 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622572+0000", 2024-04-18T21:05:24.639 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00029722 2024-04-18T21:05:24.639 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.639 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.639 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:24.639 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622752+0000", 2024-04-18T21:05:24.639 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018065900000000001 2024-04-18T21:05:24.639 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.639 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.639 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:24.639 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.626326+0000", 2024-04-18T21:05:24.639 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035737310000000001 2024-04-18T21:05:24.639 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.639 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.640 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:24.640 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643565+0000", 2024-04-18T21:05:24.640 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017238430999999999 2024-04-18T21:05:24.640 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.640 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.640 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:24.640 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643646+0000", 2024-04-18T21:05:24.640 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.1481000000000001e-05 2024-04-18T21:05:24.640 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.640 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.640 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:24.640 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643708+0000", 2024-04-18T21:05:24.640 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.2372000000000005e-05 2024-04-18T21:05:24.640 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:24.640 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:24.640 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:24.641 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.641 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.641 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:24.641 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:05:24.641 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 18.917820864999999, 2024-04-18T21:05:24.641 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026822450000000001, 2024-04-18T21:05:24.641 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:24.641 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:24.641 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:24.641 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:24.641 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.641 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:24.641 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:05:24.641 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:24.641 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.642 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.642 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:24.642 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:05:24.642 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:24.642 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.642 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.642 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:24.642 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619789+0000", 2024-04-18T21:05:24.642 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:05:24.642 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.642 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.642 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:24.643 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619797+0000", 2024-04-18T21:05:24.643 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.6899999999999992e-06 2024-04-18T21:05:24.643 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.643 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.643 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:24.643 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619816+0000", 2024-04-18T21:05:24.643 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9352999999999999e-05 2024-04-18T21:05:24.643 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.643 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.643 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:24.643 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619832+0000", 2024-04-18T21:05:24.643 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6013000000000001e-05 2024-04-18T21:05:24.643 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.643 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.643 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:24.644 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620528+0000", 2024-04-18T21:05:24.644 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00069565600000000001 2024-04-18T21:05:24.644 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.644 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.644 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:24.644 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620735+0000", 2024-04-18T21:05:24.644 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000207025 2024-04-18T21:05:24.644 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.644 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.644 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:24.644 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620912+0000", 2024-04-18T21:05:24.644 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017748199999999999 2024-04-18T21:05:24.644 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.644 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.644 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:24.645 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.625605+0000", 2024-04-18T21:05:24.645 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0046924439999999996 2024-04-18T21:05:24.645 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.645 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.645 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:24.645 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646349+0000", 2024-04-18T21:05:24.645 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.020744318000000001 2024-04-18T21:05:24.645 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.645 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.645 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:24.645 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646483+0000", 2024-04-18T21:05:24.645 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013428999999999999 2024-04-18T21:05:24.645 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.646 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.646 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:24.646 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646611+0000", 2024-04-18T21:05:24.646 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012710299999999999 2024-04-18T21:05:24.646 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:24.646 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:24.646 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:24.646 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.646 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.646 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:24.646 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:05:24.646 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 18.917150432, 2024-04-18T21:05:24.646 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023516516000000001, 2024-04-18T21:05:24.646 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:24.647 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:24.647 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:05:24.647 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:24.647 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.647 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:24.647 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:05:24.647 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:24.647 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.647 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.647 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:24.647 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:05:24.647 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:24.647 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.647 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.647 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:24.648 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620460+0000", 2024-04-18T21:05:24.648 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.787e-06 2024-04-18T21:05:24.648 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.648 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.648 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:24.648 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620470+0000", 2024-04-18T21:05:24.648 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.2560000000000008e-06 2024-04-18T21:05:24.648 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.648 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.648 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:24.648 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620496+0000", 2024-04-18T21:05:24.648 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.6205999999999999e-05 2024-04-18T21:05:24.648 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.648 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.649 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:24.649 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620517+0000", 2024-04-18T21:05:24.649 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1223e-05 2024-04-18T21:05:24.649 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.649 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.649 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:24.649 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624060+0000", 2024-04-18T21:05:24.649 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035434160000000002 2024-04-18T21:05:24.649 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.649 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.649 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:24.649 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624390+0000", 2024-04-18T21:05:24.649 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00033000500000000002 2024-04-18T21:05:24.649 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:24.650 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:24.650 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:24.650 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643975+0000", 2024-04-18T21:05:24.650 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019584622999999999 2024-04-18T21:05:24.650 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:24.650 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:24.650 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:24.650 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:24.650 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:24.650 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:05:24.652 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:05:24.653 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:24.651+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:24.665 INFO:teuthology.run_tasks:Running task workunit... 2024-04-18T21:05:24.677 INFO:tasks.workunit:Pulling workunits from ref c46a99d99fa3e2dad10a5ce96141fec909e651df 2024-04-18T21:05:24.678 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-18T21:05:24.678 INFO:tasks.workunit:timeout=3h 2024-04-18T21:05:24.678 INFO:tasks.workunit:cleanup=True 2024-04-18T21:05:24.678 DEBUG:teuthology.orchestra.run.smithi078:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-18T21:05:24.713 INFO:teuthology.orchestra.run.smithi078.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-18T21:05:24.713 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-18T21:05:24.713 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 2dh/45d Inode: 1 Links: 2 2024-04-18T21:05:24.713 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T21:05:24.714 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-18T21:05:24.714 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-04-18 21:05:05.610394151 +0000 2024-04-18T21:05:24.714 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-04-18 21:05:24.667667051 +0000 2024-04-18T21:05:24.714 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: - 2024-04-18T21:05:24.714 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-18T21:05:24.714 DEBUG:teuthology.orchestra.run.smithi078:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-18T21:05:24.753 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:24.755+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:24.766 INFO:teuthology.orchestra.run.smithi078.stderr:nodeep-scrub is set 2024-04-18T21:05:24.778 DEBUG:teuthology.orchestra.run.smithi078:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout c46a99d99fa3e2dad10a5ce96141fec909e651df 2024-04-18T21:05:24.787 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:05:24.787 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [], 2024-04-18T21:05:24.787 INFO:teuthology.orchestra.run.smithi150.stdout: "num_ops": 0 2024-04-18T21:05:24.788 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:05:24.801 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:05:24.836 INFO:tasks.workunit.client.0.smithi078.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-18T21:05:24.853 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:24.855+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:24.920 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:05:24.920 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [], 2024-04-18T21:05:24.920 INFO:teuthology.orchestra.run.smithi150.stdout: "complaint_time": 30, 2024-04-18T21:05:24.920 INFO:teuthology.orchestra.run.smithi150.stdout: "num_blocked_ops": 0 2024-04-18T21:05:24.920 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:05:24.934 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:05:24.977 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:24.979+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:25.055 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:05:25.055 INFO:teuthology.orchestra.run.smithi150.stdout: "size": 20, 2024-04-18T21:05:25.056 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 600, 2024-04-18T21:05:25.056 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [ 2024-04-18T21:05:25.056 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.056 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-18T21:05:25.056 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:05:25.056 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 30.250186280000001, 2024-04-18T21:05:25.056 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0093051590000000003, 2024-04-18T21:05:25.056 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:25.056 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:25.056 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:25.056 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:25.056 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.057 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:25.057 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:05:25.057 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:25.057 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.057 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.057 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:25.057 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:05:25.057 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:25.057 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.057 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.057 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:25.057 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804851+0000", 2024-04-18T21:05:25.057 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7039999999999999e-06 2024-04-18T21:05:25.057 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.057 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.058 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:25.058 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804864+0000", 2024-04-18T21:05:25.058 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.276e-05 2024-04-18T21:05:25.058 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.058 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.058 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:25.058 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804895+0000", 2024-04-18T21:05:25.058 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.1204999999999997e-05 2024-04-18T21:05:25.058 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.058 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.058 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:25.058 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804908+0000", 2024-04-18T21:05:25.058 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3317e-05 2024-04-18T21:05:25.058 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.059 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.059 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:25.059 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805131+0000", 2024-04-18T21:05:25.059 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00022246700000000001 2024-04-18T21:05:25.059 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.059 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.059 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:25.059 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805171+0000", 2024-04-18T21:05:25.059 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.0164999999999999e-05 2024-04-18T21:05:25.059 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.059 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.059 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:25.059 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814086+0000", 2024-04-18T21:05:25.059 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0089155329999999998 2024-04-18T21:05:25.059 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.060 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.060 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:25.060 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814154+0000", 2024-04-18T21:05:25.060 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.8008000000000003e-05 2024-04-18T21:05:25.060 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:25.060 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:25.060 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:25.060 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.060 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.060 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-18T21:05:25.060 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:05:25.060 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 30.249421087000002, 2024-04-18T21:05:25.061 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0086469770000000001, 2024-04-18T21:05:25.061 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:25.061 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:25.061 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:25.061 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:25.061 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.061 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:25.061 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:05:25.061 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:25.061 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.061 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.061 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:25.061 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:05:25.061 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:25.061 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.061 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.062 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:25.062 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805616+0000", 2024-04-18T21:05:25.062 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7799999999999999e-06 2024-04-18T21:05:25.062 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.062 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.062 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:25.062 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805707+0000", 2024-04-18T21:05:25.062 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0917999999999999e-05 2024-04-18T21:05:25.062 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.062 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.062 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:25.062 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805739+0000", 2024-04-18T21:05:25.063 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.2512000000000003e-05 2024-04-18T21:05:25.063 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.063 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.063 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:25.063 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805763+0000", 2024-04-18T21:05:25.063 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3266000000000001e-05 2024-04-18T21:05:25.063 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.063 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.063 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:25.063 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.806024+0000", 2024-04-18T21:05:25.063 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000261716 2024-04-18T21:05:25.063 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.064 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.064 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:25.064 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.806073+0000", 2024-04-18T21:05:25.064 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.8844999999999997e-05 2024-04-18T21:05:25.064 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.064 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.064 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:25.064 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814162+0000", 2024-04-18T21:05:25.064 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0080882860000000001 2024-04-18T21:05:25.064 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.064 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.064 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:25.065 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814261+0000", 2024-04-18T21:05:25.065 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.9654000000000005e-05 2024-04-18T21:05:25.065 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:25.065 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:25.065 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:25.065 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.065 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.065 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'64)", 2024-04-18T21:05:25.065 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:05:25.065 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 30.247650043, 2024-04-18T21:05:25.065 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0089721509999999994, 2024-04-18T21:05:25.065 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:25.065 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:25.065 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:25.066 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:25.066 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.066 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:25.066 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:05:25.066 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:25.066 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.066 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.066 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:25.066 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:05:25.066 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:25.066 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.066 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.066 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:25.066 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807387+0000", 2024-04-18T21:05:25.067 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.0329999999999998e-06 2024-04-18T21:05:25.067 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.067 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.067 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:25.067 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807443+0000", 2024-04-18T21:05:25.067 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.5376e-05 2024-04-18T21:05:25.067 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.067 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.067 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:25.067 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807467+0000", 2024-04-18T21:05:25.067 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.4621999999999999e-05 2024-04-18T21:05:25.067 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.067 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.067 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:25.068 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807482+0000", 2024-04-18T21:05:25.068 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.436e-05 2024-04-18T21:05:25.068 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.068 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.068 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:25.068 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.809243+0000", 2024-04-18T21:05:25.068 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001761725 2024-04-18T21:05:25.068 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.068 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.068 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:25.068 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.809295+0000", 2024-04-18T21:05:25.068 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.1445e-05 2024-04-18T21:05:25.068 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.069 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.069 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:25.069 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.816293+0000", 2024-04-18T21:05:25.069 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0069981749999999997 2024-04-18T21:05:25.069 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.069 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.069 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:25.069 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.816357+0000", 2024-04-18T21:05:25.069 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.4414999999999999e-05 2024-04-18T21:05:25.069 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:25.069 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:25.069 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:25.069 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.069 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.069 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:25.070 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:05:25.070 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 19.439740672999999, 2024-04-18T21:05:25.070 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.040843365, 2024-04-18T21:05:25.070 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:25.070 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:25.070 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:25.070 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:25.070 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.070 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:25.070 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:05:25.070 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:25.070 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.070 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.070 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:25.071 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:05:25.071 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:25.071 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.071 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.071 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:25.071 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615297+0000", 2024-04-18T21:05:25.071 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2800000000000002e-06 2024-04-18T21:05:25.071 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.071 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.071 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:25.071 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615308+0000", 2024-04-18T21:05:25.071 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0813e-05 2024-04-18T21:05:25.072 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.072 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.072 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:25.072 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615330+0000", 2024-04-18T21:05:25.072 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2370000000000001e-05 2024-04-18T21:05:25.072 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.072 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.072 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:25.072 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615346+0000", 2024-04-18T21:05:25.072 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6200000000000001e-05 2024-04-18T21:05:25.072 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.072 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.073 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:25.073 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615470+0000", 2024-04-18T21:05:25.073 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012385799999999999 2024-04-18T21:05:25.073 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.073 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.073 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:05:25.073 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615488+0000", 2024-04-18T21:05:25.073 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7923000000000001e-05 2024-04-18T21:05:25.073 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.073 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.073 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:25.073 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.630993+0000", 2024-04-18T21:05:25.073 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.01550532 2024-04-18T21:05:25.073 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.074 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.074 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:25.074 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631165+0000", 2024-04-18T21:05:25.074 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000171588 2024-04-18T21:05:25.074 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.074 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.074 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:25.074 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631320+0000", 2024-04-18T21:05:25.074 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000155162 2024-04-18T21:05:25.074 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.074 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.074 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:25.074 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635157+0000", 2024-04-18T21:05:25.074 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0038370790000000002 2024-04-18T21:05:25.074 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.075 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.075 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:25.075 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.655904+0000", 2024-04-18T21:05:25.075 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.020746483999999999 2024-04-18T21:05:25.075 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.075 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.075 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:25.075 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656032+0000", 2024-04-18T21:05:25.075 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012864199999999999 2024-04-18T21:05:25.075 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.075 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.075 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:25.075 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656138+0000", 2024-04-18T21:05:25.075 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000105646 2024-04-18T21:05:25.075 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:25.075 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:25.076 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:25.076 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.076 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.076 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:25.076 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:05:25.076 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 19.439648501000001, 2024-04-18T21:05:25.076 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.041266444999999999, 2024-04-18T21:05:25.076 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:25.076 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:25.076 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:25.076 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:25.076 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.076 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:25.076 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:05:25.077 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:25.077 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.077 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.077 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:25.077 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:05:25.077 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:25.077 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.077 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.077 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:25.077 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615388+0000", 2024-04-18T21:05:25.077 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:05:25.077 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.077 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.077 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:25.077 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:05:25.078 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.7299999999999994e-06 2024-04-18T21:05:25.078 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.078 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.078 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:25.078 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615415+0000", 2024-04-18T21:05:25.078 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7807000000000001e-05 2024-04-18T21:05:25.078 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.078 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.078 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:25.078 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615431+0000", 2024-04-18T21:05:25.078 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6127e-05 2024-04-18T21:05:25.078 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.078 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.078 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:25.079 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615621+0000", 2024-04-18T21:05:25.079 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000189781 2024-04-18T21:05:25.079 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.079 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.079 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:25.079 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615634+0000", 2024-04-18T21:05:25.079 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3383e-05 2024-04-18T21:05:25.079 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.079 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.079 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:25.079 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631703+0000", 2024-04-18T21:05:25.079 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016068737 2024-04-18T21:05:25.079 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.079 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.079 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:25.079 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631809+0000", 2024-04-18T21:05:25.080 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000106823 2024-04-18T21:05:25.080 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.080 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.080 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:25.080 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631988+0000", 2024-04-18T21:05:25.080 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000179008 2024-04-18T21:05:25.080 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.080 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.080 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:25.080 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635172+0000", 2024-04-18T21:05:25.080 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.003183029 2024-04-18T21:05:25.080 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.080 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.080 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:25.080 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656392+0000", 2024-04-18T21:05:25.080 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.021220638999999999 2024-04-18T21:05:25.081 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.081 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.081 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:25.081 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656533+0000", 2024-04-18T21:05:25.081 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014126500000000001 2024-04-18T21:05:25.081 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.081 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.081 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:25.081 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656653+0000", 2024-04-18T21:05:25.081 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000119883 2024-04-18T21:05:25.081 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:25.081 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:25.081 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:25.081 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.082 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.082 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:25.082 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:05:25.082 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 19.439561078000001, 2024-04-18T21:05:25.082 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.042492302000000003, 2024-04-18T21:05:25.082 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:25.082 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:25.082 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:25.082 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:25.082 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.082 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:25.082 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:05:25.082 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:25.082 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.083 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.083 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:25.083 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:05:25.083 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:25.083 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.083 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.083 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:25.083 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615475+0000", 2024-04-18T21:05:25.083 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.17e-06 2024-04-18T21:05:25.083 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.083 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.083 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:25.083 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615528+0000", 2024-04-18T21:05:25.084 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.2159e-05 2024-04-18T21:05:25.084 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.084 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.084 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:25.084 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615542+0000", 2024-04-18T21:05:25.084 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4197e-05 2024-04-18T21:05:25.084 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.084 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.084 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:25.084 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615559+0000", 2024-04-18T21:05:25.084 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.749e-05 2024-04-18T21:05:25.084 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.084 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.085 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:25.085 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615685+0000", 2024-04-18T21:05:25.085 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012617499999999999 2024-04-18T21:05:25.085 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.085 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.085 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:05:25.085 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:05:25.085 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4749999999999999e-05 2024-04-18T21:05:25.085 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.085 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.085 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:25.085 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632332+0000", 2024-04-18T21:05:25.085 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016631988 2024-04-18T21:05:25.086 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.086 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.086 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:25.086 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632477+0000", 2024-04-18T21:05:25.086 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014437200000000001 2024-04-18T21:05:25.086 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.086 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.086 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:25.086 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632620+0000", 2024-04-18T21:05:25.086 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000143566 2024-04-18T21:05:25.086 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.086 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.086 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:25.087 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635185+0000", 2024-04-18T21:05:25.087 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0025644209999999999 2024-04-18T21:05:25.087 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.087 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.087 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:25.087 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657803+0000", 2024-04-18T21:05:25.087 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.022618743 2024-04-18T21:05:25.087 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.087 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.087 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:25.087 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657890+0000", 2024-04-18T21:05:25.087 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.6688999999999996e-05 2024-04-18T21:05:25.087 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.087 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.087 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:25.088 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657967+0000", 2024-04-18T21:05:25.088 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.6582000000000006e-05 2024-04-18T21:05:25.088 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:25.088 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:25.088 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:25.088 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.088 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.088 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:25.088 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:05:25.088 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 19.439430265999999, 2024-04-18T21:05:25.088 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.043603435000000003, 2024-04-18T21:05:25.088 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:25.089 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:25.089 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:25.089 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:25.089 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.089 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:25.089 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:05:25.089 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:25.089 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.089 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.089 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:25.089 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:05:25.089 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:25.089 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.089 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.090 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:25.090 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615607+0000", 2024-04-18T21:05:25.090 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4300000000000001e-06 2024-04-18T21:05:25.090 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.090 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.090 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:25.090 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615614+0000", 2024-04-18T21:05:25.090 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.4100000000000002e-06 2024-04-18T21:05:25.090 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.090 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.090 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:25.090 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615632+0000", 2024-04-18T21:05:25.090 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7863000000000002e-05 2024-04-18T21:05:25.090 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.091 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.091 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:25.091 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615647+0000", 2024-04-18T21:05:25.091 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5187e-05 2024-04-18T21:05:25.091 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.091 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.091 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:25.091 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615765+0000", 2024-04-18T21:05:25.091 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000117955 2024-04-18T21:05:25.091 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.091 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.091 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:25.091 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615781+0000", 2024-04-18T21:05:25.092 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6123000000000001e-05 2024-04-18T21:05:25.092 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.092 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.092 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:25.092 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633055+0000", 2024-04-18T21:05:25.092 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.017273909 2024-04-18T21:05:25.092 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.092 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.092 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:25.092 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633254+0000", 2024-04-18T21:05:25.092 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00019903799999999999 2024-04-18T21:05:25.092 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.092 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.093 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:25.093 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633624+0000", 2024-04-18T21:05:25.093 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000369656 2024-04-18T21:05:25.093 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.093 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.093 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:25.093 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635595+0000", 2024-04-18T21:05:25.093 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001971287 2024-04-18T21:05:25.093 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.093 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.093 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:25.093 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659026+0000", 2024-04-18T21:05:25.093 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.023431495 2024-04-18T21:05:25.093 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.093 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.094 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:25.094 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659117+0000", 2024-04-18T21:05:25.094 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0885999999999997e-05 2024-04-18T21:05:25.094 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.094 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.094 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:25.094 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659209+0000", 2024-04-18T21:05:25.094 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.1195999999999999e-05 2024-04-18T21:05:25.094 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:25.094 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:25.094 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:25.094 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.094 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.094 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:25.095 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:25.095 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 19.439365037000002, 2024-04-18T21:05:25.095 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.03492514, 2024-04-18T21:05:25.095 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:25.095 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:25.095 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:25.095 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:25.095 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.095 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:25.095 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:25.095 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:25.095 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.095 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.095 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:25.096 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:25.096 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:25.096 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.096 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.096 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:25.096 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:05:25.096 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.407e-06 2024-04-18T21:05:25.096 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.096 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.096 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:25.096 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615679+0000", 2024-04-18T21:05:25.096 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.2130000000000002e-06 2024-04-18T21:05:25.096 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.096 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.097 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:25.097 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615701+0000", 2024-04-18T21:05:25.097 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2316000000000001e-05 2024-04-18T21:05:25.097 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.097 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.097 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:25.097 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615717+0000", 2024-04-18T21:05:25.097 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6197000000000001e-05 2024-04-18T21:05:25.097 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.097 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.097 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:25.097 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615828+0000", 2024-04-18T21:05:25.097 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000110899 2024-04-18T21:05:25.097 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.098 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.098 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:05:25.098 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615840+0000", 2024-04-18T21:05:25.098 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.1423000000000001e-05 2024-04-18T21:05:25.098 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.098 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.098 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:25.098 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628046+0000", 2024-04-18T21:05:25.098 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.012206295000000001 2024-04-18T21:05:25.098 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.098 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.098 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:25.098 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628323+0000", 2024-04-18T21:05:25.099 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00027658700000000001 2024-04-18T21:05:25.099 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.099 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.099 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:25.099 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628599+0000", 2024-04-18T21:05:25.099 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00027676699999999997 2024-04-18T21:05:25.099 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.099 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.099 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:25.099 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634869+0000", 2024-04-18T21:05:25.099 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.006269536 2024-04-18T21:05:25.099 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.099 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.099 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:25.100 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650333+0000", 2024-04-18T21:05:25.100 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.015463645999999999 2024-04-18T21:05:25.100 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.100 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.100 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:25.100 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650474+0000", 2024-04-18T21:05:25.100 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014091799999999999 2024-04-18T21:05:25.100 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.100 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.100 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:25.100 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650595+0000", 2024-04-18T21:05:25.100 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012193600000000001 2024-04-18T21:05:25.100 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:25.101 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:25.101 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:25.101 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.101 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.101 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:25.101 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:05:25.101 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 19.439279928000001, 2024-04-18T21:05:25.101 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.040588320999999997, 2024-04-18T21:05:25.101 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:25.101 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:25.101 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:25.102 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:25.102 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.102 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:25.102 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:05:25.102 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:25.102 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.102 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.102 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:25.102 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:05:25.102 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:25.102 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.102 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.102 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:25.103 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615757+0000", 2024-04-18T21:05:25.103 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2270000000000001e-06 2024-04-18T21:05:25.103 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.103 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.103 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:25.103 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615765+0000", 2024-04-18T21:05:25.103 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.9400000000000002e-06 2024-04-18T21:05:25.103 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.103 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.103 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:25.103 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615785+0000", 2024-04-18T21:05:25.103 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.0749000000000001e-05 2024-04-18T21:05:25.103 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.104 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.104 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:25.104 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615804+0000", 2024-04-18T21:05:25.104 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.8774e-05 2024-04-18T21:05:25.104 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.104 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.104 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:25.104 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615888+0000", 2024-04-18T21:05:25.104 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.4111999999999997e-05 2024-04-18T21:05:25.104 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.104 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.104 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:25.104 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615895+0000", 2024-04-18T21:05:25.104 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.0469999999999996e-06 2024-04-18T21:05:25.105 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.105 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.105 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:25.105 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629280+0000", 2024-04-18T21:05:25.105 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.013384416 2024-04-18T21:05:25.105 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.105 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.105 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:25.105 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629488+0000", 2024-04-18T21:05:25.105 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00020852800000000001 2024-04-18T21:05:25.105 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.105 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.106 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:25.106 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629869+0000", 2024-04-18T21:05:25.106 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00038042300000000001 2024-04-18T21:05:25.106 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.106 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.106 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:25.106 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635041+0000", 2024-04-18T21:05:25.106 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.005172383 2024-04-18T21:05:25.106 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.106 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.106 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:25.106 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656125+0000", 2024-04-18T21:05:25.106 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.021084025999999999 2024-04-18T21:05:25.107 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.107 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.107 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:25.107 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656240+0000", 2024-04-18T21:05:25.107 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000115352 2024-04-18T21:05:25.107 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.107 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.107 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:25.107 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656344+0000", 2024-04-18T21:05:25.107 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00010334400000000001 2024-04-18T21:05:25.107 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:25.107 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:25.107 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:25.108 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.108 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.108 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:25.108 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:05:25.108 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 19.439212607999998, 2024-04-18T21:05:25.108 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.043549577999999999, 2024-04-18T21:05:25.108 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:25.108 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:25.108 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:25.108 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:25.108 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.108 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:25.108 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:05:25.108 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:25.108 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.109 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.109 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:25.109 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:05:25.109 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:25.109 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.109 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.109 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:25.109 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:05:25.109 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.5000000000000002e-07 2024-04-18T21:05:25.109 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.109 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.109 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:25.109 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615828+0000", 2024-04-18T21:05:25.110 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.2359999999999998e-06 2024-04-18T21:05:25.110 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.110 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.110 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:25.110 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615838+0000", 2024-04-18T21:05:25.110 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0087e-05 2024-04-18T21:05:25.110 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.110 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.110 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:25.110 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615846+0000", 2024-04-18T21:05:25.110 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.67e-06 2024-04-18T21:05:25.110 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.110 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.111 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:25.111 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615963+0000", 2024-04-18T21:05:25.111 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00011630500000000001 2024-04-18T21:05:25.111 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.111 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.111 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:25.111 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615979+0000", 2024-04-18T21:05:25.111 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.613e-05 2024-04-18T21:05:25.111 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.111 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.111 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:25.111 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632392+0000", 2024-04-18T21:05:25.111 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016413317 2024-04-18T21:05:25.111 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.112 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.112 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:25.112 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632568+0000", 2024-04-18T21:05:25.112 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00017539500000000001 2024-04-18T21:05:25.112 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.112 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.112 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:25.112 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632748+0000", 2024-04-18T21:05:25.112 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00017991799999999999 2024-04-18T21:05:25.112 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.112 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.112 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:25.112 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635542+0000", 2024-04-18T21:05:25.112 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00279481 2024-04-18T21:05:25.113 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.113 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.113 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:25.113 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659232+0000", 2024-04-18T21:05:25.113 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.023689212000000001 2024-04-18T21:05:25.113 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.113 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.113 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:25.113 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659314+0000", 2024-04-18T21:05:25.113 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.2528999999999995e-05 2024-04-18T21:05:25.113 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.114 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.114 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:25.114 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659372+0000", 2024-04-18T21:05:25.114 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.8218999999999999e-05 2024-04-18T21:05:25.114 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:25.114 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:25.114 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:25.114 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.114 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.114 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:25.114 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:05:25.114 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 19.439151175999999, 2024-04-18T21:05:25.114 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.039335347, 2024-04-18T21:05:25.114 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:25.115 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:25.115 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "started", 2024-04-18T21:05:25.115 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:25.115 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.115 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:25.115 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:05:25.115 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:25.115 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.115 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.115 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:25.115 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:05:25.115 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:25.115 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.115 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.116 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:25.116 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615885+0000", 2024-04-18T21:05:25.116 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2699999999999999e-06 2024-04-18T21:05:25.116 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.116 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.116 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:25.116 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615892+0000", 2024-04-18T21:05:25.116 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.6499999999999999e-06 2024-04-18T21:05:25.116 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.116 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.116 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:25.116 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615906+0000", 2024-04-18T21:05:25.116 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.393e-05 2024-04-18T21:05:25.116 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.116 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.116 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:25.117 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615919+0000", 2024-04-18T21:05:25.117 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2860000000000001e-05 2024-04-18T21:05:25.117 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.117 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.117 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:25.117 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616027+0000", 2024-04-18T21:05:25.117 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000107852 2024-04-18T21:05:25.117 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.117 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.117 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:05:25.117 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616037+0000", 2024-04-18T21:05:25.117 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:05:25.117 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.117 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.118 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:25.118 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622719+0000", 2024-04-18T21:05:25.118 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0066817220000000002 2024-04-18T21:05:25.118 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.118 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.118 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:25.118 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623006+0000", 2024-04-18T21:05:25.118 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00028783699999999999 2024-04-18T21:05:25.118 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.118 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.118 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:25.118 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.655220+0000", 2024-04-18T21:05:25.118 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.032213036 2024-04-18T21:05:25.119 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:25.119 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:25.119 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:25.119 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.119 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.119 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:25.119 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:25.119 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 19.439095503000001, 2024-04-18T21:05:25.119 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.032845253999999997, 2024-04-18T21:05:25.119 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:25.119 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:25.119 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "started", 2024-04-18T21:05:25.119 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:25.119 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.120 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:25.120 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:25.120 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:25.120 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.120 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.120 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:25.120 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:25.120 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:25.120 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.120 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.120 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:25.120 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615942+0000", 2024-04-18T21:05:25.121 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.717e-06 2024-04-18T21:05:25.121 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.121 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.121 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:25.121 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615946+0000", 2024-04-18T21:05:25.121 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.6e-06 2024-04-18T21:05:25.121 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.121 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.121 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:25.121 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615960+0000", 2024-04-18T21:05:25.121 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:05:25.122 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.122 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.122 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:25.122 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615968+0000", 2024-04-18T21:05:25.122 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.9070000000000007e-06 2024-04-18T21:05:25.122 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.122 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.122 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:25.122 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616100+0000", 2024-04-18T21:05:25.122 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000132402 2024-04-18T21:05:25.122 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.122 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.122 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:05:25.123 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616117+0000", 2024-04-18T21:05:25.123 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6653000000000001e-05 2024-04-18T21:05:25.123 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.123 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.123 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:25.123 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621566+0000", 2024-04-18T21:05:25.123 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0054497740000000001 2024-04-18T21:05:25.123 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.123 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.123 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:25.123 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622801+0000", 2024-04-18T21:05:25.123 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0012345710000000001 2024-04-18T21:05:25.123 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.123 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.124 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:25.124 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648785+0000", 2024-04-18T21:05:25.124 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.025984104000000001 2024-04-18T21:05:25.124 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:25.124 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:25.124 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:25.124 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.124 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.124 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:25.124 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:05:25.124 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 19.433244153, 2024-04-18T21:05:25.124 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.011561350999999999, 2024-04-18T21:05:25.125 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:25.125 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:25.125 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:25.125 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:25.125 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.125 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:25.125 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:05:25.125 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:25.125 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.125 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.125 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:25.125 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:05:25.125 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:25.126 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.126 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.126 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:25.126 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621792+0000", 2024-04-18T21:05:25.126 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.4000000000000001e-07 2024-04-18T21:05:25.126 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.126 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.126 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:25.126 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:05:25.126 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.1050000000000002e-05 2024-04-18T21:05:25.126 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.126 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.126 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:25.127 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622608+0000", 2024-04-18T21:05:25.127 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00077505900000000003 2024-04-18T21:05:25.127 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.127 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.127 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:25.127 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623879+0000", 2024-04-18T21:05:25.127 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0012705839999999999 2024-04-18T21:05:25.127 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.127 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.127 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:25.127 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624010+0000", 2024-04-18T21:05:25.127 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00013176900000000001 2024-04-18T21:05:25.127 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.127 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.127 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:25.127 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624058+0000", 2024-04-18T21:05:25.128 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.7299000000000002e-05 2024-04-18T21:05:25.128 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.128 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.128 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:25.128 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633262+0000", 2024-04-18T21:05:25.128 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0092048770000000002 2024-04-18T21:05:25.128 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.128 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.128 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:25.128 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633353+0000", 2024-04-18T21:05:25.128 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0073000000000003e-05 2024-04-18T21:05:25.128 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:25.128 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:25.128 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:25.129 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.129 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.129 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:25.129 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:05:25.129 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 19.431116766999999, 2024-04-18T21:05:25.129 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0098419370000000003, 2024-04-18T21:05:25.129 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:25.129 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:25.129 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:25.129 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:25.129 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.129 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:25.129 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:05:25.129 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:25.129 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.130 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.130 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:25.130 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:05:25.130 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:25.130 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.130 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.130 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:25.130 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623920+0000", 2024-04-18T21:05:25.130 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2240000000000001e-06 2024-04-18T21:05:25.130 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.130 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.130 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:25.130 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623933+0000", 2024-04-18T21:05:25.130 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3653e-05 2024-04-18T21:05:25.131 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.131 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.131 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:25.131 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623956+0000", 2024-04-18T21:05:25.131 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2059e-05 2024-04-18T21:05:25.131 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.131 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.131 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:25.131 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623975+0000", 2024-04-18T21:05:25.131 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.9806999999999999e-05 2024-04-18T21:05:25.131 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.131 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.131 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:25.131 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626943+0000", 2024-04-18T21:05:25.131 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0029681579999999998 2024-04-18T21:05:25.132 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.132 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.132 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:25.132 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626993+0000", 2024-04-18T21:05:25.132 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.9935999999999998e-05 2024-04-18T21:05:25.132 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.132 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.132 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:25.132 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633665+0000", 2024-04-18T21:05:25.132 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0066719250000000004 2024-04-18T21:05:25.132 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.132 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.132 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:25.132 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633761+0000", 2024-04-18T21:05:25.132 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.5174999999999996e-05 2024-04-18T21:05:25.133 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:25.133 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:25.133 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:25.133 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.133 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.133 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:25.133 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:05:25.133 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 19.430285147999999, 2024-04-18T21:05:25.133 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0090159079999999996, 2024-04-18T21:05:25.133 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:25.133 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:25.133 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:25.134 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:25.134 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.134 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:25.134 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:05:25.134 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:25.134 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.134 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.134 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:25.134 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:05:25.134 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:25.134 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.134 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.134 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:25.134 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624751+0000", 2024-04-18T21:05:25.134 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.7600000000000006e-07 2024-04-18T21:05:25.135 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.135 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.135 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:25.135 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624787+0000", 2024-04-18T21:05:25.135 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.6273000000000003e-05 2024-04-18T21:05:25.135 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.135 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.135 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:25.135 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625837+0000", 2024-04-18T21:05:25.135 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00104992 2024-04-18T21:05:25.135 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.135 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.135 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:25.136 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625860+0000", 2024-04-18T21:05:25.136 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3110000000000001e-05 2024-04-18T21:05:25.136 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.136 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.136 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:25.136 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625984+0000", 2024-04-18T21:05:25.136 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012399199999999999 2024-04-18T21:05:25.136 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.136 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.136 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:25.136 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626030+0000", 2024-04-18T21:05:25.136 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.5429999999999997e-05 2024-04-18T21:05:25.136 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.136 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.136 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:25.137 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633643+0000", 2024-04-18T21:05:25.137 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0076129320000000002 2024-04-18T21:05:25.137 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.137 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.137 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:25.137 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633766+0000", 2024-04-18T21:05:25.137 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000123275 2024-04-18T21:05:25.137 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:25.137 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:25.137 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:25.137 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.137 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.137 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:25.137 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:05:25.138 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 19.429031424000001, 2024-04-18T21:05:25.138 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0088669170000000002, 2024-04-18T21:05:25.138 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:25.138 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:25.138 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:25.138 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:25.138 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.138 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:25.138 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:05:25.138 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:25.138 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.138 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.138 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:25.138 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:05:25.138 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:25.139 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.139 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.139 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:25.139 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626005+0000", 2024-04-18T21:05:25.139 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.5000000000000001e-07 2024-04-18T21:05:25.139 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.139 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.139 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:25.139 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626028+0000", 2024-04-18T21:05:25.139 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2756999999999999e-05 2024-04-18T21:05:25.139 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.139 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.139 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:25.139 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626050+0000", 2024-04-18T21:05:25.140 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2140000000000001e-05 2024-04-18T21:05:25.140 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.140 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.140 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:25.140 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626065+0000", 2024-04-18T21:05:25.140 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5176e-05 2024-04-18T21:05:25.140 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.140 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.140 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:25.140 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628334+0000", 2024-04-18T21:05:25.140 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0022691439999999998 2024-04-18T21:05:25.140 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.140 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.140 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:25.141 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628379+0000", 2024-04-18T21:05:25.141 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.5420000000000002e-05 2024-04-18T21:05:25.141 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.141 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.141 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:25.141 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634770+0000", 2024-04-18T21:05:25.141 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0063908410000000004 2024-04-18T21:05:25.141 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.141 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.141 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:25.141 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634871+0000", 2024-04-18T21:05:25.141 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000100589 2024-04-18T21:05:25.141 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:25.141 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:25.142 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:25.142 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.142 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.142 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:13 3.10 e17/15 3:0d89b25e:::603.00000000:head v 17'8, mlcod=0'0)", 2024-04-18T21:05:25.142 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:05:25.142 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 19.410197995000001, 2024-04-18T21:05:25.142 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0090974379999999994, 2024-04-18T21:05:25.142 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:25.142 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:25.142 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:25.142 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:25.142 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.142 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:25.142 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:05:25.143 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:25.143 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.143 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.143 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:25.143 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:05:25.143 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:25.143 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.143 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.143 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:25.143 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644838+0000", 2024-04-18T21:05:25.143 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.569999999999999e-07 2024-04-18T21:05:25.143 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.143 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.143 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:25.143 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644846+0000", 2024-04-18T21:05:25.144 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.4499999999999998e-06 2024-04-18T21:05:25.144 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.144 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.144 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:25.144 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644861+0000", 2024-04-18T21:05:25.144 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5243e-05 2024-04-18T21:05:25.144 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.144 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.144 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:25.144 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644997+0000", 2024-04-18T21:05:25.144 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000135609 2024-04-18T21:05:25.144 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.144 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.144 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:25.144 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649150+0000", 2024-04-18T21:05:25.144 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0041536760000000002 2024-04-18T21:05:25.145 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.145 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.145 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:25.145 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649207+0000", 2024-04-18T21:05:25.145 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.6677e-05 2024-04-18T21:05:25.145 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.145 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.145 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:25.145 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.653840+0000", 2024-04-18T21:05:25.145 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0046329700000000001 2024-04-18T21:05:25.145 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.145 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.145 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:25.146 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.653935+0000", 2024-04-18T21:05:25.146 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.4856000000000001e-05 2024-04-18T21:05:25.146 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:25.146 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:25.146 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:25.146 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.146 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.146 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 3 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:05:25.146 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:05:25.146 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 19.407408834999998, 2024-04-18T21:05:25.146 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0087842319999999995, 2024-04-18T21:05:25.146 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:25.146 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:25.146 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "reached pg", 2024-04-18T21:05:25.147 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:25.147 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.147 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:25.147 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:05:25.147 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:25.147 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.147 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.147 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:25.147 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:05:25.147 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:25.147 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.147 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.147 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:25.147 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:05:25.148 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.8299999999999996e-07 2024-04-18T21:05:25.148 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.148 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.148 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:25.148 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647642+0000", 2024-04-18T21:05:25.148 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4724e-05 2024-04-18T21:05:25.148 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.148 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.148 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:25.148 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647679+0000", 2024-04-18T21:05:25.148 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.6662999999999998e-05 2024-04-18T21:05:25.148 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.148 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.149 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:25.149 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647735+0000", 2024-04-18T21:05:25.149 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.6196000000000002e-05 2024-04-18T21:05:25.149 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.149 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.149 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:25.149 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649865+0000", 2024-04-18T21:05:25.149 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0021299489999999999 2024-04-18T21:05:25.149 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.149 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.149 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:25.149 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656411+0000", 2024-04-18T21:05:25.149 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0065460170000000003 2024-04-18T21:05:25.149 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:25.150 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:25.150 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:25.150 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.150 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.150 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:25.150 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:05:25.150 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 19.407263639, 2024-04-18T21:05:25.150 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0095703190000000007, 2024-04-18T21:05:25.150 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:25.150 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:25.150 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:25.150 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:25.150 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.150 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:25.151 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:05:25.151 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:25.151 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.151 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.151 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:25.151 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:05:25.151 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:25.151 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.151 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.151 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:25.151 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647773+0000", 2024-04-18T21:05:25.151 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.046e-06 2024-04-18T21:05:25.151 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.151 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.152 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:25.152 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647795+0000", 2024-04-18T21:05:25.152 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2616000000000002e-05 2024-04-18T21:05:25.152 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.152 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.152 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:25.152 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647818+0000", 2024-04-18T21:05:25.152 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3110000000000001e-05 2024-04-18T21:05:25.152 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.152 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.152 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:25.152 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647834+0000", 2024-04-18T21:05:25.152 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5163e-05 2024-04-18T21:05:25.152 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.153 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.153 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:25.153 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650682+0000", 2024-04-18T21:05:25.153 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0028479759999999999 2024-04-18T21:05:25.153 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.153 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.153 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:25.153 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650730+0000", 2024-04-18T21:05:25.153 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.8375999999999999e-05 2024-04-18T21:05:25.153 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.153 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.153 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:25.153 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656751+0000", 2024-04-18T21:05:25.153 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0060211880000000002 2024-04-18T21:05:25.153 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.154 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.154 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:25.154 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657342+0000", 2024-04-18T21:05:25.154 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00059084399999999998 2024-04-18T21:05:25.154 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:25.154 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:25.154 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:25.154 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.154 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.154 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:25.154 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:05:25.154 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 19.406851353, 2024-04-18T21:05:25.155 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0092471759999999993, 2024-04-18T21:05:25.155 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:25.155 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:25.155 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:25.155 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:25.155 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.155 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:25.155 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:05:25.155 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:25.155 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.155 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.155 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:25.155 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:05:25.156 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:25.156 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.156 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.156 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:25.156 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648185+0000", 2024-04-18T21:05:25.156 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.5000000000000001e-07 2024-04-18T21:05:25.156 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.156 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.156 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:25.156 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648203+0000", 2024-04-18T21:05:25.156 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.8102999999999999e-05 2024-04-18T21:05:25.156 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.156 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.156 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:25.157 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648226+0000", 2024-04-18T21:05:25.157 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2921999999999998e-05 2024-04-18T21:05:25.157 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.157 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.157 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:25.157 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648241+0000", 2024-04-18T21:05:25.157 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5336999999999999e-05 2024-04-18T21:05:25.157 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.157 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.157 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:25.157 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.651268+0000", 2024-04-18T21:05:25.157 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0030271640000000002 2024-04-18T21:05:25.157 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.157 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.158 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:25.158 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.651319+0000", 2024-04-18T21:05:25.158 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.0843000000000001e-05 2024-04-18T21:05:25.158 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.158 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.158 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:25.158 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657347+0000", 2024-04-18T21:05:25.158 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0060279770000000003 2024-04-18T21:05:25.158 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:25.158 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:25.158 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:25.158 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657431+0000", 2024-04-18T21:05:25.158 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.3980000000000006e-05 2024-04-18T21:05:25.158 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:25.159 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:25.159 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:25.159 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:25.159 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:25.159 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:05:25.160 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:25.055+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:25.161 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:05:25.161 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:25.159+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:25.261 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:25.263+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:25.291 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:05:25.291 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:05:25.291 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-04-18T21:05:25.291 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:05:25.305 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:05:25.362 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:25.363+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:25.462 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:25.463+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:25.471 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:05:25.471 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:05:25.471 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-18T21:05:25.471 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-18T21:05:25.471 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:05:25.485 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:05:25.564 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:25.563+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:25.652 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:05:25.652 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-18T21:05:25.652 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-18T21:05:25.652 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:05:25.652 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.652 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:25.652 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:05:25.652 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.038077938000001, 2024-04-18T21:05:25.653 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.034065303999999998, 2024-04-18T21:05:25.653 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:25.653 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:25.653 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:25.653 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:25.653 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.653 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:25.653 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:05:25.653 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:25.653 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.653 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.653 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:25.653 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:05:25.654 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:25.654 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.654 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.654 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:25.654 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615254+0000", 2024-04-18T21:05:25.654 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7829999999999999e-06 2024-04-18T21:05:25.654 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.654 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.654 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:25.654 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615267+0000", 2024-04-18T21:05:25.654 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3334e-05 2024-04-18T21:05:25.654 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.654 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.655 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:25.655 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615294+0000", 2024-04-18T21:05:25.655 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7271999999999999e-05 2024-04-18T21:05:25.655 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.655 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.655 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:25.655 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615321+0000", 2024-04-18T21:05:25.655 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.637e-05 2024-04-18T21:05:25.655 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.655 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.655 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:25.655 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615479+0000", 2024-04-18T21:05:25.656 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000158493 2024-04-18T21:05:25.656 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.656 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.656 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:25.656 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615498+0000", 2024-04-18T21:05:25.656 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9148999999999999e-05 2024-04-18T21:05:25.656 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.656 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.656 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:25.656 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632915+0000", 2024-04-18T21:05:25.656 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.017416551999999998 2024-04-18T21:05:25.657 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.657 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.657 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:25.657 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633302+0000", 2024-04-18T21:05:25.657 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00038725000000000001 2024-04-18T21:05:25.657 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.657 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.657 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:25.657 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633638+0000", 2024-04-18T21:05:25.657 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000335946 2024-04-18T21:05:25.657 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.657 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.657 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:25.658 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645976+0000", 2024-04-18T21:05:25.658 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012337617 2024-04-18T21:05:25.658 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.658 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.658 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:25.658 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649080+0000", 2024-04-18T21:05:25.658 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031038929999999999 2024-04-18T21:05:25.658 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.658 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.658 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:25.658 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649207+0000", 2024-04-18T21:05:25.658 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000127537 2024-04-18T21:05:25.658 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.659 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.659 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:25.659 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649316+0000", 2024-04-18T21:05:25.659 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109108 2024-04-18T21:05:25.659 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:25.659 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:25.659 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:25.659 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.659 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.659 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:25.659 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:05:25.659 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.037944561, 2024-04-18T21:05:25.659 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036275764000000002, 2024-04-18T21:05:25.660 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:25.660 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:25.660 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:25.660 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:25.660 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.660 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:25.660 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:05:25.660 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:25.660 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.660 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.660 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:25.660 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:05:25.661 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:25.661 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.661 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.661 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:25.661 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615386+0000", 2024-04-18T21:05:25.661 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.573e-06 2024-04-18T21:05:25.661 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.661 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.661 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:25.661 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:05:25.661 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0723999999999999e-05 2024-04-18T21:05:25.661 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.662 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.662 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:25.662 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615418+0000", 2024-04-18T21:05:25.662 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0902000000000001e-05 2024-04-18T21:05:25.662 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.662 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.662 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:25.662 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615433+0000", 2024-04-18T21:05:25.662 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5319999999999999e-05 2024-04-18T21:05:25.662 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.662 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.663 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:25.663 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615659+0000", 2024-04-18T21:05:25.663 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000226095 2024-04-18T21:05:25.663 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.663 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.663 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:25.663 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:25.663 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1276e-05 2024-04-18T21:05:25.663 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.663 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.663 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:25.663 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643654+0000", 2024-04-18T21:05:25.663 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027983238000000001 2024-04-18T21:05:25.664 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.664 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.664 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:25.664 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643868+0000", 2024-04-18T21:05:25.664 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000214305 2024-04-18T21:05:25.664 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.664 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.664 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:25.664 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:05:25.664 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035892200000000002 2024-04-18T21:05:25.664 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.664 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.665 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:25.665 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646056+0000", 2024-04-18T21:05:25.665 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001829172 2024-04-18T21:05:25.665 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.665 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.665 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:25.665 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651406+0000", 2024-04-18T21:05:25.665 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0053504800000000003 2024-04-18T21:05:25.665 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.665 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.665 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:25.665 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651551+0000", 2024-04-18T21:05:25.665 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014427999999999999 2024-04-18T21:05:25.666 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.666 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.666 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:25.666 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651660+0000", 2024-04-18T21:05:25.666 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109477 2024-04-18T21:05:25.666 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:25.666 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:25.666 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:25.666 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.666 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.666 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:25.666 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:05:25.666 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.037871179, 2024-04-18T21:05:25.666 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045668994999999997, 2024-04-18T21:05:25.667 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:25.667 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:25.667 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:25.667 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:25.667 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.667 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:25.667 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:05:25.667 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:25.667 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.667 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.667 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:25.667 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:05:25.667 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:25.668 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.668 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.668 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:25.668 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615459+0000", 2024-04-18T21:05:25.668 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5030000000000001e-06 2024-04-18T21:05:25.668 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.668 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.668 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:25.668 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615506+0000", 2024-04-18T21:05:25.668 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6872000000000001e-05 2024-04-18T21:05:25.668 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.669 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.669 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:25.669 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615527+0000", 2024-04-18T21:05:25.669 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0763000000000001e-05 2024-04-18T21:05:25.669 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.669 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.669 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:25.669 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615551+0000", 2024-04-18T21:05:25.669 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4159e-05 2024-04-18T21:05:25.669 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.669 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.669 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:25.669 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615736+0000", 2024-04-18T21:05:25.670 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018499599999999999 2024-04-18T21:05:25.670 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.670 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.670 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:25.670 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615748+0000", 2024-04-18T21:05:25.670 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2272999999999999e-05 2024-04-18T21:05:25.670 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.670 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.670 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:25.670 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635481+0000", 2024-04-18T21:05:25.670 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019732772999999999 2024-04-18T21:05:25.670 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.670 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.671 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:25.671 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635791+0000", 2024-04-18T21:05:25.671 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031013299999999998 2024-04-18T21:05:25.671 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.671 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.671 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:25.671 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636101+0000", 2024-04-18T21:05:25.671 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030943300000000002 2024-04-18T21:05:25.671 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.671 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.671 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:25.671 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646043+0000", 2024-04-18T21:05:25.672 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099428139999999995 2024-04-18T21:05:25.672 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.672 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.672 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:25.672 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660991+0000", 2024-04-18T21:05:25.672 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014947142 2024-04-18T21:05:25.672 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.672 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.672 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:25.672 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661061+0000", 2024-04-18T21:05:25.672 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0438000000000006e-05 2024-04-18T21:05:25.672 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.672 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.673 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:25.673 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661127+0000", 2024-04-18T21:05:25.673 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5696000000000003e-05 2024-04-18T21:05:25.673 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:25.673 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:25.673 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:25.673 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.673 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.673 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:25.673 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:25.673 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.037658750999999, 2024-04-18T21:05:25.673 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045745085999999997, 2024-04-18T21:05:25.673 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:25.674 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:25.674 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:25.674 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:25.674 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.674 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:25.674 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:25.674 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:25.674 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.674 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.674 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:25.675 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:25.675 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:25.675 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.675 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.675 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:25.675 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:05:25.675 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7400000000000001e-06 2024-04-18T21:05:25.675 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.675 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.675 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:25.675 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:05:25.675 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8133e-05 2024-04-18T21:05:25.675 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.676 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.676 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:25.676 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615726+0000", 2024-04-18T21:05:25.676 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6132e-05 2024-04-18T21:05:25.676 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.676 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.676 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:25.676 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615742+0000", 2024-04-18T21:05:25.676 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6157000000000001e-05 2024-04-18T21:05:25.676 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.676 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.676 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:25.676 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615937+0000", 2024-04-18T21:05:25.677 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000194768 2024-04-18T21:05:25.677 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.677 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.677 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:25.677 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615950+0000", 2024-04-18T21:05:25.677 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3084e-05 2024-04-18T21:05:25.677 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.677 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.677 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:25.677 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643676+0000", 2024-04-18T21:05:25.677 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027725639999999999 2024-04-18T21:05:25.677 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.678 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.678 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:25.678 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643867+0000", 2024-04-18T21:05:25.678 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019075900000000001 2024-04-18T21:05:25.678 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.678 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.678 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:25.678 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:05:25.678 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036013799999999997 2024-04-18T21:05:25.678 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.678 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.679 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:25.679 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646068+0000", 2024-04-18T21:05:25.679 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001841536 2024-04-18T21:05:25.679 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.679 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.679 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:25.679 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661184+0000", 2024-04-18T21:05:25.679 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015115458999999999 2024-04-18T21:05:25.679 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.679 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.679 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:25.680 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661283+0000", 2024-04-18T21:05:25.680 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9502999999999999e-05 2024-04-18T21:05:25.680 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.680 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.680 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:25.680 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661415+0000", 2024-04-18T21:05:25.680 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000132037 2024-04-18T21:05:25.680 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:25.680 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:25.680 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:25.680 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.681 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.681 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:25.681 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:05:25.681 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.037537063999999, 2024-04-18T21:05:25.681 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036185947000000003, 2024-04-18T21:05:25.681 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:25.681 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:25.681 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:25.681 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:25.681 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.681 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:25.681 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:05:25.682 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:25.682 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.682 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.682 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:25.682 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:05:25.682 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:25.682 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.682 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.682 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:25.682 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615794+0000", 2024-04-18T21:05:25.682 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6440000000000001e-06 2024-04-18T21:05:25.682 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.682 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.683 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:25.683 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615803+0000", 2024-04-18T21:05:25.683 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1220000000000001e-06 2024-04-18T21:05:25.683 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.683 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.683 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:25.683 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615827+0000", 2024-04-18T21:05:25.683 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3997000000000001e-05 2024-04-18T21:05:25.683 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.683 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.683 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:25.683 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615899+0000", 2024-04-18T21:05:25.684 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2741e-05 2024-04-18T21:05:25.684 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.684 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.684 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:25.684 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616019+0000", 2024-04-18T21:05:25.684 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119874 2024-04-18T21:05:25.684 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.684 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.684 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:25.684 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616029+0000", 2024-04-18T21:05:25.684 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:05:25.684 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.685 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.685 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:25.685 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644823+0000", 2024-04-18T21:05:25.685 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.028793151999999999 2024-04-18T21:05:25.685 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.685 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.685 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:25.685 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645106+0000", 2024-04-18T21:05:25.685 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028379700000000002 2024-04-18T21:05:25.685 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.685 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.686 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:25.686 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645294+0000", 2024-04-18T21:05:25.686 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000187181 2024-04-18T21:05:25.686 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.686 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.686 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:25.686 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646763+0000", 2024-04-18T21:05:25.686 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0014691050000000001 2024-04-18T21:05:25.686 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.686 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.686 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:25.687 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651784+0000", 2024-04-18T21:05:25.687 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050211650000000002 2024-04-18T21:05:25.687 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.687 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.687 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:25.687 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651876+0000", 2024-04-18T21:05:25.687 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2503999999999994e-05 2024-04-18T21:05:25.687 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.687 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.687 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:25.687 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651978+0000", 2024-04-18T21:05:25.688 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000101475 2024-04-18T21:05:25.688 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:25.688 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:25.688 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:25.688 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.688 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.688 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:25.688 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:25.688 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.037388456999999, 2024-04-18T21:05:25.688 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032262322000000003, 2024-04-18T21:05:25.688 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:25.688 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:25.689 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:25.689 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:25.689 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.689 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:25.689 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:25.689 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:25.689 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.689 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.689 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:25.689 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:25.689 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:25.690 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.690 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.690 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:25.690 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615943+0000", 2024-04-18T21:05:25.690 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1959999999999998e-06 2024-04-18T21:05:25.690 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.690 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.690 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:25.690 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615956+0000", 2024-04-18T21:05:25.690 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3424000000000001e-05 2024-04-18T21:05:25.691 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.691 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.691 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:25.691 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615983+0000", 2024-04-18T21:05:25.691 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7072000000000001e-05 2024-04-18T21:05:25.691 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.691 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.691 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:25.691 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616006+0000", 2024-04-18T21:05:25.691 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2823000000000002e-05 2024-04-18T21:05:25.691 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.692 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.692 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:25.692 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616156+0000", 2024-04-18T21:05:25.692 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014962299999999999 2024-04-18T21:05:25.692 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.692 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.692 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:25.692 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616174+0000", 2024-04-18T21:05:25.692 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8082999999999999e-05 2024-04-18T21:05:25.692 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.692 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.692 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:25.693 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.629952+0000", 2024-04-18T21:05:25.693 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013778514 2024-04-18T21:05:25.693 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.693 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.693 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:25.693 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630201+0000", 2024-04-18T21:05:25.693 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024918100000000001 2024-04-18T21:05:25.693 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.693 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.693 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:25.693 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630386+0000", 2024-04-18T21:05:25.693 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018436900000000001 2024-04-18T21:05:25.693 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.693 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.694 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:25.694 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643169+0000", 2024-04-18T21:05:25.694 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012782774 2024-04-18T21:05:25.694 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.694 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.694 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:25.694 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.647924+0000", 2024-04-18T21:05:25.694 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004755787 2024-04-18T21:05:25.694 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.694 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.694 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:25.694 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648069+0000", 2024-04-18T21:05:25.695 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014459600000000001 2024-04-18T21:05:25.695 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.695 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.695 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:25.695 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648203+0000", 2024-04-18T21:05:25.695 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013388000000000001 2024-04-18T21:05:25.695 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:25.695 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:25.695 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:25.695 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.695 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.695 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:25.695 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:05:25.696 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.037280193000001, 2024-04-18T21:05:25.696 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032489736999999998, 2024-04-18T21:05:25.696 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:25.696 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:25.696 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:25.696 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:25.696 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.696 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:25.696 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:05:25.696 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:25.696 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.696 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.696 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:25.697 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:05:25.697 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:25.697 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.697 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.697 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:25.697 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616050+0000", 2024-04-18T21:05:25.697 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.606e-06 2024-04-18T21:05:25.697 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.697 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.697 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:25.697 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616061+0000", 2024-04-18T21:05:25.697 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0463e-05 2024-04-18T21:05:25.698 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.698 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.698 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:25.698 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616092+0000", 2024-04-18T21:05:25.698 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1415999999999999e-05 2024-04-18T21:05:25.698 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.698 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.698 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:25.698 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616109+0000", 2024-04-18T21:05:25.698 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6557000000000001e-05 2024-04-18T21:05:25.698 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.699 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.699 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:25.699 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616358+0000", 2024-04-18T21:05:25.699 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000249077 2024-04-18T21:05:25.699 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.699 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.699 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:25.699 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616370+0000", 2024-04-18T21:05:25.699 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2037e-05 2024-04-18T21:05:25.699 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.699 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.699 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:25.699 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.634920+0000", 2024-04-18T21:05:25.700 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018550397 2024-04-18T21:05:25.700 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.700 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.700 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:25.700 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640420+0000", 2024-04-18T21:05:25.700 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055000539999999999 2024-04-18T21:05:25.700 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.700 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.700 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:25.700 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648538+0000", 2024-04-18T21:05:25.700 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0081181299999999994 2024-04-18T21:05:25.700 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:25.701 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:25.701 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:25.701 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.701 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.701 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:25.701 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:05:25.701 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.037195872000002, 2024-04-18T21:05:25.701 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036090029000000003, 2024-04-18T21:05:25.701 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:25.701 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:25.701 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:25.702 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:25.702 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.702 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:25.702 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:05:25.702 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:25.702 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.702 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.702 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:25.702 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:05:25.702 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:25.702 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.702 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.703 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:25.703 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616134+0000", 2024-04-18T21:05:25.703 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.353e-06 2024-04-18T21:05:25.703 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.703 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.703 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:25.703 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616141+0000", 2024-04-18T21:05:25.703 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2770000000000002e-06 2024-04-18T21:05:25.703 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.703 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.703 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:25.703 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616160+0000", 2024-04-18T21:05:25.703 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.91e-05 2024-04-18T21:05:25.704 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.704 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.704 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:25.704 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616170+0000", 2024-04-18T21:05:25.704 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7699999999999996e-06 2024-04-18T21:05:25.704 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.704 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.704 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:25.704 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616275+0000", 2024-04-18T21:05:25.704 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105313 2024-04-18T21:05:25.704 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.704 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.704 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:25.705 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616288+0000", 2024-04-18T21:05:25.705 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3027000000000001e-05 2024-04-18T21:05:25.705 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.705 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.705 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:25.705 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646160+0000", 2024-04-18T21:05:25.705 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.029872019 2024-04-18T21:05:25.705 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.705 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.705 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:25.705 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646368+0000", 2024-04-18T21:05:25.705 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020811899999999999 2024-04-18T21:05:25.705 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.706 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.706 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:25.706 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652223+0000", 2024-04-18T21:05:25.706 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.005855051 2024-04-18T21:05:25.706 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:25.706 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:25.706 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:25.706 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.706 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.706 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:25.706 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:05:25.706 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.037138302999999, 2024-04-18T21:05:25.707 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043572403000000003, 2024-04-18T21:05:25.707 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:25.707 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:25.707 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:25.707 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:25.707 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.707 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:25.707 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:05:25.707 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:25.707 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.707 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.707 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:25.707 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:05:25.708 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:25.708 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.708 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.708 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:25.708 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616192+0000", 2024-04-18T21:05:25.708 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:05:25.708 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.708 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.708 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:25.708 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616203+0000", 2024-04-18T21:05:25.708 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0890000000000001e-05 2024-04-18T21:05:25.708 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.709 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.709 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:25.709 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616223+0000", 2024-04-18T21:05:25.709 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0409000000000001e-05 2024-04-18T21:05:25.709 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.709 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.709 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:25.709 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616238+0000", 2024-04-18T21:05:25.709 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5160000000000001e-05 2024-04-18T21:05:25.709 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.709 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.710 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:25.710 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616343+0000", 2024-04-18T21:05:25.710 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000104831 2024-04-18T21:05:25.710 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.710 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.710 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:25.710 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616357+0000", 2024-04-18T21:05:25.710 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3686000000000001e-05 2024-04-18T21:05:25.710 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.710 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.710 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:25.711 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635912+0000", 2024-04-18T21:05:25.711 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019554944000000001 2024-04-18T21:05:25.711 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.711 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.711 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:25.711 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636231+0000", 2024-04-18T21:05:25.711 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000318766 2024-04-18T21:05:25.711 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.711 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.711 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:25.711 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659763+0000", 2024-04-18T21:05:25.711 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023532474000000001 2024-04-18T21:05:25.712 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:25.712 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:25.712 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:25.712 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.712 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.712 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:25.712 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:05:25.712 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.033209595999999, 2024-04-18T21:05:25.712 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015007971, 2024-04-18T21:05:25.712 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:25.712 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:25.712 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:25.712 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:25.713 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.713 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:25.713 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:05:25.713 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:25.713 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.713 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.713 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:25.713 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:05:25.713 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:25.713 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.713 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.713 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:25.713 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620120+0000", 2024-04-18T21:05:25.713 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0359999999999999e-06 2024-04-18T21:05:25.714 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.714 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.714 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:25.714 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620157+0000", 2024-04-18T21:05:25.714 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6636e-05 2024-04-18T21:05:25.714 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.714 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.714 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:25.714 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620177+0000", 2024-04-18T21:05:25.714 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0247000000000001e-05 2024-04-18T21:05:25.714 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.715 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.715 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:25.715 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620195+0000", 2024-04-18T21:05:25.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7819e-05 2024-04-18T21:05:25.715 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.715 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.715 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:25.715 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620342+0000", 2024-04-18T21:05:25.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014643300000000001 2024-04-18T21:05:25.715 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.715 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.716 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:25.716 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620405+0000", 2024-04-18T21:05:25.716 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3522000000000006e-05 2024-04-18T21:05:25.716 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.716 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.716 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:25.716 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635016+0000", 2024-04-18T21:05:25.716 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014610840999999999 2024-04-18T21:05:25.716 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.716 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.716 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:25.716 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635127+0000", 2024-04-18T21:05:25.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111437 2024-04-18T21:05:25.717 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:25.717 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:25.717 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:25.717 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.717 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:25.717 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:05:25.717 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.033102327999998, 2024-04-18T21:05:25.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012693296, 2024-04-18T21:05:25.717 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:25.717 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:25.718 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:25.718 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:25.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:25.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:05:25.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:25.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:25.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:05:25.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:25.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.719 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:25.719 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620228+0000", 2024-04-18T21:05:25.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:05:25.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.719 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:25.719 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620236+0000", 2024-04-18T21:05:25.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.303e-06 2024-04-18T21:05:25.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.719 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:25.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620255+0000", 2024-04-18T21:05:25.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9406e-05 2024-04-18T21:05:25.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:25.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620274+0000", 2024-04-18T21:05:25.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8940000000000002e-05 2024-04-18T21:05:25.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:25.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:05:25.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001558753 2024-04-18T21:05:25.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:25.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621879+0000", 2024-04-18T21:05:25.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6359000000000001e-05 2024-04-18T21:05:25.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:25.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632841+0000", 2024-04-18T21:05:25.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010961907 2024-04-18T21:05:25.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:25.722 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632920+0000", 2024-04-18T21:05:25.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8714999999999994e-05 2024-04-18T21:05:25.722 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:25.722 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:25.722 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:25.722 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.722 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.722 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:25.722 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:05:25.722 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.031556564999999, 2024-04-18T21:05:25.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013445702, 2024-04-18T21:05:25.723 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:25.723 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:25.723 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:25.723 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:25.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:25.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:05:25.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:25.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:25.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:05:25.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:25.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.724 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:25.724 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621774+0000", 2024-04-18T21:05:25.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2500000000000001e-06 2024-04-18T21:05:25.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.724 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:25.724 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621786+0000", 2024-04-18T21:05:25.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2636000000000001e-05 2024-04-18T21:05:25.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:25.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621814+0000", 2024-04-18T21:05:25.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7823000000000001e-05 2024-04-18T21:05:25.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:25.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621844+0000", 2024-04-18T21:05:25.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9589000000000001e-05 2024-04-18T21:05:25.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:25.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622253+0000", 2024-04-18T21:05:25.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040963700000000002 2024-04-18T21:05:25.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.726 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.726 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:25.726 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622304+0000", 2024-04-18T21:05:25.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0868999999999997e-05 2024-04-18T21:05:25.726 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.726 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.726 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:25.726 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635133+0000", 2024-04-18T21:05:25.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012829136 2024-04-18T21:05:25.726 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:25.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635218+0000", 2024-04-18T21:05:25.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4761999999999999e-05 2024-04-18T21:05:25.727 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:25.727 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:25.727 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:25.727 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.727 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:25.727 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:05:25.727 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.031429804999998, 2024-04-18T21:05:25.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014162065, 2024-04-18T21:05:25.728 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:25.728 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:25.728 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:25.728 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:25.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.728 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:25.728 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:05:25.728 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:25.728 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.728 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:25.728 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:05:25.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:25.729 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.729 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:25.729 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621900+0000", 2024-04-18T21:05:25.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:05:25.729 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.729 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:25.729 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621910+0000", 2024-04-18T21:05:25.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0207000000000001e-05 2024-04-18T21:05:25.729 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.730 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:25.730 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621932+0000", 2024-04-18T21:05:25.730 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1789000000000001e-05 2024-04-18T21:05:25.730 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.730 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:25.730 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621946+0000", 2024-04-18T21:05:25.730 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4212999999999999e-05 2024-04-18T21:05:25.730 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.730 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:25.731 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624477+0000", 2024-04-18T21:05:25.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025303470000000001 2024-04-18T21:05:25.731 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.731 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.731 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:25.731 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624525+0000", 2024-04-18T21:05:25.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8084999999999998e-05 2024-04-18T21:05:25.731 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.731 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.731 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:25.731 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635976+0000", 2024-04-18T21:05:25.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.011451368999999999 2024-04-18T21:05:25.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.732 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:25.732 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636061+0000", 2024-04-18T21:05:25.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5094999999999998e-05 2024-04-18T21:05:25.732 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:25.732 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:25.732 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:25.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.732 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:05:25.733 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:05:25.733 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.02219418, 2024-04-18T21:05:25.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0098014739999999993, 2024-04-18T21:05:25.733 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:25.733 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:25.733 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:05:25.733 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:25.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:25.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:05:25.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:25.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.734 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:25.734 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:05:25.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:25.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.734 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:25.734 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631136+0000", 2024-04-18T21:05:25.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0139999999999999e-06 2024-04-18T21:05:25.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.734 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:25.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631152+0000", 2024-04-18T21:05:25.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6365999999999999e-05 2024-04-18T21:05:25.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:25.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631961+0000", 2024-04-18T21:05:25.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00080873100000000003 2024-04-18T21:05:25.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:25.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632021+0000", 2024-04-18T21:05:25.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0541999999999997e-05 2024-04-18T21:05:25.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.736 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:25.736 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633539+0000", 2024-04-18T21:05:25.736 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015175639999999999 2024-04-18T21:05:25.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.736 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:25.736 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640936+0000", 2024-04-18T21:05:25.736 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007397257 2024-04-18T21:05:25.736 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:25.736 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:25.736 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:25.737 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.737 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-18T21:05:25.737 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:05:25.737 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.004732746999998, 2024-04-18T21:05:25.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00073592199999999997, 2024-04-18T21:05:25.737 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:25.737 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:25.737 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:25.737 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:25.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.737 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:25.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:05:25.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:25.738 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.738 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.738 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:25.738 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:05:25.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:25.738 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.738 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.738 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:25.738 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648597+0000", 2024-04-18T21:05:25.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:05:25.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:25.739 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648605+0000", 2024-04-18T21:05:25.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3960000000000006e-06 2024-04-18T21:05:25.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:25.739 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648625+0000", 2024-04-18T21:05:25.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9987e-05 2024-04-18T21:05:25.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:25.740 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648643+0000", 2024-04-18T21:05:25.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7079e-05 2024-04-18T21:05:25.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.740 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:25.740 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649043+0000", 2024-04-18T21:05:25.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040083399999999998 2024-04-18T21:05:25.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.740 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:25.740 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649062+0000", 2024-04-18T21:05:25.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9052999999999999e-05 2024-04-18T21:05:25.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:25.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649332+0000", 2024-04-18T21:05:25.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026971999999999999 2024-04-18T21:05:25.741 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:25.741 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:25.741 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:25.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.741 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-18T21:05:25.741 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.651309+0000", 2024-04-18T21:05:25.741 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.002019908000001, 2024-04-18T21:05:25.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00068160699999999998, 2024-04-18T21:05:25.742 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:25.742 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:25.742 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:25.742 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:25.742 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.742 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:25.742 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651309+0000", 2024-04-18T21:05:25.742 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:25.742 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.742 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.742 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:25.742 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651309+0000", 2024-04-18T21:05:25.742 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:25.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:25.743 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651310+0000", 2024-04-18T21:05:25.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0160000000000001e-06 2024-04-18T21:05:25.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:25.743 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651316+0000", 2024-04-18T21:05:25.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4069999999999998e-06 2024-04-18T21:05:25.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:25.743 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651334+0000", 2024-04-18T21:05:25.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7186000000000001e-05 2024-04-18T21:05:25.744 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.744 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.744 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:25.744 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651350+0000", 2024-04-18T21:05:25.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.668e-05 2024-04-18T21:05:25.744 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.744 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.744 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:25.744 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651754+0000", 2024-04-18T21:05:25.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040365399999999998 2024-04-18T21:05:25.744 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.744 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.744 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:25.745 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651771+0000", 2024-04-18T21:05:25.745 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7059e-05 2024-04-18T21:05:25.745 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.745 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.745 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:25.745 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651991+0000", 2024-04-18T21:05:25.745 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000219605 2024-04-18T21:05:25.745 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:25.745 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:25.745 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:25.745 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.745 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.745 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:05:25.745 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:05:25.746 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.001957846, 2024-04-18T21:05:25.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00086123999999999999, 2024-04-18T21:05:25.746 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:25.746 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:25.746 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:05:25.746 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:25.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:25.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:05:25.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:25.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:25.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:05:25.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:25.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:25.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651372+0000", 2024-04-18T21:05:25.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7599999999999997e-07 2024-04-18T21:05:25.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:25.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651377+0000", 2024-04-18T21:05:25.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.22e-06 2024-04-18T21:05:25.748 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.748 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:25.748 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651394+0000", 2024-04-18T21:05:25.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6646999999999998e-05 2024-04-18T21:05:25.748 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.748 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:25.748 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651427+0000", 2024-04-18T21:05:25.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3682e-05 2024-04-18T21:05:25.748 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.749 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:25.749 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652029+0000", 2024-04-18T21:05:25.749 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00060152199999999995 2024-04-18T21:05:25.749 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.749 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.749 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:25.749 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652232+0000", 2024-04-18T21:05:25.749 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020359299999999999 2024-04-18T21:05:25.749 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:25.749 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:25.749 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:25.750 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.750 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.750 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:05:25.750 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:05:25.750 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 19.993930884000001, 2024-04-18T21:05:25.750 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0017426200000000001, 2024-04-18T21:05:25.750 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:25.750 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:25.750 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:25.750 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:25.750 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:25.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:05:25.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:25.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:25.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:05:25.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:25.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:25.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659399+0000", 2024-04-18T21:05:25.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6000000000000002e-07 2024-04-18T21:05:25.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.752 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:25.752 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659405+0000", 2024-04-18T21:05:25.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5069999999999997e-06 2024-04-18T21:05:25.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.752 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:25.752 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659425+0000", 2024-04-18T21:05:25.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.927e-05 2024-04-18T21:05:25.753 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.753 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:25.753 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659443+0000", 2024-04-18T21:05:25.753 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8051999999999999e-05 2024-04-18T21:05:25.753 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.753 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:25.753 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660973+0000", 2024-04-18T21:05:25.753 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001530106 2024-04-18T21:05:25.753 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.754 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.754 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:25.754 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660983+0000", 2024-04-18T21:05:25.754 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0516999999999999e-05 2024-04-18T21:05:25.754 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.754 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.754 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:25.754 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661141+0000", 2024-04-18T21:05:25.754 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015730799999999999 2024-04-18T21:05:25.754 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:25.755 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:25.755 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:25.755 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.755 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.755 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:05:25.755 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:05:25.755 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 19.993714259000001, 2024-04-18T21:05:25.755 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001812311, 2024-04-18T21:05:25.755 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:25.755 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:25.755 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:25.755 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:25.755 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.756 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:25.756 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:05:25.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:25.756 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.756 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:25.756 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:05:25.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:25.756 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.757 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:25.757 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659616+0000", 2024-04-18T21:05:25.757 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.277e-06 2024-04-18T21:05:25.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.757 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.757 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:25.757 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659625+0000", 2024-04-18T21:05:25.757 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5359999999999998e-06 2024-04-18T21:05:25.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.757 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.757 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:25.757 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659647+0000", 2024-04-18T21:05:25.758 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1857000000000001e-05 2024-04-18T21:05:25.758 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.758 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.758 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:25.758 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659664+0000", 2024-04-18T21:05:25.758 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6405999999999998e-05 2024-04-18T21:05:25.758 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.758 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.758 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:25.758 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661169+0000", 2024-04-18T21:05:25.758 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015054179999999999 2024-04-18T21:05:25.759 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.759 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:25.759 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661177+0000", 2024-04-18T21:05:25.759 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9680000000000006e-06 2024-04-18T21:05:25.759 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.759 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:25.759 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661427+0000", 2024-04-18T21:05:25.759 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024984900000000001 2024-04-18T21:05:25.759 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:25.760 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:25.760 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:25.760 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.760 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.760 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-18T21:05:25.760 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:05:25.760 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.040793651000001, 2024-04-18T21:05:25.760 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0030975030000000001, 2024-04-18T21:05:25.760 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:25.760 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:25.760 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:25.760 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:25.761 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.761 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:25.761 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:05:25.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:25.761 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.761 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.761 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:25.761 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:05:25.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:25.761 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.761 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.761 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:25.761 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612538+0000", 2024-04-18T21:05:25.762 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6259999999999999e-06 2024-04-18T21:05:25.762 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.762 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.762 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:25.762 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612552+0000", 2024-04-18T21:05:25.762 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4073999999999999e-05 2024-04-18T21:05:25.762 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.762 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.762 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:25.762 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612585+0000", 2024-04-18T21:05:25.762 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3504999999999999e-05 2024-04-18T21:05:25.762 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.762 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.763 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:25.763 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612601+0000", 2024-04-18T21:05:25.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5194000000000001e-05 2024-04-18T21:05:25.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.763 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:25.763 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612746+0000", 2024-04-18T21:05:25.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145666 2024-04-18T21:05:25.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.763 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:25.763 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612953+0000", 2024-04-18T21:05:25.764 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000207109 2024-04-18T21:05:25.764 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.764 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.764 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:25.764 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.613134+0000", 2024-04-18T21:05:25.764 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018041300000000001 2024-04-18T21:05:25.764 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.764 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.764 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:25.764 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.614411+0000", 2024-04-18T21:05:25.764 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0012769929999999999 2024-04-18T21:05:25.764 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.764 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.765 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:25.765 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615441+0000", 2024-04-18T21:05:25.765 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001029917 2024-04-18T21:05:25.765 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.765 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.765 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:25.765 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615522+0000", 2024-04-18T21:05:25.765 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1142000000000003e-05 2024-04-18T21:05:25.765 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:25.766 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:25.766 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:25.766 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615633+0000", 2024-04-18T21:05:25.766 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000110864 2024-04-18T21:05:25.766 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:25.766 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:25.766 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:25.766 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:25.766 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:25.766 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:05:25.767 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:05:25.768 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:25.767+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:25.769 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:05:25.868 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:25.867+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:25.900 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:05:25.900 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:05:25.901 INFO:teuthology.orchestra.run.smithi132.stdout: "num_ops": 0 2024-04-18T21:05:25.901 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:05:25.914 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:05:25.927 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:05:25.927 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:05:25.949 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1: {} 2024-04-18T21:05:25.949 INFO:teuthology.orchestra.run.smithi078.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:05:25.969 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:25.967+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:25.971 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:05:25.972 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:05:26.029 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:26.029 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:26.043 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:05:26.070 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:26.071+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:26.170 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:26.171+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:26.205 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:26.205 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:26.218 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:05:26.271 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:26.271+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:26.352 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:26.352 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:26.366 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:05:26.409 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:26.411+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:26.456 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-18T21:05:26.456 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-18T21:05:26.456 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-18T21:05:26.456 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-18T21:05:26.473 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:26.475+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:26.530 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:26.530 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:26.544 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:05:26.589 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:26.591+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:26.624 INFO:teuthology.orchestra.run.smithi078.stderr:no valid command found; 10 closest matches: 2024-04-18T21:05:26.624 INFO:teuthology.orchestra.run.smithi078.stderr:0 2024-04-18T21:05:26.624 INFO:teuthology.orchestra.run.smithi078.stderr:1 2024-04-18T21:05:26.625 INFO:teuthology.orchestra.run.smithi078.stderr:2 2024-04-18T21:05:26.625 INFO:teuthology.orchestra.run.smithi078.stderr:abort 2024-04-18T21:05:26.625 INFO:teuthology.orchestra.run.smithi078.stderr:assert 2024-04-18T21:05:26.625 INFO:teuthology.orchestra.run.smithi078.stderr:bench [] [] [] [] 2024-04-18T21:05:26.625 INFO:teuthology.orchestra.run.smithi078.stderr:bluefs debug_inject_read_zeros 2024-04-18T21:05:26.625 INFO:teuthology.orchestra.run.smithi078.stderr:bluefs files list 2024-04-18T21:05:26.625 INFO:teuthology.orchestra.run.smithi078.stderr:bluefs stats 2024-04-18T21:05:26.625 INFO:teuthology.orchestra.run.smithi078.stderr:bluestore allocator dump block 2024-04-18T21:05:26.625 INFO:teuthology.orchestra.run.smithi078.stderr:Error EINVAL: invalid command 2024-04-18T21:05:26.627 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-18T21:05:26.627 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-18T21:05:26.628 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-18T21:05:26.675 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:26.675+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:26.713 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:26.713 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:26.726 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:05:26.776 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:26.775+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:26.777 INFO:teuthology.orchestra.run.smithi078.stderr:no valid command found; 10 closest matches: 2024-04-18T21:05:26.777 INFO:teuthology.orchestra.run.smithi078.stderr:0 2024-04-18T21:05:26.777 INFO:teuthology.orchestra.run.smithi078.stderr:1 2024-04-18T21:05:26.777 INFO:teuthology.orchestra.run.smithi078.stderr:2 2024-04-18T21:05:26.777 INFO:teuthology.orchestra.run.smithi078.stderr:abort 2024-04-18T21:05:26.777 INFO:teuthology.orchestra.run.smithi078.stderr:assert 2024-04-18T21:05:26.778 INFO:teuthology.orchestra.run.smithi078.stderr:bench [] [] [] [] 2024-04-18T21:05:26.778 INFO:teuthology.orchestra.run.smithi078.stderr:bluefs debug_inject_read_zeros 2024-04-18T21:05:26.778 INFO:teuthology.orchestra.run.smithi078.stderr:bluefs files list 2024-04-18T21:05:26.778 INFO:teuthology.orchestra.run.smithi078.stderr:bluefs stats 2024-04-18T21:05:26.778 INFO:teuthology.orchestra.run.smithi078.stderr:bluestore allocator dump block 2024-04-18T21:05:26.778 INFO:teuthology.orchestra.run.smithi078.stderr:Error EINVAL: invalid command 2024-04-18T21:05:26.780 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-18T21:05:26.780 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-18T21:05:26.780 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-18T21:05:26.790 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-18T21:05:26.858 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:26.858 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:26.872 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:05:26.877 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:26.879+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:26.928 INFO:teuthology.orchestra.run.smithi078.stderr:no valid command found; 10 closest matches: 2024-04-18T21:05:26.928 INFO:teuthology.orchestra.run.smithi078.stderr:0 2024-04-18T21:05:26.928 INFO:teuthology.orchestra.run.smithi078.stderr:1 2024-04-18T21:05:26.928 INFO:teuthology.orchestra.run.smithi078.stderr:2 2024-04-18T21:05:26.928 INFO:teuthology.orchestra.run.smithi078.stderr:abort 2024-04-18T21:05:26.928 INFO:teuthology.orchestra.run.smithi078.stderr:assert 2024-04-18T21:05:26.928 INFO:teuthology.orchestra.run.smithi078.stderr:bench [] [] [] [] 2024-04-18T21:05:26.928 INFO:teuthology.orchestra.run.smithi078.stderr:bluefs debug_inject_read_zeros 2024-04-18T21:05:26.928 INFO:teuthology.orchestra.run.smithi078.stderr:bluefs files list 2024-04-18T21:05:26.928 INFO:teuthology.orchestra.run.smithi078.stderr:bluefs stats 2024-04-18T21:05:26.928 INFO:teuthology.orchestra.run.smithi078.stderr:bluestore allocator dump block 2024-04-18T21:05:26.928 INFO:teuthology.orchestra.run.smithi078.stderr:Error EINVAL: invalid command 2024-04-18T21:05:26.930 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-18T21:05:26.931 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-18T21:05:26.978 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:26.979+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:26.993 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:26.993 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:27.007 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:05:27.079 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:27.079+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:27.122 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:27.122 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:27.136 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:05:27.180 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:27.179+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:27.267 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:27.267 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:27.281 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:05:27.281 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:27.279+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:27.382 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:27.383+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:27.400 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:27.401 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:27.415 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:05:27.482 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:27.483+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:27.534 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:27.534 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:27.548 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:05:27.593 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:27.595+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:27.679 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:27.679 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:27.685 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:27.687+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:27.693 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:05:27.781 INFO:teuthology.orchestra.run.smithi078.stderr:noscrub is unset 2024-04-18T21:05:27.785 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:27.783+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:27.860 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:27.860 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:27.874 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:05:27.886 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:27.887+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:27.987 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:27.987+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:27.990 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:05:27.997 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:27.997 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:28.011 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:05:28.088 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:28.087+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:28.144 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:28.144 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:28.145 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:05:28.146 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:05:28.159 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:05:28.166 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1: {} 2024-04-18T21:05:28.167 INFO:teuthology.orchestra.run.smithi078.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:05:28.187 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:05:28.187 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:05:28.189 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:28.187+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:28.281 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:05:28.281 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:05:28.281 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-18T21:05:28.281 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-18T21:05:28.281 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:05:28.291 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:28.291+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:28.295 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:05:28.392 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:28.391+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:28.412 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:05:28.412 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-18T21:05:28.412 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-18T21:05:28.412 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:05:28.412 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.412 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:28.412 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:05:28.412 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.798144190999999, 2024-04-18T21:05:28.412 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.034065303999999998, 2024-04-18T21:05:28.413 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:28.413 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:28.413 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:28.413 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:28.413 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.413 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:28.413 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:05:28.413 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:28.413 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.413 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.413 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:28.413 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:05:28.413 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:28.413 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.413 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.414 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:28.414 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615254+0000", 2024-04-18T21:05:28.414 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7829999999999999e-06 2024-04-18T21:05:28.414 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.414 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.414 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:28.414 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615267+0000", 2024-04-18T21:05:28.414 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3334e-05 2024-04-18T21:05:28.414 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.414 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.414 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:28.414 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615294+0000", 2024-04-18T21:05:28.414 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7271999999999999e-05 2024-04-18T21:05:28.414 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.414 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.415 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.415 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615321+0000", 2024-04-18T21:05:28.415 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.637e-05 2024-04-18T21:05:28.415 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.415 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.415 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:28.415 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615479+0000", 2024-04-18T21:05:28.415 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000158493 2024-04-18T21:05:28.415 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.415 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.415 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:28.415 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615498+0000", 2024-04-18T21:05:28.415 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9148999999999999e-05 2024-04-18T21:05:28.415 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.416 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.416 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:28.416 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632915+0000", 2024-04-18T21:05:28.416 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.017416551999999998 2024-04-18T21:05:28.416 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.416 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.416 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:28.416 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633302+0000", 2024-04-18T21:05:28.416 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00038725000000000001 2024-04-18T21:05:28.416 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.416 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.416 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:28.416 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633638+0000", 2024-04-18T21:05:28.416 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000335946 2024-04-18T21:05:28.416 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.417 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.417 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:28.417 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645976+0000", 2024-04-18T21:05:28.417 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012337617 2024-04-18T21:05:28.417 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.417 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.417 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:28.417 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649080+0000", 2024-04-18T21:05:28.417 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031038929999999999 2024-04-18T21:05:28.417 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.417 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.417 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:28.417 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649207+0000", 2024-04-18T21:05:28.417 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000127537 2024-04-18T21:05:28.418 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.418 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.418 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:28.418 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649316+0000", 2024-04-18T21:05:28.418 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109108 2024-04-18T21:05:28.418 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:28.418 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:28.418 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:28.418 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.418 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.418 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:28.418 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:05:28.418 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.798010814000001, 2024-04-18T21:05:28.418 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036275764000000002, 2024-04-18T21:05:28.419 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:28.419 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:28.419 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:28.419 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:28.419 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.419 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:28.419 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:05:28.419 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:28.419 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.419 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.419 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:28.419 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:05:28.419 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:28.419 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.419 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.420 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:28.420 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615386+0000", 2024-04-18T21:05:28.420 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.573e-06 2024-04-18T21:05:28.420 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.420 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.420 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:28.420 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:05:28.420 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0723999999999999e-05 2024-04-18T21:05:28.420 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.420 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.420 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:28.420 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615418+0000", 2024-04-18T21:05:28.420 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0902000000000001e-05 2024-04-18T21:05:28.420 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.420 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.421 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.421 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615433+0000", 2024-04-18T21:05:28.421 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5319999999999999e-05 2024-04-18T21:05:28.421 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.421 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.421 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:28.421 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615659+0000", 2024-04-18T21:05:28.421 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000226095 2024-04-18T21:05:28.421 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.421 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.421 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:28.421 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:28.421 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1276e-05 2024-04-18T21:05:28.421 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.421 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.422 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:28.422 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643654+0000", 2024-04-18T21:05:28.422 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027983238000000001 2024-04-18T21:05:28.422 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.422 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.422 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:28.422 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643868+0000", 2024-04-18T21:05:28.422 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000214305 2024-04-18T21:05:28.422 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.422 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.422 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:28.422 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:05:28.422 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035892200000000002 2024-04-18T21:05:28.422 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.422 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.423 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:28.423 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646056+0000", 2024-04-18T21:05:28.423 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001829172 2024-04-18T21:05:28.423 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.423 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.423 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:28.423 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651406+0000", 2024-04-18T21:05:28.423 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0053504800000000003 2024-04-18T21:05:28.423 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.423 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.423 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:28.423 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651551+0000", 2024-04-18T21:05:28.423 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014427999999999999 2024-04-18T21:05:28.423 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.423 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.424 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:28.424 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651660+0000", 2024-04-18T21:05:28.424 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109477 2024-04-18T21:05:28.424 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:28.424 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:28.424 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:28.424 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.424 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.424 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:28.424 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:05:28.424 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.797937432000001, 2024-04-18T21:05:28.424 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045668994999999997, 2024-04-18T21:05:28.424 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:28.424 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:28.425 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:28.425 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:28.425 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.425 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:28.425 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:05:28.425 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:28.425 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.425 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.425 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:28.425 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:05:28.425 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:28.425 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.425 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.425 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:28.425 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615459+0000", 2024-04-18T21:05:28.426 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5030000000000001e-06 2024-04-18T21:05:28.426 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.426 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.426 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:28.426 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615506+0000", 2024-04-18T21:05:28.426 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6872000000000001e-05 2024-04-18T21:05:28.426 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.426 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.426 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:28.426 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615527+0000", 2024-04-18T21:05:28.426 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0763000000000001e-05 2024-04-18T21:05:28.426 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.426 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.426 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.427 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615551+0000", 2024-04-18T21:05:28.427 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4159e-05 2024-04-18T21:05:28.427 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.427 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.427 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:28.427 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615736+0000", 2024-04-18T21:05:28.427 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018499599999999999 2024-04-18T21:05:28.427 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.427 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.427 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:28.427 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615748+0000", 2024-04-18T21:05:28.427 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2272999999999999e-05 2024-04-18T21:05:28.427 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.427 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.428 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:28.428 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635481+0000", 2024-04-18T21:05:28.428 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019732772999999999 2024-04-18T21:05:28.428 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.428 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.428 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:28.428 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635791+0000", 2024-04-18T21:05:28.428 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031013299999999998 2024-04-18T21:05:28.428 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.428 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.428 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:28.428 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636101+0000", 2024-04-18T21:05:28.428 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030943300000000002 2024-04-18T21:05:28.428 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.429 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.429 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:28.429 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646043+0000", 2024-04-18T21:05:28.429 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099428139999999995 2024-04-18T21:05:28.429 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.429 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.429 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:28.429 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660991+0000", 2024-04-18T21:05:28.429 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014947142 2024-04-18T21:05:28.429 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.429 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.429 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:28.429 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661061+0000", 2024-04-18T21:05:28.429 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0438000000000006e-05 2024-04-18T21:05:28.429 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.429 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.430 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:28.430 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661127+0000", 2024-04-18T21:05:28.430 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5696000000000003e-05 2024-04-18T21:05:28.430 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:28.430 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:28.430 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:28.430 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.430 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.430 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:28.430 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:28.430 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.797725004, 2024-04-18T21:05:28.430 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045745085999999997, 2024-04-18T21:05:28.430 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:28.430 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:28.431 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:28.431 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:28.431 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.431 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:28.431 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:28.431 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:28.431 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.431 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.431 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:28.431 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:28.431 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:28.431 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.431 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.431 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:28.431 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:05:28.431 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7400000000000001e-06 2024-04-18T21:05:28.432 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.432 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.432 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:28.432 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:05:28.432 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8133e-05 2024-04-18T21:05:28.432 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.432 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.432 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:28.432 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615726+0000", 2024-04-18T21:05:28.432 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6132e-05 2024-04-18T21:05:28.432 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.432 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.432 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.432 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615742+0000", 2024-04-18T21:05:28.432 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6157000000000001e-05 2024-04-18T21:05:28.433 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.433 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.433 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:28.433 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615937+0000", 2024-04-18T21:05:28.433 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000194768 2024-04-18T21:05:28.433 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.433 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.433 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:28.433 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615950+0000", 2024-04-18T21:05:28.433 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3084e-05 2024-04-18T21:05:28.433 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.433 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.433 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:28.433 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643676+0000", 2024-04-18T21:05:28.433 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027725639999999999 2024-04-18T21:05:28.434 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.434 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.434 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:28.434 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643867+0000", 2024-04-18T21:05:28.434 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019075900000000001 2024-04-18T21:05:28.434 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.434 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.434 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:28.434 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:05:28.434 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036013799999999997 2024-04-18T21:05:28.434 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.434 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.434 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:28.434 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646068+0000", 2024-04-18T21:05:28.434 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001841536 2024-04-18T21:05:28.435 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.435 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.435 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:28.435 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661184+0000", 2024-04-18T21:05:28.435 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015115458999999999 2024-04-18T21:05:28.435 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.435 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.435 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:28.435 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661283+0000", 2024-04-18T21:05:28.435 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9502999999999999e-05 2024-04-18T21:05:28.435 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.435 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.435 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:28.435 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661415+0000", 2024-04-18T21:05:28.435 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000132037 2024-04-18T21:05:28.436 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:28.436 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:28.436 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:28.436 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.436 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.436 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:28.436 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:05:28.436 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.797603317, 2024-04-18T21:05:28.436 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036185947000000003, 2024-04-18T21:05:28.436 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:28.436 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:28.436 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:28.436 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:28.436 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.436 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:28.437 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:05:28.437 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:28.437 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.437 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.437 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:28.437 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:05:28.437 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:28.437 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.437 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.437 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:28.437 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615794+0000", 2024-04-18T21:05:28.437 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6440000000000001e-06 2024-04-18T21:05:28.437 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.437 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.437 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:28.438 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615803+0000", 2024-04-18T21:05:28.438 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1220000000000001e-06 2024-04-18T21:05:28.438 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.438 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.438 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:28.438 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615827+0000", 2024-04-18T21:05:28.438 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3997000000000001e-05 2024-04-18T21:05:28.438 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.438 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.438 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.438 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615899+0000", 2024-04-18T21:05:28.438 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2741e-05 2024-04-18T21:05:28.438 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.438 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.439 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:28.439 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616019+0000", 2024-04-18T21:05:28.439 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119874 2024-04-18T21:05:28.439 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.439 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.439 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:28.439 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616029+0000", 2024-04-18T21:05:28.439 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:05:28.439 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.439 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.439 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:28.439 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644823+0000", 2024-04-18T21:05:28.439 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.028793151999999999 2024-04-18T21:05:28.439 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.439 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.439 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:28.440 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645106+0000", 2024-04-18T21:05:28.440 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028379700000000002 2024-04-18T21:05:28.440 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.440 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.440 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:28.440 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645294+0000", 2024-04-18T21:05:28.440 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000187181 2024-04-18T21:05:28.440 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.440 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.440 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:28.440 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646763+0000", 2024-04-18T21:05:28.440 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0014691050000000001 2024-04-18T21:05:28.440 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.440 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.440 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:28.440 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651784+0000", 2024-04-18T21:05:28.441 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050211650000000002 2024-04-18T21:05:28.441 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.441 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.441 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:28.441 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651876+0000", 2024-04-18T21:05:28.441 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2503999999999994e-05 2024-04-18T21:05:28.441 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.441 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.441 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:28.441 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651978+0000", 2024-04-18T21:05:28.441 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000101475 2024-04-18T21:05:28.441 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:28.441 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:28.441 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:28.441 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.441 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.442 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:28.442 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:28.442 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.79745471, 2024-04-18T21:05:28.442 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032262322000000003, 2024-04-18T21:05:28.442 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:28.442 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:28.442 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:28.442 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:28.442 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.442 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:28.442 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:28.442 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:28.442 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.442 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.443 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:28.443 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:28.443 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:28.443 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.443 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.443 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:28.443 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615943+0000", 2024-04-18T21:05:28.443 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1959999999999998e-06 2024-04-18T21:05:28.443 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.443 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.443 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:28.443 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615956+0000", 2024-04-18T21:05:28.443 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3424000000000001e-05 2024-04-18T21:05:28.443 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.443 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.444 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:28.444 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615983+0000", 2024-04-18T21:05:28.444 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7072000000000001e-05 2024-04-18T21:05:28.444 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.444 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.444 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.444 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616006+0000", 2024-04-18T21:05:28.444 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2823000000000002e-05 2024-04-18T21:05:28.444 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.444 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.444 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:28.444 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616156+0000", 2024-04-18T21:05:28.444 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014962299999999999 2024-04-18T21:05:28.444 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.444 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.444 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:28.445 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616174+0000", 2024-04-18T21:05:28.445 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8082999999999999e-05 2024-04-18T21:05:28.445 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.445 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.445 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:28.445 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.629952+0000", 2024-04-18T21:05:28.445 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013778514 2024-04-18T21:05:28.445 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.445 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.445 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:28.445 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630201+0000", 2024-04-18T21:05:28.445 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024918100000000001 2024-04-18T21:05:28.445 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.445 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.445 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:28.446 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630386+0000", 2024-04-18T21:05:28.446 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018436900000000001 2024-04-18T21:05:28.446 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.446 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.446 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:28.446 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643169+0000", 2024-04-18T21:05:28.446 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012782774 2024-04-18T21:05:28.446 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.446 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.446 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:28.446 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.647924+0000", 2024-04-18T21:05:28.446 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004755787 2024-04-18T21:05:28.446 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.446 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.446 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:28.447 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648069+0000", 2024-04-18T21:05:28.447 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014459600000000001 2024-04-18T21:05:28.447 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.447 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.447 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:28.447 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648203+0000", 2024-04-18T21:05:28.447 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013388000000000001 2024-04-18T21:05:28.447 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:28.447 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:28.447 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:28.447 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.447 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.447 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:28.447 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:05:28.447 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.797346445999999, 2024-04-18T21:05:28.448 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032489736999999998, 2024-04-18T21:05:28.448 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:28.448 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:28.448 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:28.448 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:28.448 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.448 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:28.448 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:05:28.448 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:28.448 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.448 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.448 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:28.448 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:05:28.448 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:28.448 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.448 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.449 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:28.449 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616050+0000", 2024-04-18T21:05:28.449 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.606e-06 2024-04-18T21:05:28.449 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.449 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.449 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:28.449 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616061+0000", 2024-04-18T21:05:28.449 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0463e-05 2024-04-18T21:05:28.449 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.449 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.449 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:28.449 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616092+0000", 2024-04-18T21:05:28.449 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1415999999999999e-05 2024-04-18T21:05:28.449 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.449 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.450 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.450 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616109+0000", 2024-04-18T21:05:28.450 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6557000000000001e-05 2024-04-18T21:05:28.450 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.450 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.450 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:28.450 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616358+0000", 2024-04-18T21:05:28.450 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000249077 2024-04-18T21:05:28.450 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.450 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.450 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:28.450 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616370+0000", 2024-04-18T21:05:28.450 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2037e-05 2024-04-18T21:05:28.450 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.451 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.451 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:28.451 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.634920+0000", 2024-04-18T21:05:28.451 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018550397 2024-04-18T21:05:28.451 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.451 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.451 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:28.451 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640420+0000", 2024-04-18T21:05:28.451 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055000539999999999 2024-04-18T21:05:28.451 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.451 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.451 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:28.451 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648538+0000", 2024-04-18T21:05:28.451 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0081181299999999994 2024-04-18T21:05:28.451 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:28.452 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:28.452 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:28.452 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.452 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.452 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:28.452 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:05:28.452 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.797262125, 2024-04-18T21:05:28.452 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036090029000000003, 2024-04-18T21:05:28.452 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:28.452 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:28.452 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:28.452 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:28.452 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.452 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:28.452 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:05:28.452 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:28.453 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.453 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.453 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:28.453 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:05:28.453 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:28.453 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.453 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.453 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:28.453 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616134+0000", 2024-04-18T21:05:28.453 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.353e-06 2024-04-18T21:05:28.453 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.453 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.453 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:28.453 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616141+0000", 2024-04-18T21:05:28.453 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2770000000000002e-06 2024-04-18T21:05:28.453 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.454 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.454 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:28.454 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616160+0000", 2024-04-18T21:05:28.454 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.91e-05 2024-04-18T21:05:28.454 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.454 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.454 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.454 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616170+0000", 2024-04-18T21:05:28.454 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7699999999999996e-06 2024-04-18T21:05:28.454 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.454 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.454 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:28.454 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616275+0000", 2024-04-18T21:05:28.454 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105313 2024-04-18T21:05:28.454 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.455 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.455 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:28.455 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616288+0000", 2024-04-18T21:05:28.455 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3027000000000001e-05 2024-04-18T21:05:28.455 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.455 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.455 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:28.455 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646160+0000", 2024-04-18T21:05:28.455 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.029872019 2024-04-18T21:05:28.455 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.455 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.455 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:28.455 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646368+0000", 2024-04-18T21:05:28.455 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020811899999999999 2024-04-18T21:05:28.455 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.456 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.456 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:28.456 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652223+0000", 2024-04-18T21:05:28.456 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.005855051 2024-04-18T21:05:28.456 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:28.456 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:28.456 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:28.456 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.456 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.456 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:28.456 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:05:28.456 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.797204556000001, 2024-04-18T21:05:28.456 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043572403000000003, 2024-04-18T21:05:28.456 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:28.456 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:28.456 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:28.457 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:28.457 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.457 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:28.457 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:05:28.457 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:28.457 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.457 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.457 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:28.457 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:05:28.457 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:28.457 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.457 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.457 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:28.457 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616192+0000", 2024-04-18T21:05:28.457 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:05:28.458 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.458 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.458 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:28.458 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616203+0000", 2024-04-18T21:05:28.458 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0890000000000001e-05 2024-04-18T21:05:28.458 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.458 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.458 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:28.458 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616223+0000", 2024-04-18T21:05:28.458 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0409000000000001e-05 2024-04-18T21:05:28.458 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.458 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.458 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.458 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616238+0000", 2024-04-18T21:05:28.459 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5160000000000001e-05 2024-04-18T21:05:28.459 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.459 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.459 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:28.459 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616343+0000", 2024-04-18T21:05:28.459 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000104831 2024-04-18T21:05:28.459 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.459 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.459 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:28.459 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616357+0000", 2024-04-18T21:05:28.459 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3686000000000001e-05 2024-04-18T21:05:28.459 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.459 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.459 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:28.459 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635912+0000", 2024-04-18T21:05:28.460 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019554944000000001 2024-04-18T21:05:28.460 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.460 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.460 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:28.460 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636231+0000", 2024-04-18T21:05:28.460 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000318766 2024-04-18T21:05:28.460 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.460 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.460 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:28.460 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659763+0000", 2024-04-18T21:05:28.460 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023532474000000001 2024-04-18T21:05:28.460 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:28.460 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:28.460 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:28.460 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.460 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.461 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:28.461 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:05:28.461 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.793275849, 2024-04-18T21:05:28.461 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015007971, 2024-04-18T21:05:28.461 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:28.461 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:28.461 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:28.461 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:28.461 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.461 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:28.461 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:05:28.461 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:28.461 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.461 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.461 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:28.461 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:05:28.462 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:28.462 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.462 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.462 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:28.462 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620120+0000", 2024-04-18T21:05:28.462 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0359999999999999e-06 2024-04-18T21:05:28.462 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.462 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.462 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:28.462 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620157+0000", 2024-04-18T21:05:28.462 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6636e-05 2024-04-18T21:05:28.462 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.462 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.462 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:28.463 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620177+0000", 2024-04-18T21:05:28.463 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0247000000000001e-05 2024-04-18T21:05:28.463 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.463 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.463 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.463 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620195+0000", 2024-04-18T21:05:28.463 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7819e-05 2024-04-18T21:05:28.463 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.463 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.463 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:28.463 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620342+0000", 2024-04-18T21:05:28.463 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014643300000000001 2024-04-18T21:05:28.463 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.463 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.463 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:28.463 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620405+0000", 2024-04-18T21:05:28.464 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3522000000000006e-05 2024-04-18T21:05:28.464 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.464 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.464 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:28.464 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635016+0000", 2024-04-18T21:05:28.464 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014610840999999999 2024-04-18T21:05:28.464 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.464 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.464 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:28.464 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635127+0000", 2024-04-18T21:05:28.464 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111437 2024-04-18T21:05:28.464 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:28.464 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:28.464 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:28.464 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.465 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.465 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:28.465 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:05:28.465 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.793168581, 2024-04-18T21:05:28.465 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012693296, 2024-04-18T21:05:28.465 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:28.465 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:28.465 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:28.465 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:28.465 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.465 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:28.465 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:05:28.465 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:28.465 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.465 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.465 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:28.466 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:05:28.466 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:28.466 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.466 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.466 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:28.466 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620228+0000", 2024-04-18T21:05:28.466 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:05:28.466 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.466 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.466 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:28.466 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620236+0000", 2024-04-18T21:05:28.466 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.303e-06 2024-04-18T21:05:28.466 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.466 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.467 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:28.467 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620255+0000", 2024-04-18T21:05:28.467 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9406e-05 2024-04-18T21:05:28.467 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.467 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.467 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.467 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620274+0000", 2024-04-18T21:05:28.467 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8940000000000002e-05 2024-04-18T21:05:28.467 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.467 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.467 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:28.467 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:05:28.467 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001558753 2024-04-18T21:05:28.467 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.467 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.467 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:28.468 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621879+0000", 2024-04-18T21:05:28.468 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6359000000000001e-05 2024-04-18T21:05:28.468 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.468 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.468 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:28.468 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632841+0000", 2024-04-18T21:05:28.468 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010961907 2024-04-18T21:05:28.468 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.468 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.468 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:28.468 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632920+0000", 2024-04-18T21:05:28.468 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8714999999999994e-05 2024-04-18T21:05:28.468 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:28.468 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:28.468 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:28.469 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.469 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.469 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:28.469 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:05:28.469 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.791622818, 2024-04-18T21:05:28.469 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013445702, 2024-04-18T21:05:28.469 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:28.469 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:28.469 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:28.469 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:28.469 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.469 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:28.469 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:05:28.469 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:28.469 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.469 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.470 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:28.470 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:05:28.470 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:28.470 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.470 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.470 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:28.470 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621774+0000", 2024-04-18T21:05:28.470 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2500000000000001e-06 2024-04-18T21:05:28.470 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.470 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.470 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:28.470 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621786+0000", 2024-04-18T21:05:28.470 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2636000000000001e-05 2024-04-18T21:05:28.470 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.470 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.471 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:28.471 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621814+0000", 2024-04-18T21:05:28.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7823000000000001e-05 2024-04-18T21:05:28.471 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.471 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.471 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.471 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621844+0000", 2024-04-18T21:05:28.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9589000000000001e-05 2024-04-18T21:05:28.471 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.471 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.471 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:28.471 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622253+0000", 2024-04-18T21:05:28.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040963700000000002 2024-04-18T21:05:28.471 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.471 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.471 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:28.472 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622304+0000", 2024-04-18T21:05:28.472 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0868999999999997e-05 2024-04-18T21:05:28.472 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.472 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.472 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:28.472 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635133+0000", 2024-04-18T21:05:28.472 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012829136 2024-04-18T21:05:28.472 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.472 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.472 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:28.472 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635218+0000", 2024-04-18T21:05:28.472 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4761999999999999e-05 2024-04-18T21:05:28.472 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:28.472 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:28.472 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:28.473 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.473 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:28.473 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:05:28.473 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.791496058, 2024-04-18T21:05:28.473 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014162065, 2024-04-18T21:05:28.473 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:28.473 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:28.473 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:28.473 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:28.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.473 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:28.473 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:05:28.473 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:28.473 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.474 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.474 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:28.474 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:05:28.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:28.474 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.474 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.474 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:28.474 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621900+0000", 2024-04-18T21:05:28.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:05:28.474 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.474 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.474 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:28.474 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621910+0000", 2024-04-18T21:05:28.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0207000000000001e-05 2024-04-18T21:05:28.474 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.474 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.475 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:28.475 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621932+0000", 2024-04-18T21:05:28.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1789000000000001e-05 2024-04-18T21:05:28.475 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.475 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.475 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621946+0000", 2024-04-18T21:05:28.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4212999999999999e-05 2024-04-18T21:05:28.475 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.475 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:28.475 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624477+0000", 2024-04-18T21:05:28.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025303470000000001 2024-04-18T21:05:28.475 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.475 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:28.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624525+0000", 2024-04-18T21:05:28.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8084999999999998e-05 2024-04-18T21:05:28.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:28.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635976+0000", 2024-04-18T21:05:28.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.011451368999999999 2024-04-18T21:05:28.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:28.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636061+0000", 2024-04-18T21:05:28.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5094999999999998e-05 2024-04-18T21:05:28.476 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:28.476 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:28.476 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:28.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.477 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.477 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:05:28.477 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:05:28.477 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.782260433000001, 2024-04-18T21:05:28.477 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0098014739999999993, 2024-04-18T21:05:28.477 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:28.477 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:28.477 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:05:28.477 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:28.477 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.477 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:28.477 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:05:28.477 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:28.477 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.477 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.478 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:28.478 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:05:28.478 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:28.478 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.478 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.478 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:28.478 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631136+0000", 2024-04-18T21:05:28.478 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0139999999999999e-06 2024-04-18T21:05:28.478 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.478 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.478 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:28.478 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631152+0000", 2024-04-18T21:05:28.478 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6365999999999999e-05 2024-04-18T21:05:28.478 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.479 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.479 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:28.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631961+0000", 2024-04-18T21:05:28.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00080873100000000003 2024-04-18T21:05:28.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.479 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.479 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632021+0000", 2024-04-18T21:05:28.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0541999999999997e-05 2024-04-18T21:05:28.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.479 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.479 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:28.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633539+0000", 2024-04-18T21:05:28.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015175639999999999 2024-04-18T21:05:28.480 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:28.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640936+0000", 2024-04-18T21:05:28.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007397257 2024-04-18T21:05:28.480 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:28.480 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:28.480 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:28.480 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.480 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-18T21:05:28.480 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:05:28.480 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.764799, 2024-04-18T21:05:28.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00073592199999999997, 2024-04-18T21:05:28.480 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:28.480 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:28.481 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:28.481 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:28.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:28.481 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:05:28.481 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:28.481 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:28.481 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:05:28.481 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:28.481 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:28.481 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648597+0000", 2024-04-18T21:05:28.481 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:05:28.482 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.482 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.482 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:28.482 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648605+0000", 2024-04-18T21:05:28.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3960000000000006e-06 2024-04-18T21:05:28.482 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.482 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.482 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:28.482 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648625+0000", 2024-04-18T21:05:28.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9987e-05 2024-04-18T21:05:28.482 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.482 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.482 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.482 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648643+0000", 2024-04-18T21:05:28.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7079e-05 2024-04-18T21:05:28.483 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.483 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.483 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:28.483 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649043+0000", 2024-04-18T21:05:28.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040083399999999998 2024-04-18T21:05:28.483 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.483 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.483 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:28.483 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649062+0000", 2024-04-18T21:05:28.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9052999999999999e-05 2024-04-18T21:05:28.483 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.483 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.483 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:28.483 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649332+0000", 2024-04-18T21:05:28.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026971999999999999 2024-04-18T21:05:28.484 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:28.484 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:28.484 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:28.484 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.484 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:05:28.484 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:05:28.484 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.762024099000001, 2024-04-18T21:05:28.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00086123999999999999, 2024-04-18T21:05:28.484 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:28.484 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:28.484 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:05:28.484 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:28.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:28.485 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:05:28.485 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:28.485 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:28.485 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:05:28.485 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:28.485 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:28.485 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651372+0000", 2024-04-18T21:05:28.485 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7599999999999997e-07 2024-04-18T21:05:28.485 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:28.486 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651377+0000", 2024-04-18T21:05:28.486 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.22e-06 2024-04-18T21:05:28.486 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.486 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.486 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:28.486 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651394+0000", 2024-04-18T21:05:28.486 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6646999999999998e-05 2024-04-18T21:05:28.486 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.486 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.486 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.486 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651427+0000", 2024-04-18T21:05:28.486 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3682e-05 2024-04-18T21:05:28.486 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.486 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.486 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:28.487 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652029+0000", 2024-04-18T21:05:28.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00060152199999999995 2024-04-18T21:05:28.487 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.487 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.487 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:28.487 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652232+0000", 2024-04-18T21:05:28.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020359299999999999 2024-04-18T21:05:28.487 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:28.487 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:28.487 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:28.487 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.487 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.487 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:05:28.487 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:05:28.488 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.753997136999999, 2024-04-18T21:05:28.488 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0017426200000000001, 2024-04-18T21:05:28.488 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:28.488 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:28.488 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:28.488 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:28.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.488 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:28.488 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:05:28.488 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:28.488 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.488 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:28.488 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:05:28.488 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:28.489 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.489 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:28.489 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659399+0000", 2024-04-18T21:05:28.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6000000000000002e-07 2024-04-18T21:05:28.489 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.489 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:28.489 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659405+0000", 2024-04-18T21:05:28.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5069999999999997e-06 2024-04-18T21:05:28.489 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.489 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:28.489 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659425+0000", 2024-04-18T21:05:28.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.927e-05 2024-04-18T21:05:28.489 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.490 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.490 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659443+0000", 2024-04-18T21:05:28.490 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8051999999999999e-05 2024-04-18T21:05:28.490 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.490 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:28.490 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660973+0000", 2024-04-18T21:05:28.490 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001530106 2024-04-18T21:05:28.490 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.490 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:28.490 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660983+0000", 2024-04-18T21:05:28.490 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0516999999999999e-05 2024-04-18T21:05:28.491 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.491 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.491 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:28.491 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661141+0000", 2024-04-18T21:05:28.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015730799999999999 2024-04-18T21:05:28.491 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:28.491 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:28.491 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:28.491 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.491 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.491 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:05:28.491 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:05:28.491 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.753780511999999, 2024-04-18T21:05:28.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001812311, 2024-04-18T21:05:28.491 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:28.492 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:28.492 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:28.492 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:28.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:28.492 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:05:28.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:28.492 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:28.492 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:05:28.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:28.492 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:28.493 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659616+0000", 2024-04-18T21:05:28.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.277e-06 2024-04-18T21:05:28.493 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.493 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.493 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:28.493 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659625+0000", 2024-04-18T21:05:28.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5359999999999998e-06 2024-04-18T21:05:28.493 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.493 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.493 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:28.493 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659647+0000", 2024-04-18T21:05:28.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1857000000000001e-05 2024-04-18T21:05:28.493 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.493 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.493 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.493 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659664+0000", 2024-04-18T21:05:28.494 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6405999999999998e-05 2024-04-18T21:05:28.494 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.494 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.494 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:28.494 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661169+0000", 2024-04-18T21:05:28.494 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015054179999999999 2024-04-18T21:05:28.494 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.494 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.494 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:28.494 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661177+0000", 2024-04-18T21:05:28.494 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9680000000000006e-06 2024-04-18T21:05:28.494 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.494 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.494 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:28.495 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661427+0000", 2024-04-18T21:05:28.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024984900000000001 2024-04-18T21:05:28.495 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:28.495 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:28.495 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:28.495 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.495 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-18T21:05:28.495 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:05:28.495 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.800859903999999, 2024-04-18T21:05:28.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0030975030000000001, 2024-04-18T21:05:28.495 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:28.495 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:28.495 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:28.495 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:28.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:28.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:05:28.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:28.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:28.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:05:28.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:28.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:28.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612538+0000", 2024-04-18T21:05:28.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6259999999999999e-06 2024-04-18T21:05:28.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.497 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:28.497 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612552+0000", 2024-04-18T21:05:28.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4073999999999999e-05 2024-04-18T21:05:28.497 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.497 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:28.497 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612585+0000", 2024-04-18T21:05:28.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3504999999999999e-05 2024-04-18T21:05:28.497 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.497 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.497 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612601+0000", 2024-04-18T21:05:28.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5194000000000001e-05 2024-04-18T21:05:28.497 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.498 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:28.498 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612746+0000", 2024-04-18T21:05:28.498 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145666 2024-04-18T21:05:28.498 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.498 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.498 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:28.498 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612953+0000", 2024-04-18T21:05:28.498 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000207109 2024-04-18T21:05:28.498 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.498 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.498 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:28.498 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.613134+0000", 2024-04-18T21:05:28.498 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018041300000000001 2024-04-18T21:05:28.498 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:28.499 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.614411+0000", 2024-04-18T21:05:28.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0012769929999999999 2024-04-18T21:05:28.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:28.499 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615441+0000", 2024-04-18T21:05:28.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001029917 2024-04-18T21:05:28.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:28.499 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615522+0000", 2024-04-18T21:05:28.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1142000000000003e-05 2024-04-18T21:05:28.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.500 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:28.500 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615633+0000", 2024-04-18T21:05:28.500 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000110864 2024-04-18T21:05:28.500 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:28.500 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:28.500 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:28.500 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.500 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-18T21:05:28.500 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:05:28.500 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 2.798574093, 2024-04-18T21:05:28.500 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088979039999999999, 2024-04-18T21:05:28.500 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:28.500 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:28.501 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:28.501 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:28.501 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.501 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:28.501 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:05:28.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:28.501 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.501 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.501 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:28.501 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:05:28.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:28.501 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.501 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.501 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:28.501 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614825+0000", 2024-04-18T21:05:28.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4829999999999999e-06 2024-04-18T21:05:28.501 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.502 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.502 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:28.502 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614843+0000", 2024-04-18T21:05:28.502 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8777e-05 2024-04-18T21:05:28.502 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.502 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.502 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:28.502 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614884+0000", 2024-04-18T21:05:28.502 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1051999999999999e-05 2024-04-18T21:05:28.502 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.502 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.502 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.502 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614903+0000", 2024-04-18T21:05:28.503 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9069999999999999e-05 2024-04-18T21:05:28.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:28.503 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615047+0000", 2024-04-18T21:05:28.503 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014374400000000001 2024-04-18T21:05:28.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:28.503 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615061+0000", 2024-04-18T21:05:28.503 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4063000000000001e-05 2024-04-18T21:05:28.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:28.503 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621064+0000", 2024-04-18T21:05:28.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0060029200000000001 2024-04-18T21:05:28.504 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.504 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:28.504 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621211+0000", 2024-04-18T21:05:28.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000147224 2024-04-18T21:05:28.504 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.504 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:28.504 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621396+0000", 2024-04-18T21:05:28.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018454699999999999 2024-04-18T21:05:28.504 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.504 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:28.504 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.622517+0000", 2024-04-18T21:05:28.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001121424 2024-04-18T21:05:28.505 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.505 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.505 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:28.505 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623571+0000", 2024-04-18T21:05:28.505 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010538660000000001 2024-04-18T21:05:28.505 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.505 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.505 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:28.505 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623658+0000", 2024-04-18T21:05:28.505 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6439000000000004e-05 2024-04-18T21:05:28.505 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:28.505 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:28.505 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:28.505 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623719+0000", 2024-04-18T21:05:28.505 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1295000000000002e-05 2024-04-18T21:05:28.505 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:28.506 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:28.506 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:28.506 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:28.506 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:28.506 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:05:28.507 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:05:28.508 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:28.507+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:28.608 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:28.607+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:28.640 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:05:28.640 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:05:28.640 INFO:teuthology.orchestra.run.smithi132.stdout: "num_ops": 0 2024-04-18T21:05:28.640 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:05:28.654 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:05:28.709 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:28.711+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:28.772 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:05:28.772 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:05:28.772 INFO:teuthology.orchestra.run.smithi132.stdout: "complaint_time": 30, 2024-04-18T21:05:28.773 INFO:teuthology.orchestra.run.smithi132.stdout: "num_blocked_ops": 0 2024-04-18T21:05:28.773 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:05:28.787 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:05:28.831 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:28.831+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:28.911 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:05:28.911 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 20, 2024-04-18T21:05:28.911 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 600, 2024-04-18T21:05:28.911 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [ 2024-04-18T21:05:28.912 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.912 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:28.912 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:05:28.912 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 33.998520421999999, 2024-04-18T21:05:28.912 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.02518273, 2024-04-18T21:05:28.912 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:28.912 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:28.912 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:28.912 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:28.912 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:28.912 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:28.912 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 141 2024-04-18T21:05:28.912 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.912 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:28.913 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.913 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:28.913 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:05:28.913 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:28.913 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.913 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.913 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:28.913 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:05:28.913 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:28.913 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.913 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.913 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:28.913 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911562+0000", 2024-04-18T21:05:28.913 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9300000000000006e-07 2024-04-18T21:05:28.913 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.913 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.914 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:28.914 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911569+0000", 2024-04-18T21:05:28.914 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0169999999999999e-06 2024-04-18T21:05:28.914 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.914 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.914 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:28.914 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911582+0000", 2024-04-18T21:05:28.914 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.343e-05 2024-04-18T21:05:28.914 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.914 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.914 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.914 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911590+0000", 2024-04-18T21:05:28.914 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.413e-06 2024-04-18T21:05:28.915 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.915 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.915 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:28.915 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.933922+0000", 2024-04-18T21:05:28.915 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.022332093000000001 2024-04-18T21:05:28.915 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.915 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.915 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:28.915 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.934155+0000", 2024-04-18T21:05:28.915 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023378900000000001 2024-04-18T21:05:28.915 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.915 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.915 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:28.915 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.934514+0000", 2024-04-18T21:05:28.915 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00035859200000000003 2024-04-18T21:05:28.916 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.916 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.916 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:28.916 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.935973+0000", 2024-04-18T21:05:28.916 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001458705 2024-04-18T21:05:28.916 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.916 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.916 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:28.916 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936488+0000", 2024-04-18T21:05:28.916 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00051550000000000001 2024-04-18T21:05:28.916 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.916 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.916 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:28.916 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936636+0000", 2024-04-18T21:05:28.917 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014779800000000001 2024-04-18T21:05:28.917 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.917 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.917 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:28.917 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936743+0000", 2024-04-18T21:05:28.917 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010739999999999999 2024-04-18T21:05:28.917 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:28.917 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:28.917 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:28.917 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.917 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.917 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:28.917 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:05:28.917 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 33.881321448000001, 2024-04-18T21:05:28.917 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023654959999999999, 2024-04-18T21:05:28.917 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:28.918 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:28.918 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:28.918 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:28.918 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:28.918 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:28.918 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 163 2024-04-18T21:05:28.918 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.918 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:28.918 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.918 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:28.918 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:05:28.918 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:28.918 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.918 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.919 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:28.919 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:05:28.919 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:28.919 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.919 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.919 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:28.919 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:05:28.919 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0999999999999998e-07 2024-04-18T21:05:28.919 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.919 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.919 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:28.919 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028766+0000", 2024-04-18T21:05:28.919 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4700000000000001e-06 2024-04-18T21:05:28.919 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.919 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.920 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:28.920 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028775+0000", 2024-04-18T21:05:28.920 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.3190000000000001e-06 2024-04-18T21:05:28.920 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.920 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.920 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.920 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028782+0000", 2024-04-18T21:05:28.920 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.2300000000000002e-06 2024-04-18T21:05:28.920 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.920 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.920 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:28.920 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046667+0000", 2024-04-18T21:05:28.920 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017884356000000001 2024-04-18T21:05:28.920 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.920 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.921 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:28.921 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046788+0000", 2024-04-18T21:05:28.921 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012125000000000001 2024-04-18T21:05:28.921 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.921 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.921 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:28.921 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046982+0000", 2024-04-18T21:05:28.921 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019394 2024-04-18T21:05:28.921 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.921 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.921 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:28.921 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051969+0000", 2024-04-18T21:05:28.921 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0049868150000000003 2024-04-18T21:05:28.921 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.921 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.922 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:28.922 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052089+0000", 2024-04-18T21:05:28.922 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011993 2024-04-18T21:05:28.922 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.922 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.922 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:28.922 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052292+0000", 2024-04-18T21:05:28.922 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020345699999999999 2024-04-18T21:05:28.922 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.922 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.922 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:28.922 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052415+0000", 2024-04-18T21:05:28.922 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000122483 2024-04-18T21:05:28.922 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:28.922 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:28.923 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:28.923 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.923 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.923 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:28.923 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:05:28.923 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 33.881287215999997, 2024-04-18T21:05:28.923 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023864586, 2024-04-18T21:05:28.923 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:28.923 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:28.923 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:28.923 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:28.923 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:28.923 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:28.923 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 164 2024-04-18T21:05:28.923 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.923 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:28.924 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.924 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:28.924 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:05:28.924 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:28.924 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.924 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.924 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:28.924 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:05:28.924 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:28.924 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.924 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.924 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:28.924 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028795+0000", 2024-04-18T21:05:28.924 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7999999999999995e-07 2024-04-18T21:05:28.924 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.925 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.925 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:28.925 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028884+0000", 2024-04-18T21:05:28.925 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8997000000000002e-05 2024-04-18T21:05:28.925 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.925 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.925 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:28.925 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028895+0000", 2024-04-18T21:05:28.925 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1647e-05 2024-04-18T21:05:28.925 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.925 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.925 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.925 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028903+0000", 2024-04-18T21:05:28.925 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.909e-06 2024-04-18T21:05:28.925 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.925 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.926 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:28.926 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.047818+0000", 2024-04-18T21:05:28.926 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018914337 2024-04-18T21:05:28.926 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.926 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.926 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:28.926 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.048094+0000", 2024-04-18T21:05:28.926 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00027653500000000001 2024-04-18T21:05:28.926 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.926 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.926 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:28.926 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.048471+0000", 2024-04-18T21:05:28.926 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00037705799999999999 2024-04-18T21:05:28.926 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.927 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.927 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:28.927 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052516+0000", 2024-04-18T21:05:28.927 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0040452739999999997 2024-04-18T21:05:28.927 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.927 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.927 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:28.927 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052535+0000", 2024-04-18T21:05:28.927 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.84e-05 2024-04-18T21:05:28.927 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.927 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.927 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:28.927 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052603+0000", 2024-04-18T21:05:28.927 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.8095000000000004e-05 2024-04-18T21:05:28.927 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.928 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.928 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:28.928 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052659+0000", 2024-04-18T21:05:28.928 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5653999999999999e-05 2024-04-18T21:05:28.928 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:28.928 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:28.928 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:28.928 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.928 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.928 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:28.928 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:05:28.928 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 33.881163772999997, 2024-04-18T21:05:28.928 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024516458000000001, 2024-04-18T21:05:28.928 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:28.928 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:28.929 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:28.929 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:28.929 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:28.929 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:28.929 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 165 2024-04-18T21:05:28.929 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.929 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:28.929 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.929 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:28.929 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:05:28.929 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:28.929 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.929 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.929 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:28.929 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:05:28.930 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:28.930 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.930 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.930 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:28.930 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028918+0000", 2024-04-18T21:05:28.930 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8000000000000005e-07 2024-04-18T21:05:28.930 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.930 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.930 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:28.930 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028924+0000", 2024-04-18T21:05:28.930 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5659999999999997e-06 2024-04-18T21:05:28.930 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.930 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.930 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:28.931 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028933+0000", 2024-04-18T21:05:28.931 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.38e-06 2024-04-18T21:05:28.931 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.931 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.931 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.931 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028940+0000", 2024-04-18T21:05:28.931 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0060000000000003e-06 2024-04-18T21:05:28.931 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.931 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.931 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:28.931 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.050846+0000", 2024-04-18T21:05:28.931 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021906119000000002 2024-04-18T21:05:28.931 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.931 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.931 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:28.932 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051025+0000", 2024-04-18T21:05:28.932 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017850799999999999 2024-04-18T21:05:28.932 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.932 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.932 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:28.932 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051221+0000", 2024-04-18T21:05:28.932 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019608700000000001 2024-04-18T21:05:28.932 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.932 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.932 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:28.932 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052675+0000", 2024-04-18T21:05:28.932 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0014537899999999999 2024-04-18T21:05:28.932 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.932 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.932 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:28.933 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053311+0000", 2024-04-18T21:05:28.933 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00063613299999999999 2024-04-18T21:05:28.933 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.933 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.933 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:28.933 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053381+0000", 2024-04-18T21:05:28.933 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0074999999999996e-05 2024-04-18T21:05:28.933 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.933 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.933 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:28.933 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053434+0000", 2024-04-18T21:05:28.933 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3013999999999998e-05 2024-04-18T21:05:28.933 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:28.933 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:28.933 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:28.933 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.934 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.934 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:28.934 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:05:28.934 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 33.767858294, 2024-04-18T21:05:28.934 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023772793, 2024-04-18T21:05:28.934 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:28.934 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:28.934 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:28.934 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:28.934 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:28.934 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:28.934 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 187 2024-04-18T21:05:28.934 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.934 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:28.935 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.935 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:28.935 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:05:28.935 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:28.935 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.935 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.935 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:28.935 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:05:28.935 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:28.935 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.935 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.935 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:28.935 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142224+0000", 2024-04-18T21:05:28.935 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.47e-07 2024-04-18T21:05:28.935 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.935 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.936 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:28.936 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142233+0000", 2024-04-18T21:05:28.936 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0729999999999994e-06 2024-04-18T21:05:28.936 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.936 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.936 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:28.936 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142255+0000", 2024-04-18T21:05:28.936 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.2535999999999999e-05 2024-04-18T21:05:28.936 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.936 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.936 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.936 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142268+0000", 2024-04-18T21:05:28.936 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2686e-05 2024-04-18T21:05:28.936 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.936 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.936 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:28.937 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160497+0000", 2024-04-18T21:05:28.937 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018228779000000001 2024-04-18T21:05:28.937 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.937 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.937 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:28.937 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160634+0000", 2024-04-18T21:05:28.937 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000137315 2024-04-18T21:05:28.937 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.937 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.937 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:28.937 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160831+0000", 2024-04-18T21:05:28.937 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019683100000000001 2024-04-18T21:05:28.937 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.937 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.937 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:28.938 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165129+0000", 2024-04-18T21:05:28.938 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0042981299999999998 2024-04-18T21:05:28.938 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.938 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.938 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:28.938 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165776+0000", 2024-04-18T21:05:28.938 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00064702900000000003 2024-04-18T21:05:28.938 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.938 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.938 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:28.938 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165921+0000", 2024-04-18T21:05:28.938 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014506 2024-04-18T21:05:28.938 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.938 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.938 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:28.939 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165996+0000", 2024-04-18T21:05:28.939 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.4406999999999994e-05 2024-04-18T21:05:28.939 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:28.939 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:28.939 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:28.939 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.939 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.939 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:28.939 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:05:28.939 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 33.767797696000002, 2024-04-18T21:05:28.939 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026802157, 2024-04-18T21:05:28.939 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:28.939 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:28.939 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:28.939 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:28.940 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:28.940 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:28.940 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 188 2024-04-18T21:05:28.940 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.940 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:28.940 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.940 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:28.940 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:05:28.940 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:28.940 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.940 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.940 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:28.940 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:05:28.940 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:28.940 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.940 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.941 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:28.941 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142284+0000", 2024-04-18T21:05:28.941 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4e-07 2024-04-18T21:05:28.941 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.941 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.941 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:28.941 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142374+0000", 2024-04-18T21:05:28.941 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0099999999999995e-05 2024-04-18T21:05:28.941 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.941 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.941 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:28.941 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142386+0000", 2024-04-18T21:05:28.941 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1770000000000001e-05 2024-04-18T21:05:28.941 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.941 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.941 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.942 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142394+0000", 2024-04-18T21:05:28.942 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.2130000000000008e-06 2024-04-18T21:05:28.942 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.942 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.942 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:28.942 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.161743+0000", 2024-04-18T21:05:28.942 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019348644000000002 2024-04-18T21:05:28.942 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.942 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.942 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:28.942 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.161865+0000", 2024-04-18T21:05:28.942 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012210899999999999 2024-04-18T21:05:28.942 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.942 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.943 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:28.943 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.162055+0000", 2024-04-18T21:05:28.943 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000189994 2024-04-18T21:05:28.943 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.943 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.943 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:28.943 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165735+0000", 2024-04-18T21:05:28.943 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0036803270000000002 2024-04-18T21:05:28.943 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.943 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.943 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:28.943 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.168911+0000", 2024-04-18T21:05:28.943 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0031753689999999999 2024-04-18T21:05:28.943 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.943 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.944 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:28.944 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169012+0000", 2024-04-18T21:05:28.944 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010157699999999999 2024-04-18T21:05:28.944 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.944 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.944 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:28.944 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169086+0000", 2024-04-18T21:05:28.944 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3213999999999994e-05 2024-04-18T21:05:28.944 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:28.944 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:28.944 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:28.944 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.944 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.944 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:28.944 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:05:28.945 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 33.767672390000001, 2024-04-18T21:05:28.945 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026811423000000001, 2024-04-18T21:05:28.945 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:28.945 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:28.945 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:28.945 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:28.945 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:28.945 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:28.945 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 189 2024-04-18T21:05:28.945 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.945 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:28.945 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.945 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:28.945 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:05:28.945 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:28.945 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.946 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.946 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:28.946 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:05:28.946 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:28.946 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.946 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.946 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:28.946 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142410+0000", 2024-04-18T21:05:28.946 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:05:28.946 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.946 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.946 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:28.946 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142415+0000", 2024-04-18T21:05:28.946 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.7939999999999999e-06 2024-04-18T21:05:28.946 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.947 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.947 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:28.947 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142470+0000", 2024-04-18T21:05:28.947 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4537999999999999e-05 2024-04-18T21:05:28.947 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.947 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.947 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.947 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142481+0000", 2024-04-18T21:05:28.947 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0966e-05 2024-04-18T21:05:28.947 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.947 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.947 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:28.947 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.163493+0000", 2024-04-18T21:05:28.947 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021012444000000002 2024-04-18T21:05:28.948 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.948 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.948 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:28.948 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.163727+0000", 2024-04-18T21:05:28.948 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000233339 2024-04-18T21:05:28.948 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.948 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.948 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:28.948 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.164102+0000", 2024-04-18T21:05:28.948 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000374872 2024-04-18T21:05:28.948 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.948 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.948 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:28.948 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.166528+0000", 2024-04-18T21:05:28.948 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0024258729999999998 2024-04-18T21:05:28.948 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.949 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.949 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:28.949 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169101+0000", 2024-04-18T21:05:28.949 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0025737680000000001 2024-04-18T21:05:28.949 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.949 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.949 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:28.949 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169171+0000", 2024-04-18T21:05:28.949 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0148000000000007e-05 2024-04-18T21:05:28.949 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.949 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.949 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:28.949 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169220+0000", 2024-04-18T21:05:28.949 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8767999999999998e-05 2024-04-18T21:05:28.949 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:28.949 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:28.950 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:28.950 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.950 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.950 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:28.950 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:05:28.950 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 23.294099838000001, 2024-04-18T21:05:28.950 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024082777999999999, 2024-04-18T21:05:28.950 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:28.950 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:28.950 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:28.950 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:28.950 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.950 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:28.950 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:05:28.951 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:28.951 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.951 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.951 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:28.951 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:05:28.951 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:28.951 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.951 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.951 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:28.951 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615984+0000", 2024-04-18T21:05:28.951 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.9869999999999999e-06 2024-04-18T21:05:28.951 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.951 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.951 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:28.951 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615999+0000", 2024-04-18T21:05:28.952 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4646e-05 2024-04-18T21:05:28.952 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.952 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.952 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:28.952 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616028+0000", 2024-04-18T21:05:28.952 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8952999999999999e-05 2024-04-18T21:05:28.952 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.952 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.952 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.952 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616052+0000", 2024-04-18T21:05:28.952 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.3941999999999999e-05 2024-04-18T21:05:28.952 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.952 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.952 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:28.952 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618010+0000", 2024-04-18T21:05:28.953 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0019581780000000001 2024-04-18T21:05:28.953 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.953 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.953 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:28.953 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618322+0000", 2024-04-18T21:05:28.953 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00031158899999999997 2024-04-18T21:05:28.953 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.953 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.953 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:28.953 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618587+0000", 2024-04-18T21:05:28.953 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00026495700000000002 2024-04-18T21:05:28.953 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.953 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.953 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:28.953 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629262+0000", 2024-04-18T21:05:28.953 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010675877 2024-04-18T21:05:28.954 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.954 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.954 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:28.954 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.639773+0000", 2024-04-18T21:05:28.954 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0105109 2024-04-18T21:05:28.954 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.954 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.954 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:28.954 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.639926+0000", 2024-04-18T21:05:28.954 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000152349 2024-04-18T21:05:28.954 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.954 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.954 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:28.954 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640064+0000", 2024-04-18T21:05:28.954 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0001384 2024-04-18T21:05:28.955 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:28.955 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:28.955 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:28.955 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.955 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.955 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:28.955 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:05:28.955 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 23.293987164000001, 2024-04-18T21:05:28.955 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030215005999999999, 2024-04-18T21:05:28.955 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:28.955 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:28.955 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:28.955 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:28.955 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.955 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:28.956 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:05:28.956 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:28.956 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.956 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.956 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:28.956 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:05:28.956 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:28.956 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.956 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.956 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:28.956 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616095+0000", 2024-04-18T21:05:28.956 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.446e-06 2024-04-18T21:05:28.956 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.956 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.956 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:28.957 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616104+0000", 2024-04-18T21:05:28.957 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6200000000000005e-06 2024-04-18T21:05:28.957 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.957 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.957 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:28.957 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616132+0000", 2024-04-18T21:05:28.957 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7668999999999999e-05 2024-04-18T21:05:28.957 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.957 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.957 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.957 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616149+0000", 2024-04-18T21:05:28.957 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7047000000000001e-05 2024-04-18T21:05:28.957 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.957 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.957 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:28.957 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619287+0000", 2024-04-18T21:05:28.958 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0031381450000000002 2024-04-18T21:05:28.958 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.958 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.958 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:28.958 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619503+0000", 2024-04-18T21:05:28.958 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000216522 2024-04-18T21:05:28.958 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.958 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.958 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:28.958 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619930+0000", 2024-04-18T21:05:28.958 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00042604900000000001 2024-04-18T21:05:28.958 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.958 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.958 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:28.959 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629281+0000", 2024-04-18T21:05:28.959 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0093512230000000005 2024-04-18T21:05:28.959 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.959 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.959 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:28.959 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646022+0000", 2024-04-18T21:05:28.959 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016741156 2024-04-18T21:05:28.959 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.959 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.959 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:28.959 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646198+0000", 2024-04-18T21:05:28.959 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000176009 2024-04-18T21:05:28.959 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.959 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.959 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:28.960 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646309+0000", 2024-04-18T21:05:28.960 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011112000000000001 2024-04-18T21:05:28.960 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:28.960 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:28.960 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:28.960 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.960 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.960 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:28.960 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:05:28.960 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 23.293902339999999, 2024-04-18T21:05:28.960 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030501176000000001, 2024-04-18T21:05:28.960 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:28.960 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:28.960 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:28.960 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:28.961 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.961 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:28.961 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:05:28.961 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:28.961 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.961 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.961 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:28.961 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:05:28.961 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:28.961 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.961 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.961 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:28.961 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616180+0000", 2024-04-18T21:05:28.961 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1000000000000001e-06 2024-04-18T21:05:28.961 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.962 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.962 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:28.962 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616188+0000", 2024-04-18T21:05:28.962 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4069999999999993e-06 2024-04-18T21:05:28.962 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.962 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.962 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:28.962 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616207+0000", 2024-04-18T21:05:28.962 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8335999999999999e-05 2024-04-18T21:05:28.962 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.962 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.962 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.962 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616225+0000", 2024-04-18T21:05:28.962 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8652999999999999e-05 2024-04-18T21:05:28.963 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.963 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.963 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:28.963 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620977+0000", 2024-04-18T21:05:28.963 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047512220000000003 2024-04-18T21:05:28.963 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.963 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.963 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:28.963 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621279+0000", 2024-04-18T21:05:28.963 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000302646 2024-04-18T21:05:28.963 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.963 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.963 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:28.963 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621584+0000", 2024-04-18T21:05:28.963 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000305142 2024-04-18T21:05:28.964 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.964 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.964 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:28.964 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629352+0000", 2024-04-18T21:05:28.964 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0077673689999999997 2024-04-18T21:05:28.964 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.964 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.964 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:28.964 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646480+0000", 2024-04-18T21:05:28.964 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017128259 2024-04-18T21:05:28.964 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.964 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.964 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:28.964 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646591+0000", 2024-04-18T21:05:28.964 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011113899999999999 2024-04-18T21:05:28.965 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.965 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.965 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:28.965 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646680+0000", 2024-04-18T21:05:28.965 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8902999999999999e-05 2024-04-18T21:05:28.965 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:28.965 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:28.965 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:28.965 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.965 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.965 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:28.965 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:05:28.965 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 23.293835841, 2024-04-18T21:05:28.965 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030779760999999999, 2024-04-18T21:05:28.965 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:28.966 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:28.966 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:28.966 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:28.966 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.966 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:28.966 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:05:28.966 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:28.966 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.966 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.966 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:28.966 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:05:28.966 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:28.966 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.966 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.966 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:28.967 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616246+0000", 2024-04-18T21:05:28.967 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0499999999999999e-06 2024-04-18T21:05:28.967 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.967 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.967 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:28.967 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616253+0000", 2024-04-18T21:05:28.967 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.5989999999999998e-06 2024-04-18T21:05:28.967 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.967 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.967 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:28.967 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616273+0000", 2024-04-18T21:05:28.967 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9916999999999999e-05 2024-04-18T21:05:28.967 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.967 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.967 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.968 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616287+0000", 2024-04-18T21:05:28.968 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3669000000000001e-05 2024-04-18T21:05:28.968 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.968 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.968 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:28.968 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622203+0000", 2024-04-18T21:05:28.968 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.005916737 2024-04-18T21:05:28.968 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.968 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.968 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:28.968 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622379+0000", 2024-04-18T21:05:28.968 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000175596 2024-04-18T21:05:28.968 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.968 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.968 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:28.969 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622707+0000", 2024-04-18T21:05:28.969 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00032784600000000002 2024-04-18T21:05:28.969 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.969 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.969 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:28.969 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629366+0000", 2024-04-18T21:05:28.969 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0066593279999999999 2024-04-18T21:05:28.969 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.969 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.969 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:28.969 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646813+0000", 2024-04-18T21:05:28.969 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017447059000000001 2024-04-18T21:05:28.969 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.969 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.969 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:28.969 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646946+0000", 2024-04-18T21:05:28.970 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013301200000000001 2024-04-18T21:05:28.970 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.970 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.970 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:28.970 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647025+0000", 2024-04-18T21:05:28.970 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8948000000000004e-05 2024-04-18T21:05:28.970 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:28.970 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:28.970 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:28.970 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.970 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.970 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:28.970 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:05:28.970 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 23.293752023, 2024-04-18T21:05:28.970 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.031512165000000002, 2024-04-18T21:05:28.971 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:28.971 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:28.971 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:28.971 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:28.971 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.971 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:28.971 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:05:28.971 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:28.971 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.971 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.971 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:28.971 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:05:28.971 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:28.971 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.972 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.972 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:28.972 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616330+0000", 2024-04-18T21:05:28.972 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.15e-06 2024-04-18T21:05:28.972 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.972 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.972 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:28.972 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616337+0000", 2024-04-18T21:05:28.972 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.1289999999999998e-06 2024-04-18T21:05:28.972 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.972 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.972 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:28.972 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616447+0000", 2024-04-18T21:05:28.972 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109561 2024-04-18T21:05:28.972 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.972 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.973 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.973 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616496+0000", 2024-04-18T21:05:28.973 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8591999999999998e-05 2024-04-18T21:05:28.973 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.973 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.973 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:28.973 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.623786+0000", 2024-04-18T21:05:28.973 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0072906799999999999 2024-04-18T21:05:28.973 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.973 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.973 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:28.973 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.623973+0000", 2024-04-18T21:05:28.973 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018717199999999999 2024-04-18T21:05:28.973 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.973 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.973 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:28.974 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624260+0000", 2024-04-18T21:05:28.974 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00028630600000000001 2024-04-18T21:05:28.974 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.974 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.974 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:28.974 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629381+0000", 2024-04-18T21:05:28.974 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0051211340000000003 2024-04-18T21:05:28.974 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.974 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.974 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:28.974 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647631+0000", 2024-04-18T21:05:28.974 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018249771000000001 2024-04-18T21:05:28.974 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.974 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.974 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:28.975 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647761+0000", 2024-04-18T21:05:28.975 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013037300000000001 2024-04-18T21:05:28.975 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.975 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.975 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:28.975 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647841+0000", 2024-04-18T21:05:28.975 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.0296999999999994e-05 2024-04-18T21:05:28.975 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:28.975 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:28.975 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:28.975 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.975 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.975 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:28.975 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:05:28.976 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 23.293546539000001, 2024-04-18T21:05:28.976 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043251955000000002, 2024-04-18T21:05:28.976 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:28.976 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:28.976 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:28.976 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:28.976 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.976 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:28.976 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:05:28.976 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:28.976 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.976 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.976 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:28.976 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:05:28.976 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:28.977 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.977 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.977 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:28.977 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616536+0000", 2024-04-18T21:05:28.977 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2869999999999999e-06 2024-04-18T21:05:28.977 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.977 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.977 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:28.977 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616572+0000", 2024-04-18T21:05:28.977 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.6261999999999999e-05 2024-04-18T21:05:28.977 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.977 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.977 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:28.978 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616593+0000", 2024-04-18T21:05:28.978 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1310000000000001e-05 2024-04-18T21:05:28.978 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.978 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.978 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.978 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616614+0000", 2024-04-18T21:05:28.978 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.0936000000000001e-05 2024-04-18T21:05:28.978 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.978 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.978 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:28.978 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629501+0000", 2024-04-18T21:05:28.978 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.012886819000000001 2024-04-18T21:05:28.978 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.978 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.979 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:28.979 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629696+0000", 2024-04-18T21:05:28.979 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019485499999999999 2024-04-18T21:05:28.979 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.979 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.979 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:28.979 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629940+0000", 2024-04-18T21:05:28.979 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00024386399999999999 2024-04-18T21:05:28.979 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.979 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.979 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:28.979 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640100+0000", 2024-04-18T21:05:28.979 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010159645 2024-04-18T21:05:28.979 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.979 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.980 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:28.980 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659516+0000", 2024-04-18T21:05:28.980 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019416563000000001 2024-04-18T21:05:28.980 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.980 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.980 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:28.980 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659684+0000", 2024-04-18T21:05:28.980 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016750900000000001 2024-04-18T21:05:28.980 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.980 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.980 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:28.980 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659787+0000", 2024-04-18T21:05:28.980 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000102905 2024-04-18T21:05:28.980 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:28.980 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:28.981 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:28.981 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.981 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.981 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:28.981 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:05:28.981 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 23.293441417, 2024-04-18T21:05:28.981 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043581898000000001, 2024-04-18T21:05:28.981 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:28.981 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:28.981 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:28.981 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:28.981 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.981 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:28.981 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:05:28.981 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:28.982 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.982 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.982 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:28.982 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:05:28.982 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:28.982 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.982 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.982 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:28.982 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616641+0000", 2024-04-18T21:05:28.982 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:05:28.982 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.982 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.982 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:28.982 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616648+0000", 2024-04-18T21:05:28.982 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3860000000000001e-06 2024-04-18T21:05:28.983 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.983 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.983 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:28.983 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616666+0000", 2024-04-18T21:05:28.983 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7583000000000001e-05 2024-04-18T21:05:28.983 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.983 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.983 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.983 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616679+0000", 2024-04-18T21:05:28.983 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3322999999999999e-05 2024-04-18T21:05:28.983 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.983 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.983 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:28.983 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630373+0000", 2024-04-18T21:05:28.983 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013694207999999999 2024-04-18T21:05:28.984 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.984 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.984 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:28.984 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630545+0000", 2024-04-18T21:05:28.984 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000171683 2024-04-18T21:05:28.984 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.984 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.984 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:28.984 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630728+0000", 2024-04-18T21:05:28.984 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000182599 2024-04-18T21:05:28.984 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.984 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.984 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:28.984 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640600+0000", 2024-04-18T21:05:28.985 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0098726119999999994 2024-04-18T21:05:28.985 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.985 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.985 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:28.985 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659927+0000", 2024-04-18T21:05:28.985 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019326724999999999 2024-04-18T21:05:28.985 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.985 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.985 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:28.985 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660112+0000", 2024-04-18T21:05:28.985 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000185203 2024-04-18T21:05:28.985 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.985 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.985 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:28.985 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660222+0000", 2024-04-18T21:05:28.986 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109343 2024-04-18T21:05:28.986 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:28.986 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:28.986 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:28.986 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.986 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.986 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:28.986 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:05:28.986 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 23.292576059000002, 2024-04-18T21:05:28.986 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043121310000000003, 2024-04-18T21:05:28.986 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:28.986 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:28.986 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:28.986 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:28.986 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.987 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:28.987 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:05:28.987 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:28.987 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.987 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.987 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:28.987 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:05:28.987 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:28.987 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.987 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.987 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:28.987 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617506+0000", 2024-04-18T21:05:28.987 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9999999999999995e-07 2024-04-18T21:05:28.987 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.987 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.988 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:28.988 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617513+0000", 2024-04-18T21:05:28.988 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.9700000000000002e-06 2024-04-18T21:05:28.988 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.988 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.988 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:28.988 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617531+0000", 2024-04-18T21:05:28.988 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8105999999999999e-05 2024-04-18T21:05:28.988 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.988 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.988 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.988 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617545+0000", 2024-04-18T21:05:28.988 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3703000000000001e-05 2024-04-18T21:05:28.988 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.988 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.989 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:28.989 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632129+0000", 2024-04-18T21:05:28.989 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.014584135999999999 2024-04-18T21:05:28.989 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.989 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.989 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:28.989 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632361+0000", 2024-04-18T21:05:28.989 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023171800000000001 2024-04-18T21:05:28.989 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.989 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.989 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:28.989 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632804+0000", 2024-04-18T21:05:28.989 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000443549 2024-04-18T21:05:28.989 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.989 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.990 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:28.990 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646340+0000", 2024-04-18T21:05:28.990 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013535902000000001 2024-04-18T21:05:28.990 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.990 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.990 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:28.990 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660363+0000", 2024-04-18T21:05:28.990 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01402318 2024-04-18T21:05:28.990 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.990 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.990 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:28.990 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660523+0000", 2024-04-18T21:05:28.990 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00015989899999999999 2024-04-18T21:05:28.990 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.990 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.991 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:28.991 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660626+0000", 2024-04-18T21:05:28.991 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010314699999999999 2024-04-18T21:05:28.991 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:28.991 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:28.991 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:28.991 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.991 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.991 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:28.991 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:05:28.991 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 23.292436366, 2024-04-18T21:05:28.991 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024927483, 2024-04-18T21:05:28.991 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:28.991 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:28.991 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:28.992 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:28.992 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.992 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:28.992 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:05:28.992 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:28.992 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.992 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.992 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:28.992 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:05:28.992 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:28.992 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.992 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.992 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:28.992 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617646+0000", 2024-04-18T21:05:28.992 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3030000000000001e-06 2024-04-18T21:05:28.993 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.993 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.993 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:28.993 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617653+0000", 2024-04-18T21:05:28.993 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7530000000000004e-06 2024-04-18T21:05:28.993 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.993 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.993 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:28.993 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617673+0000", 2024-04-18T21:05:28.993 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9967e-05 2024-04-18T21:05:28.993 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.993 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.993 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.993 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617688+0000", 2024-04-18T21:05:28.993 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5153e-05 2024-04-18T21:05:28.993 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.994 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.994 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:28.994 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619244+0000", 2024-04-18T21:05:28.994 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001555531 2024-04-18T21:05:28.994 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.994 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.994 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:28.994 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619361+0000", 2024-04-18T21:05:28.994 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011784400000000001 2024-04-18T21:05:28.994 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.994 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.994 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:28.994 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619604+0000", 2024-04-18T21:05:28.994 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000243007 2024-04-18T21:05:28.994 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.995 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.995 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:28.995 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.625480+0000", 2024-04-18T21:05:28.995 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0058759349999999997 2024-04-18T21:05:28.995 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.995 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.995 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:28.995 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642342+0000", 2024-04-18T21:05:28.995 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016861373999999998 2024-04-18T21:05:28.995 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.995 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.995 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:28.995 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642484+0000", 2024-04-18T21:05:28.995 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000142423 2024-04-18T21:05:28.995 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.996 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.996 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:28.996 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642572+0000", 2024-04-18T21:05:28.996 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8193000000000001e-05 2024-04-18T21:05:28.996 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:28.996 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:28.996 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:28.996 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.996 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.996 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:28.996 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:05:28.996 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 23.292154863, 2024-04-18T21:05:28.996 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024956974999999999, 2024-04-18T21:05:28.996 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:28.996 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:28.997 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:28.997 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:28.997 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.997 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:28.997 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:05:28.997 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:28.997 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.997 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.997 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:28.997 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:05:28.997 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:28.997 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.997 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.997 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:28.997 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617928+0000", 2024-04-18T21:05:28.997 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5430000000000001e-06 2024-04-18T21:05:28.998 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.998 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.998 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:28.998 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617937+0000", 2024-04-18T21:05:28.998 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6629999999999999e-06 2024-04-18T21:05:28.998 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.998 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.998 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:28.998 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617955+0000", 2024-04-18T21:05:28.998 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8749999999999998e-05 2024-04-18T21:05:28.998 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.998 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.998 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:28.998 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617971+0000", 2024-04-18T21:05:28.999 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.605e-05 2024-04-18T21:05:28.999 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.999 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.999 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:28.999 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621019+0000", 2024-04-18T21:05:28.999 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0030472369999999999 2024-04-18T21:05:28.999 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.999 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.999 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:28.999 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621249+0000", 2024-04-18T21:05:28.999 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000230075 2024-04-18T21:05:28.999 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:28.999 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:28.999 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:28.999 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621450+0000", 2024-04-18T21:05:29.000 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020166499999999999 2024-04-18T21:05:29.000 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:29.000 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:29.000 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:29.000 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.626233+0000", 2024-04-18T21:05:29.000 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047827390000000003 2024-04-18T21:05:29.000 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:29.000 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:29.000 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:29.000 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642693+0000", 2024-04-18T21:05:29.000 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01645961 2024-04-18T21:05:29.000 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:29.000 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:29.000 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:29.000 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642798+0000", 2024-04-18T21:05:29.001 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010559499999999999 2024-04-18T21:05:29.001 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:29.001 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:29.001 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:29.001 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642883+0000", 2024-04-18T21:05:29.001 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5048000000000003e-05 2024-04-18T21:05:29.001 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:29.001 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:29.001 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:29.001 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:29.001 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:29.001 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:29.001 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:05:29.001 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 23.290459235, 2024-04-18T21:05:29.002 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024086478000000001, 2024-04-18T21:05:29.002 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:29.002 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:29.002 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:29.002 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:29.002 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:29.002 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:29.002 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:05:29.002 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:29.002 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:29.002 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:29.002 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:29.002 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:05:29.003 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:29.003 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:29.003 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:29.003 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:29.003 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619624+0000", 2024-04-18T21:05:29.003 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.75e-06 2024-04-18T21:05:29.003 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:29.003 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:29.003 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:29.003 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619637+0000", 2024-04-18T21:05:29.003 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3540000000000001e-05 2024-04-18T21:05:29.003 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:29.003 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:29.003 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:29.004 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619666+0000", 2024-04-18T21:05:29.004 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8685999999999999e-05 2024-04-18T21:05:29.004 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:29.004 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:29.004 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:29.004 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619685+0000", 2024-04-18T21:05:29.004 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8681999999999998e-05 2024-04-18T21:05:29.004 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:29.004 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:29.004 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:29.004 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622275+0000", 2024-04-18T21:05:29.004 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0025899260000000002 2024-04-18T21:05:29.004 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:29.004 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:29.005 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:29.005 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622572+0000", 2024-04-18T21:05:29.005 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00029722 2024-04-18T21:05:29.005 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:29.005 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:29.005 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:29.005 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622752+0000", 2024-04-18T21:05:29.005 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018065900000000001 2024-04-18T21:05:29.005 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:29.005 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:29.005 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:29.005 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.626326+0000", 2024-04-18T21:05:29.005 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035737310000000001 2024-04-18T21:05:29.005 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:29.005 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:29.005 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:29.006 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643565+0000", 2024-04-18T21:05:29.006 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017238430999999999 2024-04-18T21:05:29.006 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:29.006 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:29.006 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:29.006 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643646+0000", 2024-04-18T21:05:29.006 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.1481000000000001e-05 2024-04-18T21:05:29.006 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:29.006 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:29.006 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:29.006 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643708+0000", 2024-04-18T21:05:29.006 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.2372000000000005e-05 2024-04-18T21:05:29.006 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:29.006 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:29.007 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:29.007 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:29.007 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:29.007 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:29.007 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:05:29.007 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 23.290293082000002, 2024-04-18T21:05:29.007 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026822450000000001, 2024-04-18T21:05:29.007 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:29.007 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:29.007 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:29.007 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:29.007 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:29.007 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:29.007 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:05:29.007 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:29.008 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:29.008 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:29.008 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:29.008 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:05:29.008 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:29.008 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:29.008 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:29.008 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:29.008 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619789+0000", 2024-04-18T21:05:29.008 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:05:29.008 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:29.008 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:29.008 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:29.008 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619797+0000", 2024-04-18T21:05:29.008 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.6899999999999992e-06 2024-04-18T21:05:29.009 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:29.009 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:29.009 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:29.009 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619816+0000", 2024-04-18T21:05:29.009 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9352999999999999e-05 2024-04-18T21:05:29.009 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:29.009 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:29.009 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:29.009 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619832+0000", 2024-04-18T21:05:29.009 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6013000000000001e-05 2024-04-18T21:05:29.009 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:29.009 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:29.009 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:29.009 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620528+0000", 2024-04-18T21:05:29.010 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00069565600000000001 2024-04-18T21:05:29.010 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:29.010 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:29.010 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:29.010 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620735+0000", 2024-04-18T21:05:29.010 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000207025 2024-04-18T21:05:29.010 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:29.010 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:29.010 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:29.010 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620912+0000", 2024-04-18T21:05:29.010 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017748199999999999 2024-04-18T21:05:29.010 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:29.010 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:29.010 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:29.011 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.625605+0000", 2024-04-18T21:05:29.011 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0046924439999999996 2024-04-18T21:05:29.011 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:29.011 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:29.011 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:29.011 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646349+0000", 2024-04-18T21:05:29.011 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.020744318000000001 2024-04-18T21:05:29.011 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:29.011 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:29.011 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:29.011 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646483+0000", 2024-04-18T21:05:29.011 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013428999999999999 2024-04-18T21:05:29.011 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:29.011 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:29.012 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:29.012 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646611+0000", 2024-04-18T21:05:29.012 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012710299999999999 2024-04-18T21:05:29.012 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:29.012 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:29.012 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:29.012 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:29.012 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:29.012 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:29.012 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:05:29.012 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 23.289622649000002, 2024-04-18T21:05:29.012 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023516516000000001, 2024-04-18T21:05:29.012 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:29.012 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:29.012 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:05:29.013 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:29.013 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:29.013 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:29.013 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:05:29.013 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:29.013 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:29.013 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:29.013 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:29.013 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:05:29.013 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:29.013 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:29.013 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:29.013 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:29.013 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620460+0000", 2024-04-18T21:05:29.013 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.787e-06 2024-04-18T21:05:29.014 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:29.014 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:29.014 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:29.014 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620470+0000", 2024-04-18T21:05:29.014 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.2560000000000008e-06 2024-04-18T21:05:29.014 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:29.014 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:29.014 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:29.014 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620496+0000", 2024-04-18T21:05:29.014 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.6205999999999999e-05 2024-04-18T21:05:29.014 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:29.014 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:29.014 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:29.014 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620517+0000", 2024-04-18T21:05:29.015 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1223e-05 2024-04-18T21:05:29.015 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:29.015 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:29.015 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:29.015 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624060+0000", 2024-04-18T21:05:29.015 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035434160000000002 2024-04-18T21:05:29.015 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:29.015 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:29.015 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:29.015 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624390+0000", 2024-04-18T21:05:29.015 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00033000500000000002 2024-04-18T21:05:29.015 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:29.015 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:29.015 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:29.015 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643975+0000", 2024-04-18T21:05:29.016 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019584622999999999 2024-04-18T21:05:29.016 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:29.016 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:29.016 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:29.016 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:29.016 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:29.016 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:05:29.016 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:28.911+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:29.017 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:05:29.018 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:29.019+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:29.119 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:29.119+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:29.151 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:05:29.152 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [], 2024-04-18T21:05:29.152 INFO:teuthology.orchestra.run.smithi150.stdout: "num_ops": 0 2024-04-18T21:05:29.152 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:05:29.167 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:05:29.222 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:29.223+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:29.323 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:29.323+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:29.334 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:05:29.334 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [], 2024-04-18T21:05:29.334 INFO:teuthology.orchestra.run.smithi150.stdout: "complaint_time": 30, 2024-04-18T21:05:29.334 INFO:teuthology.orchestra.run.smithi150.stdout: "num_blocked_ops": 0 2024-04-18T21:05:29.334 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:05:29.348 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:05:29.424 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:29.423+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:29.475 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:05:29.475 INFO:teuthology.orchestra.run.smithi150.stdout: "size": 20, 2024-04-18T21:05:29.475 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 600, 2024-04-18T21:05:29.475 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [ 2024-04-18T21:05:29.475 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.475 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-18T21:05:29.475 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:05:29.475 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 34.670372499000003, 2024-04-18T21:05:29.476 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0093051590000000003, 2024-04-18T21:05:29.476 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:29.476 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:29.476 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:29.476 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:29.476 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.476 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:29.476 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:05:29.476 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:29.476 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.476 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.476 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:29.476 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:05:29.476 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:29.476 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.477 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.477 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:29.477 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804851+0000", 2024-04-18T21:05:29.477 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7039999999999999e-06 2024-04-18T21:05:29.477 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.477 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.477 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:29.477 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804864+0000", 2024-04-18T21:05:29.477 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.276e-05 2024-04-18T21:05:29.477 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.477 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.477 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:29.477 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804895+0000", 2024-04-18T21:05:29.477 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.1204999999999997e-05 2024-04-18T21:05:29.477 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.478 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.478 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:29.478 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804908+0000", 2024-04-18T21:05:29.478 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3317e-05 2024-04-18T21:05:29.478 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.478 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.478 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:29.478 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805131+0000", 2024-04-18T21:05:29.478 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00022246700000000001 2024-04-18T21:05:29.478 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.478 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.478 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:29.478 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805171+0000", 2024-04-18T21:05:29.478 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.0164999999999999e-05 2024-04-18T21:05:29.478 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.479 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.479 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:29.479 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814086+0000", 2024-04-18T21:05:29.479 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0089155329999999998 2024-04-18T21:05:29.479 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.479 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.479 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:29.479 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814154+0000", 2024-04-18T21:05:29.479 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.8008000000000003e-05 2024-04-18T21:05:29.479 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:29.479 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:29.479 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:29.479 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.479 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.479 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-18T21:05:29.480 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:05:29.480 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 34.669607306000003, 2024-04-18T21:05:29.480 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0086469770000000001, 2024-04-18T21:05:29.480 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:29.480 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:29.480 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:29.480 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:29.480 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.480 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:29.480 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:05:29.480 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:29.480 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.480 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.480 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:29.480 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:05:29.481 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:29.481 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.481 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.481 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:29.481 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805616+0000", 2024-04-18T21:05:29.481 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7799999999999999e-06 2024-04-18T21:05:29.481 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.481 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.481 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:29.481 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805707+0000", 2024-04-18T21:05:29.481 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0917999999999999e-05 2024-04-18T21:05:29.481 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.481 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.481 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:29.481 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805739+0000", 2024-04-18T21:05:29.482 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.2512000000000003e-05 2024-04-18T21:05:29.482 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.482 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.482 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:29.482 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805763+0000", 2024-04-18T21:05:29.482 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3266000000000001e-05 2024-04-18T21:05:29.482 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.482 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.482 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:29.482 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.806024+0000", 2024-04-18T21:05:29.482 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000261716 2024-04-18T21:05:29.482 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.482 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.483 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:29.483 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.806073+0000", 2024-04-18T21:05:29.483 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.8844999999999997e-05 2024-04-18T21:05:29.483 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.483 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.483 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:29.483 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814162+0000", 2024-04-18T21:05:29.483 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0080882860000000001 2024-04-18T21:05:29.483 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.483 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.483 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:29.483 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814261+0000", 2024-04-18T21:05:29.483 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.9654000000000005e-05 2024-04-18T21:05:29.483 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:29.483 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:29.483 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:29.483 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.484 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.484 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'64)", 2024-04-18T21:05:29.484 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:05:29.484 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 34.667836262000002, 2024-04-18T21:05:29.484 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0089721509999999994, 2024-04-18T21:05:29.484 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:29.484 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:29.484 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:29.484 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:29.484 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.484 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:29.484 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:05:29.484 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:29.484 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.484 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.485 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:29.485 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:05:29.485 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:29.485 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.485 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.485 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:29.485 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807387+0000", 2024-04-18T21:05:29.485 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.0329999999999998e-06 2024-04-18T21:05:29.485 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.485 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.485 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:29.485 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807443+0000", 2024-04-18T21:05:29.485 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.5376e-05 2024-04-18T21:05:29.485 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.485 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.486 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:29.486 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807467+0000", 2024-04-18T21:05:29.486 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.4621999999999999e-05 2024-04-18T21:05:29.486 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.486 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.486 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:29.486 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807482+0000", 2024-04-18T21:05:29.486 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.436e-05 2024-04-18T21:05:29.486 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.486 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.486 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:29.486 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.809243+0000", 2024-04-18T21:05:29.486 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001761725 2024-04-18T21:05:29.486 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.486 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.487 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:29.487 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.809295+0000", 2024-04-18T21:05:29.487 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.1445e-05 2024-04-18T21:05:29.487 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.487 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.487 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:29.487 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.816293+0000", 2024-04-18T21:05:29.487 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0069981749999999997 2024-04-18T21:05:29.487 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.487 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.487 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:29.487 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.816357+0000", 2024-04-18T21:05:29.487 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.4414999999999999e-05 2024-04-18T21:05:29.487 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:29.487 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:29.487 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:29.488 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.488 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.488 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:29.488 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:05:29.488 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 23.859926892000001, 2024-04-18T21:05:29.488 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.040843365, 2024-04-18T21:05:29.488 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:29.488 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:29.488 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:29.488 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:29.488 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.488 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:29.488 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:05:29.488 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:29.488 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.489 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.489 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:29.489 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:05:29.489 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:29.489 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.489 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.489 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:29.489 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615297+0000", 2024-04-18T21:05:29.489 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2800000000000002e-06 2024-04-18T21:05:29.489 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.489 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.489 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:29.489 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615308+0000", 2024-04-18T21:05:29.489 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0813e-05 2024-04-18T21:05:29.489 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.490 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.490 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:29.490 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615330+0000", 2024-04-18T21:05:29.490 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2370000000000001e-05 2024-04-18T21:05:29.490 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.490 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.490 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:29.490 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615346+0000", 2024-04-18T21:05:29.490 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6200000000000001e-05 2024-04-18T21:05:29.490 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.490 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.490 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:29.490 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615470+0000", 2024-04-18T21:05:29.490 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012385799999999999 2024-04-18T21:05:29.491 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.491 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.491 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:05:29.491 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615488+0000", 2024-04-18T21:05:29.491 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7923000000000001e-05 2024-04-18T21:05:29.491 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.491 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.491 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:29.491 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.630993+0000", 2024-04-18T21:05:29.491 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.01550532 2024-04-18T21:05:29.491 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.491 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.491 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:29.491 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631165+0000", 2024-04-18T21:05:29.491 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000171588 2024-04-18T21:05:29.492 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.492 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.492 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:29.492 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631320+0000", 2024-04-18T21:05:29.492 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000155162 2024-04-18T21:05:29.492 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.492 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.492 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:29.492 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635157+0000", 2024-04-18T21:05:29.492 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0038370790000000002 2024-04-18T21:05:29.492 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.492 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.492 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:29.492 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.655904+0000", 2024-04-18T21:05:29.492 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.020746483999999999 2024-04-18T21:05:29.492 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.493 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.493 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:29.493 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656032+0000", 2024-04-18T21:05:29.493 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012864199999999999 2024-04-18T21:05:29.493 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.493 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.493 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:29.493 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656138+0000", 2024-04-18T21:05:29.493 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000105646 2024-04-18T21:05:29.493 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:29.493 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:29.493 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:29.493 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.493 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.493 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:29.494 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:05:29.494 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 23.859834719999998, 2024-04-18T21:05:29.494 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.041266444999999999, 2024-04-18T21:05:29.494 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:29.494 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:29.494 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:29.494 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:29.494 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.494 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:29.494 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:05:29.494 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:29.494 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.494 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.494 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:29.494 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:05:29.495 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:29.495 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.495 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.495 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:29.495 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615388+0000", 2024-04-18T21:05:29.495 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:05:29.495 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.495 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.495 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:29.495 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:05:29.495 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.7299999999999994e-06 2024-04-18T21:05:29.495 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.495 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.495 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:29.495 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615415+0000", 2024-04-18T21:05:29.496 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7807000000000001e-05 2024-04-18T21:05:29.496 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.496 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.496 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:29.496 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615431+0000", 2024-04-18T21:05:29.496 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6127e-05 2024-04-18T21:05:29.496 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.496 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.496 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:29.496 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615621+0000", 2024-04-18T21:05:29.496 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000189781 2024-04-18T21:05:29.496 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.496 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.496 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:29.496 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615634+0000", 2024-04-18T21:05:29.497 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3383e-05 2024-04-18T21:05:29.497 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.497 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.497 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:29.497 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631703+0000", 2024-04-18T21:05:29.497 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016068737 2024-04-18T21:05:29.497 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.497 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.497 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:29.497 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631809+0000", 2024-04-18T21:05:29.497 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000106823 2024-04-18T21:05:29.497 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.497 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.497 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:29.497 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631988+0000", 2024-04-18T21:05:29.497 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000179008 2024-04-18T21:05:29.498 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.498 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.498 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:29.498 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635172+0000", 2024-04-18T21:05:29.498 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.003183029 2024-04-18T21:05:29.498 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.498 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.498 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:29.498 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656392+0000", 2024-04-18T21:05:29.498 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.021220638999999999 2024-04-18T21:05:29.498 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.498 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.498 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:29.498 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656533+0000", 2024-04-18T21:05:29.499 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014126500000000001 2024-04-18T21:05:29.499 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.499 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.499 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:29.499 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656653+0000", 2024-04-18T21:05:29.499 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000119883 2024-04-18T21:05:29.499 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:29.499 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:29.499 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:29.499 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.499 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.499 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:29.499 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:05:29.499 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 23.859747296999998, 2024-04-18T21:05:29.499 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.042492302000000003, 2024-04-18T21:05:29.500 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:29.500 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:29.500 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:29.500 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:29.500 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.500 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:29.500 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:05:29.500 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:29.500 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.500 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.500 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:29.500 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:05:29.500 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:29.500 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.500 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.500 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:29.501 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615475+0000", 2024-04-18T21:05:29.501 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.17e-06 2024-04-18T21:05:29.501 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.501 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.501 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:29.501 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615528+0000", 2024-04-18T21:05:29.501 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.2159e-05 2024-04-18T21:05:29.501 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.501 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.501 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:29.501 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615542+0000", 2024-04-18T21:05:29.501 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4197e-05 2024-04-18T21:05:29.501 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.501 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.501 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:29.502 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615559+0000", 2024-04-18T21:05:29.502 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.749e-05 2024-04-18T21:05:29.502 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.502 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.502 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:29.502 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615685+0000", 2024-04-18T21:05:29.502 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012617499999999999 2024-04-18T21:05:29.502 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.502 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.502 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:05:29.502 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:05:29.502 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4749999999999999e-05 2024-04-18T21:05:29.502 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.502 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.503 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:29.503 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632332+0000", 2024-04-18T21:05:29.503 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016631988 2024-04-18T21:05:29.503 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.503 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.503 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:29.503 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632477+0000", 2024-04-18T21:05:29.503 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014437200000000001 2024-04-18T21:05:29.503 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.503 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.503 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:29.503 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632620+0000", 2024-04-18T21:05:29.503 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000143566 2024-04-18T21:05:29.503 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.503 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.504 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:29.504 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635185+0000", 2024-04-18T21:05:29.504 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0025644209999999999 2024-04-18T21:05:29.504 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.504 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.504 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:29.504 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657803+0000", 2024-04-18T21:05:29.504 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.022618743 2024-04-18T21:05:29.504 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.504 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.504 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:29.504 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657890+0000", 2024-04-18T21:05:29.504 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.6688999999999996e-05 2024-04-18T21:05:29.504 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.504 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.504 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:29.505 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657967+0000", 2024-04-18T21:05:29.505 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.6582000000000006e-05 2024-04-18T21:05:29.505 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:29.505 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:29.505 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:29.505 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.505 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.505 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:29.505 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:05:29.505 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 23.859616485, 2024-04-18T21:05:29.505 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.043603435000000003, 2024-04-18T21:05:29.505 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:29.505 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:29.505 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:29.505 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:29.506 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.506 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:29.506 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:05:29.506 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:29.506 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.506 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.506 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:29.506 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:05:29.506 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:29.506 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.506 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.506 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:29.506 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615607+0000", 2024-04-18T21:05:29.506 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4300000000000001e-06 2024-04-18T21:05:29.506 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.507 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.507 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:29.507 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615614+0000", 2024-04-18T21:05:29.507 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.4100000000000002e-06 2024-04-18T21:05:29.507 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.507 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.507 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:29.507 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615632+0000", 2024-04-18T21:05:29.507 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7863000000000002e-05 2024-04-18T21:05:29.507 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.507 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.507 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:29.507 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615647+0000", 2024-04-18T21:05:29.507 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5187e-05 2024-04-18T21:05:29.507 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.508 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.508 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:29.508 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615765+0000", 2024-04-18T21:05:29.508 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000117955 2024-04-18T21:05:29.508 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.508 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.508 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:29.508 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615781+0000", 2024-04-18T21:05:29.508 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6123000000000001e-05 2024-04-18T21:05:29.508 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.508 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.508 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:29.508 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633055+0000", 2024-04-18T21:05:29.508 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.017273909 2024-04-18T21:05:29.508 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.508 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.509 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:29.509 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633254+0000", 2024-04-18T21:05:29.509 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00019903799999999999 2024-04-18T21:05:29.509 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.509 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.509 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:29.509 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633624+0000", 2024-04-18T21:05:29.509 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000369656 2024-04-18T21:05:29.509 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.509 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.509 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:29.509 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635595+0000", 2024-04-18T21:05:29.509 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001971287 2024-04-18T21:05:29.509 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.509 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.510 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:29.510 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659026+0000", 2024-04-18T21:05:29.510 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.023431495 2024-04-18T21:05:29.510 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.510 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.510 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:29.510 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659117+0000", 2024-04-18T21:05:29.510 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0885999999999997e-05 2024-04-18T21:05:29.510 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.510 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.510 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:29.510 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659209+0000", 2024-04-18T21:05:29.510 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.1195999999999999e-05 2024-04-18T21:05:29.510 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:29.511 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:29.511 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:29.511 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.511 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.511 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:29.511 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:29.511 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 23.859551256, 2024-04-18T21:05:29.511 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.03492514, 2024-04-18T21:05:29.511 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:29.511 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:29.511 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:29.511 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:29.511 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.511 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:29.511 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:29.511 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:29.512 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.512 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.512 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:29.512 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:29.512 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:29.512 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.512 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.512 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:29.512 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:05:29.512 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.407e-06 2024-04-18T21:05:29.512 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.512 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.512 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:29.512 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615679+0000", 2024-04-18T21:05:29.512 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.2130000000000002e-06 2024-04-18T21:05:29.513 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.513 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.513 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:29.513 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615701+0000", 2024-04-18T21:05:29.513 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2316000000000001e-05 2024-04-18T21:05:29.513 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.513 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.513 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:29.513 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615717+0000", 2024-04-18T21:05:29.513 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6197000000000001e-05 2024-04-18T21:05:29.513 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.513 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.513 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:29.513 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615828+0000", 2024-04-18T21:05:29.514 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000110899 2024-04-18T21:05:29.514 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.514 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.514 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:05:29.514 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615840+0000", 2024-04-18T21:05:29.514 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.1423000000000001e-05 2024-04-18T21:05:29.514 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.514 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.514 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:29.514 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628046+0000", 2024-04-18T21:05:29.514 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.012206295000000001 2024-04-18T21:05:29.514 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.514 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.514 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:29.514 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628323+0000", 2024-04-18T21:05:29.515 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00027658700000000001 2024-04-18T21:05:29.515 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.515 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.515 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:29.515 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628599+0000", 2024-04-18T21:05:29.515 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00027676699999999997 2024-04-18T21:05:29.515 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.515 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.515 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:29.515 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634869+0000", 2024-04-18T21:05:29.515 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.006269536 2024-04-18T21:05:29.515 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.515 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.515 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:29.515 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650333+0000", 2024-04-18T21:05:29.516 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.015463645999999999 2024-04-18T21:05:29.516 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.516 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.516 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:29.516 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650474+0000", 2024-04-18T21:05:29.516 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014091799999999999 2024-04-18T21:05:29.516 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.516 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.516 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:29.516 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650595+0000", 2024-04-18T21:05:29.516 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012193600000000001 2024-04-18T21:05:29.516 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:29.516 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:29.516 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:29.516 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.517 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.517 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:29.517 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:05:29.517 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 23.859466146999999, 2024-04-18T21:05:29.517 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.040588320999999997, 2024-04-18T21:05:29.517 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:29.517 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:29.517 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:29.517 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:29.517 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.517 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:29.517 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:05:29.517 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:29.517 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.518 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.518 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:29.518 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:05:29.518 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:29.518 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.518 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.518 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:29.518 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615757+0000", 2024-04-18T21:05:29.518 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2270000000000001e-06 2024-04-18T21:05:29.518 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.518 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.518 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:29.518 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615765+0000", 2024-04-18T21:05:29.518 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.9400000000000002e-06 2024-04-18T21:05:29.519 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.519 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.519 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:29.519 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615785+0000", 2024-04-18T21:05:29.519 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.0749000000000001e-05 2024-04-18T21:05:29.519 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.519 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.519 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:29.519 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615804+0000", 2024-04-18T21:05:29.519 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.8774e-05 2024-04-18T21:05:29.519 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.519 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.519 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:29.519 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615888+0000", 2024-04-18T21:05:29.519 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.4111999999999997e-05 2024-04-18T21:05:29.519 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.520 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.520 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:29.520 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615895+0000", 2024-04-18T21:05:29.520 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.0469999999999996e-06 2024-04-18T21:05:29.520 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.520 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.520 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:29.520 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629280+0000", 2024-04-18T21:05:29.520 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.013384416 2024-04-18T21:05:29.520 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.520 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.520 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:29.520 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629488+0000", 2024-04-18T21:05:29.520 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00020852800000000001 2024-04-18T21:05:29.520 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.521 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.521 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:29.521 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629869+0000", 2024-04-18T21:05:29.521 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00038042300000000001 2024-04-18T21:05:29.521 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.521 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.521 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:29.521 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635041+0000", 2024-04-18T21:05:29.521 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.005172383 2024-04-18T21:05:29.521 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.521 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.521 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:29.521 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656125+0000", 2024-04-18T21:05:29.521 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.021084025999999999 2024-04-18T21:05:29.522 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.522 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.522 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:29.522 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656240+0000", 2024-04-18T21:05:29.522 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000115352 2024-04-18T21:05:29.522 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.522 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.522 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:29.522 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656344+0000", 2024-04-18T21:05:29.522 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00010334400000000001 2024-04-18T21:05:29.522 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:29.522 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:29.522 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:29.523 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.523 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.523 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:29.523 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:05:29.523 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 23.859398827, 2024-04-18T21:05:29.523 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.043549577999999999, 2024-04-18T21:05:29.523 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:29.523 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:29.523 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:29.523 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:29.523 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.523 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:29.523 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:05:29.523 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:29.523 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.523 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.524 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:29.524 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:05:29.524 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:29.524 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.524 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.524 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:29.524 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:05:29.524 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.5000000000000002e-07 2024-04-18T21:05:29.524 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.524 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.524 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:29.524 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615828+0000", 2024-04-18T21:05:29.524 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.2359999999999998e-06 2024-04-18T21:05:29.524 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.524 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.525 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:29.525 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615838+0000", 2024-04-18T21:05:29.525 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0087e-05 2024-04-18T21:05:29.525 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.525 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.525 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:29.525 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615846+0000", 2024-04-18T21:05:29.525 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.67e-06 2024-04-18T21:05:29.525 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.525 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.525 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:29.525 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615963+0000", 2024-04-18T21:05:29.525 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00011630500000000001 2024-04-18T21:05:29.525 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.525 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.526 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:29.526 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615979+0000", 2024-04-18T21:05:29.526 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.613e-05 2024-04-18T21:05:29.526 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.526 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.526 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:29.526 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632392+0000", 2024-04-18T21:05:29.526 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016413317 2024-04-18T21:05:29.526 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.526 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.526 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:29.526 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632568+0000", 2024-04-18T21:05:29.526 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00017539500000000001 2024-04-18T21:05:29.526 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.527 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.527 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:29.527 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632748+0000", 2024-04-18T21:05:29.527 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00017991799999999999 2024-04-18T21:05:29.527 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.527 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.527 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:29.527 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635542+0000", 2024-04-18T21:05:29.527 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00279481 2024-04-18T21:05:29.527 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.527 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.527 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:29.527 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659232+0000", 2024-04-18T21:05:29.527 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.023689212000000001 2024-04-18T21:05:29.527 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.527 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.528 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:29.528 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659314+0000", 2024-04-18T21:05:29.528 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.2528999999999995e-05 2024-04-18T21:05:29.528 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.528 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.528 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:29.528 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659372+0000", 2024-04-18T21:05:29.528 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.8218999999999999e-05 2024-04-18T21:05:29.528 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:29.528 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:29.528 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:29.528 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.528 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.528 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:29.528 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:05:29.529 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 23.859337395000001, 2024-04-18T21:05:29.529 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.039335347, 2024-04-18T21:05:29.529 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:29.529 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:29.529 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "started", 2024-04-18T21:05:29.529 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:29.529 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.529 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:29.529 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:05:29.529 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:29.529 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.529 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.529 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:29.529 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:05:29.529 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:29.530 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.530 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.530 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:29.530 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615885+0000", 2024-04-18T21:05:29.530 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2699999999999999e-06 2024-04-18T21:05:29.530 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.530 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.530 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:29.530 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615892+0000", 2024-04-18T21:05:29.530 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.6499999999999999e-06 2024-04-18T21:05:29.530 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.530 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.530 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:29.530 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615906+0000", 2024-04-18T21:05:29.531 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.393e-05 2024-04-18T21:05:29.531 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.531 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.531 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:29.531 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615919+0000", 2024-04-18T21:05:29.531 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2860000000000001e-05 2024-04-18T21:05:29.531 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.531 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.531 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:29.531 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616027+0000", 2024-04-18T21:05:29.531 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000107852 2024-04-18T21:05:29.531 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.531 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.531 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:05:29.531 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616037+0000", 2024-04-18T21:05:29.532 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:05:29.532 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.532 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.532 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:29.532 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622719+0000", 2024-04-18T21:05:29.532 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0066817220000000002 2024-04-18T21:05:29.532 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.532 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.532 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:29.532 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623006+0000", 2024-04-18T21:05:29.532 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00028783699999999999 2024-04-18T21:05:29.532 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.532 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.532 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:29.532 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.655220+0000", 2024-04-18T21:05:29.532 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.032213036 2024-04-18T21:05:29.533 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:29.533 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:29.533 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:29.533 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.533 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.533 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:29.533 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:29.533 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 23.859281721999999, 2024-04-18T21:05:29.533 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.032845253999999997, 2024-04-18T21:05:29.533 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:29.533 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:29.533 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "started", 2024-04-18T21:05:29.533 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:29.533 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.533 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:29.534 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:29.534 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:29.534 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.534 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.534 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:29.534 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:29.534 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:29.534 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.534 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.534 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:29.534 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615942+0000", 2024-04-18T21:05:29.534 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.717e-06 2024-04-18T21:05:29.534 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.535 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.535 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:29.535 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615946+0000", 2024-04-18T21:05:29.535 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.6e-06 2024-04-18T21:05:29.535 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.535 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.535 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:29.535 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615960+0000", 2024-04-18T21:05:29.535 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:05:29.535 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.535 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.535 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:29.535 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615968+0000", 2024-04-18T21:05:29.535 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.9070000000000007e-06 2024-04-18T21:05:29.535 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.536 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.536 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:29.536 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616100+0000", 2024-04-18T21:05:29.536 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000132402 2024-04-18T21:05:29.536 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.536 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.536 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:05:29.536 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616117+0000", 2024-04-18T21:05:29.536 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6653000000000001e-05 2024-04-18T21:05:29.536 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.536 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.536 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:29.536 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621566+0000", 2024-04-18T21:05:29.536 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0054497740000000001 2024-04-18T21:05:29.536 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.537 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.537 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:29.537 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622801+0000", 2024-04-18T21:05:29.537 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0012345710000000001 2024-04-18T21:05:29.537 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.537 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.537 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:29.537 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648785+0000", 2024-04-18T21:05:29.537 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.025984104000000001 2024-04-18T21:05:29.537 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:29.537 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:29.537 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:29.537 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.537 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.537 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:29.538 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:05:29.538 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 23.853430371999998, 2024-04-18T21:05:29.538 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.011561350999999999, 2024-04-18T21:05:29.538 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:29.538 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:29.538 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:29.538 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:29.538 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.538 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:29.538 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:05:29.538 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:29.538 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.538 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.538 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:29.538 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:05:29.539 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:29.539 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.539 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.539 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:29.539 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621792+0000", 2024-04-18T21:05:29.539 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.4000000000000001e-07 2024-04-18T21:05:29.539 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.539 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.539 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:29.539 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:05:29.539 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.1050000000000002e-05 2024-04-18T21:05:29.539 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.539 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.539 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:29.540 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622608+0000", 2024-04-18T21:05:29.540 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00077505900000000003 2024-04-18T21:05:29.540 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.540 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.540 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:29.540 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623879+0000", 2024-04-18T21:05:29.540 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0012705839999999999 2024-04-18T21:05:29.540 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.540 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.540 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:29.540 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624010+0000", 2024-04-18T21:05:29.540 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00013176900000000001 2024-04-18T21:05:29.540 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.540 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.541 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:29.541 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624058+0000", 2024-04-18T21:05:29.541 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.7299000000000002e-05 2024-04-18T21:05:29.541 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.541 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.541 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:29.541 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633262+0000", 2024-04-18T21:05:29.541 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0092048770000000002 2024-04-18T21:05:29.541 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.541 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.541 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:29.541 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633353+0000", 2024-04-18T21:05:29.541 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0073000000000003e-05 2024-04-18T21:05:29.541 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:29.542 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:29.542 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:29.542 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.542 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.542 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:29.542 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:05:29.542 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 23.851302986, 2024-04-18T21:05:29.542 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0098419370000000003, 2024-04-18T21:05:29.542 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:29.542 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:29.542 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:29.542 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:29.542 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.542 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:29.542 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:05:29.543 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:29.543 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.543 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.543 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:29.543 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:05:29.543 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:29.543 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.543 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.543 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:29.543 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623920+0000", 2024-04-18T21:05:29.543 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2240000000000001e-06 2024-04-18T21:05:29.543 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.543 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.543 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:29.543 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623933+0000", 2024-04-18T21:05:29.544 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3653e-05 2024-04-18T21:05:29.544 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.544 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.544 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:29.544 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623956+0000", 2024-04-18T21:05:29.544 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2059e-05 2024-04-18T21:05:29.544 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.544 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.544 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:29.544 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623975+0000", 2024-04-18T21:05:29.544 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.9806999999999999e-05 2024-04-18T21:05:29.544 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.544 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.544 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:29.544 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626943+0000", 2024-04-18T21:05:29.545 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0029681579999999998 2024-04-18T21:05:29.545 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.545 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.545 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:29.545 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626993+0000", 2024-04-18T21:05:29.545 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.9935999999999998e-05 2024-04-18T21:05:29.545 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.545 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.545 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:29.545 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633665+0000", 2024-04-18T21:05:29.545 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0066719250000000004 2024-04-18T21:05:29.545 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.545 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.545 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:29.545 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633761+0000", 2024-04-18T21:05:29.546 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.5174999999999996e-05 2024-04-18T21:05:29.546 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:29.546 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:29.546 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:29.546 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.546 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.546 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:29.546 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:05:29.546 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 23.850471367000001, 2024-04-18T21:05:29.546 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0090159079999999996, 2024-04-18T21:05:29.546 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:29.546 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:29.546 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:29.546 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:29.546 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.547 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:29.547 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:05:29.547 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:29.547 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.547 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.547 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:29.547 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:05:29.547 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:29.547 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.547 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.547 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:29.547 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624751+0000", 2024-04-18T21:05:29.547 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.7600000000000006e-07 2024-04-18T21:05:29.547 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.547 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.548 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:29.548 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624787+0000", 2024-04-18T21:05:29.548 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.6273000000000003e-05 2024-04-18T21:05:29.548 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.548 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.548 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:29.548 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625837+0000", 2024-04-18T21:05:29.548 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00104992 2024-04-18T21:05:29.548 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.548 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.548 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:29.548 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625860+0000", 2024-04-18T21:05:29.548 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3110000000000001e-05 2024-04-18T21:05:29.548 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.548 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.549 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:29.549 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625984+0000", 2024-04-18T21:05:29.549 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012399199999999999 2024-04-18T21:05:29.549 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.549 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.549 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:29.549 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626030+0000", 2024-04-18T21:05:29.549 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.5429999999999997e-05 2024-04-18T21:05:29.549 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.549 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.549 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:29.549 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633643+0000", 2024-04-18T21:05:29.549 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0076129320000000002 2024-04-18T21:05:29.549 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.549 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.550 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:29.550 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633766+0000", 2024-04-18T21:05:29.550 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000123275 2024-04-18T21:05:29.550 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:29.550 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:29.550 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:29.550 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.550 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.550 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:29.550 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:05:29.550 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 23.849217642999999, 2024-04-18T21:05:29.550 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0088669170000000002, 2024-04-18T21:05:29.550 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:29.550 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:29.551 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:29.551 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:29.551 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.551 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:29.551 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:05:29.551 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:29.551 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.551 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.551 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:29.551 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:05:29.551 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:29.551 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.551 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.551 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:29.552 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626005+0000", 2024-04-18T21:05:29.552 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.5000000000000001e-07 2024-04-18T21:05:29.552 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.552 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.552 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:29.552 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626028+0000", 2024-04-18T21:05:29.552 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2756999999999999e-05 2024-04-18T21:05:29.552 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.552 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.552 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:29.552 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626050+0000", 2024-04-18T21:05:29.552 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2140000000000001e-05 2024-04-18T21:05:29.552 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.552 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.552 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:29.553 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626065+0000", 2024-04-18T21:05:29.553 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5176e-05 2024-04-18T21:05:29.553 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.553 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.553 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:29.553 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628334+0000", 2024-04-18T21:05:29.553 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0022691439999999998 2024-04-18T21:05:29.553 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.553 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.553 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:29.553 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628379+0000", 2024-04-18T21:05:29.553 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.5420000000000002e-05 2024-04-18T21:05:29.553 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.553 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.553 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:29.554 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634770+0000", 2024-04-18T21:05:29.554 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0063908410000000004 2024-04-18T21:05:29.554 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.554 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.554 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:29.554 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634871+0000", 2024-04-18T21:05:29.554 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000100589 2024-04-18T21:05:29.554 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:29.554 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:29.554 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:29.554 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.554 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.554 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:13 3.10 e17/15 3:0d89b25e:::603.00000000:head v 17'8, mlcod=0'0)", 2024-04-18T21:05:29.554 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:05:29.555 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 23.830384213999999, 2024-04-18T21:05:29.555 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0090974379999999994, 2024-04-18T21:05:29.555 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:29.555 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:29.555 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:29.555 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:29.555 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.555 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:29.555 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:05:29.555 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:29.555 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.555 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.555 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:29.555 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:05:29.555 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:29.556 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.556 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.556 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:29.556 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644838+0000", 2024-04-18T21:05:29.556 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.569999999999999e-07 2024-04-18T21:05:29.556 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.556 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.556 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:29.556 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644846+0000", 2024-04-18T21:05:29.556 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.4499999999999998e-06 2024-04-18T21:05:29.556 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.556 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.556 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:29.556 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644861+0000", 2024-04-18T21:05:29.556 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5243e-05 2024-04-18T21:05:29.556 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.557 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.557 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:29.557 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644997+0000", 2024-04-18T21:05:29.557 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000135609 2024-04-18T21:05:29.557 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.557 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.557 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:29.557 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649150+0000", 2024-04-18T21:05:29.557 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0041536760000000002 2024-04-18T21:05:29.557 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.557 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.557 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:29.557 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649207+0000", 2024-04-18T21:05:29.557 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.6677e-05 2024-04-18T21:05:29.557 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.558 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.558 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:29.558 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.653840+0000", 2024-04-18T21:05:29.558 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0046329700000000001 2024-04-18T21:05:29.558 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.558 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.558 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:29.558 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.653935+0000", 2024-04-18T21:05:29.558 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.4856000000000001e-05 2024-04-18T21:05:29.558 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:29.558 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:29.558 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:29.558 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.558 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.559 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 3 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:05:29.559 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:05:29.559 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 23.827595054, 2024-04-18T21:05:29.559 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0087842319999999995, 2024-04-18T21:05:29.559 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:29.559 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:29.559 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "reached pg", 2024-04-18T21:05:29.559 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:29.559 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.559 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:29.559 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:05:29.559 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:29.559 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.559 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.560 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:29.560 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:05:29.560 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:29.560 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.560 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.560 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:29.560 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:05:29.560 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.8299999999999996e-07 2024-04-18T21:05:29.560 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.560 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.560 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:29.560 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647642+0000", 2024-04-18T21:05:29.560 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4724e-05 2024-04-18T21:05:29.560 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.560 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.561 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:29.561 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647679+0000", 2024-04-18T21:05:29.561 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.6662999999999998e-05 2024-04-18T21:05:29.561 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.561 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.561 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:29.561 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647735+0000", 2024-04-18T21:05:29.561 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.6196000000000002e-05 2024-04-18T21:05:29.561 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.561 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.561 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:29.561 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649865+0000", 2024-04-18T21:05:29.561 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0021299489999999999 2024-04-18T21:05:29.561 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.561 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.562 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:29.562 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656411+0000", 2024-04-18T21:05:29.562 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0065460170000000003 2024-04-18T21:05:29.562 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:29.562 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:29.562 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:29.562 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.562 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.562 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:29.562 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:05:29.562 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 23.827449858000001, 2024-04-18T21:05:29.562 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0095703190000000007, 2024-04-18T21:05:29.562 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:29.562 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:29.562 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:29.563 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:29.563 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.563 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:29.563 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:05:29.563 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:29.563 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.563 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.563 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:29.563 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:05:29.563 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:29.563 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.563 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.563 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:29.563 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647773+0000", 2024-04-18T21:05:29.563 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.046e-06 2024-04-18T21:05:29.563 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.564 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.564 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:29.564 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647795+0000", 2024-04-18T21:05:29.564 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2616000000000002e-05 2024-04-18T21:05:29.564 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.564 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.564 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:29.564 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647818+0000", 2024-04-18T21:05:29.564 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3110000000000001e-05 2024-04-18T21:05:29.564 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.564 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.564 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:29.564 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647834+0000", 2024-04-18T21:05:29.564 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5163e-05 2024-04-18T21:05:29.564 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.564 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.565 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:29.565 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650682+0000", 2024-04-18T21:05:29.565 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0028479759999999999 2024-04-18T21:05:29.565 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.565 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.565 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:29.565 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650730+0000", 2024-04-18T21:05:29.565 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.8375999999999999e-05 2024-04-18T21:05:29.565 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.565 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.565 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:29.565 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656751+0000", 2024-04-18T21:05:29.565 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0060211880000000002 2024-04-18T21:05:29.565 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.565 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.566 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:29.566 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657342+0000", 2024-04-18T21:05:29.566 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00059084399999999998 2024-04-18T21:05:29.566 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:29.566 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:29.566 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:29.566 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.566 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.566 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:29.566 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:05:29.566 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 23.827037572000002, 2024-04-18T21:05:29.566 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0092471759999999993, 2024-04-18T21:05:29.566 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:29.567 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:29.567 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:29.567 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:29.567 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.567 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:29.567 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:05:29.567 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:29.567 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.567 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.567 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:29.567 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:05:29.567 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:29.567 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.567 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.567 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:29.567 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648185+0000", 2024-04-18T21:05:29.568 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.5000000000000001e-07 2024-04-18T21:05:29.568 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.568 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.568 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:29.568 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648203+0000", 2024-04-18T21:05:29.568 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.8102999999999999e-05 2024-04-18T21:05:29.568 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.568 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.568 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:29.568 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648226+0000", 2024-04-18T21:05:29.568 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2921999999999998e-05 2024-04-18T21:05:29.568 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.568 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.568 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:29.568 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648241+0000", 2024-04-18T21:05:29.569 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5336999999999999e-05 2024-04-18T21:05:29.569 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.569 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.569 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:29.569 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.651268+0000", 2024-04-18T21:05:29.569 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0030271640000000002 2024-04-18T21:05:29.569 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.569 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.569 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:29.569 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.651319+0000", 2024-04-18T21:05:29.569 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.0843000000000001e-05 2024-04-18T21:05:29.569 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.569 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.569 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:29.569 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657347+0000", 2024-04-18T21:05:29.570 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0060279770000000003 2024-04-18T21:05:29.570 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:29.570 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:29.570 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:29.570 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657431+0000", 2024-04-18T21:05:29.570 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.3980000000000006e-05 2024-04-18T21:05:29.570 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:29.570 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:29.570 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:29.570 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:29.570 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:29.570 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:05:29.572 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:05:29.572 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:29.571+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:29.673 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:29.675+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:29.703 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:05:29.703 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:05:29.703 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-04-18T21:05:29.703 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:05:29.717 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:05:29.805 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-18T21:05:29.805 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:29.807+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:29.874 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:29.875+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:29.884 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:05:29.884 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:05:29.884 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-18T21:05:29.884 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-18T21:05:29.884 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:05:29.898 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:05:29.975 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:29.975+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:30.059 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:05:30.060 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-18T21:05:30.060 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-18T21:05:30.060 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:05:30.060 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.060 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:30.061 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:05:30.061 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 24.445236947000001, 2024-04-18T21:05:30.061 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.034065303999999998, 2024-04-18T21:05:30.061 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:30.061 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:30.061 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:30.061 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:30.061 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.061 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:30.061 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:05:30.061 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:30.061 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.061 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.062 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:30.062 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:05:30.062 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:30.062 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.062 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.062 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:30.062 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615254+0000", 2024-04-18T21:05:30.062 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7829999999999999e-06 2024-04-18T21:05:30.062 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.062 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.062 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:30.063 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615267+0000", 2024-04-18T21:05:30.063 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3334e-05 2024-04-18T21:05:30.063 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.063 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.063 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:30.063 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615294+0000", 2024-04-18T21:05:30.063 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7271999999999999e-05 2024-04-18T21:05:30.063 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.063 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.063 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:30.063 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615321+0000", 2024-04-18T21:05:30.063 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.637e-05 2024-04-18T21:05:30.063 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.063 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.064 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:30.064 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615479+0000", 2024-04-18T21:05:30.064 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000158493 2024-04-18T21:05:30.064 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.064 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.064 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:30.064 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615498+0000", 2024-04-18T21:05:30.064 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9148999999999999e-05 2024-04-18T21:05:30.064 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.064 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.064 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:30.064 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632915+0000", 2024-04-18T21:05:30.064 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.017416551999999998 2024-04-18T21:05:30.064 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.065 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.065 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:30.065 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633302+0000", 2024-04-18T21:05:30.065 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00038725000000000001 2024-04-18T21:05:30.065 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.065 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.065 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:30.065 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633638+0000", 2024-04-18T21:05:30.065 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000335946 2024-04-18T21:05:30.065 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.065 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.065 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:30.065 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645976+0000", 2024-04-18T21:05:30.065 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012337617 2024-04-18T21:05:30.065 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.066 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.066 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:30.066 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649080+0000", 2024-04-18T21:05:30.066 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031038929999999999 2024-04-18T21:05:30.066 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.066 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.066 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:30.066 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649207+0000", 2024-04-18T21:05:30.066 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000127537 2024-04-18T21:05:30.066 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.066 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.066 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:30.066 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649316+0000", 2024-04-18T21:05:30.066 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109108 2024-04-18T21:05:30.066 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:30.067 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:30.067 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:30.067 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.067 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.067 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:30.067 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:05:30.067 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 24.445103570000001, 2024-04-18T21:05:30.067 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036275764000000002, 2024-04-18T21:05:30.067 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:30.067 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:30.067 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:30.067 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:30.067 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.067 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:30.068 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:05:30.068 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:30.068 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.068 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.068 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:30.068 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:05:30.068 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:30.068 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.068 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.068 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:30.068 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615386+0000", 2024-04-18T21:05:30.068 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.573e-06 2024-04-18T21:05:30.068 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.069 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.069 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:30.069 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:05:30.069 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0723999999999999e-05 2024-04-18T21:05:30.069 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.069 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.069 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:30.069 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615418+0000", 2024-04-18T21:05:30.069 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0902000000000001e-05 2024-04-18T21:05:30.069 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.069 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.069 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:30.069 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615433+0000", 2024-04-18T21:05:30.069 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5319999999999999e-05 2024-04-18T21:05:30.069 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.069 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.070 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:30.070 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615659+0000", 2024-04-18T21:05:30.070 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000226095 2024-04-18T21:05:30.070 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.070 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.070 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:30.070 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:30.070 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1276e-05 2024-04-18T21:05:30.070 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.070 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.070 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:30.070 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643654+0000", 2024-04-18T21:05:30.070 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027983238000000001 2024-04-18T21:05:30.070 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.071 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.071 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:30.071 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643868+0000", 2024-04-18T21:05:30.071 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000214305 2024-04-18T21:05:30.071 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.071 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.071 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:30.071 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:05:30.071 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035892200000000002 2024-04-18T21:05:30.071 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.071 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.071 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:30.071 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646056+0000", 2024-04-18T21:05:30.071 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001829172 2024-04-18T21:05:30.071 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.072 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.072 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:30.072 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651406+0000", 2024-04-18T21:05:30.072 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0053504800000000003 2024-04-18T21:05:30.072 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.072 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.072 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:30.072 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651551+0000", 2024-04-18T21:05:30.072 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014427999999999999 2024-04-18T21:05:30.072 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.072 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.072 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:30.072 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651660+0000", 2024-04-18T21:05:30.073 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109477 2024-04-18T21:05:30.073 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:30.073 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:30.073 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:30.073 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.073 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.073 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:30.073 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:05:30.073 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 24.445030188, 2024-04-18T21:05:30.073 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045668994999999997, 2024-04-18T21:05:30.073 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:30.073 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:30.073 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:30.074 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:30.074 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.074 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:30.074 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:05:30.074 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:30.074 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.074 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.074 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:30.074 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:05:30.074 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:30.074 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.074 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.074 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:30.074 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615459+0000", 2024-04-18T21:05:30.075 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5030000000000001e-06 2024-04-18T21:05:30.075 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.075 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.075 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:30.075 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615506+0000", 2024-04-18T21:05:30.075 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6872000000000001e-05 2024-04-18T21:05:30.075 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.075 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.075 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:30.075 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615527+0000", 2024-04-18T21:05:30.075 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0763000000000001e-05 2024-04-18T21:05:30.075 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.075 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.076 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:30.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615551+0000", 2024-04-18T21:05:30.076 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4159e-05 2024-04-18T21:05:30.076 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.076 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.076 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:30.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615736+0000", 2024-04-18T21:05:30.076 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018499599999999999 2024-04-18T21:05:30.076 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.076 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.076 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:30.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615748+0000", 2024-04-18T21:05:30.076 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2272999999999999e-05 2024-04-18T21:05:30.077 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.077 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.077 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:30.077 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635481+0000", 2024-04-18T21:05:30.077 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019732772999999999 2024-04-18T21:05:30.077 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.077 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.077 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:30.077 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635791+0000", 2024-04-18T21:05:30.077 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031013299999999998 2024-04-18T21:05:30.077 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.077 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.077 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:30.077 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636101+0000", 2024-04-18T21:05:30.078 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030943300000000002 2024-04-18T21:05:30.078 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.078 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.078 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:30.078 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646043+0000", 2024-04-18T21:05:30.078 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099428139999999995 2024-04-18T21:05:30.078 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.078 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.078 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:30.078 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660991+0000", 2024-04-18T21:05:30.078 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014947142 2024-04-18T21:05:30.078 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.078 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.079 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:30.079 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661061+0000", 2024-04-18T21:05:30.079 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0438000000000006e-05 2024-04-18T21:05:30.079 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.079 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.079 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:30.079 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661127+0000", 2024-04-18T21:05:30.079 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5696000000000003e-05 2024-04-18T21:05:30.079 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:30.079 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:30.079 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:30.079 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.079 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.079 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:30.079 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:30.079 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 24.444817759999999, 2024-04-18T21:05:30.080 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045745085999999997, 2024-04-18T21:05:30.080 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:30.080 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:30.080 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:30.081 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:30.081 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.081 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:30.081 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:30.081 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:30.081 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.081 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.081 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:30.081 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:30.081 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:30.081 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.081 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.081 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:30.081 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:05:30.082 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7400000000000001e-06 2024-04-18T21:05:30.082 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.082 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.082 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:30.082 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:05:30.082 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8133e-05 2024-04-18T21:05:30.082 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.082 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.082 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:30.082 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615726+0000", 2024-04-18T21:05:30.082 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6132e-05 2024-04-18T21:05:30.082 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.082 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.082 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:30.083 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615742+0000", 2024-04-18T21:05:30.083 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6157000000000001e-05 2024-04-18T21:05:30.083 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.083 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.083 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:30.083 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615937+0000", 2024-04-18T21:05:30.083 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000194768 2024-04-18T21:05:30.083 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.083 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.083 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:30.083 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615950+0000", 2024-04-18T21:05:30.083 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3084e-05 2024-04-18T21:05:30.083 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.083 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.083 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:30.084 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643676+0000", 2024-04-18T21:05:30.084 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027725639999999999 2024-04-18T21:05:30.084 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.084 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.084 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:30.084 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643867+0000", 2024-04-18T21:05:30.084 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019075900000000001 2024-04-18T21:05:30.084 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.084 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.084 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:30.084 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:05:30.084 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036013799999999997 2024-04-18T21:05:30.084 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.084 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.085 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:30.085 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646068+0000", 2024-04-18T21:05:30.085 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001841536 2024-04-18T21:05:30.085 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.085 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.085 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:30.085 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661184+0000", 2024-04-18T21:05:30.085 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015115458999999999 2024-04-18T21:05:30.085 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.085 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.085 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:30.085 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661283+0000", 2024-04-18T21:05:30.085 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9502999999999999e-05 2024-04-18T21:05:30.085 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.085 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.085 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:30.086 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661415+0000", 2024-04-18T21:05:30.086 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000132037 2024-04-18T21:05:30.086 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:30.086 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:30.086 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:30.086 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.086 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.086 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:30.086 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:05:30.086 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 24.444696072999999, 2024-04-18T21:05:30.086 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036185947000000003, 2024-04-18T21:05:30.086 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:30.086 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:30.087 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:30.087 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:30.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.087 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:30.087 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:05:30.087 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:30.087 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.087 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:30.087 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:05:30.087 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:30.087 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.087 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:30.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615794+0000", 2024-04-18T21:05:30.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6440000000000001e-06 2024-04-18T21:05:30.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.088 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:30.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615803+0000", 2024-04-18T21:05:30.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1220000000000001e-06 2024-04-18T21:05:30.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.088 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:30.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615827+0000", 2024-04-18T21:05:30.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3997000000000001e-05 2024-04-18T21:05:30.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.088 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:30.089 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615899+0000", 2024-04-18T21:05:30.089 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2741e-05 2024-04-18T21:05:30.089 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.089 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.089 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:30.089 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616019+0000", 2024-04-18T21:05:30.089 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119874 2024-04-18T21:05:30.089 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.089 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.089 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:30.089 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616029+0000", 2024-04-18T21:05:30.089 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:05:30.089 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.089 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.089 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:30.089 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644823+0000", 2024-04-18T21:05:30.090 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.028793151999999999 2024-04-18T21:05:30.090 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.090 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.090 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:30.090 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645106+0000", 2024-04-18T21:05:30.090 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028379700000000002 2024-04-18T21:05:30.090 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.090 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.090 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:30.090 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645294+0000", 2024-04-18T21:05:30.090 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000187181 2024-04-18T21:05:30.090 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.090 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.090 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:30.091 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646763+0000", 2024-04-18T21:05:30.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0014691050000000001 2024-04-18T21:05:30.091 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.091 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.091 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:30.091 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651784+0000", 2024-04-18T21:05:30.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050211650000000002 2024-04-18T21:05:30.091 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.091 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.091 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:30.091 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651876+0000", 2024-04-18T21:05:30.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2503999999999994e-05 2024-04-18T21:05:30.091 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.091 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.091 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:30.092 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651978+0000", 2024-04-18T21:05:30.092 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000101475 2024-04-18T21:05:30.092 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:30.092 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:30.092 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:30.092 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.092 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.092 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:30.092 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:30.092 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 24.444547466, 2024-04-18T21:05:30.092 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032262322000000003, 2024-04-18T21:05:30.092 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:30.092 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:30.092 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:30.092 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:30.092 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.093 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:30.093 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:30.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:30.093 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.093 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:30.093 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:30.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:30.093 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.093 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:30.093 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615943+0000", 2024-04-18T21:05:30.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1959999999999998e-06 2024-04-18T21:05:30.093 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.094 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:30.094 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615956+0000", 2024-04-18T21:05:30.094 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3424000000000001e-05 2024-04-18T21:05:30.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.094 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:30.094 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615983+0000", 2024-04-18T21:05:30.094 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7072000000000001e-05 2024-04-18T21:05:30.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.094 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:30.094 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616006+0000", 2024-04-18T21:05:30.094 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2823000000000002e-05 2024-04-18T21:05:30.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.095 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.095 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:30.095 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616156+0000", 2024-04-18T21:05:30.095 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014962299999999999 2024-04-18T21:05:30.095 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.095 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.095 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:30.095 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616174+0000", 2024-04-18T21:05:30.095 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8082999999999999e-05 2024-04-18T21:05:30.095 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.095 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.095 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:30.095 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.629952+0000", 2024-04-18T21:05:30.096 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013778514 2024-04-18T21:05:30.096 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.096 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.096 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:30.096 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630201+0000", 2024-04-18T21:05:30.096 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024918100000000001 2024-04-18T21:05:30.096 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.096 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.096 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:30.096 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630386+0000", 2024-04-18T21:05:30.096 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018436900000000001 2024-04-18T21:05:30.096 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.096 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.096 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:30.097 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643169+0000", 2024-04-18T21:05:30.097 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012782774 2024-04-18T21:05:30.097 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.097 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.097 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:30.097 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.647924+0000", 2024-04-18T21:05:30.097 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004755787 2024-04-18T21:05:30.097 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.097 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.097 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:30.097 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648069+0000", 2024-04-18T21:05:30.097 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014459600000000001 2024-04-18T21:05:30.097 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.098 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.098 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:30.098 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648203+0000", 2024-04-18T21:05:30.098 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013388000000000001 2024-04-18T21:05:30.098 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:30.098 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:30.098 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:30.098 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.098 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.098 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:30.098 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:05:30.098 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 24.444439202000002, 2024-04-18T21:05:30.098 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032489736999999998, 2024-04-18T21:05:30.099 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:30.099 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:30.099 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:30.099 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:30.099 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.099 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:30.099 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:05:30.099 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:30.099 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.099 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.099 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:30.099 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:05:30.099 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:30.100 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.100 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.100 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:30.100 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616050+0000", 2024-04-18T21:05:30.100 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.606e-06 2024-04-18T21:05:30.100 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.100 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.100 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:30.100 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616061+0000", 2024-04-18T21:05:30.100 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0463e-05 2024-04-18T21:05:30.100 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.100 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.100 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:30.100 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616092+0000", 2024-04-18T21:05:30.101 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1415999999999999e-05 2024-04-18T21:05:30.101 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.101 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.101 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:30.101 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616109+0000", 2024-04-18T21:05:30.101 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6557000000000001e-05 2024-04-18T21:05:30.101 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.101 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.101 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:30.101 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616358+0000", 2024-04-18T21:05:30.101 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000249077 2024-04-18T21:05:30.101 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.101 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.101 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:30.102 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616370+0000", 2024-04-18T21:05:30.102 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2037e-05 2024-04-18T21:05:30.102 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.102 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.102 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:30.102 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.634920+0000", 2024-04-18T21:05:30.102 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018550397 2024-04-18T21:05:30.102 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.102 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.102 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:30.102 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640420+0000", 2024-04-18T21:05:30.103 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055000539999999999 2024-04-18T21:05:30.103 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.103 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.103 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:30.103 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648538+0000", 2024-04-18T21:05:30.103 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0081181299999999994 2024-04-18T21:05:30.103 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:30.103 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:30.103 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:30.103 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.103 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.103 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:30.103 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:05:30.104 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 24.444354880999999, 2024-04-18T21:05:30.104 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036090029000000003, 2024-04-18T21:05:30.104 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:30.104 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:30.104 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:30.104 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:30.104 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.104 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:30.104 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:05:30.104 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:30.104 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.104 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.104 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:30.104 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:05:30.105 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:30.105 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.105 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.105 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:30.105 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616134+0000", 2024-04-18T21:05:30.105 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.353e-06 2024-04-18T21:05:30.105 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.105 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.105 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:30.105 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616141+0000", 2024-04-18T21:05:30.105 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2770000000000002e-06 2024-04-18T21:05:30.105 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.105 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.105 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:30.105 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616160+0000", 2024-04-18T21:05:30.106 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.91e-05 2024-04-18T21:05:30.106 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.106 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.106 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:30.106 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616170+0000", 2024-04-18T21:05:30.106 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7699999999999996e-06 2024-04-18T21:05:30.106 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.106 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.106 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:30.106 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616275+0000", 2024-04-18T21:05:30.106 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105313 2024-04-18T21:05:30.106 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.106 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.106 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:30.107 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616288+0000", 2024-04-18T21:05:30.107 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3027000000000001e-05 2024-04-18T21:05:30.107 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.107 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.107 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:30.107 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646160+0000", 2024-04-18T21:05:30.107 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.029872019 2024-04-18T21:05:30.107 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.107 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.107 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:30.107 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646368+0000", 2024-04-18T21:05:30.107 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020811899999999999 2024-04-18T21:05:30.107 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.107 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.108 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:30.108 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652223+0000", 2024-04-18T21:05:30.108 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.005855051 2024-04-18T21:05:30.108 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:30.108 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:30.108 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:30.108 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.108 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.108 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:30.108 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:05:30.108 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 24.444297312, 2024-04-18T21:05:30.108 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043572403000000003, 2024-04-18T21:05:30.108 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:30.108 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:30.109 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:30.109 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:30.109 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.109 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:30.109 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:05:30.109 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:30.109 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.109 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.109 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:30.109 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:05:30.109 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:30.109 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.109 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.109 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:30.110 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616192+0000", 2024-04-18T21:05:30.110 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:05:30.110 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.110 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.110 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:30.110 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616203+0000", 2024-04-18T21:05:30.110 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0890000000000001e-05 2024-04-18T21:05:30.110 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.110 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.110 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:30.110 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616223+0000", 2024-04-18T21:05:30.110 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0409000000000001e-05 2024-04-18T21:05:30.111 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.111 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.111 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:30.111 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616238+0000", 2024-04-18T21:05:30.111 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5160000000000001e-05 2024-04-18T21:05:30.111 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.111 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.111 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:30.111 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616343+0000", 2024-04-18T21:05:30.111 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000104831 2024-04-18T21:05:30.111 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.111 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.111 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:30.111 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616357+0000", 2024-04-18T21:05:30.112 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3686000000000001e-05 2024-04-18T21:05:30.112 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.112 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.112 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:30.112 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635912+0000", 2024-04-18T21:05:30.112 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019554944000000001 2024-04-18T21:05:30.112 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.112 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.112 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:30.112 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636231+0000", 2024-04-18T21:05:30.112 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000318766 2024-04-18T21:05:30.112 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.112 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.112 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:30.113 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659763+0000", 2024-04-18T21:05:30.113 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023532474000000001 2024-04-18T21:05:30.113 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:30.113 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:30.113 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:30.113 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.113 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.113 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:30.113 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:05:30.113 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 24.440368605, 2024-04-18T21:05:30.113 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015007971, 2024-04-18T21:05:30.113 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:30.113 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:30.113 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:30.113 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:30.113 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.114 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:30.114 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:05:30.114 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:30.114 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.114 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.114 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:30.114 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:05:30.114 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:30.114 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.114 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.114 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:30.114 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620120+0000", 2024-04-18T21:05:30.114 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0359999999999999e-06 2024-04-18T21:05:30.115 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.115 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.115 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:30.115 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620157+0000", 2024-04-18T21:05:30.115 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6636e-05 2024-04-18T21:05:30.115 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.115 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.115 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:30.115 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620177+0000", 2024-04-18T21:05:30.115 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0247000000000001e-05 2024-04-18T21:05:30.115 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.115 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.115 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:30.115 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620195+0000", 2024-04-18T21:05:30.115 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7819e-05 2024-04-18T21:05:30.116 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.116 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.116 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:30.116 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620342+0000", 2024-04-18T21:05:30.116 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014643300000000001 2024-04-18T21:05:30.116 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.116 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.116 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:30.116 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620405+0000", 2024-04-18T21:05:30.116 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3522000000000006e-05 2024-04-18T21:05:30.116 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.116 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.116 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:30.116 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635016+0000", 2024-04-18T21:05:30.116 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014610840999999999 2024-04-18T21:05:30.116 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.117 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.117 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:30.117 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635127+0000", 2024-04-18T21:05:30.117 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111437 2024-04-18T21:05:30.117 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:30.117 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:30.117 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:30.117 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.117 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.117 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:30.117 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:05:30.117 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 24.440261336999999, 2024-04-18T21:05:30.117 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012693296, 2024-04-18T21:05:30.117 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:30.118 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:30.118 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:30.118 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:30.118 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.118 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:30.118 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:05:30.118 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:30.118 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.118 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.118 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:30.118 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:05:30.118 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:30.119 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.119 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.119 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:30.119 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620228+0000", 2024-04-18T21:05:30.119 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:05:30.119 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.119 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.119 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:30.119 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620236+0000", 2024-04-18T21:05:30.119 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.303e-06 2024-04-18T21:05:30.119 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.119 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.119 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:30.119 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620255+0000", 2024-04-18T21:05:30.120 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9406e-05 2024-04-18T21:05:30.120 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.120 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.120 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:30.120 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620274+0000", 2024-04-18T21:05:30.120 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8940000000000002e-05 2024-04-18T21:05:30.120 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.120 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.120 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:30.120 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:05:30.120 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001558753 2024-04-18T21:05:30.120 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.120 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.120 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:30.121 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621879+0000", 2024-04-18T21:05:30.121 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6359000000000001e-05 2024-04-18T21:05:30.121 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.121 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.121 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:30.121 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632841+0000", 2024-04-18T21:05:30.121 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010961907 2024-04-18T21:05:30.121 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.121 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.121 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:30.121 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632920+0000", 2024-04-18T21:05:30.121 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8714999999999994e-05 2024-04-18T21:05:30.122 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:30.122 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:30.122 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:30.122 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.122 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.122 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:30.122 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:05:30.122 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 24.438715574, 2024-04-18T21:05:30.122 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013445702, 2024-04-18T21:05:30.122 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:30.122 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:30.122 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:30.122 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:30.122 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.123 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:30.123 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:05:30.123 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:30.123 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.123 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.123 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:30.123 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:05:30.123 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:30.123 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.123 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.123 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:30.123 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621774+0000", 2024-04-18T21:05:30.123 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2500000000000001e-06 2024-04-18T21:05:30.123 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.124 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.124 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:30.124 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621786+0000", 2024-04-18T21:05:30.124 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2636000000000001e-05 2024-04-18T21:05:30.124 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.124 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.124 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:30.124 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621814+0000", 2024-04-18T21:05:30.124 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7823000000000001e-05 2024-04-18T21:05:30.124 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.124 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.124 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:30.124 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621844+0000", 2024-04-18T21:05:30.125 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9589000000000001e-05 2024-04-18T21:05:30.125 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.125 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.125 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:30.125 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622253+0000", 2024-04-18T21:05:30.125 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040963700000000002 2024-04-18T21:05:30.125 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.125 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.125 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:30.125 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622304+0000", 2024-04-18T21:05:30.125 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0868999999999997e-05 2024-04-18T21:05:30.125 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.125 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.125 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:30.125 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635133+0000", 2024-04-18T21:05:30.126 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012829136 2024-04-18T21:05:30.126 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.126 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.126 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:30.126 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635218+0000", 2024-04-18T21:05:30.126 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4761999999999999e-05 2024-04-18T21:05:30.126 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:30.126 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:30.126 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:30.126 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.126 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.126 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:30.126 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:05:30.126 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 24.438588813999999, 2024-04-18T21:05:30.126 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014162065, 2024-04-18T21:05:30.127 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:30.127 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:30.127 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:30.127 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:30.127 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.127 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:30.127 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:05:30.127 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:30.127 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.127 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.127 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:30.127 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:05:30.127 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:30.127 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.128 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.128 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:30.128 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621900+0000", 2024-04-18T21:05:30.128 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:05:30.128 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.128 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.128 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:30.128 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621910+0000", 2024-04-18T21:05:30.128 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0207000000000001e-05 2024-04-18T21:05:30.128 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.128 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.128 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:30.129 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621932+0000", 2024-04-18T21:05:30.129 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1789000000000001e-05 2024-04-18T21:05:30.129 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.129 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.129 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:30.129 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621946+0000", 2024-04-18T21:05:30.129 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4212999999999999e-05 2024-04-18T21:05:30.129 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.129 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.129 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:30.129 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624477+0000", 2024-04-18T21:05:30.129 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025303470000000001 2024-04-18T21:05:30.129 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.129 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.129 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:30.130 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624525+0000", 2024-04-18T21:05:30.130 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8084999999999998e-05 2024-04-18T21:05:30.130 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.130 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.130 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:30.130 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635976+0000", 2024-04-18T21:05:30.130 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.011451368999999999 2024-04-18T21:05:30.130 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.130 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.130 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:30.130 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636061+0000", 2024-04-18T21:05:30.130 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5094999999999998e-05 2024-04-18T21:05:30.130 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:30.131 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:30.131 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:30.131 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.131 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.131 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:05:30.131 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:05:30.131 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 24.429353189, 2024-04-18T21:05:30.131 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0098014739999999993, 2024-04-18T21:05:30.131 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:30.131 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:30.131 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:05:30.131 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:30.131 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.131 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:30.132 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:05:30.132 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:30.132 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.132 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.132 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:30.132 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:05:30.132 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:30.132 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.132 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.132 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:30.132 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631136+0000", 2024-04-18T21:05:30.132 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0139999999999999e-06 2024-04-18T21:05:30.133 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.133 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.133 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:30.133 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631152+0000", 2024-04-18T21:05:30.133 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6365999999999999e-05 2024-04-18T21:05:30.133 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.133 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.133 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:30.133 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631961+0000", 2024-04-18T21:05:30.133 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00080873100000000003 2024-04-18T21:05:30.133 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.133 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.133 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:30.133 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632021+0000", 2024-04-18T21:05:30.134 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0541999999999997e-05 2024-04-18T21:05:30.134 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.134 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.134 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:30.134 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633539+0000", 2024-04-18T21:05:30.134 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015175639999999999 2024-04-18T21:05:30.134 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.134 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.134 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:30.134 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640936+0000", 2024-04-18T21:05:30.134 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007397257 2024-04-18T21:05:30.134 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:30.134 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:30.134 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:30.135 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.135 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.135 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-18T21:05:30.135 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:05:30.135 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 24.411891755999999, 2024-04-18T21:05:30.135 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00073592199999999997, 2024-04-18T21:05:30.135 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:30.135 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:30.135 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:30.135 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:30.135 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.135 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:30.135 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:05:30.135 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:30.135 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.136 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.136 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:30.136 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:05:30.136 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:30.136 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.136 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.136 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:30.136 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648597+0000", 2024-04-18T21:05:30.136 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:05:30.136 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.136 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.136 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:30.136 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648605+0000", 2024-04-18T21:05:30.136 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3960000000000006e-06 2024-04-18T21:05:30.137 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.137 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.137 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:30.137 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648625+0000", 2024-04-18T21:05:30.137 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9987e-05 2024-04-18T21:05:30.137 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.137 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.137 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:30.137 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648643+0000", 2024-04-18T21:05:30.137 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7079e-05 2024-04-18T21:05:30.137 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.137 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.137 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:30.137 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649043+0000", 2024-04-18T21:05:30.138 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040083399999999998 2024-04-18T21:05:30.138 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.138 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.138 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:30.138 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649062+0000", 2024-04-18T21:05:30.138 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9052999999999999e-05 2024-04-18T21:05:30.138 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.138 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.138 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:30.138 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649332+0000", 2024-04-18T21:05:30.138 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026971999999999999 2024-04-18T21:05:30.138 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:30.139 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:30.139 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:30.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.139 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.139 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:05:30.139 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:05:30.139 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 24.409116855000001, 2024-04-18T21:05:30.139 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00086123999999999999, 2024-04-18T21:05:30.139 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:30.139 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:30.139 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:05:30.139 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:30.139 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.139 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:30.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:05:30.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:30.140 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.140 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.140 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:30.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:05:30.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:30.140 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.140 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.140 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:30.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651372+0000", 2024-04-18T21:05:30.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7599999999999997e-07 2024-04-18T21:05:30.141 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.141 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.141 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:30.141 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651377+0000", 2024-04-18T21:05:30.141 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.22e-06 2024-04-18T21:05:30.141 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.141 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.141 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:30.141 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651394+0000", 2024-04-18T21:05:30.141 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6646999999999998e-05 2024-04-18T21:05:30.141 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.141 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.141 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:30.141 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651427+0000", 2024-04-18T21:05:30.141 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3682e-05 2024-04-18T21:05:30.142 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.142 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.142 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:30.142 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652029+0000", 2024-04-18T21:05:30.142 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00060152199999999995 2024-04-18T21:05:30.142 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.142 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.142 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:30.142 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652232+0000", 2024-04-18T21:05:30.142 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020359299999999999 2024-04-18T21:05:30.142 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:30.142 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:30.142 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:30.142 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.143 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:05:30.143 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:05:30.143 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 24.401089892999998, 2024-04-18T21:05:30.143 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0017426200000000001, 2024-04-18T21:05:30.143 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:30.143 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:30.143 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:30.143 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:30.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.143 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:30.143 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:05:30.143 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:30.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.144 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.144 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:30.144 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:05:30.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:30.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.144 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.144 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:30.144 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659399+0000", 2024-04-18T21:05:30.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6000000000000002e-07 2024-04-18T21:05:30.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.144 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.144 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:30.144 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659405+0000", 2024-04-18T21:05:30.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5069999999999997e-06 2024-04-18T21:05:30.145 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.145 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:30.145 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659425+0000", 2024-04-18T21:05:30.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.927e-05 2024-04-18T21:05:30.145 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.145 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:30.145 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659443+0000", 2024-04-18T21:05:30.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8051999999999999e-05 2024-04-18T21:05:30.145 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.145 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:30.145 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660973+0000", 2024-04-18T21:05:30.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001530106 2024-04-18T21:05:30.146 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.146 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.146 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:30.146 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660983+0000", 2024-04-18T21:05:30.146 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0516999999999999e-05 2024-04-18T21:05:30.146 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.146 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.146 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:30.146 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661141+0000", 2024-04-18T21:05:30.146 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015730799999999999 2024-04-18T21:05:30.146 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:30.146 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:30.146 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:30.147 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.147 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.147 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:05:30.147 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:05:30.147 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 24.400873268000002, 2024-04-18T21:05:30.147 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001812311, 2024-04-18T21:05:30.147 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:30.147 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:30.147 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:30.147 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:30.147 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.147 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:30.147 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:05:30.147 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:30.147 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.148 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.148 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:30.148 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:05:30.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:30.148 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.148 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.148 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:30.148 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659616+0000", 2024-04-18T21:05:30.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.277e-06 2024-04-18T21:05:30.148 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.148 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.148 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:30.148 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659625+0000", 2024-04-18T21:05:30.149 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5359999999999998e-06 2024-04-18T21:05:30.149 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.149 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.149 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:30.149 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659647+0000", 2024-04-18T21:05:30.149 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1857000000000001e-05 2024-04-18T21:05:30.149 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.149 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.149 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:30.149 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659664+0000", 2024-04-18T21:05:30.149 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6405999999999998e-05 2024-04-18T21:05:30.149 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.150 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:30.150 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661169+0000", 2024-04-18T21:05:30.150 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015054179999999999 2024-04-18T21:05:30.150 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.150 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:30.150 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661177+0000", 2024-04-18T21:05:30.150 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9680000000000006e-06 2024-04-18T21:05:30.150 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.150 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:30.150 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661427+0000", 2024-04-18T21:05:30.150 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024984900000000001 2024-04-18T21:05:30.151 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:30.151 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:30.151 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:30.151 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.151 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-18T21:05:30.151 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:05:30.151 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.447952659999999, 2024-04-18T21:05:30.151 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0030975030000000001, 2024-04-18T21:05:30.151 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:30.151 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:30.151 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:30.151 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:30.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.152 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:30.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:05:30.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:30.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.152 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:30.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:05:30.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:30.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.152 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:30.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612538+0000", 2024-04-18T21:05:30.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6259999999999999e-06 2024-04-18T21:05:30.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.153 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:30.153 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612552+0000", 2024-04-18T21:05:30.153 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4073999999999999e-05 2024-04-18T21:05:30.153 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.153 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.153 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:30.153 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612585+0000", 2024-04-18T21:05:30.153 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3504999999999999e-05 2024-04-18T21:05:30.153 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.153 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.153 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:30.153 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612601+0000", 2024-04-18T21:05:30.153 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5194000000000001e-05 2024-04-18T21:05:30.153 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.153 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.154 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:30.154 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612746+0000", 2024-04-18T21:05:30.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145666 2024-04-18T21:05:30.154 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.154 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:30.154 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612953+0000", 2024-04-18T21:05:30.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000207109 2024-04-18T21:05:30.154 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.154 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:30.154 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.613134+0000", 2024-04-18T21:05:30.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018041300000000001 2024-04-18T21:05:30.154 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:30.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.614411+0000", 2024-04-18T21:05:30.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0012769929999999999 2024-04-18T21:05:30.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:30.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615441+0000", 2024-04-18T21:05:30.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001029917 2024-04-18T21:05:30.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:30.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615522+0000", 2024-04-18T21:05:30.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1142000000000003e-05 2024-04-18T21:05:30.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:30.156 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615633+0000", 2024-04-18T21:05:30.156 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000110864 2024-04-18T21:05:30.156 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:30.156 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:30.156 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:30.156 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.156 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.156 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-18T21:05:30.156 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:05:30.156 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.4456668490000002, 2024-04-18T21:05:30.156 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088979039999999999, 2024-04-18T21:05:30.156 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:30.156 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:30.156 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:30.156 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:30.156 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.157 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:30.157 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:05:30.157 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:30.157 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.157 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.157 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:30.157 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:05:30.157 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:30.157 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.157 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.157 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:30.157 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614825+0000", 2024-04-18T21:05:30.157 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4829999999999999e-06 2024-04-18T21:05:30.158 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.158 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.158 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:30.158 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614843+0000", 2024-04-18T21:05:30.158 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8777e-05 2024-04-18T21:05:30.158 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.158 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.158 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:30.158 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614884+0000", 2024-04-18T21:05:30.158 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1051999999999999e-05 2024-04-18T21:05:30.158 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.158 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.158 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:30.159 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614903+0000", 2024-04-18T21:05:30.159 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9069999999999999e-05 2024-04-18T21:05:30.159 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.159 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.159 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:30.159 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615047+0000", 2024-04-18T21:05:30.159 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014374400000000001 2024-04-18T21:05:30.159 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.159 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.159 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:30.159 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615061+0000", 2024-04-18T21:05:30.159 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4063000000000001e-05 2024-04-18T21:05:30.159 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.159 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.160 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:30.160 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621064+0000", 2024-04-18T21:05:30.160 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0060029200000000001 2024-04-18T21:05:30.160 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.160 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.160 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:30.160 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621211+0000", 2024-04-18T21:05:30.160 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000147224 2024-04-18T21:05:30.160 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.160 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.160 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:30.161 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621396+0000", 2024-04-18T21:05:30.161 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018454699999999999 2024-04-18T21:05:30.161 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.161 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.161 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:30.161 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.622517+0000", 2024-04-18T21:05:30.161 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001121424 2024-04-18T21:05:30.161 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.161 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.161 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:30.161 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623571+0000", 2024-04-18T21:05:30.161 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010538660000000001 2024-04-18T21:05:30.161 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.161 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.162 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:30.162 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623658+0000", 2024-04-18T21:05:30.162 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6439000000000004e-05 2024-04-18T21:05:30.162 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:30.162 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:30.162 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:30.162 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623719+0000", 2024-04-18T21:05:30.162 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1295000000000002e-05 2024-04-18T21:05:30.162 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:30.162 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:30.162 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:30.162 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:30.162 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:30.163 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:05:30.164 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:05:30.165 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:30.163+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:30.204 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:05:30.265 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:30.267+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:30.295 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:05:30.295 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:05:30.295 INFO:teuthology.orchestra.run.smithi132.stdout: "num_ops": 0 2024-04-18T21:05:30.295 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:05:30.309 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:05:30.350 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:05:30.351 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:05:30.366 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:30.363+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:30.371 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1: {} 2024-04-18T21:05:30.371 INFO:teuthology.orchestra.run.smithi078.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:05:30.391 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:05:30.391 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:05:30.429 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:30.429 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:30.445 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:05:30.467 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:30.467+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:30.568 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:30.567+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:30.609 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:30.609 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:30.624 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:05:30.669 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:30.667+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:30.757 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:30.757 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:30.769 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:30.771+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:30.772 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:05:30.803 INFO:teuthology.orchestra.run.smithi078.stderr:nodeep-scrub is unset 2024-04-18T21:05:30.870 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:30.871+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:30.895 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:30.895 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:30.909 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:05:30.971 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:30.971+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:31.025 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:31.025 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:31.039 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:05:31.085 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:31.087+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:31.170 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:31.170 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:31.172 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:31.171+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:31.184 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:05:31.273 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:31.271+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:31.342 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:31.342 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:31.356 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:05:31.374 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:31.375+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:31.472 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:31.473 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:31.475 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:31.475+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:31.486 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:05:31.575 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:31.575+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:31.618 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:31.619 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:31.634 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:05:31.676 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:31.679+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:31.756 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:31.756 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:31.771 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:05:31.777 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:31.779+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:31.878 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:31.879+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:31.892 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:31.892 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:31.906 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:05:31.931 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-18T21:05:31.931 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-18T21:05:31.931 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-04-18T21:05:31.932 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-18T21:05:31.979 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:31.979+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:32.036 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:32.036 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:32.050 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:05:32.080 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:32.079+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:32.173 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:32.173 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:32.180 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:32.179+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:32.187 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:05:32.235 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:05:32.235 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-04-18T21:05:32.235 INFO:teuthology.orchestra.run.smithi078.stdout: "epoch": 22, 2024-04-18T21:05:32.235 INFO:teuthology.orchestra.run.smithi078.stdout: "fsid": "dc017990-0393-4ab0-b604-5e7052fdc7bd", 2024-04-18T21:05:32.235 INFO:teuthology.orchestra.run.smithi078.stdout: "created": "2024-04-18T21:04:43.507538+0000", 2024-04-18T21:05:32.236 INFO:teuthology.orchestra.run.smithi078.stdout: "modified": "2024-04-18T21:05:30.789026+0000", 2024-04-18T21:05:32.236 INFO:teuthology.orchestra.run.smithi078.stdout: "last_up_change": "2024-04-18T21:04:52.492503+0000", 2024-04-18T21:05:32.236 INFO:teuthology.orchestra.run.smithi078.stdout: "last_in_change": "2024-04-18T21:04:44.402191+0000", 2024-04-18T21:05:32.236 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-18T21:05:32.236 INFO:teuthology.orchestra.run.smithi078.stdout: "flags_num": 5799936, 2024-04-18T21:05:32.236 INFO:teuthology.orchestra.run.smithi078.stdout: "flags_set": [ 2024-04-18T21:05:32.236 INFO:teuthology.orchestra.run.smithi078.stdout: "pglog_hardlimit", 2024-04-18T21:05:32.236 INFO:teuthology.orchestra.run.smithi078.stdout: "purged_snapdirs", 2024-04-18T21:05:32.236 INFO:teuthology.orchestra.run.smithi078.stdout: "recovery_deletes", 2024-04-18T21:05:32.236 INFO:teuthology.orchestra.run.smithi078.stdout: "sortbitwise" 2024-04-18T21:05:32.236 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-04-18T21:05:32.236 INFO:teuthology.orchestra.run.smithi078.stdout: "crush_version": 4, 2024-04-18T21:05:32.236 INFO:teuthology.orchestra.run.smithi078.stdout: "full_ratio": 0.94999998807907104, 2024-04-18T21:05:32.236 INFO:teuthology.orchestra.run.smithi078.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-18T21:05:32.237 INFO:teuthology.orchestra.run.smithi078.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-18T21:05:32.237 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_snapshot": "", 2024-04-18T21:05:32.237 INFO:teuthology.orchestra.run.smithi078.stdout: "pool_max": 4, 2024-04-18T21:05:32.237 INFO:teuthology.orchestra.run.smithi078.stdout: "max_osd": 3, 2024-04-18T21:05:32.237 INFO:teuthology.orchestra.run.smithi078.stdout: "require_min_compat_client": "luminous", 2024-04-18T21:05:32.237 INFO:teuthology.orchestra.run.smithi078.stdout: "min_compat_client": "jewel", 2024-04-18T21:05:32.237 INFO:teuthology.orchestra.run.smithi078.stdout: "require_osd_release": "squid", 2024-04-18T21:05:32.237 INFO:teuthology.orchestra.run.smithi078.stdout: "allow_crimson": false, 2024-04-18T21:05:32.237 INFO:teuthology.orchestra.run.smithi078.stdout: "pools": [ 2024-04-18T21:05:32.237 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:32.237 INFO:teuthology.orchestra.run.smithi078.stdout: "pool": 1, 2024-04-18T21:05:32.237 INFO:teuthology.orchestra.run.smithi078.stdout: "pool_name": ".mgr", 2024-04-18T21:05:32.237 INFO:teuthology.orchestra.run.smithi078.stdout: "create_time": "2024-04-18T21:04:52.538153+0000", 2024-04-18T21:05:32.237 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-04-18T21:05:32.237 INFO:teuthology.orchestra.run.smithi078.stdout: "flags_names": "hashpspool", 2024-04-18T21:05:32.238 INFO:teuthology.orchestra.run.smithi078.stdout: "type": 1, 2024-04-18T21:05:32.238 INFO:teuthology.orchestra.run.smithi078.stdout: "size": 2, 2024-04-18T21:05:32.238 INFO:teuthology.orchestra.run.smithi078.stdout: "min_size": 1, 2024-04-18T21:05:32.238 INFO:teuthology.orchestra.run.smithi078.stdout: "crush_rule": 0, 2024-04-18T21:05:32.238 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:05:32.238 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:05:32.238 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:05:32.238 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:05:32.238 INFO:teuthology.orchestra.run.smithi078.stdout: "object_hash": 2, 2024-04-18T21:05:32.238 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:05:32.238 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num": 1, 2024-04-18T21:05:32.239 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_placement_num": 1, 2024-04-18T21:05:32.239 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_placement_num_target": 1, 2024-04-18T21:05:32.239 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_target": 1, 2024-04-18T21:05:32.239 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_pending": 1, 2024-04-18T21:05:32.239 INFO:teuthology.orchestra.run.smithi078.stdout: "last_pg_merge_meta": { 2024-04-18T21:05:32.239 INFO:teuthology.orchestra.run.smithi078.stdout: "source_pgid": "0.0", 2024-04-18T21:05:32.239 INFO:teuthology.orchestra.run.smithi078.stdout: "ready_epoch": 0, 2024-04-18T21:05:32.239 INFO:teuthology.orchestra.run.smithi078.stdout: "last_epoch_started": 0, 2024-04-18T21:05:32.239 INFO:teuthology.orchestra.run.smithi078.stdout: "last_epoch_clean": 0, 2024-04-18T21:05:32.239 INFO:teuthology.orchestra.run.smithi078.stdout: "source_version": "0'0", 2024-04-18T21:05:32.239 INFO:teuthology.orchestra.run.smithi078.stdout: "target_version": "0'0" 2024-04-18T21:05:32.239 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:32.239 INFO:teuthology.orchestra.run.smithi078.stdout: "last_change": "11", 2024-04-18T21:05:32.239 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend": "0", 2024-04-18T21:05:32.239 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:05:32.240 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:05:32.240 INFO:teuthology.orchestra.run.smithi078.stdout: "auid": 0, 2024-04-18T21:05:32.240 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:05:32.240 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_seq": 0, 2024-04-18T21:05:32.240 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_epoch": 0, 2024-04-18T21:05:32.240 INFO:teuthology.orchestra.run.smithi078.stdout: "pool_snaps": [], 2024-04-18T21:05:32.240 INFO:teuthology.orchestra.run.smithi078.stdout: "removed_snaps": "[]", 2024-04-18T21:05:32.240 INFO:teuthology.orchestra.run.smithi078.stdout: "quota_max_bytes": 0, 2024-04-18T21:05:32.240 INFO:teuthology.orchestra.run.smithi078.stdout: "quota_max_objects": 0, 2024-04-18T21:05:32.240 INFO:teuthology.orchestra.run.smithi078.stdout: "tiers": [], 2024-04-18T21:05:32.240 INFO:teuthology.orchestra.run.smithi078.stdout: "tier_of": -1, 2024-04-18T21:05:32.240 INFO:teuthology.orchestra.run.smithi078.stdout: "read_tier": -1, 2024-04-18T21:05:32.240 INFO:teuthology.orchestra.run.smithi078.stdout: "write_tier": -1, 2024-04-18T21:05:32.240 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_mode": "none", 2024-04-18T21:05:32.241 INFO:teuthology.orchestra.run.smithi078.stdout: "target_max_bytes": 0, 2024-04-18T21:05:32.241 INFO:teuthology.orchestra.run.smithi078.stdout: "target_max_objects": 0, 2024-04-18T21:05:32.241 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:05:32.241 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:05:32.241 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:05:32.241 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_min_flush_age": 0, 2024-04-18T21:05:32.241 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_min_evict_age": 0, 2024-04-18T21:05:32.241 INFO:teuthology.orchestra.run.smithi078.stdout: "erasure_code_profile": "", 2024-04-18T21:05:32.241 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_params": { 2024-04-18T21:05:32.241 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "none" 2024-04-18T21:05:32.241 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:32.241 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_period": 0, 2024-04-18T21:05:32.241 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_count": 0, 2024-04-18T21:05:32.242 INFO:teuthology.orchestra.run.smithi078.stdout: "use_gmt_hitset": true, 2024-04-18T21:05:32.242 INFO:teuthology.orchestra.run.smithi078.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:05:32.242 INFO:teuthology.orchestra.run.smithi078.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:05:32.242 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:05:32.242 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:05:32.242 INFO:teuthology.orchestra.run.smithi078.stdout: "grade_table": [], 2024-04-18T21:05:32.242 INFO:teuthology.orchestra.run.smithi078.stdout: "stripe_width": 0, 2024-04-18T21:05:32.242 INFO:teuthology.orchestra.run.smithi078.stdout: "expected_num_objects": 0, 2024-04-18T21:05:32.242 INFO:teuthology.orchestra.run.smithi078.stdout: "fast_read": false, 2024-04-18T21:05:32.242 INFO:teuthology.orchestra.run.smithi078.stdout: "options": { 2024-04-18T21:05:32.242 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_max": 32, 2024-04-18T21:05:32.242 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_min": 1 2024-04-18T21:05:32.242 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:32.243 INFO:teuthology.orchestra.run.smithi078.stdout: "application_metadata": { 2024-04-18T21:05:32.243 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": {} 2024-04-18T21:05:32.243 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:32.243 INFO:teuthology.orchestra.run.smithi078.stdout: "read_balance": { 2024-04-18T21:05:32.243 INFO:teuthology.orchestra.run.smithi078.stdout: "score_type": "Fair distribution", 2024-04-18T21:05:32.243 INFO:teuthology.orchestra.run.smithi078.stdout: "score_acting": 2.9900000095367432, 2024-04-18T21:05:32.243 INFO:teuthology.orchestra.run.smithi078.stdout: "score_stable": 2.9900000095367432, 2024-04-18T21:05:32.243 INFO:teuthology.orchestra.run.smithi078.stdout: "optimal_score": 0.67000001668930054, 2024-04-18T21:05:32.243 INFO:teuthology.orchestra.run.smithi078.stdout: "raw_score_acting": 2, 2024-04-18T21:05:32.243 INFO:teuthology.orchestra.run.smithi078.stdout: "raw_score_stable": 2, 2024-04-18T21:05:32.243 INFO:teuthology.orchestra.run.smithi078.stdout: "primary_affinity_weighted": 1, 2024-04-18T21:05:32.243 INFO:teuthology.orchestra.run.smithi078.stdout: "average_primary_affinity": 1, 2024-04-18T21:05:32.243 INFO:teuthology.orchestra.run.smithi078.stdout: "average_primary_affinity_weighted": 1 2024-04-18T21:05:32.243 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:32.244 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:32.244 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:32.244 INFO:teuthology.orchestra.run.smithi078.stdout: "pool": 2, 2024-04-18T21:05:32.244 INFO:teuthology.orchestra.run.smithi078.stdout: "pool_name": "rbd", 2024-04-18T21:05:32.244 INFO:teuthology.orchestra.run.smithi078.stdout: "create_time": "2024-04-18T21:04:58.673793+0000", 2024-04-18T21:05:32.244 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-04-18T21:05:32.244 INFO:teuthology.orchestra.run.smithi078.stdout: "flags_names": "hashpspool", 2024-04-18T21:05:32.244 INFO:teuthology.orchestra.run.smithi078.stdout: "type": 1, 2024-04-18T21:05:32.244 INFO:teuthology.orchestra.run.smithi078.stdout: "size": 2, 2024-04-18T21:05:32.244 INFO:teuthology.orchestra.run.smithi078.stdout: "min_size": 1, 2024-04-18T21:05:32.244 INFO:teuthology.orchestra.run.smithi078.stdout: "crush_rule": 0, 2024-04-18T21:05:32.244 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:05:32.244 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:05:32.244 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:05:32.244 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:05:32.245 INFO:teuthology.orchestra.run.smithi078.stdout: "object_hash": 2, 2024-04-18T21:05:32.245 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:05:32.245 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num": 8, 2024-04-18T21:05:32.245 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_placement_num": 8, 2024-04-18T21:05:32.245 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_placement_num_target": 8, 2024-04-18T21:05:32.245 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_target": 8, 2024-04-18T21:05:32.245 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_pending": 8, 2024-04-18T21:05:32.245 INFO:teuthology.orchestra.run.smithi078.stdout: "last_pg_merge_meta": { 2024-04-18T21:05:32.245 INFO:teuthology.orchestra.run.smithi078.stdout: "source_pgid": "0.0", 2024-04-18T21:05:32.245 INFO:teuthology.orchestra.run.smithi078.stdout: "ready_epoch": 0, 2024-04-18T21:05:32.245 INFO:teuthology.orchestra.run.smithi078.stdout: "last_epoch_started": 0, 2024-04-18T21:05:32.245 INFO:teuthology.orchestra.run.smithi078.stdout: "last_epoch_clean": 0, 2024-04-18T21:05:32.245 INFO:teuthology.orchestra.run.smithi078.stdout: "source_version": "0'0", 2024-04-18T21:05:32.245 INFO:teuthology.orchestra.run.smithi078.stdout: "target_version": "0'0" 2024-04-18T21:05:32.246 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:32.246 INFO:teuthology.orchestra.run.smithi078.stdout: "last_change": "14", 2024-04-18T21:05:32.246 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend": "0", 2024-04-18T21:05:32.246 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:05:32.246 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:05:32.246 INFO:teuthology.orchestra.run.smithi078.stdout: "auid": 0, 2024-04-18T21:05:32.246 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:05:32.246 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_seq": 0, 2024-04-18T21:05:32.246 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_epoch": 0, 2024-04-18T21:05:32.246 INFO:teuthology.orchestra.run.smithi078.stdout: "pool_snaps": [], 2024-04-18T21:05:32.246 INFO:teuthology.orchestra.run.smithi078.stdout: "removed_snaps": "[]", 2024-04-18T21:05:32.247 INFO:teuthology.orchestra.run.smithi078.stdout: "quota_max_bytes": 0, 2024-04-18T21:05:32.247 INFO:teuthology.orchestra.run.smithi078.stdout: "quota_max_objects": 0, 2024-04-18T21:05:32.247 INFO:teuthology.orchestra.run.smithi078.stdout: "tiers": [], 2024-04-18T21:05:32.247 INFO:teuthology.orchestra.run.smithi078.stdout: "tier_of": -1, 2024-04-18T21:05:32.247 INFO:teuthology.orchestra.run.smithi078.stdout: "read_tier": -1, 2024-04-18T21:05:32.247 INFO:teuthology.orchestra.run.smithi078.stdout: "write_tier": -1, 2024-04-18T21:05:32.247 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_mode": "none", 2024-04-18T21:05:32.247 INFO:teuthology.orchestra.run.smithi078.stdout: "target_max_bytes": 0, 2024-04-18T21:05:32.247 INFO:teuthology.orchestra.run.smithi078.stdout: "target_max_objects": 0, 2024-04-18T21:05:32.247 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:05:32.247 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:05:32.247 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:05:32.247 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_min_flush_age": 0, 2024-04-18T21:05:32.247 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_min_evict_age": 0, 2024-04-18T21:05:32.248 INFO:teuthology.orchestra.run.smithi078.stdout: "erasure_code_profile": "", 2024-04-18T21:05:32.248 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_params": { 2024-04-18T21:05:32.248 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "none" 2024-04-18T21:05:32.248 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:32.248 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_period": 0, 2024-04-18T21:05:32.248 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_count": 0, 2024-04-18T21:05:32.248 INFO:teuthology.orchestra.run.smithi078.stdout: "use_gmt_hitset": true, 2024-04-18T21:05:32.248 INFO:teuthology.orchestra.run.smithi078.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:05:32.248 INFO:teuthology.orchestra.run.smithi078.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:05:32.248 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:05:32.248 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:05:32.248 INFO:teuthology.orchestra.run.smithi078.stdout: "grade_table": [], 2024-04-18T21:05:32.248 INFO:teuthology.orchestra.run.smithi078.stdout: "stripe_width": 0, 2024-04-18T21:05:32.248 INFO:teuthology.orchestra.run.smithi078.stdout: "expected_num_objects": 0, 2024-04-18T21:05:32.249 INFO:teuthology.orchestra.run.smithi078.stdout: "fast_read": false, 2024-04-18T21:05:32.249 INFO:teuthology.orchestra.run.smithi078.stdout: "options": {}, 2024-04-18T21:05:32.249 INFO:teuthology.orchestra.run.smithi078.stdout: "application_metadata": { 2024-04-18T21:05:32.249 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd": {} 2024-04-18T21:05:32.249 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:32.249 INFO:teuthology.orchestra.run.smithi078.stdout: "read_balance": { 2024-04-18T21:05:32.249 INFO:teuthology.orchestra.run.smithi078.stdout: "score_type": "Fair distribution", 2024-04-18T21:05:32.249 INFO:teuthology.orchestra.run.smithi078.stdout: "score_acting": 1.5, 2024-04-18T21:05:32.249 INFO:teuthology.orchestra.run.smithi078.stdout: "score_stable": 1.5, 2024-04-18T21:05:32.249 INFO:teuthology.orchestra.run.smithi078.stdout: "optimal_score": 1, 2024-04-18T21:05:32.249 INFO:teuthology.orchestra.run.smithi078.stdout: "raw_score_acting": 1.5, 2024-04-18T21:05:32.249 INFO:teuthology.orchestra.run.smithi078.stdout: "raw_score_stable": 1.5, 2024-04-18T21:05:32.249 INFO:teuthology.orchestra.run.smithi078.stdout: "primary_affinity_weighted": 1, 2024-04-18T21:05:32.250 INFO:teuthology.orchestra.run.smithi078.stdout: "average_primary_affinity": 1, 2024-04-18T21:05:32.250 INFO:teuthology.orchestra.run.smithi078.stdout: "average_primary_affinity_weighted": 1 2024-04-18T21:05:32.250 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:32.250 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:32.250 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:32.250 INFO:teuthology.orchestra.run.smithi078.stdout: "pool": 3, 2024-04-18T21:05:32.250 INFO:teuthology.orchestra.run.smithi078.stdout: "pool_name": "cephfs_metadata", 2024-04-18T21:05:32.250 INFO:teuthology.orchestra.run.smithi078.stdout: "create_time": "2024-04-18T21:05:03.314171+0000", 2024-04-18T21:05:32.250 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-04-18T21:05:32.250 INFO:teuthology.orchestra.run.smithi078.stdout: "flags_names": "hashpspool", 2024-04-18T21:05:32.250 INFO:teuthology.orchestra.run.smithi078.stdout: "type": 1, 2024-04-18T21:05:32.250 INFO:teuthology.orchestra.run.smithi078.stdout: "size": 2, 2024-04-18T21:05:32.250 INFO:teuthology.orchestra.run.smithi078.stdout: "min_size": 1, 2024-04-18T21:05:32.250 INFO:teuthology.orchestra.run.smithi078.stdout: "crush_rule": 0, 2024-04-18T21:05:32.251 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:05:32.251 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:05:32.251 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:05:32.251 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:05:32.251 INFO:teuthology.orchestra.run.smithi078.stdout: "object_hash": 2, 2024-04-18T21:05:32.251 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:05:32.251 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num": 32, 2024-04-18T21:05:32.251 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_placement_num": 32, 2024-04-18T21:05:32.251 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_placement_num_target": 32, 2024-04-18T21:05:32.251 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_target": 32, 2024-04-18T21:05:32.251 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_pending": 32, 2024-04-18T21:05:32.251 INFO:teuthology.orchestra.run.smithi078.stdout: "last_pg_merge_meta": { 2024-04-18T21:05:32.251 INFO:teuthology.orchestra.run.smithi078.stdout: "source_pgid": "0.0", 2024-04-18T21:05:32.251 INFO:teuthology.orchestra.run.smithi078.stdout: "ready_epoch": 0, 2024-04-18T21:05:32.252 INFO:teuthology.orchestra.run.smithi078.stdout: "last_epoch_started": 0, 2024-04-18T21:05:32.252 INFO:teuthology.orchestra.run.smithi078.stdout: "last_epoch_clean": 0, 2024-04-18T21:05:32.252 INFO:teuthology.orchestra.run.smithi078.stdout: "source_version": "0'0", 2024-04-18T21:05:32.252 INFO:teuthology.orchestra.run.smithi078.stdout: "target_version": "0'0" 2024-04-18T21:05:32.252 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:32.252 INFO:teuthology.orchestra.run.smithi078.stdout: "last_change": "17", 2024-04-18T21:05:32.252 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend": "0", 2024-04-18T21:05:32.252 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:05:32.252 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:05:32.252 INFO:teuthology.orchestra.run.smithi078.stdout: "auid": 0, 2024-04-18T21:05:32.252 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:05:32.252 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_seq": 0, 2024-04-18T21:05:32.252 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_epoch": 0, 2024-04-18T21:05:32.252 INFO:teuthology.orchestra.run.smithi078.stdout: "pool_snaps": [], 2024-04-18T21:05:32.253 INFO:teuthology.orchestra.run.smithi078.stdout: "removed_snaps": "[]", 2024-04-18T21:05:32.253 INFO:teuthology.orchestra.run.smithi078.stdout: "quota_max_bytes": 0, 2024-04-18T21:05:32.253 INFO:teuthology.orchestra.run.smithi078.stdout: "quota_max_objects": 0, 2024-04-18T21:05:32.253 INFO:teuthology.orchestra.run.smithi078.stdout: "tiers": [], 2024-04-18T21:05:32.253 INFO:teuthology.orchestra.run.smithi078.stdout: "tier_of": -1, 2024-04-18T21:05:32.253 INFO:teuthology.orchestra.run.smithi078.stdout: "read_tier": -1, 2024-04-18T21:05:32.253 INFO:teuthology.orchestra.run.smithi078.stdout: "write_tier": -1, 2024-04-18T21:05:32.253 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_mode": "none", 2024-04-18T21:05:32.253 INFO:teuthology.orchestra.run.smithi078.stdout: "target_max_bytes": 0, 2024-04-18T21:05:32.253 INFO:teuthology.orchestra.run.smithi078.stdout: "target_max_objects": 0, 2024-04-18T21:05:32.253 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:05:32.253 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:05:32.253 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:05:32.254 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_min_flush_age": 0, 2024-04-18T21:05:32.254 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_min_evict_age": 0, 2024-04-18T21:05:32.254 INFO:teuthology.orchestra.run.smithi078.stdout: "erasure_code_profile": "", 2024-04-18T21:05:32.254 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_params": { 2024-04-18T21:05:32.254 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "none" 2024-04-18T21:05:32.254 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:32.254 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_period": 0, 2024-04-18T21:05:32.254 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_count": 0, 2024-04-18T21:05:32.254 INFO:teuthology.orchestra.run.smithi078.stdout: "use_gmt_hitset": true, 2024-04-18T21:05:32.254 INFO:teuthology.orchestra.run.smithi078.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:05:32.254 INFO:teuthology.orchestra.run.smithi078.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:05:32.254 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:05:32.254 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:05:32.255 INFO:teuthology.orchestra.run.smithi078.stdout: "grade_table": [], 2024-04-18T21:05:32.255 INFO:teuthology.orchestra.run.smithi078.stdout: "stripe_width": 0, 2024-04-18T21:05:32.255 INFO:teuthology.orchestra.run.smithi078.stdout: "expected_num_objects": 0, 2024-04-18T21:05:32.255 INFO:teuthology.orchestra.run.smithi078.stdout: "fast_read": false, 2024-04-18T21:05:32.255 INFO:teuthology.orchestra.run.smithi078.stdout: "options": { 2024-04-18T21:05:32.255 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_autoscale_bias": 4, 2024-04-18T21:05:32.255 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_min": 16, 2024-04-18T21:05:32.255 INFO:teuthology.orchestra.run.smithi078.stdout: "recovery_priority": 5 2024-04-18T21:05:32.255 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:32.255 INFO:teuthology.orchestra.run.smithi078.stdout: "application_metadata": { 2024-04-18T21:05:32.255 INFO:teuthology.orchestra.run.smithi078.stdout: "cephfs": { 2024-04-18T21:05:32.255 INFO:teuthology.orchestra.run.smithi078.stdout: "metadata": "cephfs" 2024-04-18T21:05:32.255 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:32.255 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:32.256 INFO:teuthology.orchestra.run.smithi078.stdout: "read_balance": { 2024-04-18T21:05:32.256 INFO:teuthology.orchestra.run.smithi078.stdout: "score_type": "Fair distribution", 2024-04-18T21:05:32.256 INFO:teuthology.orchestra.run.smithi078.stdout: "score_acting": 1.1299999952316284, 2024-04-18T21:05:32.256 INFO:teuthology.orchestra.run.smithi078.stdout: "score_stable": 1.1299999952316284, 2024-04-18T21:05:32.256 INFO:teuthology.orchestra.run.smithi078.stdout: "optimal_score": 1, 2024-04-18T21:05:32.256 INFO:teuthology.orchestra.run.smithi078.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-18T21:05:32.256 INFO:teuthology.orchestra.run.smithi078.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-18T21:05:32.256 INFO:teuthology.orchestra.run.smithi078.stdout: "primary_affinity_weighted": 1, 2024-04-18T21:05:32.256 INFO:teuthology.orchestra.run.smithi078.stdout: "average_primary_affinity": 1, 2024-04-18T21:05:32.256 INFO:teuthology.orchestra.run.smithi078.stdout: "average_primary_affinity_weighted": 1 2024-04-18T21:05:32.256 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:32.256 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:32.256 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:32.256 INFO:teuthology.orchestra.run.smithi078.stdout: "pool": 4, 2024-04-18T21:05:32.257 INFO:teuthology.orchestra.run.smithi078.stdout: "pool_name": "cephfs_data", 2024-04-18T21:05:32.257 INFO:teuthology.orchestra.run.smithi078.stdout: "create_time": "2024-04-18T21:05:03.931699+0000", 2024-04-18T21:05:32.257 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-04-18T21:05:32.257 INFO:teuthology.orchestra.run.smithi078.stdout: "flags_names": "hashpspool", 2024-04-18T21:05:32.257 INFO:teuthology.orchestra.run.smithi078.stdout: "type": 1, 2024-04-18T21:05:32.257 INFO:teuthology.orchestra.run.smithi078.stdout: "size": 2, 2024-04-18T21:05:32.257 INFO:teuthology.orchestra.run.smithi078.stdout: "min_size": 1, 2024-04-18T21:05:32.257 INFO:teuthology.orchestra.run.smithi078.stdout: "crush_rule": 0, 2024-04-18T21:05:32.257 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:05:32.257 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:05:32.257 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:05:32.257 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:05:32.257 INFO:teuthology.orchestra.run.smithi078.stdout: "object_hash": 2, 2024-04-18T21:05:32.257 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:05:32.257 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num": 64, 2024-04-18T21:05:32.258 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_placement_num": 64, 2024-04-18T21:05:32.258 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_placement_num_target": 64, 2024-04-18T21:05:32.258 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_target": 64, 2024-04-18T21:05:32.258 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_pending": 64, 2024-04-18T21:05:32.258 INFO:teuthology.orchestra.run.smithi078.stdout: "last_pg_merge_meta": { 2024-04-18T21:05:32.258 INFO:teuthology.orchestra.run.smithi078.stdout: "source_pgid": "0.0", 2024-04-18T21:05:32.258 INFO:teuthology.orchestra.run.smithi078.stdout: "ready_epoch": 0, 2024-04-18T21:05:32.258 INFO:teuthology.orchestra.run.smithi078.stdout: "last_epoch_started": 0, 2024-04-18T21:05:32.258 INFO:teuthology.orchestra.run.smithi078.stdout: "last_epoch_clean": 0, 2024-04-18T21:05:32.258 INFO:teuthology.orchestra.run.smithi078.stdout: "source_version": "0'0", 2024-04-18T21:05:32.258 INFO:teuthology.orchestra.run.smithi078.stdout: "target_version": "0'0" 2024-04-18T21:05:32.259 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:32.259 INFO:teuthology.orchestra.run.smithi078.stdout: "last_change": "18", 2024-04-18T21:05:32.259 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend": "0", 2024-04-18T21:05:32.259 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:05:32.259 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:05:32.259 INFO:teuthology.orchestra.run.smithi078.stdout: "auid": 0, 2024-04-18T21:05:32.259 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:05:32.259 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_seq": 0, 2024-04-18T21:05:32.259 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_epoch": 0, 2024-04-18T21:05:32.259 INFO:teuthology.orchestra.run.smithi078.stdout: "pool_snaps": [], 2024-04-18T21:05:32.259 INFO:teuthology.orchestra.run.smithi078.stdout: "removed_snaps": "[]", 2024-04-18T21:05:32.259 INFO:teuthology.orchestra.run.smithi078.stdout: "quota_max_bytes": 0, 2024-04-18T21:05:32.260 INFO:teuthology.orchestra.run.smithi078.stdout: "quota_max_objects": 0, 2024-04-18T21:05:32.260 INFO:teuthology.orchestra.run.smithi078.stdout: "tiers": [], 2024-04-18T21:05:32.260 INFO:teuthology.orchestra.run.smithi078.stdout: "tier_of": -1, 2024-04-18T21:05:32.260 INFO:teuthology.orchestra.run.smithi078.stdout: "read_tier": -1, 2024-04-18T21:05:32.260 INFO:teuthology.orchestra.run.smithi078.stdout: "write_tier": -1, 2024-04-18T21:05:32.260 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_mode": "none", 2024-04-18T21:05:32.260 INFO:teuthology.orchestra.run.smithi078.stdout: "target_max_bytes": 0, 2024-04-18T21:05:32.260 INFO:teuthology.orchestra.run.smithi078.stdout: "target_max_objects": 0, 2024-04-18T21:05:32.260 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:05:32.260 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:05:32.260 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:05:32.260 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_min_flush_age": 0, 2024-04-18T21:05:32.260 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_min_evict_age": 0, 2024-04-18T21:05:32.260 INFO:teuthology.orchestra.run.smithi078.stdout: "erasure_code_profile": "", 2024-04-18T21:05:32.261 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_params": { 2024-04-18T21:05:32.261 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "none" 2024-04-18T21:05:32.261 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:32.261 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_period": 0, 2024-04-18T21:05:32.261 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_count": 0, 2024-04-18T21:05:32.261 INFO:teuthology.orchestra.run.smithi078.stdout: "use_gmt_hitset": true, 2024-04-18T21:05:32.261 INFO:teuthology.orchestra.run.smithi078.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:05:32.261 INFO:teuthology.orchestra.run.smithi078.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:05:32.261 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:05:32.261 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:05:32.261 INFO:teuthology.orchestra.run.smithi078.stdout: "grade_table": [], 2024-04-18T21:05:32.261 INFO:teuthology.orchestra.run.smithi078.stdout: "stripe_width": 0, 2024-04-18T21:05:32.261 INFO:teuthology.orchestra.run.smithi078.stdout: "expected_num_objects": 0, 2024-04-18T21:05:32.261 INFO:teuthology.orchestra.run.smithi078.stdout: "fast_read": false, 2024-04-18T21:05:32.262 INFO:teuthology.orchestra.run.smithi078.stdout: "options": { 2024-04-18T21:05:32.262 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_min": 64, 2024-04-18T21:05:32.262 INFO:teuthology.orchestra.run.smithi078.stdout: "target_size_ratio": 0.89999997615814209 2024-04-18T21:05:32.262 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:32.262 INFO:teuthology.orchestra.run.smithi078.stdout: "application_metadata": { 2024-04-18T21:05:32.262 INFO:teuthology.orchestra.run.smithi078.stdout: "cephfs": { 2024-04-18T21:05:32.262 INFO:teuthology.orchestra.run.smithi078.stdout: "data": "cephfs" 2024-04-18T21:05:32.262 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:32.262 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:32.262 INFO:teuthology.orchestra.run.smithi078.stdout: "read_balance": { 2024-04-18T21:05:32.262 INFO:teuthology.orchestra.run.smithi078.stdout: "score_type": "Fair distribution", 2024-04-18T21:05:32.262 INFO:teuthology.orchestra.run.smithi078.stdout: "score_acting": 1.1299999952316284, 2024-04-18T21:05:32.262 INFO:teuthology.orchestra.run.smithi078.stdout: "score_stable": 1.1299999952316284, 2024-04-18T21:05:32.262 INFO:teuthology.orchestra.run.smithi078.stdout: "optimal_score": 1, 2024-04-18T21:05:32.263 INFO:teuthology.orchestra.run.smithi078.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-18T21:05:32.263 INFO:teuthology.orchestra.run.smithi078.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-18T21:05:32.263 INFO:teuthology.orchestra.run.smithi078.stdout: "primary_affinity_weighted": 1, 2024-04-18T21:05:32.263 INFO:teuthology.orchestra.run.smithi078.stdout: "average_primary_affinity": 1, 2024-04-18T21:05:32.263 INFO:teuthology.orchestra.run.smithi078.stdout: "average_primary_affinity_weighted": 1 2024-04-18T21:05:32.263 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:32.263 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:32.263 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-04-18T21:05:32.263 INFO:teuthology.orchestra.run.smithi078.stdout: "osds": [ 2024-04-18T21:05:32.263 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:32.263 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": 0, 2024-04-18T21:05:32.263 INFO:teuthology.orchestra.run.smithi078.stdout: "uuid": "1854d737-3a67-416a-8c88-0f126505a0f2", 2024-04-18T21:05:32.263 INFO:teuthology.orchestra.run.smithi078.stdout: "up": 1, 2024-04-18T21:05:32.263 INFO:teuthology.orchestra.run.smithi078.stdout: "in": 1, 2024-04-18T21:05:32.264 INFO:teuthology.orchestra.run.smithi078.stdout: "weight": 1, 2024-04-18T21:05:32.264 INFO:teuthology.orchestra.run.smithi078.stdout: "primary_affinity": 1, 2024-04-18T21:05:32.264 INFO:teuthology.orchestra.run.smithi078.stdout: "last_clean_begin": 0, 2024-04-18T21:05:32.264 INFO:teuthology.orchestra.run.smithi078.stdout: "last_clean_end": 0, 2024-04-18T21:05:32.264 INFO:teuthology.orchestra.run.smithi078.stdout: "up_from": 8, 2024-04-18T21:05:32.264 INFO:teuthology.orchestra.run.smithi078.stdout: "up_thru": 16, 2024-04-18T21:05:32.264 INFO:teuthology.orchestra.run.smithi078.stdout: "down_at": 0, 2024-04-18T21:05:32.264 INFO:teuthology.orchestra.run.smithi078.stdout: "lost_at": 0, 2024-04-18T21:05:32.264 INFO:teuthology.orchestra.run.smithi078.stdout: "public_addrs": { 2024-04-18T21:05:32.264 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:05:32.264 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:32.264 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:05:32.264 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.132:6800", 2024-04-18T21:05:32.265 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 1948809768 2024-04-18T21:05:32.265 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:32.265 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:32.265 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:05:32.265 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.132:6801", 2024-04-18T21:05:32.265 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 1948809768 2024-04-18T21:05:32.265 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:32.265 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:05:32.265 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:32.265 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_addrs": { 2024-04-18T21:05:32.265 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:05:32.265 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:32.265 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:05:32.265 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.132:6802", 2024-04-18T21:05:32.266 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 1948809768 2024-04-18T21:05:32.266 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:32.266 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:32.266 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:05:32.266 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.132:6803", 2024-04-18T21:05:32.266 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 1948809768 2024-04-18T21:05:32.266 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:32.266 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:05:32.266 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:32.266 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_back_addrs": { 2024-04-18T21:05:32.267 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:05:32.267 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:32.267 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:05:32.267 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.132:6806", 2024-04-18T21:05:32.267 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 1948809768 2024-04-18T21:05:32.267 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:32.267 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:32.267 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:05:32.267 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.132:6807", 2024-04-18T21:05:32.267 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 1948809768 2024-04-18T21:05:32.267 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:32.267 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:05:32.267 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:32.267 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_front_addrs": { 2024-04-18T21:05:32.268 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:05:32.268 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:32.268 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:05:32.268 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.132:6804", 2024-04-18T21:05:32.268 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 1948809768 2024-04-18T21:05:32.268 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:32.268 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:32.268 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:05:32.268 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.132:6805", 2024-04-18T21:05:32.268 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 1948809768 2024-04-18T21:05:32.268 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:32.268 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:05:32.268 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:32.268 INFO:teuthology.orchestra.run.smithi078.stdout: "public_addr": "172.21.15.132:6801/1948809768", 2024-04-18T21:05:32.269 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_addr": "172.21.15.132:6803/1948809768", 2024-04-18T21:05:32.269 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_back_addr": "172.21.15.132:6807/1948809768", 2024-04-18T21:05:32.269 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_front_addr": "172.21.15.132:6805/1948809768", 2024-04-18T21:05:32.269 INFO:teuthology.orchestra.run.smithi078.stdout: "state": [ 2024-04-18T21:05:32.269 INFO:teuthology.orchestra.run.smithi078.stdout: "exists", 2024-04-18T21:05:32.269 INFO:teuthology.orchestra.run.smithi078.stdout: "up" 2024-04-18T21:05:32.269 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:05:32.269 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:32.269 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:32.269 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": 1, 2024-04-18T21:05:32.269 INFO:teuthology.orchestra.run.smithi078.stdout: "uuid": "dfeae661-3f8a-4d41-b287-7eb02c16b91a", 2024-04-18T21:05:32.269 INFO:teuthology.orchestra.run.smithi078.stdout: "up": 1, 2024-04-18T21:05:32.269 INFO:teuthology.orchestra.run.smithi078.stdout: "in": 1, 2024-04-18T21:05:32.269 INFO:teuthology.orchestra.run.smithi078.stdout: "weight": 1, 2024-04-18T21:05:32.270 INFO:teuthology.orchestra.run.smithi078.stdout: "primary_affinity": 1, 2024-04-18T21:05:32.270 INFO:teuthology.orchestra.run.smithi078.stdout: "last_clean_begin": 0, 2024-04-18T21:05:32.270 INFO:teuthology.orchestra.run.smithi078.stdout: "last_clean_end": 0, 2024-04-18T21:05:32.270 INFO:teuthology.orchestra.run.smithi078.stdout: "up_from": 8, 2024-04-18T21:05:32.270 INFO:teuthology.orchestra.run.smithi078.stdout: "up_thru": 16, 2024-04-18T21:05:32.270 INFO:teuthology.orchestra.run.smithi078.stdout: "down_at": 0, 2024-04-18T21:05:32.270 INFO:teuthology.orchestra.run.smithi078.stdout: "lost_at": 0, 2024-04-18T21:05:32.270 INFO:teuthology.orchestra.run.smithi078.stdout: "public_addrs": { 2024-04-18T21:05:32.271 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:05:32.271 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:32.271 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:05:32.271 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.150:6800", 2024-04-18T21:05:32.271 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 2040503167 2024-04-18T21:05:32.271 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:32.272 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:32.272 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:05:32.272 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.150:6801", 2024-04-18T21:05:32.272 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 2040503167 2024-04-18T21:05:32.272 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:32.272 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:05:32.273 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:32.273 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_addrs": { 2024-04-18T21:05:32.273 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:05:32.273 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:32.273 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:05:32.273 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.150:6802", 2024-04-18T21:05:32.274 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 2040503167 2024-04-18T21:05:32.274 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:32.274 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:32.274 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:05:32.274 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.150:6803", 2024-04-18T21:05:32.274 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 2040503167 2024-04-18T21:05:32.275 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:32.275 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:05:32.275 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:32.275 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_back_addrs": { 2024-04-18T21:05:32.275 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:05:32.275 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:32.276 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:05:32.276 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.150:6806", 2024-04-18T21:05:32.276 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 2040503167 2024-04-18T21:05:32.276 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:32.276 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:32.276 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:05:32.277 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.150:6807", 2024-04-18T21:05:32.277 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 2040503167 2024-04-18T21:05:32.277 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:32.277 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:05:32.277 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:32.277 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_front_addrs": { 2024-04-18T21:05:32.278 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:05:32.278 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:32.278 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:05:32.278 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.150:6804", 2024-04-18T21:05:32.278 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 2040503167 2024-04-18T21:05:32.278 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:32.279 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:32.279 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:05:32.279 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.150:6805", 2024-04-18T21:05:32.279 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 2040503167 2024-04-18T21:05:32.279 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:32.279 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:05:32.279 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:32.279 INFO:teuthology.orchestra.run.smithi078.stdout: "public_addr": "172.21.15.150:6801/2040503167", 2024-04-18T21:05:32.281 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_addr": "172.21.15.150:6803/2040503167", 2024-04-18T21:05:32.281 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_back_addr": "172.21.15.150:6807/2040503167", 2024-04-18T21:05:32.281 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_front_addr": "172.21.15.150:6805/2040503167", 2024-04-18T21:05:32.282 INFO:teuthology.orchestra.run.smithi078.stdout: "state": [ 2024-04-18T21:05:32.282 INFO:teuthology.orchestra.run.smithi078.stdout: "exists", 2024-04-18T21:05:32.282 INFO:teuthology.orchestra.run.smithi078.stdout: "up" 2024-04-18T21:05:32.282 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:05:32.282 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:32.282 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:32.283 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": 2, 2024-04-18T21:05:32.283 INFO:teuthology.orchestra.run.smithi078.stdout: "uuid": "56a34021-e2dc-41ff-822c-7ec123466f25", 2024-04-18T21:05:32.283 INFO:teuthology.orchestra.run.smithi078.stdout: "up": 1, 2024-04-18T21:05:32.283 INFO:teuthology.orchestra.run.smithi078.stdout: "in": 1, 2024-04-18T21:05:32.283 INFO:teuthology.orchestra.run.smithi078.stdout: "weight": 1, 2024-04-18T21:05:32.283 INFO:teuthology.orchestra.run.smithi078.stdout: "primary_affinity": 1, 2024-04-18T21:05:32.284 INFO:teuthology.orchestra.run.smithi078.stdout: "last_clean_begin": 0, 2024-04-18T21:05:32.284 INFO:teuthology.orchestra.run.smithi078.stdout: "last_clean_end": 0, 2024-04-18T21:05:32.284 INFO:teuthology.orchestra.run.smithi078.stdout: "up_from": 8, 2024-04-18T21:05:32.284 INFO:teuthology.orchestra.run.smithi078.stdout: "up_thru": 16, 2024-04-18T21:05:32.284 INFO:teuthology.orchestra.run.smithi078.stdout: "down_at": 0, 2024-04-18T21:05:32.284 INFO:teuthology.orchestra.run.smithi078.stdout: "lost_at": 0, 2024-04-18T21:05:32.285 INFO:teuthology.orchestra.run.smithi078.stdout: "public_addrs": { 2024-04-18T21:05:32.285 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:05:32.285 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:32.285 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:05:32.285 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.187:6800", 2024-04-18T21:05:32.285 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 429896900 2024-04-18T21:05:32.285 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:32.286 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:32.286 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:05:32.286 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.187:6801", 2024-04-18T21:05:32.286 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 429896900 2024-04-18T21:05:32.286 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:32.287 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:05:32.287 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:32.287 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_addrs": { 2024-04-18T21:05:32.287 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:05:32.287 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:32.287 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:05:32.287 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.187:6802", 2024-04-18T21:05:32.288 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 429896900 2024-04-18T21:05:32.288 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:32.288 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:32.288 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:05:32.288 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.187:6803", 2024-04-18T21:05:32.288 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 429896900 2024-04-18T21:05:32.289 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:32.289 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:05:32.289 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:32.289 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_back_addrs": { 2024-04-18T21:05:32.289 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:05:32.289 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:32.290 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:05:32.290 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.187:6806", 2024-04-18T21:05:32.290 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 429896900 2024-04-18T21:05:32.290 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:32.290 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:32.291 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:05:32.291 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.187:6807", 2024-04-18T21:05:32.291 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 429896900 2024-04-18T21:05:32.291 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:32.291 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:05:32.291 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:32.291 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_front_addrs": { 2024-04-18T21:05:32.292 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:05:32.292 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:32.292 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:05:32.292 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.187:6804", 2024-04-18T21:05:32.292 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 429896900 2024-04-18T21:05:32.292 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:32.293 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:32.293 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:05:32.293 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.187:6805", 2024-04-18T21:05:32.293 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 429896900 2024-04-18T21:05:32.293 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:32.293 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:05:32.294 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:32.294 INFO:teuthology.orchestra.run.smithi078.stdout: "public_addr": "172.21.15.187:6801/429896900", 2024-04-18T21:05:32.294 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_addr": "172.21.15.187:6803/429896900", 2024-04-18T21:05:32.294 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_back_addr": "172.21.15.187:6807/429896900", 2024-04-18T21:05:32.294 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_front_addr": "172.21.15.187:6805/429896900", 2024-04-18T21:05:32.294 INFO:teuthology.orchestra.run.smithi078.stdout: "state": [ 2024-04-18T21:05:32.295 INFO:teuthology.orchestra.run.smithi078.stdout: "exists", 2024-04-18T21:05:32.295 INFO:teuthology.orchestra.run.smithi078.stdout: "up" 2024-04-18T21:05:32.295 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:05:32.295 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:32.295 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-04-18T21:05:32.295 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_xinfo": [ 2024-04-18T21:05:32.296 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:32.296 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": 0, 2024-04-18T21:05:32.296 INFO:teuthology.orchestra.run.smithi078.stdout: "down_stamp": "0.000000", 2024-04-18T21:05:32.296 INFO:teuthology.orchestra.run.smithi078.stdout: "laggy_probability": 0, 2024-04-18T21:05:32.296 INFO:teuthology.orchestra.run.smithi078.stdout: "laggy_interval": 0, 2024-04-18T21:05:32.296 INFO:teuthology.orchestra.run.smithi078.stdout: "features": 4540701547738038271, 2024-04-18T21:05:32.296 INFO:teuthology.orchestra.run.smithi078.stdout: "old_weight": 0, 2024-04-18T21:05:32.297 INFO:teuthology.orchestra.run.smithi078.stdout: "last_purged_snaps_scrub": "2024-04-18T21:04:49.804359+0000", 2024-04-18T21:05:32.297 INFO:teuthology.orchestra.run.smithi078.stdout: "dead_epoch": 0 2024-04-18T21:05:32.297 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:32.297 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:32.297 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": 1, 2024-04-18T21:05:32.297 INFO:teuthology.orchestra.run.smithi078.stdout: "down_stamp": "0.000000", 2024-04-18T21:05:32.298 INFO:teuthology.orchestra.run.smithi078.stdout: "laggy_probability": 0, 2024-04-18T21:05:32.298 INFO:teuthology.orchestra.run.smithi078.stdout: "laggy_interval": 0, 2024-04-18T21:05:32.298 INFO:teuthology.orchestra.run.smithi078.stdout: "features": 4540701547738038271, 2024-04-18T21:05:32.298 INFO:teuthology.orchestra.run.smithi078.stdout: "old_weight": 0, 2024-04-18T21:05:32.298 INFO:teuthology.orchestra.run.smithi078.stdout: "last_purged_snaps_scrub": "2024-04-18T21:04:49.790978+0000", 2024-04-18T21:05:32.298 INFO:teuthology.orchestra.run.smithi078.stdout: "dead_epoch": 0 2024-04-18T21:05:32.298 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:32.299 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:32.299 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": 2, 2024-04-18T21:05:32.299 INFO:teuthology.orchestra.run.smithi078.stdout: "down_stamp": "0.000000", 2024-04-18T21:05:32.299 INFO:teuthology.orchestra.run.smithi078.stdout: "laggy_probability": 0, 2024-04-18T21:05:32.299 INFO:teuthology.orchestra.run.smithi078.stdout: "laggy_interval": 0, 2024-04-18T21:05:32.299 INFO:teuthology.orchestra.run.smithi078.stdout: "features": 4540701547738038271, 2024-04-18T21:05:32.300 INFO:teuthology.orchestra.run.smithi078.stdout: "old_weight": 0, 2024-04-18T21:05:32.300 INFO:teuthology.orchestra.run.smithi078.stdout: "last_purged_snaps_scrub": "2024-04-18T21:04:49.762943+0000", 2024-04-18T21:05:32.300 INFO:teuthology.orchestra.run.smithi078.stdout: "dead_epoch": 0 2024-04-18T21:05:32.300 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:32.300 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-04-18T21:05:32.300 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_upmap": [], 2024-04-18T21:05:32.301 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_upmap_items": [], 2024-04-18T21:05:32.301 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_upmap_primaries": [], 2024-04-18T21:05:32.301 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_temp": [], 2024-04-18T21:05:32.301 INFO:teuthology.orchestra.run.smithi078.stdout: "primary_temp": [], 2024-04-18T21:05:32.301 INFO:teuthology.orchestra.run.smithi078.stdout: "blocklist": {}, 2024-04-18T21:05:32.301 INFO:teuthology.orchestra.run.smithi078.stdout: "range_blocklist": {}, 2024-04-18T21:05:32.302 INFO:teuthology.orchestra.run.smithi078.stdout: "erasure_code_profiles": { 2024-04-18T21:05:32.302 INFO:teuthology.orchestra.run.smithi078.stdout: "default": { 2024-04-18T21:05:32.302 INFO:teuthology.orchestra.run.smithi078.stdout: "crush-failure-domain": "osd", 2024-04-18T21:05:32.302 INFO:teuthology.orchestra.run.smithi078.stdout: "k": "2", 2024-04-18T21:05:32.302 INFO:teuthology.orchestra.run.smithi078.stdout: "m": "1", 2024-04-18T21:05:32.302 INFO:teuthology.orchestra.run.smithi078.stdout: "plugin": "jerasure", 2024-04-18T21:05:32.303 INFO:teuthology.orchestra.run.smithi078.stdout: "technique": "reed_sol_van" 2024-04-18T21:05:32.303 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:32.303 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:32.303 INFO:teuthology.orchestra.run.smithi078.stdout: "removed_snaps_queue": [], 2024-04-18T21:05:32.303 INFO:teuthology.orchestra.run.smithi078.stdout: "new_removed_snaps": [], 2024-04-18T21:05:32.303 INFO:teuthology.orchestra.run.smithi078.stdout: "new_purged_snaps": [], 2024-04-18T21:05:32.303 INFO:teuthology.orchestra.run.smithi078.stdout: "crush_node_flags": {}, 2024-04-18T21:05:32.303 INFO:teuthology.orchestra.run.smithi078.stdout: "device_class_flags": {}, 2024-04-18T21:05:32.304 INFO:teuthology.orchestra.run.smithi078.stdout: "stretch_mode": { 2024-04-18T21:05:32.304 INFO:teuthology.orchestra.run.smithi078.stdout: "stretch_mode_enabled": false, 2024-04-18T21:05:32.304 INFO:teuthology.orchestra.run.smithi078.stdout: "stretch_bucket_count": 0, 2024-04-18T21:05:32.304 INFO:teuthology.orchestra.run.smithi078.stdout: "degraded_stretch_mode": 0, 2024-04-18T21:05:32.304 INFO:teuthology.orchestra.run.smithi078.stdout: "recovering_stretch_mode": 0, 2024-04-18T21:05:32.304 INFO:teuthology.orchestra.run.smithi078.stdout: "stretch_mode_bucket": 0 2024-04-18T21:05:32.304 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:32.304 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-04-18T21:05:32.306 INFO:tasks.thrashosds.thrasher:j is {'epoch': 22, 'fsid': 'dc017990-0393-4ab0-b604-5e7052fdc7bd', 'created': '2024-04-18T21:04:43.507538+0000', 'modified': '2024-04-18T21:05:30.789026+0000', 'last_up_change': '2024-04-18T21:04:52.492503+0000', 'last_in_change': '2024-04-18T21:04:44.402191+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T21:04:52.538153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-18T21:04:58.673793+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T21:05:03.314171+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T21:05:03.931699+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '1854d737-3a67-416a-8c88-0f126505a0f2', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.132:6800', 'nonce': 1948809768}, {'type': 'v1', 'addr': '172.21.15.132:6801', 'nonce': 1948809768}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.132:6802', 'nonce': 1948809768}, {'type': 'v1', 'addr': '172.21.15.132:6803', 'nonce': 1948809768}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.132:6806', 'nonce': 1948809768}, {'type': 'v1', 'addr': '172.21.15.132:6807', 'nonce': 1948809768}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.132:6804', 'nonce': 1948809768}, {'type': 'v1', 'addr': '172.21.15.132:6805', 'nonce': 1948809768}]}, 'public_addr': '172.21.15.132:6801/1948809768', 'cluster_addr': '172.21.15.132:6803/1948809768', 'heartbeat_back_addr': '172.21.15.132:6807/1948809768', 'heartbeat_front_addr': '172.21.15.132:6805/1948809768', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'dfeae661-3f8a-4d41-b287-7eb02c16b91a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6800', 'nonce': 2040503167}, {'type': 'v1', 'addr': '172.21.15.150:6801', 'nonce': 2040503167}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6802', 'nonce': 2040503167}, {'type': 'v1', 'addr': '172.21.15.150:6803', 'nonce': 2040503167}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6806', 'nonce': 2040503167}, {'type': 'v1', 'addr': '172.21.15.150:6807', 'nonce': 2040503167}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6804', 'nonce': 2040503167}, {'type': 'v1', 'addr': '172.21.15.150:6805', 'nonce': 2040503167}]}, 'public_addr': '172.21.15.150:6801/2040503167', 'cluster_addr': '172.21.15.150:6803/2040503167', 'heartbeat_back_addr': '172.21.15.150:6807/2040503167', 'heartbeat_front_addr': '172.21.15.150:6805/2040503167', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '56a34021-e2dc-41ff-822c-7ec123466f25', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6800', 'nonce': 429896900}, {'type': 'v1', 'addr': '172.21.15.187:6801', 'nonce': 429896900}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6802', 'nonce': 429896900}, {'type': 'v1', 'addr': '172.21.15.187:6803', 'nonce': 429896900}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6806', 'nonce': 429896900}, {'type': 'v1', 'addr': '172.21.15.187:6807', 'nonce': 429896900}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6804', 'nonce': 429896900}, {'type': 'v1', 'addr': '172.21.15.187:6805', 'nonce': 429896900}]}, 'public_addr': '172.21.15.187:6801/429896900', 'cluster_addr': '172.21.15.187:6803/429896900', 'heartbeat_back_addr': '172.21.15.187:6807/429896900', 'heartbeat_front_addr': '172.21.15.187:6805/429896900', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-18T21:04:49.804359+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-18T21:04:49.790978+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-18T21:04:49.762943+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-18T21:05:32.306 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-04-18T21:05:32.307 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:32.307+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:32.351 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:32.351 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:32.365 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:05:32.406 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:32.407+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:32.408 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:05:32.498 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:32.499 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:32.507 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:32.507+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:32.512 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:05:32.562 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:05:32.562 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:05:32.583 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1: {} 2024-04-18T21:05:32.583 INFO:teuthology.orchestra.run.smithi078.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:05:32.600 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:05:32.601 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:05:32.608 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:32.607+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:32.673 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:05:32.674 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:05:32.674 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-18T21:05:32.674 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-18T21:05:32.674 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:05:32.686 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:05:32.733 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:32.735+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:32.797 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:05:32.797 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-18T21:05:32.797 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-18T21:05:32.798 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:05:32.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.798 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:32.798 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:05:32.798 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 27.181672665000001, 2024-04-18T21:05:32.798 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.034065303999999998, 2024-04-18T21:05:32.798 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:32.798 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:32.798 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:32.798 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:32.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.798 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:32.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:05:32.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:32.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:32.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:05:32.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:32.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:32.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615254+0000", 2024-04-18T21:05:32.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7829999999999999e-06 2024-04-18T21:05:32.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:32.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615267+0000", 2024-04-18T21:05:32.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3334e-05 2024-04-18T21:05:32.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.800 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.800 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:32.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615294+0000", 2024-04-18T21:05:32.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7271999999999999e-05 2024-04-18T21:05:32.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.800 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.800 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:32.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615321+0000", 2024-04-18T21:05:32.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.637e-05 2024-04-18T21:05:32.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.800 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.801 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:32.801 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615479+0000", 2024-04-18T21:05:32.801 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000158493 2024-04-18T21:05:32.801 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.801 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.801 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:32.801 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615498+0000", 2024-04-18T21:05:32.801 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9148999999999999e-05 2024-04-18T21:05:32.801 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.801 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.801 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:32.801 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632915+0000", 2024-04-18T21:05:32.801 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.017416551999999998 2024-04-18T21:05:32.801 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.801 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.802 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:32.802 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633302+0000", 2024-04-18T21:05:32.802 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00038725000000000001 2024-04-18T21:05:32.802 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.802 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.802 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:32.802 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633638+0000", 2024-04-18T21:05:32.802 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000335946 2024-04-18T21:05:32.802 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.802 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.802 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:32.802 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645976+0000", 2024-04-18T21:05:32.802 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012337617 2024-04-18T21:05:32.803 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.803 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:32.803 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649080+0000", 2024-04-18T21:05:32.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031038929999999999 2024-04-18T21:05:32.803 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.803 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:32.803 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649207+0000", 2024-04-18T21:05:32.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000127537 2024-04-18T21:05:32.803 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.803 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:32.803 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649316+0000", 2024-04-18T21:05:32.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109108 2024-04-18T21:05:32.804 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:32.804 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:32.804 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:32.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.804 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:32.804 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:05:32.804 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 27.181539288, 2024-04-18T21:05:32.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036275764000000002, 2024-04-18T21:05:32.804 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:32.804 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:32.804 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:32.805 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:32.805 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.805 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:32.805 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:05:32.805 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:32.805 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.805 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.805 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:32.805 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:05:32.805 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:32.805 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.805 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.805 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:32.806 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615386+0000", 2024-04-18T21:05:32.806 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.573e-06 2024-04-18T21:05:32.806 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.806 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.806 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:32.806 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:05:32.806 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0723999999999999e-05 2024-04-18T21:05:32.806 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.806 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.806 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:32.806 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615418+0000", 2024-04-18T21:05:32.806 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0902000000000001e-05 2024-04-18T21:05:32.806 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.806 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.807 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:32.807 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615433+0000", 2024-04-18T21:05:32.807 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5319999999999999e-05 2024-04-18T21:05:32.807 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.807 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.807 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:32.807 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615659+0000", 2024-04-18T21:05:32.807 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000226095 2024-04-18T21:05:32.807 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.807 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.807 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:32.807 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:32.807 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1276e-05 2024-04-18T21:05:32.808 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.808 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:32.808 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643654+0000", 2024-04-18T21:05:32.808 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027983238000000001 2024-04-18T21:05:32.808 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.808 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:32.808 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643868+0000", 2024-04-18T21:05:32.808 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000214305 2024-04-18T21:05:32.808 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.808 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:32.808 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:05:32.808 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035892200000000002 2024-04-18T21:05:32.809 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.809 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:32.809 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646056+0000", 2024-04-18T21:05:32.809 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001829172 2024-04-18T21:05:32.809 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.809 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:32.809 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651406+0000", 2024-04-18T21:05:32.809 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0053504800000000003 2024-04-18T21:05:32.809 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.809 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:32.809 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651551+0000", 2024-04-18T21:05:32.810 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014427999999999999 2024-04-18T21:05:32.810 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.810 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.810 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:32.810 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651660+0000", 2024-04-18T21:05:32.810 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109477 2024-04-18T21:05:32.810 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:32.810 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:32.810 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:32.810 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.810 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.810 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:32.810 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:05:32.810 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 27.181465906, 2024-04-18T21:05:32.811 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045668994999999997, 2024-04-18T21:05:32.811 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:32.811 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:32.811 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:32.811 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:32.811 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.811 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:32.811 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:05:32.811 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:32.811 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.811 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.811 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:32.811 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:05:32.811 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:32.812 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.812 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.812 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:32.812 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615459+0000", 2024-04-18T21:05:32.812 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5030000000000001e-06 2024-04-18T21:05:32.812 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.812 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.812 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:32.812 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615506+0000", 2024-04-18T21:05:32.812 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6872000000000001e-05 2024-04-18T21:05:32.812 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.812 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.812 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:32.812 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615527+0000", 2024-04-18T21:05:32.813 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0763000000000001e-05 2024-04-18T21:05:32.813 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.813 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.813 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:32.813 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615551+0000", 2024-04-18T21:05:32.813 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4159e-05 2024-04-18T21:05:32.813 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.813 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.813 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:32.813 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615736+0000", 2024-04-18T21:05:32.813 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018499599999999999 2024-04-18T21:05:32.813 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.813 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.813 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:32.813 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615748+0000", 2024-04-18T21:05:32.813 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2272999999999999e-05 2024-04-18T21:05:32.814 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.814 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.814 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:32.814 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635481+0000", 2024-04-18T21:05:32.814 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019732772999999999 2024-04-18T21:05:32.814 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.814 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.814 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:32.814 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635791+0000", 2024-04-18T21:05:32.814 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031013299999999998 2024-04-18T21:05:32.814 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.814 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.814 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:32.815 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636101+0000", 2024-04-18T21:05:32.815 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030943300000000002 2024-04-18T21:05:32.815 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.815 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.815 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:32.815 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646043+0000", 2024-04-18T21:05:32.815 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099428139999999995 2024-04-18T21:05:32.815 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.815 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.815 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:32.815 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660991+0000", 2024-04-18T21:05:32.815 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014947142 2024-04-18T21:05:32.815 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.815 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.815 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:32.815 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661061+0000", 2024-04-18T21:05:32.816 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0438000000000006e-05 2024-04-18T21:05:32.816 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.816 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.816 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:32.816 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661127+0000", 2024-04-18T21:05:32.816 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5696000000000003e-05 2024-04-18T21:05:32.816 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:32.816 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:32.816 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:32.816 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.816 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.816 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:32.816 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:32.816 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 27.181253477999999, 2024-04-18T21:05:32.817 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045745085999999997, 2024-04-18T21:05:32.817 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:32.817 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:32.817 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:32.817 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:32.817 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.817 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:32.817 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:32.817 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:32.817 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.817 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.817 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:32.817 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:32.817 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:32.818 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.818 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.818 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:32.818 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:05:32.818 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7400000000000001e-06 2024-04-18T21:05:32.818 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.818 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.818 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:32.818 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:05:32.818 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8133e-05 2024-04-18T21:05:32.818 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.818 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.818 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:32.819 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615726+0000", 2024-04-18T21:05:32.819 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6132e-05 2024-04-18T21:05:32.819 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.819 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.819 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:32.819 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615742+0000", 2024-04-18T21:05:32.819 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6157000000000001e-05 2024-04-18T21:05:32.819 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.819 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.819 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:32.819 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615937+0000", 2024-04-18T21:05:32.819 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000194768 2024-04-18T21:05:32.819 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.819 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.819 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:32.820 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615950+0000", 2024-04-18T21:05:32.820 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3084e-05 2024-04-18T21:05:32.820 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.820 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.820 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:32.820 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643676+0000", 2024-04-18T21:05:32.820 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027725639999999999 2024-04-18T21:05:32.820 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.820 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.820 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:32.820 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643867+0000", 2024-04-18T21:05:32.820 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019075900000000001 2024-04-18T21:05:32.820 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.821 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.821 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:32.821 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:05:32.821 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036013799999999997 2024-04-18T21:05:32.821 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.821 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.821 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:32.821 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646068+0000", 2024-04-18T21:05:32.821 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001841536 2024-04-18T21:05:32.821 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.821 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.821 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:32.821 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661184+0000", 2024-04-18T21:05:32.821 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015115458999999999 2024-04-18T21:05:32.822 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.822 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.822 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:32.822 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661283+0000", 2024-04-18T21:05:32.822 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9502999999999999e-05 2024-04-18T21:05:32.822 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.822 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.822 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:32.822 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661415+0000", 2024-04-18T21:05:32.822 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000132037 2024-04-18T21:05:32.822 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:32.822 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:32.822 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:32.822 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.823 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.823 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:32.823 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:05:32.823 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 27.181131790999999, 2024-04-18T21:05:32.823 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036185947000000003, 2024-04-18T21:05:32.823 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:32.823 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:32.823 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:32.823 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:32.823 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.823 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:32.823 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:05:32.823 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:32.823 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.824 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.824 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:32.824 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:05:32.824 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:32.824 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.824 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.824 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:32.824 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615794+0000", 2024-04-18T21:05:32.824 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6440000000000001e-06 2024-04-18T21:05:32.824 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.824 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.824 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:32.824 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615803+0000", 2024-04-18T21:05:32.824 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1220000000000001e-06 2024-04-18T21:05:32.825 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.825 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.825 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:32.825 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615827+0000", 2024-04-18T21:05:32.825 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3997000000000001e-05 2024-04-18T21:05:32.825 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.825 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.825 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:32.825 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615899+0000", 2024-04-18T21:05:32.825 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2741e-05 2024-04-18T21:05:32.825 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.825 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.826 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:32.826 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616019+0000", 2024-04-18T21:05:32.826 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119874 2024-04-18T21:05:32.826 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.826 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.826 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:32.826 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616029+0000", 2024-04-18T21:05:32.826 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:05:32.826 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.826 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.826 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:32.826 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644823+0000", 2024-04-18T21:05:32.826 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.028793151999999999 2024-04-18T21:05:32.826 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.827 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.827 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:32.827 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645106+0000", 2024-04-18T21:05:32.827 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028379700000000002 2024-04-18T21:05:32.827 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.827 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.827 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:32.827 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645294+0000", 2024-04-18T21:05:32.827 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000187181 2024-04-18T21:05:32.827 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.827 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.827 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:32.827 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646763+0000", 2024-04-18T21:05:32.827 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0014691050000000001 2024-04-18T21:05:32.827 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.828 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.828 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:32.828 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651784+0000", 2024-04-18T21:05:32.828 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050211650000000002 2024-04-18T21:05:32.828 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.828 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.828 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:32.828 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651876+0000", 2024-04-18T21:05:32.828 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2503999999999994e-05 2024-04-18T21:05:32.828 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.828 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.828 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:32.828 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651978+0000", 2024-04-18T21:05:32.829 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000101475 2024-04-18T21:05:32.829 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:32.829 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:32.829 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:32.829 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.829 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.829 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:32.829 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:32.829 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 27.180983183999999, 2024-04-18T21:05:32.829 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032262322000000003, 2024-04-18T21:05:32.829 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:32.829 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:32.829 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:32.829 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:32.829 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.829 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:32.830 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:32.830 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:32.830 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.830 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.830 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:32.830 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:32.830 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:32.830 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.830 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.830 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:32.830 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615943+0000", 2024-04-18T21:05:32.830 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1959999999999998e-06 2024-04-18T21:05:32.830 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.830 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.831 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:32.831 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615956+0000", 2024-04-18T21:05:32.831 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3424000000000001e-05 2024-04-18T21:05:32.831 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.831 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.831 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:32.831 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615983+0000", 2024-04-18T21:05:32.831 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7072000000000001e-05 2024-04-18T21:05:32.831 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.831 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.831 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:32.831 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616006+0000", 2024-04-18T21:05:32.831 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2823000000000002e-05 2024-04-18T21:05:32.831 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.831 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.831 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:32.832 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616156+0000", 2024-04-18T21:05:32.832 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014962299999999999 2024-04-18T21:05:32.832 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.832 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.832 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:32.832 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616174+0000", 2024-04-18T21:05:32.832 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8082999999999999e-05 2024-04-18T21:05:32.832 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.832 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.832 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:32.832 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.629952+0000", 2024-04-18T21:05:32.832 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013778514 2024-04-18T21:05:32.832 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.832 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.833 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:32.833 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630201+0000", 2024-04-18T21:05:32.833 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024918100000000001 2024-04-18T21:05:32.833 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.833 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.833 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:32.833 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630386+0000", 2024-04-18T21:05:32.833 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018436900000000001 2024-04-18T21:05:32.833 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.833 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.833 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:32.833 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643169+0000", 2024-04-18T21:05:32.833 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012782774 2024-04-18T21:05:32.833 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.833 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.834 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:32.834 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.647924+0000", 2024-04-18T21:05:32.834 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004755787 2024-04-18T21:05:32.834 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.834 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.834 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:32.834 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648069+0000", 2024-04-18T21:05:32.834 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014459600000000001 2024-04-18T21:05:32.834 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.834 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.834 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:32.834 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648203+0000", 2024-04-18T21:05:32.834 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013388000000000001 2024-04-18T21:05:32.835 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:32.835 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:32.835 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:32.835 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.835 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.835 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:32.835 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:05:32.835 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 27.180874920000001, 2024-04-18T21:05:32.835 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032489736999999998, 2024-04-18T21:05:32.835 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:32.835 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:32.835 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:32.835 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:32.835 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.835 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:32.836 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:05:32.836 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:32.836 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.836 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.836 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:32.836 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:05:32.836 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:32.836 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.836 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.836 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:32.836 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616050+0000", 2024-04-18T21:05:32.836 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.606e-06 2024-04-18T21:05:32.836 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.836 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.836 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:32.837 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616061+0000", 2024-04-18T21:05:32.837 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0463e-05 2024-04-18T21:05:32.837 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.837 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.837 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:32.837 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616092+0000", 2024-04-18T21:05:32.837 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1415999999999999e-05 2024-04-18T21:05:32.837 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.837 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.837 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:32.837 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616109+0000", 2024-04-18T21:05:32.837 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6557000000000001e-05 2024-04-18T21:05:32.837 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.837 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.837 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:32.838 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616358+0000", 2024-04-18T21:05:32.838 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000249077 2024-04-18T21:05:32.838 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.838 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.838 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:32.838 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616370+0000", 2024-04-18T21:05:32.838 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2037e-05 2024-04-18T21:05:32.838 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.838 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.838 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:32.838 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.634920+0000", 2024-04-18T21:05:32.838 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018550397 2024-04-18T21:05:32.838 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.838 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.839 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:32.839 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640420+0000", 2024-04-18T21:05:32.839 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055000539999999999 2024-04-18T21:05:32.839 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.839 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.839 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:32.839 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648538+0000", 2024-04-18T21:05:32.839 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0081181299999999994 2024-04-18T21:05:32.839 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:32.839 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:32.839 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:32.839 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.839 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.840 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:32.840 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:05:32.840 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 27.180790599000002, 2024-04-18T21:05:32.840 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036090029000000003, 2024-04-18T21:05:32.840 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:32.840 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:32.840 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:32.840 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:32.840 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.840 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:32.840 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:05:32.840 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:32.840 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.840 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.840 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:32.841 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:05:32.841 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:32.841 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.841 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.841 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:32.841 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616134+0000", 2024-04-18T21:05:32.841 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.353e-06 2024-04-18T21:05:32.841 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.841 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.841 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:32.841 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616141+0000", 2024-04-18T21:05:32.841 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2770000000000002e-06 2024-04-18T21:05:32.841 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.841 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.841 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:32.842 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616160+0000", 2024-04-18T21:05:32.842 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.91e-05 2024-04-18T21:05:32.842 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.842 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.842 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:32.842 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616170+0000", 2024-04-18T21:05:32.842 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7699999999999996e-06 2024-04-18T21:05:32.842 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.842 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.842 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:32.842 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616275+0000", 2024-04-18T21:05:32.842 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105313 2024-04-18T21:05:32.842 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.843 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.843 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:32.843 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616288+0000", 2024-04-18T21:05:32.843 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3027000000000001e-05 2024-04-18T21:05:32.843 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.843 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.843 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:32.843 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646160+0000", 2024-04-18T21:05:32.843 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.029872019 2024-04-18T21:05:32.843 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.843 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.844 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:32.844 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646368+0000", 2024-04-18T21:05:32.844 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020811899999999999 2024-04-18T21:05:32.844 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.844 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.844 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:32.844 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652223+0000", 2024-04-18T21:05:32.844 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.005855051 2024-04-18T21:05:32.844 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:32.844 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:32.844 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:32.844 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.844 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.844 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:32.844 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:05:32.845 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 27.180733029999999, 2024-04-18T21:05:32.845 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043572403000000003, 2024-04-18T21:05:32.845 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:32.845 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:32.845 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:32.845 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:32.845 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.845 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:32.845 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:05:32.845 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:32.845 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.845 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.845 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:32.845 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:05:32.846 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:32.846 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.846 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.846 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:32.846 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616192+0000", 2024-04-18T21:05:32.846 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:05:32.846 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.846 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.846 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:32.846 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616203+0000", 2024-04-18T21:05:32.846 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0890000000000001e-05 2024-04-18T21:05:32.846 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.846 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.846 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:32.846 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616223+0000", 2024-04-18T21:05:32.847 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0409000000000001e-05 2024-04-18T21:05:32.847 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.847 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.847 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:32.847 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616238+0000", 2024-04-18T21:05:32.847 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5160000000000001e-05 2024-04-18T21:05:32.847 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.847 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.847 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:32.847 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616343+0000", 2024-04-18T21:05:32.847 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000104831 2024-04-18T21:05:32.847 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.847 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.847 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:32.847 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616357+0000", 2024-04-18T21:05:32.848 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3686000000000001e-05 2024-04-18T21:05:32.848 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.848 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.848 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:32.848 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635912+0000", 2024-04-18T21:05:32.848 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019554944000000001 2024-04-18T21:05:32.848 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.848 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.848 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:32.848 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636231+0000", 2024-04-18T21:05:32.848 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000318766 2024-04-18T21:05:32.848 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.848 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.848 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:32.848 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659763+0000", 2024-04-18T21:05:32.849 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023532474000000001 2024-04-18T21:05:32.849 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:32.849 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:32.849 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:32.849 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.849 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.849 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:32.849 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:05:32.849 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 27.176804322999999, 2024-04-18T21:05:32.849 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015007971, 2024-04-18T21:05:32.849 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:32.849 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:32.849 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:32.849 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:32.849 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.850 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:32.850 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:05:32.850 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:32.850 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.850 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.850 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:32.850 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:05:32.850 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:32.850 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.850 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.850 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:32.850 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620120+0000", 2024-04-18T21:05:32.850 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0359999999999999e-06 2024-04-18T21:05:32.851 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.851 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.851 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:32.851 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620157+0000", 2024-04-18T21:05:32.851 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6636e-05 2024-04-18T21:05:32.851 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.851 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.851 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:32.851 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620177+0000", 2024-04-18T21:05:32.851 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0247000000000001e-05 2024-04-18T21:05:32.851 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.851 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.851 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:32.851 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620195+0000", 2024-04-18T21:05:32.852 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7819e-05 2024-04-18T21:05:32.852 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.852 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.852 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:32.852 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620342+0000", 2024-04-18T21:05:32.852 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014643300000000001 2024-04-18T21:05:32.852 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.852 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.852 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:32.852 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620405+0000", 2024-04-18T21:05:32.852 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3522000000000006e-05 2024-04-18T21:05:32.852 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.852 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.853 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:32.853 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635016+0000", 2024-04-18T21:05:32.853 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014610840999999999 2024-04-18T21:05:32.853 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.853 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.853 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:32.853 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635127+0000", 2024-04-18T21:05:32.853 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111437 2024-04-18T21:05:32.853 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:32.853 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:32.853 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:32.853 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.853 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.853 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:32.854 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:05:32.854 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 27.176697054999998, 2024-04-18T21:05:32.854 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012693296, 2024-04-18T21:05:32.854 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:32.854 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:32.854 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:32.854 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:32.854 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.854 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:32.854 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:05:32.854 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:32.854 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.854 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.854 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:32.854 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:05:32.855 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:32.855 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.855 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.855 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:32.855 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620228+0000", 2024-04-18T21:05:32.855 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:05:32.855 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.855 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.855 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:32.855 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620236+0000", 2024-04-18T21:05:32.855 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.303e-06 2024-04-18T21:05:32.855 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.855 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.855 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:32.856 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620255+0000", 2024-04-18T21:05:32.856 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9406e-05 2024-04-18T21:05:32.856 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.856 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.856 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:32.856 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620274+0000", 2024-04-18T21:05:32.856 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8940000000000002e-05 2024-04-18T21:05:32.856 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.856 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.856 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:32.856 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:05:32.856 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001558753 2024-04-18T21:05:32.856 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.856 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.856 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:32.856 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621879+0000", 2024-04-18T21:05:32.857 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6359000000000001e-05 2024-04-18T21:05:32.857 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.857 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.857 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:32.857 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632841+0000", 2024-04-18T21:05:32.857 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010961907 2024-04-18T21:05:32.857 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.857 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.857 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:32.857 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632920+0000", 2024-04-18T21:05:32.857 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8714999999999994e-05 2024-04-18T21:05:32.857 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:32.857 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:32.857 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:32.857 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.857 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.858 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:32.858 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:05:32.858 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 27.175151291999999, 2024-04-18T21:05:32.858 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013445702, 2024-04-18T21:05:32.858 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:32.858 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:32.858 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:32.858 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:32.858 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.858 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:32.858 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:05:32.858 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:32.858 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.858 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:32.859 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:05:32.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:32.859 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:32.859 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621774+0000", 2024-04-18T21:05:32.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2500000000000001e-06 2024-04-18T21:05:32.859 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:32.859 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621786+0000", 2024-04-18T21:05:32.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2636000000000001e-05 2024-04-18T21:05:32.859 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:32.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621814+0000", 2024-04-18T21:05:32.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7823000000000001e-05 2024-04-18T21:05:32.860 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.860 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:32.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621844+0000", 2024-04-18T21:05:32.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9589000000000001e-05 2024-04-18T21:05:32.860 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.860 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:32.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622253+0000", 2024-04-18T21:05:32.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040963700000000002 2024-04-18T21:05:32.860 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.861 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:32.861 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622304+0000", 2024-04-18T21:05:32.861 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0868999999999997e-05 2024-04-18T21:05:32.861 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.861 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:32.861 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635133+0000", 2024-04-18T21:05:32.861 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012829136 2024-04-18T21:05:32.861 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.861 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:32.861 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635218+0000", 2024-04-18T21:05:32.861 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4761999999999999e-05 2024-04-18T21:05:32.861 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:32.862 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:32.862 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:32.862 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.862 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.862 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:32.862 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:05:32.862 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 27.175024531999998, 2024-04-18T21:05:32.862 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014162065, 2024-04-18T21:05:32.862 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:32.862 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:32.862 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:32.862 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:32.862 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.862 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:32.862 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:05:32.863 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:32.863 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.863 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.863 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:32.863 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:05:32.863 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:32.863 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.863 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.863 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:32.863 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621900+0000", 2024-04-18T21:05:32.863 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:05:32.863 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.863 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.863 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:32.864 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621910+0000", 2024-04-18T21:05:32.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0207000000000001e-05 2024-04-18T21:05:32.864 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.864 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.864 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:32.864 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621932+0000", 2024-04-18T21:05:32.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1789000000000001e-05 2024-04-18T21:05:32.864 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.864 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.864 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:32.864 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621946+0000", 2024-04-18T21:05:32.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4212999999999999e-05 2024-04-18T21:05:32.864 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.865 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.865 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:32.865 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624477+0000", 2024-04-18T21:05:32.865 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025303470000000001 2024-04-18T21:05:32.865 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.865 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.865 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:32.865 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624525+0000", 2024-04-18T21:05:32.865 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8084999999999998e-05 2024-04-18T21:05:32.865 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.865 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.865 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:32.865 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635976+0000", 2024-04-18T21:05:32.865 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.011451368999999999 2024-04-18T21:05:32.866 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.866 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.866 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:32.866 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636061+0000", 2024-04-18T21:05:32.866 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5094999999999998e-05 2024-04-18T21:05:32.866 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:32.866 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:32.866 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:32.866 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.866 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.866 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:05:32.866 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:05:32.866 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 27.165788907, 2024-04-18T21:05:32.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0098014739999999993, 2024-04-18T21:05:32.867 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:32.867 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:32.867 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:05:32.867 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:32.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:32.867 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:05:32.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:32.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:32.867 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:05:32.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:32.868 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.868 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.868 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:32.868 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631136+0000", 2024-04-18T21:05:32.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0139999999999999e-06 2024-04-18T21:05:32.868 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.868 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.868 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:32.868 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631152+0000", 2024-04-18T21:05:32.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6365999999999999e-05 2024-04-18T21:05:32.868 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.868 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.869 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:32.869 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631961+0000", 2024-04-18T21:05:32.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00080873100000000003 2024-04-18T21:05:32.869 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.869 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.869 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:32.869 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632021+0000", 2024-04-18T21:05:32.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0541999999999997e-05 2024-04-18T21:05:32.869 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.869 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.869 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:32.869 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633539+0000", 2024-04-18T21:05:32.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015175639999999999 2024-04-18T21:05:32.869 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.869 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.870 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:32.870 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640936+0000", 2024-04-18T21:05:32.870 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007397257 2024-04-18T21:05:32.870 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:32.870 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:32.870 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:32.870 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.870 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.870 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-18T21:05:32.870 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:05:32.870 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 27.148327473999998, 2024-04-18T21:05:32.870 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00073592199999999997, 2024-04-18T21:05:32.870 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:32.871 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:32.871 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:32.871 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:32.871 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.871 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:32.871 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:05:32.871 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:32.871 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.871 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.871 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:32.871 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:05:32.871 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:32.871 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.871 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.872 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:32.872 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648597+0000", 2024-04-18T21:05:32.872 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:05:32.872 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.872 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.872 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:32.872 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648605+0000", 2024-04-18T21:05:32.872 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3960000000000006e-06 2024-04-18T21:05:32.872 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.872 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.872 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:32.872 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648625+0000", 2024-04-18T21:05:32.872 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9987e-05 2024-04-18T21:05:32.872 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.872 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.873 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:32.873 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648643+0000", 2024-04-18T21:05:32.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7079e-05 2024-04-18T21:05:32.873 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.873 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.873 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:32.873 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649043+0000", 2024-04-18T21:05:32.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040083399999999998 2024-04-18T21:05:32.873 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.873 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.873 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:32.873 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649062+0000", 2024-04-18T21:05:32.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9052999999999999e-05 2024-04-18T21:05:32.873 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.873 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.874 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:32.874 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649332+0000", 2024-04-18T21:05:32.874 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026971999999999999 2024-04-18T21:05:32.874 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:32.874 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:32.874 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:32.874 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.874 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.874 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:05:32.874 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:05:32.874 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 27.145552573, 2024-04-18T21:05:32.874 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00086123999999999999, 2024-04-18T21:05:32.874 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:32.874 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:32.875 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:05:32.875 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:32.875 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.875 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:32.875 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:05:32.875 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:32.875 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.875 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.875 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:32.875 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:05:32.875 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:32.875 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.875 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.875 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:32.876 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651372+0000", 2024-04-18T21:05:32.876 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7599999999999997e-07 2024-04-18T21:05:32.876 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.876 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.876 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:32.876 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651377+0000", 2024-04-18T21:05:32.876 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.22e-06 2024-04-18T21:05:32.876 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.876 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.876 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:32.876 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651394+0000", 2024-04-18T21:05:32.876 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6646999999999998e-05 2024-04-18T21:05:32.876 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.876 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.877 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:32.877 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651427+0000", 2024-04-18T21:05:32.877 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3682e-05 2024-04-18T21:05:32.877 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.877 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.877 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:32.877 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652029+0000", 2024-04-18T21:05:32.877 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00060152199999999995 2024-04-18T21:05:32.877 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.877 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.877 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:32.877 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652232+0000", 2024-04-18T21:05:32.877 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020359299999999999 2024-04-18T21:05:32.877 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:32.877 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:32.878 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:32.878 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.878 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.878 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:05:32.878 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:05:32.878 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 27.137525611000001, 2024-04-18T21:05:32.878 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0017426200000000001, 2024-04-18T21:05:32.878 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:32.878 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:32.878 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:32.878 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:32.878 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.878 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:32.878 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:05:32.879 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:32.879 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.879 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.879 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:32.879 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:05:32.879 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:32.879 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.879 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.879 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:32.879 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659399+0000", 2024-04-18T21:05:32.879 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6000000000000002e-07 2024-04-18T21:05:32.879 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.879 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.879 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:32.880 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659405+0000", 2024-04-18T21:05:32.880 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5069999999999997e-06 2024-04-18T21:05:32.880 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.880 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.880 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:32.880 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659425+0000", 2024-04-18T21:05:32.880 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.927e-05 2024-04-18T21:05:32.880 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.880 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.880 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:32.880 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659443+0000", 2024-04-18T21:05:32.880 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8051999999999999e-05 2024-04-18T21:05:32.880 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.881 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.881 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:32.881 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660973+0000", 2024-04-18T21:05:32.881 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001530106 2024-04-18T21:05:32.881 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.881 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.881 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:32.881 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660983+0000", 2024-04-18T21:05:32.881 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0516999999999999e-05 2024-04-18T21:05:32.881 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.881 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.881 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:32.881 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661141+0000", 2024-04-18T21:05:32.882 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015730799999999999 2024-04-18T21:05:32.882 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:32.882 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:32.882 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:32.882 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.882 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.882 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:05:32.882 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:05:32.882 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 27.137308986000001, 2024-04-18T21:05:32.882 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001812311, 2024-04-18T21:05:32.882 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:32.882 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:32.882 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:32.883 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:32.883 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.883 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:32.883 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:05:32.883 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:32.883 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.883 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.883 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:32.883 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:05:32.883 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:32.883 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.883 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.883 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:32.883 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659616+0000", 2024-04-18T21:05:32.883 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.277e-06 2024-04-18T21:05:32.884 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.884 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.884 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:32.884 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659625+0000", 2024-04-18T21:05:32.884 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5359999999999998e-06 2024-04-18T21:05:32.884 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.884 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.884 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:32.884 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659647+0000", 2024-04-18T21:05:32.884 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1857000000000001e-05 2024-04-18T21:05:32.884 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.884 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.884 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:32.884 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659664+0000", 2024-04-18T21:05:32.884 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6405999999999998e-05 2024-04-18T21:05:32.885 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.885 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.885 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:32.885 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661169+0000", 2024-04-18T21:05:32.885 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015054179999999999 2024-04-18T21:05:32.885 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.885 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.885 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:32.885 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661177+0000", 2024-04-18T21:05:32.885 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9680000000000006e-06 2024-04-18T21:05:32.885 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.885 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.885 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:32.885 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661427+0000", 2024-04-18T21:05:32.886 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024984900000000001 2024-04-18T21:05:32.886 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:32.886 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:32.886 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:32.886 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.886 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.886 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-18T21:05:32.886 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:05:32.886 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.184388378000001, 2024-04-18T21:05:32.886 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0030975030000000001, 2024-04-18T21:05:32.886 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:32.886 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:32.886 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:32.886 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:32.887 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.887 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:32.887 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:05:32.887 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:32.887 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.887 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.887 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:32.887 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:05:32.887 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:32.887 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.887 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.887 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:32.887 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612538+0000", 2024-04-18T21:05:32.887 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6259999999999999e-06 2024-04-18T21:05:32.887 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.888 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.888 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:32.888 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612552+0000", 2024-04-18T21:05:32.888 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4073999999999999e-05 2024-04-18T21:05:32.888 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.888 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.888 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:32.888 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612585+0000", 2024-04-18T21:05:32.888 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3504999999999999e-05 2024-04-18T21:05:32.888 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.888 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.888 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:32.888 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612601+0000", 2024-04-18T21:05:32.888 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5194000000000001e-05 2024-04-18T21:05:32.889 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.889 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.889 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:32.889 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612746+0000", 2024-04-18T21:05:32.889 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145666 2024-04-18T21:05:32.889 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.889 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.889 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:32.889 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612953+0000", 2024-04-18T21:05:32.889 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000207109 2024-04-18T21:05:32.889 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.889 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.889 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:32.889 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.613134+0000", 2024-04-18T21:05:32.889 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018041300000000001 2024-04-18T21:05:32.890 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.890 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.890 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:32.890 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.614411+0000", 2024-04-18T21:05:32.890 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0012769929999999999 2024-04-18T21:05:32.890 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.890 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.890 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:32.890 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615441+0000", 2024-04-18T21:05:32.890 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001029917 2024-04-18T21:05:32.890 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.890 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.890 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:32.890 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615522+0000", 2024-04-18T21:05:32.891 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1142000000000003e-05 2024-04-18T21:05:32.891 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.891 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.891 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:32.891 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615633+0000", 2024-04-18T21:05:32.891 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000110864 2024-04-18T21:05:32.891 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:32.893 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:32.893 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:32.893 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.893 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.893 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-18T21:05:32.894 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:05:32.894 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 7.1821025670000003, 2024-04-18T21:05:32.894 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088979039999999999, 2024-04-18T21:05:32.894 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:32.894 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:32.894 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:32.894 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:32.894 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.894 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:32.894 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:05:32.894 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:32.894 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.894 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.894 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:32.895 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:05:32.895 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:32.895 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.895 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.895 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:32.895 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614825+0000", 2024-04-18T21:05:32.895 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4829999999999999e-06 2024-04-18T21:05:32.895 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.895 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.895 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:32.895 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614843+0000", 2024-04-18T21:05:32.895 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8777e-05 2024-04-18T21:05:32.895 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.895 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.895 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:32.896 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614884+0000", 2024-04-18T21:05:32.896 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1051999999999999e-05 2024-04-18T21:05:32.896 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.896 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.896 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:32.896 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614903+0000", 2024-04-18T21:05:32.896 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9069999999999999e-05 2024-04-18T21:05:32.896 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.896 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.896 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:32.896 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615047+0000", 2024-04-18T21:05:32.896 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014374400000000001 2024-04-18T21:05:32.896 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.896 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.897 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:32.897 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615061+0000", 2024-04-18T21:05:32.897 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4063000000000001e-05 2024-04-18T21:05:32.897 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.897 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.897 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:32.897 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621064+0000", 2024-04-18T21:05:32.897 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0060029200000000001 2024-04-18T21:05:32.897 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.897 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.897 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:32.897 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621211+0000", 2024-04-18T21:05:32.897 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000147224 2024-04-18T21:05:32.897 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.897 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.898 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:32.898 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621396+0000", 2024-04-18T21:05:32.898 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018454699999999999 2024-04-18T21:05:32.898 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.898 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.898 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:32.898 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.622517+0000", 2024-04-18T21:05:32.898 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001121424 2024-04-18T21:05:32.898 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.898 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.898 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:32.898 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623571+0000", 2024-04-18T21:05:32.898 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010538660000000001 2024-04-18T21:05:32.898 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.899 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.899 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:32.899 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623658+0000", 2024-04-18T21:05:32.899 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6439000000000004e-05 2024-04-18T21:05:32.899 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:32.899 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:32.899 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:32.899 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623719+0000", 2024-04-18T21:05:32.899 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1295000000000002e-05 2024-04-18T21:05:32.899 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:32.899 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:32.899 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:32.899 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:32.899 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:32.899 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:05:32.900 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-18T21:05:32.902 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:32.903+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:32.902 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:05:33.002 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:33.003+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:33.035 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:05:33.035 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:05:33.035 INFO:teuthology.orchestra.run.smithi132.stdout: "num_ops": 0 2024-04-18T21:05:33.035 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:05:33.049 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:05:33.102 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:33.099+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:33.173 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:05:33.173 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:05:33.173 INFO:teuthology.orchestra.run.smithi132.stdout: "complaint_time": 30, 2024-04-18T21:05:33.173 INFO:teuthology.orchestra.run.smithi132.stdout: "num_blocked_ops": 0 2024-04-18T21:05:33.174 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:05:33.189 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:05:33.203 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:33.203+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:33.304 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:33.307+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:33.354 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:05:33.354 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 20, 2024-04-18T21:05:33.354 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 600, 2024-04-18T21:05:33.354 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [ 2024-04-18T21:05:33.354 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.354 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:33.354 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:05:33.354 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 38.441480237999997, 2024-04-18T21:05:33.354 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.02518273, 2024-04-18T21:05:33.354 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:33.355 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:33.355 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:33.355 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:33.355 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:33.355 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:33.355 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 141 2024-04-18T21:05:33.355 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.355 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:33.355 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.355 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:33.355 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:05:33.355 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:33.355 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.355 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.355 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:33.356 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:05:33.356 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:33.356 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.356 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.356 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:33.356 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911562+0000", 2024-04-18T21:05:33.356 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9300000000000006e-07 2024-04-18T21:05:33.356 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.356 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.356 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:33.356 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911569+0000", 2024-04-18T21:05:33.356 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0169999999999999e-06 2024-04-18T21:05:33.356 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.356 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.356 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:33.356 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911582+0000", 2024-04-18T21:05:33.357 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.343e-05 2024-04-18T21:05:33.357 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.357 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.357 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.357 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911590+0000", 2024-04-18T21:05:33.357 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.413e-06 2024-04-18T21:05:33.357 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.357 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.357 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:33.357 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.933922+0000", 2024-04-18T21:05:33.357 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.022332093000000001 2024-04-18T21:05:33.357 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.357 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.357 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:33.357 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.934155+0000", 2024-04-18T21:05:33.357 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023378900000000001 2024-04-18T21:05:33.358 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.358 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.358 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:33.358 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.934514+0000", 2024-04-18T21:05:33.358 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00035859200000000003 2024-04-18T21:05:33.358 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.358 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.358 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:33.358 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.935973+0000", 2024-04-18T21:05:33.358 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001458705 2024-04-18T21:05:33.358 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.358 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.358 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:33.359 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936488+0000", 2024-04-18T21:05:33.359 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00051550000000000001 2024-04-18T21:05:33.359 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.359 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.359 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:33.359 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936636+0000", 2024-04-18T21:05:33.359 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014779800000000001 2024-04-18T21:05:33.359 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.359 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.359 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:33.359 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936743+0000", 2024-04-18T21:05:33.359 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010739999999999999 2024-04-18T21:05:33.359 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:33.359 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:33.360 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:33.360 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.360 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.360 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:33.360 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:05:33.360 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 38.324281264, 2024-04-18T21:05:33.360 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023654959999999999, 2024-04-18T21:05:33.360 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:33.360 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:33.360 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:33.360 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:33.360 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:33.360 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:33.360 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 163 2024-04-18T21:05:33.361 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.361 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:33.361 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.361 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:33.361 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:05:33.361 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:33.361 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.361 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.361 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:33.361 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:05:33.361 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:33.361 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.361 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.361 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:33.362 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:05:33.362 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0999999999999998e-07 2024-04-18T21:05:33.362 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.362 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.362 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:33.362 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028766+0000", 2024-04-18T21:05:33.362 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4700000000000001e-06 2024-04-18T21:05:33.362 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.362 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.362 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:33.362 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028775+0000", 2024-04-18T21:05:33.362 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.3190000000000001e-06 2024-04-18T21:05:33.362 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.362 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.362 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.363 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028782+0000", 2024-04-18T21:05:33.363 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.2300000000000002e-06 2024-04-18T21:05:33.363 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.363 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.363 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:33.363 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046667+0000", 2024-04-18T21:05:33.363 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017884356000000001 2024-04-18T21:05:33.363 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.363 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.363 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:33.363 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046788+0000", 2024-04-18T21:05:33.363 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012125000000000001 2024-04-18T21:05:33.363 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.363 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.364 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:33.364 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046982+0000", 2024-04-18T21:05:33.364 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019394 2024-04-18T21:05:33.364 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.364 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.364 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:33.364 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051969+0000", 2024-04-18T21:05:33.364 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0049868150000000003 2024-04-18T21:05:33.364 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.364 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.364 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:33.364 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052089+0000", 2024-04-18T21:05:33.364 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011993 2024-04-18T21:05:33.364 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.365 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.365 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:33.365 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052292+0000", 2024-04-18T21:05:33.365 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020345699999999999 2024-04-18T21:05:33.365 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.365 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.365 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:33.365 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052415+0000", 2024-04-18T21:05:33.365 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000122483 2024-04-18T21:05:33.365 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:33.365 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:33.365 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:33.365 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.365 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.365 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:33.365 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:05:33.366 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 38.324247032000002, 2024-04-18T21:05:33.366 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023864586, 2024-04-18T21:05:33.366 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:33.366 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:33.366 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:33.366 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:33.366 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:33.366 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:33.366 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 164 2024-04-18T21:05:33.366 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.366 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:33.366 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.366 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:33.366 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:05:33.367 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:33.367 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.367 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.367 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:33.367 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:05:33.367 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:33.367 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.367 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.367 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:33.367 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028795+0000", 2024-04-18T21:05:33.367 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7999999999999995e-07 2024-04-18T21:05:33.367 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.367 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.367 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:33.367 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028884+0000", 2024-04-18T21:05:33.368 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8997000000000002e-05 2024-04-18T21:05:33.368 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.368 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.368 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:33.368 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028895+0000", 2024-04-18T21:05:33.368 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1647e-05 2024-04-18T21:05:33.368 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.368 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.368 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.368 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028903+0000", 2024-04-18T21:05:33.368 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.909e-06 2024-04-18T21:05:33.368 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.368 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.368 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:33.369 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.047818+0000", 2024-04-18T21:05:33.369 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018914337 2024-04-18T21:05:33.369 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.369 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.369 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:33.369 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.048094+0000", 2024-04-18T21:05:33.369 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00027653500000000001 2024-04-18T21:05:33.369 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.369 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.369 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:33.369 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.048471+0000", 2024-04-18T21:05:33.369 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00037705799999999999 2024-04-18T21:05:33.369 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.369 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.370 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:33.370 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052516+0000", 2024-04-18T21:05:33.370 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0040452739999999997 2024-04-18T21:05:33.370 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.370 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.370 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:33.370 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052535+0000", 2024-04-18T21:05:33.370 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.84e-05 2024-04-18T21:05:33.370 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.370 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.370 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:33.370 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052603+0000", 2024-04-18T21:05:33.370 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.8095000000000004e-05 2024-04-18T21:05:33.370 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.371 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.371 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:33.371 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052659+0000", 2024-04-18T21:05:33.371 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5653999999999999e-05 2024-04-18T21:05:33.371 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:33.371 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:33.371 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:33.371 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.371 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.371 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:33.371 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:05:33.371 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 38.324123589000003, 2024-04-18T21:05:33.371 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024516458000000001, 2024-04-18T21:05:33.371 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:33.371 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:33.372 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:33.372 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:33.372 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:33.372 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:33.372 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 165 2024-04-18T21:05:33.372 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.372 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:33.372 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.372 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:33.372 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:05:33.372 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:33.372 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.372 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.372 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:33.372 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:05:33.373 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:33.373 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.373 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.373 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:33.373 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028918+0000", 2024-04-18T21:05:33.373 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8000000000000005e-07 2024-04-18T21:05:33.373 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.373 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.373 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:33.373 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028924+0000", 2024-04-18T21:05:33.373 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5659999999999997e-06 2024-04-18T21:05:33.373 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.373 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.373 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:33.373 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028933+0000", 2024-04-18T21:05:33.373 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.38e-06 2024-04-18T21:05:33.374 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.374 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.374 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.374 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028940+0000", 2024-04-18T21:05:33.374 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0060000000000003e-06 2024-04-18T21:05:33.374 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.374 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.374 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:33.374 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.050846+0000", 2024-04-18T21:05:33.374 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021906119000000002 2024-04-18T21:05:33.374 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.374 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.374 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:33.374 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051025+0000", 2024-04-18T21:05:33.374 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017850799999999999 2024-04-18T21:05:33.375 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.375 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.375 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:33.375 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051221+0000", 2024-04-18T21:05:33.375 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019608700000000001 2024-04-18T21:05:33.375 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.375 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.375 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:33.375 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052675+0000", 2024-04-18T21:05:33.375 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0014537899999999999 2024-04-18T21:05:33.375 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.375 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.375 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:33.375 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053311+0000", 2024-04-18T21:05:33.375 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00063613299999999999 2024-04-18T21:05:33.376 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.376 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.376 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:33.376 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053381+0000", 2024-04-18T21:05:33.376 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0074999999999996e-05 2024-04-18T21:05:33.376 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.376 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.376 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:33.376 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053434+0000", 2024-04-18T21:05:33.376 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3013999999999998e-05 2024-04-18T21:05:33.376 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:33.376 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:33.376 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:33.376 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.376 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.377 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:33.377 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:05:33.377 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 38.210818109999998, 2024-04-18T21:05:33.377 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023772793, 2024-04-18T21:05:33.377 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:33.377 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:33.377 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:33.377 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:33.377 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:33.377 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:33.377 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 187 2024-04-18T21:05:33.377 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.377 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:33.377 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.378 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:33.378 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:05:33.378 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:33.378 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.378 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.378 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:33.378 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:05:33.378 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:33.378 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.378 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.378 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:33.378 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142224+0000", 2024-04-18T21:05:33.378 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.47e-07 2024-04-18T21:05:33.378 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.379 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.379 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:33.379 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142233+0000", 2024-04-18T21:05:33.379 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0729999999999994e-06 2024-04-18T21:05:33.379 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.379 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.379 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:33.379 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142255+0000", 2024-04-18T21:05:33.379 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.2535999999999999e-05 2024-04-18T21:05:33.379 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.379 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.379 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.379 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142268+0000", 2024-04-18T21:05:33.379 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2686e-05 2024-04-18T21:05:33.379 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.380 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.380 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:33.380 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160497+0000", 2024-04-18T21:05:33.380 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018228779000000001 2024-04-18T21:05:33.380 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.380 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.380 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:33.380 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160634+0000", 2024-04-18T21:05:33.380 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000137315 2024-04-18T21:05:33.380 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.380 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.380 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:33.380 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160831+0000", 2024-04-18T21:05:33.380 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019683100000000001 2024-04-18T21:05:33.381 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.381 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.381 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:33.381 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165129+0000", 2024-04-18T21:05:33.381 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0042981299999999998 2024-04-18T21:05:33.381 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.381 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.381 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:33.381 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165776+0000", 2024-04-18T21:05:33.381 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00064702900000000003 2024-04-18T21:05:33.381 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.381 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.381 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:33.381 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165921+0000", 2024-04-18T21:05:33.382 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014506 2024-04-18T21:05:33.382 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.382 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.382 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:33.382 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165996+0000", 2024-04-18T21:05:33.382 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.4406999999999994e-05 2024-04-18T21:05:33.382 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:33.382 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:33.382 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:33.382 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.382 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.382 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:33.382 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:05:33.382 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 38.210757512000001, 2024-04-18T21:05:33.382 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026802157, 2024-04-18T21:05:33.383 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:33.383 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:33.383 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:33.383 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:33.383 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:33.383 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:33.383 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 188 2024-04-18T21:05:33.383 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.383 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:33.383 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.383 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:33.383 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:05:33.383 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:33.383 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.383 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.384 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:33.384 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:05:33.384 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:33.384 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.384 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.384 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:33.384 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142284+0000", 2024-04-18T21:05:33.384 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4e-07 2024-04-18T21:05:33.384 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.384 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.384 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:33.384 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142374+0000", 2024-04-18T21:05:33.384 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0099999999999995e-05 2024-04-18T21:05:33.384 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.384 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.385 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:33.385 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142386+0000", 2024-04-18T21:05:33.385 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1770000000000001e-05 2024-04-18T21:05:33.385 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.385 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.385 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.385 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142394+0000", 2024-04-18T21:05:33.385 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.2130000000000008e-06 2024-04-18T21:05:33.385 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.385 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.385 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:33.385 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.161743+0000", 2024-04-18T21:05:33.385 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019348644000000002 2024-04-18T21:05:33.385 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.385 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.386 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:33.386 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.161865+0000", 2024-04-18T21:05:33.386 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012210899999999999 2024-04-18T21:05:33.386 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.386 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.386 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:33.386 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.162055+0000", 2024-04-18T21:05:33.386 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000189994 2024-04-18T21:05:33.386 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.386 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.386 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:33.386 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165735+0000", 2024-04-18T21:05:33.386 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0036803270000000002 2024-04-18T21:05:33.387 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.387 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.387 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:33.387 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.168911+0000", 2024-04-18T21:05:33.387 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0031753689999999999 2024-04-18T21:05:33.387 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.387 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.387 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:33.387 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169012+0000", 2024-04-18T21:05:33.387 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010157699999999999 2024-04-18T21:05:33.387 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.387 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.387 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:33.387 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169086+0000", 2024-04-18T21:05:33.388 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3213999999999994e-05 2024-04-18T21:05:33.388 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:33.388 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:33.388 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:33.388 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.388 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.388 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:33.388 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:05:33.388 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 38.210632206, 2024-04-18T21:05:33.388 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026811423000000001, 2024-04-18T21:05:33.388 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:33.388 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:33.388 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:33.388 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:33.389 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:33.389 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:33.389 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 189 2024-04-18T21:05:33.389 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.389 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:33.389 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.389 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:33.389 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:05:33.389 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:33.389 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.389 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.389 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:33.389 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:05:33.389 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:33.390 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.390 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.390 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:33.390 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142410+0000", 2024-04-18T21:05:33.390 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:05:33.390 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.390 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.390 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:33.390 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142415+0000", 2024-04-18T21:05:33.390 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.7939999999999999e-06 2024-04-18T21:05:33.390 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.390 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.390 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:33.391 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142470+0000", 2024-04-18T21:05:33.391 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4537999999999999e-05 2024-04-18T21:05:33.391 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.391 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.391 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.391 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142481+0000", 2024-04-18T21:05:33.391 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0966e-05 2024-04-18T21:05:33.391 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.391 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.391 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:33.391 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.163493+0000", 2024-04-18T21:05:33.391 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021012444000000002 2024-04-18T21:05:33.391 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.391 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.391 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:33.392 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.163727+0000", 2024-04-18T21:05:33.392 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000233339 2024-04-18T21:05:33.392 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.392 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.392 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:33.392 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.164102+0000", 2024-04-18T21:05:33.392 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000374872 2024-04-18T21:05:33.392 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.392 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.392 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:33.392 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.166528+0000", 2024-04-18T21:05:33.392 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0024258729999999998 2024-04-18T21:05:33.392 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.392 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.392 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:33.392 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169101+0000", 2024-04-18T21:05:33.393 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0025737680000000001 2024-04-18T21:05:33.393 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.393 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.393 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:33.393 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169171+0000", 2024-04-18T21:05:33.393 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0148000000000007e-05 2024-04-18T21:05:33.393 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.393 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.393 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:33.393 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169220+0000", 2024-04-18T21:05:33.393 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8767999999999998e-05 2024-04-18T21:05:33.393 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:33.393 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:33.393 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:33.394 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.394 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.394 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:33.394 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:05:33.394 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 27.737059653999999, 2024-04-18T21:05:33.394 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024082777999999999, 2024-04-18T21:05:33.394 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:33.394 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:33.394 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:33.394 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:33.394 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.394 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:33.394 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:05:33.394 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:33.395 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.395 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.395 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:33.395 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:05:33.395 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:33.395 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.395 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.395 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:33.395 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615984+0000", 2024-04-18T21:05:33.395 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.9869999999999999e-06 2024-04-18T21:05:33.395 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.395 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.395 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:33.395 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615999+0000", 2024-04-18T21:05:33.395 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4646e-05 2024-04-18T21:05:33.396 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.396 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.396 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:33.396 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616028+0000", 2024-04-18T21:05:33.396 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8952999999999999e-05 2024-04-18T21:05:33.396 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.396 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.396 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.396 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616052+0000", 2024-04-18T21:05:33.396 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.3941999999999999e-05 2024-04-18T21:05:33.396 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.396 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.396 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:33.396 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618010+0000", 2024-04-18T21:05:33.397 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0019581780000000001 2024-04-18T21:05:33.397 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.397 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.397 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:33.397 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618322+0000", 2024-04-18T21:05:33.397 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00031158899999999997 2024-04-18T21:05:33.397 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.397 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.397 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:33.397 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618587+0000", 2024-04-18T21:05:33.397 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00026495700000000002 2024-04-18T21:05:33.397 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.397 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.397 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:33.398 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629262+0000", 2024-04-18T21:05:33.398 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010675877 2024-04-18T21:05:33.398 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.398 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.398 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:33.398 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.639773+0000", 2024-04-18T21:05:33.398 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0105109 2024-04-18T21:05:33.398 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.398 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.398 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:33.398 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.639926+0000", 2024-04-18T21:05:33.398 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000152349 2024-04-18T21:05:33.398 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.398 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.399 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:33.399 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640064+0000", 2024-04-18T21:05:33.399 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0001384 2024-04-18T21:05:33.399 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:33.399 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:33.399 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:33.399 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.399 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.399 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:33.399 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:05:33.399 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 27.736946979999999, 2024-04-18T21:05:33.399 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030215005999999999, 2024-04-18T21:05:33.399 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:33.399 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:33.400 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:33.400 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:33.400 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.400 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:33.400 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:05:33.400 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:33.400 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.400 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.400 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:33.400 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:05:33.400 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:33.400 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.400 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.401 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:33.401 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616095+0000", 2024-04-18T21:05:33.401 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.446e-06 2024-04-18T21:05:33.401 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.401 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.401 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:33.401 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616104+0000", 2024-04-18T21:05:33.401 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6200000000000005e-06 2024-04-18T21:05:33.401 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.401 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.401 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:33.401 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616132+0000", 2024-04-18T21:05:33.401 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7668999999999999e-05 2024-04-18T21:05:33.401 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.402 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.402 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.402 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616149+0000", 2024-04-18T21:05:33.402 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7047000000000001e-05 2024-04-18T21:05:33.402 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.402 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.402 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:33.402 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619287+0000", 2024-04-18T21:05:33.402 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0031381450000000002 2024-04-18T21:05:33.402 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.402 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.402 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:33.402 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619503+0000", 2024-04-18T21:05:33.402 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000216522 2024-04-18T21:05:33.403 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.403 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.403 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:33.403 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619930+0000", 2024-04-18T21:05:33.403 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00042604900000000001 2024-04-18T21:05:33.403 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.403 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.403 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:33.403 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629281+0000", 2024-04-18T21:05:33.403 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0093512230000000005 2024-04-18T21:05:33.403 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.403 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.403 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:33.403 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646022+0000", 2024-04-18T21:05:33.404 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016741156 2024-04-18T21:05:33.404 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.404 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.404 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:33.404 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646198+0000", 2024-04-18T21:05:33.404 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000176009 2024-04-18T21:05:33.404 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.404 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.404 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:33.404 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646309+0000", 2024-04-18T21:05:33.404 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011112000000000001 2024-04-18T21:05:33.404 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:33.404 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:33.404 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:33.404 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.405 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.405 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:33.405 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:05:33.405 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 27.736862156000001, 2024-04-18T21:05:33.405 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030501176000000001, 2024-04-18T21:05:33.405 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:33.405 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:33.405 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:33.405 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:33.405 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.405 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:33.405 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:05:33.405 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:33.405 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.405 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.406 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:33.406 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:05:33.406 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:33.406 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.406 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.406 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:33.406 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616180+0000", 2024-04-18T21:05:33.406 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1000000000000001e-06 2024-04-18T21:05:33.406 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.406 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.406 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:33.406 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616188+0000", 2024-04-18T21:05:33.406 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4069999999999993e-06 2024-04-18T21:05:33.406 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.407 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.407 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:33.407 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616207+0000", 2024-04-18T21:05:33.407 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8335999999999999e-05 2024-04-18T21:05:33.407 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.407 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.407 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.407 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616225+0000", 2024-04-18T21:05:33.407 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8652999999999999e-05 2024-04-18T21:05:33.407 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.407 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.407 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:33.407 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620977+0000", 2024-04-18T21:05:33.407 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047512220000000003 2024-04-18T21:05:33.407 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.407 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.408 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:33.408 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621279+0000", 2024-04-18T21:05:33.408 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000302646 2024-04-18T21:05:33.408 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.408 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.408 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:33.408 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621584+0000", 2024-04-18T21:05:33.408 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000305142 2024-04-18T21:05:33.408 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.408 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.408 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:33.408 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629352+0000", 2024-04-18T21:05:33.408 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0077673689999999997 2024-04-18T21:05:33.408 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.409 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.409 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:33.409 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646480+0000", 2024-04-18T21:05:33.409 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017128259 2024-04-18T21:05:33.409 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.409 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.409 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:33.409 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646591+0000", 2024-04-18T21:05:33.409 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011113899999999999 2024-04-18T21:05:33.409 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.409 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.409 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:33.409 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646680+0000", 2024-04-18T21:05:33.409 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8902999999999999e-05 2024-04-18T21:05:33.409 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:33.409 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:33.410 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:33.410 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.410 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.410 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:33.410 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:05:33.410 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 27.736795657000002, 2024-04-18T21:05:33.410 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030779760999999999, 2024-04-18T21:05:33.410 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:33.410 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:33.410 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:33.410 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:33.410 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.410 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:33.410 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:05:33.411 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:33.411 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.411 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.411 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:33.411 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:05:33.411 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:33.411 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.411 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.411 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:33.411 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616246+0000", 2024-04-18T21:05:33.411 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0499999999999999e-06 2024-04-18T21:05:33.411 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.411 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.411 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:33.411 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616253+0000", 2024-04-18T21:05:33.412 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.5989999999999998e-06 2024-04-18T21:05:33.412 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.412 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.412 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:33.412 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616273+0000", 2024-04-18T21:05:33.412 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9916999999999999e-05 2024-04-18T21:05:33.412 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.412 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.412 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.412 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616287+0000", 2024-04-18T21:05:33.412 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3669000000000001e-05 2024-04-18T21:05:33.412 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.412 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.412 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:33.412 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622203+0000", 2024-04-18T21:05:33.413 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.005916737 2024-04-18T21:05:33.413 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.413 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.413 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:33.413 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622379+0000", 2024-04-18T21:05:33.413 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000175596 2024-04-18T21:05:33.413 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.413 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.413 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:33.413 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622707+0000", 2024-04-18T21:05:33.413 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00032784600000000002 2024-04-18T21:05:33.413 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.413 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.413 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:33.414 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629366+0000", 2024-04-18T21:05:33.414 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0066593279999999999 2024-04-18T21:05:33.414 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.414 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.414 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:33.414 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646813+0000", 2024-04-18T21:05:33.414 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017447059000000001 2024-04-18T21:05:33.414 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.414 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.414 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:33.414 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646946+0000", 2024-04-18T21:05:33.414 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013301200000000001 2024-04-18T21:05:33.414 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.414 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.415 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:33.415 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647025+0000", 2024-04-18T21:05:33.415 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8948000000000004e-05 2024-04-18T21:05:33.415 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:33.415 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:33.415 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:33.415 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.415 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.415 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:33.415 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:05:33.415 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 27.736711839000002, 2024-04-18T21:05:33.415 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.031512165000000002, 2024-04-18T21:05:33.415 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:33.415 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:33.415 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:33.416 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:33.416 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.416 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:33.416 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:05:33.416 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:33.416 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.416 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.416 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:33.416 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:05:33.416 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:33.416 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.416 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.416 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:33.416 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616330+0000", 2024-04-18T21:05:33.416 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.15e-06 2024-04-18T21:05:33.416 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.417 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.417 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:33.417 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616337+0000", 2024-04-18T21:05:33.417 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.1289999999999998e-06 2024-04-18T21:05:33.417 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.417 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.417 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:33.417 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616447+0000", 2024-04-18T21:05:33.417 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109561 2024-04-18T21:05:33.417 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.417 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.417 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.417 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616496+0000", 2024-04-18T21:05:33.417 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8591999999999998e-05 2024-04-18T21:05:33.417 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.417 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.418 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:33.418 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.623786+0000", 2024-04-18T21:05:33.418 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0072906799999999999 2024-04-18T21:05:33.418 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.418 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.418 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:33.418 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.623973+0000", 2024-04-18T21:05:33.418 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018717199999999999 2024-04-18T21:05:33.418 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.418 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.418 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:33.418 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624260+0000", 2024-04-18T21:05:33.418 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00028630600000000001 2024-04-18T21:05:33.418 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.419 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.419 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:33.419 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629381+0000", 2024-04-18T21:05:33.419 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0051211340000000003 2024-04-18T21:05:33.419 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.419 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.419 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:33.419 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647631+0000", 2024-04-18T21:05:33.419 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018249771000000001 2024-04-18T21:05:33.419 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.419 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.419 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:33.419 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647761+0000", 2024-04-18T21:05:33.419 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013037300000000001 2024-04-18T21:05:33.419 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.420 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.420 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:33.420 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647841+0000", 2024-04-18T21:05:33.420 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.0296999999999994e-05 2024-04-18T21:05:33.420 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:33.420 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:33.420 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:33.420 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.420 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.420 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:33.420 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:05:33.420 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 27.736506355, 2024-04-18T21:05:33.420 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043251955000000002, 2024-04-18T21:05:33.420 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:33.420 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:33.421 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:33.421 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:33.421 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.421 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:33.421 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:05:33.421 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:33.421 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.421 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.421 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:33.421 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:05:33.421 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:33.421 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.421 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.421 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:33.422 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616536+0000", 2024-04-18T21:05:33.422 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2869999999999999e-06 2024-04-18T21:05:33.422 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.422 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.422 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:33.422 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616572+0000", 2024-04-18T21:05:33.422 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.6261999999999999e-05 2024-04-18T21:05:33.422 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.422 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.422 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:33.422 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616593+0000", 2024-04-18T21:05:33.422 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1310000000000001e-05 2024-04-18T21:05:33.422 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.422 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.423 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.423 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616614+0000", 2024-04-18T21:05:33.423 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.0936000000000001e-05 2024-04-18T21:05:33.423 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.423 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.423 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:33.423 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629501+0000", 2024-04-18T21:05:33.423 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.012886819000000001 2024-04-18T21:05:33.423 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.423 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.423 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:33.423 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629696+0000", 2024-04-18T21:05:33.423 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019485499999999999 2024-04-18T21:05:33.424 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.424 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.424 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:33.424 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629940+0000", 2024-04-18T21:05:33.424 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00024386399999999999 2024-04-18T21:05:33.424 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.424 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.424 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:33.424 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640100+0000", 2024-04-18T21:05:33.424 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010159645 2024-04-18T21:05:33.424 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.424 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.424 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:33.424 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659516+0000", 2024-04-18T21:05:33.425 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019416563000000001 2024-04-18T21:05:33.425 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.425 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.425 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:33.425 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659684+0000", 2024-04-18T21:05:33.425 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016750900000000001 2024-04-18T21:05:33.425 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.425 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.425 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:33.425 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659787+0000", 2024-04-18T21:05:33.425 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000102905 2024-04-18T21:05:33.425 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:33.425 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:33.425 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:33.426 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.426 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.426 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:33.426 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:05:33.426 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 27.736401232999999, 2024-04-18T21:05:33.426 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043581898000000001, 2024-04-18T21:05:33.426 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:33.426 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:33.426 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:33.426 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:33.426 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.426 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:33.426 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:05:33.427 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:33.427 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.427 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.427 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:33.427 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:05:33.427 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:33.427 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.427 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.427 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:33.427 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616641+0000", 2024-04-18T21:05:33.427 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:05:33.427 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.427 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.427 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:33.427 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616648+0000", 2024-04-18T21:05:33.428 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3860000000000001e-06 2024-04-18T21:05:33.428 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.428 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.428 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:33.428 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616666+0000", 2024-04-18T21:05:33.428 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7583000000000001e-05 2024-04-18T21:05:33.428 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.428 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.428 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.428 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616679+0000", 2024-04-18T21:05:33.428 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3322999999999999e-05 2024-04-18T21:05:33.428 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.428 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.428 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:33.429 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630373+0000", 2024-04-18T21:05:33.429 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013694207999999999 2024-04-18T21:05:33.429 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.429 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.429 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:33.429 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630545+0000", 2024-04-18T21:05:33.429 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000171683 2024-04-18T21:05:33.429 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.429 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.429 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:33.429 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630728+0000", 2024-04-18T21:05:33.429 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000182599 2024-04-18T21:05:33.429 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.429 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.429 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:33.430 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640600+0000", 2024-04-18T21:05:33.430 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0098726119999999994 2024-04-18T21:05:33.430 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.430 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.430 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:33.430 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659927+0000", 2024-04-18T21:05:33.430 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019326724999999999 2024-04-18T21:05:33.430 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.430 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.430 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:33.430 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660112+0000", 2024-04-18T21:05:33.430 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000185203 2024-04-18T21:05:33.430 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.430 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.431 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:33.431 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660222+0000", 2024-04-18T21:05:33.431 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109343 2024-04-18T21:05:33.431 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:33.431 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:33.431 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:33.431 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.431 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.431 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:33.431 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:05:33.431 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 27.735535875, 2024-04-18T21:05:33.431 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043121310000000003, 2024-04-18T21:05:33.431 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:33.431 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:33.431 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:33.432 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:33.432 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.432 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:33.432 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:05:33.432 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:33.432 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.432 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.432 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:33.432 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:05:33.432 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:33.432 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.432 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.432 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:33.432 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617506+0000", 2024-04-18T21:05:33.432 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9999999999999995e-07 2024-04-18T21:05:33.432 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.433 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.433 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:33.433 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617513+0000", 2024-04-18T21:05:33.433 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.9700000000000002e-06 2024-04-18T21:05:33.433 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.433 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.433 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:33.433 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617531+0000", 2024-04-18T21:05:33.433 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8105999999999999e-05 2024-04-18T21:05:33.433 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.433 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.433 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.433 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617545+0000", 2024-04-18T21:05:33.433 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3703000000000001e-05 2024-04-18T21:05:33.433 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.433 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.434 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:33.434 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632129+0000", 2024-04-18T21:05:33.434 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.014584135999999999 2024-04-18T21:05:33.434 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.434 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.434 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:33.434 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632361+0000", 2024-04-18T21:05:33.434 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023171800000000001 2024-04-18T21:05:33.434 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.434 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.434 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:33.434 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632804+0000", 2024-04-18T21:05:33.434 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000443549 2024-04-18T21:05:33.434 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.434 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.435 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:33.435 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646340+0000", 2024-04-18T21:05:33.435 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013535902000000001 2024-04-18T21:05:33.435 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.435 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.435 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:33.435 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660363+0000", 2024-04-18T21:05:33.435 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01402318 2024-04-18T21:05:33.435 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.435 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.435 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:33.435 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660523+0000", 2024-04-18T21:05:33.435 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00015989899999999999 2024-04-18T21:05:33.435 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.435 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.436 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:33.436 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660626+0000", 2024-04-18T21:05:33.436 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010314699999999999 2024-04-18T21:05:33.436 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:33.436 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:33.436 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:33.436 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.436 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.436 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:33.436 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:05:33.436 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 27.735396181999999, 2024-04-18T21:05:33.436 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024927483, 2024-04-18T21:05:33.436 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:33.436 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:33.437 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:33.437 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:33.437 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.437 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:33.437 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:05:33.437 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:33.437 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.437 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.437 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:33.437 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:05:33.437 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:33.437 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.438 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.438 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:33.438 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617646+0000", 2024-04-18T21:05:33.438 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3030000000000001e-06 2024-04-18T21:05:33.438 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.438 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.438 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:33.438 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617653+0000", 2024-04-18T21:05:33.438 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7530000000000004e-06 2024-04-18T21:05:33.438 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.438 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.438 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:33.438 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617673+0000", 2024-04-18T21:05:33.439 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9967e-05 2024-04-18T21:05:33.439 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.439 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.439 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.439 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617688+0000", 2024-04-18T21:05:33.439 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5153e-05 2024-04-18T21:05:33.439 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.439 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.439 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:33.439 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619244+0000", 2024-04-18T21:05:33.439 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001555531 2024-04-18T21:05:33.439 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.439 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.439 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:33.439 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619361+0000", 2024-04-18T21:05:33.440 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011784400000000001 2024-04-18T21:05:33.440 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.440 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.440 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:33.440 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619604+0000", 2024-04-18T21:05:33.440 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000243007 2024-04-18T21:05:33.440 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.440 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.440 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:33.440 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.625480+0000", 2024-04-18T21:05:33.440 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0058759349999999997 2024-04-18T21:05:33.440 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.440 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.440 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:33.440 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642342+0000", 2024-04-18T21:05:33.441 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016861373999999998 2024-04-18T21:05:33.441 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.441 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.441 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:33.441 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642484+0000", 2024-04-18T21:05:33.441 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000142423 2024-04-18T21:05:33.441 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.441 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.441 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:33.441 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642572+0000", 2024-04-18T21:05:33.441 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8193000000000001e-05 2024-04-18T21:05:33.441 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:33.441 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:33.441 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:33.441 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.442 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.442 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:33.442 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:05:33.442 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 27.735114678999999, 2024-04-18T21:05:33.442 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024956974999999999, 2024-04-18T21:05:33.442 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:33.442 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:33.442 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:33.442 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:33.442 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.442 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:33.442 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:05:33.442 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:33.442 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.443 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.443 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:33.443 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:05:33.443 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:33.443 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.443 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.443 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:33.443 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617928+0000", 2024-04-18T21:05:33.443 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5430000000000001e-06 2024-04-18T21:05:33.443 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.443 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.443 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:33.443 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617937+0000", 2024-04-18T21:05:33.443 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6629999999999999e-06 2024-04-18T21:05:33.444 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.444 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.444 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:33.444 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617955+0000", 2024-04-18T21:05:33.444 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8749999999999998e-05 2024-04-18T21:05:33.444 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.444 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.444 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.444 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617971+0000", 2024-04-18T21:05:33.444 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.605e-05 2024-04-18T21:05:33.444 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.444 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.444 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:33.444 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621019+0000", 2024-04-18T21:05:33.444 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0030472369999999999 2024-04-18T21:05:33.444 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.445 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.445 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:33.445 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621249+0000", 2024-04-18T21:05:33.445 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000230075 2024-04-18T21:05:33.445 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.445 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.445 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:33.445 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621450+0000", 2024-04-18T21:05:33.445 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020166499999999999 2024-04-18T21:05:33.445 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.445 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.445 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:33.445 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.626233+0000", 2024-04-18T21:05:33.445 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047827390000000003 2024-04-18T21:05:33.446 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.446 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.446 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:33.446 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642693+0000", 2024-04-18T21:05:33.446 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01645961 2024-04-18T21:05:33.446 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.446 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.446 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:33.446 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642798+0000", 2024-04-18T21:05:33.446 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010559499999999999 2024-04-18T21:05:33.446 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.446 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.446 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:33.447 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642883+0000", 2024-04-18T21:05:33.447 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5048000000000003e-05 2024-04-18T21:05:33.447 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:33.447 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:33.447 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:33.447 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.447 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.447 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:33.447 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:05:33.447 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 27.733419050999998, 2024-04-18T21:05:33.447 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024086478000000001, 2024-04-18T21:05:33.447 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:33.447 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:33.448 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:33.448 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:33.448 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.448 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:33.448 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:05:33.448 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:33.448 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.448 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.448 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:33.448 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:05:33.448 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:33.448 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.448 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.448 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:33.449 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619624+0000", 2024-04-18T21:05:33.449 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.75e-06 2024-04-18T21:05:33.449 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.449 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.449 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:33.449 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619637+0000", 2024-04-18T21:05:33.449 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3540000000000001e-05 2024-04-18T21:05:33.449 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.449 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.449 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:33.449 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619666+0000", 2024-04-18T21:05:33.449 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8685999999999999e-05 2024-04-18T21:05:33.449 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.449 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.450 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.450 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619685+0000", 2024-04-18T21:05:33.450 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8681999999999998e-05 2024-04-18T21:05:33.450 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.450 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.450 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:33.450 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622275+0000", 2024-04-18T21:05:33.450 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0025899260000000002 2024-04-18T21:05:33.450 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.450 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.450 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:33.450 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622572+0000", 2024-04-18T21:05:33.450 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00029722 2024-04-18T21:05:33.450 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.450 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.450 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:33.451 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622752+0000", 2024-04-18T21:05:33.451 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018065900000000001 2024-04-18T21:05:33.451 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.451 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.451 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:33.451 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.626326+0000", 2024-04-18T21:05:33.451 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035737310000000001 2024-04-18T21:05:33.451 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.451 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.451 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:33.451 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643565+0000", 2024-04-18T21:05:33.451 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017238430999999999 2024-04-18T21:05:33.451 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.451 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.451 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:33.451 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643646+0000", 2024-04-18T21:05:33.452 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.1481000000000001e-05 2024-04-18T21:05:33.452 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.452 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.452 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:33.452 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643708+0000", 2024-04-18T21:05:33.452 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.2372000000000005e-05 2024-04-18T21:05:33.452 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:33.452 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:33.452 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:33.452 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.452 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.452 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:33.452 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:05:33.452 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 27.733252898, 2024-04-18T21:05:33.452 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026822450000000001, 2024-04-18T21:05:33.452 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:33.452 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:33.453 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:33.453 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:33.453 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.453 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:33.453 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:05:33.453 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:33.453 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.453 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.453 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:33.453 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:05:33.453 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:33.453 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.453 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.453 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:33.453 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619789+0000", 2024-04-18T21:05:33.453 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:05:33.453 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.454 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.454 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:33.454 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619797+0000", 2024-04-18T21:05:33.454 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.6899999999999992e-06 2024-04-18T21:05:33.454 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.454 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.454 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:33.454 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619816+0000", 2024-04-18T21:05:33.454 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9352999999999999e-05 2024-04-18T21:05:33.454 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.454 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.454 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.454 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619832+0000", 2024-04-18T21:05:33.454 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6013000000000001e-05 2024-04-18T21:05:33.454 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.454 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.455 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:33.455 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620528+0000", 2024-04-18T21:05:33.455 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00069565600000000001 2024-04-18T21:05:33.455 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.455 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.455 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:33.455 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620735+0000", 2024-04-18T21:05:33.455 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000207025 2024-04-18T21:05:33.455 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.455 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.455 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:33.455 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620912+0000", 2024-04-18T21:05:33.455 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017748199999999999 2024-04-18T21:05:33.455 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.456 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.456 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:33.456 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.625605+0000", 2024-04-18T21:05:33.456 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0046924439999999996 2024-04-18T21:05:33.456 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.456 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.456 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:33.456 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646349+0000", 2024-04-18T21:05:33.456 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.020744318000000001 2024-04-18T21:05:33.456 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.456 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.456 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:33.456 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646483+0000", 2024-04-18T21:05:33.456 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013428999999999999 2024-04-18T21:05:33.456 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.457 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.457 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:33.457 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646611+0000", 2024-04-18T21:05:33.457 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012710299999999999 2024-04-18T21:05:33.457 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:33.457 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:33.457 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:33.457 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.457 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.457 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:33.457 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:05:33.457 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 27.732582465, 2024-04-18T21:05:33.457 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023516516000000001, 2024-04-18T21:05:33.457 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:33.457 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:33.457 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:05:33.458 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:33.458 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.458 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:33.458 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:05:33.458 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:33.458 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.458 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.458 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:33.458 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:05:33.458 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:33.458 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.458 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.458 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:33.458 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620460+0000", 2024-04-18T21:05:33.458 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.787e-06 2024-04-18T21:05:33.458 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.459 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.459 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:33.459 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620470+0000", 2024-04-18T21:05:33.459 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.2560000000000008e-06 2024-04-18T21:05:33.459 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.459 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.459 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:33.459 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620496+0000", 2024-04-18T21:05:33.459 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.6205999999999999e-05 2024-04-18T21:05:33.459 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.459 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.459 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.459 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620517+0000", 2024-04-18T21:05:33.459 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1223e-05 2024-04-18T21:05:33.460 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.460 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.460 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:33.460 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624060+0000", 2024-04-18T21:05:33.460 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035434160000000002 2024-04-18T21:05:33.460 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.460 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.460 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:33.460 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624390+0000", 2024-04-18T21:05:33.460 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00033000500000000002 2024-04-18T21:05:33.460 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:33.460 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:33.460 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:33.460 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643975+0000", 2024-04-18T21:05:33.460 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019584622999999999 2024-04-18T21:05:33.460 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:33.461 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:33.461 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:33.461 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:33.461 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:33.461 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:05:33.462 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:05:33.463 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:33.463+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:33.562 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:33.563+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:33.593 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:05:33.593 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [], 2024-04-18T21:05:33.593 INFO:teuthology.orchestra.run.smithi150.stdout: "num_ops": 0 2024-04-18T21:05:33.593 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:05:33.607 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:05:33.664 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:33.663+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:33.730 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:05:33.730 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [], 2024-04-18T21:05:33.730 INFO:teuthology.orchestra.run.smithi150.stdout: "complaint_time": 30, 2024-04-18T21:05:33.730 INFO:teuthology.orchestra.run.smithi150.stdout: "num_blocked_ops": 0 2024-04-18T21:05:33.730 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:05:33.744 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:05:33.789 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:33.791+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:33.830 INFO:teuthology.orchestra.run.smithi078.stderr:noscrub is set 2024-04-18T21:05:33.865 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:33.867+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:33.872 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:05:33.872 INFO:teuthology.orchestra.run.smithi150.stdout: "size": 20, 2024-04-18T21:05:33.872 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 600, 2024-04-18T21:05:33.872 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [ 2024-04-18T21:05:33.872 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.872 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-18T21:05:33.872 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:05:33.873 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 39.067482247999997, 2024-04-18T21:05:33.873 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0093051590000000003, 2024-04-18T21:05:33.873 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:33.873 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:33.873 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:33.873 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:33.873 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.873 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:33.873 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:05:33.873 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:33.873 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.873 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.873 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:33.873 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:05:33.873 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:33.874 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.874 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.874 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:33.874 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804851+0000", 2024-04-18T21:05:33.874 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7039999999999999e-06 2024-04-18T21:05:33.874 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.874 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.874 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:33.874 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804864+0000", 2024-04-18T21:05:33.874 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.276e-05 2024-04-18T21:05:33.874 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.874 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.874 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:33.875 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804895+0000", 2024-04-18T21:05:33.875 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.1204999999999997e-05 2024-04-18T21:05:33.875 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.875 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.875 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.875 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804908+0000", 2024-04-18T21:05:33.875 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3317e-05 2024-04-18T21:05:33.875 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.875 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.875 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:33.875 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805131+0000", 2024-04-18T21:05:33.875 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00022246700000000001 2024-04-18T21:05:33.875 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.875 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.876 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:33.876 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805171+0000", 2024-04-18T21:05:33.876 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.0164999999999999e-05 2024-04-18T21:05:33.876 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.876 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.876 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:33.876 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814086+0000", 2024-04-18T21:05:33.876 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0089155329999999998 2024-04-18T21:05:33.876 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.876 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.876 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:33.876 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814154+0000", 2024-04-18T21:05:33.876 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.8008000000000003e-05 2024-04-18T21:05:33.876 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:33.876 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:33.877 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:33.877 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.877 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.877 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-18T21:05:33.877 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:05:33.877 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 39.066717054999998, 2024-04-18T21:05:33.877 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0086469770000000001, 2024-04-18T21:05:33.877 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:33.877 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:33.877 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:33.877 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:33.877 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.877 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:33.877 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:05:33.878 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:33.878 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.878 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.878 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:33.878 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:05:33.878 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:33.878 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.878 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.878 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:33.878 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805616+0000", 2024-04-18T21:05:33.878 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7799999999999999e-06 2024-04-18T21:05:33.878 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.878 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.878 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:33.879 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805707+0000", 2024-04-18T21:05:33.879 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0917999999999999e-05 2024-04-18T21:05:33.879 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.879 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.879 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:33.879 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805739+0000", 2024-04-18T21:05:33.879 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.2512000000000003e-05 2024-04-18T21:05:33.879 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.879 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.879 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.879 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805763+0000", 2024-04-18T21:05:33.879 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3266000000000001e-05 2024-04-18T21:05:33.879 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.879 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.880 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:33.880 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.806024+0000", 2024-04-18T21:05:33.880 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000261716 2024-04-18T21:05:33.880 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.880 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.880 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:33.880 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.806073+0000", 2024-04-18T21:05:33.880 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.8844999999999997e-05 2024-04-18T21:05:33.880 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.880 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.880 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:33.880 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814162+0000", 2024-04-18T21:05:33.880 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0080882860000000001 2024-04-18T21:05:33.880 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.880 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.881 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:33.881 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814261+0000", 2024-04-18T21:05:33.881 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.9654000000000005e-05 2024-04-18T21:05:33.881 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:33.881 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:33.881 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:33.881 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.881 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.881 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'64)", 2024-04-18T21:05:33.881 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:05:33.881 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 39.064946011000004, 2024-04-18T21:05:33.881 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0089721509999999994, 2024-04-18T21:05:33.881 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:33.881 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:33.882 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:33.882 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:33.882 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.882 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:33.882 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:05:33.882 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:33.882 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.882 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.882 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:33.882 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:05:33.882 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:33.882 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.882 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.882 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:33.883 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807387+0000", 2024-04-18T21:05:33.883 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.0329999999999998e-06 2024-04-18T21:05:33.883 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.883 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.883 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:33.883 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807443+0000", 2024-04-18T21:05:33.883 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.5376e-05 2024-04-18T21:05:33.883 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.883 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.883 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:33.883 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807467+0000", 2024-04-18T21:05:33.883 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.4621999999999999e-05 2024-04-18T21:05:33.883 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.883 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.884 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.884 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807482+0000", 2024-04-18T21:05:33.884 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.436e-05 2024-04-18T21:05:33.884 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.884 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.884 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:33.884 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.809243+0000", 2024-04-18T21:05:33.884 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001761725 2024-04-18T21:05:33.884 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.884 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.884 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:33.884 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.809295+0000", 2024-04-18T21:05:33.884 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.1445e-05 2024-04-18T21:05:33.884 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.884 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.885 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:33.885 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.816293+0000", 2024-04-18T21:05:33.885 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0069981749999999997 2024-04-18T21:05:33.885 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.885 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.885 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:33.885 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.816357+0000", 2024-04-18T21:05:33.885 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.4414999999999999e-05 2024-04-18T21:05:33.885 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:33.885 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:33.885 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:33.885 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.885 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.885 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:33.885 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:05:33.886 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 28.257036640999999, 2024-04-18T21:05:33.886 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.040843365, 2024-04-18T21:05:33.886 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:33.886 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:33.886 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:33.886 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:33.886 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.886 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:33.886 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:05:33.886 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:33.886 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.886 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.886 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:33.887 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:05:33.887 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:33.887 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.887 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.887 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:33.887 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615297+0000", 2024-04-18T21:05:33.887 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2800000000000002e-06 2024-04-18T21:05:33.887 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.887 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.887 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:33.887 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615308+0000", 2024-04-18T21:05:33.887 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0813e-05 2024-04-18T21:05:33.887 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.887 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.888 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:33.888 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615330+0000", 2024-04-18T21:05:33.888 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2370000000000001e-05 2024-04-18T21:05:33.888 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.888 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.888 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.888 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615346+0000", 2024-04-18T21:05:33.888 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6200000000000001e-05 2024-04-18T21:05:33.888 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.888 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.888 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:33.888 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615470+0000", 2024-04-18T21:05:33.888 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012385799999999999 2024-04-18T21:05:33.888 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.889 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.889 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:05:33.889 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615488+0000", 2024-04-18T21:05:33.889 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7923000000000001e-05 2024-04-18T21:05:33.889 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.889 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.889 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:33.889 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.630993+0000", 2024-04-18T21:05:33.889 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.01550532 2024-04-18T21:05:33.889 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.889 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.889 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:33.889 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631165+0000", 2024-04-18T21:05:33.889 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000171588 2024-04-18T21:05:33.890 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.890 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.890 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:33.890 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631320+0000", 2024-04-18T21:05:33.890 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000155162 2024-04-18T21:05:33.890 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.890 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.890 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:33.890 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635157+0000", 2024-04-18T21:05:33.890 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0038370790000000002 2024-04-18T21:05:33.890 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.890 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.890 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:33.891 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.655904+0000", 2024-04-18T21:05:33.891 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.020746483999999999 2024-04-18T21:05:33.891 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.891 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.891 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:33.891 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656032+0000", 2024-04-18T21:05:33.891 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012864199999999999 2024-04-18T21:05:33.891 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.891 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.891 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:33.891 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656138+0000", 2024-04-18T21:05:33.891 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000105646 2024-04-18T21:05:33.891 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:33.891 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:33.892 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:33.892 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.892 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.892 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:33.892 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:05:33.892 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 28.256944469, 2024-04-18T21:05:33.892 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.041266444999999999, 2024-04-18T21:05:33.892 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:33.892 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:33.892 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:33.892 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:33.892 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.892 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:33.892 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:05:33.892 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:33.893 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.893 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.893 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:33.893 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:05:33.893 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:33.893 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.893 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.893 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:33.893 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615388+0000", 2024-04-18T21:05:33.893 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:05:33.893 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.893 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.893 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:33.893 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:05:33.893 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.7299999999999994e-06 2024-04-18T21:05:33.894 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.894 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.894 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:33.894 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615415+0000", 2024-04-18T21:05:33.894 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7807000000000001e-05 2024-04-18T21:05:33.894 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.894 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.894 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.894 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615431+0000", 2024-04-18T21:05:33.894 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6127e-05 2024-04-18T21:05:33.894 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.894 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.894 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:33.895 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615621+0000", 2024-04-18T21:05:33.895 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000189781 2024-04-18T21:05:33.895 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.895 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.895 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:33.895 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615634+0000", 2024-04-18T21:05:33.895 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3383e-05 2024-04-18T21:05:33.895 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.895 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.895 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:33.895 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631703+0000", 2024-04-18T21:05:33.895 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016068737 2024-04-18T21:05:33.895 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.895 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.895 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:33.896 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631809+0000", 2024-04-18T21:05:33.896 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000106823 2024-04-18T21:05:33.896 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.896 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.896 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:33.896 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631988+0000", 2024-04-18T21:05:33.896 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000179008 2024-04-18T21:05:33.896 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.896 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.896 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:33.896 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635172+0000", 2024-04-18T21:05:33.896 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.003183029 2024-04-18T21:05:33.896 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.896 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.896 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:33.897 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656392+0000", 2024-04-18T21:05:33.897 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.021220638999999999 2024-04-18T21:05:33.897 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.897 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.897 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:33.897 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656533+0000", 2024-04-18T21:05:33.897 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014126500000000001 2024-04-18T21:05:33.897 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.897 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.897 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:33.897 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656653+0000", 2024-04-18T21:05:33.897 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000119883 2024-04-18T21:05:33.897 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:33.897 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:33.897 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:33.897 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.898 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.898 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:33.898 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:05:33.898 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 28.256857046, 2024-04-18T21:05:33.898 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.042492302000000003, 2024-04-18T21:05:33.898 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:33.898 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:33.898 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:33.898 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:33.898 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.898 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:33.898 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:05:33.898 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:33.899 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.899 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.899 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:33.899 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:05:33.899 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:33.899 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.899 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.899 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:33.899 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615475+0000", 2024-04-18T21:05:33.899 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.17e-06 2024-04-18T21:05:33.899 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.899 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.899 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:33.899 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615528+0000", 2024-04-18T21:05:33.900 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.2159e-05 2024-04-18T21:05:33.900 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.900 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.900 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:33.900 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615542+0000", 2024-04-18T21:05:33.900 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4197e-05 2024-04-18T21:05:33.900 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.900 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.900 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.900 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615559+0000", 2024-04-18T21:05:33.900 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.749e-05 2024-04-18T21:05:33.900 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.900 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.900 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:33.900 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615685+0000", 2024-04-18T21:05:33.901 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012617499999999999 2024-04-18T21:05:33.901 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.901 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.901 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:05:33.901 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:05:33.901 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4749999999999999e-05 2024-04-18T21:05:33.901 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.901 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.901 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:33.901 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632332+0000", 2024-04-18T21:05:33.901 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016631988 2024-04-18T21:05:33.901 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.901 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.901 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:33.902 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632477+0000", 2024-04-18T21:05:33.902 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014437200000000001 2024-04-18T21:05:33.902 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.902 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.902 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:33.902 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632620+0000", 2024-04-18T21:05:33.902 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000143566 2024-04-18T21:05:33.902 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.902 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.902 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:33.902 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635185+0000", 2024-04-18T21:05:33.902 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0025644209999999999 2024-04-18T21:05:33.902 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.903 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.903 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:33.903 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657803+0000", 2024-04-18T21:05:33.903 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.022618743 2024-04-18T21:05:33.903 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.903 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.903 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:33.903 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657890+0000", 2024-04-18T21:05:33.903 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.6688999999999996e-05 2024-04-18T21:05:33.903 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.903 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.903 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:33.903 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657967+0000", 2024-04-18T21:05:33.903 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.6582000000000006e-05 2024-04-18T21:05:33.904 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:33.904 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:33.904 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:33.904 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.904 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.904 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:33.904 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:05:33.904 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 28.256726233999998, 2024-04-18T21:05:33.904 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.043603435000000003, 2024-04-18T21:05:33.904 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:33.904 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:33.904 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:33.904 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:33.904 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.905 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:33.905 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:05:33.905 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:33.905 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.905 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.905 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:33.905 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:05:33.905 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:33.905 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.905 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.905 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:33.905 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615607+0000", 2024-04-18T21:05:33.905 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4300000000000001e-06 2024-04-18T21:05:33.905 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.905 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.906 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:33.906 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615614+0000", 2024-04-18T21:05:33.906 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.4100000000000002e-06 2024-04-18T21:05:33.906 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.906 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.906 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:33.906 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615632+0000", 2024-04-18T21:05:33.906 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7863000000000002e-05 2024-04-18T21:05:33.906 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.906 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.906 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.906 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615647+0000", 2024-04-18T21:05:33.906 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5187e-05 2024-04-18T21:05:33.907 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.907 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.907 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:33.907 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615765+0000", 2024-04-18T21:05:33.907 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000117955 2024-04-18T21:05:33.907 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.907 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.907 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:33.907 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615781+0000", 2024-04-18T21:05:33.907 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6123000000000001e-05 2024-04-18T21:05:33.907 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.907 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.907 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:33.907 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633055+0000", 2024-04-18T21:05:33.907 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.017273909 2024-04-18T21:05:33.908 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.908 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.908 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:33.908 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633254+0000", 2024-04-18T21:05:33.908 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00019903799999999999 2024-04-18T21:05:33.908 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.908 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.908 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:33.908 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633624+0000", 2024-04-18T21:05:33.908 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000369656 2024-04-18T21:05:33.908 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.908 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.908 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:33.908 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635595+0000", 2024-04-18T21:05:33.908 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001971287 2024-04-18T21:05:33.908 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.909 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.909 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:33.909 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659026+0000", 2024-04-18T21:05:33.909 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.023431495 2024-04-18T21:05:33.909 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.909 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.909 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:33.909 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659117+0000", 2024-04-18T21:05:33.909 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0885999999999997e-05 2024-04-18T21:05:33.909 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.909 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.909 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:33.909 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659209+0000", 2024-04-18T21:05:33.909 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.1195999999999999e-05 2024-04-18T21:05:33.909 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:33.910 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:33.910 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:33.910 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.910 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.910 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:33.910 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:33.910 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 28.256661005000002, 2024-04-18T21:05:33.910 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.03492514, 2024-04-18T21:05:33.910 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:33.910 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:33.910 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:33.910 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:33.910 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.910 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:33.911 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:33.911 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:33.911 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.911 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.911 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:33.911 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:33.911 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:33.911 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.911 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.911 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:33.911 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:05:33.911 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.407e-06 2024-04-18T21:05:33.911 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.911 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.911 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:33.912 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615679+0000", 2024-04-18T21:05:33.912 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.2130000000000002e-06 2024-04-18T21:05:33.912 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.912 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.912 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:33.912 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615701+0000", 2024-04-18T21:05:33.912 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2316000000000001e-05 2024-04-18T21:05:33.912 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.912 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.912 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.912 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615717+0000", 2024-04-18T21:05:33.912 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6197000000000001e-05 2024-04-18T21:05:33.912 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.913 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.913 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:33.913 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615828+0000", 2024-04-18T21:05:33.913 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000110899 2024-04-18T21:05:33.913 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.913 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.913 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:05:33.913 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615840+0000", 2024-04-18T21:05:33.913 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.1423000000000001e-05 2024-04-18T21:05:33.913 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.913 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.913 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:33.913 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628046+0000", 2024-04-18T21:05:33.913 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.012206295000000001 2024-04-18T21:05:33.914 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.914 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.914 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:33.914 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628323+0000", 2024-04-18T21:05:33.914 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00027658700000000001 2024-04-18T21:05:33.914 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.914 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.914 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:33.914 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628599+0000", 2024-04-18T21:05:33.914 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00027676699999999997 2024-04-18T21:05:33.914 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.914 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.915 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:33.915 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634869+0000", 2024-04-18T21:05:33.915 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.006269536 2024-04-18T21:05:33.915 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.915 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.915 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:33.915 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650333+0000", 2024-04-18T21:05:33.915 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.015463645999999999 2024-04-18T21:05:33.915 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.915 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.915 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:33.915 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650474+0000", 2024-04-18T21:05:33.915 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014091799999999999 2024-04-18T21:05:33.915 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.915 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.916 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:33.916 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650595+0000", 2024-04-18T21:05:33.916 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012193600000000001 2024-04-18T21:05:33.916 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:33.916 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:33.916 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:33.916 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.916 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.916 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:33.916 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:05:33.916 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 28.256575896000001, 2024-04-18T21:05:33.916 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.040588320999999997, 2024-04-18T21:05:33.916 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:33.916 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:33.917 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:33.917 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:33.917 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.917 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:33.917 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:05:33.917 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:33.917 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.917 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.917 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:33.917 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:05:33.917 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:33.917 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.917 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.918 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:33.918 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615757+0000", 2024-04-18T21:05:33.918 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2270000000000001e-06 2024-04-18T21:05:33.918 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.918 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.918 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:33.918 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615765+0000", 2024-04-18T21:05:33.918 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.9400000000000002e-06 2024-04-18T21:05:33.918 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.918 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.918 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:33.918 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615785+0000", 2024-04-18T21:05:33.918 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.0749000000000001e-05 2024-04-18T21:05:33.918 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.919 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.919 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.919 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615804+0000", 2024-04-18T21:05:33.919 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.8774e-05 2024-04-18T21:05:33.919 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.919 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.919 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:33.919 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615888+0000", 2024-04-18T21:05:33.919 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.4111999999999997e-05 2024-04-18T21:05:33.919 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.919 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.919 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:33.919 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615895+0000", 2024-04-18T21:05:33.920 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.0469999999999996e-06 2024-04-18T21:05:33.920 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.920 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.920 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:33.920 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629280+0000", 2024-04-18T21:05:33.920 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.013384416 2024-04-18T21:05:33.920 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.920 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.920 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:33.920 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629488+0000", 2024-04-18T21:05:33.920 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00020852800000000001 2024-04-18T21:05:33.920 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.920 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.920 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:33.920 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629869+0000", 2024-04-18T21:05:33.921 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00038042300000000001 2024-04-18T21:05:33.921 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.921 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.921 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:33.921 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635041+0000", 2024-04-18T21:05:33.921 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.005172383 2024-04-18T21:05:33.921 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.921 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.921 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:33.921 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656125+0000", 2024-04-18T21:05:33.921 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.021084025999999999 2024-04-18T21:05:33.921 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.921 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.921 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:33.922 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656240+0000", 2024-04-18T21:05:33.922 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000115352 2024-04-18T21:05:33.922 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.922 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.922 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:33.922 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656344+0000", 2024-04-18T21:05:33.922 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00010334400000000001 2024-04-18T21:05:33.922 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:33.922 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:33.922 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:33.922 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.922 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.922 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:33.923 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:05:33.923 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 28.256508576000002, 2024-04-18T21:05:33.923 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.043549577999999999, 2024-04-18T21:05:33.923 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:33.923 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:33.923 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:33.923 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:33.923 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.923 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:33.923 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:05:33.923 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:33.923 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.923 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.923 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:33.924 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:05:33.924 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:33.924 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.924 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.924 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:33.924 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:05:33.924 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.5000000000000002e-07 2024-04-18T21:05:33.924 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.924 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.924 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:33.924 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615828+0000", 2024-04-18T21:05:33.924 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.2359999999999998e-06 2024-04-18T21:05:33.924 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.924 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.924 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:33.925 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615838+0000", 2024-04-18T21:05:33.925 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0087e-05 2024-04-18T21:05:33.925 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.925 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.925 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.925 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615846+0000", 2024-04-18T21:05:33.925 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.67e-06 2024-04-18T21:05:33.925 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.925 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.925 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:33.925 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615963+0000", 2024-04-18T21:05:33.925 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00011630500000000001 2024-04-18T21:05:33.925 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.925 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.925 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:33.926 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615979+0000", 2024-04-18T21:05:33.926 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.613e-05 2024-04-18T21:05:33.926 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.926 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.926 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:33.926 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632392+0000", 2024-04-18T21:05:33.926 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016413317 2024-04-18T21:05:33.926 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.926 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.926 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:33.926 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632568+0000", 2024-04-18T21:05:33.926 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00017539500000000001 2024-04-18T21:05:33.927 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.927 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.927 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:33.927 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632748+0000", 2024-04-18T21:05:33.927 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00017991799999999999 2024-04-18T21:05:33.927 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.927 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.927 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:33.927 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635542+0000", 2024-04-18T21:05:33.927 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00279481 2024-04-18T21:05:33.927 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.927 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.927 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:33.928 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659232+0000", 2024-04-18T21:05:33.928 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.023689212000000001 2024-04-18T21:05:33.928 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.928 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.928 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:33.928 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659314+0000", 2024-04-18T21:05:33.928 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.2528999999999995e-05 2024-04-18T21:05:33.928 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.928 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.928 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:33.928 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659372+0000", 2024-04-18T21:05:33.928 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.8218999999999999e-05 2024-04-18T21:05:33.928 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:33.929 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:33.929 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:33.929 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.929 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.929 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:33.929 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:05:33.929 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 28.256447143999999, 2024-04-18T21:05:33.929 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.039335347, 2024-04-18T21:05:33.929 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:33.929 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:33.929 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "started", 2024-04-18T21:05:33.929 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:33.929 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.929 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:33.929 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:05:33.930 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:33.930 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.930 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.930 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:33.930 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:05:33.930 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:33.930 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.930 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.930 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:33.930 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615885+0000", 2024-04-18T21:05:33.930 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2699999999999999e-06 2024-04-18T21:05:33.930 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.930 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.931 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:33.931 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615892+0000", 2024-04-18T21:05:33.931 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.6499999999999999e-06 2024-04-18T21:05:33.931 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.931 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.931 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:33.931 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615906+0000", 2024-04-18T21:05:33.931 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.393e-05 2024-04-18T21:05:33.931 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.931 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.931 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.931 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615919+0000", 2024-04-18T21:05:33.931 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2860000000000001e-05 2024-04-18T21:05:33.932 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.932 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.932 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:33.932 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616027+0000", 2024-04-18T21:05:33.932 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000107852 2024-04-18T21:05:33.932 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.932 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.932 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:05:33.932 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616037+0000", 2024-04-18T21:05:33.932 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:05:33.932 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.932 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.932 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:33.933 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622719+0000", 2024-04-18T21:05:33.933 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0066817220000000002 2024-04-18T21:05:33.933 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.933 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.933 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:33.933 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623006+0000", 2024-04-18T21:05:33.933 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00028783699999999999 2024-04-18T21:05:33.933 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.933 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.933 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:33.933 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.655220+0000", 2024-04-18T21:05:33.933 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.032213036 2024-04-18T21:05:33.933 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:33.934 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:33.934 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:33.934 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.934 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.934 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:33.934 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:33.934 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 28.256391471000001, 2024-04-18T21:05:33.934 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.032845253999999997, 2024-04-18T21:05:33.934 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:33.934 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:33.934 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "started", 2024-04-18T21:05:33.934 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:33.934 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.935 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:33.935 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:33.935 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:33.935 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.935 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.935 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:33.935 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:33.935 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:33.935 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.935 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.935 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:33.935 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615942+0000", 2024-04-18T21:05:33.935 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.717e-06 2024-04-18T21:05:33.935 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.936 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.936 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:33.936 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615946+0000", 2024-04-18T21:05:33.936 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.6e-06 2024-04-18T21:05:33.936 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.936 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.936 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:33.936 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615960+0000", 2024-04-18T21:05:33.936 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:05:33.936 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.936 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.936 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.936 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615968+0000", 2024-04-18T21:05:33.936 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.9070000000000007e-06 2024-04-18T21:05:33.937 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.937 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.937 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:33.937 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616100+0000", 2024-04-18T21:05:33.937 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000132402 2024-04-18T21:05:33.937 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.937 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.937 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:05:33.937 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616117+0000", 2024-04-18T21:05:33.937 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6653000000000001e-05 2024-04-18T21:05:33.937 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.937 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.937 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:33.937 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621566+0000", 2024-04-18T21:05:33.937 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0054497740000000001 2024-04-18T21:05:33.938 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.938 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.938 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:33.938 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622801+0000", 2024-04-18T21:05:33.938 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0012345710000000001 2024-04-18T21:05:33.938 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.938 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.938 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:33.938 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648785+0000", 2024-04-18T21:05:33.938 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.025984104000000001 2024-04-18T21:05:33.938 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:33.938 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:33.938 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:33.939 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.939 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.939 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:33.939 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:05:33.939 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 28.250540121, 2024-04-18T21:05:33.939 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.011561350999999999, 2024-04-18T21:05:33.939 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:33.939 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:33.939 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:33.939 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:33.939 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.939 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:33.939 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:05:33.939 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:33.939 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.940 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.940 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:33.940 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:05:33.940 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:33.940 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.940 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.940 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:33.940 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621792+0000", 2024-04-18T21:05:33.940 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.4000000000000001e-07 2024-04-18T21:05:33.940 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.940 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.940 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:33.940 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:05:33.940 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.1050000000000002e-05 2024-04-18T21:05:33.940 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.941 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.941 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:33.941 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622608+0000", 2024-04-18T21:05:33.941 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00077505900000000003 2024-04-18T21:05:33.941 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.941 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.941 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.941 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623879+0000", 2024-04-18T21:05:33.941 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0012705839999999999 2024-04-18T21:05:33.941 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.941 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.941 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:33.941 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624010+0000", 2024-04-18T21:05:33.941 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00013176900000000001 2024-04-18T21:05:33.942 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.942 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.942 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:33.942 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624058+0000", 2024-04-18T21:05:33.942 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.7299000000000002e-05 2024-04-18T21:05:33.942 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.942 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.942 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:33.942 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633262+0000", 2024-04-18T21:05:33.942 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0092048770000000002 2024-04-18T21:05:33.942 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.942 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.942 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:33.943 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633353+0000", 2024-04-18T21:05:33.943 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0073000000000003e-05 2024-04-18T21:05:33.943 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:33.943 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:33.943 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:33.943 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.943 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.943 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:33.943 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:05:33.943 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 28.248412734999999, 2024-04-18T21:05:33.943 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0098419370000000003, 2024-04-18T21:05:33.943 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:33.943 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:33.943 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:33.944 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:33.944 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.944 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:33.944 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:05:33.944 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:33.944 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.944 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.944 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:33.944 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:05:33.944 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:33.944 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.944 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.944 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:33.944 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623920+0000", 2024-04-18T21:05:33.944 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2240000000000001e-06 2024-04-18T21:05:33.945 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.945 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.945 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:33.945 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623933+0000", 2024-04-18T21:05:33.945 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3653e-05 2024-04-18T21:05:33.945 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.945 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.945 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:33.945 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623956+0000", 2024-04-18T21:05:33.945 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2059e-05 2024-04-18T21:05:33.945 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.945 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.945 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.945 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623975+0000", 2024-04-18T21:05:33.946 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.9806999999999999e-05 2024-04-18T21:05:33.946 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.946 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.946 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:33.946 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626943+0000", 2024-04-18T21:05:33.946 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0029681579999999998 2024-04-18T21:05:33.946 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.946 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.946 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:33.946 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626993+0000", 2024-04-18T21:05:33.946 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.9935999999999998e-05 2024-04-18T21:05:33.946 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.946 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.947 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:33.947 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633665+0000", 2024-04-18T21:05:33.947 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0066719250000000004 2024-04-18T21:05:33.947 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.947 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.947 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:33.947 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633761+0000", 2024-04-18T21:05:33.947 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.5174999999999996e-05 2024-04-18T21:05:33.947 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:33.947 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:33.947 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:33.947 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.947 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.947 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:33.947 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:05:33.948 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 28.247581115999999, 2024-04-18T21:05:33.948 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0090159079999999996, 2024-04-18T21:05:33.948 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:33.948 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:33.948 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:33.948 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:33.948 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.948 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:33.948 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:05:33.948 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:33.948 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.948 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.948 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:33.948 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:05:33.949 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:33.949 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.949 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.949 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:33.949 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624751+0000", 2024-04-18T21:05:33.949 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.7600000000000006e-07 2024-04-18T21:05:33.949 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.949 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.949 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:33.949 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624787+0000", 2024-04-18T21:05:33.949 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.6273000000000003e-05 2024-04-18T21:05:33.949 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.949 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.949 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:33.949 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625837+0000", 2024-04-18T21:05:33.950 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00104992 2024-04-18T21:05:33.950 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.950 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.950 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.950 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625860+0000", 2024-04-18T21:05:33.950 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3110000000000001e-05 2024-04-18T21:05:33.950 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.950 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.950 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:33.950 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625984+0000", 2024-04-18T21:05:33.950 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012399199999999999 2024-04-18T21:05:33.950 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.950 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.951 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:33.951 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626030+0000", 2024-04-18T21:05:33.951 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.5429999999999997e-05 2024-04-18T21:05:33.951 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.951 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.951 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:33.951 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633643+0000", 2024-04-18T21:05:33.951 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0076129320000000002 2024-04-18T21:05:33.951 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.951 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.951 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:33.951 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633766+0000", 2024-04-18T21:05:33.951 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000123275 2024-04-18T21:05:33.951 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:33.951 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:33.952 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:33.952 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.952 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.952 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:33.952 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:05:33.952 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 28.246327392000001, 2024-04-18T21:05:33.952 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0088669170000000002, 2024-04-18T21:05:33.952 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:33.952 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:33.952 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:33.952 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:33.952 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.952 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:33.953 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:05:33.953 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:33.953 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.953 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.953 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:33.953 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:05:33.953 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:33.953 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.953 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.953 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:33.953 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626005+0000", 2024-04-18T21:05:33.953 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.5000000000000001e-07 2024-04-18T21:05:33.953 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.954 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.954 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:33.954 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626028+0000", 2024-04-18T21:05:33.954 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2756999999999999e-05 2024-04-18T21:05:33.954 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.954 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.954 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:33.954 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626050+0000", 2024-04-18T21:05:33.954 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2140000000000001e-05 2024-04-18T21:05:33.954 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.954 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.954 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.954 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626065+0000", 2024-04-18T21:05:33.954 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5176e-05 2024-04-18T21:05:33.955 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.955 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.955 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:33.955 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628334+0000", 2024-04-18T21:05:33.955 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0022691439999999998 2024-04-18T21:05:33.955 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.955 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.955 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:33.955 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628379+0000", 2024-04-18T21:05:33.955 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.5420000000000002e-05 2024-04-18T21:05:33.955 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.955 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.955 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:33.955 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634770+0000", 2024-04-18T21:05:33.956 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0063908410000000004 2024-04-18T21:05:33.956 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.956 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.956 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:33.956 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634871+0000", 2024-04-18T21:05:33.956 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000100589 2024-04-18T21:05:33.956 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:33.956 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:33.956 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:33.956 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.956 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.956 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:13 3.10 e17/15 3:0d89b25e:::603.00000000:head v 17'8, mlcod=0'0)", 2024-04-18T21:05:33.956 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:05:33.956 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 28.227493963000001, 2024-04-18T21:05:33.956 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0090974379999999994, 2024-04-18T21:05:33.957 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:33.957 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:33.957 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:33.957 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:33.957 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.957 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:33.957 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:05:33.957 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:33.957 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.957 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.957 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:33.957 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:05:33.957 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:33.958 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.958 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.958 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:33.958 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644838+0000", 2024-04-18T21:05:33.958 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.569999999999999e-07 2024-04-18T21:05:33.958 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.958 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.958 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:33.958 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644846+0000", 2024-04-18T21:05:33.958 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.4499999999999998e-06 2024-04-18T21:05:33.958 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.958 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.958 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:33.959 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644861+0000", 2024-04-18T21:05:33.959 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5243e-05 2024-04-18T21:05:33.959 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.959 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.959 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.959 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644997+0000", 2024-04-18T21:05:33.959 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000135609 2024-04-18T21:05:33.959 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.959 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.959 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:33.959 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649150+0000", 2024-04-18T21:05:33.959 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0041536760000000002 2024-04-18T21:05:33.959 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.959 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.960 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:33.960 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649207+0000", 2024-04-18T21:05:33.960 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.6677e-05 2024-04-18T21:05:33.960 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.960 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.960 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:33.960 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.653840+0000", 2024-04-18T21:05:33.960 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0046329700000000001 2024-04-18T21:05:33.960 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.960 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.960 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:33.960 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.653935+0000", 2024-04-18T21:05:33.960 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.4856000000000001e-05 2024-04-18T21:05:33.960 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:33.960 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:33.961 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:33.961 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.961 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.961 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 3 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:05:33.961 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:05:33.961 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 28.224704803000002, 2024-04-18T21:05:33.961 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0087842319999999995, 2024-04-18T21:05:33.961 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:33.961 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:33.961 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "reached pg", 2024-04-18T21:05:33.961 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:33.961 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.961 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:33.961 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:05:33.962 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:33.962 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.962 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.962 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:33.962 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:05:33.962 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:33.962 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.962 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.962 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:33.962 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:05:33.962 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.8299999999999996e-07 2024-04-18T21:05:33.962 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.962 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.962 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:33.963 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647642+0000", 2024-04-18T21:05:33.963 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4724e-05 2024-04-18T21:05:33.963 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.963 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.963 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:33.963 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647679+0000", 2024-04-18T21:05:33.963 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.6662999999999998e-05 2024-04-18T21:05:33.963 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.963 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.963 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.963 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647735+0000", 2024-04-18T21:05:33.963 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.6196000000000002e-05 2024-04-18T21:05:33.963 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.963 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.963 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:33.964 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649865+0000", 2024-04-18T21:05:33.964 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0021299489999999999 2024-04-18T21:05:33.964 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.964 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.964 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:33.964 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656411+0000", 2024-04-18T21:05:33.964 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0065460170000000003 2024-04-18T21:05:33.964 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:33.964 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:33.964 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:33.964 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.964 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.964 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:33.964 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:05:33.965 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 28.224559607, 2024-04-18T21:05:33.965 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0095703190000000007, 2024-04-18T21:05:33.965 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:33.965 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:33.965 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:33.965 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:33.965 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.965 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:33.965 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:05:33.965 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:33.965 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.965 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.965 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:33.965 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:05:33.965 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:33.966 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.966 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.966 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:33.966 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647773+0000", 2024-04-18T21:05:33.966 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.046e-06 2024-04-18T21:05:33.966 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.966 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.966 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:33.966 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647795+0000", 2024-04-18T21:05:33.966 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2616000000000002e-05 2024-04-18T21:05:33.966 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.966 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.966 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:33.966 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647818+0000", 2024-04-18T21:05:33.967 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3110000000000001e-05 2024-04-18T21:05:33.967 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.967 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.967 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.967 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647834+0000", 2024-04-18T21:05:33.967 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5163e-05 2024-04-18T21:05:33.967 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.967 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.967 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:33.967 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650682+0000", 2024-04-18T21:05:33.967 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0028479759999999999 2024-04-18T21:05:33.967 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.967 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.967 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:33.967 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650730+0000", 2024-04-18T21:05:33.968 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.8375999999999999e-05 2024-04-18T21:05:33.968 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.968 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.968 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:33.968 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656751+0000", 2024-04-18T21:05:33.968 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0060211880000000002 2024-04-18T21:05:33.968 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.968 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.968 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:33.968 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657342+0000", 2024-04-18T21:05:33.968 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00059084399999999998 2024-04-18T21:05:33.968 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:33.968 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:33.968 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:33.969 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.969 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.969 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:33.969 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:05:33.969 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 28.224147321, 2024-04-18T21:05:33.969 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0092471759999999993, 2024-04-18T21:05:33.969 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:33.969 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:33.969 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:33.969 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:33.969 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.969 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:33.969 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:05:33.969 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:33.969 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.970 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.970 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:33.970 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:05:33.970 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:33.970 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.970 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.970 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:33.970 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648185+0000", 2024-04-18T21:05:33.970 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.5000000000000001e-07 2024-04-18T21:05:33.970 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.970 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.970 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:33.970 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648203+0000", 2024-04-18T21:05:33.971 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.8102999999999999e-05 2024-04-18T21:05:33.971 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.971 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.971 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:33.971 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648226+0000", 2024-04-18T21:05:33.971 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2921999999999998e-05 2024-04-18T21:05:33.971 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.971 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.971 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:33.971 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648241+0000", 2024-04-18T21:05:33.971 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5336999999999999e-05 2024-04-18T21:05:33.971 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.971 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.971 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:33.971 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.651268+0000", 2024-04-18T21:05:33.972 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0030271640000000002 2024-04-18T21:05:33.972 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.972 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.972 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:33.972 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.651319+0000", 2024-04-18T21:05:33.972 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.0843000000000001e-05 2024-04-18T21:05:33.972 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.972 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.972 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:33.972 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657347+0000", 2024-04-18T21:05:33.972 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0060279770000000003 2024-04-18T21:05:33.972 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:33.972 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:33.972 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:33.972 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657431+0000", 2024-04-18T21:05:33.973 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.3980000000000006e-05 2024-04-18T21:05:33.973 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:33.973 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:33.973 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:33.973 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:33.973 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:33.973 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:05:33.974 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:05:33.975 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:33.975+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:34.075 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:34.075+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:34.103 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:05:34.104 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:05:34.104 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-04-18T21:05:34.104 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:05:34.117 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:05:34.176 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:34.175+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:34.225 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:05:34.225 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:05:34.225 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-18T21:05:34.225 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-18T21:05:34.225 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:05:34.238 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:05:34.276 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:34.275+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:34.378 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:34.375+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:34.406 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:05:34.406 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-18T21:05:34.407 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-18T21:05:34.407 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:05:34.407 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.407 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:34.407 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:05:34.407 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 28.790424372, 2024-04-18T21:05:34.407 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.034065303999999998, 2024-04-18T21:05:34.407 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:34.407 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:34.407 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:34.407 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:34.407 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.407 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:34.407 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:05:34.408 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:34.408 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.408 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.408 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:34.408 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:05:34.408 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:34.408 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.408 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.408 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:34.408 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615254+0000", 2024-04-18T21:05:34.408 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7829999999999999e-06 2024-04-18T21:05:34.408 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.408 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.408 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:34.409 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615267+0000", 2024-04-18T21:05:34.409 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3334e-05 2024-04-18T21:05:34.409 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.409 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.409 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:34.409 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615294+0000", 2024-04-18T21:05:34.409 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7271999999999999e-05 2024-04-18T21:05:34.409 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.409 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.409 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:34.409 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615321+0000", 2024-04-18T21:05:34.409 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.637e-05 2024-04-18T21:05:34.409 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.410 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.410 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:34.410 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615479+0000", 2024-04-18T21:05:34.410 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000158493 2024-04-18T21:05:34.410 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.410 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.410 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:34.410 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615498+0000", 2024-04-18T21:05:34.410 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9148999999999999e-05 2024-04-18T21:05:34.410 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.410 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.410 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:34.410 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632915+0000", 2024-04-18T21:05:34.411 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.017416551999999998 2024-04-18T21:05:34.411 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.411 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.411 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:34.411 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633302+0000", 2024-04-18T21:05:34.411 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00038725000000000001 2024-04-18T21:05:34.411 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.411 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.411 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:34.411 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633638+0000", 2024-04-18T21:05:34.411 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000335946 2024-04-18T21:05:34.411 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.411 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.411 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:34.412 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645976+0000", 2024-04-18T21:05:34.412 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012337617 2024-04-18T21:05:34.412 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.412 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.412 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:34.412 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649080+0000", 2024-04-18T21:05:34.412 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031038929999999999 2024-04-18T21:05:34.412 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.412 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.412 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:34.412 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649207+0000", 2024-04-18T21:05:34.412 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000127537 2024-04-18T21:05:34.412 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.412 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.413 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:34.413 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649316+0000", 2024-04-18T21:05:34.413 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109108 2024-04-18T21:05:34.413 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:34.413 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:34.413 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:34.413 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.413 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.413 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:34.413 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:05:34.413 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 28.790290994999999, 2024-04-18T21:05:34.413 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036275764000000002, 2024-04-18T21:05:34.413 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:34.413 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:34.414 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:34.414 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:34.414 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.414 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:34.414 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:05:34.414 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:34.414 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.414 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.414 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:34.414 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:05:34.414 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:34.414 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.414 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.414 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:34.415 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615386+0000", 2024-04-18T21:05:34.415 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.573e-06 2024-04-18T21:05:34.415 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.415 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.415 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:34.415 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:05:34.415 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0723999999999999e-05 2024-04-18T21:05:34.415 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.415 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.415 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:34.415 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615418+0000", 2024-04-18T21:05:34.415 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0902000000000001e-05 2024-04-18T21:05:34.415 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.415 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.415 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:34.416 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615433+0000", 2024-04-18T21:05:34.416 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5319999999999999e-05 2024-04-18T21:05:34.416 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.416 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.416 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:34.416 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615659+0000", 2024-04-18T21:05:34.416 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000226095 2024-04-18T21:05:34.416 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.416 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.416 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:34.416 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:34.416 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1276e-05 2024-04-18T21:05:34.416 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.416 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.416 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:34.417 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643654+0000", 2024-04-18T21:05:34.417 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027983238000000001 2024-04-18T21:05:34.417 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.417 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.417 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:34.417 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643868+0000", 2024-04-18T21:05:34.417 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000214305 2024-04-18T21:05:34.417 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.417 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.417 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:34.417 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:05:34.417 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035892200000000002 2024-04-18T21:05:34.417 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.417 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.417 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:34.418 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646056+0000", 2024-04-18T21:05:34.418 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001829172 2024-04-18T21:05:34.418 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.418 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.418 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:34.418 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651406+0000", 2024-04-18T21:05:34.418 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0053504800000000003 2024-04-18T21:05:34.418 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.418 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.418 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:34.418 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651551+0000", 2024-04-18T21:05:34.418 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014427999999999999 2024-04-18T21:05:34.418 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.418 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.419 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:34.419 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651660+0000", 2024-04-18T21:05:34.419 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109477 2024-04-18T21:05:34.419 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:34.419 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:34.419 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:34.419 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.419 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.419 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:34.419 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:05:34.419 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 28.790217612999999, 2024-04-18T21:05:34.419 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045668994999999997, 2024-04-18T21:05:34.419 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:34.419 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:34.420 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:34.420 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:34.420 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.420 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:34.420 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:05:34.420 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:34.420 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.420 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.420 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:34.420 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:05:34.420 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:34.420 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.420 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.421 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:34.421 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615459+0000", 2024-04-18T21:05:34.421 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5030000000000001e-06 2024-04-18T21:05:34.421 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.421 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.421 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:34.421 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615506+0000", 2024-04-18T21:05:34.421 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6872000000000001e-05 2024-04-18T21:05:34.421 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.421 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.421 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:34.421 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615527+0000", 2024-04-18T21:05:34.421 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0763000000000001e-05 2024-04-18T21:05:34.421 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.422 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.422 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:34.422 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615551+0000", 2024-04-18T21:05:34.422 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4159e-05 2024-04-18T21:05:34.422 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.422 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.422 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:34.422 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615736+0000", 2024-04-18T21:05:34.422 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018499599999999999 2024-04-18T21:05:34.422 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.422 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.422 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:34.422 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615748+0000", 2024-04-18T21:05:34.423 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2272999999999999e-05 2024-04-18T21:05:34.423 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.423 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.423 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:34.423 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635481+0000", 2024-04-18T21:05:34.423 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019732772999999999 2024-04-18T21:05:34.423 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.423 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.423 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:34.423 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635791+0000", 2024-04-18T21:05:34.423 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031013299999999998 2024-04-18T21:05:34.423 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.423 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.423 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:34.423 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636101+0000", 2024-04-18T21:05:34.424 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030943300000000002 2024-04-18T21:05:34.424 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.424 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.424 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:34.424 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646043+0000", 2024-04-18T21:05:34.424 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099428139999999995 2024-04-18T21:05:34.424 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.424 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.424 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:34.424 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660991+0000", 2024-04-18T21:05:34.424 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014947142 2024-04-18T21:05:34.424 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.424 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.424 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:34.425 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661061+0000", 2024-04-18T21:05:34.425 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0438000000000006e-05 2024-04-18T21:05:34.425 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.425 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.425 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:34.425 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661127+0000", 2024-04-18T21:05:34.425 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5696000000000003e-05 2024-04-18T21:05:34.425 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:34.425 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:34.425 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:34.425 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.425 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.425 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:34.425 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:34.426 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 28.790005184999998, 2024-04-18T21:05:34.426 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045745085999999997, 2024-04-18T21:05:34.426 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:34.426 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:34.426 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:34.426 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:34.426 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.426 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:34.426 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:34.426 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:34.426 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.426 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.426 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:34.427 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:34.427 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:34.427 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.427 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.427 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:34.427 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:05:34.427 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7400000000000001e-06 2024-04-18T21:05:34.427 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.427 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.427 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:34.427 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:05:34.427 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8133e-05 2024-04-18T21:05:34.427 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.427 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.428 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:34.428 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615726+0000", 2024-04-18T21:05:34.428 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6132e-05 2024-04-18T21:05:34.428 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.428 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.428 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:34.428 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615742+0000", 2024-04-18T21:05:34.428 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6157000000000001e-05 2024-04-18T21:05:34.428 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.428 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.428 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:34.428 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615937+0000", 2024-04-18T21:05:34.428 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000194768 2024-04-18T21:05:34.428 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.428 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.429 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:34.429 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615950+0000", 2024-04-18T21:05:34.429 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3084e-05 2024-04-18T21:05:34.429 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.429 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.429 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:34.429 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643676+0000", 2024-04-18T21:05:34.429 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027725639999999999 2024-04-18T21:05:34.429 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.429 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.429 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:34.429 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643867+0000", 2024-04-18T21:05:34.429 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019075900000000001 2024-04-18T21:05:34.429 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.429 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.430 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:34.430 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:05:34.430 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036013799999999997 2024-04-18T21:05:34.430 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.430 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.430 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:34.430 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646068+0000", 2024-04-18T21:05:34.430 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001841536 2024-04-18T21:05:34.430 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.430 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.430 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:34.430 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661184+0000", 2024-04-18T21:05:34.430 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015115458999999999 2024-04-18T21:05:34.430 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.431 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.431 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:34.431 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661283+0000", 2024-04-18T21:05:34.431 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9502999999999999e-05 2024-04-18T21:05:34.431 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.431 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.431 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:34.431 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661415+0000", 2024-04-18T21:05:34.431 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000132037 2024-04-18T21:05:34.431 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:34.431 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:34.431 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:34.431 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.431 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.431 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:34.432 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:05:34.432 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 28.789883498000002, 2024-04-18T21:05:34.432 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036185947000000003, 2024-04-18T21:05:34.432 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:34.432 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:34.432 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:34.432 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:34.432 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.432 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:34.432 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:05:34.432 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:34.432 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.432 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.432 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:34.433 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:05:34.433 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:34.433 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.433 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.433 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:34.433 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615794+0000", 2024-04-18T21:05:34.433 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6440000000000001e-06 2024-04-18T21:05:34.433 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.433 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.433 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:34.433 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615803+0000", 2024-04-18T21:05:34.433 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1220000000000001e-06 2024-04-18T21:05:34.433 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.433 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.433 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:34.434 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615827+0000", 2024-04-18T21:05:34.434 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3997000000000001e-05 2024-04-18T21:05:34.434 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.434 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.434 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:34.434 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615899+0000", 2024-04-18T21:05:34.434 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2741e-05 2024-04-18T21:05:34.434 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.434 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.434 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:34.434 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616019+0000", 2024-04-18T21:05:34.434 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119874 2024-04-18T21:05:34.435 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.435 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.435 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:34.435 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616029+0000", 2024-04-18T21:05:34.435 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:05:34.435 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.435 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.435 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:34.435 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644823+0000", 2024-04-18T21:05:34.435 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.028793151999999999 2024-04-18T21:05:34.435 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.435 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.435 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:34.435 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645106+0000", 2024-04-18T21:05:34.436 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028379700000000002 2024-04-18T21:05:34.436 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.436 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.436 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:34.436 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645294+0000", 2024-04-18T21:05:34.436 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000187181 2024-04-18T21:05:34.436 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.436 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.436 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:34.436 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646763+0000", 2024-04-18T21:05:34.436 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0014691050000000001 2024-04-18T21:05:34.436 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.436 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.436 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:34.437 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651784+0000", 2024-04-18T21:05:34.437 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050211650000000002 2024-04-18T21:05:34.437 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.437 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.437 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:34.437 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651876+0000", 2024-04-18T21:05:34.437 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2503999999999994e-05 2024-04-18T21:05:34.437 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.437 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.437 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:34.437 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651978+0000", 2024-04-18T21:05:34.437 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000101475 2024-04-18T21:05:34.437 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:34.437 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:34.438 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:34.438 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.438 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.438 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:34.438 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:34.438 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 28.789734890999998, 2024-04-18T21:05:34.438 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032262322000000003, 2024-04-18T21:05:34.438 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:34.438 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:34.438 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:34.438 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:34.438 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.438 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:34.439 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:34.439 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:34.439 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.439 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.439 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:34.439 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:34.439 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:34.439 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.439 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.439 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:34.439 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615943+0000", 2024-04-18T21:05:34.439 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1959999999999998e-06 2024-04-18T21:05:34.439 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.439 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.439 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:34.440 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615956+0000", 2024-04-18T21:05:34.440 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3424000000000001e-05 2024-04-18T21:05:34.440 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.440 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.440 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:34.440 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615983+0000", 2024-04-18T21:05:34.440 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7072000000000001e-05 2024-04-18T21:05:34.440 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.440 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.440 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:34.440 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616006+0000", 2024-04-18T21:05:34.440 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2823000000000002e-05 2024-04-18T21:05:34.440 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.440 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.441 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:34.441 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616156+0000", 2024-04-18T21:05:34.441 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014962299999999999 2024-04-18T21:05:34.441 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.441 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.441 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:34.441 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616174+0000", 2024-04-18T21:05:34.441 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8082999999999999e-05 2024-04-18T21:05:34.441 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.441 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.441 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:34.441 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.629952+0000", 2024-04-18T21:05:34.441 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013778514 2024-04-18T21:05:34.441 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.441 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.442 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:34.442 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630201+0000", 2024-04-18T21:05:34.442 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024918100000000001 2024-04-18T21:05:34.442 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.442 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.442 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:34.442 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630386+0000", 2024-04-18T21:05:34.442 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018436900000000001 2024-04-18T21:05:34.442 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.442 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.442 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:34.442 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643169+0000", 2024-04-18T21:05:34.442 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012782774 2024-04-18T21:05:34.443 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.443 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.443 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:34.443 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.647924+0000", 2024-04-18T21:05:34.443 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004755787 2024-04-18T21:05:34.443 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.443 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.443 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:34.443 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648069+0000", 2024-04-18T21:05:34.443 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014459600000000001 2024-04-18T21:05:34.443 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.443 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.443 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:34.443 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648203+0000", 2024-04-18T21:05:34.443 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013388000000000001 2024-04-18T21:05:34.444 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:34.444 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:34.444 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:34.444 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.444 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.444 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:34.444 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:05:34.444 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 28.789626627000001, 2024-04-18T21:05:34.444 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032489736999999998, 2024-04-18T21:05:34.444 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:34.444 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:34.444 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:34.444 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:34.444 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.445 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:34.445 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:05:34.445 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:34.445 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.445 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.445 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:34.445 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:05:34.445 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:34.445 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.445 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.445 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:34.445 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616050+0000", 2024-04-18T21:05:34.445 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.606e-06 2024-04-18T21:05:34.445 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.445 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.446 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:34.446 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616061+0000", 2024-04-18T21:05:34.446 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0463e-05 2024-04-18T21:05:34.446 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.446 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.446 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:34.446 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616092+0000", 2024-04-18T21:05:34.446 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1415999999999999e-05 2024-04-18T21:05:34.446 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.446 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.446 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:34.446 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616109+0000", 2024-04-18T21:05:34.446 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6557000000000001e-05 2024-04-18T21:05:34.446 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.447 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.447 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:34.447 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616358+0000", 2024-04-18T21:05:34.447 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000249077 2024-04-18T21:05:34.447 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.447 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.447 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:34.447 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616370+0000", 2024-04-18T21:05:34.447 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2037e-05 2024-04-18T21:05:34.447 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.447 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.447 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:34.447 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.634920+0000", 2024-04-18T21:05:34.448 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018550397 2024-04-18T21:05:34.448 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.448 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.448 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:34.448 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640420+0000", 2024-04-18T21:05:34.448 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055000539999999999 2024-04-18T21:05:34.448 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.448 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.448 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:34.448 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648538+0000", 2024-04-18T21:05:34.448 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0081181299999999994 2024-04-18T21:05:34.448 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:34.448 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:34.448 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:34.449 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.449 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.449 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:34.449 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:05:34.449 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 28.789542306000001, 2024-04-18T21:05:34.449 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036090029000000003, 2024-04-18T21:05:34.449 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:34.449 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:34.449 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:34.449 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:34.449 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.449 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:34.449 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:05:34.449 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:34.450 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.450 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.450 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:34.450 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:05:34.450 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:34.450 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.450 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.450 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:34.450 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616134+0000", 2024-04-18T21:05:34.450 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.353e-06 2024-04-18T21:05:34.450 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.450 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.450 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:34.450 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616141+0000", 2024-04-18T21:05:34.451 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2770000000000002e-06 2024-04-18T21:05:34.451 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.451 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.451 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:34.451 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616160+0000", 2024-04-18T21:05:34.451 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.91e-05 2024-04-18T21:05:34.451 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.451 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.451 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:34.451 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616170+0000", 2024-04-18T21:05:34.451 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7699999999999996e-06 2024-04-18T21:05:34.451 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.451 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.451 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:34.451 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616275+0000", 2024-04-18T21:05:34.452 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105313 2024-04-18T21:05:34.452 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.452 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.452 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:34.452 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616288+0000", 2024-04-18T21:05:34.452 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3027000000000001e-05 2024-04-18T21:05:34.452 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.452 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.452 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:34.452 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646160+0000", 2024-04-18T21:05:34.452 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.029872019 2024-04-18T21:05:34.452 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.452 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.452 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:34.453 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646368+0000", 2024-04-18T21:05:34.453 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020811899999999999 2024-04-18T21:05:34.453 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.453 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.453 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:34.453 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652223+0000", 2024-04-18T21:05:34.453 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.005855051 2024-04-18T21:05:34.453 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:34.453 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:34.453 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:34.453 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.453 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.453 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:34.453 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:05:34.453 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 28.789484736999999, 2024-04-18T21:05:34.454 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043572403000000003, 2024-04-18T21:05:34.454 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:34.454 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:34.454 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:34.454 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:34.454 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.454 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:34.454 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:05:34.454 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:34.454 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.454 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.454 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:34.454 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:05:34.455 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:34.455 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.455 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.455 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:34.455 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616192+0000", 2024-04-18T21:05:34.455 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:05:34.455 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.455 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.455 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:34.455 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616203+0000", 2024-04-18T21:05:34.455 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0890000000000001e-05 2024-04-18T21:05:34.455 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.455 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.455 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:34.455 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616223+0000", 2024-04-18T21:05:34.456 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0409000000000001e-05 2024-04-18T21:05:34.456 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.456 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.456 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:34.456 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616238+0000", 2024-04-18T21:05:34.456 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5160000000000001e-05 2024-04-18T21:05:34.456 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.456 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.456 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:34.456 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616343+0000", 2024-04-18T21:05:34.456 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000104831 2024-04-18T21:05:34.456 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.456 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.456 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:34.456 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616357+0000", 2024-04-18T21:05:34.457 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3686000000000001e-05 2024-04-18T21:05:34.457 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.457 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.457 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:34.457 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635912+0000", 2024-04-18T21:05:34.457 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019554944000000001 2024-04-18T21:05:34.457 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.457 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.457 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:34.457 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636231+0000", 2024-04-18T21:05:34.457 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000318766 2024-04-18T21:05:34.457 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.457 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.457 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:34.458 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659763+0000", 2024-04-18T21:05:34.458 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023532474000000001 2024-04-18T21:05:34.458 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:34.458 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:34.458 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:34.458 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.458 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.458 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:34.458 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:05:34.458 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 28.785556029999999, 2024-04-18T21:05:34.458 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015007971, 2024-04-18T21:05:34.458 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:34.458 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:34.458 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:34.459 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:34.459 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.459 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:34.459 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:05:34.459 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:34.459 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.459 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.459 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:34.459 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:05:34.459 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:34.459 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.459 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.459 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:34.459 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620120+0000", 2024-04-18T21:05:34.459 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0359999999999999e-06 2024-04-18T21:05:34.460 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.460 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.460 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:34.460 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620157+0000", 2024-04-18T21:05:34.460 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6636e-05 2024-04-18T21:05:34.460 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.460 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.460 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:34.460 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620177+0000", 2024-04-18T21:05:34.460 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0247000000000001e-05 2024-04-18T21:05:34.460 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.460 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.460 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:34.460 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620195+0000", 2024-04-18T21:05:34.461 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7819e-05 2024-04-18T21:05:34.461 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.461 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.461 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:34.461 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620342+0000", 2024-04-18T21:05:34.461 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014643300000000001 2024-04-18T21:05:34.461 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.461 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.461 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:34.461 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620405+0000", 2024-04-18T21:05:34.461 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3522000000000006e-05 2024-04-18T21:05:34.461 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.461 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.461 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:34.461 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635016+0000", 2024-04-18T21:05:34.462 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014610840999999999 2024-04-18T21:05:34.462 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.462 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.462 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:34.462 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635127+0000", 2024-04-18T21:05:34.462 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111437 2024-04-18T21:05:34.462 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:34.462 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:34.462 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:34.462 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.462 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.462 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:34.462 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:05:34.462 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 28.785448762000001, 2024-04-18T21:05:34.463 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012693296, 2024-04-18T21:05:34.463 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:34.463 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:34.463 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:34.463 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:34.463 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.463 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:34.463 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:05:34.463 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:34.463 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.463 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.463 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:34.463 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:05:34.463 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:34.464 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.464 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.464 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:34.464 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620228+0000", 2024-04-18T21:05:34.464 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:05:34.464 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.464 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.464 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:34.464 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620236+0000", 2024-04-18T21:05:34.464 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.303e-06 2024-04-18T21:05:34.464 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.464 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.464 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:34.464 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620255+0000", 2024-04-18T21:05:34.464 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9406e-05 2024-04-18T21:05:34.465 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.465 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.465 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:34.465 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620274+0000", 2024-04-18T21:05:34.465 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8940000000000002e-05 2024-04-18T21:05:34.465 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.465 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.465 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:34.465 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:05:34.465 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001558753 2024-04-18T21:05:34.465 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.465 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.465 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:34.465 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621879+0000", 2024-04-18T21:05:34.465 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6359000000000001e-05 2024-04-18T21:05:34.466 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.466 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.466 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:34.466 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632841+0000", 2024-04-18T21:05:34.466 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010961907 2024-04-18T21:05:34.466 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.466 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.466 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:34.466 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632920+0000", 2024-04-18T21:05:34.466 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8714999999999994e-05 2024-04-18T21:05:34.466 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:34.466 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:34.466 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:34.467 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.467 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.467 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:34.467 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:05:34.467 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 28.783902998999999, 2024-04-18T21:05:34.467 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013445702, 2024-04-18T21:05:34.467 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:34.467 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:34.467 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:34.467 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:34.467 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.467 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:34.467 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:05:34.467 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:34.468 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.468 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.468 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:34.468 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:05:34.468 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:34.468 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.468 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.468 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:34.468 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621774+0000", 2024-04-18T21:05:34.468 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2500000000000001e-06 2024-04-18T21:05:34.468 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.468 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.468 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:34.468 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621786+0000", 2024-04-18T21:05:34.468 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2636000000000001e-05 2024-04-18T21:05:34.469 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.469 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.469 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:34.469 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621814+0000", 2024-04-18T21:05:34.469 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7823000000000001e-05 2024-04-18T21:05:34.469 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.469 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.469 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:34.469 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621844+0000", 2024-04-18T21:05:34.469 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9589000000000001e-05 2024-04-18T21:05:34.469 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.469 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.469 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:34.470 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622253+0000", 2024-04-18T21:05:34.470 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040963700000000002 2024-04-18T21:05:34.470 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.470 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.470 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:34.470 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622304+0000", 2024-04-18T21:05:34.470 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0868999999999997e-05 2024-04-18T21:05:34.470 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.470 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.470 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:34.470 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635133+0000", 2024-04-18T21:05:34.470 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012829136 2024-04-18T21:05:34.470 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.470 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.471 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:34.471 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635218+0000", 2024-04-18T21:05:34.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4761999999999999e-05 2024-04-18T21:05:34.471 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:34.471 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:34.471 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:34.471 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.471 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.471 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:34.471 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:05:34.471 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 28.783776239000002, 2024-04-18T21:05:34.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014162065, 2024-04-18T21:05:34.471 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:34.471 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:34.472 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:34.472 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:34.472 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.472 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:34.472 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:05:34.472 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:34.472 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.472 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.472 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:34.472 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:05:34.472 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:34.472 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.472 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.472 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:34.473 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621900+0000", 2024-04-18T21:05:34.473 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:05:34.473 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.473 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:34.473 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621910+0000", 2024-04-18T21:05:34.473 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0207000000000001e-05 2024-04-18T21:05:34.473 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.473 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:34.473 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621932+0000", 2024-04-18T21:05:34.473 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1789000000000001e-05 2024-04-18T21:05:34.473 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.473 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:34.474 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621946+0000", 2024-04-18T21:05:34.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4212999999999999e-05 2024-04-18T21:05:34.474 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.474 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.474 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:34.474 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624477+0000", 2024-04-18T21:05:34.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025303470000000001 2024-04-18T21:05:34.474 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.474 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.474 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:34.474 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624525+0000", 2024-04-18T21:05:34.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8084999999999998e-05 2024-04-18T21:05:34.474 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.474 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.475 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:34.475 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635976+0000", 2024-04-18T21:05:34.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.011451368999999999 2024-04-18T21:05:34.475 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.475 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:34.475 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636061+0000", 2024-04-18T21:05:34.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5094999999999998e-05 2024-04-18T21:05:34.475 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:34.475 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:34.475 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:34.475 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.475 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:05:34.476 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:05:34.476 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 28.774540613999999, 2024-04-18T21:05:34.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0098014739999999993, 2024-04-18T21:05:34.476 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:34.476 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:34.476 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:05:34.476 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:34.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:34.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:05:34.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:34.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:34.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:05:34.477 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:34.477 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.477 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.477 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:34.477 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631136+0000", 2024-04-18T21:05:34.477 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0139999999999999e-06 2024-04-18T21:05:34.477 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.477 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.477 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:34.477 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631152+0000", 2024-04-18T21:05:34.477 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6365999999999999e-05 2024-04-18T21:05:34.477 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.477 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.477 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:34.477 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631961+0000", 2024-04-18T21:05:34.478 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00080873100000000003 2024-04-18T21:05:34.478 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.478 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.478 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:34.478 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632021+0000", 2024-04-18T21:05:34.478 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0541999999999997e-05 2024-04-18T21:05:34.478 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.478 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.478 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:34.478 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633539+0000", 2024-04-18T21:05:34.478 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015175639999999999 2024-04-18T21:05:34.478 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.478 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.478 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:34.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640936+0000", 2024-04-18T21:05:34.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007397257 2024-04-18T21:05:34.479 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:34.479 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:34.479 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:34.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.479 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.479 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-18T21:05:34.479 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:05:34.479 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 28.757079181000002, 2024-04-18T21:05:34.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00073592199999999997, 2024-04-18T21:05:34.479 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:34.479 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:34.479 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:34.479 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:34.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:34.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:05:34.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:34.480 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:34.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:05:34.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:34.480 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:34.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648597+0000", 2024-04-18T21:05:34.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:05:34.481 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:34.481 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648605+0000", 2024-04-18T21:05:34.481 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3960000000000006e-06 2024-04-18T21:05:34.481 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:34.481 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648625+0000", 2024-04-18T21:05:34.481 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9987e-05 2024-04-18T21:05:34.481 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:34.481 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648643+0000", 2024-04-18T21:05:34.481 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7079e-05 2024-04-18T21:05:34.481 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.482 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.482 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:34.482 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649043+0000", 2024-04-18T21:05:34.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040083399999999998 2024-04-18T21:05:34.482 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.482 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.482 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:34.482 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649062+0000", 2024-04-18T21:05:34.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9052999999999999e-05 2024-04-18T21:05:34.482 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.482 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.482 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:34.482 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649332+0000", 2024-04-18T21:05:34.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026971999999999999 2024-04-18T21:05:34.483 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:34.483 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:34.483 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:34.483 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.483 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.483 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:05:34.483 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:05:34.483 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 28.754304279999999, 2024-04-18T21:05:34.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00086123999999999999, 2024-04-18T21:05:34.483 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:34.483 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:34.483 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:05:34.483 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:34.483 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:34.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:05:34.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:34.484 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:34.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:05:34.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:34.484 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:34.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651372+0000", 2024-04-18T21:05:34.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7599999999999997e-07 2024-04-18T21:05:34.484 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:34.485 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651377+0000", 2024-04-18T21:05:34.485 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.22e-06 2024-04-18T21:05:34.485 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:34.485 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651394+0000", 2024-04-18T21:05:34.485 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6646999999999998e-05 2024-04-18T21:05:34.485 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:34.485 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651427+0000", 2024-04-18T21:05:34.485 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3682e-05 2024-04-18T21:05:34.485 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.486 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.486 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:34.486 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652029+0000", 2024-04-18T21:05:34.486 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00060152199999999995 2024-04-18T21:05:34.486 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.486 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.486 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:34.486 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652232+0000", 2024-04-18T21:05:34.486 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020359299999999999 2024-04-18T21:05:34.486 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:34.486 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:34.486 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:34.486 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.486 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.486 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:05:34.487 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:05:34.487 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 28.746277318000001, 2024-04-18T21:05:34.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0017426200000000001, 2024-04-18T21:05:34.487 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:34.487 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:34.487 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:34.487 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:34.487 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.487 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:34.487 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:05:34.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:34.487 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.487 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.487 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:34.488 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:05:34.488 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:34.488 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.488 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:34.488 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659399+0000", 2024-04-18T21:05:34.488 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6000000000000002e-07 2024-04-18T21:05:34.488 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.488 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:34.488 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659405+0000", 2024-04-18T21:05:34.488 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5069999999999997e-06 2024-04-18T21:05:34.488 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.488 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:34.489 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659425+0000", 2024-04-18T21:05:34.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.927e-05 2024-04-18T21:05:34.489 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.489 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:34.489 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659443+0000", 2024-04-18T21:05:34.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8051999999999999e-05 2024-04-18T21:05:34.489 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.489 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:34.489 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660973+0000", 2024-04-18T21:05:34.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001530106 2024-04-18T21:05:34.489 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.490 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:34.490 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660983+0000", 2024-04-18T21:05:34.490 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0516999999999999e-05 2024-04-18T21:05:34.490 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.490 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:34.490 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661141+0000", 2024-04-18T21:05:34.490 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015730799999999999 2024-04-18T21:05:34.490 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:34.490 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:34.490 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:34.490 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.490 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:05:34.491 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:05:34.491 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 28.746060693, 2024-04-18T21:05:34.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001812311, 2024-04-18T21:05:34.491 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:34.491 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:34.491 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:34.491 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:34.491 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.491 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:34.491 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:05:34.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:34.491 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.491 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.491 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:34.491 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:05:34.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:34.492 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:34.492 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659616+0000", 2024-04-18T21:05:34.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.277e-06 2024-04-18T21:05:34.492 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:34.492 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659625+0000", 2024-04-18T21:05:34.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5359999999999998e-06 2024-04-18T21:05:34.492 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.493 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:34.493 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659647+0000", 2024-04-18T21:05:34.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1857000000000001e-05 2024-04-18T21:05:34.493 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.493 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.493 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:34.493 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659664+0000", 2024-04-18T21:05:34.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6405999999999998e-05 2024-04-18T21:05:34.493 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.493 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.493 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:34.493 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661169+0000", 2024-04-18T21:05:34.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015054179999999999 2024-04-18T21:05:34.493 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.494 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.494 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:34.494 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661177+0000", 2024-04-18T21:05:34.494 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9680000000000006e-06 2024-04-18T21:05:34.494 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.494 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.494 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:34.494 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661427+0000", 2024-04-18T21:05:34.494 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024984900000000001 2024-04-18T21:05:34.494 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:34.494 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:34.494 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:34.494 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.494 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.495 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-18T21:05:34.495 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:05:34.495 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 26.793140085000001, 2024-04-18T21:05:34.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0030975030000000001, 2024-04-18T21:05:34.495 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:34.495 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:34.495 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:34.495 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:34.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.495 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:34.495 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:05:34.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:34.495 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:34.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:05:34.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:34.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:34.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612538+0000", 2024-04-18T21:05:34.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6259999999999999e-06 2024-04-18T21:05:34.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:34.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612552+0000", 2024-04-18T21:05:34.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4073999999999999e-05 2024-04-18T21:05:34.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.497 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:34.497 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612585+0000", 2024-04-18T21:05:34.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3504999999999999e-05 2024-04-18T21:05:34.497 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.497 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:34.497 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612601+0000", 2024-04-18T21:05:34.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5194000000000001e-05 2024-04-18T21:05:34.497 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.497 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:34.497 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612746+0000", 2024-04-18T21:05:34.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145666 2024-04-18T21:05:34.497 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.498 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.498 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:34.498 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612953+0000", 2024-04-18T21:05:34.498 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000207109 2024-04-18T21:05:34.498 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.498 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.498 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:34.498 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.613134+0000", 2024-04-18T21:05:34.498 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018041300000000001 2024-04-18T21:05:34.498 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.498 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.498 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:34.498 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.614411+0000", 2024-04-18T21:05:34.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0012769929999999999 2024-04-18T21:05:34.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:34.499 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615441+0000", 2024-04-18T21:05:34.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001029917 2024-04-18T21:05:34.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:34.499 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615522+0000", 2024-04-18T21:05:34.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1142000000000003e-05 2024-04-18T21:05:34.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:34.499 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615633+0000", 2024-04-18T21:05:34.500 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000110864 2024-04-18T21:05:34.500 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:34.500 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:34.500 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:34.500 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.500 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-18T21:05:34.500 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:05:34.500 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.7908542740000009, 2024-04-18T21:05:34.500 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088979039999999999, 2024-04-18T21:05:34.500 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:34.500 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:34.500 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:34.500 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:34.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.501 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:34.501 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:05:34.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:34.501 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.501 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.501 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:34.501 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:05:34.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:34.501 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.501 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.501 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:34.501 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614825+0000", 2024-04-18T21:05:34.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4829999999999999e-06 2024-04-18T21:05:34.501 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.501 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.502 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:34.502 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614843+0000", 2024-04-18T21:05:34.502 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8777e-05 2024-04-18T21:05:34.502 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.502 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.502 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:34.502 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614884+0000", 2024-04-18T21:05:34.502 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1051999999999999e-05 2024-04-18T21:05:34.502 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.502 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.502 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:34.502 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614903+0000", 2024-04-18T21:05:34.502 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9069999999999999e-05 2024-04-18T21:05:34.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:34.503 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615047+0000", 2024-04-18T21:05:34.503 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014374400000000001 2024-04-18T21:05:34.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:34.503 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615061+0000", 2024-04-18T21:05:34.503 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4063000000000001e-05 2024-04-18T21:05:34.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:34.503 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621064+0000", 2024-04-18T21:05:34.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0060029200000000001 2024-04-18T21:05:34.504 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.504 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:34.504 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621211+0000", 2024-04-18T21:05:34.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000147224 2024-04-18T21:05:34.504 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.504 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:34.504 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621396+0000", 2024-04-18T21:05:34.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018454699999999999 2024-04-18T21:05:34.504 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.504 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:34.505 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.622517+0000", 2024-04-18T21:05:34.505 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001121424 2024-04-18T21:05:34.505 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.505 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.505 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:34.505 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623571+0000", 2024-04-18T21:05:34.505 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010538660000000001 2024-04-18T21:05:34.505 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.505 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.505 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:34.505 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623658+0000", 2024-04-18T21:05:34.505 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6439000000000004e-05 2024-04-18T21:05:34.505 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:34.505 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:34.505 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:34.506 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623719+0000", 2024-04-18T21:05:34.506 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1295000000000002e-05 2024-04-18T21:05:34.506 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:34.506 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:34.506 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:34.506 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:34.506 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:34.506 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:05:34.508 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:34.507+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:34.508 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:05:34.609 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:34.611+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:34.618 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:05:34.641 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:05:34.641 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:05:34.641 INFO:teuthology.orchestra.run.smithi132.stdout: "num_ops": 0 2024-04-18T21:05:34.641 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:05:34.654 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:05:34.710 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:34.711+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:34.774 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:05:34.775 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:05:34.775 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:34.775 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:34.789 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:05:34.795 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1: {} 2024-04-18T21:05:34.795 INFO:teuthology.orchestra.run.smithi078.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:05:34.811 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:34.811+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:34.818 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:05:34.818 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:05:34.910 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:34.911 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:34.911 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:34.911+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:34.924 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:05:35.012 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:35.011+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:35.054 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:35.054 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:35.068 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:05:35.113 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:35.115+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:35.214 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:35.215+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:35.230 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:35.230 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:35.244 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:05:35.315 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:35.315+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:35.363 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:35.364 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:35.378 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:05:35.421 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:35.423+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:35.509 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:35.509 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:35.516 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:35.515+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:35.523 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:05:35.618 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:35.619+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:35.689 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:35.689 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:35.703 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:05:35.719 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:35.719+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:35.820 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:35.820 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:35.820 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:35.819+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:35.834 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:05:35.852 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-18T21:05:35.921 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:35.923+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:35.965 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:35.965 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:35.979 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:05:36.023 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:36.023+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:36.096 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:36.096 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:36.110 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:05:36.123 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:36.123+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:36.223 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:36.223+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:36.283 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:36.283 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:36.297 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:05:36.345 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:36.347+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:36.425 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:36.427+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:36.431 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:36.431 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:36.445 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:05:36.526 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:36.527+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:36.613 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:36.613 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:36.627 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:05:36.628 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:36.627+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:36.727 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:36.727+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:36.748 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:36.748 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:36.762 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:05:36.828 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:36.827+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:36.838 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:05:36.842 INFO:teuthology.orchestra.run.smithi078.stderr:nodeep-scrub is set 2024-04-18T21:05:36.893 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:36.894 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:36.909 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:05:36.953 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:36.955+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:36.986 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:05:36.987 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:05:37.007 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1: {} 2024-04-18T21:05:37.007 INFO:teuthology.orchestra.run.smithi078.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:05:37.025 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:05:37.025 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:05:37.029 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:37.027+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:37.030 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:05:37.030 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:05:37.030 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-18T21:05:37.030 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-18T21:05:37.030 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:05:37.044 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:05:37.133 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:37.135+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:37.214 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:05:37.214 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-18T21:05:37.215 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-18T21:05:37.215 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:05:37.215 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.215 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:37.215 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:05:37.215 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 31.598555461, 2024-04-18T21:05:37.215 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.034065303999999998, 2024-04-18T21:05:37.215 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:37.215 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:37.215 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.215 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:37.215 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.215 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:37.215 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:05:37.216 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:37.216 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.216 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.216 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:37.216 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:05:37.216 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:37.216 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.216 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.216 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:37.216 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615254+0000", 2024-04-18T21:05:37.216 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7829999999999999e-06 2024-04-18T21:05:37.216 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.216 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.216 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:37.216 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615267+0000", 2024-04-18T21:05:37.217 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3334e-05 2024-04-18T21:05:37.217 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.217 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.217 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:37.217 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615294+0000", 2024-04-18T21:05:37.217 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7271999999999999e-05 2024-04-18T21:05:37.217 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.217 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.217 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.217 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615321+0000", 2024-04-18T21:05:37.217 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.637e-05 2024-04-18T21:05:37.217 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.217 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.217 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:37.218 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615479+0000", 2024-04-18T21:05:37.218 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000158493 2024-04-18T21:05:37.218 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.218 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.218 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:37.218 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615498+0000", 2024-04-18T21:05:37.218 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9148999999999999e-05 2024-04-18T21:05:37.218 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.218 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.218 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:37.218 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632915+0000", 2024-04-18T21:05:37.218 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.017416551999999998 2024-04-18T21:05:37.218 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.219 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.219 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:37.219 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633302+0000", 2024-04-18T21:05:37.219 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00038725000000000001 2024-04-18T21:05:37.219 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.219 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.219 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:37.219 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633638+0000", 2024-04-18T21:05:37.219 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000335946 2024-04-18T21:05:37.219 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.219 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.219 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:37.219 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645976+0000", 2024-04-18T21:05:37.220 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012337617 2024-04-18T21:05:37.220 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.220 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.220 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:37.220 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649080+0000", 2024-04-18T21:05:37.220 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031038929999999999 2024-04-18T21:05:37.220 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.220 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.220 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:37.220 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649207+0000", 2024-04-18T21:05:37.220 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000127537 2024-04-18T21:05:37.220 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.220 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.220 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:37.220 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649316+0000", 2024-04-18T21:05:37.221 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109108 2024-04-18T21:05:37.221 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:37.221 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:37.221 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:37.221 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.221 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.221 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:37.221 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:05:37.221 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 31.598422083999999, 2024-04-18T21:05:37.221 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036275764000000002, 2024-04-18T21:05:37.221 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:37.221 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:37.221 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.221 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:37.221 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.222 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:37.222 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:05:37.222 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:37.222 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.222 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.222 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:37.222 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:05:37.222 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:37.222 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.222 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.222 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:37.222 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615386+0000", 2024-04-18T21:05:37.222 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.573e-06 2024-04-18T21:05:37.222 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.223 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.223 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:37.223 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:05:37.223 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0723999999999999e-05 2024-04-18T21:05:37.223 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.223 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.223 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:37.223 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615418+0000", 2024-04-18T21:05:37.223 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0902000000000001e-05 2024-04-18T21:05:37.223 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.223 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.223 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.223 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615433+0000", 2024-04-18T21:05:37.223 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5319999999999999e-05 2024-04-18T21:05:37.223 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.224 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.224 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:37.224 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615659+0000", 2024-04-18T21:05:37.224 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000226095 2024-04-18T21:05:37.224 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.224 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.224 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:37.224 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:37.224 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1276e-05 2024-04-18T21:05:37.224 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.224 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.224 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:37.224 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643654+0000", 2024-04-18T21:05:37.224 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027983238000000001 2024-04-18T21:05:37.224 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.225 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.225 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:37.225 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643868+0000", 2024-04-18T21:05:37.225 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000214305 2024-04-18T21:05:37.225 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.225 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.225 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:37.225 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:05:37.225 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035892200000000002 2024-04-18T21:05:37.225 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.225 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.225 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:37.225 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646056+0000", 2024-04-18T21:05:37.225 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001829172 2024-04-18T21:05:37.226 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.226 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.226 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:37.226 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651406+0000", 2024-04-18T21:05:37.226 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0053504800000000003 2024-04-18T21:05:37.226 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.226 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.226 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:37.226 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651551+0000", 2024-04-18T21:05:37.226 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014427999999999999 2024-04-18T21:05:37.226 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.226 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.226 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:37.226 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651660+0000", 2024-04-18T21:05:37.227 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109477 2024-04-18T21:05:37.227 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:37.227 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:37.227 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:37.227 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.227 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.227 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:37.227 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:05:37.227 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 31.598348701999999, 2024-04-18T21:05:37.227 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045668994999999997, 2024-04-18T21:05:37.227 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:37.227 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:37.227 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.227 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:37.227 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.228 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:37.228 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:05:37.228 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:37.228 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.228 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.228 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:37.228 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:05:37.228 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:37.228 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.228 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.228 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:37.228 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615459+0000", 2024-04-18T21:05:37.228 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5030000000000001e-06 2024-04-18T21:05:37.229 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.229 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.229 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:37.229 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615506+0000", 2024-04-18T21:05:37.229 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6872000000000001e-05 2024-04-18T21:05:37.229 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.229 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.229 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:37.229 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615527+0000", 2024-04-18T21:05:37.229 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0763000000000001e-05 2024-04-18T21:05:37.229 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.229 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.229 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.229 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615551+0000", 2024-04-18T21:05:37.229 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4159e-05 2024-04-18T21:05:37.230 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.230 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.230 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:37.230 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615736+0000", 2024-04-18T21:05:37.230 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018499599999999999 2024-04-18T21:05:37.230 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.230 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.230 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:37.230 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615748+0000", 2024-04-18T21:05:37.230 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2272999999999999e-05 2024-04-18T21:05:37.230 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.230 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.230 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:37.230 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635481+0000", 2024-04-18T21:05:37.231 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019732772999999999 2024-04-18T21:05:37.231 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.231 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.231 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:37.231 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635791+0000", 2024-04-18T21:05:37.231 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031013299999999998 2024-04-18T21:05:37.231 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.231 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.231 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:37.231 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636101+0000", 2024-04-18T21:05:37.231 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030943300000000002 2024-04-18T21:05:37.231 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.231 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.231 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:37.231 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646043+0000", 2024-04-18T21:05:37.231 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099428139999999995 2024-04-18T21:05:37.232 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.232 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.232 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:37.232 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660991+0000", 2024-04-18T21:05:37.232 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014947142 2024-04-18T21:05:37.232 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.232 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.232 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:37.232 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661061+0000", 2024-04-18T21:05:37.232 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0438000000000006e-05 2024-04-18T21:05:37.232 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.232 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.232 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:37.232 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661127+0000", 2024-04-18T21:05:37.233 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5696000000000003e-05 2024-04-18T21:05:37.233 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:37.233 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:37.233 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:37.233 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.233 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.233 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:37.233 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:37.233 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 31.598136274000002, 2024-04-18T21:05:37.233 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045745085999999997, 2024-04-18T21:05:37.233 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:37.233 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:37.233 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.233 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:37.234 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.234 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:37.234 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:37.234 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:37.234 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.234 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.234 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:37.234 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:37.234 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:37.234 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.234 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.234 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:37.234 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:05:37.234 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7400000000000001e-06 2024-04-18T21:05:37.234 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.235 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.235 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:37.235 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:05:37.235 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8133e-05 2024-04-18T21:05:37.235 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.235 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.235 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:37.235 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615726+0000", 2024-04-18T21:05:37.235 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6132e-05 2024-04-18T21:05:37.235 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.235 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.235 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.235 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615742+0000", 2024-04-18T21:05:37.235 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6157000000000001e-05 2024-04-18T21:05:37.236 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.236 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.236 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:37.236 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615937+0000", 2024-04-18T21:05:37.236 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000194768 2024-04-18T21:05:37.236 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.236 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.236 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:37.236 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615950+0000", 2024-04-18T21:05:37.236 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3084e-05 2024-04-18T21:05:37.236 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.236 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.236 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:37.236 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643676+0000", 2024-04-18T21:05:37.237 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027725639999999999 2024-04-18T21:05:37.237 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.237 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.237 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:37.237 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643867+0000", 2024-04-18T21:05:37.237 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019075900000000001 2024-04-18T21:05:37.237 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.237 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.237 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:37.237 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:05:37.237 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036013799999999997 2024-04-18T21:05:37.237 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.237 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.237 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:37.237 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646068+0000", 2024-04-18T21:05:37.238 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001841536 2024-04-18T21:05:37.238 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.238 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.238 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:37.238 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661184+0000", 2024-04-18T21:05:37.238 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015115458999999999 2024-04-18T21:05:37.238 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.238 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.238 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:37.238 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661283+0000", 2024-04-18T21:05:37.238 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9502999999999999e-05 2024-04-18T21:05:37.238 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.238 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.238 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:37.239 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661415+0000", 2024-04-18T21:05:37.239 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000132037 2024-04-18T21:05:37.239 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:37.239 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:37.239 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:37.239 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.239 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.239 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:37.239 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:05:37.239 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 31.598014587000002, 2024-04-18T21:05:37.239 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036185947000000003, 2024-04-18T21:05:37.239 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:37.239 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:37.239 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.240 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:37.240 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.240 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:37.240 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:05:37.240 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:37.240 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.240 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.240 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:37.240 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:05:37.240 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:37.240 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.240 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.240 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:37.240 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615794+0000", 2024-04-18T21:05:37.240 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6440000000000001e-06 2024-04-18T21:05:37.241 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.241 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.241 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:37.241 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615803+0000", 2024-04-18T21:05:37.241 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1220000000000001e-06 2024-04-18T21:05:37.241 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.241 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.241 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:37.241 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615827+0000", 2024-04-18T21:05:37.241 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3997000000000001e-05 2024-04-18T21:05:37.241 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.241 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.241 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.241 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615899+0000", 2024-04-18T21:05:37.242 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2741e-05 2024-04-18T21:05:37.242 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.242 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.242 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:37.242 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616019+0000", 2024-04-18T21:05:37.242 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119874 2024-04-18T21:05:37.242 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.242 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.242 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:37.242 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616029+0000", 2024-04-18T21:05:37.242 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:05:37.242 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.242 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.242 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:37.242 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644823+0000", 2024-04-18T21:05:37.243 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.028793151999999999 2024-04-18T21:05:37.243 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.243 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.243 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:37.243 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645106+0000", 2024-04-18T21:05:37.243 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028379700000000002 2024-04-18T21:05:37.243 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.243 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.243 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:37.243 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645294+0000", 2024-04-18T21:05:37.243 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000187181 2024-04-18T21:05:37.243 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.243 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.243 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:37.243 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646763+0000", 2024-04-18T21:05:37.243 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0014691050000000001 2024-04-18T21:05:37.244 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.244 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.244 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:37.244 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651784+0000", 2024-04-18T21:05:37.244 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050211650000000002 2024-04-18T21:05:37.244 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.244 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.244 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:37.244 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651876+0000", 2024-04-18T21:05:37.244 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2503999999999994e-05 2024-04-18T21:05:37.244 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.244 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.244 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:37.244 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651978+0000", 2024-04-18T21:05:37.245 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000101475 2024-04-18T21:05:37.245 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:37.245 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:37.245 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:37.245 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.245 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.245 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:37.245 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:37.245 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 31.597865980000002, 2024-04-18T21:05:37.245 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032262322000000003, 2024-04-18T21:05:37.245 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:37.245 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:37.245 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.245 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:37.246 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.246 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:37.246 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:37.246 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:37.246 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.246 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.246 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:37.246 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:37.246 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:37.246 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.246 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.246 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:37.246 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615943+0000", 2024-04-18T21:05:37.247 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1959999999999998e-06 2024-04-18T21:05:37.247 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.247 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.247 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:37.247 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615956+0000", 2024-04-18T21:05:37.247 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3424000000000001e-05 2024-04-18T21:05:37.247 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.247 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.247 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:37.247 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615983+0000", 2024-04-18T21:05:37.247 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7072000000000001e-05 2024-04-18T21:05:37.247 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.247 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.247 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.247 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616006+0000", 2024-04-18T21:05:37.248 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2823000000000002e-05 2024-04-18T21:05:37.248 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.248 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.248 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:37.248 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616156+0000", 2024-04-18T21:05:37.248 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014962299999999999 2024-04-18T21:05:37.248 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.248 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.248 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:37.248 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616174+0000", 2024-04-18T21:05:37.248 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8082999999999999e-05 2024-04-18T21:05:37.248 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.248 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.248 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:37.248 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.629952+0000", 2024-04-18T21:05:37.249 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013778514 2024-04-18T21:05:37.249 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.249 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.249 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:37.249 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630201+0000", 2024-04-18T21:05:37.249 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024918100000000001 2024-04-18T21:05:37.249 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.249 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.249 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:37.249 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630386+0000", 2024-04-18T21:05:37.249 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018436900000000001 2024-04-18T21:05:37.249 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.249 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.249 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:37.249 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643169+0000", 2024-04-18T21:05:37.250 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012782774 2024-04-18T21:05:37.250 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.250 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.250 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:37.250 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.647924+0000", 2024-04-18T21:05:37.250 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004755787 2024-04-18T21:05:37.250 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.250 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.250 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:37.250 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648069+0000", 2024-04-18T21:05:37.250 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014459600000000001 2024-04-18T21:05:37.250 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.250 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.250 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:37.251 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648203+0000", 2024-04-18T21:05:37.251 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013388000000000001 2024-04-18T21:05:37.251 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:37.251 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:37.251 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:37.251 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.251 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.251 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:37.251 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:05:37.251 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 31.597757716, 2024-04-18T21:05:37.251 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032489736999999998, 2024-04-18T21:05:37.251 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:37.251 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:37.251 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:37.251 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:37.252 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.252 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:37.252 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:05:37.252 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:37.252 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.252 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.252 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:37.252 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:05:37.252 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:37.252 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.252 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.252 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:37.252 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616050+0000", 2024-04-18T21:05:37.252 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.606e-06 2024-04-18T21:05:37.252 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.253 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.253 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:37.253 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616061+0000", 2024-04-18T21:05:37.253 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0463e-05 2024-04-18T21:05:37.253 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.253 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.253 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:37.253 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616092+0000", 2024-04-18T21:05:37.253 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1415999999999999e-05 2024-04-18T21:05:37.253 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.253 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.253 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.253 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616109+0000", 2024-04-18T21:05:37.253 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6557000000000001e-05 2024-04-18T21:05:37.253 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.254 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.254 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:37.254 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616358+0000", 2024-04-18T21:05:37.254 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000249077 2024-04-18T21:05:37.254 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.254 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.254 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:37.254 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616370+0000", 2024-04-18T21:05:37.254 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2037e-05 2024-04-18T21:05:37.254 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.254 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.254 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:37.254 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.634920+0000", 2024-04-18T21:05:37.254 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018550397 2024-04-18T21:05:37.255 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.255 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.255 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:37.255 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640420+0000", 2024-04-18T21:05:37.255 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055000539999999999 2024-04-18T21:05:37.255 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.255 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.255 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:37.255 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648538+0000", 2024-04-18T21:05:37.255 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0081181299999999994 2024-04-18T21:05:37.255 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:37.255 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:37.255 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:37.255 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.255 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.256 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:37.256 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:05:37.256 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 31.597673395000001, 2024-04-18T21:05:37.256 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036090029000000003, 2024-04-18T21:05:37.256 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:37.256 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:37.256 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:37.256 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:37.256 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.256 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:37.256 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:05:37.256 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:37.256 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.256 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.257 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:37.257 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:05:37.257 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:37.257 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.257 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.257 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:37.257 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616134+0000", 2024-04-18T21:05:37.257 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.353e-06 2024-04-18T21:05:37.257 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.257 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.257 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:37.257 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616141+0000", 2024-04-18T21:05:37.257 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2770000000000002e-06 2024-04-18T21:05:37.257 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.257 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.257 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:37.258 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616160+0000", 2024-04-18T21:05:37.258 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.91e-05 2024-04-18T21:05:37.258 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.258 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.258 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.258 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616170+0000", 2024-04-18T21:05:37.258 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7699999999999996e-06 2024-04-18T21:05:37.258 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.258 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.258 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:37.258 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616275+0000", 2024-04-18T21:05:37.258 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105313 2024-04-18T21:05:37.258 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.258 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.259 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:37.259 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616288+0000", 2024-04-18T21:05:37.259 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3027000000000001e-05 2024-04-18T21:05:37.259 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.259 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.259 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:37.259 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646160+0000", 2024-04-18T21:05:37.259 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.029872019 2024-04-18T21:05:37.259 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.259 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.259 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:37.259 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646368+0000", 2024-04-18T21:05:37.259 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020811899999999999 2024-04-18T21:05:37.259 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.260 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.260 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:37.260 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652223+0000", 2024-04-18T21:05:37.260 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.005855051 2024-04-18T21:05:37.260 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:37.260 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:37.260 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:37.260 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.260 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.260 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:37.260 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:05:37.260 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 31.597615825999998, 2024-04-18T21:05:37.260 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043572403000000003, 2024-04-18T21:05:37.260 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:37.260 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:37.260 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:37.261 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:37.261 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.261 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:37.261 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:05:37.261 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:37.261 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.261 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.261 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:37.261 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:05:37.261 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:37.261 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.261 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.261 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:37.261 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616192+0000", 2024-04-18T21:05:37.261 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:05:37.262 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.262 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.262 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:37.262 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616203+0000", 2024-04-18T21:05:37.262 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0890000000000001e-05 2024-04-18T21:05:37.262 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.262 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.262 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:37.262 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616223+0000", 2024-04-18T21:05:37.262 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0409000000000001e-05 2024-04-18T21:05:37.262 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.262 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.262 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.262 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616238+0000", 2024-04-18T21:05:37.263 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5160000000000001e-05 2024-04-18T21:05:37.263 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.263 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.263 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:37.263 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616343+0000", 2024-04-18T21:05:37.263 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000104831 2024-04-18T21:05:37.263 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.263 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.263 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:37.263 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616357+0000", 2024-04-18T21:05:37.263 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3686000000000001e-05 2024-04-18T21:05:37.263 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.263 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.263 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:37.263 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635912+0000", 2024-04-18T21:05:37.264 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019554944000000001 2024-04-18T21:05:37.264 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.264 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.264 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:37.264 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636231+0000", 2024-04-18T21:05:37.264 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000318766 2024-04-18T21:05:37.264 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.264 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.264 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:37.264 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659763+0000", 2024-04-18T21:05:37.264 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023532474000000001 2024-04-18T21:05:37.264 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:37.264 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:37.264 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:37.264 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.265 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.265 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:37.265 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:05:37.265 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 31.593687118999998, 2024-04-18T21:05:37.265 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015007971, 2024-04-18T21:05:37.265 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:37.265 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:37.265 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.265 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:37.265 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.265 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:37.265 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:05:37.265 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:37.265 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.265 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.266 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:37.266 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:05:37.266 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:37.266 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.266 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.266 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:37.266 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620120+0000", 2024-04-18T21:05:37.266 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0359999999999999e-06 2024-04-18T21:05:37.266 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.266 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.266 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:37.266 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620157+0000", 2024-04-18T21:05:37.266 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6636e-05 2024-04-18T21:05:37.266 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.266 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.267 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:37.267 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620177+0000", 2024-04-18T21:05:37.267 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0247000000000001e-05 2024-04-18T21:05:37.267 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.267 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.267 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.267 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620195+0000", 2024-04-18T21:05:37.267 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7819e-05 2024-04-18T21:05:37.267 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.267 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.267 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:37.267 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620342+0000", 2024-04-18T21:05:37.267 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014643300000000001 2024-04-18T21:05:37.267 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.268 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.268 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:37.268 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620405+0000", 2024-04-18T21:05:37.268 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3522000000000006e-05 2024-04-18T21:05:37.268 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.268 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.268 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:37.268 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635016+0000", 2024-04-18T21:05:37.268 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014610840999999999 2024-04-18T21:05:37.268 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.268 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.268 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:37.268 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635127+0000", 2024-04-18T21:05:37.268 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111437 2024-04-18T21:05:37.269 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:37.269 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:37.269 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:37.269 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.269 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.269 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:37.269 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:05:37.269 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 31.593579851000001, 2024-04-18T21:05:37.269 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012693296, 2024-04-18T21:05:37.269 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:37.269 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:37.269 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.269 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:37.269 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.269 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:37.270 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:05:37.270 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:37.270 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.270 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.270 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:37.270 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:05:37.270 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:37.270 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.270 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.270 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:37.270 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620228+0000", 2024-04-18T21:05:37.270 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:05:37.270 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.270 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.271 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:37.271 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620236+0000", 2024-04-18T21:05:37.271 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.303e-06 2024-04-18T21:05:37.271 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.271 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.271 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:37.271 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620255+0000", 2024-04-18T21:05:37.271 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9406e-05 2024-04-18T21:05:37.271 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.271 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.271 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.271 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620274+0000", 2024-04-18T21:05:37.271 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8940000000000002e-05 2024-04-18T21:05:37.271 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.272 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.272 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:37.272 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:05:37.272 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001558753 2024-04-18T21:05:37.272 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.272 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.272 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:37.272 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621879+0000", 2024-04-18T21:05:37.272 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6359000000000001e-05 2024-04-18T21:05:37.272 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.272 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.272 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:37.272 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632841+0000", 2024-04-18T21:05:37.272 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010961907 2024-04-18T21:05:37.272 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.273 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.273 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:37.273 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632920+0000", 2024-04-18T21:05:37.273 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8714999999999994e-05 2024-04-18T21:05:37.273 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:37.273 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:37.273 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:37.273 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.273 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.273 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:37.273 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:05:37.273 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 31.592034087999998, 2024-04-18T21:05:37.273 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013445702, 2024-04-18T21:05:37.273 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:37.273 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:37.274 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.274 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:37.274 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.274 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:37.274 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:05:37.274 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:37.274 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.274 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.274 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:37.274 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:05:37.274 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:37.274 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.274 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.274 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:37.275 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621774+0000", 2024-04-18T21:05:37.275 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2500000000000001e-06 2024-04-18T21:05:37.275 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.275 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.275 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:37.275 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621786+0000", 2024-04-18T21:05:37.275 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2636000000000001e-05 2024-04-18T21:05:37.275 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.275 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.275 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:37.275 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621814+0000", 2024-04-18T21:05:37.275 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7823000000000001e-05 2024-04-18T21:05:37.275 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.275 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.275 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.276 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621844+0000", 2024-04-18T21:05:37.276 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9589000000000001e-05 2024-04-18T21:05:37.276 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.276 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.276 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:37.276 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622253+0000", 2024-04-18T21:05:37.276 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040963700000000002 2024-04-18T21:05:37.276 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.276 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.276 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:37.276 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622304+0000", 2024-04-18T21:05:37.276 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0868999999999997e-05 2024-04-18T21:05:37.276 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.276 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.276 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:37.277 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635133+0000", 2024-04-18T21:05:37.277 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012829136 2024-04-18T21:05:37.277 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.277 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.277 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:37.277 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635218+0000", 2024-04-18T21:05:37.277 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4761999999999999e-05 2024-04-18T21:05:37.277 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:37.277 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:37.277 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:37.277 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.277 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.277 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:37.277 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:05:37.278 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 31.591907328000001, 2024-04-18T21:05:37.278 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014162065, 2024-04-18T21:05:37.278 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:37.278 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:37.278 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.278 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:37.278 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.278 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:37.278 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:05:37.278 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:37.278 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.278 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.278 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:37.279 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:05:37.279 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:37.279 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.279 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.279 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:37.279 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621900+0000", 2024-04-18T21:05:37.279 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:05:37.279 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.279 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.279 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:37.279 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621910+0000", 2024-04-18T21:05:37.279 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0207000000000001e-05 2024-04-18T21:05:37.279 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.279 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.279 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:37.280 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621932+0000", 2024-04-18T21:05:37.280 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1789000000000001e-05 2024-04-18T21:05:37.280 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.280 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.280 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.280 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621946+0000", 2024-04-18T21:05:37.280 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4212999999999999e-05 2024-04-18T21:05:37.280 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.280 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.280 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:37.280 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624477+0000", 2024-04-18T21:05:37.280 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025303470000000001 2024-04-18T21:05:37.280 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.280 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.281 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:37.281 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624525+0000", 2024-04-18T21:05:37.281 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8084999999999998e-05 2024-04-18T21:05:37.281 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.281 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.281 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:37.281 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635976+0000", 2024-04-18T21:05:37.281 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.011451368999999999 2024-04-18T21:05:37.281 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.281 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.281 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:37.281 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636061+0000", 2024-04-18T21:05:37.281 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5094999999999998e-05 2024-04-18T21:05:37.281 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:37.281 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:37.282 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:37.282 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.282 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.282 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:05:37.282 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:05:37.282 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 31.582671702999999, 2024-04-18T21:05:37.282 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0098014739999999993, 2024-04-18T21:05:37.282 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:37.282 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:37.282 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:05:37.282 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:37.282 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.282 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:37.282 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:05:37.282 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:37.283 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.283 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.283 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:37.283 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:05:37.283 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:37.283 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.283 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.283 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:37.283 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631136+0000", 2024-04-18T21:05:37.283 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0139999999999999e-06 2024-04-18T21:05:37.283 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.283 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.283 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:37.283 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631152+0000", 2024-04-18T21:05:37.283 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6365999999999999e-05 2024-04-18T21:05:37.283 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.284 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.284 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:37.284 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631961+0000", 2024-04-18T21:05:37.284 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00080873100000000003 2024-04-18T21:05:37.284 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.284 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.284 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.284 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632021+0000", 2024-04-18T21:05:37.284 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0541999999999997e-05 2024-04-18T21:05:37.284 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.284 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.284 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:37.284 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633539+0000", 2024-04-18T21:05:37.284 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015175639999999999 2024-04-18T21:05:37.285 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.285 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.285 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:37.285 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640936+0000", 2024-04-18T21:05:37.285 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007397257 2024-04-18T21:05:37.285 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:37.285 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:37.285 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:37.285 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.285 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.285 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-18T21:05:37.285 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:05:37.285 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 31.565210270000001, 2024-04-18T21:05:37.285 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00073592199999999997, 2024-04-18T21:05:37.285 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:37.285 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:37.285 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:37.286 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:37.286 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.286 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:37.286 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:05:37.286 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:37.286 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.286 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.286 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:37.286 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:05:37.286 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:37.286 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.286 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.286 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:37.286 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648597+0000", 2024-04-18T21:05:37.287 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:05:37.287 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.287 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.287 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:37.287 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648605+0000", 2024-04-18T21:05:37.287 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3960000000000006e-06 2024-04-18T21:05:37.287 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.287 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.287 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:37.287 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648625+0000", 2024-04-18T21:05:37.287 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9987e-05 2024-04-18T21:05:37.287 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.287 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.287 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.288 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648643+0000", 2024-04-18T21:05:37.288 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7079e-05 2024-04-18T21:05:37.288 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.288 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.288 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:37.288 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649043+0000", 2024-04-18T21:05:37.288 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040083399999999998 2024-04-18T21:05:37.288 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.288 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.288 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:37.288 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649062+0000", 2024-04-18T21:05:37.288 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9052999999999999e-05 2024-04-18T21:05:37.288 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.288 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.289 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:37.289 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649332+0000", 2024-04-18T21:05:37.289 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026971999999999999 2024-04-18T21:05:37.289 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:37.289 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:37.289 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:37.289 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.289 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.289 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:05:37.289 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:05:37.289 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 31.562435368999999, 2024-04-18T21:05:37.289 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00086123999999999999, 2024-04-18T21:05:37.289 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:37.289 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:37.289 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:05:37.289 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:37.290 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.290 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:37.290 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:05:37.290 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:37.290 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.290 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.290 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:37.290 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:05:37.290 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:37.290 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.290 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.290 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:37.290 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651372+0000", 2024-04-18T21:05:37.290 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7599999999999997e-07 2024-04-18T21:05:37.291 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.291 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.291 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:37.291 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651377+0000", 2024-04-18T21:05:37.291 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.22e-06 2024-04-18T21:05:37.291 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.291 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.291 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:37.291 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651394+0000", 2024-04-18T21:05:37.291 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6646999999999998e-05 2024-04-18T21:05:37.291 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.291 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.291 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.291 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651427+0000", 2024-04-18T21:05:37.292 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3682e-05 2024-04-18T21:05:37.292 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.292 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.292 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:37.292 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652029+0000", 2024-04-18T21:05:37.292 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00060152199999999995 2024-04-18T21:05:37.292 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.292 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.292 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:37.292 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652232+0000", 2024-04-18T21:05:37.292 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020359299999999999 2024-04-18T21:05:37.292 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:37.292 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:37.292 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:37.292 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.293 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.293 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:05:37.293 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:05:37.293 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 31.554408407, 2024-04-18T21:05:37.293 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0017426200000000001, 2024-04-18T21:05:37.293 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:37.293 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:37.293 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:37.293 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:37.293 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.293 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:37.293 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:05:37.293 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:37.293 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.293 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.294 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:37.294 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:05:37.294 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:37.294 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.294 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.294 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:37.294 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659399+0000", 2024-04-18T21:05:37.294 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6000000000000002e-07 2024-04-18T21:05:37.294 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.294 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.294 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:37.294 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659405+0000", 2024-04-18T21:05:37.294 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5069999999999997e-06 2024-04-18T21:05:37.294 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.295 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.295 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:37.295 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659425+0000", 2024-04-18T21:05:37.295 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.927e-05 2024-04-18T21:05:37.295 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.295 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.295 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.295 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659443+0000", 2024-04-18T21:05:37.295 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8051999999999999e-05 2024-04-18T21:05:37.295 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.295 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.295 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:37.295 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660973+0000", 2024-04-18T21:05:37.296 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001530106 2024-04-18T21:05:37.296 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.296 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.296 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:37.296 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660983+0000", 2024-04-18T21:05:37.296 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0516999999999999e-05 2024-04-18T21:05:37.296 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.296 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.296 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:37.296 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661141+0000", 2024-04-18T21:05:37.296 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015730799999999999 2024-04-18T21:05:37.296 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:37.296 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:37.296 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:37.296 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.297 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.297 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:05:37.297 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:05:37.297 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 31.554191782, 2024-04-18T21:05:37.297 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001812311, 2024-04-18T21:05:37.297 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:37.297 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:37.297 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:37.297 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:37.297 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.297 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:37.297 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:05:37.297 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:37.297 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.298 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.298 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:37.298 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:05:37.298 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:37.298 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.298 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.298 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:37.298 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659616+0000", 2024-04-18T21:05:37.298 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.277e-06 2024-04-18T21:05:37.298 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.298 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.298 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:37.298 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659625+0000", 2024-04-18T21:05:37.298 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5359999999999998e-06 2024-04-18T21:05:37.299 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.299 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.299 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:37.299 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659647+0000", 2024-04-18T21:05:37.299 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1857000000000001e-05 2024-04-18T21:05:37.299 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.299 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.299 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.299 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659664+0000", 2024-04-18T21:05:37.299 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6405999999999998e-05 2024-04-18T21:05:37.299 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.299 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.299 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:37.299 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661169+0000", 2024-04-18T21:05:37.299 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015054179999999999 2024-04-18T21:05:37.300 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.300 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.300 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:37.300 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661177+0000", 2024-04-18T21:05:37.300 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9680000000000006e-06 2024-04-18T21:05:37.300 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.300 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.300 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:37.300 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661427+0000", 2024-04-18T21:05:37.300 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024984900000000001 2024-04-18T21:05:37.300 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:37.300 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:37.300 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:37.300 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.300 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.301 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-18T21:05:37.301 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:05:37.301 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 29.601271174000001, 2024-04-18T21:05:37.301 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0030975030000000001, 2024-04-18T21:05:37.301 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:37.301 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:37.301 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.301 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:37.301 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.301 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:37.301 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:05:37.301 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:37.301 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.301 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.302 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:37.302 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:05:37.302 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:37.302 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.302 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.302 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:37.302 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612538+0000", 2024-04-18T21:05:37.302 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6259999999999999e-06 2024-04-18T21:05:37.302 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.302 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.302 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:37.302 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612552+0000", 2024-04-18T21:05:37.302 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4073999999999999e-05 2024-04-18T21:05:37.302 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.302 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.303 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:37.303 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612585+0000", 2024-04-18T21:05:37.303 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3504999999999999e-05 2024-04-18T21:05:37.303 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.303 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.303 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.303 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612601+0000", 2024-04-18T21:05:37.303 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5194000000000001e-05 2024-04-18T21:05:37.303 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.303 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.303 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:37.303 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612746+0000", 2024-04-18T21:05:37.303 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145666 2024-04-18T21:05:37.303 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.304 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.304 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:37.304 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612953+0000", 2024-04-18T21:05:37.304 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000207109 2024-04-18T21:05:37.304 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.304 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.304 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:37.304 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.613134+0000", 2024-04-18T21:05:37.304 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018041300000000001 2024-04-18T21:05:37.304 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.304 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.304 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:37.304 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.614411+0000", 2024-04-18T21:05:37.304 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0012769929999999999 2024-04-18T21:05:37.304 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.304 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.305 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:37.305 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615441+0000", 2024-04-18T21:05:37.305 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001029917 2024-04-18T21:05:37.305 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.305 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.305 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:37.305 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615522+0000", 2024-04-18T21:05:37.305 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1142000000000003e-05 2024-04-18T21:05:37.305 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.305 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.305 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:37.305 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615633+0000", 2024-04-18T21:05:37.305 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000110864 2024-04-18T21:05:37.305 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:37.305 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:37.305 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:37.306 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.306 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.306 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-18T21:05:37.306 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:05:37.306 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 11.598985363000001, 2024-04-18T21:05:37.306 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088979039999999999, 2024-04-18T21:05:37.306 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:37.306 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:37.306 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.306 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:37.306 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.306 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:37.306 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:05:37.306 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:37.306 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.307 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.307 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:37.307 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:05:37.307 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:37.307 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.307 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.307 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:37.307 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614825+0000", 2024-04-18T21:05:37.307 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4829999999999999e-06 2024-04-18T21:05:37.307 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.307 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.307 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:37.307 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614843+0000", 2024-04-18T21:05:37.308 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8777e-05 2024-04-18T21:05:37.308 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.308 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.308 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:37.308 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614884+0000", 2024-04-18T21:05:37.308 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1051999999999999e-05 2024-04-18T21:05:37.308 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.308 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.308 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.308 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614903+0000", 2024-04-18T21:05:37.308 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9069999999999999e-05 2024-04-18T21:05:37.308 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.308 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.308 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:37.308 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615047+0000", 2024-04-18T21:05:37.309 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014374400000000001 2024-04-18T21:05:37.309 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.309 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.309 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:37.309 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615061+0000", 2024-04-18T21:05:37.309 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4063000000000001e-05 2024-04-18T21:05:37.309 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.309 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.309 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:37.309 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621064+0000", 2024-04-18T21:05:37.309 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0060029200000000001 2024-04-18T21:05:37.309 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.309 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.309 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:37.310 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621211+0000", 2024-04-18T21:05:37.310 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000147224 2024-04-18T21:05:37.310 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.310 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.310 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:37.310 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621396+0000", 2024-04-18T21:05:37.310 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018454699999999999 2024-04-18T21:05:37.310 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.310 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.310 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:37.310 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.622517+0000", 2024-04-18T21:05:37.310 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001121424 2024-04-18T21:05:37.310 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.310 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.310 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:37.311 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623571+0000", 2024-04-18T21:05:37.311 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010538660000000001 2024-04-18T21:05:37.311 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.311 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.311 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:37.311 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623658+0000", 2024-04-18T21:05:37.311 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6439000000000004e-05 2024-04-18T21:05:37.311 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:37.311 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:37.311 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:37.311 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623719+0000", 2024-04-18T21:05:37.311 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1295000000000002e-05 2024-04-18T21:05:37.311 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:37.311 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:37.311 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:37.312 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:37.312 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:37.312 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:05:37.312 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-18T21:05:37.312 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-18T21:05:37.312 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-04-18T21:05:37.312 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-18T21:05:37.313 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-18T21:05:37.313 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-04-18T21:05:37.314 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:37.315+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:37.314 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:05:37.414 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:37.411+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:37.443 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:05:37.443 INFO:teuthology.orchestra.run.smithi132.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-18T21:05:37.443 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:05:37.449 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:05:37.449 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:05:37.449 INFO:teuthology.orchestra.run.smithi132.stdout: "num_ops": 0 2024-04-18T21:05:37.449 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:05:37.465 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:05:37.514 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:37.515+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:37.615 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:37.615+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:37.628 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:05:37.628 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:05:37.628 INFO:teuthology.orchestra.run.smithi132.stdout: "complaint_time": 30, 2024-04-18T21:05:37.628 INFO:teuthology.orchestra.run.smithi132.stdout: "num_blocked_ops": 0 2024-04-18T21:05:37.628 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:05:37.642 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:05:37.716 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:37.715+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:37.769 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:05:37.769 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 20, 2024-04-18T21:05:37.769 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 600, 2024-04-18T21:05:37.769 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [ 2024-04-18T21:05:37.769 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.769 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:37.769 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:05:37.770 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 42.856781542999997, 2024-04-18T21:05:37.770 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.02518273, 2024-04-18T21:05:37.770 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:37.770 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:37.770 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.770 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:37.770 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:37.770 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:37.770 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 141 2024-04-18T21:05:37.770 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.770 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:37.770 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.770 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:37.771 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:05:37.771 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:37.771 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.771 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.771 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:37.771 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:05:37.771 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:37.771 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.771 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.771 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:37.771 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911562+0000", 2024-04-18T21:05:37.771 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9300000000000006e-07 2024-04-18T21:05:37.771 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.771 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.772 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:37.772 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911569+0000", 2024-04-18T21:05:37.772 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0169999999999999e-06 2024-04-18T21:05:37.772 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.772 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.772 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:37.772 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911582+0000", 2024-04-18T21:05:37.772 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.343e-05 2024-04-18T21:05:37.772 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.772 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.772 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.772 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911590+0000", 2024-04-18T21:05:37.772 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.413e-06 2024-04-18T21:05:37.773 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.773 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.773 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:37.773 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.933922+0000", 2024-04-18T21:05:37.773 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.022332093000000001 2024-04-18T21:05:37.773 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.773 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.773 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:37.773 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.934155+0000", 2024-04-18T21:05:37.773 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023378900000000001 2024-04-18T21:05:37.773 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.773 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.773 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:37.773 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.934514+0000", 2024-04-18T21:05:37.773 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00035859200000000003 2024-04-18T21:05:37.773 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.774 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.774 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:37.774 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.935973+0000", 2024-04-18T21:05:37.774 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001458705 2024-04-18T21:05:37.774 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.774 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.774 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:37.774 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936488+0000", 2024-04-18T21:05:37.774 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00051550000000000001 2024-04-18T21:05:37.774 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.774 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.774 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:37.774 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936636+0000", 2024-04-18T21:05:37.774 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014779800000000001 2024-04-18T21:05:37.774 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.775 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.775 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:37.775 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936743+0000", 2024-04-18T21:05:37.775 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010739999999999999 2024-04-18T21:05:37.775 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:37.775 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:37.775 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:37.775 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.775 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.775 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:37.775 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:05:37.775 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 42.739582569, 2024-04-18T21:05:37.775 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023654959999999999, 2024-04-18T21:05:37.775 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:37.775 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:37.775 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.776 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:37.776 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:37.776 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:37.776 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 163 2024-04-18T21:05:37.776 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.776 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:37.776 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.776 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:37.776 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:05:37.776 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:37.776 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.776 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.776 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:37.776 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:05:37.776 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:37.777 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.777 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.777 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:37.777 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:05:37.777 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0999999999999998e-07 2024-04-18T21:05:37.777 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.777 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.777 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:37.777 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028766+0000", 2024-04-18T21:05:37.777 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4700000000000001e-06 2024-04-18T21:05:37.777 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.777 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.777 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:37.778 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028775+0000", 2024-04-18T21:05:37.778 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.3190000000000001e-06 2024-04-18T21:05:37.778 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.778 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.778 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.778 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028782+0000", 2024-04-18T21:05:37.778 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.2300000000000002e-06 2024-04-18T21:05:37.778 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.778 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.778 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:37.778 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046667+0000", 2024-04-18T21:05:37.778 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017884356000000001 2024-04-18T21:05:37.778 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.778 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.779 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:37.779 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046788+0000", 2024-04-18T21:05:37.779 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012125000000000001 2024-04-18T21:05:37.779 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.779 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.779 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:37.779 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046982+0000", 2024-04-18T21:05:37.779 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019394 2024-04-18T21:05:37.779 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.779 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.779 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:37.779 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051969+0000", 2024-04-18T21:05:37.779 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0049868150000000003 2024-04-18T21:05:37.780 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.780 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.780 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:37.780 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052089+0000", 2024-04-18T21:05:37.780 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011993 2024-04-18T21:05:37.780 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.780 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.780 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:37.780 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052292+0000", 2024-04-18T21:05:37.780 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020345699999999999 2024-04-18T21:05:37.780 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.780 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.780 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:37.780 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052415+0000", 2024-04-18T21:05:37.781 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000122483 2024-04-18T21:05:37.781 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:37.781 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:37.781 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:37.781 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.781 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.781 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:37.781 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:05:37.781 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 42.739548337000002, 2024-04-18T21:05:37.781 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023864586, 2024-04-18T21:05:37.781 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:37.781 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:37.781 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.781 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:37.782 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:37.782 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:37.782 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 164 2024-04-18T21:05:37.782 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.782 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:37.782 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.782 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:37.782 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:05:37.782 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:37.782 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.782 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.782 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:37.782 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:05:37.782 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:37.782 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.783 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.783 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:37.783 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028795+0000", 2024-04-18T21:05:37.783 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7999999999999995e-07 2024-04-18T21:05:37.783 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.783 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.783 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:37.783 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028884+0000", 2024-04-18T21:05:37.783 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8997000000000002e-05 2024-04-18T21:05:37.783 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.783 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.783 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:37.783 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028895+0000", 2024-04-18T21:05:37.783 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1647e-05 2024-04-18T21:05:37.784 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.784 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.784 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.784 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028903+0000", 2024-04-18T21:05:37.784 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.909e-06 2024-04-18T21:05:37.784 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.784 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.784 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:37.784 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.047818+0000", 2024-04-18T21:05:37.784 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018914337 2024-04-18T21:05:37.784 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.784 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.784 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:37.784 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.048094+0000", 2024-04-18T21:05:37.784 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00027653500000000001 2024-04-18T21:05:37.785 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.785 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.785 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:37.785 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.048471+0000", 2024-04-18T21:05:37.785 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00037705799999999999 2024-04-18T21:05:37.785 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.785 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.785 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:37.785 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052516+0000", 2024-04-18T21:05:37.785 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0040452739999999997 2024-04-18T21:05:37.785 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.785 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.785 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:37.785 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052535+0000", 2024-04-18T21:05:37.785 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.84e-05 2024-04-18T21:05:37.785 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.786 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.786 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:37.786 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052603+0000", 2024-04-18T21:05:37.786 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.8095000000000004e-05 2024-04-18T21:05:37.786 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.786 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.786 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:37.786 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052659+0000", 2024-04-18T21:05:37.786 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5653999999999999e-05 2024-04-18T21:05:37.786 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:37.786 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:37.786 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:37.786 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.787 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.787 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:37.787 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:05:37.787 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 42.739424894000003, 2024-04-18T21:05:37.787 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024516458000000001, 2024-04-18T21:05:37.787 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:37.787 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:37.787 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.787 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:37.787 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:37.787 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:37.787 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 165 2024-04-18T21:05:37.787 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.788 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:37.788 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.788 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:37.788 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:05:37.788 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:37.788 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.788 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.788 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:37.788 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:05:37.788 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:37.788 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.788 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.788 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:37.789 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028918+0000", 2024-04-18T21:05:37.789 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8000000000000005e-07 2024-04-18T21:05:37.789 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.789 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.789 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:37.789 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028924+0000", 2024-04-18T21:05:37.789 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5659999999999997e-06 2024-04-18T21:05:37.789 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.789 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.789 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:37.789 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028933+0000", 2024-04-18T21:05:37.789 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.38e-06 2024-04-18T21:05:37.789 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.789 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.790 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.790 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028940+0000", 2024-04-18T21:05:37.790 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0060000000000003e-06 2024-04-18T21:05:37.790 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.790 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.790 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:37.790 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.050846+0000", 2024-04-18T21:05:37.790 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021906119000000002 2024-04-18T21:05:37.790 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.790 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.790 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:37.790 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051025+0000", 2024-04-18T21:05:37.790 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017850799999999999 2024-04-18T21:05:37.790 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.790 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.791 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:37.791 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051221+0000", 2024-04-18T21:05:37.791 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019608700000000001 2024-04-18T21:05:37.791 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.791 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.791 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:37.791 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052675+0000", 2024-04-18T21:05:37.791 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0014537899999999999 2024-04-18T21:05:37.791 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.791 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.791 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:37.791 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053311+0000", 2024-04-18T21:05:37.791 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00063613299999999999 2024-04-18T21:05:37.791 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.791 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.792 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:37.792 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053381+0000", 2024-04-18T21:05:37.792 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0074999999999996e-05 2024-04-18T21:05:37.792 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.792 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.792 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:37.792 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053434+0000", 2024-04-18T21:05:37.792 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3013999999999998e-05 2024-04-18T21:05:37.792 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:37.792 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:37.792 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:37.792 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.792 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.792 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:37.792 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:05:37.792 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 42.626119414999998, 2024-04-18T21:05:37.793 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023772793, 2024-04-18T21:05:37.793 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:37.793 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:37.793 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.793 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:37.793 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:37.793 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:37.793 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 187 2024-04-18T21:05:37.793 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.793 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:37.793 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.793 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:37.793 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:05:37.793 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:37.793 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.793 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.794 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:37.794 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:05:37.794 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:37.794 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.794 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.794 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:37.794 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142224+0000", 2024-04-18T21:05:37.794 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.47e-07 2024-04-18T21:05:37.794 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.794 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.794 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:37.794 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142233+0000", 2024-04-18T21:05:37.794 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0729999999999994e-06 2024-04-18T21:05:37.794 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.794 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.794 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:37.795 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142255+0000", 2024-04-18T21:05:37.795 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.2535999999999999e-05 2024-04-18T21:05:37.795 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.795 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.795 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.795 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142268+0000", 2024-04-18T21:05:37.795 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2686e-05 2024-04-18T21:05:37.795 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.795 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.795 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:37.795 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160497+0000", 2024-04-18T21:05:37.795 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018228779000000001 2024-04-18T21:05:37.795 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.795 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.795 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:37.795 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160634+0000", 2024-04-18T21:05:37.796 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000137315 2024-04-18T21:05:37.796 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.796 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.796 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:37.796 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160831+0000", 2024-04-18T21:05:37.796 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019683100000000001 2024-04-18T21:05:37.796 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.796 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.796 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:37.796 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165129+0000", 2024-04-18T21:05:37.796 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0042981299999999998 2024-04-18T21:05:37.796 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.796 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.796 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:37.796 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165776+0000", 2024-04-18T21:05:37.796 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00064702900000000003 2024-04-18T21:05:37.797 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.797 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.797 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:37.797 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165921+0000", 2024-04-18T21:05:37.797 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014506 2024-04-18T21:05:37.797 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.797 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.797 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:37.797 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165996+0000", 2024-04-18T21:05:37.797 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.4406999999999994e-05 2024-04-18T21:05:37.797 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:37.797 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:37.797 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:37.797 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.797 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.798 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:37.798 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:05:37.798 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 42.626058817000001, 2024-04-18T21:05:37.798 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026802157, 2024-04-18T21:05:37.798 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:37.798 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:37.798 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.798 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:37.798 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:37.798 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:37.798 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 188 2024-04-18T21:05:37.798 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.798 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:37.798 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.799 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:37.799 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:05:37.799 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:37.799 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.799 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.799 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:37.799 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:05:37.799 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:37.799 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.799 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.799 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:37.799 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142284+0000", 2024-04-18T21:05:37.799 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4e-07 2024-04-18T21:05:37.799 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.799 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.800 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:37.800 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142374+0000", 2024-04-18T21:05:37.800 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0099999999999995e-05 2024-04-18T21:05:37.800 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.800 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.800 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:37.800 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142386+0000", 2024-04-18T21:05:37.800 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1770000000000001e-05 2024-04-18T21:05:37.800 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.800 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.800 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.800 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142394+0000", 2024-04-18T21:05:37.800 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.2130000000000008e-06 2024-04-18T21:05:37.800 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.800 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.800 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:37.801 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.161743+0000", 2024-04-18T21:05:37.801 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019348644000000002 2024-04-18T21:05:37.801 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.801 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.801 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:37.801 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.161865+0000", 2024-04-18T21:05:37.801 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012210899999999999 2024-04-18T21:05:37.801 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.801 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.801 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:37.801 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.162055+0000", 2024-04-18T21:05:37.801 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000189994 2024-04-18T21:05:37.801 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.802 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.802 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:37.802 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165735+0000", 2024-04-18T21:05:37.802 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0036803270000000002 2024-04-18T21:05:37.802 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.802 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.802 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:37.802 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.168911+0000", 2024-04-18T21:05:37.802 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0031753689999999999 2024-04-18T21:05:37.802 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.802 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.802 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:37.802 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169012+0000", 2024-04-18T21:05:37.803 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010157699999999999 2024-04-18T21:05:37.803 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.803 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.803 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:37.803 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169086+0000", 2024-04-18T21:05:37.803 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3213999999999994e-05 2024-04-18T21:05:37.803 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:37.803 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:37.803 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:37.803 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.803 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.803 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:37.803 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:05:37.803 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 42.625933510999999, 2024-04-18T21:05:37.804 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026811423000000001, 2024-04-18T21:05:37.804 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:37.804 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:37.804 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.804 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:37.804 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:37.804 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:37.804 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 189 2024-04-18T21:05:37.804 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.804 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:37.804 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.804 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:37.804 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:05:37.804 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:37.804 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.805 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.805 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:37.805 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:05:37.805 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:37.805 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.805 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.805 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:37.805 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142410+0000", 2024-04-18T21:05:37.805 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:05:37.805 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.805 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.805 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:37.805 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142415+0000", 2024-04-18T21:05:37.805 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.7939999999999999e-06 2024-04-18T21:05:37.805 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.805 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.806 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:37.806 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142470+0000", 2024-04-18T21:05:37.806 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4537999999999999e-05 2024-04-18T21:05:37.806 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.806 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.806 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.806 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142481+0000", 2024-04-18T21:05:37.806 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0966e-05 2024-04-18T21:05:37.806 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.806 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.806 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:37.806 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.163493+0000", 2024-04-18T21:05:37.806 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021012444000000002 2024-04-18T21:05:37.806 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.807 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.807 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:37.807 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.163727+0000", 2024-04-18T21:05:37.807 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000233339 2024-04-18T21:05:37.807 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.807 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.807 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:37.807 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.164102+0000", 2024-04-18T21:05:37.807 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000374872 2024-04-18T21:05:37.807 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.807 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.807 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:37.807 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.166528+0000", 2024-04-18T21:05:37.807 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0024258729999999998 2024-04-18T21:05:37.807 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.808 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.808 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:37.808 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169101+0000", 2024-04-18T21:05:37.808 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0025737680000000001 2024-04-18T21:05:37.808 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.808 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.808 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:37.808 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169171+0000", 2024-04-18T21:05:37.808 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0148000000000007e-05 2024-04-18T21:05:37.808 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.808 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.808 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:37.808 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169220+0000", 2024-04-18T21:05:37.809 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8767999999999998e-05 2024-04-18T21:05:37.809 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:37.809 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:37.809 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:37.809 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.809 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.809 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:37.809 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:05:37.809 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 32.152360958999999, 2024-04-18T21:05:37.809 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024082777999999999, 2024-04-18T21:05:37.809 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:37.809 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:37.809 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.809 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:37.809 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.810 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:37.810 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:05:37.810 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:37.810 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.810 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.810 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:37.810 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:05:37.810 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:37.810 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.810 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.810 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:37.810 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615984+0000", 2024-04-18T21:05:37.810 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.9869999999999999e-06 2024-04-18T21:05:37.810 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.811 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.811 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:37.811 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615999+0000", 2024-04-18T21:05:37.811 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4646e-05 2024-04-18T21:05:37.811 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.811 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.811 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:37.811 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616028+0000", 2024-04-18T21:05:37.811 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8952999999999999e-05 2024-04-18T21:05:37.811 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.811 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.811 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.811 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616052+0000", 2024-04-18T21:05:37.812 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.3941999999999999e-05 2024-04-18T21:05:37.812 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.812 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.812 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:37.812 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618010+0000", 2024-04-18T21:05:37.812 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0019581780000000001 2024-04-18T21:05:37.812 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.812 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.812 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:37.812 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618322+0000", 2024-04-18T21:05:37.812 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00031158899999999997 2024-04-18T21:05:37.812 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.812 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.812 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:37.812 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618587+0000", 2024-04-18T21:05:37.812 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00026495700000000002 2024-04-18T21:05:37.813 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.813 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.813 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:37.813 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629262+0000", 2024-04-18T21:05:37.813 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010675877 2024-04-18T21:05:37.813 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.813 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.813 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:37.813 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.639773+0000", 2024-04-18T21:05:37.813 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0105109 2024-04-18T21:05:37.813 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.813 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.813 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:37.813 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.639926+0000", 2024-04-18T21:05:37.813 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000152349 2024-04-18T21:05:37.813 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.814 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.814 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:37.814 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640064+0000", 2024-04-18T21:05:37.814 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0001384 2024-04-18T21:05:37.814 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:37.814 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:37.814 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:37.814 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.814 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.814 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:37.814 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:05:37.814 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 32.152248284999999, 2024-04-18T21:05:37.814 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030215005999999999, 2024-04-18T21:05:37.814 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:37.814 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:37.814 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.815 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:37.815 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.815 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:37.815 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:05:37.815 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:37.815 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.815 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.815 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:37.815 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:05:37.815 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:37.815 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.815 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.815 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:37.815 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616095+0000", 2024-04-18T21:05:37.815 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.446e-06 2024-04-18T21:05:37.815 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.815 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.816 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:37.816 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616104+0000", 2024-04-18T21:05:37.816 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6200000000000005e-06 2024-04-18T21:05:37.816 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.816 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.816 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:37.816 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616132+0000", 2024-04-18T21:05:37.816 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7668999999999999e-05 2024-04-18T21:05:37.816 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.816 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.816 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.816 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616149+0000", 2024-04-18T21:05:37.816 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7047000000000001e-05 2024-04-18T21:05:37.816 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.816 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.816 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:37.817 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619287+0000", 2024-04-18T21:05:37.817 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0031381450000000002 2024-04-18T21:05:37.817 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.817 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.817 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:37.817 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619503+0000", 2024-04-18T21:05:37.817 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000216522 2024-04-18T21:05:37.817 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.817 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.817 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:37.817 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619930+0000", 2024-04-18T21:05:37.817 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00042604900000000001 2024-04-18T21:05:37.817 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.817 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.817 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:37.817 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629281+0000", 2024-04-18T21:05:37.818 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0093512230000000005 2024-04-18T21:05:37.818 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.818 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.818 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:37.818 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646022+0000", 2024-04-18T21:05:37.818 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016741156 2024-04-18T21:05:37.818 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.818 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.818 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:37.818 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646198+0000", 2024-04-18T21:05:37.818 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000176009 2024-04-18T21:05:37.818 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.818 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.818 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:37.819 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646309+0000", 2024-04-18T21:05:37.819 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011112000000000001 2024-04-18T21:05:37.819 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:37.819 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:37.819 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:37.819 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.819 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.819 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:37.819 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:05:37.819 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 32.152163461000001, 2024-04-18T21:05:37.819 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030501176000000001, 2024-04-18T21:05:37.819 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:37.819 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:37.820 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.820 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:37.820 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.820 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:37.820 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:05:37.820 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:37.820 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.820 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.820 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:37.820 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:05:37.820 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:37.820 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.820 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.820 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:37.820 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616180+0000", 2024-04-18T21:05:37.820 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1000000000000001e-06 2024-04-18T21:05:37.821 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.821 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.821 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:37.821 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616188+0000", 2024-04-18T21:05:37.821 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4069999999999993e-06 2024-04-18T21:05:37.821 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.821 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.821 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:37.821 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616207+0000", 2024-04-18T21:05:37.821 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8335999999999999e-05 2024-04-18T21:05:37.821 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.821 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.821 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.821 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616225+0000", 2024-04-18T21:05:37.821 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8652999999999999e-05 2024-04-18T21:05:37.821 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.822 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.822 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:37.822 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620977+0000", 2024-04-18T21:05:37.822 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047512220000000003 2024-04-18T21:05:37.822 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.822 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.822 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:37.822 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621279+0000", 2024-04-18T21:05:37.822 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000302646 2024-04-18T21:05:37.822 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.822 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.822 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:37.822 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621584+0000", 2024-04-18T21:05:37.822 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000305142 2024-04-18T21:05:37.823 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.823 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.823 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:37.823 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629352+0000", 2024-04-18T21:05:37.823 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0077673689999999997 2024-04-18T21:05:37.823 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.823 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.823 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:37.823 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646480+0000", 2024-04-18T21:05:37.823 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017128259 2024-04-18T21:05:37.823 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.823 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.823 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:37.823 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646591+0000", 2024-04-18T21:05:37.823 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011113899999999999 2024-04-18T21:05:37.824 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.824 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.824 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:37.824 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646680+0000", 2024-04-18T21:05:37.824 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8902999999999999e-05 2024-04-18T21:05:37.824 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:37.824 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:37.824 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:37.824 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.824 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.824 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:37.824 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:05:37.824 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 32.152096962000002, 2024-04-18T21:05:37.824 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030779760999999999, 2024-04-18T21:05:37.824 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:37.824 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:37.825 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.825 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:37.825 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.825 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:37.825 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:05:37.825 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:37.825 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.825 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.825 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:37.825 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:05:37.825 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:37.825 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.825 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.825 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:37.825 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616246+0000", 2024-04-18T21:05:37.826 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0499999999999999e-06 2024-04-18T21:05:37.826 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.826 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.826 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:37.826 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616253+0000", 2024-04-18T21:05:37.826 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.5989999999999998e-06 2024-04-18T21:05:37.826 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.826 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.826 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:37.826 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616273+0000", 2024-04-18T21:05:37.826 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9916999999999999e-05 2024-04-18T21:05:37.826 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.827 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.827 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.827 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616287+0000", 2024-04-18T21:05:37.827 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3669000000000001e-05 2024-04-18T21:05:37.827 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.827 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.827 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:37.827 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622203+0000", 2024-04-18T21:05:37.827 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.005916737 2024-04-18T21:05:37.827 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.827 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.827 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:37.827 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622379+0000", 2024-04-18T21:05:37.827 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000175596 2024-04-18T21:05:37.828 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.828 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.828 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:37.828 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622707+0000", 2024-04-18T21:05:37.828 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00032784600000000002 2024-04-18T21:05:37.828 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.828 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.828 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:37.828 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629366+0000", 2024-04-18T21:05:37.828 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0066593279999999999 2024-04-18T21:05:37.828 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.828 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.829 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:37.829 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646813+0000", 2024-04-18T21:05:37.829 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017447059000000001 2024-04-18T21:05:37.829 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.829 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.829 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:37.829 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646946+0000", 2024-04-18T21:05:37.829 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013301200000000001 2024-04-18T21:05:37.829 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.829 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.829 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:37.829 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647025+0000", 2024-04-18T21:05:37.830 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8948000000000004e-05 2024-04-18T21:05:37.830 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:37.830 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:37.830 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:37.830 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.830 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.830 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:37.830 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:05:37.830 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 32.152013144000001, 2024-04-18T21:05:37.830 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.031512165000000002, 2024-04-18T21:05:37.830 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:37.830 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:37.830 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.830 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:37.830 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.831 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:37.831 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:05:37.831 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:37.831 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.831 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.831 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:37.831 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:05:37.831 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:37.831 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.831 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.831 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:37.831 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616330+0000", 2024-04-18T21:05:37.831 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.15e-06 2024-04-18T21:05:37.831 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.832 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.832 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:37.832 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616337+0000", 2024-04-18T21:05:37.832 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.1289999999999998e-06 2024-04-18T21:05:37.832 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.832 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.832 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:37.832 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616447+0000", 2024-04-18T21:05:37.832 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109561 2024-04-18T21:05:37.832 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.832 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.832 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.832 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616496+0000", 2024-04-18T21:05:37.832 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8591999999999998e-05 2024-04-18T21:05:37.832 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.833 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.833 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:37.833 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.623786+0000", 2024-04-18T21:05:37.833 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0072906799999999999 2024-04-18T21:05:37.833 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.833 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.833 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:37.833 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.623973+0000", 2024-04-18T21:05:37.833 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018717199999999999 2024-04-18T21:05:37.833 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.833 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.833 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:37.833 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624260+0000", 2024-04-18T21:05:37.834 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00028630600000000001 2024-04-18T21:05:37.834 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.834 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.834 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:37.834 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629381+0000", 2024-04-18T21:05:37.834 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0051211340000000003 2024-04-18T21:05:37.834 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.834 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.834 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:37.834 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647631+0000", 2024-04-18T21:05:37.834 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018249771000000001 2024-04-18T21:05:37.834 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.834 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.834 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:37.835 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647761+0000", 2024-04-18T21:05:37.835 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013037300000000001 2024-04-18T21:05:37.835 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.835 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.835 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:37.835 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647841+0000", 2024-04-18T21:05:37.835 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.0296999999999994e-05 2024-04-18T21:05:37.835 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:37.835 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:37.835 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:37.835 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.835 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.835 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:37.835 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:05:37.836 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 32.151807660000003, 2024-04-18T21:05:37.836 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043251955000000002, 2024-04-18T21:05:37.836 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:37.836 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:37.836 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.836 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:37.836 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.836 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:37.836 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:05:37.836 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:37.836 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.836 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.836 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:37.836 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:05:37.836 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:37.837 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.837 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.837 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:37.837 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616536+0000", 2024-04-18T21:05:37.837 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2869999999999999e-06 2024-04-18T21:05:37.837 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.837 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.837 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:37.837 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616572+0000", 2024-04-18T21:05:37.837 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.6261999999999999e-05 2024-04-18T21:05:37.837 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.837 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.837 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:37.837 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616593+0000", 2024-04-18T21:05:37.837 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1310000000000001e-05 2024-04-18T21:05:37.837 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.838 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.838 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.838 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616614+0000", 2024-04-18T21:05:37.838 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.0936000000000001e-05 2024-04-18T21:05:37.838 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.838 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.838 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:37.838 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629501+0000", 2024-04-18T21:05:37.838 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.012886819000000001 2024-04-18T21:05:37.838 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.838 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.838 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:37.838 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629696+0000", 2024-04-18T21:05:37.838 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019485499999999999 2024-04-18T21:05:37.838 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.839 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.839 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:37.839 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629940+0000", 2024-04-18T21:05:37.839 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00024386399999999999 2024-04-18T21:05:37.839 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.839 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.839 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:37.839 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640100+0000", 2024-04-18T21:05:37.839 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010159645 2024-04-18T21:05:37.839 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.839 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.839 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:37.839 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659516+0000", 2024-04-18T21:05:37.840 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019416563000000001 2024-04-18T21:05:37.840 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.840 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.840 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:37.840 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659684+0000", 2024-04-18T21:05:37.840 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016750900000000001 2024-04-18T21:05:37.840 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.840 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.840 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:37.840 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659787+0000", 2024-04-18T21:05:37.840 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000102905 2024-04-18T21:05:37.840 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:37.840 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:37.840 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:37.840 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.840 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.841 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:37.841 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:05:37.841 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 32.151702538000002, 2024-04-18T21:05:37.841 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043581898000000001, 2024-04-18T21:05:37.841 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:37.841 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:37.841 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.841 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:37.841 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.841 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:37.841 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:05:37.841 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:37.841 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.841 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.841 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:37.841 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:05:37.842 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:37.842 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.842 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.842 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:37.842 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616641+0000", 2024-04-18T21:05:37.842 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:05:37.842 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.842 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.842 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:37.842 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616648+0000", 2024-04-18T21:05:37.842 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3860000000000001e-06 2024-04-18T21:05:37.842 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.842 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.842 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:37.842 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616666+0000", 2024-04-18T21:05:37.842 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7583000000000001e-05 2024-04-18T21:05:37.843 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.843 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.843 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.843 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616679+0000", 2024-04-18T21:05:37.843 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3322999999999999e-05 2024-04-18T21:05:37.843 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.843 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.843 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:37.843 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630373+0000", 2024-04-18T21:05:37.843 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013694207999999999 2024-04-18T21:05:37.843 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.843 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.843 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:37.843 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630545+0000", 2024-04-18T21:05:37.843 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000171683 2024-04-18T21:05:37.844 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.844 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.844 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:37.844 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630728+0000", 2024-04-18T21:05:37.844 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000182599 2024-04-18T21:05:37.844 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.844 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.844 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:37.844 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640600+0000", 2024-04-18T21:05:37.844 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0098726119999999994 2024-04-18T21:05:37.844 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.844 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.844 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:37.844 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659927+0000", 2024-04-18T21:05:37.844 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019326724999999999 2024-04-18T21:05:37.844 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.845 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.845 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:37.845 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660112+0000", 2024-04-18T21:05:37.845 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000185203 2024-04-18T21:05:37.845 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.845 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.845 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:37.845 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660222+0000", 2024-04-18T21:05:37.845 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109343 2024-04-18T21:05:37.845 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:37.845 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:37.845 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:37.845 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.845 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.845 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:37.846 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:05:37.846 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 32.150837180000003, 2024-04-18T21:05:37.846 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043121310000000003, 2024-04-18T21:05:37.846 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:37.846 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:37.846 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.846 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:37.846 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.846 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:37.846 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:05:37.846 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:37.846 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.846 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.847 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:37.847 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:05:37.847 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:37.847 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.847 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.847 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:37.847 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617506+0000", 2024-04-18T21:05:37.847 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9999999999999995e-07 2024-04-18T21:05:37.847 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.847 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.847 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:37.847 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617513+0000", 2024-04-18T21:05:37.847 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.9700000000000002e-06 2024-04-18T21:05:37.847 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.847 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.848 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:37.848 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617531+0000", 2024-04-18T21:05:37.848 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8105999999999999e-05 2024-04-18T21:05:37.848 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.848 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.848 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.848 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617545+0000", 2024-04-18T21:05:37.848 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3703000000000001e-05 2024-04-18T21:05:37.848 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.848 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.848 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:37.848 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632129+0000", 2024-04-18T21:05:37.848 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.014584135999999999 2024-04-18T21:05:37.848 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.848 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.848 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:37.849 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632361+0000", 2024-04-18T21:05:37.849 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023171800000000001 2024-04-18T21:05:37.849 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.849 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.849 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:37.849 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632804+0000", 2024-04-18T21:05:37.849 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000443549 2024-04-18T21:05:37.849 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.849 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.849 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:37.849 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646340+0000", 2024-04-18T21:05:37.849 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013535902000000001 2024-04-18T21:05:37.849 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.849 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.849 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:37.849 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660363+0000", 2024-04-18T21:05:37.850 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01402318 2024-04-18T21:05:37.850 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.850 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.850 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:37.850 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660523+0000", 2024-04-18T21:05:37.850 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00015989899999999999 2024-04-18T21:05:37.850 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.850 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.850 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:37.850 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660626+0000", 2024-04-18T21:05:37.850 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010314699999999999 2024-04-18T21:05:37.850 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:37.850 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:37.850 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:37.850 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.850 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.851 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:37.851 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:05:37.851 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 32.150697487000002, 2024-04-18T21:05:37.851 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024927483, 2024-04-18T21:05:37.851 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:37.851 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:37.851 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.851 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:37.851 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.851 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:37.851 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:05:37.851 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:37.851 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.851 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.851 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:37.851 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:05:37.852 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:37.852 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.852 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.852 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:37.852 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617646+0000", 2024-04-18T21:05:37.852 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3030000000000001e-06 2024-04-18T21:05:37.852 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.852 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.852 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:37.852 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617653+0000", 2024-04-18T21:05:37.852 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7530000000000004e-06 2024-04-18T21:05:37.852 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.852 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.852 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:37.852 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617673+0000", 2024-04-18T21:05:37.853 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9967e-05 2024-04-18T21:05:37.853 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.853 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.853 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.853 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617688+0000", 2024-04-18T21:05:37.853 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5153e-05 2024-04-18T21:05:37.853 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.853 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.853 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:37.853 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619244+0000", 2024-04-18T21:05:37.853 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001555531 2024-04-18T21:05:37.853 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.853 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.853 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:37.853 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619361+0000", 2024-04-18T21:05:37.853 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011784400000000001 2024-04-18T21:05:37.854 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.854 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.854 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:37.854 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619604+0000", 2024-04-18T21:05:37.854 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000243007 2024-04-18T21:05:37.854 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.854 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.854 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:37.854 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.625480+0000", 2024-04-18T21:05:37.854 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0058759349999999997 2024-04-18T21:05:37.855 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.855 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.855 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:37.855 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642342+0000", 2024-04-18T21:05:37.855 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016861373999999998 2024-04-18T21:05:37.855 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.855 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.855 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:37.855 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642484+0000", 2024-04-18T21:05:37.855 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000142423 2024-04-18T21:05:37.855 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.855 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.855 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:37.855 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642572+0000", 2024-04-18T21:05:37.855 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8193000000000001e-05 2024-04-18T21:05:37.855 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:37.856 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:37.856 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:37.856 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.856 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.856 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:37.856 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:05:37.856 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 32.150415983999999, 2024-04-18T21:05:37.856 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024956974999999999, 2024-04-18T21:05:37.856 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:37.856 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:37.856 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.856 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:37.856 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.856 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:37.856 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:05:37.856 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:37.857 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.857 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.857 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:37.857 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:05:37.857 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:37.857 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.857 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.857 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:37.857 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617928+0000", 2024-04-18T21:05:37.857 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5430000000000001e-06 2024-04-18T21:05:37.857 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.857 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.857 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:37.857 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617937+0000", 2024-04-18T21:05:37.857 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6629999999999999e-06 2024-04-18T21:05:37.858 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.858 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.858 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:37.858 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617955+0000", 2024-04-18T21:05:37.858 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8749999999999998e-05 2024-04-18T21:05:37.858 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.858 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.858 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.858 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617971+0000", 2024-04-18T21:05:37.858 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.605e-05 2024-04-18T21:05:37.858 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.858 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.858 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:37.858 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621019+0000", 2024-04-18T21:05:37.859 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0030472369999999999 2024-04-18T21:05:37.859 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.859 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.859 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:37.859 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621249+0000", 2024-04-18T21:05:37.859 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000230075 2024-04-18T21:05:37.859 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.859 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.859 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:37.859 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621450+0000", 2024-04-18T21:05:37.859 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020166499999999999 2024-04-18T21:05:37.859 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.859 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.859 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:37.859 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.626233+0000", 2024-04-18T21:05:37.859 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047827390000000003 2024-04-18T21:05:37.860 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.860 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.860 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:37.860 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642693+0000", 2024-04-18T21:05:37.860 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01645961 2024-04-18T21:05:37.860 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.860 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.860 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:37.860 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642798+0000", 2024-04-18T21:05:37.860 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010559499999999999 2024-04-18T21:05:37.860 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.860 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.860 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:37.861 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642883+0000", 2024-04-18T21:05:37.861 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5048000000000003e-05 2024-04-18T21:05:37.861 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:37.861 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:37.861 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:37.861 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.861 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.861 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:37.861 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:05:37.861 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 32.148720355999998, 2024-04-18T21:05:37.861 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024086478000000001, 2024-04-18T21:05:37.861 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:37.861 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:37.861 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.862 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:37.862 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.862 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:37.862 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:05:37.862 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:37.862 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.862 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.862 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:37.862 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:05:37.862 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:37.862 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.862 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.862 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:37.862 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619624+0000", 2024-04-18T21:05:37.862 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.75e-06 2024-04-18T21:05:37.863 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.863 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.863 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:37.863 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619637+0000", 2024-04-18T21:05:37.863 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3540000000000001e-05 2024-04-18T21:05:37.863 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.863 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.863 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:37.863 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619666+0000", 2024-04-18T21:05:37.863 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8685999999999999e-05 2024-04-18T21:05:37.863 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.863 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.863 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.863 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619685+0000", 2024-04-18T21:05:37.863 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8681999999999998e-05 2024-04-18T21:05:37.864 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.864 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.864 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:37.864 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622275+0000", 2024-04-18T21:05:37.864 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0025899260000000002 2024-04-18T21:05:37.864 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.864 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.864 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:37.864 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622572+0000", 2024-04-18T21:05:37.864 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00029722 2024-04-18T21:05:37.864 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.864 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.864 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:37.864 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622752+0000", 2024-04-18T21:05:37.864 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018065900000000001 2024-04-18T21:05:37.864 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.865 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.865 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:37.865 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.626326+0000", 2024-04-18T21:05:37.865 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035737310000000001 2024-04-18T21:05:37.865 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.865 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.865 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:37.865 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643565+0000", 2024-04-18T21:05:37.865 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017238430999999999 2024-04-18T21:05:37.865 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.865 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.865 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:37.865 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643646+0000", 2024-04-18T21:05:37.865 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.1481000000000001e-05 2024-04-18T21:05:37.865 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.865 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.866 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:37.866 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643708+0000", 2024-04-18T21:05:37.866 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.2372000000000005e-05 2024-04-18T21:05:37.866 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:37.866 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:37.866 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:37.866 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.866 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.866 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:37.866 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:05:37.866 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 32.148554203000003, 2024-04-18T21:05:37.866 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026822450000000001, 2024-04-18T21:05:37.866 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:37.866 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:37.866 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:37.866 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:37.867 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.867 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:37.867 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:05:37.867 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:37.867 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.867 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.867 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:37.867 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:05:37.867 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:37.867 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.867 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.867 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:37.867 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619789+0000", 2024-04-18T21:05:37.867 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:05:37.868 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.868 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.868 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:37.868 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619797+0000", 2024-04-18T21:05:37.868 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.6899999999999992e-06 2024-04-18T21:05:37.868 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.868 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.868 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:37.868 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619816+0000", 2024-04-18T21:05:37.868 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9352999999999999e-05 2024-04-18T21:05:37.868 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.868 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.868 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.868 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619832+0000", 2024-04-18T21:05:37.869 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6013000000000001e-05 2024-04-18T21:05:37.869 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.869 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.869 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:37.869 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620528+0000", 2024-04-18T21:05:37.869 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00069565600000000001 2024-04-18T21:05:37.869 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.869 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.869 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:37.869 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620735+0000", 2024-04-18T21:05:37.869 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000207025 2024-04-18T21:05:37.869 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.869 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.869 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:37.870 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620912+0000", 2024-04-18T21:05:37.870 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017748199999999999 2024-04-18T21:05:37.870 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.870 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.870 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:37.870 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.625605+0000", 2024-04-18T21:05:37.870 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0046924439999999996 2024-04-18T21:05:37.870 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.870 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.870 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:37.870 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646349+0000", 2024-04-18T21:05:37.870 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.020744318000000001 2024-04-18T21:05:37.870 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.870 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.871 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:37.871 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646483+0000", 2024-04-18T21:05:37.871 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013428999999999999 2024-04-18T21:05:37.871 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.871 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.871 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:37.871 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646611+0000", 2024-04-18T21:05:37.871 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012710299999999999 2024-04-18T21:05:37.871 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:37.871 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:37.871 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:37.871 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.871 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.871 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:37.871 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:05:37.872 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 32.14788377, 2024-04-18T21:05:37.872 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023516516000000001, 2024-04-18T21:05:37.872 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:37.872 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:37.872 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:05:37.872 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:37.872 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.872 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:37.872 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:05:37.872 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:37.872 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.872 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.872 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:37.872 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:05:37.873 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:37.873 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.873 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.873 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:37.873 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620460+0000", 2024-04-18T21:05:37.873 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.787e-06 2024-04-18T21:05:37.873 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.873 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.873 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:37.873 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620470+0000", 2024-04-18T21:05:37.873 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.2560000000000008e-06 2024-04-18T21:05:37.873 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.873 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.874 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:37.874 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620496+0000", 2024-04-18T21:05:37.874 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.6205999999999999e-05 2024-04-18T21:05:37.874 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.874 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.874 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:37.874 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620517+0000", 2024-04-18T21:05:37.874 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1223e-05 2024-04-18T21:05:37.874 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.874 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.874 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:37.874 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624060+0000", 2024-04-18T21:05:37.875 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035434160000000002 2024-04-18T21:05:37.875 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.875 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.875 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:37.875 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624390+0000", 2024-04-18T21:05:37.875 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00033000500000000002 2024-04-18T21:05:37.875 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:37.875 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:37.875 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:37.875 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643975+0000", 2024-04-18T21:05:37.875 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019584622999999999 2024-04-18T21:05:37.875 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:37.876 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:37.876 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:37.876 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:37.876 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:37.876 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:05:37.878 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:05:37.878 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:37.875+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:37.978 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:37.979+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:38.011 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:05:38.011 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [], 2024-04-18T21:05:38.011 INFO:teuthology.orchestra.run.smithi150.stdout: "num_ops": 0 2024-04-18T21:05:38.011 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:05:38.025 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:05:38.079 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:38.079+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:38.145 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:05:38.145 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [], 2024-04-18T21:05:38.146 INFO:teuthology.orchestra.run.smithi150.stdout: "complaint_time": 30, 2024-04-18T21:05:38.146 INFO:teuthology.orchestra.run.smithi150.stdout: "num_blocked_ops": 0 2024-04-18T21:05:38.146 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:05:38.160 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:05:38.179 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:38.179+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:38.280 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:38.279+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:38.329 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:05:38.329 INFO:teuthology.orchestra.run.smithi150.stdout: "size": 20, 2024-04-18T21:05:38.329 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 600, 2024-04-18T21:05:38.329 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [ 2024-04-18T21:05:38.329 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.329 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-18T21:05:38.330 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:05:38.330 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 43.524467158, 2024-04-18T21:05:38.330 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0093051590000000003, 2024-04-18T21:05:38.330 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:38.330 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:38.330 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:38.330 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:38.330 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.330 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:38.330 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:05:38.330 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:38.330 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.331 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.331 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:38.331 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:05:38.331 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:38.331 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.331 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.331 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:38.331 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804851+0000", 2024-04-18T21:05:38.331 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7039999999999999e-06 2024-04-18T21:05:38.331 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.331 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.331 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:38.331 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804864+0000", 2024-04-18T21:05:38.332 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.276e-05 2024-04-18T21:05:38.332 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.332 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.332 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:38.332 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804895+0000", 2024-04-18T21:05:38.332 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.1204999999999997e-05 2024-04-18T21:05:38.332 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.332 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.332 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:38.332 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804908+0000", 2024-04-18T21:05:38.332 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3317e-05 2024-04-18T21:05:38.332 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.332 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.333 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:38.333 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805131+0000", 2024-04-18T21:05:38.333 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00022246700000000001 2024-04-18T21:05:38.333 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.333 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.333 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:38.333 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805171+0000", 2024-04-18T21:05:38.333 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.0164999999999999e-05 2024-04-18T21:05:38.333 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.333 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.333 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:38.333 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814086+0000", 2024-04-18T21:05:38.333 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0089155329999999998 2024-04-18T21:05:38.333 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.334 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.334 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:38.334 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814154+0000", 2024-04-18T21:05:38.334 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.8008000000000003e-05 2024-04-18T21:05:38.334 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:38.334 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:38.334 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:38.334 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.334 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.334 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-18T21:05:38.334 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:05:38.334 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 43.523701965000001, 2024-04-18T21:05:38.334 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0086469770000000001, 2024-04-18T21:05:38.335 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:38.335 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:38.335 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:38.335 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:38.335 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.335 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:38.335 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:05:38.335 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:38.335 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.335 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.335 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:38.335 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:05:38.335 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:38.336 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.336 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.336 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:38.336 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805616+0000", 2024-04-18T21:05:38.336 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7799999999999999e-06 2024-04-18T21:05:38.336 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.336 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.336 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:38.336 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805707+0000", 2024-04-18T21:05:38.336 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0917999999999999e-05 2024-04-18T21:05:38.336 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.336 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.336 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:38.336 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805739+0000", 2024-04-18T21:05:38.337 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.2512000000000003e-05 2024-04-18T21:05:38.337 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.337 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.337 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:38.337 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805763+0000", 2024-04-18T21:05:38.337 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3266000000000001e-05 2024-04-18T21:05:38.337 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.337 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.337 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:38.337 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.806024+0000", 2024-04-18T21:05:38.337 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000261716 2024-04-18T21:05:38.337 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.337 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.338 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:38.338 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.806073+0000", 2024-04-18T21:05:38.338 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.8844999999999997e-05 2024-04-18T21:05:38.338 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.338 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.338 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:38.338 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814162+0000", 2024-04-18T21:05:38.338 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0080882860000000001 2024-04-18T21:05:38.338 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.338 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.338 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:38.338 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814261+0000", 2024-04-18T21:05:38.338 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.9654000000000005e-05 2024-04-18T21:05:38.339 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:38.339 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:38.339 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:38.339 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.339 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.339 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'64)", 2024-04-18T21:05:38.339 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:05:38.339 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 43.521930920999999, 2024-04-18T21:05:38.339 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0089721509999999994, 2024-04-18T21:05:38.339 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:38.339 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:38.339 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:38.339 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:38.339 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.340 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:38.340 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:05:38.340 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:38.340 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.340 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.340 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:38.340 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:05:38.340 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:38.340 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.340 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.340 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:38.340 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807387+0000", 2024-04-18T21:05:38.340 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.0329999999999998e-06 2024-04-18T21:05:38.341 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.341 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.341 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:38.341 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807443+0000", 2024-04-18T21:05:38.341 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.5376e-05 2024-04-18T21:05:38.341 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.341 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.341 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:38.341 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807467+0000", 2024-04-18T21:05:38.341 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.4621999999999999e-05 2024-04-18T21:05:38.341 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.341 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.341 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:38.342 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807482+0000", 2024-04-18T21:05:38.342 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.436e-05 2024-04-18T21:05:38.342 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.342 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.342 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:38.342 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.809243+0000", 2024-04-18T21:05:38.342 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001761725 2024-04-18T21:05:38.342 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.342 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.342 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:38.342 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.809295+0000", 2024-04-18T21:05:38.342 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.1445e-05 2024-04-18T21:05:38.342 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.342 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.343 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:38.343 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.816293+0000", 2024-04-18T21:05:38.343 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0069981749999999997 2024-04-18T21:05:38.343 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.343 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.343 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:38.343 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.816357+0000", 2024-04-18T21:05:38.343 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.4414999999999999e-05 2024-04-18T21:05:38.343 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:38.343 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:38.343 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:38.343 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.343 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.343 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:38.343 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:05:38.343 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 32.714021551000002, 2024-04-18T21:05:38.344 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.040843365, 2024-04-18T21:05:38.344 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:38.344 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:38.344 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:38.344 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:38.344 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.344 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:38.344 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:05:38.344 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:38.344 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.344 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.344 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:38.344 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:05:38.345 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:38.345 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.345 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.345 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:38.345 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615297+0000", 2024-04-18T21:05:38.345 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2800000000000002e-06 2024-04-18T21:05:38.345 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.345 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.345 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:38.345 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615308+0000", 2024-04-18T21:05:38.345 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0813e-05 2024-04-18T21:05:38.345 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.345 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.346 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:38.346 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615330+0000", 2024-04-18T21:05:38.346 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2370000000000001e-05 2024-04-18T21:05:38.346 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.346 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.346 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:38.346 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615346+0000", 2024-04-18T21:05:38.346 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6200000000000001e-05 2024-04-18T21:05:38.346 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.346 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.346 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:38.346 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615470+0000", 2024-04-18T21:05:38.346 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012385799999999999 2024-04-18T21:05:38.346 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.346 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.347 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:05:38.347 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615488+0000", 2024-04-18T21:05:38.347 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7923000000000001e-05 2024-04-18T21:05:38.347 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.347 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.347 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:38.347 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.630993+0000", 2024-04-18T21:05:38.347 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.01550532 2024-04-18T21:05:38.347 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.347 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.347 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:38.347 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631165+0000", 2024-04-18T21:05:38.347 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000171588 2024-04-18T21:05:38.347 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.347 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.348 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:38.348 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631320+0000", 2024-04-18T21:05:38.348 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000155162 2024-04-18T21:05:38.348 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.348 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.348 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:38.348 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635157+0000", 2024-04-18T21:05:38.348 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0038370790000000002 2024-04-18T21:05:38.348 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.348 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.348 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:38.348 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.655904+0000", 2024-04-18T21:05:38.348 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.020746483999999999 2024-04-18T21:05:38.348 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.348 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.349 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:38.349 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656032+0000", 2024-04-18T21:05:38.349 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012864199999999999 2024-04-18T21:05:38.349 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.349 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.349 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:38.349 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656138+0000", 2024-04-18T21:05:38.349 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000105646 2024-04-18T21:05:38.349 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:38.349 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:38.349 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:38.349 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.349 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.349 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:38.349 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:05:38.349 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 32.713929379, 2024-04-18T21:05:38.350 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.041266444999999999, 2024-04-18T21:05:38.350 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:38.350 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:38.350 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:38.350 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:38.350 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.350 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:38.350 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:05:38.350 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:38.350 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.350 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.350 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:38.350 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:05:38.350 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:38.351 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.351 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.351 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:38.351 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615388+0000", 2024-04-18T21:05:38.351 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:05:38.351 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.351 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.351 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:38.351 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:05:38.351 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.7299999999999994e-06 2024-04-18T21:05:38.351 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.351 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.351 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:38.351 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615415+0000", 2024-04-18T21:05:38.351 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7807000000000001e-05 2024-04-18T21:05:38.351 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.352 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.352 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:38.352 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615431+0000", 2024-04-18T21:05:38.352 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6127e-05 2024-04-18T21:05:38.352 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.352 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.352 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:38.352 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615621+0000", 2024-04-18T21:05:38.352 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000189781 2024-04-18T21:05:38.352 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.352 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.352 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:38.352 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615634+0000", 2024-04-18T21:05:38.352 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3383e-05 2024-04-18T21:05:38.352 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.352 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.353 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:38.353 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631703+0000", 2024-04-18T21:05:38.353 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016068737 2024-04-18T21:05:38.353 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.353 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.353 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:38.353 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631809+0000", 2024-04-18T21:05:38.353 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000106823 2024-04-18T21:05:38.353 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.353 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.353 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:38.353 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631988+0000", 2024-04-18T21:05:38.353 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000179008 2024-04-18T21:05:38.353 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.353 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.353 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:38.354 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635172+0000", 2024-04-18T21:05:38.354 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.003183029 2024-04-18T21:05:38.354 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.354 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.354 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:38.354 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656392+0000", 2024-04-18T21:05:38.354 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.021220638999999999 2024-04-18T21:05:38.354 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.354 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.354 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:38.354 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656533+0000", 2024-04-18T21:05:38.354 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014126500000000001 2024-04-18T21:05:38.354 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.354 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.354 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:38.355 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656653+0000", 2024-04-18T21:05:38.355 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000119883 2024-04-18T21:05:38.355 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:38.355 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:38.355 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:38.355 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.355 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.355 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:38.355 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:05:38.355 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 32.713841956000003, 2024-04-18T21:05:38.355 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.042492302000000003, 2024-04-18T21:05:38.355 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:38.355 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:38.355 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:38.355 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:38.355 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.356 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:38.356 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:05:38.356 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:38.356 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.356 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.356 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:38.356 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:05:38.356 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:38.356 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.356 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.356 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:38.356 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615475+0000", 2024-04-18T21:05:38.356 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.17e-06 2024-04-18T21:05:38.356 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.356 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.356 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:38.357 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615528+0000", 2024-04-18T21:05:38.357 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.2159e-05 2024-04-18T21:05:38.357 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.357 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.357 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:38.357 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615542+0000", 2024-04-18T21:05:38.357 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4197e-05 2024-04-18T21:05:38.357 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.357 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.357 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:38.357 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615559+0000", 2024-04-18T21:05:38.357 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.749e-05 2024-04-18T21:05:38.357 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.357 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.357 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:38.357 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615685+0000", 2024-04-18T21:05:38.358 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012617499999999999 2024-04-18T21:05:38.358 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.358 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.358 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:05:38.358 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:05:38.358 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4749999999999999e-05 2024-04-18T21:05:38.358 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.358 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.358 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:38.358 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632332+0000", 2024-04-18T21:05:38.358 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016631988 2024-04-18T21:05:38.358 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.358 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.358 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:38.359 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632477+0000", 2024-04-18T21:05:38.359 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014437200000000001 2024-04-18T21:05:38.359 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.359 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.359 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:38.359 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632620+0000", 2024-04-18T21:05:38.359 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000143566 2024-04-18T21:05:38.359 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.359 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.359 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:38.359 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635185+0000", 2024-04-18T21:05:38.359 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0025644209999999999 2024-04-18T21:05:38.359 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.359 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.359 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:38.359 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657803+0000", 2024-04-18T21:05:38.360 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.022618743 2024-04-18T21:05:38.360 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.360 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.360 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:38.360 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657890+0000", 2024-04-18T21:05:38.360 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.6688999999999996e-05 2024-04-18T21:05:38.360 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.360 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.360 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:38.360 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657967+0000", 2024-04-18T21:05:38.360 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.6582000000000006e-05 2024-04-18T21:05:38.360 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:38.360 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:38.360 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:38.361 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.361 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.361 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:38.361 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:05:38.361 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 32.713711144000001, 2024-04-18T21:05:38.361 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.043603435000000003, 2024-04-18T21:05:38.361 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:38.361 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:38.361 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:38.361 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:38.361 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.361 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:38.361 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:05:38.362 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:38.362 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.362 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.362 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:38.362 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:05:38.362 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:38.362 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.362 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.362 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:38.362 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615607+0000", 2024-04-18T21:05:38.362 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4300000000000001e-06 2024-04-18T21:05:38.362 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.362 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.362 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:38.362 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615614+0000", 2024-04-18T21:05:38.362 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.4100000000000002e-06 2024-04-18T21:05:38.363 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.363 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.363 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:38.363 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615632+0000", 2024-04-18T21:05:38.363 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7863000000000002e-05 2024-04-18T21:05:38.363 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.363 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.363 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:38.363 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615647+0000", 2024-04-18T21:05:38.363 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5187e-05 2024-04-18T21:05:38.363 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.363 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.363 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:38.363 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615765+0000", 2024-04-18T21:05:38.363 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000117955 2024-04-18T21:05:38.363 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.364 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.364 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:38.364 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615781+0000", 2024-04-18T21:05:38.364 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6123000000000001e-05 2024-04-18T21:05:38.364 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.364 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.364 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:38.364 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633055+0000", 2024-04-18T21:05:38.364 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.017273909 2024-04-18T21:05:38.364 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.364 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.365 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:38.365 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633254+0000", 2024-04-18T21:05:38.365 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00019903799999999999 2024-04-18T21:05:38.365 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.365 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.365 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:38.365 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633624+0000", 2024-04-18T21:05:38.365 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000369656 2024-04-18T21:05:38.365 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.365 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.365 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:38.366 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635595+0000", 2024-04-18T21:05:38.366 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001971287 2024-04-18T21:05:38.366 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.366 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.366 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:38.366 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659026+0000", 2024-04-18T21:05:38.366 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.023431495 2024-04-18T21:05:38.366 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.366 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.366 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:38.366 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659117+0000", 2024-04-18T21:05:38.366 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0885999999999997e-05 2024-04-18T21:05:38.366 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.367 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.367 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:38.367 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659209+0000", 2024-04-18T21:05:38.367 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.1195999999999999e-05 2024-04-18T21:05:38.367 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:38.367 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:38.367 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:38.367 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.367 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.367 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:38.367 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:38.367 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 32.713645915000001, 2024-04-18T21:05:38.368 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.03492514, 2024-04-18T21:05:38.368 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:38.368 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:38.368 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:38.368 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:38.368 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.368 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:38.368 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:38.368 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:38.368 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.368 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.368 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:38.368 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:38.368 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:38.369 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.369 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.369 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:38.369 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:05:38.369 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.407e-06 2024-04-18T21:05:38.369 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.369 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.369 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:38.369 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615679+0000", 2024-04-18T21:05:38.369 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.2130000000000002e-06 2024-04-18T21:05:38.369 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.369 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.369 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:38.369 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615701+0000", 2024-04-18T21:05:38.369 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2316000000000001e-05 2024-04-18T21:05:38.370 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.370 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.370 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:38.370 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615717+0000", 2024-04-18T21:05:38.370 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6197000000000001e-05 2024-04-18T21:05:38.370 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.370 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.370 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:38.370 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615828+0000", 2024-04-18T21:05:38.370 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000110899 2024-04-18T21:05:38.370 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.370 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.370 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:05:38.371 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615840+0000", 2024-04-18T21:05:38.371 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.1423000000000001e-05 2024-04-18T21:05:38.371 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.371 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.371 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:38.371 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628046+0000", 2024-04-18T21:05:38.371 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.012206295000000001 2024-04-18T21:05:38.371 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.371 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.371 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:38.371 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628323+0000", 2024-04-18T21:05:38.371 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00027658700000000001 2024-04-18T21:05:38.371 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.371 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.371 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:38.371 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628599+0000", 2024-04-18T21:05:38.372 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00027676699999999997 2024-04-18T21:05:38.372 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.372 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.372 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:38.372 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634869+0000", 2024-04-18T21:05:38.372 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.006269536 2024-04-18T21:05:38.372 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.372 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.372 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:38.372 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650333+0000", 2024-04-18T21:05:38.372 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.015463645999999999 2024-04-18T21:05:38.372 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.372 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.372 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:38.372 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650474+0000", 2024-04-18T21:05:38.372 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014091799999999999 2024-04-18T21:05:38.372 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.373 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.373 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:38.373 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650595+0000", 2024-04-18T21:05:38.373 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012193600000000001 2024-04-18T21:05:38.373 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:38.373 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:38.373 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:38.373 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.373 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.373 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:38.373 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:05:38.373 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 32.713560805999997, 2024-04-18T21:05:38.373 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.040588320999999997, 2024-04-18T21:05:38.374 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:38.374 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:38.374 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:38.374 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:38.374 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.374 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:38.374 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:05:38.374 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:38.374 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.374 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.374 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:38.374 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:05:38.374 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:38.374 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.375 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.375 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:38.375 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615757+0000", 2024-04-18T21:05:38.375 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2270000000000001e-06 2024-04-18T21:05:38.375 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.375 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.375 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:38.375 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615765+0000", 2024-04-18T21:05:38.375 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.9400000000000002e-06 2024-04-18T21:05:38.375 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.375 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.375 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:38.375 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615785+0000", 2024-04-18T21:05:38.375 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.0749000000000001e-05 2024-04-18T21:05:38.375 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.376 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.376 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:38.376 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615804+0000", 2024-04-18T21:05:38.376 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.8774e-05 2024-04-18T21:05:38.376 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.376 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.376 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:38.376 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615888+0000", 2024-04-18T21:05:38.376 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.4111999999999997e-05 2024-04-18T21:05:38.376 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.376 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.376 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:38.376 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615895+0000", 2024-04-18T21:05:38.376 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.0469999999999996e-06 2024-04-18T21:05:38.377 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.377 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.377 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:38.377 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629280+0000", 2024-04-18T21:05:38.377 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.013384416 2024-04-18T21:05:38.377 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.377 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.377 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:38.377 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629488+0000", 2024-04-18T21:05:38.377 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00020852800000000001 2024-04-18T21:05:38.377 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.377 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.377 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:38.377 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629869+0000", 2024-04-18T21:05:38.377 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00038042300000000001 2024-04-18T21:05:38.378 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.378 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.378 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:38.378 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635041+0000", 2024-04-18T21:05:38.378 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.005172383 2024-04-18T21:05:38.378 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.378 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.378 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:38.378 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656125+0000", 2024-04-18T21:05:38.378 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.021084025999999999 2024-04-18T21:05:38.378 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.378 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.378 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:38.378 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656240+0000", 2024-04-18T21:05:38.379 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000115352 2024-04-18T21:05:38.379 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.379 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.379 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:38.379 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656344+0000", 2024-04-18T21:05:38.379 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00010334400000000001 2024-04-18T21:05:38.379 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:38.379 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:38.379 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:38.379 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.379 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.379 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:38.379 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:05:38.380 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 32.713493485999997, 2024-04-18T21:05:38.380 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.043549577999999999, 2024-04-18T21:05:38.380 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:38.380 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:38.380 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:38.380 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:38.380 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.380 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:38.380 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:05:38.380 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:38.380 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.380 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.381 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:38.381 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:05:38.381 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:38.381 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.381 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.381 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:38.381 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:05:38.381 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.5000000000000002e-07 2024-04-18T21:05:38.381 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.381 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.381 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:38.381 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615828+0000", 2024-04-18T21:05:38.382 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.2359999999999998e-06 2024-04-18T21:05:38.382 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.382 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.382 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:38.382 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615838+0000", 2024-04-18T21:05:38.382 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0087e-05 2024-04-18T21:05:38.382 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.382 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.382 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:38.382 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615846+0000", 2024-04-18T21:05:38.382 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.67e-06 2024-04-18T21:05:38.382 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.382 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.383 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:38.383 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615963+0000", 2024-04-18T21:05:38.383 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00011630500000000001 2024-04-18T21:05:38.383 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.383 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.383 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:38.383 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615979+0000", 2024-04-18T21:05:38.383 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.613e-05 2024-04-18T21:05:38.383 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.383 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.383 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:38.383 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632392+0000", 2024-04-18T21:05:38.383 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016413317 2024-04-18T21:05:38.383 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.383 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.383 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:38.384 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632568+0000", 2024-04-18T21:05:38.384 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00017539500000000001 2024-04-18T21:05:38.384 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.384 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.384 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:38.384 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632748+0000", 2024-04-18T21:05:38.384 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00017991799999999999 2024-04-18T21:05:38.384 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.384 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.384 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:38.384 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635542+0000", 2024-04-18T21:05:38.384 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00279481 2024-04-18T21:05:38.384 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.385 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.385 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:38.385 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659232+0000", 2024-04-18T21:05:38.385 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.023689212000000001 2024-04-18T21:05:38.385 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.385 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.385 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:38.385 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659314+0000", 2024-04-18T21:05:38.385 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.2528999999999995e-05 2024-04-18T21:05:38.385 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.385 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.385 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:38.385 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659372+0000", 2024-04-18T21:05:38.386 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.8218999999999999e-05 2024-04-18T21:05:38.386 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:38.386 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:38.386 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:38.386 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.386 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.386 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:38.386 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:05:38.386 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 32.713432054000002, 2024-04-18T21:05:38.386 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.039335347, 2024-04-18T21:05:38.386 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:38.386 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:38.386 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "started", 2024-04-18T21:05:38.386 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:38.387 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.387 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:38.387 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:05:38.387 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:38.387 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.387 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.387 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:38.387 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:05:38.387 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:38.387 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.387 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.387 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:38.387 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615885+0000", 2024-04-18T21:05:38.388 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2699999999999999e-06 2024-04-18T21:05:38.388 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.388 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.388 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:38.388 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615892+0000", 2024-04-18T21:05:38.388 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.6499999999999999e-06 2024-04-18T21:05:38.388 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.388 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.388 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:38.388 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615906+0000", 2024-04-18T21:05:38.388 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.393e-05 2024-04-18T21:05:38.389 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.389 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.389 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:38.389 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615919+0000", 2024-04-18T21:05:38.389 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2860000000000001e-05 2024-04-18T21:05:38.389 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.389 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.389 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:38.389 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616027+0000", 2024-04-18T21:05:38.389 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000107852 2024-04-18T21:05:38.389 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.389 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.389 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:05:38.390 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616037+0000", 2024-04-18T21:05:38.390 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:05:38.390 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.390 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.390 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:38.390 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622719+0000", 2024-04-18T21:05:38.390 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0066817220000000002 2024-04-18T21:05:38.390 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.390 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.390 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:38.390 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623006+0000", 2024-04-18T21:05:38.390 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00028783699999999999 2024-04-18T21:05:38.390 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.391 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.391 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:38.391 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.655220+0000", 2024-04-18T21:05:38.391 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.032213036 2024-04-18T21:05:38.391 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:38.391 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:38.391 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:38.391 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.391 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.391 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:38.391 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:38.391 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 32.713376381000003, 2024-04-18T21:05:38.391 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.032845253999999997, 2024-04-18T21:05:38.392 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:38.392 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:38.392 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "started", 2024-04-18T21:05:38.392 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:38.392 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.392 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:38.392 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:38.392 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:38.392 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.392 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.392 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:38.392 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:38.392 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:38.393 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.393 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.393 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:38.393 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615942+0000", 2024-04-18T21:05:38.393 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.717e-06 2024-04-18T21:05:38.393 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.393 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.393 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:38.393 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615946+0000", 2024-04-18T21:05:38.393 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.6e-06 2024-04-18T21:05:38.393 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.393 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.393 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:38.393 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615960+0000", 2024-04-18T21:05:38.394 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:05:38.394 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.394 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.394 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:38.394 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615968+0000", 2024-04-18T21:05:38.394 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.9070000000000007e-06 2024-04-18T21:05:38.394 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.394 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.394 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:38.394 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616100+0000", 2024-04-18T21:05:38.394 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000132402 2024-04-18T21:05:38.394 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.394 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.395 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:05:38.395 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616117+0000", 2024-04-18T21:05:38.395 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6653000000000001e-05 2024-04-18T21:05:38.395 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.395 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.395 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:38.395 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621566+0000", 2024-04-18T21:05:38.395 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0054497740000000001 2024-04-18T21:05:38.395 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.395 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.395 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:38.395 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622801+0000", 2024-04-18T21:05:38.395 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0012345710000000001 2024-04-18T21:05:38.396 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.396 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.396 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:38.396 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648785+0000", 2024-04-18T21:05:38.396 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.025984104000000001 2024-04-18T21:05:38.396 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:38.396 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:38.396 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:38.396 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.396 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.396 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:38.396 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:05:38.396 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 32.707525031000003, 2024-04-18T21:05:38.396 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.011561350999999999, 2024-04-18T21:05:38.396 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:38.397 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:38.397 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:38.397 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:38.397 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.397 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:38.397 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:05:38.397 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:38.397 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.397 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.397 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:38.397 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:05:38.397 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:38.397 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.397 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.398 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:38.398 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621792+0000", 2024-04-18T21:05:38.398 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.4000000000000001e-07 2024-04-18T21:05:38.398 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.398 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.398 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:38.398 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:05:38.398 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.1050000000000002e-05 2024-04-18T21:05:38.398 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.398 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.398 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:38.398 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622608+0000", 2024-04-18T21:05:38.398 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00077505900000000003 2024-04-18T21:05:38.399 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.399 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.399 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:38.399 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623879+0000", 2024-04-18T21:05:38.399 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0012705839999999999 2024-04-18T21:05:38.399 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.399 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.399 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:38.399 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624010+0000", 2024-04-18T21:05:38.399 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00013176900000000001 2024-04-18T21:05:38.399 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.399 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.399 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:38.399 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624058+0000", 2024-04-18T21:05:38.400 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.7299000000000002e-05 2024-04-18T21:05:38.400 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.400 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.400 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:38.400 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633262+0000", 2024-04-18T21:05:38.400 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0092048770000000002 2024-04-18T21:05:38.400 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.400 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.400 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:38.400 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633353+0000", 2024-04-18T21:05:38.400 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0073000000000003e-05 2024-04-18T21:05:38.400 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:38.400 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:38.400 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:38.400 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.401 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.401 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:38.401 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:05:38.401 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 32.705397644999998, 2024-04-18T21:05:38.401 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0098419370000000003, 2024-04-18T21:05:38.401 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:38.401 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:38.401 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:38.401 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:38.401 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.401 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:38.401 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:05:38.401 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:38.401 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.401 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.401 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:38.402 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:05:38.402 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:38.402 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.402 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.402 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:38.402 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623920+0000", 2024-04-18T21:05:38.402 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2240000000000001e-06 2024-04-18T21:05:38.402 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.402 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.402 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:38.402 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623933+0000", 2024-04-18T21:05:38.402 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3653e-05 2024-04-18T21:05:38.403 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.403 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.403 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:38.403 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623956+0000", 2024-04-18T21:05:38.403 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2059e-05 2024-04-18T21:05:38.403 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.403 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.403 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:38.403 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623975+0000", 2024-04-18T21:05:38.403 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.9806999999999999e-05 2024-04-18T21:05:38.403 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.403 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.403 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:38.403 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626943+0000", 2024-04-18T21:05:38.403 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0029681579999999998 2024-04-18T21:05:38.403 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.404 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.404 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:38.404 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626993+0000", 2024-04-18T21:05:38.404 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.9935999999999998e-05 2024-04-18T21:05:38.404 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.404 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.404 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:38.404 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633665+0000", 2024-04-18T21:05:38.404 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0066719250000000004 2024-04-18T21:05:38.404 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.404 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.404 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:38.404 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633761+0000", 2024-04-18T21:05:38.404 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.5174999999999996e-05 2024-04-18T21:05:38.404 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:38.404 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:38.405 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:38.405 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.405 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.405 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:38.405 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:05:38.405 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 32.704566026000002, 2024-04-18T21:05:38.405 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0090159079999999996, 2024-04-18T21:05:38.405 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:38.405 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:38.405 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:38.405 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:38.405 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.405 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:38.405 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:05:38.406 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:38.406 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.406 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.406 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:38.406 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:05:38.406 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:38.406 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.406 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.406 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:38.406 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624751+0000", 2024-04-18T21:05:38.406 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.7600000000000006e-07 2024-04-18T21:05:38.406 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.406 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.407 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:38.407 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624787+0000", 2024-04-18T21:05:38.407 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.6273000000000003e-05 2024-04-18T21:05:38.407 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.407 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.407 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:38.407 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625837+0000", 2024-04-18T21:05:38.407 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00104992 2024-04-18T21:05:38.407 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.407 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.407 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:38.407 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625860+0000", 2024-04-18T21:05:38.407 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3110000000000001e-05 2024-04-18T21:05:38.408 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.408 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.408 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:38.408 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625984+0000", 2024-04-18T21:05:38.408 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012399199999999999 2024-04-18T21:05:38.408 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.408 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.408 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:38.408 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626030+0000", 2024-04-18T21:05:38.408 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.5429999999999997e-05 2024-04-18T21:05:38.408 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.408 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.408 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:38.409 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633643+0000", 2024-04-18T21:05:38.409 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0076129320000000002 2024-04-18T21:05:38.409 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.409 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.409 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:38.409 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633766+0000", 2024-04-18T21:05:38.409 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000123275 2024-04-18T21:05:38.409 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:38.409 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:38.409 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:38.409 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.409 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.409 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:38.409 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:05:38.409 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 32.703312302, 2024-04-18T21:05:38.410 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0088669170000000002, 2024-04-18T21:05:38.410 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:38.410 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:38.410 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:38.410 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:38.410 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.410 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:38.410 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:05:38.410 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:38.410 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.410 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.410 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:38.410 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:05:38.410 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:38.411 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.411 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.411 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:38.411 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626005+0000", 2024-04-18T21:05:38.411 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.5000000000000001e-07 2024-04-18T21:05:38.411 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.411 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.411 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:38.411 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626028+0000", 2024-04-18T21:05:38.411 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2756999999999999e-05 2024-04-18T21:05:38.411 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.411 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.411 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:38.411 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626050+0000", 2024-04-18T21:05:38.412 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2140000000000001e-05 2024-04-18T21:05:38.412 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.412 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.412 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:38.412 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626065+0000", 2024-04-18T21:05:38.412 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5176e-05 2024-04-18T21:05:38.412 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.412 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.412 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:38.412 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628334+0000", 2024-04-18T21:05:38.412 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0022691439999999998 2024-04-18T21:05:38.412 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.413 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.413 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:38.413 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628379+0000", 2024-04-18T21:05:38.413 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.5420000000000002e-05 2024-04-18T21:05:38.413 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.413 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.413 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:38.413 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634770+0000", 2024-04-18T21:05:38.413 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0063908410000000004 2024-04-18T21:05:38.413 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.413 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.413 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:38.413 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634871+0000", 2024-04-18T21:05:38.414 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000100589 2024-04-18T21:05:38.414 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:38.414 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:38.414 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:38.414 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.414 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.414 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:13 3.10 e17/15 3:0d89b25e:::603.00000000:head v 17'8, mlcod=0'0)", 2024-04-18T21:05:38.414 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:05:38.414 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 32.684478873000003, 2024-04-18T21:05:38.414 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0090974379999999994, 2024-04-18T21:05:38.414 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:38.414 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:38.414 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:38.415 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:38.415 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.415 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:38.415 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:05:38.415 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:38.415 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.415 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.415 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:38.415 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:05:38.415 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:38.415 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.415 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.415 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:38.415 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644838+0000", 2024-04-18T21:05:38.416 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.569999999999999e-07 2024-04-18T21:05:38.416 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.416 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.416 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:38.416 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644846+0000", 2024-04-18T21:05:38.416 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.4499999999999998e-06 2024-04-18T21:05:38.416 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.416 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.416 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:38.416 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644861+0000", 2024-04-18T21:05:38.416 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5243e-05 2024-04-18T21:05:38.416 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.416 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.416 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:38.417 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644997+0000", 2024-04-18T21:05:38.417 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000135609 2024-04-18T21:05:38.417 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.417 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.417 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:38.417 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649150+0000", 2024-04-18T21:05:38.417 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0041536760000000002 2024-04-18T21:05:38.417 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.417 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.417 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:38.417 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649207+0000", 2024-04-18T21:05:38.417 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.6677e-05 2024-04-18T21:05:38.417 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.417 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.418 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:38.418 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.653840+0000", 2024-04-18T21:05:38.418 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0046329700000000001 2024-04-18T21:05:38.418 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.418 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.418 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:38.418 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.653935+0000", 2024-04-18T21:05:38.418 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.4856000000000001e-05 2024-04-18T21:05:38.418 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:38.418 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:38.418 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:38.418 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.418 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.418 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 3 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:05:38.419 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:05:38.419 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 32.681689712999997, 2024-04-18T21:05:38.419 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0087842319999999995, 2024-04-18T21:05:38.419 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:38.419 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:38.419 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "reached pg", 2024-04-18T21:05:38.419 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:38.419 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.421 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:38.422 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:05:38.422 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:38.422 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.422 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.422 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:38.422 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:05:38.422 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:38.422 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.422 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.422 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:38.422 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:05:38.422 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.8299999999999996e-07 2024-04-18T21:05:38.423 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.423 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.423 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:38.423 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647642+0000", 2024-04-18T21:05:38.423 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4724e-05 2024-04-18T21:05:38.423 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.423 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.423 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:38.423 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647679+0000", 2024-04-18T21:05:38.423 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.6662999999999998e-05 2024-04-18T21:05:38.423 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.423 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.423 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:38.424 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647735+0000", 2024-04-18T21:05:38.424 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.6196000000000002e-05 2024-04-18T21:05:38.424 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.424 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.424 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:38.424 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649865+0000", 2024-04-18T21:05:38.424 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0021299489999999999 2024-04-18T21:05:38.424 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.424 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.424 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:38.424 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656411+0000", 2024-04-18T21:05:38.424 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0065460170000000003 2024-04-18T21:05:38.424 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:38.424 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:38.424 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:38.424 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.425 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.425 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:38.425 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:05:38.425 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 32.681544516999999, 2024-04-18T21:05:38.425 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0095703190000000007, 2024-04-18T21:05:38.425 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:38.425 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:38.425 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:38.425 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:38.425 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.425 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:38.425 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:05:38.425 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:38.425 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.425 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.426 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:38.426 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:05:38.426 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:38.426 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.426 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.426 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:38.426 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647773+0000", 2024-04-18T21:05:38.426 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.046e-06 2024-04-18T21:05:38.426 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.426 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.426 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:38.426 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647795+0000", 2024-04-18T21:05:38.426 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2616000000000002e-05 2024-04-18T21:05:38.426 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.427 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.427 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:38.427 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647818+0000", 2024-04-18T21:05:38.427 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3110000000000001e-05 2024-04-18T21:05:38.427 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.427 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.427 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:38.427 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647834+0000", 2024-04-18T21:05:38.427 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5163e-05 2024-04-18T21:05:38.427 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.427 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.427 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:38.427 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650682+0000", 2024-04-18T21:05:38.427 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0028479759999999999 2024-04-18T21:05:38.427 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.427 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.428 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:38.428 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650730+0000", 2024-04-18T21:05:38.428 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.8375999999999999e-05 2024-04-18T21:05:38.428 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.428 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.428 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:38.428 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656751+0000", 2024-04-18T21:05:38.428 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0060211880000000002 2024-04-18T21:05:38.428 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.428 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.428 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:38.428 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657342+0000", 2024-04-18T21:05:38.428 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00059084399999999998 2024-04-18T21:05:38.428 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:38.428 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:38.429 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:38.429 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.429 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.429 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:38.429 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:05:38.429 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 32.681132230999999, 2024-04-18T21:05:38.429 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0092471759999999993, 2024-04-18T21:05:38.429 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:38.429 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:38.429 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:38.429 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:38.429 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.429 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:38.430 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:05:38.430 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:38.430 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.430 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.430 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:38.430 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:05:38.430 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:38.430 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.430 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.430 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:38.430 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648185+0000", 2024-04-18T21:05:38.430 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.5000000000000001e-07 2024-04-18T21:05:38.430 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.430 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.431 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:38.431 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648203+0000", 2024-04-18T21:05:38.431 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.8102999999999999e-05 2024-04-18T21:05:38.431 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.431 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.431 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:38.431 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648226+0000", 2024-04-18T21:05:38.431 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2921999999999998e-05 2024-04-18T21:05:38.431 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.431 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.431 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:38.431 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648241+0000", 2024-04-18T21:05:38.431 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5336999999999999e-05 2024-04-18T21:05:38.431 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.431 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.431 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:38.432 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.651268+0000", 2024-04-18T21:05:38.432 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0030271640000000002 2024-04-18T21:05:38.432 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.432 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.432 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:38.432 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.651319+0000", 2024-04-18T21:05:38.432 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.0843000000000001e-05 2024-04-18T21:05:38.432 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.432 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.432 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:38.432 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657347+0000", 2024-04-18T21:05:38.432 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0060279770000000003 2024-04-18T21:05:38.432 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:38.432 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:38.433 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:38.433 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657431+0000", 2024-04-18T21:05:38.433 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.3980000000000006e-05 2024-04-18T21:05:38.433 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:38.433 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:38.433 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:38.433 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:38.433 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:38.433 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:05:38.435 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:05:38.435 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:38.435+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:38.536 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:38.535+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:38.568 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:05:38.568 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:05:38.568 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-04-18T21:05:38.568 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:05:38.582 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:05:38.637 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:38.639+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:38.698 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:05:38.699 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:05:38.699 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-18T21:05:38.699 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-18T21:05:38.699 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:05:38.712 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:05:38.757 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:38.759+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:38.832 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:05:38.832 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-18T21:05:38.832 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-18T21:05:38.832 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:05:38.832 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.833 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:38.833 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:05:38.833 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 33.216713151, 2024-04-18T21:05:38.833 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.034065303999999998, 2024-04-18T21:05:38.833 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:38.833 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:38.833 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:38.833 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:38.833 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.833 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:38.833 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:05:38.833 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:38.833 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.833 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.834 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:38.834 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:05:38.834 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:38.834 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.834 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.834 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:38.834 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615254+0000", 2024-04-18T21:05:38.834 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7829999999999999e-06 2024-04-18T21:05:38.834 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.834 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.834 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:38.834 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615267+0000", 2024-04-18T21:05:38.834 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3334e-05 2024-04-18T21:05:38.835 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.835 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.835 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:38.835 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615294+0000", 2024-04-18T21:05:38.835 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7271999999999999e-05 2024-04-18T21:05:38.835 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.835 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.835 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:38.835 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615321+0000", 2024-04-18T21:05:38.835 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.637e-05 2024-04-18T21:05:38.835 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.835 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.835 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:38.835 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615479+0000", 2024-04-18T21:05:38.836 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000158493 2024-04-18T21:05:38.836 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.836 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.836 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:38.836 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615498+0000", 2024-04-18T21:05:38.836 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9148999999999999e-05 2024-04-18T21:05:38.836 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.836 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.836 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:38.836 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632915+0000", 2024-04-18T21:05:38.836 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.017416551999999998 2024-04-18T21:05:38.836 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.836 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.836 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:38.837 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633302+0000", 2024-04-18T21:05:38.837 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00038725000000000001 2024-04-18T21:05:38.837 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.837 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.837 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:38.837 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633638+0000", 2024-04-18T21:05:38.837 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000335946 2024-04-18T21:05:38.837 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.837 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.837 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:38.837 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645976+0000", 2024-04-18T21:05:38.837 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012337617 2024-04-18T21:05:38.837 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.837 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.838 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:38.838 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649080+0000", 2024-04-18T21:05:38.838 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031038929999999999 2024-04-18T21:05:38.838 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.838 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.838 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:38.838 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649207+0000", 2024-04-18T21:05:38.838 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000127537 2024-04-18T21:05:38.838 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.838 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.838 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:38.838 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649316+0000", 2024-04-18T21:05:38.839 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109108 2024-04-18T21:05:38.839 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:38.839 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:38.839 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:38.839 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.839 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.839 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:38.839 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:05:38.839 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 33.216579774000003, 2024-04-18T21:05:38.839 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036275764000000002, 2024-04-18T21:05:38.839 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:38.839 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:38.839 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:38.839 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:38.840 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.840 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:38.840 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:05:38.840 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:38.840 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.840 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.840 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:38.840 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:05:38.840 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:38.840 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.840 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.840 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:38.840 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615386+0000", 2024-04-18T21:05:38.840 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.573e-06 2024-04-18T21:05:38.840 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.841 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.841 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:38.841 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:05:38.841 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0723999999999999e-05 2024-04-18T21:05:38.841 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.841 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.841 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:38.841 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615418+0000", 2024-04-18T21:05:38.841 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0902000000000001e-05 2024-04-18T21:05:38.841 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.841 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.841 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:38.841 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615433+0000", 2024-04-18T21:05:38.841 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5319999999999999e-05 2024-04-18T21:05:38.841 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.842 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.842 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:38.842 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615659+0000", 2024-04-18T21:05:38.842 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000226095 2024-04-18T21:05:38.842 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.842 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.842 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:38.842 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:38.842 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1276e-05 2024-04-18T21:05:38.842 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.842 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.842 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:38.842 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643654+0000", 2024-04-18T21:05:38.842 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027983238000000001 2024-04-18T21:05:38.843 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.843 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.843 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:38.843 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643868+0000", 2024-04-18T21:05:38.843 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000214305 2024-04-18T21:05:38.843 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.843 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.843 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:38.843 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:05:38.843 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035892200000000002 2024-04-18T21:05:38.843 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.843 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.843 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:38.843 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646056+0000", 2024-04-18T21:05:38.844 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001829172 2024-04-18T21:05:38.844 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.844 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.844 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:38.844 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651406+0000", 2024-04-18T21:05:38.844 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0053504800000000003 2024-04-18T21:05:38.844 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.844 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.844 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:38.844 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651551+0000", 2024-04-18T21:05:38.844 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014427999999999999 2024-04-18T21:05:38.844 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.844 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.844 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:38.844 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651660+0000", 2024-04-18T21:05:38.845 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109477 2024-04-18T21:05:38.845 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:38.845 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:38.845 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:38.845 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.845 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.845 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:38.845 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:05:38.845 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 33.216506391999999, 2024-04-18T21:05:38.845 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045668994999999997, 2024-04-18T21:05:38.845 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:38.845 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:38.845 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:38.845 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:38.846 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.846 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:38.846 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:05:38.846 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:38.846 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.846 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.846 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:38.846 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:05:38.846 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:38.846 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.846 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.846 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:38.846 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615459+0000", 2024-04-18T21:05:38.847 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5030000000000001e-06 2024-04-18T21:05:38.847 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.847 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.847 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:38.847 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615506+0000", 2024-04-18T21:05:38.847 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6872000000000001e-05 2024-04-18T21:05:38.847 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.847 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.847 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:38.847 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615527+0000", 2024-04-18T21:05:38.847 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0763000000000001e-05 2024-04-18T21:05:38.847 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.847 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.848 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:38.848 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615551+0000", 2024-04-18T21:05:38.848 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4159e-05 2024-04-18T21:05:38.848 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.848 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.848 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:38.848 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615736+0000", 2024-04-18T21:05:38.848 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018499599999999999 2024-04-18T21:05:38.848 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.848 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.848 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:38.849 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615748+0000", 2024-04-18T21:05:38.849 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2272999999999999e-05 2024-04-18T21:05:38.849 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.849 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.849 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:38.849 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635481+0000", 2024-04-18T21:05:38.849 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019732772999999999 2024-04-18T21:05:38.849 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.849 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.849 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:38.849 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635791+0000", 2024-04-18T21:05:38.849 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031013299999999998 2024-04-18T21:05:38.850 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.850 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.850 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:38.850 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636101+0000", 2024-04-18T21:05:38.850 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030943300000000002 2024-04-18T21:05:38.850 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.850 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.850 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:38.850 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646043+0000", 2024-04-18T21:05:38.850 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099428139999999995 2024-04-18T21:05:38.850 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.850 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.850 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:38.850 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660991+0000", 2024-04-18T21:05:38.851 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014947142 2024-04-18T21:05:38.851 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.851 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.851 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:38.851 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661061+0000", 2024-04-18T21:05:38.851 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0438000000000006e-05 2024-04-18T21:05:38.851 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.851 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.851 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:38.851 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661127+0000", 2024-04-18T21:05:38.851 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5696000000000003e-05 2024-04-18T21:05:38.851 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:38.851 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:38.852 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:38.852 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.852 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.852 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:38.852 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:38.852 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 33.216293964000002, 2024-04-18T21:05:38.852 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045745085999999997, 2024-04-18T21:05:38.852 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:38.852 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:38.852 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:38.852 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:38.852 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.852 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:38.853 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:38.853 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:38.853 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.853 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.853 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:38.853 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:38.853 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:38.853 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.853 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.853 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:38.853 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:05:38.853 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7400000000000001e-06 2024-04-18T21:05:38.853 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.853 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.854 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:38.854 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:05:38.854 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8133e-05 2024-04-18T21:05:38.854 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.854 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.854 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:38.854 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615726+0000", 2024-04-18T21:05:38.854 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6132e-05 2024-04-18T21:05:38.854 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.854 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.854 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:38.854 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615742+0000", 2024-04-18T21:05:38.855 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6157000000000001e-05 2024-04-18T21:05:38.855 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.855 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.855 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:38.855 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615937+0000", 2024-04-18T21:05:38.855 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000194768 2024-04-18T21:05:38.855 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.855 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.855 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:38.855 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615950+0000", 2024-04-18T21:05:38.855 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3084e-05 2024-04-18T21:05:38.855 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.855 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.856 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:38.856 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643676+0000", 2024-04-18T21:05:38.856 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027725639999999999 2024-04-18T21:05:38.856 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.856 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.856 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:38.856 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643867+0000", 2024-04-18T21:05:38.856 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019075900000000001 2024-04-18T21:05:38.856 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.856 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.856 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:38.856 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:05:38.856 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036013799999999997 2024-04-18T21:05:38.856 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.857 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.857 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:38.857 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646068+0000", 2024-04-18T21:05:38.857 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001841536 2024-04-18T21:05:38.857 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.857 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.857 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:38.857 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661184+0000", 2024-04-18T21:05:38.857 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015115458999999999 2024-04-18T21:05:38.857 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.857 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.857 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:38.857 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661283+0000", 2024-04-18T21:05:38.857 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9502999999999999e-05 2024-04-18T21:05:38.858 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.858 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.858 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:38.858 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661415+0000", 2024-04-18T21:05:38.858 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000132037 2024-04-18T21:05:38.858 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:38.858 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:38.858 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:38.858 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.858 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.858 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:38.858 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:05:38.858 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 33.216172276999998, 2024-04-18T21:05:38.858 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036185947000000003, 2024-04-18T21:05:38.859 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:38.859 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:38.859 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:38.859 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:38.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:38.859 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:05:38.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:38.859 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:38.859 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:05:38.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:38.860 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.860 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:38.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615794+0000", 2024-04-18T21:05:38.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6440000000000001e-06 2024-04-18T21:05:38.860 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.860 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:38.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615803+0000", 2024-04-18T21:05:38.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1220000000000001e-06 2024-04-18T21:05:38.860 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.860 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:38.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615827+0000", 2024-04-18T21:05:38.861 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3997000000000001e-05 2024-04-18T21:05:38.861 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.861 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:38.861 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615899+0000", 2024-04-18T21:05:38.861 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2741e-05 2024-04-18T21:05:38.861 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.861 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:38.861 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616019+0000", 2024-04-18T21:05:38.861 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119874 2024-04-18T21:05:38.861 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.861 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:38.862 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616029+0000", 2024-04-18T21:05:38.862 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:05:38.862 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.862 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.862 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:38.862 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644823+0000", 2024-04-18T21:05:38.862 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.028793151999999999 2024-04-18T21:05:38.862 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.862 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.862 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:38.862 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645106+0000", 2024-04-18T21:05:38.862 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028379700000000002 2024-04-18T21:05:38.862 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.862 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.863 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:38.863 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645294+0000", 2024-04-18T21:05:38.863 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000187181 2024-04-18T21:05:38.863 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.863 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.863 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:38.863 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646763+0000", 2024-04-18T21:05:38.863 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0014691050000000001 2024-04-18T21:05:38.863 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.863 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.863 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:38.863 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651784+0000", 2024-04-18T21:05:38.863 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050211650000000002 2024-04-18T21:05:38.864 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.864 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.864 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:38.864 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651876+0000", 2024-04-18T21:05:38.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2503999999999994e-05 2024-04-18T21:05:38.864 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.864 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.864 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:38.864 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651978+0000", 2024-04-18T21:05:38.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000101475 2024-04-18T21:05:38.864 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:38.864 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:38.864 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:38.865 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.865 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.865 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:38.865 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:38.865 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 33.216023669999998, 2024-04-18T21:05:38.865 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032262322000000003, 2024-04-18T21:05:38.865 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:38.865 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:38.865 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:38.865 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:38.865 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.865 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:38.865 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:38.865 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:38.866 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.866 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.866 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:38.866 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:38.866 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:38.866 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.866 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.866 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:38.866 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615943+0000", 2024-04-18T21:05:38.866 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1959999999999998e-06 2024-04-18T21:05:38.866 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.866 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.866 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:38.866 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615956+0000", 2024-04-18T21:05:38.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3424000000000001e-05 2024-04-18T21:05:38.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:38.867 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615983+0000", 2024-04-18T21:05:38.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7072000000000001e-05 2024-04-18T21:05:38.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:38.867 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616006+0000", 2024-04-18T21:05:38.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2823000000000002e-05 2024-04-18T21:05:38.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.868 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:38.868 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616156+0000", 2024-04-18T21:05:38.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014962299999999999 2024-04-18T21:05:38.868 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.868 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.868 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:38.868 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616174+0000", 2024-04-18T21:05:38.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8082999999999999e-05 2024-04-18T21:05:38.868 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.868 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.868 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:38.868 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.629952+0000", 2024-04-18T21:05:38.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013778514 2024-04-18T21:05:38.869 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.869 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.869 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:38.869 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630201+0000", 2024-04-18T21:05:38.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024918100000000001 2024-04-18T21:05:38.869 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.869 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.869 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:38.869 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630386+0000", 2024-04-18T21:05:38.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018436900000000001 2024-04-18T21:05:38.869 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.869 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.869 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:38.869 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643169+0000", 2024-04-18T21:05:38.870 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012782774 2024-04-18T21:05:38.870 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.870 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.870 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:38.870 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.647924+0000", 2024-04-18T21:05:38.870 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004755787 2024-04-18T21:05:38.870 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.870 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.870 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:38.870 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648069+0000", 2024-04-18T21:05:38.870 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014459600000000001 2024-04-18T21:05:38.870 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.870 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.870 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:38.871 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648203+0000", 2024-04-18T21:05:38.871 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013388000000000001 2024-04-18T21:05:38.871 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:38.871 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:38.871 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:38.871 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.871 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.871 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:38.871 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:05:38.871 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 33.215915406000001, 2024-04-18T21:05:38.871 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032489736999999998, 2024-04-18T21:05:38.871 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:38.871 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:38.871 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:38.872 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:38.872 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.872 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:38.872 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:05:38.872 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:38.872 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.872 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.872 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:38.872 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:05:38.872 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:38.872 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.872 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.872 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:38.872 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616050+0000", 2024-04-18T21:05:38.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.606e-06 2024-04-18T21:05:38.873 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.873 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.873 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:38.873 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616061+0000", 2024-04-18T21:05:38.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0463e-05 2024-04-18T21:05:38.873 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.873 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.873 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:38.873 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616092+0000", 2024-04-18T21:05:38.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1415999999999999e-05 2024-04-18T21:05:38.873 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.873 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.874 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:38.874 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616109+0000", 2024-04-18T21:05:38.874 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6557000000000001e-05 2024-04-18T21:05:38.874 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.874 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.874 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:38.874 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616358+0000", 2024-04-18T21:05:38.874 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000249077 2024-04-18T21:05:38.874 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.874 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.874 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:38.874 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616370+0000", 2024-04-18T21:05:38.874 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2037e-05 2024-04-18T21:05:38.875 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.875 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.875 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:38.875 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.634920+0000", 2024-04-18T21:05:38.875 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018550397 2024-04-18T21:05:38.875 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.875 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.875 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:38.875 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640420+0000", 2024-04-18T21:05:38.875 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055000539999999999 2024-04-18T21:05:38.875 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.875 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.876 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:38.876 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648538+0000", 2024-04-18T21:05:38.876 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0081181299999999994 2024-04-18T21:05:38.876 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:38.876 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:38.876 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:38.876 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.876 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.876 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:38.876 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:05:38.876 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 33.215831084999998, 2024-04-18T21:05:38.876 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036090029000000003, 2024-04-18T21:05:38.876 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:38.876 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:38.876 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:38.876 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:38.876 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.877 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:38.877 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:05:38.877 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:38.877 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.877 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.877 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:38.877 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:05:38.877 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:38.877 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.877 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.877 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:38.877 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616134+0000", 2024-04-18T21:05:38.877 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.353e-06 2024-04-18T21:05:38.877 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.877 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.877 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:38.878 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616141+0000", 2024-04-18T21:05:38.878 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2770000000000002e-06 2024-04-18T21:05:38.878 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.878 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.878 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:38.878 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616160+0000", 2024-04-18T21:05:38.878 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.91e-05 2024-04-18T21:05:38.878 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.878 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.878 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:38.878 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616170+0000", 2024-04-18T21:05:38.878 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7699999999999996e-06 2024-04-18T21:05:38.878 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.878 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.879 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:38.879 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616275+0000", 2024-04-18T21:05:38.879 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105313 2024-04-18T21:05:38.879 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.879 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.879 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:38.879 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616288+0000", 2024-04-18T21:05:38.879 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3027000000000001e-05 2024-04-18T21:05:38.879 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.879 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.879 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:38.879 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646160+0000", 2024-04-18T21:05:38.879 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.029872019 2024-04-18T21:05:38.879 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.879 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.879 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:38.880 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646368+0000", 2024-04-18T21:05:38.880 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020811899999999999 2024-04-18T21:05:38.880 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.880 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.880 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:38.880 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652223+0000", 2024-04-18T21:05:38.880 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.005855051 2024-04-18T21:05:38.880 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:38.880 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:38.880 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:38.880 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.880 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.880 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:38.880 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:05:38.881 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 33.215773515999999, 2024-04-18T21:05:38.881 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043572403000000003, 2024-04-18T21:05:38.881 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:38.881 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:38.881 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:38.881 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:38.881 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.881 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:38.881 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:05:38.881 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:38.881 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.881 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.881 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:38.881 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:05:38.882 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:38.882 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.882 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.882 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:38.882 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616192+0000", 2024-04-18T21:05:38.882 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:05:38.882 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.882 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.882 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:38.882 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616203+0000", 2024-04-18T21:05:38.882 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0890000000000001e-05 2024-04-18T21:05:38.882 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.882 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.883 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:38.883 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616223+0000", 2024-04-18T21:05:38.883 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0409000000000001e-05 2024-04-18T21:05:38.883 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.883 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.883 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:38.883 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616238+0000", 2024-04-18T21:05:38.883 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5160000000000001e-05 2024-04-18T21:05:38.883 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.883 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.883 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:38.883 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616343+0000", 2024-04-18T21:05:38.883 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000104831 2024-04-18T21:05:38.883 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.884 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.884 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:38.884 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616357+0000", 2024-04-18T21:05:38.884 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3686000000000001e-05 2024-04-18T21:05:38.884 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.884 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.884 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:38.884 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635912+0000", 2024-04-18T21:05:38.884 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019554944000000001 2024-04-18T21:05:38.884 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.884 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.884 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:38.884 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636231+0000", 2024-04-18T21:05:38.884 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000318766 2024-04-18T21:05:38.885 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.885 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.885 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:38.885 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659763+0000", 2024-04-18T21:05:38.885 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023532474000000001 2024-04-18T21:05:38.885 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:38.885 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:38.885 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:38.885 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.885 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.885 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:38.885 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:05:38.885 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 33.211844808999999, 2024-04-18T21:05:38.885 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015007971, 2024-04-18T21:05:38.886 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:38.886 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:38.886 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:38.886 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:38.886 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.886 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:38.886 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:05:38.886 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:38.886 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.886 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.886 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:38.886 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:05:38.886 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:38.886 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.887 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.887 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:38.887 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620120+0000", 2024-04-18T21:05:38.887 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0359999999999999e-06 2024-04-18T21:05:38.887 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.887 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.887 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:38.887 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620157+0000", 2024-04-18T21:05:38.887 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6636e-05 2024-04-18T21:05:38.887 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.887 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.887 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:38.887 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620177+0000", 2024-04-18T21:05:38.887 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0247000000000001e-05 2024-04-18T21:05:38.887 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.888 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.888 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:38.888 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620195+0000", 2024-04-18T21:05:38.888 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7819e-05 2024-04-18T21:05:38.888 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.888 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.888 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:38.888 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620342+0000", 2024-04-18T21:05:38.888 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014643300000000001 2024-04-18T21:05:38.888 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.888 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.888 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:38.889 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620405+0000", 2024-04-18T21:05:38.889 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3522000000000006e-05 2024-04-18T21:05:38.889 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.889 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.889 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:38.889 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635016+0000", 2024-04-18T21:05:38.889 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014610840999999999 2024-04-18T21:05:38.889 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.889 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.889 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:38.889 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635127+0000", 2024-04-18T21:05:38.889 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111437 2024-04-18T21:05:38.889 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:38.889 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:38.890 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:38.890 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.890 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.890 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:38.890 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:05:38.890 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 33.211737540999998, 2024-04-18T21:05:38.890 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012693296, 2024-04-18T21:05:38.890 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:38.890 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:38.890 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:38.890 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:38.890 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.890 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:38.890 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:05:38.891 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:38.891 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.891 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.891 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:38.891 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:05:38.891 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:38.891 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.891 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.891 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:38.891 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620228+0000", 2024-04-18T21:05:38.891 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:05:38.891 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.891 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.891 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:38.892 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620236+0000", 2024-04-18T21:05:38.892 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.303e-06 2024-04-18T21:05:38.892 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.892 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.892 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:38.892 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620255+0000", 2024-04-18T21:05:38.892 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9406e-05 2024-04-18T21:05:38.892 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.892 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.892 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:38.892 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620274+0000", 2024-04-18T21:05:38.892 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8940000000000002e-05 2024-04-18T21:05:38.892 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.892 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.893 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:38.893 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:05:38.893 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001558753 2024-04-18T21:05:38.893 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.893 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.893 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:38.893 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621879+0000", 2024-04-18T21:05:38.893 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6359000000000001e-05 2024-04-18T21:05:38.893 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.893 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.893 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:38.893 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632841+0000", 2024-04-18T21:05:38.893 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010961907 2024-04-18T21:05:38.894 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.894 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.894 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:38.894 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632920+0000", 2024-04-18T21:05:38.894 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8714999999999994e-05 2024-04-18T21:05:38.894 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:38.894 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:38.894 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:38.894 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.894 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.894 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:38.894 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:05:38.894 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 33.210191778000002, 2024-04-18T21:05:38.894 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013445702, 2024-04-18T21:05:38.895 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:38.895 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:38.895 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:38.895 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:38.895 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.895 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:38.895 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:05:38.895 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:38.895 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.895 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.895 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:38.895 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:05:38.895 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:38.895 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.896 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.896 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:38.896 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621774+0000", 2024-04-18T21:05:38.896 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2500000000000001e-06 2024-04-18T21:05:38.896 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.896 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.896 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:38.896 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621786+0000", 2024-04-18T21:05:38.896 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2636000000000001e-05 2024-04-18T21:05:38.896 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.896 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.896 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:38.896 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621814+0000", 2024-04-18T21:05:38.896 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7823000000000001e-05 2024-04-18T21:05:38.897 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.897 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.897 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:38.897 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621844+0000", 2024-04-18T21:05:38.897 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9589000000000001e-05 2024-04-18T21:05:38.897 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.897 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.897 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:38.897 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622253+0000", 2024-04-18T21:05:38.897 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040963700000000002 2024-04-18T21:05:38.897 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.897 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.897 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:38.897 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622304+0000", 2024-04-18T21:05:38.898 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0868999999999997e-05 2024-04-18T21:05:38.898 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.898 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.898 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:38.898 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635133+0000", 2024-04-18T21:05:38.898 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012829136 2024-04-18T21:05:38.898 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.898 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.898 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:38.898 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635218+0000", 2024-04-18T21:05:38.899 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4761999999999999e-05 2024-04-18T21:05:38.899 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:38.899 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:38.899 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:38.899 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.899 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.899 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:38.899 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:05:38.899 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 33.210065018000002, 2024-04-18T21:05:38.899 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014162065, 2024-04-18T21:05:38.899 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:38.899 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:38.899 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:38.899 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:38.900 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.900 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:38.900 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:05:38.900 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:38.900 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.900 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.900 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:38.900 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:05:38.900 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:38.900 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.900 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.900 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:38.900 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621900+0000", 2024-04-18T21:05:38.900 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:05:38.901 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.901 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.901 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:38.901 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621910+0000", 2024-04-18T21:05:38.901 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0207000000000001e-05 2024-04-18T21:05:38.901 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.901 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.901 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:38.901 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621932+0000", 2024-04-18T21:05:38.901 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1789000000000001e-05 2024-04-18T21:05:38.901 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.901 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.901 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:38.901 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621946+0000", 2024-04-18T21:05:38.901 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4212999999999999e-05 2024-04-18T21:05:38.902 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.902 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.902 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:38.902 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624477+0000", 2024-04-18T21:05:38.902 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025303470000000001 2024-04-18T21:05:38.902 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.902 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.902 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:38.902 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624525+0000", 2024-04-18T21:05:38.902 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8084999999999998e-05 2024-04-18T21:05:38.902 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.902 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.902 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:38.902 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635976+0000", 2024-04-18T21:05:38.903 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.011451368999999999 2024-04-18T21:05:38.903 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.903 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.903 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:38.903 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636061+0000", 2024-04-18T21:05:38.903 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5094999999999998e-05 2024-04-18T21:05:38.903 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:38.903 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:38.903 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:38.903 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.903 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.903 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:05:38.903 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:05:38.903 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 33.200829392999999, 2024-04-18T21:05:38.903 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0098014739999999993, 2024-04-18T21:05:38.904 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:38.904 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:38.904 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:05:38.904 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:38.904 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.904 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:38.904 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:05:38.904 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:38.904 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.904 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.904 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:38.904 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:05:38.905 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:38.905 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.905 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.905 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:38.905 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631136+0000", 2024-04-18T21:05:38.905 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0139999999999999e-06 2024-04-18T21:05:38.905 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.905 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.905 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:38.905 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631152+0000", 2024-04-18T21:05:38.905 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6365999999999999e-05 2024-04-18T21:05:38.905 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.905 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.905 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:38.905 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631961+0000", 2024-04-18T21:05:38.906 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00080873100000000003 2024-04-18T21:05:38.906 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.906 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.906 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:38.906 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632021+0000", 2024-04-18T21:05:38.906 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0541999999999997e-05 2024-04-18T21:05:38.906 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.906 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.906 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:38.906 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633539+0000", 2024-04-18T21:05:38.906 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015175639999999999 2024-04-18T21:05:38.906 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.906 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.906 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:38.907 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640936+0000", 2024-04-18T21:05:38.907 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007397257 2024-04-18T21:05:38.907 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:38.907 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:38.907 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:38.907 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.907 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.907 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-18T21:05:38.907 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:05:38.907 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 33.183367959999998, 2024-04-18T21:05:38.907 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00073592199999999997, 2024-04-18T21:05:38.907 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:38.907 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:38.907 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:38.908 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:38.908 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.908 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:38.908 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:05:38.908 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:38.908 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.908 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.908 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:38.908 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:05:38.908 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:38.908 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.908 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.908 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:38.908 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648597+0000", 2024-04-18T21:05:38.908 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:05:38.909 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.909 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.909 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:38.909 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648605+0000", 2024-04-18T21:05:38.909 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3960000000000006e-06 2024-04-18T21:05:38.909 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.909 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.909 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:38.909 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648625+0000", 2024-04-18T21:05:38.909 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9987e-05 2024-04-18T21:05:38.909 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.909 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.909 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:38.910 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648643+0000", 2024-04-18T21:05:38.910 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7079e-05 2024-04-18T21:05:38.910 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.910 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.910 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:38.910 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649043+0000", 2024-04-18T21:05:38.910 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040083399999999998 2024-04-18T21:05:38.910 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.910 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.910 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:38.910 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649062+0000", 2024-04-18T21:05:38.910 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9052999999999999e-05 2024-04-18T21:05:38.910 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.910 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.911 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:38.911 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649332+0000", 2024-04-18T21:05:38.911 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026971999999999999 2024-04-18T21:05:38.911 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:38.911 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:38.911 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:38.911 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.911 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.911 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:05:38.911 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:05:38.911 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 33.180593059000003, 2024-04-18T21:05:38.911 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00086123999999999999, 2024-04-18T21:05:38.911 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:38.911 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:38.912 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:05:38.912 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:38.912 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.912 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:38.912 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:05:38.912 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:38.912 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.912 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.912 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:38.912 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:05:38.912 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:38.912 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.912 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.912 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:38.913 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651372+0000", 2024-04-18T21:05:38.913 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7599999999999997e-07 2024-04-18T21:05:38.913 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.913 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.913 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:38.913 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651377+0000", 2024-04-18T21:05:38.913 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.22e-06 2024-04-18T21:05:38.913 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.913 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.913 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:38.913 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651394+0000", 2024-04-18T21:05:38.913 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6646999999999998e-05 2024-04-18T21:05:38.913 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.913 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.913 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:38.914 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651427+0000", 2024-04-18T21:05:38.914 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3682e-05 2024-04-18T21:05:38.914 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.914 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.914 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:38.914 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652029+0000", 2024-04-18T21:05:38.914 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00060152199999999995 2024-04-18T21:05:38.914 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.914 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.914 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:38.914 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652232+0000", 2024-04-18T21:05:38.914 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020359299999999999 2024-04-18T21:05:38.915 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:38.915 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:38.915 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:38.915 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.915 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.915 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:05:38.915 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:05:38.915 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 33.172566097000001, 2024-04-18T21:05:38.915 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0017426200000000001, 2024-04-18T21:05:38.915 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:38.915 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:38.915 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:38.915 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:38.915 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.915 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:38.916 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:05:38.916 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:38.916 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.916 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.916 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:38.916 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:05:38.916 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:38.916 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.916 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.916 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:38.916 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659399+0000", 2024-04-18T21:05:38.916 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6000000000000002e-07 2024-04-18T21:05:38.916 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.916 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.916 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:38.917 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659405+0000", 2024-04-18T21:05:38.917 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5069999999999997e-06 2024-04-18T21:05:38.917 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.917 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.917 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:38.917 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659425+0000", 2024-04-18T21:05:38.917 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.927e-05 2024-04-18T21:05:38.917 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.917 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.917 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:38.917 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659443+0000", 2024-04-18T21:05:38.917 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8051999999999999e-05 2024-04-18T21:05:38.917 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.917 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.918 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:38.918 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660973+0000", 2024-04-18T21:05:38.918 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001530106 2024-04-18T21:05:38.918 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.918 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.918 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:38.918 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660983+0000", 2024-04-18T21:05:38.918 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0516999999999999e-05 2024-04-18T21:05:38.918 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.918 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.918 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:38.918 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661141+0000", 2024-04-18T21:05:38.918 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015730799999999999 2024-04-18T21:05:38.918 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:38.918 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:38.919 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:38.919 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.919 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.919 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:05:38.919 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:05:38.919 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 33.172349472000001, 2024-04-18T21:05:38.919 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001812311, 2024-04-18T21:05:38.919 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:38.919 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:38.919 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:38.919 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:38.919 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.919 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:38.919 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:05:38.920 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:38.920 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.920 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.920 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:38.920 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:05:38.920 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:38.920 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.920 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.920 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:38.920 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659616+0000", 2024-04-18T21:05:38.920 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.277e-06 2024-04-18T21:05:38.920 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.920 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.920 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:38.920 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659625+0000", 2024-04-18T21:05:38.920 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5359999999999998e-06 2024-04-18T21:05:38.921 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.921 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.921 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:38.921 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659647+0000", 2024-04-18T21:05:38.921 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1857000000000001e-05 2024-04-18T21:05:38.921 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.921 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.921 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:38.921 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659664+0000", 2024-04-18T21:05:38.921 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6405999999999998e-05 2024-04-18T21:05:38.921 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.921 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.921 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:38.921 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661169+0000", 2024-04-18T21:05:38.921 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015054179999999999 2024-04-18T21:05:38.922 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.922 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.922 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:38.922 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661177+0000", 2024-04-18T21:05:38.922 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9680000000000006e-06 2024-04-18T21:05:38.922 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.922 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.922 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:38.922 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661427+0000", 2024-04-18T21:05:38.922 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024984900000000001 2024-04-18T21:05:38.922 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:38.922 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:38.923 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:38.923 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.923 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.923 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-18T21:05:38.923 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:05:38.923 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 31.219428864000001, 2024-04-18T21:05:38.923 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0030975030000000001, 2024-04-18T21:05:38.923 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:38.923 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:38.923 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:38.923 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:38.923 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.923 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:38.923 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:05:38.924 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:38.924 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.924 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.924 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:38.924 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:05:38.924 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:38.924 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.924 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.924 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:38.924 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612538+0000", 2024-04-18T21:05:38.924 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6259999999999999e-06 2024-04-18T21:05:38.924 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.924 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.924 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:38.924 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612552+0000", 2024-04-18T21:05:38.924 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4073999999999999e-05 2024-04-18T21:05:38.925 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.925 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.925 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:38.925 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612585+0000", 2024-04-18T21:05:38.925 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3504999999999999e-05 2024-04-18T21:05:38.925 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.925 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.925 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:38.925 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612601+0000", 2024-04-18T21:05:38.925 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5194000000000001e-05 2024-04-18T21:05:38.925 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.925 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.925 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:38.925 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612746+0000", 2024-04-18T21:05:38.925 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145666 2024-04-18T21:05:38.926 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.926 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.926 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:38.926 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612953+0000", 2024-04-18T21:05:38.926 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000207109 2024-04-18T21:05:38.926 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.926 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.926 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:38.926 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.613134+0000", 2024-04-18T21:05:38.926 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018041300000000001 2024-04-18T21:05:38.926 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.926 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.926 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:38.926 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.614411+0000", 2024-04-18T21:05:38.927 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0012769929999999999 2024-04-18T21:05:38.927 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.927 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.927 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:38.927 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615441+0000", 2024-04-18T21:05:38.927 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001029917 2024-04-18T21:05:38.927 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.927 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.927 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:38.927 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615522+0000", 2024-04-18T21:05:38.927 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1142000000000003e-05 2024-04-18T21:05:38.927 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.927 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.927 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:38.927 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615633+0000", 2024-04-18T21:05:38.928 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000110864 2024-04-18T21:05:38.928 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:38.928 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:38.928 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:38.928 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.928 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.928 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-18T21:05:38.928 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:05:38.928 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.217143052999999, 2024-04-18T21:05:38.928 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088979039999999999, 2024-04-18T21:05:38.928 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:38.928 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:38.928 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:38.928 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:38.928 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.928 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:38.929 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:05:38.929 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:38.929 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.929 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.929 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:38.929 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:05:38.929 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:38.929 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.929 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.929 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:38.929 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614825+0000", 2024-04-18T21:05:38.929 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4829999999999999e-06 2024-04-18T21:05:38.929 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.929 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.929 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:38.930 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614843+0000", 2024-04-18T21:05:38.930 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8777e-05 2024-04-18T21:05:38.930 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.930 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.930 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:38.930 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614884+0000", 2024-04-18T21:05:38.930 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1051999999999999e-05 2024-04-18T21:05:38.930 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.930 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.930 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:38.930 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614903+0000", 2024-04-18T21:05:38.930 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9069999999999999e-05 2024-04-18T21:05:38.930 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.930 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.931 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:38.931 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615047+0000", 2024-04-18T21:05:38.931 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014374400000000001 2024-04-18T21:05:38.931 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.931 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.931 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:38.931 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615061+0000", 2024-04-18T21:05:38.931 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4063000000000001e-05 2024-04-18T21:05:38.931 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.931 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.931 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:38.931 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621064+0000", 2024-04-18T21:05:38.931 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0060029200000000001 2024-04-18T21:05:38.931 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.931 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.932 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:38.932 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621211+0000", 2024-04-18T21:05:38.932 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000147224 2024-04-18T21:05:38.932 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.932 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.932 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:38.932 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621396+0000", 2024-04-18T21:05:38.932 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018454699999999999 2024-04-18T21:05:38.932 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.932 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.932 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:38.933 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.622517+0000", 2024-04-18T21:05:38.933 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001121424 2024-04-18T21:05:38.933 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.933 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.933 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:38.933 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623571+0000", 2024-04-18T21:05:38.933 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010538660000000001 2024-04-18T21:05:38.933 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.933 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.933 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:38.933 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623658+0000", 2024-04-18T21:05:38.933 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6439000000000004e-05 2024-04-18T21:05:38.933 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:38.933 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:38.933 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:38.933 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623719+0000", 2024-04-18T21:05:38.934 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1295000000000002e-05 2024-04-18T21:05:38.934 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:38.934 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:38.934 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:38.934 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:38.934 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:38.934 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:05:38.934 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-18T21:05:38.936 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:38.935+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:38.936 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:05:39.037 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:39.035+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:39.042 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:05:39.068 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:05:39.068 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:05:39.068 INFO:teuthology.orchestra.run.smithi132.stdout: "num_ops": 0 2024-04-18T21:05:39.068 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:05:39.082 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:05:39.167 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:39.167+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:39.188 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:05:39.188 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:05:39.209 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1: {} 2024-04-18T21:05:39.209 INFO:teuthology.orchestra.run.smithi078.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:05:39.229 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:05:39.229 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:05:39.239 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:39.239+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:39.245 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:39.246 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:39.260 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:05:39.340 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:39.339+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:39.428 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:39.428 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:39.440 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:39.439+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:39.443 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:05:39.541 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:39.543+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:39.574 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:39.574 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:39.589 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:05:39.642 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:39.643+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:39.706 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:39.707 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:39.721 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:05:39.743 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:39.743+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:39.837 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:39.837 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:39.843 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:39.843+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:39.848 INFO:teuthology.orchestra.run.smithi078.stderr:noscrub is unset 2024-04-18T21:05:39.852 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:05:39.944 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:39.943+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:39.983 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:39.983 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:39.997 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:05:40.089 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:40.091+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:40.145 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:40.147+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:40.156 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:40.157 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:40.169 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:05:40.246 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:40.247+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:40.333 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:40.333 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:40.347 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:05:40.348 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:40.347+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:40.448 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:40.447+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:40.477 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:40.477 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:40.491 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:05:40.549 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:40.551+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:40.609 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:40.609 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:40.623 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:05:40.649 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:40.651+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:40.744 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:40.744 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:40.750 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:40.751+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:40.758 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:05:40.851 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:40.851+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:40.885 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:40.885 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:40.900 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:05:40.951 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:40.951+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:41.052 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:41.051+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:41.060 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:41.060 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:41.073 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:05:41.153 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:41.155+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:41.178 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:41.179 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:41.193 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:05:41.246 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:05:41.253 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:41.255+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:41.322 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:41.323 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:41.337 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:05:41.382 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:41.383+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:41.406 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:05:41.406 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:05:41.427 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1: {} 2024-04-18T21:05:41.525 INFO:teuthology.orchestra.run.smithi078.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:05:41.525 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:05:41.526 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:05:41.527 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:05:41.527 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:05:41.527 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-18T21:05:41.528 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-18T21:05:41.528 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:05:41.528 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:05:41.528 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:41.527+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:41.628 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:41.627+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:41.696 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:05:41.696 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-18T21:05:41.696 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-18T21:05:41.696 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:05:41.697 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.697 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:41.697 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:05:41.697 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 36.080659095999998, 2024-04-18T21:05:41.697 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.034065303999999998, 2024-04-18T21:05:41.697 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:41.697 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:41.697 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:41.697 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:41.697 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.697 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:41.697 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:05:41.697 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:41.697 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.698 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.698 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:41.698 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:05:41.698 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:41.698 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.698 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.698 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:41.698 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615254+0000", 2024-04-18T21:05:41.698 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7829999999999999e-06 2024-04-18T21:05:41.698 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.698 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.698 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:41.699 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615267+0000", 2024-04-18T21:05:41.699 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3334e-05 2024-04-18T21:05:41.699 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.699 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.699 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:41.699 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615294+0000", 2024-04-18T21:05:41.699 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7271999999999999e-05 2024-04-18T21:05:41.699 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.699 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.699 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:41.699 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615321+0000", 2024-04-18T21:05:41.699 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.637e-05 2024-04-18T21:05:41.699 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.700 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.700 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:41.700 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615479+0000", 2024-04-18T21:05:41.700 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000158493 2024-04-18T21:05:41.700 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.700 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.700 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:41.700 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615498+0000", 2024-04-18T21:05:41.700 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9148999999999999e-05 2024-04-18T21:05:41.700 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.700 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.700 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:41.700 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632915+0000", 2024-04-18T21:05:41.701 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.017416551999999998 2024-04-18T21:05:41.701 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.701 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.701 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:41.701 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633302+0000", 2024-04-18T21:05:41.701 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00038725000000000001 2024-04-18T21:05:41.701 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.701 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.701 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:41.701 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633638+0000", 2024-04-18T21:05:41.701 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000335946 2024-04-18T21:05:41.701 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.701 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.701 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:41.702 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645976+0000", 2024-04-18T21:05:41.702 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012337617 2024-04-18T21:05:41.702 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.702 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.702 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:41.702 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649080+0000", 2024-04-18T21:05:41.702 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031038929999999999 2024-04-18T21:05:41.702 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.702 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.702 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:41.702 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649207+0000", 2024-04-18T21:05:41.702 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000127537 2024-04-18T21:05:41.702 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.702 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.703 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:41.703 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649316+0000", 2024-04-18T21:05:41.703 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109108 2024-04-18T21:05:41.703 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:41.703 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:41.703 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:41.703 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.703 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.703 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:41.703 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:05:41.703 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 36.080525719000001, 2024-04-18T21:05:41.703 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036275764000000002, 2024-04-18T21:05:41.703 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:41.704 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:41.704 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:41.704 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:41.704 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.704 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:41.704 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:05:41.704 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:41.704 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.704 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.704 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:41.704 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:05:41.704 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:41.704 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.704 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.705 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:41.705 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615386+0000", 2024-04-18T21:05:41.705 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.573e-06 2024-04-18T21:05:41.705 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.705 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.705 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:41.705 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:05:41.705 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0723999999999999e-05 2024-04-18T21:05:41.705 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.705 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.705 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:41.705 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615418+0000", 2024-04-18T21:05:41.705 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0902000000000001e-05 2024-04-18T21:05:41.705 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.705 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.706 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:41.706 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615433+0000", 2024-04-18T21:05:41.706 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5319999999999999e-05 2024-04-18T21:05:41.706 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.706 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.706 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:41.706 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615659+0000", 2024-04-18T21:05:41.706 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000226095 2024-04-18T21:05:41.706 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.706 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.706 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:41.706 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:41.706 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1276e-05 2024-04-18T21:05:41.707 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.707 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.707 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:41.707 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643654+0000", 2024-04-18T21:05:41.707 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027983238000000001 2024-04-18T21:05:41.707 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.707 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.707 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:41.707 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643868+0000", 2024-04-18T21:05:41.707 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000214305 2024-04-18T21:05:41.707 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.707 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.707 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:41.707 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:05:41.707 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035892200000000002 2024-04-18T21:05:41.708 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.708 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.708 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:41.708 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646056+0000", 2024-04-18T21:05:41.708 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001829172 2024-04-18T21:05:41.708 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.708 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.708 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:41.708 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651406+0000", 2024-04-18T21:05:41.708 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0053504800000000003 2024-04-18T21:05:41.708 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.708 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.708 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:41.709 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651551+0000", 2024-04-18T21:05:41.709 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014427999999999999 2024-04-18T21:05:41.709 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.709 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.709 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:41.709 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651660+0000", 2024-04-18T21:05:41.709 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109477 2024-04-18T21:05:41.709 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:41.709 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:41.709 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:41.709 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.709 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.709 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:41.710 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:05:41.710 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 36.080452336999997, 2024-04-18T21:05:41.710 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045668994999999997, 2024-04-18T21:05:41.710 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:41.710 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:41.710 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:41.710 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:41.710 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.710 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:41.710 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:05:41.710 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:41.710 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.710 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.711 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:41.711 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:05:41.711 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:41.711 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.711 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.711 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:41.711 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615459+0000", 2024-04-18T21:05:41.711 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5030000000000001e-06 2024-04-18T21:05:41.711 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.711 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.711 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:41.711 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615506+0000", 2024-04-18T21:05:41.711 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6872000000000001e-05 2024-04-18T21:05:41.711 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.712 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.712 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:41.712 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615527+0000", 2024-04-18T21:05:41.712 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0763000000000001e-05 2024-04-18T21:05:41.712 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.712 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.712 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:41.712 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615551+0000", 2024-04-18T21:05:41.712 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4159e-05 2024-04-18T21:05:41.712 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.712 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.712 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:41.712 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615736+0000", 2024-04-18T21:05:41.712 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018499599999999999 2024-04-18T21:05:41.712 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.713 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.713 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:41.713 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615748+0000", 2024-04-18T21:05:41.713 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2272999999999999e-05 2024-04-18T21:05:41.713 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.713 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.713 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:41.713 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635481+0000", 2024-04-18T21:05:41.713 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019732772999999999 2024-04-18T21:05:41.713 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.713 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.713 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:41.713 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635791+0000", 2024-04-18T21:05:41.713 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031013299999999998 2024-04-18T21:05:41.714 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.714 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.714 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:41.714 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636101+0000", 2024-04-18T21:05:41.714 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030943300000000002 2024-04-18T21:05:41.714 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.714 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.714 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:41.714 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646043+0000", 2024-04-18T21:05:41.714 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099428139999999995 2024-04-18T21:05:41.714 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.714 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.714 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:41.714 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660991+0000", 2024-04-18T21:05:41.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014947142 2024-04-18T21:05:41.715 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.715 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.715 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:41.715 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661061+0000", 2024-04-18T21:05:41.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0438000000000006e-05 2024-04-18T21:05:41.715 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.715 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.715 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:41.715 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661127+0000", 2024-04-18T21:05:41.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5696000000000003e-05 2024-04-18T21:05:41.715 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:41.715 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:41.716 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:41.716 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.716 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.716 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:41.716 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:41.716 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 36.080239908999999, 2024-04-18T21:05:41.716 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045745085999999997, 2024-04-18T21:05:41.716 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:41.716 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:41.716 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:41.716 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:41.716 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.716 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:41.716 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:41.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:41.717 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.717 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:41.717 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:41.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:41.717 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.717 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:41.717 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:05:41.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7400000000000001e-06 2024-04-18T21:05:41.717 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:41.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:05:41.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8133e-05 2024-04-18T21:05:41.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:41.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615726+0000", 2024-04-18T21:05:41.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6132e-05 2024-04-18T21:05:41.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:41.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615742+0000", 2024-04-18T21:05:41.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6157000000000001e-05 2024-04-18T21:05:41.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.719 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:41.719 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615937+0000", 2024-04-18T21:05:41.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000194768 2024-04-18T21:05:41.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.719 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:41.719 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615950+0000", 2024-04-18T21:05:41.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3084e-05 2024-04-18T21:05:41.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.719 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:41.719 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643676+0000", 2024-04-18T21:05:41.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027725639999999999 2024-04-18T21:05:41.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:41.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643867+0000", 2024-04-18T21:05:41.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019075900000000001 2024-04-18T21:05:41.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:41.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:05:41.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036013799999999997 2024-04-18T21:05:41.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:41.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646068+0000", 2024-04-18T21:05:41.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001841536 2024-04-18T21:05:41.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:41.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661184+0000", 2024-04-18T21:05:41.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015115458999999999 2024-04-18T21:05:41.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:41.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661283+0000", 2024-04-18T21:05:41.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9502999999999999e-05 2024-04-18T21:05:41.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:41.722 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661415+0000", 2024-04-18T21:05:41.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000132037 2024-04-18T21:05:41.722 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:41.722 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:41.722 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:41.722 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.722 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.722 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:41.722 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:05:41.722 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 36.080118222000003, 2024-04-18T21:05:41.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036185947000000003, 2024-04-18T21:05:41.722 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:41.722 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:41.723 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:41.723 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:41.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:41.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:05:41.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:41.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:41.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:05:41.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:41.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:41.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615794+0000", 2024-04-18T21:05:41.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6440000000000001e-06 2024-04-18T21:05:41.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.724 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:41.724 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615803+0000", 2024-04-18T21:05:41.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1220000000000001e-06 2024-04-18T21:05:41.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.724 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:41.724 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615827+0000", 2024-04-18T21:05:41.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3997000000000001e-05 2024-04-18T21:05:41.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:41.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615899+0000", 2024-04-18T21:05:41.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2741e-05 2024-04-18T21:05:41.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:41.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616019+0000", 2024-04-18T21:05:41.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119874 2024-04-18T21:05:41.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:41.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616029+0000", 2024-04-18T21:05:41.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:05:41.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.726 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.726 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:41.726 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644823+0000", 2024-04-18T21:05:41.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.028793151999999999 2024-04-18T21:05:41.726 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.726 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.726 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:41.726 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645106+0000", 2024-04-18T21:05:41.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028379700000000002 2024-04-18T21:05:41.726 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.726 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.726 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:41.726 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645294+0000", 2024-04-18T21:05:41.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000187181 2024-04-18T21:05:41.727 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:41.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646763+0000", 2024-04-18T21:05:41.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0014691050000000001 2024-04-18T21:05:41.727 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:41.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651784+0000", 2024-04-18T21:05:41.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050211650000000002 2024-04-18T21:05:41.727 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:41.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651876+0000", 2024-04-18T21:05:41.728 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2503999999999994e-05 2024-04-18T21:05:41.728 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.728 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:41.728 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651978+0000", 2024-04-18T21:05:41.728 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000101475 2024-04-18T21:05:41.728 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:41.728 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:41.728 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:41.728 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.728 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:41.728 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:41.728 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 36.079969615000003, 2024-04-18T21:05:41.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032262322000000003, 2024-04-18T21:05:41.729 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:41.729 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:41.729 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:41.729 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:41.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.729 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:41.729 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:41.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:41.729 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.729 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:41.730 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:41.730 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:41.730 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.730 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:41.730 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615943+0000", 2024-04-18T21:05:41.730 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1959999999999998e-06 2024-04-18T21:05:41.730 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.730 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:41.730 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615956+0000", 2024-04-18T21:05:41.730 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3424000000000001e-05 2024-04-18T21:05:41.730 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.731 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:41.731 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615983+0000", 2024-04-18T21:05:41.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7072000000000001e-05 2024-04-18T21:05:41.731 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.731 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.731 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:41.731 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616006+0000", 2024-04-18T21:05:41.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2823000000000002e-05 2024-04-18T21:05:41.731 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.731 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.731 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:41.731 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616156+0000", 2024-04-18T21:05:41.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014962299999999999 2024-04-18T21:05:41.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.732 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:41.732 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616174+0000", 2024-04-18T21:05:41.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8082999999999999e-05 2024-04-18T21:05:41.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.732 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:41.732 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.629952+0000", 2024-04-18T21:05:41.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013778514 2024-04-18T21:05:41.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.732 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:41.732 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630201+0000", 2024-04-18T21:05:41.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024918100000000001 2024-04-18T21:05:41.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:41.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630386+0000", 2024-04-18T21:05:41.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018436900000000001 2024-04-18T21:05:41.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:41.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643169+0000", 2024-04-18T21:05:41.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012782774 2024-04-18T21:05:41.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:41.734 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.647924+0000", 2024-04-18T21:05:41.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004755787 2024-04-18T21:05:41.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.734 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:41.734 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648069+0000", 2024-04-18T21:05:41.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014459600000000001 2024-04-18T21:05:41.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.734 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:41.734 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648203+0000", 2024-04-18T21:05:41.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013388000000000001 2024-04-18T21:05:41.734 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:41.735 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:41.735 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:41.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.735 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:41.735 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:05:41.735 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 36.079861350999998, 2024-04-18T21:05:41.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032489736999999998, 2024-04-18T21:05:41.735 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:41.735 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:41.735 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:41.735 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:41.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:41.736 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:05:41.736 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:41.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.736 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:41.736 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:05:41.736 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:41.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.736 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:41.736 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616050+0000", 2024-04-18T21:05:41.736 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.606e-06 2024-04-18T21:05:41.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.737 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:41.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616061+0000", 2024-04-18T21:05:41.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0463e-05 2024-04-18T21:05:41.737 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.737 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:41.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616092+0000", 2024-04-18T21:05:41.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1415999999999999e-05 2024-04-18T21:05:41.737 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.737 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:41.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616109+0000", 2024-04-18T21:05:41.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6557000000000001e-05 2024-04-18T21:05:41.738 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.738 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.738 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:41.738 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616358+0000", 2024-04-18T21:05:41.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000249077 2024-04-18T21:05:41.738 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.738 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.738 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:41.738 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616370+0000", 2024-04-18T21:05:41.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2037e-05 2024-04-18T21:05:41.738 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.738 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.738 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:41.739 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.634920+0000", 2024-04-18T21:05:41.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018550397 2024-04-18T21:05:41.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:41.739 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640420+0000", 2024-04-18T21:05:41.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055000539999999999 2024-04-18T21:05:41.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:41.739 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648538+0000", 2024-04-18T21:05:41.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0081181299999999994 2024-04-18T21:05:41.739 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:41.740 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:41.740 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:41.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.740 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:41.740 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:05:41.740 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 36.079777030000002, 2024-04-18T21:05:41.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036090029000000003, 2024-04-18T21:05:41.740 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:41.740 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:41.740 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:41.740 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:41.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:41.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:05:41.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:41.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:41.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:05:41.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:41.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:41.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616134+0000", 2024-04-18T21:05:41.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.353e-06 2024-04-18T21:05:41.742 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.742 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.742 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:41.742 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616141+0000", 2024-04-18T21:05:41.742 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2770000000000002e-06 2024-04-18T21:05:41.742 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.742 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.742 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:41.742 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616160+0000", 2024-04-18T21:05:41.742 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.91e-05 2024-04-18T21:05:41.742 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.742 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.742 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:41.742 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616170+0000", 2024-04-18T21:05:41.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7699999999999996e-06 2024-04-18T21:05:41.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:41.743 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616275+0000", 2024-04-18T21:05:41.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105313 2024-04-18T21:05:41.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:41.743 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616288+0000", 2024-04-18T21:05:41.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3027000000000001e-05 2024-04-18T21:05:41.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.744 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:41.744 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646160+0000", 2024-04-18T21:05:41.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.029872019 2024-04-18T21:05:41.744 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.744 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.744 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:41.744 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646368+0000", 2024-04-18T21:05:41.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020811899999999999 2024-04-18T21:05:41.744 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.744 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.744 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:41.744 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652223+0000", 2024-04-18T21:05:41.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.005855051 2024-04-18T21:05:41.744 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:41.744 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:41.744 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:41.745 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.745 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.745 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:41.745 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:05:41.745 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 36.079719461000003, 2024-04-18T21:05:41.745 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043572403000000003, 2024-04-18T21:05:41.745 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:41.745 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:41.745 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:41.745 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:41.745 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.745 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:41.745 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:05:41.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:41.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:41.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:05:41.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:41.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:41.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616192+0000", 2024-04-18T21:05:41.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:05:41.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:41.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616203+0000", 2024-04-18T21:05:41.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0890000000000001e-05 2024-04-18T21:05:41.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:41.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616223+0000", 2024-04-18T21:05:41.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0409000000000001e-05 2024-04-18T21:05:41.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:41.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616238+0000", 2024-04-18T21:05:41.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5160000000000001e-05 2024-04-18T21:05:41.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:41.748 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616343+0000", 2024-04-18T21:05:41.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000104831 2024-04-18T21:05:41.748 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.748 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:41.748 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616357+0000", 2024-04-18T21:05:41.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3686000000000001e-05 2024-04-18T21:05:41.748 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.748 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:41.748 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635912+0000", 2024-04-18T21:05:41.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019554944000000001 2024-04-18T21:05:41.748 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.749 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:41.749 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636231+0000", 2024-04-18T21:05:41.749 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000318766 2024-04-18T21:05:41.749 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.749 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.749 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:41.749 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659763+0000", 2024-04-18T21:05:41.749 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023532474000000001 2024-04-18T21:05:41.749 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:41.749 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:41.749 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:41.749 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.749 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.749 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:41.750 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:05:41.750 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 36.075790754000003, 2024-04-18T21:05:41.750 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015007971, 2024-04-18T21:05:41.750 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:41.750 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:41.750 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:41.750 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:41.750 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.750 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:41.750 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:05:41.750 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:41.750 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.750 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.750 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:41.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:05:41.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:41.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:41.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620120+0000", 2024-04-18T21:05:41.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0359999999999999e-06 2024-04-18T21:05:41.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:41.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620157+0000", 2024-04-18T21:05:41.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6636e-05 2024-04-18T21:05:41.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.752 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:41.752 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620177+0000", 2024-04-18T21:05:41.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0247000000000001e-05 2024-04-18T21:05:41.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.752 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:41.752 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620195+0000", 2024-04-18T21:05:41.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7819e-05 2024-04-18T21:05:41.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.752 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:41.752 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620342+0000", 2024-04-18T21:05:41.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014643300000000001 2024-04-18T21:05:41.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.753 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:41.753 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620405+0000", 2024-04-18T21:05:41.753 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3522000000000006e-05 2024-04-18T21:05:41.753 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.753 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:41.753 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635016+0000", 2024-04-18T21:05:41.753 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014610840999999999 2024-04-18T21:05:41.753 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.753 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:41.753 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635127+0000", 2024-04-18T21:05:41.754 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111437 2024-04-18T21:05:41.754 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:41.754 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:41.754 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:41.754 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.754 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.754 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:41.754 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:05:41.754 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 36.075683486000003, 2024-04-18T21:05:41.754 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012693296, 2024-04-18T21:05:41.754 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:41.754 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:41.754 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:41.755 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:41.755 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.755 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:41.755 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:05:41.755 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:41.755 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.755 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.755 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:41.755 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:05:41.755 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:41.755 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.755 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.755 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:41.756 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620228+0000", 2024-04-18T21:05:41.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:05:41.756 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.756 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:41.756 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620236+0000", 2024-04-18T21:05:41.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.303e-06 2024-04-18T21:05:41.756 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.756 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:41.756 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620255+0000", 2024-04-18T21:05:41.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9406e-05 2024-04-18T21:05:41.756 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.757 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:41.757 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620274+0000", 2024-04-18T21:05:41.757 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8940000000000002e-05 2024-04-18T21:05:41.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.757 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.757 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:41.757 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:05:41.757 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001558753 2024-04-18T21:05:41.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.757 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.757 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:41.757 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621879+0000", 2024-04-18T21:05:41.757 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6359000000000001e-05 2024-04-18T21:05:41.758 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.758 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.758 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:41.758 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632841+0000", 2024-04-18T21:05:41.758 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010961907 2024-04-18T21:05:41.758 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.758 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.758 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:41.758 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632920+0000", 2024-04-18T21:05:41.758 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8714999999999994e-05 2024-04-18T21:05:41.758 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:41.758 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:41.758 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:41.759 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.759 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:41.759 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:05:41.759 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 36.074137723, 2024-04-18T21:05:41.759 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013445702, 2024-04-18T21:05:41.759 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:41.759 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:41.759 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:41.759 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:41.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.759 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:41.759 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:05:41.759 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:41.760 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.760 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.760 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:41.760 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:05:41.760 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:41.760 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.760 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.760 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:41.760 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621774+0000", 2024-04-18T21:05:41.760 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2500000000000001e-06 2024-04-18T21:05:41.760 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.760 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.760 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:41.760 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621786+0000", 2024-04-18T21:05:41.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2636000000000001e-05 2024-04-18T21:05:41.761 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.761 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.761 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:41.761 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621814+0000", 2024-04-18T21:05:41.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7823000000000001e-05 2024-04-18T21:05:41.761 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.761 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.761 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:41.761 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621844+0000", 2024-04-18T21:05:41.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9589000000000001e-05 2024-04-18T21:05:41.761 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.761 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.761 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:41.762 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622253+0000", 2024-04-18T21:05:41.762 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040963700000000002 2024-04-18T21:05:41.762 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.762 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.762 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:41.762 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622304+0000", 2024-04-18T21:05:41.762 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0868999999999997e-05 2024-04-18T21:05:41.762 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.762 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.762 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:41.762 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635133+0000", 2024-04-18T21:05:41.762 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012829136 2024-04-18T21:05:41.762 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.763 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:41.763 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635218+0000", 2024-04-18T21:05:41.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4761999999999999e-05 2024-04-18T21:05:41.763 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:41.763 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:41.763 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:41.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.763 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:41.763 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:05:41.763 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 36.074010962999999, 2024-04-18T21:05:41.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014162065, 2024-04-18T21:05:41.764 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:41.764 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:41.764 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:41.764 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:41.764 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.764 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:41.764 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:05:41.764 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:41.764 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.764 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.764 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:41.764 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:05:41.764 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:41.765 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.765 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.765 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:41.765 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621900+0000", 2024-04-18T21:05:41.765 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:05:41.765 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.765 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.765 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:41.765 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621910+0000", 2024-04-18T21:05:41.765 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0207000000000001e-05 2024-04-18T21:05:41.765 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.765 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.765 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:41.765 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621932+0000", 2024-04-18T21:05:41.766 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1789000000000001e-05 2024-04-18T21:05:41.766 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.766 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.766 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:41.766 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621946+0000", 2024-04-18T21:05:41.766 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4212999999999999e-05 2024-04-18T21:05:41.766 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.766 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.766 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:41.766 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624477+0000", 2024-04-18T21:05:41.766 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025303470000000001 2024-04-18T21:05:41.766 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.766 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.766 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:41.767 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624525+0000", 2024-04-18T21:05:41.767 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8084999999999998e-05 2024-04-18T21:05:41.767 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.767 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.767 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:41.767 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635976+0000", 2024-04-18T21:05:41.767 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.011451368999999999 2024-04-18T21:05:41.767 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.767 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.767 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:41.767 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636061+0000", 2024-04-18T21:05:41.767 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5094999999999998e-05 2024-04-18T21:05:41.767 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:41.767 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:41.767 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:41.768 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.768 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.768 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:05:41.768 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:05:41.768 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 36.064775337999997, 2024-04-18T21:05:41.768 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0098014739999999993, 2024-04-18T21:05:41.768 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:41.768 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:41.768 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:05:41.768 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:41.768 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.768 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:41.768 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:05:41.768 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:41.769 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.769 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.769 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:41.769 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:05:41.769 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:41.769 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.769 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.769 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:41.769 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631136+0000", 2024-04-18T21:05:41.769 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0139999999999999e-06 2024-04-18T21:05:41.769 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.769 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.769 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:41.769 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631152+0000", 2024-04-18T21:05:41.770 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6365999999999999e-05 2024-04-18T21:05:41.770 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.770 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.770 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:41.770 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631961+0000", 2024-04-18T21:05:41.770 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00080873100000000003 2024-04-18T21:05:41.770 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.770 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.770 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:41.770 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632021+0000", 2024-04-18T21:05:41.770 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0541999999999997e-05 2024-04-18T21:05:41.770 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.770 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.770 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:41.771 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633539+0000", 2024-04-18T21:05:41.771 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015175639999999999 2024-04-18T21:05:41.771 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.771 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.771 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:41.771 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640936+0000", 2024-04-18T21:05:41.771 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007397257 2024-04-18T21:05:41.771 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:41.771 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:41.771 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:41.771 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.771 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.771 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-18T21:05:41.771 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:05:41.771 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 36.047313905000003, 2024-04-18T21:05:41.772 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00073592199999999997, 2024-04-18T21:05:41.772 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:41.772 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:41.772 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:41.772 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:41.772 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.772 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:41.772 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:05:41.772 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:41.772 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.772 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.772 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:41.772 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:05:41.772 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:41.772 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.772 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.773 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:41.773 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648597+0000", 2024-04-18T21:05:41.773 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:05:41.773 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.773 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.773 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:41.773 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648605+0000", 2024-04-18T21:05:41.773 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3960000000000006e-06 2024-04-18T21:05:41.773 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.773 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.773 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:41.773 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648625+0000", 2024-04-18T21:05:41.773 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9987e-05 2024-04-18T21:05:41.773 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.774 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.774 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:41.774 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648643+0000", 2024-04-18T21:05:41.774 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7079e-05 2024-04-18T21:05:41.774 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.774 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.774 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:41.774 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649043+0000", 2024-04-18T21:05:41.774 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040083399999999998 2024-04-18T21:05:41.774 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.774 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.774 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:41.774 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649062+0000", 2024-04-18T21:05:41.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9052999999999999e-05 2024-04-18T21:05:41.775 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.775 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.775 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:41.775 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649332+0000", 2024-04-18T21:05:41.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026971999999999999 2024-04-18T21:05:41.775 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:41.775 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:41.775 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:41.775 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.775 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.775 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:05:41.775 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:05:41.775 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 36.044539004000001, 2024-04-18T21:05:41.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00086123999999999999, 2024-04-18T21:05:41.775 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:41.776 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:41.776 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:05:41.776 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:41.776 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.776 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:41.776 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:05:41.776 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:41.776 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.776 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.776 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:41.776 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:05:41.776 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:41.776 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.776 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.776 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:41.777 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651372+0000", 2024-04-18T21:05:41.777 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7599999999999997e-07 2024-04-18T21:05:41.777 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.777 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.777 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:41.777 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651377+0000", 2024-04-18T21:05:41.777 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.22e-06 2024-04-18T21:05:41.777 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.777 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.777 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:41.777 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651394+0000", 2024-04-18T21:05:41.777 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6646999999999998e-05 2024-04-18T21:05:41.777 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.778 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.778 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:41.778 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651427+0000", 2024-04-18T21:05:41.778 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3682e-05 2024-04-18T21:05:41.778 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.778 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.778 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:41.778 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652029+0000", 2024-04-18T21:05:41.778 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00060152199999999995 2024-04-18T21:05:41.778 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.778 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.778 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:41.779 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652232+0000", 2024-04-18T21:05:41.779 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020359299999999999 2024-04-18T21:05:41.779 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:41.779 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:41.779 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:41.779 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.779 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.779 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:05:41.779 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:05:41.779 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 36.036512041999998, 2024-04-18T21:05:41.779 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0017426200000000001, 2024-04-18T21:05:41.779 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:41.779 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:41.780 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:41.780 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:41.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:41.780 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:05:41.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:41.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:41.780 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:05:41.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:41.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.781 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:41.781 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659399+0000", 2024-04-18T21:05:41.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6000000000000002e-07 2024-04-18T21:05:41.781 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.781 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.781 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:41.781 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659405+0000", 2024-04-18T21:05:41.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5069999999999997e-06 2024-04-18T21:05:41.781 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.781 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.781 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:41.781 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659425+0000", 2024-04-18T21:05:41.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.927e-05 2024-04-18T21:05:41.781 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.781 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.781 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:41.782 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659443+0000", 2024-04-18T21:05:41.782 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8051999999999999e-05 2024-04-18T21:05:41.782 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.782 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.782 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:41.782 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660973+0000", 2024-04-18T21:05:41.782 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001530106 2024-04-18T21:05:41.782 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.782 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.782 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:41.782 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660983+0000", 2024-04-18T21:05:41.782 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0516999999999999e-05 2024-04-18T21:05:41.782 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.782 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.783 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:41.783 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661141+0000", 2024-04-18T21:05:41.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015730799999999999 2024-04-18T21:05:41.783 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:41.783 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:41.783 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:41.783 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.783 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.783 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:05:41.783 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:05:41.783 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 36.036295416999998, 2024-04-18T21:05:41.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001812311, 2024-04-18T21:05:41.783 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:41.784 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:41.784 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:41.784 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:41.784 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.784 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:41.784 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:05:41.784 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:41.784 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.784 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.784 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:41.784 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:05:41.784 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:41.784 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.784 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.784 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:41.785 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659616+0000", 2024-04-18T21:05:41.785 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.277e-06 2024-04-18T21:05:41.785 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.785 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.785 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:41.785 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659625+0000", 2024-04-18T21:05:41.785 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5359999999999998e-06 2024-04-18T21:05:41.785 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.785 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.785 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:41.785 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659647+0000", 2024-04-18T21:05:41.785 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1857000000000001e-05 2024-04-18T21:05:41.785 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.786 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.786 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:41.786 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659664+0000", 2024-04-18T21:05:41.786 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6405999999999998e-05 2024-04-18T21:05:41.786 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.786 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.786 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:41.786 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661169+0000", 2024-04-18T21:05:41.786 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015054179999999999 2024-04-18T21:05:41.786 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.786 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.786 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:41.786 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661177+0000", 2024-04-18T21:05:41.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9680000000000006e-06 2024-04-18T21:05:41.787 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.787 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.787 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:41.787 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661427+0000", 2024-04-18T21:05:41.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024984900000000001 2024-04-18T21:05:41.787 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:41.787 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:41.787 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:41.787 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.787 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.787 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-18T21:05:41.787 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:05:41.787 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 34.083374808999999, 2024-04-18T21:05:41.788 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0030975030000000001, 2024-04-18T21:05:41.788 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:41.788 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:41.788 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:41.788 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:41.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:41.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:05:41.788 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:41.788 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:41.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:05:41.788 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:41.789 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.789 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.789 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:41.789 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612538+0000", 2024-04-18T21:05:41.789 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6259999999999999e-06 2024-04-18T21:05:41.789 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.789 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.789 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:41.789 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612552+0000", 2024-04-18T21:05:41.789 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4073999999999999e-05 2024-04-18T21:05:41.789 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.789 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.789 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:41.790 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612585+0000", 2024-04-18T21:05:41.790 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3504999999999999e-05 2024-04-18T21:05:41.790 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.790 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.790 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:41.790 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612601+0000", 2024-04-18T21:05:41.790 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5194000000000001e-05 2024-04-18T21:05:41.790 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.790 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.790 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:41.790 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612746+0000", 2024-04-18T21:05:41.790 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145666 2024-04-18T21:05:41.790 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.791 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.791 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:41.791 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612953+0000", 2024-04-18T21:05:41.791 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000207109 2024-04-18T21:05:41.791 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.791 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.791 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:41.791 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.613134+0000", 2024-04-18T21:05:41.791 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018041300000000001 2024-04-18T21:05:41.791 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.791 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.791 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:41.791 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.614411+0000", 2024-04-18T21:05:41.791 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0012769929999999999 2024-04-18T21:05:41.792 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.792 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.792 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:41.792 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615441+0000", 2024-04-18T21:05:41.792 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001029917 2024-04-18T21:05:41.792 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.792 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.792 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:41.792 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615522+0000", 2024-04-18T21:05:41.792 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1142000000000003e-05 2024-04-18T21:05:41.792 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.792 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.792 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:41.792 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615633+0000", 2024-04-18T21:05:41.793 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000110864 2024-04-18T21:05:41.793 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:41.793 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:41.793 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:41.793 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.793 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.793 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-18T21:05:41.793 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:05:41.793 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 16.081088997999998, 2024-04-18T21:05:41.793 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088979039999999999, 2024-04-18T21:05:41.793 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:41.793 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:41.793 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:41.793 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:41.794 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.794 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:41.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:05:41.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:41.794 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.794 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.794 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:41.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:05:41.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:41.794 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.794 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.794 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:41.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614825+0000", 2024-04-18T21:05:41.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4829999999999999e-06 2024-04-18T21:05:41.795 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.795 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:41.795 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614843+0000", 2024-04-18T21:05:41.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8777e-05 2024-04-18T21:05:41.795 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.795 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:41.795 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614884+0000", 2024-04-18T21:05:41.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1051999999999999e-05 2024-04-18T21:05:41.795 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.796 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:41.796 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614903+0000", 2024-04-18T21:05:41.796 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9069999999999999e-05 2024-04-18T21:05:41.796 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.796 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.796 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:41.796 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615047+0000", 2024-04-18T21:05:41.796 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014374400000000001 2024-04-18T21:05:41.796 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.796 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.796 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:41.796 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615061+0000", 2024-04-18T21:05:41.796 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4063000000000001e-05 2024-04-18T21:05:41.796 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.797 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.797 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:41.797 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621064+0000", 2024-04-18T21:05:41.797 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0060029200000000001 2024-04-18T21:05:41.797 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.797 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.797 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:41.797 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621211+0000", 2024-04-18T21:05:41.797 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000147224 2024-04-18T21:05:41.797 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.797 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.797 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:41.797 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621396+0000", 2024-04-18T21:05:41.797 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018454699999999999 2024-04-18T21:05:41.797 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.798 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:41.798 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.622517+0000", 2024-04-18T21:05:41.798 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001121424 2024-04-18T21:05:41.798 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.798 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:41.798 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623571+0000", 2024-04-18T21:05:41.798 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010538660000000001 2024-04-18T21:05:41.798 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.798 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:41.798 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623658+0000", 2024-04-18T21:05:41.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6439000000000004e-05 2024-04-18T21:05:41.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:41.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:41.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:41.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623719+0000", 2024-04-18T21:05:41.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1295000000000002e-05 2024-04-18T21:05:41.799 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:41.799 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:41.799 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:41.799 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:41.799 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:41.799 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:05:41.801 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:41.803+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:41.801 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:05:41.874 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-18T21:05:41.901 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:41.899+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:41.935 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:05:41.935 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:05:41.935 INFO:teuthology.orchestra.run.smithi132.stdout: "num_ops": 0 2024-04-18T21:05:41.935 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:05:41.949 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:05:42.002 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:42.003+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:42.103 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:42.103+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:42.111 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:05:42.111 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:05:42.111 INFO:teuthology.orchestra.run.smithi132.stdout: "complaint_time": 30, 2024-04-18T21:05:42.112 INFO:teuthology.orchestra.run.smithi132.stdout: "num_blocked_ops": 0 2024-04-18T21:05:42.112 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:05:42.125 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:05:42.215 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:42.215+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:42.292 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:05:42.292 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 20, 2024-04-18T21:05:42.292 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 600, 2024-04-18T21:05:42.292 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [ 2024-04-18T21:05:42.292 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.292 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:42.292 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:05:42.292 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 47.381512391000001, 2024-04-18T21:05:42.292 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.02518273, 2024-04-18T21:05:42.292 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:42.293 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:42.293 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.293 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:42.293 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:42.293 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:42.293 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 141 2024-04-18T21:05:42.293 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.293 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:42.293 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.293 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:42.293 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:05:42.293 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:42.293 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.294 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.294 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:42.294 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:05:42.294 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:42.294 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.294 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.294 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:42.294 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911562+0000", 2024-04-18T21:05:42.294 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9300000000000006e-07 2024-04-18T21:05:42.294 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.294 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.294 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:42.294 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911569+0000", 2024-04-18T21:05:42.295 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0169999999999999e-06 2024-04-18T21:05:42.295 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.295 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.295 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:42.295 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911582+0000", 2024-04-18T21:05:42.295 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.343e-05 2024-04-18T21:05:42.295 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.295 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.295 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.295 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911590+0000", 2024-04-18T21:05:42.295 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.413e-06 2024-04-18T21:05:42.295 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.295 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.295 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:42.295 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.933922+0000", 2024-04-18T21:05:42.295 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.022332093000000001 2024-04-18T21:05:42.296 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.296 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.296 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:42.297 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.934155+0000", 2024-04-18T21:05:42.297 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023378900000000001 2024-04-18T21:05:42.297 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.298 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.298 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:42.298 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.934514+0000", 2024-04-18T21:05:42.298 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00035859200000000003 2024-04-18T21:05:42.298 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.298 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.298 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:42.298 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.935973+0000", 2024-04-18T21:05:42.298 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001458705 2024-04-18T21:05:42.298 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.298 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.298 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:42.298 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936488+0000", 2024-04-18T21:05:42.299 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00051550000000000001 2024-04-18T21:05:42.299 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.299 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.299 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:42.299 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936636+0000", 2024-04-18T21:05:42.299 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014779800000000001 2024-04-18T21:05:42.299 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.299 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.299 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:42.299 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936743+0000", 2024-04-18T21:05:42.299 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010739999999999999 2024-04-18T21:05:42.299 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:42.299 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:42.299 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:42.300 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.300 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.300 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:42.300 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:05:42.300 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 47.264313416999997, 2024-04-18T21:05:42.300 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023654959999999999, 2024-04-18T21:05:42.300 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:42.300 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:42.300 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.300 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:42.300 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:42.300 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:42.300 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 163 2024-04-18T21:05:42.300 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.301 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:42.301 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.301 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:42.301 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:05:42.301 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:42.301 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.301 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.301 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:42.301 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:05:42.301 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:42.301 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.301 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.301 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:42.301 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:05:42.301 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0999999999999998e-07 2024-04-18T21:05:42.301 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.302 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.302 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:42.302 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028766+0000", 2024-04-18T21:05:42.302 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4700000000000001e-06 2024-04-18T21:05:42.302 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.302 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.302 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:42.302 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028775+0000", 2024-04-18T21:05:42.302 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.3190000000000001e-06 2024-04-18T21:05:42.302 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.302 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.302 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.303 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028782+0000", 2024-04-18T21:05:42.303 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.2300000000000002e-06 2024-04-18T21:05:42.303 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.303 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.303 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:42.303 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046667+0000", 2024-04-18T21:05:42.303 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017884356000000001 2024-04-18T21:05:42.303 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.303 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.303 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:42.303 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046788+0000", 2024-04-18T21:05:42.303 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012125000000000001 2024-04-18T21:05:42.303 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.303 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.303 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:42.304 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046982+0000", 2024-04-18T21:05:42.304 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019394 2024-04-18T21:05:42.304 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.304 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.304 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:42.304 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051969+0000", 2024-04-18T21:05:42.304 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0049868150000000003 2024-04-18T21:05:42.304 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.304 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.304 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:42.304 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052089+0000", 2024-04-18T21:05:42.304 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011993 2024-04-18T21:05:42.304 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.304 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.305 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:42.305 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052292+0000", 2024-04-18T21:05:42.305 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020345699999999999 2024-04-18T21:05:42.305 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.305 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.305 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:42.305 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052415+0000", 2024-04-18T21:05:42.305 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000122483 2024-04-18T21:05:42.305 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:42.305 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:42.305 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:42.305 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.305 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.305 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:42.306 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:05:42.306 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 47.264279184999999, 2024-04-18T21:05:42.306 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023864586, 2024-04-18T21:05:42.306 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:42.306 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:42.306 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.306 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:42.306 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:42.306 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:42.306 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 164 2024-04-18T21:05:42.306 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.306 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:42.306 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.306 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:42.307 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:05:42.307 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:42.307 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.307 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.307 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:42.307 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:05:42.307 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:42.307 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.307 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.307 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:42.307 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028795+0000", 2024-04-18T21:05:42.307 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7999999999999995e-07 2024-04-18T21:05:42.307 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.307 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.307 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:42.308 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028884+0000", 2024-04-18T21:05:42.308 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8997000000000002e-05 2024-04-18T21:05:42.308 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.308 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.308 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:42.308 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028895+0000", 2024-04-18T21:05:42.308 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1647e-05 2024-04-18T21:05:42.308 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.308 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.308 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.308 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028903+0000", 2024-04-18T21:05:42.308 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.909e-06 2024-04-18T21:05:42.308 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.308 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.309 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:42.309 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.047818+0000", 2024-04-18T21:05:42.309 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018914337 2024-04-18T21:05:42.309 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.309 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.309 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:42.309 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.048094+0000", 2024-04-18T21:05:42.309 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00027653500000000001 2024-04-18T21:05:42.309 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.309 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.309 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:42.309 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.048471+0000", 2024-04-18T21:05:42.309 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00037705799999999999 2024-04-18T21:05:42.309 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.310 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.310 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:42.310 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052516+0000", 2024-04-18T21:05:42.310 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0040452739999999997 2024-04-18T21:05:42.310 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.310 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.310 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:42.310 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052535+0000", 2024-04-18T21:05:42.310 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.84e-05 2024-04-18T21:05:42.310 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.310 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.310 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:42.310 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052603+0000", 2024-04-18T21:05:42.311 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.8095000000000004e-05 2024-04-18T21:05:42.311 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.311 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.311 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:42.311 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052659+0000", 2024-04-18T21:05:42.311 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5653999999999999e-05 2024-04-18T21:05:42.311 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:42.311 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:42.311 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:42.311 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.311 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.311 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:42.311 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:05:42.311 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 47.264155742, 2024-04-18T21:05:42.312 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024516458000000001, 2024-04-18T21:05:42.312 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:42.312 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:42.312 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.312 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:42.312 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:42.312 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:42.312 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 165 2024-04-18T21:05:42.312 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.312 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:42.312 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.312 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:42.312 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:05:42.312 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:42.312 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.313 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.313 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:42.313 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:05:42.313 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:42.313 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.313 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.313 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:42.313 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028918+0000", 2024-04-18T21:05:42.313 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8000000000000005e-07 2024-04-18T21:05:42.313 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.313 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.313 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:42.313 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028924+0000", 2024-04-18T21:05:42.313 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5659999999999997e-06 2024-04-18T21:05:42.313 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.313 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.314 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:42.314 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028933+0000", 2024-04-18T21:05:42.314 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.38e-06 2024-04-18T21:05:42.314 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.314 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.314 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.314 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028940+0000", 2024-04-18T21:05:42.314 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0060000000000003e-06 2024-04-18T21:05:42.314 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.314 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.314 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:42.314 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.050846+0000", 2024-04-18T21:05:42.314 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021906119000000002 2024-04-18T21:05:42.314 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.315 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.315 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:42.315 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051025+0000", 2024-04-18T21:05:42.315 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017850799999999999 2024-04-18T21:05:42.315 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.315 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.315 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:42.315 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051221+0000", 2024-04-18T21:05:42.315 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019608700000000001 2024-04-18T21:05:42.315 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.315 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.315 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:42.315 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052675+0000", 2024-04-18T21:05:42.315 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0014537899999999999 2024-04-18T21:05:42.316 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.316 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.316 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:42.316 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053311+0000", 2024-04-18T21:05:42.316 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00063613299999999999 2024-04-18T21:05:42.316 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.316 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.316 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:42.316 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053381+0000", 2024-04-18T21:05:42.316 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0074999999999996e-05 2024-04-18T21:05:42.316 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.316 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.316 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:42.316 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053434+0000", 2024-04-18T21:05:42.316 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3013999999999998e-05 2024-04-18T21:05:42.317 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:42.317 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:42.317 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:42.317 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.317 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.317 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:42.317 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:05:42.317 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 47.150850263000002, 2024-04-18T21:05:42.317 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023772793, 2024-04-18T21:05:42.317 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:42.317 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:42.317 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.317 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:42.318 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:42.318 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:42.318 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 187 2024-04-18T21:05:42.318 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.318 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:42.318 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.318 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:42.318 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:05:42.318 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:42.318 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.318 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.318 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:42.318 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:05:42.319 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:42.319 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.319 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.319 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:42.319 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142224+0000", 2024-04-18T21:05:42.319 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.47e-07 2024-04-18T21:05:42.319 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.319 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.319 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:42.319 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142233+0000", 2024-04-18T21:05:42.319 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0729999999999994e-06 2024-04-18T21:05:42.319 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.319 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.320 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:42.320 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142255+0000", 2024-04-18T21:05:42.320 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.2535999999999999e-05 2024-04-18T21:05:42.320 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.320 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.320 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.320 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142268+0000", 2024-04-18T21:05:42.320 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2686e-05 2024-04-18T21:05:42.320 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.320 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.320 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:42.320 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160497+0000", 2024-04-18T21:05:42.320 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018228779000000001 2024-04-18T21:05:42.320 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.320 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.321 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:42.321 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160634+0000", 2024-04-18T21:05:42.321 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000137315 2024-04-18T21:05:42.321 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.321 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.321 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:42.321 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160831+0000", 2024-04-18T21:05:42.321 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019683100000000001 2024-04-18T21:05:42.321 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.321 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.321 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:42.321 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165129+0000", 2024-04-18T21:05:42.321 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0042981299999999998 2024-04-18T21:05:42.321 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.321 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.321 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:42.322 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165776+0000", 2024-04-18T21:05:42.322 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00064702900000000003 2024-04-18T21:05:42.322 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.322 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.322 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:42.322 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165921+0000", 2024-04-18T21:05:42.322 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014506 2024-04-18T21:05:42.322 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.322 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.322 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:42.322 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165996+0000", 2024-04-18T21:05:42.322 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.4406999999999994e-05 2024-04-18T21:05:42.322 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:42.322 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:42.322 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:42.323 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.323 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.323 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:42.323 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:05:42.323 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 47.150789664999998, 2024-04-18T21:05:42.323 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026802157, 2024-04-18T21:05:42.323 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:42.323 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:42.323 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.323 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:42.323 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:42.323 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:42.324 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 188 2024-04-18T21:05:42.324 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.324 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:42.324 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.324 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:42.324 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:05:42.324 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:42.324 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.324 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.324 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:42.324 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:05:42.325 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:42.325 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.325 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.325 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:42.325 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142284+0000", 2024-04-18T21:05:42.325 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4e-07 2024-04-18T21:05:42.325 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.325 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.325 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:42.325 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142374+0000", 2024-04-18T21:05:42.325 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0099999999999995e-05 2024-04-18T21:05:42.325 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.325 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.325 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:42.325 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142386+0000", 2024-04-18T21:05:42.325 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1770000000000001e-05 2024-04-18T21:05:42.326 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.326 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.326 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.326 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142394+0000", 2024-04-18T21:05:42.326 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.2130000000000008e-06 2024-04-18T21:05:42.326 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.326 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.326 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:42.326 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.161743+0000", 2024-04-18T21:05:42.326 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019348644000000002 2024-04-18T21:05:42.326 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.326 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.327 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:42.327 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.161865+0000", 2024-04-18T21:05:42.327 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012210899999999999 2024-04-18T21:05:42.327 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.327 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.327 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:42.327 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.162055+0000", 2024-04-18T21:05:42.327 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000189994 2024-04-18T21:05:42.327 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.327 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.327 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:42.327 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165735+0000", 2024-04-18T21:05:42.327 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0036803270000000002 2024-04-18T21:05:42.327 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.327 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.327 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:42.328 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.168911+0000", 2024-04-18T21:05:42.328 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0031753689999999999 2024-04-18T21:05:42.328 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.328 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.328 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:42.328 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169012+0000", 2024-04-18T21:05:42.328 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010157699999999999 2024-04-18T21:05:42.328 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.328 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.328 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:42.328 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169086+0000", 2024-04-18T21:05:42.328 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3213999999999994e-05 2024-04-18T21:05:42.328 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:42.328 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:42.328 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:42.328 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.328 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.329 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:42.329 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:05:42.329 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 47.150664358999997, 2024-04-18T21:05:42.329 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026811423000000001, 2024-04-18T21:05:42.329 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:42.329 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:42.329 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.329 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:42.329 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:42.329 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:42.329 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 189 2024-04-18T21:05:42.330 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.330 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:42.330 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.330 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:42.330 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:05:42.330 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:42.330 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.330 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.330 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:42.330 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:05:42.330 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:42.330 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.330 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.331 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:42.331 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142410+0000", 2024-04-18T21:05:42.331 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:05:42.331 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.331 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.331 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:42.331 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142415+0000", 2024-04-18T21:05:42.331 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.7939999999999999e-06 2024-04-18T21:05:42.331 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.331 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.331 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:42.331 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142470+0000", 2024-04-18T21:05:42.331 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4537999999999999e-05 2024-04-18T21:05:42.331 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.331 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.331 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.332 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142481+0000", 2024-04-18T21:05:42.332 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0966e-05 2024-04-18T21:05:42.332 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.332 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.332 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:42.332 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.163493+0000", 2024-04-18T21:05:42.332 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021012444000000002 2024-04-18T21:05:42.332 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.332 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.332 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:42.332 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.163727+0000", 2024-04-18T21:05:42.332 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000233339 2024-04-18T21:05:42.332 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.333 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.333 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:42.333 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.164102+0000", 2024-04-18T21:05:42.333 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000374872 2024-04-18T21:05:42.333 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.333 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.333 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:42.333 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.166528+0000", 2024-04-18T21:05:42.333 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0024258729999999998 2024-04-18T21:05:42.333 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.333 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.334 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:42.334 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169101+0000", 2024-04-18T21:05:42.334 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0025737680000000001 2024-04-18T21:05:42.334 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.334 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.334 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:42.334 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169171+0000", 2024-04-18T21:05:42.334 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0148000000000007e-05 2024-04-18T21:05:42.334 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.334 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.334 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:42.334 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169220+0000", 2024-04-18T21:05:42.334 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8767999999999998e-05 2024-04-18T21:05:42.334 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:42.335 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:42.335 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:42.335 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.335 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.335 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:42.335 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:05:42.335 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 36.677091806999996, 2024-04-18T21:05:42.335 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024082777999999999, 2024-04-18T21:05:42.335 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:42.335 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:42.335 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.335 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:42.335 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.336 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:42.336 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:05:42.336 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:42.336 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.336 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.336 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:42.336 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:05:42.336 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:42.336 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.336 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.336 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:42.336 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615984+0000", 2024-04-18T21:05:42.336 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.9869999999999999e-06 2024-04-18T21:05:42.336 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.337 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.337 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:42.337 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615999+0000", 2024-04-18T21:05:42.337 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4646e-05 2024-04-18T21:05:42.337 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.337 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.337 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:42.337 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616028+0000", 2024-04-18T21:05:42.337 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8952999999999999e-05 2024-04-18T21:05:42.337 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.337 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.337 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.338 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616052+0000", 2024-04-18T21:05:42.338 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.3941999999999999e-05 2024-04-18T21:05:42.338 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.338 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.338 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:42.338 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618010+0000", 2024-04-18T21:05:42.338 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0019581780000000001 2024-04-18T21:05:42.338 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.338 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.338 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:42.338 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618322+0000", 2024-04-18T21:05:42.338 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00031158899999999997 2024-04-18T21:05:42.339 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.339 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.339 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:42.339 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618587+0000", 2024-04-18T21:05:42.339 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00026495700000000002 2024-04-18T21:05:42.339 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.339 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.339 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:42.339 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629262+0000", 2024-04-18T21:05:42.339 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010675877 2024-04-18T21:05:42.339 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.339 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.339 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:42.340 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.639773+0000", 2024-04-18T21:05:42.340 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0105109 2024-04-18T21:05:42.340 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.340 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.340 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:42.340 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.639926+0000", 2024-04-18T21:05:42.340 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000152349 2024-04-18T21:05:42.340 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.340 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.340 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:42.340 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640064+0000", 2024-04-18T21:05:42.340 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0001384 2024-04-18T21:05:42.340 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:42.340 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:42.341 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:42.341 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.341 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.341 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:42.341 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:05:42.341 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 36.676979133000003, 2024-04-18T21:05:42.341 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030215005999999999, 2024-04-18T21:05:42.341 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:42.341 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:42.341 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.341 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:42.341 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.342 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:42.342 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:05:42.342 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:42.342 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.342 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.342 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:42.342 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:05:42.342 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:42.342 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.342 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.342 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:42.342 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616095+0000", 2024-04-18T21:05:42.342 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.446e-06 2024-04-18T21:05:42.343 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.343 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.343 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:42.343 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616104+0000", 2024-04-18T21:05:42.343 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6200000000000005e-06 2024-04-18T21:05:42.343 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.343 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.343 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:42.343 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616132+0000", 2024-04-18T21:05:42.343 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7668999999999999e-05 2024-04-18T21:05:42.343 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.343 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.343 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.343 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616149+0000", 2024-04-18T21:05:42.343 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7047000000000001e-05 2024-04-18T21:05:42.344 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.344 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.344 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:42.344 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619287+0000", 2024-04-18T21:05:42.344 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0031381450000000002 2024-04-18T21:05:42.344 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.344 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.344 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:42.344 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619503+0000", 2024-04-18T21:05:42.344 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000216522 2024-04-18T21:05:42.344 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.344 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.344 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:42.344 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619930+0000", 2024-04-18T21:05:42.344 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00042604900000000001 2024-04-18T21:05:42.345 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.345 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.345 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:42.345 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629281+0000", 2024-04-18T21:05:42.345 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0093512230000000005 2024-04-18T21:05:42.345 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.345 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.345 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:42.345 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646022+0000", 2024-04-18T21:05:42.345 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016741156 2024-04-18T21:05:42.345 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.345 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.345 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:42.345 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646198+0000", 2024-04-18T21:05:42.346 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000176009 2024-04-18T21:05:42.346 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.346 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.346 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:42.346 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646309+0000", 2024-04-18T21:05:42.346 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011112000000000001 2024-04-18T21:05:42.346 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:42.346 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:42.346 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:42.346 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.346 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.346 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:42.346 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:05:42.346 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 36.676894308999998, 2024-04-18T21:05:42.347 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030501176000000001, 2024-04-18T21:05:42.347 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:42.347 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:42.347 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.347 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:42.347 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.347 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:42.347 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:05:42.347 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:42.347 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.347 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.347 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:42.347 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:05:42.347 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:42.347 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.348 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.348 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:42.348 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616180+0000", 2024-04-18T21:05:42.348 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1000000000000001e-06 2024-04-18T21:05:42.348 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.348 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.348 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:42.348 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616188+0000", 2024-04-18T21:05:42.348 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4069999999999993e-06 2024-04-18T21:05:42.348 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.348 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.348 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:42.348 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616207+0000", 2024-04-18T21:05:42.348 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8335999999999999e-05 2024-04-18T21:05:42.348 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.349 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.349 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.349 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616225+0000", 2024-04-18T21:05:42.349 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8652999999999999e-05 2024-04-18T21:05:42.349 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.349 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.349 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:42.349 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620977+0000", 2024-04-18T21:05:42.349 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047512220000000003 2024-04-18T21:05:42.349 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.349 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.349 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:42.349 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621279+0000", 2024-04-18T21:05:42.350 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000302646 2024-04-18T21:05:42.350 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.350 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.350 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:42.350 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621584+0000", 2024-04-18T21:05:42.350 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000305142 2024-04-18T21:05:42.350 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.350 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.350 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:42.350 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629352+0000", 2024-04-18T21:05:42.350 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0077673689999999997 2024-04-18T21:05:42.350 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.350 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.350 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:42.351 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646480+0000", 2024-04-18T21:05:42.351 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017128259 2024-04-18T21:05:42.351 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.351 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.351 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:42.351 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646591+0000", 2024-04-18T21:05:42.351 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011113899999999999 2024-04-18T21:05:42.351 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.351 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.351 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:42.351 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646680+0000", 2024-04-18T21:05:42.351 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8902999999999999e-05 2024-04-18T21:05:42.351 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:42.351 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:42.352 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:42.352 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.352 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.352 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:42.352 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:05:42.352 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 36.676827809999999, 2024-04-18T21:05:42.352 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030779760999999999, 2024-04-18T21:05:42.352 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:42.352 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:42.352 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.352 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:42.352 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.352 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:42.352 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:05:42.353 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:42.353 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.353 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.353 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:42.353 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:05:42.353 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:42.353 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.353 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.353 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:42.353 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616246+0000", 2024-04-18T21:05:42.353 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0499999999999999e-06 2024-04-18T21:05:42.353 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.353 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.353 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:42.353 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616253+0000", 2024-04-18T21:05:42.354 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.5989999999999998e-06 2024-04-18T21:05:42.354 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.354 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.354 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:42.354 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616273+0000", 2024-04-18T21:05:42.354 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9916999999999999e-05 2024-04-18T21:05:42.354 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.354 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.354 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.354 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616287+0000", 2024-04-18T21:05:42.354 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3669000000000001e-05 2024-04-18T21:05:42.354 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.354 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.354 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:42.354 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622203+0000", 2024-04-18T21:05:42.355 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.005916737 2024-04-18T21:05:42.355 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.355 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.355 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:42.355 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622379+0000", 2024-04-18T21:05:42.355 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000175596 2024-04-18T21:05:42.355 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.355 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.355 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:42.355 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622707+0000", 2024-04-18T21:05:42.355 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00032784600000000002 2024-04-18T21:05:42.355 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.355 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.355 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:42.355 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629366+0000", 2024-04-18T21:05:42.356 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0066593279999999999 2024-04-18T21:05:42.356 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.356 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.356 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:42.356 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646813+0000", 2024-04-18T21:05:42.356 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017447059000000001 2024-04-18T21:05:42.356 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.356 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.356 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:42.356 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646946+0000", 2024-04-18T21:05:42.356 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013301200000000001 2024-04-18T21:05:42.356 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.356 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.356 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:42.356 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647025+0000", 2024-04-18T21:05:42.356 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8948000000000004e-05 2024-04-18T21:05:42.357 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:42.357 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:42.357 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:42.357 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.357 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.357 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:42.357 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:05:42.357 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 36.676743991999999, 2024-04-18T21:05:42.357 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.031512165000000002, 2024-04-18T21:05:42.357 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:42.357 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:42.357 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.357 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:42.357 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.357 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:42.358 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:05:42.358 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:42.358 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.358 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.358 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:42.358 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:05:42.358 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:42.358 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.358 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.358 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:42.358 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616330+0000", 2024-04-18T21:05:42.358 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.15e-06 2024-04-18T21:05:42.358 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.358 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.359 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:42.359 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616337+0000", 2024-04-18T21:05:42.359 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.1289999999999998e-06 2024-04-18T21:05:42.359 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.359 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.359 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:42.359 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616447+0000", 2024-04-18T21:05:42.359 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109561 2024-04-18T21:05:42.359 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.359 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.359 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.359 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616496+0000", 2024-04-18T21:05:42.359 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8591999999999998e-05 2024-04-18T21:05:42.359 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.359 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.360 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:42.360 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.623786+0000", 2024-04-18T21:05:42.360 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0072906799999999999 2024-04-18T21:05:42.360 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.360 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.360 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:42.360 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.623973+0000", 2024-04-18T21:05:42.360 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018717199999999999 2024-04-18T21:05:42.360 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.360 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.360 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:42.360 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624260+0000", 2024-04-18T21:05:42.361 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00028630600000000001 2024-04-18T21:05:42.361 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.361 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.361 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:42.361 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629381+0000", 2024-04-18T21:05:42.361 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0051211340000000003 2024-04-18T21:05:42.361 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.361 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.361 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:42.361 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647631+0000", 2024-04-18T21:05:42.361 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018249771000000001 2024-04-18T21:05:42.361 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.361 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.361 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:42.361 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647761+0000", 2024-04-18T21:05:42.362 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013037300000000001 2024-04-18T21:05:42.362 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.362 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.362 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:42.362 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647841+0000", 2024-04-18T21:05:42.362 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.0296999999999994e-05 2024-04-18T21:05:42.362 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:42.362 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:42.362 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:42.362 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.362 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.362 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:42.362 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:05:42.363 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 36.676538508, 2024-04-18T21:05:42.363 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043251955000000002, 2024-04-18T21:05:42.363 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:42.363 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:42.363 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.363 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:42.363 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.363 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:42.363 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:05:42.363 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:42.363 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.363 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.363 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:42.363 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:05:42.363 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:42.364 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.364 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.364 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:42.364 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616536+0000", 2024-04-18T21:05:42.364 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2869999999999999e-06 2024-04-18T21:05:42.364 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.364 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.364 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:42.364 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616572+0000", 2024-04-18T21:05:42.364 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.6261999999999999e-05 2024-04-18T21:05:42.364 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.364 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.364 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:42.364 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616593+0000", 2024-04-18T21:05:42.364 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1310000000000001e-05 2024-04-18T21:05:42.365 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.365 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.365 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.365 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616614+0000", 2024-04-18T21:05:42.365 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.0936000000000001e-05 2024-04-18T21:05:42.365 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.365 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.365 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:42.365 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629501+0000", 2024-04-18T21:05:42.365 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.012886819000000001 2024-04-18T21:05:42.365 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.365 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.365 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:42.365 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629696+0000", 2024-04-18T21:05:42.365 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019485499999999999 2024-04-18T21:05:42.365 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.366 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.366 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:42.366 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629940+0000", 2024-04-18T21:05:42.366 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00024386399999999999 2024-04-18T21:05:42.366 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.366 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.366 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:42.366 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640100+0000", 2024-04-18T21:05:42.366 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010159645 2024-04-18T21:05:42.366 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.366 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.366 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:42.366 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659516+0000", 2024-04-18T21:05:42.366 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019416563000000001 2024-04-18T21:05:42.367 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.367 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.367 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:42.367 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659684+0000", 2024-04-18T21:05:42.367 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016750900000000001 2024-04-18T21:05:42.367 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.367 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.367 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:42.367 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659787+0000", 2024-04-18T21:05:42.367 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000102905 2024-04-18T21:05:42.367 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:42.367 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:42.367 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:42.367 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.367 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.367 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:42.368 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:05:42.368 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 36.676433385999999, 2024-04-18T21:05:42.368 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043581898000000001, 2024-04-18T21:05:42.368 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:42.368 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:42.368 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.368 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:42.368 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.368 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:42.368 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:05:42.368 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:42.368 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.368 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.368 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:42.368 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:05:42.369 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:42.369 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.369 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.369 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:42.369 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616641+0000", 2024-04-18T21:05:42.369 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:05:42.369 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.369 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.369 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:42.369 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616648+0000", 2024-04-18T21:05:42.369 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3860000000000001e-06 2024-04-18T21:05:42.369 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.369 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.369 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:42.370 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616666+0000", 2024-04-18T21:05:42.370 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7583000000000001e-05 2024-04-18T21:05:42.370 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.370 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.370 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.370 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616679+0000", 2024-04-18T21:05:42.370 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3322999999999999e-05 2024-04-18T21:05:42.370 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.370 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.370 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:42.370 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630373+0000", 2024-04-18T21:05:42.370 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013694207999999999 2024-04-18T21:05:42.371 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.371 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.371 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:42.371 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630545+0000", 2024-04-18T21:05:42.371 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000171683 2024-04-18T21:05:42.371 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.371 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.371 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:42.371 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630728+0000", 2024-04-18T21:05:42.371 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000182599 2024-04-18T21:05:42.371 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.371 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.371 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:42.371 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640600+0000", 2024-04-18T21:05:42.372 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0098726119999999994 2024-04-18T21:05:42.372 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.372 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.372 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:42.372 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659927+0000", 2024-04-18T21:05:42.372 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019326724999999999 2024-04-18T21:05:42.372 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.372 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.372 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:42.372 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660112+0000", 2024-04-18T21:05:42.372 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000185203 2024-04-18T21:05:42.372 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.372 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.372 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:42.372 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660222+0000", 2024-04-18T21:05:42.373 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109343 2024-04-18T21:05:42.373 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:42.373 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:42.373 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:42.373 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.373 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.373 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:42.373 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:05:42.373 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 36.675568028000001, 2024-04-18T21:05:42.373 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043121310000000003, 2024-04-18T21:05:42.373 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:42.373 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:42.373 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.373 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:42.373 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.373 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:42.374 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:05:42.374 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:42.374 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.374 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.374 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:42.374 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:05:42.374 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:42.374 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.374 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.374 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:42.374 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617506+0000", 2024-04-18T21:05:42.374 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9999999999999995e-07 2024-04-18T21:05:42.375 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.375 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.375 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:42.375 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617513+0000", 2024-04-18T21:05:42.375 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.9700000000000002e-06 2024-04-18T21:05:42.375 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.375 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.375 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:42.375 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617531+0000", 2024-04-18T21:05:42.375 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8105999999999999e-05 2024-04-18T21:05:42.375 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.375 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.375 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.375 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617545+0000", 2024-04-18T21:05:42.375 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3703000000000001e-05 2024-04-18T21:05:42.376 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.376 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.376 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:42.376 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632129+0000", 2024-04-18T21:05:42.376 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.014584135999999999 2024-04-18T21:05:42.376 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.376 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.376 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:42.376 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632361+0000", 2024-04-18T21:05:42.376 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023171800000000001 2024-04-18T21:05:42.376 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.376 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.376 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:42.376 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632804+0000", 2024-04-18T21:05:42.376 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000443549 2024-04-18T21:05:42.377 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.377 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.377 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:42.377 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646340+0000", 2024-04-18T21:05:42.377 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013535902000000001 2024-04-18T21:05:42.377 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.377 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.377 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:42.377 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660363+0000", 2024-04-18T21:05:42.377 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01402318 2024-04-18T21:05:42.377 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.377 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.378 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:42.378 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660523+0000", 2024-04-18T21:05:42.378 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00015989899999999999 2024-04-18T21:05:42.378 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.378 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.378 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:42.378 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660626+0000", 2024-04-18T21:05:42.378 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010314699999999999 2024-04-18T21:05:42.378 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:42.378 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:42.378 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:42.378 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.378 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.379 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:42.379 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:05:42.379 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 36.675428334999999, 2024-04-18T21:05:42.379 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024927483, 2024-04-18T21:05:42.379 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:42.379 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:42.379 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.379 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:42.379 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.379 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:42.379 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:05:42.379 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:42.379 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.379 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.380 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:42.380 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:05:42.380 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:42.380 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.380 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.380 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:42.380 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617646+0000", 2024-04-18T21:05:42.380 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3030000000000001e-06 2024-04-18T21:05:42.380 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.380 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.380 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:42.380 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617653+0000", 2024-04-18T21:05:42.380 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7530000000000004e-06 2024-04-18T21:05:42.380 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.380 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.381 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:42.381 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617673+0000", 2024-04-18T21:05:42.381 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9967e-05 2024-04-18T21:05:42.381 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.381 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.381 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.381 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617688+0000", 2024-04-18T21:05:42.381 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5153e-05 2024-04-18T21:05:42.381 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.381 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.381 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:42.381 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619244+0000", 2024-04-18T21:05:42.381 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001555531 2024-04-18T21:05:42.381 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.382 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.382 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:42.382 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619361+0000", 2024-04-18T21:05:42.382 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011784400000000001 2024-04-18T21:05:42.382 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.382 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.382 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:42.382 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619604+0000", 2024-04-18T21:05:42.382 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000243007 2024-04-18T21:05:42.382 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.382 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.382 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:42.382 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.625480+0000", 2024-04-18T21:05:42.383 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0058759349999999997 2024-04-18T21:05:42.383 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.383 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.383 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:42.383 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642342+0000", 2024-04-18T21:05:42.383 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016861373999999998 2024-04-18T21:05:42.383 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.383 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.383 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:42.383 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642484+0000", 2024-04-18T21:05:42.383 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000142423 2024-04-18T21:05:42.383 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.383 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.383 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:42.383 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642572+0000", 2024-04-18T21:05:42.384 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8193000000000001e-05 2024-04-18T21:05:42.384 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:42.384 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:42.384 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:42.384 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.384 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.384 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:42.384 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:05:42.384 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 36.675146832000003, 2024-04-18T21:05:42.384 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024956974999999999, 2024-04-18T21:05:42.384 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:42.384 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:42.384 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.384 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:42.384 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.385 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:42.385 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:05:42.385 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:42.385 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.385 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.385 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:42.385 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:05:42.385 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:42.385 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.385 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.385 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:42.385 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617928+0000", 2024-04-18T21:05:42.386 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5430000000000001e-06 2024-04-18T21:05:42.386 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.386 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.386 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:42.386 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617937+0000", 2024-04-18T21:05:42.386 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6629999999999999e-06 2024-04-18T21:05:42.386 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.386 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.386 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:42.386 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617955+0000", 2024-04-18T21:05:42.386 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8749999999999998e-05 2024-04-18T21:05:42.386 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.387 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.387 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.387 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617971+0000", 2024-04-18T21:05:42.387 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.605e-05 2024-04-18T21:05:42.387 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.387 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.387 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:42.387 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621019+0000", 2024-04-18T21:05:42.387 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0030472369999999999 2024-04-18T21:05:42.387 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.387 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.387 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:42.387 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621249+0000", 2024-04-18T21:05:42.387 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000230075 2024-04-18T21:05:42.388 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.388 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.388 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:42.388 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621450+0000", 2024-04-18T21:05:42.388 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020166499999999999 2024-04-18T21:05:42.388 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.388 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.388 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:42.388 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.626233+0000", 2024-04-18T21:05:42.388 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047827390000000003 2024-04-18T21:05:42.388 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.388 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.388 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:42.388 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642693+0000", 2024-04-18T21:05:42.389 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01645961 2024-04-18T21:05:42.389 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.389 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.389 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:42.389 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642798+0000", 2024-04-18T21:05:42.389 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010559499999999999 2024-04-18T21:05:42.389 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.389 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.389 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:42.389 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642883+0000", 2024-04-18T21:05:42.389 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5048000000000003e-05 2024-04-18T21:05:42.389 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:42.389 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:42.389 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:42.390 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.390 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.390 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:42.390 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:05:42.390 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 36.673451204000003, 2024-04-18T21:05:42.390 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024086478000000001, 2024-04-18T21:05:42.390 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:42.390 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:42.390 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.390 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:42.390 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.390 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:42.390 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:05:42.390 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:42.391 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.391 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.391 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:42.391 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:05:42.391 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:42.391 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.391 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.391 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:42.391 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619624+0000", 2024-04-18T21:05:42.391 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.75e-06 2024-04-18T21:05:42.391 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.391 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.391 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:42.391 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619637+0000", 2024-04-18T21:05:42.392 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3540000000000001e-05 2024-04-18T21:05:42.392 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.392 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.392 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:42.392 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619666+0000", 2024-04-18T21:05:42.392 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8685999999999999e-05 2024-04-18T21:05:42.392 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.392 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.392 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.392 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619685+0000", 2024-04-18T21:05:42.392 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8681999999999998e-05 2024-04-18T21:05:42.392 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.392 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.392 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:42.392 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622275+0000", 2024-04-18T21:05:42.392 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0025899260000000002 2024-04-18T21:05:42.392 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.393 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.393 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:42.393 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622572+0000", 2024-04-18T21:05:42.393 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00029722 2024-04-18T21:05:42.393 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.393 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.393 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:42.393 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622752+0000", 2024-04-18T21:05:42.393 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018065900000000001 2024-04-18T21:05:42.393 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.393 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.393 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:42.393 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.626326+0000", 2024-04-18T21:05:42.393 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035737310000000001 2024-04-18T21:05:42.393 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.394 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.394 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:42.394 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643565+0000", 2024-04-18T21:05:42.394 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017238430999999999 2024-04-18T21:05:42.394 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.394 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.394 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:42.394 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643646+0000", 2024-04-18T21:05:42.394 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.1481000000000001e-05 2024-04-18T21:05:42.394 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.394 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.394 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:42.394 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643708+0000", 2024-04-18T21:05:42.394 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.2372000000000005e-05 2024-04-18T21:05:42.395 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:42.395 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:42.395 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:42.395 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.395 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.395 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:42.395 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:05:42.395 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 36.673285051000001, 2024-04-18T21:05:42.395 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026822450000000001, 2024-04-18T21:05:42.395 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:42.395 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:42.395 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.396 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:42.396 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.396 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:42.396 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:05:42.396 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:42.396 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.396 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.396 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:42.396 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:05:42.396 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:42.396 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.396 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.396 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:42.396 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619789+0000", 2024-04-18T21:05:42.396 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:05:42.397 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.397 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.397 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:42.397 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619797+0000", 2024-04-18T21:05:42.397 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.6899999999999992e-06 2024-04-18T21:05:42.397 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.397 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.397 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:42.397 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619816+0000", 2024-04-18T21:05:42.397 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9352999999999999e-05 2024-04-18T21:05:42.397 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.397 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.397 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.397 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619832+0000", 2024-04-18T21:05:42.397 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6013000000000001e-05 2024-04-18T21:05:42.398 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.398 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.398 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:42.398 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620528+0000", 2024-04-18T21:05:42.398 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00069565600000000001 2024-04-18T21:05:42.398 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.398 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.398 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:42.398 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620735+0000", 2024-04-18T21:05:42.398 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000207025 2024-04-18T21:05:42.398 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.398 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.399 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:42.399 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620912+0000", 2024-04-18T21:05:42.399 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017748199999999999 2024-04-18T21:05:42.399 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.399 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.399 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:42.399 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.625605+0000", 2024-04-18T21:05:42.399 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0046924439999999996 2024-04-18T21:05:42.399 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.399 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.399 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:42.399 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646349+0000", 2024-04-18T21:05:42.399 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.020744318000000001 2024-04-18T21:05:42.399 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.400 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.400 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:42.400 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646483+0000", 2024-04-18T21:05:42.400 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013428999999999999 2024-04-18T21:05:42.400 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.400 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.400 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:42.400 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646611+0000", 2024-04-18T21:05:42.400 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012710299999999999 2024-04-18T21:05:42.400 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:42.400 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:42.400 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:42.400 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.400 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.401 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:42.401 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:05:42.401 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 36.672614617999997, 2024-04-18T21:05:42.401 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023516516000000001, 2024-04-18T21:05:42.401 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:42.401 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:42.401 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:05:42.401 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:42.401 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.401 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:42.401 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:05:42.401 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:42.401 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.401 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.401 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:42.401 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:05:42.402 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:42.402 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.402 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.402 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:42.402 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620460+0000", 2024-04-18T21:05:42.402 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.787e-06 2024-04-18T21:05:42.402 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.402 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.402 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:42.402 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620470+0000", 2024-04-18T21:05:42.403 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.2560000000000008e-06 2024-04-18T21:05:42.403 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.403 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.403 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:42.403 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620496+0000", 2024-04-18T21:05:42.403 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.6205999999999999e-05 2024-04-18T21:05:42.403 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.403 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.403 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.403 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620517+0000", 2024-04-18T21:05:42.403 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1223e-05 2024-04-18T21:05:42.403 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.403 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.403 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:42.404 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624060+0000", 2024-04-18T21:05:42.404 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035434160000000002 2024-04-18T21:05:42.404 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.404 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.404 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:42.404 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624390+0000", 2024-04-18T21:05:42.404 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00033000500000000002 2024-04-18T21:05:42.404 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:42.404 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:42.404 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:42.404 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643975+0000", 2024-04-18T21:05:42.404 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019584622999999999 2024-04-18T21:05:42.405 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:42.405 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:42.405 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:42.405 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:42.405 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:42.405 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:05:42.406 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:05:42.407 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:42.407+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:42.459 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-18T21:05:42.459 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-18T21:05:42.460 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2024-04-18T21:05:42.460 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-18T21:05:42.460 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-18T21:05:42.460 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2024-04-18T21:05:42.507 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:42.507+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:42.536 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:05:42.537 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [], 2024-04-18T21:05:42.537 INFO:teuthology.orchestra.run.smithi150.stdout: "num_ops": 0 2024-04-18T21:05:42.537 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:05:42.552 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:05:42.579 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:05:42.579 INFO:teuthology.orchestra.run.smithi150.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-18T21:05:42.579 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:05:42.641 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:42.643+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:42.677 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:05:42.678 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [], 2024-04-18T21:05:42.678 INFO:teuthology.orchestra.run.smithi150.stdout: "complaint_time": 30, 2024-04-18T21:05:42.678 INFO:teuthology.orchestra.run.smithi150.stdout: "num_blocked_ops": 0 2024-04-18T21:05:42.678 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:05:42.691 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:05:42.733 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:42.735+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:42.811 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:42.811+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:42.856 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:05:42.856 INFO:teuthology.orchestra.run.smithi150.stdout: "size": 20, 2024-04-18T21:05:42.856 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 600, 2024-04-18T21:05:42.856 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [ 2024-04-18T21:05:42.857 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.857 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-18T21:05:42.857 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:05:42.857 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 48.051319591000002, 2024-04-18T21:05:42.857 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0093051590000000003, 2024-04-18T21:05:42.857 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:42.857 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:42.857 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.857 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:42.857 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.857 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:42.857 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:05:42.858 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:42.858 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.858 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.858 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:42.858 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:05:42.858 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:42.858 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.858 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.858 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:42.858 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804851+0000", 2024-04-18T21:05:42.858 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7039999999999999e-06 2024-04-18T21:05:42.858 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.859 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.859 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:42.859 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804864+0000", 2024-04-18T21:05:42.859 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.276e-05 2024-04-18T21:05:42.859 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.859 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.859 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:42.859 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804895+0000", 2024-04-18T21:05:42.859 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.1204999999999997e-05 2024-04-18T21:05:42.859 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.860 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.860 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.860 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804908+0000", 2024-04-18T21:05:42.860 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3317e-05 2024-04-18T21:05:42.860 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.860 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.860 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:42.860 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805131+0000", 2024-04-18T21:05:42.860 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00022246700000000001 2024-04-18T21:05:42.860 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.860 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.860 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:42.861 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805171+0000", 2024-04-18T21:05:42.861 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.0164999999999999e-05 2024-04-18T21:05:42.861 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.861 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.861 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:42.861 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814086+0000", 2024-04-18T21:05:42.861 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0089155329999999998 2024-04-18T21:05:42.861 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.861 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.861 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:42.861 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814154+0000", 2024-04-18T21:05:42.861 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.8008000000000003e-05 2024-04-18T21:05:42.862 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:42.862 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:42.862 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:42.862 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.862 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.862 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-18T21:05:42.862 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:05:42.862 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 48.050554398000003, 2024-04-18T21:05:42.862 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0086469770000000001, 2024-04-18T21:05:42.862 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:42.863 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:42.863 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.863 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:42.863 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.863 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:42.863 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:05:42.863 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:42.863 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.863 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.863 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:42.863 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:05:42.863 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:42.864 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.864 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.864 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:42.864 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805616+0000", 2024-04-18T21:05:42.864 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7799999999999999e-06 2024-04-18T21:05:42.864 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.864 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.864 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:42.864 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805707+0000", 2024-04-18T21:05:42.864 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0917999999999999e-05 2024-04-18T21:05:42.864 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.864 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.865 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:42.865 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805739+0000", 2024-04-18T21:05:42.865 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.2512000000000003e-05 2024-04-18T21:05:42.865 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.865 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.865 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.865 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805763+0000", 2024-04-18T21:05:42.865 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3266000000000001e-05 2024-04-18T21:05:42.865 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.865 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.865 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:42.865 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.806024+0000", 2024-04-18T21:05:42.865 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000261716 2024-04-18T21:05:42.866 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.866 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.866 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:42.866 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.806073+0000", 2024-04-18T21:05:42.866 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.8844999999999997e-05 2024-04-18T21:05:42.866 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.866 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.866 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:42.866 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814162+0000", 2024-04-18T21:05:42.866 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0080882860000000001 2024-04-18T21:05:42.866 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.866 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.867 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:42.867 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814261+0000", 2024-04-18T21:05:42.867 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.9654000000000005e-05 2024-04-18T21:05:42.867 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:42.867 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:42.867 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:42.867 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.867 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.867 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'64)", 2024-04-18T21:05:42.867 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:05:42.867 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 48.048783354000001, 2024-04-18T21:05:42.867 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0089721509999999994, 2024-04-18T21:05:42.867 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:42.868 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:42.868 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.868 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:42.868 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.868 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:42.868 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:05:42.868 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:42.868 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.868 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.868 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:42.868 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:05:42.868 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:42.869 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.869 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.869 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:42.869 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807387+0000", 2024-04-18T21:05:42.869 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.0329999999999998e-06 2024-04-18T21:05:42.869 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.869 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.869 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:42.869 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807443+0000", 2024-04-18T21:05:42.869 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.5376e-05 2024-04-18T21:05:42.869 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.869 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.869 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:42.870 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807467+0000", 2024-04-18T21:05:42.870 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.4621999999999999e-05 2024-04-18T21:05:42.870 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.870 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.870 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.870 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807482+0000", 2024-04-18T21:05:42.870 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.436e-05 2024-04-18T21:05:42.870 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.870 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.870 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:42.870 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.809243+0000", 2024-04-18T21:05:42.870 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001761725 2024-04-18T21:05:42.871 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.871 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.871 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:42.871 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.809295+0000", 2024-04-18T21:05:42.871 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.1445e-05 2024-04-18T21:05:42.871 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.871 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.871 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:42.871 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.816293+0000", 2024-04-18T21:05:42.871 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0069981749999999997 2024-04-18T21:05:42.871 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.871 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.871 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:42.872 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.816357+0000", 2024-04-18T21:05:42.872 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.4414999999999999e-05 2024-04-18T21:05:42.872 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:42.872 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:42.872 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:42.872 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.872 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.872 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:42.872 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:05:42.872 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 37.240873983999997, 2024-04-18T21:05:42.872 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.040843365, 2024-04-18T21:05:42.872 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:42.873 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:42.873 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.873 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:42.873 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.873 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:42.873 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:05:42.873 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:42.873 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.873 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.873 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:42.874 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:05:42.874 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:42.874 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.874 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.874 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:42.874 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615297+0000", 2024-04-18T21:05:42.874 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2800000000000002e-06 2024-04-18T21:05:42.874 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.874 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.874 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:42.874 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615308+0000", 2024-04-18T21:05:42.874 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0813e-05 2024-04-18T21:05:42.874 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.875 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.875 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:42.875 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615330+0000", 2024-04-18T21:05:42.875 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2370000000000001e-05 2024-04-18T21:05:42.875 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.875 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.875 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.875 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615346+0000", 2024-04-18T21:05:42.875 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6200000000000001e-05 2024-04-18T21:05:42.875 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.875 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.875 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:42.876 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615470+0000", 2024-04-18T21:05:42.876 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012385799999999999 2024-04-18T21:05:42.876 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.876 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.876 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:05:42.876 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615488+0000", 2024-04-18T21:05:42.876 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7923000000000001e-05 2024-04-18T21:05:42.876 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.876 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.876 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:42.876 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.630993+0000", 2024-04-18T21:05:42.876 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.01550532 2024-04-18T21:05:42.876 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.877 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.877 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:42.877 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631165+0000", 2024-04-18T21:05:42.877 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000171588 2024-04-18T21:05:42.877 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.877 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.877 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:42.877 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631320+0000", 2024-04-18T21:05:42.877 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000155162 2024-04-18T21:05:42.877 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.877 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.877 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:42.877 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635157+0000", 2024-04-18T21:05:42.878 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0038370790000000002 2024-04-18T21:05:42.878 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.878 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.878 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:42.878 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.655904+0000", 2024-04-18T21:05:42.878 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.020746483999999999 2024-04-18T21:05:42.878 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.878 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.878 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:42.878 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656032+0000", 2024-04-18T21:05:42.878 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012864199999999999 2024-04-18T21:05:42.878 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.879 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.879 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:42.879 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656138+0000", 2024-04-18T21:05:42.879 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000105646 2024-04-18T21:05:42.879 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:42.879 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:42.879 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:42.879 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.879 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.879 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:42.879 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:05:42.879 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 37.240781812000002, 2024-04-18T21:05:42.880 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.041266444999999999, 2024-04-18T21:05:42.880 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:42.880 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:42.880 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.880 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:42.880 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.880 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:42.880 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:05:42.880 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:42.880 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.880 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.880 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:42.881 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:05:42.881 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:42.881 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.881 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.881 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:42.881 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615388+0000", 2024-04-18T21:05:42.881 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:05:42.881 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.881 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.881 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:42.881 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:05:42.882 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.7299999999999994e-06 2024-04-18T21:05:42.882 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.882 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.882 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:42.882 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615415+0000", 2024-04-18T21:05:42.882 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7807000000000001e-05 2024-04-18T21:05:42.882 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.882 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.882 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.882 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615431+0000", 2024-04-18T21:05:42.882 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6127e-05 2024-04-18T21:05:42.883 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.883 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.883 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:42.883 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615621+0000", 2024-04-18T21:05:42.883 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000189781 2024-04-18T21:05:42.883 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.883 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.883 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:42.883 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615634+0000", 2024-04-18T21:05:42.883 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3383e-05 2024-04-18T21:05:42.883 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.883 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.884 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:42.884 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631703+0000", 2024-04-18T21:05:42.884 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016068737 2024-04-18T21:05:42.884 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.884 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.884 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:42.884 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631809+0000", 2024-04-18T21:05:42.884 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000106823 2024-04-18T21:05:42.884 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.884 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.884 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:42.884 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631988+0000", 2024-04-18T21:05:42.884 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000179008 2024-04-18T21:05:42.885 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.885 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.885 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:42.885 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635172+0000", 2024-04-18T21:05:42.885 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.003183029 2024-04-18T21:05:42.885 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.885 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.885 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:42.885 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656392+0000", 2024-04-18T21:05:42.885 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.021220638999999999 2024-04-18T21:05:42.885 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.885 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.886 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:42.886 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656533+0000", 2024-04-18T21:05:42.886 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014126500000000001 2024-04-18T21:05:42.886 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.886 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.886 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:42.886 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656653+0000", 2024-04-18T21:05:42.886 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000119883 2024-04-18T21:05:42.886 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:42.886 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:42.886 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:42.886 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.887 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.887 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:42.887 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:05:42.887 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 37.240694388999998, 2024-04-18T21:05:42.887 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.042492302000000003, 2024-04-18T21:05:42.887 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:42.887 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:42.887 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.887 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:42.887 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.888 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:42.888 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:05:42.888 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:42.888 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.888 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.888 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:42.888 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:05:42.888 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:42.888 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.888 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.888 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:42.888 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615475+0000", 2024-04-18T21:05:42.889 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.17e-06 2024-04-18T21:05:42.889 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.889 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.889 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:42.889 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615528+0000", 2024-04-18T21:05:42.889 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.2159e-05 2024-04-18T21:05:42.889 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.889 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.889 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:42.889 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615542+0000", 2024-04-18T21:05:42.889 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4197e-05 2024-04-18T21:05:42.889 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.890 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.890 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.890 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615559+0000", 2024-04-18T21:05:42.890 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.749e-05 2024-04-18T21:05:42.890 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.890 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.890 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:42.890 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615685+0000", 2024-04-18T21:05:42.890 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012617499999999999 2024-04-18T21:05:42.890 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.890 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.891 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:05:42.891 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:05:42.891 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4749999999999999e-05 2024-04-18T21:05:42.891 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.891 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.891 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:42.891 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632332+0000", 2024-04-18T21:05:42.891 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016631988 2024-04-18T21:05:42.891 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.891 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.891 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:42.891 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632477+0000", 2024-04-18T21:05:42.892 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014437200000000001 2024-04-18T21:05:42.892 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.892 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.892 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:42.892 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632620+0000", 2024-04-18T21:05:42.892 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000143566 2024-04-18T21:05:42.892 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.892 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.892 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:42.892 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635185+0000", 2024-04-18T21:05:42.892 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0025644209999999999 2024-04-18T21:05:42.893 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.893 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.893 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:42.893 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657803+0000", 2024-04-18T21:05:42.893 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.022618743 2024-04-18T21:05:42.893 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.893 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.893 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:42.893 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657890+0000", 2024-04-18T21:05:42.893 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.6688999999999996e-05 2024-04-18T21:05:42.893 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.893 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.893 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:42.894 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657967+0000", 2024-04-18T21:05:42.894 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.6582000000000006e-05 2024-04-18T21:05:42.894 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:42.894 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:42.894 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:42.894 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.894 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.894 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:42.894 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:05:42.894 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 37.240563577000003, 2024-04-18T21:05:42.894 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.043603435000000003, 2024-04-18T21:05:42.894 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:42.895 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:42.895 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.895 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:42.895 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.895 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:42.895 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:05:42.895 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:42.895 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.895 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.895 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:42.895 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:05:42.895 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:42.895 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.895 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.896 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:42.896 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615607+0000", 2024-04-18T21:05:42.896 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4300000000000001e-06 2024-04-18T21:05:42.896 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.896 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.896 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:42.896 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615614+0000", 2024-04-18T21:05:42.896 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.4100000000000002e-06 2024-04-18T21:05:42.896 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.896 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.896 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:42.896 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615632+0000", 2024-04-18T21:05:42.896 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7863000000000002e-05 2024-04-18T21:05:42.896 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.897 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.897 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.897 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615647+0000", 2024-04-18T21:05:42.897 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5187e-05 2024-04-18T21:05:42.897 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.897 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.897 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:42.897 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615765+0000", 2024-04-18T21:05:42.897 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000117955 2024-04-18T21:05:42.897 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.898 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.898 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:42.898 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615781+0000", 2024-04-18T21:05:42.898 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6123000000000001e-05 2024-04-18T21:05:42.898 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.898 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.898 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:42.898 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633055+0000", 2024-04-18T21:05:42.898 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.017273909 2024-04-18T21:05:42.898 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.898 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.898 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:42.899 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633254+0000", 2024-04-18T21:05:42.899 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00019903799999999999 2024-04-18T21:05:42.899 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.899 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.899 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:42.899 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633624+0000", 2024-04-18T21:05:42.899 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000369656 2024-04-18T21:05:42.899 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.899 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.899 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:42.899 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635595+0000", 2024-04-18T21:05:42.900 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001971287 2024-04-18T21:05:42.900 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.900 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.900 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:42.900 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659026+0000", 2024-04-18T21:05:42.900 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.023431495 2024-04-18T21:05:42.900 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.900 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.900 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:42.900 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659117+0000", 2024-04-18T21:05:42.900 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0885999999999997e-05 2024-04-18T21:05:42.900 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.900 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.901 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:42.901 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659209+0000", 2024-04-18T21:05:42.901 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.1195999999999999e-05 2024-04-18T21:05:42.901 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:42.901 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:42.901 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:42.901 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.901 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.901 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:42.901 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:42.901 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 37.240498348000003, 2024-04-18T21:05:42.901 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.03492514, 2024-04-18T21:05:42.901 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:42.902 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:42.902 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.902 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:42.902 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.902 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:42.902 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:42.902 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:42.902 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.902 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.902 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:42.902 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:42.902 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:42.903 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.903 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.903 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:42.903 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:05:42.903 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.407e-06 2024-04-18T21:05:42.903 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.903 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.903 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:42.903 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615679+0000", 2024-04-18T21:05:42.903 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.2130000000000002e-06 2024-04-18T21:05:42.903 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.903 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.903 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:42.904 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615701+0000", 2024-04-18T21:05:42.904 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2316000000000001e-05 2024-04-18T21:05:42.904 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.904 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.904 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.904 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615717+0000", 2024-04-18T21:05:42.904 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6197000000000001e-05 2024-04-18T21:05:42.904 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.904 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.904 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:42.904 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615828+0000", 2024-04-18T21:05:42.904 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000110899 2024-04-18T21:05:42.905 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.905 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.905 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:05:42.905 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615840+0000", 2024-04-18T21:05:42.905 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.1423000000000001e-05 2024-04-18T21:05:42.905 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.905 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.905 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:42.905 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628046+0000", 2024-04-18T21:05:42.905 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.012206295000000001 2024-04-18T21:05:42.905 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.905 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.905 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:42.906 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628323+0000", 2024-04-18T21:05:42.906 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00027658700000000001 2024-04-18T21:05:42.906 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.906 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.906 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:42.906 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628599+0000", 2024-04-18T21:05:42.906 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00027676699999999997 2024-04-18T21:05:42.906 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.906 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.906 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:42.906 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634869+0000", 2024-04-18T21:05:42.906 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.006269536 2024-04-18T21:05:42.907 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.907 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.907 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:42.907 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650333+0000", 2024-04-18T21:05:42.907 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.015463645999999999 2024-04-18T21:05:42.907 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.907 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.907 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:42.907 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650474+0000", 2024-04-18T21:05:42.907 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014091799999999999 2024-04-18T21:05:42.907 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.907 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.907 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:42.908 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650595+0000", 2024-04-18T21:05:42.908 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012193600000000001 2024-04-18T21:05:42.908 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:42.908 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:42.908 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:42.908 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.908 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.908 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:42.908 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:05:42.908 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 37.240413238999999, 2024-04-18T21:05:42.908 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.040588320999999997, 2024-04-18T21:05:42.909 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:42.909 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:42.909 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.909 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:42.909 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.909 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:42.909 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:05:42.909 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:42.909 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.909 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.909 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:42.909 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:05:42.909 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:42.910 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.910 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.910 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:42.910 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615757+0000", 2024-04-18T21:05:42.910 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2270000000000001e-06 2024-04-18T21:05:42.910 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.910 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.910 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:42.910 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615765+0000", 2024-04-18T21:05:42.910 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.9400000000000002e-06 2024-04-18T21:05:42.910 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.911 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.911 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:42.911 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615785+0000", 2024-04-18T21:05:42.911 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.0749000000000001e-05 2024-04-18T21:05:42.911 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.911 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.911 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.911 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615804+0000", 2024-04-18T21:05:42.911 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.8774e-05 2024-04-18T21:05:42.911 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.911 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.911 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:42.911 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615888+0000", 2024-04-18T21:05:42.912 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.4111999999999997e-05 2024-04-18T21:05:42.912 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.912 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.912 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:42.912 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615895+0000", 2024-04-18T21:05:42.912 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.0469999999999996e-06 2024-04-18T21:05:42.912 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.912 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.912 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:42.912 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629280+0000", 2024-04-18T21:05:42.912 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.013384416 2024-04-18T21:05:42.912 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.912 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.913 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:42.913 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629488+0000", 2024-04-18T21:05:42.913 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00020852800000000001 2024-04-18T21:05:42.913 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.913 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.913 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:42.913 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629869+0000", 2024-04-18T21:05:42.913 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00038042300000000001 2024-04-18T21:05:42.913 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.913 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.913 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:42.913 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635041+0000", 2024-04-18T21:05:42.913 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.005172383 2024-04-18T21:05:42.914 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.914 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.914 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:42.914 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656125+0000", 2024-04-18T21:05:42.914 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.021084025999999999 2024-04-18T21:05:42.914 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.914 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.914 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:42.914 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656240+0000", 2024-04-18T21:05:42.914 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000115352 2024-04-18T21:05:42.914 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.915 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.915 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:42.915 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656344+0000", 2024-04-18T21:05:42.915 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00010334400000000001 2024-04-18T21:05:42.915 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:42.915 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:42.915 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:42.915 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.915 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.915 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:42.916 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:05:42.916 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 37.240345918999999, 2024-04-18T21:05:42.916 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.043549577999999999, 2024-04-18T21:05:42.916 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:42.916 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:42.916 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.916 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:42.916 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.916 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:42.916 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:05:42.916 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:42.916 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.917 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.917 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:42.917 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:05:42.917 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:42.917 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.917 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.917 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:42.917 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:05:42.917 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.5000000000000002e-07 2024-04-18T21:05:42.917 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.917 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.917 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:42.918 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615828+0000", 2024-04-18T21:05:42.918 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.2359999999999998e-06 2024-04-18T21:05:42.918 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.918 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.918 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:42.918 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615838+0000", 2024-04-18T21:05:42.918 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0087e-05 2024-04-18T21:05:42.918 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.918 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.918 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.919 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615846+0000", 2024-04-18T21:05:42.919 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.67e-06 2024-04-18T21:05:42.919 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.919 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.919 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:42.919 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615963+0000", 2024-04-18T21:05:42.919 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00011630500000000001 2024-04-18T21:05:42.919 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.919 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.919 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:42.919 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615979+0000", 2024-04-18T21:05:42.919 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.613e-05 2024-04-18T21:05:42.920 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.920 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.920 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:42.920 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632392+0000", 2024-04-18T21:05:42.920 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016413317 2024-04-18T21:05:42.920 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.920 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.920 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:42.920 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632568+0000", 2024-04-18T21:05:42.920 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00017539500000000001 2024-04-18T21:05:42.920 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.921 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.921 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:42.921 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632748+0000", 2024-04-18T21:05:42.921 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00017991799999999999 2024-04-18T21:05:42.921 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.921 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.921 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:42.921 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635542+0000", 2024-04-18T21:05:42.921 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00279481 2024-04-18T21:05:42.921 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.921 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.922 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:42.922 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659232+0000", 2024-04-18T21:05:42.922 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.023689212000000001 2024-04-18T21:05:42.922 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.922 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.922 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:42.922 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659314+0000", 2024-04-18T21:05:42.922 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.2528999999999995e-05 2024-04-18T21:05:42.922 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.922 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.922 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:42.922 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659372+0000", 2024-04-18T21:05:42.922 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.8218999999999999e-05 2024-04-18T21:05:42.923 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:42.923 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:42.923 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:42.923 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.923 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.923 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:42.923 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:05:42.923 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 37.240284486999997, 2024-04-18T21:05:42.923 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.039335347, 2024-04-18T21:05:42.923 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:42.923 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:42.923 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "started", 2024-04-18T21:05:42.924 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:42.924 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.924 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:42.924 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:05:42.924 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:42.924 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.924 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.924 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:42.924 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:05:42.924 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:42.924 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.924 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.924 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:42.925 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615885+0000", 2024-04-18T21:05:42.925 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2699999999999999e-06 2024-04-18T21:05:42.925 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.925 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.925 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:42.925 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615892+0000", 2024-04-18T21:05:42.925 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.6499999999999999e-06 2024-04-18T21:05:42.925 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.925 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.925 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:42.926 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615906+0000", 2024-04-18T21:05:42.926 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.393e-05 2024-04-18T21:05:42.926 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.926 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.926 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.926 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615919+0000", 2024-04-18T21:05:42.926 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2860000000000001e-05 2024-04-18T21:05:42.926 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.926 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.926 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:42.926 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616027+0000", 2024-04-18T21:05:42.926 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000107852 2024-04-18T21:05:42.926 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.927 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.927 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:05:42.927 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616037+0000", 2024-04-18T21:05:42.927 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:05:42.927 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.927 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.927 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:42.927 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622719+0000", 2024-04-18T21:05:42.927 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0066817220000000002 2024-04-18T21:05:42.927 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.927 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.928 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:42.928 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623006+0000", 2024-04-18T21:05:42.928 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00028783699999999999 2024-04-18T21:05:42.928 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.928 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.928 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:42.928 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.655220+0000", 2024-04-18T21:05:42.928 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.032213036 2024-04-18T21:05:42.928 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:42.928 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:42.929 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:42.929 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.929 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.929 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:42.929 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:42.929 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 37.240228813999998, 2024-04-18T21:05:42.929 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.032845253999999997, 2024-04-18T21:05:42.929 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:42.929 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:42.929 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "started", 2024-04-18T21:05:42.929 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:42.929 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.929 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:42.930 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:42.930 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:42.930 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.930 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.930 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:42.930 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:42.930 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:42.930 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.930 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.930 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:42.930 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615942+0000", 2024-04-18T21:05:42.931 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.717e-06 2024-04-18T21:05:42.931 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.931 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.931 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:42.931 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615946+0000", 2024-04-18T21:05:42.931 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.6e-06 2024-04-18T21:05:42.931 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.931 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.931 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:42.931 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615960+0000", 2024-04-18T21:05:42.931 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:05:42.932 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.932 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.932 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.932 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615968+0000", 2024-04-18T21:05:42.932 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.9070000000000007e-06 2024-04-18T21:05:42.932 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.932 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.932 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:42.932 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616100+0000", 2024-04-18T21:05:42.932 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000132402 2024-04-18T21:05:42.932 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.932 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.932 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:05:42.932 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616117+0000", 2024-04-18T21:05:42.933 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6653000000000001e-05 2024-04-18T21:05:42.933 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.933 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.933 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:42.933 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621566+0000", 2024-04-18T21:05:42.933 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0054497740000000001 2024-04-18T21:05:42.933 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.933 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.933 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:42.933 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622801+0000", 2024-04-18T21:05:42.933 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0012345710000000001 2024-04-18T21:05:42.933 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.933 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.934 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:42.934 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648785+0000", 2024-04-18T21:05:42.934 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.025984104000000001 2024-04-18T21:05:42.934 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:42.934 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:42.934 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:42.934 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.934 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.934 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:42.935 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:05:42.935 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 37.234377463999998, 2024-04-18T21:05:42.935 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.011561350999999999, 2024-04-18T21:05:42.935 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:42.935 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:42.935 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.935 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:42.935 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.935 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:42.935 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:05:42.935 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:42.935 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.935 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.936 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:42.936 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:05:42.936 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:42.936 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.936 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.936 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:42.936 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621792+0000", 2024-04-18T21:05:42.936 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.4000000000000001e-07 2024-04-18T21:05:42.936 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.936 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.936 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:42.936 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:05:42.936 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.1050000000000002e-05 2024-04-18T21:05:42.936 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.937 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.937 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:42.937 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622608+0000", 2024-04-18T21:05:42.937 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00077505900000000003 2024-04-18T21:05:42.937 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.937 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.937 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.937 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623879+0000", 2024-04-18T21:05:42.937 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0012705839999999999 2024-04-18T21:05:42.937 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.937 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.937 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:42.938 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624010+0000", 2024-04-18T21:05:42.938 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00013176900000000001 2024-04-18T21:05:42.938 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.938 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.938 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:42.938 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624058+0000", 2024-04-18T21:05:42.938 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.7299000000000002e-05 2024-04-18T21:05:42.938 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.938 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.938 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:42.938 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633262+0000", 2024-04-18T21:05:42.938 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0092048770000000002 2024-04-18T21:05:42.939 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.939 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.939 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:42.939 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633353+0000", 2024-04-18T21:05:42.939 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0073000000000003e-05 2024-04-18T21:05:42.939 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:42.939 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:42.939 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:42.939 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.939 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.939 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:42.939 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:05:42.940 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 37.232250078, 2024-04-18T21:05:42.940 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0098419370000000003, 2024-04-18T21:05:42.940 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:42.940 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:42.940 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.940 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:42.940 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.940 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:42.940 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:05:42.940 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:42.940 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.940 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.941 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:42.941 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:05:42.941 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:42.941 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.941 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.941 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:42.941 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623920+0000", 2024-04-18T21:05:42.941 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2240000000000001e-06 2024-04-18T21:05:42.941 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.941 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.941 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:42.942 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623933+0000", 2024-04-18T21:05:42.942 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3653e-05 2024-04-18T21:05:42.942 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.942 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.942 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:42.942 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623956+0000", 2024-04-18T21:05:42.942 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2059e-05 2024-04-18T21:05:42.942 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.942 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.942 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.943 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623975+0000", 2024-04-18T21:05:42.943 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.9806999999999999e-05 2024-04-18T21:05:42.943 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.943 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.943 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:42.943 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626943+0000", 2024-04-18T21:05:42.943 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0029681579999999998 2024-04-18T21:05:42.943 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.943 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.943 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:42.943 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626993+0000", 2024-04-18T21:05:42.943 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.9935999999999998e-05 2024-04-18T21:05:42.943 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.944 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.944 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:42.944 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633665+0000", 2024-04-18T21:05:42.944 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0066719250000000004 2024-04-18T21:05:42.944 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.944 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.944 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:42.944 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633761+0000", 2024-04-18T21:05:42.944 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.5174999999999996e-05 2024-04-18T21:05:42.944 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:42.944 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:42.944 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:42.944 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.944 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.945 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:42.945 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:05:42.945 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 37.231418458999997, 2024-04-18T21:05:42.945 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0090159079999999996, 2024-04-18T21:05:42.945 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:42.945 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:42.945 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.945 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:42.945 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.945 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:42.945 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:05:42.945 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:42.945 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.946 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.946 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:42.946 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:05:42.946 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:42.946 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.946 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.946 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:42.946 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624751+0000", 2024-04-18T21:05:42.946 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.7600000000000006e-07 2024-04-18T21:05:42.946 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.946 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.946 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:42.947 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624787+0000", 2024-04-18T21:05:42.947 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.6273000000000003e-05 2024-04-18T21:05:42.947 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.947 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.947 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:42.947 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625837+0000", 2024-04-18T21:05:42.947 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00104992 2024-04-18T21:05:42.947 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.947 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.947 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.947 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625860+0000", 2024-04-18T21:05:42.947 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3110000000000001e-05 2024-04-18T21:05:42.947 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.948 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.948 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:42.948 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625984+0000", 2024-04-18T21:05:42.948 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012399199999999999 2024-04-18T21:05:42.948 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.948 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.948 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:42.948 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626030+0000", 2024-04-18T21:05:42.948 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.5429999999999997e-05 2024-04-18T21:05:42.948 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.948 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.948 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:42.949 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633643+0000", 2024-04-18T21:05:42.949 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0076129320000000002 2024-04-18T21:05:42.949 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.949 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.949 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:42.949 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633766+0000", 2024-04-18T21:05:42.949 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000123275 2024-04-18T21:05:42.949 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:42.949 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:42.949 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:42.949 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.950 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.950 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:42.950 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:05:42.950 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 37.230164735000002, 2024-04-18T21:05:42.950 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0088669170000000002, 2024-04-18T21:05:42.950 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:42.950 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:42.950 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.950 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:42.950 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.951 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:42.951 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:05:42.951 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:42.951 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.951 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.951 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:42.951 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:05:42.951 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:42.951 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.951 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.951 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:42.951 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626005+0000", 2024-04-18T21:05:42.951 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.5000000000000001e-07 2024-04-18T21:05:42.952 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.952 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.952 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:42.952 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626028+0000", 2024-04-18T21:05:42.952 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2756999999999999e-05 2024-04-18T21:05:42.952 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.952 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.952 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:42.952 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626050+0000", 2024-04-18T21:05:42.952 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2140000000000001e-05 2024-04-18T21:05:42.952 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.952 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.952 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.952 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626065+0000", 2024-04-18T21:05:42.953 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5176e-05 2024-04-18T21:05:42.953 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.953 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.953 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:42.953 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628334+0000", 2024-04-18T21:05:42.953 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0022691439999999998 2024-04-18T21:05:42.953 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.953 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.953 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:42.953 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628379+0000", 2024-04-18T21:05:42.953 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.5420000000000002e-05 2024-04-18T21:05:42.953 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.953 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.953 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:42.954 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634770+0000", 2024-04-18T21:05:42.954 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0063908410000000004 2024-04-18T21:05:42.954 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.954 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.954 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:42.954 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634871+0000", 2024-04-18T21:05:42.954 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000100589 2024-04-18T21:05:42.954 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:42.954 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:42.955 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:42.955 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.955 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.955 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:13 3.10 e17/15 3:0d89b25e:::603.00000000:head v 17'8, mlcod=0'0)", 2024-04-18T21:05:42.955 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:05:42.955 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 37.211331305999998, 2024-04-18T21:05:42.955 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0090974379999999994, 2024-04-18T21:05:42.955 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:42.955 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:42.955 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.955 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:42.955 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.955 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:42.956 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:05:42.956 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:42.956 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.956 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.956 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:42.956 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:05:42.956 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:42.956 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.956 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.956 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:42.956 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644838+0000", 2024-04-18T21:05:42.956 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.569999999999999e-07 2024-04-18T21:05:42.956 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.957 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.957 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:42.957 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644846+0000", 2024-04-18T21:05:42.957 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.4499999999999998e-06 2024-04-18T21:05:42.957 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.957 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.957 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:42.957 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644861+0000", 2024-04-18T21:05:42.957 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5243e-05 2024-04-18T21:05:42.957 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.957 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.958 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.958 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644997+0000", 2024-04-18T21:05:42.958 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000135609 2024-04-18T21:05:42.958 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.958 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.958 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:42.958 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649150+0000", 2024-04-18T21:05:42.958 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0041536760000000002 2024-04-18T21:05:42.958 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.958 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.958 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:42.958 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649207+0000", 2024-04-18T21:05:42.958 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.6677e-05 2024-04-18T21:05:42.959 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.959 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.959 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:42.959 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.653840+0000", 2024-04-18T21:05:42.959 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0046329700000000001 2024-04-18T21:05:42.959 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.959 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.959 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:42.959 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.653935+0000", 2024-04-18T21:05:42.959 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.4856000000000001e-05 2024-04-18T21:05:42.959 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:42.959 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:42.960 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:42.960 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.960 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.960 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 3 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:05:42.960 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:05:42.960 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 37.208542145999999, 2024-04-18T21:05:42.960 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0087842319999999995, 2024-04-18T21:05:42.960 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:42.960 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:42.960 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "reached pg", 2024-04-18T21:05:42.960 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:42.960 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.961 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:42.961 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:05:42.961 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:42.961 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.961 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.961 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:42.961 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:05:42.961 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:42.961 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.961 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.961 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:42.961 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:05:42.961 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.8299999999999996e-07 2024-04-18T21:05:42.962 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.962 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.962 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:42.962 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647642+0000", 2024-04-18T21:05:42.962 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4724e-05 2024-04-18T21:05:42.962 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.962 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.962 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:42.962 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647679+0000", 2024-04-18T21:05:42.962 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.6662999999999998e-05 2024-04-18T21:05:42.962 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.962 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.963 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.963 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647735+0000", 2024-04-18T21:05:42.963 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.6196000000000002e-05 2024-04-18T21:05:42.963 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.963 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.963 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:42.963 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649865+0000", 2024-04-18T21:05:42.963 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0021299489999999999 2024-04-18T21:05:42.963 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.963 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.963 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:42.963 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656411+0000", 2024-04-18T21:05:42.963 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0065460170000000003 2024-04-18T21:05:42.964 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:42.964 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:42.964 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:42.964 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.964 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.964 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:42.964 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:05:42.964 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 37.208396950000001, 2024-04-18T21:05:42.964 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0095703190000000007, 2024-04-18T21:05:42.964 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:42.964 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:42.964 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.964 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:42.965 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.965 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:42.965 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:05:42.965 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:42.965 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.965 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.965 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:42.965 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:05:42.965 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:42.965 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.965 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.965 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:42.965 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647773+0000", 2024-04-18T21:05:42.966 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.046e-06 2024-04-18T21:05:42.966 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.966 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.966 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:42.966 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647795+0000", 2024-04-18T21:05:42.966 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2616000000000002e-05 2024-04-18T21:05:42.966 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.966 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.966 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:42.966 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647818+0000", 2024-04-18T21:05:42.966 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3110000000000001e-05 2024-04-18T21:05:42.967 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.967 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.967 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.967 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647834+0000", 2024-04-18T21:05:42.967 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5163e-05 2024-04-18T21:05:42.967 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.967 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.967 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:42.967 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650682+0000", 2024-04-18T21:05:42.967 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0028479759999999999 2024-04-18T21:05:42.967 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.967 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.968 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:42.968 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650730+0000", 2024-04-18T21:05:42.968 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.8375999999999999e-05 2024-04-18T21:05:42.968 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.968 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.968 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:42.968 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656751+0000", 2024-04-18T21:05:42.968 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0060211880000000002 2024-04-18T21:05:42.968 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.968 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.968 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:42.968 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657342+0000", 2024-04-18T21:05:42.969 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00059084399999999998 2024-04-18T21:05:42.969 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:42.969 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:42.969 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:42.969 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.969 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.969 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:42.969 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:05:42.969 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 37.207984664000001, 2024-04-18T21:05:42.969 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0092471759999999993, 2024-04-18T21:05:42.969 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:42.969 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:42.969 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:42.970 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:42.970 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.970 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:42.970 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:05:42.970 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:42.970 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.970 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.970 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:42.970 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:05:42.970 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:42.970 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.970 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.971 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:42.971 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648185+0000", 2024-04-18T21:05:42.971 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.5000000000000001e-07 2024-04-18T21:05:42.971 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.971 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.971 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:42.971 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648203+0000", 2024-04-18T21:05:42.971 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.8102999999999999e-05 2024-04-18T21:05:42.971 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.971 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.971 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:42.971 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648226+0000", 2024-04-18T21:05:42.972 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2921999999999998e-05 2024-04-18T21:05:42.972 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.972 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.972 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:42.972 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648241+0000", 2024-04-18T21:05:42.972 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5336999999999999e-05 2024-04-18T21:05:42.972 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.972 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.972 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:42.972 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.651268+0000", 2024-04-18T21:05:42.972 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0030271640000000002 2024-04-18T21:05:42.973 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.973 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.973 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:42.973 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.651319+0000", 2024-04-18T21:05:42.973 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.0843000000000001e-05 2024-04-18T21:05:42.973 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.973 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.973 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:42.973 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657347+0000", 2024-04-18T21:05:42.973 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0060279770000000003 2024-04-18T21:05:42.973 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:42.973 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:42.974 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:42.974 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657431+0000", 2024-04-18T21:05:42.974 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.3980000000000006e-05 2024-04-18T21:05:42.974 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:42.974 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:42.974 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:42.974 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:42.974 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:42.974 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:05:42.976 INFO:teuthology.orchestra.run.smithi078.stderr:nodeep-scrub is unset 2024-04-18T21:05:42.977 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:05:42.977 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:42.975+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:43.076 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:43.075+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:43.106 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:05:43.106 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:05:43.107 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-04-18T21:05:43.107 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:05:43.121 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:05:43.176 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:43.175+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:43.239 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:05:43.239 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:05:43.239 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-18T21:05:43.239 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-18T21:05:43.239 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:05:43.253 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:05:43.278 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:43.279+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:43.378 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:43.379+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:43.425 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:05:43.425 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-18T21:05:43.426 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-18T21:05:43.426 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:05:43.426 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.426 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:43.426 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:05:43.426 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 37.809230047, 2024-04-18T21:05:43.426 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.034065303999999998, 2024-04-18T21:05:43.427 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:43.427 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:43.427 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:43.427 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:43.427 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.427 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:43.427 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:05:43.427 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:43.427 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.428 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.428 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:43.428 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:05:43.428 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:43.428 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.428 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.428 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:43.428 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615254+0000", 2024-04-18T21:05:43.428 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7829999999999999e-06 2024-04-18T21:05:43.428 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.428 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.428 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:43.428 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615267+0000", 2024-04-18T21:05:43.428 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3334e-05 2024-04-18T21:05:43.429 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.429 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.429 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:43.429 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615294+0000", 2024-04-18T21:05:43.429 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7271999999999999e-05 2024-04-18T21:05:43.429 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.429 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.429 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:43.429 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615321+0000", 2024-04-18T21:05:43.429 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.637e-05 2024-04-18T21:05:43.429 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.429 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.429 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:43.429 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615479+0000", 2024-04-18T21:05:43.430 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000158493 2024-04-18T21:05:43.430 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.430 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.430 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:43.430 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615498+0000", 2024-04-18T21:05:43.430 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9148999999999999e-05 2024-04-18T21:05:43.430 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.430 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.430 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:43.430 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632915+0000", 2024-04-18T21:05:43.430 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.017416551999999998 2024-04-18T21:05:43.431 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.431 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.431 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:43.431 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633302+0000", 2024-04-18T21:05:43.431 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00038725000000000001 2024-04-18T21:05:43.431 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.431 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.431 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:43.431 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633638+0000", 2024-04-18T21:05:43.431 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000335946 2024-04-18T21:05:43.431 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.431 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.431 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:43.432 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645976+0000", 2024-04-18T21:05:43.432 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012337617 2024-04-18T21:05:43.432 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.432 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.432 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:43.432 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649080+0000", 2024-04-18T21:05:43.432 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031038929999999999 2024-04-18T21:05:43.432 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.432 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.432 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:43.432 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649207+0000", 2024-04-18T21:05:43.433 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000127537 2024-04-18T21:05:43.433 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.433 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.433 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:43.433 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649316+0000", 2024-04-18T21:05:43.433 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109108 2024-04-18T21:05:43.433 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:43.433 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:43.433 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:43.433 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.433 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.433 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:43.433 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:05:43.433 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 37.809096670000002, 2024-04-18T21:05:43.433 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036275764000000002, 2024-04-18T21:05:43.434 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:43.434 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:43.434 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:43.434 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:43.434 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.434 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:43.434 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:05:43.434 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:43.434 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.434 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.434 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:43.435 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:05:43.435 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:43.435 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.435 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.435 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:43.435 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615386+0000", 2024-04-18T21:05:43.435 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.573e-06 2024-04-18T21:05:43.435 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.435 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.435 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:43.435 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:05:43.435 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0723999999999999e-05 2024-04-18T21:05:43.435 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.435 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.436 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:43.436 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615418+0000", 2024-04-18T21:05:43.436 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0902000000000001e-05 2024-04-18T21:05:43.436 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.436 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.436 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:43.436 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615433+0000", 2024-04-18T21:05:43.436 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5319999999999999e-05 2024-04-18T21:05:43.436 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.436 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.436 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:43.436 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615659+0000", 2024-04-18T21:05:43.436 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000226095 2024-04-18T21:05:43.436 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.437 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.437 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:43.437 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:43.437 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1276e-05 2024-04-18T21:05:43.437 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.437 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.437 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:43.437 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643654+0000", 2024-04-18T21:05:43.437 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027983238000000001 2024-04-18T21:05:43.437 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.437 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.437 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:43.437 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643868+0000", 2024-04-18T21:05:43.437 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000214305 2024-04-18T21:05:43.437 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.438 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.438 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:43.438 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:05:43.438 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035892200000000002 2024-04-18T21:05:43.438 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.438 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.438 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:43.438 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646056+0000", 2024-04-18T21:05:43.438 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001829172 2024-04-18T21:05:43.438 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.438 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.439 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:43.439 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651406+0000", 2024-04-18T21:05:43.439 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0053504800000000003 2024-04-18T21:05:43.439 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.439 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.439 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:43.439 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651551+0000", 2024-04-18T21:05:43.439 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014427999999999999 2024-04-18T21:05:43.439 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.439 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.439 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:43.439 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651660+0000", 2024-04-18T21:05:43.440 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109477 2024-04-18T21:05:43.440 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:43.440 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:43.440 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:43.440 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.440 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.440 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:43.440 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:05:43.440 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 37.809023287999999, 2024-04-18T21:05:43.440 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045668994999999997, 2024-04-18T21:05:43.440 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:43.440 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:43.440 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:43.440 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:43.440 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.441 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:43.441 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:05:43.441 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:43.441 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.441 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.441 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:43.441 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:05:43.441 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:43.441 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.441 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.441 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:43.441 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615459+0000", 2024-04-18T21:05:43.441 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5030000000000001e-06 2024-04-18T21:05:43.441 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.442 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.442 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:43.442 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615506+0000", 2024-04-18T21:05:43.442 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6872000000000001e-05 2024-04-18T21:05:43.442 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.442 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.442 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:43.442 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615527+0000", 2024-04-18T21:05:43.442 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0763000000000001e-05 2024-04-18T21:05:43.442 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.442 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.442 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:43.443 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615551+0000", 2024-04-18T21:05:43.443 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4159e-05 2024-04-18T21:05:43.443 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.443 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.443 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:43.443 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615736+0000", 2024-04-18T21:05:43.443 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018499599999999999 2024-04-18T21:05:43.443 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.443 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.443 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:43.443 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615748+0000", 2024-04-18T21:05:43.443 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2272999999999999e-05 2024-04-18T21:05:43.443 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.443 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.444 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:43.444 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635481+0000", 2024-04-18T21:05:43.444 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019732772999999999 2024-04-18T21:05:43.444 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.444 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.444 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:43.444 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635791+0000", 2024-04-18T21:05:43.444 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031013299999999998 2024-04-18T21:05:43.444 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.444 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.444 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:43.444 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636101+0000", 2024-04-18T21:05:43.445 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030943300000000002 2024-04-18T21:05:43.445 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.445 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.445 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:43.445 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646043+0000", 2024-04-18T21:05:43.445 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099428139999999995 2024-04-18T21:05:43.445 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.445 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.445 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:43.445 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660991+0000", 2024-04-18T21:05:43.445 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014947142 2024-04-18T21:05:43.445 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.445 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.445 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:43.446 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661061+0000", 2024-04-18T21:05:43.446 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0438000000000006e-05 2024-04-18T21:05:43.446 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.446 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.446 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:43.446 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661127+0000", 2024-04-18T21:05:43.446 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5696000000000003e-05 2024-04-18T21:05:43.446 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:43.446 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:43.446 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:43.446 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.446 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.446 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:43.447 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:43.447 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 37.808810860000001, 2024-04-18T21:05:43.447 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045745085999999997, 2024-04-18T21:05:43.447 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:43.447 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:43.447 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:43.447 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:43.447 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.447 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:43.447 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:43.447 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:43.447 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.447 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.447 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:43.447 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:43.448 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:43.448 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.448 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.448 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:43.448 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:05:43.448 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7400000000000001e-06 2024-04-18T21:05:43.448 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.448 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.448 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:43.448 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:05:43.448 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8133e-05 2024-04-18T21:05:43.448 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.448 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.448 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:43.448 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615726+0000", 2024-04-18T21:05:43.449 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6132e-05 2024-04-18T21:05:43.449 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.449 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.449 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:43.449 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615742+0000", 2024-04-18T21:05:43.449 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6157000000000001e-05 2024-04-18T21:05:43.449 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.449 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.449 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:43.449 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615937+0000", 2024-04-18T21:05:43.449 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000194768 2024-04-18T21:05:43.449 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.449 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.450 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:43.450 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615950+0000", 2024-04-18T21:05:43.450 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3084e-05 2024-04-18T21:05:43.450 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.450 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.450 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:43.450 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643676+0000", 2024-04-18T21:05:43.450 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027725639999999999 2024-04-18T21:05:43.450 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.450 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.451 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:43.451 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643867+0000", 2024-04-18T21:05:43.451 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019075900000000001 2024-04-18T21:05:43.451 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.451 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.451 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:43.451 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:05:43.451 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036013799999999997 2024-04-18T21:05:43.451 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.451 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.451 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:43.451 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646068+0000", 2024-04-18T21:05:43.451 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001841536 2024-04-18T21:05:43.451 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.451 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.451 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:43.452 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661184+0000", 2024-04-18T21:05:43.452 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015115458999999999 2024-04-18T21:05:43.452 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.452 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.452 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:43.452 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661283+0000", 2024-04-18T21:05:43.452 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9502999999999999e-05 2024-04-18T21:05:43.452 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.452 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.452 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:43.452 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661415+0000", 2024-04-18T21:05:43.452 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000132037 2024-04-18T21:05:43.452 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:43.452 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:43.452 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:43.452 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.453 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.453 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:43.453 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:05:43.453 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 37.808689172999998, 2024-04-18T21:05:43.453 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036185947000000003, 2024-04-18T21:05:43.453 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:43.453 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:43.453 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:43.453 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:43.453 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.453 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:43.453 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:05:43.453 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:43.453 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.453 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.454 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:43.454 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:05:43.454 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:43.454 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.454 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.454 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:43.454 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615794+0000", 2024-04-18T21:05:43.454 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6440000000000001e-06 2024-04-18T21:05:43.454 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.454 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.454 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:43.454 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615803+0000", 2024-04-18T21:05:43.454 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1220000000000001e-06 2024-04-18T21:05:43.455 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.455 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.455 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:43.455 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615827+0000", 2024-04-18T21:05:43.455 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3997000000000001e-05 2024-04-18T21:05:43.455 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.455 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.455 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:43.455 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615899+0000", 2024-04-18T21:05:43.455 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2741e-05 2024-04-18T21:05:43.455 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.455 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.455 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:43.456 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616019+0000", 2024-04-18T21:05:43.456 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119874 2024-04-18T21:05:43.456 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.456 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.456 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:43.456 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616029+0000", 2024-04-18T21:05:43.456 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:05:43.456 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.456 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.456 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:43.456 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644823+0000", 2024-04-18T21:05:43.456 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.028793151999999999 2024-04-18T21:05:43.456 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.456 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.457 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:43.457 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645106+0000", 2024-04-18T21:05:43.457 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028379700000000002 2024-04-18T21:05:43.457 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.457 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.457 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:43.457 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645294+0000", 2024-04-18T21:05:43.457 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000187181 2024-04-18T21:05:43.457 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.457 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.457 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:43.457 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646763+0000", 2024-04-18T21:05:43.457 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0014691050000000001 2024-04-18T21:05:43.458 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.458 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.458 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:43.458 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651784+0000", 2024-04-18T21:05:43.458 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050211650000000002 2024-04-18T21:05:43.458 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.458 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.458 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:43.458 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651876+0000", 2024-04-18T21:05:43.458 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2503999999999994e-05 2024-04-18T21:05:43.458 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.458 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.459 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:43.459 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651978+0000", 2024-04-18T21:05:43.459 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000101475 2024-04-18T21:05:43.459 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:43.459 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:43.459 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:43.459 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.459 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.459 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:43.459 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:43.459 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 37.808540565999998, 2024-04-18T21:05:43.459 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032262322000000003, 2024-04-18T21:05:43.459 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:43.459 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:43.460 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:43.460 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:43.460 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.460 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:43.460 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:43.460 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:43.460 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.460 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.460 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:43.460 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:43.460 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:43.460 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.461 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.461 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:43.461 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615943+0000", 2024-04-18T21:05:43.461 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1959999999999998e-06 2024-04-18T21:05:43.461 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.461 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.461 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:43.461 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615956+0000", 2024-04-18T21:05:43.461 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3424000000000001e-05 2024-04-18T21:05:43.461 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.461 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.461 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:43.461 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615983+0000", 2024-04-18T21:05:43.462 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7072000000000001e-05 2024-04-18T21:05:43.462 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.462 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.462 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:43.462 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616006+0000", 2024-04-18T21:05:43.462 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2823000000000002e-05 2024-04-18T21:05:43.462 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.462 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.462 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:43.462 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616156+0000", 2024-04-18T21:05:43.462 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014962299999999999 2024-04-18T21:05:43.462 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.462 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.463 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:43.463 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616174+0000", 2024-04-18T21:05:43.463 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8082999999999999e-05 2024-04-18T21:05:43.463 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.463 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.463 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:43.463 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.629952+0000", 2024-04-18T21:05:43.463 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013778514 2024-04-18T21:05:43.463 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.463 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.463 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:43.463 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630201+0000", 2024-04-18T21:05:43.463 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024918100000000001 2024-04-18T21:05:43.463 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.463 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.464 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:43.464 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630386+0000", 2024-04-18T21:05:43.464 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018436900000000001 2024-04-18T21:05:43.464 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.464 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.464 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:43.464 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643169+0000", 2024-04-18T21:05:43.464 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012782774 2024-04-18T21:05:43.464 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.464 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.464 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:43.464 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.647924+0000", 2024-04-18T21:05:43.464 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004755787 2024-04-18T21:05:43.464 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.464 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.464 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:43.465 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648069+0000", 2024-04-18T21:05:43.465 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014459600000000001 2024-04-18T21:05:43.465 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.465 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.465 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:43.465 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648203+0000", 2024-04-18T21:05:43.465 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013388000000000001 2024-04-18T21:05:43.465 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:43.465 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:43.465 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:43.465 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.465 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.465 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:43.466 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:05:43.466 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 37.808432302, 2024-04-18T21:05:43.466 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032489736999999998, 2024-04-18T21:05:43.466 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:43.466 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:43.466 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:43.466 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:43.466 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.466 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:43.466 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:05:43.466 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:43.466 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.466 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.466 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:43.466 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:05:43.466 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:43.467 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.467 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.467 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:43.467 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616050+0000", 2024-04-18T21:05:43.467 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.606e-06 2024-04-18T21:05:43.467 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.467 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.467 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:43.467 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616061+0000", 2024-04-18T21:05:43.467 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0463e-05 2024-04-18T21:05:43.467 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.467 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.467 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:43.467 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616092+0000", 2024-04-18T21:05:43.468 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1415999999999999e-05 2024-04-18T21:05:43.468 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.468 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.468 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:43.468 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616109+0000", 2024-04-18T21:05:43.468 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6557000000000001e-05 2024-04-18T21:05:43.468 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.468 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.468 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:43.468 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616358+0000", 2024-04-18T21:05:43.468 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000249077 2024-04-18T21:05:43.468 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.468 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.468 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:43.469 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616370+0000", 2024-04-18T21:05:43.469 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2037e-05 2024-04-18T21:05:43.469 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.469 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.469 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:43.469 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.634920+0000", 2024-04-18T21:05:43.469 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018550397 2024-04-18T21:05:43.469 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.469 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.469 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:43.469 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640420+0000", 2024-04-18T21:05:43.469 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055000539999999999 2024-04-18T21:05:43.469 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.469 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.469 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:43.469 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648538+0000", 2024-04-18T21:05:43.470 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0081181299999999994 2024-04-18T21:05:43.470 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:43.470 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:43.470 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:43.470 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.470 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.470 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:43.470 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:05:43.470 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 37.808347980999997, 2024-04-18T21:05:43.470 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036090029000000003, 2024-04-18T21:05:43.470 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:43.470 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:43.470 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:43.470 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:43.471 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.471 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:43.471 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:05:43.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:43.471 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.471 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.471 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:43.471 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:05:43.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:43.471 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.471 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.471 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:43.471 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616134+0000", 2024-04-18T21:05:43.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.353e-06 2024-04-18T21:05:43.472 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.472 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.472 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:43.472 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616141+0000", 2024-04-18T21:05:43.472 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2770000000000002e-06 2024-04-18T21:05:43.472 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.472 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.472 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:43.472 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616160+0000", 2024-04-18T21:05:43.472 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.91e-05 2024-04-18T21:05:43.472 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.472 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.472 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:43.472 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616170+0000", 2024-04-18T21:05:43.472 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7699999999999996e-06 2024-04-18T21:05:43.473 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.473 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:43.473 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616275+0000", 2024-04-18T21:05:43.473 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105313 2024-04-18T21:05:43.473 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.473 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:43.473 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616288+0000", 2024-04-18T21:05:43.473 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3027000000000001e-05 2024-04-18T21:05:43.473 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.473 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:43.473 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646160+0000", 2024-04-18T21:05:43.473 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.029872019 2024-04-18T21:05:43.473 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.474 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.474 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:43.474 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646368+0000", 2024-04-18T21:05:43.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020811899999999999 2024-04-18T21:05:43.474 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.474 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.474 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:43.474 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652223+0000", 2024-04-18T21:05:43.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.005855051 2024-04-18T21:05:43.474 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:43.474 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:43.474 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:43.474 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.475 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:43.475 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:05:43.475 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 37.808290411999998, 2024-04-18T21:05:43.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043572403000000003, 2024-04-18T21:05:43.475 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:43.475 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:43.475 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:43.475 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:43.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.475 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:43.475 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:05:43.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:43.475 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:43.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:05:43.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:43.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:43.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616192+0000", 2024-04-18T21:05:43.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:05:43.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:43.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616203+0000", 2024-04-18T21:05:43.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0890000000000001e-05 2024-04-18T21:05:43.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.477 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.477 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:43.477 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616223+0000", 2024-04-18T21:05:43.477 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0409000000000001e-05 2024-04-18T21:05:43.477 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.477 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.477 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:43.477 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616238+0000", 2024-04-18T21:05:43.477 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5160000000000001e-05 2024-04-18T21:05:43.477 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.477 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.477 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:43.477 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616343+0000", 2024-04-18T21:05:43.478 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000104831 2024-04-18T21:05:43.478 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.478 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.478 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:43.478 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616357+0000", 2024-04-18T21:05:43.478 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3686000000000001e-05 2024-04-18T21:05:43.478 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.478 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.478 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:43.478 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635912+0000", 2024-04-18T21:05:43.478 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019554944000000001 2024-04-18T21:05:43.478 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.478 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.479 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:43.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636231+0000", 2024-04-18T21:05:43.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000318766 2024-04-18T21:05:43.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.479 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.479 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:43.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659763+0000", 2024-04-18T21:05:43.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023532474000000001 2024-04-18T21:05:43.479 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:43.479 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:43.479 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:43.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.479 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.480 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:43.480 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:05:43.480 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 37.804361704999998, 2024-04-18T21:05:43.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015007971, 2024-04-18T21:05:43.480 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:43.480 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:43.480 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:43.480 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:43.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:43.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:05:43.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:43.480 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:43.481 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:05:43.481 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:43.481 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:43.481 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620120+0000", 2024-04-18T21:05:43.481 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0359999999999999e-06 2024-04-18T21:05:43.481 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:43.482 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620157+0000", 2024-04-18T21:05:43.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6636e-05 2024-04-18T21:05:43.482 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.482 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.482 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:43.482 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620177+0000", 2024-04-18T21:05:43.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0247000000000001e-05 2024-04-18T21:05:43.482 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.482 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.482 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:43.482 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620195+0000", 2024-04-18T21:05:43.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7819e-05 2024-04-18T21:05:43.482 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.482 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.483 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:43.483 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620342+0000", 2024-04-18T21:05:43.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014643300000000001 2024-04-18T21:05:43.483 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.483 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.483 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:43.483 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620405+0000", 2024-04-18T21:05:43.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3522000000000006e-05 2024-04-18T21:05:43.483 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.483 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.483 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:43.483 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635016+0000", 2024-04-18T21:05:43.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014610840999999999 2024-04-18T21:05:43.484 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:43.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635127+0000", 2024-04-18T21:05:43.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111437 2024-04-18T21:05:43.484 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:43.484 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:43.484 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:43.484 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.484 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:43.484 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:05:43.484 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 37.804254436999997, 2024-04-18T21:05:43.485 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012693296, 2024-04-18T21:05:43.485 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:43.485 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:43.485 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:43.485 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:43.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:43.485 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:05:43.485 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:43.485 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:43.485 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:05:43.485 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:43.486 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.486 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.486 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:43.486 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620228+0000", 2024-04-18T21:05:43.486 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:05:43.486 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.486 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.486 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:43.486 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620236+0000", 2024-04-18T21:05:43.486 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.303e-06 2024-04-18T21:05:43.486 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.486 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.486 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:43.486 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620255+0000", 2024-04-18T21:05:43.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9406e-05 2024-04-18T21:05:43.487 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.487 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.487 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:43.487 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620274+0000", 2024-04-18T21:05:43.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8940000000000002e-05 2024-04-18T21:05:43.487 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.487 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.487 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:43.487 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:05:43.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001558753 2024-04-18T21:05:43.487 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.487 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.487 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:43.487 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621879+0000", 2024-04-18T21:05:43.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6359000000000001e-05 2024-04-18T21:05:43.488 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.488 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:43.488 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632841+0000", 2024-04-18T21:05:43.488 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010961907 2024-04-18T21:05:43.488 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.488 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:43.488 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632920+0000", 2024-04-18T21:05:43.488 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8714999999999994e-05 2024-04-18T21:05:43.488 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:43.488 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:43.488 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:43.488 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.489 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:43.489 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:05:43.489 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 37.802708674000002, 2024-04-18T21:05:43.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013445702, 2024-04-18T21:05:43.489 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:43.489 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:43.489 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:43.489 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:43.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.489 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:43.489 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:05:43.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:43.489 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.490 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:43.490 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:05:43.490 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:43.490 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.490 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:43.490 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621774+0000", 2024-04-18T21:05:43.490 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2500000000000001e-06 2024-04-18T21:05:43.490 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.490 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:43.490 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621786+0000", 2024-04-18T21:05:43.490 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2636000000000001e-05 2024-04-18T21:05:43.490 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.491 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:43.491 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621814+0000", 2024-04-18T21:05:43.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7823000000000001e-05 2024-04-18T21:05:43.491 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.491 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.491 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:43.491 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621844+0000", 2024-04-18T21:05:43.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9589000000000001e-05 2024-04-18T21:05:43.491 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.491 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.491 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:43.491 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622253+0000", 2024-04-18T21:05:43.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040963700000000002 2024-04-18T21:05:43.491 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:43.492 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622304+0000", 2024-04-18T21:05:43.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0868999999999997e-05 2024-04-18T21:05:43.492 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:43.492 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635133+0000", 2024-04-18T21:05:43.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012829136 2024-04-18T21:05:43.492 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:43.492 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635218+0000", 2024-04-18T21:05:43.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4761999999999999e-05 2024-04-18T21:05:43.492 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:43.492 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:43.493 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:43.493 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.493 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.493 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:43.493 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:05:43.493 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 37.802581914000001, 2024-04-18T21:05:43.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014162065, 2024-04-18T21:05:43.493 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:43.493 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:43.493 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:43.493 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:43.493 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.493 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:43.493 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:05:43.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:43.493 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.494 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.494 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:43.494 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:05:43.494 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:43.494 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.494 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.494 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:43.494 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621900+0000", 2024-04-18T21:05:43.494 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:05:43.494 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.494 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.494 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:43.494 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621910+0000", 2024-04-18T21:05:43.494 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0207000000000001e-05 2024-04-18T21:05:43.495 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.495 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:43.495 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621932+0000", 2024-04-18T21:05:43.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1789000000000001e-05 2024-04-18T21:05:43.495 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.495 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:43.495 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621946+0000", 2024-04-18T21:05:43.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4212999999999999e-05 2024-04-18T21:05:43.495 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.495 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:43.495 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624477+0000", 2024-04-18T21:05:43.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025303470000000001 2024-04-18T21:05:43.495 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:43.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624525+0000", 2024-04-18T21:05:43.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8084999999999998e-05 2024-04-18T21:05:43.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:43.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635976+0000", 2024-04-18T21:05:43.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.011451368999999999 2024-04-18T21:05:43.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:43.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636061+0000", 2024-04-18T21:05:43.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5094999999999998e-05 2024-04-18T21:05:43.497 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:43.497 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:43.497 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:43.497 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.497 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:05:43.497 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:05:43.497 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 37.793346288999999, 2024-04-18T21:05:43.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0098014739999999993, 2024-04-18T21:05:43.497 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:43.497 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:43.497 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:05:43.497 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:43.498 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.498 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:43.498 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:05:43.498 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:43.498 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.498 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.498 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:43.498 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:05:43.498 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:43.498 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.498 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.498 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:43.498 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631136+0000", 2024-04-18T21:05:43.498 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0139999999999999e-06 2024-04-18T21:05:43.498 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:43.499 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631152+0000", 2024-04-18T21:05:43.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6365999999999999e-05 2024-04-18T21:05:43.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:43.499 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631961+0000", 2024-04-18T21:05:43.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00080873100000000003 2024-04-18T21:05:43.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:43.499 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632021+0000", 2024-04-18T21:05:43.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0541999999999997e-05 2024-04-18T21:05:43.500 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.500 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:43.500 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633539+0000", 2024-04-18T21:05:43.500 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015175639999999999 2024-04-18T21:05:43.500 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.500 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:43.500 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640936+0000", 2024-04-18T21:05:43.500 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007397257 2024-04-18T21:05:43.500 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:43.500 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:43.500 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:43.500 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.501 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-18T21:05:43.501 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:05:43.501 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 37.775884855999998, 2024-04-18T21:05:43.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00073592199999999997, 2024-04-18T21:05:43.501 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:43.501 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:43.501 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:43.501 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:43.501 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.501 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:43.501 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:05:43.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:43.501 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.501 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.502 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:43.502 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:05:43.502 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:43.502 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.502 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.502 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:43.502 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648597+0000", 2024-04-18T21:05:43.502 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:05:43.502 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.502 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.502 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:43.502 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648605+0000", 2024-04-18T21:05:43.502 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3960000000000006e-06 2024-04-18T21:05:43.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:43.503 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648625+0000", 2024-04-18T21:05:43.503 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9987e-05 2024-04-18T21:05:43.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:43.503 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648643+0000", 2024-04-18T21:05:43.503 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7079e-05 2024-04-18T21:05:43.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:43.504 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649043+0000", 2024-04-18T21:05:43.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040083399999999998 2024-04-18T21:05:43.504 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.504 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:43.504 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649062+0000", 2024-04-18T21:05:43.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9052999999999999e-05 2024-04-18T21:05:43.504 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.504 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:43.504 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649332+0000", 2024-04-18T21:05:43.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026971999999999999 2024-04-18T21:05:43.504 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:43.505 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:43.505 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:43.505 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.505 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.505 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:05:43.505 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:05:43.505 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 37.773109955000002, 2024-04-18T21:05:43.505 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00086123999999999999, 2024-04-18T21:05:43.505 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:43.505 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:43.505 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:05:43.505 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:43.505 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.505 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:43.505 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:05:43.506 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:43.506 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.506 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.506 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:43.506 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:05:43.506 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:43.506 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.506 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.506 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:43.506 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651372+0000", 2024-04-18T21:05:43.506 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7599999999999997e-07 2024-04-18T21:05:43.506 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.506 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.507 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:43.507 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651377+0000", 2024-04-18T21:05:43.507 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.22e-06 2024-04-18T21:05:43.507 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.507 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.507 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:43.507 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651394+0000", 2024-04-18T21:05:43.507 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6646999999999998e-05 2024-04-18T21:05:43.507 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.507 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.507 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:43.507 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651427+0000", 2024-04-18T21:05:43.507 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3682e-05 2024-04-18T21:05:43.507 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.507 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.507 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:43.508 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652029+0000", 2024-04-18T21:05:43.508 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00060152199999999995 2024-04-18T21:05:43.508 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.508 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.508 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:43.508 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652232+0000", 2024-04-18T21:05:43.508 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020359299999999999 2024-04-18T21:05:43.508 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:43.508 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:43.508 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:43.508 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.508 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.508 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:05:43.509 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:05:43.509 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 37.765082993, 2024-04-18T21:05:43.509 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0017426200000000001, 2024-04-18T21:05:43.509 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:43.509 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:43.509 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:43.509 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:43.509 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.509 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:43.509 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:05:43.510 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:43.510 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.510 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.510 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:43.510 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:05:43.510 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:43.510 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.510 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.510 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:43.510 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659399+0000", 2024-04-18T21:05:43.510 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6000000000000002e-07 2024-04-18T21:05:43.511 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.511 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.511 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:43.511 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659405+0000", 2024-04-18T21:05:43.511 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5069999999999997e-06 2024-04-18T21:05:43.511 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.511 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.511 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:43.511 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659425+0000", 2024-04-18T21:05:43.511 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.927e-05 2024-04-18T21:05:43.511 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.511 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.511 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:43.511 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659443+0000", 2024-04-18T21:05:43.512 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8051999999999999e-05 2024-04-18T21:05:43.512 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.512 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.512 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:43.512 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660973+0000", 2024-04-18T21:05:43.512 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001530106 2024-04-18T21:05:43.512 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.512 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.512 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:43.512 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660983+0000", 2024-04-18T21:05:43.512 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0516999999999999e-05 2024-04-18T21:05:43.512 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.512 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.513 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:43.513 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661141+0000", 2024-04-18T21:05:43.513 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015730799999999999 2024-04-18T21:05:43.513 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:43.513 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:43.513 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:43.513 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.513 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.513 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:05:43.513 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:05:43.513 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 37.764866368, 2024-04-18T21:05:43.513 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001812311, 2024-04-18T21:05:43.513 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:43.514 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:43.514 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:43.514 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:43.514 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.514 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:43.514 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:05:43.514 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:43.514 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.514 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.514 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:43.514 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:05:43.514 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:43.514 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.515 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.515 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:43.515 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659616+0000", 2024-04-18T21:05:43.515 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.277e-06 2024-04-18T21:05:43.515 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.515 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.515 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:43.515 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659625+0000", 2024-04-18T21:05:43.515 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5359999999999998e-06 2024-04-18T21:05:43.515 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.515 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.515 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:43.515 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659647+0000", 2024-04-18T21:05:43.515 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1857000000000001e-05 2024-04-18T21:05:43.516 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.516 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.516 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:43.516 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659664+0000", 2024-04-18T21:05:43.516 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6405999999999998e-05 2024-04-18T21:05:43.516 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.516 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.516 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:43.516 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661169+0000", 2024-04-18T21:05:43.516 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015054179999999999 2024-04-18T21:05:43.516 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.516 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.516 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:43.516 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661177+0000", 2024-04-18T21:05:43.517 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9680000000000006e-06 2024-04-18T21:05:43.517 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.517 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.517 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:43.517 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661427+0000", 2024-04-18T21:05:43.517 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024984900000000001 2024-04-18T21:05:43.517 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:43.517 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:43.517 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:43.517 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.517 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.517 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-18T21:05:43.517 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:05:43.517 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 35.81194576, 2024-04-18T21:05:43.518 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0030975030000000001, 2024-04-18T21:05:43.518 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:43.518 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:43.518 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:43.518 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:43.518 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.518 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:43.518 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:05:43.518 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:43.518 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.518 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.518 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:43.518 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:05:43.519 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:43.519 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.519 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.519 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:43.519 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612538+0000", 2024-04-18T21:05:43.519 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6259999999999999e-06 2024-04-18T21:05:43.519 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.519 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.519 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:43.519 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612552+0000", 2024-04-18T21:05:43.519 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4073999999999999e-05 2024-04-18T21:05:43.519 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.519 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.519 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:43.520 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612585+0000", 2024-04-18T21:05:43.520 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3504999999999999e-05 2024-04-18T21:05:43.520 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.520 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.520 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:43.520 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612601+0000", 2024-04-18T21:05:43.520 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5194000000000001e-05 2024-04-18T21:05:43.520 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.520 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.520 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:43.520 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612746+0000", 2024-04-18T21:05:43.520 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145666 2024-04-18T21:05:43.520 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.520 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.521 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:43.521 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612953+0000", 2024-04-18T21:05:43.521 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000207109 2024-04-18T21:05:43.521 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.521 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.521 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:43.521 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.613134+0000", 2024-04-18T21:05:43.521 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018041300000000001 2024-04-18T21:05:43.521 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.521 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.521 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:43.521 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.614411+0000", 2024-04-18T21:05:43.521 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0012769929999999999 2024-04-18T21:05:43.522 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.522 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.522 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:43.522 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615441+0000", 2024-04-18T21:05:43.522 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001029917 2024-04-18T21:05:43.522 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.522 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.522 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:43.522 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615522+0000", 2024-04-18T21:05:43.522 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1142000000000003e-05 2024-04-18T21:05:43.522 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.522 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.522 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:43.523 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615633+0000", 2024-04-18T21:05:43.523 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000110864 2024-04-18T21:05:43.523 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:43.523 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:43.523 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:43.523 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.523 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.523 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-18T21:05:43.523 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:05:43.523 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 17.809659949, 2024-04-18T21:05:43.523 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088979039999999999, 2024-04-18T21:05:43.523 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:43.523 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:43.523 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:43.524 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:43.524 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.524 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:43.524 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:05:43.524 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:43.524 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.524 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.524 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:43.524 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:05:43.524 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:43.524 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.524 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.524 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:43.524 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614825+0000", 2024-04-18T21:05:43.525 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4829999999999999e-06 2024-04-18T21:05:43.525 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.525 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.525 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:43.525 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614843+0000", 2024-04-18T21:05:43.525 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8777e-05 2024-04-18T21:05:43.525 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.525 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.525 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:43.525 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614884+0000", 2024-04-18T21:05:43.525 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1051999999999999e-05 2024-04-18T21:05:43.525 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.525 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.526 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:43.526 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614903+0000", 2024-04-18T21:05:43.526 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9069999999999999e-05 2024-04-18T21:05:43.526 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.526 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.526 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:43.526 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615047+0000", 2024-04-18T21:05:43.526 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014374400000000001 2024-04-18T21:05:43.526 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.526 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.526 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:43.527 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615061+0000", 2024-04-18T21:05:43.527 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4063000000000001e-05 2024-04-18T21:05:43.527 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.527 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.527 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:43.527 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621064+0000", 2024-04-18T21:05:43.527 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0060029200000000001 2024-04-18T21:05:43.527 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.527 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.527 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:43.527 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621211+0000", 2024-04-18T21:05:43.527 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000147224 2024-04-18T21:05:43.527 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.528 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.528 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:43.528 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621396+0000", 2024-04-18T21:05:43.528 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018454699999999999 2024-04-18T21:05:43.528 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.528 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.528 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:43.528 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.622517+0000", 2024-04-18T21:05:43.528 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001121424 2024-04-18T21:05:43.528 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.528 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.528 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:43.528 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623571+0000", 2024-04-18T21:05:43.528 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010538660000000001 2024-04-18T21:05:43.529 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.529 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.529 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:43.529 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623658+0000", 2024-04-18T21:05:43.529 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6439000000000004e-05 2024-04-18T21:05:43.529 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:43.529 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:43.529 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:43.529 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623719+0000", 2024-04-18T21:05:43.529 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1295000000000002e-05 2024-04-18T21:05:43.529 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:43.529 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:43.529 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:43.530 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:43.530 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:43.530 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:05:43.530 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:05:43.532 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:43.531+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:43.532 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:05:43.632 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:43.631+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:43.663 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:05:43.663 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:05:43.663 INFO:teuthology.orchestra.run.smithi132.stdout: "num_ops": 0 2024-04-18T21:05:43.663 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:05:43.677 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:05:43.685 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:05:43.685 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:05:43.706 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1: {} 2024-04-18T21:05:43.706 INFO:teuthology.orchestra.run.smithi078.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:05:43.728 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:05:43.728 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:05:43.733 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:43.731+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:43.798 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:43.798 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:43.812 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:05:43.859 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:43.859+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:43.934 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:43.934 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:43.935 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:43.935+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:43.948 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:05:44.035 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:44.035+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:44.078 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:44.078 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:44.093 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:05:44.138 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:44.139+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:44.239 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:44.239+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:44.256 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:44.257 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:44.271 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:05:44.342 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:44.343+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:44.436 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:44.436 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:44.443 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:44.443+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:44.451 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:05:44.544 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:44.543+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:44.584 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:44.584 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:44.599 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:05:44.645 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:44.643+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:44.746 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:44.747+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:44.761 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:44.762 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:44.775 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:05:44.847 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:44.847+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:44.896 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:44.897 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:44.911 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:05:44.948 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:44.947+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:44.977 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-18T21:05:45.040 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:45.041 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:45.049 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:45.051+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:45.054 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:05:45.150 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:45.151+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:45.173 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:45.173 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:45.187 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:05:45.251 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:45.251+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:45.303 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:45.303 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:45.318 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:05:45.352 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:45.351+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:45.452 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:45.452 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:45.453 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:45.455+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:45.467 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:05:45.553 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:45.555+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:45.589 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:45.589 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:45.604 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:05:45.653 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:45.655+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:45.731 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:45.731 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:45.745 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:05:45.747 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:05:45.793 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:45.795+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:45.855 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:45.855+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:45.875 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:45.876 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:45.883 INFO:teuthology.orchestra.run.smithi078.stderr:noscrub is set 2024-04-18T21:05:45.889 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:05:45.908 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:05:45.908 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:05:45.929 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1: {} 2024-04-18T21:05:45.929 INFO:teuthology.orchestra.run.smithi078.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:05:45.950 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:05:45.950 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:05:45.982 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:45.983+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:46.054 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:05:46.054 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:05:46.054 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-18T21:05:46.054 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-18T21:05:46.054 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:05:46.056 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:46.055+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:46.068 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:05:46.157 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:46.159+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:46.236 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:05:46.237 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-18T21:05:46.237 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-18T21:05:46.237 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:05:46.237 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.237 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:46.237 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:05:46.237 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 40.620925362999998, 2024-04-18T21:05:46.237 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.034065303999999998, 2024-04-18T21:05:46.237 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:46.237 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:46.237 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:46.237 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:46.237 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.237 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:46.238 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:05:46.238 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:46.238 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.238 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.238 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:46.238 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:05:46.238 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:46.238 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.238 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.238 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:46.238 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615254+0000", 2024-04-18T21:05:46.238 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7829999999999999e-06 2024-04-18T21:05:46.238 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.239 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.239 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:46.239 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615267+0000", 2024-04-18T21:05:46.239 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3334e-05 2024-04-18T21:05:46.239 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.239 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.239 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:46.239 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615294+0000", 2024-04-18T21:05:46.239 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7271999999999999e-05 2024-04-18T21:05:46.239 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.239 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.239 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.239 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615321+0000", 2024-04-18T21:05:46.239 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.637e-05 2024-04-18T21:05:46.240 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.240 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.240 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:46.240 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615479+0000", 2024-04-18T21:05:46.240 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000158493 2024-04-18T21:05:46.240 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.240 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.240 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:46.240 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615498+0000", 2024-04-18T21:05:46.240 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9148999999999999e-05 2024-04-18T21:05:46.240 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.240 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.240 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:46.240 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632915+0000", 2024-04-18T21:05:46.241 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.017416551999999998 2024-04-18T21:05:46.241 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.241 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.241 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:46.241 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633302+0000", 2024-04-18T21:05:46.241 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00038725000000000001 2024-04-18T21:05:46.241 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.241 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.241 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:46.241 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633638+0000", 2024-04-18T21:05:46.241 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000335946 2024-04-18T21:05:46.241 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.241 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.241 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:46.242 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645976+0000", 2024-04-18T21:05:46.242 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012337617 2024-04-18T21:05:46.242 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.242 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.242 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:46.242 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649080+0000", 2024-04-18T21:05:46.242 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031038929999999999 2024-04-18T21:05:46.242 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.242 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.242 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:46.242 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649207+0000", 2024-04-18T21:05:46.242 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000127537 2024-04-18T21:05:46.242 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.243 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.243 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:46.243 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649316+0000", 2024-04-18T21:05:46.243 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109108 2024-04-18T21:05:46.243 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:46.243 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:46.243 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:46.243 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.243 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.243 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:46.243 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:05:46.243 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 40.620791986, 2024-04-18T21:05:46.243 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036275764000000002, 2024-04-18T21:05:46.243 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:46.243 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:46.244 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:46.244 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:46.244 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.244 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:46.244 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:05:46.244 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:46.244 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.244 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.244 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:46.244 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:05:46.244 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:46.244 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.244 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.244 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:46.245 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615386+0000", 2024-04-18T21:05:46.245 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.573e-06 2024-04-18T21:05:46.245 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.245 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.245 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:46.245 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:05:46.245 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0723999999999999e-05 2024-04-18T21:05:46.245 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.245 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.245 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:46.245 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615418+0000", 2024-04-18T21:05:46.245 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0902000000000001e-05 2024-04-18T21:05:46.245 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.245 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.246 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.246 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615433+0000", 2024-04-18T21:05:46.246 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5319999999999999e-05 2024-04-18T21:05:46.246 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.246 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.246 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:46.246 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615659+0000", 2024-04-18T21:05:46.246 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000226095 2024-04-18T21:05:46.246 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.247 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.247 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:46.247 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:46.247 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1276e-05 2024-04-18T21:05:46.247 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.247 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.247 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:46.247 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643654+0000", 2024-04-18T21:05:46.247 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027983238000000001 2024-04-18T21:05:46.247 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.247 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.247 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:46.247 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643868+0000", 2024-04-18T21:05:46.247 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000214305 2024-04-18T21:05:46.248 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.248 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.248 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:46.248 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:05:46.248 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035892200000000002 2024-04-18T21:05:46.248 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.248 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.248 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:46.248 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646056+0000", 2024-04-18T21:05:46.248 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001829172 2024-04-18T21:05:46.248 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.248 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.248 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:46.248 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651406+0000", 2024-04-18T21:05:46.249 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0053504800000000003 2024-04-18T21:05:46.249 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.249 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.249 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:46.249 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651551+0000", 2024-04-18T21:05:46.249 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014427999999999999 2024-04-18T21:05:46.249 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.249 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.249 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:46.249 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651660+0000", 2024-04-18T21:05:46.249 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109477 2024-04-18T21:05:46.249 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:46.249 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:46.249 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:46.250 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.250 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.250 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:46.250 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:05:46.250 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 40.620718603999997, 2024-04-18T21:05:46.250 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045668994999999997, 2024-04-18T21:05:46.250 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:46.250 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:46.250 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:46.250 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:46.250 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.250 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:46.250 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:05:46.251 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:46.251 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.251 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.251 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:46.251 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:05:46.251 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:46.251 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.251 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.251 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:46.251 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615459+0000", 2024-04-18T21:05:46.251 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5030000000000001e-06 2024-04-18T21:05:46.251 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.251 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.251 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:46.251 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615506+0000", 2024-04-18T21:05:46.252 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6872000000000001e-05 2024-04-18T21:05:46.252 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.252 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.252 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:46.252 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615527+0000", 2024-04-18T21:05:46.252 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0763000000000001e-05 2024-04-18T21:05:46.252 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.252 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.252 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.252 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615551+0000", 2024-04-18T21:05:46.252 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4159e-05 2024-04-18T21:05:46.252 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.252 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.253 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:46.253 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615736+0000", 2024-04-18T21:05:46.253 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018499599999999999 2024-04-18T21:05:46.253 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.253 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.253 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:46.253 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615748+0000", 2024-04-18T21:05:46.253 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2272999999999999e-05 2024-04-18T21:05:46.253 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.253 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.253 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:46.253 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635481+0000", 2024-04-18T21:05:46.253 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019732772999999999 2024-04-18T21:05:46.253 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.254 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.254 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:46.254 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635791+0000", 2024-04-18T21:05:46.254 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031013299999999998 2024-04-18T21:05:46.254 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.254 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.254 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:46.254 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636101+0000", 2024-04-18T21:05:46.254 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030943300000000002 2024-04-18T21:05:46.254 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.254 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.254 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:46.254 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646043+0000", 2024-04-18T21:05:46.254 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099428139999999995 2024-04-18T21:05:46.255 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.255 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.255 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:46.255 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660991+0000", 2024-04-18T21:05:46.255 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014947142 2024-04-18T21:05:46.255 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.255 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.255 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:46.255 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661061+0000", 2024-04-18T21:05:46.255 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0438000000000006e-05 2024-04-18T21:05:46.255 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.255 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.255 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:46.255 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661127+0000", 2024-04-18T21:05:46.255 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5696000000000003e-05 2024-04-18T21:05:46.256 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:46.256 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:46.256 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:46.256 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.256 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.256 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:46.256 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:46.256 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 40.620506175999999, 2024-04-18T21:05:46.256 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045745085999999997, 2024-04-18T21:05:46.256 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:46.256 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:46.256 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:46.256 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:46.256 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.256 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:46.256 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:46.257 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:46.257 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.257 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.257 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:46.257 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:46.257 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:46.257 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.257 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.257 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:46.257 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:05:46.257 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7400000000000001e-06 2024-04-18T21:05:46.257 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.257 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.257 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:46.258 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:05:46.258 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8133e-05 2024-04-18T21:05:46.258 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.258 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.258 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:46.258 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615726+0000", 2024-04-18T21:05:46.258 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6132e-05 2024-04-18T21:05:46.258 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.258 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.258 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.258 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615742+0000", 2024-04-18T21:05:46.258 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6157000000000001e-05 2024-04-18T21:05:46.258 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.258 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.258 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:46.259 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615937+0000", 2024-04-18T21:05:46.259 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000194768 2024-04-18T21:05:46.259 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.259 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.259 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:46.259 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615950+0000", 2024-04-18T21:05:46.259 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3084e-05 2024-04-18T21:05:46.259 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.259 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.259 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:46.259 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643676+0000", 2024-04-18T21:05:46.259 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027725639999999999 2024-04-18T21:05:46.259 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.259 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.260 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:46.260 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643867+0000", 2024-04-18T21:05:46.260 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019075900000000001 2024-04-18T21:05:46.260 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.260 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.260 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:46.260 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:05:46.260 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036013799999999997 2024-04-18T21:05:46.260 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.260 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.260 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:46.260 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646068+0000", 2024-04-18T21:05:46.260 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001841536 2024-04-18T21:05:46.260 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.260 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.260 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:46.261 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661184+0000", 2024-04-18T21:05:46.261 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015115458999999999 2024-04-18T21:05:46.261 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.261 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.261 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:46.261 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661283+0000", 2024-04-18T21:05:46.261 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9502999999999999e-05 2024-04-18T21:05:46.261 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.261 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.261 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:46.261 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661415+0000", 2024-04-18T21:05:46.261 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000132037 2024-04-18T21:05:46.261 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:46.261 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:46.261 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:46.262 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.262 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.262 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:46.262 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:05:46.262 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 40.620384489000003, 2024-04-18T21:05:46.262 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036185947000000003, 2024-04-18T21:05:46.262 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:46.262 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:46.262 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:46.262 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:46.262 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.262 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:46.262 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:05:46.262 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:46.263 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.263 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.263 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:46.263 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:05:46.263 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:46.263 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.263 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.263 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:46.263 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615794+0000", 2024-04-18T21:05:46.263 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6440000000000001e-06 2024-04-18T21:05:46.263 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.263 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.263 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:46.263 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615803+0000", 2024-04-18T21:05:46.263 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1220000000000001e-06 2024-04-18T21:05:46.263 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.264 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.264 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:46.264 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615827+0000", 2024-04-18T21:05:46.264 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3997000000000001e-05 2024-04-18T21:05:46.264 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.264 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.264 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.264 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615899+0000", 2024-04-18T21:05:46.264 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2741e-05 2024-04-18T21:05:46.264 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.264 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.264 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:46.264 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616019+0000", 2024-04-18T21:05:46.264 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119874 2024-04-18T21:05:46.265 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.265 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.265 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:46.265 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616029+0000", 2024-04-18T21:05:46.265 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:05:46.265 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.265 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.265 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:46.265 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644823+0000", 2024-04-18T21:05:46.265 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.028793151999999999 2024-04-18T21:05:46.265 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.265 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.265 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:46.265 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645106+0000", 2024-04-18T21:05:46.266 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028379700000000002 2024-04-18T21:05:46.266 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.266 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.266 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:46.266 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645294+0000", 2024-04-18T21:05:46.266 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000187181 2024-04-18T21:05:46.266 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.266 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.266 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:46.266 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646763+0000", 2024-04-18T21:05:46.266 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0014691050000000001 2024-04-18T21:05:46.266 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.266 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.266 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:46.267 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651784+0000", 2024-04-18T21:05:46.267 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050211650000000002 2024-04-18T21:05:46.267 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.267 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.267 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:46.267 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651876+0000", 2024-04-18T21:05:46.267 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2503999999999994e-05 2024-04-18T21:05:46.267 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.267 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.267 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:46.267 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651978+0000", 2024-04-18T21:05:46.267 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000101475 2024-04-18T21:05:46.267 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:46.267 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:46.268 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:46.268 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.268 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.268 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:46.268 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:46.268 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 40.620235882000003, 2024-04-18T21:05:46.268 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032262322000000003, 2024-04-18T21:05:46.268 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:46.268 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:46.268 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:46.268 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:46.268 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.268 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:46.268 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:46.269 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:46.269 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.269 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.269 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:46.269 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:46.269 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:46.269 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.269 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.269 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:46.269 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615943+0000", 2024-04-18T21:05:46.269 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1959999999999998e-06 2024-04-18T21:05:46.269 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.269 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.269 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:46.270 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615956+0000", 2024-04-18T21:05:46.270 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3424000000000001e-05 2024-04-18T21:05:46.270 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.270 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.270 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:46.270 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615983+0000", 2024-04-18T21:05:46.270 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7072000000000001e-05 2024-04-18T21:05:46.270 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.270 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.270 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.270 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616006+0000", 2024-04-18T21:05:46.270 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2823000000000002e-05 2024-04-18T21:05:46.270 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.270 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.271 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:46.271 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616156+0000", 2024-04-18T21:05:46.271 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014962299999999999 2024-04-18T21:05:46.271 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.271 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.271 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:46.271 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616174+0000", 2024-04-18T21:05:46.271 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8082999999999999e-05 2024-04-18T21:05:46.271 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.271 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.271 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:46.271 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.629952+0000", 2024-04-18T21:05:46.271 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013778514 2024-04-18T21:05:46.271 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.271 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.272 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:46.272 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630201+0000", 2024-04-18T21:05:46.272 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024918100000000001 2024-04-18T21:05:46.272 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.272 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.272 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:46.272 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630386+0000", 2024-04-18T21:05:46.272 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018436900000000001 2024-04-18T21:05:46.272 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.272 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.272 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:46.272 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643169+0000", 2024-04-18T21:05:46.272 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012782774 2024-04-18T21:05:46.272 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.272 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.273 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:46.273 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.647924+0000", 2024-04-18T21:05:46.273 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004755787 2024-04-18T21:05:46.273 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.273 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.273 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:46.273 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648069+0000", 2024-04-18T21:05:46.273 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014459600000000001 2024-04-18T21:05:46.273 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.273 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.273 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:46.273 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648203+0000", 2024-04-18T21:05:46.273 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013388000000000001 2024-04-18T21:05:46.274 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:46.274 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:46.274 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:46.274 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.274 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.274 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:46.274 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:05:46.274 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 40.620127617999998, 2024-04-18T21:05:46.274 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032489736999999998, 2024-04-18T21:05:46.274 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:46.274 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:46.274 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:46.274 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:46.275 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.275 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:46.275 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:05:46.275 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:46.275 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.275 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.275 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:46.275 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:05:46.275 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:46.275 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.275 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.275 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:46.275 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616050+0000", 2024-04-18T21:05:46.275 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.606e-06 2024-04-18T21:05:46.276 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.276 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.276 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:46.276 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616061+0000", 2024-04-18T21:05:46.276 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0463e-05 2024-04-18T21:05:46.276 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.276 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.276 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:46.276 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616092+0000", 2024-04-18T21:05:46.276 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1415999999999999e-05 2024-04-18T21:05:46.276 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.276 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.276 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.276 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616109+0000", 2024-04-18T21:05:46.276 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6557000000000001e-05 2024-04-18T21:05:46.277 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.277 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.277 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:46.277 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616358+0000", 2024-04-18T21:05:46.277 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000249077 2024-04-18T21:05:46.277 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.277 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.277 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:46.277 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616370+0000", 2024-04-18T21:05:46.277 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2037e-05 2024-04-18T21:05:46.277 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.277 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.277 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:46.278 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.634920+0000", 2024-04-18T21:05:46.278 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018550397 2024-04-18T21:05:46.278 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.278 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.278 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:46.278 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640420+0000", 2024-04-18T21:05:46.278 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055000539999999999 2024-04-18T21:05:46.278 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.278 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.278 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:46.278 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648538+0000", 2024-04-18T21:05:46.278 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0081181299999999994 2024-04-18T21:05:46.278 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:46.279 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:46.279 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:46.279 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.279 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.279 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:46.279 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:05:46.279 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 40.620043297000002, 2024-04-18T21:05:46.279 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036090029000000003, 2024-04-18T21:05:46.279 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:46.279 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:46.279 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:46.279 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:46.279 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.279 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:46.280 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:05:46.280 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:46.280 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.280 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.280 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:46.280 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:05:46.280 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:46.280 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.280 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.280 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:46.280 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616134+0000", 2024-04-18T21:05:46.280 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.353e-06 2024-04-18T21:05:46.280 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.280 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.280 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:46.281 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616141+0000", 2024-04-18T21:05:46.281 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2770000000000002e-06 2024-04-18T21:05:46.281 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.281 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.281 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:46.281 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616160+0000", 2024-04-18T21:05:46.281 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.91e-05 2024-04-18T21:05:46.281 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.281 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.281 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.281 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616170+0000", 2024-04-18T21:05:46.281 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7699999999999996e-06 2024-04-18T21:05:46.281 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.281 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.282 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:46.282 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616275+0000", 2024-04-18T21:05:46.282 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105313 2024-04-18T21:05:46.282 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.282 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.282 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:46.282 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616288+0000", 2024-04-18T21:05:46.282 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3027000000000001e-05 2024-04-18T21:05:46.282 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.282 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.282 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:46.282 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646160+0000", 2024-04-18T21:05:46.282 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.029872019 2024-04-18T21:05:46.283 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.283 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.283 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:46.283 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646368+0000", 2024-04-18T21:05:46.283 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020811899999999999 2024-04-18T21:05:46.283 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.283 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.283 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:46.283 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652223+0000", 2024-04-18T21:05:46.283 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.005855051 2024-04-18T21:05:46.283 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:46.283 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:46.283 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:46.283 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.283 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.284 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:46.284 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:05:46.284 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 40.619985728000003, 2024-04-18T21:05:46.284 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043572403000000003, 2024-04-18T21:05:46.284 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:46.284 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:46.284 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:46.284 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:46.284 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.284 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:46.284 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:05:46.284 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:46.284 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.284 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.284 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:46.285 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:05:46.285 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:46.285 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.285 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.285 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:46.285 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616192+0000", 2024-04-18T21:05:46.285 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:05:46.285 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.285 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.285 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:46.285 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616203+0000", 2024-04-18T21:05:46.285 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0890000000000001e-05 2024-04-18T21:05:46.285 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.285 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.285 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:46.286 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616223+0000", 2024-04-18T21:05:46.286 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0409000000000001e-05 2024-04-18T21:05:46.286 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.286 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.286 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.286 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616238+0000", 2024-04-18T21:05:46.286 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5160000000000001e-05 2024-04-18T21:05:46.286 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.286 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.286 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:46.286 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616343+0000", 2024-04-18T21:05:46.286 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000104831 2024-04-18T21:05:46.286 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.286 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.287 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:46.287 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616357+0000", 2024-04-18T21:05:46.287 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3686000000000001e-05 2024-04-18T21:05:46.287 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.287 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.287 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:46.287 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635912+0000", 2024-04-18T21:05:46.287 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019554944000000001 2024-04-18T21:05:46.287 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.287 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.287 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:46.287 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636231+0000", 2024-04-18T21:05:46.287 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000318766 2024-04-18T21:05:46.287 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.287 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.288 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:46.288 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659763+0000", 2024-04-18T21:05:46.288 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023532474000000001 2024-04-18T21:05:46.288 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:46.288 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:46.288 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:46.288 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.288 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.288 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:46.288 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:05:46.288 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 40.616057021000003, 2024-04-18T21:05:46.288 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015007971, 2024-04-18T21:05:46.288 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:46.288 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:46.289 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:46.289 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:46.289 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.289 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:46.289 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:05:46.289 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:46.289 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.289 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.289 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:46.289 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:05:46.289 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:46.289 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.289 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.289 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:46.290 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620120+0000", 2024-04-18T21:05:46.290 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0359999999999999e-06 2024-04-18T21:05:46.290 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.290 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.290 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:46.290 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620157+0000", 2024-04-18T21:05:46.290 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6636e-05 2024-04-18T21:05:46.290 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.290 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.290 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:46.290 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620177+0000", 2024-04-18T21:05:46.290 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0247000000000001e-05 2024-04-18T21:05:46.290 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.290 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.291 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.291 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620195+0000", 2024-04-18T21:05:46.291 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7819e-05 2024-04-18T21:05:46.291 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.291 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.291 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:46.291 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620342+0000", 2024-04-18T21:05:46.291 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014643300000000001 2024-04-18T21:05:46.291 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.291 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.291 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:46.291 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620405+0000", 2024-04-18T21:05:46.291 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3522000000000006e-05 2024-04-18T21:05:46.291 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.292 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.292 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:46.292 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635016+0000", 2024-04-18T21:05:46.292 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014610840999999999 2024-04-18T21:05:46.292 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.292 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.292 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:46.292 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635127+0000", 2024-04-18T21:05:46.292 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111437 2024-04-18T21:05:46.292 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:46.292 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:46.292 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:46.292 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.292 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.292 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:46.293 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:05:46.293 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 40.615949753000002, 2024-04-18T21:05:46.293 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012693296, 2024-04-18T21:05:46.293 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:46.293 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:46.293 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:46.293 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:46.293 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.293 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:46.293 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:05:46.293 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:46.293 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.293 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.294 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:46.294 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:05:46.294 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:46.294 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.294 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.294 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:46.294 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620228+0000", 2024-04-18T21:05:46.294 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:05:46.294 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.294 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.294 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:46.294 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620236+0000", 2024-04-18T21:05:46.294 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.303e-06 2024-04-18T21:05:46.295 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.295 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.295 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:46.295 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620255+0000", 2024-04-18T21:05:46.295 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9406e-05 2024-04-18T21:05:46.295 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.295 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.295 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.295 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620274+0000", 2024-04-18T21:05:46.295 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8940000000000002e-05 2024-04-18T21:05:46.295 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.295 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.295 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:46.295 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:05:46.295 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001558753 2024-04-18T21:05:46.296 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.296 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.296 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:46.296 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621879+0000", 2024-04-18T21:05:46.296 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6359000000000001e-05 2024-04-18T21:05:46.296 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.296 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.296 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:46.296 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632841+0000", 2024-04-18T21:05:46.296 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010961907 2024-04-18T21:05:46.296 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.296 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.296 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:46.296 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632920+0000", 2024-04-18T21:05:46.296 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8714999999999994e-05 2024-04-18T21:05:46.297 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:46.297 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:46.297 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:46.297 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.297 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.297 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:46.297 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:05:46.297 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 40.61440399, 2024-04-18T21:05:46.297 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013445702, 2024-04-18T21:05:46.297 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:46.297 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:46.297 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:46.297 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:46.297 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.297 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:46.297 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:05:46.298 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:46.298 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.298 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.298 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:46.298 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:05:46.298 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:46.298 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.298 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.298 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:46.298 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621774+0000", 2024-04-18T21:05:46.298 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2500000000000001e-06 2024-04-18T21:05:46.298 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.298 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.298 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:46.299 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621786+0000", 2024-04-18T21:05:46.299 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2636000000000001e-05 2024-04-18T21:05:46.299 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.299 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.299 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:46.299 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621814+0000", 2024-04-18T21:05:46.299 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7823000000000001e-05 2024-04-18T21:05:46.299 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.299 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.299 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.299 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621844+0000", 2024-04-18T21:05:46.299 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9589000000000001e-05 2024-04-18T21:05:46.299 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.299 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.300 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:46.300 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622253+0000", 2024-04-18T21:05:46.300 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040963700000000002 2024-04-18T21:05:46.300 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.300 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.300 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:46.300 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622304+0000", 2024-04-18T21:05:46.300 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0868999999999997e-05 2024-04-18T21:05:46.300 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.300 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.300 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:46.300 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635133+0000", 2024-04-18T21:05:46.300 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012829136 2024-04-18T21:05:46.300 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.300 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.301 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:46.301 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635218+0000", 2024-04-18T21:05:46.301 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4761999999999999e-05 2024-04-18T21:05:46.301 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:46.301 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:46.301 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:46.301 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.301 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.301 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:46.301 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:05:46.301 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 40.614277229999999, 2024-04-18T21:05:46.301 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014162065, 2024-04-18T21:05:46.301 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:46.302 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:46.302 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:46.302 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:46.302 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.302 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:46.302 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:05:46.302 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:46.302 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.302 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.302 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:46.302 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:05:46.302 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:46.302 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.302 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.303 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:46.303 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621900+0000", 2024-04-18T21:05:46.303 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:05:46.303 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.303 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.303 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:46.303 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621910+0000", 2024-04-18T21:05:46.303 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0207000000000001e-05 2024-04-18T21:05:46.303 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.303 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.303 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:46.303 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621932+0000", 2024-04-18T21:05:46.303 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1789000000000001e-05 2024-04-18T21:05:46.303 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.304 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.304 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.304 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621946+0000", 2024-04-18T21:05:46.304 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4212999999999999e-05 2024-04-18T21:05:46.304 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.304 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.304 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:46.304 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624477+0000", 2024-04-18T21:05:46.304 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025303470000000001 2024-04-18T21:05:46.304 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.304 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.304 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:46.304 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624525+0000", 2024-04-18T21:05:46.304 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8084999999999998e-05 2024-04-18T21:05:46.305 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.305 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.305 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:46.305 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635976+0000", 2024-04-18T21:05:46.305 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.011451368999999999 2024-04-18T21:05:46.305 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.305 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.305 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:46.305 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636061+0000", 2024-04-18T21:05:46.305 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5094999999999998e-05 2024-04-18T21:05:46.305 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:46.305 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:46.305 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:46.305 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.306 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.306 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:05:46.306 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:05:46.306 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 40.605041604999997, 2024-04-18T21:05:46.306 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0098014739999999993, 2024-04-18T21:05:46.306 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:46.306 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:46.306 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:05:46.306 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:46.306 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.306 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:46.306 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:05:46.306 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:46.306 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.306 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.307 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:46.307 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:05:46.307 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:46.307 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.307 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.307 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:46.307 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631136+0000", 2024-04-18T21:05:46.307 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0139999999999999e-06 2024-04-18T21:05:46.307 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.307 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.307 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:46.307 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631152+0000", 2024-04-18T21:05:46.307 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6365999999999999e-05 2024-04-18T21:05:46.307 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.307 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.307 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:46.308 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631961+0000", 2024-04-18T21:05:46.308 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00080873100000000003 2024-04-18T21:05:46.308 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.308 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.308 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.308 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632021+0000", 2024-04-18T21:05:46.308 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0541999999999997e-05 2024-04-18T21:05:46.308 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.308 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.308 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:46.308 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633539+0000", 2024-04-18T21:05:46.308 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015175639999999999 2024-04-18T21:05:46.308 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.308 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.309 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:46.309 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640936+0000", 2024-04-18T21:05:46.309 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007397257 2024-04-18T21:05:46.309 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:46.309 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:46.309 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:46.309 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.309 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.309 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-18T21:05:46.309 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:05:46.309 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 40.587580172000003, 2024-04-18T21:05:46.309 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00073592199999999997, 2024-04-18T21:05:46.309 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:46.309 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:46.310 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:46.310 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:46.310 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.310 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:46.310 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:05:46.310 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:46.310 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.310 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.310 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:46.310 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:05:46.310 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:46.310 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.311 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.311 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:46.311 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648597+0000", 2024-04-18T21:05:46.311 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:05:46.311 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.311 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.311 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:46.311 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648605+0000", 2024-04-18T21:05:46.311 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3960000000000006e-06 2024-04-18T21:05:46.311 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.311 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.311 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:46.311 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648625+0000", 2024-04-18T21:05:46.311 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9987e-05 2024-04-18T21:05:46.311 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.312 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.312 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.312 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648643+0000", 2024-04-18T21:05:46.312 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7079e-05 2024-04-18T21:05:46.312 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.312 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.312 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:46.312 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649043+0000", 2024-04-18T21:05:46.312 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040083399999999998 2024-04-18T21:05:46.312 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.312 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.312 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:46.312 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649062+0000", 2024-04-18T21:05:46.312 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9052999999999999e-05 2024-04-18T21:05:46.312 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.312 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.313 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:46.313 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649332+0000", 2024-04-18T21:05:46.313 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026971999999999999 2024-04-18T21:05:46.313 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:46.313 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:46.313 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:46.313 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.313 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.313 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:05:46.313 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:05:46.313 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 40.584805271, 2024-04-18T21:05:46.313 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00086123999999999999, 2024-04-18T21:05:46.313 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:46.313 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:46.314 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:05:46.314 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:46.314 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.314 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:46.314 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:05:46.314 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:46.314 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.314 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.314 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:46.314 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:05:46.314 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:46.314 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.314 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.314 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:46.314 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651372+0000", 2024-04-18T21:05:46.315 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7599999999999997e-07 2024-04-18T21:05:46.315 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.315 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.315 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:46.315 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651377+0000", 2024-04-18T21:05:46.315 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.22e-06 2024-04-18T21:05:46.315 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.315 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.315 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:46.315 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651394+0000", 2024-04-18T21:05:46.315 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6646999999999998e-05 2024-04-18T21:05:46.315 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.315 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.315 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.315 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651427+0000", 2024-04-18T21:05:46.316 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3682e-05 2024-04-18T21:05:46.316 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.316 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.316 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:46.316 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652029+0000", 2024-04-18T21:05:46.316 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00060152199999999995 2024-04-18T21:05:46.316 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.316 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.316 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:46.316 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652232+0000", 2024-04-18T21:05:46.316 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020359299999999999 2024-04-18T21:05:46.316 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:46.316 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:46.316 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:46.316 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.317 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.317 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:05:46.317 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:05:46.317 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 40.576778308999998, 2024-04-18T21:05:46.317 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0017426200000000001, 2024-04-18T21:05:46.317 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:46.317 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:46.317 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:46.317 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:46.317 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.317 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:46.317 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:05:46.317 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:46.317 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.318 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.318 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:46.318 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:05:46.318 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:46.318 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.318 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.318 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:46.318 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659399+0000", 2024-04-18T21:05:46.318 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6000000000000002e-07 2024-04-18T21:05:46.318 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.318 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.318 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:46.318 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659405+0000", 2024-04-18T21:05:46.318 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5069999999999997e-06 2024-04-18T21:05:46.318 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.319 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.319 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:46.319 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659425+0000", 2024-04-18T21:05:46.319 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.927e-05 2024-04-18T21:05:46.319 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.319 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.319 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.319 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659443+0000", 2024-04-18T21:05:46.319 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8051999999999999e-05 2024-04-18T21:05:46.319 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.319 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.319 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:46.319 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660973+0000", 2024-04-18T21:05:46.320 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001530106 2024-04-18T21:05:46.320 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.320 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.320 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:46.320 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660983+0000", 2024-04-18T21:05:46.320 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0516999999999999e-05 2024-04-18T21:05:46.320 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.320 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.320 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:46.320 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661141+0000", 2024-04-18T21:05:46.320 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015730799999999999 2024-04-18T21:05:46.320 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:46.320 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:46.320 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:46.320 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.321 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.321 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:05:46.321 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:05:46.321 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 40.576561683999998, 2024-04-18T21:05:46.321 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001812311, 2024-04-18T21:05:46.321 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:46.321 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:46.321 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:46.321 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:46.321 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.321 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:46.321 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:05:46.321 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:46.321 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.322 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.322 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:46.322 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:05:46.322 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:46.322 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.322 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.322 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:46.322 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659616+0000", 2024-04-18T21:05:46.322 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.277e-06 2024-04-18T21:05:46.322 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.322 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.322 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:46.322 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659625+0000", 2024-04-18T21:05:46.322 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5359999999999998e-06 2024-04-18T21:05:46.323 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.323 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.323 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:46.323 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659647+0000", 2024-04-18T21:05:46.323 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1857000000000001e-05 2024-04-18T21:05:46.323 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.323 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.323 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.323 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659664+0000", 2024-04-18T21:05:46.323 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6405999999999998e-05 2024-04-18T21:05:46.323 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.323 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.323 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:46.323 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661169+0000", 2024-04-18T21:05:46.323 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015054179999999999 2024-04-18T21:05:46.324 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.324 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.324 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:46.324 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661177+0000", 2024-04-18T21:05:46.324 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9680000000000006e-06 2024-04-18T21:05:46.324 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.324 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.324 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:46.324 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661427+0000", 2024-04-18T21:05:46.324 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024984900000000001 2024-04-18T21:05:46.324 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:46.324 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:46.324 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:46.324 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.324 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.325 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-18T21:05:46.325 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:05:46.325 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 38.623641075999998, 2024-04-18T21:05:46.325 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0030975030000000001, 2024-04-18T21:05:46.325 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:46.325 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:46.325 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:46.325 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:46.325 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.325 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:46.325 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:05:46.325 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:46.325 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.325 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.326 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:46.326 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:05:46.326 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:46.326 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.326 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.326 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:46.326 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612538+0000", 2024-04-18T21:05:46.326 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6259999999999999e-06 2024-04-18T21:05:46.326 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.326 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.326 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:46.326 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612552+0000", 2024-04-18T21:05:46.326 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4073999999999999e-05 2024-04-18T21:05:46.326 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.326 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.327 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:46.327 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612585+0000", 2024-04-18T21:05:46.327 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3504999999999999e-05 2024-04-18T21:05:46.327 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.327 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.327 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.327 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612601+0000", 2024-04-18T21:05:46.327 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5194000000000001e-05 2024-04-18T21:05:46.327 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.327 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.327 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:46.327 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612746+0000", 2024-04-18T21:05:46.327 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145666 2024-04-18T21:05:46.327 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.327 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.328 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:46.328 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612953+0000", 2024-04-18T21:05:46.328 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000207109 2024-04-18T21:05:46.328 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.328 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.328 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:46.328 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.613134+0000", 2024-04-18T21:05:46.328 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018041300000000001 2024-04-18T21:05:46.328 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.328 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.328 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:46.328 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.614411+0000", 2024-04-18T21:05:46.328 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0012769929999999999 2024-04-18T21:05:46.328 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.329 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.329 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:46.329 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615441+0000", 2024-04-18T21:05:46.329 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001029917 2024-04-18T21:05:46.329 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.329 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.329 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:46.329 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615522+0000", 2024-04-18T21:05:46.329 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1142000000000003e-05 2024-04-18T21:05:46.329 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.329 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.329 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:46.329 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615633+0000", 2024-04-18T21:05:46.329 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000110864 2024-04-18T21:05:46.329 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:46.330 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:46.330 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:46.330 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.330 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.330 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-18T21:05:46.330 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:05:46.330 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.621355264999998, 2024-04-18T21:05:46.330 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088979039999999999, 2024-04-18T21:05:46.330 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:46.330 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:46.330 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:46.330 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:46.330 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.330 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:46.331 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:05:46.331 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:46.331 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.331 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.331 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:46.331 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:05:46.331 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:46.331 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.331 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.331 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:46.331 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614825+0000", 2024-04-18T21:05:46.331 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4829999999999999e-06 2024-04-18T21:05:46.331 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.331 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.331 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:46.332 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614843+0000", 2024-04-18T21:05:46.332 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8777e-05 2024-04-18T21:05:46.332 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.332 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.332 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:46.332 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614884+0000", 2024-04-18T21:05:46.332 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1051999999999999e-05 2024-04-18T21:05:46.332 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.332 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.332 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.332 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614903+0000", 2024-04-18T21:05:46.332 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9069999999999999e-05 2024-04-18T21:05:46.332 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.332 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.332 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:46.333 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615047+0000", 2024-04-18T21:05:46.333 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014374400000000001 2024-04-18T21:05:46.333 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.333 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.333 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:46.333 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615061+0000", 2024-04-18T21:05:46.333 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4063000000000001e-05 2024-04-18T21:05:46.333 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.333 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.333 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:46.333 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621064+0000", 2024-04-18T21:05:46.333 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0060029200000000001 2024-04-18T21:05:46.333 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.333 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.334 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:46.334 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621211+0000", 2024-04-18T21:05:46.334 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000147224 2024-04-18T21:05:46.334 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.334 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.334 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:46.334 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621396+0000", 2024-04-18T21:05:46.334 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018454699999999999 2024-04-18T21:05:46.334 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.334 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.334 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:46.334 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.622517+0000", 2024-04-18T21:05:46.334 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001121424 2024-04-18T21:05:46.334 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.334 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.335 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:46.335 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623571+0000", 2024-04-18T21:05:46.335 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010538660000000001 2024-04-18T21:05:46.335 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.335 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.335 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:46.335 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623658+0000", 2024-04-18T21:05:46.335 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6439000000000004e-05 2024-04-18T21:05:46.335 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:46.335 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:46.335 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:46.335 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623719+0000", 2024-04-18T21:05:46.335 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1295000000000002e-05 2024-04-18T21:05:46.335 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:46.335 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:46.335 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:46.336 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:46.336 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:46.336 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:05:46.337 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:05:46.338 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:46.339+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:46.438 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:46.435+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:46.468 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:05:46.468 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:05:46.468 INFO:teuthology.orchestra.run.smithi132.stdout: "num_ops": 0 2024-04-18T21:05:46.468 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:05:46.482 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:05:46.539 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:46.539+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:46.640 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:46.639+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:46.644 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:05:46.644 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:05:46.644 INFO:teuthology.orchestra.run.smithi132.stdout: "complaint_time": 30, 2024-04-18T21:05:46.644 INFO:teuthology.orchestra.run.smithi132.stdout: "num_blocked_ops": 0 2024-04-18T21:05:46.644 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:05:46.658 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:05:46.742 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:46.743+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:46.779 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:05:46.780 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 20, 2024-04-18T21:05:46.780 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 600, 2024-04-18T21:05:46.780 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [ 2024-04-18T21:05:46.780 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.780 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:46.780 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:05:46.780 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 51.867466415999999, 2024-04-18T21:05:46.780 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.02518273, 2024-04-18T21:05:46.780 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:46.780 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:46.780 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:46.780 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:46.781 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:46.781 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:46.781 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 141 2024-04-18T21:05:46.781 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.781 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:46.781 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.781 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:46.781 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:05:46.781 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:46.781 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.781 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.781 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:46.781 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:05:46.781 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:46.782 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.782 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.782 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:46.782 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911562+0000", 2024-04-18T21:05:46.782 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9300000000000006e-07 2024-04-18T21:05:46.782 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.782 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.782 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:46.782 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911569+0000", 2024-04-18T21:05:46.782 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0169999999999999e-06 2024-04-18T21:05:46.782 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.782 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.782 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:46.783 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911582+0000", 2024-04-18T21:05:46.783 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.343e-05 2024-04-18T21:05:46.783 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.783 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.783 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.783 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911590+0000", 2024-04-18T21:05:46.783 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.413e-06 2024-04-18T21:05:46.783 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.783 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.783 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:46.783 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.933922+0000", 2024-04-18T21:05:46.783 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.022332093000000001 2024-04-18T21:05:46.783 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.783 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.784 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:46.784 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.934155+0000", 2024-04-18T21:05:46.784 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023378900000000001 2024-04-18T21:05:46.784 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.784 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.784 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:46.784 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.934514+0000", 2024-04-18T21:05:46.784 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00035859200000000003 2024-04-18T21:05:46.784 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.784 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.784 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:46.784 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.935973+0000", 2024-04-18T21:05:46.784 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001458705 2024-04-18T21:05:46.784 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.784 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.784 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:46.785 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936488+0000", 2024-04-18T21:05:46.785 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00051550000000000001 2024-04-18T21:05:46.785 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.785 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.785 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:46.785 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936636+0000", 2024-04-18T21:05:46.785 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014779800000000001 2024-04-18T21:05:46.785 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.785 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.785 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:46.785 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936743+0000", 2024-04-18T21:05:46.785 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010739999999999999 2024-04-18T21:05:46.785 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:46.785 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:46.786 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:46.786 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.786 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.786 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:46.786 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:05:46.786 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 51.750267442000002, 2024-04-18T21:05:46.786 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023654959999999999, 2024-04-18T21:05:46.786 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:46.786 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:46.786 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:46.786 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:46.786 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:46.786 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:46.787 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 163 2024-04-18T21:05:46.787 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.787 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:46.787 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.787 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:46.787 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:05:46.787 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:46.787 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.787 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.787 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:46.787 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:05:46.787 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:46.787 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.788 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.788 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:46.788 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:05:46.788 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0999999999999998e-07 2024-04-18T21:05:46.788 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.788 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.788 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:46.788 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028766+0000", 2024-04-18T21:05:46.788 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4700000000000001e-06 2024-04-18T21:05:46.788 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.788 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.788 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:46.788 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028775+0000", 2024-04-18T21:05:46.788 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.3190000000000001e-06 2024-04-18T21:05:46.789 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.789 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.789 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.789 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028782+0000", 2024-04-18T21:05:46.789 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.2300000000000002e-06 2024-04-18T21:05:46.789 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.789 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.789 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:46.789 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046667+0000", 2024-04-18T21:05:46.789 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017884356000000001 2024-04-18T21:05:46.789 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.789 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.789 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:46.789 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046788+0000", 2024-04-18T21:05:46.790 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012125000000000001 2024-04-18T21:05:46.790 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.790 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.790 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:46.790 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046982+0000", 2024-04-18T21:05:46.790 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019394 2024-04-18T21:05:46.790 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.790 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.790 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:46.790 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051969+0000", 2024-04-18T21:05:46.790 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0049868150000000003 2024-04-18T21:05:46.790 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.790 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.791 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:46.791 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052089+0000", 2024-04-18T21:05:46.791 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011993 2024-04-18T21:05:46.791 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.791 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.791 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:46.791 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052292+0000", 2024-04-18T21:05:46.791 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020345699999999999 2024-04-18T21:05:46.791 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.791 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.791 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:46.791 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052415+0000", 2024-04-18T21:05:46.791 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000122483 2024-04-18T21:05:46.791 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:46.792 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:46.792 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:46.792 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.792 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.792 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:46.792 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:05:46.792 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 51.750233209999998, 2024-04-18T21:05:46.792 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023864586, 2024-04-18T21:05:46.792 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:46.792 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:46.792 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:46.792 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:46.792 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:46.792 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:46.793 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 164 2024-04-18T21:05:46.793 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.793 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:46.793 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.793 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:46.793 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:05:46.793 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:46.793 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.793 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.793 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:46.793 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:05:46.793 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:46.793 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.793 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.794 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:46.794 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028795+0000", 2024-04-18T21:05:46.794 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7999999999999995e-07 2024-04-18T21:05:46.794 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.794 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.794 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:46.794 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028884+0000", 2024-04-18T21:05:46.794 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8997000000000002e-05 2024-04-18T21:05:46.794 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.794 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.794 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:46.794 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028895+0000", 2024-04-18T21:05:46.794 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1647e-05 2024-04-18T21:05:46.795 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.795 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.795 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.795 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028903+0000", 2024-04-18T21:05:46.795 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.909e-06 2024-04-18T21:05:46.795 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.795 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.795 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:46.795 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.047818+0000", 2024-04-18T21:05:46.795 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018914337 2024-04-18T21:05:46.795 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.795 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.795 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:46.795 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.048094+0000", 2024-04-18T21:05:46.796 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00027653500000000001 2024-04-18T21:05:46.796 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.796 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.796 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:46.796 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.048471+0000", 2024-04-18T21:05:46.796 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00037705799999999999 2024-04-18T21:05:46.796 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.796 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.796 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:46.796 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052516+0000", 2024-04-18T21:05:46.796 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0040452739999999997 2024-04-18T21:05:46.796 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.796 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.796 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:46.797 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052535+0000", 2024-04-18T21:05:46.797 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.84e-05 2024-04-18T21:05:46.797 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.797 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.797 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:46.797 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052603+0000", 2024-04-18T21:05:46.797 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.8095000000000004e-05 2024-04-18T21:05:46.797 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.797 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.797 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:46.797 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052659+0000", 2024-04-18T21:05:46.797 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5653999999999999e-05 2024-04-18T21:05:46.797 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:46.798 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:46.798 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:46.798 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.798 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.798 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:46.798 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:05:46.798 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 51.750109766999998, 2024-04-18T21:05:46.798 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024516458000000001, 2024-04-18T21:05:46.798 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:46.798 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:46.798 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:46.798 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:46.799 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:46.799 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:46.799 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 165 2024-04-18T21:05:46.799 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.799 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:46.799 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.799 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:46.799 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:05:46.799 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:46.799 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.799 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.799 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:46.800 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:05:46.800 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:46.800 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.800 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.800 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:46.800 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028918+0000", 2024-04-18T21:05:46.800 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8000000000000005e-07 2024-04-18T21:05:46.800 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.800 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.800 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:46.800 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028924+0000", 2024-04-18T21:05:46.800 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5659999999999997e-06 2024-04-18T21:05:46.800 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.800 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.800 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:46.801 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028933+0000", 2024-04-18T21:05:46.801 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.38e-06 2024-04-18T21:05:46.801 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.801 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.801 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.801 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028940+0000", 2024-04-18T21:05:46.801 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0060000000000003e-06 2024-04-18T21:05:46.801 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.801 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.801 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:46.801 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.050846+0000", 2024-04-18T21:05:46.801 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021906119000000002 2024-04-18T21:05:46.801 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.802 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.802 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:46.802 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051025+0000", 2024-04-18T21:05:46.802 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017850799999999999 2024-04-18T21:05:46.802 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.802 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.802 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:46.802 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051221+0000", 2024-04-18T21:05:46.802 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019608700000000001 2024-04-18T21:05:46.806 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.806 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.806 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:46.806 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052675+0000", 2024-04-18T21:05:46.806 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0014537899999999999 2024-04-18T21:05:46.806 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.806 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.806 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:46.806 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053311+0000", 2024-04-18T21:05:46.806 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00063613299999999999 2024-04-18T21:05:46.807 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.807 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.807 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:46.807 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053381+0000", 2024-04-18T21:05:46.807 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0074999999999996e-05 2024-04-18T21:05:46.807 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.807 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.807 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:46.807 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053434+0000", 2024-04-18T21:05:46.807 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3013999999999998e-05 2024-04-18T21:05:46.807 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:46.807 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:46.807 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:46.807 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.807 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.808 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:46.808 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:05:46.808 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 51.636804288, 2024-04-18T21:05:46.808 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023772793, 2024-04-18T21:05:46.808 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:46.808 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:46.808 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:46.808 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:46.808 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:46.808 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:46.808 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 187 2024-04-18T21:05:46.808 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.808 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:46.809 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.809 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:46.809 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:05:46.809 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:46.809 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.809 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.809 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:46.809 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:05:46.809 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:46.809 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.809 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.809 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:46.809 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142224+0000", 2024-04-18T21:05:46.810 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.47e-07 2024-04-18T21:05:46.810 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.810 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.810 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:46.810 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142233+0000", 2024-04-18T21:05:46.810 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0729999999999994e-06 2024-04-18T21:05:46.810 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.810 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.810 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:46.810 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142255+0000", 2024-04-18T21:05:46.810 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.2535999999999999e-05 2024-04-18T21:05:46.810 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.810 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.810 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.811 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142268+0000", 2024-04-18T21:05:46.811 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2686e-05 2024-04-18T21:05:46.811 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.811 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.811 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:46.811 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160497+0000", 2024-04-18T21:05:46.811 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018228779000000001 2024-04-18T21:05:46.811 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.811 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.811 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:46.811 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160634+0000", 2024-04-18T21:05:46.811 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000137315 2024-04-18T21:05:46.811 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.811 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.812 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:46.812 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160831+0000", 2024-04-18T21:05:46.812 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019683100000000001 2024-04-18T21:05:46.812 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.812 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.812 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:46.812 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165129+0000", 2024-04-18T21:05:46.812 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0042981299999999998 2024-04-18T21:05:46.812 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.812 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.812 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:46.812 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165776+0000", 2024-04-18T21:05:46.812 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00064702900000000003 2024-04-18T21:05:46.812 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.813 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.813 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:46.813 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165921+0000", 2024-04-18T21:05:46.813 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014506 2024-04-18T21:05:46.813 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.813 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.813 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:46.813 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165996+0000", 2024-04-18T21:05:46.813 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.4406999999999994e-05 2024-04-18T21:05:46.813 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:46.813 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:46.813 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:46.813 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.813 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.813 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:46.814 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:05:46.814 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 51.636743690000003, 2024-04-18T21:05:46.814 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026802157, 2024-04-18T21:05:46.814 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:46.814 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:46.814 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:46.814 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:46.814 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:46.814 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:46.814 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 188 2024-04-18T21:05:46.814 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.814 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:46.814 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.814 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:46.815 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:05:46.815 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:46.815 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.815 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.815 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:46.815 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:05:46.815 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:46.815 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.815 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.815 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:46.815 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142284+0000", 2024-04-18T21:05:46.815 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4e-07 2024-04-18T21:05:46.816 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.816 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.816 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:46.816 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142374+0000", 2024-04-18T21:05:46.816 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0099999999999995e-05 2024-04-18T21:05:46.816 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.816 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.816 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:46.816 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142386+0000", 2024-04-18T21:05:46.816 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1770000000000001e-05 2024-04-18T21:05:46.816 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.816 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.816 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.816 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142394+0000", 2024-04-18T21:05:46.817 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.2130000000000008e-06 2024-04-18T21:05:46.817 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.817 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.817 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:46.817 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.161743+0000", 2024-04-18T21:05:46.817 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019348644000000002 2024-04-18T21:05:46.817 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.817 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.817 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:46.817 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.161865+0000", 2024-04-18T21:05:46.817 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012210899999999999 2024-04-18T21:05:46.817 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.817 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.817 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:46.817 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.162055+0000", 2024-04-18T21:05:46.818 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000189994 2024-04-18T21:05:46.818 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.818 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.818 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:46.818 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165735+0000", 2024-04-18T21:05:46.818 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0036803270000000002 2024-04-18T21:05:46.818 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.818 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.818 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:46.818 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.168911+0000", 2024-04-18T21:05:46.818 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0031753689999999999 2024-04-18T21:05:46.818 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.818 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.818 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:46.819 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169012+0000", 2024-04-18T21:05:46.819 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010157699999999999 2024-04-18T21:05:46.819 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.819 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.819 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:46.819 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169086+0000", 2024-04-18T21:05:46.819 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3213999999999994e-05 2024-04-18T21:05:46.819 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:46.819 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:46.819 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:46.819 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.819 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.819 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:46.819 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:05:46.819 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 51.636618384000002, 2024-04-18T21:05:46.820 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026811423000000001, 2024-04-18T21:05:46.820 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:46.820 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:46.820 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:46.820 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:46.820 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:46.820 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:46.820 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 189 2024-04-18T21:05:46.820 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.820 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:46.820 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.820 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:46.820 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:05:46.820 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:46.821 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.821 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.821 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:46.821 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:05:46.821 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:46.821 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.821 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.821 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:46.821 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142410+0000", 2024-04-18T21:05:46.821 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:05:46.821 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.821 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.821 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:46.821 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142415+0000", 2024-04-18T21:05:46.821 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.7939999999999999e-06 2024-04-18T21:05:46.822 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.822 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.822 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:46.822 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142470+0000", 2024-04-18T21:05:46.822 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4537999999999999e-05 2024-04-18T21:05:46.822 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.822 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.822 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.822 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142481+0000", 2024-04-18T21:05:46.822 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0966e-05 2024-04-18T21:05:46.822 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.822 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.822 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:46.822 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.163493+0000", 2024-04-18T21:05:46.823 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021012444000000002 2024-04-18T21:05:46.823 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.823 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.823 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:46.823 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.163727+0000", 2024-04-18T21:05:46.823 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000233339 2024-04-18T21:05:46.823 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.823 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.823 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:46.823 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.164102+0000", 2024-04-18T21:05:46.823 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000374872 2024-04-18T21:05:46.823 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.823 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.823 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:46.823 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.166528+0000", 2024-04-18T21:05:46.824 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0024258729999999998 2024-04-18T21:05:46.824 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.824 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.824 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:46.824 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169101+0000", 2024-04-18T21:05:46.824 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0025737680000000001 2024-04-18T21:05:46.824 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.824 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.824 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:46.824 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169171+0000", 2024-04-18T21:05:46.824 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0148000000000007e-05 2024-04-18T21:05:46.824 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.824 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.824 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:46.824 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169220+0000", 2024-04-18T21:05:46.825 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8767999999999998e-05 2024-04-18T21:05:46.825 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:46.825 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:46.825 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:46.825 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.825 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.825 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:46.825 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:05:46.825 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 41.163045832000002, 2024-04-18T21:05:46.825 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024082777999999999, 2024-04-18T21:05:46.825 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:46.825 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:46.825 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:46.825 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:46.825 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.826 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:46.826 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:05:46.826 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:46.826 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.826 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.826 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:46.826 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:05:46.826 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:46.826 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.826 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.826 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:46.826 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615984+0000", 2024-04-18T21:05:46.826 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.9869999999999999e-06 2024-04-18T21:05:46.826 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.827 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.827 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:46.827 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615999+0000", 2024-04-18T21:05:46.827 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4646e-05 2024-04-18T21:05:46.827 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.827 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.827 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:46.827 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616028+0000", 2024-04-18T21:05:46.827 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8952999999999999e-05 2024-04-18T21:05:46.827 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.827 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.827 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.827 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616052+0000", 2024-04-18T21:05:46.827 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.3941999999999999e-05 2024-04-18T21:05:46.828 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.828 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.828 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:46.828 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618010+0000", 2024-04-18T21:05:46.828 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0019581780000000001 2024-04-18T21:05:46.828 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.828 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.828 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:46.828 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618322+0000", 2024-04-18T21:05:46.828 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00031158899999999997 2024-04-18T21:05:46.828 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.828 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.828 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:46.828 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618587+0000", 2024-04-18T21:05:46.828 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00026495700000000002 2024-04-18T21:05:46.829 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.829 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.829 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:46.829 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629262+0000", 2024-04-18T21:05:46.829 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010675877 2024-04-18T21:05:46.829 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.829 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.829 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:46.829 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.639773+0000", 2024-04-18T21:05:46.829 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0105109 2024-04-18T21:05:46.829 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.829 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.829 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:46.830 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.639926+0000", 2024-04-18T21:05:46.830 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000152349 2024-04-18T21:05:46.830 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.830 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.830 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:46.830 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640064+0000", 2024-04-18T21:05:46.830 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0001384 2024-04-18T21:05:46.830 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:46.830 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:46.830 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:46.830 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.830 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.830 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:46.831 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:05:46.831 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 41.162933158000001, 2024-04-18T21:05:46.831 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030215005999999999, 2024-04-18T21:05:46.831 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:46.831 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:46.831 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:46.831 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:46.831 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.831 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:46.831 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:05:46.831 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:46.831 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.831 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.831 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:46.831 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:05:46.832 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:46.832 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.832 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.832 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:46.832 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616095+0000", 2024-04-18T21:05:46.832 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.446e-06 2024-04-18T21:05:46.832 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.832 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.832 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:46.832 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616104+0000", 2024-04-18T21:05:46.832 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6200000000000005e-06 2024-04-18T21:05:46.832 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.832 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.833 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:46.833 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616132+0000", 2024-04-18T21:05:46.833 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7668999999999999e-05 2024-04-18T21:05:46.833 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.833 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.833 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.833 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616149+0000", 2024-04-18T21:05:46.833 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7047000000000001e-05 2024-04-18T21:05:46.833 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.833 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.833 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:46.833 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619287+0000", 2024-04-18T21:05:46.833 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0031381450000000002 2024-04-18T21:05:46.834 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.834 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.834 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:46.834 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619503+0000", 2024-04-18T21:05:46.834 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000216522 2024-04-18T21:05:46.834 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.834 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.834 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:46.834 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619930+0000", 2024-04-18T21:05:46.834 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00042604900000000001 2024-04-18T21:05:46.834 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.834 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.834 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:46.835 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629281+0000", 2024-04-18T21:05:46.835 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0093512230000000005 2024-04-18T21:05:46.835 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.835 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.835 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:46.835 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646022+0000", 2024-04-18T21:05:46.835 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016741156 2024-04-18T21:05:46.835 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.835 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.835 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:46.835 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646198+0000", 2024-04-18T21:05:46.835 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000176009 2024-04-18T21:05:46.835 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.835 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.836 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:46.836 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646309+0000", 2024-04-18T21:05:46.836 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011112000000000001 2024-04-18T21:05:46.836 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:46.836 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:46.836 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:46.836 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.836 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.836 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:46.836 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:05:46.836 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 41.162848334000003, 2024-04-18T21:05:46.836 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030501176000000001, 2024-04-18T21:05:46.836 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:46.836 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:46.837 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:46.837 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:46.837 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.837 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:46.837 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:05:46.837 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:46.837 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.837 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.837 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:46.837 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:05:46.837 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:46.837 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.837 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.837 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:46.837 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616180+0000", 2024-04-18T21:05:46.838 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1000000000000001e-06 2024-04-18T21:05:46.838 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.838 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.838 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:46.838 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616188+0000", 2024-04-18T21:05:46.838 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4069999999999993e-06 2024-04-18T21:05:46.838 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.838 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.838 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:46.838 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616207+0000", 2024-04-18T21:05:46.838 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8335999999999999e-05 2024-04-18T21:05:46.838 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.838 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.838 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.839 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616225+0000", 2024-04-18T21:05:46.839 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8652999999999999e-05 2024-04-18T21:05:46.839 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.839 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.839 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:46.839 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620977+0000", 2024-04-18T21:05:46.839 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047512220000000003 2024-04-18T21:05:46.839 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.839 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.839 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:46.839 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621279+0000", 2024-04-18T21:05:46.839 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000302646 2024-04-18T21:05:46.839 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.839 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.839 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:46.839 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621584+0000", 2024-04-18T21:05:46.840 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000305142 2024-04-18T21:05:46.840 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.840 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.840 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:46.840 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629352+0000", 2024-04-18T21:05:46.840 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0077673689999999997 2024-04-18T21:05:46.840 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.840 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.840 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:46.840 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646480+0000", 2024-04-18T21:05:46.840 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017128259 2024-04-18T21:05:46.840 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.840 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.840 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:46.840 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646591+0000", 2024-04-18T21:05:46.841 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011113899999999999 2024-04-18T21:05:46.841 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.841 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.841 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:46.841 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646680+0000", 2024-04-18T21:05:46.841 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8902999999999999e-05 2024-04-18T21:05:46.841 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:46.841 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:46.841 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:46.841 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.841 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.841 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:46.841 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:05:46.841 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 41.162781834999997, 2024-04-18T21:05:46.842 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030779760999999999, 2024-04-18T21:05:46.842 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:46.842 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:46.842 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:46.842 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:46.842 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.842 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:46.842 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:05:46.842 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:46.842 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.842 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.842 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:46.842 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:05:46.842 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:46.843 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.843 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.843 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:46.843 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616246+0000", 2024-04-18T21:05:46.843 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0499999999999999e-06 2024-04-18T21:05:46.843 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.843 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.843 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:46.843 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616253+0000", 2024-04-18T21:05:46.843 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.5989999999999998e-06 2024-04-18T21:05:46.843 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.843 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.843 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:46.843 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616273+0000", 2024-04-18T21:05:46.843 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9916999999999999e-05 2024-04-18T21:05:46.843 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.844 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.844 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.844 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616287+0000", 2024-04-18T21:05:46.844 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3669000000000001e-05 2024-04-18T21:05:46.844 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.844 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.844 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:46.844 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622203+0000", 2024-04-18T21:05:46.844 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.005916737 2024-04-18T21:05:46.844 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.844 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.844 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:46.844 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622379+0000", 2024-04-18T21:05:46.844 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000175596 2024-04-18T21:05:46.844 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.845 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.845 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:46.845 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622707+0000", 2024-04-18T21:05:46.845 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00032784600000000002 2024-04-18T21:05:46.845 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.845 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.845 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:46.845 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629366+0000", 2024-04-18T21:05:46.845 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0066593279999999999 2024-04-18T21:05:46.845 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.845 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.845 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:46.845 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646813+0000", 2024-04-18T21:05:46.845 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017447059000000001 2024-04-18T21:05:46.845 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.845 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.845 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:46.846 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646946+0000", 2024-04-18T21:05:46.846 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013301200000000001 2024-04-18T21:05:46.846 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.846 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.846 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:46.846 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647025+0000", 2024-04-18T21:05:46.846 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8948000000000004e-05 2024-04-18T21:05:46.846 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:46.846 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:46.846 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:46.846 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.846 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.846 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:46.847 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:05:46.847 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 41.162698016999997, 2024-04-18T21:05:46.847 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.031512165000000002, 2024-04-18T21:05:46.847 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:46.847 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:46.847 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:46.847 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:46.847 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.847 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:46.847 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:05:46.847 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:46.847 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.847 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.847 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:46.847 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:05:46.847 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:46.848 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.848 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.848 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:46.848 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616330+0000", 2024-04-18T21:05:46.848 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.15e-06 2024-04-18T21:05:46.848 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.848 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.848 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:46.848 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616337+0000", 2024-04-18T21:05:46.848 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.1289999999999998e-06 2024-04-18T21:05:46.848 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.848 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.848 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:46.848 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616447+0000", 2024-04-18T21:05:46.848 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109561 2024-04-18T21:05:46.849 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.849 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.849 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.849 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616496+0000", 2024-04-18T21:05:46.849 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8591999999999998e-05 2024-04-18T21:05:46.849 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.849 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.849 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:46.849 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.623786+0000", 2024-04-18T21:05:46.849 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0072906799999999999 2024-04-18T21:05:46.849 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.849 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.849 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:46.849 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.623973+0000", 2024-04-18T21:05:46.849 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018717199999999999 2024-04-18T21:05:46.849 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.850 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.850 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:46.850 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624260+0000", 2024-04-18T21:05:46.850 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00028630600000000001 2024-04-18T21:05:46.850 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.850 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.850 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:46.850 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629381+0000", 2024-04-18T21:05:46.850 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0051211340000000003 2024-04-18T21:05:46.850 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.850 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.850 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:46.850 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647631+0000", 2024-04-18T21:05:46.851 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018249771000000001 2024-04-18T21:05:46.851 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.851 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.851 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:46.851 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647761+0000", 2024-04-18T21:05:46.851 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013037300000000001 2024-04-18T21:05:46.851 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.851 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.851 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:46.851 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647841+0000", 2024-04-18T21:05:46.851 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.0296999999999994e-05 2024-04-18T21:05:46.852 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:46.852 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:46.852 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:46.852 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.852 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.852 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:46.852 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:05:46.852 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 41.162492532999998, 2024-04-18T21:05:46.852 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043251955000000002, 2024-04-18T21:05:46.852 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:46.852 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:46.852 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:46.852 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:46.852 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.852 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:46.853 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:05:46.853 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:46.853 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.853 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.853 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:46.853 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:05:46.853 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:46.853 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.853 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.853 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:46.853 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616536+0000", 2024-04-18T21:05:46.853 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2869999999999999e-06 2024-04-18T21:05:46.853 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.853 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.853 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:46.853 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616572+0000", 2024-04-18T21:05:46.854 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.6261999999999999e-05 2024-04-18T21:05:46.854 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.854 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.854 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:46.854 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616593+0000", 2024-04-18T21:05:46.854 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1310000000000001e-05 2024-04-18T21:05:46.854 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.854 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.854 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.854 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616614+0000", 2024-04-18T21:05:46.854 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.0936000000000001e-05 2024-04-18T21:05:46.854 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.854 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.854 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:46.854 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629501+0000", 2024-04-18T21:05:46.855 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.012886819000000001 2024-04-18T21:05:46.855 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.855 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.855 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:46.855 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629696+0000", 2024-04-18T21:05:46.855 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019485499999999999 2024-04-18T21:05:46.855 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.855 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.855 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:46.855 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629940+0000", 2024-04-18T21:05:46.855 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00024386399999999999 2024-04-18T21:05:46.855 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.855 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.855 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:46.855 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640100+0000", 2024-04-18T21:05:46.856 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010159645 2024-04-18T21:05:46.856 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.856 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.856 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:46.856 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659516+0000", 2024-04-18T21:05:46.856 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019416563000000001 2024-04-18T21:05:46.856 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.856 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.856 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:46.856 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659684+0000", 2024-04-18T21:05:46.856 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016750900000000001 2024-04-18T21:05:46.856 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.856 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.856 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:46.856 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659787+0000", 2024-04-18T21:05:46.856 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000102905 2024-04-18T21:05:46.857 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:46.857 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:46.857 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:46.857 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.857 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.857 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:46.857 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:05:46.857 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 41.162387410999997, 2024-04-18T21:05:46.857 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043581898000000001, 2024-04-18T21:05:46.857 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:46.857 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:46.857 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:46.857 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:46.857 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.857 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:46.857 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:05:46.858 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:46.858 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.858 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.858 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:46.858 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:05:46.858 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:46.858 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.858 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.858 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:46.858 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616641+0000", 2024-04-18T21:05:46.858 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:05:46.858 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.858 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.858 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:46.859 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616648+0000", 2024-04-18T21:05:46.859 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3860000000000001e-06 2024-04-18T21:05:46.859 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.859 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.859 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:46.859 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616666+0000", 2024-04-18T21:05:46.859 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7583000000000001e-05 2024-04-18T21:05:46.859 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.859 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.859 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.859 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616679+0000", 2024-04-18T21:05:46.859 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3322999999999999e-05 2024-04-18T21:05:46.859 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.859 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.859 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:46.860 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630373+0000", 2024-04-18T21:05:46.860 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013694207999999999 2024-04-18T21:05:46.860 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.860 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.860 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:46.860 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630545+0000", 2024-04-18T21:05:46.860 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000171683 2024-04-18T21:05:46.860 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.860 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.860 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:46.860 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630728+0000", 2024-04-18T21:05:46.860 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000182599 2024-04-18T21:05:46.860 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.860 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.860 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:46.861 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640600+0000", 2024-04-18T21:05:46.861 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0098726119999999994 2024-04-18T21:05:46.861 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.861 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.861 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:46.861 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659927+0000", 2024-04-18T21:05:46.861 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019326724999999999 2024-04-18T21:05:46.861 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.861 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.861 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:46.861 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660112+0000", 2024-04-18T21:05:46.861 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000185203 2024-04-18T21:05:46.861 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.861 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.861 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:46.861 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660222+0000", 2024-04-18T21:05:46.862 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109343 2024-04-18T21:05:46.862 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:46.862 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:46.862 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:46.862 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.862 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.862 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:46.862 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:05:46.862 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 41.161522052999999, 2024-04-18T21:05:46.862 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043121310000000003, 2024-04-18T21:05:46.862 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:46.862 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:46.862 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:46.862 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:46.862 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.863 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:46.863 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:05:46.863 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:46.863 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.863 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.863 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:46.863 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:05:46.863 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:46.863 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.863 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.863 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:46.863 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617506+0000", 2024-04-18T21:05:46.863 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9999999999999995e-07 2024-04-18T21:05:46.863 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.863 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.863 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:46.863 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617513+0000", 2024-04-18T21:05:46.864 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.9700000000000002e-06 2024-04-18T21:05:46.864 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.864 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.864 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:46.864 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617531+0000", 2024-04-18T21:05:46.864 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8105999999999999e-05 2024-04-18T21:05:46.864 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.864 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.864 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.864 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617545+0000", 2024-04-18T21:05:46.864 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3703000000000001e-05 2024-04-18T21:05:46.864 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.864 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.865 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:46.865 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632129+0000", 2024-04-18T21:05:46.865 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.014584135999999999 2024-04-18T21:05:46.865 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.865 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.865 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:46.865 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632361+0000", 2024-04-18T21:05:46.865 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023171800000000001 2024-04-18T21:05:46.865 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.865 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.865 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:46.865 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632804+0000", 2024-04-18T21:05:46.866 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000443549 2024-04-18T21:05:46.866 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.866 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.866 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:46.866 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646340+0000", 2024-04-18T21:05:46.866 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013535902000000001 2024-04-18T21:05:46.866 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.866 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.866 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:46.866 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660363+0000", 2024-04-18T21:05:46.866 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01402318 2024-04-18T21:05:46.866 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.866 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.866 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:46.866 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660523+0000", 2024-04-18T21:05:46.867 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00015989899999999999 2024-04-18T21:05:46.867 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.867 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.867 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:46.867 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660626+0000", 2024-04-18T21:05:46.867 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010314699999999999 2024-04-18T21:05:46.867 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:46.867 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:46.867 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:46.867 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.867 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.867 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:46.867 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:05:46.867 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 41.161382359999998, 2024-04-18T21:05:46.867 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024927483, 2024-04-18T21:05:46.868 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:46.868 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:46.868 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:46.868 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:46.868 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.868 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:46.868 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:05:46.868 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:46.868 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.868 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.868 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:46.868 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:05:46.868 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:46.868 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.869 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.869 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:46.869 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617646+0000", 2024-04-18T21:05:46.869 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3030000000000001e-06 2024-04-18T21:05:46.869 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.869 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.869 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:46.869 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617653+0000", 2024-04-18T21:05:46.869 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7530000000000004e-06 2024-04-18T21:05:46.869 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.869 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.869 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:46.869 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617673+0000", 2024-04-18T21:05:46.869 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9967e-05 2024-04-18T21:05:46.870 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.870 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.870 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.870 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617688+0000", 2024-04-18T21:05:46.870 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5153e-05 2024-04-18T21:05:46.870 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.870 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.870 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:46.870 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619244+0000", 2024-04-18T21:05:46.870 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001555531 2024-04-18T21:05:46.870 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.870 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.870 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:46.871 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619361+0000", 2024-04-18T21:05:46.871 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011784400000000001 2024-04-18T21:05:46.871 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.871 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.871 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:46.871 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619604+0000", 2024-04-18T21:05:46.871 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000243007 2024-04-18T21:05:46.871 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.871 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.871 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:46.871 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.625480+0000", 2024-04-18T21:05:46.871 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0058759349999999997 2024-04-18T21:05:46.872 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.872 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.872 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:46.872 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642342+0000", 2024-04-18T21:05:46.872 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016861373999999998 2024-04-18T21:05:46.872 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.872 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.872 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:46.872 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642484+0000", 2024-04-18T21:05:46.872 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000142423 2024-04-18T21:05:46.872 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.872 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.872 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:46.872 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642572+0000", 2024-04-18T21:05:46.872 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8193000000000001e-05 2024-04-18T21:05:46.873 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:46.873 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:46.873 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:46.873 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.873 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.873 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:46.873 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:05:46.873 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 41.161100857000001, 2024-04-18T21:05:46.873 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024956974999999999, 2024-04-18T21:05:46.873 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:46.873 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:46.873 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:46.874 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:46.874 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.874 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:46.874 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:05:46.874 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:46.874 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.874 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.874 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:46.874 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:05:46.874 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:46.874 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.874 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.874 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:46.875 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617928+0000", 2024-04-18T21:05:46.875 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5430000000000001e-06 2024-04-18T21:05:46.875 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.875 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.875 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:46.875 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617937+0000", 2024-04-18T21:05:46.875 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6629999999999999e-06 2024-04-18T21:05:46.875 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.875 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.875 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:46.875 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617955+0000", 2024-04-18T21:05:46.875 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8749999999999998e-05 2024-04-18T21:05:46.875 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.876 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.876 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.876 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617971+0000", 2024-04-18T21:05:46.876 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.605e-05 2024-04-18T21:05:46.876 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.876 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.876 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:46.876 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621019+0000", 2024-04-18T21:05:46.876 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0030472369999999999 2024-04-18T21:05:46.876 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.876 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.876 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:46.876 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621249+0000", 2024-04-18T21:05:46.876 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000230075 2024-04-18T21:05:46.876 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.876 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.877 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:46.877 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621450+0000", 2024-04-18T21:05:46.877 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020166499999999999 2024-04-18T21:05:46.877 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.877 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.877 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:46.877 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.626233+0000", 2024-04-18T21:05:46.877 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047827390000000003 2024-04-18T21:05:46.877 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.877 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.877 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:46.877 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642693+0000", 2024-04-18T21:05:46.877 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01645961 2024-04-18T21:05:46.877 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.877 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.877 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:46.878 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642798+0000", 2024-04-18T21:05:46.878 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010559499999999999 2024-04-18T21:05:46.878 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.878 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.878 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:46.878 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642883+0000", 2024-04-18T21:05:46.878 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5048000000000003e-05 2024-04-18T21:05:46.878 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:46.878 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:46.878 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:46.878 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.878 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.878 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:46.879 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:05:46.879 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 41.159405229000001, 2024-04-18T21:05:46.879 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024086478000000001, 2024-04-18T21:05:46.879 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:46.879 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:46.879 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:46.879 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:46.879 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.879 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:46.879 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:05:46.879 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:46.879 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.879 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.879 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:46.880 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:05:46.880 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:46.880 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.880 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.880 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:46.880 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619624+0000", 2024-04-18T21:05:46.880 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.75e-06 2024-04-18T21:05:46.880 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.880 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.880 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:46.880 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619637+0000", 2024-04-18T21:05:46.880 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3540000000000001e-05 2024-04-18T21:05:46.881 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.881 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.881 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:46.881 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619666+0000", 2024-04-18T21:05:46.881 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8685999999999999e-05 2024-04-18T21:05:46.881 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.881 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.881 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.881 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619685+0000", 2024-04-18T21:05:46.881 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8681999999999998e-05 2024-04-18T21:05:46.881 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.881 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.881 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:46.881 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622275+0000", 2024-04-18T21:05:46.882 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0025899260000000002 2024-04-18T21:05:46.882 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.882 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.882 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:46.882 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622572+0000", 2024-04-18T21:05:46.882 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00029722 2024-04-18T21:05:46.882 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.882 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.882 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:46.882 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622752+0000", 2024-04-18T21:05:46.882 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018065900000000001 2024-04-18T21:05:46.882 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.882 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.882 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:46.883 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.626326+0000", 2024-04-18T21:05:46.883 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035737310000000001 2024-04-18T21:05:46.883 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.883 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.883 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:46.883 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643565+0000", 2024-04-18T21:05:46.883 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017238430999999999 2024-04-18T21:05:46.883 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.883 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.883 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:46.883 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643646+0000", 2024-04-18T21:05:46.883 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.1481000000000001e-05 2024-04-18T21:05:46.883 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.883 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.884 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:46.884 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643708+0000", 2024-04-18T21:05:46.884 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.2372000000000005e-05 2024-04-18T21:05:46.884 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:46.884 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:46.884 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:46.884 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.884 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.884 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:46.884 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:05:46.884 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 41.159239075999999, 2024-04-18T21:05:46.884 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026822450000000001, 2024-04-18T21:05:46.884 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:46.884 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:46.884 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:46.884 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:46.885 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.885 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:46.885 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:05:46.885 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:46.885 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.885 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.885 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:46.885 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:05:46.885 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:46.885 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.885 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.885 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:46.885 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619789+0000", 2024-04-18T21:05:46.885 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:05:46.885 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.885 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.886 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:46.886 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619797+0000", 2024-04-18T21:05:46.886 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.6899999999999992e-06 2024-04-18T21:05:46.886 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.886 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.886 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:46.886 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619816+0000", 2024-04-18T21:05:46.886 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9352999999999999e-05 2024-04-18T21:05:46.886 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.886 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.886 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.886 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619832+0000", 2024-04-18T21:05:46.886 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6013000000000001e-05 2024-04-18T21:05:46.887 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.887 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.887 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:46.887 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620528+0000", 2024-04-18T21:05:46.887 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00069565600000000001 2024-04-18T21:05:46.887 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.887 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.887 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:46.887 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620735+0000", 2024-04-18T21:05:46.887 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000207025 2024-04-18T21:05:46.887 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.887 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.887 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:46.887 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620912+0000", 2024-04-18T21:05:46.887 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017748199999999999 2024-04-18T21:05:46.888 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.888 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.888 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:46.888 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.625605+0000", 2024-04-18T21:05:46.888 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0046924439999999996 2024-04-18T21:05:46.888 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.888 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.888 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:46.888 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646349+0000", 2024-04-18T21:05:46.888 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.020744318000000001 2024-04-18T21:05:46.888 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.888 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.888 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:46.888 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646483+0000", 2024-04-18T21:05:46.889 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013428999999999999 2024-04-18T21:05:46.889 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.889 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.889 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:46.889 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646611+0000", 2024-04-18T21:05:46.889 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012710299999999999 2024-04-18T21:05:46.889 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:46.889 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:46.889 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:46.889 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.889 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.889 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:46.889 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:05:46.889 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 41.158568643000002, 2024-04-18T21:05:46.889 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023516516000000001, 2024-04-18T21:05:46.889 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:46.890 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:46.890 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:05:46.890 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:46.890 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.890 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:46.890 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:05:46.890 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:46.890 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.890 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.890 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:46.890 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:05:46.890 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:46.890 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.890 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.891 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:46.891 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620460+0000", 2024-04-18T21:05:46.891 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.787e-06 2024-04-18T21:05:46.891 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.891 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.891 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:46.891 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620470+0000", 2024-04-18T21:05:46.891 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.2560000000000008e-06 2024-04-18T21:05:46.891 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.891 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.891 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:46.891 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620496+0000", 2024-04-18T21:05:46.891 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.6205999999999999e-05 2024-04-18T21:05:46.891 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.891 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.891 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:46.892 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620517+0000", 2024-04-18T21:05:46.892 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1223e-05 2024-04-18T21:05:46.892 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.892 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.892 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:46.892 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624060+0000", 2024-04-18T21:05:46.892 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035434160000000002 2024-04-18T21:05:46.892 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.892 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.892 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:46.892 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624390+0000", 2024-04-18T21:05:46.892 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00033000500000000002 2024-04-18T21:05:46.892 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:46.892 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:46.892 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:46.892 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643975+0000", 2024-04-18T21:05:46.892 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019584622999999999 2024-04-18T21:05:46.893 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:46.893 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:46.893 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:46.893 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:46.893 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:46.893 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:05:46.894 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:05:46.895 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:46.895+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:46.995 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:46.995+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:47.026 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:05:47.026 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [], 2024-04-18T21:05:47.026 INFO:teuthology.orchestra.run.smithi150.stdout: "num_ops": 0 2024-04-18T21:05:47.026 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:05:47.042 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:05:47.096 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:47.095+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:47.197 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:47.199+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:47.204 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:05:47.204 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [], 2024-04-18T21:05:47.205 INFO:teuthology.orchestra.run.smithi150.stdout: "complaint_time": 30, 2024-04-18T21:05:47.205 INFO:teuthology.orchestra.run.smithi150.stdout: "num_blocked_ops": 0 2024-04-18T21:05:47.205 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:05:47.219 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:05:47.298 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:47.299+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:47.346 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:05:47.346 INFO:teuthology.orchestra.run.smithi150.stdout: "size": 20, 2024-04-18T21:05:47.346 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 600, 2024-04-18T21:05:47.346 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [ 2024-04-18T21:05:47.346 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.346 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-18T21:05:47.346 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:05:47.346 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 52.541517081999999, 2024-04-18T21:05:47.346 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0093051590000000003, 2024-04-18T21:05:47.346 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:47.346 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:47.347 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:47.347 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:47.347 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.347 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:47.347 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:05:47.347 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:47.347 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.347 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.347 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:47.347 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:05:47.347 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:47.347 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.347 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.347 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:47.347 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804851+0000", 2024-04-18T21:05:47.348 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7039999999999999e-06 2024-04-18T21:05:47.348 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.348 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.348 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:47.348 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804864+0000", 2024-04-18T21:05:47.348 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.276e-05 2024-04-18T21:05:47.348 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.348 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.348 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:47.348 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804895+0000", 2024-04-18T21:05:47.348 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.1204999999999997e-05 2024-04-18T21:05:47.348 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.348 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.348 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:47.349 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804908+0000", 2024-04-18T21:05:47.349 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3317e-05 2024-04-18T21:05:47.349 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.349 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.349 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:47.349 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805131+0000", 2024-04-18T21:05:47.349 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00022246700000000001 2024-04-18T21:05:47.349 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.349 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.349 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:47.349 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805171+0000", 2024-04-18T21:05:47.349 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.0164999999999999e-05 2024-04-18T21:05:47.349 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.349 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.349 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:47.350 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814086+0000", 2024-04-18T21:05:47.350 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0089155329999999998 2024-04-18T21:05:47.350 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.350 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.350 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:47.350 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814154+0000", 2024-04-18T21:05:47.350 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.8008000000000003e-05 2024-04-18T21:05:47.350 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:47.350 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:47.350 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:47.350 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.350 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.350 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-18T21:05:47.350 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:05:47.351 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 52.540751888999999, 2024-04-18T21:05:47.351 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0086469770000000001, 2024-04-18T21:05:47.351 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:47.351 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:47.351 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:47.351 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:47.351 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.351 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:47.351 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:05:47.351 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:47.351 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.351 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.351 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:47.351 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:05:47.351 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:47.351 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.352 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.352 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:47.352 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805616+0000", 2024-04-18T21:05:47.352 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7799999999999999e-06 2024-04-18T21:05:47.352 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.352 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.352 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:47.352 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805707+0000", 2024-04-18T21:05:47.352 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0917999999999999e-05 2024-04-18T21:05:47.352 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.352 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.352 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:47.352 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805739+0000", 2024-04-18T21:05:47.353 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.2512000000000003e-05 2024-04-18T21:05:47.353 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.353 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.353 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:47.353 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805763+0000", 2024-04-18T21:05:47.353 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3266000000000001e-05 2024-04-18T21:05:47.353 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.353 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.353 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:47.353 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.806024+0000", 2024-04-18T21:05:47.353 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000261716 2024-04-18T21:05:47.353 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.353 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.353 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:47.353 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.806073+0000", 2024-04-18T21:05:47.354 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.8844999999999997e-05 2024-04-18T21:05:47.354 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.354 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.354 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:47.354 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814162+0000", 2024-04-18T21:05:47.354 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0080882860000000001 2024-04-18T21:05:47.354 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.354 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.354 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:47.354 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814261+0000", 2024-04-18T21:05:47.354 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.9654000000000005e-05 2024-04-18T21:05:47.354 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:47.354 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:47.354 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:47.354 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.355 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.355 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'64)", 2024-04-18T21:05:47.355 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:05:47.355 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 52.538980844999998, 2024-04-18T21:05:47.355 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0089721509999999994, 2024-04-18T21:05:47.355 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:47.355 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:47.355 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:47.355 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:47.355 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.355 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:47.355 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:05:47.355 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:47.355 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.356 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.356 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:47.356 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:05:47.356 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:47.356 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.356 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.356 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:47.356 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807387+0000", 2024-04-18T21:05:47.356 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.0329999999999998e-06 2024-04-18T21:05:47.356 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.356 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.356 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:47.356 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807443+0000", 2024-04-18T21:05:47.356 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.5376e-05 2024-04-18T21:05:47.357 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.357 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.357 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:47.357 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807467+0000", 2024-04-18T21:05:47.357 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.4621999999999999e-05 2024-04-18T21:05:47.357 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.357 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.357 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:47.357 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807482+0000", 2024-04-18T21:05:47.357 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.436e-05 2024-04-18T21:05:47.357 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.357 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.357 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:47.357 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.809243+0000", 2024-04-18T21:05:47.357 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001761725 2024-04-18T21:05:47.357 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.358 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.358 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:47.358 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.809295+0000", 2024-04-18T21:05:47.358 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.1445e-05 2024-04-18T21:05:47.358 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.358 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.358 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:47.358 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.816293+0000", 2024-04-18T21:05:47.358 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0069981749999999997 2024-04-18T21:05:47.358 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.358 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.358 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:47.358 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.816357+0000", 2024-04-18T21:05:47.358 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.4414999999999999e-05 2024-04-18T21:05:47.359 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:47.359 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:47.359 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:47.359 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.359 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.359 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:47.359 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:05:47.359 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 41.731071475, 2024-04-18T21:05:47.359 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.040843365, 2024-04-18T21:05:47.359 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:47.359 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:47.359 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:47.359 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:47.359 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.360 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:47.360 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:05:47.360 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:47.360 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.360 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.360 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:47.360 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:05:47.360 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:47.360 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.360 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.360 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:47.360 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615297+0000", 2024-04-18T21:05:47.360 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2800000000000002e-06 2024-04-18T21:05:47.361 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.361 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.361 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:47.361 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615308+0000", 2024-04-18T21:05:47.361 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0813e-05 2024-04-18T21:05:47.361 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.361 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.361 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:47.361 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615330+0000", 2024-04-18T21:05:47.361 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2370000000000001e-05 2024-04-18T21:05:47.361 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.361 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.361 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:47.361 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615346+0000", 2024-04-18T21:05:47.361 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6200000000000001e-05 2024-04-18T21:05:47.361 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.362 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.362 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:47.362 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615470+0000", 2024-04-18T21:05:47.362 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012385799999999999 2024-04-18T21:05:47.362 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.362 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.362 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:05:47.362 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615488+0000", 2024-04-18T21:05:47.362 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7923000000000001e-05 2024-04-18T21:05:47.362 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.362 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.362 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:47.362 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.630993+0000", 2024-04-18T21:05:47.362 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.01550532 2024-04-18T21:05:47.363 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.363 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.363 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:47.363 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631165+0000", 2024-04-18T21:05:47.363 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000171588 2024-04-18T21:05:47.363 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.363 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.363 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:47.363 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631320+0000", 2024-04-18T21:05:47.363 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000155162 2024-04-18T21:05:47.363 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.363 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.363 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:47.363 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635157+0000", 2024-04-18T21:05:47.363 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0038370790000000002 2024-04-18T21:05:47.363 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.364 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.364 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:47.364 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.655904+0000", 2024-04-18T21:05:47.364 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.020746483999999999 2024-04-18T21:05:47.364 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.364 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.364 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:47.364 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656032+0000", 2024-04-18T21:05:47.364 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012864199999999999 2024-04-18T21:05:47.364 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.364 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.364 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:47.364 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656138+0000", 2024-04-18T21:05:47.364 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000105646 2024-04-18T21:05:47.364 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:47.364 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:47.365 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:47.365 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.365 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.365 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:47.365 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:05:47.365 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 41.730979302999998, 2024-04-18T21:05:47.365 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.041266444999999999, 2024-04-18T21:05:47.365 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:47.365 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:47.365 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:47.365 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:47.365 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.365 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:47.365 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:05:47.366 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:47.366 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.366 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.366 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:47.366 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:05:47.366 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:47.366 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.366 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.366 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:47.366 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615388+0000", 2024-04-18T21:05:47.366 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:05:47.366 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.366 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.366 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:47.366 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:05:47.367 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.7299999999999994e-06 2024-04-18T21:05:47.367 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.367 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.367 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:47.367 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615415+0000", 2024-04-18T21:05:47.367 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7807000000000001e-05 2024-04-18T21:05:47.367 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.367 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.367 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:47.367 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615431+0000", 2024-04-18T21:05:47.367 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6127e-05 2024-04-18T21:05:47.367 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.367 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.367 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:47.367 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615621+0000", 2024-04-18T21:05:47.368 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000189781 2024-04-18T21:05:47.368 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.368 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.368 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:47.368 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615634+0000", 2024-04-18T21:05:47.368 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3383e-05 2024-04-18T21:05:47.368 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.368 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.368 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:47.368 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631703+0000", 2024-04-18T21:05:47.368 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016068737 2024-04-18T21:05:47.368 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.368 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.368 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:47.368 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631809+0000", 2024-04-18T21:05:47.369 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000106823 2024-04-18T21:05:47.369 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.369 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.369 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:47.369 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631988+0000", 2024-04-18T21:05:47.369 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000179008 2024-04-18T21:05:47.369 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.369 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.369 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:47.369 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635172+0000", 2024-04-18T21:05:47.369 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.003183029 2024-04-18T21:05:47.369 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.369 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.369 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:47.369 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656392+0000", 2024-04-18T21:05:47.370 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.021220638999999999 2024-04-18T21:05:47.370 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.370 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.370 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:47.370 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656533+0000", 2024-04-18T21:05:47.370 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014126500000000001 2024-04-18T21:05:47.370 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.370 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.370 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:47.370 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656653+0000", 2024-04-18T21:05:47.370 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000119883 2024-04-18T21:05:47.370 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:47.370 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:47.370 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:47.370 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.370 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.371 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:47.371 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:05:47.371 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 41.730891880000001, 2024-04-18T21:05:47.371 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.042492302000000003, 2024-04-18T21:05:47.371 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:47.371 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:47.371 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:47.371 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:47.371 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.371 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:47.371 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:05:47.371 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:47.371 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.371 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.371 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:47.371 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:05:47.372 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:47.372 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.372 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.372 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:47.372 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615475+0000", 2024-04-18T21:05:47.372 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.17e-06 2024-04-18T21:05:47.372 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.372 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.372 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:47.372 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615528+0000", 2024-04-18T21:05:47.372 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.2159e-05 2024-04-18T21:05:47.372 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.372 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.372 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:47.373 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615542+0000", 2024-04-18T21:05:47.373 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4197e-05 2024-04-18T21:05:47.373 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.373 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.373 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:47.373 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615559+0000", 2024-04-18T21:05:47.373 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.749e-05 2024-04-18T21:05:47.373 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.373 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.373 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:47.373 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615685+0000", 2024-04-18T21:05:47.373 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012617499999999999 2024-04-18T21:05:47.373 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.373 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.374 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:05:47.374 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:05:47.374 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4749999999999999e-05 2024-04-18T21:05:47.374 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.374 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.374 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:47.374 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632332+0000", 2024-04-18T21:05:47.374 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016631988 2024-04-18T21:05:47.374 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.374 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.374 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:47.374 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632477+0000", 2024-04-18T21:05:47.374 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014437200000000001 2024-04-18T21:05:47.375 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.375 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.375 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:47.375 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632620+0000", 2024-04-18T21:05:47.375 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000143566 2024-04-18T21:05:47.375 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.375 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.375 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:47.375 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635185+0000", 2024-04-18T21:05:47.375 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0025644209999999999 2024-04-18T21:05:47.375 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.375 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.376 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:47.376 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657803+0000", 2024-04-18T21:05:47.376 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.022618743 2024-04-18T21:05:47.376 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.376 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.376 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:47.376 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657890+0000", 2024-04-18T21:05:47.376 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.6688999999999996e-05 2024-04-18T21:05:47.376 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.376 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.376 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:47.376 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657967+0000", 2024-04-18T21:05:47.377 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.6582000000000006e-05 2024-04-18T21:05:47.377 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:47.377 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:47.377 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:47.377 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.377 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.377 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:47.377 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:05:47.377 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 41.730761068, 2024-04-18T21:05:47.377 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.043603435000000003, 2024-04-18T21:05:47.377 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:47.377 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:47.377 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:47.377 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:47.377 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.377 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:47.378 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:05:47.378 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:47.378 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.378 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.378 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:47.378 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:05:47.378 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:47.378 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.378 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.378 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:47.378 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615607+0000", 2024-04-18T21:05:47.378 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4300000000000001e-06 2024-04-18T21:05:47.378 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.379 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.379 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:47.379 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615614+0000", 2024-04-18T21:05:47.379 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.4100000000000002e-06 2024-04-18T21:05:47.379 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.379 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.379 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:47.379 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615632+0000", 2024-04-18T21:05:47.379 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7863000000000002e-05 2024-04-18T21:05:47.379 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.379 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.379 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:47.379 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615647+0000", 2024-04-18T21:05:47.379 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5187e-05 2024-04-18T21:05:47.380 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.380 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.380 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:47.380 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615765+0000", 2024-04-18T21:05:47.380 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000117955 2024-04-18T21:05:47.380 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.380 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.380 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:47.380 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615781+0000", 2024-04-18T21:05:47.380 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6123000000000001e-05 2024-04-18T21:05:47.380 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.380 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.380 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:47.380 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633055+0000", 2024-04-18T21:05:47.380 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.017273909 2024-04-18T21:05:47.380 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.381 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.381 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:47.381 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633254+0000", 2024-04-18T21:05:47.381 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00019903799999999999 2024-04-18T21:05:47.381 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.381 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.381 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:47.381 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633624+0000", 2024-04-18T21:05:47.381 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000369656 2024-04-18T21:05:47.381 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.381 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.381 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:47.381 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635595+0000", 2024-04-18T21:05:47.381 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001971287 2024-04-18T21:05:47.382 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.382 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.382 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:47.382 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659026+0000", 2024-04-18T21:05:47.382 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.023431495 2024-04-18T21:05:47.382 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.382 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.382 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:47.382 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659117+0000", 2024-04-18T21:05:47.382 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0885999999999997e-05 2024-04-18T21:05:47.382 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.382 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.382 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:47.382 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659209+0000", 2024-04-18T21:05:47.383 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.1195999999999999e-05 2024-04-18T21:05:47.383 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:47.383 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:47.383 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:47.383 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.383 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.383 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:47.383 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:47.383 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 41.730695838999999, 2024-04-18T21:05:47.383 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.03492514, 2024-04-18T21:05:47.383 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:47.383 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:47.383 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:47.383 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:47.384 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.384 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:47.384 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:47.384 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:47.384 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.384 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.384 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:47.384 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:47.384 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:47.384 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.384 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.384 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:47.384 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:05:47.384 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.407e-06 2024-04-18T21:05:47.384 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.385 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.385 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:47.385 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615679+0000", 2024-04-18T21:05:47.385 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.2130000000000002e-06 2024-04-18T21:05:47.385 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.385 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.385 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:47.385 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615701+0000", 2024-04-18T21:05:47.385 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2316000000000001e-05 2024-04-18T21:05:47.385 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.385 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.385 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:47.385 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615717+0000", 2024-04-18T21:05:47.385 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6197000000000001e-05 2024-04-18T21:05:47.386 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.386 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.386 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:47.386 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615828+0000", 2024-04-18T21:05:47.386 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000110899 2024-04-18T21:05:47.386 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.386 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.386 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:05:47.386 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615840+0000", 2024-04-18T21:05:47.386 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.1423000000000001e-05 2024-04-18T21:05:47.386 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.386 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.386 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:47.386 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628046+0000", 2024-04-18T21:05:47.387 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.012206295000000001 2024-04-18T21:05:47.387 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.387 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.387 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:47.387 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628323+0000", 2024-04-18T21:05:47.387 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00027658700000000001 2024-04-18T21:05:47.387 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.387 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.387 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:47.387 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628599+0000", 2024-04-18T21:05:47.387 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00027676699999999997 2024-04-18T21:05:47.387 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.387 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.388 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:47.388 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634869+0000", 2024-04-18T21:05:47.388 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.006269536 2024-04-18T21:05:47.388 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.388 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.388 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:47.388 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650333+0000", 2024-04-18T21:05:47.388 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.015463645999999999 2024-04-18T21:05:47.388 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.388 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.388 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:47.388 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650474+0000", 2024-04-18T21:05:47.388 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014091799999999999 2024-04-18T21:05:47.388 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.388 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.389 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:47.389 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650595+0000", 2024-04-18T21:05:47.389 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012193600000000001 2024-04-18T21:05:47.389 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:47.389 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:47.389 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:47.389 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.389 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.389 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:47.389 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:05:47.389 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 41.730610730000002, 2024-04-18T21:05:47.389 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.040588320999999997, 2024-04-18T21:05:47.389 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:47.389 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:47.390 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:47.390 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:47.390 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.390 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:47.390 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:05:47.390 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:47.390 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.390 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.390 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:47.390 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:05:47.390 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:47.390 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.390 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.391 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:47.391 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615757+0000", 2024-04-18T21:05:47.391 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2270000000000001e-06 2024-04-18T21:05:47.391 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.391 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.391 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:47.391 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615765+0000", 2024-04-18T21:05:47.391 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.9400000000000002e-06 2024-04-18T21:05:47.391 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.391 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.391 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:47.391 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615785+0000", 2024-04-18T21:05:47.391 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.0749000000000001e-05 2024-04-18T21:05:47.391 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.391 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.392 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:47.392 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615804+0000", 2024-04-18T21:05:47.392 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.8774e-05 2024-04-18T21:05:47.392 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.392 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.392 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:47.392 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615888+0000", 2024-04-18T21:05:47.392 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.4111999999999997e-05 2024-04-18T21:05:47.392 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.392 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.392 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:47.392 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615895+0000", 2024-04-18T21:05:47.392 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.0469999999999996e-06 2024-04-18T21:05:47.392 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.392 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.392 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:47.393 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629280+0000", 2024-04-18T21:05:47.393 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.013384416 2024-04-18T21:05:47.393 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.393 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.393 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:47.393 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629488+0000", 2024-04-18T21:05:47.393 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00020852800000000001 2024-04-18T21:05:47.393 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.393 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.393 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:47.393 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629869+0000", 2024-04-18T21:05:47.393 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00038042300000000001 2024-04-18T21:05:47.393 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.393 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.393 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:47.394 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635041+0000", 2024-04-18T21:05:47.394 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.005172383 2024-04-18T21:05:47.394 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.394 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.394 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:47.394 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656125+0000", 2024-04-18T21:05:47.394 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.021084025999999999 2024-04-18T21:05:47.394 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.394 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.394 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:47.394 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656240+0000", 2024-04-18T21:05:47.394 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000115352 2024-04-18T21:05:47.394 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.394 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.395 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:47.395 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656344+0000", 2024-04-18T21:05:47.395 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00010334400000000001 2024-04-18T21:05:47.395 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:47.395 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:47.395 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:47.395 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.395 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.395 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:47.395 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:05:47.395 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 41.730543410000003, 2024-04-18T21:05:47.395 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.043549577999999999, 2024-04-18T21:05:47.395 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:47.395 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:47.396 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:47.396 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:47.396 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.396 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:47.396 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:05:47.396 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:47.396 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.396 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.396 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:47.396 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:05:47.396 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:47.396 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.396 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.396 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:47.396 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:05:47.397 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.5000000000000002e-07 2024-04-18T21:05:47.397 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.397 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.397 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:47.397 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615828+0000", 2024-04-18T21:05:47.397 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.2359999999999998e-06 2024-04-18T21:05:47.397 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.397 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.397 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:47.397 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615838+0000", 2024-04-18T21:05:47.397 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0087e-05 2024-04-18T21:05:47.397 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.397 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.397 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:47.398 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615846+0000", 2024-04-18T21:05:47.398 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.67e-06 2024-04-18T21:05:47.398 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.398 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.398 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:47.398 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615963+0000", 2024-04-18T21:05:47.398 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00011630500000000001 2024-04-18T21:05:47.398 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.398 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.398 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:47.398 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615979+0000", 2024-04-18T21:05:47.398 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.613e-05 2024-04-18T21:05:47.398 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.398 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.399 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:47.399 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632392+0000", 2024-04-18T21:05:47.399 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016413317 2024-04-18T21:05:47.399 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.399 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.399 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:47.399 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632568+0000", 2024-04-18T21:05:47.399 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00017539500000000001 2024-04-18T21:05:47.399 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.399 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.399 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:47.399 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632748+0000", 2024-04-18T21:05:47.399 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00017991799999999999 2024-04-18T21:05:47.399 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.400 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.400 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:47.400 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635542+0000", 2024-04-18T21:05:47.400 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00279481 2024-04-18T21:05:47.400 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.400 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.400 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:47.400 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659232+0000", 2024-04-18T21:05:47.400 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.023689212000000001 2024-04-18T21:05:47.400 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.400 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.400 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:47.400 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659314+0000", 2024-04-18T21:05:47.401 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.2528999999999995e-05 2024-04-18T21:05:47.401 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.401 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.401 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:47.401 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659372+0000", 2024-04-18T21:05:47.401 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.8218999999999999e-05 2024-04-18T21:05:47.401 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:47.401 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:47.401 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:47.401 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.401 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.401 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:47.401 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:05:47.401 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 41.730481978, 2024-04-18T21:05:47.401 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.039335347, 2024-04-18T21:05:47.402 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:47.402 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:47.402 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "started", 2024-04-18T21:05:47.402 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:47.402 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.402 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:47.402 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:05:47.402 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:47.402 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.402 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.402 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:47.402 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:05:47.403 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:47.403 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.403 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.403 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:47.403 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615885+0000", 2024-04-18T21:05:47.403 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2699999999999999e-06 2024-04-18T21:05:47.403 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.403 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.403 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:47.403 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615892+0000", 2024-04-18T21:05:47.403 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.6499999999999999e-06 2024-04-18T21:05:47.403 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.403 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.404 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:47.404 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615906+0000", 2024-04-18T21:05:47.404 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.393e-05 2024-04-18T21:05:47.404 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.404 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.404 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:47.404 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615919+0000", 2024-04-18T21:05:47.404 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2860000000000001e-05 2024-04-18T21:05:47.404 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.404 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.404 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:47.404 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616027+0000", 2024-04-18T21:05:47.404 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000107852 2024-04-18T21:05:47.404 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.404 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.405 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:05:47.405 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616037+0000", 2024-04-18T21:05:47.405 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:05:47.405 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.405 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.405 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:47.405 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622719+0000", 2024-04-18T21:05:47.405 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0066817220000000002 2024-04-18T21:05:47.405 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.405 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.405 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:47.405 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623006+0000", 2024-04-18T21:05:47.405 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00028783699999999999 2024-04-18T21:05:47.405 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.405 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.405 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:47.406 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.655220+0000", 2024-04-18T21:05:47.406 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.032213036 2024-04-18T21:05:47.406 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:47.406 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:47.406 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:47.406 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.406 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.406 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:47.406 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:47.406 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 41.730426305000002, 2024-04-18T21:05:47.406 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.032845253999999997, 2024-04-18T21:05:47.406 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:47.406 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:47.407 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "started", 2024-04-18T21:05:47.407 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:47.407 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.407 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:47.407 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:47.407 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:47.407 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.407 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.407 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:47.407 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:47.407 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:47.407 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.407 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.407 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:47.407 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615942+0000", 2024-04-18T21:05:47.408 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.717e-06 2024-04-18T21:05:47.408 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.408 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.408 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:47.408 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615946+0000", 2024-04-18T21:05:47.408 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.6e-06 2024-04-18T21:05:47.408 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.408 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.408 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:47.408 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615960+0000", 2024-04-18T21:05:47.408 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:05:47.408 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.408 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.408 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:47.408 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615968+0000", 2024-04-18T21:05:47.408 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.9070000000000007e-06 2024-04-18T21:05:47.409 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.409 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.409 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:47.409 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616100+0000", 2024-04-18T21:05:47.409 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000132402 2024-04-18T21:05:47.409 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.409 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.409 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:05:47.409 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616117+0000", 2024-04-18T21:05:47.409 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6653000000000001e-05 2024-04-18T21:05:47.409 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.409 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.409 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:47.409 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621566+0000", 2024-04-18T21:05:47.410 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0054497740000000001 2024-04-18T21:05:47.410 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.410 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.410 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:47.410 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622801+0000", 2024-04-18T21:05:47.410 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0012345710000000001 2024-04-18T21:05:47.410 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.410 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.410 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:47.410 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648785+0000", 2024-04-18T21:05:47.410 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.025984104000000001 2024-04-18T21:05:47.410 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:47.410 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:47.411 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:47.411 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.411 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.411 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:47.411 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:05:47.411 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 41.724574955000001, 2024-04-18T21:05:47.411 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.011561350999999999, 2024-04-18T21:05:47.411 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:47.411 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:47.411 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:47.411 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:47.411 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.411 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:47.412 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:05:47.412 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:47.412 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.412 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.412 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:47.412 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:05:47.412 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:47.412 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.412 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.412 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:47.412 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621792+0000", 2024-04-18T21:05:47.412 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.4000000000000001e-07 2024-04-18T21:05:47.412 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.413 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.413 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:47.413 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:05:47.413 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.1050000000000002e-05 2024-04-18T21:05:47.413 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.413 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.413 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:47.413 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622608+0000", 2024-04-18T21:05:47.413 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00077505900000000003 2024-04-18T21:05:47.413 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.413 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.413 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:47.413 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623879+0000", 2024-04-18T21:05:47.413 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0012705839999999999 2024-04-18T21:05:47.413 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.414 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.414 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:47.414 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624010+0000", 2024-04-18T21:05:47.414 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00013176900000000001 2024-04-18T21:05:47.414 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.414 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.414 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:47.414 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624058+0000", 2024-04-18T21:05:47.414 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.7299000000000002e-05 2024-04-18T21:05:47.414 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.414 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.414 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:47.414 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633262+0000", 2024-04-18T21:05:47.415 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0092048770000000002 2024-04-18T21:05:47.415 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.415 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.415 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:47.415 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633353+0000", 2024-04-18T21:05:47.415 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0073000000000003e-05 2024-04-18T21:05:47.415 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:47.415 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:47.415 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:47.415 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.415 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.415 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:47.415 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:05:47.415 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 41.722447569000003, 2024-04-18T21:05:47.415 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0098419370000000003, 2024-04-18T21:05:47.416 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:47.416 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:47.416 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:47.416 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:47.416 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.416 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:47.416 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:05:47.416 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:47.416 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.416 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.416 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:47.416 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:05:47.416 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:47.416 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.416 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.417 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:47.417 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623920+0000", 2024-04-18T21:05:47.417 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2240000000000001e-06 2024-04-18T21:05:47.417 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.417 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.417 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:47.417 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623933+0000", 2024-04-18T21:05:47.417 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3653e-05 2024-04-18T21:05:47.417 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.417 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.417 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:47.417 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623956+0000", 2024-04-18T21:05:47.417 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2059e-05 2024-04-18T21:05:47.417 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.417 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.417 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:47.418 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623975+0000", 2024-04-18T21:05:47.418 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.9806999999999999e-05 2024-04-18T21:05:47.418 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.418 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.418 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:47.418 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626943+0000", 2024-04-18T21:05:47.418 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0029681579999999998 2024-04-18T21:05:47.418 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.418 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.418 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:47.418 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626993+0000", 2024-04-18T21:05:47.418 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.9935999999999998e-05 2024-04-18T21:05:47.418 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.419 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.419 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:47.419 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633665+0000", 2024-04-18T21:05:47.419 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0066719250000000004 2024-04-18T21:05:47.419 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.419 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.419 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:47.419 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633761+0000", 2024-04-18T21:05:47.419 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.5174999999999996e-05 2024-04-18T21:05:47.419 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:47.419 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:47.419 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:47.419 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.419 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.419 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:47.420 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:05:47.420 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 41.72161595, 2024-04-18T21:05:47.420 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0090159079999999996, 2024-04-18T21:05:47.420 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:47.420 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:47.420 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:47.420 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:47.420 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.420 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:47.420 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:05:47.420 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:47.420 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.420 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.421 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:47.421 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:05:47.421 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:47.421 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.421 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.421 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:47.421 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624751+0000", 2024-04-18T21:05:47.421 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.7600000000000006e-07 2024-04-18T21:05:47.421 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.421 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.421 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:47.421 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624787+0000", 2024-04-18T21:05:47.422 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.6273000000000003e-05 2024-04-18T21:05:47.422 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.422 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.422 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:47.422 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625837+0000", 2024-04-18T21:05:47.422 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00104992 2024-04-18T21:05:47.422 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.422 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.422 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:47.422 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625860+0000", 2024-04-18T21:05:47.422 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3110000000000001e-05 2024-04-18T21:05:47.422 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.422 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.423 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:47.423 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625984+0000", 2024-04-18T21:05:47.423 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012399199999999999 2024-04-18T21:05:47.423 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.423 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.423 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:47.423 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626030+0000", 2024-04-18T21:05:47.423 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.5429999999999997e-05 2024-04-18T21:05:47.423 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.423 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.423 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:47.423 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633643+0000", 2024-04-18T21:05:47.423 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0076129320000000002 2024-04-18T21:05:47.424 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.424 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.424 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:47.424 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633766+0000", 2024-04-18T21:05:47.424 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000123275 2024-04-18T21:05:47.424 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:47.424 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:47.424 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:47.424 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.424 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.424 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:47.424 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:05:47.424 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 41.720362225999999, 2024-04-18T21:05:47.424 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0088669170000000002, 2024-04-18T21:05:47.424 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:47.425 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:47.425 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:47.425 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:47.425 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.425 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:47.425 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:05:47.425 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:47.425 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.425 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.425 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:47.425 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:05:47.425 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:47.426 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.426 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.426 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:47.426 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626005+0000", 2024-04-18T21:05:47.426 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.5000000000000001e-07 2024-04-18T21:05:47.426 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.426 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.426 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:47.426 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626028+0000", 2024-04-18T21:05:47.426 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2756999999999999e-05 2024-04-18T21:05:47.426 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.426 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.427 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:47.427 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626050+0000", 2024-04-18T21:05:47.427 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2140000000000001e-05 2024-04-18T21:05:47.427 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.427 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.427 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:47.427 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626065+0000", 2024-04-18T21:05:47.427 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5176e-05 2024-04-18T21:05:47.427 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.427 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.427 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:47.427 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628334+0000", 2024-04-18T21:05:47.427 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0022691439999999998 2024-04-18T21:05:47.427 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.427 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.428 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:47.428 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628379+0000", 2024-04-18T21:05:47.428 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.5420000000000002e-05 2024-04-18T21:05:47.428 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.428 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.428 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:47.428 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634770+0000", 2024-04-18T21:05:47.428 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0063908410000000004 2024-04-18T21:05:47.428 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.428 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.428 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:47.428 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634871+0000", 2024-04-18T21:05:47.429 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000100589 2024-04-18T21:05:47.429 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:47.429 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:47.429 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:47.429 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.429 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.429 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:13 3.10 e17/15 3:0d89b25e:::603.00000000:head v 17'8, mlcod=0'0)", 2024-04-18T21:05:47.429 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:05:47.429 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 41.701528797000002, 2024-04-18T21:05:47.429 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0090974379999999994, 2024-04-18T21:05:47.429 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:47.429 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:47.429 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:47.430 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:47.430 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.430 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:47.430 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:05:47.430 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:47.430 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.430 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.430 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:47.430 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:05:47.430 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:47.430 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.431 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.431 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:47.431 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644838+0000", 2024-04-18T21:05:47.431 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.569999999999999e-07 2024-04-18T21:05:47.431 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.431 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.431 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:47.431 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644846+0000", 2024-04-18T21:05:47.431 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.4499999999999998e-06 2024-04-18T21:05:47.431 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.431 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.431 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:47.431 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644861+0000", 2024-04-18T21:05:47.431 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5243e-05 2024-04-18T21:05:47.432 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.432 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.432 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:47.432 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644997+0000", 2024-04-18T21:05:47.432 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000135609 2024-04-18T21:05:47.432 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.432 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.432 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:47.432 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649150+0000", 2024-04-18T21:05:47.432 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0041536760000000002 2024-04-18T21:05:47.432 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.432 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.432 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:47.433 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649207+0000", 2024-04-18T21:05:47.433 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.6677e-05 2024-04-18T21:05:47.433 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.433 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.433 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:47.433 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.653840+0000", 2024-04-18T21:05:47.433 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0046329700000000001 2024-04-18T21:05:47.433 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.433 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.433 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:47.433 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.653935+0000", 2024-04-18T21:05:47.433 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.4856000000000001e-05 2024-04-18T21:05:47.433 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:47.434 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:47.434 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:47.434 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.434 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.434 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 3 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:05:47.434 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:05:47.434 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 41.698739637000003, 2024-04-18T21:05:47.434 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0087842319999999995, 2024-04-18T21:05:47.434 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:47.434 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:47.434 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "reached pg", 2024-04-18T21:05:47.434 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:47.434 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.434 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:47.435 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:05:47.435 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:47.435 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.435 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.435 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:47.435 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:05:47.435 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:47.435 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.435 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.435 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:47.435 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:05:47.435 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.8299999999999996e-07 2024-04-18T21:05:47.435 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.435 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.436 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:47.436 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647642+0000", 2024-04-18T21:05:47.436 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4724e-05 2024-04-18T21:05:47.436 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.436 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.436 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:47.436 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647679+0000", 2024-04-18T21:05:47.436 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.6662999999999998e-05 2024-04-18T21:05:47.436 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.436 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.436 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:47.436 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647735+0000", 2024-04-18T21:05:47.436 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.6196000000000002e-05 2024-04-18T21:05:47.436 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.436 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.437 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:47.437 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649865+0000", 2024-04-18T21:05:47.437 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0021299489999999999 2024-04-18T21:05:47.437 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.437 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.437 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:47.437 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656411+0000", 2024-04-18T21:05:47.437 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0065460170000000003 2024-04-18T21:05:47.437 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:47.437 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:47.437 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:47.437 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.437 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.437 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:47.437 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:05:47.437 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 41.698594440999997, 2024-04-18T21:05:47.437 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0095703190000000007, 2024-04-18T21:05:47.438 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:47.438 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:47.438 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:47.438 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:47.438 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.438 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:47.438 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:05:47.438 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:47.438 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.438 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.438 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:47.438 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:05:47.438 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:47.438 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.439 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.439 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:47.439 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647773+0000", 2024-04-18T21:05:47.439 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.046e-06 2024-04-18T21:05:47.439 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.439 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.439 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:47.439 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647795+0000", 2024-04-18T21:05:47.439 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2616000000000002e-05 2024-04-18T21:05:47.439 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.439 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.439 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:47.439 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647818+0000", 2024-04-18T21:05:47.439 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3110000000000001e-05 2024-04-18T21:05:47.439 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.439 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.440 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:47.440 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647834+0000", 2024-04-18T21:05:47.440 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5163e-05 2024-04-18T21:05:47.440 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.440 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.440 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:47.440 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650682+0000", 2024-04-18T21:05:47.440 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0028479759999999999 2024-04-18T21:05:47.440 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.440 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.440 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:47.440 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650730+0000", 2024-04-18T21:05:47.440 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.8375999999999999e-05 2024-04-18T21:05:47.440 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.440 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.440 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:47.440 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656751+0000", 2024-04-18T21:05:47.441 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0060211880000000002 2024-04-18T21:05:47.441 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.441 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.441 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:47.441 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657342+0000", 2024-04-18T21:05:47.441 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00059084399999999998 2024-04-18T21:05:47.441 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:47.441 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:47.441 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:47.441 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.441 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.441 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:47.441 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:05:47.441 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 41.698182154999998, 2024-04-18T21:05:47.441 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0092471759999999993, 2024-04-18T21:05:47.441 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:47.442 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:47.442 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:47.442 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:47.442 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.442 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:47.442 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:05:47.442 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:47.442 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.442 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.442 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:47.442 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:05:47.442 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:47.442 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.442 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.443 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:47.443 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648185+0000", 2024-04-18T21:05:47.443 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.5000000000000001e-07 2024-04-18T21:05:47.443 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.443 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.443 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:47.443 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648203+0000", 2024-04-18T21:05:47.443 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.8102999999999999e-05 2024-04-18T21:05:47.443 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.443 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.443 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:47.443 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648226+0000", 2024-04-18T21:05:47.443 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2921999999999998e-05 2024-04-18T21:05:47.443 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.443 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.443 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:47.443 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648241+0000", 2024-04-18T21:05:47.444 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5336999999999999e-05 2024-04-18T21:05:47.444 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.444 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.444 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:47.444 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.651268+0000", 2024-04-18T21:05:47.444 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0030271640000000002 2024-04-18T21:05:47.444 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.444 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.444 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:47.444 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.651319+0000", 2024-04-18T21:05:47.444 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.0843000000000001e-05 2024-04-18T21:05:47.444 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.444 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.444 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:47.444 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657347+0000", 2024-04-18T21:05:47.444 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0060279770000000003 2024-04-18T21:05:47.445 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:47.445 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:47.445 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:47.445 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657431+0000", 2024-04-18T21:05:47.445 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.3980000000000006e-05 2024-04-18T21:05:47.445 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:47.445 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:47.445 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:47.445 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:47.445 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:47.445 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:05:47.447 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:05:47.447 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:47.447+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:47.548 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:47.547+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:47.578 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:05:47.579 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:05:47.579 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-04-18T21:05:47.579 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:05:47.593 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:05:47.593 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-18T21:05:47.593 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-18T21:05:47.593 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-04-18T21:05:47.594 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-18T21:05:47.649 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:47.647+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:47.712 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:05:47.712 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:05:47.712 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-18T21:05:47.712 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-18T21:05:47.713 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:05:47.728 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:05:47.750 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:47.751+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:47.851 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:47.851+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:47.852 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:05:47.852 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-18T21:05:47.852 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-18T21:05:47.853 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:05:47.853 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.853 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:47.853 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:05:47.853 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 42.236715015000001, 2024-04-18T21:05:47.853 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.034065303999999998, 2024-04-18T21:05:47.853 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:47.853 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:47.853 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:47.853 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:47.853 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.853 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:47.853 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:05:47.854 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:47.854 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.854 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.854 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:47.854 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:05:47.854 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:47.854 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.854 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.854 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:47.854 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615254+0000", 2024-04-18T21:05:47.854 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7829999999999999e-06 2024-04-18T21:05:47.854 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.854 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.854 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:47.854 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615267+0000", 2024-04-18T21:05:47.854 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3334e-05 2024-04-18T21:05:47.855 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.855 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.855 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:47.855 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615294+0000", 2024-04-18T21:05:47.855 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7271999999999999e-05 2024-04-18T21:05:47.855 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.855 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.855 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:47.855 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615321+0000", 2024-04-18T21:05:47.855 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.637e-05 2024-04-18T21:05:47.855 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.855 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.855 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:47.856 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615479+0000", 2024-04-18T21:05:47.856 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000158493 2024-04-18T21:05:47.856 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.856 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.856 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:47.856 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615498+0000", 2024-04-18T21:05:47.856 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9148999999999999e-05 2024-04-18T21:05:47.856 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.856 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.856 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:47.856 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632915+0000", 2024-04-18T21:05:47.856 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.017416551999999998 2024-04-18T21:05:47.856 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.856 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.856 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:47.856 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633302+0000", 2024-04-18T21:05:47.857 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00038725000000000001 2024-04-18T21:05:47.857 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.857 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.857 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:47.857 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633638+0000", 2024-04-18T21:05:47.857 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000335946 2024-04-18T21:05:47.857 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.857 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.857 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:47.857 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645976+0000", 2024-04-18T21:05:47.857 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012337617 2024-04-18T21:05:47.857 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.857 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.857 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:47.858 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649080+0000", 2024-04-18T21:05:47.858 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031038929999999999 2024-04-18T21:05:47.858 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.858 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.858 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:47.858 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649207+0000", 2024-04-18T21:05:47.858 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000127537 2024-04-18T21:05:47.858 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.858 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.858 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:47.858 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649316+0000", 2024-04-18T21:05:47.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109108 2024-04-18T21:05:47.859 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:47.859 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:47.859 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:47.859 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.859 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:47.859 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:05:47.859 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 42.236581637999997, 2024-04-18T21:05:47.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036275764000000002, 2024-04-18T21:05:47.859 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:47.859 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:47.859 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:47.859 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:47.860 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:47.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:05:47.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:47.860 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.860 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:47.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:05:47.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:47.860 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.860 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:47.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615386+0000", 2024-04-18T21:05:47.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.573e-06 2024-04-18T21:05:47.860 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.861 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:47.861 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:05:47.861 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0723999999999999e-05 2024-04-18T21:05:47.861 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.861 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:47.861 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615418+0000", 2024-04-18T21:05:47.861 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0902000000000001e-05 2024-04-18T21:05:47.861 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.861 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:47.861 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615433+0000", 2024-04-18T21:05:47.862 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5319999999999999e-05 2024-04-18T21:05:47.862 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.862 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.862 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:47.862 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615659+0000", 2024-04-18T21:05:47.862 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000226095 2024-04-18T21:05:47.862 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.862 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.862 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:47.862 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:47.862 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1276e-05 2024-04-18T21:05:47.862 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.862 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.862 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:47.862 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643654+0000", 2024-04-18T21:05:47.862 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027983238000000001 2024-04-18T21:05:47.863 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.863 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.863 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:47.863 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643868+0000", 2024-04-18T21:05:47.863 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000214305 2024-04-18T21:05:47.863 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.863 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.863 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:47.863 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:05:47.863 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035892200000000002 2024-04-18T21:05:47.863 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.863 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.863 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:47.864 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646056+0000", 2024-04-18T21:05:47.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001829172 2024-04-18T21:05:47.864 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.864 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.864 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:47.864 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651406+0000", 2024-04-18T21:05:47.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0053504800000000003 2024-04-18T21:05:47.864 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.864 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.864 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:47.864 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651551+0000", 2024-04-18T21:05:47.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014427999999999999 2024-04-18T21:05:47.864 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.864 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.864 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:47.864 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651660+0000", 2024-04-18T21:05:47.865 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109477 2024-04-18T21:05:47.865 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:47.865 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:47.865 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:47.865 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.865 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.865 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:47.865 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:05:47.865 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 42.236508256, 2024-04-18T21:05:47.865 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045668994999999997, 2024-04-18T21:05:47.865 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:47.865 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:47.865 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:47.865 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:47.865 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.866 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:47.866 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:05:47.866 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:47.866 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.866 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.866 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:47.866 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:05:47.866 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:47.866 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.866 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.866 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:47.866 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615459+0000", 2024-04-18T21:05:47.866 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5030000000000001e-06 2024-04-18T21:05:47.866 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:47.867 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615506+0000", 2024-04-18T21:05:47.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6872000000000001e-05 2024-04-18T21:05:47.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:47.867 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615527+0000", 2024-04-18T21:05:47.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0763000000000001e-05 2024-04-18T21:05:47.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:47.867 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615551+0000", 2024-04-18T21:05:47.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4159e-05 2024-04-18T21:05:47.868 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.868 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.868 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:47.868 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615736+0000", 2024-04-18T21:05:47.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018499599999999999 2024-04-18T21:05:47.868 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.868 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.868 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:47.868 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615748+0000", 2024-04-18T21:05:47.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2272999999999999e-05 2024-04-18T21:05:47.868 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.868 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.868 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:47.868 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635481+0000", 2024-04-18T21:05:47.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019732772999999999 2024-04-18T21:05:47.869 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.869 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.869 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:47.869 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635791+0000", 2024-04-18T21:05:47.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031013299999999998 2024-04-18T21:05:47.869 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.869 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.869 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:47.869 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636101+0000", 2024-04-18T21:05:47.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030943300000000002 2024-04-18T21:05:47.869 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.870 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.870 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:47.870 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646043+0000", 2024-04-18T21:05:47.870 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099428139999999995 2024-04-18T21:05:47.870 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.870 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.870 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:47.870 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660991+0000", 2024-04-18T21:05:47.870 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014947142 2024-04-18T21:05:47.870 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.870 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.870 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:47.870 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661061+0000", 2024-04-18T21:05:47.870 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0438000000000006e-05 2024-04-18T21:05:47.870 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.871 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.871 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:47.871 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661127+0000", 2024-04-18T21:05:47.871 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5696000000000003e-05 2024-04-18T21:05:47.871 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:47.871 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:47.871 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:47.871 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.871 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.871 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:47.871 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:47.871 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 42.236295828000003, 2024-04-18T21:05:47.871 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045745085999999997, 2024-04-18T21:05:47.871 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:47.871 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:47.871 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:47.872 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:47.872 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.872 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:47.872 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:47.872 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:47.872 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.872 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.872 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:47.872 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:47.872 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:47.872 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.872 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.872 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:47.872 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:05:47.872 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7400000000000001e-06 2024-04-18T21:05:47.872 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.873 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.873 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:47.873 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:05:47.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8133e-05 2024-04-18T21:05:47.873 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.873 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.873 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:47.873 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615726+0000", 2024-04-18T21:05:47.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6132e-05 2024-04-18T21:05:47.873 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.873 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.873 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:47.873 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615742+0000", 2024-04-18T21:05:47.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6157000000000001e-05 2024-04-18T21:05:47.873 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.873 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.874 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:47.874 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615937+0000", 2024-04-18T21:05:47.874 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000194768 2024-04-18T21:05:47.874 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.874 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.874 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:47.874 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615950+0000", 2024-04-18T21:05:47.874 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3084e-05 2024-04-18T21:05:47.874 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.874 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.874 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:47.874 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643676+0000", 2024-04-18T21:05:47.874 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027725639999999999 2024-04-18T21:05:47.874 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.874 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.875 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:47.875 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643867+0000", 2024-04-18T21:05:47.875 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019075900000000001 2024-04-18T21:05:47.875 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.875 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.875 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:47.875 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:05:47.875 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036013799999999997 2024-04-18T21:05:47.875 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.875 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.875 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:47.875 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646068+0000", 2024-04-18T21:05:47.875 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001841536 2024-04-18T21:05:47.875 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.875 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.876 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:47.876 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661184+0000", 2024-04-18T21:05:47.876 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015115458999999999 2024-04-18T21:05:47.876 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.876 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.876 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:47.876 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661283+0000", 2024-04-18T21:05:47.876 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9502999999999999e-05 2024-04-18T21:05:47.876 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.876 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.876 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:47.876 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661415+0000", 2024-04-18T21:05:47.876 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000132037 2024-04-18T21:05:47.877 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:47.877 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:47.877 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:47.877 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.877 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.877 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:47.877 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:05:47.877 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 42.236174140999999, 2024-04-18T21:05:47.877 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036185947000000003, 2024-04-18T21:05:47.877 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:47.877 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:47.877 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:47.877 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:47.878 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.878 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:47.878 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:05:47.878 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:47.878 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.878 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.878 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:47.878 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:05:47.878 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:47.878 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.878 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.878 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:47.879 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615794+0000", 2024-04-18T21:05:47.879 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6440000000000001e-06 2024-04-18T21:05:47.879 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.879 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.879 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:47.879 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615803+0000", 2024-04-18T21:05:47.879 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1220000000000001e-06 2024-04-18T21:05:47.879 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.879 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.879 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:47.879 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615827+0000", 2024-04-18T21:05:47.879 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3997000000000001e-05 2024-04-18T21:05:47.879 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.879 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.879 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:47.880 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615899+0000", 2024-04-18T21:05:47.880 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2741e-05 2024-04-18T21:05:47.880 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.880 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.880 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:47.880 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616019+0000", 2024-04-18T21:05:47.880 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119874 2024-04-18T21:05:47.880 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.880 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.880 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:47.880 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616029+0000", 2024-04-18T21:05:47.880 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:05:47.880 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.880 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.881 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:47.881 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644823+0000", 2024-04-18T21:05:47.881 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.028793151999999999 2024-04-18T21:05:47.881 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.881 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.881 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:47.881 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645106+0000", 2024-04-18T21:05:47.881 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028379700000000002 2024-04-18T21:05:47.881 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.881 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.881 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:47.881 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645294+0000", 2024-04-18T21:05:47.881 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000187181 2024-04-18T21:05:47.882 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.882 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.882 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:47.882 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646763+0000", 2024-04-18T21:05:47.882 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0014691050000000001 2024-04-18T21:05:47.882 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.882 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.882 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:47.882 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651784+0000", 2024-04-18T21:05:47.882 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050211650000000002 2024-04-18T21:05:47.882 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.882 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.882 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:47.883 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651876+0000", 2024-04-18T21:05:47.883 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2503999999999994e-05 2024-04-18T21:05:47.883 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.883 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.883 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:47.883 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651978+0000", 2024-04-18T21:05:47.883 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000101475 2024-04-18T21:05:47.883 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:47.883 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:47.883 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:47.883 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.883 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.884 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:47.884 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:47.884 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 42.236025533999999, 2024-04-18T21:05:47.884 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032262322000000003, 2024-04-18T21:05:47.884 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:47.884 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:47.884 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:47.884 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:47.884 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.884 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:47.884 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:47.884 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:47.884 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.885 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.885 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:47.885 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:47.885 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:47.885 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.885 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.885 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:47.885 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615943+0000", 2024-04-18T21:05:47.885 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1959999999999998e-06 2024-04-18T21:05:47.885 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.885 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.885 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:47.885 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615956+0000", 2024-04-18T21:05:47.885 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3424000000000001e-05 2024-04-18T21:05:47.885 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.886 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.886 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:47.886 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615983+0000", 2024-04-18T21:05:47.886 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7072000000000001e-05 2024-04-18T21:05:47.886 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.886 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.886 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:47.886 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616006+0000", 2024-04-18T21:05:47.886 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2823000000000002e-05 2024-04-18T21:05:47.886 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.886 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.887 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:47.887 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616156+0000", 2024-04-18T21:05:47.887 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014962299999999999 2024-04-18T21:05:47.887 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.887 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.887 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:47.887 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616174+0000", 2024-04-18T21:05:47.887 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8082999999999999e-05 2024-04-18T21:05:47.887 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.887 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.887 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:47.887 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.629952+0000", 2024-04-18T21:05:47.887 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013778514 2024-04-18T21:05:47.887 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.888 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.888 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:47.888 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630201+0000", 2024-04-18T21:05:47.888 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024918100000000001 2024-04-18T21:05:47.888 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.888 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.888 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:47.888 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630386+0000", 2024-04-18T21:05:47.888 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018436900000000001 2024-04-18T21:05:47.888 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.888 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.888 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:47.888 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643169+0000", 2024-04-18T21:05:47.888 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012782774 2024-04-18T21:05:47.888 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.888 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.889 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:47.889 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.647924+0000", 2024-04-18T21:05:47.889 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004755787 2024-04-18T21:05:47.889 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.889 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.889 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:47.889 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648069+0000", 2024-04-18T21:05:47.889 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014459600000000001 2024-04-18T21:05:47.889 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.889 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.889 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:47.889 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648203+0000", 2024-04-18T21:05:47.889 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013388000000000001 2024-04-18T21:05:47.889 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:47.890 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:47.890 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:47.890 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.890 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.890 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:47.890 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:05:47.890 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 42.235917270000002, 2024-04-18T21:05:47.890 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032489736999999998, 2024-04-18T21:05:47.890 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:47.890 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:47.890 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:47.890 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:47.891 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.891 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:47.891 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:05:47.891 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:47.891 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.891 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.891 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:47.891 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:05:47.891 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:47.891 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.891 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.891 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:47.891 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616050+0000", 2024-04-18T21:05:47.891 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.606e-06 2024-04-18T21:05:47.891 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.892 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.892 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:47.892 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616061+0000", 2024-04-18T21:05:47.892 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0463e-05 2024-04-18T21:05:47.892 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.892 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.892 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:47.892 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616092+0000", 2024-04-18T21:05:47.892 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1415999999999999e-05 2024-04-18T21:05:47.892 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.892 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.892 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:47.892 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616109+0000", 2024-04-18T21:05:47.892 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6557000000000001e-05 2024-04-18T21:05:47.893 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.893 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.893 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:47.893 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616358+0000", 2024-04-18T21:05:47.893 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000249077 2024-04-18T21:05:47.893 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.893 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.893 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:47.893 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616370+0000", 2024-04-18T21:05:47.893 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2037e-05 2024-04-18T21:05:47.893 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.893 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.893 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:47.893 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.634920+0000", 2024-04-18T21:05:47.893 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018550397 2024-04-18T21:05:47.893 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.894 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.894 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:47.894 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640420+0000", 2024-04-18T21:05:47.894 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055000539999999999 2024-04-18T21:05:47.894 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.894 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.894 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:47.894 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648538+0000", 2024-04-18T21:05:47.894 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0081181299999999994 2024-04-18T21:05:47.894 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:47.894 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:47.894 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:47.895 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.895 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.895 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:47.895 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:05:47.895 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 42.235832948999999, 2024-04-18T21:05:47.895 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036090029000000003, 2024-04-18T21:05:47.895 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:47.895 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:47.895 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:47.895 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:47.895 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.895 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:47.895 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:05:47.895 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:47.895 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.895 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.896 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:47.896 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:05:47.896 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:47.896 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.896 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.896 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:47.896 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616134+0000", 2024-04-18T21:05:47.896 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.353e-06 2024-04-18T21:05:47.896 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.896 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.896 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:47.896 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616141+0000", 2024-04-18T21:05:47.896 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2770000000000002e-06 2024-04-18T21:05:47.896 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.896 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.896 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:47.897 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616160+0000", 2024-04-18T21:05:47.897 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.91e-05 2024-04-18T21:05:47.897 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.897 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.897 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:47.897 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616170+0000", 2024-04-18T21:05:47.897 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7699999999999996e-06 2024-04-18T21:05:47.897 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.897 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.897 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:47.897 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616275+0000", 2024-04-18T21:05:47.897 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105313 2024-04-18T21:05:47.897 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.897 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.897 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:47.897 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616288+0000", 2024-04-18T21:05:47.898 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3027000000000001e-05 2024-04-18T21:05:47.898 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.898 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.898 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:47.898 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646160+0000", 2024-04-18T21:05:47.898 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.029872019 2024-04-18T21:05:47.898 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.898 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.898 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:47.898 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646368+0000", 2024-04-18T21:05:47.898 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020811899999999999 2024-04-18T21:05:47.898 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.898 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.899 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:47.899 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652223+0000", 2024-04-18T21:05:47.899 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.005855051 2024-04-18T21:05:47.899 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:47.899 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:47.899 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:47.899 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.899 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.899 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:47.899 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:05:47.899 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 42.23577538, 2024-04-18T21:05:47.899 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043572403000000003, 2024-04-18T21:05:47.899 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:47.899 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:47.900 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:47.900 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:47.900 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.900 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:47.900 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:05:47.900 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:47.900 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.900 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.900 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:47.900 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:05:47.900 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:47.900 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.900 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.900 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:47.901 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616192+0000", 2024-04-18T21:05:47.901 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:05:47.901 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.901 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.901 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:47.901 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616203+0000", 2024-04-18T21:05:47.901 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0890000000000001e-05 2024-04-18T21:05:47.901 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.901 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.901 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:47.901 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616223+0000", 2024-04-18T21:05:47.901 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0409000000000001e-05 2024-04-18T21:05:47.901 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.901 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.901 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:47.901 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616238+0000", 2024-04-18T21:05:47.902 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5160000000000001e-05 2024-04-18T21:05:47.902 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.902 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.902 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:47.902 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616343+0000", 2024-04-18T21:05:47.902 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000104831 2024-04-18T21:05:47.902 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.902 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.902 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:47.902 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616357+0000", 2024-04-18T21:05:47.902 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3686000000000001e-05 2024-04-18T21:05:47.902 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.902 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.903 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:47.903 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635912+0000", 2024-04-18T21:05:47.903 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019554944000000001 2024-04-18T21:05:47.903 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.903 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.903 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:47.903 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636231+0000", 2024-04-18T21:05:47.903 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000318766 2024-04-18T21:05:47.903 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.903 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.903 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:47.903 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659763+0000", 2024-04-18T21:05:47.903 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023532474000000001 2024-04-18T21:05:47.903 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:47.904 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:47.904 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:47.904 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.904 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.904 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:47.904 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:05:47.904 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 42.231846673, 2024-04-18T21:05:47.904 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015007971, 2024-04-18T21:05:47.904 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:47.904 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:47.904 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:47.904 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:47.904 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.904 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:47.904 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:05:47.905 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:47.905 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.905 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.905 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:47.905 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:05:47.905 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:47.905 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.905 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.905 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:47.905 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620120+0000", 2024-04-18T21:05:47.905 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0359999999999999e-06 2024-04-18T21:05:47.905 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.905 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.905 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:47.905 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620157+0000", 2024-04-18T21:05:47.906 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6636e-05 2024-04-18T21:05:47.906 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.906 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.906 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:47.906 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620177+0000", 2024-04-18T21:05:47.906 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0247000000000001e-05 2024-04-18T21:05:47.906 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.906 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.906 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:47.906 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620195+0000", 2024-04-18T21:05:47.906 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7819e-05 2024-04-18T21:05:47.906 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.906 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.906 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:47.907 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620342+0000", 2024-04-18T21:05:47.907 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014643300000000001 2024-04-18T21:05:47.907 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.907 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.907 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:47.907 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620405+0000", 2024-04-18T21:05:47.907 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3522000000000006e-05 2024-04-18T21:05:47.907 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.907 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.907 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:47.907 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635016+0000", 2024-04-18T21:05:47.907 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014610840999999999 2024-04-18T21:05:47.908 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.908 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.908 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:47.908 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635127+0000", 2024-04-18T21:05:47.908 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111437 2024-04-18T21:05:47.908 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:47.908 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:47.908 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:47.908 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.908 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.908 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:47.908 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:05:47.908 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 42.231739404999999, 2024-04-18T21:05:47.908 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012693296, 2024-04-18T21:05:47.909 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:47.909 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:47.909 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:47.909 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:47.909 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.909 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:47.909 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:05:47.909 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:47.909 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.909 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.909 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:47.909 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:05:47.909 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:47.910 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.910 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.910 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:47.910 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620228+0000", 2024-04-18T21:05:47.910 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:05:47.910 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.910 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.910 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:47.910 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620236+0000", 2024-04-18T21:05:47.910 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.303e-06 2024-04-18T21:05:47.910 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.910 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.911 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:47.911 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620255+0000", 2024-04-18T21:05:47.911 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9406e-05 2024-04-18T21:05:47.911 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.911 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.911 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:47.911 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620274+0000", 2024-04-18T21:05:47.911 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8940000000000002e-05 2024-04-18T21:05:47.911 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.911 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.911 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:47.911 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:05:47.912 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001558753 2024-04-18T21:05:47.912 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.912 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.912 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:47.912 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621879+0000", 2024-04-18T21:05:47.912 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6359000000000001e-05 2024-04-18T21:05:47.912 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.912 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.912 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:47.912 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632841+0000", 2024-04-18T21:05:47.912 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010961907 2024-04-18T21:05:47.912 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.912 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.913 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:47.913 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632920+0000", 2024-04-18T21:05:47.913 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8714999999999994e-05 2024-04-18T21:05:47.913 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:47.913 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:47.913 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:47.913 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.913 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.913 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:47.913 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:05:47.913 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 42.230193642000003, 2024-04-18T21:05:47.913 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013445702, 2024-04-18T21:05:47.913 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:47.914 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:47.914 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:47.914 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:47.914 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.914 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:47.914 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:05:47.914 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:47.914 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.914 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.914 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:47.914 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:05:47.914 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:47.914 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.914 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.915 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:47.915 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621774+0000", 2024-04-18T21:05:47.915 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2500000000000001e-06 2024-04-18T21:05:47.915 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.915 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.915 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:47.915 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621786+0000", 2024-04-18T21:05:47.915 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2636000000000001e-05 2024-04-18T21:05:47.915 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.915 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.915 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:47.915 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621814+0000", 2024-04-18T21:05:47.915 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7823000000000001e-05 2024-04-18T21:05:47.915 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.915 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.916 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:47.916 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621844+0000", 2024-04-18T21:05:47.916 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9589000000000001e-05 2024-04-18T21:05:47.916 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.916 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.916 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:47.916 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622253+0000", 2024-04-18T21:05:47.916 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040963700000000002 2024-04-18T21:05:47.916 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.916 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.916 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:47.916 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622304+0000", 2024-04-18T21:05:47.916 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0868999999999997e-05 2024-04-18T21:05:47.916 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.917 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.917 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:47.917 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635133+0000", 2024-04-18T21:05:47.917 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012829136 2024-04-18T21:05:47.917 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.917 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.917 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:47.917 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635218+0000", 2024-04-18T21:05:47.917 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4761999999999999e-05 2024-04-18T21:05:47.917 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:47.917 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:47.917 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:47.917 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.917 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.917 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:47.918 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:05:47.918 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 42.230066882000003, 2024-04-18T21:05:47.918 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014162065, 2024-04-18T21:05:47.918 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:47.918 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:47.918 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:47.918 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:47.918 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.918 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:47.918 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:05:47.918 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:47.918 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.918 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.918 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:47.918 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:05:47.919 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:47.919 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.919 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.919 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:47.919 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621900+0000", 2024-04-18T21:05:47.919 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:05:47.919 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.919 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.919 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:47.919 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621910+0000", 2024-04-18T21:05:47.919 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0207000000000001e-05 2024-04-18T21:05:47.919 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.919 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.919 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:47.920 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621932+0000", 2024-04-18T21:05:47.920 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1789000000000001e-05 2024-04-18T21:05:47.920 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.920 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.920 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:47.920 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621946+0000", 2024-04-18T21:05:47.920 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4212999999999999e-05 2024-04-18T21:05:47.920 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.920 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.920 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:47.920 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624477+0000", 2024-04-18T21:05:47.920 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025303470000000001 2024-04-18T21:05:47.920 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.920 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.921 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:47.921 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624525+0000", 2024-04-18T21:05:47.921 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8084999999999998e-05 2024-04-18T21:05:47.921 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.921 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.921 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:47.921 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635976+0000", 2024-04-18T21:05:47.921 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.011451368999999999 2024-04-18T21:05:47.921 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.921 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.921 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:47.921 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636061+0000", 2024-04-18T21:05:47.921 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5094999999999998e-05 2024-04-18T21:05:47.921 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:47.922 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:47.922 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:47.922 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.922 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.922 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:05:47.922 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:05:47.922 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 42.220831257, 2024-04-18T21:05:47.922 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0098014739999999993, 2024-04-18T21:05:47.922 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:47.922 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:47.922 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:05:47.922 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:47.922 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.922 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:47.922 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:05:47.923 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:47.923 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.923 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.923 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:47.923 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:05:47.923 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:47.923 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.923 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.923 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:47.923 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631136+0000", 2024-04-18T21:05:47.923 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0139999999999999e-06 2024-04-18T21:05:47.923 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.923 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.923 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:47.923 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631152+0000", 2024-04-18T21:05:47.923 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6365999999999999e-05 2024-04-18T21:05:47.924 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.924 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.924 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:47.924 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631961+0000", 2024-04-18T21:05:47.924 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00080873100000000003 2024-04-18T21:05:47.924 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.924 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.924 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:47.924 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632021+0000", 2024-04-18T21:05:47.924 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0541999999999997e-05 2024-04-18T21:05:47.924 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.924 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.924 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:47.924 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633539+0000", 2024-04-18T21:05:47.924 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015175639999999999 2024-04-18T21:05:47.925 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.925 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.925 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:47.925 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640936+0000", 2024-04-18T21:05:47.925 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007397257 2024-04-18T21:05:47.925 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:47.925 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:47.925 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:47.925 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.925 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.925 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-18T21:05:47.926 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:05:47.926 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 42.203369823999999, 2024-04-18T21:05:47.926 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00073592199999999997, 2024-04-18T21:05:47.926 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:47.926 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:47.926 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:47.926 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:47.926 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.926 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:47.926 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:05:47.926 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:47.926 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.926 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.926 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:47.926 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:05:47.927 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:47.927 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.927 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.927 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:47.927 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648597+0000", 2024-04-18T21:05:47.927 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:05:47.927 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.927 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.927 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:47.927 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648605+0000", 2024-04-18T21:05:47.927 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3960000000000006e-06 2024-04-18T21:05:47.927 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.927 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.928 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:47.928 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648625+0000", 2024-04-18T21:05:47.928 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9987e-05 2024-04-18T21:05:47.928 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.928 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.928 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:47.928 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648643+0000", 2024-04-18T21:05:47.928 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7079e-05 2024-04-18T21:05:47.928 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.928 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.928 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:47.928 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649043+0000", 2024-04-18T21:05:47.928 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040083399999999998 2024-04-18T21:05:47.928 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.929 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.929 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:47.929 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649062+0000", 2024-04-18T21:05:47.929 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9052999999999999e-05 2024-04-18T21:05:47.929 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.929 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.929 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:47.929 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649332+0000", 2024-04-18T21:05:47.929 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026971999999999999 2024-04-18T21:05:47.929 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:47.929 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:47.929 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:47.929 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.930 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.930 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:05:47.930 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:05:47.930 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 42.200594922999997, 2024-04-18T21:05:47.930 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00086123999999999999, 2024-04-18T21:05:47.930 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:47.930 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:47.930 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:05:47.930 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:47.930 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.930 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:47.930 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:05:47.930 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:47.930 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.930 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.931 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:47.931 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:05:47.931 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:47.931 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.931 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.931 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:47.931 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651372+0000", 2024-04-18T21:05:47.931 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7599999999999997e-07 2024-04-18T21:05:47.931 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.931 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.931 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:47.931 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651377+0000", 2024-04-18T21:05:47.931 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.22e-06 2024-04-18T21:05:47.931 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.931 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.932 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:47.932 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651394+0000", 2024-04-18T21:05:47.932 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6646999999999998e-05 2024-04-18T21:05:47.932 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.932 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.932 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:47.932 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651427+0000", 2024-04-18T21:05:47.932 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3682e-05 2024-04-18T21:05:47.932 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.932 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.932 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:47.932 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652029+0000", 2024-04-18T21:05:47.932 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00060152199999999995 2024-04-18T21:05:47.932 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.932 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.932 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:47.933 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652232+0000", 2024-04-18T21:05:47.933 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020359299999999999 2024-04-18T21:05:47.933 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:47.933 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:47.933 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:47.933 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.933 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.933 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:05:47.933 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:05:47.933 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 42.192567961000002, 2024-04-18T21:05:47.933 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0017426200000000001, 2024-04-18T21:05:47.933 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:47.933 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:47.934 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:47.934 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:47.934 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.934 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:47.934 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:05:47.934 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:47.934 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.934 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.934 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:47.934 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:05:47.934 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:47.934 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.934 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.934 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:47.935 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659399+0000", 2024-04-18T21:05:47.935 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6000000000000002e-07 2024-04-18T21:05:47.935 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.935 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.935 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:47.935 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659405+0000", 2024-04-18T21:05:47.935 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5069999999999997e-06 2024-04-18T21:05:47.935 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.935 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.935 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:47.935 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659425+0000", 2024-04-18T21:05:47.935 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.927e-05 2024-04-18T21:05:47.935 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.935 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.935 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:47.935 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659443+0000", 2024-04-18T21:05:47.936 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8051999999999999e-05 2024-04-18T21:05:47.936 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.936 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.936 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:47.936 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660973+0000", 2024-04-18T21:05:47.936 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001530106 2024-04-18T21:05:47.936 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.936 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.936 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:47.936 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660983+0000", 2024-04-18T21:05:47.936 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0516999999999999e-05 2024-04-18T21:05:47.936 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.936 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.936 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:47.936 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661141+0000", 2024-04-18T21:05:47.936 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015730799999999999 2024-04-18T21:05:47.937 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:47.937 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:47.937 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:47.937 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.937 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.937 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:05:47.937 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:05:47.937 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 42.192351336000002, 2024-04-18T21:05:47.937 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001812311, 2024-04-18T21:05:47.937 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:47.937 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:47.937 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:47.937 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:47.937 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.937 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:47.938 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:05:47.938 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:47.938 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.938 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.938 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:47.938 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:05:47.938 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:47.938 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.938 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.938 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:47.938 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659616+0000", 2024-04-18T21:05:47.938 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.277e-06 2024-04-18T21:05:47.938 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.938 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.939 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:47.939 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659625+0000", 2024-04-18T21:05:47.939 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5359999999999998e-06 2024-04-18T21:05:47.939 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.939 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.939 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:47.939 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659647+0000", 2024-04-18T21:05:47.939 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1857000000000001e-05 2024-04-18T21:05:47.939 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.939 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.939 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:47.939 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659664+0000", 2024-04-18T21:05:47.939 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6405999999999998e-05 2024-04-18T21:05:47.939 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.939 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.940 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:47.940 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661169+0000", 2024-04-18T21:05:47.940 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015054179999999999 2024-04-18T21:05:47.940 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.940 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.940 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:47.940 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661177+0000", 2024-04-18T21:05:47.940 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9680000000000006e-06 2024-04-18T21:05:47.940 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.940 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.940 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:47.940 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661427+0000", 2024-04-18T21:05:47.941 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024984900000000001 2024-04-18T21:05:47.941 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:47.941 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:47.941 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:47.941 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.941 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.941 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-18T21:05:47.941 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:05:47.941 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 40.239430728000002, 2024-04-18T21:05:47.941 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0030975030000000001, 2024-04-18T21:05:47.941 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:47.941 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:47.941 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:47.942 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:47.942 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.942 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:47.942 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:05:47.942 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:47.942 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.942 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.942 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:47.942 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:05:47.942 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:47.942 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.942 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.942 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:47.943 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612538+0000", 2024-04-18T21:05:47.943 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6259999999999999e-06 2024-04-18T21:05:47.943 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.943 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.943 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:47.943 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612552+0000", 2024-04-18T21:05:47.943 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4073999999999999e-05 2024-04-18T21:05:47.943 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.943 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.943 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:47.943 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612585+0000", 2024-04-18T21:05:47.943 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3504999999999999e-05 2024-04-18T21:05:47.943 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.943 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.944 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:47.944 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612601+0000", 2024-04-18T21:05:47.944 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5194000000000001e-05 2024-04-18T21:05:47.944 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.944 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.944 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:47.944 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612746+0000", 2024-04-18T21:05:47.944 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145666 2024-04-18T21:05:47.944 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.944 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.944 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:47.944 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612953+0000", 2024-04-18T21:05:47.944 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000207109 2024-04-18T21:05:47.944 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.945 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.945 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:47.945 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.613134+0000", 2024-04-18T21:05:47.945 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018041300000000001 2024-04-18T21:05:47.945 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.945 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.945 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:47.945 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.614411+0000", 2024-04-18T21:05:47.945 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0012769929999999999 2024-04-18T21:05:47.945 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.945 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.945 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:47.945 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615441+0000", 2024-04-18T21:05:47.945 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001029917 2024-04-18T21:05:47.945 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.946 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.946 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:47.946 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615522+0000", 2024-04-18T21:05:47.946 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1142000000000003e-05 2024-04-18T21:05:47.946 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.946 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.946 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:47.946 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615633+0000", 2024-04-18T21:05:47.946 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000110864 2024-04-18T21:05:47.946 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:47.946 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:47.946 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:47.946 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.946 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.946 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-18T21:05:47.947 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:05:47.947 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.237144916999998, 2024-04-18T21:05:47.947 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088979039999999999, 2024-04-18T21:05:47.947 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:47.947 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:47.947 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:47.947 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:47.947 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.947 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:47.947 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:05:47.947 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:47.947 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.947 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.947 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:47.947 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:05:47.947 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:47.948 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.948 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.948 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:47.948 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614825+0000", 2024-04-18T21:05:47.948 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4829999999999999e-06 2024-04-18T21:05:47.948 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.948 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.948 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:47.948 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614843+0000", 2024-04-18T21:05:47.948 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8777e-05 2024-04-18T21:05:47.948 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.948 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.948 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:47.948 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614884+0000", 2024-04-18T21:05:47.948 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1051999999999999e-05 2024-04-18T21:05:47.949 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.949 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.949 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:47.949 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614903+0000", 2024-04-18T21:05:47.949 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9069999999999999e-05 2024-04-18T21:05:47.949 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.949 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.949 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:47.949 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615047+0000", 2024-04-18T21:05:47.949 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014374400000000001 2024-04-18T21:05:47.949 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.949 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.949 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:47.949 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615061+0000", 2024-04-18T21:05:47.949 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4063000000000001e-05 2024-04-18T21:05:47.950 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.950 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.950 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:47.950 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621064+0000", 2024-04-18T21:05:47.950 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0060029200000000001 2024-04-18T21:05:47.950 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.950 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.950 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:47.950 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621211+0000", 2024-04-18T21:05:47.950 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000147224 2024-04-18T21:05:47.950 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.950 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.950 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:47.951 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621396+0000", 2024-04-18T21:05:47.951 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018454699999999999 2024-04-18T21:05:47.951 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.951 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.951 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:47.951 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.622517+0000", 2024-04-18T21:05:47.951 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001121424 2024-04-18T21:05:47.951 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.951 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.951 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:47.951 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623571+0000", 2024-04-18T21:05:47.951 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010538660000000001 2024-04-18T21:05:47.951 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.951 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.951 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:47.952 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623658+0000", 2024-04-18T21:05:47.952 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6439000000000004e-05 2024-04-18T21:05:47.952 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:47.952 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:47.952 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:47.952 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623719+0000", 2024-04-18T21:05:47.952 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1295000000000002e-05 2024-04-18T21:05:47.952 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:47.952 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:47.952 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:47.952 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:47.952 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:47.952 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:05:47.953 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-18T21:05:47.955 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:05:47.955 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-04-18T21:05:47.955 INFO:teuthology.orchestra.run.smithi078.stdout: "epoch": 27, 2024-04-18T21:05:47.955 INFO:teuthology.orchestra.run.smithi078.stdout: "fsid": "dc017990-0393-4ab0-b604-5e7052fdc7bd", 2024-04-18T21:05:47.955 INFO:teuthology.orchestra.run.smithi078.stdout: "created": "2024-04-18T21:04:43.507538+0000", 2024-04-18T21:05:47.955 INFO:teuthology.orchestra.run.smithi078.stdout: "modified": "2024-04-18T21:05:45.876929+0000", 2024-04-18T21:05:47.955 INFO:teuthology.orchestra.run.smithi078.stdout: "last_up_change": "2024-04-18T21:04:52.492503+0000", 2024-04-18T21:05:47.955 INFO:teuthology.orchestra.run.smithi078.stdout: "last_in_change": "2024-04-18T21:04:44.402191+0000", 2024-04-18T21:05:47.955 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-18T21:05:47.956 INFO:teuthology.orchestra.run.smithi078.stdout: "flags_num": 5801984, 2024-04-18T21:05:47.956 INFO:teuthology.orchestra.run.smithi078.stdout: "flags_set": [ 2024-04-18T21:05:47.956 INFO:teuthology.orchestra.run.smithi078.stdout: "noscrub", 2024-04-18T21:05:47.956 INFO:teuthology.orchestra.run.smithi078.stdout: "pglog_hardlimit", 2024-04-18T21:05:47.956 INFO:teuthology.orchestra.run.smithi078.stdout: "purged_snapdirs", 2024-04-18T21:05:47.956 INFO:teuthology.orchestra.run.smithi078.stdout: "recovery_deletes", 2024-04-18T21:05:47.956 INFO:teuthology.orchestra.run.smithi078.stdout: "sortbitwise" 2024-04-18T21:05:47.956 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-04-18T21:05:47.956 INFO:teuthology.orchestra.run.smithi078.stdout: "crush_version": 4, 2024-04-18T21:05:47.956 INFO:teuthology.orchestra.run.smithi078.stdout: "full_ratio": 0.94999998807907104, 2024-04-18T21:05:47.956 INFO:teuthology.orchestra.run.smithi078.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-18T21:05:47.956 INFO:teuthology.orchestra.run.smithi078.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-18T21:05:47.957 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_snapshot": "", 2024-04-18T21:05:47.957 INFO:teuthology.orchestra.run.smithi078.stdout: "pool_max": 4, 2024-04-18T21:05:47.957 INFO:teuthology.orchestra.run.smithi078.stdout: "max_osd": 3, 2024-04-18T21:05:47.957 INFO:teuthology.orchestra.run.smithi078.stdout: "require_min_compat_client": "luminous", 2024-04-18T21:05:47.957 INFO:teuthology.orchestra.run.smithi078.stdout: "min_compat_client": "jewel", 2024-04-18T21:05:47.957 INFO:teuthology.orchestra.run.smithi078.stdout: "require_osd_release": "squid", 2024-04-18T21:05:47.957 INFO:teuthology.orchestra.run.smithi078.stdout: "allow_crimson": false, 2024-04-18T21:05:47.957 INFO:teuthology.orchestra.run.smithi078.stdout: "pools": [ 2024-04-18T21:05:47.957 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:47.957 INFO:teuthology.orchestra.run.smithi078.stdout: "pool": 1, 2024-04-18T21:05:47.957 INFO:teuthology.orchestra.run.smithi078.stdout: "pool_name": ".mgr", 2024-04-18T21:05:47.957 INFO:teuthology.orchestra.run.smithi078.stdout: "create_time": "2024-04-18T21:04:52.538153+0000", 2024-04-18T21:05:47.957 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-04-18T21:05:47.957 INFO:teuthology.orchestra.run.smithi078.stdout: "flags_names": "hashpspool", 2024-04-18T21:05:47.958 INFO:teuthology.orchestra.run.smithi078.stdout: "type": 1, 2024-04-18T21:05:47.958 INFO:teuthology.orchestra.run.smithi078.stdout: "size": 2, 2024-04-18T21:05:47.958 INFO:teuthology.orchestra.run.smithi078.stdout: "min_size": 1, 2024-04-18T21:05:47.958 INFO:teuthology.orchestra.run.smithi078.stdout: "crush_rule": 0, 2024-04-18T21:05:47.958 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:05:47.958 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:05:47.958 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:05:47.958 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:05:47.958 INFO:teuthology.orchestra.run.smithi078.stdout: "object_hash": 2, 2024-04-18T21:05:47.958 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:05:47.958 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num": 1, 2024-04-18T21:05:47.958 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_placement_num": 1, 2024-04-18T21:05:47.958 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_placement_num_target": 1, 2024-04-18T21:05:47.959 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_target": 1, 2024-04-18T21:05:47.959 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_pending": 1, 2024-04-18T21:05:47.959 INFO:teuthology.orchestra.run.smithi078.stdout: "last_pg_merge_meta": { 2024-04-18T21:05:47.959 INFO:teuthology.orchestra.run.smithi078.stdout: "source_pgid": "0.0", 2024-04-18T21:05:47.959 INFO:teuthology.orchestra.run.smithi078.stdout: "ready_epoch": 0, 2024-04-18T21:05:47.959 INFO:teuthology.orchestra.run.smithi078.stdout: "last_epoch_started": 0, 2024-04-18T21:05:47.959 INFO:teuthology.orchestra.run.smithi078.stdout: "last_epoch_clean": 0, 2024-04-18T21:05:47.959 INFO:teuthology.orchestra.run.smithi078.stdout: "source_version": "0'0", 2024-04-18T21:05:47.959 INFO:teuthology.orchestra.run.smithi078.stdout: "target_version": "0'0" 2024-04-18T21:05:47.959 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:47.959 INFO:teuthology.orchestra.run.smithi078.stdout: "last_change": "11", 2024-04-18T21:05:47.959 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend": "0", 2024-04-18T21:05:47.959 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:05:47.959 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:05:47.960 INFO:teuthology.orchestra.run.smithi078.stdout: "auid": 0, 2024-04-18T21:05:47.960 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:05:47.960 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_seq": 0, 2024-04-18T21:05:47.960 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_epoch": 0, 2024-04-18T21:05:47.960 INFO:teuthology.orchestra.run.smithi078.stdout: "pool_snaps": [], 2024-04-18T21:05:47.960 INFO:teuthology.orchestra.run.smithi078.stdout: "removed_snaps": "[]", 2024-04-18T21:05:47.960 INFO:teuthology.orchestra.run.smithi078.stdout: "quota_max_bytes": 0, 2024-04-18T21:05:47.960 INFO:teuthology.orchestra.run.smithi078.stdout: "quota_max_objects": 0, 2024-04-18T21:05:47.960 INFO:teuthology.orchestra.run.smithi078.stdout: "tiers": [], 2024-04-18T21:05:47.960 INFO:teuthology.orchestra.run.smithi078.stdout: "tier_of": -1, 2024-04-18T21:05:47.960 INFO:teuthology.orchestra.run.smithi078.stdout: "read_tier": -1, 2024-04-18T21:05:47.960 INFO:teuthology.orchestra.run.smithi078.stdout: "write_tier": -1, 2024-04-18T21:05:47.960 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_mode": "none", 2024-04-18T21:05:47.960 INFO:teuthology.orchestra.run.smithi078.stdout: "target_max_bytes": 0, 2024-04-18T21:05:47.961 INFO:teuthology.orchestra.run.smithi078.stdout: "target_max_objects": 0, 2024-04-18T21:05:47.961 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:05:47.961 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:05:47.961 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:05:47.961 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_min_flush_age": 0, 2024-04-18T21:05:47.961 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_min_evict_age": 0, 2024-04-18T21:05:47.961 INFO:teuthology.orchestra.run.smithi078.stdout: "erasure_code_profile": "", 2024-04-18T21:05:47.961 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_params": { 2024-04-18T21:05:47.961 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "none" 2024-04-18T21:05:47.961 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:47.961 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_period": 0, 2024-04-18T21:05:47.961 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_count": 0, 2024-04-18T21:05:47.961 INFO:teuthology.orchestra.run.smithi078.stdout: "use_gmt_hitset": true, 2024-04-18T21:05:47.962 INFO:teuthology.orchestra.run.smithi078.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:05:47.962 INFO:teuthology.orchestra.run.smithi078.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:05:47.962 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:05:47.962 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:05:47.962 INFO:teuthology.orchestra.run.smithi078.stdout: "grade_table": [], 2024-04-18T21:05:47.962 INFO:teuthology.orchestra.run.smithi078.stdout: "stripe_width": 0, 2024-04-18T21:05:47.962 INFO:teuthology.orchestra.run.smithi078.stdout: "expected_num_objects": 0, 2024-04-18T21:05:47.962 INFO:teuthology.orchestra.run.smithi078.stdout: "fast_read": false, 2024-04-18T21:05:47.962 INFO:teuthology.orchestra.run.smithi078.stdout: "options": { 2024-04-18T21:05:47.962 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_max": 32, 2024-04-18T21:05:47.962 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_min": 1 2024-04-18T21:05:47.962 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:47.963 INFO:teuthology.orchestra.run.smithi078.stdout: "application_metadata": { 2024-04-18T21:05:47.963 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": {} 2024-04-18T21:05:47.963 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:47.963 INFO:teuthology.orchestra.run.smithi078.stdout: "read_balance": { 2024-04-18T21:05:47.963 INFO:teuthology.orchestra.run.smithi078.stdout: "score_type": "Fair distribution", 2024-04-18T21:05:47.963 INFO:teuthology.orchestra.run.smithi078.stdout: "score_acting": 2.9900000095367432, 2024-04-18T21:05:47.963 INFO:teuthology.orchestra.run.smithi078.stdout: "score_stable": 2.9900000095367432, 2024-04-18T21:05:47.963 INFO:teuthology.orchestra.run.smithi078.stdout: "optimal_score": 0.67000001668930054, 2024-04-18T21:05:47.963 INFO:teuthology.orchestra.run.smithi078.stdout: "raw_score_acting": 2, 2024-04-18T21:05:47.963 INFO:teuthology.orchestra.run.smithi078.stdout: "raw_score_stable": 2, 2024-04-18T21:05:47.963 INFO:teuthology.orchestra.run.smithi078.stdout: "primary_affinity_weighted": 1, 2024-04-18T21:05:47.963 INFO:teuthology.orchestra.run.smithi078.stdout: "average_primary_affinity": 1, 2024-04-18T21:05:47.963 INFO:teuthology.orchestra.run.smithi078.stdout: "average_primary_affinity_weighted": 1 2024-04-18T21:05:47.963 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:47.964 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:47.964 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:47.964 INFO:teuthology.orchestra.run.smithi078.stdout: "pool": 2, 2024-04-18T21:05:47.964 INFO:teuthology.orchestra.run.smithi078.stdout: "pool_name": "rbd", 2024-04-18T21:05:47.964 INFO:teuthology.orchestra.run.smithi078.stdout: "create_time": "2024-04-18T21:04:58.673793+0000", 2024-04-18T21:05:47.964 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-04-18T21:05:47.964 INFO:teuthology.orchestra.run.smithi078.stdout: "flags_names": "hashpspool", 2024-04-18T21:05:47.964 INFO:teuthology.orchestra.run.smithi078.stdout: "type": 1, 2024-04-18T21:05:47.964 INFO:teuthology.orchestra.run.smithi078.stdout: "size": 2, 2024-04-18T21:05:47.964 INFO:teuthology.orchestra.run.smithi078.stdout: "min_size": 1, 2024-04-18T21:05:47.964 INFO:teuthology.orchestra.run.smithi078.stdout: "crush_rule": 0, 2024-04-18T21:05:47.964 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:05:47.964 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:05:47.964 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:05:47.964 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:05:47.964 INFO:teuthology.orchestra.run.smithi078.stdout: "object_hash": 2, 2024-04-18T21:05:47.965 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:05:47.965 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num": 8, 2024-04-18T21:05:47.965 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_placement_num": 8, 2024-04-18T21:05:47.965 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_placement_num_target": 8, 2024-04-18T21:05:47.965 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_target": 8, 2024-04-18T21:05:47.965 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_pending": 8, 2024-04-18T21:05:47.965 INFO:teuthology.orchestra.run.smithi078.stdout: "last_pg_merge_meta": { 2024-04-18T21:05:47.965 INFO:teuthology.orchestra.run.smithi078.stdout: "source_pgid": "0.0", 2024-04-18T21:05:47.965 INFO:teuthology.orchestra.run.smithi078.stdout: "ready_epoch": 0, 2024-04-18T21:05:47.965 INFO:teuthology.orchestra.run.smithi078.stdout: "last_epoch_started": 0, 2024-04-18T21:05:47.965 INFO:teuthology.orchestra.run.smithi078.stdout: "last_epoch_clean": 0, 2024-04-18T21:05:47.965 INFO:teuthology.orchestra.run.smithi078.stdout: "source_version": "0'0", 2024-04-18T21:05:47.965 INFO:teuthology.orchestra.run.smithi078.stdout: "target_version": "0'0" 2024-04-18T21:05:47.965 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:47.966 INFO:teuthology.orchestra.run.smithi078.stdout: "last_change": "14", 2024-04-18T21:05:47.966 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend": "0", 2024-04-18T21:05:47.966 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:05:47.966 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:05:47.966 INFO:teuthology.orchestra.run.smithi078.stdout: "auid": 0, 2024-04-18T21:05:47.966 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:05:47.966 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_seq": 0, 2024-04-18T21:05:47.966 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_epoch": 0, 2024-04-18T21:05:47.966 INFO:teuthology.orchestra.run.smithi078.stdout: "pool_snaps": [], 2024-04-18T21:05:47.966 INFO:teuthology.orchestra.run.smithi078.stdout: "removed_snaps": "[]", 2024-04-18T21:05:47.966 INFO:teuthology.orchestra.run.smithi078.stdout: "quota_max_bytes": 0, 2024-04-18T21:05:47.966 INFO:teuthology.orchestra.run.smithi078.stdout: "quota_max_objects": 0, 2024-04-18T21:05:47.966 INFO:teuthology.orchestra.run.smithi078.stdout: "tiers": [], 2024-04-18T21:05:47.967 INFO:teuthology.orchestra.run.smithi078.stdout: "tier_of": -1, 2024-04-18T21:05:47.967 INFO:teuthology.orchestra.run.smithi078.stdout: "read_tier": -1, 2024-04-18T21:05:47.967 INFO:teuthology.orchestra.run.smithi078.stdout: "write_tier": -1, 2024-04-18T21:05:47.967 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_mode": "none", 2024-04-18T21:05:47.967 INFO:teuthology.orchestra.run.smithi078.stdout: "target_max_bytes": 0, 2024-04-18T21:05:47.967 INFO:teuthology.orchestra.run.smithi078.stdout: "target_max_objects": 0, 2024-04-18T21:05:47.967 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:05:47.967 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:05:47.967 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:05:47.967 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_min_flush_age": 0, 2024-04-18T21:05:47.967 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_min_evict_age": 0, 2024-04-18T21:05:47.967 INFO:teuthology.orchestra.run.smithi078.stdout: "erasure_code_profile": "", 2024-04-18T21:05:47.967 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_params": { 2024-04-18T21:05:47.967 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "none" 2024-04-18T21:05:47.968 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:47.968 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_period": 0, 2024-04-18T21:05:47.968 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_count": 0, 2024-04-18T21:05:47.968 INFO:teuthology.orchestra.run.smithi078.stdout: "use_gmt_hitset": true, 2024-04-18T21:05:47.968 INFO:teuthology.orchestra.run.smithi078.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:05:47.968 INFO:teuthology.orchestra.run.smithi078.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:05:47.968 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:05:47.968 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:05:47.968 INFO:teuthology.orchestra.run.smithi078.stdout: "grade_table": [], 2024-04-18T21:05:47.968 INFO:teuthology.orchestra.run.smithi078.stdout: "stripe_width": 0, 2024-04-18T21:05:47.969 INFO:teuthology.orchestra.run.smithi078.stdout: "expected_num_objects": 0, 2024-04-18T21:05:47.969 INFO:teuthology.orchestra.run.smithi078.stdout: "fast_read": false, 2024-04-18T21:05:47.969 INFO:teuthology.orchestra.run.smithi078.stdout: "options": {}, 2024-04-18T21:05:47.969 INFO:teuthology.orchestra.run.smithi078.stdout: "application_metadata": { 2024-04-18T21:05:47.969 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd": {} 2024-04-18T21:05:47.969 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:47.969 INFO:teuthology.orchestra.run.smithi078.stdout: "read_balance": { 2024-04-18T21:05:47.969 INFO:teuthology.orchestra.run.smithi078.stdout: "score_type": "Fair distribution", 2024-04-18T21:05:47.969 INFO:teuthology.orchestra.run.smithi078.stdout: "score_acting": 1.5, 2024-04-18T21:05:47.969 INFO:teuthology.orchestra.run.smithi078.stdout: "score_stable": 1.5, 2024-04-18T21:05:47.969 INFO:teuthology.orchestra.run.smithi078.stdout: "optimal_score": 1, 2024-04-18T21:05:47.969 INFO:teuthology.orchestra.run.smithi078.stdout: "raw_score_acting": 1.5, 2024-04-18T21:05:47.969 INFO:teuthology.orchestra.run.smithi078.stdout: "raw_score_stable": 1.5, 2024-04-18T21:05:47.970 INFO:teuthology.orchestra.run.smithi078.stdout: "primary_affinity_weighted": 1, 2024-04-18T21:05:47.970 INFO:teuthology.orchestra.run.smithi078.stdout: "average_primary_affinity": 1, 2024-04-18T21:05:47.970 INFO:teuthology.orchestra.run.smithi078.stdout: "average_primary_affinity_weighted": 1 2024-04-18T21:05:47.970 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:47.970 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:47.970 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:47.970 INFO:teuthology.orchestra.run.smithi078.stdout: "pool": 3, 2024-04-18T21:05:47.970 INFO:teuthology.orchestra.run.smithi078.stdout: "pool_name": "cephfs_metadata", 2024-04-18T21:05:47.970 INFO:teuthology.orchestra.run.smithi078.stdout: "create_time": "2024-04-18T21:05:03.314171+0000", 2024-04-18T21:05:47.970 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-04-18T21:05:47.970 INFO:teuthology.orchestra.run.smithi078.stdout: "flags_names": "hashpspool", 2024-04-18T21:05:47.970 INFO:teuthology.orchestra.run.smithi078.stdout: "type": 1, 2024-04-18T21:05:47.970 INFO:teuthology.orchestra.run.smithi078.stdout: "size": 2, 2024-04-18T21:05:47.971 INFO:teuthology.orchestra.run.smithi078.stdout: "min_size": 1, 2024-04-18T21:05:47.971 INFO:teuthology.orchestra.run.smithi078.stdout: "crush_rule": 0, 2024-04-18T21:05:47.971 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:05:47.971 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:05:47.971 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:05:47.971 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:05:47.971 INFO:teuthology.orchestra.run.smithi078.stdout: "object_hash": 2, 2024-04-18T21:05:47.971 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:05:47.971 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num": 32, 2024-04-18T21:05:47.971 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_placement_num": 32, 2024-04-18T21:05:47.971 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_placement_num_target": 32, 2024-04-18T21:05:47.971 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_target": 32, 2024-04-18T21:05:47.972 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_pending": 32, 2024-04-18T21:05:47.972 INFO:teuthology.orchestra.run.smithi078.stdout: "last_pg_merge_meta": { 2024-04-18T21:05:47.972 INFO:teuthology.orchestra.run.smithi078.stdout: "source_pgid": "0.0", 2024-04-18T21:05:47.972 INFO:teuthology.orchestra.run.smithi078.stdout: "ready_epoch": 0, 2024-04-18T21:05:47.972 INFO:teuthology.orchestra.run.smithi078.stdout: "last_epoch_started": 0, 2024-04-18T21:05:47.972 INFO:teuthology.orchestra.run.smithi078.stdout: "last_epoch_clean": 0, 2024-04-18T21:05:47.972 INFO:teuthology.orchestra.run.smithi078.stdout: "source_version": "0'0", 2024-04-18T21:05:47.972 INFO:teuthology.orchestra.run.smithi078.stdout: "target_version": "0'0" 2024-04-18T21:05:47.972 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:47.972 INFO:teuthology.orchestra.run.smithi078.stdout: "last_change": "17", 2024-04-18T21:05:47.972 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend": "0", 2024-04-18T21:05:47.972 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:05:47.972 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:05:47.972 INFO:teuthology.orchestra.run.smithi078.stdout: "auid": 0, 2024-04-18T21:05:47.973 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:05:47.973 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_seq": 0, 2024-04-18T21:05:47.973 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_epoch": 0, 2024-04-18T21:05:47.973 INFO:teuthology.orchestra.run.smithi078.stdout: "pool_snaps": [], 2024-04-18T21:05:47.973 INFO:teuthology.orchestra.run.smithi078.stdout: "removed_snaps": "[]", 2024-04-18T21:05:47.973 INFO:teuthology.orchestra.run.smithi078.stdout: "quota_max_bytes": 0, 2024-04-18T21:05:47.973 INFO:teuthology.orchestra.run.smithi078.stdout: "quota_max_objects": 0, 2024-04-18T21:05:47.973 INFO:teuthology.orchestra.run.smithi078.stdout: "tiers": [], 2024-04-18T21:05:47.973 INFO:teuthology.orchestra.run.smithi078.stdout: "tier_of": -1, 2024-04-18T21:05:47.973 INFO:teuthology.orchestra.run.smithi078.stdout: "read_tier": -1, 2024-04-18T21:05:47.973 INFO:teuthology.orchestra.run.smithi078.stdout: "write_tier": -1, 2024-04-18T21:05:47.973 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_mode": "none", 2024-04-18T21:05:47.973 INFO:teuthology.orchestra.run.smithi078.stdout: "target_max_bytes": 0, 2024-04-18T21:05:47.973 INFO:teuthology.orchestra.run.smithi078.stdout: "target_max_objects": 0, 2024-04-18T21:05:47.973 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:05:47.973 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:05:47.974 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:05:47.974 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_min_flush_age": 0, 2024-04-18T21:05:47.974 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_min_evict_age": 0, 2024-04-18T21:05:47.974 INFO:teuthology.orchestra.run.smithi078.stdout: "erasure_code_profile": "", 2024-04-18T21:05:47.974 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_params": { 2024-04-18T21:05:47.974 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "none" 2024-04-18T21:05:47.974 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:47.974 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_period": 0, 2024-04-18T21:05:47.974 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_count": 0, 2024-04-18T21:05:47.974 INFO:teuthology.orchestra.run.smithi078.stdout: "use_gmt_hitset": true, 2024-04-18T21:05:47.974 INFO:teuthology.orchestra.run.smithi078.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:05:47.974 INFO:teuthology.orchestra.run.smithi078.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:05:47.974 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:05:47.974 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:05:47.975 INFO:teuthology.orchestra.run.smithi078.stdout: "grade_table": [], 2024-04-18T21:05:47.975 INFO:teuthology.orchestra.run.smithi078.stdout: "stripe_width": 0, 2024-04-18T21:05:47.975 INFO:teuthology.orchestra.run.smithi078.stdout: "expected_num_objects": 0, 2024-04-18T21:05:47.975 INFO:teuthology.orchestra.run.smithi078.stdout: "fast_read": false, 2024-04-18T21:05:47.975 INFO:teuthology.orchestra.run.smithi078.stdout: "options": { 2024-04-18T21:05:47.975 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_autoscale_bias": 4, 2024-04-18T21:05:47.975 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_min": 16, 2024-04-18T21:05:47.975 INFO:teuthology.orchestra.run.smithi078.stdout: "recovery_priority": 5 2024-04-18T21:05:47.975 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:47.975 INFO:teuthology.orchestra.run.smithi078.stdout: "application_metadata": { 2024-04-18T21:05:47.975 INFO:teuthology.orchestra.run.smithi078.stdout: "cephfs": { 2024-04-18T21:05:47.975 INFO:teuthology.orchestra.run.smithi078.stdout: "metadata": "cephfs" 2024-04-18T21:05:47.975 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:47.976 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:47.976 INFO:teuthology.orchestra.run.smithi078.stdout: "read_balance": { 2024-04-18T21:05:47.976 INFO:teuthology.orchestra.run.smithi078.stdout: "score_type": "Fair distribution", 2024-04-18T21:05:47.976 INFO:teuthology.orchestra.run.smithi078.stdout: "score_acting": 1.1299999952316284, 2024-04-18T21:05:47.976 INFO:teuthology.orchestra.run.smithi078.stdout: "score_stable": 1.1299999952316284, 2024-04-18T21:05:47.976 INFO:teuthology.orchestra.run.smithi078.stdout: "optimal_score": 1, 2024-04-18T21:05:47.976 INFO:teuthology.orchestra.run.smithi078.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-18T21:05:47.976 INFO:teuthology.orchestra.run.smithi078.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-18T21:05:47.976 INFO:teuthology.orchestra.run.smithi078.stdout: "primary_affinity_weighted": 1, 2024-04-18T21:05:47.976 INFO:teuthology.orchestra.run.smithi078.stdout: "average_primary_affinity": 1, 2024-04-18T21:05:47.976 INFO:teuthology.orchestra.run.smithi078.stdout: "average_primary_affinity_weighted": 1 2024-04-18T21:05:47.976 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:47.976 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:47.976 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:47.977 INFO:teuthology.orchestra.run.smithi078.stdout: "pool": 4, 2024-04-18T21:05:47.977 INFO:teuthology.orchestra.run.smithi078.stdout: "pool_name": "cephfs_data", 2024-04-18T21:05:47.977 INFO:teuthology.orchestra.run.smithi078.stdout: "create_time": "2024-04-18T21:05:03.931699+0000", 2024-04-18T21:05:47.977 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-04-18T21:05:47.977 INFO:teuthology.orchestra.run.smithi078.stdout: "flags_names": "hashpspool", 2024-04-18T21:05:47.977 INFO:teuthology.orchestra.run.smithi078.stdout: "type": 1, 2024-04-18T21:05:47.977 INFO:teuthology.orchestra.run.smithi078.stdout: "size": 2, 2024-04-18T21:05:47.977 INFO:teuthology.orchestra.run.smithi078.stdout: "min_size": 1, 2024-04-18T21:05:47.977 INFO:teuthology.orchestra.run.smithi078.stdout: "crush_rule": 0, 2024-04-18T21:05:47.977 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:05:47.977 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:05:47.977 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:05:47.977 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:05:47.978 INFO:teuthology.orchestra.run.smithi078.stdout: "object_hash": 2, 2024-04-18T21:05:47.978 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:05:47.978 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num": 64, 2024-04-18T21:05:47.978 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_placement_num": 64, 2024-04-18T21:05:47.978 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_placement_num_target": 64, 2024-04-18T21:05:47.978 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_target": 64, 2024-04-18T21:05:47.978 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_pending": 64, 2024-04-18T21:05:47.978 INFO:teuthology.orchestra.run.smithi078.stdout: "last_pg_merge_meta": { 2024-04-18T21:05:47.978 INFO:teuthology.orchestra.run.smithi078.stdout: "source_pgid": "0.0", 2024-04-18T21:05:47.978 INFO:teuthology.orchestra.run.smithi078.stdout: "ready_epoch": 0, 2024-04-18T21:05:47.978 INFO:teuthology.orchestra.run.smithi078.stdout: "last_epoch_started": 0, 2024-04-18T21:05:47.978 INFO:teuthology.orchestra.run.smithi078.stdout: "last_epoch_clean": 0, 2024-04-18T21:05:47.978 INFO:teuthology.orchestra.run.smithi078.stdout: "source_version": "0'0", 2024-04-18T21:05:47.978 INFO:teuthology.orchestra.run.smithi078.stdout: "target_version": "0'0" 2024-04-18T21:05:47.979 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:47.979 INFO:teuthology.orchestra.run.smithi078.stdout: "last_change": "18", 2024-04-18T21:05:47.979 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend": "0", 2024-04-18T21:05:47.979 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:05:47.979 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:05:47.979 INFO:teuthology.orchestra.run.smithi078.stdout: "auid": 0, 2024-04-18T21:05:47.979 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:05:47.979 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_seq": 0, 2024-04-18T21:05:47.979 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_epoch": 0, 2024-04-18T21:05:47.979 INFO:teuthology.orchestra.run.smithi078.stdout: "pool_snaps": [], 2024-04-18T21:05:47.979 INFO:teuthology.orchestra.run.smithi078.stdout: "removed_snaps": "[]", 2024-04-18T21:05:47.979 INFO:teuthology.orchestra.run.smithi078.stdout: "quota_max_bytes": 0, 2024-04-18T21:05:47.979 INFO:teuthology.orchestra.run.smithi078.stdout: "quota_max_objects": 0, 2024-04-18T21:05:47.980 INFO:teuthology.orchestra.run.smithi078.stdout: "tiers": [], 2024-04-18T21:05:47.980 INFO:teuthology.orchestra.run.smithi078.stdout: "tier_of": -1, 2024-04-18T21:05:47.980 INFO:teuthology.orchestra.run.smithi078.stdout: "read_tier": -1, 2024-04-18T21:05:47.980 INFO:teuthology.orchestra.run.smithi078.stdout: "write_tier": -1, 2024-04-18T21:05:47.980 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_mode": "none", 2024-04-18T21:05:47.980 INFO:teuthology.orchestra.run.smithi078.stdout: "target_max_bytes": 0, 2024-04-18T21:05:47.980 INFO:teuthology.orchestra.run.smithi078.stdout: "target_max_objects": 0, 2024-04-18T21:05:47.980 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:05:47.980 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:05:47.980 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:05:47.980 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_min_flush_age": 0, 2024-04-18T21:05:47.980 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_min_evict_age": 0, 2024-04-18T21:05:47.980 INFO:teuthology.orchestra.run.smithi078.stdout: "erasure_code_profile": "", 2024-04-18T21:05:47.980 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_params": { 2024-04-18T21:05:47.981 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "none" 2024-04-18T21:05:47.981 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:47.981 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_period": 0, 2024-04-18T21:05:47.981 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_count": 0, 2024-04-18T21:05:47.981 INFO:teuthology.orchestra.run.smithi078.stdout: "use_gmt_hitset": true, 2024-04-18T21:05:47.981 INFO:teuthology.orchestra.run.smithi078.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:05:47.981 INFO:teuthology.orchestra.run.smithi078.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:05:47.981 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:05:47.981 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:05:47.981 INFO:teuthology.orchestra.run.smithi078.stdout: "grade_table": [], 2024-04-18T21:05:47.981 INFO:teuthology.orchestra.run.smithi078.stdout: "stripe_width": 0, 2024-04-18T21:05:47.981 INFO:teuthology.orchestra.run.smithi078.stdout: "expected_num_objects": 0, 2024-04-18T21:05:47.981 INFO:teuthology.orchestra.run.smithi078.stdout: "fast_read": false, 2024-04-18T21:05:47.981 INFO:teuthology.orchestra.run.smithi078.stdout: "options": { 2024-04-18T21:05:47.981 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_min": 64, 2024-04-18T21:05:47.981 INFO:teuthology.orchestra.run.smithi078.stdout: "target_size_ratio": 0.89999997615814209 2024-04-18T21:05:47.982 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:47.982 INFO:teuthology.orchestra.run.smithi078.stdout: "application_metadata": { 2024-04-18T21:05:47.982 INFO:teuthology.orchestra.run.smithi078.stdout: "cephfs": { 2024-04-18T21:05:47.982 INFO:teuthology.orchestra.run.smithi078.stdout: "data": "cephfs" 2024-04-18T21:05:47.982 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:47.982 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:47.982 INFO:teuthology.orchestra.run.smithi078.stdout: "read_balance": { 2024-04-18T21:05:47.982 INFO:teuthology.orchestra.run.smithi078.stdout: "score_type": "Fair distribution", 2024-04-18T21:05:47.982 INFO:teuthology.orchestra.run.smithi078.stdout: "score_acting": 1.1299999952316284, 2024-04-18T21:05:47.982 INFO:teuthology.orchestra.run.smithi078.stdout: "score_stable": 1.1299999952316284, 2024-04-18T21:05:47.982 INFO:teuthology.orchestra.run.smithi078.stdout: "optimal_score": 1, 2024-04-18T21:05:47.982 INFO:teuthology.orchestra.run.smithi078.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-18T21:05:47.982 INFO:teuthology.orchestra.run.smithi078.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-18T21:05:47.982 INFO:teuthology.orchestra.run.smithi078.stdout: "primary_affinity_weighted": 1, 2024-04-18T21:05:47.982 INFO:teuthology.orchestra.run.smithi078.stdout: "average_primary_affinity": 1, 2024-04-18T21:05:47.983 INFO:teuthology.orchestra.run.smithi078.stdout: "average_primary_affinity_weighted": 1 2024-04-18T21:05:47.983 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:47.983 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:47.983 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-04-18T21:05:47.983 INFO:teuthology.orchestra.run.smithi078.stdout: "osds": [ 2024-04-18T21:05:47.983 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:47.983 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": 0, 2024-04-18T21:05:47.983 INFO:teuthology.orchestra.run.smithi078.stdout: "uuid": "1854d737-3a67-416a-8c88-0f126505a0f2", 2024-04-18T21:05:47.983 INFO:teuthology.orchestra.run.smithi078.stdout: "up": 1, 2024-04-18T21:05:47.983 INFO:teuthology.orchestra.run.smithi078.stdout: "in": 1, 2024-04-18T21:05:47.983 INFO:teuthology.orchestra.run.smithi078.stdout: "weight": 1, 2024-04-18T21:05:47.983 INFO:teuthology.orchestra.run.smithi078.stdout: "primary_affinity": 1, 2024-04-18T21:05:47.983 INFO:teuthology.orchestra.run.smithi078.stdout: "last_clean_begin": 0, 2024-04-18T21:05:47.983 INFO:teuthology.orchestra.run.smithi078.stdout: "last_clean_end": 0, 2024-04-18T21:05:47.983 INFO:teuthology.orchestra.run.smithi078.stdout: "up_from": 8, 2024-04-18T21:05:47.983 INFO:teuthology.orchestra.run.smithi078.stdout: "up_thru": 16, 2024-04-18T21:05:47.984 INFO:teuthology.orchestra.run.smithi078.stdout: "down_at": 0, 2024-04-18T21:05:47.984 INFO:teuthology.orchestra.run.smithi078.stdout: "lost_at": 0, 2024-04-18T21:05:47.984 INFO:teuthology.orchestra.run.smithi078.stdout: "public_addrs": { 2024-04-18T21:05:47.984 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:05:47.984 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:47.984 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:05:47.984 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.132:6800", 2024-04-18T21:05:47.984 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 1948809768 2024-04-18T21:05:47.984 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:47.984 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:47.984 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:05:47.984 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.132:6801", 2024-04-18T21:05:47.984 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 1948809768 2024-04-18T21:05:47.984 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:47.984 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:05:47.985 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:47.985 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_addrs": { 2024-04-18T21:05:47.985 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:05:47.985 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:47.985 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:05:47.985 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.132:6802", 2024-04-18T21:05:47.985 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 1948809768 2024-04-18T21:05:47.985 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:47.985 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:47.985 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:05:47.985 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.132:6803", 2024-04-18T21:05:47.985 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 1948809768 2024-04-18T21:05:47.985 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:47.985 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:05:47.986 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:47.986 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_back_addrs": { 2024-04-18T21:05:47.986 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:05:47.986 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:47.986 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:05:47.986 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.132:6806", 2024-04-18T21:05:47.986 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 1948809768 2024-04-18T21:05:47.986 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:47.986 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:47.986 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:05:47.986 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.132:6807", 2024-04-18T21:05:47.986 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 1948809768 2024-04-18T21:05:47.986 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:47.986 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:05:47.986 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:47.986 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_front_addrs": { 2024-04-18T21:05:47.987 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:05:47.987 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:47.987 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:05:47.987 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.132:6804", 2024-04-18T21:05:47.987 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 1948809768 2024-04-18T21:05:47.987 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:47.987 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:47.987 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:05:47.987 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.132:6805", 2024-04-18T21:05:47.987 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 1948809768 2024-04-18T21:05:47.987 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:47.987 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:05:47.987 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:47.987 INFO:teuthology.orchestra.run.smithi078.stdout: "public_addr": "172.21.15.132:6801/1948809768", 2024-04-18T21:05:47.987 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_addr": "172.21.15.132:6803/1948809768", 2024-04-18T21:05:47.988 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_back_addr": "172.21.15.132:6807/1948809768", 2024-04-18T21:05:47.988 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_front_addr": "172.21.15.132:6805/1948809768", 2024-04-18T21:05:47.988 INFO:teuthology.orchestra.run.smithi078.stdout: "state": [ 2024-04-18T21:05:47.988 INFO:teuthology.orchestra.run.smithi078.stdout: "exists", 2024-04-18T21:05:47.988 INFO:teuthology.orchestra.run.smithi078.stdout: "up" 2024-04-18T21:05:47.988 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:05:47.988 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:47.988 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:47.988 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": 1, 2024-04-18T21:05:47.988 INFO:teuthology.orchestra.run.smithi078.stdout: "uuid": "dfeae661-3f8a-4d41-b287-7eb02c16b91a", 2024-04-18T21:05:47.988 INFO:teuthology.orchestra.run.smithi078.stdout: "up": 1, 2024-04-18T21:05:47.988 INFO:teuthology.orchestra.run.smithi078.stdout: "in": 1, 2024-04-18T21:05:47.988 INFO:teuthology.orchestra.run.smithi078.stdout: "weight": 1, 2024-04-18T21:05:47.988 INFO:teuthology.orchestra.run.smithi078.stdout: "primary_affinity": 1, 2024-04-18T21:05:47.988 INFO:teuthology.orchestra.run.smithi078.stdout: "last_clean_begin": 0, 2024-04-18T21:05:47.989 INFO:teuthology.orchestra.run.smithi078.stdout: "last_clean_end": 0, 2024-04-18T21:05:47.989 INFO:teuthology.orchestra.run.smithi078.stdout: "up_from": 8, 2024-04-18T21:05:47.989 INFO:teuthology.orchestra.run.smithi078.stdout: "up_thru": 16, 2024-04-18T21:05:47.989 INFO:teuthology.orchestra.run.smithi078.stdout: "down_at": 0, 2024-04-18T21:05:47.989 INFO:teuthology.orchestra.run.smithi078.stdout: "lost_at": 0, 2024-04-18T21:05:47.989 INFO:teuthology.orchestra.run.smithi078.stdout: "public_addrs": { 2024-04-18T21:05:47.989 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:05:47.989 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:47.989 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:05:47.989 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.150:6800", 2024-04-18T21:05:47.989 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 2040503167 2024-04-18T21:05:47.989 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:47.989 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:47.989 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:05:47.990 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.150:6801", 2024-04-18T21:05:47.990 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 2040503167 2024-04-18T21:05:47.990 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:47.990 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:05:47.990 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:47.990 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_addrs": { 2024-04-18T21:05:47.990 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:05:47.990 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:47.990 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:05:47.990 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.150:6802", 2024-04-18T21:05:47.990 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 2040503167 2024-04-18T21:05:47.990 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:47.990 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:47.990 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:05:47.991 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.150:6803", 2024-04-18T21:05:47.991 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 2040503167 2024-04-18T21:05:47.991 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:47.991 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:05:47.991 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:47.991 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_back_addrs": { 2024-04-18T21:05:47.991 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:05:47.991 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:47.991 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:05:47.991 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.150:6806", 2024-04-18T21:05:47.991 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 2040503167 2024-04-18T21:05:47.991 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:47.991 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:47.991 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:05:47.992 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.150:6807", 2024-04-18T21:05:47.992 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 2040503167 2024-04-18T21:05:47.992 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:47.992 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:05:47.992 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:47.992 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_front_addrs": { 2024-04-18T21:05:47.992 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:05:47.992 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:47.992 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:05:47.992 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.150:6804", 2024-04-18T21:05:47.992 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 2040503167 2024-04-18T21:05:47.992 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:47.992 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:47.993 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:05:47.993 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.150:6805", 2024-04-18T21:05:47.993 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 2040503167 2024-04-18T21:05:47.993 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:47.993 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:05:47.993 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:47.993 INFO:teuthology.orchestra.run.smithi078.stdout: "public_addr": "172.21.15.150:6801/2040503167", 2024-04-18T21:05:47.993 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_addr": "172.21.15.150:6803/2040503167", 2024-04-18T21:05:47.993 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_back_addr": "172.21.15.150:6807/2040503167", 2024-04-18T21:05:47.993 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_front_addr": "172.21.15.150:6805/2040503167", 2024-04-18T21:05:47.993 INFO:teuthology.orchestra.run.smithi078.stdout: "state": [ 2024-04-18T21:05:47.993 INFO:teuthology.orchestra.run.smithi078.stdout: "exists", 2024-04-18T21:05:47.994 INFO:teuthology.orchestra.run.smithi078.stdout: "up" 2024-04-18T21:05:47.994 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:05:47.994 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:47.994 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:47.994 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": 2, 2024-04-18T21:05:47.994 INFO:teuthology.orchestra.run.smithi078.stdout: "uuid": "56a34021-e2dc-41ff-822c-7ec123466f25", 2024-04-18T21:05:47.994 INFO:teuthology.orchestra.run.smithi078.stdout: "up": 1, 2024-04-18T21:05:47.994 INFO:teuthology.orchestra.run.smithi078.stdout: "in": 1, 2024-04-18T21:05:47.994 INFO:teuthology.orchestra.run.smithi078.stdout: "weight": 1, 2024-04-18T21:05:47.994 INFO:teuthology.orchestra.run.smithi078.stdout: "primary_affinity": 1, 2024-04-18T21:05:47.994 INFO:teuthology.orchestra.run.smithi078.stdout: "last_clean_begin": 0, 2024-04-18T21:05:47.994 INFO:teuthology.orchestra.run.smithi078.stdout: "last_clean_end": 0, 2024-04-18T21:05:47.994 INFO:teuthology.orchestra.run.smithi078.stdout: "up_from": 8, 2024-04-18T21:05:47.995 INFO:teuthology.orchestra.run.smithi078.stdout: "up_thru": 16, 2024-04-18T21:05:47.995 INFO:teuthology.orchestra.run.smithi078.stdout: "down_at": 0, 2024-04-18T21:05:47.995 INFO:teuthology.orchestra.run.smithi078.stdout: "lost_at": 0, 2024-04-18T21:05:47.995 INFO:teuthology.orchestra.run.smithi078.stdout: "public_addrs": { 2024-04-18T21:05:47.995 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:05:47.995 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:47.995 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:05:47.995 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.187:6800", 2024-04-18T21:05:47.995 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 429896900 2024-04-18T21:05:47.995 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:47.995 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:47.995 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:05:47.995 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.187:6801", 2024-04-18T21:05:47.995 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 429896900 2024-04-18T21:05:47.996 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:47.996 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:05:47.996 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:47.996 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_addrs": { 2024-04-18T21:05:47.996 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:05:47.996 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:47.996 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:05:47.996 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.187:6802", 2024-04-18T21:05:47.996 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 429896900 2024-04-18T21:05:47.996 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:47.996 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:47.996 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:05:47.996 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.187:6803", 2024-04-18T21:05:47.996 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 429896900 2024-04-18T21:05:47.996 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:47.997 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:05:47.997 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:47.997 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_back_addrs": { 2024-04-18T21:05:47.997 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:05:47.997 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:47.997 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:05:47.997 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.187:6806", 2024-04-18T21:05:47.997 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 429896900 2024-04-18T21:05:47.997 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:47.997 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:47.997 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:05:47.997 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.187:6807", 2024-04-18T21:05:47.997 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 429896900 2024-04-18T21:05:47.997 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:47.997 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:05:47.998 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:47.998 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_front_addrs": { 2024-04-18T21:05:47.998 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:05:47.998 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:47.998 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:05:47.998 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.187:6804", 2024-04-18T21:05:47.998 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 429896900 2024-04-18T21:05:47.998 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:47.998 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:47.998 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:05:47.998 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.187:6805", 2024-04-18T21:05:47.998 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 429896900 2024-04-18T21:05:47.998 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:47.998 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:05:47.999 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:47.999 INFO:teuthology.orchestra.run.smithi078.stdout: "public_addr": "172.21.15.187:6801/429896900", 2024-04-18T21:05:47.999 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_addr": "172.21.15.187:6803/429896900", 2024-04-18T21:05:47.999 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_back_addr": "172.21.15.187:6807/429896900", 2024-04-18T21:05:47.999 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_front_addr": "172.21.15.187:6805/429896900", 2024-04-18T21:05:47.999 INFO:teuthology.orchestra.run.smithi078.stdout: "state": [ 2024-04-18T21:05:47.999 INFO:teuthology.orchestra.run.smithi078.stdout: "exists", 2024-04-18T21:05:47.999 INFO:teuthology.orchestra.run.smithi078.stdout: "up" 2024-04-18T21:05:47.999 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:05:47.999 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:47.999 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-04-18T21:05:47.999 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_xinfo": [ 2024-04-18T21:05:47.999 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:48.000 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": 0, 2024-04-18T21:05:48.000 INFO:teuthology.orchestra.run.smithi078.stdout: "down_stamp": "0.000000", 2024-04-18T21:05:48.000 INFO:teuthology.orchestra.run.smithi078.stdout: "laggy_probability": 0, 2024-04-18T21:05:48.000 INFO:teuthology.orchestra.run.smithi078.stdout: "laggy_interval": 0, 2024-04-18T21:05:48.000 INFO:teuthology.orchestra.run.smithi078.stdout: "features": 4540701547738038271, 2024-04-18T21:05:48.000 INFO:teuthology.orchestra.run.smithi078.stdout: "old_weight": 0, 2024-04-18T21:05:48.000 INFO:teuthology.orchestra.run.smithi078.stdout: "last_purged_snaps_scrub": "2024-04-18T21:04:49.804359+0000", 2024-04-18T21:05:48.000 INFO:teuthology.orchestra.run.smithi078.stdout: "dead_epoch": 0 2024-04-18T21:05:48.000 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:48.000 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:48.000 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": 1, 2024-04-18T21:05:48.000 INFO:teuthology.orchestra.run.smithi078.stdout: "down_stamp": "0.000000", 2024-04-18T21:05:48.000 INFO:teuthology.orchestra.run.smithi078.stdout: "laggy_probability": 0, 2024-04-18T21:05:48.000 INFO:teuthology.orchestra.run.smithi078.stdout: "laggy_interval": 0, 2024-04-18T21:05:48.000 INFO:teuthology.orchestra.run.smithi078.stdout: "features": 4540701547738038271, 2024-04-18T21:05:48.001 INFO:teuthology.orchestra.run.smithi078.stdout: "old_weight": 0, 2024-04-18T21:05:48.001 INFO:teuthology.orchestra.run.smithi078.stdout: "last_purged_snaps_scrub": "2024-04-18T21:04:49.790978+0000", 2024-04-18T21:05:48.001 INFO:teuthology.orchestra.run.smithi078.stdout: "dead_epoch": 0 2024-04-18T21:05:48.001 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:48.001 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:48.001 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": 2, 2024-04-18T21:05:48.001 INFO:teuthology.orchestra.run.smithi078.stdout: "down_stamp": "0.000000", 2024-04-18T21:05:48.001 INFO:teuthology.orchestra.run.smithi078.stdout: "laggy_probability": 0, 2024-04-18T21:05:48.001 INFO:teuthology.orchestra.run.smithi078.stdout: "laggy_interval": 0, 2024-04-18T21:05:48.001 INFO:teuthology.orchestra.run.smithi078.stdout: "features": 4540701547738038271, 2024-04-18T21:05:48.001 INFO:teuthology.orchestra.run.smithi078.stdout: "old_weight": 0, 2024-04-18T21:05:48.001 INFO:teuthology.orchestra.run.smithi078.stdout: "last_purged_snaps_scrub": "2024-04-18T21:04:49.762943+0000", 2024-04-18T21:05:48.001 INFO:teuthology.orchestra.run.smithi078.stdout: "dead_epoch": 0 2024-04-18T21:05:48.001 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:48.001 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-04-18T21:05:48.001 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_upmap": [], 2024-04-18T21:05:48.002 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_upmap_items": [], 2024-04-18T21:05:48.002 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_upmap_primaries": [], 2024-04-18T21:05:48.002 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_temp": [], 2024-04-18T21:05:48.002 INFO:teuthology.orchestra.run.smithi078.stdout: "primary_temp": [], 2024-04-18T21:05:48.002 INFO:teuthology.orchestra.run.smithi078.stdout: "blocklist": {}, 2024-04-18T21:05:48.002 INFO:teuthology.orchestra.run.smithi078.stdout: "range_blocklist": {}, 2024-04-18T21:05:48.002 INFO:teuthology.orchestra.run.smithi078.stdout: "erasure_code_profiles": { 2024-04-18T21:05:48.002 INFO:teuthology.orchestra.run.smithi078.stdout: "default": { 2024-04-18T21:05:48.002 INFO:teuthology.orchestra.run.smithi078.stdout: "crush-failure-domain": "osd", 2024-04-18T21:05:48.002 INFO:teuthology.orchestra.run.smithi078.stdout: "k": "2", 2024-04-18T21:05:48.002 INFO:teuthology.orchestra.run.smithi078.stdout: "m": "1", 2024-04-18T21:05:48.002 INFO:teuthology.orchestra.run.smithi078.stdout: "plugin": "jerasure", 2024-04-18T21:05:48.002 INFO:teuthology.orchestra.run.smithi078.stdout: "technique": "reed_sol_van" 2024-04-18T21:05:48.002 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:48.003 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:48.003 INFO:teuthology.orchestra.run.smithi078.stdout: "removed_snaps_queue": [], 2024-04-18T21:05:48.003 INFO:teuthology.orchestra.run.smithi078.stdout: "new_removed_snaps": [], 2024-04-18T21:05:48.003 INFO:teuthology.orchestra.run.smithi078.stdout: "new_purged_snaps": [], 2024-04-18T21:05:48.003 INFO:teuthology.orchestra.run.smithi078.stdout: "crush_node_flags": {}, 2024-04-18T21:05:48.003 INFO:teuthology.orchestra.run.smithi078.stdout: "device_class_flags": {}, 2024-04-18T21:05:48.003 INFO:teuthology.orchestra.run.smithi078.stdout: "stretch_mode": { 2024-04-18T21:05:48.003 INFO:teuthology.orchestra.run.smithi078.stdout: "stretch_mode_enabled": false, 2024-04-18T21:05:48.003 INFO:teuthology.orchestra.run.smithi078.stdout: "stretch_bucket_count": 0, 2024-04-18T21:05:48.003 INFO:teuthology.orchestra.run.smithi078.stdout: "degraded_stretch_mode": 0, 2024-04-18T21:05:48.003 INFO:teuthology.orchestra.run.smithi078.stdout: "recovering_stretch_mode": 0, 2024-04-18T21:05:48.003 INFO:teuthology.orchestra.run.smithi078.stdout: "stretch_mode_bucket": 0 2024-04-18T21:05:48.003 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:48.003 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-04-18T21:05:48.004 INFO:tasks.thrashosds.thrasher:j is {'epoch': 27, 'fsid': 'dc017990-0393-4ab0-b604-5e7052fdc7bd', 'created': '2024-04-18T21:04:43.507538+0000', 'modified': '2024-04-18T21:05:45.876929+0000', 'last_up_change': '2024-04-18T21:04:52.492503+0000', 'last_in_change': '2024-04-18T21:04:44.402191+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T21:04:52.538153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-18T21:04:58.673793+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T21:05:03.314171+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T21:05:03.931699+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '1854d737-3a67-416a-8c88-0f126505a0f2', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.132:6800', 'nonce': 1948809768}, {'type': 'v1', 'addr': '172.21.15.132:6801', 'nonce': 1948809768}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.132:6802', 'nonce': 1948809768}, {'type': 'v1', 'addr': '172.21.15.132:6803', 'nonce': 1948809768}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.132:6806', 'nonce': 1948809768}, {'type': 'v1', 'addr': '172.21.15.132:6807', 'nonce': 1948809768}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.132:6804', 'nonce': 1948809768}, {'type': 'v1', 'addr': '172.21.15.132:6805', 'nonce': 1948809768}]}, 'public_addr': '172.21.15.132:6801/1948809768', 'cluster_addr': '172.21.15.132:6803/1948809768', 'heartbeat_back_addr': '172.21.15.132:6807/1948809768', 'heartbeat_front_addr': '172.21.15.132:6805/1948809768', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'dfeae661-3f8a-4d41-b287-7eb02c16b91a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6800', 'nonce': 2040503167}, {'type': 'v1', 'addr': '172.21.15.150:6801', 'nonce': 2040503167}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6802', 'nonce': 2040503167}, {'type': 'v1', 'addr': '172.21.15.150:6803', 'nonce': 2040503167}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6806', 'nonce': 2040503167}, {'type': 'v1', 'addr': '172.21.15.150:6807', 'nonce': 2040503167}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6804', 'nonce': 2040503167}, {'type': 'v1', 'addr': '172.21.15.150:6805', 'nonce': 2040503167}]}, 'public_addr': '172.21.15.150:6801/2040503167', 'cluster_addr': '172.21.15.150:6803/2040503167', 'heartbeat_back_addr': '172.21.15.150:6807/2040503167', 'heartbeat_front_addr': '172.21.15.150:6805/2040503167', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '56a34021-e2dc-41ff-822c-7ec123466f25', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6800', 'nonce': 429896900}, {'type': 'v1', 'addr': '172.21.15.187:6801', 'nonce': 429896900}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6802', 'nonce': 429896900}, {'type': 'v1', 'addr': '172.21.15.187:6803', 'nonce': 429896900}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6806', 'nonce': 429896900}, {'type': 'v1', 'addr': '172.21.15.187:6807', 'nonce': 429896900}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6804', 'nonce': 429896900}, {'type': 'v1', 'addr': '172.21.15.187:6805', 'nonce': 429896900}]}, 'public_addr': '172.21.15.187:6801/429896900', 'cluster_addr': '172.21.15.187:6803/429896900', 'heartbeat_back_addr': '172.21.15.187:6807/429896900', 'heartbeat_front_addr': '172.21.15.187:6805/429896900', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-18T21:04:49.804359+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-18T21:04:49.790978+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-18T21:04:49.762943+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-18T21:05:48.004 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:05:48.005 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:05:48.005 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:05:48.006 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:47.955+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:48.055 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:48.055+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:48.136 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:05:48.136 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:05:48.137 INFO:teuthology.orchestra.run.smithi132.stdout: "num_ops": 0 2024-04-18T21:05:48.137 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:05:48.145 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:05:48.145 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:05:48.151 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:05:48.165 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1: {} 2024-04-18T21:05:48.166 INFO:teuthology.orchestra.run.smithi078.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:05:48.186 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:05:48.186 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:05:48.195 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:48.195+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:48.257 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:48.259+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:48.298 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:05:48.300 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-04-18T21:05:48.315 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2024-04-18T21:05:46.514361+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597719,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":256,"num_write_kb":3483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":95396,"kb_used_data":1856,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":283020124,"statfs":{"total":289910292480,"available":289812606976,"internally_reserved":0,"allocated":1900544,"data_stored":1449226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.667373"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:40.406790+0000","last_change":"2024-04-18T21:05:05.652795+0000","last_active":"2024-04-18T21:05:40.406790+0000","last_peered":"2024-04-18T21:05:40.406790+0000","last_clean":"2024-04-18T21:05:40.406790+0000","last_became_active":"2024-04-18T21:05:05.650121+0000","last_became_peered":"2024-04-18T21:05:05.650121+0000","last_unstale":"2024-04-18T21:05:40.406790+0000","last_undegraded":"2024-04-18T21:05:40.406790+0000","last_fullsized":"2024-04-18T21:05:40.406790+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:40.405892+0000","last_change":"2024-04-18T21:05:05.657531+0000","last_active":"2024-04-18T21:05:40.405892+0000","last_peered":"2024-04-18T21:05:40.405892+0000","last_clean":"2024-04-18T21:05:40.405892+0000","last_became_active":"2024-04-18T21:05:05.653101+0000","last_became_peered":"2024-04-18T21:05:05.653101+0000","last_unstale":"2024-04-18T21:05:40.405892+0000","last_undegraded":"2024-04-18T21:05:40.405892+0000","last_fullsized":"2024-04-18T21:05:40.405892+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:32:23.929877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.852205+0000","last_change":"2024-04-18T21:05:05.647965+0000","last_active":"2024-04-18T21:05:39.852205+0000","last_peered":"2024-04-18T21:05:39.852205+0000","last_clean":"2024-04-18T21:05:39.852205+0000","last_became_active":"2024-04-18T21:05:05.645931+0000","last_became_peered":"2024-04-18T21:05:05.645931+0000","last_unstale":"2024-04-18T21:05:39.852205+0000","last_undegraded":"2024-04-18T21:05:39.852205+0000","last_fullsized":"2024-04-18T21:05:39.852205+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:04.350492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.851763+0000","last_change":"2024-04-18T21:05:05.629321+0000","last_active":"2024-04-18T21:05:39.851763+0000","last_peered":"2024-04-18T21:05:39.851763+0000","last_clean":"2024-04-18T21:05:39.851763+0000","last_became_active":"2024-04-18T21:05:05.627956+0000","last_became_peered":"2024-04-18T21:05:05.627956+0000","last_unstale":"2024-04-18T21:05:39.851763+0000","last_undegraded":"2024-04-18T21:05:39.851763+0000","last_fullsized":"2024-04-18T21:05:39.851763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:15:28.458476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:40.405637+0000","last_change":"2024-04-18T21:05:05.648710+0000","last_active":"2024-04-18T21:05:40.405637+0000","last_peered":"2024-04-18T21:05:40.405637+0000","last_clean":"2024-04-18T21:05:40.405637+0000","last_became_active":"2024-04-18T21:05:05.647801+0000","last_became_peered":"2024-04-18T21:05:05.647801+0000","last_unstale":"2024-04-18T21:05:40.405637+0000","last_undegraded":"2024-04-18T21:05:40.405637+0000","last_fullsized":"2024-04-18T21:05:40.405637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:46:36.339289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.851076+0000","last_change":"2024-04-18T21:05:05.629095+0000","last_active":"2024-04-18T21:05:39.851076+0000","last_peered":"2024-04-18T21:05:39.851076+0000","last_clean":"2024-04-18T21:05:39.851076+0000","last_became_active":"2024-04-18T21:05:05.627664+0000","last_became_peered":"2024-04-18T21:05:05.627664+0000","last_unstale":"2024-04-18T21:05:39.851076+0000","last_undegraded":"2024-04-18T21:05:39.851076+0000","last_fullsized":"2024-04-18T21:05:39.851076+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:51:28.440070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.850959+0000","last_change":"2024-04-18T21:05:05.625047+0000","last_active":"2024-04-18T21:05:39.850959+0000","last_peered":"2024-04-18T21:05:39.850959+0000","last_clean":"2024-04-18T21:05:39.850959+0000","last_became_active":"2024-04-18T21:05:05.622781+0000","last_became_peered":"2024-04-18T21:05:05.622781+0000","last_unstale":"2024-04-18T21:05:39.850959+0000","last_undegraded":"2024-04-18T21:05:39.850959+0000","last_fullsized":"2024-04-18T21:05:39.850959+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:12.944469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.850582+0000","last_change":"2024-04-18T21:05:05.640390+0000","last_active":"2024-04-18T21:05:39.850582+0000","last_peered":"2024-04-18T21:05:39.850582+0000","last_clean":"2024-04-18T21:05:39.850582+0000","last_became_active":"2024-04-18T21:05:05.638295+0000","last_became_peered":"2024-04-18T21:05:05.638295+0000","last_unstale":"2024-04-18T21:05:39.850582+0000","last_undegraded":"2024-04-18T21:05:39.850582+0000","last_fullsized":"2024-04-18T21:05:39.850582+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:34:31.132458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.850935+0000","last_change":"2024-04-18T21:05:05.660752+0000","last_active":"2024-04-18T21:05:39.850935+0000","last_peered":"2024-04-18T21:05:39.850935+0000","last_clean":"2024-04-18T21:05:39.850935+0000","last_became_active":"2024-04-18T21:05:05.659226+0000","last_became_peered":"2024-04-18T21:05:05.659226+0000","last_unstale":"2024-04-18T21:05:39.850935+0000","last_undegraded":"2024-04-18T21:05:39.850935+0000","last_fullsized":"2024-04-18T21:05:39.850935+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:20:45.938503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:40.406147+0000","last_change":"2024-04-18T21:05:05.656660+0000","last_active":"2024-04-18T21:05:40.406147+0000","last_peered":"2024-04-18T21:05:40.406147+0000","last_clean":"2024-04-18T21:05:40.406147+0000","last_became_active":"2024-04-18T21:05:05.653829+0000","last_became_peered":"2024-04-18T21:05:05.653829+0000","last_unstale":"2024-04-18T21:05:40.406147+0000","last_undegraded":"2024-04-18T21:05:40.406147+0000","last_fullsized":"2024-04-18T21:05:40.406147+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:50:40.920146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.851956+0000","last_change":"2024-04-18T21:05:05.646721+0000","last_active":"2024-04-18T21:05:39.851956+0000","last_peered":"2024-04-18T21:05:39.851956+0000","last_clean":"2024-04-18T21:05:39.851956+0000","last_became_active":"2024-04-18T21:05:05.643421+0000","last_became_peered":"2024-04-18T21:05:05.643421+0000","last_unstale":"2024-04-18T21:05:39.851956+0000","last_undegraded":"2024-04-18T21:05:39.851956+0000","last_fullsized":"2024-04-18T21:05:39.851956+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:14:51.873741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:40.405459+0000","last_change":"2024-04-18T21:05:05.656320+0000","last_active":"2024-04-18T21:05:40.405459+0000","last_peered":"2024-04-18T21:05:40.405459+0000","last_clean":"2024-04-18T21:05:40.405459+0000","last_became_active":"2024-04-18T21:05:05.655508+0000","last_became_peered":"2024-04-18T21:05:05.655508+0000","last_unstale":"2024-04-18T21:05:40.405459+0000","last_undegraded":"2024-04-18T21:05:40.405459+0000","last_fullsized":"2024-04-18T21:05:40.405459+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:51.225379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:40.405157+0000","last_change":"2024-04-18T21:05:05.649001+0000","last_active":"2024-04-18T21:05:40.405157+0000","last_peered":"2024-04-18T21:05:40.405157+0000","last_clean":"2024-04-18T21:05:40.405157+0000","last_became_active":"2024-04-18T21:05:05.648070+0000","last_became_peered":"2024-04-18T21:05:05.648070+0000","last_unstale":"2024-04-18T21:05:40.405157+0000","last_undegraded":"2024-04-18T21:05:40.405157+0000","last_fullsized":"2024-04-18T21:05:40.405157+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:56.408234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.851256+0000","last_change":"2024-04-18T21:05:05.635880+0000","last_active":"2024-04-18T21:05:39.851256+0000","last_peered":"2024-04-18T21:05:39.851256+0000","last_clean":"2024-04-18T21:05:39.851256+0000","last_became_active":"2024-04-18T21:05:05.635089+0000","last_became_peered":"2024-04-18T21:05:05.635089+0000","last_unstale":"2024-04-18T21:05:39.851256+0000","last_undegraded":"2024-04-18T21:05:39.851256+0000","last_fullsized":"2024-04-18T21:05:39.851256+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:50:40.920146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.851026+0000","last_change":"2024-04-18T21:05:05.639640+0000","last_active":"2024-04-18T21:05:39.851026+0000","last_peered":"2024-04-18T21:05:39.851026+0000","last_clean":"2024-04-18T21:05:39.851026+0000","last_became_active":"2024-04-18T21:05:05.637311+0000","last_became_peered":"2024-04-18T21:05:05.637311+0000","last_unstale":"2024-04-18T21:05:39.851026+0000","last_undegraded":"2024-04-18T21:05:39.851026+0000","last_fullsized":"2024-04-18T21:05:39.851026+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:20:45.938503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.850582+0000","last_change":"2024-04-18T21:05:05.638203+0000","last_active":"2024-04-18T21:05:39.850582+0000","last_peered":"2024-04-18T21:05:39.850582+0000","last_clean":"2024-04-18T21:05:39.850582+0000","last_became_active":"2024-04-18T21:05:05.637352+0000","last_became_peered":"2024-04-18T21:05:05.637352+0000","last_unstale":"2024-04-18T21:05:39.850582+0000","last_undegraded":"2024-04-18T21:05:39.850582+0000","last_fullsized":"2024-04-18T21:05:39.850582+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.851687+0000","last_change":"2024-04-18T21:05:05.661613+0000","last_active":"2024-04-18T21:05:39.851687+0000","last_peered":"2024-04-18T21:05:39.851687+0000","last_clean":"2024-04-18T21:05:39.851687+0000","last_became_active":"2024-04-18T21:05:05.660496+0000","last_became_peered":"2024-04-18T21:05:05.660496+0000","last_unstale":"2024-04-18T21:05:39.851687+0000","last_undegraded":"2024-04-18T21:05:39.851687+0000","last_fullsized":"2024-04-18T21:05:39.851687+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:31:31.842528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:40.406408+0000","last_change":"2024-04-18T21:05:05.655261+0000","last_active":"2024-04-18T21:05:40.406408+0000","last_peered":"2024-04-18T21:05:40.406408+0000","last_clean":"2024-04-18T21:05:40.406408+0000","last_became_active":"2024-04-18T21:05:05.651388+0000","last_became_peered":"2024-04-18T21:05:05.651388+0000","last_unstale":"2024-04-18T21:05:40.406408+0000","last_undegraded":"2024-04-18T21:05:40.406408+0000","last_fullsized":"2024-04-18T21:05:40.406408+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:53.850184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.850586+0000","last_change":"2024-04-18T21:05:05.652710+0000","last_active":"2024-04-18T21:05:39.850586+0000","last_peered":"2024-04-18T21:05:39.850586+0000","last_clean":"2024-04-18T21:05:39.850586+0000","last_became_active":"2024-04-18T21:05:05.651929+0000","last_became_peered":"2024-04-18T21:05:05.651929+0000","last_unstale":"2024-04-18T21:05:39.850586+0000","last_undegraded":"2024-04-18T21:05:39.850586+0000","last_fullsized":"2024-04-18T21:05:39.850586+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:12.944469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.851902+0000","last_change":"2024-04-18T21:05:05.638338+0000","last_active":"2024-04-18T21:05:39.851902+0000","last_peered":"2024-04-18T21:05:39.851902+0000","last_clean":"2024-04-18T21:05:39.851902+0000","last_became_active":"2024-04-18T21:05:05.637567+0000","last_became_peered":"2024-04-18T21:05:05.637567+0000","last_unstale":"2024-04-18T21:05:39.851902+0000","last_undegraded":"2024-04-18T21:05:39.851902+0000","last_fullsized":"2024-04-18T21:05:39.851902+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.852581+0000","last_change":"2024-04-18T21:05:05.643606+0000","last_active":"2024-04-18T21:05:39.852581+0000","last_peered":"2024-04-18T21:05:39.852581+0000","last_clean":"2024-04-18T21:05:39.852581+0000","last_became_active":"2024-04-18T21:05:05.642991+0000","last_became_peered":"2024-04-18T21:05:05.642991+0000","last_unstale":"2024-04-18T21:05:39.852581+0000","last_undegraded":"2024-04-18T21:05:39.852581+0000","last_fullsized":"2024-04-18T21:05:39.852581+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:01.841786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:40.404971+0000","last_change":"2024-04-18T21:05:05.650896+0000","last_active":"2024-04-18T21:05:40.404971+0000","last_peered":"2024-04-18T21:05:40.404971+0000","last_clean":"2024-04-18T21:05:40.404971+0000","last_became_active":"2024-04-18T21:05:05.650083+0000","last_became_peered":"2024-04-18T21:05:05.650083+0000","last_unstale":"2024-04-18T21:05:40.404971+0000","last_undegraded":"2024-04-18T21:05:40.404971+0000","last_fullsized":"2024-04-18T21:05:40.404971+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:43:55.788425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.849185+0000","last_change":"2024-04-18T21:05:05.640362+0000","last_active":"2024-04-18T21:05:39.849185+0000","last_peered":"2024-04-18T21:05:39.849185+0000","last_clean":"2024-04-18T21:05:39.849185+0000","last_became_active":"2024-04-18T21:05:05.635643+0000","last_became_peered":"2024-04-18T21:05:05.635643+0000","last_unstale":"2024-04-18T21:05:39.849185+0000","last_undegraded":"2024-04-18T21:05:39.849185+0000","last_fullsized":"2024-04-18T21:05:39.849185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:43:55.788425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:40.404218+0000","last_change":"2024-04-18T21:05:05.642755+0000","last_active":"2024-04-18T21:05:40.404218+0000","last_peered":"2024-04-18T21:05:40.404218+0000","last_clean":"2024-04-18T21:05:40.404218+0000","last_became_active":"2024-04-18T21:05:05.642150+0000","last_became_peered":"2024-04-18T21:05:05.642150+0000","last_unstale":"2024-04-18T21:05:40.404218+0000","last_undegraded":"2024-04-18T21:05:40.404218+0000","last_fullsized":"2024-04-18T21:05:40.404218+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:29:22.647425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:40.406832+0000","last_change":"2024-04-18T21:05:05.653741+0000","last_active":"2024-04-18T21:05:40.406832+0000","last_peered":"2024-04-18T21:05:40.406832+0000","last_clean":"2024-04-18T21:05:40.406832+0000","last_became_active":"2024-04-18T21:05:05.650174+0000","last_became_peered":"2024-04-18T21:05:05.650174+0000","last_unstale":"2024-04-18T21:05:40.406832+0000","last_undegraded":"2024-04-18T21:05:40.406832+0000","last_fullsized":"2024-04-18T21:05:40.406832+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:04.350492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.850994+0000","last_change":"2024-04-18T21:05:05.649581+0000","last_active":"2024-04-18T21:05:39.850994+0000","last_peered":"2024-04-18T21:05:39.850994+0000","last_clean":"2024-04-18T21:05:39.850994+0000","last_became_active":"2024-04-18T21:05:05.648233+0000","last_became_peered":"2024-04-18T21:05:05.648233+0000","last_unstale":"2024-04-18T21:05:39.850994+0000","last_undegraded":"2024-04-18T21:05:39.850994+0000","last_fullsized":"2024-04-18T21:05:39.850994+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.852503+0000","last_change":"2024-04-18T21:05:05.646926+0000","last_active":"2024-04-18T21:05:39.852503+0000","last_peered":"2024-04-18T21:05:39.852503+0000","last_clean":"2024-04-18T21:05:39.852503+0000","last_became_active":"2024-04-18T21:05:05.644942+0000","last_became_peered":"2024-04-18T21:05:05.644942+0000","last_unstale":"2024-04-18T21:05:39.852503+0000","last_undegraded":"2024-04-18T21:05:39.852503+0000","last_fullsized":"2024-04-18T21:05:39.852503+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:53.850184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:40.406080+0000","last_change":"2024-04-18T21:05:05.656314+0000","last_active":"2024-04-18T21:05:40.406080+0000","last_peered":"2024-04-18T21:05:40.406080+0000","last_clean":"2024-04-18T21:05:40.406080+0000","last_became_active":"2024-04-18T21:05:05.655364+0000","last_became_peered":"2024-04-18T21:05:05.655364+0000","last_unstale":"2024-04-18T21:05:40.406080+0000","last_undegraded":"2024-04-18T21:05:40.406080+0000","last_fullsized":"2024-04-18T21:05:40.406080+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:27:17.530889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.850448+0000","last_change":"2024-04-18T21:05:05.653532+0000","last_active":"2024-04-18T21:05:39.850448+0000","last_peered":"2024-04-18T21:05:39.850448+0000","last_clean":"2024-04-18T21:05:39.850448+0000","last_became_active":"2024-04-18T21:05:05.652950+0000","last_became_peered":"2024-04-18T21:05:05.652950+0000","last_unstale":"2024-04-18T21:05:39.850448+0000","last_undegraded":"2024-04-18T21:05:39.850448+0000","last_fullsized":"2024-04-18T21:05:39.850448+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:51.225379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:40.405301+0000","last_change":"2024-04-18T21:05:05.648084+0000","last_active":"2024-04-18T21:05:40.405301+0000","last_peered":"2024-04-18T21:05:40.405301+0000","last_clean":"2024-04-18T21:05:40.405301+0000","last_became_active":"2024-04-18T21:05:05.645340+0000","last_became_peered":"2024-04-18T21:05:05.645340+0000","last_unstale":"2024-04-18T21:05:40.405301+0000","last_undegraded":"2024-04-18T21:05:40.405301+0000","last_fullsized":"2024-04-18T21:05:40.405301+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:34:31.132458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.849441+0000","last_change":"2024-04-18T21:05:05.655034+0000","last_active":"2024-04-18T21:05:39.849441+0000","last_peered":"2024-04-18T21:05:39.849441+0000","last_clean":"2024-04-18T21:05:39.849441+0000","last_became_active":"2024-04-18T21:05:05.654517+0000","last_became_peered":"2024-04-18T21:05:05.654517+0000","last_unstale":"2024-04-18T21:05:39.849441+0000","last_undegraded":"2024-04-18T21:05:39.849441+0000","last_fullsized":"2024-04-18T21:05:39.849441+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:34:38.427319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.850877+0000","last_change":"2024-04-18T21:05:05.626677+0000","last_active":"2024-04-18T21:05:39.850877+0000","last_peered":"2024-04-18T21:05:39.850877+0000","last_clean":"2024-04-18T21:05:39.850877+0000","last_became_active":"2024-04-18T21:05:05.624250+0000","last_became_peered":"2024-04-18T21:05:05.624250+0000","last_unstale":"2024-04-18T21:05:39.850877+0000","last_undegraded":"2024-04-18T21:05:39.850877+0000","last_fullsized":"2024-04-18T21:05:39.850877+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:51.225379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:40.405794+0000","last_change":"2024-04-18T21:05:05.649918+0000","last_active":"2024-04-18T21:05:40.405794+0000","last_peered":"2024-04-18T21:05:40.405794+0000","last_clean":"2024-04-18T21:05:40.405794+0000","last_became_active":"2024-04-18T21:05:05.647147+0000","last_became_peered":"2024-04-18T21:05:05.647147+0000","last_unstale":"2024-04-18T21:05:40.405794+0000","last_undegraded":"2024-04-18T21:05:40.405794+0000","last_fullsized":"2024-04-18T21:05:40.405794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:51:28.440070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.852948+0000","last_change":"2024-04-18T21:05:04.632748+0000","last_active":"2024-04-18T21:05:39.852948+0000","last_peered":"2024-04-18T21:05:39.852948+0000","last_clean":"2024-04-18T21:05:39.852948+0000","last_became_active":"2024-04-18T21:05:04.628407+0000","last_became_peered":"2024-04-18T21:05:04.628407+0000","last_unstale":"2024-04-18T21:05:39.852948+0000","last_undegraded":"2024-04-18T21:05:39.852948+0000","last_fullsized":"2024-04-18T21:05:39.852948+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:42:45.392908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:40.405928+0000","last_change":"2024-04-18T21:05:05.649199+0000","last_active":"2024-04-18T21:05:40.405928+0000","last_peered":"2024-04-18T21:05:40.405928+0000","last_clean":"2024-04-18T21:05:40.405928+0000","last_became_active":"2024-04-18T21:05:05.646898+0000","last_became_peered":"2024-04-18T21:05:05.646898+0000","last_unstale":"2024-04-18T21:05:40.405928+0000","last_undegraded":"2024-04-18T21:05:40.405928+0000","last_fullsized":"2024-04-18T21:05:40.405928+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:31:31.842528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.849944+0000","last_change":"2024-04-18T21:05:04.638017+0000","last_active":"2024-04-18T21:05:39.849944+0000","last_peered":"2024-04-18T21:05:39.849944+0000","last_clean":"2024-04-18T21:05:39.849944+0000","last_became_active":"2024-04-18T21:05:04.637287+0000","last_became_peered":"2024-04-18T21:05:04.637287+0000","last_unstale":"2024-04-18T21:05:39.849944+0000","last_undegraded":"2024-04-18T21:05:39.849944+0000","last_fullsized":"2024-04-18T21:05:39.849944+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:25.891472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.851457+0000","last_change":"2024-04-18T21:05:05.650757+0000","last_active":"2024-04-18T21:05:39.851457+0000","last_peered":"2024-04-18T21:05:39.851457+0000","last_clean":"2024-04-18T21:05:39.851457+0000","last_became_active":"2024-04-18T21:05:05.650143+0000","last_became_peered":"2024-04-18T21:05:05.650143+0000","last_unstale":"2024-04-18T21:05:39.851457+0000","last_undegraded":"2024-04-18T21:05:39.851457+0000","last_fullsized":"2024-04-18T21:05:39.851457+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:14:51.873741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:40.404915+0000","last_change":"2024-04-18T21:05:04.628489+0000","last_active":"2024-04-18T21:05:40.404915+0000","last_peered":"2024-04-18T21:05:40.404915+0000","last_clean":"2024-04-18T21:05:40.404915+0000","last_became_active":"2024-04-18T21:05:04.627279+0000","last_became_peered":"2024-04-18T21:05:04.627279+0000","last_unstale":"2024-04-18T21:05:40.404915+0000","last_undegraded":"2024-04-18T21:05:40.404915+0000","last_fullsized":"2024-04-18T21:05:40.404915+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:43:23.420744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.851013+0000","last_change":"2024-04-18T21:05:05.649347+0000","last_active":"2024-04-18T21:05:39.851013+0000","last_peered":"2024-04-18T21:05:39.851013+0000","last_clean":"2024-04-18T21:05:39.851013+0000","last_became_active":"2024-04-18T21:05:05.648144+0000","last_became_peered":"2024-04-18T21:05:05.648144+0000","last_unstale":"2024-04-18T21:05:39.851013+0000","last_undegraded":"2024-04-18T21:05:39.851013+0000","last_fullsized":"2024-04-18T21:05:39.851013+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:51:28.440070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.850966+0000","last_change":"2024-04-18T21:05:04.624089+0000","last_active":"2024-04-18T21:05:39.850966+0000","last_peered":"2024-04-18T21:05:39.850966+0000","last_clean":"2024-04-18T21:05:39.850966+0000","last_became_active":"2024-04-18T21:05:04.623238+0000","last_became_peered":"2024-04-18T21:05:04.623238+0000","last_unstale":"2024-04-18T21:05:39.850966+0000","last_undegraded":"2024-04-18T21:05:39.850966+0000","last_fullsized":"2024-04-18T21:05:39.850966+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:44:19.076499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.853024+0000","last_change":"2024-04-18T21:05:04.633907+0000","last_active":"2024-04-18T21:05:39.853024+0000","last_peered":"2024-04-18T21:05:39.853024+0000","last_clean":"2024-04-18T21:05:39.853024+0000","last_became_active":"2024-04-18T21:05:04.630308+0000","last_became_peered":"2024-04-18T21:05:04.630308+0000","last_unstale":"2024-04-18T21:05:39.853024+0000","last_undegraded":"2024-04-18T21:05:39.853024+0000","last_fullsized":"2024-04-18T21:05:39.853024+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:55:46.219812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:40.404413+0000","last_change":"2024-04-18T21:05:05.658572+0000","last_active":"2024-04-18T21:05:40.404413+0000","last_peered":"2024-04-18T21:05:40.404413+0000","last_clean":"2024-04-18T21:05:40.404413+0000","last_became_active":"2024-04-18T21:05:05.657842+0000","last_became_peered":"2024-04-18T21:05:05.657842+0000","last_unstale":"2024-04-18T21:05:40.404413+0000","last_undegraded":"2024-04-18T21:05:40.404413+0000","last_fullsized":"2024-04-18T21:05:40.404413+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:26:38.636530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:40.406700+0000","last_change":"2024-04-18T21:05:04.628541+0000","last_active":"2024-04-18T21:05:40.406700+0000","last_peered":"2024-04-18T21:05:40.406700+0000","last_clean":"2024-04-18T21:05:40.406700+0000","last_became_active":"2024-04-18T21:05:04.627407+0000","last_became_peered":"2024-04-18T21:05:04.627407+0000","last_unstale":"2024-04-18T21:05:40.406700+0000","last_undegraded":"2024-04-18T21:05:40.406700+0000","last_fullsized":"2024-04-18T21:05:40.406700+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:55:48.643174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:40.404608+0000","last_change":"2024-04-18T21:05:05.651649+0000","last_active":"2024-04-18T21:05:40.404608+0000","last_peered":"2024-04-18T21:05:40.404608+0000","last_clean":"2024-04-18T21:05:40.404608+0000","last_became_active":"2024-04-18T21:05:05.646809+0000","last_became_peered":"2024-04-18T21:05:05.646809+0000","last_unstale":"2024-04-18T21:05:40.404608+0000","last_undegraded":"2024-04-18T21:05:40.404608+0000","last_fullsized":"2024-04-18T21:05:40.404608+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:23.698827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.853066+0000","last_change":"2024-04-18T21:05:04.634055+0000","last_active":"2024-04-18T21:05:39.853066+0000","last_peered":"2024-04-18T21:05:39.853066+0000","last_clean":"2024-04-18T21:05:39.853066+0000","last_became_active":"2024-04-18T21:05:04.630736+0000","last_became_peered":"2024-04-18T21:05:04.630736+0000","last_unstale":"2024-04-18T21:05:39.853066+0000","last_undegraded":"2024-04-18T21:05:39.853066+0000","last_fullsized":"2024-04-18T21:05:39.853066+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:06:44.001512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.851785+0000","last_change":"2024-04-18T21:05:05.628869+0000","last_active":"2024-04-18T21:05:39.851785+0000","last_peered":"2024-04-18T21:05:39.851785+0000","last_clean":"2024-04-18T21:05:39.851785+0000","last_became_active":"2024-04-18T21:05:05.627071+0000","last_became_peered":"2024-04-18T21:05:05.627071+0000","last_unstale":"2024-04-18T21:05:39.851785+0000","last_undegraded":"2024-04-18T21:05:39.851785+0000","last_fullsized":"2024-04-18T21:05:39.851785+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:31:31.842528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.852829+0000","last_change":"2024-04-18T21:05:04.625520+0000","last_active":"2024-04-18T21:05:39.852829+0000","last_peered":"2024-04-18T21:05:39.852829+0000","last_clean":"2024-04-18T21:05:39.852829+0000","last_became_active":"2024-04-18T21:05:04.624656+0000","last_became_peered":"2024-04-18T21:05:04.624656+0000","last_unstale":"2024-04-18T21:05:39.852829+0000","last_undegraded":"2024-04-18T21:05:39.852829+0000","last_fullsized":"2024-04-18T21:05:39.852829+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:56:05.795125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.850123+0000","last_change":"2024-04-18T21:05:05.649406+0000","last_active":"2024-04-18T21:05:39.850123+0000","last_peered":"2024-04-18T21:05:39.850123+0000","last_clean":"2024-04-18T21:05:39.850123+0000","last_became_active":"2024-04-18T21:05:05.648380+0000","last_became_peered":"2024-04-18T21:05:05.648380+0000","last_unstale":"2024-04-18T21:05:39.850123+0000","last_undegraded":"2024-04-18T21:05:39.850123+0000","last_fullsized":"2024-04-18T21:05:39.850123+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.851145+0000","last_change":"2024-04-18T21:05:04.640216+0000","last_active":"2024-04-18T21:05:39.851145+0000","last_peered":"2024-04-18T21:05:39.851145+0000","last_clean":"2024-04-18T21:05:39.851145+0000","last_became_active":"2024-04-18T21:05:04.639349+0000","last_became_peered":"2024-04-18T21:05:04.639349+0000","last_unstale":"2024-04-18T21:05:39.851145+0000","last_undegraded":"2024-04-18T21:05:39.851145+0000","last_fullsized":"2024-04-18T21:05:39.851145+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:09:18.466987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.852172+0000","last_change":"2024-04-18T21:05:05.628850+0000","last_active":"2024-04-18T21:05:39.852172+0000","last_peered":"2024-04-18T21:05:39.852172+0000","last_clean":"2024-04-18T21:05:39.852172+0000","last_became_active":"2024-04-18T21:05:05.627521+0000","last_became_peered":"2024-04-18T21:05:05.627521+0000","last_unstale":"2024-04-18T21:05:39.852172+0000","last_undegraded":"2024-04-18T21:05:39.852172+0000","last_fullsized":"2024-04-18T21:05:39.852172+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:14:37.912032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.851971+0000","last_change":"2024-04-18T21:05:04.634674+0000","last_active":"2024-04-18T21:05:39.851971+0000","last_peered":"2024-04-18T21:05:39.851971+0000","last_clean":"2024-04-18T21:05:39.851971+0000","last_became_active":"2024-04-18T21:05:04.632284+0000","last_became_peered":"2024-04-18T21:05:04.632284+0000","last_unstale":"2024-04-18T21:05:39.851971+0000","last_undegraded":"2024-04-18T21:05:39.851971+0000","last_fullsized":"2024-04-18T21:05:39.851971+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:09:18.466987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.852700+0000","last_change":"2024-04-18T21:05:05.647377+0000","last_active":"2024-04-18T21:05:39.852700+0000","last_peered":"2024-04-18T21:05:39.852700+0000","last_clean":"2024-04-18T21:05:39.852700+0000","last_became_active":"2024-04-18T21:05:05.645067+0000","last_became_peered":"2024-04-18T21:05:05.645067+0000","last_unstale":"2024-04-18T21:05:39.852700+0000","last_undegraded":"2024-04-18T21:05:39.852700+0000","last_fullsized":"2024-04-18T21:05:39.852700+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:29:30.243751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:40.404983+0000","last_change":"2024-04-18T21:05:04.627578+0000","last_active":"2024-04-18T21:05:40.404983+0000","last_peered":"2024-04-18T21:05:40.404983+0000","last_clean":"2024-04-18T21:05:40.404983+0000","last_became_active":"2024-04-18T21:05:04.626786+0000","last_became_peered":"2024-04-18T21:05:04.626786+0000","last_unstale":"2024-04-18T21:05:40.404983+0000","last_undegraded":"2024-04-18T21:05:40.404983+0000","last_fullsized":"2024-04-18T21:05:40.404983+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:55:59.563512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.852663+0000","last_change":"2024-04-18T21:05:05.640817+0000","last_active":"2024-04-18T21:05:39.852663+0000","last_peered":"2024-04-18T21:05:39.852663+0000","last_clean":"2024-04-18T21:05:39.852663+0000","last_became_active":"2024-04-18T21:05:05.635526+0000","last_became_peered":"2024-04-18T21:05:05.635526+0000","last_unstale":"2024-04-18T21:05:39.852663+0000","last_undegraded":"2024-04-18T21:05:39.852663+0000","last_fullsized":"2024-04-18T21:05:39.852663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:44:29.823511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:40.404552+0000","last_change":"2024-04-18T21:05:04.636499+0000","last_active":"2024-04-18T21:05:40.404552+0000","last_peered":"2024-04-18T21:05:40.404552+0000","last_clean":"2024-04-18T21:05:40.404552+0000","last_became_active":"2024-04-18T21:05:04.635830+0000","last_became_peered":"2024-04-18T21:05:04.635830+0000","last_unstale":"2024-04-18T21:05:40.404552+0000","last_undegraded":"2024-04-18T21:05:40.404552+0000","last_fullsized":"2024-04-18T21:05:40.404552+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:26:30.565175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.851144+0000","last_change":"2024-04-18T21:05:05.660974+0000","last_active":"2024-04-18T21:05:39.851144+0000","last_peered":"2024-04-18T21:05:39.851144+0000","last_clean":"2024-04-18T21:05:39.851144+0000","last_became_active":"2024-04-18T21:05:05.659287+0000","last_became_peered":"2024-04-18T21:05:05.659287+0000","last_unstale":"2024-04-18T21:05:39.851144+0000","last_undegraded":"2024-04-18T21:05:39.851144+0000","last_fullsized":"2024-04-18T21:05:39.851144+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:50:40.920146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":236,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.851605+0000","last_change":"2024-04-18T21:04:54.511605+0000","last_active":"2024-04-18T21:05:39.851605+0000","last_peered":"2024-04-18T21:05:39.851605+0000","last_clean":"2024-04-18T21:05:39.851605+0000","last_became_active":"2024-04-18T21:04:54.510791+0000","last_became_peered":"2024-04-18T21:04:54.510791+0000","last_unstale":"2024-04-18T21:05:39.851605+0000","last_undegraded":"2024-04-18T21:05:39.851605+0000","last_fullsized":"2024-04-18T21:05:39.851605+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_clean_scrub_stamp":"2024-04-18T21:04:53.494814+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:46.262250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":34,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.853244+0000","last_change":"2024-04-18T21:05:00.576671+0000","last_active":"2024-04-18T21:05:39.853244+0000","last_peered":"2024-04-18T21:05:39.853244+0000","last_clean":"2024-04-18T21:05:39.853244+0000","last_became_active":"2024-04-18T21:05:00.575933+0000","last_became_peered":"2024-04-18T21:05:00.575933+0000","last_unstale":"2024-04-18T21:05:39.853244+0000","last_undegraded":"2024-04-18T21:05:39.853244+0000","last_fullsized":"2024-04-18T21:05:39.853244+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:14:59.207959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.850390+0000","last_change":"2024-04-18T21:05:04.639528+0000","last_active":"2024-04-18T21:05:39.850390+0000","last_peered":"2024-04-18T21:05:39.850390+0000","last_clean":"2024-04-18T21:05:39.850390+0000","last_became_active":"2024-04-18T21:05:04.638517+0000","last_became_peered":"2024-04-18T21:05:04.638517+0000","last_unstale":"2024-04-18T21:05:39.850390+0000","last_undegraded":"2024-04-18T21:05:39.850390+0000","last_fullsized":"2024-04-18T21:05:39.850390+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:55:46.219812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.852756+0000","last_change":"2024-04-18T21:05:05.647623+0000","last_active":"2024-04-18T21:05:39.852756+0000","last_peered":"2024-04-18T21:05:39.852756+0000","last_clean":"2024-04-18T21:05:39.852756+0000","last_became_active":"2024-04-18T21:05:05.645640+0000","last_became_peered":"2024-04-18T21:05:05.645640+0000","last_unstale":"2024-04-18T21:05:39.852756+0000","last_undegraded":"2024-04-18T21:05:39.852756+0000","last_fullsized":"2024-04-18T21:05:39.852756+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:59.950421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":34,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.851345+0000","last_change":"2024-04-18T21:05:00.571960+0000","last_active":"2024-04-18T21:05:39.851345+0000","last_peered":"2024-04-18T21:05:39.851345+0000","last_clean":"2024-04-18T21:05:39.851345+0000","last_became_active":"2024-04-18T21:05:00.571301+0000","last_became_peered":"2024-04-18T21:05:00.571301+0000","last_unstale":"2024-04-18T21:05:39.851345+0000","last_undegraded":"2024-04-18T21:05:39.851345+0000","last_fullsized":"2024-04-18T21:05:39.851345+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:31:59.262440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.850011+0000","last_change":"2024-04-18T21:05:04.638026+0000","last_active":"2024-04-18T21:05:39.850011+0000","last_peered":"2024-04-18T21:05:39.850011+0000","last_clean":"2024-04-18T21:05:39.850011+0000","last_became_active":"2024-04-18T21:05:04.637160+0000","last_became_peered":"2024-04-18T21:05:04.637160+0000","last_unstale":"2024-04-18T21:05:39.850011+0000","last_undegraded":"2024-04-18T21:05:39.850011+0000","last_fullsized":"2024-04-18T21:05:39.850011+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:33:48.703994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:40.406695+0000","last_change":"2024-04-18T21:05:05.654121+0000","last_active":"2024-04-18T21:05:40.406695+0000","last_peered":"2024-04-18T21:05:40.406695+0000","last_clean":"2024-04-18T21:05:40.406695+0000","last_became_active":"2024-04-18T21:05:05.651310+0000","last_became_peered":"2024-04-18T21:05:05.651310+0000","last_unstale":"2024-04-18T21:05:40.406695+0000","last_undegraded":"2024-04-18T21:05:40.406695+0000","last_fullsized":"2024-04-18T21:05:40.406695+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:01.841786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":34,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.850277+0000","last_change":"2024-04-18T21:05:00.578604+0000","last_active":"2024-04-18T21:05:39.850277+0000","last_peered":"2024-04-18T21:05:39.850277+0000","last_clean":"2024-04-18T21:05:39.850277+0000","last_became_active":"2024-04-18T21:05:00.577988+0000","last_became_peered":"2024-04-18T21:05:00.577988+0000","last_unstale":"2024-04-18T21:05:39.850277+0000","last_undegraded":"2024-04-18T21:05:39.850277+0000","last_fullsized":"2024-04-18T21:05:39.850277+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:54:54.201759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:40.404677+0000","last_change":"2024-04-18T21:05:04.627627+0000","last_active":"2024-04-18T21:05:40.404677+0000","last_peered":"2024-04-18T21:05:40.404677+0000","last_clean":"2024-04-18T21:05:40.404677+0000","last_became_active":"2024-04-18T21:05:04.626850+0000","last_became_peered":"2024-04-18T21:05:04.626850+0000","last_unstale":"2024-04-18T21:05:40.404677+0000","last_undegraded":"2024-04-18T21:05:40.404677+0000","last_fullsized":"2024-04-18T21:05:40.404677+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:43:31.453080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.851298+0000","last_change":"2024-04-18T21:05:05.661488+0000","last_active":"2024-04-18T21:05:39.851298+0000","last_peered":"2024-04-18T21:05:39.851298+0000","last_clean":"2024-04-18T21:05:39.851298+0000","last_became_active":"2024-04-18T21:05:05.660283+0000","last_became_peered":"2024-04-18T21:05:05.660283+0000","last_unstale":"2024-04-18T21:05:39.851298+0000","last_undegraded":"2024-04-18T21:05:39.851298+0000","last_fullsized":"2024-04-18T21:05:39.851298+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:04.350492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.852027+0000","last_change":"2024-04-18T21:05:00.576606+0000","last_active":"2024-04-18T21:05:39.852027+0000","last_peered":"2024-04-18T21:05:39.852027+0000","last_clean":"2024-04-18T21:05:39.852027+0000","last_became_active":"2024-04-18T21:05:00.575951+0000","last_became_peered":"2024-04-18T21:05:00.575951+0000","last_unstale":"2024-04-18T21:05:39.852027+0000","last_undegraded":"2024-04-18T21:05:39.852027+0000","last_fullsized":"2024-04-18T21:05:39.852027+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:32:17.612481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.853064+0000","last_change":"2024-04-18T21:05:04.627296+0000","last_active":"2024-04-18T21:05:39.853064+0000","last_peered":"2024-04-18T21:05:39.853064+0000","last_clean":"2024-04-18T21:05:39.853064+0000","last_became_active":"2024-04-18T21:05:04.626801+0000","last_became_peered":"2024-04-18T21:05:04.626801+0000","last_unstale":"2024-04-18T21:05:39.853064+0000","last_undegraded":"2024-04-18T21:05:39.853064+0000","last_fullsized":"2024-04-18T21:05:39.853064+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:46:36.285416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.850735+0000","last_change":"2024-04-18T21:05:05.655152+0000","last_active":"2024-04-18T21:05:39.850735+0000","last_peered":"2024-04-18T21:05:39.850735+0000","last_clean":"2024-04-18T21:05:39.850735+0000","last_became_active":"2024-04-18T21:05:05.654506+0000","last_became_peered":"2024-04-18T21:05:05.654506+0000","last_unstale":"2024-04-18T21:05:39.850735+0000","last_undegraded":"2024-04-18T21:05:39.850735+0000","last_fullsized":"2024-04-18T21:05:39.850735+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:32:23.929877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.853095+0000","last_change":"2024-04-18T21:05:04.628916+0000","last_active":"2024-04-18T21:05:39.853095+0000","last_peered":"2024-04-18T21:05:39.853095+0000","last_clean":"2024-04-18T21:05:39.853095+0000","last_became_active":"2024-04-18T21:05:04.628245+0000","last_became_peered":"2024-04-18T21:05:04.628245+0000","last_unstale":"2024-04-18T21:05:39.853095+0000","last_undegraded":"2024-04-18T21:05:39.853095+0000","last_fullsized":"2024-04-18T21:05:39.853095+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:34:58.562540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.851378+0000","last_change":"2024-04-18T21:05:00.578563+0000","last_active":"2024-04-18T21:05:39.851378+0000","last_peered":"2024-04-18T21:05:39.851378+0000","last_clean":"2024-04-18T21:05:39.851378+0000","last_became_active":"2024-04-18T21:05:00.577960+0000","last_became_peered":"2024-04-18T21:05:00.577960+0000","last_unstale":"2024-04-18T21:05:39.851378+0000","last_undegraded":"2024-04-18T21:05:39.851378+0000","last_fullsized":"2024-04-18T21:05:39.851378+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:31:59.262440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:40.405041+0000","last_change":"2024-04-18T21:05:05.646076+0000","last_active":"2024-04-18T21:05:40.405041+0000","last_peered":"2024-04-18T21:05:40.405041+0000","last_clean":"2024-04-18T21:05:40.405041+0000","last_became_active":"2024-04-18T21:05:05.645104+0000","last_became_peered":"2024-04-18T21:05:05.645104+0000","last_unstale":"2024-04-18T21:05:40.405041+0000","last_undegraded":"2024-04-18T21:05:40.405041+0000","last_fullsized":"2024-04-18T21:05:40.405041+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:34:38.427319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.851313+0000","last_change":"2024-04-18T21:05:04.639700+0000","last_active":"2024-04-18T21:05:39.851313+0000","last_peered":"2024-04-18T21:05:39.851313+0000","last_clean":"2024-04-18T21:05:39.851313+0000","last_became_active":"2024-04-18T21:05:04.638928+0000","last_became_peered":"2024-04-18T21:05:04.638928+0000","last_unstale":"2024-04-18T21:05:39.851313+0000","last_undegraded":"2024-04-18T21:05:39.851313+0000","last_fullsized":"2024-04-18T21:05:39.851313+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:00:08.877854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":34,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:40.406553+0000","last_change":"2024-04-18T21:05:00.576907+0000","last_active":"2024-04-18T21:05:40.406553+0000","last_peered":"2024-04-18T21:05:40.406553+0000","last_clean":"2024-04-18T21:05:40.406553+0000","last_became_active":"2024-04-18T21:05:00.576152+0000","last_became_peered":"2024-04-18T21:05:00.576152+0000","last_unstale":"2024-04-18T21:05:40.406553+0000","last_undegraded":"2024-04-18T21:05:40.406553+0000","last_fullsized":"2024-04-18T21:05:40.406553+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:25:07.270023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:40.405636+0000","last_change":"2024-04-18T21:05:05.646026+0000","last_active":"2024-04-18T21:05:40.405636+0000","last_peered":"2024-04-18T21:05:40.405636+0000","last_clean":"2024-04-18T21:05:40.405636+0000","last_became_active":"2024-04-18T21:05:05.645192+0000","last_became_peered":"2024-04-18T21:05:05.645192+0000","last_unstale":"2024-04-18T21:05:40.405636+0000","last_undegraded":"2024-04-18T21:05:40.405636+0000","last_fullsized":"2024-04-18T21:05:40.405636+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:05:46.009381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.851877+0000","last_change":"2024-04-18T21:05:04.640732+0000","last_active":"2024-04-18T21:05:39.851877+0000","last_peered":"2024-04-18T21:05:39.851877+0000","last_clean":"2024-04-18T21:05:39.851877+0000","last_became_active":"2024-04-18T21:05:04.638505+0000","last_became_peered":"2024-04-18T21:05:04.638505+0000","last_unstale":"2024-04-18T21:05:39.851877+0000","last_undegraded":"2024-04-18T21:05:39.851877+0000","last_fullsized":"2024-04-18T21:05:39.851877+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:34:58.562540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":34,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.851674+0000","last_change":"2024-04-18T21:05:00.579869+0000","last_active":"2024-04-18T21:05:39.851674+0000","last_peered":"2024-04-18T21:05:39.851674+0000","last_clean":"2024-04-18T21:05:39.851674+0000","last_became_active":"2024-04-18T21:05:00.579351+0000","last_became_peered":"2024-04-18T21:05:00.579351+0000","last_unstale":"2024-04-18T21:05:39.851674+0000","last_undegraded":"2024-04-18T21:05:39.851674+0000","last_fullsized":"2024-04-18T21:05:39.851674+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:15:02.061128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.849588+0000","last_change":"2024-04-18T21:05:05.642730+0000","last_active":"2024-04-18T21:05:39.849588+0000","last_peered":"2024-04-18T21:05:39.849588+0000","last_clean":"2024-04-18T21:05:39.849588+0000","last_became_active":"2024-04-18T21:05:05.641890+0000","last_became_peered":"2024-04-18T21:05:05.641890+0000","last_unstale":"2024-04-18T21:05:39.849588+0000","last_undegraded":"2024-04-18T21:05:39.849588+0000","last_fullsized":"2024-04-18T21:05:39.849588+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:05:46.009381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"21'3","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.851673+0000","last_change":"2024-04-18T21:05:04.639898+0000","last_active":"2024-04-18T21:05:39.851673+0000","last_peered":"2024-04-18T21:05:39.851673+0000","last_clean":"2024-04-18T21:05:39.851673+0000","last_became_active":"2024-04-18T21:05:04.639115+0000","last_became_peered":"2024-04-18T21:05:04.639115+0000","last_unstale":"2024-04-18T21:05:39.851673+0000","last_undegraded":"2024-04-18T21:05:39.851673+0000","last_fullsized":"2024-04-18T21:05:39.851673+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:44:19.076499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":34,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.853246+0000","last_change":"2024-04-18T21:05:00.572414+0000","last_active":"2024-04-18T21:05:39.853246+0000","last_peered":"2024-04-18T21:05:39.853246+0000","last_clean":"2024-04-18T21:05:39.853246+0000","last_became_active":"2024-04-18T21:05:00.571755+0000","last_became_peered":"2024-04-18T21:05:00.571755+0000","last_unstale":"2024-04-18T21:05:39.853246+0000","last_undegraded":"2024-04-18T21:05:39.853246+0000","last_fullsized":"2024-04-18T21:05:39.853246+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:15:02.061128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:40.404621+0000","last_change":"2024-04-18T21:05:05.655898+0000","last_active":"2024-04-18T21:05:40.404621+0000","last_peered":"2024-04-18T21:05:40.404621+0000","last_clean":"2024-04-18T21:05:40.404621+0000","last_became_active":"2024-04-18T21:05:05.654111+0000","last_became_peered":"2024-04-18T21:05:05.654111+0000","last_unstale":"2024-04-18T21:05:40.404621+0000","last_undegraded":"2024-04-18T21:05:40.404621+0000","last_fullsized":"2024-04-18T21:05:40.404621+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:19:38.537080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.852186+0000","last_change":"2024-04-18T21:05:05.641373+0000","last_active":"2024-04-18T21:05:39.852186+0000","last_peered":"2024-04-18T21:05:39.852186+0000","last_clean":"2024-04-18T21:05:39.852186+0000","last_became_active":"2024-04-18T21:05:05.634204+0000","last_became_peered":"2024-04-18T21:05:05.634204+0000","last_unstale":"2024-04-18T21:05:39.852186+0000","last_undegraded":"2024-04-18T21:05:39.852186+0000","last_fullsized":"2024-04-18T21:05:39.852186+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:27:35.995004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"21'10","reported_seq":38,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.852630+0000","last_change":"2024-04-18T21:05:04.631271+0000","last_active":"2024-04-18T21:05:39.852630+0000","last_peered":"2024-04-18T21:05:39.852630+0000","last_clean":"2024-04-18T21:05:39.852630+0000","last_became_active":"2024-04-18T21:05:04.630442+0000","last_became_peered":"2024-04-18T21:05:04.630442+0000","last_unstale":"2024-04-18T21:05:39.852630+0000","last_undegraded":"2024-04-18T21:05:39.852630+0000","last_fullsized":"2024-04-18T21:05:39.852630+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:33:48.703994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.849767+0000","last_change":"2024-04-18T21:05:05.637894+0000","last_active":"2024-04-18T21:05:39.849767+0000","last_peered":"2024-04-18T21:05:39.849767+0000","last_clean":"2024-04-18T21:05:39.849767+0000","last_became_active":"2024-04-18T21:05:05.636846+0000","last_became_peered":"2024-04-18T21:05:05.636846+0000","last_unstale":"2024-04-18T21:05:39.849767+0000","last_undegraded":"2024-04-18T21:05:39.849767+0000","last_fullsized":"2024-04-18T21:05:39.849767+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:34:31.132458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:40.406395+0000","last_change":"2024-04-18T21:05:04.631152+0000","last_active":"2024-04-18T21:05:40.406395+0000","last_peered":"2024-04-18T21:05:40.406395+0000","last_clean":"2024-04-18T21:05:40.406395+0000","last_became_active":"2024-04-18T21:05:04.628900+0000","last_became_peered":"2024-04-18T21:05:04.628900+0000","last_unstale":"2024-04-18T21:05:40.406395+0000","last_undegraded":"2024-04-18T21:05:40.406395+0000","last_fullsized":"2024-04-18T21:05:40.406395+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:40:21.452052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.852784+0000","last_change":"2024-04-18T21:05:04.629470+0000","last_active":"2024-04-18T21:05:39.852784+0000","last_peered":"2024-04-18T21:05:39.852784+0000","last_clean":"2024-04-18T21:05:39.852784+0000","last_became_active":"2024-04-18T21:05:04.628286+0000","last_became_peered":"2024-04-18T21:05:04.628286+0000","last_unstale":"2024-04-18T21:05:39.852784+0000","last_undegraded":"2024-04-18T21:05:39.852784+0000","last_fullsized":"2024-04-18T21:05:39.852784+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:00:08.877854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.849449+0000","last_change":"2024-04-18T21:05:05.642793+0000","last_active":"2024-04-18T21:05:39.849449+0000","last_peered":"2024-04-18T21:05:39.849449+0000","last_clean":"2024-04-18T21:05:39.849449+0000","last_became_active":"2024-04-18T21:05:05.641983+0000","last_became_peered":"2024-04-18T21:05:05.641983+0000","last_unstale":"2024-04-18T21:05:39.849449+0000","last_undegraded":"2024-04-18T21:05:39.849449+0000","last_fullsized":"2024-04-18T21:05:39.849449+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:46:36.339289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.851647+0000","last_change":"2024-04-18T21:05:04.641445+0000","last_active":"2024-04-18T21:05:39.851647+0000","last_peered":"2024-04-18T21:05:39.851647+0000","last_clean":"2024-04-18T21:05:39.851647+0000","last_became_active":"2024-04-18T21:05:04.640682+0000","last_became_peered":"2024-04-18T21:05:04.640682+0000","last_unstale":"2024-04-18T21:05:39.851647+0000","last_undegraded":"2024-04-18T21:05:39.851647+0000","last_fullsized":"2024-04-18T21:05:39.851647+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:46:36.285416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.849438+0000","last_change":"2024-04-18T21:05:05.641561+0000","last_active":"2024-04-18T21:05:39.849438+0000","last_peered":"2024-04-18T21:05:39.849438+0000","last_clean":"2024-04-18T21:05:39.849438+0000","last_became_active":"2024-04-18T21:05:05.640922+0000","last_became_peered":"2024-04-18T21:05:05.640922+0000","last_unstale":"2024-04-18T21:05:39.849438+0000","last_undegraded":"2024-04-18T21:05:39.849438+0000","last_fullsized":"2024-04-18T21:05:39.849438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:56.408234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:40.407045+0000","last_change":"2024-04-18T21:05:05.651530+0000","last_active":"2024-04-18T21:05:40.407045+0000","last_peered":"2024-04-18T21:05:40.407045+0000","last_clean":"2024-04-18T21:05:40.407045+0000","last_became_active":"2024-04-18T21:05:05.648167+0000","last_became_peered":"2024-04-18T21:05:05.648167+0000","last_unstale":"2024-04-18T21:05:40.407045+0000","last_undegraded":"2024-04-18T21:05:40.407045+0000","last_fullsized":"2024-04-18T21:05:40.407045+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:14:51.873741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.849713+0000","last_change":"2024-04-18T21:05:04.637369+0000","last_active":"2024-04-18T21:05:39.849713+0000","last_peered":"2024-04-18T21:05:39.849713+0000","last_clean":"2024-04-18T21:05:39.849713+0000","last_became_active":"2024-04-18T21:05:04.636468+0000","last_became_peered":"2024-04-18T21:05:04.636468+0000","last_unstale":"2024-04-18T21:05:39.849713+0000","last_undegraded":"2024-04-18T21:05:39.849713+0000","last_fullsized":"2024-04-18T21:05:39.849713+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:40:21.452052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.850895+0000","last_change":"2024-04-18T21:05:05.651245+0000","last_active":"2024-04-18T21:05:39.850895+0000","last_peered":"2024-04-18T21:05:39.850895+0000","last_clean":"2024-04-18T21:05:39.850895+0000","last_became_active":"2024-04-18T21:05:05.650463+0000","last_became_peered":"2024-04-18T21:05:05.650463+0000","last_unstale":"2024-04-18T21:05:39.850895+0000","last_undegraded":"2024-04-18T21:05:39.850895+0000","last_fullsized":"2024-04-18T21:05:39.850895+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:27:17.530889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.849804+0000","last_change":"2024-04-18T21:05:04.637597+0000","last_active":"2024-04-18T21:05:39.849804+0000","last_peered":"2024-04-18T21:05:39.849804+0000","last_clean":"2024-04-18T21:05:39.849804+0000","last_became_active":"2024-04-18T21:05:04.636827+0000","last_became_peered":"2024-04-18T21:05:04.636827+0000","last_unstale":"2024-04-18T21:05:39.849804+0000","last_undegraded":"2024-04-18T21:05:39.849804+0000","last_fullsized":"2024-04-18T21:05:39.849804+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:43.511952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:40.405662+0000","last_change":"2024-04-18T21:05:05.658971+0000","last_active":"2024-04-18T21:05:40.405662+0000","last_peered":"2024-04-18T21:05:40.405662+0000","last_clean":"2024-04-18T21:05:40.405662+0000","last_became_active":"2024-04-18T21:05:05.658363+0000","last_became_peered":"2024-04-18T21:05:05.658363+0000","last_unstale":"2024-04-18T21:05:40.405662+0000","last_undegraded":"2024-04-18T21:05:40.405662+0000","last_fullsized":"2024-04-18T21:05:40.405662+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:12.944469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:40.405902+0000","last_change":"2024-04-18T21:05:04.636585+0000","last_active":"2024-04-18T21:05:40.405902+0000","last_peered":"2024-04-18T21:05:40.405902+0000","last_clean":"2024-04-18T21:05:40.405902+0000","last_became_active":"2024-04-18T21:05:04.635670+0000","last_became_peered":"2024-04-18T21:05:04.635670+0000","last_unstale":"2024-04-18T21:05:40.405902+0000","last_undegraded":"2024-04-18T21:05:40.405902+0000","last_fullsized":"2024-04-18T21:05:40.405902+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:34:33.779063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:40.405587+0000","last_change":"2024-04-18T21:05:05.649960+0000","last_active":"2024-04-18T21:05:40.405587+0000","last_peered":"2024-04-18T21:05:40.405587+0000","last_clean":"2024-04-18T21:05:40.405587+0000","last_became_active":"2024-04-18T21:05:05.648528+0000","last_became_peered":"2024-04-18T21:05:05.648528+0000","last_unstale":"2024-04-18T21:05:40.405587+0000","last_undegraded":"2024-04-18T21:05:40.405587+0000","last_fullsized":"2024-04-18T21:05:40.405587+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:20:45.938503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:40.405959+0000","last_change":"2024-04-18T21:05:04.630151+0000","last_active":"2024-04-18T21:05:40.405959+0000","last_peered":"2024-04-18T21:05:40.405959+0000","last_clean":"2024-04-18T21:05:40.405959+0000","last_became_active":"2024-04-18T21:05:04.627968+0000","last_became_peered":"2024-04-18T21:05:04.627968+0000","last_unstale":"2024-04-18T21:05:40.405959+0000","last_undegraded":"2024-04-18T21:05:40.405959+0000","last_fullsized":"2024-04-18T21:05:40.405959+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:00:33.393636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.851915+0000","last_change":"2024-04-18T21:05:05.624840+0000","last_active":"2024-04-18T21:05:39.851915+0000","last_peered":"2024-04-18T21:05:39.851915+0000","last_clean":"2024-04-18T21:05:39.851915+0000","last_became_active":"2024-04-18T21:05:05.622950+0000","last_became_peered":"2024-04-18T21:05:05.622950+0000","last_unstale":"2024-04-18T21:05:39.851915+0000","last_undegraded":"2024-04-18T21:05:39.851915+0000","last_fullsized":"2024-04-18T21:05:39.851915+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:27:17.530889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.852516+0000","last_change":"2024-04-18T21:05:04.626715+0000","last_active":"2024-04-18T21:05:39.852516+0000","last_peered":"2024-04-18T21:05:39.852516+0000","last_clean":"2024-04-18T21:05:39.852516+0000","last_became_active":"2024-04-18T21:05:04.625270+0000","last_became_peered":"2024-04-18T21:05:04.625270+0000","last_unstale":"2024-04-18T21:05:39.852516+0000","last_undegraded":"2024-04-18T21:05:39.852516+0000","last_fullsized":"2024-04-18T21:05:39.852516+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:43.511952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.851527+0000","last_change":"2024-04-18T21:05:05.627962+0000","last_active":"2024-04-18T21:05:39.851527+0000","last_peered":"2024-04-18T21:05:39.851527+0000","last_clean":"2024-04-18T21:05:39.851527+0000","last_became_active":"2024-04-18T21:05:05.626698+0000","last_became_peered":"2024-04-18T21:05:05.626698+0000","last_unstale":"2024-04-18T21:05:39.851527+0000","last_undegraded":"2024-04-18T21:05:39.851527+0000","last_fullsized":"2024-04-18T21:05:39.851527+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:48:48.973087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:40.406075+0000","last_change":"2024-04-18T21:05:04.632776+0000","last_active":"2024-04-18T21:05:40.406075+0000","last_peered":"2024-04-18T21:05:40.406075+0000","last_clean":"2024-04-18T21:05:40.406075+0000","last_became_active":"2024-04-18T21:05:04.630142+0000","last_became_peered":"2024-04-18T21:05:04.630142+0000","last_unstale":"2024-04-18T21:05:40.406075+0000","last_undegraded":"2024-04-18T21:05:40.406075+0000","last_fullsized":"2024-04-18T21:05:40.406075+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:19:36.721897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:40.405239+0000","last_change":"2024-04-18T21:05:05.653025+0000","last_active":"2024-04-18T21:05:40.405239+0000","last_peered":"2024-04-18T21:05:40.405239+0000","last_clean":"2024-04-18T21:05:40.405239+0000","last_became_active":"2024-04-18T21:05:05.645039+0000","last_became_peered":"2024-04-18T21:05:05.645039+0000","last_unstale":"2024-04-18T21:05:40.405239+0000","last_undegraded":"2024-04-18T21:05:40.405239+0000","last_fullsized":"2024-04-18T21:05:40.405239+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.851448+0000","last_change":"2024-04-18T21:05:04.640134+0000","last_active":"2024-04-18T21:05:39.851448+0000","last_peered":"2024-04-18T21:05:39.851448+0000","last_clean":"2024-04-18T21:05:39.851448+0000","last_became_active":"2024-04-18T21:05:04.638597+0000","last_became_peered":"2024-04-18T21:05:04.638597+0000","last_unstale":"2024-04-18T21:05:39.851448+0000","last_undegraded":"2024-04-18T21:05:39.851448+0000","last_fullsized":"2024-04-18T21:05:39.851448+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:56:05.795125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.851278+0000","last_change":"2024-04-18T21:05:05.629022+0000","last_active":"2024-04-18T21:05:39.851278+0000","last_peered":"2024-04-18T21:05:39.851278+0000","last_clean":"2024-04-18T21:05:39.851278+0000","last_became_active":"2024-04-18T21:05:05.627643+0000","last_became_peered":"2024-04-18T21:05:05.627643+0000","last_unstale":"2024-04-18T21:05:39.851278+0000","last_undegraded":"2024-04-18T21:05:39.851278+0000","last_fullsized":"2024-04-18T21:05:39.851278+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:32:23.929877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T21:05:39.851378+0000","last_change":"2024-04-18T21:05:04.641338+0000","last_active":"2024-04-18T21:05:39.851378+0000","last_peered":"2024-04-18T21:05:39.851378+0000","last_clean":"2024-04-18T21:05:39.851378+0000","last_became_active":"2024-04-18T21:05:04.639958+0000","last_became_peered":"2024-04-18T21:05:04.639958+0000","last_unstale":"2024-04-18T21:05:39.851378+0000","last_undegraded":"2024-04-18T21:05:39.851378+0000","last_fullsized":"2024-04-18T21:05:39.851378+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:42:45.392908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7351,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738382,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35556,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336284,"statfs":{"total":96636764160,"available":96600354816,"internally_reserved":0,"allocated":221184,"data_stored":85212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738382,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":835584,"data_stored":681699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738380,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":843776,"data_stored":682315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:05:48.318 INFO:tasks.thrashosds.thrasher:Setting 4.1 to [1, 2, 0] 2024-04-18T21:05:48.319 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '4.1', '1', '2', '0'] 2024-04-18T21:05:48.319 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 4.1 1 2 0 2024-04-18T21:05:48.319 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:48.319 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:48.332 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:05:48.358 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:48.359+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:48.454 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:48.454 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:48.458 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:48.459+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:48.468 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:05:48.559 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:48.559+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:48.601 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:48.601 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:48.615 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:05:48.642 INFO:teuthology.orchestra.run.smithi078.stderr:Error EINVAL: you must specify pairs of osd ids to be remapped 2024-04-18T21:05:48.647 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-18T21:05:48.648 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2024-04-18T21:05:48.660 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:48.659+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:48.731 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:48.731 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:48.745 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:05:48.761 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:48.759+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:48.861 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:48.863+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:48.868 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:48.868 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:48.882 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:05:48.962 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:48.963+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:48.968 INFO:teuthology.orchestra.run.smithi078.stderr:nodeep-scrub is set 2024-04-18T21:05:49.014 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:49.014 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:49.028 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:05:49.063 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:49.063+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:49.150 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:49.150 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:49.164 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:49.163+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:49.166 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:05:49.265 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:49.267+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:49.287 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:49.288 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:49.301 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:05:49.366 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:49.367+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:49.435 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:49.435 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:49.450 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:05:49.466 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:49.467+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:49.568 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:49.568 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:49.568 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:49.567+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:49.582 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:05:49.668 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:49.667+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:49.705 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:49.705 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:49.719 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:05:49.768 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:49.767+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:49.854 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:49.854 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:49.869 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:49.867+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:49.870 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:05:49.970 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:49.971+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:50.035 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:50.035 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:50.049 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:05:50.071 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:50.071+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:50.172 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:50.171+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:50.203 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:05:50.215 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:50.216 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:50.231 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:05:50.272 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:50.271+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:50.362 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:05:50.362 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:05:50.364 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:50.364 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:50.373 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:50.371+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:50.379 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:05:50.382 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1: {} 2024-04-18T21:05:50.383 INFO:teuthology.orchestra.run.smithi078.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:05:50.401 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:05:50.401 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:05:50.474 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:50.475+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:50.502 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:05:50.502 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:05:50.502 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-18T21:05:50.502 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-18T21:05:50.502 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:05:50.516 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:05:50.575 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:50.575+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:50.638 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:05:50.638 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-18T21:05:50.638 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-18T21:05:50.639 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:05:50.639 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.639 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:50.639 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:05:50.639 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 45.024086386, 2024-04-18T21:05:50.639 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.034065303999999998, 2024-04-18T21:05:50.639 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:50.639 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:50.639 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:50.639 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:50.639 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.639 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:50.639 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:05:50.640 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:50.640 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.640 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.640 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:50.640 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:05:50.640 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:50.640 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.640 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.640 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:50.640 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615254+0000", 2024-04-18T21:05:50.640 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7829999999999999e-06 2024-04-18T21:05:50.640 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.640 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.640 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:50.640 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615267+0000", 2024-04-18T21:05:50.641 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3334e-05 2024-04-18T21:05:50.641 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.641 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.641 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:50.641 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615294+0000", 2024-04-18T21:05:50.641 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7271999999999999e-05 2024-04-18T21:05:50.641 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.641 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.641 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.641 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615321+0000", 2024-04-18T21:05:50.641 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.637e-05 2024-04-18T21:05:50.641 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.641 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.641 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:50.642 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615479+0000", 2024-04-18T21:05:50.642 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000158493 2024-04-18T21:05:50.642 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.642 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.642 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:50.642 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615498+0000", 2024-04-18T21:05:50.642 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9148999999999999e-05 2024-04-18T21:05:50.642 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.642 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.642 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:50.642 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632915+0000", 2024-04-18T21:05:50.642 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.017416551999999998 2024-04-18T21:05:50.642 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.642 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.643 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:50.643 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633302+0000", 2024-04-18T21:05:50.643 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00038725000000000001 2024-04-18T21:05:50.643 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.643 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.643 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:50.643 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633638+0000", 2024-04-18T21:05:50.643 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000335946 2024-04-18T21:05:50.643 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.643 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.643 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:50.643 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645976+0000", 2024-04-18T21:05:50.643 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012337617 2024-04-18T21:05:50.643 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.643 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.644 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:50.644 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649080+0000", 2024-04-18T21:05:50.644 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031038929999999999 2024-04-18T21:05:50.644 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.644 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.644 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:50.644 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649207+0000", 2024-04-18T21:05:50.644 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000127537 2024-04-18T21:05:50.644 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.644 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.644 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:50.645 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649316+0000", 2024-04-18T21:05:50.645 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109108 2024-04-18T21:05:50.645 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:50.645 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:50.645 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:50.645 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.645 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.645 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:50.645 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:05:50.645 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 45.023953009000003, 2024-04-18T21:05:50.645 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036275764000000002, 2024-04-18T21:05:50.645 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:50.645 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:50.645 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:50.646 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:50.646 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.646 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:50.646 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:05:50.646 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:50.646 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.646 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.646 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:50.646 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:05:50.646 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:50.646 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.646 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.646 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:50.646 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615386+0000", 2024-04-18T21:05:50.647 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.573e-06 2024-04-18T21:05:50.647 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.647 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.647 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:50.647 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:05:50.647 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0723999999999999e-05 2024-04-18T21:05:50.647 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.647 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.647 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:50.647 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615418+0000", 2024-04-18T21:05:50.647 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0902000000000001e-05 2024-04-18T21:05:50.647 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.647 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.647 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.647 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615433+0000", 2024-04-18T21:05:50.648 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5319999999999999e-05 2024-04-18T21:05:50.648 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.648 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.648 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:50.648 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615659+0000", 2024-04-18T21:05:50.648 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000226095 2024-04-18T21:05:50.648 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.648 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.648 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:50.648 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:50.648 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1276e-05 2024-04-18T21:05:50.648 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.648 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.648 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:50.648 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643654+0000", 2024-04-18T21:05:50.649 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027983238000000001 2024-04-18T21:05:50.649 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.649 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.649 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:50.649 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643868+0000", 2024-04-18T21:05:50.649 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000214305 2024-04-18T21:05:50.649 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.649 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.649 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:50.649 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:05:50.649 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035892200000000002 2024-04-18T21:05:50.649 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.649 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.649 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:50.649 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646056+0000", 2024-04-18T21:05:50.650 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001829172 2024-04-18T21:05:50.650 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.650 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.650 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:50.650 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651406+0000", 2024-04-18T21:05:50.650 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0053504800000000003 2024-04-18T21:05:50.650 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.650 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.650 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:50.650 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651551+0000", 2024-04-18T21:05:50.650 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014427999999999999 2024-04-18T21:05:50.650 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.650 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.651 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:50.651 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651660+0000", 2024-04-18T21:05:50.651 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109477 2024-04-18T21:05:50.651 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:50.651 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:50.651 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:50.651 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.651 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.651 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:50.651 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:05:50.651 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 45.023879626999999, 2024-04-18T21:05:50.651 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045668994999999997, 2024-04-18T21:05:50.651 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:50.651 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:50.651 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:50.652 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:50.652 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.652 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:50.652 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:05:50.652 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:50.652 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.652 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.652 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:50.652 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:05:50.652 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:50.652 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.652 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.652 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:50.652 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615459+0000", 2024-04-18T21:05:50.653 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5030000000000001e-06 2024-04-18T21:05:50.653 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.653 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.653 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:50.653 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615506+0000", 2024-04-18T21:05:50.653 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6872000000000001e-05 2024-04-18T21:05:50.653 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.653 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.653 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:50.653 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615527+0000", 2024-04-18T21:05:50.653 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0763000000000001e-05 2024-04-18T21:05:50.653 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.653 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.653 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.653 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615551+0000", 2024-04-18T21:05:50.654 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4159e-05 2024-04-18T21:05:50.654 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.654 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.654 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:50.654 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615736+0000", 2024-04-18T21:05:50.654 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018499599999999999 2024-04-18T21:05:50.654 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.654 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.654 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:50.654 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615748+0000", 2024-04-18T21:05:50.654 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2272999999999999e-05 2024-04-18T21:05:50.654 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.654 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.655 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:50.655 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635481+0000", 2024-04-18T21:05:50.655 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019732772999999999 2024-04-18T21:05:50.655 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.655 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.655 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:50.655 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635791+0000", 2024-04-18T21:05:50.655 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031013299999999998 2024-04-18T21:05:50.655 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.655 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.655 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:50.655 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636101+0000", 2024-04-18T21:05:50.655 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030943300000000002 2024-04-18T21:05:50.655 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.655 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.656 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:50.656 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646043+0000", 2024-04-18T21:05:50.656 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099428139999999995 2024-04-18T21:05:50.656 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.656 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.656 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:50.656 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660991+0000", 2024-04-18T21:05:50.656 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014947142 2024-04-18T21:05:50.656 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.656 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.656 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:50.656 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661061+0000", 2024-04-18T21:05:50.656 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0438000000000006e-05 2024-04-18T21:05:50.656 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.657 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.657 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:50.657 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661127+0000", 2024-04-18T21:05:50.657 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5696000000000003e-05 2024-04-18T21:05:50.657 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:50.657 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:50.657 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:50.657 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.657 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.657 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:50.657 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:50.657 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 45.023667199000002, 2024-04-18T21:05:50.657 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045745085999999997, 2024-04-18T21:05:50.657 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:50.657 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:50.658 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:50.658 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:50.658 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.658 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:50.658 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:50.658 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:50.658 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.658 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.658 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:50.658 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:50.658 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:50.658 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.658 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.658 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:50.659 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:05:50.659 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7400000000000001e-06 2024-04-18T21:05:50.659 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.659 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.659 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:50.659 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:05:50.659 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8133e-05 2024-04-18T21:05:50.659 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.659 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.659 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:50.659 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615726+0000", 2024-04-18T21:05:50.659 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6132e-05 2024-04-18T21:05:50.659 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.659 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.659 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.660 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615742+0000", 2024-04-18T21:05:50.660 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6157000000000001e-05 2024-04-18T21:05:50.660 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.660 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.660 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:50.660 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615937+0000", 2024-04-18T21:05:50.660 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000194768 2024-04-18T21:05:50.660 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.660 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.660 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:50.660 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615950+0000", 2024-04-18T21:05:50.660 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3084e-05 2024-04-18T21:05:50.660 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.660 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.661 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:50.661 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643676+0000", 2024-04-18T21:05:50.661 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027725639999999999 2024-04-18T21:05:50.661 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.661 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.661 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:50.661 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643867+0000", 2024-04-18T21:05:50.661 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019075900000000001 2024-04-18T21:05:50.661 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.661 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.661 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:50.661 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:05:50.662 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036013799999999997 2024-04-18T21:05:50.662 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.662 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.662 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:50.662 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646068+0000", 2024-04-18T21:05:50.662 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001841536 2024-04-18T21:05:50.662 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.662 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.662 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:50.662 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661184+0000", 2024-04-18T21:05:50.662 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015115458999999999 2024-04-18T21:05:50.663 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.663 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.663 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:50.663 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661283+0000", 2024-04-18T21:05:50.663 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9502999999999999e-05 2024-04-18T21:05:50.663 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.663 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.663 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:50.663 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661415+0000", 2024-04-18T21:05:50.663 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000132037 2024-04-18T21:05:50.663 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:50.663 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:50.663 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:50.663 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.664 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.664 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:50.664 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:05:50.664 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 45.023545511999998, 2024-04-18T21:05:50.664 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036185947000000003, 2024-04-18T21:05:50.664 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:50.664 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:50.664 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:50.664 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:50.664 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.664 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:50.664 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:05:50.664 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:50.664 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.665 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.665 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:50.665 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:05:50.665 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:50.665 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.665 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.665 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:50.665 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615794+0000", 2024-04-18T21:05:50.665 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6440000000000001e-06 2024-04-18T21:05:50.665 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.665 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.665 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:50.665 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615803+0000", 2024-04-18T21:05:50.665 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1220000000000001e-06 2024-04-18T21:05:50.665 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.666 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.666 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:50.666 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615827+0000", 2024-04-18T21:05:50.666 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3997000000000001e-05 2024-04-18T21:05:50.666 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.666 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.666 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.666 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615899+0000", 2024-04-18T21:05:50.666 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2741e-05 2024-04-18T21:05:50.666 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.666 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.666 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:50.666 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616019+0000", 2024-04-18T21:05:50.667 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119874 2024-04-18T21:05:50.667 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.667 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.667 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:50.667 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616029+0000", 2024-04-18T21:05:50.667 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:05:50.667 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.667 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.667 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:50.667 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644823+0000", 2024-04-18T21:05:50.667 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.028793151999999999 2024-04-18T21:05:50.667 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.667 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.667 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:50.668 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645106+0000", 2024-04-18T21:05:50.668 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028379700000000002 2024-04-18T21:05:50.668 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.668 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.668 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:50.668 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645294+0000", 2024-04-18T21:05:50.668 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000187181 2024-04-18T21:05:50.668 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.668 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.668 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:50.668 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646763+0000", 2024-04-18T21:05:50.668 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0014691050000000001 2024-04-18T21:05:50.668 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.668 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.669 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:50.669 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651784+0000", 2024-04-18T21:05:50.669 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050211650000000002 2024-04-18T21:05:50.669 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.669 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.669 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:50.669 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651876+0000", 2024-04-18T21:05:50.669 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2503999999999994e-05 2024-04-18T21:05:50.669 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.669 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.669 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:50.669 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651978+0000", 2024-04-18T21:05:50.669 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000101475 2024-04-18T21:05:50.669 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:50.670 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:50.670 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:50.670 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.670 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.670 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:50.670 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:50.670 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 45.023396904999998, 2024-04-18T21:05:50.670 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032262322000000003, 2024-04-18T21:05:50.670 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:50.670 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:50.670 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:50.670 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:50.670 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.670 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:50.671 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:50.671 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:50.671 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.671 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.671 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:50.671 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:50.671 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:50.671 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.671 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.671 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:50.671 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615943+0000", 2024-04-18T21:05:50.671 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1959999999999998e-06 2024-04-18T21:05:50.671 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.671 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.672 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:50.672 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615956+0000", 2024-04-18T21:05:50.672 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3424000000000001e-05 2024-04-18T21:05:50.672 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.672 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.672 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:50.672 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615983+0000", 2024-04-18T21:05:50.672 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7072000000000001e-05 2024-04-18T21:05:50.672 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.672 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.672 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.672 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616006+0000", 2024-04-18T21:05:50.672 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2823000000000002e-05 2024-04-18T21:05:50.672 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.672 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.673 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:50.673 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616156+0000", 2024-04-18T21:05:50.673 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014962299999999999 2024-04-18T21:05:50.673 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.673 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.673 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:50.673 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616174+0000", 2024-04-18T21:05:50.673 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8082999999999999e-05 2024-04-18T21:05:50.673 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.673 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.673 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:50.673 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.629952+0000", 2024-04-18T21:05:50.673 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013778514 2024-04-18T21:05:50.673 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.673 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.674 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:50.674 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630201+0000", 2024-04-18T21:05:50.674 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024918100000000001 2024-04-18T21:05:50.674 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.674 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.674 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:50.674 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630386+0000", 2024-04-18T21:05:50.674 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018436900000000001 2024-04-18T21:05:50.674 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.674 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.674 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:50.674 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643169+0000", 2024-04-18T21:05:50.674 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012782774 2024-04-18T21:05:50.674 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.675 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.675 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:50.675 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.647924+0000", 2024-04-18T21:05:50.675 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004755787 2024-04-18T21:05:50.675 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.675 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.675 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:50.675 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648069+0000", 2024-04-18T21:05:50.675 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014459600000000001 2024-04-18T21:05:50.675 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.675 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.675 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:50.675 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648203+0000", 2024-04-18T21:05:50.675 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013388000000000001 2024-04-18T21:05:50.676 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:50.676 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:50.676 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:50.676 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.676 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.676 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:50.676 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:05:50.676 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 45.023288641000001, 2024-04-18T21:05:50.676 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032489736999999998, 2024-04-18T21:05:50.676 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:50.676 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:50.676 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:50.676 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:50.676 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.677 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:50.677 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:05:50.677 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:50.677 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.677 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.677 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:50.677 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:05:50.677 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:50.677 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.677 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.677 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:50.677 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616050+0000", 2024-04-18T21:05:50.677 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.606e-06 2024-04-18T21:05:50.677 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.678 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.678 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:50.678 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616061+0000", 2024-04-18T21:05:50.678 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0463e-05 2024-04-18T21:05:50.678 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.678 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.678 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:50.678 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616092+0000", 2024-04-18T21:05:50.678 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1415999999999999e-05 2024-04-18T21:05:50.678 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.678 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.678 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.678 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616109+0000", 2024-04-18T21:05:50.678 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6557000000000001e-05 2024-04-18T21:05:50.679 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.679 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.679 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:50.679 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616358+0000", 2024-04-18T21:05:50.679 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000249077 2024-04-18T21:05:50.679 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.679 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.679 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:50.679 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616370+0000", 2024-04-18T21:05:50.679 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2037e-05 2024-04-18T21:05:50.679 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.679 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.679 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:50.680 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.634920+0000", 2024-04-18T21:05:50.680 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018550397 2024-04-18T21:05:50.680 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.680 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.680 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:50.680 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640420+0000", 2024-04-18T21:05:50.680 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055000539999999999 2024-04-18T21:05:50.680 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.680 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.680 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:50.680 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648538+0000", 2024-04-18T21:05:50.680 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0081181299999999994 2024-04-18T21:05:50.680 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:50.680 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:50.680 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:50.681 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.681 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.681 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:50.681 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:05:50.681 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 45.023204319999998, 2024-04-18T21:05:50.681 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036090029000000003, 2024-04-18T21:05:50.681 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:50.681 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:50.681 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:50.681 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:50.681 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.681 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:50.681 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:05:50.681 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:50.682 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.682 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.682 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:50.682 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:05:50.682 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:50.682 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.682 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.682 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:50.682 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616134+0000", 2024-04-18T21:05:50.682 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.353e-06 2024-04-18T21:05:50.682 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.682 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.682 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:50.682 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616141+0000", 2024-04-18T21:05:50.683 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2770000000000002e-06 2024-04-18T21:05:50.683 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.683 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.683 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:50.683 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616160+0000", 2024-04-18T21:05:50.683 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.91e-05 2024-04-18T21:05:50.683 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.683 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.683 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.683 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616170+0000", 2024-04-18T21:05:50.683 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7699999999999996e-06 2024-04-18T21:05:50.683 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.683 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.683 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:50.684 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616275+0000", 2024-04-18T21:05:50.684 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105313 2024-04-18T21:05:50.684 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.684 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.684 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:50.684 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616288+0000", 2024-04-18T21:05:50.684 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3027000000000001e-05 2024-04-18T21:05:50.684 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.684 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.684 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:50.684 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646160+0000", 2024-04-18T21:05:50.684 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.029872019 2024-04-18T21:05:50.684 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.684 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.684 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:50.685 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646368+0000", 2024-04-18T21:05:50.685 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020811899999999999 2024-04-18T21:05:50.685 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.685 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.685 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:50.685 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652223+0000", 2024-04-18T21:05:50.685 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.005855051 2024-04-18T21:05:50.685 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:50.685 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:50.685 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:50.685 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.685 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.685 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:50.685 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:05:50.686 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 45.023146750999999, 2024-04-18T21:05:50.686 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043572403000000003, 2024-04-18T21:05:50.686 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:50.686 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:50.686 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:50.686 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:50.686 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.686 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:50.686 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:05:50.686 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:50.686 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.686 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.686 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:50.686 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:05:50.687 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:50.687 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.687 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.687 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:50.687 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616192+0000", 2024-04-18T21:05:50.687 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:05:50.687 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.687 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.687 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:50.687 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616203+0000", 2024-04-18T21:05:50.687 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0890000000000001e-05 2024-04-18T21:05:50.687 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.687 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.687 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:50.687 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616223+0000", 2024-04-18T21:05:50.687 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0409000000000001e-05 2024-04-18T21:05:50.688 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.688 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.688 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.688 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616238+0000", 2024-04-18T21:05:50.688 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5160000000000001e-05 2024-04-18T21:05:50.688 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.688 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.688 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:50.688 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616343+0000", 2024-04-18T21:05:50.688 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000104831 2024-04-18T21:05:50.688 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.688 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.688 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:50.688 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616357+0000", 2024-04-18T21:05:50.688 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3686000000000001e-05 2024-04-18T21:05:50.689 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.689 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.689 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:50.689 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635912+0000", 2024-04-18T21:05:50.689 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019554944000000001 2024-04-18T21:05:50.689 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.689 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.689 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:50.689 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636231+0000", 2024-04-18T21:05:50.689 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000318766 2024-04-18T21:05:50.689 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.689 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.689 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:50.689 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659763+0000", 2024-04-18T21:05:50.689 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023532474000000001 2024-04-18T21:05:50.690 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:50.690 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:50.690 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:50.690 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.690 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.690 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:50.690 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:05:50.690 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 45.019218043999999, 2024-04-18T21:05:50.690 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015007971, 2024-04-18T21:05:50.690 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:50.690 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:50.690 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:50.690 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:50.690 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.691 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:50.691 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:05:50.691 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:50.691 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.691 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.691 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:50.691 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:05:50.691 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:50.691 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.691 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.691 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:50.691 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620120+0000", 2024-04-18T21:05:50.691 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0359999999999999e-06 2024-04-18T21:05:50.691 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.692 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.692 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:50.692 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620157+0000", 2024-04-18T21:05:50.692 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6636e-05 2024-04-18T21:05:50.692 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.692 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.692 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:50.692 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620177+0000", 2024-04-18T21:05:50.692 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0247000000000001e-05 2024-04-18T21:05:50.692 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.692 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.692 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.692 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620195+0000", 2024-04-18T21:05:50.692 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7819e-05 2024-04-18T21:05:50.692 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.693 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.693 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:50.693 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620342+0000", 2024-04-18T21:05:50.693 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014643300000000001 2024-04-18T21:05:50.693 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.693 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.693 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:50.693 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620405+0000", 2024-04-18T21:05:50.693 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3522000000000006e-05 2024-04-18T21:05:50.693 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.693 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.693 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:50.693 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635016+0000", 2024-04-18T21:05:50.693 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014610840999999999 2024-04-18T21:05:50.694 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.694 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.694 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:50.694 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635127+0000", 2024-04-18T21:05:50.694 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111437 2024-04-18T21:05:50.694 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:50.694 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:50.694 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:50.694 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.694 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.694 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:50.694 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:05:50.694 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 45.019110775999998, 2024-04-18T21:05:50.695 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012693296, 2024-04-18T21:05:50.695 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:50.695 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:50.695 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:50.695 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:50.695 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.695 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:50.695 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:05:50.695 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:50.695 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.695 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.695 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:50.695 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:05:50.695 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:50.695 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.696 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.696 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:50.696 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620228+0000", 2024-04-18T21:05:50.696 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:05:50.696 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.696 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.696 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:50.696 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620236+0000", 2024-04-18T21:05:50.696 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.303e-06 2024-04-18T21:05:50.696 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.696 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.696 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:50.696 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620255+0000", 2024-04-18T21:05:50.696 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9406e-05 2024-04-18T21:05:50.696 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.697 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.697 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.697 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620274+0000", 2024-04-18T21:05:50.697 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8940000000000002e-05 2024-04-18T21:05:50.697 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.697 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.697 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:50.697 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:05:50.697 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001558753 2024-04-18T21:05:50.697 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.697 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.697 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:50.697 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621879+0000", 2024-04-18T21:05:50.697 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6359000000000001e-05 2024-04-18T21:05:50.697 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.698 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.698 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:50.698 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632841+0000", 2024-04-18T21:05:50.698 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010961907 2024-04-18T21:05:50.698 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.698 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.698 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:50.698 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632920+0000", 2024-04-18T21:05:50.698 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8714999999999994e-05 2024-04-18T21:05:50.698 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:50.698 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:50.698 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:50.698 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.698 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.699 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:50.699 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:05:50.699 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 45.017565013000002, 2024-04-18T21:05:50.699 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013445702, 2024-04-18T21:05:50.699 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:50.699 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:50.699 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:50.699 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:50.699 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.699 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:50.699 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:05:50.699 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:50.699 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.699 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.700 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:50.700 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:05:50.700 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:50.700 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.700 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.700 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:50.700 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621774+0000", 2024-04-18T21:05:50.700 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2500000000000001e-06 2024-04-18T21:05:50.700 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.700 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.700 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:50.700 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621786+0000", 2024-04-18T21:05:50.700 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2636000000000001e-05 2024-04-18T21:05:50.700 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.700 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.701 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:50.701 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621814+0000", 2024-04-18T21:05:50.701 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7823000000000001e-05 2024-04-18T21:05:50.701 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.701 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.701 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.701 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621844+0000", 2024-04-18T21:05:50.701 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9589000000000001e-05 2024-04-18T21:05:50.701 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.701 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.701 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:50.701 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622253+0000", 2024-04-18T21:05:50.701 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040963700000000002 2024-04-18T21:05:50.701 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.702 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.702 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:50.702 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622304+0000", 2024-04-18T21:05:50.702 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0868999999999997e-05 2024-04-18T21:05:50.702 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.702 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.702 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:50.702 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635133+0000", 2024-04-18T21:05:50.702 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012829136 2024-04-18T21:05:50.702 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.702 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.702 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:50.702 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635218+0000", 2024-04-18T21:05:50.702 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4761999999999999e-05 2024-04-18T21:05:50.703 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:50.703 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:50.703 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:50.703 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.703 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.703 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:50.703 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:05:50.703 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 45.017438253000002, 2024-04-18T21:05:50.703 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014162065, 2024-04-18T21:05:50.703 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:50.703 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:50.703 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:50.703 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:50.703 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.703 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:50.704 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:05:50.704 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:50.704 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.704 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.704 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:50.704 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:05:50.704 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:50.704 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.704 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.704 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:50.704 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621900+0000", 2024-04-18T21:05:50.704 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:05:50.704 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.704 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.704 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:50.705 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621910+0000", 2024-04-18T21:05:50.705 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0207000000000001e-05 2024-04-18T21:05:50.705 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.705 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.705 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:50.705 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621932+0000", 2024-04-18T21:05:50.705 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1789000000000001e-05 2024-04-18T21:05:50.705 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.705 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.705 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.705 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621946+0000", 2024-04-18T21:05:50.705 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4212999999999999e-05 2024-04-18T21:05:50.705 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.705 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.706 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:50.706 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624477+0000", 2024-04-18T21:05:50.706 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025303470000000001 2024-04-18T21:05:50.706 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.706 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.706 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:50.706 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624525+0000", 2024-04-18T21:05:50.706 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8084999999999998e-05 2024-04-18T21:05:50.706 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.706 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.706 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:50.706 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635976+0000", 2024-04-18T21:05:50.706 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.011451368999999999 2024-04-18T21:05:50.706 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.707 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.707 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:50.707 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636061+0000", 2024-04-18T21:05:50.707 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5094999999999998e-05 2024-04-18T21:05:50.707 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:50.707 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:50.707 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:50.707 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.707 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.707 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:05:50.707 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:05:50.707 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 45.008202627999999, 2024-04-18T21:05:50.707 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0098014739999999993, 2024-04-18T21:05:50.707 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:50.708 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:50.708 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:05:50.708 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:50.708 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.708 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:50.708 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:05:50.708 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:50.708 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.708 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.708 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:50.708 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:05:50.708 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:50.708 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.708 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.709 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:50.709 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631136+0000", 2024-04-18T21:05:50.709 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0139999999999999e-06 2024-04-18T21:05:50.709 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.709 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.709 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:50.709 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631152+0000", 2024-04-18T21:05:50.709 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6365999999999999e-05 2024-04-18T21:05:50.709 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.709 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.709 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:50.709 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631961+0000", 2024-04-18T21:05:50.709 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00080873100000000003 2024-04-18T21:05:50.709 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.710 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.710 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.710 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632021+0000", 2024-04-18T21:05:50.710 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0541999999999997e-05 2024-04-18T21:05:50.710 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.710 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.710 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:50.710 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633539+0000", 2024-04-18T21:05:50.710 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015175639999999999 2024-04-18T21:05:50.710 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.710 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.710 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:50.710 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640936+0000", 2024-04-18T21:05:50.710 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007397257 2024-04-18T21:05:50.711 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:50.711 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:50.711 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:50.711 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.711 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.711 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-18T21:05:50.711 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:05:50.711 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 44.990741194999998, 2024-04-18T21:05:50.711 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00073592199999999997, 2024-04-18T21:05:50.711 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:50.711 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:50.711 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:50.711 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:50.711 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.711 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:50.712 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:05:50.712 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:50.712 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.712 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.712 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:50.712 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:05:50.712 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:50.712 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.712 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.712 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:50.712 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648597+0000", 2024-04-18T21:05:50.712 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:05:50.712 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.712 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.713 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:50.713 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648605+0000", 2024-04-18T21:05:50.713 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3960000000000006e-06 2024-04-18T21:05:50.713 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.713 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.713 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:50.713 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648625+0000", 2024-04-18T21:05:50.713 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9987e-05 2024-04-18T21:05:50.713 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.713 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.713 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.713 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648643+0000", 2024-04-18T21:05:50.713 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7079e-05 2024-04-18T21:05:50.713 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.713 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.714 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:50.714 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649043+0000", 2024-04-18T21:05:50.714 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040083399999999998 2024-04-18T21:05:50.714 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.714 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.714 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:50.714 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649062+0000", 2024-04-18T21:05:50.714 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9052999999999999e-05 2024-04-18T21:05:50.714 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.714 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.714 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:50.714 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649332+0000", 2024-04-18T21:05:50.714 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026971999999999999 2024-04-18T21:05:50.714 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:50.715 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:50.715 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:50.715 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.715 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.715 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:05:50.715 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:05:50.715 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 44.987966294000003, 2024-04-18T21:05:50.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00086123999999999999, 2024-04-18T21:05:50.715 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:50.715 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:50.715 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:05:50.715 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:50.715 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.715 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:50.716 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:05:50.716 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:50.716 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.716 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.716 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:50.716 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:05:50.716 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:50.716 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.716 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.716 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:50.716 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651372+0000", 2024-04-18T21:05:50.716 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7599999999999997e-07 2024-04-18T21:05:50.716 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.716 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.716 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:50.717 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651377+0000", 2024-04-18T21:05:50.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.22e-06 2024-04-18T21:05:50.717 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.717 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:50.717 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651394+0000", 2024-04-18T21:05:50.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6646999999999998e-05 2024-04-18T21:05:50.717 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.717 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.717 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651427+0000", 2024-04-18T21:05:50.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3682e-05 2024-04-18T21:05:50.717 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.717 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:50.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652029+0000", 2024-04-18T21:05:50.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00060152199999999995 2024-04-18T21:05:50.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:50.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652232+0000", 2024-04-18T21:05:50.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020359299999999999 2024-04-18T21:05:50.718 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:50.718 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:50.718 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:50.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.718 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:05:50.718 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:05:50.719 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 44.979939332000001, 2024-04-18T21:05:50.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0017426200000000001, 2024-04-18T21:05:50.719 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:50.719 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:50.719 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:50.719 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:50.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.719 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:50.719 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:05:50.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:50.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.719 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:50.719 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:05:50.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:50.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:50.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659399+0000", 2024-04-18T21:05:50.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6000000000000002e-07 2024-04-18T21:05:50.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:50.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659405+0000", 2024-04-18T21:05:50.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5069999999999997e-06 2024-04-18T21:05:50.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:50.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659425+0000", 2024-04-18T21:05:50.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.927e-05 2024-04-18T21:05:50.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659443+0000", 2024-04-18T21:05:50.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8051999999999999e-05 2024-04-18T21:05:50.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:50.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660973+0000", 2024-04-18T21:05:50.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001530106 2024-04-18T21:05:50.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:50.722 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660983+0000", 2024-04-18T21:05:50.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0516999999999999e-05 2024-04-18T21:05:50.722 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.722 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.722 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:50.722 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661141+0000", 2024-04-18T21:05:50.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015730799999999999 2024-04-18T21:05:50.722 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:50.722 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:50.722 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:50.722 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.722 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.722 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:05:50.722 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:05:50.722 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 44.979722707000001, 2024-04-18T21:05:50.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001812311, 2024-04-18T21:05:50.723 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:50.723 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:50.723 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:50.723 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:50.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:50.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:05:50.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:50.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:50.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:05:50.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:50.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.724 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:50.724 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659616+0000", 2024-04-18T21:05:50.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.277e-06 2024-04-18T21:05:50.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.724 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:50.724 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659625+0000", 2024-04-18T21:05:50.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5359999999999998e-06 2024-04-18T21:05:50.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.724 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:50.724 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659647+0000", 2024-04-18T21:05:50.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1857000000000001e-05 2024-04-18T21:05:50.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659664+0000", 2024-04-18T21:05:50.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6405999999999998e-05 2024-04-18T21:05:50.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:50.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661169+0000", 2024-04-18T21:05:50.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015054179999999999 2024-04-18T21:05:50.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:50.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661177+0000", 2024-04-18T21:05:50.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9680000000000006e-06 2024-04-18T21:05:50.726 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.726 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.726 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:50.726 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661427+0000", 2024-04-18T21:05:50.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024984900000000001 2024-04-18T21:05:50.726 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:50.726 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:50.726 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:50.726 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.726 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.726 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-18T21:05:50.726 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:05:50.726 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 43.026802099000001, 2024-04-18T21:05:50.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0030975030000000001, 2024-04-18T21:05:50.727 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:50.727 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:50.727 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:50.727 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:50.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:50.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:05:50.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:50.727 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:50.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:05:50.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:50.727 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.728 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:50.728 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612538+0000", 2024-04-18T21:05:50.728 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6259999999999999e-06 2024-04-18T21:05:50.728 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.728 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:50.728 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612552+0000", 2024-04-18T21:05:50.728 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4073999999999999e-05 2024-04-18T21:05:50.728 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.728 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:50.728 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612585+0000", 2024-04-18T21:05:50.728 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3504999999999999e-05 2024-04-18T21:05:50.729 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.729 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.729 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612601+0000", 2024-04-18T21:05:50.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5194000000000001e-05 2024-04-18T21:05:50.729 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.729 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:50.729 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612746+0000", 2024-04-18T21:05:50.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145666 2024-04-18T21:05:50.729 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.729 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:50.729 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612953+0000", 2024-04-18T21:05:50.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000207109 2024-04-18T21:05:50.730 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.730 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:50.730 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.613134+0000", 2024-04-18T21:05:50.730 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018041300000000001 2024-04-18T21:05:50.730 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.730 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:50.730 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.614411+0000", 2024-04-18T21:05:50.730 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0012769929999999999 2024-04-18T21:05:50.730 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.730 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:50.730 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615441+0000", 2024-04-18T21:05:50.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001029917 2024-04-18T21:05:50.731 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.731 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.731 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:50.731 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615522+0000", 2024-04-18T21:05:50.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1142000000000003e-05 2024-04-18T21:05:50.731 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.731 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.731 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:50.731 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615633+0000", 2024-04-18T21:05:50.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000110864 2024-04-18T21:05:50.731 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:50.731 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:50.731 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:50.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.732 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-18T21:05:50.732 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:05:50.732 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.024516288000001, 2024-04-18T21:05:50.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088979039999999999, 2024-04-18T21:05:50.732 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:50.732 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:50.732 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:50.732 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:50.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.732 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:50.732 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:05:50.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:50.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:50.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:05:50.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:50.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:50.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614825+0000", 2024-04-18T21:05:50.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4829999999999999e-06 2024-04-18T21:05:50.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:50.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614843+0000", 2024-04-18T21:05:50.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8777e-05 2024-04-18T21:05:50.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.734 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:50.734 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614884+0000", 2024-04-18T21:05:50.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1051999999999999e-05 2024-04-18T21:05:50.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.734 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:50.734 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614903+0000", 2024-04-18T21:05:50.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9069999999999999e-05 2024-04-18T21:05:50.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.734 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:50.734 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615047+0000", 2024-04-18T21:05:50.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014374400000000001 2024-04-18T21:05:50.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:50.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615061+0000", 2024-04-18T21:05:50.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4063000000000001e-05 2024-04-18T21:05:50.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:50.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621064+0000", 2024-04-18T21:05:50.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0060029200000000001 2024-04-18T21:05:50.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:50.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621211+0000", 2024-04-18T21:05:50.736 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000147224 2024-04-18T21:05:50.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.736 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:50.736 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621396+0000", 2024-04-18T21:05:50.736 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018454699999999999 2024-04-18T21:05:50.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.736 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:50.736 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.622517+0000", 2024-04-18T21:05:50.736 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001121424 2024-04-18T21:05:50.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.736 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:50.736 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623571+0000", 2024-04-18T21:05:50.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010538660000000001 2024-04-18T21:05:50.737 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.737 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:50.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623658+0000", 2024-04-18T21:05:50.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6439000000000004e-05 2024-04-18T21:05:50.737 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:50.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:50.737 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:50.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623719+0000", 2024-04-18T21:05:50.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1295000000000002e-05 2024-04-18T21:05:50.737 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:50.737 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:50.737 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:50.738 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:50.738 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:50.738 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:05:50.739 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:05:50.740 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:50.739+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:50.839 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:50.839+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:50.871 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:05:50.871 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:05:50.871 INFO:teuthology.orchestra.run.smithi132.stdout: "num_ops": 0 2024-04-18T21:05:50.871 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:05:50.885 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:05:50.940 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:50.939+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:50.993 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-18T21:05:51.006 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:05:51.006 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:05:51.006 INFO:teuthology.orchestra.run.smithi132.stdout: "complaint_time": 30, 2024-04-18T21:05:51.006 INFO:teuthology.orchestra.run.smithi132.stdout: "num_blocked_ops": 0 2024-04-18T21:05:51.006 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:05:51.020 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:05:51.067 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:51.067+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:51.139 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:05:51.140 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 20, 2024-04-18T21:05:51.140 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 600, 2024-04-18T21:05:51.140 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [ 2024-04-18T21:05:51.140 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.140 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:51.140 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:05:51.140 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 56.228968707, 2024-04-18T21:05:51.140 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.02518273, 2024-04-18T21:05:51.140 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:51.140 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:51.140 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:51.140 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:51.140 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:51.141 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:51.141 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 141 2024-04-18T21:05:51.141 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.141 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:51.141 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.141 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:51.141 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:05:51.141 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:51.141 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.141 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.141 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:51.141 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:05:51.141 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:51.141 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.142 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.142 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:51.142 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911562+0000", 2024-04-18T21:05:51.142 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9300000000000006e-07 2024-04-18T21:05:51.142 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.142 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.142 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:51.142 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911569+0000", 2024-04-18T21:05:51.142 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0169999999999999e-06 2024-04-18T21:05:51.142 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.142 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.142 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:51.142 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911582+0000", 2024-04-18T21:05:51.142 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.343e-05 2024-04-18T21:05:51.143 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.143 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.143 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:51.143 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911590+0000", 2024-04-18T21:05:51.143 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.413e-06 2024-04-18T21:05:51.143 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.143 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.143 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:51.143 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.933922+0000", 2024-04-18T21:05:51.143 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.022332093000000001 2024-04-18T21:05:51.143 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.143 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.143 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:51.143 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.934155+0000", 2024-04-18T21:05:51.144 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023378900000000001 2024-04-18T21:05:51.144 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.144 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.144 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:51.144 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.934514+0000", 2024-04-18T21:05:51.144 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00035859200000000003 2024-04-18T21:05:51.144 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.144 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.144 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:51.144 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.935973+0000", 2024-04-18T21:05:51.144 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001458705 2024-04-18T21:05:51.144 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.144 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.144 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:51.144 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936488+0000", 2024-04-18T21:05:51.145 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00051550000000000001 2024-04-18T21:05:51.145 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.145 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.145 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:51.145 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936636+0000", 2024-04-18T21:05:51.145 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014779800000000001 2024-04-18T21:05:51.145 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.145 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.145 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:51.145 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936743+0000", 2024-04-18T21:05:51.145 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010739999999999999 2024-04-18T21:05:51.145 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:51.145 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:51.145 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:51.145 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.146 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.146 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:51.146 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:05:51.146 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 56.111769733000003, 2024-04-18T21:05:51.146 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023654959999999999, 2024-04-18T21:05:51.146 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:51.146 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:51.146 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:51.146 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:51.146 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:51.146 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:51.146 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 163 2024-04-18T21:05:51.146 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.147 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:51.147 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.147 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:51.147 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:05:51.147 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:51.147 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.147 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.147 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:51.147 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:05:51.147 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:51.147 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.147 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.147 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:51.147 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:05:51.147 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0999999999999998e-07 2024-04-18T21:05:51.148 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.148 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.148 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:51.148 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028766+0000", 2024-04-18T21:05:51.148 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4700000000000001e-06 2024-04-18T21:05:51.148 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.148 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.148 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:51.148 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028775+0000", 2024-04-18T21:05:51.148 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.3190000000000001e-06 2024-04-18T21:05:51.148 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.148 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.148 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:51.149 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028782+0000", 2024-04-18T21:05:51.149 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.2300000000000002e-06 2024-04-18T21:05:51.149 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.149 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.149 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:51.149 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046667+0000", 2024-04-18T21:05:51.149 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017884356000000001 2024-04-18T21:05:51.149 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.149 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.149 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:51.149 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046788+0000", 2024-04-18T21:05:51.149 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012125000000000001 2024-04-18T21:05:51.149 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.149 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.149 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:51.150 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046982+0000", 2024-04-18T21:05:51.150 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019394 2024-04-18T21:05:51.150 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.150 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.150 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:51.150 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051969+0000", 2024-04-18T21:05:51.150 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0049868150000000003 2024-04-18T21:05:51.150 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.150 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.150 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:51.150 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052089+0000", 2024-04-18T21:05:51.150 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011993 2024-04-18T21:05:51.150 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.150 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.151 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:51.151 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052292+0000", 2024-04-18T21:05:51.151 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020345699999999999 2024-04-18T21:05:51.151 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.151 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.151 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:51.151 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052415+0000", 2024-04-18T21:05:51.151 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000122483 2024-04-18T21:05:51.151 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:51.151 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:51.151 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:51.151 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.151 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.151 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:51.152 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:05:51.152 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 56.111735500999998, 2024-04-18T21:05:51.152 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023864586, 2024-04-18T21:05:51.152 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:51.152 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:51.152 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:51.152 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:51.152 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:51.152 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:51.152 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 164 2024-04-18T21:05:51.152 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.152 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:51.152 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.152 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:51.153 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:05:51.153 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:51.153 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.153 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.153 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:51.153 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:05:51.153 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:51.153 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.153 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.153 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:51.153 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028795+0000", 2024-04-18T21:05:51.153 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7999999999999995e-07 2024-04-18T21:05:51.153 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.153 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.154 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:51.154 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028884+0000", 2024-04-18T21:05:51.154 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8997000000000002e-05 2024-04-18T21:05:51.154 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.154 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.154 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:51.154 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028895+0000", 2024-04-18T21:05:51.154 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1647e-05 2024-04-18T21:05:51.154 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.154 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.154 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:51.154 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028903+0000", 2024-04-18T21:05:51.154 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.909e-06 2024-04-18T21:05:51.154 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.155 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.155 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:51.155 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.047818+0000", 2024-04-18T21:05:51.155 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018914337 2024-04-18T21:05:51.155 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.155 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.155 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:51.155 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.048094+0000", 2024-04-18T21:05:51.155 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00027653500000000001 2024-04-18T21:05:51.155 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.155 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.155 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:51.155 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.048471+0000", 2024-04-18T21:05:51.155 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00037705799999999999 2024-04-18T21:05:51.156 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.156 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.156 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:51.156 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052516+0000", 2024-04-18T21:05:51.156 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0040452739999999997 2024-04-18T21:05:51.156 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.156 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.156 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:51.156 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052535+0000", 2024-04-18T21:05:51.156 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.84e-05 2024-04-18T21:05:51.156 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.156 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.156 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:51.156 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052603+0000", 2024-04-18T21:05:51.157 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.8095000000000004e-05 2024-04-18T21:05:51.157 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.157 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.157 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:51.157 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052659+0000", 2024-04-18T21:05:51.157 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5653999999999999e-05 2024-04-18T21:05:51.157 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:51.157 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:51.157 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:51.157 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.157 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.157 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:51.157 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:05:51.157 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 56.111612057999999, 2024-04-18T21:05:51.158 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024516458000000001, 2024-04-18T21:05:51.158 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:51.158 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:51.158 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:51.158 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:51.158 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:51.158 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:51.158 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 165 2024-04-18T21:05:51.158 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.158 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:51.158 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.158 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:51.158 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:05:51.158 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:51.159 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.159 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.159 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:51.159 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:05:51.159 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:51.159 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.159 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.159 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:51.159 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028918+0000", 2024-04-18T21:05:51.159 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8000000000000005e-07 2024-04-18T21:05:51.159 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.159 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.159 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:51.159 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028924+0000", 2024-04-18T21:05:51.159 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5659999999999997e-06 2024-04-18T21:05:51.160 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.160 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.160 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:51.160 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028933+0000", 2024-04-18T21:05:51.160 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.38e-06 2024-04-18T21:05:51.160 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.160 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.160 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:51.160 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028940+0000", 2024-04-18T21:05:51.160 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0060000000000003e-06 2024-04-18T21:05:51.160 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.160 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.160 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:51.160 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.050846+0000", 2024-04-18T21:05:51.161 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021906119000000002 2024-04-18T21:05:51.161 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.161 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.161 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:51.161 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051025+0000", 2024-04-18T21:05:51.161 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017850799999999999 2024-04-18T21:05:51.161 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.161 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.161 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:51.161 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051221+0000", 2024-04-18T21:05:51.161 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019608700000000001 2024-04-18T21:05:51.161 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.161 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.161 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:51.162 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052675+0000", 2024-04-18T21:05:51.162 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0014537899999999999 2024-04-18T21:05:51.162 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.162 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.162 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:51.162 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053311+0000", 2024-04-18T21:05:51.162 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00063613299999999999 2024-04-18T21:05:51.162 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.162 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.162 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:51.162 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053381+0000", 2024-04-18T21:05:51.162 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0074999999999996e-05 2024-04-18T21:05:51.162 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.162 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.163 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:51.163 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053434+0000", 2024-04-18T21:05:51.163 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3013999999999998e-05 2024-04-18T21:05:51.163 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:51.163 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:51.163 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:51.163 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.163 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.163 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:51.163 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:05:51.163 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 55.998306579000001, 2024-04-18T21:05:51.163 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023772793, 2024-04-18T21:05:51.163 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:51.163 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:51.163 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:51.164 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:51.164 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:51.164 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:51.164 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 187 2024-04-18T21:05:51.164 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.164 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:51.164 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.164 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:51.164 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:05:51.164 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:51.164 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.164 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.164 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:51.164 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:05:51.165 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:51.165 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.165 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.165 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:51.165 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142224+0000", 2024-04-18T21:05:51.165 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.47e-07 2024-04-18T21:05:51.165 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.165 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.165 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:51.165 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142233+0000", 2024-04-18T21:05:51.165 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0729999999999994e-06 2024-04-18T21:05:51.165 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.165 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.165 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:51.165 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142255+0000", 2024-04-18T21:05:51.166 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.2535999999999999e-05 2024-04-18T21:05:51.166 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.166 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.166 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:51.166 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142268+0000", 2024-04-18T21:05:51.166 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2686e-05 2024-04-18T21:05:51.166 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.166 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.166 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:51.166 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160497+0000", 2024-04-18T21:05:51.166 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018228779000000001 2024-04-18T21:05:51.166 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.166 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.166 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:51.167 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160634+0000", 2024-04-18T21:05:51.167 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000137315 2024-04-18T21:05:51.167 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.167 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.167 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:51.167 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160831+0000", 2024-04-18T21:05:51.167 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019683100000000001 2024-04-18T21:05:51.167 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.167 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.167 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:51.167 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165129+0000", 2024-04-18T21:05:51.167 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0042981299999999998 2024-04-18T21:05:51.167 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.167 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.168 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:51.168 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165776+0000", 2024-04-18T21:05:51.168 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00064702900000000003 2024-04-18T21:05:51.168 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.168 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.168 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:51.168 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165921+0000", 2024-04-18T21:05:51.168 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014506 2024-04-18T21:05:51.168 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.168 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.168 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:51.168 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165996+0000", 2024-04-18T21:05:51.168 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.4406999999999994e-05 2024-04-18T21:05:51.168 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:51.168 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:51.169 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:51.169 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.169 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.169 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:51.169 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:05:51.169 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 55.998245980999997, 2024-04-18T21:05:51.169 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026802157, 2024-04-18T21:05:51.169 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:51.169 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:51.169 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:51.169 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:51.169 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:51.169 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:51.169 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 188 2024-04-18T21:05:51.170 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.170 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:51.170 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.170 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:51.170 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:05:51.170 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:51.170 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.170 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.170 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:51.170 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:05:51.170 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:51.170 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.170 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.170 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:51.170 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142284+0000", 2024-04-18T21:05:51.171 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4e-07 2024-04-18T21:05:51.171 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.171 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.171 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:51.171 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142374+0000", 2024-04-18T21:05:51.171 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0099999999999995e-05 2024-04-18T21:05:51.171 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.171 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.171 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:51.171 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142386+0000", 2024-04-18T21:05:51.171 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1770000000000001e-05 2024-04-18T21:05:51.171 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.171 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.171 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:51.172 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142394+0000", 2024-04-18T21:05:51.172 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.2130000000000008e-06 2024-04-18T21:05:51.172 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.172 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.172 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:51.172 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.161743+0000", 2024-04-18T21:05:51.172 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019348644000000002 2024-04-18T21:05:51.172 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.172 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.172 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:51.172 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.161865+0000", 2024-04-18T21:05:51.172 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012210899999999999 2024-04-18T21:05:51.172 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.172 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.173 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:51.173 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.162055+0000", 2024-04-18T21:05:51.173 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000189994 2024-04-18T21:05:51.173 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.173 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.173 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:51.173 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165735+0000", 2024-04-18T21:05:51.173 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0036803270000000002 2024-04-18T21:05:51.173 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.173 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.173 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:51.173 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.168911+0000", 2024-04-18T21:05:51.173 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0031753689999999999 2024-04-18T21:05:51.173 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.173 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.174 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:51.174 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169012+0000", 2024-04-18T21:05:51.174 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010157699999999999 2024-04-18T21:05:51.174 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.174 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.174 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:51.174 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169086+0000", 2024-04-18T21:05:51.174 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3213999999999994e-05 2024-04-18T21:05:51.174 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:51.174 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:51.174 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:51.174 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.174 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.174 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:51.175 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:05:51.175 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 55.998120675000003, 2024-04-18T21:05:51.175 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026811423000000001, 2024-04-18T21:05:51.175 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:51.175 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:51.175 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:51.175 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:51.175 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:51.175 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:51.175 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 189 2024-04-18T21:05:51.175 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.175 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:51.175 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.175 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:51.176 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:05:51.176 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:51.176 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.176 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.176 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:51.176 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:05:51.176 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:51.176 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.176 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.176 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:51.176 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142410+0000", 2024-04-18T21:05:51.176 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:05:51.176 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.176 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.176 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:51.177 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142415+0000", 2024-04-18T21:05:51.177 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.7939999999999999e-06 2024-04-18T21:05:51.177 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.177 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.177 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:51.177 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142470+0000", 2024-04-18T21:05:51.177 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4537999999999999e-05 2024-04-18T21:05:51.177 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.177 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.177 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:51.177 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142481+0000", 2024-04-18T21:05:51.177 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0966e-05 2024-04-18T21:05:51.177 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.177 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.177 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:51.178 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.163493+0000", 2024-04-18T21:05:51.178 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021012444000000002 2024-04-18T21:05:51.178 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.178 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.178 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:51.178 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.163727+0000", 2024-04-18T21:05:51.178 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000233339 2024-04-18T21:05:51.178 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.178 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.178 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:51.178 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.164102+0000", 2024-04-18T21:05:51.178 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000374872 2024-04-18T21:05:51.178 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.178 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.179 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:51.179 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.166528+0000", 2024-04-18T21:05:51.179 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0024258729999999998 2024-04-18T21:05:51.179 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.179 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.179 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:51.179 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169101+0000", 2024-04-18T21:05:51.179 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0025737680000000001 2024-04-18T21:05:51.179 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.179 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.179 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:51.179 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169171+0000", 2024-04-18T21:05:51.179 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0148000000000007e-05 2024-04-18T21:05:51.179 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.179 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.180 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:51.180 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169220+0000", 2024-04-18T21:05:51.180 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8767999999999998e-05 2024-04-18T21:05:51.180 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:51.180 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:51.180 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:51.180 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.180 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.180 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:51.180 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:05:51.180 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 45.524548123000002, 2024-04-18T21:05:51.180 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024082777999999999, 2024-04-18T21:05:51.180 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:51.180 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:51.181 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:51.181 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:51.181 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.181 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:51.181 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:05:51.181 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:51.181 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.181 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.181 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:51.181 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:05:51.181 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:51.181 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.181 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.181 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:51.182 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615984+0000", 2024-04-18T21:05:51.182 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.9869999999999999e-06 2024-04-18T21:05:51.182 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.182 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.182 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:51.182 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615999+0000", 2024-04-18T21:05:51.182 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4646e-05 2024-04-18T21:05:51.182 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.182 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.182 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:51.182 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616028+0000", 2024-04-18T21:05:51.182 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8952999999999999e-05 2024-04-18T21:05:51.182 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.183 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.183 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:51.183 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616052+0000", 2024-04-18T21:05:51.183 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.3941999999999999e-05 2024-04-18T21:05:51.183 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.183 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.183 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:51.183 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618010+0000", 2024-04-18T21:05:51.183 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0019581780000000001 2024-04-18T21:05:51.183 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.183 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.183 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:51.183 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618322+0000", 2024-04-18T21:05:51.183 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00031158899999999997 2024-04-18T21:05:51.183 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.184 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.184 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:51.184 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618587+0000", 2024-04-18T21:05:51.184 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00026495700000000002 2024-04-18T21:05:51.184 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.184 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.184 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:51.184 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629262+0000", 2024-04-18T21:05:51.184 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010675877 2024-04-18T21:05:51.184 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.184 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.184 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:51.184 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.639773+0000", 2024-04-18T21:05:51.184 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0105109 2024-04-18T21:05:51.185 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.185 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.185 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:51.185 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.639926+0000", 2024-04-18T21:05:51.185 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000152349 2024-04-18T21:05:51.185 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.185 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.185 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:51.185 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640064+0000", 2024-04-18T21:05:51.185 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0001384 2024-04-18T21:05:51.185 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:51.185 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:51.185 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:51.185 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.185 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.186 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:51.186 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:05:51.186 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 45.524435449000002, 2024-04-18T21:05:51.186 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030215005999999999, 2024-04-18T21:05:51.186 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:51.186 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:51.186 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:51.186 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:51.186 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.186 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:51.186 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:05:51.186 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:51.186 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.186 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.187 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:51.187 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:05:51.187 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:51.187 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.187 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.187 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:51.187 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616095+0000", 2024-04-18T21:05:51.187 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.446e-06 2024-04-18T21:05:51.187 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.187 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.187 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:51.187 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616104+0000", 2024-04-18T21:05:51.187 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6200000000000005e-06 2024-04-18T21:05:51.187 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.188 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.188 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:51.188 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616132+0000", 2024-04-18T21:05:51.188 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7668999999999999e-05 2024-04-18T21:05:51.188 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.188 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.188 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:51.188 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616149+0000", 2024-04-18T21:05:51.188 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7047000000000001e-05 2024-04-18T21:05:51.188 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.188 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.188 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:51.188 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619287+0000", 2024-04-18T21:05:51.188 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0031381450000000002 2024-04-18T21:05:51.188 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.189 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.189 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:51.189 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619503+0000", 2024-04-18T21:05:51.189 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000216522 2024-04-18T21:05:51.189 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.189 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.189 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:51.189 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619930+0000", 2024-04-18T21:05:51.189 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00042604900000000001 2024-04-18T21:05:51.189 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.189 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.189 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:51.189 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629281+0000", 2024-04-18T21:05:51.189 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0093512230000000005 2024-04-18T21:05:51.190 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.190 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.190 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:51.190 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646022+0000", 2024-04-18T21:05:51.190 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016741156 2024-04-18T21:05:51.190 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.190 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.190 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:51.190 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646198+0000", 2024-04-18T21:05:51.190 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000176009 2024-04-18T21:05:51.190 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.190 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.190 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:51.190 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646309+0000", 2024-04-18T21:05:51.191 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011112000000000001 2024-04-18T21:05:51.191 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:51.191 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:51.191 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:51.191 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.191 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.191 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:51.191 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:05:51.191 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 45.524350624999997, 2024-04-18T21:05:51.191 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030501176000000001, 2024-04-18T21:05:51.191 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:51.191 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:51.191 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:51.191 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:51.191 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.192 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:51.192 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:05:51.192 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:51.192 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.192 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.192 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:51.192 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:05:51.192 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:51.192 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.192 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.192 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:51.192 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616180+0000", 2024-04-18T21:05:51.192 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1000000000000001e-06 2024-04-18T21:05:51.192 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.192 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.193 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:51.193 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616188+0000", 2024-04-18T21:05:51.193 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4069999999999993e-06 2024-04-18T21:05:51.193 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.193 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.193 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:51.193 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616207+0000", 2024-04-18T21:05:51.193 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8335999999999999e-05 2024-04-18T21:05:51.193 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.193 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.193 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:51.193 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616225+0000", 2024-04-18T21:05:51.193 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8652999999999999e-05 2024-04-18T21:05:51.193 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.194 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.194 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:51.194 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620977+0000", 2024-04-18T21:05:51.194 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047512220000000003 2024-04-18T21:05:51.194 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.194 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.194 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:51.194 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621279+0000", 2024-04-18T21:05:51.194 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000302646 2024-04-18T21:05:51.194 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.194 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.194 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:51.194 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621584+0000", 2024-04-18T21:05:51.195 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000305142 2024-04-18T21:05:51.195 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.195 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.195 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:51.195 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629352+0000", 2024-04-18T21:05:51.195 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0077673689999999997 2024-04-18T21:05:51.195 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.195 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.195 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:51.195 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646480+0000", 2024-04-18T21:05:51.195 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017128259 2024-04-18T21:05:51.195 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.195 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.195 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:51.195 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646591+0000", 2024-04-18T21:05:51.196 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011113899999999999 2024-04-18T21:05:51.196 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.196 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.196 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:51.196 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646680+0000", 2024-04-18T21:05:51.196 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8902999999999999e-05 2024-04-18T21:05:51.196 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:51.196 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:51.196 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:51.196 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.196 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.196 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:51.196 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:05:51.196 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 45.524284125999998, 2024-04-18T21:05:51.197 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030779760999999999, 2024-04-18T21:05:51.197 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:51.197 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:51.197 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:51.197 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:51.197 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.197 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:51.197 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:05:51.197 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:51.197 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.197 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.197 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:51.197 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:05:51.197 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:51.198 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.198 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.198 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:51.198 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616246+0000", 2024-04-18T21:05:51.198 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0499999999999999e-06 2024-04-18T21:05:51.198 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.198 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.198 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:51.198 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616253+0000", 2024-04-18T21:05:51.198 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.5989999999999998e-06 2024-04-18T21:05:51.198 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.198 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.198 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:51.199 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616273+0000", 2024-04-18T21:05:51.199 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9916999999999999e-05 2024-04-18T21:05:51.199 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.199 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.199 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:51.199 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616287+0000", 2024-04-18T21:05:51.199 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3669000000000001e-05 2024-04-18T21:05:51.199 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.199 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.199 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:51.199 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622203+0000", 2024-04-18T21:05:51.199 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.005916737 2024-04-18T21:05:51.199 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.199 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.199 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:51.200 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622379+0000", 2024-04-18T21:05:51.200 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000175596 2024-04-18T21:05:51.200 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.200 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.200 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:51.200 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622707+0000", 2024-04-18T21:05:51.200 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00032784600000000002 2024-04-18T21:05:51.200 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.200 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.200 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:51.200 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629366+0000", 2024-04-18T21:05:51.200 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0066593279999999999 2024-04-18T21:05:51.200 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.200 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.201 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:51.201 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646813+0000", 2024-04-18T21:05:51.201 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017447059000000001 2024-04-18T21:05:51.201 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.201 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.201 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:51.201 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646946+0000", 2024-04-18T21:05:51.201 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013301200000000001 2024-04-18T21:05:51.201 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.201 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.201 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:51.201 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647025+0000", 2024-04-18T21:05:51.201 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8948000000000004e-05 2024-04-18T21:05:51.201 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:51.202 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:51.202 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:51.202 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.202 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.202 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:51.202 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:05:51.202 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 45.524200307999998, 2024-04-18T21:05:51.202 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.031512165000000002, 2024-04-18T21:05:51.202 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:51.202 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:51.202 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:51.202 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:51.202 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.202 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:51.203 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:05:51.203 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:51.203 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.203 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.203 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:51.203 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:05:51.203 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:51.203 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.203 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.203 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:51.203 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616330+0000", 2024-04-18T21:05:51.203 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.15e-06 2024-04-18T21:05:51.203 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.203 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.203 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:51.204 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616337+0000", 2024-04-18T21:05:51.204 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.1289999999999998e-06 2024-04-18T21:05:51.204 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.204 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.204 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:51.204 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616447+0000", 2024-04-18T21:05:51.204 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109561 2024-04-18T21:05:51.204 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.204 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.204 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:51.204 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616496+0000", 2024-04-18T21:05:51.204 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8591999999999998e-05 2024-04-18T21:05:51.204 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.204 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.205 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:51.205 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.623786+0000", 2024-04-18T21:05:51.205 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0072906799999999999 2024-04-18T21:05:51.205 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.205 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.205 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:51.205 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.623973+0000", 2024-04-18T21:05:51.205 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018717199999999999 2024-04-18T21:05:51.205 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.205 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.205 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:51.205 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624260+0000", 2024-04-18T21:05:51.205 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00028630600000000001 2024-04-18T21:05:51.205 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.205 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.206 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:51.206 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629381+0000", 2024-04-18T21:05:51.206 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0051211340000000003 2024-04-18T21:05:51.206 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.206 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.206 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:51.206 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647631+0000", 2024-04-18T21:05:51.206 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018249771000000001 2024-04-18T21:05:51.206 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.206 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.206 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:51.206 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647761+0000", 2024-04-18T21:05:51.206 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013037300000000001 2024-04-18T21:05:51.206 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.207 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.207 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:51.207 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647841+0000", 2024-04-18T21:05:51.207 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.0296999999999994e-05 2024-04-18T21:05:51.207 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:51.207 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:51.207 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:51.207 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.207 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.207 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:51.207 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:05:51.207 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 45.523994823999999, 2024-04-18T21:05:51.207 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043251955000000002, 2024-04-18T21:05:51.207 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:51.208 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:51.208 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:51.208 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:51.208 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.208 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:51.208 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:05:51.208 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:51.208 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.208 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.208 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:51.208 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:05:51.208 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:51.208 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.208 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.208 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:51.209 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616536+0000", 2024-04-18T21:05:51.209 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2869999999999999e-06 2024-04-18T21:05:51.209 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.209 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.209 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:51.209 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616572+0000", 2024-04-18T21:05:51.209 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.6261999999999999e-05 2024-04-18T21:05:51.209 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.209 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.209 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:51.209 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616593+0000", 2024-04-18T21:05:51.209 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1310000000000001e-05 2024-04-18T21:05:51.209 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.209 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.210 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:51.210 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616614+0000", 2024-04-18T21:05:51.210 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.0936000000000001e-05 2024-04-18T21:05:51.210 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.210 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.210 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:51.210 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629501+0000", 2024-04-18T21:05:51.210 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.012886819000000001 2024-04-18T21:05:51.210 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.210 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.210 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:51.210 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629696+0000", 2024-04-18T21:05:51.210 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019485499999999999 2024-04-18T21:05:51.210 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.211 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.211 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:51.211 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629940+0000", 2024-04-18T21:05:51.211 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00024386399999999999 2024-04-18T21:05:51.211 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.211 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.211 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:51.211 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640100+0000", 2024-04-18T21:05:51.211 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010159645 2024-04-18T21:05:51.211 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.211 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.211 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:51.211 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659516+0000", 2024-04-18T21:05:51.211 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019416563000000001 2024-04-18T21:05:51.212 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.212 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.212 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:51.212 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659684+0000", 2024-04-18T21:05:51.212 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016750900000000001 2024-04-18T21:05:51.212 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.212 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.212 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:51.212 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659787+0000", 2024-04-18T21:05:51.212 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000102905 2024-04-18T21:05:51.212 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:51.212 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:51.212 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:51.212 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.212 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.213 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:51.213 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:05:51.213 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 45.523889701999998, 2024-04-18T21:05:51.213 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043581898000000001, 2024-04-18T21:05:51.213 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:51.213 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:51.213 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:51.213 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:51.213 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.213 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:51.213 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:05:51.213 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:51.213 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.213 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.214 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:51.214 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:05:51.214 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:51.214 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.214 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.214 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:51.214 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616641+0000", 2024-04-18T21:05:51.214 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:05:51.214 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.214 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.214 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:51.214 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616648+0000", 2024-04-18T21:05:51.214 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3860000000000001e-06 2024-04-18T21:05:51.214 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.214 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.215 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:51.215 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616666+0000", 2024-04-18T21:05:51.215 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7583000000000001e-05 2024-04-18T21:05:51.215 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.215 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.215 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:51.215 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616679+0000", 2024-04-18T21:05:51.215 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3322999999999999e-05 2024-04-18T21:05:51.215 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.215 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.215 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:51.215 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630373+0000", 2024-04-18T21:05:51.215 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013694207999999999 2024-04-18T21:05:51.215 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.215 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.216 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:51.216 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630545+0000", 2024-04-18T21:05:51.216 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000171683 2024-04-18T21:05:51.216 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.216 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.216 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:51.216 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630728+0000", 2024-04-18T21:05:51.216 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000182599 2024-04-18T21:05:51.216 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.216 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.216 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:51.216 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640600+0000", 2024-04-18T21:05:51.216 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0098726119999999994 2024-04-18T21:05:51.216 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.217 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.217 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:51.217 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659927+0000", 2024-04-18T21:05:51.217 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019326724999999999 2024-04-18T21:05:51.217 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.217 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.217 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:51.217 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660112+0000", 2024-04-18T21:05:51.217 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000185203 2024-04-18T21:05:51.217 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.217 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.217 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:51.217 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660222+0000", 2024-04-18T21:05:51.217 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109343 2024-04-18T21:05:51.217 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:51.218 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:51.218 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:51.218 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.218 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.218 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:51.218 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:05:51.218 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 45.523024344, 2024-04-18T21:05:51.218 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043121310000000003, 2024-04-18T21:05:51.218 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:51.218 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:51.218 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:51.218 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:51.218 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.218 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:51.219 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:05:51.219 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:51.219 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.219 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.219 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:51.219 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:05:51.219 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:51.219 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.219 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.219 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:51.219 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617506+0000", 2024-04-18T21:05:51.219 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9999999999999995e-07 2024-04-18T21:05:51.219 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.219 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.219 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:51.220 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617513+0000", 2024-04-18T21:05:51.220 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.9700000000000002e-06 2024-04-18T21:05:51.220 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.220 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.220 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:51.220 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617531+0000", 2024-04-18T21:05:51.220 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8105999999999999e-05 2024-04-18T21:05:51.220 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.220 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.220 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:51.220 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617545+0000", 2024-04-18T21:05:51.220 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3703000000000001e-05 2024-04-18T21:05:51.220 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.220 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.221 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:51.221 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632129+0000", 2024-04-18T21:05:51.221 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.014584135999999999 2024-04-18T21:05:51.221 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.221 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.221 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:51.221 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632361+0000", 2024-04-18T21:05:51.221 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023171800000000001 2024-04-18T21:05:51.221 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.221 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.221 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:51.221 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632804+0000", 2024-04-18T21:05:51.221 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000443549 2024-04-18T21:05:51.221 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.222 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.222 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:51.222 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646340+0000", 2024-04-18T21:05:51.222 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013535902000000001 2024-04-18T21:05:51.222 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.222 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.222 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:51.222 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660363+0000", 2024-04-18T21:05:51.222 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01402318 2024-04-18T21:05:51.222 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.222 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.222 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:51.222 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660523+0000", 2024-04-18T21:05:51.222 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00015989899999999999 2024-04-18T21:05:51.223 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.223 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.223 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:51.223 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660626+0000", 2024-04-18T21:05:51.223 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010314699999999999 2024-04-18T21:05:51.223 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:51.223 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:51.223 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:51.223 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.223 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.223 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:51.223 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:05:51.223 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 45.522884650999998, 2024-04-18T21:05:51.223 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024927483, 2024-04-18T21:05:51.223 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:51.224 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:51.224 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:51.224 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:51.224 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.224 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:51.224 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:05:51.224 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:51.224 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.224 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.224 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:51.224 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:05:51.224 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:51.224 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.224 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.225 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:51.225 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617646+0000", 2024-04-18T21:05:51.225 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3030000000000001e-06 2024-04-18T21:05:51.225 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.225 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.225 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:51.225 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617653+0000", 2024-04-18T21:05:51.225 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7530000000000004e-06 2024-04-18T21:05:51.225 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.225 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.225 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:51.225 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617673+0000", 2024-04-18T21:05:51.225 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9967e-05 2024-04-18T21:05:51.225 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.226 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.226 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:51.226 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617688+0000", 2024-04-18T21:05:51.226 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5153e-05 2024-04-18T21:05:51.226 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.226 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.226 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:51.226 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619244+0000", 2024-04-18T21:05:51.226 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001555531 2024-04-18T21:05:51.226 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.226 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.226 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:51.226 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619361+0000", 2024-04-18T21:05:51.226 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011784400000000001 2024-04-18T21:05:51.227 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.227 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.227 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:51.227 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619604+0000", 2024-04-18T21:05:51.227 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000243007 2024-04-18T21:05:51.227 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.227 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.227 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:51.227 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.625480+0000", 2024-04-18T21:05:51.227 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0058759349999999997 2024-04-18T21:05:51.227 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.227 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.227 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:51.227 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642342+0000", 2024-04-18T21:05:51.227 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016861373999999998 2024-04-18T21:05:51.228 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.228 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.228 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:51.228 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642484+0000", 2024-04-18T21:05:51.228 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000142423 2024-04-18T21:05:51.228 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.228 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.228 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:51.228 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642572+0000", 2024-04-18T21:05:51.228 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8193000000000001e-05 2024-04-18T21:05:51.228 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:51.228 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:51.228 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:51.228 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.229 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.229 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:51.229 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:05:51.229 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 45.522603148000002, 2024-04-18T21:05:51.229 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024956974999999999, 2024-04-18T21:05:51.229 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:51.229 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:51.229 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:51.229 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:51.229 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.229 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:51.229 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:05:51.229 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:51.229 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.229 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.230 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:51.230 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:05:51.230 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:51.230 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.230 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.230 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:51.230 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617928+0000", 2024-04-18T21:05:51.230 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5430000000000001e-06 2024-04-18T21:05:51.230 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.230 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.230 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:51.230 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617937+0000", 2024-04-18T21:05:51.230 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6629999999999999e-06 2024-04-18T21:05:51.230 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.231 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.231 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:51.231 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617955+0000", 2024-04-18T21:05:51.231 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8749999999999998e-05 2024-04-18T21:05:51.231 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.231 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.231 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:51.231 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617971+0000", 2024-04-18T21:05:51.231 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.605e-05 2024-04-18T21:05:51.231 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.231 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.231 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:51.231 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621019+0000", 2024-04-18T21:05:51.231 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0030472369999999999 2024-04-18T21:05:51.231 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.232 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.232 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:51.232 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621249+0000", 2024-04-18T21:05:51.232 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000230075 2024-04-18T21:05:51.232 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.232 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.232 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:51.232 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621450+0000", 2024-04-18T21:05:51.232 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020166499999999999 2024-04-18T21:05:51.232 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.232 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.232 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:51.232 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.626233+0000", 2024-04-18T21:05:51.232 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047827390000000003 2024-04-18T21:05:51.232 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.233 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.233 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:51.233 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642693+0000", 2024-04-18T21:05:51.233 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01645961 2024-04-18T21:05:51.233 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.233 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.233 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:51.233 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642798+0000", 2024-04-18T21:05:51.233 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010559499999999999 2024-04-18T21:05:51.233 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.233 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.233 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:51.233 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642883+0000", 2024-04-18T21:05:51.233 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5048000000000003e-05 2024-04-18T21:05:51.234 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:51.234 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:51.234 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:51.234 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.234 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.234 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:51.234 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:05:51.234 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 45.520907520000002, 2024-04-18T21:05:51.234 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024086478000000001, 2024-04-18T21:05:51.234 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:51.234 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:51.234 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:51.234 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:51.234 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.235 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:51.235 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:05:51.235 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:51.235 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.235 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.235 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:51.235 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:05:51.235 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:51.235 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.235 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.235 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:51.235 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619624+0000", 2024-04-18T21:05:51.235 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.75e-06 2024-04-18T21:05:51.235 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.235 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.236 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:51.236 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619637+0000", 2024-04-18T21:05:51.236 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3540000000000001e-05 2024-04-18T21:05:51.236 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.236 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.236 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:51.236 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619666+0000", 2024-04-18T21:05:51.236 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8685999999999999e-05 2024-04-18T21:05:51.236 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.236 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.236 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:51.236 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619685+0000", 2024-04-18T21:05:51.236 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8681999999999998e-05 2024-04-18T21:05:51.236 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.237 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.237 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:51.237 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622275+0000", 2024-04-18T21:05:51.237 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0025899260000000002 2024-04-18T21:05:51.237 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.237 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.237 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:51.237 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622572+0000", 2024-04-18T21:05:51.237 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00029722 2024-04-18T21:05:51.237 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.237 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.237 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:51.237 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622752+0000", 2024-04-18T21:05:51.237 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018065900000000001 2024-04-18T21:05:51.238 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.238 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.238 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:51.238 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.626326+0000", 2024-04-18T21:05:51.238 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035737310000000001 2024-04-18T21:05:51.238 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.238 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.238 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:51.238 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643565+0000", 2024-04-18T21:05:51.238 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017238430999999999 2024-04-18T21:05:51.238 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.238 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.238 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:51.238 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643646+0000", 2024-04-18T21:05:51.238 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.1481000000000001e-05 2024-04-18T21:05:51.239 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.239 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.239 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:51.239 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643708+0000", 2024-04-18T21:05:51.239 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.2372000000000005e-05 2024-04-18T21:05:51.239 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:51.239 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:51.239 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:51.239 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.239 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.239 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:51.239 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:05:51.239 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 45.520741366999999, 2024-04-18T21:05:51.239 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026822450000000001, 2024-04-18T21:05:51.240 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:51.240 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:51.240 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:51.240 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:51.240 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.240 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:51.240 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:05:51.240 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:51.240 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.240 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.240 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:51.240 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:05:51.240 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:51.240 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.240 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.241 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:51.241 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619789+0000", 2024-04-18T21:05:51.241 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:05:51.241 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.241 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.241 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:51.241 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619797+0000", 2024-04-18T21:05:51.241 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.6899999999999992e-06 2024-04-18T21:05:51.241 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.241 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.241 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:51.241 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619816+0000", 2024-04-18T21:05:51.241 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9352999999999999e-05 2024-04-18T21:05:51.241 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.241 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.242 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:51.242 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619832+0000", 2024-04-18T21:05:51.242 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6013000000000001e-05 2024-04-18T21:05:51.242 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.242 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.242 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:51.242 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620528+0000", 2024-04-18T21:05:51.242 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00069565600000000001 2024-04-18T21:05:51.242 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.242 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.242 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:51.242 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620735+0000", 2024-04-18T21:05:51.242 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000207025 2024-04-18T21:05:51.242 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.243 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.243 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:51.243 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620912+0000", 2024-04-18T21:05:51.243 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017748199999999999 2024-04-18T21:05:51.243 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.243 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.243 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:51.243 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.625605+0000", 2024-04-18T21:05:51.243 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0046924439999999996 2024-04-18T21:05:51.243 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.243 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.243 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:51.243 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646349+0000", 2024-04-18T21:05:51.243 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.020744318000000001 2024-04-18T21:05:51.243 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.244 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.244 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:51.244 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646483+0000", 2024-04-18T21:05:51.244 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013428999999999999 2024-04-18T21:05:51.244 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.244 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.244 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:51.244 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646611+0000", 2024-04-18T21:05:51.244 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012710299999999999 2024-04-18T21:05:51.244 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:51.244 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:51.244 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:51.244 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.244 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.244 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:51.245 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:05:51.245 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 45.520070934000003, 2024-04-18T21:05:51.245 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023516516000000001, 2024-04-18T21:05:51.245 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:51.245 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:51.245 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:05:51.245 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:51.245 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.245 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:51.245 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:05:51.245 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:51.245 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.245 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.245 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:51.245 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:05:51.246 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:51.246 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.246 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.246 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:51.246 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620460+0000", 2024-04-18T21:05:51.246 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.787e-06 2024-04-18T21:05:51.246 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.246 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.246 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:51.246 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620470+0000", 2024-04-18T21:05:51.246 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.2560000000000008e-06 2024-04-18T21:05:51.246 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.246 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.246 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:51.247 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620496+0000", 2024-04-18T21:05:51.247 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.6205999999999999e-05 2024-04-18T21:05:51.247 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.247 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.247 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:51.247 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620517+0000", 2024-04-18T21:05:51.247 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1223e-05 2024-04-18T21:05:51.247 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.247 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.247 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:51.247 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624060+0000", 2024-04-18T21:05:51.247 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035434160000000002 2024-04-18T21:05:51.247 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.247 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.247 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:51.248 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624390+0000", 2024-04-18T21:05:51.248 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00033000500000000002 2024-04-18T21:05:51.248 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:51.248 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:51.248 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:51.248 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643975+0000", 2024-04-18T21:05:51.248 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019584622999999999 2024-04-18T21:05:51.248 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:51.248 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:51.248 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:51.248 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:51.248 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:51.248 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:05:51.250 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:05:51.250 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:51.251+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:51.351 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:51.351+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:51.382 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:05:51.382 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [], 2024-04-18T21:05:51.382 INFO:teuthology.orchestra.run.smithi150.stdout: "num_ops": 0 2024-04-18T21:05:51.382 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:05:51.397 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:05:51.452 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:51.451+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:51.518 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:05:51.518 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [], 2024-04-18T21:05:51.518 INFO:teuthology.orchestra.run.smithi150.stdout: "complaint_time": 30, 2024-04-18T21:05:51.518 INFO:teuthology.orchestra.run.smithi150.stdout: "num_blocked_ops": 0 2024-04-18T21:05:51.518 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:05:51.532 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:05:51.577 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:51.579+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:51.654 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:51.655+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:51.655 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:05:51.655 INFO:teuthology.orchestra.run.smithi150.stdout: "size": 20, 2024-04-18T21:05:51.655 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 600, 2024-04-18T21:05:51.655 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [ 2024-04-18T21:05:51.655 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.655 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-18T21:05:51.655 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:05:51.655 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 56.851908649999999, 2024-04-18T21:05:51.655 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0093051590000000003, 2024-04-18T21:05:51.656 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:51.656 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:51.656 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:51.656 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:51.656 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.656 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:51.656 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:05:51.656 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:51.656 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.656 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.656 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:51.656 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:05:51.656 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:51.656 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.656 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.657 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:51.657 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804851+0000", 2024-04-18T21:05:51.657 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7039999999999999e-06 2024-04-18T21:05:51.657 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.657 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.657 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:51.657 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804864+0000", 2024-04-18T21:05:51.657 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.276e-05 2024-04-18T21:05:51.657 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.657 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.657 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:51.657 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804895+0000", 2024-04-18T21:05:51.657 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.1204999999999997e-05 2024-04-18T21:05:51.657 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.658 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.658 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:51.658 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804908+0000", 2024-04-18T21:05:51.658 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3317e-05 2024-04-18T21:05:51.658 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.658 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.658 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:51.658 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805131+0000", 2024-04-18T21:05:51.658 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00022246700000000001 2024-04-18T21:05:51.658 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.658 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.658 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:51.658 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805171+0000", 2024-04-18T21:05:51.658 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.0164999999999999e-05 2024-04-18T21:05:51.659 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.659 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.659 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:51.659 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814086+0000", 2024-04-18T21:05:51.659 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0089155329999999998 2024-04-18T21:05:51.659 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.659 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.659 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:51.659 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814154+0000", 2024-04-18T21:05:51.659 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.8008000000000003e-05 2024-04-18T21:05:51.659 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:51.659 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:51.659 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:51.659 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.660 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.660 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-18T21:05:51.660 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:05:51.660 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 56.851143456999999, 2024-04-18T21:05:51.660 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0086469770000000001, 2024-04-18T21:05:51.660 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:51.660 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:51.660 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:51.660 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:51.660 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.660 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:51.660 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:05:51.660 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:51.660 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.660 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.660 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:51.661 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:05:51.661 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:51.661 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.661 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.661 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:51.661 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805616+0000", 2024-04-18T21:05:51.661 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7799999999999999e-06 2024-04-18T21:05:51.661 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.661 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.661 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:51.661 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805707+0000", 2024-04-18T21:05:51.661 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0917999999999999e-05 2024-04-18T21:05:51.661 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.661 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.661 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:51.662 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805739+0000", 2024-04-18T21:05:51.662 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.2512000000000003e-05 2024-04-18T21:05:51.662 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.662 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.662 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:51.662 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805763+0000", 2024-04-18T21:05:51.662 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3266000000000001e-05 2024-04-18T21:05:51.662 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.662 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.662 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:51.662 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.806024+0000", 2024-04-18T21:05:51.662 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000261716 2024-04-18T21:05:51.662 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.662 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.662 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:51.663 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.806073+0000", 2024-04-18T21:05:51.663 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.8844999999999997e-05 2024-04-18T21:05:51.663 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.663 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.663 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:51.663 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814162+0000", 2024-04-18T21:05:51.663 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0080882860000000001 2024-04-18T21:05:51.663 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.663 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.663 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:51.663 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814261+0000", 2024-04-18T21:05:51.663 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.9654000000000005e-05 2024-04-18T21:05:51.663 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:51.663 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:51.663 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:51.664 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.664 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.664 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'64)", 2024-04-18T21:05:51.664 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:05:51.664 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 56.849372412999998, 2024-04-18T21:05:51.664 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0089721509999999994, 2024-04-18T21:05:51.664 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:51.664 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:51.664 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:51.664 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:51.664 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.664 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:51.664 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:05:51.664 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:51.664 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.664 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.665 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:51.665 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:05:51.665 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:51.665 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.665 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.665 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:51.665 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807387+0000", 2024-04-18T21:05:51.665 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.0329999999999998e-06 2024-04-18T21:05:51.665 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.665 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.665 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:51.665 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807443+0000", 2024-04-18T21:05:51.665 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.5376e-05 2024-04-18T21:05:51.665 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.665 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.665 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:51.665 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807467+0000", 2024-04-18T21:05:51.666 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.4621999999999999e-05 2024-04-18T21:05:51.666 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.666 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.666 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:51.666 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807482+0000", 2024-04-18T21:05:51.666 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.436e-05 2024-04-18T21:05:51.666 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.666 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.666 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:51.666 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.809243+0000", 2024-04-18T21:05:51.666 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001761725 2024-04-18T21:05:51.666 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.666 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.666 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:51.667 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.809295+0000", 2024-04-18T21:05:51.667 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.1445e-05 2024-04-18T21:05:51.667 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.667 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.667 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:51.667 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.816293+0000", 2024-04-18T21:05:51.667 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0069981749999999997 2024-04-18T21:05:51.667 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.667 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.667 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:51.667 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.816357+0000", 2024-04-18T21:05:51.667 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.4414999999999999e-05 2024-04-18T21:05:51.667 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:51.667 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:51.667 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:51.668 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.668 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.668 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:51.668 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:05:51.668 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 46.041463043, 2024-04-18T21:05:51.668 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.040843365, 2024-04-18T21:05:51.668 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:51.668 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:51.668 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:51.668 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:51.668 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.668 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:51.668 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:05:51.668 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:51.669 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.669 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.669 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:51.669 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:05:51.669 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:51.669 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.669 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.669 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:51.669 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615297+0000", 2024-04-18T21:05:51.669 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2800000000000002e-06 2024-04-18T21:05:51.669 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.669 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.669 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:51.669 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615308+0000", 2024-04-18T21:05:51.669 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0813e-05 2024-04-18T21:05:51.670 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.670 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.670 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:51.670 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615330+0000", 2024-04-18T21:05:51.670 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2370000000000001e-05 2024-04-18T21:05:51.670 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.670 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.670 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:51.670 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615346+0000", 2024-04-18T21:05:51.670 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6200000000000001e-05 2024-04-18T21:05:51.670 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.670 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.670 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:51.671 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615470+0000", 2024-04-18T21:05:51.671 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012385799999999999 2024-04-18T21:05:51.671 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.671 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.671 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:05:51.671 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615488+0000", 2024-04-18T21:05:51.671 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7923000000000001e-05 2024-04-18T21:05:51.671 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.671 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.671 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:51.671 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.630993+0000", 2024-04-18T21:05:51.671 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.01550532 2024-04-18T21:05:51.671 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.671 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.672 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:51.672 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631165+0000", 2024-04-18T21:05:51.672 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000171588 2024-04-18T21:05:51.672 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.672 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.672 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:51.672 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631320+0000", 2024-04-18T21:05:51.672 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000155162 2024-04-18T21:05:51.672 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.672 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.672 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:51.672 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635157+0000", 2024-04-18T21:05:51.672 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0038370790000000002 2024-04-18T21:05:51.672 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.672 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.673 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:51.673 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.655904+0000", 2024-04-18T21:05:51.673 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.020746483999999999 2024-04-18T21:05:51.673 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.673 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.673 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:51.673 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656032+0000", 2024-04-18T21:05:51.673 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012864199999999999 2024-04-18T21:05:51.673 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.673 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.673 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:51.673 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656138+0000", 2024-04-18T21:05:51.673 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000105646 2024-04-18T21:05:51.673 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:51.673 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:51.673 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:51.674 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.674 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.674 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:51.674 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:05:51.674 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 46.041370870999998, 2024-04-18T21:05:51.674 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.041266444999999999, 2024-04-18T21:05:51.674 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:51.674 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:51.674 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:51.674 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:51.674 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.674 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:51.674 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:05:51.674 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:51.675 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.675 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.675 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:51.675 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:05:51.675 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:51.675 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.675 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.675 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:51.675 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615388+0000", 2024-04-18T21:05:51.675 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:05:51.675 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.675 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.675 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:51.675 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:05:51.675 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.7299999999999994e-06 2024-04-18T21:05:51.675 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.675 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.676 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:51.676 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615415+0000", 2024-04-18T21:05:51.676 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7807000000000001e-05 2024-04-18T21:05:51.676 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.676 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.676 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:51.676 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615431+0000", 2024-04-18T21:05:51.676 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6127e-05 2024-04-18T21:05:51.676 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.676 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.676 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:51.676 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615621+0000", 2024-04-18T21:05:51.676 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000189781 2024-04-18T21:05:51.676 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.676 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.676 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:51.677 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615634+0000", 2024-04-18T21:05:51.677 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3383e-05 2024-04-18T21:05:51.677 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.677 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.677 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:51.677 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631703+0000", 2024-04-18T21:05:51.677 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016068737 2024-04-18T21:05:51.677 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.677 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.677 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:51.677 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631809+0000", 2024-04-18T21:05:51.677 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000106823 2024-04-18T21:05:51.677 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.677 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.677 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:51.678 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631988+0000", 2024-04-18T21:05:51.678 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000179008 2024-04-18T21:05:51.678 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.678 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.678 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:51.678 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635172+0000", 2024-04-18T21:05:51.678 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.003183029 2024-04-18T21:05:51.678 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.678 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.678 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:51.678 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656392+0000", 2024-04-18T21:05:51.678 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.021220638999999999 2024-04-18T21:05:51.678 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.678 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.679 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:51.679 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656533+0000", 2024-04-18T21:05:51.679 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014126500000000001 2024-04-18T21:05:51.679 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.679 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.679 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:51.679 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656653+0000", 2024-04-18T21:05:51.679 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000119883 2024-04-18T21:05:51.679 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:51.679 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:51.679 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:51.679 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.679 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.679 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:51.679 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:05:51.680 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 46.041283448000001, 2024-04-18T21:05:51.680 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.042492302000000003, 2024-04-18T21:05:51.680 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:51.680 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:51.680 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:51.680 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:51.680 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.680 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:51.680 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:05:51.680 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:51.680 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.680 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.680 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:51.680 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:05:51.680 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:51.681 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.681 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.681 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:51.681 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615475+0000", 2024-04-18T21:05:51.681 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.17e-06 2024-04-18T21:05:51.681 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.681 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.681 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:51.681 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615528+0000", 2024-04-18T21:05:51.681 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.2159e-05 2024-04-18T21:05:51.681 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.681 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.681 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:51.681 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615542+0000", 2024-04-18T21:05:51.682 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4197e-05 2024-04-18T21:05:51.682 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.682 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.682 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:51.682 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615559+0000", 2024-04-18T21:05:51.682 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.749e-05 2024-04-18T21:05:51.682 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.682 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.682 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:51.682 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615685+0000", 2024-04-18T21:05:51.682 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012617499999999999 2024-04-18T21:05:51.682 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.682 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.682 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:05:51.683 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:05:51.683 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4749999999999999e-05 2024-04-18T21:05:51.683 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.683 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.683 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:51.683 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632332+0000", 2024-04-18T21:05:51.683 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016631988 2024-04-18T21:05:51.683 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.683 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.683 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:51.683 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632477+0000", 2024-04-18T21:05:51.683 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014437200000000001 2024-04-18T21:05:51.683 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.683 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.683 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:51.684 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632620+0000", 2024-04-18T21:05:51.684 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000143566 2024-04-18T21:05:51.684 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.684 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.684 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:51.684 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635185+0000", 2024-04-18T21:05:51.684 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0025644209999999999 2024-04-18T21:05:51.684 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.684 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.684 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:51.684 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657803+0000", 2024-04-18T21:05:51.684 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.022618743 2024-04-18T21:05:51.684 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.684 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.685 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:51.685 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657890+0000", 2024-04-18T21:05:51.685 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.6688999999999996e-05 2024-04-18T21:05:51.685 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.685 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.685 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:51.685 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657967+0000", 2024-04-18T21:05:51.685 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.6582000000000006e-05 2024-04-18T21:05:51.685 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:51.685 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:51.685 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:51.685 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.685 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.685 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:51.685 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:05:51.686 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 46.041152636, 2024-04-18T21:05:51.686 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.043603435000000003, 2024-04-18T21:05:51.686 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:51.686 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:51.686 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:51.686 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:51.686 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.686 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:51.686 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:05:51.686 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:51.686 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.686 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.686 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:51.687 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:05:51.687 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:51.687 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.687 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.687 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:51.687 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615607+0000", 2024-04-18T21:05:51.687 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4300000000000001e-06 2024-04-18T21:05:51.687 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.687 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.687 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:51.687 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615614+0000", 2024-04-18T21:05:51.687 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.4100000000000002e-06 2024-04-18T21:05:51.687 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.687 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.687 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:51.688 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615632+0000", 2024-04-18T21:05:51.688 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7863000000000002e-05 2024-04-18T21:05:51.688 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.688 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.688 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:51.688 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615647+0000", 2024-04-18T21:05:51.688 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5187e-05 2024-04-18T21:05:51.688 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.688 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.688 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:51.688 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615765+0000", 2024-04-18T21:05:51.688 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000117955 2024-04-18T21:05:51.688 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.688 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.688 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:51.689 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615781+0000", 2024-04-18T21:05:51.689 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6123000000000001e-05 2024-04-18T21:05:51.689 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.689 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.689 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:51.689 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633055+0000", 2024-04-18T21:05:51.689 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.017273909 2024-04-18T21:05:51.689 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.689 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.689 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:51.689 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633254+0000", 2024-04-18T21:05:51.689 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00019903799999999999 2024-04-18T21:05:51.689 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.689 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.690 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:51.690 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633624+0000", 2024-04-18T21:05:51.690 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000369656 2024-04-18T21:05:51.690 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.690 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.690 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:51.690 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635595+0000", 2024-04-18T21:05:51.690 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001971287 2024-04-18T21:05:51.690 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.690 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.690 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:51.690 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659026+0000", 2024-04-18T21:05:51.690 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.023431495 2024-04-18T21:05:51.690 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.691 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.691 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:51.691 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659117+0000", 2024-04-18T21:05:51.691 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0885999999999997e-05 2024-04-18T21:05:51.691 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.691 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.691 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:51.691 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659209+0000", 2024-04-18T21:05:51.691 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.1195999999999999e-05 2024-04-18T21:05:51.691 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:51.691 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:51.691 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:51.691 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.691 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.691 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:51.692 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:51.692 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 46.041087406999999, 2024-04-18T21:05:51.692 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.03492514, 2024-04-18T21:05:51.692 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:51.692 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:51.692 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:51.692 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:51.692 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.692 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:51.692 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:51.692 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:51.692 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.692 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.692 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:51.692 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:51.693 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:51.693 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.693 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.693 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:51.693 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:05:51.693 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.407e-06 2024-04-18T21:05:51.693 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.693 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.693 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:51.693 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615679+0000", 2024-04-18T21:05:51.693 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.2130000000000002e-06 2024-04-18T21:05:51.693 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.693 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.693 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:51.693 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615701+0000", 2024-04-18T21:05:51.694 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2316000000000001e-05 2024-04-18T21:05:51.694 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.694 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.694 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:51.694 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615717+0000", 2024-04-18T21:05:51.694 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6197000000000001e-05 2024-04-18T21:05:51.694 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.694 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.694 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:51.694 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615828+0000", 2024-04-18T21:05:51.694 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000110899 2024-04-18T21:05:51.694 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.694 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.695 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:05:51.695 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615840+0000", 2024-04-18T21:05:51.695 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.1423000000000001e-05 2024-04-18T21:05:51.695 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.695 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.695 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:51.695 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628046+0000", 2024-04-18T21:05:51.695 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.012206295000000001 2024-04-18T21:05:51.695 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.695 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.695 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:51.695 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628323+0000", 2024-04-18T21:05:51.695 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00027658700000000001 2024-04-18T21:05:51.695 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.695 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.696 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:51.696 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628599+0000", 2024-04-18T21:05:51.696 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00027676699999999997 2024-04-18T21:05:51.696 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.696 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.696 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:51.696 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634869+0000", 2024-04-18T21:05:51.696 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.006269536 2024-04-18T21:05:51.696 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.696 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.696 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:51.696 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650333+0000", 2024-04-18T21:05:51.696 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.015463645999999999 2024-04-18T21:05:51.696 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.696 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.697 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:51.697 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650474+0000", 2024-04-18T21:05:51.697 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014091799999999999 2024-04-18T21:05:51.697 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.697 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.697 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:51.697 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650595+0000", 2024-04-18T21:05:51.697 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012193600000000001 2024-04-18T21:05:51.697 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:51.697 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:51.697 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:51.697 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.697 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.697 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:51.697 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:05:51.698 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 46.041002298000002, 2024-04-18T21:05:51.698 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.040588320999999997, 2024-04-18T21:05:51.698 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:51.698 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:51.698 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:51.698 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:51.698 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.698 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:51.698 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:05:51.698 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:51.698 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.698 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.698 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:51.698 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:05:51.699 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:51.699 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.699 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.699 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:51.699 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615757+0000", 2024-04-18T21:05:51.699 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2270000000000001e-06 2024-04-18T21:05:51.699 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.699 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.699 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:51.699 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615765+0000", 2024-04-18T21:05:51.699 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.9400000000000002e-06 2024-04-18T21:05:51.699 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.699 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.699 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:51.699 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615785+0000", 2024-04-18T21:05:51.700 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.0749000000000001e-05 2024-04-18T21:05:51.700 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.700 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.700 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:51.700 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615804+0000", 2024-04-18T21:05:51.700 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.8774e-05 2024-04-18T21:05:51.700 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.700 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.700 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:51.700 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615888+0000", 2024-04-18T21:05:51.700 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.4111999999999997e-05 2024-04-18T21:05:51.700 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.700 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.700 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:51.701 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615895+0000", 2024-04-18T21:05:51.701 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.0469999999999996e-06 2024-04-18T21:05:51.701 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.701 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.701 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:51.701 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629280+0000", 2024-04-18T21:05:51.701 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.013384416 2024-04-18T21:05:51.701 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.701 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.701 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:51.701 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629488+0000", 2024-04-18T21:05:51.701 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00020852800000000001 2024-04-18T21:05:51.701 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.701 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.702 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:51.702 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629869+0000", 2024-04-18T21:05:51.702 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00038042300000000001 2024-04-18T21:05:51.702 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.702 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.702 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:51.702 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635041+0000", 2024-04-18T21:05:51.702 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.005172383 2024-04-18T21:05:51.702 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.702 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.702 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:51.702 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656125+0000", 2024-04-18T21:05:51.702 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.021084025999999999 2024-04-18T21:05:51.702 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.702 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.703 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:51.703 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656240+0000", 2024-04-18T21:05:51.703 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000115352 2024-04-18T21:05:51.703 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.703 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.703 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:51.703 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656344+0000", 2024-04-18T21:05:51.703 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00010334400000000001 2024-04-18T21:05:51.703 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:51.703 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:51.703 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:51.703 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.703 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.703 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:51.704 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:05:51.704 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 46.040934978000003, 2024-04-18T21:05:51.704 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.043549577999999999, 2024-04-18T21:05:51.704 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:51.704 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:51.704 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:51.704 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:51.704 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.704 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:51.704 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:05:51.704 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:51.704 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.704 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.704 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:51.704 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:05:51.705 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:51.705 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.705 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.705 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:51.705 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:05:51.705 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.5000000000000002e-07 2024-04-18T21:05:51.705 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.705 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.705 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:51.705 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615828+0000", 2024-04-18T21:05:51.705 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.2359999999999998e-06 2024-04-18T21:05:51.705 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.705 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.705 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:51.705 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615838+0000", 2024-04-18T21:05:51.706 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0087e-05 2024-04-18T21:05:51.706 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.706 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.706 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:51.706 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615846+0000", 2024-04-18T21:05:51.706 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.67e-06 2024-04-18T21:05:51.706 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.706 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.706 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:51.706 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615963+0000", 2024-04-18T21:05:51.706 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00011630500000000001 2024-04-18T21:05:51.706 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.706 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.706 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:51.707 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615979+0000", 2024-04-18T21:05:51.707 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.613e-05 2024-04-18T21:05:51.707 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.707 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.707 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:51.707 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632392+0000", 2024-04-18T21:05:51.707 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016413317 2024-04-18T21:05:51.707 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.707 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.707 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:51.707 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632568+0000", 2024-04-18T21:05:51.707 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00017539500000000001 2024-04-18T21:05:51.707 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.707 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.708 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:51.708 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632748+0000", 2024-04-18T21:05:51.708 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00017991799999999999 2024-04-18T21:05:51.708 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.708 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.708 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:51.708 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635542+0000", 2024-04-18T21:05:51.708 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00279481 2024-04-18T21:05:51.708 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.708 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.708 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:51.708 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659232+0000", 2024-04-18T21:05:51.708 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.023689212000000001 2024-04-18T21:05:51.708 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.709 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.709 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:51.709 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659314+0000", 2024-04-18T21:05:51.709 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.2528999999999995e-05 2024-04-18T21:05:51.709 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.709 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.709 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:51.709 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659372+0000", 2024-04-18T21:05:51.709 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.8218999999999999e-05 2024-04-18T21:05:51.709 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:51.709 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:51.709 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:51.709 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.709 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.709 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:51.710 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:05:51.710 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 46.040873546, 2024-04-18T21:05:51.710 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.039335347, 2024-04-18T21:05:51.710 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:51.710 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:51.710 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "started", 2024-04-18T21:05:51.710 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:51.710 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.710 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:51.710 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:05:51.710 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:51.710 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.710 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.711 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:51.711 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:05:51.711 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:51.711 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.711 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.711 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:51.711 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615885+0000", 2024-04-18T21:05:51.711 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2699999999999999e-06 2024-04-18T21:05:51.711 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.711 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.711 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:51.711 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615892+0000", 2024-04-18T21:05:51.711 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.6499999999999999e-06 2024-04-18T21:05:51.712 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.712 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.712 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:51.712 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615906+0000", 2024-04-18T21:05:51.712 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.393e-05 2024-04-18T21:05:51.712 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.712 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.712 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:51.712 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615919+0000", 2024-04-18T21:05:51.712 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2860000000000001e-05 2024-04-18T21:05:51.712 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.712 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.712 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:51.712 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616027+0000", 2024-04-18T21:05:51.712 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000107852 2024-04-18T21:05:51.713 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.713 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.713 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:05:51.713 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616037+0000", 2024-04-18T21:05:51.713 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:05:51.713 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.713 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.713 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:51.713 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622719+0000", 2024-04-18T21:05:51.713 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0066817220000000002 2024-04-18T21:05:51.713 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.713 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.713 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:51.713 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623006+0000", 2024-04-18T21:05:51.714 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00028783699999999999 2024-04-18T21:05:51.714 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.714 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.714 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:51.714 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.655220+0000", 2024-04-18T21:05:51.714 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.032213036 2024-04-18T21:05:51.714 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:51.714 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:51.714 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:51.714 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.714 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.714 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:51.714 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:51.714 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 46.040817873000002, 2024-04-18T21:05:51.715 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.032845253999999997, 2024-04-18T21:05:51.715 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:51.715 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:51.715 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "started", 2024-04-18T21:05:51.715 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:51.715 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.715 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:51.715 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:51.715 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:51.715 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.715 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.715 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:51.715 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:51.715 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:51.716 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.716 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.716 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:51.716 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615942+0000", 2024-04-18T21:05:51.716 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.717e-06 2024-04-18T21:05:51.716 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.716 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.716 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:51.716 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615946+0000", 2024-04-18T21:05:51.716 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.6e-06 2024-04-18T21:05:51.716 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.716 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.716 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:51.716 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615960+0000", 2024-04-18T21:05:51.716 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:05:51.717 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.717 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.717 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:51.717 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615968+0000", 2024-04-18T21:05:51.717 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.9070000000000007e-06 2024-04-18T21:05:51.717 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.717 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.717 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:51.717 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616100+0000", 2024-04-18T21:05:51.717 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000132402 2024-04-18T21:05:51.717 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.717 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.717 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:05:51.717 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616117+0000", 2024-04-18T21:05:51.718 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6653000000000001e-05 2024-04-18T21:05:51.718 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.718 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.718 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:51.718 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621566+0000", 2024-04-18T21:05:51.718 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0054497740000000001 2024-04-18T21:05:51.718 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.718 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.718 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:51.718 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622801+0000", 2024-04-18T21:05:51.718 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0012345710000000001 2024-04-18T21:05:51.718 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.718 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.718 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:51.719 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648785+0000", 2024-04-18T21:05:51.719 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.025984104000000001 2024-04-18T21:05:51.719 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:51.719 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:51.719 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:51.719 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.719 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.719 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:51.719 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:05:51.719 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 46.034966523000001, 2024-04-18T21:05:51.719 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.011561350999999999, 2024-04-18T21:05:51.719 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:51.719 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:51.719 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:51.719 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:51.720 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.720 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:51.720 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:05:51.720 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:51.720 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.720 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.720 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:51.720 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:05:51.720 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:51.720 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.720 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.720 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:51.720 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621792+0000", 2024-04-18T21:05:51.720 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.4000000000000001e-07 2024-04-18T21:05:51.721 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.721 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.721 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:51.721 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:05:51.721 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.1050000000000002e-05 2024-04-18T21:05:51.721 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.721 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.721 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:51.721 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622608+0000", 2024-04-18T21:05:51.721 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00077505900000000003 2024-04-18T21:05:51.721 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.721 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.721 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:51.721 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623879+0000", 2024-04-18T21:05:51.722 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0012705839999999999 2024-04-18T21:05:51.722 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.722 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.722 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:51.722 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624010+0000", 2024-04-18T21:05:51.722 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00013176900000000001 2024-04-18T21:05:51.722 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.722 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.722 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:51.722 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624058+0000", 2024-04-18T21:05:51.722 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.7299000000000002e-05 2024-04-18T21:05:51.722 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.722 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.722 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:51.723 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633262+0000", 2024-04-18T21:05:51.723 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0092048770000000002 2024-04-18T21:05:51.723 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.723 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.723 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:51.723 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633353+0000", 2024-04-18T21:05:51.723 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0073000000000003e-05 2024-04-18T21:05:51.723 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:51.723 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:51.723 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:51.723 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.723 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.723 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:51.723 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:05:51.723 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 46.032839137000003, 2024-04-18T21:05:51.724 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0098419370000000003, 2024-04-18T21:05:51.724 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:51.724 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:51.724 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:51.724 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:51.724 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.724 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:51.724 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:05:51.724 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:51.724 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.724 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.724 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:51.724 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:05:51.724 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:51.724 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.725 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.725 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:51.725 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623920+0000", 2024-04-18T21:05:51.725 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2240000000000001e-06 2024-04-18T21:05:51.725 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.725 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.725 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:51.725 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623933+0000", 2024-04-18T21:05:51.725 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3653e-05 2024-04-18T21:05:51.725 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.725 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.725 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:51.725 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623956+0000", 2024-04-18T21:05:51.725 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2059e-05 2024-04-18T21:05:51.725 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.726 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.726 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:51.726 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623975+0000", 2024-04-18T21:05:51.726 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.9806999999999999e-05 2024-04-18T21:05:51.726 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.726 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.726 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:51.726 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626943+0000", 2024-04-18T21:05:51.726 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0029681579999999998 2024-04-18T21:05:51.726 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.726 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.726 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:51.726 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626993+0000", 2024-04-18T21:05:51.726 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.9935999999999998e-05 2024-04-18T21:05:51.727 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.727 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.727 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:51.727 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633665+0000", 2024-04-18T21:05:51.727 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0066719250000000004 2024-04-18T21:05:51.727 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.727 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.727 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:51.727 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633761+0000", 2024-04-18T21:05:51.727 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.5174999999999996e-05 2024-04-18T21:05:51.727 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:51.727 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:51.727 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:51.727 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.727 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.728 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:51.728 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:05:51.728 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 46.032007518, 2024-04-18T21:05:51.728 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0090159079999999996, 2024-04-18T21:05:51.728 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:51.728 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:51.728 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:51.728 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:51.728 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.728 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:51.728 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:05:51.728 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:51.728 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.728 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.729 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:51.729 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:05:51.729 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:51.729 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.729 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.729 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:51.729 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624751+0000", 2024-04-18T21:05:51.729 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.7600000000000006e-07 2024-04-18T21:05:51.729 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.729 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.729 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:51.729 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624787+0000", 2024-04-18T21:05:51.729 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.6273000000000003e-05 2024-04-18T21:05:51.729 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.729 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.730 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:51.730 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625837+0000", 2024-04-18T21:05:51.730 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00104992 2024-04-18T21:05:51.730 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.730 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.730 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:51.730 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625860+0000", 2024-04-18T21:05:51.730 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3110000000000001e-05 2024-04-18T21:05:51.730 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.730 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.730 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:51.730 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625984+0000", 2024-04-18T21:05:51.730 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012399199999999999 2024-04-18T21:05:51.731 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.731 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.731 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:51.731 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626030+0000", 2024-04-18T21:05:51.731 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.5429999999999997e-05 2024-04-18T21:05:51.731 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.731 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.731 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:51.731 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633643+0000", 2024-04-18T21:05:51.731 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0076129320000000002 2024-04-18T21:05:51.731 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.731 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.731 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:51.731 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633766+0000", 2024-04-18T21:05:51.731 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000123275 2024-04-18T21:05:51.731 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:51.732 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:51.732 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:51.732 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.732 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.732 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:51.732 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:05:51.732 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 46.030753793999999, 2024-04-18T21:05:51.732 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0088669170000000002, 2024-04-18T21:05:51.732 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:51.732 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:51.732 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:51.732 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:51.732 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.732 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:51.732 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:05:51.733 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:51.733 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.733 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.733 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:51.733 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:05:51.733 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:51.733 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.733 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.733 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:51.733 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626005+0000", 2024-04-18T21:05:51.733 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.5000000000000001e-07 2024-04-18T21:05:51.733 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.733 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.733 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:51.734 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626028+0000", 2024-04-18T21:05:51.734 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2756999999999999e-05 2024-04-18T21:05:51.734 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.734 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.734 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:51.734 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626050+0000", 2024-04-18T21:05:51.734 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2140000000000001e-05 2024-04-18T21:05:51.734 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.734 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.734 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:51.734 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626065+0000", 2024-04-18T21:05:51.734 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5176e-05 2024-04-18T21:05:51.734 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.734 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.735 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:51.735 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628334+0000", 2024-04-18T21:05:51.735 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0022691439999999998 2024-04-18T21:05:51.735 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.735 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.735 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:51.735 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628379+0000", 2024-04-18T21:05:51.735 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.5420000000000002e-05 2024-04-18T21:05:51.735 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.735 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.735 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:51.735 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634770+0000", 2024-04-18T21:05:51.735 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0063908410000000004 2024-04-18T21:05:51.735 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.736 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.736 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:51.736 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634871+0000", 2024-04-18T21:05:51.736 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000100589 2024-04-18T21:05:51.736 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:51.736 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:51.736 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:51.736 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.736 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.736 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:13 3.10 e17/15 3:0d89b25e:::603.00000000:head v 17'8, mlcod=0'0)", 2024-04-18T21:05:51.736 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:05:51.736 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 46.011920365000002, 2024-04-18T21:05:51.736 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0090974379999999994, 2024-04-18T21:05:51.736 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:51.737 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:51.737 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:51.737 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:51.737 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.737 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:51.737 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:05:51.737 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:51.737 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.737 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.737 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:51.737 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:05:51.737 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:51.737 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.737 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.737 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:51.738 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644838+0000", 2024-04-18T21:05:51.738 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.569999999999999e-07 2024-04-18T21:05:51.738 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.738 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.738 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:51.738 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644846+0000", 2024-04-18T21:05:51.738 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.4499999999999998e-06 2024-04-18T21:05:51.738 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.738 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.738 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:51.738 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644861+0000", 2024-04-18T21:05:51.738 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5243e-05 2024-04-18T21:05:51.738 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.739 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.739 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:51.739 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644997+0000", 2024-04-18T21:05:51.739 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000135609 2024-04-18T21:05:51.739 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.739 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.739 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:51.739 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649150+0000", 2024-04-18T21:05:51.739 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0041536760000000002 2024-04-18T21:05:51.739 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.739 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.739 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:51.739 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649207+0000", 2024-04-18T21:05:51.739 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.6677e-05 2024-04-18T21:05:51.739 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.740 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.740 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:51.740 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.653840+0000", 2024-04-18T21:05:51.740 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0046329700000000001 2024-04-18T21:05:51.740 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.740 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.740 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:51.740 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.653935+0000", 2024-04-18T21:05:51.740 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.4856000000000001e-05 2024-04-18T21:05:51.740 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:51.740 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:51.740 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:51.740 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.740 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.741 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 3 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:05:51.741 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:05:51.741 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 46.009131205000003, 2024-04-18T21:05:51.741 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0087842319999999995, 2024-04-18T21:05:51.741 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:51.741 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:51.741 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "reached pg", 2024-04-18T21:05:51.741 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:51.741 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.741 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:51.741 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:05:51.741 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:51.741 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.741 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.741 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:51.742 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:05:51.742 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:51.742 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.742 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.742 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:51.742 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:05:51.742 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.8299999999999996e-07 2024-04-18T21:05:51.742 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.742 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.742 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:51.742 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647642+0000", 2024-04-18T21:05:51.742 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4724e-05 2024-04-18T21:05:51.742 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.742 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.742 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:51.743 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647679+0000", 2024-04-18T21:05:51.743 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.6662999999999998e-05 2024-04-18T21:05:51.743 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.743 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.743 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:51.743 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647735+0000", 2024-04-18T21:05:51.743 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.6196000000000002e-05 2024-04-18T21:05:51.743 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.743 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.743 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:51.743 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649865+0000", 2024-04-18T21:05:51.743 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0021299489999999999 2024-04-18T21:05:51.743 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.743 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.743 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:51.744 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656411+0000", 2024-04-18T21:05:51.744 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0065460170000000003 2024-04-18T21:05:51.744 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:51.744 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:51.744 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:51.744 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.744 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.744 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:51.744 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:05:51.744 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 46.008986008999997, 2024-04-18T21:05:51.744 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0095703190000000007, 2024-04-18T21:05:51.744 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:51.744 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:51.744 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:51.744 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:51.745 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.745 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:51.745 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:05:51.745 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:51.745 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.745 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.745 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:51.745 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:05:51.745 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:51.745 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.745 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.745 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:51.745 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647773+0000", 2024-04-18T21:05:51.745 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.046e-06 2024-04-18T21:05:51.745 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.745 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.746 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:51.746 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647795+0000", 2024-04-18T21:05:51.746 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2616000000000002e-05 2024-04-18T21:05:51.746 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.746 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.746 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:51.746 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647818+0000", 2024-04-18T21:05:51.746 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3110000000000001e-05 2024-04-18T21:05:51.746 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.746 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.746 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:51.746 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647834+0000", 2024-04-18T21:05:51.746 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5163e-05 2024-04-18T21:05:51.746 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.747 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.747 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:51.747 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650682+0000", 2024-04-18T21:05:51.747 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0028479759999999999 2024-04-18T21:05:51.747 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.747 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.747 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:51.747 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650730+0000", 2024-04-18T21:05:51.747 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.8375999999999999e-05 2024-04-18T21:05:51.747 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.747 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.747 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:51.747 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656751+0000", 2024-04-18T21:05:51.747 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0060211880000000002 2024-04-18T21:05:51.747 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.748 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.748 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:51.748 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657342+0000", 2024-04-18T21:05:51.748 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00059084399999999998 2024-04-18T21:05:51.748 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:51.748 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:51.748 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:51.748 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.748 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.748 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:51.748 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:05:51.748 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 46.008573722999998, 2024-04-18T21:05:51.748 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0092471759999999993, 2024-04-18T21:05:51.748 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:51.748 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:51.749 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:51.749 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:51.749 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.749 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:51.749 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:05:51.749 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:51.749 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.749 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.749 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:51.749 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:05:51.749 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:51.749 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.749 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.749 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:51.750 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648185+0000", 2024-04-18T21:05:51.750 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.5000000000000001e-07 2024-04-18T21:05:51.750 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.750 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.750 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:51.750 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648203+0000", 2024-04-18T21:05:51.750 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.8102999999999999e-05 2024-04-18T21:05:51.750 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.750 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.750 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:51.750 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648226+0000", 2024-04-18T21:05:51.750 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2921999999999998e-05 2024-04-18T21:05:51.750 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.750 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.751 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:51.751 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648241+0000", 2024-04-18T21:05:51.751 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5336999999999999e-05 2024-04-18T21:05:51.751 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.751 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.751 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:51.751 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.651268+0000", 2024-04-18T21:05:51.751 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0030271640000000002 2024-04-18T21:05:51.751 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.751 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.751 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:51.751 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.651319+0000", 2024-04-18T21:05:51.751 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.0843000000000001e-05 2024-04-18T21:05:51.751 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.751 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.751 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:51.752 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657347+0000", 2024-04-18T21:05:51.752 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0060279770000000003 2024-04-18T21:05:51.752 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:51.752 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:51.752 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:51.752 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657431+0000", 2024-04-18T21:05:51.752 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.3980000000000006e-05 2024-04-18T21:05:51.752 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:51.752 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:51.752 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:51.752 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:51.752 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:51.752 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:05:51.753 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:05:51.755 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:51.755+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:51.855 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:51.855+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:51.884 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:05:51.884 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:05:51.884 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-04-18T21:05:51.884 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:05:51.898 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:05:51.956 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:51.955+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:51.982 INFO:teuthology.orchestra.run.smithi078.stderr:noscrub is unset 2024-04-18T21:05:52.017 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:05:52.017 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:05:52.017 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-18T21:05:52.017 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-18T21:05:52.017 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:05:52.032 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:05:52.073 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:52.075+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:52.157 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:52.159+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:52.199 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:05:52.199 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-18T21:05:52.199 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-18T21:05:52.199 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:05:52.199 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.199 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:52.199 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:05:52.199 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 46.582978267000001, 2024-04-18T21:05:52.199 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.034065303999999998, 2024-04-18T21:05:52.199 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:52.200 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:52.200 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:52.200 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:52.200 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.200 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:52.200 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:05:52.200 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:52.200 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.200 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.200 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:52.200 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:05:52.200 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:52.200 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.200 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.200 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:52.201 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615254+0000", 2024-04-18T21:05:52.201 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7829999999999999e-06 2024-04-18T21:05:52.201 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.201 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.201 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:52.201 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615267+0000", 2024-04-18T21:05:52.201 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3334e-05 2024-04-18T21:05:52.201 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.201 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.201 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:52.201 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615294+0000", 2024-04-18T21:05:52.201 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7271999999999999e-05 2024-04-18T21:05:52.201 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.201 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.202 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:52.202 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615321+0000", 2024-04-18T21:05:52.202 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.637e-05 2024-04-18T21:05:52.202 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.202 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.202 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:52.202 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615479+0000", 2024-04-18T21:05:52.202 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000158493 2024-04-18T21:05:52.202 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.202 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.202 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:52.202 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615498+0000", 2024-04-18T21:05:52.202 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9148999999999999e-05 2024-04-18T21:05:52.202 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.203 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.203 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:52.203 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632915+0000", 2024-04-18T21:05:52.203 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.017416551999999998 2024-04-18T21:05:52.203 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.203 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.203 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:52.203 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633302+0000", 2024-04-18T21:05:52.203 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00038725000000000001 2024-04-18T21:05:52.203 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.203 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.203 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:52.203 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633638+0000", 2024-04-18T21:05:52.203 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000335946 2024-04-18T21:05:52.204 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.204 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.204 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:52.204 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645976+0000", 2024-04-18T21:05:52.204 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012337617 2024-04-18T21:05:52.204 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.204 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.204 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:52.204 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649080+0000", 2024-04-18T21:05:52.204 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031038929999999999 2024-04-18T21:05:52.204 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.204 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.204 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:52.204 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649207+0000", 2024-04-18T21:05:52.204 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000127537 2024-04-18T21:05:52.204 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.205 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.205 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:52.205 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649316+0000", 2024-04-18T21:05:52.205 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109108 2024-04-18T21:05:52.205 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:52.205 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:52.205 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:52.205 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.205 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.205 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:52.205 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:05:52.205 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 46.582844889999997, 2024-04-18T21:05:52.205 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036275764000000002, 2024-04-18T21:05:52.205 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:52.205 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:52.206 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:52.206 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:52.206 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.206 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:52.206 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:05:52.206 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:52.206 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.206 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.206 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:52.206 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:05:52.206 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:52.206 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.206 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.206 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:52.206 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615386+0000", 2024-04-18T21:05:52.207 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.573e-06 2024-04-18T21:05:52.207 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.207 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.207 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:52.207 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:05:52.207 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0723999999999999e-05 2024-04-18T21:05:52.207 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.207 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.207 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:52.207 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615418+0000", 2024-04-18T21:05:52.207 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0902000000000001e-05 2024-04-18T21:05:52.207 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.207 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.207 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:52.207 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615433+0000", 2024-04-18T21:05:52.208 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5319999999999999e-05 2024-04-18T21:05:52.208 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.208 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.208 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:52.208 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615659+0000", 2024-04-18T21:05:52.208 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000226095 2024-04-18T21:05:52.208 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.208 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.208 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:52.208 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:52.208 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1276e-05 2024-04-18T21:05:52.208 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.208 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.208 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:52.208 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643654+0000", 2024-04-18T21:05:52.209 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027983238000000001 2024-04-18T21:05:52.209 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.209 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.209 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:52.209 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643868+0000", 2024-04-18T21:05:52.209 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000214305 2024-04-18T21:05:52.209 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.209 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.209 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:52.209 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:05:52.209 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035892200000000002 2024-04-18T21:05:52.209 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.209 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.209 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:52.209 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646056+0000", 2024-04-18T21:05:52.209 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001829172 2024-04-18T21:05:52.210 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.210 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.210 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:52.210 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651406+0000", 2024-04-18T21:05:52.210 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0053504800000000003 2024-04-18T21:05:52.210 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.210 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.210 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:52.210 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651551+0000", 2024-04-18T21:05:52.210 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014427999999999999 2024-04-18T21:05:52.210 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.210 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.210 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:52.210 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651660+0000", 2024-04-18T21:05:52.211 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109477 2024-04-18T21:05:52.211 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:52.211 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:52.211 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:52.211 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.211 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.211 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:52.211 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:05:52.211 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 46.582771508, 2024-04-18T21:05:52.211 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045668994999999997, 2024-04-18T21:05:52.211 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:52.211 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:52.211 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:52.211 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:52.211 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.212 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:52.212 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:05:52.212 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:52.212 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.212 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.212 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:52.212 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:05:52.212 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:52.212 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.212 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.212 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:52.212 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615459+0000", 2024-04-18T21:05:52.212 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5030000000000001e-06 2024-04-18T21:05:52.212 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.213 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.213 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:52.213 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615506+0000", 2024-04-18T21:05:52.213 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6872000000000001e-05 2024-04-18T21:05:52.213 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.213 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.213 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:52.213 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615527+0000", 2024-04-18T21:05:52.213 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0763000000000001e-05 2024-04-18T21:05:52.213 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.213 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.213 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:52.213 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615551+0000", 2024-04-18T21:05:52.213 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4159e-05 2024-04-18T21:05:52.214 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.214 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.214 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:52.214 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615736+0000", 2024-04-18T21:05:52.214 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018499599999999999 2024-04-18T21:05:52.214 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.214 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.214 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:52.214 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615748+0000", 2024-04-18T21:05:52.214 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2272999999999999e-05 2024-04-18T21:05:52.214 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.214 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.215 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:52.215 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635481+0000", 2024-04-18T21:05:52.215 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019732772999999999 2024-04-18T21:05:52.215 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.215 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.215 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:52.215 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635791+0000", 2024-04-18T21:05:52.215 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031013299999999998 2024-04-18T21:05:52.215 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.215 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.215 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:52.215 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636101+0000", 2024-04-18T21:05:52.215 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030943300000000002 2024-04-18T21:05:52.215 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.215 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.216 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:52.216 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646043+0000", 2024-04-18T21:05:52.216 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099428139999999995 2024-04-18T21:05:52.216 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.216 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.216 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:52.216 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660991+0000", 2024-04-18T21:05:52.216 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014947142 2024-04-18T21:05:52.216 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.216 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.216 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:52.216 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661061+0000", 2024-04-18T21:05:52.216 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0438000000000006e-05 2024-04-18T21:05:52.216 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.216 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.217 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:52.217 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661127+0000", 2024-04-18T21:05:52.217 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5696000000000003e-05 2024-04-18T21:05:52.217 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:52.217 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:52.217 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:52.217 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.217 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.217 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:52.217 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:52.217 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 46.582559080000003, 2024-04-18T21:05:52.217 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045745085999999997, 2024-04-18T21:05:52.217 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:52.217 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:52.218 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:52.218 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:52.218 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.218 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:52.218 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:52.218 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:52.218 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.218 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.218 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:52.218 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:52.218 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:52.218 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.218 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.218 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:52.219 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:05:52.219 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7400000000000001e-06 2024-04-18T21:05:52.219 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.219 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.219 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:52.219 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:05:52.219 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8133e-05 2024-04-18T21:05:52.219 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.219 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.219 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:52.219 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615726+0000", 2024-04-18T21:05:52.219 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6132e-05 2024-04-18T21:05:52.219 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.219 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.219 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:52.220 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615742+0000", 2024-04-18T21:05:52.220 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6157000000000001e-05 2024-04-18T21:05:52.220 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.220 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.220 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:52.220 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615937+0000", 2024-04-18T21:05:52.220 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000194768 2024-04-18T21:05:52.220 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.220 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.220 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:52.220 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615950+0000", 2024-04-18T21:05:52.220 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3084e-05 2024-04-18T21:05:52.220 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.220 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.220 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:52.221 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643676+0000", 2024-04-18T21:05:52.221 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027725639999999999 2024-04-18T21:05:52.221 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.221 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.221 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:52.221 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643867+0000", 2024-04-18T21:05:52.221 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019075900000000001 2024-04-18T21:05:52.221 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.221 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.221 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:52.221 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:05:52.221 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036013799999999997 2024-04-18T21:05:52.221 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.221 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.221 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:52.222 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646068+0000", 2024-04-18T21:05:52.222 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001841536 2024-04-18T21:05:52.222 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.222 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.222 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:52.222 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661184+0000", 2024-04-18T21:05:52.222 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015115458999999999 2024-04-18T21:05:52.222 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.222 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.222 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:52.222 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661283+0000", 2024-04-18T21:05:52.222 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9502999999999999e-05 2024-04-18T21:05:52.222 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.222 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.223 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:52.223 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661415+0000", 2024-04-18T21:05:52.223 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000132037 2024-04-18T21:05:52.223 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:52.223 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:52.223 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:52.223 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.223 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.223 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:52.223 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:05:52.223 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 46.582437392999999, 2024-04-18T21:05:52.223 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036185947000000003, 2024-04-18T21:05:52.223 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:52.223 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:52.224 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:52.224 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:52.224 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.224 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:52.224 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:05:52.224 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:52.224 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.224 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.224 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:52.224 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:05:52.224 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:52.224 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.224 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.224 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:52.224 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615794+0000", 2024-04-18T21:05:52.224 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6440000000000001e-06 2024-04-18T21:05:52.225 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.225 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.225 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:52.225 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615803+0000", 2024-04-18T21:05:52.225 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1220000000000001e-06 2024-04-18T21:05:52.225 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.225 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.225 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:52.225 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615827+0000", 2024-04-18T21:05:52.225 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3997000000000001e-05 2024-04-18T21:05:52.225 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.225 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.225 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:52.225 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615899+0000", 2024-04-18T21:05:52.225 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2741e-05 2024-04-18T21:05:52.226 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.226 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.226 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:52.226 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616019+0000", 2024-04-18T21:05:52.226 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119874 2024-04-18T21:05:52.226 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.226 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.226 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:52.226 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616029+0000", 2024-04-18T21:05:52.226 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:05:52.226 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.226 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.226 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:52.227 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644823+0000", 2024-04-18T21:05:52.227 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.028793151999999999 2024-04-18T21:05:52.227 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.227 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.227 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:52.227 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645106+0000", 2024-04-18T21:05:52.227 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028379700000000002 2024-04-18T21:05:52.227 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.227 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.227 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:52.227 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645294+0000", 2024-04-18T21:05:52.227 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000187181 2024-04-18T21:05:52.227 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.227 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.227 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:52.228 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646763+0000", 2024-04-18T21:05:52.228 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0014691050000000001 2024-04-18T21:05:52.228 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.228 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.228 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:52.228 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651784+0000", 2024-04-18T21:05:52.228 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050211650000000002 2024-04-18T21:05:52.228 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.228 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.228 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:52.228 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651876+0000", 2024-04-18T21:05:52.228 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2503999999999994e-05 2024-04-18T21:05:52.228 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.228 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.228 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:52.229 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651978+0000", 2024-04-18T21:05:52.229 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000101475 2024-04-18T21:05:52.229 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:52.229 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:52.229 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:52.229 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.229 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.229 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:52.229 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:52.229 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 46.582288785999999, 2024-04-18T21:05:52.229 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032262322000000003, 2024-04-18T21:05:52.229 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:52.229 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:52.229 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:52.230 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:52.230 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.230 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:52.230 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:52.230 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:52.230 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.230 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.230 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:52.230 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:52.230 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:52.230 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.230 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.230 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:52.230 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615943+0000", 2024-04-18T21:05:52.231 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1959999999999998e-06 2024-04-18T21:05:52.231 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.231 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.231 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:52.231 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615956+0000", 2024-04-18T21:05:52.231 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3424000000000001e-05 2024-04-18T21:05:52.231 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.231 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.231 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:52.231 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615983+0000", 2024-04-18T21:05:52.231 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7072000000000001e-05 2024-04-18T21:05:52.231 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.231 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.231 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:52.231 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616006+0000", 2024-04-18T21:05:52.232 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2823000000000002e-05 2024-04-18T21:05:52.232 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.232 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.232 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:52.232 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616156+0000", 2024-04-18T21:05:52.232 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014962299999999999 2024-04-18T21:05:52.232 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.232 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.232 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:52.232 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616174+0000", 2024-04-18T21:05:52.232 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8082999999999999e-05 2024-04-18T21:05:52.232 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.232 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.232 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:52.233 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.629952+0000", 2024-04-18T21:05:52.233 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013778514 2024-04-18T21:05:52.233 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.233 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.233 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:52.233 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630201+0000", 2024-04-18T21:05:52.233 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024918100000000001 2024-04-18T21:05:52.233 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.233 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.233 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:52.233 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630386+0000", 2024-04-18T21:05:52.233 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018436900000000001 2024-04-18T21:05:52.233 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.233 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.234 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:52.234 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643169+0000", 2024-04-18T21:05:52.234 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012782774 2024-04-18T21:05:52.234 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.234 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.234 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:52.234 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.647924+0000", 2024-04-18T21:05:52.234 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004755787 2024-04-18T21:05:52.234 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.234 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.234 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:52.234 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648069+0000", 2024-04-18T21:05:52.234 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014459600000000001 2024-04-18T21:05:52.234 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.234 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.235 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:52.235 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648203+0000", 2024-04-18T21:05:52.235 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013388000000000001 2024-04-18T21:05:52.235 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:52.235 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:52.235 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:52.235 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.235 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.235 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:52.235 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:05:52.235 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 46.582180522000002, 2024-04-18T21:05:52.235 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032489736999999998, 2024-04-18T21:05:52.235 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:52.235 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:52.236 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:52.236 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:52.236 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.236 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:52.236 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:05:52.236 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:52.236 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.236 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.236 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:52.236 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:05:52.236 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:52.236 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.236 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.236 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:52.236 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616050+0000", 2024-04-18T21:05:52.237 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.606e-06 2024-04-18T21:05:52.237 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.237 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.237 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:52.237 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616061+0000", 2024-04-18T21:05:52.237 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0463e-05 2024-04-18T21:05:52.237 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.237 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.237 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:52.237 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616092+0000", 2024-04-18T21:05:52.237 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1415999999999999e-05 2024-04-18T21:05:52.237 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.237 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.237 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:52.237 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616109+0000", 2024-04-18T21:05:52.238 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6557000000000001e-05 2024-04-18T21:05:52.238 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.238 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.238 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:52.238 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616358+0000", 2024-04-18T21:05:52.238 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000249077 2024-04-18T21:05:52.238 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.238 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.238 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:52.238 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616370+0000", 2024-04-18T21:05:52.238 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2037e-05 2024-04-18T21:05:52.238 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.238 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.238 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:52.239 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.634920+0000", 2024-04-18T21:05:52.239 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018550397 2024-04-18T21:05:52.239 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.239 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.239 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:52.239 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640420+0000", 2024-04-18T21:05:52.239 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055000539999999999 2024-04-18T21:05:52.239 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.239 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.239 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:52.239 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648538+0000", 2024-04-18T21:05:52.239 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0081181299999999994 2024-04-18T21:05:52.239 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:52.240 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:52.240 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:52.240 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.240 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.240 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:52.240 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:05:52.240 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 46.582096200999999, 2024-04-18T21:05:52.240 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036090029000000003, 2024-04-18T21:05:52.240 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:52.240 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:52.240 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:52.240 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:52.240 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.240 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:52.240 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:05:52.241 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:52.241 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.241 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.241 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:52.241 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:05:52.241 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:52.241 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.241 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.241 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:52.241 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616134+0000", 2024-04-18T21:05:52.241 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.353e-06 2024-04-18T21:05:52.241 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.241 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.241 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:52.242 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616141+0000", 2024-04-18T21:05:52.242 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2770000000000002e-06 2024-04-18T21:05:52.242 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.242 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.242 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:52.242 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616160+0000", 2024-04-18T21:05:52.242 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.91e-05 2024-04-18T21:05:52.242 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.242 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.242 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:52.242 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616170+0000", 2024-04-18T21:05:52.242 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7699999999999996e-06 2024-04-18T21:05:52.242 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.242 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.242 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:52.243 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616275+0000", 2024-04-18T21:05:52.243 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105313 2024-04-18T21:05:52.243 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.243 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.243 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:52.243 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616288+0000", 2024-04-18T21:05:52.243 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3027000000000001e-05 2024-04-18T21:05:52.243 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.243 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.243 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:52.243 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646160+0000", 2024-04-18T21:05:52.243 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.029872019 2024-04-18T21:05:52.243 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.243 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.244 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:52.244 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646368+0000", 2024-04-18T21:05:52.244 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020811899999999999 2024-04-18T21:05:52.244 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.244 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.244 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:52.244 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652223+0000", 2024-04-18T21:05:52.244 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.005855051 2024-04-18T21:05:52.244 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:52.244 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:52.244 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:52.244 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.244 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.244 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:52.244 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:05:52.245 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 46.582038632, 2024-04-18T21:05:52.245 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043572403000000003, 2024-04-18T21:05:52.245 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:52.245 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:52.245 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:52.245 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:52.245 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.245 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:52.245 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:05:52.245 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:52.245 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.245 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.245 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:52.245 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:05:52.245 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:52.246 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.246 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.246 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:52.246 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616192+0000", 2024-04-18T21:05:52.246 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:05:52.246 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.246 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.246 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:52.246 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616203+0000", 2024-04-18T21:05:52.246 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0890000000000001e-05 2024-04-18T21:05:52.246 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.246 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.246 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:52.246 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616223+0000", 2024-04-18T21:05:52.246 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0409000000000001e-05 2024-04-18T21:05:52.247 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.247 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.247 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:52.247 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616238+0000", 2024-04-18T21:05:52.247 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5160000000000001e-05 2024-04-18T21:05:52.247 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.247 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.247 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:52.247 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616343+0000", 2024-04-18T21:05:52.247 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000104831 2024-04-18T21:05:52.247 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.247 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.247 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:52.247 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616357+0000", 2024-04-18T21:05:52.248 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3686000000000001e-05 2024-04-18T21:05:52.248 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.248 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.248 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:52.248 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635912+0000", 2024-04-18T21:05:52.248 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019554944000000001 2024-04-18T21:05:52.248 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.248 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.248 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:52.248 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636231+0000", 2024-04-18T21:05:52.248 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000318766 2024-04-18T21:05:52.248 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.248 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.248 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:52.248 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659763+0000", 2024-04-18T21:05:52.249 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023532474000000001 2024-04-18T21:05:52.249 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:52.249 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:52.249 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:52.249 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.249 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.249 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:52.249 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:05:52.249 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 46.578109925, 2024-04-18T21:05:52.249 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015007971, 2024-04-18T21:05:52.249 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:52.249 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:52.249 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:52.249 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:52.249 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.250 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:52.250 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:05:52.250 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:52.250 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.250 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.250 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:52.250 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:05:52.250 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:52.250 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.250 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.250 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:52.250 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620120+0000", 2024-04-18T21:05:52.250 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0359999999999999e-06 2024-04-18T21:05:52.250 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.250 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.251 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:52.251 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620157+0000", 2024-04-18T21:05:52.251 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6636e-05 2024-04-18T21:05:52.251 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.251 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.251 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:52.251 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620177+0000", 2024-04-18T21:05:52.251 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0247000000000001e-05 2024-04-18T21:05:52.251 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.251 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.251 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:52.251 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620195+0000", 2024-04-18T21:05:52.251 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7819e-05 2024-04-18T21:05:52.251 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.251 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.252 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:52.252 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620342+0000", 2024-04-18T21:05:52.252 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014643300000000001 2024-04-18T21:05:52.252 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.252 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.252 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:52.252 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620405+0000", 2024-04-18T21:05:52.252 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3522000000000006e-05 2024-04-18T21:05:52.252 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.252 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.252 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:52.252 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635016+0000", 2024-04-18T21:05:52.252 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014610840999999999 2024-04-18T21:05:52.252 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.253 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.253 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:52.253 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635127+0000", 2024-04-18T21:05:52.253 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111437 2024-04-18T21:05:52.253 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:52.253 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:52.253 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:52.253 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.253 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.253 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:52.253 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:05:52.253 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 46.578002656999999, 2024-04-18T21:05:52.253 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012693296, 2024-04-18T21:05:52.253 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:52.253 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:52.254 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:52.254 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:52.254 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.254 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:52.254 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:05:52.254 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:52.254 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.254 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.254 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:52.254 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:05:52.254 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:52.254 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.254 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.254 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:52.254 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620228+0000", 2024-04-18T21:05:52.255 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:05:52.255 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.255 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.255 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:52.255 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620236+0000", 2024-04-18T21:05:52.255 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.303e-06 2024-04-18T21:05:52.255 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.255 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.255 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:52.255 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620255+0000", 2024-04-18T21:05:52.255 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9406e-05 2024-04-18T21:05:52.255 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.255 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.255 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:52.256 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620274+0000", 2024-04-18T21:05:52.256 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8940000000000002e-05 2024-04-18T21:05:52.256 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.256 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.256 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:52.256 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:05:52.256 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001558753 2024-04-18T21:05:52.256 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.256 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.256 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:52.256 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621879+0000", 2024-04-18T21:05:52.256 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6359000000000001e-05 2024-04-18T21:05:52.256 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.256 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.257 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:52.257 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632841+0000", 2024-04-18T21:05:52.257 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010961907 2024-04-18T21:05:52.257 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.257 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.257 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:52.257 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632920+0000", 2024-04-18T21:05:52.257 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8714999999999994e-05 2024-04-18T21:05:52.257 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:52.257 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:52.257 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:52.257 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.257 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.257 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:52.257 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:05:52.257 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 46.576456894000003, 2024-04-18T21:05:52.258 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013445702, 2024-04-18T21:05:52.258 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:52.258 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:52.258 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:52.258 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:52.258 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.258 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:52.258 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:05:52.258 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:52.258 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.258 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.258 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:52.258 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:05:52.259 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:52.259 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.259 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.259 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:52.259 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621774+0000", 2024-04-18T21:05:52.259 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2500000000000001e-06 2024-04-18T21:05:52.259 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.259 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.259 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:52.259 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621786+0000", 2024-04-18T21:05:52.259 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2636000000000001e-05 2024-04-18T21:05:52.259 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.259 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.259 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:52.259 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621814+0000", 2024-04-18T21:05:52.259 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7823000000000001e-05 2024-04-18T21:05:52.260 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.260 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.260 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:52.260 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621844+0000", 2024-04-18T21:05:52.260 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9589000000000001e-05 2024-04-18T21:05:52.260 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.260 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.260 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:52.260 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622253+0000", 2024-04-18T21:05:52.260 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040963700000000002 2024-04-18T21:05:52.260 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.260 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.260 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:52.260 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622304+0000", 2024-04-18T21:05:52.260 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0868999999999997e-05 2024-04-18T21:05:52.261 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.261 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.261 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:52.261 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635133+0000", 2024-04-18T21:05:52.261 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012829136 2024-04-18T21:05:52.261 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.261 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.261 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:52.261 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635218+0000", 2024-04-18T21:05:52.261 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4761999999999999e-05 2024-04-18T21:05:52.261 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:52.261 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:52.261 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:52.261 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.262 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.262 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:52.262 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:05:52.262 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 46.576330134000003, 2024-04-18T21:05:52.262 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014162065, 2024-04-18T21:05:52.262 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:52.262 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:52.262 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:52.262 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:52.262 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.262 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:52.262 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:05:52.262 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:52.262 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.263 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.263 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:52.263 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:05:52.263 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:52.263 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.263 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.263 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:52.263 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621900+0000", 2024-04-18T21:05:52.263 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:05:52.263 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.263 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.263 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:52.263 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621910+0000", 2024-04-18T21:05:52.263 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0207000000000001e-05 2024-04-18T21:05:52.263 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.263 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.264 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:52.264 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621932+0000", 2024-04-18T21:05:52.264 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1789000000000001e-05 2024-04-18T21:05:52.264 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.264 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.264 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:52.264 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621946+0000", 2024-04-18T21:05:52.264 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4212999999999999e-05 2024-04-18T21:05:52.264 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.264 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.264 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:52.264 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624477+0000", 2024-04-18T21:05:52.264 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025303470000000001 2024-04-18T21:05:52.264 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.264 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.264 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:52.265 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624525+0000", 2024-04-18T21:05:52.265 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8084999999999998e-05 2024-04-18T21:05:52.265 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.265 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.265 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:52.265 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635976+0000", 2024-04-18T21:05:52.265 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.011451368999999999 2024-04-18T21:05:52.265 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.265 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.265 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:52.265 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636061+0000", 2024-04-18T21:05:52.265 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5094999999999998e-05 2024-04-18T21:05:52.265 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:52.265 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:52.265 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:52.266 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.266 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.266 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:05:52.266 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:05:52.266 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 46.567094509, 2024-04-18T21:05:52.266 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0098014739999999993, 2024-04-18T21:05:52.266 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:52.266 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:52.266 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:05:52.266 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:52.266 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.266 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:52.266 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:05:52.266 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:52.267 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.267 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.267 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:52.267 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:05:52.267 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:52.267 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.267 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.267 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:52.267 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631136+0000", 2024-04-18T21:05:52.267 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0139999999999999e-06 2024-04-18T21:05:52.267 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.267 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.267 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:52.267 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631152+0000", 2024-04-18T21:05:52.268 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6365999999999999e-05 2024-04-18T21:05:52.268 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.268 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.268 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:52.268 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631961+0000", 2024-04-18T21:05:52.268 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00080873100000000003 2024-04-18T21:05:52.268 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.268 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.268 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:52.268 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632021+0000", 2024-04-18T21:05:52.268 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0541999999999997e-05 2024-04-18T21:05:52.268 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.268 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.268 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:52.268 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633539+0000", 2024-04-18T21:05:52.269 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015175639999999999 2024-04-18T21:05:52.269 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.269 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.269 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:52.269 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640936+0000", 2024-04-18T21:05:52.269 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007397257 2024-04-18T21:05:52.269 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:52.269 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:52.269 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:52.269 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.269 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.269 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-18T21:05:52.269 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:05:52.269 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 46.549633075999999, 2024-04-18T21:05:52.270 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00073592199999999997, 2024-04-18T21:05:52.270 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:52.270 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:52.270 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:52.270 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:52.270 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.270 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:52.270 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:05:52.270 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:52.270 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.270 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.270 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:52.270 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:05:52.270 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:52.271 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.271 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.271 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:52.271 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648597+0000", 2024-04-18T21:05:52.271 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:05:52.271 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.271 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.271 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:52.271 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648605+0000", 2024-04-18T21:05:52.271 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3960000000000006e-06 2024-04-18T21:05:52.271 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.271 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.271 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:52.271 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648625+0000", 2024-04-18T21:05:52.272 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9987e-05 2024-04-18T21:05:52.272 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.272 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.272 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:52.272 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648643+0000", 2024-04-18T21:05:52.272 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7079e-05 2024-04-18T21:05:52.272 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.272 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.272 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:52.272 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649043+0000", 2024-04-18T21:05:52.272 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040083399999999998 2024-04-18T21:05:52.272 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.272 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.272 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:52.272 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649062+0000", 2024-04-18T21:05:52.273 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9052999999999999e-05 2024-04-18T21:05:52.273 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.273 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.273 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:52.273 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649332+0000", 2024-04-18T21:05:52.273 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026971999999999999 2024-04-18T21:05:52.273 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:52.273 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:52.273 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:52.273 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.273 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.273 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:05:52.273 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:05:52.273 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 46.546858174999997, 2024-04-18T21:05:52.273 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00086123999999999999, 2024-04-18T21:05:52.274 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:52.274 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:52.274 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:05:52.274 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:52.274 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.274 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:52.274 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:05:52.274 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:52.274 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.274 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.274 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:52.274 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:05:52.274 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:52.274 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.275 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.275 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:52.275 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651372+0000", 2024-04-18T21:05:52.275 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7599999999999997e-07 2024-04-18T21:05:52.275 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.275 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.275 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:52.275 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651377+0000", 2024-04-18T21:05:52.275 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.22e-06 2024-04-18T21:05:52.275 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.275 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.275 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:52.275 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651394+0000", 2024-04-18T21:05:52.275 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6646999999999998e-05 2024-04-18T21:05:52.275 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.275 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.276 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:52.276 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651427+0000", 2024-04-18T21:05:52.276 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3682e-05 2024-04-18T21:05:52.276 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.276 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.276 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:52.276 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652029+0000", 2024-04-18T21:05:52.276 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00060152199999999995 2024-04-18T21:05:52.276 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.276 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.276 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:52.276 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652232+0000", 2024-04-18T21:05:52.276 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020359299999999999 2024-04-18T21:05:52.276 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:52.276 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:52.276 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:52.277 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.277 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.277 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:05:52.277 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:05:52.277 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 46.538831213000002, 2024-04-18T21:05:52.277 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0017426200000000001, 2024-04-18T21:05:52.277 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:52.277 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:52.277 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:52.277 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:52.277 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.277 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:52.277 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:05:52.277 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:52.277 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.278 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.278 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:52.278 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:05:52.278 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:52.278 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.278 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.278 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:52.278 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659399+0000", 2024-04-18T21:05:52.278 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6000000000000002e-07 2024-04-18T21:05:52.278 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.278 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.278 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:52.278 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659405+0000", 2024-04-18T21:05:52.278 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5069999999999997e-06 2024-04-18T21:05:52.279 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.279 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.279 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:52.279 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659425+0000", 2024-04-18T21:05:52.279 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.927e-05 2024-04-18T21:05:52.279 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.279 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.279 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:52.279 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659443+0000", 2024-04-18T21:05:52.279 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8051999999999999e-05 2024-04-18T21:05:52.279 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.279 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.279 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:52.279 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660973+0000", 2024-04-18T21:05:52.279 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001530106 2024-04-18T21:05:52.280 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.280 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.280 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:52.280 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660983+0000", 2024-04-18T21:05:52.280 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0516999999999999e-05 2024-04-18T21:05:52.280 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.280 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.280 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:52.280 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661141+0000", 2024-04-18T21:05:52.280 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015730799999999999 2024-04-18T21:05:52.280 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:52.280 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:52.280 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:52.280 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.280 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.280 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:05:52.281 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:05:52.281 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 46.538614588000002, 2024-04-18T21:05:52.281 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001812311, 2024-04-18T21:05:52.281 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:52.281 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:52.281 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:52.281 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:52.281 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.281 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:52.281 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:05:52.281 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:52.281 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.281 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.281 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:52.281 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:05:52.282 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:52.282 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.282 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.282 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:52.282 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659616+0000", 2024-04-18T21:05:52.282 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.277e-06 2024-04-18T21:05:52.282 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.282 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.282 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:52.282 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659625+0000", 2024-04-18T21:05:52.282 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5359999999999998e-06 2024-04-18T21:05:52.282 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.282 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.282 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:52.283 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659647+0000", 2024-04-18T21:05:52.283 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1857000000000001e-05 2024-04-18T21:05:52.283 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.283 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.283 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:52.283 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659664+0000", 2024-04-18T21:05:52.283 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6405999999999998e-05 2024-04-18T21:05:52.283 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.283 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.283 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:52.283 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661169+0000", 2024-04-18T21:05:52.283 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015054179999999999 2024-04-18T21:05:52.283 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.283 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.284 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:52.284 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661177+0000", 2024-04-18T21:05:52.284 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9680000000000006e-06 2024-04-18T21:05:52.284 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.284 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.284 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:52.284 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661427+0000", 2024-04-18T21:05:52.284 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024984900000000001 2024-04-18T21:05:52.284 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:52.284 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:52.284 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:52.284 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.284 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.284 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-18T21:05:52.284 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:05:52.285 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 44.585693980000002, 2024-04-18T21:05:52.285 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0030975030000000001, 2024-04-18T21:05:52.285 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:52.285 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:52.285 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:52.285 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:52.285 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.285 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:52.285 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:05:52.285 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:52.285 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.285 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.285 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:52.285 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:05:52.285 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:52.285 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.286 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.286 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:52.286 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612538+0000", 2024-04-18T21:05:52.286 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6259999999999999e-06 2024-04-18T21:05:52.286 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.286 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.286 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:52.286 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612552+0000", 2024-04-18T21:05:52.286 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4073999999999999e-05 2024-04-18T21:05:52.286 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.286 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.286 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:52.286 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612585+0000", 2024-04-18T21:05:52.286 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3504999999999999e-05 2024-04-18T21:05:52.287 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.287 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.287 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:52.287 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612601+0000", 2024-04-18T21:05:52.287 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5194000000000001e-05 2024-04-18T21:05:52.287 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.287 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.287 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:52.287 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612746+0000", 2024-04-18T21:05:52.287 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145666 2024-04-18T21:05:52.287 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.287 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.287 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:52.287 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612953+0000", 2024-04-18T21:05:52.287 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000207109 2024-04-18T21:05:52.288 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.288 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.288 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:52.288 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.613134+0000", 2024-04-18T21:05:52.288 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018041300000000001 2024-04-18T21:05:52.288 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.288 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.288 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:52.288 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.614411+0000", 2024-04-18T21:05:52.288 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0012769929999999999 2024-04-18T21:05:52.288 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.288 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.288 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:52.288 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615441+0000", 2024-04-18T21:05:52.288 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001029917 2024-04-18T21:05:52.288 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.289 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.289 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:52.289 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615522+0000", 2024-04-18T21:05:52.289 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1142000000000003e-05 2024-04-18T21:05:52.289 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.289 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.289 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:52.289 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615633+0000", 2024-04-18T21:05:52.289 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000110864 2024-04-18T21:05:52.289 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:52.289 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:52.289 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:52.289 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.289 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.289 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-18T21:05:52.290 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:05:52.290 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 26.583408168999998, 2024-04-18T21:05:52.290 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088979039999999999, 2024-04-18T21:05:52.290 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:52.290 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:52.290 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:52.290 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:52.290 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.290 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:52.290 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:05:52.290 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:52.290 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.290 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.290 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:52.291 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:05:52.291 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:52.291 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.291 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.291 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:52.291 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614825+0000", 2024-04-18T21:05:52.291 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4829999999999999e-06 2024-04-18T21:05:52.291 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.291 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.291 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:52.291 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614843+0000", 2024-04-18T21:05:52.291 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8777e-05 2024-04-18T21:05:52.291 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.291 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.291 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:52.291 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614884+0000", 2024-04-18T21:05:52.292 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1051999999999999e-05 2024-04-18T21:05:52.292 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.292 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.292 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:52.292 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614903+0000", 2024-04-18T21:05:52.292 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9069999999999999e-05 2024-04-18T21:05:52.292 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.292 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.292 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:52.292 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615047+0000", 2024-04-18T21:05:52.292 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014374400000000001 2024-04-18T21:05:52.292 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.292 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.292 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:52.292 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615061+0000", 2024-04-18T21:05:52.292 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4063000000000001e-05 2024-04-18T21:05:52.293 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.293 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.293 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:52.293 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621064+0000", 2024-04-18T21:05:52.293 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0060029200000000001 2024-04-18T21:05:52.293 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.293 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.293 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:52.293 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621211+0000", 2024-04-18T21:05:52.293 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000147224 2024-04-18T21:05:52.293 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.293 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.293 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:52.293 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621396+0000", 2024-04-18T21:05:52.293 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018454699999999999 2024-04-18T21:05:52.294 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.294 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.294 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:52.294 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.622517+0000", 2024-04-18T21:05:52.294 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001121424 2024-04-18T21:05:52.294 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.294 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.294 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:52.294 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623571+0000", 2024-04-18T21:05:52.294 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010538660000000001 2024-04-18T21:05:52.294 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.294 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.294 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:52.294 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623658+0000", 2024-04-18T21:05:52.295 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6439000000000004e-05 2024-04-18T21:05:52.295 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:52.295 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:52.295 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:52.295 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623719+0000", 2024-04-18T21:05:52.295 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1295000000000002e-05 2024-04-18T21:05:52.295 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:52.295 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:52.295 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:52.295 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:52.295 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:52.295 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:05:52.297 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:52.299+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:52.297 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:05:52.397 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:52.395+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:52.418 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:05:52.431 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:05:52.431 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:05:52.431 INFO:teuthology.orchestra.run.smithi132.stdout: "num_ops": 0 2024-04-18T21:05:52.431 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:05:52.446 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:05:52.498 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:52.499+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:52.578 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:05:52.578 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:05:52.598 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:52.599+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:52.599 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1: {} 2024-04-18T21:05:52.599 INFO:teuthology.orchestra.run.smithi078.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:05:52.615 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:52.615 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:52.620 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:05:52.620 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:05:52.631 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:05:52.699 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:52.699+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:52.752 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:52.752 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:52.767 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:05:52.811 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:52.811+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:52.899 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:52.899 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:52.900 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:52.899+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:52.914 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:05:53.001 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:52.999+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:53.035 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:53.036 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:53.050 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:05:53.102 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:53.103+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:53.165 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:53.165 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:53.179 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:05:53.203 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:53.203+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:53.304 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:53.303+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:53.310 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:53.311 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:53.325 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:05:53.405 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:53.407+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:53.441 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:53.441 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:53.456 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:05:53.507 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:53.507+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:53.571 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:53.571 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:53.585 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:05:53.607 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:53.607+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:53.649 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-18T21:05:53.649 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-18T21:05:53.649 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-04-18T21:05:53.649 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-18T21:05:53.709 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:53.707+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:53.721 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:53.721 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:53.735 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:05:53.823 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:53.823+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:53.901 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:53.902 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:53.910 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:53.911+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:53.916 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:05:53.957 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:05:53.957 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-04-18T21:05:53.957 INFO:teuthology.orchestra.run.smithi078.stdout: "epoch": 29, 2024-04-18T21:05:53.958 INFO:teuthology.orchestra.run.smithi078.stdout: "fsid": "dc017990-0393-4ab0-b604-5e7052fdc7bd", 2024-04-18T21:05:53.958 INFO:teuthology.orchestra.run.smithi078.stdout: "created": "2024-04-18T21:04:43.507538+0000", 2024-04-18T21:05:53.958 INFO:teuthology.orchestra.run.smithi078.stdout: "modified": "2024-04-18T21:05:51.977074+0000", 2024-04-18T21:05:53.958 INFO:teuthology.orchestra.run.smithi078.stdout: "last_up_change": "2024-04-18T21:04:52.492503+0000", 2024-04-18T21:05:53.958 INFO:teuthology.orchestra.run.smithi078.stdout: "last_in_change": "2024-04-18T21:04:44.402191+0000", 2024-04-18T21:05:53.958 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-18T21:05:53.958 INFO:teuthology.orchestra.run.smithi078.stdout: "flags_num": 5804032, 2024-04-18T21:05:53.958 INFO:teuthology.orchestra.run.smithi078.stdout: "flags_set": [ 2024-04-18T21:05:53.958 INFO:teuthology.orchestra.run.smithi078.stdout: "nodeep-scrub", 2024-04-18T21:05:53.958 INFO:teuthology.orchestra.run.smithi078.stdout: "pglog_hardlimit", 2024-04-18T21:05:53.958 INFO:teuthology.orchestra.run.smithi078.stdout: "purged_snapdirs", 2024-04-18T21:05:53.958 INFO:teuthology.orchestra.run.smithi078.stdout: "recovery_deletes", 2024-04-18T21:05:53.958 INFO:teuthology.orchestra.run.smithi078.stdout: "sortbitwise" 2024-04-18T21:05:53.958 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-04-18T21:05:53.959 INFO:teuthology.orchestra.run.smithi078.stdout: "crush_version": 4, 2024-04-18T21:05:53.959 INFO:teuthology.orchestra.run.smithi078.stdout: "full_ratio": 0.94999998807907104, 2024-04-18T21:05:53.959 INFO:teuthology.orchestra.run.smithi078.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-18T21:05:53.959 INFO:teuthology.orchestra.run.smithi078.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-18T21:05:53.959 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_snapshot": "", 2024-04-18T21:05:53.959 INFO:teuthology.orchestra.run.smithi078.stdout: "pool_max": 4, 2024-04-18T21:05:53.959 INFO:teuthology.orchestra.run.smithi078.stdout: "max_osd": 3, 2024-04-18T21:05:53.959 INFO:teuthology.orchestra.run.smithi078.stdout: "require_min_compat_client": "luminous", 2024-04-18T21:05:53.959 INFO:teuthology.orchestra.run.smithi078.stdout: "min_compat_client": "jewel", 2024-04-18T21:05:53.959 INFO:teuthology.orchestra.run.smithi078.stdout: "require_osd_release": "squid", 2024-04-18T21:05:53.959 INFO:teuthology.orchestra.run.smithi078.stdout: "allow_crimson": false, 2024-04-18T21:05:53.959 INFO:teuthology.orchestra.run.smithi078.stdout: "pools": [ 2024-04-18T21:05:53.960 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:53.960 INFO:teuthology.orchestra.run.smithi078.stdout: "pool": 1, 2024-04-18T21:05:53.960 INFO:teuthology.orchestra.run.smithi078.stdout: "pool_name": ".mgr", 2024-04-18T21:05:53.960 INFO:teuthology.orchestra.run.smithi078.stdout: "create_time": "2024-04-18T21:04:52.538153+0000", 2024-04-18T21:05:53.960 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-04-18T21:05:53.960 INFO:teuthology.orchestra.run.smithi078.stdout: "flags_names": "hashpspool", 2024-04-18T21:05:53.960 INFO:teuthology.orchestra.run.smithi078.stdout: "type": 1, 2024-04-18T21:05:53.960 INFO:teuthology.orchestra.run.smithi078.stdout: "size": 2, 2024-04-18T21:05:53.960 INFO:teuthology.orchestra.run.smithi078.stdout: "min_size": 1, 2024-04-18T21:05:53.960 INFO:teuthology.orchestra.run.smithi078.stdout: "crush_rule": 0, 2024-04-18T21:05:53.960 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:05:53.960 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:05:53.960 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:05:53.960 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:05:53.961 INFO:teuthology.orchestra.run.smithi078.stdout: "object_hash": 2, 2024-04-18T21:05:53.961 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:05:53.961 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num": 1, 2024-04-18T21:05:53.961 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_placement_num": 1, 2024-04-18T21:05:53.961 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_placement_num_target": 1, 2024-04-18T21:05:53.961 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_target": 1, 2024-04-18T21:05:53.961 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_pending": 1, 2024-04-18T21:05:53.961 INFO:teuthology.orchestra.run.smithi078.stdout: "last_pg_merge_meta": { 2024-04-18T21:05:53.961 INFO:teuthology.orchestra.run.smithi078.stdout: "source_pgid": "0.0", 2024-04-18T21:05:53.961 INFO:teuthology.orchestra.run.smithi078.stdout: "ready_epoch": 0, 2024-04-18T21:05:53.961 INFO:teuthology.orchestra.run.smithi078.stdout: "last_epoch_started": 0, 2024-04-18T21:05:53.961 INFO:teuthology.orchestra.run.smithi078.stdout: "last_epoch_clean": 0, 2024-04-18T21:05:53.961 INFO:teuthology.orchestra.run.smithi078.stdout: "source_version": "0'0", 2024-04-18T21:05:53.961 INFO:teuthology.orchestra.run.smithi078.stdout: "target_version": "0'0" 2024-04-18T21:05:53.961 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:53.962 INFO:teuthology.orchestra.run.smithi078.stdout: "last_change": "11", 2024-04-18T21:05:53.962 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend": "0", 2024-04-18T21:05:53.962 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:05:53.962 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:05:53.962 INFO:teuthology.orchestra.run.smithi078.stdout: "auid": 0, 2024-04-18T21:05:53.962 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:05:53.962 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_seq": 0, 2024-04-18T21:05:53.962 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_epoch": 0, 2024-04-18T21:05:53.962 INFO:teuthology.orchestra.run.smithi078.stdout: "pool_snaps": [], 2024-04-18T21:05:53.962 INFO:teuthology.orchestra.run.smithi078.stdout: "removed_snaps": "[]", 2024-04-18T21:05:53.962 INFO:teuthology.orchestra.run.smithi078.stdout: "quota_max_bytes": 0, 2024-04-18T21:05:53.962 INFO:teuthology.orchestra.run.smithi078.stdout: "quota_max_objects": 0, 2024-04-18T21:05:53.962 INFO:teuthology.orchestra.run.smithi078.stdout: "tiers": [], 2024-04-18T21:05:53.962 INFO:teuthology.orchestra.run.smithi078.stdout: "tier_of": -1, 2024-04-18T21:05:53.962 INFO:teuthology.orchestra.run.smithi078.stdout: "read_tier": -1, 2024-04-18T21:05:53.963 INFO:teuthology.orchestra.run.smithi078.stdout: "write_tier": -1, 2024-04-18T21:05:53.963 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_mode": "none", 2024-04-18T21:05:53.963 INFO:teuthology.orchestra.run.smithi078.stdout: "target_max_bytes": 0, 2024-04-18T21:05:53.963 INFO:teuthology.orchestra.run.smithi078.stdout: "target_max_objects": 0, 2024-04-18T21:05:53.963 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:05:53.963 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:05:53.963 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:05:53.963 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_min_flush_age": 0, 2024-04-18T21:05:53.963 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_min_evict_age": 0, 2024-04-18T21:05:53.963 INFO:teuthology.orchestra.run.smithi078.stdout: "erasure_code_profile": "", 2024-04-18T21:05:53.963 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_params": { 2024-04-18T21:05:53.963 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "none" 2024-04-18T21:05:53.963 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:53.963 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_period": 0, 2024-04-18T21:05:53.964 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_count": 0, 2024-04-18T21:05:53.964 INFO:teuthology.orchestra.run.smithi078.stdout: "use_gmt_hitset": true, 2024-04-18T21:05:53.964 INFO:teuthology.orchestra.run.smithi078.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:05:53.964 INFO:teuthology.orchestra.run.smithi078.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:05:53.964 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:05:53.964 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:05:53.964 INFO:teuthology.orchestra.run.smithi078.stdout: "grade_table": [], 2024-04-18T21:05:53.964 INFO:teuthology.orchestra.run.smithi078.stdout: "stripe_width": 0, 2024-04-18T21:05:53.964 INFO:teuthology.orchestra.run.smithi078.stdout: "expected_num_objects": 0, 2024-04-18T21:05:53.964 INFO:teuthology.orchestra.run.smithi078.stdout: "fast_read": false, 2024-04-18T21:05:53.964 INFO:teuthology.orchestra.run.smithi078.stdout: "options": { 2024-04-18T21:05:53.964 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_max": 32, 2024-04-18T21:05:53.964 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_min": 1 2024-04-18T21:05:53.964 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:53.964 INFO:teuthology.orchestra.run.smithi078.stdout: "application_metadata": { 2024-04-18T21:05:53.964 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": {} 2024-04-18T21:05:53.965 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:53.965 INFO:teuthology.orchestra.run.smithi078.stdout: "read_balance": { 2024-04-18T21:05:53.965 INFO:teuthology.orchestra.run.smithi078.stdout: "score_type": "Fair distribution", 2024-04-18T21:05:53.965 INFO:teuthology.orchestra.run.smithi078.stdout: "score_acting": 2.9900000095367432, 2024-04-18T21:05:53.965 INFO:teuthology.orchestra.run.smithi078.stdout: "score_stable": 2.9900000095367432, 2024-04-18T21:05:53.965 INFO:teuthology.orchestra.run.smithi078.stdout: "optimal_score": 0.67000001668930054, 2024-04-18T21:05:53.965 INFO:teuthology.orchestra.run.smithi078.stdout: "raw_score_acting": 2, 2024-04-18T21:05:53.965 INFO:teuthology.orchestra.run.smithi078.stdout: "raw_score_stable": 2, 2024-04-18T21:05:53.965 INFO:teuthology.orchestra.run.smithi078.stdout: "primary_affinity_weighted": 1, 2024-04-18T21:05:53.965 INFO:teuthology.orchestra.run.smithi078.stdout: "average_primary_affinity": 1, 2024-04-18T21:05:53.965 INFO:teuthology.orchestra.run.smithi078.stdout: "average_primary_affinity_weighted": 1 2024-04-18T21:05:53.965 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:53.965 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:53.965 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:53.965 INFO:teuthology.orchestra.run.smithi078.stdout: "pool": 2, 2024-04-18T21:05:53.966 INFO:teuthology.orchestra.run.smithi078.stdout: "pool_name": "rbd", 2024-04-18T21:05:53.966 INFO:teuthology.orchestra.run.smithi078.stdout: "create_time": "2024-04-18T21:04:58.673793+0000", 2024-04-18T21:05:53.966 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-04-18T21:05:53.966 INFO:teuthology.orchestra.run.smithi078.stdout: "flags_names": "hashpspool", 2024-04-18T21:05:53.966 INFO:teuthology.orchestra.run.smithi078.stdout: "type": 1, 2024-04-18T21:05:53.966 INFO:teuthology.orchestra.run.smithi078.stdout: "size": 2, 2024-04-18T21:05:53.966 INFO:teuthology.orchestra.run.smithi078.stdout: "min_size": 1, 2024-04-18T21:05:53.966 INFO:teuthology.orchestra.run.smithi078.stdout: "crush_rule": 0, 2024-04-18T21:05:53.966 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:05:53.966 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:05:53.966 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:05:53.966 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:05:53.967 INFO:teuthology.orchestra.run.smithi078.stdout: "object_hash": 2, 2024-04-18T21:05:53.967 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:05:53.967 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num": 8, 2024-04-18T21:05:53.967 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_placement_num": 8, 2024-04-18T21:05:53.967 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_placement_num_target": 8, 2024-04-18T21:05:53.967 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_target": 8, 2024-04-18T21:05:53.967 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_pending": 8, 2024-04-18T21:05:53.967 INFO:teuthology.orchestra.run.smithi078.stdout: "last_pg_merge_meta": { 2024-04-18T21:05:53.967 INFO:teuthology.orchestra.run.smithi078.stdout: "source_pgid": "0.0", 2024-04-18T21:05:53.967 INFO:teuthology.orchestra.run.smithi078.stdout: "ready_epoch": 0, 2024-04-18T21:05:53.967 INFO:teuthology.orchestra.run.smithi078.stdout: "last_epoch_started": 0, 2024-04-18T21:05:53.967 INFO:teuthology.orchestra.run.smithi078.stdout: "last_epoch_clean": 0, 2024-04-18T21:05:53.968 INFO:teuthology.orchestra.run.smithi078.stdout: "source_version": "0'0", 2024-04-18T21:05:53.968 INFO:teuthology.orchestra.run.smithi078.stdout: "target_version": "0'0" 2024-04-18T21:05:53.968 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:53.968 INFO:teuthology.orchestra.run.smithi078.stdout: "last_change": "14", 2024-04-18T21:05:53.968 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend": "0", 2024-04-18T21:05:53.968 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:05:53.968 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:05:53.968 INFO:teuthology.orchestra.run.smithi078.stdout: "auid": 0, 2024-04-18T21:05:53.968 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:05:53.968 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_seq": 0, 2024-04-18T21:05:53.968 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_epoch": 0, 2024-04-18T21:05:53.968 INFO:teuthology.orchestra.run.smithi078.stdout: "pool_snaps": [], 2024-04-18T21:05:53.968 INFO:teuthology.orchestra.run.smithi078.stdout: "removed_snaps": "[]", 2024-04-18T21:05:53.968 INFO:teuthology.orchestra.run.smithi078.stdout: "quota_max_bytes": 0, 2024-04-18T21:05:53.968 INFO:teuthology.orchestra.run.smithi078.stdout: "quota_max_objects": 0, 2024-04-18T21:05:53.969 INFO:teuthology.orchestra.run.smithi078.stdout: "tiers": [], 2024-04-18T21:05:53.969 INFO:teuthology.orchestra.run.smithi078.stdout: "tier_of": -1, 2024-04-18T21:05:53.969 INFO:teuthology.orchestra.run.smithi078.stdout: "read_tier": -1, 2024-04-18T21:05:53.969 INFO:teuthology.orchestra.run.smithi078.stdout: "write_tier": -1, 2024-04-18T21:05:53.969 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_mode": "none", 2024-04-18T21:05:53.969 INFO:teuthology.orchestra.run.smithi078.stdout: "target_max_bytes": 0, 2024-04-18T21:05:53.969 INFO:teuthology.orchestra.run.smithi078.stdout: "target_max_objects": 0, 2024-04-18T21:05:53.969 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:05:53.969 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:05:53.969 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:05:53.969 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_min_flush_age": 0, 2024-04-18T21:05:53.969 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_min_evict_age": 0, 2024-04-18T21:05:53.969 INFO:teuthology.orchestra.run.smithi078.stdout: "erasure_code_profile": "", 2024-04-18T21:05:53.969 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_params": { 2024-04-18T21:05:53.969 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "none" 2024-04-18T21:05:53.969 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:53.970 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_period": 0, 2024-04-18T21:05:53.970 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_count": 0, 2024-04-18T21:05:53.970 INFO:teuthology.orchestra.run.smithi078.stdout: "use_gmt_hitset": true, 2024-04-18T21:05:53.970 INFO:teuthology.orchestra.run.smithi078.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:05:53.970 INFO:teuthology.orchestra.run.smithi078.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:05:53.970 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:05:53.970 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:05:53.970 INFO:teuthology.orchestra.run.smithi078.stdout: "grade_table": [], 2024-04-18T21:05:53.970 INFO:teuthology.orchestra.run.smithi078.stdout: "stripe_width": 0, 2024-04-18T21:05:53.970 INFO:teuthology.orchestra.run.smithi078.stdout: "expected_num_objects": 0, 2024-04-18T21:05:53.970 INFO:teuthology.orchestra.run.smithi078.stdout: "fast_read": false, 2024-04-18T21:05:53.970 INFO:teuthology.orchestra.run.smithi078.stdout: "options": {}, 2024-04-18T21:05:53.970 INFO:teuthology.orchestra.run.smithi078.stdout: "application_metadata": { 2024-04-18T21:05:53.970 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd": {} 2024-04-18T21:05:53.970 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:53.971 INFO:teuthology.orchestra.run.smithi078.stdout: "read_balance": { 2024-04-18T21:05:53.971 INFO:teuthology.orchestra.run.smithi078.stdout: "score_type": "Fair distribution", 2024-04-18T21:05:53.971 INFO:teuthology.orchestra.run.smithi078.stdout: "score_acting": 1.5, 2024-04-18T21:05:53.971 INFO:teuthology.orchestra.run.smithi078.stdout: "score_stable": 1.5, 2024-04-18T21:05:53.971 INFO:teuthology.orchestra.run.smithi078.stdout: "optimal_score": 1, 2024-04-18T21:05:53.971 INFO:teuthology.orchestra.run.smithi078.stdout: "raw_score_acting": 1.5, 2024-04-18T21:05:53.971 INFO:teuthology.orchestra.run.smithi078.stdout: "raw_score_stable": 1.5, 2024-04-18T21:05:53.971 INFO:teuthology.orchestra.run.smithi078.stdout: "primary_affinity_weighted": 1, 2024-04-18T21:05:53.971 INFO:teuthology.orchestra.run.smithi078.stdout: "average_primary_affinity": 1, 2024-04-18T21:05:53.971 INFO:teuthology.orchestra.run.smithi078.stdout: "average_primary_affinity_weighted": 1 2024-04-18T21:05:53.971 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:53.971 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:53.971 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:53.972 INFO:teuthology.orchestra.run.smithi078.stdout: "pool": 3, 2024-04-18T21:05:53.972 INFO:teuthology.orchestra.run.smithi078.stdout: "pool_name": "cephfs_metadata", 2024-04-18T21:05:53.972 INFO:teuthology.orchestra.run.smithi078.stdout: "create_time": "2024-04-18T21:05:03.314171+0000", 2024-04-18T21:05:53.972 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-04-18T21:05:53.972 INFO:teuthology.orchestra.run.smithi078.stdout: "flags_names": "hashpspool", 2024-04-18T21:05:53.972 INFO:teuthology.orchestra.run.smithi078.stdout: "type": 1, 2024-04-18T21:05:53.972 INFO:teuthology.orchestra.run.smithi078.stdout: "size": 2, 2024-04-18T21:05:53.972 INFO:teuthology.orchestra.run.smithi078.stdout: "min_size": 1, 2024-04-18T21:05:53.972 INFO:teuthology.orchestra.run.smithi078.stdout: "crush_rule": 0, 2024-04-18T21:05:53.972 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:05:53.972 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:05:53.972 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:05:53.972 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:05:53.972 INFO:teuthology.orchestra.run.smithi078.stdout: "object_hash": 2, 2024-04-18T21:05:53.972 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:05:53.972 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num": 32, 2024-04-18T21:05:53.973 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_placement_num": 32, 2024-04-18T21:05:53.973 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_placement_num_target": 32, 2024-04-18T21:05:53.973 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_target": 32, 2024-04-18T21:05:53.973 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_pending": 32, 2024-04-18T21:05:53.973 INFO:teuthology.orchestra.run.smithi078.stdout: "last_pg_merge_meta": { 2024-04-18T21:05:53.973 INFO:teuthology.orchestra.run.smithi078.stdout: "source_pgid": "0.0", 2024-04-18T21:05:53.973 INFO:teuthology.orchestra.run.smithi078.stdout: "ready_epoch": 0, 2024-04-18T21:05:53.973 INFO:teuthology.orchestra.run.smithi078.stdout: "last_epoch_started": 0, 2024-04-18T21:05:53.973 INFO:teuthology.orchestra.run.smithi078.stdout: "last_epoch_clean": 0, 2024-04-18T21:05:53.973 INFO:teuthology.orchestra.run.smithi078.stdout: "source_version": "0'0", 2024-04-18T21:05:53.973 INFO:teuthology.orchestra.run.smithi078.stdout: "target_version": "0'0" 2024-04-18T21:05:53.973 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:53.973 INFO:teuthology.orchestra.run.smithi078.stdout: "last_change": "17", 2024-04-18T21:05:53.973 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend": "0", 2024-04-18T21:05:53.973 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:05:53.974 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:05:53.974 INFO:teuthology.orchestra.run.smithi078.stdout: "auid": 0, 2024-04-18T21:05:53.974 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:05:53.974 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_seq": 0, 2024-04-18T21:05:53.974 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_epoch": 0, 2024-04-18T21:05:53.974 INFO:teuthology.orchestra.run.smithi078.stdout: "pool_snaps": [], 2024-04-18T21:05:53.974 INFO:teuthology.orchestra.run.smithi078.stdout: "removed_snaps": "[]", 2024-04-18T21:05:53.974 INFO:teuthology.orchestra.run.smithi078.stdout: "quota_max_bytes": 0, 2024-04-18T21:05:53.974 INFO:teuthology.orchestra.run.smithi078.stdout: "quota_max_objects": 0, 2024-04-18T21:05:53.974 INFO:teuthology.orchestra.run.smithi078.stdout: "tiers": [], 2024-04-18T21:05:53.974 INFO:teuthology.orchestra.run.smithi078.stdout: "tier_of": -1, 2024-04-18T21:05:53.974 INFO:teuthology.orchestra.run.smithi078.stdout: "read_tier": -1, 2024-04-18T21:05:53.974 INFO:teuthology.orchestra.run.smithi078.stdout: "write_tier": -1, 2024-04-18T21:05:53.974 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_mode": "none", 2024-04-18T21:05:53.974 INFO:teuthology.orchestra.run.smithi078.stdout: "target_max_bytes": 0, 2024-04-18T21:05:53.975 INFO:teuthology.orchestra.run.smithi078.stdout: "target_max_objects": 0, 2024-04-18T21:05:53.975 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:05:53.975 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:05:53.975 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:05:53.975 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_min_flush_age": 0, 2024-04-18T21:05:53.975 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_min_evict_age": 0, 2024-04-18T21:05:53.975 INFO:teuthology.orchestra.run.smithi078.stdout: "erasure_code_profile": "", 2024-04-18T21:05:53.975 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_params": { 2024-04-18T21:05:53.975 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "none" 2024-04-18T21:05:53.975 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:53.975 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_period": 0, 2024-04-18T21:05:53.975 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_count": 0, 2024-04-18T21:05:53.975 INFO:teuthology.orchestra.run.smithi078.stdout: "use_gmt_hitset": true, 2024-04-18T21:05:53.975 INFO:teuthology.orchestra.run.smithi078.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:05:53.976 INFO:teuthology.orchestra.run.smithi078.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:05:53.976 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:05:53.976 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:05:53.976 INFO:teuthology.orchestra.run.smithi078.stdout: "grade_table": [], 2024-04-18T21:05:53.976 INFO:teuthology.orchestra.run.smithi078.stdout: "stripe_width": 0, 2024-04-18T21:05:53.976 INFO:teuthology.orchestra.run.smithi078.stdout: "expected_num_objects": 0, 2024-04-18T21:05:53.976 INFO:teuthology.orchestra.run.smithi078.stdout: "fast_read": false, 2024-04-18T21:05:53.976 INFO:teuthology.orchestra.run.smithi078.stdout: "options": { 2024-04-18T21:05:53.976 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_autoscale_bias": 4, 2024-04-18T21:05:53.976 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_min": 16, 2024-04-18T21:05:53.976 INFO:teuthology.orchestra.run.smithi078.stdout: "recovery_priority": 5 2024-04-18T21:05:53.976 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:53.976 INFO:teuthology.orchestra.run.smithi078.stdout: "application_metadata": { 2024-04-18T21:05:53.976 INFO:teuthology.orchestra.run.smithi078.stdout: "cephfs": { 2024-04-18T21:05:53.977 INFO:teuthology.orchestra.run.smithi078.stdout: "metadata": "cephfs" 2024-04-18T21:05:53.977 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:53.977 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:53.977 INFO:teuthology.orchestra.run.smithi078.stdout: "read_balance": { 2024-04-18T21:05:53.977 INFO:teuthology.orchestra.run.smithi078.stdout: "score_type": "Fair distribution", 2024-04-18T21:05:53.977 INFO:teuthology.orchestra.run.smithi078.stdout: "score_acting": 1.1299999952316284, 2024-04-18T21:05:53.977 INFO:teuthology.orchestra.run.smithi078.stdout: "score_stable": 1.1299999952316284, 2024-04-18T21:05:53.977 INFO:teuthology.orchestra.run.smithi078.stdout: "optimal_score": 1, 2024-04-18T21:05:53.977 INFO:teuthology.orchestra.run.smithi078.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-18T21:05:53.977 INFO:teuthology.orchestra.run.smithi078.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-18T21:05:53.977 INFO:teuthology.orchestra.run.smithi078.stdout: "primary_affinity_weighted": 1, 2024-04-18T21:05:53.977 INFO:teuthology.orchestra.run.smithi078.stdout: "average_primary_affinity": 1, 2024-04-18T21:05:53.977 INFO:teuthology.orchestra.run.smithi078.stdout: "average_primary_affinity_weighted": 1 2024-04-18T21:05:53.978 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:53.978 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:53.978 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:53.978 INFO:teuthology.orchestra.run.smithi078.stdout: "pool": 4, 2024-04-18T21:05:53.978 INFO:teuthology.orchestra.run.smithi078.stdout: "pool_name": "cephfs_data", 2024-04-18T21:05:53.978 INFO:teuthology.orchestra.run.smithi078.stdout: "create_time": "2024-04-18T21:05:03.931699+0000", 2024-04-18T21:05:53.978 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-04-18T21:05:53.978 INFO:teuthology.orchestra.run.smithi078.stdout: "flags_names": "hashpspool", 2024-04-18T21:05:53.978 INFO:teuthology.orchestra.run.smithi078.stdout: "type": 1, 2024-04-18T21:05:53.978 INFO:teuthology.orchestra.run.smithi078.stdout: "size": 2, 2024-04-18T21:05:53.978 INFO:teuthology.orchestra.run.smithi078.stdout: "min_size": 1, 2024-04-18T21:05:53.978 INFO:teuthology.orchestra.run.smithi078.stdout: "crush_rule": 0, 2024-04-18T21:05:53.978 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:05:53.979 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:05:53.979 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:05:53.979 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:05:53.979 INFO:teuthology.orchestra.run.smithi078.stdout: "object_hash": 2, 2024-04-18T21:05:53.979 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:05:53.979 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num": 64, 2024-04-18T21:05:53.979 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_placement_num": 64, 2024-04-18T21:05:53.979 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_placement_num_target": 64, 2024-04-18T21:05:53.979 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_target": 64, 2024-04-18T21:05:53.979 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_pending": 64, 2024-04-18T21:05:53.979 INFO:teuthology.orchestra.run.smithi078.stdout: "last_pg_merge_meta": { 2024-04-18T21:05:53.979 INFO:teuthology.orchestra.run.smithi078.stdout: "source_pgid": "0.0", 2024-04-18T21:05:53.979 INFO:teuthology.orchestra.run.smithi078.stdout: "ready_epoch": 0, 2024-04-18T21:05:53.979 INFO:teuthology.orchestra.run.smithi078.stdout: "last_epoch_started": 0, 2024-04-18T21:05:53.979 INFO:teuthology.orchestra.run.smithi078.stdout: "last_epoch_clean": 0, 2024-04-18T21:05:53.979 INFO:teuthology.orchestra.run.smithi078.stdout: "source_version": "0'0", 2024-04-18T21:05:53.980 INFO:teuthology.orchestra.run.smithi078.stdout: "target_version": "0'0" 2024-04-18T21:05:53.980 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:53.980 INFO:teuthology.orchestra.run.smithi078.stdout: "last_change": "18", 2024-04-18T21:05:53.980 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend": "0", 2024-04-18T21:05:53.980 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:05:53.980 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:05:53.980 INFO:teuthology.orchestra.run.smithi078.stdout: "auid": 0, 2024-04-18T21:05:53.980 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:05:53.980 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_seq": 0, 2024-04-18T21:05:53.980 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_epoch": 0, 2024-04-18T21:05:53.980 INFO:teuthology.orchestra.run.smithi078.stdout: "pool_snaps": [], 2024-04-18T21:05:53.980 INFO:teuthology.orchestra.run.smithi078.stdout: "removed_snaps": "[]", 2024-04-18T21:05:53.980 INFO:teuthology.orchestra.run.smithi078.stdout: "quota_max_bytes": 0, 2024-04-18T21:05:53.980 INFO:teuthology.orchestra.run.smithi078.stdout: "quota_max_objects": 0, 2024-04-18T21:05:53.981 INFO:teuthology.orchestra.run.smithi078.stdout: "tiers": [], 2024-04-18T21:05:53.981 INFO:teuthology.orchestra.run.smithi078.stdout: "tier_of": -1, 2024-04-18T21:05:53.981 INFO:teuthology.orchestra.run.smithi078.stdout: "read_tier": -1, 2024-04-18T21:05:53.981 INFO:teuthology.orchestra.run.smithi078.stdout: "write_tier": -1, 2024-04-18T21:05:53.981 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_mode": "none", 2024-04-18T21:05:53.981 INFO:teuthology.orchestra.run.smithi078.stdout: "target_max_bytes": 0, 2024-04-18T21:05:53.981 INFO:teuthology.orchestra.run.smithi078.stdout: "target_max_objects": 0, 2024-04-18T21:05:53.981 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:05:53.981 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:05:53.981 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:05:53.981 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_min_flush_age": 0, 2024-04-18T21:05:53.981 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_min_evict_age": 0, 2024-04-18T21:05:53.981 INFO:teuthology.orchestra.run.smithi078.stdout: "erasure_code_profile": "", 2024-04-18T21:05:53.981 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_params": { 2024-04-18T21:05:53.982 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "none" 2024-04-18T21:05:53.982 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:53.982 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_period": 0, 2024-04-18T21:05:53.982 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_count": 0, 2024-04-18T21:05:53.982 INFO:teuthology.orchestra.run.smithi078.stdout: "use_gmt_hitset": true, 2024-04-18T21:05:53.982 INFO:teuthology.orchestra.run.smithi078.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:05:53.982 INFO:teuthology.orchestra.run.smithi078.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:05:53.982 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:05:53.982 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:05:53.982 INFO:teuthology.orchestra.run.smithi078.stdout: "grade_table": [], 2024-04-18T21:05:53.982 INFO:teuthology.orchestra.run.smithi078.stdout: "stripe_width": 0, 2024-04-18T21:05:53.982 INFO:teuthology.orchestra.run.smithi078.stdout: "expected_num_objects": 0, 2024-04-18T21:05:53.983 INFO:teuthology.orchestra.run.smithi078.stdout: "fast_read": false, 2024-04-18T21:05:53.983 INFO:teuthology.orchestra.run.smithi078.stdout: "options": { 2024-04-18T21:05:53.983 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_min": 64, 2024-04-18T21:05:53.983 INFO:teuthology.orchestra.run.smithi078.stdout: "target_size_ratio": 0.89999997615814209 2024-04-18T21:05:53.983 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:53.983 INFO:teuthology.orchestra.run.smithi078.stdout: "application_metadata": { 2024-04-18T21:05:53.983 INFO:teuthology.orchestra.run.smithi078.stdout: "cephfs": { 2024-04-18T21:05:53.983 INFO:teuthology.orchestra.run.smithi078.stdout: "data": "cephfs" 2024-04-18T21:05:53.983 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:53.983 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:53.983 INFO:teuthology.orchestra.run.smithi078.stdout: "read_balance": { 2024-04-18T21:05:53.983 INFO:teuthology.orchestra.run.smithi078.stdout: "score_type": "Fair distribution", 2024-04-18T21:05:53.983 INFO:teuthology.orchestra.run.smithi078.stdout: "score_acting": 1.1299999952316284, 2024-04-18T21:05:53.983 INFO:teuthology.orchestra.run.smithi078.stdout: "score_stable": 1.1299999952316284, 2024-04-18T21:05:53.984 INFO:teuthology.orchestra.run.smithi078.stdout: "optimal_score": 1, 2024-04-18T21:05:53.984 INFO:teuthology.orchestra.run.smithi078.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-18T21:05:53.984 INFO:teuthology.orchestra.run.smithi078.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-18T21:05:53.984 INFO:teuthology.orchestra.run.smithi078.stdout: "primary_affinity_weighted": 1, 2024-04-18T21:05:53.984 INFO:teuthology.orchestra.run.smithi078.stdout: "average_primary_affinity": 1, 2024-04-18T21:05:53.984 INFO:teuthology.orchestra.run.smithi078.stdout: "average_primary_affinity_weighted": 1 2024-04-18T21:05:53.984 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:53.984 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:53.984 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-04-18T21:05:53.984 INFO:teuthology.orchestra.run.smithi078.stdout: "osds": [ 2024-04-18T21:05:53.984 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:53.984 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": 0, 2024-04-18T21:05:53.984 INFO:teuthology.orchestra.run.smithi078.stdout: "uuid": "1854d737-3a67-416a-8c88-0f126505a0f2", 2024-04-18T21:05:53.984 INFO:teuthology.orchestra.run.smithi078.stdout: "up": 1, 2024-04-18T21:05:53.985 INFO:teuthology.orchestra.run.smithi078.stdout: "in": 1, 2024-04-18T21:05:53.985 INFO:teuthology.orchestra.run.smithi078.stdout: "weight": 1, 2024-04-18T21:05:53.985 INFO:teuthology.orchestra.run.smithi078.stdout: "primary_affinity": 1, 2024-04-18T21:05:53.985 INFO:teuthology.orchestra.run.smithi078.stdout: "last_clean_begin": 0, 2024-04-18T21:05:53.985 INFO:teuthology.orchestra.run.smithi078.stdout: "last_clean_end": 0, 2024-04-18T21:05:53.985 INFO:teuthology.orchestra.run.smithi078.stdout: "up_from": 8, 2024-04-18T21:05:53.985 INFO:teuthology.orchestra.run.smithi078.stdout: "up_thru": 16, 2024-04-18T21:05:53.985 INFO:teuthology.orchestra.run.smithi078.stdout: "down_at": 0, 2024-04-18T21:05:53.985 INFO:teuthology.orchestra.run.smithi078.stdout: "lost_at": 0, 2024-04-18T21:05:53.985 INFO:teuthology.orchestra.run.smithi078.stdout: "public_addrs": { 2024-04-18T21:05:53.985 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:05:53.985 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:53.985 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:05:53.985 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.132:6800", 2024-04-18T21:05:53.986 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 1948809768 2024-04-18T21:05:53.986 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:53.986 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:53.986 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:05:53.986 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.132:6801", 2024-04-18T21:05:53.986 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 1948809768 2024-04-18T21:05:53.986 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:53.986 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:05:53.986 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:53.986 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_addrs": { 2024-04-18T21:05:53.986 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:05:53.986 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:53.986 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:05:53.986 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.132:6802", 2024-04-18T21:05:53.987 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 1948809768 2024-04-18T21:05:53.987 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:53.987 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:53.987 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:05:53.987 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.132:6803", 2024-04-18T21:05:53.987 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 1948809768 2024-04-18T21:05:53.987 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:53.987 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:05:53.987 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:53.987 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_back_addrs": { 2024-04-18T21:05:53.987 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:05:53.987 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:53.987 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:05:53.987 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.132:6806", 2024-04-18T21:05:53.987 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 1948809768 2024-04-18T21:05:53.988 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:53.988 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:53.988 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:05:53.988 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.132:6807", 2024-04-18T21:05:53.988 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 1948809768 2024-04-18T21:05:53.988 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:53.988 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:05:53.988 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:53.988 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_front_addrs": { 2024-04-18T21:05:53.988 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:05:53.988 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:53.988 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:05:53.988 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.132:6804", 2024-04-18T21:05:53.988 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 1948809768 2024-04-18T21:05:53.989 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:53.989 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:53.989 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:05:53.989 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.132:6805", 2024-04-18T21:05:53.989 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 1948809768 2024-04-18T21:05:53.989 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:53.989 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:05:53.989 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:53.989 INFO:teuthology.orchestra.run.smithi078.stdout: "public_addr": "172.21.15.132:6801/1948809768", 2024-04-18T21:05:53.989 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_addr": "172.21.15.132:6803/1948809768", 2024-04-18T21:05:53.989 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_back_addr": "172.21.15.132:6807/1948809768", 2024-04-18T21:05:53.989 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_front_addr": "172.21.15.132:6805/1948809768", 2024-04-18T21:05:53.989 INFO:teuthology.orchestra.run.smithi078.stdout: "state": [ 2024-04-18T21:05:53.989 INFO:teuthology.orchestra.run.smithi078.stdout: "exists", 2024-04-18T21:05:53.990 INFO:teuthology.orchestra.run.smithi078.stdout: "up" 2024-04-18T21:05:53.990 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:05:53.990 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:53.990 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:53.990 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": 1, 2024-04-18T21:05:53.990 INFO:teuthology.orchestra.run.smithi078.stdout: "uuid": "dfeae661-3f8a-4d41-b287-7eb02c16b91a", 2024-04-18T21:05:53.990 INFO:teuthology.orchestra.run.smithi078.stdout: "up": 1, 2024-04-18T21:05:53.990 INFO:teuthology.orchestra.run.smithi078.stdout: "in": 1, 2024-04-18T21:05:53.990 INFO:teuthology.orchestra.run.smithi078.stdout: "weight": 1, 2024-04-18T21:05:53.990 INFO:teuthology.orchestra.run.smithi078.stdout: "primary_affinity": 1, 2024-04-18T21:05:53.990 INFO:teuthology.orchestra.run.smithi078.stdout: "last_clean_begin": 0, 2024-04-18T21:05:53.990 INFO:teuthology.orchestra.run.smithi078.stdout: "last_clean_end": 0, 2024-04-18T21:05:53.991 INFO:teuthology.orchestra.run.smithi078.stdout: "up_from": 8, 2024-04-18T21:05:53.991 INFO:teuthology.orchestra.run.smithi078.stdout: "up_thru": 16, 2024-04-18T21:05:53.991 INFO:teuthology.orchestra.run.smithi078.stdout: "down_at": 0, 2024-04-18T21:05:53.991 INFO:teuthology.orchestra.run.smithi078.stdout: "lost_at": 0, 2024-04-18T21:05:53.991 INFO:teuthology.orchestra.run.smithi078.stdout: "public_addrs": { 2024-04-18T21:05:53.991 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:05:53.991 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:53.991 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:05:53.991 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.150:6800", 2024-04-18T21:05:53.991 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 2040503167 2024-04-18T21:05:53.991 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:53.991 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:53.991 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:05:53.991 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.150:6801", 2024-04-18T21:05:53.991 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 2040503167 2024-04-18T21:05:53.992 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:53.992 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:05:53.992 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:53.992 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_addrs": { 2024-04-18T21:05:53.992 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:05:53.992 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:53.992 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:05:53.992 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.150:6802", 2024-04-18T21:05:53.992 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 2040503167 2024-04-18T21:05:53.992 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:53.992 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:53.992 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:05:53.992 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.150:6803", 2024-04-18T21:05:53.993 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 2040503167 2024-04-18T21:05:53.993 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:53.993 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:05:53.993 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:53.993 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_back_addrs": { 2024-04-18T21:05:53.993 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:05:53.993 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:53.993 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:05:53.993 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.150:6806", 2024-04-18T21:05:53.993 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 2040503167 2024-04-18T21:05:53.993 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:53.993 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:53.993 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:05:53.994 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.150:6807", 2024-04-18T21:05:53.994 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 2040503167 2024-04-18T21:05:53.994 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:53.994 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:05:53.994 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:53.994 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_front_addrs": { 2024-04-18T21:05:53.994 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:05:53.994 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:53.994 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:05:53.994 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.150:6804", 2024-04-18T21:05:53.994 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 2040503167 2024-04-18T21:05:53.994 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:53.994 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:53.995 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:05:53.995 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.150:6805", 2024-04-18T21:05:53.995 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 2040503167 2024-04-18T21:05:53.995 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:53.995 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:05:53.995 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:53.995 INFO:teuthology.orchestra.run.smithi078.stdout: "public_addr": "172.21.15.150:6801/2040503167", 2024-04-18T21:05:53.995 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_addr": "172.21.15.150:6803/2040503167", 2024-04-18T21:05:53.995 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_back_addr": "172.21.15.150:6807/2040503167", 2024-04-18T21:05:53.995 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_front_addr": "172.21.15.150:6805/2040503167", 2024-04-18T21:05:53.995 INFO:teuthology.orchestra.run.smithi078.stdout: "state": [ 2024-04-18T21:05:53.995 INFO:teuthology.orchestra.run.smithi078.stdout: "exists", 2024-04-18T21:05:53.995 INFO:teuthology.orchestra.run.smithi078.stdout: "up" 2024-04-18T21:05:53.995 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:05:53.996 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:53.996 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:53.996 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": 2, 2024-04-18T21:05:53.996 INFO:teuthology.orchestra.run.smithi078.stdout: "uuid": "56a34021-e2dc-41ff-822c-7ec123466f25", 2024-04-18T21:05:53.996 INFO:teuthology.orchestra.run.smithi078.stdout: "up": 1, 2024-04-18T21:05:53.996 INFO:teuthology.orchestra.run.smithi078.stdout: "in": 1, 2024-04-18T21:05:53.996 INFO:teuthology.orchestra.run.smithi078.stdout: "weight": 1, 2024-04-18T21:05:53.996 INFO:teuthology.orchestra.run.smithi078.stdout: "primary_affinity": 1, 2024-04-18T21:05:53.996 INFO:teuthology.orchestra.run.smithi078.stdout: "last_clean_begin": 0, 2024-04-18T21:05:53.996 INFO:teuthology.orchestra.run.smithi078.stdout: "last_clean_end": 0, 2024-04-18T21:05:53.996 INFO:teuthology.orchestra.run.smithi078.stdout: "up_from": 8, 2024-04-18T21:05:53.996 INFO:teuthology.orchestra.run.smithi078.stdout: "up_thru": 16, 2024-04-18T21:05:53.996 INFO:teuthology.orchestra.run.smithi078.stdout: "down_at": 0, 2024-04-18T21:05:53.996 INFO:teuthology.orchestra.run.smithi078.stdout: "lost_at": 0, 2024-04-18T21:05:53.997 INFO:teuthology.orchestra.run.smithi078.stdout: "public_addrs": { 2024-04-18T21:05:53.997 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:05:53.997 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:53.997 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:05:53.997 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.187:6800", 2024-04-18T21:05:53.997 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 429896900 2024-04-18T21:05:53.997 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:53.997 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:53.997 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:05:53.997 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.187:6801", 2024-04-18T21:05:53.997 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 429896900 2024-04-18T21:05:53.997 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:53.997 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:05:53.997 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:53.998 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_addrs": { 2024-04-18T21:05:53.998 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:05:53.998 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:53.998 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:05:53.998 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.187:6802", 2024-04-18T21:05:53.998 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 429896900 2024-04-18T21:05:53.998 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:53.998 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:53.998 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:05:53.998 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.187:6803", 2024-04-18T21:05:53.998 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 429896900 2024-04-18T21:05:53.998 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:53.998 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:05:53.999 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:53.999 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_back_addrs": { 2024-04-18T21:05:53.999 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:05:53.999 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:53.999 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:05:53.999 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.187:6806", 2024-04-18T21:05:53.999 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 429896900 2024-04-18T21:05:53.999 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:53.999 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:53.999 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:05:53.999 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.187:6807", 2024-04-18T21:05:53.999 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 429896900 2024-04-18T21:05:53.999 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:53.999 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:05:54.000 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:54.000 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_front_addrs": { 2024-04-18T21:05:54.000 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:05:54.000 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:54.000 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:05:54.000 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.187:6804", 2024-04-18T21:05:54.000 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 429896900 2024-04-18T21:05:54.000 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:54.000 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:54.000 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:05:54.000 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.187:6805", 2024-04-18T21:05:54.000 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 429896900 2024-04-18T21:05:54.001 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:54.001 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:05:54.001 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:54.001 INFO:teuthology.orchestra.run.smithi078.stdout: "public_addr": "172.21.15.187:6801/429896900", 2024-04-18T21:05:54.001 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_addr": "172.21.15.187:6803/429896900", 2024-04-18T21:05:54.001 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_back_addr": "172.21.15.187:6807/429896900", 2024-04-18T21:05:54.001 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_front_addr": "172.21.15.187:6805/429896900", 2024-04-18T21:05:54.001 INFO:teuthology.orchestra.run.smithi078.stdout: "state": [ 2024-04-18T21:05:54.001 INFO:teuthology.orchestra.run.smithi078.stdout: "exists", 2024-04-18T21:05:54.001 INFO:teuthology.orchestra.run.smithi078.stdout: "up" 2024-04-18T21:05:54.001 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:05:54.001 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:54.001 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-04-18T21:05:54.002 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_xinfo": [ 2024-04-18T21:05:54.002 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:54.002 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": 0, 2024-04-18T21:05:54.002 INFO:teuthology.orchestra.run.smithi078.stdout: "down_stamp": "0.000000", 2024-04-18T21:05:54.002 INFO:teuthology.orchestra.run.smithi078.stdout: "laggy_probability": 0, 2024-04-18T21:05:54.002 INFO:teuthology.orchestra.run.smithi078.stdout: "laggy_interval": 0, 2024-04-18T21:05:54.002 INFO:teuthology.orchestra.run.smithi078.stdout: "features": 4540701547738038271, 2024-04-18T21:05:54.002 INFO:teuthology.orchestra.run.smithi078.stdout: "old_weight": 0, 2024-04-18T21:05:54.002 INFO:teuthology.orchestra.run.smithi078.stdout: "last_purged_snaps_scrub": "2024-04-18T21:04:49.804359+0000", 2024-04-18T21:05:54.002 INFO:teuthology.orchestra.run.smithi078.stdout: "dead_epoch": 0 2024-04-18T21:05:54.002 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:54.002 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:54.003 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": 1, 2024-04-18T21:05:54.003 INFO:teuthology.orchestra.run.smithi078.stdout: "down_stamp": "0.000000", 2024-04-18T21:05:54.003 INFO:teuthology.orchestra.run.smithi078.stdout: "laggy_probability": 0, 2024-04-18T21:05:54.003 INFO:teuthology.orchestra.run.smithi078.stdout: "laggy_interval": 0, 2024-04-18T21:05:54.003 INFO:teuthology.orchestra.run.smithi078.stdout: "features": 4540701547738038271, 2024-04-18T21:05:54.003 INFO:teuthology.orchestra.run.smithi078.stdout: "old_weight": 0, 2024-04-18T21:05:54.003 INFO:teuthology.orchestra.run.smithi078.stdout: "last_purged_snaps_scrub": "2024-04-18T21:04:49.790978+0000", 2024-04-18T21:05:54.003 INFO:teuthology.orchestra.run.smithi078.stdout: "dead_epoch": 0 2024-04-18T21:05:54.003 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:54.003 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:05:54.003 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": 2, 2024-04-18T21:05:54.003 INFO:teuthology.orchestra.run.smithi078.stdout: "down_stamp": "0.000000", 2024-04-18T21:05:54.003 INFO:teuthology.orchestra.run.smithi078.stdout: "laggy_probability": 0, 2024-04-18T21:05:54.003 INFO:teuthology.orchestra.run.smithi078.stdout: "laggy_interval": 0, 2024-04-18T21:05:54.004 INFO:teuthology.orchestra.run.smithi078.stdout: "features": 4540701547738038271, 2024-04-18T21:05:54.004 INFO:teuthology.orchestra.run.smithi078.stdout: "old_weight": 0, 2024-04-18T21:05:54.004 INFO:teuthology.orchestra.run.smithi078.stdout: "last_purged_snaps_scrub": "2024-04-18T21:04:49.762943+0000", 2024-04-18T21:05:54.004 INFO:teuthology.orchestra.run.smithi078.stdout: "dead_epoch": 0 2024-04-18T21:05:54.004 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:54.004 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-04-18T21:05:54.004 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_upmap": [], 2024-04-18T21:05:54.004 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_upmap_items": [], 2024-04-18T21:05:54.004 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_upmap_primaries": [], 2024-04-18T21:05:54.004 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_temp": [], 2024-04-18T21:05:54.004 INFO:teuthology.orchestra.run.smithi078.stdout: "primary_temp": [], 2024-04-18T21:05:54.004 INFO:teuthology.orchestra.run.smithi078.stdout: "blocklist": {}, 2024-04-18T21:05:54.004 INFO:teuthology.orchestra.run.smithi078.stdout: "range_blocklist": {}, 2024-04-18T21:05:54.004 INFO:teuthology.orchestra.run.smithi078.stdout: "erasure_code_profiles": { 2024-04-18T21:05:54.004 INFO:teuthology.orchestra.run.smithi078.stdout: "default": { 2024-04-18T21:05:54.004 INFO:teuthology.orchestra.run.smithi078.stdout: "crush-failure-domain": "osd", 2024-04-18T21:05:54.005 INFO:teuthology.orchestra.run.smithi078.stdout: "k": "2", 2024-04-18T21:05:54.005 INFO:teuthology.orchestra.run.smithi078.stdout: "m": "1", 2024-04-18T21:05:54.005 INFO:teuthology.orchestra.run.smithi078.stdout: "plugin": "jerasure", 2024-04-18T21:05:54.005 INFO:teuthology.orchestra.run.smithi078.stdout: "technique": "reed_sol_van" 2024-04-18T21:05:54.005 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:54.005 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:05:54.005 INFO:teuthology.orchestra.run.smithi078.stdout: "removed_snaps_queue": [], 2024-04-18T21:05:54.005 INFO:teuthology.orchestra.run.smithi078.stdout: "new_removed_snaps": [], 2024-04-18T21:05:54.005 INFO:teuthology.orchestra.run.smithi078.stdout: "new_purged_snaps": [], 2024-04-18T21:05:54.005 INFO:teuthology.orchestra.run.smithi078.stdout: "crush_node_flags": {}, 2024-04-18T21:05:54.005 INFO:teuthology.orchestra.run.smithi078.stdout: "device_class_flags": {}, 2024-04-18T21:05:54.005 INFO:teuthology.orchestra.run.smithi078.stdout: "stretch_mode": { 2024-04-18T21:05:54.005 INFO:teuthology.orchestra.run.smithi078.stdout: "stretch_mode_enabled": false, 2024-04-18T21:05:54.005 INFO:teuthology.orchestra.run.smithi078.stdout: "stretch_bucket_count": 0, 2024-04-18T21:05:54.005 INFO:teuthology.orchestra.run.smithi078.stdout: "degraded_stretch_mode": 0, 2024-04-18T21:05:54.006 INFO:teuthology.orchestra.run.smithi078.stdout: "recovering_stretch_mode": 0, 2024-04-18T21:05:54.006 INFO:teuthology.orchestra.run.smithi078.stdout: "stretch_mode_bucket": 0 2024-04-18T21:05:54.006 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:05:54.006 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-04-18T21:05:54.007 INFO:tasks.thrashosds.thrasher:j is {'epoch': 29, 'fsid': 'dc017990-0393-4ab0-b604-5e7052fdc7bd', 'created': '2024-04-18T21:04:43.507538+0000', 'modified': '2024-04-18T21:05:51.977074+0000', 'last_up_change': '2024-04-18T21:04:52.492503+0000', 'last_in_change': '2024-04-18T21:04:44.402191+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T21:04:52.538153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-18T21:04:58.673793+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T21:05:03.314171+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T21:05:03.931699+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '1854d737-3a67-416a-8c88-0f126505a0f2', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.132:6800', 'nonce': 1948809768}, {'type': 'v1', 'addr': '172.21.15.132:6801', 'nonce': 1948809768}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.132:6802', 'nonce': 1948809768}, {'type': 'v1', 'addr': '172.21.15.132:6803', 'nonce': 1948809768}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.132:6806', 'nonce': 1948809768}, {'type': 'v1', 'addr': '172.21.15.132:6807', 'nonce': 1948809768}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.132:6804', 'nonce': 1948809768}, {'type': 'v1', 'addr': '172.21.15.132:6805', 'nonce': 1948809768}]}, 'public_addr': '172.21.15.132:6801/1948809768', 'cluster_addr': '172.21.15.132:6803/1948809768', 'heartbeat_back_addr': '172.21.15.132:6807/1948809768', 'heartbeat_front_addr': '172.21.15.132:6805/1948809768', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'dfeae661-3f8a-4d41-b287-7eb02c16b91a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6800', 'nonce': 2040503167}, {'type': 'v1', 'addr': '172.21.15.150:6801', 'nonce': 2040503167}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6802', 'nonce': 2040503167}, {'type': 'v1', 'addr': '172.21.15.150:6803', 'nonce': 2040503167}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6806', 'nonce': 2040503167}, {'type': 'v1', 'addr': '172.21.15.150:6807', 'nonce': 2040503167}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6804', 'nonce': 2040503167}, {'type': 'v1', 'addr': '172.21.15.150:6805', 'nonce': 2040503167}]}, 'public_addr': '172.21.15.150:6801/2040503167', 'cluster_addr': '172.21.15.150:6803/2040503167', 'heartbeat_back_addr': '172.21.15.150:6807/2040503167', 'heartbeat_front_addr': '172.21.15.150:6805/2040503167', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '56a34021-e2dc-41ff-822c-7ec123466f25', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6800', 'nonce': 429896900}, {'type': 'v1', 'addr': '172.21.15.187:6801', 'nonce': 429896900}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6802', 'nonce': 429896900}, {'type': 'v1', 'addr': '172.21.15.187:6803', 'nonce': 429896900}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6806', 'nonce': 429896900}, {'type': 'v1', 'addr': '172.21.15.187:6807', 'nonce': 429896900}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6804', 'nonce': 429896900}, {'type': 'v1', 'addr': '172.21.15.187:6805', 'nonce': 429896900}]}, 'public_addr': '172.21.15.187:6801/429896900', 'cluster_addr': '172.21.15.187:6803/429896900', 'heartbeat_back_addr': '172.21.15.187:6807/429896900', 'heartbeat_front_addr': '172.21.15.187:6805/429896900', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-18T21:04:49.804359+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-18T21:04:49.790978+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-18T21:04:49.762943+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-18T21:05:54.007 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-04-18T21:05:54.009 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-18T21:05:54.011 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:54.011+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:54.112 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:54.111+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:54.131 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:54.131 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:54.145 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:05:54.212 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:54.211+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:54.280 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:54.280 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:54.295 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:05:54.313 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:54.311+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:54.414 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:54.415+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:54.457 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:54.458 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:54.473 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:05:54.517 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:54.519+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:54.615 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:54.615+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:54.639 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:05:54.642 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:54.642 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:54.656 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:05:54.716 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:54.715+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:54.783 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:54.783 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:54.797 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:05:54.797 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:05:54.798 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:05:54.816 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:54.815+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:54.817 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1: {} 2024-04-18T21:05:54.817 INFO:teuthology.orchestra.run.smithi078.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:05:54.834 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:05:54.834 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:05:54.917 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:54.919+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:54.917 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:05:54.917 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:05:54.918 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-18T21:05:54.918 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-18T21:05:54.918 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:05:54.931 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:05:55.002 INFO:teuthology.orchestra.run.smithi078.stderr:nodeep-scrub is unset 2024-04-18T21:05:55.018 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:55.019+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:55.058 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:05:55.058 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-18T21:05:55.058 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-18T21:05:55.058 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:05:55.058 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.059 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:55.059 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:05:55.059 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.442363045999997, 2024-04-18T21:05:55.059 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.034065303999999998, 2024-04-18T21:05:55.059 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:55.059 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:55.059 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:55.059 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:55.059 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.059 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:55.059 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:05:55.059 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:55.059 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.059 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.060 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:55.060 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:05:55.060 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:55.060 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.060 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.060 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:55.060 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615254+0000", 2024-04-18T21:05:55.060 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7829999999999999e-06 2024-04-18T21:05:55.060 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.060 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.060 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:55.060 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615267+0000", 2024-04-18T21:05:55.060 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3334e-05 2024-04-18T21:05:55.060 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.060 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.061 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:55.061 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615294+0000", 2024-04-18T21:05:55.061 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7271999999999999e-05 2024-04-18T21:05:55.061 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.061 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.061 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:55.061 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615321+0000", 2024-04-18T21:05:55.061 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.637e-05 2024-04-18T21:05:55.061 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.061 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.061 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:55.061 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615479+0000", 2024-04-18T21:05:55.061 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000158493 2024-04-18T21:05:55.061 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.062 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.062 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:55.062 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615498+0000", 2024-04-18T21:05:55.062 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9148999999999999e-05 2024-04-18T21:05:55.062 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.062 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.062 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:55.062 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632915+0000", 2024-04-18T21:05:55.062 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.017416551999999998 2024-04-18T21:05:55.062 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.062 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.062 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:55.062 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633302+0000", 2024-04-18T21:05:55.063 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00038725000000000001 2024-04-18T21:05:55.063 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.063 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.063 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:55.063 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633638+0000", 2024-04-18T21:05:55.063 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000335946 2024-04-18T21:05:55.063 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.063 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.063 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:55.063 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645976+0000", 2024-04-18T21:05:55.063 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012337617 2024-04-18T21:05:55.063 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.063 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.063 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:55.063 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649080+0000", 2024-04-18T21:05:55.064 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031038929999999999 2024-04-18T21:05:55.064 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.064 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.064 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:55.064 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649207+0000", 2024-04-18T21:05:55.064 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000127537 2024-04-18T21:05:55.064 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.064 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.064 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:55.064 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649316+0000", 2024-04-18T21:05:55.064 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109108 2024-04-18T21:05:55.064 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:55.064 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:55.064 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:55.065 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.065 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.065 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:55.065 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:05:55.065 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.442229669, 2024-04-18T21:05:55.065 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036275764000000002, 2024-04-18T21:05:55.065 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:55.065 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:55.065 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:55.065 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:55.065 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.065 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:55.065 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:05:55.066 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:55.066 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.066 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.066 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:55.066 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:05:55.066 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:55.066 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.066 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.066 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:55.066 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615386+0000", 2024-04-18T21:05:55.066 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.573e-06 2024-04-18T21:05:55.066 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.066 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.066 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:55.067 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:05:55.067 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0723999999999999e-05 2024-04-18T21:05:55.067 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.067 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.067 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:55.067 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615418+0000", 2024-04-18T21:05:55.067 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0902000000000001e-05 2024-04-18T21:05:55.067 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.067 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.067 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:55.067 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615433+0000", 2024-04-18T21:05:55.067 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5319999999999999e-05 2024-04-18T21:05:55.067 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.067 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.068 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:55.068 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615659+0000", 2024-04-18T21:05:55.068 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000226095 2024-04-18T21:05:55.068 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.068 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.068 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:55.068 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:55.068 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1276e-05 2024-04-18T21:05:55.068 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.068 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.068 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:55.068 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643654+0000", 2024-04-18T21:05:55.068 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027983238000000001 2024-04-18T21:05:55.068 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.069 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.069 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:55.069 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643868+0000", 2024-04-18T21:05:55.069 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000214305 2024-04-18T21:05:55.069 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.069 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.069 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:55.069 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:05:55.069 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035892200000000002 2024-04-18T21:05:55.069 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.069 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.069 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:55.069 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646056+0000", 2024-04-18T21:05:55.069 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001829172 2024-04-18T21:05:55.070 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.070 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.070 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:55.070 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651406+0000", 2024-04-18T21:05:55.070 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0053504800000000003 2024-04-18T21:05:55.070 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.070 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.070 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:55.070 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651551+0000", 2024-04-18T21:05:55.070 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014427999999999999 2024-04-18T21:05:55.070 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.070 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.070 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:55.070 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651660+0000", 2024-04-18T21:05:55.071 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109477 2024-04-18T21:05:55.071 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:55.071 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:55.071 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:55.071 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.071 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.071 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:55.071 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:05:55.071 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.442156287000003, 2024-04-18T21:05:55.071 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045668994999999997, 2024-04-18T21:05:55.071 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:55.071 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:55.071 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:55.071 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:55.072 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.072 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:55.072 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:05:55.072 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:55.072 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.072 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.072 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:55.072 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:05:55.072 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:55.072 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.072 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.072 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:55.072 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615459+0000", 2024-04-18T21:05:55.072 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5030000000000001e-06 2024-04-18T21:05:55.072 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.073 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.073 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:55.073 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615506+0000", 2024-04-18T21:05:55.073 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6872000000000001e-05 2024-04-18T21:05:55.073 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.073 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.073 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:55.073 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615527+0000", 2024-04-18T21:05:55.073 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0763000000000001e-05 2024-04-18T21:05:55.073 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.073 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.073 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:55.073 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615551+0000", 2024-04-18T21:05:55.073 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4159e-05 2024-04-18T21:05:55.074 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.074 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.074 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:55.074 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615736+0000", 2024-04-18T21:05:55.074 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018499599999999999 2024-04-18T21:05:55.074 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.074 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.074 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:55.074 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615748+0000", 2024-04-18T21:05:55.074 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2272999999999999e-05 2024-04-18T21:05:55.074 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.074 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.074 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:55.074 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635481+0000", 2024-04-18T21:05:55.075 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019732772999999999 2024-04-18T21:05:55.075 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.075 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.075 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:55.075 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635791+0000", 2024-04-18T21:05:55.075 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031013299999999998 2024-04-18T21:05:55.075 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.075 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.075 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:55.075 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636101+0000", 2024-04-18T21:05:55.075 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030943300000000002 2024-04-18T21:05:55.075 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.075 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.075 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:55.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646043+0000", 2024-04-18T21:05:55.076 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099428139999999995 2024-04-18T21:05:55.076 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.076 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.076 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:55.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660991+0000", 2024-04-18T21:05:55.076 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014947142 2024-04-18T21:05:55.076 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.076 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.076 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:55.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661061+0000", 2024-04-18T21:05:55.076 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0438000000000006e-05 2024-04-18T21:05:55.076 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.076 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.077 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:55.077 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661127+0000", 2024-04-18T21:05:55.077 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5696000000000003e-05 2024-04-18T21:05:55.077 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:55.077 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:55.077 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:55.077 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.077 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.077 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:55.077 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:55.077 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.441943858999998, 2024-04-18T21:05:55.077 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045745085999999997, 2024-04-18T21:05:55.077 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:55.077 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:55.077 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:55.078 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:55.078 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.078 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:55.078 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:55.078 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:55.078 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.078 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.078 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:55.078 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:55.078 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:55.078 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.078 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.078 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:55.079 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:05:55.079 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7400000000000001e-06 2024-04-18T21:05:55.079 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.079 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.079 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:55.079 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:05:55.079 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8133e-05 2024-04-18T21:05:55.079 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.079 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.079 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:55.079 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615726+0000", 2024-04-18T21:05:55.079 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6132e-05 2024-04-18T21:05:55.079 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.079 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.080 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:55.080 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615742+0000", 2024-04-18T21:05:55.080 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6157000000000001e-05 2024-04-18T21:05:55.080 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.080 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.080 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:55.080 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615937+0000", 2024-04-18T21:05:55.080 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000194768 2024-04-18T21:05:55.080 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.080 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.080 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:55.080 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615950+0000", 2024-04-18T21:05:55.080 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3084e-05 2024-04-18T21:05:55.080 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.081 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.081 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:55.081 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643676+0000", 2024-04-18T21:05:55.081 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027725639999999999 2024-04-18T21:05:55.081 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.081 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.081 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:55.081 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643867+0000", 2024-04-18T21:05:55.081 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019075900000000001 2024-04-18T21:05:55.081 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.081 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.081 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:55.081 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:05:55.081 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036013799999999997 2024-04-18T21:05:55.082 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.082 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.082 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:55.082 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646068+0000", 2024-04-18T21:05:55.082 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001841536 2024-04-18T21:05:55.082 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.082 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.082 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:55.082 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661184+0000", 2024-04-18T21:05:55.082 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015115458999999999 2024-04-18T21:05:55.082 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.082 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.082 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:55.083 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661283+0000", 2024-04-18T21:05:55.083 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9502999999999999e-05 2024-04-18T21:05:55.083 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.083 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.083 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:55.083 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661415+0000", 2024-04-18T21:05:55.083 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000132037 2024-04-18T21:05:55.083 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:55.083 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:55.083 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:55.083 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.083 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.083 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:55.083 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:05:55.083 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.441822172000002, 2024-04-18T21:05:55.083 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036185947000000003, 2024-04-18T21:05:55.084 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:55.084 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:55.084 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:55.084 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:55.084 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.084 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:55.084 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:05:55.084 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:55.084 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.084 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.084 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:55.084 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:05:55.084 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:55.084 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.084 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.085 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:55.085 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615794+0000", 2024-04-18T21:05:55.085 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6440000000000001e-06 2024-04-18T21:05:55.085 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.085 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.085 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:55.085 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615803+0000", 2024-04-18T21:05:55.085 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1220000000000001e-06 2024-04-18T21:05:55.085 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.085 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.085 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:55.085 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615827+0000", 2024-04-18T21:05:55.085 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3997000000000001e-05 2024-04-18T21:05:55.085 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.086 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.086 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:55.086 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615899+0000", 2024-04-18T21:05:55.086 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2741e-05 2024-04-18T21:05:55.086 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.086 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.086 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:55.086 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616019+0000", 2024-04-18T21:05:55.086 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119874 2024-04-18T21:05:55.086 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.086 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.086 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:55.086 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616029+0000", 2024-04-18T21:05:55.087 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:05:55.087 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.087 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:55.087 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644823+0000", 2024-04-18T21:05:55.087 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.028793151999999999 2024-04-18T21:05:55.087 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.087 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:55.087 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645106+0000", 2024-04-18T21:05:55.087 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028379700000000002 2024-04-18T21:05:55.087 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.087 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:55.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645294+0000", 2024-04-18T21:05:55.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000187181 2024-04-18T21:05:55.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.088 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:55.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646763+0000", 2024-04-18T21:05:55.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0014691050000000001 2024-04-18T21:05:55.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.088 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:55.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651784+0000", 2024-04-18T21:05:55.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050211650000000002 2024-04-18T21:05:55.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.089 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:55.089 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651876+0000", 2024-04-18T21:05:55.089 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2503999999999994e-05 2024-04-18T21:05:55.089 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.089 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.089 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:55.089 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651978+0000", 2024-04-18T21:05:55.089 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000101475 2024-04-18T21:05:55.089 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:55.089 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:55.089 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:55.089 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.089 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.089 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:55.090 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:55.090 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.441673565000002, 2024-04-18T21:05:55.090 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032262322000000003, 2024-04-18T21:05:55.090 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:55.090 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:55.090 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:55.090 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:55.090 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.090 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:55.090 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:55.090 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:55.090 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.090 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.090 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:55.091 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:55.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:55.091 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.091 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.091 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:55.091 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615943+0000", 2024-04-18T21:05:55.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1959999999999998e-06 2024-04-18T21:05:55.091 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.091 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.091 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:55.091 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615956+0000", 2024-04-18T21:05:55.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3424000000000001e-05 2024-04-18T21:05:55.091 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.091 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.092 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:55.092 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615983+0000", 2024-04-18T21:05:55.092 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7072000000000001e-05 2024-04-18T21:05:55.092 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.092 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.092 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:55.092 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616006+0000", 2024-04-18T21:05:55.092 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2823000000000002e-05 2024-04-18T21:05:55.092 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.092 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.092 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:55.092 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616156+0000", 2024-04-18T21:05:55.092 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014962299999999999 2024-04-18T21:05:55.092 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.092 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.093 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:55.093 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616174+0000", 2024-04-18T21:05:55.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8082999999999999e-05 2024-04-18T21:05:55.093 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.093 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:55.093 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.629952+0000", 2024-04-18T21:05:55.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013778514 2024-04-18T21:05:55.093 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.093 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:55.093 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630201+0000", 2024-04-18T21:05:55.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024918100000000001 2024-04-18T21:05:55.093 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.094 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:55.094 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630386+0000", 2024-04-18T21:05:55.094 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018436900000000001 2024-04-18T21:05:55.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.094 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:55.094 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643169+0000", 2024-04-18T21:05:55.094 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012782774 2024-04-18T21:05:55.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.094 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:55.094 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.647924+0000", 2024-04-18T21:05:55.094 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004755787 2024-04-18T21:05:55.095 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.095 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.095 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:55.095 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648069+0000", 2024-04-18T21:05:55.095 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014459600000000001 2024-04-18T21:05:55.095 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.095 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.095 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:55.095 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648203+0000", 2024-04-18T21:05:55.095 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013388000000000001 2024-04-18T21:05:55.095 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:55.095 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:55.095 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:55.096 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.096 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.096 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:55.096 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:05:55.096 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.441565300999997, 2024-04-18T21:05:55.096 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032489736999999998, 2024-04-18T21:05:55.096 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:55.096 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:55.096 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:55.096 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:55.096 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.096 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:55.096 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:05:55.096 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:55.097 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.097 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.097 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:55.097 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:05:55.097 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:55.097 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.097 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.097 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:55.097 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616050+0000", 2024-04-18T21:05:55.097 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.606e-06 2024-04-18T21:05:55.097 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.097 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.097 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:55.097 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616061+0000", 2024-04-18T21:05:55.097 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0463e-05 2024-04-18T21:05:55.098 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.098 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.098 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:55.098 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616092+0000", 2024-04-18T21:05:55.098 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1415999999999999e-05 2024-04-18T21:05:55.098 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.098 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.098 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:55.098 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616109+0000", 2024-04-18T21:05:55.098 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6557000000000001e-05 2024-04-18T21:05:55.098 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.098 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.098 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:55.098 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616358+0000", 2024-04-18T21:05:55.099 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000249077 2024-04-18T21:05:55.099 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.099 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.099 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:55.099 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616370+0000", 2024-04-18T21:05:55.099 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2037e-05 2024-04-18T21:05:55.099 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.099 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.099 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:55.099 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.634920+0000", 2024-04-18T21:05:55.099 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018550397 2024-04-18T21:05:55.099 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.099 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.099 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:55.099 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640420+0000", 2024-04-18T21:05:55.100 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055000539999999999 2024-04-18T21:05:55.100 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.100 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.100 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:55.100 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648538+0000", 2024-04-18T21:05:55.100 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0081181299999999994 2024-04-18T21:05:55.100 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:55.100 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:55.100 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:55.100 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.100 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.100 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:55.100 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:05:55.100 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.441480980000001, 2024-04-18T21:05:55.101 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036090029000000003, 2024-04-18T21:05:55.101 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:55.101 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:55.101 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:55.101 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:55.101 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.101 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:55.101 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:05:55.101 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:55.101 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.101 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.101 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:55.101 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:05:55.101 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:55.102 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.102 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.102 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:55.102 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616134+0000", 2024-04-18T21:05:55.102 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.353e-06 2024-04-18T21:05:55.102 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.102 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.102 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:55.102 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616141+0000", 2024-04-18T21:05:55.102 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2770000000000002e-06 2024-04-18T21:05:55.102 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.102 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.102 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:55.103 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616160+0000", 2024-04-18T21:05:55.103 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.91e-05 2024-04-18T21:05:55.103 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.103 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.103 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:55.103 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616170+0000", 2024-04-18T21:05:55.103 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7699999999999996e-06 2024-04-18T21:05:55.103 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.103 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.103 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:55.103 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616275+0000", 2024-04-18T21:05:55.103 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105313 2024-04-18T21:05:55.103 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.103 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.103 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:55.104 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616288+0000", 2024-04-18T21:05:55.104 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3027000000000001e-05 2024-04-18T21:05:55.104 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.104 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.104 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:55.104 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646160+0000", 2024-04-18T21:05:55.104 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.029872019 2024-04-18T21:05:55.104 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.104 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.104 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:55.104 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646368+0000", 2024-04-18T21:05:55.104 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020811899999999999 2024-04-18T21:05:55.104 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.104 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.104 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:55.105 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652223+0000", 2024-04-18T21:05:55.105 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.005855051 2024-04-18T21:05:55.105 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:55.105 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:55.105 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:55.105 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.105 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.105 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:55.105 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:05:55.105 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.441423411000002, 2024-04-18T21:05:55.105 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043572403000000003, 2024-04-18T21:05:55.105 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:55.105 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:55.105 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:55.106 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:55.106 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.106 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:55.106 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:05:55.106 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:55.106 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.106 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.106 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:55.106 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:05:55.106 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:55.106 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.106 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.106 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:55.106 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616192+0000", 2024-04-18T21:05:55.107 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:05:55.107 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.107 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.107 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:55.107 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616203+0000", 2024-04-18T21:05:55.107 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0890000000000001e-05 2024-04-18T21:05:55.107 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.107 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.107 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:55.107 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616223+0000", 2024-04-18T21:05:55.107 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0409000000000001e-05 2024-04-18T21:05:55.107 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.107 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.107 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:55.108 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616238+0000", 2024-04-18T21:05:55.108 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5160000000000001e-05 2024-04-18T21:05:55.108 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.108 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.108 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:55.108 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616343+0000", 2024-04-18T21:05:55.108 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000104831 2024-04-18T21:05:55.108 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.108 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.108 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:55.108 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616357+0000", 2024-04-18T21:05:55.108 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3686000000000001e-05 2024-04-18T21:05:55.108 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.108 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.108 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:55.108 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635912+0000", 2024-04-18T21:05:55.109 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019554944000000001 2024-04-18T21:05:55.109 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.109 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.109 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:55.109 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636231+0000", 2024-04-18T21:05:55.109 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000318766 2024-04-18T21:05:55.109 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.109 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.109 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:55.109 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659763+0000", 2024-04-18T21:05:55.109 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023532474000000001 2024-04-18T21:05:55.109 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:55.109 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:55.109 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:55.109 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.110 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.110 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:55.110 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:05:55.110 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.437494704000002, 2024-04-18T21:05:55.110 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015007971, 2024-04-18T21:05:55.110 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:55.110 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:55.110 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:55.110 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:55.110 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.110 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:55.110 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:05:55.110 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:55.111 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.111 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.111 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:55.111 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:05:55.111 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:55.111 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.111 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.111 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:55.111 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620120+0000", 2024-04-18T21:05:55.111 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0359999999999999e-06 2024-04-18T21:05:55.111 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.111 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.111 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:55.111 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620157+0000", 2024-04-18T21:05:55.111 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6636e-05 2024-04-18T21:05:55.112 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.112 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.112 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:55.112 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620177+0000", 2024-04-18T21:05:55.112 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0247000000000001e-05 2024-04-18T21:05:55.112 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.112 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.112 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:55.112 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620195+0000", 2024-04-18T21:05:55.112 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7819e-05 2024-04-18T21:05:55.112 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.112 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.112 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:55.112 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620342+0000", 2024-04-18T21:05:55.112 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014643300000000001 2024-04-18T21:05:55.113 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.113 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.113 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:55.113 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620405+0000", 2024-04-18T21:05:55.113 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3522000000000006e-05 2024-04-18T21:05:55.113 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.113 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.113 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:55.113 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635016+0000", 2024-04-18T21:05:55.113 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014610840999999999 2024-04-18T21:05:55.113 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.113 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.113 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:55.113 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635127+0000", 2024-04-18T21:05:55.113 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111437 2024-04-18T21:05:55.114 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:55.114 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:55.114 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:55.114 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.114 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.114 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:55.114 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:05:55.114 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.437387436000002, 2024-04-18T21:05:55.114 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012693296, 2024-04-18T21:05:55.114 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:55.114 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:55.114 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:55.114 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:55.114 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.115 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:55.115 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:05:55.115 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:55.115 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.115 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.115 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:55.115 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:05:55.115 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:55.115 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.115 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.115 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:55.115 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620228+0000", 2024-04-18T21:05:55.115 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:05:55.115 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.116 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.116 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:55.116 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620236+0000", 2024-04-18T21:05:55.116 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.303e-06 2024-04-18T21:05:55.116 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.116 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.116 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:55.116 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620255+0000", 2024-04-18T21:05:55.116 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9406e-05 2024-04-18T21:05:55.116 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.116 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.116 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:55.116 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620274+0000", 2024-04-18T21:05:55.116 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8940000000000002e-05 2024-04-18T21:05:55.117 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.117 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.117 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:55.117 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:05:55.117 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001558753 2024-04-18T21:05:55.117 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.117 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.117 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:55.117 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621879+0000", 2024-04-18T21:05:55.117 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6359000000000001e-05 2024-04-18T21:05:55.117 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.117 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.117 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:55.117 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632841+0000", 2024-04-18T21:05:55.118 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010961907 2024-04-18T21:05:55.118 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.118 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.118 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:55.118 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632920+0000", 2024-04-18T21:05:55.118 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8714999999999994e-05 2024-04-18T21:05:55.118 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:55.118 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:55.118 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:55.118 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.118 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.118 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:55.118 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:05:55.118 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.435841672999999, 2024-04-18T21:05:55.118 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013445702, 2024-04-18T21:05:55.119 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:55.119 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:55.119 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:55.119 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:55.119 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.119 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:55.119 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:05:55.119 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:55.119 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.119 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.119 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:55.119 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:05:55.119 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:55.119 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.119 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.120 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:55.120 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621774+0000", 2024-04-18T21:05:55.120 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2500000000000001e-06 2024-04-18T21:05:55.120 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.120 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.120 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:55.120 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621786+0000", 2024-04-18T21:05:55.120 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2636000000000001e-05 2024-04-18T21:05:55.120 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.120 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.120 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:55.120 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621814+0000", 2024-04-18T21:05:55.120 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7823000000000001e-05 2024-04-18T21:05:55.120 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.120 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.121 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:55.121 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621844+0000", 2024-04-18T21:05:55.121 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9589000000000001e-05 2024-04-18T21:05:55.121 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.121 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.121 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:55.121 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622253+0000", 2024-04-18T21:05:55.121 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040963700000000002 2024-04-18T21:05:55.121 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.121 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.121 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:55.121 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622304+0000", 2024-04-18T21:05:55.121 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0868999999999997e-05 2024-04-18T21:05:55.121 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.121 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.122 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:55.122 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635133+0000", 2024-04-18T21:05:55.122 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012829136 2024-04-18T21:05:55.122 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.122 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.122 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:55.122 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635218+0000", 2024-04-18T21:05:55.122 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4761999999999999e-05 2024-04-18T21:05:55.122 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:55.122 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:55.122 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:55.122 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.122 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.122 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:55.122 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:05:55.123 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.435714912999998, 2024-04-18T21:05:55.123 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014162065, 2024-04-18T21:05:55.123 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:55.123 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:55.123 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:55.123 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:55.123 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.123 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:55.123 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:05:55.123 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:55.123 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.123 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.123 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:55.123 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:05:55.123 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:55.124 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.124 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.124 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:55.124 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621900+0000", 2024-04-18T21:05:55.124 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:05:55.124 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.124 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.124 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:55.124 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621910+0000", 2024-04-18T21:05:55.124 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0207000000000001e-05 2024-04-18T21:05:55.124 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.124 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.124 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:55.124 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621932+0000", 2024-04-18T21:05:55.124 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1789000000000001e-05 2024-04-18T21:05:55.125 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.125 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.125 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:55.125 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621946+0000", 2024-04-18T21:05:55.125 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4212999999999999e-05 2024-04-18T21:05:55.125 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.125 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.125 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:55.125 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624477+0000", 2024-04-18T21:05:55.125 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025303470000000001 2024-04-18T21:05:55.125 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.125 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.125 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:55.125 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624525+0000", 2024-04-18T21:05:55.125 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8084999999999998e-05 2024-04-18T21:05:55.126 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.126 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.126 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:55.126 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635976+0000", 2024-04-18T21:05:55.126 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.011451368999999999 2024-04-18T21:05:55.126 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.126 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.126 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:55.126 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636061+0000", 2024-04-18T21:05:55.126 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5094999999999998e-05 2024-04-18T21:05:55.126 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:55.126 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:55.126 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:55.127 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.127 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.127 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:05:55.127 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:05:55.127 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.426479288000003, 2024-04-18T21:05:55.127 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0098014739999999993, 2024-04-18T21:05:55.127 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:55.127 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:55.127 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:05:55.127 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:55.127 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.127 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:55.127 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:05:55.127 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:55.127 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.128 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.128 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:55.128 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:05:55.128 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:55.128 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.128 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.128 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:55.128 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631136+0000", 2024-04-18T21:05:55.128 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0139999999999999e-06 2024-04-18T21:05:55.128 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.128 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.128 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:55.128 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631152+0000", 2024-04-18T21:05:55.128 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6365999999999999e-05 2024-04-18T21:05:55.128 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.129 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.129 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:55.129 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631961+0000", 2024-04-18T21:05:55.129 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00080873100000000003 2024-04-18T21:05:55.129 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.129 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.129 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:55.129 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632021+0000", 2024-04-18T21:05:55.129 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0541999999999997e-05 2024-04-18T21:05:55.129 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.129 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.129 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:55.129 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633539+0000", 2024-04-18T21:05:55.129 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015175639999999999 2024-04-18T21:05:55.130 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.130 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.130 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:55.130 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640936+0000", 2024-04-18T21:05:55.130 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007397257 2024-04-18T21:05:55.130 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:55.130 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:55.130 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:55.130 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.130 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.130 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-18T21:05:55.130 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:05:55.130 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.409017855000002, 2024-04-18T21:05:55.130 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00073592199999999997, 2024-04-18T21:05:55.131 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:55.131 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:55.131 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:55.131 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:55.131 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.131 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:55.131 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:05:55.131 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:55.131 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.131 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.131 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:55.131 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:05:55.131 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:55.131 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.132 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.132 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:55.132 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648597+0000", 2024-04-18T21:05:55.132 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:05:55.132 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.132 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.132 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:55.132 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648605+0000", 2024-04-18T21:05:55.132 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3960000000000006e-06 2024-04-18T21:05:55.132 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.132 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.132 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:55.132 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648625+0000", 2024-04-18T21:05:55.132 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9987e-05 2024-04-18T21:05:55.133 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.133 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.133 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:55.133 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648643+0000", 2024-04-18T21:05:55.133 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7079e-05 2024-04-18T21:05:55.133 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.133 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.133 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:55.133 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649043+0000", 2024-04-18T21:05:55.133 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040083399999999998 2024-04-18T21:05:55.133 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.133 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.133 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:55.133 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649062+0000", 2024-04-18T21:05:55.134 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9052999999999999e-05 2024-04-18T21:05:55.134 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.134 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.134 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:55.134 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649332+0000", 2024-04-18T21:05:55.134 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026971999999999999 2024-04-18T21:05:55.134 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:55.134 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:55.134 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:55.134 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.134 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.134 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:05:55.134 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:05:55.134 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.406242954, 2024-04-18T21:05:55.135 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00086123999999999999, 2024-04-18T21:05:55.135 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:55.135 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:55.135 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:05:55.135 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:55.135 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.135 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:55.135 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:05:55.135 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:55.135 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.135 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.135 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:55.135 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:05:55.135 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:55.135 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.136 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.136 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:55.136 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651372+0000", 2024-04-18T21:05:55.136 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7599999999999997e-07 2024-04-18T21:05:55.136 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.136 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.136 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:55.136 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651377+0000", 2024-04-18T21:05:55.136 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.22e-06 2024-04-18T21:05:55.136 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.136 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.136 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:55.136 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651394+0000", 2024-04-18T21:05:55.136 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6646999999999998e-05 2024-04-18T21:05:55.137 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.137 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.137 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:55.137 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651427+0000", 2024-04-18T21:05:55.137 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3682e-05 2024-04-18T21:05:55.137 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.137 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.137 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:55.137 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652029+0000", 2024-04-18T21:05:55.137 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00060152199999999995 2024-04-18T21:05:55.137 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.137 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.137 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:55.137 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652232+0000", 2024-04-18T21:05:55.137 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020359299999999999 2024-04-18T21:05:55.138 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:55.138 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:55.138 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:55.138 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.138 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.138 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:05:55.138 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:05:55.138 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.398215991999997, 2024-04-18T21:05:55.138 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0017426200000000001, 2024-04-18T21:05:55.138 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:55.138 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:55.138 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:55.138 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:55.138 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.139 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:55.139 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:05:55.139 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:55.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.139 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.139 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:55.139 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:05:55.139 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:55.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.139 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.139 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:55.139 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659399+0000", 2024-04-18T21:05:55.139 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6000000000000002e-07 2024-04-18T21:05:55.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.140 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.140 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:55.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659405+0000", 2024-04-18T21:05:55.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5069999999999997e-06 2024-04-18T21:05:55.140 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.140 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.140 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:55.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659425+0000", 2024-04-18T21:05:55.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.927e-05 2024-04-18T21:05:55.140 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.140 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.140 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:55.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659443+0000", 2024-04-18T21:05:55.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8051999999999999e-05 2024-04-18T21:05:55.140 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.141 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.141 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:55.141 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660973+0000", 2024-04-18T21:05:55.141 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001530106 2024-04-18T21:05:55.141 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.141 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.141 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:55.141 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660983+0000", 2024-04-18T21:05:55.141 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0516999999999999e-05 2024-04-18T21:05:55.141 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.141 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.141 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:55.141 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661141+0000", 2024-04-18T21:05:55.141 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015730799999999999 2024-04-18T21:05:55.141 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:55.142 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:55.142 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:55.142 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.142 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.142 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:05:55.142 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:05:55.142 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.397999366999997, 2024-04-18T21:05:55.142 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001812311, 2024-04-18T21:05:55.142 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:55.142 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:55.142 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:55.142 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:55.142 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.143 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:55.143 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:05:55.143 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:55.143 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.143 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:55.143 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:05:55.143 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:55.143 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.143 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:55.143 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659616+0000", 2024-04-18T21:05:55.143 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.277e-06 2024-04-18T21:05:55.143 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.144 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:55.144 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659625+0000", 2024-04-18T21:05:55.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5359999999999998e-06 2024-04-18T21:05:55.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.144 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.144 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:55.144 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659647+0000", 2024-04-18T21:05:55.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1857000000000001e-05 2024-04-18T21:05:55.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.144 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.144 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:55.144 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659664+0000", 2024-04-18T21:05:55.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6405999999999998e-05 2024-04-18T21:05:55.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.144 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.145 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:55.145 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661169+0000", 2024-04-18T21:05:55.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015054179999999999 2024-04-18T21:05:55.145 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.145 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:55.145 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661177+0000", 2024-04-18T21:05:55.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9680000000000006e-06 2024-04-18T21:05:55.145 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.145 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:55.145 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661427+0000", 2024-04-18T21:05:55.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024984900000000001 2024-04-18T21:05:55.146 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:55.146 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:55.146 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:55.146 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.146 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.146 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-18T21:05:55.146 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:05:55.146 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 47.445078758999998, 2024-04-18T21:05:55.146 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0030975030000000001, 2024-04-18T21:05:55.146 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:55.146 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:55.146 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:55.146 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:55.146 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.147 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:55.147 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:05:55.147 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:55.147 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.147 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.147 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:55.147 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:05:55.147 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:55.147 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.147 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.147 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:55.147 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612538+0000", 2024-04-18T21:05:55.147 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6259999999999999e-06 2024-04-18T21:05:55.147 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.148 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.148 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:55.148 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612552+0000", 2024-04-18T21:05:55.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4073999999999999e-05 2024-04-18T21:05:55.148 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.148 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.148 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:55.148 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612585+0000", 2024-04-18T21:05:55.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3504999999999999e-05 2024-04-18T21:05:55.148 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.148 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.148 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:55.148 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612601+0000", 2024-04-18T21:05:55.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5194000000000001e-05 2024-04-18T21:05:55.149 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.149 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.149 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:55.149 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612746+0000", 2024-04-18T21:05:55.149 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145666 2024-04-18T21:05:55.149 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.149 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.149 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:55.149 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612953+0000", 2024-04-18T21:05:55.149 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000207109 2024-04-18T21:05:55.149 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.149 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.149 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:55.149 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.613134+0000", 2024-04-18T21:05:55.150 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018041300000000001 2024-04-18T21:05:55.150 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.150 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:55.150 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.614411+0000", 2024-04-18T21:05:55.150 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0012769929999999999 2024-04-18T21:05:55.150 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.150 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:55.150 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615441+0000", 2024-04-18T21:05:55.150 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001029917 2024-04-18T21:05:55.150 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.150 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:55.151 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615522+0000", 2024-04-18T21:05:55.151 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1142000000000003e-05 2024-04-18T21:05:55.151 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.151 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:55.151 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615633+0000", 2024-04-18T21:05:55.151 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000110864 2024-04-18T21:05:55.151 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:55.151 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:55.151 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:55.151 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.151 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-18T21:05:55.151 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:05:55.151 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 29.442792948000001, 2024-04-18T21:05:55.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088979039999999999, 2024-04-18T21:05:55.152 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:55.152 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:55.152 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:55.152 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:55.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.152 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:55.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:05:55.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:55.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.152 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:55.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:05:55.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:55.153 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.153 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.153 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:55.153 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614825+0000", 2024-04-18T21:05:55.153 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4829999999999999e-06 2024-04-18T21:05:55.153 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.153 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.153 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:55.153 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614843+0000", 2024-04-18T21:05:55.153 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8777e-05 2024-04-18T21:05:55.153 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.153 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.153 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:55.153 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614884+0000", 2024-04-18T21:05:55.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1051999999999999e-05 2024-04-18T21:05:55.154 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.154 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:55.154 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614903+0000", 2024-04-18T21:05:55.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9069999999999999e-05 2024-04-18T21:05:55.154 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.154 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:55.154 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615047+0000", 2024-04-18T21:05:55.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014374400000000001 2024-04-18T21:05:55.154 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:55.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615061+0000", 2024-04-18T21:05:55.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4063000000000001e-05 2024-04-18T21:05:55.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:55.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621064+0000", 2024-04-18T21:05:55.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0060029200000000001 2024-04-18T21:05:55.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:55.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621211+0000", 2024-04-18T21:05:55.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000147224 2024-04-18T21:05:55.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.156 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.156 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:55.156 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621396+0000", 2024-04-18T21:05:55.156 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018454699999999999 2024-04-18T21:05:55.156 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.156 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.156 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:55.156 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.622517+0000", 2024-04-18T21:05:55.156 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001121424 2024-04-18T21:05:55.156 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.156 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.156 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:55.156 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623571+0000", 2024-04-18T21:05:55.156 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010538660000000001 2024-04-18T21:05:55.156 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.157 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.157 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:55.157 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623658+0000", 2024-04-18T21:05:55.157 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6439000000000004e-05 2024-04-18T21:05:55.157 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:55.157 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:55.157 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:55.157 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623719+0000", 2024-04-18T21:05:55.157 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1295000000000002e-05 2024-04-18T21:05:55.157 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:55.157 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:55.157 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:55.157 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:55.157 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:55.157 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:05:55.159 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:05:55.160 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:55.159+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:55.260 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:55.263+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:55.291 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:05:55.291 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:05:55.291 INFO:teuthology.orchestra.run.smithi132.stdout: "num_ops": 0 2024-04-18T21:05:55.291 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:05:55.305 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:05:55.361 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:55.359+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:55.428 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:05:55.428 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:05:55.428 INFO:teuthology.orchestra.run.smithi132.stdout: "complaint_time": 30, 2024-04-18T21:05:55.429 INFO:teuthology.orchestra.run.smithi132.stdout: "num_blocked_ops": 0 2024-04-18T21:05:55.429 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:05:55.442 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:05:55.462 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:55.463+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:55.563 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:55.563+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:55.608 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:05:55.608 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 20, 2024-04-18T21:05:55.609 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 600, 2024-04-18T21:05:55.609 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [ 2024-04-18T21:05:55.609 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.609 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:55.609 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:05:55.609 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 60.696401897999998, 2024-04-18T21:05:55.609 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.02518273, 2024-04-18T21:05:55.609 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:55.609 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:55.609 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:55.609 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:55.609 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:55.609 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:55.610 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 141 2024-04-18T21:05:55.610 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.610 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:55.610 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.610 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:55.610 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:05:55.610 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:55.610 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.610 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.610 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:55.610 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:05:55.610 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:55.610 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.610 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.611 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:55.611 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911562+0000", 2024-04-18T21:05:55.611 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9300000000000006e-07 2024-04-18T21:05:55.611 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.611 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.611 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:55.611 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911569+0000", 2024-04-18T21:05:55.611 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0169999999999999e-06 2024-04-18T21:05:55.611 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.611 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.611 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:55.611 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911582+0000", 2024-04-18T21:05:55.611 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.343e-05 2024-04-18T21:05:55.611 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.611 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.612 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:55.612 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911590+0000", 2024-04-18T21:05:55.612 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.413e-06 2024-04-18T21:05:55.612 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.612 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.612 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:55.612 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.933922+0000", 2024-04-18T21:05:55.612 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.022332093000000001 2024-04-18T21:05:55.612 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.612 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.612 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:55.612 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.934155+0000", 2024-04-18T21:05:55.612 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023378900000000001 2024-04-18T21:05:55.612 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.613 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.613 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:55.613 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.934514+0000", 2024-04-18T21:05:55.613 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00035859200000000003 2024-04-18T21:05:55.613 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.613 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.613 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:55.613 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.935973+0000", 2024-04-18T21:05:55.613 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001458705 2024-04-18T21:05:55.613 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.613 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.613 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:55.614 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936488+0000", 2024-04-18T21:05:55.614 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00051550000000000001 2024-04-18T21:05:55.614 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.614 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.614 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:55.614 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936636+0000", 2024-04-18T21:05:55.614 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014779800000000001 2024-04-18T21:05:55.614 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.614 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.614 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:55.614 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936743+0000", 2024-04-18T21:05:55.614 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010739999999999999 2024-04-18T21:05:55.614 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:55.615 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:55.615 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:55.615 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.615 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.615 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:55.615 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:05:55.615 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 60.579202924000001, 2024-04-18T21:05:55.615 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023654959999999999, 2024-04-18T21:05:55.615 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:55.615 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:55.615 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:55.615 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:55.615 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:55.615 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:55.616 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 163 2024-04-18T21:05:55.616 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.616 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:55.616 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.616 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:55.616 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:05:55.616 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:55.616 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.616 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.616 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:55.616 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:05:55.616 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:55.616 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.616 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.616 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:55.616 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:05:55.617 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0999999999999998e-07 2024-04-18T21:05:55.617 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.617 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.617 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:55.617 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028766+0000", 2024-04-18T21:05:55.617 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4700000000000001e-06 2024-04-18T21:05:55.617 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.617 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.617 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:55.617 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028775+0000", 2024-04-18T21:05:55.617 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.3190000000000001e-06 2024-04-18T21:05:55.617 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.617 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.617 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:55.617 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028782+0000", 2024-04-18T21:05:55.618 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.2300000000000002e-06 2024-04-18T21:05:55.618 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.618 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.618 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:55.618 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046667+0000", 2024-04-18T21:05:55.618 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017884356000000001 2024-04-18T21:05:55.618 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.618 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.618 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:55.618 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046788+0000", 2024-04-18T21:05:55.618 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012125000000000001 2024-04-18T21:05:55.618 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.618 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.619 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:55.619 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046982+0000", 2024-04-18T21:05:55.619 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019394 2024-04-18T21:05:55.619 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.619 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.619 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:55.619 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051969+0000", 2024-04-18T21:05:55.619 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0049868150000000003 2024-04-18T21:05:55.619 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.619 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.619 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:55.619 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052089+0000", 2024-04-18T21:05:55.619 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011993 2024-04-18T21:05:55.619 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.619 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.620 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:55.620 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052292+0000", 2024-04-18T21:05:55.620 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020345699999999999 2024-04-18T21:05:55.620 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.620 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.620 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:55.620 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052415+0000", 2024-04-18T21:05:55.620 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000122483 2024-04-18T21:05:55.620 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:55.620 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:55.620 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:55.620 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.620 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.620 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:55.620 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:05:55.620 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 60.579168692000003, 2024-04-18T21:05:55.621 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023864586, 2024-04-18T21:05:55.621 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:55.621 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:55.621 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:55.621 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:55.621 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:55.621 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:55.621 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 164 2024-04-18T21:05:55.621 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.621 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:55.621 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.621 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:55.621 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:05:55.621 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:55.621 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.621 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.622 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:55.622 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:05:55.622 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:55.622 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.622 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.622 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:55.622 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028795+0000", 2024-04-18T21:05:55.622 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7999999999999995e-07 2024-04-18T21:05:55.622 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.622 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.622 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:55.622 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028884+0000", 2024-04-18T21:05:55.622 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8997000000000002e-05 2024-04-18T21:05:55.623 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.623 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.623 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:55.623 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028895+0000", 2024-04-18T21:05:55.623 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1647e-05 2024-04-18T21:05:55.623 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.623 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.623 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:55.623 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028903+0000", 2024-04-18T21:05:55.623 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.909e-06 2024-04-18T21:05:55.623 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.623 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.623 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:55.623 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.047818+0000", 2024-04-18T21:05:55.624 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018914337 2024-04-18T21:05:55.624 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.624 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.624 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:55.624 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.048094+0000", 2024-04-18T21:05:55.624 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00027653500000000001 2024-04-18T21:05:55.624 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.624 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.624 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:55.624 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.048471+0000", 2024-04-18T21:05:55.624 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00037705799999999999 2024-04-18T21:05:55.624 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.624 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.625 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:55.625 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052516+0000", 2024-04-18T21:05:55.625 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0040452739999999997 2024-04-18T21:05:55.625 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.625 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.625 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:55.625 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052535+0000", 2024-04-18T21:05:55.625 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.84e-05 2024-04-18T21:05:55.625 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.625 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.625 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:55.625 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052603+0000", 2024-04-18T21:05:55.625 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.8095000000000004e-05 2024-04-18T21:05:55.625 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.625 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.625 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:55.626 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052659+0000", 2024-04-18T21:05:55.626 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5653999999999999e-05 2024-04-18T21:05:55.626 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:55.626 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:55.626 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:55.626 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.626 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.626 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:55.626 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:05:55.626 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 60.579045249000004, 2024-04-18T21:05:55.626 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024516458000000001, 2024-04-18T21:05:55.626 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:55.626 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:55.627 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:55.627 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:55.627 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:55.627 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:55.627 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 165 2024-04-18T21:05:55.627 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.627 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:55.627 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.627 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:55.627 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:05:55.627 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:55.627 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.627 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.627 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:55.628 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:05:55.628 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:55.628 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.628 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.628 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:55.628 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028918+0000", 2024-04-18T21:05:55.628 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8000000000000005e-07 2024-04-18T21:05:55.628 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.628 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.628 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:55.628 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028924+0000", 2024-04-18T21:05:55.628 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5659999999999997e-06 2024-04-18T21:05:55.628 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.628 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.628 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:55.628 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028933+0000", 2024-04-18T21:05:55.629 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.38e-06 2024-04-18T21:05:55.629 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.629 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.629 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:55.629 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028940+0000", 2024-04-18T21:05:55.629 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0060000000000003e-06 2024-04-18T21:05:55.629 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.629 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.629 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:55.629 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.050846+0000", 2024-04-18T21:05:55.629 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021906119000000002 2024-04-18T21:05:55.629 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.630 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.630 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:55.630 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051025+0000", 2024-04-18T21:05:55.630 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017850799999999999 2024-04-18T21:05:55.630 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.630 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.630 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:55.630 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051221+0000", 2024-04-18T21:05:55.630 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019608700000000001 2024-04-18T21:05:55.630 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.630 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.630 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:55.630 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052675+0000", 2024-04-18T21:05:55.630 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0014537899999999999 2024-04-18T21:05:55.631 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.631 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.631 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:55.631 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053311+0000", 2024-04-18T21:05:55.631 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00063613299999999999 2024-04-18T21:05:55.631 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.631 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.631 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:55.631 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053381+0000", 2024-04-18T21:05:55.631 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0074999999999996e-05 2024-04-18T21:05:55.631 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.631 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.631 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:55.631 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053434+0000", 2024-04-18T21:05:55.632 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3013999999999998e-05 2024-04-18T21:05:55.632 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:55.632 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:55.632 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:55.632 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.632 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.632 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:55.632 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:05:55.632 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 60.465739769999999, 2024-04-18T21:05:55.632 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023772793, 2024-04-18T21:05:55.632 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:55.632 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:55.632 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:55.632 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:55.632 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:55.633 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:55.633 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 187 2024-04-18T21:05:55.633 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.633 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:55.633 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.633 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:55.633 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:05:55.633 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:55.633 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.633 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.633 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:55.633 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:05:55.633 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:55.633 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.633 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.633 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:55.634 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142224+0000", 2024-04-18T21:05:55.634 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.47e-07 2024-04-18T21:05:55.634 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.634 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.634 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:55.634 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142233+0000", 2024-04-18T21:05:55.634 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0729999999999994e-06 2024-04-18T21:05:55.634 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.634 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.634 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:55.634 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142255+0000", 2024-04-18T21:05:55.634 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.2535999999999999e-05 2024-04-18T21:05:55.634 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.634 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.634 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:55.634 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142268+0000", 2024-04-18T21:05:55.635 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2686e-05 2024-04-18T21:05:55.635 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.635 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.635 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:55.635 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160497+0000", 2024-04-18T21:05:55.635 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018228779000000001 2024-04-18T21:05:55.635 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.635 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.635 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:55.635 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160634+0000", 2024-04-18T21:05:55.635 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000137315 2024-04-18T21:05:55.635 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.635 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.635 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:55.635 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160831+0000", 2024-04-18T21:05:55.636 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019683100000000001 2024-04-18T21:05:55.636 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.636 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.636 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:55.636 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165129+0000", 2024-04-18T21:05:55.636 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0042981299999999998 2024-04-18T21:05:55.636 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.636 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.636 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:55.636 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165776+0000", 2024-04-18T21:05:55.636 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00064702900000000003 2024-04-18T21:05:55.636 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.636 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.637 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:55.637 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165921+0000", 2024-04-18T21:05:55.637 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014506 2024-04-18T21:05:55.637 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.637 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.637 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:55.637 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165996+0000", 2024-04-18T21:05:55.637 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.4406999999999994e-05 2024-04-18T21:05:55.637 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:55.637 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:55.637 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:55.637 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.637 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.637 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:55.638 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:05:55.638 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 60.465679172000002, 2024-04-18T21:05:55.638 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026802157, 2024-04-18T21:05:55.638 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:55.638 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:55.638 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:55.638 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:55.638 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:55.638 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:55.638 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 188 2024-04-18T21:05:55.638 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.638 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:55.638 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.638 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:55.638 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:05:55.639 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:55.639 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.639 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.639 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:55.639 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:05:55.639 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:55.639 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.639 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.639 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:55.639 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142284+0000", 2024-04-18T21:05:55.639 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4e-07 2024-04-18T21:05:55.639 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.639 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.640 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:55.640 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142374+0000", 2024-04-18T21:05:55.640 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0099999999999995e-05 2024-04-18T21:05:55.640 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.640 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.640 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:55.640 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142386+0000", 2024-04-18T21:05:55.640 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1770000000000001e-05 2024-04-18T21:05:55.640 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.640 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.640 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:55.640 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142394+0000", 2024-04-18T21:05:55.640 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.2130000000000008e-06 2024-04-18T21:05:55.640 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.640 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.640 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:55.641 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.161743+0000", 2024-04-18T21:05:55.641 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019348644000000002 2024-04-18T21:05:55.641 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.641 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.641 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:55.641 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.161865+0000", 2024-04-18T21:05:55.641 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012210899999999999 2024-04-18T21:05:55.641 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.641 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.641 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:55.641 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.162055+0000", 2024-04-18T21:05:55.641 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000189994 2024-04-18T21:05:55.641 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.641 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.641 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:55.641 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165735+0000", 2024-04-18T21:05:55.642 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0036803270000000002 2024-04-18T21:05:55.642 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.642 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.642 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:55.642 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.168911+0000", 2024-04-18T21:05:55.642 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0031753689999999999 2024-04-18T21:05:55.642 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.642 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.642 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:55.642 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169012+0000", 2024-04-18T21:05:55.642 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010157699999999999 2024-04-18T21:05:55.642 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.642 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.642 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:55.642 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169086+0000", 2024-04-18T21:05:55.642 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3213999999999994e-05 2024-04-18T21:05:55.643 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:55.643 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:55.643 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:55.643 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.643 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.643 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:55.643 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:05:55.643 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 60.465553866, 2024-04-18T21:05:55.643 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026811423000000001, 2024-04-18T21:05:55.643 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:55.643 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:55.643 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:55.643 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:55.643 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:55.644 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:55.644 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 189 2024-04-18T21:05:55.644 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.644 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:55.644 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.644 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:55.644 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:05:55.644 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:55.644 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.644 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.644 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:55.644 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:05:55.644 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:55.644 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.644 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.644 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:55.645 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142410+0000", 2024-04-18T21:05:55.645 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:05:55.645 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.645 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.645 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:55.645 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142415+0000", 2024-04-18T21:05:55.645 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.7939999999999999e-06 2024-04-18T21:05:55.645 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.645 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.645 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:55.645 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142470+0000", 2024-04-18T21:05:55.645 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4537999999999999e-05 2024-04-18T21:05:55.645 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.645 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.645 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:55.645 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142481+0000", 2024-04-18T21:05:55.646 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0966e-05 2024-04-18T21:05:55.646 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.646 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.646 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:55.646 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.163493+0000", 2024-04-18T21:05:55.646 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021012444000000002 2024-04-18T21:05:55.646 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.646 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.646 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:55.646 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.163727+0000", 2024-04-18T21:05:55.646 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000233339 2024-04-18T21:05:55.646 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.647 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.647 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:55.647 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.164102+0000", 2024-04-18T21:05:55.647 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000374872 2024-04-18T21:05:55.647 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.647 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.647 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:55.647 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.166528+0000", 2024-04-18T21:05:55.647 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0024258729999999998 2024-04-18T21:05:55.647 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.647 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.647 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:55.647 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169101+0000", 2024-04-18T21:05:55.647 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0025737680000000001 2024-04-18T21:05:55.648 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.648 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.648 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:55.648 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169171+0000", 2024-04-18T21:05:55.648 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0148000000000007e-05 2024-04-18T21:05:55.648 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.648 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.648 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:55.648 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169220+0000", 2024-04-18T21:05:55.648 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8767999999999998e-05 2024-04-18T21:05:55.648 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:55.648 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:55.648 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:55.648 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.649 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.649 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:55.649 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:05:55.649 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 49.991981314, 2024-04-18T21:05:55.649 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024082777999999999, 2024-04-18T21:05:55.649 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:55.649 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:55.649 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:55.649 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:55.649 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.649 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:55.649 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:05:55.649 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:55.649 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.650 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.650 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:55.650 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:05:55.650 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:55.650 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.650 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.650 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:55.650 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615984+0000", 2024-04-18T21:05:55.650 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.9869999999999999e-06 2024-04-18T21:05:55.650 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.650 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.650 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:55.650 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615999+0000", 2024-04-18T21:05:55.650 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4646e-05 2024-04-18T21:05:55.651 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.651 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.651 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:55.651 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616028+0000", 2024-04-18T21:05:55.651 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8952999999999999e-05 2024-04-18T21:05:55.651 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.651 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.651 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:55.651 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616052+0000", 2024-04-18T21:05:55.651 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.3941999999999999e-05 2024-04-18T21:05:55.651 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.651 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.651 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:55.651 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618010+0000", 2024-04-18T21:05:55.652 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0019581780000000001 2024-04-18T21:05:55.652 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.652 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.652 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:55.652 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618322+0000", 2024-04-18T21:05:55.652 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00031158899999999997 2024-04-18T21:05:55.652 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.652 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.652 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:55.652 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618587+0000", 2024-04-18T21:05:55.652 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00026495700000000002 2024-04-18T21:05:55.652 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.652 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.652 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:55.653 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629262+0000", 2024-04-18T21:05:55.653 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010675877 2024-04-18T21:05:55.653 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.653 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.653 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:55.653 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.639773+0000", 2024-04-18T21:05:55.653 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0105109 2024-04-18T21:05:55.653 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.653 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.653 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:55.653 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.639926+0000", 2024-04-18T21:05:55.653 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000152349 2024-04-18T21:05:55.653 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.654 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.654 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:55.654 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640064+0000", 2024-04-18T21:05:55.654 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0001384 2024-04-18T21:05:55.654 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:55.654 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:55.654 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:55.654 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.654 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.654 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:55.654 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:05:55.654 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 49.99186864, 2024-04-18T21:05:55.654 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030215005999999999, 2024-04-18T21:05:55.654 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:55.655 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:55.655 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:55.655 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:55.655 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.655 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:55.655 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:05:55.655 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:55.655 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.655 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.655 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:55.655 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:05:55.655 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:55.655 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.655 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.656 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:55.656 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616095+0000", 2024-04-18T21:05:55.656 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.446e-06 2024-04-18T21:05:55.656 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.656 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.656 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:55.656 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616104+0000", 2024-04-18T21:05:55.656 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6200000000000005e-06 2024-04-18T21:05:55.656 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.656 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.656 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:55.656 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616132+0000", 2024-04-18T21:05:55.657 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7668999999999999e-05 2024-04-18T21:05:55.657 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.657 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.657 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:55.657 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616149+0000", 2024-04-18T21:05:55.657 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7047000000000001e-05 2024-04-18T21:05:55.657 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.657 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.657 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:55.657 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619287+0000", 2024-04-18T21:05:55.657 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0031381450000000002 2024-04-18T21:05:55.657 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.657 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.657 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:55.657 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619503+0000", 2024-04-18T21:05:55.657 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000216522 2024-04-18T21:05:55.658 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.658 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.658 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:55.658 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619930+0000", 2024-04-18T21:05:55.658 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00042604900000000001 2024-04-18T21:05:55.658 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.658 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.658 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:55.658 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629281+0000", 2024-04-18T21:05:55.658 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0093512230000000005 2024-04-18T21:05:55.658 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.658 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.658 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:55.659 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646022+0000", 2024-04-18T21:05:55.659 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016741156 2024-04-18T21:05:55.659 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.659 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.659 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:55.659 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646198+0000", 2024-04-18T21:05:55.659 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000176009 2024-04-18T21:05:55.659 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.659 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.659 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:55.659 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646309+0000", 2024-04-18T21:05:55.659 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011112000000000001 2024-04-18T21:05:55.659 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:55.659 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:55.659 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:55.660 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.660 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.660 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:55.660 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:05:55.660 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 49.991783816000002, 2024-04-18T21:05:55.660 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030501176000000001, 2024-04-18T21:05:55.660 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:55.660 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:55.660 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:55.660 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:55.660 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.660 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:55.660 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:05:55.660 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:55.660 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.661 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.661 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:55.661 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:05:55.661 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:55.661 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.661 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.661 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:55.661 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616180+0000", 2024-04-18T21:05:55.661 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1000000000000001e-06 2024-04-18T21:05:55.661 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.661 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.661 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:55.661 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616188+0000", 2024-04-18T21:05:55.662 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4069999999999993e-06 2024-04-18T21:05:55.662 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.662 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.662 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:55.662 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616207+0000", 2024-04-18T21:05:55.662 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8335999999999999e-05 2024-04-18T21:05:55.662 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.662 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.662 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:55.662 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616225+0000", 2024-04-18T21:05:55.662 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8652999999999999e-05 2024-04-18T21:05:55.662 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.662 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.662 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:55.663 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620977+0000", 2024-04-18T21:05:55.663 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047512220000000003 2024-04-18T21:05:55.663 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.663 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.663 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:55.663 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621279+0000", 2024-04-18T21:05:55.663 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000302646 2024-04-18T21:05:55.663 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.663 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.663 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:55.663 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621584+0000", 2024-04-18T21:05:55.663 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000305142 2024-04-18T21:05:55.663 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.664 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.664 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:55.664 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629352+0000", 2024-04-18T21:05:55.664 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0077673689999999997 2024-04-18T21:05:55.664 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.664 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.664 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:55.664 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646480+0000", 2024-04-18T21:05:55.664 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017128259 2024-04-18T21:05:55.664 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.664 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.664 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:55.664 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646591+0000", 2024-04-18T21:05:55.665 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011113899999999999 2024-04-18T21:05:55.665 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.665 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.665 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:55.665 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646680+0000", 2024-04-18T21:05:55.665 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8902999999999999e-05 2024-04-18T21:05:55.665 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:55.665 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:55.665 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:55.665 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.665 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.665 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:55.666 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:05:55.666 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 49.991717317000003, 2024-04-18T21:05:55.666 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030779760999999999, 2024-04-18T21:05:55.666 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:55.666 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:55.666 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:55.666 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:55.666 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.666 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:55.666 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:05:55.666 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:55.666 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.666 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.667 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:55.667 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:05:55.667 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:55.667 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.667 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.667 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:55.667 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616246+0000", 2024-04-18T21:05:55.667 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0499999999999999e-06 2024-04-18T21:05:55.667 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.667 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.667 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:55.667 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616253+0000", 2024-04-18T21:05:55.667 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.5989999999999998e-06 2024-04-18T21:05:55.667 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.667 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.667 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:55.668 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616273+0000", 2024-04-18T21:05:55.668 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9916999999999999e-05 2024-04-18T21:05:55.668 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.668 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.668 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:55.668 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616287+0000", 2024-04-18T21:05:55.668 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3669000000000001e-05 2024-04-18T21:05:55.668 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.668 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.668 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:55.668 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622203+0000", 2024-04-18T21:05:55.668 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.005916737 2024-04-18T21:05:55.668 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.668 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.669 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:55.669 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622379+0000", 2024-04-18T21:05:55.669 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000175596 2024-04-18T21:05:55.669 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.669 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.669 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:55.669 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622707+0000", 2024-04-18T21:05:55.669 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00032784600000000002 2024-04-18T21:05:55.669 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.669 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.669 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:55.669 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629366+0000", 2024-04-18T21:05:55.669 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0066593279999999999 2024-04-18T21:05:55.669 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.669 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.669 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:55.670 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646813+0000", 2024-04-18T21:05:55.670 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017447059000000001 2024-04-18T21:05:55.670 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.670 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.670 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:55.670 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646946+0000", 2024-04-18T21:05:55.670 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013301200000000001 2024-04-18T21:05:55.670 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.670 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.670 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:55.670 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647025+0000", 2024-04-18T21:05:55.670 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8948000000000004e-05 2024-04-18T21:05:55.670 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:55.671 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:55.671 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:55.671 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.671 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.671 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:55.671 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:05:55.671 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 49.991633499000002, 2024-04-18T21:05:55.671 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.031512165000000002, 2024-04-18T21:05:55.671 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:55.671 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:55.671 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:55.671 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:55.671 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.671 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:55.671 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:05:55.671 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:55.671 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.672 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.672 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:55.672 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:05:55.672 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:55.672 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.672 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.672 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:55.672 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616330+0000", 2024-04-18T21:05:55.672 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.15e-06 2024-04-18T21:05:55.672 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.672 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.672 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:55.672 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616337+0000", 2024-04-18T21:05:55.672 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.1289999999999998e-06 2024-04-18T21:05:55.672 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.672 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.673 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:55.673 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616447+0000", 2024-04-18T21:05:55.673 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109561 2024-04-18T21:05:55.673 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.673 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.673 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:55.673 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616496+0000", 2024-04-18T21:05:55.673 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8591999999999998e-05 2024-04-18T21:05:55.673 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.673 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.673 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:55.673 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.623786+0000", 2024-04-18T21:05:55.673 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0072906799999999999 2024-04-18T21:05:55.673 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.674 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.674 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:55.674 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.623973+0000", 2024-04-18T21:05:55.674 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018717199999999999 2024-04-18T21:05:55.674 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.674 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.674 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:55.674 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624260+0000", 2024-04-18T21:05:55.674 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00028630600000000001 2024-04-18T21:05:55.674 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.674 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.674 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:55.674 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629381+0000", 2024-04-18T21:05:55.674 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0051211340000000003 2024-04-18T21:05:55.675 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.675 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.675 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:55.675 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647631+0000", 2024-04-18T21:05:55.675 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018249771000000001 2024-04-18T21:05:55.675 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.675 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.675 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:55.675 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647761+0000", 2024-04-18T21:05:55.675 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013037300000000001 2024-04-18T21:05:55.675 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.675 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.675 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:55.675 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647841+0000", 2024-04-18T21:05:55.675 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.0296999999999994e-05 2024-04-18T21:05:55.676 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:55.676 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:55.676 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:55.676 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.676 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.676 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:55.676 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:05:55.676 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 49.991428014999997, 2024-04-18T21:05:55.676 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043251955000000002, 2024-04-18T21:05:55.676 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:55.676 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:55.676 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:55.676 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:55.676 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.676 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:55.676 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:05:55.677 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:55.677 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.677 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.677 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:55.677 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:05:55.677 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:55.677 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.677 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.677 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:55.677 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616536+0000", 2024-04-18T21:05:55.677 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2869999999999999e-06 2024-04-18T21:05:55.677 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.677 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.677 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:55.677 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616572+0000", 2024-04-18T21:05:55.678 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.6261999999999999e-05 2024-04-18T21:05:55.678 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.678 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.678 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:55.678 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616593+0000", 2024-04-18T21:05:55.678 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1310000000000001e-05 2024-04-18T21:05:55.678 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.678 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.678 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:55.678 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616614+0000", 2024-04-18T21:05:55.678 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.0936000000000001e-05 2024-04-18T21:05:55.678 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.678 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.679 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:55.679 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629501+0000", 2024-04-18T21:05:55.679 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.012886819000000001 2024-04-18T21:05:55.679 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.679 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.679 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:55.679 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629696+0000", 2024-04-18T21:05:55.679 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019485499999999999 2024-04-18T21:05:55.679 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.679 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.679 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:55.679 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629940+0000", 2024-04-18T21:05:55.679 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00024386399999999999 2024-04-18T21:05:55.679 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.679 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.680 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:55.680 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640100+0000", 2024-04-18T21:05:55.680 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010159645 2024-04-18T21:05:55.680 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.680 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.680 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:55.680 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659516+0000", 2024-04-18T21:05:55.680 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019416563000000001 2024-04-18T21:05:55.680 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.680 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.680 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:55.680 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659684+0000", 2024-04-18T21:05:55.680 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016750900000000001 2024-04-18T21:05:55.681 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.681 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.681 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:55.681 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659787+0000", 2024-04-18T21:05:55.681 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000102905 2024-04-18T21:05:55.681 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:55.681 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:55.681 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:55.681 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.681 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.681 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:55.681 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:05:55.681 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 49.991322893000003, 2024-04-18T21:05:55.681 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043581898000000001, 2024-04-18T21:05:55.682 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:55.682 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:55.682 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:55.682 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:55.682 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.682 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:55.682 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:05:55.682 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:55.682 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.682 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.682 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:55.682 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:05:55.682 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:55.682 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.683 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.683 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:55.683 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616641+0000", 2024-04-18T21:05:55.683 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:05:55.683 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.683 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.683 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:55.683 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616648+0000", 2024-04-18T21:05:55.683 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3860000000000001e-06 2024-04-18T21:05:55.683 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.683 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.683 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:55.683 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616666+0000", 2024-04-18T21:05:55.683 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7583000000000001e-05 2024-04-18T21:05:55.684 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.684 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.684 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:55.684 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616679+0000", 2024-04-18T21:05:55.684 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3322999999999999e-05 2024-04-18T21:05:55.684 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.684 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.684 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:55.684 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630373+0000", 2024-04-18T21:05:55.684 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013694207999999999 2024-04-18T21:05:55.684 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.684 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.684 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:55.684 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630545+0000", 2024-04-18T21:05:55.685 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000171683 2024-04-18T21:05:55.685 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.685 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.685 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:55.685 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630728+0000", 2024-04-18T21:05:55.685 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000182599 2024-04-18T21:05:55.685 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.685 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.685 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:55.685 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640600+0000", 2024-04-18T21:05:55.685 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0098726119999999994 2024-04-18T21:05:55.685 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.685 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.685 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:55.686 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659927+0000", 2024-04-18T21:05:55.686 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019326724999999999 2024-04-18T21:05:55.686 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.686 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.686 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:55.686 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660112+0000", 2024-04-18T21:05:55.686 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000185203 2024-04-18T21:05:55.686 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.686 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.686 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:55.686 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660222+0000", 2024-04-18T21:05:55.686 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109343 2024-04-18T21:05:55.686 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:55.687 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:55.687 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:55.687 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.687 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.687 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:55.687 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:05:55.687 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 49.990457534999997, 2024-04-18T21:05:55.687 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043121310000000003, 2024-04-18T21:05:55.687 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:55.687 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:55.687 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:55.687 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:55.687 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.687 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:55.688 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:05:55.688 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:55.688 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.688 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.688 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:55.688 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:05:55.688 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:55.688 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.688 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.688 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:55.688 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617506+0000", 2024-04-18T21:05:55.688 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9999999999999995e-07 2024-04-18T21:05:55.688 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.688 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.689 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:55.689 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617513+0000", 2024-04-18T21:05:55.689 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.9700000000000002e-06 2024-04-18T21:05:55.689 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.689 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.689 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:55.689 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617531+0000", 2024-04-18T21:05:55.689 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8105999999999999e-05 2024-04-18T21:05:55.689 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.689 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.689 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:55.689 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617545+0000", 2024-04-18T21:05:55.690 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3703000000000001e-05 2024-04-18T21:05:55.690 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.690 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.690 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:55.690 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632129+0000", 2024-04-18T21:05:55.690 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.014584135999999999 2024-04-18T21:05:55.690 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.690 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.690 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:55.690 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632361+0000", 2024-04-18T21:05:55.690 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023171800000000001 2024-04-18T21:05:55.690 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.690 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.690 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:55.691 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632804+0000", 2024-04-18T21:05:55.691 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000443549 2024-04-18T21:05:55.691 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.691 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.691 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:55.691 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646340+0000", 2024-04-18T21:05:55.691 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013535902000000001 2024-04-18T21:05:55.691 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.691 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.691 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:55.691 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660363+0000", 2024-04-18T21:05:55.691 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01402318 2024-04-18T21:05:55.691 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.691 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.691 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:55.692 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660523+0000", 2024-04-18T21:05:55.692 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00015989899999999999 2024-04-18T21:05:55.692 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.692 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.692 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:55.692 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660626+0000", 2024-04-18T21:05:55.692 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010314699999999999 2024-04-18T21:05:55.692 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:55.692 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:55.692 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:55.692 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.692 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.692 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:55.692 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:05:55.692 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 49.990317842000003, 2024-04-18T21:05:55.692 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024927483, 2024-04-18T21:05:55.692 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:55.693 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:55.693 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:55.693 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:55.693 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.693 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:55.693 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:05:55.693 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:55.693 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.693 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.693 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:55.693 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:05:55.693 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:55.693 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.693 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.694 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:55.694 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617646+0000", 2024-04-18T21:05:55.694 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3030000000000001e-06 2024-04-18T21:05:55.694 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.694 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.694 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:55.694 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617653+0000", 2024-04-18T21:05:55.694 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7530000000000004e-06 2024-04-18T21:05:55.694 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.694 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.694 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:55.694 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617673+0000", 2024-04-18T21:05:55.694 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9967e-05 2024-04-18T21:05:55.694 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.695 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.695 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:55.695 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617688+0000", 2024-04-18T21:05:55.695 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5153e-05 2024-04-18T21:05:55.695 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.695 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.695 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:55.695 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619244+0000", 2024-04-18T21:05:55.695 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001555531 2024-04-18T21:05:55.695 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.695 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.695 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:55.695 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619361+0000", 2024-04-18T21:05:55.695 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011784400000000001 2024-04-18T21:05:55.695 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.695 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.696 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:55.696 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619604+0000", 2024-04-18T21:05:55.696 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000243007 2024-04-18T21:05:55.696 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.696 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.696 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:55.696 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.625480+0000", 2024-04-18T21:05:55.696 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0058759349999999997 2024-04-18T21:05:55.696 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.696 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.696 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:55.696 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642342+0000", 2024-04-18T21:05:55.697 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016861373999999998 2024-04-18T21:05:55.697 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.697 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.697 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:55.697 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642484+0000", 2024-04-18T21:05:55.697 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000142423 2024-04-18T21:05:55.697 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.697 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.697 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:55.697 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642572+0000", 2024-04-18T21:05:55.697 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8193000000000001e-05 2024-04-18T21:05:55.697 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:55.697 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:55.697 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:55.697 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.697 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.698 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:55.698 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:05:55.698 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 49.990036339, 2024-04-18T21:05:55.698 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024956974999999999, 2024-04-18T21:05:55.698 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:55.698 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:55.698 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:55.698 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:55.698 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.698 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:55.698 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:05:55.698 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:55.698 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.698 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.699 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:55.699 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:05:55.699 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:55.699 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.699 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.699 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:55.699 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617928+0000", 2024-04-18T21:05:55.699 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5430000000000001e-06 2024-04-18T21:05:55.699 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.699 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.699 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:55.699 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617937+0000", 2024-04-18T21:05:55.699 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6629999999999999e-06 2024-04-18T21:05:55.699 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.700 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.700 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:55.700 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617955+0000", 2024-04-18T21:05:55.700 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8749999999999998e-05 2024-04-18T21:05:55.700 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.700 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.700 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:55.700 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617971+0000", 2024-04-18T21:05:55.700 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.605e-05 2024-04-18T21:05:55.700 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.700 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.700 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:55.700 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621019+0000", 2024-04-18T21:05:55.701 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0030472369999999999 2024-04-18T21:05:55.701 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.701 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.701 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:55.701 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621249+0000", 2024-04-18T21:05:55.701 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000230075 2024-04-18T21:05:55.701 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.701 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.701 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:55.701 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621450+0000", 2024-04-18T21:05:55.701 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020166499999999999 2024-04-18T21:05:55.701 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.701 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.701 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:55.701 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.626233+0000", 2024-04-18T21:05:55.702 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047827390000000003 2024-04-18T21:05:55.702 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.702 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.702 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:55.702 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642693+0000", 2024-04-18T21:05:55.702 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01645961 2024-04-18T21:05:55.702 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.702 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.702 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:55.702 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642798+0000", 2024-04-18T21:05:55.702 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010559499999999999 2024-04-18T21:05:55.702 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.702 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.703 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:55.703 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642883+0000", 2024-04-18T21:05:55.703 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5048000000000003e-05 2024-04-18T21:05:55.703 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:55.703 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:55.703 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:55.703 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.703 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.703 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:55.703 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:05:55.703 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 49.988340710999999, 2024-04-18T21:05:55.703 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024086478000000001, 2024-04-18T21:05:55.703 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:55.703 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:55.704 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:55.704 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:55.704 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.704 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:55.704 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:05:55.704 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:55.704 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.704 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.704 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:55.704 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:05:55.704 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:55.704 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.704 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.704 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:55.704 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619624+0000", 2024-04-18T21:05:55.705 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.75e-06 2024-04-18T21:05:55.705 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.705 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.705 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:55.705 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619637+0000", 2024-04-18T21:05:55.705 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3540000000000001e-05 2024-04-18T21:05:55.705 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.705 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.705 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:55.705 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619666+0000", 2024-04-18T21:05:55.705 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8685999999999999e-05 2024-04-18T21:05:55.705 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.705 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.706 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:55.706 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619685+0000", 2024-04-18T21:05:55.706 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8681999999999998e-05 2024-04-18T21:05:55.706 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.706 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.706 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:55.706 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622275+0000", 2024-04-18T21:05:55.706 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0025899260000000002 2024-04-18T21:05:55.706 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.706 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.706 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:55.706 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622572+0000", 2024-04-18T21:05:55.706 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00029722 2024-04-18T21:05:55.706 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.706 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.707 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:55.707 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622752+0000", 2024-04-18T21:05:55.707 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018065900000000001 2024-04-18T21:05:55.707 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.707 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.707 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:55.707 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.626326+0000", 2024-04-18T21:05:55.707 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035737310000000001 2024-04-18T21:05:55.707 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.707 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.707 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:55.707 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643565+0000", 2024-04-18T21:05:55.707 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017238430999999999 2024-04-18T21:05:55.707 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.707 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.707 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:55.708 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643646+0000", 2024-04-18T21:05:55.708 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.1481000000000001e-05 2024-04-18T21:05:55.708 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.708 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.708 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:55.708 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643708+0000", 2024-04-18T21:05:55.708 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.2372000000000005e-05 2024-04-18T21:05:55.708 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:55.708 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:55.708 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:55.708 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.708 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.708 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:55.708 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:05:55.708 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 49.988174557999997, 2024-04-18T21:05:55.708 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026822450000000001, 2024-04-18T21:05:55.709 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:55.709 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:55.709 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:55.709 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:55.709 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.709 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:55.709 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:05:55.709 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:55.709 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.709 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.709 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:55.709 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:05:55.709 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:55.709 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.710 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.710 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:55.710 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619789+0000", 2024-04-18T21:05:55.710 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:05:55.710 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.710 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.710 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:55.710 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619797+0000", 2024-04-18T21:05:55.710 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.6899999999999992e-06 2024-04-18T21:05:55.710 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.710 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.710 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:55.710 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619816+0000", 2024-04-18T21:05:55.710 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9352999999999999e-05 2024-04-18T21:05:55.711 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.711 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.711 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:55.711 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619832+0000", 2024-04-18T21:05:55.711 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6013000000000001e-05 2024-04-18T21:05:55.711 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.711 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.711 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:55.711 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620528+0000", 2024-04-18T21:05:55.711 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00069565600000000001 2024-04-18T21:05:55.711 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.711 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.711 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:55.711 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620735+0000", 2024-04-18T21:05:55.711 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000207025 2024-04-18T21:05:55.711 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.712 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.712 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:55.712 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620912+0000", 2024-04-18T21:05:55.712 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017748199999999999 2024-04-18T21:05:55.712 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.712 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.712 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:05:55.712 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.625605+0000", 2024-04-18T21:05:55.712 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0046924439999999996 2024-04-18T21:05:55.712 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.712 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.712 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:55.712 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646349+0000", 2024-04-18T21:05:55.712 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.020744318000000001 2024-04-18T21:05:55.713 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.713 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.713 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:05:55.713 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646483+0000", 2024-04-18T21:05:55.713 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013428999999999999 2024-04-18T21:05:55.713 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.713 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.713 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:55.713 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646611+0000", 2024-04-18T21:05:55.713 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012710299999999999 2024-04-18T21:05:55.713 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:55.713 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:55.713 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:55.713 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.713 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.713 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:55.714 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:05:55.714 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 49.987504125000001, 2024-04-18T21:05:55.714 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023516516000000001, 2024-04-18T21:05:55.714 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:55.714 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:55.714 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:05:55.714 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:55.714 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.714 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:55.714 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:05:55.714 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:55.714 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.714 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.714 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:55.714 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:05:55.714 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:55.715 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.715 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.715 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:55.715 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620460+0000", 2024-04-18T21:05:55.715 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.787e-06 2024-04-18T21:05:55.715 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.715 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.715 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:55.715 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620470+0000", 2024-04-18T21:05:55.715 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.2560000000000008e-06 2024-04-18T21:05:55.715 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.715 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.715 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:05:55.715 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620496+0000", 2024-04-18T21:05:55.715 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.6205999999999999e-05 2024-04-18T21:05:55.716 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.716 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.716 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:05:55.716 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620517+0000", 2024-04-18T21:05:55.716 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1223e-05 2024-04-18T21:05:55.716 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.716 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.716 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:05:55.716 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624060+0000", 2024-04-18T21:05:55.716 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035434160000000002 2024-04-18T21:05:55.716 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.716 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.716 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:05:55.716 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624390+0000", 2024-04-18T21:05:55.716 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00033000500000000002 2024-04-18T21:05:55.717 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:55.717 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:55.717 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:05:55.717 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643975+0000", 2024-04-18T21:05:55.717 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019584622999999999 2024-04-18T21:05:55.717 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:55.717 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:55.717 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:55.717 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:05:55.717 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:05:55.717 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:05:55.719 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:05:55.719 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:55.719+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:55.819 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:55.819+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:55.850 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:05:55.850 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [], 2024-04-18T21:05:55.850 INFO:teuthology.orchestra.run.smithi150.stdout: "num_ops": 0 2024-04-18T21:05:55.851 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:05:55.866 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:05:55.920 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:55.919+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:55.988 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:05:55.988 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [], 2024-04-18T21:05:55.988 INFO:teuthology.orchestra.run.smithi150.stdout: "complaint_time": 30, 2024-04-18T21:05:55.988 INFO:teuthology.orchestra.run.smithi150.stdout: "num_blocked_ops": 0 2024-04-18T21:05:55.988 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:05:56.002 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:05:56.021 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:56.023+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:56.122 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:56.123+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:56.125 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:05:56.125 INFO:teuthology.orchestra.run.smithi150.stdout: "size": 20, 2024-04-18T21:05:56.125 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 600, 2024-04-18T21:05:56.125 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [ 2024-04-18T21:05:56.125 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.125 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-18T21:05:56.125 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:05:56.125 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 61.322151007999999, 2024-04-18T21:05:56.126 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0093051590000000003, 2024-04-18T21:05:56.126 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:56.126 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:56.126 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:56.126 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:56.126 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.126 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:56.126 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:05:56.126 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:56.126 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.126 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.126 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:56.126 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:05:56.127 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:56.127 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.127 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.127 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:56.127 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804851+0000", 2024-04-18T21:05:56.127 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7039999999999999e-06 2024-04-18T21:05:56.127 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.127 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.127 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:56.127 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804864+0000", 2024-04-18T21:05:56.127 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.276e-05 2024-04-18T21:05:56.127 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.127 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.127 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:56.127 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804895+0000", 2024-04-18T21:05:56.128 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.1204999999999997e-05 2024-04-18T21:05:56.128 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.128 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.128 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:56.128 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804908+0000", 2024-04-18T21:05:56.128 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3317e-05 2024-04-18T21:05:56.128 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.128 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.128 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:56.128 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805131+0000", 2024-04-18T21:05:56.128 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00022246700000000001 2024-04-18T21:05:56.128 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.128 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.128 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:56.129 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805171+0000", 2024-04-18T21:05:56.129 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.0164999999999999e-05 2024-04-18T21:05:56.129 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.129 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.129 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:56.129 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814086+0000", 2024-04-18T21:05:56.129 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0089155329999999998 2024-04-18T21:05:56.129 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.129 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.129 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:56.129 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814154+0000", 2024-04-18T21:05:56.129 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.8008000000000003e-05 2024-04-18T21:05:56.129 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:56.129 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:56.129 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:56.130 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.130 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.130 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-18T21:05:56.130 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:05:56.130 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 61.321385814999999, 2024-04-18T21:05:56.130 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0086469770000000001, 2024-04-18T21:05:56.130 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:56.130 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:56.130 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:56.130 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:56.130 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.130 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:56.130 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:05:56.131 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:56.131 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.131 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.131 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:56.131 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:05:56.131 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:56.131 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.131 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.131 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:56.131 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805616+0000", 2024-04-18T21:05:56.131 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7799999999999999e-06 2024-04-18T21:05:56.131 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.131 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.131 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:56.132 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805707+0000", 2024-04-18T21:05:56.132 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0917999999999999e-05 2024-04-18T21:05:56.132 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.132 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.132 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:56.132 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805739+0000", 2024-04-18T21:05:56.132 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.2512000000000003e-05 2024-04-18T21:05:56.132 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.132 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.132 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:56.132 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805763+0000", 2024-04-18T21:05:56.132 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3266000000000001e-05 2024-04-18T21:05:56.132 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.132 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.132 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:56.133 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.806024+0000", 2024-04-18T21:05:56.133 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000261716 2024-04-18T21:05:56.133 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.133 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.133 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:56.133 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.806073+0000", 2024-04-18T21:05:56.133 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.8844999999999997e-05 2024-04-18T21:05:56.133 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.133 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.133 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:56.133 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814162+0000", 2024-04-18T21:05:56.133 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0080882860000000001 2024-04-18T21:05:56.133 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.133 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.133 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:56.134 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814261+0000", 2024-04-18T21:05:56.134 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.9654000000000005e-05 2024-04-18T21:05:56.134 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:56.134 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:56.134 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:56.134 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.134 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.134 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'64)", 2024-04-18T21:05:56.134 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:05:56.134 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 61.319614770999998, 2024-04-18T21:05:56.134 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0089721509999999994, 2024-04-18T21:05:56.134 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:56.134 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:56.134 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:56.135 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:56.135 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.135 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:56.135 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:05:56.135 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:56.135 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.135 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.135 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:56.135 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:05:56.135 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:56.135 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.135 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.135 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:56.135 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807387+0000", 2024-04-18T21:05:56.135 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.0329999999999998e-06 2024-04-18T21:05:56.136 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.136 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.136 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:56.136 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807443+0000", 2024-04-18T21:05:56.136 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.5376e-05 2024-04-18T21:05:56.136 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.136 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.136 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:56.136 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807467+0000", 2024-04-18T21:05:56.136 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.4621999999999999e-05 2024-04-18T21:05:56.136 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.136 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.136 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:56.136 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807482+0000", 2024-04-18T21:05:56.136 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.436e-05 2024-04-18T21:05:56.137 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.137 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.137 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:56.137 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.809243+0000", 2024-04-18T21:05:56.137 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001761725 2024-04-18T21:05:56.137 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.137 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.137 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:56.137 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.809295+0000", 2024-04-18T21:05:56.137 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.1445e-05 2024-04-18T21:05:56.137 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.137 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.137 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:56.137 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.816293+0000", 2024-04-18T21:05:56.137 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0069981749999999997 2024-04-18T21:05:56.138 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.138 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.138 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:56.138 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.816357+0000", 2024-04-18T21:05:56.138 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.4414999999999999e-05 2024-04-18T21:05:56.138 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:56.138 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:56.138 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:56.138 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.138 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.138 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:56.138 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:05:56.138 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 50.511705401, 2024-04-18T21:05:56.138 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.040843365, 2024-04-18T21:05:56.139 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:56.139 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:56.139 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:56.139 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:56.139 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.139 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:56.139 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:05:56.139 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:56.139 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.139 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.139 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:56.139 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:05:56.139 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:56.139 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.139 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.140 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:56.140 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615297+0000", 2024-04-18T21:05:56.140 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2800000000000002e-06 2024-04-18T21:05:56.140 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.140 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.140 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:56.140 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615308+0000", 2024-04-18T21:05:56.140 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0813e-05 2024-04-18T21:05:56.140 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.140 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.140 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:56.140 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615330+0000", 2024-04-18T21:05:56.140 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2370000000000001e-05 2024-04-18T21:05:56.140 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.141 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.141 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:56.141 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615346+0000", 2024-04-18T21:05:56.141 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6200000000000001e-05 2024-04-18T21:05:56.141 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.141 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.141 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:56.141 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615470+0000", 2024-04-18T21:05:56.141 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012385799999999999 2024-04-18T21:05:56.141 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.141 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.141 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:05:56.141 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615488+0000", 2024-04-18T21:05:56.141 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7923000000000001e-05 2024-04-18T21:05:56.141 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.142 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.142 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:56.142 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.630993+0000", 2024-04-18T21:05:56.142 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.01550532 2024-04-18T21:05:56.142 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.142 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.142 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:56.142 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631165+0000", 2024-04-18T21:05:56.142 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000171588 2024-04-18T21:05:56.142 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.142 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.142 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:56.142 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631320+0000", 2024-04-18T21:05:56.142 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000155162 2024-04-18T21:05:56.143 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.143 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.143 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:56.143 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635157+0000", 2024-04-18T21:05:56.143 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0038370790000000002 2024-04-18T21:05:56.143 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.143 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.143 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:56.143 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.655904+0000", 2024-04-18T21:05:56.143 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.020746483999999999 2024-04-18T21:05:56.143 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.143 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.143 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:56.143 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656032+0000", 2024-04-18T21:05:56.143 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012864199999999999 2024-04-18T21:05:56.144 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.144 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.144 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:56.144 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656138+0000", 2024-04-18T21:05:56.144 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000105646 2024-04-18T21:05:56.144 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:56.144 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:56.144 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:56.144 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.144 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.144 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:56.144 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:05:56.144 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 50.511613228999998, 2024-04-18T21:05:56.144 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.041266444999999999, 2024-04-18T21:05:56.145 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:56.145 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:56.145 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:56.145 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:56.145 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.145 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:56.145 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:05:56.145 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:56.145 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.145 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.145 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:56.145 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:05:56.145 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:56.145 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.145 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.145 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:56.146 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615388+0000", 2024-04-18T21:05:56.146 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:05:56.146 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.146 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.146 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:56.146 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:05:56.146 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.7299999999999994e-06 2024-04-18T21:05:56.146 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.146 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.146 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:56.146 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615415+0000", 2024-04-18T21:05:56.146 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7807000000000001e-05 2024-04-18T21:05:56.146 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.146 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.147 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:56.147 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615431+0000", 2024-04-18T21:05:56.147 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6127e-05 2024-04-18T21:05:56.147 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.147 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.147 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:56.147 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615621+0000", 2024-04-18T21:05:56.147 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000189781 2024-04-18T21:05:56.147 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.147 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.147 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:56.147 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615634+0000", 2024-04-18T21:05:56.147 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3383e-05 2024-04-18T21:05:56.147 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.147 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.147 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:56.148 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631703+0000", 2024-04-18T21:05:56.148 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016068737 2024-04-18T21:05:56.148 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.148 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.148 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:56.148 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631809+0000", 2024-04-18T21:05:56.148 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000106823 2024-04-18T21:05:56.148 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.148 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.148 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:56.148 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631988+0000", 2024-04-18T21:05:56.148 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000179008 2024-04-18T21:05:56.148 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.148 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.148 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:56.149 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635172+0000", 2024-04-18T21:05:56.149 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.003183029 2024-04-18T21:05:56.149 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.149 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.149 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:56.149 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656392+0000", 2024-04-18T21:05:56.149 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.021220638999999999 2024-04-18T21:05:56.149 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.149 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.149 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:56.149 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656533+0000", 2024-04-18T21:05:56.149 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014126500000000001 2024-04-18T21:05:56.149 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.149 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.149 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:56.150 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656653+0000", 2024-04-18T21:05:56.150 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000119883 2024-04-18T21:05:56.150 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:56.150 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:56.150 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:56.150 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.150 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.150 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:56.150 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:05:56.150 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 50.511525806000002, 2024-04-18T21:05:56.150 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.042492302000000003, 2024-04-18T21:05:56.150 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:56.150 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:56.150 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:56.151 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:56.151 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.151 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:56.151 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:05:56.151 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:56.151 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.151 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.151 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:56.151 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:05:56.151 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:56.151 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.151 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.151 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:56.151 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615475+0000", 2024-04-18T21:05:56.152 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.17e-06 2024-04-18T21:05:56.152 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.152 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.152 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:56.152 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615528+0000", 2024-04-18T21:05:56.152 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.2159e-05 2024-04-18T21:05:56.152 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.152 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.152 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:56.152 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615542+0000", 2024-04-18T21:05:56.152 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4197e-05 2024-04-18T21:05:56.152 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.152 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.152 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:56.153 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615559+0000", 2024-04-18T21:05:56.153 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.749e-05 2024-04-18T21:05:56.153 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.153 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.153 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:56.153 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615685+0000", 2024-04-18T21:05:56.153 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012617499999999999 2024-04-18T21:05:56.153 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.153 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.153 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:05:56.153 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:05:56.153 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4749999999999999e-05 2024-04-18T21:05:56.153 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.153 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.153 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:56.154 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632332+0000", 2024-04-18T21:05:56.154 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016631988 2024-04-18T21:05:56.154 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.154 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.154 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:56.154 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632477+0000", 2024-04-18T21:05:56.154 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014437200000000001 2024-04-18T21:05:56.154 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.154 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.154 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:56.154 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632620+0000", 2024-04-18T21:05:56.154 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000143566 2024-04-18T21:05:56.154 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.155 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.155 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:56.155 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635185+0000", 2024-04-18T21:05:56.155 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0025644209999999999 2024-04-18T21:05:56.155 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.155 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.155 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:56.155 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657803+0000", 2024-04-18T21:05:56.155 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.022618743 2024-04-18T21:05:56.155 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.155 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.155 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:56.155 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657890+0000", 2024-04-18T21:05:56.155 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.6688999999999996e-05 2024-04-18T21:05:56.155 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.155 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.156 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:56.156 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657967+0000", 2024-04-18T21:05:56.156 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.6582000000000006e-05 2024-04-18T21:05:56.156 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:56.156 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:56.156 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:56.156 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.156 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.156 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:56.156 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:05:56.156 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 50.511394994, 2024-04-18T21:05:56.156 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.043603435000000003, 2024-04-18T21:05:56.156 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:56.156 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:56.157 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:56.157 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:56.157 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.157 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:56.157 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:05:56.157 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:56.157 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.157 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.157 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:56.157 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:05:56.157 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:56.157 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.157 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.157 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:56.158 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615607+0000", 2024-04-18T21:05:56.158 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4300000000000001e-06 2024-04-18T21:05:56.158 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.158 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.158 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:56.158 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615614+0000", 2024-04-18T21:05:56.158 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.4100000000000002e-06 2024-04-18T21:05:56.158 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.158 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.158 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:56.158 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615632+0000", 2024-04-18T21:05:56.158 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7863000000000002e-05 2024-04-18T21:05:56.158 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.158 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.159 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:56.159 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615647+0000", 2024-04-18T21:05:56.159 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5187e-05 2024-04-18T21:05:56.159 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.159 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.159 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:56.159 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615765+0000", 2024-04-18T21:05:56.159 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000117955 2024-04-18T21:05:56.159 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.159 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.159 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:56.159 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615781+0000", 2024-04-18T21:05:56.159 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6123000000000001e-05 2024-04-18T21:05:56.159 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.159 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.160 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:56.160 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633055+0000", 2024-04-18T21:05:56.160 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.017273909 2024-04-18T21:05:56.160 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.160 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.160 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:56.160 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633254+0000", 2024-04-18T21:05:56.160 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00019903799999999999 2024-04-18T21:05:56.160 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.160 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.160 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:56.160 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633624+0000", 2024-04-18T21:05:56.160 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000369656 2024-04-18T21:05:56.161 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.161 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.161 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:56.161 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635595+0000", 2024-04-18T21:05:56.161 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001971287 2024-04-18T21:05:56.161 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.161 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.161 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:56.161 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659026+0000", 2024-04-18T21:05:56.161 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.023431495 2024-04-18T21:05:56.161 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.161 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.161 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:56.161 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659117+0000", 2024-04-18T21:05:56.161 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0885999999999997e-05 2024-04-18T21:05:56.162 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.162 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.162 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:56.162 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659209+0000", 2024-04-18T21:05:56.162 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.1195999999999999e-05 2024-04-18T21:05:56.162 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:56.162 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:56.162 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:56.162 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.162 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.162 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:56.162 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:56.162 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 50.511329764999999, 2024-04-18T21:05:56.162 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.03492514, 2024-04-18T21:05:56.163 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:56.163 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:56.163 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:56.163 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:56.163 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.163 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:56.163 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:56.163 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:56.163 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.163 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.163 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:56.163 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:56.163 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:56.163 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.164 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.164 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:56.164 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:05:56.164 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.407e-06 2024-04-18T21:05:56.164 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.164 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.164 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:56.164 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615679+0000", 2024-04-18T21:05:56.164 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.2130000000000002e-06 2024-04-18T21:05:56.164 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.164 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.164 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:56.164 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615701+0000", 2024-04-18T21:05:56.164 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2316000000000001e-05 2024-04-18T21:05:56.165 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.165 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.165 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:56.165 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615717+0000", 2024-04-18T21:05:56.165 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6197000000000001e-05 2024-04-18T21:05:56.165 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.165 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.165 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:56.165 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615828+0000", 2024-04-18T21:05:56.165 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000110899 2024-04-18T21:05:56.165 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.165 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.165 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:05:56.165 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615840+0000", 2024-04-18T21:05:56.165 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.1423000000000001e-05 2024-04-18T21:05:56.166 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.166 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.166 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:56.166 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628046+0000", 2024-04-18T21:05:56.166 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.012206295000000001 2024-04-18T21:05:56.166 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.166 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.166 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:56.166 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628323+0000", 2024-04-18T21:05:56.166 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00027658700000000001 2024-04-18T21:05:56.166 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.166 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.166 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:56.167 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628599+0000", 2024-04-18T21:05:56.167 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00027676699999999997 2024-04-18T21:05:56.167 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.167 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.167 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:56.167 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634869+0000", 2024-04-18T21:05:56.167 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.006269536 2024-04-18T21:05:56.167 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.167 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.167 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:56.167 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650333+0000", 2024-04-18T21:05:56.167 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.015463645999999999 2024-04-18T21:05:56.167 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.167 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.167 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:56.168 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650474+0000", 2024-04-18T21:05:56.168 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014091799999999999 2024-04-18T21:05:56.168 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.168 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.168 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:56.168 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650595+0000", 2024-04-18T21:05:56.168 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012193600000000001 2024-04-18T21:05:56.168 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:56.168 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:56.168 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:56.168 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.168 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.168 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:56.168 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:05:56.168 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 50.511244656000002, 2024-04-18T21:05:56.169 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.040588320999999997, 2024-04-18T21:05:56.169 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:56.169 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:56.169 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:56.169 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:56.169 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.169 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:56.169 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:05:56.169 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:56.169 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.169 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.169 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:56.169 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:05:56.169 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:56.170 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.170 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.170 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:56.170 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615757+0000", 2024-04-18T21:05:56.170 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2270000000000001e-06 2024-04-18T21:05:56.170 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.170 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.170 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:56.170 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615765+0000", 2024-04-18T21:05:56.170 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.9400000000000002e-06 2024-04-18T21:05:56.170 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.170 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.170 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:56.170 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615785+0000", 2024-04-18T21:05:56.171 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.0749000000000001e-05 2024-04-18T21:05:56.171 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.171 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.171 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:56.171 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615804+0000", 2024-04-18T21:05:56.171 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.8774e-05 2024-04-18T21:05:56.171 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.171 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.171 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:56.171 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615888+0000", 2024-04-18T21:05:56.171 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.4111999999999997e-05 2024-04-18T21:05:56.171 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.171 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.171 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:56.172 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615895+0000", 2024-04-18T21:05:56.172 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.0469999999999996e-06 2024-04-18T21:05:56.172 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.172 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.172 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:56.172 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629280+0000", 2024-04-18T21:05:56.172 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.013384416 2024-04-18T21:05:56.172 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.172 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.172 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:56.172 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629488+0000", 2024-04-18T21:05:56.172 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00020852800000000001 2024-04-18T21:05:56.172 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.172 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.172 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:56.173 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629869+0000", 2024-04-18T21:05:56.173 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00038042300000000001 2024-04-18T21:05:56.173 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.173 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.173 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:56.173 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635041+0000", 2024-04-18T21:05:56.173 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.005172383 2024-04-18T21:05:56.173 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.173 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.173 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:56.173 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656125+0000", 2024-04-18T21:05:56.173 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.021084025999999999 2024-04-18T21:05:56.173 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.174 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.174 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:56.174 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656240+0000", 2024-04-18T21:05:56.174 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000115352 2024-04-18T21:05:56.174 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.174 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.174 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:56.174 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656344+0000", 2024-04-18T21:05:56.174 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00010334400000000001 2024-04-18T21:05:56.174 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:56.174 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:56.174 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:56.174 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.174 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.175 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:56.175 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:05:56.175 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 50.511177336000003, 2024-04-18T21:05:56.175 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.043549577999999999, 2024-04-18T21:05:56.175 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:56.175 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:56.175 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:56.175 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:56.175 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.175 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:56.175 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:05:56.175 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:56.175 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.175 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.175 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:56.176 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:05:56.176 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:56.176 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.176 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.176 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:56.176 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:05:56.176 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.5000000000000002e-07 2024-04-18T21:05:56.176 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.176 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.176 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:56.176 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615828+0000", 2024-04-18T21:05:56.176 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.2359999999999998e-06 2024-04-18T21:05:56.176 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.177 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.177 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:56.177 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615838+0000", 2024-04-18T21:05:56.177 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0087e-05 2024-04-18T21:05:56.177 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.177 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.177 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:56.177 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615846+0000", 2024-04-18T21:05:56.177 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.67e-06 2024-04-18T21:05:56.177 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.177 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.177 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:56.177 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615963+0000", 2024-04-18T21:05:56.177 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00011630500000000001 2024-04-18T21:05:56.177 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.178 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.178 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:56.178 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615979+0000", 2024-04-18T21:05:56.178 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.613e-05 2024-04-18T21:05:56.178 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.178 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.178 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:56.178 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632392+0000", 2024-04-18T21:05:56.178 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016413317 2024-04-18T21:05:56.178 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.178 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.178 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:56.178 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632568+0000", 2024-04-18T21:05:56.178 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00017539500000000001 2024-04-18T21:05:56.179 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.179 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.179 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:56.179 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632748+0000", 2024-04-18T21:05:56.179 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00017991799999999999 2024-04-18T21:05:56.179 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.179 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.179 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:05:56.179 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635542+0000", 2024-04-18T21:05:56.179 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00279481 2024-04-18T21:05:56.179 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.179 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.179 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:56.179 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659232+0000", 2024-04-18T21:05:56.180 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.023689212000000001 2024-04-18T21:05:56.180 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.180 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.180 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:56.180 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659314+0000", 2024-04-18T21:05:56.180 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.2528999999999995e-05 2024-04-18T21:05:56.180 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.180 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.180 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:56.180 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659372+0000", 2024-04-18T21:05:56.180 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.8218999999999999e-05 2024-04-18T21:05:56.180 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:56.180 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:56.180 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:56.181 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.181 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.181 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:56.181 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:05:56.181 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 50.511115904, 2024-04-18T21:05:56.181 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.039335347, 2024-04-18T21:05:56.181 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:56.181 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:56.181 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "started", 2024-04-18T21:05:56.181 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:56.181 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.181 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:56.181 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:05:56.181 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:56.182 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.182 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.182 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:56.182 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:05:56.182 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:56.182 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.182 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.182 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:56.182 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615885+0000", 2024-04-18T21:05:56.182 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2699999999999999e-06 2024-04-18T21:05:56.182 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.182 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.182 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:56.182 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615892+0000", 2024-04-18T21:05:56.183 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.6499999999999999e-06 2024-04-18T21:05:56.183 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.183 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.183 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:56.183 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615906+0000", 2024-04-18T21:05:56.183 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.393e-05 2024-04-18T21:05:56.183 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.183 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.183 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:56.183 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615919+0000", 2024-04-18T21:05:56.183 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2860000000000001e-05 2024-04-18T21:05:56.183 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.183 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.183 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:56.184 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616027+0000", 2024-04-18T21:05:56.184 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000107852 2024-04-18T21:05:56.184 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.184 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.184 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:05:56.184 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616037+0000", 2024-04-18T21:05:56.184 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:05:56.184 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.184 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.184 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:56.184 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622719+0000", 2024-04-18T21:05:56.184 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0066817220000000002 2024-04-18T21:05:56.184 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.184 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.184 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:56.185 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623006+0000", 2024-04-18T21:05:56.185 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00028783699999999999 2024-04-18T21:05:56.185 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.185 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.185 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:56.185 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.655220+0000", 2024-04-18T21:05:56.185 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.032213036 2024-04-18T21:05:56.185 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:56.185 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:56.185 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:56.185 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.185 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.185 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:56.185 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:56.186 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 50.511060231000002, 2024-04-18T21:05:56.186 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.032845253999999997, 2024-04-18T21:05:56.186 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:56.186 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:56.186 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "started", 2024-04-18T21:05:56.186 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:56.186 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.186 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:56.186 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:56.186 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:56.186 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.186 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.186 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:56.186 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:56.187 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:56.187 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.187 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.187 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:56.187 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615942+0000", 2024-04-18T21:05:56.187 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.717e-06 2024-04-18T21:05:56.187 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.187 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.187 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:56.187 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615946+0000", 2024-04-18T21:05:56.187 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.6e-06 2024-04-18T21:05:56.187 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.187 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.187 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:56.188 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615960+0000", 2024-04-18T21:05:56.188 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:05:56.188 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.188 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.188 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:56.188 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615968+0000", 2024-04-18T21:05:56.188 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.9070000000000007e-06 2024-04-18T21:05:56.188 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.188 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.188 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:56.188 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616100+0000", 2024-04-18T21:05:56.188 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000132402 2024-04-18T21:05:56.188 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.188 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.188 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:05:56.189 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616117+0000", 2024-04-18T21:05:56.189 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6653000000000001e-05 2024-04-18T21:05:56.189 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.189 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.189 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:56.189 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621566+0000", 2024-04-18T21:05:56.189 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0054497740000000001 2024-04-18T21:05:56.189 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.189 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.189 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:56.189 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622801+0000", 2024-04-18T21:05:56.189 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0012345710000000001 2024-04-18T21:05:56.189 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.190 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.190 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:56.190 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648785+0000", 2024-04-18T21:05:56.190 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.025984104000000001 2024-04-18T21:05:56.190 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:56.190 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:56.190 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:56.190 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.190 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.190 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:56.190 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:05:56.190 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 50.505208881000001, 2024-04-18T21:05:56.190 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.011561350999999999, 2024-04-18T21:05:56.190 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:56.191 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:56.191 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:56.191 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:56.191 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.191 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:56.191 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:05:56.191 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:56.191 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.191 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.191 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:56.191 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:05:56.191 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:56.191 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.191 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.192 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:56.192 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621792+0000", 2024-04-18T21:05:56.192 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.4000000000000001e-07 2024-04-18T21:05:56.192 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.192 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.192 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:56.192 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:05:56.192 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.1050000000000002e-05 2024-04-18T21:05:56.192 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.192 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.192 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:56.192 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622608+0000", 2024-04-18T21:05:56.192 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00077505900000000003 2024-04-18T21:05:56.193 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.193 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.193 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:56.193 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623879+0000", 2024-04-18T21:05:56.193 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0012705839999999999 2024-04-18T21:05:56.193 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.193 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.193 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:56.193 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624010+0000", 2024-04-18T21:05:56.193 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00013176900000000001 2024-04-18T21:05:56.193 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.193 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.193 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:56.193 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624058+0000", 2024-04-18T21:05:56.194 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.7299000000000002e-05 2024-04-18T21:05:56.194 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.194 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.194 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:56.194 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633262+0000", 2024-04-18T21:05:56.194 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0092048770000000002 2024-04-18T21:05:56.194 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.194 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.194 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:56.194 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633353+0000", 2024-04-18T21:05:56.194 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0073000000000003e-05 2024-04-18T21:05:56.194 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:56.194 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:56.194 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:56.195 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.195 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.195 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:56.195 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:05:56.195 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 50.503081495000004, 2024-04-18T21:05:56.195 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0098419370000000003, 2024-04-18T21:05:56.195 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:56.195 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:56.195 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:56.195 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:56.195 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.195 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:56.195 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:05:56.195 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:56.195 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.196 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.196 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:56.196 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:05:56.196 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:56.196 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.196 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.196 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:56.196 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623920+0000", 2024-04-18T21:05:56.196 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2240000000000001e-06 2024-04-18T21:05:56.196 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.196 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.196 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:56.196 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623933+0000", 2024-04-18T21:05:56.196 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3653e-05 2024-04-18T21:05:56.196 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.197 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.197 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:56.197 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623956+0000", 2024-04-18T21:05:56.197 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2059e-05 2024-04-18T21:05:56.197 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.197 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.197 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:56.197 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623975+0000", 2024-04-18T21:05:56.197 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.9806999999999999e-05 2024-04-18T21:05:56.197 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.197 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.197 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:56.197 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626943+0000", 2024-04-18T21:05:56.197 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0029681579999999998 2024-04-18T21:05:56.198 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.198 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.198 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:56.198 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626993+0000", 2024-04-18T21:05:56.198 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.9935999999999998e-05 2024-04-18T21:05:56.198 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.198 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.198 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:56.198 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633665+0000", 2024-04-18T21:05:56.198 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0066719250000000004 2024-04-18T21:05:56.198 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.198 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.198 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:56.198 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633761+0000", 2024-04-18T21:05:56.199 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.5174999999999996e-05 2024-04-18T21:05:56.199 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:56.199 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:56.199 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:56.199 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.199 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.199 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:56.199 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:05:56.199 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 50.502249876, 2024-04-18T21:05:56.199 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0090159079999999996, 2024-04-18T21:05:56.199 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:56.199 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:56.199 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:56.199 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:56.199 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.200 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:56.200 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:05:56.200 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:56.200 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.200 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.200 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:56.200 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:05:56.200 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:56.200 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.200 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.200 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:56.200 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624751+0000", 2024-04-18T21:05:56.200 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.7600000000000006e-07 2024-04-18T21:05:56.200 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.201 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.201 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:56.201 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624787+0000", 2024-04-18T21:05:56.201 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.6273000000000003e-05 2024-04-18T21:05:56.201 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.201 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.201 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:56.201 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625837+0000", 2024-04-18T21:05:56.201 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00104992 2024-04-18T21:05:56.201 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.201 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.201 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:56.201 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625860+0000", 2024-04-18T21:05:56.201 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3110000000000001e-05 2024-04-18T21:05:56.201 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.202 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.202 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:56.202 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625984+0000", 2024-04-18T21:05:56.202 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012399199999999999 2024-04-18T21:05:56.202 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.202 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.202 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:56.202 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626030+0000", 2024-04-18T21:05:56.202 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.5429999999999997e-05 2024-04-18T21:05:56.202 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.202 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.202 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:56.202 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633643+0000", 2024-04-18T21:05:56.203 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0076129320000000002 2024-04-18T21:05:56.203 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.203 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.203 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:56.203 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633766+0000", 2024-04-18T21:05:56.203 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000123275 2024-04-18T21:05:56.203 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:56.203 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:56.203 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:56.203 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.203 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.203 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:56.203 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:05:56.203 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 50.500996151999999, 2024-04-18T21:05:56.204 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0088669170000000002, 2024-04-18T21:05:56.204 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:56.204 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:56.204 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:56.204 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:56.204 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.204 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:56.204 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:05:56.204 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:56.204 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.204 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.204 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:56.204 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:05:56.204 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:56.204 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.205 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.205 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:56.205 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626005+0000", 2024-04-18T21:05:56.205 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.5000000000000001e-07 2024-04-18T21:05:56.205 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.205 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.205 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:56.205 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626028+0000", 2024-04-18T21:05:56.205 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2756999999999999e-05 2024-04-18T21:05:56.205 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.205 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.205 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:56.205 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626050+0000", 2024-04-18T21:05:56.205 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2140000000000001e-05 2024-04-18T21:05:56.205 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.205 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.206 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:56.206 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626065+0000", 2024-04-18T21:05:56.206 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5176e-05 2024-04-18T21:05:56.206 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.206 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.206 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:56.206 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628334+0000", 2024-04-18T21:05:56.206 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0022691439999999998 2024-04-18T21:05:56.206 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.206 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.206 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:56.206 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628379+0000", 2024-04-18T21:05:56.206 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.5420000000000002e-05 2024-04-18T21:05:56.206 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.207 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.207 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:56.207 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634770+0000", 2024-04-18T21:05:56.207 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0063908410000000004 2024-04-18T21:05:56.207 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.207 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.207 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:56.207 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634871+0000", 2024-04-18T21:05:56.207 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000100589 2024-04-18T21:05:56.207 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:56.207 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:56.207 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:56.207 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.207 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.207 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:13 3.10 e17/15 3:0d89b25e:::603.00000000:head v 17'8, mlcod=0'0)", 2024-04-18T21:05:56.208 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:05:56.208 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 50.482162723000002, 2024-04-18T21:05:56.208 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0090974379999999994, 2024-04-18T21:05:56.208 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:56.208 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:56.208 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:56.208 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:56.208 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.208 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:56.208 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:05:56.208 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:56.208 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.208 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.208 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:56.209 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:05:56.209 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:56.209 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.209 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.209 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:56.209 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644838+0000", 2024-04-18T21:05:56.209 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.569999999999999e-07 2024-04-18T21:05:56.209 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.209 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.209 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:56.209 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644846+0000", 2024-04-18T21:05:56.209 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.4499999999999998e-06 2024-04-18T21:05:56.209 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.209 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.209 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:56.210 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644861+0000", 2024-04-18T21:05:56.210 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5243e-05 2024-04-18T21:05:56.210 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.210 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.210 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:56.210 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644997+0000", 2024-04-18T21:05:56.210 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000135609 2024-04-18T21:05:56.210 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.210 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.210 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:56.210 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649150+0000", 2024-04-18T21:05:56.210 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0041536760000000002 2024-04-18T21:05:56.210 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.210 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.211 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:56.211 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649207+0000", 2024-04-18T21:05:56.211 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.6677e-05 2024-04-18T21:05:56.211 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.211 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.211 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:56.211 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.653840+0000", 2024-04-18T21:05:56.211 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0046329700000000001 2024-04-18T21:05:56.211 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.211 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.211 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:56.211 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.653935+0000", 2024-04-18T21:05:56.211 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.4856000000000001e-05 2024-04-18T21:05:56.211 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:56.212 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:56.212 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:56.212 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.212 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.212 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 3 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:05:56.212 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:05:56.212 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 50.479373563000003, 2024-04-18T21:05:56.212 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0087842319999999995, 2024-04-18T21:05:56.212 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:56.212 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:56.212 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "reached pg", 2024-04-18T21:05:56.212 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:56.212 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.212 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:56.213 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:05:56.213 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:56.213 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.213 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.213 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:56.213 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:05:56.213 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:56.213 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.213 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.213 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:56.213 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:05:56.213 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.8299999999999996e-07 2024-04-18T21:05:56.213 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.213 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.213 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:56.213 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647642+0000", 2024-04-18T21:05:56.214 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4724e-05 2024-04-18T21:05:56.214 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.214 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.214 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:56.214 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647679+0000", 2024-04-18T21:05:56.214 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.6662999999999998e-05 2024-04-18T21:05:56.214 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.214 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.214 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:56.214 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647735+0000", 2024-04-18T21:05:56.214 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.6196000000000002e-05 2024-04-18T21:05:56.214 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.214 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.215 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:56.215 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649865+0000", 2024-04-18T21:05:56.215 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0021299489999999999 2024-04-18T21:05:56.215 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.215 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.215 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:56.215 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656411+0000", 2024-04-18T21:05:56.215 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0065460170000000003 2024-04-18T21:05:56.215 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:56.215 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:56.215 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:56.215 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.215 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.215 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:56.216 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:05:56.216 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 50.479228366999997, 2024-04-18T21:05:56.216 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0095703190000000007, 2024-04-18T21:05:56.216 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:56.216 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:56.216 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:56.216 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:56.216 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.216 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:56.216 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:05:56.216 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:56.216 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.216 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.216 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:56.217 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:05:56.217 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:56.217 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.217 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.217 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:56.217 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647773+0000", 2024-04-18T21:05:56.217 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.046e-06 2024-04-18T21:05:56.217 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.217 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.217 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:56.217 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647795+0000", 2024-04-18T21:05:56.217 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2616000000000002e-05 2024-04-18T21:05:56.217 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.217 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.218 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:56.218 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647818+0000", 2024-04-18T21:05:56.218 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3110000000000001e-05 2024-04-18T21:05:56.218 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.218 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.218 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:56.218 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647834+0000", 2024-04-18T21:05:56.218 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5163e-05 2024-04-18T21:05:56.218 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.218 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.218 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:56.218 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650682+0000", 2024-04-18T21:05:56.218 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0028479759999999999 2024-04-18T21:05:56.219 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.219 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.219 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:56.219 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650730+0000", 2024-04-18T21:05:56.219 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.8375999999999999e-05 2024-04-18T21:05:56.219 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.219 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.219 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:56.219 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656751+0000", 2024-04-18T21:05:56.219 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0060211880000000002 2024-04-18T21:05:56.219 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.219 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.219 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:56.219 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657342+0000", 2024-04-18T21:05:56.219 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00059084399999999998 2024-04-18T21:05:56.219 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:56.220 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:56.220 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:56.220 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.220 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.220 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:56.220 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:05:56.220 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 50.478816080999998, 2024-04-18T21:05:56.220 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0092471759999999993, 2024-04-18T21:05:56.220 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:05:56.220 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:05:56.220 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:56.220 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:05:56.220 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.220 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:05:56.220 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:05:56.220 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:56.221 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.221 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.221 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:05:56.221 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:05:56.221 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:05:56.221 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.221 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.221 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:05:56.221 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648185+0000", 2024-04-18T21:05:56.221 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.5000000000000001e-07 2024-04-18T21:05:56.221 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.221 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.221 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:05:56.221 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648203+0000", 2024-04-18T21:05:56.221 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.8102999999999999e-05 2024-04-18T21:05:56.222 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.222 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.222 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:05:56.222 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648226+0000", 2024-04-18T21:05:56.222 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2921999999999998e-05 2024-04-18T21:05:56.222 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.222 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.222 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:05:56.222 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648241+0000", 2024-04-18T21:05:56.222 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5336999999999999e-05 2024-04-18T21:05:56.222 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.222 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.222 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:05:56.222 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.651268+0000", 2024-04-18T21:05:56.223 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0030271640000000002 2024-04-18T21:05:56.223 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.223 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.223 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:05:56.223 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.651319+0000", 2024-04-18T21:05:56.223 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.0843000000000001e-05 2024-04-18T21:05:56.223 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.223 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.223 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:05:56.223 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657347+0000", 2024-04-18T21:05:56.225 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0060279770000000003 2024-04-18T21:05:56.225 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:05:56.225 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:05:56.225 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:05:56.225 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657431+0000", 2024-04-18T21:05:56.225 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.3980000000000006e-05 2024-04-18T21:05:56.225 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:56.225 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:56.225 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:56.225 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:05:56.225 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:05:56.225 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:05:56.228 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:05:56.228 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:56.227+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:56.329 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:56.331+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:56.360 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:05:56.360 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:05:56.360 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-04-18T21:05:56.360 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:05:56.374 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:05:56.430 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:56.431+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:56.530 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:56.531+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:56.539 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:05:56.539 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:05:56.539 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-18T21:05:56.539 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-18T21:05:56.539 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:05:56.553 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:05:56.630 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:56.631+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:56.717 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:05:56.717 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-18T21:05:56.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-18T21:05:56.718 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:05:56.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.718 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:56.718 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:05:56.718 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 51.101633143000001, 2024-04-18T21:05:56.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.034065303999999998, 2024-04-18T21:05:56.718 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:56.718 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:56.718 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:56.718 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:56.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:56.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:05:56.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:56.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.719 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:56.719 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:05:56.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:56.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.719 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:56.719 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615254+0000", 2024-04-18T21:05:56.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7829999999999999e-06 2024-04-18T21:05:56.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.719 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:56.719 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615267+0000", 2024-04-18T21:05:56.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3334e-05 2024-04-18T21:05:56.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:56.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615294+0000", 2024-04-18T21:05:56.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7271999999999999e-05 2024-04-18T21:05:56.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:56.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615321+0000", 2024-04-18T21:05:56.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.637e-05 2024-04-18T21:05:56.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:56.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615479+0000", 2024-04-18T21:05:56.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000158493 2024-04-18T21:05:56.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:56.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615498+0000", 2024-04-18T21:05:56.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9148999999999999e-05 2024-04-18T21:05:56.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:56.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632915+0000", 2024-04-18T21:05:56.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.017416551999999998 2024-04-18T21:05:56.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.722 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:56.722 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633302+0000", 2024-04-18T21:05:56.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00038725000000000001 2024-04-18T21:05:56.722 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.722 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.722 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:56.722 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633638+0000", 2024-04-18T21:05:56.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000335946 2024-04-18T21:05:56.722 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.722 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.722 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:56.722 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645976+0000", 2024-04-18T21:05:56.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012337617 2024-04-18T21:05:56.722 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:56.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649080+0000", 2024-04-18T21:05:56.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031038929999999999 2024-04-18T21:05:56.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:56.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649207+0000", 2024-04-18T21:05:56.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000127537 2024-04-18T21:05:56.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:56.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649316+0000", 2024-04-18T21:05:56.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109108 2024-04-18T21:05:56.723 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:56.724 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:56.724 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:56.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.724 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:56.724 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:05:56.724 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 51.101499766000003, 2024-04-18T21:05:56.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036275764000000002, 2024-04-18T21:05:56.724 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:56.724 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:56.724 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:56.724 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:56.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.724 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:56.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:05:56.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:56.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:56.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:05:56.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:56.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:56.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615386+0000", 2024-04-18T21:05:56.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.573e-06 2024-04-18T21:05:56.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.726 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:56.726 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:05:56.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0723999999999999e-05 2024-04-18T21:05:56.726 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.726 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.726 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:56.726 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615418+0000", 2024-04-18T21:05:56.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0902000000000001e-05 2024-04-18T21:05:56.726 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.726 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.726 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:56.726 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615433+0000", 2024-04-18T21:05:56.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5319999999999999e-05 2024-04-18T21:05:56.726 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:56.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615659+0000", 2024-04-18T21:05:56.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000226095 2024-04-18T21:05:56.727 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:56.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:56.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1276e-05 2024-04-18T21:05:56.727 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:56.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643654+0000", 2024-04-18T21:05:56.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027983238000000001 2024-04-18T21:05:56.727 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.728 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:56.728 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643868+0000", 2024-04-18T21:05:56.728 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000214305 2024-04-18T21:05:56.728 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.728 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:56.728 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:05:56.728 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035892200000000002 2024-04-18T21:05:56.728 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.728 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:56.728 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646056+0000", 2024-04-18T21:05:56.728 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001829172 2024-04-18T21:05:56.729 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.729 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:56.729 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651406+0000", 2024-04-18T21:05:56.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0053504800000000003 2024-04-18T21:05:56.729 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.729 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:56.729 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651551+0000", 2024-04-18T21:05:56.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014427999999999999 2024-04-18T21:05:56.729 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.729 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:56.729 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651660+0000", 2024-04-18T21:05:56.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109477 2024-04-18T21:05:56.730 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:56.730 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:56.730 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:56.730 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.730 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:56.730 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:05:56.730 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 51.101426384, 2024-04-18T21:05:56.730 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045668994999999997, 2024-04-18T21:05:56.730 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:56.730 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:56.730 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:56.730 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:56.731 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.731 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:56.731 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:05:56.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:56.731 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.731 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.731 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:56.731 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:05:56.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:56.731 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.731 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.731 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:56.731 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615459+0000", 2024-04-18T21:05:56.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5030000000000001e-06 2024-04-18T21:05:56.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.732 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:56.732 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615506+0000", 2024-04-18T21:05:56.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6872000000000001e-05 2024-04-18T21:05:56.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.732 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:56.732 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615527+0000", 2024-04-18T21:05:56.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0763000000000001e-05 2024-04-18T21:05:56.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.732 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:56.732 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615551+0000", 2024-04-18T21:05:56.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4159e-05 2024-04-18T21:05:56.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:56.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615736+0000", 2024-04-18T21:05:56.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018499599999999999 2024-04-18T21:05:56.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:56.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615748+0000", 2024-04-18T21:05:56.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2272999999999999e-05 2024-04-18T21:05:56.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:56.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635481+0000", 2024-04-18T21:05:56.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019732772999999999 2024-04-18T21:05:56.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.734 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:56.734 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635791+0000", 2024-04-18T21:05:56.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031013299999999998 2024-04-18T21:05:56.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.734 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:56.734 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636101+0000", 2024-04-18T21:05:56.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030943300000000002 2024-04-18T21:05:56.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.734 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:56.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646043+0000", 2024-04-18T21:05:56.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099428139999999995 2024-04-18T21:05:56.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:56.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660991+0000", 2024-04-18T21:05:56.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014947142 2024-04-18T21:05:56.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:56.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661061+0000", 2024-04-18T21:05:56.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0438000000000006e-05 2024-04-18T21:05:56.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:56.736 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661127+0000", 2024-04-18T21:05:56.736 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5696000000000003e-05 2024-04-18T21:05:56.736 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:56.736 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:56.736 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:56.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.736 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:56.736 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:56.736 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 51.101213956000002, 2024-04-18T21:05:56.736 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045745085999999997, 2024-04-18T21:05:56.736 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:56.736 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:56.736 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:56.736 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:56.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.737 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:56.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:56.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:56.737 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.737 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:56.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:56.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:56.737 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.737 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:56.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:05:56.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7400000000000001e-06 2024-04-18T21:05:56.738 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.738 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.738 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:56.738 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:05:56.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8133e-05 2024-04-18T21:05:56.738 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.738 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.738 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:56.738 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615726+0000", 2024-04-18T21:05:56.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6132e-05 2024-04-18T21:05:56.738 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.738 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.738 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:56.738 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615742+0000", 2024-04-18T21:05:56.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6157000000000001e-05 2024-04-18T21:05:56.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:56.739 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615937+0000", 2024-04-18T21:05:56.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000194768 2024-04-18T21:05:56.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:56.739 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615950+0000", 2024-04-18T21:05:56.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3084e-05 2024-04-18T21:05:56.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:56.739 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643676+0000", 2024-04-18T21:05:56.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027725639999999999 2024-04-18T21:05:56.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.740 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:56.740 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643867+0000", 2024-04-18T21:05:56.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019075900000000001 2024-04-18T21:05:56.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.740 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:56.740 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:05:56.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036013799999999997 2024-04-18T21:05:56.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.740 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:56.740 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646068+0000", 2024-04-18T21:05:56.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001841536 2024-04-18T21:05:56.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:56.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661184+0000", 2024-04-18T21:05:56.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015115458999999999 2024-04-18T21:05:56.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:56.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661283+0000", 2024-04-18T21:05:56.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9502999999999999e-05 2024-04-18T21:05:56.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:56.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661415+0000", 2024-04-18T21:05:56.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000132037 2024-04-18T21:05:56.742 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:56.742 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:56.742 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:56.742 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.742 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.742 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:56.742 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:05:56.742 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 51.101092268999999, 2024-04-18T21:05:56.742 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036185947000000003, 2024-04-18T21:05:56.742 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:56.742 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:56.742 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:56.742 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:56.742 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:56.743 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:05:56.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:56.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:56.743 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:05:56.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:56.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:56.743 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615794+0000", 2024-04-18T21:05:56.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6440000000000001e-06 2024-04-18T21:05:56.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:56.744 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615803+0000", 2024-04-18T21:05:56.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1220000000000001e-06 2024-04-18T21:05:56.744 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.744 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.744 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:56.744 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615827+0000", 2024-04-18T21:05:56.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3997000000000001e-05 2024-04-18T21:05:56.744 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.744 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.744 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:56.744 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615899+0000", 2024-04-18T21:05:56.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2741e-05 2024-04-18T21:05:56.744 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.744 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.745 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:56.745 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616019+0000", 2024-04-18T21:05:56.745 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119874 2024-04-18T21:05:56.745 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.745 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.745 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:56.745 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616029+0000", 2024-04-18T21:05:56.745 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:05:56.745 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.745 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.745 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:56.745 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644823+0000", 2024-04-18T21:05:56.745 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.028793151999999999 2024-04-18T21:05:56.745 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.745 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:56.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645106+0000", 2024-04-18T21:05:56.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028379700000000002 2024-04-18T21:05:56.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:56.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645294+0000", 2024-04-18T21:05:56.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000187181 2024-04-18T21:05:56.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:56.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646763+0000", 2024-04-18T21:05:56.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0014691050000000001 2024-04-18T21:05:56.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:56.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651784+0000", 2024-04-18T21:05:56.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050211650000000002 2024-04-18T21:05:56.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:56.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651876+0000", 2024-04-18T21:05:56.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2503999999999994e-05 2024-04-18T21:05:56.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:56.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651978+0000", 2024-04-18T21:05:56.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000101475 2024-04-18T21:05:56.748 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:56.748 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:56.748 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:56.748 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.748 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:56.748 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:56.748 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 51.100943661999999, 2024-04-18T21:05:56.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032262322000000003, 2024-04-18T21:05:56.748 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:56.748 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:56.748 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:56.748 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:56.749 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.749 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:56.749 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:56.749 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:56.749 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.749 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.749 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:56.749 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:56.749 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:56.749 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.749 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.749 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:56.749 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615943+0000", 2024-04-18T21:05:56.749 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1959999999999998e-06 2024-04-18T21:05:56.749 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.750 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.750 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:56.750 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615956+0000", 2024-04-18T21:05:56.750 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3424000000000001e-05 2024-04-18T21:05:56.750 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.750 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.750 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:56.750 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615983+0000", 2024-04-18T21:05:56.750 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7072000000000001e-05 2024-04-18T21:05:56.750 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.750 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.750 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:56.750 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616006+0000", 2024-04-18T21:05:56.750 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2823000000000002e-05 2024-04-18T21:05:56.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:56.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616156+0000", 2024-04-18T21:05:56.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014962299999999999 2024-04-18T21:05:56.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:56.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616174+0000", 2024-04-18T21:05:56.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8082999999999999e-05 2024-04-18T21:05:56.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:56.752 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.629952+0000", 2024-04-18T21:05:56.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013778514 2024-04-18T21:05:56.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.752 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:56.752 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630201+0000", 2024-04-18T21:05:56.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024918100000000001 2024-04-18T21:05:56.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.752 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:56.752 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630386+0000", 2024-04-18T21:05:56.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018436900000000001 2024-04-18T21:05:56.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.752 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:56.753 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643169+0000", 2024-04-18T21:05:56.753 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012782774 2024-04-18T21:05:56.753 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.753 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:56.753 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.647924+0000", 2024-04-18T21:05:56.753 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004755787 2024-04-18T21:05:56.753 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.753 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:56.753 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648069+0000", 2024-04-18T21:05:56.753 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014459600000000001 2024-04-18T21:05:56.753 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.754 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:56.754 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648203+0000", 2024-04-18T21:05:56.754 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013388000000000001 2024-04-18T21:05:56.754 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:56.754 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:56.754 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:56.754 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.754 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.754 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:56.754 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:05:56.754 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 51.100835398000001, 2024-04-18T21:05:56.754 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032489736999999998, 2024-04-18T21:05:56.754 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:56.754 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:56.755 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:56.755 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:56.755 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.755 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:56.755 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:05:56.755 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:56.755 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.755 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.755 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:56.755 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:05:56.755 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:56.755 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.755 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.755 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:56.755 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616050+0000", 2024-04-18T21:05:56.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.606e-06 2024-04-18T21:05:56.756 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.756 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:56.756 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616061+0000", 2024-04-18T21:05:56.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0463e-05 2024-04-18T21:05:56.756 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.756 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:56.756 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616092+0000", 2024-04-18T21:05:56.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1415999999999999e-05 2024-04-18T21:05:56.756 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.756 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:56.757 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616109+0000", 2024-04-18T21:05:56.757 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6557000000000001e-05 2024-04-18T21:05:56.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.757 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.757 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:56.757 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616358+0000", 2024-04-18T21:05:56.757 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000249077 2024-04-18T21:05:56.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.757 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.757 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:56.757 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616370+0000", 2024-04-18T21:05:56.757 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2037e-05 2024-04-18T21:05:56.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.757 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.758 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:56.758 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.634920+0000", 2024-04-18T21:05:56.758 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018550397 2024-04-18T21:05:56.758 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.758 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.758 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:56.758 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640420+0000", 2024-04-18T21:05:56.758 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055000539999999999 2024-04-18T21:05:56.758 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.758 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.758 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:56.758 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648538+0000", 2024-04-18T21:05:56.758 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0081181299999999994 2024-04-18T21:05:56.758 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:56.759 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:56.759 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:56.759 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.759 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:56.759 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:05:56.759 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 51.100751076999998, 2024-04-18T21:05:56.759 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036090029000000003, 2024-04-18T21:05:56.759 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:56.759 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:56.759 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:56.759 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:56.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.759 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:56.760 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:05:56.760 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:56.760 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.760 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.760 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:56.760 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:05:56.760 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:56.760 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.760 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.760 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:56.760 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616134+0000", 2024-04-18T21:05:56.760 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.353e-06 2024-04-18T21:05:56.760 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.760 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.761 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:56.761 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616141+0000", 2024-04-18T21:05:56.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2770000000000002e-06 2024-04-18T21:05:56.761 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.761 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.761 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:56.761 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616160+0000", 2024-04-18T21:05:56.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.91e-05 2024-04-18T21:05:56.761 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.761 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.761 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:56.761 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616170+0000", 2024-04-18T21:05:56.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7699999999999996e-06 2024-04-18T21:05:56.761 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.761 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.762 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:56.762 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616275+0000", 2024-04-18T21:05:56.762 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105313 2024-04-18T21:05:56.762 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.762 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.762 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:56.762 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616288+0000", 2024-04-18T21:05:56.762 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3027000000000001e-05 2024-04-18T21:05:56.762 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.762 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.762 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:56.762 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646160+0000", 2024-04-18T21:05:56.762 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.029872019 2024-04-18T21:05:56.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.763 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:56.763 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646368+0000", 2024-04-18T21:05:56.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020811899999999999 2024-04-18T21:05:56.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.763 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:56.763 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652223+0000", 2024-04-18T21:05:56.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.005855051 2024-04-18T21:05:56.763 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:56.763 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:56.763 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:56.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.763 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:56.764 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:05:56.764 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 51.100693507999999, 2024-04-18T21:05:56.764 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043572403000000003, 2024-04-18T21:05:56.764 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:56.764 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:56.764 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:56.764 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:56.764 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.764 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:56.764 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:05:56.764 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:56.764 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.764 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.764 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:56.765 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:05:56.765 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:56.765 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.765 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.765 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:56.765 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616192+0000", 2024-04-18T21:05:56.765 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:05:56.765 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.765 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.765 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:56.765 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616203+0000", 2024-04-18T21:05:56.765 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0890000000000001e-05 2024-04-18T21:05:56.765 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.765 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.765 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:56.766 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616223+0000", 2024-04-18T21:05:56.766 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0409000000000001e-05 2024-04-18T21:05:56.766 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.766 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.766 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:56.766 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616238+0000", 2024-04-18T21:05:56.766 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5160000000000001e-05 2024-04-18T21:05:56.766 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.766 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.766 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:56.766 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616343+0000", 2024-04-18T21:05:56.766 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000104831 2024-04-18T21:05:56.766 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.766 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.767 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:56.767 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616357+0000", 2024-04-18T21:05:56.767 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3686000000000001e-05 2024-04-18T21:05:56.767 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.767 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.767 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:56.767 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635912+0000", 2024-04-18T21:05:56.767 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019554944000000001 2024-04-18T21:05:56.767 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.767 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.767 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:56.767 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636231+0000", 2024-04-18T21:05:56.767 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000318766 2024-04-18T21:05:56.767 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.768 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.768 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:56.768 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659763+0000", 2024-04-18T21:05:56.768 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023532474000000001 2024-04-18T21:05:56.768 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:56.768 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:56.768 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:56.768 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.768 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.768 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:56.768 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:05:56.768 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 51.096764800999999, 2024-04-18T21:05:56.768 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015007971, 2024-04-18T21:05:56.768 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:56.769 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:56.769 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:56.769 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:56.769 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.769 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:56.769 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:05:56.769 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:56.769 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.769 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.769 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:56.769 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:05:56.769 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:56.769 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.769 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.769 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:56.770 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620120+0000", 2024-04-18T21:05:56.770 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0359999999999999e-06 2024-04-18T21:05:56.770 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.770 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.770 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:56.770 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620157+0000", 2024-04-18T21:05:56.770 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6636e-05 2024-04-18T21:05:56.770 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.770 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.770 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:56.770 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620177+0000", 2024-04-18T21:05:56.770 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0247000000000001e-05 2024-04-18T21:05:56.770 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.771 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.771 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:56.771 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620195+0000", 2024-04-18T21:05:56.771 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7819e-05 2024-04-18T21:05:56.771 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.771 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.771 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:56.771 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620342+0000", 2024-04-18T21:05:56.771 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014643300000000001 2024-04-18T21:05:56.771 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.771 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.771 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:56.771 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620405+0000", 2024-04-18T21:05:56.771 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3522000000000006e-05 2024-04-18T21:05:56.772 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.772 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.772 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:56.772 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635016+0000", 2024-04-18T21:05:56.772 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014610840999999999 2024-04-18T21:05:56.772 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.772 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.772 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:56.772 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635127+0000", 2024-04-18T21:05:56.772 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111437 2024-04-18T21:05:56.772 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:56.772 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:56.772 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:56.772 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.773 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.773 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:56.773 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:05:56.773 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 51.096657532999998, 2024-04-18T21:05:56.773 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012693296, 2024-04-18T21:05:56.773 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:56.773 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:56.773 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:56.773 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:56.773 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.773 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:56.773 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:05:56.773 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:56.773 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.774 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.774 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:56.774 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:05:56.774 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:56.774 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.774 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.774 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:56.774 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620228+0000", 2024-04-18T21:05:56.774 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:05:56.774 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.774 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.774 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:56.774 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620236+0000", 2024-04-18T21:05:56.774 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.303e-06 2024-04-18T21:05:56.775 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.775 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.775 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:56.775 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620255+0000", 2024-04-18T21:05:56.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9406e-05 2024-04-18T21:05:56.775 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.775 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.775 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:56.775 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620274+0000", 2024-04-18T21:05:56.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8940000000000002e-05 2024-04-18T21:05:56.775 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.775 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.775 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:56.775 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:05:56.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001558753 2024-04-18T21:05:56.776 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.776 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.776 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:56.776 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621879+0000", 2024-04-18T21:05:56.776 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6359000000000001e-05 2024-04-18T21:05:56.776 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.776 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.776 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:56.776 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632841+0000", 2024-04-18T21:05:56.776 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010961907 2024-04-18T21:05:56.776 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.776 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.776 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:56.776 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632920+0000", 2024-04-18T21:05:56.777 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8714999999999994e-05 2024-04-18T21:05:56.777 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:56.777 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:56.777 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:56.777 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.777 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.777 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:56.777 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:05:56.777 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 51.095111770000003, 2024-04-18T21:05:56.777 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013445702, 2024-04-18T21:05:56.777 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:56.777 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:56.777 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:56.777 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:56.778 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.778 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:56.778 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:05:56.778 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:56.778 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.778 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.778 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:56.778 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:05:56.778 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:56.778 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.778 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.778 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:56.778 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621774+0000", 2024-04-18T21:05:56.778 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2500000000000001e-06 2024-04-18T21:05:56.779 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.779 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.779 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:56.779 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621786+0000", 2024-04-18T21:05:56.779 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2636000000000001e-05 2024-04-18T21:05:56.779 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.779 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.779 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:56.779 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621814+0000", 2024-04-18T21:05:56.779 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7823000000000001e-05 2024-04-18T21:05:56.779 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.779 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.779 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:56.779 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621844+0000", 2024-04-18T21:05:56.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9589000000000001e-05 2024-04-18T21:05:56.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:56.780 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622253+0000", 2024-04-18T21:05:56.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040963700000000002 2024-04-18T21:05:56.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:56.780 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622304+0000", 2024-04-18T21:05:56.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0868999999999997e-05 2024-04-18T21:05:56.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:56.780 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635133+0000", 2024-04-18T21:05:56.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012829136 2024-04-18T21:05:56.781 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.781 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.781 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:56.781 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635218+0000", 2024-04-18T21:05:56.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4761999999999999e-05 2024-04-18T21:05:56.781 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:56.781 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:56.781 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:56.781 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.781 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.781 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:56.781 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:05:56.781 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 51.094985010000002, 2024-04-18T21:05:56.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014162065, 2024-04-18T21:05:56.782 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:56.782 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:56.782 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:56.782 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:56.782 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.782 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:56.782 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:05:56.782 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:56.782 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.782 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.782 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:56.782 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:05:56.782 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:56.782 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.783 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.783 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:56.783 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621900+0000", 2024-04-18T21:05:56.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:05:56.783 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.783 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.783 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:56.783 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621910+0000", 2024-04-18T21:05:56.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0207000000000001e-05 2024-04-18T21:05:56.783 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.783 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.783 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:56.783 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621932+0000", 2024-04-18T21:05:56.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1789000000000001e-05 2024-04-18T21:05:56.783 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.783 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.784 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:56.784 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621946+0000", 2024-04-18T21:05:56.784 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4212999999999999e-05 2024-04-18T21:05:56.784 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.784 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.784 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:56.784 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624477+0000", 2024-04-18T21:05:56.784 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025303470000000001 2024-04-18T21:05:56.784 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.784 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.784 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:56.784 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624525+0000", 2024-04-18T21:05:56.784 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8084999999999998e-05 2024-04-18T21:05:56.784 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.785 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.785 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:56.785 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635976+0000", 2024-04-18T21:05:56.785 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.011451368999999999 2024-04-18T21:05:56.785 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.785 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.785 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:56.785 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636061+0000", 2024-04-18T21:05:56.785 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5094999999999998e-05 2024-04-18T21:05:56.785 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:56.785 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:56.785 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:56.785 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.785 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.785 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:05:56.786 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:05:56.786 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 51.085749385, 2024-04-18T21:05:56.786 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0098014739999999993, 2024-04-18T21:05:56.786 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:56.786 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:56.786 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:05:56.786 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:56.786 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.786 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:56.786 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:05:56.786 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:56.786 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.786 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.787 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:56.787 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:05:56.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:56.787 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.787 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.787 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:56.787 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631136+0000", 2024-04-18T21:05:56.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0139999999999999e-06 2024-04-18T21:05:56.787 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.787 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.787 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:56.787 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631152+0000", 2024-04-18T21:05:56.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6365999999999999e-05 2024-04-18T21:05:56.787 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.787 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:56.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631961+0000", 2024-04-18T21:05:56.788 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00080873100000000003 2024-04-18T21:05:56.788 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:56.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632021+0000", 2024-04-18T21:05:56.788 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0541999999999997e-05 2024-04-18T21:05:56.788 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:56.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633539+0000", 2024-04-18T21:05:56.788 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015175639999999999 2024-04-18T21:05:56.788 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.789 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.789 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:56.789 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640936+0000", 2024-04-18T21:05:56.789 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007397257 2024-04-18T21:05:56.789 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:56.789 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:56.789 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:56.789 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.789 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.789 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-18T21:05:56.789 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:05:56.789 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 51.068287951999999, 2024-04-18T21:05:56.789 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00073592199999999997, 2024-04-18T21:05:56.789 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:56.789 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:56.790 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:56.790 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:56.790 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.790 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:56.790 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:05:56.790 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:56.790 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.790 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.790 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:56.790 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:05:56.790 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:56.790 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.790 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.791 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:56.791 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648597+0000", 2024-04-18T21:05:56.791 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:05:56.791 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.791 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.791 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:56.791 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648605+0000", 2024-04-18T21:05:56.791 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3960000000000006e-06 2024-04-18T21:05:56.791 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.791 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.791 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:56.791 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648625+0000", 2024-04-18T21:05:56.791 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9987e-05 2024-04-18T21:05:56.791 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.791 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.792 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:56.792 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648643+0000", 2024-04-18T21:05:56.792 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7079e-05 2024-04-18T21:05:56.792 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.792 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.792 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:56.792 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649043+0000", 2024-04-18T21:05:56.792 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040083399999999998 2024-04-18T21:05:56.792 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.792 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.792 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:56.792 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649062+0000", 2024-04-18T21:05:56.792 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9052999999999999e-05 2024-04-18T21:05:56.792 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.793 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.793 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:56.793 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649332+0000", 2024-04-18T21:05:56.793 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026971999999999999 2024-04-18T21:05:56.793 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:56.793 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:56.793 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:56.793 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.793 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.793 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:05:56.793 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:05:56.793 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 51.065513051000003, 2024-04-18T21:05:56.793 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00086123999999999999, 2024-04-18T21:05:56.793 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:56.794 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:56.794 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:05:56.794 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:56.794 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.794 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:56.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:05:56.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:56.794 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.794 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.794 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:56.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:05:56.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:56.794 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.795 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:56.795 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651372+0000", 2024-04-18T21:05:56.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7599999999999997e-07 2024-04-18T21:05:56.795 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.795 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:56.795 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651377+0000", 2024-04-18T21:05:56.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.22e-06 2024-04-18T21:05:56.795 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.795 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:56.795 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651394+0000", 2024-04-18T21:05:56.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6646999999999998e-05 2024-04-18T21:05:56.796 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.796 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.796 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:56.796 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651427+0000", 2024-04-18T21:05:56.796 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3682e-05 2024-04-18T21:05:56.796 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.796 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.796 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:56.796 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652029+0000", 2024-04-18T21:05:56.796 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00060152199999999995 2024-04-18T21:05:56.796 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.796 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.796 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:56.796 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652232+0000", 2024-04-18T21:05:56.796 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020359299999999999 2024-04-18T21:05:56.797 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:56.797 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:56.797 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:56.797 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.797 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.797 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:05:56.797 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:05:56.797 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 51.057486089000001, 2024-04-18T21:05:56.797 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0017426200000000001, 2024-04-18T21:05:56.797 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:56.797 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:56.797 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:56.797 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:56.797 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.797 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:56.798 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:05:56.798 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:56.798 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.798 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:56.798 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:05:56.798 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:56.798 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.798 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:56.798 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659399+0000", 2024-04-18T21:05:56.798 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6000000000000002e-07 2024-04-18T21:05:56.798 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.798 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:56.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659405+0000", 2024-04-18T21:05:56.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5069999999999997e-06 2024-04-18T21:05:56.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:56.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659425+0000", 2024-04-18T21:05:56.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.927e-05 2024-04-18T21:05:56.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:56.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659443+0000", 2024-04-18T21:05:56.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8051999999999999e-05 2024-04-18T21:05:56.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.800 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:56.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660973+0000", 2024-04-18T21:05:56.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001530106 2024-04-18T21:05:56.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.800 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.800 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:56.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660983+0000", 2024-04-18T21:05:56.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0516999999999999e-05 2024-04-18T21:05:56.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.800 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.800 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:56.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661141+0000", 2024-04-18T21:05:56.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015730799999999999 2024-04-18T21:05:56.800 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:56.800 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:56.801 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:56.801 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.801 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.801 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:05:56.801 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:05:56.801 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 51.057269464000001, 2024-04-18T21:05:56.801 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001812311, 2024-04-18T21:05:56.801 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:56.801 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:56.801 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:56.801 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:56.801 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.801 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:56.801 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:05:56.801 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:56.802 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.802 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.802 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:56.802 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:05:56.802 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:56.802 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.802 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.802 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:56.802 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659616+0000", 2024-04-18T21:05:56.802 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.277e-06 2024-04-18T21:05:56.802 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.802 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.802 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:56.803 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659625+0000", 2024-04-18T21:05:56.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5359999999999998e-06 2024-04-18T21:05:56.803 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.803 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:56.803 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659647+0000", 2024-04-18T21:05:56.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1857000000000001e-05 2024-04-18T21:05:56.803 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.803 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:56.803 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659664+0000", 2024-04-18T21:05:56.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6405999999999998e-05 2024-04-18T21:05:56.803 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.804 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:56.804 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661169+0000", 2024-04-18T21:05:56.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015054179999999999 2024-04-18T21:05:56.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.804 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:56.804 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661177+0000", 2024-04-18T21:05:56.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9680000000000006e-06 2024-04-18T21:05:56.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.804 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:56.804 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661427+0000", 2024-04-18T21:05:56.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024984900000000001 2024-04-18T21:05:56.804 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:56.804 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:56.805 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:56.805 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.805 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.805 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-18T21:05:56.805 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:05:56.805 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.104348856000001, 2024-04-18T21:05:56.805 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0030975030000000001, 2024-04-18T21:05:56.805 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:56.805 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:56.805 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:56.805 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:56.805 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.805 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:56.805 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:05:56.806 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:56.806 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.806 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.806 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:56.806 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:05:56.806 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:56.806 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.806 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.806 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:56.806 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612538+0000", 2024-04-18T21:05:56.806 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6259999999999999e-06 2024-04-18T21:05:56.806 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.806 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.806 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:56.806 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612552+0000", 2024-04-18T21:05:56.807 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4073999999999999e-05 2024-04-18T21:05:56.807 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.807 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.807 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:56.807 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612585+0000", 2024-04-18T21:05:56.807 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3504999999999999e-05 2024-04-18T21:05:56.807 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.807 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.807 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:56.807 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612601+0000", 2024-04-18T21:05:56.807 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5194000000000001e-05 2024-04-18T21:05:56.807 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.807 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.807 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:56.807 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612746+0000", 2024-04-18T21:05:56.808 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145666 2024-04-18T21:05:56.808 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.808 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:56.808 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612953+0000", 2024-04-18T21:05:56.808 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000207109 2024-04-18T21:05:56.808 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.808 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:56.808 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.613134+0000", 2024-04-18T21:05:56.808 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018041300000000001 2024-04-18T21:05:56.808 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.808 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:56.809 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.614411+0000", 2024-04-18T21:05:56.809 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0012769929999999999 2024-04-18T21:05:56.809 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.809 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:56.809 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615441+0000", 2024-04-18T21:05:56.809 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001029917 2024-04-18T21:05:56.809 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.809 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:56.809 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615522+0000", 2024-04-18T21:05:56.809 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1142000000000003e-05 2024-04-18T21:05:56.809 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.810 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:56.810 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615633+0000", 2024-04-18T21:05:56.810 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000110864 2024-04-18T21:05:56.810 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:56.810 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:56.810 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:56.810 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.810 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.810 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-18T21:05:56.810 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:05:56.810 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 31.102063045000001, 2024-04-18T21:05:56.810 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088979039999999999, 2024-04-18T21:05:56.811 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:56.811 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:56.811 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:56.811 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:56.811 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.811 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:56.811 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:05:56.811 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:56.811 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.811 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.811 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:56.811 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:05:56.811 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:56.811 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.811 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.812 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:56.812 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614825+0000", 2024-04-18T21:05:56.812 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4829999999999999e-06 2024-04-18T21:05:56.812 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.812 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.812 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:56.812 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614843+0000", 2024-04-18T21:05:56.812 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8777e-05 2024-04-18T21:05:56.812 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.812 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.812 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:56.812 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614884+0000", 2024-04-18T21:05:56.812 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1051999999999999e-05 2024-04-18T21:05:56.812 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.813 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.813 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:56.813 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614903+0000", 2024-04-18T21:05:56.813 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9069999999999999e-05 2024-04-18T21:05:56.813 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.813 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.813 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:56.813 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615047+0000", 2024-04-18T21:05:56.813 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014374400000000001 2024-04-18T21:05:56.813 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.813 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.813 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:56.813 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615061+0000", 2024-04-18T21:05:56.813 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4063000000000001e-05 2024-04-18T21:05:56.813 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.814 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.814 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:56.814 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621064+0000", 2024-04-18T21:05:56.814 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0060029200000000001 2024-04-18T21:05:56.814 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.814 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.814 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:56.814 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621211+0000", 2024-04-18T21:05:56.814 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000147224 2024-04-18T21:05:56.814 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.814 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.814 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:56.814 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621396+0000", 2024-04-18T21:05:56.814 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018454699999999999 2024-04-18T21:05:56.814 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.815 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.815 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:56.815 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.622517+0000", 2024-04-18T21:05:56.815 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001121424 2024-04-18T21:05:56.815 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.815 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.815 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:56.815 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623571+0000", 2024-04-18T21:05:56.815 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010538660000000001 2024-04-18T21:05:56.815 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.815 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.815 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:56.815 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623658+0000", 2024-04-18T21:05:56.815 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6439000000000004e-05 2024-04-18T21:05:56.815 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:56.816 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:56.816 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:56.816 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623719+0000", 2024-04-18T21:05:56.816 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1295000000000002e-05 2024-04-18T21:05:56.816 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:56.816 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:56.816 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:56.816 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:56.816 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:56.816 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:05:56.818 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:05:56.818 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:56.819+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:56.850 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:05:56.918 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:56.919+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:56.947 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:05:56.947 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:05:56.947 INFO:teuthology.orchestra.run.smithi132.stdout: "num_ops": 0 2024-04-18T21:05:56.947 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:05:56.961 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:05:57.012 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:05:57.012 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:05:57.019 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:57.019+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:57.022 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-18T21:05:57.033 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1: {} 2024-04-18T21:05:57.033 INFO:teuthology.orchestra.run.smithi078.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:05:57.069 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:05:57.069 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:05:57.082 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:57.083 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:57.097 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:05:57.120 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:57.119+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:57.212 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:57.212 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:57.220 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:57.219+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:57.226 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:05:57.321 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:57.319+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:57.357 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:57.357 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:57.371 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:05:57.422 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:57.423+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:57.523 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:57.523+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:57.534 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:57.534 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:57.548 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:05:57.633 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:57.635+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:57.708 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:57.708 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:57.723 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:05:57.725 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:57.727+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:57.826 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:57.827+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:57.854 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:57.854 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:57.868 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:05:57.926 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:57.927+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:57.986 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:57.986 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:58.000 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:05:58.019 INFO:teuthology.orchestra.run.smithi078.stderr:noscrub is set 2024-04-18T21:05:58.027 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:58.027+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:58.128 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:58.127+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:58.162 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:58.162 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:58.176 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:05:58.228 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:58.231+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:58.308 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:58.308 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:58.324 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:05:58.329 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:58.331+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:58.430 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:58.431+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:58.443 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:58.443 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:58.457 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:05:58.531 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:58.531+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:58.579 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:58.579 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:58.593 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:05:58.632 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:58.635+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:58.723 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:58.723 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:58.733 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:58.735+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:58.737 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:05:58.834 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:58.831+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:58.902 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:58.902 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:58.916 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:05:58.935 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:58.935+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:59.008 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-18T21:05:59.008 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-18T21:05:59.009 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-04-18T21:05:59.009 INFO:tasks.thrashosds.thrasher:Setting osd 2 primary_affinity to 0.591237 2024-04-18T21:05:59.009 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 0.5912374448085611 2024-04-18T21:05:59.036 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:59.035+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:59.038 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:59.038 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:59.052 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:05:59.087 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:05:59.137 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:59.135+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:59.183 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:05:59.183 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:05:59.197 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:05:59.241 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:59.243+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:59.247 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:05:59.248 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:05:59.282 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1: {} 2024-04-18T21:05:59.282 INFO:teuthology.orchestra.run.smithi078.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:05:59.316 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:05:59.316 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:05:59.316 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:05:59.317 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:05:59.317 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-18T21:05:59.317 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-18T21:05:59.317 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:05:59.330 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:05:59.339 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:59.339+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:59.440 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:05:59.443+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:05:59.494 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:05:59.495 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-18T21:05:59.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-18T21:05:59.495 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:05:59.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.495 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:59.495 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:05:59.495 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 53.880659479000002, 2024-04-18T21:05:59.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.034065303999999998, 2024-04-18T21:05:59.495 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:59.495 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:59.495 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:59.495 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:59.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.495 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:59.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:05:59.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:59.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:59.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:05:59.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:59.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:59.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615254+0000", 2024-04-18T21:05:59.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7829999999999999e-06 2024-04-18T21:05:59.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.497 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:59.497 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615267+0000", 2024-04-18T21:05:59.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3334e-05 2024-04-18T21:05:59.497 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.497 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:59.497 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615294+0000", 2024-04-18T21:05:59.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7271999999999999e-05 2024-04-18T21:05:59.497 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.497 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.497 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615321+0000", 2024-04-18T21:05:59.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.637e-05 2024-04-18T21:05:59.497 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.498 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:59.498 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615479+0000", 2024-04-18T21:05:59.498 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000158493 2024-04-18T21:05:59.498 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.498 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.498 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:59.498 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615498+0000", 2024-04-18T21:05:59.498 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9148999999999999e-05 2024-04-18T21:05:59.498 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.498 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.498 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:59.498 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632915+0000", 2024-04-18T21:05:59.498 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.017416551999999998 2024-04-18T21:05:59.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:59.499 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633302+0000", 2024-04-18T21:05:59.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00038725000000000001 2024-04-18T21:05:59.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:59.499 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633638+0000", 2024-04-18T21:05:59.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000335946 2024-04-18T21:05:59.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:59.500 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645976+0000", 2024-04-18T21:05:59.500 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012337617 2024-04-18T21:05:59.500 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.500 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:59.500 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649080+0000", 2024-04-18T21:05:59.500 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031038929999999999 2024-04-18T21:05:59.500 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.500 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:59.500 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649207+0000", 2024-04-18T21:05:59.500 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000127537 2024-04-18T21:05:59.500 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.500 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:59.501 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649316+0000", 2024-04-18T21:05:59.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109108 2024-04-18T21:05:59.501 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:59.501 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:59.501 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:59.501 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.501 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.501 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:59.501 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:05:59.501 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 53.880526101999997, 2024-04-18T21:05:59.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036275764000000002, 2024-04-18T21:05:59.501 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:59.501 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:59.501 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:59.501 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:59.502 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.502 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:59.502 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:05:59.502 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:59.502 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.502 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.502 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:59.502 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:05:59.502 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:59.502 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:59.503 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615386+0000", 2024-04-18T21:05:59.503 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.573e-06 2024-04-18T21:05:59.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:59.503 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:05:59.503 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0723999999999999e-05 2024-04-18T21:05:59.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:59.503 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615418+0000", 2024-04-18T21:05:59.503 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0902000000000001e-05 2024-04-18T21:05:59.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.504 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.504 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615433+0000", 2024-04-18T21:05:59.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5319999999999999e-05 2024-04-18T21:05:59.504 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.504 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:59.504 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615659+0000", 2024-04-18T21:05:59.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000226095 2024-04-18T21:05:59.504 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.504 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:59.504 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:59.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1276e-05 2024-04-18T21:05:59.505 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.505 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.505 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:59.505 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643654+0000", 2024-04-18T21:05:59.505 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027983238000000001 2024-04-18T21:05:59.505 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.505 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.505 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:59.505 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643868+0000", 2024-04-18T21:05:59.505 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000214305 2024-04-18T21:05:59.505 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.506 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.506 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:59.506 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:05:59.506 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035892200000000002 2024-04-18T21:05:59.506 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.506 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.506 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:59.506 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646056+0000", 2024-04-18T21:05:59.506 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001829172 2024-04-18T21:05:59.506 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.506 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.506 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:59.506 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651406+0000", 2024-04-18T21:05:59.506 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0053504800000000003 2024-04-18T21:05:59.507 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.507 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.507 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:59.507 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651551+0000", 2024-04-18T21:05:59.507 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014427999999999999 2024-04-18T21:05:59.507 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.507 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.507 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:59.507 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651660+0000", 2024-04-18T21:05:59.507 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109477 2024-04-18T21:05:59.507 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:59.507 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:59.507 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:59.507 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.507 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.508 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:59.508 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:05:59.508 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 53.880452720000001, 2024-04-18T21:05:59.508 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045668994999999997, 2024-04-18T21:05:59.508 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:59.508 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:59.508 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:59.508 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:59.508 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.508 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:59.508 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:05:59.508 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:59.508 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.508 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.509 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:59.509 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:05:59.509 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:59.509 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.509 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.509 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:59.509 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615459+0000", 2024-04-18T21:05:59.509 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5030000000000001e-06 2024-04-18T21:05:59.509 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.509 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.509 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:59.509 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615506+0000", 2024-04-18T21:05:59.509 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6872000000000001e-05 2024-04-18T21:05:59.509 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.509 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.510 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:59.510 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615527+0000", 2024-04-18T21:05:59.510 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0763000000000001e-05 2024-04-18T21:05:59.510 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.510 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.510 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.510 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615551+0000", 2024-04-18T21:05:59.510 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4159e-05 2024-04-18T21:05:59.510 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.510 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.510 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:59.510 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615736+0000", 2024-04-18T21:05:59.510 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018499599999999999 2024-04-18T21:05:59.510 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.511 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.511 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:59.511 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615748+0000", 2024-04-18T21:05:59.511 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2272999999999999e-05 2024-04-18T21:05:59.511 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.511 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.511 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:59.511 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635481+0000", 2024-04-18T21:05:59.511 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019732772999999999 2024-04-18T21:05:59.511 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.511 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.511 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:59.511 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635791+0000", 2024-04-18T21:05:59.511 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031013299999999998 2024-04-18T21:05:59.511 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.512 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.512 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:59.512 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636101+0000", 2024-04-18T21:05:59.512 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030943300000000002 2024-04-18T21:05:59.512 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.512 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.512 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:59.512 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646043+0000", 2024-04-18T21:05:59.512 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099428139999999995 2024-04-18T21:05:59.512 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.512 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.512 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:59.512 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660991+0000", 2024-04-18T21:05:59.512 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014947142 2024-04-18T21:05:59.512 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.513 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.513 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:59.513 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661061+0000", 2024-04-18T21:05:59.513 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0438000000000006e-05 2024-04-18T21:05:59.513 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.513 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.513 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:59.513 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661127+0000", 2024-04-18T21:05:59.513 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5696000000000003e-05 2024-04-18T21:05:59.513 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:59.513 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:59.513 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:59.513 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.513 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.514 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:59.514 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:59.514 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 53.880240292000003, 2024-04-18T21:05:59.514 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045745085999999997, 2024-04-18T21:05:59.514 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:59.514 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:59.514 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:59.514 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:59.514 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.514 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:59.514 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:59.514 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:59.514 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.515 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.515 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:59.515 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:05:59.515 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:59.515 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.515 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.515 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:59.515 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:05:59.515 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7400000000000001e-06 2024-04-18T21:05:59.515 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.515 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.515 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:59.515 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:05:59.515 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8133e-05 2024-04-18T21:05:59.515 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.516 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.516 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:59.516 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615726+0000", 2024-04-18T21:05:59.516 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6132e-05 2024-04-18T21:05:59.516 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.516 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.516 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.516 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615742+0000", 2024-04-18T21:05:59.516 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6157000000000001e-05 2024-04-18T21:05:59.516 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.516 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.516 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:59.516 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615937+0000", 2024-04-18T21:05:59.516 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000194768 2024-04-18T21:05:59.516 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.517 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.517 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:59.517 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615950+0000", 2024-04-18T21:05:59.517 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3084e-05 2024-04-18T21:05:59.517 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.517 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.517 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:59.517 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643676+0000", 2024-04-18T21:05:59.517 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027725639999999999 2024-04-18T21:05:59.517 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.517 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.517 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:59.517 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643867+0000", 2024-04-18T21:05:59.517 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019075900000000001 2024-04-18T21:05:59.517 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.518 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.518 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:05:59.518 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:05:59.518 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036013799999999997 2024-04-18T21:05:59.518 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.518 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.518 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:59.518 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646068+0000", 2024-04-18T21:05:59.518 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001841536 2024-04-18T21:05:59.518 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.518 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.518 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:59.518 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661184+0000", 2024-04-18T21:05:59.519 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015115458999999999 2024-04-18T21:05:59.519 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.519 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.519 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:59.519 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661283+0000", 2024-04-18T21:05:59.519 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9502999999999999e-05 2024-04-18T21:05:59.519 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.519 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.519 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:59.519 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661415+0000", 2024-04-18T21:05:59.519 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000132037 2024-04-18T21:05:59.519 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:59.519 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:59.519 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:59.519 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.520 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.520 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:59.520 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:05:59.520 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 53.880118605, 2024-04-18T21:05:59.520 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036185947000000003, 2024-04-18T21:05:59.520 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:59.520 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:59.520 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:59.520 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:59.520 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.520 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:59.520 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:05:59.520 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:59.520 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.520 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.521 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:59.521 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:05:59.521 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:59.521 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.521 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.521 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:59.521 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615794+0000", 2024-04-18T21:05:59.521 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6440000000000001e-06 2024-04-18T21:05:59.521 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.521 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.521 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:59.521 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615803+0000", 2024-04-18T21:05:59.521 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1220000000000001e-06 2024-04-18T21:05:59.521 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.521 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.522 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:59.522 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615827+0000", 2024-04-18T21:05:59.522 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3997000000000001e-05 2024-04-18T21:05:59.522 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.522 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.522 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.522 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615899+0000", 2024-04-18T21:05:59.522 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2741e-05 2024-04-18T21:05:59.522 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.522 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.522 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:59.522 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616019+0000", 2024-04-18T21:05:59.522 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119874 2024-04-18T21:05:59.523 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.523 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.523 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:59.523 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616029+0000", 2024-04-18T21:05:59.523 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:05:59.523 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.523 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.523 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:59.523 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644823+0000", 2024-04-18T21:05:59.523 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.028793151999999999 2024-04-18T21:05:59.523 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.523 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.523 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:59.523 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645106+0000", 2024-04-18T21:05:59.523 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028379700000000002 2024-04-18T21:05:59.524 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.524 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.524 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:59.524 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645294+0000", 2024-04-18T21:05:59.524 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000187181 2024-04-18T21:05:59.524 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.524 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.524 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:59.524 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646763+0000", 2024-04-18T21:05:59.524 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0014691050000000001 2024-04-18T21:05:59.524 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.524 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.524 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:59.524 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651784+0000", 2024-04-18T21:05:59.524 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050211650000000002 2024-04-18T21:05:59.525 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.525 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.525 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:59.525 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651876+0000", 2024-04-18T21:05:59.525 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2503999999999994e-05 2024-04-18T21:05:59.525 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.525 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.525 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:59.525 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651978+0000", 2024-04-18T21:05:59.525 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000101475 2024-04-18T21:05:59.525 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:59.525 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:59.525 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:59.525 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.525 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.526 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:59.526 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:59.526 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 53.879969998, 2024-04-18T21:05:59.526 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032262322000000003, 2024-04-18T21:05:59.526 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:59.526 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:59.526 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:59.526 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:59.526 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.526 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:59.526 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:59.526 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:59.526 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.526 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.527 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:59.527 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:05:59.527 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:59.527 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.527 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.527 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:59.527 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615943+0000", 2024-04-18T21:05:59.527 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1959999999999998e-06 2024-04-18T21:05:59.527 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.527 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.527 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:59.527 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615956+0000", 2024-04-18T21:05:59.527 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3424000000000001e-05 2024-04-18T21:05:59.527 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.528 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.528 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:59.528 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615983+0000", 2024-04-18T21:05:59.528 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7072000000000001e-05 2024-04-18T21:05:59.528 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.528 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.528 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.528 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616006+0000", 2024-04-18T21:05:59.528 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2823000000000002e-05 2024-04-18T21:05:59.528 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.528 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.528 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:59.528 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616156+0000", 2024-04-18T21:05:59.528 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014962299999999999 2024-04-18T21:05:59.528 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.529 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.529 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:59.529 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616174+0000", 2024-04-18T21:05:59.529 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8082999999999999e-05 2024-04-18T21:05:59.529 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.529 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.529 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:59.529 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.629952+0000", 2024-04-18T21:05:59.529 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013778514 2024-04-18T21:05:59.529 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.529 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.529 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:59.530 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630201+0000", 2024-04-18T21:05:59.530 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024918100000000001 2024-04-18T21:05:59.530 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.530 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.530 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:59.530 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630386+0000", 2024-04-18T21:05:59.530 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018436900000000001 2024-04-18T21:05:59.530 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.530 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.530 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:59.530 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643169+0000", 2024-04-18T21:05:59.530 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012782774 2024-04-18T21:05:59.530 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.531 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.531 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:59.531 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.647924+0000", 2024-04-18T21:05:59.531 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004755787 2024-04-18T21:05:59.531 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.531 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.531 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:59.531 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648069+0000", 2024-04-18T21:05:59.531 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014459600000000001 2024-04-18T21:05:59.531 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.531 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.531 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:59.531 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648203+0000", 2024-04-18T21:05:59.531 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013388000000000001 2024-04-18T21:05:59.531 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:59.532 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:59.532 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:59.532 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.532 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.532 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:59.532 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:05:59.532 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 53.879861734000002, 2024-04-18T21:05:59.532 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032489736999999998, 2024-04-18T21:05:59.532 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:59.532 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:59.532 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:59.532 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:59.532 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.532 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:59.532 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:05:59.533 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:59.533 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.533 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.533 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:59.533 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:05:59.533 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:59.533 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.533 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.533 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:59.533 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616050+0000", 2024-04-18T21:05:59.533 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.606e-06 2024-04-18T21:05:59.533 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.533 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.533 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:59.534 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616061+0000", 2024-04-18T21:05:59.534 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0463e-05 2024-04-18T21:05:59.534 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.534 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.534 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:59.534 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616092+0000", 2024-04-18T21:05:59.534 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1415999999999999e-05 2024-04-18T21:05:59.534 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.534 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.534 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.534 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616109+0000", 2024-04-18T21:05:59.534 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6557000000000001e-05 2024-04-18T21:05:59.534 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.534 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.535 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:59.535 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616358+0000", 2024-04-18T21:05:59.535 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000249077 2024-04-18T21:05:59.535 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.535 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.535 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:59.535 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616370+0000", 2024-04-18T21:05:59.535 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2037e-05 2024-04-18T21:05:59.535 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.535 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.535 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:59.535 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.634920+0000", 2024-04-18T21:05:59.535 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018550397 2024-04-18T21:05:59.535 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.535 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.536 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:59.536 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640420+0000", 2024-04-18T21:05:59.536 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055000539999999999 2024-04-18T21:05:59.536 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.536 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.536 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:59.536 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648538+0000", 2024-04-18T21:05:59.536 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0081181299999999994 2024-04-18T21:05:59.536 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:59.536 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:59.536 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:59.536 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.536 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.536 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:59.537 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:05:59.537 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 53.879777412999999, 2024-04-18T21:05:59.537 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036090029000000003, 2024-04-18T21:05:59.537 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:59.537 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:59.537 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:59.537 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:59.537 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.537 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:59.537 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:05:59.537 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:59.537 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.537 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.537 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:59.538 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:05:59.538 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:59.538 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.538 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.538 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:59.538 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616134+0000", 2024-04-18T21:05:59.538 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.353e-06 2024-04-18T21:05:59.538 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.538 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.538 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:59.538 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616141+0000", 2024-04-18T21:05:59.538 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2770000000000002e-06 2024-04-18T21:05:59.538 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.539 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.539 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:59.539 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616160+0000", 2024-04-18T21:05:59.539 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.91e-05 2024-04-18T21:05:59.539 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.539 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.539 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.539 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616170+0000", 2024-04-18T21:05:59.539 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7699999999999996e-06 2024-04-18T21:05:59.539 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.539 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.539 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:59.539 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616275+0000", 2024-04-18T21:05:59.539 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105313 2024-04-18T21:05:59.540 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.540 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.540 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:05:59.540 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616288+0000", 2024-04-18T21:05:59.540 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3027000000000001e-05 2024-04-18T21:05:59.540 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.540 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.540 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:59.540 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646160+0000", 2024-04-18T21:05:59.540 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.029872019 2024-04-18T21:05:59.540 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.540 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.540 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:59.540 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646368+0000", 2024-04-18T21:05:59.540 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020811899999999999 2024-04-18T21:05:59.541 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.541 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.541 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:59.541 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652223+0000", 2024-04-18T21:05:59.541 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.005855051 2024-04-18T21:05:59.541 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:59.541 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:59.541 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:59.541 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.541 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.541 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:05:59.541 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:05:59.541 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 53.879719844, 2024-04-18T21:05:59.541 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043572403000000003, 2024-04-18T21:05:59.541 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:59.542 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:59.542 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:59.542 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:59.542 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.542 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:59.542 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:05:59.542 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:59.542 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.542 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.542 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:59.543 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:05:59.543 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:59.543 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.543 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.543 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:59.543 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616192+0000", 2024-04-18T21:05:59.543 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:05:59.543 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.543 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.543 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:59.543 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616203+0000", 2024-04-18T21:05:59.543 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0890000000000001e-05 2024-04-18T21:05:59.543 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.543 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.543 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:59.544 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616223+0000", 2024-04-18T21:05:59.544 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0409000000000001e-05 2024-04-18T21:05:59.544 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.544 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.544 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.544 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616238+0000", 2024-04-18T21:05:59.544 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5160000000000001e-05 2024-04-18T21:05:59.544 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.544 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.544 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:59.544 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616343+0000", 2024-04-18T21:05:59.544 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000104831 2024-04-18T21:05:59.544 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.544 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.545 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:59.545 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616357+0000", 2024-04-18T21:05:59.545 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3686000000000001e-05 2024-04-18T21:05:59.545 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.545 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.545 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:59.545 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635912+0000", 2024-04-18T21:05:59.545 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019554944000000001 2024-04-18T21:05:59.545 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.545 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.545 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:59.545 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636231+0000", 2024-04-18T21:05:59.545 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000318766 2024-04-18T21:05:59.545 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.546 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.546 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:59.546 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659763+0000", 2024-04-18T21:05:59.546 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023532474000000001 2024-04-18T21:05:59.546 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:59.546 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:59.546 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:59.546 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.546 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.546 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:59.546 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:05:59.546 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 53.875791137, 2024-04-18T21:05:59.546 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015007971, 2024-04-18T21:05:59.546 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:59.547 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:59.547 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:59.547 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:59.547 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.547 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:59.547 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:05:59.547 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:59.547 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.547 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.547 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:59.547 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:05:59.547 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:59.547 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.547 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.547 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:59.548 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620120+0000", 2024-04-18T21:05:59.548 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0359999999999999e-06 2024-04-18T21:05:59.548 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.548 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.548 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:59.548 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620157+0000", 2024-04-18T21:05:59.548 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6636e-05 2024-04-18T21:05:59.548 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.548 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.548 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:59.548 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620177+0000", 2024-04-18T21:05:59.548 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0247000000000001e-05 2024-04-18T21:05:59.548 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.548 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.549 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.549 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620195+0000", 2024-04-18T21:05:59.549 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7819e-05 2024-04-18T21:05:59.549 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.549 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.549 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:59.549 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620342+0000", 2024-04-18T21:05:59.549 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014643300000000001 2024-04-18T21:05:59.549 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.549 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.549 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:59.549 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620405+0000", 2024-04-18T21:05:59.549 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3522000000000006e-05 2024-04-18T21:05:59.549 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.549 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.550 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:59.550 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635016+0000", 2024-04-18T21:05:59.550 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014610840999999999 2024-04-18T21:05:59.550 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.550 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.550 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:59.550 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635127+0000", 2024-04-18T21:05:59.550 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111437 2024-04-18T21:05:59.550 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:59.550 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:59.550 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:59.550 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.550 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.551 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:05:59.551 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:05:59.551 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 53.875683869, 2024-04-18T21:05:59.551 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012693296, 2024-04-18T21:05:59.551 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:59.551 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:59.551 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:59.551 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:59.551 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.551 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:59.551 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:05:59.551 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:59.551 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.551 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.551 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:59.552 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:05:59.552 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:59.552 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.552 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.552 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:59.552 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620228+0000", 2024-04-18T21:05:59.552 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:05:59.552 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.552 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.552 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:59.552 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620236+0000", 2024-04-18T21:05:59.552 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.303e-06 2024-04-18T21:05:59.552 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.552 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.552 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:59.553 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620255+0000", 2024-04-18T21:05:59.553 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9406e-05 2024-04-18T21:05:59.553 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.553 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.553 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.553 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620274+0000", 2024-04-18T21:05:59.553 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8940000000000002e-05 2024-04-18T21:05:59.553 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.553 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.553 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:59.553 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:05:59.553 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001558753 2024-04-18T21:05:59.553 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.553 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.554 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:59.554 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621879+0000", 2024-04-18T21:05:59.554 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6359000000000001e-05 2024-04-18T21:05:59.554 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.554 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.554 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:59.554 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632841+0000", 2024-04-18T21:05:59.554 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010961907 2024-04-18T21:05:59.554 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.554 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.554 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:59.554 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632920+0000", 2024-04-18T21:05:59.554 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8714999999999994e-05 2024-04-18T21:05:59.554 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:59.555 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:59.555 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:59.555 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.555 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.555 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:59.555 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:05:59.555 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 53.874138105999997, 2024-04-18T21:05:59.555 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013445702, 2024-04-18T21:05:59.555 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:59.555 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:59.555 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:59.555 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:59.555 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.555 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:59.555 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:05:59.556 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:59.556 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.556 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.556 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:59.556 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:05:59.556 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:59.556 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.556 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.556 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:59.556 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621774+0000", 2024-04-18T21:05:59.556 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2500000000000001e-06 2024-04-18T21:05:59.556 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.556 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.556 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:59.557 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621786+0000", 2024-04-18T21:05:59.557 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2636000000000001e-05 2024-04-18T21:05:59.557 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.557 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.557 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:59.557 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621814+0000", 2024-04-18T21:05:59.557 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7823000000000001e-05 2024-04-18T21:05:59.557 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.557 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.557 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.557 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621844+0000", 2024-04-18T21:05:59.557 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9589000000000001e-05 2024-04-18T21:05:59.557 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.557 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.557 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:59.558 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622253+0000", 2024-04-18T21:05:59.558 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040963700000000002 2024-04-18T21:05:59.558 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.558 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.558 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:59.558 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622304+0000", 2024-04-18T21:05:59.558 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0868999999999997e-05 2024-04-18T21:05:59.558 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.558 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.558 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:59.558 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635133+0000", 2024-04-18T21:05:59.558 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012829136 2024-04-18T21:05:59.558 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.558 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.559 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:59.559 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635218+0000", 2024-04-18T21:05:59.559 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4761999999999999e-05 2024-04-18T21:05:59.559 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:59.559 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:59.559 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:59.559 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.559 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.559 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:05:59.559 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:05:59.559 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 53.874011346000003, 2024-04-18T21:05:59.559 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014162065, 2024-04-18T21:05:59.559 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:59.559 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:59.560 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:59.560 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:59.560 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.560 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:59.560 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:05:59.560 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:59.560 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.560 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.560 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:59.560 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:05:59.560 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:59.560 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.560 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.560 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:59.560 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621900+0000", 2024-04-18T21:05:59.561 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:05:59.561 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.561 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.561 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:59.561 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621910+0000", 2024-04-18T21:05:59.561 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0207000000000001e-05 2024-04-18T21:05:59.561 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.561 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.561 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:59.561 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621932+0000", 2024-04-18T21:05:59.561 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1789000000000001e-05 2024-04-18T21:05:59.561 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.561 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.561 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.561 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621946+0000", 2024-04-18T21:05:59.562 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4212999999999999e-05 2024-04-18T21:05:59.562 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.562 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.562 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:59.562 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624477+0000", 2024-04-18T21:05:59.562 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025303470000000001 2024-04-18T21:05:59.562 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.562 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.562 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:59.562 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624525+0000", 2024-04-18T21:05:59.562 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8084999999999998e-05 2024-04-18T21:05:59.562 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.562 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.562 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:59.563 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635976+0000", 2024-04-18T21:05:59.563 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.011451368999999999 2024-04-18T21:05:59.563 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.563 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.563 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:59.563 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636061+0000", 2024-04-18T21:05:59.563 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5094999999999998e-05 2024-04-18T21:05:59.563 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:59.563 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:59.563 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:59.563 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.563 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.563 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:05:59.563 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:05:59.563 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 53.864775721000001, 2024-04-18T21:05:59.564 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0098014739999999993, 2024-04-18T21:05:59.564 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:59.564 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:59.564 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:05:59.564 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:59.564 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.564 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:59.564 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:05:59.564 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:59.564 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.564 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.564 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:59.564 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:05:59.564 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:59.565 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.565 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.565 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:59.565 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631136+0000", 2024-04-18T21:05:59.565 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0139999999999999e-06 2024-04-18T21:05:59.565 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.565 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.565 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:59.565 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631152+0000", 2024-04-18T21:05:59.565 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6365999999999999e-05 2024-04-18T21:05:59.565 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.565 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.565 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:59.565 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631961+0000", 2024-04-18T21:05:59.565 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00080873100000000003 2024-04-18T21:05:59.566 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.566 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.566 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.566 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632021+0000", 2024-04-18T21:05:59.566 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0541999999999997e-05 2024-04-18T21:05:59.566 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.566 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.566 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:59.566 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633539+0000", 2024-04-18T21:05:59.566 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015175639999999999 2024-04-18T21:05:59.566 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.566 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.566 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:59.566 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640936+0000", 2024-04-18T21:05:59.567 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007397257 2024-04-18T21:05:59.567 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:59.567 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:59.567 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:59.567 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.567 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.567 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-18T21:05:59.567 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:05:59.567 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 53.847314288, 2024-04-18T21:05:59.567 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00073592199999999997, 2024-04-18T21:05:59.567 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:59.567 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:59.567 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:59.567 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:59.568 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.568 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:59.568 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:05:59.568 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:59.568 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.568 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.568 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:59.568 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:05:59.568 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:59.568 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.568 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.568 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:59.568 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648597+0000", 2024-04-18T21:05:59.568 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:05:59.568 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.569 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.569 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:59.569 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648605+0000", 2024-04-18T21:05:59.569 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3960000000000006e-06 2024-04-18T21:05:59.569 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.569 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.569 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:59.569 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648625+0000", 2024-04-18T21:05:59.569 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9987e-05 2024-04-18T21:05:59.569 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.569 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.569 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.569 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648643+0000", 2024-04-18T21:05:59.569 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7079e-05 2024-04-18T21:05:59.569 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.570 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.570 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:59.570 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649043+0000", 2024-04-18T21:05:59.570 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040083399999999998 2024-04-18T21:05:59.570 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.570 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.570 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:59.570 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649062+0000", 2024-04-18T21:05:59.570 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9052999999999999e-05 2024-04-18T21:05:59.570 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.570 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.570 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:59.570 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649332+0000", 2024-04-18T21:05:59.570 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026971999999999999 2024-04-18T21:05:59.571 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:59.571 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:59.571 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:59.571 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.571 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.571 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:05:59.571 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:05:59.571 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 53.844539386999998, 2024-04-18T21:05:59.571 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00086123999999999999, 2024-04-18T21:05:59.571 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:59.571 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:59.571 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:05:59.571 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:59.571 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.571 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:59.572 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:05:59.572 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:59.572 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.572 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.572 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:59.572 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:05:59.572 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:59.572 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.572 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.572 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:59.572 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651372+0000", 2024-04-18T21:05:59.572 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7599999999999997e-07 2024-04-18T21:05:59.572 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.572 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.572 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:59.573 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651377+0000", 2024-04-18T21:05:59.573 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.22e-06 2024-04-18T21:05:59.573 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.573 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.573 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:59.573 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651394+0000", 2024-04-18T21:05:59.573 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6646999999999998e-05 2024-04-18T21:05:59.573 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.573 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.573 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.573 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651427+0000", 2024-04-18T21:05:59.573 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3682e-05 2024-04-18T21:05:59.573 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.573 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.573 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:59.574 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652029+0000", 2024-04-18T21:05:59.574 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00060152199999999995 2024-04-18T21:05:59.574 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.574 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.574 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:59.574 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652232+0000", 2024-04-18T21:05:59.574 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020359299999999999 2024-04-18T21:05:59.574 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:59.574 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:59.574 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:59.574 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.574 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.574 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:05:59.574 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:05:59.575 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 53.836512425000002, 2024-04-18T21:05:59.575 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0017426200000000001, 2024-04-18T21:05:59.575 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:59.575 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:59.575 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:59.575 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:59.575 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.575 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:59.575 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:05:59.575 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:59.575 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.575 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.575 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:59.575 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:05:59.576 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:59.576 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.576 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.576 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:59.576 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659399+0000", 2024-04-18T21:05:59.576 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6000000000000002e-07 2024-04-18T21:05:59.576 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.576 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.576 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:59.576 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659405+0000", 2024-04-18T21:05:59.576 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5069999999999997e-06 2024-04-18T21:05:59.576 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.576 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.576 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:59.576 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659425+0000", 2024-04-18T21:05:59.577 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.927e-05 2024-04-18T21:05:59.577 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.577 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.577 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.577 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659443+0000", 2024-04-18T21:05:59.577 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8051999999999999e-05 2024-04-18T21:05:59.577 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.577 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.577 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:59.577 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660973+0000", 2024-04-18T21:05:59.577 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001530106 2024-04-18T21:05:59.577 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.577 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.577 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:59.578 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660983+0000", 2024-04-18T21:05:59.578 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0516999999999999e-05 2024-04-18T21:05:59.578 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.578 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.578 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:59.578 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661141+0000", 2024-04-18T21:05:59.578 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015730799999999999 2024-04-18T21:05:59.578 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:59.578 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:59.578 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:59.578 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.578 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.578 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:05:59.578 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:05:59.579 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 53.836295800000002, 2024-04-18T21:05:59.579 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001812311, 2024-04-18T21:05:59.579 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:59.579 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:59.579 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:05:59.579 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:59.579 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.579 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:59.579 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:05:59.579 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:59.579 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.579 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.579 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:59.579 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:05:59.580 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:59.580 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.580 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.580 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:59.580 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659616+0000", 2024-04-18T21:05:59.580 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.277e-06 2024-04-18T21:05:59.580 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.580 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.580 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:59.580 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659625+0000", 2024-04-18T21:05:59.580 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5359999999999998e-06 2024-04-18T21:05:59.580 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.580 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.580 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:59.580 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659647+0000", 2024-04-18T21:05:59.581 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1857000000000001e-05 2024-04-18T21:05:59.581 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.581 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.581 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.581 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659664+0000", 2024-04-18T21:05:59.581 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6405999999999998e-05 2024-04-18T21:05:59.581 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.581 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.581 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:59.581 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661169+0000", 2024-04-18T21:05:59.581 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015054179999999999 2024-04-18T21:05:59.581 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.581 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.581 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:59.581 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661177+0000", 2024-04-18T21:05:59.582 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9680000000000006e-06 2024-04-18T21:05:59.582 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.582 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.582 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:59.582 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661427+0000", 2024-04-18T21:05:59.582 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024984900000000001 2024-04-18T21:05:59.582 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:59.582 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:59.582 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:59.582 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.582 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.582 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-18T21:05:59.582 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:05:59.582 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 51.883375192000003, 2024-04-18T21:05:59.583 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0030975030000000001, 2024-04-18T21:05:59.583 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:59.583 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:59.583 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:59.583 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:59.583 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.583 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:59.583 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:05:59.583 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:59.583 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.583 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.583 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:59.583 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:05:59.583 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:59.583 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.584 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.584 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:59.584 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612538+0000", 2024-04-18T21:05:59.584 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6259999999999999e-06 2024-04-18T21:05:59.584 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.584 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.584 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:59.584 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612552+0000", 2024-04-18T21:05:59.584 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4073999999999999e-05 2024-04-18T21:05:59.584 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.584 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.584 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:59.584 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612585+0000", 2024-04-18T21:05:59.584 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3504999999999999e-05 2024-04-18T21:05:59.585 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.585 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.585 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.585 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612601+0000", 2024-04-18T21:05:59.585 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5194000000000001e-05 2024-04-18T21:05:59.585 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.585 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.585 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:59.585 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612746+0000", 2024-04-18T21:05:59.585 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145666 2024-04-18T21:05:59.585 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.585 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.585 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:59.585 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612953+0000", 2024-04-18T21:05:59.585 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000207109 2024-04-18T21:05:59.586 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.586 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.586 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:59.586 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.613134+0000", 2024-04-18T21:05:59.586 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018041300000000001 2024-04-18T21:05:59.586 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.586 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.586 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:59.586 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.614411+0000", 2024-04-18T21:05:59.586 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0012769929999999999 2024-04-18T21:05:59.586 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.586 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.586 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:59.586 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615441+0000", 2024-04-18T21:05:59.587 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001029917 2024-04-18T21:05:59.587 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.587 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.587 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:59.587 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615522+0000", 2024-04-18T21:05:59.587 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1142000000000003e-05 2024-04-18T21:05:59.587 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.587 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.587 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:59.587 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615633+0000", 2024-04-18T21:05:59.587 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000110864 2024-04-18T21:05:59.587 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:59.587 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:59.587 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:59.587 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.588 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.588 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-18T21:05:59.588 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:05:59.588 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 33.881089381000002, 2024-04-18T21:05:59.588 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088979039999999999, 2024-04-18T21:05:59.588 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:05:59.588 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:05:59.588 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:59.588 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:05:59.588 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.588 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:05:59.588 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:05:59.588 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:59.588 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.588 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.589 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:05:59.589 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:05:59.589 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:05:59.589 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.589 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.589 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:05:59.589 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614825+0000", 2024-04-18T21:05:59.589 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4829999999999999e-06 2024-04-18T21:05:59.589 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.589 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.589 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:05:59.589 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614843+0000", 2024-04-18T21:05:59.589 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8777e-05 2024-04-18T21:05:59.590 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.590 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.590 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:05:59.590 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614884+0000", 2024-04-18T21:05:59.590 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1051999999999999e-05 2024-04-18T21:05:59.590 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.590 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.590 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:05:59.590 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614903+0000", 2024-04-18T21:05:59.590 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9069999999999999e-05 2024-04-18T21:05:59.590 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.590 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.590 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:59.591 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615047+0000", 2024-04-18T21:05:59.591 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014374400000000001 2024-04-18T21:05:59.591 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.591 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.591 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:05:59.591 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615061+0000", 2024-04-18T21:05:59.591 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4063000000000001e-05 2024-04-18T21:05:59.591 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.591 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.591 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:05:59.591 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621064+0000", 2024-04-18T21:05:59.591 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0060029200000000001 2024-04-18T21:05:59.591 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.591 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.591 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:05:59.592 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621211+0000", 2024-04-18T21:05:59.592 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000147224 2024-04-18T21:05:59.592 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.592 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.592 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:05:59.592 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621396+0000", 2024-04-18T21:05:59.592 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018454699999999999 2024-04-18T21:05:59.592 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.592 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.592 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:05:59.592 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.622517+0000", 2024-04-18T21:05:59.592 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001121424 2024-04-18T21:05:59.592 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.592 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.593 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:05:59.593 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623571+0000", 2024-04-18T21:05:59.593 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010538660000000001 2024-04-18T21:05:59.593 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.593 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.593 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:05:59.593 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623658+0000", 2024-04-18T21:05:59.593 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6439000000000004e-05 2024-04-18T21:05:59.593 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:05:59.593 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:05:59.593 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:05:59.593 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623719+0000", 2024-04-18T21:05:59.593 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1295000000000002e-05 2024-04-18T21:05:59.593 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:59.593 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:59.594 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:59.594 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:05:59.594 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:05:59.594 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:05:59.595 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:59.595+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:59.595 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:05:59.696 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:59.695+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:59.726 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:05:59.726 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:05:59.726 INFO:teuthology.orchestra.run.smithi132.stdout: "num_ops": 0 2024-04-18T21:05:59.726 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:05:59.740 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:05:59.796 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:05:59.795+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:05:59.862 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:05:59.863 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:05:59.863 INFO:teuthology.orchestra.run.smithi132.stdout: "complaint_time": 30, 2024-04-18T21:05:59.863 INFO:teuthology.orchestra.run.smithi132.stdout: "num_blocked_ops": 0 2024-04-18T21:05:59.863 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:05:59.877 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:05:59.897 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:05:59.899+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:05:59.997 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:05:59.997 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 20, 2024-04-18T21:05:59.997 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 600, 2024-04-18T21:05:59.997 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [ 2024-04-18T21:05:59.997 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:59.997 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:05:59.997 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:05:59.997 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 65.084344408999996, 2024-04-18T21:05:59.997 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.02518273, 2024-04-18T21:05:59.997 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:05:59.997 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:05:59.997 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:05:59.998 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:05:59.998 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:05:59.998 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:05:59.998 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 141 2024-04-18T21:05:59.998 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:59.998 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:05:59.998 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:59.998 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:05:59.998 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:05:59.998 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:59.998 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:59.998 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:59.998 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:05:59.999 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:05:59.999 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:05:59.999 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:59.999 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:59.999 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:05:59.999 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911562+0000", 2024-04-18T21:05:59.999 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9300000000000006e-07 2024-04-18T21:05:59.999 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:59.999 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:59.999 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:05:59.999 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911569+0000", 2024-04-18T21:05:59.999 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0169999999999999e-06 2024-04-18T21:05:59.999 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:05:59.999 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:05:59.999 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:00.000 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911582+0000", 2024-04-18T21:06:00.000 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.343e-05 2024-04-18T21:06:00.000 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.000 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.000 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:00.000 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911590+0000", 2024-04-18T21:06:00.000 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.413e-06 2024-04-18T21:06:00.000 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.000 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.000 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:00.000 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.933922+0000", 2024-04-18T21:06:00.000 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.022332093000000001 2024-04-18T21:06:00.000 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.000 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.001 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:00.001 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.934155+0000", 2024-04-18T21:06:00.001 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023378900000000001 2024-04-18T21:06:00.001 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.001 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.001 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:00.001 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.934514+0000", 2024-04-18T21:06:00.001 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00035859200000000003 2024-04-18T21:06:00.001 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.001 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.001 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:00.001 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.935973+0000", 2024-04-18T21:06:00.001 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001458705 2024-04-18T21:06:00.001 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.002 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.002 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:00.002 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936488+0000", 2024-04-18T21:06:00.002 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00051550000000000001 2024-04-18T21:06:00.002 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.002 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.002 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:00.002 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936636+0000", 2024-04-18T21:06:00.002 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014779800000000001 2024-04-18T21:06:00.002 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.002 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.002 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:00.002 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936743+0000", 2024-04-18T21:06:00.003 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010739999999999999 2024-04-18T21:06:00.003 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:00.003 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:00.003 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:00.003 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.003 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.003 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:00.003 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:00.003 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 64.967145435000006, 2024-04-18T21:06:00.003 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023654959999999999, 2024-04-18T21:06:00.003 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:00.003 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:00.003 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:00.003 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:00.004 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:00.004 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:00.004 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 163 2024-04-18T21:06:00.004 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.004 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:00.004 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.004 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:00.004 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:00.004 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:00.004 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.004 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.004 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:00.004 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:00.004 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:00.004 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.005 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.005 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:00.005 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:00.005 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0999999999999998e-07 2024-04-18T21:06:00.005 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.005 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.005 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:00.005 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028766+0000", 2024-04-18T21:06:00.005 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4700000000000001e-06 2024-04-18T21:06:00.005 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.005 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.005 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:00.005 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028775+0000", 2024-04-18T21:06:00.005 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.3190000000000001e-06 2024-04-18T21:06:00.006 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.006 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.006 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:00.006 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028782+0000", 2024-04-18T21:06:00.006 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.2300000000000002e-06 2024-04-18T21:06:00.006 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.006 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.006 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:00.006 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046667+0000", 2024-04-18T21:06:00.006 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017884356000000001 2024-04-18T21:06:00.006 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.006 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.006 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:00.006 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046788+0000", 2024-04-18T21:06:00.007 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012125000000000001 2024-04-18T21:06:00.007 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.007 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.007 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:00.007 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046982+0000", 2024-04-18T21:06:00.007 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019394 2024-04-18T21:06:00.007 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.007 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.007 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:00.007 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051969+0000", 2024-04-18T21:06:00.007 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0049868150000000003 2024-04-18T21:06:00.007 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.007 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.007 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:00.008 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052089+0000", 2024-04-18T21:06:00.008 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011993 2024-04-18T21:06:00.008 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.008 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.008 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:00.009 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052292+0000", 2024-04-18T21:06:00.009 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020345699999999999 2024-04-18T21:06:00.009 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.009 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.009 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:00.009 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052415+0000", 2024-04-18T21:06:00.009 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000122483 2024-04-18T21:06:00.009 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:00.009 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:00.009 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:00.009 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.009 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.009 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:00.009 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:00.009 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 64.967111203000002, 2024-04-18T21:06:00.010 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023864586, 2024-04-18T21:06:00.010 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:00.010 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:00.010 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:00.010 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:00.010 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:00.010 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:00.010 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 164 2024-04-18T21:06:00.010 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.010 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:00.010 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.010 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:00.010 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:00.010 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:00.011 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.011 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.011 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:00.011 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:00.011 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:00.011 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.011 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.011 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:00.011 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028795+0000", 2024-04-18T21:06:00.011 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7999999999999995e-07 2024-04-18T21:06:00.011 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.011 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.011 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:00.012 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028884+0000", 2024-04-18T21:06:00.012 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8997000000000002e-05 2024-04-18T21:06:00.012 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.012 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.012 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:00.012 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028895+0000", 2024-04-18T21:06:00.012 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1647e-05 2024-04-18T21:06:00.012 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.012 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.012 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:00.012 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028903+0000", 2024-04-18T21:06:00.012 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.909e-06 2024-04-18T21:06:00.012 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.012 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.012 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:00.013 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.047818+0000", 2024-04-18T21:06:00.013 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018914337 2024-04-18T21:06:00.013 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.013 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.013 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:00.013 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.048094+0000", 2024-04-18T21:06:00.013 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00027653500000000001 2024-04-18T21:06:00.013 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.013 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.013 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:00.013 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.048471+0000", 2024-04-18T21:06:00.013 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00037705799999999999 2024-04-18T21:06:00.013 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.013 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.014 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:00.014 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052516+0000", 2024-04-18T21:06:00.014 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0040452739999999997 2024-04-18T21:06:00.014 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.014 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.014 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:00.014 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052535+0000", 2024-04-18T21:06:00.014 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.84e-05 2024-04-18T21:06:00.014 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.014 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.014 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:00.014 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052603+0000", 2024-04-18T21:06:00.014 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.8095000000000004e-05 2024-04-18T21:06:00.014 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.015 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.015 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:00.015 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052659+0000", 2024-04-18T21:06:00.015 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5653999999999999e-05 2024-04-18T21:06:00.015 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:00.015 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:00.015 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:00.015 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.015 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.015 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:00.015 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:00.015 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 64.966987759999995, 2024-04-18T21:06:00.015 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024516458000000001, 2024-04-18T21:06:00.015 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:00.015 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:00.016 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:00.016 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:00.016 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:00.016 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:00.016 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 165 2024-04-18T21:06:00.016 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.016 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:00.016 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.016 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:00.016 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:00.016 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:00.016 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.016 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.016 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:00.016 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:00.017 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:00.017 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.017 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.017 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:00.017 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028918+0000", 2024-04-18T21:06:00.017 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8000000000000005e-07 2024-04-18T21:06:00.017 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.017 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.017 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:00.017 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028924+0000", 2024-04-18T21:06:00.017 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5659999999999997e-06 2024-04-18T21:06:00.017 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.017 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.017 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:00.018 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028933+0000", 2024-04-18T21:06:00.018 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.38e-06 2024-04-18T21:06:00.018 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.018 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.018 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:00.018 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028940+0000", 2024-04-18T21:06:00.018 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0060000000000003e-06 2024-04-18T21:06:00.018 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.018 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.018 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:00.018 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.050846+0000", 2024-04-18T21:06:00.018 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021906119000000002 2024-04-18T21:06:00.018 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.018 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.019 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:00.019 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051025+0000", 2024-04-18T21:06:00.019 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017850799999999999 2024-04-18T21:06:00.019 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.019 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.019 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:00.019 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051221+0000", 2024-04-18T21:06:00.019 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019608700000000001 2024-04-18T21:06:00.019 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.019 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.019 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:00.019 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052675+0000", 2024-04-18T21:06:00.019 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0014537899999999999 2024-04-18T21:06:00.019 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.020 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.020 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:00.020 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053311+0000", 2024-04-18T21:06:00.020 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00063613299999999999 2024-04-18T21:06:00.020 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.020 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.020 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:00.020 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053381+0000", 2024-04-18T21:06:00.020 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0074999999999996e-05 2024-04-18T21:06:00.020 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.020 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.020 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:00.020 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053434+0000", 2024-04-18T21:06:00.020 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3013999999999998e-05 2024-04-18T21:06:00.021 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:00.021 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:00.021 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:00.021 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.021 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.021 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:00.021 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:00.021 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 64.853682281000005, 2024-04-18T21:06:00.021 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023772793, 2024-04-18T21:06:00.021 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:00.021 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:00.021 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:00.021 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:00.021 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:00.021 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:00.022 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 187 2024-04-18T21:06:00.022 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.022 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:00.022 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.022 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:00.022 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:00.022 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:00.022 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.022 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.022 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:00.022 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:00.022 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:00.022 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.023 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.023 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:00.023 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142224+0000", 2024-04-18T21:06:00.023 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.47e-07 2024-04-18T21:06:00.023 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.023 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.023 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:00.023 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142233+0000", 2024-04-18T21:06:00.023 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0729999999999994e-06 2024-04-18T21:06:00.023 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.023 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.023 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:00.023 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142255+0000", 2024-04-18T21:06:00.023 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.2535999999999999e-05 2024-04-18T21:06:00.023 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.024 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.024 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:00.024 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142268+0000", 2024-04-18T21:06:00.024 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2686e-05 2024-04-18T21:06:00.024 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.024 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.024 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:00.024 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160497+0000", 2024-04-18T21:06:00.024 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018228779000000001 2024-04-18T21:06:00.024 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.024 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.024 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:00.024 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160634+0000", 2024-04-18T21:06:00.024 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000137315 2024-04-18T21:06:00.025 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.025 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.025 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:00.025 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160831+0000", 2024-04-18T21:06:00.025 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019683100000000001 2024-04-18T21:06:00.025 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.025 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.025 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:00.025 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165129+0000", 2024-04-18T21:06:00.025 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0042981299999999998 2024-04-18T21:06:00.025 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.025 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.025 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:00.025 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165776+0000", 2024-04-18T21:06:00.026 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00064702900000000003 2024-04-18T21:06:00.026 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.026 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.026 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:00.026 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165921+0000", 2024-04-18T21:06:00.026 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014506 2024-04-18T21:06:00.026 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.026 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.026 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:00.026 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165996+0000", 2024-04-18T21:06:00.026 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.4406999999999994e-05 2024-04-18T21:06:00.026 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:00.026 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:00.026 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:00.027 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.027 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.027 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:00.027 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:00.027 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 64.853621683, 2024-04-18T21:06:00.027 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026802157, 2024-04-18T21:06:00.027 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:00.027 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:00.027 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:00.027 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:00.027 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:00.027 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:00.027 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 188 2024-04-18T21:06:00.027 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.028 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:00.028 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.028 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:00.028 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:00.028 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:00.028 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.028 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.028 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:00.028 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:00.028 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:00.028 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.028 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.028 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:00.028 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142284+0000", 2024-04-18T21:06:00.028 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4e-07 2024-04-18T21:06:00.029 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.029 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.029 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:00.029 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142374+0000", 2024-04-18T21:06:00.029 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0099999999999995e-05 2024-04-18T21:06:00.029 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.029 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.029 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:00.029 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142386+0000", 2024-04-18T21:06:00.029 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1770000000000001e-05 2024-04-18T21:06:00.029 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.029 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.029 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:00.029 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142394+0000", 2024-04-18T21:06:00.030 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.2130000000000008e-06 2024-04-18T21:06:00.030 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.030 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.030 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:00.030 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.161743+0000", 2024-04-18T21:06:00.030 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019348644000000002 2024-04-18T21:06:00.030 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.030 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.030 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:00.030 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.161865+0000", 2024-04-18T21:06:00.030 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012210899999999999 2024-04-18T21:06:00.030 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.030 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.031 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:00.031 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.162055+0000", 2024-04-18T21:06:00.031 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000189994 2024-04-18T21:06:00.031 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.031 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.031 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:00.031 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165735+0000", 2024-04-18T21:06:00.031 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0036803270000000002 2024-04-18T21:06:00.031 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.031 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.031 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:00.031 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.168911+0000", 2024-04-18T21:06:00.031 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0031753689999999999 2024-04-18T21:06:00.031 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.032 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.032 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:00.032 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169012+0000", 2024-04-18T21:06:00.032 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010157699999999999 2024-04-18T21:06:00.032 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.032 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.032 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:00.032 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169086+0000", 2024-04-18T21:06:00.032 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3213999999999994e-05 2024-04-18T21:06:00.032 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:00.032 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:00.032 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:00.032 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.032 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.033 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:00.033 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:00.033 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 64.853496376999999, 2024-04-18T21:06:00.033 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026811423000000001, 2024-04-18T21:06:00.033 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:00.033 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:00.033 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:00.033 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:00.033 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:00.033 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:00.033 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 189 2024-04-18T21:06:00.033 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.033 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:00.034 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.034 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:00.034 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:00.034 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:00.034 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.034 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.034 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:00.034 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:00.034 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:00.034 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.034 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.034 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:00.034 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142410+0000", 2024-04-18T21:06:00.034 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:06:00.035 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.035 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.035 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:00.035 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142415+0000", 2024-04-18T21:06:00.035 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.7939999999999999e-06 2024-04-18T21:06:00.035 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.035 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.035 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:00.035 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142470+0000", 2024-04-18T21:06:00.035 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4537999999999999e-05 2024-04-18T21:06:00.035 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.035 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.035 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:00.035 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142481+0000", 2024-04-18T21:06:00.035 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0966e-05 2024-04-18T21:06:00.036 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.036 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.036 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:00.036 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.163493+0000", 2024-04-18T21:06:00.036 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021012444000000002 2024-04-18T21:06:00.036 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.036 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.036 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:00.036 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.163727+0000", 2024-04-18T21:06:00.036 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000233339 2024-04-18T21:06:00.036 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.036 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.036 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:00.036 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.164102+0000", 2024-04-18T21:06:00.036 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000374872 2024-04-18T21:06:00.037 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.037 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.037 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:00.037 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.166528+0000", 2024-04-18T21:06:00.037 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0024258729999999998 2024-04-18T21:06:00.037 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.037 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.037 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:00.037 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169101+0000", 2024-04-18T21:06:00.037 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0025737680000000001 2024-04-18T21:06:00.037 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.037 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.037 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:00.037 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169171+0000", 2024-04-18T21:06:00.037 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0148000000000007e-05 2024-04-18T21:06:00.038 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.038 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.038 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:00.038 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169220+0000", 2024-04-18T21:06:00.038 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8767999999999998e-05 2024-04-18T21:06:00.038 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:00.038 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:00.038 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:00.038 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.038 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.038 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:00.038 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:00.039 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 54.379923824999999, 2024-04-18T21:06:00.039 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024082777999999999, 2024-04-18T21:06:00.039 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:00.039 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:00.039 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:00.039 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:00.039 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.039 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:00.039 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:00.039 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:00.039 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.039 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.039 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:00.039 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:00.039 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:00.040 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.040 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.040 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:00.040 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615984+0000", 2024-04-18T21:06:00.040 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.9869999999999999e-06 2024-04-18T21:06:00.040 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.040 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.040 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:00.040 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615999+0000", 2024-04-18T21:06:00.040 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4646e-05 2024-04-18T21:06:00.040 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.040 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.040 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:00.040 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616028+0000", 2024-04-18T21:06:00.040 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8952999999999999e-05 2024-04-18T21:06:00.041 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.041 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.041 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:00.041 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616052+0000", 2024-04-18T21:06:00.041 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.3941999999999999e-05 2024-04-18T21:06:00.041 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.041 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.041 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:00.041 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618010+0000", 2024-04-18T21:06:00.041 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0019581780000000001 2024-04-18T21:06:00.041 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.041 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.041 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:00.041 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618322+0000", 2024-04-18T21:06:00.041 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00031158899999999997 2024-04-18T21:06:00.042 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.042 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.042 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:00.042 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618587+0000", 2024-04-18T21:06:00.042 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00026495700000000002 2024-04-18T21:06:00.042 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.042 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.042 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:00.042 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629262+0000", 2024-04-18T21:06:00.042 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010675877 2024-04-18T21:06:00.042 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.042 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.042 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:00.042 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.639773+0000", 2024-04-18T21:06:00.042 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0105109 2024-04-18T21:06:00.043 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.043 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.043 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:00.043 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.639926+0000", 2024-04-18T21:06:00.043 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000152349 2024-04-18T21:06:00.043 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.043 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.043 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:00.043 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640064+0000", 2024-04-18T21:06:00.043 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0001384 2024-04-18T21:06:00.043 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:00.043 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:00.043 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:00.043 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.044 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.044 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:00.044 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:00.044 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 54.379811150999998, 2024-04-18T21:06:00.044 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030215005999999999, 2024-04-18T21:06:00.044 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:00.044 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:00.044 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:00.044 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:00.044 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.044 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:00.044 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:00.044 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:00.044 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.044 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.045 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:00.045 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:00.045 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:00.045 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.045 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.045 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:00.045 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616095+0000", 2024-04-18T21:06:00.045 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.446e-06 2024-04-18T21:06:00.045 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.045 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.045 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:00.045 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616104+0000", 2024-04-18T21:06:00.045 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6200000000000005e-06 2024-04-18T21:06:00.045 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.045 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.046 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:00.046 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616132+0000", 2024-04-18T21:06:00.046 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7668999999999999e-05 2024-04-18T21:06:00.046 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.046 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.046 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:00.046 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616149+0000", 2024-04-18T21:06:00.046 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7047000000000001e-05 2024-04-18T21:06:00.046 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.046 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.046 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:00.046 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619287+0000", 2024-04-18T21:06:00.046 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0031381450000000002 2024-04-18T21:06:00.047 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.047 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.047 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:00.047 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619503+0000", 2024-04-18T21:06:00.047 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000216522 2024-04-18T21:06:00.047 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.047 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.047 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:00.047 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619930+0000", 2024-04-18T21:06:00.047 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00042604900000000001 2024-04-18T21:06:00.047 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.047 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.047 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:00.047 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629281+0000", 2024-04-18T21:06:00.047 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0093512230000000005 2024-04-18T21:06:00.048 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.048 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.048 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:00.048 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646022+0000", 2024-04-18T21:06:00.048 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016741156 2024-04-18T21:06:00.048 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.048 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.048 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:00.048 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646198+0000", 2024-04-18T21:06:00.048 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000176009 2024-04-18T21:06:00.048 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.048 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.048 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:00.048 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646309+0000", 2024-04-18T21:06:00.049 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011112000000000001 2024-04-18T21:06:00.049 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:00.049 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:00.049 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:00.049 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.049 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.049 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:00.049 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:00.049 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 54.379726327, 2024-04-18T21:06:00.049 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030501176000000001, 2024-04-18T21:06:00.049 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:00.049 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:00.049 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:00.049 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:00.050 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.050 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:00.050 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:00.050 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:00.050 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.050 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.050 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:00.050 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:00.050 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:00.050 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.050 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.050 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:00.050 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616180+0000", 2024-04-18T21:06:00.050 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1000000000000001e-06 2024-04-18T21:06:00.051 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.051 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.051 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:00.051 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616188+0000", 2024-04-18T21:06:00.051 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4069999999999993e-06 2024-04-18T21:06:00.051 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.051 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.051 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:00.051 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616207+0000", 2024-04-18T21:06:00.051 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8335999999999999e-05 2024-04-18T21:06:00.051 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.051 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.051 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:00.051 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616225+0000", 2024-04-18T21:06:00.052 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8652999999999999e-05 2024-04-18T21:06:00.052 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.052 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.052 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:00.052 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620977+0000", 2024-04-18T21:06:00.052 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047512220000000003 2024-04-18T21:06:00.052 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.052 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.052 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:00.052 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621279+0000", 2024-04-18T21:06:00.052 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000302646 2024-04-18T21:06:00.052 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.052 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.052 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:00.053 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621584+0000", 2024-04-18T21:06:00.053 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000305142 2024-04-18T21:06:00.053 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.053 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.053 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:00.053 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629352+0000", 2024-04-18T21:06:00.053 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0077673689999999997 2024-04-18T21:06:00.053 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.053 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.053 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:00.053 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646480+0000", 2024-04-18T21:06:00.053 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017128259 2024-04-18T21:06:00.053 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.053 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.054 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:00.054 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646591+0000", 2024-04-18T21:06:00.054 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011113899999999999 2024-04-18T21:06:00.054 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.054 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.054 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:00.054 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646680+0000", 2024-04-18T21:06:00.054 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8902999999999999e-05 2024-04-18T21:06:00.054 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:00.054 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:00.054 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:00.054 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.054 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.054 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:00.055 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:00.055 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 54.379659828000001, 2024-04-18T21:06:00.055 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030779760999999999, 2024-04-18T21:06:00.055 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:00.055 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:00.055 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:00.055 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:00.055 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.055 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:00.055 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:00.055 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:00.055 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.055 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.055 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:00.056 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:00.056 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:00.056 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.056 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.056 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:00.056 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616246+0000", 2024-04-18T21:06:00.056 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0499999999999999e-06 2024-04-18T21:06:00.056 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.056 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.056 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:00.056 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616253+0000", 2024-04-18T21:06:00.056 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.5989999999999998e-06 2024-04-18T21:06:00.056 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.056 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.057 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:00.057 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616273+0000", 2024-04-18T21:06:00.057 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9916999999999999e-05 2024-04-18T21:06:00.057 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.057 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.057 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:00.057 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616287+0000", 2024-04-18T21:06:00.057 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3669000000000001e-05 2024-04-18T21:06:00.057 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.057 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.057 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:00.057 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622203+0000", 2024-04-18T21:06:00.057 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.005916737 2024-04-18T21:06:00.057 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.057 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.058 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:00.058 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622379+0000", 2024-04-18T21:06:00.058 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000175596 2024-04-18T21:06:00.058 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.058 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.058 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:00.058 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622707+0000", 2024-04-18T21:06:00.058 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00032784600000000002 2024-04-18T21:06:00.058 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.058 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.058 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:00.058 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629366+0000", 2024-04-18T21:06:00.058 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0066593279999999999 2024-04-18T21:06:00.058 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.059 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.059 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:00.059 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646813+0000", 2024-04-18T21:06:00.059 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017447059000000001 2024-04-18T21:06:00.059 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.059 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.059 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:00.059 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646946+0000", 2024-04-18T21:06:00.059 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013301200000000001 2024-04-18T21:06:00.059 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.059 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.059 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:00.059 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647025+0000", 2024-04-18T21:06:00.059 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8948000000000004e-05 2024-04-18T21:06:00.060 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:00.060 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:00.060 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:00.060 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.060 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.060 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:00.060 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:00.060 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 54.379576010000001, 2024-04-18T21:06:00.060 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.031512165000000002, 2024-04-18T21:06:00.060 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:00.060 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:00.060 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:00.060 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:00.060 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.060 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:00.061 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:00.061 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:00.061 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.061 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.061 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:00.061 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:00.061 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:00.061 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.061 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.061 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:00.061 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616330+0000", 2024-04-18T21:06:00.061 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.15e-06 2024-04-18T21:06:00.061 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.061 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.061 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:00.062 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616337+0000", 2024-04-18T21:06:00.062 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.1289999999999998e-06 2024-04-18T21:06:00.062 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.062 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.062 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:00.062 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616447+0000", 2024-04-18T21:06:00.062 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109561 2024-04-18T21:06:00.062 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.062 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.062 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:00.062 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616496+0000", 2024-04-18T21:06:00.062 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8591999999999998e-05 2024-04-18T21:06:00.062 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.062 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.063 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:00.063 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.623786+0000", 2024-04-18T21:06:00.063 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0072906799999999999 2024-04-18T21:06:00.063 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.063 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.063 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:00.063 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.623973+0000", 2024-04-18T21:06:00.063 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018717199999999999 2024-04-18T21:06:00.063 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.063 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.063 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:00.063 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624260+0000", 2024-04-18T21:06:00.063 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00028630600000000001 2024-04-18T21:06:00.063 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.063 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.063 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:00.064 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629381+0000", 2024-04-18T21:06:00.064 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0051211340000000003 2024-04-18T21:06:00.064 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.064 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.064 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:00.064 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647631+0000", 2024-04-18T21:06:00.064 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018249771000000001 2024-04-18T21:06:00.064 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.064 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.064 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:00.064 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647761+0000", 2024-04-18T21:06:00.064 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013037300000000001 2024-04-18T21:06:00.064 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.064 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.064 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:00.065 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647841+0000", 2024-04-18T21:06:00.065 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.0296999999999994e-05 2024-04-18T21:06:00.065 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:00.065 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:00.065 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:00.065 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.065 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.065 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:00.065 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:00.065 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 54.379370526000002, 2024-04-18T21:06:00.065 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043251955000000002, 2024-04-18T21:06:00.065 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:00.065 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:00.065 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:00.065 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:00.066 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.066 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:00.066 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:00.066 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:00.066 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.066 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.066 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:00.066 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:00.066 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:00.066 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.066 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.066 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:00.066 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616536+0000", 2024-04-18T21:06:00.066 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2869999999999999e-06 2024-04-18T21:06:00.067 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.067 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.067 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:00.067 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616572+0000", 2024-04-18T21:06:00.067 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.6261999999999999e-05 2024-04-18T21:06:00.067 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.067 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.067 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:00.067 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616593+0000", 2024-04-18T21:06:00.067 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1310000000000001e-05 2024-04-18T21:06:00.067 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.067 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.067 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:00.067 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616614+0000", 2024-04-18T21:06:00.068 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.0936000000000001e-05 2024-04-18T21:06:00.068 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.068 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.068 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:00.068 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629501+0000", 2024-04-18T21:06:00.068 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.012886819000000001 2024-04-18T21:06:00.068 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.068 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.068 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:00.068 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629696+0000", 2024-04-18T21:06:00.068 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019485499999999999 2024-04-18T21:06:00.068 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.068 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.068 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:00.068 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629940+0000", 2024-04-18T21:06:00.069 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00024386399999999999 2024-04-18T21:06:00.069 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.069 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.069 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:00.069 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640100+0000", 2024-04-18T21:06:00.069 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010159645 2024-04-18T21:06:00.069 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.069 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.069 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:00.069 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659516+0000", 2024-04-18T21:06:00.069 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019416563000000001 2024-04-18T21:06:00.069 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.069 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.069 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:00.069 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659684+0000", 2024-04-18T21:06:00.069 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016750900000000001 2024-04-18T21:06:00.070 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.070 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.070 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:00.070 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659787+0000", 2024-04-18T21:06:00.070 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000102905 2024-04-18T21:06:00.070 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:00.070 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:00.070 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:00.070 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.070 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.070 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:00.070 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:00.070 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 54.379265404000002, 2024-04-18T21:06:00.071 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043581898000000001, 2024-04-18T21:06:00.071 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:00.071 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:00.071 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:00.071 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:00.071 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.071 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:00.071 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:00.071 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:00.071 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.071 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.071 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:00.071 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:00.071 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:00.071 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.072 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.072 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:00.072 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616641+0000", 2024-04-18T21:06:00.072 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:06:00.072 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.072 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.072 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:00.072 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616648+0000", 2024-04-18T21:06:00.072 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3860000000000001e-06 2024-04-18T21:06:00.072 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.072 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.072 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:00.072 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616666+0000", 2024-04-18T21:06:00.072 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7583000000000001e-05 2024-04-18T21:06:00.073 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.073 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.073 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:00.073 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616679+0000", 2024-04-18T21:06:00.073 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3322999999999999e-05 2024-04-18T21:06:00.073 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.073 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.073 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:00.073 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630373+0000", 2024-04-18T21:06:00.073 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013694207999999999 2024-04-18T21:06:00.073 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.073 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.073 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:00.073 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630545+0000", 2024-04-18T21:06:00.073 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000171683 2024-04-18T21:06:00.073 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.074 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.074 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:00.074 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630728+0000", 2024-04-18T21:06:00.074 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000182599 2024-04-18T21:06:00.074 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.074 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.074 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:00.074 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640600+0000", 2024-04-18T21:06:00.074 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0098726119999999994 2024-04-18T21:06:00.074 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.074 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.074 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:00.074 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659927+0000", 2024-04-18T21:06:00.074 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019326724999999999 2024-04-18T21:06:00.075 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.075 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.075 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:00.075 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660112+0000", 2024-04-18T21:06:00.075 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000185203 2024-04-18T21:06:00.075 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.075 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.075 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:00.075 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660222+0000", 2024-04-18T21:06:00.075 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109343 2024-04-18T21:06:00.075 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:00.075 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:00.075 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:00.075 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.075 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.076 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:00.076 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:00.076 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 54.378400046000003, 2024-04-18T21:06:00.076 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043121310000000003, 2024-04-18T21:06:00.076 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:00.076 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:00.076 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:00.076 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:00.076 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.076 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:00.076 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:00.076 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:00.076 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.076 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.076 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:00.077 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:00.077 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:00.077 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.077 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.077 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:00.077 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617506+0000", 2024-04-18T21:06:00.077 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9999999999999995e-07 2024-04-18T21:06:00.077 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.077 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.077 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:00.077 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617513+0000", 2024-04-18T21:06:00.077 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.9700000000000002e-06 2024-04-18T21:06:00.077 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.077 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.077 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:00.078 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617531+0000", 2024-04-18T21:06:00.078 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8105999999999999e-05 2024-04-18T21:06:00.078 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.078 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.078 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:00.078 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617545+0000", 2024-04-18T21:06:00.078 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3703000000000001e-05 2024-04-18T21:06:00.078 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.078 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.078 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:00.078 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632129+0000", 2024-04-18T21:06:00.078 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.014584135999999999 2024-04-18T21:06:00.078 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.079 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.079 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:00.079 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632361+0000", 2024-04-18T21:06:00.079 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023171800000000001 2024-04-18T21:06:00.079 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.079 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.079 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:00.079 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632804+0000", 2024-04-18T21:06:00.079 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000443549 2024-04-18T21:06:00.079 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.079 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.079 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:00.079 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646340+0000", 2024-04-18T21:06:00.079 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013535902000000001 2024-04-18T21:06:00.080 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.080 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.080 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:00.080 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660363+0000", 2024-04-18T21:06:00.080 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01402318 2024-04-18T21:06:00.080 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.080 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.080 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:00.080 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660523+0000", 2024-04-18T21:06:00.080 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00015989899999999999 2024-04-18T21:06:00.080 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.080 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.080 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:00.080 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660626+0000", 2024-04-18T21:06:00.080 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010314699999999999 2024-04-18T21:06:00.081 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:00.081 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:00.081 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:00.081 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.081 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.081 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:00.081 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:00.081 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 54.378260353000002, 2024-04-18T21:06:00.081 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024927483, 2024-04-18T21:06:00.081 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:00.081 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:00.081 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:00.081 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:00.081 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.082 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:00.082 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:00.082 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:00.082 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.082 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.082 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:00.082 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:00.082 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:00.082 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.082 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.082 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:00.082 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617646+0000", 2024-04-18T21:06:00.082 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3030000000000001e-06 2024-04-18T21:06:00.082 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.083 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.083 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:00.083 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617653+0000", 2024-04-18T21:06:00.083 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7530000000000004e-06 2024-04-18T21:06:00.083 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.083 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.083 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:00.083 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617673+0000", 2024-04-18T21:06:00.083 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9967e-05 2024-04-18T21:06:00.083 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.083 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.083 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:00.083 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617688+0000", 2024-04-18T21:06:00.083 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5153e-05 2024-04-18T21:06:00.083 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.084 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.084 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:00.084 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619244+0000", 2024-04-18T21:06:00.084 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001555531 2024-04-18T21:06:00.084 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.084 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.084 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:00.084 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619361+0000", 2024-04-18T21:06:00.084 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011784400000000001 2024-04-18T21:06:00.084 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.084 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.084 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:00.084 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619604+0000", 2024-04-18T21:06:00.084 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000243007 2024-04-18T21:06:00.084 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.085 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.085 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:00.085 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.625480+0000", 2024-04-18T21:06:00.085 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0058759349999999997 2024-04-18T21:06:00.085 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.085 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.085 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:00.085 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642342+0000", 2024-04-18T21:06:00.085 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016861373999999998 2024-04-18T21:06:00.085 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.085 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.085 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:00.085 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642484+0000", 2024-04-18T21:06:00.085 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000142423 2024-04-18T21:06:00.085 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.086 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.086 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:00.086 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642572+0000", 2024-04-18T21:06:00.086 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8193000000000001e-05 2024-04-18T21:06:00.086 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:00.086 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:00.086 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:00.086 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.086 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.086 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:00.086 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:00.086 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 54.377978849999998, 2024-04-18T21:06:00.086 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024956974999999999, 2024-04-18T21:06:00.086 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:00.086 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:00.087 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:00.087 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:00.087 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.087 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:00.087 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:00.087 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:00.087 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.087 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.087 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:00.087 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:00.087 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:00.087 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.087 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.088 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:00.088 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617928+0000", 2024-04-18T21:06:00.088 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5430000000000001e-06 2024-04-18T21:06:00.088 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.088 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.088 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:00.088 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617937+0000", 2024-04-18T21:06:00.088 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6629999999999999e-06 2024-04-18T21:06:00.088 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.088 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.088 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:00.088 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617955+0000", 2024-04-18T21:06:00.088 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8749999999999998e-05 2024-04-18T21:06:00.088 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.088 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.089 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:00.089 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617971+0000", 2024-04-18T21:06:00.089 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.605e-05 2024-04-18T21:06:00.089 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.089 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.089 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:00.089 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621019+0000", 2024-04-18T21:06:00.089 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0030472369999999999 2024-04-18T21:06:00.089 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.089 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.089 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:00.089 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621249+0000", 2024-04-18T21:06:00.089 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000230075 2024-04-18T21:06:00.089 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.089 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.089 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:00.090 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621450+0000", 2024-04-18T21:06:00.090 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020166499999999999 2024-04-18T21:06:00.090 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.090 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.090 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:00.090 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.626233+0000", 2024-04-18T21:06:00.090 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047827390000000003 2024-04-18T21:06:00.090 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.090 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.090 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:00.090 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642693+0000", 2024-04-18T21:06:00.090 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01645961 2024-04-18T21:06:00.090 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.091 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.091 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:00.091 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642798+0000", 2024-04-18T21:06:00.091 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010559499999999999 2024-04-18T21:06:00.091 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.091 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.091 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:00.091 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642883+0000", 2024-04-18T21:06:00.091 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5048000000000003e-05 2024-04-18T21:06:00.091 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:00.091 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:00.091 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:00.091 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.091 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.091 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:00.092 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:00.092 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 54.376283221999998, 2024-04-18T21:06:00.092 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024086478000000001, 2024-04-18T21:06:00.092 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:00.092 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:00.092 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:00.092 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:00.092 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.092 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:00.092 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:00.092 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:00.092 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.092 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.092 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:00.092 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:00.093 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:00.093 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.093 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.093 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:00.093 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619624+0000", 2024-04-18T21:06:00.093 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.75e-06 2024-04-18T21:06:00.093 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.093 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.093 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:00.093 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619637+0000", 2024-04-18T21:06:00.093 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3540000000000001e-05 2024-04-18T21:06:00.093 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.093 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.094 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:00.094 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619666+0000", 2024-04-18T21:06:00.094 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8685999999999999e-05 2024-04-18T21:06:00.094 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.094 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.094 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:00.094 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619685+0000", 2024-04-18T21:06:00.094 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8681999999999998e-05 2024-04-18T21:06:00.094 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.094 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.094 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:00.094 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622275+0000", 2024-04-18T21:06:00.094 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0025899260000000002 2024-04-18T21:06:00.094 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.095 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.095 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:00.095 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622572+0000", 2024-04-18T21:06:00.095 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00029722 2024-04-18T21:06:00.095 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.095 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.095 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:00.095 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622752+0000", 2024-04-18T21:06:00.095 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018065900000000001 2024-04-18T21:06:00.095 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.095 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.095 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:00.095 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.626326+0000", 2024-04-18T21:06:00.095 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035737310000000001 2024-04-18T21:06:00.096 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.096 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.096 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:00.096 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643565+0000", 2024-04-18T21:06:00.096 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017238430999999999 2024-04-18T21:06:00.096 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.096 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.096 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:00.096 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643646+0000", 2024-04-18T21:06:00.096 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.1481000000000001e-05 2024-04-18T21:06:00.096 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.096 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.096 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:00.096 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643708+0000", 2024-04-18T21:06:00.097 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.2372000000000005e-05 2024-04-18T21:06:00.097 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:00.097 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:00.097 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:00.097 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.097 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.097 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:00.097 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:00.097 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 54.376117069000003, 2024-04-18T21:06:00.097 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026822450000000001, 2024-04-18T21:06:00.097 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:00.097 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:00.097 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:00.097 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:00.097 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.098 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:00.098 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:00.098 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:00.098 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.098 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.098 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:00.098 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:00.098 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:00.098 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.098 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.098 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:00.098 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619789+0000", 2024-04-18T21:06:00.098 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:06:00.099 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.099 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.099 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:00.099 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619797+0000", 2024-04-18T21:06:00.099 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.6899999999999992e-06 2024-04-18T21:06:00.099 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.099 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.099 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:00.099 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619816+0000", 2024-04-18T21:06:00.099 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9352999999999999e-05 2024-04-18T21:06:00.099 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.099 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.099 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:00.099 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619832+0000", 2024-04-18T21:06:00.100 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6013000000000001e-05 2024-04-18T21:06:00.100 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.100 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.100 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:00.100 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620528+0000", 2024-04-18T21:06:00.100 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00069565600000000001 2024-04-18T21:06:00.100 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.100 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.100 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:00.100 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620735+0000", 2024-04-18T21:06:00.100 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000207025 2024-04-18T21:06:00.100 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.100 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.100 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:00.100 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620912+0000", 2024-04-18T21:06:00.101 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017748199999999999 2024-04-18T21:06:00.101 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.101 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.101 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:00.101 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.625605+0000", 2024-04-18T21:06:00.101 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0046924439999999996 2024-04-18T21:06:00.101 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.101 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.101 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:00.101 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646349+0000", 2024-04-18T21:06:00.101 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.020744318000000001 2024-04-18T21:06:00.101 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.101 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.101 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:00.102 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646483+0000", 2024-04-18T21:06:00.102 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013428999999999999 2024-04-18T21:06:00.102 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.102 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.102 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:00.102 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646611+0000", 2024-04-18T21:06:00.102 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012710299999999999 2024-04-18T21:06:00.102 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:00.102 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:00.102 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:00.102 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.102 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.102 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:00.103 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:06:00.103 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 54.375446636, 2024-04-18T21:06:00.103 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023516516000000001, 2024-04-18T21:06:00.103 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:00.103 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:00.103 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:06:00.103 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:00.103 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.103 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:00.103 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:06:00.103 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:00.103 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.103 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.103 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:00.103 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:06:00.104 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:00.104 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.104 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.104 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:00.104 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620460+0000", 2024-04-18T21:06:00.104 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.787e-06 2024-04-18T21:06:00.104 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.104 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.104 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:00.104 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620470+0000", 2024-04-18T21:06:00.104 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.2560000000000008e-06 2024-04-18T21:06:00.104 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.104 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.104 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:00.105 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620496+0000", 2024-04-18T21:06:00.105 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.6205999999999999e-05 2024-04-18T21:06:00.105 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.105 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.105 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:00.105 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620517+0000", 2024-04-18T21:06:00.105 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1223e-05 2024-04-18T21:06:00.105 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.105 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.105 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:00.105 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624060+0000", 2024-04-18T21:06:00.105 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035434160000000002 2024-04-18T21:06:00.105 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.105 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.106 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:00.106 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624390+0000", 2024-04-18T21:06:00.106 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00033000500000000002 2024-04-18T21:06:00.106 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:00.106 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:00.106 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:00.106 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643975+0000", 2024-04-18T21:06:00.106 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019584622999999999 2024-04-18T21:06:00.106 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:00.106 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:00.106 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:00.106 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:00.106 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:00.106 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:00.107 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-18T21:06:00.108 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:00.107+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:00.109 INFO:teuthology.orchestra.run.smithi078.stderr:set osd.2 primary-affinity to 0.591237 (8387472) 2024-04-18T21:06:00.110 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:00.209 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:00.211+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:00.229 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:06:00.229 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [], 2024-04-18T21:06:00.229 INFO:teuthology.orchestra.run.smithi150.stdout: "num_ops": 0 2024-04-18T21:06:00.229 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:06:00.243 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:00.310 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:00.311+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:00.402 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:06:00.402 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [], 2024-04-18T21:06:00.402 INFO:teuthology.orchestra.run.smithi150.stdout: "complaint_time": 30, 2024-04-18T21:06:00.402 INFO:teuthology.orchestra.run.smithi150.stdout: "num_blocked_ops": 0 2024-04-18T21:06:00.402 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:06:00.411 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:00.411+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:00.416 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:00.512 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:00.511+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:00.541 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:06:00.541 INFO:teuthology.orchestra.run.smithi150.stdout: "size": 20, 2024-04-18T21:06:00.541 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 600, 2024-04-18T21:06:00.541 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [ 2024-04-18T21:06:00.541 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.541 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-18T21:06:00.541 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:06:00.541 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 65.736129274000007, 2024-04-18T21:06:00.541 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0093051590000000003, 2024-04-18T21:06:00.541 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:00.541 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:00.541 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:00.542 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:00.542 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.542 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:00.542 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:06:00.542 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:00.542 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.542 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.542 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:00.542 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:06:00.542 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:00.542 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.542 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.542 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:00.543 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804851+0000", 2024-04-18T21:06:00.543 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7039999999999999e-06 2024-04-18T21:06:00.543 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.543 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.543 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:00.543 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804864+0000", 2024-04-18T21:06:00.543 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.276e-05 2024-04-18T21:06:00.543 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.543 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.543 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:00.543 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804895+0000", 2024-04-18T21:06:00.543 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.1204999999999997e-05 2024-04-18T21:06:00.543 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.543 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.543 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:00.544 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804908+0000", 2024-04-18T21:06:00.544 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3317e-05 2024-04-18T21:06:00.544 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.544 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.544 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:00.544 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805131+0000", 2024-04-18T21:06:00.544 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00022246700000000001 2024-04-18T21:06:00.544 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.544 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.544 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:00.544 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805171+0000", 2024-04-18T21:06:00.544 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.0164999999999999e-05 2024-04-18T21:06:00.544 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.544 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.544 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:00.545 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814086+0000", 2024-04-18T21:06:00.545 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0089155329999999998 2024-04-18T21:06:00.545 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.545 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.545 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:00.545 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814154+0000", 2024-04-18T21:06:00.545 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.8008000000000003e-05 2024-04-18T21:06:00.545 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:00.545 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:00.545 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:00.545 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.545 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.545 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-18T21:06:00.545 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:06:00.546 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 65.735364081, 2024-04-18T21:06:00.546 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0086469770000000001, 2024-04-18T21:06:00.546 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:00.546 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:00.546 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:00.546 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:00.546 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.546 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:00.546 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:06:00.546 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:00.546 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.546 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.546 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:00.546 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:06:00.547 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:00.547 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.547 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.547 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:00.547 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805616+0000", 2024-04-18T21:06:00.547 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7799999999999999e-06 2024-04-18T21:06:00.547 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.547 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.547 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:00.547 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805707+0000", 2024-04-18T21:06:00.547 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0917999999999999e-05 2024-04-18T21:06:00.547 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.547 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.547 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:00.547 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805739+0000", 2024-04-18T21:06:00.548 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.2512000000000003e-05 2024-04-18T21:06:00.548 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.548 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.548 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:00.548 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805763+0000", 2024-04-18T21:06:00.548 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3266000000000001e-05 2024-04-18T21:06:00.548 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.548 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.548 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:00.548 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.806024+0000", 2024-04-18T21:06:00.548 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000261716 2024-04-18T21:06:00.548 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.548 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.548 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:00.549 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.806073+0000", 2024-04-18T21:06:00.549 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.8844999999999997e-05 2024-04-18T21:06:00.549 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.549 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.549 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:00.549 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814162+0000", 2024-04-18T21:06:00.549 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0080882860000000001 2024-04-18T21:06:00.549 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.549 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.549 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:00.549 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814261+0000", 2024-04-18T21:06:00.549 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.9654000000000005e-05 2024-04-18T21:06:00.549 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:00.549 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:00.549 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:00.549 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.550 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.550 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'64)", 2024-04-18T21:06:00.550 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:06:00.550 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 65.733593037000006, 2024-04-18T21:06:00.550 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0089721509999999994, 2024-04-18T21:06:00.550 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:00.550 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:00.550 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:00.550 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:00.550 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.550 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:00.550 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:06:00.550 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:00.550 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.551 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.551 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:00.551 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:06:00.551 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:00.551 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.551 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.551 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:00.551 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807387+0000", 2024-04-18T21:06:00.551 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.0329999999999998e-06 2024-04-18T21:06:00.551 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.551 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.551 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:00.551 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807443+0000", 2024-04-18T21:06:00.551 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.5376e-05 2024-04-18T21:06:00.551 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.552 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.552 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:00.552 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807467+0000", 2024-04-18T21:06:00.552 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.4621999999999999e-05 2024-04-18T21:06:00.552 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.552 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.552 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:00.552 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807482+0000", 2024-04-18T21:06:00.552 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.436e-05 2024-04-18T21:06:00.552 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.552 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.552 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:00.552 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.809243+0000", 2024-04-18T21:06:00.552 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001761725 2024-04-18T21:06:00.552 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.553 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.553 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:00.553 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.809295+0000", 2024-04-18T21:06:00.553 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.1445e-05 2024-04-18T21:06:00.553 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.553 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.553 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:00.553 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.816293+0000", 2024-04-18T21:06:00.553 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0069981749999999997 2024-04-18T21:06:00.553 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.553 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.553 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:00.553 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.816357+0000", 2024-04-18T21:06:00.553 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.4414999999999999e-05 2024-04-18T21:06:00.553 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:00.554 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:00.554 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:00.554 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.554 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.554 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:00.554 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:06:00.554 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 54.925683667000001, 2024-04-18T21:06:00.554 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.040843365, 2024-04-18T21:06:00.554 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:00.554 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:00.554 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:00.554 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:00.554 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.554 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:00.554 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:06:00.555 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:00.555 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.555 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.555 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:00.555 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:06:00.555 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:00.555 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.555 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.555 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:00.555 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615297+0000", 2024-04-18T21:06:00.555 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2800000000000002e-06 2024-04-18T21:06:00.555 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.555 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.555 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:00.555 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615308+0000", 2024-04-18T21:06:00.556 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0813e-05 2024-04-18T21:06:00.556 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.556 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.556 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:00.556 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615330+0000", 2024-04-18T21:06:00.556 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2370000000000001e-05 2024-04-18T21:06:00.556 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.556 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.556 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:00.556 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615346+0000", 2024-04-18T21:06:00.556 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6200000000000001e-05 2024-04-18T21:06:00.556 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.556 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.556 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:00.557 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615470+0000", 2024-04-18T21:06:00.557 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012385799999999999 2024-04-18T21:06:00.557 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.557 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.557 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:00.557 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615488+0000", 2024-04-18T21:06:00.557 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7923000000000001e-05 2024-04-18T21:06:00.557 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.557 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.557 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:00.557 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.630993+0000", 2024-04-18T21:06:00.557 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.01550532 2024-04-18T21:06:00.557 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.557 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.558 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:00.558 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631165+0000", 2024-04-18T21:06:00.558 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000171588 2024-04-18T21:06:00.558 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.558 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.558 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:00.558 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631320+0000", 2024-04-18T21:06:00.558 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000155162 2024-04-18T21:06:00.558 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.558 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.558 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:00.558 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635157+0000", 2024-04-18T21:06:00.558 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0038370790000000002 2024-04-18T21:06:00.558 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.559 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.559 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:00.559 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.655904+0000", 2024-04-18T21:06:00.559 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.020746483999999999 2024-04-18T21:06:00.559 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.559 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.559 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:00.559 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656032+0000", 2024-04-18T21:06:00.559 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012864199999999999 2024-04-18T21:06:00.559 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.559 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.559 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:00.559 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656138+0000", 2024-04-18T21:06:00.559 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000105646 2024-04-18T21:06:00.559 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:00.560 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:00.560 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:00.560 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.560 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.560 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:00.560 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:06:00.560 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 54.925591494999999, 2024-04-18T21:06:00.560 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.041266444999999999, 2024-04-18T21:06:00.560 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:00.560 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:00.560 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:00.560 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:00.560 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.560 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:00.560 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:06:00.561 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:00.561 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.561 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.561 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:00.561 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:06:00.561 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:00.561 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.561 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.561 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:00.561 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615388+0000", 2024-04-18T21:06:00.561 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:06:00.561 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.561 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.561 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:00.561 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:06:00.562 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.7299999999999994e-06 2024-04-18T21:06:00.562 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.562 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.562 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:00.562 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615415+0000", 2024-04-18T21:06:00.562 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7807000000000001e-05 2024-04-18T21:06:00.562 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.562 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.562 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:00.562 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615431+0000", 2024-04-18T21:06:00.562 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6127e-05 2024-04-18T21:06:00.562 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.562 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.562 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:00.562 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615621+0000", 2024-04-18T21:06:00.563 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000189781 2024-04-18T21:06:00.563 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.563 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.563 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:00.563 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615634+0000", 2024-04-18T21:06:00.563 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3383e-05 2024-04-18T21:06:00.563 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.563 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.563 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:00.563 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631703+0000", 2024-04-18T21:06:00.563 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016068737 2024-04-18T21:06:00.563 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.563 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.563 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:00.563 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631809+0000", 2024-04-18T21:06:00.563 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000106823 2024-04-18T21:06:00.564 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.564 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.564 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:00.564 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631988+0000", 2024-04-18T21:06:00.564 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000179008 2024-04-18T21:06:00.564 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.564 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.564 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:00.564 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635172+0000", 2024-04-18T21:06:00.564 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.003183029 2024-04-18T21:06:00.564 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.564 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.564 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:00.564 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656392+0000", 2024-04-18T21:06:00.564 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.021220638999999999 2024-04-18T21:06:00.565 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.565 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.565 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:00.565 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656533+0000", 2024-04-18T21:06:00.565 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014126500000000001 2024-04-18T21:06:00.565 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.565 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.565 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:00.565 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656653+0000", 2024-04-18T21:06:00.565 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000119883 2024-04-18T21:06:00.565 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:00.565 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:00.565 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:00.565 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.566 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.566 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:00.566 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:06:00.566 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 54.925504072000003, 2024-04-18T21:06:00.566 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.042492302000000003, 2024-04-18T21:06:00.566 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:00.566 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:00.566 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:00.566 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:00.566 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.566 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:00.566 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:06:00.566 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:00.566 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.567 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.567 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:00.567 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:06:00.567 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:00.567 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.567 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.567 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:00.567 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615475+0000", 2024-04-18T21:06:00.567 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.17e-06 2024-04-18T21:06:00.567 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.567 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.567 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:00.567 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615528+0000", 2024-04-18T21:06:00.567 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.2159e-05 2024-04-18T21:06:00.567 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.568 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.568 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:00.568 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615542+0000", 2024-04-18T21:06:00.568 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4197e-05 2024-04-18T21:06:00.568 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.568 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.568 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:00.568 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615559+0000", 2024-04-18T21:06:00.568 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.749e-05 2024-04-18T21:06:00.568 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.568 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.568 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:00.568 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615685+0000", 2024-04-18T21:06:00.568 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012617499999999999 2024-04-18T21:06:00.568 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.569 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.569 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:00.569 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:06:00.569 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4749999999999999e-05 2024-04-18T21:06:00.569 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.569 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.569 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:00.569 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632332+0000", 2024-04-18T21:06:00.569 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016631988 2024-04-18T21:06:00.569 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.569 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.569 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:00.569 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632477+0000", 2024-04-18T21:06:00.569 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014437200000000001 2024-04-18T21:06:00.569 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.570 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.570 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:00.570 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632620+0000", 2024-04-18T21:06:00.570 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000143566 2024-04-18T21:06:00.570 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.570 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.570 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:00.570 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635185+0000", 2024-04-18T21:06:00.570 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0025644209999999999 2024-04-18T21:06:00.570 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.570 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.570 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:00.570 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657803+0000", 2024-04-18T21:06:00.570 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.022618743 2024-04-18T21:06:00.571 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.571 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.571 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:00.571 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657890+0000", 2024-04-18T21:06:00.571 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.6688999999999996e-05 2024-04-18T21:06:00.571 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.571 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.571 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:00.571 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657967+0000", 2024-04-18T21:06:00.571 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.6582000000000006e-05 2024-04-18T21:06:00.571 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:00.571 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:00.571 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:00.571 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.571 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.572 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:00.572 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:06:00.572 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 54.925373260000001, 2024-04-18T21:06:00.572 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.043603435000000003, 2024-04-18T21:06:00.572 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:00.572 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:00.572 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:00.572 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:00.572 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.572 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:00.572 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:06:00.572 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:00.572 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.572 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.572 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:00.573 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:06:00.573 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:00.573 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.573 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.573 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:00.573 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615607+0000", 2024-04-18T21:06:00.573 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4300000000000001e-06 2024-04-18T21:06:00.573 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.573 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.573 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:00.573 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615614+0000", 2024-04-18T21:06:00.573 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.4100000000000002e-06 2024-04-18T21:06:00.573 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.573 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.573 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:00.573 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615632+0000", 2024-04-18T21:06:00.574 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7863000000000002e-05 2024-04-18T21:06:00.574 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.574 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.574 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:00.574 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615647+0000", 2024-04-18T21:06:00.574 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5187e-05 2024-04-18T21:06:00.574 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.574 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.574 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:00.574 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615765+0000", 2024-04-18T21:06:00.574 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000117955 2024-04-18T21:06:00.574 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.574 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.574 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:00.575 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615781+0000", 2024-04-18T21:06:00.575 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6123000000000001e-05 2024-04-18T21:06:00.575 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.575 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.575 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:00.575 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633055+0000", 2024-04-18T21:06:00.575 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.017273909 2024-04-18T21:06:00.575 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.575 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.575 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:00.575 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633254+0000", 2024-04-18T21:06:00.575 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00019903799999999999 2024-04-18T21:06:00.575 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.575 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.575 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:00.576 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633624+0000", 2024-04-18T21:06:00.576 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000369656 2024-04-18T21:06:00.576 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.576 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.576 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:00.576 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635595+0000", 2024-04-18T21:06:00.576 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001971287 2024-04-18T21:06:00.576 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.576 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.576 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:00.576 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659026+0000", 2024-04-18T21:06:00.576 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.023431495 2024-04-18T21:06:00.576 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.576 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.576 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:00.577 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659117+0000", 2024-04-18T21:06:00.577 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0885999999999997e-05 2024-04-18T21:06:00.577 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.577 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.577 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:00.577 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659209+0000", 2024-04-18T21:06:00.577 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.1195999999999999e-05 2024-04-18T21:06:00.577 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:00.577 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:00.577 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:00.577 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.577 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.577 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:00.577 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:00.578 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 54.925308031, 2024-04-18T21:06:00.578 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.03492514, 2024-04-18T21:06:00.578 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:00.578 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:00.578 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:00.578 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:00.578 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.578 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:00.578 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:00.578 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:00.578 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.578 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.578 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:00.578 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:00.579 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:00.579 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.579 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.579 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:00.579 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:06:00.579 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.407e-06 2024-04-18T21:06:00.579 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.579 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.579 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:00.579 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615679+0000", 2024-04-18T21:06:00.579 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.2130000000000002e-06 2024-04-18T21:06:00.579 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.579 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.579 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:00.579 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615701+0000", 2024-04-18T21:06:00.579 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2316000000000001e-05 2024-04-18T21:06:00.580 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.580 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.580 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:00.580 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615717+0000", 2024-04-18T21:06:00.580 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6197000000000001e-05 2024-04-18T21:06:00.580 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.580 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.580 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:00.580 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615828+0000", 2024-04-18T21:06:00.580 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000110899 2024-04-18T21:06:00.580 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.580 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.580 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:00.580 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615840+0000", 2024-04-18T21:06:00.581 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.1423000000000001e-05 2024-04-18T21:06:00.581 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.581 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.581 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:00.581 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628046+0000", 2024-04-18T21:06:00.581 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.012206295000000001 2024-04-18T21:06:00.581 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.581 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.581 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:00.581 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628323+0000", 2024-04-18T21:06:00.581 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00027658700000000001 2024-04-18T21:06:00.581 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.581 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.581 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:00.581 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628599+0000", 2024-04-18T21:06:00.581 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00027676699999999997 2024-04-18T21:06:00.582 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.582 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.582 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:00.582 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634869+0000", 2024-04-18T21:06:00.582 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.006269536 2024-04-18T21:06:00.582 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.582 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.582 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:00.582 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650333+0000", 2024-04-18T21:06:00.582 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.015463645999999999 2024-04-18T21:06:00.582 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.582 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.582 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:00.583 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650474+0000", 2024-04-18T21:06:00.583 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014091799999999999 2024-04-18T21:06:00.583 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.583 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.583 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:00.583 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650595+0000", 2024-04-18T21:06:00.583 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012193600000000001 2024-04-18T21:06:00.583 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:00.583 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:00.583 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:00.583 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.583 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.583 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:00.583 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:06:00.583 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 54.925222922000003, 2024-04-18T21:06:00.584 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.040588320999999997, 2024-04-18T21:06:00.584 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:00.584 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:00.584 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:00.584 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:00.584 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.584 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:00.584 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:06:00.584 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:00.584 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.584 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.584 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:00.584 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:06:00.584 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:00.584 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.585 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.585 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:00.585 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615757+0000", 2024-04-18T21:06:00.585 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2270000000000001e-06 2024-04-18T21:06:00.585 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.585 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.585 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:00.585 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615765+0000", 2024-04-18T21:06:00.585 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.9400000000000002e-06 2024-04-18T21:06:00.585 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.585 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.585 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:00.585 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615785+0000", 2024-04-18T21:06:00.585 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.0749000000000001e-05 2024-04-18T21:06:00.585 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.586 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.586 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:00.586 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615804+0000", 2024-04-18T21:06:00.586 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.8774e-05 2024-04-18T21:06:00.586 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.586 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.586 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:00.586 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615888+0000", 2024-04-18T21:06:00.586 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.4111999999999997e-05 2024-04-18T21:06:00.586 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.586 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.586 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:00.586 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615895+0000", 2024-04-18T21:06:00.587 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.0469999999999996e-06 2024-04-18T21:06:00.587 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.587 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.587 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:00.587 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629280+0000", 2024-04-18T21:06:00.587 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.013384416 2024-04-18T21:06:00.587 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.587 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.587 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:00.587 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629488+0000", 2024-04-18T21:06:00.587 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00020852800000000001 2024-04-18T21:06:00.587 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.587 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.587 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:00.587 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629869+0000", 2024-04-18T21:06:00.588 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00038042300000000001 2024-04-18T21:06:00.588 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.588 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.588 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:00.588 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635041+0000", 2024-04-18T21:06:00.588 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.005172383 2024-04-18T21:06:00.588 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.588 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.588 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:00.588 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656125+0000", 2024-04-18T21:06:00.588 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.021084025999999999 2024-04-18T21:06:00.588 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.588 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.589 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:00.589 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656240+0000", 2024-04-18T21:06:00.589 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000115352 2024-04-18T21:06:00.589 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.589 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.589 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:00.589 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656344+0000", 2024-04-18T21:06:00.589 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00010334400000000001 2024-04-18T21:06:00.589 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:00.589 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:00.589 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:00.589 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.589 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.589 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:00.590 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:00.590 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 54.925155601999997, 2024-04-18T21:06:00.590 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.043549577999999999, 2024-04-18T21:06:00.590 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:00.590 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:00.590 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:00.590 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:00.590 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.590 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:00.590 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:00.590 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:00.590 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.590 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.591 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:00.591 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:00.591 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:00.591 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.591 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.591 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:00.591 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:00.591 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.5000000000000002e-07 2024-04-18T21:06:00.591 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.591 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.591 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:00.591 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615828+0000", 2024-04-18T21:06:00.591 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.2359999999999998e-06 2024-04-18T21:06:00.591 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.591 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.592 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:00.592 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615838+0000", 2024-04-18T21:06:00.592 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0087e-05 2024-04-18T21:06:00.592 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.592 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.592 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:00.592 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615846+0000", 2024-04-18T21:06:00.592 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.67e-06 2024-04-18T21:06:00.592 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.592 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.592 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:00.592 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615963+0000", 2024-04-18T21:06:00.592 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00011630500000000001 2024-04-18T21:06:00.592 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.592 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.592 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:00.593 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615979+0000", 2024-04-18T21:06:00.593 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.613e-05 2024-04-18T21:06:00.593 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.593 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.593 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:00.593 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632392+0000", 2024-04-18T21:06:00.593 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016413317 2024-04-18T21:06:00.593 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.593 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.593 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:00.593 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632568+0000", 2024-04-18T21:06:00.593 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00017539500000000001 2024-04-18T21:06:00.593 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.593 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.594 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:00.594 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632748+0000", 2024-04-18T21:06:00.594 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00017991799999999999 2024-04-18T21:06:00.594 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.594 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.594 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:00.594 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635542+0000", 2024-04-18T21:06:00.594 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00279481 2024-04-18T21:06:00.594 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.594 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.594 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:00.594 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659232+0000", 2024-04-18T21:06:00.594 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.023689212000000001 2024-04-18T21:06:00.594 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.595 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.595 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:00.595 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659314+0000", 2024-04-18T21:06:00.595 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.2528999999999995e-05 2024-04-18T21:06:00.595 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.595 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.595 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:00.595 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659372+0000", 2024-04-18T21:06:00.595 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.8218999999999999e-05 2024-04-18T21:06:00.595 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:00.595 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:00.595 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:00.596 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.596 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.596 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:00.596 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:06:00.596 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 54.925094170000001, 2024-04-18T21:06:00.596 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.039335347, 2024-04-18T21:06:00.596 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:00.596 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:00.596 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "started", 2024-04-18T21:06:00.596 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:00.596 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.596 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:00.596 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:06:00.596 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:00.596 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.597 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.597 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:00.597 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:06:00.597 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:00.597 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.597 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.597 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:00.597 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615885+0000", 2024-04-18T21:06:00.597 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2699999999999999e-06 2024-04-18T21:06:00.597 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.597 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.597 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:00.597 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615892+0000", 2024-04-18T21:06:00.597 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.6499999999999999e-06 2024-04-18T21:06:00.597 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.598 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.598 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:00.598 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615906+0000", 2024-04-18T21:06:00.598 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.393e-05 2024-04-18T21:06:00.598 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.598 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.598 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:00.598 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615919+0000", 2024-04-18T21:06:00.598 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2860000000000001e-05 2024-04-18T21:06:00.598 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.598 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.598 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:00.598 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616027+0000", 2024-04-18T21:06:00.598 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000107852 2024-04-18T21:06:00.599 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.599 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.599 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:00.599 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616037+0000", 2024-04-18T21:06:00.599 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:06:00.599 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.599 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.599 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:00.599 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622719+0000", 2024-04-18T21:06:00.599 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0066817220000000002 2024-04-18T21:06:00.599 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.599 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.599 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:00.599 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623006+0000", 2024-04-18T21:06:00.600 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00028783699999999999 2024-04-18T21:06:00.600 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.600 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.600 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:00.600 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.655220+0000", 2024-04-18T21:06:00.600 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.032213036 2024-04-18T21:06:00.600 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:00.600 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:00.600 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:00.600 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.600 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.600 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:00.600 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:00.600 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 54.925038497000003, 2024-04-18T21:06:00.601 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.032845253999999997, 2024-04-18T21:06:00.601 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:00.601 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:00.601 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "started", 2024-04-18T21:06:00.601 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:00.601 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.601 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:00.601 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:00.601 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:00.601 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.601 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.601 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:00.601 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:00.601 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:00.602 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.602 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.602 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:00.602 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615942+0000", 2024-04-18T21:06:00.602 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.717e-06 2024-04-18T21:06:00.602 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.602 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.602 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:00.602 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615946+0000", 2024-04-18T21:06:00.602 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.6e-06 2024-04-18T21:06:00.602 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.602 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.602 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:00.602 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615960+0000", 2024-04-18T21:06:00.603 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:06:00.603 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.603 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.603 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:00.603 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615968+0000", 2024-04-18T21:06:00.603 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.9070000000000007e-06 2024-04-18T21:06:00.603 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.603 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.603 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:00.603 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616100+0000", 2024-04-18T21:06:00.603 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000132402 2024-04-18T21:06:00.603 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.603 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.603 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:00.604 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616117+0000", 2024-04-18T21:06:00.604 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6653000000000001e-05 2024-04-18T21:06:00.604 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.604 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.604 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:00.604 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621566+0000", 2024-04-18T21:06:00.604 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0054497740000000001 2024-04-18T21:06:00.604 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.604 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.604 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:00.604 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622801+0000", 2024-04-18T21:06:00.604 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0012345710000000001 2024-04-18T21:06:00.604 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.604 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.604 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:00.605 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648785+0000", 2024-04-18T21:06:00.605 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.025984104000000001 2024-04-18T21:06:00.605 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:00.605 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:00.605 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:00.605 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.605 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.605 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:00.605 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:06:00.605 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 54.919187147000002, 2024-04-18T21:06:00.605 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.011561350999999999, 2024-04-18T21:06:00.605 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:00.605 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:00.605 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:00.605 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:00.606 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.606 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:00.606 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:06:00.606 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:00.606 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.606 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.606 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:00.606 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:06:00.606 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:00.606 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.606 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.606 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:00.606 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621792+0000", 2024-04-18T21:06:00.607 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.4000000000000001e-07 2024-04-18T21:06:00.607 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.607 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.607 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:00.607 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:06:00.607 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.1050000000000002e-05 2024-04-18T21:06:00.607 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.607 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.607 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:00.607 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622608+0000", 2024-04-18T21:06:00.607 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00077505900000000003 2024-04-18T21:06:00.607 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.607 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.607 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:00.607 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623879+0000", 2024-04-18T21:06:00.608 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0012705839999999999 2024-04-18T21:06:00.608 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.608 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.608 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:00.608 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624010+0000", 2024-04-18T21:06:00.608 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00013176900000000001 2024-04-18T21:06:00.608 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.608 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.608 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:00.608 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624058+0000", 2024-04-18T21:06:00.608 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.7299000000000002e-05 2024-04-18T21:06:00.608 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.608 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.608 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:00.608 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633262+0000", 2024-04-18T21:06:00.609 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0092048770000000002 2024-04-18T21:06:00.609 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.609 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.609 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:00.609 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633353+0000", 2024-04-18T21:06:00.609 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0073000000000003e-05 2024-04-18T21:06:00.609 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:00.609 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:00.609 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:00.609 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.609 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.609 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:00.609 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:06:00.610 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 54.917059760999997, 2024-04-18T21:06:00.610 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0098419370000000003, 2024-04-18T21:06:00.610 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:00.610 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:00.610 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:00.610 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:00.610 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.610 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:00.610 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:06:00.610 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:00.610 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.610 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.610 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:00.610 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:06:00.611 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:00.611 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.611 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.611 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:00.611 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623920+0000", 2024-04-18T21:06:00.611 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2240000000000001e-06 2024-04-18T21:06:00.611 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.611 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.611 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:00.611 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623933+0000", 2024-04-18T21:06:00.611 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3653e-05 2024-04-18T21:06:00.611 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.611 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.611 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:00.611 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623956+0000", 2024-04-18T21:06:00.612 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2059e-05 2024-04-18T21:06:00.612 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.612 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.612 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:00.612 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623975+0000", 2024-04-18T21:06:00.612 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.9806999999999999e-05 2024-04-18T21:06:00.612 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.612 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.612 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:00.612 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626943+0000", 2024-04-18T21:06:00.612 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0029681579999999998 2024-04-18T21:06:00.612 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.612 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.612 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:00.612 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626993+0000", 2024-04-18T21:06:00.613 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.9935999999999998e-05 2024-04-18T21:06:00.613 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.613 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.613 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:00.613 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633665+0000", 2024-04-18T21:06:00.613 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0066719250000000004 2024-04-18T21:06:00.613 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.613 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.613 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:00.613 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633761+0000", 2024-04-18T21:06:00.613 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.5174999999999996e-05 2024-04-18T21:06:00.613 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:00.613 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:00.613 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:00.613 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.614 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.614 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:00.614 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:06:00.614 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 54.916228142000001, 2024-04-18T21:06:00.614 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0090159079999999996, 2024-04-18T21:06:00.614 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:00.614 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:00.614 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:00.614 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:00.614 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.614 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:00.614 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:06:00.614 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:00.615 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.615 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.615 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:00.615 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:06:00.615 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:00.615 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.615 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.615 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:00.615 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624751+0000", 2024-04-18T21:06:00.615 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.7600000000000006e-07 2024-04-18T21:06:00.615 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.615 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.615 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:00.615 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624787+0000", 2024-04-18T21:06:00.615 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.6273000000000003e-05 2024-04-18T21:06:00.616 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.616 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.616 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:00.616 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625837+0000", 2024-04-18T21:06:00.616 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00104992 2024-04-18T21:06:00.616 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.616 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.616 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:00.616 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625860+0000", 2024-04-18T21:06:00.616 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3110000000000001e-05 2024-04-18T21:06:00.616 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.616 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.616 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:00.616 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625984+0000", 2024-04-18T21:06:00.617 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012399199999999999 2024-04-18T21:06:00.617 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.617 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.617 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:00.617 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626030+0000", 2024-04-18T21:06:00.617 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.5429999999999997e-05 2024-04-18T21:06:00.617 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.617 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.617 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:00.617 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633643+0000", 2024-04-18T21:06:00.617 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0076129320000000002 2024-04-18T21:06:00.617 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.617 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.617 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:00.617 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633766+0000", 2024-04-18T21:06:00.618 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000123275 2024-04-18T21:06:00.618 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:00.618 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:00.618 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:00.618 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.618 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.618 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:00.618 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:06:00.618 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 54.914974418, 2024-04-18T21:06:00.618 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0088669170000000002, 2024-04-18T21:06:00.618 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:00.618 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:00.618 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:00.618 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:00.619 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.619 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:00.619 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:06:00.619 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:00.619 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.619 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.619 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:00.619 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:06:00.619 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:00.619 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.619 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.619 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:00.619 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626005+0000", 2024-04-18T21:06:00.619 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.5000000000000001e-07 2024-04-18T21:06:00.620 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.620 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.620 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:00.620 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626028+0000", 2024-04-18T21:06:00.620 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2756999999999999e-05 2024-04-18T21:06:00.620 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.620 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.620 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:00.620 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626050+0000", 2024-04-18T21:06:00.620 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2140000000000001e-05 2024-04-18T21:06:00.620 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.620 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.620 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:00.620 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626065+0000", 2024-04-18T21:06:00.621 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5176e-05 2024-04-18T21:06:00.621 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.621 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.621 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:00.621 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628334+0000", 2024-04-18T21:06:00.621 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0022691439999999998 2024-04-18T21:06:00.621 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.621 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.621 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:00.621 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628379+0000", 2024-04-18T21:06:00.621 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.5420000000000002e-05 2024-04-18T21:06:00.621 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.621 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.621 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:00.622 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634770+0000", 2024-04-18T21:06:00.622 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0063908410000000004 2024-04-18T21:06:00.622 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.622 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.622 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:00.622 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634871+0000", 2024-04-18T21:06:00.622 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000100589 2024-04-18T21:06:00.622 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:00.622 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:00.622 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:00.622 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.622 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.622 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:13 3.10 e17/15 3:0d89b25e:::603.00000000:head v 17'8, mlcod=0'0)", 2024-04-18T21:06:00.623 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:06:00.623 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 54.896140989000003, 2024-04-18T21:06:00.623 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0090974379999999994, 2024-04-18T21:06:00.623 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:00.623 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:00.623 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:00.623 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:00.623 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.623 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:00.623 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:06:00.623 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:00.623 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.623 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.623 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:00.623 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:06:00.624 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:00.624 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.624 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.624 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:00.624 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644838+0000", 2024-04-18T21:06:00.624 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.569999999999999e-07 2024-04-18T21:06:00.624 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.624 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.624 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:00.624 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644846+0000", 2024-04-18T21:06:00.624 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.4499999999999998e-06 2024-04-18T21:06:00.624 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.624 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.624 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:00.624 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644861+0000", 2024-04-18T21:06:00.625 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5243e-05 2024-04-18T21:06:00.625 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.625 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.625 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:00.625 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644997+0000", 2024-04-18T21:06:00.625 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000135609 2024-04-18T21:06:00.625 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.625 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.625 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:00.625 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649150+0000", 2024-04-18T21:06:00.625 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0041536760000000002 2024-04-18T21:06:00.625 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.625 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.625 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:00.625 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649207+0000", 2024-04-18T21:06:00.626 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.6677e-05 2024-04-18T21:06:00.626 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.626 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.626 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:00.626 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.653840+0000", 2024-04-18T21:06:00.626 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0046329700000000001 2024-04-18T21:06:00.626 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.626 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.626 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:00.626 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.653935+0000", 2024-04-18T21:06:00.626 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.4856000000000001e-05 2024-04-18T21:06:00.626 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:00.626 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:00.626 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:00.627 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.627 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.627 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 3 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:06:00.627 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:06:00.627 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 54.893351828999997, 2024-04-18T21:06:00.627 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0087842319999999995, 2024-04-18T21:06:00.627 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:00.627 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:00.627 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "reached pg", 2024-04-18T21:06:00.627 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:00.627 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.627 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:00.627 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:06:00.627 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:00.627 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.627 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.628 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:00.628 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:06:00.628 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:00.628 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.628 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.628 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:00.628 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:06:00.628 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.8299999999999996e-07 2024-04-18T21:06:00.628 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.628 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.628 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:00.628 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647642+0000", 2024-04-18T21:06:00.628 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4724e-05 2024-04-18T21:06:00.628 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.628 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.629 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:00.629 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647679+0000", 2024-04-18T21:06:00.629 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.6662999999999998e-05 2024-04-18T21:06:00.629 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.629 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.629 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:00.629 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647735+0000", 2024-04-18T21:06:00.629 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.6196000000000002e-05 2024-04-18T21:06:00.629 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.629 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.629 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:00.629 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649865+0000", 2024-04-18T21:06:00.629 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0021299489999999999 2024-04-18T21:06:00.629 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.629 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.629 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:00.630 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656411+0000", 2024-04-18T21:06:00.630 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0065460170000000003 2024-04-18T21:06:00.630 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:00.630 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:00.630 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:00.630 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.630 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.630 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:00.630 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:06:00.630 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 54.893206632999998, 2024-04-18T21:06:00.630 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0095703190000000007, 2024-04-18T21:06:00.630 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:00.630 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:00.630 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:00.630 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:00.631 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.631 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:00.631 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:06:00.631 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:00.631 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.631 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.631 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:00.631 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:06:00.631 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:00.631 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.631 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.631 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:00.631 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647773+0000", 2024-04-18T21:06:00.631 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.046e-06 2024-04-18T21:06:00.632 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.632 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.632 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:00.632 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647795+0000", 2024-04-18T21:06:00.632 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2616000000000002e-05 2024-04-18T21:06:00.632 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.632 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.632 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:00.632 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647818+0000", 2024-04-18T21:06:00.632 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3110000000000001e-05 2024-04-18T21:06:00.632 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.632 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.632 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:00.632 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647834+0000", 2024-04-18T21:06:00.632 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5163e-05 2024-04-18T21:06:00.633 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.633 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.633 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:00.633 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650682+0000", 2024-04-18T21:06:00.633 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0028479759999999999 2024-04-18T21:06:00.633 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.633 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.633 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:00.633 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650730+0000", 2024-04-18T21:06:00.633 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.8375999999999999e-05 2024-04-18T21:06:00.633 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.633 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.633 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:00.633 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656751+0000", 2024-04-18T21:06:00.634 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0060211880000000002 2024-04-18T21:06:00.634 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.634 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.634 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:00.634 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657342+0000", 2024-04-18T21:06:00.634 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00059084399999999998 2024-04-18T21:06:00.634 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:00.634 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:00.634 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:00.634 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.634 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.634 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:00.634 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:06:00.634 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 54.892794346999999, 2024-04-18T21:06:00.635 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0092471759999999993, 2024-04-18T21:06:00.635 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:00.635 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:00.635 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:00.635 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:00.635 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.635 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:00.635 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:06:00.635 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:00.635 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.635 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.635 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:00.635 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:06:00.635 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:00.636 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.636 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.636 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:00.636 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648185+0000", 2024-04-18T21:06:00.636 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.5000000000000001e-07 2024-04-18T21:06:00.636 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.636 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.636 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:00.636 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648203+0000", 2024-04-18T21:06:00.636 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.8102999999999999e-05 2024-04-18T21:06:00.636 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.636 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.636 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:00.636 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648226+0000", 2024-04-18T21:06:00.636 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2921999999999998e-05 2024-04-18T21:06:00.637 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.637 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.637 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:00.637 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648241+0000", 2024-04-18T21:06:00.637 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5336999999999999e-05 2024-04-18T21:06:00.637 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.637 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.637 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:00.637 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.651268+0000", 2024-04-18T21:06:00.637 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0030271640000000002 2024-04-18T21:06:00.637 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.637 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.637 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:00.637 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.651319+0000", 2024-04-18T21:06:00.637 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.0843000000000001e-05 2024-04-18T21:06:00.638 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.638 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.638 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:00.638 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657347+0000", 2024-04-18T21:06:00.638 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0060279770000000003 2024-04-18T21:06:00.638 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:00.638 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:00.638 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:00.638 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657431+0000", 2024-04-18T21:06:00.638 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.3980000000000006e-05 2024-04-18T21:06:00.638 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:00.638 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:00.638 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:00.638 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:00.639 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:00.639 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:06:00.640 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:00.640 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:00.639+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:00.741 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:00.743+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:00.770 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:00.770 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:06:00.770 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-04-18T21:06:00.770 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:00.784 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:00.842 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:00.843+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:00.943 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:00.943+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:00.943 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:00.943 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:06:00.943 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-18T21:06:00.943 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-18T21:06:00.943 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:00.958 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:01.025 INFO:teuthology.orchestra.run.smithi078.stderr:nodeep-scrub is set 2024-04-18T21:06:01.043 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:01.043+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:01.082 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:01.082 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-18T21:06:01.082 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-18T21:06:01.082 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:06:01.082 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.082 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:01.082 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:06:01.082 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 55.465927364999999, 2024-04-18T21:06:01.082 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.034065303999999998, 2024-04-18T21:06:01.082 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:01.082 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:01.083 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:01.083 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:01.083 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.083 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:01.083 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:06:01.083 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:01.083 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.083 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.083 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:01.083 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:06:01.083 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:01.083 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.083 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.083 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:01.084 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615254+0000", 2024-04-18T21:06:01.084 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7829999999999999e-06 2024-04-18T21:06:01.084 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.084 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.084 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:01.084 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615267+0000", 2024-04-18T21:06:01.084 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3334e-05 2024-04-18T21:06:01.084 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.084 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.084 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:01.084 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615294+0000", 2024-04-18T21:06:01.084 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7271999999999999e-05 2024-04-18T21:06:01.084 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.084 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.085 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:01.085 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615321+0000", 2024-04-18T21:06:01.085 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.637e-05 2024-04-18T21:06:01.085 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.085 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.085 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:01.085 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615479+0000", 2024-04-18T21:06:01.085 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000158493 2024-04-18T21:06:01.085 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.085 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.085 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:01.085 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615498+0000", 2024-04-18T21:06:01.085 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9148999999999999e-05 2024-04-18T21:06:01.085 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.086 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.086 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:01.086 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632915+0000", 2024-04-18T21:06:01.086 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.017416551999999998 2024-04-18T21:06:01.086 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.086 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.086 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:01.086 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633302+0000", 2024-04-18T21:06:01.086 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00038725000000000001 2024-04-18T21:06:01.086 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.086 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.086 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:01.086 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633638+0000", 2024-04-18T21:06:01.086 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000335946 2024-04-18T21:06:01.087 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.087 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:01.087 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645976+0000", 2024-04-18T21:06:01.087 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012337617 2024-04-18T21:06:01.087 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.087 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:01.087 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649080+0000", 2024-04-18T21:06:01.087 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031038929999999999 2024-04-18T21:06:01.087 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.087 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:01.087 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649207+0000", 2024-04-18T21:06:01.087 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000127537 2024-04-18T21:06:01.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.088 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:01.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649316+0000", 2024-04-18T21:06:01.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109108 2024-04-18T21:06:01.088 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:01.088 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:01.088 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:01.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.088 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:01.088 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:06:01.088 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 55.465793988000001, 2024-04-18T21:06:01.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036275764000000002, 2024-04-18T21:06:01.088 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:01.089 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:01.089 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:01.089 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:01.089 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.089 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:01.089 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:06:01.089 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:01.089 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.089 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.089 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:01.089 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:06:01.089 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:01.089 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.089 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.089 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:01.090 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615386+0000", 2024-04-18T21:06:01.090 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.573e-06 2024-04-18T21:06:01.090 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.090 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.090 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:01.090 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:06:01.090 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0723999999999999e-05 2024-04-18T21:06:01.090 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.090 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.090 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:01.090 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615418+0000", 2024-04-18T21:06:01.090 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0902000000000001e-05 2024-04-18T21:06:01.090 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.090 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.091 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:01.091 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615433+0000", 2024-04-18T21:06:01.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5319999999999999e-05 2024-04-18T21:06:01.091 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.091 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.091 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:01.091 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615659+0000", 2024-04-18T21:06:01.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000226095 2024-04-18T21:06:01.091 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.091 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.091 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:01.091 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:01.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1276e-05 2024-04-18T21:06:01.091 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.091 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.092 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:01.092 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643654+0000", 2024-04-18T21:06:01.092 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027983238000000001 2024-04-18T21:06:01.092 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.092 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.092 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:01.092 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643868+0000", 2024-04-18T21:06:01.092 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000214305 2024-04-18T21:06:01.092 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.092 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.092 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:01.092 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:06:01.092 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035892200000000002 2024-04-18T21:06:01.093 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.093 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:01.093 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646056+0000", 2024-04-18T21:06:01.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001829172 2024-04-18T21:06:01.093 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.093 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:01.093 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651406+0000", 2024-04-18T21:06:01.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0053504800000000003 2024-04-18T21:06:01.093 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.093 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:01.093 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651551+0000", 2024-04-18T21:06:01.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014427999999999999 2024-04-18T21:06:01.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.094 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:01.094 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651660+0000", 2024-04-18T21:06:01.094 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109477 2024-04-18T21:06:01.094 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:01.094 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:01.094 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:01.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.094 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:01.094 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:01.095 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 55.465720605999998, 2024-04-18T21:06:01.095 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045668994999999997, 2024-04-18T21:06:01.095 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:01.095 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:01.095 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:01.095 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:01.095 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.095 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:01.095 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:01.095 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:01.095 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.095 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.095 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:01.095 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:01.095 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:01.096 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.096 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.096 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:01.096 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615459+0000", 2024-04-18T21:06:01.096 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5030000000000001e-06 2024-04-18T21:06:01.096 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.096 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.096 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:01.096 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615506+0000", 2024-04-18T21:06:01.096 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6872000000000001e-05 2024-04-18T21:06:01.096 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.096 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.096 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:01.096 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615527+0000", 2024-04-18T21:06:01.096 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0763000000000001e-05 2024-04-18T21:06:01.097 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.097 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.097 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:01.097 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615551+0000", 2024-04-18T21:06:01.097 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4159e-05 2024-04-18T21:06:01.097 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.097 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.097 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:01.097 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615736+0000", 2024-04-18T21:06:01.097 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018499599999999999 2024-04-18T21:06:01.097 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.097 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.097 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:01.097 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615748+0000", 2024-04-18T21:06:01.097 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2272999999999999e-05 2024-04-18T21:06:01.098 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.098 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.098 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:01.098 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635481+0000", 2024-04-18T21:06:01.098 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019732772999999999 2024-04-18T21:06:01.098 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.098 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.098 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:01.098 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635791+0000", 2024-04-18T21:06:01.098 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031013299999999998 2024-04-18T21:06:01.098 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.098 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.098 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:01.098 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636101+0000", 2024-04-18T21:06:01.098 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030943300000000002 2024-04-18T21:06:01.099 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.099 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.099 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:01.099 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646043+0000", 2024-04-18T21:06:01.099 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099428139999999995 2024-04-18T21:06:01.099 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.099 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.099 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:01.099 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660991+0000", 2024-04-18T21:06:01.099 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014947142 2024-04-18T21:06:01.099 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.099 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.099 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:01.099 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661061+0000", 2024-04-18T21:06:01.100 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0438000000000006e-05 2024-04-18T21:06:01.100 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.100 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.100 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:01.100 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661127+0000", 2024-04-18T21:06:01.100 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5696000000000003e-05 2024-04-18T21:06:01.100 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:01.100 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:01.100 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:01.100 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.100 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.100 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:01.100 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:01.100 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 55.465508178, 2024-04-18T21:06:01.100 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045745085999999997, 2024-04-18T21:06:01.101 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:01.101 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:01.101 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:01.101 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:01.101 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.101 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:01.101 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:01.101 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:01.101 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.101 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.101 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:01.101 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:01.101 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:01.101 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.101 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.102 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:01.102 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:06:01.102 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7400000000000001e-06 2024-04-18T21:06:01.102 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.102 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.102 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:01.102 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:06:01.102 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8133e-05 2024-04-18T21:06:01.102 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.102 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.102 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:01.102 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615726+0000", 2024-04-18T21:06:01.102 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6132e-05 2024-04-18T21:06:01.103 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.103 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.103 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:01.103 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615742+0000", 2024-04-18T21:06:01.103 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6157000000000001e-05 2024-04-18T21:06:01.103 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.103 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.103 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:01.103 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615937+0000", 2024-04-18T21:06:01.103 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000194768 2024-04-18T21:06:01.103 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.103 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.103 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:01.103 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615950+0000", 2024-04-18T21:06:01.103 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3084e-05 2024-04-18T21:06:01.104 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.104 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.104 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:01.104 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643676+0000", 2024-04-18T21:06:01.104 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027725639999999999 2024-04-18T21:06:01.104 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.104 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.104 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:01.104 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643867+0000", 2024-04-18T21:06:01.104 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019075900000000001 2024-04-18T21:06:01.104 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.104 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.104 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:01.104 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:06:01.105 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036013799999999997 2024-04-18T21:06:01.105 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.105 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.105 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:01.105 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646068+0000", 2024-04-18T21:06:01.105 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001841536 2024-04-18T21:06:01.105 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.105 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.105 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:01.105 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661184+0000", 2024-04-18T21:06:01.105 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015115458999999999 2024-04-18T21:06:01.105 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.105 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.105 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:01.105 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661283+0000", 2024-04-18T21:06:01.105 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9502999999999999e-05 2024-04-18T21:06:01.106 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.106 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.106 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:01.106 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661415+0000", 2024-04-18T21:06:01.106 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000132037 2024-04-18T21:06:01.106 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:01.106 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:01.106 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:01.106 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.106 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.106 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:01.106 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:06:01.106 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 55.465386490999997, 2024-04-18T21:06:01.106 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036185947000000003, 2024-04-18T21:06:01.106 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:01.107 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:01.107 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:01.107 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:01.107 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.107 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:01.107 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:06:01.107 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:01.107 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.107 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.107 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:01.107 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:06:01.107 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:01.107 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.107 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.107 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:01.108 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615794+0000", 2024-04-18T21:06:01.108 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6440000000000001e-06 2024-04-18T21:06:01.108 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.108 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.108 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:01.108 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615803+0000", 2024-04-18T21:06:01.108 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1220000000000001e-06 2024-04-18T21:06:01.108 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.108 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.108 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:01.108 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615827+0000", 2024-04-18T21:06:01.108 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3997000000000001e-05 2024-04-18T21:06:01.108 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.108 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.109 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:01.109 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615899+0000", 2024-04-18T21:06:01.109 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2741e-05 2024-04-18T21:06:01.109 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.109 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.109 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:01.109 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616019+0000", 2024-04-18T21:06:01.109 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119874 2024-04-18T21:06:01.109 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.109 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.109 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:01.109 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616029+0000", 2024-04-18T21:06:01.109 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:06:01.109 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.109 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.109 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:01.110 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644823+0000", 2024-04-18T21:06:01.110 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.028793151999999999 2024-04-18T21:06:01.110 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.110 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.110 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:01.110 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645106+0000", 2024-04-18T21:06:01.110 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028379700000000002 2024-04-18T21:06:01.110 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.110 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.110 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:01.110 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645294+0000", 2024-04-18T21:06:01.110 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000187181 2024-04-18T21:06:01.110 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.110 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.111 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:01.111 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646763+0000", 2024-04-18T21:06:01.111 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0014691050000000001 2024-04-18T21:06:01.111 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.111 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.111 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:01.111 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651784+0000", 2024-04-18T21:06:01.111 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050211650000000002 2024-04-18T21:06:01.111 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.111 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.111 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:01.111 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651876+0000", 2024-04-18T21:06:01.111 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2503999999999994e-05 2024-04-18T21:06:01.111 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.112 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.112 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:01.112 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651978+0000", 2024-04-18T21:06:01.112 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000101475 2024-04-18T21:06:01.112 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:01.112 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:01.112 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:01.112 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.112 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.112 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:01.112 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:01.112 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 55.465237883999997, 2024-04-18T21:06:01.112 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032262322000000003, 2024-04-18T21:06:01.112 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:01.112 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:01.113 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:01.113 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:01.113 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.113 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:01.113 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:01.113 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:01.113 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.113 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.113 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:01.113 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:01.113 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:01.113 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.113 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.113 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:01.113 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615943+0000", 2024-04-18T21:06:01.114 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1959999999999998e-06 2024-04-18T21:06:01.114 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.114 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.114 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:01.114 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615956+0000", 2024-04-18T21:06:01.114 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3424000000000001e-05 2024-04-18T21:06:01.114 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.114 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.114 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:01.114 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615983+0000", 2024-04-18T21:06:01.114 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7072000000000001e-05 2024-04-18T21:06:01.114 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.114 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.114 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:01.115 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616006+0000", 2024-04-18T21:06:01.115 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2823000000000002e-05 2024-04-18T21:06:01.115 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.115 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.115 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:01.115 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616156+0000", 2024-04-18T21:06:01.115 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014962299999999999 2024-04-18T21:06:01.115 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.115 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.115 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:01.115 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616174+0000", 2024-04-18T21:06:01.115 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8082999999999999e-05 2024-04-18T21:06:01.115 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.115 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.115 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:01.116 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.629952+0000", 2024-04-18T21:06:01.116 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013778514 2024-04-18T21:06:01.116 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.116 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.116 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:01.116 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630201+0000", 2024-04-18T21:06:01.116 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024918100000000001 2024-04-18T21:06:01.116 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.116 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.116 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:01.116 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630386+0000", 2024-04-18T21:06:01.116 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018436900000000001 2024-04-18T21:06:01.116 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.116 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.117 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:01.117 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643169+0000", 2024-04-18T21:06:01.117 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012782774 2024-04-18T21:06:01.117 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.117 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.117 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:01.117 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.647924+0000", 2024-04-18T21:06:01.117 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004755787 2024-04-18T21:06:01.117 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.117 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.117 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:01.117 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648069+0000", 2024-04-18T21:06:01.117 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014459600000000001 2024-04-18T21:06:01.117 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.117 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.118 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:01.118 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648203+0000", 2024-04-18T21:06:01.118 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013388000000000001 2024-04-18T21:06:01.118 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:01.118 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:01.118 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:01.118 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.118 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.118 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:01.118 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:06:01.118 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 55.465129619999999, 2024-04-18T21:06:01.118 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032489736999999998, 2024-04-18T21:06:01.118 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:01.118 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:01.119 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:01.119 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:01.119 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.119 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:01.119 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:06:01.119 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:01.119 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.119 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.119 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:01.119 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:06:01.119 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:01.119 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.119 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.119 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:01.119 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616050+0000", 2024-04-18T21:06:01.120 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.606e-06 2024-04-18T21:06:01.120 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.120 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.120 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:01.120 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616061+0000", 2024-04-18T21:06:01.120 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0463e-05 2024-04-18T21:06:01.120 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.120 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.120 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:01.120 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616092+0000", 2024-04-18T21:06:01.120 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1415999999999999e-05 2024-04-18T21:06:01.120 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.120 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.120 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:01.120 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616109+0000", 2024-04-18T21:06:01.121 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6557000000000001e-05 2024-04-18T21:06:01.121 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.121 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.121 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:01.121 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616358+0000", 2024-04-18T21:06:01.121 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000249077 2024-04-18T21:06:01.121 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.121 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.121 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:01.121 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616370+0000", 2024-04-18T21:06:01.121 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2037e-05 2024-04-18T21:06:01.121 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.121 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.121 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:01.122 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.634920+0000", 2024-04-18T21:06:01.122 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018550397 2024-04-18T21:06:01.122 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.122 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.122 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:01.122 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640420+0000", 2024-04-18T21:06:01.122 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055000539999999999 2024-04-18T21:06:01.122 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.122 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.122 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:01.122 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648538+0000", 2024-04-18T21:06:01.122 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0081181299999999994 2024-04-18T21:06:01.122 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:01.122 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:01.123 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:01.123 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.123 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.123 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:01.123 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:06:01.123 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 55.465045299000003, 2024-04-18T21:06:01.123 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036090029000000003, 2024-04-18T21:06:01.123 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:01.123 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:01.123 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:01.123 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:01.123 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.123 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:01.123 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:06:01.123 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:01.124 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.124 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.124 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:01.124 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:06:01.124 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:01.124 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.124 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.124 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:01.124 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616134+0000", 2024-04-18T21:06:01.124 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.353e-06 2024-04-18T21:06:01.124 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.124 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.124 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:01.124 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616141+0000", 2024-04-18T21:06:01.125 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2770000000000002e-06 2024-04-18T21:06:01.125 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.125 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.125 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:01.125 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616160+0000", 2024-04-18T21:06:01.125 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.91e-05 2024-04-18T21:06:01.125 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.125 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.125 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:01.125 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616170+0000", 2024-04-18T21:06:01.125 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7699999999999996e-06 2024-04-18T21:06:01.125 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.125 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.125 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:01.125 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616275+0000", 2024-04-18T21:06:01.126 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105313 2024-04-18T21:06:01.126 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.126 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.126 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:01.126 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616288+0000", 2024-04-18T21:06:01.126 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3027000000000001e-05 2024-04-18T21:06:01.126 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.126 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.126 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:01.126 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646160+0000", 2024-04-18T21:06:01.126 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.029872019 2024-04-18T21:06:01.126 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.126 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.126 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:01.127 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646368+0000", 2024-04-18T21:06:01.127 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020811899999999999 2024-04-18T21:06:01.127 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.127 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.127 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:01.127 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652223+0000", 2024-04-18T21:06:01.127 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.005855051 2024-04-18T21:06:01.127 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:01.127 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:01.127 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:01.127 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.127 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.127 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:01.127 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:01.127 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 55.464987729999997, 2024-04-18T21:06:01.128 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043572403000000003, 2024-04-18T21:06:01.128 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:01.128 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:01.128 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:01.128 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:01.128 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.128 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:01.128 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:01.128 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:01.128 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.128 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.128 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:01.128 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:01.128 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:01.128 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.129 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.129 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:01.129 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616192+0000", 2024-04-18T21:06:01.129 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:06:01.129 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.129 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.129 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:01.129 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616203+0000", 2024-04-18T21:06:01.129 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0890000000000001e-05 2024-04-18T21:06:01.129 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.129 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.129 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:01.129 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616223+0000", 2024-04-18T21:06:01.129 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0409000000000001e-05 2024-04-18T21:06:01.129 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.130 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.130 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:01.130 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616238+0000", 2024-04-18T21:06:01.130 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5160000000000001e-05 2024-04-18T21:06:01.130 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.130 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.130 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:01.130 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616343+0000", 2024-04-18T21:06:01.130 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000104831 2024-04-18T21:06:01.130 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.130 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.130 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:01.130 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616357+0000", 2024-04-18T21:06:01.130 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3686000000000001e-05 2024-04-18T21:06:01.130 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.131 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.131 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:01.131 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635912+0000", 2024-04-18T21:06:01.131 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019554944000000001 2024-04-18T21:06:01.131 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.131 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.131 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:01.131 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636231+0000", 2024-04-18T21:06:01.131 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000318766 2024-04-18T21:06:01.131 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.131 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.131 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:01.131 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659763+0000", 2024-04-18T21:06:01.131 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023532474000000001 2024-04-18T21:06:01.131 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:01.132 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:01.132 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:01.132 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.132 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.132 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:01.132 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:06:01.132 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 55.461059022999997, 2024-04-18T21:06:01.132 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015007971, 2024-04-18T21:06:01.132 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:01.132 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:01.132 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:01.132 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:01.132 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.132 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:01.133 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:06:01.133 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:01.133 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.133 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.133 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:01.133 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:06:01.133 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:01.133 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.133 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.133 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:01.133 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620120+0000", 2024-04-18T21:06:01.133 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0359999999999999e-06 2024-04-18T21:06:01.133 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.133 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.133 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:01.133 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620157+0000", 2024-04-18T21:06:01.134 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6636e-05 2024-04-18T21:06:01.134 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.134 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.134 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:01.134 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620177+0000", 2024-04-18T21:06:01.134 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0247000000000001e-05 2024-04-18T21:06:01.134 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.134 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.134 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:01.134 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620195+0000", 2024-04-18T21:06:01.134 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7819e-05 2024-04-18T21:06:01.134 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.134 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.134 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:01.135 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620342+0000", 2024-04-18T21:06:01.135 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014643300000000001 2024-04-18T21:06:01.135 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.135 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.135 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:01.135 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620405+0000", 2024-04-18T21:06:01.135 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3522000000000006e-05 2024-04-18T21:06:01.135 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.135 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.135 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:01.135 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635016+0000", 2024-04-18T21:06:01.135 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014610840999999999 2024-04-18T21:06:01.135 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.135 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.135 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:01.136 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635127+0000", 2024-04-18T21:06:01.136 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111437 2024-04-18T21:06:01.136 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:01.136 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:01.136 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:01.136 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.136 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.136 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:01.136 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:06:01.136 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 55.460951755000004, 2024-04-18T21:06:01.136 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012693296, 2024-04-18T21:06:01.136 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:01.136 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:01.136 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:01.137 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:01.137 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.137 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:01.137 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:06:01.137 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:01.137 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.137 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.137 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:01.137 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:06:01.137 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:01.137 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.137 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.137 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:01.137 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620228+0000", 2024-04-18T21:06:01.137 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:06:01.138 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.138 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.138 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:01.138 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620236+0000", 2024-04-18T21:06:01.138 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.303e-06 2024-04-18T21:06:01.138 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.138 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.138 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:01.138 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620255+0000", 2024-04-18T21:06:01.138 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9406e-05 2024-04-18T21:06:01.138 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.138 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.138 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:01.138 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620274+0000", 2024-04-18T21:06:01.139 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8940000000000002e-05 2024-04-18T21:06:01.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.139 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.139 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:01.139 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:06:01.139 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001558753 2024-04-18T21:06:01.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.139 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.139 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:01.139 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621879+0000", 2024-04-18T21:06:01.139 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6359000000000001e-05 2024-04-18T21:06:01.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.139 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.139 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:01.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632841+0000", 2024-04-18T21:06:01.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010961907 2024-04-18T21:06:01.140 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.140 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.140 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:01.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632920+0000", 2024-04-18T21:06:01.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8714999999999994e-05 2024-04-18T21:06:01.140 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:01.140 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:01.140 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:01.140 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.140 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.140 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:01.140 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:06:01.140 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 55.459405992000001, 2024-04-18T21:06:01.141 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013445702, 2024-04-18T21:06:01.141 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:01.141 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:01.141 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:01.141 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:01.141 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.141 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:01.141 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:06:01.141 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:01.141 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.141 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.141 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:01.141 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:06:01.141 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:01.142 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.142 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.142 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:01.142 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621774+0000", 2024-04-18T21:06:01.142 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2500000000000001e-06 2024-04-18T21:06:01.142 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.142 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.142 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:01.142 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621786+0000", 2024-04-18T21:06:01.142 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2636000000000001e-05 2024-04-18T21:06:01.142 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.142 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.142 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:01.142 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621814+0000", 2024-04-18T21:06:01.143 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7823000000000001e-05 2024-04-18T21:06:01.143 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.143 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:01.143 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621844+0000", 2024-04-18T21:06:01.143 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9589000000000001e-05 2024-04-18T21:06:01.143 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.143 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:01.143 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622253+0000", 2024-04-18T21:06:01.143 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040963700000000002 2024-04-18T21:06:01.143 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.143 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:01.143 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622304+0000", 2024-04-18T21:06:01.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0868999999999997e-05 2024-04-18T21:06:01.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.144 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.144 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:01.144 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635133+0000", 2024-04-18T21:06:01.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012829136 2024-04-18T21:06:01.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.144 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.144 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:01.144 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635218+0000", 2024-04-18T21:06:01.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4761999999999999e-05 2024-04-18T21:06:01.144 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:01.144 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:01.144 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:01.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.145 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:01.145 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:06:01.145 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 55.459279232, 2024-04-18T21:06:01.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014162065, 2024-04-18T21:06:01.145 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:01.145 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:01.145 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:01.145 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:01.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.145 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:01.145 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:06:01.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:01.145 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.146 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:01.146 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:06:01.146 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:01.146 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.146 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.146 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:01.146 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621900+0000", 2024-04-18T21:06:01.146 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:06:01.146 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.146 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.146 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:01.146 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621910+0000", 2024-04-18T21:06:01.146 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0207000000000001e-05 2024-04-18T21:06:01.146 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.146 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.147 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:01.147 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621932+0000", 2024-04-18T21:06:01.147 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1789000000000001e-05 2024-04-18T21:06:01.147 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.147 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.147 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:01.147 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621946+0000", 2024-04-18T21:06:01.147 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4212999999999999e-05 2024-04-18T21:06:01.147 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.147 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.147 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:01.147 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624477+0000", 2024-04-18T21:06:01.147 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025303470000000001 2024-04-18T21:06:01.147 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.147 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.148 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:01.148 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624525+0000", 2024-04-18T21:06:01.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8084999999999998e-05 2024-04-18T21:06:01.148 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.148 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.148 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:01.148 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635976+0000", 2024-04-18T21:06:01.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.011451368999999999 2024-04-18T21:06:01.148 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.148 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.148 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:01.148 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636061+0000", 2024-04-18T21:06:01.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5094999999999998e-05 2024-04-18T21:06:01.148 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:01.148 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:01.149 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:01.149 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.149 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.149 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:06:01.149 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:06:01.149 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 55.450043606999998, 2024-04-18T21:06:01.149 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0098014739999999993, 2024-04-18T21:06:01.149 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:01.149 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:01.149 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:06:01.149 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:01.149 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.149 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:01.149 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:06:01.149 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:01.150 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.150 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:01.150 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:06:01.150 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:01.150 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.150 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:01.150 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631136+0000", 2024-04-18T21:06:01.150 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0139999999999999e-06 2024-04-18T21:06:01.150 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.150 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:01.150 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631152+0000", 2024-04-18T21:06:01.151 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6365999999999999e-05 2024-04-18T21:06:01.151 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.151 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:01.151 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631961+0000", 2024-04-18T21:06:01.151 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00080873100000000003 2024-04-18T21:06:01.151 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.151 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:01.151 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632021+0000", 2024-04-18T21:06:01.151 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0541999999999997e-05 2024-04-18T21:06:01.151 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.151 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:01.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633539+0000", 2024-04-18T21:06:01.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015175639999999999 2024-04-18T21:06:01.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.152 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:01.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640936+0000", 2024-04-18T21:06:01.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007397257 2024-04-18T21:06:01.152 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:01.152 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:01.152 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:01.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.152 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-18T21:06:01.152 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:06:01.152 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 55.432582173999997, 2024-04-18T21:06:01.153 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00073592199999999997, 2024-04-18T21:06:01.153 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:01.153 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:01.153 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:01.153 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:01.153 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.153 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:01.153 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:06:01.153 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:01.153 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.153 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.153 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:01.153 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:06:01.153 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:01.153 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.154 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:01.154 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648597+0000", 2024-04-18T21:06:01.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:06:01.154 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.154 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:01.154 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648605+0000", 2024-04-18T21:06:01.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3960000000000006e-06 2024-04-18T21:06:01.154 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.154 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:01.154 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648625+0000", 2024-04-18T21:06:01.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9987e-05 2024-04-18T21:06:01.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:01.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648643+0000", 2024-04-18T21:06:01.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7079e-05 2024-04-18T21:06:01.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:01.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649043+0000", 2024-04-18T21:06:01.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040083399999999998 2024-04-18T21:06:01.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:01.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649062+0000", 2024-04-18T21:06:01.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9052999999999999e-05 2024-04-18T21:06:01.156 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.156 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.156 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:01.156 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649332+0000", 2024-04-18T21:06:01.156 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026971999999999999 2024-04-18T21:06:01.156 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:01.156 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:01.156 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:01.156 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.156 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.156 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:06:01.156 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:06:01.156 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 55.429807273000002, 2024-04-18T21:06:01.156 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00086123999999999999, 2024-04-18T21:06:01.157 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:01.157 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:01.157 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:06:01.157 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:01.157 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.157 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:01.157 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:06:01.157 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:01.157 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.157 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.157 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:01.157 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:06:01.157 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:01.157 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.157 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.157 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:01.158 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651372+0000", 2024-04-18T21:06:01.158 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7599999999999997e-07 2024-04-18T21:06:01.158 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.158 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.158 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:01.158 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651377+0000", 2024-04-18T21:06:01.158 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.22e-06 2024-04-18T21:06:01.158 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.158 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.158 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:01.158 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651394+0000", 2024-04-18T21:06:01.158 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6646999999999998e-05 2024-04-18T21:06:01.158 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.158 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.159 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:01.159 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651427+0000", 2024-04-18T21:06:01.159 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3682e-05 2024-04-18T21:06:01.159 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.159 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.159 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:01.159 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652029+0000", 2024-04-18T21:06:01.159 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00060152199999999995 2024-04-18T21:06:01.159 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.159 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.159 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:01.159 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652232+0000", 2024-04-18T21:06:01.159 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020359299999999999 2024-04-18T21:06:01.159 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:01.159 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:01.160 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:01.160 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.160 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.160 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:06:01.160 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:06:01.160 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 55.421780310999999, 2024-04-18T21:06:01.160 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0017426200000000001, 2024-04-18T21:06:01.160 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:01.160 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:01.160 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:01.160 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:01.160 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.160 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:01.160 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:06:01.160 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:01.161 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.161 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.161 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:01.161 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:06:01.161 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:01.161 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.161 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.161 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:01.161 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659399+0000", 2024-04-18T21:06:01.161 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6000000000000002e-07 2024-04-18T21:06:01.161 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.161 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.161 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:01.161 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659405+0000", 2024-04-18T21:06:01.161 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5069999999999997e-06 2024-04-18T21:06:01.162 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.162 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.162 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:01.162 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659425+0000", 2024-04-18T21:06:01.162 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.927e-05 2024-04-18T21:06:01.162 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.162 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.162 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:01.162 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659443+0000", 2024-04-18T21:06:01.162 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8051999999999999e-05 2024-04-18T21:06:01.162 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.162 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.162 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:01.162 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660973+0000", 2024-04-18T21:06:01.163 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001530106 2024-04-18T21:06:01.163 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.163 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.163 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:01.163 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660983+0000", 2024-04-18T21:06:01.163 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0516999999999999e-05 2024-04-18T21:06:01.163 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.163 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.163 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:01.163 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661141+0000", 2024-04-18T21:06:01.163 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015730799999999999 2024-04-18T21:06:01.163 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:01.163 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:01.163 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:01.163 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.164 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.164 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:06:01.164 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:06:01.164 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 55.421563685999999, 2024-04-18T21:06:01.164 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001812311, 2024-04-18T21:06:01.164 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:01.164 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:01.164 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:01.164 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:01.164 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.164 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:01.164 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:06:01.164 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:01.164 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.165 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.165 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:01.165 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:06:01.165 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:01.165 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.165 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.165 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:01.165 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659616+0000", 2024-04-18T21:06:01.165 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.277e-06 2024-04-18T21:06:01.165 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.165 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.165 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:01.165 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659625+0000", 2024-04-18T21:06:01.165 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5359999999999998e-06 2024-04-18T21:06:01.165 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.166 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.166 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:01.166 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659647+0000", 2024-04-18T21:06:01.166 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1857000000000001e-05 2024-04-18T21:06:01.166 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.166 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.166 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:01.166 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659664+0000", 2024-04-18T21:06:01.166 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6405999999999998e-05 2024-04-18T21:06:01.166 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.166 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.166 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:01.166 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661169+0000", 2024-04-18T21:06:01.167 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015054179999999999 2024-04-18T21:06:01.167 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.167 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.167 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:01.167 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661177+0000", 2024-04-18T21:06:01.167 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9680000000000006e-06 2024-04-18T21:06:01.167 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.167 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.167 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:01.167 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661427+0000", 2024-04-18T21:06:01.167 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024984900000000001 2024-04-18T21:06:01.167 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:01.167 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:01.167 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:01.167 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.168 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.168 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-18T21:06:01.168 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:06:01.168 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 53.468643077999999, 2024-04-18T21:06:01.168 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0030975030000000001, 2024-04-18T21:06:01.168 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:01.168 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:01.168 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:01.168 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:01.168 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.168 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:01.168 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:06:01.168 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:01.168 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.169 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.169 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:01.169 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:06:01.169 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:01.169 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.169 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.169 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:01.169 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612538+0000", 2024-04-18T21:06:01.169 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6259999999999999e-06 2024-04-18T21:06:01.169 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.169 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.169 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:01.169 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612552+0000", 2024-04-18T21:06:01.169 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4073999999999999e-05 2024-04-18T21:06:01.169 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.170 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.170 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:01.170 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612585+0000", 2024-04-18T21:06:01.170 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3504999999999999e-05 2024-04-18T21:06:01.170 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.170 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.170 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:01.170 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612601+0000", 2024-04-18T21:06:01.170 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5194000000000001e-05 2024-04-18T21:06:01.170 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.170 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.170 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:01.170 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612746+0000", 2024-04-18T21:06:01.170 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145666 2024-04-18T21:06:01.170 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.171 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.171 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:01.171 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612953+0000", 2024-04-18T21:06:01.171 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000207109 2024-04-18T21:06:01.171 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.171 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.171 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:01.171 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.613134+0000", 2024-04-18T21:06:01.171 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018041300000000001 2024-04-18T21:06:01.171 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.171 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.171 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:01.171 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.614411+0000", 2024-04-18T21:06:01.171 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0012769929999999999 2024-04-18T21:06:01.171 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.172 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.172 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:01.172 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615441+0000", 2024-04-18T21:06:01.172 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001029917 2024-04-18T21:06:01.172 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.172 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.172 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:01.172 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615522+0000", 2024-04-18T21:06:01.172 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1142000000000003e-05 2024-04-18T21:06:01.172 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.172 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.172 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:01.172 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615633+0000", 2024-04-18T21:06:01.172 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000110864 2024-04-18T21:06:01.172 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:01.173 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:01.173 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:01.173 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.173 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.173 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-18T21:06:01.173 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:06:01.173 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 35.466357266999999, 2024-04-18T21:06:01.173 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088979039999999999, 2024-04-18T21:06:01.173 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:01.173 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:01.173 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:01.173 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:01.173 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.173 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:01.174 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:06:01.174 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:01.174 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.174 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.174 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:01.174 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:06:01.174 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:01.174 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.174 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.174 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:01.174 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614825+0000", 2024-04-18T21:06:01.174 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4829999999999999e-06 2024-04-18T21:06:01.174 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.174 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.174 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:01.175 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614843+0000", 2024-04-18T21:06:01.175 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8777e-05 2024-04-18T21:06:01.175 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.175 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.175 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:01.175 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614884+0000", 2024-04-18T21:06:01.175 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1051999999999999e-05 2024-04-18T21:06:01.175 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.175 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.175 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:01.175 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614903+0000", 2024-04-18T21:06:01.175 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9069999999999999e-05 2024-04-18T21:06:01.175 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.175 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.176 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:01.176 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615047+0000", 2024-04-18T21:06:01.176 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014374400000000001 2024-04-18T21:06:01.176 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.176 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.176 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:01.176 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615061+0000", 2024-04-18T21:06:01.176 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4063000000000001e-05 2024-04-18T21:06:01.176 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.176 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.176 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:01.176 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621064+0000", 2024-04-18T21:06:01.176 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0060029200000000001 2024-04-18T21:06:01.176 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.176 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.177 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:01.177 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621211+0000", 2024-04-18T21:06:01.177 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000147224 2024-04-18T21:06:01.177 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.177 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.177 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:01.177 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621396+0000", 2024-04-18T21:06:01.177 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018454699999999999 2024-04-18T21:06:01.177 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.177 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.177 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:01.177 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.622517+0000", 2024-04-18T21:06:01.177 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001121424 2024-04-18T21:06:01.177 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.177 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.177 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:01.178 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623571+0000", 2024-04-18T21:06:01.178 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010538660000000001 2024-04-18T21:06:01.178 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.178 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.178 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:01.178 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623658+0000", 2024-04-18T21:06:01.178 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6439000000000004e-05 2024-04-18T21:06:01.178 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:01.178 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:01.178 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:01.178 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623719+0000", 2024-04-18T21:06:01.178 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1295000000000002e-05 2024-04-18T21:06:01.178 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:01.178 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:01.179 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:01.179 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:01.179 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:01.179 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:01.180 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:01.181 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:01.183+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:01.281 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:01.279+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:01.312 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:01.312 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:06:01.312 INFO:teuthology.orchestra.run.smithi132.stdout: "num_ops": 0 2024-04-18T21:06:01.312 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:01.326 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:01.333 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:06:01.415 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:01.415+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:01.475 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:06:01.475 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:06:01.482 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:01.479+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:01.493 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:01.493 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:01.495 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1: {} 2024-04-18T21:06:01.495 INFO:teuthology.orchestra.run.smithi078.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:06:01.507 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:01.515 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:06:01.515 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:01.583 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:01.583+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:01.676 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:01.676 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:01.684 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:01.683+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:01.690 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:01.786 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:01.783+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:01.822 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:01.822 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:01.836 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:01.887 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:01.887+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:01.952 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:01.952 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:01.967 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:01.987 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:01.987+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:02.088 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:02.087+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:02.089 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:02.089 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:02.104 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:02.189 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:02.191+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:02.237 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:02.237 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:02.251 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:02.290 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:02.291+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:02.366 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:02.366 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:02.380 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:02.425 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:02.427+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:02.491 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:02.491+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:02.505 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:02.505 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:02.520 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:02.593 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:02.591+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:02.654 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:02.654 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:02.669 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:02.693 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:02.695+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:02.788 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:02.788 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:02.795 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:02.795+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:02.802 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:02.896 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:02.895+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:02.926 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:02.926 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:02.940 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:02.996 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:02.995+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:03.045 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-18T21:06:03.071 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:03.071 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:03.085 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:03.097 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:03.095+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:03.198 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:03.199+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:03.207 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:03.207 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:03.221 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:03.299 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:03.299+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:03.337 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:03.337 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:03.353 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:03.399 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:03.399+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:03.484 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:03.484 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:03.500 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:03.500 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:03.503+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:03.531 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:06:03.600 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:03.603+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:03.622 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:03.622 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:03.636 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:03.675 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:06:03.675 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:06:03.697 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1: {} 2024-04-18T21:06:03.698 INFO:teuthology.orchestra.run.smithi078.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:06:03.701 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:03.703+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:03.717 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:06:03.717 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:03.758 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:03.758 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-18T21:06:03.758 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-18T21:06:03.758 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:06:03.758 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.758 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:03.758 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:06:03.759 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 58.141923165999998, 2024-04-18T21:06:03.759 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.034065303999999998, 2024-04-18T21:06:03.759 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:03.759 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:03.759 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:03.759 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:03.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.759 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:03.759 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:06:03.759 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:03.759 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.759 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:03.759 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:06:03.760 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:03.760 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.760 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.760 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:03.760 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615254+0000", 2024-04-18T21:06:03.760 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7829999999999999e-06 2024-04-18T21:06:03.760 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.760 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.760 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:03.760 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615267+0000", 2024-04-18T21:06:03.760 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3334e-05 2024-04-18T21:06:03.760 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.760 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.760 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:03.761 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615294+0000", 2024-04-18T21:06:03.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7271999999999999e-05 2024-04-18T21:06:03.761 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.761 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.761 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.761 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615321+0000", 2024-04-18T21:06:03.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.637e-05 2024-04-18T21:06:03.761 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.761 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.761 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:03.761 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615479+0000", 2024-04-18T21:06:03.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000158493 2024-04-18T21:06:03.762 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.762 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.762 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:03.762 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615498+0000", 2024-04-18T21:06:03.762 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9148999999999999e-05 2024-04-18T21:06:03.762 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.762 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.762 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:03.762 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632915+0000", 2024-04-18T21:06:03.762 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.017416551999999998 2024-04-18T21:06:03.762 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.762 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.762 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:03.763 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633302+0000", 2024-04-18T21:06:03.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00038725000000000001 2024-04-18T21:06:03.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.763 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:03.763 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633638+0000", 2024-04-18T21:06:03.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000335946 2024-04-18T21:06:03.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.763 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:03.763 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645976+0000", 2024-04-18T21:06:03.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012337617 2024-04-18T21:06:03.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.764 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:03.764 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649080+0000", 2024-04-18T21:06:03.764 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031038929999999999 2024-04-18T21:06:03.764 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.764 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.764 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:03.764 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649207+0000", 2024-04-18T21:06:03.764 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000127537 2024-04-18T21:06:03.764 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.764 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.764 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:03.764 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649316+0000", 2024-04-18T21:06:03.764 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109108 2024-04-18T21:06:03.764 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:03.764 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:03.765 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:03.765 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.765 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.765 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:03.765 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:06:03.765 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 58.141789789000001, 2024-04-18T21:06:03.765 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036275764000000002, 2024-04-18T21:06:03.765 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:03.765 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:03.765 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:03.765 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:03.765 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.765 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:03.765 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:06:03.766 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:03.766 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.766 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.766 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:03.766 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:06:03.766 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:03.766 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.766 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.766 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:03.766 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615386+0000", 2024-04-18T21:06:03.766 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.573e-06 2024-04-18T21:06:03.766 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.766 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.766 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:03.767 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:06:03.767 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0723999999999999e-05 2024-04-18T21:06:03.767 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.767 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.767 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:03.767 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615418+0000", 2024-04-18T21:06:03.767 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0902000000000001e-05 2024-04-18T21:06:03.767 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.767 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.767 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.767 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615433+0000", 2024-04-18T21:06:03.767 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5319999999999999e-05 2024-04-18T21:06:03.767 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.767 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.768 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:03.768 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615659+0000", 2024-04-18T21:06:03.768 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000226095 2024-04-18T21:06:03.768 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.768 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.768 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:03.768 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:03.768 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1276e-05 2024-04-18T21:06:03.768 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.768 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.768 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:03.768 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643654+0000", 2024-04-18T21:06:03.768 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027983238000000001 2024-04-18T21:06:03.768 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.768 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.769 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:03.769 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643868+0000", 2024-04-18T21:06:03.769 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000214305 2024-04-18T21:06:03.769 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.769 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.769 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:03.769 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:06:03.769 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035892200000000002 2024-04-18T21:06:03.769 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.769 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.769 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:03.769 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646056+0000", 2024-04-18T21:06:03.769 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001829172 2024-04-18T21:06:03.769 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.770 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.770 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:03.770 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651406+0000", 2024-04-18T21:06:03.770 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0053504800000000003 2024-04-18T21:06:03.770 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.770 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.770 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:03.770 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651551+0000", 2024-04-18T21:06:03.770 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014427999999999999 2024-04-18T21:06:03.770 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.770 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.770 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:03.770 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651660+0000", 2024-04-18T21:06:03.770 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109477 2024-04-18T21:06:03.771 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:03.771 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:03.771 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:03.771 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.771 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.771 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:03.771 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:03.771 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 58.141716406999997, 2024-04-18T21:06:03.771 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045668994999999997, 2024-04-18T21:06:03.771 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:03.771 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:03.771 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:03.771 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:03.772 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.772 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:03.772 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:03.772 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:03.772 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.772 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.772 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:03.772 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:03.772 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:03.772 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.772 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.772 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:03.772 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615459+0000", 2024-04-18T21:06:03.773 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5030000000000001e-06 2024-04-18T21:06:03.773 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.773 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.773 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:03.773 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615506+0000", 2024-04-18T21:06:03.773 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6872000000000001e-05 2024-04-18T21:06:03.773 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.773 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.773 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:03.773 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615527+0000", 2024-04-18T21:06:03.773 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0763000000000001e-05 2024-04-18T21:06:03.773 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.773 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.773 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.773 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615551+0000", 2024-04-18T21:06:03.774 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4159e-05 2024-04-18T21:06:03.774 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.774 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.774 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:03.774 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615736+0000", 2024-04-18T21:06:03.774 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018499599999999999 2024-04-18T21:06:03.774 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.774 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.774 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:03.774 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615748+0000", 2024-04-18T21:06:03.774 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2272999999999999e-05 2024-04-18T21:06:03.775 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.775 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.775 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:03.775 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635481+0000", 2024-04-18T21:06:03.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019732772999999999 2024-04-18T21:06:03.775 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.775 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.775 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:03.775 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635791+0000", 2024-04-18T21:06:03.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031013299999999998 2024-04-18T21:06:03.775 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.775 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.775 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:03.776 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636101+0000", 2024-04-18T21:06:03.776 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030943300000000002 2024-04-18T21:06:03.776 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.776 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.776 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:03.776 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646043+0000", 2024-04-18T21:06:03.776 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099428139999999995 2024-04-18T21:06:03.776 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.776 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.776 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:03.776 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660991+0000", 2024-04-18T21:06:03.776 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014947142 2024-04-18T21:06:03.776 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.776 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.777 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:03.777 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661061+0000", 2024-04-18T21:06:03.777 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0438000000000006e-05 2024-04-18T21:06:03.777 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.777 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.777 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:03.777 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661127+0000", 2024-04-18T21:06:03.777 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5696000000000003e-05 2024-04-18T21:06:03.777 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:03.777 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:03.777 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:03.777 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.777 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.777 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:03.778 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:03.778 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 58.141503978999999, 2024-04-18T21:06:03.778 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045745085999999997, 2024-04-18T21:06:03.778 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:03.778 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:03.778 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:03.778 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:03.778 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.778 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:03.778 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:03.778 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:03.778 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.779 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.779 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:03.779 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:03.779 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:03.779 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.779 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.779 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:03.779 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:06:03.779 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7400000000000001e-06 2024-04-18T21:06:03.779 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.779 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.779 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:03.779 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:06:03.779 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8133e-05 2024-04-18T21:06:03.779 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:03.780 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615726+0000", 2024-04-18T21:06:03.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6132e-05 2024-04-18T21:06:03.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.780 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615742+0000", 2024-04-18T21:06:03.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6157000000000001e-05 2024-04-18T21:06:03.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:03.780 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615937+0000", 2024-04-18T21:06:03.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000194768 2024-04-18T21:06:03.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.781 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.781 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:03.781 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615950+0000", 2024-04-18T21:06:03.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3084e-05 2024-04-18T21:06:03.781 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.781 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.781 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:03.781 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643676+0000", 2024-04-18T21:06:03.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027725639999999999 2024-04-18T21:06:03.781 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.781 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.781 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:03.781 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643867+0000", 2024-04-18T21:06:03.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019075900000000001 2024-04-18T21:06:03.781 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.782 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.782 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:03.782 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:06:03.782 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036013799999999997 2024-04-18T21:06:03.782 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.782 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.782 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:03.782 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646068+0000", 2024-04-18T21:06:03.782 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001841536 2024-04-18T21:06:03.782 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.782 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.782 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:03.782 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661184+0000", 2024-04-18T21:06:03.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015115458999999999 2024-04-18T21:06:03.783 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.783 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.783 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:03.783 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661283+0000", 2024-04-18T21:06:03.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9502999999999999e-05 2024-04-18T21:06:03.783 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.783 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.783 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:03.783 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661415+0000", 2024-04-18T21:06:03.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000132037 2024-04-18T21:06:03.783 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:03.783 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:03.783 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:03.784 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.784 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.784 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:03.784 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:06:03.784 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 58.141382292000003, 2024-04-18T21:06:03.784 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036185947000000003, 2024-04-18T21:06:03.784 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:03.784 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:03.784 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:03.784 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:03.784 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.784 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:03.784 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:06:03.784 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:03.785 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.785 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.785 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:03.785 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:06:03.785 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:03.785 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.785 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.785 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:03.785 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615794+0000", 2024-04-18T21:06:03.785 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6440000000000001e-06 2024-04-18T21:06:03.785 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.785 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.785 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:03.785 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615803+0000", 2024-04-18T21:06:03.786 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1220000000000001e-06 2024-04-18T21:06:03.786 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.786 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.786 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:03.786 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615827+0000", 2024-04-18T21:06:03.786 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3997000000000001e-05 2024-04-18T21:06:03.786 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.786 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.786 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.786 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615899+0000", 2024-04-18T21:06:03.786 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2741e-05 2024-04-18T21:06:03.786 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.786 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.787 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:03.787 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616019+0000", 2024-04-18T21:06:03.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119874 2024-04-18T21:06:03.787 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.787 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.787 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:03.787 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616029+0000", 2024-04-18T21:06:03.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:06:03.787 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.787 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.787 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:03.787 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644823+0000", 2024-04-18T21:06:03.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.028793151999999999 2024-04-18T21:06:03.787 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:03.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645106+0000", 2024-04-18T21:06:03.788 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028379700000000002 2024-04-18T21:06:03.788 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:03.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645294+0000", 2024-04-18T21:06:03.788 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000187181 2024-04-18T21:06:03.788 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:03.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646763+0000", 2024-04-18T21:06:03.788 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0014691050000000001 2024-04-18T21:06:03.789 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.789 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.789 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:03.789 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651784+0000", 2024-04-18T21:06:03.789 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050211650000000002 2024-04-18T21:06:03.789 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.789 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.789 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:03.789 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651876+0000", 2024-04-18T21:06:03.789 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2503999999999994e-05 2024-04-18T21:06:03.789 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.789 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.789 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:03.789 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651978+0000", 2024-04-18T21:06:03.790 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000101475 2024-04-18T21:06:03.790 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:03.790 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:03.790 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:03.790 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.790 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.790 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:03.790 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:03.790 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 58.141233685000003, 2024-04-18T21:06:03.790 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032262322000000003, 2024-04-18T21:06:03.790 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:03.790 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:03.790 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:03.790 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:03.791 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.791 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:03.791 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:03.791 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:03.791 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.791 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.791 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:03.791 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:03.791 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:03.791 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.791 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.791 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:03.791 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615943+0000", 2024-04-18T21:06:03.791 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1959999999999998e-06 2024-04-18T21:06:03.792 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.792 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.792 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:03.792 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615956+0000", 2024-04-18T21:06:03.792 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3424000000000001e-05 2024-04-18T21:06:03.792 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.792 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.792 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:03.792 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615983+0000", 2024-04-18T21:06:03.792 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7072000000000001e-05 2024-04-18T21:06:03.792 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.792 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.792 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.792 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616006+0000", 2024-04-18T21:06:03.793 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2823000000000002e-05 2024-04-18T21:06:03.793 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.793 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.793 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:03.793 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616156+0000", 2024-04-18T21:06:03.793 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014962299999999999 2024-04-18T21:06:03.793 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.793 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.793 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:03.793 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616174+0000", 2024-04-18T21:06:03.793 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8082999999999999e-05 2024-04-18T21:06:03.793 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.793 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.793 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:03.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.629952+0000", 2024-04-18T21:06:03.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013778514 2024-04-18T21:06:03.794 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.794 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.794 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:03.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630201+0000", 2024-04-18T21:06:03.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024918100000000001 2024-04-18T21:06:03.794 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.794 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.794 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:03.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630386+0000", 2024-04-18T21:06:03.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018436900000000001 2024-04-18T21:06:03.794 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.795 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:03.795 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643169+0000", 2024-04-18T21:06:03.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012782774 2024-04-18T21:06:03.795 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.795 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:03.795 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.647924+0000", 2024-04-18T21:06:03.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004755787 2024-04-18T21:06:03.795 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.795 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:03.795 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648069+0000", 2024-04-18T21:06:03.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014459600000000001 2024-04-18T21:06:03.797 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.797 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.797 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:03.797 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648203+0000", 2024-04-18T21:06:03.797 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013388000000000001 2024-04-18T21:06:03.797 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:03.797 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:03.797 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:03.797 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.798 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:03.798 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:06:03.798 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 58.141125420999998, 2024-04-18T21:06:03.798 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032489736999999998, 2024-04-18T21:06:03.798 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:03.798 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:03.798 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:03.798 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:03.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.798 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:03.798 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:06:03.798 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:03.798 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:03.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:06:03.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:03.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:03.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616050+0000", 2024-04-18T21:06:03.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.606e-06 2024-04-18T21:06:03.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:03.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616061+0000", 2024-04-18T21:06:03.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0463e-05 2024-04-18T21:06:03.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.800 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.800 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:03.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616092+0000", 2024-04-18T21:06:03.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1415999999999999e-05 2024-04-18T21:06:03.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.800 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.800 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616109+0000", 2024-04-18T21:06:03.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6557000000000001e-05 2024-04-18T21:06:03.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.800 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.800 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:03.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616358+0000", 2024-04-18T21:06:03.801 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000249077 2024-04-18T21:06:03.801 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.801 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.801 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:03.801 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616370+0000", 2024-04-18T21:06:03.801 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2037e-05 2024-04-18T21:06:03.801 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.801 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.801 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:03.801 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.634920+0000", 2024-04-18T21:06:03.801 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018550397 2024-04-18T21:06:03.801 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.801 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.802 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:03.802 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640420+0000", 2024-04-18T21:06:03.802 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055000539999999999 2024-04-18T21:06:03.802 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.802 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.802 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:03.802 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648538+0000", 2024-04-18T21:06:03.802 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0081181299999999994 2024-04-18T21:06:03.802 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:03.802 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:03.802 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:03.802 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.802 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.803 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:03.803 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:06:03.803 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 58.141041100000002, 2024-04-18T21:06:03.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036090029000000003, 2024-04-18T21:06:03.803 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:03.803 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:03.803 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:03.803 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:03.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.803 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:03.803 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:06:03.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:03.803 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.804 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:03.804 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:06:03.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:03.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.804 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:03.804 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616134+0000", 2024-04-18T21:06:03.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.353e-06 2024-04-18T21:06:03.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.804 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:03.804 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616141+0000", 2024-04-18T21:06:03.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2770000000000002e-06 2024-04-18T21:06:03.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.805 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:03.805 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616160+0000", 2024-04-18T21:06:03.805 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.91e-05 2024-04-18T21:06:03.805 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.805 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.805 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.805 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616170+0000", 2024-04-18T21:06:03.805 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7699999999999996e-06 2024-04-18T21:06:03.805 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.805 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.805 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:03.805 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616275+0000", 2024-04-18T21:06:03.805 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105313 2024-04-18T21:06:03.805 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.806 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.806 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:03.806 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616288+0000", 2024-04-18T21:06:03.806 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3027000000000001e-05 2024-04-18T21:06:03.806 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.806 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.806 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:03.806 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646160+0000", 2024-04-18T21:06:03.806 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.029872019 2024-04-18T21:06:03.806 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.806 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.806 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:03.806 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646368+0000", 2024-04-18T21:06:03.807 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020811899999999999 2024-04-18T21:06:03.807 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.807 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.807 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:03.807 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652223+0000", 2024-04-18T21:06:03.807 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.005855051 2024-04-18T21:06:03.807 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:03.807 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:03.807 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:03.807 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.807 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.807 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:03.807 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:03.807 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 58.140983531000003, 2024-04-18T21:06:03.808 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043572403000000003, 2024-04-18T21:06:03.808 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:03.808 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:03.808 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:03.808 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:03.808 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:03.808 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:03.808 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:03.808 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.808 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:03.808 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:03.809 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:03.809 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.809 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:03.809 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616192+0000", 2024-04-18T21:06:03.809 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:06:03.809 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.809 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:03.809 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616203+0000", 2024-04-18T21:06:03.809 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0890000000000001e-05 2024-04-18T21:06:03.809 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.810 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:03.810 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616223+0000", 2024-04-18T21:06:03.810 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0409000000000001e-05 2024-04-18T21:06:03.810 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.810 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.810 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.810 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616238+0000", 2024-04-18T21:06:03.810 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5160000000000001e-05 2024-04-18T21:06:03.810 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.810 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.810 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:03.810 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616343+0000", 2024-04-18T21:06:03.811 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000104831 2024-04-18T21:06:03.811 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.811 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.811 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:03.811 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616357+0000", 2024-04-18T21:06:03.811 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3686000000000001e-05 2024-04-18T21:06:03.811 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.811 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.811 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:03.811 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635912+0000", 2024-04-18T21:06:03.811 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019554944000000001 2024-04-18T21:06:03.811 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.811 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.811 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:03.811 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636231+0000", 2024-04-18T21:06:03.812 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000318766 2024-04-18T21:06:03.812 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.812 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.812 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:03.812 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659763+0000", 2024-04-18T21:06:03.812 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023532474000000001 2024-04-18T21:06:03.812 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:03.812 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:03.812 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:03.812 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.812 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.812 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:03.812 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:06:03.813 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 58.137054824000003, 2024-04-18T21:06:03.813 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015007971, 2024-04-18T21:06:03.813 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:03.813 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:03.813 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:03.813 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:03.813 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.813 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:03.813 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:06:03.813 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:03.813 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.813 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.813 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:03.813 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:06:03.814 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:03.814 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.814 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.814 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:03.814 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620120+0000", 2024-04-18T21:06:03.814 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0359999999999999e-06 2024-04-18T21:06:03.814 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.814 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.814 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:03.814 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620157+0000", 2024-04-18T21:06:03.814 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6636e-05 2024-04-18T21:06:03.814 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.814 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.815 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:03.815 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620177+0000", 2024-04-18T21:06:03.815 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0247000000000001e-05 2024-04-18T21:06:03.815 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.815 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.815 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.815 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620195+0000", 2024-04-18T21:06:03.815 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7819e-05 2024-04-18T21:06:03.815 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.815 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.815 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:03.815 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620342+0000", 2024-04-18T21:06:03.815 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014643300000000001 2024-04-18T21:06:03.816 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.816 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.816 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:03.816 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620405+0000", 2024-04-18T21:06:03.816 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3522000000000006e-05 2024-04-18T21:06:03.816 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.816 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.816 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:03.816 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635016+0000", 2024-04-18T21:06:03.816 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014610840999999999 2024-04-18T21:06:03.816 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.816 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.816 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:03.816 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635127+0000", 2024-04-18T21:06:03.816 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111437 2024-04-18T21:06:03.817 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:03.817 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:03.817 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:03.817 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.817 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.817 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:03.817 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:06:03.817 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 58.136947556000003, 2024-04-18T21:06:03.817 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012693296, 2024-04-18T21:06:03.817 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:03.817 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:03.817 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:03.817 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:03.817 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.817 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:03.817 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:06:03.818 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:03.818 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.818 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.818 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:03.818 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:06:03.818 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:03.818 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.818 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.818 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:03.818 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620228+0000", 2024-04-18T21:06:03.818 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:06:03.818 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.818 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.819 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:03.819 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620236+0000", 2024-04-18T21:06:03.819 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.303e-06 2024-04-18T21:06:03.819 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.819 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.819 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:03.819 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620255+0000", 2024-04-18T21:06:03.819 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9406e-05 2024-04-18T21:06:03.819 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.819 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.819 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.819 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620274+0000", 2024-04-18T21:06:03.819 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8940000000000002e-05 2024-04-18T21:06:03.819 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.820 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.820 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:03.820 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:06:03.820 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001558753 2024-04-18T21:06:03.820 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.820 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.820 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:03.820 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621879+0000", 2024-04-18T21:06:03.820 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6359000000000001e-05 2024-04-18T21:06:03.820 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.821 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.821 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:03.821 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632841+0000", 2024-04-18T21:06:03.821 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010961907 2024-04-18T21:06:03.821 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.821 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.821 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:03.821 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632920+0000", 2024-04-18T21:06:03.821 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8714999999999994e-05 2024-04-18T21:06:03.821 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:03.821 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:03.821 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:03.822 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.822 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.822 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:03.822 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:06:03.822 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 58.135401793, 2024-04-18T21:06:03.822 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013445702, 2024-04-18T21:06:03.822 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:03.822 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:03.822 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:03.822 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:03.822 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.822 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:03.822 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:06:03.823 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:03.823 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.823 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.823 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:03.823 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:06:03.823 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:03.823 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.823 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.823 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:03.823 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621774+0000", 2024-04-18T21:06:03.823 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2500000000000001e-06 2024-04-18T21:06:03.823 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.823 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.823 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:03.823 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621786+0000", 2024-04-18T21:06:03.824 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2636000000000001e-05 2024-04-18T21:06:03.824 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.824 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.824 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:03.824 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621814+0000", 2024-04-18T21:06:03.824 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7823000000000001e-05 2024-04-18T21:06:03.824 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.824 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.824 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.824 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621844+0000", 2024-04-18T21:06:03.824 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9589000000000001e-05 2024-04-18T21:06:03.824 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.824 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.824 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:03.824 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622253+0000", 2024-04-18T21:06:03.825 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040963700000000002 2024-04-18T21:06:03.825 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.825 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.825 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:03.825 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622304+0000", 2024-04-18T21:06:03.825 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0868999999999997e-05 2024-04-18T21:06:03.825 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.825 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.825 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:03.825 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635133+0000", 2024-04-18T21:06:03.825 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012829136 2024-04-18T21:06:03.825 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.825 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.825 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:03.826 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635218+0000", 2024-04-18T21:06:03.826 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4761999999999999e-05 2024-04-18T21:06:03.826 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:03.826 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:03.826 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:03.826 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.826 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.826 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:03.826 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:06:03.826 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 58.135275032999999, 2024-04-18T21:06:03.826 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014162065, 2024-04-18T21:06:03.826 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:03.826 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:03.827 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:03.827 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:03.827 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.827 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:03.827 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:06:03.827 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:03.827 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.827 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.827 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:03.827 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:06:03.827 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:03.827 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.827 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.827 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:03.827 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621900+0000", 2024-04-18T21:06:03.828 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:06:03.828 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.828 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.828 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:03.828 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621910+0000", 2024-04-18T21:06:03.828 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0207000000000001e-05 2024-04-18T21:06:03.828 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.828 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.828 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:03.828 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621932+0000", 2024-04-18T21:06:03.828 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1789000000000001e-05 2024-04-18T21:06:03.828 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.828 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.828 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.829 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621946+0000", 2024-04-18T21:06:03.829 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4212999999999999e-05 2024-04-18T21:06:03.829 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.829 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.829 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:03.829 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624477+0000", 2024-04-18T21:06:03.829 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025303470000000001 2024-04-18T21:06:03.829 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.829 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.829 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:03.829 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624525+0000", 2024-04-18T21:06:03.829 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8084999999999998e-05 2024-04-18T21:06:03.829 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.830 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.830 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:03.830 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635976+0000", 2024-04-18T21:06:03.830 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.011451368999999999 2024-04-18T21:06:03.830 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.830 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.830 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:03.830 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636061+0000", 2024-04-18T21:06:03.830 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5094999999999998e-05 2024-04-18T21:06:03.830 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:03.830 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:03.830 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:03.830 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.830 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.831 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:06:03.831 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:06:03.831 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 58.126039407999997, 2024-04-18T21:06:03.831 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0098014739999999993, 2024-04-18T21:06:03.831 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:03.831 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:03.831 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:06:03.831 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:03.831 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.831 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:03.831 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:06:03.831 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:03.831 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.832 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.832 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:03.832 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:06:03.832 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:03.832 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.832 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.832 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:03.832 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631136+0000", 2024-04-18T21:06:03.832 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0139999999999999e-06 2024-04-18T21:06:03.832 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.832 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.832 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:03.832 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631152+0000", 2024-04-18T21:06:03.832 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6365999999999999e-05 2024-04-18T21:06:03.832 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.833 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.833 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:03.833 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631961+0000", 2024-04-18T21:06:03.833 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00080873100000000003 2024-04-18T21:06:03.833 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.833 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.833 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.833 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632021+0000", 2024-04-18T21:06:03.833 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0541999999999997e-05 2024-04-18T21:06:03.833 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.833 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.833 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:03.833 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633539+0000", 2024-04-18T21:06:03.833 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015175639999999999 2024-04-18T21:06:03.834 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.834 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.834 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:03.834 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640936+0000", 2024-04-18T21:06:03.834 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007397257 2024-04-18T21:06:03.834 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:03.834 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:03.834 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:03.834 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.834 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.834 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-18T21:06:03.834 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:06:03.834 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 58.108577975000003, 2024-04-18T21:06:03.835 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00073592199999999997, 2024-04-18T21:06:03.835 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:03.835 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:03.835 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:03.835 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:03.835 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.835 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:03.835 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:06:03.835 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:03.835 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.835 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.835 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:03.835 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:06:03.835 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:03.836 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.836 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.836 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:03.836 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648597+0000", 2024-04-18T21:06:03.836 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:06:03.836 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.836 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.836 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:03.836 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648605+0000", 2024-04-18T21:06:03.836 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3960000000000006e-06 2024-04-18T21:06:03.836 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.837 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.837 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:03.837 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648625+0000", 2024-04-18T21:06:03.837 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9987e-05 2024-04-18T21:06:03.837 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.837 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.837 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.837 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648643+0000", 2024-04-18T21:06:03.837 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7079e-05 2024-04-18T21:06:03.837 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.837 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.837 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:03.837 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649043+0000", 2024-04-18T21:06:03.837 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040083399999999998 2024-04-18T21:06:03.838 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.838 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.838 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:03.838 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649062+0000", 2024-04-18T21:06:03.838 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9052999999999999e-05 2024-04-18T21:06:03.838 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.838 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.838 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:03.838 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649332+0000", 2024-04-18T21:06:03.838 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026971999999999999 2024-04-18T21:06:03.838 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:03.838 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:03.839 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:03.839 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.839 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.839 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:06:03.839 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:06:03.839 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 58.105803074000001, 2024-04-18T21:06:03.839 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00086123999999999999, 2024-04-18T21:06:03.839 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:03.839 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:03.839 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:06:03.839 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:03.839 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.839 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:03.839 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:06:03.840 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:03.840 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.840 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.840 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:03.840 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:06:03.840 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:03.840 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.840 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.840 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:03.840 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651372+0000", 2024-04-18T21:06:03.840 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7599999999999997e-07 2024-04-18T21:06:03.840 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.840 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.840 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:03.840 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651377+0000", 2024-04-18T21:06:03.841 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.22e-06 2024-04-18T21:06:03.841 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.841 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.841 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:03.841 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651394+0000", 2024-04-18T21:06:03.841 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6646999999999998e-05 2024-04-18T21:06:03.841 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.841 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.841 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.841 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651427+0000", 2024-04-18T21:06:03.841 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3682e-05 2024-04-18T21:06:03.841 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.841 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.841 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:03.842 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652029+0000", 2024-04-18T21:06:03.842 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00060152199999999995 2024-04-18T21:06:03.842 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.842 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.842 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:03.842 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652232+0000", 2024-04-18T21:06:03.842 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020359299999999999 2024-04-18T21:06:03.842 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:03.842 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:03.842 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:03.842 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.842 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.842 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:06:03.842 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:06:03.843 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 58.097776111999998, 2024-04-18T21:06:03.843 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0017426200000000001, 2024-04-18T21:06:03.843 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:03.843 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:03.843 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:03.843 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:03.843 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.843 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:03.843 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:06:03.843 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:03.843 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.843 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.843 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:03.843 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:06:03.844 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:03.844 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.844 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.844 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:03.844 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659399+0000", 2024-04-18T21:06:03.844 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6000000000000002e-07 2024-04-18T21:06:03.844 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.844 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.844 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:03.844 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659405+0000", 2024-04-18T21:06:03.844 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5069999999999997e-06 2024-04-18T21:06:03.844 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.844 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.844 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:03.845 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659425+0000", 2024-04-18T21:06:03.845 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.927e-05 2024-04-18T21:06:03.845 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.845 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.845 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.845 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659443+0000", 2024-04-18T21:06:03.845 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8051999999999999e-05 2024-04-18T21:06:03.845 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.845 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.845 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:03.845 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660973+0000", 2024-04-18T21:06:03.845 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001530106 2024-04-18T21:06:03.845 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.845 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.846 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:03.846 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660983+0000", 2024-04-18T21:06:03.846 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0516999999999999e-05 2024-04-18T21:06:03.846 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.846 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.846 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:03.846 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661141+0000", 2024-04-18T21:06:03.846 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015730799999999999 2024-04-18T21:06:03.846 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:03.846 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:03.846 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:03.846 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.846 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.847 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:06:03.847 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:06:03.847 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 58.097559486999998, 2024-04-18T21:06:03.847 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001812311, 2024-04-18T21:06:03.847 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:03.847 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:03.847 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:03.847 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:03.847 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.847 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:03.847 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:06:03.847 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:03.847 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.847 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.848 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:03.848 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:06:03.848 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:03.848 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.848 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.848 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:03.848 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659616+0000", 2024-04-18T21:06:03.848 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.277e-06 2024-04-18T21:06:03.848 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.848 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.848 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:03.848 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659625+0000", 2024-04-18T21:06:03.848 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5359999999999998e-06 2024-04-18T21:06:03.848 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.848 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.849 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:03.849 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659647+0000", 2024-04-18T21:06:03.849 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1857000000000001e-05 2024-04-18T21:06:03.849 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.849 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.849 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.849 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659664+0000", 2024-04-18T21:06:03.849 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6405999999999998e-05 2024-04-18T21:06:03.849 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.849 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.849 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:03.849 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661169+0000", 2024-04-18T21:06:03.849 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015054179999999999 2024-04-18T21:06:03.850 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.850 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.850 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:03.850 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661177+0000", 2024-04-18T21:06:03.850 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9680000000000006e-06 2024-04-18T21:06:03.850 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.850 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.850 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:03.850 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661427+0000", 2024-04-18T21:06:03.850 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024984900000000001 2024-04-18T21:06:03.850 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:03.850 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:03.850 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:03.851 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.851 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.851 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-18T21:06:03.851 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:06:03.851 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 56.144638878999999, 2024-04-18T21:06:03.851 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0030975030000000001, 2024-04-18T21:06:03.851 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:03.851 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:03.851 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:03.851 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:03.851 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.851 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:03.851 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:06:03.852 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:03.852 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.852 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.852 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:03.852 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:06:03.852 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:03.852 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.852 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.852 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:03.852 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612538+0000", 2024-04-18T21:06:03.852 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6259999999999999e-06 2024-04-18T21:06:03.852 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.852 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.852 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:03.853 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612552+0000", 2024-04-18T21:06:03.853 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4073999999999999e-05 2024-04-18T21:06:03.853 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.853 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.853 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:03.853 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612585+0000", 2024-04-18T21:06:03.853 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3504999999999999e-05 2024-04-18T21:06:03.853 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.853 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.853 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.853 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612601+0000", 2024-04-18T21:06:03.853 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5194000000000001e-05 2024-04-18T21:06:03.853 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.854 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.854 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:03.854 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612746+0000", 2024-04-18T21:06:03.854 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145666 2024-04-18T21:06:03.854 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.854 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.854 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:03.854 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612953+0000", 2024-04-18T21:06:03.854 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000207109 2024-04-18T21:06:03.854 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.854 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.854 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:03.854 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.613134+0000", 2024-04-18T21:06:03.855 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018041300000000001 2024-04-18T21:06:03.855 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.855 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.855 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:03.855 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.614411+0000", 2024-04-18T21:06:03.855 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0012769929999999999 2024-04-18T21:06:03.855 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.855 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.855 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:03.855 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615441+0000", 2024-04-18T21:06:03.855 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001029917 2024-04-18T21:06:03.855 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.855 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.855 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:03.855 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615522+0000", 2024-04-18T21:06:03.856 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1142000000000003e-05 2024-04-18T21:06:03.856 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.856 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.856 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:03.856 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615633+0000", 2024-04-18T21:06:03.856 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000110864 2024-04-18T21:06:03.856 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:03.856 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:03.856 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:03.856 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.856 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.856 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-18T21:06:03.857 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:06:03.857 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 38.142353067999998, 2024-04-18T21:06:03.857 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088979039999999999, 2024-04-18T21:06:03.857 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:03.857 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:03.857 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:03.857 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:03.857 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.857 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:03.857 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:06:03.857 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:03.857 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.857 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.857 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:03.857 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:06:03.857 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:03.858 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.858 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.858 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:03.858 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614825+0000", 2024-04-18T21:06:03.858 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4829999999999999e-06 2024-04-18T21:06:03.858 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.858 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.858 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:03.858 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614843+0000", 2024-04-18T21:06:03.858 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8777e-05 2024-04-18T21:06:03.858 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.858 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.858 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:03.859 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614884+0000", 2024-04-18T21:06:03.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1051999999999999e-05 2024-04-18T21:06:03.859 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:03.859 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614903+0000", 2024-04-18T21:06:03.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9069999999999999e-05 2024-04-18T21:06:03.859 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:03.859 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615047+0000", 2024-04-18T21:06:03.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014374400000000001 2024-04-18T21:06:03.859 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:03.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615061+0000", 2024-04-18T21:06:03.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4063000000000001e-05 2024-04-18T21:06:03.860 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.860 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:03.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621064+0000", 2024-04-18T21:06:03.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0060029200000000001 2024-04-18T21:06:03.860 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.860 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:03.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621211+0000", 2024-04-18T21:06:03.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000147224 2024-04-18T21:06:03.860 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.860 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:03.861 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621396+0000", 2024-04-18T21:06:03.861 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018454699999999999 2024-04-18T21:06:03.861 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.861 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:03.861 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.622517+0000", 2024-04-18T21:06:03.861 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001121424 2024-04-18T21:06:03.861 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.861 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:03.861 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623571+0000", 2024-04-18T21:06:03.861 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010538660000000001 2024-04-18T21:06:03.861 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.861 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:03.861 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623658+0000", 2024-04-18T21:06:03.861 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6439000000000004e-05 2024-04-18T21:06:03.862 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:03.862 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:03.862 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:03.862 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623719+0000", 2024-04-18T21:06:03.862 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1295000000000002e-05 2024-04-18T21:06:03.862 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:03.862 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:03.862 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:03.862 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:03.862 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:03.862 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:03.864 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:03.865 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:03.867+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:03.964 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:03.963+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:03.996 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:03.996 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:06:03.996 INFO:teuthology.orchestra.run.smithi132.stdout: "num_ops": 0 2024-04-18T21:06:03.996 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:04.010 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:04.053 INFO:teuthology.orchestra.run.smithi078.stderr:noscrub is unset 2024-04-18T21:06:04.065 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:04.067+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:04.166 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:04.167+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:04.179 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:04.179 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:06:04.179 INFO:teuthology.orchestra.run.smithi132.stdout: "complaint_time": 30, 2024-04-18T21:06:04.180 INFO:teuthology.orchestra.run.smithi132.stdout: "num_blocked_ops": 0 2024-04-18T21:06:04.180 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:04.193 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:04.267 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:04.267+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:04.312 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:04.312 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 20, 2024-04-18T21:06:04.312 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 600, 2024-04-18T21:06:04.312 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [ 2024-04-18T21:06:04.312 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.312 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:04.312 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:06:04.312 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 69.401175776000002, 2024-04-18T21:06:04.312 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.02518273, 2024-04-18T21:06:04.312 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:04.312 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:04.312 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.312 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:04.313 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:04.313 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:04.313 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 141 2024-04-18T21:06:04.313 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.313 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:04.313 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.313 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:04.313 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:06:04.313 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:04.313 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.313 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.313 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:04.313 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:06:04.313 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:04.314 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.314 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.314 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:04.314 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911562+0000", 2024-04-18T21:06:04.314 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9300000000000006e-07 2024-04-18T21:06:04.314 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.314 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.314 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:04.314 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911569+0000", 2024-04-18T21:06:04.314 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0169999999999999e-06 2024-04-18T21:06:04.314 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.314 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.314 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:04.315 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911582+0000", 2024-04-18T21:06:04.315 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.343e-05 2024-04-18T21:06:04.315 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.315 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.315 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.315 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911590+0000", 2024-04-18T21:06:04.315 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.413e-06 2024-04-18T21:06:04.315 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.315 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.315 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:04.315 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.933922+0000", 2024-04-18T21:06:04.315 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.022332093000000001 2024-04-18T21:06:04.315 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.315 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.315 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:04.315 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.934155+0000", 2024-04-18T21:06:04.316 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023378900000000001 2024-04-18T21:06:04.316 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.316 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.316 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:04.316 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.934514+0000", 2024-04-18T21:06:04.316 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00035859200000000003 2024-04-18T21:06:04.316 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.316 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.316 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:04.316 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.935973+0000", 2024-04-18T21:06:04.316 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001458705 2024-04-18T21:06:04.316 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.316 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.316 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:04.316 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936488+0000", 2024-04-18T21:06:04.317 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00051550000000000001 2024-04-18T21:06:04.317 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.317 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.317 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:04.317 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936636+0000", 2024-04-18T21:06:04.317 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014779800000000001 2024-04-18T21:06:04.317 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.317 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.317 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:04.317 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936743+0000", 2024-04-18T21:06:04.317 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010739999999999999 2024-04-18T21:06:04.317 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:04.317 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:04.317 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:04.317 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.317 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.318 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:04.318 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:04.318 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 69.283976801999998, 2024-04-18T21:06:04.318 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023654959999999999, 2024-04-18T21:06:04.318 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:04.318 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:04.318 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.318 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:04.318 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:04.318 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:04.318 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 163 2024-04-18T21:06:04.318 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.319 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:04.319 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.319 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:04.319 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:04.319 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:04.319 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.319 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.319 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:04.319 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:04.319 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:04.319 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.319 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.319 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:04.319 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:04.320 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0999999999999998e-07 2024-04-18T21:06:04.320 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.320 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.320 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:04.320 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028766+0000", 2024-04-18T21:06:04.320 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4700000000000001e-06 2024-04-18T21:06:04.320 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.320 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.320 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:04.320 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028775+0000", 2024-04-18T21:06:04.320 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.3190000000000001e-06 2024-04-18T21:06:04.320 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.320 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.320 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.321 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028782+0000", 2024-04-18T21:06:04.321 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.2300000000000002e-06 2024-04-18T21:06:04.321 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.321 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.321 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:04.321 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046667+0000", 2024-04-18T21:06:04.321 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017884356000000001 2024-04-18T21:06:04.321 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.321 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.321 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:04.321 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046788+0000", 2024-04-18T21:06:04.321 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012125000000000001 2024-04-18T21:06:04.321 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.322 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.322 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:04.322 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046982+0000", 2024-04-18T21:06:04.322 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019394 2024-04-18T21:06:04.322 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.322 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.322 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:04.322 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051969+0000", 2024-04-18T21:06:04.322 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0049868150000000003 2024-04-18T21:06:04.322 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.322 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.323 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:04.323 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052089+0000", 2024-04-18T21:06:04.323 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011993 2024-04-18T21:06:04.323 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.323 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.323 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:04.323 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052292+0000", 2024-04-18T21:06:04.323 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020345699999999999 2024-04-18T21:06:04.323 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.323 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.323 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:04.323 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052415+0000", 2024-04-18T21:06:04.323 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000122483 2024-04-18T21:06:04.323 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:04.323 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:04.324 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:04.324 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.324 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.324 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:04.324 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:04.324 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 69.283942569999994, 2024-04-18T21:06:04.324 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023864586, 2024-04-18T21:06:04.324 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:04.324 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:04.324 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.324 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:04.324 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:04.324 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:04.324 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 164 2024-04-18T21:06:04.325 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.325 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:04.325 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.325 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:04.325 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:04.325 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:04.325 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.325 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.325 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:04.325 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:04.325 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:04.325 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.325 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.325 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:04.326 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028795+0000", 2024-04-18T21:06:04.326 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7999999999999995e-07 2024-04-18T21:06:04.326 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.326 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.326 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:04.326 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028884+0000", 2024-04-18T21:06:04.326 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8997000000000002e-05 2024-04-18T21:06:04.326 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.326 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.326 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:04.326 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028895+0000", 2024-04-18T21:06:04.326 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1647e-05 2024-04-18T21:06:04.326 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.326 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.327 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.327 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028903+0000", 2024-04-18T21:06:04.327 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.909e-06 2024-04-18T21:06:04.327 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.327 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.327 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:04.327 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.047818+0000", 2024-04-18T21:06:04.327 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018914337 2024-04-18T21:06:04.327 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.327 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.327 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:04.327 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.048094+0000", 2024-04-18T21:06:04.327 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00027653500000000001 2024-04-18T21:06:04.327 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.327 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.327 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:04.328 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.048471+0000", 2024-04-18T21:06:04.328 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00037705799999999999 2024-04-18T21:06:04.328 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.328 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.328 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:04.328 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052516+0000", 2024-04-18T21:06:04.328 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0040452739999999997 2024-04-18T21:06:04.328 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.328 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.328 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:04.328 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052535+0000", 2024-04-18T21:06:04.328 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.84e-05 2024-04-18T21:06:04.328 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.328 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.328 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:04.328 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052603+0000", 2024-04-18T21:06:04.329 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.8095000000000004e-05 2024-04-18T21:06:04.329 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.329 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.329 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:04.329 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052659+0000", 2024-04-18T21:06:04.329 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5653999999999999e-05 2024-04-18T21:06:04.329 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:04.329 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:04.329 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:04.329 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.329 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.329 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:04.329 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:04.329 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 69.283819127000001, 2024-04-18T21:06:04.329 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024516458000000001, 2024-04-18T21:06:04.330 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:04.330 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:04.330 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.330 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:04.330 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:04.330 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:04.330 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 165 2024-04-18T21:06:04.330 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.330 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:04.330 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.330 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:04.330 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:04.330 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:04.330 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.331 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.331 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:04.331 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:04.331 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:04.331 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.331 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.331 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:04.331 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028918+0000", 2024-04-18T21:06:04.331 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8000000000000005e-07 2024-04-18T21:06:04.331 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.331 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.331 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:04.331 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028924+0000", 2024-04-18T21:06:04.331 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5659999999999997e-06 2024-04-18T21:06:04.331 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.332 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.332 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:04.332 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028933+0000", 2024-04-18T21:06:04.332 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.38e-06 2024-04-18T21:06:04.332 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.332 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.332 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.332 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028940+0000", 2024-04-18T21:06:04.332 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0060000000000003e-06 2024-04-18T21:06:04.332 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.332 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.332 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:04.332 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.050846+0000", 2024-04-18T21:06:04.332 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021906119000000002 2024-04-18T21:06:04.333 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.333 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.333 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:04.333 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051025+0000", 2024-04-18T21:06:04.333 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017850799999999999 2024-04-18T21:06:04.333 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.333 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.333 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:04.333 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051221+0000", 2024-04-18T21:06:04.333 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019608700000000001 2024-04-18T21:06:04.333 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.333 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.333 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:04.333 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052675+0000", 2024-04-18T21:06:04.333 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0014537899999999999 2024-04-18T21:06:04.334 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.334 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.334 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:04.334 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053311+0000", 2024-04-18T21:06:04.334 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00063613299999999999 2024-04-18T21:06:04.334 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.334 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.334 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:04.334 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053381+0000", 2024-04-18T21:06:04.334 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0074999999999996e-05 2024-04-18T21:06:04.334 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.334 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.334 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:04.335 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053434+0000", 2024-04-18T21:06:04.335 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3013999999999998e-05 2024-04-18T21:06:04.335 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:04.335 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:04.335 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:04.335 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.335 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.335 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:04.335 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:04.335 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 69.170513647999996, 2024-04-18T21:06:04.335 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023772793, 2024-04-18T21:06:04.335 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:04.335 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:04.335 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.336 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:04.336 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:04.336 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:04.336 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 187 2024-04-18T21:06:04.336 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.336 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:04.336 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.336 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:04.336 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:04.336 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:04.336 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.336 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.336 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:04.336 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:04.337 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:04.337 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.337 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.337 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:04.337 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142224+0000", 2024-04-18T21:06:04.337 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.47e-07 2024-04-18T21:06:04.337 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.337 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.337 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:04.337 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142233+0000", 2024-04-18T21:06:04.337 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0729999999999994e-06 2024-04-18T21:06:04.337 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.337 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.337 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:04.337 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142255+0000", 2024-04-18T21:06:04.338 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.2535999999999999e-05 2024-04-18T21:06:04.338 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.338 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.338 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.338 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142268+0000", 2024-04-18T21:06:04.338 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2686e-05 2024-04-18T21:06:04.338 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.338 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.338 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:04.338 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160497+0000", 2024-04-18T21:06:04.338 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018228779000000001 2024-04-18T21:06:04.338 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.338 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.339 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:04.339 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160634+0000", 2024-04-18T21:06:04.339 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000137315 2024-04-18T21:06:04.339 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.339 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.339 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:04.339 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160831+0000", 2024-04-18T21:06:04.339 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019683100000000001 2024-04-18T21:06:04.339 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.339 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.339 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:04.339 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165129+0000", 2024-04-18T21:06:04.339 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0042981299999999998 2024-04-18T21:06:04.339 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.340 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.340 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:04.340 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165776+0000", 2024-04-18T21:06:04.340 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00064702900000000003 2024-04-18T21:06:04.340 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.340 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.340 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:04.340 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165921+0000", 2024-04-18T21:06:04.340 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014506 2024-04-18T21:06:04.340 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.340 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.340 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:04.340 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165996+0000", 2024-04-18T21:06:04.340 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.4406999999999994e-05 2024-04-18T21:06:04.340 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:04.340 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:04.341 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:04.341 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.341 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.341 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:04.341 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:04.341 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 69.170453050000006, 2024-04-18T21:06:04.341 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026802157, 2024-04-18T21:06:04.341 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:04.341 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:04.341 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.341 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:04.341 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:04.341 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:04.341 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 188 2024-04-18T21:06:04.342 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.342 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:04.342 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.342 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:04.342 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:04.342 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:04.342 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.342 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.342 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:04.342 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:04.342 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:04.342 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.342 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.342 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:04.343 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142284+0000", 2024-04-18T21:06:04.343 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4e-07 2024-04-18T21:06:04.343 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.343 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.343 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:04.343 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142374+0000", 2024-04-18T21:06:04.343 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0099999999999995e-05 2024-04-18T21:06:04.343 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.343 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.343 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:04.343 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142386+0000", 2024-04-18T21:06:04.343 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1770000000000001e-05 2024-04-18T21:06:04.343 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.343 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.343 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.343 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142394+0000", 2024-04-18T21:06:04.344 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.2130000000000008e-06 2024-04-18T21:06:04.344 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.344 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.344 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:04.344 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.161743+0000", 2024-04-18T21:06:04.344 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019348644000000002 2024-04-18T21:06:04.344 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.344 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.344 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:04.344 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.161865+0000", 2024-04-18T21:06:04.344 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012210899999999999 2024-04-18T21:06:04.344 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.344 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.344 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:04.345 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.162055+0000", 2024-04-18T21:06:04.345 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000189994 2024-04-18T21:06:04.345 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.345 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.345 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:04.345 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165735+0000", 2024-04-18T21:06:04.345 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0036803270000000002 2024-04-18T21:06:04.345 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.345 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.345 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:04.345 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.168911+0000", 2024-04-18T21:06:04.345 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0031753689999999999 2024-04-18T21:06:04.345 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.345 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.346 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:04.346 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169012+0000", 2024-04-18T21:06:04.346 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010157699999999999 2024-04-18T21:06:04.346 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.346 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.346 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:04.346 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169086+0000", 2024-04-18T21:06:04.346 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3213999999999994e-05 2024-04-18T21:06:04.346 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:04.346 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:04.346 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:04.346 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.346 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.346 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:04.346 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:04.347 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 69.170327744000005, 2024-04-18T21:06:04.347 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026811423000000001, 2024-04-18T21:06:04.347 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:04.347 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:04.347 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.347 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:04.347 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:04.347 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:04.347 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 189 2024-04-18T21:06:04.347 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.347 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:04.347 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.347 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:04.348 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:04.348 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:04.348 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.348 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.348 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:04.348 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:04.348 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:04.348 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.348 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.348 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:04.348 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142410+0000", 2024-04-18T21:06:04.348 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:06:04.348 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.349 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.349 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:04.349 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142415+0000", 2024-04-18T21:06:04.349 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.7939999999999999e-06 2024-04-18T21:06:04.349 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.349 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.349 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:04.349 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142470+0000", 2024-04-18T21:06:04.349 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4537999999999999e-05 2024-04-18T21:06:04.349 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.349 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.349 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.349 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142481+0000", 2024-04-18T21:06:04.349 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0966e-05 2024-04-18T21:06:04.350 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.350 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.350 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:04.350 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.163493+0000", 2024-04-18T21:06:04.350 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021012444000000002 2024-04-18T21:06:04.350 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.350 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.350 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:04.350 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.163727+0000", 2024-04-18T21:06:04.350 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000233339 2024-04-18T21:06:04.350 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.350 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.350 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:04.351 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.164102+0000", 2024-04-18T21:06:04.351 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000374872 2024-04-18T21:06:04.351 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.351 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.351 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:04.351 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.166528+0000", 2024-04-18T21:06:04.351 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0024258729999999998 2024-04-18T21:06:04.351 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.351 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.351 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:04.351 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169101+0000", 2024-04-18T21:06:04.351 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0025737680000000001 2024-04-18T21:06:04.351 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.351 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.352 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:04.352 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169171+0000", 2024-04-18T21:06:04.352 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0148000000000007e-05 2024-04-18T21:06:04.352 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.352 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.352 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:04.352 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169220+0000", 2024-04-18T21:06:04.352 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8767999999999998e-05 2024-04-18T21:06:04.352 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:04.352 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:04.352 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:04.352 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.352 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.352 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:04.353 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:04.353 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 58.696755191999998, 2024-04-18T21:06:04.353 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024082777999999999, 2024-04-18T21:06:04.353 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:04.353 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:04.353 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.353 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:04.353 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.353 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:04.353 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:04.353 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:04.353 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.353 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.353 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:04.353 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:04.354 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:04.354 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.354 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.354 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:04.354 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615984+0000", 2024-04-18T21:06:04.354 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.9869999999999999e-06 2024-04-18T21:06:04.354 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.354 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.354 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:04.354 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615999+0000", 2024-04-18T21:06:04.354 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4646e-05 2024-04-18T21:06:04.354 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.354 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.355 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:04.355 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616028+0000", 2024-04-18T21:06:04.355 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8952999999999999e-05 2024-04-18T21:06:04.355 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.355 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.355 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.355 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616052+0000", 2024-04-18T21:06:04.355 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.3941999999999999e-05 2024-04-18T21:06:04.355 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.355 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.355 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:04.355 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618010+0000", 2024-04-18T21:06:04.355 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0019581780000000001 2024-04-18T21:06:04.355 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.356 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.356 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:04.356 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618322+0000", 2024-04-18T21:06:04.356 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00031158899999999997 2024-04-18T21:06:04.356 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.356 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.356 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:04.356 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618587+0000", 2024-04-18T21:06:04.356 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00026495700000000002 2024-04-18T21:06:04.356 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.357 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.357 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:04.357 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629262+0000", 2024-04-18T21:06:04.357 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010675877 2024-04-18T21:06:04.357 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.357 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.357 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:04.357 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.639773+0000", 2024-04-18T21:06:04.357 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0105109 2024-04-18T21:06:04.357 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.357 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.357 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:04.358 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.639926+0000", 2024-04-18T21:06:04.358 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000152349 2024-04-18T21:06:04.358 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.358 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.358 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:04.358 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640064+0000", 2024-04-18T21:06:04.358 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0001384 2024-04-18T21:06:04.358 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:04.358 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:04.358 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:04.358 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.359 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.359 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:04.359 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:04.359 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 58.696642517999997, 2024-04-18T21:06:04.359 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030215005999999999, 2024-04-18T21:06:04.359 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:04.359 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:04.359 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.359 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:04.359 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.360 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:04.360 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:04.360 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:04.360 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.360 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.360 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:04.360 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:04.360 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:04.360 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.360 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.360 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:04.360 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616095+0000", 2024-04-18T21:06:04.361 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.446e-06 2024-04-18T21:06:04.361 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.361 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.361 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:04.361 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616104+0000", 2024-04-18T21:06:04.361 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6200000000000005e-06 2024-04-18T21:06:04.361 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.361 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.361 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:04.361 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616132+0000", 2024-04-18T21:06:04.361 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7668999999999999e-05 2024-04-18T21:06:04.361 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.361 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.361 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.362 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616149+0000", 2024-04-18T21:06:04.362 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7047000000000001e-05 2024-04-18T21:06:04.362 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.362 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.362 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:04.362 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619287+0000", 2024-04-18T21:06:04.362 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0031381450000000002 2024-04-18T21:06:04.362 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.362 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.362 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:04.362 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619503+0000", 2024-04-18T21:06:04.362 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000216522 2024-04-18T21:06:04.362 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.363 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.363 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:04.363 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619930+0000", 2024-04-18T21:06:04.363 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00042604900000000001 2024-04-18T21:06:04.363 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.363 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.363 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:04.363 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629281+0000", 2024-04-18T21:06:04.363 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0093512230000000005 2024-04-18T21:06:04.363 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.363 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.363 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:04.363 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646022+0000", 2024-04-18T21:06:04.363 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016741156 2024-04-18T21:06:04.363 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.363 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.364 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:04.364 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646198+0000", 2024-04-18T21:06:04.364 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000176009 2024-04-18T21:06:04.364 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.364 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.364 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:04.364 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646309+0000", 2024-04-18T21:06:04.364 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011112000000000001 2024-04-18T21:06:04.364 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:04.364 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:04.364 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:04.364 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.364 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.364 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:04.364 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:04.364 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 58.696557693999999, 2024-04-18T21:06:04.365 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030501176000000001, 2024-04-18T21:06:04.365 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:04.365 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:04.365 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.365 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:04.365 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.365 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:04.365 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:04.365 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:04.365 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.365 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.365 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:04.365 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:04.365 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:04.366 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.366 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.366 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:04.366 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616180+0000", 2024-04-18T21:06:04.366 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1000000000000001e-06 2024-04-18T21:06:04.366 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.366 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.366 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:04.366 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616188+0000", 2024-04-18T21:06:04.366 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4069999999999993e-06 2024-04-18T21:06:04.366 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.366 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.366 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:04.367 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616207+0000", 2024-04-18T21:06:04.367 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8335999999999999e-05 2024-04-18T21:06:04.367 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.367 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.367 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.367 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616225+0000", 2024-04-18T21:06:04.367 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8652999999999999e-05 2024-04-18T21:06:04.367 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.367 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.367 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:04.367 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620977+0000", 2024-04-18T21:06:04.367 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047512220000000003 2024-04-18T21:06:04.367 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.367 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.367 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:04.368 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621279+0000", 2024-04-18T21:06:04.368 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000302646 2024-04-18T21:06:04.368 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.368 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.368 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:04.368 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621584+0000", 2024-04-18T21:06:04.368 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000305142 2024-04-18T21:06:04.368 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.368 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.368 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:04.368 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629352+0000", 2024-04-18T21:06:04.368 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0077673689999999997 2024-04-18T21:06:04.368 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.368 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.368 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:04.369 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646480+0000", 2024-04-18T21:06:04.369 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017128259 2024-04-18T21:06:04.369 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.369 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.369 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:04.369 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646591+0000", 2024-04-18T21:06:04.369 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011113899999999999 2024-04-18T21:06:04.369 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.369 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.369 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:04.369 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646680+0000", 2024-04-18T21:06:04.369 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8902999999999999e-05 2024-04-18T21:06:04.370 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:04.370 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:04.370 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:04.370 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.370 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.370 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:04.370 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:04.370 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 58.696491195, 2024-04-18T21:06:04.370 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030779760999999999, 2024-04-18T21:06:04.370 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:04.370 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:04.370 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.370 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:04.370 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.370 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:04.371 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:04.371 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:04.371 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.371 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.371 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:04.371 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:04.371 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:04.371 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.371 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.371 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:04.371 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616246+0000", 2024-04-18T21:06:04.371 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0499999999999999e-06 2024-04-18T21:06:04.371 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.371 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.371 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:04.372 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616253+0000", 2024-04-18T21:06:04.372 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.5989999999999998e-06 2024-04-18T21:06:04.372 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.372 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.372 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:04.372 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616273+0000", 2024-04-18T21:06:04.372 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9916999999999999e-05 2024-04-18T21:06:04.372 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.372 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.372 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.372 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616287+0000", 2024-04-18T21:06:04.372 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3669000000000001e-05 2024-04-18T21:06:04.372 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.372 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.372 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:04.373 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622203+0000", 2024-04-18T21:06:04.373 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.005916737 2024-04-18T21:06:04.373 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.373 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.373 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:04.373 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622379+0000", 2024-04-18T21:06:04.373 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000175596 2024-04-18T21:06:04.373 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.373 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.373 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:04.373 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622707+0000", 2024-04-18T21:06:04.373 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00032784600000000002 2024-04-18T21:06:04.373 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.373 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.373 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:04.374 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629366+0000", 2024-04-18T21:06:04.374 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0066593279999999999 2024-04-18T21:06:04.374 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.374 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.374 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:04.374 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646813+0000", 2024-04-18T21:06:04.374 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017447059000000001 2024-04-18T21:06:04.374 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.374 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.374 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:04.374 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646946+0000", 2024-04-18T21:06:04.374 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013301200000000001 2024-04-18T21:06:04.374 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.374 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.374 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:04.375 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647025+0000", 2024-04-18T21:06:04.375 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8948000000000004e-05 2024-04-18T21:06:04.375 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:04.375 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:04.375 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:04.375 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.375 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.375 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:04.375 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:04.375 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 58.696407377, 2024-04-18T21:06:04.375 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.031512165000000002, 2024-04-18T21:06:04.375 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:04.375 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:04.375 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.375 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:04.375 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.375 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:04.376 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:04.376 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:04.376 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.376 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.376 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:04.376 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:04.376 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:04.376 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.376 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.376 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:04.376 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616330+0000", 2024-04-18T21:06:04.376 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.15e-06 2024-04-18T21:06:04.376 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.376 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.376 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:04.377 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616337+0000", 2024-04-18T21:06:04.377 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.1289999999999998e-06 2024-04-18T21:06:04.377 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.377 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.377 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:04.377 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616447+0000", 2024-04-18T21:06:04.377 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109561 2024-04-18T21:06:04.377 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.377 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.377 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.377 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616496+0000", 2024-04-18T21:06:04.377 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8591999999999998e-05 2024-04-18T21:06:04.377 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.377 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.377 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:04.378 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.623786+0000", 2024-04-18T21:06:04.378 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0072906799999999999 2024-04-18T21:06:04.378 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.378 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.378 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:04.378 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.623973+0000", 2024-04-18T21:06:04.378 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018717199999999999 2024-04-18T21:06:04.378 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.378 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.378 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:04.378 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624260+0000", 2024-04-18T21:06:04.378 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00028630600000000001 2024-04-18T21:06:04.378 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.378 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.378 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:04.379 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629381+0000", 2024-04-18T21:06:04.379 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0051211340000000003 2024-04-18T21:06:04.379 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.379 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.379 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:04.379 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647631+0000", 2024-04-18T21:06:04.379 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018249771000000001 2024-04-18T21:06:04.379 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.379 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.379 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:04.379 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647761+0000", 2024-04-18T21:06:04.379 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013037300000000001 2024-04-18T21:06:04.379 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.379 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.379 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:04.380 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647841+0000", 2024-04-18T21:06:04.380 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.0296999999999994e-05 2024-04-18T21:06:04.380 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:04.380 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:04.380 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:04.380 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.380 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.380 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:04.380 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:04.380 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 58.696201893000001, 2024-04-18T21:06:04.380 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043251955000000002, 2024-04-18T21:06:04.380 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:04.380 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:04.380 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.381 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:04.381 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.381 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:04.381 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:04.381 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:04.381 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.381 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.381 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:04.381 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:04.381 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:04.381 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.381 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.381 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:04.381 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616536+0000", 2024-04-18T21:06:04.381 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2869999999999999e-06 2024-04-18T21:06:04.382 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.382 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.382 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:04.382 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616572+0000", 2024-04-18T21:06:04.382 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.6261999999999999e-05 2024-04-18T21:06:04.382 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.382 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.382 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:04.382 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616593+0000", 2024-04-18T21:06:04.382 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1310000000000001e-05 2024-04-18T21:06:04.382 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.382 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.382 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.382 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616614+0000", 2024-04-18T21:06:04.382 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.0936000000000001e-05 2024-04-18T21:06:04.383 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.383 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.383 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:04.383 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629501+0000", 2024-04-18T21:06:04.383 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.012886819000000001 2024-04-18T21:06:04.383 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.383 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.383 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:04.383 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629696+0000", 2024-04-18T21:06:04.383 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019485499999999999 2024-04-18T21:06:04.383 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.383 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.383 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:04.383 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629940+0000", 2024-04-18T21:06:04.383 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00024386399999999999 2024-04-18T21:06:04.383 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.384 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.384 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:04.384 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640100+0000", 2024-04-18T21:06:04.384 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010159645 2024-04-18T21:06:04.384 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.384 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.384 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:04.384 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659516+0000", 2024-04-18T21:06:04.384 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019416563000000001 2024-04-18T21:06:04.384 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.384 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.384 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:04.384 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659684+0000", 2024-04-18T21:06:04.384 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016750900000000001 2024-04-18T21:06:04.384 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.385 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.385 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:04.385 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659787+0000", 2024-04-18T21:06:04.385 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000102905 2024-04-18T21:06:04.385 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:04.385 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:04.385 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:04.385 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.385 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.385 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:04.385 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:04.385 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 58.696096771000001, 2024-04-18T21:06:04.385 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043581898000000001, 2024-04-18T21:06:04.385 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:04.385 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:04.386 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.386 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:04.386 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.386 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:04.386 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:04.386 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:04.386 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.386 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.386 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:04.386 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:04.386 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:04.386 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.386 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.387 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:04.387 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616641+0000", 2024-04-18T21:06:04.387 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:06:04.387 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.387 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.387 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:04.387 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616648+0000", 2024-04-18T21:06:04.387 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3860000000000001e-06 2024-04-18T21:06:04.387 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.387 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.387 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:04.387 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616666+0000", 2024-04-18T21:06:04.387 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7583000000000001e-05 2024-04-18T21:06:04.387 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.388 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.388 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.388 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616679+0000", 2024-04-18T21:06:04.388 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3322999999999999e-05 2024-04-18T21:06:04.388 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.388 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.388 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:04.388 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630373+0000", 2024-04-18T21:06:04.388 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013694207999999999 2024-04-18T21:06:04.388 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.388 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.388 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:04.388 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630545+0000", 2024-04-18T21:06:04.388 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000171683 2024-04-18T21:06:04.389 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.389 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.389 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:04.389 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630728+0000", 2024-04-18T21:06:04.389 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000182599 2024-04-18T21:06:04.389 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.389 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.389 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:04.389 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640600+0000", 2024-04-18T21:06:04.389 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0098726119999999994 2024-04-18T21:06:04.389 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.389 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.389 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:04.389 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659927+0000", 2024-04-18T21:06:04.390 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019326724999999999 2024-04-18T21:06:04.390 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.390 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.390 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:04.390 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660112+0000", 2024-04-18T21:06:04.390 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000185203 2024-04-18T21:06:04.390 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.390 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.390 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:04.390 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660222+0000", 2024-04-18T21:06:04.390 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109343 2024-04-18T21:06:04.390 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:04.390 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:04.390 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:04.391 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.391 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.391 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:04.391 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:04.391 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 58.695231413000002, 2024-04-18T21:06:04.391 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043121310000000003, 2024-04-18T21:06:04.391 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:04.391 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:04.391 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.391 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:04.391 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.391 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:04.391 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:04.391 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:04.391 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.391 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.391 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:04.392 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:04.392 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:04.392 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.392 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.392 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:04.392 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617506+0000", 2024-04-18T21:06:04.392 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9999999999999995e-07 2024-04-18T21:06:04.392 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.392 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.392 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:04.392 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617513+0000", 2024-04-18T21:06:04.392 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.9700000000000002e-06 2024-04-18T21:06:04.392 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.392 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.392 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:04.392 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617531+0000", 2024-04-18T21:06:04.393 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8105999999999999e-05 2024-04-18T21:06:04.393 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.393 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.393 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.393 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617545+0000", 2024-04-18T21:06:04.393 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3703000000000001e-05 2024-04-18T21:06:04.393 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.393 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.393 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:04.393 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632129+0000", 2024-04-18T21:06:04.393 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.014584135999999999 2024-04-18T21:06:04.393 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.393 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.393 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:04.394 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632361+0000", 2024-04-18T21:06:04.394 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023171800000000001 2024-04-18T21:06:04.394 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.394 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.394 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:04.394 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632804+0000", 2024-04-18T21:06:04.394 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000443549 2024-04-18T21:06:04.394 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.394 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.394 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:04.394 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646340+0000", 2024-04-18T21:06:04.395 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013535902000000001 2024-04-18T21:06:04.395 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.395 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.395 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:04.395 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660363+0000", 2024-04-18T21:06:04.395 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01402318 2024-04-18T21:06:04.395 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.395 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.395 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:04.395 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660523+0000", 2024-04-18T21:06:04.395 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00015989899999999999 2024-04-18T21:06:04.395 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.395 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.395 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:04.396 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660626+0000", 2024-04-18T21:06:04.396 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010314699999999999 2024-04-18T21:06:04.396 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:04.396 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:04.396 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:04.396 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.396 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.396 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:04.396 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:04.396 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 58.695091720000001, 2024-04-18T21:06:04.396 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024927483, 2024-04-18T21:06:04.396 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:04.396 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:04.397 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.397 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:04.397 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.397 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:04.397 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:04.397 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:04.397 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.397 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.397 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:04.397 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:04.397 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:04.397 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.397 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.397 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:04.398 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617646+0000", 2024-04-18T21:06:04.398 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3030000000000001e-06 2024-04-18T21:06:04.398 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.398 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.398 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:04.398 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617653+0000", 2024-04-18T21:06:04.398 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7530000000000004e-06 2024-04-18T21:06:04.398 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.398 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.398 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:04.398 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617673+0000", 2024-04-18T21:06:04.398 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9967e-05 2024-04-18T21:06:04.398 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.398 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.398 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.399 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617688+0000", 2024-04-18T21:06:04.399 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5153e-05 2024-04-18T21:06:04.399 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.399 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.399 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:04.399 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619244+0000", 2024-04-18T21:06:04.399 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001555531 2024-04-18T21:06:04.399 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.399 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.399 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:04.399 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619361+0000", 2024-04-18T21:06:04.399 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011784400000000001 2024-04-18T21:06:04.399 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.399 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.399 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:04.400 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619604+0000", 2024-04-18T21:06:04.400 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000243007 2024-04-18T21:06:04.400 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.400 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.400 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:04.400 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.625480+0000", 2024-04-18T21:06:04.400 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0058759349999999997 2024-04-18T21:06:04.400 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.400 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.400 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:04.400 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642342+0000", 2024-04-18T21:06:04.400 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016861373999999998 2024-04-18T21:06:04.400 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.400 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.401 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:04.401 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642484+0000", 2024-04-18T21:06:04.401 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000142423 2024-04-18T21:06:04.401 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.401 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.401 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:04.401 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642572+0000", 2024-04-18T21:06:04.401 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8193000000000001e-05 2024-04-18T21:06:04.401 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:04.401 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:04.401 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:04.401 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.401 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.401 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:04.401 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:04.402 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 58.694810216999997, 2024-04-18T21:06:04.402 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024956974999999999, 2024-04-18T21:06:04.402 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:04.402 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:04.402 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.402 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:04.402 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.402 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:04.402 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:04.402 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:04.402 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.402 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.403 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:04.403 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:04.403 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:04.403 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.403 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.403 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:04.403 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617928+0000", 2024-04-18T21:06:04.403 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5430000000000001e-06 2024-04-18T21:06:04.403 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.403 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.403 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:04.403 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617937+0000", 2024-04-18T21:06:04.403 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6629999999999999e-06 2024-04-18T21:06:04.403 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.403 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.404 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:04.404 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617955+0000", 2024-04-18T21:06:04.404 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8749999999999998e-05 2024-04-18T21:06:04.404 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.404 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.404 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.404 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617971+0000", 2024-04-18T21:06:04.404 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.605e-05 2024-04-18T21:06:04.404 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.404 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.404 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:04.404 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621019+0000", 2024-04-18T21:06:04.404 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0030472369999999999 2024-04-18T21:06:04.404 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.404 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.404 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:04.405 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621249+0000", 2024-04-18T21:06:04.405 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000230075 2024-04-18T21:06:04.405 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.405 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.405 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:04.405 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621450+0000", 2024-04-18T21:06:04.405 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020166499999999999 2024-04-18T21:06:04.405 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.405 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.405 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:04.405 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.626233+0000", 2024-04-18T21:06:04.405 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047827390000000003 2024-04-18T21:06:04.405 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.405 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.405 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:04.406 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642693+0000", 2024-04-18T21:06:04.406 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01645961 2024-04-18T21:06:04.406 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.406 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.406 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:04.406 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642798+0000", 2024-04-18T21:06:04.406 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010559499999999999 2024-04-18T21:06:04.406 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.406 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.406 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:04.406 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642883+0000", 2024-04-18T21:06:04.406 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5048000000000003e-05 2024-04-18T21:06:04.406 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:04.407 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:04.407 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:04.407 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.407 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.407 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:04.407 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:04.407 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 58.693114588999997, 2024-04-18T21:06:04.407 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024086478000000001, 2024-04-18T21:06:04.407 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:04.407 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:04.407 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.407 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:04.407 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.407 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:04.408 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:04.408 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:04.408 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.408 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.408 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:04.408 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:04.408 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:04.408 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.408 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.408 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:04.408 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619624+0000", 2024-04-18T21:06:04.408 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.75e-06 2024-04-18T21:06:04.408 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.408 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.409 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:04.409 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619637+0000", 2024-04-18T21:06:04.409 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3540000000000001e-05 2024-04-18T21:06:04.409 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.409 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.409 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:04.409 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619666+0000", 2024-04-18T21:06:04.409 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8685999999999999e-05 2024-04-18T21:06:04.409 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.409 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.410 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.410 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619685+0000", 2024-04-18T21:06:04.410 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8681999999999998e-05 2024-04-18T21:06:04.410 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.410 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.410 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:04.410 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622275+0000", 2024-04-18T21:06:04.410 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0025899260000000002 2024-04-18T21:06:04.410 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.410 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.410 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:04.411 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622572+0000", 2024-04-18T21:06:04.411 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00029722 2024-04-18T21:06:04.411 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.411 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.411 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:04.411 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622752+0000", 2024-04-18T21:06:04.411 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018065900000000001 2024-04-18T21:06:04.411 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.411 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.411 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:04.411 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.626326+0000", 2024-04-18T21:06:04.411 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035737310000000001 2024-04-18T21:06:04.411 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.411 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.412 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:04.412 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643565+0000", 2024-04-18T21:06:04.412 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017238430999999999 2024-04-18T21:06:04.412 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.412 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.412 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:04.412 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643646+0000", 2024-04-18T21:06:04.412 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.1481000000000001e-05 2024-04-18T21:06:04.412 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.412 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.412 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:04.412 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643708+0000", 2024-04-18T21:06:04.412 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.2372000000000005e-05 2024-04-18T21:06:04.412 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:04.412 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:04.413 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:04.413 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.413 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.413 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:04.413 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:04.413 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 58.692948436000002, 2024-04-18T21:06:04.413 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026822450000000001, 2024-04-18T21:06:04.413 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:04.413 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:04.413 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.413 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:04.413 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.413 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:04.414 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:04.414 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:04.414 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.414 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.414 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:04.414 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:04.414 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:04.414 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.414 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.414 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:04.414 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619789+0000", 2024-04-18T21:06:04.414 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:06:04.414 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.414 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.415 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:04.415 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619797+0000", 2024-04-18T21:06:04.415 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.6899999999999992e-06 2024-04-18T21:06:04.415 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.415 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.415 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:04.415 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619816+0000", 2024-04-18T21:06:04.415 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9352999999999999e-05 2024-04-18T21:06:04.415 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.415 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.415 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.415 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619832+0000", 2024-04-18T21:06:04.415 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6013000000000001e-05 2024-04-18T21:06:04.415 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.416 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.416 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:04.416 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620528+0000", 2024-04-18T21:06:04.416 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00069565600000000001 2024-04-18T21:06:04.416 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.416 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.416 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:04.416 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620735+0000", 2024-04-18T21:06:04.416 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000207025 2024-04-18T21:06:04.416 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.416 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.416 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:04.416 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620912+0000", 2024-04-18T21:06:04.416 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017748199999999999 2024-04-18T21:06:04.416 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.417 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.417 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:04.417 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.625605+0000", 2024-04-18T21:06:04.417 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0046924439999999996 2024-04-18T21:06:04.417 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.417 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.417 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:04.417 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646349+0000", 2024-04-18T21:06:04.417 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.020744318000000001 2024-04-18T21:06:04.417 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.417 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.417 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:04.417 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646483+0000", 2024-04-18T21:06:04.418 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013428999999999999 2024-04-18T21:06:04.418 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.418 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.418 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:04.418 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646611+0000", 2024-04-18T21:06:04.418 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012710299999999999 2024-04-18T21:06:04.418 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:04.418 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:04.418 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:04.418 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.418 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.418 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:04.418 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:06:04.419 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 58.692278002999998, 2024-04-18T21:06:04.419 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023516516000000001, 2024-04-18T21:06:04.419 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:04.419 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:04.419 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:06:04.419 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:04.419 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.419 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:04.419 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:06:04.419 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:04.419 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.419 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.419 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:04.420 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:06:04.420 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:04.420 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.420 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.420 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:04.420 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620460+0000", 2024-04-18T21:06:04.420 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.787e-06 2024-04-18T21:06:04.420 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.420 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.420 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:04.420 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620470+0000", 2024-04-18T21:06:04.420 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.2560000000000008e-06 2024-04-18T21:06:04.420 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.420 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.421 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:04.421 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620496+0000", 2024-04-18T21:06:04.421 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.6205999999999999e-05 2024-04-18T21:06:04.421 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.421 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.421 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.421 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620517+0000", 2024-04-18T21:06:04.421 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1223e-05 2024-04-18T21:06:04.421 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.421 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.421 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:04.421 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624060+0000", 2024-04-18T21:06:04.421 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035434160000000002 2024-04-18T21:06:04.421 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.421 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.422 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:04.422 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624390+0000", 2024-04-18T21:06:04.422 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00033000500000000002 2024-04-18T21:06:04.422 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:04.422 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:04.422 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:04.422 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643975+0000", 2024-04-18T21:06:04.422 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019584622999999999 2024-04-18T21:06:04.422 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:04.422 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:04.422 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:04.422 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:04.422 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:04.423 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:04.424 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:04.425 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:04.423+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:04.524 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:04.523+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:04.557 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:06:04.557 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [], 2024-04-18T21:06:04.558 INFO:teuthology.orchestra.run.smithi150.stdout: "num_ops": 0 2024-04-18T21:06:04.558 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:06:04.572 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:04.625 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:04.627+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:04.726 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:04.727+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:04.736 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:06:04.736 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [], 2024-04-18T21:06:04.736 INFO:teuthology.orchestra.run.smithi150.stdout: "complaint_time": 30, 2024-04-18T21:06:04.737 INFO:teuthology.orchestra.run.smithi150.stdout: "num_blocked_ops": 0 2024-04-18T21:06:04.737 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:06:04.750 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:04.826 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:04.827+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:04.872 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:06:04.872 INFO:teuthology.orchestra.run.smithi150.stdout: "size": 20, 2024-04-18T21:06:04.872 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 600, 2024-04-18T21:06:04.872 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [ 2024-04-18T21:06:04.872 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.872 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-18T21:06:04.872 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:06:04.872 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 70.067060560000002, 2024-04-18T21:06:04.872 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0093051590000000003, 2024-04-18T21:06:04.872 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:04.873 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:04.873 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.873 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:04.873 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.873 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:04.873 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:06:04.873 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:04.873 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.873 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.873 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:04.873 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:06:04.873 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:04.873 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.873 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.874 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:04.874 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804851+0000", 2024-04-18T21:06:04.874 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7039999999999999e-06 2024-04-18T21:06:04.874 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.874 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.874 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:04.874 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804864+0000", 2024-04-18T21:06:04.874 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.276e-05 2024-04-18T21:06:04.874 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.874 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.874 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:04.874 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804895+0000", 2024-04-18T21:06:04.875 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.1204999999999997e-05 2024-04-18T21:06:04.875 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.875 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.875 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.875 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804908+0000", 2024-04-18T21:06:04.875 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3317e-05 2024-04-18T21:06:04.875 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.875 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.875 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:04.875 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805131+0000", 2024-04-18T21:06:04.875 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00022246700000000001 2024-04-18T21:06:04.875 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.876 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.876 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:04.876 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805171+0000", 2024-04-18T21:06:04.876 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.0164999999999999e-05 2024-04-18T21:06:04.876 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.876 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.876 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:04.876 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814086+0000", 2024-04-18T21:06:04.876 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0089155329999999998 2024-04-18T21:06:04.876 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.876 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.876 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:04.876 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814154+0000", 2024-04-18T21:06:04.877 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.8008000000000003e-05 2024-04-18T21:06:04.877 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:04.877 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:04.877 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:04.877 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.877 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.877 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-18T21:06:04.877 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:06:04.877 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 70.066295366999995, 2024-04-18T21:06:04.877 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0086469770000000001, 2024-04-18T21:06:04.877 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:04.877 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:04.878 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.878 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:04.878 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.878 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:04.878 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:06:04.878 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:04.878 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.878 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.878 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:04.878 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:06:04.878 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:04.878 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.879 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.879 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:04.879 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805616+0000", 2024-04-18T21:06:04.879 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7799999999999999e-06 2024-04-18T21:06:04.879 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.879 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.879 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:04.879 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805707+0000", 2024-04-18T21:06:04.879 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0917999999999999e-05 2024-04-18T21:06:04.879 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.879 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.879 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:04.879 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805739+0000", 2024-04-18T21:06:04.879 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.2512000000000003e-05 2024-04-18T21:06:04.880 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.880 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.880 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.880 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805763+0000", 2024-04-18T21:06:04.880 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3266000000000001e-05 2024-04-18T21:06:04.880 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.880 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.880 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:04.880 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.806024+0000", 2024-04-18T21:06:04.880 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000261716 2024-04-18T21:06:04.880 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.880 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.880 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:04.880 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.806073+0000", 2024-04-18T21:06:04.881 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.8844999999999997e-05 2024-04-18T21:06:04.881 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.881 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.881 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:04.881 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814162+0000", 2024-04-18T21:06:04.881 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0080882860000000001 2024-04-18T21:06:04.881 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.881 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.881 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:04.881 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814261+0000", 2024-04-18T21:06:04.881 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.9654000000000005e-05 2024-04-18T21:06:04.881 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:04.881 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:04.881 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:04.882 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.882 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.882 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'64)", 2024-04-18T21:06:04.882 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:06:04.882 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 70.064524323000001, 2024-04-18T21:06:04.882 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0089721509999999994, 2024-04-18T21:06:04.882 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:04.882 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:04.882 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.882 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:04.882 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.882 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:04.882 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:06:04.883 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:04.883 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.883 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.883 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:04.883 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:06:04.883 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:04.883 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.883 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.883 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:04.883 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807387+0000", 2024-04-18T21:06:04.883 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.0329999999999998e-06 2024-04-18T21:06:04.883 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.883 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.883 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:04.884 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807443+0000", 2024-04-18T21:06:04.884 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.5376e-05 2024-04-18T21:06:04.884 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.884 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.884 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:04.884 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807467+0000", 2024-04-18T21:06:04.884 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.4621999999999999e-05 2024-04-18T21:06:04.884 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.884 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.884 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.884 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807482+0000", 2024-04-18T21:06:04.884 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.436e-05 2024-04-18T21:06:04.884 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.885 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.885 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:04.885 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.809243+0000", 2024-04-18T21:06:04.885 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001761725 2024-04-18T21:06:04.885 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.885 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.885 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:04.885 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.809295+0000", 2024-04-18T21:06:04.885 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.1445e-05 2024-04-18T21:06:04.885 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.885 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.885 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:04.885 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.816293+0000", 2024-04-18T21:06:04.885 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0069981749999999997 2024-04-18T21:06:04.886 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.886 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.886 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:04.886 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.816357+0000", 2024-04-18T21:06:04.886 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.4414999999999999e-05 2024-04-18T21:06:04.886 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:04.886 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:04.886 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:04.886 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.886 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.886 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:04.886 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:06:04.886 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 59.256614953000003, 2024-04-18T21:06:04.887 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.040843365, 2024-04-18T21:06:04.887 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:04.887 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:04.887 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.887 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:04.887 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.887 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:04.887 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:06:04.887 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:04.887 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.887 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.887 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:04.887 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:06:04.888 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:04.888 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.888 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.888 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:04.888 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615297+0000", 2024-04-18T21:06:04.888 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2800000000000002e-06 2024-04-18T21:06:04.888 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.888 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.888 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:04.888 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615308+0000", 2024-04-18T21:06:04.888 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0813e-05 2024-04-18T21:06:04.888 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.888 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.888 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:04.889 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615330+0000", 2024-04-18T21:06:04.889 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2370000000000001e-05 2024-04-18T21:06:04.889 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.889 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.889 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.889 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615346+0000", 2024-04-18T21:06:04.889 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6200000000000001e-05 2024-04-18T21:06:04.889 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.889 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.889 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:04.889 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615470+0000", 2024-04-18T21:06:04.889 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012385799999999999 2024-04-18T21:06:04.890 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.890 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.890 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:04.890 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615488+0000", 2024-04-18T21:06:04.890 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7923000000000001e-05 2024-04-18T21:06:04.890 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.890 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.890 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:04.890 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.630993+0000", 2024-04-18T21:06:04.890 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.01550532 2024-04-18T21:06:04.890 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.890 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.891 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:04.891 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631165+0000", 2024-04-18T21:06:04.891 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000171588 2024-04-18T21:06:04.891 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.891 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.891 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:04.891 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631320+0000", 2024-04-18T21:06:04.891 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000155162 2024-04-18T21:06:04.891 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.891 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.892 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:04.892 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635157+0000", 2024-04-18T21:06:04.892 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0038370790000000002 2024-04-18T21:06:04.892 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.892 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.892 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:04.892 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.655904+0000", 2024-04-18T21:06:04.892 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.020746483999999999 2024-04-18T21:06:04.892 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.892 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.892 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:04.893 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656032+0000", 2024-04-18T21:06:04.893 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012864199999999999 2024-04-18T21:06:04.893 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.893 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.893 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:04.893 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656138+0000", 2024-04-18T21:06:04.893 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000105646 2024-04-18T21:06:04.893 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:04.893 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:04.893 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:04.893 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.893 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.894 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:04.894 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:06:04.894 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 59.256522781000001, 2024-04-18T21:06:04.894 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.041266444999999999, 2024-04-18T21:06:04.894 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:04.894 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:04.894 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.894 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:04.894 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.894 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:04.894 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:06:04.894 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:04.895 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.895 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.895 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:04.895 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:06:04.895 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:04.895 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.895 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.895 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:04.895 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615388+0000", 2024-04-18T21:06:04.895 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:06:04.895 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.895 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.895 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:04.895 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:06:04.896 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.7299999999999994e-06 2024-04-18T21:06:04.896 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.896 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.896 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:04.896 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615415+0000", 2024-04-18T21:06:04.896 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7807000000000001e-05 2024-04-18T21:06:04.896 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.896 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.896 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.896 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615431+0000", 2024-04-18T21:06:04.896 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6127e-05 2024-04-18T21:06:04.896 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.896 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.897 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:04.897 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615621+0000", 2024-04-18T21:06:04.897 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000189781 2024-04-18T21:06:04.897 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.897 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.897 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:04.897 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615634+0000", 2024-04-18T21:06:04.897 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3383e-05 2024-04-18T21:06:04.897 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.897 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.897 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:04.897 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631703+0000", 2024-04-18T21:06:04.897 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016068737 2024-04-18T21:06:04.897 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.898 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.898 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:04.898 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631809+0000", 2024-04-18T21:06:04.898 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000106823 2024-04-18T21:06:04.898 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.898 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.898 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:04.898 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631988+0000", 2024-04-18T21:06:04.898 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000179008 2024-04-18T21:06:04.898 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.898 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.898 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:04.898 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635172+0000", 2024-04-18T21:06:04.898 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.003183029 2024-04-18T21:06:04.899 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.899 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.899 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:04.899 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656392+0000", 2024-04-18T21:06:04.899 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.021220638999999999 2024-04-18T21:06:04.899 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.899 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.899 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:04.899 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656533+0000", 2024-04-18T21:06:04.899 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014126500000000001 2024-04-18T21:06:04.899 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.899 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.899 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:04.900 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656653+0000", 2024-04-18T21:06:04.900 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000119883 2024-04-18T21:06:04.900 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:04.900 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:04.900 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:04.900 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.900 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.900 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:04.900 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:06:04.900 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 59.256435357999997, 2024-04-18T21:06:04.900 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.042492302000000003, 2024-04-18T21:06:04.900 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:04.901 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:04.901 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.901 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:04.901 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.901 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:04.901 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:06:04.901 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:04.901 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.901 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.901 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:04.901 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:06:04.902 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:04.902 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.902 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.902 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:04.902 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615475+0000", 2024-04-18T21:06:04.902 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.17e-06 2024-04-18T21:06:04.902 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.902 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.902 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:04.902 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615528+0000", 2024-04-18T21:06:04.902 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.2159e-05 2024-04-18T21:06:04.902 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.903 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.903 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:04.903 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615542+0000", 2024-04-18T21:06:04.903 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4197e-05 2024-04-18T21:06:04.903 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.903 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.903 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.903 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615559+0000", 2024-04-18T21:06:04.903 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.749e-05 2024-04-18T21:06:04.903 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.903 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.903 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:04.903 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615685+0000", 2024-04-18T21:06:04.903 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012617499999999999 2024-04-18T21:06:04.904 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.904 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.904 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:04.904 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:06:04.904 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4749999999999999e-05 2024-04-18T21:06:04.904 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.904 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.904 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:04.904 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632332+0000", 2024-04-18T21:06:04.904 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016631988 2024-04-18T21:06:04.904 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.904 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.904 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:04.905 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632477+0000", 2024-04-18T21:06:04.905 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014437200000000001 2024-04-18T21:06:04.905 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.905 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.905 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:04.905 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632620+0000", 2024-04-18T21:06:04.905 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000143566 2024-04-18T21:06:04.905 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.905 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.905 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:04.905 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635185+0000", 2024-04-18T21:06:04.905 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0025644209999999999 2024-04-18T21:06:04.905 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.905 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.906 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:04.906 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657803+0000", 2024-04-18T21:06:04.906 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.022618743 2024-04-18T21:06:04.906 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.906 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.906 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:04.906 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657890+0000", 2024-04-18T21:06:04.906 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.6688999999999996e-05 2024-04-18T21:06:04.906 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.906 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.906 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:04.907 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657967+0000", 2024-04-18T21:06:04.907 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.6582000000000006e-05 2024-04-18T21:06:04.907 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:04.907 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:04.907 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:04.907 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.907 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.907 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:04.907 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:06:04.907 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 59.256304546000003, 2024-04-18T21:06:04.907 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.043603435000000003, 2024-04-18T21:06:04.907 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:04.908 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:04.908 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.908 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:04.908 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.908 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:04.908 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:06:04.908 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:04.908 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.908 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.908 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:04.908 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:06:04.908 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:04.909 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.909 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.909 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:04.909 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615607+0000", 2024-04-18T21:06:04.909 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4300000000000001e-06 2024-04-18T21:06:04.909 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.909 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.909 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:04.909 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615614+0000", 2024-04-18T21:06:04.909 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.4100000000000002e-06 2024-04-18T21:06:04.909 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.909 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.910 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:04.910 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615632+0000", 2024-04-18T21:06:04.910 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7863000000000002e-05 2024-04-18T21:06:04.910 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.910 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.910 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.910 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615647+0000", 2024-04-18T21:06:04.910 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5187e-05 2024-04-18T21:06:04.910 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.910 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.910 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:04.910 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615765+0000", 2024-04-18T21:06:04.910 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000117955 2024-04-18T21:06:04.911 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.911 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.911 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:04.911 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615781+0000", 2024-04-18T21:06:04.911 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6123000000000001e-05 2024-04-18T21:06:04.911 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.911 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.911 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:04.911 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633055+0000", 2024-04-18T21:06:04.911 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.017273909 2024-04-18T21:06:04.911 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.912 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.912 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:04.912 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633254+0000", 2024-04-18T21:06:04.912 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00019903799999999999 2024-04-18T21:06:04.912 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.912 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.912 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:04.912 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633624+0000", 2024-04-18T21:06:04.912 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000369656 2024-04-18T21:06:04.912 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.912 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.912 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:04.912 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635595+0000", 2024-04-18T21:06:04.912 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001971287 2024-04-18T21:06:04.913 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.913 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.913 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:04.913 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659026+0000", 2024-04-18T21:06:04.913 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.023431495 2024-04-18T21:06:04.913 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.913 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.913 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:04.913 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659117+0000", 2024-04-18T21:06:04.913 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0885999999999997e-05 2024-04-18T21:06:04.913 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.913 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.913 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:04.913 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659209+0000", 2024-04-18T21:06:04.914 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.1195999999999999e-05 2024-04-18T21:06:04.914 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:04.914 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:04.914 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:04.914 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.914 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.914 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:04.914 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:04.914 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 59.256239317000002, 2024-04-18T21:06:04.914 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.03492514, 2024-04-18T21:06:04.914 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:04.914 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:04.914 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.915 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:04.915 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.915 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:04.915 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:04.915 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:04.915 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.915 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.915 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:04.915 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:04.915 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:04.915 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.916 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.916 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:04.916 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:06:04.916 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.407e-06 2024-04-18T21:06:04.916 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.916 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.916 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:04.916 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615679+0000", 2024-04-18T21:06:04.916 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.2130000000000002e-06 2024-04-18T21:06:04.916 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.916 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.916 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:04.917 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615701+0000", 2024-04-18T21:06:04.917 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2316000000000001e-05 2024-04-18T21:06:04.917 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.917 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.917 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.917 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615717+0000", 2024-04-18T21:06:04.917 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6197000000000001e-05 2024-04-18T21:06:04.917 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.917 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.917 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:04.917 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615828+0000", 2024-04-18T21:06:04.917 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000110899 2024-04-18T21:06:04.918 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.918 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.918 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:04.918 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615840+0000", 2024-04-18T21:06:04.918 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.1423000000000001e-05 2024-04-18T21:06:04.918 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.918 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.918 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:04.918 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628046+0000", 2024-04-18T21:06:04.918 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.012206295000000001 2024-04-18T21:06:04.918 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.918 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.919 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:04.919 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628323+0000", 2024-04-18T21:06:04.919 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00027658700000000001 2024-04-18T21:06:04.919 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.919 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.919 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:04.919 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628599+0000", 2024-04-18T21:06:04.919 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00027676699999999997 2024-04-18T21:06:04.919 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.919 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.919 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:04.920 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634869+0000", 2024-04-18T21:06:04.920 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.006269536 2024-04-18T21:06:04.920 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.920 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.920 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:04.920 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650333+0000", 2024-04-18T21:06:04.920 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.015463645999999999 2024-04-18T21:06:04.920 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.920 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.920 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:04.920 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650474+0000", 2024-04-18T21:06:04.920 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014091799999999999 2024-04-18T21:06:04.920 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.920 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.921 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:04.921 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650595+0000", 2024-04-18T21:06:04.921 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012193600000000001 2024-04-18T21:06:04.921 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:04.921 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:04.921 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:04.921 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.921 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.921 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:04.921 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:06:04.921 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 59.256154207999998, 2024-04-18T21:06:04.921 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.040588320999999997, 2024-04-18T21:06:04.921 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:04.921 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:04.922 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.922 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:04.922 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.922 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:04.922 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:06:04.922 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:04.922 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.922 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.922 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:04.922 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:06:04.922 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:04.923 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.923 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.923 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:04.923 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615757+0000", 2024-04-18T21:06:04.923 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2270000000000001e-06 2024-04-18T21:06:04.923 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.923 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.923 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:04.923 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615765+0000", 2024-04-18T21:06:04.923 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.9400000000000002e-06 2024-04-18T21:06:04.923 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.923 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.923 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:04.923 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615785+0000", 2024-04-18T21:06:04.923 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.0749000000000001e-05 2024-04-18T21:06:04.923 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.923 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.924 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.924 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615804+0000", 2024-04-18T21:06:04.924 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.8774e-05 2024-04-18T21:06:04.924 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.924 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.924 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:04.924 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615888+0000", 2024-04-18T21:06:04.924 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.4111999999999997e-05 2024-04-18T21:06:04.924 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.924 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.924 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:04.924 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615895+0000", 2024-04-18T21:06:04.924 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.0469999999999996e-06 2024-04-18T21:06:04.924 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.924 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.924 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:04.925 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629280+0000", 2024-04-18T21:06:04.925 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.013384416 2024-04-18T21:06:04.925 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.925 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.925 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:04.925 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629488+0000", 2024-04-18T21:06:04.925 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00020852800000000001 2024-04-18T21:06:04.925 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.925 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.925 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:04.925 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629869+0000", 2024-04-18T21:06:04.925 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00038042300000000001 2024-04-18T21:06:04.925 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.925 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.925 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:04.925 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635041+0000", 2024-04-18T21:06:04.926 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.005172383 2024-04-18T21:06:04.926 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.926 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.926 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:04.926 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656125+0000", 2024-04-18T21:06:04.926 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.021084025999999999 2024-04-18T21:06:04.926 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.926 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.926 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:04.926 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656240+0000", 2024-04-18T21:06:04.926 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000115352 2024-04-18T21:06:04.926 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.926 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.926 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:04.927 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656344+0000", 2024-04-18T21:06:04.927 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00010334400000000001 2024-04-18T21:06:04.927 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:04.927 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:04.927 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:04.927 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.927 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.927 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:04.927 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:04.927 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 59.256086887999999, 2024-04-18T21:06:04.927 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.043549577999999999, 2024-04-18T21:06:04.927 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:04.927 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:04.927 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.928 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:04.928 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.928 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:04.928 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:04.928 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:04.928 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.928 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.928 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:04.928 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:04.928 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:04.928 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.928 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.928 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:04.928 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:04.928 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.5000000000000002e-07 2024-04-18T21:06:04.928 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.929 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.929 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:04.929 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615828+0000", 2024-04-18T21:06:04.929 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.2359999999999998e-06 2024-04-18T21:06:04.929 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.929 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.929 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:04.929 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615838+0000", 2024-04-18T21:06:04.929 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0087e-05 2024-04-18T21:06:04.929 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.929 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.929 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.929 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615846+0000", 2024-04-18T21:06:04.929 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.67e-06 2024-04-18T21:06:04.929 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.929 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.930 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:04.930 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615963+0000", 2024-04-18T21:06:04.930 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00011630500000000001 2024-04-18T21:06:04.930 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.930 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.930 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:04.930 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615979+0000", 2024-04-18T21:06:04.930 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.613e-05 2024-04-18T21:06:04.930 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.930 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.930 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:04.930 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632392+0000", 2024-04-18T21:06:04.930 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016413317 2024-04-18T21:06:04.930 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.930 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.930 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:04.931 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632568+0000", 2024-04-18T21:06:04.931 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00017539500000000001 2024-04-18T21:06:04.931 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.931 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.931 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:04.931 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632748+0000", 2024-04-18T21:06:04.931 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00017991799999999999 2024-04-18T21:06:04.931 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.931 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.931 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:04.931 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635542+0000", 2024-04-18T21:06:04.931 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00279481 2024-04-18T21:06:04.931 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.931 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.931 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:04.931 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659232+0000", 2024-04-18T21:06:04.932 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.023689212000000001 2024-04-18T21:06:04.932 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.932 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.932 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:04.932 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659314+0000", 2024-04-18T21:06:04.932 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.2528999999999995e-05 2024-04-18T21:06:04.932 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.932 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.932 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:04.932 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659372+0000", 2024-04-18T21:06:04.932 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.8218999999999999e-05 2024-04-18T21:06:04.932 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:04.932 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:04.932 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:04.932 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.933 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.933 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:04.933 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:06:04.933 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 59.256025456000003, 2024-04-18T21:06:04.933 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.039335347, 2024-04-18T21:06:04.933 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:04.933 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:04.933 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "started", 2024-04-18T21:06:04.933 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:04.933 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.933 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:04.933 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:06:04.933 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:04.933 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.933 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.934 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:04.934 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:06:04.934 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:04.934 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.934 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.934 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:04.934 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615885+0000", 2024-04-18T21:06:04.934 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2699999999999999e-06 2024-04-18T21:06:04.934 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.934 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.934 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:04.934 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615892+0000", 2024-04-18T21:06:04.934 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.6499999999999999e-06 2024-04-18T21:06:04.935 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.935 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.935 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:04.935 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615906+0000", 2024-04-18T21:06:04.935 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.393e-05 2024-04-18T21:06:04.935 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.935 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.935 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.935 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615919+0000", 2024-04-18T21:06:04.935 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2860000000000001e-05 2024-04-18T21:06:04.935 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.935 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.935 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:04.935 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616027+0000", 2024-04-18T21:06:04.935 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000107852 2024-04-18T21:06:04.935 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.935 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.936 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:04.936 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616037+0000", 2024-04-18T21:06:04.936 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:06:04.936 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.936 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.936 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:04.936 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622719+0000", 2024-04-18T21:06:04.936 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0066817220000000002 2024-04-18T21:06:04.936 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.936 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.936 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:04.936 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623006+0000", 2024-04-18T21:06:04.936 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00028783699999999999 2024-04-18T21:06:04.936 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.936 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.937 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:04.937 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.655220+0000", 2024-04-18T21:06:04.937 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.032213036 2024-04-18T21:06:04.937 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:04.937 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:04.937 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:04.937 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.937 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.937 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:04.937 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:04.937 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 59.255969782999998, 2024-04-18T21:06:04.937 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.032845253999999997, 2024-04-18T21:06:04.937 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:04.937 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:04.937 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "started", 2024-04-18T21:06:04.937 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:04.938 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.938 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:04.938 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:04.938 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:04.938 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.938 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.938 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:04.938 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:04.938 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:04.938 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.938 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.938 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:04.938 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615942+0000", 2024-04-18T21:06:04.938 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.717e-06 2024-04-18T21:06:04.939 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.939 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.939 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:04.939 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615946+0000", 2024-04-18T21:06:04.939 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.6e-06 2024-04-18T21:06:04.939 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.939 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.939 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:04.939 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615960+0000", 2024-04-18T21:06:04.939 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:06:04.939 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.939 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.939 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.939 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615968+0000", 2024-04-18T21:06:04.939 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.9070000000000007e-06 2024-04-18T21:06:04.940 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.940 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.940 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:04.940 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616100+0000", 2024-04-18T21:06:04.940 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000132402 2024-04-18T21:06:04.940 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.940 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.940 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:04.940 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616117+0000", 2024-04-18T21:06:04.940 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6653000000000001e-05 2024-04-18T21:06:04.940 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.940 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.940 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:04.940 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621566+0000", 2024-04-18T21:06:04.941 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0054497740000000001 2024-04-18T21:06:04.941 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.941 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.941 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:04.941 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622801+0000", 2024-04-18T21:06:04.941 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0012345710000000001 2024-04-18T21:06:04.941 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.941 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.941 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:04.941 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648785+0000", 2024-04-18T21:06:04.941 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.025984104000000001 2024-04-18T21:06:04.941 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:04.941 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:04.941 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:04.941 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.941 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.941 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:04.942 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:06:04.942 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 59.250118432999997, 2024-04-18T21:06:04.942 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.011561350999999999, 2024-04-18T21:06:04.942 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:04.942 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:04.942 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.942 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:04.942 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.942 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:04.942 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:06:04.942 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:04.942 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.942 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.942 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:04.942 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:06:04.943 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:04.943 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.943 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.943 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:04.943 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621792+0000", 2024-04-18T21:06:04.943 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.4000000000000001e-07 2024-04-18T21:06:04.943 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.943 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.943 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:04.943 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:06:04.943 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.1050000000000002e-05 2024-04-18T21:06:04.943 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.943 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.943 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:04.944 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622608+0000", 2024-04-18T21:06:04.944 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00077505900000000003 2024-04-18T21:06:04.944 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.944 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.944 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.944 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623879+0000", 2024-04-18T21:06:04.944 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0012705839999999999 2024-04-18T21:06:04.944 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.944 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.944 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:04.944 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624010+0000", 2024-04-18T21:06:04.944 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00013176900000000001 2024-04-18T21:06:04.944 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.945 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.945 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:04.945 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624058+0000", 2024-04-18T21:06:04.945 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.7299000000000002e-05 2024-04-18T21:06:04.945 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.945 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.945 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:04.945 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633262+0000", 2024-04-18T21:06:04.945 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0092048770000000002 2024-04-18T21:06:04.945 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.945 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.945 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:04.945 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633353+0000", 2024-04-18T21:06:04.945 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0073000000000003e-05 2024-04-18T21:06:04.945 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:04.946 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:04.946 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:04.946 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.946 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.946 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:04.946 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:06:04.946 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 59.247991046999999, 2024-04-18T21:06:04.946 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0098419370000000003, 2024-04-18T21:06:04.946 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:04.946 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:04.946 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.946 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:04.946 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.946 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:04.947 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:06:04.947 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:04.947 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.947 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.947 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:04.947 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:06:04.947 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:04.947 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.947 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.947 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:04.947 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623920+0000", 2024-04-18T21:06:04.947 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2240000000000001e-06 2024-04-18T21:06:04.947 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.947 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.947 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:04.947 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623933+0000", 2024-04-18T21:06:04.948 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3653e-05 2024-04-18T21:06:04.948 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.948 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.948 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:04.948 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623956+0000", 2024-04-18T21:06:04.948 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2059e-05 2024-04-18T21:06:04.948 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.948 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.948 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.948 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623975+0000", 2024-04-18T21:06:04.948 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.9806999999999999e-05 2024-04-18T21:06:04.948 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.948 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.948 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:04.949 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626943+0000", 2024-04-18T21:06:04.949 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0029681579999999998 2024-04-18T21:06:04.949 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.949 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.949 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:04.949 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626993+0000", 2024-04-18T21:06:04.949 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.9935999999999998e-05 2024-04-18T21:06:04.949 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.949 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.949 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:04.949 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633665+0000", 2024-04-18T21:06:04.949 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0066719250000000004 2024-04-18T21:06:04.949 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.949 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.949 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:04.950 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633761+0000", 2024-04-18T21:06:04.950 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.5174999999999996e-05 2024-04-18T21:06:04.950 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:04.950 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:04.950 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:04.950 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.950 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.950 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:04.950 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:06:04.950 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 59.247159428000003, 2024-04-18T21:06:04.950 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0090159079999999996, 2024-04-18T21:06:04.950 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:04.950 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:04.950 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.950 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:04.951 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.951 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:04.951 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:06:04.951 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:04.951 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.951 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.951 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:04.951 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:06:04.951 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:04.951 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.951 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.951 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:04.951 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624751+0000", 2024-04-18T21:06:04.951 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.7600000000000006e-07 2024-04-18T21:06:04.951 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.951 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.952 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:04.952 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624787+0000", 2024-04-18T21:06:04.952 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.6273000000000003e-05 2024-04-18T21:06:04.952 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.952 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.952 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:04.952 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625837+0000", 2024-04-18T21:06:04.952 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00104992 2024-04-18T21:06:04.952 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.952 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.952 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.952 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625860+0000", 2024-04-18T21:06:04.952 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3110000000000001e-05 2024-04-18T21:06:04.952 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.952 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.952 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:04.953 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625984+0000", 2024-04-18T21:06:04.953 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012399199999999999 2024-04-18T21:06:04.953 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.953 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.953 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:04.953 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626030+0000", 2024-04-18T21:06:04.953 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.5429999999999997e-05 2024-04-18T21:06:04.953 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.953 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.953 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:04.953 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633643+0000", 2024-04-18T21:06:04.953 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0076129320000000002 2024-04-18T21:06:04.953 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.953 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.954 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:04.954 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633766+0000", 2024-04-18T21:06:04.954 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000123275 2024-04-18T21:06:04.954 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:04.954 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:04.954 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:04.954 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.954 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.954 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:04.954 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:06:04.954 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 59.245905704000002, 2024-04-18T21:06:04.954 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0088669170000000002, 2024-04-18T21:06:04.954 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:04.955 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:04.955 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.955 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:04.955 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.955 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:04.955 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:06:04.955 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:04.955 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.955 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.955 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:04.955 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:06:04.955 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:04.955 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.956 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.956 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:04.956 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626005+0000", 2024-04-18T21:06:04.956 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.5000000000000001e-07 2024-04-18T21:06:04.956 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.956 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.956 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:04.956 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626028+0000", 2024-04-18T21:06:04.956 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2756999999999999e-05 2024-04-18T21:06:04.956 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.956 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.956 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:04.956 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626050+0000", 2024-04-18T21:06:04.956 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2140000000000001e-05 2024-04-18T21:06:04.957 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.957 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.957 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.957 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626065+0000", 2024-04-18T21:06:04.957 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5176e-05 2024-04-18T21:06:04.957 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.957 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.957 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:04.957 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628334+0000", 2024-04-18T21:06:04.957 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0022691439999999998 2024-04-18T21:06:04.957 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.957 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.957 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:04.957 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628379+0000", 2024-04-18T21:06:04.958 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.5420000000000002e-05 2024-04-18T21:06:04.958 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.958 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.958 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:04.958 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634770+0000", 2024-04-18T21:06:04.958 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0063908410000000004 2024-04-18T21:06:04.958 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.958 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.958 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:04.958 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634871+0000", 2024-04-18T21:06:04.958 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000100589 2024-04-18T21:06:04.958 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:04.958 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:04.959 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:04.959 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.959 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.959 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:13 3.10 e17/15 3:0d89b25e:::603.00000000:head v 17'8, mlcod=0'0)", 2024-04-18T21:06:04.959 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:06:04.959 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 59.227072274999998, 2024-04-18T21:06:04.959 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0090974379999999994, 2024-04-18T21:06:04.959 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:04.959 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:04.959 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.959 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:04.959 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.959 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:04.960 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:06:04.960 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:04.960 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.960 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.960 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:04.960 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:06:04.960 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:04.960 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.960 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.960 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:04.960 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644838+0000", 2024-04-18T21:06:04.960 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.569999999999999e-07 2024-04-18T21:06:04.960 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.960 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.961 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:04.961 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644846+0000", 2024-04-18T21:06:04.961 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.4499999999999998e-06 2024-04-18T21:06:04.961 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.961 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.961 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:04.961 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644861+0000", 2024-04-18T21:06:04.961 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5243e-05 2024-04-18T21:06:04.961 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.961 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.961 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.961 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644997+0000", 2024-04-18T21:06:04.961 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000135609 2024-04-18T21:06:04.961 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.961 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.961 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:04.962 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649150+0000", 2024-04-18T21:06:04.962 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0041536760000000002 2024-04-18T21:06:04.962 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.962 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.962 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:04.962 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649207+0000", 2024-04-18T21:06:04.962 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.6677e-05 2024-04-18T21:06:04.962 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.962 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.962 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:04.962 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.653840+0000", 2024-04-18T21:06:04.962 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0046329700000000001 2024-04-18T21:06:04.962 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.962 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.962 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:04.963 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.653935+0000", 2024-04-18T21:06:04.963 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.4856000000000001e-05 2024-04-18T21:06:04.963 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:04.963 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:04.963 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:04.963 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.963 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.963 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 3 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:06:04.963 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:06:04.963 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 59.224283114999999, 2024-04-18T21:06:04.963 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0087842319999999995, 2024-04-18T21:06:04.963 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:04.963 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:04.963 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "reached pg", 2024-04-18T21:06:04.963 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:04.964 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.964 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:04.964 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:06:04.964 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:04.964 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.964 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.964 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:04.964 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:06:04.964 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:04.964 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.964 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.964 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:04.964 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:06:04.964 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.8299999999999996e-07 2024-04-18T21:06:04.964 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.965 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.965 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:04.965 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647642+0000", 2024-04-18T21:06:04.965 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4724e-05 2024-04-18T21:06:04.965 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.965 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.965 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:04.965 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647679+0000", 2024-04-18T21:06:04.965 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.6662999999999998e-05 2024-04-18T21:06:04.965 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.965 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.965 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.965 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647735+0000", 2024-04-18T21:06:04.965 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.6196000000000002e-05 2024-04-18T21:06:04.965 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.965 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.965 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:04.966 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649865+0000", 2024-04-18T21:06:04.966 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0021299489999999999 2024-04-18T21:06:04.966 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.966 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.966 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:04.966 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656411+0000", 2024-04-18T21:06:04.966 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0065460170000000003 2024-04-18T21:06:04.966 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:04.966 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:04.966 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:04.966 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.966 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.966 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:04.967 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:06:04.967 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 59.224137919, 2024-04-18T21:06:04.967 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0095703190000000007, 2024-04-18T21:06:04.967 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:04.967 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:04.967 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.967 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:04.967 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.967 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:04.967 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:06:04.967 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:04.967 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.967 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.967 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:04.967 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:06:04.967 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:04.968 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.968 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.968 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:04.968 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647773+0000", 2024-04-18T21:06:04.968 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.046e-06 2024-04-18T21:06:04.968 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.968 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.968 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:04.968 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647795+0000", 2024-04-18T21:06:04.968 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2616000000000002e-05 2024-04-18T21:06:04.968 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.968 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.968 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:04.968 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647818+0000", 2024-04-18T21:06:04.969 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3110000000000001e-05 2024-04-18T21:06:04.969 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.969 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.969 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.969 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647834+0000", 2024-04-18T21:06:04.969 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5163e-05 2024-04-18T21:06:04.969 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.969 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.969 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:04.969 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650682+0000", 2024-04-18T21:06:04.969 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0028479759999999999 2024-04-18T21:06:04.969 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.969 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.969 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:04.969 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650730+0000", 2024-04-18T21:06:04.969 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.8375999999999999e-05 2024-04-18T21:06:04.970 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.970 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.970 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:04.970 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656751+0000", 2024-04-18T21:06:04.970 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0060211880000000002 2024-04-18T21:06:04.970 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.970 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.970 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:04.970 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657342+0000", 2024-04-18T21:06:04.970 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00059084399999999998 2024-04-18T21:06:04.970 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:04.970 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:04.970 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:04.970 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.970 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.971 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:04.971 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:06:04.971 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 59.223725633000001, 2024-04-18T21:06:04.971 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0092471759999999993, 2024-04-18T21:06:04.971 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:04.971 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:04.971 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:04.971 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:04.971 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.971 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:04.971 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:06:04.971 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:04.971 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.971 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.971 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:04.971 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:06:04.972 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:04.972 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.972 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.972 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:04.972 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648185+0000", 2024-04-18T21:06:04.972 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.5000000000000001e-07 2024-04-18T21:06:04.972 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.972 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.972 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:04.972 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648203+0000", 2024-04-18T21:06:04.972 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.8102999999999999e-05 2024-04-18T21:06:04.972 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.972 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.972 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:04.972 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648226+0000", 2024-04-18T21:06:04.972 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2921999999999998e-05 2024-04-18T21:06:04.972 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.973 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.973 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:04.973 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648241+0000", 2024-04-18T21:06:04.973 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5336999999999999e-05 2024-04-18T21:06:04.973 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.973 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.973 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:04.973 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.651268+0000", 2024-04-18T21:06:04.973 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0030271640000000002 2024-04-18T21:06:04.973 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.973 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.973 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:04.973 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.651319+0000", 2024-04-18T21:06:04.973 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.0843000000000001e-05 2024-04-18T21:06:04.973 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.973 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.974 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:04.974 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657347+0000", 2024-04-18T21:06:04.974 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0060279770000000003 2024-04-18T21:06:04.974 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:04.974 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:04.974 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:04.974 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657431+0000", 2024-04-18T21:06:04.974 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.3980000000000006e-05 2024-04-18T21:06:04.974 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:04.974 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:04.974 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:04.974 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:04.974 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:04.974 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:06:04.976 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:04.976 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:04.974+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:05.077 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:05.074+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:05.107 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:05.107 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:06:05.108 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-04-18T21:06:05.108 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:05.111 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-18T21:06:05.111 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-18T21:06:05.111 INFO:tasks.thrashosds.thrasher:Setting full ratio to .001 2024-04-18T21:06:05.111 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set-full-ratio .001 2024-04-18T21:06:05.123 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:05.178 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:05.178+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:05.245 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:05.245 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:06:05.245 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-18T21:06:05.245 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-18T21:06:05.246 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:05.259 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:05.278 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:05.279+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:05.379 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:05.378+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:05.384 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:05.384 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-18T21:06:05.384 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-18T21:06:05.384 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:06:05.384 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.384 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:05.384 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:06:05.385 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 59.769454254999999, 2024-04-18T21:06:05.385 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.034065303999999998, 2024-04-18T21:06:05.385 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:05.385 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:05.385 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:05.385 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:05.385 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.385 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:05.385 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:06:05.385 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:05.385 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.385 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.385 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:05.385 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:06:05.386 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:05.386 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.386 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.386 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:05.386 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615254+0000", 2024-04-18T21:06:05.386 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7829999999999999e-06 2024-04-18T21:06:05.386 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.386 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.386 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:05.386 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615267+0000", 2024-04-18T21:06:05.386 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3334e-05 2024-04-18T21:06:05.386 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.386 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.386 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:05.386 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615294+0000", 2024-04-18T21:06:05.387 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7271999999999999e-05 2024-04-18T21:06:05.387 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.387 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.387 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:05.387 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615321+0000", 2024-04-18T21:06:05.387 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.637e-05 2024-04-18T21:06:05.387 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.387 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.387 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:05.387 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615479+0000", 2024-04-18T21:06:05.387 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000158493 2024-04-18T21:06:05.387 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.387 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.387 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:05.387 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615498+0000", 2024-04-18T21:06:05.388 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9148999999999999e-05 2024-04-18T21:06:05.388 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.388 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.388 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:05.388 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632915+0000", 2024-04-18T21:06:05.388 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.017416551999999998 2024-04-18T21:06:05.388 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.388 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.388 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:05.388 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633302+0000", 2024-04-18T21:06:05.388 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00038725000000000001 2024-04-18T21:06:05.388 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.388 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.389 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:05.389 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633638+0000", 2024-04-18T21:06:05.389 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000335946 2024-04-18T21:06:05.389 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.389 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.389 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:05.389 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645976+0000", 2024-04-18T21:06:05.389 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012337617 2024-04-18T21:06:05.389 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.389 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.389 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:05.389 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649080+0000", 2024-04-18T21:06:05.389 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031038929999999999 2024-04-18T21:06:05.389 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.389 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.389 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:05.390 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649207+0000", 2024-04-18T21:06:05.390 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000127537 2024-04-18T21:06:05.390 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.390 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.390 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:05.390 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649316+0000", 2024-04-18T21:06:05.390 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109108 2024-04-18T21:06:05.390 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:05.390 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:05.390 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:05.390 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.390 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.390 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:05.390 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:06:05.390 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 59.769320878000002, 2024-04-18T21:06:05.391 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036275764000000002, 2024-04-18T21:06:05.391 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:05.391 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:05.391 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:05.391 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:05.391 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.391 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:05.391 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:06:05.391 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:05.391 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.391 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.391 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:05.391 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:06:05.391 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:05.392 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.392 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.392 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:05.392 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615386+0000", 2024-04-18T21:06:05.392 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.573e-06 2024-04-18T21:06:05.392 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.392 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.392 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:05.392 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:06:05.392 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0723999999999999e-05 2024-04-18T21:06:05.392 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.392 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.392 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:05.392 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615418+0000", 2024-04-18T21:06:05.392 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0902000000000001e-05 2024-04-18T21:06:05.393 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.393 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.393 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:05.393 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615433+0000", 2024-04-18T21:06:05.393 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5319999999999999e-05 2024-04-18T21:06:05.393 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.393 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.393 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:05.393 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615659+0000", 2024-04-18T21:06:05.393 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000226095 2024-04-18T21:06:05.393 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.393 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.393 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:05.393 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:05.394 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1276e-05 2024-04-18T21:06:05.394 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.394 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.394 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:05.394 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643654+0000", 2024-04-18T21:06:05.394 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027983238000000001 2024-04-18T21:06:05.394 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.394 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.394 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:05.394 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643868+0000", 2024-04-18T21:06:05.394 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000214305 2024-04-18T21:06:05.394 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.394 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.394 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:05.395 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:06:05.395 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035892200000000002 2024-04-18T21:06:05.395 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.395 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.395 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:05.395 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646056+0000", 2024-04-18T21:06:05.395 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001829172 2024-04-18T21:06:05.395 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.395 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.395 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:05.395 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651406+0000", 2024-04-18T21:06:05.395 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0053504800000000003 2024-04-18T21:06:05.395 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.395 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.395 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:05.396 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651551+0000", 2024-04-18T21:06:05.396 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014427999999999999 2024-04-18T21:06:05.396 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.396 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.396 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:05.396 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651660+0000", 2024-04-18T21:06:05.396 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109477 2024-04-18T21:06:05.396 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:05.396 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:05.396 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:05.396 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.396 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.396 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:05.396 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:05.397 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 59.769247495999998, 2024-04-18T21:06:05.397 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045668994999999997, 2024-04-18T21:06:05.397 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:05.397 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:05.397 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:05.397 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:05.397 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.397 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:05.397 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:05.397 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:05.397 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.397 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.397 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:05.397 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:05.397 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:05.398 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.398 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.398 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:05.398 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615459+0000", 2024-04-18T21:06:05.398 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5030000000000001e-06 2024-04-18T21:06:05.398 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.398 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.398 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:05.398 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615506+0000", 2024-04-18T21:06:05.398 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6872000000000001e-05 2024-04-18T21:06:05.398 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.398 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.398 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:05.399 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615527+0000", 2024-04-18T21:06:05.399 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0763000000000001e-05 2024-04-18T21:06:05.399 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.399 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.399 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:05.399 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615551+0000", 2024-04-18T21:06:05.399 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4159e-05 2024-04-18T21:06:05.399 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.399 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.399 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:05.399 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615736+0000", 2024-04-18T21:06:05.399 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018499599999999999 2024-04-18T21:06:05.399 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.400 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.400 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:05.400 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615748+0000", 2024-04-18T21:06:05.400 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2272999999999999e-05 2024-04-18T21:06:05.400 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.400 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.400 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:05.400 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635481+0000", 2024-04-18T21:06:05.400 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019732772999999999 2024-04-18T21:06:05.400 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.400 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.400 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:05.400 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635791+0000", 2024-04-18T21:06:05.400 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031013299999999998 2024-04-18T21:06:05.400 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.401 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.401 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:05.401 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636101+0000", 2024-04-18T21:06:05.401 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030943300000000002 2024-04-18T21:06:05.401 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.401 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.401 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:05.401 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646043+0000", 2024-04-18T21:06:05.401 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099428139999999995 2024-04-18T21:06:05.401 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.401 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.401 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:05.401 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660991+0000", 2024-04-18T21:06:05.401 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014947142 2024-04-18T21:06:05.402 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.402 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.402 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:05.402 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661061+0000", 2024-04-18T21:06:05.402 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0438000000000006e-05 2024-04-18T21:06:05.402 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.402 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.402 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:05.402 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661127+0000", 2024-04-18T21:06:05.402 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5696000000000003e-05 2024-04-18T21:06:05.402 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:05.402 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:05.402 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:05.403 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.403 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.403 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:05.403 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:05.403 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 59.769035068000001, 2024-04-18T21:06:05.403 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045745085999999997, 2024-04-18T21:06:05.403 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:05.403 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:05.403 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:05.403 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:05.403 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.403 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:05.403 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:05.403 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:05.404 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.404 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.404 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:05.404 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:05.404 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:05.404 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.404 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.404 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:05.404 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:06:05.404 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7400000000000001e-06 2024-04-18T21:06:05.404 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.404 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.404 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:05.404 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:06:05.405 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8133e-05 2024-04-18T21:06:05.405 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.405 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.405 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:05.405 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615726+0000", 2024-04-18T21:06:05.405 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6132e-05 2024-04-18T21:06:05.405 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.405 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.405 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:05.405 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615742+0000", 2024-04-18T21:06:05.405 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6157000000000001e-05 2024-04-18T21:06:05.405 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.405 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.405 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:05.406 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615937+0000", 2024-04-18T21:06:05.406 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000194768 2024-04-18T21:06:05.406 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.406 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.406 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:05.406 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615950+0000", 2024-04-18T21:06:05.406 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3084e-05 2024-04-18T21:06:05.406 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.406 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.406 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:05.406 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643676+0000", 2024-04-18T21:06:05.406 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027725639999999999 2024-04-18T21:06:05.406 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.406 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.407 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:05.407 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643867+0000", 2024-04-18T21:06:05.407 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019075900000000001 2024-04-18T21:06:05.407 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.407 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.407 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:05.407 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:06:05.407 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036013799999999997 2024-04-18T21:06:05.407 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.407 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.407 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:05.407 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646068+0000", 2024-04-18T21:06:05.407 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001841536 2024-04-18T21:06:05.407 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.408 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.408 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:05.408 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661184+0000", 2024-04-18T21:06:05.408 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015115458999999999 2024-04-18T21:06:05.408 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.408 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.408 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:05.408 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661283+0000", 2024-04-18T21:06:05.408 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9502999999999999e-05 2024-04-18T21:06:05.408 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.408 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.408 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:05.408 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661415+0000", 2024-04-18T21:06:05.408 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000132037 2024-04-18T21:06:05.409 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:05.409 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:05.409 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:05.409 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.409 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.409 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:05.409 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:06:05.409 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 59.768913380999997, 2024-04-18T21:06:05.409 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036185947000000003, 2024-04-18T21:06:05.409 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:05.409 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:05.409 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:05.409 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:05.409 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.410 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:05.410 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:06:05.410 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:05.410 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.410 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.410 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:05.410 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:06:05.410 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:05.410 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.410 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.410 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:05.410 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615794+0000", 2024-04-18T21:06:05.410 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6440000000000001e-06 2024-04-18T21:06:05.410 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.411 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.411 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:05.411 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615803+0000", 2024-04-18T21:06:05.411 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1220000000000001e-06 2024-04-18T21:06:05.411 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.411 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.411 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:05.411 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615827+0000", 2024-04-18T21:06:05.411 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3997000000000001e-05 2024-04-18T21:06:05.411 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.411 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.411 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:05.411 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615899+0000", 2024-04-18T21:06:05.412 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2741e-05 2024-04-18T21:06:05.412 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.412 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.412 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:05.412 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616019+0000", 2024-04-18T21:06:05.412 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119874 2024-04-18T21:06:05.412 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.412 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.412 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:05.412 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616029+0000", 2024-04-18T21:06:05.412 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:06:05.412 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.412 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.412 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:05.412 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644823+0000", 2024-04-18T21:06:05.413 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.028793151999999999 2024-04-18T21:06:05.413 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.413 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.413 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:05.413 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645106+0000", 2024-04-18T21:06:05.413 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028379700000000002 2024-04-18T21:06:05.413 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.413 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.413 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:05.413 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645294+0000", 2024-04-18T21:06:05.413 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000187181 2024-04-18T21:06:05.413 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.413 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.413 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:05.413 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646763+0000", 2024-04-18T21:06:05.414 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0014691050000000001 2024-04-18T21:06:05.414 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.414 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.414 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:05.414 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651784+0000", 2024-04-18T21:06:05.414 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050211650000000002 2024-04-18T21:06:05.414 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.414 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.414 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:05.414 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651876+0000", 2024-04-18T21:06:05.414 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2503999999999994e-05 2024-04-18T21:06:05.414 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.414 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.415 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:05.415 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651978+0000", 2024-04-18T21:06:05.415 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000101475 2024-04-18T21:06:05.415 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:05.415 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:05.415 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:05.415 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.415 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.415 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:05.415 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:05.415 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 59.768764773999997, 2024-04-18T21:06:05.415 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032262322000000003, 2024-04-18T21:06:05.415 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:05.415 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:05.415 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:05.416 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:05.416 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.416 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:05.416 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:05.416 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:05.416 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.416 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.416 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:05.416 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:05.416 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:05.416 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.416 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.416 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:05.416 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615943+0000", 2024-04-18T21:06:05.416 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1959999999999998e-06 2024-04-18T21:06:05.417 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.417 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.417 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:05.417 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615956+0000", 2024-04-18T21:06:05.417 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3424000000000001e-05 2024-04-18T21:06:05.417 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.417 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.417 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:05.417 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615983+0000", 2024-04-18T21:06:05.417 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7072000000000001e-05 2024-04-18T21:06:05.417 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.417 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.417 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:05.417 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616006+0000", 2024-04-18T21:06:05.417 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2823000000000002e-05 2024-04-18T21:06:05.418 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.418 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.418 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:05.418 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616156+0000", 2024-04-18T21:06:05.418 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014962299999999999 2024-04-18T21:06:05.418 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.418 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.418 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:05.418 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616174+0000", 2024-04-18T21:06:05.418 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8082999999999999e-05 2024-04-18T21:06:05.418 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.418 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.418 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:05.419 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.629952+0000", 2024-04-18T21:06:05.419 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013778514 2024-04-18T21:06:05.419 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.419 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.419 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:05.419 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630201+0000", 2024-04-18T21:06:05.419 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024918100000000001 2024-04-18T21:06:05.419 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.419 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.419 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:05.419 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630386+0000", 2024-04-18T21:06:05.419 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018436900000000001 2024-04-18T21:06:05.419 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.419 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.419 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:05.420 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643169+0000", 2024-04-18T21:06:05.420 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012782774 2024-04-18T21:06:05.420 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.420 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.420 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:05.420 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.647924+0000", 2024-04-18T21:06:05.420 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004755787 2024-04-18T21:06:05.420 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.420 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.420 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:05.420 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648069+0000", 2024-04-18T21:06:05.420 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014459600000000001 2024-04-18T21:06:05.420 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.420 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.420 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:05.421 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648203+0000", 2024-04-18T21:06:05.421 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013388000000000001 2024-04-18T21:06:05.421 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:05.421 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:05.421 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:05.421 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.421 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.421 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:05.421 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:06:05.421 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 59.76865651, 2024-04-18T21:06:05.421 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032489736999999998, 2024-04-18T21:06:05.421 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:05.421 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:05.421 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:05.421 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:05.422 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.422 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:05.422 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:06:05.422 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:05.422 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.422 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.422 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:05.422 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:06:05.422 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:05.422 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.422 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.422 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:05.422 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616050+0000", 2024-04-18T21:06:05.422 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.606e-06 2024-04-18T21:06:05.423 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.423 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.423 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:05.423 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616061+0000", 2024-04-18T21:06:05.423 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0463e-05 2024-04-18T21:06:05.423 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.423 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.423 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:05.423 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616092+0000", 2024-04-18T21:06:05.423 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1415999999999999e-05 2024-04-18T21:06:05.423 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.423 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.423 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:05.423 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616109+0000", 2024-04-18T21:06:05.423 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6557000000000001e-05 2024-04-18T21:06:05.424 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.424 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.424 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:05.424 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616358+0000", 2024-04-18T21:06:05.424 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000249077 2024-04-18T21:06:05.424 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.424 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.424 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:05.424 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616370+0000", 2024-04-18T21:06:05.424 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2037e-05 2024-04-18T21:06:05.424 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.424 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.424 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:05.424 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.634920+0000", 2024-04-18T21:06:05.425 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018550397 2024-04-18T21:06:05.425 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.425 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.425 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:05.425 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640420+0000", 2024-04-18T21:06:05.425 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055000539999999999 2024-04-18T21:06:05.425 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.425 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.425 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:05.425 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648538+0000", 2024-04-18T21:06:05.425 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0081181299999999994 2024-04-18T21:06:05.425 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:05.425 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:05.426 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:05.426 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.426 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.426 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:05.426 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:06:05.426 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 59.768572188999997, 2024-04-18T21:06:05.426 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036090029000000003, 2024-04-18T21:06:05.426 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:05.426 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:05.426 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:05.426 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:05.426 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.426 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:05.426 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:06:05.427 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:05.427 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.427 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.427 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:05.427 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:06:05.427 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:05.427 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.427 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.427 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:05.427 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616134+0000", 2024-04-18T21:06:05.427 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.353e-06 2024-04-18T21:06:05.427 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.427 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.427 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:05.429 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616141+0000", 2024-04-18T21:06:05.429 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2770000000000002e-06 2024-04-18T21:06:05.429 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.429 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.429 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:05.429 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616160+0000", 2024-04-18T21:06:05.429 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.91e-05 2024-04-18T21:06:05.429 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.429 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.429 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:05.430 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616170+0000", 2024-04-18T21:06:05.430 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7699999999999996e-06 2024-04-18T21:06:05.430 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.430 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.430 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:05.430 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616275+0000", 2024-04-18T21:06:05.430 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105313 2024-04-18T21:06:05.430 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.430 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.430 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:05.430 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616288+0000", 2024-04-18T21:06:05.430 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3027000000000001e-05 2024-04-18T21:06:05.430 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.430 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.430 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:05.431 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646160+0000", 2024-04-18T21:06:05.431 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.029872019 2024-04-18T21:06:05.431 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.431 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.431 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:05.431 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646368+0000", 2024-04-18T21:06:05.431 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020811899999999999 2024-04-18T21:06:05.431 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.431 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.431 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:05.431 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652223+0000", 2024-04-18T21:06:05.431 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.005855051 2024-04-18T21:06:05.431 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:05.431 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:05.431 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:05.432 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.432 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.432 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:05.432 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:05.432 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 59.768514619999998, 2024-04-18T21:06:05.432 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043572403000000003, 2024-04-18T21:06:05.432 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:05.432 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:05.432 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:05.432 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:05.432 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.432 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:05.432 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:05.432 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:05.433 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.433 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.433 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:05.433 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:05.433 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:05.433 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.433 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.433 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:05.433 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616192+0000", 2024-04-18T21:06:05.433 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:06:05.433 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.433 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.433 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:05.433 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616203+0000", 2024-04-18T21:06:05.433 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0890000000000001e-05 2024-04-18T21:06:05.434 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.434 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.434 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:05.434 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616223+0000", 2024-04-18T21:06:05.434 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0409000000000001e-05 2024-04-18T21:06:05.434 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.434 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.434 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:05.434 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616238+0000", 2024-04-18T21:06:05.434 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5160000000000001e-05 2024-04-18T21:06:05.434 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.434 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.434 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:05.434 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616343+0000", 2024-04-18T21:06:05.435 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000104831 2024-04-18T21:06:05.435 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.435 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.435 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:05.435 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616357+0000", 2024-04-18T21:06:05.435 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3686000000000001e-05 2024-04-18T21:06:05.435 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.435 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.435 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:05.435 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635912+0000", 2024-04-18T21:06:05.435 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019554944000000001 2024-04-18T21:06:05.435 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.435 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.435 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:05.436 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636231+0000", 2024-04-18T21:06:05.436 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000318766 2024-04-18T21:06:05.436 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.436 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.436 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:05.436 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659763+0000", 2024-04-18T21:06:05.436 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023532474000000001 2024-04-18T21:06:05.436 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:05.436 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:05.436 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:05.436 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.436 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.436 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:05.436 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:06:05.436 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 59.764585912999998, 2024-04-18T21:06:05.437 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015007971, 2024-04-18T21:06:05.437 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:05.437 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:05.437 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:05.437 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:05.437 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.437 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:05.437 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:06:05.437 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:05.437 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.437 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.437 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:05.437 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:06:05.437 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:05.438 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.438 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.438 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:05.438 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620120+0000", 2024-04-18T21:06:05.438 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0359999999999999e-06 2024-04-18T21:06:05.438 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.438 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.438 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:05.438 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620157+0000", 2024-04-18T21:06:05.438 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6636e-05 2024-04-18T21:06:05.438 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.438 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.438 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:05.439 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620177+0000", 2024-04-18T21:06:05.439 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0247000000000001e-05 2024-04-18T21:06:05.439 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.439 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.439 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:05.439 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620195+0000", 2024-04-18T21:06:05.439 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7819e-05 2024-04-18T21:06:05.439 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.439 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.439 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:05.439 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620342+0000", 2024-04-18T21:06:05.439 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014643300000000001 2024-04-18T21:06:05.439 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.439 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.439 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:05.440 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620405+0000", 2024-04-18T21:06:05.440 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3522000000000006e-05 2024-04-18T21:06:05.440 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.440 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.440 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:05.440 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635016+0000", 2024-04-18T21:06:05.440 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014610840999999999 2024-04-18T21:06:05.440 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.440 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.440 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:05.440 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635127+0000", 2024-04-18T21:06:05.440 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111437 2024-04-18T21:06:05.440 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:05.440 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:05.441 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:05.441 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.441 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.441 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:05.441 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:06:05.441 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 59.764478644999997, 2024-04-18T21:06:05.441 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012693296, 2024-04-18T21:06:05.441 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:05.441 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:05.441 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:05.441 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:05.441 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.441 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:05.441 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:06:05.441 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:05.441 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.442 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.442 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:05.442 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:06:05.442 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:05.442 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.442 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.442 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:05.442 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620228+0000", 2024-04-18T21:06:05.442 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:06:05.442 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.442 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.442 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:05.442 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620236+0000", 2024-04-18T21:06:05.442 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.303e-06 2024-04-18T21:06:05.443 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.443 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.443 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:05.443 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620255+0000", 2024-04-18T21:06:05.443 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9406e-05 2024-04-18T21:06:05.443 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.443 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.443 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:05.443 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620274+0000", 2024-04-18T21:06:05.443 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8940000000000002e-05 2024-04-18T21:06:05.443 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.443 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.443 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:05.443 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:06:05.443 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001558753 2024-04-18T21:06:05.443 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.444 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.444 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:05.444 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621879+0000", 2024-04-18T21:06:05.444 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6359000000000001e-05 2024-04-18T21:06:05.444 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.444 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.444 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:05.444 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632841+0000", 2024-04-18T21:06:05.444 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010961907 2024-04-18T21:06:05.444 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.444 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.444 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:05.444 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632920+0000", 2024-04-18T21:06:05.444 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8714999999999994e-05 2024-04-18T21:06:05.444 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:05.444 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:05.444 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:05.445 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.445 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.445 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:05.445 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:06:05.445 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 59.762932882000001, 2024-04-18T21:06:05.445 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013445702, 2024-04-18T21:06:05.445 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:05.445 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:05.445 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:05.445 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:05.445 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.445 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:05.445 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:06:05.445 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:05.445 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.445 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.446 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:05.446 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:06:05.446 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:05.446 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.446 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.446 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:05.446 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621774+0000", 2024-04-18T21:06:05.446 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2500000000000001e-06 2024-04-18T21:06:05.446 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.446 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.446 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:05.446 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621786+0000", 2024-04-18T21:06:05.446 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2636000000000001e-05 2024-04-18T21:06:05.446 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.447 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.447 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:05.447 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621814+0000", 2024-04-18T21:06:05.447 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7823000000000001e-05 2024-04-18T21:06:05.447 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.447 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.447 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:05.447 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621844+0000", 2024-04-18T21:06:05.447 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9589000000000001e-05 2024-04-18T21:06:05.447 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.447 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.447 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:05.447 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622253+0000", 2024-04-18T21:06:05.447 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040963700000000002 2024-04-18T21:06:05.447 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.447 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.448 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:05.448 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622304+0000", 2024-04-18T21:06:05.448 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0868999999999997e-05 2024-04-18T21:06:05.448 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.448 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.448 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:05.448 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635133+0000", 2024-04-18T21:06:05.448 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012829136 2024-04-18T21:06:05.448 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.448 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.448 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:05.448 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635218+0000", 2024-04-18T21:06:05.448 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4761999999999999e-05 2024-04-18T21:06:05.448 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:05.448 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:05.449 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:05.449 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.449 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.449 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:05.449 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:06:05.449 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 59.762806122000001, 2024-04-18T21:06:05.449 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014162065, 2024-04-18T21:06:05.449 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:05.449 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:05.449 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:05.449 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:05.449 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.449 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:05.449 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:06:05.449 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:05.450 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.450 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.450 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:05.450 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:06:05.450 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:05.450 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.450 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.450 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:05.450 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621900+0000", 2024-04-18T21:06:05.450 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:06:05.450 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.450 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.450 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:05.450 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621910+0000", 2024-04-18T21:06:05.451 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0207000000000001e-05 2024-04-18T21:06:05.451 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.451 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.451 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:05.451 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621932+0000", 2024-04-18T21:06:05.451 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1789000000000001e-05 2024-04-18T21:06:05.451 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.451 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.451 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:05.451 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621946+0000", 2024-04-18T21:06:05.451 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4212999999999999e-05 2024-04-18T21:06:05.451 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.451 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.451 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:05.451 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624477+0000", 2024-04-18T21:06:05.451 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025303470000000001 2024-04-18T21:06:05.452 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.452 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.452 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:05.452 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624525+0000", 2024-04-18T21:06:05.452 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8084999999999998e-05 2024-04-18T21:06:05.452 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.452 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.452 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:05.452 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635976+0000", 2024-04-18T21:06:05.452 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.011451368999999999 2024-04-18T21:06:05.452 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.452 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.452 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:05.452 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636061+0000", 2024-04-18T21:06:05.452 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5094999999999998e-05 2024-04-18T21:06:05.453 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:05.453 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:05.453 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:05.453 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.453 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.453 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:06:05.453 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:06:05.453 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 59.753570496999998, 2024-04-18T21:06:05.453 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0098014739999999993, 2024-04-18T21:06:05.453 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:05.453 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:05.453 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:06:05.453 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:05.453 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.453 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:05.454 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:06:05.454 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:05.454 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.454 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.454 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:05.454 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:06:05.454 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:05.454 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.454 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.454 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:05.454 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631136+0000", 2024-04-18T21:06:05.454 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0139999999999999e-06 2024-04-18T21:06:05.454 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.455 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.455 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:05.455 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631152+0000", 2024-04-18T21:06:05.455 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6365999999999999e-05 2024-04-18T21:06:05.455 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.455 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.455 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:05.455 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631961+0000", 2024-04-18T21:06:05.455 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00080873100000000003 2024-04-18T21:06:05.455 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.455 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.455 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:05.455 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632021+0000", 2024-04-18T21:06:05.455 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0541999999999997e-05 2024-04-18T21:06:05.455 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.455 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.455 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:05.456 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633539+0000", 2024-04-18T21:06:05.456 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015175639999999999 2024-04-18T21:06:05.456 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.456 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.456 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:05.456 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640936+0000", 2024-04-18T21:06:05.456 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007397257 2024-04-18T21:06:05.456 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:05.456 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:05.456 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:05.456 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.456 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.456 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-18T21:06:05.456 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:06:05.456 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 59.736109063999997, 2024-04-18T21:06:05.456 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00073592199999999997, 2024-04-18T21:06:05.457 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:05.457 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:05.457 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:05.457 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:05.457 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.457 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:05.457 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:06:05.457 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:05.457 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.457 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.457 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:05.457 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:06:05.457 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:05.457 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.457 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.457 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:05.458 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648597+0000", 2024-04-18T21:06:05.458 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:06:05.458 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.458 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.458 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:05.458 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648605+0000", 2024-04-18T21:06:05.458 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3960000000000006e-06 2024-04-18T21:06:05.458 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.458 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.458 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:05.458 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648625+0000", 2024-04-18T21:06:05.458 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9987e-05 2024-04-18T21:06:05.458 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.458 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.458 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:05.459 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648643+0000", 2024-04-18T21:06:05.459 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7079e-05 2024-04-18T21:06:05.459 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.459 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.459 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:05.459 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649043+0000", 2024-04-18T21:06:05.459 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040083399999999998 2024-04-18T21:06:05.459 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.459 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.459 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:05.459 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649062+0000", 2024-04-18T21:06:05.459 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9052999999999999e-05 2024-04-18T21:06:05.459 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.460 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.460 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:05.460 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649332+0000", 2024-04-18T21:06:05.460 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026971999999999999 2024-04-18T21:06:05.460 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:05.460 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:05.460 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:05.460 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.460 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.460 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:06:05.460 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:06:05.460 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 59.733334163000002, 2024-04-18T21:06:05.460 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00086123999999999999, 2024-04-18T21:06:05.460 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:05.460 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:05.461 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:06:05.461 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:05.461 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.461 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:05.461 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:06:05.461 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:05.461 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.461 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.461 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:05.461 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:06:05.461 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:05.461 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.461 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.461 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:05.461 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651372+0000", 2024-04-18T21:06:05.461 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7599999999999997e-07 2024-04-18T21:06:05.462 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.462 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.462 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:05.462 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651377+0000", 2024-04-18T21:06:05.462 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.22e-06 2024-04-18T21:06:05.462 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.462 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.462 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:05.462 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651394+0000", 2024-04-18T21:06:05.462 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6646999999999998e-05 2024-04-18T21:06:05.462 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.462 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.462 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:05.462 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651427+0000", 2024-04-18T21:06:05.462 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3682e-05 2024-04-18T21:06:05.463 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.463 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.463 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:05.463 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652029+0000", 2024-04-18T21:06:05.463 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00060152199999999995 2024-04-18T21:06:05.463 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.463 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.463 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:05.463 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652232+0000", 2024-04-18T21:06:05.463 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020359299999999999 2024-04-18T21:06:05.463 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:05.463 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:05.463 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:05.463 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.463 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.463 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:06:05.464 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:06:05.464 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 59.725307201, 2024-04-18T21:06:05.464 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0017426200000000001, 2024-04-18T21:06:05.464 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:05.464 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:05.464 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:05.464 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:05.464 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.464 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:05.464 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:06:05.464 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:05.464 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.464 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.464 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:05.464 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:06:05.464 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:05.464 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.465 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.465 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:05.465 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659399+0000", 2024-04-18T21:06:05.465 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6000000000000002e-07 2024-04-18T21:06:05.465 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.465 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.465 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:05.465 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659405+0000", 2024-04-18T21:06:05.465 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5069999999999997e-06 2024-04-18T21:06:05.465 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.465 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.465 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:05.465 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659425+0000", 2024-04-18T21:06:05.465 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.927e-05 2024-04-18T21:06:05.465 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.465 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.466 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:05.466 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659443+0000", 2024-04-18T21:06:05.466 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8051999999999999e-05 2024-04-18T21:06:05.466 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.466 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.466 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:05.466 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660973+0000", 2024-04-18T21:06:05.466 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001530106 2024-04-18T21:06:05.466 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.466 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.466 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:05.466 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660983+0000", 2024-04-18T21:06:05.466 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0516999999999999e-05 2024-04-18T21:06:05.466 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.467 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.467 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:05.467 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661141+0000", 2024-04-18T21:06:05.467 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015730799999999999 2024-04-18T21:06:05.467 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:05.467 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:05.467 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:05.467 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.467 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.467 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:06:05.467 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:06:05.467 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 59.725090575999999, 2024-04-18T21:06:05.467 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001812311, 2024-04-18T21:06:05.467 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:05.468 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:05.468 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:05.468 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:05.468 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.468 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:05.468 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:06:05.468 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:05.468 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.468 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.468 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:05.468 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:06:05.468 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:05.468 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.468 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.469 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:05.469 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659616+0000", 2024-04-18T21:06:05.469 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.277e-06 2024-04-18T21:06:05.469 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.469 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.469 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:05.469 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659625+0000", 2024-04-18T21:06:05.469 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5359999999999998e-06 2024-04-18T21:06:05.469 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.469 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.469 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:05.469 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659647+0000", 2024-04-18T21:06:05.469 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1857000000000001e-05 2024-04-18T21:06:05.469 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.470 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.470 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:05.470 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659664+0000", 2024-04-18T21:06:05.470 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6405999999999998e-05 2024-04-18T21:06:05.470 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.470 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.470 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:05.470 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661169+0000", 2024-04-18T21:06:05.470 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015054179999999999 2024-04-18T21:06:05.470 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.470 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.470 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:05.470 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661177+0000", 2024-04-18T21:06:05.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9680000000000006e-06 2024-04-18T21:06:05.471 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.471 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.471 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:05.471 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661427+0000", 2024-04-18T21:06:05.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024984900000000001 2024-04-18T21:06:05.471 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:05.471 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:05.471 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:05.471 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.471 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.471 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-18T21:06:05.471 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:06:05.471 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 57.772169968, 2024-04-18T21:06:05.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0030975030000000001, 2024-04-18T21:06:05.472 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:05.472 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:05.472 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:05.472 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:05.472 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.472 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:05.472 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:06:05.472 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:05.472 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.472 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.472 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:05.472 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:06:05.472 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:05.472 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.473 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:05.473 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612538+0000", 2024-04-18T21:06:05.473 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6259999999999999e-06 2024-04-18T21:06:05.473 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.473 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:05.473 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612552+0000", 2024-04-18T21:06:05.473 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4073999999999999e-05 2024-04-18T21:06:05.473 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.473 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:05.473 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612585+0000", 2024-04-18T21:06:05.473 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3504999999999999e-05 2024-04-18T21:06:05.473 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.474 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.474 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:05.474 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612601+0000", 2024-04-18T21:06:05.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5194000000000001e-05 2024-04-18T21:06:05.474 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.474 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.474 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:05.474 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612746+0000", 2024-04-18T21:06:05.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145666 2024-04-18T21:06:05.474 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.474 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.474 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:05.474 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612953+0000", 2024-04-18T21:06:05.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000207109 2024-04-18T21:06:05.475 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.475 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:05.475 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.613134+0000", 2024-04-18T21:06:05.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018041300000000001 2024-04-18T21:06:05.475 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.475 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:05.475 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.614411+0000", 2024-04-18T21:06:05.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0012769929999999999 2024-04-18T21:06:05.475 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.475 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:05.475 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615441+0000", 2024-04-18T21:06:05.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001029917 2024-04-18T21:06:05.475 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:05.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615522+0000", 2024-04-18T21:06:05.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1142000000000003e-05 2024-04-18T21:06:05.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:05.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615633+0000", 2024-04-18T21:06:05.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000110864 2024-04-18T21:06:05.476 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:05.476 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:05.476 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:05.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.476 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-18T21:06:05.477 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:06:05.477 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 39.769884157, 2024-04-18T21:06:05.477 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088979039999999999, 2024-04-18T21:06:05.477 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:05.477 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:05.477 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:05.477 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:05.477 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.477 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:05.477 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:06:05.477 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:05.477 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.477 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.477 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:05.477 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:06:05.478 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:05.478 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.478 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.478 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:05.478 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614825+0000", 2024-04-18T21:06:05.478 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4829999999999999e-06 2024-04-18T21:06:05.478 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.478 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.478 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:05.478 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614843+0000", 2024-04-18T21:06:05.478 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8777e-05 2024-04-18T21:06:05.478 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.478 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.478 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:05.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614884+0000", 2024-04-18T21:06:05.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1051999999999999e-05 2024-04-18T21:06:05.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.479 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.479 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:05.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614903+0000", 2024-04-18T21:06:05.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9069999999999999e-05 2024-04-18T21:06:05.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.479 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.479 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:05.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615047+0000", 2024-04-18T21:06:05.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014374400000000001 2024-04-18T21:06:05.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.479 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.479 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:05.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615061+0000", 2024-04-18T21:06:05.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4063000000000001e-05 2024-04-18T21:06:05.480 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:05.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621064+0000", 2024-04-18T21:06:05.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0060029200000000001 2024-04-18T21:06:05.480 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:05.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621211+0000", 2024-04-18T21:06:05.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000147224 2024-04-18T21:06:05.480 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:05.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621396+0000", 2024-04-18T21:06:05.481 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018454699999999999 2024-04-18T21:06:05.481 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:05.481 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.622517+0000", 2024-04-18T21:06:05.481 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001121424 2024-04-18T21:06:05.481 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:05.481 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623571+0000", 2024-04-18T21:06:05.481 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010538660000000001 2024-04-18T21:06:05.481 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:05.481 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623658+0000", 2024-04-18T21:06:05.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6439000000000004e-05 2024-04-18T21:06:05.482 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:05.482 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:05.482 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:05.482 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623719+0000", 2024-04-18T21:06:05.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1295000000000002e-05 2024-04-18T21:06:05.482 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:05.482 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:05.482 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:05.482 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:05.482 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:05.482 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:05.484 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:05.484 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:05.486+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:05.585 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:05.582+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:05.614 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:05.614 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:06:05.615 INFO:teuthology.orchestra.run.smithi132.stdout: "num_ops": 0 2024-04-18T21:06:05.615 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:05.629 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:05.686 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:05.687+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:05.733 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:06:05.786 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:05.787+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:05.792 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:05.792 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:06:05.792 INFO:teuthology.orchestra.run.smithi132.stdout: "complaint_time": 30, 2024-04-18T21:06:05.792 INFO:teuthology.orchestra.run.smithi132.stdout: "num_blocked_ops": 0 2024-04-18T21:06:05.792 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:05.806 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:05.884 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:06:05.884 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:06:05.887 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:05.887+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:05.906 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1: {} 2024-04-18T21:06:05.907 INFO:teuthology.orchestra.run.smithi078.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:06:05.929 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:05.929 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:05.930 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:06:05.930 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:05.943 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:05.988 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:05.990+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:06.065 INFO:tasks.ceph.mon.a.smithi078.stderr:2024-04-18T21:06:06.067+0000 7f8285915640 -1 log_channel(cluster) log [ERR] : Health check failed: full ratio(s) out of order (OSD_OUT_OF_ORDER_FULL) 2024-04-18T21:06:06.068 INFO:teuthology.orchestra.run.smithi078.stderr:osd set-full-ratio 0.001 2024-04-18T21:06:06.074 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-18T21:06:06.075 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:06.075 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:06.088 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:06.089 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:06.087+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:06.189 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:06.187+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:06.253 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:06.253 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:06.268 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:06.309 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:06.311+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:06.390 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:06.391+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:06.434 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:06.434 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:06.448 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:06.493 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:06.495+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:06.580 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:06.580 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:06.592 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:06.590+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:06.595 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:06.693 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:06.694+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:06.753 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:06.753 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:06.767 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:06.794 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:06.795+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:06.895 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:06.894+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:06.932 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:06.932 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:06.946 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:06.995 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:06.994+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:07.077 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:07.077 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:07.092 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:07.093 INFO:tasks.thrashosds.thrasher:Setting full ratio back to .95 2024-04-18T21:06:07.093 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set-full-ratio .95 2024-04-18T21:06:07.096 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:07.095+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:07.100 INFO:teuthology.orchestra.run.smithi078.stderr:nodeep-scrub is unset 2024-04-18T21:06:07.197 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:07.195+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:07.259 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:07.259 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:07.273 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:07.323 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:07.322+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:07.389 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:07.389 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:07.398 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:07.398+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:07.403 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:07.499 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:07.498+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:07.536 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:07.537 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:07.550 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:07.600 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:07.598+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:07.671 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:07.671 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:07.685 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:07.701 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:07.698+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:07.801 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:07.803+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:07.808 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:07.808 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:07.822 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:07.903 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:07.902+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:07.948 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:06:07.953 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:07.954 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:07.967 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:08.004 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:08.003+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:08.092 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:06:08.093 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:06:08.093 INFO:teuthology.orchestra.run.smithi078.stderr:osd set-full-ratio 0.95 2024-04-18T21:06:08.107 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:08.102+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:08.126 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1: {} 2024-04-18T21:06:08.126 INFO:teuthology.orchestra.run.smithi078.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:06:08.127 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:08.127 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:08.141 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:08.157 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:06:08.158 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:08.205 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:08.202+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:08.261 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:08.262 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-18T21:06:08.262 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-18T21:06:08.262 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:06:08.262 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.262 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:08.262 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:06:08.262 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 62.645880159000001, 2024-04-18T21:06:08.262 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.034065303999999998, 2024-04-18T21:06:08.262 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:08.262 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:08.262 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.262 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:08.263 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.263 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:08.263 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:06:08.263 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:08.263 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.263 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.263 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:08.263 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:06:08.263 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:08.263 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.263 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.263 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:08.263 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615254+0000", 2024-04-18T21:06:08.264 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7829999999999999e-06 2024-04-18T21:06:08.264 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.264 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.264 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:08.264 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615267+0000", 2024-04-18T21:06:08.264 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3334e-05 2024-04-18T21:06:08.264 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.264 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.264 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:08.264 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615294+0000", 2024-04-18T21:06:08.264 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7271999999999999e-05 2024-04-18T21:06:08.264 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.264 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.264 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.265 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615321+0000", 2024-04-18T21:06:08.265 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.637e-05 2024-04-18T21:06:08.265 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.265 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.265 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:08.265 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615479+0000", 2024-04-18T21:06:08.265 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000158493 2024-04-18T21:06:08.265 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.265 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.265 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:08.265 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615498+0000", 2024-04-18T21:06:08.265 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9148999999999999e-05 2024-04-18T21:06:08.265 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.265 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.266 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:08.266 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632915+0000", 2024-04-18T21:06:08.266 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.017416551999999998 2024-04-18T21:06:08.266 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.266 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.266 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:08.266 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633302+0000", 2024-04-18T21:06:08.266 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00038725000000000001 2024-04-18T21:06:08.266 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.266 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.266 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:08.266 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633638+0000", 2024-04-18T21:06:08.266 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000335946 2024-04-18T21:06:08.267 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.267 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.267 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:08.267 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645976+0000", 2024-04-18T21:06:08.267 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012337617 2024-04-18T21:06:08.267 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.267 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.267 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:08.267 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649080+0000", 2024-04-18T21:06:08.267 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031038929999999999 2024-04-18T21:06:08.267 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.267 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.267 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:08.268 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649207+0000", 2024-04-18T21:06:08.268 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000127537 2024-04-18T21:06:08.268 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.268 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.268 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:08.268 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649316+0000", 2024-04-18T21:06:08.268 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109108 2024-04-18T21:06:08.268 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:08.268 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:08.268 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:08.268 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.268 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.268 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:08.268 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:06:08.268 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 62.645746782000003, 2024-04-18T21:06:08.269 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036275764000000002, 2024-04-18T21:06:08.269 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:08.269 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:08.269 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.269 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:08.269 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.269 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:08.269 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:06:08.269 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:08.269 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.269 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.269 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:08.269 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:06:08.269 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:08.270 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.270 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.270 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:08.270 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615386+0000", 2024-04-18T21:06:08.270 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.573e-06 2024-04-18T21:06:08.270 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.270 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.270 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:08.270 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:06:08.270 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0723999999999999e-05 2024-04-18T21:06:08.270 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.270 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.270 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:08.270 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615418+0000", 2024-04-18T21:06:08.271 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0902000000000001e-05 2024-04-18T21:06:08.271 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.271 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.271 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.271 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615433+0000", 2024-04-18T21:06:08.271 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5319999999999999e-05 2024-04-18T21:06:08.271 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.271 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.271 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:08.271 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615659+0000", 2024-04-18T21:06:08.271 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000226095 2024-04-18T21:06:08.271 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.271 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.272 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:08.272 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:08.272 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1276e-05 2024-04-18T21:06:08.272 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.272 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.272 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:08.272 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643654+0000", 2024-04-18T21:06:08.272 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027983238000000001 2024-04-18T21:06:08.272 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.272 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.272 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:08.272 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643868+0000", 2024-04-18T21:06:08.272 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000214305 2024-04-18T21:06:08.272 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.272 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.273 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:08.273 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:06:08.273 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035892200000000002 2024-04-18T21:06:08.273 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.273 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.273 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:08.273 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646056+0000", 2024-04-18T21:06:08.273 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001829172 2024-04-18T21:06:08.273 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.273 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.273 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:08.273 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651406+0000", 2024-04-18T21:06:08.273 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0053504800000000003 2024-04-18T21:06:08.273 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.274 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.274 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:08.274 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651551+0000", 2024-04-18T21:06:08.274 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014427999999999999 2024-04-18T21:06:08.274 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.274 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.274 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:08.274 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651660+0000", 2024-04-18T21:06:08.274 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109477 2024-04-18T21:06:08.274 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:08.274 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:08.274 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:08.274 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.274 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.275 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:08.275 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:08.275 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 62.6456734, 2024-04-18T21:06:08.275 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045668994999999997, 2024-04-18T21:06:08.275 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:08.275 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:08.275 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.275 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:08.275 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.275 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:08.275 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:08.275 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:08.275 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.276 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.276 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:08.276 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:08.276 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:08.276 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.276 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.276 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:08.276 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615459+0000", 2024-04-18T21:06:08.276 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5030000000000001e-06 2024-04-18T21:06:08.276 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.276 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.276 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:08.276 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615506+0000", 2024-04-18T21:06:08.277 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6872000000000001e-05 2024-04-18T21:06:08.277 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.277 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.277 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:08.277 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615527+0000", 2024-04-18T21:06:08.277 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0763000000000001e-05 2024-04-18T21:06:08.277 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.277 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.277 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.277 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615551+0000", 2024-04-18T21:06:08.277 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4159e-05 2024-04-18T21:06:08.277 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.277 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.277 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:08.278 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615736+0000", 2024-04-18T21:06:08.278 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018499599999999999 2024-04-18T21:06:08.278 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.278 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.278 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:08.278 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615748+0000", 2024-04-18T21:06:08.278 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2272999999999999e-05 2024-04-18T21:06:08.278 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.278 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.278 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:08.278 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635481+0000", 2024-04-18T21:06:08.278 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019732772999999999 2024-04-18T21:06:08.278 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.279 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.279 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:08.279 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635791+0000", 2024-04-18T21:06:08.279 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031013299999999998 2024-04-18T21:06:08.279 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.279 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.279 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:08.279 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636101+0000", 2024-04-18T21:06:08.279 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030943300000000002 2024-04-18T21:06:08.279 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.279 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.279 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:08.279 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646043+0000", 2024-04-18T21:06:08.280 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099428139999999995 2024-04-18T21:06:08.280 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.280 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.280 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:08.280 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660991+0000", 2024-04-18T21:06:08.280 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014947142 2024-04-18T21:06:08.280 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.280 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.280 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:08.280 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661061+0000", 2024-04-18T21:06:08.280 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0438000000000006e-05 2024-04-18T21:06:08.280 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.280 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.280 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:08.281 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661127+0000", 2024-04-18T21:06:08.281 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5696000000000003e-05 2024-04-18T21:06:08.281 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:08.281 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:08.281 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:08.281 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.281 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.281 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:08.281 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:08.281 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 62.645460972000002, 2024-04-18T21:06:08.281 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045745085999999997, 2024-04-18T21:06:08.281 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:08.281 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:08.281 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.281 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:08.282 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.282 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:08.282 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:08.282 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:08.282 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.282 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.282 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:08.282 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:08.282 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:08.282 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.282 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.282 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:08.282 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:06:08.283 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7400000000000001e-06 2024-04-18T21:06:08.283 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.283 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.283 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:08.283 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:06:08.283 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8133e-05 2024-04-18T21:06:08.283 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.283 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.283 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:08.283 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615726+0000", 2024-04-18T21:06:08.283 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6132e-05 2024-04-18T21:06:08.283 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.283 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.283 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.284 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615742+0000", 2024-04-18T21:06:08.284 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6157000000000001e-05 2024-04-18T21:06:08.284 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.284 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.284 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:08.284 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615937+0000", 2024-04-18T21:06:08.284 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000194768 2024-04-18T21:06:08.284 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.284 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.284 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:08.284 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615950+0000", 2024-04-18T21:06:08.284 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3084e-05 2024-04-18T21:06:08.284 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.284 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.285 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:08.285 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643676+0000", 2024-04-18T21:06:08.285 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027725639999999999 2024-04-18T21:06:08.285 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.285 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.285 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:08.285 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643867+0000", 2024-04-18T21:06:08.285 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019075900000000001 2024-04-18T21:06:08.285 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.285 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.285 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:08.285 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:06:08.285 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036013799999999997 2024-04-18T21:06:08.285 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.286 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.286 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:08.286 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646068+0000", 2024-04-18T21:06:08.286 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001841536 2024-04-18T21:06:08.286 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.286 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.286 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:08.286 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661184+0000", 2024-04-18T21:06:08.286 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015115458999999999 2024-04-18T21:06:08.286 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.286 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.286 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:08.286 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661283+0000", 2024-04-18T21:06:08.286 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9502999999999999e-05 2024-04-18T21:06:08.287 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.287 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.287 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:08.287 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661415+0000", 2024-04-18T21:06:08.287 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000132037 2024-04-18T21:06:08.287 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:08.287 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:08.287 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:08.287 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.287 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.287 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:08.287 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:06:08.287 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 62.645339284999999, 2024-04-18T21:06:08.288 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036185947000000003, 2024-04-18T21:06:08.288 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:08.288 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:08.288 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.288 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:08.288 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.288 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:08.288 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:06:08.288 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:08.288 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.288 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.288 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:08.288 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:06:08.288 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:08.289 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.289 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.289 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:08.289 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615794+0000", 2024-04-18T21:06:08.289 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6440000000000001e-06 2024-04-18T21:06:08.289 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.289 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.289 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:08.289 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615803+0000", 2024-04-18T21:06:08.289 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1220000000000001e-06 2024-04-18T21:06:08.289 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.289 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.289 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:08.290 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615827+0000", 2024-04-18T21:06:08.290 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3997000000000001e-05 2024-04-18T21:06:08.290 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.290 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.290 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.290 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615899+0000", 2024-04-18T21:06:08.290 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2741e-05 2024-04-18T21:06:08.290 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.290 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.290 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:08.290 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616019+0000", 2024-04-18T21:06:08.290 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119874 2024-04-18T21:06:08.290 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.290 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.291 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:08.291 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616029+0000", 2024-04-18T21:06:08.291 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:06:08.291 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.291 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.291 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:08.291 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644823+0000", 2024-04-18T21:06:08.291 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.028793151999999999 2024-04-18T21:06:08.291 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.291 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.291 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:08.291 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645106+0000", 2024-04-18T21:06:08.291 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028379700000000002 2024-04-18T21:06:08.291 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.291 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.292 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:08.292 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645294+0000", 2024-04-18T21:06:08.292 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000187181 2024-04-18T21:06:08.292 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.292 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.292 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:08.292 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646763+0000", 2024-04-18T21:06:08.292 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0014691050000000001 2024-04-18T21:06:08.292 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.292 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.292 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:08.292 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651784+0000", 2024-04-18T21:06:08.292 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050211650000000002 2024-04-18T21:06:08.292 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.292 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.293 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:08.293 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651876+0000", 2024-04-18T21:06:08.293 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2503999999999994e-05 2024-04-18T21:06:08.293 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.293 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.293 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:08.293 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651978+0000", 2024-04-18T21:06:08.293 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000101475 2024-04-18T21:06:08.293 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:08.293 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:08.293 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:08.293 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.293 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.293 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:08.294 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:08.294 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 62.645190677999999, 2024-04-18T21:06:08.294 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032262322000000003, 2024-04-18T21:06:08.294 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:08.294 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:08.294 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.294 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:08.294 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.294 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:08.294 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:08.294 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:08.294 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.294 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.294 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:08.295 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:08.295 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:08.295 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.295 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.295 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:08.295 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615943+0000", 2024-04-18T21:06:08.295 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1959999999999998e-06 2024-04-18T21:06:08.295 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.295 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.295 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:08.295 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615956+0000", 2024-04-18T21:06:08.296 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3424000000000001e-05 2024-04-18T21:06:08.296 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.296 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.296 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:08.296 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615983+0000", 2024-04-18T21:06:08.296 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7072000000000001e-05 2024-04-18T21:06:08.296 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.296 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.296 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.296 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616006+0000", 2024-04-18T21:06:08.296 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2823000000000002e-05 2024-04-18T21:06:08.296 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.296 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.296 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:08.297 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616156+0000", 2024-04-18T21:06:08.297 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014962299999999999 2024-04-18T21:06:08.297 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.297 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.297 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:08.297 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616174+0000", 2024-04-18T21:06:08.297 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8082999999999999e-05 2024-04-18T21:06:08.297 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.297 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.297 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:08.297 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.629952+0000", 2024-04-18T21:06:08.297 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013778514 2024-04-18T21:06:08.297 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.297 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.297 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:08.298 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630201+0000", 2024-04-18T21:06:08.298 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024918100000000001 2024-04-18T21:06:08.298 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.298 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.298 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:08.298 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630386+0000", 2024-04-18T21:06:08.298 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018436900000000001 2024-04-18T21:06:08.298 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.298 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.298 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:08.298 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643169+0000", 2024-04-18T21:06:08.299 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012782774 2024-04-18T21:06:08.299 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.299 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.299 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:08.299 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.647924+0000", 2024-04-18T21:06:08.299 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004755787 2024-04-18T21:06:08.299 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.299 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.299 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:08.299 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648069+0000", 2024-04-18T21:06:08.299 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014459600000000001 2024-04-18T21:06:08.299 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.299 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.299 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:08.300 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648203+0000", 2024-04-18T21:06:08.300 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013388000000000001 2024-04-18T21:06:08.300 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:08.300 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:08.300 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:08.300 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.300 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.300 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:08.300 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:06:08.300 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 62.645082414000001, 2024-04-18T21:06:08.300 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032489736999999998, 2024-04-18T21:06:08.300 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:08.300 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:08.300 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:08.301 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:08.301 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.301 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:08.301 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:06:08.301 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:08.301 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.301 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.301 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:08.301 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:06:08.301 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:08.301 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.301 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.301 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:08.301 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616050+0000", 2024-04-18T21:06:08.302 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.606e-06 2024-04-18T21:06:08.302 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.302 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.302 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:08.302 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616061+0000", 2024-04-18T21:06:08.302 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0463e-05 2024-04-18T21:06:08.302 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.302 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.302 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:08.302 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616092+0000", 2024-04-18T21:06:08.302 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1415999999999999e-05 2024-04-18T21:06:08.302 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.302 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.303 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.303 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616109+0000", 2024-04-18T21:06:08.303 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6557000000000001e-05 2024-04-18T21:06:08.303 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.303 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.303 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:08.303 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616358+0000", 2024-04-18T21:06:08.303 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000249077 2024-04-18T21:06:08.303 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.303 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.303 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:08.303 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616370+0000", 2024-04-18T21:06:08.303 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2037e-05 2024-04-18T21:06:08.303 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.303 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.304 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:08.304 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.634920+0000", 2024-04-18T21:06:08.304 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018550397 2024-04-18T21:06:08.304 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.304 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.304 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:08.304 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640420+0000", 2024-04-18T21:06:08.304 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055000539999999999 2024-04-18T21:06:08.304 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.304 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.304 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:08.304 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648538+0000", 2024-04-18T21:06:08.304 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0081181299999999994 2024-04-18T21:06:08.304 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:08.305 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:08.305 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:08.305 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.305 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.305 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:08.305 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:06:08.305 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 62.644998092999998, 2024-04-18T21:06:08.305 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036090029000000003, 2024-04-18T21:06:08.305 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:08.305 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:08.305 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:08.305 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:08.306 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.306 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:08.306 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:06:08.306 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:08.306 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.306 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.306 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:08.306 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:06:08.306 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:08.306 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.306 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.306 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:08.306 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616134+0000", 2024-04-18T21:06:08.307 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.353e-06 2024-04-18T21:06:08.307 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.307 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.307 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:08.307 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616141+0000", 2024-04-18T21:06:08.307 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2770000000000002e-06 2024-04-18T21:06:08.307 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.307 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.307 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:08.307 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616160+0000", 2024-04-18T21:06:08.307 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.91e-05 2024-04-18T21:06:08.307 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.307 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.309 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.309 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616170+0000", 2024-04-18T21:06:08.309 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7699999999999996e-06 2024-04-18T21:06:08.309 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.309 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.309 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:08.309 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616275+0000", 2024-04-18T21:06:08.309 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105313 2024-04-18T21:06:08.309 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.309 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.309 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:08.310 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616288+0000", 2024-04-18T21:06:08.310 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3027000000000001e-05 2024-04-18T21:06:08.310 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.310 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.310 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:08.310 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646160+0000", 2024-04-18T21:06:08.310 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.029872019 2024-04-18T21:06:08.310 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.310 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.310 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:08.310 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646368+0000", 2024-04-18T21:06:08.311 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020811899999999999 2024-04-18T21:06:08.311 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.311 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.311 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:08.311 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652223+0000", 2024-04-18T21:06:08.311 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.005855051 2024-04-18T21:06:08.311 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:08.311 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:08.311 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:08.311 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.311 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.311 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:08.311 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:08.311 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 62.644940523999999, 2024-04-18T21:06:08.312 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043572403000000003, 2024-04-18T21:06:08.312 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:08.312 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:08.312 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:08.312 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:08.312 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.312 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:08.312 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:08.312 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:08.312 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.312 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.313 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:08.313 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:08.313 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:08.313 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.313 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.313 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:08.313 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616192+0000", 2024-04-18T21:06:08.313 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:06:08.313 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.313 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.313 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:08.313 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616203+0000", 2024-04-18T21:06:08.313 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0890000000000001e-05 2024-04-18T21:06:08.313 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.314 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.314 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:08.314 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616223+0000", 2024-04-18T21:06:08.314 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0409000000000001e-05 2024-04-18T21:06:08.314 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.314 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.314 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.314 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616238+0000", 2024-04-18T21:06:08.314 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5160000000000001e-05 2024-04-18T21:06:08.314 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.314 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.314 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:08.314 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616343+0000", 2024-04-18T21:06:08.315 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000104831 2024-04-18T21:06:08.315 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.315 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.315 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:08.315 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616357+0000", 2024-04-18T21:06:08.315 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3686000000000001e-05 2024-04-18T21:06:08.315 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.315 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.315 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:08.315 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635912+0000", 2024-04-18T21:06:08.315 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019554944000000001 2024-04-18T21:06:08.315 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.315 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.315 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:08.316 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636231+0000", 2024-04-18T21:06:08.316 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000318766 2024-04-18T21:06:08.316 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.316 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.316 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:08.316 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659763+0000", 2024-04-18T21:06:08.316 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023532474000000001 2024-04-18T21:06:08.316 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:08.316 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:08.316 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:08.316 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.316 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.316 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:08.316 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:06:08.316 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 62.641011816999999, 2024-04-18T21:06:08.317 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015007971, 2024-04-18T21:06:08.317 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:08.317 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:08.317 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.317 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:08.317 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.317 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:08.317 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:06:08.317 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:08.317 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.317 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.317 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:08.317 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:06:08.317 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:08.318 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.318 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.318 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:08.318 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620120+0000", 2024-04-18T21:06:08.318 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0359999999999999e-06 2024-04-18T21:06:08.318 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.318 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.318 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:08.318 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620157+0000", 2024-04-18T21:06:08.318 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6636e-05 2024-04-18T21:06:08.318 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.318 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.318 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:08.319 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620177+0000", 2024-04-18T21:06:08.319 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0247000000000001e-05 2024-04-18T21:06:08.319 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.319 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.319 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.319 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620195+0000", 2024-04-18T21:06:08.319 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7819e-05 2024-04-18T21:06:08.319 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.319 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.319 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:08.319 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620342+0000", 2024-04-18T21:06:08.319 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014643300000000001 2024-04-18T21:06:08.319 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.320 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.320 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:08.320 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620405+0000", 2024-04-18T21:06:08.320 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3522000000000006e-05 2024-04-18T21:06:08.320 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.320 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.320 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:08.320 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635016+0000", 2024-04-18T21:06:08.320 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014610840999999999 2024-04-18T21:06:08.320 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.320 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.320 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:08.320 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635127+0000", 2024-04-18T21:06:08.320 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111437 2024-04-18T21:06:08.321 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:08.321 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:08.321 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:08.321 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.321 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.321 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:08.321 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:06:08.321 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 62.640904548999998, 2024-04-18T21:06:08.321 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012693296, 2024-04-18T21:06:08.321 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:08.321 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:08.321 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.321 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:08.321 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.322 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:08.322 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:06:08.322 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:08.322 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.322 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.322 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:08.322 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:06:08.322 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:08.322 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.322 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.322 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:08.322 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620228+0000", 2024-04-18T21:06:08.322 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:06:08.322 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.323 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.323 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:08.323 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620236+0000", 2024-04-18T21:06:08.323 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.303e-06 2024-04-18T21:06:08.323 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.323 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.323 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:08.323 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620255+0000", 2024-04-18T21:06:08.323 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9406e-05 2024-04-18T21:06:08.323 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.323 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.323 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.323 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620274+0000", 2024-04-18T21:06:08.324 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8940000000000002e-05 2024-04-18T21:06:08.324 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.324 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.324 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:08.324 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:06:08.324 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001558753 2024-04-18T21:06:08.324 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.324 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.324 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:08.324 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621879+0000", 2024-04-18T21:06:08.324 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6359000000000001e-05 2024-04-18T21:06:08.324 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.324 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.324 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:08.324 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632841+0000", 2024-04-18T21:06:08.325 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010961907 2024-04-18T21:06:08.325 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.325 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.325 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:08.325 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632920+0000", 2024-04-18T21:06:08.325 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8714999999999994e-05 2024-04-18T21:06:08.325 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:08.325 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:08.325 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:08.325 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.325 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.325 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:08.325 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:06:08.325 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 62.639358786000003, 2024-04-18T21:06:08.326 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013445702, 2024-04-18T21:06:08.326 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:08.326 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:08.326 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.326 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:08.326 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.326 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:08.326 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:06:08.326 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:08.326 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.326 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.326 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:08.327 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:06:08.327 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:08.327 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.327 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.327 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:08.327 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621774+0000", 2024-04-18T21:06:08.327 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2500000000000001e-06 2024-04-18T21:06:08.327 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.327 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.327 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:08.327 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621786+0000", 2024-04-18T21:06:08.327 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2636000000000001e-05 2024-04-18T21:06:08.327 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.327 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.328 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:08.328 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621814+0000", 2024-04-18T21:06:08.328 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7823000000000001e-05 2024-04-18T21:06:08.328 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.328 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.328 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.328 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621844+0000", 2024-04-18T21:06:08.328 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9589000000000001e-05 2024-04-18T21:06:08.328 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.328 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.328 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:08.328 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622253+0000", 2024-04-18T21:06:08.328 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040963700000000002 2024-04-18T21:06:08.328 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.329 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.329 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:08.329 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622304+0000", 2024-04-18T21:06:08.329 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0868999999999997e-05 2024-04-18T21:06:08.329 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.329 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.329 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:08.329 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635133+0000", 2024-04-18T21:06:08.329 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012829136 2024-04-18T21:06:08.329 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.329 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.329 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:08.329 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635218+0000", 2024-04-18T21:06:08.329 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4761999999999999e-05 2024-04-18T21:06:08.330 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:08.330 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:08.330 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:08.330 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.330 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.330 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:08.330 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:06:08.330 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 62.639232026000002, 2024-04-18T21:06:08.330 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014162065, 2024-04-18T21:06:08.330 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:08.330 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:08.330 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.330 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:08.330 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.331 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:08.331 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:06:08.331 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:08.331 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.331 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.331 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:08.331 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:06:08.331 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:08.331 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.331 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.331 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:08.331 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621900+0000", 2024-04-18T21:06:08.331 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:06:08.331 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.332 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.332 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:08.332 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621910+0000", 2024-04-18T21:06:08.332 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0207000000000001e-05 2024-04-18T21:06:08.332 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.332 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.332 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:08.332 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621932+0000", 2024-04-18T21:06:08.332 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1789000000000001e-05 2024-04-18T21:06:08.332 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.332 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.332 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.332 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621946+0000", 2024-04-18T21:06:08.332 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4212999999999999e-05 2024-04-18T21:06:08.333 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.333 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.333 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:08.333 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624477+0000", 2024-04-18T21:06:08.333 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025303470000000001 2024-04-18T21:06:08.333 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.333 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.333 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:08.333 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624525+0000", 2024-04-18T21:06:08.333 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8084999999999998e-05 2024-04-18T21:06:08.333 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.333 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.333 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:08.333 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635976+0000", 2024-04-18T21:06:08.334 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.011451368999999999 2024-04-18T21:06:08.334 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.334 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.334 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:08.334 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636061+0000", 2024-04-18T21:06:08.334 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5094999999999998e-05 2024-04-18T21:06:08.334 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:08.334 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:08.334 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:08.334 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.334 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.334 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:06:08.334 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:06:08.335 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 62.629996401, 2024-04-18T21:06:08.335 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0098014739999999993, 2024-04-18T21:06:08.335 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:08.335 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:08.335 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:06:08.335 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:08.335 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.335 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:08.335 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:06:08.335 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:08.335 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.335 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.335 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:08.335 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:06:08.335 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:08.336 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.336 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.336 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:08.336 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631136+0000", 2024-04-18T21:06:08.336 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0139999999999999e-06 2024-04-18T21:06:08.336 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.336 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.336 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:08.336 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631152+0000", 2024-04-18T21:06:08.336 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6365999999999999e-05 2024-04-18T21:06:08.336 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.336 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.336 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:08.336 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631961+0000", 2024-04-18T21:06:08.336 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00080873100000000003 2024-04-18T21:06:08.337 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.337 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.337 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.337 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632021+0000", 2024-04-18T21:06:08.337 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0541999999999997e-05 2024-04-18T21:06:08.337 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.337 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.337 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:08.337 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633539+0000", 2024-04-18T21:06:08.337 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015175639999999999 2024-04-18T21:06:08.337 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.337 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.337 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:08.338 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640936+0000", 2024-04-18T21:06:08.338 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007397257 2024-04-18T21:06:08.338 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:08.338 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:08.338 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:08.338 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.338 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.338 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-18T21:06:08.338 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:06:08.338 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 62.612534967999999, 2024-04-18T21:06:08.338 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00073592199999999997, 2024-04-18T21:06:08.338 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:08.338 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:08.338 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:08.339 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:08.339 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.339 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:08.339 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:06:08.339 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:08.339 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.339 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.339 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:08.339 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:06:08.339 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:08.339 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.339 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.339 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:08.340 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648597+0000", 2024-04-18T21:06:08.340 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:06:08.340 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.340 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.340 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:08.340 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648605+0000", 2024-04-18T21:06:08.340 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3960000000000006e-06 2024-04-18T21:06:08.340 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.340 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.340 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:08.340 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648625+0000", 2024-04-18T21:06:08.340 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9987e-05 2024-04-18T21:06:08.340 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.340 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.340 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.341 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648643+0000", 2024-04-18T21:06:08.341 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7079e-05 2024-04-18T21:06:08.341 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.341 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.341 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:08.341 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649043+0000", 2024-04-18T21:06:08.341 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040083399999999998 2024-04-18T21:06:08.341 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.341 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.341 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:08.341 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649062+0000", 2024-04-18T21:06:08.341 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9052999999999999e-05 2024-04-18T21:06:08.341 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.342 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.342 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:08.342 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649332+0000", 2024-04-18T21:06:08.342 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026971999999999999 2024-04-18T21:06:08.342 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:08.342 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:08.342 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:08.342 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.342 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.342 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:06:08.342 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:06:08.342 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 62.609760067000003, 2024-04-18T21:06:08.342 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00086123999999999999, 2024-04-18T21:06:08.343 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:08.343 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:08.343 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:06:08.343 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:08.343 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.343 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:08.343 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:06:08.343 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:08.343 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.343 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.343 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:08.343 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:06:08.343 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:08.343 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.343 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.344 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:08.344 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651372+0000", 2024-04-18T21:06:08.344 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7599999999999997e-07 2024-04-18T21:06:08.344 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.344 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.344 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:08.344 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651377+0000", 2024-04-18T21:06:08.344 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.22e-06 2024-04-18T21:06:08.344 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.344 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.344 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:08.344 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651394+0000", 2024-04-18T21:06:08.344 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6646999999999998e-05 2024-04-18T21:06:08.344 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.345 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.345 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.345 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651427+0000", 2024-04-18T21:06:08.345 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3682e-05 2024-04-18T21:06:08.345 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.345 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.345 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:08.345 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652029+0000", 2024-04-18T21:06:08.345 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00060152199999999995 2024-04-18T21:06:08.345 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.345 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.345 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:08.345 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652232+0000", 2024-04-18T21:06:08.345 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020359299999999999 2024-04-18T21:06:08.346 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:08.346 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:08.346 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:08.346 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.346 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.346 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:06:08.346 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:06:08.346 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 62.601733105000001, 2024-04-18T21:06:08.346 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0017426200000000001, 2024-04-18T21:06:08.346 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:08.346 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:08.346 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:08.346 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:08.347 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.347 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:08.347 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:06:08.347 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:08.347 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.347 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.347 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:08.347 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:06:08.347 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:08.347 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.347 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.347 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:08.347 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659399+0000", 2024-04-18T21:06:08.347 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6000000000000002e-07 2024-04-18T21:06:08.348 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.348 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.348 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:08.348 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659405+0000", 2024-04-18T21:06:08.348 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5069999999999997e-06 2024-04-18T21:06:08.348 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.348 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.348 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:08.348 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659425+0000", 2024-04-18T21:06:08.348 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.927e-05 2024-04-18T21:06:08.348 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.348 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.348 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.349 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659443+0000", 2024-04-18T21:06:08.349 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8051999999999999e-05 2024-04-18T21:06:08.349 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.349 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.349 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:08.349 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660973+0000", 2024-04-18T21:06:08.349 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001530106 2024-04-18T21:06:08.349 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.349 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.349 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:08.349 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660983+0000", 2024-04-18T21:06:08.349 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0516999999999999e-05 2024-04-18T21:06:08.349 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.349 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.349 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:08.350 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661141+0000", 2024-04-18T21:06:08.350 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015730799999999999 2024-04-18T21:06:08.350 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:08.350 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:08.350 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:08.350 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.350 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.350 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:06:08.350 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:06:08.350 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 62.601516480000001, 2024-04-18T21:06:08.350 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001812311, 2024-04-18T21:06:08.350 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:08.350 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:08.351 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:08.351 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:08.351 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.351 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:08.351 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:06:08.351 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:08.351 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.351 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.351 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:08.351 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:06:08.351 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:08.351 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.351 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.351 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:08.352 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659616+0000", 2024-04-18T21:06:08.352 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.277e-06 2024-04-18T21:06:08.352 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.352 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.352 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:08.352 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659625+0000", 2024-04-18T21:06:08.352 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5359999999999998e-06 2024-04-18T21:06:08.352 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.352 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.352 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:08.352 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659647+0000", 2024-04-18T21:06:08.352 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1857000000000001e-05 2024-04-18T21:06:08.352 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.352 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.353 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.353 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659664+0000", 2024-04-18T21:06:08.353 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6405999999999998e-05 2024-04-18T21:06:08.353 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.353 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.353 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:08.353 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661169+0000", 2024-04-18T21:06:08.353 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015054179999999999 2024-04-18T21:06:08.353 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.353 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.353 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:08.353 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661177+0000", 2024-04-18T21:06:08.353 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9680000000000006e-06 2024-04-18T21:06:08.353 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.354 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.354 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:08.354 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661427+0000", 2024-04-18T21:06:08.354 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024984900000000001 2024-04-18T21:06:08.354 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:08.354 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:08.354 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:08.354 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.354 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.354 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-18T21:06:08.354 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:06:08.354 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 60.648595872000001, 2024-04-18T21:06:08.354 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0030975030000000001, 2024-04-18T21:06:08.354 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:08.355 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:08.355 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.355 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:08.355 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.355 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:08.355 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:06:08.355 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:08.355 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.355 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.355 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:08.355 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:06:08.355 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:08.355 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.355 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.355 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:08.356 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612538+0000", 2024-04-18T21:06:08.356 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6259999999999999e-06 2024-04-18T21:06:08.356 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.356 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.356 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:08.356 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612552+0000", 2024-04-18T21:06:08.356 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4073999999999999e-05 2024-04-18T21:06:08.356 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.356 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.356 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:08.356 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612585+0000", 2024-04-18T21:06:08.356 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3504999999999999e-05 2024-04-18T21:06:08.356 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.356 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.356 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.357 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612601+0000", 2024-04-18T21:06:08.357 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5194000000000001e-05 2024-04-18T21:06:08.357 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.357 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.357 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:08.357 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612746+0000", 2024-04-18T21:06:08.357 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145666 2024-04-18T21:06:08.357 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.357 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.357 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:08.357 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612953+0000", 2024-04-18T21:06:08.357 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000207109 2024-04-18T21:06:08.357 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.357 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.358 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:08.358 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.613134+0000", 2024-04-18T21:06:08.358 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018041300000000001 2024-04-18T21:06:08.358 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.358 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.358 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:08.358 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.614411+0000", 2024-04-18T21:06:08.358 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0012769929999999999 2024-04-18T21:06:08.358 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.358 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.358 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:08.358 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615441+0000", 2024-04-18T21:06:08.358 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001029917 2024-04-18T21:06:08.359 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.359 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.359 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:08.359 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615522+0000", 2024-04-18T21:06:08.359 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1142000000000003e-05 2024-04-18T21:06:08.359 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.359 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.359 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:08.359 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615633+0000", 2024-04-18T21:06:08.359 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000110864 2024-04-18T21:06:08.359 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:08.359 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:08.359 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:08.359 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.360 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.360 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-18T21:06:08.360 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:06:08.360 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 42.646310061000001, 2024-04-18T21:06:08.360 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088979039999999999, 2024-04-18T21:06:08.360 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:08.360 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:08.360 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.360 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:08.360 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.360 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:08.360 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:06:08.360 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:08.360 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.360 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.360 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:08.361 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:06:08.361 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:08.361 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.361 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.361 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:08.361 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614825+0000", 2024-04-18T21:06:08.361 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4829999999999999e-06 2024-04-18T21:06:08.361 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.361 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.361 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:08.361 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614843+0000", 2024-04-18T21:06:08.361 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8777e-05 2024-04-18T21:06:08.361 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.361 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.361 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:08.361 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614884+0000", 2024-04-18T21:06:08.362 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1051999999999999e-05 2024-04-18T21:06:08.362 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.362 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.362 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.362 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614903+0000", 2024-04-18T21:06:08.362 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9069999999999999e-05 2024-04-18T21:06:08.362 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.362 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.362 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:08.362 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615047+0000", 2024-04-18T21:06:08.362 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014374400000000001 2024-04-18T21:06:08.362 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.363 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.363 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:08.363 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615061+0000", 2024-04-18T21:06:08.363 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4063000000000001e-05 2024-04-18T21:06:08.363 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.363 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.363 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:08.363 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621064+0000", 2024-04-18T21:06:08.363 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0060029200000000001 2024-04-18T21:06:08.363 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.363 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.363 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:08.363 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621211+0000", 2024-04-18T21:06:08.363 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000147224 2024-04-18T21:06:08.363 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.364 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.364 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:08.364 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621396+0000", 2024-04-18T21:06:08.364 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018454699999999999 2024-04-18T21:06:08.364 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.364 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.364 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:08.364 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.622517+0000", 2024-04-18T21:06:08.364 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001121424 2024-04-18T21:06:08.364 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.364 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.364 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:08.364 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623571+0000", 2024-04-18T21:06:08.364 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010538660000000001 2024-04-18T21:06:08.364 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.365 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.365 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:08.365 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623658+0000", 2024-04-18T21:06:08.365 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6439000000000004e-05 2024-04-18T21:06:08.365 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:08.365 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:08.365 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:08.365 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623719+0000", 2024-04-18T21:06:08.365 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1295000000000002e-05 2024-04-18T21:06:08.365 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:08.365 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:08.365 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:08.365 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:08.365 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:08.365 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:08.367 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:08.366+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:08.367 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:08.468 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:08.466+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:08.498 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:08.498 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:06:08.498 INFO:teuthology.orchestra.run.smithi132.stdout: "num_ops": 0 2024-04-18T21:06:08.498 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:08.514 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:08.569 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:08.570+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:08.636 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:08.636 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:06:08.637 INFO:teuthology.orchestra.run.smithi132.stdout: "complaint_time": 30, 2024-04-18T21:06:08.637 INFO:teuthology.orchestra.run.smithi132.stdout: "num_blocked_ops": 0 2024-04-18T21:06:08.637 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:08.651 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:08.669 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:08.671+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:08.770 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:08.770 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 20, 2024-04-18T21:06:08.770 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 600, 2024-04-18T21:06:08.770 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [ 2024-04-18T21:06:08.770 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.770 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:08.770 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:06:08.770 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 73.857919213000002, 2024-04-18T21:06:08.770 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.02518273, 2024-04-18T21:06:08.771 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:08.771 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:08.771 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.771 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:08.771 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:08.771 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:08.771 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 141 2024-04-18T21:06:08.771 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.771 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:08.771 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.771 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:08.772 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:06:08.772 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:08.772 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.772 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.772 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:08.772 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:06:08.772 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:08.772 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.772 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.772 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:08.772 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911562+0000", 2024-04-18T21:06:08.772 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9300000000000006e-07 2024-04-18T21:06:08.772 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.772 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.773 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:08.773 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911569+0000", 2024-04-18T21:06:08.773 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0169999999999999e-06 2024-04-18T21:06:08.773 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.773 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.773 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:08.773 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911582+0000", 2024-04-18T21:06:08.773 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.343e-05 2024-04-18T21:06:08.773 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.773 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.773 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.773 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911590+0000", 2024-04-18T21:06:08.773 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.413e-06 2024-04-18T21:06:08.773 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.774 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.774 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:08.774 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.933922+0000", 2024-04-18T21:06:08.774 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.022332093000000001 2024-04-18T21:06:08.774 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.774 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.774 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:08.774 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.934155+0000", 2024-04-18T21:06:08.774 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023378900000000001 2024-04-18T21:06:08.774 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.774 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.774 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:08.774 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.934514+0000", 2024-04-18T21:06:08.774 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00035859200000000003 2024-04-18T21:06:08.775 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.775 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.775 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:08.775 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.935973+0000", 2024-04-18T21:06:08.775 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001458705 2024-04-18T21:06:08.775 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.775 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.775 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:08.775 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936488+0000", 2024-04-18T21:06:08.775 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00051550000000000001 2024-04-18T21:06:08.775 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.775 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.775 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:08.775 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936636+0000", 2024-04-18T21:06:08.776 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014779800000000001 2024-04-18T21:06:08.776 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.776 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.776 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:08.776 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936743+0000", 2024-04-18T21:06:08.776 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010739999999999999 2024-04-18T21:06:08.776 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:08.776 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:08.776 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:08.776 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.776 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.776 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:08.776 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:08.777 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 73.740720238999998, 2024-04-18T21:06:08.777 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023654959999999999, 2024-04-18T21:06:08.777 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:08.777 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:08.777 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.777 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:08.777 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:08.777 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:08.777 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 163 2024-04-18T21:06:08.777 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.777 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:08.777 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.777 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:08.777 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:08.777 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:08.778 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.778 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.778 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:08.778 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:08.778 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:08.778 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.778 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.778 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:08.778 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:08.778 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0999999999999998e-07 2024-04-18T21:06:08.778 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.778 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.778 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:08.779 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028766+0000", 2024-04-18T21:06:08.779 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4700000000000001e-06 2024-04-18T21:06:08.779 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.779 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.779 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:08.779 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028775+0000", 2024-04-18T21:06:08.779 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.3190000000000001e-06 2024-04-18T21:06:08.779 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.779 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.779 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.779 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028782+0000", 2024-04-18T21:06:08.779 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.2300000000000002e-06 2024-04-18T21:06:08.779 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.779 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.779 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:08.780 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046667+0000", 2024-04-18T21:06:08.780 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017884356000000001 2024-04-18T21:06:08.780 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.780 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.780 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:08.780 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046788+0000", 2024-04-18T21:06:08.780 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012125000000000001 2024-04-18T21:06:08.780 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.780 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.780 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:08.780 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046982+0000", 2024-04-18T21:06:08.780 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019394 2024-04-18T21:06:08.780 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.780 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.781 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:08.781 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051969+0000", 2024-04-18T21:06:08.781 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0049868150000000003 2024-04-18T21:06:08.781 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.781 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.781 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:08.781 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052089+0000", 2024-04-18T21:06:08.781 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011993 2024-04-18T21:06:08.781 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.781 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.781 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:08.781 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052292+0000", 2024-04-18T21:06:08.781 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020345699999999999 2024-04-18T21:06:08.781 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.781 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.782 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:08.782 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052415+0000", 2024-04-18T21:06:08.782 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000122483 2024-04-18T21:06:08.782 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:08.782 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:08.782 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:08.782 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.782 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.782 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:08.782 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:08.782 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 73.740686006999994, 2024-04-18T21:06:08.782 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023864586, 2024-04-18T21:06:08.782 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:08.782 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:08.783 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.783 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:08.783 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:08.783 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:08.783 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 164 2024-04-18T21:06:08.783 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.783 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:08.783 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.783 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:08.783 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:08.783 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:08.783 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.783 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.783 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:08.784 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:08.784 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:08.784 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.784 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.784 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:08.784 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028795+0000", 2024-04-18T21:06:08.784 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7999999999999995e-07 2024-04-18T21:06:08.784 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.784 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.784 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:08.784 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028884+0000", 2024-04-18T21:06:08.784 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8997000000000002e-05 2024-04-18T21:06:08.784 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.784 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.785 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:08.785 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028895+0000", 2024-04-18T21:06:08.785 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1647e-05 2024-04-18T21:06:08.785 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.785 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.785 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.785 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028903+0000", 2024-04-18T21:06:08.785 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.909e-06 2024-04-18T21:06:08.785 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.785 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.785 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:08.785 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.047818+0000", 2024-04-18T21:06:08.785 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018914337 2024-04-18T21:06:08.785 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.785 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.786 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:08.786 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.048094+0000", 2024-04-18T21:06:08.786 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00027653500000000001 2024-04-18T21:06:08.786 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.786 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.786 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:08.786 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.048471+0000", 2024-04-18T21:06:08.786 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00037705799999999999 2024-04-18T21:06:08.786 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.786 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.786 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:08.786 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052516+0000", 2024-04-18T21:06:08.786 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0040452739999999997 2024-04-18T21:06:08.787 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.787 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.787 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:08.787 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052535+0000", 2024-04-18T21:06:08.787 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.84e-05 2024-04-18T21:06:08.787 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.787 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.787 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:08.787 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052603+0000", 2024-04-18T21:06:08.787 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.8095000000000004e-05 2024-04-18T21:06:08.787 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.787 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.787 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:08.788 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052659+0000", 2024-04-18T21:06:08.788 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5653999999999999e-05 2024-04-18T21:06:08.788 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:08.788 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:08.788 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:08.788 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.788 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.788 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:08.788 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:08.788 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 73.740562564000001, 2024-04-18T21:06:08.788 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024516458000000001, 2024-04-18T21:06:08.788 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:08.788 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:08.788 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.788 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:08.789 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:08.789 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:08.789 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 165 2024-04-18T21:06:08.789 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.789 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:08.789 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.789 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:08.789 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:08.789 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:08.789 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.789 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.789 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:08.789 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:08.789 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:08.790 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.790 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.790 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:08.790 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028918+0000", 2024-04-18T21:06:08.790 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8000000000000005e-07 2024-04-18T21:06:08.790 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.790 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.790 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:08.790 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028924+0000", 2024-04-18T21:06:08.790 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5659999999999997e-06 2024-04-18T21:06:08.790 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.790 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.790 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:08.791 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028933+0000", 2024-04-18T21:06:08.791 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.38e-06 2024-04-18T21:06:08.791 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.791 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.791 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.791 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028940+0000", 2024-04-18T21:06:08.791 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0060000000000003e-06 2024-04-18T21:06:08.791 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.791 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.791 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:08.791 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.050846+0000", 2024-04-18T21:06:08.791 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021906119000000002 2024-04-18T21:06:08.791 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.791 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.791 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:08.792 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051025+0000", 2024-04-18T21:06:08.792 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017850799999999999 2024-04-18T21:06:08.792 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.792 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.792 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:08.792 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051221+0000", 2024-04-18T21:06:08.792 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019608700000000001 2024-04-18T21:06:08.792 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.792 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.792 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:08.792 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052675+0000", 2024-04-18T21:06:08.792 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0014537899999999999 2024-04-18T21:06:08.792 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.793 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.793 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:08.793 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053311+0000", 2024-04-18T21:06:08.793 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00063613299999999999 2024-04-18T21:06:08.793 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.793 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.793 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:08.793 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053381+0000", 2024-04-18T21:06:08.793 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0074999999999996e-05 2024-04-18T21:06:08.793 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.793 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.793 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:08.793 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053434+0000", 2024-04-18T21:06:08.793 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3013999999999998e-05 2024-04-18T21:06:08.793 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:08.794 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:08.794 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:08.794 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.794 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.794 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:08.794 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:08.794 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 73.627257084999997, 2024-04-18T21:06:08.794 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023772793, 2024-04-18T21:06:08.794 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:08.794 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:08.794 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.795 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:08.795 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:08.795 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:08.795 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 187 2024-04-18T21:06:08.795 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.795 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:08.795 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.795 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:08.795 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:08.795 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:08.795 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.795 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.795 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:08.795 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:08.796 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:08.796 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.796 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.796 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:08.796 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142224+0000", 2024-04-18T21:06:08.796 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.47e-07 2024-04-18T21:06:08.796 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.796 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.796 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:08.796 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142233+0000", 2024-04-18T21:06:08.796 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0729999999999994e-06 2024-04-18T21:06:08.796 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.796 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.796 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:08.796 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142255+0000", 2024-04-18T21:06:08.797 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.2535999999999999e-05 2024-04-18T21:06:08.797 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.797 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.797 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.797 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142268+0000", 2024-04-18T21:06:08.797 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2686e-05 2024-04-18T21:06:08.797 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.797 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.797 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:08.797 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160497+0000", 2024-04-18T21:06:08.797 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018228779000000001 2024-04-18T21:06:08.797 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.797 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.797 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:08.798 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160634+0000", 2024-04-18T21:06:08.798 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000137315 2024-04-18T21:06:08.798 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.798 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.798 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:08.798 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160831+0000", 2024-04-18T21:06:08.798 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019683100000000001 2024-04-18T21:06:08.798 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.798 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.798 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:08.798 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165129+0000", 2024-04-18T21:06:08.798 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0042981299999999998 2024-04-18T21:06:08.798 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.799 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.799 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:08.799 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165776+0000", 2024-04-18T21:06:08.799 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00064702900000000003 2024-04-18T21:06:08.799 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.799 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.799 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:08.799 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165921+0000", 2024-04-18T21:06:08.799 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014506 2024-04-18T21:06:08.799 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.799 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.799 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:08.800 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165996+0000", 2024-04-18T21:06:08.800 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.4406999999999994e-05 2024-04-18T21:06:08.800 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:08.800 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:08.800 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:08.800 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.800 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.800 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:08.800 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:08.800 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 73.627196487000006, 2024-04-18T21:06:08.800 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026802157, 2024-04-18T21:06:08.800 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:08.800 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:08.800 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.801 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:08.801 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:08.801 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:08.801 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 188 2024-04-18T21:06:08.801 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.801 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:08.801 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.801 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:08.801 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:08.801 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:08.801 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.801 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.801 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:08.801 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:08.801 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:08.802 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.802 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.802 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:08.802 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142284+0000", 2024-04-18T21:06:08.802 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4e-07 2024-04-18T21:06:08.802 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.802 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.802 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:08.802 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142374+0000", 2024-04-18T21:06:08.802 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0099999999999995e-05 2024-04-18T21:06:08.802 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.802 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.802 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:08.803 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142386+0000", 2024-04-18T21:06:08.803 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1770000000000001e-05 2024-04-18T21:06:08.803 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.803 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.803 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.803 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142394+0000", 2024-04-18T21:06:08.803 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.2130000000000008e-06 2024-04-18T21:06:08.803 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.803 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.804 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:08.804 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.161743+0000", 2024-04-18T21:06:08.804 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019348644000000002 2024-04-18T21:06:08.804 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.804 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.804 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:08.804 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.161865+0000", 2024-04-18T21:06:08.804 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012210899999999999 2024-04-18T21:06:08.804 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.804 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.804 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:08.804 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.162055+0000", 2024-04-18T21:06:08.804 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000189994 2024-04-18T21:06:08.804 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.805 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.805 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:08.805 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165735+0000", 2024-04-18T21:06:08.805 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0036803270000000002 2024-04-18T21:06:08.805 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.805 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.805 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:08.805 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.168911+0000", 2024-04-18T21:06:08.805 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0031753689999999999 2024-04-18T21:06:08.805 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.805 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.805 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:08.805 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169012+0000", 2024-04-18T21:06:08.805 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010157699999999999 2024-04-18T21:06:08.806 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.806 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.806 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:08.806 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169086+0000", 2024-04-18T21:06:08.806 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3213999999999994e-05 2024-04-18T21:06:08.806 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:08.806 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:08.806 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:08.806 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.806 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.806 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:08.806 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:08.807 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 73.627071181000005, 2024-04-18T21:06:08.807 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026811423000000001, 2024-04-18T21:06:08.807 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:08.807 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:08.807 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.807 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:08.807 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:08.807 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:08.807 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 189 2024-04-18T21:06:08.807 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.807 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:08.807 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.807 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:08.807 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:08.808 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:08.808 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.808 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.808 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:08.808 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:08.808 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:08.808 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.808 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.808 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:08.808 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142410+0000", 2024-04-18T21:06:08.808 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:06:08.808 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.808 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.808 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:08.809 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142415+0000", 2024-04-18T21:06:08.809 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.7939999999999999e-06 2024-04-18T21:06:08.809 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.809 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.809 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:08.809 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142470+0000", 2024-04-18T21:06:08.809 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4537999999999999e-05 2024-04-18T21:06:08.809 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.809 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.809 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.809 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142481+0000", 2024-04-18T21:06:08.809 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0966e-05 2024-04-18T21:06:08.809 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.810 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.810 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:08.810 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.163493+0000", 2024-04-18T21:06:08.810 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021012444000000002 2024-04-18T21:06:08.810 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.810 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.810 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:08.810 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.163727+0000", 2024-04-18T21:06:08.810 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000233339 2024-04-18T21:06:08.810 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.810 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.810 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:08.810 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.164102+0000", 2024-04-18T21:06:08.810 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000374872 2024-04-18T21:06:08.811 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.811 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.811 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:08.811 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.166528+0000", 2024-04-18T21:06:08.811 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0024258729999999998 2024-04-18T21:06:08.811 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.811 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.811 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:08.811 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169101+0000", 2024-04-18T21:06:08.811 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0025737680000000001 2024-04-18T21:06:08.811 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.811 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.812 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:08.812 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169171+0000", 2024-04-18T21:06:08.812 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0148000000000007e-05 2024-04-18T21:06:08.812 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.812 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.812 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:08.812 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169220+0000", 2024-04-18T21:06:08.812 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8767999999999998e-05 2024-04-18T21:06:08.812 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:08.812 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:08.812 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:08.812 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.812 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.813 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:08.813 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:08.813 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 63.153498628999998, 2024-04-18T21:06:08.813 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024082777999999999, 2024-04-18T21:06:08.813 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:08.813 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:08.813 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.813 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:08.813 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.813 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:08.813 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:08.813 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:08.813 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.813 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.814 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:08.814 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:08.814 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:08.814 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.814 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.814 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:08.814 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615984+0000", 2024-04-18T21:06:08.814 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.9869999999999999e-06 2024-04-18T21:06:08.814 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.814 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.814 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:08.814 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615999+0000", 2024-04-18T21:06:08.814 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4646e-05 2024-04-18T21:06:08.814 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.815 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.815 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:08.815 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616028+0000", 2024-04-18T21:06:08.815 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8952999999999999e-05 2024-04-18T21:06:08.815 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.815 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.815 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.815 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616052+0000", 2024-04-18T21:06:08.815 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.3941999999999999e-05 2024-04-18T21:06:08.815 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.815 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.815 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:08.815 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618010+0000", 2024-04-18T21:06:08.815 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0019581780000000001 2024-04-18T21:06:08.815 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.816 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.816 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:08.816 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618322+0000", 2024-04-18T21:06:08.816 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00031158899999999997 2024-04-18T21:06:08.816 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.816 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.816 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:08.816 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618587+0000", 2024-04-18T21:06:08.816 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00026495700000000002 2024-04-18T21:06:08.816 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.816 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.816 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:08.816 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629262+0000", 2024-04-18T21:06:08.816 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010675877 2024-04-18T21:06:08.817 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.817 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.817 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:08.817 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.639773+0000", 2024-04-18T21:06:08.817 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0105109 2024-04-18T21:06:08.817 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.817 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.817 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:08.817 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.639926+0000", 2024-04-18T21:06:08.817 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000152349 2024-04-18T21:06:08.817 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.817 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.817 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:08.817 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640064+0000", 2024-04-18T21:06:08.817 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0001384 2024-04-18T21:06:08.818 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:08.818 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:08.818 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:08.818 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.818 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.818 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:08.818 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:08.818 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 63.153385954999997, 2024-04-18T21:06:08.818 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030215005999999999, 2024-04-18T21:06:08.818 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:08.818 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:08.818 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.818 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:08.819 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.819 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:08.819 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:08.819 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:08.819 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.819 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.819 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:08.819 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:08.819 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:08.819 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.819 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.819 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:08.819 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616095+0000", 2024-04-18T21:06:08.819 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.446e-06 2024-04-18T21:06:08.820 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.820 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.820 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:08.820 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616104+0000", 2024-04-18T21:06:08.820 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6200000000000005e-06 2024-04-18T21:06:08.820 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.820 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.820 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:08.820 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616132+0000", 2024-04-18T21:06:08.820 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7668999999999999e-05 2024-04-18T21:06:08.820 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.820 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.820 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.820 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616149+0000", 2024-04-18T21:06:08.821 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7047000000000001e-05 2024-04-18T21:06:08.821 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.821 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.821 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:08.821 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619287+0000", 2024-04-18T21:06:08.821 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0031381450000000002 2024-04-18T21:06:08.821 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.821 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.821 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:08.821 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619503+0000", 2024-04-18T21:06:08.821 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000216522 2024-04-18T21:06:08.821 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.821 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.821 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:08.821 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619930+0000", 2024-04-18T21:06:08.822 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00042604900000000001 2024-04-18T21:06:08.822 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.822 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.822 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:08.822 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629281+0000", 2024-04-18T21:06:08.822 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0093512230000000005 2024-04-18T21:06:08.822 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.822 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.822 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:08.822 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646022+0000", 2024-04-18T21:06:08.822 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016741156 2024-04-18T21:06:08.822 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.822 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.823 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:08.823 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646198+0000", 2024-04-18T21:06:08.823 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000176009 2024-04-18T21:06:08.823 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.823 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.823 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:08.823 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646309+0000", 2024-04-18T21:06:08.823 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011112000000000001 2024-04-18T21:06:08.823 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:08.823 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:08.823 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:08.823 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.823 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.823 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:08.823 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:08.824 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 63.153301130999999, 2024-04-18T21:06:08.824 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030501176000000001, 2024-04-18T21:06:08.824 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:08.824 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:08.824 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.824 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:08.824 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.824 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:08.824 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:08.824 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:08.824 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.824 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.824 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:08.824 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:08.825 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:08.825 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.825 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.825 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:08.825 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616180+0000", 2024-04-18T21:06:08.825 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1000000000000001e-06 2024-04-18T21:06:08.825 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.825 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.825 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:08.825 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616188+0000", 2024-04-18T21:06:08.825 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4069999999999993e-06 2024-04-18T21:06:08.825 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.825 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.825 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:08.825 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616207+0000", 2024-04-18T21:06:08.826 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8335999999999999e-05 2024-04-18T21:06:08.826 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.826 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.826 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.826 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616225+0000", 2024-04-18T21:06:08.826 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8652999999999999e-05 2024-04-18T21:06:08.826 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.826 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.826 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:08.826 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620977+0000", 2024-04-18T21:06:08.826 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047512220000000003 2024-04-18T21:06:08.826 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.826 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.827 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:08.827 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621279+0000", 2024-04-18T21:06:08.827 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000302646 2024-04-18T21:06:08.827 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.827 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.827 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:08.827 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621584+0000", 2024-04-18T21:06:08.827 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000305142 2024-04-18T21:06:08.827 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.827 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.827 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:08.827 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629352+0000", 2024-04-18T21:06:08.827 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0077673689999999997 2024-04-18T21:06:08.827 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.828 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.828 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:08.828 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646480+0000", 2024-04-18T21:06:08.828 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017128259 2024-04-18T21:06:08.828 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.828 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.828 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:08.828 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646591+0000", 2024-04-18T21:06:08.828 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011113899999999999 2024-04-18T21:06:08.828 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.828 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.828 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:08.828 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646680+0000", 2024-04-18T21:06:08.828 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8902999999999999e-05 2024-04-18T21:06:08.828 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:08.829 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:08.829 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:08.829 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.829 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.829 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:08.829 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:08.829 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 63.153234632, 2024-04-18T21:06:08.829 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030779760999999999, 2024-04-18T21:06:08.829 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:08.829 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:08.829 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.829 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:08.829 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.829 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:08.829 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:08.830 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:08.830 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.830 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.830 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:08.830 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:08.830 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:08.830 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.830 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.830 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:08.830 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616246+0000", 2024-04-18T21:06:08.830 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0499999999999999e-06 2024-04-18T21:06:08.830 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.830 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.831 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:08.831 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616253+0000", 2024-04-18T21:06:08.831 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.5989999999999998e-06 2024-04-18T21:06:08.831 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.831 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.831 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:08.831 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616273+0000", 2024-04-18T21:06:08.831 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9916999999999999e-05 2024-04-18T21:06:08.831 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.831 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.831 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.831 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616287+0000", 2024-04-18T21:06:08.831 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3669000000000001e-05 2024-04-18T21:06:08.831 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.831 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.832 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:08.832 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622203+0000", 2024-04-18T21:06:08.832 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.005916737 2024-04-18T21:06:08.832 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.832 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.832 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:08.832 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622379+0000", 2024-04-18T21:06:08.832 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000175596 2024-04-18T21:06:08.832 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.832 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.832 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:08.832 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622707+0000", 2024-04-18T21:06:08.832 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00032784600000000002 2024-04-18T21:06:08.832 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.833 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.833 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:08.833 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629366+0000", 2024-04-18T21:06:08.833 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0066593279999999999 2024-04-18T21:06:08.833 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.833 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.833 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:08.833 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646813+0000", 2024-04-18T21:06:08.833 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017447059000000001 2024-04-18T21:06:08.833 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.833 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.833 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:08.833 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646946+0000", 2024-04-18T21:06:08.833 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013301200000000001 2024-04-18T21:06:08.833 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.833 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.834 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:08.834 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647025+0000", 2024-04-18T21:06:08.834 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8948000000000004e-05 2024-04-18T21:06:08.834 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:08.834 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:08.834 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:08.834 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.834 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.834 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:08.834 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:08.834 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 63.153150814, 2024-04-18T21:06:08.834 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.031512165000000002, 2024-04-18T21:06:08.834 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:08.834 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:08.835 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.835 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:08.835 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.835 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:08.835 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:08.835 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:08.835 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.835 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.835 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:08.835 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:08.835 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:08.835 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.835 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.835 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:08.836 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616330+0000", 2024-04-18T21:06:08.836 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.15e-06 2024-04-18T21:06:08.836 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.836 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.836 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:08.836 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616337+0000", 2024-04-18T21:06:08.836 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.1289999999999998e-06 2024-04-18T21:06:08.836 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.836 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.836 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:08.836 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616447+0000", 2024-04-18T21:06:08.836 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109561 2024-04-18T21:06:08.836 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.836 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.836 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.837 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616496+0000", 2024-04-18T21:06:08.837 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8591999999999998e-05 2024-04-18T21:06:08.837 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.837 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.837 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:08.837 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.623786+0000", 2024-04-18T21:06:08.837 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0072906799999999999 2024-04-18T21:06:08.837 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.837 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.837 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:08.837 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.623973+0000", 2024-04-18T21:06:08.837 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018717199999999999 2024-04-18T21:06:08.837 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.837 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.838 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:08.838 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624260+0000", 2024-04-18T21:06:08.838 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00028630600000000001 2024-04-18T21:06:08.838 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.838 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.838 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:08.838 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629381+0000", 2024-04-18T21:06:08.838 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0051211340000000003 2024-04-18T21:06:08.838 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.838 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.838 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:08.838 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647631+0000", 2024-04-18T21:06:08.838 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018249771000000001 2024-04-18T21:06:08.838 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.839 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.839 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:08.839 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647761+0000", 2024-04-18T21:06:08.839 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013037300000000001 2024-04-18T21:06:08.839 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.839 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.839 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:08.839 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647841+0000", 2024-04-18T21:06:08.839 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.0296999999999994e-05 2024-04-18T21:06:08.839 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:08.839 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:08.839 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:08.839 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.839 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.840 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:08.840 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:08.840 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 63.152945330000001, 2024-04-18T21:06:08.840 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043251955000000002, 2024-04-18T21:06:08.840 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:08.840 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:08.840 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.840 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:08.840 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.840 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:08.840 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:08.840 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:08.840 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.840 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.841 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:08.841 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:08.841 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:08.841 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.841 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.841 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:08.841 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616536+0000", 2024-04-18T21:06:08.841 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2869999999999999e-06 2024-04-18T21:06:08.841 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.841 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.841 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:08.841 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616572+0000", 2024-04-18T21:06:08.841 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.6261999999999999e-05 2024-04-18T21:06:08.841 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.842 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.842 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:08.842 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616593+0000", 2024-04-18T21:06:08.842 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1310000000000001e-05 2024-04-18T21:06:08.842 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.842 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.842 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.842 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616614+0000", 2024-04-18T21:06:08.842 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.0936000000000001e-05 2024-04-18T21:06:08.842 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.842 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.842 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:08.842 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629501+0000", 2024-04-18T21:06:08.843 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.012886819000000001 2024-04-18T21:06:08.843 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.843 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.843 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:08.843 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629696+0000", 2024-04-18T21:06:08.843 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019485499999999999 2024-04-18T21:06:08.843 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.843 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.843 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:08.843 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629940+0000", 2024-04-18T21:06:08.843 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00024386399999999999 2024-04-18T21:06:08.843 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.843 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.843 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:08.843 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640100+0000", 2024-04-18T21:06:08.844 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010159645 2024-04-18T21:06:08.844 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.844 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.844 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:08.844 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659516+0000", 2024-04-18T21:06:08.844 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019416563000000001 2024-04-18T21:06:08.844 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.844 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.844 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:08.844 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659684+0000", 2024-04-18T21:06:08.844 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016750900000000001 2024-04-18T21:06:08.844 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.844 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.844 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:08.844 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659787+0000", 2024-04-18T21:06:08.845 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000102905 2024-04-18T21:06:08.845 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:08.845 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:08.845 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:08.845 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.845 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.845 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:08.845 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:08.845 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 63.152840208000001, 2024-04-18T21:06:08.845 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043581898000000001, 2024-04-18T21:06:08.845 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:08.845 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:08.845 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.845 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:08.845 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.845 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:08.846 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:08.846 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:08.846 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.846 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.846 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:08.846 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:08.846 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:08.846 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.846 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.846 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:08.846 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616641+0000", 2024-04-18T21:06:08.846 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:06:08.846 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.846 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.847 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:08.847 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616648+0000", 2024-04-18T21:06:08.847 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3860000000000001e-06 2024-04-18T21:06:08.847 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.847 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.847 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:08.847 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616666+0000", 2024-04-18T21:06:08.847 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7583000000000001e-05 2024-04-18T21:06:08.847 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.847 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.847 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.847 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616679+0000", 2024-04-18T21:06:08.847 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3322999999999999e-05 2024-04-18T21:06:08.847 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.847 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.848 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:08.848 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630373+0000", 2024-04-18T21:06:08.848 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013694207999999999 2024-04-18T21:06:08.848 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.848 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.848 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:08.848 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630545+0000", 2024-04-18T21:06:08.848 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000171683 2024-04-18T21:06:08.848 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.848 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.848 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:08.848 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630728+0000", 2024-04-18T21:06:08.848 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000182599 2024-04-18T21:06:08.848 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.848 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.849 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:08.849 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640600+0000", 2024-04-18T21:06:08.849 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0098726119999999994 2024-04-18T21:06:08.849 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.849 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.849 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:08.849 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659927+0000", 2024-04-18T21:06:08.849 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019326724999999999 2024-04-18T21:06:08.849 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.849 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.849 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:08.849 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660112+0000", 2024-04-18T21:06:08.849 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000185203 2024-04-18T21:06:08.849 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.849 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.850 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:08.850 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660222+0000", 2024-04-18T21:06:08.850 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109343 2024-04-18T21:06:08.850 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:08.850 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:08.850 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:08.850 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.850 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.850 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:08.850 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:08.850 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 63.151974850000002, 2024-04-18T21:06:08.850 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043121310000000003, 2024-04-18T21:06:08.850 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:08.850 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:08.851 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.851 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:08.851 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.851 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:08.851 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:08.851 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:08.851 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.851 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.851 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:08.851 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:08.851 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:08.851 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.851 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.851 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:08.851 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617506+0000", 2024-04-18T21:06:08.852 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9999999999999995e-07 2024-04-18T21:06:08.852 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.852 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.852 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:08.852 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617513+0000", 2024-04-18T21:06:08.852 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.9700000000000002e-06 2024-04-18T21:06:08.852 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.852 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.852 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:08.852 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617531+0000", 2024-04-18T21:06:08.852 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8105999999999999e-05 2024-04-18T21:06:08.852 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.852 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.853 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.853 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617545+0000", 2024-04-18T21:06:08.853 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3703000000000001e-05 2024-04-18T21:06:08.853 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.853 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.853 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:08.853 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632129+0000", 2024-04-18T21:06:08.853 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.014584135999999999 2024-04-18T21:06:08.853 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.853 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.853 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:08.853 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632361+0000", 2024-04-18T21:06:08.853 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023171800000000001 2024-04-18T21:06:08.853 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.854 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.854 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:08.854 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632804+0000", 2024-04-18T21:06:08.854 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000443549 2024-04-18T21:06:08.854 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.854 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.854 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:08.854 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646340+0000", 2024-04-18T21:06:08.854 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013535902000000001 2024-04-18T21:06:08.854 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.854 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.854 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:08.855 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660363+0000", 2024-04-18T21:06:08.855 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01402318 2024-04-18T21:06:08.855 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.855 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.855 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:08.855 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660523+0000", 2024-04-18T21:06:08.855 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00015989899999999999 2024-04-18T21:06:08.855 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.855 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.855 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:08.855 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660626+0000", 2024-04-18T21:06:08.855 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010314699999999999 2024-04-18T21:06:08.855 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:08.855 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:08.855 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:08.856 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.856 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.856 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:08.856 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:08.856 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 63.151835157000001, 2024-04-18T21:06:08.856 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024927483, 2024-04-18T21:06:08.856 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:08.856 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:08.856 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.856 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:08.856 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.856 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:08.856 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:08.856 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:08.857 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.857 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.857 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:08.857 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:08.857 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:08.857 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.857 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.857 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:08.857 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617646+0000", 2024-04-18T21:06:08.857 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3030000000000001e-06 2024-04-18T21:06:08.857 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.857 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.857 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:08.857 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617653+0000", 2024-04-18T21:06:08.857 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7530000000000004e-06 2024-04-18T21:06:08.858 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.858 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.858 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:08.858 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617673+0000", 2024-04-18T21:06:08.858 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9967e-05 2024-04-18T21:06:08.858 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.858 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.858 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.858 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617688+0000", 2024-04-18T21:06:08.858 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5153e-05 2024-04-18T21:06:08.858 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.858 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.858 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:08.858 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619244+0000", 2024-04-18T21:06:08.859 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001555531 2024-04-18T21:06:08.859 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.859 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.859 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:08.859 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619361+0000", 2024-04-18T21:06:08.859 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011784400000000001 2024-04-18T21:06:08.859 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.859 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.859 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:08.859 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619604+0000", 2024-04-18T21:06:08.859 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000243007 2024-04-18T21:06:08.859 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.859 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.859 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:08.859 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.625480+0000", 2024-04-18T21:06:08.860 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0058759349999999997 2024-04-18T21:06:08.860 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.860 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.860 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:08.860 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642342+0000", 2024-04-18T21:06:08.860 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016861373999999998 2024-04-18T21:06:08.860 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.860 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.860 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:08.860 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642484+0000", 2024-04-18T21:06:08.860 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000142423 2024-04-18T21:06:08.860 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.860 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.860 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:08.860 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642572+0000", 2024-04-18T21:06:08.861 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8193000000000001e-05 2024-04-18T21:06:08.861 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:08.861 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:08.861 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:08.861 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.861 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.861 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:08.861 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:08.861 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 63.151553653999997, 2024-04-18T21:06:08.861 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024956974999999999, 2024-04-18T21:06:08.861 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:08.861 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:08.861 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.861 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:08.861 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.862 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:08.862 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:08.862 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:08.862 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.862 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.862 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:08.862 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:08.862 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:08.862 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.862 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.862 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:08.862 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617928+0000", 2024-04-18T21:06:08.862 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5430000000000001e-06 2024-04-18T21:06:08.862 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.862 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.863 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:08.863 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617937+0000", 2024-04-18T21:06:08.863 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6629999999999999e-06 2024-04-18T21:06:08.863 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.863 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.863 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:08.863 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617955+0000", 2024-04-18T21:06:08.863 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8749999999999998e-05 2024-04-18T21:06:08.863 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.863 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.863 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.863 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617971+0000", 2024-04-18T21:06:08.863 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.605e-05 2024-04-18T21:06:08.863 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.864 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.864 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:08.864 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621019+0000", 2024-04-18T21:06:08.864 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0030472369999999999 2024-04-18T21:06:08.864 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.864 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.864 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:08.864 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621249+0000", 2024-04-18T21:06:08.864 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000230075 2024-04-18T21:06:08.864 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.864 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.864 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:08.864 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621450+0000", 2024-04-18T21:06:08.864 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020166499999999999 2024-04-18T21:06:08.864 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.865 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.865 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:08.865 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.626233+0000", 2024-04-18T21:06:08.865 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047827390000000003 2024-04-18T21:06:08.865 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.865 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.865 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:08.865 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642693+0000", 2024-04-18T21:06:08.865 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01645961 2024-04-18T21:06:08.865 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.865 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.865 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:08.865 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642798+0000", 2024-04-18T21:06:08.866 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010559499999999999 2024-04-18T21:06:08.866 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.866 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.866 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:08.866 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642883+0000", 2024-04-18T21:06:08.866 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5048000000000003e-05 2024-04-18T21:06:08.866 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:08.866 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:08.866 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:08.866 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.866 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.866 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:08.866 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:08.867 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 63.149858025999997, 2024-04-18T21:06:08.867 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024086478000000001, 2024-04-18T21:06:08.867 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:08.867 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:08.867 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.867 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:08.867 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.867 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:08.867 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:08.867 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:08.867 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.867 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.867 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:08.867 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:08.867 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:08.868 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.868 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.868 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:08.868 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619624+0000", 2024-04-18T21:06:08.868 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.75e-06 2024-04-18T21:06:08.868 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.868 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.868 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:08.868 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619637+0000", 2024-04-18T21:06:08.868 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3540000000000001e-05 2024-04-18T21:06:08.868 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.868 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.868 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:08.868 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619666+0000", 2024-04-18T21:06:08.869 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8685999999999999e-05 2024-04-18T21:06:08.869 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.869 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.869 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.869 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619685+0000", 2024-04-18T21:06:08.869 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8681999999999998e-05 2024-04-18T21:06:08.869 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.869 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.869 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:08.869 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622275+0000", 2024-04-18T21:06:08.869 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0025899260000000002 2024-04-18T21:06:08.869 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.869 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.869 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:08.870 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622572+0000", 2024-04-18T21:06:08.870 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00029722 2024-04-18T21:06:08.870 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.870 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.870 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:08.870 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622752+0000", 2024-04-18T21:06:08.870 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018065900000000001 2024-04-18T21:06:08.870 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.870 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.870 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:08.870 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.626326+0000", 2024-04-18T21:06:08.870 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035737310000000001 2024-04-18T21:06:08.870 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.870 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.871 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:08.871 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643565+0000", 2024-04-18T21:06:08.871 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017238430999999999 2024-04-18T21:06:08.871 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.871 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.871 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:08.871 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643646+0000", 2024-04-18T21:06:08.871 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.1481000000000001e-05 2024-04-18T21:06:08.871 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.871 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.871 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:08.871 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643708+0000", 2024-04-18T21:06:08.871 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.2372000000000005e-05 2024-04-18T21:06:08.871 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:08.871 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:08.871 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:08.872 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.872 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.872 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:08.872 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:08.872 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 63.149691873000002, 2024-04-18T21:06:08.872 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026822450000000001, 2024-04-18T21:06:08.872 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:08.872 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:08.872 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:08.872 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:08.872 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.872 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:08.872 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:08.872 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:08.872 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.873 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.873 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:08.873 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:08.873 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:08.873 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.873 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.873 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:08.873 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619789+0000", 2024-04-18T21:06:08.873 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:06:08.873 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.873 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.873 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:08.873 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619797+0000", 2024-04-18T21:06:08.873 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.6899999999999992e-06 2024-04-18T21:06:08.874 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.874 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.874 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:08.874 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619816+0000", 2024-04-18T21:06:08.874 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9352999999999999e-05 2024-04-18T21:06:08.874 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.874 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.874 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.874 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619832+0000", 2024-04-18T21:06:08.874 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6013000000000001e-05 2024-04-18T21:06:08.874 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.874 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.874 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:08.874 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620528+0000", 2024-04-18T21:06:08.874 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00069565600000000001 2024-04-18T21:06:08.874 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.875 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.875 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:08.875 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620735+0000", 2024-04-18T21:06:08.875 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000207025 2024-04-18T21:06:08.875 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.875 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.875 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:08.875 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620912+0000", 2024-04-18T21:06:08.875 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017748199999999999 2024-04-18T21:06:08.875 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.875 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.875 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:08.875 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.625605+0000", 2024-04-18T21:06:08.875 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0046924439999999996 2024-04-18T21:06:08.876 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.876 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.876 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:08.876 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646349+0000", 2024-04-18T21:06:08.876 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.020744318000000001 2024-04-18T21:06:08.876 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.876 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.876 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:08.876 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646483+0000", 2024-04-18T21:06:08.876 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013428999999999999 2024-04-18T21:06:08.876 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.876 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.876 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:08.876 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646611+0000", 2024-04-18T21:06:08.876 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012710299999999999 2024-04-18T21:06:08.877 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:08.877 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:08.877 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:08.877 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.877 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.877 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:08.877 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:06:08.877 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 63.149021439999999, 2024-04-18T21:06:08.877 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023516516000000001, 2024-04-18T21:06:08.877 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:08.877 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:08.877 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:06:08.877 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:08.877 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.877 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:08.878 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:06:08.878 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:08.878 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.878 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.878 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:08.878 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:06:08.878 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:08.878 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.878 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.878 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:08.878 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620460+0000", 2024-04-18T21:06:08.878 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.787e-06 2024-04-18T21:06:08.878 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.878 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.879 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:08.879 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620470+0000", 2024-04-18T21:06:08.879 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.2560000000000008e-06 2024-04-18T21:06:08.879 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.879 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.879 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:08.879 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620496+0000", 2024-04-18T21:06:08.879 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.6205999999999999e-05 2024-04-18T21:06:08.879 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.879 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.879 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:08.879 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620517+0000", 2024-04-18T21:06:08.879 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1223e-05 2024-04-18T21:06:08.879 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.879 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.879 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:08.880 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624060+0000", 2024-04-18T21:06:08.880 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035434160000000002 2024-04-18T21:06:08.880 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.880 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.880 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:08.880 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624390+0000", 2024-04-18T21:06:08.880 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00033000500000000002 2024-04-18T21:06:08.880 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:08.880 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:08.880 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:08.880 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643975+0000", 2024-04-18T21:06:08.880 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019584622999999999 2024-04-18T21:06:08.880 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:08.880 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:08.880 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:08.880 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:08.881 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:08.881 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:08.881 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:08.771+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:08.882 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:08.883 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:08.882+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:08.983 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:08.983+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:09.015 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:06:09.015 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [], 2024-04-18T21:06:09.016 INFO:teuthology.orchestra.run.smithi150.stdout: "num_ops": 0 2024-04-18T21:06:09.016 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:06:09.031 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:09.117 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:09.119+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:09.121 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-18T21:06:09.185 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:09.183+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:09.195 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:06:09.195 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [], 2024-04-18T21:06:09.196 INFO:teuthology.orchestra.run.smithi150.stdout: "complaint_time": 30, 2024-04-18T21:06:09.196 INFO:teuthology.orchestra.run.smithi150.stdout: "num_blocked_ops": 0 2024-04-18T21:06:09.196 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:06:09.210 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:09.285 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:09.286+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:09.375 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:06:09.375 INFO:teuthology.orchestra.run.smithi150.stdout: "size": 20, 2024-04-18T21:06:09.375 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 600, 2024-04-18T21:06:09.375 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [ 2024-04-18T21:06:09.375 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.375 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-18T21:06:09.375 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:06:09.376 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 74.572194417999995, 2024-04-18T21:06:09.376 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0093051590000000003, 2024-04-18T21:06:09.376 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:09.376 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:09.376 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:09.376 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:09.376 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.376 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:09.376 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:06:09.376 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:09.376 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.376 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.376 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:09.377 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:06:09.377 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:09.377 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.377 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.377 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:09.377 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804851+0000", 2024-04-18T21:06:09.377 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7039999999999999e-06 2024-04-18T21:06:09.377 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.377 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.377 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:09.377 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804864+0000", 2024-04-18T21:06:09.377 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.276e-05 2024-04-18T21:06:09.377 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.378 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.378 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:09.378 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804895+0000", 2024-04-18T21:06:09.378 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.1204999999999997e-05 2024-04-18T21:06:09.378 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.378 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.378 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:09.378 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804908+0000", 2024-04-18T21:06:09.378 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3317e-05 2024-04-18T21:06:09.378 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.378 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.378 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:09.378 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805131+0000", 2024-04-18T21:06:09.379 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00022246700000000001 2024-04-18T21:06:09.379 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.379 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.379 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:09.379 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805171+0000", 2024-04-18T21:06:09.379 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.0164999999999999e-05 2024-04-18T21:06:09.379 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.379 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.379 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:09.379 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814086+0000", 2024-04-18T21:06:09.379 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0089155329999999998 2024-04-18T21:06:09.379 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.379 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.379 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:09.380 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814154+0000", 2024-04-18T21:06:09.380 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.8008000000000003e-05 2024-04-18T21:06:09.380 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:09.380 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:09.380 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:09.380 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.380 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.380 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-18T21:06:09.380 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:06:09.380 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 74.571429225000003, 2024-04-18T21:06:09.380 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0086469770000000001, 2024-04-18T21:06:09.380 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:09.380 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:09.381 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:09.381 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:09.381 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.381 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:09.381 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:06:09.381 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:09.381 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.381 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.381 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:09.381 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:06:09.381 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:09.381 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.381 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.381 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:09.382 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805616+0000", 2024-04-18T21:06:09.382 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7799999999999999e-06 2024-04-18T21:06:09.382 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.382 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.382 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:09.382 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805707+0000", 2024-04-18T21:06:09.382 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0917999999999999e-05 2024-04-18T21:06:09.382 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.382 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.382 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:09.382 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805739+0000", 2024-04-18T21:06:09.382 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.2512000000000003e-05 2024-04-18T21:06:09.382 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.383 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.383 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:09.383 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805763+0000", 2024-04-18T21:06:09.383 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3266000000000001e-05 2024-04-18T21:06:09.383 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.383 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.383 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:09.383 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.806024+0000", 2024-04-18T21:06:09.383 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000261716 2024-04-18T21:06:09.383 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.383 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.383 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:09.383 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.806073+0000", 2024-04-18T21:06:09.383 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.8844999999999997e-05 2024-04-18T21:06:09.383 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.384 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.384 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:09.384 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814162+0000", 2024-04-18T21:06:09.384 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0080882860000000001 2024-04-18T21:06:09.384 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.384 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.384 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:09.384 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814261+0000", 2024-04-18T21:06:09.384 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.9654000000000005e-05 2024-04-18T21:06:09.384 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:09.384 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:09.384 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:09.384 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.384 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.385 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'64)", 2024-04-18T21:06:09.385 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:06:09.385 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 74.569658180999994, 2024-04-18T21:06:09.385 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0089721509999999994, 2024-04-18T21:06:09.385 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:09.385 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:09.385 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:09.385 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:09.385 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.385 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:09.385 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:06:09.385 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:09.385 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.385 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.385 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:09.386 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:06:09.386 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:09.386 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.386 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.386 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:09.386 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807387+0000", 2024-04-18T21:06:09.386 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.0329999999999998e-06 2024-04-18T21:06:09.386 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.386 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.386 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:09.386 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807443+0000", 2024-04-18T21:06:09.386 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.5376e-05 2024-04-18T21:06:09.386 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.386 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.386 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:09.387 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807467+0000", 2024-04-18T21:06:09.387 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.4621999999999999e-05 2024-04-18T21:06:09.387 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.387 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.387 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:09.387 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807482+0000", 2024-04-18T21:06:09.387 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.436e-05 2024-04-18T21:06:09.387 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.387 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.387 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:09.387 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.809243+0000", 2024-04-18T21:06:09.387 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001761725 2024-04-18T21:06:09.387 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.387 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.387 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:09.388 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.809295+0000", 2024-04-18T21:06:09.388 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.1445e-05 2024-04-18T21:06:09.388 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.388 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.388 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:09.388 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.816293+0000", 2024-04-18T21:06:09.388 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0069981749999999997 2024-04-18T21:06:09.388 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.388 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.388 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:09.388 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.816357+0000", 2024-04-18T21:06:09.388 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.4414999999999999e-05 2024-04-18T21:06:09.388 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:09.388 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:09.389 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:09.389 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.389 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.389 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:09.389 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:06:09.389 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 63.761748810999997, 2024-04-18T21:06:09.389 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.040843365, 2024-04-18T21:06:09.389 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:09.389 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:09.389 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:09.389 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:09.389 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.389 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:09.389 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:06:09.389 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:09.390 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.390 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.390 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:09.390 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:06:09.390 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:09.390 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.390 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.390 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:09.390 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615297+0000", 2024-04-18T21:06:09.390 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2800000000000002e-06 2024-04-18T21:06:09.390 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.390 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.390 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:09.391 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615308+0000", 2024-04-18T21:06:09.391 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0813e-05 2024-04-18T21:06:09.391 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.391 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.391 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:09.391 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615330+0000", 2024-04-18T21:06:09.391 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2370000000000001e-05 2024-04-18T21:06:09.391 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.391 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.391 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:09.391 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615346+0000", 2024-04-18T21:06:09.391 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6200000000000001e-05 2024-04-18T21:06:09.391 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.391 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.391 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:09.392 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615470+0000", 2024-04-18T21:06:09.392 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012385799999999999 2024-04-18T21:06:09.392 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.392 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.392 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:09.392 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615488+0000", 2024-04-18T21:06:09.392 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7923000000000001e-05 2024-04-18T21:06:09.392 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.392 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.392 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:09.392 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.630993+0000", 2024-04-18T21:06:09.392 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.01550532 2024-04-18T21:06:09.392 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.392 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.393 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:09.393 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631165+0000", 2024-04-18T21:06:09.393 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000171588 2024-04-18T21:06:09.393 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.393 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.393 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:09.393 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631320+0000", 2024-04-18T21:06:09.393 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000155162 2024-04-18T21:06:09.393 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.393 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.393 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:09.393 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635157+0000", 2024-04-18T21:06:09.393 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0038370790000000002 2024-04-18T21:06:09.394 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.394 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.394 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:09.394 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.655904+0000", 2024-04-18T21:06:09.394 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.020746483999999999 2024-04-18T21:06:09.394 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.394 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.394 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:09.394 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656032+0000", 2024-04-18T21:06:09.394 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012864199999999999 2024-04-18T21:06:09.394 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.394 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.394 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:09.394 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656138+0000", 2024-04-18T21:06:09.395 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000105646 2024-04-18T21:06:09.395 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:09.395 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:09.395 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:09.395 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.395 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.395 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:09.395 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:06:09.395 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 63.761656639000002, 2024-04-18T21:06:09.395 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.041266444999999999, 2024-04-18T21:06:09.395 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:09.395 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:09.395 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:09.395 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:09.395 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.396 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:09.396 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:06:09.396 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:09.396 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.396 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.396 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:09.396 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:06:09.396 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:09.396 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.396 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.396 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:09.396 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615388+0000", 2024-04-18T21:06:09.396 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:06:09.396 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.397 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.397 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:09.397 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:06:09.397 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.7299999999999994e-06 2024-04-18T21:06:09.397 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.397 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.397 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:09.397 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615415+0000", 2024-04-18T21:06:09.397 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7807000000000001e-05 2024-04-18T21:06:09.397 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.397 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.397 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:09.397 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615431+0000", 2024-04-18T21:06:09.397 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6127e-05 2024-04-18T21:06:09.398 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.398 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.398 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:09.398 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615621+0000", 2024-04-18T21:06:09.398 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000189781 2024-04-18T21:06:09.398 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.398 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.398 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:09.398 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615634+0000", 2024-04-18T21:06:09.398 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3383e-05 2024-04-18T21:06:09.398 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.398 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.398 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:09.399 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631703+0000", 2024-04-18T21:06:09.399 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016068737 2024-04-18T21:06:09.399 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.399 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.399 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:09.399 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631809+0000", 2024-04-18T21:06:09.399 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000106823 2024-04-18T21:06:09.399 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.399 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.399 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:09.399 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631988+0000", 2024-04-18T21:06:09.399 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000179008 2024-04-18T21:06:09.399 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.400 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.400 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:09.400 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635172+0000", 2024-04-18T21:06:09.400 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.003183029 2024-04-18T21:06:09.400 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.400 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.400 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:09.400 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656392+0000", 2024-04-18T21:06:09.400 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.021220638999999999 2024-04-18T21:06:09.400 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.400 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.400 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:09.400 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656533+0000", 2024-04-18T21:06:09.400 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014126500000000001 2024-04-18T21:06:09.400 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.401 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.401 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:09.401 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656653+0000", 2024-04-18T21:06:09.401 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000119883 2024-04-18T21:06:09.401 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:09.401 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:09.401 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:09.401 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.401 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.401 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:09.401 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:06:09.401 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 63.761569215999998, 2024-04-18T21:06:09.401 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.042492302000000003, 2024-04-18T21:06:09.401 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:09.401 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:09.402 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:09.402 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:09.402 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.402 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:09.402 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:06:09.402 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:09.402 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.402 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.402 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:09.402 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:06:09.402 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:09.402 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.402 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.403 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:09.403 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615475+0000", 2024-04-18T21:06:09.403 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.17e-06 2024-04-18T21:06:09.403 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.403 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.403 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:09.403 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615528+0000", 2024-04-18T21:06:09.403 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.2159e-05 2024-04-18T21:06:09.403 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.403 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.403 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:09.403 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615542+0000", 2024-04-18T21:06:09.403 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4197e-05 2024-04-18T21:06:09.403 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.403 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.404 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:09.404 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615559+0000", 2024-04-18T21:06:09.404 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.749e-05 2024-04-18T21:06:09.404 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.404 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.404 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:09.404 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615685+0000", 2024-04-18T21:06:09.404 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012617499999999999 2024-04-18T21:06:09.404 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.404 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.404 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:09.404 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:06:09.404 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4749999999999999e-05 2024-04-18T21:06:09.404 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.405 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.405 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:09.405 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632332+0000", 2024-04-18T21:06:09.405 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016631988 2024-04-18T21:06:09.405 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.405 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.405 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:09.405 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632477+0000", 2024-04-18T21:06:09.405 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014437200000000001 2024-04-18T21:06:09.405 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.405 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.405 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:09.405 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632620+0000", 2024-04-18T21:06:09.405 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000143566 2024-04-18T21:06:09.406 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.406 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.406 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:09.406 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635185+0000", 2024-04-18T21:06:09.406 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0025644209999999999 2024-04-18T21:06:09.406 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.406 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.406 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:09.406 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657803+0000", 2024-04-18T21:06:09.406 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.022618743 2024-04-18T21:06:09.406 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.406 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.406 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:09.406 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657890+0000", 2024-04-18T21:06:09.407 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.6688999999999996e-05 2024-04-18T21:06:09.407 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.407 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.407 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:09.407 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657967+0000", 2024-04-18T21:06:09.407 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.6582000000000006e-05 2024-04-18T21:06:09.407 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:09.407 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:09.407 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:09.407 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.407 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.407 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:09.407 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:06:09.407 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 63.761438404000003, 2024-04-18T21:06:09.408 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.043603435000000003, 2024-04-18T21:06:09.408 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:09.408 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:09.408 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:09.408 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:09.408 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.408 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:09.408 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:06:09.408 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:09.408 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.408 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.408 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:09.408 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:06:09.408 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:09.409 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.409 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.409 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:09.409 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615607+0000", 2024-04-18T21:06:09.409 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4300000000000001e-06 2024-04-18T21:06:09.409 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.409 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.409 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:09.409 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615614+0000", 2024-04-18T21:06:09.409 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.4100000000000002e-06 2024-04-18T21:06:09.409 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.409 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.409 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:09.409 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615632+0000", 2024-04-18T21:06:09.410 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7863000000000002e-05 2024-04-18T21:06:09.410 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.410 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.410 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:09.410 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615647+0000", 2024-04-18T21:06:09.410 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5187e-05 2024-04-18T21:06:09.410 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.410 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.410 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:09.410 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615765+0000", 2024-04-18T21:06:09.410 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000117955 2024-04-18T21:06:09.410 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.410 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.411 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:09.411 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615781+0000", 2024-04-18T21:06:09.411 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6123000000000001e-05 2024-04-18T21:06:09.411 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.411 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.411 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:09.411 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633055+0000", 2024-04-18T21:06:09.411 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.017273909 2024-04-18T21:06:09.411 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.411 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.411 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:09.411 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633254+0000", 2024-04-18T21:06:09.411 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00019903799999999999 2024-04-18T21:06:09.411 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.411 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.412 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:09.412 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633624+0000", 2024-04-18T21:06:09.412 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000369656 2024-04-18T21:06:09.412 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.412 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.412 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:09.412 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635595+0000", 2024-04-18T21:06:09.412 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001971287 2024-04-18T21:06:09.412 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.412 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.412 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:09.412 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659026+0000", 2024-04-18T21:06:09.412 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.023431495 2024-04-18T21:06:09.412 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.413 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.413 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:09.413 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659117+0000", 2024-04-18T21:06:09.413 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0885999999999997e-05 2024-04-18T21:06:09.413 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.413 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.413 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:09.413 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659209+0000", 2024-04-18T21:06:09.413 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.1195999999999999e-05 2024-04-18T21:06:09.413 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:09.413 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:09.413 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:09.413 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.413 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.414 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:09.414 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:09.414 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 63.761373175000003, 2024-04-18T21:06:09.414 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.03492514, 2024-04-18T21:06:09.414 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:09.414 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:09.414 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:09.414 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:09.414 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.414 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:09.414 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:09.414 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:09.414 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.415 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.415 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:09.415 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:09.415 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:09.415 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.415 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.415 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:09.415 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:06:09.415 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.407e-06 2024-04-18T21:06:09.415 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.415 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.415 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:09.415 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615679+0000", 2024-04-18T21:06:09.415 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.2130000000000002e-06 2024-04-18T21:06:09.416 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.416 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.416 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:09.416 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615701+0000", 2024-04-18T21:06:09.416 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2316000000000001e-05 2024-04-18T21:06:09.416 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.416 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.416 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:09.416 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615717+0000", 2024-04-18T21:06:09.416 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6197000000000001e-05 2024-04-18T21:06:09.416 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.416 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.416 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:09.416 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615828+0000", 2024-04-18T21:06:09.416 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000110899 2024-04-18T21:06:09.417 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.417 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.417 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:09.417 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615840+0000", 2024-04-18T21:06:09.417 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.1423000000000001e-05 2024-04-18T21:06:09.417 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.417 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.417 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:09.417 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628046+0000", 2024-04-18T21:06:09.417 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.012206295000000001 2024-04-18T21:06:09.417 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.417 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.417 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:09.417 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628323+0000", 2024-04-18T21:06:09.418 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00027658700000000001 2024-04-18T21:06:09.418 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.418 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.418 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:09.418 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628599+0000", 2024-04-18T21:06:09.418 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00027676699999999997 2024-04-18T21:06:09.418 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.418 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.418 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:09.418 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634869+0000", 2024-04-18T21:06:09.418 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.006269536 2024-04-18T21:06:09.418 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.418 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.418 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:09.419 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650333+0000", 2024-04-18T21:06:09.419 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.015463645999999999 2024-04-18T21:06:09.419 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.419 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.419 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:09.419 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650474+0000", 2024-04-18T21:06:09.419 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014091799999999999 2024-04-18T21:06:09.419 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.419 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.419 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:09.419 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650595+0000", 2024-04-18T21:06:09.419 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012193600000000001 2024-04-18T21:06:09.419 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:09.419 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:09.420 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:09.420 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.420 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.420 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:09.420 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:06:09.420 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 63.761288065999999, 2024-04-18T21:06:09.420 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.040588320999999997, 2024-04-18T21:06:09.420 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:09.420 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:09.420 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:09.420 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:09.420 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.420 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:09.420 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:06:09.420 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:09.421 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.421 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.421 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:09.421 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:06:09.421 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:09.421 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.421 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.421 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:09.421 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615757+0000", 2024-04-18T21:06:09.421 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2270000000000001e-06 2024-04-18T21:06:09.421 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.421 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.421 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:09.421 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615765+0000", 2024-04-18T21:06:09.422 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.9400000000000002e-06 2024-04-18T21:06:09.422 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.422 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.422 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:09.422 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615785+0000", 2024-04-18T21:06:09.422 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.0749000000000001e-05 2024-04-18T21:06:09.422 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.422 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.422 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:09.422 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615804+0000", 2024-04-18T21:06:09.422 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.8774e-05 2024-04-18T21:06:09.422 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.422 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.423 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:09.423 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615888+0000", 2024-04-18T21:06:09.423 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.4111999999999997e-05 2024-04-18T21:06:09.423 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.423 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.423 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:09.423 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615895+0000", 2024-04-18T21:06:09.423 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.0469999999999996e-06 2024-04-18T21:06:09.423 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.423 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.423 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:09.423 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629280+0000", 2024-04-18T21:06:09.423 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.013384416 2024-04-18T21:06:09.423 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.424 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.424 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:09.424 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629488+0000", 2024-04-18T21:06:09.424 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00020852800000000001 2024-04-18T21:06:09.424 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.424 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.424 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:09.424 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629869+0000", 2024-04-18T21:06:09.424 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00038042300000000001 2024-04-18T21:06:09.424 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.424 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.424 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:09.424 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635041+0000", 2024-04-18T21:06:09.424 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.005172383 2024-04-18T21:06:09.425 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.425 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.425 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:09.425 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656125+0000", 2024-04-18T21:06:09.425 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.021084025999999999 2024-04-18T21:06:09.425 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.425 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.425 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:09.425 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656240+0000", 2024-04-18T21:06:09.425 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000115352 2024-04-18T21:06:09.425 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.425 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.425 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:09.425 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656344+0000", 2024-04-18T21:06:09.426 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00010334400000000001 2024-04-18T21:06:09.426 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:09.426 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:09.426 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:09.426 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.426 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.426 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:09.426 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:09.426 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 63.761220745999999, 2024-04-18T21:06:09.426 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.043549577999999999, 2024-04-18T21:06:09.426 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:09.426 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:09.426 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:09.426 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:09.427 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.427 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:09.427 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:09.427 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:09.427 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.427 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.427 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:09.427 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:09.427 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:09.427 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.427 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.427 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:09.427 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:09.427 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.5000000000000002e-07 2024-04-18T21:06:09.427 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.428 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.428 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:09.428 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615828+0000", 2024-04-18T21:06:09.428 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.2359999999999998e-06 2024-04-18T21:06:09.428 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.428 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.428 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:09.428 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615838+0000", 2024-04-18T21:06:09.428 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0087e-05 2024-04-18T21:06:09.428 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.428 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.428 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:09.428 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615846+0000", 2024-04-18T21:06:09.428 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.67e-06 2024-04-18T21:06:09.428 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.429 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.429 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:09.429 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615963+0000", 2024-04-18T21:06:09.429 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00011630500000000001 2024-04-18T21:06:09.429 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.429 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.429 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:09.429 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615979+0000", 2024-04-18T21:06:09.429 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.613e-05 2024-04-18T21:06:09.429 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.429 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.429 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:09.429 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632392+0000", 2024-04-18T21:06:09.429 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016413317 2024-04-18T21:06:09.429 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.430 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.430 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:09.430 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632568+0000", 2024-04-18T21:06:09.430 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00017539500000000001 2024-04-18T21:06:09.430 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.430 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.430 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:09.430 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632748+0000", 2024-04-18T21:06:09.430 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00017991799999999999 2024-04-18T21:06:09.430 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.430 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.430 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:09.430 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635542+0000", 2024-04-18T21:06:09.431 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00279481 2024-04-18T21:06:09.431 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.431 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.431 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:09.431 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659232+0000", 2024-04-18T21:06:09.431 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.023689212000000001 2024-04-18T21:06:09.431 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.431 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.431 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:09.431 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659314+0000", 2024-04-18T21:06:09.431 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.2528999999999995e-05 2024-04-18T21:06:09.431 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.431 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.431 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:09.431 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659372+0000", 2024-04-18T21:06:09.432 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.8218999999999999e-05 2024-04-18T21:06:09.432 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:09.432 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:09.432 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:09.432 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.432 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.432 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:09.432 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:06:09.432 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 63.761159313999997, 2024-04-18T21:06:09.432 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.039335347, 2024-04-18T21:06:09.432 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:09.432 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:09.432 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "started", 2024-04-18T21:06:09.432 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:09.432 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.433 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:09.433 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:06:09.433 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:09.433 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.433 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.433 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:09.433 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:06:09.433 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:09.433 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.433 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.433 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:09.433 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615885+0000", 2024-04-18T21:06:09.433 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2699999999999999e-06 2024-04-18T21:06:09.433 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.433 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.434 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:09.434 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615892+0000", 2024-04-18T21:06:09.434 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.6499999999999999e-06 2024-04-18T21:06:09.434 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.434 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.434 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:09.434 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615906+0000", 2024-04-18T21:06:09.434 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.393e-05 2024-04-18T21:06:09.434 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.434 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.434 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:09.434 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615919+0000", 2024-04-18T21:06:09.434 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2860000000000001e-05 2024-04-18T21:06:09.435 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.435 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.435 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:09.435 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616027+0000", 2024-04-18T21:06:09.435 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000107852 2024-04-18T21:06:09.435 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.435 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.435 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:09.435 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616037+0000", 2024-04-18T21:06:09.435 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:06:09.435 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.435 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.435 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:09.435 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622719+0000", 2024-04-18T21:06:09.436 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0066817220000000002 2024-04-18T21:06:09.436 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.436 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.436 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:09.436 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623006+0000", 2024-04-18T21:06:09.436 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00028783699999999999 2024-04-18T21:06:09.436 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.436 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.436 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:09.436 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.655220+0000", 2024-04-18T21:06:09.436 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.032213036 2024-04-18T21:06:09.436 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:09.436 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:09.436 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:09.436 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.437 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.437 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:09.437 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:09.437 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 63.761103640999998, 2024-04-18T21:06:09.437 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.032845253999999997, 2024-04-18T21:06:09.437 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:09.437 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:09.437 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "started", 2024-04-18T21:06:09.437 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:09.437 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.437 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:09.437 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:09.437 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:09.438 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.438 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.438 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:09.438 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:09.438 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:09.438 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.438 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.438 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:09.438 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615942+0000", 2024-04-18T21:06:09.438 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.717e-06 2024-04-18T21:06:09.438 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.438 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.438 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:09.439 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615946+0000", 2024-04-18T21:06:09.439 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.6e-06 2024-04-18T21:06:09.439 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.439 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.439 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:09.439 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615960+0000", 2024-04-18T21:06:09.439 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:06:09.439 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.439 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.439 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:09.439 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615968+0000", 2024-04-18T21:06:09.439 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.9070000000000007e-06 2024-04-18T21:06:09.439 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.439 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.439 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:09.440 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616100+0000", 2024-04-18T21:06:09.440 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000132402 2024-04-18T21:06:09.440 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.440 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.440 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:09.440 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616117+0000", 2024-04-18T21:06:09.440 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6653000000000001e-05 2024-04-18T21:06:09.440 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.440 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.440 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:09.440 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621566+0000", 2024-04-18T21:06:09.440 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0054497740000000001 2024-04-18T21:06:09.440 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.440 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.440 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:09.441 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622801+0000", 2024-04-18T21:06:09.441 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0012345710000000001 2024-04-18T21:06:09.441 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.441 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.441 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:09.441 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648785+0000", 2024-04-18T21:06:09.441 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.025984104000000001 2024-04-18T21:06:09.441 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:09.441 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:09.441 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:09.441 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.441 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.441 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:09.441 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:06:09.441 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 63.755252290999998, 2024-04-18T21:06:09.442 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.011561350999999999, 2024-04-18T21:06:09.442 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:09.442 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:09.442 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:09.442 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:09.442 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.442 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:09.442 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:06:09.442 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:09.442 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.442 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.442 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:09.442 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:06:09.442 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:09.443 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.443 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.443 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:09.443 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621792+0000", 2024-04-18T21:06:09.443 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.4000000000000001e-07 2024-04-18T21:06:09.443 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.443 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.443 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:09.443 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:06:09.443 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.1050000000000002e-05 2024-04-18T21:06:09.443 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.443 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.443 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:09.443 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622608+0000", 2024-04-18T21:06:09.444 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00077505900000000003 2024-04-18T21:06:09.444 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.444 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.444 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:09.444 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623879+0000", 2024-04-18T21:06:09.444 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0012705839999999999 2024-04-18T21:06:09.444 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.444 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.444 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:09.444 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624010+0000", 2024-04-18T21:06:09.444 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00013176900000000001 2024-04-18T21:06:09.444 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.444 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.444 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:09.444 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624058+0000", 2024-04-18T21:06:09.445 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.7299000000000002e-05 2024-04-18T21:06:09.445 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.445 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.445 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:09.445 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633262+0000", 2024-04-18T21:06:09.445 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0092048770000000002 2024-04-18T21:06:09.445 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.445 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.445 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:09.445 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633353+0000", 2024-04-18T21:06:09.445 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0073000000000003e-05 2024-04-18T21:06:09.445 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:09.445 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:09.445 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:09.445 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.446 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.446 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:09.446 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:06:09.446 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 63.753124905, 2024-04-18T21:06:09.446 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0098419370000000003, 2024-04-18T21:06:09.446 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:09.446 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:09.446 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:09.446 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:09.446 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.446 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:09.446 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:06:09.446 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:09.446 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.447 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.447 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:09.447 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:06:09.447 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:09.447 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.447 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.447 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:09.447 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623920+0000", 2024-04-18T21:06:09.447 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2240000000000001e-06 2024-04-18T21:06:09.447 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.447 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.447 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:09.447 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623933+0000", 2024-04-18T21:06:09.447 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3653e-05 2024-04-18T21:06:09.447 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.447 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.448 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:09.448 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623956+0000", 2024-04-18T21:06:09.448 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2059e-05 2024-04-18T21:06:09.448 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.448 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.448 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:09.448 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623975+0000", 2024-04-18T21:06:09.448 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.9806999999999999e-05 2024-04-18T21:06:09.448 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.448 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.448 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:09.448 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626943+0000", 2024-04-18T21:06:09.448 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0029681579999999998 2024-04-18T21:06:09.448 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.449 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.449 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:09.449 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626993+0000", 2024-04-18T21:06:09.449 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.9935999999999998e-05 2024-04-18T21:06:09.449 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.449 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.449 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:09.449 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633665+0000", 2024-04-18T21:06:09.449 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0066719250000000004 2024-04-18T21:06:09.449 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.449 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.449 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:09.449 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633761+0000", 2024-04-18T21:06:09.449 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.5174999999999996e-05 2024-04-18T21:06:09.449 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:09.450 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:09.450 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:09.450 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.450 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.450 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:09.450 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:06:09.450 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 63.752293285999997, 2024-04-18T21:06:09.450 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0090159079999999996, 2024-04-18T21:06:09.450 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:09.450 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:09.450 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:09.450 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:09.450 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.450 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:09.451 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:06:09.451 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:09.451 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.451 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.451 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:09.451 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:06:09.451 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:09.451 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.451 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.451 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:09.451 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624751+0000", 2024-04-18T21:06:09.451 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.7600000000000006e-07 2024-04-18T21:06:09.451 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.451 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.452 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:09.452 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624787+0000", 2024-04-18T21:06:09.452 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.6273000000000003e-05 2024-04-18T21:06:09.452 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.452 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.452 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:09.452 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625837+0000", 2024-04-18T21:06:09.452 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00104992 2024-04-18T21:06:09.452 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.452 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.452 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:09.452 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625860+0000", 2024-04-18T21:06:09.452 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3110000000000001e-05 2024-04-18T21:06:09.452 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.453 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.453 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:09.453 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625984+0000", 2024-04-18T21:06:09.453 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012399199999999999 2024-04-18T21:06:09.453 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.453 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.453 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:09.453 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626030+0000", 2024-04-18T21:06:09.453 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.5429999999999997e-05 2024-04-18T21:06:09.453 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.453 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.453 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:09.453 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633643+0000", 2024-04-18T21:06:09.453 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0076129320000000002 2024-04-18T21:06:09.453 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.454 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.454 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:09.454 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633766+0000", 2024-04-18T21:06:09.454 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000123275 2024-04-18T21:06:09.454 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:09.454 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:09.454 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:09.454 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.454 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.454 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:09.454 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:06:09.454 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 63.751039562000003, 2024-04-18T21:06:09.454 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0088669170000000002, 2024-04-18T21:06:09.455 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:09.455 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:09.455 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:09.455 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:09.455 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.455 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:09.455 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:06:09.455 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:09.455 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.455 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.455 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:09.455 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:06:09.455 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:09.455 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.455 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.456 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:09.456 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626005+0000", 2024-04-18T21:06:09.456 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.5000000000000001e-07 2024-04-18T21:06:09.456 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.456 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.456 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:09.456 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626028+0000", 2024-04-18T21:06:09.456 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2756999999999999e-05 2024-04-18T21:06:09.456 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.456 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.456 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:09.456 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626050+0000", 2024-04-18T21:06:09.456 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2140000000000001e-05 2024-04-18T21:06:09.456 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.456 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.457 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:09.457 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626065+0000", 2024-04-18T21:06:09.457 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5176e-05 2024-04-18T21:06:09.457 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.457 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.457 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:09.457 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628334+0000", 2024-04-18T21:06:09.457 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0022691439999999998 2024-04-18T21:06:09.457 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.457 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.457 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:09.457 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628379+0000", 2024-04-18T21:06:09.457 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.5420000000000002e-05 2024-04-18T21:06:09.457 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.457 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.458 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:09.458 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634770+0000", 2024-04-18T21:06:09.458 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0063908410000000004 2024-04-18T21:06:09.458 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.458 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.458 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:09.458 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634871+0000", 2024-04-18T21:06:09.458 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000100589 2024-04-18T21:06:09.458 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:09.458 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:09.458 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:09.458 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.458 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.459 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:13 3.10 e17/15 3:0d89b25e:::603.00000000:head v 17'8, mlcod=0'0)", 2024-04-18T21:06:09.459 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:06:09.459 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 63.732206132999998, 2024-04-18T21:06:09.459 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0090974379999999994, 2024-04-18T21:06:09.459 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:09.459 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:09.459 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:09.459 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:09.459 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.459 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:09.459 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:06:09.459 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:09.459 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.459 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.459 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:09.460 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:06:09.460 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:09.460 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.460 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.460 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:09.460 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644838+0000", 2024-04-18T21:06:09.460 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.569999999999999e-07 2024-04-18T21:06:09.460 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.460 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.460 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:09.460 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644846+0000", 2024-04-18T21:06:09.460 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.4499999999999998e-06 2024-04-18T21:06:09.460 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.460 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.461 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:09.461 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644861+0000", 2024-04-18T21:06:09.461 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5243e-05 2024-04-18T21:06:09.461 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.461 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.461 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:09.461 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644997+0000", 2024-04-18T21:06:09.461 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000135609 2024-04-18T21:06:09.461 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.461 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.461 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:09.461 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649150+0000", 2024-04-18T21:06:09.461 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0041536760000000002 2024-04-18T21:06:09.461 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.462 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.462 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:09.462 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649207+0000", 2024-04-18T21:06:09.462 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.6677e-05 2024-04-18T21:06:09.462 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.462 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.462 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:09.462 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.653840+0000", 2024-04-18T21:06:09.462 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0046329700000000001 2024-04-18T21:06:09.462 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.462 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.462 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:09.462 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.653935+0000", 2024-04-18T21:06:09.462 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.4856000000000001e-05 2024-04-18T21:06:09.463 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:09.463 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:09.463 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:09.463 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.463 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.463 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 3 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:06:09.463 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:06:09.463 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 63.729416972999999, 2024-04-18T21:06:09.463 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0087842319999999995, 2024-04-18T21:06:09.463 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:09.463 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:09.463 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "reached pg", 2024-04-18T21:06:09.463 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:09.463 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.463 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:09.464 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:06:09.464 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:09.464 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.464 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.464 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:09.464 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:06:09.464 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:09.464 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.464 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.464 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:09.464 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:06:09.464 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.8299999999999996e-07 2024-04-18T21:06:09.464 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.464 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.465 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:09.465 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647642+0000", 2024-04-18T21:06:09.465 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4724e-05 2024-04-18T21:06:09.465 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.465 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.465 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:09.465 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647679+0000", 2024-04-18T21:06:09.465 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.6662999999999998e-05 2024-04-18T21:06:09.465 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.465 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.465 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:09.465 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647735+0000", 2024-04-18T21:06:09.465 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.6196000000000002e-05 2024-04-18T21:06:09.466 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.466 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.466 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:09.466 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649865+0000", 2024-04-18T21:06:09.466 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0021299489999999999 2024-04-18T21:06:09.466 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.466 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.466 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:09.466 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656411+0000", 2024-04-18T21:06:09.466 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0065460170000000003 2024-04-18T21:06:09.466 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:09.466 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:09.466 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:09.466 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.467 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.467 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:09.467 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:06:09.467 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 63.729271777000001, 2024-04-18T21:06:09.467 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0095703190000000007, 2024-04-18T21:06:09.467 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:09.467 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:09.467 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:09.467 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:09.467 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.467 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:09.467 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:06:09.467 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:09.467 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.468 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.468 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:09.468 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:06:09.468 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:09.468 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.468 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.468 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:09.468 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647773+0000", 2024-04-18T21:06:09.468 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.046e-06 2024-04-18T21:06:09.468 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.468 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.468 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:09.468 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647795+0000", 2024-04-18T21:06:09.468 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2616000000000002e-05 2024-04-18T21:06:09.468 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.468 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.469 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:09.469 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647818+0000", 2024-04-18T21:06:09.469 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3110000000000001e-05 2024-04-18T21:06:09.469 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.469 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.469 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:09.469 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647834+0000", 2024-04-18T21:06:09.469 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5163e-05 2024-04-18T21:06:09.469 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.469 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.469 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:09.469 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650682+0000", 2024-04-18T21:06:09.469 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0028479759999999999 2024-04-18T21:06:09.469 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.469 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.470 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:09.470 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650730+0000", 2024-04-18T21:06:09.470 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.8375999999999999e-05 2024-04-18T21:06:09.470 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.470 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.470 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:09.470 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656751+0000", 2024-04-18T21:06:09.470 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0060211880000000002 2024-04-18T21:06:09.470 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.470 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.470 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:09.470 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657342+0000", 2024-04-18T21:06:09.470 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00059084399999999998 2024-04-18T21:06:09.470 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:09.471 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:09.471 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:09.471 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.471 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.471 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:09.471 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:06:09.471 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 63.728859491000001, 2024-04-18T21:06:09.471 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0092471759999999993, 2024-04-18T21:06:09.471 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:09.471 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:09.471 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:09.471 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:09.471 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.471 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:09.471 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:06:09.472 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:09.472 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.472 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.472 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:09.472 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:06:09.472 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:09.472 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.472 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.472 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:09.472 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648185+0000", 2024-04-18T21:06:09.472 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.5000000000000001e-07 2024-04-18T21:06:09.472 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.472 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.472 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:09.472 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648203+0000", 2024-04-18T21:06:09.473 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.8102999999999999e-05 2024-04-18T21:06:09.473 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.473 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.473 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:09.473 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648226+0000", 2024-04-18T21:06:09.473 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2921999999999998e-05 2024-04-18T21:06:09.473 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.473 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.473 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:09.473 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648241+0000", 2024-04-18T21:06:09.473 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5336999999999999e-05 2024-04-18T21:06:09.473 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.473 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.473 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:09.473 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.651268+0000", 2024-04-18T21:06:09.473 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0030271640000000002 2024-04-18T21:06:09.474 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.474 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.474 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:09.474 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.651319+0000", 2024-04-18T21:06:09.474 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.0843000000000001e-05 2024-04-18T21:06:09.474 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.474 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.474 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:09.474 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657347+0000", 2024-04-18T21:06:09.474 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0060279770000000003 2024-04-18T21:06:09.474 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:09.474 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:09.474 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:09.474 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657431+0000", 2024-04-18T21:06:09.475 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.3980000000000006e-05 2024-04-18T21:06:09.475 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:09.475 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:09.475 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:09.475 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:09.475 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:09.475 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:06:09.477 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:09.477 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:09.475+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:09.578 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:09.579+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:09.607 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:09.607 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:06:09.607 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-04-18T21:06:09.608 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:09.622 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:09.678 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:09.678+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:09.746 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:09.746 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:06:09.746 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-18T21:06:09.746 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-18T21:06:09.746 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:09.762 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:09.779 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:09.778+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:09.880 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:09.883+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:09.929 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:09.929 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-18T21:06:09.929 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-18T21:06:09.929 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:06:09.929 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.929 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:09.929 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:06:09.929 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 64.312963312999997, 2024-04-18T21:06:09.929 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.034065303999999998, 2024-04-18T21:06:09.929 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:09.929 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:09.929 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:09.929 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:09.930 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.930 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:09.930 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:06:09.930 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:09.930 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.930 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.930 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:09.930 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:06:09.930 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:09.930 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.930 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.930 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:09.930 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615254+0000", 2024-04-18T21:06:09.930 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7829999999999999e-06 2024-04-18T21:06:09.931 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.931 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.931 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:09.931 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615267+0000", 2024-04-18T21:06:09.931 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3334e-05 2024-04-18T21:06:09.931 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.931 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.931 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:09.931 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615294+0000", 2024-04-18T21:06:09.931 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7271999999999999e-05 2024-04-18T21:06:09.931 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.931 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.931 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:09.931 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615321+0000", 2024-04-18T21:06:09.931 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.637e-05 2024-04-18T21:06:09.932 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.932 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.932 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:09.932 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615479+0000", 2024-04-18T21:06:09.932 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000158493 2024-04-18T21:06:09.932 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.932 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.932 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:09.932 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615498+0000", 2024-04-18T21:06:09.932 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9148999999999999e-05 2024-04-18T21:06:09.932 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.932 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.932 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:09.932 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632915+0000", 2024-04-18T21:06:09.932 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.017416551999999998 2024-04-18T21:06:09.932 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.933 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.933 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:09.933 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633302+0000", 2024-04-18T21:06:09.933 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00038725000000000001 2024-04-18T21:06:09.933 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.933 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.933 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:09.933 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633638+0000", 2024-04-18T21:06:09.933 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000335946 2024-04-18T21:06:09.933 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.933 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.933 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:09.933 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645976+0000", 2024-04-18T21:06:09.933 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012337617 2024-04-18T21:06:09.933 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.934 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.934 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:09.934 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649080+0000", 2024-04-18T21:06:09.934 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031038929999999999 2024-04-18T21:06:09.934 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.934 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.934 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:09.934 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649207+0000", 2024-04-18T21:06:09.934 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000127537 2024-04-18T21:06:09.934 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.934 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.934 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:09.934 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649316+0000", 2024-04-18T21:06:09.935 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109108 2024-04-18T21:06:09.935 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:09.935 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:09.935 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:09.935 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.935 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.935 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:09.935 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:06:09.935 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 64.312829936, 2024-04-18T21:06:09.935 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036275764000000002, 2024-04-18T21:06:09.935 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:09.935 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:09.935 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:09.935 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:09.935 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.936 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:09.936 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:06:09.936 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:09.936 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.936 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.936 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:09.936 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:06:09.936 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:09.936 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.936 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.936 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:09.936 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615386+0000", 2024-04-18T21:06:09.936 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.573e-06 2024-04-18T21:06:09.936 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.936 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.937 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:09.937 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:06:09.937 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0723999999999999e-05 2024-04-18T21:06:09.937 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.937 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.937 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:09.937 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615418+0000", 2024-04-18T21:06:09.937 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0902000000000001e-05 2024-04-18T21:06:09.937 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.937 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.937 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:09.937 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615433+0000", 2024-04-18T21:06:09.937 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5319999999999999e-05 2024-04-18T21:06:09.937 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.937 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.937 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:09.938 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615659+0000", 2024-04-18T21:06:09.938 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000226095 2024-04-18T21:06:09.938 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.938 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.938 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:09.938 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:09.938 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1276e-05 2024-04-18T21:06:09.938 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.938 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.938 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:09.938 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643654+0000", 2024-04-18T21:06:09.938 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027983238000000001 2024-04-18T21:06:09.938 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.938 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.939 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:09.939 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643868+0000", 2024-04-18T21:06:09.939 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000214305 2024-04-18T21:06:09.939 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.939 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.939 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:09.939 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:06:09.939 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035892200000000002 2024-04-18T21:06:09.939 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.939 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.939 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:09.939 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646056+0000", 2024-04-18T21:06:09.939 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001829172 2024-04-18T21:06:09.939 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.939 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.940 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:09.940 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651406+0000", 2024-04-18T21:06:09.940 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0053504800000000003 2024-04-18T21:06:09.940 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.940 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.940 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:09.940 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651551+0000", 2024-04-18T21:06:09.940 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014427999999999999 2024-04-18T21:06:09.940 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.940 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.940 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:09.940 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651660+0000", 2024-04-18T21:06:09.940 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109477 2024-04-18T21:06:09.940 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:09.941 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:09.941 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:09.941 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.941 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.941 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:09.941 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:09.941 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 64.312756554000003, 2024-04-18T21:06:09.941 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045668994999999997, 2024-04-18T21:06:09.941 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:09.942 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:09.942 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:09.942 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:09.942 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.942 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:09.942 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:09.942 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:09.942 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.942 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.942 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:09.942 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:09.942 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:09.942 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.942 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.943 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:09.943 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615459+0000", 2024-04-18T21:06:09.943 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5030000000000001e-06 2024-04-18T21:06:09.943 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.943 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.943 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:09.943 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615506+0000", 2024-04-18T21:06:09.943 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6872000000000001e-05 2024-04-18T21:06:09.943 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.943 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.943 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:09.943 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615527+0000", 2024-04-18T21:06:09.943 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0763000000000001e-05 2024-04-18T21:06:09.943 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.944 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.944 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:09.944 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615551+0000", 2024-04-18T21:06:09.944 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4159e-05 2024-04-18T21:06:09.944 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.944 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.944 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:09.944 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615736+0000", 2024-04-18T21:06:09.944 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018499599999999999 2024-04-18T21:06:09.944 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.944 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.944 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:09.944 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615748+0000", 2024-04-18T21:06:09.944 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2272999999999999e-05 2024-04-18T21:06:09.944 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.945 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.945 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:09.945 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635481+0000", 2024-04-18T21:06:09.945 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019732772999999999 2024-04-18T21:06:09.945 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.945 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.945 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:09.945 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635791+0000", 2024-04-18T21:06:09.945 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031013299999999998 2024-04-18T21:06:09.945 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.945 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.945 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:09.945 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636101+0000", 2024-04-18T21:06:09.945 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030943300000000002 2024-04-18T21:06:09.946 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.946 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.946 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:09.946 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646043+0000", 2024-04-18T21:06:09.946 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099428139999999995 2024-04-18T21:06:09.946 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.946 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.946 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:09.946 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660991+0000", 2024-04-18T21:06:09.946 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014947142 2024-04-18T21:06:09.946 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.946 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.946 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:09.947 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661061+0000", 2024-04-18T21:06:09.947 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0438000000000006e-05 2024-04-18T21:06:09.947 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.947 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.947 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:09.947 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661127+0000", 2024-04-18T21:06:09.947 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5696000000000003e-05 2024-04-18T21:06:09.947 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:09.947 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:09.947 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:09.947 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.947 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.947 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:09.947 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:09.947 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 64.312544126000006, 2024-04-18T21:06:09.948 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045745085999999997, 2024-04-18T21:06:09.948 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:09.948 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:09.948 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:09.948 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:09.948 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.948 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:09.948 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:09.948 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:09.948 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.948 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.948 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:09.948 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:09.948 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:09.948 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.949 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.949 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:09.949 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:06:09.949 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7400000000000001e-06 2024-04-18T21:06:09.949 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.949 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.949 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:09.949 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:06:09.949 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8133e-05 2024-04-18T21:06:09.949 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.949 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.949 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:09.949 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615726+0000", 2024-04-18T21:06:09.949 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6132e-05 2024-04-18T21:06:09.949 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.950 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.950 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:09.950 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615742+0000", 2024-04-18T21:06:09.950 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6157000000000001e-05 2024-04-18T21:06:09.950 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.950 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.950 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:09.950 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615937+0000", 2024-04-18T21:06:09.950 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000194768 2024-04-18T21:06:09.950 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.950 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.950 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:09.950 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615950+0000", 2024-04-18T21:06:09.950 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3084e-05 2024-04-18T21:06:09.950 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.951 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.951 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:09.951 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643676+0000", 2024-04-18T21:06:09.951 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027725639999999999 2024-04-18T21:06:09.951 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.951 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.951 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:09.951 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643867+0000", 2024-04-18T21:06:09.951 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019075900000000001 2024-04-18T21:06:09.951 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.951 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.951 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:09.951 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:06:09.951 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036013799999999997 2024-04-18T21:06:09.952 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.952 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.952 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:09.952 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646068+0000", 2024-04-18T21:06:09.952 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001841536 2024-04-18T21:06:09.952 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.952 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.952 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:09.952 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661184+0000", 2024-04-18T21:06:09.952 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015115458999999999 2024-04-18T21:06:09.952 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.952 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.952 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:09.952 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661283+0000", 2024-04-18T21:06:09.952 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9502999999999999e-05 2024-04-18T21:06:09.952 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.953 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.953 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:09.953 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661415+0000", 2024-04-18T21:06:09.953 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000132037 2024-04-18T21:06:09.953 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:09.953 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:09.953 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:09.953 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.953 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.953 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:09.953 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:06:09.953 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 64.312422439000002, 2024-04-18T21:06:09.953 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036185947000000003, 2024-04-18T21:06:09.953 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:09.953 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:09.954 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:09.954 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:09.954 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.954 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:09.954 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:06:09.954 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:09.954 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.954 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.954 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:09.954 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:06:09.954 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:09.954 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.954 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.954 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:09.955 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615794+0000", 2024-04-18T21:06:09.955 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6440000000000001e-06 2024-04-18T21:06:09.955 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.955 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.955 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:09.955 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615803+0000", 2024-04-18T21:06:09.955 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1220000000000001e-06 2024-04-18T21:06:09.955 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.955 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.955 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:09.955 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615827+0000", 2024-04-18T21:06:09.955 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3997000000000001e-05 2024-04-18T21:06:09.955 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.955 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.956 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:09.956 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615899+0000", 2024-04-18T21:06:09.956 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2741e-05 2024-04-18T21:06:09.956 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.956 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.956 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:09.956 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616019+0000", 2024-04-18T21:06:09.956 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119874 2024-04-18T21:06:09.956 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.956 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.956 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:09.956 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616029+0000", 2024-04-18T21:06:09.956 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:06:09.957 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.957 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.957 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:09.957 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644823+0000", 2024-04-18T21:06:09.957 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.028793151999999999 2024-04-18T21:06:09.957 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.957 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.957 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:09.957 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645106+0000", 2024-04-18T21:06:09.957 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028379700000000002 2024-04-18T21:06:09.957 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.957 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.957 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:09.957 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645294+0000", 2024-04-18T21:06:09.957 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000187181 2024-04-18T21:06:09.957 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.958 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.958 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:09.958 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646763+0000", 2024-04-18T21:06:09.958 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0014691050000000001 2024-04-18T21:06:09.958 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.958 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.958 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:09.958 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651784+0000", 2024-04-18T21:06:09.958 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050211650000000002 2024-04-18T21:06:09.958 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.958 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.958 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:09.958 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651876+0000", 2024-04-18T21:06:09.958 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2503999999999994e-05 2024-04-18T21:06:09.958 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.959 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.959 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:09.959 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651978+0000", 2024-04-18T21:06:09.959 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000101475 2024-04-18T21:06:09.959 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:09.959 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:09.959 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:09.959 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.959 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.959 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:09.959 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:09.959 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 64.312273832000002, 2024-04-18T21:06:09.959 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032262322000000003, 2024-04-18T21:06:09.959 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:09.959 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:09.960 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:09.960 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:09.960 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.960 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:09.960 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:09.960 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:09.960 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.960 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.960 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:09.960 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:09.960 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:09.960 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.960 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.960 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:09.960 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615943+0000", 2024-04-18T21:06:09.960 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1959999999999998e-06 2024-04-18T21:06:09.961 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.961 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.961 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:09.961 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615956+0000", 2024-04-18T21:06:09.961 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3424000000000001e-05 2024-04-18T21:06:09.961 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.961 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.961 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:09.961 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615983+0000", 2024-04-18T21:06:09.961 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7072000000000001e-05 2024-04-18T21:06:09.961 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.961 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.961 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:09.961 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616006+0000", 2024-04-18T21:06:09.961 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2823000000000002e-05 2024-04-18T21:06:09.962 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.962 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.962 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:09.962 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616156+0000", 2024-04-18T21:06:09.962 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014962299999999999 2024-04-18T21:06:09.962 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.962 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.962 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:09.962 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616174+0000", 2024-04-18T21:06:09.962 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8082999999999999e-05 2024-04-18T21:06:09.962 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.962 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.962 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:09.963 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.629952+0000", 2024-04-18T21:06:09.963 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013778514 2024-04-18T21:06:09.963 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.963 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.963 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:09.963 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630201+0000", 2024-04-18T21:06:09.963 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024918100000000001 2024-04-18T21:06:09.963 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.963 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.963 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:09.963 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630386+0000", 2024-04-18T21:06:09.963 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018436900000000001 2024-04-18T21:06:09.963 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.963 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.963 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:09.964 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643169+0000", 2024-04-18T21:06:09.964 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012782774 2024-04-18T21:06:09.964 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.964 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.964 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:09.964 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.647924+0000", 2024-04-18T21:06:09.964 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004755787 2024-04-18T21:06:09.964 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.964 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.964 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:09.964 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648069+0000", 2024-04-18T21:06:09.964 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014459600000000001 2024-04-18T21:06:09.964 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.964 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.964 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:09.964 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648203+0000", 2024-04-18T21:06:09.965 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013388000000000001 2024-04-18T21:06:09.965 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:09.965 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:09.965 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:09.965 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.965 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.965 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:09.965 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:06:09.965 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 64.312165567999998, 2024-04-18T21:06:09.965 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032489736999999998, 2024-04-18T21:06:09.965 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:09.965 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:09.965 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:09.965 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:09.965 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.966 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:09.966 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:06:09.966 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:09.966 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.966 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.966 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:09.966 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:06:09.966 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:09.966 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.966 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.966 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:09.966 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616050+0000", 2024-04-18T21:06:09.966 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.606e-06 2024-04-18T21:06:09.966 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.966 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.967 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:09.967 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616061+0000", 2024-04-18T21:06:09.967 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0463e-05 2024-04-18T21:06:09.967 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.967 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.967 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:09.967 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616092+0000", 2024-04-18T21:06:09.967 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1415999999999999e-05 2024-04-18T21:06:09.967 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.967 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.967 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:09.967 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616109+0000", 2024-04-18T21:06:09.967 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6557000000000001e-05 2024-04-18T21:06:09.967 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.967 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.968 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:09.968 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616358+0000", 2024-04-18T21:06:09.968 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000249077 2024-04-18T21:06:09.968 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.968 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.968 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:09.968 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616370+0000", 2024-04-18T21:06:09.968 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2037e-05 2024-04-18T21:06:09.968 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.968 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.968 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:09.968 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.634920+0000", 2024-04-18T21:06:09.968 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018550397 2024-04-18T21:06:09.968 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.969 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.969 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:09.969 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640420+0000", 2024-04-18T21:06:09.969 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055000539999999999 2024-04-18T21:06:09.969 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.969 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.969 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:09.969 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648538+0000", 2024-04-18T21:06:09.969 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0081181299999999994 2024-04-18T21:06:09.969 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:09.969 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:09.969 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:09.969 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.970 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.970 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:09.970 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:06:09.970 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 64.312081246999995, 2024-04-18T21:06:09.970 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036090029000000003, 2024-04-18T21:06:09.970 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:09.970 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:09.970 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:09.970 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:09.970 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.970 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:09.970 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:06:09.970 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:09.970 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.971 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.971 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:09.971 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:06:09.971 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:09.971 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.971 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.971 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:09.971 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616134+0000", 2024-04-18T21:06:09.971 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.353e-06 2024-04-18T21:06:09.971 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.971 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.971 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:09.971 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616141+0000", 2024-04-18T21:06:09.971 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2770000000000002e-06 2024-04-18T21:06:09.971 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.972 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.972 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:09.972 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616160+0000", 2024-04-18T21:06:09.972 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.91e-05 2024-04-18T21:06:09.972 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.972 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.972 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:09.972 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616170+0000", 2024-04-18T21:06:09.972 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7699999999999996e-06 2024-04-18T21:06:09.972 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.972 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.972 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:09.972 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616275+0000", 2024-04-18T21:06:09.972 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105313 2024-04-18T21:06:09.972 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.973 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.973 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:09.973 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616288+0000", 2024-04-18T21:06:09.973 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3027000000000001e-05 2024-04-18T21:06:09.973 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.973 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.973 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:09.973 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646160+0000", 2024-04-18T21:06:09.973 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.029872019 2024-04-18T21:06:09.973 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.973 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.973 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:09.973 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646368+0000", 2024-04-18T21:06:09.973 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020811899999999999 2024-04-18T21:06:09.974 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.974 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.974 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:09.974 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652223+0000", 2024-04-18T21:06:09.974 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.005855051 2024-04-18T21:06:09.974 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:09.974 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:09.974 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:09.974 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.974 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.974 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:09.974 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:09.974 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 64.312023678000003, 2024-04-18T21:06:09.974 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043572403000000003, 2024-04-18T21:06:09.975 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:09.975 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:09.975 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:09.975 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:09.975 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.975 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:09.975 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:09.975 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:09.975 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.975 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.975 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:09.975 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:09.975 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:09.975 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.975 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.976 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:09.976 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616192+0000", 2024-04-18T21:06:09.976 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:06:09.976 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.976 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.976 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:09.976 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616203+0000", 2024-04-18T21:06:09.976 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0890000000000001e-05 2024-04-18T21:06:09.976 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.976 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.976 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:09.976 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616223+0000", 2024-04-18T21:06:09.976 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0409000000000001e-05 2024-04-18T21:06:09.976 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.976 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.976 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:09.977 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616238+0000", 2024-04-18T21:06:09.977 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5160000000000001e-05 2024-04-18T21:06:09.977 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.977 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.977 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:09.977 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616343+0000", 2024-04-18T21:06:09.977 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000104831 2024-04-18T21:06:09.977 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.977 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.977 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:09.977 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616357+0000", 2024-04-18T21:06:09.977 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3686000000000001e-05 2024-04-18T21:06:09.977 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.977 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.977 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:09.977 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635912+0000", 2024-04-18T21:06:09.978 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019554944000000001 2024-04-18T21:06:09.978 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.978 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.978 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:09.978 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636231+0000", 2024-04-18T21:06:09.978 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000318766 2024-04-18T21:06:09.978 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.978 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.978 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:09.978 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659763+0000", 2024-04-18T21:06:09.978 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023532474000000001 2024-04-18T21:06:09.978 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:09.978 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:09.978 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:09.978 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.979 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.979 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:09.979 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:06:09.979 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 64.308094971000003, 2024-04-18T21:06:09.979 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015007971, 2024-04-18T21:06:09.979 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:09.979 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:09.979 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:09.979 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:09.979 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.979 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:09.979 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:06:09.979 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:09.979 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.979 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.980 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:09.980 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:06:09.980 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:09.980 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.980 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.980 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:09.980 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620120+0000", 2024-04-18T21:06:09.980 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0359999999999999e-06 2024-04-18T21:06:09.980 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.980 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.980 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:09.980 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620157+0000", 2024-04-18T21:06:09.980 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6636e-05 2024-04-18T21:06:09.980 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.980 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.981 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:09.981 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620177+0000", 2024-04-18T21:06:09.981 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0247000000000001e-05 2024-04-18T21:06:09.981 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.981 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.981 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:09.981 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620195+0000", 2024-04-18T21:06:09.981 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7819e-05 2024-04-18T21:06:09.981 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.981 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.981 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:09.981 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620342+0000", 2024-04-18T21:06:09.981 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014643300000000001 2024-04-18T21:06:09.981 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.982 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.982 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:09.982 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620405+0000", 2024-04-18T21:06:09.982 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3522000000000006e-05 2024-04-18T21:06:09.982 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.982 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.982 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:09.982 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635016+0000", 2024-04-18T21:06:09.982 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014610840999999999 2024-04-18T21:06:09.982 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.982 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.982 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:09.982 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635127+0000", 2024-04-18T21:06:09.983 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111437 2024-04-18T21:06:09.983 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:09.983 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:09.983 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:09.983 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.983 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.983 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:09.983 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:06:09.983 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 64.307987702999995, 2024-04-18T21:06:09.983 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012693296, 2024-04-18T21:06:09.983 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:09.983 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:09.983 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:09.983 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:09.983 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.984 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:09.984 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:06:09.984 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:09.984 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.984 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.984 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:09.984 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:06:09.984 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:09.984 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.984 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.984 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:09.984 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620228+0000", 2024-04-18T21:06:09.984 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:06:09.984 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.984 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.985 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:09.985 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620236+0000", 2024-04-18T21:06:09.985 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.303e-06 2024-04-18T21:06:09.985 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.985 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.985 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:09.985 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620255+0000", 2024-04-18T21:06:09.985 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9406e-05 2024-04-18T21:06:09.985 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.985 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.985 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:09.985 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620274+0000", 2024-04-18T21:06:09.985 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8940000000000002e-05 2024-04-18T21:06:09.985 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.986 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.986 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:09.986 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:06:09.986 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001558753 2024-04-18T21:06:09.986 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.986 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.986 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:09.986 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621879+0000", 2024-04-18T21:06:09.986 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6359000000000001e-05 2024-04-18T21:06:09.986 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.986 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.986 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:09.986 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632841+0000", 2024-04-18T21:06:09.986 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010961907 2024-04-18T21:06:09.987 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.987 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.987 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:09.987 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632920+0000", 2024-04-18T21:06:09.987 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8714999999999994e-05 2024-04-18T21:06:09.987 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:09.987 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:09.987 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:09.987 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.987 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.987 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:09.987 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:06:09.987 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 64.306441939999999, 2024-04-18T21:06:09.987 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013445702, 2024-04-18T21:06:09.987 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:09.987 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:09.987 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:09.988 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:09.988 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.988 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:09.988 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:06:09.988 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:09.988 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.988 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.988 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:09.988 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:06:09.988 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:09.988 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.988 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.988 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:09.988 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621774+0000", 2024-04-18T21:06:09.988 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2500000000000001e-06 2024-04-18T21:06:09.989 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.989 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.989 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:09.989 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621786+0000", 2024-04-18T21:06:09.989 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2636000000000001e-05 2024-04-18T21:06:09.989 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.989 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.989 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:09.989 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621814+0000", 2024-04-18T21:06:09.989 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7823000000000001e-05 2024-04-18T21:06:09.989 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.989 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.989 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:09.989 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621844+0000", 2024-04-18T21:06:09.989 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9589000000000001e-05 2024-04-18T21:06:09.989 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.990 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.990 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:09.990 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622253+0000", 2024-04-18T21:06:09.990 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040963700000000002 2024-04-18T21:06:09.990 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.990 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.990 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:09.990 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622304+0000", 2024-04-18T21:06:09.990 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0868999999999997e-05 2024-04-18T21:06:09.990 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.990 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.990 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:09.990 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635133+0000", 2024-04-18T21:06:09.990 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012829136 2024-04-18T21:06:09.990 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.991 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.991 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:09.991 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635218+0000", 2024-04-18T21:06:09.991 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4761999999999999e-05 2024-04-18T21:06:09.991 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:09.991 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:09.991 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:09.991 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.991 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.991 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:09.991 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:06:09.991 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 64.306315179999999, 2024-04-18T21:06:09.991 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014162065, 2024-04-18T21:06:09.991 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:09.992 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:09.992 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:09.992 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:09.992 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.992 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:09.992 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:06:09.992 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:09.992 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.992 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.992 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:09.992 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:06:09.992 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:09.992 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.992 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.992 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:09.992 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621900+0000", 2024-04-18T21:06:09.993 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:06:09.993 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.993 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.993 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:09.993 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621910+0000", 2024-04-18T21:06:09.993 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0207000000000001e-05 2024-04-18T21:06:09.993 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.993 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.993 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:09.993 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621932+0000", 2024-04-18T21:06:09.993 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1789000000000001e-05 2024-04-18T21:06:09.993 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.993 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.994 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:09.994 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621946+0000", 2024-04-18T21:06:09.994 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4212999999999999e-05 2024-04-18T21:06:09.994 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.994 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.994 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:09.994 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624477+0000", 2024-04-18T21:06:09.994 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025303470000000001 2024-04-18T21:06:09.994 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.994 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.994 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:09.994 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624525+0000", 2024-04-18T21:06:09.994 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8084999999999998e-05 2024-04-18T21:06:09.994 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.995 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.995 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:09.995 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635976+0000", 2024-04-18T21:06:09.995 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.011451368999999999 2024-04-18T21:06:09.995 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.995 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.995 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:09.995 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636061+0000", 2024-04-18T21:06:09.995 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5094999999999998e-05 2024-04-18T21:06:09.995 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:09.995 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:09.995 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:09.995 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.995 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.995 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:06:09.995 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:06:09.996 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 64.297079554999996, 2024-04-18T21:06:09.996 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0098014739999999993, 2024-04-18T21:06:09.996 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:09.996 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:09.996 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:06:09.996 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:09.996 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.996 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:09.996 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:06:09.996 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:09.996 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.996 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.996 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:09.996 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:06:09.996 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:09.997 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.997 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.997 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:09.997 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631136+0000", 2024-04-18T21:06:09.997 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0139999999999999e-06 2024-04-18T21:06:09.997 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.997 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.997 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:09.997 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631152+0000", 2024-04-18T21:06:09.997 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6365999999999999e-05 2024-04-18T21:06:09.997 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.997 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.997 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:09.997 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631961+0000", 2024-04-18T21:06:09.997 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00080873100000000003 2024-04-18T21:06:09.997 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.998 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.998 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:09.998 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632021+0000", 2024-04-18T21:06:09.998 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0541999999999997e-05 2024-04-18T21:06:09.998 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.998 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.998 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:09.998 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633539+0000", 2024-04-18T21:06:09.998 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015175639999999999 2024-04-18T21:06:09.998 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.998 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.998 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:09.998 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640936+0000", 2024-04-18T21:06:09.999 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007397257 2024-04-18T21:06:09.999 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:09.999 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:09.999 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:09.999 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:09.999 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.999 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-18T21:06:09.999 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:06:09.999 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 64.279618122000002, 2024-04-18T21:06:09.999 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00073592199999999997, 2024-04-18T21:06:09.999 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:09.999 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:09.999 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:09.999 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:09.999 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:09.999 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:10.000 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:06:10.000 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:10.000 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.000 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.000 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:10.000 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:06:10.000 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:10.000 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.000 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.000 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:10.000 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648597+0000", 2024-04-18T21:06:10.000 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:06:10.000 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.000 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.000 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:10.000 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648605+0000", 2024-04-18T21:06:10.001 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3960000000000006e-06 2024-04-18T21:06:10.001 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.001 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.001 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:10.001 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648625+0000", 2024-04-18T21:06:10.001 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9987e-05 2024-04-18T21:06:10.001 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.001 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.001 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:10.001 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648643+0000", 2024-04-18T21:06:10.001 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7079e-05 2024-04-18T21:06:10.001 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.001 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.001 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:10.001 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649043+0000", 2024-04-18T21:06:10.002 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040083399999999998 2024-04-18T21:06:10.002 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.002 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.002 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:10.002 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649062+0000", 2024-04-18T21:06:10.002 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9052999999999999e-05 2024-04-18T21:06:10.002 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.002 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.002 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:10.002 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649332+0000", 2024-04-18T21:06:10.002 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026971999999999999 2024-04-18T21:06:10.002 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:10.002 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:10.002 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:10.003 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.003 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.003 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:06:10.003 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:06:10.003 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 64.276843220999993, 2024-04-18T21:06:10.003 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00086123999999999999, 2024-04-18T21:06:10.003 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:10.003 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:10.003 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:06:10.003 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:10.003 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.003 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:10.003 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:06:10.003 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:10.003 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.003 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.004 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:10.004 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:06:10.004 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:10.004 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.004 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.004 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:10.004 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651372+0000", 2024-04-18T21:06:10.004 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7599999999999997e-07 2024-04-18T21:06:10.004 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.004 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.004 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:10.004 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651377+0000", 2024-04-18T21:06:10.004 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.22e-06 2024-04-18T21:06:10.004 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.004 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.005 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:10.005 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651394+0000", 2024-04-18T21:06:10.005 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6646999999999998e-05 2024-04-18T21:06:10.005 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.005 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.005 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:10.005 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651427+0000", 2024-04-18T21:06:10.005 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3682e-05 2024-04-18T21:06:10.005 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.005 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.005 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:10.005 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652029+0000", 2024-04-18T21:06:10.005 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00060152199999999995 2024-04-18T21:06:10.005 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.005 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.006 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:10.006 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652232+0000", 2024-04-18T21:06:10.006 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020359299999999999 2024-04-18T21:06:10.006 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:10.006 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:10.006 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:10.006 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.006 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.006 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:06:10.006 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:06:10.006 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 64.268816259000005, 2024-04-18T21:06:10.006 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0017426200000000001, 2024-04-18T21:06:10.006 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:10.007 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:10.007 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:10.007 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:10.007 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.007 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:10.007 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:06:10.007 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:10.007 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.007 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.007 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:10.007 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:06:10.007 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:10.007 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.007 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.007 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:10.008 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659399+0000", 2024-04-18T21:06:10.008 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6000000000000002e-07 2024-04-18T21:06:10.008 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.008 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.008 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:10.008 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659405+0000", 2024-04-18T21:06:10.008 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5069999999999997e-06 2024-04-18T21:06:10.008 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.008 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.008 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:10.008 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659425+0000", 2024-04-18T21:06:10.008 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.927e-05 2024-04-18T21:06:10.008 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.009 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.009 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:10.009 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659443+0000", 2024-04-18T21:06:10.009 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8051999999999999e-05 2024-04-18T21:06:10.009 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.009 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.009 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:10.009 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660973+0000", 2024-04-18T21:06:10.009 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001530106 2024-04-18T21:06:10.009 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.009 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.009 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:10.009 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660983+0000", 2024-04-18T21:06:10.009 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0516999999999999e-05 2024-04-18T21:06:10.009 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.010 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.010 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:10.010 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661141+0000", 2024-04-18T21:06:10.010 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015730799999999999 2024-04-18T21:06:10.010 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:10.010 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:10.010 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:10.010 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.010 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.010 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:06:10.010 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:06:10.010 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 64.268599633999997, 2024-04-18T21:06:10.010 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001812311, 2024-04-18T21:06:10.010 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:10.011 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:10.011 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:10.011 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:10.011 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.011 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:10.011 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:06:10.011 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:10.011 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.011 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.011 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:10.011 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:06:10.011 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:10.011 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.011 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.012 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:10.012 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659616+0000", 2024-04-18T21:06:10.012 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.277e-06 2024-04-18T21:06:10.012 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.012 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.012 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:10.012 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659625+0000", 2024-04-18T21:06:10.012 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5359999999999998e-06 2024-04-18T21:06:10.012 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.012 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.012 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:10.012 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659647+0000", 2024-04-18T21:06:10.012 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1857000000000001e-05 2024-04-18T21:06:10.012 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.013 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.013 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:10.013 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659664+0000", 2024-04-18T21:06:10.013 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6405999999999998e-05 2024-04-18T21:06:10.013 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.013 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.013 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:10.013 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661169+0000", 2024-04-18T21:06:10.013 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015054179999999999 2024-04-18T21:06:10.013 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.013 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.013 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:10.013 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661177+0000", 2024-04-18T21:06:10.013 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9680000000000006e-06 2024-04-18T21:06:10.014 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.014 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.014 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:10.014 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661427+0000", 2024-04-18T21:06:10.014 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024984900000000001 2024-04-18T21:06:10.014 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:10.014 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:10.014 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:10.014 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.014 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.014 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-18T21:06:10.014 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:06:10.014 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 62.315679025999998, 2024-04-18T21:06:10.014 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0030975030000000001, 2024-04-18T21:06:10.015 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:10.015 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:10.015 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:10.015 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:10.015 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.015 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:10.015 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:06:10.015 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:10.015 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.015 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.015 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:10.015 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:06:10.015 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:10.015 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.015 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.016 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:10.016 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612538+0000", 2024-04-18T21:06:10.016 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6259999999999999e-06 2024-04-18T21:06:10.016 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.016 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.016 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:10.016 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612552+0000", 2024-04-18T21:06:10.016 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4073999999999999e-05 2024-04-18T21:06:10.016 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.016 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.016 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:10.016 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612585+0000", 2024-04-18T21:06:10.016 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3504999999999999e-05 2024-04-18T21:06:10.016 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.017 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.017 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:10.017 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612601+0000", 2024-04-18T21:06:10.017 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5194000000000001e-05 2024-04-18T21:06:10.017 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.017 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.017 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:10.017 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612746+0000", 2024-04-18T21:06:10.017 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145666 2024-04-18T21:06:10.017 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.017 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.017 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:10.017 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612953+0000", 2024-04-18T21:06:10.017 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000207109 2024-04-18T21:06:10.017 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.017 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.018 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:10.018 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.613134+0000", 2024-04-18T21:06:10.018 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018041300000000001 2024-04-18T21:06:10.018 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.018 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.018 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:10.018 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.614411+0000", 2024-04-18T21:06:10.018 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0012769929999999999 2024-04-18T21:06:10.018 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.018 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.018 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:10.018 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615441+0000", 2024-04-18T21:06:10.018 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001029917 2024-04-18T21:06:10.018 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.019 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.019 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:10.019 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615522+0000", 2024-04-18T21:06:10.019 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1142000000000003e-05 2024-04-18T21:06:10.019 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.019 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.019 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:10.019 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615633+0000", 2024-04-18T21:06:10.019 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000110864 2024-04-18T21:06:10.019 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:10.019 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:10.019 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:10.019 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.020 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.020 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-18T21:06:10.020 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:06:10.020 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 44.313393214999998, 2024-04-18T21:06:10.020 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088979039999999999, 2024-04-18T21:06:10.020 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:10.020 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:10.020 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:10.020 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:10.020 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.020 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:10.020 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:06:10.020 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:10.020 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.020 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.021 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:10.021 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:06:10.021 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:10.021 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.021 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.021 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:10.021 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614825+0000", 2024-04-18T21:06:10.021 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4829999999999999e-06 2024-04-18T21:06:10.021 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.021 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.021 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:10.021 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614843+0000", 2024-04-18T21:06:10.021 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8777e-05 2024-04-18T21:06:10.021 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.021 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.021 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:10.022 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614884+0000", 2024-04-18T21:06:10.022 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1051999999999999e-05 2024-04-18T21:06:10.022 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.022 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.022 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:10.022 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614903+0000", 2024-04-18T21:06:10.022 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9069999999999999e-05 2024-04-18T21:06:10.022 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.022 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.022 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:10.022 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615047+0000", 2024-04-18T21:06:10.022 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014374400000000001 2024-04-18T21:06:10.022 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.022 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.023 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:10.023 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615061+0000", 2024-04-18T21:06:10.023 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4063000000000001e-05 2024-04-18T21:06:10.023 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.023 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.023 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:10.023 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621064+0000", 2024-04-18T21:06:10.023 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0060029200000000001 2024-04-18T21:06:10.023 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.023 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.023 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:10.023 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621211+0000", 2024-04-18T21:06:10.023 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000147224 2024-04-18T21:06:10.024 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.024 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.024 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:10.024 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621396+0000", 2024-04-18T21:06:10.024 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018454699999999999 2024-04-18T21:06:10.024 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.024 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.024 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:10.024 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.622517+0000", 2024-04-18T21:06:10.024 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001121424 2024-04-18T21:06:10.024 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.024 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.024 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:10.024 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623571+0000", 2024-04-18T21:06:10.025 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010538660000000001 2024-04-18T21:06:10.025 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.025 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.025 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:10.025 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623658+0000", 2024-04-18T21:06:10.025 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6439000000000004e-05 2024-04-18T21:06:10.025 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:10.025 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:10.025 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:10.025 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623719+0000", 2024-04-18T21:06:10.025 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1295000000000002e-05 2024-04-18T21:06:10.025 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:10.025 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:10.026 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:10.026 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:10.026 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:10.026 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:10.027 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:10.026+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:10.028 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:10.107 INFO:teuthology.orchestra.run.smithi078.stderr:noscrub is set 2024-04-18T21:06:10.128 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:10.131+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:10.159 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:10.159 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:06:10.159 INFO:teuthology.orchestra.run.smithi132.stdout: "num_ops": 0 2024-04-18T21:06:10.159 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:10.173 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:10.178 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:06:10.229 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:10.231+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:10.289 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:10.289 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:06:10.289 INFO:teuthology.orchestra.run.smithi132.stdout: "complaint_time": 30, 2024-04-18T21:06:10.289 INFO:teuthology.orchestra.run.smithi132.stdout: "num_blocked_ops": 0 2024-04-18T21:06:10.289 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:10.303 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:10.331 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:10.330+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:10.335 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:06:10.336 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:06:10.357 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1: {} 2024-04-18T21:06:10.358 INFO:teuthology.orchestra.run.smithi078.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:06:10.379 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:06:10.380 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:10.421 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:10.421 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:10.430 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:10.426+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:10.435 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:10.531 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:10.531+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:10.565 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:10.565 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:10.580 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:10.632 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:10.630+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:10.733 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:10.730+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:10.743 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:10.743 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:10.759 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:10.834 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:10.835+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:10.881 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:10.881 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:10.895 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:10.935 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:10.934+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:11.029 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:11.030 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:11.035 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:11.034+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:11.045 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:11.136 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:11.134+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:11.163 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:11.164 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:11.177 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:11.269 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:11.270+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:11.327 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:11.327 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:11.337 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:11.338+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:11.340 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:11.437 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:11.434+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:11.471 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:11.471 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:11.485 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:11.538 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:11.539+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:11.640 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:11.638+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:11.651 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:11.651 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:11.665 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:11.740 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:11.738+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:11.830 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:11.831 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:11.841 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:11.838+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:11.845 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:11.942 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:11.943+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:11.978 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:11.978 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:11.993 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:12.081 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:12.083+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:12.129 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-18T21:06:12.255 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:12.255 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:12.255 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:12.256 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:12.254+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:12.355 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:12.354+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:12.398 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:06:12.428 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:12.428 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:12.444 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:12.456 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:12.455+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:12.553 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:06:12.554 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:06:12.557 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:12.559+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:12.574 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:12.574 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:12.586 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1: {} 2024-04-18T21:06:12.586 INFO:teuthology.orchestra.run.smithi078.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:06:12.589 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:12.617 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:06:12.617 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:12.658 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:12.654+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:12.711 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:12.711 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:06:12.711 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-18T21:06:12.711 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-18T21:06:12.711 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:12.725 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:12.759 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:12.758+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:12.852 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:12.852 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-18T21:06:12.852 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-18T21:06:12.852 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:06:12.852 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.852 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:12.852 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:06:12.852 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 67.235771764999996, 2024-04-18T21:06:12.852 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.034065303999999998, 2024-04-18T21:06:12.852 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:12.852 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:12.852 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:12.853 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:12.853 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.853 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:12.853 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:06:12.853 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:12.853 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.853 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.853 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:12.853 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:06:12.853 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:12.853 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.853 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.853 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:12.853 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615254+0000", 2024-04-18T21:06:12.853 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7829999999999999e-06 2024-04-18T21:06:12.853 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.854 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.854 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:12.854 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615267+0000", 2024-04-18T21:06:12.854 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3334e-05 2024-04-18T21:06:12.854 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.854 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.854 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:12.854 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615294+0000", 2024-04-18T21:06:12.854 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7271999999999999e-05 2024-04-18T21:06:12.854 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.854 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.854 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:12.854 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615321+0000", 2024-04-18T21:06:12.854 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.637e-05 2024-04-18T21:06:12.855 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.855 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.855 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:12.855 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615479+0000", 2024-04-18T21:06:12.855 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000158493 2024-04-18T21:06:12.855 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.855 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.855 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:12.855 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615498+0000", 2024-04-18T21:06:12.855 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9148999999999999e-05 2024-04-18T21:06:12.855 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.855 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.855 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:12.855 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632915+0000", 2024-04-18T21:06:12.856 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.017416551999999998 2024-04-18T21:06:12.856 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.856 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.856 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:12.856 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633302+0000", 2024-04-18T21:06:12.856 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00038725000000000001 2024-04-18T21:06:12.856 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.856 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.856 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:12.856 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633638+0000", 2024-04-18T21:06:12.856 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000335946 2024-04-18T21:06:12.856 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.856 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.856 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:12.857 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645976+0000", 2024-04-18T21:06:12.857 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012337617 2024-04-18T21:06:12.857 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.857 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.857 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:12.857 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649080+0000", 2024-04-18T21:06:12.857 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031038929999999999 2024-04-18T21:06:12.857 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.857 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.857 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:12.857 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649207+0000", 2024-04-18T21:06:12.857 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000127537 2024-04-18T21:06:12.858 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.858 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.858 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:12.858 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649316+0000", 2024-04-18T21:06:12.858 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109108 2024-04-18T21:06:12.858 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:12.858 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:12.858 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:12.858 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.858 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.858 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:12.858 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:06:12.858 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 67.235638387999998, 2024-04-18T21:06:12.858 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036275764000000002, 2024-04-18T21:06:12.858 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:12.859 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:12.859 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:12.859 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:12.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:12.859 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:06:12.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:12.859 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:12.859 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:06:12.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:12.859 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:12.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615386+0000", 2024-04-18T21:06:12.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.573e-06 2024-04-18T21:06:12.860 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.860 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:12.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:06:12.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0723999999999999e-05 2024-04-18T21:06:12.860 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.860 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:12.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615418+0000", 2024-04-18T21:06:12.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0902000000000001e-05 2024-04-18T21:06:12.860 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.860 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:12.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615433+0000", 2024-04-18T21:06:12.861 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5319999999999999e-05 2024-04-18T21:06:12.861 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.861 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:12.861 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615659+0000", 2024-04-18T21:06:12.861 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000226095 2024-04-18T21:06:12.861 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.861 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:12.861 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:12.861 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1276e-05 2024-04-18T21:06:12.861 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.861 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:12.861 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643654+0000", 2024-04-18T21:06:12.862 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027983238000000001 2024-04-18T21:06:12.862 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.862 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.862 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:12.862 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643868+0000", 2024-04-18T21:06:12.862 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000214305 2024-04-18T21:06:12.862 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.862 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.862 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:12.862 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:06:12.862 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035892200000000002 2024-04-18T21:06:12.862 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.862 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.862 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:12.862 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646056+0000", 2024-04-18T21:06:12.863 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001829172 2024-04-18T21:06:12.863 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.863 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.863 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:12.863 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651406+0000", 2024-04-18T21:06:12.863 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0053504800000000003 2024-04-18T21:06:12.863 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.863 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.863 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:12.863 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651551+0000", 2024-04-18T21:06:12.863 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014427999999999999 2024-04-18T21:06:12.863 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.863 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.863 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:12.863 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651660+0000", 2024-04-18T21:06:12.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109477 2024-04-18T21:06:12.864 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:12.864 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:12.864 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:12.864 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.864 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.864 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:12.864 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:12.864 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 67.235565006000002, 2024-04-18T21:06:12.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045668994999999997, 2024-04-18T21:06:12.864 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:12.864 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:12.864 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:12.864 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:12.864 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.864 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:12.865 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:12.865 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:12.865 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.865 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.865 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:12.865 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:12.865 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:12.865 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.865 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.865 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:12.865 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615459+0000", 2024-04-18T21:06:12.865 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5030000000000001e-06 2024-04-18T21:06:12.865 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.865 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.865 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:12.865 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615506+0000", 2024-04-18T21:06:12.866 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6872000000000001e-05 2024-04-18T21:06:12.866 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.866 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.866 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:12.866 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615527+0000", 2024-04-18T21:06:12.866 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0763000000000001e-05 2024-04-18T21:06:12.866 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.866 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.866 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:12.866 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615551+0000", 2024-04-18T21:06:12.866 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4159e-05 2024-04-18T21:06:12.866 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.866 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:12.867 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615736+0000", 2024-04-18T21:06:12.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018499599999999999 2024-04-18T21:06:12.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:12.867 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615748+0000", 2024-04-18T21:06:12.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2272999999999999e-05 2024-04-18T21:06:12.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:12.867 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635481+0000", 2024-04-18T21:06:12.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019732772999999999 2024-04-18T21:06:12.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:12.868 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635791+0000", 2024-04-18T21:06:12.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031013299999999998 2024-04-18T21:06:12.868 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.868 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.868 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:12.868 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636101+0000", 2024-04-18T21:06:12.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030943300000000002 2024-04-18T21:06:12.868 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.868 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.868 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:12.868 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646043+0000", 2024-04-18T21:06:12.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099428139999999995 2024-04-18T21:06:12.868 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.868 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.869 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:12.869 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660991+0000", 2024-04-18T21:06:12.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014947142 2024-04-18T21:06:12.869 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.869 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.869 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:12.869 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661061+0000", 2024-04-18T21:06:12.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0438000000000006e-05 2024-04-18T21:06:12.869 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.869 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.869 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:12.869 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661127+0000", 2024-04-18T21:06:12.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5696000000000003e-05 2024-04-18T21:06:12.869 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:12.869 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:12.869 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:12.870 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.870 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.870 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:12.870 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:12.870 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 67.235352578000004, 2024-04-18T21:06:12.870 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045745085999999997, 2024-04-18T21:06:12.870 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:12.870 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:12.870 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:12.870 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:12.870 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.870 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:12.870 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:12.870 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:12.871 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.871 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.871 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:12.871 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:12.871 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:12.871 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.871 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.871 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:12.871 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:06:12.871 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7400000000000001e-06 2024-04-18T21:06:12.871 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.871 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.871 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:12.871 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:06:12.871 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8133e-05 2024-04-18T21:06:12.872 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.872 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.872 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:12.872 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615726+0000", 2024-04-18T21:06:12.872 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6132e-05 2024-04-18T21:06:12.872 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.872 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.872 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:12.872 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615742+0000", 2024-04-18T21:06:12.872 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6157000000000001e-05 2024-04-18T21:06:12.872 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.872 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.872 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:12.872 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615937+0000", 2024-04-18T21:06:12.872 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000194768 2024-04-18T21:06:12.872 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.873 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.873 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:12.873 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615950+0000", 2024-04-18T21:06:12.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3084e-05 2024-04-18T21:06:12.873 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.873 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.873 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:12.873 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643676+0000", 2024-04-18T21:06:12.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027725639999999999 2024-04-18T21:06:12.873 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.873 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.873 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:12.873 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643867+0000", 2024-04-18T21:06:12.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019075900000000001 2024-04-18T21:06:12.873 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.873 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.874 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:12.874 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:06:12.874 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036013799999999997 2024-04-18T21:06:12.874 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.874 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.874 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:12.874 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646068+0000", 2024-04-18T21:06:12.874 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001841536 2024-04-18T21:06:12.874 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.874 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.874 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:12.874 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661184+0000", 2024-04-18T21:06:12.874 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015115458999999999 2024-04-18T21:06:12.874 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.874 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.875 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:12.875 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661283+0000", 2024-04-18T21:06:12.875 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9502999999999999e-05 2024-04-18T21:06:12.875 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.875 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.875 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:12.875 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661415+0000", 2024-04-18T21:06:12.875 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000132037 2024-04-18T21:06:12.875 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:12.875 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:12.875 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:12.875 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.875 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.875 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:12.875 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:06:12.875 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 67.235230891, 2024-04-18T21:06:12.876 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036185947000000003, 2024-04-18T21:06:12.876 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:12.876 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:12.876 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:12.876 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:12.876 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.876 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:12.876 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:06:12.876 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:12.876 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.876 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.876 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:12.876 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:06:12.876 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:12.876 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.877 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.877 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:12.877 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615794+0000", 2024-04-18T21:06:12.877 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6440000000000001e-06 2024-04-18T21:06:12.877 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.877 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.877 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:12.877 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615803+0000", 2024-04-18T21:06:12.877 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1220000000000001e-06 2024-04-18T21:06:12.877 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.877 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.877 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:12.877 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615827+0000", 2024-04-18T21:06:12.877 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3997000000000001e-05 2024-04-18T21:06:12.877 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.878 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.878 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:12.878 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615899+0000", 2024-04-18T21:06:12.878 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2741e-05 2024-04-18T21:06:12.878 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.878 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.878 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:12.878 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616019+0000", 2024-04-18T21:06:12.878 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119874 2024-04-18T21:06:12.878 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.878 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.878 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:12.878 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616029+0000", 2024-04-18T21:06:12.878 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:06:12.879 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.879 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.879 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:12.879 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644823+0000", 2024-04-18T21:06:12.879 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.028793151999999999 2024-04-18T21:06:12.879 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.879 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.879 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:12.879 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645106+0000", 2024-04-18T21:06:12.879 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028379700000000002 2024-04-18T21:06:12.879 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.879 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.879 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:12.879 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645294+0000", 2024-04-18T21:06:12.879 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000187181 2024-04-18T21:06:12.880 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.880 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.880 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:12.880 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646763+0000", 2024-04-18T21:06:12.880 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0014691050000000001 2024-04-18T21:06:12.880 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.880 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.880 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:12.880 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651784+0000", 2024-04-18T21:06:12.880 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050211650000000002 2024-04-18T21:06:12.880 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.880 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.880 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:12.880 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651876+0000", 2024-04-18T21:06:12.880 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2503999999999994e-05 2024-04-18T21:06:12.881 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.881 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.881 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:12.881 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651978+0000", 2024-04-18T21:06:12.881 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000101475 2024-04-18T21:06:12.881 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:12.881 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:12.881 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:12.881 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.881 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.881 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:12.881 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:12.881 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 67.235082284000001, 2024-04-18T21:06:12.881 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032262322000000003, 2024-04-18T21:06:12.881 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:12.882 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:12.882 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:12.882 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:12.882 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.882 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:12.882 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:12.882 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:12.882 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.882 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.882 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:12.882 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:12.882 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:12.882 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.882 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.883 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:12.883 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615943+0000", 2024-04-18T21:06:12.883 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1959999999999998e-06 2024-04-18T21:06:12.883 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.883 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.883 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:12.883 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615956+0000", 2024-04-18T21:06:12.883 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3424000000000001e-05 2024-04-18T21:06:12.883 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.883 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.883 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:12.883 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615983+0000", 2024-04-18T21:06:12.883 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7072000000000001e-05 2024-04-18T21:06:12.883 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.883 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.884 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:12.884 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616006+0000", 2024-04-18T21:06:12.884 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2823000000000002e-05 2024-04-18T21:06:12.884 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.884 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.884 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:12.884 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616156+0000", 2024-04-18T21:06:12.884 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014962299999999999 2024-04-18T21:06:12.884 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.884 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.885 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:12.885 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616174+0000", 2024-04-18T21:06:12.885 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8082999999999999e-05 2024-04-18T21:06:12.885 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.885 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.885 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:12.885 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.629952+0000", 2024-04-18T21:06:12.885 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013778514 2024-04-18T21:06:12.885 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.885 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.885 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:12.885 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630201+0000", 2024-04-18T21:06:12.885 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024918100000000001 2024-04-18T21:06:12.885 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.886 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.886 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:12.886 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630386+0000", 2024-04-18T21:06:12.886 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018436900000000001 2024-04-18T21:06:12.886 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.886 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.886 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:12.886 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643169+0000", 2024-04-18T21:06:12.886 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012782774 2024-04-18T21:06:12.886 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.887 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.887 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:12.887 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.647924+0000", 2024-04-18T21:06:12.887 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004755787 2024-04-18T21:06:12.887 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.887 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.887 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:12.887 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648069+0000", 2024-04-18T21:06:12.887 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014459600000000001 2024-04-18T21:06:12.887 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.887 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.887 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:12.887 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648203+0000", 2024-04-18T21:06:12.887 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013388000000000001 2024-04-18T21:06:12.888 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:12.888 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:12.888 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:12.888 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.888 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.888 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:12.888 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:06:12.888 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 67.234974019999996, 2024-04-18T21:06:12.888 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032489736999999998, 2024-04-18T21:06:12.888 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:12.888 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:12.888 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:12.888 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:12.888 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.889 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:12.889 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:06:12.889 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:12.889 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.889 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.889 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:12.889 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:06:12.889 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:12.889 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.889 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.889 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:12.889 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616050+0000", 2024-04-18T21:06:12.889 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.606e-06 2024-04-18T21:06:12.889 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.889 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.890 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:12.890 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616061+0000", 2024-04-18T21:06:12.890 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0463e-05 2024-04-18T21:06:12.890 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.890 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.890 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:12.890 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616092+0000", 2024-04-18T21:06:12.890 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1415999999999999e-05 2024-04-18T21:06:12.890 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.890 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.890 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:12.890 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616109+0000", 2024-04-18T21:06:12.890 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6557000000000001e-05 2024-04-18T21:06:12.890 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.891 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.891 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:12.891 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616358+0000", 2024-04-18T21:06:12.891 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000249077 2024-04-18T21:06:12.891 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.891 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.891 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:12.891 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616370+0000", 2024-04-18T21:06:12.891 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2037e-05 2024-04-18T21:06:12.891 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.891 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.891 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:12.891 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.634920+0000", 2024-04-18T21:06:12.891 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018550397 2024-04-18T21:06:12.891 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.892 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.892 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:12.892 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640420+0000", 2024-04-18T21:06:12.892 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055000539999999999 2024-04-18T21:06:12.892 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.892 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.892 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:12.892 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648538+0000", 2024-04-18T21:06:12.892 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0081181299999999994 2024-04-18T21:06:12.892 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:12.892 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:12.892 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:12.892 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.892 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.892 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:12.893 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:06:12.893 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 67.234889699000007, 2024-04-18T21:06:12.893 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036090029000000003, 2024-04-18T21:06:12.893 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:12.893 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:12.893 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:12.893 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:12.893 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.893 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:12.893 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:06:12.893 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:12.893 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.893 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.893 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:12.893 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:06:12.894 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:12.894 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.894 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.894 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:12.894 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616134+0000", 2024-04-18T21:06:12.894 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.353e-06 2024-04-18T21:06:12.894 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.894 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.894 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:12.894 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616141+0000", 2024-04-18T21:06:12.894 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2770000000000002e-06 2024-04-18T21:06:12.894 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.895 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.895 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:12.895 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616160+0000", 2024-04-18T21:06:12.895 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.91e-05 2024-04-18T21:06:12.895 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.895 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.895 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:12.895 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616170+0000", 2024-04-18T21:06:12.895 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7699999999999996e-06 2024-04-18T21:06:12.895 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.895 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.895 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:12.895 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616275+0000", 2024-04-18T21:06:12.895 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105313 2024-04-18T21:06:12.895 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.896 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.896 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:12.896 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616288+0000", 2024-04-18T21:06:12.896 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3027000000000001e-05 2024-04-18T21:06:12.896 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.896 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.896 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:12.896 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646160+0000", 2024-04-18T21:06:12.896 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.029872019 2024-04-18T21:06:12.896 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.896 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.896 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:12.896 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646368+0000", 2024-04-18T21:06:12.896 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020811899999999999 2024-04-18T21:06:12.896 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.897 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.897 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:12.897 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652223+0000", 2024-04-18T21:06:12.897 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.005855051 2024-04-18T21:06:12.897 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:12.897 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:12.897 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:12.897 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.897 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.897 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:12.897 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:12.897 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 67.234832130000001, 2024-04-18T21:06:12.897 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043572403000000003, 2024-04-18T21:06:12.897 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:12.897 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:12.898 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:12.898 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:12.898 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.898 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:12.898 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:12.898 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:12.898 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.898 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.898 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:12.898 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:12.898 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:12.898 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.898 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.899 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:12.899 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616192+0000", 2024-04-18T21:06:12.899 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:06:12.899 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.899 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.899 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:12.899 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616203+0000", 2024-04-18T21:06:12.899 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0890000000000001e-05 2024-04-18T21:06:12.899 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.899 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.899 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:12.899 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616223+0000", 2024-04-18T21:06:12.899 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0409000000000001e-05 2024-04-18T21:06:12.899 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.899 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.900 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:12.900 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616238+0000", 2024-04-18T21:06:12.900 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5160000000000001e-05 2024-04-18T21:06:12.900 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.900 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.900 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:12.900 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616343+0000", 2024-04-18T21:06:12.900 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000104831 2024-04-18T21:06:12.900 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.900 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.900 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:12.900 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616357+0000", 2024-04-18T21:06:12.901 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3686000000000001e-05 2024-04-18T21:06:12.901 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.901 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.901 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:12.901 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635912+0000", 2024-04-18T21:06:12.901 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019554944000000001 2024-04-18T21:06:12.901 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.901 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.901 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:12.901 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636231+0000", 2024-04-18T21:06:12.901 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000318766 2024-04-18T21:06:12.901 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.901 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.901 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:12.901 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659763+0000", 2024-04-18T21:06:12.902 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023532474000000001 2024-04-18T21:06:12.902 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:12.902 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:12.902 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:12.902 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.902 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.902 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:12.902 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:06:12.902 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 67.230903423000001, 2024-04-18T21:06:12.902 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015007971, 2024-04-18T21:06:12.903 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:12.903 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:12.903 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:12.903 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:12.903 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.903 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:12.903 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:06:12.903 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:12.903 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.903 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.903 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:12.903 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:06:12.903 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:12.903 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.904 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.904 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:12.904 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620120+0000", 2024-04-18T21:06:12.904 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0359999999999999e-06 2024-04-18T21:06:12.904 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.904 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.904 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:12.904 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620157+0000", 2024-04-18T21:06:12.904 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6636e-05 2024-04-18T21:06:12.904 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.904 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.904 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:12.904 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620177+0000", 2024-04-18T21:06:12.904 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0247000000000001e-05 2024-04-18T21:06:12.904 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.905 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.905 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:12.905 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620195+0000", 2024-04-18T21:06:12.905 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7819e-05 2024-04-18T21:06:12.905 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.905 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.905 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:12.905 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620342+0000", 2024-04-18T21:06:12.905 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014643300000000001 2024-04-18T21:06:12.905 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.905 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.905 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:12.905 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620405+0000", 2024-04-18T21:06:12.906 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3522000000000006e-05 2024-04-18T21:06:12.906 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.906 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.906 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:12.906 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635016+0000", 2024-04-18T21:06:12.906 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014610840999999999 2024-04-18T21:06:12.906 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.906 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.906 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:12.906 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635127+0000", 2024-04-18T21:06:12.906 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111437 2024-04-18T21:06:12.906 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:12.906 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:12.907 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:12.907 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.907 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.907 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:12.907 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:06:12.907 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 67.230796154999993, 2024-04-18T21:06:12.907 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012693296, 2024-04-18T21:06:12.907 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:12.907 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:12.907 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:12.907 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:12.907 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.907 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:12.908 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:06:12.908 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:12.908 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.908 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.908 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:12.908 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:06:12.908 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:12.908 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.908 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.908 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:12.908 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620228+0000", 2024-04-18T21:06:12.908 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:06:12.908 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.909 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.909 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:12.909 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620236+0000", 2024-04-18T21:06:12.909 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.303e-06 2024-04-18T21:06:12.909 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.909 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.909 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:12.909 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620255+0000", 2024-04-18T21:06:12.909 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9406e-05 2024-04-18T21:06:12.909 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.909 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.909 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:12.909 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620274+0000", 2024-04-18T21:06:12.909 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8940000000000002e-05 2024-04-18T21:06:12.910 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.910 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.910 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:12.910 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:06:12.910 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001558753 2024-04-18T21:06:12.910 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.910 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.910 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:12.910 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621879+0000", 2024-04-18T21:06:12.910 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6359000000000001e-05 2024-04-18T21:06:12.910 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.910 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.910 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:12.910 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632841+0000", 2024-04-18T21:06:12.911 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010961907 2024-04-18T21:06:12.911 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.911 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.911 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:12.911 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632920+0000", 2024-04-18T21:06:12.911 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8714999999999994e-05 2024-04-18T21:06:12.911 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:12.911 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:12.911 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:12.911 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.911 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.911 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:12.911 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:06:12.911 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 67.229250391999997, 2024-04-18T21:06:12.912 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013445702, 2024-04-18T21:06:12.912 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:12.912 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:12.912 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:12.912 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:12.912 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.912 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:12.912 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:06:12.912 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:12.912 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.912 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.912 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:12.912 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:06:12.912 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:12.912 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.913 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.913 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:12.913 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621774+0000", 2024-04-18T21:06:12.913 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2500000000000001e-06 2024-04-18T21:06:12.913 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.913 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.913 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:12.913 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621786+0000", 2024-04-18T21:06:12.913 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2636000000000001e-05 2024-04-18T21:06:12.913 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.913 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.913 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:12.913 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621814+0000", 2024-04-18T21:06:12.913 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7823000000000001e-05 2024-04-18T21:06:12.913 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.914 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.914 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:12.914 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621844+0000", 2024-04-18T21:06:12.914 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9589000000000001e-05 2024-04-18T21:06:12.914 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.914 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.914 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:12.914 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622253+0000", 2024-04-18T21:06:12.914 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040963700000000002 2024-04-18T21:06:12.914 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.914 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.914 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:12.914 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622304+0000", 2024-04-18T21:06:12.915 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0868999999999997e-05 2024-04-18T21:06:12.915 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.915 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.915 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:12.915 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635133+0000", 2024-04-18T21:06:12.915 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012829136 2024-04-18T21:06:12.915 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.915 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.915 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:12.915 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635218+0000", 2024-04-18T21:06:12.915 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4761999999999999e-05 2024-04-18T21:06:12.915 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:12.915 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:12.915 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:12.916 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.916 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.916 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:12.916 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:06:12.916 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 67.229123631999997, 2024-04-18T21:06:12.916 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014162065, 2024-04-18T21:06:12.916 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:12.916 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:12.916 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:12.916 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:12.916 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.916 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:12.916 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:06:12.917 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:12.917 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.917 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.917 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:12.917 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:06:12.917 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:12.917 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.917 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.917 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:12.917 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621900+0000", 2024-04-18T21:06:12.917 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:06:12.917 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.917 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.917 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:12.917 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621910+0000", 2024-04-18T21:06:12.918 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0207000000000001e-05 2024-04-18T21:06:12.918 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.918 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.918 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:12.918 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621932+0000", 2024-04-18T21:06:12.918 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1789000000000001e-05 2024-04-18T21:06:12.918 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.918 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.918 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:12.918 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621946+0000", 2024-04-18T21:06:12.918 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4212999999999999e-05 2024-04-18T21:06:12.918 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.918 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.919 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:12.919 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624477+0000", 2024-04-18T21:06:12.919 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025303470000000001 2024-04-18T21:06:12.919 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.919 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.919 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:12.919 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624525+0000", 2024-04-18T21:06:12.919 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8084999999999998e-05 2024-04-18T21:06:12.919 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.919 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.919 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:12.919 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635976+0000", 2024-04-18T21:06:12.919 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.011451368999999999 2024-04-18T21:06:12.919 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.920 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.920 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:12.920 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636061+0000", 2024-04-18T21:06:12.920 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5094999999999998e-05 2024-04-18T21:06:12.920 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:12.920 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:12.920 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:12.920 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.920 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.920 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:06:12.920 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:06:12.920 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 67.219888006999994, 2024-04-18T21:06:12.920 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0098014739999999993, 2024-04-18T21:06:12.920 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:12.921 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:12.921 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:06:12.921 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:12.921 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.921 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:12.921 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:06:12.921 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:12.921 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.921 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.921 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:12.921 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:06:12.921 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:12.921 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.922 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.922 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:12.922 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631136+0000", 2024-04-18T21:06:12.922 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0139999999999999e-06 2024-04-18T21:06:12.922 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.922 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.922 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:12.922 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631152+0000", 2024-04-18T21:06:12.922 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6365999999999999e-05 2024-04-18T21:06:12.922 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.922 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.922 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:12.922 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631961+0000", 2024-04-18T21:06:12.922 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00080873100000000003 2024-04-18T21:06:12.923 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.923 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.923 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:12.923 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632021+0000", 2024-04-18T21:06:12.923 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0541999999999997e-05 2024-04-18T21:06:12.923 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.923 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.923 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:12.923 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633539+0000", 2024-04-18T21:06:12.923 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015175639999999999 2024-04-18T21:06:12.923 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.923 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.923 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:12.923 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640936+0000", 2024-04-18T21:06:12.924 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007397257 2024-04-18T21:06:12.924 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:12.924 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:12.924 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:12.924 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.924 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.924 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-18T21:06:12.924 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:06:12.924 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 67.202426574, 2024-04-18T21:06:12.924 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00073592199999999997, 2024-04-18T21:06:12.924 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:12.924 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:12.924 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:12.925 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:12.925 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.925 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:12.925 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:06:12.925 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:12.925 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.925 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.925 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:12.925 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:06:12.925 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:12.925 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.925 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.925 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:12.925 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648597+0000", 2024-04-18T21:06:12.925 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:06:12.926 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.926 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.926 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:12.926 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648605+0000", 2024-04-18T21:06:12.926 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3960000000000006e-06 2024-04-18T21:06:12.926 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.926 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.926 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:12.926 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648625+0000", 2024-04-18T21:06:12.926 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9987e-05 2024-04-18T21:06:12.926 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.926 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.927 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:12.927 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648643+0000", 2024-04-18T21:06:12.927 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7079e-05 2024-04-18T21:06:12.927 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.927 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.927 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:12.927 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649043+0000", 2024-04-18T21:06:12.927 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040083399999999998 2024-04-18T21:06:12.927 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.927 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.927 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:12.927 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649062+0000", 2024-04-18T21:06:12.927 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9052999999999999e-05 2024-04-18T21:06:12.928 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.928 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.928 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:12.928 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649332+0000", 2024-04-18T21:06:12.928 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026971999999999999 2024-04-18T21:06:12.928 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:12.928 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:12.928 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:12.928 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.928 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.928 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:06:12.928 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:06:12.928 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 67.199651673000005, 2024-04-18T21:06:12.928 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00086123999999999999, 2024-04-18T21:06:12.929 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:12.929 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:12.929 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:06:12.929 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:12.929 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.929 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:12.929 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:06:12.929 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:12.929 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.929 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.929 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:12.929 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:06:12.930 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:12.930 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.930 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.930 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:12.930 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651372+0000", 2024-04-18T21:06:12.930 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7599999999999997e-07 2024-04-18T21:06:12.930 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.930 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.930 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:12.930 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651377+0000", 2024-04-18T21:06:12.930 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.22e-06 2024-04-18T21:06:12.930 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.930 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.930 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:12.931 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651394+0000", 2024-04-18T21:06:12.931 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6646999999999998e-05 2024-04-18T21:06:12.931 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.931 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.931 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:12.931 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651427+0000", 2024-04-18T21:06:12.931 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3682e-05 2024-04-18T21:06:12.931 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.931 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.931 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:12.931 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652029+0000", 2024-04-18T21:06:12.931 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00060152199999999995 2024-04-18T21:06:12.931 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.931 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.932 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:12.932 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652232+0000", 2024-04-18T21:06:12.932 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020359299999999999 2024-04-18T21:06:12.932 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:12.932 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:12.932 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:12.932 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.932 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.932 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:06:12.932 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:06:12.932 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 67.191624711000003, 2024-04-18T21:06:12.932 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0017426200000000001, 2024-04-18T21:06:12.932 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:12.932 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:12.933 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:12.933 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:12.933 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.933 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:12.933 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:06:12.933 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:12.933 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.933 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.933 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:12.933 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:06:12.933 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:12.933 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.933 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.933 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:12.933 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659399+0000", 2024-04-18T21:06:12.934 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6000000000000002e-07 2024-04-18T21:06:12.934 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.934 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.934 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:12.934 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659405+0000", 2024-04-18T21:06:12.934 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5069999999999997e-06 2024-04-18T21:06:12.934 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.934 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.934 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:12.934 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659425+0000", 2024-04-18T21:06:12.934 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.927e-05 2024-04-18T21:06:12.934 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.934 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.934 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:12.935 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659443+0000", 2024-04-18T21:06:12.935 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8051999999999999e-05 2024-04-18T21:06:12.935 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.935 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.935 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:12.935 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660973+0000", 2024-04-18T21:06:12.935 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001530106 2024-04-18T21:06:12.935 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.935 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.935 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:12.935 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660983+0000", 2024-04-18T21:06:12.935 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0516999999999999e-05 2024-04-18T21:06:12.935 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.935 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.936 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:12.936 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661141+0000", 2024-04-18T21:06:12.936 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015730799999999999 2024-04-18T21:06:12.936 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:12.936 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:12.936 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:12.936 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.936 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.936 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:06:12.936 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:06:12.936 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 67.191408085999996, 2024-04-18T21:06:12.936 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001812311, 2024-04-18T21:06:12.936 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:12.936 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:12.936 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:12.937 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:12.937 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.937 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:12.937 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:06:12.937 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:12.937 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.937 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.937 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:12.937 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:06:12.937 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:12.937 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.937 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.937 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:12.937 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659616+0000", 2024-04-18T21:06:12.938 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.277e-06 2024-04-18T21:06:12.938 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.938 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.938 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:12.938 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659625+0000", 2024-04-18T21:06:12.938 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5359999999999998e-06 2024-04-18T21:06:12.938 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.938 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.938 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:12.938 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659647+0000", 2024-04-18T21:06:12.938 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1857000000000001e-05 2024-04-18T21:06:12.938 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.938 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.939 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:12.939 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659664+0000", 2024-04-18T21:06:12.939 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6405999999999998e-05 2024-04-18T21:06:12.939 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.939 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.939 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:12.939 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661169+0000", 2024-04-18T21:06:12.939 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015054179999999999 2024-04-18T21:06:12.939 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.939 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.939 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:12.939 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661177+0000", 2024-04-18T21:06:12.939 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9680000000000006e-06 2024-04-18T21:06:12.939 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.940 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.940 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:12.940 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661427+0000", 2024-04-18T21:06:12.940 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024984900000000001 2024-04-18T21:06:12.940 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:12.940 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:12.940 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:12.940 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.940 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.940 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-18T21:06:12.940 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:06:12.940 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 65.238487477999996, 2024-04-18T21:06:12.940 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0030975030000000001, 2024-04-18T21:06:12.941 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:12.941 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:12.941 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:12.941 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:12.941 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.941 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:12.941 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:06:12.941 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:12.941 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.941 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.941 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:12.941 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:06:12.942 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:12.942 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.942 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.942 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:12.942 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612538+0000", 2024-04-18T21:06:12.942 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6259999999999999e-06 2024-04-18T21:06:12.942 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.942 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.942 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:12.942 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612552+0000", 2024-04-18T21:06:12.942 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4073999999999999e-05 2024-04-18T21:06:12.942 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.942 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.943 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:12.943 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612585+0000", 2024-04-18T21:06:12.943 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3504999999999999e-05 2024-04-18T21:06:12.943 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.943 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.943 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:12.943 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612601+0000", 2024-04-18T21:06:12.943 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5194000000000001e-05 2024-04-18T21:06:12.943 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.943 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.943 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:12.943 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612746+0000", 2024-04-18T21:06:12.943 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145666 2024-04-18T21:06:12.943 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.943 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.943 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:12.943 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612953+0000", 2024-04-18T21:06:12.944 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000207109 2024-04-18T21:06:12.944 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.944 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.944 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:12.944 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.613134+0000", 2024-04-18T21:06:12.944 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018041300000000001 2024-04-18T21:06:12.944 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.944 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.944 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:12.944 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.614411+0000", 2024-04-18T21:06:12.944 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0012769929999999999 2024-04-18T21:06:12.944 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.944 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.944 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:12.944 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615441+0000", 2024-04-18T21:06:12.944 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001029917 2024-04-18T21:06:12.945 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.945 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.945 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:12.945 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615522+0000", 2024-04-18T21:06:12.945 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1142000000000003e-05 2024-04-18T21:06:12.945 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.945 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.945 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:12.945 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615633+0000", 2024-04-18T21:06:12.945 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000110864 2024-04-18T21:06:12.945 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:12.945 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:12.946 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:12.946 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.946 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.946 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-18T21:06:12.946 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:06:12.946 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 47.236201667000003, 2024-04-18T21:06:12.946 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088979039999999999, 2024-04-18T21:06:12.946 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:12.946 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:12.946 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:12.946 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:12.946 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.947 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:12.947 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:06:12.947 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:12.947 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.947 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.947 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:12.947 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:06:12.947 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:12.947 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.947 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.947 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:12.947 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614825+0000", 2024-04-18T21:06:12.947 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4829999999999999e-06 2024-04-18T21:06:12.947 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.948 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.948 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:12.948 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614843+0000", 2024-04-18T21:06:12.948 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8777e-05 2024-04-18T21:06:12.948 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.948 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.948 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:12.948 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614884+0000", 2024-04-18T21:06:12.948 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1051999999999999e-05 2024-04-18T21:06:12.948 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.948 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.948 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:12.948 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614903+0000", 2024-04-18T21:06:12.948 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9069999999999999e-05 2024-04-18T21:06:12.949 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.949 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.949 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:12.949 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615047+0000", 2024-04-18T21:06:12.949 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014374400000000001 2024-04-18T21:06:12.949 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.949 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.949 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:12.949 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615061+0000", 2024-04-18T21:06:12.949 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4063000000000001e-05 2024-04-18T21:06:12.949 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.949 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.949 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:12.949 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621064+0000", 2024-04-18T21:06:12.949 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0060029200000000001 2024-04-18T21:06:12.950 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.950 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.950 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:12.950 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621211+0000", 2024-04-18T21:06:12.950 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000147224 2024-04-18T21:06:12.950 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.950 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.950 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:12.950 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621396+0000", 2024-04-18T21:06:12.950 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018454699999999999 2024-04-18T21:06:12.950 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.950 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.950 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:12.950 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.622517+0000", 2024-04-18T21:06:12.951 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001121424 2024-04-18T21:06:12.951 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.951 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.951 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:12.951 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623571+0000", 2024-04-18T21:06:12.951 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010538660000000001 2024-04-18T21:06:12.951 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.951 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.951 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:12.951 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623658+0000", 2024-04-18T21:06:12.951 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6439000000000004e-05 2024-04-18T21:06:12.951 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:12.951 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:12.951 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:12.952 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623719+0000", 2024-04-18T21:06:12.952 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1295000000000002e-05 2024-04-18T21:06:12.952 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:12.952 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:12.952 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:12.952 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:12.952 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:12.952 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:12.954 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:12.954 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:12.954+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:13.055 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:13.055+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:13.084 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:13.084 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:06:13.084 INFO:teuthology.orchestra.run.smithi132.stdout: "num_ops": 0 2024-04-18T21:06:13.084 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:13.098 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:13.113 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-18T21:06:13.113 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-18T21:06:13.113 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-04-18T21:06:13.113 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-18T21:06:13.113 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-18T21:06:13.113 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-04-18T21:06:13.191 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:13.190+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:13.220 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:13.220 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:06:13.220 INFO:teuthology.orchestra.run.smithi132.stdout: "complaint_time": 30, 2024-04-18T21:06:13.220 INFO:teuthology.orchestra.run.smithi132.stdout: "num_blocked_ops": 0 2024-04-18T21:06:13.220 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:13.235 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:13.262 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:13.262 INFO:teuthology.orchestra.run.smithi132.stdout: "success": "" 2024-04-18T21:06:13.262 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:13.262 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:13.258+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:13.357 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:13.359+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:13.380 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:13.380 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 20, 2024-04-18T21:06:13.380 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 600, 2024-04-18T21:06:13.380 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [ 2024-04-18T21:06:13.380 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.380 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:13.380 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:06:13.380 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 78.467844145000001, 2024-04-18T21:06:13.380 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.02518273, 2024-04-18T21:06:13.380 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:13.380 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:13.381 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:13.381 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:13.381 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:13.381 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:13.381 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 141 2024-04-18T21:06:13.381 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.381 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:13.381 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.381 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:13.381 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:06:13.381 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:13.381 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.381 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.381 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:13.382 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:06:13.382 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:13.382 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.382 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.382 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:13.382 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911562+0000", 2024-04-18T21:06:13.382 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9300000000000006e-07 2024-04-18T21:06:13.382 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.382 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.382 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:13.382 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911569+0000", 2024-04-18T21:06:13.382 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0169999999999999e-06 2024-04-18T21:06:13.382 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.383 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.383 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:13.383 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911582+0000", 2024-04-18T21:06:13.383 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.343e-05 2024-04-18T21:06:13.383 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.383 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.383 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:13.383 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911590+0000", 2024-04-18T21:06:13.383 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.413e-06 2024-04-18T21:06:13.383 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.383 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.383 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:13.383 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.933922+0000", 2024-04-18T21:06:13.384 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.022332093000000001 2024-04-18T21:06:13.384 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.384 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.384 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:13.384 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.934155+0000", 2024-04-18T21:06:13.384 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023378900000000001 2024-04-18T21:06:13.384 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.384 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.384 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:13.384 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.934514+0000", 2024-04-18T21:06:13.384 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00035859200000000003 2024-04-18T21:06:13.384 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.384 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.384 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:13.384 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.935973+0000", 2024-04-18T21:06:13.385 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001458705 2024-04-18T21:06:13.385 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.385 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.385 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:13.385 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936488+0000", 2024-04-18T21:06:13.385 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00051550000000000001 2024-04-18T21:06:13.385 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.385 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.385 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:13.385 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936636+0000", 2024-04-18T21:06:13.385 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014779800000000001 2024-04-18T21:06:13.385 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.385 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.385 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:13.385 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936743+0000", 2024-04-18T21:06:13.386 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010739999999999999 2024-04-18T21:06:13.386 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:13.386 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:13.386 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:13.386 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.386 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.386 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:13.386 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:13.386 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 78.350645170999996, 2024-04-18T21:06:13.386 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023654959999999999, 2024-04-18T21:06:13.386 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:13.386 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:13.386 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:13.386 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:13.387 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:13.387 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:13.387 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 163 2024-04-18T21:06:13.387 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.387 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:13.387 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.387 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:13.387 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:13.387 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:13.387 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.387 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.387 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:13.387 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:13.388 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:13.388 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.388 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.388 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:13.388 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:13.388 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0999999999999998e-07 2024-04-18T21:06:13.388 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.388 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.388 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:13.388 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028766+0000", 2024-04-18T21:06:13.388 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4700000000000001e-06 2024-04-18T21:06:13.388 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.388 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.388 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:13.389 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028775+0000", 2024-04-18T21:06:13.389 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.3190000000000001e-06 2024-04-18T21:06:13.389 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.389 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.389 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:13.389 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028782+0000", 2024-04-18T21:06:13.389 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.2300000000000002e-06 2024-04-18T21:06:13.389 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.389 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.389 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:13.389 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046667+0000", 2024-04-18T21:06:13.389 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017884356000000001 2024-04-18T21:06:13.389 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.389 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.389 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:13.390 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046788+0000", 2024-04-18T21:06:13.390 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012125000000000001 2024-04-18T21:06:13.390 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.390 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.390 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:13.390 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046982+0000", 2024-04-18T21:06:13.390 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019394 2024-04-18T21:06:13.390 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.390 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.390 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:13.390 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051969+0000", 2024-04-18T21:06:13.390 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0049868150000000003 2024-04-18T21:06:13.390 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.390 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.390 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:13.391 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052089+0000", 2024-04-18T21:06:13.391 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011993 2024-04-18T21:06:13.391 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.391 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.391 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:13.391 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052292+0000", 2024-04-18T21:06:13.391 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020345699999999999 2024-04-18T21:06:13.391 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.391 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.391 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:13.391 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052415+0000", 2024-04-18T21:06:13.391 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000122483 2024-04-18T21:06:13.391 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:13.391 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:13.391 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:13.392 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.392 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.392 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:13.392 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:13.392 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 78.350610939000006, 2024-04-18T21:06:13.392 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023864586, 2024-04-18T21:06:13.392 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:13.392 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:13.392 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:13.392 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:13.392 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:13.392 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:13.392 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 164 2024-04-18T21:06:13.392 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.392 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:13.392 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.393 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:13.393 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:13.393 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:13.393 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.393 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.393 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:13.393 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:13.393 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:13.393 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.393 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.393 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:13.393 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028795+0000", 2024-04-18T21:06:13.393 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7999999999999995e-07 2024-04-18T21:06:13.393 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.394 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.394 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:13.394 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028884+0000", 2024-04-18T21:06:13.394 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8997000000000002e-05 2024-04-18T21:06:13.394 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.394 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.394 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:13.394 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028895+0000", 2024-04-18T21:06:13.394 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1647e-05 2024-04-18T21:06:13.394 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.394 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.394 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:13.394 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028903+0000", 2024-04-18T21:06:13.394 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.909e-06 2024-04-18T21:06:13.395 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.395 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.395 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:13.395 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.047818+0000", 2024-04-18T21:06:13.395 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018914337 2024-04-18T21:06:13.395 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.395 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.395 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:13.395 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.048094+0000", 2024-04-18T21:06:13.395 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00027653500000000001 2024-04-18T21:06:13.395 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.395 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.395 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:13.395 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.048471+0000", 2024-04-18T21:06:13.395 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00037705799999999999 2024-04-18T21:06:13.396 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.396 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.396 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:13.396 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052516+0000", 2024-04-18T21:06:13.396 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0040452739999999997 2024-04-18T21:06:13.396 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.396 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.396 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:13.396 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052535+0000", 2024-04-18T21:06:13.396 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.84e-05 2024-04-18T21:06:13.396 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.396 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.396 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:13.396 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052603+0000", 2024-04-18T21:06:13.396 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.8095000000000004e-05 2024-04-18T21:06:13.397 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.397 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.397 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:13.397 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052659+0000", 2024-04-18T21:06:13.397 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5653999999999999e-05 2024-04-18T21:06:13.397 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:13.397 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:13.397 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:13.397 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.397 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.397 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:13.397 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:13.397 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 78.350487496, 2024-04-18T21:06:13.397 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024516458000000001, 2024-04-18T21:06:13.397 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:13.398 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:13.398 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:13.398 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:13.398 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:13.398 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:13.398 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 165 2024-04-18T21:06:13.398 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.398 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:13.398 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.398 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:13.398 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:13.398 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:13.398 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.398 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.399 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:13.399 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:13.399 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:13.399 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.399 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.399 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:13.399 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028918+0000", 2024-04-18T21:06:13.399 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8000000000000005e-07 2024-04-18T21:06:13.399 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.399 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.399 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:13.399 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028924+0000", 2024-04-18T21:06:13.399 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5659999999999997e-06 2024-04-18T21:06:13.400 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.400 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.400 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:13.400 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028933+0000", 2024-04-18T21:06:13.400 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.38e-06 2024-04-18T21:06:13.400 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.400 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.400 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:13.400 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028940+0000", 2024-04-18T21:06:13.400 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0060000000000003e-06 2024-04-18T21:06:13.400 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.400 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.400 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:13.400 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.050846+0000", 2024-04-18T21:06:13.400 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021906119000000002 2024-04-18T21:06:13.400 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.401 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.401 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:13.401 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051025+0000", 2024-04-18T21:06:13.401 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017850799999999999 2024-04-18T21:06:13.401 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.401 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.401 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:13.401 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051221+0000", 2024-04-18T21:06:13.401 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019608700000000001 2024-04-18T21:06:13.401 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.401 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.401 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:13.401 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052675+0000", 2024-04-18T21:06:13.401 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0014537899999999999 2024-04-18T21:06:13.401 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.401 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.402 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:13.402 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053311+0000", 2024-04-18T21:06:13.402 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00063613299999999999 2024-04-18T21:06:13.402 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.402 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.402 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:13.402 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053381+0000", 2024-04-18T21:06:13.402 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0074999999999996e-05 2024-04-18T21:06:13.402 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.402 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.402 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:13.402 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053434+0000", 2024-04-18T21:06:13.402 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3013999999999998e-05 2024-04-18T21:06:13.403 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:13.403 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:13.403 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:13.403 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.403 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.403 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:13.403 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:13.403 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 78.237182016999995, 2024-04-18T21:06:13.403 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023772793, 2024-04-18T21:06:13.403 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:13.403 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:13.403 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:13.403 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:13.404 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:13.404 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:13.404 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 187 2024-04-18T21:06:13.404 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.404 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:13.404 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.404 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:13.404 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:13.404 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:13.404 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.404 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.404 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:13.404 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:13.404 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:13.404 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.405 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.405 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:13.405 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142224+0000", 2024-04-18T21:06:13.405 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.47e-07 2024-04-18T21:06:13.405 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.405 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.405 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:13.405 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142233+0000", 2024-04-18T21:06:13.405 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0729999999999994e-06 2024-04-18T21:06:13.405 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.405 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.405 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:13.405 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142255+0000", 2024-04-18T21:06:13.405 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.2535999999999999e-05 2024-04-18T21:06:13.405 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.406 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.406 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:13.406 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142268+0000", 2024-04-18T21:06:13.406 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2686e-05 2024-04-18T21:06:13.406 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.406 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.406 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:13.406 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160497+0000", 2024-04-18T21:06:13.406 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018228779000000001 2024-04-18T21:06:13.406 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.406 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.406 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:13.406 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160634+0000", 2024-04-18T21:06:13.407 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000137315 2024-04-18T21:06:13.407 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.407 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.407 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:13.407 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160831+0000", 2024-04-18T21:06:13.407 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019683100000000001 2024-04-18T21:06:13.407 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.407 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.407 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:13.407 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165129+0000", 2024-04-18T21:06:13.407 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0042981299999999998 2024-04-18T21:06:13.407 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.407 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.407 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:13.408 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165776+0000", 2024-04-18T21:06:13.408 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00064702900000000003 2024-04-18T21:06:13.408 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.408 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.408 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:13.408 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165921+0000", 2024-04-18T21:06:13.408 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014506 2024-04-18T21:06:13.408 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.408 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.408 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:13.408 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165996+0000", 2024-04-18T21:06:13.408 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.4406999999999994e-05 2024-04-18T21:06:13.408 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:13.408 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:13.409 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:13.409 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.409 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.409 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:13.409 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:13.409 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 78.237121419000005, 2024-04-18T21:06:13.409 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026802157, 2024-04-18T21:06:13.409 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:13.409 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:13.409 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:13.409 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:13.409 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:13.409 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:13.410 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 188 2024-04-18T21:06:13.410 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.410 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:13.410 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.410 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:13.410 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:13.410 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:13.410 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.410 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.410 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:13.410 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:13.410 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:13.410 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.410 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.411 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:13.411 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142284+0000", 2024-04-18T21:06:13.411 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4e-07 2024-04-18T21:06:13.411 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.411 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.411 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:13.411 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142374+0000", 2024-04-18T21:06:13.411 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0099999999999995e-05 2024-04-18T21:06:13.411 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.411 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.411 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:13.411 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142386+0000", 2024-04-18T21:06:13.411 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1770000000000001e-05 2024-04-18T21:06:13.411 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.412 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.412 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:13.412 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142394+0000", 2024-04-18T21:06:13.412 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.2130000000000008e-06 2024-04-18T21:06:13.412 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.412 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.412 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:13.412 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.161743+0000", 2024-04-18T21:06:13.412 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019348644000000002 2024-04-18T21:06:13.412 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.412 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.412 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:13.412 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.161865+0000", 2024-04-18T21:06:13.413 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012210899999999999 2024-04-18T21:06:13.413 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.413 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.413 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:13.413 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.162055+0000", 2024-04-18T21:06:13.413 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000189994 2024-04-18T21:06:13.413 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.413 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.413 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:13.413 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165735+0000", 2024-04-18T21:06:13.413 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0036803270000000002 2024-04-18T21:06:13.413 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.413 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.414 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:13.414 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.168911+0000", 2024-04-18T21:06:13.414 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0031753689999999999 2024-04-18T21:06:13.414 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.414 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.414 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:13.414 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169012+0000", 2024-04-18T21:06:13.414 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010157699999999999 2024-04-18T21:06:13.414 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.414 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.414 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:13.414 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169086+0000", 2024-04-18T21:06:13.414 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3213999999999994e-05 2024-04-18T21:06:13.414 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:13.415 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:13.415 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:13.415 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.415 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.415 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:13.415 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:13.415 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 78.236996113000004, 2024-04-18T21:06:13.415 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026811423000000001, 2024-04-18T21:06:13.415 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:13.415 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:13.415 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:13.415 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:13.415 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:13.415 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:13.415 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 189 2024-04-18T21:06:13.416 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.416 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:13.416 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.416 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:13.416 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:13.416 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:13.416 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.416 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.416 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:13.416 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:13.416 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:13.416 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.416 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.416 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:13.416 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142410+0000", 2024-04-18T21:06:13.417 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:06:13.417 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.417 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.417 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:13.417 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142415+0000", 2024-04-18T21:06:13.417 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.7939999999999999e-06 2024-04-18T21:06:13.417 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.417 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.417 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:13.417 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142470+0000", 2024-04-18T21:06:13.417 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4537999999999999e-05 2024-04-18T21:06:13.417 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.417 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.417 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:13.418 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142481+0000", 2024-04-18T21:06:13.418 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0966e-05 2024-04-18T21:06:13.418 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.418 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.418 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:13.418 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.163493+0000", 2024-04-18T21:06:13.418 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021012444000000002 2024-04-18T21:06:13.418 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.418 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.418 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:13.418 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.163727+0000", 2024-04-18T21:06:13.418 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000233339 2024-04-18T21:06:13.418 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.418 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.419 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:13.419 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.164102+0000", 2024-04-18T21:06:13.419 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000374872 2024-04-18T21:06:13.419 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.419 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.419 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:13.419 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.166528+0000", 2024-04-18T21:06:13.419 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0024258729999999998 2024-04-18T21:06:13.419 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.419 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.419 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:13.419 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169101+0000", 2024-04-18T21:06:13.419 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0025737680000000001 2024-04-18T21:06:13.420 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.420 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.420 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:13.420 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169171+0000", 2024-04-18T21:06:13.420 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0148000000000007e-05 2024-04-18T21:06:13.420 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.420 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.420 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:13.420 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169220+0000", 2024-04-18T21:06:13.420 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8767999999999998e-05 2024-04-18T21:06:13.420 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:13.420 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:13.420 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:13.420 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.421 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.421 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:13.421 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:13.421 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 67.763423560999996, 2024-04-18T21:06:13.421 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024082777999999999, 2024-04-18T21:06:13.421 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:13.421 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:13.421 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:13.421 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:13.421 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.421 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:13.421 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:13.421 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:13.422 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.422 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.422 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:13.422 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:13.422 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:13.422 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.422 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.422 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:13.422 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615984+0000", 2024-04-18T21:06:13.422 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.9869999999999999e-06 2024-04-18T21:06:13.422 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.422 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.422 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:13.422 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615999+0000", 2024-04-18T21:06:13.423 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4646e-05 2024-04-18T21:06:13.423 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.423 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.423 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:13.423 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616028+0000", 2024-04-18T21:06:13.423 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8952999999999999e-05 2024-04-18T21:06:13.423 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.423 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.423 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:13.423 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616052+0000", 2024-04-18T21:06:13.423 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.3941999999999999e-05 2024-04-18T21:06:13.423 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.423 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.423 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:13.424 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618010+0000", 2024-04-18T21:06:13.424 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0019581780000000001 2024-04-18T21:06:13.424 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.424 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.424 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:13.424 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618322+0000", 2024-04-18T21:06:13.424 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00031158899999999997 2024-04-18T21:06:13.424 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.424 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.424 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:13.424 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618587+0000", 2024-04-18T21:06:13.424 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00026495700000000002 2024-04-18T21:06:13.424 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.424 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.425 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:13.425 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629262+0000", 2024-04-18T21:06:13.425 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010675877 2024-04-18T21:06:13.425 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.425 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.425 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:13.425 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.639773+0000", 2024-04-18T21:06:13.425 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0105109 2024-04-18T21:06:13.425 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.425 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.425 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:13.425 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.639926+0000", 2024-04-18T21:06:13.425 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000152349 2024-04-18T21:06:13.426 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.426 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.426 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:13.426 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640064+0000", 2024-04-18T21:06:13.426 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0001384 2024-04-18T21:06:13.426 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:13.426 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:13.426 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:13.426 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.426 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.426 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:13.426 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:13.427 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 67.763310887000003, 2024-04-18T21:06:13.427 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030215005999999999, 2024-04-18T21:06:13.427 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:13.427 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:13.427 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:13.427 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:13.427 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.427 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:13.427 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:13.427 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:13.427 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.427 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.427 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:13.428 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:13.428 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:13.428 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.428 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.428 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:13.428 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616095+0000", 2024-04-18T21:06:13.428 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.446e-06 2024-04-18T21:06:13.428 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.428 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.428 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:13.428 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616104+0000", 2024-04-18T21:06:13.428 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6200000000000005e-06 2024-04-18T21:06:13.428 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.428 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.428 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:13.429 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616132+0000", 2024-04-18T21:06:13.429 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7668999999999999e-05 2024-04-18T21:06:13.429 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.429 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.429 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:13.429 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616149+0000", 2024-04-18T21:06:13.429 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7047000000000001e-05 2024-04-18T21:06:13.429 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.429 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.429 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:13.429 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619287+0000", 2024-04-18T21:06:13.429 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0031381450000000002 2024-04-18T21:06:13.429 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.429 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.430 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:13.430 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619503+0000", 2024-04-18T21:06:13.430 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000216522 2024-04-18T21:06:13.430 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.430 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.430 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:13.430 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619930+0000", 2024-04-18T21:06:13.430 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00042604900000000001 2024-04-18T21:06:13.430 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.430 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.430 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:13.430 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629281+0000", 2024-04-18T21:06:13.430 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0093512230000000005 2024-04-18T21:06:13.431 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.431 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.431 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:13.431 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646022+0000", 2024-04-18T21:06:13.431 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016741156 2024-04-18T21:06:13.431 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.431 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.431 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:13.431 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646198+0000", 2024-04-18T21:06:13.431 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000176009 2024-04-18T21:06:13.432 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.432 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.432 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:13.432 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646309+0000", 2024-04-18T21:06:13.432 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011112000000000001 2024-04-18T21:06:13.432 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:13.432 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:13.432 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:13.432 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.432 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.432 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:13.432 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:13.432 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 67.763226063000005, 2024-04-18T21:06:13.432 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030501176000000001, 2024-04-18T21:06:13.433 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:13.433 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:13.433 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:13.433 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:13.433 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.433 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:13.433 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:13.433 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:13.433 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.433 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.433 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:13.433 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:13.433 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:13.434 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.434 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.434 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:13.434 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616180+0000", 2024-04-18T21:06:13.434 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1000000000000001e-06 2024-04-18T21:06:13.434 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.434 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.434 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:13.434 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616188+0000", 2024-04-18T21:06:13.434 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4069999999999993e-06 2024-04-18T21:06:13.434 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.434 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.434 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:13.435 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616207+0000", 2024-04-18T21:06:13.435 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8335999999999999e-05 2024-04-18T21:06:13.435 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.435 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.435 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:13.435 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616225+0000", 2024-04-18T21:06:13.435 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8652999999999999e-05 2024-04-18T21:06:13.435 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.435 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.435 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:13.435 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620977+0000", 2024-04-18T21:06:13.435 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047512220000000003 2024-04-18T21:06:13.435 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.436 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.436 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:13.436 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621279+0000", 2024-04-18T21:06:13.436 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000302646 2024-04-18T21:06:13.436 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.436 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.436 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:13.436 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621584+0000", 2024-04-18T21:06:13.436 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000305142 2024-04-18T21:06:13.436 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.436 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.436 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:13.436 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629352+0000", 2024-04-18T21:06:13.436 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0077673689999999997 2024-04-18T21:06:13.437 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.437 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.437 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:13.437 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646480+0000", 2024-04-18T21:06:13.437 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017128259 2024-04-18T21:06:13.437 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.437 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.437 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:13.437 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646591+0000", 2024-04-18T21:06:13.437 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011113899999999999 2024-04-18T21:06:13.437 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.437 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.438 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:13.438 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646680+0000", 2024-04-18T21:06:13.438 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8902999999999999e-05 2024-04-18T21:06:13.438 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:13.438 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:13.438 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:13.438 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.438 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.438 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:13.438 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:13.438 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 67.763159564000006, 2024-04-18T21:06:13.438 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030779760999999999, 2024-04-18T21:06:13.439 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:13.439 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:13.439 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:13.439 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:13.439 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.439 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:13.439 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:13.439 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:13.439 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.439 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.439 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:13.439 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:13.439 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:13.439 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.440 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.440 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:13.440 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616246+0000", 2024-04-18T21:06:13.440 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0499999999999999e-06 2024-04-18T21:06:13.440 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.440 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.440 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:13.440 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616253+0000", 2024-04-18T21:06:13.440 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.5989999999999998e-06 2024-04-18T21:06:13.440 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.440 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.440 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:13.440 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616273+0000", 2024-04-18T21:06:13.441 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9916999999999999e-05 2024-04-18T21:06:13.441 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.441 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.441 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:13.441 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616287+0000", 2024-04-18T21:06:13.441 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3669000000000001e-05 2024-04-18T21:06:13.441 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.441 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.441 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:13.441 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622203+0000", 2024-04-18T21:06:13.441 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.005916737 2024-04-18T21:06:13.441 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.442 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.442 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:13.442 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622379+0000", 2024-04-18T21:06:13.442 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000175596 2024-04-18T21:06:13.442 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.442 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.442 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:13.442 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622707+0000", 2024-04-18T21:06:13.442 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00032784600000000002 2024-04-18T21:06:13.442 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.442 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.442 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:13.442 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629366+0000", 2024-04-18T21:06:13.443 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0066593279999999999 2024-04-18T21:06:13.443 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.443 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.443 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:13.443 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646813+0000", 2024-04-18T21:06:13.443 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017447059000000001 2024-04-18T21:06:13.443 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.443 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.443 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:13.443 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646946+0000", 2024-04-18T21:06:13.443 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013301200000000001 2024-04-18T21:06:13.443 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.443 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.443 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:13.443 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647025+0000", 2024-04-18T21:06:13.443 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8948000000000004e-05 2024-04-18T21:06:13.444 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:13.444 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:13.444 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:13.444 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.444 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.444 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:13.444 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:13.444 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 67.763075745999998, 2024-04-18T21:06:13.444 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.031512165000000002, 2024-04-18T21:06:13.444 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:13.444 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:13.444 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:13.444 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:13.444 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.444 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:13.445 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:13.445 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:13.445 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.445 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.445 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:13.445 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:13.445 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:13.445 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.445 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.445 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:13.445 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616330+0000", 2024-04-18T21:06:13.445 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.15e-06 2024-04-18T21:06:13.445 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.445 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.446 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:13.446 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616337+0000", 2024-04-18T21:06:13.446 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.1289999999999998e-06 2024-04-18T21:06:13.446 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.446 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.446 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:13.446 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616447+0000", 2024-04-18T21:06:13.446 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109561 2024-04-18T21:06:13.446 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.446 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.446 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:13.446 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616496+0000", 2024-04-18T21:06:13.446 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8591999999999998e-05 2024-04-18T21:06:13.447 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.447 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.447 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:13.447 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.623786+0000", 2024-04-18T21:06:13.447 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0072906799999999999 2024-04-18T21:06:13.447 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.447 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.447 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:13.447 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.623973+0000", 2024-04-18T21:06:13.447 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018717199999999999 2024-04-18T21:06:13.447 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.447 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.447 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:13.447 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624260+0000", 2024-04-18T21:06:13.448 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00028630600000000001 2024-04-18T21:06:13.448 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.448 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.448 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:13.448 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629381+0000", 2024-04-18T21:06:13.448 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0051211340000000003 2024-04-18T21:06:13.448 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.448 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.448 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:13.448 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647631+0000", 2024-04-18T21:06:13.448 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018249771000000001 2024-04-18T21:06:13.448 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.448 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.448 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:13.449 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647761+0000", 2024-04-18T21:06:13.449 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013037300000000001 2024-04-18T21:06:13.449 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.449 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.449 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:13.449 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647841+0000", 2024-04-18T21:06:13.449 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.0296999999999994e-05 2024-04-18T21:06:13.449 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:13.449 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:13.449 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:13.449 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.449 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.449 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:13.449 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:13.450 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 67.762870262000007, 2024-04-18T21:06:13.450 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043251955000000002, 2024-04-18T21:06:13.450 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:13.450 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:13.450 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:13.450 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:13.450 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.450 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:13.450 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:13.450 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:13.450 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.450 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.450 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:13.450 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:13.451 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:13.451 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.451 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.451 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:13.451 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616536+0000", 2024-04-18T21:06:13.451 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2869999999999999e-06 2024-04-18T21:06:13.451 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.451 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.451 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:13.451 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616572+0000", 2024-04-18T21:06:13.451 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.6261999999999999e-05 2024-04-18T21:06:13.451 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.451 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.451 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:13.452 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616593+0000", 2024-04-18T21:06:13.452 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1310000000000001e-05 2024-04-18T21:06:13.452 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.452 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.452 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:13.452 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616614+0000", 2024-04-18T21:06:13.452 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.0936000000000001e-05 2024-04-18T21:06:13.452 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.452 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.452 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:13.452 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629501+0000", 2024-04-18T21:06:13.452 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.012886819000000001 2024-04-18T21:06:13.452 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.452 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.453 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:13.453 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629696+0000", 2024-04-18T21:06:13.453 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019485499999999999 2024-04-18T21:06:13.453 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.453 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.453 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:13.453 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629940+0000", 2024-04-18T21:06:13.453 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00024386399999999999 2024-04-18T21:06:13.453 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.453 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.453 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:13.453 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640100+0000", 2024-04-18T21:06:13.453 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010159645 2024-04-18T21:06:13.453 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.453 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.454 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:13.454 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659516+0000", 2024-04-18T21:06:13.454 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019416563000000001 2024-04-18T21:06:13.454 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.454 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.454 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:13.454 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659684+0000", 2024-04-18T21:06:13.454 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016750900000000001 2024-04-18T21:06:13.454 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.454 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.454 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:13.454 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659787+0000", 2024-04-18T21:06:13.454 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000102905 2024-04-18T21:06:13.454 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:13.455 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:13.455 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:13.455 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.455 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.455 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:13.455 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:13.455 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 67.762765139999999, 2024-04-18T21:06:13.455 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043581898000000001, 2024-04-18T21:06:13.455 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:13.455 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:13.455 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:13.455 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:13.455 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.455 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:13.455 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:13.455 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:13.456 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.456 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.456 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:13.456 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:13.456 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:13.456 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.456 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.456 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:13.456 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616641+0000", 2024-04-18T21:06:13.456 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:06:13.456 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.456 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.456 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:13.456 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616648+0000", 2024-04-18T21:06:13.456 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3860000000000001e-06 2024-04-18T21:06:13.456 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.457 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.457 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:13.457 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616666+0000", 2024-04-18T21:06:13.457 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7583000000000001e-05 2024-04-18T21:06:13.457 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.457 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.457 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:13.457 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616679+0000", 2024-04-18T21:06:13.457 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3322999999999999e-05 2024-04-18T21:06:13.457 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.457 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.457 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:13.457 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630373+0000", 2024-04-18T21:06:13.457 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013694207999999999 2024-04-18T21:06:13.457 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.458 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.458 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:13.458 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630545+0000", 2024-04-18T21:06:13.458 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000171683 2024-04-18T21:06:13.458 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.458 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.458 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:13.458 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630728+0000", 2024-04-18T21:06:13.458 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000182599 2024-04-18T21:06:13.458 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.458 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.458 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:13.458 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640600+0000", 2024-04-18T21:06:13.459 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0098726119999999994 2024-04-18T21:06:13.459 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.459 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.459 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:13.459 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659927+0000", 2024-04-18T21:06:13.459 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019326724999999999 2024-04-18T21:06:13.459 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.459 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.459 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:13.459 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660112+0000", 2024-04-18T21:06:13.459 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000185203 2024-04-18T21:06:13.460 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.460 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.460 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:13.460 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660222+0000", 2024-04-18T21:06:13.460 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109343 2024-04-18T21:06:13.460 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:13.460 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:13.460 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:13.460 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.460 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.460 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:13.460 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:13.460 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 67.761899782, 2024-04-18T21:06:13.461 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043121310000000003, 2024-04-18T21:06:13.461 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:13.461 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:13.461 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:13.461 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:13.461 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.461 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:13.461 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:13.461 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:13.461 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.461 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.461 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:13.461 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:13.462 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:13.462 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.462 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.462 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:13.462 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617506+0000", 2024-04-18T21:06:13.462 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9999999999999995e-07 2024-04-18T21:06:13.462 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.462 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.462 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:13.462 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617513+0000", 2024-04-18T21:06:13.462 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.9700000000000002e-06 2024-04-18T21:06:13.462 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.462 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.463 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:13.463 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617531+0000", 2024-04-18T21:06:13.463 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8105999999999999e-05 2024-04-18T21:06:13.463 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.463 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.463 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:13.463 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617545+0000", 2024-04-18T21:06:13.463 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3703000000000001e-05 2024-04-18T21:06:13.463 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.463 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.463 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:13.463 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632129+0000", 2024-04-18T21:06:13.463 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.014584135999999999 2024-04-18T21:06:13.463 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.464 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.464 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:13.464 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632361+0000", 2024-04-18T21:06:13.464 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023171800000000001 2024-04-18T21:06:13.464 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.464 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.464 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:13.464 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632804+0000", 2024-04-18T21:06:13.464 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000443549 2024-04-18T21:06:13.464 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.464 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.464 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:13.464 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646340+0000", 2024-04-18T21:06:13.464 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013535902000000001 2024-04-18T21:06:13.464 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.464 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.465 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:13.465 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660363+0000", 2024-04-18T21:06:13.465 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01402318 2024-04-18T21:06:13.465 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.465 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.465 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:13.465 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660523+0000", 2024-04-18T21:06:13.465 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00015989899999999999 2024-04-18T21:06:13.465 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.465 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.465 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:13.465 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660626+0000", 2024-04-18T21:06:13.465 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010314699999999999 2024-04-18T21:06:13.465 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:13.465 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:13.466 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:13.466 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.466 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.466 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:13.466 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:13.466 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 67.761760089000006, 2024-04-18T21:06:13.466 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024927483, 2024-04-18T21:06:13.466 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:13.466 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:13.466 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:13.466 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:13.466 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.466 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:13.466 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:13.467 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:13.467 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.467 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.467 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:13.467 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:13.467 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:13.467 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.467 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.467 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:13.467 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617646+0000", 2024-04-18T21:06:13.467 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3030000000000001e-06 2024-04-18T21:06:13.467 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.467 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.467 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:13.467 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617653+0000", 2024-04-18T21:06:13.468 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7530000000000004e-06 2024-04-18T21:06:13.468 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.468 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.468 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:13.468 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617673+0000", 2024-04-18T21:06:13.468 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9967e-05 2024-04-18T21:06:13.468 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.468 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.468 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:13.468 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617688+0000", 2024-04-18T21:06:13.468 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5153e-05 2024-04-18T21:06:13.468 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.468 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.468 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:13.469 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619244+0000", 2024-04-18T21:06:13.469 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001555531 2024-04-18T21:06:13.469 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.469 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.469 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:13.469 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619361+0000", 2024-04-18T21:06:13.469 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011784400000000001 2024-04-18T21:06:13.469 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.469 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.469 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:13.469 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619604+0000", 2024-04-18T21:06:13.469 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000243007 2024-04-18T21:06:13.469 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.469 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.470 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:13.470 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.625480+0000", 2024-04-18T21:06:13.470 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0058759349999999997 2024-04-18T21:06:13.470 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.470 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.470 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:13.470 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642342+0000", 2024-04-18T21:06:13.470 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016861373999999998 2024-04-18T21:06:13.470 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.470 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.470 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:13.470 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642484+0000", 2024-04-18T21:06:13.470 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000142423 2024-04-18T21:06:13.470 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.471 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.471 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:13.471 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642572+0000", 2024-04-18T21:06:13.471 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8193000000000001e-05 2024-04-18T21:06:13.471 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:13.471 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:13.471 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:13.471 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.471 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.471 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:13.471 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:13.471 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 67.761478585999996, 2024-04-18T21:06:13.471 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024956974999999999, 2024-04-18T21:06:13.471 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:13.471 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:13.472 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:13.472 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:13.472 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.472 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:13.472 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:13.472 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:13.472 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.472 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.472 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:13.472 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:13.472 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:13.472 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.472 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.472 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:13.472 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617928+0000", 2024-04-18T21:06:13.473 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5430000000000001e-06 2024-04-18T21:06:13.473 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.473 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.473 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:13.473 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617937+0000", 2024-04-18T21:06:13.473 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6629999999999999e-06 2024-04-18T21:06:13.473 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.473 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.473 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:13.473 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617955+0000", 2024-04-18T21:06:13.473 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8749999999999998e-05 2024-04-18T21:06:13.473 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.473 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.474 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:13.474 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617971+0000", 2024-04-18T21:06:13.474 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.605e-05 2024-04-18T21:06:13.474 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.474 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.474 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:13.474 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621019+0000", 2024-04-18T21:06:13.474 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0030472369999999999 2024-04-18T21:06:13.474 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.474 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.474 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:13.474 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621249+0000", 2024-04-18T21:06:13.474 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000230075 2024-04-18T21:06:13.475 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.475 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.475 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:13.475 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621450+0000", 2024-04-18T21:06:13.475 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020166499999999999 2024-04-18T21:06:13.475 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.475 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.475 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:13.475 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.626233+0000", 2024-04-18T21:06:13.475 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047827390000000003 2024-04-18T21:06:13.475 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.475 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.475 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:13.475 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642693+0000", 2024-04-18T21:06:13.475 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01645961 2024-04-18T21:06:13.475 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.476 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.476 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:13.476 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642798+0000", 2024-04-18T21:06:13.476 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010559499999999999 2024-04-18T21:06:13.476 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.476 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.476 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:13.476 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642883+0000", 2024-04-18T21:06:13.476 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5048000000000003e-05 2024-04-18T21:06:13.476 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:13.476 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:13.476 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:13.476 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.476 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.477 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:13.477 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:13.477 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 67.759782958000002, 2024-04-18T21:06:13.477 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024086478000000001, 2024-04-18T21:06:13.477 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:13.477 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:13.477 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:13.477 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:13.477 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.477 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:13.477 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:13.477 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:13.477 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.477 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.478 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:13.478 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:13.478 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:13.478 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.478 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.478 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:13.478 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619624+0000", 2024-04-18T21:06:13.478 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.75e-06 2024-04-18T21:06:13.478 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.478 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.478 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:13.478 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619637+0000", 2024-04-18T21:06:13.479 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3540000000000001e-05 2024-04-18T21:06:13.479 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.479 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.479 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:13.479 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619666+0000", 2024-04-18T21:06:13.479 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8685999999999999e-05 2024-04-18T21:06:13.479 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.479 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.479 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:13.479 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619685+0000", 2024-04-18T21:06:13.479 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8681999999999998e-05 2024-04-18T21:06:13.479 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.479 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.479 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:13.480 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622275+0000", 2024-04-18T21:06:13.480 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0025899260000000002 2024-04-18T21:06:13.480 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.480 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.480 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:13.480 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622572+0000", 2024-04-18T21:06:13.480 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00029722 2024-04-18T21:06:13.480 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.480 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.480 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:13.480 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622752+0000", 2024-04-18T21:06:13.480 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018065900000000001 2024-04-18T21:06:13.480 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.480 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.480 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:13.481 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.626326+0000", 2024-04-18T21:06:13.481 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035737310000000001 2024-04-18T21:06:13.481 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.481 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.481 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:13.481 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643565+0000", 2024-04-18T21:06:13.481 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017238430999999999 2024-04-18T21:06:13.481 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.481 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.481 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:13.481 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643646+0000", 2024-04-18T21:06:13.481 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.1481000000000001e-05 2024-04-18T21:06:13.481 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.481 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.482 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:13.482 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643708+0000", 2024-04-18T21:06:13.482 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.2372000000000005e-05 2024-04-18T21:06:13.482 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:13.482 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:13.482 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:13.482 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.482 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.482 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:13.482 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:13.482 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 67.759616804999993, 2024-04-18T21:06:13.482 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026822450000000001, 2024-04-18T21:06:13.482 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:13.482 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:13.483 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:13.483 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:13.483 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.483 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:13.483 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:13.483 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:13.483 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.483 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.483 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:13.483 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:13.483 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:13.483 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.483 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.483 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:13.483 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619789+0000", 2024-04-18T21:06:13.484 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:06:13.484 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.484 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.484 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:13.484 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619797+0000", 2024-04-18T21:06:13.484 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.6899999999999992e-06 2024-04-18T21:06:13.484 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.484 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.484 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:13.484 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619816+0000", 2024-04-18T21:06:13.484 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9352999999999999e-05 2024-04-18T21:06:13.484 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.484 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.484 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:13.484 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619832+0000", 2024-04-18T21:06:13.484 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6013000000000001e-05 2024-04-18T21:06:13.485 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.485 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.485 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:13.485 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620528+0000", 2024-04-18T21:06:13.485 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00069565600000000001 2024-04-18T21:06:13.485 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.485 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.485 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:13.485 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620735+0000", 2024-04-18T21:06:13.485 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000207025 2024-04-18T21:06:13.485 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.485 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.485 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:13.485 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620912+0000", 2024-04-18T21:06:13.486 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017748199999999999 2024-04-18T21:06:13.486 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.486 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.486 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:13.486 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.625605+0000", 2024-04-18T21:06:13.486 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0046924439999999996 2024-04-18T21:06:13.486 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.486 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.486 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:13.486 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646349+0000", 2024-04-18T21:06:13.486 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.020744318000000001 2024-04-18T21:06:13.486 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.486 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.486 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:13.487 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646483+0000", 2024-04-18T21:06:13.487 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013428999999999999 2024-04-18T21:06:13.487 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.487 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.487 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:13.487 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646611+0000", 2024-04-18T21:06:13.487 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012710299999999999 2024-04-18T21:06:13.487 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:13.487 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:13.487 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:13.487 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.487 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.487 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:13.487 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:06:13.487 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 67.758946371999997, 2024-04-18T21:06:13.488 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023516516000000001, 2024-04-18T21:06:13.488 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:13.488 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:13.488 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:06:13.488 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:13.488 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.488 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:13.488 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:06:13.488 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:13.488 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.488 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.488 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:13.488 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:06:13.488 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:13.488 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.489 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.489 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:13.489 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620460+0000", 2024-04-18T21:06:13.489 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.787e-06 2024-04-18T21:06:13.489 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.489 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.489 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:13.489 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620470+0000", 2024-04-18T21:06:13.489 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.2560000000000008e-06 2024-04-18T21:06:13.489 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.489 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.489 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:13.489 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620496+0000", 2024-04-18T21:06:13.489 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.6205999999999999e-05 2024-04-18T21:06:13.490 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.490 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.490 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:13.490 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620517+0000", 2024-04-18T21:06:13.490 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1223e-05 2024-04-18T21:06:13.490 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.490 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.490 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:13.490 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624060+0000", 2024-04-18T21:06:13.490 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035434160000000002 2024-04-18T21:06:13.490 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.490 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.490 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:13.490 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624390+0000", 2024-04-18T21:06:13.491 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00033000500000000002 2024-04-18T21:06:13.491 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:13.491 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:13.491 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:13.491 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643975+0000", 2024-04-18T21:06:13.491 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019584622999999999 2024-04-18T21:06:13.491 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:13.491 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:13.491 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:13.491 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:13.491 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:13.491 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:13.493 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:13.493 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:13.491+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:13.591 INFO:teuthology.orchestra.run.smithi078.stderr:nodeep-scrub is set 2024-04-18T21:06:13.594 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:13.594+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:13.622 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:06:13.623 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [], 2024-04-18T21:06:13.623 INFO:teuthology.orchestra.run.smithi150.stdout: "num_ops": 0 2024-04-18T21:06:13.623 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:06:13.638 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:13.694 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:13.695+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:13.764 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:06:13.764 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [], 2024-04-18T21:06:13.764 INFO:teuthology.orchestra.run.smithi150.stdout: "complaint_time": 30, 2024-04-18T21:06:13.764 INFO:teuthology.orchestra.run.smithi150.stdout: "num_blocked_ops": 0 2024-04-18T21:06:13.764 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:06:13.779 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:13.795 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:13.794+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:13.895 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:13.894+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:13.950 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:06:13.950 INFO:teuthology.orchestra.run.smithi150.stdout: "size": 20, 2024-04-18T21:06:13.950 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 600, 2024-04-18T21:06:13.951 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [ 2024-04-18T21:06:13.951 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.951 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-18T21:06:13.951 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:06:13.951 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 79.147597400999999, 2024-04-18T21:06:13.951 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0093051590000000003, 2024-04-18T21:06:13.951 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:13.951 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:13.951 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:13.951 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:13.951 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.951 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:13.951 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:06:13.951 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:13.952 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.952 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.952 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:13.952 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:06:13.952 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:13.952 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.952 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.952 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:13.952 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804851+0000", 2024-04-18T21:06:13.952 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7039999999999999e-06 2024-04-18T21:06:13.952 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.952 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.952 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:13.952 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804864+0000", 2024-04-18T21:06:13.953 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.276e-05 2024-04-18T21:06:13.953 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.953 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.953 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:13.953 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804895+0000", 2024-04-18T21:06:13.953 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.1204999999999997e-05 2024-04-18T21:06:13.953 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.953 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.953 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:13.953 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804908+0000", 2024-04-18T21:06:13.953 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3317e-05 2024-04-18T21:06:13.953 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.953 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.953 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:13.954 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805131+0000", 2024-04-18T21:06:13.954 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00022246700000000001 2024-04-18T21:06:13.954 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.954 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.954 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:13.954 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805171+0000", 2024-04-18T21:06:13.954 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.0164999999999999e-05 2024-04-18T21:06:13.954 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.954 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.954 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:13.954 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814086+0000", 2024-04-18T21:06:13.954 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0089155329999999998 2024-04-18T21:06:13.955 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.955 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.955 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:13.955 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814154+0000", 2024-04-18T21:06:13.955 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.8008000000000003e-05 2024-04-18T21:06:13.955 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:13.955 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:13.955 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:13.955 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.955 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.955 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-18T21:06:13.955 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:06:13.955 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 79.146832208000006, 2024-04-18T21:06:13.955 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0086469770000000001, 2024-04-18T21:06:13.956 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:13.956 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:13.956 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:13.956 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:13.956 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.956 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:13.956 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:06:13.956 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:13.956 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.956 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.956 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:13.956 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:06:13.956 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:13.956 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.956 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.957 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:13.957 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805616+0000", 2024-04-18T21:06:13.957 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7799999999999999e-06 2024-04-18T21:06:13.957 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.957 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.957 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:13.957 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805707+0000", 2024-04-18T21:06:13.957 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0917999999999999e-05 2024-04-18T21:06:13.957 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.957 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.957 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:13.957 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805739+0000", 2024-04-18T21:06:13.957 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.2512000000000003e-05 2024-04-18T21:06:13.957 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.958 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.958 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:13.958 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805763+0000", 2024-04-18T21:06:13.958 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3266000000000001e-05 2024-04-18T21:06:13.958 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.958 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.958 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:13.958 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.806024+0000", 2024-04-18T21:06:13.958 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000261716 2024-04-18T21:06:13.958 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.958 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.958 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:13.959 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.806073+0000", 2024-04-18T21:06:13.959 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.8844999999999997e-05 2024-04-18T21:06:13.959 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.959 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.959 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:13.959 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814162+0000", 2024-04-18T21:06:13.959 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0080882860000000001 2024-04-18T21:06:13.959 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.959 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.959 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:13.959 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814261+0000", 2024-04-18T21:06:13.959 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.9654000000000005e-05 2024-04-18T21:06:13.959 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:13.960 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:13.960 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:13.960 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.960 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.960 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'64)", 2024-04-18T21:06:13.960 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:06:13.960 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 79.145061163999998, 2024-04-18T21:06:13.960 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0089721509999999994, 2024-04-18T21:06:13.960 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:13.960 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:13.960 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:13.960 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:13.960 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.960 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:13.960 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:06:13.961 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:13.961 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.961 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.961 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:13.961 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:06:13.961 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:13.961 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.961 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.961 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:13.961 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807387+0000", 2024-04-18T21:06:13.961 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.0329999999999998e-06 2024-04-18T21:06:13.961 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.961 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.961 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:13.961 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807443+0000", 2024-04-18T21:06:13.961 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.5376e-05 2024-04-18T21:06:13.962 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.962 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.962 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:13.962 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807467+0000", 2024-04-18T21:06:13.962 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.4621999999999999e-05 2024-04-18T21:06:13.962 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.962 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.962 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:13.962 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807482+0000", 2024-04-18T21:06:13.962 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.436e-05 2024-04-18T21:06:13.962 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.962 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.962 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:13.962 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.809243+0000", 2024-04-18T21:06:13.962 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001761725 2024-04-18T21:06:13.963 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.963 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.963 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:13.963 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.809295+0000", 2024-04-18T21:06:13.963 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.1445e-05 2024-04-18T21:06:13.963 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.963 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.963 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:13.963 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.816293+0000", 2024-04-18T21:06:13.963 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0069981749999999997 2024-04-18T21:06:13.963 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.963 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.963 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:13.963 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.816357+0000", 2024-04-18T21:06:13.963 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.4414999999999999e-05 2024-04-18T21:06:13.964 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:13.964 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:13.964 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:13.964 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.964 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.964 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:13.964 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:06:13.964 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 68.337151793999993, 2024-04-18T21:06:13.964 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.040843365, 2024-04-18T21:06:13.964 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:13.964 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:13.964 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:13.964 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:13.964 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.964 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:13.965 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:06:13.965 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:13.965 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.965 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.965 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:13.965 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:06:13.965 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:13.965 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.965 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.965 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:13.965 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615297+0000", 2024-04-18T21:06:13.965 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2800000000000002e-06 2024-04-18T21:06:13.965 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.965 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.966 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:13.966 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615308+0000", 2024-04-18T21:06:13.966 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0813e-05 2024-04-18T21:06:13.966 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.966 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.966 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:13.966 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615330+0000", 2024-04-18T21:06:13.966 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2370000000000001e-05 2024-04-18T21:06:13.966 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.966 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.966 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:13.966 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615346+0000", 2024-04-18T21:06:13.966 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6200000000000001e-05 2024-04-18T21:06:13.966 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.966 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.967 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:13.967 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615470+0000", 2024-04-18T21:06:13.967 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012385799999999999 2024-04-18T21:06:13.967 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.967 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.967 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:13.967 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615488+0000", 2024-04-18T21:06:13.967 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7923000000000001e-05 2024-04-18T21:06:13.967 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.967 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.967 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:13.967 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.630993+0000", 2024-04-18T21:06:13.967 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.01550532 2024-04-18T21:06:13.967 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.967 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.968 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:13.968 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631165+0000", 2024-04-18T21:06:13.968 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000171588 2024-04-18T21:06:13.968 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.968 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.968 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:13.968 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631320+0000", 2024-04-18T21:06:13.968 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000155162 2024-04-18T21:06:13.968 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.968 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.968 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:13.968 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635157+0000", 2024-04-18T21:06:13.968 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0038370790000000002 2024-04-18T21:06:13.968 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.968 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.969 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:13.969 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.655904+0000", 2024-04-18T21:06:13.969 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.020746483999999999 2024-04-18T21:06:13.969 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.969 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.969 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:13.969 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656032+0000", 2024-04-18T21:06:13.969 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012864199999999999 2024-04-18T21:06:13.969 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.969 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.969 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:13.969 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656138+0000", 2024-04-18T21:06:13.969 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000105646 2024-04-18T21:06:13.969 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:13.969 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:13.969 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:13.970 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.970 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.970 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:13.970 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:06:13.970 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 68.337059621999998, 2024-04-18T21:06:13.970 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.041266444999999999, 2024-04-18T21:06:13.970 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:13.970 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:13.970 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:13.970 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:13.970 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.970 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:13.970 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:06:13.970 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:13.970 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.971 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.971 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:13.971 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:06:13.971 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:13.971 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.971 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.971 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:13.971 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615388+0000", 2024-04-18T21:06:13.971 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:06:13.971 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.971 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.971 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:13.971 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:06:13.971 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.7299999999999994e-06 2024-04-18T21:06:13.971 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.972 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.972 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:13.972 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615415+0000", 2024-04-18T21:06:13.972 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7807000000000001e-05 2024-04-18T21:06:13.972 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.972 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.972 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:13.972 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615431+0000", 2024-04-18T21:06:13.972 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6127e-05 2024-04-18T21:06:13.972 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.972 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.972 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:13.972 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615621+0000", 2024-04-18T21:06:13.972 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000189781 2024-04-18T21:06:13.972 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.972 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.973 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:13.973 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615634+0000", 2024-04-18T21:06:13.973 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3383e-05 2024-04-18T21:06:13.973 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.973 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.973 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:13.973 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631703+0000", 2024-04-18T21:06:13.973 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016068737 2024-04-18T21:06:13.973 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.973 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.973 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:13.973 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631809+0000", 2024-04-18T21:06:13.973 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000106823 2024-04-18T21:06:13.973 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.973 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.974 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:13.974 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631988+0000", 2024-04-18T21:06:13.974 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000179008 2024-04-18T21:06:13.974 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.974 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.974 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:13.974 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635172+0000", 2024-04-18T21:06:13.974 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.003183029 2024-04-18T21:06:13.974 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.974 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.974 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:13.974 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656392+0000", 2024-04-18T21:06:13.974 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.021220638999999999 2024-04-18T21:06:13.975 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.975 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.975 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:13.975 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656533+0000", 2024-04-18T21:06:13.975 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014126500000000001 2024-04-18T21:06:13.975 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.975 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.975 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:13.975 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656653+0000", 2024-04-18T21:06:13.975 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000119883 2024-04-18T21:06:13.975 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:13.975 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:13.975 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:13.975 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.975 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.976 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:13.976 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:06:13.976 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 68.336972199000002, 2024-04-18T21:06:13.976 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.042492302000000003, 2024-04-18T21:06:13.976 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:13.976 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:13.976 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:13.976 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:13.976 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.976 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:13.976 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:06:13.976 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:13.976 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.976 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.977 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:13.977 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:06:13.977 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:13.977 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.977 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.977 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:13.977 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615475+0000", 2024-04-18T21:06:13.977 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.17e-06 2024-04-18T21:06:13.977 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.977 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.977 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:13.977 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615528+0000", 2024-04-18T21:06:13.977 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.2159e-05 2024-04-18T21:06:13.977 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.978 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.978 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:13.978 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615542+0000", 2024-04-18T21:06:13.978 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4197e-05 2024-04-18T21:06:13.978 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.978 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.978 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:13.978 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615559+0000", 2024-04-18T21:06:13.978 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.749e-05 2024-04-18T21:06:13.978 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.978 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.978 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:13.978 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615685+0000", 2024-04-18T21:06:13.978 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012617499999999999 2024-04-18T21:06:13.979 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.979 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.979 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:13.979 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:06:13.979 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4749999999999999e-05 2024-04-18T21:06:13.979 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.979 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.979 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:13.979 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632332+0000", 2024-04-18T21:06:13.979 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016631988 2024-04-18T21:06:13.979 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.979 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.979 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:13.979 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632477+0000", 2024-04-18T21:06:13.979 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014437200000000001 2024-04-18T21:06:13.980 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.980 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.980 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:13.980 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632620+0000", 2024-04-18T21:06:13.980 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000143566 2024-04-18T21:06:13.980 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.980 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.980 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:13.980 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635185+0000", 2024-04-18T21:06:13.980 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0025644209999999999 2024-04-18T21:06:13.980 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.980 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.980 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:13.980 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657803+0000", 2024-04-18T21:06:13.980 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.022618743 2024-04-18T21:06:13.981 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.981 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.981 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:13.981 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657890+0000", 2024-04-18T21:06:13.981 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.6688999999999996e-05 2024-04-18T21:06:13.981 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.981 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.981 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:13.981 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657967+0000", 2024-04-18T21:06:13.981 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.6582000000000006e-05 2024-04-18T21:06:13.981 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:13.981 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:13.981 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:13.982 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.982 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.982 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:13.982 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:06:13.982 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 68.336841387000007, 2024-04-18T21:06:13.982 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.043603435000000003, 2024-04-18T21:06:13.982 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:13.982 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:13.982 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:13.982 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:13.982 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.982 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:13.982 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:06:13.982 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:13.983 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.983 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.983 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:13.983 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:06:13.983 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:13.983 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.983 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.983 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:13.983 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615607+0000", 2024-04-18T21:06:13.983 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4300000000000001e-06 2024-04-18T21:06:13.983 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.983 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.983 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:13.983 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615614+0000", 2024-04-18T21:06:13.983 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.4100000000000002e-06 2024-04-18T21:06:13.983 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.984 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.984 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:13.984 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615632+0000", 2024-04-18T21:06:13.984 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7863000000000002e-05 2024-04-18T21:06:13.984 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.984 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.984 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:13.984 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615647+0000", 2024-04-18T21:06:13.984 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5187e-05 2024-04-18T21:06:13.984 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.984 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.984 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:13.984 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615765+0000", 2024-04-18T21:06:13.984 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000117955 2024-04-18T21:06:13.984 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.984 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.984 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:13.985 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615781+0000", 2024-04-18T21:06:13.985 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6123000000000001e-05 2024-04-18T21:06:13.985 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.985 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.985 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:13.985 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633055+0000", 2024-04-18T21:06:13.985 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.017273909 2024-04-18T21:06:13.985 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.985 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.985 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:13.985 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633254+0000", 2024-04-18T21:06:13.985 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00019903799999999999 2024-04-18T21:06:13.985 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.985 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.986 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:13.986 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633624+0000", 2024-04-18T21:06:13.986 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000369656 2024-04-18T21:06:13.986 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.986 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.986 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:13.986 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635595+0000", 2024-04-18T21:06:13.986 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001971287 2024-04-18T21:06:13.986 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.986 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.986 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:13.986 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659026+0000", 2024-04-18T21:06:13.986 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.023431495 2024-04-18T21:06:13.987 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.987 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.987 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:13.987 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659117+0000", 2024-04-18T21:06:13.987 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0885999999999997e-05 2024-04-18T21:06:13.987 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.987 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.987 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:13.987 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659209+0000", 2024-04-18T21:06:13.987 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.1195999999999999e-05 2024-04-18T21:06:13.987 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:13.987 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:13.987 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:13.987 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.987 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.987 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:13.988 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:13.988 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 68.336776158000006, 2024-04-18T21:06:13.988 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.03492514, 2024-04-18T21:06:13.988 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:13.988 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:13.988 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:13.988 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:13.988 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.988 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:13.988 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:13.988 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:13.988 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.988 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.989 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:13.989 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:13.989 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:13.989 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.989 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.989 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:13.989 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:06:13.989 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.407e-06 2024-04-18T21:06:13.989 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.989 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.989 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:13.989 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615679+0000", 2024-04-18T21:06:13.989 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.2130000000000002e-06 2024-04-18T21:06:13.989 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.990 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.990 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:13.990 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615701+0000", 2024-04-18T21:06:13.990 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2316000000000001e-05 2024-04-18T21:06:13.990 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.990 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.990 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:13.990 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615717+0000", 2024-04-18T21:06:13.990 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6197000000000001e-05 2024-04-18T21:06:13.990 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.990 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.990 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:13.990 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615828+0000", 2024-04-18T21:06:13.990 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000110899 2024-04-18T21:06:13.991 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.991 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.991 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:13.991 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615840+0000", 2024-04-18T21:06:13.991 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.1423000000000001e-05 2024-04-18T21:06:13.991 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.991 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.991 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:13.991 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628046+0000", 2024-04-18T21:06:13.991 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.012206295000000001 2024-04-18T21:06:13.991 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.991 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.991 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:13.991 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628323+0000", 2024-04-18T21:06:13.991 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00027658700000000001 2024-04-18T21:06:13.991 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.992 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.992 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:13.992 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628599+0000", 2024-04-18T21:06:13.992 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00027676699999999997 2024-04-18T21:06:13.992 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.992 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.992 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:13.992 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634869+0000", 2024-04-18T21:06:13.992 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.006269536 2024-04-18T21:06:13.992 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.992 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.992 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:13.992 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650333+0000", 2024-04-18T21:06:13.992 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.015463645999999999 2024-04-18T21:06:13.993 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.993 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.993 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:13.993 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650474+0000", 2024-04-18T21:06:13.993 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014091799999999999 2024-04-18T21:06:13.993 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.993 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.993 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:13.993 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650595+0000", 2024-04-18T21:06:13.993 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012193600000000001 2024-04-18T21:06:13.993 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:13.993 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:13.993 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:13.993 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.993 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.993 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:13.994 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:06:13.994 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 68.336691048999995, 2024-04-18T21:06:13.994 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.040588320999999997, 2024-04-18T21:06:13.994 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:13.994 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:13.994 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:13.994 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:13.994 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.994 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:13.994 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:06:13.994 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:13.994 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.994 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.994 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:13.994 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:06:13.994 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:13.995 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.995 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.995 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:13.995 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615757+0000", 2024-04-18T21:06:13.995 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2270000000000001e-06 2024-04-18T21:06:13.995 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.995 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.995 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:13.995 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615765+0000", 2024-04-18T21:06:13.995 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.9400000000000002e-06 2024-04-18T21:06:13.995 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.995 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.995 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:13.995 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615785+0000", 2024-04-18T21:06:13.995 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.0749000000000001e-05 2024-04-18T21:06:13.996 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.996 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.996 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:13.996 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615804+0000", 2024-04-18T21:06:13.996 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.8774e-05 2024-04-18T21:06:13.996 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.996 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.996 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:13.996 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615888+0000", 2024-04-18T21:06:13.996 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.4111999999999997e-05 2024-04-18T21:06:13.996 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.996 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.996 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:13.996 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615895+0000", 2024-04-18T21:06:13.996 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.0469999999999996e-06 2024-04-18T21:06:13.996 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.996 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.997 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:13.997 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629280+0000", 2024-04-18T21:06:13.997 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.013384416 2024-04-18T21:06:13.997 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.997 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.997 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:13.997 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629488+0000", 2024-04-18T21:06:13.997 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00020852800000000001 2024-04-18T21:06:13.997 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.997 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.997 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:13.997 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629869+0000", 2024-04-18T21:06:13.997 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00038042300000000001 2024-04-18T21:06:13.997 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.997 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.998 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:13.998 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635041+0000", 2024-04-18T21:06:13.998 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.005172383 2024-04-18T21:06:13.998 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.998 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.998 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:13.998 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656125+0000", 2024-04-18T21:06:13.998 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.021084025999999999 2024-04-18T21:06:13.998 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.998 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.998 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:13.998 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656240+0000", 2024-04-18T21:06:13.998 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000115352 2024-04-18T21:06:13.998 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.999 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.999 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:13.999 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656344+0000", 2024-04-18T21:06:13.999 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00010334400000000001 2024-04-18T21:06:13.999 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:13.999 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:13.999 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:13.999 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:13.999 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:13.999 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:13.999 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:13.999 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 68.336623728999996, 2024-04-18T21:06:13.999 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.043549577999999999, 2024-04-18T21:06:14.000 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:14.000 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:14.000 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:14.000 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:14.000 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.000 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:14.000 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:14.000 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:14.000 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.000 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.000 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:14.000 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:14.000 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:14.000 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.000 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.001 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:14.001 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:14.001 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.5000000000000002e-07 2024-04-18T21:06:14.001 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.001 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.001 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:14.001 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615828+0000", 2024-04-18T21:06:14.001 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.2359999999999998e-06 2024-04-18T21:06:14.001 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.001 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.001 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:14.001 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615838+0000", 2024-04-18T21:06:14.001 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0087e-05 2024-04-18T21:06:14.001 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.001 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.001 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:14.002 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615846+0000", 2024-04-18T21:06:14.002 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.67e-06 2024-04-18T21:06:14.002 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.002 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.002 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:14.002 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615963+0000", 2024-04-18T21:06:14.002 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00011630500000000001 2024-04-18T21:06:14.002 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.002 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.002 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:14.002 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615979+0000", 2024-04-18T21:06:14.002 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.613e-05 2024-04-18T21:06:14.002 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.002 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.002 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:14.003 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632392+0000", 2024-04-18T21:06:14.003 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016413317 2024-04-18T21:06:14.003 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.003 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.003 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:14.003 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632568+0000", 2024-04-18T21:06:14.003 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00017539500000000001 2024-04-18T21:06:14.003 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.003 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.003 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:14.003 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632748+0000", 2024-04-18T21:06:14.003 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00017991799999999999 2024-04-18T21:06:14.003 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.003 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.004 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:14.004 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635542+0000", 2024-04-18T21:06:14.004 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00279481 2024-04-18T21:06:14.004 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.004 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.004 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:14.004 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659232+0000", 2024-04-18T21:06:14.004 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.023689212000000001 2024-04-18T21:06:14.004 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.004 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.004 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:14.004 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659314+0000", 2024-04-18T21:06:14.004 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.2528999999999995e-05 2024-04-18T21:06:14.004 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.004 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.004 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:14.005 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659372+0000", 2024-04-18T21:06:14.005 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.8218999999999999e-05 2024-04-18T21:06:14.005 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:14.005 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:14.005 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:14.005 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.005 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.005 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:14.005 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:06:14.005 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 68.336562297, 2024-04-18T21:06:14.005 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.039335347, 2024-04-18T21:06:14.005 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:14.005 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:14.005 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "started", 2024-04-18T21:06:14.006 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:14.006 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.006 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:14.006 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:06:14.006 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:14.006 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.006 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.006 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:14.006 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:06:14.006 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:14.006 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.006 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.006 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:14.006 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615885+0000", 2024-04-18T21:06:14.006 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2699999999999999e-06 2024-04-18T21:06:14.007 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.007 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.007 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:14.007 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615892+0000", 2024-04-18T21:06:14.007 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.6499999999999999e-06 2024-04-18T21:06:14.007 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.007 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.007 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:14.007 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615906+0000", 2024-04-18T21:06:14.007 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.393e-05 2024-04-18T21:06:14.007 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.007 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.007 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:14.007 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615919+0000", 2024-04-18T21:06:14.008 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2860000000000001e-05 2024-04-18T21:06:14.008 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.008 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.008 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:14.008 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616027+0000", 2024-04-18T21:06:14.008 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000107852 2024-04-18T21:06:14.008 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.008 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.008 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:14.008 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616037+0000", 2024-04-18T21:06:14.008 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:06:14.008 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.008 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.008 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:14.009 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622719+0000", 2024-04-18T21:06:14.009 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0066817220000000002 2024-04-18T21:06:14.009 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.009 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.009 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:14.009 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623006+0000", 2024-04-18T21:06:14.009 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00028783699999999999 2024-04-18T21:06:14.009 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.009 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.009 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:14.009 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.655220+0000", 2024-04-18T21:06:14.009 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.032213036 2024-04-18T21:06:14.009 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:14.010 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:14.010 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:14.010 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.010 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.010 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:14.010 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:14.010 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 68.336506623999995, 2024-04-18T21:06:14.010 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.032845253999999997, 2024-04-18T21:06:14.010 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:14.010 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:14.010 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "started", 2024-04-18T21:06:14.010 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:14.010 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.010 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:14.011 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:14.011 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:14.011 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.011 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.011 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:14.011 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:14.011 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:14.011 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.011 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.011 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:14.011 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615942+0000", 2024-04-18T21:06:14.011 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.717e-06 2024-04-18T21:06:14.011 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.011 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.011 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:14.012 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615946+0000", 2024-04-18T21:06:14.012 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.6e-06 2024-04-18T21:06:14.012 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.012 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.012 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:14.012 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615960+0000", 2024-04-18T21:06:14.012 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:06:14.012 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.012 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.012 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:14.012 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615968+0000", 2024-04-18T21:06:14.012 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.9070000000000007e-06 2024-04-18T21:06:14.012 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.012 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.012 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:14.013 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616100+0000", 2024-04-18T21:06:14.013 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000132402 2024-04-18T21:06:14.013 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.013 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.013 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:14.013 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616117+0000", 2024-04-18T21:06:14.013 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6653000000000001e-05 2024-04-18T21:06:14.013 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.013 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.013 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:14.013 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621566+0000", 2024-04-18T21:06:14.013 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0054497740000000001 2024-04-18T21:06:14.013 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.013 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.013 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:14.013 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622801+0000", 2024-04-18T21:06:14.014 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0012345710000000001 2024-04-18T21:06:14.014 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.014 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.014 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:14.014 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648785+0000", 2024-04-18T21:06:14.014 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.025984104000000001 2024-04-18T21:06:14.014 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:14.014 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:14.014 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:14.014 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.014 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.014 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:14.014 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:06:14.014 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 68.330655273999994, 2024-04-18T21:06:14.015 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.011561350999999999, 2024-04-18T21:06:14.015 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:14.015 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:14.015 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:14.015 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:14.015 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.015 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:14.015 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:06:14.015 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:14.015 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.015 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.015 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:14.015 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:06:14.015 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:14.015 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.016 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.016 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:14.016 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621792+0000", 2024-04-18T21:06:14.016 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.4000000000000001e-07 2024-04-18T21:06:14.016 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.016 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.016 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:14.016 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:06:14.016 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.1050000000000002e-05 2024-04-18T21:06:14.016 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.016 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.016 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:14.016 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622608+0000", 2024-04-18T21:06:14.016 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00077505900000000003 2024-04-18T21:06:14.016 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.016 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.017 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:14.017 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623879+0000", 2024-04-18T21:06:14.017 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0012705839999999999 2024-04-18T21:06:14.017 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.017 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.017 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:14.017 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624010+0000", 2024-04-18T21:06:14.017 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00013176900000000001 2024-04-18T21:06:14.017 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.017 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.017 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:14.017 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624058+0000", 2024-04-18T21:06:14.017 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.7299000000000002e-05 2024-04-18T21:06:14.017 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.017 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.018 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:14.018 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633262+0000", 2024-04-18T21:06:14.018 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0092048770000000002 2024-04-18T21:06:14.018 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.018 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.018 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:14.018 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633353+0000", 2024-04-18T21:06:14.018 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0073000000000003e-05 2024-04-18T21:06:14.018 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:14.018 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:14.018 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:14.019 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.019 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.019 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:14.019 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:06:14.019 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 68.328527887999996, 2024-04-18T21:06:14.019 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0098419370000000003, 2024-04-18T21:06:14.019 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:14.019 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:14.019 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:14.019 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:14.019 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.019 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:14.019 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:06:14.019 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:14.019 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.020 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.020 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:14.020 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:06:14.020 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:14.020 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.020 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.020 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:14.020 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623920+0000", 2024-04-18T21:06:14.020 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2240000000000001e-06 2024-04-18T21:06:14.020 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.020 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.020 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:14.020 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623933+0000", 2024-04-18T21:06:14.020 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3653e-05 2024-04-18T21:06:14.020 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.020 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.021 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:14.021 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623956+0000", 2024-04-18T21:06:14.021 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2059e-05 2024-04-18T21:06:14.021 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.021 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.021 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:14.021 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623975+0000", 2024-04-18T21:06:14.021 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.9806999999999999e-05 2024-04-18T21:06:14.021 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.021 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.021 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:14.021 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626943+0000", 2024-04-18T21:06:14.021 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0029681579999999998 2024-04-18T21:06:14.021 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.022 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.022 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:14.022 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626993+0000", 2024-04-18T21:06:14.022 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.9935999999999998e-05 2024-04-18T21:06:14.022 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.022 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.022 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:14.022 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633665+0000", 2024-04-18T21:06:14.022 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0066719250000000004 2024-04-18T21:06:14.022 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.022 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.022 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:14.022 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633761+0000", 2024-04-18T21:06:14.023 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.5174999999999996e-05 2024-04-18T21:06:14.023 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:14.023 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:14.023 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:14.023 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.023 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.023 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:14.023 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:06:14.023 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 68.327696269, 2024-04-18T21:06:14.023 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0090159079999999996, 2024-04-18T21:06:14.023 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:14.023 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:14.023 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:14.023 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:14.024 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.024 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:14.024 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:06:14.024 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:14.024 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.024 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.024 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:14.024 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:06:14.024 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:14.024 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.024 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.024 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:14.024 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624751+0000", 2024-04-18T21:06:14.024 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.7600000000000006e-07 2024-04-18T21:06:14.025 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.025 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.025 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:14.025 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624787+0000", 2024-04-18T21:06:14.025 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.6273000000000003e-05 2024-04-18T21:06:14.025 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.025 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.025 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:14.025 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625837+0000", 2024-04-18T21:06:14.025 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00104992 2024-04-18T21:06:14.025 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.025 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.025 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:14.025 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625860+0000", 2024-04-18T21:06:14.025 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3110000000000001e-05 2024-04-18T21:06:14.025 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.026 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.026 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:14.026 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625984+0000", 2024-04-18T21:06:14.026 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012399199999999999 2024-04-18T21:06:14.026 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.026 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.026 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:14.026 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626030+0000", 2024-04-18T21:06:14.026 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.5429999999999997e-05 2024-04-18T21:06:14.026 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.026 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.026 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:14.026 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633643+0000", 2024-04-18T21:06:14.026 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0076129320000000002 2024-04-18T21:06:14.027 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.027 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.027 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:14.027 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633766+0000", 2024-04-18T21:06:14.027 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000123275 2024-04-18T21:06:14.027 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:14.027 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:14.027 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:14.027 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.027 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.027 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:14.027 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:06:14.027 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 68.326442545000006, 2024-04-18T21:06:14.027 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0088669170000000002, 2024-04-18T21:06:14.028 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:14.028 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:14.028 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:14.028 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:14.028 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.028 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:14.028 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:06:14.028 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:14.028 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.028 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.028 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:14.028 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:06:14.028 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:14.028 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.029 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.029 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:14.029 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626005+0000", 2024-04-18T21:06:14.029 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.5000000000000001e-07 2024-04-18T21:06:14.029 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.029 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.029 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:14.029 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626028+0000", 2024-04-18T21:06:14.029 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2756999999999999e-05 2024-04-18T21:06:14.029 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.029 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.029 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:14.029 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626050+0000", 2024-04-18T21:06:14.029 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2140000000000001e-05 2024-04-18T21:06:14.030 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.030 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.030 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:14.030 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626065+0000", 2024-04-18T21:06:14.030 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5176e-05 2024-04-18T21:06:14.030 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.030 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.030 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:14.030 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628334+0000", 2024-04-18T21:06:14.030 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0022691439999999998 2024-04-18T21:06:14.030 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.030 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.031 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:14.031 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628379+0000", 2024-04-18T21:06:14.031 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.5420000000000002e-05 2024-04-18T21:06:14.031 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.031 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.031 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:14.031 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634770+0000", 2024-04-18T21:06:14.031 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0063908410000000004 2024-04-18T21:06:14.031 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.031 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.031 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:14.031 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634871+0000", 2024-04-18T21:06:14.031 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000100589 2024-04-18T21:06:14.031 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:14.031 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:14.032 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:14.032 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.032 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.032 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:13 3.10 e17/15 3:0d89b25e:::603.00000000:head v 17'8, mlcod=0'0)", 2024-04-18T21:06:14.032 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:06:14.032 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 68.307609115999995, 2024-04-18T21:06:14.032 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0090974379999999994, 2024-04-18T21:06:14.032 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:14.032 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:14.032 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:14.032 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:14.032 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.032 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:14.033 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:06:14.033 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:14.033 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.033 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.033 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:14.033 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:06:14.033 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:14.033 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.033 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.033 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:14.033 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644838+0000", 2024-04-18T21:06:14.033 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.569999999999999e-07 2024-04-18T21:06:14.033 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.033 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.033 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:14.034 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644846+0000", 2024-04-18T21:06:14.034 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.4499999999999998e-06 2024-04-18T21:06:14.034 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.034 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.034 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:14.034 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644861+0000", 2024-04-18T21:06:14.034 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5243e-05 2024-04-18T21:06:14.034 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.034 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.034 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:14.034 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644997+0000", 2024-04-18T21:06:14.034 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000135609 2024-04-18T21:06:14.034 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.034 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.035 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:14.035 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649150+0000", 2024-04-18T21:06:14.035 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0041536760000000002 2024-04-18T21:06:14.035 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.035 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.035 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:14.035 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649207+0000", 2024-04-18T21:06:14.035 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.6677e-05 2024-04-18T21:06:14.035 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.035 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.035 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:14.035 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.653840+0000", 2024-04-18T21:06:14.035 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0046329700000000001 2024-04-18T21:06:14.035 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.035 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.036 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:14.036 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.653935+0000", 2024-04-18T21:06:14.036 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.4856000000000001e-05 2024-04-18T21:06:14.036 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:14.036 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:14.036 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:14.036 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.036 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.036 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 3 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:06:14.036 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:06:14.036 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 68.304819956000003, 2024-04-18T21:06:14.036 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0087842319999999995, 2024-04-18T21:06:14.036 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:14.036 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:14.037 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "reached pg", 2024-04-18T21:06:14.037 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:14.037 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.037 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:14.037 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:06:14.037 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:14.037 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.037 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.037 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:14.037 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:06:14.037 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:14.037 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.037 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.038 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:14.038 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:06:14.038 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.8299999999999996e-07 2024-04-18T21:06:14.038 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.038 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.038 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:14.038 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647642+0000", 2024-04-18T21:06:14.038 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4724e-05 2024-04-18T21:06:14.038 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.038 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.038 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:14.038 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647679+0000", 2024-04-18T21:06:14.038 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.6662999999999998e-05 2024-04-18T21:06:14.039 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.039 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.039 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:14.039 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647735+0000", 2024-04-18T21:06:14.039 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.6196000000000002e-05 2024-04-18T21:06:14.039 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.039 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.039 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:14.039 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649865+0000", 2024-04-18T21:06:14.039 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0021299489999999999 2024-04-18T21:06:14.039 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.039 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.039 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:14.039 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656411+0000", 2024-04-18T21:06:14.040 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0065460170000000003 2024-04-18T21:06:14.040 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:14.040 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:14.040 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:14.040 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.040 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.040 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:14.040 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:06:14.040 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 68.304674759999997, 2024-04-18T21:06:14.040 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0095703190000000007, 2024-04-18T21:06:14.040 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:14.040 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:14.040 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:14.040 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:14.041 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.041 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:14.041 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:06:14.041 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:14.041 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.041 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.041 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:14.041 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:06:14.041 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:14.041 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.041 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.041 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:14.041 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647773+0000", 2024-04-18T21:06:14.041 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.046e-06 2024-04-18T21:06:14.042 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.042 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.042 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:14.042 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647795+0000", 2024-04-18T21:06:14.042 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2616000000000002e-05 2024-04-18T21:06:14.042 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.042 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.042 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:14.042 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647818+0000", 2024-04-18T21:06:14.042 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3110000000000001e-05 2024-04-18T21:06:14.042 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.042 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.042 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:14.042 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647834+0000", 2024-04-18T21:06:14.042 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5163e-05 2024-04-18T21:06:14.043 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.043 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.043 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:14.043 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650682+0000", 2024-04-18T21:06:14.043 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0028479759999999999 2024-04-18T21:06:14.043 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.043 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.043 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:14.043 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650730+0000", 2024-04-18T21:06:14.043 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.8375999999999999e-05 2024-04-18T21:06:14.043 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.043 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.043 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:14.043 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656751+0000", 2024-04-18T21:06:14.043 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0060211880000000002 2024-04-18T21:06:14.043 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.044 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.044 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:14.044 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657342+0000", 2024-04-18T21:06:14.044 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00059084399999999998 2024-04-18T21:06:14.044 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:14.044 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:14.044 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:14.044 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.044 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.044 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:14.044 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:06:14.044 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 68.304262473999998, 2024-04-18T21:06:14.044 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0092471759999999993, 2024-04-18T21:06:14.044 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:14.044 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:14.044 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:14.045 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:14.045 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.045 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:14.045 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:06:14.045 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:14.045 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.045 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.045 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:14.045 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:06:14.045 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:14.045 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.045 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.045 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:14.046 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648185+0000", 2024-04-18T21:06:14.046 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.5000000000000001e-07 2024-04-18T21:06:14.046 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.046 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.046 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:14.046 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648203+0000", 2024-04-18T21:06:14.046 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.8102999999999999e-05 2024-04-18T21:06:14.046 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.046 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.046 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:14.046 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648226+0000", 2024-04-18T21:06:14.046 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2921999999999998e-05 2024-04-18T21:06:14.046 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.047 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.047 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:14.047 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648241+0000", 2024-04-18T21:06:14.047 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5336999999999999e-05 2024-04-18T21:06:14.047 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.047 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.047 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:14.047 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.651268+0000", 2024-04-18T21:06:14.047 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0030271640000000002 2024-04-18T21:06:14.047 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.047 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.047 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:14.047 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.651319+0000", 2024-04-18T21:06:14.047 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.0843000000000001e-05 2024-04-18T21:06:14.047 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.048 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.048 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:14.048 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657347+0000", 2024-04-18T21:06:14.048 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0060279770000000003 2024-04-18T21:06:14.048 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:14.048 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:14.048 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:14.048 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657431+0000", 2024-04-18T21:06:14.048 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.3980000000000006e-05 2024-04-18T21:06:14.048 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:14.048 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:14.048 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:14.048 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:14.048 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:14.049 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:06:14.050 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:14.051 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:14.046+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:14.151 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:14.150+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:14.182 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:14.182 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:06:14.182 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-04-18T21:06:14.182 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:14.197 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:14.252 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:14.251+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:14.320 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:14.320 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:06:14.320 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-18T21:06:14.320 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-18T21:06:14.320 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:14.334 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:14.353 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:14.350+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:14.454 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:14.454 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-18T21:06:14.454 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-18T21:06:14.454 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:06:14.454 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.455 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:14.455 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:06:14.455 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 68.838397149000002, 2024-04-18T21:06:14.455 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.034065303999999998, 2024-04-18T21:06:14.455 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:14.455 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:14.455 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:14.455 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:14.455 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.455 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:14.455 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:06:14.455 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:14.455 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.455 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.455 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:14.456 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:06:14.456 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:14.456 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.456 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.456 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:14.456 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615254+0000", 2024-04-18T21:06:14.456 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7829999999999999e-06 2024-04-18T21:06:14.456 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.456 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.456 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:14.456 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615267+0000", 2024-04-18T21:06:14.456 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3334e-05 2024-04-18T21:06:14.456 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.456 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.456 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:14.456 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615294+0000", 2024-04-18T21:06:14.457 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7271999999999999e-05 2024-04-18T21:06:14.457 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.457 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.457 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:14.457 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615321+0000", 2024-04-18T21:06:14.457 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.637e-05 2024-04-18T21:06:14.457 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.457 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.457 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:14.457 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615479+0000", 2024-04-18T21:06:14.457 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000158493 2024-04-18T21:06:14.457 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.457 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.458 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:14.458 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615498+0000", 2024-04-18T21:06:14.458 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9148999999999999e-05 2024-04-18T21:06:14.458 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.458 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.458 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:14.458 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632915+0000", 2024-04-18T21:06:14.458 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.017416551999999998 2024-04-18T21:06:14.458 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.458 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.458 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:14.458 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633302+0000", 2024-04-18T21:06:14.458 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00038725000000000001 2024-04-18T21:06:14.459 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.459 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.459 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:14.459 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633638+0000", 2024-04-18T21:06:14.459 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000335946 2024-04-18T21:06:14.459 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.459 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.459 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:14.459 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645976+0000", 2024-04-18T21:06:14.459 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012337617 2024-04-18T21:06:14.459 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.459 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.459 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:14.460 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649080+0000", 2024-04-18T21:06:14.460 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031038929999999999 2024-04-18T21:06:14.460 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.460 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.460 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:14.460 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649207+0000", 2024-04-18T21:06:14.460 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000127537 2024-04-18T21:06:14.460 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.460 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.460 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:14.460 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649316+0000", 2024-04-18T21:06:14.460 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109108 2024-04-18T21:06:14.460 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:14.460 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:14.460 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:14.460 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.461 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.461 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:14.461 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:06:14.461 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 68.838263772000005, 2024-04-18T21:06:14.461 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036275764000000002, 2024-04-18T21:06:14.461 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:14.461 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:14.461 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:14.461 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:14.461 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.461 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:14.461 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:06:14.461 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:14.461 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.462 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.462 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:14.462 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:06:14.462 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:14.462 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.462 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.462 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:14.462 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615386+0000", 2024-04-18T21:06:14.462 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.573e-06 2024-04-18T21:06:14.462 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.462 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.462 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:14.462 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:06:14.462 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0723999999999999e-05 2024-04-18T21:06:14.463 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.463 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.463 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:14.463 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615418+0000", 2024-04-18T21:06:14.463 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0902000000000001e-05 2024-04-18T21:06:14.463 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.463 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.463 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:14.463 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615433+0000", 2024-04-18T21:06:14.463 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5319999999999999e-05 2024-04-18T21:06:14.463 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.463 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.463 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:14.463 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615659+0000", 2024-04-18T21:06:14.463 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000226095 2024-04-18T21:06:14.464 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.464 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.464 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:14.464 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:14.464 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1276e-05 2024-04-18T21:06:14.464 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.464 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.464 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:14.464 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643654+0000", 2024-04-18T21:06:14.464 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027983238000000001 2024-04-18T21:06:14.464 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.464 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.464 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:14.464 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643868+0000", 2024-04-18T21:06:14.465 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000214305 2024-04-18T21:06:14.465 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.465 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.465 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:14.465 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:06:14.465 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035892200000000002 2024-04-18T21:06:14.465 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.465 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.465 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:14.465 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646056+0000", 2024-04-18T21:06:14.465 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001829172 2024-04-18T21:06:14.465 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.465 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.465 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:14.465 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651406+0000", 2024-04-18T21:06:14.465 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0053504800000000003 2024-04-18T21:06:14.466 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.466 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.466 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:14.466 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651551+0000", 2024-04-18T21:06:14.466 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014427999999999999 2024-04-18T21:06:14.466 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.466 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.466 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:14.466 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651660+0000", 2024-04-18T21:06:14.466 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109477 2024-04-18T21:06:14.466 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:14.466 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:14.466 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:14.466 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.466 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.467 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:14.467 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:14.467 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 68.838190389999994, 2024-04-18T21:06:14.467 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045668994999999997, 2024-04-18T21:06:14.467 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:14.467 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:14.467 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:14.467 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:14.467 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.467 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:14.467 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:14.467 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:14.467 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.467 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.467 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:14.468 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:14.468 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:14.468 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.468 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.468 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:14.468 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615459+0000", 2024-04-18T21:06:14.468 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5030000000000001e-06 2024-04-18T21:06:14.468 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.468 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.468 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:14.468 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615506+0000", 2024-04-18T21:06:14.468 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6872000000000001e-05 2024-04-18T21:06:14.468 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.468 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.469 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:14.469 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615527+0000", 2024-04-18T21:06:14.469 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0763000000000001e-05 2024-04-18T21:06:14.469 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.469 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.469 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:14.469 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615551+0000", 2024-04-18T21:06:14.469 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4159e-05 2024-04-18T21:06:14.469 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.469 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.469 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:14.469 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615736+0000", 2024-04-18T21:06:14.469 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018499599999999999 2024-04-18T21:06:14.469 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.469 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.470 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:14.470 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615748+0000", 2024-04-18T21:06:14.470 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2272999999999999e-05 2024-04-18T21:06:14.470 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.470 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.470 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:14.470 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635481+0000", 2024-04-18T21:06:14.470 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019732772999999999 2024-04-18T21:06:14.470 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.470 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.470 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:14.470 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635791+0000", 2024-04-18T21:06:14.470 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031013299999999998 2024-04-18T21:06:14.470 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.471 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.471 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:14.471 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636101+0000", 2024-04-18T21:06:14.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030943300000000002 2024-04-18T21:06:14.471 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.471 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.471 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:14.471 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646043+0000", 2024-04-18T21:06:14.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099428139999999995 2024-04-18T21:06:14.471 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.471 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.471 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:14.471 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660991+0000", 2024-04-18T21:06:14.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014947142 2024-04-18T21:06:14.472 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.472 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.472 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:14.472 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661061+0000", 2024-04-18T21:06:14.472 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0438000000000006e-05 2024-04-18T21:06:14.472 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.472 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.472 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:14.472 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661127+0000", 2024-04-18T21:06:14.472 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5696000000000003e-05 2024-04-18T21:06:14.472 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:14.472 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:14.472 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:14.472 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.472 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.473 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:14.473 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:14.473 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 68.837977961999997, 2024-04-18T21:06:14.473 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045745085999999997, 2024-04-18T21:06:14.473 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:14.473 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:14.473 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:14.473 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:14.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.473 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:14.473 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:14.473 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:14.473 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.473 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:14.473 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:14.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:14.474 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.474 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.474 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:14.474 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:06:14.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7400000000000001e-06 2024-04-18T21:06:14.474 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.474 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.474 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:14.474 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:06:14.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8133e-05 2024-04-18T21:06:14.474 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.474 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.474 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:14.475 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615726+0000", 2024-04-18T21:06:14.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6132e-05 2024-04-18T21:06:14.475 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.475 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:14.475 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615742+0000", 2024-04-18T21:06:14.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6157000000000001e-05 2024-04-18T21:06:14.475 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.475 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:14.475 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615937+0000", 2024-04-18T21:06:14.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000194768 2024-04-18T21:06:14.475 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:14.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615950+0000", 2024-04-18T21:06:14.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3084e-05 2024-04-18T21:06:14.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:14.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643676+0000", 2024-04-18T21:06:14.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027725639999999999 2024-04-18T21:06:14.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:14.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643867+0000", 2024-04-18T21:06:14.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019075900000000001 2024-04-18T21:06:14.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:14.477 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:06:14.477 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036013799999999997 2024-04-18T21:06:14.477 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.477 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.477 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:14.477 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646068+0000", 2024-04-18T21:06:14.477 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001841536 2024-04-18T21:06:14.477 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.477 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.477 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:14.477 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661184+0000", 2024-04-18T21:06:14.477 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015115458999999999 2024-04-18T21:06:14.477 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.477 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.477 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:14.478 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661283+0000", 2024-04-18T21:06:14.478 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9502999999999999e-05 2024-04-18T21:06:14.478 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.478 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.478 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:14.478 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661415+0000", 2024-04-18T21:06:14.478 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000132037 2024-04-18T21:06:14.478 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:14.478 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:14.478 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:14.478 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.478 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.478 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:14.478 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:06:14.479 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 68.837856275000007, 2024-04-18T21:06:14.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036185947000000003, 2024-04-18T21:06:14.479 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:14.479 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:14.479 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:14.479 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:14.479 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.479 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:14.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:06:14.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:14.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.479 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.479 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:14.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:06:14.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:14.480 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:14.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615794+0000", 2024-04-18T21:06:14.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6440000000000001e-06 2024-04-18T21:06:14.480 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:14.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615803+0000", 2024-04-18T21:06:14.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1220000000000001e-06 2024-04-18T21:06:14.480 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:14.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615827+0000", 2024-04-18T21:06:14.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3997000000000001e-05 2024-04-18T21:06:14.481 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:14.481 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615899+0000", 2024-04-18T21:06:14.481 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2741e-05 2024-04-18T21:06:14.481 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:14.481 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616019+0000", 2024-04-18T21:06:14.481 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119874 2024-04-18T21:06:14.481 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:14.482 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616029+0000", 2024-04-18T21:06:14.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:06:14.482 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.482 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.482 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:14.482 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644823+0000", 2024-04-18T21:06:14.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.028793151999999999 2024-04-18T21:06:14.482 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.482 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.482 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:14.482 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645106+0000", 2024-04-18T21:06:14.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028379700000000002 2024-04-18T21:06:14.482 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.482 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.483 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:14.483 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645294+0000", 2024-04-18T21:06:14.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000187181 2024-04-18T21:06:14.483 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.483 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.483 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:14.483 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646763+0000", 2024-04-18T21:06:14.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0014691050000000001 2024-04-18T21:06:14.483 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.483 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.483 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:14.483 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651784+0000", 2024-04-18T21:06:14.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050211650000000002 2024-04-18T21:06:14.483 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:14.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651876+0000", 2024-04-18T21:06:14.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2503999999999994e-05 2024-04-18T21:06:14.484 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:14.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651978+0000", 2024-04-18T21:06:14.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000101475 2024-04-18T21:06:14.484 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:14.484 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:14.484 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:14.484 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.485 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:14.485 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:14.485 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 68.837707667999993, 2024-04-18T21:06:14.485 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032262322000000003, 2024-04-18T21:06:14.485 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:14.485 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:14.485 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:14.485 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:14.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:14.485 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:14.485 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:14.485 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:14.485 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:14.486 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:14.486 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.486 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.486 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:14.486 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615943+0000", 2024-04-18T21:06:14.486 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1959999999999998e-06 2024-04-18T21:06:14.486 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.486 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.486 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:14.486 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615956+0000", 2024-04-18T21:06:14.486 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3424000000000001e-05 2024-04-18T21:06:14.486 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.486 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.487 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:14.487 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615983+0000", 2024-04-18T21:06:14.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7072000000000001e-05 2024-04-18T21:06:14.487 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.487 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.487 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:14.487 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616006+0000", 2024-04-18T21:06:14.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2823000000000002e-05 2024-04-18T21:06:14.487 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.487 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.487 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:14.487 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616156+0000", 2024-04-18T21:06:14.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014962299999999999 2024-04-18T21:06:14.487 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.488 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:14.488 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616174+0000", 2024-04-18T21:06:14.488 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8082999999999999e-05 2024-04-18T21:06:14.488 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.488 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:14.488 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.629952+0000", 2024-04-18T21:06:14.488 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013778514 2024-04-18T21:06:14.488 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.488 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:14.488 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630201+0000", 2024-04-18T21:06:14.488 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024918100000000001 2024-04-18T21:06:14.488 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.489 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:14.489 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630386+0000", 2024-04-18T21:06:14.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018436900000000001 2024-04-18T21:06:14.489 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.489 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:14.489 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643169+0000", 2024-04-18T21:06:14.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012782774 2024-04-18T21:06:14.489 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.489 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:14.489 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.647924+0000", 2024-04-18T21:06:14.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004755787 2024-04-18T21:06:14.489 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.490 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:14.490 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648069+0000", 2024-04-18T21:06:14.490 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014459600000000001 2024-04-18T21:06:14.490 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.490 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:14.490 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648203+0000", 2024-04-18T21:06:14.490 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013388000000000001 2024-04-18T21:06:14.490 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:14.490 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:14.490 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:14.490 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.491 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.491 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:14.491 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:06:14.491 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 68.837599404000002, 2024-04-18T21:06:14.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032489736999999998, 2024-04-18T21:06:14.491 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:14.491 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:14.491 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:14.491 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:14.491 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.491 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:14.491 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:06:14.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:14.491 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.491 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:14.492 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:06:14.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:14.492 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:14.492 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616050+0000", 2024-04-18T21:06:14.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.606e-06 2024-04-18T21:06:14.492 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:14.492 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616061+0000", 2024-04-18T21:06:14.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0463e-05 2024-04-18T21:06:14.492 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.493 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.493 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:14.493 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616092+0000", 2024-04-18T21:06:14.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1415999999999999e-05 2024-04-18T21:06:14.493 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.493 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.493 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:14.493 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616109+0000", 2024-04-18T21:06:14.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6557000000000001e-05 2024-04-18T21:06:14.493 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.493 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.493 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:14.493 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616358+0000", 2024-04-18T21:06:14.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000249077 2024-04-18T21:06:14.494 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.494 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.494 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:14.494 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616370+0000", 2024-04-18T21:06:14.494 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2037e-05 2024-04-18T21:06:14.494 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.494 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.494 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:14.494 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.634920+0000", 2024-04-18T21:06:14.494 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018550397 2024-04-18T21:06:14.494 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.494 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.494 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:14.494 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640420+0000", 2024-04-18T21:06:14.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055000539999999999 2024-04-18T21:06:14.495 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.495 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:14.495 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648538+0000", 2024-04-18T21:06:14.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0081181299999999994 2024-04-18T21:06:14.495 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:14.495 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:14.495 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:14.495 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.495 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:14.495 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:06:14.495 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 68.837515083, 2024-04-18T21:06:14.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036090029000000003, 2024-04-18T21:06:14.496 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:14.496 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:14.496 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:14.496 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:14.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:14.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:06:14.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:14.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:14.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:06:14.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:14.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.497 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:14.497 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616134+0000", 2024-04-18T21:06:14.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.353e-06 2024-04-18T21:06:14.497 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.497 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:14.497 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616141+0000", 2024-04-18T21:06:14.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2770000000000002e-06 2024-04-18T21:06:14.497 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.497 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:14.497 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616160+0000", 2024-04-18T21:06:14.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.91e-05 2024-04-18T21:06:14.498 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.498 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.498 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:14.498 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616170+0000", 2024-04-18T21:06:14.498 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7699999999999996e-06 2024-04-18T21:06:14.498 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.498 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.498 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:14.498 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616275+0000", 2024-04-18T21:06:14.498 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105313 2024-04-18T21:06:14.498 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.498 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.498 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:14.498 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616288+0000", 2024-04-18T21:06:14.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3027000000000001e-05 2024-04-18T21:06:14.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:14.499 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646160+0000", 2024-04-18T21:06:14.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.029872019 2024-04-18T21:06:14.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:14.499 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646368+0000", 2024-04-18T21:06:14.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020811899999999999 2024-04-18T21:06:14.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:14.500 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652223+0000", 2024-04-18T21:06:14.500 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.005855051 2024-04-18T21:06:14.500 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:14.500 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:14.500 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:14.500 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.500 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:14.500 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:14.500 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 68.837457513999993, 2024-04-18T21:06:14.500 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043572403000000003, 2024-04-18T21:06:14.500 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:14.500 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:14.500 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:14.500 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:14.501 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.501 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:14.501 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:14.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:14.501 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.501 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.501 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:14.501 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:14.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:14.501 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.501 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.501 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:14.501 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616192+0000", 2024-04-18T21:06:14.502 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:06:14.502 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.502 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.502 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:14.502 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616203+0000", 2024-04-18T21:06:14.502 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0890000000000001e-05 2024-04-18T21:06:14.502 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.502 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.502 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:14.502 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616223+0000", 2024-04-18T21:06:14.502 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0409000000000001e-05 2024-04-18T21:06:14.502 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.502 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.502 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:14.502 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616238+0000", 2024-04-18T21:06:14.503 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5160000000000001e-05 2024-04-18T21:06:14.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:14.503 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616343+0000", 2024-04-18T21:06:14.503 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000104831 2024-04-18T21:06:14.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:14.503 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616357+0000", 2024-04-18T21:06:14.503 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3686000000000001e-05 2024-04-18T21:06:14.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:14.504 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635912+0000", 2024-04-18T21:06:14.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019554944000000001 2024-04-18T21:06:14.504 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.504 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:14.504 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636231+0000", 2024-04-18T21:06:14.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000318766 2024-04-18T21:06:14.504 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.504 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:14.504 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659763+0000", 2024-04-18T21:06:14.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023532474000000001 2024-04-18T21:06:14.504 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:14.504 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:14.504 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:14.505 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.505 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.505 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:14.505 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:06:14.505 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 68.833528806999993, 2024-04-18T21:06:14.505 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015007971, 2024-04-18T21:06:14.505 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:14.505 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:14.505 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:14.505 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:14.505 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.505 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:14.505 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:06:14.505 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:14.506 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.506 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.506 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:14.506 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:06:14.506 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:14.506 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.506 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.506 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:14.506 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620120+0000", 2024-04-18T21:06:14.506 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0359999999999999e-06 2024-04-18T21:06:14.506 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.506 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.506 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:14.507 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620157+0000", 2024-04-18T21:06:14.507 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6636e-05 2024-04-18T21:06:14.507 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.507 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.507 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:14.507 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620177+0000", 2024-04-18T21:06:14.507 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0247000000000001e-05 2024-04-18T21:06:14.507 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.507 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.507 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:14.507 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620195+0000", 2024-04-18T21:06:14.507 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7819e-05 2024-04-18T21:06:14.507 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.507 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.507 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:14.508 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620342+0000", 2024-04-18T21:06:14.508 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014643300000000001 2024-04-18T21:06:14.508 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.508 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.508 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:14.508 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620405+0000", 2024-04-18T21:06:14.508 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3522000000000006e-05 2024-04-18T21:06:14.508 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.508 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.508 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:14.508 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635016+0000", 2024-04-18T21:06:14.508 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014610840999999999 2024-04-18T21:06:14.508 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.508 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.509 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:14.509 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635127+0000", 2024-04-18T21:06:14.509 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111437 2024-04-18T21:06:14.509 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:14.509 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:14.509 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:14.509 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.509 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.509 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:14.509 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:06:14.509 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 68.833421539, 2024-04-18T21:06:14.509 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012693296, 2024-04-18T21:06:14.509 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:14.509 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:14.510 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:14.510 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:14.510 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.510 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:14.510 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:06:14.510 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:14.510 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.510 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.510 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:14.510 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:06:14.510 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:14.510 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.510 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.511 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:14.511 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620228+0000", 2024-04-18T21:06:14.511 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:06:14.511 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.511 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.511 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:14.511 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620236+0000", 2024-04-18T21:06:14.511 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.303e-06 2024-04-18T21:06:14.511 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.511 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.511 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:14.511 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620255+0000", 2024-04-18T21:06:14.511 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9406e-05 2024-04-18T21:06:14.511 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.512 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.512 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:14.512 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620274+0000", 2024-04-18T21:06:14.512 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8940000000000002e-05 2024-04-18T21:06:14.512 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.512 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.512 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:14.512 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:06:14.512 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001558753 2024-04-18T21:06:14.512 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.512 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.512 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:14.512 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621879+0000", 2024-04-18T21:06:14.512 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6359000000000001e-05 2024-04-18T21:06:14.513 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.513 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.513 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:14.513 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632841+0000", 2024-04-18T21:06:14.513 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010961907 2024-04-18T21:06:14.513 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.513 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.513 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:14.513 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632920+0000", 2024-04-18T21:06:14.513 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8714999999999994e-05 2024-04-18T21:06:14.513 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:14.513 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:14.513 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:14.513 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.513 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.514 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:14.514 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:06:14.514 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 68.831875776000004, 2024-04-18T21:06:14.514 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013445702, 2024-04-18T21:06:14.514 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:14.514 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:14.514 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:14.514 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:14.514 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.514 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:14.514 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:06:14.514 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:14.514 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.515 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.515 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:14.515 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:06:14.515 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:14.515 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.515 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.515 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:14.515 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621774+0000", 2024-04-18T21:06:14.515 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2500000000000001e-06 2024-04-18T21:06:14.515 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.515 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.515 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:14.515 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621786+0000", 2024-04-18T21:06:14.515 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2636000000000001e-05 2024-04-18T21:06:14.515 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.516 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.516 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:14.516 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621814+0000", 2024-04-18T21:06:14.516 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7823000000000001e-05 2024-04-18T21:06:14.516 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.516 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.516 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:14.516 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621844+0000", 2024-04-18T21:06:14.516 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9589000000000001e-05 2024-04-18T21:06:14.516 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.516 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.516 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:14.516 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622253+0000", 2024-04-18T21:06:14.516 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040963700000000002 2024-04-18T21:06:14.517 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.517 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.517 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:14.517 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622304+0000", 2024-04-18T21:06:14.517 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0868999999999997e-05 2024-04-18T21:06:14.517 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.517 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.517 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:14.517 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635133+0000", 2024-04-18T21:06:14.517 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012829136 2024-04-18T21:06:14.517 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.517 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.517 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:14.517 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635218+0000", 2024-04-18T21:06:14.517 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4761999999999999e-05 2024-04-18T21:06:14.517 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:14.517 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:14.518 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:14.518 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.518 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.518 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:14.518 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:06:14.518 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 68.831749016000003, 2024-04-18T21:06:14.518 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014162065, 2024-04-18T21:06:14.518 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:14.518 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:14.518 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:14.518 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:14.518 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.518 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:14.518 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:06:14.519 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:14.519 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.519 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.519 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:14.519 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:06:14.519 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:14.519 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.519 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.519 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:14.519 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621900+0000", 2024-04-18T21:06:14.519 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:06:14.519 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.519 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.519 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:14.519 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621910+0000", 2024-04-18T21:06:14.520 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0207000000000001e-05 2024-04-18T21:06:14.520 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.520 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.520 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:14.520 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621932+0000", 2024-04-18T21:06:14.520 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1789000000000001e-05 2024-04-18T21:06:14.520 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.520 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.520 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:14.520 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621946+0000", 2024-04-18T21:06:14.520 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4212999999999999e-05 2024-04-18T21:06:14.520 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.520 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.520 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:14.520 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624477+0000", 2024-04-18T21:06:14.521 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025303470000000001 2024-04-18T21:06:14.521 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.521 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.521 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:14.521 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624525+0000", 2024-04-18T21:06:14.521 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8084999999999998e-05 2024-04-18T21:06:14.521 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.521 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.521 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:14.521 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635976+0000", 2024-04-18T21:06:14.521 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.011451368999999999 2024-04-18T21:06:14.521 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.521 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.521 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:14.522 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636061+0000", 2024-04-18T21:06:14.522 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5094999999999998e-05 2024-04-18T21:06:14.522 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:14.522 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:14.522 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:14.522 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.522 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.522 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:06:14.522 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:06:14.522 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 68.822513391000001, 2024-04-18T21:06:14.522 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0098014739999999993, 2024-04-18T21:06:14.522 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:14.522 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:14.522 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:06:14.523 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:14.523 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.523 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:14.523 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:06:14.523 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:14.523 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.523 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.523 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:14.523 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:06:14.523 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:14.523 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.523 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.523 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:14.524 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631136+0000", 2024-04-18T21:06:14.524 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0139999999999999e-06 2024-04-18T21:06:14.524 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.524 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.524 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:14.524 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631152+0000", 2024-04-18T21:06:14.524 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6365999999999999e-05 2024-04-18T21:06:14.524 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.524 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.524 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:14.524 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631961+0000", 2024-04-18T21:06:14.524 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00080873100000000003 2024-04-18T21:06:14.524 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.524 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.524 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:14.525 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632021+0000", 2024-04-18T21:06:14.525 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0541999999999997e-05 2024-04-18T21:06:14.525 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.525 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.525 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:14.525 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633539+0000", 2024-04-18T21:06:14.525 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015175639999999999 2024-04-18T21:06:14.525 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.525 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.525 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:14.525 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640936+0000", 2024-04-18T21:06:14.525 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007397257 2024-04-18T21:06:14.525 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:14.525 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:14.525 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:14.526 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.526 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.526 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-18T21:06:14.526 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:06:14.526 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 68.805051958000007, 2024-04-18T21:06:14.526 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00073592199999999997, 2024-04-18T21:06:14.526 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:14.526 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:14.526 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:14.526 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:14.526 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.526 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:14.526 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:06:14.527 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:14.527 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.527 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.527 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:14.527 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:06:14.527 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:14.527 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.527 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.527 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:14.527 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648597+0000", 2024-04-18T21:06:14.527 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:06:14.527 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.527 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.527 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:14.528 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648605+0000", 2024-04-18T21:06:14.528 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3960000000000006e-06 2024-04-18T21:06:14.528 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.528 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.528 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:14.528 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648625+0000", 2024-04-18T21:06:14.528 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9987e-05 2024-04-18T21:06:14.528 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.528 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.528 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:14.528 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648643+0000", 2024-04-18T21:06:14.528 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7079e-05 2024-04-18T21:06:14.528 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.528 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.528 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:14.529 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649043+0000", 2024-04-18T21:06:14.529 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040083399999999998 2024-04-18T21:06:14.529 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.529 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.529 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:14.529 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649062+0000", 2024-04-18T21:06:14.529 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9052999999999999e-05 2024-04-18T21:06:14.529 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.529 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.529 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:14.529 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649332+0000", 2024-04-18T21:06:14.529 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026971999999999999 2024-04-18T21:06:14.529 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:14.529 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:14.529 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:14.530 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.530 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.530 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:06:14.530 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:06:14.530 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 68.802277056999998, 2024-04-18T21:06:14.530 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00086123999999999999, 2024-04-18T21:06:14.530 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:14.530 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:14.530 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:06:14.530 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:14.530 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.530 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:14.530 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:06:14.530 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:14.531 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.531 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.531 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:14.531 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:06:14.531 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:14.531 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.531 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.531 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:14.531 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651372+0000", 2024-04-18T21:06:14.531 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7599999999999997e-07 2024-04-18T21:06:14.531 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.531 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.531 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:14.531 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651377+0000", 2024-04-18T21:06:14.532 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.22e-06 2024-04-18T21:06:14.532 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.532 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.532 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:14.532 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651394+0000", 2024-04-18T21:06:14.532 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6646999999999998e-05 2024-04-18T21:06:14.532 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.532 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.532 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:14.532 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651427+0000", 2024-04-18T21:06:14.532 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3682e-05 2024-04-18T21:06:14.532 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.532 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.532 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:14.533 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652029+0000", 2024-04-18T21:06:14.533 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00060152199999999995 2024-04-18T21:06:14.533 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.533 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.533 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:14.533 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652232+0000", 2024-04-18T21:06:14.533 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020359299999999999 2024-04-18T21:06:14.533 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:14.533 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:14.533 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:14.533 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.533 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.533 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:06:14.533 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:06:14.534 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 68.794250094999995, 2024-04-18T21:06:14.534 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0017426200000000001, 2024-04-18T21:06:14.534 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:14.534 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:14.534 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:14.534 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:14.534 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.534 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:14.534 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:06:14.534 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:14.534 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.534 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.534 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:14.534 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:06:14.534 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:14.535 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.535 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.535 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:14.535 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659399+0000", 2024-04-18T21:06:14.535 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6000000000000002e-07 2024-04-18T21:06:14.535 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.535 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.535 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:14.535 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659405+0000", 2024-04-18T21:06:14.535 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5069999999999997e-06 2024-04-18T21:06:14.535 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.535 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.535 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:14.535 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659425+0000", 2024-04-18T21:06:14.535 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.927e-05 2024-04-18T21:06:14.536 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.536 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.536 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:14.536 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659443+0000", 2024-04-18T21:06:14.536 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8051999999999999e-05 2024-04-18T21:06:14.536 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.536 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.536 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:14.536 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660973+0000", 2024-04-18T21:06:14.536 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001530106 2024-04-18T21:06:14.536 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.536 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.536 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:14.536 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660983+0000", 2024-04-18T21:06:14.537 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0516999999999999e-05 2024-04-18T21:06:14.537 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.537 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.537 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:14.537 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661141+0000", 2024-04-18T21:06:14.537 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015730799999999999 2024-04-18T21:06:14.537 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:14.537 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:14.537 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:14.537 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.537 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.537 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:06:14.537 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:06:14.537 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 68.794033470000002, 2024-04-18T21:06:14.537 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001812311, 2024-04-18T21:06:14.538 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:14.538 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:14.538 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:14.538 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:14.538 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.538 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:14.538 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:06:14.538 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:14.538 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.538 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.538 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:14.538 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:06:14.538 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:14.539 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.539 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.539 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:14.539 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659616+0000", 2024-04-18T21:06:14.539 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.277e-06 2024-04-18T21:06:14.539 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.539 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.539 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:14.539 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659625+0000", 2024-04-18T21:06:14.539 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5359999999999998e-06 2024-04-18T21:06:14.539 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.539 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.539 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:14.539 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659647+0000", 2024-04-18T21:06:14.539 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1857000000000001e-05 2024-04-18T21:06:14.540 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.540 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.540 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:14.540 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659664+0000", 2024-04-18T21:06:14.540 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6405999999999998e-05 2024-04-18T21:06:14.540 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.540 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.540 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:14.540 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661169+0000", 2024-04-18T21:06:14.540 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015054179999999999 2024-04-18T21:06:14.540 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.540 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.540 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:14.540 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661177+0000", 2024-04-18T21:06:14.541 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9680000000000006e-06 2024-04-18T21:06:14.541 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.541 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.541 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:14.541 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661427+0000", 2024-04-18T21:06:14.541 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024984900000000001 2024-04-18T21:06:14.541 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:14.541 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:14.541 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:14.541 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.541 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.541 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-18T21:06:14.541 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:06:14.541 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 66.841112862000003, 2024-04-18T21:06:14.542 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0030975030000000001, 2024-04-18T21:06:14.542 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:14.542 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:14.542 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:14.542 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:14.542 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.542 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:14.542 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:06:14.542 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:14.542 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.542 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.542 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:14.542 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:06:14.543 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:14.543 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.543 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.543 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:14.543 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612538+0000", 2024-04-18T21:06:14.543 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6259999999999999e-06 2024-04-18T21:06:14.543 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.543 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.543 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:14.543 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612552+0000", 2024-04-18T21:06:14.543 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4073999999999999e-05 2024-04-18T21:06:14.543 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.543 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.543 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:14.543 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612585+0000", 2024-04-18T21:06:14.544 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3504999999999999e-05 2024-04-18T21:06:14.544 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.544 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.544 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:14.544 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612601+0000", 2024-04-18T21:06:14.544 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5194000000000001e-05 2024-04-18T21:06:14.544 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.544 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.544 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:14.544 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612746+0000", 2024-04-18T21:06:14.544 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145666 2024-04-18T21:06:14.544 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.544 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.544 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:14.545 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612953+0000", 2024-04-18T21:06:14.545 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000207109 2024-04-18T21:06:14.545 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.545 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.545 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:14.545 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.613134+0000", 2024-04-18T21:06:14.545 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018041300000000001 2024-04-18T21:06:14.545 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.545 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.545 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:14.545 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.614411+0000", 2024-04-18T21:06:14.545 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0012769929999999999 2024-04-18T21:06:14.545 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.545 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.545 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:14.545 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615441+0000", 2024-04-18T21:06:14.545 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001029917 2024-04-18T21:06:14.546 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.546 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.546 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:14.546 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615522+0000", 2024-04-18T21:06:14.546 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1142000000000003e-05 2024-04-18T21:06:14.546 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.546 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.546 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:14.546 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615633+0000", 2024-04-18T21:06:14.546 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000110864 2024-04-18T21:06:14.546 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:14.546 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:14.546 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:14.546 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.547 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.547 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-18T21:06:14.547 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:06:14.547 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 48.838827051000003, 2024-04-18T21:06:14.547 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088979039999999999, 2024-04-18T21:06:14.547 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:14.547 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:14.547 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:14.547 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:14.547 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.547 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:14.547 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:06:14.547 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:14.547 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.547 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.547 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:14.548 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:06:14.548 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:14.548 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.548 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.548 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:14.548 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614825+0000", 2024-04-18T21:06:14.548 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4829999999999999e-06 2024-04-18T21:06:14.548 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.548 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.548 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:14.548 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614843+0000", 2024-04-18T21:06:14.548 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8777e-05 2024-04-18T21:06:14.548 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.548 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.548 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:14.549 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614884+0000", 2024-04-18T21:06:14.549 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1051999999999999e-05 2024-04-18T21:06:14.549 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.549 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.549 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:14.549 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614903+0000", 2024-04-18T21:06:14.549 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9069999999999999e-05 2024-04-18T21:06:14.549 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.549 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.549 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:14.549 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615047+0000", 2024-04-18T21:06:14.549 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014374400000000001 2024-04-18T21:06:14.549 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.550 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.550 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:14.550 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615061+0000", 2024-04-18T21:06:14.550 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4063000000000001e-05 2024-04-18T21:06:14.550 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.550 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.550 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:14.550 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621064+0000", 2024-04-18T21:06:14.550 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0060029200000000001 2024-04-18T21:06:14.550 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.550 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.550 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:14.550 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621211+0000", 2024-04-18T21:06:14.550 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000147224 2024-04-18T21:06:14.550 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.551 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.551 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:14.551 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621396+0000", 2024-04-18T21:06:14.551 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018454699999999999 2024-04-18T21:06:14.551 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.551 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.551 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:14.551 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.622517+0000", 2024-04-18T21:06:14.551 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001121424 2024-04-18T21:06:14.551 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.551 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.551 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:14.551 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623571+0000", 2024-04-18T21:06:14.551 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010538660000000001 2024-04-18T21:06:14.551 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.551 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.552 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:14.552 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623658+0000", 2024-04-18T21:06:14.552 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6439000000000004e-05 2024-04-18T21:06:14.552 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:14.552 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:14.552 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:14.552 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623719+0000", 2024-04-18T21:06:14.552 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1295000000000002e-05 2024-04-18T21:06:14.552 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:14.552 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:14.552 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:14.552 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:14.552 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:14.552 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:14.553 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:14.454+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:14.554 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:14.597 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:14.598+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:14.639 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:06:14.656 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:14.654+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:14.686 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:14.686 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:06:14.686 INFO:teuthology.orchestra.run.smithi132.stdout: "num_ops": 0 2024-04-18T21:06:14.686 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:14.701 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:14.786 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:06:14.786 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:06:14.787 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:14.786+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:14.818 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1: {} 2024-04-18T21:06:14.818 INFO:teuthology.orchestra.run.smithi078.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:06:14.850 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:06:14.850 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:14.859 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:14.858+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:14.861 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:14.861 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:14.875 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:14.960 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:14.958+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:15.048 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:15.048 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:15.061 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:15.063+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:15.062 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:15.162 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:15.162+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:15.196 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:15.196 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:15.210 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:15.263 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:15.263+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:15.330 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:15.330 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:15.344 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:15.364 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:15.362+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:15.465 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:15.467+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:15.507 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:15.508 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:15.522 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:15.566 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:15.566+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:15.615 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-18T21:06:15.657 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:15.657 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:15.666 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:15.666+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:15.670 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:15.767 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:15.766+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:15.787 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:15.788 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:15.802 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:15.868 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:15.866+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:15.965 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:15.965 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:15.969 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:15.967+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:15.979 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:16.070 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:16.070+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:16.111 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:16.111 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:16.125 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:16.171 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:16.170+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:16.247 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:16.247 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:16.261 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:16.271 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:16.270+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:16.372 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:16.370+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:16.426 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:16.426 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:16.441 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:16.485 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:16.487+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:16.574 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:16.574 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:16.574 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:16.575+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:16.588 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:16.606 INFO:teuthology.orchestra.run.smithi078.stderr:noscrub is unset 2024-04-18T21:06:16.674 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:16.675+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:16.747 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:16.747 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:16.761 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:16.805 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:16.807+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:16.871 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:06:16.876 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:16.875+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:16.927 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:16.928 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:16.943 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:16.985 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:16.987+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:17.070 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:06:17.071 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:06:17.075 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:17.075 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:17.078 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:17.079+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:17.090 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:17.103 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1: {} 2024-04-18T21:06:17.104 INFO:teuthology.orchestra.run.smithi078.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:06:17.134 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:06:17.135 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:17.178 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:17.179+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:17.206 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:17.206 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:06:17.206 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-18T21:06:17.206 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-18T21:06:17.206 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:17.220 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:17.281 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:17.278+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:17.340 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:17.340 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-18T21:06:17.340 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-18T21:06:17.340 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:06:17.340 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.340 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:17.340 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:06:17.340 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 71.724188139000006, 2024-04-18T21:06:17.341 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.034065303999999998, 2024-04-18T21:06:17.341 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:17.341 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:17.341 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:17.341 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:17.341 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.341 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:17.341 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:06:17.341 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:17.341 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.341 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.341 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:17.341 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:06:17.341 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:17.342 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.342 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.342 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:17.342 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615254+0000", 2024-04-18T21:06:17.342 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7829999999999999e-06 2024-04-18T21:06:17.342 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.342 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.342 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:17.342 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615267+0000", 2024-04-18T21:06:17.342 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3334e-05 2024-04-18T21:06:17.342 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.342 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.342 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:17.343 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615294+0000", 2024-04-18T21:06:17.343 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7271999999999999e-05 2024-04-18T21:06:17.343 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.343 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.343 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.343 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615321+0000", 2024-04-18T21:06:17.343 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.637e-05 2024-04-18T21:06:17.343 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.343 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.343 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:17.343 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615479+0000", 2024-04-18T21:06:17.343 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000158493 2024-04-18T21:06:17.343 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.343 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.344 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:17.344 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615498+0000", 2024-04-18T21:06:17.344 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9148999999999999e-05 2024-04-18T21:06:17.344 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.344 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.344 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:17.344 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632915+0000", 2024-04-18T21:06:17.344 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.017416551999999998 2024-04-18T21:06:17.344 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.344 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.344 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:17.344 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633302+0000", 2024-04-18T21:06:17.344 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00038725000000000001 2024-04-18T21:06:17.344 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.345 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.345 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:17.345 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633638+0000", 2024-04-18T21:06:17.345 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000335946 2024-04-18T21:06:17.345 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.345 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.345 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:17.345 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645976+0000", 2024-04-18T21:06:17.345 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012337617 2024-04-18T21:06:17.345 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.345 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.345 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:17.345 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649080+0000", 2024-04-18T21:06:17.345 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031038929999999999 2024-04-18T21:06:17.346 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.346 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.346 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:17.346 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649207+0000", 2024-04-18T21:06:17.346 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000127537 2024-04-18T21:06:17.346 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.346 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.346 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:17.346 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649316+0000", 2024-04-18T21:06:17.346 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109108 2024-04-18T21:06:17.346 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:17.346 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:17.346 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:17.346 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.347 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.347 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:17.347 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:06:17.347 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 71.724054761999994, 2024-04-18T21:06:17.347 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036275764000000002, 2024-04-18T21:06:17.347 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:17.347 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:17.347 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:17.347 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:17.347 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.347 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:17.347 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:06:17.347 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:17.347 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.347 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.348 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:17.348 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:06:17.348 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:17.348 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.348 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.348 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:17.348 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615386+0000", 2024-04-18T21:06:17.348 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.573e-06 2024-04-18T21:06:17.348 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.348 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.348 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:17.348 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:06:17.348 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0723999999999999e-05 2024-04-18T21:06:17.348 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.348 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.348 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:17.349 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615418+0000", 2024-04-18T21:06:17.349 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0902000000000001e-05 2024-04-18T21:06:17.349 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.349 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.349 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.349 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615433+0000", 2024-04-18T21:06:17.349 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5319999999999999e-05 2024-04-18T21:06:17.349 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.349 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.349 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:17.349 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615659+0000", 2024-04-18T21:06:17.349 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000226095 2024-04-18T21:06:17.349 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.349 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.349 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:17.349 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:17.350 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1276e-05 2024-04-18T21:06:17.350 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.350 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.350 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:17.350 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643654+0000", 2024-04-18T21:06:17.350 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027983238000000001 2024-04-18T21:06:17.350 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.350 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.350 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:17.350 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643868+0000", 2024-04-18T21:06:17.350 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000214305 2024-04-18T21:06:17.350 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.350 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.351 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:17.351 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:06:17.351 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035892200000000002 2024-04-18T21:06:17.351 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.351 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.351 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:17.351 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646056+0000", 2024-04-18T21:06:17.351 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001829172 2024-04-18T21:06:17.351 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.351 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.351 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:17.351 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651406+0000", 2024-04-18T21:06:17.351 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0053504800000000003 2024-04-18T21:06:17.351 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.351 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.352 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:17.352 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651551+0000", 2024-04-18T21:06:17.352 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014427999999999999 2024-04-18T21:06:17.352 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.352 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.352 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:17.352 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651660+0000", 2024-04-18T21:06:17.352 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109477 2024-04-18T21:06:17.352 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:17.352 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:17.352 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:17.352 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.352 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.352 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:17.352 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:17.353 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 71.723981379999998, 2024-04-18T21:06:17.353 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045668994999999997, 2024-04-18T21:06:17.353 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:17.353 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:17.353 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:17.353 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:17.353 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.353 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:17.353 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:17.353 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:17.353 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.353 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.353 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:17.353 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:17.353 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:17.354 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.354 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.354 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:17.354 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615459+0000", 2024-04-18T21:06:17.354 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5030000000000001e-06 2024-04-18T21:06:17.354 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.354 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.354 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:17.354 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615506+0000", 2024-04-18T21:06:17.354 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6872000000000001e-05 2024-04-18T21:06:17.354 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.354 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.354 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:17.354 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615527+0000", 2024-04-18T21:06:17.355 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0763000000000001e-05 2024-04-18T21:06:17.355 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.355 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.355 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.355 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615551+0000", 2024-04-18T21:06:17.355 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4159e-05 2024-04-18T21:06:17.355 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.355 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.355 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:17.355 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615736+0000", 2024-04-18T21:06:17.355 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018499599999999999 2024-04-18T21:06:17.355 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.355 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.355 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:17.355 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615748+0000", 2024-04-18T21:06:17.356 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2272999999999999e-05 2024-04-18T21:06:17.356 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.356 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.356 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:17.356 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635481+0000", 2024-04-18T21:06:17.356 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019732772999999999 2024-04-18T21:06:17.356 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.356 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.356 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:17.356 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635791+0000", 2024-04-18T21:06:17.356 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031013299999999998 2024-04-18T21:06:17.356 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.356 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.357 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:17.357 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636101+0000", 2024-04-18T21:06:17.357 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030943300000000002 2024-04-18T21:06:17.357 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.357 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.357 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:17.357 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646043+0000", 2024-04-18T21:06:17.357 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099428139999999995 2024-04-18T21:06:17.357 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.357 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.357 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:17.357 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660991+0000", 2024-04-18T21:06:17.357 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014947142 2024-04-18T21:06:17.357 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.357 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.358 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:17.358 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661061+0000", 2024-04-18T21:06:17.358 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0438000000000006e-05 2024-04-18T21:06:17.358 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.358 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.358 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:17.358 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661127+0000", 2024-04-18T21:06:17.358 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5696000000000003e-05 2024-04-18T21:06:17.358 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:17.358 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:17.358 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:17.358 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.358 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.358 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:17.359 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:17.359 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 71.723768952, 2024-04-18T21:06:17.359 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045745085999999997, 2024-04-18T21:06:17.359 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:17.359 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:17.359 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:17.359 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:17.359 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.359 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:17.359 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:17.359 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:17.359 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.359 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.359 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:17.359 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:17.359 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:17.359 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.360 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.360 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:17.360 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:06:17.360 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7400000000000001e-06 2024-04-18T21:06:17.360 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.360 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.360 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:17.360 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:06:17.360 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8133e-05 2024-04-18T21:06:17.360 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.360 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.360 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:17.360 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615726+0000", 2024-04-18T21:06:17.360 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6132e-05 2024-04-18T21:06:17.360 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.360 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.361 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.361 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615742+0000", 2024-04-18T21:06:17.361 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6157000000000001e-05 2024-04-18T21:06:17.361 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.361 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.361 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:17.361 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615937+0000", 2024-04-18T21:06:17.361 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000194768 2024-04-18T21:06:17.361 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.361 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.361 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:17.361 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615950+0000", 2024-04-18T21:06:17.361 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3084e-05 2024-04-18T21:06:17.361 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.362 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.362 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:17.362 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643676+0000", 2024-04-18T21:06:17.362 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027725639999999999 2024-04-18T21:06:17.362 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.362 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.362 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:17.362 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643867+0000", 2024-04-18T21:06:17.362 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019075900000000001 2024-04-18T21:06:17.362 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.362 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.362 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:17.362 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:06:17.363 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036013799999999997 2024-04-18T21:06:17.363 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.363 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.363 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:17.363 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646068+0000", 2024-04-18T21:06:17.363 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001841536 2024-04-18T21:06:17.363 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.363 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.363 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:17.363 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661184+0000", 2024-04-18T21:06:17.363 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015115458999999999 2024-04-18T21:06:17.363 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.363 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.363 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:17.363 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661283+0000", 2024-04-18T21:06:17.363 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9502999999999999e-05 2024-04-18T21:06:17.364 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.364 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.364 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:17.364 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661415+0000", 2024-04-18T21:06:17.364 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000132037 2024-04-18T21:06:17.364 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:17.364 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:17.364 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:17.364 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.364 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.364 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:17.364 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:06:17.364 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 71.723647264999997, 2024-04-18T21:06:17.364 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036185947000000003, 2024-04-18T21:06:17.364 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:17.365 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:17.365 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:17.365 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:17.365 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.365 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:17.365 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:06:17.365 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:17.365 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.365 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.365 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:17.365 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:06:17.365 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:17.365 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.365 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.365 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:17.365 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615794+0000", 2024-04-18T21:06:17.366 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6440000000000001e-06 2024-04-18T21:06:17.366 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.366 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.366 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:17.366 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615803+0000", 2024-04-18T21:06:17.366 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1220000000000001e-06 2024-04-18T21:06:17.366 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.366 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.366 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:17.366 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615827+0000", 2024-04-18T21:06:17.366 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3997000000000001e-05 2024-04-18T21:06:17.366 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.366 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.367 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.367 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615899+0000", 2024-04-18T21:06:17.367 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2741e-05 2024-04-18T21:06:17.367 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.367 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.367 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:17.367 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616019+0000", 2024-04-18T21:06:17.367 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119874 2024-04-18T21:06:17.367 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.367 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.367 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:17.367 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616029+0000", 2024-04-18T21:06:17.367 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:06:17.368 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.368 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.368 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:17.368 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644823+0000", 2024-04-18T21:06:17.368 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.028793151999999999 2024-04-18T21:06:17.368 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.368 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.368 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:17.368 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645106+0000", 2024-04-18T21:06:17.368 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028379700000000002 2024-04-18T21:06:17.368 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.368 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.368 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:17.368 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645294+0000", 2024-04-18T21:06:17.368 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000187181 2024-04-18T21:06:17.369 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.369 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.369 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:17.369 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646763+0000", 2024-04-18T21:06:17.369 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0014691050000000001 2024-04-18T21:06:17.369 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.369 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.369 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:17.369 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651784+0000", 2024-04-18T21:06:17.369 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050211650000000002 2024-04-18T21:06:17.369 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.369 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.369 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:17.369 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651876+0000", 2024-04-18T21:06:17.370 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2503999999999994e-05 2024-04-18T21:06:17.370 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.370 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.370 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:17.370 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651978+0000", 2024-04-18T21:06:17.370 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000101475 2024-04-18T21:06:17.370 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:17.370 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:17.370 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:17.370 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.370 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.370 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:17.370 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:17.370 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 71.723498657999997, 2024-04-18T21:06:17.371 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032262322000000003, 2024-04-18T21:06:17.371 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:17.371 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:17.371 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:17.371 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:17.371 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.371 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:17.371 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:17.371 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:17.371 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.371 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.371 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:17.371 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:17.371 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:17.371 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.372 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.372 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:17.372 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615943+0000", 2024-04-18T21:06:17.372 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1959999999999998e-06 2024-04-18T21:06:17.372 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.372 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.372 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:17.372 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615956+0000", 2024-04-18T21:06:17.372 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3424000000000001e-05 2024-04-18T21:06:17.372 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.372 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.372 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:17.372 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615983+0000", 2024-04-18T21:06:17.372 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7072000000000001e-05 2024-04-18T21:06:17.372 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.372 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.373 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.373 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616006+0000", 2024-04-18T21:06:17.373 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2823000000000002e-05 2024-04-18T21:06:17.373 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.373 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.373 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:17.373 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616156+0000", 2024-04-18T21:06:17.373 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014962299999999999 2024-04-18T21:06:17.373 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.373 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.373 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:17.373 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616174+0000", 2024-04-18T21:06:17.373 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8082999999999999e-05 2024-04-18T21:06:17.373 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.373 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.374 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:17.374 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.629952+0000", 2024-04-18T21:06:17.374 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013778514 2024-04-18T21:06:17.374 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.374 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.374 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:17.374 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630201+0000", 2024-04-18T21:06:17.374 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024918100000000001 2024-04-18T21:06:17.374 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.374 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.374 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:17.374 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630386+0000", 2024-04-18T21:06:17.374 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018436900000000001 2024-04-18T21:06:17.374 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.375 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.375 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:17.375 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643169+0000", 2024-04-18T21:06:17.375 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012782774 2024-04-18T21:06:17.375 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.375 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.375 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:17.375 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.647924+0000", 2024-04-18T21:06:17.375 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004755787 2024-04-18T21:06:17.375 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.375 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.375 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:17.375 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648069+0000", 2024-04-18T21:06:17.375 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014459600000000001 2024-04-18T21:06:17.375 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.375 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.376 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:17.376 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648203+0000", 2024-04-18T21:06:17.376 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013388000000000001 2024-04-18T21:06:17.376 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:17.376 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:17.376 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:17.376 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.376 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.376 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:17.376 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:06:17.376 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 71.723390394000006, 2024-04-18T21:06:17.376 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032489736999999998, 2024-04-18T21:06:17.376 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:17.376 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:17.376 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:17.377 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:17.377 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.377 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:17.377 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:06:17.377 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:17.377 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.377 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.377 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:17.377 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:06:17.377 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:17.377 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.377 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.377 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:17.377 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616050+0000", 2024-04-18T21:06:17.377 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.606e-06 2024-04-18T21:06:17.377 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.378 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.378 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:17.378 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616061+0000", 2024-04-18T21:06:17.378 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0463e-05 2024-04-18T21:06:17.378 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.378 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.378 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:17.378 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616092+0000", 2024-04-18T21:06:17.378 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1415999999999999e-05 2024-04-18T21:06:17.378 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.378 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.378 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.378 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616109+0000", 2024-04-18T21:06:17.378 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6557000000000001e-05 2024-04-18T21:06:17.379 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.379 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.379 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:17.379 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616358+0000", 2024-04-18T21:06:17.379 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000249077 2024-04-18T21:06:17.379 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.379 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.379 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:17.379 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616370+0000", 2024-04-18T21:06:17.379 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2037e-05 2024-04-18T21:06:17.379 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.379 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.379 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:17.379 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.634920+0000", 2024-04-18T21:06:17.379 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018550397 2024-04-18T21:06:17.380 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.380 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.380 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:17.380 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640420+0000", 2024-04-18T21:06:17.380 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055000539999999999 2024-04-18T21:06:17.380 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.380 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.380 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:17.380 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648538+0000", 2024-04-18T21:06:17.380 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0081181299999999994 2024-04-18T21:06:17.380 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:17.380 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:17.380 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:17.380 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.380 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.381 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:17.381 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:06:17.381 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 71.723306073000003, 2024-04-18T21:06:17.381 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036090029000000003, 2024-04-18T21:06:17.381 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:17.381 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:17.381 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:17.381 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:17.381 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.381 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:17.381 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:06:17.381 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:17.381 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.381 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.381 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:17.381 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:06:17.382 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:17.382 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.382 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.382 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:17.382 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616134+0000", 2024-04-18T21:06:17.382 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.353e-06 2024-04-18T21:06:17.382 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.382 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.382 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:17.382 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616141+0000", 2024-04-18T21:06:17.382 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2770000000000002e-06 2024-04-18T21:06:17.382 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.382 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.382 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:17.382 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616160+0000", 2024-04-18T21:06:17.383 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.91e-05 2024-04-18T21:06:17.383 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.383 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.383 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.383 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616170+0000", 2024-04-18T21:06:17.383 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7699999999999996e-06 2024-04-18T21:06:17.383 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.383 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.383 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:17.383 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616275+0000", 2024-04-18T21:06:17.383 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105313 2024-04-18T21:06:17.383 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.383 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.383 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:17.383 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616288+0000", 2024-04-18T21:06:17.384 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3027000000000001e-05 2024-04-18T21:06:17.384 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.384 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.384 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:17.384 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646160+0000", 2024-04-18T21:06:17.384 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.029872019 2024-04-18T21:06:17.384 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.384 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.384 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:17.384 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646368+0000", 2024-04-18T21:06:17.384 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020811899999999999 2024-04-18T21:06:17.384 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.384 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.384 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:17.384 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652223+0000", 2024-04-18T21:06:17.384 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.005855051 2024-04-18T21:06:17.384 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:17.385 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:17.385 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:17.385 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.385 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.385 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:17.385 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:17.385 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 71.723248503999997, 2024-04-18T21:06:17.385 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043572403000000003, 2024-04-18T21:06:17.385 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:17.385 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:17.385 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:17.385 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:17.385 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.385 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:17.385 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:17.386 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:17.386 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.386 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.386 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:17.386 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:17.386 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:17.386 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.386 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.386 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:17.386 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616192+0000", 2024-04-18T21:06:17.386 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:06:17.386 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.386 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.386 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:17.386 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616203+0000", 2024-04-18T21:06:17.387 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0890000000000001e-05 2024-04-18T21:06:17.387 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.387 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.387 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:17.387 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616223+0000", 2024-04-18T21:06:17.387 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0409000000000001e-05 2024-04-18T21:06:17.387 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.387 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.387 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.387 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616238+0000", 2024-04-18T21:06:17.387 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5160000000000001e-05 2024-04-18T21:06:17.387 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.387 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.387 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:17.387 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616343+0000", 2024-04-18T21:06:17.388 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000104831 2024-04-18T21:06:17.388 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.388 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.388 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:17.388 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616357+0000", 2024-04-18T21:06:17.388 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3686000000000001e-05 2024-04-18T21:06:17.388 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.388 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.388 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:17.388 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635912+0000", 2024-04-18T21:06:17.388 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019554944000000001 2024-04-18T21:06:17.388 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.388 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.388 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:17.388 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636231+0000", 2024-04-18T21:06:17.388 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000318766 2024-04-18T21:06:17.389 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.389 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.389 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:17.389 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659763+0000", 2024-04-18T21:06:17.389 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023532474000000001 2024-04-18T21:06:17.389 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:17.389 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:17.389 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:17.389 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.389 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.389 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:17.389 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:06:17.389 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 71.719319796999997, 2024-04-18T21:06:17.389 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015007971, 2024-04-18T21:06:17.389 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:17.390 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:17.390 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:17.390 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:17.390 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.390 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:17.390 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:06:17.390 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:17.390 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.390 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.390 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:17.390 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:06:17.390 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:17.390 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.390 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.390 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:17.391 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620120+0000", 2024-04-18T21:06:17.391 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0359999999999999e-06 2024-04-18T21:06:17.391 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.391 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.391 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:17.391 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620157+0000", 2024-04-18T21:06:17.391 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6636e-05 2024-04-18T21:06:17.391 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.391 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.391 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:17.391 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620177+0000", 2024-04-18T21:06:17.391 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0247000000000001e-05 2024-04-18T21:06:17.391 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.391 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.391 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.392 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620195+0000", 2024-04-18T21:06:17.392 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7819e-05 2024-04-18T21:06:17.392 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.392 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.392 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:17.392 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620342+0000", 2024-04-18T21:06:17.392 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014643300000000001 2024-04-18T21:06:17.392 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.392 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.392 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:17.392 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620405+0000", 2024-04-18T21:06:17.392 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3522000000000006e-05 2024-04-18T21:06:17.392 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.392 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.392 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:17.392 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635016+0000", 2024-04-18T21:06:17.393 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014610840999999999 2024-04-18T21:06:17.393 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.393 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.393 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:17.393 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635127+0000", 2024-04-18T21:06:17.393 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111437 2024-04-18T21:06:17.393 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:17.393 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:17.393 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:17.393 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.393 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.393 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:17.393 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:06:17.393 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 71.719212529000004, 2024-04-18T21:06:17.393 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012693296, 2024-04-18T21:06:17.393 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:17.394 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:17.394 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:17.394 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:17.394 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.394 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:17.394 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:06:17.394 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:17.394 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.394 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.394 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:17.394 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:06:17.394 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:17.394 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.394 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.395 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:17.395 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620228+0000", 2024-04-18T21:06:17.395 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:06:17.395 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.395 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.395 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:17.395 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620236+0000", 2024-04-18T21:06:17.395 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.303e-06 2024-04-18T21:06:17.395 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.395 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.395 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:17.395 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620255+0000", 2024-04-18T21:06:17.395 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9406e-05 2024-04-18T21:06:17.395 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.395 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.395 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.396 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620274+0000", 2024-04-18T21:06:17.396 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8940000000000002e-05 2024-04-18T21:06:17.396 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.396 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.396 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:17.396 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:06:17.396 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001558753 2024-04-18T21:06:17.396 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.396 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.396 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:17.396 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621879+0000", 2024-04-18T21:06:17.396 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6359000000000001e-05 2024-04-18T21:06:17.396 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.397 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.397 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:17.397 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632841+0000", 2024-04-18T21:06:17.397 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010961907 2024-04-18T21:06:17.397 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.397 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.397 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:17.397 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632920+0000", 2024-04-18T21:06:17.397 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8714999999999994e-05 2024-04-18T21:06:17.397 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:17.397 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:17.397 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:17.397 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.397 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.397 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:17.397 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:06:17.398 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 71.717666765999994, 2024-04-18T21:06:17.398 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013445702, 2024-04-18T21:06:17.398 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:17.398 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:17.398 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:17.398 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:17.398 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.398 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:17.398 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:06:17.398 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:17.398 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.398 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.398 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:17.398 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:06:17.399 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:17.399 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.399 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.399 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:17.399 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621774+0000", 2024-04-18T21:06:17.399 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2500000000000001e-06 2024-04-18T21:06:17.399 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.399 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.399 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:17.399 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621786+0000", 2024-04-18T21:06:17.399 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2636000000000001e-05 2024-04-18T21:06:17.399 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.399 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.399 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:17.400 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621814+0000", 2024-04-18T21:06:17.400 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7823000000000001e-05 2024-04-18T21:06:17.400 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.400 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.400 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.400 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621844+0000", 2024-04-18T21:06:17.400 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9589000000000001e-05 2024-04-18T21:06:17.400 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.400 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.400 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:17.400 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622253+0000", 2024-04-18T21:06:17.400 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040963700000000002 2024-04-18T21:06:17.400 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.400 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.400 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:17.400 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622304+0000", 2024-04-18T21:06:17.401 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0868999999999997e-05 2024-04-18T21:06:17.401 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.401 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.401 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:17.401 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635133+0000", 2024-04-18T21:06:17.401 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012829136 2024-04-18T21:06:17.401 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.401 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.401 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:17.401 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635218+0000", 2024-04-18T21:06:17.401 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4761999999999999e-05 2024-04-18T21:06:17.401 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:17.401 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:17.401 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:17.401 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.401 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.402 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:17.402 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:06:17.402 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 71.717540005999993, 2024-04-18T21:06:17.402 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014162065, 2024-04-18T21:06:17.402 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:17.402 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:17.402 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:17.402 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:17.402 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.402 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:17.402 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:06:17.402 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:17.402 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.402 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.403 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:17.403 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:06:17.403 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:17.403 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.403 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.403 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:17.403 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621900+0000", 2024-04-18T21:06:17.403 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:06:17.403 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.403 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.403 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:17.403 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621910+0000", 2024-04-18T21:06:17.403 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0207000000000001e-05 2024-04-18T21:06:17.403 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.403 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.404 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:17.404 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621932+0000", 2024-04-18T21:06:17.404 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1789000000000001e-05 2024-04-18T21:06:17.404 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.404 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.404 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.404 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621946+0000", 2024-04-18T21:06:17.404 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4212999999999999e-05 2024-04-18T21:06:17.404 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.404 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.404 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:17.404 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624477+0000", 2024-04-18T21:06:17.404 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025303470000000001 2024-04-18T21:06:17.404 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.404 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.405 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:17.405 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624525+0000", 2024-04-18T21:06:17.405 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8084999999999998e-05 2024-04-18T21:06:17.405 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.405 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.405 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:17.405 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635976+0000", 2024-04-18T21:06:17.405 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.011451368999999999 2024-04-18T21:06:17.405 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.405 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.405 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:17.405 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636061+0000", 2024-04-18T21:06:17.405 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5094999999999998e-05 2024-04-18T21:06:17.405 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:17.405 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:17.406 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:17.406 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.406 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.406 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:06:17.406 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:06:17.406 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 71.708304381000005, 2024-04-18T21:06:17.406 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0098014739999999993, 2024-04-18T21:06:17.406 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:17.406 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:17.406 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:06:17.406 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:17.406 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.406 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:17.406 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:06:17.406 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:17.407 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.407 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.407 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:17.407 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:06:17.407 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:17.407 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.407 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.407 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:17.407 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631136+0000", 2024-04-18T21:06:17.407 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0139999999999999e-06 2024-04-18T21:06:17.407 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.407 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.407 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:17.407 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631152+0000", 2024-04-18T21:06:17.407 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6365999999999999e-05 2024-04-18T21:06:17.408 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.408 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.408 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:17.408 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631961+0000", 2024-04-18T21:06:17.408 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00080873100000000003 2024-04-18T21:06:17.408 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.408 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.408 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.408 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632021+0000", 2024-04-18T21:06:17.408 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0541999999999997e-05 2024-04-18T21:06:17.408 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.408 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.408 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:17.408 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633539+0000", 2024-04-18T21:06:17.408 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015175639999999999 2024-04-18T21:06:17.409 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.409 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.409 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:17.409 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640936+0000", 2024-04-18T21:06:17.409 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007397257 2024-04-18T21:06:17.409 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:17.409 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:17.409 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:17.409 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.409 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.409 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-18T21:06:17.409 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:06:17.409 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 71.690842947999997, 2024-04-18T21:06:17.409 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00073592199999999997, 2024-04-18T21:06:17.409 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:17.410 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:17.410 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:17.410 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:17.410 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.410 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:17.410 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:06:17.410 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:17.410 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.410 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.410 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:17.410 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:06:17.410 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:17.410 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.410 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.411 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:17.411 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648597+0000", 2024-04-18T21:06:17.411 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:06:17.411 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.411 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.411 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:17.411 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648605+0000", 2024-04-18T21:06:17.411 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3960000000000006e-06 2024-04-18T21:06:17.411 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.411 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.411 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:17.411 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648625+0000", 2024-04-18T21:06:17.411 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9987e-05 2024-04-18T21:06:17.411 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.411 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.411 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.412 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648643+0000", 2024-04-18T21:06:17.412 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7079e-05 2024-04-18T21:06:17.412 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.412 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.412 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:17.412 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649043+0000", 2024-04-18T21:06:17.412 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040083399999999998 2024-04-18T21:06:17.412 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.412 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.412 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:17.412 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649062+0000", 2024-04-18T21:06:17.412 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9052999999999999e-05 2024-04-18T21:06:17.412 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.412 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.412 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:17.412 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649332+0000", 2024-04-18T21:06:17.413 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026971999999999999 2024-04-18T21:06:17.413 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:17.413 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:17.413 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:17.413 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.413 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.413 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:06:17.413 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:06:17.413 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 71.688068047000002, 2024-04-18T21:06:17.413 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00086123999999999999, 2024-04-18T21:06:17.413 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:17.413 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:17.413 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:06:17.413 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:17.413 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.413 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:17.414 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:06:17.414 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:17.414 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.414 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.414 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:17.414 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:06:17.414 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:17.414 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.414 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.414 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:17.414 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651372+0000", 2024-04-18T21:06:17.414 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7599999999999997e-07 2024-04-18T21:06:17.414 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.414 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.415 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:17.415 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651377+0000", 2024-04-18T21:06:17.415 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.22e-06 2024-04-18T21:06:17.415 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.415 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.415 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:17.415 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651394+0000", 2024-04-18T21:06:17.415 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6646999999999998e-05 2024-04-18T21:06:17.415 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.415 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.415 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.415 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651427+0000", 2024-04-18T21:06:17.415 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3682e-05 2024-04-18T21:06:17.415 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.415 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.416 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:17.416 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652029+0000", 2024-04-18T21:06:17.416 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00060152199999999995 2024-04-18T21:06:17.416 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.416 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.416 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:17.416 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652232+0000", 2024-04-18T21:06:17.416 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020359299999999999 2024-04-18T21:06:17.416 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:17.416 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:17.416 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:17.416 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.416 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.417 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:06:17.417 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:06:17.417 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 71.680041084999999, 2024-04-18T21:06:17.417 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0017426200000000001, 2024-04-18T21:06:17.417 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:17.417 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:17.417 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:17.417 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:17.417 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.417 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:17.417 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:06:17.417 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:17.417 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.417 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.418 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:17.418 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:06:17.418 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:17.418 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.418 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.418 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:17.418 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659399+0000", 2024-04-18T21:06:17.418 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6000000000000002e-07 2024-04-18T21:06:17.418 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.418 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.418 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:17.418 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659405+0000", 2024-04-18T21:06:17.418 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5069999999999997e-06 2024-04-18T21:06:17.419 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.419 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.419 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:17.419 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659425+0000", 2024-04-18T21:06:17.419 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.927e-05 2024-04-18T21:06:17.419 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.419 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.419 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.419 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659443+0000", 2024-04-18T21:06:17.419 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8051999999999999e-05 2024-04-18T21:06:17.419 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.419 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.419 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:17.419 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660973+0000", 2024-04-18T21:06:17.420 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001530106 2024-04-18T21:06:17.420 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.420 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.420 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:17.420 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660983+0000", 2024-04-18T21:06:17.420 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0516999999999999e-05 2024-04-18T21:06:17.420 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.420 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.420 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:17.420 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661141+0000", 2024-04-18T21:06:17.420 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015730799999999999 2024-04-18T21:06:17.420 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:17.420 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:17.420 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:17.421 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.421 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.421 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:06:17.421 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:06:17.421 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 71.679824460000006, 2024-04-18T21:06:17.421 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001812311, 2024-04-18T21:06:17.421 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:17.421 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:17.421 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:17.421 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:17.421 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.421 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:17.421 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:06:17.421 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:17.422 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.422 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.422 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:17.422 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:06:17.422 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:17.422 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.422 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.422 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:17.422 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659616+0000", 2024-04-18T21:06:17.422 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.277e-06 2024-04-18T21:06:17.422 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.422 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.422 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:17.423 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659625+0000", 2024-04-18T21:06:17.423 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5359999999999998e-06 2024-04-18T21:06:17.423 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.423 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.423 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:17.423 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659647+0000", 2024-04-18T21:06:17.423 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1857000000000001e-05 2024-04-18T21:06:17.423 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.423 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.423 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.423 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659664+0000", 2024-04-18T21:06:17.423 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6405999999999998e-05 2024-04-18T21:06:17.423 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.423 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.424 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:17.424 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661169+0000", 2024-04-18T21:06:17.424 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015054179999999999 2024-04-18T21:06:17.424 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.424 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.424 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:17.424 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661177+0000", 2024-04-18T21:06:17.424 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9680000000000006e-06 2024-04-18T21:06:17.424 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.424 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.424 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:17.424 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661427+0000", 2024-04-18T21:06:17.424 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024984900000000001 2024-04-18T21:06:17.424 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:17.424 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:17.425 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:17.425 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.425 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.425 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-18T21:06:17.425 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:06:17.425 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 69.726903852000007, 2024-04-18T21:06:17.425 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0030975030000000001, 2024-04-18T21:06:17.425 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:17.425 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:17.425 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:17.425 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:17.425 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.425 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:17.425 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:06:17.426 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:17.426 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.426 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.426 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:17.426 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:06:17.426 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:17.426 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.426 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.426 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:17.426 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612538+0000", 2024-04-18T21:06:17.426 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6259999999999999e-06 2024-04-18T21:06:17.426 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.426 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.426 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:17.427 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612552+0000", 2024-04-18T21:06:17.427 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4073999999999999e-05 2024-04-18T21:06:17.427 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.427 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.427 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:17.427 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612585+0000", 2024-04-18T21:06:17.427 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3504999999999999e-05 2024-04-18T21:06:17.427 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.427 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.427 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.427 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612601+0000", 2024-04-18T21:06:17.427 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5194000000000001e-05 2024-04-18T21:06:17.427 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.427 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.427 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:17.427 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612746+0000", 2024-04-18T21:06:17.428 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145666 2024-04-18T21:06:17.428 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.428 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.428 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:17.428 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612953+0000", 2024-04-18T21:06:17.428 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000207109 2024-04-18T21:06:17.428 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.428 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.428 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:17.428 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.613134+0000", 2024-04-18T21:06:17.428 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018041300000000001 2024-04-18T21:06:17.428 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.428 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.428 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:17.428 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.614411+0000", 2024-04-18T21:06:17.429 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0012769929999999999 2024-04-18T21:06:17.429 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.429 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.429 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:17.429 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615441+0000", 2024-04-18T21:06:17.429 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001029917 2024-04-18T21:06:17.429 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.429 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.429 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:17.429 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615522+0000", 2024-04-18T21:06:17.429 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1142000000000003e-05 2024-04-18T21:06:17.429 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.429 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.429 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:17.430 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615633+0000", 2024-04-18T21:06:17.430 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000110864 2024-04-18T21:06:17.430 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:17.430 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:17.430 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:17.430 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.430 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.430 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-18T21:06:17.430 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:06:17.430 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 51.724618040999999, 2024-04-18T21:06:17.430 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088979039999999999, 2024-04-18T21:06:17.430 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:17.430 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:17.431 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:17.431 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:17.431 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.431 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:17.431 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:06:17.431 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:17.431 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.431 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.431 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:17.431 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:06:17.431 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:17.431 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.431 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.431 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:17.432 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614825+0000", 2024-04-18T21:06:17.432 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4829999999999999e-06 2024-04-18T21:06:17.432 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.432 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.432 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:17.432 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614843+0000", 2024-04-18T21:06:17.432 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8777e-05 2024-04-18T21:06:17.432 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.432 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.432 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:17.432 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614884+0000", 2024-04-18T21:06:17.432 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1051999999999999e-05 2024-04-18T21:06:17.432 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.432 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.433 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.433 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614903+0000", 2024-04-18T21:06:17.433 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9069999999999999e-05 2024-04-18T21:06:17.433 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.433 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.433 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:17.433 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615047+0000", 2024-04-18T21:06:17.433 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014374400000000001 2024-04-18T21:06:17.433 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.433 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.433 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:17.433 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615061+0000", 2024-04-18T21:06:17.433 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4063000000000001e-05 2024-04-18T21:06:17.433 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.433 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.434 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:17.434 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621064+0000", 2024-04-18T21:06:17.434 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0060029200000000001 2024-04-18T21:06:17.434 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.434 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.434 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:17.434 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621211+0000", 2024-04-18T21:06:17.434 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000147224 2024-04-18T21:06:17.434 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.434 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.434 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:17.434 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621396+0000", 2024-04-18T21:06:17.434 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018454699999999999 2024-04-18T21:06:17.435 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.435 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.435 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:17.435 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.622517+0000", 2024-04-18T21:06:17.435 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001121424 2024-04-18T21:06:17.435 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.435 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.435 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:17.435 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623571+0000", 2024-04-18T21:06:17.435 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010538660000000001 2024-04-18T21:06:17.435 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.435 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.435 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:17.435 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623658+0000", 2024-04-18T21:06:17.435 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6439000000000004e-05 2024-04-18T21:06:17.436 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:17.436 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:17.436 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:17.436 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623719+0000", 2024-04-18T21:06:17.436 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1295000000000002e-05 2024-04-18T21:06:17.436 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:17.436 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:17.436 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:17.436 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:17.436 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:17.436 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:17.437 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:17.438 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:17.434+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:17.538 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:17.539+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:17.569 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:17.569 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:06:17.569 INFO:teuthology.orchestra.run.smithi132.stdout: "num_ops": 0 2024-04-18T21:06:17.569 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:17.585 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:17.640 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:17.638+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:17.709 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:17.709 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:06:17.709 INFO:teuthology.orchestra.run.smithi132.stdout: "complaint_time": 30, 2024-04-18T21:06:17.709 INFO:teuthology.orchestra.run.smithi132.stdout: "num_blocked_ops": 0 2024-04-18T21:06:17.709 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:17.723 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:17.767 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:17.766+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:17.841 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:17.838+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:17.844 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:17.844 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 20, 2024-04-18T21:06:17.844 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 600, 2024-04-18T21:06:17.844 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [ 2024-04-18T21:06:17.844 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.845 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:17.845 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:06:17.845 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 82.931963468000006, 2024-04-18T21:06:17.845 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.02518273, 2024-04-18T21:06:17.845 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:17.845 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:17.845 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:17.845 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:17.845 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:17.845 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:17.845 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 141 2024-04-18T21:06:17.845 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.845 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:17.845 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.846 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:17.846 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:06:17.846 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:17.846 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.846 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.846 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:17.846 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:06:17.846 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:17.846 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.846 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.846 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:17.846 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911562+0000", 2024-04-18T21:06:17.846 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9300000000000006e-07 2024-04-18T21:06:17.847 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.847 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.847 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:17.847 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911569+0000", 2024-04-18T21:06:17.847 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0169999999999999e-06 2024-04-18T21:06:17.847 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.847 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.847 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:17.847 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911582+0000", 2024-04-18T21:06:17.847 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.343e-05 2024-04-18T21:06:17.847 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.847 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.847 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.847 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911590+0000", 2024-04-18T21:06:17.847 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.413e-06 2024-04-18T21:06:17.848 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.848 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.848 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:17.848 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.933922+0000", 2024-04-18T21:06:17.848 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.022332093000000001 2024-04-18T21:06:17.848 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.848 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.848 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:17.848 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.934155+0000", 2024-04-18T21:06:17.848 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023378900000000001 2024-04-18T21:06:17.848 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.848 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.848 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:17.848 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.934514+0000", 2024-04-18T21:06:17.849 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00035859200000000003 2024-04-18T21:06:17.849 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.849 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.849 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:17.849 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.935973+0000", 2024-04-18T21:06:17.849 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001458705 2024-04-18T21:06:17.849 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.849 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.849 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:17.849 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936488+0000", 2024-04-18T21:06:17.849 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00051550000000000001 2024-04-18T21:06:17.849 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.849 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.849 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:17.849 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936636+0000", 2024-04-18T21:06:17.850 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014779800000000001 2024-04-18T21:06:17.850 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.850 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.850 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:17.850 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936743+0000", 2024-04-18T21:06:17.850 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010739999999999999 2024-04-18T21:06:17.850 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:17.850 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:17.850 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:17.850 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.850 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.850 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:17.850 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:17.851 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 82.814764494000002, 2024-04-18T21:06:17.851 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023654959999999999, 2024-04-18T21:06:17.851 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:17.851 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:17.851 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:17.851 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:17.851 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:17.851 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:17.851 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 163 2024-04-18T21:06:17.851 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.851 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:17.851 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.851 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:17.851 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:17.851 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:17.852 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.852 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.852 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:17.852 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:17.852 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:17.852 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.852 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.852 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:17.852 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:17.852 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0999999999999998e-07 2024-04-18T21:06:17.852 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.852 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.852 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:17.852 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028766+0000", 2024-04-18T21:06:17.852 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4700000000000001e-06 2024-04-18T21:06:17.853 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.853 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.853 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:17.853 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028775+0000", 2024-04-18T21:06:17.853 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.3190000000000001e-06 2024-04-18T21:06:17.853 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.853 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.853 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.853 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028782+0000", 2024-04-18T21:06:17.853 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.2300000000000002e-06 2024-04-18T21:06:17.853 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.853 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.853 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:17.853 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046667+0000", 2024-04-18T21:06:17.853 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017884356000000001 2024-04-18T21:06:17.853 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.854 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.854 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:17.854 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046788+0000", 2024-04-18T21:06:17.854 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012125000000000001 2024-04-18T21:06:17.854 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.854 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.854 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:17.854 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046982+0000", 2024-04-18T21:06:17.854 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019394 2024-04-18T21:06:17.854 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.854 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.854 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:17.855 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051969+0000", 2024-04-18T21:06:17.855 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0049868150000000003 2024-04-18T21:06:17.855 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.855 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.855 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:17.855 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052089+0000", 2024-04-18T21:06:17.855 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011993 2024-04-18T21:06:17.855 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.855 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.855 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:17.855 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052292+0000", 2024-04-18T21:06:17.855 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020345699999999999 2024-04-18T21:06:17.855 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.855 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.855 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:17.856 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052415+0000", 2024-04-18T21:06:17.856 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000122483 2024-04-18T21:06:17.856 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:17.856 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:17.856 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:17.856 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.856 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.856 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:17.856 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:17.856 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 82.814730261999998, 2024-04-18T21:06:17.856 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023864586, 2024-04-18T21:06:17.856 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:17.856 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:17.856 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:17.856 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:17.857 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:17.857 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:17.857 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 164 2024-04-18T21:06:17.857 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.857 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:17.857 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.857 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:17.857 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:17.857 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:17.857 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.857 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.857 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:17.857 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:17.857 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:17.858 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.858 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.858 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:17.858 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028795+0000", 2024-04-18T21:06:17.858 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7999999999999995e-07 2024-04-18T21:06:17.858 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.858 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.858 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:17.858 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028884+0000", 2024-04-18T21:06:17.858 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8997000000000002e-05 2024-04-18T21:06:17.858 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.858 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.858 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:17.859 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028895+0000", 2024-04-18T21:06:17.859 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1647e-05 2024-04-18T21:06:17.859 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.859 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.859 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.859 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028903+0000", 2024-04-18T21:06:17.859 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.909e-06 2024-04-18T21:06:17.859 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.859 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.859 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:17.859 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.047818+0000", 2024-04-18T21:06:17.859 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018914337 2024-04-18T21:06:17.859 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.860 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.860 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:17.860 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.048094+0000", 2024-04-18T21:06:17.860 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00027653500000000001 2024-04-18T21:06:17.860 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.860 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.860 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:17.860 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.048471+0000", 2024-04-18T21:06:17.860 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00037705799999999999 2024-04-18T21:06:17.860 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.860 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.860 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:17.860 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052516+0000", 2024-04-18T21:06:17.860 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0040452739999999997 2024-04-18T21:06:17.861 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.861 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.861 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:17.861 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052535+0000", 2024-04-18T21:06:17.861 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.84e-05 2024-04-18T21:06:17.861 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.861 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.861 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:17.861 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052603+0000", 2024-04-18T21:06:17.861 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.8095000000000004e-05 2024-04-18T21:06:17.861 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.861 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.861 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:17.862 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052659+0000", 2024-04-18T21:06:17.862 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5653999999999999e-05 2024-04-18T21:06:17.862 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:17.862 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:17.862 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:17.862 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.862 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.862 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:17.862 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:17.862 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 82.814606819000005, 2024-04-18T21:06:17.862 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024516458000000001, 2024-04-18T21:06:17.862 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:17.862 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:17.862 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:17.863 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:17.863 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:17.863 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:17.863 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 165 2024-04-18T21:06:17.863 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.863 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:17.863 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.863 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:17.863 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:17.863 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:17.863 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.863 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.863 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:17.863 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:17.863 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:17.864 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.864 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.864 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:17.864 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028918+0000", 2024-04-18T21:06:17.864 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8000000000000005e-07 2024-04-18T21:06:17.864 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.864 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.864 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:17.864 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028924+0000", 2024-04-18T21:06:17.864 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5659999999999997e-06 2024-04-18T21:06:17.864 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.864 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.864 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:17.864 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028933+0000", 2024-04-18T21:06:17.865 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.38e-06 2024-04-18T21:06:17.865 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.865 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.865 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.865 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028940+0000", 2024-04-18T21:06:17.865 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0060000000000003e-06 2024-04-18T21:06:17.865 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.865 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.865 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:17.865 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.050846+0000", 2024-04-18T21:06:17.865 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021906119000000002 2024-04-18T21:06:17.865 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.865 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.865 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:17.866 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051025+0000", 2024-04-18T21:06:17.866 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017850799999999999 2024-04-18T21:06:17.866 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.866 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.866 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:17.866 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051221+0000", 2024-04-18T21:06:17.866 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019608700000000001 2024-04-18T21:06:17.866 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.866 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.866 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:17.866 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052675+0000", 2024-04-18T21:06:17.866 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0014537899999999999 2024-04-18T21:06:17.866 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.866 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.867 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:17.867 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053311+0000", 2024-04-18T21:06:17.867 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00063613299999999999 2024-04-18T21:06:17.867 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.867 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.867 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:17.867 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053381+0000", 2024-04-18T21:06:17.867 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0074999999999996e-05 2024-04-18T21:06:17.867 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.867 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.867 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:17.867 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053434+0000", 2024-04-18T21:06:17.867 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3013999999999998e-05 2024-04-18T21:06:17.867 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:17.867 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:17.868 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:17.868 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.868 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.868 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:17.868 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:17.868 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 82.701301340000001, 2024-04-18T21:06:17.868 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023772793, 2024-04-18T21:06:17.868 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:17.868 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:17.868 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:17.868 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:17.868 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:17.868 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:17.868 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 187 2024-04-18T21:06:17.869 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.869 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:17.869 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.869 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:17.869 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:17.869 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:17.869 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.869 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.869 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:17.869 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:17.869 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:17.869 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.869 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.869 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:17.869 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142224+0000", 2024-04-18T21:06:17.870 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.47e-07 2024-04-18T21:06:17.870 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.870 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.870 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:17.870 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142233+0000", 2024-04-18T21:06:17.870 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0729999999999994e-06 2024-04-18T21:06:17.870 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.870 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.870 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:17.870 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142255+0000", 2024-04-18T21:06:17.870 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.2535999999999999e-05 2024-04-18T21:06:17.870 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.870 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.870 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.870 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142268+0000", 2024-04-18T21:06:17.871 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2686e-05 2024-04-18T21:06:17.871 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.871 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.871 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:17.871 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160497+0000", 2024-04-18T21:06:17.871 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018228779000000001 2024-04-18T21:06:17.871 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.871 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.871 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:17.871 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160634+0000", 2024-04-18T21:06:17.871 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000137315 2024-04-18T21:06:17.871 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.871 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.871 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:17.871 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160831+0000", 2024-04-18T21:06:17.871 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019683100000000001 2024-04-18T21:06:17.872 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.872 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.872 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:17.872 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165129+0000", 2024-04-18T21:06:17.872 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0042981299999999998 2024-04-18T21:06:17.872 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.872 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.872 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:17.872 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165776+0000", 2024-04-18T21:06:17.872 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00064702900000000003 2024-04-18T21:06:17.872 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.872 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.872 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:17.872 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165921+0000", 2024-04-18T21:06:17.872 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014506 2024-04-18T21:06:17.872 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.873 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.873 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:17.873 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165996+0000", 2024-04-18T21:06:17.873 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.4406999999999994e-05 2024-04-18T21:06:17.873 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:17.873 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:17.873 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:17.873 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.873 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.873 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:17.873 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:17.873 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 82.701240741999996, 2024-04-18T21:06:17.873 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026802157, 2024-04-18T21:06:17.873 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:17.873 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:17.873 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:17.874 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:17.874 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:17.874 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:17.874 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 188 2024-04-18T21:06:17.874 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.874 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:17.874 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.874 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:17.874 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:17.874 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:17.874 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.874 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.874 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:17.874 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:17.875 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:17.875 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.875 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.875 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:17.875 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142284+0000", 2024-04-18T21:06:17.875 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4e-07 2024-04-18T21:06:17.875 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.875 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.875 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:17.875 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142374+0000", 2024-04-18T21:06:17.875 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0099999999999995e-05 2024-04-18T21:06:17.875 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.875 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.875 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:17.875 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142386+0000", 2024-04-18T21:06:17.876 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1770000000000001e-05 2024-04-18T21:06:17.876 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.876 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.876 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.876 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142394+0000", 2024-04-18T21:06:17.876 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.2130000000000008e-06 2024-04-18T21:06:17.876 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.876 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.876 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:17.876 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.161743+0000", 2024-04-18T21:06:17.876 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019348644000000002 2024-04-18T21:06:17.876 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.876 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.876 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:17.876 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.161865+0000", 2024-04-18T21:06:17.876 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012210899999999999 2024-04-18T21:06:17.876 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.877 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.877 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:17.877 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.162055+0000", 2024-04-18T21:06:17.877 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000189994 2024-04-18T21:06:17.877 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.877 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.877 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:17.877 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165735+0000", 2024-04-18T21:06:17.877 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0036803270000000002 2024-04-18T21:06:17.877 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.877 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.877 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:17.877 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.168911+0000", 2024-04-18T21:06:17.877 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0031753689999999999 2024-04-18T21:06:17.877 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.877 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.878 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:17.878 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169012+0000", 2024-04-18T21:06:17.878 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010157699999999999 2024-04-18T21:06:17.878 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.878 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.878 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:17.878 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169086+0000", 2024-04-18T21:06:17.878 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3213999999999994e-05 2024-04-18T21:06:17.878 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:17.878 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:17.878 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:17.878 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.878 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.878 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:17.879 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:17.879 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 82.701115435999995, 2024-04-18T21:06:17.879 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026811423000000001, 2024-04-18T21:06:17.879 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:17.879 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:17.879 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:17.879 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:17.879 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:17.879 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:17.879 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 189 2024-04-18T21:06:17.879 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.879 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:17.879 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.879 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:17.880 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:17.880 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:17.880 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.880 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.880 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:17.880 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:17.880 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:17.880 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.880 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.880 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:17.880 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142410+0000", 2024-04-18T21:06:17.880 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:06:17.880 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.880 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.880 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:17.880 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142415+0000", 2024-04-18T21:06:17.881 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.7939999999999999e-06 2024-04-18T21:06:17.881 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.881 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.881 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:17.881 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142470+0000", 2024-04-18T21:06:17.881 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4537999999999999e-05 2024-04-18T21:06:17.881 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.881 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.881 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.881 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142481+0000", 2024-04-18T21:06:17.881 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0966e-05 2024-04-18T21:06:17.881 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.881 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.881 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:17.881 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.163493+0000", 2024-04-18T21:06:17.881 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021012444000000002 2024-04-18T21:06:17.882 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.882 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.882 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:17.882 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.163727+0000", 2024-04-18T21:06:17.882 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000233339 2024-04-18T21:06:17.882 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.882 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.882 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:17.882 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.164102+0000", 2024-04-18T21:06:17.882 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000374872 2024-04-18T21:06:17.882 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.882 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.882 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:17.882 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.166528+0000", 2024-04-18T21:06:17.882 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0024258729999999998 2024-04-18T21:06:17.883 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.883 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.883 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:17.883 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169101+0000", 2024-04-18T21:06:17.883 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0025737680000000001 2024-04-18T21:06:17.883 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.883 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.883 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:17.883 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169171+0000", 2024-04-18T21:06:17.883 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0148000000000007e-05 2024-04-18T21:06:17.883 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.883 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.883 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:17.883 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169220+0000", 2024-04-18T21:06:17.883 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8767999999999998e-05 2024-04-18T21:06:17.884 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:17.884 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:17.884 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:17.884 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.884 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.884 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:17.884 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:17.884 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 72.227542884000002, 2024-04-18T21:06:17.884 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024082777999999999, 2024-04-18T21:06:17.884 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:17.884 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:17.884 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:17.884 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:17.884 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.884 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:17.885 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:17.885 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:17.885 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.885 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.885 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:17.885 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:17.885 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:17.885 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.885 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.885 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:17.885 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615984+0000", 2024-04-18T21:06:17.885 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.9869999999999999e-06 2024-04-18T21:06:17.885 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.885 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.885 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:17.886 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615999+0000", 2024-04-18T21:06:17.886 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4646e-05 2024-04-18T21:06:17.886 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.886 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.886 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:17.886 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616028+0000", 2024-04-18T21:06:17.886 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8952999999999999e-05 2024-04-18T21:06:17.886 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.886 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.886 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.886 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616052+0000", 2024-04-18T21:06:17.886 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.3941999999999999e-05 2024-04-18T21:06:17.886 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.887 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.887 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:17.887 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618010+0000", 2024-04-18T21:06:17.887 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0019581780000000001 2024-04-18T21:06:17.887 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.887 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.887 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:17.887 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618322+0000", 2024-04-18T21:06:17.887 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00031158899999999997 2024-04-18T21:06:17.887 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.887 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.887 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:17.887 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618587+0000", 2024-04-18T21:06:17.887 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00026495700000000002 2024-04-18T21:06:17.887 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.887 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.888 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:17.888 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629262+0000", 2024-04-18T21:06:17.888 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010675877 2024-04-18T21:06:17.888 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.888 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.888 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:17.888 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.639773+0000", 2024-04-18T21:06:17.888 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0105109 2024-04-18T21:06:17.888 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.888 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.888 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:17.888 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.639926+0000", 2024-04-18T21:06:17.888 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000152349 2024-04-18T21:06:17.888 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.888 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.889 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:17.889 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640064+0000", 2024-04-18T21:06:17.889 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0001384 2024-04-18T21:06:17.889 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:17.889 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:17.889 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:17.889 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.889 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.889 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:17.889 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:17.889 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 72.227430209999994, 2024-04-18T21:06:17.889 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030215005999999999, 2024-04-18T21:06:17.889 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:17.889 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:17.889 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:17.889 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:17.890 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.890 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:17.890 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:17.890 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:17.890 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.890 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.890 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:17.890 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:17.890 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:17.890 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.890 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.890 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:17.890 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616095+0000", 2024-04-18T21:06:17.891 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.446e-06 2024-04-18T21:06:17.891 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.891 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.891 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:17.891 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616104+0000", 2024-04-18T21:06:17.891 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6200000000000005e-06 2024-04-18T21:06:17.891 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.891 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.891 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:17.891 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616132+0000", 2024-04-18T21:06:17.891 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7668999999999999e-05 2024-04-18T21:06:17.891 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.891 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.891 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.892 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616149+0000", 2024-04-18T21:06:17.892 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7047000000000001e-05 2024-04-18T21:06:17.892 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.892 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.892 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:17.892 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619287+0000", 2024-04-18T21:06:17.892 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0031381450000000002 2024-04-18T21:06:17.892 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.892 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.892 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:17.892 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619503+0000", 2024-04-18T21:06:17.892 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000216522 2024-04-18T21:06:17.892 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.892 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.893 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:17.893 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619930+0000", 2024-04-18T21:06:17.893 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00042604900000000001 2024-04-18T21:06:17.893 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.893 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.893 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:17.893 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629281+0000", 2024-04-18T21:06:17.893 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0093512230000000005 2024-04-18T21:06:17.893 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.893 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.893 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:17.893 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646022+0000", 2024-04-18T21:06:17.893 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016741156 2024-04-18T21:06:17.893 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.893 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.894 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:17.894 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646198+0000", 2024-04-18T21:06:17.894 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000176009 2024-04-18T21:06:17.894 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.894 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.894 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:17.894 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646309+0000", 2024-04-18T21:06:17.894 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011112000000000001 2024-04-18T21:06:17.894 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:17.894 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:17.894 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:17.894 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.894 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.895 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:17.895 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:17.895 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 72.227345385999996, 2024-04-18T21:06:17.895 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030501176000000001, 2024-04-18T21:06:17.895 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:17.895 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:17.895 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:17.895 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:17.895 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.895 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:17.895 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:17.895 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:17.895 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.895 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.895 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:17.896 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:17.896 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:17.896 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.896 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.896 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:17.896 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616180+0000", 2024-04-18T21:06:17.896 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1000000000000001e-06 2024-04-18T21:06:17.896 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.896 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.896 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:17.896 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616188+0000", 2024-04-18T21:06:17.896 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4069999999999993e-06 2024-04-18T21:06:17.896 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.896 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.896 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:17.897 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616207+0000", 2024-04-18T21:06:17.897 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8335999999999999e-05 2024-04-18T21:06:17.897 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.897 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.897 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.897 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616225+0000", 2024-04-18T21:06:17.897 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8652999999999999e-05 2024-04-18T21:06:17.897 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.897 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.897 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:17.897 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620977+0000", 2024-04-18T21:06:17.897 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047512220000000003 2024-04-18T21:06:17.897 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.897 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.897 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:17.898 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621279+0000", 2024-04-18T21:06:17.898 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000302646 2024-04-18T21:06:17.898 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.898 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.898 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:17.898 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621584+0000", 2024-04-18T21:06:17.898 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000305142 2024-04-18T21:06:17.898 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.898 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.898 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:17.898 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629352+0000", 2024-04-18T21:06:17.898 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0077673689999999997 2024-04-18T21:06:17.898 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.898 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.898 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:17.899 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646480+0000", 2024-04-18T21:06:17.899 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017128259 2024-04-18T21:06:17.899 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.899 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.899 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:17.899 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646591+0000", 2024-04-18T21:06:17.899 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011113899999999999 2024-04-18T21:06:17.899 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.899 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.899 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:17.899 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646680+0000", 2024-04-18T21:06:17.899 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8902999999999999e-05 2024-04-18T21:06:17.899 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:17.899 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:17.899 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:17.899 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.900 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.900 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:17.900 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:17.900 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 72.227278886999997, 2024-04-18T21:06:17.900 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030779760999999999, 2024-04-18T21:06:17.900 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:17.900 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:17.900 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:17.900 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:17.900 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.900 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:17.900 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:17.900 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:17.901 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.901 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.901 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:17.901 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:17.901 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:17.901 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.901 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.901 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:17.901 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616246+0000", 2024-04-18T21:06:17.901 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0499999999999999e-06 2024-04-18T21:06:17.901 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.901 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.901 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:17.901 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616253+0000", 2024-04-18T21:06:17.901 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.5989999999999998e-06 2024-04-18T21:06:17.901 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.901 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.902 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:17.902 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616273+0000", 2024-04-18T21:06:17.902 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9916999999999999e-05 2024-04-18T21:06:17.902 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.902 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.902 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.902 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616287+0000", 2024-04-18T21:06:17.902 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3669000000000001e-05 2024-04-18T21:06:17.902 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.902 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.902 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:17.902 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622203+0000", 2024-04-18T21:06:17.902 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.005916737 2024-04-18T21:06:17.903 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.903 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.903 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:17.903 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622379+0000", 2024-04-18T21:06:17.903 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000175596 2024-04-18T21:06:17.903 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.903 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.903 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:17.903 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622707+0000", 2024-04-18T21:06:17.903 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00032784600000000002 2024-04-18T21:06:17.903 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.903 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.903 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:17.903 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629366+0000", 2024-04-18T21:06:17.903 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0066593279999999999 2024-04-18T21:06:17.903 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.904 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.904 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:17.904 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646813+0000", 2024-04-18T21:06:17.904 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017447059000000001 2024-04-18T21:06:17.904 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.904 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.904 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:17.904 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646946+0000", 2024-04-18T21:06:17.904 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013301200000000001 2024-04-18T21:06:17.904 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.904 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.904 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:17.904 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647025+0000", 2024-04-18T21:06:17.904 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8948000000000004e-05 2024-04-18T21:06:17.904 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:17.904 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:17.905 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:17.905 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.905 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.905 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:17.905 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:17.905 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 72.227195069000004, 2024-04-18T21:06:17.905 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.031512165000000002, 2024-04-18T21:06:17.905 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:17.905 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:17.905 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:17.905 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:17.905 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.905 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:17.905 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:17.905 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:17.905 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.906 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.906 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:17.906 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:17.906 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:17.906 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.906 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.906 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:17.906 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616330+0000", 2024-04-18T21:06:17.906 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.15e-06 2024-04-18T21:06:17.906 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.906 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.906 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:17.906 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616337+0000", 2024-04-18T21:06:17.906 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.1289999999999998e-06 2024-04-18T21:06:17.906 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.907 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.907 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:17.907 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616447+0000", 2024-04-18T21:06:17.907 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109561 2024-04-18T21:06:17.907 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.907 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.907 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.907 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616496+0000", 2024-04-18T21:06:17.907 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8591999999999998e-05 2024-04-18T21:06:17.907 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.907 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.907 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:17.907 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.623786+0000", 2024-04-18T21:06:17.907 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0072906799999999999 2024-04-18T21:06:17.907 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.907 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.908 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:17.908 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.623973+0000", 2024-04-18T21:06:17.908 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018717199999999999 2024-04-18T21:06:17.908 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.908 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.908 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:17.908 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624260+0000", 2024-04-18T21:06:17.908 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00028630600000000001 2024-04-18T21:06:17.908 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.908 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.908 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:17.908 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629381+0000", 2024-04-18T21:06:17.908 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0051211340000000003 2024-04-18T21:06:17.908 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.908 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.908 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:17.909 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647631+0000", 2024-04-18T21:06:17.909 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018249771000000001 2024-04-18T21:06:17.909 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.909 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.909 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:17.909 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647761+0000", 2024-04-18T21:06:17.909 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013037300000000001 2024-04-18T21:06:17.909 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.909 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.909 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:17.909 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647841+0000", 2024-04-18T21:06:17.909 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.0296999999999994e-05 2024-04-18T21:06:17.909 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:17.909 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:17.909 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:17.910 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.910 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.910 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:17.910 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:17.910 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 72.226989584999998, 2024-04-18T21:06:17.910 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043251955000000002, 2024-04-18T21:06:17.910 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:17.910 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:17.910 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:17.910 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:17.910 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.910 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:17.910 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:17.910 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:17.910 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.910 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.911 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:17.911 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:17.911 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:17.911 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.911 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.911 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:17.911 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616536+0000", 2024-04-18T21:06:17.911 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2869999999999999e-06 2024-04-18T21:06:17.911 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.911 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.911 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:17.911 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616572+0000", 2024-04-18T21:06:17.911 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.6261999999999999e-05 2024-04-18T21:06:17.911 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.911 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.912 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:17.912 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616593+0000", 2024-04-18T21:06:17.912 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1310000000000001e-05 2024-04-18T21:06:17.912 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.912 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.912 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.912 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616614+0000", 2024-04-18T21:06:17.912 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.0936000000000001e-05 2024-04-18T21:06:17.912 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.912 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.912 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:17.912 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629501+0000", 2024-04-18T21:06:17.912 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.012886819000000001 2024-04-18T21:06:17.912 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.913 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.913 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:17.913 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629696+0000", 2024-04-18T21:06:17.913 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019485499999999999 2024-04-18T21:06:17.913 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.913 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.913 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:17.913 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629940+0000", 2024-04-18T21:06:17.913 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00024386399999999999 2024-04-18T21:06:17.913 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.913 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.913 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:17.913 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640100+0000", 2024-04-18T21:06:17.913 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010159645 2024-04-18T21:06:17.913 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.913 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.914 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:17.914 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659516+0000", 2024-04-18T21:06:17.914 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019416563000000001 2024-04-18T21:06:17.914 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.914 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.914 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:17.914 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659684+0000", 2024-04-18T21:06:17.914 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016750900000000001 2024-04-18T21:06:17.914 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.914 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.914 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:17.914 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659787+0000", 2024-04-18T21:06:17.914 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000102905 2024-04-18T21:06:17.914 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:17.914 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:17.914 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:17.915 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.915 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.915 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:17.915 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:17.915 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 72.226884463000005, 2024-04-18T21:06:17.915 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043581898000000001, 2024-04-18T21:06:17.915 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:17.915 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:17.915 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:17.915 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:17.915 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.915 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:17.915 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:17.915 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:17.915 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.916 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.916 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:17.916 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:17.916 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:17.916 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.916 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.916 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:17.916 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616641+0000", 2024-04-18T21:06:17.916 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:06:17.916 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.916 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.916 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:17.916 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616648+0000", 2024-04-18T21:06:17.916 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3860000000000001e-06 2024-04-18T21:06:17.916 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.917 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.917 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:17.917 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616666+0000", 2024-04-18T21:06:17.917 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7583000000000001e-05 2024-04-18T21:06:17.917 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.917 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.917 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.917 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616679+0000", 2024-04-18T21:06:17.917 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3322999999999999e-05 2024-04-18T21:06:17.917 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.917 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.917 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:17.917 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630373+0000", 2024-04-18T21:06:17.917 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013694207999999999 2024-04-18T21:06:17.917 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.917 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.918 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:17.918 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630545+0000", 2024-04-18T21:06:17.918 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000171683 2024-04-18T21:06:17.918 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.918 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.918 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:17.918 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630728+0000", 2024-04-18T21:06:17.918 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000182599 2024-04-18T21:06:17.918 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.918 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.918 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:17.918 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640600+0000", 2024-04-18T21:06:17.918 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0098726119999999994 2024-04-18T21:06:17.918 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.919 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.919 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:17.919 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659927+0000", 2024-04-18T21:06:17.919 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019326724999999999 2024-04-18T21:06:17.919 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.919 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.919 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:17.919 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660112+0000", 2024-04-18T21:06:17.919 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000185203 2024-04-18T21:06:17.919 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.919 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.919 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:17.919 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660222+0000", 2024-04-18T21:06:17.919 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109343 2024-04-18T21:06:17.920 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:17.920 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:17.920 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:17.920 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.920 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.920 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:17.920 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:17.920 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 72.226019105000006, 2024-04-18T21:06:17.920 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043121310000000003, 2024-04-18T21:06:17.920 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:17.920 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:17.920 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:17.920 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:17.920 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.920 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:17.920 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:17.921 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:17.921 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.921 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.921 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:17.921 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:17.921 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:17.921 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.921 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.921 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:17.921 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617506+0000", 2024-04-18T21:06:17.921 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9999999999999995e-07 2024-04-18T21:06:17.921 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.921 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.921 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:17.921 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617513+0000", 2024-04-18T21:06:17.921 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.9700000000000002e-06 2024-04-18T21:06:17.922 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.922 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.922 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:17.922 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617531+0000", 2024-04-18T21:06:17.922 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8105999999999999e-05 2024-04-18T21:06:17.922 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.922 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.922 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.922 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617545+0000", 2024-04-18T21:06:17.922 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3703000000000001e-05 2024-04-18T21:06:17.922 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.922 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.922 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:17.922 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632129+0000", 2024-04-18T21:06:17.923 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.014584135999999999 2024-04-18T21:06:17.923 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.923 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.923 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:17.923 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632361+0000", 2024-04-18T21:06:17.923 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023171800000000001 2024-04-18T21:06:17.923 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.923 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.923 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:17.923 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632804+0000", 2024-04-18T21:06:17.923 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000443549 2024-04-18T21:06:17.923 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.923 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.923 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:17.923 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646340+0000", 2024-04-18T21:06:17.924 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013535902000000001 2024-04-18T21:06:17.924 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.924 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.924 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:17.924 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660363+0000", 2024-04-18T21:06:17.924 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01402318 2024-04-18T21:06:17.924 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.924 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.924 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:17.924 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660523+0000", 2024-04-18T21:06:17.924 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00015989899999999999 2024-04-18T21:06:17.924 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.924 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.924 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:17.925 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660626+0000", 2024-04-18T21:06:17.925 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010314699999999999 2024-04-18T21:06:17.925 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:17.925 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:17.925 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:17.925 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.925 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.925 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:17.925 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:17.925 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 72.225879411999998, 2024-04-18T21:06:17.925 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024927483, 2024-04-18T21:06:17.925 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:17.925 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:17.926 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:17.926 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:17.926 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.926 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:17.926 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:17.926 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:17.926 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.926 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.926 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:17.926 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:17.926 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:17.926 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.926 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.926 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:17.926 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617646+0000", 2024-04-18T21:06:17.926 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3030000000000001e-06 2024-04-18T21:06:17.927 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.927 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.927 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:17.927 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617653+0000", 2024-04-18T21:06:17.927 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7530000000000004e-06 2024-04-18T21:06:17.927 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.927 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.927 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:17.927 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617673+0000", 2024-04-18T21:06:17.927 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9967e-05 2024-04-18T21:06:17.927 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.927 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.927 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.927 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617688+0000", 2024-04-18T21:06:17.927 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5153e-05 2024-04-18T21:06:17.928 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.928 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.928 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:17.928 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619244+0000", 2024-04-18T21:06:17.928 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001555531 2024-04-18T21:06:17.928 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.928 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.928 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:17.928 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619361+0000", 2024-04-18T21:06:17.928 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011784400000000001 2024-04-18T21:06:17.928 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.928 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.928 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:17.928 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619604+0000", 2024-04-18T21:06:17.928 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000243007 2024-04-18T21:06:17.928 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.929 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.929 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:17.929 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.625480+0000", 2024-04-18T21:06:17.929 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0058759349999999997 2024-04-18T21:06:17.929 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.929 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.929 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:17.929 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642342+0000", 2024-04-18T21:06:17.929 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016861373999999998 2024-04-18T21:06:17.929 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.929 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.929 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:17.929 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642484+0000", 2024-04-18T21:06:17.929 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000142423 2024-04-18T21:06:17.929 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.929 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.930 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:17.930 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642572+0000", 2024-04-18T21:06:17.930 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8193000000000001e-05 2024-04-18T21:06:17.930 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:17.930 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:17.930 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:17.930 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.930 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.930 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:17.930 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:17.930 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 72.225597909000001, 2024-04-18T21:06:17.930 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024956974999999999, 2024-04-18T21:06:17.930 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:17.930 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:17.931 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:17.931 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:17.931 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.931 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:17.931 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:17.931 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:17.931 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.931 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.931 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:17.931 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:17.931 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:17.931 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.931 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.931 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:17.931 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617928+0000", 2024-04-18T21:06:17.932 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5430000000000001e-06 2024-04-18T21:06:17.932 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.932 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.932 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:17.932 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617937+0000", 2024-04-18T21:06:17.932 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6629999999999999e-06 2024-04-18T21:06:17.932 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.932 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.932 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:17.932 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617955+0000", 2024-04-18T21:06:17.932 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8749999999999998e-05 2024-04-18T21:06:17.932 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.932 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.932 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.932 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617971+0000", 2024-04-18T21:06:17.933 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.605e-05 2024-04-18T21:06:17.933 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.933 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.933 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:17.933 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621019+0000", 2024-04-18T21:06:17.933 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0030472369999999999 2024-04-18T21:06:17.933 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.933 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.933 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:17.933 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621249+0000", 2024-04-18T21:06:17.933 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000230075 2024-04-18T21:06:17.933 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.933 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.933 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:17.934 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621450+0000", 2024-04-18T21:06:17.934 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020166499999999999 2024-04-18T21:06:17.934 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.934 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.934 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:17.934 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.626233+0000", 2024-04-18T21:06:17.934 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047827390000000003 2024-04-18T21:06:17.934 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.934 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.934 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:17.934 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642693+0000", 2024-04-18T21:06:17.934 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01645961 2024-04-18T21:06:17.934 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.935 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.935 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:17.935 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642798+0000", 2024-04-18T21:06:17.935 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010559499999999999 2024-04-18T21:06:17.935 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.935 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.935 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:17.935 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642883+0000", 2024-04-18T21:06:17.935 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5048000000000003e-05 2024-04-18T21:06:17.935 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:17.935 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:17.935 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:17.935 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.935 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.935 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:17.936 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:17.936 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 72.223902280999994, 2024-04-18T21:06:17.936 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024086478000000001, 2024-04-18T21:06:17.936 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:17.936 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:17.936 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:17.936 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:17.936 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.936 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:17.936 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:17.936 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:17.936 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.936 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.936 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:17.936 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:17.937 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:17.937 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.937 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.937 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:17.937 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619624+0000", 2024-04-18T21:06:17.937 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.75e-06 2024-04-18T21:06:17.937 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.937 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.937 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:17.937 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619637+0000", 2024-04-18T21:06:17.937 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3540000000000001e-05 2024-04-18T21:06:17.937 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.937 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.937 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:17.938 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619666+0000", 2024-04-18T21:06:17.938 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8685999999999999e-05 2024-04-18T21:06:17.938 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.938 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.938 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.938 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619685+0000", 2024-04-18T21:06:17.938 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8681999999999998e-05 2024-04-18T21:06:17.938 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.938 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.938 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:17.938 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622275+0000", 2024-04-18T21:06:17.938 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0025899260000000002 2024-04-18T21:06:17.938 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.938 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.939 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:17.939 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622572+0000", 2024-04-18T21:06:17.939 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00029722 2024-04-18T21:06:17.939 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.939 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.939 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:17.939 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622752+0000", 2024-04-18T21:06:17.939 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018065900000000001 2024-04-18T21:06:17.939 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.939 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.939 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:17.939 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.626326+0000", 2024-04-18T21:06:17.939 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035737310000000001 2024-04-18T21:06:17.939 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.939 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.939 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:17.940 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643565+0000", 2024-04-18T21:06:17.940 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017238430999999999 2024-04-18T21:06:17.940 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.940 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.940 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:17.940 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643646+0000", 2024-04-18T21:06:17.940 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.1481000000000001e-05 2024-04-18T21:06:17.940 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.940 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.940 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:17.940 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643708+0000", 2024-04-18T21:06:17.940 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.2372000000000005e-05 2024-04-18T21:06:17.940 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:17.940 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:17.940 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:17.940 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.941 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.941 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:17.941 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:17.941 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 72.223736127999999, 2024-04-18T21:06:17.941 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026822450000000001, 2024-04-18T21:06:17.941 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:17.941 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:17.941 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:17.941 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:17.941 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.941 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:17.941 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:17.941 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:17.941 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.941 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.942 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:17.942 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:17.942 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:17.942 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.942 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.942 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:17.942 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619789+0000", 2024-04-18T21:06:17.942 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:06:17.942 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.942 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.942 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:17.942 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619797+0000", 2024-04-18T21:06:17.942 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.6899999999999992e-06 2024-04-18T21:06:17.943 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.943 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.943 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:17.943 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619816+0000", 2024-04-18T21:06:17.943 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9352999999999999e-05 2024-04-18T21:06:17.943 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.943 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.943 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.943 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619832+0000", 2024-04-18T21:06:17.943 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6013000000000001e-05 2024-04-18T21:06:17.943 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.943 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.943 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:17.943 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620528+0000", 2024-04-18T21:06:17.943 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00069565600000000001 2024-04-18T21:06:17.944 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.944 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.944 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:17.944 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620735+0000", 2024-04-18T21:06:17.944 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000207025 2024-04-18T21:06:17.944 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.944 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.944 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:17.944 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620912+0000", 2024-04-18T21:06:17.944 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017748199999999999 2024-04-18T21:06:17.944 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.944 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.944 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:17.944 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.625605+0000", 2024-04-18T21:06:17.945 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0046924439999999996 2024-04-18T21:06:17.945 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.945 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.945 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:17.945 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646349+0000", 2024-04-18T21:06:17.945 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.020744318000000001 2024-04-18T21:06:17.945 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.945 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.945 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:17.945 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646483+0000", 2024-04-18T21:06:17.945 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013428999999999999 2024-04-18T21:06:17.945 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.945 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.945 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:17.945 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646611+0000", 2024-04-18T21:06:17.946 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012710299999999999 2024-04-18T21:06:17.946 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:17.946 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:17.946 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:17.946 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.946 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.946 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:17.946 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:06:17.946 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 72.223065695000003, 2024-04-18T21:06:17.946 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023516516000000001, 2024-04-18T21:06:17.946 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:17.946 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:17.946 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:06:17.946 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:17.947 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.947 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:17.947 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:06:17.947 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:17.947 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.947 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.947 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:17.947 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:06:17.947 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:17.947 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.947 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.947 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:17.947 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620460+0000", 2024-04-18T21:06:17.947 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.787e-06 2024-04-18T21:06:17.948 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.948 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.948 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:17.948 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620470+0000", 2024-04-18T21:06:17.948 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.2560000000000008e-06 2024-04-18T21:06:17.948 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.948 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.948 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:17.948 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620496+0000", 2024-04-18T21:06:17.948 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.6205999999999999e-05 2024-04-18T21:06:17.948 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.948 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.948 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:17.948 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620517+0000", 2024-04-18T21:06:17.948 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1223e-05 2024-04-18T21:06:17.949 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.949 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.949 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:17.949 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624060+0000", 2024-04-18T21:06:17.949 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035434160000000002 2024-04-18T21:06:17.949 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.949 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.949 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:17.949 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624390+0000", 2024-04-18T21:06:17.949 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00033000500000000002 2024-04-18T21:06:17.949 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:17.949 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:17.949 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:17.949 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643975+0000", 2024-04-18T21:06:17.949 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019584622999999999 2024-04-18T21:06:17.950 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:17.950 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:17.950 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:17.950 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:17.950 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:17.950 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:17.951 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:17.952 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:17.950+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:18.053 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:18.050+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:18.082 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:06:18.083 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [], 2024-04-18T21:06:18.083 INFO:teuthology.orchestra.run.smithi150.stdout: "num_ops": 0 2024-04-18T21:06:18.083 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:06:18.098 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:18.153 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:18.155+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:18.218 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:06:18.218 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [], 2024-04-18T21:06:18.218 INFO:teuthology.orchestra.run.smithi150.stdout: "complaint_time": 30, 2024-04-18T21:06:18.218 INFO:teuthology.orchestra.run.smithi150.stdout: "num_blocked_ops": 0 2024-04-18T21:06:18.219 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:06:18.234 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:18.254 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:18.254+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:18.277 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-18T21:06:18.277 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-18T21:06:18.277 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:06:18.355 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:18.354+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:18.404 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:06:18.404 INFO:teuthology.orchestra.run.smithi150.stdout: "size": 20, 2024-04-18T21:06:18.404 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 600, 2024-04-18T21:06:18.404 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [ 2024-04-18T21:06:18.404 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.404 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-18T21:06:18.404 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:06:18.404 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 83.599147779999996, 2024-04-18T21:06:18.404 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0093051590000000003, 2024-04-18T21:06:18.404 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:18.404 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:18.404 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:18.405 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:18.405 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.405 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:18.405 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:06:18.405 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:18.405 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.405 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.405 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:18.405 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:06:18.405 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:18.405 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.405 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.405 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:18.405 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804851+0000", 2024-04-18T21:06:18.405 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7039999999999999e-06 2024-04-18T21:06:18.405 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.406 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.406 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:18.406 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804864+0000", 2024-04-18T21:06:18.406 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.276e-05 2024-04-18T21:06:18.406 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.406 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.406 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:18.406 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804895+0000", 2024-04-18T21:06:18.406 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.1204999999999997e-05 2024-04-18T21:06:18.406 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.406 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.406 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:18.406 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804908+0000", 2024-04-18T21:06:18.406 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3317e-05 2024-04-18T21:06:18.407 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.407 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.407 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:18.407 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805131+0000", 2024-04-18T21:06:18.407 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00022246700000000001 2024-04-18T21:06:18.407 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.407 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.407 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:18.407 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805171+0000", 2024-04-18T21:06:18.407 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.0164999999999999e-05 2024-04-18T21:06:18.407 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.407 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.407 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:18.407 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814086+0000", 2024-04-18T21:06:18.407 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0089155329999999998 2024-04-18T21:06:18.407 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.408 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.408 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:18.408 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814154+0000", 2024-04-18T21:06:18.408 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.8008000000000003e-05 2024-04-18T21:06:18.408 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:18.408 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:18.408 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:18.408 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.408 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.408 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-18T21:06:18.408 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:06:18.408 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 83.598382587000003, 2024-04-18T21:06:18.408 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0086469770000000001, 2024-04-18T21:06:18.408 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:18.408 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:18.408 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:18.409 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:18.409 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.409 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:18.409 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:06:18.409 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:18.409 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.409 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.409 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:18.409 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:06:18.409 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:18.409 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.409 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.409 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:18.409 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805616+0000", 2024-04-18T21:06:18.409 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7799999999999999e-06 2024-04-18T21:06:18.409 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.409 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.410 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:18.410 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805707+0000", 2024-04-18T21:06:18.410 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0917999999999999e-05 2024-04-18T21:06:18.410 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.410 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.410 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:18.410 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805739+0000", 2024-04-18T21:06:18.410 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.2512000000000003e-05 2024-04-18T21:06:18.410 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.410 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.410 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:18.410 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805763+0000", 2024-04-18T21:06:18.410 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3266000000000001e-05 2024-04-18T21:06:18.410 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.410 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.411 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:18.411 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.806024+0000", 2024-04-18T21:06:18.411 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000261716 2024-04-18T21:06:18.411 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.411 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.411 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:18.411 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.806073+0000", 2024-04-18T21:06:18.411 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.8844999999999997e-05 2024-04-18T21:06:18.411 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.411 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.411 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:18.411 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814162+0000", 2024-04-18T21:06:18.411 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0080882860000000001 2024-04-18T21:06:18.411 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.411 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.411 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:18.412 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814261+0000", 2024-04-18T21:06:18.412 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.9654000000000005e-05 2024-04-18T21:06:18.412 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:18.412 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:18.412 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:18.412 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.412 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.412 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'64)", 2024-04-18T21:06:18.412 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:06:18.412 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 83.596611542999995, 2024-04-18T21:06:18.412 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0089721509999999994, 2024-04-18T21:06:18.412 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:18.412 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:18.412 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:18.412 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:18.412 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.412 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:18.413 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:06:18.413 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:18.413 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.413 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.413 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:18.413 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:06:18.413 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:18.413 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.413 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.413 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:18.413 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807387+0000", 2024-04-18T21:06:18.413 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.0329999999999998e-06 2024-04-18T21:06:18.413 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.413 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.413 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:18.413 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807443+0000", 2024-04-18T21:06:18.414 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.5376e-05 2024-04-18T21:06:18.414 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.414 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.414 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:18.414 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807467+0000", 2024-04-18T21:06:18.414 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.4621999999999999e-05 2024-04-18T21:06:18.414 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.414 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.414 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:18.414 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807482+0000", 2024-04-18T21:06:18.414 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.436e-05 2024-04-18T21:06:18.414 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.414 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.414 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:18.415 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.809243+0000", 2024-04-18T21:06:18.415 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001761725 2024-04-18T21:06:18.415 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.415 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.415 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:18.415 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.809295+0000", 2024-04-18T21:06:18.415 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.1445e-05 2024-04-18T21:06:18.415 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.415 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.415 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:18.415 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.816293+0000", 2024-04-18T21:06:18.415 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0069981749999999997 2024-04-18T21:06:18.415 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.415 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.415 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:18.415 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.816357+0000", 2024-04-18T21:06:18.415 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.4414999999999999e-05 2024-04-18T21:06:18.416 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:18.416 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:18.416 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:18.416 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.416 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.416 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:18.416 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:06:18.416 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 72.788702173000004, 2024-04-18T21:06:18.416 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.040843365, 2024-04-18T21:06:18.416 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:18.416 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:18.416 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:18.416 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:18.416 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.416 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:18.416 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:06:18.417 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:18.417 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.417 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.417 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:18.417 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:06:18.417 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:18.417 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.417 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.417 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:18.417 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615297+0000", 2024-04-18T21:06:18.417 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2800000000000002e-06 2024-04-18T21:06:18.417 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.417 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.418 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:18.418 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615308+0000", 2024-04-18T21:06:18.418 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0813e-05 2024-04-18T21:06:18.418 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.418 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.418 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:18.418 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615330+0000", 2024-04-18T21:06:18.418 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2370000000000001e-05 2024-04-18T21:06:18.418 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.418 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.418 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:18.418 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615346+0000", 2024-04-18T21:06:18.418 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6200000000000001e-05 2024-04-18T21:06:18.418 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.418 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.419 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:18.419 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615470+0000", 2024-04-18T21:06:18.419 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012385799999999999 2024-04-18T21:06:18.419 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.419 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.419 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:18.419 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615488+0000", 2024-04-18T21:06:18.419 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7923000000000001e-05 2024-04-18T21:06:18.419 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.419 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.419 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:18.419 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.630993+0000", 2024-04-18T21:06:18.419 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.01550532 2024-04-18T21:06:18.419 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.420 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.420 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:18.420 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631165+0000", 2024-04-18T21:06:18.420 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000171588 2024-04-18T21:06:18.420 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.420 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.420 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:18.420 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631320+0000", 2024-04-18T21:06:18.420 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000155162 2024-04-18T21:06:18.420 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.420 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.420 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:18.420 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635157+0000", 2024-04-18T21:06:18.420 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0038370790000000002 2024-04-18T21:06:18.420 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.421 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.421 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:18.421 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.655904+0000", 2024-04-18T21:06:18.421 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.020746483999999999 2024-04-18T21:06:18.421 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.421 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.421 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:18.421 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656032+0000", 2024-04-18T21:06:18.421 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012864199999999999 2024-04-18T21:06:18.421 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.421 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.421 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:18.422 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656138+0000", 2024-04-18T21:06:18.422 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000105646 2024-04-18T21:06:18.422 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:18.422 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:18.422 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:18.422 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.422 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.422 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:18.422 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:06:18.422 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 72.788610000999995, 2024-04-18T21:06:18.422 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.041266444999999999, 2024-04-18T21:06:18.422 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:18.422 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:18.422 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:18.423 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:18.423 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.423 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:18.423 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:06:18.423 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:18.423 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.423 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.423 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:18.423 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:06:18.423 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:18.423 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.423 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.423 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:18.423 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615388+0000", 2024-04-18T21:06:18.424 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:06:18.424 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.424 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.424 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:18.424 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:06:18.424 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.7299999999999994e-06 2024-04-18T21:06:18.424 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.424 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.424 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:18.424 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615415+0000", 2024-04-18T21:06:18.424 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7807000000000001e-05 2024-04-18T21:06:18.424 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.424 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.424 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:18.424 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615431+0000", 2024-04-18T21:06:18.424 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6127e-05 2024-04-18T21:06:18.425 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.425 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.425 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:18.425 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615621+0000", 2024-04-18T21:06:18.425 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000189781 2024-04-18T21:06:18.425 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.425 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.425 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:18.425 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615634+0000", 2024-04-18T21:06:18.425 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3383e-05 2024-04-18T21:06:18.425 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.425 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.425 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:18.425 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631703+0000", 2024-04-18T21:06:18.425 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016068737 2024-04-18T21:06:18.426 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.426 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.426 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:18.426 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631809+0000", 2024-04-18T21:06:18.426 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000106823 2024-04-18T21:06:18.426 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.426 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.426 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:18.426 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631988+0000", 2024-04-18T21:06:18.426 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000179008 2024-04-18T21:06:18.426 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.426 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.426 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:18.427 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635172+0000", 2024-04-18T21:06:18.427 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.003183029 2024-04-18T21:06:18.427 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.427 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.427 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:18.427 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656392+0000", 2024-04-18T21:06:18.427 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.021220638999999999 2024-04-18T21:06:18.427 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.427 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.427 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:18.427 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656533+0000", 2024-04-18T21:06:18.427 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014126500000000001 2024-04-18T21:06:18.427 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.427 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.427 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:18.427 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656653+0000", 2024-04-18T21:06:18.428 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000119883 2024-04-18T21:06:18.428 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:18.428 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:18.428 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:18.428 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.428 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.428 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:18.428 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:06:18.428 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 72.788522577999998, 2024-04-18T21:06:18.428 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.042492302000000003, 2024-04-18T21:06:18.428 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:18.428 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:18.428 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:18.428 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:18.428 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.429 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:18.429 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:06:18.429 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:18.429 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.429 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.429 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:18.429 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:06:18.429 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:18.429 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.429 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.429 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:18.429 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615475+0000", 2024-04-18T21:06:18.429 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.17e-06 2024-04-18T21:06:18.429 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.429 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.430 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:18.430 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615528+0000", 2024-04-18T21:06:18.430 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.2159e-05 2024-04-18T21:06:18.430 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.430 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.430 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:18.430 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615542+0000", 2024-04-18T21:06:18.430 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4197e-05 2024-04-18T21:06:18.430 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.430 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.430 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:18.430 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615559+0000", 2024-04-18T21:06:18.430 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.749e-05 2024-04-18T21:06:18.430 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.431 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.431 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:18.431 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615685+0000", 2024-04-18T21:06:18.431 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012617499999999999 2024-04-18T21:06:18.431 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.431 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.431 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:18.431 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:06:18.431 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4749999999999999e-05 2024-04-18T21:06:18.431 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.431 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.431 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:18.431 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632332+0000", 2024-04-18T21:06:18.431 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016631988 2024-04-18T21:06:18.431 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.431 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.432 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:18.432 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632477+0000", 2024-04-18T21:06:18.432 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014437200000000001 2024-04-18T21:06:18.432 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.432 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.432 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:18.432 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632620+0000", 2024-04-18T21:06:18.432 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000143566 2024-04-18T21:06:18.432 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.432 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.432 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:18.432 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635185+0000", 2024-04-18T21:06:18.432 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0025644209999999999 2024-04-18T21:06:18.432 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.433 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.433 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:18.433 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657803+0000", 2024-04-18T21:06:18.433 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.022618743 2024-04-18T21:06:18.433 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.433 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.433 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:18.433 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657890+0000", 2024-04-18T21:06:18.433 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.6688999999999996e-05 2024-04-18T21:06:18.433 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.433 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.433 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:18.433 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657967+0000", 2024-04-18T21:06:18.433 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.6582000000000006e-05 2024-04-18T21:06:18.433 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:18.434 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:18.434 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:18.434 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.434 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.434 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:18.434 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:06:18.434 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 72.788391766000004, 2024-04-18T21:06:18.434 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.043603435000000003, 2024-04-18T21:06:18.434 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:18.434 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:18.434 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:18.434 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:18.434 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.434 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:18.435 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:06:18.435 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:18.435 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.435 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.435 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:18.435 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:06:18.435 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:18.435 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.435 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.435 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:18.435 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615607+0000", 2024-04-18T21:06:18.435 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4300000000000001e-06 2024-04-18T21:06:18.435 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.435 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.435 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:18.435 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615614+0000", 2024-04-18T21:06:18.436 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.4100000000000002e-06 2024-04-18T21:06:18.436 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.436 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.436 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:18.436 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615632+0000", 2024-04-18T21:06:18.436 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7863000000000002e-05 2024-04-18T21:06:18.436 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.436 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.436 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:18.436 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615647+0000", 2024-04-18T21:06:18.436 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5187e-05 2024-04-18T21:06:18.436 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.436 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.436 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:18.436 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615765+0000", 2024-04-18T21:06:18.436 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000117955 2024-04-18T21:06:18.437 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.437 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.437 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:18.437 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615781+0000", 2024-04-18T21:06:18.437 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6123000000000001e-05 2024-04-18T21:06:18.437 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.437 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.437 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:18.437 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633055+0000", 2024-04-18T21:06:18.437 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.017273909 2024-04-18T21:06:18.437 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.437 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.437 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:18.437 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633254+0000", 2024-04-18T21:06:18.437 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00019903799999999999 2024-04-18T21:06:18.438 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.438 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.438 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:18.438 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633624+0000", 2024-04-18T21:06:18.438 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000369656 2024-04-18T21:06:18.438 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.438 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.438 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:18.438 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635595+0000", 2024-04-18T21:06:18.438 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001971287 2024-04-18T21:06:18.438 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.438 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.438 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:18.438 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659026+0000", 2024-04-18T21:06:18.438 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.023431495 2024-04-18T21:06:18.439 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.439 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.439 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:18.439 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659117+0000", 2024-04-18T21:06:18.439 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0885999999999997e-05 2024-04-18T21:06:18.439 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.439 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.439 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:18.439 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659209+0000", 2024-04-18T21:06:18.439 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.1195999999999999e-05 2024-04-18T21:06:18.439 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:18.439 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:18.439 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:18.439 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.439 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.440 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:18.440 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:18.440 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 72.788326537000003, 2024-04-18T21:06:18.440 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.03492514, 2024-04-18T21:06:18.440 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:18.440 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:18.440 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:18.440 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:18.440 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.440 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:18.440 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:18.440 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:18.440 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.440 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.440 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:18.441 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:18.441 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:18.441 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.441 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.441 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:18.441 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:06:18.441 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.407e-06 2024-04-18T21:06:18.441 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.441 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.441 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:18.441 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615679+0000", 2024-04-18T21:06:18.441 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.2130000000000002e-06 2024-04-18T21:06:18.441 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.441 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.441 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:18.441 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615701+0000", 2024-04-18T21:06:18.441 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2316000000000001e-05 2024-04-18T21:06:18.442 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.442 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.442 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:18.442 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615717+0000", 2024-04-18T21:06:18.442 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6197000000000001e-05 2024-04-18T21:06:18.442 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.442 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.442 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:18.442 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615828+0000", 2024-04-18T21:06:18.442 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000110899 2024-04-18T21:06:18.442 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.442 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.442 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:18.443 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615840+0000", 2024-04-18T21:06:18.443 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.1423000000000001e-05 2024-04-18T21:06:18.443 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.443 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.443 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:18.443 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628046+0000", 2024-04-18T21:06:18.443 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.012206295000000001 2024-04-18T21:06:18.443 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.443 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.443 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:18.443 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628323+0000", 2024-04-18T21:06:18.443 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00027658700000000001 2024-04-18T21:06:18.443 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.443 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.443 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:18.444 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628599+0000", 2024-04-18T21:06:18.444 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00027676699999999997 2024-04-18T21:06:18.444 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.444 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.444 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:18.444 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634869+0000", 2024-04-18T21:06:18.444 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.006269536 2024-04-18T21:06:18.444 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.444 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.444 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:18.444 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650333+0000", 2024-04-18T21:06:18.444 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.015463645999999999 2024-04-18T21:06:18.444 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.444 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.445 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:18.445 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650474+0000", 2024-04-18T21:06:18.445 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014091799999999999 2024-04-18T21:06:18.445 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.445 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.445 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:18.445 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650595+0000", 2024-04-18T21:06:18.445 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012193600000000001 2024-04-18T21:06:18.445 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:18.445 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:18.445 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:18.445 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.445 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.445 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:18.445 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:06:18.445 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 72.788241428000006, 2024-04-18T21:06:18.445 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.040588320999999997, 2024-04-18T21:06:18.446 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:18.446 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:18.446 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:18.446 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:18.446 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.446 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:18.446 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:06:18.446 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:18.446 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.446 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.446 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:18.446 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:06:18.446 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:18.447 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.447 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.447 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:18.447 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615757+0000", 2024-04-18T21:06:18.447 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2270000000000001e-06 2024-04-18T21:06:18.447 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.447 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.447 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:18.447 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615765+0000", 2024-04-18T21:06:18.447 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.9400000000000002e-06 2024-04-18T21:06:18.447 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.447 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.447 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:18.448 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615785+0000", 2024-04-18T21:06:18.448 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.0749000000000001e-05 2024-04-18T21:06:18.448 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.448 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.448 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:18.448 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615804+0000", 2024-04-18T21:06:18.448 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.8774e-05 2024-04-18T21:06:18.448 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.448 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.448 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:18.448 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615888+0000", 2024-04-18T21:06:18.448 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.4111999999999997e-05 2024-04-18T21:06:18.448 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.448 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.448 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:18.448 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615895+0000", 2024-04-18T21:06:18.449 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.0469999999999996e-06 2024-04-18T21:06:18.449 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.449 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.449 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:18.449 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629280+0000", 2024-04-18T21:06:18.449 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.013384416 2024-04-18T21:06:18.449 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.449 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.449 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:18.449 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629488+0000", 2024-04-18T21:06:18.449 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00020852800000000001 2024-04-18T21:06:18.449 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.449 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.450 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:18.450 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629869+0000", 2024-04-18T21:06:18.450 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00038042300000000001 2024-04-18T21:06:18.450 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.450 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.450 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:18.450 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635041+0000", 2024-04-18T21:06:18.450 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.005172383 2024-04-18T21:06:18.450 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.450 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.450 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:18.450 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656125+0000", 2024-04-18T21:06:18.450 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.021084025999999999 2024-04-18T21:06:18.450 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.451 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.451 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:18.451 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656240+0000", 2024-04-18T21:06:18.451 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000115352 2024-04-18T21:06:18.451 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.451 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.451 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:18.451 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656344+0000", 2024-04-18T21:06:18.451 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00010334400000000001 2024-04-18T21:06:18.451 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:18.451 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:18.451 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:18.451 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.451 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.451 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:18.451 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:18.451 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 72.788174108000007, 2024-04-18T21:06:18.452 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.043549577999999999, 2024-04-18T21:06:18.452 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:18.452 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:18.452 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:18.452 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:18.452 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.452 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:18.452 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:18.452 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:18.452 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.452 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.452 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:18.452 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:18.452 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:18.452 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.452 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.453 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:18.453 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:18.453 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.5000000000000002e-07 2024-04-18T21:06:18.453 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.453 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.453 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:18.453 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615828+0000", 2024-04-18T21:06:18.453 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.2359999999999998e-06 2024-04-18T21:06:18.453 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.453 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.453 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:18.453 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615838+0000", 2024-04-18T21:06:18.453 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0087e-05 2024-04-18T21:06:18.453 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.453 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.453 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:18.454 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615846+0000", 2024-04-18T21:06:18.454 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.67e-06 2024-04-18T21:06:18.454 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.454 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.454 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:18.454 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615963+0000", 2024-04-18T21:06:18.454 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00011630500000000001 2024-04-18T21:06:18.454 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.454 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.454 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:18.454 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615979+0000", 2024-04-18T21:06:18.454 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.613e-05 2024-04-18T21:06:18.454 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.454 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.454 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:18.454 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632392+0000", 2024-04-18T21:06:18.455 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016413317 2024-04-18T21:06:18.455 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.455 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.455 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:18.455 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632568+0000", 2024-04-18T21:06:18.455 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00017539500000000001 2024-04-18T21:06:18.455 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.455 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.455 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:18.455 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632748+0000", 2024-04-18T21:06:18.455 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00017991799999999999 2024-04-18T21:06:18.455 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.455 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.455 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:18.455 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635542+0000", 2024-04-18T21:06:18.455 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00279481 2024-04-18T21:06:18.456 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.456 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.456 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:18.456 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659232+0000", 2024-04-18T21:06:18.456 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.023689212000000001 2024-04-18T21:06:18.456 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.456 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.456 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:18.456 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659314+0000", 2024-04-18T21:06:18.456 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.2528999999999995e-05 2024-04-18T21:06:18.456 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.456 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.456 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:18.456 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659372+0000", 2024-04-18T21:06:18.456 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.8218999999999999e-05 2024-04-18T21:06:18.456 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:18.457 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:18.457 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:18.457 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.457 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.457 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:18.457 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:06:18.457 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 72.788112675999997, 2024-04-18T21:06:18.457 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.039335347, 2024-04-18T21:06:18.457 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:18.457 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:18.457 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "started", 2024-04-18T21:06:18.457 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:18.457 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.457 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:18.457 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:06:18.457 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:18.458 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.458 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.458 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:18.458 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:06:18.458 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:18.458 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.458 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.458 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:18.458 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615885+0000", 2024-04-18T21:06:18.458 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2699999999999999e-06 2024-04-18T21:06:18.458 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.458 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.458 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:18.458 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615892+0000", 2024-04-18T21:06:18.458 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.6499999999999999e-06 2024-04-18T21:06:18.458 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.459 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.459 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:18.459 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615906+0000", 2024-04-18T21:06:18.459 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.393e-05 2024-04-18T21:06:18.459 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.459 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.459 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:18.459 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615919+0000", 2024-04-18T21:06:18.459 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2860000000000001e-05 2024-04-18T21:06:18.459 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.459 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.459 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:18.459 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616027+0000", 2024-04-18T21:06:18.459 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000107852 2024-04-18T21:06:18.459 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.459 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.460 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:18.460 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616037+0000", 2024-04-18T21:06:18.460 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:06:18.460 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.460 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.460 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:18.460 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622719+0000", 2024-04-18T21:06:18.460 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0066817220000000002 2024-04-18T21:06:18.460 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.460 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.460 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:18.460 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623006+0000", 2024-04-18T21:06:18.460 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00028783699999999999 2024-04-18T21:06:18.460 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.460 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.460 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:18.461 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.655220+0000", 2024-04-18T21:06:18.461 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.032213036 2024-04-18T21:06:18.461 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:18.461 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:18.461 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:18.461 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.461 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.461 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:18.461 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:18.461 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 72.788057003000006, 2024-04-18T21:06:18.461 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.032845253999999997, 2024-04-18T21:06:18.461 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:18.461 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:18.461 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "started", 2024-04-18T21:06:18.461 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:18.461 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.462 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:18.462 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:18.462 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:18.462 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.462 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.462 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:18.462 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:18.462 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:18.462 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.462 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.462 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:18.462 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615942+0000", 2024-04-18T21:06:18.462 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.717e-06 2024-04-18T21:06:18.462 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.463 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.463 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:18.463 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615946+0000", 2024-04-18T21:06:18.463 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.6e-06 2024-04-18T21:06:18.463 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.463 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.463 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:18.463 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615960+0000", 2024-04-18T21:06:18.463 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:06:18.463 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.463 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.463 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:18.463 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615968+0000", 2024-04-18T21:06:18.463 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.9070000000000007e-06 2024-04-18T21:06:18.463 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.463 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.464 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:18.464 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616100+0000", 2024-04-18T21:06:18.464 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000132402 2024-04-18T21:06:18.464 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.464 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.464 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:18.464 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616117+0000", 2024-04-18T21:06:18.464 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6653000000000001e-05 2024-04-18T21:06:18.464 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.464 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.464 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:18.464 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621566+0000", 2024-04-18T21:06:18.464 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0054497740000000001 2024-04-18T21:06:18.464 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.464 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.465 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:18.465 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622801+0000", 2024-04-18T21:06:18.465 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0012345710000000001 2024-04-18T21:06:18.465 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.465 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.465 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:18.465 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648785+0000", 2024-04-18T21:06:18.465 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.025984104000000001 2024-04-18T21:06:18.465 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:18.465 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:18.465 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:18.465 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.465 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.465 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:18.465 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:06:18.465 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 72.782205653000005, 2024-04-18T21:06:18.466 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.011561350999999999, 2024-04-18T21:06:18.466 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:18.466 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:18.466 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:18.466 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:18.466 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.466 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:18.466 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:06:18.466 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:18.466 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.466 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.466 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:18.466 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:06:18.466 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:18.466 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.467 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.467 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:18.467 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621792+0000", 2024-04-18T21:06:18.467 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.4000000000000001e-07 2024-04-18T21:06:18.467 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.467 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.467 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:18.467 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:06:18.467 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.1050000000000002e-05 2024-04-18T21:06:18.467 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.467 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.467 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:18.467 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622608+0000", 2024-04-18T21:06:18.467 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00077505900000000003 2024-04-18T21:06:18.467 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.467 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.468 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:18.468 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623879+0000", 2024-04-18T21:06:18.468 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0012705839999999999 2024-04-18T21:06:18.468 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.468 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.468 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:18.468 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624010+0000", 2024-04-18T21:06:18.468 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00013176900000000001 2024-04-18T21:06:18.468 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.468 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.468 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:18.468 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624058+0000", 2024-04-18T21:06:18.468 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.7299000000000002e-05 2024-04-18T21:06:18.468 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.468 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.468 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:18.469 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633262+0000", 2024-04-18T21:06:18.469 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0092048770000000002 2024-04-18T21:06:18.469 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.469 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.469 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:18.469 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633353+0000", 2024-04-18T21:06:18.469 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0073000000000003e-05 2024-04-18T21:06:18.469 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:18.469 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:18.469 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:18.469 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.469 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.469 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:18.469 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:06:18.469 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 72.780078266999993, 2024-04-18T21:06:18.469 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0098419370000000003, 2024-04-18T21:06:18.470 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:18.470 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:18.470 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:18.470 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:18.470 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.470 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:18.470 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:06:18.470 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:18.470 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.470 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.470 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:18.470 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:06:18.470 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:18.470 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.470 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.471 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:18.471 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623920+0000", 2024-04-18T21:06:18.471 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2240000000000001e-06 2024-04-18T21:06:18.471 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.471 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.471 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:18.471 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623933+0000", 2024-04-18T21:06:18.471 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3653e-05 2024-04-18T21:06:18.471 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.471 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.471 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:18.471 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623956+0000", 2024-04-18T21:06:18.471 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2059e-05 2024-04-18T21:06:18.471 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.471 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.471 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:18.472 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623975+0000", 2024-04-18T21:06:18.472 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.9806999999999999e-05 2024-04-18T21:06:18.472 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.472 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.472 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:18.472 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626943+0000", 2024-04-18T21:06:18.472 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0029681579999999998 2024-04-18T21:06:18.472 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.472 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.472 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:18.472 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626993+0000", 2024-04-18T21:06:18.472 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.9935999999999998e-05 2024-04-18T21:06:18.472 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.472 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.472 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:18.472 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633665+0000", 2024-04-18T21:06:18.473 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0066719250000000004 2024-04-18T21:06:18.473 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.473 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.473 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:18.473 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633761+0000", 2024-04-18T21:06:18.473 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.5174999999999996e-05 2024-04-18T21:06:18.473 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:18.473 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:18.473 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:18.473 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.473 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.473 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:18.473 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:06:18.473 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 72.779246647999997, 2024-04-18T21:06:18.473 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0090159079999999996, 2024-04-18T21:06:18.473 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:18.473 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:18.474 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:18.474 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:18.474 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.474 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:18.474 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:06:18.474 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:18.474 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.474 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.474 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:18.474 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:06:18.474 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:18.474 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.474 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.474 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:18.475 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624751+0000", 2024-04-18T21:06:18.475 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.7600000000000006e-07 2024-04-18T21:06:18.475 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.475 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.475 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:18.475 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624787+0000", 2024-04-18T21:06:18.475 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.6273000000000003e-05 2024-04-18T21:06:18.475 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.475 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.475 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:18.475 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625837+0000", 2024-04-18T21:06:18.475 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00104992 2024-04-18T21:06:18.475 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.475 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.475 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:18.475 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625860+0000", 2024-04-18T21:06:18.476 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3110000000000001e-05 2024-04-18T21:06:18.476 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.476 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.476 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:18.476 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625984+0000", 2024-04-18T21:06:18.476 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012399199999999999 2024-04-18T21:06:18.476 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.476 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.476 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:18.476 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626030+0000", 2024-04-18T21:06:18.476 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.5429999999999997e-05 2024-04-18T21:06:18.476 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.476 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.476 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:18.476 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633643+0000", 2024-04-18T21:06:18.476 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0076129320000000002 2024-04-18T21:06:18.477 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.477 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.477 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:18.477 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633766+0000", 2024-04-18T21:06:18.477 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000123275 2024-04-18T21:06:18.477 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:18.477 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:18.477 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:18.477 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.477 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.477 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:18.477 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:06:18.477 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 72.777992924000003, 2024-04-18T21:06:18.477 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0088669170000000002, 2024-04-18T21:06:18.477 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:18.477 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:18.478 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:18.478 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:18.478 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.478 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:18.478 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:06:18.478 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:18.478 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.478 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.478 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:18.478 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:06:18.478 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:18.478 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.478 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.478 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:18.478 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626005+0000", 2024-04-18T21:06:18.478 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.5000000000000001e-07 2024-04-18T21:06:18.479 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.479 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.479 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:18.479 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626028+0000", 2024-04-18T21:06:18.479 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2756999999999999e-05 2024-04-18T21:06:18.479 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.479 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.479 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:18.479 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626050+0000", 2024-04-18T21:06:18.479 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2140000000000001e-05 2024-04-18T21:06:18.479 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.479 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.479 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:18.479 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626065+0000", 2024-04-18T21:06:18.479 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5176e-05 2024-04-18T21:06:18.479 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.480 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.480 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:18.480 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628334+0000", 2024-04-18T21:06:18.480 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0022691439999999998 2024-04-18T21:06:18.480 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.480 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.480 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:18.480 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628379+0000", 2024-04-18T21:06:18.480 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.5420000000000002e-05 2024-04-18T21:06:18.480 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.480 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.480 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:18.480 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634770+0000", 2024-04-18T21:06:18.480 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0063908410000000004 2024-04-18T21:06:18.480 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.480 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.481 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:18.481 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634871+0000", 2024-04-18T21:06:18.481 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000100589 2024-04-18T21:06:18.481 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:18.481 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:18.481 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:18.481 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.481 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.481 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:13 3.10 e17/15 3:0d89b25e:::603.00000000:head v 17'8, mlcod=0'0)", 2024-04-18T21:06:18.481 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:06:18.481 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 72.759159495000006, 2024-04-18T21:06:18.481 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0090974379999999994, 2024-04-18T21:06:18.481 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:18.481 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:18.481 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:18.481 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:18.481 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.482 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:18.482 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:06:18.482 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:18.482 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.482 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.482 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:18.482 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:06:18.482 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:18.482 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.482 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.482 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:18.482 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644838+0000", 2024-04-18T21:06:18.482 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.569999999999999e-07 2024-04-18T21:06:18.482 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.483 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.483 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:18.483 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644846+0000", 2024-04-18T21:06:18.483 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.4499999999999998e-06 2024-04-18T21:06:18.483 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.483 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.483 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:18.483 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644861+0000", 2024-04-18T21:06:18.483 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5243e-05 2024-04-18T21:06:18.483 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.483 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.483 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:18.483 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644997+0000", 2024-04-18T21:06:18.483 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000135609 2024-04-18T21:06:18.483 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.483 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.483 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:18.484 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649150+0000", 2024-04-18T21:06:18.484 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0041536760000000002 2024-04-18T21:06:18.484 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.484 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.484 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:18.484 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649207+0000", 2024-04-18T21:06:18.484 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.6677e-05 2024-04-18T21:06:18.484 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.484 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.484 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:18.484 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.653840+0000", 2024-04-18T21:06:18.484 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0046329700000000001 2024-04-18T21:06:18.484 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.484 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.484 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:18.484 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.653935+0000", 2024-04-18T21:06:18.484 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.4856000000000001e-05 2024-04-18T21:06:18.485 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:18.485 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:18.485 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:18.485 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.485 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.485 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 3 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:06:18.485 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:06:18.485 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 72.756370335, 2024-04-18T21:06:18.485 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0087842319999999995, 2024-04-18T21:06:18.485 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:18.485 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:18.485 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "reached pg", 2024-04-18T21:06:18.485 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:18.485 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.485 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:18.486 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:06:18.486 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:18.486 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.486 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.486 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:18.486 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:06:18.486 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:18.486 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.486 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.486 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:18.486 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:06:18.486 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.8299999999999996e-07 2024-04-18T21:06:18.486 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.486 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.486 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:18.487 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647642+0000", 2024-04-18T21:06:18.487 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4724e-05 2024-04-18T21:06:18.487 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.487 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.487 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:18.487 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647679+0000", 2024-04-18T21:06:18.487 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.6662999999999998e-05 2024-04-18T21:06:18.487 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.487 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.487 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:18.487 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647735+0000", 2024-04-18T21:06:18.487 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.6196000000000002e-05 2024-04-18T21:06:18.487 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.487 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.487 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:18.487 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649865+0000", 2024-04-18T21:06:18.488 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0021299489999999999 2024-04-18T21:06:18.488 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.488 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.488 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:18.488 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656411+0000", 2024-04-18T21:06:18.488 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0065460170000000003 2024-04-18T21:06:18.488 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:18.488 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:18.488 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:18.488 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.488 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.488 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:18.488 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:06:18.488 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 72.756225138999994, 2024-04-18T21:06:18.488 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0095703190000000007, 2024-04-18T21:06:18.488 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:18.489 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:18.489 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:18.489 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:18.489 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.489 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:18.489 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:06:18.489 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:18.489 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.489 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.489 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:18.489 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:06:18.489 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:18.489 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.489 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.489 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:18.489 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647773+0000", 2024-04-18T21:06:18.490 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.046e-06 2024-04-18T21:06:18.490 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.490 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.490 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:18.490 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647795+0000", 2024-04-18T21:06:18.490 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2616000000000002e-05 2024-04-18T21:06:18.490 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.490 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.490 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:18.490 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647818+0000", 2024-04-18T21:06:18.490 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3110000000000001e-05 2024-04-18T21:06:18.490 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.490 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.490 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:18.490 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647834+0000", 2024-04-18T21:06:18.490 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5163e-05 2024-04-18T21:06:18.491 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.491 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.491 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:18.491 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650682+0000", 2024-04-18T21:06:18.491 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0028479759999999999 2024-04-18T21:06:18.491 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.491 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.491 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:18.491 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650730+0000", 2024-04-18T21:06:18.491 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.8375999999999999e-05 2024-04-18T21:06:18.491 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.491 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.491 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:18.491 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656751+0000", 2024-04-18T21:06:18.491 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0060211880000000002 2024-04-18T21:06:18.491 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.492 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.492 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:18.492 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657342+0000", 2024-04-18T21:06:18.492 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00059084399999999998 2024-04-18T21:06:18.492 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:18.492 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:18.492 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:18.492 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.492 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.492 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:18.492 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:06:18.492 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 72.755812852999995, 2024-04-18T21:06:18.492 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0092471759999999993, 2024-04-18T21:06:18.492 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:18.492 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:18.492 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:18.492 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:18.493 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.493 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:18.493 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:06:18.493 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:18.493 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.493 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.493 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:18.493 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:06:18.493 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:18.493 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.493 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.493 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:18.493 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648185+0000", 2024-04-18T21:06:18.493 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.5000000000000001e-07 2024-04-18T21:06:18.493 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.493 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.493 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:18.494 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648203+0000", 2024-04-18T21:06:18.494 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.8102999999999999e-05 2024-04-18T21:06:18.494 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.494 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.494 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:18.494 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648226+0000", 2024-04-18T21:06:18.494 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2921999999999998e-05 2024-04-18T21:06:18.494 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.494 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.494 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:18.494 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648241+0000", 2024-04-18T21:06:18.494 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5336999999999999e-05 2024-04-18T21:06:18.494 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.494 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.495 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:18.495 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.651268+0000", 2024-04-18T21:06:18.495 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0030271640000000002 2024-04-18T21:06:18.495 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.495 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.495 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:18.495 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.651319+0000", 2024-04-18T21:06:18.495 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.0843000000000001e-05 2024-04-18T21:06:18.495 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.495 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.495 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:18.495 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657347+0000", 2024-04-18T21:06:18.495 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0060279770000000003 2024-04-18T21:06:18.495 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:18.495 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:18.495 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:18.496 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657431+0000", 2024-04-18T21:06:18.496 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.3980000000000006e-05 2024-04-18T21:06:18.496 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:18.496 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:18.496 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:18.496 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:18.496 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:18.496 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:06:18.497 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:18.498 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:18.499+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:18.598 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:18.599+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:18.627 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:18.627 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:06:18.627 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-04-18T21:06:18.627 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:18.627 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-18T21:06:18.641 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:18.700 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:18.702+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:18.756 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:18.757 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:06:18.757 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-18T21:06:18.757 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-18T21:06:18.757 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:18.772 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:06:18.774 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-04-18T21:06:18.775 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:18.795 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2024-04-18T21:06:18.522849+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597719,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":256,"num_write_kb":3483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":95756,"kb_used_data":2216,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":283019764,"statfs":{"total":289910292480,"available":289812238336,"internally_reserved":0,"allocated":2269184,"data_stored":1639162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001574"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.609069+0000","last_change":"2024-04-18T21:05:05.652795+0000","last_active":"2024-04-18T21:06:16.609069+0000","last_peered":"2024-04-18T21:06:16.609069+0000","last_clean":"2024-04-18T21:06:16.609069+0000","last_became_active":"2024-04-18T21:05:05.650121+0000","last_became_peered":"2024-04-18T21:05:05.650121+0000","last_unstale":"2024-04-18T21:06:16.609069+0000","last_undegraded":"2024-04-18T21:06:16.609069+0000","last_fullsized":"2024-04-18T21:06:16.609069+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.608597+0000","last_change":"2024-04-18T21:05:05.657531+0000","last_active":"2024-04-18T21:06:16.608597+0000","last_peered":"2024-04-18T21:06:16.608597+0000","last_clean":"2024-04-18T21:06:16.608597+0000","last_became_active":"2024-04-18T21:05:05.653101+0000","last_became_peered":"2024-04-18T21:05:05.653101+0000","last_unstale":"2024-04-18T21:06:16.608597+0000","last_undegraded":"2024-04-18T21:06:16.608597+0000","last_fullsized":"2024-04-18T21:06:16.608597+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:32:23.929877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.610757+0000","last_change":"2024-04-18T21:05:05.647965+0000","last_active":"2024-04-18T21:06:16.610757+0000","last_peered":"2024-04-18T21:06:16.610757+0000","last_clean":"2024-04-18T21:06:16.610757+0000","last_became_active":"2024-04-18T21:05:05.645931+0000","last_became_peered":"2024-04-18T21:05:05.645931+0000","last_unstale":"2024-04-18T21:06:16.610757+0000","last_undegraded":"2024-04-18T21:06:16.610757+0000","last_fullsized":"2024-04-18T21:06:16.610757+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:04.350492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.610612+0000","last_change":"2024-04-18T21:05:05.629321+0000","last_active":"2024-04-18T21:06:16.610612+0000","last_peered":"2024-04-18T21:06:16.610612+0000","last_clean":"2024-04-18T21:06:16.610612+0000","last_became_active":"2024-04-18T21:05:05.627956+0000","last_became_peered":"2024-04-18T21:05:05.627956+0000","last_unstale":"2024-04-18T21:06:16.610612+0000","last_undegraded":"2024-04-18T21:06:16.610612+0000","last_fullsized":"2024-04-18T21:06:16.610612+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:15:28.458476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.608520+0000","last_change":"2024-04-18T21:05:05.648710+0000","last_active":"2024-04-18T21:06:16.608520+0000","last_peered":"2024-04-18T21:06:16.608520+0000","last_clean":"2024-04-18T21:06:16.608520+0000","last_became_active":"2024-04-18T21:05:05.647801+0000","last_became_peered":"2024-04-18T21:05:05.647801+0000","last_unstale":"2024-04-18T21:06:16.608520+0000","last_undegraded":"2024-04-18T21:06:16.608520+0000","last_fullsized":"2024-04-18T21:06:16.608520+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:46:36.339289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.610310+0000","last_change":"2024-04-18T21:05:05.629095+0000","last_active":"2024-04-18T21:06:16.610310+0000","last_peered":"2024-04-18T21:06:16.610310+0000","last_clean":"2024-04-18T21:06:16.610310+0000","last_became_active":"2024-04-18T21:05:05.627664+0000","last_became_peered":"2024-04-18T21:05:05.627664+0000","last_unstale":"2024-04-18T21:06:16.610310+0000","last_undegraded":"2024-04-18T21:06:16.610310+0000","last_fullsized":"2024-04-18T21:06:16.610310+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:51:28.440070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.610086+0000","last_change":"2024-04-18T21:05:05.625047+0000","last_active":"2024-04-18T21:06:16.610086+0000","last_peered":"2024-04-18T21:06:16.610086+0000","last_clean":"2024-04-18T21:06:16.610086+0000","last_became_active":"2024-04-18T21:05:05.622781+0000","last_became_peered":"2024-04-18T21:05:05.622781+0000","last_unstale":"2024-04-18T21:06:16.610086+0000","last_undegraded":"2024-04-18T21:06:16.610086+0000","last_fullsized":"2024-04-18T21:06:16.610086+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:12.944469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.609577+0000","last_change":"2024-04-18T21:05:05.640390+0000","last_active":"2024-04-18T21:06:16.609577+0000","last_peered":"2024-04-18T21:06:16.609577+0000","last_clean":"2024-04-18T21:06:16.609577+0000","last_became_active":"2024-04-18T21:05:05.638295+0000","last_became_peered":"2024-04-18T21:05:05.638295+0000","last_unstale":"2024-04-18T21:06:16.609577+0000","last_undegraded":"2024-04-18T21:06:16.609577+0000","last_fullsized":"2024-04-18T21:06:16.609577+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:34:31.132458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.735647+0000","last_change":"2024-04-18T21:05:05.660752+0000","last_active":"2024-04-18T21:06:16.735647+0000","last_peered":"2024-04-18T21:06:16.735647+0000","last_clean":"2024-04-18T21:06:16.735647+0000","last_became_active":"2024-04-18T21:05:05.659226+0000","last_became_peered":"2024-04-18T21:05:05.659226+0000","last_unstale":"2024-04-18T21:06:16.735647+0000","last_undegraded":"2024-04-18T21:06:16.735647+0000","last_fullsized":"2024-04-18T21:06:16.735647+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:20:45.938503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.608697+0000","last_change":"2024-04-18T21:05:05.656660+0000","last_active":"2024-04-18T21:06:16.608697+0000","last_peered":"2024-04-18T21:06:16.608697+0000","last_clean":"2024-04-18T21:06:16.608697+0000","last_became_active":"2024-04-18T21:05:05.653829+0000","last_became_peered":"2024-04-18T21:05:05.653829+0000","last_unstale":"2024-04-18T21:06:16.608697+0000","last_undegraded":"2024-04-18T21:06:16.608697+0000","last_fullsized":"2024-04-18T21:06:16.608697+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:50:40.920146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.611083+0000","last_change":"2024-04-18T21:05:05.646721+0000","last_active":"2024-04-18T21:06:16.611083+0000","last_peered":"2024-04-18T21:06:16.611083+0000","last_clean":"2024-04-18T21:06:16.611083+0000","last_became_active":"2024-04-18T21:05:05.643421+0000","last_became_peered":"2024-04-18T21:05:05.643421+0000","last_unstale":"2024-04-18T21:06:16.611083+0000","last_undegraded":"2024-04-18T21:06:16.611083+0000","last_fullsized":"2024-04-18T21:06:16.611083+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:14:51.873741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.608348+0000","last_change":"2024-04-18T21:05:05.656320+0000","last_active":"2024-04-18T21:06:16.608348+0000","last_peered":"2024-04-18T21:06:16.608348+0000","last_clean":"2024-04-18T21:06:16.608348+0000","last_became_active":"2024-04-18T21:05:05.655508+0000","last_became_peered":"2024-04-18T21:05:05.655508+0000","last_unstale":"2024-04-18T21:06:16.608348+0000","last_undegraded":"2024-04-18T21:06:16.608348+0000","last_fullsized":"2024-04-18T21:06:16.608348+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:51.225379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.608260+0000","last_change":"2024-04-18T21:05:05.649001+0000","last_active":"2024-04-18T21:06:16.608260+0000","last_peered":"2024-04-18T21:06:16.608260+0000","last_clean":"2024-04-18T21:06:16.608260+0000","last_became_active":"2024-04-18T21:05:05.648070+0000","last_became_peered":"2024-04-18T21:05:05.648070+0000","last_unstale":"2024-04-18T21:06:16.608260+0000","last_undegraded":"2024-04-18T21:06:16.608260+0000","last_fullsized":"2024-04-18T21:06:16.608260+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:56.408234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.610143+0000","last_change":"2024-04-18T21:05:05.635880+0000","last_active":"2024-04-18T21:06:16.610143+0000","last_peered":"2024-04-18T21:06:16.610143+0000","last_clean":"2024-04-18T21:06:16.610143+0000","last_became_active":"2024-04-18T21:05:05.635089+0000","last_became_peered":"2024-04-18T21:05:05.635089+0000","last_unstale":"2024-04-18T21:06:16.610143+0000","last_undegraded":"2024-04-18T21:06:16.610143+0000","last_fullsized":"2024-04-18T21:06:16.610143+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:50:40.920146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.610200+0000","last_change":"2024-04-18T21:05:05.639640+0000","last_active":"2024-04-18T21:06:16.610200+0000","last_peered":"2024-04-18T21:06:16.610200+0000","last_clean":"2024-04-18T21:06:16.610200+0000","last_became_active":"2024-04-18T21:05:05.637311+0000","last_became_peered":"2024-04-18T21:05:05.637311+0000","last_unstale":"2024-04-18T21:06:16.610200+0000","last_undegraded":"2024-04-18T21:06:16.610200+0000","last_fullsized":"2024-04-18T21:06:16.610200+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:20:45.938503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.609563+0000","last_change":"2024-04-18T21:05:05.638203+0000","last_active":"2024-04-18T21:06:16.609563+0000","last_peered":"2024-04-18T21:06:16.609563+0000","last_clean":"2024-04-18T21:06:16.609563+0000","last_became_active":"2024-04-18T21:05:05.637352+0000","last_became_peered":"2024-04-18T21:05:05.637352+0000","last_unstale":"2024-04-18T21:06:16.609563+0000","last_undegraded":"2024-04-18T21:06:16.609563+0000","last_fullsized":"2024-04-18T21:06:16.609563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":25,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.608913+0000","last_change":"2024-04-18T21:06:01.036290+0000","last_active":"2024-04-18T21:06:16.608913+0000","last_peered":"2024-04-18T21:06:16.608913+0000","last_clean":"2024-04-18T21:06:16.608913+0000","last_became_active":"2024-04-18T21:06:01.035478+0000","last_became_peered":"2024-04-18T21:06:01.035478+0000","last_unstale":"2024-04-18T21:06:16.608913+0000","last_undegraded":"2024-04-18T21:06:16.608913+0000","last_fullsized":"2024-04-18T21:06:16.608913+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:14:08.347445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.608926+0000","last_change":"2024-04-18T21:05:05.655261+0000","last_active":"2024-04-18T21:06:16.608926+0000","last_peered":"2024-04-18T21:06:16.608926+0000","last_clean":"2024-04-18T21:06:16.608926+0000","last_became_active":"2024-04-18T21:05:05.651388+0000","last_became_peered":"2024-04-18T21:05:05.651388+0000","last_unstale":"2024-04-18T21:06:16.608926+0000","last_undegraded":"2024-04-18T21:06:16.608926+0000","last_fullsized":"2024-04-18T21:06:16.608926+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:53.850184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.735381+0000","last_change":"2024-04-18T21:05:05.652710+0000","last_active":"2024-04-18T21:06:16.735381+0000","last_peered":"2024-04-18T21:06:16.735381+0000","last_clean":"2024-04-18T21:06:16.735381+0000","last_became_active":"2024-04-18T21:05:05.651929+0000","last_became_peered":"2024-04-18T21:05:05.651929+0000","last_unstale":"2024-04-18T21:06:16.735381+0000","last_undegraded":"2024-04-18T21:06:16.735381+0000","last_fullsized":"2024-04-18T21:06:16.735381+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:12.944469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.610764+0000","last_change":"2024-04-18T21:05:05.638338+0000","last_active":"2024-04-18T21:06:16.610764+0000","last_peered":"2024-04-18T21:06:16.610764+0000","last_clean":"2024-04-18T21:06:16.610764+0000","last_became_active":"2024-04-18T21:05:05.637567+0000","last_became_peered":"2024-04-18T21:05:05.637567+0000","last_unstale":"2024-04-18T21:06:16.610764+0000","last_undegraded":"2024-04-18T21:06:16.610764+0000","last_fullsized":"2024-04-18T21:06:16.610764+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.610669+0000","last_change":"2024-04-18T21:05:05.643606+0000","last_active":"2024-04-18T21:06:16.610669+0000","last_peered":"2024-04-18T21:06:16.610669+0000","last_clean":"2024-04-18T21:06:16.610669+0000","last_became_active":"2024-04-18T21:05:05.642991+0000","last_became_peered":"2024-04-18T21:05:05.642991+0000","last_unstale":"2024-04-18T21:06:16.610669+0000","last_undegraded":"2024-04-18T21:06:16.610669+0000","last_fullsized":"2024-04-18T21:06:16.610669+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:01.841786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.608075+0000","last_change":"2024-04-18T21:05:05.650896+0000","last_active":"2024-04-18T21:06:16.608075+0000","last_peered":"2024-04-18T21:06:16.608075+0000","last_clean":"2024-04-18T21:06:16.608075+0000","last_became_active":"2024-04-18T21:05:05.650083+0000","last_became_peered":"2024-04-18T21:05:05.650083+0000","last_unstale":"2024-04-18T21:06:16.608075+0000","last_undegraded":"2024-04-18T21:06:16.608075+0000","last_fullsized":"2024-04-18T21:06:16.608075+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:43:55.788425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":25,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.609579+0000","last_change":"2024-04-18T21:06:01.034390+0000","last_active":"2024-04-18T21:06:16.609579+0000","last_peered":"2024-04-18T21:06:16.609579+0000","last_clean":"2024-04-18T21:06:16.609579+0000","last_became_active":"2024-04-18T21:06:01.033524+0000","last_became_peered":"2024-04-18T21:06:01.033524+0000","last_unstale":"2024-04-18T21:06:16.609579+0000","last_undegraded":"2024-04-18T21:06:16.609579+0000","last_fullsized":"2024-04-18T21:06:16.609579+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:28:17.539732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.607692+0000","last_change":"2024-04-18T21:05:05.642755+0000","last_active":"2024-04-18T21:06:16.607692+0000","last_peered":"2024-04-18T21:06:16.607692+0000","last_clean":"2024-04-18T21:06:16.607692+0000","last_became_active":"2024-04-18T21:05:05.642150+0000","last_became_peered":"2024-04-18T21:05:05.642150+0000","last_unstale":"2024-04-18T21:06:16.607692+0000","last_undegraded":"2024-04-18T21:06:16.607692+0000","last_fullsized":"2024-04-18T21:06:16.607692+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:29:22.647425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.609127+0000","last_change":"2024-04-18T21:05:05.653741+0000","last_active":"2024-04-18T21:06:16.609127+0000","last_peered":"2024-04-18T21:06:16.609127+0000","last_clean":"2024-04-18T21:06:16.609127+0000","last_became_active":"2024-04-18T21:05:05.650174+0000","last_became_peered":"2024-04-18T21:05:05.650174+0000","last_unstale":"2024-04-18T21:06:16.609127+0000","last_undegraded":"2024-04-18T21:06:16.609127+0000","last_fullsized":"2024-04-18T21:06:16.609127+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:04.350492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.735646+0000","last_change":"2024-04-18T21:05:05.649581+0000","last_active":"2024-04-18T21:06:16.735646+0000","last_peered":"2024-04-18T21:06:16.735646+0000","last_clean":"2024-04-18T21:06:16.735646+0000","last_became_active":"2024-04-18T21:05:05.648233+0000","last_became_peered":"2024-04-18T21:05:05.648233+0000","last_unstale":"2024-04-18T21:06:16.735646+0000","last_undegraded":"2024-04-18T21:06:16.735646+0000","last_fullsized":"2024-04-18T21:06:16.735646+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.611487+0000","last_change":"2024-04-18T21:05:05.646926+0000","last_active":"2024-04-18T21:06:16.611487+0000","last_peered":"2024-04-18T21:06:16.611487+0000","last_clean":"2024-04-18T21:06:16.611487+0000","last_became_active":"2024-04-18T21:05:05.644942+0000","last_became_peered":"2024-04-18T21:05:05.644942+0000","last_unstale":"2024-04-18T21:06:16.611487+0000","last_undegraded":"2024-04-18T21:06:16.611487+0000","last_fullsized":"2024-04-18T21:06:16.611487+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:53.850184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.608737+0000","last_change":"2024-04-18T21:05:05.656314+0000","last_active":"2024-04-18T21:06:16.608737+0000","last_peered":"2024-04-18T21:06:16.608737+0000","last_clean":"2024-04-18T21:06:16.608737+0000","last_became_active":"2024-04-18T21:05:05.655364+0000","last_became_peered":"2024-04-18T21:05:05.655364+0000","last_unstale":"2024-04-18T21:06:16.608737+0000","last_undegraded":"2024-04-18T21:06:16.608737+0000","last_fullsized":"2024-04-18T21:06:16.608737+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:27:17.530889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":25,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.608086+0000","last_change":"2024-04-18T21:06:01.033572+0000","last_active":"2024-04-18T21:06:16.608086+0000","last_peered":"2024-04-18T21:06:16.608086+0000","last_clean":"2024-04-18T21:06:16.608086+0000","last_became_active":"2024-04-18T21:06:01.032811+0000","last_became_peered":"2024-04-18T21:06:01.032811+0000","last_unstale":"2024-04-18T21:06:16.608086+0000","last_undegraded":"2024-04-18T21:06:16.608086+0000","last_fullsized":"2024-04-18T21:06:16.608086+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:38:45.452379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.608270+0000","last_change":"2024-04-18T21:05:05.648084+0000","last_active":"2024-04-18T21:06:16.608270+0000","last_peered":"2024-04-18T21:06:16.608270+0000","last_clean":"2024-04-18T21:06:16.608270+0000","last_became_active":"2024-04-18T21:05:05.645340+0000","last_became_peered":"2024-04-18T21:05:05.645340+0000","last_unstale":"2024-04-18T21:06:16.608270+0000","last_undegraded":"2024-04-18T21:06:16.608270+0000","last_fullsized":"2024-04-18T21:06:16.608270+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:34:31.132458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":25,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.607786+0000","last_change":"2024-04-18T21:06:01.034356+0000","last_active":"2024-04-18T21:06:16.607786+0000","last_peered":"2024-04-18T21:06:16.607786+0000","last_clean":"2024-04-18T21:06:16.607786+0000","last_became_active":"2024-04-18T21:06:01.033850+0000","last_became_peered":"2024-04-18T21:06:01.033850+0000","last_unstale":"2024-04-18T21:06:16.607786+0000","last_undegraded":"2024-04-18T21:06:16.607786+0000","last_fullsized":"2024-04-18T21:06:16.607786+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:28:32.020153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.609863+0000","last_change":"2024-04-18T21:05:05.626677+0000","last_active":"2024-04-18T21:06:16.609863+0000","last_peered":"2024-04-18T21:06:16.609863+0000","last_clean":"2024-04-18T21:06:16.609863+0000","last_became_active":"2024-04-18T21:05:05.624250+0000","last_became_peered":"2024-04-18T21:05:05.624250+0000","last_unstale":"2024-04-18T21:06:16.609863+0000","last_undegraded":"2024-04-18T21:06:16.609863+0000","last_fullsized":"2024-04-18T21:06:16.609863+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:51.225379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.608509+0000","last_change":"2024-04-18T21:05:05.649918+0000","last_active":"2024-04-18T21:06:16.608509+0000","last_peered":"2024-04-18T21:06:16.608509+0000","last_clean":"2024-04-18T21:06:16.608509+0000","last_became_active":"2024-04-18T21:05:05.647147+0000","last_became_peered":"2024-04-18T21:05:05.647147+0000","last_unstale":"2024-04-18T21:06:16.608509+0000","last_undegraded":"2024-04-18T21:06:16.608509+0000","last_fullsized":"2024-04-18T21:06:16.608509+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:51:28.440070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":60,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.611245+0000","last_change":"2024-04-18T21:05:04.632748+0000","last_active":"2024-04-18T21:06:16.611245+0000","last_peered":"2024-04-18T21:06:16.611245+0000","last_clean":"2024-04-18T21:06:16.611245+0000","last_became_active":"2024-04-18T21:05:04.628407+0000","last_became_peered":"2024-04-18T21:05:04.628407+0000","last_unstale":"2024-04-18T21:06:16.611245+0000","last_undegraded":"2024-04-18T21:06:16.611245+0000","last_fullsized":"2024-04-18T21:06:16.611245+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:42:45.392908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.608762+0000","last_change":"2024-04-18T21:05:05.649199+0000","last_active":"2024-04-18T21:06:16.608762+0000","last_peered":"2024-04-18T21:06:16.608762+0000","last_clean":"2024-04-18T21:06:16.608762+0000","last_became_active":"2024-04-18T21:05:05.646898+0000","last_became_peered":"2024-04-18T21:05:05.646898+0000","last_unstale":"2024-04-18T21:06:16.608762+0000","last_undegraded":"2024-04-18T21:06:16.608762+0000","last_fullsized":"2024-04-18T21:06:16.608762+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:31:31.842528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.732947+0000","last_change":"2024-04-18T21:05:04.638017+0000","last_active":"2024-04-18T21:06:16.732947+0000","last_peered":"2024-04-18T21:06:16.732947+0000","last_clean":"2024-04-18T21:06:16.732947+0000","last_became_active":"2024-04-18T21:05:04.637287+0000","last_became_peered":"2024-04-18T21:05:04.637287+0000","last_unstale":"2024-04-18T21:06:16.732947+0000","last_undegraded":"2024-04-18T21:06:16.732947+0000","last_fullsized":"2024-04-18T21:06:16.732947+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:25.891472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":25,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.610972+0000","last_change":"2024-04-18T21:06:01.034755+0000","last_active":"2024-04-18T21:06:16.610972+0000","last_peered":"2024-04-18T21:06:16.610972+0000","last_clean":"2024-04-18T21:06:16.610972+0000","last_became_active":"2024-04-18T21:06:01.033889+0000","last_became_peered":"2024-04-18T21:06:01.033889+0000","last_unstale":"2024-04-18T21:06:16.610972+0000","last_undegraded":"2024-04-18T21:06:16.610972+0000","last_fullsized":"2024-04-18T21:06:16.610972+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:09:08.394894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.608049+0000","last_change":"2024-04-18T21:05:04.628489+0000","last_active":"2024-04-18T21:06:16.608049+0000","last_peered":"2024-04-18T21:06:16.608049+0000","last_clean":"2024-04-18T21:06:16.608049+0000","last_became_active":"2024-04-18T21:05:04.627279+0000","last_became_peered":"2024-04-18T21:05:04.627279+0000","last_unstale":"2024-04-18T21:06:16.608049+0000","last_undegraded":"2024-04-18T21:06:16.608049+0000","last_fullsized":"2024-04-18T21:06:16.608049+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:43:23.420744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.735683+0000","last_change":"2024-04-18T21:05:05.649347+0000","last_active":"2024-04-18T21:06:16.735683+0000","last_peered":"2024-04-18T21:06:16.735683+0000","last_clean":"2024-04-18T21:06:16.735683+0000","last_became_active":"2024-04-18T21:05:05.648144+0000","last_became_peered":"2024-04-18T21:05:05.648144+0000","last_unstale":"2024-04-18T21:06:16.735683+0000","last_undegraded":"2024-04-18T21:06:16.735683+0000","last_fullsized":"2024-04-18T21:06:16.735683+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:51:28.440070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":66,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.609975+0000","last_change":"2024-04-18T21:05:04.624089+0000","last_active":"2024-04-18T21:06:16.609975+0000","last_peered":"2024-04-18T21:06:16.609975+0000","last_clean":"2024-04-18T21:06:16.609975+0000","last_became_active":"2024-04-18T21:05:04.623238+0000","last_became_peered":"2024-04-18T21:05:04.623238+0000","last_unstale":"2024-04-18T21:06:16.609975+0000","last_undegraded":"2024-04-18T21:06:16.609975+0000","last_fullsized":"2024-04-18T21:06:16.609975+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:44:19.076499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":59,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.611848+0000","last_change":"2024-04-18T21:05:04.633907+0000","last_active":"2024-04-18T21:06:16.611848+0000","last_peered":"2024-04-18T21:06:16.611848+0000","last_clean":"2024-04-18T21:06:16.611848+0000","last_became_active":"2024-04-18T21:05:04.630308+0000","last_became_peered":"2024-04-18T21:05:04.630308+0000","last_unstale":"2024-04-18T21:06:16.611848+0000","last_undegraded":"2024-04-18T21:06:16.611848+0000","last_fullsized":"2024-04-18T21:06:16.611848+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:55:46.219812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.607800+0000","last_change":"2024-04-18T21:05:05.658572+0000","last_active":"2024-04-18T21:06:16.607800+0000","last_peered":"2024-04-18T21:06:16.607800+0000","last_clean":"2024-04-18T21:06:16.607800+0000","last_became_active":"2024-04-18T21:05:05.657842+0000","last_became_peered":"2024-04-18T21:05:05.657842+0000","last_unstale":"2024-04-18T21:06:16.607800+0000","last_undegraded":"2024-04-18T21:06:16.607800+0000","last_fullsized":"2024-04-18T21:06:16.607800+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:26:38.636530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":60,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.609135+0000","last_change":"2024-04-18T21:05:04.628541+0000","last_active":"2024-04-18T21:06:16.609135+0000","last_peered":"2024-04-18T21:06:16.609135+0000","last_clean":"2024-04-18T21:06:16.609135+0000","last_became_active":"2024-04-18T21:05:04.627407+0000","last_became_peered":"2024-04-18T21:05:04.627407+0000","last_unstale":"2024-04-18T21:06:16.609135+0000","last_undegraded":"2024-04-18T21:06:16.609135+0000","last_fullsized":"2024-04-18T21:06:16.609135+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:55:48.643174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.607891+0000","last_change":"2024-04-18T21:05:05.651649+0000","last_active":"2024-04-18T21:06:16.607891+0000","last_peered":"2024-04-18T21:06:16.607891+0000","last_clean":"2024-04-18T21:06:16.607891+0000","last_became_active":"2024-04-18T21:05:05.646809+0000","last_became_peered":"2024-04-18T21:05:05.646809+0000","last_unstale":"2024-04-18T21:06:16.607891+0000","last_undegraded":"2024-04-18T21:06:16.607891+0000","last_fullsized":"2024-04-18T21:06:16.607891+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:23.698827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":59,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.612121+0000","last_change":"2024-04-18T21:05:04.634055+0000","last_active":"2024-04-18T21:06:16.612121+0000","last_peered":"2024-04-18T21:06:16.612121+0000","last_clean":"2024-04-18T21:06:16.612121+0000","last_became_active":"2024-04-18T21:05:04.630736+0000","last_became_peered":"2024-04-18T21:05:04.630736+0000","last_unstale":"2024-04-18T21:06:16.612121+0000","last_undegraded":"2024-04-18T21:06:16.612121+0000","last_fullsized":"2024-04-18T21:06:16.612121+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:06:44.001512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.611060+0000","last_change":"2024-04-18T21:05:05.628869+0000","last_active":"2024-04-18T21:06:16.611060+0000","last_peered":"2024-04-18T21:06:16.611060+0000","last_clean":"2024-04-18T21:06:16.611060+0000","last_became_active":"2024-04-18T21:05:05.627071+0000","last_became_peered":"2024-04-18T21:05:05.627071+0000","last_unstale":"2024-04-18T21:06:16.611060+0000","last_undegraded":"2024-04-18T21:06:16.611060+0000","last_fullsized":"2024-04-18T21:06:16.611060+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:31:31.842528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.611660+0000","last_change":"2024-04-18T21:05:04.625520+0000","last_active":"2024-04-18T21:06:16.611660+0000","last_peered":"2024-04-18T21:06:16.611660+0000","last_clean":"2024-04-18T21:06:16.611660+0000","last_became_active":"2024-04-18T21:05:04.624656+0000","last_became_peered":"2024-04-18T21:05:04.624656+0000","last_unstale":"2024-04-18T21:06:16.611660+0000","last_undegraded":"2024-04-18T21:06:16.611660+0000","last_fullsized":"2024-04-18T21:06:16.611660+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:56:05.795125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.734327+0000","last_change":"2024-04-18T21:05:05.649406+0000","last_active":"2024-04-18T21:06:16.734327+0000","last_peered":"2024-04-18T21:06:16.734327+0000","last_clean":"2024-04-18T21:06:16.734327+0000","last_became_active":"2024-04-18T21:05:05.648380+0000","last_became_peered":"2024-04-18T21:05:05.648380+0000","last_unstale":"2024-04-18T21:06:16.734327+0000","last_undegraded":"2024-04-18T21:06:16.734327+0000","last_fullsized":"2024-04-18T21:06:16.734327+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":60,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.732949+0000","last_change":"2024-04-18T21:05:04.640216+0000","last_active":"2024-04-18T21:06:16.732949+0000","last_peered":"2024-04-18T21:06:16.732949+0000","last_clean":"2024-04-18T21:06:16.732949+0000","last_became_active":"2024-04-18T21:05:04.639349+0000","last_became_peered":"2024-04-18T21:05:04.639349+0000","last_unstale":"2024-04-18T21:06:16.732949+0000","last_undegraded":"2024-04-18T21:06:16.732949+0000","last_fullsized":"2024-04-18T21:06:16.732949+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:09:18.466987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.611050+0000","last_change":"2024-04-18T21:05:05.628850+0000","last_active":"2024-04-18T21:06:16.611050+0000","last_peered":"2024-04-18T21:06:16.611050+0000","last_clean":"2024-04-18T21:06:16.611050+0000","last_became_active":"2024-04-18T21:05:05.627521+0000","last_became_peered":"2024-04-18T21:05:05.627521+0000","last_unstale":"2024-04-18T21:06:16.611050+0000","last_undegraded":"2024-04-18T21:06:16.611050+0000","last_fullsized":"2024-04-18T21:06:16.611050+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:14:37.912032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.611313+0000","last_change":"2024-04-18T21:05:04.634674+0000","last_active":"2024-04-18T21:06:16.611313+0000","last_peered":"2024-04-18T21:06:16.611313+0000","last_clean":"2024-04-18T21:06:16.611313+0000","last_became_active":"2024-04-18T21:05:04.632284+0000","last_became_peered":"2024-04-18T21:05:04.632284+0000","last_unstale":"2024-04-18T21:06:16.611313+0000","last_undegraded":"2024-04-18T21:06:16.611313+0000","last_fullsized":"2024-04-18T21:06:16.611313+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:09:18.466987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.611878+0000","last_change":"2024-04-18T21:05:05.647377+0000","last_active":"2024-04-18T21:06:16.611878+0000","last_peered":"2024-04-18T21:06:16.611878+0000","last_clean":"2024-04-18T21:06:16.611878+0000","last_became_active":"2024-04-18T21:05:05.645067+0000","last_became_peered":"2024-04-18T21:05:05.645067+0000","last_unstale":"2024-04-18T21:06:16.611878+0000","last_undegraded":"2024-04-18T21:06:16.611878+0000","last_fullsized":"2024-04-18T21:06:16.611878+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:29:30.243751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.608211+0000","last_change":"2024-04-18T21:05:04.627578+0000","last_active":"2024-04-18T21:06:16.608211+0000","last_peered":"2024-04-18T21:06:16.608211+0000","last_clean":"2024-04-18T21:06:16.608211+0000","last_became_active":"2024-04-18T21:05:04.626786+0000","last_became_peered":"2024-04-18T21:05:04.626786+0000","last_unstale":"2024-04-18T21:06:16.608211+0000","last_undegraded":"2024-04-18T21:06:16.608211+0000","last_fullsized":"2024-04-18T21:06:16.608211+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:55:59.563512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.611492+0000","last_change":"2024-04-18T21:05:05.640817+0000","last_active":"2024-04-18T21:06:16.611492+0000","last_peered":"2024-04-18T21:06:16.611492+0000","last_clean":"2024-04-18T21:06:16.611492+0000","last_became_active":"2024-04-18T21:05:05.635526+0000","last_became_peered":"2024-04-18T21:05:05.635526+0000","last_unstale":"2024-04-18T21:06:16.611492+0000","last_undegraded":"2024-04-18T21:06:16.611492+0000","last_fullsized":"2024-04-18T21:06:16.611492+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:44:29.823511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.607897+0000","last_change":"2024-04-18T21:05:04.636499+0000","last_active":"2024-04-18T21:06:16.607897+0000","last_peered":"2024-04-18T21:06:16.607897+0000","last_clean":"2024-04-18T21:06:16.607897+0000","last_became_active":"2024-04-18T21:05:04.635830+0000","last_became_peered":"2024-04-18T21:05:04.635830+0000","last_unstale":"2024-04-18T21:06:16.607897+0000","last_undegraded":"2024-04-18T21:06:16.607897+0000","last_fullsized":"2024-04-18T21:06:16.607897+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:26:30.565175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.735851+0000","last_change":"2024-04-18T21:05:05.660974+0000","last_active":"2024-04-18T21:06:16.735851+0000","last_peered":"2024-04-18T21:06:16.735851+0000","last_clean":"2024-04-18T21:06:16.735851+0000","last_became_active":"2024-04-18T21:05:05.659287+0000","last_became_peered":"2024-04-18T21:05:05.659287+0000","last_unstale":"2024-04-18T21:06:16.735851+0000","last_undegraded":"2024-04-18T21:06:16.735851+0000","last_fullsized":"2024-04-18T21:06:16.735851+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:50:40.920146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":266,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.610443+0000","last_change":"2024-04-18T21:04:54.511605+0000","last_active":"2024-04-18T21:06:16.610443+0000","last_peered":"2024-04-18T21:06:16.610443+0000","last_clean":"2024-04-18T21:06:16.610443+0000","last_became_active":"2024-04-18T21:04:54.510791+0000","last_became_peered":"2024-04-18T21:04:54.510791+0000","last_unstale":"2024-04-18T21:06:16.610443+0000","last_undegraded":"2024-04-18T21:06:16.610443+0000","last_fullsized":"2024-04-18T21:06:16.610443+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_clean_scrub_stamp":"2024-04-18T21:04:53.494814+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:46.262250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":64,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.611739+0000","last_change":"2024-04-18T21:05:00.576671+0000","last_active":"2024-04-18T21:06:16.611739+0000","last_peered":"2024-04-18T21:06:16.611739+0000","last_clean":"2024-04-18T21:06:16.611739+0000","last_became_active":"2024-04-18T21:05:00.575933+0000","last_became_peered":"2024-04-18T21:05:00.575933+0000","last_unstale":"2024-04-18T21:06:16.611739+0000","last_undegraded":"2024-04-18T21:06:16.611739+0000","last_fullsized":"2024-04-18T21:06:16.611739+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:14:59.207959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.607919+0000","last_change":"2024-04-18T21:06:01.034577+0000","last_active":"2024-04-18T21:06:16.607919+0000","last_peered":"2024-04-18T21:06:16.607919+0000","last_clean":"2024-04-18T21:06:16.607919+0000","last_became_active":"2024-04-18T21:06:01.033899+0000","last_became_peered":"2024-04-18T21:06:01.033899+0000","last_unstale":"2024-04-18T21:06:16.607919+0000","last_undegraded":"2024-04-18T21:06:16.607919+0000","last_fullsized":"2024-04-18T21:06:16.607919+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:13:40.375625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.611983+0000","last_change":"2024-04-18T21:05:05.647623+0000","last_active":"2024-04-18T21:06:16.611983+0000","last_peered":"2024-04-18T21:06:16.611983+0000","last_clean":"2024-04-18T21:06:16.611983+0000","last_became_active":"2024-04-18T21:05:05.645640+0000","last_became_peered":"2024-04-18T21:05:05.645640+0000","last_unstale":"2024-04-18T21:06:16.611983+0000","last_undegraded":"2024-04-18T21:06:16.611983+0000","last_fullsized":"2024-04-18T21:06:16.611983+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:59.950421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":64,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.610391+0000","last_change":"2024-04-18T21:05:00.571960+0000","last_active":"2024-04-18T21:06:16.610391+0000","last_peered":"2024-04-18T21:06:16.610391+0000","last_clean":"2024-04-18T21:06:16.610391+0000","last_became_active":"2024-04-18T21:05:00.571301+0000","last_became_peered":"2024-04-18T21:05:00.571301+0000","last_unstale":"2024-04-18T21:06:16.610391+0000","last_undegraded":"2024-04-18T21:06:16.610391+0000","last_fullsized":"2024-04-18T21:06:16.610391+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:31:59.262440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.609772+0000","last_change":"2024-04-18T21:06:01.033769+0000","last_active":"2024-04-18T21:06:16.609772+0000","last_peered":"2024-04-18T21:06:16.609772+0000","last_clean":"2024-04-18T21:06:16.609772+0000","last_became_active":"2024-04-18T21:06:01.033157+0000","last_became_peered":"2024-04-18T21:06:01.033157+0000","last_unstale":"2024-04-18T21:06:16.609772+0000","last_undegraded":"2024-04-18T21:06:16.609772+0000","last_fullsized":"2024-04-18T21:06:16.609772+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:42:40.133263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.609112+0000","last_change":"2024-04-18T21:05:05.654121+0000","last_active":"2024-04-18T21:06:16.609112+0000","last_peered":"2024-04-18T21:06:16.609112+0000","last_clean":"2024-04-18T21:06:16.609112+0000","last_became_active":"2024-04-18T21:05:05.651310+0000","last_became_peered":"2024-04-18T21:05:05.651310+0000","last_unstale":"2024-04-18T21:06:16.609112+0000","last_undegraded":"2024-04-18T21:06:16.609112+0000","last_fullsized":"2024-04-18T21:06:16.609112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:01.841786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":64,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.734721+0000","last_change":"2024-04-18T21:05:00.578604+0000","last_active":"2024-04-18T21:06:16.734721+0000","last_peered":"2024-04-18T21:06:16.734721+0000","last_clean":"2024-04-18T21:06:16.734721+0000","last_became_active":"2024-04-18T21:05:00.577988+0000","last_became_peered":"2024-04-18T21:05:00.577988+0000","last_unstale":"2024-04-18T21:06:16.734721+0000","last_undegraded":"2024-04-18T21:06:16.734721+0000","last_fullsized":"2024-04-18T21:06:16.734721+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:54:54.201759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.607994+0000","last_change":"2024-04-18T21:05:04.627627+0000","last_active":"2024-04-18T21:06:16.607994+0000","last_peered":"2024-04-18T21:06:16.607994+0000","last_clean":"2024-04-18T21:06:16.607994+0000","last_became_active":"2024-04-18T21:05:04.626850+0000","last_became_peered":"2024-04-18T21:05:04.626850+0000","last_unstale":"2024-04-18T21:06:16.607994+0000","last_undegraded":"2024-04-18T21:06:16.607994+0000","last_fullsized":"2024-04-18T21:06:16.607994+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:43:31.453080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.735861+0000","last_change":"2024-04-18T21:05:05.661488+0000","last_active":"2024-04-18T21:06:16.735861+0000","last_peered":"2024-04-18T21:06:16.735861+0000","last_clean":"2024-04-18T21:06:16.735861+0000","last_became_active":"2024-04-18T21:05:05.660283+0000","last_became_peered":"2024-04-18T21:05:05.660283+0000","last_unstale":"2024-04-18T21:06:16.735861+0000","last_undegraded":"2024-04-18T21:06:16.735861+0000","last_fullsized":"2024-04-18T21:06:16.735861+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:04.350492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":64,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.611554+0000","last_change":"2024-04-18T21:05:00.576606+0000","last_active":"2024-04-18T21:06:16.611554+0000","last_peered":"2024-04-18T21:06:16.611554+0000","last_clean":"2024-04-18T21:06:16.611554+0000","last_became_active":"2024-04-18T21:05:00.575951+0000","last_became_peered":"2024-04-18T21:05:00.575951+0000","last_unstale":"2024-04-18T21:06:16.611554+0000","last_undegraded":"2024-04-18T21:06:16.611554+0000","last_fullsized":"2024-04-18T21:06:16.611554+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:32:17.612481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.611514+0000","last_change":"2024-04-18T21:05:04.627296+0000","last_active":"2024-04-18T21:06:16.611514+0000","last_peered":"2024-04-18T21:06:16.611514+0000","last_clean":"2024-04-18T21:06:16.611514+0000","last_became_active":"2024-04-18T21:05:04.626801+0000","last_became_peered":"2024-04-18T21:05:04.626801+0000","last_unstale":"2024-04-18T21:06:16.611514+0000","last_undegraded":"2024-04-18T21:06:16.611514+0000","last_fullsized":"2024-04-18T21:06:16.611514+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:46:36.285416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.735303+0000","last_change":"2024-04-18T21:05:05.655152+0000","last_active":"2024-04-18T21:06:16.735303+0000","last_peered":"2024-04-18T21:06:16.735303+0000","last_clean":"2024-04-18T21:06:16.735303+0000","last_became_active":"2024-04-18T21:05:05.654506+0000","last_became_peered":"2024-04-18T21:05:05.654506+0000","last_unstale":"2024-04-18T21:06:16.735303+0000","last_undegraded":"2024-04-18T21:06:16.735303+0000","last_fullsized":"2024-04-18T21:06:16.735303+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:32:23.929877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.612215+0000","last_change":"2024-04-18T21:05:04.628916+0000","last_active":"2024-04-18T21:06:16.612215+0000","last_peered":"2024-04-18T21:06:16.612215+0000","last_clean":"2024-04-18T21:06:16.612215+0000","last_became_active":"2024-04-18T21:05:04.628245+0000","last_became_peered":"2024-04-18T21:05:04.628245+0000","last_unstale":"2024-04-18T21:06:16.612215+0000","last_undegraded":"2024-04-18T21:06:16.612215+0000","last_fullsized":"2024-04-18T21:06:16.612215+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:34:58.562540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.608864+0000","last_change":"2024-04-18T21:06:01.036156+0000","last_active":"2024-04-18T21:06:16.608864+0000","last_peered":"2024-04-18T21:06:16.608864+0000","last_clean":"2024-04-18T21:06:16.608864+0000","last_became_active":"2024-04-18T21:06:01.035478+0000","last_became_peered":"2024-04-18T21:06:01.035478+0000","last_unstale":"2024-04-18T21:06:16.608864+0000","last_undegraded":"2024-04-18T21:06:16.608864+0000","last_fullsized":"2024-04-18T21:06:16.608864+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:25:04.260649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.608110+0000","last_change":"2024-04-18T21:05:05.646076+0000","last_active":"2024-04-18T21:06:16.608110+0000","last_peered":"2024-04-18T21:06:16.608110+0000","last_clean":"2024-04-18T21:06:16.608110+0000","last_became_active":"2024-04-18T21:05:05.645104+0000","last_became_peered":"2024-04-18T21:05:05.645104+0000","last_unstale":"2024-04-18T21:06:16.608110+0000","last_undegraded":"2024-04-18T21:06:16.608110+0000","last_fullsized":"2024-04-18T21:06:16.608110+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:34:38.427319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.732993+0000","last_change":"2024-04-18T21:05:04.639700+0000","last_active":"2024-04-18T21:06:16.732993+0000","last_peered":"2024-04-18T21:06:16.732993+0000","last_clean":"2024-04-18T21:06:16.732993+0000","last_became_active":"2024-04-18T21:05:04.638928+0000","last_became_peered":"2024-04-18T21:05:04.638928+0000","last_unstale":"2024-04-18T21:06:16.732993+0000","last_undegraded":"2024-04-18T21:06:16.732993+0000","last_fullsized":"2024-04-18T21:06:16.732993+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:00:08.877854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":64,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.609019+0000","last_change":"2024-04-18T21:05:00.576907+0000","last_active":"2024-04-18T21:06:16.609019+0000","last_peered":"2024-04-18T21:06:16.609019+0000","last_clean":"2024-04-18T21:06:16.609019+0000","last_became_active":"2024-04-18T21:05:00.576152+0000","last_became_peered":"2024-04-18T21:05:00.576152+0000","last_unstale":"2024-04-18T21:06:16.609019+0000","last_undegraded":"2024-04-18T21:06:16.609019+0000","last_fullsized":"2024-04-18T21:06:16.609019+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:25:07.270023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.608460+0000","last_change":"2024-04-18T21:05:05.646026+0000","last_active":"2024-04-18T21:06:16.608460+0000","last_peered":"2024-04-18T21:06:16.608460+0000","last_clean":"2024-04-18T21:06:16.608460+0000","last_became_active":"2024-04-18T21:05:05.645192+0000","last_became_peered":"2024-04-18T21:05:05.645192+0000","last_unstale":"2024-04-18T21:06:16.608460+0000","last_undegraded":"2024-04-18T21:06:16.608460+0000","last_fullsized":"2024-04-18T21:06:16.608460+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:05:46.009381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":60,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.733265+0000","last_change":"2024-04-18T21:05:04.640732+0000","last_active":"2024-04-18T21:06:16.733265+0000","last_peered":"2024-04-18T21:06:16.733265+0000","last_clean":"2024-04-18T21:06:16.733265+0000","last_became_active":"2024-04-18T21:05:04.638505+0000","last_became_peered":"2024-04-18T21:05:04.638505+0000","last_unstale":"2024-04-18T21:06:16.733265+0000","last_undegraded":"2024-04-18T21:06:16.733265+0000","last_fullsized":"2024-04-18T21:06:16.733265+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:34:58.562540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.609351+0000","last_change":"2024-04-18T21:06:01.036362+0000","last_active":"2024-04-18T21:06:16.609351+0000","last_peered":"2024-04-18T21:06:16.609351+0000","last_clean":"2024-04-18T21:06:16.609351+0000","last_became_active":"2024-04-18T21:06:01.035483+0000","last_became_peered":"2024-04-18T21:06:01.035483+0000","last_unstale":"2024-04-18T21:06:16.609351+0000","last_undegraded":"2024-04-18T21:06:16.609351+0000","last_fullsized":"2024-04-18T21:06:16.609351+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:42:36.106273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":25,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.609353+0000","last_change":"2024-04-18T21:06:01.032606+0000","last_active":"2024-04-18T21:06:16.609353+0000","last_peered":"2024-04-18T21:06:16.609353+0000","last_clean":"2024-04-18T21:06:16.609353+0000","last_became_active":"2024-04-18T21:06:01.032092+0000","last_became_peered":"2024-04-18T21:06:01.032092+0000","last_unstale":"2024-04-18T21:06:16.609353+0000","last_undegraded":"2024-04-18T21:06:16.609353+0000","last_fullsized":"2024-04-18T21:06:16.609353+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:14:08.347445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"21'3","reported_seq":61,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.733090+0000","last_change":"2024-04-18T21:05:04.639898+0000","last_active":"2024-04-18T21:06:16.733090+0000","last_peered":"2024-04-18T21:06:16.733090+0000","last_clean":"2024-04-18T21:06:16.733090+0000","last_became_active":"2024-04-18T21:05:04.639115+0000","last_became_peered":"2024-04-18T21:05:04.639115+0000","last_unstale":"2024-04-18T21:06:16.733090+0000","last_undegraded":"2024-04-18T21:06:16.733090+0000","last_fullsized":"2024-04-18T21:06:16.733090+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:44:19.076499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":64,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.611974+0000","last_change":"2024-04-18T21:05:00.572414+0000","last_active":"2024-04-18T21:06:16.611974+0000","last_peered":"2024-04-18T21:06:16.611974+0000","last_clean":"2024-04-18T21:06:16.611974+0000","last_became_active":"2024-04-18T21:05:00.571755+0000","last_became_peered":"2024-04-18T21:05:00.571755+0000","last_unstale":"2024-04-18T21:06:16.611974+0000","last_undegraded":"2024-04-18T21:06:16.611974+0000","last_fullsized":"2024-04-18T21:06:16.611974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:15:02.061128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.608004+0000","last_change":"2024-04-18T21:05:05.655898+0000","last_active":"2024-04-18T21:06:16.608004+0000","last_peered":"2024-04-18T21:06:16.608004+0000","last_clean":"2024-04-18T21:06:16.608004+0000","last_became_active":"2024-04-18T21:05:05.654111+0000","last_became_peered":"2024-04-18T21:05:05.654111+0000","last_unstale":"2024-04-18T21:06:16.608004+0000","last_undegraded":"2024-04-18T21:06:16.608004+0000","last_fullsized":"2024-04-18T21:06:16.608004+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:19:38.537080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.610999+0000","last_change":"2024-04-18T21:05:05.641373+0000","last_active":"2024-04-18T21:06:16.610999+0000","last_peered":"2024-04-18T21:06:16.610999+0000","last_clean":"2024-04-18T21:06:16.610999+0000","last_became_active":"2024-04-18T21:05:05.634204+0000","last_became_peered":"2024-04-18T21:05:05.634204+0000","last_unstale":"2024-04-18T21:06:16.610999+0000","last_undegraded":"2024-04-18T21:06:16.610999+0000","last_fullsized":"2024-04-18T21:06:16.610999+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:27:35.995004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"21'10","reported_seq":68,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.611409+0000","last_change":"2024-04-18T21:05:04.631271+0000","last_active":"2024-04-18T21:06:16.611409+0000","last_peered":"2024-04-18T21:06:16.611409+0000","last_clean":"2024-04-18T21:06:16.611409+0000","last_became_active":"2024-04-18T21:05:04.630442+0000","last_became_peered":"2024-04-18T21:05:04.630442+0000","last_unstale":"2024-04-18T21:06:16.611409+0000","last_undegraded":"2024-04-18T21:06:16.611409+0000","last_fullsized":"2024-04-18T21:06:16.611409+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:33:48.703994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.734543+0000","last_change":"2024-04-18T21:05:05.637894+0000","last_active":"2024-04-18T21:06:16.734543+0000","last_peered":"2024-04-18T21:06:16.734543+0000","last_clean":"2024-04-18T21:06:16.734543+0000","last_became_active":"2024-04-18T21:05:05.636846+0000","last_became_peered":"2024-04-18T21:05:05.636846+0000","last_unstale":"2024-04-18T21:06:16.734543+0000","last_undegraded":"2024-04-18T21:06:16.734543+0000","last_fullsized":"2024-04-18T21:06:16.734543+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:34:31.132458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":61,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.608964+0000","last_change":"2024-04-18T21:05:04.631152+0000","last_active":"2024-04-18T21:06:16.608964+0000","last_peered":"2024-04-18T21:06:16.608964+0000","last_clean":"2024-04-18T21:06:16.608964+0000","last_became_active":"2024-04-18T21:05:04.628900+0000","last_became_peered":"2024-04-18T21:05:04.628900+0000","last_unstale":"2024-04-18T21:06:16.608964+0000","last_undegraded":"2024-04-18T21:06:16.608964+0000","last_fullsized":"2024-04-18T21:06:16.608964+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:40:21.452052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.611747+0000","last_change":"2024-04-18T21:05:04.629470+0000","last_active":"2024-04-18T21:06:16.611747+0000","last_peered":"2024-04-18T21:06:16.611747+0000","last_clean":"2024-04-18T21:06:16.611747+0000","last_became_active":"2024-04-18T21:05:04.628286+0000","last_became_peered":"2024-04-18T21:05:04.628286+0000","last_unstale":"2024-04-18T21:06:16.611747+0000","last_undegraded":"2024-04-18T21:06:16.611747+0000","last_fullsized":"2024-04-18T21:06:16.611747+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:00:08.877854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.734102+0000","last_change":"2024-04-18T21:05:05.642793+0000","last_active":"2024-04-18T21:06:16.734102+0000","last_peered":"2024-04-18T21:06:16.734102+0000","last_clean":"2024-04-18T21:06:16.734102+0000","last_became_active":"2024-04-18T21:05:05.641983+0000","last_became_peered":"2024-04-18T21:05:05.641983+0000","last_unstale":"2024-04-18T21:06:16.734102+0000","last_undegraded":"2024-04-18T21:06:16.734102+0000","last_fullsized":"2024-04-18T21:06:16.734102+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:46:36.339289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.733659+0000","last_change":"2024-04-18T21:05:04.641445+0000","last_active":"2024-04-18T21:06:16.733659+0000","last_peered":"2024-04-18T21:06:16.733659+0000","last_clean":"2024-04-18T21:06:16.733659+0000","last_became_active":"2024-04-18T21:05:04.640682+0000","last_became_peered":"2024-04-18T21:05:04.640682+0000","last_unstale":"2024-04-18T21:06:16.733659+0000","last_undegraded":"2024-04-18T21:06:16.733659+0000","last_fullsized":"2024-04-18T21:06:16.733659+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:46:36.285416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.734261+0000","last_change":"2024-04-18T21:05:05.641561+0000","last_active":"2024-04-18T21:06:16.734261+0000","last_peered":"2024-04-18T21:06:16.734261+0000","last_clean":"2024-04-18T21:06:16.734261+0000","last_became_active":"2024-04-18T21:05:05.640922+0000","last_became_peered":"2024-04-18T21:05:05.640922+0000","last_unstale":"2024-04-18T21:06:16.734261+0000","last_undegraded":"2024-04-18T21:06:16.734261+0000","last_fullsized":"2024-04-18T21:06:16.734261+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:56.408234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.609149+0000","last_change":"2024-04-18T21:05:05.651530+0000","last_active":"2024-04-18T21:06:16.609149+0000","last_peered":"2024-04-18T21:06:16.609149+0000","last_clean":"2024-04-18T21:06:16.609149+0000","last_became_active":"2024-04-18T21:05:05.648167+0000","last_became_peered":"2024-04-18T21:05:05.648167+0000","last_unstale":"2024-04-18T21:06:16.609149+0000","last_undegraded":"2024-04-18T21:06:16.609149+0000","last_fullsized":"2024-04-18T21:06:16.609149+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:14:51.873741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.608163+0000","last_change":"2024-04-18T21:06:01.033325+0000","last_active":"2024-04-18T21:06:16.608163+0000","last_peered":"2024-04-18T21:06:16.608163+0000","last_clean":"2024-04-18T21:06:16.608163+0000","last_became_active":"2024-04-18T21:06:01.032763+0000","last_became_peered":"2024-04-18T21:06:01.032763+0000","last_unstale":"2024-04-18T21:06:16.608163+0000","last_undegraded":"2024-04-18T21:06:16.608163+0000","last_fullsized":"2024-04-18T21:06:16.608163+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:46:21.038602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":25,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.611231+0000","last_change":"2024-04-18T21:06:01.034762+0000","last_active":"2024-04-18T21:06:16.611231+0000","last_peered":"2024-04-18T21:06:16.611231+0000","last_clean":"2024-04-18T21:06:16.611231+0000","last_became_active":"2024-04-18T21:06:01.033874+0000","last_became_peered":"2024-04-18T21:06:01.033874+0000","last_unstale":"2024-04-18T21:06:16.611231+0000","last_undegraded":"2024-04-18T21:06:16.611231+0000","last_fullsized":"2024-04-18T21:06:16.611231+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:36:21.285460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.732876+0000","last_change":"2024-04-18T21:05:04.637597+0000","last_active":"2024-04-18T21:06:16.732876+0000","last_peered":"2024-04-18T21:06:16.732876+0000","last_clean":"2024-04-18T21:06:16.732876+0000","last_became_active":"2024-04-18T21:05:04.636827+0000","last_became_peered":"2024-04-18T21:05:04.636827+0000","last_unstale":"2024-04-18T21:06:16.732876+0000","last_undegraded":"2024-04-18T21:06:16.732876+0000","last_fullsized":"2024-04-18T21:06:16.732876+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:43.511952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.608739+0000","last_change":"2024-04-18T21:05:05.658971+0000","last_active":"2024-04-18T21:06:16.608739+0000","last_peered":"2024-04-18T21:06:16.608739+0000","last_clean":"2024-04-18T21:06:16.608739+0000","last_became_active":"2024-04-18T21:05:05.658363+0000","last_became_peered":"2024-04-18T21:05:05.658363+0000","last_unstale":"2024-04-18T21:06:16.608739+0000","last_undegraded":"2024-04-18T21:06:16.608739+0000","last_fullsized":"2024-04-18T21:06:16.608739+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:12.944469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":59,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.608451+0000","last_change":"2024-04-18T21:05:04.636585+0000","last_active":"2024-04-18T21:06:16.608451+0000","last_peered":"2024-04-18T21:06:16.608451+0000","last_clean":"2024-04-18T21:06:16.608451+0000","last_became_active":"2024-04-18T21:05:04.635670+0000","last_became_peered":"2024-04-18T21:05:04.635670+0000","last_unstale":"2024-04-18T21:06:16.608451+0000","last_undegraded":"2024-04-18T21:06:16.608451+0000","last_fullsized":"2024-04-18T21:06:16.608451+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:34:33.779063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.608517+0000","last_change":"2024-04-18T21:05:05.649960+0000","last_active":"2024-04-18T21:06:16.608517+0000","last_peered":"2024-04-18T21:06:16.608517+0000","last_clean":"2024-04-18T21:06:16.608517+0000","last_became_active":"2024-04-18T21:05:05.648528+0000","last_became_peered":"2024-04-18T21:05:05.648528+0000","last_unstale":"2024-04-18T21:06:16.608517+0000","last_undegraded":"2024-04-18T21:06:16.608517+0000","last_fullsized":"2024-04-18T21:06:16.608517+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:20:45.938503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":59,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.608644+0000","last_change":"2024-04-18T21:05:04.630151+0000","last_active":"2024-04-18T21:06:16.608644+0000","last_peered":"2024-04-18T21:06:16.608644+0000","last_clean":"2024-04-18T21:06:16.608644+0000","last_became_active":"2024-04-18T21:05:04.627968+0000","last_became_peered":"2024-04-18T21:05:04.627968+0000","last_unstale":"2024-04-18T21:06:16.608644+0000","last_undegraded":"2024-04-18T21:06:16.608644+0000","last_fullsized":"2024-04-18T21:06:16.608644+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:00:33.393636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.610719+0000","last_change":"2024-04-18T21:05:05.624840+0000","last_active":"2024-04-18T21:06:16.610719+0000","last_peered":"2024-04-18T21:06:16.610719+0000","last_clean":"2024-04-18T21:06:16.610719+0000","last_became_active":"2024-04-18T21:05:05.622950+0000","last_became_peered":"2024-04-18T21:05:05.622950+0000","last_unstale":"2024-04-18T21:06:16.610719+0000","last_undegraded":"2024-04-18T21:06:16.610719+0000","last_fullsized":"2024-04-18T21:06:16.610719+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:27:17.530889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":60,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.611137+0000","last_change":"2024-04-18T21:05:04.626715+0000","last_active":"2024-04-18T21:06:16.611137+0000","last_peered":"2024-04-18T21:06:16.611137+0000","last_clean":"2024-04-18T21:06:16.611137+0000","last_became_active":"2024-04-18T21:05:04.625270+0000","last_became_peered":"2024-04-18T21:05:04.625270+0000","last_unstale":"2024-04-18T21:06:16.611137+0000","last_undegraded":"2024-04-18T21:06:16.611137+0000","last_fullsized":"2024-04-18T21:06:16.611137+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:43.511952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.611811+0000","last_change":"2024-04-18T21:05:05.627962+0000","last_active":"2024-04-18T21:06:16.611811+0000","last_peered":"2024-04-18T21:06:16.611811+0000","last_clean":"2024-04-18T21:06:16.611811+0000","last_became_active":"2024-04-18T21:05:05.626698+0000","last_became_peered":"2024-04-18T21:05:05.626698+0000","last_unstale":"2024-04-18T21:06:16.611811+0000","last_undegraded":"2024-04-18T21:06:16.611811+0000","last_fullsized":"2024-04-18T21:06:16.611811+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:48:48.973087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":60,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.608844+0000","last_change":"2024-04-18T21:05:04.632776+0000","last_active":"2024-04-18T21:06:16.608844+0000","last_peered":"2024-04-18T21:06:16.608844+0000","last_clean":"2024-04-18T21:06:16.608844+0000","last_became_active":"2024-04-18T21:05:04.630142+0000","last_became_peered":"2024-04-18T21:05:04.630142+0000","last_unstale":"2024-04-18T21:06:16.608844+0000","last_undegraded":"2024-04-18T21:06:16.608844+0000","last_fullsized":"2024-04-18T21:06:16.608844+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:19:36.721897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.608375+0000","last_change":"2024-04-18T21:05:05.653025+0000","last_active":"2024-04-18T21:06:16.608375+0000","last_peered":"2024-04-18T21:06:16.608375+0000","last_clean":"2024-04-18T21:06:16.608375+0000","last_became_active":"2024-04-18T21:05:05.645039+0000","last_became_peered":"2024-04-18T21:05:05.645039+0000","last_unstale":"2024-04-18T21:06:16.608375+0000","last_undegraded":"2024-04-18T21:06:16.608375+0000","last_fullsized":"2024-04-18T21:06:16.608375+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":59,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.733421+0000","last_change":"2024-04-18T21:05:04.640134+0000","last_active":"2024-04-18T21:06:16.733421+0000","last_peered":"2024-04-18T21:06:16.733421+0000","last_clean":"2024-04-18T21:06:16.733421+0000","last_became_active":"2024-04-18T21:05:04.638597+0000","last_became_peered":"2024-04-18T21:05:04.638597+0000","last_unstale":"2024-04-18T21:06:16.733421+0000","last_undegraded":"2024-04-18T21:06:16.733421+0000","last_fullsized":"2024-04-18T21:06:16.733421+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:56:05.795125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.610145+0000","last_change":"2024-04-18T21:05:05.629022+0000","last_active":"2024-04-18T21:06:16.610145+0000","last_peered":"2024-04-18T21:06:16.610145+0000","last_clean":"2024-04-18T21:06:16.610145+0000","last_became_active":"2024-04-18T21:05:05.627643+0000","last_became_peered":"2024-04-18T21:05:05.627643+0000","last_unstale":"2024-04-18T21:06:16.610145+0000","last_undegraded":"2024-04-18T21:06:16.610145+0000","last_fullsized":"2024-04-18T21:06:16.610145+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:32:23.929877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":62,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T21:06:16.733957+0000","last_change":"2024-04-18T21:05:04.641338+0000","last_active":"2024-04-18T21:06:16.733957+0000","last_peered":"2024-04-18T21:06:16.733957+0000","last_clean":"2024-04-18T21:06:16.733957+0000","last_became_active":"2024-04-18T21:05:04.639958+0000","last_became_peered":"2024-04-18T21:05:04.639958+0000","last_unstale":"2024-04-18T21:06:16.733957+0000","last_undegraded":"2024-04-18T21:06:16.733957+0000","last_fullsized":"2024-04-18T21:06:16.733957+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:42:45.392908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7351,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738389,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35676,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336164,"statfs":{"total":96636764160,"available":96600231936,"internally_reserved":0,"allocated":344064,"data_stored":148524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738389,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32116,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":958464,"data_stored":745011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738387,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":966656,"data_stored":745627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:06:18.800 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:18.799+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:18.894 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:18.894 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-18T21:06:18.894 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-18T21:06:18.894 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:06:18.894 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.895 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:18.895 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:06:18.895 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 73.278562352999998, 2024-04-18T21:06:18.895 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.034065303999999998, 2024-04-18T21:06:18.895 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:18.895 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:18.895 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:18.895 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:18.895 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.895 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:18.895 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:06:18.895 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:18.895 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.895 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.895 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:18.896 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:06:18.896 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:18.896 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.896 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.896 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:18.896 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615254+0000", 2024-04-18T21:06:18.896 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7829999999999999e-06 2024-04-18T21:06:18.896 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.896 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.896 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:18.896 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615267+0000", 2024-04-18T21:06:18.896 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3334e-05 2024-04-18T21:06:18.896 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.896 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.896 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:18.896 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615294+0000", 2024-04-18T21:06:18.897 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7271999999999999e-05 2024-04-18T21:06:18.897 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.897 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.897 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:18.897 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615321+0000", 2024-04-18T21:06:18.897 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.637e-05 2024-04-18T21:06:18.897 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.897 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.897 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:18.897 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615479+0000", 2024-04-18T21:06:18.897 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000158493 2024-04-18T21:06:18.897 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.897 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.897 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:18.897 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615498+0000", 2024-04-18T21:06:18.897 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9148999999999999e-05 2024-04-18T21:06:18.898 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.898 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.898 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:18.898 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632915+0000", 2024-04-18T21:06:18.898 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.017416551999999998 2024-04-18T21:06:18.898 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.898 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.898 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:18.898 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633302+0000", 2024-04-18T21:06:18.898 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00038725000000000001 2024-04-18T21:06:18.898 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.898 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.898 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:18.899 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633638+0000", 2024-04-18T21:06:18.899 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000335946 2024-04-18T21:06:18.899 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.899 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.899 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:18.899 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645976+0000", 2024-04-18T21:06:18.899 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012337617 2024-04-18T21:06:18.899 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.899 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.899 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:18.899 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649080+0000", 2024-04-18T21:06:18.899 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031038929999999999 2024-04-18T21:06:18.899 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.899 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.899 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:18.899 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649207+0000", 2024-04-18T21:06:18.900 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000127537 2024-04-18T21:06:18.900 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.900 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.900 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:18.900 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649316+0000", 2024-04-18T21:06:18.900 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109108 2024-04-18T21:06:18.900 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:18.900 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:18.900 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:18.900 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.900 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.900 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:18.900 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:06:18.900 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 73.278428976000001, 2024-04-18T21:06:18.900 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036275764000000002, 2024-04-18T21:06:18.900 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:18.900 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:18.901 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:18.901 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:18.901 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.901 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:18.901 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:06:18.901 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:18.901 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.901 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.901 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:18.901 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:06:18.901 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:18.901 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.901 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.901 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:18.901 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615386+0000", 2024-04-18T21:06:18.901 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.573e-06 2024-04-18T21:06:18.902 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.902 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.902 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:18.902 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:06:18.902 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0723999999999999e-05 2024-04-18T21:06:18.902 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.902 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.902 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:18.902 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615418+0000", 2024-04-18T21:06:18.902 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0902000000000001e-05 2024-04-18T21:06:18.902 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.902 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.902 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:18.902 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615433+0000", 2024-04-18T21:06:18.902 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5319999999999999e-05 2024-04-18T21:06:18.902 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.903 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.903 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:18.903 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615659+0000", 2024-04-18T21:06:18.903 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000226095 2024-04-18T21:06:18.903 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.903 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.903 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:18.903 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:18.903 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1276e-05 2024-04-18T21:06:18.903 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.903 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.903 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:18.903 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643654+0000", 2024-04-18T21:06:18.903 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027983238000000001 2024-04-18T21:06:18.903 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.903 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.904 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:18.904 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643868+0000", 2024-04-18T21:06:18.904 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000214305 2024-04-18T21:06:18.904 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.904 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.904 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:18.904 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:06:18.904 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035892200000000002 2024-04-18T21:06:18.904 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.904 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.904 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:18.904 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646056+0000", 2024-04-18T21:06:18.904 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001829172 2024-04-18T21:06:18.904 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.904 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.904 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:18.905 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651406+0000", 2024-04-18T21:06:18.905 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0053504800000000003 2024-04-18T21:06:18.905 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.905 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.905 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:18.905 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651551+0000", 2024-04-18T21:06:18.905 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014427999999999999 2024-04-18T21:06:18.905 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.905 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.905 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:18.905 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651660+0000", 2024-04-18T21:06:18.905 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109477 2024-04-18T21:06:18.905 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:18.905 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:18.905 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:18.905 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.905 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.906 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:18.906 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:18.906 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 73.278355594000004, 2024-04-18T21:06:18.906 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045668994999999997, 2024-04-18T21:06:18.906 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:18.906 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:18.906 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:18.906 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:18.906 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.906 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:18.906 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:18.906 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:18.906 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.906 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.906 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:18.906 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:18.907 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:18.907 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.907 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.907 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:18.907 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615459+0000", 2024-04-18T21:06:18.907 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5030000000000001e-06 2024-04-18T21:06:18.907 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.907 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.907 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:18.907 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615506+0000", 2024-04-18T21:06:18.907 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6872000000000001e-05 2024-04-18T21:06:18.907 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.907 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.907 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:18.907 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615527+0000", 2024-04-18T21:06:18.907 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0763000000000001e-05 2024-04-18T21:06:18.908 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.908 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.908 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:18.908 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615551+0000", 2024-04-18T21:06:18.908 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4159e-05 2024-04-18T21:06:18.908 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.908 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.908 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:18.908 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615736+0000", 2024-04-18T21:06:18.908 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018499599999999999 2024-04-18T21:06:18.908 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.908 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.908 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:18.908 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615748+0000", 2024-04-18T21:06:18.908 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2272999999999999e-05 2024-04-18T21:06:18.908 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.909 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.909 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:18.909 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635481+0000", 2024-04-18T21:06:18.909 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019732772999999999 2024-04-18T21:06:18.909 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.909 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.909 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:18.909 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635791+0000", 2024-04-18T21:06:18.909 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031013299999999998 2024-04-18T21:06:18.909 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.909 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.909 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:18.909 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636101+0000", 2024-04-18T21:06:18.909 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030943300000000002 2024-04-18T21:06:18.909 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.909 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.910 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:18.910 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646043+0000", 2024-04-18T21:06:18.910 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099428139999999995 2024-04-18T21:06:18.910 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.910 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.910 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:18.910 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660991+0000", 2024-04-18T21:06:18.910 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014947142 2024-04-18T21:06:18.910 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.910 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.910 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:18.910 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661061+0000", 2024-04-18T21:06:18.910 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0438000000000006e-05 2024-04-18T21:06:18.910 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.910 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.911 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:18.911 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661127+0000", 2024-04-18T21:06:18.911 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5696000000000003e-05 2024-04-18T21:06:18.911 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:18.911 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:18.911 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:18.911 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.911 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.911 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:18.911 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:18.911 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 73.278143166000007, 2024-04-18T21:06:18.911 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045745085999999997, 2024-04-18T21:06:18.911 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:18.911 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:18.911 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:18.911 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:18.911 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.912 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:18.912 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:18.912 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:18.912 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.912 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.912 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:18.912 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:18.912 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:18.912 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.912 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.912 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:18.912 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:06:18.912 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7400000000000001e-06 2024-04-18T21:06:18.912 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.912 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.912 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:18.913 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:06:18.913 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8133e-05 2024-04-18T21:06:18.913 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.913 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.913 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:18.913 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615726+0000", 2024-04-18T21:06:18.913 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6132e-05 2024-04-18T21:06:18.913 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.913 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.913 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:18.913 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615742+0000", 2024-04-18T21:06:18.913 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6157000000000001e-05 2024-04-18T21:06:18.913 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.913 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.913 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:18.913 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615937+0000", 2024-04-18T21:06:18.913 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000194768 2024-04-18T21:06:18.914 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.914 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.914 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:18.914 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615950+0000", 2024-04-18T21:06:18.914 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3084e-05 2024-04-18T21:06:18.914 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.914 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.914 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:18.914 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643676+0000", 2024-04-18T21:06:18.914 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027725639999999999 2024-04-18T21:06:18.914 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.914 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.914 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:18.914 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643867+0000", 2024-04-18T21:06:18.914 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019075900000000001 2024-04-18T21:06:18.914 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.915 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.915 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:18.915 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:06:18.915 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036013799999999997 2024-04-18T21:06:18.915 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.915 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.915 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:18.915 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646068+0000", 2024-04-18T21:06:18.915 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001841536 2024-04-18T21:06:18.915 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.915 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.915 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:18.915 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661184+0000", 2024-04-18T21:06:18.915 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015115458999999999 2024-04-18T21:06:18.915 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.915 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.916 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:18.916 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661283+0000", 2024-04-18T21:06:18.916 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9502999999999999e-05 2024-04-18T21:06:18.916 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.916 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.916 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:18.916 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661415+0000", 2024-04-18T21:06:18.916 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000132037 2024-04-18T21:06:18.916 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:18.916 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:18.916 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:18.916 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.916 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.916 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:18.916 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:06:18.916 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 73.278021479000003, 2024-04-18T21:06:18.917 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036185947000000003, 2024-04-18T21:06:18.917 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:18.917 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:18.917 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:18.917 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:18.917 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.917 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:18.917 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:06:18.917 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:18.917 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.917 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.917 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:18.917 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:06:18.917 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:18.917 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.918 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.918 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:18.918 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615794+0000", 2024-04-18T21:06:18.918 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6440000000000001e-06 2024-04-18T21:06:18.918 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.918 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.918 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:18.918 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615803+0000", 2024-04-18T21:06:18.918 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1220000000000001e-06 2024-04-18T21:06:18.918 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.918 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.918 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:18.918 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615827+0000", 2024-04-18T21:06:18.918 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3997000000000001e-05 2024-04-18T21:06:18.918 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.918 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.919 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:18.919 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615899+0000", 2024-04-18T21:06:18.919 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2741e-05 2024-04-18T21:06:18.919 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.919 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.919 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:18.919 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616019+0000", 2024-04-18T21:06:18.919 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119874 2024-04-18T21:06:18.919 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.919 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.919 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:18.919 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616029+0000", 2024-04-18T21:06:18.919 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:06:18.919 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.919 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.919 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:18.920 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644823+0000", 2024-04-18T21:06:18.920 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.028793151999999999 2024-04-18T21:06:18.920 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.920 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.920 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:18.920 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645106+0000", 2024-04-18T21:06:18.920 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028379700000000002 2024-04-18T21:06:18.920 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.920 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.920 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:18.920 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645294+0000", 2024-04-18T21:06:18.920 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000187181 2024-04-18T21:06:18.920 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.920 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.920 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:18.920 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646763+0000", 2024-04-18T21:06:18.920 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0014691050000000001 2024-04-18T21:06:18.921 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.921 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.921 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:18.921 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651784+0000", 2024-04-18T21:06:18.921 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050211650000000002 2024-04-18T21:06:18.921 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.921 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.921 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:18.921 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651876+0000", 2024-04-18T21:06:18.921 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2503999999999994e-05 2024-04-18T21:06:18.921 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.921 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.921 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:18.921 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651978+0000", 2024-04-18T21:06:18.921 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000101475 2024-04-18T21:06:18.921 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:18.922 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:18.922 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:18.922 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.922 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.922 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:18.922 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:18.922 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 73.277872872000003, 2024-04-18T21:06:18.922 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032262322000000003, 2024-04-18T21:06:18.922 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:18.922 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:18.922 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:18.922 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:18.922 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.922 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:18.923 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:18.923 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:18.923 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.923 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.923 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:18.923 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:18.923 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:18.923 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.923 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.923 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:18.923 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615943+0000", 2024-04-18T21:06:18.923 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1959999999999998e-06 2024-04-18T21:06:18.923 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.923 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.923 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:18.924 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615956+0000", 2024-04-18T21:06:18.924 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3424000000000001e-05 2024-04-18T21:06:18.924 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.924 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.924 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:18.924 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615983+0000", 2024-04-18T21:06:18.924 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7072000000000001e-05 2024-04-18T21:06:18.924 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.924 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.924 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:18.924 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616006+0000", 2024-04-18T21:06:18.924 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2823000000000002e-05 2024-04-18T21:06:18.924 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.924 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.924 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:18.925 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616156+0000", 2024-04-18T21:06:18.925 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014962299999999999 2024-04-18T21:06:18.925 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.925 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.925 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:18.925 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616174+0000", 2024-04-18T21:06:18.925 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8082999999999999e-05 2024-04-18T21:06:18.925 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.925 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.925 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:18.925 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.629952+0000", 2024-04-18T21:06:18.925 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013778514 2024-04-18T21:06:18.925 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.925 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.925 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:18.926 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630201+0000", 2024-04-18T21:06:18.926 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024918100000000001 2024-04-18T21:06:18.926 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.926 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.926 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:18.926 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630386+0000", 2024-04-18T21:06:18.926 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018436900000000001 2024-04-18T21:06:18.926 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.926 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.926 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:18.926 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643169+0000", 2024-04-18T21:06:18.926 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012782774 2024-04-18T21:06:18.926 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.926 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.927 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:18.927 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.647924+0000", 2024-04-18T21:06:18.927 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004755787 2024-04-18T21:06:18.927 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.927 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.927 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:18.927 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648069+0000", 2024-04-18T21:06:18.927 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014459600000000001 2024-04-18T21:06:18.927 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.927 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.927 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:18.927 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648203+0000", 2024-04-18T21:06:18.927 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013388000000000001 2024-04-18T21:06:18.927 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:18.927 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:18.928 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:18.928 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.928 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.928 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:18.928 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:06:18.928 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 73.277764607999998, 2024-04-18T21:06:18.928 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032489736999999998, 2024-04-18T21:06:18.928 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:18.928 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:18.928 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:18.928 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:18.928 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.928 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:18.928 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:06:18.928 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:18.928 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.929 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.929 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:18.929 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:06:18.929 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:18.929 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.929 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.929 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:18.929 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616050+0000", 2024-04-18T21:06:18.929 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.606e-06 2024-04-18T21:06:18.929 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.929 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.929 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:18.929 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616061+0000", 2024-04-18T21:06:18.929 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0463e-05 2024-04-18T21:06:18.929 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.930 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.930 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:18.930 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616092+0000", 2024-04-18T21:06:18.930 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1415999999999999e-05 2024-04-18T21:06:18.930 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.930 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.930 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:18.930 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616109+0000", 2024-04-18T21:06:18.930 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6557000000000001e-05 2024-04-18T21:06:18.930 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.930 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.930 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:18.930 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616358+0000", 2024-04-18T21:06:18.930 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000249077 2024-04-18T21:06:18.930 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.931 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.931 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:18.931 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616370+0000", 2024-04-18T21:06:18.931 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2037e-05 2024-04-18T21:06:18.931 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.931 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.931 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:18.931 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.634920+0000", 2024-04-18T21:06:18.931 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018550397 2024-04-18T21:06:18.931 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.931 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.931 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:18.931 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640420+0000", 2024-04-18T21:06:18.931 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055000539999999999 2024-04-18T21:06:18.931 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.931 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.932 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:18.932 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648538+0000", 2024-04-18T21:06:18.932 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0081181299999999994 2024-04-18T21:06:18.932 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:18.932 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:18.932 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:18.932 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.932 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.932 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:18.932 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:06:18.932 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 73.277680286999995, 2024-04-18T21:06:18.932 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036090029000000003, 2024-04-18T21:06:18.932 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:18.932 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:18.932 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:18.932 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:18.933 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.933 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:18.933 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:06:18.933 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:18.933 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.933 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.933 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:18.933 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:06:18.933 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:18.933 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.933 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.933 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:18.933 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616134+0000", 2024-04-18T21:06:18.933 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.353e-06 2024-04-18T21:06:18.934 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.934 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.934 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:18.934 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616141+0000", 2024-04-18T21:06:18.934 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2770000000000002e-06 2024-04-18T21:06:18.934 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.934 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.934 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:18.934 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616160+0000", 2024-04-18T21:06:18.934 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.91e-05 2024-04-18T21:06:18.934 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.934 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.934 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:18.934 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616170+0000", 2024-04-18T21:06:18.934 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7699999999999996e-06 2024-04-18T21:06:18.935 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.935 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.935 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:18.935 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616275+0000", 2024-04-18T21:06:18.935 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105313 2024-04-18T21:06:18.935 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.935 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.935 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:18.935 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616288+0000", 2024-04-18T21:06:18.935 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3027000000000001e-05 2024-04-18T21:06:18.935 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.935 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.935 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:18.935 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646160+0000", 2024-04-18T21:06:18.936 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.029872019 2024-04-18T21:06:18.936 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.936 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.936 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:18.936 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646368+0000", 2024-04-18T21:06:18.936 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020811899999999999 2024-04-18T21:06:18.936 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.936 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.936 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:18.936 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652223+0000", 2024-04-18T21:06:18.936 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.005855051 2024-04-18T21:06:18.936 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:18.936 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:18.936 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:18.936 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.937 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.937 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:18.937 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:18.937 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 73.277622718000003, 2024-04-18T21:06:18.937 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043572403000000003, 2024-04-18T21:06:18.937 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:18.937 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:18.937 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:18.937 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:18.937 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.937 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:18.937 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:18.937 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:18.937 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.937 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.937 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:18.938 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:18.938 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:18.938 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.938 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.938 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:18.938 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616192+0000", 2024-04-18T21:06:18.938 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:06:18.938 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.938 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.938 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:18.938 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616203+0000", 2024-04-18T21:06:18.938 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0890000000000001e-05 2024-04-18T21:06:18.938 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.938 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.938 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:18.939 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616223+0000", 2024-04-18T21:06:18.939 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0409000000000001e-05 2024-04-18T21:06:18.939 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.939 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.939 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:18.939 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616238+0000", 2024-04-18T21:06:18.939 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5160000000000001e-05 2024-04-18T21:06:18.939 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.939 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.939 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:18.939 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616343+0000", 2024-04-18T21:06:18.939 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000104831 2024-04-18T21:06:18.939 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.939 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.939 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:18.940 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616357+0000", 2024-04-18T21:06:18.940 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3686000000000001e-05 2024-04-18T21:06:18.940 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.940 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.940 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:18.940 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635912+0000", 2024-04-18T21:06:18.940 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019554944000000001 2024-04-18T21:06:18.940 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.940 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.940 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:18.940 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636231+0000", 2024-04-18T21:06:18.940 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000318766 2024-04-18T21:06:18.940 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.940 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.940 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:18.941 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659763+0000", 2024-04-18T21:06:18.941 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023532474000000001 2024-04-18T21:06:18.941 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:18.941 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:18.941 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:18.941 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.941 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.941 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:18.941 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:06:18.941 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 73.273694011000003, 2024-04-18T21:06:18.941 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015007971, 2024-04-18T21:06:18.941 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:18.941 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:18.941 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:18.941 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:18.941 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.941 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:18.942 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:06:18.942 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:18.942 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.942 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.942 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:18.942 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:06:18.942 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:18.942 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.942 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.942 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:18.942 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620120+0000", 2024-04-18T21:06:18.942 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0359999999999999e-06 2024-04-18T21:06:18.942 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.942 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.943 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:18.943 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620157+0000", 2024-04-18T21:06:18.943 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6636e-05 2024-04-18T21:06:18.943 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.943 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.943 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:18.943 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620177+0000", 2024-04-18T21:06:18.943 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0247000000000001e-05 2024-04-18T21:06:18.943 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.943 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.943 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:18.943 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620195+0000", 2024-04-18T21:06:18.943 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7819e-05 2024-04-18T21:06:18.943 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.943 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.943 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:18.944 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620342+0000", 2024-04-18T21:06:18.944 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014643300000000001 2024-04-18T21:06:18.944 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.944 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.944 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:18.944 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620405+0000", 2024-04-18T21:06:18.944 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3522000000000006e-05 2024-04-18T21:06:18.944 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.944 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.944 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:18.944 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635016+0000", 2024-04-18T21:06:18.944 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014610840999999999 2024-04-18T21:06:18.944 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.945 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.945 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:18.945 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635127+0000", 2024-04-18T21:06:18.945 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111437 2024-04-18T21:06:18.945 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:18.945 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:18.945 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:18.945 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.945 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.945 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:18.945 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:06:18.945 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 73.273586742999996, 2024-04-18T21:06:18.945 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012693296, 2024-04-18T21:06:18.945 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:18.945 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:18.945 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:18.946 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:18.946 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.946 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:18.946 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:06:18.946 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:18.946 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.946 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.946 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:18.946 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:06:18.946 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:18.946 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.946 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.946 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:18.947 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620228+0000", 2024-04-18T21:06:18.947 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:06:18.947 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.947 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.947 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:18.947 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620236+0000", 2024-04-18T21:06:18.947 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.303e-06 2024-04-18T21:06:18.947 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.947 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.947 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:18.947 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620255+0000", 2024-04-18T21:06:18.947 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9406e-05 2024-04-18T21:06:18.947 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.947 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.947 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:18.947 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620274+0000", 2024-04-18T21:06:18.948 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8940000000000002e-05 2024-04-18T21:06:18.948 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.948 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.948 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:18.948 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:06:18.948 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001558753 2024-04-18T21:06:18.948 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.948 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.948 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:18.948 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621879+0000", 2024-04-18T21:06:18.948 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6359000000000001e-05 2024-04-18T21:06:18.948 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.948 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.948 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:18.948 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632841+0000", 2024-04-18T21:06:18.949 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010961907 2024-04-18T21:06:18.949 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.949 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.949 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:18.949 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632920+0000", 2024-04-18T21:06:18.949 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8714999999999994e-05 2024-04-18T21:06:18.949 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:18.949 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:18.949 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:18.949 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.949 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.949 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:18.949 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:06:18.949 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 73.27204098, 2024-04-18T21:06:18.949 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013445702, 2024-04-18T21:06:18.950 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:18.950 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:18.950 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:18.950 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:18.950 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.950 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:18.950 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:06:18.950 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:18.950 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.950 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.950 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:18.950 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:06:18.950 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:18.950 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.950 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.950 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:18.951 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621774+0000", 2024-04-18T21:06:18.951 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2500000000000001e-06 2024-04-18T21:06:18.951 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.951 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.951 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:18.951 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621786+0000", 2024-04-18T21:06:18.951 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2636000000000001e-05 2024-04-18T21:06:18.951 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.951 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.951 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:18.951 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621814+0000", 2024-04-18T21:06:18.951 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7823000000000001e-05 2024-04-18T21:06:18.951 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.951 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.951 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:18.952 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621844+0000", 2024-04-18T21:06:18.952 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9589000000000001e-05 2024-04-18T21:06:18.952 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.952 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.952 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:18.952 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622253+0000", 2024-04-18T21:06:18.952 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040963700000000002 2024-04-18T21:06:18.952 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.952 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.952 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:18.952 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622304+0000", 2024-04-18T21:06:18.952 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0868999999999997e-05 2024-04-18T21:06:18.952 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.952 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.952 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:18.952 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635133+0000", 2024-04-18T21:06:18.953 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012829136 2024-04-18T21:06:18.953 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.953 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.953 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:18.953 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635218+0000", 2024-04-18T21:06:18.953 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4761999999999999e-05 2024-04-18T21:06:18.953 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:18.953 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:18.953 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:18.953 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.953 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.953 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:18.953 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:06:18.953 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 73.271914219999999, 2024-04-18T21:06:18.953 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014162065, 2024-04-18T21:06:18.953 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:18.954 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:18.954 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:18.954 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:18.954 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.954 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:18.954 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:06:18.954 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:18.954 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.954 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.954 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:18.954 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:06:18.954 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:18.954 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.954 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.954 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:18.955 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621900+0000", 2024-04-18T21:06:18.955 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:06:18.955 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.955 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.955 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:18.955 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621910+0000", 2024-04-18T21:06:18.955 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0207000000000001e-05 2024-04-18T21:06:18.955 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.955 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.955 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:18.955 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621932+0000", 2024-04-18T21:06:18.955 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1789000000000001e-05 2024-04-18T21:06:18.955 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.955 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.955 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:18.956 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621946+0000", 2024-04-18T21:06:18.956 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4212999999999999e-05 2024-04-18T21:06:18.956 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.956 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.956 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:18.956 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624477+0000", 2024-04-18T21:06:18.956 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025303470000000001 2024-04-18T21:06:18.956 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.956 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.956 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:18.956 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624525+0000", 2024-04-18T21:06:18.956 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8084999999999998e-05 2024-04-18T21:06:18.956 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.956 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.956 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:18.957 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635976+0000", 2024-04-18T21:06:18.957 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.011451368999999999 2024-04-18T21:06:18.957 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.957 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.957 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:18.957 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636061+0000", 2024-04-18T21:06:18.957 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5094999999999998e-05 2024-04-18T21:06:18.957 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:18.957 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:18.957 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:18.957 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.957 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.957 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:06:18.957 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:06:18.957 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 73.262678594999997, 2024-04-18T21:06:18.958 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0098014739999999993, 2024-04-18T21:06:18.958 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:18.958 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:18.958 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:06:18.958 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:18.958 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.958 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:18.958 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:06:18.958 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:18.958 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.958 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.958 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:18.958 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:06:18.958 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:18.959 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.959 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.959 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:18.959 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631136+0000", 2024-04-18T21:06:18.959 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0139999999999999e-06 2024-04-18T21:06:18.959 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.959 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.959 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:18.959 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631152+0000", 2024-04-18T21:06:18.959 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6365999999999999e-05 2024-04-18T21:06:18.959 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.959 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.959 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:18.959 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631961+0000", 2024-04-18T21:06:18.959 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00080873100000000003 2024-04-18T21:06:18.960 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.960 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.960 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:18.960 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632021+0000", 2024-04-18T21:06:18.960 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0541999999999997e-05 2024-04-18T21:06:18.960 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.960 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.960 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:18.960 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633539+0000", 2024-04-18T21:06:18.960 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015175639999999999 2024-04-18T21:06:18.960 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.960 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.960 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:18.960 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640936+0000", 2024-04-18T21:06:18.960 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007397257 2024-04-18T21:06:18.961 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:18.961 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:18.961 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:18.961 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.961 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.961 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-18T21:06:18.961 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:06:18.961 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 73.245217162000003, 2024-04-18T21:06:18.961 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00073592199999999997, 2024-04-18T21:06:18.961 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:18.961 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:18.961 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:18.961 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:18.961 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.962 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:18.962 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:06:18.962 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:18.962 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.962 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.962 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:18.962 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:06:18.962 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:18.962 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.962 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.962 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:18.962 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648597+0000", 2024-04-18T21:06:18.962 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:06:18.962 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.962 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.963 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:18.963 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648605+0000", 2024-04-18T21:06:18.963 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3960000000000006e-06 2024-04-18T21:06:18.963 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.963 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.963 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:18.963 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648625+0000", 2024-04-18T21:06:18.963 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9987e-05 2024-04-18T21:06:18.963 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.963 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.963 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:18.963 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648643+0000", 2024-04-18T21:06:18.963 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7079e-05 2024-04-18T21:06:18.963 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.963 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.964 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:18.964 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649043+0000", 2024-04-18T21:06:18.964 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040083399999999998 2024-04-18T21:06:18.964 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.964 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.964 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:18.964 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649062+0000", 2024-04-18T21:06:18.964 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9052999999999999e-05 2024-04-18T21:06:18.964 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.964 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.964 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:18.964 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649332+0000", 2024-04-18T21:06:18.964 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026971999999999999 2024-04-18T21:06:18.964 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:18.964 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:18.965 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:18.965 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.965 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.965 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:06:18.965 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:06:18.965 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 73.242442260999994, 2024-04-18T21:06:18.965 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00086123999999999999, 2024-04-18T21:06:18.965 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:18.965 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:18.965 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:06:18.965 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:18.965 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.965 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:18.965 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:06:18.965 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:18.965 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.965 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.966 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:18.966 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:06:18.966 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:18.966 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.966 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.966 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:18.966 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651372+0000", 2024-04-18T21:06:18.966 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7599999999999997e-07 2024-04-18T21:06:18.966 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.966 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.966 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:18.966 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651377+0000", 2024-04-18T21:06:18.966 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.22e-06 2024-04-18T21:06:18.966 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.967 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.967 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:18.967 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651394+0000", 2024-04-18T21:06:18.967 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6646999999999998e-05 2024-04-18T21:06:18.967 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.967 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.967 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:18.967 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651427+0000", 2024-04-18T21:06:18.967 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3682e-05 2024-04-18T21:06:18.967 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.967 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.967 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:18.967 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652029+0000", 2024-04-18T21:06:18.967 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00060152199999999995 2024-04-18T21:06:18.967 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.967 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.968 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:18.968 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652232+0000", 2024-04-18T21:06:18.968 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020359299999999999 2024-04-18T21:06:18.968 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:18.968 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:18.968 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:18.968 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.968 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.968 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:06:18.968 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:06:18.968 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 73.234415299000005, 2024-04-18T21:06:18.968 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0017426200000000001, 2024-04-18T21:06:18.968 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:18.968 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:18.968 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:18.968 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:18.969 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.969 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:18.969 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:06:18.969 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:18.969 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.969 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.969 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:18.969 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:06:18.969 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:18.969 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.969 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.969 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:18.969 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659399+0000", 2024-04-18T21:06:18.969 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6000000000000002e-07 2024-04-18T21:06:18.969 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.969 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.970 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:18.970 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659405+0000", 2024-04-18T21:06:18.970 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5069999999999997e-06 2024-04-18T21:06:18.970 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.970 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.970 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:18.970 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659425+0000", 2024-04-18T21:06:18.970 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.927e-05 2024-04-18T21:06:18.970 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.970 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.970 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:18.970 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659443+0000", 2024-04-18T21:06:18.970 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8051999999999999e-05 2024-04-18T21:06:18.970 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.971 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.971 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:18.971 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660973+0000", 2024-04-18T21:06:18.971 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001530106 2024-04-18T21:06:18.971 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.971 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.971 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:18.971 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660983+0000", 2024-04-18T21:06:18.971 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0516999999999999e-05 2024-04-18T21:06:18.971 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.971 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.971 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:18.971 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661141+0000", 2024-04-18T21:06:18.971 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015730799999999999 2024-04-18T21:06:18.971 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:18.972 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:18.972 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:18.972 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.972 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.972 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:06:18.972 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:06:18.972 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 73.234198673999998, 2024-04-18T21:06:18.972 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001812311, 2024-04-18T21:06:18.972 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:18.972 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:18.972 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:18.972 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:18.972 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.972 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:18.972 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:06:18.972 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:18.973 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.973 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.973 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:18.973 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:06:18.973 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:18.973 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.973 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.973 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:18.973 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659616+0000", 2024-04-18T21:06:18.973 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.277e-06 2024-04-18T21:06:18.973 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.973 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.973 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:18.973 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659625+0000", 2024-04-18T21:06:18.973 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5359999999999998e-06 2024-04-18T21:06:18.974 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.974 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.974 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:18.974 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659647+0000", 2024-04-18T21:06:18.974 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1857000000000001e-05 2024-04-18T21:06:18.974 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.974 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.974 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:18.974 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659664+0000", 2024-04-18T21:06:18.974 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6405999999999998e-05 2024-04-18T21:06:18.974 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.974 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.974 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:18.974 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661169+0000", 2024-04-18T21:06:18.974 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015054179999999999 2024-04-18T21:06:18.975 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.975 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.975 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:18.975 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661177+0000", 2024-04-18T21:06:18.975 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9680000000000006e-06 2024-04-18T21:06:18.975 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.975 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.975 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:18.975 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661427+0000", 2024-04-18T21:06:18.975 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024984900000000001 2024-04-18T21:06:18.975 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:18.975 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:18.975 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:18.975 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.975 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.975 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-18T21:06:18.976 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:06:18.976 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 71.281278065999999, 2024-04-18T21:06:18.976 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0030975030000000001, 2024-04-18T21:06:18.976 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:18.976 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:18.976 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:18.976 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:18.976 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.976 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:18.976 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:06:18.976 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:18.976 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.976 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.976 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:18.976 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:06:18.976 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:18.977 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.977 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.977 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:18.977 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612538+0000", 2024-04-18T21:06:18.977 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6259999999999999e-06 2024-04-18T21:06:18.977 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.977 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.977 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:18.977 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612552+0000", 2024-04-18T21:06:18.977 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4073999999999999e-05 2024-04-18T21:06:18.977 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.977 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.977 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:18.977 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612585+0000", 2024-04-18T21:06:18.977 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3504999999999999e-05 2024-04-18T21:06:18.977 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.978 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.978 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:18.978 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612601+0000", 2024-04-18T21:06:18.978 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5194000000000001e-05 2024-04-18T21:06:18.978 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.978 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.978 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:18.978 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612746+0000", 2024-04-18T21:06:18.978 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145666 2024-04-18T21:06:18.978 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.978 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.978 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:18.978 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612953+0000", 2024-04-18T21:06:18.978 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000207109 2024-04-18T21:06:18.979 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.979 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.979 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:18.979 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.613134+0000", 2024-04-18T21:06:18.979 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018041300000000001 2024-04-18T21:06:18.979 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.979 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.979 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:18.979 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.614411+0000", 2024-04-18T21:06:18.979 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0012769929999999999 2024-04-18T21:06:18.979 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.979 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.979 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:18.979 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615441+0000", 2024-04-18T21:06:18.979 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001029917 2024-04-18T21:06:18.979 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.980 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.980 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:18.980 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615522+0000", 2024-04-18T21:06:18.980 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1142000000000003e-05 2024-04-18T21:06:18.980 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.980 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.980 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:18.980 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615633+0000", 2024-04-18T21:06:18.980 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000110864 2024-04-18T21:06:18.980 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:18.980 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:18.980 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:18.980 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.980 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.980 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-18T21:06:18.980 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:06:18.981 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 53.278992254999999, 2024-04-18T21:06:18.981 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088979039999999999, 2024-04-18T21:06:18.981 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:18.981 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:18.981 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:18.981 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:18.981 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.981 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:18.981 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:06:18.981 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:18.981 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.981 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.981 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:18.981 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:06:18.982 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:18.982 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.982 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.982 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:18.982 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614825+0000", 2024-04-18T21:06:18.982 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4829999999999999e-06 2024-04-18T21:06:18.982 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.982 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.982 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:18.982 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614843+0000", 2024-04-18T21:06:18.982 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8777e-05 2024-04-18T21:06:18.982 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.982 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.982 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:18.983 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614884+0000", 2024-04-18T21:06:18.983 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1051999999999999e-05 2024-04-18T21:06:18.983 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.983 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.983 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:18.983 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614903+0000", 2024-04-18T21:06:18.983 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9069999999999999e-05 2024-04-18T21:06:18.983 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.983 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.983 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:18.983 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615047+0000", 2024-04-18T21:06:18.983 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014374400000000001 2024-04-18T21:06:18.983 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.983 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.983 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:18.984 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615061+0000", 2024-04-18T21:06:18.984 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4063000000000001e-05 2024-04-18T21:06:18.984 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.984 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.984 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:18.984 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621064+0000", 2024-04-18T21:06:18.984 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0060029200000000001 2024-04-18T21:06:18.984 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.984 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.984 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:18.984 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621211+0000", 2024-04-18T21:06:18.984 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000147224 2024-04-18T21:06:18.984 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.984 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.984 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:18.984 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621396+0000", 2024-04-18T21:06:18.985 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018454699999999999 2024-04-18T21:06:18.985 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.985 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.985 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:18.985 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.622517+0000", 2024-04-18T21:06:18.985 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001121424 2024-04-18T21:06:18.985 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.985 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.985 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:18.985 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623571+0000", 2024-04-18T21:06:18.985 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010538660000000001 2024-04-18T21:06:18.985 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.985 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.985 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:18.985 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623658+0000", 2024-04-18T21:06:18.985 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6439000000000004e-05 2024-04-18T21:06:18.985 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:18.986 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:18.986 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:18.986 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623719+0000", 2024-04-18T21:06:18.986 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1295000000000002e-05 2024-04-18T21:06:18.986 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:18.986 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:18.986 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:18.986 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:18.986 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:18.986 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:18.987 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:18.988 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:18.987+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:19.088 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:19.091+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:19.120 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:19.120 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:06:19.120 INFO:teuthology.orchestra.run.smithi132.stdout: "num_ops": 0 2024-04-18T21:06:19.120 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:19.135 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:19.156 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:06:19.189 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:19.191+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:19.258 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:19.259 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:06:19.259 INFO:teuthology.orchestra.run.smithi132.stdout: "complaint_time": 30, 2024-04-18T21:06:19.259 INFO:teuthology.orchestra.run.smithi132.stdout: "num_blocked_ops": 0 2024-04-18T21:06:19.259 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:19.272 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:19.290 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:19.290+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:19.349 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:06:19.349 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:06:19.382 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1: {} 2024-04-18T21:06:19.382 INFO:teuthology.orchestra.run.smithi078.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:06:19.389 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:19.389 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:19.390 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:19.390+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:19.403 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:19.415 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:06:19.415 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:19.491 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:19.491+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:19.535 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:19.535 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:19.550 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:19.593 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:19.595+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:19.602 INFO:teuthology.orchestra.run.smithi078.stderr:nodeep-scrub is unset 2024-04-18T21:06:19.693 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:19.694+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:19.712 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:19.712 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:19.727 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:19.793 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:19.790+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:19.843 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:19.843 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:19.856 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:19.894 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:19.894+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:19.982 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:19.982 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:19.994 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:19.995+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:19.995 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:20.095 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:20.095+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:20.116 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:20.116 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:20.130 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:20.196 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:20.199+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:20.249 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:20.249 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:20.261 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:20.296 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:20.294+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:20.392 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:20.393 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:20.397 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:20.394+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:20.407 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:20.497 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:20.494+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:20.573 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:20.573 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:20.587 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:20.598 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:20.598+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:20.700 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:20.698+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:20.755 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:20.755 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:20.769 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:20.817 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:20.819+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:20.898 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:20.899 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:20.902 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:20.898+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:20.912 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:21.003 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:21.002+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:21.082 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:21.082 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:21.096 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:21.104 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:21.102+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:21.205 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:21.206+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:21.219 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:21.219 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:21.233 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:21.306 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:21.307+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:21.366 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:21.366 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:21.380 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:21.425 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:21.426+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:21.435 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:06:21.499 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:21.499 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:21.507 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:21.506+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:21.513 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:21.609 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:21.606+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:21.629 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-18T21:06:21.633 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:06:21.634 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:06:21.669 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1: {} 2024-04-18T21:06:21.669 INFO:teuthology.orchestra.run.smithi078.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:06:21.679 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:21.679 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:21.694 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:21.700 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:06:21.701 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:21.709 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:21.711+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:21.810 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:21.806+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:21.824 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:21.824 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:06:21.824 INFO:teuthology.orchestra.run.smithi132.stdout: "num_ops": 0 2024-04-18T21:06:21.824 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:21.838 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:21.911 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:21.911+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:22.007 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:22.007 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:06:22.007 INFO:teuthology.orchestra.run.smithi132.stdout: "complaint_time": 30, 2024-04-18T21:06:22.007 INFO:teuthology.orchestra.run.smithi132.stdout: "num_blocked_ops": 0 2024-04-18T21:06:22.007 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:22.011 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:22.010+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:22.021 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:22.112 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:22.110+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:22.141 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:22.141 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 20, 2024-04-18T21:06:22.141 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 600, 2024-04-18T21:06:22.141 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [ 2024-04-18T21:06:22.141 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.141 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:22.141 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:06:22.142 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 87.229194323000002, 2024-04-18T21:06:22.142 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.02518273, 2024-04-18T21:06:22.142 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:22.142 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:22.142 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:22.142 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:22.142 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:22.142 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:22.142 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 141 2024-04-18T21:06:22.142 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.142 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:22.142 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.142 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:22.143 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:06:22.143 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:22.143 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.143 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.143 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:22.143 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:06:22.143 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:22.143 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.143 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.143 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:22.143 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911562+0000", 2024-04-18T21:06:22.143 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9300000000000006e-07 2024-04-18T21:06:22.143 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.143 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.144 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:22.144 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911569+0000", 2024-04-18T21:06:22.144 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0169999999999999e-06 2024-04-18T21:06:22.144 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.144 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.144 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:22.144 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911582+0000", 2024-04-18T21:06:22.144 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.343e-05 2024-04-18T21:06:22.144 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.144 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.144 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:22.144 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911590+0000", 2024-04-18T21:06:22.144 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.413e-06 2024-04-18T21:06:22.144 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.145 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.145 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:22.145 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.933922+0000", 2024-04-18T21:06:22.145 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.022332093000000001 2024-04-18T21:06:22.145 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.145 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.145 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:22.145 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.934155+0000", 2024-04-18T21:06:22.145 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023378900000000001 2024-04-18T21:06:22.145 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.145 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.145 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:22.145 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.934514+0000", 2024-04-18T21:06:22.145 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00035859200000000003 2024-04-18T21:06:22.146 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.146 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.146 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:22.146 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.935973+0000", 2024-04-18T21:06:22.146 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001458705 2024-04-18T21:06:22.146 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.146 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.146 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:22.146 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936488+0000", 2024-04-18T21:06:22.146 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00051550000000000001 2024-04-18T21:06:22.146 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.146 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.146 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:22.146 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936636+0000", 2024-04-18T21:06:22.147 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014779800000000001 2024-04-18T21:06:22.147 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.147 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.147 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:22.147 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936743+0000", 2024-04-18T21:06:22.147 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010739999999999999 2024-04-18T21:06:22.147 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:22.147 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:22.147 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:22.147 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.147 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.147 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:22.148 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:22.148 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 87.111995348999997, 2024-04-18T21:06:22.148 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023654959999999999, 2024-04-18T21:06:22.148 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:22.148 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:22.148 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:22.148 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:22.148 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:22.148 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:22.148 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 163 2024-04-18T21:06:22.148 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.148 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:22.148 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.148 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:22.149 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:22.149 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:22.149 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.149 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.149 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:22.149 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:22.149 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:22.149 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.149 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.149 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:22.149 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:22.149 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0999999999999998e-07 2024-04-18T21:06:22.149 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.150 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.150 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:22.150 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028766+0000", 2024-04-18T21:06:22.150 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4700000000000001e-06 2024-04-18T21:06:22.150 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.150 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.150 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:22.150 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028775+0000", 2024-04-18T21:06:22.150 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.3190000000000001e-06 2024-04-18T21:06:22.150 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.150 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.150 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:22.150 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028782+0000", 2024-04-18T21:06:22.150 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.2300000000000002e-06 2024-04-18T21:06:22.151 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.151 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.151 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:22.151 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046667+0000", 2024-04-18T21:06:22.151 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017884356000000001 2024-04-18T21:06:22.151 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.151 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.151 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:22.151 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046788+0000", 2024-04-18T21:06:22.151 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012125000000000001 2024-04-18T21:06:22.151 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.151 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.151 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:22.151 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046982+0000", 2024-04-18T21:06:22.151 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019394 2024-04-18T21:06:22.152 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.152 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.152 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:22.152 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051969+0000", 2024-04-18T21:06:22.152 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0049868150000000003 2024-04-18T21:06:22.152 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.152 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.152 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:22.152 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052089+0000", 2024-04-18T21:06:22.152 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011993 2024-04-18T21:06:22.152 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.152 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.152 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:22.152 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052292+0000", 2024-04-18T21:06:22.153 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020345699999999999 2024-04-18T21:06:22.153 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.153 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.153 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:22.153 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052415+0000", 2024-04-18T21:06:22.153 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000122483 2024-04-18T21:06:22.153 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:22.153 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:22.153 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:22.153 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.153 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.153 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:22.153 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:22.153 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 87.111961117000007, 2024-04-18T21:06:22.153 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023864586, 2024-04-18T21:06:22.154 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:22.154 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:22.154 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:22.154 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:22.154 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:22.154 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:22.154 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 164 2024-04-18T21:06:22.154 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.154 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:22.154 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.154 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:22.154 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:22.154 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:22.154 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.155 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.155 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:22.155 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:22.155 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:22.155 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.155 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.155 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:22.155 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028795+0000", 2024-04-18T21:06:22.155 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7999999999999995e-07 2024-04-18T21:06:22.155 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.155 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.155 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:22.155 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028884+0000", 2024-04-18T21:06:22.155 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8997000000000002e-05 2024-04-18T21:06:22.156 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.156 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.156 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:22.156 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028895+0000", 2024-04-18T21:06:22.156 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1647e-05 2024-04-18T21:06:22.156 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.156 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.156 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:22.156 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028903+0000", 2024-04-18T21:06:22.156 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.909e-06 2024-04-18T21:06:22.156 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.156 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.156 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:22.156 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.047818+0000", 2024-04-18T21:06:22.156 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018914337 2024-04-18T21:06:22.157 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.157 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.157 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:22.157 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.048094+0000", 2024-04-18T21:06:22.157 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00027653500000000001 2024-04-18T21:06:22.157 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.157 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.157 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:22.157 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.048471+0000", 2024-04-18T21:06:22.157 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00037705799999999999 2024-04-18T21:06:22.157 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.157 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.157 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:22.157 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052516+0000", 2024-04-18T21:06:22.157 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0040452739999999997 2024-04-18T21:06:22.158 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.158 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.158 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:22.158 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052535+0000", 2024-04-18T21:06:22.158 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.84e-05 2024-04-18T21:06:22.158 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.158 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.158 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:22.158 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052603+0000", 2024-04-18T21:06:22.158 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.8095000000000004e-05 2024-04-18T21:06:22.158 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.158 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.158 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:22.159 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052659+0000", 2024-04-18T21:06:22.159 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5653999999999999e-05 2024-04-18T21:06:22.159 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:22.159 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:22.159 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:22.159 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.159 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.159 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:22.159 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:22.159 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 87.111837674, 2024-04-18T21:06:22.159 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024516458000000001, 2024-04-18T21:06:22.159 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:22.159 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:22.159 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:22.160 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:22.160 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:22.160 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:22.160 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 165 2024-04-18T21:06:22.160 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.160 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:22.160 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.160 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:22.160 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:22.160 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:22.160 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.160 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.160 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:22.160 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:22.160 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:22.161 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.161 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.161 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:22.161 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028918+0000", 2024-04-18T21:06:22.161 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8000000000000005e-07 2024-04-18T21:06:22.161 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.161 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.161 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:22.161 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028924+0000", 2024-04-18T21:06:22.161 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5659999999999997e-06 2024-04-18T21:06:22.161 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.161 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.161 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:22.161 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028933+0000", 2024-04-18T21:06:22.161 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.38e-06 2024-04-18T21:06:22.162 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.162 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.162 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:22.162 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028940+0000", 2024-04-18T21:06:22.162 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0060000000000003e-06 2024-04-18T21:06:22.162 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.162 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.162 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:22.162 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.050846+0000", 2024-04-18T21:06:22.162 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021906119000000002 2024-04-18T21:06:22.162 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.162 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.162 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:22.162 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051025+0000", 2024-04-18T21:06:22.163 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017850799999999999 2024-04-18T21:06:22.163 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.163 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.163 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:22.163 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051221+0000", 2024-04-18T21:06:22.163 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019608700000000001 2024-04-18T21:06:22.163 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.163 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.163 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:22.163 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052675+0000", 2024-04-18T21:06:22.163 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0014537899999999999 2024-04-18T21:06:22.163 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.163 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.163 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:22.164 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053311+0000", 2024-04-18T21:06:22.164 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00063613299999999999 2024-04-18T21:06:22.164 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.164 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.164 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:22.164 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053381+0000", 2024-04-18T21:06:22.164 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0074999999999996e-05 2024-04-18T21:06:22.164 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.164 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.164 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:22.164 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053434+0000", 2024-04-18T21:06:22.164 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3013999999999998e-05 2024-04-18T21:06:22.164 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:22.164 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:22.165 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:22.165 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.165 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.165 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:22.165 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:22.165 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 86.998532194999996, 2024-04-18T21:06:22.165 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023772793, 2024-04-18T21:06:22.165 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:22.165 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:22.165 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:22.165 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:22.165 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:22.165 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:22.165 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 187 2024-04-18T21:06:22.165 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.166 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:22.166 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.166 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:22.166 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:22.166 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:22.166 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.166 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.166 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:22.166 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:22.166 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:22.166 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.166 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.166 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:22.166 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142224+0000", 2024-04-18T21:06:22.167 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.47e-07 2024-04-18T21:06:22.167 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.167 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.167 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:22.167 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142233+0000", 2024-04-18T21:06:22.167 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0729999999999994e-06 2024-04-18T21:06:22.167 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.167 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.167 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:22.167 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142255+0000", 2024-04-18T21:06:22.167 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.2535999999999999e-05 2024-04-18T21:06:22.167 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.167 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.167 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:22.168 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142268+0000", 2024-04-18T21:06:22.168 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2686e-05 2024-04-18T21:06:22.168 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.168 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.168 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:22.168 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160497+0000", 2024-04-18T21:06:22.168 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018228779000000001 2024-04-18T21:06:22.168 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.168 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.168 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:22.168 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160634+0000", 2024-04-18T21:06:22.168 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000137315 2024-04-18T21:06:22.168 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.168 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.169 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:22.169 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160831+0000", 2024-04-18T21:06:22.169 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019683100000000001 2024-04-18T21:06:22.169 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.169 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.169 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:22.169 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165129+0000", 2024-04-18T21:06:22.169 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0042981299999999998 2024-04-18T21:06:22.169 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.169 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.169 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:22.169 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165776+0000", 2024-04-18T21:06:22.169 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00064702900000000003 2024-04-18T21:06:22.169 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.169 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.170 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:22.170 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165921+0000", 2024-04-18T21:06:22.170 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014506 2024-04-18T21:06:22.170 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.170 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.170 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:22.170 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165996+0000", 2024-04-18T21:06:22.170 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.4406999999999994e-05 2024-04-18T21:06:22.170 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:22.170 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:22.170 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:22.170 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.170 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.171 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:22.171 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:22.171 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 86.998471597000005, 2024-04-18T21:06:22.171 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026802157, 2024-04-18T21:06:22.171 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:22.171 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:22.171 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:22.171 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:22.171 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:22.171 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:22.171 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 188 2024-04-18T21:06:22.171 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.171 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:22.171 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.171 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:22.172 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:22.172 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:22.172 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.172 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.172 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:22.172 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:22.172 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:22.172 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.172 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.172 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:22.172 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142284+0000", 2024-04-18T21:06:22.172 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4e-07 2024-04-18T21:06:22.172 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.172 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.173 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:22.173 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142374+0000", 2024-04-18T21:06:22.173 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0099999999999995e-05 2024-04-18T21:06:22.173 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.173 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.173 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:22.173 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142386+0000", 2024-04-18T21:06:22.173 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1770000000000001e-05 2024-04-18T21:06:22.173 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.173 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.173 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:22.173 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142394+0000", 2024-04-18T21:06:22.173 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.2130000000000008e-06 2024-04-18T21:06:22.173 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.173 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.174 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:22.174 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.161743+0000", 2024-04-18T21:06:22.174 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019348644000000002 2024-04-18T21:06:22.174 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.174 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.174 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:22.174 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.161865+0000", 2024-04-18T21:06:22.174 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012210899999999999 2024-04-18T21:06:22.174 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.174 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.174 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:22.174 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.162055+0000", 2024-04-18T21:06:22.174 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000189994 2024-04-18T21:06:22.174 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.175 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.175 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:22.175 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165735+0000", 2024-04-18T21:06:22.175 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0036803270000000002 2024-04-18T21:06:22.175 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.175 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.175 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:22.175 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.168911+0000", 2024-04-18T21:06:22.175 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0031753689999999999 2024-04-18T21:06:22.175 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.175 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.175 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:22.175 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169012+0000", 2024-04-18T21:06:22.175 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010157699999999999 2024-04-18T21:06:22.175 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.176 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.176 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:22.176 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169086+0000", 2024-04-18T21:06:22.176 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3213999999999994e-05 2024-04-18T21:06:22.176 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:22.176 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:22.176 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:22.176 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.176 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.176 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:22.176 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:22.176 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 86.998346291000004, 2024-04-18T21:06:22.176 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026811423000000001, 2024-04-18T21:06:22.176 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:22.176 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:22.177 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:22.177 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:22.177 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:22.177 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:22.177 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 189 2024-04-18T21:06:22.177 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.177 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:22.177 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.177 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:22.177 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:22.177 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:22.177 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.177 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.177 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:22.177 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:22.178 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:22.178 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.178 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.178 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:22.178 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142410+0000", 2024-04-18T21:06:22.178 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:06:22.178 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.178 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.178 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:22.178 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142415+0000", 2024-04-18T21:06:22.178 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.7939999999999999e-06 2024-04-18T21:06:22.178 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.178 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.178 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:22.179 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142470+0000", 2024-04-18T21:06:22.179 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4537999999999999e-05 2024-04-18T21:06:22.179 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.179 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.179 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:22.179 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142481+0000", 2024-04-18T21:06:22.179 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0966e-05 2024-04-18T21:06:22.179 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.179 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.179 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:22.179 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.163493+0000", 2024-04-18T21:06:22.179 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021012444000000002 2024-04-18T21:06:22.179 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.179 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.179 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:22.180 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.163727+0000", 2024-04-18T21:06:22.180 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000233339 2024-04-18T21:06:22.180 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.180 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.180 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:22.180 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.164102+0000", 2024-04-18T21:06:22.180 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000374872 2024-04-18T21:06:22.180 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.180 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.180 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:22.180 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.166528+0000", 2024-04-18T21:06:22.180 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0024258729999999998 2024-04-18T21:06:22.180 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.181 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.181 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:22.181 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169101+0000", 2024-04-18T21:06:22.181 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0025737680000000001 2024-04-18T21:06:22.181 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.181 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.181 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:22.181 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169171+0000", 2024-04-18T21:06:22.181 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0148000000000007e-05 2024-04-18T21:06:22.181 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.181 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.181 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:22.181 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169220+0000", 2024-04-18T21:06:22.181 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8767999999999998e-05 2024-04-18T21:06:22.182 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:22.182 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:22.182 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:22.182 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.182 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.182 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:22.182 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:22.182 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 76.524773738999997, 2024-04-18T21:06:22.182 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024082777999999999, 2024-04-18T21:06:22.182 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:22.182 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:22.182 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:22.182 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:22.182 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.182 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:22.183 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:22.183 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:22.183 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.183 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.183 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:22.183 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:22.183 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:22.183 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.183 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.183 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:22.183 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615984+0000", 2024-04-18T21:06:22.183 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.9869999999999999e-06 2024-04-18T21:06:22.183 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.183 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.184 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:22.184 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615999+0000", 2024-04-18T21:06:22.184 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4646e-05 2024-04-18T21:06:22.184 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.184 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.184 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:22.184 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616028+0000", 2024-04-18T21:06:22.184 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8952999999999999e-05 2024-04-18T21:06:22.184 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.184 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.184 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:22.184 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616052+0000", 2024-04-18T21:06:22.184 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.3941999999999999e-05 2024-04-18T21:06:22.184 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.185 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.185 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:22.185 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618010+0000", 2024-04-18T21:06:22.185 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0019581780000000001 2024-04-18T21:06:22.185 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.185 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.185 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:22.185 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618322+0000", 2024-04-18T21:06:22.185 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00031158899999999997 2024-04-18T21:06:22.185 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.185 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.185 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:22.185 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618587+0000", 2024-04-18T21:06:22.185 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00026495700000000002 2024-04-18T21:06:22.186 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.186 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.186 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:22.186 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629262+0000", 2024-04-18T21:06:22.186 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010675877 2024-04-18T21:06:22.186 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.186 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.186 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:22.186 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.639773+0000", 2024-04-18T21:06:22.186 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0105109 2024-04-18T21:06:22.186 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.186 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.186 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:22.186 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.639926+0000", 2024-04-18T21:06:22.186 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000152349 2024-04-18T21:06:22.187 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.187 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.187 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:22.187 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640064+0000", 2024-04-18T21:06:22.187 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0001384 2024-04-18T21:06:22.187 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:22.187 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:22.187 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:22.187 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.187 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.187 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:22.187 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:22.187 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 76.524661065000004, 2024-04-18T21:06:22.187 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030215005999999999, 2024-04-18T21:06:22.188 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:22.188 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:22.188 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:22.188 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:22.188 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.188 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:22.188 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:22.188 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:22.188 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.188 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.188 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:22.188 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:22.188 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:22.188 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.188 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.189 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:22.189 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616095+0000", 2024-04-18T21:06:22.189 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.446e-06 2024-04-18T21:06:22.189 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.189 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.189 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:22.189 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616104+0000", 2024-04-18T21:06:22.189 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6200000000000005e-06 2024-04-18T21:06:22.189 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.189 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.189 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:22.189 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616132+0000", 2024-04-18T21:06:22.189 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7668999999999999e-05 2024-04-18T21:06:22.189 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.189 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.190 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:22.190 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616149+0000", 2024-04-18T21:06:22.190 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7047000000000001e-05 2024-04-18T21:06:22.190 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.190 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.190 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:22.190 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619287+0000", 2024-04-18T21:06:22.190 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0031381450000000002 2024-04-18T21:06:22.190 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.190 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.190 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:22.190 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619503+0000", 2024-04-18T21:06:22.190 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000216522 2024-04-18T21:06:22.190 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.191 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.191 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:22.191 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619930+0000", 2024-04-18T21:06:22.191 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00042604900000000001 2024-04-18T21:06:22.191 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.191 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.191 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:22.191 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629281+0000", 2024-04-18T21:06:22.191 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0093512230000000005 2024-04-18T21:06:22.191 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.191 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.191 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:22.191 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646022+0000", 2024-04-18T21:06:22.191 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016741156 2024-04-18T21:06:22.192 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.192 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.192 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:22.192 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646198+0000", 2024-04-18T21:06:22.192 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000176009 2024-04-18T21:06:22.192 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.192 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.192 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:22.192 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646309+0000", 2024-04-18T21:06:22.192 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011112000000000001 2024-04-18T21:06:22.192 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:22.192 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:22.192 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:22.193 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.193 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.193 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:22.193 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:22.193 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 76.524576241000005, 2024-04-18T21:06:22.193 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030501176000000001, 2024-04-18T21:06:22.193 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:22.193 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:22.193 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:22.193 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:22.193 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.193 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:22.193 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:22.193 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:22.193 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.194 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.194 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:22.194 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:22.194 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:22.194 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.194 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.194 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:22.194 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616180+0000", 2024-04-18T21:06:22.194 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1000000000000001e-06 2024-04-18T21:06:22.194 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.194 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.194 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:22.194 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616188+0000", 2024-04-18T21:06:22.194 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4069999999999993e-06 2024-04-18T21:06:22.195 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.195 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.195 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:22.195 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616207+0000", 2024-04-18T21:06:22.195 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8335999999999999e-05 2024-04-18T21:06:22.195 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.195 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.195 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:22.195 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616225+0000", 2024-04-18T21:06:22.195 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8652999999999999e-05 2024-04-18T21:06:22.195 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.195 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.195 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:22.195 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620977+0000", 2024-04-18T21:06:22.196 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047512220000000003 2024-04-18T21:06:22.196 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.196 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.196 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:22.196 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621279+0000", 2024-04-18T21:06:22.196 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000302646 2024-04-18T21:06:22.196 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.196 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.196 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:22.196 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621584+0000", 2024-04-18T21:06:22.196 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000305142 2024-04-18T21:06:22.196 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.196 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.196 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:22.196 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629352+0000", 2024-04-18T21:06:22.197 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0077673689999999997 2024-04-18T21:06:22.197 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.197 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.197 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:22.197 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646480+0000", 2024-04-18T21:06:22.197 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017128259 2024-04-18T21:06:22.197 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.197 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.197 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:22.197 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646591+0000", 2024-04-18T21:06:22.197 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011113899999999999 2024-04-18T21:06:22.197 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.197 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.197 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:22.197 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646680+0000", 2024-04-18T21:06:22.198 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8902999999999999e-05 2024-04-18T21:06:22.198 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:22.198 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:22.198 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:22.198 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.198 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.198 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:22.198 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:22.198 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 76.524509742000006, 2024-04-18T21:06:22.198 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030779760999999999, 2024-04-18T21:06:22.198 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:22.198 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:22.198 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:22.198 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:22.199 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.199 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:22.199 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:22.199 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:22.199 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.199 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.199 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:22.199 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:22.199 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:22.199 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.199 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.199 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:22.199 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616246+0000", 2024-04-18T21:06:22.199 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0499999999999999e-06 2024-04-18T21:06:22.199 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.200 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.200 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:22.200 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616253+0000", 2024-04-18T21:06:22.200 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.5989999999999998e-06 2024-04-18T21:06:22.200 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.200 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.200 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:22.200 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616273+0000", 2024-04-18T21:06:22.200 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9916999999999999e-05 2024-04-18T21:06:22.200 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.200 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.200 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:22.200 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616287+0000", 2024-04-18T21:06:22.200 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3669000000000001e-05 2024-04-18T21:06:22.201 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.201 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.201 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:22.201 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622203+0000", 2024-04-18T21:06:22.201 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.005916737 2024-04-18T21:06:22.201 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.201 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.201 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:22.201 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622379+0000", 2024-04-18T21:06:22.201 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000175596 2024-04-18T21:06:22.201 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.201 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.201 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:22.201 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622707+0000", 2024-04-18T21:06:22.202 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00032784600000000002 2024-04-18T21:06:22.202 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.202 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.202 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:22.202 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629366+0000", 2024-04-18T21:06:22.202 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0066593279999999999 2024-04-18T21:06:22.202 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.202 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.202 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:22.202 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646813+0000", 2024-04-18T21:06:22.202 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017447059000000001 2024-04-18T21:06:22.202 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.202 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.202 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:22.203 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646946+0000", 2024-04-18T21:06:22.203 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013301200000000001 2024-04-18T21:06:22.203 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.203 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.203 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:22.203 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647025+0000", 2024-04-18T21:06:22.203 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8948000000000004e-05 2024-04-18T21:06:22.203 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:22.203 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:22.203 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:22.203 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.203 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.203 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:22.203 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:22.204 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 76.524425923999999, 2024-04-18T21:06:22.204 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.031512165000000002, 2024-04-18T21:06:22.204 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:22.204 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:22.204 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:22.204 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:22.204 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.204 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:22.204 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:22.204 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:22.204 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.204 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.204 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:22.204 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:22.205 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:22.205 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.205 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.205 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:22.205 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616330+0000", 2024-04-18T21:06:22.205 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.15e-06 2024-04-18T21:06:22.205 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.205 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.205 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:22.205 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616337+0000", 2024-04-18T21:06:22.205 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.1289999999999998e-06 2024-04-18T21:06:22.205 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.205 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.205 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:22.206 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616447+0000", 2024-04-18T21:06:22.206 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109561 2024-04-18T21:06:22.206 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.206 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.206 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:22.206 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616496+0000", 2024-04-18T21:06:22.206 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8591999999999998e-05 2024-04-18T21:06:22.206 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.206 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.206 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:22.206 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.623786+0000", 2024-04-18T21:06:22.206 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0072906799999999999 2024-04-18T21:06:22.206 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.207 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.207 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:22.207 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.623973+0000", 2024-04-18T21:06:22.207 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018717199999999999 2024-04-18T21:06:22.207 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.207 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.207 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:22.207 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624260+0000", 2024-04-18T21:06:22.207 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00028630600000000001 2024-04-18T21:06:22.207 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.207 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.207 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:22.207 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629381+0000", 2024-04-18T21:06:22.207 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0051211340000000003 2024-04-18T21:06:22.207 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.208 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.208 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:22.208 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647631+0000", 2024-04-18T21:06:22.208 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018249771000000001 2024-04-18T21:06:22.208 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.208 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.208 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:22.208 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647761+0000", 2024-04-18T21:06:22.208 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013037300000000001 2024-04-18T21:06:22.208 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.208 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.208 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:22.208 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647841+0000", 2024-04-18T21:06:22.208 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.0296999999999994e-05 2024-04-18T21:06:22.208 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:22.209 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:22.209 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:22.209 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.209 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.209 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:22.209 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:22.209 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 76.524220439999993, 2024-04-18T21:06:22.209 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043251955000000002, 2024-04-18T21:06:22.209 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:22.209 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:22.209 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:22.209 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:22.209 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.209 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:22.209 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:22.210 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:22.210 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.210 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.210 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:22.210 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:22.210 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:22.210 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.210 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.210 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:22.210 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616536+0000", 2024-04-18T21:06:22.210 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2869999999999999e-06 2024-04-18T21:06:22.210 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.210 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.210 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:22.210 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616572+0000", 2024-04-18T21:06:22.211 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.6261999999999999e-05 2024-04-18T21:06:22.211 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.211 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.211 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:22.211 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616593+0000", 2024-04-18T21:06:22.211 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1310000000000001e-05 2024-04-18T21:06:22.211 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.211 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.211 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:22.211 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616614+0000", 2024-04-18T21:06:22.211 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.0936000000000001e-05 2024-04-18T21:06:22.211 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.211 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.211 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:22.211 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629501+0000", 2024-04-18T21:06:22.211 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.012886819000000001 2024-04-18T21:06:22.212 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.212 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.212 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:22.212 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629696+0000", 2024-04-18T21:06:22.212 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019485499999999999 2024-04-18T21:06:22.212 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.212 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.212 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:22.212 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629940+0000", 2024-04-18T21:06:22.212 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00024386399999999999 2024-04-18T21:06:22.212 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.212 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.212 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:22.212 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640100+0000", 2024-04-18T21:06:22.213 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010159645 2024-04-18T21:06:22.213 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.213 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.213 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:22.213 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659516+0000", 2024-04-18T21:06:22.213 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019416563000000001 2024-04-18T21:06:22.213 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.213 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.213 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:22.213 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659684+0000", 2024-04-18T21:06:22.213 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016750900000000001 2024-04-18T21:06:22.213 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.213 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.213 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:22.214 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659787+0000", 2024-04-18T21:06:22.214 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000102905 2024-04-18T21:06:22.214 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:22.214 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:22.214 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:22.214 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.214 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.214 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:22.214 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:22.214 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 76.524115318, 2024-04-18T21:06:22.214 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043581898000000001, 2024-04-18T21:06:22.214 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:22.214 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:22.214 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:22.214 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:22.215 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.215 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:22.215 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:22.215 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:22.215 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.215 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.215 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:22.215 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:22.215 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:22.215 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.215 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.215 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:22.215 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616641+0000", 2024-04-18T21:06:22.215 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:06:22.215 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.215 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.216 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:22.216 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616648+0000", 2024-04-18T21:06:22.216 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3860000000000001e-06 2024-04-18T21:06:22.216 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.216 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.216 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:22.216 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616666+0000", 2024-04-18T21:06:22.216 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7583000000000001e-05 2024-04-18T21:06:22.216 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.216 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.216 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:22.216 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616679+0000", 2024-04-18T21:06:22.216 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3322999999999999e-05 2024-04-18T21:06:22.216 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.216 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.216 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:22.217 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630373+0000", 2024-04-18T21:06:22.217 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013694207999999999 2024-04-18T21:06:22.217 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.217 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.217 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:22.217 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630545+0000", 2024-04-18T21:06:22.217 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000171683 2024-04-18T21:06:22.217 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.217 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.217 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:22.217 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630728+0000", 2024-04-18T21:06:22.217 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000182599 2024-04-18T21:06:22.217 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.217 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.217 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:22.217 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640600+0000", 2024-04-18T21:06:22.218 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0098726119999999994 2024-04-18T21:06:22.218 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.218 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.218 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:22.218 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659927+0000", 2024-04-18T21:06:22.218 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019326724999999999 2024-04-18T21:06:22.218 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.218 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.218 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:22.218 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660112+0000", 2024-04-18T21:06:22.218 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000185203 2024-04-18T21:06:22.218 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.218 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.218 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:22.219 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660222+0000", 2024-04-18T21:06:22.219 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109343 2024-04-18T21:06:22.219 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:22.219 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:22.219 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:22.219 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.219 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.219 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:22.219 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:22.219 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 76.523249960000001, 2024-04-18T21:06:22.219 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043121310000000003, 2024-04-18T21:06:22.219 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:22.219 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:22.219 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:22.220 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:22.220 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.220 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:22.220 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:22.220 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:22.220 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.220 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.220 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:22.220 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:22.220 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:22.220 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.220 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.220 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:22.220 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617506+0000", 2024-04-18T21:06:22.221 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9999999999999995e-07 2024-04-18T21:06:22.221 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.221 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.221 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:22.221 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617513+0000", 2024-04-18T21:06:22.221 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.9700000000000002e-06 2024-04-18T21:06:22.221 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.221 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.221 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:22.221 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617531+0000", 2024-04-18T21:06:22.221 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8105999999999999e-05 2024-04-18T21:06:22.221 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.221 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.221 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:22.221 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617545+0000", 2024-04-18T21:06:22.222 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3703000000000001e-05 2024-04-18T21:06:22.222 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.222 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.222 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:22.222 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632129+0000", 2024-04-18T21:06:22.222 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.014584135999999999 2024-04-18T21:06:22.222 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.222 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.222 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:22.222 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632361+0000", 2024-04-18T21:06:22.222 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023171800000000001 2024-04-18T21:06:22.222 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.222 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.223 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:22.223 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632804+0000", 2024-04-18T21:06:22.223 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000443549 2024-04-18T21:06:22.223 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.223 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.223 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:22.223 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646340+0000", 2024-04-18T21:06:22.223 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013535902000000001 2024-04-18T21:06:22.223 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.223 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.223 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:22.223 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660363+0000", 2024-04-18T21:06:22.223 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01402318 2024-04-18T21:06:22.223 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.223 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.223 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:22.224 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660523+0000", 2024-04-18T21:06:22.224 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00015989899999999999 2024-04-18T21:06:22.224 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.224 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.224 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:22.224 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660626+0000", 2024-04-18T21:06:22.224 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010314699999999999 2024-04-18T21:06:22.224 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:22.224 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:22.224 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:22.224 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.224 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.224 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:22.224 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:22.224 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 76.523110267000007, 2024-04-18T21:06:22.225 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024927483, 2024-04-18T21:06:22.225 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:22.225 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:22.225 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:22.225 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:22.225 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.225 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:22.225 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:22.225 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:22.225 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.225 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.225 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:22.225 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:22.225 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:22.225 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.225 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.226 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:22.226 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617646+0000", 2024-04-18T21:06:22.226 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3030000000000001e-06 2024-04-18T21:06:22.226 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.226 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.226 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:22.226 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617653+0000", 2024-04-18T21:06:22.226 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7530000000000004e-06 2024-04-18T21:06:22.226 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.226 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.226 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:22.226 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617673+0000", 2024-04-18T21:06:22.226 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9967e-05 2024-04-18T21:06:22.227 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.227 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.227 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:22.227 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617688+0000", 2024-04-18T21:06:22.227 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5153e-05 2024-04-18T21:06:22.227 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.227 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.227 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:22.227 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619244+0000", 2024-04-18T21:06:22.227 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001555531 2024-04-18T21:06:22.227 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.227 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.227 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:22.227 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619361+0000", 2024-04-18T21:06:22.228 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011784400000000001 2024-04-18T21:06:22.228 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.228 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.228 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:22.228 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619604+0000", 2024-04-18T21:06:22.228 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000243007 2024-04-18T21:06:22.228 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.228 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.228 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:22.228 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.625480+0000", 2024-04-18T21:06:22.228 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0058759349999999997 2024-04-18T21:06:22.228 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.228 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.228 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:22.228 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642342+0000", 2024-04-18T21:06:22.229 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016861373999999998 2024-04-18T21:06:22.229 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.229 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.229 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:22.229 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642484+0000", 2024-04-18T21:06:22.229 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000142423 2024-04-18T21:06:22.229 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.229 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.229 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:22.229 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642572+0000", 2024-04-18T21:06:22.229 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8193000000000001e-05 2024-04-18T21:06:22.229 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:22.229 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:22.229 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:22.229 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.230 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.230 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:22.230 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:22.230 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 76.522828763999996, 2024-04-18T21:06:22.230 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024956974999999999, 2024-04-18T21:06:22.230 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:22.230 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:22.230 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:22.230 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:22.230 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.230 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:22.230 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:22.230 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:22.230 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.231 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.231 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:22.231 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:22.231 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:22.231 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.231 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.231 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:22.231 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617928+0000", 2024-04-18T21:06:22.231 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5430000000000001e-06 2024-04-18T21:06:22.231 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.231 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.231 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:22.231 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617937+0000", 2024-04-18T21:06:22.231 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6629999999999999e-06 2024-04-18T21:06:22.231 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.231 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.232 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:22.232 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617955+0000", 2024-04-18T21:06:22.232 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8749999999999998e-05 2024-04-18T21:06:22.232 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.232 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.232 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:22.232 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617971+0000", 2024-04-18T21:06:22.232 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.605e-05 2024-04-18T21:06:22.232 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.232 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.232 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:22.232 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621019+0000", 2024-04-18T21:06:22.232 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0030472369999999999 2024-04-18T21:06:22.232 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.233 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.233 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:22.233 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621249+0000", 2024-04-18T21:06:22.233 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000230075 2024-04-18T21:06:22.233 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.233 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.233 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:22.233 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621450+0000", 2024-04-18T21:06:22.233 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020166499999999999 2024-04-18T21:06:22.233 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.233 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.233 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:22.233 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.626233+0000", 2024-04-18T21:06:22.233 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047827390000000003 2024-04-18T21:06:22.234 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.234 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.234 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:22.234 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642693+0000", 2024-04-18T21:06:22.234 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01645961 2024-04-18T21:06:22.234 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.234 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.234 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:22.234 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642798+0000", 2024-04-18T21:06:22.234 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010559499999999999 2024-04-18T21:06:22.234 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.234 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.234 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:22.235 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642883+0000", 2024-04-18T21:06:22.235 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5048000000000003e-05 2024-04-18T21:06:22.235 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:22.235 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:22.235 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:22.235 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.235 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.235 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:22.235 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:22.235 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 76.521133136000003, 2024-04-18T21:06:22.235 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024086478000000001, 2024-04-18T21:06:22.235 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:22.235 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:22.235 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:22.235 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:22.236 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.236 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:22.236 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:22.236 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:22.236 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.236 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.236 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:22.236 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:22.236 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:22.236 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.236 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.236 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:22.236 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619624+0000", 2024-04-18T21:06:22.236 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.75e-06 2024-04-18T21:06:22.236 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.236 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.237 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:22.237 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619637+0000", 2024-04-18T21:06:22.237 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3540000000000001e-05 2024-04-18T21:06:22.237 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.237 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.237 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:22.237 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619666+0000", 2024-04-18T21:06:22.237 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8685999999999999e-05 2024-04-18T21:06:22.237 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.237 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.237 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:22.237 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619685+0000", 2024-04-18T21:06:22.237 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8681999999999998e-05 2024-04-18T21:06:22.237 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.237 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.238 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:22.238 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622275+0000", 2024-04-18T21:06:22.238 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0025899260000000002 2024-04-18T21:06:22.238 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.238 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.238 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:22.238 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622572+0000", 2024-04-18T21:06:22.238 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00029722 2024-04-18T21:06:22.238 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.238 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.238 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:22.238 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622752+0000", 2024-04-18T21:06:22.238 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018065900000000001 2024-04-18T21:06:22.238 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.239 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.239 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:22.239 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.626326+0000", 2024-04-18T21:06:22.239 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035737310000000001 2024-04-18T21:06:22.239 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.239 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.239 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:22.239 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643565+0000", 2024-04-18T21:06:22.239 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017238430999999999 2024-04-18T21:06:22.239 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.239 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.239 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:22.239 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643646+0000", 2024-04-18T21:06:22.239 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.1481000000000001e-05 2024-04-18T21:06:22.239 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.240 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.240 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:22.240 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643708+0000", 2024-04-18T21:06:22.240 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.2372000000000005e-05 2024-04-18T21:06:22.240 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:22.240 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:22.240 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:22.240 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.240 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.240 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:22.240 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:22.240 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 76.520966982999994, 2024-04-18T21:06:22.240 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026822450000000001, 2024-04-18T21:06:22.240 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:22.241 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:22.241 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:22.241 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:22.241 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.241 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:22.241 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:22.241 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:22.241 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.241 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.241 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:22.241 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:22.241 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:22.241 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.241 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.241 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:22.242 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619789+0000", 2024-04-18T21:06:22.242 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:06:22.242 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.242 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.242 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:22.242 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619797+0000", 2024-04-18T21:06:22.242 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.6899999999999992e-06 2024-04-18T21:06:22.242 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.242 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.242 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:22.242 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619816+0000", 2024-04-18T21:06:22.242 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9352999999999999e-05 2024-04-18T21:06:22.242 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.242 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.243 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:22.243 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619832+0000", 2024-04-18T21:06:22.243 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6013000000000001e-05 2024-04-18T21:06:22.243 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.243 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.243 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:22.243 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620528+0000", 2024-04-18T21:06:22.243 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00069565600000000001 2024-04-18T21:06:22.243 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.243 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.243 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:22.243 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620735+0000", 2024-04-18T21:06:22.243 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000207025 2024-04-18T21:06:22.243 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.244 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.244 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:22.244 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620912+0000", 2024-04-18T21:06:22.244 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017748199999999999 2024-04-18T21:06:22.244 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.244 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.244 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:22.244 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.625605+0000", 2024-04-18T21:06:22.244 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0046924439999999996 2024-04-18T21:06:22.244 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.244 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.244 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:22.244 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646349+0000", 2024-04-18T21:06:22.244 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.020744318000000001 2024-04-18T21:06:22.245 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.245 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.245 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:22.245 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646483+0000", 2024-04-18T21:06:22.245 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013428999999999999 2024-04-18T21:06:22.245 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.245 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.245 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:22.245 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646611+0000", 2024-04-18T21:06:22.245 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012710299999999999 2024-04-18T21:06:22.245 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:22.245 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:22.245 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:22.245 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.245 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.246 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:22.246 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:06:22.246 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 76.520296549999998, 2024-04-18T21:06:22.246 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023516516000000001, 2024-04-18T21:06:22.246 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:22.246 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:22.246 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:06:22.246 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:22.246 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.246 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:22.246 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:06:22.246 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:22.246 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.246 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.247 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:22.247 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:06:22.247 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:22.247 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.247 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.247 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:22.247 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620460+0000", 2024-04-18T21:06:22.247 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.787e-06 2024-04-18T21:06:22.247 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.247 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.247 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:22.247 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620470+0000", 2024-04-18T21:06:22.247 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.2560000000000008e-06 2024-04-18T21:06:22.247 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.247 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.247 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:22.248 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620496+0000", 2024-04-18T21:06:22.248 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.6205999999999999e-05 2024-04-18T21:06:22.248 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.248 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.248 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:22.248 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620517+0000", 2024-04-18T21:06:22.248 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1223e-05 2024-04-18T21:06:22.248 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.248 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.248 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:22.248 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624060+0000", 2024-04-18T21:06:22.248 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035434160000000002 2024-04-18T21:06:22.248 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.248 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.249 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:22.249 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624390+0000", 2024-04-18T21:06:22.249 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00033000500000000002 2024-04-18T21:06:22.249 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:22.249 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:22.249 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:22.249 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643975+0000", 2024-04-18T21:06:22.249 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019584622999999999 2024-04-18T21:06:22.249 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:22.249 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:22.249 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:22.249 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:22.249 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:22.249 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:22.251 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:22.251 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:22.250+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:22.352 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:22.350+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:22.384 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:06:22.384 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [], 2024-04-18T21:06:22.384 INFO:teuthology.orchestra.run.smithi150.stdout: "num_ops": 0 2024-04-18T21:06:22.384 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:06:22.399 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:22.452 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:22.454+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:22.520 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:06:22.520 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [], 2024-04-18T21:06:22.520 INFO:teuthology.orchestra.run.smithi150.stdout: "complaint_time": 30, 2024-04-18T21:06:22.521 INFO:teuthology.orchestra.run.smithi150.stdout: "num_blocked_ops": 0 2024-04-18T21:06:22.521 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:06:22.535 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:22.553 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:22.554+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:22.622 INFO:teuthology.orchestra.run.smithi078.stderr:noscrub is set 2024-04-18T21:06:22.654 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:06:22.654 INFO:teuthology.orchestra.run.smithi150.stdout: "size": 20, 2024-04-18T21:06:22.654 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 600, 2024-04-18T21:06:22.654 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [ 2024-04-18T21:06:22.654 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.654 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-18T21:06:22.654 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:06:22.654 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 87.850788158, 2024-04-18T21:06:22.655 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0093051590000000003, 2024-04-18T21:06:22.655 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:22.655 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:22.655 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:22.655 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:22.655 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.655 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:22.655 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:06:22.655 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:22.655 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.655 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.655 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:22.655 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:06:22.655 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:22.655 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.656 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.656 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:22.656 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804851+0000", 2024-04-18T21:06:22.656 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7039999999999999e-06 2024-04-18T21:06:22.656 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.656 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.656 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:22.656 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804864+0000", 2024-04-18T21:06:22.656 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.276e-05 2024-04-18T21:06:22.656 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.656 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.656 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:22.656 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804895+0000", 2024-04-18T21:06:22.656 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.1204999999999997e-05 2024-04-18T21:06:22.656 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.656 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.657 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:22.657 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804908+0000", 2024-04-18T21:06:22.657 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3317e-05 2024-04-18T21:06:22.657 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.657 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.657 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:22.657 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805131+0000", 2024-04-18T21:06:22.657 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00022246700000000001 2024-04-18T21:06:22.657 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.657 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.657 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:22.657 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805171+0000", 2024-04-18T21:06:22.657 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.0164999999999999e-05 2024-04-18T21:06:22.657 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.657 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.658 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:22.658 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814086+0000", 2024-04-18T21:06:22.658 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0089155329999999998 2024-04-18T21:06:22.658 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.658 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.658 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:22.658 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814154+0000", 2024-04-18T21:06:22.658 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.8008000000000003e-05 2024-04-18T21:06:22.658 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:22.658 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:22.658 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:22.658 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.658 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.658 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-18T21:06:22.658 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:06:22.659 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 87.850022964999994, 2024-04-18T21:06:22.659 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0086469770000000001, 2024-04-18T21:06:22.659 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:22.659 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:22.659 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:22.659 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:22.659 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.659 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:22.659 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:06:22.659 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:22.659 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.659 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.659 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:22.659 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:06:22.659 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:22.660 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.660 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.660 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:22.660 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805616+0000", 2024-04-18T21:06:22.660 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7799999999999999e-06 2024-04-18T21:06:22.660 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.660 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.660 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:22.660 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805707+0000", 2024-04-18T21:06:22.660 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0917999999999999e-05 2024-04-18T21:06:22.660 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.660 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.660 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:22.660 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805739+0000", 2024-04-18T21:06:22.660 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.2512000000000003e-05 2024-04-18T21:06:22.660 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.661 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.661 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:22.661 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805763+0000", 2024-04-18T21:06:22.661 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3266000000000001e-05 2024-04-18T21:06:22.661 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.661 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.661 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:22.661 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.806024+0000", 2024-04-18T21:06:22.661 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000261716 2024-04-18T21:06:22.661 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.661 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.661 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:22.661 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.806073+0000", 2024-04-18T21:06:22.661 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.8844999999999997e-05 2024-04-18T21:06:22.661 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.662 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.662 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:22.662 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814162+0000", 2024-04-18T21:06:22.662 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0080882860000000001 2024-04-18T21:06:22.662 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.662 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.662 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:22.662 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814261+0000", 2024-04-18T21:06:22.662 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.9654000000000005e-05 2024-04-18T21:06:22.662 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:22.662 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:22.662 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:22.662 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.662 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.663 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'64)", 2024-04-18T21:06:22.663 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:06:22.663 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 87.848251920999999, 2024-04-18T21:06:22.663 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0089721509999999994, 2024-04-18T21:06:22.663 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:22.663 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:22.663 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:22.663 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:22.663 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.663 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:22.663 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:06:22.663 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:22.663 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.663 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.663 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:22.663 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:06:22.664 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:22.664 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.664 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.664 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:22.664 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807387+0000", 2024-04-18T21:06:22.664 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.0329999999999998e-06 2024-04-18T21:06:22.664 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.664 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.664 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:22.664 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807443+0000", 2024-04-18T21:06:22.664 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.5376e-05 2024-04-18T21:06:22.664 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.664 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.664 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:22.665 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807467+0000", 2024-04-18T21:06:22.665 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.4621999999999999e-05 2024-04-18T21:06:22.665 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.665 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.665 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:22.665 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807482+0000", 2024-04-18T21:06:22.665 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.436e-05 2024-04-18T21:06:22.665 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.665 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.665 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:22.665 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.809243+0000", 2024-04-18T21:06:22.665 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001761725 2024-04-18T21:06:22.665 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.665 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.665 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:22.666 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.809295+0000", 2024-04-18T21:06:22.666 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.1445e-05 2024-04-18T21:06:22.666 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.666 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.666 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:22.666 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.816293+0000", 2024-04-18T21:06:22.666 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0069981749999999997 2024-04-18T21:06:22.666 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.666 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.666 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:22.666 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.816357+0000", 2024-04-18T21:06:22.666 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.4414999999999999e-05 2024-04-18T21:06:22.666 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:22.666 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:22.667 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:22.667 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.667 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.667 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:22.667 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:06:22.667 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 77.040342550999995, 2024-04-18T21:06:22.667 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.040843365, 2024-04-18T21:06:22.667 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:22.667 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:22.667 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:22.667 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:22.667 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.667 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:22.667 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:06:22.668 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:22.668 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.668 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.668 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:22.668 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:06:22.668 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:22.668 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.668 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.668 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:22.668 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615297+0000", 2024-04-18T21:06:22.668 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2800000000000002e-06 2024-04-18T21:06:22.668 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.668 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.668 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:22.668 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615308+0000", 2024-04-18T21:06:22.669 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0813e-05 2024-04-18T21:06:22.669 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.669 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.669 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:22.669 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615330+0000", 2024-04-18T21:06:22.669 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2370000000000001e-05 2024-04-18T21:06:22.669 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.669 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.669 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:22.669 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615346+0000", 2024-04-18T21:06:22.669 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6200000000000001e-05 2024-04-18T21:06:22.669 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.669 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.669 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:22.670 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615470+0000", 2024-04-18T21:06:22.670 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012385799999999999 2024-04-18T21:06:22.670 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.670 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.670 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:22.670 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615488+0000", 2024-04-18T21:06:22.670 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7923000000000001e-05 2024-04-18T21:06:22.670 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.670 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.670 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:22.670 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.630993+0000", 2024-04-18T21:06:22.670 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.01550532 2024-04-18T21:06:22.670 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.670 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.671 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:22.671 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631165+0000", 2024-04-18T21:06:22.671 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000171588 2024-04-18T21:06:22.671 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.671 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.671 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:22.671 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631320+0000", 2024-04-18T21:06:22.671 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000155162 2024-04-18T21:06:22.671 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.671 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.671 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:22.671 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635157+0000", 2024-04-18T21:06:22.671 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0038370790000000002 2024-04-18T21:06:22.671 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.672 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.672 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:22.672 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.655904+0000", 2024-04-18T21:06:22.672 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.020746483999999999 2024-04-18T21:06:22.672 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.672 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.672 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:22.672 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656032+0000", 2024-04-18T21:06:22.672 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012864199999999999 2024-04-18T21:06:22.672 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.672 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.672 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:22.672 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656138+0000", 2024-04-18T21:06:22.672 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000105646 2024-04-18T21:06:22.672 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:22.673 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:22.673 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:22.673 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.673 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.673 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:22.673 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:06:22.673 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 77.040250379, 2024-04-18T21:06:22.673 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.041266444999999999, 2024-04-18T21:06:22.673 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:22.673 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:22.673 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:22.673 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:22.673 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.673 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:22.673 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:06:22.674 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:22.674 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.674 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.674 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:22.674 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:06:22.674 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:22.674 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.674 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.674 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:22.674 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615388+0000", 2024-04-18T21:06:22.674 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:06:22.674 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.674 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.675 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:22.675 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:06:22.675 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.7299999999999994e-06 2024-04-18T21:06:22.675 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.675 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.675 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:22.675 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615415+0000", 2024-04-18T21:06:22.675 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7807000000000001e-05 2024-04-18T21:06:22.675 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.675 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.675 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:22.675 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615431+0000", 2024-04-18T21:06:22.675 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6127e-05 2024-04-18T21:06:22.675 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.675 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.676 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:22.676 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615621+0000", 2024-04-18T21:06:22.676 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000189781 2024-04-18T21:06:22.676 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.676 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.676 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:22.676 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615634+0000", 2024-04-18T21:06:22.676 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3383e-05 2024-04-18T21:06:22.676 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.676 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.676 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:22.676 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631703+0000", 2024-04-18T21:06:22.676 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016068737 2024-04-18T21:06:22.676 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.676 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.677 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:22.677 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631809+0000", 2024-04-18T21:06:22.677 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000106823 2024-04-18T21:06:22.677 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.677 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.677 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:22.677 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631988+0000", 2024-04-18T21:06:22.677 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000179008 2024-04-18T21:06:22.677 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.677 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.677 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:22.677 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635172+0000", 2024-04-18T21:06:22.677 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.003183029 2024-04-18T21:06:22.677 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.677 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.678 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:22.678 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656392+0000", 2024-04-18T21:06:22.678 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.021220638999999999 2024-04-18T21:06:22.678 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.678 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.678 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:22.678 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656533+0000", 2024-04-18T21:06:22.678 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014126500000000001 2024-04-18T21:06:22.678 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.678 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.678 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:22.678 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656653+0000", 2024-04-18T21:06:22.678 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000119883 2024-04-18T21:06:22.678 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:22.679 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:22.679 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:22.679 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.679 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.679 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:22.679 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:06:22.679 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 77.040162956000003, 2024-04-18T21:06:22.679 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.042492302000000003, 2024-04-18T21:06:22.679 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:22.679 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:22.679 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:22.679 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:22.679 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.679 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:22.680 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:06:22.680 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:22.680 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.680 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.680 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:22.680 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:06:22.680 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:22.680 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.680 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.680 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:22.680 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615475+0000", 2024-04-18T21:06:22.680 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.17e-06 2024-04-18T21:06:22.680 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.680 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.680 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:22.681 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615528+0000", 2024-04-18T21:06:22.681 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.2159e-05 2024-04-18T21:06:22.681 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.681 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.681 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:22.681 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615542+0000", 2024-04-18T21:06:22.681 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4197e-05 2024-04-18T21:06:22.681 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.681 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.681 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:22.681 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615559+0000", 2024-04-18T21:06:22.681 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.749e-05 2024-04-18T21:06:22.681 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.681 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.682 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:22.682 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615685+0000", 2024-04-18T21:06:22.682 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012617499999999999 2024-04-18T21:06:22.682 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.682 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.682 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:22.682 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:06:22.682 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4749999999999999e-05 2024-04-18T21:06:22.682 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.682 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.682 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:22.682 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632332+0000", 2024-04-18T21:06:22.682 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016631988 2024-04-18T21:06:22.682 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.683 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.683 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:22.683 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632477+0000", 2024-04-18T21:06:22.683 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014437200000000001 2024-04-18T21:06:22.683 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.683 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.683 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:22.683 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632620+0000", 2024-04-18T21:06:22.683 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000143566 2024-04-18T21:06:22.683 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.683 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.683 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:22.683 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635185+0000", 2024-04-18T21:06:22.683 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0025644209999999999 2024-04-18T21:06:22.684 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.684 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.684 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:22.684 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657803+0000", 2024-04-18T21:06:22.684 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.022618743 2024-04-18T21:06:22.684 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.684 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.684 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:22.684 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657890+0000", 2024-04-18T21:06:22.684 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.6688999999999996e-05 2024-04-18T21:06:22.684 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.684 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.684 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:22.684 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657967+0000", 2024-04-18T21:06:22.684 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.6582000000000006e-05 2024-04-18T21:06:22.685 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:22.685 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:22.685 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:22.685 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.685 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.685 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:22.685 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:06:22.685 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 77.040032143999994, 2024-04-18T21:06:22.685 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.043603435000000003, 2024-04-18T21:06:22.685 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:22.685 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:22.685 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:22.685 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:22.685 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.685 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:22.686 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:06:22.686 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:22.686 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.686 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.686 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:22.686 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:06:22.686 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:22.686 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.686 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.686 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:22.686 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615607+0000", 2024-04-18T21:06:22.686 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4300000000000001e-06 2024-04-18T21:06:22.686 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.686 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.687 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:22.687 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615614+0000", 2024-04-18T21:06:22.687 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.4100000000000002e-06 2024-04-18T21:06:22.687 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.687 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.687 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:22.687 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615632+0000", 2024-04-18T21:06:22.687 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7863000000000002e-05 2024-04-18T21:06:22.687 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.687 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.687 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:22.687 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615647+0000", 2024-04-18T21:06:22.687 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5187e-05 2024-04-18T21:06:22.687 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.688 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.688 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:22.688 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615765+0000", 2024-04-18T21:06:22.688 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000117955 2024-04-18T21:06:22.688 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.688 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.688 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:22.688 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615781+0000", 2024-04-18T21:06:22.688 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6123000000000001e-05 2024-04-18T21:06:22.688 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.688 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.688 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:22.688 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633055+0000", 2024-04-18T21:06:22.688 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.017273909 2024-04-18T21:06:22.688 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.689 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.689 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:22.689 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633254+0000", 2024-04-18T21:06:22.689 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00019903799999999999 2024-04-18T21:06:22.689 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.689 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.689 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:22.689 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633624+0000", 2024-04-18T21:06:22.689 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000369656 2024-04-18T21:06:22.689 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.689 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.689 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:22.689 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635595+0000", 2024-04-18T21:06:22.689 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001971287 2024-04-18T21:06:22.689 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.690 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.690 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:22.690 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659026+0000", 2024-04-18T21:06:22.690 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.023431495 2024-04-18T21:06:22.690 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.690 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.690 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:22.690 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659117+0000", 2024-04-18T21:06:22.690 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0885999999999997e-05 2024-04-18T21:06:22.690 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.690 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.690 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:22.690 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659209+0000", 2024-04-18T21:06:22.690 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.1195999999999999e-05 2024-04-18T21:06:22.691 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:22.691 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:22.691 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:22.691 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.691 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.691 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:22.691 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:22.691 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 77.039966914999994, 2024-04-18T21:06:22.691 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.03492514, 2024-04-18T21:06:22.691 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:22.691 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:22.691 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:22.691 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:22.691 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.692 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:22.692 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:22.692 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:22.692 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.692 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.692 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:22.692 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:22.692 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:22.692 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.692 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.692 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:22.692 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:06:22.692 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.407e-06 2024-04-18T21:06:22.692 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.692 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.693 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:22.693 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615679+0000", 2024-04-18T21:06:22.693 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.2130000000000002e-06 2024-04-18T21:06:22.693 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.693 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.693 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:22.693 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615701+0000", 2024-04-18T21:06:22.693 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2316000000000001e-05 2024-04-18T21:06:22.693 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.693 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.693 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:22.693 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615717+0000", 2024-04-18T21:06:22.693 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6197000000000001e-05 2024-04-18T21:06:22.693 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.693 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.694 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:22.694 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615828+0000", 2024-04-18T21:06:22.694 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000110899 2024-04-18T21:06:22.694 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.694 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.694 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:22.694 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615840+0000", 2024-04-18T21:06:22.694 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.1423000000000001e-05 2024-04-18T21:06:22.694 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.694 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.694 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:22.694 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628046+0000", 2024-04-18T21:06:22.694 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.012206295000000001 2024-04-18T21:06:22.694 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.695 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.695 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:22.695 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628323+0000", 2024-04-18T21:06:22.695 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00027658700000000001 2024-04-18T21:06:22.695 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.695 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.695 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:22.695 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628599+0000", 2024-04-18T21:06:22.695 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00027676699999999997 2024-04-18T21:06:22.695 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.695 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.695 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:22.695 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634869+0000", 2024-04-18T21:06:22.695 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.006269536 2024-04-18T21:06:22.696 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.696 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.696 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:22.696 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650333+0000", 2024-04-18T21:06:22.696 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.015463645999999999 2024-04-18T21:06:22.696 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.696 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.696 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:22.696 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650474+0000", 2024-04-18T21:06:22.696 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014091799999999999 2024-04-18T21:06:22.696 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.696 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.696 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:22.696 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650595+0000", 2024-04-18T21:06:22.696 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012193600000000001 2024-04-18T21:06:22.697 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:22.697 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:22.697 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:22.697 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.697 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.697 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:22.697 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:06:22.697 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 77.039881805999997, 2024-04-18T21:06:22.697 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.040588320999999997, 2024-04-18T21:06:22.697 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:22.697 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:22.697 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:22.697 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:22.697 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.698 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:22.698 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:06:22.698 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:22.698 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.698 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.698 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:22.698 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:06:22.698 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:22.698 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.698 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.698 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:22.698 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615757+0000", 2024-04-18T21:06:22.698 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2270000000000001e-06 2024-04-18T21:06:22.698 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.698 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.699 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:22.699 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615765+0000", 2024-04-18T21:06:22.699 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.9400000000000002e-06 2024-04-18T21:06:22.699 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.699 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.699 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:22.699 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615785+0000", 2024-04-18T21:06:22.699 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.0749000000000001e-05 2024-04-18T21:06:22.699 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.699 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.699 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:22.699 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615804+0000", 2024-04-18T21:06:22.699 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.8774e-05 2024-04-18T21:06:22.699 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.700 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.700 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:22.700 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615888+0000", 2024-04-18T21:06:22.700 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.4111999999999997e-05 2024-04-18T21:06:22.700 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.700 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.700 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:22.700 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615895+0000", 2024-04-18T21:06:22.700 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.0469999999999996e-06 2024-04-18T21:06:22.700 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.700 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.700 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:22.700 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629280+0000", 2024-04-18T21:06:22.700 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.013384416 2024-04-18T21:06:22.700 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.701 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.701 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:22.701 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629488+0000", 2024-04-18T21:06:22.701 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00020852800000000001 2024-04-18T21:06:22.701 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.701 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.701 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:22.701 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629869+0000", 2024-04-18T21:06:22.701 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00038042300000000001 2024-04-18T21:06:22.701 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.701 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.701 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:22.701 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635041+0000", 2024-04-18T21:06:22.701 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.005172383 2024-04-18T21:06:22.701 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.702 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.702 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:22.702 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656125+0000", 2024-04-18T21:06:22.702 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.021084025999999999 2024-04-18T21:06:22.702 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.702 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.702 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:22.702 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656240+0000", 2024-04-18T21:06:22.702 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000115352 2024-04-18T21:06:22.702 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.702 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.702 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:22.702 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656344+0000", 2024-04-18T21:06:22.702 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00010334400000000001 2024-04-18T21:06:22.703 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:22.703 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:22.703 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:22.703 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.703 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.703 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:22.703 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:22.703 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 77.039814485999997, 2024-04-18T21:06:22.703 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.043549577999999999, 2024-04-18T21:06:22.703 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:22.703 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:22.703 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:22.703 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:22.703 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.703 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:22.704 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:22.704 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:22.704 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.704 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.704 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:22.704 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:22.704 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:22.704 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.704 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.704 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:22.704 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:22.704 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.5000000000000002e-07 2024-04-18T21:06:22.704 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.704 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.705 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:22.705 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615828+0000", 2024-04-18T21:06:22.705 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.2359999999999998e-06 2024-04-18T21:06:22.705 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.705 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.705 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:22.705 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615838+0000", 2024-04-18T21:06:22.705 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0087e-05 2024-04-18T21:06:22.705 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.705 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.705 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:22.705 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615846+0000", 2024-04-18T21:06:22.705 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.67e-06 2024-04-18T21:06:22.705 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.705 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.706 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:22.706 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615963+0000", 2024-04-18T21:06:22.706 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00011630500000000001 2024-04-18T21:06:22.706 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.706 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.706 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:22.706 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615979+0000", 2024-04-18T21:06:22.706 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.613e-05 2024-04-18T21:06:22.706 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.706 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.706 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:22.706 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632392+0000", 2024-04-18T21:06:22.706 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016413317 2024-04-18T21:06:22.706 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.707 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.707 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:22.707 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632568+0000", 2024-04-18T21:06:22.707 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00017539500000000001 2024-04-18T21:06:22.707 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.707 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.707 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:22.707 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632748+0000", 2024-04-18T21:06:22.707 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00017991799999999999 2024-04-18T21:06:22.707 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.707 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.707 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:22.707 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635542+0000", 2024-04-18T21:06:22.707 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00279481 2024-04-18T21:06:22.708 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.708 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.708 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:22.708 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659232+0000", 2024-04-18T21:06:22.708 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.023689212000000001 2024-04-18T21:06:22.708 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.708 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.708 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:22.708 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659314+0000", 2024-04-18T21:06:22.708 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.2528999999999995e-05 2024-04-18T21:06:22.708 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.708 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.708 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:22.708 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659372+0000", 2024-04-18T21:06:22.708 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.8218999999999999e-05 2024-04-18T21:06:22.709 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:22.709 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:22.709 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:22.709 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.709 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.709 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:22.709 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:06:22.709 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 77.039753054000002, 2024-04-18T21:06:22.709 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.039335347, 2024-04-18T21:06:22.709 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:22.709 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:22.709 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "started", 2024-04-18T21:06:22.709 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:22.709 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.710 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:22.710 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:06:22.710 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:22.710 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.710 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.710 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:22.710 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:06:22.710 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:22.710 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.710 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.710 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:22.710 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615885+0000", 2024-04-18T21:06:22.710 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2699999999999999e-06 2024-04-18T21:06:22.710 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.710 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.711 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:22.711 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615892+0000", 2024-04-18T21:06:22.711 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.6499999999999999e-06 2024-04-18T21:06:22.711 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.711 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.711 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:22.711 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615906+0000", 2024-04-18T21:06:22.711 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.393e-05 2024-04-18T21:06:22.711 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.711 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.711 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:22.711 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615919+0000", 2024-04-18T21:06:22.711 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2860000000000001e-05 2024-04-18T21:06:22.711 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.712 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.712 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:22.712 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616027+0000", 2024-04-18T21:06:22.712 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000107852 2024-04-18T21:06:22.712 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.712 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.712 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:22.712 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616037+0000", 2024-04-18T21:06:22.712 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:06:22.712 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.712 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.712 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:22.712 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622719+0000", 2024-04-18T21:06:22.712 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0066817220000000002 2024-04-18T21:06:22.712 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.712 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.713 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:22.713 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623006+0000", 2024-04-18T21:06:22.713 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00028783699999999999 2024-04-18T21:06:22.713 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.713 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.713 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:22.713 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.655220+0000", 2024-04-18T21:06:22.713 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.032213036 2024-04-18T21:06:22.713 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:22.713 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:22.713 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:22.713 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.713 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.713 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:22.713 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:22.714 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 77.039697380999996, 2024-04-18T21:06:22.714 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.032845253999999997, 2024-04-18T21:06:22.714 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:22.714 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:22.714 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "started", 2024-04-18T21:06:22.714 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:22.714 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.714 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:22.714 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:22.714 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:22.714 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.714 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.714 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:22.714 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:22.715 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:22.715 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.715 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.715 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:22.715 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615942+0000", 2024-04-18T21:06:22.715 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.717e-06 2024-04-18T21:06:22.715 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.715 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.715 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:22.715 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615946+0000", 2024-04-18T21:06:22.715 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.6e-06 2024-04-18T21:06:22.715 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.715 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.715 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:22.715 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615960+0000", 2024-04-18T21:06:22.716 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:06:22.716 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.716 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.716 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:22.716 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615968+0000", 2024-04-18T21:06:22.716 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.9070000000000007e-06 2024-04-18T21:06:22.716 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.716 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.716 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:22.716 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616100+0000", 2024-04-18T21:06:22.716 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000132402 2024-04-18T21:06:22.716 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.716 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.716 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:22.716 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616117+0000", 2024-04-18T21:06:22.717 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6653000000000001e-05 2024-04-18T21:06:22.717 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.717 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.717 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:22.717 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621566+0000", 2024-04-18T21:06:22.717 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0054497740000000001 2024-04-18T21:06:22.717 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.717 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.717 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:22.717 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622801+0000", 2024-04-18T21:06:22.717 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0012345710000000001 2024-04-18T21:06:22.717 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.717 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.717 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:22.717 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648785+0000", 2024-04-18T21:06:22.717 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.025984104000000001 2024-04-18T21:06:22.718 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:22.718 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:22.718 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:22.718 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.718 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.718 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:22.718 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:06:22.718 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 77.033846030999996, 2024-04-18T21:06:22.718 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.011561350999999999, 2024-04-18T21:06:22.718 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:22.718 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:22.718 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:22.718 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:22.718 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.719 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:22.719 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:06:22.719 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:22.719 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.719 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.719 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:22.719 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:06:22.719 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:22.719 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.719 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.719 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:22.719 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621792+0000", 2024-04-18T21:06:22.719 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.4000000000000001e-07 2024-04-18T21:06:22.719 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.719 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.720 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:22.720 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:06:22.720 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.1050000000000002e-05 2024-04-18T21:06:22.720 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.720 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.720 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:22.720 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622608+0000", 2024-04-18T21:06:22.720 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00077505900000000003 2024-04-18T21:06:22.720 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.720 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.720 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:22.720 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623879+0000", 2024-04-18T21:06:22.720 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0012705839999999999 2024-04-18T21:06:22.720 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.721 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.721 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:22.721 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624010+0000", 2024-04-18T21:06:22.721 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00013176900000000001 2024-04-18T21:06:22.721 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.721 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.721 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:22.721 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624058+0000", 2024-04-18T21:06:22.721 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.7299000000000002e-05 2024-04-18T21:06:22.721 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.721 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.721 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:22.721 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633262+0000", 2024-04-18T21:06:22.721 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0092048770000000002 2024-04-18T21:06:22.721 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.722 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.722 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:22.722 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633353+0000", 2024-04-18T21:06:22.722 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0073000000000003e-05 2024-04-18T21:06:22.722 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:22.722 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:22.722 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:22.722 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.722 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.722 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:22.722 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:06:22.722 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 77.031718644999998, 2024-04-18T21:06:22.722 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0098419370000000003, 2024-04-18T21:06:22.722 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:22.723 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:22.723 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:22.723 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:22.723 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.723 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:22.723 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:06:22.723 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:22.723 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.723 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.723 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:22.723 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:06:22.723 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:22.723 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.723 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.723 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:22.724 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623920+0000", 2024-04-18T21:06:22.724 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2240000000000001e-06 2024-04-18T21:06:22.724 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.724 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.724 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:22.724 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623933+0000", 2024-04-18T21:06:22.724 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3653e-05 2024-04-18T21:06:22.724 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.724 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.724 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:22.724 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623956+0000", 2024-04-18T21:06:22.724 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2059e-05 2024-04-18T21:06:22.724 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.724 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.725 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:22.725 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623975+0000", 2024-04-18T21:06:22.725 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.9806999999999999e-05 2024-04-18T21:06:22.725 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.725 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.725 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:22.725 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626943+0000", 2024-04-18T21:06:22.725 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0029681579999999998 2024-04-18T21:06:22.725 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.725 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.725 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:22.725 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626993+0000", 2024-04-18T21:06:22.725 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.9935999999999998e-05 2024-04-18T21:06:22.725 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.726 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.726 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:22.726 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633665+0000", 2024-04-18T21:06:22.726 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0066719250000000004 2024-04-18T21:06:22.726 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.726 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.726 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:22.726 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633761+0000", 2024-04-18T21:06:22.726 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.5174999999999996e-05 2024-04-18T21:06:22.726 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:22.726 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:22.726 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:22.726 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.726 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.726 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:22.727 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:06:22.727 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 77.030887026000002, 2024-04-18T21:06:22.727 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0090159079999999996, 2024-04-18T21:06:22.727 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:22.727 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:22.727 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:22.727 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:22.727 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.727 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:22.727 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:06:22.727 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:22.727 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.727 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.727 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:22.727 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:06:22.728 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:22.728 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.728 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.728 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:22.728 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624751+0000", 2024-04-18T21:06:22.728 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.7600000000000006e-07 2024-04-18T21:06:22.728 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.728 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.728 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:22.728 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624787+0000", 2024-04-18T21:06:22.728 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.6273000000000003e-05 2024-04-18T21:06:22.728 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.728 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.728 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:22.728 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625837+0000", 2024-04-18T21:06:22.729 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00104992 2024-04-18T21:06:22.729 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.729 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.729 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:22.729 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625860+0000", 2024-04-18T21:06:22.729 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3110000000000001e-05 2024-04-18T21:06:22.729 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.729 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.729 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:22.729 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625984+0000", 2024-04-18T21:06:22.729 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012399199999999999 2024-04-18T21:06:22.729 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.729 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.729 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:22.729 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626030+0000", 2024-04-18T21:06:22.730 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.5429999999999997e-05 2024-04-18T21:06:22.730 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.730 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.730 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:22.730 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633643+0000", 2024-04-18T21:06:22.730 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0076129320000000002 2024-04-18T21:06:22.730 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.730 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.730 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:22.730 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633766+0000", 2024-04-18T21:06:22.730 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000123275 2024-04-18T21:06:22.730 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:22.730 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:22.730 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:22.730 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.731 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.731 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:22.731 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:06:22.731 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 77.029633301999993, 2024-04-18T21:06:22.731 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0088669170000000002, 2024-04-18T21:06:22.731 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:22.731 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:22.731 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:22.731 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:22.731 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.731 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:22.731 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:06:22.731 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:22.731 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.732 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.732 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:22.732 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:06:22.732 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:22.732 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.732 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.732 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:22.732 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626005+0000", 2024-04-18T21:06:22.732 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.5000000000000001e-07 2024-04-18T21:06:22.732 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.732 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.732 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:22.732 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626028+0000", 2024-04-18T21:06:22.732 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2756999999999999e-05 2024-04-18T21:06:22.732 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.733 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.733 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:22.733 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626050+0000", 2024-04-18T21:06:22.733 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2140000000000001e-05 2024-04-18T21:06:22.733 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.733 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.733 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:22.733 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626065+0000", 2024-04-18T21:06:22.733 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5176e-05 2024-04-18T21:06:22.733 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.733 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.733 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:22.733 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628334+0000", 2024-04-18T21:06:22.733 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0022691439999999998 2024-04-18T21:06:22.734 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.734 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.734 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:22.734 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628379+0000", 2024-04-18T21:06:22.734 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.5420000000000002e-05 2024-04-18T21:06:22.734 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.734 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.734 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:22.734 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634770+0000", 2024-04-18T21:06:22.734 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0063908410000000004 2024-04-18T21:06:22.734 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.734 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.734 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:22.735 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634871+0000", 2024-04-18T21:06:22.735 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000100589 2024-04-18T21:06:22.735 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:22.735 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:22.735 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:22.735 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.735 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.735 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:13 3.10 e17/15 3:0d89b25e:::603.00000000:head v 17'8, mlcod=0'0)", 2024-04-18T21:06:22.735 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:06:22.735 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 77.010799872999996, 2024-04-18T21:06:22.735 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0090974379999999994, 2024-04-18T21:06:22.735 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:22.735 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:22.735 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:22.735 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:22.735 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.736 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:22.736 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:06:22.736 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:22.736 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.736 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.736 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:22.736 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:06:22.736 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:22.736 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.736 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.736 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:22.736 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644838+0000", 2024-04-18T21:06:22.736 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.569999999999999e-07 2024-04-18T21:06:22.736 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.737 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.737 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:22.737 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644846+0000", 2024-04-18T21:06:22.737 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.4499999999999998e-06 2024-04-18T21:06:22.737 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.737 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.737 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:22.737 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644861+0000", 2024-04-18T21:06:22.737 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5243e-05 2024-04-18T21:06:22.737 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.737 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.737 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:22.737 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644997+0000", 2024-04-18T21:06:22.737 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000135609 2024-04-18T21:06:22.737 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.738 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.738 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:22.738 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649150+0000", 2024-04-18T21:06:22.738 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0041536760000000002 2024-04-18T21:06:22.738 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.738 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.738 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:22.738 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649207+0000", 2024-04-18T21:06:22.738 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.6677e-05 2024-04-18T21:06:22.738 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.738 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.738 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:22.738 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.653840+0000", 2024-04-18T21:06:22.738 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0046329700000000001 2024-04-18T21:06:22.739 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.739 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.739 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:22.739 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.653935+0000", 2024-04-18T21:06:22.739 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.4856000000000001e-05 2024-04-18T21:06:22.739 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:22.739 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:22.739 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:22.739 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.739 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.739 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 3 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:06:22.739 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:06:22.739 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 77.008010713000004, 2024-04-18T21:06:22.739 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0087842319999999995, 2024-04-18T21:06:22.739 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:22.740 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:22.740 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "reached pg", 2024-04-18T21:06:22.740 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:22.740 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.740 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:22.740 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:06:22.740 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:22.740 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.740 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.740 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:22.740 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:06:22.740 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:22.740 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.740 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.741 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:22.741 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:06:22.741 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.8299999999999996e-07 2024-04-18T21:06:22.741 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.741 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.741 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:22.741 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647642+0000", 2024-04-18T21:06:22.741 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4724e-05 2024-04-18T21:06:22.741 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.741 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.741 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:22.741 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647679+0000", 2024-04-18T21:06:22.741 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.6662999999999998e-05 2024-04-18T21:06:22.741 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.742 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.742 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:22.742 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647735+0000", 2024-04-18T21:06:22.742 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.6196000000000002e-05 2024-04-18T21:06:22.742 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.742 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.742 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:22.742 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649865+0000", 2024-04-18T21:06:22.742 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0021299489999999999 2024-04-18T21:06:22.742 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.742 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.742 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:22.742 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656411+0000", 2024-04-18T21:06:22.742 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0065460170000000003 2024-04-18T21:06:22.743 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:22.743 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:22.743 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:22.743 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.743 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.743 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:22.743 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:06:22.743 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 77.007865516999999, 2024-04-18T21:06:22.743 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0095703190000000007, 2024-04-18T21:06:22.743 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:22.743 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:22.743 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:22.743 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:22.743 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.743 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:22.744 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:06:22.744 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:22.744 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.744 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.744 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:22.744 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:06:22.744 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:22.744 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.744 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.744 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:22.744 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647773+0000", 2024-04-18T21:06:22.744 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.046e-06 2024-04-18T21:06:22.744 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.744 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.744 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:22.745 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647795+0000", 2024-04-18T21:06:22.745 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2616000000000002e-05 2024-04-18T21:06:22.745 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.745 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.745 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:22.745 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647818+0000", 2024-04-18T21:06:22.745 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3110000000000001e-05 2024-04-18T21:06:22.745 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.745 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.745 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:22.745 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647834+0000", 2024-04-18T21:06:22.745 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5163e-05 2024-04-18T21:06:22.745 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.745 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.745 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:22.746 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650682+0000", 2024-04-18T21:06:22.746 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0028479759999999999 2024-04-18T21:06:22.746 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.746 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.746 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:22.746 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650730+0000", 2024-04-18T21:06:22.746 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.8375999999999999e-05 2024-04-18T21:06:22.746 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.746 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.746 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:22.746 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656751+0000", 2024-04-18T21:06:22.746 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0060211880000000002 2024-04-18T21:06:22.746 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.746 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.747 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:22.747 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657342+0000", 2024-04-18T21:06:22.747 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00059084399999999998 2024-04-18T21:06:22.747 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:22.747 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:22.747 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:22.747 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.747 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.747 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:22.747 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:06:22.747 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 77.007453231, 2024-04-18T21:06:22.747 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0092471759999999993, 2024-04-18T21:06:22.747 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:22.747 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:22.747 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:22.748 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:22.748 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.748 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:22.748 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:06:22.748 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:22.748 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.748 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.748 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:22.748 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:06:22.748 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:22.748 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.748 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.748 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:22.748 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648185+0000", 2024-04-18T21:06:22.748 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.5000000000000001e-07 2024-04-18T21:06:22.749 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.749 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.749 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:22.749 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648203+0000", 2024-04-18T21:06:22.749 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.8102999999999999e-05 2024-04-18T21:06:22.749 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.749 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.749 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:22.749 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648226+0000", 2024-04-18T21:06:22.749 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2921999999999998e-05 2024-04-18T21:06:22.749 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.749 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.749 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:22.749 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648241+0000", 2024-04-18T21:06:22.750 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5336999999999999e-05 2024-04-18T21:06:22.750 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.750 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.750 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:22.750 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.651268+0000", 2024-04-18T21:06:22.750 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0030271640000000002 2024-04-18T21:06:22.750 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.750 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.750 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:22.750 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.651319+0000", 2024-04-18T21:06:22.750 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.0843000000000001e-05 2024-04-18T21:06:22.750 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.750 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.750 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:22.750 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657347+0000", 2024-04-18T21:06:22.751 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0060279770000000003 2024-04-18T21:06:22.751 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:22.751 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:22.751 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:22.751 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657431+0000", 2024-04-18T21:06:22.751 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.3980000000000006e-05 2024-04-18T21:06:22.751 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:22.751 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:22.751 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:22.751 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:22.751 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:22.751 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:06:22.752 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:22.655+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:22.753 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:22.754 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:22.754+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:22.855 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:22.854+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:22.883 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:22.883 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:06:22.883 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-04-18T21:06:22.883 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:22.897 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:22.956 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:22.958+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:23.015 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:23.015 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:06:23.015 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-18T21:06:23.015 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-18T21:06:23.015 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:23.030 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:23.056 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:23.055+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:23.150 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:23.150 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-18T21:06:23.150 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-18T21:06:23.151 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:06:23.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.151 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:23.151 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:06:23.151 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 77.534760418000005, 2024-04-18T21:06:23.151 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.034065303999999998, 2024-04-18T21:06:23.151 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:23.151 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:23.151 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:23.151 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:23.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.151 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:23.151 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:06:23.151 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:23.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.152 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:23.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:06:23.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:23.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.152 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:23.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615254+0000", 2024-04-18T21:06:23.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7829999999999999e-06 2024-04-18T21:06:23.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.152 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:23.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615267+0000", 2024-04-18T21:06:23.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3334e-05 2024-04-18T21:06:23.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.153 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.153 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:23.153 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615294+0000", 2024-04-18T21:06:23.153 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7271999999999999e-05 2024-04-18T21:06:23.153 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.153 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.153 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:23.153 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615321+0000", 2024-04-18T21:06:23.153 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.637e-05 2024-04-18T21:06:23.153 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.153 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.153 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:23.153 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615479+0000", 2024-04-18T21:06:23.153 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000158493 2024-04-18T21:06:23.153 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.153 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.154 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:23.154 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615498+0000", 2024-04-18T21:06:23.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9148999999999999e-05 2024-04-18T21:06:23.154 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.154 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:23.154 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632915+0000", 2024-04-18T21:06:23.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.017416551999999998 2024-04-18T21:06:23.154 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.154 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:23.154 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633302+0000", 2024-04-18T21:06:23.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00038725000000000001 2024-04-18T21:06:23.154 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.154 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:23.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633638+0000", 2024-04-18T21:06:23.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000335946 2024-04-18T21:06:23.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:23.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645976+0000", 2024-04-18T21:06:23.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012337617 2024-04-18T21:06:23.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:23.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649080+0000", 2024-04-18T21:06:23.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031038929999999999 2024-04-18T21:06:23.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:23.156 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649207+0000", 2024-04-18T21:06:23.156 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000127537 2024-04-18T21:06:23.156 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.156 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.156 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:23.156 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649316+0000", 2024-04-18T21:06:23.156 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109108 2024-04-18T21:06:23.156 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:23.156 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:23.156 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:23.156 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.156 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.156 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:23.156 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:06:23.156 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 77.534627040999993, 2024-04-18T21:06:23.156 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036275764000000002, 2024-04-18T21:06:23.157 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:23.157 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:23.157 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:23.157 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:23.157 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.157 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:23.157 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:06:23.157 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:23.157 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.157 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.157 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:23.157 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:06:23.157 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:23.157 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.157 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.157 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:23.158 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615386+0000", 2024-04-18T21:06:23.158 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.573e-06 2024-04-18T21:06:23.158 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.158 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.158 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:23.158 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:06:23.158 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0723999999999999e-05 2024-04-18T21:06:23.158 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.158 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.158 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:23.158 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615418+0000", 2024-04-18T21:06:23.158 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0902000000000001e-05 2024-04-18T21:06:23.158 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.158 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.159 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:23.159 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615433+0000", 2024-04-18T21:06:23.159 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5319999999999999e-05 2024-04-18T21:06:23.159 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.159 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.159 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:23.159 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615659+0000", 2024-04-18T21:06:23.159 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000226095 2024-04-18T21:06:23.159 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.159 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.159 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:23.159 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:23.159 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1276e-05 2024-04-18T21:06:23.159 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.159 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.159 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:23.160 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643654+0000", 2024-04-18T21:06:23.160 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027983238000000001 2024-04-18T21:06:23.160 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.160 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.160 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:23.160 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643868+0000", 2024-04-18T21:06:23.160 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000214305 2024-04-18T21:06:23.160 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.160 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.160 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:23.160 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:06:23.160 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035892200000000002 2024-04-18T21:06:23.160 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.160 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.160 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:23.160 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646056+0000", 2024-04-18T21:06:23.161 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001829172 2024-04-18T21:06:23.161 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.161 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.161 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:23.161 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651406+0000", 2024-04-18T21:06:23.161 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0053504800000000003 2024-04-18T21:06:23.161 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.161 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.161 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:23.161 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651551+0000", 2024-04-18T21:06:23.161 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014427999999999999 2024-04-18T21:06:23.161 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.161 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.161 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:23.161 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651660+0000", 2024-04-18T21:06:23.161 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109477 2024-04-18T21:06:23.161 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:23.162 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:23.162 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:23.162 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.162 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.162 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:23.162 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:23.162 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 77.534553658999997, 2024-04-18T21:06:23.162 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045668994999999997, 2024-04-18T21:06:23.162 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:23.162 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:23.162 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:23.162 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:23.162 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.162 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:23.162 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:23.162 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:23.163 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.163 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.163 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:23.163 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:23.163 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:23.163 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.163 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.163 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:23.163 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615459+0000", 2024-04-18T21:06:23.163 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5030000000000001e-06 2024-04-18T21:06:23.163 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.163 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.163 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:23.163 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615506+0000", 2024-04-18T21:06:23.163 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6872000000000001e-05 2024-04-18T21:06:23.164 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.164 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.164 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:23.164 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615527+0000", 2024-04-18T21:06:23.164 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0763000000000001e-05 2024-04-18T21:06:23.164 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.164 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.164 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:23.164 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615551+0000", 2024-04-18T21:06:23.164 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4159e-05 2024-04-18T21:06:23.164 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.164 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.164 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:23.164 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615736+0000", 2024-04-18T21:06:23.164 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018499599999999999 2024-04-18T21:06:23.165 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.165 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.165 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:23.165 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615748+0000", 2024-04-18T21:06:23.165 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2272999999999999e-05 2024-04-18T21:06:23.165 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.165 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.165 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:23.165 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635481+0000", 2024-04-18T21:06:23.165 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019732772999999999 2024-04-18T21:06:23.165 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.165 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.165 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:23.165 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635791+0000", 2024-04-18T21:06:23.165 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031013299999999998 2024-04-18T21:06:23.165 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.165 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.166 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:23.166 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636101+0000", 2024-04-18T21:06:23.166 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030943300000000002 2024-04-18T21:06:23.166 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.166 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.166 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:23.166 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646043+0000", 2024-04-18T21:06:23.166 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099428139999999995 2024-04-18T21:06:23.166 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.166 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.166 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:23.166 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660991+0000", 2024-04-18T21:06:23.166 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014947142 2024-04-18T21:06:23.166 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.166 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.167 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:23.167 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661061+0000", 2024-04-18T21:06:23.167 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0438000000000006e-05 2024-04-18T21:06:23.167 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.167 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.167 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:23.167 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661127+0000", 2024-04-18T21:06:23.167 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5696000000000003e-05 2024-04-18T21:06:23.167 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:23.167 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:23.167 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:23.167 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.167 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.167 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:23.167 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:23.167 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 77.534341230999999, 2024-04-18T21:06:23.168 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045745085999999997, 2024-04-18T21:06:23.168 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:23.168 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:23.168 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:23.168 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:23.168 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.168 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:23.168 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:23.168 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:23.168 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.168 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.168 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:23.168 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:23.168 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:23.168 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.168 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.169 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:23.169 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:06:23.169 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7400000000000001e-06 2024-04-18T21:06:23.169 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.169 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.169 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:23.169 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:06:23.169 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8133e-05 2024-04-18T21:06:23.169 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.169 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.169 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:23.169 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615726+0000", 2024-04-18T21:06:23.169 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6132e-05 2024-04-18T21:06:23.169 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.169 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.169 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:23.170 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615742+0000", 2024-04-18T21:06:23.170 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6157000000000001e-05 2024-04-18T21:06:23.170 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.170 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.170 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:23.170 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615937+0000", 2024-04-18T21:06:23.170 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000194768 2024-04-18T21:06:23.170 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.170 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.170 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:23.170 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615950+0000", 2024-04-18T21:06:23.170 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3084e-05 2024-04-18T21:06:23.170 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.170 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.170 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:23.171 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643676+0000", 2024-04-18T21:06:23.171 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027725639999999999 2024-04-18T21:06:23.171 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.171 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.171 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:23.171 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643867+0000", 2024-04-18T21:06:23.171 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019075900000000001 2024-04-18T21:06:23.171 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.171 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.171 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:23.171 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:06:23.171 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036013799999999997 2024-04-18T21:06:23.171 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.171 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.171 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:23.171 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646068+0000", 2024-04-18T21:06:23.172 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001841536 2024-04-18T21:06:23.172 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.172 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.172 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:23.172 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661184+0000", 2024-04-18T21:06:23.172 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015115458999999999 2024-04-18T21:06:23.172 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.172 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.172 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:23.172 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661283+0000", 2024-04-18T21:06:23.172 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9502999999999999e-05 2024-04-18T21:06:23.172 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.172 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.172 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:23.172 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661415+0000", 2024-04-18T21:06:23.172 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000132037 2024-04-18T21:06:23.173 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:23.173 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:23.173 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:23.173 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.173 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.173 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:23.173 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:06:23.173 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 77.534219543999995, 2024-04-18T21:06:23.173 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036185947000000003, 2024-04-18T21:06:23.173 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:23.173 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:23.173 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:23.173 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:23.173 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.173 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:23.173 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:06:23.174 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:23.174 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.174 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.174 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:23.174 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:06:23.174 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:23.174 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.174 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.174 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:23.174 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615794+0000", 2024-04-18T21:06:23.174 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6440000000000001e-06 2024-04-18T21:06:23.174 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.174 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.174 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:23.174 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615803+0000", 2024-04-18T21:06:23.174 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1220000000000001e-06 2024-04-18T21:06:23.175 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.175 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.175 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:23.175 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615827+0000", 2024-04-18T21:06:23.175 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3997000000000001e-05 2024-04-18T21:06:23.175 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.175 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.175 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:23.175 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615899+0000", 2024-04-18T21:06:23.175 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2741e-05 2024-04-18T21:06:23.175 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.175 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.175 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:23.175 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616019+0000", 2024-04-18T21:06:23.175 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119874 2024-04-18T21:06:23.176 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.176 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.176 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:23.176 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616029+0000", 2024-04-18T21:06:23.176 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:06:23.176 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.176 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.176 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:23.176 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644823+0000", 2024-04-18T21:06:23.176 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.028793151999999999 2024-04-18T21:06:23.176 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.176 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.176 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:23.176 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645106+0000", 2024-04-18T21:06:23.176 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028379700000000002 2024-04-18T21:06:23.176 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.177 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.177 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:23.177 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645294+0000", 2024-04-18T21:06:23.177 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000187181 2024-04-18T21:06:23.177 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.177 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.177 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:23.177 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646763+0000", 2024-04-18T21:06:23.177 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0014691050000000001 2024-04-18T21:06:23.177 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.177 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.177 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:23.177 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651784+0000", 2024-04-18T21:06:23.177 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050211650000000002 2024-04-18T21:06:23.177 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.177 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.177 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:23.178 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651876+0000", 2024-04-18T21:06:23.178 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2503999999999994e-05 2024-04-18T21:06:23.178 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.178 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.178 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:23.178 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651978+0000", 2024-04-18T21:06:23.178 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000101475 2024-04-18T21:06:23.178 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:23.178 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:23.178 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:23.178 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.178 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.178 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:23.178 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:23.178 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 77.534070936999996, 2024-04-18T21:06:23.179 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032262322000000003, 2024-04-18T21:06:23.179 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:23.179 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:23.179 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:23.179 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:23.179 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.179 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:23.179 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:23.179 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:23.179 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.179 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.179 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:23.179 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:23.179 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:23.179 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.180 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.180 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:23.180 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615943+0000", 2024-04-18T21:06:23.180 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1959999999999998e-06 2024-04-18T21:06:23.180 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.180 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.180 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:23.180 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615956+0000", 2024-04-18T21:06:23.180 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3424000000000001e-05 2024-04-18T21:06:23.180 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.180 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.180 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:23.180 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615983+0000", 2024-04-18T21:06:23.180 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7072000000000001e-05 2024-04-18T21:06:23.180 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.180 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.181 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:23.181 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616006+0000", 2024-04-18T21:06:23.181 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2823000000000002e-05 2024-04-18T21:06:23.181 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.181 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.181 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:23.181 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616156+0000", 2024-04-18T21:06:23.181 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014962299999999999 2024-04-18T21:06:23.181 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.181 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.181 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:23.181 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616174+0000", 2024-04-18T21:06:23.181 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8082999999999999e-05 2024-04-18T21:06:23.181 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.181 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.182 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:23.182 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.629952+0000", 2024-04-18T21:06:23.182 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013778514 2024-04-18T21:06:23.182 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.182 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.182 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:23.182 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630201+0000", 2024-04-18T21:06:23.182 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024918100000000001 2024-04-18T21:06:23.182 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.182 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.182 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:23.182 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630386+0000", 2024-04-18T21:06:23.182 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018436900000000001 2024-04-18T21:06:23.182 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.182 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.182 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:23.183 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643169+0000", 2024-04-18T21:06:23.183 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012782774 2024-04-18T21:06:23.183 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.183 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.183 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:23.183 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.647924+0000", 2024-04-18T21:06:23.183 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004755787 2024-04-18T21:06:23.183 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.183 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.183 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:23.183 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648069+0000", 2024-04-18T21:06:23.183 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014459600000000001 2024-04-18T21:06:23.183 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.183 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.183 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:23.183 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648203+0000", 2024-04-18T21:06:23.183 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013388000000000001 2024-04-18T21:06:23.184 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:23.184 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:23.184 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:23.184 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.184 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.184 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:23.184 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:06:23.184 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 77.533962673000005, 2024-04-18T21:06:23.184 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032489736999999998, 2024-04-18T21:06:23.184 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:23.184 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:23.184 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:23.184 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:23.184 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.184 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:23.184 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:06:23.184 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:23.185 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.185 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.185 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:23.185 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:06:23.185 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:23.185 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.185 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.185 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:23.185 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616050+0000", 2024-04-18T21:06:23.185 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.606e-06 2024-04-18T21:06:23.185 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.185 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.185 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:23.185 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616061+0000", 2024-04-18T21:06:23.185 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0463e-05 2024-04-18T21:06:23.186 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.186 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.186 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:23.186 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616092+0000", 2024-04-18T21:06:23.186 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1415999999999999e-05 2024-04-18T21:06:23.186 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.186 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.186 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:23.186 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616109+0000", 2024-04-18T21:06:23.186 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6557000000000001e-05 2024-04-18T21:06:23.186 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.186 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.186 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:23.186 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616358+0000", 2024-04-18T21:06:23.186 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000249077 2024-04-18T21:06:23.186 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.186 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.187 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:23.187 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616370+0000", 2024-04-18T21:06:23.187 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2037e-05 2024-04-18T21:06:23.187 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.187 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.187 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:23.187 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.634920+0000", 2024-04-18T21:06:23.187 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018550397 2024-04-18T21:06:23.187 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.187 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.187 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:23.187 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640420+0000", 2024-04-18T21:06:23.187 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055000539999999999 2024-04-18T21:06:23.187 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.187 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.187 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:23.188 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648538+0000", 2024-04-18T21:06:23.188 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0081181299999999994 2024-04-18T21:06:23.188 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:23.188 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:23.188 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:23.188 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.188 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.188 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:23.188 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:06:23.188 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 77.533878352000002, 2024-04-18T21:06:23.188 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036090029000000003, 2024-04-18T21:06:23.188 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:23.188 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:23.188 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:23.188 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:23.188 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.189 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:23.189 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:06:23.189 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:23.189 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.189 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.189 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:23.189 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:06:23.189 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:23.189 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.189 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.189 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:23.189 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616134+0000", 2024-04-18T21:06:23.189 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.353e-06 2024-04-18T21:06:23.189 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.189 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.189 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:23.190 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616141+0000", 2024-04-18T21:06:23.190 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2770000000000002e-06 2024-04-18T21:06:23.190 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.190 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.190 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:23.190 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616160+0000", 2024-04-18T21:06:23.190 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.91e-05 2024-04-18T21:06:23.190 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.190 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.190 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:23.190 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616170+0000", 2024-04-18T21:06:23.190 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7699999999999996e-06 2024-04-18T21:06:23.190 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.190 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.190 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:23.190 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616275+0000", 2024-04-18T21:06:23.191 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105313 2024-04-18T21:06:23.191 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.191 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.191 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:23.191 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616288+0000", 2024-04-18T21:06:23.191 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3027000000000001e-05 2024-04-18T21:06:23.191 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.191 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.191 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:23.191 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646160+0000", 2024-04-18T21:06:23.191 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.029872019 2024-04-18T21:06:23.191 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.191 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.191 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:23.191 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646368+0000", 2024-04-18T21:06:23.191 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020811899999999999 2024-04-18T21:06:23.191 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.192 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.192 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:23.192 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652223+0000", 2024-04-18T21:06:23.192 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.005855051 2024-04-18T21:06:23.192 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:23.192 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:23.192 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:23.192 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.192 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.192 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:23.192 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:23.192 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 77.533820782999996, 2024-04-18T21:06:23.192 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043572403000000003, 2024-04-18T21:06:23.192 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:23.192 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:23.192 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:23.193 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:23.193 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.193 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:23.193 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:23.193 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:23.193 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.193 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.193 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:23.193 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:23.193 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:23.193 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.193 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.193 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:23.193 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616192+0000", 2024-04-18T21:06:23.193 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:06:23.194 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.194 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.194 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:23.194 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616203+0000", 2024-04-18T21:06:23.194 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0890000000000001e-05 2024-04-18T21:06:23.194 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.194 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.194 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:23.194 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616223+0000", 2024-04-18T21:06:23.194 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0409000000000001e-05 2024-04-18T21:06:23.194 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.194 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.194 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:23.194 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616238+0000", 2024-04-18T21:06:23.194 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5160000000000001e-05 2024-04-18T21:06:23.194 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.195 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.195 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:23.195 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616343+0000", 2024-04-18T21:06:23.195 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000104831 2024-04-18T21:06:23.195 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.195 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.195 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:23.195 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616357+0000", 2024-04-18T21:06:23.195 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3686000000000001e-05 2024-04-18T21:06:23.195 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.195 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.195 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:23.195 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635912+0000", 2024-04-18T21:06:23.195 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019554944000000001 2024-04-18T21:06:23.195 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.195 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.196 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:23.196 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636231+0000", 2024-04-18T21:06:23.196 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000318766 2024-04-18T21:06:23.196 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.196 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.196 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:23.196 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659763+0000", 2024-04-18T21:06:23.196 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023532474000000001 2024-04-18T21:06:23.196 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:23.196 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:23.196 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:23.196 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.196 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.196 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:23.196 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:06:23.196 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 77.529892075999996, 2024-04-18T21:06:23.196 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015007971, 2024-04-18T21:06:23.197 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:23.197 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:23.197 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:23.197 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:23.197 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.197 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:23.197 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:06:23.197 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:23.197 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.197 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.197 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:23.197 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:06:23.197 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:23.197 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.197 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.197 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:23.198 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620120+0000", 2024-04-18T21:06:23.198 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0359999999999999e-06 2024-04-18T21:06:23.198 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.198 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.198 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:23.198 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620157+0000", 2024-04-18T21:06:23.198 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6636e-05 2024-04-18T21:06:23.198 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.198 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.198 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:23.198 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620177+0000", 2024-04-18T21:06:23.198 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0247000000000001e-05 2024-04-18T21:06:23.198 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.198 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.198 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:23.198 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620195+0000", 2024-04-18T21:06:23.199 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7819e-05 2024-04-18T21:06:23.199 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.199 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.199 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:23.199 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620342+0000", 2024-04-18T21:06:23.199 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014643300000000001 2024-04-18T21:06:23.199 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.199 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.199 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:23.199 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620405+0000", 2024-04-18T21:06:23.199 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3522000000000006e-05 2024-04-18T21:06:23.199 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.199 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.199 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:23.199 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635016+0000", 2024-04-18T21:06:23.200 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014610840999999999 2024-04-18T21:06:23.200 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.200 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.200 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:23.200 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635127+0000", 2024-04-18T21:06:23.200 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111437 2024-04-18T21:06:23.200 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:23.200 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:23.200 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:23.200 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.200 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.200 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:23.200 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:06:23.200 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 77.529784808000002, 2024-04-18T21:06:23.200 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012693296, 2024-04-18T21:06:23.200 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:23.201 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:23.201 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:23.201 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:23.201 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.201 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:23.201 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:06:23.201 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:23.201 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.201 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.201 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:23.201 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:06:23.201 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:23.201 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.201 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.201 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:23.201 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620228+0000", 2024-04-18T21:06:23.202 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:06:23.202 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.202 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.202 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:23.202 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620236+0000", 2024-04-18T21:06:23.202 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.303e-06 2024-04-18T21:06:23.202 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.202 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.202 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:23.202 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620255+0000", 2024-04-18T21:06:23.202 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9406e-05 2024-04-18T21:06:23.202 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.202 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.202 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:23.202 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620274+0000", 2024-04-18T21:06:23.202 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8940000000000002e-05 2024-04-18T21:06:23.203 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.203 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.203 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:23.203 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:06:23.203 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001558753 2024-04-18T21:06:23.203 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.203 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.203 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:23.203 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621879+0000", 2024-04-18T21:06:23.203 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6359000000000001e-05 2024-04-18T21:06:23.203 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.203 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.203 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:23.203 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632841+0000", 2024-04-18T21:06:23.203 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010961907 2024-04-18T21:06:23.203 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.204 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.204 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:23.204 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632920+0000", 2024-04-18T21:06:23.204 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8714999999999994e-05 2024-04-18T21:06:23.204 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:23.204 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:23.204 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:23.204 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.204 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.204 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:23.204 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:06:23.204 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 77.528239045000007, 2024-04-18T21:06:23.204 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013445702, 2024-04-18T21:06:23.204 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:23.204 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:23.205 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:23.205 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:23.205 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.205 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:23.205 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:06:23.205 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:23.205 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.205 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.205 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:23.205 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:06:23.205 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:23.205 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.205 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.205 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:23.205 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621774+0000", 2024-04-18T21:06:23.205 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2500000000000001e-06 2024-04-18T21:06:23.206 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.206 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.206 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:23.206 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621786+0000", 2024-04-18T21:06:23.206 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2636000000000001e-05 2024-04-18T21:06:23.206 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.206 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.206 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:23.206 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621814+0000", 2024-04-18T21:06:23.206 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7823000000000001e-05 2024-04-18T21:06:23.206 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.206 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.206 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:23.206 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621844+0000", 2024-04-18T21:06:23.206 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9589000000000001e-05 2024-04-18T21:06:23.206 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.207 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.207 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:23.207 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622253+0000", 2024-04-18T21:06:23.207 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040963700000000002 2024-04-18T21:06:23.207 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.207 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.207 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:23.207 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622304+0000", 2024-04-18T21:06:23.207 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0868999999999997e-05 2024-04-18T21:06:23.207 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.207 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.207 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:23.207 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635133+0000", 2024-04-18T21:06:23.207 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012829136 2024-04-18T21:06:23.207 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.207 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.208 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:23.208 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635218+0000", 2024-04-18T21:06:23.208 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4761999999999999e-05 2024-04-18T21:06:23.208 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:23.208 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:23.208 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:23.208 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.208 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.208 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:23.208 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:06:23.208 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 77.528112285000006, 2024-04-18T21:06:23.208 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014162065, 2024-04-18T21:06:23.208 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:23.208 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:23.209 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:23.209 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:23.209 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.209 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:23.209 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:06:23.209 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:23.209 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.209 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.209 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:23.209 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:06:23.209 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:23.209 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.209 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.209 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:23.209 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621900+0000", 2024-04-18T21:06:23.209 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:06:23.210 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.210 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.210 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:23.210 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621910+0000", 2024-04-18T21:06:23.210 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0207000000000001e-05 2024-04-18T21:06:23.210 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.210 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.210 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:23.210 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621932+0000", 2024-04-18T21:06:23.210 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1789000000000001e-05 2024-04-18T21:06:23.210 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.210 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.210 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:23.210 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621946+0000", 2024-04-18T21:06:23.210 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4212999999999999e-05 2024-04-18T21:06:23.211 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.211 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.211 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:23.211 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624477+0000", 2024-04-18T21:06:23.211 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025303470000000001 2024-04-18T21:06:23.211 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.211 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.211 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:23.211 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624525+0000", 2024-04-18T21:06:23.211 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8084999999999998e-05 2024-04-18T21:06:23.211 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.211 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.211 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:23.211 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635976+0000", 2024-04-18T21:06:23.211 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.011451368999999999 2024-04-18T21:06:23.211 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.211 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.212 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:23.212 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636061+0000", 2024-04-18T21:06:23.212 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5094999999999998e-05 2024-04-18T21:06:23.212 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:23.212 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:23.212 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:23.212 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.212 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.212 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:06:23.212 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:06:23.212 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 77.518876660000004, 2024-04-18T21:06:23.212 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0098014739999999993, 2024-04-18T21:06:23.212 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:23.212 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:23.212 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:06:23.212 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:23.213 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.213 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:23.213 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:06:23.213 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:23.213 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.213 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.213 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:23.213 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:06:23.213 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:23.213 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.213 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.213 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:23.213 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631136+0000", 2024-04-18T21:06:23.213 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0139999999999999e-06 2024-04-18T21:06:23.213 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.214 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.214 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:23.214 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631152+0000", 2024-04-18T21:06:23.214 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6365999999999999e-05 2024-04-18T21:06:23.214 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.214 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.214 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:23.214 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631961+0000", 2024-04-18T21:06:23.214 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00080873100000000003 2024-04-18T21:06:23.214 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.214 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.214 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:23.214 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632021+0000", 2024-04-18T21:06:23.214 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0541999999999997e-05 2024-04-18T21:06:23.214 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.214 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.215 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:23.215 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633539+0000", 2024-04-18T21:06:23.215 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015175639999999999 2024-04-18T21:06:23.215 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.215 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.215 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:23.215 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640936+0000", 2024-04-18T21:06:23.215 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007397257 2024-04-18T21:06:23.215 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:23.215 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:23.215 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:23.215 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.215 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.215 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-18T21:06:23.215 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:06:23.215 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 77.501415226999995, 2024-04-18T21:06:23.216 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00073592199999999997, 2024-04-18T21:06:23.216 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:23.216 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:23.216 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:23.216 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:23.216 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.216 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:23.216 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:06:23.216 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:23.216 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.216 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.216 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:23.216 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:06:23.216 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:23.216 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.217 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.217 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:23.217 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648597+0000", 2024-04-18T21:06:23.217 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:06:23.217 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.217 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.217 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:23.217 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648605+0000", 2024-04-18T21:06:23.217 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3960000000000006e-06 2024-04-18T21:06:23.217 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.217 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.217 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:23.217 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648625+0000", 2024-04-18T21:06:23.217 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9987e-05 2024-04-18T21:06:23.217 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.218 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.218 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:23.218 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648643+0000", 2024-04-18T21:06:23.218 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7079e-05 2024-04-18T21:06:23.218 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.218 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.218 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:23.218 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649043+0000", 2024-04-18T21:06:23.218 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040083399999999998 2024-04-18T21:06:23.218 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.218 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.218 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:23.218 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649062+0000", 2024-04-18T21:06:23.219 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9052999999999999e-05 2024-04-18T21:06:23.219 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.219 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.219 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:23.219 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649332+0000", 2024-04-18T21:06:23.219 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026971999999999999 2024-04-18T21:06:23.219 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:23.219 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:23.219 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:23.219 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.219 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.219 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:06:23.219 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:06:23.219 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 77.498640326, 2024-04-18T21:06:23.219 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00086123999999999999, 2024-04-18T21:06:23.219 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:23.220 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:23.220 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:06:23.220 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:23.220 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.220 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:23.220 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:06:23.220 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:23.220 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.220 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.220 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:23.220 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:06:23.220 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:23.220 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.220 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.220 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:23.220 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651372+0000", 2024-04-18T21:06:23.221 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7599999999999997e-07 2024-04-18T21:06:23.221 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.221 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.221 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:23.221 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651377+0000", 2024-04-18T21:06:23.221 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.22e-06 2024-04-18T21:06:23.221 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.221 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.221 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:23.221 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651394+0000", 2024-04-18T21:06:23.221 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6646999999999998e-05 2024-04-18T21:06:23.221 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.221 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.221 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:23.221 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651427+0000", 2024-04-18T21:06:23.222 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3682e-05 2024-04-18T21:06:23.222 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.222 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.222 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:23.222 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652029+0000", 2024-04-18T21:06:23.222 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00060152199999999995 2024-04-18T21:06:23.222 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.222 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.222 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:23.222 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652232+0000", 2024-04-18T21:06:23.222 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020359299999999999 2024-04-18T21:06:23.222 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:23.222 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:23.222 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:23.222 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.223 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.223 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:06:23.223 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:06:23.223 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 77.490613363999998, 2024-04-18T21:06:23.223 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0017426200000000001, 2024-04-18T21:06:23.223 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:23.223 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:23.223 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:23.223 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:23.223 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.225 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:23.225 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:06:23.225 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:23.225 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.225 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.225 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:23.225 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:06:23.225 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:23.225 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.225 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.225 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:23.225 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659399+0000", 2024-04-18T21:06:23.225 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6000000000000002e-07 2024-04-18T21:06:23.226 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.226 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.226 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:23.226 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659405+0000", 2024-04-18T21:06:23.226 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5069999999999997e-06 2024-04-18T21:06:23.226 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.226 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.226 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:23.226 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659425+0000", 2024-04-18T21:06:23.226 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.927e-05 2024-04-18T21:06:23.226 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.226 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.226 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:23.226 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659443+0000", 2024-04-18T21:06:23.226 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8051999999999999e-05 2024-04-18T21:06:23.227 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.227 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.227 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:23.227 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660973+0000", 2024-04-18T21:06:23.227 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001530106 2024-04-18T21:06:23.227 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.227 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.227 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:23.227 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660983+0000", 2024-04-18T21:06:23.227 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0516999999999999e-05 2024-04-18T21:06:23.227 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.227 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.227 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:23.227 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661141+0000", 2024-04-18T21:06:23.227 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015730799999999999 2024-04-18T21:06:23.227 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:23.227 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:23.228 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:23.228 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.228 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.228 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:06:23.228 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:06:23.228 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 77.490396739000005, 2024-04-18T21:06:23.228 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001812311, 2024-04-18T21:06:23.228 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:23.228 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:23.228 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:23.228 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:23.228 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.228 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:23.228 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:06:23.229 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:23.229 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.229 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.229 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:23.229 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:06:23.229 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:23.229 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.229 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.229 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:23.229 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659616+0000", 2024-04-18T21:06:23.229 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.277e-06 2024-04-18T21:06:23.229 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.229 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.229 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:23.229 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659625+0000", 2024-04-18T21:06:23.229 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5359999999999998e-06 2024-04-18T21:06:23.230 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.230 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.230 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:23.230 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659647+0000", 2024-04-18T21:06:23.230 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1857000000000001e-05 2024-04-18T21:06:23.230 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.230 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.230 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:23.230 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659664+0000", 2024-04-18T21:06:23.230 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6405999999999998e-05 2024-04-18T21:06:23.230 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.230 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.230 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:23.230 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661169+0000", 2024-04-18T21:06:23.231 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015054179999999999 2024-04-18T21:06:23.231 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.231 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.231 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:23.231 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661177+0000", 2024-04-18T21:06:23.231 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9680000000000006e-06 2024-04-18T21:06:23.231 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.231 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.231 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:23.231 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661427+0000", 2024-04-18T21:06:23.231 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024984900000000001 2024-04-18T21:06:23.231 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:23.231 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:23.231 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:23.232 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.232 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.232 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-18T21:06:23.232 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:06:23.232 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 75.537476131000005, 2024-04-18T21:06:23.232 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0030975030000000001, 2024-04-18T21:06:23.232 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:23.232 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:23.232 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:23.232 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:23.232 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.232 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:23.232 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:06:23.232 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:23.232 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.233 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.233 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:23.233 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:06:23.233 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:23.233 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.233 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.233 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:23.233 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612538+0000", 2024-04-18T21:06:23.233 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6259999999999999e-06 2024-04-18T21:06:23.233 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.233 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.233 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:23.233 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612552+0000", 2024-04-18T21:06:23.233 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4073999999999999e-05 2024-04-18T21:06:23.234 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.234 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.234 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:23.234 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612585+0000", 2024-04-18T21:06:23.234 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3504999999999999e-05 2024-04-18T21:06:23.234 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.234 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.234 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:23.234 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612601+0000", 2024-04-18T21:06:23.234 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5194000000000001e-05 2024-04-18T21:06:23.234 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.234 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.234 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:23.234 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612746+0000", 2024-04-18T21:06:23.235 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145666 2024-04-18T21:06:23.235 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.235 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.235 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:23.235 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612953+0000", 2024-04-18T21:06:23.235 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000207109 2024-04-18T21:06:23.235 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.235 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.235 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:23.235 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.613134+0000", 2024-04-18T21:06:23.235 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018041300000000001 2024-04-18T21:06:23.235 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.235 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.235 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:23.236 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.614411+0000", 2024-04-18T21:06:23.236 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0012769929999999999 2024-04-18T21:06:23.236 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.236 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.236 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:23.236 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615441+0000", 2024-04-18T21:06:23.236 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001029917 2024-04-18T21:06:23.236 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.236 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.236 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:23.236 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615522+0000", 2024-04-18T21:06:23.236 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1142000000000003e-05 2024-04-18T21:06:23.236 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.236 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.236 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:23.236 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615633+0000", 2024-04-18T21:06:23.237 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000110864 2024-04-18T21:06:23.237 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:23.237 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:23.237 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:23.237 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.237 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.237 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-18T21:06:23.237 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:06:23.237 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 57.535190319999998, 2024-04-18T21:06:23.237 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088979039999999999, 2024-04-18T21:06:23.237 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:23.237 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:23.237 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:23.237 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:23.237 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.237 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:23.238 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:06:23.238 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:23.238 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.238 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.238 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:23.238 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:06:23.238 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:23.238 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.238 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.238 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:23.238 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614825+0000", 2024-04-18T21:06:23.238 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4829999999999999e-06 2024-04-18T21:06:23.238 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.238 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.238 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:23.239 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614843+0000", 2024-04-18T21:06:23.239 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8777e-05 2024-04-18T21:06:23.239 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.239 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.239 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:23.239 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614884+0000", 2024-04-18T21:06:23.239 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1051999999999999e-05 2024-04-18T21:06:23.239 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.239 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.239 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:23.239 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614903+0000", 2024-04-18T21:06:23.239 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9069999999999999e-05 2024-04-18T21:06:23.239 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.239 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.239 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:23.239 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615047+0000", 2024-04-18T21:06:23.240 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014374400000000001 2024-04-18T21:06:23.240 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.240 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.240 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:23.240 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615061+0000", 2024-04-18T21:06:23.240 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4063000000000001e-05 2024-04-18T21:06:23.240 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.240 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.240 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:23.240 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621064+0000", 2024-04-18T21:06:23.240 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0060029200000000001 2024-04-18T21:06:23.240 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.240 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.240 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:23.240 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621211+0000", 2024-04-18T21:06:23.240 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000147224 2024-04-18T21:06:23.240 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.241 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.241 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:23.241 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621396+0000", 2024-04-18T21:06:23.241 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018454699999999999 2024-04-18T21:06:23.241 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.241 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.241 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:23.241 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.622517+0000", 2024-04-18T21:06:23.241 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001121424 2024-04-18T21:06:23.241 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.241 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.241 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:23.241 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623571+0000", 2024-04-18T21:06:23.241 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010538660000000001 2024-04-18T21:06:23.241 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.241 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.242 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:23.242 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623658+0000", 2024-04-18T21:06:23.242 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6439000000000004e-05 2024-04-18T21:06:23.242 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:23.242 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:23.242 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:23.242 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623719+0000", 2024-04-18T21:06:23.242 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1295000000000002e-05 2024-04-18T21:06:23.242 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:23.242 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:23.242 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:23.242 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:23.242 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:23.242 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:23.244 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:23.242+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:23.244 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:23.345 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:23.342+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:23.374 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:23.374 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:06:23.374 INFO:teuthology.orchestra.run.smithi132.stdout: "num_ops": 0 2024-04-18T21:06:23.374 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:23.388 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:23.446 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:23.447+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:23.546 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:23.547+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:23.554 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:23.554 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:06:23.554 INFO:teuthology.orchestra.run.smithi132.stdout: "complaint_time": 30, 2024-04-18T21:06:23.554 INFO:teuthology.orchestra.run.smithi132.stdout: "num_blocked_ops": 0 2024-04-18T21:06:23.554 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:23.569 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:23.647 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:23.646+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:23.692 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:23.692 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 20, 2024-04-18T21:06:23.692 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 600, 2024-04-18T21:06:23.692 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [ 2024-04-18T21:06:23.692 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.692 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:23.692 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:06:23.692 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 88.781498317, 2024-04-18T21:06:23.692 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.02518273, 2024-04-18T21:06:23.692 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:23.692 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:23.692 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:23.692 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:23.693 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:23.693 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:23.693 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 141 2024-04-18T21:06:23.693 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.693 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:23.693 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.693 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:23.693 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:06:23.693 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:23.693 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.693 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.693 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:23.693 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:06:23.693 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:23.693 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.693 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.694 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:23.694 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911562+0000", 2024-04-18T21:06:23.694 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9300000000000006e-07 2024-04-18T21:06:23.694 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.694 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.694 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:23.694 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911569+0000", 2024-04-18T21:06:23.694 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0169999999999999e-06 2024-04-18T21:06:23.694 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.694 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.694 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:23.694 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911582+0000", 2024-04-18T21:06:23.694 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.343e-05 2024-04-18T21:06:23.694 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.695 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.695 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:23.695 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911590+0000", 2024-04-18T21:06:23.695 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.413e-06 2024-04-18T21:06:23.695 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.695 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.695 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:23.695 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.933922+0000", 2024-04-18T21:06:23.695 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.022332093000000001 2024-04-18T21:06:23.695 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.695 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.695 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:23.695 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.934155+0000", 2024-04-18T21:06:23.695 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023378900000000001 2024-04-18T21:06:23.695 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.695 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.696 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:23.696 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.934514+0000", 2024-04-18T21:06:23.696 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00035859200000000003 2024-04-18T21:06:23.696 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.696 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.696 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:23.696 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.935973+0000", 2024-04-18T21:06:23.696 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001458705 2024-04-18T21:06:23.696 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.696 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.696 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:23.696 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936488+0000", 2024-04-18T21:06:23.696 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00051550000000000001 2024-04-18T21:06:23.696 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.696 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.697 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:23.697 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936636+0000", 2024-04-18T21:06:23.697 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014779800000000001 2024-04-18T21:06:23.697 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.697 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.697 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:23.697 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936743+0000", 2024-04-18T21:06:23.697 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010739999999999999 2024-04-18T21:06:23.697 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:23.697 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:23.697 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:23.697 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.697 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.697 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:23.697 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:23.697 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 88.664299342999996, 2024-04-18T21:06:23.698 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023654959999999999, 2024-04-18T21:06:23.698 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:23.698 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:23.698 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:23.698 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:23.698 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:23.698 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:23.698 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 163 2024-04-18T21:06:23.698 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.698 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:23.698 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.698 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:23.698 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:23.698 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:23.698 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.698 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.699 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:23.699 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:23.699 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:23.699 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.699 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.699 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:23.699 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:23.699 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0999999999999998e-07 2024-04-18T21:06:23.699 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.699 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.699 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:23.699 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028766+0000", 2024-04-18T21:06:23.699 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4700000000000001e-06 2024-04-18T21:06:23.699 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.699 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.699 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:23.700 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028775+0000", 2024-04-18T21:06:23.700 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.3190000000000001e-06 2024-04-18T21:06:23.700 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.700 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.700 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:23.700 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028782+0000", 2024-04-18T21:06:23.700 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.2300000000000002e-06 2024-04-18T21:06:23.700 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.700 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.700 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:23.700 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046667+0000", 2024-04-18T21:06:23.700 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017884356000000001 2024-04-18T21:06:23.700 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.700 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.700 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:23.700 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046788+0000", 2024-04-18T21:06:23.701 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012125000000000001 2024-04-18T21:06:23.701 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.701 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.701 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:23.701 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046982+0000", 2024-04-18T21:06:23.701 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019394 2024-04-18T21:06:23.701 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.701 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.701 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:23.701 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051969+0000", 2024-04-18T21:06:23.701 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0049868150000000003 2024-04-18T21:06:23.701 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.701 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.701 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:23.701 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052089+0000", 2024-04-18T21:06:23.702 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011993 2024-04-18T21:06:23.702 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.702 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.702 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:23.702 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052292+0000", 2024-04-18T21:06:23.702 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020345699999999999 2024-04-18T21:06:23.702 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.702 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.702 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:23.702 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052415+0000", 2024-04-18T21:06:23.702 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000122483 2024-04-18T21:06:23.702 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:23.702 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:23.702 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:23.702 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.702 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.703 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:23.703 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:23.703 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 88.664265111000006, 2024-04-18T21:06:23.703 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023864586, 2024-04-18T21:06:23.703 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:23.703 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:23.703 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:23.703 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:23.703 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:23.703 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:23.703 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 164 2024-04-18T21:06:23.703 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.703 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:23.703 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.703 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:23.703 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:23.703 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:23.704 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.704 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.704 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:23.704 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:23.704 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:23.704 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.704 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.704 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:23.704 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028795+0000", 2024-04-18T21:06:23.704 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7999999999999995e-07 2024-04-18T21:06:23.704 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.704 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.704 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:23.704 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028884+0000", 2024-04-18T21:06:23.705 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8997000000000002e-05 2024-04-18T21:06:23.705 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.705 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.705 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:23.705 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028895+0000", 2024-04-18T21:06:23.705 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1647e-05 2024-04-18T21:06:23.705 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.705 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.705 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:23.705 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028903+0000", 2024-04-18T21:06:23.705 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.909e-06 2024-04-18T21:06:23.705 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.705 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.705 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:23.706 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.047818+0000", 2024-04-18T21:06:23.706 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018914337 2024-04-18T21:06:23.706 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.706 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.706 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:23.706 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.048094+0000", 2024-04-18T21:06:23.706 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00027653500000000001 2024-04-18T21:06:23.706 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.706 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.706 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:23.706 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.048471+0000", 2024-04-18T21:06:23.706 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00037705799999999999 2024-04-18T21:06:23.706 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.706 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.707 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:23.707 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052516+0000", 2024-04-18T21:06:23.707 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0040452739999999997 2024-04-18T21:06:23.707 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.707 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.707 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:23.707 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052535+0000", 2024-04-18T21:06:23.707 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.84e-05 2024-04-18T21:06:23.707 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.707 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.707 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:23.707 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052603+0000", 2024-04-18T21:06:23.707 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.8095000000000004e-05 2024-04-18T21:06:23.707 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.707 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.708 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:23.708 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052659+0000", 2024-04-18T21:06:23.708 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5653999999999999e-05 2024-04-18T21:06:23.708 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:23.708 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:23.708 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:23.708 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.708 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.708 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:23.708 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:23.708 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 88.664141667999999, 2024-04-18T21:06:23.708 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024516458000000001, 2024-04-18T21:06:23.708 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:23.708 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:23.708 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:23.709 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:23.709 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:23.709 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:23.709 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 165 2024-04-18T21:06:23.709 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.709 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:23.709 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.709 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:23.709 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:23.709 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:23.709 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.709 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.709 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:23.709 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:23.709 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:23.709 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.710 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.710 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:23.710 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028918+0000", 2024-04-18T21:06:23.710 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8000000000000005e-07 2024-04-18T21:06:23.710 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.710 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.710 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:23.710 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028924+0000", 2024-04-18T21:06:23.710 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5659999999999997e-06 2024-04-18T21:06:23.710 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.710 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.710 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:23.710 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028933+0000", 2024-04-18T21:06:23.710 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.38e-06 2024-04-18T21:06:23.711 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.711 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.711 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:23.711 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028940+0000", 2024-04-18T21:06:23.711 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0060000000000003e-06 2024-04-18T21:06:23.711 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.711 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.711 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:23.711 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.050846+0000", 2024-04-18T21:06:23.711 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021906119000000002 2024-04-18T21:06:23.711 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.711 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.711 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:23.711 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051025+0000", 2024-04-18T21:06:23.711 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017850799999999999 2024-04-18T21:06:23.712 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.712 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.712 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:23.712 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051221+0000", 2024-04-18T21:06:23.712 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019608700000000001 2024-04-18T21:06:23.712 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.712 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.712 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:23.712 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052675+0000", 2024-04-18T21:06:23.712 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0014537899999999999 2024-04-18T21:06:23.712 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.712 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.712 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:23.712 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053311+0000", 2024-04-18T21:06:23.712 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00063613299999999999 2024-04-18T21:06:23.712 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.713 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.713 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:23.713 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053381+0000", 2024-04-18T21:06:23.713 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0074999999999996e-05 2024-04-18T21:06:23.713 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.713 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.713 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:23.713 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053434+0000", 2024-04-18T21:06:23.713 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3013999999999998e-05 2024-04-18T21:06:23.713 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:23.713 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:23.713 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:23.713 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.713 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.713 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:23.714 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:23.714 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 88.550836188999995, 2024-04-18T21:06:23.714 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023772793, 2024-04-18T21:06:23.714 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:23.714 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:23.714 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:23.714 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:23.714 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:23.714 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:23.714 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 187 2024-04-18T21:06:23.714 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.714 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:23.714 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.715 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:23.715 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:23.715 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:23.715 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.715 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.715 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:23.715 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:23.715 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:23.715 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.715 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.715 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:23.715 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142224+0000", 2024-04-18T21:06:23.715 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.47e-07 2024-04-18T21:06:23.715 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.715 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.716 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:23.716 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142233+0000", 2024-04-18T21:06:23.716 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0729999999999994e-06 2024-04-18T21:06:23.716 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.716 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.716 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:23.716 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142255+0000", 2024-04-18T21:06:23.716 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.2535999999999999e-05 2024-04-18T21:06:23.716 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.716 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.716 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:23.716 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142268+0000", 2024-04-18T21:06:23.716 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2686e-05 2024-04-18T21:06:23.716 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.716 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.716 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:23.717 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160497+0000", 2024-04-18T21:06:23.717 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018228779000000001 2024-04-18T21:06:23.717 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.717 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.717 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:23.717 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160634+0000", 2024-04-18T21:06:23.717 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000137315 2024-04-18T21:06:23.717 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.717 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.717 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:23.717 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160831+0000", 2024-04-18T21:06:23.717 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019683100000000001 2024-04-18T21:06:23.717 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.717 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.718 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:23.718 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165129+0000", 2024-04-18T21:06:23.718 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0042981299999999998 2024-04-18T21:06:23.718 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.718 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.718 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:23.718 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165776+0000", 2024-04-18T21:06:23.718 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00064702900000000003 2024-04-18T21:06:23.718 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.718 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.718 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:23.718 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165921+0000", 2024-04-18T21:06:23.718 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014506 2024-04-18T21:06:23.719 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.719 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.719 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:23.719 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165996+0000", 2024-04-18T21:06:23.719 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.4406999999999994e-05 2024-04-18T21:06:23.719 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:23.719 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:23.719 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:23.719 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.719 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.719 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:23.719 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:23.719 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 88.550775591000004, 2024-04-18T21:06:23.719 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026802157, 2024-04-18T21:06:23.720 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:23.720 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:23.720 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:23.720 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:23.720 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:23.720 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:23.720 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 188 2024-04-18T21:06:23.720 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.720 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:23.720 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.720 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:23.720 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:23.720 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:23.720 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.720 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.720 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:23.721 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:23.721 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:23.721 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.721 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.721 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:23.721 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142284+0000", 2024-04-18T21:06:23.721 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4e-07 2024-04-18T21:06:23.721 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.721 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.721 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:23.721 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142374+0000", 2024-04-18T21:06:23.721 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0099999999999995e-05 2024-04-18T21:06:23.721 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.721 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.721 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:23.721 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142386+0000", 2024-04-18T21:06:23.722 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1770000000000001e-05 2024-04-18T21:06:23.722 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.722 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.722 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:23.722 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142394+0000", 2024-04-18T21:06:23.722 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.2130000000000008e-06 2024-04-18T21:06:23.722 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.722 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.722 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:23.722 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.161743+0000", 2024-04-18T21:06:23.722 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019348644000000002 2024-04-18T21:06:23.722 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.722 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.723 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:23.723 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.161865+0000", 2024-04-18T21:06:23.723 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012210899999999999 2024-04-18T21:06:23.723 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.723 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.723 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:23.723 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.162055+0000", 2024-04-18T21:06:23.723 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000189994 2024-04-18T21:06:23.723 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.723 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.723 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:23.723 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165735+0000", 2024-04-18T21:06:23.723 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0036803270000000002 2024-04-18T21:06:23.723 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.723 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.724 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:23.724 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.168911+0000", 2024-04-18T21:06:23.724 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0031753689999999999 2024-04-18T21:06:23.724 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.724 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.724 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:23.724 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169012+0000", 2024-04-18T21:06:23.724 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010157699999999999 2024-04-18T21:06:23.724 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.724 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.724 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:23.724 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169086+0000", 2024-04-18T21:06:23.724 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3213999999999994e-05 2024-04-18T21:06:23.724 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:23.724 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:23.724 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:23.725 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.725 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.725 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:23.725 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:23.725 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 88.550650285000003, 2024-04-18T21:06:23.725 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026811423000000001, 2024-04-18T21:06:23.725 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:23.725 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:23.725 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:23.725 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:23.725 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:23.725 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:23.725 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 189 2024-04-18T21:06:23.725 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.725 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:23.725 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.725 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:23.726 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:23.726 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:23.726 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.726 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.726 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:23.726 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:23.726 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:23.726 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.726 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.726 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:23.726 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142410+0000", 2024-04-18T21:06:23.726 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:06:23.726 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.726 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.726 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:23.727 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142415+0000", 2024-04-18T21:06:23.727 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.7939999999999999e-06 2024-04-18T21:06:23.727 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.727 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.727 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:23.727 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142470+0000", 2024-04-18T21:06:23.727 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4537999999999999e-05 2024-04-18T21:06:23.727 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.727 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.727 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:23.727 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142481+0000", 2024-04-18T21:06:23.727 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0966e-05 2024-04-18T21:06:23.727 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.727 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.727 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:23.727 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.163493+0000", 2024-04-18T21:06:23.728 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021012444000000002 2024-04-18T21:06:23.728 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.728 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.728 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:23.728 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.163727+0000", 2024-04-18T21:06:23.728 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000233339 2024-04-18T21:06:23.728 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.728 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.728 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:23.728 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.164102+0000", 2024-04-18T21:06:23.728 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000374872 2024-04-18T21:06:23.728 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.728 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.728 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:23.728 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.166528+0000", 2024-04-18T21:06:23.728 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0024258729999999998 2024-04-18T21:06:23.729 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.729 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.729 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:23.729 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169101+0000", 2024-04-18T21:06:23.729 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0025737680000000001 2024-04-18T21:06:23.729 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.729 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.729 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:23.729 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169171+0000", 2024-04-18T21:06:23.729 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0148000000000007e-05 2024-04-18T21:06:23.729 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.729 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.729 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:23.729 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169220+0000", 2024-04-18T21:06:23.729 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8767999999999998e-05 2024-04-18T21:06:23.729 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:23.730 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:23.730 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:23.730 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.730 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.730 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:23.730 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:23.730 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 78.077077732999996, 2024-04-18T21:06:23.730 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024082777999999999, 2024-04-18T21:06:23.730 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:23.730 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:23.730 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:23.730 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:23.730 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.730 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:23.731 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:23.731 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:23.731 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.731 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.731 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:23.731 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:23.731 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:23.731 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.731 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.731 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:23.731 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615984+0000", 2024-04-18T21:06:23.731 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.9869999999999999e-06 2024-04-18T21:06:23.731 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.732 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.732 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:23.732 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615999+0000", 2024-04-18T21:06:23.732 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4646e-05 2024-04-18T21:06:23.732 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.732 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.732 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:23.732 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616028+0000", 2024-04-18T21:06:23.732 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8952999999999999e-05 2024-04-18T21:06:23.732 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.732 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.732 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:23.732 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616052+0000", 2024-04-18T21:06:23.732 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.3941999999999999e-05 2024-04-18T21:06:23.733 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.733 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.733 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:23.733 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618010+0000", 2024-04-18T21:06:23.733 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0019581780000000001 2024-04-18T21:06:23.733 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.733 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.733 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:23.733 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618322+0000", 2024-04-18T21:06:23.733 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00031158899999999997 2024-04-18T21:06:23.733 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.733 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.733 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:23.733 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618587+0000", 2024-04-18T21:06:23.734 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00026495700000000002 2024-04-18T21:06:23.734 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.734 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.734 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:23.734 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629262+0000", 2024-04-18T21:06:23.734 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010675877 2024-04-18T21:06:23.734 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.734 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.734 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:23.734 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.639773+0000", 2024-04-18T21:06:23.734 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0105109 2024-04-18T21:06:23.734 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.734 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.735 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:23.735 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.639926+0000", 2024-04-18T21:06:23.735 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000152349 2024-04-18T21:06:23.735 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.735 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.735 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:23.735 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640064+0000", 2024-04-18T21:06:23.735 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0001384 2024-04-18T21:06:23.735 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:23.735 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:23.735 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:23.735 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.735 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.735 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:23.736 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:23.736 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 78.076965059000003, 2024-04-18T21:06:23.736 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030215005999999999, 2024-04-18T21:06:23.736 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:23.736 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:23.736 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:23.736 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:23.736 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.736 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:23.736 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:23.736 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:23.736 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.736 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.736 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:23.736 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:23.736 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:23.736 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.737 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.737 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:23.737 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616095+0000", 2024-04-18T21:06:23.737 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.446e-06 2024-04-18T21:06:23.737 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.737 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.737 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:23.737 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616104+0000", 2024-04-18T21:06:23.737 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6200000000000005e-06 2024-04-18T21:06:23.737 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.737 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.737 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:23.737 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616132+0000", 2024-04-18T21:06:23.737 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7668999999999999e-05 2024-04-18T21:06:23.737 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.737 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.738 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:23.738 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616149+0000", 2024-04-18T21:06:23.738 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7047000000000001e-05 2024-04-18T21:06:23.738 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.738 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.738 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:23.738 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619287+0000", 2024-04-18T21:06:23.738 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0031381450000000002 2024-04-18T21:06:23.738 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.738 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.738 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:23.738 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619503+0000", 2024-04-18T21:06:23.738 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000216522 2024-04-18T21:06:23.738 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.738 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.739 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:23.739 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619930+0000", 2024-04-18T21:06:23.739 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00042604900000000001 2024-04-18T21:06:23.739 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.739 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.739 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:23.739 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629281+0000", 2024-04-18T21:06:23.739 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0093512230000000005 2024-04-18T21:06:23.739 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.739 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.739 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:23.739 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646022+0000", 2024-04-18T21:06:23.739 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016741156 2024-04-18T21:06:23.739 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.739 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.740 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:23.740 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646198+0000", 2024-04-18T21:06:23.740 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000176009 2024-04-18T21:06:23.740 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.740 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.740 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:23.740 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646309+0000", 2024-04-18T21:06:23.740 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011112000000000001 2024-04-18T21:06:23.740 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:23.740 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:23.740 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:23.740 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.740 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.740 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:23.740 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:23.741 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 78.076880235000004, 2024-04-18T21:06:23.741 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030501176000000001, 2024-04-18T21:06:23.741 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:23.741 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:23.741 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:23.741 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:23.741 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.741 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:23.741 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:23.741 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:23.741 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.741 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.741 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:23.742 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:23.742 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:23.742 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.742 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.742 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:23.742 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616180+0000", 2024-04-18T21:06:23.742 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1000000000000001e-06 2024-04-18T21:06:23.742 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.742 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.742 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:23.742 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616188+0000", 2024-04-18T21:06:23.742 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4069999999999993e-06 2024-04-18T21:06:23.742 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.742 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.743 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:23.743 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616207+0000", 2024-04-18T21:06:23.743 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8335999999999999e-05 2024-04-18T21:06:23.743 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.743 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.743 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:23.743 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616225+0000", 2024-04-18T21:06:23.743 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8652999999999999e-05 2024-04-18T21:06:23.743 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.743 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.743 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:23.743 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620977+0000", 2024-04-18T21:06:23.743 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047512220000000003 2024-04-18T21:06:23.743 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.744 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.744 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:23.744 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621279+0000", 2024-04-18T21:06:23.744 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000302646 2024-04-18T21:06:23.744 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.744 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.744 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:23.744 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621584+0000", 2024-04-18T21:06:23.744 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000305142 2024-04-18T21:06:23.744 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.744 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.744 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:23.744 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629352+0000", 2024-04-18T21:06:23.744 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0077673689999999997 2024-04-18T21:06:23.745 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.745 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.745 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:23.745 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646480+0000", 2024-04-18T21:06:23.745 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017128259 2024-04-18T21:06:23.745 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.745 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.745 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:23.745 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646591+0000", 2024-04-18T21:06:23.745 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011113899999999999 2024-04-18T21:06:23.745 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.745 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.745 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:23.745 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646680+0000", 2024-04-18T21:06:23.745 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8902999999999999e-05 2024-04-18T21:06:23.746 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:23.746 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:23.746 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:23.746 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.746 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.746 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:23.746 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:23.746 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 78.076813736000005, 2024-04-18T21:06:23.746 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030779760999999999, 2024-04-18T21:06:23.746 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:23.746 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:23.746 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:23.746 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:23.747 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.747 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:23.747 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:23.747 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:23.747 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.747 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.747 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:23.747 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:23.747 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:23.747 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.747 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.747 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:23.747 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616246+0000", 2024-04-18T21:06:23.747 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0499999999999999e-06 2024-04-18T21:06:23.747 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.747 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.748 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:23.748 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616253+0000", 2024-04-18T21:06:23.748 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.5989999999999998e-06 2024-04-18T21:06:23.748 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.748 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.748 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:23.748 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616273+0000", 2024-04-18T21:06:23.748 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9916999999999999e-05 2024-04-18T21:06:23.748 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.748 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.748 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:23.748 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616287+0000", 2024-04-18T21:06:23.748 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3669000000000001e-05 2024-04-18T21:06:23.748 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.748 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.749 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:23.749 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622203+0000", 2024-04-18T21:06:23.749 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.005916737 2024-04-18T21:06:23.749 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.749 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.749 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:23.749 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622379+0000", 2024-04-18T21:06:23.749 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000175596 2024-04-18T21:06:23.749 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.749 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.749 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:23.749 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622707+0000", 2024-04-18T21:06:23.749 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00032784600000000002 2024-04-18T21:06:23.749 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.749 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.749 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:23.750 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629366+0000", 2024-04-18T21:06:23.750 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0066593279999999999 2024-04-18T21:06:23.750 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.750 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.750 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:23.750 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646813+0000", 2024-04-18T21:06:23.750 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017447059000000001 2024-04-18T21:06:23.750 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.750 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.750 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:23.750 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646946+0000", 2024-04-18T21:06:23.750 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013301200000000001 2024-04-18T21:06:23.750 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.750 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.751 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:23.751 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647025+0000", 2024-04-18T21:06:23.751 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8948000000000004e-05 2024-04-18T21:06:23.751 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:23.751 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:23.751 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:23.751 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.751 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.751 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:23.751 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:23.751 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 78.076729917999998, 2024-04-18T21:06:23.751 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.031512165000000002, 2024-04-18T21:06:23.751 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:23.751 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:23.751 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:23.752 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:23.752 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.752 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:23.752 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:23.752 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:23.752 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.752 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.752 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:23.752 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:23.752 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:23.752 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.752 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.752 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:23.752 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616330+0000", 2024-04-18T21:06:23.752 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.15e-06 2024-04-18T21:06:23.753 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.753 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.753 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:23.753 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616337+0000", 2024-04-18T21:06:23.753 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.1289999999999998e-06 2024-04-18T21:06:23.753 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.753 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.753 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:23.753 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616447+0000", 2024-04-18T21:06:23.753 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109561 2024-04-18T21:06:23.753 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.753 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.753 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:23.753 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616496+0000", 2024-04-18T21:06:23.753 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8591999999999998e-05 2024-04-18T21:06:23.754 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.754 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.754 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:23.754 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.623786+0000", 2024-04-18T21:06:23.754 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0072906799999999999 2024-04-18T21:06:23.754 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.754 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.754 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:23.754 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.623973+0000", 2024-04-18T21:06:23.754 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018717199999999999 2024-04-18T21:06:23.754 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.754 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.754 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:23.754 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624260+0000", 2024-04-18T21:06:23.755 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00028630600000000001 2024-04-18T21:06:23.755 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.755 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.755 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:23.755 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629381+0000", 2024-04-18T21:06:23.755 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0051211340000000003 2024-04-18T21:06:23.755 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.755 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.755 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:23.755 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647631+0000", 2024-04-18T21:06:23.755 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018249771000000001 2024-04-18T21:06:23.755 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.755 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.755 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:23.755 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647761+0000", 2024-04-18T21:06:23.756 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013037300000000001 2024-04-18T21:06:23.756 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.756 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.756 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:23.756 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647841+0000", 2024-04-18T21:06:23.756 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.0296999999999994e-05 2024-04-18T21:06:23.756 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:23.756 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:23.756 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:23.756 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.756 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.756 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:23.756 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:23.756 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 78.076524434000007, 2024-04-18T21:06:23.756 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043251955000000002, 2024-04-18T21:06:23.756 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:23.757 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:23.757 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:23.757 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:23.757 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.757 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:23.757 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:23.757 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:23.757 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.757 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.757 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:23.757 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:23.757 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:23.757 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.757 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.757 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:23.757 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616536+0000", 2024-04-18T21:06:23.758 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2869999999999999e-06 2024-04-18T21:06:23.758 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.758 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.758 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:23.758 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616572+0000", 2024-04-18T21:06:23.758 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.6261999999999999e-05 2024-04-18T21:06:23.758 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.758 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.758 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:23.758 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616593+0000", 2024-04-18T21:06:23.758 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1310000000000001e-05 2024-04-18T21:06:23.758 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.758 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.759 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:23.759 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616614+0000", 2024-04-18T21:06:23.759 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.0936000000000001e-05 2024-04-18T21:06:23.759 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.759 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.759 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:23.759 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629501+0000", 2024-04-18T21:06:23.759 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.012886819000000001 2024-04-18T21:06:23.759 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.759 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.759 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:23.759 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629696+0000", 2024-04-18T21:06:23.759 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019485499999999999 2024-04-18T21:06:23.759 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.760 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.760 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:23.760 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629940+0000", 2024-04-18T21:06:23.760 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00024386399999999999 2024-04-18T21:06:23.760 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.760 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.760 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:23.760 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640100+0000", 2024-04-18T21:06:23.760 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010159645 2024-04-18T21:06:23.760 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.760 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.760 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:23.760 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659516+0000", 2024-04-18T21:06:23.760 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019416563000000001 2024-04-18T21:06:23.760 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.760 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.761 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:23.761 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659684+0000", 2024-04-18T21:06:23.761 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016750900000000001 2024-04-18T21:06:23.761 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.761 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.761 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:23.761 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659787+0000", 2024-04-18T21:06:23.761 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000102905 2024-04-18T21:06:23.761 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:23.761 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:23.761 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:23.761 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.761 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.761 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:23.761 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:23.761 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 78.076419311999999, 2024-04-18T21:06:23.761 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043581898000000001, 2024-04-18T21:06:23.762 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:23.762 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:23.762 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:23.762 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:23.762 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.762 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:23.762 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:23.762 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:23.762 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.762 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.762 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:23.762 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:23.762 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:23.762 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.763 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.763 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:23.763 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616641+0000", 2024-04-18T21:06:23.763 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:06:23.763 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.763 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.763 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:23.763 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616648+0000", 2024-04-18T21:06:23.763 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3860000000000001e-06 2024-04-18T21:06:23.763 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.763 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.763 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:23.763 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616666+0000", 2024-04-18T21:06:23.763 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7583000000000001e-05 2024-04-18T21:06:23.763 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.764 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.764 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:23.764 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616679+0000", 2024-04-18T21:06:23.764 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3322999999999999e-05 2024-04-18T21:06:23.764 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.764 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.764 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:23.764 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630373+0000", 2024-04-18T21:06:23.764 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013694207999999999 2024-04-18T21:06:23.764 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.764 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.764 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:23.764 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630545+0000", 2024-04-18T21:06:23.764 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000171683 2024-04-18T21:06:23.764 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.764 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.765 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:23.765 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630728+0000", 2024-04-18T21:06:23.765 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000182599 2024-04-18T21:06:23.765 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.765 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.765 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:23.765 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640600+0000", 2024-04-18T21:06:23.765 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0098726119999999994 2024-04-18T21:06:23.765 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.765 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.765 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:23.765 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659927+0000", 2024-04-18T21:06:23.765 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019326724999999999 2024-04-18T21:06:23.765 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.765 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.766 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:23.766 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660112+0000", 2024-04-18T21:06:23.766 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000185203 2024-04-18T21:06:23.766 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.766 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.766 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:23.766 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660222+0000", 2024-04-18T21:06:23.766 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109343 2024-04-18T21:06:23.766 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:23.766 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:23.766 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:23.766 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.766 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.766 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:23.766 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:23.766 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 78.075553954, 2024-04-18T21:06:23.767 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043121310000000003, 2024-04-18T21:06:23.767 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:23.767 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:23.767 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:23.767 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:23.767 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.767 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:23.767 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:23.767 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:23.767 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.767 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.767 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:23.767 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:23.767 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:23.767 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.768 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.768 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:23.768 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617506+0000", 2024-04-18T21:06:23.768 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9999999999999995e-07 2024-04-18T21:06:23.768 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.768 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.768 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:23.768 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617513+0000", 2024-04-18T21:06:23.768 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.9700000000000002e-06 2024-04-18T21:06:23.768 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.768 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.768 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:23.768 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617531+0000", 2024-04-18T21:06:23.768 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8105999999999999e-05 2024-04-18T21:06:23.769 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.769 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.769 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:23.769 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617545+0000", 2024-04-18T21:06:23.769 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3703000000000001e-05 2024-04-18T21:06:23.769 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.769 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.769 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:23.769 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632129+0000", 2024-04-18T21:06:23.769 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.014584135999999999 2024-04-18T21:06:23.769 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.769 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.769 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:23.769 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632361+0000", 2024-04-18T21:06:23.769 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023171800000000001 2024-04-18T21:06:23.769 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.770 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.770 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:23.770 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632804+0000", 2024-04-18T21:06:23.770 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000443549 2024-04-18T21:06:23.770 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.770 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.770 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:23.770 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646340+0000", 2024-04-18T21:06:23.770 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013535902000000001 2024-04-18T21:06:23.770 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.770 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.770 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:23.770 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660363+0000", 2024-04-18T21:06:23.770 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01402318 2024-04-18T21:06:23.771 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.771 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.771 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:23.771 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660523+0000", 2024-04-18T21:06:23.771 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00015989899999999999 2024-04-18T21:06:23.771 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.771 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.771 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:23.771 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660626+0000", 2024-04-18T21:06:23.771 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010314699999999999 2024-04-18T21:06:23.771 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:23.771 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:23.771 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:23.771 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.771 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.771 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:23.772 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:23.772 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 78.075414261000006, 2024-04-18T21:06:23.772 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024927483, 2024-04-18T21:06:23.772 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:23.772 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:23.772 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:23.772 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:23.772 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.772 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:23.772 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:23.772 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:23.772 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.772 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.772 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:23.773 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:23.773 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:23.773 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.773 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.773 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:23.773 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617646+0000", 2024-04-18T21:06:23.773 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3030000000000001e-06 2024-04-18T21:06:23.773 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.773 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.773 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:23.773 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617653+0000", 2024-04-18T21:06:23.773 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7530000000000004e-06 2024-04-18T21:06:23.773 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.773 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.773 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:23.773 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617673+0000", 2024-04-18T21:06:23.774 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9967e-05 2024-04-18T21:06:23.774 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.774 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.774 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:23.774 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617688+0000", 2024-04-18T21:06:23.774 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5153e-05 2024-04-18T21:06:23.774 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.774 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.774 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:23.774 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619244+0000", 2024-04-18T21:06:23.774 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001555531 2024-04-18T21:06:23.774 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.774 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.774 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:23.774 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619361+0000", 2024-04-18T21:06:23.775 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011784400000000001 2024-04-18T21:06:23.775 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.775 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.775 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:23.775 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619604+0000", 2024-04-18T21:06:23.775 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000243007 2024-04-18T21:06:23.775 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.775 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.775 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:23.775 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.625480+0000", 2024-04-18T21:06:23.775 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0058759349999999997 2024-04-18T21:06:23.775 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.775 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.775 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:23.776 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642342+0000", 2024-04-18T21:06:23.776 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016861373999999998 2024-04-18T21:06:23.776 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.776 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.776 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:23.776 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642484+0000", 2024-04-18T21:06:23.776 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000142423 2024-04-18T21:06:23.776 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.776 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.776 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:23.776 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642572+0000", 2024-04-18T21:06:23.776 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8193000000000001e-05 2024-04-18T21:06:23.776 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:23.776 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:23.776 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:23.776 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.777 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.777 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:23.777 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:23.777 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 78.075132757999995, 2024-04-18T21:06:23.777 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024956974999999999, 2024-04-18T21:06:23.777 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:23.777 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:23.777 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:23.777 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:23.777 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.777 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:23.777 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:23.777 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:23.777 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.777 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.777 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:23.778 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:23.778 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:23.778 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.778 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.778 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:23.778 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617928+0000", 2024-04-18T21:06:23.778 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5430000000000001e-06 2024-04-18T21:06:23.778 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.778 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.778 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:23.778 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617937+0000", 2024-04-18T21:06:23.778 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6629999999999999e-06 2024-04-18T21:06:23.778 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.778 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.779 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:23.779 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617955+0000", 2024-04-18T21:06:23.779 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8749999999999998e-05 2024-04-18T21:06:23.779 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.779 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.779 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:23.779 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617971+0000", 2024-04-18T21:06:23.779 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.605e-05 2024-04-18T21:06:23.779 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.779 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.779 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:23.779 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621019+0000", 2024-04-18T21:06:23.779 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0030472369999999999 2024-04-18T21:06:23.779 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.779 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.780 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:23.780 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621249+0000", 2024-04-18T21:06:23.780 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000230075 2024-04-18T21:06:23.780 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.780 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.780 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:23.780 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621450+0000", 2024-04-18T21:06:23.780 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020166499999999999 2024-04-18T21:06:23.780 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.780 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.780 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:23.780 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.626233+0000", 2024-04-18T21:06:23.780 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047827390000000003 2024-04-18T21:06:23.780 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.780 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.780 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:23.781 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642693+0000", 2024-04-18T21:06:23.781 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01645961 2024-04-18T21:06:23.781 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.781 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.781 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:23.781 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642798+0000", 2024-04-18T21:06:23.781 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010559499999999999 2024-04-18T21:06:23.781 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.781 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.781 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:23.781 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642883+0000", 2024-04-18T21:06:23.781 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5048000000000003e-05 2024-04-18T21:06:23.781 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:23.781 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:23.781 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:23.781 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.782 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.782 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:23.782 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:23.782 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 78.073437130000002, 2024-04-18T21:06:23.782 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024086478000000001, 2024-04-18T21:06:23.782 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:23.782 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:23.782 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:23.782 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:23.782 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.782 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:23.782 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:23.782 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:23.782 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.782 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.783 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:23.783 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:23.783 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:23.783 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.783 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.783 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:23.783 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619624+0000", 2024-04-18T21:06:23.783 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.75e-06 2024-04-18T21:06:23.783 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.783 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.783 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:23.783 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619637+0000", 2024-04-18T21:06:23.783 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3540000000000001e-05 2024-04-18T21:06:23.783 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.783 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.784 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:23.784 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619666+0000", 2024-04-18T21:06:23.784 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8685999999999999e-05 2024-04-18T21:06:23.784 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.784 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.784 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:23.784 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619685+0000", 2024-04-18T21:06:23.784 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8681999999999998e-05 2024-04-18T21:06:23.784 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.784 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.784 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:23.784 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622275+0000", 2024-04-18T21:06:23.784 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0025899260000000002 2024-04-18T21:06:23.784 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.785 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.785 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:23.785 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622572+0000", 2024-04-18T21:06:23.785 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00029722 2024-04-18T21:06:23.785 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.785 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.785 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:23.785 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622752+0000", 2024-04-18T21:06:23.785 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018065900000000001 2024-04-18T21:06:23.785 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.785 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.785 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:23.785 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.626326+0000", 2024-04-18T21:06:23.785 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035737310000000001 2024-04-18T21:06:23.785 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.785 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.786 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:23.786 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643565+0000", 2024-04-18T21:06:23.786 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017238430999999999 2024-04-18T21:06:23.786 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.786 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.786 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:23.786 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643646+0000", 2024-04-18T21:06:23.786 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.1481000000000001e-05 2024-04-18T21:06:23.786 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.786 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.786 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:23.786 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643708+0000", 2024-04-18T21:06:23.786 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.2372000000000005e-05 2024-04-18T21:06:23.786 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:23.787 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:23.787 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:23.787 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.787 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.787 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:23.787 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:23.787 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 78.073270977000007, 2024-04-18T21:06:23.787 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026822450000000001, 2024-04-18T21:06:23.787 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:23.787 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:23.787 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:23.787 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:23.787 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.787 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:23.787 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:23.788 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:23.788 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.788 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.788 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:23.788 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:23.788 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:23.788 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.788 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.788 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:23.788 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619789+0000", 2024-04-18T21:06:23.788 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:06:23.788 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.788 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.788 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:23.788 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619797+0000", 2024-04-18T21:06:23.788 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.6899999999999992e-06 2024-04-18T21:06:23.789 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.789 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.789 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:23.789 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619816+0000", 2024-04-18T21:06:23.789 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9352999999999999e-05 2024-04-18T21:06:23.789 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.789 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.789 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:23.789 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619832+0000", 2024-04-18T21:06:23.789 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6013000000000001e-05 2024-04-18T21:06:23.789 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.789 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.789 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:23.789 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620528+0000", 2024-04-18T21:06:23.789 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00069565600000000001 2024-04-18T21:06:23.789 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.790 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.790 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:23.790 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620735+0000", 2024-04-18T21:06:23.790 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000207025 2024-04-18T21:06:23.790 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.790 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.790 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:23.790 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620912+0000", 2024-04-18T21:06:23.790 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017748199999999999 2024-04-18T21:06:23.790 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.790 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.790 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:23.790 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.625605+0000", 2024-04-18T21:06:23.790 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0046924439999999996 2024-04-18T21:06:23.790 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.791 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.791 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:23.791 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646349+0000", 2024-04-18T21:06:23.791 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.020744318000000001 2024-04-18T21:06:23.791 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.791 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.791 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:23.791 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646483+0000", 2024-04-18T21:06:23.791 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013428999999999999 2024-04-18T21:06:23.791 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.791 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.791 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:23.791 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646611+0000", 2024-04-18T21:06:23.791 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012710299999999999 2024-04-18T21:06:23.791 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:23.792 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:23.792 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:23.792 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.792 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.792 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:23.792 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:06:23.792 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 78.072600543999997, 2024-04-18T21:06:23.792 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023516516000000001, 2024-04-18T21:06:23.792 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:23.792 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:23.792 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:06:23.792 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:23.792 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.792 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:23.793 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:06:23.793 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:23.793 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.793 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.793 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:23.793 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:06:23.793 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:23.793 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.793 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.793 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:23.793 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620460+0000", 2024-04-18T21:06:23.793 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.787e-06 2024-04-18T21:06:23.793 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.793 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.793 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:23.793 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620470+0000", 2024-04-18T21:06:23.794 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.2560000000000008e-06 2024-04-18T21:06:23.794 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.794 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.794 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:23.794 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620496+0000", 2024-04-18T21:06:23.794 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.6205999999999999e-05 2024-04-18T21:06:23.794 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.794 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.794 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:23.794 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620517+0000", 2024-04-18T21:06:23.794 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1223e-05 2024-04-18T21:06:23.794 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.794 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.794 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:23.794 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624060+0000", 2024-04-18T21:06:23.794 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035434160000000002 2024-04-18T21:06:23.795 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.795 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.795 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:23.795 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624390+0000", 2024-04-18T21:06:23.795 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00033000500000000002 2024-04-18T21:06:23.795 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:23.795 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:23.795 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:23.795 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643975+0000", 2024-04-18T21:06:23.795 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019584622999999999 2024-04-18T21:06:23.795 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:23.795 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:23.795 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:23.795 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:23.795 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:23.795 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:23.796 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:06:23.797 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:23.798 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:23.798+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:23.800 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-18T21:06:23.800 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-18T21:06:23.800 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-18T21:06:23.800 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-18T21:06:23.898 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:23.899+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:23.928 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:06:23.928 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [], 2024-04-18T21:06:23.928 INFO:teuthology.orchestra.run.smithi150.stdout: "num_ops": 0 2024-04-18T21:06:23.928 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:06:23.943 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:23.993 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:06:23.994 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:06:24.028 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1: {} 2024-04-18T21:06:24.028 INFO:teuthology.orchestra.run.smithi078.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:06:24.033 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:24.035+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:24.057 INFO:teuthology.orchestra.run.smithi078.stderr:no valid command found; 10 closest matches: 2024-04-18T21:06:24.057 INFO:teuthology.orchestra.run.smithi078.stderr:0 2024-04-18T21:06:24.057 INFO:teuthology.orchestra.run.smithi078.stderr:1 2024-04-18T21:06:24.057 INFO:teuthology.orchestra.run.smithi078.stderr:2 2024-04-18T21:06:24.057 INFO:teuthology.orchestra.run.smithi078.stderr:abort 2024-04-18T21:06:24.057 INFO:teuthology.orchestra.run.smithi078.stderr:assert 2024-04-18T21:06:24.057 INFO:teuthology.orchestra.run.smithi078.stderr:bench [] [] [] [] 2024-04-18T21:06:24.057 INFO:teuthology.orchestra.run.smithi078.stderr:bluefs debug_inject_read_zeros 2024-04-18T21:06:24.057 INFO:teuthology.orchestra.run.smithi078.stderr:bluefs files list 2024-04-18T21:06:24.058 INFO:teuthology.orchestra.run.smithi078.stderr:bluefs stats 2024-04-18T21:06:24.058 INFO:teuthology.orchestra.run.smithi078.stderr:bluestore allocator dump block 2024-04-18T21:06:24.058 INFO:teuthology.orchestra.run.smithi078.stderr:Error EINVAL: invalid command 2024-04-18T21:06:24.061 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-18T21:06:24.061 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-18T21:06:24.061 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-18T21:06:24.062 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:06:24.062 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:24.099 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:24.099+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:24.112 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:24.112 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:24.126 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:24.213 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:24.215+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:24.277 INFO:teuthology.orchestra.run.smithi078.stderr:no valid command found; 10 closest matches: 2024-04-18T21:06:24.277 INFO:teuthology.orchestra.run.smithi078.stderr:0 2024-04-18T21:06:24.277 INFO:teuthology.orchestra.run.smithi078.stderr:1 2024-04-18T21:06:24.277 INFO:teuthology.orchestra.run.smithi078.stderr:2 2024-04-18T21:06:24.277 INFO:teuthology.orchestra.run.smithi078.stderr:abort 2024-04-18T21:06:24.277 INFO:teuthology.orchestra.run.smithi078.stderr:assert 2024-04-18T21:06:24.278 INFO:teuthology.orchestra.run.smithi078.stderr:bench [] [] [] [] 2024-04-18T21:06:24.278 INFO:teuthology.orchestra.run.smithi078.stderr:bluefs debug_inject_read_zeros 2024-04-18T21:06:24.278 INFO:teuthology.orchestra.run.smithi078.stderr:bluefs files list 2024-04-18T21:06:24.278 INFO:teuthology.orchestra.run.smithi078.stderr:bluefs stats 2024-04-18T21:06:24.278 INFO:teuthology.orchestra.run.smithi078.stderr:bluestore allocator dump block 2024-04-18T21:06:24.278 INFO:teuthology.orchestra.run.smithi078.stderr:Error EINVAL: invalid command 2024-04-18T21:06:24.281 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-18T21:06:24.281 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-18T21:06:24.282 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-18T21:06:24.291 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:24.291 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:24.301 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:24.299+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:24.305 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:24.401 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:24.402+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:24.438 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:24.438 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:24.454 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:24.499 INFO:teuthology.orchestra.run.smithi078.stderr:no valid command found; 10 closest matches: 2024-04-18T21:06:24.499 INFO:teuthology.orchestra.run.smithi078.stderr:0 2024-04-18T21:06:24.499 INFO:teuthology.orchestra.run.smithi078.stderr:1 2024-04-18T21:06:24.499 INFO:teuthology.orchestra.run.smithi078.stderr:2 2024-04-18T21:06:24.499 INFO:teuthology.orchestra.run.smithi078.stderr:abort 2024-04-18T21:06:24.499 INFO:teuthology.orchestra.run.smithi078.stderr:assert 2024-04-18T21:06:24.499 INFO:teuthology.orchestra.run.smithi078.stderr:bench [] [] [] [] 2024-04-18T21:06:24.499 INFO:teuthology.orchestra.run.smithi078.stderr:bluefs debug_inject_read_zeros 2024-04-18T21:06:24.500 INFO:teuthology.orchestra.run.smithi078.stderr:bluefs files list 2024-04-18T21:06:24.500 INFO:teuthology.orchestra.run.smithi078.stderr:bluefs stats 2024-04-18T21:06:24.500 INFO:teuthology.orchestra.run.smithi078.stderr:bluestore allocator dump block 2024-04-18T21:06:24.500 INFO:teuthology.orchestra.run.smithi078.stderr:Error EINVAL: invalid command 2024-04-18T21:06:24.502 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:24.503+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:24.503 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-18T21:06:24.503 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-18T21:06:24.602 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:24.602+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:24.620 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:24.620 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:24.635 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:24.647 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-18T21:06:24.704 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:24.703+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:24.800 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:24.800 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:24.804 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:24.802+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:24.814 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:24.905 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:24.906+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:24.947 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:24.947 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:24.961 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:25.007 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:25.006+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:25.086 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:25.086 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:25.100 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:25.143 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:25.142+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:25.208 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:25.210+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:25.265 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:25.265 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:25.280 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:25.309 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:25.310+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:25.410 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:25.411+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:25.411 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:25.411 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:25.426 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:25.511 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:25.510+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:25.591 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:25.591 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:25.605 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:25.635 INFO:teuthology.orchestra.run.smithi078.stderr:nodeep-scrub is set 2024-04-18T21:06:25.649 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:25.651+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:25.712 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:25.714+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:25.728 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:25.728 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:25.743 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:25.813 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:25.814+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:25.874 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:25.874 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:25.890 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:25.914 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:25.914+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:26.006 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:26.007 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:26.014 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:26.014+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:26.021 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:26.084 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:06:26.115 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:26.114+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:26.180 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:26.180 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:26.195 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:26.239 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:26.238+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:26.281 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:06:26.282 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:06:26.315 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1: {} 2024-04-18T21:06:26.315 INFO:teuthology.orchestra.run.smithi078.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:06:26.316 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:26.314+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:26.325 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:26.325 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:06:26.325 INFO:teuthology.orchestra.run.smithi132.stdout: "num_ops": 0 2024-04-18T21:06:26.325 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:26.339 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:26.347 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:06:26.348 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:26.417 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:26.414+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:26.505 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:26.506 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:06:26.506 INFO:teuthology.orchestra.run.smithi132.stdout: "complaint_time": 30, 2024-04-18T21:06:26.506 INFO:teuthology.orchestra.run.smithi132.stdout: "num_blocked_ops": 0 2024-04-18T21:06:26.506 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:26.517 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:26.514+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:26.519 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:26.618 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:26.619+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:26.688 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:26.688 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 20, 2024-04-18T21:06:26.688 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 600, 2024-04-18T21:06:26.688 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [ 2024-04-18T21:06:26.688 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.688 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:26.688 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:06:26.689 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 91.776142214999993, 2024-04-18T21:06:26.689 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.02518273, 2024-04-18T21:06:26.689 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:26.689 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:26.689 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:26.689 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:26.689 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:26.689 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:26.689 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 141 2024-04-18T21:06:26.689 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.689 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:26.689 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.689 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:26.689 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:06:26.690 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:26.690 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.690 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.690 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:26.690 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:06:26.690 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:26.690 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.690 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.690 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:26.690 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911562+0000", 2024-04-18T21:06:26.690 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9300000000000006e-07 2024-04-18T21:06:26.690 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.691 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.691 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:26.691 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911569+0000", 2024-04-18T21:06:26.691 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0169999999999999e-06 2024-04-18T21:06:26.691 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.691 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.691 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:26.691 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911582+0000", 2024-04-18T21:06:26.691 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.343e-05 2024-04-18T21:06:26.691 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.691 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.691 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:26.691 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911590+0000", 2024-04-18T21:06:26.692 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.413e-06 2024-04-18T21:06:26.692 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.692 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.692 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:26.692 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.933922+0000", 2024-04-18T21:06:26.692 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.022332093000000001 2024-04-18T21:06:26.692 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.692 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.692 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:26.692 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.934155+0000", 2024-04-18T21:06:26.692 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023378900000000001 2024-04-18T21:06:26.692 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.692 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.693 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:26.693 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.934514+0000", 2024-04-18T21:06:26.693 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00035859200000000003 2024-04-18T21:06:26.693 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.693 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.693 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:26.693 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.935973+0000", 2024-04-18T21:06:26.693 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001458705 2024-04-18T21:06:26.693 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.693 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.693 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:26.693 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936488+0000", 2024-04-18T21:06:26.693 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00051550000000000001 2024-04-18T21:06:26.693 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.694 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.694 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:26.694 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936636+0000", 2024-04-18T21:06:26.694 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014779800000000001 2024-04-18T21:06:26.694 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.694 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.694 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:26.694 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936743+0000", 2024-04-18T21:06:26.694 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010739999999999999 2024-04-18T21:06:26.694 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:26.694 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:26.694 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:26.694 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.695 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.695 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:26.695 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:26.695 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 91.658943241000003, 2024-04-18T21:06:26.695 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023654959999999999, 2024-04-18T21:06:26.695 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:26.695 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:26.695 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:26.695 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:26.695 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:26.695 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:26.695 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 163 2024-04-18T21:06:26.695 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.695 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:26.696 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.696 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:26.696 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:26.696 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:26.696 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.696 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.696 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:26.696 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:26.696 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:26.696 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.696 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.696 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:26.696 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:26.697 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0999999999999998e-07 2024-04-18T21:06:26.697 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.697 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.697 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:26.697 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028766+0000", 2024-04-18T21:06:26.697 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4700000000000001e-06 2024-04-18T21:06:26.697 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.697 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.697 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:26.697 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028775+0000", 2024-04-18T21:06:26.697 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.3190000000000001e-06 2024-04-18T21:06:26.697 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.697 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.698 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:26.698 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028782+0000", 2024-04-18T21:06:26.698 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.2300000000000002e-06 2024-04-18T21:06:26.698 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.698 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.698 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:26.698 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046667+0000", 2024-04-18T21:06:26.698 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017884356000000001 2024-04-18T21:06:26.698 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.698 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.698 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:26.698 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046788+0000", 2024-04-18T21:06:26.698 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012125000000000001 2024-04-18T21:06:26.698 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.699 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.699 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:26.699 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046982+0000", 2024-04-18T21:06:26.699 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019394 2024-04-18T21:06:26.699 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.699 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.699 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:26.699 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051969+0000", 2024-04-18T21:06:26.699 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0049868150000000003 2024-04-18T21:06:26.699 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.699 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.699 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:26.699 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052089+0000", 2024-04-18T21:06:26.699 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011993 2024-04-18T21:06:26.700 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.700 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.700 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:26.700 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052292+0000", 2024-04-18T21:06:26.700 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020345699999999999 2024-04-18T21:06:26.700 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.700 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.700 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:26.700 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052415+0000", 2024-04-18T21:06:26.700 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000122483 2024-04-18T21:06:26.700 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:26.700 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:26.700 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:26.700 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.701 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.701 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:26.701 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:26.701 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 91.658909008999998, 2024-04-18T21:06:26.701 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023864586, 2024-04-18T21:06:26.701 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:26.701 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:26.701 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:26.701 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:26.701 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:26.701 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:26.701 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 164 2024-04-18T21:06:26.701 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.701 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:26.702 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.702 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:26.702 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:26.702 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:26.702 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.702 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.702 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:26.702 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:26.702 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:26.702 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.702 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.702 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:26.702 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028795+0000", 2024-04-18T21:06:26.702 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7999999999999995e-07 2024-04-18T21:06:26.703 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.703 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.703 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:26.703 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028884+0000", 2024-04-18T21:06:26.703 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8997000000000002e-05 2024-04-18T21:06:26.703 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.703 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.703 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:26.703 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028895+0000", 2024-04-18T21:06:26.703 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1647e-05 2024-04-18T21:06:26.703 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.703 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.703 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:26.703 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028903+0000", 2024-04-18T21:06:26.704 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.909e-06 2024-04-18T21:06:26.704 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.705 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.705 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:26.705 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.047818+0000", 2024-04-18T21:06:26.705 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018914337 2024-04-18T21:06:26.705 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.705 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.705 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:26.705 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.048094+0000", 2024-04-18T21:06:26.706 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00027653500000000001 2024-04-18T21:06:26.706 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.706 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.706 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:26.706 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.048471+0000", 2024-04-18T21:06:26.706 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00037705799999999999 2024-04-18T21:06:26.706 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.706 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.706 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:26.706 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052516+0000", 2024-04-18T21:06:26.706 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0040452739999999997 2024-04-18T21:06:26.706 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.707 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.707 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:26.707 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052535+0000", 2024-04-18T21:06:26.707 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.84e-05 2024-04-18T21:06:26.707 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.707 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.707 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:26.707 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052603+0000", 2024-04-18T21:06:26.707 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.8095000000000004e-05 2024-04-18T21:06:26.707 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.707 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.707 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:26.707 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052659+0000", 2024-04-18T21:06:26.707 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5653999999999999e-05 2024-04-18T21:06:26.708 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:26.708 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:26.708 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:26.708 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.708 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.708 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:26.708 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:26.708 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 91.658785566000006, 2024-04-18T21:06:26.708 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024516458000000001, 2024-04-18T21:06:26.708 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:26.708 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:26.708 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:26.708 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:26.708 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:26.709 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:26.709 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 165 2024-04-18T21:06:26.709 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.709 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:26.709 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.709 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:26.709 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:26.709 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:26.709 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.709 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.709 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:26.709 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:26.710 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:26.710 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.710 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.710 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:26.710 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028918+0000", 2024-04-18T21:06:26.710 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8000000000000005e-07 2024-04-18T21:06:26.710 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.710 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.710 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:26.710 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028924+0000", 2024-04-18T21:06:26.710 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5659999999999997e-06 2024-04-18T21:06:26.710 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.710 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.711 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:26.711 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028933+0000", 2024-04-18T21:06:26.711 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.38e-06 2024-04-18T21:06:26.711 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.711 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.711 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:26.711 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028940+0000", 2024-04-18T21:06:26.711 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0060000000000003e-06 2024-04-18T21:06:26.711 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.711 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.711 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:26.711 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.050846+0000", 2024-04-18T21:06:26.711 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021906119000000002 2024-04-18T21:06:26.712 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.712 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.712 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:26.712 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051025+0000", 2024-04-18T21:06:26.712 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017850799999999999 2024-04-18T21:06:26.712 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.712 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.712 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:26.712 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051221+0000", 2024-04-18T21:06:26.712 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019608700000000001 2024-04-18T21:06:26.712 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.712 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.712 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:26.712 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052675+0000", 2024-04-18T21:06:26.712 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0014537899999999999 2024-04-18T21:06:26.713 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.713 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.713 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:26.713 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053311+0000", 2024-04-18T21:06:26.713 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00063613299999999999 2024-04-18T21:06:26.713 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.713 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.713 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:26.713 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053381+0000", 2024-04-18T21:06:26.713 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0074999999999996e-05 2024-04-18T21:06:26.713 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.713 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.713 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:26.713 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053434+0000", 2024-04-18T21:06:26.714 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3013999999999998e-05 2024-04-18T21:06:26.714 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:26.714 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:26.714 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:26.714 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.714 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.714 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:26.714 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:26.714 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 91.545480087000001, 2024-04-18T21:06:26.714 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023772793, 2024-04-18T21:06:26.714 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:26.714 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:26.714 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:26.714 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:26.715 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:26.715 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:26.715 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 187 2024-04-18T21:06:26.715 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.715 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:26.715 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.715 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:26.715 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:26.715 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:26.715 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.715 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.715 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:26.715 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:26.715 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:26.715 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.715 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.716 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:26.716 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142224+0000", 2024-04-18T21:06:26.716 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.47e-07 2024-04-18T21:06:26.716 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.716 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.716 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:26.716 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142233+0000", 2024-04-18T21:06:26.716 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0729999999999994e-06 2024-04-18T21:06:26.716 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.716 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.716 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:26.716 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142255+0000", 2024-04-18T21:06:26.716 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.2535999999999999e-05 2024-04-18T21:06:26.716 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.716 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.717 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:26.717 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142268+0000", 2024-04-18T21:06:26.717 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2686e-05 2024-04-18T21:06:26.717 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.717 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.717 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:26.717 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160497+0000", 2024-04-18T21:06:26.717 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018228779000000001 2024-04-18T21:06:26.717 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.717 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.717 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:26.717 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160634+0000", 2024-04-18T21:06:26.717 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000137315 2024-04-18T21:06:26.717 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.717 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.718 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:26.718 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160831+0000", 2024-04-18T21:06:26.718 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019683100000000001 2024-04-18T21:06:26.718 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.718 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.718 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:26.718 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165129+0000", 2024-04-18T21:06:26.718 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0042981299999999998 2024-04-18T21:06:26.718 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.718 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.718 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:26.718 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165776+0000", 2024-04-18T21:06:26.718 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00064702900000000003 2024-04-18T21:06:26.719 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.719 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.719 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:26.719 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165921+0000", 2024-04-18T21:06:26.719 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014506 2024-04-18T21:06:26.719 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.719 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.719 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:26.719 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165996+0000", 2024-04-18T21:06:26.719 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.4406999999999994e-05 2024-04-18T21:06:26.719 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:26.719 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:26.719 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:26.719 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.720 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.720 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:26.720 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:26.720 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 91.545419488999997, 2024-04-18T21:06:26.720 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026802157, 2024-04-18T21:06:26.720 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:26.720 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:26.720 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:26.720 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:26.720 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:26.720 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:26.720 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 188 2024-04-18T21:06:26.720 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.720 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:26.720 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.721 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:26.721 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:26.721 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:26.721 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.721 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.721 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:26.721 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:26.721 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:26.721 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.721 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.721 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:26.721 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142284+0000", 2024-04-18T21:06:26.721 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4e-07 2024-04-18T21:06:26.721 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.722 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.722 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:26.722 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142374+0000", 2024-04-18T21:06:26.722 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0099999999999995e-05 2024-04-18T21:06:26.722 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.722 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.722 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:26.722 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142386+0000", 2024-04-18T21:06:26.722 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1770000000000001e-05 2024-04-18T21:06:26.722 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.722 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.722 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:26.722 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142394+0000", 2024-04-18T21:06:26.723 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.2130000000000008e-06 2024-04-18T21:06:26.723 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.723 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.723 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:26.723 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.161743+0000", 2024-04-18T21:06:26.723 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019348644000000002 2024-04-18T21:06:26.723 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.723 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.723 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:26.723 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.161865+0000", 2024-04-18T21:06:26.723 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012210899999999999 2024-04-18T21:06:26.723 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.723 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.723 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:26.724 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.162055+0000", 2024-04-18T21:06:26.724 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000189994 2024-04-18T21:06:26.724 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.724 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.724 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:26.724 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165735+0000", 2024-04-18T21:06:26.724 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0036803270000000002 2024-04-18T21:06:26.724 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.724 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.724 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:26.724 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.168911+0000", 2024-04-18T21:06:26.724 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0031753689999999999 2024-04-18T21:06:26.724 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.725 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.725 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:26.725 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169012+0000", 2024-04-18T21:06:26.725 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010157699999999999 2024-04-18T21:06:26.725 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.725 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.725 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:26.725 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169086+0000", 2024-04-18T21:06:26.725 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3213999999999994e-05 2024-04-18T21:06:26.725 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:26.725 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:26.725 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:26.725 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.725 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.726 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:26.726 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:26.726 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 91.545294182999996, 2024-04-18T21:06:26.726 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026811423000000001, 2024-04-18T21:06:26.726 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:26.726 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:26.726 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:26.726 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:26.726 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:26.726 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:26.726 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 189 2024-04-18T21:06:26.726 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.726 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:26.727 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.727 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:26.727 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:26.727 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:26.727 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.727 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.727 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:26.727 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:26.727 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:26.727 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.727 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.727 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:26.727 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142410+0000", 2024-04-18T21:06:26.727 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:06:26.728 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.728 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.728 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:26.728 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142415+0000", 2024-04-18T21:06:26.728 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.7939999999999999e-06 2024-04-18T21:06:26.728 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.728 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.728 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:26.728 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142470+0000", 2024-04-18T21:06:26.728 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4537999999999999e-05 2024-04-18T21:06:26.728 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.728 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.728 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:26.728 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142481+0000", 2024-04-18T21:06:26.729 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0966e-05 2024-04-18T21:06:26.729 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.729 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.729 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:26.729 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.163493+0000", 2024-04-18T21:06:26.729 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021012444000000002 2024-04-18T21:06:26.729 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.729 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.729 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:26.729 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.163727+0000", 2024-04-18T21:06:26.729 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000233339 2024-04-18T21:06:26.729 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.729 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.729 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:26.729 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.164102+0000", 2024-04-18T21:06:26.730 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000374872 2024-04-18T21:06:26.730 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.730 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.730 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:26.730 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.166528+0000", 2024-04-18T21:06:26.730 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0024258729999999998 2024-04-18T21:06:26.730 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.730 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.730 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:26.730 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169101+0000", 2024-04-18T21:06:26.730 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0025737680000000001 2024-04-18T21:06:26.730 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.731 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.731 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:26.731 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169171+0000", 2024-04-18T21:06:26.731 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0148000000000007e-05 2024-04-18T21:06:26.731 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.731 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.731 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:26.731 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169220+0000", 2024-04-18T21:06:26.731 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8767999999999998e-05 2024-04-18T21:06:26.731 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:26.731 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:26.731 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:26.731 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.731 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.732 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:26.732 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:26.732 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 81.071721631000003, 2024-04-18T21:06:26.732 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024082777999999999, 2024-04-18T21:06:26.732 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:26.732 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:26.732 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:26.732 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:26.732 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.732 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:26.732 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:26.732 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:26.732 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.732 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.733 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:26.733 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:26.733 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:26.733 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.733 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.733 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:26.733 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615984+0000", 2024-04-18T21:06:26.733 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.9869999999999999e-06 2024-04-18T21:06:26.733 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.733 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.733 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:26.733 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615999+0000", 2024-04-18T21:06:26.733 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4646e-05 2024-04-18T21:06:26.733 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.734 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.734 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:26.734 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616028+0000", 2024-04-18T21:06:26.734 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8952999999999999e-05 2024-04-18T21:06:26.734 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.734 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.734 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:26.734 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616052+0000", 2024-04-18T21:06:26.734 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.3941999999999999e-05 2024-04-18T21:06:26.734 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.734 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.734 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:26.734 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618010+0000", 2024-04-18T21:06:26.734 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0019581780000000001 2024-04-18T21:06:26.735 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.735 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.735 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:26.735 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618322+0000", 2024-04-18T21:06:26.735 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00031158899999999997 2024-04-18T21:06:26.735 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.735 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.735 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:26.735 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618587+0000", 2024-04-18T21:06:26.735 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00026495700000000002 2024-04-18T21:06:26.735 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.735 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.736 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:26.736 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629262+0000", 2024-04-18T21:06:26.736 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010675877 2024-04-18T21:06:26.736 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.736 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.736 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:26.736 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.639773+0000", 2024-04-18T21:06:26.736 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0105109 2024-04-18T21:06:26.736 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.736 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.736 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:26.736 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.639926+0000", 2024-04-18T21:06:26.736 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000152349 2024-04-18T21:06:26.736 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.737 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.737 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:26.737 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640064+0000", 2024-04-18T21:06:26.737 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0001384 2024-04-18T21:06:26.737 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:26.737 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:26.737 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:26.737 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.737 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.737 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:26.737 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:26.737 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 81.071608956999995, 2024-04-18T21:06:26.737 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030215005999999999, 2024-04-18T21:06:26.738 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:26.738 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:26.738 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:26.738 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:26.738 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.738 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:26.738 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:26.738 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:26.738 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.738 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.738 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:26.738 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:26.738 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:26.739 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.739 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.739 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:26.739 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616095+0000", 2024-04-18T21:06:26.739 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.446e-06 2024-04-18T21:06:26.739 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.739 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.739 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:26.739 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616104+0000", 2024-04-18T21:06:26.739 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6200000000000005e-06 2024-04-18T21:06:26.739 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.739 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.739 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:26.739 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616132+0000", 2024-04-18T21:06:26.740 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7668999999999999e-05 2024-04-18T21:06:26.740 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.740 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.740 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:26.740 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616149+0000", 2024-04-18T21:06:26.740 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7047000000000001e-05 2024-04-18T21:06:26.740 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.740 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.740 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:26.740 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619287+0000", 2024-04-18T21:06:26.740 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0031381450000000002 2024-04-18T21:06:26.740 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.740 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.740 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:26.740 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619503+0000", 2024-04-18T21:06:26.741 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000216522 2024-04-18T21:06:26.741 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.741 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.741 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:26.741 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619930+0000", 2024-04-18T21:06:26.741 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00042604900000000001 2024-04-18T21:06:26.741 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.741 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.741 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:26.741 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629281+0000", 2024-04-18T21:06:26.741 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0093512230000000005 2024-04-18T21:06:26.741 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.741 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.741 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:26.742 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646022+0000", 2024-04-18T21:06:26.742 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016741156 2024-04-18T21:06:26.742 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.742 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.742 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:26.742 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646198+0000", 2024-04-18T21:06:26.742 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000176009 2024-04-18T21:06:26.742 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.742 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.742 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:26.742 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646309+0000", 2024-04-18T21:06:26.742 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011112000000000001 2024-04-18T21:06:26.742 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:26.743 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:26.743 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:26.743 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.743 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.743 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:26.743 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:26.743 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 81.071524132999997, 2024-04-18T21:06:26.743 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030501176000000001, 2024-04-18T21:06:26.743 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:26.743 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:26.743 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:26.743 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:26.743 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.744 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:26.744 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:26.744 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:26.744 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.744 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.744 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:26.744 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:26.744 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:26.744 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.744 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.744 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:26.744 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616180+0000", 2024-04-18T21:06:26.744 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1000000000000001e-06 2024-04-18T21:06:26.744 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.745 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.745 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:26.745 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616188+0000", 2024-04-18T21:06:26.745 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4069999999999993e-06 2024-04-18T21:06:26.745 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.745 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.745 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:26.745 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616207+0000", 2024-04-18T21:06:26.745 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8335999999999999e-05 2024-04-18T21:06:26.745 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.745 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.745 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:26.745 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616225+0000", 2024-04-18T21:06:26.745 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8652999999999999e-05 2024-04-18T21:06:26.745 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.746 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.746 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:26.746 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620977+0000", 2024-04-18T21:06:26.746 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047512220000000003 2024-04-18T21:06:26.746 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.746 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.746 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:26.746 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621279+0000", 2024-04-18T21:06:26.746 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000302646 2024-04-18T21:06:26.746 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.746 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.746 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:26.746 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621584+0000", 2024-04-18T21:06:26.747 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000305142 2024-04-18T21:06:26.747 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.747 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.747 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:26.747 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629352+0000", 2024-04-18T21:06:26.747 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0077673689999999997 2024-04-18T21:06:26.747 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.747 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.747 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:26.747 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646480+0000", 2024-04-18T21:06:26.747 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017128259 2024-04-18T21:06:26.747 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.747 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.748 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:26.748 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646591+0000", 2024-04-18T21:06:26.748 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011113899999999999 2024-04-18T21:06:26.748 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.748 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.748 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:26.748 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646680+0000", 2024-04-18T21:06:26.748 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8902999999999999e-05 2024-04-18T21:06:26.748 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:26.748 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:26.748 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:26.748 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.748 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.749 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:26.749 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:26.749 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 81.071457633999998, 2024-04-18T21:06:26.749 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030779760999999999, 2024-04-18T21:06:26.749 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:26.749 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:26.749 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:26.749 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:26.749 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.749 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:26.749 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:26.749 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:26.749 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.749 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.750 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:26.750 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:26.750 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:26.750 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.750 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.750 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:26.750 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616246+0000", 2024-04-18T21:06:26.750 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0499999999999999e-06 2024-04-18T21:06:26.750 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.750 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.750 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:26.750 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616253+0000", 2024-04-18T21:06:26.750 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.5989999999999998e-06 2024-04-18T21:06:26.751 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.751 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.751 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:26.751 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616273+0000", 2024-04-18T21:06:26.751 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9916999999999999e-05 2024-04-18T21:06:26.751 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.751 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.751 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:26.751 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616287+0000", 2024-04-18T21:06:26.751 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3669000000000001e-05 2024-04-18T21:06:26.751 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.751 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.751 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:26.751 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622203+0000", 2024-04-18T21:06:26.752 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.005916737 2024-04-18T21:06:26.752 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.752 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.752 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:26.752 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622379+0000", 2024-04-18T21:06:26.752 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000175596 2024-04-18T21:06:26.752 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.752 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.752 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:26.752 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622707+0000", 2024-04-18T21:06:26.752 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00032784600000000002 2024-04-18T21:06:26.752 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.752 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.752 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:26.752 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629366+0000", 2024-04-18T21:06:26.752 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0066593279999999999 2024-04-18T21:06:26.753 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.753 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.753 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:26.753 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646813+0000", 2024-04-18T21:06:26.753 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017447059000000001 2024-04-18T21:06:26.753 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.753 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.753 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:26.753 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646946+0000", 2024-04-18T21:06:26.753 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013301200000000001 2024-04-18T21:06:26.753 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.753 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.753 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:26.753 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647025+0000", 2024-04-18T21:06:26.753 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8948000000000004e-05 2024-04-18T21:06:26.754 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:26.754 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:26.754 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:26.754 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.754 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.754 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:26.754 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:26.754 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 81.071373816000005, 2024-04-18T21:06:26.754 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.031512165000000002, 2024-04-18T21:06:26.754 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:26.754 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:26.754 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:26.754 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:26.754 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.754 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:26.755 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:26.755 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:26.755 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.755 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.755 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:26.755 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:26.755 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:26.755 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.755 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.755 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:26.755 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616330+0000", 2024-04-18T21:06:26.755 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.15e-06 2024-04-18T21:06:26.755 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.755 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.756 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:26.756 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616337+0000", 2024-04-18T21:06:26.756 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.1289999999999998e-06 2024-04-18T21:06:26.756 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.756 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.756 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:26.756 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616447+0000", 2024-04-18T21:06:26.756 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109561 2024-04-18T21:06:26.756 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.756 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.756 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:26.756 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616496+0000", 2024-04-18T21:06:26.756 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8591999999999998e-05 2024-04-18T21:06:26.756 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.757 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.757 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:26.757 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.623786+0000", 2024-04-18T21:06:26.757 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0072906799999999999 2024-04-18T21:06:26.757 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.757 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.757 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:26.757 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.623973+0000", 2024-04-18T21:06:26.757 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018717199999999999 2024-04-18T21:06:26.757 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.757 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.757 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:26.757 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624260+0000", 2024-04-18T21:06:26.757 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00028630600000000001 2024-04-18T21:06:26.758 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.758 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.758 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:26.758 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629381+0000", 2024-04-18T21:06:26.758 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0051211340000000003 2024-04-18T21:06:26.758 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.758 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.758 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:26.758 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647631+0000", 2024-04-18T21:06:26.758 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018249771000000001 2024-04-18T21:06:26.758 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.758 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.758 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:26.758 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647761+0000", 2024-04-18T21:06:26.759 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013037300000000001 2024-04-18T21:06:26.759 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.759 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.759 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:26.759 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647841+0000", 2024-04-18T21:06:26.759 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.0296999999999994e-05 2024-04-18T21:06:26.759 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:26.759 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:26.759 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:26.759 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.759 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.759 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:26.759 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:26.759 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 81.071168331999999, 2024-04-18T21:06:26.760 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043251955000000002, 2024-04-18T21:06:26.760 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:26.760 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:26.760 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:26.760 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:26.760 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.760 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:26.760 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:26.760 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:26.760 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.760 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.760 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:26.760 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:26.760 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:26.760 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.761 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.761 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:26.761 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616536+0000", 2024-04-18T21:06:26.761 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2869999999999999e-06 2024-04-18T21:06:26.761 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.761 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.761 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:26.761 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616572+0000", 2024-04-18T21:06:26.761 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.6261999999999999e-05 2024-04-18T21:06:26.761 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.761 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.761 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:26.761 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616593+0000", 2024-04-18T21:06:26.761 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1310000000000001e-05 2024-04-18T21:06:26.761 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.761 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.762 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:26.762 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616614+0000", 2024-04-18T21:06:26.762 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.0936000000000001e-05 2024-04-18T21:06:26.762 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.762 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.762 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:26.762 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629501+0000", 2024-04-18T21:06:26.762 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.012886819000000001 2024-04-18T21:06:26.762 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.762 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.762 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:26.762 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629696+0000", 2024-04-18T21:06:26.762 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019485499999999999 2024-04-18T21:06:26.763 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.763 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.763 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:26.763 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629940+0000", 2024-04-18T21:06:26.763 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00024386399999999999 2024-04-18T21:06:26.763 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.763 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.763 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:26.763 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640100+0000", 2024-04-18T21:06:26.763 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010159645 2024-04-18T21:06:26.763 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.763 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.763 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:26.763 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659516+0000", 2024-04-18T21:06:26.764 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019416563000000001 2024-04-18T21:06:26.764 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.764 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.764 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:26.764 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659684+0000", 2024-04-18T21:06:26.764 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016750900000000001 2024-04-18T21:06:26.764 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.764 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.764 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:26.764 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659787+0000", 2024-04-18T21:06:26.764 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000102905 2024-04-18T21:06:26.764 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:26.764 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:26.764 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:26.765 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.765 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.765 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:26.765 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:26.765 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 81.071063210000005, 2024-04-18T21:06:26.765 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043581898000000001, 2024-04-18T21:06:26.765 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:26.765 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:26.765 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:26.765 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:26.765 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.765 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:26.765 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:26.765 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:26.765 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.766 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.766 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:26.766 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:26.766 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:26.766 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.766 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.766 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:26.766 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616641+0000", 2024-04-18T21:06:26.766 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:06:26.766 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.766 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.766 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:26.766 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616648+0000", 2024-04-18T21:06:26.766 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3860000000000001e-06 2024-04-18T21:06:26.767 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.767 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.767 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:26.767 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616666+0000", 2024-04-18T21:06:26.767 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7583000000000001e-05 2024-04-18T21:06:26.767 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.767 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.767 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:26.767 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616679+0000", 2024-04-18T21:06:26.767 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3322999999999999e-05 2024-04-18T21:06:26.767 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.767 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.767 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:26.767 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630373+0000", 2024-04-18T21:06:26.767 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013694207999999999 2024-04-18T21:06:26.767 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.768 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.768 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:26.768 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630545+0000", 2024-04-18T21:06:26.768 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000171683 2024-04-18T21:06:26.768 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.768 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.768 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:26.768 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630728+0000", 2024-04-18T21:06:26.768 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000182599 2024-04-18T21:06:26.768 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.768 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.768 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:26.768 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640600+0000", 2024-04-18T21:06:26.768 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0098726119999999994 2024-04-18T21:06:26.768 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.769 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.769 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:26.769 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659927+0000", 2024-04-18T21:06:26.769 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019326724999999999 2024-04-18T21:06:26.769 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.769 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.769 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:26.769 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660112+0000", 2024-04-18T21:06:26.769 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000185203 2024-04-18T21:06:26.769 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.769 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.769 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:26.769 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660222+0000", 2024-04-18T21:06:26.769 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109343 2024-04-18T21:06:26.769 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:26.770 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:26.770 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:26.770 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.770 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.770 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:26.770 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:26.770 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 81.070197852000007, 2024-04-18T21:06:26.770 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043121310000000003, 2024-04-18T21:06:26.770 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:26.770 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:26.770 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:26.770 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:26.770 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.770 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:26.771 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:26.771 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:26.771 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.771 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.771 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:26.771 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:26.771 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:26.771 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.771 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.771 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:26.771 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617506+0000", 2024-04-18T21:06:26.771 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9999999999999995e-07 2024-04-18T21:06:26.771 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.771 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.771 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:26.771 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617513+0000", 2024-04-18T21:06:26.772 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.9700000000000002e-06 2024-04-18T21:06:26.772 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.772 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.772 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:26.772 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617531+0000", 2024-04-18T21:06:26.772 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8105999999999999e-05 2024-04-18T21:06:26.772 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.772 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.772 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:26.772 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617545+0000", 2024-04-18T21:06:26.772 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3703000000000001e-05 2024-04-18T21:06:26.772 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.772 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.772 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:26.772 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632129+0000", 2024-04-18T21:06:26.773 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.014584135999999999 2024-04-18T21:06:26.773 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.773 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.773 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:26.773 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632361+0000", 2024-04-18T21:06:26.773 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023171800000000001 2024-04-18T21:06:26.773 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.773 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.773 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:26.773 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632804+0000", 2024-04-18T21:06:26.773 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000443549 2024-04-18T21:06:26.773 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.773 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.773 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:26.774 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646340+0000", 2024-04-18T21:06:26.774 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013535902000000001 2024-04-18T21:06:26.774 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.774 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.774 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:26.774 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660363+0000", 2024-04-18T21:06:26.774 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01402318 2024-04-18T21:06:26.774 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.774 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.774 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:26.774 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660523+0000", 2024-04-18T21:06:26.774 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00015989899999999999 2024-04-18T21:06:26.774 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.774 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.774 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:26.775 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660626+0000", 2024-04-18T21:06:26.775 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010314699999999999 2024-04-18T21:06:26.775 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:26.775 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:26.775 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:26.775 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.775 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.775 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:26.775 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:26.775 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 81.070058158999998, 2024-04-18T21:06:26.775 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024927483, 2024-04-18T21:06:26.775 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:26.775 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:26.775 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:26.775 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:26.776 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.776 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:26.776 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:26.776 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:26.776 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.776 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.776 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:26.776 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:26.776 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:26.776 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.776 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.776 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:26.776 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617646+0000", 2024-04-18T21:06:26.776 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3030000000000001e-06 2024-04-18T21:06:26.776 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.776 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.777 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:26.777 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617653+0000", 2024-04-18T21:06:26.777 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7530000000000004e-06 2024-04-18T21:06:26.777 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.777 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.777 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:26.777 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617673+0000", 2024-04-18T21:06:26.777 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9967e-05 2024-04-18T21:06:26.777 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.777 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.777 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:26.777 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617688+0000", 2024-04-18T21:06:26.777 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5153e-05 2024-04-18T21:06:26.777 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.778 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.778 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:26.778 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619244+0000", 2024-04-18T21:06:26.778 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001555531 2024-04-18T21:06:26.778 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.778 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.778 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:26.778 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619361+0000", 2024-04-18T21:06:26.778 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011784400000000001 2024-04-18T21:06:26.778 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.778 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.778 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:26.779 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619604+0000", 2024-04-18T21:06:26.779 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000243007 2024-04-18T21:06:26.779 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.779 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.779 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:26.779 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.625480+0000", 2024-04-18T21:06:26.779 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0058759349999999997 2024-04-18T21:06:26.779 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.779 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.779 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:26.779 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642342+0000", 2024-04-18T21:06:26.779 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016861373999999998 2024-04-18T21:06:26.779 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.779 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.779 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:26.779 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642484+0000", 2024-04-18T21:06:26.780 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000142423 2024-04-18T21:06:26.780 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.780 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.780 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:26.780 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642572+0000", 2024-04-18T21:06:26.780 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8193000000000001e-05 2024-04-18T21:06:26.780 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:26.780 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:26.780 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:26.780 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.780 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.780 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:26.780 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:26.781 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 81.069776656000002, 2024-04-18T21:06:26.781 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024956974999999999, 2024-04-18T21:06:26.781 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:26.781 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:26.781 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:26.781 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:26.781 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.781 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:26.781 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:26.781 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:26.781 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.781 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.781 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:26.782 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:26.782 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:26.782 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.782 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.782 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:26.782 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617928+0000", 2024-04-18T21:06:26.782 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5430000000000001e-06 2024-04-18T21:06:26.782 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.782 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.782 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:26.782 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617937+0000", 2024-04-18T21:06:26.782 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6629999999999999e-06 2024-04-18T21:06:26.782 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.783 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.783 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:26.783 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617955+0000", 2024-04-18T21:06:26.783 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8749999999999998e-05 2024-04-18T21:06:26.783 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.783 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.783 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:26.783 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617971+0000", 2024-04-18T21:06:26.783 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.605e-05 2024-04-18T21:06:26.783 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.783 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.783 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:26.784 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621019+0000", 2024-04-18T21:06:26.784 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0030472369999999999 2024-04-18T21:06:26.784 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.784 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.784 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:26.784 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621249+0000", 2024-04-18T21:06:26.784 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000230075 2024-04-18T21:06:26.784 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.784 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.784 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:26.784 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621450+0000", 2024-04-18T21:06:26.784 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020166499999999999 2024-04-18T21:06:26.784 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.784 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.785 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:26.785 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.626233+0000", 2024-04-18T21:06:26.785 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047827390000000003 2024-04-18T21:06:26.785 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.785 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.785 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:26.785 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642693+0000", 2024-04-18T21:06:26.785 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01645961 2024-04-18T21:06:26.785 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.785 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.785 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:26.785 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642798+0000", 2024-04-18T21:06:26.785 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010559499999999999 2024-04-18T21:06:26.785 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.786 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.786 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:26.786 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642883+0000", 2024-04-18T21:06:26.786 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5048000000000003e-05 2024-04-18T21:06:26.786 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:26.786 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:26.786 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:26.786 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.786 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.786 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:26.786 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:26.786 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 81.068081027999995, 2024-04-18T21:06:26.786 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024086478000000001, 2024-04-18T21:06:26.787 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:26.787 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:26.787 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:26.787 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:26.787 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.787 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:26.787 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:26.787 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:26.787 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.787 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.787 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:26.787 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:26.787 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:26.787 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.787 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.787 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:26.788 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619624+0000", 2024-04-18T21:06:26.788 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.75e-06 2024-04-18T21:06:26.788 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.788 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.788 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:26.788 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619637+0000", 2024-04-18T21:06:26.788 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3540000000000001e-05 2024-04-18T21:06:26.788 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.788 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.788 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:26.788 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619666+0000", 2024-04-18T21:06:26.788 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8685999999999999e-05 2024-04-18T21:06:26.788 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.788 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.789 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:26.789 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619685+0000", 2024-04-18T21:06:26.789 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8681999999999998e-05 2024-04-18T21:06:26.789 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.789 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.789 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:26.789 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622275+0000", 2024-04-18T21:06:26.789 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0025899260000000002 2024-04-18T21:06:26.789 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.789 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.789 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:26.789 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622572+0000", 2024-04-18T21:06:26.789 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00029722 2024-04-18T21:06:26.790 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.790 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.790 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:26.790 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622752+0000", 2024-04-18T21:06:26.790 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018065900000000001 2024-04-18T21:06:26.790 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.790 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.790 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:26.790 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.626326+0000", 2024-04-18T21:06:26.790 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035737310000000001 2024-04-18T21:06:26.790 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.790 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.790 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:26.791 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643565+0000", 2024-04-18T21:06:26.791 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017238430999999999 2024-04-18T21:06:26.791 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.791 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.791 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:26.791 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643646+0000", 2024-04-18T21:06:26.791 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.1481000000000001e-05 2024-04-18T21:06:26.791 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.791 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.791 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:26.791 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643708+0000", 2024-04-18T21:06:26.791 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.2372000000000005e-05 2024-04-18T21:06:26.791 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:26.792 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:26.792 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:26.792 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.792 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.792 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:26.792 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:26.792 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 81.067914875, 2024-04-18T21:06:26.792 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026822450000000001, 2024-04-18T21:06:26.792 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:26.792 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:26.792 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:26.792 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:26.792 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.792 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:26.793 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:26.793 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:26.793 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.793 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.793 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:26.793 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:26.793 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:26.793 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.793 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.793 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:26.793 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619789+0000", 2024-04-18T21:06:26.793 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:06:26.793 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.793 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.794 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:26.794 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619797+0000", 2024-04-18T21:06:26.794 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.6899999999999992e-06 2024-04-18T21:06:26.794 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.794 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.794 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:26.794 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619816+0000", 2024-04-18T21:06:26.794 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9352999999999999e-05 2024-04-18T21:06:26.794 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.794 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.794 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:26.794 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619832+0000", 2024-04-18T21:06:26.794 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6013000000000001e-05 2024-04-18T21:06:26.794 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.794 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.794 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:26.795 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620528+0000", 2024-04-18T21:06:26.795 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00069565600000000001 2024-04-18T21:06:26.795 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.795 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.795 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:26.795 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620735+0000", 2024-04-18T21:06:26.795 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000207025 2024-04-18T21:06:26.795 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.795 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.795 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:26.795 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620912+0000", 2024-04-18T21:06:26.795 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017748199999999999 2024-04-18T21:06:26.795 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.795 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.796 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:26.796 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.625605+0000", 2024-04-18T21:06:26.796 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0046924439999999996 2024-04-18T21:06:26.796 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.796 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.796 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:26.796 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646349+0000", 2024-04-18T21:06:26.796 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.020744318000000001 2024-04-18T21:06:26.796 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.796 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.796 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:26.796 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646483+0000", 2024-04-18T21:06:26.796 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013428999999999999 2024-04-18T21:06:26.796 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.796 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.796 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:26.797 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646611+0000", 2024-04-18T21:06:26.797 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012710299999999999 2024-04-18T21:06:26.797 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:26.797 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:26.797 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:26.797 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.797 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.797 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:26.797 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:06:26.797 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 81.067244442000003, 2024-04-18T21:06:26.797 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023516516000000001, 2024-04-18T21:06:26.797 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:26.797 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:26.797 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:06:26.797 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:26.798 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.798 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:26.798 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:06:26.798 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:26.798 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.798 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.798 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:26.798 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:06:26.798 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:26.798 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.798 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.798 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:26.798 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620460+0000", 2024-04-18T21:06:26.798 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.787e-06 2024-04-18T21:06:26.799 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.799 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.799 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:26.799 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620470+0000", 2024-04-18T21:06:26.799 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.2560000000000008e-06 2024-04-18T21:06:26.799 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.799 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.799 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:26.799 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620496+0000", 2024-04-18T21:06:26.799 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.6205999999999999e-05 2024-04-18T21:06:26.799 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.799 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.799 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:26.800 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620517+0000", 2024-04-18T21:06:26.800 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1223e-05 2024-04-18T21:06:26.800 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.800 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.800 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:26.800 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624060+0000", 2024-04-18T21:06:26.800 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035434160000000002 2024-04-18T21:06:26.800 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.800 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.800 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:26.800 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624390+0000", 2024-04-18T21:06:26.800 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00033000500000000002 2024-04-18T21:06:26.800 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:26.800 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:26.801 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:26.801 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643975+0000", 2024-04-18T21:06:26.801 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019584622999999999 2024-04-18T21:06:26.801 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:26.801 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:26.801 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:26.801 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:26.801 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:26.801 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:26.802 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:26.803 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:26.803+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:26.903 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:26.902+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:26.937 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:06:26.937 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [], 2024-04-18T21:06:26.938 INFO:teuthology.orchestra.run.smithi150.stdout: "num_ops": 0 2024-04-18T21:06:26.938 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:06:26.953 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:27.004 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:27.003+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:27.074 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:06:27.074 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [], 2024-04-18T21:06:27.074 INFO:teuthology.orchestra.run.smithi150.stdout: "complaint_time": 30, 2024-04-18T21:06:27.074 INFO:teuthology.orchestra.run.smithi150.stdout: "num_blocked_ops": 0 2024-04-18T21:06:27.075 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:06:27.088 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:27.105 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:27.106+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:27.206 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:27.207+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:27.254 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:06:27.255 INFO:teuthology.orchestra.run.smithi150.stdout: "size": 20, 2024-04-18T21:06:27.255 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 600, 2024-04-18T21:06:27.255 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [ 2024-04-18T21:06:27.255 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.255 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-18T21:06:27.255 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:06:27.255 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 92.450096119999998, 2024-04-18T21:06:27.255 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0093051590000000003, 2024-04-18T21:06:27.255 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:27.255 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:27.255 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:27.255 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:27.255 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.255 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:27.256 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:06:27.256 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:27.256 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.256 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.256 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:27.256 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:06:27.256 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:27.256 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.256 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.256 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:27.256 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804851+0000", 2024-04-18T21:06:27.256 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7039999999999999e-06 2024-04-18T21:06:27.256 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.257 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.257 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:27.257 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804864+0000", 2024-04-18T21:06:27.257 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.276e-05 2024-04-18T21:06:27.257 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.257 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.257 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:27.257 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804895+0000", 2024-04-18T21:06:27.257 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.1204999999999997e-05 2024-04-18T21:06:27.257 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.257 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.257 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:27.257 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804908+0000", 2024-04-18T21:06:27.257 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3317e-05 2024-04-18T21:06:27.257 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.257 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.258 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:27.258 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805131+0000", 2024-04-18T21:06:27.258 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00022246700000000001 2024-04-18T21:06:27.258 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.258 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.258 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:27.258 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805171+0000", 2024-04-18T21:06:27.258 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.0164999999999999e-05 2024-04-18T21:06:27.258 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.258 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.258 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:27.258 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814086+0000", 2024-04-18T21:06:27.258 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0089155329999999998 2024-04-18T21:06:27.258 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.259 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.259 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:27.259 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814154+0000", 2024-04-18T21:06:27.259 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.8008000000000003e-05 2024-04-18T21:06:27.259 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:27.259 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:27.259 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:27.259 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.259 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.259 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-18T21:06:27.259 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:06:27.259 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 92.449330927000005, 2024-04-18T21:06:27.259 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0086469770000000001, 2024-04-18T21:06:27.260 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:27.260 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:27.260 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:27.260 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:27.260 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.260 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:27.260 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:06:27.260 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:27.260 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.260 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.260 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:27.260 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:06:27.260 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:27.260 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.261 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.261 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:27.261 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805616+0000", 2024-04-18T21:06:27.261 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7799999999999999e-06 2024-04-18T21:06:27.261 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.261 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.261 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:27.261 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805707+0000", 2024-04-18T21:06:27.261 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0917999999999999e-05 2024-04-18T21:06:27.261 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.261 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.261 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:27.261 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805739+0000", 2024-04-18T21:06:27.262 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.2512000000000003e-05 2024-04-18T21:06:27.262 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.262 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.262 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:27.262 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805763+0000", 2024-04-18T21:06:27.262 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3266000000000001e-05 2024-04-18T21:06:27.262 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.262 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.262 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:27.262 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.806024+0000", 2024-04-18T21:06:27.262 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000261716 2024-04-18T21:06:27.262 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.263 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.263 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:27.263 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.806073+0000", 2024-04-18T21:06:27.263 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.8844999999999997e-05 2024-04-18T21:06:27.263 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.263 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.263 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:27.263 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814162+0000", 2024-04-18T21:06:27.263 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0080882860000000001 2024-04-18T21:06:27.263 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.263 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.263 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:27.263 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814261+0000", 2024-04-18T21:06:27.263 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.9654000000000005e-05 2024-04-18T21:06:27.263 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:27.263 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:27.264 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:27.264 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.264 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.264 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'64)", 2024-04-18T21:06:27.264 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:06:27.264 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 92.447559882999997, 2024-04-18T21:06:27.264 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0089721509999999994, 2024-04-18T21:06:27.264 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:27.264 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:27.264 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:27.264 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:27.264 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.264 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:27.264 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:06:27.265 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:27.265 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.265 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.265 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:27.265 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:06:27.265 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:27.265 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.265 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.265 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:27.265 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807387+0000", 2024-04-18T21:06:27.265 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.0329999999999998e-06 2024-04-18T21:06:27.265 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.265 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.265 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:27.265 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807443+0000", 2024-04-18T21:06:27.265 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.5376e-05 2024-04-18T21:06:27.266 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.266 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.266 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:27.266 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807467+0000", 2024-04-18T21:06:27.266 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.4621999999999999e-05 2024-04-18T21:06:27.266 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.266 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.266 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:27.266 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807482+0000", 2024-04-18T21:06:27.266 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.436e-05 2024-04-18T21:06:27.266 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.266 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.266 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:27.266 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.809243+0000", 2024-04-18T21:06:27.266 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001761725 2024-04-18T21:06:27.266 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.267 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.267 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:27.267 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.809295+0000", 2024-04-18T21:06:27.267 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.1445e-05 2024-04-18T21:06:27.267 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.267 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.267 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:27.267 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.816293+0000", 2024-04-18T21:06:27.267 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0069981749999999997 2024-04-18T21:06:27.267 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.267 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.267 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:27.267 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.816357+0000", 2024-04-18T21:06:27.267 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.4414999999999999e-05 2024-04-18T21:06:27.268 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:27.268 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:27.268 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:27.268 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.268 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.268 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:27.268 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:06:27.268 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 81.639650513000007, 2024-04-18T21:06:27.268 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.040843365, 2024-04-18T21:06:27.268 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:27.268 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:27.268 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:27.268 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:27.268 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.269 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:27.269 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:06:27.269 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:27.269 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.269 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.269 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:27.269 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:06:27.269 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:27.269 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.269 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.269 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:27.269 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615297+0000", 2024-04-18T21:06:27.269 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2800000000000002e-06 2024-04-18T21:06:27.269 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.269 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.270 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:27.270 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615308+0000", 2024-04-18T21:06:27.270 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0813e-05 2024-04-18T21:06:27.270 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.270 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.270 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:27.270 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615330+0000", 2024-04-18T21:06:27.270 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2370000000000001e-05 2024-04-18T21:06:27.270 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.270 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.270 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:27.270 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615346+0000", 2024-04-18T21:06:27.270 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6200000000000001e-05 2024-04-18T21:06:27.271 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.271 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.271 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:27.271 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615470+0000", 2024-04-18T21:06:27.271 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012385799999999999 2024-04-18T21:06:27.271 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.271 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.271 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:27.271 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615488+0000", 2024-04-18T21:06:27.271 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7923000000000001e-05 2024-04-18T21:06:27.271 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.271 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.271 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:27.271 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.630993+0000", 2024-04-18T21:06:27.271 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.01550532 2024-04-18T21:06:27.271 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.272 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.272 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:27.272 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631165+0000", 2024-04-18T21:06:27.272 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000171588 2024-04-18T21:06:27.272 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.272 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.272 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:27.272 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631320+0000", 2024-04-18T21:06:27.272 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000155162 2024-04-18T21:06:27.272 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.272 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.272 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:27.272 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635157+0000", 2024-04-18T21:06:27.272 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0038370790000000002 2024-04-18T21:06:27.272 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.272 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.273 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:27.273 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.655904+0000", 2024-04-18T21:06:27.273 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.020746483999999999 2024-04-18T21:06:27.273 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.273 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.273 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:27.273 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656032+0000", 2024-04-18T21:06:27.273 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012864199999999999 2024-04-18T21:06:27.273 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.273 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.273 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:27.273 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656138+0000", 2024-04-18T21:06:27.273 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000105646 2024-04-18T21:06:27.273 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:27.274 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:27.274 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:27.274 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.274 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.274 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:27.274 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:06:27.274 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 81.639558340999997, 2024-04-18T21:06:27.274 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.041266444999999999, 2024-04-18T21:06:27.274 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:27.274 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:27.274 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:27.274 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:27.274 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.275 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:27.275 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:06:27.275 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:27.275 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.275 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.275 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:27.275 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:06:27.275 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:27.275 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.275 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.275 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:27.275 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615388+0000", 2024-04-18T21:06:27.275 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:06:27.275 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.275 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.276 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:27.276 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:06:27.276 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.7299999999999994e-06 2024-04-18T21:06:27.276 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.276 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.276 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:27.276 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615415+0000", 2024-04-18T21:06:27.276 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7807000000000001e-05 2024-04-18T21:06:27.276 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.276 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.276 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:27.276 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615431+0000", 2024-04-18T21:06:27.276 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6127e-05 2024-04-18T21:06:27.276 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.276 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.276 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:27.277 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615621+0000", 2024-04-18T21:06:27.277 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000189781 2024-04-18T21:06:27.277 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.277 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.277 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:27.277 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615634+0000", 2024-04-18T21:06:27.277 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3383e-05 2024-04-18T21:06:27.277 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.277 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.277 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:27.277 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631703+0000", 2024-04-18T21:06:27.277 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016068737 2024-04-18T21:06:27.277 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.277 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.278 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:27.278 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631809+0000", 2024-04-18T21:06:27.278 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000106823 2024-04-18T21:06:27.278 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.278 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.278 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:27.278 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631988+0000", 2024-04-18T21:06:27.278 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000179008 2024-04-18T21:06:27.278 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.278 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.278 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:27.279 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635172+0000", 2024-04-18T21:06:27.279 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.003183029 2024-04-18T21:06:27.279 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.279 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.279 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:27.279 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656392+0000", 2024-04-18T21:06:27.279 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.021220638999999999 2024-04-18T21:06:27.279 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.279 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.279 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:27.279 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656533+0000", 2024-04-18T21:06:27.279 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014126500000000001 2024-04-18T21:06:27.279 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.280 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.280 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:27.280 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656653+0000", 2024-04-18T21:06:27.280 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000119883 2024-04-18T21:06:27.280 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:27.280 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:27.280 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:27.280 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.280 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.280 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:27.280 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:06:27.280 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 81.639470918000001, 2024-04-18T21:06:27.280 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.042492302000000003, 2024-04-18T21:06:27.281 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:27.281 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:27.281 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:27.281 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:27.281 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.281 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:27.281 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:06:27.281 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:27.281 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.281 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.281 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:27.281 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:06:27.281 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:27.281 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.282 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.282 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:27.282 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615475+0000", 2024-04-18T21:06:27.282 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.17e-06 2024-04-18T21:06:27.282 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.282 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.282 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:27.282 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615528+0000", 2024-04-18T21:06:27.282 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.2159e-05 2024-04-18T21:06:27.282 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.282 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.282 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:27.283 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615542+0000", 2024-04-18T21:06:27.283 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4197e-05 2024-04-18T21:06:27.283 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.283 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.283 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:27.283 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615559+0000", 2024-04-18T21:06:27.283 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.749e-05 2024-04-18T21:06:27.283 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.283 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.283 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:27.283 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615685+0000", 2024-04-18T21:06:27.283 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012617499999999999 2024-04-18T21:06:27.283 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.283 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.284 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:27.284 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:06:27.284 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4749999999999999e-05 2024-04-18T21:06:27.284 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.284 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.284 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:27.284 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632332+0000", 2024-04-18T21:06:27.284 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016631988 2024-04-18T21:06:27.284 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.284 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.284 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:27.284 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632477+0000", 2024-04-18T21:06:27.284 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014437200000000001 2024-04-18T21:06:27.285 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.285 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.285 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:27.285 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632620+0000", 2024-04-18T21:06:27.285 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000143566 2024-04-18T21:06:27.285 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.285 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.285 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:27.285 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635185+0000", 2024-04-18T21:06:27.285 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0025644209999999999 2024-04-18T21:06:27.285 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.285 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.285 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:27.285 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657803+0000", 2024-04-18T21:06:27.286 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.022618743 2024-04-18T21:06:27.286 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.286 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.286 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:27.286 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657890+0000", 2024-04-18T21:06:27.286 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.6688999999999996e-05 2024-04-18T21:06:27.286 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.286 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.286 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:27.286 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657967+0000", 2024-04-18T21:06:27.286 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.6582000000000006e-05 2024-04-18T21:06:27.286 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:27.286 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:27.286 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:27.287 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.287 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.287 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:27.287 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:06:27.287 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 81.639340106000006, 2024-04-18T21:06:27.287 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.043603435000000003, 2024-04-18T21:06:27.287 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:27.287 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:27.287 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:27.287 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:27.287 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.287 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:27.287 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:06:27.287 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:27.287 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.288 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.288 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:27.288 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:06:27.288 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:27.288 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.288 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.288 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:27.288 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615607+0000", 2024-04-18T21:06:27.288 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4300000000000001e-06 2024-04-18T21:06:27.288 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.288 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.288 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:27.288 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615614+0000", 2024-04-18T21:06:27.288 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.4100000000000002e-06 2024-04-18T21:06:27.289 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.289 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.289 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:27.289 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615632+0000", 2024-04-18T21:06:27.289 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7863000000000002e-05 2024-04-18T21:06:27.289 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.289 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.289 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:27.289 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615647+0000", 2024-04-18T21:06:27.289 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5187e-05 2024-04-18T21:06:27.289 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.289 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.289 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:27.289 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615765+0000", 2024-04-18T21:06:27.289 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000117955 2024-04-18T21:06:27.290 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.290 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.290 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:27.290 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615781+0000", 2024-04-18T21:06:27.290 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6123000000000001e-05 2024-04-18T21:06:27.290 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.290 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.290 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:27.290 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633055+0000", 2024-04-18T21:06:27.290 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.017273909 2024-04-18T21:06:27.290 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.290 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.290 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:27.290 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633254+0000", 2024-04-18T21:06:27.290 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00019903799999999999 2024-04-18T21:06:27.290 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.291 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.291 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:27.291 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633624+0000", 2024-04-18T21:06:27.291 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000369656 2024-04-18T21:06:27.291 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.291 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.291 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:27.291 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635595+0000", 2024-04-18T21:06:27.291 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001971287 2024-04-18T21:06:27.291 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.291 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.291 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:27.291 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659026+0000", 2024-04-18T21:06:27.291 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.023431495 2024-04-18T21:06:27.291 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.291 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.292 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:27.292 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659117+0000", 2024-04-18T21:06:27.292 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0885999999999997e-05 2024-04-18T21:06:27.292 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.292 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.292 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:27.292 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659209+0000", 2024-04-18T21:06:27.292 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.1195999999999999e-05 2024-04-18T21:06:27.292 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:27.292 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:27.292 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:27.292 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.292 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.292 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:27.292 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:27.292 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 81.639274877000005, 2024-04-18T21:06:27.293 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.03492514, 2024-04-18T21:06:27.293 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:27.293 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:27.293 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:27.293 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:27.293 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.293 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:27.293 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:27.293 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:27.293 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.293 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.293 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:27.293 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:27.293 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:27.293 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.294 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.294 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:27.294 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:06:27.294 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.407e-06 2024-04-18T21:06:27.294 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.294 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.294 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:27.294 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615679+0000", 2024-04-18T21:06:27.294 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.2130000000000002e-06 2024-04-18T21:06:27.294 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.294 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.294 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:27.294 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615701+0000", 2024-04-18T21:06:27.294 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2316000000000001e-05 2024-04-18T21:06:27.294 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.295 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.295 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:27.295 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615717+0000", 2024-04-18T21:06:27.295 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6197000000000001e-05 2024-04-18T21:06:27.295 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.295 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.295 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:27.295 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615828+0000", 2024-04-18T21:06:27.295 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000110899 2024-04-18T21:06:27.295 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.295 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.295 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:27.296 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615840+0000", 2024-04-18T21:06:27.296 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.1423000000000001e-05 2024-04-18T21:06:27.296 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.296 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.296 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:27.296 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628046+0000", 2024-04-18T21:06:27.296 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.012206295000000001 2024-04-18T21:06:27.296 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.296 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.296 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:27.296 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628323+0000", 2024-04-18T21:06:27.296 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00027658700000000001 2024-04-18T21:06:27.296 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.296 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.297 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:27.297 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628599+0000", 2024-04-18T21:06:27.297 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00027676699999999997 2024-04-18T21:06:27.297 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.297 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.297 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:27.297 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634869+0000", 2024-04-18T21:06:27.297 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.006269536 2024-04-18T21:06:27.297 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.297 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.297 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:27.297 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650333+0000", 2024-04-18T21:06:27.297 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.015463645999999999 2024-04-18T21:06:27.297 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.297 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.297 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:27.298 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650474+0000", 2024-04-18T21:06:27.298 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014091799999999999 2024-04-18T21:06:27.298 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.298 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.298 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:27.298 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650595+0000", 2024-04-18T21:06:27.298 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012193600000000001 2024-04-18T21:06:27.298 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:27.298 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:27.298 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:27.298 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.298 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.298 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:27.298 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:06:27.299 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 81.639189767999994, 2024-04-18T21:06:27.299 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.040588320999999997, 2024-04-18T21:06:27.299 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:27.299 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:27.299 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:27.299 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:27.299 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.299 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:27.299 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:06:27.299 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:27.299 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.299 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.299 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:27.299 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:06:27.299 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:27.300 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.300 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.300 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:27.300 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615757+0000", 2024-04-18T21:06:27.300 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2270000000000001e-06 2024-04-18T21:06:27.300 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.300 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.300 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:27.300 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615765+0000", 2024-04-18T21:06:27.300 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.9400000000000002e-06 2024-04-18T21:06:27.300 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.300 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.300 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:27.300 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615785+0000", 2024-04-18T21:06:27.300 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.0749000000000001e-05 2024-04-18T21:06:27.301 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.301 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.301 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:27.301 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615804+0000", 2024-04-18T21:06:27.301 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.8774e-05 2024-04-18T21:06:27.301 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.301 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.301 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:27.301 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615888+0000", 2024-04-18T21:06:27.301 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.4111999999999997e-05 2024-04-18T21:06:27.301 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.301 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.301 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:27.301 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615895+0000", 2024-04-18T21:06:27.301 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.0469999999999996e-06 2024-04-18T21:06:27.302 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.302 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.302 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:27.302 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629280+0000", 2024-04-18T21:06:27.302 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.013384416 2024-04-18T21:06:27.302 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.302 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.302 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:27.302 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629488+0000", 2024-04-18T21:06:27.302 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00020852800000000001 2024-04-18T21:06:27.302 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.302 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.303 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:27.303 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629869+0000", 2024-04-18T21:06:27.303 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00038042300000000001 2024-04-18T21:06:27.303 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.303 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.303 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:27.303 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635041+0000", 2024-04-18T21:06:27.303 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.005172383 2024-04-18T21:06:27.303 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.303 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.303 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:27.303 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656125+0000", 2024-04-18T21:06:27.303 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.021084025999999999 2024-04-18T21:06:27.304 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.304 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.304 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:27.304 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656240+0000", 2024-04-18T21:06:27.304 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000115352 2024-04-18T21:06:27.304 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.304 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.304 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:27.304 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656344+0000", 2024-04-18T21:06:27.304 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00010334400000000001 2024-04-18T21:06:27.304 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:27.304 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:27.304 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:27.304 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.304 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.305 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:27.305 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:27.305 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 81.639122447999995, 2024-04-18T21:06:27.305 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.043549577999999999, 2024-04-18T21:06:27.305 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:27.305 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:27.305 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:27.305 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:27.305 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.305 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:27.305 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:27.305 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:27.305 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.305 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.305 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:27.305 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:27.306 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:27.306 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.306 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.306 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:27.306 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:27.306 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.5000000000000002e-07 2024-04-18T21:06:27.306 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.306 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.306 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:27.306 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615828+0000", 2024-04-18T21:06:27.306 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.2359999999999998e-06 2024-04-18T21:06:27.306 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.306 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.307 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:27.307 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615838+0000", 2024-04-18T21:06:27.307 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0087e-05 2024-04-18T21:06:27.307 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.307 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.307 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:27.307 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615846+0000", 2024-04-18T21:06:27.307 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.67e-06 2024-04-18T21:06:27.307 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.307 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.307 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:27.307 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615963+0000", 2024-04-18T21:06:27.307 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00011630500000000001 2024-04-18T21:06:27.307 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.307 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.307 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:27.308 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615979+0000", 2024-04-18T21:06:27.308 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.613e-05 2024-04-18T21:06:27.308 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.308 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.308 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:27.308 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632392+0000", 2024-04-18T21:06:27.308 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016413317 2024-04-18T21:06:27.308 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.308 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.308 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:27.308 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632568+0000", 2024-04-18T21:06:27.308 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00017539500000000001 2024-04-18T21:06:27.308 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.308 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.308 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:27.309 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632748+0000", 2024-04-18T21:06:27.309 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00017991799999999999 2024-04-18T21:06:27.309 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.309 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.309 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:27.309 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635542+0000", 2024-04-18T21:06:27.309 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00279481 2024-04-18T21:06:27.309 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.309 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.309 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:27.309 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659232+0000", 2024-04-18T21:06:27.309 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.023689212000000001 2024-04-18T21:06:27.309 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.309 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.309 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:27.309 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659314+0000", 2024-04-18T21:06:27.310 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.2528999999999995e-05 2024-04-18T21:06:27.310 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.310 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.310 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:27.310 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659372+0000", 2024-04-18T21:06:27.310 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.8218999999999999e-05 2024-04-18T21:06:27.310 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:27.310 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:27.310 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:27.310 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.310 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.310 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:27.310 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:06:27.310 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 81.639061015999999, 2024-04-18T21:06:27.311 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.039335347, 2024-04-18T21:06:27.311 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:27.311 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:27.311 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "started", 2024-04-18T21:06:27.311 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:27.311 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.311 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:27.311 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:06:27.311 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:27.311 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.311 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.311 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:27.311 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:06:27.312 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:27.312 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.312 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.312 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:27.312 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615885+0000", 2024-04-18T21:06:27.312 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2699999999999999e-06 2024-04-18T21:06:27.312 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.312 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.312 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:27.312 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615892+0000", 2024-04-18T21:06:27.312 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.6499999999999999e-06 2024-04-18T21:06:27.312 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.312 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.313 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:27.313 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615906+0000", 2024-04-18T21:06:27.313 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.393e-05 2024-04-18T21:06:27.313 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.313 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.313 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:27.313 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615919+0000", 2024-04-18T21:06:27.313 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2860000000000001e-05 2024-04-18T21:06:27.313 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.313 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.313 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:27.313 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616027+0000", 2024-04-18T21:06:27.313 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000107852 2024-04-18T21:06:27.313 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.314 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.314 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:27.314 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616037+0000", 2024-04-18T21:06:27.314 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:06:27.314 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.314 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.314 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:27.314 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622719+0000", 2024-04-18T21:06:27.314 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0066817220000000002 2024-04-18T21:06:27.314 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.314 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.314 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:27.315 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623006+0000", 2024-04-18T21:06:27.315 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00028783699999999999 2024-04-18T21:06:27.315 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.315 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.315 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:27.315 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.655220+0000", 2024-04-18T21:06:27.315 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.032213036 2024-04-18T21:06:27.315 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:27.315 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:27.315 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:27.315 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.315 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.315 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:27.315 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:27.315 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 81.639005342999994, 2024-04-18T21:06:27.316 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.032845253999999997, 2024-04-18T21:06:27.316 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:27.316 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:27.316 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "started", 2024-04-18T21:06:27.316 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:27.316 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.316 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:27.316 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:27.316 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:27.316 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.316 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.316 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:27.316 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:27.316 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:27.316 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.317 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.317 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:27.317 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615942+0000", 2024-04-18T21:06:27.317 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.717e-06 2024-04-18T21:06:27.317 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.317 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.317 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:27.317 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615946+0000", 2024-04-18T21:06:27.317 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.6e-06 2024-04-18T21:06:27.317 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.317 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.317 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:27.317 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615960+0000", 2024-04-18T21:06:27.317 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:06:27.317 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.318 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.318 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:27.318 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615968+0000", 2024-04-18T21:06:27.318 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.9070000000000007e-06 2024-04-18T21:06:27.318 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.318 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.318 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:27.318 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616100+0000", 2024-04-18T21:06:27.318 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000132402 2024-04-18T21:06:27.318 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.318 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.318 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:27.318 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616117+0000", 2024-04-18T21:06:27.318 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6653000000000001e-05 2024-04-18T21:06:27.319 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.319 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.319 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:27.319 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621566+0000", 2024-04-18T21:06:27.319 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0054497740000000001 2024-04-18T21:06:27.319 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.319 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.319 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:27.319 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622801+0000", 2024-04-18T21:06:27.319 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0012345710000000001 2024-04-18T21:06:27.319 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.319 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.319 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:27.319 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648785+0000", 2024-04-18T21:06:27.320 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.025984104000000001 2024-04-18T21:06:27.320 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:27.320 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:27.320 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:27.320 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.320 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.320 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:27.320 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:06:27.320 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 81.633153992999993, 2024-04-18T21:06:27.320 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.011561350999999999, 2024-04-18T21:06:27.320 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:27.320 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:27.320 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:27.320 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:27.321 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.321 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:27.321 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:06:27.321 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:27.321 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.321 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.321 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:27.321 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:06:27.321 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:27.321 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.321 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.321 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:27.321 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621792+0000", 2024-04-18T21:06:27.321 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.4000000000000001e-07 2024-04-18T21:06:27.322 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.322 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.322 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:27.322 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:06:27.322 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.1050000000000002e-05 2024-04-18T21:06:27.322 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.322 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.322 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:27.322 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622608+0000", 2024-04-18T21:06:27.322 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00077505900000000003 2024-04-18T21:06:27.322 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.322 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.323 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:27.323 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623879+0000", 2024-04-18T21:06:27.323 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0012705839999999999 2024-04-18T21:06:27.323 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.323 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.323 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:27.323 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624010+0000", 2024-04-18T21:06:27.323 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00013176900000000001 2024-04-18T21:06:27.323 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.323 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.323 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:27.323 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624058+0000", 2024-04-18T21:06:27.323 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.7299000000000002e-05 2024-04-18T21:06:27.323 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.323 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.324 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:27.324 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633262+0000", 2024-04-18T21:06:27.324 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0092048770000000002 2024-04-18T21:06:27.324 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.324 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.324 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:27.324 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633353+0000", 2024-04-18T21:06:27.324 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0073000000000003e-05 2024-04-18T21:06:27.324 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:27.324 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:27.324 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:27.324 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.324 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.325 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:27.325 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:06:27.325 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 81.631026606999995, 2024-04-18T21:06:27.325 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0098419370000000003, 2024-04-18T21:06:27.325 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:27.325 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:27.325 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:27.325 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:27.325 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.325 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:27.325 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:06:27.325 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:27.325 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.325 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.325 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:27.325 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:06:27.326 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:27.326 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.326 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.326 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:27.326 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623920+0000", 2024-04-18T21:06:27.326 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2240000000000001e-06 2024-04-18T21:06:27.326 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.326 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.326 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:27.326 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623933+0000", 2024-04-18T21:06:27.326 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3653e-05 2024-04-18T21:06:27.326 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.326 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.326 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:27.327 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623956+0000", 2024-04-18T21:06:27.327 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2059e-05 2024-04-18T21:06:27.327 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.327 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.327 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:27.327 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623975+0000", 2024-04-18T21:06:27.327 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.9806999999999999e-05 2024-04-18T21:06:27.327 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.327 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.327 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:27.327 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626943+0000", 2024-04-18T21:06:27.327 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0029681579999999998 2024-04-18T21:06:27.327 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.328 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.328 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:27.328 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626993+0000", 2024-04-18T21:06:27.328 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.9935999999999998e-05 2024-04-18T21:06:27.328 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.328 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.328 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:27.328 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633665+0000", 2024-04-18T21:06:27.328 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0066719250000000004 2024-04-18T21:06:27.328 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.328 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.328 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:27.328 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633761+0000", 2024-04-18T21:06:27.329 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.5174999999999996e-05 2024-04-18T21:06:27.329 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:27.329 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:27.329 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:27.329 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.329 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.329 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:27.329 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:06:27.329 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 81.630194988, 2024-04-18T21:06:27.329 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0090159079999999996, 2024-04-18T21:06:27.329 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:27.329 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:27.329 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:27.329 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:27.330 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.330 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:27.330 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:06:27.330 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:27.330 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.330 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.330 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:27.330 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:06:27.330 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:27.330 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.330 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.330 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:27.330 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624751+0000", 2024-04-18T21:06:27.330 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.7600000000000006e-07 2024-04-18T21:06:27.330 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.331 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.331 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:27.331 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624787+0000", 2024-04-18T21:06:27.331 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.6273000000000003e-05 2024-04-18T21:06:27.331 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.331 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.331 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:27.331 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625837+0000", 2024-04-18T21:06:27.331 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00104992 2024-04-18T21:06:27.331 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.331 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.331 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:27.331 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625860+0000", 2024-04-18T21:06:27.331 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3110000000000001e-05 2024-04-18T21:06:27.331 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.331 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.332 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:27.332 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625984+0000", 2024-04-18T21:06:27.332 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012399199999999999 2024-04-18T21:06:27.332 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.332 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.332 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:27.332 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626030+0000", 2024-04-18T21:06:27.332 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.5429999999999997e-05 2024-04-18T21:06:27.332 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.332 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.332 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:27.332 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633643+0000", 2024-04-18T21:06:27.332 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0076129320000000002 2024-04-18T21:06:27.332 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.333 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.333 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:27.333 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633766+0000", 2024-04-18T21:06:27.333 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000123275 2024-04-18T21:06:27.333 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:27.333 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:27.333 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:27.333 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.333 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.333 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:27.333 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:06:27.333 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 81.628941264000005, 2024-04-18T21:06:27.333 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0088669170000000002, 2024-04-18T21:06:27.333 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:27.333 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:27.333 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:27.334 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:27.334 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.334 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:27.334 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:06:27.334 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:27.334 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.334 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.334 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:27.334 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:06:27.334 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:27.334 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.334 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.334 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:27.334 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626005+0000", 2024-04-18T21:06:27.335 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.5000000000000001e-07 2024-04-18T21:06:27.335 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.335 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.335 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:27.335 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626028+0000", 2024-04-18T21:06:27.335 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2756999999999999e-05 2024-04-18T21:06:27.335 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.335 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.335 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:27.335 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626050+0000", 2024-04-18T21:06:27.335 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2140000000000001e-05 2024-04-18T21:06:27.335 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.335 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.335 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:27.336 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626065+0000", 2024-04-18T21:06:27.336 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5176e-05 2024-04-18T21:06:27.336 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.336 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.336 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:27.336 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628334+0000", 2024-04-18T21:06:27.336 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0022691439999999998 2024-04-18T21:06:27.336 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.336 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.336 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:27.336 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628379+0000", 2024-04-18T21:06:27.336 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.5420000000000002e-05 2024-04-18T21:06:27.336 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.337 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.337 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:27.337 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634770+0000", 2024-04-18T21:06:27.337 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0063908410000000004 2024-04-18T21:06:27.337 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.337 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.337 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:27.337 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634871+0000", 2024-04-18T21:06:27.337 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000100589 2024-04-18T21:06:27.337 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:27.337 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:27.337 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:27.337 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.338 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.338 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:13 3.10 e17/15 3:0d89b25e:::603.00000000:head v 17'8, mlcod=0'0)", 2024-04-18T21:06:27.338 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:06:27.338 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 81.610107834999994, 2024-04-18T21:06:27.338 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0090974379999999994, 2024-04-18T21:06:27.338 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:27.338 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:27.338 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:27.338 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:27.338 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.338 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:27.338 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:06:27.338 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:27.339 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.339 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.339 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:27.339 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:06:27.339 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:27.339 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.339 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.339 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:27.339 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644838+0000", 2024-04-18T21:06:27.339 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.569999999999999e-07 2024-04-18T21:06:27.339 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.339 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.339 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:27.340 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644846+0000", 2024-04-18T21:06:27.340 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.4499999999999998e-06 2024-04-18T21:06:27.340 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.340 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.340 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:27.340 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644861+0000", 2024-04-18T21:06:27.340 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5243e-05 2024-04-18T21:06:27.340 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.340 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.340 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:27.340 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644997+0000", 2024-04-18T21:06:27.340 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000135609 2024-04-18T21:06:27.340 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.340 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.340 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:27.341 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649150+0000", 2024-04-18T21:06:27.341 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0041536760000000002 2024-04-18T21:06:27.341 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.341 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.341 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:27.341 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649207+0000", 2024-04-18T21:06:27.341 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.6677e-05 2024-04-18T21:06:27.341 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.341 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.341 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:27.341 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.653840+0000", 2024-04-18T21:06:27.341 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0046329700000000001 2024-04-18T21:06:27.341 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.341 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.341 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:27.342 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.653935+0000", 2024-04-18T21:06:27.342 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.4856000000000001e-05 2024-04-18T21:06:27.342 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:27.342 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:27.342 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:27.342 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.342 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.342 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 3 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:06:27.342 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:06:27.342 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 81.607318675000002, 2024-04-18T21:06:27.342 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0087842319999999995, 2024-04-18T21:06:27.342 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:27.342 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:27.343 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "reached pg", 2024-04-18T21:06:27.343 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:27.343 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.343 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:27.343 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:06:27.343 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:27.343 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.343 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.343 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:27.343 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:06:27.343 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:27.343 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.343 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.344 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:27.344 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:06:27.344 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.8299999999999996e-07 2024-04-18T21:06:27.344 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.344 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.344 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:27.344 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647642+0000", 2024-04-18T21:06:27.344 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4724e-05 2024-04-18T21:06:27.344 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.344 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.344 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:27.344 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647679+0000", 2024-04-18T21:06:27.344 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.6662999999999998e-05 2024-04-18T21:06:27.345 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.345 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.345 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:27.345 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647735+0000", 2024-04-18T21:06:27.345 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.6196000000000002e-05 2024-04-18T21:06:27.345 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.345 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.345 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:27.345 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649865+0000", 2024-04-18T21:06:27.345 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0021299489999999999 2024-04-18T21:06:27.345 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.345 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.345 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:27.345 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656411+0000", 2024-04-18T21:06:27.346 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0065460170000000003 2024-04-18T21:06:27.346 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:27.346 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:27.346 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:27.346 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.346 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.346 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:27.346 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:06:27.346 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 81.607173478999997, 2024-04-18T21:06:27.346 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0095703190000000007, 2024-04-18T21:06:27.346 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:27.346 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:27.347 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:27.347 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:27.347 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.347 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:27.347 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:06:27.347 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:27.347 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.347 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.347 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:27.347 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:06:27.347 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:27.347 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.347 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.347 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:27.347 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647773+0000", 2024-04-18T21:06:27.348 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.046e-06 2024-04-18T21:06:27.348 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.348 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.348 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:27.348 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647795+0000", 2024-04-18T21:06:27.348 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2616000000000002e-05 2024-04-18T21:06:27.348 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.348 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.348 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:27.348 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647818+0000", 2024-04-18T21:06:27.348 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3110000000000001e-05 2024-04-18T21:06:27.348 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.349 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.349 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:27.349 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647834+0000", 2024-04-18T21:06:27.349 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5163e-05 2024-04-18T21:06:27.349 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.349 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.349 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:27.349 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650682+0000", 2024-04-18T21:06:27.349 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0028479759999999999 2024-04-18T21:06:27.349 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.349 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.349 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:27.349 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650730+0000", 2024-04-18T21:06:27.349 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.8375999999999999e-05 2024-04-18T21:06:27.350 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.350 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.350 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:27.350 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656751+0000", 2024-04-18T21:06:27.350 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0060211880000000002 2024-04-18T21:06:27.350 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.350 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.350 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:27.350 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657342+0000", 2024-04-18T21:06:27.350 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00059084399999999998 2024-04-18T21:06:27.350 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:27.350 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:27.350 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:27.350 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.351 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.351 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:27.351 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:06:27.351 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 81.606761192999997, 2024-04-18T21:06:27.351 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0092471759999999993, 2024-04-18T21:06:27.351 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:27.351 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:27.351 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:27.351 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:27.351 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.351 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:27.351 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:06:27.351 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:27.351 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.352 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.352 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:27.352 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:06:27.352 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:27.352 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.352 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.352 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:27.352 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648185+0000", 2024-04-18T21:06:27.352 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.5000000000000001e-07 2024-04-18T21:06:27.352 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.352 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.352 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:27.352 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648203+0000", 2024-04-18T21:06:27.352 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.8102999999999999e-05 2024-04-18T21:06:27.352 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.353 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.353 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:27.353 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648226+0000", 2024-04-18T21:06:27.353 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2921999999999998e-05 2024-04-18T21:06:27.353 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.353 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.353 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:27.353 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648241+0000", 2024-04-18T21:06:27.353 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5336999999999999e-05 2024-04-18T21:06:27.353 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.353 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.353 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:27.353 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.651268+0000", 2024-04-18T21:06:27.353 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0030271640000000002 2024-04-18T21:06:27.353 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.354 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.354 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:27.354 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.651319+0000", 2024-04-18T21:06:27.354 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.0843000000000001e-05 2024-04-18T21:06:27.354 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.354 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.354 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:27.354 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657347+0000", 2024-04-18T21:06:27.354 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0060279770000000003 2024-04-18T21:06:27.354 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:27.354 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:27.354 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:27.354 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657431+0000", 2024-04-18T21:06:27.355 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.3980000000000006e-05 2024-04-18T21:06:27.355 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:27.355 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:27.355 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:27.355 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:27.355 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:27.355 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:06:27.356 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:27.357 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:27.355+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:27.458 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:27.458+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:27.489 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:27.489 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:06:27.489 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-04-18T21:06:27.489 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:27.503 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:27.559 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:27.559+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:27.659 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-18T21:06:27.660 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:27.663+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:27.669 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:27.669 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:06:27.669 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-18T21:06:27.669 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-18T21:06:27.669 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:27.683 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:27.761 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:27.763+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:27.803 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:27.803 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-18T21:06:27.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-18T21:06:27.803 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:06:27.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.804 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:27.804 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:06:27.804 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 82.187721682000003, 2024-04-18T21:06:27.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.034065303999999998, 2024-04-18T21:06:27.804 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:27.804 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:27.804 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:27.804 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:27.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.804 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:27.804 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:06:27.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:27.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.804 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:27.805 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:06:27.805 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:27.805 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.805 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.805 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:27.805 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615254+0000", 2024-04-18T21:06:27.805 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7829999999999999e-06 2024-04-18T21:06:27.805 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.805 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.805 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:27.805 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615267+0000", 2024-04-18T21:06:27.805 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3334e-05 2024-04-18T21:06:27.805 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.805 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.805 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:27.805 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615294+0000", 2024-04-18T21:06:27.806 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7271999999999999e-05 2024-04-18T21:06:27.806 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.806 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.806 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:27.806 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615321+0000", 2024-04-18T21:06:27.806 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.637e-05 2024-04-18T21:06:27.806 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.806 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.806 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:27.806 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615479+0000", 2024-04-18T21:06:27.806 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000158493 2024-04-18T21:06:27.806 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.807 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.807 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:27.807 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615498+0000", 2024-04-18T21:06:27.807 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9148999999999999e-05 2024-04-18T21:06:27.807 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.807 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.807 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:27.807 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632915+0000", 2024-04-18T21:06:27.807 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.017416551999999998 2024-04-18T21:06:27.807 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.807 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.807 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:27.807 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633302+0000", 2024-04-18T21:06:27.807 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00038725000000000001 2024-04-18T21:06:27.808 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.808 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:27.808 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633638+0000", 2024-04-18T21:06:27.808 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000335946 2024-04-18T21:06:27.808 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.808 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:27.808 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645976+0000", 2024-04-18T21:06:27.808 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012337617 2024-04-18T21:06:27.808 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.808 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:27.808 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649080+0000", 2024-04-18T21:06:27.809 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031038929999999999 2024-04-18T21:06:27.809 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.809 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:27.809 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649207+0000", 2024-04-18T21:06:27.809 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000127537 2024-04-18T21:06:27.809 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.809 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:27.809 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649316+0000", 2024-04-18T21:06:27.809 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109108 2024-04-18T21:06:27.809 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:27.809 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:27.809 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:27.810 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.810 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.810 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:27.810 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:06:27.810 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 82.187588305000006, 2024-04-18T21:06:27.810 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036275764000000002, 2024-04-18T21:06:27.810 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:27.810 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:27.810 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:27.810 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:27.810 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.810 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:27.810 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:06:27.810 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:27.811 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.811 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.811 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:27.811 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:06:27.811 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:27.811 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.811 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.811 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:27.811 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615386+0000", 2024-04-18T21:06:27.811 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.573e-06 2024-04-18T21:06:27.811 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.811 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.811 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:27.811 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:06:27.811 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0723999999999999e-05 2024-04-18T21:06:27.812 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.812 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.812 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:27.812 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615418+0000", 2024-04-18T21:06:27.812 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0902000000000001e-05 2024-04-18T21:06:27.812 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.812 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.812 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:27.812 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615433+0000", 2024-04-18T21:06:27.812 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5319999999999999e-05 2024-04-18T21:06:27.812 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.812 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.812 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:27.812 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615659+0000", 2024-04-18T21:06:27.812 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000226095 2024-04-18T21:06:27.813 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.813 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.813 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:27.813 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:27.813 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1276e-05 2024-04-18T21:06:27.813 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.813 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.813 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:27.813 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643654+0000", 2024-04-18T21:06:27.813 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027983238000000001 2024-04-18T21:06:27.813 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.813 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.813 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:27.813 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643868+0000", 2024-04-18T21:06:27.814 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000214305 2024-04-18T21:06:27.814 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.814 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.814 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:27.814 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:06:27.814 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035892200000000002 2024-04-18T21:06:27.814 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.814 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.814 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:27.814 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646056+0000", 2024-04-18T21:06:27.814 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001829172 2024-04-18T21:06:27.814 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.814 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.815 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:27.815 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651406+0000", 2024-04-18T21:06:27.815 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0053504800000000003 2024-04-18T21:06:27.815 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.815 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.815 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:27.815 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651551+0000", 2024-04-18T21:06:27.815 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014427999999999999 2024-04-18T21:06:27.815 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.815 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.815 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:27.815 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651660+0000", 2024-04-18T21:06:27.815 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109477 2024-04-18T21:06:27.815 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:27.816 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:27.816 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:27.816 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.816 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.816 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:27.816 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:27.816 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 82.187514922999995, 2024-04-18T21:06:27.816 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045668994999999997, 2024-04-18T21:06:27.816 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:27.816 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:27.816 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:27.816 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:27.816 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.816 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:27.816 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:27.817 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:27.817 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.817 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.817 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:27.817 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:27.817 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:27.817 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.817 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.817 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:27.817 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615459+0000", 2024-04-18T21:06:27.817 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5030000000000001e-06 2024-04-18T21:06:27.817 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.817 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.817 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:27.817 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615506+0000", 2024-04-18T21:06:27.817 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6872000000000001e-05 2024-04-18T21:06:27.818 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.818 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.818 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:27.818 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615527+0000", 2024-04-18T21:06:27.818 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0763000000000001e-05 2024-04-18T21:06:27.818 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.818 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.818 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:27.818 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615551+0000", 2024-04-18T21:06:27.818 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4159e-05 2024-04-18T21:06:27.818 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.818 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.818 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:27.819 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615736+0000", 2024-04-18T21:06:27.819 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018499599999999999 2024-04-18T21:06:27.819 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.819 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.819 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:27.819 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615748+0000", 2024-04-18T21:06:27.819 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2272999999999999e-05 2024-04-18T21:06:27.819 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.819 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.819 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:27.819 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635481+0000", 2024-04-18T21:06:27.819 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019732772999999999 2024-04-18T21:06:27.819 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.819 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.820 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:27.820 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635791+0000", 2024-04-18T21:06:27.820 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031013299999999998 2024-04-18T21:06:27.820 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.820 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.820 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:27.820 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636101+0000", 2024-04-18T21:06:27.820 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030943300000000002 2024-04-18T21:06:27.820 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.820 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.820 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:27.820 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646043+0000", 2024-04-18T21:06:27.820 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099428139999999995 2024-04-18T21:06:27.820 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.820 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.821 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:27.821 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660991+0000", 2024-04-18T21:06:27.821 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014947142 2024-04-18T21:06:27.821 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.821 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.821 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:27.821 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661061+0000", 2024-04-18T21:06:27.821 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0438000000000006e-05 2024-04-18T21:06:27.821 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.821 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.821 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:27.821 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661127+0000", 2024-04-18T21:06:27.821 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5696000000000003e-05 2024-04-18T21:06:27.821 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:27.821 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:27.821 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:27.821 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.822 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.822 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:27.822 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:27.822 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 82.187302494999997, 2024-04-18T21:06:27.822 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045745085999999997, 2024-04-18T21:06:27.822 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:27.822 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:27.822 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:27.822 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:27.822 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.822 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:27.822 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:27.822 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:27.822 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.822 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.823 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:27.823 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:27.823 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:27.823 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.823 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.823 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:27.823 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:06:27.823 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7400000000000001e-06 2024-04-18T21:06:27.823 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.823 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.823 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:27.823 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:06:27.823 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8133e-05 2024-04-18T21:06:27.823 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.824 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.824 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:27.824 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615726+0000", 2024-04-18T21:06:27.824 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6132e-05 2024-04-18T21:06:27.824 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.824 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.824 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:27.824 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615742+0000", 2024-04-18T21:06:27.824 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6157000000000001e-05 2024-04-18T21:06:27.824 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.824 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.824 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:27.825 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615937+0000", 2024-04-18T21:06:27.825 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000194768 2024-04-18T21:06:27.825 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.825 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.825 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:27.825 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615950+0000", 2024-04-18T21:06:27.825 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3084e-05 2024-04-18T21:06:27.825 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.825 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.825 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:27.825 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643676+0000", 2024-04-18T21:06:27.825 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027725639999999999 2024-04-18T21:06:27.825 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.825 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.825 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:27.825 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643867+0000", 2024-04-18T21:06:27.825 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019075900000000001 2024-04-18T21:06:27.826 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.826 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.826 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:27.826 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:06:27.826 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036013799999999997 2024-04-18T21:06:27.826 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.826 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.826 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:27.826 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646068+0000", 2024-04-18T21:06:27.826 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001841536 2024-04-18T21:06:27.826 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.826 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.826 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:27.826 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661184+0000", 2024-04-18T21:06:27.826 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015115458999999999 2024-04-18T21:06:27.827 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.827 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.827 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:27.827 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661283+0000", 2024-04-18T21:06:27.827 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9502999999999999e-05 2024-04-18T21:06:27.827 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.827 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.827 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:27.827 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661415+0000", 2024-04-18T21:06:27.827 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000132037 2024-04-18T21:06:27.827 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:27.827 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:27.827 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:27.827 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.827 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.827 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:27.828 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:06:27.828 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 82.187180807999994, 2024-04-18T21:06:27.828 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036185947000000003, 2024-04-18T21:06:27.828 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:27.828 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:27.828 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:27.828 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:27.828 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.828 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:27.828 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:06:27.828 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:27.828 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.829 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.829 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:27.829 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:06:27.829 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:27.829 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.829 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.829 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:27.829 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615794+0000", 2024-04-18T21:06:27.829 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6440000000000001e-06 2024-04-18T21:06:27.829 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.829 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.829 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:27.829 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615803+0000", 2024-04-18T21:06:27.829 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1220000000000001e-06 2024-04-18T21:06:27.830 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.830 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.830 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:27.830 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615827+0000", 2024-04-18T21:06:27.830 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3997000000000001e-05 2024-04-18T21:06:27.830 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.830 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.830 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:27.830 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615899+0000", 2024-04-18T21:06:27.830 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2741e-05 2024-04-18T21:06:27.830 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.830 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.830 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:27.830 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616019+0000", 2024-04-18T21:06:27.831 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119874 2024-04-18T21:06:27.831 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.831 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.831 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:27.831 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616029+0000", 2024-04-18T21:06:27.831 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:06:27.831 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.831 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.831 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:27.831 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644823+0000", 2024-04-18T21:06:27.831 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.028793151999999999 2024-04-18T21:06:27.831 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.832 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.832 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:27.832 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645106+0000", 2024-04-18T21:06:27.832 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028379700000000002 2024-04-18T21:06:27.832 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.832 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.832 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:27.832 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645294+0000", 2024-04-18T21:06:27.832 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000187181 2024-04-18T21:06:27.832 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.832 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.832 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:27.833 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646763+0000", 2024-04-18T21:06:27.833 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0014691050000000001 2024-04-18T21:06:27.833 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.833 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.833 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:27.833 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651784+0000", 2024-04-18T21:06:27.833 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050211650000000002 2024-04-18T21:06:27.833 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.833 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.833 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:27.833 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651876+0000", 2024-04-18T21:06:27.833 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2503999999999994e-05 2024-04-18T21:06:27.833 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.833 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.833 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:27.834 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651978+0000", 2024-04-18T21:06:27.834 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000101475 2024-04-18T21:06:27.834 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:27.834 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:27.834 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:27.834 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.834 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.834 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:27.834 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:27.834 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 82.187032200999994, 2024-04-18T21:06:27.834 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032262322000000003, 2024-04-18T21:06:27.834 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:27.835 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:27.835 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:27.835 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:27.835 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.835 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:27.835 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:27.835 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:27.835 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.835 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.835 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:27.835 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:27.835 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:27.835 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.835 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.836 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:27.836 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615943+0000", 2024-04-18T21:06:27.836 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1959999999999998e-06 2024-04-18T21:06:27.836 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.836 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.836 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:27.836 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615956+0000", 2024-04-18T21:06:27.836 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3424000000000001e-05 2024-04-18T21:06:27.836 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.836 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.836 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:27.836 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615983+0000", 2024-04-18T21:06:27.836 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7072000000000001e-05 2024-04-18T21:06:27.836 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.837 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.837 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:27.837 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616006+0000", 2024-04-18T21:06:27.837 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2823000000000002e-05 2024-04-18T21:06:27.837 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.837 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.837 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:27.837 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616156+0000", 2024-04-18T21:06:27.837 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014962299999999999 2024-04-18T21:06:27.837 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.837 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.837 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:27.837 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616174+0000", 2024-04-18T21:06:27.837 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8082999999999999e-05 2024-04-18T21:06:27.837 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.837 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.838 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:27.838 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.629952+0000", 2024-04-18T21:06:27.838 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013778514 2024-04-18T21:06:27.838 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.838 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.838 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:27.838 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630201+0000", 2024-04-18T21:06:27.838 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024918100000000001 2024-04-18T21:06:27.838 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.838 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.838 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:27.838 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630386+0000", 2024-04-18T21:06:27.838 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018436900000000001 2024-04-18T21:06:27.838 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.838 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.839 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:27.839 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643169+0000", 2024-04-18T21:06:27.839 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012782774 2024-04-18T21:06:27.839 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.839 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.839 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:27.839 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.647924+0000", 2024-04-18T21:06:27.839 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004755787 2024-04-18T21:06:27.839 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.839 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.839 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:27.839 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648069+0000", 2024-04-18T21:06:27.839 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014459600000000001 2024-04-18T21:06:27.839 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.840 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.840 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:27.840 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648203+0000", 2024-04-18T21:06:27.840 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013388000000000001 2024-04-18T21:06:27.840 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:27.840 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:27.840 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:27.840 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.840 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.840 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:27.840 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:06:27.840 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 82.186923937000003, 2024-04-18T21:06:27.840 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032489736999999998, 2024-04-18T21:06:27.840 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:27.841 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:27.841 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:27.841 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:27.841 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.841 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:27.841 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:06:27.841 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:27.841 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.841 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.841 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:27.841 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:06:27.841 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:27.841 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.842 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.842 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:27.842 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616050+0000", 2024-04-18T21:06:27.842 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.606e-06 2024-04-18T21:06:27.842 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.842 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.842 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:27.842 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616061+0000", 2024-04-18T21:06:27.842 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0463e-05 2024-04-18T21:06:27.842 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.842 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.842 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:27.842 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616092+0000", 2024-04-18T21:06:27.842 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1415999999999999e-05 2024-04-18T21:06:27.843 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.843 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.843 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:27.843 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616109+0000", 2024-04-18T21:06:27.843 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6557000000000001e-05 2024-04-18T21:06:27.843 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.843 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.843 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:27.843 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616358+0000", 2024-04-18T21:06:27.843 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000249077 2024-04-18T21:06:27.843 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.843 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.843 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:27.843 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616370+0000", 2024-04-18T21:06:27.844 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2037e-05 2024-04-18T21:06:27.844 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.844 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.844 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:27.844 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.634920+0000", 2024-04-18T21:06:27.844 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018550397 2024-04-18T21:06:27.844 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.844 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.844 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:27.844 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640420+0000", 2024-04-18T21:06:27.844 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055000539999999999 2024-04-18T21:06:27.844 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.844 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.845 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:27.845 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648538+0000", 2024-04-18T21:06:27.845 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0081181299999999994 2024-04-18T21:06:27.845 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:27.845 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:27.845 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:27.845 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.845 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.845 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:27.845 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:06:27.845 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 82.186839616, 2024-04-18T21:06:27.845 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036090029000000003, 2024-04-18T21:06:27.845 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:27.845 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:27.846 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:27.846 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:27.846 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.846 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:27.846 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:06:27.846 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:27.846 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.846 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.846 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:27.846 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:06:27.846 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:27.846 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.847 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.847 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:27.847 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616134+0000", 2024-04-18T21:06:27.847 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.353e-06 2024-04-18T21:06:27.847 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.847 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.847 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:27.847 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616141+0000", 2024-04-18T21:06:27.847 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2770000000000002e-06 2024-04-18T21:06:27.847 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.847 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.847 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:27.847 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616160+0000", 2024-04-18T21:06:27.847 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.91e-05 2024-04-18T21:06:27.847 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.847 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.848 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:27.848 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616170+0000", 2024-04-18T21:06:27.848 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7699999999999996e-06 2024-04-18T21:06:27.848 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.848 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.848 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:27.848 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616275+0000", 2024-04-18T21:06:27.848 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105313 2024-04-18T21:06:27.848 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.848 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.848 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:27.848 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616288+0000", 2024-04-18T21:06:27.848 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3027000000000001e-05 2024-04-18T21:06:27.848 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.848 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.849 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:27.849 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646160+0000", 2024-04-18T21:06:27.849 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.029872019 2024-04-18T21:06:27.849 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.849 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.849 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:27.849 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646368+0000", 2024-04-18T21:06:27.849 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020811899999999999 2024-04-18T21:06:27.849 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.850 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.850 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:27.850 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652223+0000", 2024-04-18T21:06:27.850 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.005855051 2024-04-18T21:06:27.850 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:27.850 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:27.850 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:27.850 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.850 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.850 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:27.850 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:27.850 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 82.186782046999994, 2024-04-18T21:06:27.851 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043572403000000003, 2024-04-18T21:06:27.851 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:27.851 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:27.851 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:27.851 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:27.851 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.851 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:27.851 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:27.851 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:27.851 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.851 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.851 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:27.852 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:27.852 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:27.852 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.852 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.852 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:27.852 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616192+0000", 2024-04-18T21:06:27.852 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:06:27.852 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.852 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.852 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:27.852 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616203+0000", 2024-04-18T21:06:27.852 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0890000000000001e-05 2024-04-18T21:06:27.852 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.853 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.853 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:27.853 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616223+0000", 2024-04-18T21:06:27.853 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0409000000000001e-05 2024-04-18T21:06:27.853 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.853 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.853 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:27.853 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616238+0000", 2024-04-18T21:06:27.853 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5160000000000001e-05 2024-04-18T21:06:27.853 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.853 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.853 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:27.853 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616343+0000", 2024-04-18T21:06:27.854 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000104831 2024-04-18T21:06:27.854 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.854 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.854 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:27.854 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616357+0000", 2024-04-18T21:06:27.854 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3686000000000001e-05 2024-04-18T21:06:27.854 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.854 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.854 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:27.854 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635912+0000", 2024-04-18T21:06:27.854 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019554944000000001 2024-04-18T21:06:27.854 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.854 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.855 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:27.855 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636231+0000", 2024-04-18T21:06:27.855 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000318766 2024-04-18T21:06:27.855 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.855 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.855 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:27.855 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659763+0000", 2024-04-18T21:06:27.855 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023532474000000001 2024-04-18T21:06:27.855 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:27.855 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:27.855 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:27.855 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.855 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.856 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:27.856 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:06:27.856 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 82.182853339999994, 2024-04-18T21:06:27.856 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015007971, 2024-04-18T21:06:27.856 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:27.856 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:27.856 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:27.856 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:27.856 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.856 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:27.856 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:06:27.856 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:27.856 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.857 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.857 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:27.857 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:06:27.857 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:27.857 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.857 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.857 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:27.857 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620120+0000", 2024-04-18T21:06:27.857 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0359999999999999e-06 2024-04-18T21:06:27.857 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.857 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.857 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:27.857 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620157+0000", 2024-04-18T21:06:27.857 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6636e-05 2024-04-18T21:06:27.858 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.858 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.858 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:27.858 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620177+0000", 2024-04-18T21:06:27.858 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0247000000000001e-05 2024-04-18T21:06:27.858 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.858 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.858 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:27.858 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620195+0000", 2024-04-18T21:06:27.858 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7819e-05 2024-04-18T21:06:27.858 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.858 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:27.859 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620342+0000", 2024-04-18T21:06:27.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014643300000000001 2024-04-18T21:06:27.859 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:27.859 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620405+0000", 2024-04-18T21:06:27.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3522000000000006e-05 2024-04-18T21:06:27.859 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:27.859 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635016+0000", 2024-04-18T21:06:27.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014610840999999999 2024-04-18T21:06:27.859 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:27.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635127+0000", 2024-04-18T21:06:27.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111437 2024-04-18T21:06:27.860 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:27.860 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:27.860 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:27.860 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.860 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.860 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:27.860 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:06:27.860 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 82.182746072, 2024-04-18T21:06:27.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012693296, 2024-04-18T21:06:27.860 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:27.860 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:27.861 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:27.861 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:27.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.861 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:27.861 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:06:27.861 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:27.861 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.861 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:27.861 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:06:27.861 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:27.861 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.862 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:27.862 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620228+0000", 2024-04-18T21:06:27.862 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:06:27.862 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.862 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.862 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:27.862 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620236+0000", 2024-04-18T21:06:27.862 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.303e-06 2024-04-18T21:06:27.862 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.862 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.862 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:27.862 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620255+0000", 2024-04-18T21:06:27.863 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9406e-05 2024-04-18T21:06:27.863 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.863 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.863 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:27.863 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620274+0000", 2024-04-18T21:06:27.863 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8940000000000002e-05 2024-04-18T21:06:27.863 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.863 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.863 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:27.863 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:06:27.863 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001558753 2024-04-18T21:06:27.863 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.863 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.863 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:27.864 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621879+0000", 2024-04-18T21:06:27.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6359000000000001e-05 2024-04-18T21:06:27.864 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.864 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.864 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:27.864 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632841+0000", 2024-04-18T21:06:27.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010961907 2024-04-18T21:06:27.864 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.864 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.864 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:27.864 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632920+0000", 2024-04-18T21:06:27.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8714999999999994e-05 2024-04-18T21:06:27.864 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:27.864 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:27.864 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:27.864 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.865 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.865 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:27.865 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:06:27.865 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 82.181200309000005, 2024-04-18T21:06:27.865 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013445702, 2024-04-18T21:06:27.865 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:27.865 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:27.865 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:27.865 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:27.865 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.865 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:27.865 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:06:27.865 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:27.865 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.866 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.866 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:27.866 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:06:27.866 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:27.866 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.866 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.866 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:27.866 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621774+0000", 2024-04-18T21:06:27.866 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2500000000000001e-06 2024-04-18T21:06:27.866 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.866 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.866 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:27.866 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621786+0000", 2024-04-18T21:06:27.866 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2636000000000001e-05 2024-04-18T21:06:27.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:27.867 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621814+0000", 2024-04-18T21:06:27.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7823000000000001e-05 2024-04-18T21:06:27.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:27.867 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621844+0000", 2024-04-18T21:06:27.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9589000000000001e-05 2024-04-18T21:06:27.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:27.867 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622253+0000", 2024-04-18T21:06:27.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040963700000000002 2024-04-18T21:06:27.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.868 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.868 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:27.868 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622304+0000", 2024-04-18T21:06:27.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0868999999999997e-05 2024-04-18T21:06:27.868 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.868 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.868 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:27.868 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635133+0000", 2024-04-18T21:06:27.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012829136 2024-04-18T21:06:27.868 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.869 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.869 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:27.869 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635218+0000", 2024-04-18T21:06:27.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4761999999999999e-05 2024-04-18T21:06:27.869 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:27.869 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:27.869 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:27.869 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.869 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.869 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:27.869 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:06:27.869 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 82.181073549000004, 2024-04-18T21:06:27.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014162065, 2024-04-18T21:06:27.870 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:27.870 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:27.870 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:27.870 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:27.870 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.870 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:27.870 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:06:27.870 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:27.870 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.870 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.870 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:27.870 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:06:27.870 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:27.871 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.871 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.871 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:27.871 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621900+0000", 2024-04-18T21:06:27.871 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:06:27.871 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.871 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.871 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:27.871 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621910+0000", 2024-04-18T21:06:27.871 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0207000000000001e-05 2024-04-18T21:06:27.871 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.871 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.871 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:27.872 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621932+0000", 2024-04-18T21:06:27.872 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1789000000000001e-05 2024-04-18T21:06:27.872 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.872 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.872 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:27.872 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621946+0000", 2024-04-18T21:06:27.872 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4212999999999999e-05 2024-04-18T21:06:27.872 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.872 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.872 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:27.872 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624477+0000", 2024-04-18T21:06:27.872 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025303470000000001 2024-04-18T21:06:27.872 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.873 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.873 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:27.873 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624525+0000", 2024-04-18T21:06:27.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8084999999999998e-05 2024-04-18T21:06:27.873 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.873 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.873 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:27.873 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635976+0000", 2024-04-18T21:06:27.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.011451368999999999 2024-04-18T21:06:27.873 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.873 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.873 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:27.873 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636061+0000", 2024-04-18T21:06:27.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5094999999999998e-05 2024-04-18T21:06:27.874 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:27.874 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:27.874 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:27.874 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.874 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.874 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:06:27.874 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:06:27.874 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 82.171837924000002, 2024-04-18T21:06:27.874 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0098014739999999993, 2024-04-18T21:06:27.874 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:27.874 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:27.874 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:06:27.874 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:27.875 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.875 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:27.875 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:06:27.875 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:27.875 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.875 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.875 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:27.875 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:06:27.875 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:27.875 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.875 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.875 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:27.875 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631136+0000", 2024-04-18T21:06:27.875 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0139999999999999e-06 2024-04-18T21:06:27.875 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.876 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.876 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:27.876 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631152+0000", 2024-04-18T21:06:27.876 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6365999999999999e-05 2024-04-18T21:06:27.876 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.876 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.876 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:27.876 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631961+0000", 2024-04-18T21:06:27.876 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00080873100000000003 2024-04-18T21:06:27.876 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.876 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.876 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:27.876 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632021+0000", 2024-04-18T21:06:27.876 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0541999999999997e-05 2024-04-18T21:06:27.876 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.877 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.877 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:27.877 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633539+0000", 2024-04-18T21:06:27.877 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015175639999999999 2024-04-18T21:06:27.877 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.877 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.877 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:27.877 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640936+0000", 2024-04-18T21:06:27.877 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007397257 2024-04-18T21:06:27.877 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:27.877 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:27.877 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:27.877 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.877 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.877 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-18T21:06:27.878 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:06:27.878 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 82.154376490999994, 2024-04-18T21:06:27.878 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00073592199999999997, 2024-04-18T21:06:27.878 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:27.878 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:27.878 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:27.878 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:27.878 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.878 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:27.878 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:06:27.878 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:27.878 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.879 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.879 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:27.879 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:06:27.879 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:27.879 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.879 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.879 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:27.879 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648597+0000", 2024-04-18T21:06:27.879 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:06:27.879 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.879 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.879 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:27.879 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648605+0000", 2024-04-18T21:06:27.880 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3960000000000006e-06 2024-04-18T21:06:27.880 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.880 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.880 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:27.880 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648625+0000", 2024-04-18T21:06:27.880 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9987e-05 2024-04-18T21:06:27.880 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.880 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.880 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:27.880 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648643+0000", 2024-04-18T21:06:27.880 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7079e-05 2024-04-18T21:06:27.880 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.880 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.881 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:27.881 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649043+0000", 2024-04-18T21:06:27.881 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040083399999999998 2024-04-18T21:06:27.881 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.881 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.881 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:27.881 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649062+0000", 2024-04-18T21:06:27.881 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9052999999999999e-05 2024-04-18T21:06:27.881 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.881 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.881 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:27.881 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649332+0000", 2024-04-18T21:06:27.881 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026971999999999999 2024-04-18T21:06:27.881 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:27.881 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:27.882 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:27.882 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.882 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.882 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:06:27.882 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:06:27.882 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 82.151601589999999, 2024-04-18T21:06:27.882 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00086123999999999999, 2024-04-18T21:06:27.882 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:27.882 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:27.882 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:06:27.882 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:27.882 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.882 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:27.883 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:06:27.883 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:27.883 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.883 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.883 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:27.883 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:06:27.883 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:27.883 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.883 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.883 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:27.883 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651372+0000", 2024-04-18T21:06:27.883 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7599999999999997e-07 2024-04-18T21:06:27.883 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.883 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.883 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:27.883 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651377+0000", 2024-04-18T21:06:27.883 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.22e-06 2024-04-18T21:06:27.884 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.884 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.884 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:27.884 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651394+0000", 2024-04-18T21:06:27.884 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6646999999999998e-05 2024-04-18T21:06:27.884 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.884 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.884 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:27.884 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651427+0000", 2024-04-18T21:06:27.884 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3682e-05 2024-04-18T21:06:27.884 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.884 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.884 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:27.884 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652029+0000", 2024-04-18T21:06:27.884 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00060152199999999995 2024-04-18T21:06:27.884 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.885 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.885 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:27.885 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652232+0000", 2024-04-18T21:06:27.885 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020359299999999999 2024-04-18T21:06:27.885 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:27.885 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:27.885 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:27.885 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.885 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.885 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:06:27.885 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:06:27.885 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 82.143574627999996, 2024-04-18T21:06:27.885 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0017426200000000001, 2024-04-18T21:06:27.885 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:27.885 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:27.886 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:27.886 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:27.886 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.886 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:27.886 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:06:27.886 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:27.886 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.886 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.886 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:27.886 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:06:27.886 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:27.886 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.887 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.887 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:27.887 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659399+0000", 2024-04-18T21:06:27.887 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6000000000000002e-07 2024-04-18T21:06:27.887 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.887 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.887 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:27.887 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659405+0000", 2024-04-18T21:06:27.887 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5069999999999997e-06 2024-04-18T21:06:27.887 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.887 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.887 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:27.887 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659425+0000", 2024-04-18T21:06:27.888 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.927e-05 2024-04-18T21:06:27.888 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.888 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.888 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:27.888 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659443+0000", 2024-04-18T21:06:27.888 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8051999999999999e-05 2024-04-18T21:06:27.888 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.888 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.888 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:27.888 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660973+0000", 2024-04-18T21:06:27.888 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001530106 2024-04-18T21:06:27.888 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.888 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.889 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:27.889 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660983+0000", 2024-04-18T21:06:27.889 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0516999999999999e-05 2024-04-18T21:06:27.889 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.889 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.889 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:27.889 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661141+0000", 2024-04-18T21:06:27.889 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015730799999999999 2024-04-18T21:06:27.889 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:27.889 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:27.889 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:27.890 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.890 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.890 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:06:27.890 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:06:27.890 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 82.143358003000003, 2024-04-18T21:06:27.890 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001812311, 2024-04-18T21:06:27.890 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:27.890 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:27.890 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:27.890 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:27.890 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.890 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:27.891 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:06:27.891 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:27.891 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.891 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.891 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:27.891 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:06:27.891 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:27.891 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.891 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.891 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:27.891 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659616+0000", 2024-04-18T21:06:27.891 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.277e-06 2024-04-18T21:06:27.891 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.891 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.892 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:27.892 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659625+0000", 2024-04-18T21:06:27.892 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5359999999999998e-06 2024-04-18T21:06:27.892 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.892 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.892 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:27.892 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659647+0000", 2024-04-18T21:06:27.892 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1857000000000001e-05 2024-04-18T21:06:27.892 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.892 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.892 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:27.892 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659664+0000", 2024-04-18T21:06:27.892 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6405999999999998e-05 2024-04-18T21:06:27.892 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.892 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.893 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:27.893 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661169+0000", 2024-04-18T21:06:27.893 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015054179999999999 2024-04-18T21:06:27.893 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.893 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.893 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:27.893 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661177+0000", 2024-04-18T21:06:27.893 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9680000000000006e-06 2024-04-18T21:06:27.893 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.893 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.893 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:27.894 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661427+0000", 2024-04-18T21:06:27.894 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024984900000000001 2024-04-18T21:06:27.894 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:27.894 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:27.894 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:27.894 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.894 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.894 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-18T21:06:27.894 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:06:27.894 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 80.190437395000004, 2024-04-18T21:06:27.894 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0030975030000000001, 2024-04-18T21:06:27.894 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:27.894 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:27.895 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:27.895 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:27.895 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.895 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:27.895 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:06:27.895 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:27.895 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.895 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.895 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:27.895 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:06:27.895 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:27.895 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.895 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.895 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:27.895 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612538+0000", 2024-04-18T21:06:27.895 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6259999999999999e-06 2024-04-18T21:06:27.896 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.896 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.896 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:27.896 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612552+0000", 2024-04-18T21:06:27.896 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4073999999999999e-05 2024-04-18T21:06:27.896 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.896 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.896 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:27.896 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612585+0000", 2024-04-18T21:06:27.896 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3504999999999999e-05 2024-04-18T21:06:27.896 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.896 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.897 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:27.897 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612601+0000", 2024-04-18T21:06:27.897 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5194000000000001e-05 2024-04-18T21:06:27.897 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.897 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.897 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:27.897 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612746+0000", 2024-04-18T21:06:27.897 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145666 2024-04-18T21:06:27.897 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.897 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.897 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:27.897 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612953+0000", 2024-04-18T21:06:27.897 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000207109 2024-04-18T21:06:27.897 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.897 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.898 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:27.898 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.613134+0000", 2024-04-18T21:06:27.898 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018041300000000001 2024-04-18T21:06:27.898 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.898 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.898 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:27.898 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.614411+0000", 2024-04-18T21:06:27.898 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0012769929999999999 2024-04-18T21:06:27.898 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.898 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.898 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:27.899 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615441+0000", 2024-04-18T21:06:27.899 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001029917 2024-04-18T21:06:27.899 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.899 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.899 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:27.899 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615522+0000", 2024-04-18T21:06:27.899 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1142000000000003e-05 2024-04-18T21:06:27.899 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.899 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.899 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:27.899 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615633+0000", 2024-04-18T21:06:27.899 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000110864 2024-04-18T21:06:27.899 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:27.899 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:27.899 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:27.900 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.900 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.900 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-18T21:06:27.900 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:06:27.900 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 62.188151584000003, 2024-04-18T21:06:27.900 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088979039999999999, 2024-04-18T21:06:27.900 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:27.900 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:27.900 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:27.900 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:27.900 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.900 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:27.900 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:06:27.900 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:27.901 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.901 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.901 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:27.901 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:06:27.901 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:27.901 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.901 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.901 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:27.901 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614825+0000", 2024-04-18T21:06:27.901 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4829999999999999e-06 2024-04-18T21:06:27.901 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.901 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.901 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:27.901 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614843+0000", 2024-04-18T21:06:27.901 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8777e-05 2024-04-18T21:06:27.901 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.902 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.902 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:27.902 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614884+0000", 2024-04-18T21:06:27.902 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1051999999999999e-05 2024-04-18T21:06:27.902 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.902 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.902 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:27.902 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614903+0000", 2024-04-18T21:06:27.902 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9069999999999999e-05 2024-04-18T21:06:27.902 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.902 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.902 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:27.902 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615047+0000", 2024-04-18T21:06:27.903 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014374400000000001 2024-04-18T21:06:27.903 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.903 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.903 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:27.903 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615061+0000", 2024-04-18T21:06:27.903 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4063000000000001e-05 2024-04-18T21:06:27.903 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.903 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.903 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:27.903 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621064+0000", 2024-04-18T21:06:27.903 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0060029200000000001 2024-04-18T21:06:27.903 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.903 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.904 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:27.904 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621211+0000", 2024-04-18T21:06:27.904 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000147224 2024-04-18T21:06:27.904 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.904 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.904 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:27.904 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621396+0000", 2024-04-18T21:06:27.904 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018454699999999999 2024-04-18T21:06:27.904 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.904 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.904 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:27.904 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.622517+0000", 2024-04-18T21:06:27.904 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001121424 2024-04-18T21:06:27.904 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.904 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.904 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:27.905 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623571+0000", 2024-04-18T21:06:27.905 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010538660000000001 2024-04-18T21:06:27.905 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.905 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.905 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:27.905 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623658+0000", 2024-04-18T21:06:27.905 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6439000000000004e-05 2024-04-18T21:06:27.905 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:27.905 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:27.905 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:27.905 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623719+0000", 2024-04-18T21:06:27.905 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1295000000000002e-05 2024-04-18T21:06:27.905 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:27.906 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:27.906 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:27.906 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:27.906 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:27.906 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:27.907 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:27.906+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:27.908 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:28.009 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:28.006+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:28.039 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:28.039 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:06:28.039 INFO:teuthology.orchestra.run.smithi132.stdout: "num_ops": 0 2024-04-18T21:06:28.039 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:28.054 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:28.109 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:28.111+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:28.210 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:28.211+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:28.223 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:28.223 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:06:28.223 INFO:teuthology.orchestra.run.smithi132.stdout: "complaint_time": 30, 2024-04-18T21:06:28.223 INFO:teuthology.orchestra.run.smithi132.stdout: "num_blocked_ops": 0 2024-04-18T21:06:28.224 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:28.239 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:28.311 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:28.310+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:28.361 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:28.361 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 20, 2024-04-18T21:06:28.361 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 600, 2024-04-18T21:06:28.361 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [ 2024-04-18T21:06:28.361 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.361 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:28.361 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:06:28.362 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 93.448970363000001, 2024-04-18T21:06:28.362 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.02518273, 2024-04-18T21:06:28.362 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:28.362 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:28.362 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:28.362 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:28.362 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:28.362 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:28.362 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 141 2024-04-18T21:06:28.362 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.362 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:28.362 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.362 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:28.362 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:06:28.363 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:28.363 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.363 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.363 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:28.363 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:06:28.363 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:28.363 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.363 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.363 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:28.363 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911562+0000", 2024-04-18T21:06:28.363 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9300000000000006e-07 2024-04-18T21:06:28.363 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.363 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.363 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:28.364 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911569+0000", 2024-04-18T21:06:28.364 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0169999999999999e-06 2024-04-18T21:06:28.364 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.364 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.364 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:28.364 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911582+0000", 2024-04-18T21:06:28.364 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.343e-05 2024-04-18T21:06:28.364 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.364 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.364 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:28.364 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911590+0000", 2024-04-18T21:06:28.364 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.413e-06 2024-04-18T21:06:28.364 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.364 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.364 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:28.365 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.933922+0000", 2024-04-18T21:06:28.365 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.022332093000000001 2024-04-18T21:06:28.365 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.365 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.365 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:28.365 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.934155+0000", 2024-04-18T21:06:28.365 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023378900000000001 2024-04-18T21:06:28.365 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.365 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.365 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:28.365 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.934514+0000", 2024-04-18T21:06:28.365 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00035859200000000003 2024-04-18T21:06:28.365 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.365 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.366 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:28.366 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.935973+0000", 2024-04-18T21:06:28.366 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001458705 2024-04-18T21:06:28.366 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.366 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.366 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:28.366 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936488+0000", 2024-04-18T21:06:28.366 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00051550000000000001 2024-04-18T21:06:28.366 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.366 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.366 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:28.366 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936636+0000", 2024-04-18T21:06:28.366 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014779800000000001 2024-04-18T21:06:28.366 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.367 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.367 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:28.367 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936743+0000", 2024-04-18T21:06:28.367 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010739999999999999 2024-04-18T21:06:28.367 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:28.367 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:28.367 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:28.367 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.367 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.367 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:28.367 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:28.367 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 93.331771388999996, 2024-04-18T21:06:28.367 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023654959999999999, 2024-04-18T21:06:28.367 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:28.367 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:28.368 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:28.368 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:28.368 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:28.368 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:28.368 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 163 2024-04-18T21:06:28.368 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.368 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:28.368 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.368 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:28.368 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:28.368 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:28.368 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.368 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.368 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:28.369 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:28.369 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:28.369 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.369 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.369 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:28.369 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:28.369 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0999999999999998e-07 2024-04-18T21:06:28.369 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.369 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.369 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:28.369 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028766+0000", 2024-04-18T21:06:28.369 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4700000000000001e-06 2024-04-18T21:06:28.369 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.369 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.370 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:28.370 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028775+0000", 2024-04-18T21:06:28.370 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.3190000000000001e-06 2024-04-18T21:06:28.370 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.370 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.370 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:28.370 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028782+0000", 2024-04-18T21:06:28.370 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.2300000000000002e-06 2024-04-18T21:06:28.370 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.370 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.370 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:28.370 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046667+0000", 2024-04-18T21:06:28.370 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017884356000000001 2024-04-18T21:06:28.370 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.370 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.371 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:28.371 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046788+0000", 2024-04-18T21:06:28.371 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012125000000000001 2024-04-18T21:06:28.371 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.371 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.371 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:28.371 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046982+0000", 2024-04-18T21:06:28.371 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019394 2024-04-18T21:06:28.371 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.371 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.371 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:28.371 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051969+0000", 2024-04-18T21:06:28.371 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0049868150000000003 2024-04-18T21:06:28.371 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.371 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.372 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:28.372 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052089+0000", 2024-04-18T21:06:28.372 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011993 2024-04-18T21:06:28.372 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.372 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.372 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:28.372 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052292+0000", 2024-04-18T21:06:28.372 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020345699999999999 2024-04-18T21:06:28.372 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.372 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.372 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:28.372 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052415+0000", 2024-04-18T21:06:28.372 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000122483 2024-04-18T21:06:28.372 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:28.373 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:28.373 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:28.373 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.373 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.373 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:28.373 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:28.373 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 93.331737157000006, 2024-04-18T21:06:28.373 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023864586, 2024-04-18T21:06:28.373 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:28.373 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:28.373 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:28.373 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:28.373 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:28.373 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:28.373 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 164 2024-04-18T21:06:28.374 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.374 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:28.374 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.374 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:28.374 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:28.374 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:28.374 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.374 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.374 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:28.374 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:28.374 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:28.374 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.374 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.375 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:28.375 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028795+0000", 2024-04-18T21:06:28.375 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7999999999999995e-07 2024-04-18T21:06:28.375 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.375 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.375 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:28.375 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028884+0000", 2024-04-18T21:06:28.375 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8997000000000002e-05 2024-04-18T21:06:28.375 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.375 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.375 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:28.375 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028895+0000", 2024-04-18T21:06:28.375 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1647e-05 2024-04-18T21:06:28.375 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.376 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.376 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:28.376 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028903+0000", 2024-04-18T21:06:28.376 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.909e-06 2024-04-18T21:06:28.376 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.376 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.376 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:28.376 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.047818+0000", 2024-04-18T21:06:28.376 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018914337 2024-04-18T21:06:28.376 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.376 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.376 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:28.376 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.048094+0000", 2024-04-18T21:06:28.377 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00027653500000000001 2024-04-18T21:06:28.377 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.377 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.377 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:28.377 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.048471+0000", 2024-04-18T21:06:28.377 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00037705799999999999 2024-04-18T21:06:28.377 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.377 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.377 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:28.377 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052516+0000", 2024-04-18T21:06:28.377 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0040452739999999997 2024-04-18T21:06:28.377 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.377 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.377 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:28.377 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052535+0000", 2024-04-18T21:06:28.378 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.84e-05 2024-04-18T21:06:28.378 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.378 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.378 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:28.378 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052603+0000", 2024-04-18T21:06:28.378 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.8095000000000004e-05 2024-04-18T21:06:28.378 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.378 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.378 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:28.378 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052659+0000", 2024-04-18T21:06:28.378 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5653999999999999e-05 2024-04-18T21:06:28.378 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:28.378 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:28.379 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:28.379 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.379 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.379 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:28.379 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:28.379 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 93.331613714, 2024-04-18T21:06:28.379 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024516458000000001, 2024-04-18T21:06:28.379 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:28.379 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:28.379 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:28.379 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:28.379 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:28.379 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:28.380 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 165 2024-04-18T21:06:28.380 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.380 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:28.380 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.380 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:28.380 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:28.380 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:28.380 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.380 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.380 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:28.380 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:28.380 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:28.380 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.380 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.380 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:28.380 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028918+0000", 2024-04-18T21:06:28.381 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8000000000000005e-07 2024-04-18T21:06:28.381 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.381 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.381 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:28.381 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028924+0000", 2024-04-18T21:06:28.381 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5659999999999997e-06 2024-04-18T21:06:28.381 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.381 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.381 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:28.381 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028933+0000", 2024-04-18T21:06:28.381 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.38e-06 2024-04-18T21:06:28.381 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.381 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.382 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:28.382 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028940+0000", 2024-04-18T21:06:28.382 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0060000000000003e-06 2024-04-18T21:06:28.382 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.382 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.382 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:28.382 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.050846+0000", 2024-04-18T21:06:28.382 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021906119000000002 2024-04-18T21:06:28.382 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.382 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.382 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:28.382 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051025+0000", 2024-04-18T21:06:28.382 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017850799999999999 2024-04-18T21:06:28.383 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.383 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.383 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:28.383 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051221+0000", 2024-04-18T21:06:28.383 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019608700000000001 2024-04-18T21:06:28.383 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.383 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.383 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:28.383 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052675+0000", 2024-04-18T21:06:28.383 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0014537899999999999 2024-04-18T21:06:28.383 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.383 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.383 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:28.383 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053311+0000", 2024-04-18T21:06:28.383 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00063613299999999999 2024-04-18T21:06:28.384 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.384 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.384 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:28.384 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053381+0000", 2024-04-18T21:06:28.384 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0074999999999996e-05 2024-04-18T21:06:28.384 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.384 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.384 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:28.384 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053434+0000", 2024-04-18T21:06:28.384 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3013999999999998e-05 2024-04-18T21:06:28.384 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:28.384 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:28.384 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:28.384 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.385 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.385 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:28.385 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:28.385 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 93.218308234999995, 2024-04-18T21:06:28.385 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023772793, 2024-04-18T21:06:28.385 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:28.385 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:28.385 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:28.385 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:28.385 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:28.385 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:28.385 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 187 2024-04-18T21:06:28.385 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.385 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:28.386 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.386 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:28.386 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:28.386 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:28.386 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.386 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.386 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:28.386 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:28.386 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:28.386 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.386 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.386 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:28.386 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142224+0000", 2024-04-18T21:06:28.386 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.47e-07 2024-04-18T21:06:28.386 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.387 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.387 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:28.387 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142233+0000", 2024-04-18T21:06:28.387 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0729999999999994e-06 2024-04-18T21:06:28.387 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.387 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.387 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:28.387 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142255+0000", 2024-04-18T21:06:28.387 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.2535999999999999e-05 2024-04-18T21:06:28.387 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.387 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.387 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:28.387 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142268+0000", 2024-04-18T21:06:28.387 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2686e-05 2024-04-18T21:06:28.387 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.388 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.388 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:28.388 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160497+0000", 2024-04-18T21:06:28.388 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018228779000000001 2024-04-18T21:06:28.388 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.388 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.388 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:28.388 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160634+0000", 2024-04-18T21:06:28.388 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000137315 2024-04-18T21:06:28.388 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.388 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.388 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:28.388 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160831+0000", 2024-04-18T21:06:28.389 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019683100000000001 2024-04-18T21:06:28.389 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.389 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.389 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:28.389 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165129+0000", 2024-04-18T21:06:28.389 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0042981299999999998 2024-04-18T21:06:28.389 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.389 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.389 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:28.389 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165776+0000", 2024-04-18T21:06:28.389 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00064702900000000003 2024-04-18T21:06:28.389 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.389 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.390 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:28.390 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165921+0000", 2024-04-18T21:06:28.390 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014506 2024-04-18T21:06:28.390 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.390 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.390 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:28.390 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165996+0000", 2024-04-18T21:06:28.390 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.4406999999999994e-05 2024-04-18T21:06:28.390 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:28.390 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:28.390 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:28.390 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.390 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.390 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:28.391 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:28.391 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 93.218247637000005, 2024-04-18T21:06:28.391 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026802157, 2024-04-18T21:06:28.391 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:28.391 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:28.391 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:28.391 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:28.391 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:28.391 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:28.391 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 188 2024-04-18T21:06:28.391 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.391 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:28.391 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.392 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:28.392 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:28.392 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:28.392 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.392 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.392 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:28.392 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:28.392 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:28.392 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.392 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.392 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:28.392 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142284+0000", 2024-04-18T21:06:28.392 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4e-07 2024-04-18T21:06:28.392 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.392 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.392 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:28.393 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142374+0000", 2024-04-18T21:06:28.393 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0099999999999995e-05 2024-04-18T21:06:28.393 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.393 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.393 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:28.393 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142386+0000", 2024-04-18T21:06:28.393 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1770000000000001e-05 2024-04-18T21:06:28.393 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.393 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.393 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:28.393 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142394+0000", 2024-04-18T21:06:28.393 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.2130000000000008e-06 2024-04-18T21:06:28.393 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.393 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.393 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:28.393 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.161743+0000", 2024-04-18T21:06:28.394 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019348644000000002 2024-04-18T21:06:28.394 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.394 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.394 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:28.394 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.161865+0000", 2024-04-18T21:06:28.394 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012210899999999999 2024-04-18T21:06:28.394 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.394 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.394 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:28.394 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.162055+0000", 2024-04-18T21:06:28.394 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000189994 2024-04-18T21:06:28.394 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.394 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.394 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:28.394 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165735+0000", 2024-04-18T21:06:28.395 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0036803270000000002 2024-04-18T21:06:28.395 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.395 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.395 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:28.395 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.168911+0000", 2024-04-18T21:06:28.395 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0031753689999999999 2024-04-18T21:06:28.395 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.395 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.395 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:28.395 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169012+0000", 2024-04-18T21:06:28.395 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010157699999999999 2024-04-18T21:06:28.395 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.395 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.395 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:28.396 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169086+0000", 2024-04-18T21:06:28.396 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3213999999999994e-05 2024-04-18T21:06:28.396 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:28.396 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:28.396 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:28.396 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.396 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.396 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:28.396 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:28.396 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 93.218122331000004, 2024-04-18T21:06:28.396 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026811423000000001, 2024-04-18T21:06:28.396 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:28.396 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:28.396 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:28.397 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:28.397 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:28.397 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:28.397 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 189 2024-04-18T21:06:28.397 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.397 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:28.397 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.397 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:28.397 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:28.397 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:28.397 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.397 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.397 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:28.397 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:28.397 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:28.398 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.398 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.398 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:28.398 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142410+0000", 2024-04-18T21:06:28.398 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:06:28.398 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.398 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.398 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:28.398 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142415+0000", 2024-04-18T21:06:28.398 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.7939999999999999e-06 2024-04-18T21:06:28.398 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.398 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.398 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:28.398 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142470+0000", 2024-04-18T21:06:28.399 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4537999999999999e-05 2024-04-18T21:06:28.399 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.399 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.399 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:28.399 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142481+0000", 2024-04-18T21:06:28.399 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0966e-05 2024-04-18T21:06:28.399 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.399 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.399 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:28.399 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.163493+0000", 2024-04-18T21:06:28.399 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021012444000000002 2024-04-18T21:06:28.399 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.399 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.399 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:28.399 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.163727+0000", 2024-04-18T21:06:28.400 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000233339 2024-04-18T21:06:28.400 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.400 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.400 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:28.400 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.164102+0000", 2024-04-18T21:06:28.400 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000374872 2024-04-18T21:06:28.400 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.400 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.400 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:28.400 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.166528+0000", 2024-04-18T21:06:28.400 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0024258729999999998 2024-04-18T21:06:28.400 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.400 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.400 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:28.401 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169101+0000", 2024-04-18T21:06:28.401 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0025737680000000001 2024-04-18T21:06:28.401 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.401 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.401 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:28.401 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169171+0000", 2024-04-18T21:06:28.401 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0148000000000007e-05 2024-04-18T21:06:28.401 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.401 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.401 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:28.401 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169220+0000", 2024-04-18T21:06:28.401 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8767999999999998e-05 2024-04-18T21:06:28.401 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:28.402 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:28.402 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:28.402 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.402 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.402 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:28.402 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:28.402 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 82.744549778999996, 2024-04-18T21:06:28.402 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024082777999999999, 2024-04-18T21:06:28.402 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:28.402 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:28.402 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:28.402 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:28.402 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.403 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:28.403 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:28.403 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:28.403 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.403 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.403 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:28.403 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:28.403 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:28.403 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.403 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.403 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:28.403 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615984+0000", 2024-04-18T21:06:28.403 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.9869999999999999e-06 2024-04-18T21:06:28.403 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.403 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.404 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:28.404 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615999+0000", 2024-04-18T21:06:28.404 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4646e-05 2024-04-18T21:06:28.404 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.404 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.404 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:28.404 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616028+0000", 2024-04-18T21:06:28.404 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8952999999999999e-05 2024-04-18T21:06:28.404 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.404 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.404 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:28.404 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616052+0000", 2024-04-18T21:06:28.404 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.3941999999999999e-05 2024-04-18T21:06:28.404 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.404 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.405 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:28.405 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618010+0000", 2024-04-18T21:06:28.405 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0019581780000000001 2024-04-18T21:06:28.405 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.405 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.405 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:28.405 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618322+0000", 2024-04-18T21:06:28.405 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00031158899999999997 2024-04-18T21:06:28.405 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.405 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.405 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:28.405 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618587+0000", 2024-04-18T21:06:28.405 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00026495700000000002 2024-04-18T21:06:28.405 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.406 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.406 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:28.406 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629262+0000", 2024-04-18T21:06:28.406 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010675877 2024-04-18T21:06:28.406 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.406 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.406 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:28.406 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.639773+0000", 2024-04-18T21:06:28.406 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0105109 2024-04-18T21:06:28.406 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.406 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.406 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:28.406 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.639926+0000", 2024-04-18T21:06:28.406 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000152349 2024-04-18T21:06:28.406 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.407 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.407 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:28.407 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640064+0000", 2024-04-18T21:06:28.407 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0001384 2024-04-18T21:06:28.407 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:28.407 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:28.407 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:28.407 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.407 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.407 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:28.407 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:28.407 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 82.744437105000003, 2024-04-18T21:06:28.407 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030215005999999999, 2024-04-18T21:06:28.407 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:28.407 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:28.407 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:28.408 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:28.408 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.408 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:28.408 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:28.408 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:28.408 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.408 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.408 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:28.408 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:28.408 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:28.408 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.408 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.408 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:28.408 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616095+0000", 2024-04-18T21:06:28.408 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.446e-06 2024-04-18T21:06:28.409 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.409 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.409 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:28.409 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616104+0000", 2024-04-18T21:06:28.409 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6200000000000005e-06 2024-04-18T21:06:28.409 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.409 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.409 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:28.409 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616132+0000", 2024-04-18T21:06:28.409 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7668999999999999e-05 2024-04-18T21:06:28.409 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.409 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.409 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:28.409 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616149+0000", 2024-04-18T21:06:28.410 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7047000000000001e-05 2024-04-18T21:06:28.410 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.410 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.410 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:28.410 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619287+0000", 2024-04-18T21:06:28.410 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0031381450000000002 2024-04-18T21:06:28.410 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.410 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.410 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:28.410 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619503+0000", 2024-04-18T21:06:28.410 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000216522 2024-04-18T21:06:28.410 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.410 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.410 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:28.411 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619930+0000", 2024-04-18T21:06:28.411 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00042604900000000001 2024-04-18T21:06:28.411 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.411 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.411 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:28.411 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629281+0000", 2024-04-18T21:06:28.411 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0093512230000000005 2024-04-18T21:06:28.411 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.411 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.411 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:28.411 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646022+0000", 2024-04-18T21:06:28.411 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016741156 2024-04-18T21:06:28.411 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.411 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.411 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:28.411 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646198+0000", 2024-04-18T21:06:28.412 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000176009 2024-04-18T21:06:28.412 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.412 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.412 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:28.412 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646309+0000", 2024-04-18T21:06:28.412 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011112000000000001 2024-04-18T21:06:28.412 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:28.412 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:28.412 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:28.412 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.412 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.412 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:28.412 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:28.412 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 82.744352281000005, 2024-04-18T21:06:28.412 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030501176000000001, 2024-04-18T21:06:28.413 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:28.413 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:28.413 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:28.413 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:28.413 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.413 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:28.413 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:28.413 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:28.413 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.413 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.413 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:28.413 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:28.413 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:28.413 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.414 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.414 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:28.414 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616180+0000", 2024-04-18T21:06:28.414 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1000000000000001e-06 2024-04-18T21:06:28.414 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.414 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.414 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:28.414 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616188+0000", 2024-04-18T21:06:28.414 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4069999999999993e-06 2024-04-18T21:06:28.414 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.414 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.414 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:28.414 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616207+0000", 2024-04-18T21:06:28.414 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8335999999999999e-05 2024-04-18T21:06:28.415 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.415 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.415 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:28.415 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616225+0000", 2024-04-18T21:06:28.415 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8652999999999999e-05 2024-04-18T21:06:28.415 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.415 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.415 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:28.415 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620977+0000", 2024-04-18T21:06:28.415 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047512220000000003 2024-04-18T21:06:28.415 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.415 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.415 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:28.415 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621279+0000", 2024-04-18T21:06:28.415 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000302646 2024-04-18T21:06:28.415 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.416 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.416 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:28.416 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621584+0000", 2024-04-18T21:06:28.416 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000305142 2024-04-18T21:06:28.416 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.416 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.416 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:28.416 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629352+0000", 2024-04-18T21:06:28.416 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0077673689999999997 2024-04-18T21:06:28.416 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.416 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.416 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:28.416 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646480+0000", 2024-04-18T21:06:28.416 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017128259 2024-04-18T21:06:28.417 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.417 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.417 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:28.417 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646591+0000", 2024-04-18T21:06:28.417 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011113899999999999 2024-04-18T21:06:28.417 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.417 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.417 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:28.417 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646680+0000", 2024-04-18T21:06:28.417 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8902999999999999e-05 2024-04-18T21:06:28.417 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:28.417 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:28.417 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:28.417 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.417 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.418 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:28.418 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:28.418 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 82.744285782000006, 2024-04-18T21:06:28.418 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030779760999999999, 2024-04-18T21:06:28.418 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:28.418 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:28.418 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:28.418 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:28.418 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.418 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:28.418 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:28.418 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:28.418 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.419 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.419 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:28.419 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:28.419 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:28.419 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.419 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.419 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:28.419 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616246+0000", 2024-04-18T21:06:28.419 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0499999999999999e-06 2024-04-18T21:06:28.419 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.419 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.419 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:28.419 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616253+0000", 2024-04-18T21:06:28.419 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.5989999999999998e-06 2024-04-18T21:06:28.420 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.420 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.420 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:28.420 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616273+0000", 2024-04-18T21:06:28.420 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9916999999999999e-05 2024-04-18T21:06:28.420 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.420 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.420 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:28.420 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616287+0000", 2024-04-18T21:06:28.420 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3669000000000001e-05 2024-04-18T21:06:28.420 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.420 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.420 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:28.420 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622203+0000", 2024-04-18T21:06:28.421 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.005916737 2024-04-18T21:06:28.421 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.421 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.421 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:28.421 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622379+0000", 2024-04-18T21:06:28.421 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000175596 2024-04-18T21:06:28.421 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.421 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.421 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:28.421 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622707+0000", 2024-04-18T21:06:28.421 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00032784600000000002 2024-04-18T21:06:28.421 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.421 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.421 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:28.421 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629366+0000", 2024-04-18T21:06:28.421 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0066593279999999999 2024-04-18T21:06:28.422 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.422 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.422 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:28.422 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646813+0000", 2024-04-18T21:06:28.422 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017447059000000001 2024-04-18T21:06:28.422 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.422 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.422 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:28.422 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646946+0000", 2024-04-18T21:06:28.422 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013301200000000001 2024-04-18T21:06:28.422 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.422 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.422 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:28.423 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647025+0000", 2024-04-18T21:06:28.423 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8948000000000004e-05 2024-04-18T21:06:28.423 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:28.423 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:28.423 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:28.423 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.423 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.423 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:28.423 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:28.423 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 82.744201963999998, 2024-04-18T21:06:28.423 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.031512165000000002, 2024-04-18T21:06:28.423 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:28.423 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:28.423 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:28.423 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:28.424 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.424 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:28.424 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:28.424 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:28.424 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.424 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.424 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:28.424 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:28.424 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:28.424 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.424 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.424 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:28.424 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616330+0000", 2024-04-18T21:06:28.424 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.15e-06 2024-04-18T21:06:28.425 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.425 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.425 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:28.425 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616337+0000", 2024-04-18T21:06:28.425 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.1289999999999998e-06 2024-04-18T21:06:28.425 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.425 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.425 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:28.425 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616447+0000", 2024-04-18T21:06:28.425 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109561 2024-04-18T21:06:28.425 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.425 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.425 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:28.425 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616496+0000", 2024-04-18T21:06:28.425 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8591999999999998e-05 2024-04-18T21:06:28.426 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.426 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.426 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:28.426 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.623786+0000", 2024-04-18T21:06:28.426 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0072906799999999999 2024-04-18T21:06:28.426 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.426 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.426 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:28.426 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.623973+0000", 2024-04-18T21:06:28.426 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018717199999999999 2024-04-18T21:06:28.426 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.426 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.426 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:28.426 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624260+0000", 2024-04-18T21:06:28.427 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00028630600000000001 2024-04-18T21:06:28.427 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.427 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.427 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:28.427 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629381+0000", 2024-04-18T21:06:28.427 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0051211340000000003 2024-04-18T21:06:28.427 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.427 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.427 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:28.427 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647631+0000", 2024-04-18T21:06:28.427 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018249771000000001 2024-04-18T21:06:28.427 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.427 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.427 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:28.427 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647761+0000", 2024-04-18T21:06:28.427 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013037300000000001 2024-04-18T21:06:28.428 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.428 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.428 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:28.428 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647841+0000", 2024-04-18T21:06:28.428 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.0296999999999994e-05 2024-04-18T21:06:28.428 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:28.428 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:28.428 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:28.428 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.428 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.428 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:28.428 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:28.428 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 82.743996480000007, 2024-04-18T21:06:28.428 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043251955000000002, 2024-04-18T21:06:28.428 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:28.429 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:28.429 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:28.429 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:28.429 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.429 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:28.429 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:28.429 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:28.429 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.429 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.429 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:28.429 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:28.429 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:28.429 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.429 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.429 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:28.430 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616536+0000", 2024-04-18T21:06:28.430 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2869999999999999e-06 2024-04-18T21:06:28.430 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.430 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.430 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:28.430 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616572+0000", 2024-04-18T21:06:28.430 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.6261999999999999e-05 2024-04-18T21:06:28.430 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.430 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.430 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:28.430 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616593+0000", 2024-04-18T21:06:28.430 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1310000000000001e-05 2024-04-18T21:06:28.430 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.430 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.430 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:28.431 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616614+0000", 2024-04-18T21:06:28.431 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.0936000000000001e-05 2024-04-18T21:06:28.431 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.431 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.431 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:28.431 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629501+0000", 2024-04-18T21:06:28.431 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.012886819000000001 2024-04-18T21:06:28.431 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.431 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.431 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:28.431 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629696+0000", 2024-04-18T21:06:28.431 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019485499999999999 2024-04-18T21:06:28.431 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.431 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.431 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:28.432 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629940+0000", 2024-04-18T21:06:28.432 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00024386399999999999 2024-04-18T21:06:28.432 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.432 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.432 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:28.432 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640100+0000", 2024-04-18T21:06:28.432 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010159645 2024-04-18T21:06:28.432 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.432 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.432 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:28.432 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659516+0000", 2024-04-18T21:06:28.432 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019416563000000001 2024-04-18T21:06:28.432 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.432 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.432 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:28.433 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659684+0000", 2024-04-18T21:06:28.433 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016750900000000001 2024-04-18T21:06:28.433 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.433 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.433 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:28.433 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659787+0000", 2024-04-18T21:06:28.433 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000102905 2024-04-18T21:06:28.433 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:28.433 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:28.433 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:28.433 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.433 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.433 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:28.434 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:28.434 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 82.743891357999999, 2024-04-18T21:06:28.434 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043581898000000001, 2024-04-18T21:06:28.434 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:28.434 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:28.434 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:28.434 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:28.434 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.434 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:28.434 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:28.434 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:28.434 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.434 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.434 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:28.435 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:28.435 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:28.435 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.435 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.435 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:28.435 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616641+0000", 2024-04-18T21:06:28.435 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:06:28.435 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.435 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.435 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:28.435 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616648+0000", 2024-04-18T21:06:28.435 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3860000000000001e-06 2024-04-18T21:06:28.435 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.435 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.435 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:28.436 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616666+0000", 2024-04-18T21:06:28.436 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7583000000000001e-05 2024-04-18T21:06:28.436 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.436 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.436 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:28.436 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616679+0000", 2024-04-18T21:06:28.436 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3322999999999999e-05 2024-04-18T21:06:28.436 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.436 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.436 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:28.436 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630373+0000", 2024-04-18T21:06:28.436 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013694207999999999 2024-04-18T21:06:28.436 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.436 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.437 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:28.437 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630545+0000", 2024-04-18T21:06:28.437 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000171683 2024-04-18T21:06:28.437 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.437 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.437 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:28.437 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630728+0000", 2024-04-18T21:06:28.437 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000182599 2024-04-18T21:06:28.437 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.437 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.437 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:28.437 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640600+0000", 2024-04-18T21:06:28.437 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0098726119999999994 2024-04-18T21:06:28.437 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.438 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.438 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:28.438 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659927+0000", 2024-04-18T21:06:28.438 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019326724999999999 2024-04-18T21:06:28.438 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.438 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.438 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:28.438 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660112+0000", 2024-04-18T21:06:28.438 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000185203 2024-04-18T21:06:28.438 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.438 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.438 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:28.438 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660222+0000", 2024-04-18T21:06:28.438 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109343 2024-04-18T21:06:28.439 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:28.439 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:28.439 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:28.439 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.439 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.439 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:28.439 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:28.439 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 82.743026, 2024-04-18T21:06:28.439 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043121310000000003, 2024-04-18T21:06:28.439 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:28.439 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:28.439 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:28.439 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:28.439 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.440 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:28.440 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:28.440 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:28.440 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.440 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.440 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:28.440 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:28.440 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:28.440 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.440 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.440 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:28.440 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617506+0000", 2024-04-18T21:06:28.440 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9999999999999995e-07 2024-04-18T21:06:28.440 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.440 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.441 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:28.441 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617513+0000", 2024-04-18T21:06:28.441 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.9700000000000002e-06 2024-04-18T21:06:28.441 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.441 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.441 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:28.441 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617531+0000", 2024-04-18T21:06:28.441 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8105999999999999e-05 2024-04-18T21:06:28.441 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.441 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.441 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:28.441 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617545+0000", 2024-04-18T21:06:28.441 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3703000000000001e-05 2024-04-18T21:06:28.441 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.442 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.442 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:28.442 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632129+0000", 2024-04-18T21:06:28.442 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.014584135999999999 2024-04-18T21:06:28.442 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.442 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.442 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:28.442 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632361+0000", 2024-04-18T21:06:28.442 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023171800000000001 2024-04-18T21:06:28.442 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.442 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.442 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:28.442 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632804+0000", 2024-04-18T21:06:28.442 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000443549 2024-04-18T21:06:28.442 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.443 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.443 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:28.443 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646340+0000", 2024-04-18T21:06:28.443 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013535902000000001 2024-04-18T21:06:28.443 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.443 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.443 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:28.443 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660363+0000", 2024-04-18T21:06:28.443 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01402318 2024-04-18T21:06:28.443 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.443 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.443 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:28.443 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660523+0000", 2024-04-18T21:06:28.443 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00015989899999999999 2024-04-18T21:06:28.443 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.444 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.444 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:28.444 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660626+0000", 2024-04-18T21:06:28.444 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010314699999999999 2024-04-18T21:06:28.444 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:28.444 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:28.444 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:28.444 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.444 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.444 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:28.444 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:28.444 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 82.742886307000006, 2024-04-18T21:06:28.444 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024927483, 2024-04-18T21:06:28.444 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:28.444 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:28.444 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:28.445 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:28.445 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.445 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:28.445 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:28.445 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:28.445 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.445 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.445 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:28.445 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:28.445 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:28.445 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.445 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.445 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:28.445 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617646+0000", 2024-04-18T21:06:28.445 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3030000000000001e-06 2024-04-18T21:06:28.445 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.446 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.446 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:28.446 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617653+0000", 2024-04-18T21:06:28.446 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7530000000000004e-06 2024-04-18T21:06:28.446 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.446 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.446 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:28.446 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617673+0000", 2024-04-18T21:06:28.446 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9967e-05 2024-04-18T21:06:28.446 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.446 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.446 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:28.446 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617688+0000", 2024-04-18T21:06:28.446 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5153e-05 2024-04-18T21:06:28.447 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.447 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.447 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:28.447 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619244+0000", 2024-04-18T21:06:28.447 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001555531 2024-04-18T21:06:28.447 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.447 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.447 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:28.447 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619361+0000", 2024-04-18T21:06:28.447 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011784400000000001 2024-04-18T21:06:28.447 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.447 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.447 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:28.447 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619604+0000", 2024-04-18T21:06:28.448 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000243007 2024-04-18T21:06:28.448 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.448 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.448 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:28.448 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.625480+0000", 2024-04-18T21:06:28.448 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0058759349999999997 2024-04-18T21:06:28.448 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.448 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.448 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:28.448 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642342+0000", 2024-04-18T21:06:28.448 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016861373999999998 2024-04-18T21:06:28.448 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.448 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.448 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:28.448 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642484+0000", 2024-04-18T21:06:28.448 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000142423 2024-04-18T21:06:28.449 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.449 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.449 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:28.449 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642572+0000", 2024-04-18T21:06:28.449 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8193000000000001e-05 2024-04-18T21:06:28.449 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:28.449 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:28.449 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:28.449 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.449 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.449 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:28.449 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:28.449 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 82.742604803999996, 2024-04-18T21:06:28.449 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024956974999999999, 2024-04-18T21:06:28.449 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:28.449 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:28.450 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:28.450 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:28.450 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.450 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:28.450 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:28.450 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:28.450 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.450 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.450 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:28.450 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:28.450 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:28.450 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.450 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.450 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:28.451 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617928+0000", 2024-04-18T21:06:28.451 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5430000000000001e-06 2024-04-18T21:06:28.451 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.451 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.451 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:28.451 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617937+0000", 2024-04-18T21:06:28.451 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6629999999999999e-06 2024-04-18T21:06:28.451 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.451 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.451 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:28.451 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617955+0000", 2024-04-18T21:06:28.451 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8749999999999998e-05 2024-04-18T21:06:28.451 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.451 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.452 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:28.452 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617971+0000", 2024-04-18T21:06:28.452 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.605e-05 2024-04-18T21:06:28.452 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.452 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.452 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:28.452 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621019+0000", 2024-04-18T21:06:28.452 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0030472369999999999 2024-04-18T21:06:28.452 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.452 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.452 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:28.452 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621249+0000", 2024-04-18T21:06:28.452 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000230075 2024-04-18T21:06:28.452 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.452 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.453 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:28.453 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621450+0000", 2024-04-18T21:06:28.453 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020166499999999999 2024-04-18T21:06:28.453 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.453 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.453 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:28.453 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.626233+0000", 2024-04-18T21:06:28.453 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047827390000000003 2024-04-18T21:06:28.453 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.453 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.453 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:28.453 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642693+0000", 2024-04-18T21:06:28.453 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01645961 2024-04-18T21:06:28.453 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.454 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.454 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:28.454 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642798+0000", 2024-04-18T21:06:28.454 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010559499999999999 2024-04-18T21:06:28.454 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.454 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.454 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:28.454 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642883+0000", 2024-04-18T21:06:28.454 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5048000000000003e-05 2024-04-18T21:06:28.454 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:28.454 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:28.454 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:28.454 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.454 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.455 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:28.455 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:28.455 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 82.740909176000002, 2024-04-18T21:06:28.455 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024086478000000001, 2024-04-18T21:06:28.455 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:28.455 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:28.455 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:28.455 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:28.455 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.455 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:28.455 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:28.455 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:28.455 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.456 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.456 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:28.456 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:28.456 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:28.456 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.456 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.456 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:28.456 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619624+0000", 2024-04-18T21:06:28.456 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.75e-06 2024-04-18T21:06:28.456 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.456 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.456 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:28.456 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619637+0000", 2024-04-18T21:06:28.456 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3540000000000001e-05 2024-04-18T21:06:28.456 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.457 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.457 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:28.457 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619666+0000", 2024-04-18T21:06:28.457 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8685999999999999e-05 2024-04-18T21:06:28.457 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.457 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.457 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:28.457 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619685+0000", 2024-04-18T21:06:28.457 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8681999999999998e-05 2024-04-18T21:06:28.457 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.457 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.457 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:28.457 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622275+0000", 2024-04-18T21:06:28.457 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0025899260000000002 2024-04-18T21:06:28.458 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.458 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.458 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:28.458 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622572+0000", 2024-04-18T21:06:28.458 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00029722 2024-04-18T21:06:28.458 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.458 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.458 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:28.458 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622752+0000", 2024-04-18T21:06:28.458 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018065900000000001 2024-04-18T21:06:28.458 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.458 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.458 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:28.458 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.626326+0000", 2024-04-18T21:06:28.459 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035737310000000001 2024-04-18T21:06:28.459 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.459 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.459 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:28.459 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643565+0000", 2024-04-18T21:06:28.459 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017238430999999999 2024-04-18T21:06:28.459 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.459 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.459 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:28.459 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643646+0000", 2024-04-18T21:06:28.459 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.1481000000000001e-05 2024-04-18T21:06:28.459 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.459 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.459 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:28.459 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643708+0000", 2024-04-18T21:06:28.460 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.2372000000000005e-05 2024-04-18T21:06:28.460 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:28.460 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:28.460 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:28.460 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.460 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.460 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:28.460 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:28.460 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 82.740743022999993, 2024-04-18T21:06:28.460 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026822450000000001, 2024-04-18T21:06:28.460 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:28.460 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:28.460 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:28.460 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:28.461 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.461 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:28.461 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:28.461 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:28.461 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.461 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.461 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:28.461 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:28.461 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:28.461 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.461 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.461 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:28.461 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619789+0000", 2024-04-18T21:06:28.461 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:06:28.461 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.461 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.462 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:28.462 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619797+0000", 2024-04-18T21:06:28.462 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.6899999999999992e-06 2024-04-18T21:06:28.462 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.462 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.462 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:28.462 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619816+0000", 2024-04-18T21:06:28.462 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9352999999999999e-05 2024-04-18T21:06:28.462 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.462 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.462 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:28.462 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619832+0000", 2024-04-18T21:06:28.462 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6013000000000001e-05 2024-04-18T21:06:28.462 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.463 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.463 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:28.463 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620528+0000", 2024-04-18T21:06:28.463 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00069565600000000001 2024-04-18T21:06:28.463 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.463 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.463 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:28.463 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620735+0000", 2024-04-18T21:06:28.463 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000207025 2024-04-18T21:06:28.463 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.463 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.463 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:28.463 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620912+0000", 2024-04-18T21:06:28.463 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017748199999999999 2024-04-18T21:06:28.464 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.464 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.464 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:28.464 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.625605+0000", 2024-04-18T21:06:28.464 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0046924439999999996 2024-04-18T21:06:28.464 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.464 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.464 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:28.464 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646349+0000", 2024-04-18T21:06:28.464 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.020744318000000001 2024-04-18T21:06:28.464 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.464 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.464 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:28.464 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646483+0000", 2024-04-18T21:06:28.465 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013428999999999999 2024-04-18T21:06:28.465 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.465 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.465 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:28.465 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646611+0000", 2024-04-18T21:06:28.465 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012710299999999999 2024-04-18T21:06:28.465 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:28.465 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:28.465 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:28.465 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.465 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.465 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:28.465 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:06:28.465 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 82.740072589999997, 2024-04-18T21:06:28.465 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023516516000000001, 2024-04-18T21:06:28.466 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:28.466 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:28.466 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:06:28.466 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:28.466 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.466 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:28.466 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:06:28.466 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:28.466 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.466 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.466 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:28.466 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:06:28.466 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:28.466 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.467 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.467 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:28.467 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620460+0000", 2024-04-18T21:06:28.467 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.787e-06 2024-04-18T21:06:28.467 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.467 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.467 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:28.467 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620470+0000", 2024-04-18T21:06:28.467 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.2560000000000008e-06 2024-04-18T21:06:28.467 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.467 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.467 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:28.467 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620496+0000", 2024-04-18T21:06:28.467 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.6205999999999999e-05 2024-04-18T21:06:28.467 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.468 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.468 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:28.468 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620517+0000", 2024-04-18T21:06:28.468 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1223e-05 2024-04-18T21:06:28.468 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.468 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.468 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:28.468 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624060+0000", 2024-04-18T21:06:28.468 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035434160000000002 2024-04-18T21:06:28.468 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.468 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.468 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:28.468 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624390+0000", 2024-04-18T21:06:28.468 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00033000500000000002 2024-04-18T21:06:28.468 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:28.469 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:28.469 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:28.469 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643975+0000", 2024-04-18T21:06:28.469 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019584622999999999 2024-04-18T21:06:28.469 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:28.469 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:28.469 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:28.469 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:28.469 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:28.469 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:28.469 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:06:28.471 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:28.472 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:28.471+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:28.572 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:28.570+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:28.603 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:06:28.603 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [], 2024-04-18T21:06:28.604 INFO:teuthology.orchestra.run.smithi150.stdout: "num_ops": 0 2024-04-18T21:06:28.604 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:06:28.617 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:28.664 INFO:teuthology.orchestra.run.smithi078.stderr:noscrub is unset 2024-04-18T21:06:28.670 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:06:28.670 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:06:28.672 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:28.674+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:28.700 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1: {} 2024-04-18T21:06:28.701 INFO:teuthology.orchestra.run.smithi078.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:06:28.733 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:06:28.733 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:28.735 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:28.735 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:28.749 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:28.793 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:28.795+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:28.867 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:28.867 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:28.874 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:28.874+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:28.881 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:28.975 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:28.975+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:29.013 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:29.013 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:29.027 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:29.076 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:29.075+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:29.149 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:29.149 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:29.166 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:29.209 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:29.210+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:29.279 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:29.278+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:29.283 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:29.283 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:29.297 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:29.379 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:29.379+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:29.429 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:29.429 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:29.443 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:29.480 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:29.478+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:29.504 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-18T21:06:29.504 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-18T21:06:29.565 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:29.565 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:29.581 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:29.581 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:29.582+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:29.682 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:29.682+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:29.702 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:29.702 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:29.717 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:29.783 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:29.782+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:29.851 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:29.851 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:29.867 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:29.884 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:29.886+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:29.985 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:29.982+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:29.987 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:29.987 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:30.002 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:30.086 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:30.086+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:30.119 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:30.119 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:30.133 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:30.186 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:30.186+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:30.263 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:30.264 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:30.278 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:30.287 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:30.286+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:30.390 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:30.390+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:30.395 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:30.395 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:30.409 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:30.491 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:30.490+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:30.530 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:30.530 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:30.546 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:30.592 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:30.590+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:30.670 INFO:teuthology.orchestra.run.smithi078.stderr:reweighted osd.0 to 1 (10000) 2024-04-18T21:06:30.678 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:30.678 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:30.687 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-18T21:06:30.692 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:30.693 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:30.691+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:30.694 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-18T21:06:30.755 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:06:30.792 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:30.790+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:30.816 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:30.816 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:30.830 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:30.893 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:30.894+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:30.986 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:06:30.986 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:06:30.994 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:30.995+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:31.002 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:31.003 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 20, 2024-04-18T21:06:31.003 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 600, 2024-04-18T21:06:31.003 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [ 2024-04-18T21:06:31.003 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.003 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:31.003 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:06:31.003 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 96.092165675999993, 2024-04-18T21:06:31.003 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.02518273, 2024-04-18T21:06:31.003 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:31.003 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:31.003 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:31.003 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:31.004 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:31.004 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:31.004 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 141 2024-04-18T21:06:31.004 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.004 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:31.004 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.004 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:31.004 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:06:31.004 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:31.004 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.004 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.004 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:31.004 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:06:31.004 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:31.005 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.005 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.005 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:31.005 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911562+0000", 2024-04-18T21:06:31.005 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9300000000000006e-07 2024-04-18T21:06:31.005 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.005 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.005 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:31.005 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911569+0000", 2024-04-18T21:06:31.005 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0169999999999999e-06 2024-04-18T21:06:31.005 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.005 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.005 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:31.005 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911582+0000", 2024-04-18T21:06:31.005 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.343e-05 2024-04-18T21:06:31.005 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.006 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.006 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.006 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911590+0000", 2024-04-18T21:06:31.006 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.413e-06 2024-04-18T21:06:31.006 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.006 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.006 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:31.006 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.933922+0000", 2024-04-18T21:06:31.006 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.022332093000000001 2024-04-18T21:06:31.006 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.006 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.006 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:31.006 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.934155+0000", 2024-04-18T21:06:31.006 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023378900000000001 2024-04-18T21:06:31.007 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.007 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.007 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:31.007 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.934514+0000", 2024-04-18T21:06:31.007 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00035859200000000003 2024-04-18T21:06:31.007 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.007 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.007 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:31.007 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.935973+0000", 2024-04-18T21:06:31.007 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001458705 2024-04-18T21:06:31.007 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.007 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.007 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:31.007 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936488+0000", 2024-04-18T21:06:31.008 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00051550000000000001 2024-04-18T21:06:31.008 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.008 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.008 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:31.008 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936636+0000", 2024-04-18T21:06:31.008 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014779800000000001 2024-04-18T21:06:31.008 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.008 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.008 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:31.008 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936743+0000", 2024-04-18T21:06:31.008 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010739999999999999 2024-04-18T21:06:31.008 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:31.008 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:31.008 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:31.008 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.009 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.009 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:31.009 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:31.009 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 95.974966702000003, 2024-04-18T21:06:31.009 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023654959999999999, 2024-04-18T21:06:31.009 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:31.009 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:31.009 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:31.009 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:31.009 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:31.009 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:31.009 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 163 2024-04-18T21:06:31.009 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.010 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:31.010 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.010 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:31.010 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:31.010 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:31.010 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.010 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.010 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:31.010 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:31.010 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:31.010 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.010 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.010 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:31.010 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:31.011 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0999999999999998e-07 2024-04-18T21:06:31.011 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.011 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.011 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:31.011 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028766+0000", 2024-04-18T21:06:31.011 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4700000000000001e-06 2024-04-18T21:06:31.011 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.011 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.011 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:31.011 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028775+0000", 2024-04-18T21:06:31.011 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.3190000000000001e-06 2024-04-18T21:06:31.011 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.011 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.011 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.011 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028782+0000", 2024-04-18T21:06:31.012 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.2300000000000002e-06 2024-04-18T21:06:31.012 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.012 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.012 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:31.012 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046667+0000", 2024-04-18T21:06:31.012 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017884356000000001 2024-04-18T21:06:31.012 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.012 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.012 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:31.012 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046788+0000", 2024-04-18T21:06:31.012 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012125000000000001 2024-04-18T21:06:31.012 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.012 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.013 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:31.013 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046982+0000", 2024-04-18T21:06:31.013 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019394 2024-04-18T21:06:31.013 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.013 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.013 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:31.013 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051969+0000", 2024-04-18T21:06:31.013 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0049868150000000003 2024-04-18T21:06:31.013 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.013 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.013 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:31.013 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052089+0000", 2024-04-18T21:06:31.013 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011993 2024-04-18T21:06:31.014 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.014 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.014 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:31.014 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052292+0000", 2024-04-18T21:06:31.014 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020345699999999999 2024-04-18T21:06:31.014 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.014 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.014 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:31.014 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052415+0000", 2024-04-18T21:06:31.014 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000122483 2024-04-18T21:06:31.014 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:31.014 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:31.014 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:31.014 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.015 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.015 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:31.015 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:31.015 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 95.974932469999999, 2024-04-18T21:06:31.015 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023864586, 2024-04-18T21:06:31.015 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:31.015 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:31.015 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:31.015 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:31.015 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:31.015 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:31.015 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 164 2024-04-18T21:06:31.015 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.016 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:31.016 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.016 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:31.016 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:31.016 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:31.016 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.016 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.016 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:31.016 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:31.016 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:31.016 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.016 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.016 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:31.016 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028795+0000", 2024-04-18T21:06:31.016 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7999999999999995e-07 2024-04-18T21:06:31.017 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.017 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.017 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:31.017 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028884+0000", 2024-04-18T21:06:31.017 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8997000000000002e-05 2024-04-18T21:06:31.017 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.017 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.017 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:31.017 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028895+0000", 2024-04-18T21:06:31.017 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1647e-05 2024-04-18T21:06:31.017 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.017 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.017 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.017 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028903+0000", 2024-04-18T21:06:31.018 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.909e-06 2024-04-18T21:06:31.018 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.018 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.018 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:31.018 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.047818+0000", 2024-04-18T21:06:31.018 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018914337 2024-04-18T21:06:31.018 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.018 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.018 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:31.018 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.048094+0000", 2024-04-18T21:06:31.018 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00027653500000000001 2024-04-18T21:06:31.018 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.018 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.018 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:31.019 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.048471+0000", 2024-04-18T21:06:31.019 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00037705799999999999 2024-04-18T21:06:31.019 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.019 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.019 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:31.019 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052516+0000", 2024-04-18T21:06:31.019 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0040452739999999997 2024-04-18T21:06:31.019 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.019 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.019 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:31.019 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052535+0000", 2024-04-18T21:06:31.019 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.84e-05 2024-04-18T21:06:31.019 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.019 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.020 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:31.020 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052603+0000", 2024-04-18T21:06:31.020 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.8095000000000004e-05 2024-04-18T21:06:31.020 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.020 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.020 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:31.020 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052659+0000", 2024-04-18T21:06:31.020 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5653999999999999e-05 2024-04-18T21:06:31.020 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:31.020 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:31.020 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:31.020 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.021 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.021 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:31.021 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:31.021 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 95.974809027000006, 2024-04-18T21:06:31.021 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024516458000000001, 2024-04-18T21:06:31.021 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:31.021 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:31.021 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:31.021 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:31.021 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:31.021 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:31.021 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 165 2024-04-18T21:06:31.021 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.021 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:31.021 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.021 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:31.022 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:31.022 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:31.022 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.022 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.022 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:31.022 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:31.022 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:31.022 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.022 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.022 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:31.022 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028918+0000", 2024-04-18T21:06:31.022 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8000000000000005e-07 2024-04-18T21:06:31.022 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.022 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.023 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:31.023 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028924+0000", 2024-04-18T21:06:31.023 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5659999999999997e-06 2024-04-18T21:06:31.023 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.023 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.023 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:31.023 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028933+0000", 2024-04-18T21:06:31.023 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.38e-06 2024-04-18T21:06:31.023 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.023 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.023 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.023 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028940+0000", 2024-04-18T21:06:31.023 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0060000000000003e-06 2024-04-18T21:06:31.023 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.023 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.024 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:31.024 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.050846+0000", 2024-04-18T21:06:31.024 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021906119000000002 2024-04-18T21:06:31.024 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.024 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.024 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:31.024 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051025+0000", 2024-04-18T21:06:31.024 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017850799999999999 2024-04-18T21:06:31.024 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.024 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.024 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:31.024 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051221+0000", 2024-04-18T21:06:31.024 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019608700000000001 2024-04-18T21:06:31.024 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.025 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.025 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:31.025 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052675+0000", 2024-04-18T21:06:31.025 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0014537899999999999 2024-04-18T21:06:31.025 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.025 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.025 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:31.025 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053311+0000", 2024-04-18T21:06:31.025 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00063613299999999999 2024-04-18T21:06:31.025 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.025 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.025 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:31.025 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053381+0000", 2024-04-18T21:06:31.026 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0074999999999996e-05 2024-04-18T21:06:31.026 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.026 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.026 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:31.026 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053434+0000", 2024-04-18T21:06:31.026 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3013999999999998e-05 2024-04-18T21:06:31.026 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:31.026 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:31.026 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:31.026 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.026 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.026 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:31.026 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:31.026 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 95.861503548000002, 2024-04-18T21:06:31.027 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023772793, 2024-04-18T21:06:31.027 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:31.027 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:31.027 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:31.027 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:31.027 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:31.027 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:31.027 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 187 2024-04-18T21:06:31.027 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.027 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:31.027 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.027 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:31.027 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:31.027 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:31.027 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.028 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.028 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:31.028 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:31.028 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:31.028 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.028 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.028 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:31.028 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142224+0000", 2024-04-18T21:06:31.028 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.47e-07 2024-04-18T21:06:31.028 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.028 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.028 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:31.028 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142233+0000", 2024-04-18T21:06:31.028 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0729999999999994e-06 2024-04-18T21:06:31.029 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.029 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.029 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:31.029 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142255+0000", 2024-04-18T21:06:31.029 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.2535999999999999e-05 2024-04-18T21:06:31.029 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.029 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.029 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.029 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142268+0000", 2024-04-18T21:06:31.029 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2686e-05 2024-04-18T21:06:31.029 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.029 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.029 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:31.029 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160497+0000", 2024-04-18T21:06:31.029 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018228779000000001 2024-04-18T21:06:31.030 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.030 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.030 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:31.030 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160634+0000", 2024-04-18T21:06:31.030 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000137315 2024-04-18T21:06:31.030 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.030 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.030 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:31.030 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160831+0000", 2024-04-18T21:06:31.030 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019683100000000001 2024-04-18T21:06:31.030 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.030 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.030 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:31.030 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165129+0000", 2024-04-18T21:06:31.031 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0042981299999999998 2024-04-18T21:06:31.031 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.031 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.031 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:31.031 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165776+0000", 2024-04-18T21:06:31.031 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00064702900000000003 2024-04-18T21:06:31.031 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.031 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.031 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:31.031 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165921+0000", 2024-04-18T21:06:31.031 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014506 2024-04-18T21:06:31.031 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.032 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.032 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:31.032 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165996+0000", 2024-04-18T21:06:31.032 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.4406999999999994e-05 2024-04-18T21:06:31.032 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:31.032 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:31.032 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:31.032 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.032 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.032 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:31.032 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:31.032 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 95.861442949999997, 2024-04-18T21:06:31.032 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026802157, 2024-04-18T21:06:31.032 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:31.033 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:31.033 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:31.033 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:31.033 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:31.033 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:31.033 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 188 2024-04-18T21:06:31.033 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.033 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:31.033 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.033 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:31.033 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:31.033 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:31.033 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.033 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.034 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:31.034 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:31.034 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:31.034 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.034 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.034 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:31.034 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142284+0000", 2024-04-18T21:06:31.034 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4e-07 2024-04-18T21:06:31.034 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.034 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.034 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:31.034 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142374+0000", 2024-04-18T21:06:31.034 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0099999999999995e-05 2024-04-18T21:06:31.035 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.035 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.035 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:31.035 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142386+0000", 2024-04-18T21:06:31.035 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1770000000000001e-05 2024-04-18T21:06:31.035 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.035 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.035 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.035 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142394+0000", 2024-04-18T21:06:31.035 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.2130000000000008e-06 2024-04-18T21:06:31.035 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.035 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.035 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:31.035 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.161743+0000", 2024-04-18T21:06:31.035 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019348644000000002 2024-04-18T21:06:31.036 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.036 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.036 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:31.036 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.161865+0000", 2024-04-18T21:06:31.036 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012210899999999999 2024-04-18T21:06:31.036 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.036 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.036 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:31.036 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.162055+0000", 2024-04-18T21:06:31.036 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000189994 2024-04-18T21:06:31.036 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.036 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.036 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:31.036 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165735+0000", 2024-04-18T21:06:31.036 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0036803270000000002 2024-04-18T21:06:31.036 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.037 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.037 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:31.037 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.168911+0000", 2024-04-18T21:06:31.037 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0031753689999999999 2024-04-18T21:06:31.037 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.037 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.037 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:31.037 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169012+0000", 2024-04-18T21:06:31.037 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010157699999999999 2024-04-18T21:06:31.037 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.037 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.037 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:31.037 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169086+0000", 2024-04-18T21:06:31.037 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3213999999999994e-05 2024-04-18T21:06:31.037 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:31.037 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:31.038 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:31.038 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.038 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.038 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:31.038 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:31.038 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 95.861317643999996, 2024-04-18T21:06:31.038 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026811423000000001, 2024-04-18T21:06:31.038 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:31.038 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:31.038 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:31.038 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:31.038 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:31.038 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:31.038 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 189 2024-04-18T21:06:31.039 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.039 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:31.039 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.039 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:31.039 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:31.039 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:31.039 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.039 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.039 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:31.039 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:31.039 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:31.039 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.039 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.039 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:31.039 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142410+0000", 2024-04-18T21:06:31.040 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:06:31.040 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.040 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.040 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:31.040 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142415+0000", 2024-04-18T21:06:31.040 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.7939999999999999e-06 2024-04-18T21:06:31.040 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.040 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.040 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:31.040 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142470+0000", 2024-04-18T21:06:31.040 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4537999999999999e-05 2024-04-18T21:06:31.040 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.040 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.040 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.040 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142481+0000", 2024-04-18T21:06:31.041 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0966e-05 2024-04-18T21:06:31.041 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.041 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.041 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:31.041 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.163493+0000", 2024-04-18T21:06:31.041 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021012444000000002 2024-04-18T21:06:31.041 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.041 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.041 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:31.041 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.163727+0000", 2024-04-18T21:06:31.041 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000233339 2024-04-18T21:06:31.041 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.041 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.041 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:31.041 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.164102+0000", 2024-04-18T21:06:31.041 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000374872 2024-04-18T21:06:31.042 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.042 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.042 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:31.042 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.166528+0000", 2024-04-18T21:06:31.042 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0024258729999999998 2024-04-18T21:06:31.042 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.042 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.042 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:31.042 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169101+0000", 2024-04-18T21:06:31.042 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0025737680000000001 2024-04-18T21:06:31.042 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.042 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.042 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:31.042 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169171+0000", 2024-04-18T21:06:31.042 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0148000000000007e-05 2024-04-18T21:06:31.042 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.043 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.043 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:31.043 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169220+0000", 2024-04-18T21:06:31.043 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8767999999999998e-05 2024-04-18T21:06:31.043 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:31.043 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:31.043 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:31.043 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.043 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.043 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:31.043 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:31.043 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 85.387745092000003, 2024-04-18T21:06:31.043 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024082777999999999, 2024-04-18T21:06:31.044 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:31.044 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:31.044 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:31.044 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:31.044 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.044 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:31.044 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:31.044 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:31.044 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.044 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.044 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:31.044 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:31.044 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:31.044 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.044 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.044 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:31.045 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615984+0000", 2024-04-18T21:06:31.045 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.9869999999999999e-06 2024-04-18T21:06:31.045 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.045 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.045 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:31.045 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615999+0000", 2024-04-18T21:06:31.045 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4646e-05 2024-04-18T21:06:31.045 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.045 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.045 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:31.045 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616028+0000", 2024-04-18T21:06:31.045 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8952999999999999e-05 2024-04-18T21:06:31.045 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.045 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.045 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.046 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616052+0000", 2024-04-18T21:06:31.046 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.3941999999999999e-05 2024-04-18T21:06:31.046 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.046 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.046 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:31.046 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618010+0000", 2024-04-18T21:06:31.046 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0019581780000000001 2024-04-18T21:06:31.046 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.046 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.046 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:31.046 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618322+0000", 2024-04-18T21:06:31.046 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00031158899999999997 2024-04-18T21:06:31.046 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.046 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.046 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:31.046 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618587+0000", 2024-04-18T21:06:31.047 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00026495700000000002 2024-04-18T21:06:31.047 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.047 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.047 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:31.047 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629262+0000", 2024-04-18T21:06:31.047 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010675877 2024-04-18T21:06:31.047 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.047 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.047 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:31.047 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.639773+0000", 2024-04-18T21:06:31.047 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0105109 2024-04-18T21:06:31.047 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.047 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.047 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:31.047 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.639926+0000", 2024-04-18T21:06:31.047 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000152349 2024-04-18T21:06:31.048 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.048 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.048 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:31.048 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640064+0000", 2024-04-18T21:06:31.048 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0001384 2024-04-18T21:06:31.048 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:31.048 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:31.048 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:31.048 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.048 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.048 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:31.048 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:31.048 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 85.387632417999995, 2024-04-18T21:06:31.049 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030215005999999999, 2024-04-18T21:06:31.049 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:31.049 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:31.049 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:31.049 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:31.049 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.049 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:31.049 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:31.049 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:31.049 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.049 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.049 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:31.049 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:31.049 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:31.049 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.050 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.050 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:31.050 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616095+0000", 2024-04-18T21:06:31.050 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.446e-06 2024-04-18T21:06:31.050 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.050 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.050 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:31.050 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616104+0000", 2024-04-18T21:06:31.050 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6200000000000005e-06 2024-04-18T21:06:31.050 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.050 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.050 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:31.050 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616132+0000", 2024-04-18T21:06:31.051 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7668999999999999e-05 2024-04-18T21:06:31.051 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.051 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.051 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.051 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616149+0000", 2024-04-18T21:06:31.051 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7047000000000001e-05 2024-04-18T21:06:31.051 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.051 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.051 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:31.051 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619287+0000", 2024-04-18T21:06:31.051 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0031381450000000002 2024-04-18T21:06:31.051 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.051 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.051 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:31.051 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619503+0000", 2024-04-18T21:06:31.052 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000216522 2024-04-18T21:06:31.052 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.052 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.052 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:31.052 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619930+0000", 2024-04-18T21:06:31.052 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00042604900000000001 2024-04-18T21:06:31.052 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.052 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.052 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:31.052 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629281+0000", 2024-04-18T21:06:31.052 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0093512230000000005 2024-04-18T21:06:31.052 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.052 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.052 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:31.052 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646022+0000", 2024-04-18T21:06:31.052 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016741156 2024-04-18T21:06:31.053 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.053 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.053 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:31.053 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646198+0000", 2024-04-18T21:06:31.053 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000176009 2024-04-18T21:06:31.053 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.053 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.053 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:31.053 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646309+0000", 2024-04-18T21:06:31.053 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011112000000000001 2024-04-18T21:06:31.053 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:31.053 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:31.054 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:31.054 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.054 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.054 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:31.054 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:31.054 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 85.387547593999997, 2024-04-18T21:06:31.054 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030501176000000001, 2024-04-18T21:06:31.054 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:31.054 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:31.054 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:31.054 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:31.054 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.054 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:31.055 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:31.055 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:31.055 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.055 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.055 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:31.055 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:31.055 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:31.055 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.055 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.055 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:31.055 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616180+0000", 2024-04-18T21:06:31.055 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1000000000000001e-06 2024-04-18T21:06:31.055 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.055 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.056 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:31.056 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616188+0000", 2024-04-18T21:06:31.056 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4069999999999993e-06 2024-04-18T21:06:31.056 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.056 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.056 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:31.056 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616207+0000", 2024-04-18T21:06:31.056 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8335999999999999e-05 2024-04-18T21:06:31.056 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.056 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.056 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.056 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616225+0000", 2024-04-18T21:06:31.056 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8652999999999999e-05 2024-04-18T21:06:31.056 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.057 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.057 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:31.057 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620977+0000", 2024-04-18T21:06:31.057 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047512220000000003 2024-04-18T21:06:31.057 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.057 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.057 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:31.057 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621279+0000", 2024-04-18T21:06:31.057 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000302646 2024-04-18T21:06:31.057 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.057 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.057 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:31.058 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621584+0000", 2024-04-18T21:06:31.058 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000305142 2024-04-18T21:06:31.058 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.058 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.058 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:31.058 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629352+0000", 2024-04-18T21:06:31.058 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0077673689999999997 2024-04-18T21:06:31.058 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.058 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.058 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:31.058 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646480+0000", 2024-04-18T21:06:31.058 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017128259 2024-04-18T21:06:31.059 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.059 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.059 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:31.059 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646591+0000", 2024-04-18T21:06:31.059 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011113899999999999 2024-04-18T21:06:31.059 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.059 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.059 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:31.059 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646680+0000", 2024-04-18T21:06:31.059 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8902999999999999e-05 2024-04-18T21:06:31.059 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:31.059 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:31.059 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:31.059 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.059 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.059 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:31.060 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:31.060 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 85.387481094999998, 2024-04-18T21:06:31.060 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030779760999999999, 2024-04-18T21:06:31.060 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:31.060 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:31.060 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:31.060 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:31.060 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.060 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:31.060 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:31.060 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:31.060 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.060 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.060 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:31.060 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:31.061 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:31.061 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.061 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.061 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:31.061 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616246+0000", 2024-04-18T21:06:31.061 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0499999999999999e-06 2024-04-18T21:06:31.061 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.061 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.061 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:31.061 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616253+0000", 2024-04-18T21:06:31.061 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.5989999999999998e-06 2024-04-18T21:06:31.061 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.061 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.061 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:31.061 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616273+0000", 2024-04-18T21:06:31.062 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9916999999999999e-05 2024-04-18T21:06:31.062 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.062 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.062 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.062 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616287+0000", 2024-04-18T21:06:31.062 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3669000000000001e-05 2024-04-18T21:06:31.062 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.062 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.062 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:31.062 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622203+0000", 2024-04-18T21:06:31.062 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.005916737 2024-04-18T21:06:31.062 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.062 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.062 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:31.063 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622379+0000", 2024-04-18T21:06:31.063 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000175596 2024-04-18T21:06:31.063 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.063 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.063 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:31.063 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622707+0000", 2024-04-18T21:06:31.063 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00032784600000000002 2024-04-18T21:06:31.063 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.063 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.063 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:31.063 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629366+0000", 2024-04-18T21:06:31.063 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0066593279999999999 2024-04-18T21:06:31.063 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.063 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.063 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:31.064 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646813+0000", 2024-04-18T21:06:31.064 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017447059000000001 2024-04-18T21:06:31.064 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.064 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.064 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:31.064 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646946+0000", 2024-04-18T21:06:31.064 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013301200000000001 2024-04-18T21:06:31.064 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.064 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.064 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:31.064 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647025+0000", 2024-04-18T21:06:31.064 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8948000000000004e-05 2024-04-18T21:06:31.064 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:31.064 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:31.064 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:31.065 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.065 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.065 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:31.065 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:31.065 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 85.387397277000005, 2024-04-18T21:06:31.065 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.031512165000000002, 2024-04-18T21:06:31.065 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:31.065 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:31.065 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:31.065 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:31.065 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.065 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:31.065 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:31.065 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:31.066 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.066 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.066 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:31.066 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:31.066 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:31.066 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.066 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.066 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:31.066 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616330+0000", 2024-04-18T21:06:31.066 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.15e-06 2024-04-18T21:06:31.066 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.066 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.066 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:31.066 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616337+0000", 2024-04-18T21:06:31.067 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.1289999999999998e-06 2024-04-18T21:06:31.067 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.067 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.067 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:31.067 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616447+0000", 2024-04-18T21:06:31.067 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109561 2024-04-18T21:06:31.067 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.067 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.067 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.067 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616496+0000", 2024-04-18T21:06:31.067 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8591999999999998e-05 2024-04-18T21:06:31.067 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.067 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.067 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:31.067 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.623786+0000", 2024-04-18T21:06:31.068 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0072906799999999999 2024-04-18T21:06:31.068 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.068 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.068 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:31.068 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.623973+0000", 2024-04-18T21:06:31.068 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018717199999999999 2024-04-18T21:06:31.068 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.068 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.068 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:31.068 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624260+0000", 2024-04-18T21:06:31.068 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00028630600000000001 2024-04-18T21:06:31.068 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.068 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.069 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:31.069 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629381+0000", 2024-04-18T21:06:31.069 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0051211340000000003 2024-04-18T21:06:31.069 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.069 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.069 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:31.069 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647631+0000", 2024-04-18T21:06:31.069 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018249771000000001 2024-04-18T21:06:31.069 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.069 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.069 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:31.069 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647761+0000", 2024-04-18T21:06:31.069 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013037300000000001 2024-04-18T21:06:31.069 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.070 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.070 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:31.070 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647841+0000", 2024-04-18T21:06:31.070 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.0296999999999994e-05 2024-04-18T21:06:31.070 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:31.070 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:31.070 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:31.070 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.070 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.070 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:31.070 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:31.070 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 85.387191793, 2024-04-18T21:06:31.071 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043251955000000002, 2024-04-18T21:06:31.071 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:31.071 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:31.071 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:31.071 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:31.071 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.071 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:31.071 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:31.071 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:31.071 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.071 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.071 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:31.071 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:31.071 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:31.071 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.072 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.072 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:31.072 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616536+0000", 2024-04-18T21:06:31.072 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2869999999999999e-06 2024-04-18T21:06:31.072 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.072 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.072 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:31.072 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616572+0000", 2024-04-18T21:06:31.072 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.6261999999999999e-05 2024-04-18T21:06:31.072 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.072 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.072 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:31.072 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616593+0000", 2024-04-18T21:06:31.073 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1310000000000001e-05 2024-04-18T21:06:31.073 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.073 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.073 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.073 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616614+0000", 2024-04-18T21:06:31.073 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.0936000000000001e-05 2024-04-18T21:06:31.073 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.073 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.073 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:31.073 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629501+0000", 2024-04-18T21:06:31.073 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.012886819000000001 2024-04-18T21:06:31.073 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.073 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.073 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:31.073 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629696+0000", 2024-04-18T21:06:31.073 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019485499999999999 2024-04-18T21:06:31.074 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.074 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.074 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:31.074 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629940+0000", 2024-04-18T21:06:31.074 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00024386399999999999 2024-04-18T21:06:31.074 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.074 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.074 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:31.074 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640100+0000", 2024-04-18T21:06:31.074 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010159645 2024-04-18T21:06:31.074 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.074 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.074 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:31.074 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659516+0000", 2024-04-18T21:06:31.074 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019416563000000001 2024-04-18T21:06:31.075 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.075 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.075 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:31.075 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659684+0000", 2024-04-18T21:06:31.075 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016750900000000001 2024-04-18T21:06:31.075 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.075 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.075 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:31.075 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659787+0000", 2024-04-18T21:06:31.075 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000102905 2024-04-18T21:06:31.075 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:31.075 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:31.075 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:31.075 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.076 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.076 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:31.076 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:31.076 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 85.387086671000006, 2024-04-18T21:06:31.076 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043581898000000001, 2024-04-18T21:06:31.076 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:31.076 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:31.076 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:31.076 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:31.076 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.076 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:31.076 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:31.076 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:31.076 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.077 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.077 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:31.077 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:31.077 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:31.077 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.077 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.077 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:31.077 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616641+0000", 2024-04-18T21:06:31.077 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:06:31.077 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.077 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.077 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:31.077 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616648+0000", 2024-04-18T21:06:31.077 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3860000000000001e-06 2024-04-18T21:06:31.077 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.077 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.078 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:31.078 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616666+0000", 2024-04-18T21:06:31.078 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7583000000000001e-05 2024-04-18T21:06:31.078 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.078 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.078 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.078 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616679+0000", 2024-04-18T21:06:31.078 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3322999999999999e-05 2024-04-18T21:06:31.078 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.078 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.078 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:31.078 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630373+0000", 2024-04-18T21:06:31.078 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013694207999999999 2024-04-18T21:06:31.078 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.078 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.078 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:31.079 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630545+0000", 2024-04-18T21:06:31.079 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000171683 2024-04-18T21:06:31.079 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.079 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.079 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:31.079 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630728+0000", 2024-04-18T21:06:31.079 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000182599 2024-04-18T21:06:31.079 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.079 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.079 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:31.079 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640600+0000", 2024-04-18T21:06:31.079 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0098726119999999994 2024-04-18T21:06:31.079 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.079 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.079 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:31.079 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659927+0000", 2024-04-18T21:06:31.080 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019326724999999999 2024-04-18T21:06:31.080 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.080 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.080 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:31.080 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660112+0000", 2024-04-18T21:06:31.080 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000185203 2024-04-18T21:06:31.080 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.080 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.080 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:31.080 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660222+0000", 2024-04-18T21:06:31.080 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109343 2024-04-18T21:06:31.080 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:31.080 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:31.080 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:31.080 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.080 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.081 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:31.081 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:31.081 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 85.386221312999993, 2024-04-18T21:06:31.081 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043121310000000003, 2024-04-18T21:06:31.081 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:31.081 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:31.081 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:31.081 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:31.081 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.081 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:31.081 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:31.081 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:31.081 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.082 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.082 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:31.082 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:31.082 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:31.082 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.082 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.082 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:31.082 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617506+0000", 2024-04-18T21:06:31.082 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9999999999999995e-07 2024-04-18T21:06:31.082 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.082 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.082 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:31.082 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617513+0000", 2024-04-18T21:06:31.082 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.9700000000000002e-06 2024-04-18T21:06:31.082 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.083 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.083 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:31.083 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617531+0000", 2024-04-18T21:06:31.083 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8105999999999999e-05 2024-04-18T21:06:31.083 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.083 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.083 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.083 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617545+0000", 2024-04-18T21:06:31.083 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3703000000000001e-05 2024-04-18T21:06:31.083 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.083 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.083 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:31.083 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632129+0000", 2024-04-18T21:06:31.084 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.014584135999999999 2024-04-18T21:06:31.084 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.084 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.084 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:31.084 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632361+0000", 2024-04-18T21:06:31.084 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023171800000000001 2024-04-18T21:06:31.084 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.084 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.084 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:31.084 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632804+0000", 2024-04-18T21:06:31.084 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000443549 2024-04-18T21:06:31.084 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.084 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.084 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:31.085 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646340+0000", 2024-04-18T21:06:31.085 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013535902000000001 2024-04-18T21:06:31.085 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.085 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.085 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:31.085 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660363+0000", 2024-04-18T21:06:31.085 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01402318 2024-04-18T21:06:31.085 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.085 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.085 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:31.085 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660523+0000", 2024-04-18T21:06:31.085 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00015989899999999999 2024-04-18T21:06:31.085 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.085 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.085 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:31.086 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660626+0000", 2024-04-18T21:06:31.086 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010314699999999999 2024-04-18T21:06:31.086 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:31.086 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:31.086 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:31.086 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.086 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.086 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:31.086 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:31.086 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 85.386081619999999, 2024-04-18T21:06:31.086 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024927483, 2024-04-18T21:06:31.086 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:31.086 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:31.086 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:31.087 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:31.087 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.087 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:31.087 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:31.087 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:31.087 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.087 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.087 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:31.087 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:31.087 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:31.087 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.087 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.087 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:31.087 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617646+0000", 2024-04-18T21:06:31.087 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3030000000000001e-06 2024-04-18T21:06:31.087 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.088 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.088 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:31.088 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617653+0000", 2024-04-18T21:06:31.088 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7530000000000004e-06 2024-04-18T21:06:31.088 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.088 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.088 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:31.088 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617673+0000", 2024-04-18T21:06:31.088 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9967e-05 2024-04-18T21:06:31.088 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.088 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.088 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.088 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617688+0000", 2024-04-18T21:06:31.088 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5153e-05 2024-04-18T21:06:31.088 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.088 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.089 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:31.089 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619244+0000", 2024-04-18T21:06:31.089 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001555531 2024-04-18T21:06:31.089 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.089 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.089 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:31.089 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619361+0000", 2024-04-18T21:06:31.089 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011784400000000001 2024-04-18T21:06:31.089 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.089 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.089 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:31.089 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619604+0000", 2024-04-18T21:06:31.089 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000243007 2024-04-18T21:06:31.089 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.090 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.090 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:31.090 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.625480+0000", 2024-04-18T21:06:31.090 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0058759349999999997 2024-04-18T21:06:31.090 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.090 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.090 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:31.090 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642342+0000", 2024-04-18T21:06:31.090 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016861373999999998 2024-04-18T21:06:31.090 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.090 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.090 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:31.090 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642484+0000", 2024-04-18T21:06:31.091 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000142423 2024-04-18T21:06:31.091 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.091 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.091 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:31.091 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642572+0000", 2024-04-18T21:06:31.091 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8193000000000001e-05 2024-04-18T21:06:31.091 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:31.091 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:31.091 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:31.091 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.091 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.091 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:31.091 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:31.091 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 85.385800117000002, 2024-04-18T21:06:31.092 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024956974999999999, 2024-04-18T21:06:31.092 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:31.092 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:31.092 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:31.092 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:31.092 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.092 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:31.092 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:31.092 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:31.092 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.092 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.092 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:31.092 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:31.092 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:31.093 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.093 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.093 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:31.093 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617928+0000", 2024-04-18T21:06:31.093 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5430000000000001e-06 2024-04-18T21:06:31.093 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.093 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.093 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:31.093 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617937+0000", 2024-04-18T21:06:31.093 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6629999999999999e-06 2024-04-18T21:06:31.093 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.093 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.093 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:31.093 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617955+0000", 2024-04-18T21:06:31.093 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8749999999999998e-05 2024-04-18T21:06:31.093 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.094 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.094 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.094 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617971+0000", 2024-04-18T21:06:31.094 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.605e-05 2024-04-18T21:06:31.094 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.094 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.094 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:31.094 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621019+0000", 2024-04-18T21:06:31.094 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0030472369999999999 2024-04-18T21:06:31.094 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.094 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.094 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:31.094 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621249+0000", 2024-04-18T21:06:31.094 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000230075 2024-04-18T21:06:31.094 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.095 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.095 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:31.095 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621450+0000", 2024-04-18T21:06:31.095 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020166499999999999 2024-04-18T21:06:31.095 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.095 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.095 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:31.095 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.626233+0000", 2024-04-18T21:06:31.095 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047827390000000003 2024-04-18T21:06:31.095 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.095 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.095 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:31.095 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642693+0000", 2024-04-18T21:06:31.095 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01645961 2024-04-18T21:06:31.095 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.096 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.096 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:31.096 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642798+0000", 2024-04-18T21:06:31.096 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010559499999999999 2024-04-18T21:06:31.096 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.096 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.096 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:31.096 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642883+0000", 2024-04-18T21:06:31.096 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5048000000000003e-05 2024-04-18T21:06:31.096 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:31.096 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:31.096 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:31.096 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.096 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.096 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:31.097 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:31.097 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 85.384104488999995, 2024-04-18T21:06:31.097 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024086478000000001, 2024-04-18T21:06:31.097 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:31.097 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:31.097 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:31.097 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:31.097 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.097 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:31.097 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:31.097 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:31.097 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.097 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.097 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:31.097 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:31.097 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:31.098 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.098 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.098 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:31.098 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619624+0000", 2024-04-18T21:06:31.098 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.75e-06 2024-04-18T21:06:31.098 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.098 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.098 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:31.098 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619637+0000", 2024-04-18T21:06:31.098 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3540000000000001e-05 2024-04-18T21:06:31.098 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.098 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.098 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:31.098 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619666+0000", 2024-04-18T21:06:31.098 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8685999999999999e-05 2024-04-18T21:06:31.099 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.099 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.099 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.099 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619685+0000", 2024-04-18T21:06:31.099 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8681999999999998e-05 2024-04-18T21:06:31.099 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.099 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.099 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:31.099 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622275+0000", 2024-04-18T21:06:31.099 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0025899260000000002 2024-04-18T21:06:31.099 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.099 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.099 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:31.099 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622572+0000", 2024-04-18T21:06:31.100 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00029722 2024-04-18T21:06:31.100 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.100 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.100 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:31.100 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622752+0000", 2024-04-18T21:06:31.100 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018065900000000001 2024-04-18T21:06:31.100 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.100 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.100 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:31.100 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.626326+0000", 2024-04-18T21:06:31.100 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035737310000000001 2024-04-18T21:06:31.100 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.100 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.100 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:31.101 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643565+0000", 2024-04-18T21:06:31.101 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017238430999999999 2024-04-18T21:06:31.101 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.101 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.101 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:31.101 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643646+0000", 2024-04-18T21:06:31.101 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.1481000000000001e-05 2024-04-18T21:06:31.101 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.101 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.101 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:31.101 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643708+0000", 2024-04-18T21:06:31.101 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.2372000000000005e-05 2024-04-18T21:06:31.101 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:31.101 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:31.101 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:31.102 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.102 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.102 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:31.102 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:31.102 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 85.383938336, 2024-04-18T21:06:31.102 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026822450000000001, 2024-04-18T21:06:31.102 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:31.102 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:31.102 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:31.102 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:31.102 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.102 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:31.102 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:31.103 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:31.103 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.103 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.103 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:31.103 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:31.103 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:31.103 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.103 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.103 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:31.103 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619789+0000", 2024-04-18T21:06:31.103 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:06:31.103 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.103 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.103 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:31.104 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619797+0000", 2024-04-18T21:06:31.104 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.6899999999999992e-06 2024-04-18T21:06:31.104 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.104 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.104 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:31.104 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619816+0000", 2024-04-18T21:06:31.104 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9352999999999999e-05 2024-04-18T21:06:31.104 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.104 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.104 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.104 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619832+0000", 2024-04-18T21:06:31.104 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6013000000000001e-05 2024-04-18T21:06:31.104 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.104 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.104 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:31.105 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620528+0000", 2024-04-18T21:06:31.105 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00069565600000000001 2024-04-18T21:06:31.105 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.105 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.105 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:31.105 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620735+0000", 2024-04-18T21:06:31.105 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000207025 2024-04-18T21:06:31.105 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.105 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.105 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:31.105 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620912+0000", 2024-04-18T21:06:31.105 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017748199999999999 2024-04-18T21:06:31.105 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.105 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.105 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:31.105 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.625605+0000", 2024-04-18T21:06:31.106 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0046924439999999996 2024-04-18T21:06:31.106 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.106 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.106 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:31.106 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646349+0000", 2024-04-18T21:06:31.106 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.020744318000000001 2024-04-18T21:06:31.106 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.106 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.106 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:31.106 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646483+0000", 2024-04-18T21:06:31.106 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013428999999999999 2024-04-18T21:06:31.106 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.106 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.106 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:31.106 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646611+0000", 2024-04-18T21:06:31.107 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012710299999999999 2024-04-18T21:06:31.107 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:31.107 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:31.107 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:31.107 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.107 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.107 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:31.107 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:06:31.107 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 85.383267903000004, 2024-04-18T21:06:31.107 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023516516000000001, 2024-04-18T21:06:31.107 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:31.107 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:31.107 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:06:31.107 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:31.107 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.107 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:31.108 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:06:31.108 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:31.108 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.108 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.108 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:31.108 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:06:31.108 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:31.108 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.108 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.108 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:31.108 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620460+0000", 2024-04-18T21:06:31.109 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.787e-06 2024-04-18T21:06:31.109 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.109 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.109 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:31.109 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620470+0000", 2024-04-18T21:06:31.109 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.2560000000000008e-06 2024-04-18T21:06:31.109 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.109 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.109 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:31.109 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620496+0000", 2024-04-18T21:06:31.109 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.6205999999999999e-05 2024-04-18T21:06:31.109 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.109 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.110 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.110 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620517+0000", 2024-04-18T21:06:31.110 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1223e-05 2024-04-18T21:06:31.110 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.110 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.110 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:31.110 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624060+0000", 2024-04-18T21:06:31.110 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035434160000000002 2024-04-18T21:06:31.110 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.110 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.110 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:31.110 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624390+0000", 2024-04-18T21:06:31.111 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00033000500000000002 2024-04-18T21:06:31.111 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:31.111 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:31.111 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:31.111 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643975+0000", 2024-04-18T21:06:31.111 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019584622999999999 2024-04-18T21:06:31.111 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:31.111 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:31.111 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:31.111 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:31.111 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:31.111 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:31.113 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1: {} 2024-04-18T21:06:31.113 INFO:teuthology.orchestra.run.smithi078.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:06:31.114 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:06:31.114 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:31.114 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:31.110+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:31.115 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:31.214 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:31.214+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:31.246 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:06:31.246 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [], 2024-04-18T21:06:31.246 INFO:teuthology.orchestra.run.smithi150.stdout: "num_ops": 0 2024-04-18T21:06:31.246 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:06:31.260 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:31.314 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:31.315+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:31.381 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:06:31.382 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [], 2024-04-18T21:06:31.382 INFO:teuthology.orchestra.run.smithi150.stdout: "complaint_time": 30, 2024-04-18T21:06:31.382 INFO:teuthology.orchestra.run.smithi150.stdout: "num_blocked_ops": 0 2024-04-18T21:06:31.382 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:06:31.397 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:31.415 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:31.418+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:31.516 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:31.518+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:31.560 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:06:31.561 INFO:teuthology.orchestra.run.smithi150.stdout: "size": 20, 2024-04-18T21:06:31.561 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 600, 2024-04-18T21:06:31.561 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [ 2024-04-18T21:06:31.561 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.561 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-18T21:06:31.561 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:06:31.561 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 96.755927301, 2024-04-18T21:06:31.561 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0093051590000000003, 2024-04-18T21:06:31.561 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:31.561 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:31.561 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:31.561 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:31.561 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.561 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:31.562 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:06:31.562 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:31.562 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.562 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.562 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:31.562 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:06:31.562 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:31.562 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.562 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.562 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:31.562 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804851+0000", 2024-04-18T21:06:31.562 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7039999999999999e-06 2024-04-18T21:06:31.562 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.563 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.563 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:31.563 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804864+0000", 2024-04-18T21:06:31.563 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.276e-05 2024-04-18T21:06:31.563 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.563 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.563 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:31.563 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804895+0000", 2024-04-18T21:06:31.563 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.1204999999999997e-05 2024-04-18T21:06:31.563 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.563 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.563 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.563 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804908+0000", 2024-04-18T21:06:31.563 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3317e-05 2024-04-18T21:06:31.563 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.563 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.564 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:31.564 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805131+0000", 2024-04-18T21:06:31.564 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00022246700000000001 2024-04-18T21:06:31.564 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.564 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.564 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:31.564 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805171+0000", 2024-04-18T21:06:31.564 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.0164999999999999e-05 2024-04-18T21:06:31.564 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.564 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.564 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:31.564 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814086+0000", 2024-04-18T21:06:31.564 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0089155329999999998 2024-04-18T21:06:31.564 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.564 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.565 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:31.565 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814154+0000", 2024-04-18T21:06:31.565 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.8008000000000003e-05 2024-04-18T21:06:31.565 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:31.565 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:31.565 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:31.565 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.565 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.565 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-18T21:06:31.565 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:06:31.565 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 96.755162107999993, 2024-04-18T21:06:31.565 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0086469770000000001, 2024-04-18T21:06:31.565 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:31.565 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:31.565 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:31.566 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:31.566 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.566 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:31.566 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:06:31.566 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:31.566 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.566 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.566 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:31.566 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:06:31.566 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:31.566 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.566 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.566 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:31.566 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805616+0000", 2024-04-18T21:06:31.566 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7799999999999999e-06 2024-04-18T21:06:31.567 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.567 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.567 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:31.567 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805707+0000", 2024-04-18T21:06:31.567 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0917999999999999e-05 2024-04-18T21:06:31.567 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.567 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.567 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:31.567 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805739+0000", 2024-04-18T21:06:31.567 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.2512000000000003e-05 2024-04-18T21:06:31.567 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.567 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.567 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.567 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805763+0000", 2024-04-18T21:06:31.567 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3266000000000001e-05 2024-04-18T21:06:31.567 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.568 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.568 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:31.568 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.806024+0000", 2024-04-18T21:06:31.568 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000261716 2024-04-18T21:06:31.568 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.568 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.568 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:31.568 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.806073+0000", 2024-04-18T21:06:31.568 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.8844999999999997e-05 2024-04-18T21:06:31.568 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.568 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.568 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:31.568 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814162+0000", 2024-04-18T21:06:31.568 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0080882860000000001 2024-04-18T21:06:31.568 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.568 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.569 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:31.569 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814261+0000", 2024-04-18T21:06:31.569 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.9654000000000005e-05 2024-04-18T21:06:31.569 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:31.569 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:31.569 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:31.569 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.569 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.569 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'64)", 2024-04-18T21:06:31.569 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:06:31.569 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 96.753391063999999, 2024-04-18T21:06:31.569 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0089721509999999994, 2024-04-18T21:06:31.569 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:31.569 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:31.569 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:31.570 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:31.570 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.570 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:31.570 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:06:31.570 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:31.570 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.570 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.570 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:31.570 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:06:31.570 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:31.570 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.570 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.570 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:31.570 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807387+0000", 2024-04-18T21:06:31.571 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.0329999999999998e-06 2024-04-18T21:06:31.571 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.571 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.571 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:31.571 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807443+0000", 2024-04-18T21:06:31.571 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.5376e-05 2024-04-18T21:06:31.571 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.571 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.571 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:31.571 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807467+0000", 2024-04-18T21:06:31.571 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.4621999999999999e-05 2024-04-18T21:06:31.571 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.571 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.571 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.571 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807482+0000", 2024-04-18T21:06:31.571 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.436e-05 2024-04-18T21:06:31.572 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.572 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.572 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:31.572 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.809243+0000", 2024-04-18T21:06:31.572 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001761725 2024-04-18T21:06:31.572 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.572 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.572 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:31.572 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.809295+0000", 2024-04-18T21:06:31.572 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.1445e-05 2024-04-18T21:06:31.572 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.572 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.572 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:31.572 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.816293+0000", 2024-04-18T21:06:31.572 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0069981749999999997 2024-04-18T21:06:31.573 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.573 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.573 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:31.573 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.816357+0000", 2024-04-18T21:06:31.573 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.4414999999999999e-05 2024-04-18T21:06:31.573 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:31.573 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:31.573 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:31.573 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.573 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.573 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:31.573 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:06:31.573 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 85.945481693999994, 2024-04-18T21:06:31.573 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.040843365, 2024-04-18T21:06:31.573 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:31.574 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:31.574 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:31.574 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:31.574 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.574 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:31.574 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:06:31.574 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:31.574 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.574 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.574 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:31.574 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:06:31.574 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:31.574 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.574 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.574 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:31.575 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615297+0000", 2024-04-18T21:06:31.575 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2800000000000002e-06 2024-04-18T21:06:31.575 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.575 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.575 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:31.575 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615308+0000", 2024-04-18T21:06:31.575 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0813e-05 2024-04-18T21:06:31.575 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.575 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.575 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:31.575 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615330+0000", 2024-04-18T21:06:31.575 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2370000000000001e-05 2024-04-18T21:06:31.575 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.575 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.575 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.576 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615346+0000", 2024-04-18T21:06:31.576 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6200000000000001e-05 2024-04-18T21:06:31.576 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.576 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.576 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:31.576 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615470+0000", 2024-04-18T21:06:31.576 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012385799999999999 2024-04-18T21:06:31.576 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.576 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.576 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:31.576 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615488+0000", 2024-04-18T21:06:31.576 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7923000000000001e-05 2024-04-18T21:06:31.576 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.576 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.577 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:31.577 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.630993+0000", 2024-04-18T21:06:31.577 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.01550532 2024-04-18T21:06:31.577 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.577 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.577 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:31.577 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631165+0000", 2024-04-18T21:06:31.577 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000171588 2024-04-18T21:06:31.577 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.577 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.577 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:31.577 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631320+0000", 2024-04-18T21:06:31.577 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000155162 2024-04-18T21:06:31.577 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.577 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.578 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:31.578 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635157+0000", 2024-04-18T21:06:31.578 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0038370790000000002 2024-04-18T21:06:31.578 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.578 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.578 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:31.578 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.655904+0000", 2024-04-18T21:06:31.578 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.020746483999999999 2024-04-18T21:06:31.578 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.578 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.578 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:31.578 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656032+0000", 2024-04-18T21:06:31.578 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012864199999999999 2024-04-18T21:06:31.578 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.579 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.579 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:31.579 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656138+0000", 2024-04-18T21:06:31.579 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000105646 2024-04-18T21:06:31.579 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:31.579 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:31.579 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:31.579 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.579 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.579 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:31.579 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:06:31.579 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 85.945389521999999, 2024-04-18T21:06:31.579 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.041266444999999999, 2024-04-18T21:06:31.579 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:31.579 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:31.580 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:31.580 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:31.580 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.580 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:31.580 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:06:31.580 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:31.580 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.580 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.580 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:31.580 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:06:31.580 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:31.580 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.580 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.580 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:31.580 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615388+0000", 2024-04-18T21:06:31.580 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:06:31.580 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.581 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.581 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:31.581 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:06:31.581 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.7299999999999994e-06 2024-04-18T21:06:31.581 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.581 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.581 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:31.581 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615415+0000", 2024-04-18T21:06:31.581 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7807000000000001e-05 2024-04-18T21:06:31.581 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.581 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.581 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.581 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615431+0000", 2024-04-18T21:06:31.581 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6127e-05 2024-04-18T21:06:31.581 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.581 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.582 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:31.582 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615621+0000", 2024-04-18T21:06:31.582 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000189781 2024-04-18T21:06:31.582 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.582 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.582 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:31.582 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615634+0000", 2024-04-18T21:06:31.582 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3383e-05 2024-04-18T21:06:31.582 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.582 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.582 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:31.582 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631703+0000", 2024-04-18T21:06:31.582 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016068737 2024-04-18T21:06:31.582 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.582 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.583 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:31.583 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631809+0000", 2024-04-18T21:06:31.583 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000106823 2024-04-18T21:06:31.583 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.583 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.583 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:31.583 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631988+0000", 2024-04-18T21:06:31.583 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000179008 2024-04-18T21:06:31.583 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.583 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.583 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:31.583 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635172+0000", 2024-04-18T21:06:31.583 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.003183029 2024-04-18T21:06:31.583 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.583 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.583 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:31.584 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656392+0000", 2024-04-18T21:06:31.584 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.021220638999999999 2024-04-18T21:06:31.584 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.584 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.584 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:31.584 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656533+0000", 2024-04-18T21:06:31.584 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014126500000000001 2024-04-18T21:06:31.584 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.584 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.584 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:31.584 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656653+0000", 2024-04-18T21:06:31.584 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000119883 2024-04-18T21:06:31.584 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:31.584 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:31.584 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:31.584 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.585 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.585 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:31.585 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:06:31.585 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 85.945302099000003, 2024-04-18T21:06:31.585 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.042492302000000003, 2024-04-18T21:06:31.585 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:31.585 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:31.585 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:31.585 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:31.585 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.585 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:31.585 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:06:31.585 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:31.585 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.585 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.585 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:31.585 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:06:31.586 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:31.586 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.586 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.586 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:31.586 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615475+0000", 2024-04-18T21:06:31.586 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.17e-06 2024-04-18T21:06:31.586 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.586 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.586 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:31.586 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615528+0000", 2024-04-18T21:06:31.586 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.2159e-05 2024-04-18T21:06:31.586 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.586 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.586 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:31.586 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615542+0000", 2024-04-18T21:06:31.587 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4197e-05 2024-04-18T21:06:31.587 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.587 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.587 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.587 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615559+0000", 2024-04-18T21:06:31.587 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.749e-05 2024-04-18T21:06:31.587 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.587 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.587 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:31.587 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615685+0000", 2024-04-18T21:06:31.587 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012617499999999999 2024-04-18T21:06:31.587 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.587 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.587 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:31.587 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:06:31.588 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4749999999999999e-05 2024-04-18T21:06:31.588 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.588 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.588 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:31.588 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632332+0000", 2024-04-18T21:06:31.588 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016631988 2024-04-18T21:06:31.588 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.588 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.588 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:31.588 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632477+0000", 2024-04-18T21:06:31.588 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014437200000000001 2024-04-18T21:06:31.588 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.588 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.588 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:31.588 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632620+0000", 2024-04-18T21:06:31.589 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000143566 2024-04-18T21:06:31.589 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.589 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.589 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:31.589 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635185+0000", 2024-04-18T21:06:31.589 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0025644209999999999 2024-04-18T21:06:31.589 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.589 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.589 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:31.589 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657803+0000", 2024-04-18T21:06:31.589 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.022618743 2024-04-18T21:06:31.589 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.589 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.589 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:31.589 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657890+0000", 2024-04-18T21:06:31.589 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.6688999999999996e-05 2024-04-18T21:06:31.589 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.590 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.590 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:31.590 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657967+0000", 2024-04-18T21:06:31.590 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.6582000000000006e-05 2024-04-18T21:06:31.590 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:31.590 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:31.590 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:31.590 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.590 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.590 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:31.590 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:06:31.590 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 85.945171286999994, 2024-04-18T21:06:31.590 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.043603435000000003, 2024-04-18T21:06:31.590 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:31.591 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:31.591 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:31.591 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:31.591 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.591 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:31.591 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:06:31.591 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:31.591 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.591 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.591 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:31.591 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:06:31.591 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:31.591 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.591 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.591 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:31.591 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615607+0000", 2024-04-18T21:06:31.591 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4300000000000001e-06 2024-04-18T21:06:31.592 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.592 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.592 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:31.592 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615614+0000", 2024-04-18T21:06:31.592 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.4100000000000002e-06 2024-04-18T21:06:31.592 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.592 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.592 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:31.592 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615632+0000", 2024-04-18T21:06:31.592 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7863000000000002e-05 2024-04-18T21:06:31.592 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.592 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.592 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.592 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615647+0000", 2024-04-18T21:06:31.592 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5187e-05 2024-04-18T21:06:31.592 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.593 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.593 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:31.593 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615765+0000", 2024-04-18T21:06:31.593 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000117955 2024-04-18T21:06:31.593 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.593 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.593 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:31.593 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615781+0000", 2024-04-18T21:06:31.593 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6123000000000001e-05 2024-04-18T21:06:31.593 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.593 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.593 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:31.593 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633055+0000", 2024-04-18T21:06:31.593 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.017273909 2024-04-18T21:06:31.593 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.593 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.594 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:31.594 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633254+0000", 2024-04-18T21:06:31.594 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00019903799999999999 2024-04-18T21:06:31.594 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.594 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.594 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:31.594 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633624+0000", 2024-04-18T21:06:31.594 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000369656 2024-04-18T21:06:31.594 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.594 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.594 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:31.594 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635595+0000", 2024-04-18T21:06:31.594 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001971287 2024-04-18T21:06:31.594 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.594 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.594 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:31.595 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659026+0000", 2024-04-18T21:06:31.595 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.023431495 2024-04-18T21:06:31.595 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.595 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.595 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:31.595 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659117+0000", 2024-04-18T21:06:31.595 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0885999999999997e-05 2024-04-18T21:06:31.595 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.595 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.595 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:31.595 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659209+0000", 2024-04-18T21:06:31.595 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.1195999999999999e-05 2024-04-18T21:06:31.595 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:31.595 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:31.595 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:31.596 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.596 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.596 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:31.596 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:31.596 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 85.945106057999993, 2024-04-18T21:06:31.596 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.03492514, 2024-04-18T21:06:31.596 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:31.596 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:31.596 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:31.596 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:31.596 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.596 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:31.596 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:31.596 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:31.596 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.597 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.597 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:31.597 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:31.597 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:31.597 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.597 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.597 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:31.597 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:06:31.597 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.407e-06 2024-04-18T21:06:31.597 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.597 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.597 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:31.597 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615679+0000", 2024-04-18T21:06:31.597 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.2130000000000002e-06 2024-04-18T21:06:31.597 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.597 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.598 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:31.598 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615701+0000", 2024-04-18T21:06:31.598 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2316000000000001e-05 2024-04-18T21:06:31.598 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.598 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.598 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.598 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615717+0000", 2024-04-18T21:06:31.598 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6197000000000001e-05 2024-04-18T21:06:31.598 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.598 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.598 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:31.598 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615828+0000", 2024-04-18T21:06:31.598 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000110899 2024-04-18T21:06:31.598 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.598 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.598 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:31.599 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615840+0000", 2024-04-18T21:06:31.599 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.1423000000000001e-05 2024-04-18T21:06:31.599 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.599 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.599 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:31.599 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628046+0000", 2024-04-18T21:06:31.599 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.012206295000000001 2024-04-18T21:06:31.599 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.599 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.599 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:31.599 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628323+0000", 2024-04-18T21:06:31.599 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00027658700000000001 2024-04-18T21:06:31.599 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.599 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.599 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:31.599 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628599+0000", 2024-04-18T21:06:31.600 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00027676699999999997 2024-04-18T21:06:31.600 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.600 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.600 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:31.600 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634869+0000", 2024-04-18T21:06:31.600 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.006269536 2024-04-18T21:06:31.600 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.600 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.600 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:31.600 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650333+0000", 2024-04-18T21:06:31.600 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.015463645999999999 2024-04-18T21:06:31.600 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.600 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.600 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:31.600 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650474+0000", 2024-04-18T21:06:31.600 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014091799999999999 2024-04-18T21:06:31.600 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.601 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.601 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:31.601 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650595+0000", 2024-04-18T21:06:31.601 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012193600000000001 2024-04-18T21:06:31.601 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:31.601 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:31.601 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:31.601 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.601 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.601 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:31.601 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:06:31.601 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 85.945020948999996, 2024-04-18T21:06:31.601 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.040588320999999997, 2024-04-18T21:06:31.601 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:31.601 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:31.601 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:31.602 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:31.602 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.602 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:31.602 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:06:31.602 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:31.602 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.602 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.602 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:31.602 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:06:31.602 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:31.602 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.602 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.602 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:31.602 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615757+0000", 2024-04-18T21:06:31.603 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2270000000000001e-06 2024-04-18T21:06:31.603 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.603 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.603 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:31.603 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615765+0000", 2024-04-18T21:06:31.603 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.9400000000000002e-06 2024-04-18T21:06:31.603 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.603 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.603 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:31.603 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615785+0000", 2024-04-18T21:06:31.603 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.0749000000000001e-05 2024-04-18T21:06:31.603 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.603 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.603 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.603 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615804+0000", 2024-04-18T21:06:31.603 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.8774e-05 2024-04-18T21:06:31.604 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.604 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.604 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:31.604 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615888+0000", 2024-04-18T21:06:31.604 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.4111999999999997e-05 2024-04-18T21:06:31.604 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.604 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.604 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:31.604 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615895+0000", 2024-04-18T21:06:31.604 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.0469999999999996e-06 2024-04-18T21:06:31.604 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.604 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.604 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:31.604 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629280+0000", 2024-04-18T21:06:31.604 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.013384416 2024-04-18T21:06:31.604 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.605 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.605 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:31.605 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629488+0000", 2024-04-18T21:06:31.605 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00020852800000000001 2024-04-18T21:06:31.605 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.605 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.605 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:31.605 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629869+0000", 2024-04-18T21:06:31.605 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00038042300000000001 2024-04-18T21:06:31.605 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.605 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.605 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:31.605 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635041+0000", 2024-04-18T21:06:31.605 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.005172383 2024-04-18T21:06:31.605 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.605 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.606 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:31.606 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656125+0000", 2024-04-18T21:06:31.606 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.021084025999999999 2024-04-18T21:06:31.606 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.606 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.606 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:31.606 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656240+0000", 2024-04-18T21:06:31.606 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000115352 2024-04-18T21:06:31.606 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.606 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.606 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:31.606 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656344+0000", 2024-04-18T21:06:31.606 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00010334400000000001 2024-04-18T21:06:31.606 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:31.606 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:31.606 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:31.607 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.607 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.607 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:31.607 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:31.607 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 85.944953628999997, 2024-04-18T21:06:31.607 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.043549577999999999, 2024-04-18T21:06:31.607 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:31.607 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:31.607 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:31.607 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:31.607 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.607 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:31.607 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:31.607 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:31.607 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.607 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.607 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:31.608 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:31.608 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:31.608 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.608 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.608 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:31.608 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:31.608 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.5000000000000002e-07 2024-04-18T21:06:31.608 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.608 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.608 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:31.608 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615828+0000", 2024-04-18T21:06:31.608 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.2359999999999998e-06 2024-04-18T21:06:31.608 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.608 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.608 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:31.608 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615838+0000", 2024-04-18T21:06:31.609 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0087e-05 2024-04-18T21:06:31.609 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.609 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.609 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.609 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615846+0000", 2024-04-18T21:06:31.609 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.67e-06 2024-04-18T21:06:31.609 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.609 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.609 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:31.609 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615963+0000", 2024-04-18T21:06:31.609 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00011630500000000001 2024-04-18T21:06:31.609 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.609 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.609 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:31.610 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615979+0000", 2024-04-18T21:06:31.610 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.613e-05 2024-04-18T21:06:31.610 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.610 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.610 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:31.610 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632392+0000", 2024-04-18T21:06:31.610 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016413317 2024-04-18T21:06:31.610 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.610 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.610 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:31.610 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632568+0000", 2024-04-18T21:06:31.610 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00017539500000000001 2024-04-18T21:06:31.610 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.610 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.610 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:31.611 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632748+0000", 2024-04-18T21:06:31.611 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00017991799999999999 2024-04-18T21:06:31.611 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.611 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.611 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:31.611 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635542+0000", 2024-04-18T21:06:31.611 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00279481 2024-04-18T21:06:31.611 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.611 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.611 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:31.611 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659232+0000", 2024-04-18T21:06:31.611 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.023689212000000001 2024-04-18T21:06:31.611 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.611 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.611 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:31.611 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659314+0000", 2024-04-18T21:06:31.612 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.2528999999999995e-05 2024-04-18T21:06:31.612 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.612 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.612 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:31.612 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659372+0000", 2024-04-18T21:06:31.612 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.8218999999999999e-05 2024-04-18T21:06:31.612 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:31.612 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:31.612 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:31.612 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.612 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.612 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:31.612 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:06:31.612 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 85.944892197000001, 2024-04-18T21:06:31.612 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.039335347, 2024-04-18T21:06:31.613 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:31.613 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:31.613 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "started", 2024-04-18T21:06:31.613 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:31.613 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.613 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:31.613 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:06:31.613 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:31.613 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.613 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.613 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:31.613 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:06:31.613 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:31.613 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.613 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.614 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:31.614 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615885+0000", 2024-04-18T21:06:31.614 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2699999999999999e-06 2024-04-18T21:06:31.614 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.614 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.614 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:31.614 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615892+0000", 2024-04-18T21:06:31.614 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.6499999999999999e-06 2024-04-18T21:06:31.614 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.614 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.614 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:31.614 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615906+0000", 2024-04-18T21:06:31.614 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.393e-05 2024-04-18T21:06:31.615 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.615 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.615 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.615 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615919+0000", 2024-04-18T21:06:31.615 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2860000000000001e-05 2024-04-18T21:06:31.615 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.615 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.615 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:31.615 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616027+0000", 2024-04-18T21:06:31.615 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000107852 2024-04-18T21:06:31.615 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.615 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.615 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:31.615 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616037+0000", 2024-04-18T21:06:31.615 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:06:31.615 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.615 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.616 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:31.616 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622719+0000", 2024-04-18T21:06:31.616 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0066817220000000002 2024-04-18T21:06:31.616 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.616 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.616 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:31.616 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623006+0000", 2024-04-18T21:06:31.616 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00028783699999999999 2024-04-18T21:06:31.616 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.616 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.616 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:31.616 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.655220+0000", 2024-04-18T21:06:31.616 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.032213036 2024-04-18T21:06:31.616 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:31.616 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:31.616 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:31.617 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.617 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.617 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:31.617 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:31.617 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 85.944836523999996, 2024-04-18T21:06:31.617 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.032845253999999997, 2024-04-18T21:06:31.617 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:31.617 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:31.617 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "started", 2024-04-18T21:06:31.617 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:31.617 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.617 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:31.617 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:31.617 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:31.617 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.618 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.618 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:31.618 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:31.618 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:31.618 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.618 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.618 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:31.618 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615942+0000", 2024-04-18T21:06:31.618 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.717e-06 2024-04-18T21:06:31.618 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.618 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.618 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:31.618 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615946+0000", 2024-04-18T21:06:31.618 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.6e-06 2024-04-18T21:06:31.618 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.619 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.619 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:31.619 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615960+0000", 2024-04-18T21:06:31.619 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:06:31.619 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.619 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.619 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.619 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615968+0000", 2024-04-18T21:06:31.619 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.9070000000000007e-06 2024-04-18T21:06:31.619 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.619 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.619 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:31.619 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616100+0000", 2024-04-18T21:06:31.619 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000132402 2024-04-18T21:06:31.619 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.619 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.620 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:31.620 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616117+0000", 2024-04-18T21:06:31.620 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6653000000000001e-05 2024-04-18T21:06:31.620 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.620 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.620 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:31.620 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621566+0000", 2024-04-18T21:06:31.620 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0054497740000000001 2024-04-18T21:06:31.620 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.620 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.620 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:31.621 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622801+0000", 2024-04-18T21:06:31.621 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0012345710000000001 2024-04-18T21:06:31.621 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.621 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.621 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:31.621 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648785+0000", 2024-04-18T21:06:31.621 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.025984104000000001 2024-04-18T21:06:31.621 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:31.621 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:31.622 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:31.622 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.622 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.622 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:31.622 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:06:31.622 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 85.938985173999995, 2024-04-18T21:06:31.622 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.011561350999999999, 2024-04-18T21:06:31.622 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:31.622 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:31.622 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:31.622 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:31.622 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.622 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:31.622 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:06:31.622 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:31.622 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.623 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.623 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:31.623 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:06:31.623 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:31.623 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.623 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.623 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:31.623 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621792+0000", 2024-04-18T21:06:31.623 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.4000000000000001e-07 2024-04-18T21:06:31.623 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.623 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.623 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:31.623 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:06:31.623 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.1050000000000002e-05 2024-04-18T21:06:31.623 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.624 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.624 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:31.624 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622608+0000", 2024-04-18T21:06:31.624 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00077505900000000003 2024-04-18T21:06:31.624 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.624 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.624 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.624 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623879+0000", 2024-04-18T21:06:31.624 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0012705839999999999 2024-04-18T21:06:31.624 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.624 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.624 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:31.624 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624010+0000", 2024-04-18T21:06:31.624 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00013176900000000001 2024-04-18T21:06:31.625 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.625 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.625 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:31.625 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624058+0000", 2024-04-18T21:06:31.625 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.7299000000000002e-05 2024-04-18T21:06:31.625 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.625 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.625 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:31.625 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633262+0000", 2024-04-18T21:06:31.625 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0092048770000000002 2024-04-18T21:06:31.625 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.625 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.625 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:31.625 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633353+0000", 2024-04-18T21:06:31.626 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0073000000000003e-05 2024-04-18T21:06:31.626 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:31.626 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:31.626 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:31.626 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.626 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.626 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:31.626 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:06:31.626 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 85.936857787999998, 2024-04-18T21:06:31.626 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0098419370000000003, 2024-04-18T21:06:31.626 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:31.626 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:31.626 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:31.626 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:31.626 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.627 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:31.627 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:06:31.627 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:31.627 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.627 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.627 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:31.627 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:06:31.627 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:31.627 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.627 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.627 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:31.627 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623920+0000", 2024-04-18T21:06:31.627 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2240000000000001e-06 2024-04-18T21:06:31.627 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.628 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.628 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:31.628 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623933+0000", 2024-04-18T21:06:31.628 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3653e-05 2024-04-18T21:06:31.628 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.628 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.628 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:31.628 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623956+0000", 2024-04-18T21:06:31.628 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2059e-05 2024-04-18T21:06:31.628 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.628 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.628 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.628 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623975+0000", 2024-04-18T21:06:31.628 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.9806999999999999e-05 2024-04-18T21:06:31.628 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.628 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.628 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:31.629 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626943+0000", 2024-04-18T21:06:31.629 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0029681579999999998 2024-04-18T21:06:31.629 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.629 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.629 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:31.629 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626993+0000", 2024-04-18T21:06:31.629 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.9935999999999998e-05 2024-04-18T21:06:31.629 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.629 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.629 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:31.629 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633665+0000", 2024-04-18T21:06:31.629 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0066719250000000004 2024-04-18T21:06:31.629 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.629 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.629 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:31.629 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633761+0000", 2024-04-18T21:06:31.630 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.5174999999999996e-05 2024-04-18T21:06:31.630 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:31.630 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:31.630 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:31.630 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.630 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.630 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:31.630 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:06:31.630 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 85.936026169000002, 2024-04-18T21:06:31.630 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0090159079999999996, 2024-04-18T21:06:31.630 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:31.630 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:31.630 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:31.630 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:31.630 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.630 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:31.631 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:06:31.631 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:31.631 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.631 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.631 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:31.631 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:06:31.631 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:31.631 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.631 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.631 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:31.631 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624751+0000", 2024-04-18T21:06:31.631 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.7600000000000006e-07 2024-04-18T21:06:31.631 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.631 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.631 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:31.632 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624787+0000", 2024-04-18T21:06:31.632 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.6273000000000003e-05 2024-04-18T21:06:31.632 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.632 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.632 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:31.632 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625837+0000", 2024-04-18T21:06:31.632 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00104992 2024-04-18T21:06:31.632 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.632 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.632 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.632 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625860+0000", 2024-04-18T21:06:31.632 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3110000000000001e-05 2024-04-18T21:06:31.632 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.632 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.633 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:31.633 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625984+0000", 2024-04-18T21:06:31.633 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012399199999999999 2024-04-18T21:06:31.633 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.633 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.633 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:31.633 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626030+0000", 2024-04-18T21:06:31.633 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.5429999999999997e-05 2024-04-18T21:06:31.633 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.633 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.633 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:31.633 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633643+0000", 2024-04-18T21:06:31.633 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0076129320000000002 2024-04-18T21:06:31.633 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.633 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.634 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:31.634 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633766+0000", 2024-04-18T21:06:31.634 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000123275 2024-04-18T21:06:31.634 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:31.634 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:31.634 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:31.634 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.634 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.634 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:31.634 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:06:31.634 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 85.934772444999993, 2024-04-18T21:06:31.634 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0088669170000000002, 2024-04-18T21:06:31.634 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:31.635 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:31.635 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:31.635 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:31.635 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.635 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:31.635 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:06:31.635 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:31.635 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.635 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.635 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:31.635 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:06:31.635 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:31.635 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.635 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.635 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:31.636 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626005+0000", 2024-04-18T21:06:31.636 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.5000000000000001e-07 2024-04-18T21:06:31.636 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.636 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.636 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:31.636 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626028+0000", 2024-04-18T21:06:31.636 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2756999999999999e-05 2024-04-18T21:06:31.636 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.636 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.636 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:31.636 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626050+0000", 2024-04-18T21:06:31.636 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2140000000000001e-05 2024-04-18T21:06:31.636 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.636 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.636 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.636 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626065+0000", 2024-04-18T21:06:31.637 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5176e-05 2024-04-18T21:06:31.637 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.637 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.637 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:31.637 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628334+0000", 2024-04-18T21:06:31.637 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0022691439999999998 2024-04-18T21:06:31.637 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.637 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.637 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:31.637 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628379+0000", 2024-04-18T21:06:31.637 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.5420000000000002e-05 2024-04-18T21:06:31.637 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.637 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.637 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:31.637 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634770+0000", 2024-04-18T21:06:31.637 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0063908410000000004 2024-04-18T21:06:31.638 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.638 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.638 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:31.638 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634871+0000", 2024-04-18T21:06:31.638 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000100589 2024-04-18T21:06:31.638 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:31.638 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:31.638 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:31.638 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.638 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.638 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:13 3.10 e17/15 3:0d89b25e:::603.00000000:head v 17'8, mlcod=0'0)", 2024-04-18T21:06:31.638 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:06:31.638 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 85.915939015999996, 2024-04-18T21:06:31.638 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0090974379999999994, 2024-04-18T21:06:31.638 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:31.639 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:31.639 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:31.639 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:31.639 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.639 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:31.639 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:06:31.639 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:31.639 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.639 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.639 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:31.639 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:06:31.639 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:31.639 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.639 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.639 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:31.639 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644838+0000", 2024-04-18T21:06:31.640 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.569999999999999e-07 2024-04-18T21:06:31.640 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.640 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.640 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:31.640 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644846+0000", 2024-04-18T21:06:31.640 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.4499999999999998e-06 2024-04-18T21:06:31.640 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.640 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.640 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:31.640 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644861+0000", 2024-04-18T21:06:31.640 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5243e-05 2024-04-18T21:06:31.640 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.640 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.640 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.640 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644997+0000", 2024-04-18T21:06:31.640 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000135609 2024-04-18T21:06:31.641 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.641 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.641 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:31.641 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649150+0000", 2024-04-18T21:06:31.641 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0041536760000000002 2024-04-18T21:06:31.641 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.641 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.641 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:31.641 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649207+0000", 2024-04-18T21:06:31.641 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.6677e-05 2024-04-18T21:06:31.641 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.641 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.641 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:31.641 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.653840+0000", 2024-04-18T21:06:31.641 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0046329700000000001 2024-04-18T21:06:31.641 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.642 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.642 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:31.642 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.653935+0000", 2024-04-18T21:06:31.642 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.4856000000000001e-05 2024-04-18T21:06:31.642 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:31.642 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:31.642 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:31.642 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.642 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.642 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 3 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:06:31.642 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:06:31.642 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 85.913149856000004, 2024-04-18T21:06:31.642 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0087842319999999995, 2024-04-18T21:06:31.642 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:31.642 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:31.643 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "reached pg", 2024-04-18T21:06:31.643 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:31.643 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.643 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:31.643 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:06:31.643 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:31.643 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.643 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.643 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:31.643 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:06:31.643 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:31.643 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.643 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.643 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:31.643 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:06:31.644 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.8299999999999996e-07 2024-04-18T21:06:31.644 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.644 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.644 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:31.644 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647642+0000", 2024-04-18T21:06:31.644 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4724e-05 2024-04-18T21:06:31.644 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.644 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.644 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:31.644 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647679+0000", 2024-04-18T21:06:31.644 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.6662999999999998e-05 2024-04-18T21:06:31.644 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.644 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.644 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.644 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647735+0000", 2024-04-18T21:06:31.645 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.6196000000000002e-05 2024-04-18T21:06:31.645 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.645 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.645 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:31.645 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649865+0000", 2024-04-18T21:06:31.645 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0021299489999999999 2024-04-18T21:06:31.645 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.645 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.645 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:31.645 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656411+0000", 2024-04-18T21:06:31.645 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0065460170000000003 2024-04-18T21:06:31.645 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:31.645 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:31.645 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:31.646 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.646 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.646 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:31.646 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:06:31.646 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 85.913004659999999, 2024-04-18T21:06:31.646 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0095703190000000007, 2024-04-18T21:06:31.646 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:31.646 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:31.646 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:31.646 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:31.646 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.646 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:31.646 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:06:31.646 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:31.646 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.647 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.647 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:31.647 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:06:31.647 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:31.647 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.647 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.647 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:31.647 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647773+0000", 2024-04-18T21:06:31.647 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.046e-06 2024-04-18T21:06:31.647 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.647 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.647 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:31.647 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647795+0000", 2024-04-18T21:06:31.647 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2616000000000002e-05 2024-04-18T21:06:31.647 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.647 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.648 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:31.648 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647818+0000", 2024-04-18T21:06:31.648 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3110000000000001e-05 2024-04-18T21:06:31.648 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.648 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.648 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.648 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647834+0000", 2024-04-18T21:06:31.648 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5163e-05 2024-04-18T21:06:31.648 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.648 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.648 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:31.648 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650682+0000", 2024-04-18T21:06:31.648 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0028479759999999999 2024-04-18T21:06:31.648 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.648 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.648 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:31.648 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650730+0000", 2024-04-18T21:06:31.649 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.8375999999999999e-05 2024-04-18T21:06:31.649 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.649 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.649 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:31.649 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656751+0000", 2024-04-18T21:06:31.649 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0060211880000000002 2024-04-18T21:06:31.649 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.649 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.649 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:31.649 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657342+0000", 2024-04-18T21:06:31.649 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00059084399999999998 2024-04-18T21:06:31.649 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:31.649 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:31.649 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:31.649 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.649 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.650 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:31.650 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:06:31.650 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 85.912592373999999, 2024-04-18T21:06:31.650 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0092471759999999993, 2024-04-18T21:06:31.650 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:31.650 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:31.650 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:31.650 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:31.650 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.650 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:31.650 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:06:31.650 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:31.650 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.650 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.650 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:31.651 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:06:31.651 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:31.651 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.651 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.651 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:31.651 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648185+0000", 2024-04-18T21:06:31.651 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.5000000000000001e-07 2024-04-18T21:06:31.651 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.651 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.651 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:31.651 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648203+0000", 2024-04-18T21:06:31.651 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.8102999999999999e-05 2024-04-18T21:06:31.651 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.651 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.651 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:31.651 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648226+0000", 2024-04-18T21:06:31.652 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2921999999999998e-05 2024-04-18T21:06:31.652 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.652 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.652 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:31.652 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648241+0000", 2024-04-18T21:06:31.652 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5336999999999999e-05 2024-04-18T21:06:31.652 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.652 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.652 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:31.652 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.651268+0000", 2024-04-18T21:06:31.652 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0030271640000000002 2024-04-18T21:06:31.652 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.652 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.652 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:31.652 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.651319+0000", 2024-04-18T21:06:31.653 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.0843000000000001e-05 2024-04-18T21:06:31.653 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.653 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.653 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:31.653 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657347+0000", 2024-04-18T21:06:31.653 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0060279770000000003 2024-04-18T21:06:31.653 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:31.653 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:31.653 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:31.653 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657431+0000", 2024-04-18T21:06:31.653 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.3980000000000006e-05 2024-04-18T21:06:31.653 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:31.653 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:31.653 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:31.653 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:31.654 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:31.654 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:06:31.655 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:31.655 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:31.654+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:31.673 INFO:teuthology.orchestra.run.smithi078.stderr:nodeep-scrub is unset 2024-04-18T21:06:31.673 INFO:teuthology.orchestra.run.smithi078.stderr:reweighted osd.1 to 1 (10000) 2024-04-18T21:06:31.704 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-18T21:06:31.756 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:31.754+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:31.781 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:31.782 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:06:31.782 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-04-18T21:06:31.782 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:31.795 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:31.857 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:31.859+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:31.958 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:31.958+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:31.959 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:31.959 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:06:31.959 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-18T21:06:31.959 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-18T21:06:31.959 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:31.975 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:32.059 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:32.058+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:32.093 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:32.093 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-18T21:06:32.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-18T21:06:32.093 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:06:32.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.093 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:32.093 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:06:32.093 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 86.478434218999993, 2024-04-18T21:06:32.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.034065303999999998, 2024-04-18T21:06:32.093 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:32.093 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:32.093 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:32.093 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:32.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.094 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:32.094 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:06:32.094 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:32.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.094 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:32.094 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:06:32.094 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:32.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.094 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:32.094 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615254+0000", 2024-04-18T21:06:32.094 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7829999999999999e-06 2024-04-18T21:06:32.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.095 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:32.095 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615267+0000", 2024-04-18T21:06:32.095 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3334e-05 2024-04-18T21:06:32.095 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.095 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.095 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:32.095 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615294+0000", 2024-04-18T21:06:32.095 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7271999999999999e-05 2024-04-18T21:06:32.095 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.095 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.095 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:32.095 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615321+0000", 2024-04-18T21:06:32.095 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.637e-05 2024-04-18T21:06:32.095 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.095 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.095 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:32.096 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615479+0000", 2024-04-18T21:06:32.096 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000158493 2024-04-18T21:06:32.096 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.096 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.096 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:32.096 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615498+0000", 2024-04-18T21:06:32.096 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9148999999999999e-05 2024-04-18T21:06:32.096 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.096 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.096 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:32.096 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632915+0000", 2024-04-18T21:06:32.096 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.017416551999999998 2024-04-18T21:06:32.096 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.096 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.096 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:32.096 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633302+0000", 2024-04-18T21:06:32.097 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00038725000000000001 2024-04-18T21:06:32.097 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.097 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.097 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:32.097 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633638+0000", 2024-04-18T21:06:32.097 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000335946 2024-04-18T21:06:32.097 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.097 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.097 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:32.097 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645976+0000", 2024-04-18T21:06:32.097 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012337617 2024-04-18T21:06:32.097 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.097 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.097 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:32.098 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649080+0000", 2024-04-18T21:06:32.098 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031038929999999999 2024-04-18T21:06:32.098 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.098 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.098 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:32.098 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649207+0000", 2024-04-18T21:06:32.098 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000127537 2024-04-18T21:06:32.098 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.098 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.098 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:32.098 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649316+0000", 2024-04-18T21:06:32.098 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109108 2024-04-18T21:06:32.098 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:32.098 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:32.098 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:32.099 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.099 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.099 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:32.099 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:06:32.099 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 86.478300841999996, 2024-04-18T21:06:32.099 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036275764000000002, 2024-04-18T21:06:32.099 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:32.099 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:32.099 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:32.099 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:32.099 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.099 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:32.099 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:06:32.099 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:32.099 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.099 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.100 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:32.100 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:06:32.100 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:32.100 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.100 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.100 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:32.100 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615386+0000", 2024-04-18T21:06:32.100 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.573e-06 2024-04-18T21:06:32.100 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.100 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.100 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:32.100 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:06:32.100 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0723999999999999e-05 2024-04-18T21:06:32.100 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.100 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.100 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:32.101 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615418+0000", 2024-04-18T21:06:32.101 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0902000000000001e-05 2024-04-18T21:06:32.101 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.101 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.101 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:32.101 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615433+0000", 2024-04-18T21:06:32.101 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5319999999999999e-05 2024-04-18T21:06:32.101 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.101 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.101 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:32.101 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615659+0000", 2024-04-18T21:06:32.101 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000226095 2024-04-18T21:06:32.101 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.101 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.101 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:32.101 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:32.102 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1276e-05 2024-04-18T21:06:32.102 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.102 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.102 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:32.102 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643654+0000", 2024-04-18T21:06:32.102 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027983238000000001 2024-04-18T21:06:32.102 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.102 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.102 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:32.102 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643868+0000", 2024-04-18T21:06:32.102 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000214305 2024-04-18T21:06:32.102 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.102 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.102 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:32.102 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:06:32.102 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035892200000000002 2024-04-18T21:06:32.103 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.103 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.103 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:32.103 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646056+0000", 2024-04-18T21:06:32.103 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001829172 2024-04-18T21:06:32.103 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.103 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.103 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:32.103 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651406+0000", 2024-04-18T21:06:32.103 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0053504800000000003 2024-04-18T21:06:32.103 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.103 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.103 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:32.103 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651551+0000", 2024-04-18T21:06:32.103 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014427999999999999 2024-04-18T21:06:32.104 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.104 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.104 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:32.104 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651660+0000", 2024-04-18T21:06:32.104 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109477 2024-04-18T21:06:32.104 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:32.104 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:32.104 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:32.104 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.104 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.104 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:32.104 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:32.104 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 86.478227459999999, 2024-04-18T21:06:32.104 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045668994999999997, 2024-04-18T21:06:32.104 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:32.105 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:32.105 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:32.105 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:32.105 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.105 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:32.105 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:32.105 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:32.105 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.105 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.105 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:32.105 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:32.105 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:32.105 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.105 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.105 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:32.106 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615459+0000", 2024-04-18T21:06:32.106 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5030000000000001e-06 2024-04-18T21:06:32.106 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.106 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.106 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:32.106 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615506+0000", 2024-04-18T21:06:32.106 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6872000000000001e-05 2024-04-18T21:06:32.106 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.106 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.106 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:32.106 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615527+0000", 2024-04-18T21:06:32.106 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0763000000000001e-05 2024-04-18T21:06:32.106 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.106 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.107 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:32.107 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615551+0000", 2024-04-18T21:06:32.107 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4159e-05 2024-04-18T21:06:32.107 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.107 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.107 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:32.107 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615736+0000", 2024-04-18T21:06:32.107 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018499599999999999 2024-04-18T21:06:32.107 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.107 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.107 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:32.107 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615748+0000", 2024-04-18T21:06:32.107 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2272999999999999e-05 2024-04-18T21:06:32.107 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.108 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.108 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:32.108 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635481+0000", 2024-04-18T21:06:32.108 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019732772999999999 2024-04-18T21:06:32.108 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.108 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.108 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:32.108 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635791+0000", 2024-04-18T21:06:32.108 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031013299999999998 2024-04-18T21:06:32.108 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.108 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.108 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:32.108 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636101+0000", 2024-04-18T21:06:32.108 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030943300000000002 2024-04-18T21:06:32.108 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.109 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.109 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:32.109 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646043+0000", 2024-04-18T21:06:32.109 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099428139999999995 2024-04-18T21:06:32.109 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.109 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.109 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:32.109 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660991+0000", 2024-04-18T21:06:32.109 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014947142 2024-04-18T21:06:32.109 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.109 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.109 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:32.109 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661061+0000", 2024-04-18T21:06:32.109 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0438000000000006e-05 2024-04-18T21:06:32.110 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.110 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.110 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:32.110 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661127+0000", 2024-04-18T21:06:32.110 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5696000000000003e-05 2024-04-18T21:06:32.110 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:32.110 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:32.110 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:32.110 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.110 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.110 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:32.110 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:32.110 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 86.478015032000002, 2024-04-18T21:06:32.110 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045745085999999997, 2024-04-18T21:06:32.110 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:32.110 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:32.110 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:32.111 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:32.111 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.111 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:32.111 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:32.111 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:32.111 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.111 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.111 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:32.111 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:32.111 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:32.111 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.111 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.111 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:32.111 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:06:32.111 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7400000000000001e-06 2024-04-18T21:06:32.112 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.112 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.112 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:32.112 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:06:32.112 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8133e-05 2024-04-18T21:06:32.112 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.112 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.112 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:32.112 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615726+0000", 2024-04-18T21:06:32.112 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6132e-05 2024-04-18T21:06:32.112 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.112 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.112 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:32.112 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615742+0000", 2024-04-18T21:06:32.112 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6157000000000001e-05 2024-04-18T21:06:32.112 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.112 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.113 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:32.113 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615937+0000", 2024-04-18T21:06:32.113 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000194768 2024-04-18T21:06:32.113 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.113 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.113 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:32.113 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615950+0000", 2024-04-18T21:06:32.113 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3084e-05 2024-04-18T21:06:32.113 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.113 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.113 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:32.113 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643676+0000", 2024-04-18T21:06:32.113 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027725639999999999 2024-04-18T21:06:32.113 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.113 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.114 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:32.114 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643867+0000", 2024-04-18T21:06:32.114 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019075900000000001 2024-04-18T21:06:32.114 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.114 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.114 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:32.114 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:06:32.114 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036013799999999997 2024-04-18T21:06:32.114 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.114 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.114 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:32.114 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646068+0000", 2024-04-18T21:06:32.114 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001841536 2024-04-18T21:06:32.114 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.114 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.115 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:32.115 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661184+0000", 2024-04-18T21:06:32.115 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015115458999999999 2024-04-18T21:06:32.115 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.115 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.115 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:32.115 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661283+0000", 2024-04-18T21:06:32.115 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9502999999999999e-05 2024-04-18T21:06:32.115 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.115 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.115 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:32.115 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661415+0000", 2024-04-18T21:06:32.115 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000132037 2024-04-18T21:06:32.115 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:32.115 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:32.115 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:32.115 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.116 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.116 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:32.116 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:06:32.116 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 86.477893344999998, 2024-04-18T21:06:32.116 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036185947000000003, 2024-04-18T21:06:32.116 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:32.116 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:32.116 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:32.116 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:32.116 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.116 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:32.116 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:06:32.116 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:32.116 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.116 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.117 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:32.117 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:06:32.117 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:32.117 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.117 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.117 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:32.117 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615794+0000", 2024-04-18T21:06:32.117 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6440000000000001e-06 2024-04-18T21:06:32.117 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.117 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.117 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:32.117 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615803+0000", 2024-04-18T21:06:32.117 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1220000000000001e-06 2024-04-18T21:06:32.117 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.117 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.118 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:32.118 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615827+0000", 2024-04-18T21:06:32.118 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3997000000000001e-05 2024-04-18T21:06:32.118 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.118 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.118 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:32.118 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615899+0000", 2024-04-18T21:06:32.118 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2741e-05 2024-04-18T21:06:32.118 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.118 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.118 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:32.118 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616019+0000", 2024-04-18T21:06:32.118 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119874 2024-04-18T21:06:32.118 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.119 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.119 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:32.119 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616029+0000", 2024-04-18T21:06:32.119 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:06:32.119 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.119 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.119 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:32.119 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644823+0000", 2024-04-18T21:06:32.119 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.028793151999999999 2024-04-18T21:06:32.119 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.119 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.119 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:32.119 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645106+0000", 2024-04-18T21:06:32.119 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028379700000000002 2024-04-18T21:06:32.119 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.120 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.120 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:32.120 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645294+0000", 2024-04-18T21:06:32.120 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000187181 2024-04-18T21:06:32.120 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.120 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.120 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:32.120 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646763+0000", 2024-04-18T21:06:32.120 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0014691050000000001 2024-04-18T21:06:32.120 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.120 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.120 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:32.120 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651784+0000", 2024-04-18T21:06:32.120 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050211650000000002 2024-04-18T21:06:32.120 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.120 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.121 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:32.121 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651876+0000", 2024-04-18T21:06:32.121 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2503999999999994e-05 2024-04-18T21:06:32.121 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.121 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.121 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:32.121 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651978+0000", 2024-04-18T21:06:32.121 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000101475 2024-04-18T21:06:32.121 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:32.121 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:32.121 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:32.121 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.121 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.121 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:32.121 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:32.122 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 86.477744737999998, 2024-04-18T21:06:32.122 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032262322000000003, 2024-04-18T21:06:32.122 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:32.122 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:32.122 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:32.122 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:32.122 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.122 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:32.122 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:32.122 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:32.122 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.122 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.122 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:32.122 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:32.123 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:32.123 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.123 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.123 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:32.123 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615943+0000", 2024-04-18T21:06:32.123 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1959999999999998e-06 2024-04-18T21:06:32.123 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.123 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.123 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:32.123 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615956+0000", 2024-04-18T21:06:32.123 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3424000000000001e-05 2024-04-18T21:06:32.123 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.123 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.123 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:32.123 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615983+0000", 2024-04-18T21:06:32.124 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7072000000000001e-05 2024-04-18T21:06:32.124 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.124 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.124 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:32.124 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616006+0000", 2024-04-18T21:06:32.124 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2823000000000002e-05 2024-04-18T21:06:32.124 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.124 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.124 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:32.124 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616156+0000", 2024-04-18T21:06:32.124 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014962299999999999 2024-04-18T21:06:32.124 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.124 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.124 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:32.124 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616174+0000", 2024-04-18T21:06:32.124 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8082999999999999e-05 2024-04-18T21:06:32.125 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.125 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.125 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:32.125 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.629952+0000", 2024-04-18T21:06:32.125 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013778514 2024-04-18T21:06:32.125 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.125 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.125 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:32.125 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630201+0000", 2024-04-18T21:06:32.125 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024918100000000001 2024-04-18T21:06:32.125 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.125 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.125 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:32.125 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630386+0000", 2024-04-18T21:06:32.125 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018436900000000001 2024-04-18T21:06:32.126 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.126 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.126 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:32.126 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643169+0000", 2024-04-18T21:06:32.126 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012782774 2024-04-18T21:06:32.126 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.126 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.126 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:32.126 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.647924+0000", 2024-04-18T21:06:32.126 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004755787 2024-04-18T21:06:32.126 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.126 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.126 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:32.127 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648069+0000", 2024-04-18T21:06:32.127 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014459600000000001 2024-04-18T21:06:32.127 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.127 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.127 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:32.127 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648203+0000", 2024-04-18T21:06:32.127 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013388000000000001 2024-04-18T21:06:32.127 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:32.127 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:32.127 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:32.127 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.127 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.127 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:32.127 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:06:32.127 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 86.477636473999993, 2024-04-18T21:06:32.128 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032489736999999998, 2024-04-18T21:06:32.128 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:32.128 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:32.128 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:32.128 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:32.128 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.128 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:32.128 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:06:32.128 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:32.128 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.128 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.128 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:32.128 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:06:32.128 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:32.129 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.129 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.129 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:32.129 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616050+0000", 2024-04-18T21:06:32.129 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.606e-06 2024-04-18T21:06:32.129 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.129 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.129 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:32.129 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616061+0000", 2024-04-18T21:06:32.129 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0463e-05 2024-04-18T21:06:32.129 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.129 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.129 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:32.129 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616092+0000", 2024-04-18T21:06:32.129 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1415999999999999e-05 2024-04-18T21:06:32.130 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.130 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.130 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:32.130 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616109+0000", 2024-04-18T21:06:32.130 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6557000000000001e-05 2024-04-18T21:06:32.130 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.130 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.130 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:32.130 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616358+0000", 2024-04-18T21:06:32.130 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000249077 2024-04-18T21:06:32.130 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.130 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.130 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:32.130 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616370+0000", 2024-04-18T21:06:32.130 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2037e-05 2024-04-18T21:06:32.131 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.131 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.131 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:32.131 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.634920+0000", 2024-04-18T21:06:32.131 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018550397 2024-04-18T21:06:32.131 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.131 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.131 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:32.131 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640420+0000", 2024-04-18T21:06:32.131 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055000539999999999 2024-04-18T21:06:32.131 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.131 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.131 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:32.131 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648538+0000", 2024-04-18T21:06:32.131 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0081181299999999994 2024-04-18T21:06:32.132 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:32.132 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:32.132 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:32.132 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.132 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.132 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:32.132 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:06:32.132 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 86.477552153000005, 2024-04-18T21:06:32.132 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036090029000000003, 2024-04-18T21:06:32.132 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:32.132 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:32.132 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:32.132 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:32.132 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.132 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:32.132 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:06:32.133 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:32.133 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.133 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.133 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:32.133 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:06:32.133 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:32.133 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.133 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.133 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:32.133 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616134+0000", 2024-04-18T21:06:32.133 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.353e-06 2024-04-18T21:06:32.133 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.133 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.133 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:32.133 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616141+0000", 2024-04-18T21:06:32.134 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2770000000000002e-06 2024-04-18T21:06:32.134 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.134 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.134 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:32.134 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616160+0000", 2024-04-18T21:06:32.134 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.91e-05 2024-04-18T21:06:32.134 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.134 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.134 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:32.134 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616170+0000", 2024-04-18T21:06:32.134 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7699999999999996e-06 2024-04-18T21:06:32.134 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.134 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.134 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:32.134 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616275+0000", 2024-04-18T21:06:32.135 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105313 2024-04-18T21:06:32.135 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.135 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.135 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:32.135 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616288+0000", 2024-04-18T21:06:32.135 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3027000000000001e-05 2024-04-18T21:06:32.135 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.135 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.135 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:32.135 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646160+0000", 2024-04-18T21:06:32.135 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.029872019 2024-04-18T21:06:32.135 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.135 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.135 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:32.135 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646368+0000", 2024-04-18T21:06:32.136 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020811899999999999 2024-04-18T21:06:32.136 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.136 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.136 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:32.136 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652223+0000", 2024-04-18T21:06:32.136 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.005855051 2024-04-18T21:06:32.136 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:32.136 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:32.136 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:32.136 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.136 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.136 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:32.136 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:32.136 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 86.477494583999999, 2024-04-18T21:06:32.136 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043572403000000003, 2024-04-18T21:06:32.136 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:32.137 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:32.137 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:32.137 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:32.137 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.137 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:32.137 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:32.137 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:32.137 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.137 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.137 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:32.137 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:32.137 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:32.137 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.137 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.137 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:32.137 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616192+0000", 2024-04-18T21:06:32.138 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:06:32.138 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.138 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.138 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:32.138 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616203+0000", 2024-04-18T21:06:32.138 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0890000000000001e-05 2024-04-18T21:06:32.138 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.138 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.138 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:32.138 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616223+0000", 2024-04-18T21:06:32.138 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0409000000000001e-05 2024-04-18T21:06:32.138 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.138 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.138 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:32.138 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616238+0000", 2024-04-18T21:06:32.138 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5160000000000001e-05 2024-04-18T21:06:32.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.139 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.139 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:32.139 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616343+0000", 2024-04-18T21:06:32.139 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000104831 2024-04-18T21:06:32.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.139 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.139 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:32.139 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616357+0000", 2024-04-18T21:06:32.139 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3686000000000001e-05 2024-04-18T21:06:32.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.139 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.139 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:32.139 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635912+0000", 2024-04-18T21:06:32.139 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019554944000000001 2024-04-18T21:06:32.140 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.140 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.140 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:32.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636231+0000", 2024-04-18T21:06:32.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000318766 2024-04-18T21:06:32.140 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.140 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.140 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:32.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659763+0000", 2024-04-18T21:06:32.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023532474000000001 2024-04-18T21:06:32.140 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:32.140 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:32.140 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:32.140 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.140 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.140 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:32.141 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:06:32.141 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 86.473565876999999, 2024-04-18T21:06:32.141 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015007971, 2024-04-18T21:06:32.141 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:32.141 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:32.141 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:32.141 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:32.141 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.141 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:32.141 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:06:32.141 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:32.141 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.141 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.141 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:32.141 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:06:32.141 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:32.142 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.142 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.142 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:32.142 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620120+0000", 2024-04-18T21:06:32.142 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0359999999999999e-06 2024-04-18T21:06:32.142 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.142 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.142 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:32.142 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620157+0000", 2024-04-18T21:06:32.142 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6636e-05 2024-04-18T21:06:32.142 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.142 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.142 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:32.143 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620177+0000", 2024-04-18T21:06:32.143 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0247000000000001e-05 2024-04-18T21:06:32.143 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.143 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:32.143 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620195+0000", 2024-04-18T21:06:32.143 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7819e-05 2024-04-18T21:06:32.143 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.143 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:32.143 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620342+0000", 2024-04-18T21:06:32.143 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014643300000000001 2024-04-18T21:06:32.143 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.143 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:32.143 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620405+0000", 2024-04-18T21:06:32.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3522000000000006e-05 2024-04-18T21:06:32.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.144 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.144 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:32.144 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635016+0000", 2024-04-18T21:06:32.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014610840999999999 2024-04-18T21:06:32.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.144 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.144 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:32.144 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635127+0000", 2024-04-18T21:06:32.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111437 2024-04-18T21:06:32.144 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:32.144 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:32.144 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:32.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.145 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:32.145 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:06:32.145 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 86.473458609000005, 2024-04-18T21:06:32.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012693296, 2024-04-18T21:06:32.145 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:32.145 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:32.145 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:32.145 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:32.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.145 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:32.145 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:06:32.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:32.145 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.145 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:32.146 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:06:32.146 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:32.146 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.146 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.146 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:32.146 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620228+0000", 2024-04-18T21:06:32.146 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:06:32.146 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.146 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.146 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:32.146 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620236+0000", 2024-04-18T21:06:32.146 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.303e-06 2024-04-18T21:06:32.146 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.146 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.146 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:32.147 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620255+0000", 2024-04-18T21:06:32.147 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9406e-05 2024-04-18T21:06:32.147 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.147 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.147 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:32.147 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620274+0000", 2024-04-18T21:06:32.147 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8940000000000002e-05 2024-04-18T21:06:32.147 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.147 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.147 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:32.147 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:06:32.147 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001558753 2024-04-18T21:06:32.147 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.147 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.148 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:32.148 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621879+0000", 2024-04-18T21:06:32.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6359000000000001e-05 2024-04-18T21:06:32.148 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.148 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.148 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:32.148 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632841+0000", 2024-04-18T21:06:32.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010961907 2024-04-18T21:06:32.148 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.148 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.148 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:32.148 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632920+0000", 2024-04-18T21:06:32.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8714999999999994e-05 2024-04-18T21:06:32.148 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:32.148 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:32.149 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:32.149 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.149 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.149 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:32.149 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:06:32.149 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 86.471912845999995, 2024-04-18T21:06:32.149 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013445702, 2024-04-18T21:06:32.149 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:32.149 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:32.149 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:32.149 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:32.149 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.149 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:32.149 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:06:32.149 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:32.149 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.150 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:32.150 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:06:32.150 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:32.150 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.150 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:32.150 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621774+0000", 2024-04-18T21:06:32.150 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2500000000000001e-06 2024-04-18T21:06:32.150 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.150 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:32.150 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621786+0000", 2024-04-18T21:06:32.150 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2636000000000001e-05 2024-04-18T21:06:32.151 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.151 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:32.151 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621814+0000", 2024-04-18T21:06:32.151 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7823000000000001e-05 2024-04-18T21:06:32.151 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.151 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:32.151 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621844+0000", 2024-04-18T21:06:32.151 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9589000000000001e-05 2024-04-18T21:06:32.151 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.151 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:32.151 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622253+0000", 2024-04-18T21:06:32.151 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040963700000000002 2024-04-18T21:06:32.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.152 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:32.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622304+0000", 2024-04-18T21:06:32.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0868999999999997e-05 2024-04-18T21:06:32.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.152 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:32.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635133+0000", 2024-04-18T21:06:32.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012829136 2024-04-18T21:06:32.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.152 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:32.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635218+0000", 2024-04-18T21:06:32.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4761999999999999e-05 2024-04-18T21:06:32.152 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:32.153 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:32.153 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:32.153 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.153 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.153 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:32.153 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:06:32.153 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 86.471786085999994, 2024-04-18T21:06:32.153 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014162065, 2024-04-18T21:06:32.153 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:32.153 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:32.153 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:32.153 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:32.153 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.153 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:32.153 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:06:32.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:32.154 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.154 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:32.154 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:06:32.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:32.154 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.154 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:32.154 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621900+0000", 2024-04-18T21:06:32.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:06:32.154 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.154 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:32.154 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621910+0000", 2024-04-18T21:06:32.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0207000000000001e-05 2024-04-18T21:06:32.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:32.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621932+0000", 2024-04-18T21:06:32.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1789000000000001e-05 2024-04-18T21:06:32.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:32.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621946+0000", 2024-04-18T21:06:32.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4212999999999999e-05 2024-04-18T21:06:32.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:32.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624477+0000", 2024-04-18T21:06:32.156 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025303470000000001 2024-04-18T21:06:32.156 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.156 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.156 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:32.156 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624525+0000", 2024-04-18T21:06:32.156 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8084999999999998e-05 2024-04-18T21:06:32.156 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.156 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.156 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:32.156 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635976+0000", 2024-04-18T21:06:32.156 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.011451368999999999 2024-04-18T21:06:32.156 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.156 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.156 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:32.156 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636061+0000", 2024-04-18T21:06:32.156 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5094999999999998e-05 2024-04-18T21:06:32.157 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:32.157 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:32.157 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:32.157 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.157 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.157 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:06:32.157 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:06:32.157 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 86.462550461000006, 2024-04-18T21:06:32.157 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0098014739999999993, 2024-04-18T21:06:32.157 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:32.157 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:32.157 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:06:32.157 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:32.157 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.157 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:32.157 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:06:32.158 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:32.158 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.158 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.158 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:32.158 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:06:32.158 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:32.158 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.158 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.158 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:32.158 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631136+0000", 2024-04-18T21:06:32.158 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0139999999999999e-06 2024-04-18T21:06:32.158 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.158 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.158 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:32.158 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631152+0000", 2024-04-18T21:06:32.159 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6365999999999999e-05 2024-04-18T21:06:32.159 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.159 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.159 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:32.159 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631961+0000", 2024-04-18T21:06:32.159 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00080873100000000003 2024-04-18T21:06:32.159 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.159 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.159 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:32.159 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632021+0000", 2024-04-18T21:06:32.159 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0541999999999997e-05 2024-04-18T21:06:32.159 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.159 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.159 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:32.159 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633539+0000", 2024-04-18T21:06:32.159 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015175639999999999 2024-04-18T21:06:32.160 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.160 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.160 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:32.160 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640936+0000", 2024-04-18T21:06:32.160 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007397257 2024-04-18T21:06:32.160 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:32.160 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:32.160 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:32.160 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.160 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.160 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-18T21:06:32.160 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:06:32.160 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 86.445089027999998, 2024-04-18T21:06:32.160 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00073592199999999997, 2024-04-18T21:06:32.161 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:32.161 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:32.161 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:32.161 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:32.161 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.161 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:32.161 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:06:32.161 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:32.161 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.161 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.161 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:32.161 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:06:32.161 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:32.161 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.161 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.161 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:32.161 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648597+0000", 2024-04-18T21:06:32.162 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:06:32.162 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.162 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.162 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:32.162 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648605+0000", 2024-04-18T21:06:32.162 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3960000000000006e-06 2024-04-18T21:06:32.162 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.162 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.162 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:32.162 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648625+0000", 2024-04-18T21:06:32.162 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9987e-05 2024-04-18T21:06:32.162 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.162 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.162 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:32.162 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648643+0000", 2024-04-18T21:06:32.163 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7079e-05 2024-04-18T21:06:32.163 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.163 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.163 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:32.163 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649043+0000", 2024-04-18T21:06:32.163 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040083399999999998 2024-04-18T21:06:32.163 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.163 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.163 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:32.163 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649062+0000", 2024-04-18T21:06:32.163 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9052999999999999e-05 2024-04-18T21:06:32.163 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.163 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.163 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:32.164 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649332+0000", 2024-04-18T21:06:32.164 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026971999999999999 2024-04-18T21:06:32.164 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:32.164 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:32.164 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:32.164 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.164 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.164 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:06:32.164 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:06:32.164 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 86.442314127000003, 2024-04-18T21:06:32.164 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00086123999999999999, 2024-04-18T21:06:32.164 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:32.164 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:32.164 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:06:32.164 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:32.165 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.165 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:32.165 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:06:32.165 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:32.165 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.165 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.165 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:32.165 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:06:32.165 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:32.165 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.165 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.165 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:32.165 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651372+0000", 2024-04-18T21:06:32.165 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7599999999999997e-07 2024-04-18T21:06:32.166 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.166 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.166 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:32.166 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651377+0000", 2024-04-18T21:06:32.166 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.22e-06 2024-04-18T21:06:32.166 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.166 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.166 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:32.166 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651394+0000", 2024-04-18T21:06:32.166 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6646999999999998e-05 2024-04-18T21:06:32.166 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.166 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.166 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:32.167 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651427+0000", 2024-04-18T21:06:32.167 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3682e-05 2024-04-18T21:06:32.167 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.167 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.167 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:32.167 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652029+0000", 2024-04-18T21:06:32.167 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00060152199999999995 2024-04-18T21:06:32.167 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.167 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.167 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:32.167 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652232+0000", 2024-04-18T21:06:32.167 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020359299999999999 2024-04-18T21:06:32.167 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:32.167 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:32.167 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:32.168 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.168 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.168 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:06:32.168 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:06:32.168 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 86.434287165000001, 2024-04-18T21:06:32.168 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0017426200000000001, 2024-04-18T21:06:32.168 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:32.168 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:32.168 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:32.168 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:32.168 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.168 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:32.168 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:06:32.168 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:32.168 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.169 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.169 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:32.169 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:06:32.169 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:32.169 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.169 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.169 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:32.169 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659399+0000", 2024-04-18T21:06:32.169 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6000000000000002e-07 2024-04-18T21:06:32.169 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.169 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.169 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:32.169 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659405+0000", 2024-04-18T21:06:32.169 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5069999999999997e-06 2024-04-18T21:06:32.170 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.170 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.170 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:32.170 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659425+0000", 2024-04-18T21:06:32.170 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.927e-05 2024-04-18T21:06:32.170 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.170 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.170 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:32.170 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659443+0000", 2024-04-18T21:06:32.170 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8051999999999999e-05 2024-04-18T21:06:32.170 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.170 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.170 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:32.171 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660973+0000", 2024-04-18T21:06:32.171 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001530106 2024-04-18T21:06:32.171 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.171 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.171 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:32.171 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660983+0000", 2024-04-18T21:06:32.171 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0516999999999999e-05 2024-04-18T21:06:32.171 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.171 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.171 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:32.171 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661141+0000", 2024-04-18T21:06:32.171 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015730799999999999 2024-04-18T21:06:32.171 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:32.171 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:32.171 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:32.171 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.172 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.172 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:06:32.172 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:06:32.172 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 86.434070539999993, 2024-04-18T21:06:32.172 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001812311, 2024-04-18T21:06:32.172 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:32.172 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:32.172 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:32.172 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:32.172 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.172 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:32.172 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:06:32.172 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:32.172 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.173 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.173 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:32.173 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:06:32.173 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:32.173 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.173 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.173 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:32.173 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659616+0000", 2024-04-18T21:06:32.173 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.277e-06 2024-04-18T21:06:32.173 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.173 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.173 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:32.173 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659625+0000", 2024-04-18T21:06:32.173 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5359999999999998e-06 2024-04-18T21:06:32.173 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.174 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.174 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:32.174 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659647+0000", 2024-04-18T21:06:32.174 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1857000000000001e-05 2024-04-18T21:06:32.174 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.174 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.174 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:32.174 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659664+0000", 2024-04-18T21:06:32.174 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6405999999999998e-05 2024-04-18T21:06:32.174 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.174 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.174 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:32.174 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661169+0000", 2024-04-18T21:06:32.175 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015054179999999999 2024-04-18T21:06:32.175 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.175 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.175 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:32.175 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661177+0000", 2024-04-18T21:06:32.175 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9680000000000006e-06 2024-04-18T21:06:32.175 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.175 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.175 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:32.175 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661427+0000", 2024-04-18T21:06:32.175 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024984900000000001 2024-04-18T21:06:32.175 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:32.175 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:32.175 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:32.175 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.176 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.176 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-18T21:06:32.176 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:06:32.176 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 84.481149931999994, 2024-04-18T21:06:32.176 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0030975030000000001, 2024-04-18T21:06:32.176 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:32.176 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:32.176 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:32.176 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:32.176 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.176 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:32.176 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:06:32.176 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:32.176 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.176 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.177 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:32.177 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:06:32.177 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:32.177 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.177 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.177 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:32.177 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612538+0000", 2024-04-18T21:06:32.177 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6259999999999999e-06 2024-04-18T21:06:32.177 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.177 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.177 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:32.177 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612552+0000", 2024-04-18T21:06:32.177 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4073999999999999e-05 2024-04-18T21:06:32.177 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.177 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.177 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:32.178 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612585+0000", 2024-04-18T21:06:32.178 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3504999999999999e-05 2024-04-18T21:06:32.178 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.178 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.178 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:32.178 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612601+0000", 2024-04-18T21:06:32.178 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5194000000000001e-05 2024-04-18T21:06:32.178 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.178 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.178 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:32.178 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612746+0000", 2024-04-18T21:06:32.178 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145666 2024-04-18T21:06:32.178 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.178 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.179 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:32.179 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612953+0000", 2024-04-18T21:06:32.179 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000207109 2024-04-18T21:06:32.179 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.179 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.179 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:32.179 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.613134+0000", 2024-04-18T21:06:32.179 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018041300000000001 2024-04-18T21:06:32.179 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.179 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.179 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:32.179 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.614411+0000", 2024-04-18T21:06:32.179 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0012769929999999999 2024-04-18T21:06:32.179 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.179 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.180 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:32.180 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615441+0000", 2024-04-18T21:06:32.180 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001029917 2024-04-18T21:06:32.180 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.180 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.180 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:32.180 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615522+0000", 2024-04-18T21:06:32.180 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1142000000000003e-05 2024-04-18T21:06:32.180 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.180 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.180 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:32.180 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615633+0000", 2024-04-18T21:06:32.180 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000110864 2024-04-18T21:06:32.180 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:32.180 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:32.181 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:32.181 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.181 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.181 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-18T21:06:32.181 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:06:32.181 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 66.478864121000001, 2024-04-18T21:06:32.181 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088979039999999999, 2024-04-18T21:06:32.181 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:32.181 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:32.181 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:32.181 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:32.181 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.181 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:32.181 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:06:32.181 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:32.181 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.182 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.182 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:32.182 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:06:32.182 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:32.182 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.182 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.182 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:32.182 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614825+0000", 2024-04-18T21:06:32.182 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4829999999999999e-06 2024-04-18T21:06:32.182 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.182 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.182 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:32.182 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614843+0000", 2024-04-18T21:06:32.182 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8777e-05 2024-04-18T21:06:32.182 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.182 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.183 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:32.183 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614884+0000", 2024-04-18T21:06:32.183 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1051999999999999e-05 2024-04-18T21:06:32.183 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.183 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.183 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:32.183 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614903+0000", 2024-04-18T21:06:32.183 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9069999999999999e-05 2024-04-18T21:06:32.183 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.183 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.183 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:32.183 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615047+0000", 2024-04-18T21:06:32.183 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014374400000000001 2024-04-18T21:06:32.183 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.183 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.183 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:32.184 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615061+0000", 2024-04-18T21:06:32.184 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4063000000000001e-05 2024-04-18T21:06:32.184 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.184 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.184 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:32.184 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621064+0000", 2024-04-18T21:06:32.184 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0060029200000000001 2024-04-18T21:06:32.184 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.184 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.184 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:32.184 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621211+0000", 2024-04-18T21:06:32.184 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000147224 2024-04-18T21:06:32.184 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.184 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.184 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:32.184 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621396+0000", 2024-04-18T21:06:32.185 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018454699999999999 2024-04-18T21:06:32.185 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.185 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.185 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:32.185 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.622517+0000", 2024-04-18T21:06:32.185 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001121424 2024-04-18T21:06:32.185 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.185 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.185 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:32.185 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623571+0000", 2024-04-18T21:06:32.185 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010538660000000001 2024-04-18T21:06:32.185 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.185 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.185 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:32.185 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623658+0000", 2024-04-18T21:06:32.185 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6439000000000004e-05 2024-04-18T21:06:32.186 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:32.186 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:32.186 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:32.186 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623719+0000", 2024-04-18T21:06:32.186 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1295000000000002e-05 2024-04-18T21:06:32.186 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:32.186 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:32.186 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:32.186 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:32.186 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:32.186 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:32.188 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:32.186+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:32.188 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:32.289 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:32.290+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:32.319 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:32.319 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:06:32.320 INFO:teuthology.orchestra.run.smithi132.stdout: "num_ops": 0 2024-04-18T21:06:32.320 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:32.333 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:32.390 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:32.390+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:32.450 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:32.450 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:06:32.451 INFO:teuthology.orchestra.run.smithi132.stdout: "complaint_time": 30, 2024-04-18T21:06:32.451 INFO:teuthology.orchestra.run.smithi132.stdout: "num_blocked_ops": 0 2024-04-18T21:06:32.451 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:32.464 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:32.491 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:32.490+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:32.584 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:32.585 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 20, 2024-04-18T21:06:32.585 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 600, 2024-04-18T21:06:32.585 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [ 2024-04-18T21:06:32.585 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.585 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:32.585 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:06:32.585 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 97.672973217000006, 2024-04-18T21:06:32.585 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.02518273, 2024-04-18T21:06:32.585 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:32.585 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:32.585 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:32.585 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:32.585 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:32.585 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:32.586 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 141 2024-04-18T21:06:32.586 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.586 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:32.586 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.586 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:32.586 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:06:32.586 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:32.586 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.586 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.586 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:32.586 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:06:32.586 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:32.586 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.586 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.586 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:32.587 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911562+0000", 2024-04-18T21:06:32.587 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9300000000000006e-07 2024-04-18T21:06:32.587 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.587 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.587 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:32.587 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911569+0000", 2024-04-18T21:06:32.587 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0169999999999999e-06 2024-04-18T21:06:32.587 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.587 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.587 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:32.587 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911582+0000", 2024-04-18T21:06:32.587 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.343e-05 2024-04-18T21:06:32.587 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.587 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.588 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:32.588 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911590+0000", 2024-04-18T21:06:32.588 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.413e-06 2024-04-18T21:06:32.588 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.588 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.588 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:32.588 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.933922+0000", 2024-04-18T21:06:32.588 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.022332093000000001 2024-04-18T21:06:32.588 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.588 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.588 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:32.588 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.934155+0000", 2024-04-18T21:06:32.588 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023378900000000001 2024-04-18T21:06:32.588 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.589 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.589 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:32.589 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.934514+0000", 2024-04-18T21:06:32.589 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00035859200000000003 2024-04-18T21:06:32.589 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.589 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.589 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:32.589 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.935973+0000", 2024-04-18T21:06:32.589 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001458705 2024-04-18T21:06:32.589 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.589 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.589 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:32.589 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936488+0000", 2024-04-18T21:06:32.589 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00051550000000000001 2024-04-18T21:06:32.589 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.590 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.590 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:32.590 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936636+0000", 2024-04-18T21:06:32.590 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014779800000000001 2024-04-18T21:06:32.590 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.590 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.590 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:32.590 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936743+0000", 2024-04-18T21:06:32.590 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010739999999999999 2024-04-18T21:06:32.590 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:32.590 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:32.590 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:32.591 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.591 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.591 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:32.591 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:32.591 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 97.555774243000002, 2024-04-18T21:06:32.591 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023654959999999999, 2024-04-18T21:06:32.591 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:32.591 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:32.591 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:32.591 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:32.591 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:32.591 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:32.591 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 163 2024-04-18T21:06:32.591 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.592 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:32.592 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.592 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:32.592 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:32.592 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:32.592 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.592 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.592 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:32.592 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:32.592 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:32.592 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.592 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.592 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:32.592 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:32.593 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0999999999999998e-07 2024-04-18T21:06:32.593 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.593 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.593 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:32.593 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028766+0000", 2024-04-18T21:06:32.593 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4700000000000001e-06 2024-04-18T21:06:32.593 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.593 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.593 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:32.593 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028775+0000", 2024-04-18T21:06:32.593 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.3190000000000001e-06 2024-04-18T21:06:32.593 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.593 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.593 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:32.594 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028782+0000", 2024-04-18T21:06:32.594 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.2300000000000002e-06 2024-04-18T21:06:32.594 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.594 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.594 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:32.594 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046667+0000", 2024-04-18T21:06:32.594 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017884356000000001 2024-04-18T21:06:32.594 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.594 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.594 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:32.594 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046788+0000", 2024-04-18T21:06:32.594 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012125000000000001 2024-04-18T21:06:32.594 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.594 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.594 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:32.595 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046982+0000", 2024-04-18T21:06:32.595 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019394 2024-04-18T21:06:32.595 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.595 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.595 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:32.595 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051969+0000", 2024-04-18T21:06:32.595 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0049868150000000003 2024-04-18T21:06:32.595 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.595 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.595 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:32.595 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052089+0000", 2024-04-18T21:06:32.595 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011993 2024-04-18T21:06:32.595 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.595 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.595 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:32.596 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052292+0000", 2024-04-18T21:06:32.596 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020345699999999999 2024-04-18T21:06:32.596 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.596 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.596 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:32.596 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052415+0000", 2024-04-18T21:06:32.596 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000122483 2024-04-18T21:06:32.596 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:32.596 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:32.596 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:32.596 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.596 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.596 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:32.596 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:32.596 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 97.555740010999997, 2024-04-18T21:06:32.597 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023864586, 2024-04-18T21:06:32.597 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:32.597 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:32.597 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:32.597 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:32.597 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:32.597 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:32.597 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 164 2024-04-18T21:06:32.597 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.597 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:32.597 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.597 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:32.597 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:32.597 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:32.597 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.597 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.598 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:32.598 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:32.598 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:32.598 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.598 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.598 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:32.598 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028795+0000", 2024-04-18T21:06:32.598 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7999999999999995e-07 2024-04-18T21:06:32.598 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.598 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.598 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:32.598 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028884+0000", 2024-04-18T21:06:32.598 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8997000000000002e-05 2024-04-18T21:06:32.599 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.599 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.599 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:32.599 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028895+0000", 2024-04-18T21:06:32.599 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1647e-05 2024-04-18T21:06:32.599 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.599 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.599 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:32.599 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028903+0000", 2024-04-18T21:06:32.599 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.909e-06 2024-04-18T21:06:32.599 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.599 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.599 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:32.599 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.047818+0000", 2024-04-18T21:06:32.600 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018914337 2024-04-18T21:06:32.600 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.600 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.600 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:32.600 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.048094+0000", 2024-04-18T21:06:32.600 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00027653500000000001 2024-04-18T21:06:32.600 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.600 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.600 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:32.600 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.048471+0000", 2024-04-18T21:06:32.600 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00037705799999999999 2024-04-18T21:06:32.600 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.600 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.600 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:32.600 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052516+0000", 2024-04-18T21:06:32.600 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0040452739999999997 2024-04-18T21:06:32.601 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.601 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.601 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:32.601 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052535+0000", 2024-04-18T21:06:32.601 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.84e-05 2024-04-18T21:06:32.601 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.601 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.601 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:32.601 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052603+0000", 2024-04-18T21:06:32.601 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.8095000000000004e-05 2024-04-18T21:06:32.601 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.601 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.601 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:32.601 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052659+0000", 2024-04-18T21:06:32.601 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5653999999999999e-05 2024-04-18T21:06:32.602 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:32.602 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:32.602 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:32.602 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.602 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.602 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:32.602 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:32.602 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 97.555616568000005, 2024-04-18T21:06:32.602 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024516458000000001, 2024-04-18T21:06:32.602 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:32.602 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:32.602 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:32.602 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:32.602 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:32.603 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:32.603 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 165 2024-04-18T21:06:32.603 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.603 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:32.603 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.603 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:32.603 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:32.603 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:32.603 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.603 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.603 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:32.603 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:32.603 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:32.603 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.604 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.604 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:32.604 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028918+0000", 2024-04-18T21:06:32.604 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8000000000000005e-07 2024-04-18T21:06:32.604 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.604 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.604 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:32.604 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028924+0000", 2024-04-18T21:06:32.604 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5659999999999997e-06 2024-04-18T21:06:32.604 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.604 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.604 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:32.604 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028933+0000", 2024-04-18T21:06:32.604 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.38e-06 2024-04-18T21:06:32.604 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.605 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.605 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:32.605 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028940+0000", 2024-04-18T21:06:32.605 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0060000000000003e-06 2024-04-18T21:06:32.605 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.605 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.605 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:32.605 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.050846+0000", 2024-04-18T21:06:32.605 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021906119000000002 2024-04-18T21:06:32.605 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.605 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.605 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:32.605 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051025+0000", 2024-04-18T21:06:32.605 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017850799999999999 2024-04-18T21:06:32.605 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.606 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.606 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:32.606 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051221+0000", 2024-04-18T21:06:32.606 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019608700000000001 2024-04-18T21:06:32.606 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.606 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.606 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:32.606 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052675+0000", 2024-04-18T21:06:32.606 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0014537899999999999 2024-04-18T21:06:32.606 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.606 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.606 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:32.606 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053311+0000", 2024-04-18T21:06:32.606 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00063613299999999999 2024-04-18T21:06:32.606 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.607 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.607 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:32.607 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053381+0000", 2024-04-18T21:06:32.607 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0074999999999996e-05 2024-04-18T21:06:32.607 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.607 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.607 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:32.607 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053434+0000", 2024-04-18T21:06:32.607 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3013999999999998e-05 2024-04-18T21:06:32.607 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:32.607 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:32.607 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:32.607 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.607 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.608 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:32.608 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:32.608 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 97.442311089, 2024-04-18T21:06:32.608 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023772793, 2024-04-18T21:06:32.608 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:32.608 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:32.608 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:32.608 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:32.608 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:32.608 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:32.608 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 187 2024-04-18T21:06:32.608 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.608 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:32.608 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.608 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:32.609 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:32.609 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:32.609 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.609 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.609 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:32.609 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:32.609 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:32.609 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.609 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.609 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:32.609 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142224+0000", 2024-04-18T21:06:32.609 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.47e-07 2024-04-18T21:06:32.609 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.609 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.610 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:32.610 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142233+0000", 2024-04-18T21:06:32.610 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0729999999999994e-06 2024-04-18T21:06:32.610 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.610 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.610 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:32.610 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142255+0000", 2024-04-18T21:06:32.610 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.2535999999999999e-05 2024-04-18T21:06:32.610 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.610 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.610 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:32.610 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142268+0000", 2024-04-18T21:06:32.610 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2686e-05 2024-04-18T21:06:32.610 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.611 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.611 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:32.611 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160497+0000", 2024-04-18T21:06:32.611 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018228779000000001 2024-04-18T21:06:32.611 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.611 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.611 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:32.611 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160634+0000", 2024-04-18T21:06:32.611 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000137315 2024-04-18T21:06:32.611 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.611 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.611 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:32.611 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160831+0000", 2024-04-18T21:06:32.611 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019683100000000001 2024-04-18T21:06:32.612 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.612 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.612 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:32.612 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165129+0000", 2024-04-18T21:06:32.612 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0042981299999999998 2024-04-18T21:06:32.612 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.612 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.612 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:32.612 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165776+0000", 2024-04-18T21:06:32.612 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00064702900000000003 2024-04-18T21:06:32.612 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.612 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.612 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:32.612 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165921+0000", 2024-04-18T21:06:32.613 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014506 2024-04-18T21:06:32.613 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.613 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.613 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:32.613 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165996+0000", 2024-04-18T21:06:32.613 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.4406999999999994e-05 2024-04-18T21:06:32.613 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:32.613 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:32.613 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:32.613 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.613 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.613 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:32.613 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:32.613 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 97.442250490999996, 2024-04-18T21:06:32.614 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026802157, 2024-04-18T21:06:32.614 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:32.614 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:32.614 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:32.614 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:32.614 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:32.614 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:32.614 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 188 2024-04-18T21:06:32.614 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.614 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:32.614 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.614 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:32.614 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:32.614 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:32.614 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.615 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.615 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:32.615 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:32.615 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:32.615 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.615 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.615 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:32.615 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142284+0000", 2024-04-18T21:06:32.615 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4e-07 2024-04-18T21:06:32.615 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.615 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.615 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:32.615 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142374+0000", 2024-04-18T21:06:32.615 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0099999999999995e-05 2024-04-18T21:06:32.615 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.615 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.616 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:32.616 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142386+0000", 2024-04-18T21:06:32.616 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1770000000000001e-05 2024-04-18T21:06:32.616 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.616 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.616 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:32.616 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142394+0000", 2024-04-18T21:06:32.616 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.2130000000000008e-06 2024-04-18T21:06:32.616 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.616 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.616 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:32.616 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.161743+0000", 2024-04-18T21:06:32.616 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019348644000000002 2024-04-18T21:06:32.616 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.616 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.617 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:32.617 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.161865+0000", 2024-04-18T21:06:32.617 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012210899999999999 2024-04-18T21:06:32.617 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.617 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.617 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:32.617 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.162055+0000", 2024-04-18T21:06:32.617 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000189994 2024-04-18T21:06:32.617 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.617 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.617 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:32.617 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165735+0000", 2024-04-18T21:06:32.617 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0036803270000000002 2024-04-18T21:06:32.617 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.617 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.618 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:32.618 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.168911+0000", 2024-04-18T21:06:32.618 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0031753689999999999 2024-04-18T21:06:32.618 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.618 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.618 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:32.618 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169012+0000", 2024-04-18T21:06:32.618 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010157699999999999 2024-04-18T21:06:32.618 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.618 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.618 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:32.618 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169086+0000", 2024-04-18T21:06:32.618 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3213999999999994e-05 2024-04-18T21:06:32.618 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:32.619 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:32.619 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:32.619 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.619 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.619 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:32.619 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:32.619 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 97.442125184999995, 2024-04-18T21:06:32.619 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026811423000000001, 2024-04-18T21:06:32.619 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:32.619 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:32.619 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:32.619 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:32.619 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:32.619 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:32.619 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 189 2024-04-18T21:06:32.619 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.620 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:32.620 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.620 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:32.620 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:32.620 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:32.620 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.620 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.620 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:32.620 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:32.620 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:32.620 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.620 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.620 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:32.620 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142410+0000", 2024-04-18T21:06:32.621 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:06:32.621 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.621 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.621 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:32.621 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142415+0000", 2024-04-18T21:06:32.621 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.7939999999999999e-06 2024-04-18T21:06:32.621 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.621 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.621 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:32.621 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142470+0000", 2024-04-18T21:06:32.621 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4537999999999999e-05 2024-04-18T21:06:32.621 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.621 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.621 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:32.621 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142481+0000", 2024-04-18T21:06:32.622 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0966e-05 2024-04-18T21:06:32.622 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.622 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.622 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:32.622 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.163493+0000", 2024-04-18T21:06:32.622 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021012444000000002 2024-04-18T21:06:32.622 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.622 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.622 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:32.622 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.163727+0000", 2024-04-18T21:06:32.622 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000233339 2024-04-18T21:06:32.622 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.622 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.622 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:32.623 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.164102+0000", 2024-04-18T21:06:32.623 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000374872 2024-04-18T21:06:32.623 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.623 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.623 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:32.623 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.166528+0000", 2024-04-18T21:06:32.623 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0024258729999999998 2024-04-18T21:06:32.623 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.623 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.623 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:32.623 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169101+0000", 2024-04-18T21:06:32.623 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0025737680000000001 2024-04-18T21:06:32.623 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.623 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.623 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:32.623 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169171+0000", 2024-04-18T21:06:32.624 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0148000000000007e-05 2024-04-18T21:06:32.624 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.624 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.624 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:32.624 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169220+0000", 2024-04-18T21:06:32.624 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8767999999999998e-05 2024-04-18T21:06:32.624 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:32.624 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:32.624 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:32.624 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.624 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.624 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:32.624 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:32.624 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 86.968552633000002, 2024-04-18T21:06:32.625 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024082777999999999, 2024-04-18T21:06:32.625 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:32.625 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:32.625 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:32.625 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:32.625 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.625 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:32.625 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:32.625 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:32.625 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.625 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.625 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:32.625 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:32.625 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:32.625 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.626 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.626 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:32.626 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615984+0000", 2024-04-18T21:06:32.626 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.9869999999999999e-06 2024-04-18T21:06:32.626 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.626 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.626 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:32.626 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615999+0000", 2024-04-18T21:06:32.626 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4646e-05 2024-04-18T21:06:32.626 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.626 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.626 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:32.626 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616028+0000", 2024-04-18T21:06:32.626 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8952999999999999e-05 2024-04-18T21:06:32.627 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.627 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.627 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:32.627 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616052+0000", 2024-04-18T21:06:32.627 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.3941999999999999e-05 2024-04-18T21:06:32.627 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.627 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.627 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:32.627 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618010+0000", 2024-04-18T21:06:32.627 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0019581780000000001 2024-04-18T21:06:32.627 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.627 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.627 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:32.627 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618322+0000", 2024-04-18T21:06:32.627 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00031158899999999997 2024-04-18T21:06:32.628 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.628 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.628 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:32.628 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618587+0000", 2024-04-18T21:06:32.628 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00026495700000000002 2024-04-18T21:06:32.628 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.628 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.628 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:32.628 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629262+0000", 2024-04-18T21:06:32.628 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010675877 2024-04-18T21:06:32.628 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.628 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.628 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:32.628 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.639773+0000", 2024-04-18T21:06:32.629 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0105109 2024-04-18T21:06:32.629 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.629 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.629 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:32.629 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.639926+0000", 2024-04-18T21:06:32.629 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000152349 2024-04-18T21:06:32.629 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.629 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.629 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:32.629 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640064+0000", 2024-04-18T21:06:32.629 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0001384 2024-04-18T21:06:32.629 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:32.629 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:32.629 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:32.629 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.630 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.630 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:32.630 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:32.630 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 86.968439958999994, 2024-04-18T21:06:32.630 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030215005999999999, 2024-04-18T21:06:32.630 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:32.630 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:32.630 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:32.630 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:32.630 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.630 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:32.630 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:32.630 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:32.630 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.631 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.631 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:32.631 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:32.631 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:32.631 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.631 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.631 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:32.631 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616095+0000", 2024-04-18T21:06:32.631 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.446e-06 2024-04-18T21:06:32.631 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.631 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.631 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:32.631 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616104+0000", 2024-04-18T21:06:32.631 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6200000000000005e-06 2024-04-18T21:06:32.632 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.632 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.632 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:32.632 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616132+0000", 2024-04-18T21:06:32.632 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7668999999999999e-05 2024-04-18T21:06:32.632 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.632 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.632 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:32.632 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616149+0000", 2024-04-18T21:06:32.632 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7047000000000001e-05 2024-04-18T21:06:32.632 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.632 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.632 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:32.632 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619287+0000", 2024-04-18T21:06:32.632 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0031381450000000002 2024-04-18T21:06:32.633 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.633 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.633 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:32.633 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619503+0000", 2024-04-18T21:06:32.633 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000216522 2024-04-18T21:06:32.633 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.633 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.633 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:32.633 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619930+0000", 2024-04-18T21:06:32.633 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00042604900000000001 2024-04-18T21:06:32.633 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.633 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.633 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:32.634 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629281+0000", 2024-04-18T21:06:32.634 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0093512230000000005 2024-04-18T21:06:32.634 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.634 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.634 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:32.634 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646022+0000", 2024-04-18T21:06:32.634 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016741156 2024-04-18T21:06:32.634 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.634 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.634 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:32.634 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646198+0000", 2024-04-18T21:06:32.634 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000176009 2024-04-18T21:06:32.634 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.634 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.634 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:32.635 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646309+0000", 2024-04-18T21:06:32.635 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011112000000000001 2024-04-18T21:06:32.635 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:32.635 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:32.635 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:32.635 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.635 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.635 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:32.635 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:32.635 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 86.968355134999996, 2024-04-18T21:06:32.635 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030501176000000001, 2024-04-18T21:06:32.635 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:32.635 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:32.635 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:32.635 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:32.636 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.636 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:32.636 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:32.636 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:32.636 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.636 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.636 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:32.636 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:32.636 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:32.636 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.636 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.636 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:32.636 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616180+0000", 2024-04-18T21:06:32.636 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1000000000000001e-06 2024-04-18T21:06:32.636 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.637 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.637 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:32.637 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616188+0000", 2024-04-18T21:06:32.637 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4069999999999993e-06 2024-04-18T21:06:32.637 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.637 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.637 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:32.637 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616207+0000", 2024-04-18T21:06:32.637 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8335999999999999e-05 2024-04-18T21:06:32.637 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.637 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.637 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:32.637 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616225+0000", 2024-04-18T21:06:32.637 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8652999999999999e-05 2024-04-18T21:06:32.637 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.638 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.638 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:32.638 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620977+0000", 2024-04-18T21:06:32.638 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047512220000000003 2024-04-18T21:06:32.638 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.638 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.638 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:32.638 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621279+0000", 2024-04-18T21:06:32.638 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000302646 2024-04-18T21:06:32.638 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.638 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.638 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:32.638 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621584+0000", 2024-04-18T21:06:32.638 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000305142 2024-04-18T21:06:32.639 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.639 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.639 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:32.639 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629352+0000", 2024-04-18T21:06:32.639 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0077673689999999997 2024-04-18T21:06:32.639 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.639 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.639 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:32.639 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646480+0000", 2024-04-18T21:06:32.639 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017128259 2024-04-18T21:06:32.639 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.639 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.639 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:32.640 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646591+0000", 2024-04-18T21:06:32.640 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011113899999999999 2024-04-18T21:06:32.640 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.640 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.640 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:32.640 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646680+0000", 2024-04-18T21:06:32.640 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8902999999999999e-05 2024-04-18T21:06:32.640 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:32.640 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:32.640 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:32.640 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.640 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.640 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:32.640 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:32.640 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 86.968288635999997, 2024-04-18T21:06:32.640 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030779760999999999, 2024-04-18T21:06:32.641 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:32.641 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:32.641 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:32.641 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:32.641 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.641 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:32.641 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:32.641 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:32.641 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.641 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.641 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:32.641 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:32.641 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:32.641 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.641 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.642 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:32.642 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616246+0000", 2024-04-18T21:06:32.642 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0499999999999999e-06 2024-04-18T21:06:32.642 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.642 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.642 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:32.642 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616253+0000", 2024-04-18T21:06:32.642 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.5989999999999998e-06 2024-04-18T21:06:32.642 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.642 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.642 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:32.642 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616273+0000", 2024-04-18T21:06:32.642 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9916999999999999e-05 2024-04-18T21:06:32.642 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.643 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.643 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:32.643 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616287+0000", 2024-04-18T21:06:32.643 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3669000000000001e-05 2024-04-18T21:06:32.643 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.643 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.643 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:32.643 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622203+0000", 2024-04-18T21:06:32.643 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.005916737 2024-04-18T21:06:32.643 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.643 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.643 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:32.643 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622379+0000", 2024-04-18T21:06:32.643 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000175596 2024-04-18T21:06:32.643 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.643 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.644 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:32.644 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622707+0000", 2024-04-18T21:06:32.644 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00032784600000000002 2024-04-18T21:06:32.644 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.644 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.644 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:32.644 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629366+0000", 2024-04-18T21:06:32.644 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0066593279999999999 2024-04-18T21:06:32.644 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.644 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.644 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:32.644 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646813+0000", 2024-04-18T21:06:32.644 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017447059000000001 2024-04-18T21:06:32.644 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.645 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.645 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:32.645 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646946+0000", 2024-04-18T21:06:32.645 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013301200000000001 2024-04-18T21:06:32.645 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.645 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.645 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:32.645 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647025+0000", 2024-04-18T21:06:32.645 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8948000000000004e-05 2024-04-18T21:06:32.645 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:32.645 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:32.645 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:32.645 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.645 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.645 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:32.646 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:32.646 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 86.968204818000004, 2024-04-18T21:06:32.646 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.031512165000000002, 2024-04-18T21:06:32.646 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:32.646 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:32.646 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:32.646 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:32.646 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.646 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:32.646 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:32.646 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:32.646 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.646 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.646 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:32.646 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:32.647 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:32.647 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.647 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.647 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:32.647 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616330+0000", 2024-04-18T21:06:32.647 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.15e-06 2024-04-18T21:06:32.647 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.647 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.647 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:32.647 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616337+0000", 2024-04-18T21:06:32.647 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.1289999999999998e-06 2024-04-18T21:06:32.647 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.647 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.647 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:32.647 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616447+0000", 2024-04-18T21:06:32.647 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109561 2024-04-18T21:06:32.648 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.648 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.648 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:32.648 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616496+0000", 2024-04-18T21:06:32.648 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8591999999999998e-05 2024-04-18T21:06:32.648 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.648 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.648 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:32.648 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.623786+0000", 2024-04-18T21:06:32.648 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0072906799999999999 2024-04-18T21:06:32.648 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.648 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.648 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:32.648 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.623973+0000", 2024-04-18T21:06:32.648 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018717199999999999 2024-04-18T21:06:32.649 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.649 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.649 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:32.649 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624260+0000", 2024-04-18T21:06:32.649 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00028630600000000001 2024-04-18T21:06:32.649 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.649 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.649 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:32.649 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629381+0000", 2024-04-18T21:06:32.649 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0051211340000000003 2024-04-18T21:06:32.649 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.649 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.649 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:32.649 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647631+0000", 2024-04-18T21:06:32.650 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018249771000000001 2024-04-18T21:06:32.650 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.650 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.650 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:32.650 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647761+0000", 2024-04-18T21:06:32.650 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013037300000000001 2024-04-18T21:06:32.650 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.650 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.650 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:32.650 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647841+0000", 2024-04-18T21:06:32.650 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.0296999999999994e-05 2024-04-18T21:06:32.650 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:32.650 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:32.650 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:32.651 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.651 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.651 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:32.651 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:32.651 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 86.967999333999998, 2024-04-18T21:06:32.651 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043251955000000002, 2024-04-18T21:06:32.651 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:32.651 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:32.651 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:32.651 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:32.651 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.651 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:32.651 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:32.651 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:32.651 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.651 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.652 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:32.652 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:32.652 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:32.652 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.652 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.652 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:32.652 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616536+0000", 2024-04-18T21:06:32.652 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2869999999999999e-06 2024-04-18T21:06:32.652 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.652 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.652 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:32.652 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616572+0000", 2024-04-18T21:06:32.652 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.6261999999999999e-05 2024-04-18T21:06:32.652 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.652 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.653 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:32.653 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616593+0000", 2024-04-18T21:06:32.653 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1310000000000001e-05 2024-04-18T21:06:32.653 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.653 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.653 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:32.653 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616614+0000", 2024-04-18T21:06:32.653 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.0936000000000001e-05 2024-04-18T21:06:32.653 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.653 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.653 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:32.653 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629501+0000", 2024-04-18T21:06:32.653 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.012886819000000001 2024-04-18T21:06:32.653 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.653 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.653 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:32.653 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629696+0000", 2024-04-18T21:06:32.654 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019485499999999999 2024-04-18T21:06:32.654 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.654 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.654 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:32.654 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629940+0000", 2024-04-18T21:06:32.654 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00024386399999999999 2024-04-18T21:06:32.654 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.654 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.654 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:32.654 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640100+0000", 2024-04-18T21:06:32.654 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010159645 2024-04-18T21:06:32.654 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.654 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.654 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:32.655 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659516+0000", 2024-04-18T21:06:32.655 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019416563000000001 2024-04-18T21:06:32.655 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.655 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.655 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:32.655 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659684+0000", 2024-04-18T21:06:32.655 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016750900000000001 2024-04-18T21:06:32.655 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.655 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.655 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:32.655 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659787+0000", 2024-04-18T21:06:32.655 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000102905 2024-04-18T21:06:32.655 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:32.655 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:32.655 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:32.655 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.656 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.656 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:32.656 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:32.656 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 86.967894212000004, 2024-04-18T21:06:32.656 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043581898000000001, 2024-04-18T21:06:32.656 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:32.656 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:32.656 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:32.656 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:32.656 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.656 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:32.656 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:32.656 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:32.656 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.656 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.656 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:32.657 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:32.657 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:32.657 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.657 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.657 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:32.657 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616641+0000", 2024-04-18T21:06:32.657 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:06:32.657 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.657 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.657 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:32.657 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616648+0000", 2024-04-18T21:06:32.657 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3860000000000001e-06 2024-04-18T21:06:32.657 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.657 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.657 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:32.658 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616666+0000", 2024-04-18T21:06:32.658 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7583000000000001e-05 2024-04-18T21:06:32.658 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.658 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.658 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:32.658 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616679+0000", 2024-04-18T21:06:32.658 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3322999999999999e-05 2024-04-18T21:06:32.658 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.658 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.658 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:32.658 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630373+0000", 2024-04-18T21:06:32.658 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013694207999999999 2024-04-18T21:06:32.658 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.659 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.659 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:32.659 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630545+0000", 2024-04-18T21:06:32.659 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000171683 2024-04-18T21:06:32.659 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.659 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.659 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:32.659 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630728+0000", 2024-04-18T21:06:32.659 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000182599 2024-04-18T21:06:32.659 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.659 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.659 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:32.659 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640600+0000", 2024-04-18T21:06:32.659 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0098726119999999994 2024-04-18T21:06:32.659 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.660 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.660 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:32.660 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659927+0000", 2024-04-18T21:06:32.660 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019326724999999999 2024-04-18T21:06:32.660 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.660 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.660 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:32.660 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660112+0000", 2024-04-18T21:06:32.660 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000185203 2024-04-18T21:06:32.660 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.660 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.660 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:32.660 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660222+0000", 2024-04-18T21:06:32.660 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109343 2024-04-18T21:06:32.660 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:32.660 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:32.661 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:32.661 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.661 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.661 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:32.661 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:32.661 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 86.967028854000006, 2024-04-18T21:06:32.661 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043121310000000003, 2024-04-18T21:06:32.661 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:32.661 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:32.661 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:32.661 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:32.661 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.661 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:32.661 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:32.661 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:32.662 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.662 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.662 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:32.662 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:32.662 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:32.662 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.662 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.662 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:32.662 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617506+0000", 2024-04-18T21:06:32.662 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9999999999999995e-07 2024-04-18T21:06:32.662 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.662 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.662 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:32.662 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617513+0000", 2024-04-18T21:06:32.662 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.9700000000000002e-06 2024-04-18T21:06:32.663 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.663 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.663 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:32.663 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617531+0000", 2024-04-18T21:06:32.663 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8105999999999999e-05 2024-04-18T21:06:32.663 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.663 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.663 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:32.663 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617545+0000", 2024-04-18T21:06:32.663 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3703000000000001e-05 2024-04-18T21:06:32.663 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.663 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.663 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:32.663 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632129+0000", 2024-04-18T21:06:32.663 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.014584135999999999 2024-04-18T21:06:32.664 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.664 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.664 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:32.664 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632361+0000", 2024-04-18T21:06:32.664 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023171800000000001 2024-04-18T21:06:32.664 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.664 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.664 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:32.664 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632804+0000", 2024-04-18T21:06:32.664 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000443549 2024-04-18T21:06:32.664 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.664 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.664 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:32.665 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646340+0000", 2024-04-18T21:06:32.665 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013535902000000001 2024-04-18T21:06:32.665 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.665 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.665 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:32.665 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660363+0000", 2024-04-18T21:06:32.665 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01402318 2024-04-18T21:06:32.665 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.665 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.665 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:32.665 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660523+0000", 2024-04-18T21:06:32.665 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00015989899999999999 2024-04-18T21:06:32.665 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.665 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.665 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:32.665 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660626+0000", 2024-04-18T21:06:32.665 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010314699999999999 2024-04-18T21:06:32.666 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:32.666 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:32.666 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:32.666 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.666 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.666 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:32.666 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:32.666 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 86.966889160999997, 2024-04-18T21:06:32.666 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024927483, 2024-04-18T21:06:32.666 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:32.666 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:32.666 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:32.666 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:32.666 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.667 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:32.667 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:32.667 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:32.667 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.667 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.667 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:32.667 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:32.667 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:32.667 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.667 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.667 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:32.667 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617646+0000", 2024-04-18T21:06:32.667 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3030000000000001e-06 2024-04-18T21:06:32.667 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.667 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.668 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:32.668 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617653+0000", 2024-04-18T21:06:32.668 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7530000000000004e-06 2024-04-18T21:06:32.668 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.668 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.668 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:32.668 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617673+0000", 2024-04-18T21:06:32.668 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9967e-05 2024-04-18T21:06:32.668 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.668 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.668 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:32.668 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617688+0000", 2024-04-18T21:06:32.668 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5153e-05 2024-04-18T21:06:32.668 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.668 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.668 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:32.669 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619244+0000", 2024-04-18T21:06:32.669 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001555531 2024-04-18T21:06:32.669 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.669 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.669 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:32.669 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619361+0000", 2024-04-18T21:06:32.669 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011784400000000001 2024-04-18T21:06:32.669 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.669 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.669 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:32.669 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619604+0000", 2024-04-18T21:06:32.669 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000243007 2024-04-18T21:06:32.669 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.669 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.669 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:32.669 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.625480+0000", 2024-04-18T21:06:32.670 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0058759349999999997 2024-04-18T21:06:32.670 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.670 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.670 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:32.670 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642342+0000", 2024-04-18T21:06:32.670 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016861373999999998 2024-04-18T21:06:32.670 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.670 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.670 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:32.670 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642484+0000", 2024-04-18T21:06:32.670 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000142423 2024-04-18T21:06:32.670 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.670 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.671 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:32.671 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642572+0000", 2024-04-18T21:06:32.671 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8193000000000001e-05 2024-04-18T21:06:32.671 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:32.671 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:32.671 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:32.671 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.671 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.671 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:32.671 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:32.671 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 86.966607658000001, 2024-04-18T21:06:32.671 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024956974999999999, 2024-04-18T21:06:32.671 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:32.671 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:32.671 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:32.672 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:32.672 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.672 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:32.672 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:32.672 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:32.672 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.672 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.672 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:32.672 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:32.672 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:32.672 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.672 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.672 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:32.672 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617928+0000", 2024-04-18T21:06:32.672 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5430000000000001e-06 2024-04-18T21:06:32.672 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.673 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.673 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:32.673 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617937+0000", 2024-04-18T21:06:32.673 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6629999999999999e-06 2024-04-18T21:06:32.673 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.673 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.673 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:32.673 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617955+0000", 2024-04-18T21:06:32.673 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8749999999999998e-05 2024-04-18T21:06:32.673 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.673 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.673 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:32.673 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617971+0000", 2024-04-18T21:06:32.673 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.605e-05 2024-04-18T21:06:32.673 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.673 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.674 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:32.674 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621019+0000", 2024-04-18T21:06:32.674 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0030472369999999999 2024-04-18T21:06:32.674 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.674 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.674 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:32.674 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621249+0000", 2024-04-18T21:06:32.674 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000230075 2024-04-18T21:06:32.674 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.674 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.674 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:32.674 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621450+0000", 2024-04-18T21:06:32.674 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020166499999999999 2024-04-18T21:06:32.674 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.675 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.675 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:32.675 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.626233+0000", 2024-04-18T21:06:32.675 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047827390000000003 2024-04-18T21:06:32.675 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.675 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.675 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:32.675 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642693+0000", 2024-04-18T21:06:32.675 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01645961 2024-04-18T21:06:32.675 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.675 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.675 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:32.675 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642798+0000", 2024-04-18T21:06:32.675 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010559499999999999 2024-04-18T21:06:32.675 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.676 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.676 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:32.676 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642883+0000", 2024-04-18T21:06:32.676 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5048000000000003e-05 2024-04-18T21:06:32.676 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:32.676 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:32.676 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:32.676 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.676 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.676 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:32.676 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:32.676 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 86.964912029999994, 2024-04-18T21:06:32.676 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024086478000000001, 2024-04-18T21:06:32.676 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:32.677 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:32.677 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:32.677 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:32.677 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.677 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:32.677 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:32.677 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:32.677 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.677 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.677 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:32.677 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:32.677 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:32.677 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.677 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.677 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:32.678 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619624+0000", 2024-04-18T21:06:32.678 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.75e-06 2024-04-18T21:06:32.678 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.678 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.678 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:32.678 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619637+0000", 2024-04-18T21:06:32.678 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3540000000000001e-05 2024-04-18T21:06:32.678 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.678 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.678 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:32.678 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619666+0000", 2024-04-18T21:06:32.678 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8685999999999999e-05 2024-04-18T21:06:32.678 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.679 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.679 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:32.679 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619685+0000", 2024-04-18T21:06:32.679 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8681999999999998e-05 2024-04-18T21:06:32.679 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.679 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.679 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:32.679 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622275+0000", 2024-04-18T21:06:32.679 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0025899260000000002 2024-04-18T21:06:32.679 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.679 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.679 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:32.679 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622572+0000", 2024-04-18T21:06:32.679 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00029722 2024-04-18T21:06:32.679 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.680 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.680 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:32.680 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622752+0000", 2024-04-18T21:06:32.680 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018065900000000001 2024-04-18T21:06:32.680 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.680 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.680 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:32.680 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.626326+0000", 2024-04-18T21:06:32.680 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035737310000000001 2024-04-18T21:06:32.680 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.680 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.680 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:32.680 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643565+0000", 2024-04-18T21:06:32.680 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017238430999999999 2024-04-18T21:06:32.680 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.681 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.681 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:32.681 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643646+0000", 2024-04-18T21:06:32.681 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.1481000000000001e-05 2024-04-18T21:06:32.681 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.681 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.681 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:32.681 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643708+0000", 2024-04-18T21:06:32.681 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.2372000000000005e-05 2024-04-18T21:06:32.681 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:32.681 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:32.681 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:32.681 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.681 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.682 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:32.682 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:32.682 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 86.964745876999999, 2024-04-18T21:06:32.682 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026822450000000001, 2024-04-18T21:06:32.682 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:32.682 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:32.682 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:32.682 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:32.682 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.682 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:32.682 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:32.682 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:32.682 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.682 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.683 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:32.683 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:32.683 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:32.683 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.683 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.683 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:32.683 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619789+0000", 2024-04-18T21:06:32.683 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:06:32.683 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.683 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.683 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:32.683 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619797+0000", 2024-04-18T21:06:32.683 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.6899999999999992e-06 2024-04-18T21:06:32.683 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.683 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.683 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:32.684 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619816+0000", 2024-04-18T21:06:32.684 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9352999999999999e-05 2024-04-18T21:06:32.684 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.684 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.684 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:32.684 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619832+0000", 2024-04-18T21:06:32.684 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6013000000000001e-05 2024-04-18T21:06:32.684 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.684 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.684 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:32.684 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620528+0000", 2024-04-18T21:06:32.684 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00069565600000000001 2024-04-18T21:06:32.684 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.684 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.684 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:32.685 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620735+0000", 2024-04-18T21:06:32.685 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000207025 2024-04-18T21:06:32.685 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.685 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.685 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:32.685 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620912+0000", 2024-04-18T21:06:32.685 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017748199999999999 2024-04-18T21:06:32.685 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.685 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.685 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:32.685 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.625605+0000", 2024-04-18T21:06:32.685 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0046924439999999996 2024-04-18T21:06:32.685 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.685 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.685 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:32.686 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646349+0000", 2024-04-18T21:06:32.686 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.020744318000000001 2024-04-18T21:06:32.686 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.686 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.686 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:32.686 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646483+0000", 2024-04-18T21:06:32.686 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013428999999999999 2024-04-18T21:06:32.686 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.686 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.686 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:32.686 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646611+0000", 2024-04-18T21:06:32.686 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012710299999999999 2024-04-18T21:06:32.686 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:32.686 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:32.686 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:32.686 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.687 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.687 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:32.687 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:06:32.687 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 86.964075444000002, 2024-04-18T21:06:32.687 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023516516000000001, 2024-04-18T21:06:32.687 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:32.687 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:32.687 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:06:32.687 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:32.687 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.687 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:32.687 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:06:32.687 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:32.687 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.687 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.687 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:32.688 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:06:32.688 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:32.688 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.688 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.688 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:32.688 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620460+0000", 2024-04-18T21:06:32.688 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.787e-06 2024-04-18T21:06:32.688 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.688 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.688 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:32.688 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620470+0000", 2024-04-18T21:06:32.688 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.2560000000000008e-06 2024-04-18T21:06:32.688 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.688 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.688 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:32.688 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620496+0000", 2024-04-18T21:06:32.689 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.6205999999999999e-05 2024-04-18T21:06:32.689 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.689 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.689 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:32.689 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620517+0000", 2024-04-18T21:06:32.689 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1223e-05 2024-04-18T21:06:32.689 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.689 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.689 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:32.689 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624060+0000", 2024-04-18T21:06:32.689 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035434160000000002 2024-04-18T21:06:32.689 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.689 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.689 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:32.689 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624390+0000", 2024-04-18T21:06:32.689 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00033000500000000002 2024-04-18T21:06:32.689 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:32.690 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:32.690 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:32.690 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643975+0000", 2024-04-18T21:06:32.690 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019584622999999999 2024-04-18T21:06:32.690 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:32.690 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:32.690 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:32.690 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:32.690 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:32.690 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:32.691 INFO:teuthology.orchestra.run.smithi078.stderr:reweighted osd.2 to 1 (10000) 2024-04-18T21:06:32.692 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:32.692 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:32.691+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:32.706 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-18T21:06:32.706 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:06:32.792 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:32.794+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:32.827 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:06:32.827 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [], 2024-04-18T21:06:32.827 INFO:teuthology.orchestra.run.smithi150.stdout: "num_ops": 0 2024-04-18T21:06:32.827 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:06:32.842 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:32.893 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:32.894+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:32.961 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:06:32.961 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [], 2024-04-18T21:06:32.962 INFO:teuthology.orchestra.run.smithi150.stdout: "complaint_time": 30, 2024-04-18T21:06:32.962 INFO:teuthology.orchestra.run.smithi150.stdout: "num_blocked_ops": 0 2024-04-18T21:06:32.962 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:06:32.976 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:32.994 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:32.994+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:33.095 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:33.095+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:33.100 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:06:33.100 INFO:teuthology.orchestra.run.smithi150.stdout: "size": 20, 2024-04-18T21:06:33.100 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 600, 2024-04-18T21:06:33.100 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [ 2024-04-18T21:06:33.101 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.101 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-18T21:06:33.101 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:06:33.101 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 98.297607337000002, 2024-04-18T21:06:33.101 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0093051590000000003, 2024-04-18T21:06:33.101 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:33.101 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:33.101 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:33.101 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:33.101 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.101 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:33.101 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:06:33.101 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:33.101 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.101 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.101 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:33.102 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:06:33.102 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:33.102 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.102 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.102 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:33.102 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804851+0000", 2024-04-18T21:06:33.102 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7039999999999999e-06 2024-04-18T21:06:33.102 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.102 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.102 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:33.102 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804864+0000", 2024-04-18T21:06:33.102 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.276e-05 2024-04-18T21:06:33.102 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.102 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.102 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:33.103 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804895+0000", 2024-04-18T21:06:33.103 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.1204999999999997e-05 2024-04-18T21:06:33.103 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.103 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.103 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:33.103 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804908+0000", 2024-04-18T21:06:33.103 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3317e-05 2024-04-18T21:06:33.103 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.103 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.103 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:33.103 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805131+0000", 2024-04-18T21:06:33.103 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00022246700000000001 2024-04-18T21:06:33.103 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.103 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.103 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:33.103 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805171+0000", 2024-04-18T21:06:33.104 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.0164999999999999e-05 2024-04-18T21:06:33.104 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.104 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.104 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:33.104 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814086+0000", 2024-04-18T21:06:33.104 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0089155329999999998 2024-04-18T21:06:33.104 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.104 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.104 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:33.104 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814154+0000", 2024-04-18T21:06:33.104 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.8008000000000003e-05 2024-04-18T21:06:33.104 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:33.104 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:33.104 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:33.104 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.104 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.105 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-18T21:06:33.105 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:06:33.105 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 98.296842143999996, 2024-04-18T21:06:33.105 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0086469770000000001, 2024-04-18T21:06:33.105 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:33.105 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:33.105 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:33.105 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:33.105 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.105 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:33.105 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:06:33.105 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:33.105 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.105 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.105 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:33.105 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:06:33.106 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:33.106 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.106 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.106 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:33.106 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805616+0000", 2024-04-18T21:06:33.106 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7799999999999999e-06 2024-04-18T21:06:33.106 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.106 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.106 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:33.106 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805707+0000", 2024-04-18T21:06:33.106 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0917999999999999e-05 2024-04-18T21:06:33.106 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.106 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.106 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:33.106 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805739+0000", 2024-04-18T21:06:33.106 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.2512000000000003e-05 2024-04-18T21:06:33.107 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.107 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.107 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:33.107 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805763+0000", 2024-04-18T21:06:33.107 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3266000000000001e-05 2024-04-18T21:06:33.107 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.107 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.107 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:33.107 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.806024+0000", 2024-04-18T21:06:33.107 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000261716 2024-04-18T21:06:33.107 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.107 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.107 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:33.107 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.806073+0000", 2024-04-18T21:06:33.107 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.8844999999999997e-05 2024-04-18T21:06:33.108 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.108 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.108 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:33.108 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814162+0000", 2024-04-18T21:06:33.108 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0080882860000000001 2024-04-18T21:06:33.108 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.108 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.108 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:33.108 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814261+0000", 2024-04-18T21:06:33.108 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.9654000000000005e-05 2024-04-18T21:06:33.108 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:33.108 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:33.108 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:33.108 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.108 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.108 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'64)", 2024-04-18T21:06:33.108 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:06:33.109 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 98.295071100000001, 2024-04-18T21:06:33.109 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0089721509999999994, 2024-04-18T21:06:33.109 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:33.109 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:33.109 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:33.109 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:33.109 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.109 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:33.109 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:06:33.109 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:33.109 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.109 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.109 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:33.109 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:06:33.109 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:33.109 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.110 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.110 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:33.110 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807387+0000", 2024-04-18T21:06:33.110 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.0329999999999998e-06 2024-04-18T21:06:33.110 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.110 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.110 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:33.110 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807443+0000", 2024-04-18T21:06:33.110 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.5376e-05 2024-04-18T21:06:33.110 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.110 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.110 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:33.110 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807467+0000", 2024-04-18T21:06:33.110 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.4621999999999999e-05 2024-04-18T21:06:33.110 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.111 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.111 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:33.111 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807482+0000", 2024-04-18T21:06:33.111 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.436e-05 2024-04-18T21:06:33.111 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.111 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.111 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:33.111 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.809243+0000", 2024-04-18T21:06:33.111 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001761725 2024-04-18T21:06:33.111 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.111 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.111 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:33.111 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.809295+0000", 2024-04-18T21:06:33.111 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.1445e-05 2024-04-18T21:06:33.111 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.111 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.112 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:33.112 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.816293+0000", 2024-04-18T21:06:33.112 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0069981749999999997 2024-04-18T21:06:33.112 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.112 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.112 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:33.112 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.816357+0000", 2024-04-18T21:06:33.112 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.4414999999999999e-05 2024-04-18T21:06:33.112 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:33.112 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:33.112 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:33.112 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.112 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.112 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:33.112 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:06:33.113 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 87.487161729999997, 2024-04-18T21:06:33.113 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.040843365, 2024-04-18T21:06:33.113 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:33.113 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:33.113 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:33.113 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:33.113 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.113 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:33.113 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:06:33.113 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:33.113 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.113 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.113 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:33.113 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:06:33.113 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:33.113 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.114 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.114 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:33.114 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615297+0000", 2024-04-18T21:06:33.114 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2800000000000002e-06 2024-04-18T21:06:33.114 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.114 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.114 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:33.114 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615308+0000", 2024-04-18T21:06:33.114 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0813e-05 2024-04-18T21:06:33.114 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.114 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.114 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:33.114 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615330+0000", 2024-04-18T21:06:33.114 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2370000000000001e-05 2024-04-18T21:06:33.114 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.115 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.115 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:33.115 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615346+0000", 2024-04-18T21:06:33.115 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6200000000000001e-05 2024-04-18T21:06:33.115 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.115 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.115 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:33.115 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615470+0000", 2024-04-18T21:06:33.115 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012385799999999999 2024-04-18T21:06:33.115 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.115 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.115 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:33.115 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615488+0000", 2024-04-18T21:06:33.115 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7923000000000001e-05 2024-04-18T21:06:33.115 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.116 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.116 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:33.116 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.630993+0000", 2024-04-18T21:06:33.116 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.01550532 2024-04-18T21:06:33.116 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.116 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.116 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:33.116 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631165+0000", 2024-04-18T21:06:33.116 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000171588 2024-04-18T21:06:33.116 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.116 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.116 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:33.116 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631320+0000", 2024-04-18T21:06:33.116 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000155162 2024-04-18T21:06:33.116 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.116 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.116 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:33.117 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635157+0000", 2024-04-18T21:06:33.117 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0038370790000000002 2024-04-18T21:06:33.117 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.117 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.117 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:33.117 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.655904+0000", 2024-04-18T21:06:33.117 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.020746483999999999 2024-04-18T21:06:33.117 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.117 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.117 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:33.117 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656032+0000", 2024-04-18T21:06:33.117 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012864199999999999 2024-04-18T21:06:33.117 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.117 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.117 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:33.117 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656138+0000", 2024-04-18T21:06:33.118 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000105646 2024-04-18T21:06:33.118 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:33.118 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:33.118 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:33.118 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.118 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.118 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:33.118 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:06:33.118 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 87.487069558000002, 2024-04-18T21:06:33.118 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.041266444999999999, 2024-04-18T21:06:33.118 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:33.118 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:33.118 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:33.118 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:33.119 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.119 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:33.119 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:06:33.119 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:33.119 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.119 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.119 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:33.119 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:06:33.119 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:33.119 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.119 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.119 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:33.119 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615388+0000", 2024-04-18T21:06:33.119 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:06:33.119 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.119 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.119 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:33.120 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:06:33.120 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.7299999999999994e-06 2024-04-18T21:06:33.120 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.120 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.120 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:33.120 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615415+0000", 2024-04-18T21:06:33.120 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7807000000000001e-05 2024-04-18T21:06:33.120 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.120 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.120 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:33.120 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615431+0000", 2024-04-18T21:06:33.120 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6127e-05 2024-04-18T21:06:33.120 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.120 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.120 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:33.120 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615621+0000", 2024-04-18T21:06:33.120 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000189781 2024-04-18T21:06:33.121 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.121 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.121 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:33.121 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615634+0000", 2024-04-18T21:06:33.121 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3383e-05 2024-04-18T21:06:33.121 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.121 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.121 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:33.121 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631703+0000", 2024-04-18T21:06:33.121 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016068737 2024-04-18T21:06:33.121 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.121 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.121 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:33.121 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631809+0000", 2024-04-18T21:06:33.122 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000106823 2024-04-18T21:06:33.122 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.122 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.122 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:33.122 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631988+0000", 2024-04-18T21:06:33.122 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000179008 2024-04-18T21:06:33.122 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.122 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.122 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:33.122 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635172+0000", 2024-04-18T21:06:33.122 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.003183029 2024-04-18T21:06:33.122 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.122 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.122 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:33.122 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656392+0000", 2024-04-18T21:06:33.122 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.021220638999999999 2024-04-18T21:06:33.122 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.123 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.123 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:33.123 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656533+0000", 2024-04-18T21:06:33.123 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014126500000000001 2024-04-18T21:06:33.123 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.123 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.123 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:33.123 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656653+0000", 2024-04-18T21:06:33.123 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000119883 2024-04-18T21:06:33.123 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:33.123 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:33.123 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:33.123 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.123 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.123 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:33.123 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:06:33.124 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 87.486982135000005, 2024-04-18T21:06:33.124 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.042492302000000003, 2024-04-18T21:06:33.124 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:33.124 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:33.124 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:33.124 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:33.124 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.124 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:33.124 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:06:33.124 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:33.124 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.124 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.124 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:33.124 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:06:33.124 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:33.124 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.124 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.125 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:33.125 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615475+0000", 2024-04-18T21:06:33.125 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.17e-06 2024-04-18T21:06:33.125 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.125 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.125 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:33.125 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615528+0000", 2024-04-18T21:06:33.125 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.2159e-05 2024-04-18T21:06:33.125 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.125 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.125 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:33.125 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615542+0000", 2024-04-18T21:06:33.125 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4197e-05 2024-04-18T21:06:33.125 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.125 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.125 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:33.126 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615559+0000", 2024-04-18T21:06:33.126 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.749e-05 2024-04-18T21:06:33.126 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.126 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.126 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:33.126 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615685+0000", 2024-04-18T21:06:33.126 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012617499999999999 2024-04-18T21:06:33.126 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.126 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.126 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:33.126 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:06:33.126 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4749999999999999e-05 2024-04-18T21:06:33.126 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.126 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.127 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:33.127 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632332+0000", 2024-04-18T21:06:33.127 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016631988 2024-04-18T21:06:33.127 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.127 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.127 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:33.127 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632477+0000", 2024-04-18T21:06:33.127 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014437200000000001 2024-04-18T21:06:33.127 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.127 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.127 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:33.127 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632620+0000", 2024-04-18T21:06:33.127 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000143566 2024-04-18T21:06:33.127 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.127 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.128 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:33.128 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635185+0000", 2024-04-18T21:06:33.128 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0025644209999999999 2024-04-18T21:06:33.128 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.128 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.128 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:33.128 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657803+0000", 2024-04-18T21:06:33.128 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.022618743 2024-04-18T21:06:33.128 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.128 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.128 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:33.128 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657890+0000", 2024-04-18T21:06:33.128 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.6688999999999996e-05 2024-04-18T21:06:33.128 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.129 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.129 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:33.129 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657967+0000", 2024-04-18T21:06:33.129 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.6582000000000006e-05 2024-04-18T21:06:33.129 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:33.129 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:33.129 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:33.129 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.129 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.129 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:33.129 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:06:33.129 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 87.486851322999996, 2024-04-18T21:06:33.129 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.043603435000000003, 2024-04-18T21:06:33.129 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:33.130 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:33.130 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:33.130 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:33.130 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.130 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:33.130 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:06:33.130 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:33.130 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.130 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.130 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:33.130 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:06:33.130 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:33.130 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.130 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.131 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:33.131 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615607+0000", 2024-04-18T21:06:33.131 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4300000000000001e-06 2024-04-18T21:06:33.131 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.131 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.131 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:33.131 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615614+0000", 2024-04-18T21:06:33.131 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.4100000000000002e-06 2024-04-18T21:06:33.131 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.131 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.131 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:33.131 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615632+0000", 2024-04-18T21:06:33.131 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7863000000000002e-05 2024-04-18T21:06:33.131 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.131 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.132 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:33.132 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615647+0000", 2024-04-18T21:06:33.132 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5187e-05 2024-04-18T21:06:33.132 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.132 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.132 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:33.132 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615765+0000", 2024-04-18T21:06:33.132 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000117955 2024-04-18T21:06:33.132 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.132 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.132 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:33.132 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615781+0000", 2024-04-18T21:06:33.132 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6123000000000001e-05 2024-04-18T21:06:33.132 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.132 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.132 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:33.133 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633055+0000", 2024-04-18T21:06:33.133 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.017273909 2024-04-18T21:06:33.133 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.133 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.133 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:33.133 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633254+0000", 2024-04-18T21:06:33.133 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00019903799999999999 2024-04-18T21:06:33.133 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.133 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.133 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:33.133 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633624+0000", 2024-04-18T21:06:33.133 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000369656 2024-04-18T21:06:33.133 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.133 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.133 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:33.134 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635595+0000", 2024-04-18T21:06:33.134 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001971287 2024-04-18T21:06:33.134 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.134 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.134 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:33.134 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659026+0000", 2024-04-18T21:06:33.134 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.023431495 2024-04-18T21:06:33.134 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.134 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.134 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:33.134 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659117+0000", 2024-04-18T21:06:33.134 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0885999999999997e-05 2024-04-18T21:06:33.134 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.135 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.135 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:33.135 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659209+0000", 2024-04-18T21:06:33.135 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.1195999999999999e-05 2024-04-18T21:06:33.135 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:33.135 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:33.135 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:33.135 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.135 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.135 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:33.135 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:33.135 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 87.486786093999996, 2024-04-18T21:06:33.135 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.03492514, 2024-04-18T21:06:33.135 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:33.135 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:33.136 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:33.136 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:33.136 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.136 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:33.136 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:33.136 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:33.136 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.136 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.136 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:33.136 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:33.136 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:33.136 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.136 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.136 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:33.136 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:06:33.136 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.407e-06 2024-04-18T21:06:33.137 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.137 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.137 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:33.137 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615679+0000", 2024-04-18T21:06:33.137 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.2130000000000002e-06 2024-04-18T21:06:33.137 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.137 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.137 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:33.137 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615701+0000", 2024-04-18T21:06:33.137 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2316000000000001e-05 2024-04-18T21:06:33.137 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.137 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.137 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:33.137 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615717+0000", 2024-04-18T21:06:33.137 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6197000000000001e-05 2024-04-18T21:06:33.137 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.137 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.138 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:33.138 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615828+0000", 2024-04-18T21:06:33.138 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000110899 2024-04-18T21:06:33.138 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.138 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.138 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:33.138 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615840+0000", 2024-04-18T21:06:33.138 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.1423000000000001e-05 2024-04-18T21:06:33.138 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.138 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.138 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:33.138 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628046+0000", 2024-04-18T21:06:33.138 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.012206295000000001 2024-04-18T21:06:33.138 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.138 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.139 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:33.139 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628323+0000", 2024-04-18T21:06:33.139 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00027658700000000001 2024-04-18T21:06:33.139 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.139 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.139 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:33.139 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628599+0000", 2024-04-18T21:06:33.139 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00027676699999999997 2024-04-18T21:06:33.139 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.139 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.139 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:33.139 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634869+0000", 2024-04-18T21:06:33.139 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.006269536 2024-04-18T21:06:33.139 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.139 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.139 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:33.140 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650333+0000", 2024-04-18T21:06:33.140 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.015463645999999999 2024-04-18T21:06:33.140 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.140 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.140 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:33.140 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650474+0000", 2024-04-18T21:06:33.140 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014091799999999999 2024-04-18T21:06:33.140 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.140 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.140 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:33.140 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650595+0000", 2024-04-18T21:06:33.140 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012193600000000001 2024-04-18T21:06:33.140 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:33.140 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:33.140 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:33.141 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.141 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.141 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:33.141 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:06:33.141 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 87.486700984999999, 2024-04-18T21:06:33.141 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.040588320999999997, 2024-04-18T21:06:33.141 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:33.141 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:33.141 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:33.141 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:33.141 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.141 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:33.141 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:06:33.141 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:33.141 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.142 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.142 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:33.142 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:06:33.142 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:33.142 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.142 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.142 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:33.142 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615757+0000", 2024-04-18T21:06:33.142 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2270000000000001e-06 2024-04-18T21:06:33.142 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.142 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.142 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:33.142 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615765+0000", 2024-04-18T21:06:33.142 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.9400000000000002e-06 2024-04-18T21:06:33.142 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.143 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.143 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:33.143 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615785+0000", 2024-04-18T21:06:33.143 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.0749000000000001e-05 2024-04-18T21:06:33.143 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.143 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.143 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:33.143 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615804+0000", 2024-04-18T21:06:33.143 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.8774e-05 2024-04-18T21:06:33.143 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.143 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.143 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:33.143 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615888+0000", 2024-04-18T21:06:33.143 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.4111999999999997e-05 2024-04-18T21:06:33.143 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.143 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.144 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:33.144 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615895+0000", 2024-04-18T21:06:33.144 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.0469999999999996e-06 2024-04-18T21:06:33.144 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.144 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.144 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:33.144 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629280+0000", 2024-04-18T21:06:33.144 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.013384416 2024-04-18T21:06:33.144 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.144 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.144 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:33.144 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629488+0000", 2024-04-18T21:06:33.144 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00020852800000000001 2024-04-18T21:06:33.144 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.144 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.144 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:33.145 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629869+0000", 2024-04-18T21:06:33.145 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00038042300000000001 2024-04-18T21:06:33.145 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.145 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.145 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:33.145 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635041+0000", 2024-04-18T21:06:33.145 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.005172383 2024-04-18T21:06:33.145 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.145 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.145 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:33.145 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656125+0000", 2024-04-18T21:06:33.145 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.021084025999999999 2024-04-18T21:06:33.145 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.145 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.145 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:33.146 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656240+0000", 2024-04-18T21:06:33.146 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000115352 2024-04-18T21:06:33.146 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.146 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.146 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:33.146 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656344+0000", 2024-04-18T21:06:33.146 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00010334400000000001 2024-04-18T21:06:33.146 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:33.146 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:33.146 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:33.146 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.146 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.146 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:33.147 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:33.147 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 87.486633664999999, 2024-04-18T21:06:33.147 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.043549577999999999, 2024-04-18T21:06:33.147 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:33.147 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:33.147 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:33.147 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:33.147 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.147 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:33.147 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:33.147 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:33.147 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.147 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.147 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:33.147 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:33.147 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:33.148 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.148 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.148 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:33.148 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:33.148 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.5000000000000002e-07 2024-04-18T21:06:33.148 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.148 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.148 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:33.148 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615828+0000", 2024-04-18T21:06:33.148 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.2359999999999998e-06 2024-04-18T21:06:33.148 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.148 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.148 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:33.148 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615838+0000", 2024-04-18T21:06:33.148 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0087e-05 2024-04-18T21:06:33.149 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.149 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.149 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:33.149 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615846+0000", 2024-04-18T21:06:33.149 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.67e-06 2024-04-18T21:06:33.149 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.149 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.149 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:33.149 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615963+0000", 2024-04-18T21:06:33.149 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00011630500000000001 2024-04-18T21:06:33.149 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.149 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.149 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:33.149 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615979+0000", 2024-04-18T21:06:33.149 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.613e-05 2024-04-18T21:06:33.150 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.150 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.150 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:33.150 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632392+0000", 2024-04-18T21:06:33.150 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016413317 2024-04-18T21:06:33.150 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.150 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.150 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:33.150 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632568+0000", 2024-04-18T21:06:33.150 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00017539500000000001 2024-04-18T21:06:33.150 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.150 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.150 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:33.151 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632748+0000", 2024-04-18T21:06:33.151 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00017991799999999999 2024-04-18T21:06:33.151 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.151 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.151 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:33.151 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635542+0000", 2024-04-18T21:06:33.151 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00279481 2024-04-18T21:06:33.151 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.151 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.151 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:33.151 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659232+0000", 2024-04-18T21:06:33.151 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.023689212000000001 2024-04-18T21:06:33.151 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.152 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.152 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:33.152 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659314+0000", 2024-04-18T21:06:33.152 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.2528999999999995e-05 2024-04-18T21:06:33.152 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.152 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.152 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:33.152 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659372+0000", 2024-04-18T21:06:33.152 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.8218999999999999e-05 2024-04-18T21:06:33.152 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:33.152 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:33.152 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:33.152 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.152 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.152 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:33.152 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:06:33.153 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 87.486572233000004, 2024-04-18T21:06:33.153 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.039335347, 2024-04-18T21:06:33.153 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:33.153 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:33.153 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "started", 2024-04-18T21:06:33.153 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:33.153 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.153 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:33.153 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:06:33.153 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:33.153 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.153 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.153 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:33.153 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:06:33.153 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:33.153 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.153 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.154 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:33.154 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615885+0000", 2024-04-18T21:06:33.154 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2699999999999999e-06 2024-04-18T21:06:33.154 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.154 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.154 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:33.154 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615892+0000", 2024-04-18T21:06:33.154 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.6499999999999999e-06 2024-04-18T21:06:33.154 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.154 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.154 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:33.154 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615906+0000", 2024-04-18T21:06:33.154 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.393e-05 2024-04-18T21:06:33.155 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.155 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.155 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:33.155 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615919+0000", 2024-04-18T21:06:33.155 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2860000000000001e-05 2024-04-18T21:06:33.155 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.155 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.155 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:33.155 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616027+0000", 2024-04-18T21:06:33.155 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000107852 2024-04-18T21:06:33.155 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.155 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.155 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:33.155 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616037+0000", 2024-04-18T21:06:33.155 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:06:33.155 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.156 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.156 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:33.156 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622719+0000", 2024-04-18T21:06:33.156 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0066817220000000002 2024-04-18T21:06:33.156 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.156 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.156 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:33.156 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623006+0000", 2024-04-18T21:06:33.156 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00028783699999999999 2024-04-18T21:06:33.156 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.156 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.156 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:33.156 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.655220+0000", 2024-04-18T21:06:33.156 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.032213036 2024-04-18T21:06:33.156 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:33.156 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:33.156 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:33.157 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.157 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.157 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:33.157 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:33.157 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 87.486516559999998, 2024-04-18T21:06:33.157 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.032845253999999997, 2024-04-18T21:06:33.157 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:33.157 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:33.157 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "started", 2024-04-18T21:06:33.157 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:33.157 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.157 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:33.157 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:33.157 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:33.157 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.157 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.158 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:33.158 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:33.158 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:33.158 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.158 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.158 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:33.158 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615942+0000", 2024-04-18T21:06:33.158 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.717e-06 2024-04-18T21:06:33.158 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.158 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.158 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:33.158 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615946+0000", 2024-04-18T21:06:33.158 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.6e-06 2024-04-18T21:06:33.159 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.159 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.159 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:33.159 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615960+0000", 2024-04-18T21:06:33.159 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:06:33.159 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.159 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.159 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:33.159 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615968+0000", 2024-04-18T21:06:33.159 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.9070000000000007e-06 2024-04-18T21:06:33.159 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.159 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.159 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:33.159 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616100+0000", 2024-04-18T21:06:33.159 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000132402 2024-04-18T21:06:33.160 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.160 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.160 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:33.160 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616117+0000", 2024-04-18T21:06:33.160 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6653000000000001e-05 2024-04-18T21:06:33.160 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.160 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.160 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:33.160 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621566+0000", 2024-04-18T21:06:33.160 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0054497740000000001 2024-04-18T21:06:33.160 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.160 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.160 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:33.160 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622801+0000", 2024-04-18T21:06:33.160 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0012345710000000001 2024-04-18T21:06:33.160 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.161 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.161 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:33.161 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648785+0000", 2024-04-18T21:06:33.161 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.025984104000000001 2024-04-18T21:06:33.161 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:33.161 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:33.161 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:33.161 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.161 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.161 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:33.161 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:06:33.161 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 87.480665209999998, 2024-04-18T21:06:33.161 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.011561350999999999, 2024-04-18T21:06:33.161 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:33.161 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:33.161 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:33.162 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:33.162 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.162 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:33.162 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:06:33.162 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:33.162 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.162 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.162 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:33.162 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:06:33.162 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:33.162 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.162 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.162 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:33.162 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621792+0000", 2024-04-18T21:06:33.162 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.4000000000000001e-07 2024-04-18T21:06:33.162 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.163 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.163 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:33.163 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:06:33.163 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.1050000000000002e-05 2024-04-18T21:06:33.163 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.163 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.163 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:33.163 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622608+0000", 2024-04-18T21:06:33.163 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00077505900000000003 2024-04-18T21:06:33.163 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.163 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.163 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:33.163 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623879+0000", 2024-04-18T21:06:33.163 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0012705839999999999 2024-04-18T21:06:33.164 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.164 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.164 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:33.164 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624010+0000", 2024-04-18T21:06:33.164 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00013176900000000001 2024-04-18T21:06:33.164 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.164 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.164 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:33.164 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624058+0000", 2024-04-18T21:06:33.164 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.7299000000000002e-05 2024-04-18T21:06:33.164 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.164 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.164 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:33.164 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633262+0000", 2024-04-18T21:06:33.165 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0092048770000000002 2024-04-18T21:06:33.165 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.165 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.165 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:33.165 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633353+0000", 2024-04-18T21:06:33.165 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0073000000000003e-05 2024-04-18T21:06:33.165 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:33.165 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:33.165 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:33.165 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.165 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.165 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:33.165 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:06:33.165 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 87.478537824, 2024-04-18T21:06:33.165 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0098419370000000003, 2024-04-18T21:06:33.165 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:33.166 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:33.166 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:33.166 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:33.166 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.166 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:33.166 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:06:33.166 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:33.166 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.166 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.166 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:33.166 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:06:33.166 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:33.166 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.166 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.166 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:33.167 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623920+0000", 2024-04-18T21:06:33.167 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2240000000000001e-06 2024-04-18T21:06:33.167 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.167 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.167 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:33.167 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623933+0000", 2024-04-18T21:06:33.167 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3653e-05 2024-04-18T21:06:33.167 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.167 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.167 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:33.167 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623956+0000", 2024-04-18T21:06:33.167 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2059e-05 2024-04-18T21:06:33.167 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.167 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.167 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:33.167 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623975+0000", 2024-04-18T21:06:33.168 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.9806999999999999e-05 2024-04-18T21:06:33.168 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.168 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.168 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:33.168 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626943+0000", 2024-04-18T21:06:33.168 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0029681579999999998 2024-04-18T21:06:33.168 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.168 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.168 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:33.168 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626993+0000", 2024-04-18T21:06:33.168 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.9935999999999998e-05 2024-04-18T21:06:33.168 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.168 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.168 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:33.168 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633665+0000", 2024-04-18T21:06:33.168 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0066719250000000004 2024-04-18T21:06:33.169 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.169 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.169 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:33.169 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633761+0000", 2024-04-18T21:06:33.169 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.5174999999999996e-05 2024-04-18T21:06:33.169 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:33.169 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:33.169 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:33.169 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.169 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.169 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:33.169 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:06:33.169 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 87.477706205000004, 2024-04-18T21:06:33.169 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0090159079999999996, 2024-04-18T21:06:33.169 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:33.170 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:33.170 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:33.170 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:33.170 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.170 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:33.170 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:06:33.170 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:33.170 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.170 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.170 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:33.170 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:06:33.170 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:33.170 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.170 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.170 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:33.171 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624751+0000", 2024-04-18T21:06:33.171 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.7600000000000006e-07 2024-04-18T21:06:33.171 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.171 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.171 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:33.171 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624787+0000", 2024-04-18T21:06:33.171 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.6273000000000003e-05 2024-04-18T21:06:33.171 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.171 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.171 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:33.171 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625837+0000", 2024-04-18T21:06:33.171 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00104992 2024-04-18T21:06:33.171 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.171 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.171 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:33.171 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625860+0000", 2024-04-18T21:06:33.172 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3110000000000001e-05 2024-04-18T21:06:33.172 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.172 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.172 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:33.172 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625984+0000", 2024-04-18T21:06:33.172 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012399199999999999 2024-04-18T21:06:33.172 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.172 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.172 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:33.172 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626030+0000", 2024-04-18T21:06:33.172 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.5429999999999997e-05 2024-04-18T21:06:33.172 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.172 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.172 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:33.172 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633643+0000", 2024-04-18T21:06:33.172 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0076129320000000002 2024-04-18T21:06:33.173 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.173 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.173 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:33.173 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633766+0000", 2024-04-18T21:06:33.173 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000123275 2024-04-18T21:06:33.173 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:33.173 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:33.173 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:33.173 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.173 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.173 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:33.173 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:06:33.173 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 87.476452480999995, 2024-04-18T21:06:33.173 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0088669170000000002, 2024-04-18T21:06:33.173 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:33.174 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:33.174 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:33.174 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:33.174 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.174 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:33.174 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:06:33.174 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:33.174 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.174 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.174 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:33.174 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:06:33.174 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:33.174 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.174 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.175 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:33.175 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626005+0000", 2024-04-18T21:06:33.175 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.5000000000000001e-07 2024-04-18T21:06:33.175 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.175 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.175 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:33.175 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626028+0000", 2024-04-18T21:06:33.175 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2756999999999999e-05 2024-04-18T21:06:33.175 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.175 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.175 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:33.175 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626050+0000", 2024-04-18T21:06:33.175 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2140000000000001e-05 2024-04-18T21:06:33.175 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.176 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.176 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:33.176 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626065+0000", 2024-04-18T21:06:33.176 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5176e-05 2024-04-18T21:06:33.176 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.176 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.176 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:33.176 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628334+0000", 2024-04-18T21:06:33.176 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0022691439999999998 2024-04-18T21:06:33.176 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.176 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.176 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:33.176 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628379+0000", 2024-04-18T21:06:33.176 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.5420000000000002e-05 2024-04-18T21:06:33.176 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.177 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.177 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:33.177 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634770+0000", 2024-04-18T21:06:33.177 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0063908410000000004 2024-04-18T21:06:33.177 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.177 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.177 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:33.177 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634871+0000", 2024-04-18T21:06:33.177 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000100589 2024-04-18T21:06:33.177 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:33.177 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:33.177 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:33.177 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.177 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.177 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:13 3.10 e17/15 3:0d89b25e:::603.00000000:head v 17'8, mlcod=0'0)", 2024-04-18T21:06:33.178 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:06:33.178 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 87.457619051999998, 2024-04-18T21:06:33.178 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0090974379999999994, 2024-04-18T21:06:33.178 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:33.178 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:33.178 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:33.178 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:33.178 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.178 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:33.178 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:06:33.178 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:33.178 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.178 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.178 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:33.179 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:06:33.179 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:33.179 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.179 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.179 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:33.179 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644838+0000", 2024-04-18T21:06:33.179 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.569999999999999e-07 2024-04-18T21:06:33.179 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.179 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.179 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:33.179 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644846+0000", 2024-04-18T21:06:33.179 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.4499999999999998e-06 2024-04-18T21:06:33.179 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.179 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.179 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:33.180 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644861+0000", 2024-04-18T21:06:33.180 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5243e-05 2024-04-18T21:06:33.180 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.180 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.180 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:33.180 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644997+0000", 2024-04-18T21:06:33.180 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000135609 2024-04-18T21:06:33.180 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.180 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.180 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:33.180 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649150+0000", 2024-04-18T21:06:33.180 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0041536760000000002 2024-04-18T21:06:33.180 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.180 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.180 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:33.181 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649207+0000", 2024-04-18T21:06:33.181 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.6677e-05 2024-04-18T21:06:33.181 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.181 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.181 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:33.181 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.653840+0000", 2024-04-18T21:06:33.181 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0046329700000000001 2024-04-18T21:06:33.181 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.181 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.181 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:33.181 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.653935+0000", 2024-04-18T21:06:33.181 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.4856000000000001e-05 2024-04-18T21:06:33.181 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:33.181 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:33.181 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:33.182 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.182 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.182 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 3 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:06:33.182 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:06:33.182 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 87.454829892000006, 2024-04-18T21:06:33.182 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0087842319999999995, 2024-04-18T21:06:33.182 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:33.182 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:33.182 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "reached pg", 2024-04-18T21:06:33.182 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:33.182 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.182 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:33.182 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:06:33.182 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:33.182 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.183 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.183 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:33.183 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:06:33.183 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:33.183 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.183 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.183 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:33.183 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:06:33.183 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.8299999999999996e-07 2024-04-18T21:06:33.183 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.183 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.183 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:33.183 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647642+0000", 2024-04-18T21:06:33.183 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4724e-05 2024-04-18T21:06:33.184 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.184 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.184 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:33.184 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647679+0000", 2024-04-18T21:06:33.184 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.6662999999999998e-05 2024-04-18T21:06:33.184 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.184 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.184 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:33.184 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647735+0000", 2024-04-18T21:06:33.184 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.6196000000000002e-05 2024-04-18T21:06:33.184 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.184 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.184 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:33.184 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649865+0000", 2024-04-18T21:06:33.184 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0021299489999999999 2024-04-18T21:06:33.184 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.184 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.185 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:33.185 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656411+0000", 2024-04-18T21:06:33.185 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0065460170000000003 2024-04-18T21:06:33.185 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:33.185 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:33.185 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:33.185 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.185 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.185 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:33.185 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:06:33.185 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 87.454684696000001, 2024-04-18T21:06:33.185 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0095703190000000007, 2024-04-18T21:06:33.185 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:33.185 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:33.185 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:33.186 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:33.186 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.186 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:33.186 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:06:33.186 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:33.186 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.186 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.186 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:33.186 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:06:33.186 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:33.186 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.186 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.186 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:33.186 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647773+0000", 2024-04-18T21:06:33.186 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.046e-06 2024-04-18T21:06:33.187 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.187 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.187 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:33.187 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647795+0000", 2024-04-18T21:06:33.187 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2616000000000002e-05 2024-04-18T21:06:33.187 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.187 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.187 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:33.187 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647818+0000", 2024-04-18T21:06:33.187 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3110000000000001e-05 2024-04-18T21:06:33.187 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.187 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.187 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:33.187 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647834+0000", 2024-04-18T21:06:33.187 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5163e-05 2024-04-18T21:06:33.187 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.187 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.188 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:33.188 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650682+0000", 2024-04-18T21:06:33.188 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0028479759999999999 2024-04-18T21:06:33.188 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.188 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.188 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:33.188 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650730+0000", 2024-04-18T21:06:33.188 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.8375999999999999e-05 2024-04-18T21:06:33.188 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.188 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.188 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:33.188 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656751+0000", 2024-04-18T21:06:33.188 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0060211880000000002 2024-04-18T21:06:33.188 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.188 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.188 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:33.188 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657342+0000", 2024-04-18T21:06:33.189 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00059084399999999998 2024-04-18T21:06:33.189 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:33.189 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:33.189 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:33.189 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.189 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.189 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:33.189 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:06:33.189 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 87.454272410000002, 2024-04-18T21:06:33.189 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0092471759999999993, 2024-04-18T21:06:33.189 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:33.189 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:33.189 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:33.189 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:33.189 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.190 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:33.190 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:06:33.190 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:33.190 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.190 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.190 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:33.190 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:06:33.190 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:33.190 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.190 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.190 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:33.190 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648185+0000", 2024-04-18T21:06:33.190 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.5000000000000001e-07 2024-04-18T21:06:33.190 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.190 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.191 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:33.191 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648203+0000", 2024-04-18T21:06:33.191 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.8102999999999999e-05 2024-04-18T21:06:33.191 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.191 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.191 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:33.191 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648226+0000", 2024-04-18T21:06:33.191 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2921999999999998e-05 2024-04-18T21:06:33.191 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.191 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.191 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:33.191 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648241+0000", 2024-04-18T21:06:33.191 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5336999999999999e-05 2024-04-18T21:06:33.191 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.192 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.192 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:33.192 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.651268+0000", 2024-04-18T21:06:33.192 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0030271640000000002 2024-04-18T21:06:33.192 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.192 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.192 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:33.192 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.651319+0000", 2024-04-18T21:06:33.192 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.0843000000000001e-05 2024-04-18T21:06:33.192 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.192 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.192 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:33.192 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657347+0000", 2024-04-18T21:06:33.192 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0060279770000000003 2024-04-18T21:06:33.192 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:33.192 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:33.193 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:33.193 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657431+0000", 2024-04-18T21:06:33.193 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.3980000000000006e-05 2024-04-18T21:06:33.193 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:33.193 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:33.193 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:33.193 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:33.193 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:33.193 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:06:33.193 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:06:33.194 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:33.197 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:06:33.199 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-04-18T21:06:33.200 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:33.194+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:33.221 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":95,"stamp":"2024-04-18T21:06:32.683479+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597719,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":256,"num_write_kb":3483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":95900,"kb_used_data":2352,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":283019620,"statfs":{"total":289910292480,"available":289812090880,"internally_reserved":0,"allocated":2408448,"data_stored":1711010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.158776"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685864+0000","last_change":"2024-04-18T21:05:05.652795+0000","last_active":"2024-04-18T21:06:31.685864+0000","last_peered":"2024-04-18T21:06:31.685864+0000","last_clean":"2024-04-18T21:06:31.685864+0000","last_became_active":"2024-04-18T21:05:05.650121+0000","last_became_peered":"2024-04-18T21:05:05.650121+0000","last_unstale":"2024-04-18T21:06:31.685864+0000","last_undegraded":"2024-04-18T21:06:31.685864+0000","last_fullsized":"2024-04-18T21:06:31.685864+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685082+0000","last_change":"2024-04-18T21:05:05.657531+0000","last_active":"2024-04-18T21:06:31.685082+0000","last_peered":"2024-04-18T21:06:31.685082+0000","last_clean":"2024-04-18T21:06:31.685082+0000","last_became_active":"2024-04-18T21:05:05.653101+0000","last_became_peered":"2024-04-18T21:05:05.653101+0000","last_unstale":"2024-04-18T21:06:31.685082+0000","last_undegraded":"2024-04-18T21:06:31.685082+0000","last_fullsized":"2024-04-18T21:06:31.685082+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:32:23.929877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683945+0000","last_change":"2024-04-18T21:05:05.647965+0000","last_active":"2024-04-18T21:06:31.683945+0000","last_peered":"2024-04-18T21:06:31.683945+0000","last_clean":"2024-04-18T21:06:31.683945+0000","last_became_active":"2024-04-18T21:05:05.645931+0000","last_became_peered":"2024-04-18T21:05:05.645931+0000","last_unstale":"2024-04-18T21:06:31.683945+0000","last_undegraded":"2024-04-18T21:06:31.683945+0000","last_fullsized":"2024-04-18T21:06:31.683945+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:04.350492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683944+0000","last_change":"2024-04-18T21:05:05.629321+0000","last_active":"2024-04-18T21:06:31.683944+0000","last_peered":"2024-04-18T21:06:31.683944+0000","last_clean":"2024-04-18T21:06:31.683944+0000","last_became_active":"2024-04-18T21:05:05.627956+0000","last_became_peered":"2024-04-18T21:05:05.627956+0000","last_unstale":"2024-04-18T21:06:31.683944+0000","last_undegraded":"2024-04-18T21:06:31.683944+0000","last_fullsized":"2024-04-18T21:06:31.683944+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:15:28.458476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685405+0000","last_change":"2024-04-18T21:05:05.648710+0000","last_active":"2024-04-18T21:06:31.685405+0000","last_peered":"2024-04-18T21:06:31.685405+0000","last_clean":"2024-04-18T21:06:31.685405+0000","last_became_active":"2024-04-18T21:05:05.647801+0000","last_became_peered":"2024-04-18T21:05:05.647801+0000","last_unstale":"2024-04-18T21:06:31.685405+0000","last_undegraded":"2024-04-18T21:06:31.685405+0000","last_fullsized":"2024-04-18T21:06:31.685405+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:46:36.339289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683322+0000","last_change":"2024-04-18T21:05:05.629095+0000","last_active":"2024-04-18T21:06:31.683322+0000","last_peered":"2024-04-18T21:06:31.683322+0000","last_clean":"2024-04-18T21:06:31.683322+0000","last_became_active":"2024-04-18T21:05:05.627664+0000","last_became_peered":"2024-04-18T21:05:05.627664+0000","last_unstale":"2024-04-18T21:06:31.683322+0000","last_undegraded":"2024-04-18T21:06:31.683322+0000","last_fullsized":"2024-04-18T21:06:31.683322+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:51:28.440070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683427+0000","last_change":"2024-04-18T21:05:05.625047+0000","last_active":"2024-04-18T21:06:31.683427+0000","last_peered":"2024-04-18T21:06:31.683427+0000","last_clean":"2024-04-18T21:06:31.683427+0000","last_became_active":"2024-04-18T21:05:05.622781+0000","last_became_peered":"2024-04-18T21:05:05.622781+0000","last_unstale":"2024-04-18T21:06:31.683427+0000","last_undegraded":"2024-04-18T21:06:31.683427+0000","last_fullsized":"2024-04-18T21:06:31.683427+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:12.944469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683007+0000","last_change":"2024-04-18T21:05:05.640390+0000","last_active":"2024-04-18T21:06:31.683007+0000","last_peered":"2024-04-18T21:06:31.683007+0000","last_clean":"2024-04-18T21:06:31.683007+0000","last_became_active":"2024-04-18T21:05:05.638295+0000","last_became_peered":"2024-04-18T21:05:05.638295+0000","last_unstale":"2024-04-18T21:06:31.683007+0000","last_undegraded":"2024-04-18T21:06:31.683007+0000","last_fullsized":"2024-04-18T21:06:31.683007+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:34:31.132458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":66,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.610957+0000","last_change":"2024-04-18T21:05:05.660752+0000","last_active":"2024-04-18T21:06:31.610957+0000","last_peered":"2024-04-18T21:06:31.610957+0000","last_clean":"2024-04-18T21:06:31.610957+0000","last_became_active":"2024-04-18T21:05:05.659226+0000","last_became_peered":"2024-04-18T21:05:05.659226+0000","last_unstale":"2024-04-18T21:06:31.610957+0000","last_undegraded":"2024-04-18T21:06:31.610957+0000","last_fullsized":"2024-04-18T21:06:31.610957+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:20:45.938503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685339+0000","last_change":"2024-04-18T21:05:05.656660+0000","last_active":"2024-04-18T21:06:31.685339+0000","last_peered":"2024-04-18T21:06:31.685339+0000","last_clean":"2024-04-18T21:06:31.685339+0000","last_became_active":"2024-04-18T21:05:05.653829+0000","last_became_peered":"2024-04-18T21:05:05.653829+0000","last_unstale":"2024-04-18T21:06:31.685339+0000","last_undegraded":"2024-04-18T21:06:31.685339+0000","last_fullsized":"2024-04-18T21:06:31.685339+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:50:40.920146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684150+0000","last_change":"2024-04-18T21:05:05.646721+0000","last_active":"2024-04-18T21:06:31.684150+0000","last_peered":"2024-04-18T21:06:31.684150+0000","last_clean":"2024-04-18T21:06:31.684150+0000","last_became_active":"2024-04-18T21:05:05.643421+0000","last_became_peered":"2024-04-18T21:05:05.643421+0000","last_unstale":"2024-04-18T21:06:31.684150+0000","last_undegraded":"2024-04-18T21:06:31.684150+0000","last_fullsized":"2024-04-18T21:06:31.684150+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:14:51.873741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684748+0000","last_change":"2024-04-18T21:05:05.656320+0000","last_active":"2024-04-18T21:06:31.684748+0000","last_peered":"2024-04-18T21:06:31.684748+0000","last_clean":"2024-04-18T21:06:31.684748+0000","last_became_active":"2024-04-18T21:05:05.655508+0000","last_became_peered":"2024-04-18T21:05:05.655508+0000","last_unstale":"2024-04-18T21:06:31.684748+0000","last_undegraded":"2024-04-18T21:06:31.684748+0000","last_fullsized":"2024-04-18T21:06:31.684748+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:51.225379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684313+0000","last_change":"2024-04-18T21:05:05.649001+0000","last_active":"2024-04-18T21:06:31.684313+0000","last_peered":"2024-04-18T21:06:31.684313+0000","last_clean":"2024-04-18T21:06:31.684313+0000","last_became_active":"2024-04-18T21:05:05.648070+0000","last_became_peered":"2024-04-18T21:05:05.648070+0000","last_unstale":"2024-04-18T21:06:31.684313+0000","last_undegraded":"2024-04-18T21:06:31.684313+0000","last_fullsized":"2024-04-18T21:06:31.684313+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:56.408234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683624+0000","last_change":"2024-04-18T21:05:05.635880+0000","last_active":"2024-04-18T21:06:31.683624+0000","last_peered":"2024-04-18T21:06:31.683624+0000","last_clean":"2024-04-18T21:06:31.683624+0000","last_became_active":"2024-04-18T21:05:05.635089+0000","last_became_peered":"2024-04-18T21:05:05.635089+0000","last_unstale":"2024-04-18T21:06:31.683624+0000","last_undegraded":"2024-04-18T21:06:31.683624+0000","last_fullsized":"2024-04-18T21:06:31.683624+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:50:40.920146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683419+0000","last_change":"2024-04-18T21:05:05.639640+0000","last_active":"2024-04-18T21:06:31.683419+0000","last_peered":"2024-04-18T21:06:31.683419+0000","last_clean":"2024-04-18T21:06:31.683419+0000","last_became_active":"2024-04-18T21:05:05.637311+0000","last_became_peered":"2024-04-18T21:05:05.637311+0000","last_unstale":"2024-04-18T21:06:31.683419+0000","last_undegraded":"2024-04-18T21:06:31.683419+0000","last_fullsized":"2024-04-18T21:06:31.683419+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:20:45.938503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683092+0000","last_change":"2024-04-18T21:05:05.638203+0000","last_active":"2024-04-18T21:06:31.683092+0000","last_peered":"2024-04-18T21:06:31.683092+0000","last_clean":"2024-04-18T21:06:31.683092+0000","last_became_active":"2024-04-18T21:05:05.637352+0000","last_became_peered":"2024-04-18T21:05:05.637352+0000","last_unstale":"2024-04-18T21:06:31.683092+0000","last_undegraded":"2024-04-18T21:06:31.683092+0000","last_fullsized":"2024-04-18T21:06:31.683092+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":37,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685582+0000","last_change":"2024-04-18T21:06:01.036290+0000","last_active":"2024-04-18T21:06:31.685582+0000","last_peered":"2024-04-18T21:06:31.685582+0000","last_clean":"2024-04-18T21:06:31.685582+0000","last_became_active":"2024-04-18T21:06:01.035478+0000","last_became_peered":"2024-04-18T21:06:01.035478+0000","last_unstale":"2024-04-18T21:06:31.685582+0000","last_undegraded":"2024-04-18T21:06:31.685582+0000","last_fullsized":"2024-04-18T21:06:31.685582+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:14:08.347445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685826+0000","last_change":"2024-04-18T21:05:05.655261+0000","last_active":"2024-04-18T21:06:31.685826+0000","last_peered":"2024-04-18T21:06:31.685826+0000","last_clean":"2024-04-18T21:06:31.685826+0000","last_became_active":"2024-04-18T21:05:05.651388+0000","last_became_peered":"2024-04-18T21:05:05.651388+0000","last_unstale":"2024-04-18T21:06:31.685826+0000","last_undegraded":"2024-04-18T21:06:31.685826+0000","last_fullsized":"2024-04-18T21:06:31.685826+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:53.850184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":66,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.610439+0000","last_change":"2024-04-18T21:05:05.652710+0000","last_active":"2024-04-18T21:06:31.610439+0000","last_peered":"2024-04-18T21:06:31.610439+0000","last_clean":"2024-04-18T21:06:31.610439+0000","last_became_active":"2024-04-18T21:05:05.651929+0000","last_became_peered":"2024-04-18T21:05:05.651929+0000","last_unstale":"2024-04-18T21:06:31.610439+0000","last_undegraded":"2024-04-18T21:06:31.610439+0000","last_fullsized":"2024-04-18T21:06:31.610439+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:12.944469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684124+0000","last_change":"2024-04-18T21:05:05.638338+0000","last_active":"2024-04-18T21:06:31.684124+0000","last_peered":"2024-04-18T21:06:31.684124+0000","last_clean":"2024-04-18T21:06:31.684124+0000","last_became_active":"2024-04-18T21:05:05.637567+0000","last_became_peered":"2024-04-18T21:05:05.637567+0000","last_unstale":"2024-04-18T21:06:31.684124+0000","last_undegraded":"2024-04-18T21:06:31.684124+0000","last_fullsized":"2024-04-18T21:06:31.684124+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683958+0000","last_change":"2024-04-18T21:05:05.643606+0000","last_active":"2024-04-18T21:06:31.683958+0000","last_peered":"2024-04-18T21:06:31.683958+0000","last_clean":"2024-04-18T21:06:31.683958+0000","last_became_active":"2024-04-18T21:05:05.642991+0000","last_became_peered":"2024-04-18T21:05:05.642991+0000","last_unstale":"2024-04-18T21:06:31.683958+0000","last_undegraded":"2024-04-18T21:06:31.683958+0000","last_fullsized":"2024-04-18T21:06:31.683958+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:01.841786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684476+0000","last_change":"2024-04-18T21:05:05.650896+0000","last_active":"2024-04-18T21:06:31.684476+0000","last_peered":"2024-04-18T21:06:31.684476+0000","last_clean":"2024-04-18T21:06:31.684476+0000","last_became_active":"2024-04-18T21:05:05.650083+0000","last_became_peered":"2024-04-18T21:05:05.650083+0000","last_unstale":"2024-04-18T21:06:31.684476+0000","last_undegraded":"2024-04-18T21:06:31.684476+0000","last_fullsized":"2024-04-18T21:06:31.684476+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:43:55.788425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":37,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.682950+0000","last_change":"2024-04-18T21:06:01.034390+0000","last_active":"2024-04-18T21:06:31.682950+0000","last_peered":"2024-04-18T21:06:31.682950+0000","last_clean":"2024-04-18T21:06:31.682950+0000","last_became_active":"2024-04-18T21:06:01.033524+0000","last_became_peered":"2024-04-18T21:06:01.033524+0000","last_unstale":"2024-04-18T21:06:31.682950+0000","last_undegraded":"2024-04-18T21:06:31.682950+0000","last_fullsized":"2024-04-18T21:06:31.682950+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:28:17.539732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683563+0000","last_change":"2024-04-18T21:05:05.642755+0000","last_active":"2024-04-18T21:06:31.683563+0000","last_peered":"2024-04-18T21:06:31.683563+0000","last_clean":"2024-04-18T21:06:31.683563+0000","last_became_active":"2024-04-18T21:05:05.642150+0000","last_became_peered":"2024-04-18T21:05:05.642150+0000","last_unstale":"2024-04-18T21:06:31.683563+0000","last_undegraded":"2024-04-18T21:06:31.683563+0000","last_fullsized":"2024-04-18T21:06:31.683563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:29:22.647425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685978+0000","last_change":"2024-04-18T21:05:05.653741+0000","last_active":"2024-04-18T21:06:31.685978+0000","last_peered":"2024-04-18T21:06:31.685978+0000","last_clean":"2024-04-18T21:06:31.685978+0000","last_became_active":"2024-04-18T21:05:05.650174+0000","last_became_peered":"2024-04-18T21:05:05.650174+0000","last_unstale":"2024-04-18T21:06:31.685978+0000","last_undegraded":"2024-04-18T21:06:31.685978+0000","last_fullsized":"2024-04-18T21:06:31.685978+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:04.350492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":66,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.610977+0000","last_change":"2024-04-18T21:05:05.649581+0000","last_active":"2024-04-18T21:06:31.610977+0000","last_peered":"2024-04-18T21:06:31.610977+0000","last_clean":"2024-04-18T21:06:31.610977+0000","last_became_active":"2024-04-18T21:05:05.648233+0000","last_became_peered":"2024-04-18T21:05:05.648233+0000","last_unstale":"2024-04-18T21:06:31.610977+0000","last_undegraded":"2024-04-18T21:06:31.610977+0000","last_fullsized":"2024-04-18T21:06:31.610977+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685069+0000","last_change":"2024-04-18T21:05:05.646926+0000","last_active":"2024-04-18T21:06:31.685069+0000","last_peered":"2024-04-18T21:06:31.685069+0000","last_clean":"2024-04-18T21:06:31.685069+0000","last_became_active":"2024-04-18T21:05:05.644942+0000","last_became_peered":"2024-04-18T21:05:05.644942+0000","last_unstale":"2024-04-18T21:06:31.685069+0000","last_undegraded":"2024-04-18T21:06:31.685069+0000","last_fullsized":"2024-04-18T21:06:31.685069+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:53.850184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685257+0000","last_change":"2024-04-18T21:05:05.656314+0000","last_active":"2024-04-18T21:06:31.685257+0000","last_peered":"2024-04-18T21:06:31.685257+0000","last_clean":"2024-04-18T21:06:31.685257+0000","last_became_active":"2024-04-18T21:05:05.655364+0000","last_became_peered":"2024-04-18T21:05:05.655364+0000","last_unstale":"2024-04-18T21:06:31.685257+0000","last_undegraded":"2024-04-18T21:06:31.685257+0000","last_fullsized":"2024-04-18T21:06:31.685257+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:27:17.530889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":37,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684271+0000","last_change":"2024-04-18T21:06:01.033572+0000","last_active":"2024-04-18T21:06:31.684271+0000","last_peered":"2024-04-18T21:06:31.684271+0000","last_clean":"2024-04-18T21:06:31.684271+0000","last_became_active":"2024-04-18T21:06:01.032811+0000","last_became_peered":"2024-04-18T21:06:01.032811+0000","last_unstale":"2024-04-18T21:06:31.684271+0000","last_undegraded":"2024-04-18T21:06:31.684271+0000","last_fullsized":"2024-04-18T21:06:31.684271+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:38:45.452379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684713+0000","last_change":"2024-04-18T21:05:05.648084+0000","last_active":"2024-04-18T21:06:31.684713+0000","last_peered":"2024-04-18T21:06:31.684713+0000","last_clean":"2024-04-18T21:06:31.684713+0000","last_became_active":"2024-04-18T21:05:05.645340+0000","last_became_peered":"2024-04-18T21:05:05.645340+0000","last_unstale":"2024-04-18T21:06:31.684713+0000","last_undegraded":"2024-04-18T21:06:31.684713+0000","last_fullsized":"2024-04-18T21:06:31.684713+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:34:31.132458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":37,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683791+0000","last_change":"2024-04-18T21:06:01.034356+0000","last_active":"2024-04-18T21:06:31.683791+0000","last_peered":"2024-04-18T21:06:31.683791+0000","last_clean":"2024-04-18T21:06:31.683791+0000","last_became_active":"2024-04-18T21:06:01.033850+0000","last_became_peered":"2024-04-18T21:06:01.033850+0000","last_unstale":"2024-04-18T21:06:31.683791+0000","last_undegraded":"2024-04-18T21:06:31.683791+0000","last_fullsized":"2024-04-18T21:06:31.683791+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:28:32.020153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683349+0000","last_change":"2024-04-18T21:05:05.626677+0000","last_active":"2024-04-18T21:06:31.683349+0000","last_peered":"2024-04-18T21:06:31.683349+0000","last_clean":"2024-04-18T21:06:31.683349+0000","last_became_active":"2024-04-18T21:05:05.624250+0000","last_became_peered":"2024-04-18T21:05:05.624250+0000","last_unstale":"2024-04-18T21:06:31.683349+0000","last_undegraded":"2024-04-18T21:06:31.683349+0000","last_fullsized":"2024-04-18T21:06:31.683349+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:51.225379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685005+0000","last_change":"2024-04-18T21:05:05.649918+0000","last_active":"2024-04-18T21:06:31.685005+0000","last_peered":"2024-04-18T21:06:31.685005+0000","last_clean":"2024-04-18T21:06:31.685005+0000","last_became_active":"2024-04-18T21:05:05.647147+0000","last_became_peered":"2024-04-18T21:05:05.647147+0000","last_unstale":"2024-04-18T21:06:31.685005+0000","last_undegraded":"2024-04-18T21:06:31.685005+0000","last_fullsized":"2024-04-18T21:06:31.685005+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:51:28.440070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":72,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685208+0000","last_change":"2024-04-18T21:05:04.632748+0000","last_active":"2024-04-18T21:06:31.685208+0000","last_peered":"2024-04-18T21:06:31.685208+0000","last_clean":"2024-04-18T21:06:31.685208+0000","last_became_active":"2024-04-18T21:05:04.628407+0000","last_became_peered":"2024-04-18T21:05:04.628407+0000","last_unstale":"2024-04-18T21:06:31.685208+0000","last_undegraded":"2024-04-18T21:06:31.685208+0000","last_fullsized":"2024-04-18T21:06:31.685208+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:42:45.392908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685415+0000","last_change":"2024-04-18T21:05:05.649199+0000","last_active":"2024-04-18T21:06:31.685415+0000","last_peered":"2024-04-18T21:06:31.685415+0000","last_clean":"2024-04-18T21:06:31.685415+0000","last_became_active":"2024-04-18T21:05:05.646898+0000","last_became_peered":"2024-04-18T21:05:05.646898+0000","last_unstale":"2024-04-18T21:06:31.685415+0000","last_undegraded":"2024-04-18T21:06:31.685415+0000","last_fullsized":"2024-04-18T21:06:31.685415+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:31:31.842528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":68,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.609793+0000","last_change":"2024-04-18T21:05:04.638017+0000","last_active":"2024-04-18T21:06:31.609793+0000","last_peered":"2024-04-18T21:06:31.609793+0000","last_clean":"2024-04-18T21:06:31.609793+0000","last_became_active":"2024-04-18T21:05:04.637287+0000","last_became_peered":"2024-04-18T21:05:04.637287+0000","last_unstale":"2024-04-18T21:06:31.609793+0000","last_undegraded":"2024-04-18T21:06:31.609793+0000","last_fullsized":"2024-04-18T21:06:31.609793+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:25.891472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":37,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683922+0000","last_change":"2024-04-18T21:06:01.034755+0000","last_active":"2024-04-18T21:06:31.683922+0000","last_peered":"2024-04-18T21:06:31.683922+0000","last_clean":"2024-04-18T21:06:31.683922+0000","last_became_active":"2024-04-18T21:06:01.033889+0000","last_became_peered":"2024-04-18T21:06:01.033889+0000","last_unstale":"2024-04-18T21:06:31.683922+0000","last_undegraded":"2024-04-18T21:06:31.683922+0000","last_fullsized":"2024-04-18T21:06:31.683922+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:09:08.394894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":70,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684240+0000","last_change":"2024-04-18T21:05:04.628489+0000","last_active":"2024-04-18T21:06:31.684240+0000","last_peered":"2024-04-18T21:06:31.684240+0000","last_clean":"2024-04-18T21:06:31.684240+0000","last_became_active":"2024-04-18T21:05:04.627279+0000","last_became_peered":"2024-04-18T21:05:04.627279+0000","last_unstale":"2024-04-18T21:06:31.684240+0000","last_undegraded":"2024-04-18T21:06:31.684240+0000","last_fullsized":"2024-04-18T21:06:31.684240+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:43:23.420744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":66,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.610990+0000","last_change":"2024-04-18T21:05:05.649347+0000","last_active":"2024-04-18T21:06:31.610990+0000","last_peered":"2024-04-18T21:06:31.610990+0000","last_clean":"2024-04-18T21:06:31.610990+0000","last_became_active":"2024-04-18T21:05:05.648144+0000","last_became_peered":"2024-04-18T21:05:05.648144+0000","last_unstale":"2024-04-18T21:06:31.610990+0000","last_undegraded":"2024-04-18T21:06:31.610990+0000","last_fullsized":"2024-04-18T21:06:31.610990+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:51:28.440070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":78,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683454+0000","last_change":"2024-04-18T21:05:04.624089+0000","last_active":"2024-04-18T21:06:31.683454+0000","last_peered":"2024-04-18T21:06:31.683454+0000","last_clean":"2024-04-18T21:06:31.683454+0000","last_became_active":"2024-04-18T21:05:04.623238+0000","last_became_peered":"2024-04-18T21:05:04.623238+0000","last_unstale":"2024-04-18T21:06:31.683454+0000","last_undegraded":"2024-04-18T21:06:31.683454+0000","last_fullsized":"2024-04-18T21:06:31.683454+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:44:19.076499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":71,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684933+0000","last_change":"2024-04-18T21:05:04.633907+0000","last_active":"2024-04-18T21:06:31.684933+0000","last_peered":"2024-04-18T21:06:31.684933+0000","last_clean":"2024-04-18T21:06:31.684933+0000","last_became_active":"2024-04-18T21:05:04.630308+0000","last_became_peered":"2024-04-18T21:05:04.630308+0000","last_unstale":"2024-04-18T21:06:31.684933+0000","last_undegraded":"2024-04-18T21:06:31.684933+0000","last_fullsized":"2024-04-18T21:06:31.684933+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:55:46.219812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683649+0000","last_change":"2024-04-18T21:05:05.658572+0000","last_active":"2024-04-18T21:06:31.683649+0000","last_peered":"2024-04-18T21:06:31.683649+0000","last_clean":"2024-04-18T21:06:31.683649+0000","last_became_active":"2024-04-18T21:05:05.657842+0000","last_became_peered":"2024-04-18T21:05:05.657842+0000","last_unstale":"2024-04-18T21:06:31.683649+0000","last_undegraded":"2024-04-18T21:06:31.683649+0000","last_fullsized":"2024-04-18T21:06:31.683649+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:26:38.636530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":72,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.686098+0000","last_change":"2024-04-18T21:05:04.628541+0000","last_active":"2024-04-18T21:06:31.686098+0000","last_peered":"2024-04-18T21:06:31.686098+0000","last_clean":"2024-04-18T21:06:31.686098+0000","last_became_active":"2024-04-18T21:05:04.627407+0000","last_became_peered":"2024-04-18T21:05:04.627407+0000","last_unstale":"2024-04-18T21:06:31.686098+0000","last_undegraded":"2024-04-18T21:06:31.686098+0000","last_fullsized":"2024-04-18T21:06:31.686098+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:55:48.643174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683960+0000","last_change":"2024-04-18T21:05:05.651649+0000","last_active":"2024-04-18T21:06:31.683960+0000","last_peered":"2024-04-18T21:06:31.683960+0000","last_clean":"2024-04-18T21:06:31.683960+0000","last_became_active":"2024-04-18T21:05:05.646809+0000","last_became_peered":"2024-04-18T21:05:05.646809+0000","last_unstale":"2024-04-18T21:06:31.683960+0000","last_undegraded":"2024-04-18T21:06:31.683960+0000","last_fullsized":"2024-04-18T21:06:31.683960+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:23.698827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":71,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685634+0000","last_change":"2024-04-18T21:05:04.634055+0000","last_active":"2024-04-18T21:06:31.685634+0000","last_peered":"2024-04-18T21:06:31.685634+0000","last_clean":"2024-04-18T21:06:31.685634+0000","last_became_active":"2024-04-18T21:05:04.630736+0000","last_became_peered":"2024-04-18T21:05:04.630736+0000","last_unstale":"2024-04-18T21:06:31.685634+0000","last_undegraded":"2024-04-18T21:06:31.685634+0000","last_fullsized":"2024-04-18T21:06:31.685634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:06:44.001512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684524+0000","last_change":"2024-04-18T21:05:05.628869+0000","last_active":"2024-04-18T21:06:31.684524+0000","last_peered":"2024-04-18T21:06:31.684524+0000","last_clean":"2024-04-18T21:06:31.684524+0000","last_became_active":"2024-04-18T21:05:05.627071+0000","last_became_peered":"2024-04-18T21:05:05.627071+0000","last_unstale":"2024-04-18T21:06:31.684524+0000","last_undegraded":"2024-04-18T21:06:31.684524+0000","last_fullsized":"2024-04-18T21:06:31.684524+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:31:31.842528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":70,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685436+0000","last_change":"2024-04-18T21:05:04.625520+0000","last_active":"2024-04-18T21:06:31.685436+0000","last_peered":"2024-04-18T21:06:31.685436+0000","last_clean":"2024-04-18T21:06:31.685436+0000","last_became_active":"2024-04-18T21:05:04.624656+0000","last_became_peered":"2024-04-18T21:05:04.624656+0000","last_unstale":"2024-04-18T21:06:31.685436+0000","last_undegraded":"2024-04-18T21:06:31.685436+0000","last_fullsized":"2024-04-18T21:06:31.685436+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:56:05.795125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":66,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.609801+0000","last_change":"2024-04-18T21:05:05.649406+0000","last_active":"2024-04-18T21:06:31.609801+0000","last_peered":"2024-04-18T21:06:31.609801+0000","last_clean":"2024-04-18T21:06:31.609801+0000","last_became_active":"2024-04-18T21:05:05.648380+0000","last_became_peered":"2024-04-18T21:05:05.648380+0000","last_unstale":"2024-04-18T21:06:31.609801+0000","last_undegraded":"2024-04-18T21:06:31.609801+0000","last_fullsized":"2024-04-18T21:06:31.609801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":70,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.610472+0000","last_change":"2024-04-18T21:05:04.640216+0000","last_active":"2024-04-18T21:06:31.610472+0000","last_peered":"2024-04-18T21:06:31.610472+0000","last_clean":"2024-04-18T21:06:31.610472+0000","last_became_active":"2024-04-18T21:05:04.639349+0000","last_became_peered":"2024-04-18T21:05:04.639349+0000","last_unstale":"2024-04-18T21:06:31.610472+0000","last_undegraded":"2024-04-18T21:06:31.610472+0000","last_fullsized":"2024-04-18T21:06:31.610472+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:09:18.466987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684195+0000","last_change":"2024-04-18T21:05:05.628850+0000","last_active":"2024-04-18T21:06:31.684195+0000","last_peered":"2024-04-18T21:06:31.684195+0000","last_clean":"2024-04-18T21:06:31.684195+0000","last_became_active":"2024-04-18T21:05:05.627521+0000","last_became_peered":"2024-04-18T21:05:05.627521+0000","last_unstale":"2024-04-18T21:06:31.684195+0000","last_undegraded":"2024-04-18T21:06:31.684195+0000","last_fullsized":"2024-04-18T21:06:31.684195+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:14:37.912032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":70,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684862+0000","last_change":"2024-04-18T21:05:04.634674+0000","last_active":"2024-04-18T21:06:31.684862+0000","last_peered":"2024-04-18T21:06:31.684862+0000","last_clean":"2024-04-18T21:06:31.684862+0000","last_became_active":"2024-04-18T21:05:04.632284+0000","last_became_peered":"2024-04-18T21:05:04.632284+0000","last_unstale":"2024-04-18T21:06:31.684862+0000","last_undegraded":"2024-04-18T21:06:31.684862+0000","last_fullsized":"2024-04-18T21:06:31.684862+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:09:18.466987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685377+0000","last_change":"2024-04-18T21:05:05.647377+0000","last_active":"2024-04-18T21:06:31.685377+0000","last_peered":"2024-04-18T21:06:31.685377+0000","last_clean":"2024-04-18T21:06:31.685377+0000","last_became_active":"2024-04-18T21:05:05.645067+0000","last_became_peered":"2024-04-18T21:05:05.645067+0000","last_unstale":"2024-04-18T21:06:31.685377+0000","last_undegraded":"2024-04-18T21:06:31.685377+0000","last_fullsized":"2024-04-18T21:06:31.685377+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:29:30.243751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":70,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684495+0000","last_change":"2024-04-18T21:05:04.627578+0000","last_active":"2024-04-18T21:06:31.684495+0000","last_peered":"2024-04-18T21:06:31.684495+0000","last_clean":"2024-04-18T21:06:31.684495+0000","last_became_active":"2024-04-18T21:05:04.626786+0000","last_became_peered":"2024-04-18T21:05:04.626786+0000","last_unstale":"2024-04-18T21:06:31.684495+0000","last_undegraded":"2024-04-18T21:06:31.684495+0000","last_fullsized":"2024-04-18T21:06:31.684495+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:55:59.563512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684719+0000","last_change":"2024-04-18T21:05:05.640817+0000","last_active":"2024-04-18T21:06:31.684719+0000","last_peered":"2024-04-18T21:06:31.684719+0000","last_clean":"2024-04-18T21:06:31.684719+0000","last_became_active":"2024-04-18T21:05:05.635526+0000","last_became_peered":"2024-04-18T21:05:05.635526+0000","last_unstale":"2024-04-18T21:06:31.684719+0000","last_undegraded":"2024-04-18T21:06:31.684719+0000","last_fullsized":"2024-04-18T21:06:31.684719+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:44:29.823511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":70,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683954+0000","last_change":"2024-04-18T21:05:04.636499+0000","last_active":"2024-04-18T21:06:31.683954+0000","last_peered":"2024-04-18T21:06:31.683954+0000","last_clean":"2024-04-18T21:06:31.683954+0000","last_became_active":"2024-04-18T21:05:04.635830+0000","last_became_peered":"2024-04-18T21:05:04.635830+0000","last_unstale":"2024-04-18T21:06:31.683954+0000","last_undegraded":"2024-04-18T21:06:31.683954+0000","last_fullsized":"2024-04-18T21:06:31.683954+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:26:30.565175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":66,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.611166+0000","last_change":"2024-04-18T21:05:05.660974+0000","last_active":"2024-04-18T21:06:31.611166+0000","last_peered":"2024-04-18T21:06:31.611166+0000","last_clean":"2024-04-18T21:06:31.611166+0000","last_became_active":"2024-04-18T21:05:05.659287+0000","last_became_peered":"2024-04-18T21:05:05.659287+0000","last_unstale":"2024-04-18T21:06:31.611166+0000","last_undegraded":"2024-04-18T21:06:31.611166+0000","last_fullsized":"2024-04-18T21:06:31.611166+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:50:40.920146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":278,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685300+0000","last_change":"2024-04-18T21:04:54.511605+0000","last_active":"2024-04-18T21:06:31.685300+0000","last_peered":"2024-04-18T21:06:31.685300+0000","last_clean":"2024-04-18T21:06:31.685300+0000","last_became_active":"2024-04-18T21:04:54.510791+0000","last_became_peered":"2024-04-18T21:04:54.510791+0000","last_unstale":"2024-04-18T21:06:31.685300+0000","last_undegraded":"2024-04-18T21:06:31.685300+0000","last_fullsized":"2024-04-18T21:06:31.685300+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_clean_scrub_stamp":"2024-04-18T21:04:53.494814+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:46.262250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":76,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685430+0000","last_change":"2024-04-18T21:05:00.576671+0000","last_active":"2024-04-18T21:06:31.685430+0000","last_peered":"2024-04-18T21:06:31.685430+0000","last_clean":"2024-04-18T21:06:31.685430+0000","last_became_active":"2024-04-18T21:05:00.575933+0000","last_became_peered":"2024-04-18T21:05:00.575933+0000","last_unstale":"2024-04-18T21:06:31.685430+0000","last_undegraded":"2024-04-18T21:06:31.685430+0000","last_fullsized":"2024-04-18T21:06:31.685430+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:14:59.207959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":37,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684060+0000","last_change":"2024-04-18T21:06:01.034577+0000","last_active":"2024-04-18T21:06:31.684060+0000","last_peered":"2024-04-18T21:06:31.684060+0000","last_clean":"2024-04-18T21:06:31.684060+0000","last_became_active":"2024-04-18T21:06:01.033899+0000","last_became_peered":"2024-04-18T21:06:01.033899+0000","last_unstale":"2024-04-18T21:06:31.684060+0000","last_undegraded":"2024-04-18T21:06:31.684060+0000","last_fullsized":"2024-04-18T21:06:31.684060+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:13:40.375625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685499+0000","last_change":"2024-04-18T21:05:05.647623+0000","last_active":"2024-04-18T21:06:31.685499+0000","last_peered":"2024-04-18T21:06:31.685499+0000","last_clean":"2024-04-18T21:06:31.685499+0000","last_became_active":"2024-04-18T21:05:05.645640+0000","last_became_peered":"2024-04-18T21:05:05.645640+0000","last_unstale":"2024-04-18T21:06:31.685499+0000","last_undegraded":"2024-04-18T21:06:31.685499+0000","last_fullsized":"2024-04-18T21:06:31.685499+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:59.950421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":76,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684023+0000","last_change":"2024-04-18T21:05:00.571960+0000","last_active":"2024-04-18T21:06:31.684023+0000","last_peered":"2024-04-18T21:06:31.684023+0000","last_clean":"2024-04-18T21:06:31.684023+0000","last_became_active":"2024-04-18T21:05:00.571301+0000","last_became_peered":"2024-04-18T21:05:00.571301+0000","last_unstale":"2024-04-18T21:06:31.684023+0000","last_undegraded":"2024-04-18T21:06:31.684023+0000","last_fullsized":"2024-04-18T21:06:31.684023+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:31:59.262440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":37,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683128+0000","last_change":"2024-04-18T21:06:01.033769+0000","last_active":"2024-04-18T21:06:31.683128+0000","last_peered":"2024-04-18T21:06:31.683128+0000","last_clean":"2024-04-18T21:06:31.683128+0000","last_became_active":"2024-04-18T21:06:01.033157+0000","last_became_peered":"2024-04-18T21:06:01.033157+0000","last_unstale":"2024-04-18T21:06:31.683128+0000","last_undegraded":"2024-04-18T21:06:31.683128+0000","last_fullsized":"2024-04-18T21:06:31.683128+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:42:40.133263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685798+0000","last_change":"2024-04-18T21:05:05.654121+0000","last_active":"2024-04-18T21:06:31.685798+0000","last_peered":"2024-04-18T21:06:31.685798+0000","last_clean":"2024-04-18T21:06:31.685798+0000","last_became_active":"2024-04-18T21:05:05.651310+0000","last_became_peered":"2024-04-18T21:05:05.651310+0000","last_unstale":"2024-04-18T21:06:31.685798+0000","last_undegraded":"2024-04-18T21:06:31.685798+0000","last_fullsized":"2024-04-18T21:06:31.685798+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:01.841786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":74,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.610111+0000","last_change":"2024-04-18T21:05:00.578604+0000","last_active":"2024-04-18T21:06:31.610111+0000","last_peered":"2024-04-18T21:06:31.610111+0000","last_clean":"2024-04-18T21:06:31.610111+0000","last_became_active":"2024-04-18T21:05:00.577988+0000","last_became_peered":"2024-04-18T21:05:00.577988+0000","last_unstale":"2024-04-18T21:06:31.610111+0000","last_undegraded":"2024-04-18T21:06:31.610111+0000","last_fullsized":"2024-04-18T21:06:31.610111+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:54:54.201759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":70,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683966+0000","last_change":"2024-04-18T21:05:04.627627+0000","last_active":"2024-04-18T21:06:31.683966+0000","last_peered":"2024-04-18T21:06:31.683966+0000","last_clean":"2024-04-18T21:06:31.683966+0000","last_became_active":"2024-04-18T21:05:04.626850+0000","last_became_peered":"2024-04-18T21:05:04.626850+0000","last_unstale":"2024-04-18T21:06:31.683966+0000","last_undegraded":"2024-04-18T21:06:31.683966+0000","last_fullsized":"2024-04-18T21:06:31.683966+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:43:31.453080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":66,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.611206+0000","last_change":"2024-04-18T21:05:05.661488+0000","last_active":"2024-04-18T21:06:31.611206+0000","last_peered":"2024-04-18T21:06:31.611206+0000","last_clean":"2024-04-18T21:06:31.611206+0000","last_became_active":"2024-04-18T21:05:05.660283+0000","last_became_peered":"2024-04-18T21:05:05.660283+0000","last_unstale":"2024-04-18T21:06:31.611206+0000","last_undegraded":"2024-04-18T21:06:31.611206+0000","last_fullsized":"2024-04-18T21:06:31.611206+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:04.350492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":76,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685050+0000","last_change":"2024-04-18T21:05:00.576606+0000","last_active":"2024-04-18T21:06:31.685050+0000","last_peered":"2024-04-18T21:06:31.685050+0000","last_clean":"2024-04-18T21:06:31.685050+0000","last_became_active":"2024-04-18T21:05:00.575951+0000","last_became_peered":"2024-04-18T21:05:00.575951+0000","last_unstale":"2024-04-18T21:06:31.685050+0000","last_undegraded":"2024-04-18T21:06:31.685050+0000","last_fullsized":"2024-04-18T21:06:31.685050+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:32:17.612481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":70,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685186+0000","last_change":"2024-04-18T21:05:04.627296+0000","last_active":"2024-04-18T21:06:31.685186+0000","last_peered":"2024-04-18T21:06:31.685186+0000","last_clean":"2024-04-18T21:06:31.685186+0000","last_became_active":"2024-04-18T21:05:04.626801+0000","last_became_peered":"2024-04-18T21:05:04.626801+0000","last_unstale":"2024-04-18T21:06:31.685186+0000","last_undegraded":"2024-04-18T21:06:31.685186+0000","last_fullsized":"2024-04-18T21:06:31.685186+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:46:36.285416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":66,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.610437+0000","last_change":"2024-04-18T21:05:05.655152+0000","last_active":"2024-04-18T21:06:31.610437+0000","last_peered":"2024-04-18T21:06:31.610437+0000","last_clean":"2024-04-18T21:06:31.610437+0000","last_became_active":"2024-04-18T21:05:05.654506+0000","last_became_peered":"2024-04-18T21:05:05.654506+0000","last_unstale":"2024-04-18T21:06:31.610437+0000","last_undegraded":"2024-04-18T21:06:31.610437+0000","last_fullsized":"2024-04-18T21:06:31.610437+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:32:23.929877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":70,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685647+0000","last_change":"2024-04-18T21:05:04.628916+0000","last_active":"2024-04-18T21:06:31.685647+0000","last_peered":"2024-04-18T21:06:31.685647+0000","last_clean":"2024-04-18T21:06:31.685647+0000","last_became_active":"2024-04-18T21:05:04.628245+0000","last_became_peered":"2024-04-18T21:05:04.628245+0000","last_unstale":"2024-04-18T21:06:31.685647+0000","last_undegraded":"2024-04-18T21:06:31.685647+0000","last_fullsized":"2024-04-18T21:06:31.685647+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:34:58.562540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685320+0000","last_change":"2024-04-18T21:06:01.036156+0000","last_active":"2024-04-18T21:06:31.685320+0000","last_peered":"2024-04-18T21:06:31.685320+0000","last_clean":"2024-04-18T21:06:31.685320+0000","last_became_active":"2024-04-18T21:06:01.035478+0000","last_became_peered":"2024-04-18T21:06:01.035478+0000","last_unstale":"2024-04-18T21:06:31.685320+0000","last_undegraded":"2024-04-18T21:06:31.685320+0000","last_fullsized":"2024-04-18T21:06:31.685320+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:25:04.260649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684418+0000","last_change":"2024-04-18T21:05:05.646076+0000","last_active":"2024-04-18T21:06:31.684418+0000","last_peered":"2024-04-18T21:06:31.684418+0000","last_clean":"2024-04-18T21:06:31.684418+0000","last_became_active":"2024-04-18T21:05:05.645104+0000","last_became_peered":"2024-04-18T21:05:05.645104+0000","last_unstale":"2024-04-18T21:06:31.684418+0000","last_undegraded":"2024-04-18T21:06:31.684418+0000","last_fullsized":"2024-04-18T21:06:31.684418+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:34:38.427319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":68,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.610945+0000","last_change":"2024-04-18T21:05:04.639700+0000","last_active":"2024-04-18T21:06:31.610945+0000","last_peered":"2024-04-18T21:06:31.610945+0000","last_clean":"2024-04-18T21:06:31.610945+0000","last_became_active":"2024-04-18T21:05:04.638928+0000","last_became_peered":"2024-04-18T21:05:04.638928+0000","last_unstale":"2024-04-18T21:06:31.610945+0000","last_undegraded":"2024-04-18T21:06:31.610945+0000","last_fullsized":"2024-04-18T21:06:31.610945+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:00:08.877854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":76,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.686247+0000","last_change":"2024-04-18T21:05:00.576907+0000","last_active":"2024-04-18T21:06:31.686247+0000","last_peered":"2024-04-18T21:06:31.686247+0000","last_clean":"2024-04-18T21:06:31.686247+0000","last_became_active":"2024-04-18T21:05:00.576152+0000","last_became_peered":"2024-04-18T21:05:00.576152+0000","last_unstale":"2024-04-18T21:06:31.686247+0000","last_undegraded":"2024-04-18T21:06:31.686247+0000","last_fullsized":"2024-04-18T21:06:31.686247+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:25:07.270023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684849+0000","last_change":"2024-04-18T21:05:05.646026+0000","last_active":"2024-04-18T21:06:31.684849+0000","last_peered":"2024-04-18T21:06:31.684849+0000","last_clean":"2024-04-18T21:06:31.684849+0000","last_became_active":"2024-04-18T21:05:05.645192+0000","last_became_peered":"2024-04-18T21:05:05.645192+0000","last_unstale":"2024-04-18T21:06:31.684849+0000","last_undegraded":"2024-04-18T21:06:31.684849+0000","last_fullsized":"2024-04-18T21:06:31.684849+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:05:46.009381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":70,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.611585+0000","last_change":"2024-04-18T21:05:04.640732+0000","last_active":"2024-04-18T21:06:31.611585+0000","last_peered":"2024-04-18T21:06:31.611585+0000","last_clean":"2024-04-18T21:06:31.611585+0000","last_became_active":"2024-04-18T21:05:04.638505+0000","last_became_peered":"2024-04-18T21:05:04.638505+0000","last_unstale":"2024-04-18T21:06:31.611585+0000","last_undegraded":"2024-04-18T21:06:31.611585+0000","last_fullsized":"2024-04-18T21:06:31.611585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:34:58.562540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.686102+0000","last_change":"2024-04-18T21:06:01.036362+0000","last_active":"2024-04-18T21:06:31.686102+0000","last_peered":"2024-04-18T21:06:31.686102+0000","last_clean":"2024-04-18T21:06:31.686102+0000","last_became_active":"2024-04-18T21:06:01.035483+0000","last_became_peered":"2024-04-18T21:06:01.035483+0000","last_unstale":"2024-04-18T21:06:31.686102+0000","last_undegraded":"2024-04-18T21:06:31.686102+0000","last_fullsized":"2024-04-18T21:06:31.686102+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:42:36.106273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":37,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.682828+0000","last_change":"2024-04-18T21:06:01.032606+0000","last_active":"2024-04-18T21:06:31.682828+0000","last_peered":"2024-04-18T21:06:31.682828+0000","last_clean":"2024-04-18T21:06:31.682828+0000","last_became_active":"2024-04-18T21:06:01.032092+0000","last_became_peered":"2024-04-18T21:06:01.032092+0000","last_unstale":"2024-04-18T21:06:31.682828+0000","last_undegraded":"2024-04-18T21:06:31.682828+0000","last_fullsized":"2024-04-18T21:06:31.682828+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:14:08.347445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"21'3","reported_seq":71,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.611416+0000","last_change":"2024-04-18T21:05:04.639898+0000","last_active":"2024-04-18T21:06:31.611416+0000","last_peered":"2024-04-18T21:06:31.611416+0000","last_clean":"2024-04-18T21:06:31.611416+0000","last_became_active":"2024-04-18T21:05:04.639115+0000","last_became_peered":"2024-04-18T21:05:04.639115+0000","last_unstale":"2024-04-18T21:06:31.611416+0000","last_undegraded":"2024-04-18T21:06:31.611416+0000","last_fullsized":"2024-04-18T21:06:31.611416+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:44:19.076499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":76,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685205+0000","last_change":"2024-04-18T21:05:00.572414+0000","last_active":"2024-04-18T21:06:31.685205+0000","last_peered":"2024-04-18T21:06:31.685205+0000","last_clean":"2024-04-18T21:06:31.685205+0000","last_became_active":"2024-04-18T21:05:00.571755+0000","last_became_peered":"2024-04-18T21:05:00.571755+0000","last_unstale":"2024-04-18T21:06:31.685205+0000","last_undegraded":"2024-04-18T21:06:31.685205+0000","last_fullsized":"2024-04-18T21:06:31.685205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:15:02.061128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684067+0000","last_change":"2024-04-18T21:05:05.655898+0000","last_active":"2024-04-18T21:06:31.684067+0000","last_peered":"2024-04-18T21:06:31.684067+0000","last_clean":"2024-04-18T21:06:31.684067+0000","last_became_active":"2024-04-18T21:05:05.654111+0000","last_became_peered":"2024-04-18T21:05:05.654111+0000","last_unstale":"2024-04-18T21:06:31.684067+0000","last_undegraded":"2024-04-18T21:06:31.684067+0000","last_fullsized":"2024-04-18T21:06:31.684067+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:19:38.537080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684675+0000","last_change":"2024-04-18T21:05:05.641373+0000","last_active":"2024-04-18T21:06:31.684675+0000","last_peered":"2024-04-18T21:06:31.684675+0000","last_clean":"2024-04-18T21:06:31.684675+0000","last_became_active":"2024-04-18T21:05:05.634204+0000","last_became_peered":"2024-04-18T21:05:05.634204+0000","last_unstale":"2024-04-18T21:06:31.684675+0000","last_undegraded":"2024-04-18T21:06:31.684675+0000","last_fullsized":"2024-04-18T21:06:31.684675+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:27:35.995004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"21'10","reported_seq":80,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684752+0000","last_change":"2024-04-18T21:05:04.631271+0000","last_active":"2024-04-18T21:06:31.684752+0000","last_peered":"2024-04-18T21:06:31.684752+0000","last_clean":"2024-04-18T21:06:31.684752+0000","last_became_active":"2024-04-18T21:05:04.630442+0000","last_became_peered":"2024-04-18T21:05:04.630442+0000","last_unstale":"2024-04-18T21:06:31.684752+0000","last_undegraded":"2024-04-18T21:06:31.684752+0000","last_fullsized":"2024-04-18T21:06:31.684752+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:33:48.703994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":66,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.609539+0000","last_change":"2024-04-18T21:05:05.637894+0000","last_active":"2024-04-18T21:06:31.609539+0000","last_peered":"2024-04-18T21:06:31.609539+0000","last_clean":"2024-04-18T21:06:31.609539+0000","last_became_active":"2024-04-18T21:05:05.636846+0000","last_became_peered":"2024-04-18T21:05:05.636846+0000","last_unstale":"2024-04-18T21:06:31.609539+0000","last_undegraded":"2024-04-18T21:06:31.609539+0000","last_fullsized":"2024-04-18T21:06:31.609539+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:34:31.132458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":73,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.686084+0000","last_change":"2024-04-18T21:05:04.631152+0000","last_active":"2024-04-18T21:06:31.686084+0000","last_peered":"2024-04-18T21:06:31.686084+0000","last_clean":"2024-04-18T21:06:31.686084+0000","last_became_active":"2024-04-18T21:05:04.628900+0000","last_became_peered":"2024-04-18T21:05:04.628900+0000","last_unstale":"2024-04-18T21:06:31.686084+0000","last_undegraded":"2024-04-18T21:06:31.686084+0000","last_fullsized":"2024-04-18T21:06:31.686084+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:40:21.452052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":70,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684987+0000","last_change":"2024-04-18T21:05:04.629470+0000","last_active":"2024-04-18T21:06:31.684987+0000","last_peered":"2024-04-18T21:06:31.684987+0000","last_clean":"2024-04-18T21:06:31.684987+0000","last_became_active":"2024-04-18T21:05:04.628286+0000","last_became_peered":"2024-04-18T21:05:04.628286+0000","last_unstale":"2024-04-18T21:06:31.684987+0000","last_undegraded":"2024-04-18T21:06:31.684987+0000","last_fullsized":"2024-04-18T21:06:31.684987+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:00:08.877854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":66,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.609254+0000","last_change":"2024-04-18T21:05:05.642793+0000","last_active":"2024-04-18T21:06:31.609254+0000","last_peered":"2024-04-18T21:06:31.609254+0000","last_clean":"2024-04-18T21:06:31.609254+0000","last_became_active":"2024-04-18T21:05:05.641983+0000","last_became_peered":"2024-04-18T21:05:05.641983+0000","last_unstale":"2024-04-18T21:06:31.609254+0000","last_undegraded":"2024-04-18T21:06:31.609254+0000","last_fullsized":"2024-04-18T21:06:31.609254+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:46:36.339289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":68,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.611435+0000","last_change":"2024-04-18T21:05:04.641445+0000","last_active":"2024-04-18T21:06:31.611435+0000","last_peered":"2024-04-18T21:06:31.611435+0000","last_clean":"2024-04-18T21:06:31.611435+0000","last_became_active":"2024-04-18T21:05:04.640682+0000","last_became_peered":"2024-04-18T21:05:04.640682+0000","last_unstale":"2024-04-18T21:06:31.611435+0000","last_undegraded":"2024-04-18T21:06:31.611435+0000","last_fullsized":"2024-04-18T21:06:31.611435+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:46:36.285416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":66,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.609295+0000","last_change":"2024-04-18T21:05:05.641561+0000","last_active":"2024-04-18T21:06:31.609295+0000","last_peered":"2024-04-18T21:06:31.609295+0000","last_clean":"2024-04-18T21:06:31.609295+0000","last_became_active":"2024-04-18T21:05:05.640922+0000","last_became_peered":"2024-04-18T21:05:05.640922+0000","last_unstale":"2024-04-18T21:06:31.609295+0000","last_undegraded":"2024-04-18T21:06:31.609295+0000","last_fullsized":"2024-04-18T21:06:31.609295+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:56.408234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.686100+0000","last_change":"2024-04-18T21:05:05.651530+0000","last_active":"2024-04-18T21:06:31.686100+0000","last_peered":"2024-04-18T21:06:31.686100+0000","last_clean":"2024-04-18T21:06:31.686100+0000","last_became_active":"2024-04-18T21:05:05.648167+0000","last_became_peered":"2024-04-18T21:05:05.648167+0000","last_unstale":"2024-04-18T21:06:31.686100+0000","last_undegraded":"2024-04-18T21:06:31.686100+0000","last_fullsized":"2024-04-18T21:06:31.686100+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:14:51.873741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":37,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684257+0000","last_change":"2024-04-18T21:06:01.033325+0000","last_active":"2024-04-18T21:06:31.684257+0000","last_peered":"2024-04-18T21:06:31.684257+0000","last_clean":"2024-04-18T21:06:31.684257+0000","last_became_active":"2024-04-18T21:06:01.032763+0000","last_became_peered":"2024-04-18T21:06:01.032763+0000","last_unstale":"2024-04-18T21:06:31.684257+0000","last_undegraded":"2024-04-18T21:06:31.684257+0000","last_fullsized":"2024-04-18T21:06:31.684257+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:46:21.038602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":37,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684441+0000","last_change":"2024-04-18T21:06:01.034762+0000","last_active":"2024-04-18T21:06:31.684441+0000","last_peered":"2024-04-18T21:06:31.684441+0000","last_clean":"2024-04-18T21:06:31.684441+0000","last_became_active":"2024-04-18T21:06:01.033874+0000","last_became_peered":"2024-04-18T21:06:01.033874+0000","last_unstale":"2024-04-18T21:06:31.684441+0000","last_undegraded":"2024-04-18T21:06:31.684441+0000","last_fullsized":"2024-04-18T21:06:31.684441+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:36:21.285460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":68,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.609593+0000","last_change":"2024-04-18T21:05:04.637597+0000","last_active":"2024-04-18T21:06:31.609593+0000","last_peered":"2024-04-18T21:06:31.609593+0000","last_clean":"2024-04-18T21:06:31.609593+0000","last_became_active":"2024-04-18T21:05:04.636827+0000","last_became_peered":"2024-04-18T21:05:04.636827+0000","last_unstale":"2024-04-18T21:06:31.609593+0000","last_undegraded":"2024-04-18T21:06:31.609593+0000","last_fullsized":"2024-04-18T21:06:31.609593+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:43.511952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685121+0000","last_change":"2024-04-18T21:05:05.658971+0000","last_active":"2024-04-18T21:06:31.685121+0000","last_peered":"2024-04-18T21:06:31.685121+0000","last_clean":"2024-04-18T21:06:31.685121+0000","last_became_active":"2024-04-18T21:05:05.658363+0000","last_became_peered":"2024-04-18T21:05:05.658363+0000","last_unstale":"2024-04-18T21:06:31.685121+0000","last_undegraded":"2024-04-18T21:06:31.685121+0000","last_fullsized":"2024-04-18T21:06:31.685121+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:12.944469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":71,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684757+0000","last_change":"2024-04-18T21:05:04.636585+0000","last_active":"2024-04-18T21:06:31.684757+0000","last_peered":"2024-04-18T21:06:31.684757+0000","last_clean":"2024-04-18T21:06:31.684757+0000","last_became_active":"2024-04-18T21:05:04.635670+0000","last_became_peered":"2024-04-18T21:05:04.635670+0000","last_unstale":"2024-04-18T21:06:31.684757+0000","last_undegraded":"2024-04-18T21:06:31.684757+0000","last_fullsized":"2024-04-18T21:06:31.684757+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:34:33.779063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684825+0000","last_change":"2024-04-18T21:05:05.649960+0000","last_active":"2024-04-18T21:06:31.684825+0000","last_peered":"2024-04-18T21:06:31.684825+0000","last_clean":"2024-04-18T21:06:31.684825+0000","last_became_active":"2024-04-18T21:05:05.648528+0000","last_became_peered":"2024-04-18T21:05:05.648528+0000","last_unstale":"2024-04-18T21:06:31.684825+0000","last_undegraded":"2024-04-18T21:06:31.684825+0000","last_fullsized":"2024-04-18T21:06:31.684825+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:20:45.938503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":71,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685668+0000","last_change":"2024-04-18T21:05:04.630151+0000","last_active":"2024-04-18T21:06:31.685668+0000","last_peered":"2024-04-18T21:06:31.685668+0000","last_clean":"2024-04-18T21:06:31.685668+0000","last_became_active":"2024-04-18T21:05:04.627968+0000","last_became_peered":"2024-04-18T21:05:04.627968+0000","last_unstale":"2024-04-18T21:06:31.685668+0000","last_undegraded":"2024-04-18T21:06:31.685668+0000","last_fullsized":"2024-04-18T21:06:31.685668+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:00:33.393636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684404+0000","last_change":"2024-04-18T21:05:05.624840+0000","last_active":"2024-04-18T21:06:31.684404+0000","last_peered":"2024-04-18T21:06:31.684404+0000","last_clean":"2024-04-18T21:06:31.684404+0000","last_became_active":"2024-04-18T21:05:05.622950+0000","last_became_peered":"2024-04-18T21:05:05.622950+0000","last_unstale":"2024-04-18T21:06:31.684404+0000","last_undegraded":"2024-04-18T21:06:31.684404+0000","last_fullsized":"2024-04-18T21:06:31.684404+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:27:17.530889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":72,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684479+0000","last_change":"2024-04-18T21:05:04.626715+0000","last_active":"2024-04-18T21:06:31.684479+0000","last_peered":"2024-04-18T21:06:31.684479+0000","last_clean":"2024-04-18T21:06:31.684479+0000","last_became_active":"2024-04-18T21:05:04.625270+0000","last_became_peered":"2024-04-18T21:05:04.625270+0000","last_unstale":"2024-04-18T21:06:31.684479+0000","last_undegraded":"2024-04-18T21:06:31.684479+0000","last_fullsized":"2024-04-18T21:06:31.684479+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:43.511952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684241+0000","last_change":"2024-04-18T21:05:05.627962+0000","last_active":"2024-04-18T21:06:31.684241+0000","last_peered":"2024-04-18T21:06:31.684241+0000","last_clean":"2024-04-18T21:06:31.684241+0000","last_became_active":"2024-04-18T21:05:05.626698+0000","last_became_peered":"2024-04-18T21:05:05.626698+0000","last_unstale":"2024-04-18T21:06:31.684241+0000","last_undegraded":"2024-04-18T21:06:31.684241+0000","last_fullsized":"2024-04-18T21:06:31.684241+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:48:48.973087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":72,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685682+0000","last_change":"2024-04-18T21:05:04.632776+0000","last_active":"2024-04-18T21:06:31.685682+0000","last_peered":"2024-04-18T21:06:31.685682+0000","last_clean":"2024-04-18T21:06:31.685682+0000","last_became_active":"2024-04-18T21:05:04.630142+0000","last_became_peered":"2024-04-18T21:05:04.630142+0000","last_unstale":"2024-04-18T21:06:31.685682+0000","last_undegraded":"2024-04-18T21:06:31.685682+0000","last_fullsized":"2024-04-18T21:06:31.685682+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:19:36.721897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684760+0000","last_change":"2024-04-18T21:05:05.653025+0000","last_active":"2024-04-18T21:06:31.684760+0000","last_peered":"2024-04-18T21:06:31.684760+0000","last_clean":"2024-04-18T21:06:31.684760+0000","last_became_active":"2024-04-18T21:05:05.645039+0000","last_became_peered":"2024-04-18T21:05:05.645039+0000","last_unstale":"2024-04-18T21:06:31.684760+0000","last_undegraded":"2024-04-18T21:06:31.684760+0000","last_fullsized":"2024-04-18T21:06:31.684760+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":69,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.611266+0000","last_change":"2024-04-18T21:05:04.640134+0000","last_active":"2024-04-18T21:06:31.611266+0000","last_peered":"2024-04-18T21:06:31.611266+0000","last_clean":"2024-04-18T21:06:31.611266+0000","last_became_active":"2024-04-18T21:05:04.638597+0000","last_became_peered":"2024-04-18T21:05:04.638597+0000","last_unstale":"2024-04-18T21:06:31.611266+0000","last_undegraded":"2024-04-18T21:06:31.611266+0000","last_fullsized":"2024-04-18T21:06:31.611266+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:56:05.795125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683778+0000","last_change":"2024-04-18T21:05:05.629022+0000","last_active":"2024-04-18T21:06:31.683778+0000","last_peered":"2024-04-18T21:06:31.683778+0000","last_clean":"2024-04-18T21:06:31.683778+0000","last_became_active":"2024-04-18T21:05:05.627643+0000","last_became_peered":"2024-04-18T21:05:05.627643+0000","last_unstale":"2024-04-18T21:06:31.683778+0000","last_undegraded":"2024-04-18T21:06:31.683778+0000","last_fullsized":"2024-04-18T21:06:31.683778+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:32:23.929877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":72,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.611308+0000","last_change":"2024-04-18T21:05:04.641338+0000","last_active":"2024-04-18T21:06:31.611308+0000","last_peered":"2024-04-18T21:06:31.611308+0000","last_clean":"2024-04-18T21:06:31.611308+0000","last_became_active":"2024-04-18T21:05:04.639958+0000","last_became_peered":"2024-04-18T21:05:04.639958+0000","last_unstale":"2024-04-18T21:06:31.611308+0000","last_undegraded":"2024-04-18T21:06:31.611308+0000","last_fullsized":"2024-04-18T21:06:31.611308+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:42:45.392908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7351,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738392,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35716,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336124,"statfs":{"total":96636764160,"available":96600190976,"internally_reserved":0,"allocated":385024,"data_stored":169652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738392,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32168,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339672,"statfs":{"total":96636764160,"available":96603824128,"internally_reserved":0,"allocated":1007616,"data_stored":770371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738390,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1015808,"data_stored":770987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:06:33.225 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:06:33.297 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:33.298+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:33.326 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:33.326 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:06:33.326 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-04-18T21:06:33.326 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:33.340 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:33.394 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:06:33.395 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:06:33.425 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:33.426+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:33.429 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1: {} 2024-04-18T21:06:33.429 INFO:teuthology.orchestra.run.smithi078.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:06:33.462 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:06:33.462 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:33.498 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:33.498+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:33.502 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:33.502 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:33.517 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:33.599 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:33.599+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:33.684 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:33.684 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:33.699 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:33.700 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:33.699+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:33.705 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-18T21:06:33.762 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:06:33.764 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-04-18T21:06:33.785 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":95,"stamp":"2024-04-18T21:06:32.683479+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597719,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":256,"num_write_kb":3483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":95900,"kb_used_data":2352,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":283019620,"statfs":{"total":289910292480,"available":289812090880,"internally_reserved":0,"allocated":2408448,"data_stored":1711010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.158776"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685864+0000","last_change":"2024-04-18T21:05:05.652795+0000","last_active":"2024-04-18T21:06:31.685864+0000","last_peered":"2024-04-18T21:06:31.685864+0000","last_clean":"2024-04-18T21:06:31.685864+0000","last_became_active":"2024-04-18T21:05:05.650121+0000","last_became_peered":"2024-04-18T21:05:05.650121+0000","last_unstale":"2024-04-18T21:06:31.685864+0000","last_undegraded":"2024-04-18T21:06:31.685864+0000","last_fullsized":"2024-04-18T21:06:31.685864+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685082+0000","last_change":"2024-04-18T21:05:05.657531+0000","last_active":"2024-04-18T21:06:31.685082+0000","last_peered":"2024-04-18T21:06:31.685082+0000","last_clean":"2024-04-18T21:06:31.685082+0000","last_became_active":"2024-04-18T21:05:05.653101+0000","last_became_peered":"2024-04-18T21:05:05.653101+0000","last_unstale":"2024-04-18T21:06:31.685082+0000","last_undegraded":"2024-04-18T21:06:31.685082+0000","last_fullsized":"2024-04-18T21:06:31.685082+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:32:23.929877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683945+0000","last_change":"2024-04-18T21:05:05.647965+0000","last_active":"2024-04-18T21:06:31.683945+0000","last_peered":"2024-04-18T21:06:31.683945+0000","last_clean":"2024-04-18T21:06:31.683945+0000","last_became_active":"2024-04-18T21:05:05.645931+0000","last_became_peered":"2024-04-18T21:05:05.645931+0000","last_unstale":"2024-04-18T21:06:31.683945+0000","last_undegraded":"2024-04-18T21:06:31.683945+0000","last_fullsized":"2024-04-18T21:06:31.683945+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:04.350492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683944+0000","last_change":"2024-04-18T21:05:05.629321+0000","last_active":"2024-04-18T21:06:31.683944+0000","last_peered":"2024-04-18T21:06:31.683944+0000","last_clean":"2024-04-18T21:06:31.683944+0000","last_became_active":"2024-04-18T21:05:05.627956+0000","last_became_peered":"2024-04-18T21:05:05.627956+0000","last_unstale":"2024-04-18T21:06:31.683944+0000","last_undegraded":"2024-04-18T21:06:31.683944+0000","last_fullsized":"2024-04-18T21:06:31.683944+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:15:28.458476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685405+0000","last_change":"2024-04-18T21:05:05.648710+0000","last_active":"2024-04-18T21:06:31.685405+0000","last_peered":"2024-04-18T21:06:31.685405+0000","last_clean":"2024-04-18T21:06:31.685405+0000","last_became_active":"2024-04-18T21:05:05.647801+0000","last_became_peered":"2024-04-18T21:05:05.647801+0000","last_unstale":"2024-04-18T21:06:31.685405+0000","last_undegraded":"2024-04-18T21:06:31.685405+0000","last_fullsized":"2024-04-18T21:06:31.685405+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:46:36.339289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683322+0000","last_change":"2024-04-18T21:05:05.629095+0000","last_active":"2024-04-18T21:06:31.683322+0000","last_peered":"2024-04-18T21:06:31.683322+0000","last_clean":"2024-04-18T21:06:31.683322+0000","last_became_active":"2024-04-18T21:05:05.627664+0000","last_became_peered":"2024-04-18T21:05:05.627664+0000","last_unstale":"2024-04-18T21:06:31.683322+0000","last_undegraded":"2024-04-18T21:06:31.683322+0000","last_fullsized":"2024-04-18T21:06:31.683322+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:51:28.440070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683427+0000","last_change":"2024-04-18T21:05:05.625047+0000","last_active":"2024-04-18T21:06:31.683427+0000","last_peered":"2024-04-18T21:06:31.683427+0000","last_clean":"2024-04-18T21:06:31.683427+0000","last_became_active":"2024-04-18T21:05:05.622781+0000","last_became_peered":"2024-04-18T21:05:05.622781+0000","last_unstale":"2024-04-18T21:06:31.683427+0000","last_undegraded":"2024-04-18T21:06:31.683427+0000","last_fullsized":"2024-04-18T21:06:31.683427+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:12.944469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683007+0000","last_change":"2024-04-18T21:05:05.640390+0000","last_active":"2024-04-18T21:06:31.683007+0000","last_peered":"2024-04-18T21:06:31.683007+0000","last_clean":"2024-04-18T21:06:31.683007+0000","last_became_active":"2024-04-18T21:05:05.638295+0000","last_became_peered":"2024-04-18T21:05:05.638295+0000","last_unstale":"2024-04-18T21:06:31.683007+0000","last_undegraded":"2024-04-18T21:06:31.683007+0000","last_fullsized":"2024-04-18T21:06:31.683007+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:34:31.132458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":66,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.610957+0000","last_change":"2024-04-18T21:05:05.660752+0000","last_active":"2024-04-18T21:06:31.610957+0000","last_peered":"2024-04-18T21:06:31.610957+0000","last_clean":"2024-04-18T21:06:31.610957+0000","last_became_active":"2024-04-18T21:05:05.659226+0000","last_became_peered":"2024-04-18T21:05:05.659226+0000","last_unstale":"2024-04-18T21:06:31.610957+0000","last_undegraded":"2024-04-18T21:06:31.610957+0000","last_fullsized":"2024-04-18T21:06:31.610957+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:20:45.938503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685339+0000","last_change":"2024-04-18T21:05:05.656660+0000","last_active":"2024-04-18T21:06:31.685339+0000","last_peered":"2024-04-18T21:06:31.685339+0000","last_clean":"2024-04-18T21:06:31.685339+0000","last_became_active":"2024-04-18T21:05:05.653829+0000","last_became_peered":"2024-04-18T21:05:05.653829+0000","last_unstale":"2024-04-18T21:06:31.685339+0000","last_undegraded":"2024-04-18T21:06:31.685339+0000","last_fullsized":"2024-04-18T21:06:31.685339+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:50:40.920146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684150+0000","last_change":"2024-04-18T21:05:05.646721+0000","last_active":"2024-04-18T21:06:31.684150+0000","last_peered":"2024-04-18T21:06:31.684150+0000","last_clean":"2024-04-18T21:06:31.684150+0000","last_became_active":"2024-04-18T21:05:05.643421+0000","last_became_peered":"2024-04-18T21:05:05.643421+0000","last_unstale":"2024-04-18T21:06:31.684150+0000","last_undegraded":"2024-04-18T21:06:31.684150+0000","last_fullsized":"2024-04-18T21:06:31.684150+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:14:51.873741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684748+0000","last_change":"2024-04-18T21:05:05.656320+0000","last_active":"2024-04-18T21:06:31.684748+0000","last_peered":"2024-04-18T21:06:31.684748+0000","last_clean":"2024-04-18T21:06:31.684748+0000","last_became_active":"2024-04-18T21:05:05.655508+0000","last_became_peered":"2024-04-18T21:05:05.655508+0000","last_unstale":"2024-04-18T21:06:31.684748+0000","last_undegraded":"2024-04-18T21:06:31.684748+0000","last_fullsized":"2024-04-18T21:06:31.684748+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:51.225379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684313+0000","last_change":"2024-04-18T21:05:05.649001+0000","last_active":"2024-04-18T21:06:31.684313+0000","last_peered":"2024-04-18T21:06:31.684313+0000","last_clean":"2024-04-18T21:06:31.684313+0000","last_became_active":"2024-04-18T21:05:05.648070+0000","last_became_peered":"2024-04-18T21:05:05.648070+0000","last_unstale":"2024-04-18T21:06:31.684313+0000","last_undegraded":"2024-04-18T21:06:31.684313+0000","last_fullsized":"2024-04-18T21:06:31.684313+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:56.408234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683624+0000","last_change":"2024-04-18T21:05:05.635880+0000","last_active":"2024-04-18T21:06:31.683624+0000","last_peered":"2024-04-18T21:06:31.683624+0000","last_clean":"2024-04-18T21:06:31.683624+0000","last_became_active":"2024-04-18T21:05:05.635089+0000","last_became_peered":"2024-04-18T21:05:05.635089+0000","last_unstale":"2024-04-18T21:06:31.683624+0000","last_undegraded":"2024-04-18T21:06:31.683624+0000","last_fullsized":"2024-04-18T21:06:31.683624+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:50:40.920146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683419+0000","last_change":"2024-04-18T21:05:05.639640+0000","last_active":"2024-04-18T21:06:31.683419+0000","last_peered":"2024-04-18T21:06:31.683419+0000","last_clean":"2024-04-18T21:06:31.683419+0000","last_became_active":"2024-04-18T21:05:05.637311+0000","last_became_peered":"2024-04-18T21:05:05.637311+0000","last_unstale":"2024-04-18T21:06:31.683419+0000","last_undegraded":"2024-04-18T21:06:31.683419+0000","last_fullsized":"2024-04-18T21:06:31.683419+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:20:45.938503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683092+0000","last_change":"2024-04-18T21:05:05.638203+0000","last_active":"2024-04-18T21:06:31.683092+0000","last_peered":"2024-04-18T21:06:31.683092+0000","last_clean":"2024-04-18T21:06:31.683092+0000","last_became_active":"2024-04-18T21:05:05.637352+0000","last_became_peered":"2024-04-18T21:05:05.637352+0000","last_unstale":"2024-04-18T21:06:31.683092+0000","last_undegraded":"2024-04-18T21:06:31.683092+0000","last_fullsized":"2024-04-18T21:06:31.683092+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":37,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685582+0000","last_change":"2024-04-18T21:06:01.036290+0000","last_active":"2024-04-18T21:06:31.685582+0000","last_peered":"2024-04-18T21:06:31.685582+0000","last_clean":"2024-04-18T21:06:31.685582+0000","last_became_active":"2024-04-18T21:06:01.035478+0000","last_became_peered":"2024-04-18T21:06:01.035478+0000","last_unstale":"2024-04-18T21:06:31.685582+0000","last_undegraded":"2024-04-18T21:06:31.685582+0000","last_fullsized":"2024-04-18T21:06:31.685582+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:14:08.347445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685826+0000","last_change":"2024-04-18T21:05:05.655261+0000","last_active":"2024-04-18T21:06:31.685826+0000","last_peered":"2024-04-18T21:06:31.685826+0000","last_clean":"2024-04-18T21:06:31.685826+0000","last_became_active":"2024-04-18T21:05:05.651388+0000","last_became_peered":"2024-04-18T21:05:05.651388+0000","last_unstale":"2024-04-18T21:06:31.685826+0000","last_undegraded":"2024-04-18T21:06:31.685826+0000","last_fullsized":"2024-04-18T21:06:31.685826+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:53.850184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":66,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.610439+0000","last_change":"2024-04-18T21:05:05.652710+0000","last_active":"2024-04-18T21:06:31.610439+0000","last_peered":"2024-04-18T21:06:31.610439+0000","last_clean":"2024-04-18T21:06:31.610439+0000","last_became_active":"2024-04-18T21:05:05.651929+0000","last_became_peered":"2024-04-18T21:05:05.651929+0000","last_unstale":"2024-04-18T21:06:31.610439+0000","last_undegraded":"2024-04-18T21:06:31.610439+0000","last_fullsized":"2024-04-18T21:06:31.610439+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:12.944469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684124+0000","last_change":"2024-04-18T21:05:05.638338+0000","last_active":"2024-04-18T21:06:31.684124+0000","last_peered":"2024-04-18T21:06:31.684124+0000","last_clean":"2024-04-18T21:06:31.684124+0000","last_became_active":"2024-04-18T21:05:05.637567+0000","last_became_peered":"2024-04-18T21:05:05.637567+0000","last_unstale":"2024-04-18T21:06:31.684124+0000","last_undegraded":"2024-04-18T21:06:31.684124+0000","last_fullsized":"2024-04-18T21:06:31.684124+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683958+0000","last_change":"2024-04-18T21:05:05.643606+0000","last_active":"2024-04-18T21:06:31.683958+0000","last_peered":"2024-04-18T21:06:31.683958+0000","last_clean":"2024-04-18T21:06:31.683958+0000","last_became_active":"2024-04-18T21:05:05.642991+0000","last_became_peered":"2024-04-18T21:05:05.642991+0000","last_unstale":"2024-04-18T21:06:31.683958+0000","last_undegraded":"2024-04-18T21:06:31.683958+0000","last_fullsized":"2024-04-18T21:06:31.683958+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:01.841786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684476+0000","last_change":"2024-04-18T21:05:05.650896+0000","last_active":"2024-04-18T21:06:31.684476+0000","last_peered":"2024-04-18T21:06:31.684476+0000","last_clean":"2024-04-18T21:06:31.684476+0000","last_became_active":"2024-04-18T21:05:05.650083+0000","last_became_peered":"2024-04-18T21:05:05.650083+0000","last_unstale":"2024-04-18T21:06:31.684476+0000","last_undegraded":"2024-04-18T21:06:31.684476+0000","last_fullsized":"2024-04-18T21:06:31.684476+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:43:55.788425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":37,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.682950+0000","last_change":"2024-04-18T21:06:01.034390+0000","last_active":"2024-04-18T21:06:31.682950+0000","last_peered":"2024-04-18T21:06:31.682950+0000","last_clean":"2024-04-18T21:06:31.682950+0000","last_became_active":"2024-04-18T21:06:01.033524+0000","last_became_peered":"2024-04-18T21:06:01.033524+0000","last_unstale":"2024-04-18T21:06:31.682950+0000","last_undegraded":"2024-04-18T21:06:31.682950+0000","last_fullsized":"2024-04-18T21:06:31.682950+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:28:17.539732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683563+0000","last_change":"2024-04-18T21:05:05.642755+0000","last_active":"2024-04-18T21:06:31.683563+0000","last_peered":"2024-04-18T21:06:31.683563+0000","last_clean":"2024-04-18T21:06:31.683563+0000","last_became_active":"2024-04-18T21:05:05.642150+0000","last_became_peered":"2024-04-18T21:05:05.642150+0000","last_unstale":"2024-04-18T21:06:31.683563+0000","last_undegraded":"2024-04-18T21:06:31.683563+0000","last_fullsized":"2024-04-18T21:06:31.683563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:29:22.647425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685978+0000","last_change":"2024-04-18T21:05:05.653741+0000","last_active":"2024-04-18T21:06:31.685978+0000","last_peered":"2024-04-18T21:06:31.685978+0000","last_clean":"2024-04-18T21:06:31.685978+0000","last_became_active":"2024-04-18T21:05:05.650174+0000","last_became_peered":"2024-04-18T21:05:05.650174+0000","last_unstale":"2024-04-18T21:06:31.685978+0000","last_undegraded":"2024-04-18T21:06:31.685978+0000","last_fullsized":"2024-04-18T21:06:31.685978+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:04.350492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":66,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.610977+0000","last_change":"2024-04-18T21:05:05.649581+0000","last_active":"2024-04-18T21:06:31.610977+0000","last_peered":"2024-04-18T21:06:31.610977+0000","last_clean":"2024-04-18T21:06:31.610977+0000","last_became_active":"2024-04-18T21:05:05.648233+0000","last_became_peered":"2024-04-18T21:05:05.648233+0000","last_unstale":"2024-04-18T21:06:31.610977+0000","last_undegraded":"2024-04-18T21:06:31.610977+0000","last_fullsized":"2024-04-18T21:06:31.610977+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685069+0000","last_change":"2024-04-18T21:05:05.646926+0000","last_active":"2024-04-18T21:06:31.685069+0000","last_peered":"2024-04-18T21:06:31.685069+0000","last_clean":"2024-04-18T21:06:31.685069+0000","last_became_active":"2024-04-18T21:05:05.644942+0000","last_became_peered":"2024-04-18T21:05:05.644942+0000","last_unstale":"2024-04-18T21:06:31.685069+0000","last_undegraded":"2024-04-18T21:06:31.685069+0000","last_fullsized":"2024-04-18T21:06:31.685069+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:53.850184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685257+0000","last_change":"2024-04-18T21:05:05.656314+0000","last_active":"2024-04-18T21:06:31.685257+0000","last_peered":"2024-04-18T21:06:31.685257+0000","last_clean":"2024-04-18T21:06:31.685257+0000","last_became_active":"2024-04-18T21:05:05.655364+0000","last_became_peered":"2024-04-18T21:05:05.655364+0000","last_unstale":"2024-04-18T21:06:31.685257+0000","last_undegraded":"2024-04-18T21:06:31.685257+0000","last_fullsized":"2024-04-18T21:06:31.685257+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:27:17.530889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":37,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684271+0000","last_change":"2024-04-18T21:06:01.033572+0000","last_active":"2024-04-18T21:06:31.684271+0000","last_peered":"2024-04-18T21:06:31.684271+0000","last_clean":"2024-04-18T21:06:31.684271+0000","last_became_active":"2024-04-18T21:06:01.032811+0000","last_became_peered":"2024-04-18T21:06:01.032811+0000","last_unstale":"2024-04-18T21:06:31.684271+0000","last_undegraded":"2024-04-18T21:06:31.684271+0000","last_fullsized":"2024-04-18T21:06:31.684271+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:38:45.452379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684713+0000","last_change":"2024-04-18T21:05:05.648084+0000","last_active":"2024-04-18T21:06:31.684713+0000","last_peered":"2024-04-18T21:06:31.684713+0000","last_clean":"2024-04-18T21:06:31.684713+0000","last_became_active":"2024-04-18T21:05:05.645340+0000","last_became_peered":"2024-04-18T21:05:05.645340+0000","last_unstale":"2024-04-18T21:06:31.684713+0000","last_undegraded":"2024-04-18T21:06:31.684713+0000","last_fullsized":"2024-04-18T21:06:31.684713+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:34:31.132458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":37,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683791+0000","last_change":"2024-04-18T21:06:01.034356+0000","last_active":"2024-04-18T21:06:31.683791+0000","last_peered":"2024-04-18T21:06:31.683791+0000","last_clean":"2024-04-18T21:06:31.683791+0000","last_became_active":"2024-04-18T21:06:01.033850+0000","last_became_peered":"2024-04-18T21:06:01.033850+0000","last_unstale":"2024-04-18T21:06:31.683791+0000","last_undegraded":"2024-04-18T21:06:31.683791+0000","last_fullsized":"2024-04-18T21:06:31.683791+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:28:32.020153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683349+0000","last_change":"2024-04-18T21:05:05.626677+0000","last_active":"2024-04-18T21:06:31.683349+0000","last_peered":"2024-04-18T21:06:31.683349+0000","last_clean":"2024-04-18T21:06:31.683349+0000","last_became_active":"2024-04-18T21:05:05.624250+0000","last_became_peered":"2024-04-18T21:05:05.624250+0000","last_unstale":"2024-04-18T21:06:31.683349+0000","last_undegraded":"2024-04-18T21:06:31.683349+0000","last_fullsized":"2024-04-18T21:06:31.683349+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:51.225379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685005+0000","last_change":"2024-04-18T21:05:05.649918+0000","last_active":"2024-04-18T21:06:31.685005+0000","last_peered":"2024-04-18T21:06:31.685005+0000","last_clean":"2024-04-18T21:06:31.685005+0000","last_became_active":"2024-04-18T21:05:05.647147+0000","last_became_peered":"2024-04-18T21:05:05.647147+0000","last_unstale":"2024-04-18T21:06:31.685005+0000","last_undegraded":"2024-04-18T21:06:31.685005+0000","last_fullsized":"2024-04-18T21:06:31.685005+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:51:28.440070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":72,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685208+0000","last_change":"2024-04-18T21:05:04.632748+0000","last_active":"2024-04-18T21:06:31.685208+0000","last_peered":"2024-04-18T21:06:31.685208+0000","last_clean":"2024-04-18T21:06:31.685208+0000","last_became_active":"2024-04-18T21:05:04.628407+0000","last_became_peered":"2024-04-18T21:05:04.628407+0000","last_unstale":"2024-04-18T21:06:31.685208+0000","last_undegraded":"2024-04-18T21:06:31.685208+0000","last_fullsized":"2024-04-18T21:06:31.685208+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:42:45.392908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685415+0000","last_change":"2024-04-18T21:05:05.649199+0000","last_active":"2024-04-18T21:06:31.685415+0000","last_peered":"2024-04-18T21:06:31.685415+0000","last_clean":"2024-04-18T21:06:31.685415+0000","last_became_active":"2024-04-18T21:05:05.646898+0000","last_became_peered":"2024-04-18T21:05:05.646898+0000","last_unstale":"2024-04-18T21:06:31.685415+0000","last_undegraded":"2024-04-18T21:06:31.685415+0000","last_fullsized":"2024-04-18T21:06:31.685415+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:31:31.842528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":68,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.609793+0000","last_change":"2024-04-18T21:05:04.638017+0000","last_active":"2024-04-18T21:06:31.609793+0000","last_peered":"2024-04-18T21:06:31.609793+0000","last_clean":"2024-04-18T21:06:31.609793+0000","last_became_active":"2024-04-18T21:05:04.637287+0000","last_became_peered":"2024-04-18T21:05:04.637287+0000","last_unstale":"2024-04-18T21:06:31.609793+0000","last_undegraded":"2024-04-18T21:06:31.609793+0000","last_fullsized":"2024-04-18T21:06:31.609793+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:25.891472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":37,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683922+0000","last_change":"2024-04-18T21:06:01.034755+0000","last_active":"2024-04-18T21:06:31.683922+0000","last_peered":"2024-04-18T21:06:31.683922+0000","last_clean":"2024-04-18T21:06:31.683922+0000","last_became_active":"2024-04-18T21:06:01.033889+0000","last_became_peered":"2024-04-18T21:06:01.033889+0000","last_unstale":"2024-04-18T21:06:31.683922+0000","last_undegraded":"2024-04-18T21:06:31.683922+0000","last_fullsized":"2024-04-18T21:06:31.683922+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:09:08.394894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":70,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684240+0000","last_change":"2024-04-18T21:05:04.628489+0000","last_active":"2024-04-18T21:06:31.684240+0000","last_peered":"2024-04-18T21:06:31.684240+0000","last_clean":"2024-04-18T21:06:31.684240+0000","last_became_active":"2024-04-18T21:05:04.627279+0000","last_became_peered":"2024-04-18T21:05:04.627279+0000","last_unstale":"2024-04-18T21:06:31.684240+0000","last_undegraded":"2024-04-18T21:06:31.684240+0000","last_fullsized":"2024-04-18T21:06:31.684240+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:43:23.420744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":66,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.610990+0000","last_change":"2024-04-18T21:05:05.649347+0000","last_active":"2024-04-18T21:06:31.610990+0000","last_peered":"2024-04-18T21:06:31.610990+0000","last_clean":"2024-04-18T21:06:31.610990+0000","last_became_active":"2024-04-18T21:05:05.648144+0000","last_became_peered":"2024-04-18T21:05:05.648144+0000","last_unstale":"2024-04-18T21:06:31.610990+0000","last_undegraded":"2024-04-18T21:06:31.610990+0000","last_fullsized":"2024-04-18T21:06:31.610990+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:51:28.440070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":78,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683454+0000","last_change":"2024-04-18T21:05:04.624089+0000","last_active":"2024-04-18T21:06:31.683454+0000","last_peered":"2024-04-18T21:06:31.683454+0000","last_clean":"2024-04-18T21:06:31.683454+0000","last_became_active":"2024-04-18T21:05:04.623238+0000","last_became_peered":"2024-04-18T21:05:04.623238+0000","last_unstale":"2024-04-18T21:06:31.683454+0000","last_undegraded":"2024-04-18T21:06:31.683454+0000","last_fullsized":"2024-04-18T21:06:31.683454+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:44:19.076499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":71,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684933+0000","last_change":"2024-04-18T21:05:04.633907+0000","last_active":"2024-04-18T21:06:31.684933+0000","last_peered":"2024-04-18T21:06:31.684933+0000","last_clean":"2024-04-18T21:06:31.684933+0000","last_became_active":"2024-04-18T21:05:04.630308+0000","last_became_peered":"2024-04-18T21:05:04.630308+0000","last_unstale":"2024-04-18T21:06:31.684933+0000","last_undegraded":"2024-04-18T21:06:31.684933+0000","last_fullsized":"2024-04-18T21:06:31.684933+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:55:46.219812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683649+0000","last_change":"2024-04-18T21:05:05.658572+0000","last_active":"2024-04-18T21:06:31.683649+0000","last_peered":"2024-04-18T21:06:31.683649+0000","last_clean":"2024-04-18T21:06:31.683649+0000","last_became_active":"2024-04-18T21:05:05.657842+0000","last_became_peered":"2024-04-18T21:05:05.657842+0000","last_unstale":"2024-04-18T21:06:31.683649+0000","last_undegraded":"2024-04-18T21:06:31.683649+0000","last_fullsized":"2024-04-18T21:06:31.683649+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:26:38.636530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":72,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.686098+0000","last_change":"2024-04-18T21:05:04.628541+0000","last_active":"2024-04-18T21:06:31.686098+0000","last_peered":"2024-04-18T21:06:31.686098+0000","last_clean":"2024-04-18T21:06:31.686098+0000","last_became_active":"2024-04-18T21:05:04.627407+0000","last_became_peered":"2024-04-18T21:05:04.627407+0000","last_unstale":"2024-04-18T21:06:31.686098+0000","last_undegraded":"2024-04-18T21:06:31.686098+0000","last_fullsized":"2024-04-18T21:06:31.686098+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:55:48.643174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683960+0000","last_change":"2024-04-18T21:05:05.651649+0000","last_active":"2024-04-18T21:06:31.683960+0000","last_peered":"2024-04-18T21:06:31.683960+0000","last_clean":"2024-04-18T21:06:31.683960+0000","last_became_active":"2024-04-18T21:05:05.646809+0000","last_became_peered":"2024-04-18T21:05:05.646809+0000","last_unstale":"2024-04-18T21:06:31.683960+0000","last_undegraded":"2024-04-18T21:06:31.683960+0000","last_fullsized":"2024-04-18T21:06:31.683960+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:23.698827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":71,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685634+0000","last_change":"2024-04-18T21:05:04.634055+0000","last_active":"2024-04-18T21:06:31.685634+0000","last_peered":"2024-04-18T21:06:31.685634+0000","last_clean":"2024-04-18T21:06:31.685634+0000","last_became_active":"2024-04-18T21:05:04.630736+0000","last_became_peered":"2024-04-18T21:05:04.630736+0000","last_unstale":"2024-04-18T21:06:31.685634+0000","last_undegraded":"2024-04-18T21:06:31.685634+0000","last_fullsized":"2024-04-18T21:06:31.685634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:06:44.001512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684524+0000","last_change":"2024-04-18T21:05:05.628869+0000","last_active":"2024-04-18T21:06:31.684524+0000","last_peered":"2024-04-18T21:06:31.684524+0000","last_clean":"2024-04-18T21:06:31.684524+0000","last_became_active":"2024-04-18T21:05:05.627071+0000","last_became_peered":"2024-04-18T21:05:05.627071+0000","last_unstale":"2024-04-18T21:06:31.684524+0000","last_undegraded":"2024-04-18T21:06:31.684524+0000","last_fullsized":"2024-04-18T21:06:31.684524+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:31:31.842528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":70,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685436+0000","last_change":"2024-04-18T21:05:04.625520+0000","last_active":"2024-04-18T21:06:31.685436+0000","last_peered":"2024-04-18T21:06:31.685436+0000","last_clean":"2024-04-18T21:06:31.685436+0000","last_became_active":"2024-04-18T21:05:04.624656+0000","last_became_peered":"2024-04-18T21:05:04.624656+0000","last_unstale":"2024-04-18T21:06:31.685436+0000","last_undegraded":"2024-04-18T21:06:31.685436+0000","last_fullsized":"2024-04-18T21:06:31.685436+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:56:05.795125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":66,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.609801+0000","last_change":"2024-04-18T21:05:05.649406+0000","last_active":"2024-04-18T21:06:31.609801+0000","last_peered":"2024-04-18T21:06:31.609801+0000","last_clean":"2024-04-18T21:06:31.609801+0000","last_became_active":"2024-04-18T21:05:05.648380+0000","last_became_peered":"2024-04-18T21:05:05.648380+0000","last_unstale":"2024-04-18T21:06:31.609801+0000","last_undegraded":"2024-04-18T21:06:31.609801+0000","last_fullsized":"2024-04-18T21:06:31.609801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":70,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.610472+0000","last_change":"2024-04-18T21:05:04.640216+0000","last_active":"2024-04-18T21:06:31.610472+0000","last_peered":"2024-04-18T21:06:31.610472+0000","last_clean":"2024-04-18T21:06:31.610472+0000","last_became_active":"2024-04-18T21:05:04.639349+0000","last_became_peered":"2024-04-18T21:05:04.639349+0000","last_unstale":"2024-04-18T21:06:31.610472+0000","last_undegraded":"2024-04-18T21:06:31.610472+0000","last_fullsized":"2024-04-18T21:06:31.610472+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:09:18.466987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684195+0000","last_change":"2024-04-18T21:05:05.628850+0000","last_active":"2024-04-18T21:06:31.684195+0000","last_peered":"2024-04-18T21:06:31.684195+0000","last_clean":"2024-04-18T21:06:31.684195+0000","last_became_active":"2024-04-18T21:05:05.627521+0000","last_became_peered":"2024-04-18T21:05:05.627521+0000","last_unstale":"2024-04-18T21:06:31.684195+0000","last_undegraded":"2024-04-18T21:06:31.684195+0000","last_fullsized":"2024-04-18T21:06:31.684195+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:14:37.912032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":70,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684862+0000","last_change":"2024-04-18T21:05:04.634674+0000","last_active":"2024-04-18T21:06:31.684862+0000","last_peered":"2024-04-18T21:06:31.684862+0000","last_clean":"2024-04-18T21:06:31.684862+0000","last_became_active":"2024-04-18T21:05:04.632284+0000","last_became_peered":"2024-04-18T21:05:04.632284+0000","last_unstale":"2024-04-18T21:06:31.684862+0000","last_undegraded":"2024-04-18T21:06:31.684862+0000","last_fullsized":"2024-04-18T21:06:31.684862+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:09:18.466987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685377+0000","last_change":"2024-04-18T21:05:05.647377+0000","last_active":"2024-04-18T21:06:31.685377+0000","last_peered":"2024-04-18T21:06:31.685377+0000","last_clean":"2024-04-18T21:06:31.685377+0000","last_became_active":"2024-04-18T21:05:05.645067+0000","last_became_peered":"2024-04-18T21:05:05.645067+0000","last_unstale":"2024-04-18T21:06:31.685377+0000","last_undegraded":"2024-04-18T21:06:31.685377+0000","last_fullsized":"2024-04-18T21:06:31.685377+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:29:30.243751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":70,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684495+0000","last_change":"2024-04-18T21:05:04.627578+0000","last_active":"2024-04-18T21:06:31.684495+0000","last_peered":"2024-04-18T21:06:31.684495+0000","last_clean":"2024-04-18T21:06:31.684495+0000","last_became_active":"2024-04-18T21:05:04.626786+0000","last_became_peered":"2024-04-18T21:05:04.626786+0000","last_unstale":"2024-04-18T21:06:31.684495+0000","last_undegraded":"2024-04-18T21:06:31.684495+0000","last_fullsized":"2024-04-18T21:06:31.684495+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:55:59.563512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684719+0000","last_change":"2024-04-18T21:05:05.640817+0000","last_active":"2024-04-18T21:06:31.684719+0000","last_peered":"2024-04-18T21:06:31.684719+0000","last_clean":"2024-04-18T21:06:31.684719+0000","last_became_active":"2024-04-18T21:05:05.635526+0000","last_became_peered":"2024-04-18T21:05:05.635526+0000","last_unstale":"2024-04-18T21:06:31.684719+0000","last_undegraded":"2024-04-18T21:06:31.684719+0000","last_fullsized":"2024-04-18T21:06:31.684719+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:44:29.823511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":70,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683954+0000","last_change":"2024-04-18T21:05:04.636499+0000","last_active":"2024-04-18T21:06:31.683954+0000","last_peered":"2024-04-18T21:06:31.683954+0000","last_clean":"2024-04-18T21:06:31.683954+0000","last_became_active":"2024-04-18T21:05:04.635830+0000","last_became_peered":"2024-04-18T21:05:04.635830+0000","last_unstale":"2024-04-18T21:06:31.683954+0000","last_undegraded":"2024-04-18T21:06:31.683954+0000","last_fullsized":"2024-04-18T21:06:31.683954+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:26:30.565175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":66,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.611166+0000","last_change":"2024-04-18T21:05:05.660974+0000","last_active":"2024-04-18T21:06:31.611166+0000","last_peered":"2024-04-18T21:06:31.611166+0000","last_clean":"2024-04-18T21:06:31.611166+0000","last_became_active":"2024-04-18T21:05:05.659287+0000","last_became_peered":"2024-04-18T21:05:05.659287+0000","last_unstale":"2024-04-18T21:06:31.611166+0000","last_undegraded":"2024-04-18T21:06:31.611166+0000","last_fullsized":"2024-04-18T21:06:31.611166+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:50:40.920146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":278,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685300+0000","last_change":"2024-04-18T21:04:54.511605+0000","last_active":"2024-04-18T21:06:31.685300+0000","last_peered":"2024-04-18T21:06:31.685300+0000","last_clean":"2024-04-18T21:06:31.685300+0000","last_became_active":"2024-04-18T21:04:54.510791+0000","last_became_peered":"2024-04-18T21:04:54.510791+0000","last_unstale":"2024-04-18T21:06:31.685300+0000","last_undegraded":"2024-04-18T21:06:31.685300+0000","last_fullsized":"2024-04-18T21:06:31.685300+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_clean_scrub_stamp":"2024-04-18T21:04:53.494814+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:46.262250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":76,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685430+0000","last_change":"2024-04-18T21:05:00.576671+0000","last_active":"2024-04-18T21:06:31.685430+0000","last_peered":"2024-04-18T21:06:31.685430+0000","last_clean":"2024-04-18T21:06:31.685430+0000","last_became_active":"2024-04-18T21:05:00.575933+0000","last_became_peered":"2024-04-18T21:05:00.575933+0000","last_unstale":"2024-04-18T21:06:31.685430+0000","last_undegraded":"2024-04-18T21:06:31.685430+0000","last_fullsized":"2024-04-18T21:06:31.685430+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:14:59.207959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":37,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684060+0000","last_change":"2024-04-18T21:06:01.034577+0000","last_active":"2024-04-18T21:06:31.684060+0000","last_peered":"2024-04-18T21:06:31.684060+0000","last_clean":"2024-04-18T21:06:31.684060+0000","last_became_active":"2024-04-18T21:06:01.033899+0000","last_became_peered":"2024-04-18T21:06:01.033899+0000","last_unstale":"2024-04-18T21:06:31.684060+0000","last_undegraded":"2024-04-18T21:06:31.684060+0000","last_fullsized":"2024-04-18T21:06:31.684060+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:13:40.375625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685499+0000","last_change":"2024-04-18T21:05:05.647623+0000","last_active":"2024-04-18T21:06:31.685499+0000","last_peered":"2024-04-18T21:06:31.685499+0000","last_clean":"2024-04-18T21:06:31.685499+0000","last_became_active":"2024-04-18T21:05:05.645640+0000","last_became_peered":"2024-04-18T21:05:05.645640+0000","last_unstale":"2024-04-18T21:06:31.685499+0000","last_undegraded":"2024-04-18T21:06:31.685499+0000","last_fullsized":"2024-04-18T21:06:31.685499+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:59.950421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":76,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684023+0000","last_change":"2024-04-18T21:05:00.571960+0000","last_active":"2024-04-18T21:06:31.684023+0000","last_peered":"2024-04-18T21:06:31.684023+0000","last_clean":"2024-04-18T21:06:31.684023+0000","last_became_active":"2024-04-18T21:05:00.571301+0000","last_became_peered":"2024-04-18T21:05:00.571301+0000","last_unstale":"2024-04-18T21:06:31.684023+0000","last_undegraded":"2024-04-18T21:06:31.684023+0000","last_fullsized":"2024-04-18T21:06:31.684023+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:31:59.262440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":37,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683128+0000","last_change":"2024-04-18T21:06:01.033769+0000","last_active":"2024-04-18T21:06:31.683128+0000","last_peered":"2024-04-18T21:06:31.683128+0000","last_clean":"2024-04-18T21:06:31.683128+0000","last_became_active":"2024-04-18T21:06:01.033157+0000","last_became_peered":"2024-04-18T21:06:01.033157+0000","last_unstale":"2024-04-18T21:06:31.683128+0000","last_undegraded":"2024-04-18T21:06:31.683128+0000","last_fullsized":"2024-04-18T21:06:31.683128+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:42:40.133263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685798+0000","last_change":"2024-04-18T21:05:05.654121+0000","last_active":"2024-04-18T21:06:31.685798+0000","last_peered":"2024-04-18T21:06:31.685798+0000","last_clean":"2024-04-18T21:06:31.685798+0000","last_became_active":"2024-04-18T21:05:05.651310+0000","last_became_peered":"2024-04-18T21:05:05.651310+0000","last_unstale":"2024-04-18T21:06:31.685798+0000","last_undegraded":"2024-04-18T21:06:31.685798+0000","last_fullsized":"2024-04-18T21:06:31.685798+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:01.841786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":74,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.610111+0000","last_change":"2024-04-18T21:05:00.578604+0000","last_active":"2024-04-18T21:06:31.610111+0000","last_peered":"2024-04-18T21:06:31.610111+0000","last_clean":"2024-04-18T21:06:31.610111+0000","last_became_active":"2024-04-18T21:05:00.577988+0000","last_became_peered":"2024-04-18T21:05:00.577988+0000","last_unstale":"2024-04-18T21:06:31.610111+0000","last_undegraded":"2024-04-18T21:06:31.610111+0000","last_fullsized":"2024-04-18T21:06:31.610111+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:54:54.201759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":70,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683966+0000","last_change":"2024-04-18T21:05:04.627627+0000","last_active":"2024-04-18T21:06:31.683966+0000","last_peered":"2024-04-18T21:06:31.683966+0000","last_clean":"2024-04-18T21:06:31.683966+0000","last_became_active":"2024-04-18T21:05:04.626850+0000","last_became_peered":"2024-04-18T21:05:04.626850+0000","last_unstale":"2024-04-18T21:06:31.683966+0000","last_undegraded":"2024-04-18T21:06:31.683966+0000","last_fullsized":"2024-04-18T21:06:31.683966+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:43:31.453080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":66,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.611206+0000","last_change":"2024-04-18T21:05:05.661488+0000","last_active":"2024-04-18T21:06:31.611206+0000","last_peered":"2024-04-18T21:06:31.611206+0000","last_clean":"2024-04-18T21:06:31.611206+0000","last_became_active":"2024-04-18T21:05:05.660283+0000","last_became_peered":"2024-04-18T21:05:05.660283+0000","last_unstale":"2024-04-18T21:06:31.611206+0000","last_undegraded":"2024-04-18T21:06:31.611206+0000","last_fullsized":"2024-04-18T21:06:31.611206+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:04.350492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":76,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685050+0000","last_change":"2024-04-18T21:05:00.576606+0000","last_active":"2024-04-18T21:06:31.685050+0000","last_peered":"2024-04-18T21:06:31.685050+0000","last_clean":"2024-04-18T21:06:31.685050+0000","last_became_active":"2024-04-18T21:05:00.575951+0000","last_became_peered":"2024-04-18T21:05:00.575951+0000","last_unstale":"2024-04-18T21:06:31.685050+0000","last_undegraded":"2024-04-18T21:06:31.685050+0000","last_fullsized":"2024-04-18T21:06:31.685050+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:32:17.612481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":70,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685186+0000","last_change":"2024-04-18T21:05:04.627296+0000","last_active":"2024-04-18T21:06:31.685186+0000","last_peered":"2024-04-18T21:06:31.685186+0000","last_clean":"2024-04-18T21:06:31.685186+0000","last_became_active":"2024-04-18T21:05:04.626801+0000","last_became_peered":"2024-04-18T21:05:04.626801+0000","last_unstale":"2024-04-18T21:06:31.685186+0000","last_undegraded":"2024-04-18T21:06:31.685186+0000","last_fullsized":"2024-04-18T21:06:31.685186+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:46:36.285416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":66,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.610437+0000","last_change":"2024-04-18T21:05:05.655152+0000","last_active":"2024-04-18T21:06:31.610437+0000","last_peered":"2024-04-18T21:06:31.610437+0000","last_clean":"2024-04-18T21:06:31.610437+0000","last_became_active":"2024-04-18T21:05:05.654506+0000","last_became_peered":"2024-04-18T21:05:05.654506+0000","last_unstale":"2024-04-18T21:06:31.610437+0000","last_undegraded":"2024-04-18T21:06:31.610437+0000","last_fullsized":"2024-04-18T21:06:31.610437+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:32:23.929877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":70,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685647+0000","last_change":"2024-04-18T21:05:04.628916+0000","last_active":"2024-04-18T21:06:31.685647+0000","last_peered":"2024-04-18T21:06:31.685647+0000","last_clean":"2024-04-18T21:06:31.685647+0000","last_became_active":"2024-04-18T21:05:04.628245+0000","last_became_peered":"2024-04-18T21:05:04.628245+0000","last_unstale":"2024-04-18T21:06:31.685647+0000","last_undegraded":"2024-04-18T21:06:31.685647+0000","last_fullsized":"2024-04-18T21:06:31.685647+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:34:58.562540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685320+0000","last_change":"2024-04-18T21:06:01.036156+0000","last_active":"2024-04-18T21:06:31.685320+0000","last_peered":"2024-04-18T21:06:31.685320+0000","last_clean":"2024-04-18T21:06:31.685320+0000","last_became_active":"2024-04-18T21:06:01.035478+0000","last_became_peered":"2024-04-18T21:06:01.035478+0000","last_unstale":"2024-04-18T21:06:31.685320+0000","last_undegraded":"2024-04-18T21:06:31.685320+0000","last_fullsized":"2024-04-18T21:06:31.685320+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:25:04.260649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684418+0000","last_change":"2024-04-18T21:05:05.646076+0000","last_active":"2024-04-18T21:06:31.684418+0000","last_peered":"2024-04-18T21:06:31.684418+0000","last_clean":"2024-04-18T21:06:31.684418+0000","last_became_active":"2024-04-18T21:05:05.645104+0000","last_became_peered":"2024-04-18T21:05:05.645104+0000","last_unstale":"2024-04-18T21:06:31.684418+0000","last_undegraded":"2024-04-18T21:06:31.684418+0000","last_fullsized":"2024-04-18T21:06:31.684418+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:34:38.427319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":68,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.610945+0000","last_change":"2024-04-18T21:05:04.639700+0000","last_active":"2024-04-18T21:06:31.610945+0000","last_peered":"2024-04-18T21:06:31.610945+0000","last_clean":"2024-04-18T21:06:31.610945+0000","last_became_active":"2024-04-18T21:05:04.638928+0000","last_became_peered":"2024-04-18T21:05:04.638928+0000","last_unstale":"2024-04-18T21:06:31.610945+0000","last_undegraded":"2024-04-18T21:06:31.610945+0000","last_fullsized":"2024-04-18T21:06:31.610945+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:00:08.877854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":76,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.686247+0000","last_change":"2024-04-18T21:05:00.576907+0000","last_active":"2024-04-18T21:06:31.686247+0000","last_peered":"2024-04-18T21:06:31.686247+0000","last_clean":"2024-04-18T21:06:31.686247+0000","last_became_active":"2024-04-18T21:05:00.576152+0000","last_became_peered":"2024-04-18T21:05:00.576152+0000","last_unstale":"2024-04-18T21:06:31.686247+0000","last_undegraded":"2024-04-18T21:06:31.686247+0000","last_fullsized":"2024-04-18T21:06:31.686247+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:25:07.270023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684849+0000","last_change":"2024-04-18T21:05:05.646026+0000","last_active":"2024-04-18T21:06:31.684849+0000","last_peered":"2024-04-18T21:06:31.684849+0000","last_clean":"2024-04-18T21:06:31.684849+0000","last_became_active":"2024-04-18T21:05:05.645192+0000","last_became_peered":"2024-04-18T21:05:05.645192+0000","last_unstale":"2024-04-18T21:06:31.684849+0000","last_undegraded":"2024-04-18T21:06:31.684849+0000","last_fullsized":"2024-04-18T21:06:31.684849+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:05:46.009381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":70,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.611585+0000","last_change":"2024-04-18T21:05:04.640732+0000","last_active":"2024-04-18T21:06:31.611585+0000","last_peered":"2024-04-18T21:06:31.611585+0000","last_clean":"2024-04-18T21:06:31.611585+0000","last_became_active":"2024-04-18T21:05:04.638505+0000","last_became_peered":"2024-04-18T21:05:04.638505+0000","last_unstale":"2024-04-18T21:06:31.611585+0000","last_undegraded":"2024-04-18T21:06:31.611585+0000","last_fullsized":"2024-04-18T21:06:31.611585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:34:58.562540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.686102+0000","last_change":"2024-04-18T21:06:01.036362+0000","last_active":"2024-04-18T21:06:31.686102+0000","last_peered":"2024-04-18T21:06:31.686102+0000","last_clean":"2024-04-18T21:06:31.686102+0000","last_became_active":"2024-04-18T21:06:01.035483+0000","last_became_peered":"2024-04-18T21:06:01.035483+0000","last_unstale":"2024-04-18T21:06:31.686102+0000","last_undegraded":"2024-04-18T21:06:31.686102+0000","last_fullsized":"2024-04-18T21:06:31.686102+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:42:36.106273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":37,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.682828+0000","last_change":"2024-04-18T21:06:01.032606+0000","last_active":"2024-04-18T21:06:31.682828+0000","last_peered":"2024-04-18T21:06:31.682828+0000","last_clean":"2024-04-18T21:06:31.682828+0000","last_became_active":"2024-04-18T21:06:01.032092+0000","last_became_peered":"2024-04-18T21:06:01.032092+0000","last_unstale":"2024-04-18T21:06:31.682828+0000","last_undegraded":"2024-04-18T21:06:31.682828+0000","last_fullsized":"2024-04-18T21:06:31.682828+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:14:08.347445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"21'3","reported_seq":71,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.611416+0000","last_change":"2024-04-18T21:05:04.639898+0000","last_active":"2024-04-18T21:06:31.611416+0000","last_peered":"2024-04-18T21:06:31.611416+0000","last_clean":"2024-04-18T21:06:31.611416+0000","last_became_active":"2024-04-18T21:05:04.639115+0000","last_became_peered":"2024-04-18T21:05:04.639115+0000","last_unstale":"2024-04-18T21:06:31.611416+0000","last_undegraded":"2024-04-18T21:06:31.611416+0000","last_fullsized":"2024-04-18T21:06:31.611416+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:44:19.076499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":76,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685205+0000","last_change":"2024-04-18T21:05:00.572414+0000","last_active":"2024-04-18T21:06:31.685205+0000","last_peered":"2024-04-18T21:06:31.685205+0000","last_clean":"2024-04-18T21:06:31.685205+0000","last_became_active":"2024-04-18T21:05:00.571755+0000","last_became_peered":"2024-04-18T21:05:00.571755+0000","last_unstale":"2024-04-18T21:06:31.685205+0000","last_undegraded":"2024-04-18T21:06:31.685205+0000","last_fullsized":"2024-04-18T21:06:31.685205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:15:02.061128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684067+0000","last_change":"2024-04-18T21:05:05.655898+0000","last_active":"2024-04-18T21:06:31.684067+0000","last_peered":"2024-04-18T21:06:31.684067+0000","last_clean":"2024-04-18T21:06:31.684067+0000","last_became_active":"2024-04-18T21:05:05.654111+0000","last_became_peered":"2024-04-18T21:05:05.654111+0000","last_unstale":"2024-04-18T21:06:31.684067+0000","last_undegraded":"2024-04-18T21:06:31.684067+0000","last_fullsized":"2024-04-18T21:06:31.684067+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:19:38.537080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684675+0000","last_change":"2024-04-18T21:05:05.641373+0000","last_active":"2024-04-18T21:06:31.684675+0000","last_peered":"2024-04-18T21:06:31.684675+0000","last_clean":"2024-04-18T21:06:31.684675+0000","last_became_active":"2024-04-18T21:05:05.634204+0000","last_became_peered":"2024-04-18T21:05:05.634204+0000","last_unstale":"2024-04-18T21:06:31.684675+0000","last_undegraded":"2024-04-18T21:06:31.684675+0000","last_fullsized":"2024-04-18T21:06:31.684675+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:27:35.995004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"21'10","reported_seq":80,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684752+0000","last_change":"2024-04-18T21:05:04.631271+0000","last_active":"2024-04-18T21:06:31.684752+0000","last_peered":"2024-04-18T21:06:31.684752+0000","last_clean":"2024-04-18T21:06:31.684752+0000","last_became_active":"2024-04-18T21:05:04.630442+0000","last_became_peered":"2024-04-18T21:05:04.630442+0000","last_unstale":"2024-04-18T21:06:31.684752+0000","last_undegraded":"2024-04-18T21:06:31.684752+0000","last_fullsized":"2024-04-18T21:06:31.684752+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:33:48.703994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":66,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.609539+0000","last_change":"2024-04-18T21:05:05.637894+0000","last_active":"2024-04-18T21:06:31.609539+0000","last_peered":"2024-04-18T21:06:31.609539+0000","last_clean":"2024-04-18T21:06:31.609539+0000","last_became_active":"2024-04-18T21:05:05.636846+0000","last_became_peered":"2024-04-18T21:05:05.636846+0000","last_unstale":"2024-04-18T21:06:31.609539+0000","last_undegraded":"2024-04-18T21:06:31.609539+0000","last_fullsized":"2024-04-18T21:06:31.609539+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:34:31.132458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":73,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.686084+0000","last_change":"2024-04-18T21:05:04.631152+0000","last_active":"2024-04-18T21:06:31.686084+0000","last_peered":"2024-04-18T21:06:31.686084+0000","last_clean":"2024-04-18T21:06:31.686084+0000","last_became_active":"2024-04-18T21:05:04.628900+0000","last_became_peered":"2024-04-18T21:05:04.628900+0000","last_unstale":"2024-04-18T21:06:31.686084+0000","last_undegraded":"2024-04-18T21:06:31.686084+0000","last_fullsized":"2024-04-18T21:06:31.686084+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:40:21.452052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":70,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684987+0000","last_change":"2024-04-18T21:05:04.629470+0000","last_active":"2024-04-18T21:06:31.684987+0000","last_peered":"2024-04-18T21:06:31.684987+0000","last_clean":"2024-04-18T21:06:31.684987+0000","last_became_active":"2024-04-18T21:05:04.628286+0000","last_became_peered":"2024-04-18T21:05:04.628286+0000","last_unstale":"2024-04-18T21:06:31.684987+0000","last_undegraded":"2024-04-18T21:06:31.684987+0000","last_fullsized":"2024-04-18T21:06:31.684987+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:00:08.877854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":66,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.609254+0000","last_change":"2024-04-18T21:05:05.642793+0000","last_active":"2024-04-18T21:06:31.609254+0000","last_peered":"2024-04-18T21:06:31.609254+0000","last_clean":"2024-04-18T21:06:31.609254+0000","last_became_active":"2024-04-18T21:05:05.641983+0000","last_became_peered":"2024-04-18T21:05:05.641983+0000","last_unstale":"2024-04-18T21:06:31.609254+0000","last_undegraded":"2024-04-18T21:06:31.609254+0000","last_fullsized":"2024-04-18T21:06:31.609254+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:46:36.339289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":68,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.611435+0000","last_change":"2024-04-18T21:05:04.641445+0000","last_active":"2024-04-18T21:06:31.611435+0000","last_peered":"2024-04-18T21:06:31.611435+0000","last_clean":"2024-04-18T21:06:31.611435+0000","last_became_active":"2024-04-18T21:05:04.640682+0000","last_became_peered":"2024-04-18T21:05:04.640682+0000","last_unstale":"2024-04-18T21:06:31.611435+0000","last_undegraded":"2024-04-18T21:06:31.611435+0000","last_fullsized":"2024-04-18T21:06:31.611435+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:46:36.285416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":66,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.609295+0000","last_change":"2024-04-18T21:05:05.641561+0000","last_active":"2024-04-18T21:06:31.609295+0000","last_peered":"2024-04-18T21:06:31.609295+0000","last_clean":"2024-04-18T21:06:31.609295+0000","last_became_active":"2024-04-18T21:05:05.640922+0000","last_became_peered":"2024-04-18T21:05:05.640922+0000","last_unstale":"2024-04-18T21:06:31.609295+0000","last_undegraded":"2024-04-18T21:06:31.609295+0000","last_fullsized":"2024-04-18T21:06:31.609295+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:56.408234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.686100+0000","last_change":"2024-04-18T21:05:05.651530+0000","last_active":"2024-04-18T21:06:31.686100+0000","last_peered":"2024-04-18T21:06:31.686100+0000","last_clean":"2024-04-18T21:06:31.686100+0000","last_became_active":"2024-04-18T21:05:05.648167+0000","last_became_peered":"2024-04-18T21:05:05.648167+0000","last_unstale":"2024-04-18T21:06:31.686100+0000","last_undegraded":"2024-04-18T21:06:31.686100+0000","last_fullsized":"2024-04-18T21:06:31.686100+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:14:51.873741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":37,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684257+0000","last_change":"2024-04-18T21:06:01.033325+0000","last_active":"2024-04-18T21:06:31.684257+0000","last_peered":"2024-04-18T21:06:31.684257+0000","last_clean":"2024-04-18T21:06:31.684257+0000","last_became_active":"2024-04-18T21:06:01.032763+0000","last_became_peered":"2024-04-18T21:06:01.032763+0000","last_unstale":"2024-04-18T21:06:31.684257+0000","last_undegraded":"2024-04-18T21:06:31.684257+0000","last_fullsized":"2024-04-18T21:06:31.684257+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:46:21.038602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":37,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684441+0000","last_change":"2024-04-18T21:06:01.034762+0000","last_active":"2024-04-18T21:06:31.684441+0000","last_peered":"2024-04-18T21:06:31.684441+0000","last_clean":"2024-04-18T21:06:31.684441+0000","last_became_active":"2024-04-18T21:06:01.033874+0000","last_became_peered":"2024-04-18T21:06:01.033874+0000","last_unstale":"2024-04-18T21:06:31.684441+0000","last_undegraded":"2024-04-18T21:06:31.684441+0000","last_fullsized":"2024-04-18T21:06:31.684441+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:36:21.285460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":68,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.609593+0000","last_change":"2024-04-18T21:05:04.637597+0000","last_active":"2024-04-18T21:06:31.609593+0000","last_peered":"2024-04-18T21:06:31.609593+0000","last_clean":"2024-04-18T21:06:31.609593+0000","last_became_active":"2024-04-18T21:05:04.636827+0000","last_became_peered":"2024-04-18T21:05:04.636827+0000","last_unstale":"2024-04-18T21:06:31.609593+0000","last_undegraded":"2024-04-18T21:06:31.609593+0000","last_fullsized":"2024-04-18T21:06:31.609593+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:43.511952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685121+0000","last_change":"2024-04-18T21:05:05.658971+0000","last_active":"2024-04-18T21:06:31.685121+0000","last_peered":"2024-04-18T21:06:31.685121+0000","last_clean":"2024-04-18T21:06:31.685121+0000","last_became_active":"2024-04-18T21:05:05.658363+0000","last_became_peered":"2024-04-18T21:05:05.658363+0000","last_unstale":"2024-04-18T21:06:31.685121+0000","last_undegraded":"2024-04-18T21:06:31.685121+0000","last_fullsized":"2024-04-18T21:06:31.685121+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:12.944469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":71,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684757+0000","last_change":"2024-04-18T21:05:04.636585+0000","last_active":"2024-04-18T21:06:31.684757+0000","last_peered":"2024-04-18T21:06:31.684757+0000","last_clean":"2024-04-18T21:06:31.684757+0000","last_became_active":"2024-04-18T21:05:04.635670+0000","last_became_peered":"2024-04-18T21:05:04.635670+0000","last_unstale":"2024-04-18T21:06:31.684757+0000","last_undegraded":"2024-04-18T21:06:31.684757+0000","last_fullsized":"2024-04-18T21:06:31.684757+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:34:33.779063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684825+0000","last_change":"2024-04-18T21:05:05.649960+0000","last_active":"2024-04-18T21:06:31.684825+0000","last_peered":"2024-04-18T21:06:31.684825+0000","last_clean":"2024-04-18T21:06:31.684825+0000","last_became_active":"2024-04-18T21:05:05.648528+0000","last_became_peered":"2024-04-18T21:05:05.648528+0000","last_unstale":"2024-04-18T21:06:31.684825+0000","last_undegraded":"2024-04-18T21:06:31.684825+0000","last_fullsized":"2024-04-18T21:06:31.684825+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:20:45.938503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":71,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685668+0000","last_change":"2024-04-18T21:05:04.630151+0000","last_active":"2024-04-18T21:06:31.685668+0000","last_peered":"2024-04-18T21:06:31.685668+0000","last_clean":"2024-04-18T21:06:31.685668+0000","last_became_active":"2024-04-18T21:05:04.627968+0000","last_became_peered":"2024-04-18T21:05:04.627968+0000","last_unstale":"2024-04-18T21:06:31.685668+0000","last_undegraded":"2024-04-18T21:06:31.685668+0000","last_fullsized":"2024-04-18T21:06:31.685668+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:00:33.393636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684404+0000","last_change":"2024-04-18T21:05:05.624840+0000","last_active":"2024-04-18T21:06:31.684404+0000","last_peered":"2024-04-18T21:06:31.684404+0000","last_clean":"2024-04-18T21:06:31.684404+0000","last_became_active":"2024-04-18T21:05:05.622950+0000","last_became_peered":"2024-04-18T21:05:05.622950+0000","last_unstale":"2024-04-18T21:06:31.684404+0000","last_undegraded":"2024-04-18T21:06:31.684404+0000","last_fullsized":"2024-04-18T21:06:31.684404+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:27:17.530889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":72,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684479+0000","last_change":"2024-04-18T21:05:04.626715+0000","last_active":"2024-04-18T21:06:31.684479+0000","last_peered":"2024-04-18T21:06:31.684479+0000","last_clean":"2024-04-18T21:06:31.684479+0000","last_became_active":"2024-04-18T21:05:04.625270+0000","last_became_peered":"2024-04-18T21:05:04.625270+0000","last_unstale":"2024-04-18T21:06:31.684479+0000","last_undegraded":"2024-04-18T21:06:31.684479+0000","last_fullsized":"2024-04-18T21:06:31.684479+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:43.511952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684241+0000","last_change":"2024-04-18T21:05:05.627962+0000","last_active":"2024-04-18T21:06:31.684241+0000","last_peered":"2024-04-18T21:06:31.684241+0000","last_clean":"2024-04-18T21:06:31.684241+0000","last_became_active":"2024-04-18T21:05:05.626698+0000","last_became_peered":"2024-04-18T21:05:05.626698+0000","last_unstale":"2024-04-18T21:06:31.684241+0000","last_undegraded":"2024-04-18T21:06:31.684241+0000","last_fullsized":"2024-04-18T21:06:31.684241+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:48:48.973087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":72,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685682+0000","last_change":"2024-04-18T21:05:04.632776+0000","last_active":"2024-04-18T21:06:31.685682+0000","last_peered":"2024-04-18T21:06:31.685682+0000","last_clean":"2024-04-18T21:06:31.685682+0000","last_became_active":"2024-04-18T21:05:04.630142+0000","last_became_peered":"2024-04-18T21:05:04.630142+0000","last_unstale":"2024-04-18T21:06:31.685682+0000","last_undegraded":"2024-04-18T21:06:31.685682+0000","last_fullsized":"2024-04-18T21:06:31.685682+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:19:36.721897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684760+0000","last_change":"2024-04-18T21:05:05.653025+0000","last_active":"2024-04-18T21:06:31.684760+0000","last_peered":"2024-04-18T21:06:31.684760+0000","last_clean":"2024-04-18T21:06:31.684760+0000","last_became_active":"2024-04-18T21:05:05.645039+0000","last_became_peered":"2024-04-18T21:05:05.645039+0000","last_unstale":"2024-04-18T21:06:31.684760+0000","last_undegraded":"2024-04-18T21:06:31.684760+0000","last_fullsized":"2024-04-18T21:06:31.684760+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":69,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.611266+0000","last_change":"2024-04-18T21:05:04.640134+0000","last_active":"2024-04-18T21:06:31.611266+0000","last_peered":"2024-04-18T21:06:31.611266+0000","last_clean":"2024-04-18T21:06:31.611266+0000","last_became_active":"2024-04-18T21:05:04.638597+0000","last_became_peered":"2024-04-18T21:05:04.638597+0000","last_unstale":"2024-04-18T21:06:31.611266+0000","last_undegraded":"2024-04-18T21:06:31.611266+0000","last_fullsized":"2024-04-18T21:06:31.611266+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:56:05.795125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683778+0000","last_change":"2024-04-18T21:05:05.629022+0000","last_active":"2024-04-18T21:06:31.683778+0000","last_peered":"2024-04-18T21:06:31.683778+0000","last_clean":"2024-04-18T21:06:31.683778+0000","last_became_active":"2024-04-18T21:05:05.627643+0000","last_became_peered":"2024-04-18T21:05:05.627643+0000","last_unstale":"2024-04-18T21:06:31.683778+0000","last_undegraded":"2024-04-18T21:06:31.683778+0000","last_fullsized":"2024-04-18T21:06:31.683778+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:32:23.929877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":72,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.611308+0000","last_change":"2024-04-18T21:05:04.641338+0000","last_active":"2024-04-18T21:06:31.611308+0000","last_peered":"2024-04-18T21:06:31.611308+0000","last_clean":"2024-04-18T21:06:31.611308+0000","last_became_active":"2024-04-18T21:05:04.639958+0000","last_became_peered":"2024-04-18T21:05:04.639958+0000","last_unstale":"2024-04-18T21:06:31.611308+0000","last_undegraded":"2024-04-18T21:06:31.611308+0000","last_fullsized":"2024-04-18T21:06:31.611308+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:42:45.392908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7351,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738392,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35716,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336124,"statfs":{"total":96636764160,"available":96600190976,"internally_reserved":0,"allocated":385024,"data_stored":169652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738392,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32168,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339672,"statfs":{"total":96636764160,"available":96603824128,"internally_reserved":0,"allocated":1007616,"data_stored":770371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738390,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1015808,"data_stored":770987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:06:33.789 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-18T21:06:33.789 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-18T21:06:33.789 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-04-18T21:06:33.790 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-18T21:06:33.801 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:33.803+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:33.828 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:33.828 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:33.844 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:33.902 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:33.898+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:33.967 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:33.967 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:33.981 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:34.002 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:34.003+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:34.103 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:34.103+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:34.129 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:06:34.129 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-04-18T21:06:34.129 INFO:teuthology.orchestra.run.smithi078.stdout: "epoch": 47, 2024-04-18T21:06:34.129 INFO:teuthology.orchestra.run.smithi078.stdout: "fsid": "dc017990-0393-4ab0-b604-5e7052fdc7bd", 2024-04-18T21:06:34.129 INFO:teuthology.orchestra.run.smithi078.stdout: "created": "2024-04-18T21:04:43.507538+0000", 2024-04-18T21:06:34.129 INFO:teuthology.orchestra.run.smithi078.stdout: "modified": "2024-04-18T21:06:32.679222+0000", 2024-04-18T21:06:34.130 INFO:teuthology.orchestra.run.smithi078.stdout: "last_up_change": "2024-04-18T21:04:52.492503+0000", 2024-04-18T21:06:34.130 INFO:teuthology.orchestra.run.smithi078.stdout: "last_in_change": "2024-04-18T21:04:44.402191+0000", 2024-04-18T21:06:34.130 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-18T21:06:34.130 INFO:teuthology.orchestra.run.smithi078.stdout: "flags_num": 5799936, 2024-04-18T21:06:34.130 INFO:teuthology.orchestra.run.smithi078.stdout: "flags_set": [ 2024-04-18T21:06:34.130 INFO:teuthology.orchestra.run.smithi078.stdout: "pglog_hardlimit", 2024-04-18T21:06:34.130 INFO:teuthology.orchestra.run.smithi078.stdout: "purged_snapdirs", 2024-04-18T21:06:34.130 INFO:teuthology.orchestra.run.smithi078.stdout: "recovery_deletes", 2024-04-18T21:06:34.130 INFO:teuthology.orchestra.run.smithi078.stdout: "sortbitwise" 2024-04-18T21:06:34.130 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-04-18T21:06:34.130 INFO:teuthology.orchestra.run.smithi078.stdout: "crush_version": 4, 2024-04-18T21:06:34.130 INFO:teuthology.orchestra.run.smithi078.stdout: "full_ratio": 0.94999998807907104, 2024-04-18T21:06:34.130 INFO:teuthology.orchestra.run.smithi078.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-18T21:06:34.131 INFO:teuthology.orchestra.run.smithi078.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-18T21:06:34.131 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_snapshot": "", 2024-04-18T21:06:34.131 INFO:teuthology.orchestra.run.smithi078.stdout: "pool_max": 4, 2024-04-18T21:06:34.131 INFO:teuthology.orchestra.run.smithi078.stdout: "max_osd": 3, 2024-04-18T21:06:34.131 INFO:teuthology.orchestra.run.smithi078.stdout: "require_min_compat_client": "luminous", 2024-04-18T21:06:34.131 INFO:teuthology.orchestra.run.smithi078.stdout: "min_compat_client": "jewel", 2024-04-18T21:06:34.131 INFO:teuthology.orchestra.run.smithi078.stdout: "require_osd_release": "squid", 2024-04-18T21:06:34.131 INFO:teuthology.orchestra.run.smithi078.stdout: "allow_crimson": false, 2024-04-18T21:06:34.131 INFO:teuthology.orchestra.run.smithi078.stdout: "pools": [ 2024-04-18T21:06:34.131 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:34.131 INFO:teuthology.orchestra.run.smithi078.stdout: "pool": 1, 2024-04-18T21:06:34.131 INFO:teuthology.orchestra.run.smithi078.stdout: "pool_name": ".mgr", 2024-04-18T21:06:34.131 INFO:teuthology.orchestra.run.smithi078.stdout: "create_time": "2024-04-18T21:04:52.538153+0000", 2024-04-18T21:06:34.132 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-04-18T21:06:34.132 INFO:teuthology.orchestra.run.smithi078.stdout: "flags_names": "hashpspool", 2024-04-18T21:06:34.132 INFO:teuthology.orchestra.run.smithi078.stdout: "type": 1, 2024-04-18T21:06:34.132 INFO:teuthology.orchestra.run.smithi078.stdout: "size": 2, 2024-04-18T21:06:34.132 INFO:teuthology.orchestra.run.smithi078.stdout: "min_size": 1, 2024-04-18T21:06:34.132 INFO:teuthology.orchestra.run.smithi078.stdout: "crush_rule": 0, 2024-04-18T21:06:34.132 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:06:34.132 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:06:34.132 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:06:34.132 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:06:34.132 INFO:teuthology.orchestra.run.smithi078.stdout: "object_hash": 2, 2024-04-18T21:06:34.132 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:06:34.132 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num": 1, 2024-04-18T21:06:34.132 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_placement_num": 1, 2024-04-18T21:06:34.133 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_placement_num_target": 1, 2024-04-18T21:06:34.133 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_target": 1, 2024-04-18T21:06:34.133 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_pending": 1, 2024-04-18T21:06:34.133 INFO:teuthology.orchestra.run.smithi078.stdout: "last_pg_merge_meta": { 2024-04-18T21:06:34.133 INFO:teuthology.orchestra.run.smithi078.stdout: "source_pgid": "0.0", 2024-04-18T21:06:34.133 INFO:teuthology.orchestra.run.smithi078.stdout: "ready_epoch": 0, 2024-04-18T21:06:34.133 INFO:teuthology.orchestra.run.smithi078.stdout: "last_epoch_started": 0, 2024-04-18T21:06:34.133 INFO:teuthology.orchestra.run.smithi078.stdout: "last_epoch_clean": 0, 2024-04-18T21:06:34.133 INFO:teuthology.orchestra.run.smithi078.stdout: "source_version": "0'0", 2024-04-18T21:06:34.133 INFO:teuthology.orchestra.run.smithi078.stdout: "target_version": "0'0" 2024-04-18T21:06:34.133 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:34.133 INFO:teuthology.orchestra.run.smithi078.stdout: "last_change": "11", 2024-04-18T21:06:34.133 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend": "0", 2024-04-18T21:06:34.134 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:06:34.134 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:06:34.134 INFO:teuthology.orchestra.run.smithi078.stdout: "auid": 0, 2024-04-18T21:06:34.134 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:06:34.134 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_seq": 0, 2024-04-18T21:06:34.134 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_epoch": 0, 2024-04-18T21:06:34.134 INFO:teuthology.orchestra.run.smithi078.stdout: "pool_snaps": [], 2024-04-18T21:06:34.134 INFO:teuthology.orchestra.run.smithi078.stdout: "removed_snaps": "[]", 2024-04-18T21:06:34.134 INFO:teuthology.orchestra.run.smithi078.stdout: "quota_max_bytes": 0, 2024-04-18T21:06:34.134 INFO:teuthology.orchestra.run.smithi078.stdout: "quota_max_objects": 0, 2024-04-18T21:06:34.134 INFO:teuthology.orchestra.run.smithi078.stdout: "tiers": [], 2024-04-18T21:06:34.134 INFO:teuthology.orchestra.run.smithi078.stdout: "tier_of": -1, 2024-04-18T21:06:34.134 INFO:teuthology.orchestra.run.smithi078.stdout: "read_tier": -1, 2024-04-18T21:06:34.134 INFO:teuthology.orchestra.run.smithi078.stdout: "write_tier": -1, 2024-04-18T21:06:34.134 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_mode": "none", 2024-04-18T21:06:34.135 INFO:teuthology.orchestra.run.smithi078.stdout: "target_max_bytes": 0, 2024-04-18T21:06:34.135 INFO:teuthology.orchestra.run.smithi078.stdout: "target_max_objects": 0, 2024-04-18T21:06:34.135 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:06:34.135 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:06:34.135 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:06:34.135 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_min_flush_age": 0, 2024-04-18T21:06:34.135 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_min_evict_age": 0, 2024-04-18T21:06:34.135 INFO:teuthology.orchestra.run.smithi078.stdout: "erasure_code_profile": "", 2024-04-18T21:06:34.135 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_params": { 2024-04-18T21:06:34.136 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "none" 2024-04-18T21:06:34.136 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:34.136 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_period": 0, 2024-04-18T21:06:34.136 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_count": 0, 2024-04-18T21:06:34.136 INFO:teuthology.orchestra.run.smithi078.stdout: "use_gmt_hitset": true, 2024-04-18T21:06:34.136 INFO:teuthology.orchestra.run.smithi078.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:06:34.136 INFO:teuthology.orchestra.run.smithi078.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:06:34.136 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:06:34.136 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:06:34.136 INFO:teuthology.orchestra.run.smithi078.stdout: "grade_table": [], 2024-04-18T21:06:34.136 INFO:teuthology.orchestra.run.smithi078.stdout: "stripe_width": 0, 2024-04-18T21:06:34.136 INFO:teuthology.orchestra.run.smithi078.stdout: "expected_num_objects": 0, 2024-04-18T21:06:34.136 INFO:teuthology.orchestra.run.smithi078.stdout: "fast_read": false, 2024-04-18T21:06:34.136 INFO:teuthology.orchestra.run.smithi078.stdout: "options": { 2024-04-18T21:06:34.137 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_max": 32, 2024-04-18T21:06:34.137 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_min": 1 2024-04-18T21:06:34.137 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:34.137 INFO:teuthology.orchestra.run.smithi078.stdout: "application_metadata": { 2024-04-18T21:06:34.137 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": {} 2024-04-18T21:06:34.137 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:34.137 INFO:teuthology.orchestra.run.smithi078.stdout: "read_balance": { 2024-04-18T21:06:34.137 INFO:teuthology.orchestra.run.smithi078.stdout: "score_type": "Fair distribution", 2024-04-18T21:06:34.137 INFO:teuthology.orchestra.run.smithi078.stdout: "score_acting": 2.9900000095367432, 2024-04-18T21:06:34.137 INFO:teuthology.orchestra.run.smithi078.stdout: "score_stable": 2.9900000095367432, 2024-04-18T21:06:34.137 INFO:teuthology.orchestra.run.smithi078.stdout: "optimal_score": 0.67000001668930054, 2024-04-18T21:06:34.137 INFO:teuthology.orchestra.run.smithi078.stdout: "raw_score_acting": 2, 2024-04-18T21:06:34.137 INFO:teuthology.orchestra.run.smithi078.stdout: "raw_score_stable": 2, 2024-04-18T21:06:34.137 INFO:teuthology.orchestra.run.smithi078.stdout: "primary_affinity_weighted": 0.86374413967132568, 2024-04-18T21:06:34.138 INFO:teuthology.orchestra.run.smithi078.stdout: "average_primary_affinity": 0.86000001430511475, 2024-04-18T21:06:34.138 INFO:teuthology.orchestra.run.smithi078.stdout: "average_primary_affinity_weighted": 0.86000001430511475 2024-04-18T21:06:34.138 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:06:34.138 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:34.138 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:34.138 INFO:teuthology.orchestra.run.smithi078.stdout: "pool": 2, 2024-04-18T21:06:34.138 INFO:teuthology.orchestra.run.smithi078.stdout: "pool_name": "rbd", 2024-04-18T21:06:34.138 INFO:teuthology.orchestra.run.smithi078.stdout: "create_time": "2024-04-18T21:04:58.673793+0000", 2024-04-18T21:06:34.138 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-04-18T21:06:34.138 INFO:teuthology.orchestra.run.smithi078.stdout: "flags_names": "hashpspool", 2024-04-18T21:06:34.138 INFO:teuthology.orchestra.run.smithi078.stdout: "type": 1, 2024-04-18T21:06:34.138 INFO:teuthology.orchestra.run.smithi078.stdout: "size": 2, 2024-04-18T21:06:34.138 INFO:teuthology.orchestra.run.smithi078.stdout: "min_size": 1, 2024-04-18T21:06:34.138 INFO:teuthology.orchestra.run.smithi078.stdout: "crush_rule": 0, 2024-04-18T21:06:34.138 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:06:34.139 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:06:34.139 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:06:34.139 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:06:34.139 INFO:teuthology.orchestra.run.smithi078.stdout: "object_hash": 2, 2024-04-18T21:06:34.139 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:06:34.139 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num": 8, 2024-04-18T21:06:34.139 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_placement_num": 8, 2024-04-18T21:06:34.139 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_placement_num_target": 8, 2024-04-18T21:06:34.139 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_target": 8, 2024-04-18T21:06:34.139 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_pending": 8, 2024-04-18T21:06:34.139 INFO:teuthology.orchestra.run.smithi078.stdout: "last_pg_merge_meta": { 2024-04-18T21:06:34.139 INFO:teuthology.orchestra.run.smithi078.stdout: "source_pgid": "0.0", 2024-04-18T21:06:34.139 INFO:teuthology.orchestra.run.smithi078.stdout: "ready_epoch": 0, 2024-04-18T21:06:34.139 INFO:teuthology.orchestra.run.smithi078.stdout: "last_epoch_started": 0, 2024-04-18T21:06:34.139 INFO:teuthology.orchestra.run.smithi078.stdout: "last_epoch_clean": 0, 2024-04-18T21:06:34.139 INFO:teuthology.orchestra.run.smithi078.stdout: "source_version": "0'0", 2024-04-18T21:06:34.140 INFO:teuthology.orchestra.run.smithi078.stdout: "target_version": "0'0" 2024-04-18T21:06:34.140 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:34.140 INFO:teuthology.orchestra.run.smithi078.stdout: "last_change": "14", 2024-04-18T21:06:34.140 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend": "0", 2024-04-18T21:06:34.140 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:06:34.140 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:06:34.140 INFO:teuthology.orchestra.run.smithi078.stdout: "auid": 0, 2024-04-18T21:06:34.140 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:06:34.140 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_seq": 0, 2024-04-18T21:06:34.140 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_epoch": 0, 2024-04-18T21:06:34.140 INFO:teuthology.orchestra.run.smithi078.stdout: "pool_snaps": [], 2024-04-18T21:06:34.140 INFO:teuthology.orchestra.run.smithi078.stdout: "removed_snaps": "[]", 2024-04-18T21:06:34.140 INFO:teuthology.orchestra.run.smithi078.stdout: "quota_max_bytes": 0, 2024-04-18T21:06:34.140 INFO:teuthology.orchestra.run.smithi078.stdout: "quota_max_objects": 0, 2024-04-18T21:06:34.140 INFO:teuthology.orchestra.run.smithi078.stdout: "tiers": [], 2024-04-18T21:06:34.141 INFO:teuthology.orchestra.run.smithi078.stdout: "tier_of": -1, 2024-04-18T21:06:34.141 INFO:teuthology.orchestra.run.smithi078.stdout: "read_tier": -1, 2024-04-18T21:06:34.141 INFO:teuthology.orchestra.run.smithi078.stdout: "write_tier": -1, 2024-04-18T21:06:34.141 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_mode": "none", 2024-04-18T21:06:34.141 INFO:teuthology.orchestra.run.smithi078.stdout: "target_max_bytes": 0, 2024-04-18T21:06:34.141 INFO:teuthology.orchestra.run.smithi078.stdout: "target_max_objects": 0, 2024-04-18T21:06:34.141 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:06:34.141 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:06:34.141 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:06:34.141 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_min_flush_age": 0, 2024-04-18T21:06:34.141 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_min_evict_age": 0, 2024-04-18T21:06:34.141 INFO:teuthology.orchestra.run.smithi078.stdout: "erasure_code_profile": "", 2024-04-18T21:06:34.141 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_params": { 2024-04-18T21:06:34.141 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "none" 2024-04-18T21:06:34.141 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:34.142 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_period": 0, 2024-04-18T21:06:34.142 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_count": 0, 2024-04-18T21:06:34.142 INFO:teuthology.orchestra.run.smithi078.stdout: "use_gmt_hitset": true, 2024-04-18T21:06:34.142 INFO:teuthology.orchestra.run.smithi078.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:06:34.142 INFO:teuthology.orchestra.run.smithi078.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:06:34.142 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:06:34.142 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:06:34.142 INFO:teuthology.orchestra.run.smithi078.stdout: "grade_table": [], 2024-04-18T21:06:34.142 INFO:teuthology.orchestra.run.smithi078.stdout: "stripe_width": 0, 2024-04-18T21:06:34.142 INFO:teuthology.orchestra.run.smithi078.stdout: "expected_num_objects": 0, 2024-04-18T21:06:34.142 INFO:teuthology.orchestra.run.smithi078.stdout: "fast_read": false, 2024-04-18T21:06:34.142 INFO:teuthology.orchestra.run.smithi078.stdout: "options": {}, 2024-04-18T21:06:34.142 INFO:teuthology.orchestra.run.smithi078.stdout: "application_metadata": { 2024-04-18T21:06:34.142 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd": {} 2024-04-18T21:06:34.142 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:34.143 INFO:teuthology.orchestra.run.smithi078.stdout: "read_balance": { 2024-04-18T21:06:34.143 INFO:teuthology.orchestra.run.smithi078.stdout: "score_type": "Fair distribution", 2024-04-18T21:06:34.143 INFO:teuthology.orchestra.run.smithi078.stdout: "score_acting": 1.5, 2024-04-18T21:06:34.143 INFO:teuthology.orchestra.run.smithi078.stdout: "score_stable": 1.5, 2024-04-18T21:06:34.143 INFO:teuthology.orchestra.run.smithi078.stdout: "optimal_score": 1, 2024-04-18T21:06:34.143 INFO:teuthology.orchestra.run.smithi078.stdout: "raw_score_acting": 1.5, 2024-04-18T21:06:34.143 INFO:teuthology.orchestra.run.smithi078.stdout: "raw_score_stable": 1.5, 2024-04-18T21:06:34.143 INFO:teuthology.orchestra.run.smithi078.stdout: "primary_affinity_weighted": 0.86374413967132568, 2024-04-18T21:06:34.143 INFO:teuthology.orchestra.run.smithi078.stdout: "average_primary_affinity": 0.86000001430511475, 2024-04-18T21:06:34.143 INFO:teuthology.orchestra.run.smithi078.stdout: "average_primary_affinity_weighted": 0.86000001430511475 2024-04-18T21:06:34.143 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:06:34.143 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:34.143 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:34.143 INFO:teuthology.orchestra.run.smithi078.stdout: "pool": 3, 2024-04-18T21:06:34.143 INFO:teuthology.orchestra.run.smithi078.stdout: "pool_name": "cephfs_metadata", 2024-04-18T21:06:34.144 INFO:teuthology.orchestra.run.smithi078.stdout: "create_time": "2024-04-18T21:05:03.314171+0000", 2024-04-18T21:06:34.144 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-04-18T21:06:34.144 INFO:teuthology.orchestra.run.smithi078.stdout: "flags_names": "hashpspool", 2024-04-18T21:06:34.144 INFO:teuthology.orchestra.run.smithi078.stdout: "type": 1, 2024-04-18T21:06:34.144 INFO:teuthology.orchestra.run.smithi078.stdout: "size": 2, 2024-04-18T21:06:34.144 INFO:teuthology.orchestra.run.smithi078.stdout: "min_size": 1, 2024-04-18T21:06:34.144 INFO:teuthology.orchestra.run.smithi078.stdout: "crush_rule": 0, 2024-04-18T21:06:34.144 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:06:34.144 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:06:34.144 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:06:34.144 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:06:34.144 INFO:teuthology.orchestra.run.smithi078.stdout: "object_hash": 2, 2024-04-18T21:06:34.144 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:06:34.144 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num": 32, 2024-04-18T21:06:34.145 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_placement_num": 32, 2024-04-18T21:06:34.145 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_placement_num_target": 32, 2024-04-18T21:06:34.145 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_target": 32, 2024-04-18T21:06:34.145 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_pending": 32, 2024-04-18T21:06:34.145 INFO:teuthology.orchestra.run.smithi078.stdout: "last_pg_merge_meta": { 2024-04-18T21:06:34.145 INFO:teuthology.orchestra.run.smithi078.stdout: "source_pgid": "0.0", 2024-04-18T21:06:34.145 INFO:teuthology.orchestra.run.smithi078.stdout: "ready_epoch": 0, 2024-04-18T21:06:34.145 INFO:teuthology.orchestra.run.smithi078.stdout: "last_epoch_started": 0, 2024-04-18T21:06:34.145 INFO:teuthology.orchestra.run.smithi078.stdout: "last_epoch_clean": 0, 2024-04-18T21:06:34.145 INFO:teuthology.orchestra.run.smithi078.stdout: "source_version": "0'0", 2024-04-18T21:06:34.145 INFO:teuthology.orchestra.run.smithi078.stdout: "target_version": "0'0" 2024-04-18T21:06:34.145 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:34.145 INFO:teuthology.orchestra.run.smithi078.stdout: "last_change": "17", 2024-04-18T21:06:34.145 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend": "0", 2024-04-18T21:06:34.146 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:06:34.146 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:06:34.146 INFO:teuthology.orchestra.run.smithi078.stdout: "auid": 0, 2024-04-18T21:06:34.146 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:06:34.146 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_seq": 0, 2024-04-18T21:06:34.146 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_epoch": 0, 2024-04-18T21:06:34.146 INFO:teuthology.orchestra.run.smithi078.stdout: "pool_snaps": [], 2024-04-18T21:06:34.146 INFO:teuthology.orchestra.run.smithi078.stdout: "removed_snaps": "[]", 2024-04-18T21:06:34.146 INFO:teuthology.orchestra.run.smithi078.stdout: "quota_max_bytes": 0, 2024-04-18T21:06:34.146 INFO:teuthology.orchestra.run.smithi078.stdout: "quota_max_objects": 0, 2024-04-18T21:06:34.146 INFO:teuthology.orchestra.run.smithi078.stdout: "tiers": [], 2024-04-18T21:06:34.146 INFO:teuthology.orchestra.run.smithi078.stdout: "tier_of": -1, 2024-04-18T21:06:34.146 INFO:teuthology.orchestra.run.smithi078.stdout: "read_tier": -1, 2024-04-18T21:06:34.146 INFO:teuthology.orchestra.run.smithi078.stdout: "write_tier": -1, 2024-04-18T21:06:34.146 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_mode": "none", 2024-04-18T21:06:34.147 INFO:teuthology.orchestra.run.smithi078.stdout: "target_max_bytes": 0, 2024-04-18T21:06:34.147 INFO:teuthology.orchestra.run.smithi078.stdout: "target_max_objects": 0, 2024-04-18T21:06:34.147 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:06:34.147 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:06:34.147 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:06:34.147 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_min_flush_age": 0, 2024-04-18T21:06:34.147 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_min_evict_age": 0, 2024-04-18T21:06:34.147 INFO:teuthology.orchestra.run.smithi078.stdout: "erasure_code_profile": "", 2024-04-18T21:06:34.147 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_params": { 2024-04-18T21:06:34.147 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "none" 2024-04-18T21:06:34.147 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:34.147 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_period": 0, 2024-04-18T21:06:34.147 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_count": 0, 2024-04-18T21:06:34.147 INFO:teuthology.orchestra.run.smithi078.stdout: "use_gmt_hitset": true, 2024-04-18T21:06:34.147 INFO:teuthology.orchestra.run.smithi078.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:06:34.147 INFO:teuthology.orchestra.run.smithi078.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:06:34.148 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:06:34.148 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:06:34.148 INFO:teuthology.orchestra.run.smithi078.stdout: "grade_table": [], 2024-04-18T21:06:34.148 INFO:teuthology.orchestra.run.smithi078.stdout: "stripe_width": 0, 2024-04-18T21:06:34.148 INFO:teuthology.orchestra.run.smithi078.stdout: "expected_num_objects": 0, 2024-04-18T21:06:34.148 INFO:teuthology.orchestra.run.smithi078.stdout: "fast_read": false, 2024-04-18T21:06:34.148 INFO:teuthology.orchestra.run.smithi078.stdout: "options": { 2024-04-18T21:06:34.148 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_autoscale_bias": 4, 2024-04-18T21:06:34.148 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_min": 16, 2024-04-18T21:06:34.148 INFO:teuthology.orchestra.run.smithi078.stdout: "recovery_priority": 5 2024-04-18T21:06:34.148 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:34.148 INFO:teuthology.orchestra.run.smithi078.stdout: "application_metadata": { 2024-04-18T21:06:34.148 INFO:teuthology.orchestra.run.smithi078.stdout: "cephfs": { 2024-04-18T21:06:34.148 INFO:teuthology.orchestra.run.smithi078.stdout: "metadata": "cephfs" 2024-04-18T21:06:34.148 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:06:34.148 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:34.149 INFO:teuthology.orchestra.run.smithi078.stdout: "read_balance": { 2024-04-18T21:06:34.149 INFO:teuthology.orchestra.run.smithi078.stdout: "score_type": "Fair distribution", 2024-04-18T21:06:34.149 INFO:teuthology.orchestra.run.smithi078.stdout: "score_acting": 1.1299999952316284, 2024-04-18T21:06:34.149 INFO:teuthology.orchestra.run.smithi078.stdout: "score_stable": 1.1299999952316284, 2024-04-18T21:06:34.149 INFO:teuthology.orchestra.run.smithi078.stdout: "optimal_score": 1, 2024-04-18T21:06:34.149 INFO:teuthology.orchestra.run.smithi078.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-18T21:06:34.149 INFO:teuthology.orchestra.run.smithi078.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-18T21:06:34.149 INFO:teuthology.orchestra.run.smithi078.stdout: "primary_affinity_weighted": 0.86374413967132568, 2024-04-18T21:06:34.149 INFO:teuthology.orchestra.run.smithi078.stdout: "average_primary_affinity": 0.86000001430511475, 2024-04-18T21:06:34.149 INFO:teuthology.orchestra.run.smithi078.stdout: "average_primary_affinity_weighted": 0.86000001430511475 2024-04-18T21:06:34.149 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:06:34.149 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:34.149 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:34.149 INFO:teuthology.orchestra.run.smithi078.stdout: "pool": 4, 2024-04-18T21:06:34.150 INFO:teuthology.orchestra.run.smithi078.stdout: "pool_name": "cephfs_data", 2024-04-18T21:06:34.150 INFO:teuthology.orchestra.run.smithi078.stdout: "create_time": "2024-04-18T21:05:03.931699+0000", 2024-04-18T21:06:34.150 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-04-18T21:06:34.150 INFO:teuthology.orchestra.run.smithi078.stdout: "flags_names": "hashpspool", 2024-04-18T21:06:34.150 INFO:teuthology.orchestra.run.smithi078.stdout: "type": 1, 2024-04-18T21:06:34.150 INFO:teuthology.orchestra.run.smithi078.stdout: "size": 2, 2024-04-18T21:06:34.150 INFO:teuthology.orchestra.run.smithi078.stdout: "min_size": 1, 2024-04-18T21:06:34.150 INFO:teuthology.orchestra.run.smithi078.stdout: "crush_rule": 0, 2024-04-18T21:06:34.150 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:06:34.150 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:06:34.150 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:06:34.150 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:06:34.150 INFO:teuthology.orchestra.run.smithi078.stdout: "object_hash": 2, 2024-04-18T21:06:34.150 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:06:34.150 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num": 64, 2024-04-18T21:06:34.151 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_placement_num": 64, 2024-04-18T21:06:34.151 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_placement_num_target": 64, 2024-04-18T21:06:34.151 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_target": 64, 2024-04-18T21:06:34.151 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_pending": 64, 2024-04-18T21:06:34.151 INFO:teuthology.orchestra.run.smithi078.stdout: "last_pg_merge_meta": { 2024-04-18T21:06:34.151 INFO:teuthology.orchestra.run.smithi078.stdout: "source_pgid": "0.0", 2024-04-18T21:06:34.151 INFO:teuthology.orchestra.run.smithi078.stdout: "ready_epoch": 0, 2024-04-18T21:06:34.151 INFO:teuthology.orchestra.run.smithi078.stdout: "last_epoch_started": 0, 2024-04-18T21:06:34.151 INFO:teuthology.orchestra.run.smithi078.stdout: "last_epoch_clean": 0, 2024-04-18T21:06:34.151 INFO:teuthology.orchestra.run.smithi078.stdout: "source_version": "0'0", 2024-04-18T21:06:34.151 INFO:teuthology.orchestra.run.smithi078.stdout: "target_version": "0'0" 2024-04-18T21:06:34.151 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:34.151 INFO:teuthology.orchestra.run.smithi078.stdout: "last_change": "18", 2024-04-18T21:06:34.152 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend": "0", 2024-04-18T21:06:34.152 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:06:34.152 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:06:34.152 INFO:teuthology.orchestra.run.smithi078.stdout: "auid": 0, 2024-04-18T21:06:34.152 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:06:34.152 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_seq": 0, 2024-04-18T21:06:34.152 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_epoch": 0, 2024-04-18T21:06:34.152 INFO:teuthology.orchestra.run.smithi078.stdout: "pool_snaps": [], 2024-04-18T21:06:34.152 INFO:teuthology.orchestra.run.smithi078.stdout: "removed_snaps": "[]", 2024-04-18T21:06:34.152 INFO:teuthology.orchestra.run.smithi078.stdout: "quota_max_bytes": 0, 2024-04-18T21:06:34.152 INFO:teuthology.orchestra.run.smithi078.stdout: "quota_max_objects": 0, 2024-04-18T21:06:34.152 INFO:teuthology.orchestra.run.smithi078.stdout: "tiers": [], 2024-04-18T21:06:34.152 INFO:teuthology.orchestra.run.smithi078.stdout: "tier_of": -1, 2024-04-18T21:06:34.152 INFO:teuthology.orchestra.run.smithi078.stdout: "read_tier": -1, 2024-04-18T21:06:34.152 INFO:teuthology.orchestra.run.smithi078.stdout: "write_tier": -1, 2024-04-18T21:06:34.152 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_mode": "none", 2024-04-18T21:06:34.153 INFO:teuthology.orchestra.run.smithi078.stdout: "target_max_bytes": 0, 2024-04-18T21:06:34.153 INFO:teuthology.orchestra.run.smithi078.stdout: "target_max_objects": 0, 2024-04-18T21:06:34.153 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:06:34.153 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:06:34.153 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:06:34.153 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_min_flush_age": 0, 2024-04-18T21:06:34.153 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_min_evict_age": 0, 2024-04-18T21:06:34.153 INFO:teuthology.orchestra.run.smithi078.stdout: "erasure_code_profile": "", 2024-04-18T21:06:34.153 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_params": { 2024-04-18T21:06:34.153 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "none" 2024-04-18T21:06:34.153 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:34.153 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_period": 0, 2024-04-18T21:06:34.153 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_count": 0, 2024-04-18T21:06:34.153 INFO:teuthology.orchestra.run.smithi078.stdout: "use_gmt_hitset": true, 2024-04-18T21:06:34.153 INFO:teuthology.orchestra.run.smithi078.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:06:34.153 INFO:teuthology.orchestra.run.smithi078.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:06:34.154 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:06:34.154 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:06:34.154 INFO:teuthology.orchestra.run.smithi078.stdout: "grade_table": [], 2024-04-18T21:06:34.154 INFO:teuthology.orchestra.run.smithi078.stdout: "stripe_width": 0, 2024-04-18T21:06:34.154 INFO:teuthology.orchestra.run.smithi078.stdout: "expected_num_objects": 0, 2024-04-18T21:06:34.154 INFO:teuthology.orchestra.run.smithi078.stdout: "fast_read": false, 2024-04-18T21:06:34.154 INFO:teuthology.orchestra.run.smithi078.stdout: "options": { 2024-04-18T21:06:34.154 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_min": 64, 2024-04-18T21:06:34.154 INFO:teuthology.orchestra.run.smithi078.stdout: "target_size_ratio": 0.89999997615814209 2024-04-18T21:06:34.154 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:34.154 INFO:teuthology.orchestra.run.smithi078.stdout: "application_metadata": { 2024-04-18T21:06:34.154 INFO:teuthology.orchestra.run.smithi078.stdout: "cephfs": { 2024-04-18T21:06:34.154 INFO:teuthology.orchestra.run.smithi078.stdout: "data": "cephfs" 2024-04-18T21:06:34.154 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:06:34.155 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:34.155 INFO:teuthology.orchestra.run.smithi078.stdout: "read_balance": { 2024-04-18T21:06:34.155 INFO:teuthology.orchestra.run.smithi078.stdout: "score_type": "Fair distribution", 2024-04-18T21:06:34.155 INFO:teuthology.orchestra.run.smithi078.stdout: "score_acting": 1.2699999809265137, 2024-04-18T21:06:34.155 INFO:teuthology.orchestra.run.smithi078.stdout: "score_stable": 1.2699999809265137, 2024-04-18T21:06:34.155 INFO:teuthology.orchestra.run.smithi078.stdout: "optimal_score": 1, 2024-04-18T21:06:34.155 INFO:teuthology.orchestra.run.smithi078.stdout: "raw_score_acting": 1.2699999809265137, 2024-04-18T21:06:34.155 INFO:teuthology.orchestra.run.smithi078.stdout: "raw_score_stable": 1.2699999809265137, 2024-04-18T21:06:34.155 INFO:teuthology.orchestra.run.smithi078.stdout: "primary_affinity_weighted": 0.86374413967132568, 2024-04-18T21:06:34.155 INFO:teuthology.orchestra.run.smithi078.stdout: "average_primary_affinity": 0.86000001430511475, 2024-04-18T21:06:34.155 INFO:teuthology.orchestra.run.smithi078.stdout: "average_primary_affinity_weighted": 0.86000001430511475 2024-04-18T21:06:34.155 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:06:34.155 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:06:34.155 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-04-18T21:06:34.155 INFO:teuthology.orchestra.run.smithi078.stdout: "osds": [ 2024-04-18T21:06:34.155 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:34.156 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": 0, 2024-04-18T21:06:34.156 INFO:teuthology.orchestra.run.smithi078.stdout: "uuid": "1854d737-3a67-416a-8c88-0f126505a0f2", 2024-04-18T21:06:34.156 INFO:teuthology.orchestra.run.smithi078.stdout: "up": 1, 2024-04-18T21:06:34.156 INFO:teuthology.orchestra.run.smithi078.stdout: "in": 1, 2024-04-18T21:06:34.156 INFO:teuthology.orchestra.run.smithi078.stdout: "weight": 1, 2024-04-18T21:06:34.156 INFO:teuthology.orchestra.run.smithi078.stdout: "primary_affinity": 1, 2024-04-18T21:06:34.156 INFO:teuthology.orchestra.run.smithi078.stdout: "last_clean_begin": 0, 2024-04-18T21:06:34.156 INFO:teuthology.orchestra.run.smithi078.stdout: "last_clean_end": 0, 2024-04-18T21:06:34.156 INFO:teuthology.orchestra.run.smithi078.stdout: "up_from": 8, 2024-04-18T21:06:34.156 INFO:teuthology.orchestra.run.smithi078.stdout: "up_thru": 32, 2024-04-18T21:06:34.156 INFO:teuthology.orchestra.run.smithi078.stdout: "down_at": 0, 2024-04-18T21:06:34.156 INFO:teuthology.orchestra.run.smithi078.stdout: "lost_at": 0, 2024-04-18T21:06:34.156 INFO:teuthology.orchestra.run.smithi078.stdout: "public_addrs": { 2024-04-18T21:06:34.156 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:06:34.156 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:34.157 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:06:34.157 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.132:6800", 2024-04-18T21:06:34.157 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 1948809768 2024-04-18T21:06:34.157 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:34.157 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:34.157 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:06:34.157 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.132:6801", 2024-04-18T21:06:34.157 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 1948809768 2024-04-18T21:06:34.157 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:06:34.157 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:06:34.157 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:34.157 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_addrs": { 2024-04-18T21:06:34.157 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:06:34.157 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:34.158 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:06:34.158 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.132:6802", 2024-04-18T21:06:34.158 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 1948809768 2024-04-18T21:06:34.158 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:34.158 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:34.158 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:06:34.158 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.132:6803", 2024-04-18T21:06:34.158 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 1948809768 2024-04-18T21:06:34.158 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:06:34.158 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:06:34.158 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:34.158 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_back_addrs": { 2024-04-18T21:06:34.158 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:06:34.159 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:34.159 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:06:34.159 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.132:6806", 2024-04-18T21:06:34.159 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 1948809768 2024-04-18T21:06:34.159 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:34.159 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:34.159 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:06:34.159 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.132:6807", 2024-04-18T21:06:34.159 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 1948809768 2024-04-18T21:06:34.159 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:06:34.159 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:06:34.159 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:34.159 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_front_addrs": { 2024-04-18T21:06:34.159 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:06:34.160 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:34.160 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:06:34.160 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.132:6804", 2024-04-18T21:06:34.160 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 1948809768 2024-04-18T21:06:34.160 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:34.160 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:34.160 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:06:34.160 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.132:6805", 2024-04-18T21:06:34.160 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 1948809768 2024-04-18T21:06:34.160 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:06:34.160 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:06:34.160 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:34.160 INFO:teuthology.orchestra.run.smithi078.stdout: "public_addr": "172.21.15.132:6801/1948809768", 2024-04-18T21:06:34.160 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_addr": "172.21.15.132:6803/1948809768", 2024-04-18T21:06:34.160 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_back_addr": "172.21.15.132:6807/1948809768", 2024-04-18T21:06:34.161 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_front_addr": "172.21.15.132:6805/1948809768", 2024-04-18T21:06:34.161 INFO:teuthology.orchestra.run.smithi078.stdout: "state": [ 2024-04-18T21:06:34.161 INFO:teuthology.orchestra.run.smithi078.stdout: "exists", 2024-04-18T21:06:34.161 INFO:teuthology.orchestra.run.smithi078.stdout: "up" 2024-04-18T21:06:34.161 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:06:34.161 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:34.161 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:34.161 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": 1, 2024-04-18T21:06:34.161 INFO:teuthology.orchestra.run.smithi078.stdout: "uuid": "dfeae661-3f8a-4d41-b287-7eb02c16b91a", 2024-04-18T21:06:34.161 INFO:teuthology.orchestra.run.smithi078.stdout: "up": 1, 2024-04-18T21:06:34.161 INFO:teuthology.orchestra.run.smithi078.stdout: "in": 1, 2024-04-18T21:06:34.161 INFO:teuthology.orchestra.run.smithi078.stdout: "weight": 1, 2024-04-18T21:06:34.161 INFO:teuthology.orchestra.run.smithi078.stdout: "primary_affinity": 1, 2024-04-18T21:06:34.161 INFO:teuthology.orchestra.run.smithi078.stdout: "last_clean_begin": 0, 2024-04-18T21:06:34.161 INFO:teuthology.orchestra.run.smithi078.stdout: "last_clean_end": 0, 2024-04-18T21:06:34.161 INFO:teuthology.orchestra.run.smithi078.stdout: "up_from": 8, 2024-04-18T21:06:34.162 INFO:teuthology.orchestra.run.smithi078.stdout: "up_thru": 32, 2024-04-18T21:06:34.162 INFO:teuthology.orchestra.run.smithi078.stdout: "down_at": 0, 2024-04-18T21:06:34.162 INFO:teuthology.orchestra.run.smithi078.stdout: "lost_at": 0, 2024-04-18T21:06:34.162 INFO:teuthology.orchestra.run.smithi078.stdout: "public_addrs": { 2024-04-18T21:06:34.162 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:06:34.162 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:34.162 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:06:34.162 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.150:6800", 2024-04-18T21:06:34.162 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 2040503167 2024-04-18T21:06:34.162 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:34.162 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:34.162 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:06:34.162 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.150:6801", 2024-04-18T21:06:34.163 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 2040503167 2024-04-18T21:06:34.163 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:06:34.163 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:06:34.163 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:34.163 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_addrs": { 2024-04-18T21:06:34.163 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:06:34.163 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:34.163 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:06:34.163 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.150:6802", 2024-04-18T21:06:34.163 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 2040503167 2024-04-18T21:06:34.163 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:34.163 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:34.163 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:06:34.163 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.150:6803", 2024-04-18T21:06:34.163 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 2040503167 2024-04-18T21:06:34.164 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:06:34.164 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:06:34.164 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:34.164 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_back_addrs": { 2024-04-18T21:06:34.164 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:06:34.164 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:34.164 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:06:34.164 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.150:6806", 2024-04-18T21:06:34.164 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 2040503167 2024-04-18T21:06:34.164 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:34.164 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:34.164 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:06:34.164 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.150:6807", 2024-04-18T21:06:34.164 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 2040503167 2024-04-18T21:06:34.164 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:06:34.164 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:06:34.165 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:34.165 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_front_addrs": { 2024-04-18T21:06:34.165 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:06:34.165 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:34.165 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:06:34.165 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.150:6804", 2024-04-18T21:06:34.165 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 2040503167 2024-04-18T21:06:34.165 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:34.165 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:34.165 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:06:34.165 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.150:6805", 2024-04-18T21:06:34.165 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 2040503167 2024-04-18T21:06:34.165 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:06:34.165 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:06:34.166 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:34.166 INFO:teuthology.orchestra.run.smithi078.stdout: "public_addr": "172.21.15.150:6801/2040503167", 2024-04-18T21:06:34.166 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_addr": "172.21.15.150:6803/2040503167", 2024-04-18T21:06:34.166 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_back_addr": "172.21.15.150:6807/2040503167", 2024-04-18T21:06:34.166 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_front_addr": "172.21.15.150:6805/2040503167", 2024-04-18T21:06:34.166 INFO:teuthology.orchestra.run.smithi078.stdout: "state": [ 2024-04-18T21:06:34.166 INFO:teuthology.orchestra.run.smithi078.stdout: "exists", 2024-04-18T21:06:34.166 INFO:teuthology.orchestra.run.smithi078.stdout: "up" 2024-04-18T21:06:34.166 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:06:34.166 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:34.166 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:34.166 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": 2, 2024-04-18T21:06:34.166 INFO:teuthology.orchestra.run.smithi078.stdout: "uuid": "56a34021-e2dc-41ff-822c-7ec123466f25", 2024-04-18T21:06:34.166 INFO:teuthology.orchestra.run.smithi078.stdout: "up": 1, 2024-04-18T21:06:34.167 INFO:teuthology.orchestra.run.smithi078.stdout: "in": 1, 2024-04-18T21:06:34.167 INFO:teuthology.orchestra.run.smithi078.stdout: "weight": 1, 2024-04-18T21:06:34.167 INFO:teuthology.orchestra.run.smithi078.stdout: "primary_affinity": 0.5912322998046875, 2024-04-18T21:06:34.167 INFO:teuthology.orchestra.run.smithi078.stdout: "last_clean_begin": 0, 2024-04-18T21:06:34.167 INFO:teuthology.orchestra.run.smithi078.stdout: "last_clean_end": 0, 2024-04-18T21:06:34.167 INFO:teuthology.orchestra.run.smithi078.stdout: "up_from": 8, 2024-04-18T21:06:34.167 INFO:teuthology.orchestra.run.smithi078.stdout: "up_thru": 16, 2024-04-18T21:06:34.167 INFO:teuthology.orchestra.run.smithi078.stdout: "down_at": 0, 2024-04-18T21:06:34.167 INFO:teuthology.orchestra.run.smithi078.stdout: "lost_at": 0, 2024-04-18T21:06:34.167 INFO:teuthology.orchestra.run.smithi078.stdout: "public_addrs": { 2024-04-18T21:06:34.167 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:06:34.168 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:34.168 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:06:34.168 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.187:6800", 2024-04-18T21:06:34.168 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 429896900 2024-04-18T21:06:34.168 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:34.168 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:34.168 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:06:34.168 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.187:6801", 2024-04-18T21:06:34.168 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 429896900 2024-04-18T21:06:34.168 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:06:34.168 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:06:34.168 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:34.168 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_addrs": { 2024-04-18T21:06:34.168 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:06:34.168 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:34.169 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:06:34.169 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.187:6802", 2024-04-18T21:06:34.169 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 429896900 2024-04-18T21:06:34.169 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:34.169 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:34.169 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:06:34.169 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.187:6803", 2024-04-18T21:06:34.169 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 429896900 2024-04-18T21:06:34.169 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:06:34.169 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:06:34.169 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:34.169 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_back_addrs": { 2024-04-18T21:06:34.169 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:06:34.169 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:34.170 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:06:34.170 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.187:6806", 2024-04-18T21:06:34.170 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 429896900 2024-04-18T21:06:34.170 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:34.170 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:34.170 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:06:34.170 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.187:6807", 2024-04-18T21:06:34.170 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 429896900 2024-04-18T21:06:34.170 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:06:34.170 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:06:34.170 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:34.170 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_front_addrs": { 2024-04-18T21:06:34.170 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:06:34.170 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:34.171 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:06:34.171 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.187:6804", 2024-04-18T21:06:34.171 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 429896900 2024-04-18T21:06:34.171 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:34.171 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:34.171 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:06:34.171 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.187:6805", 2024-04-18T21:06:34.171 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 429896900 2024-04-18T21:06:34.171 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:06:34.171 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:06:34.171 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:34.172 INFO:teuthology.orchestra.run.smithi078.stdout: "public_addr": "172.21.15.187:6801/429896900", 2024-04-18T21:06:34.172 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_addr": "172.21.15.187:6803/429896900", 2024-04-18T21:06:34.172 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_back_addr": "172.21.15.187:6807/429896900", 2024-04-18T21:06:34.172 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_front_addr": "172.21.15.187:6805/429896900", 2024-04-18T21:06:34.172 INFO:teuthology.orchestra.run.smithi078.stdout: "state": [ 2024-04-18T21:06:34.172 INFO:teuthology.orchestra.run.smithi078.stdout: "exists", 2024-04-18T21:06:34.172 INFO:teuthology.orchestra.run.smithi078.stdout: "up" 2024-04-18T21:06:34.172 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:06:34.172 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:06:34.172 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-04-18T21:06:34.172 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_xinfo": [ 2024-04-18T21:06:34.172 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:34.172 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": 0, 2024-04-18T21:06:34.172 INFO:teuthology.orchestra.run.smithi078.stdout: "down_stamp": "0.000000", 2024-04-18T21:06:34.172 INFO:teuthology.orchestra.run.smithi078.stdout: "laggy_probability": 0, 2024-04-18T21:06:34.172 INFO:teuthology.orchestra.run.smithi078.stdout: "laggy_interval": 0, 2024-04-18T21:06:34.173 INFO:teuthology.orchestra.run.smithi078.stdout: "features": 4540701547738038271, 2024-04-18T21:06:34.173 INFO:teuthology.orchestra.run.smithi078.stdout: "old_weight": 0, 2024-04-18T21:06:34.173 INFO:teuthology.orchestra.run.smithi078.stdout: "last_purged_snaps_scrub": "2024-04-18T21:04:49.804359+0000", 2024-04-18T21:06:34.173 INFO:teuthology.orchestra.run.smithi078.stdout: "dead_epoch": 0 2024-04-18T21:06:34.173 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:34.173 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:34.173 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": 1, 2024-04-18T21:06:34.173 INFO:teuthology.orchestra.run.smithi078.stdout: "down_stamp": "0.000000", 2024-04-18T21:06:34.173 INFO:teuthology.orchestra.run.smithi078.stdout: "laggy_probability": 0, 2024-04-18T21:06:34.173 INFO:teuthology.orchestra.run.smithi078.stdout: "laggy_interval": 0, 2024-04-18T21:06:34.173 INFO:teuthology.orchestra.run.smithi078.stdout: "features": 4540701547738038271, 2024-04-18T21:06:34.173 INFO:teuthology.orchestra.run.smithi078.stdout: "old_weight": 0, 2024-04-18T21:06:34.173 INFO:teuthology.orchestra.run.smithi078.stdout: "last_purged_snaps_scrub": "2024-04-18T21:04:49.790978+0000", 2024-04-18T21:06:34.173 INFO:teuthology.orchestra.run.smithi078.stdout: "dead_epoch": 0 2024-04-18T21:06:34.173 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:34.173 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:34.174 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": 2, 2024-04-18T21:06:34.174 INFO:teuthology.orchestra.run.smithi078.stdout: "down_stamp": "0.000000", 2024-04-18T21:06:34.174 INFO:teuthology.orchestra.run.smithi078.stdout: "laggy_probability": 0, 2024-04-18T21:06:34.174 INFO:teuthology.orchestra.run.smithi078.stdout: "laggy_interval": 0, 2024-04-18T21:06:34.174 INFO:teuthology.orchestra.run.smithi078.stdout: "features": 4540701547738038271, 2024-04-18T21:06:34.174 INFO:teuthology.orchestra.run.smithi078.stdout: "old_weight": 0, 2024-04-18T21:06:34.174 INFO:teuthology.orchestra.run.smithi078.stdout: "last_purged_snaps_scrub": "2024-04-18T21:04:49.762943+0000", 2024-04-18T21:06:34.174 INFO:teuthology.orchestra.run.smithi078.stdout: "dead_epoch": 0 2024-04-18T21:06:34.174 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:06:34.174 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-04-18T21:06:34.174 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_upmap": [], 2024-04-18T21:06:34.174 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_upmap_items": [], 2024-04-18T21:06:34.174 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_upmap_primaries": [], 2024-04-18T21:06:34.174 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_temp": [], 2024-04-18T21:06:34.175 INFO:teuthology.orchestra.run.smithi078.stdout: "primary_temp": [], 2024-04-18T21:06:34.175 INFO:teuthology.orchestra.run.smithi078.stdout: "blocklist": {}, 2024-04-18T21:06:34.175 INFO:teuthology.orchestra.run.smithi078.stdout: "range_blocklist": {}, 2024-04-18T21:06:34.175 INFO:teuthology.orchestra.run.smithi078.stdout: "erasure_code_profiles": { 2024-04-18T21:06:34.175 INFO:teuthology.orchestra.run.smithi078.stdout: "default": { 2024-04-18T21:06:34.175 INFO:teuthology.orchestra.run.smithi078.stdout: "crush-failure-domain": "osd", 2024-04-18T21:06:34.175 INFO:teuthology.orchestra.run.smithi078.stdout: "k": "2", 2024-04-18T21:06:34.175 INFO:teuthology.orchestra.run.smithi078.stdout: "m": "1", 2024-04-18T21:06:34.175 INFO:teuthology.orchestra.run.smithi078.stdout: "plugin": "jerasure", 2024-04-18T21:06:34.175 INFO:teuthology.orchestra.run.smithi078.stdout: "technique": "reed_sol_van" 2024-04-18T21:06:34.175 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:06:34.176 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:34.176 INFO:teuthology.orchestra.run.smithi078.stdout: "removed_snaps_queue": [], 2024-04-18T21:06:34.176 INFO:teuthology.orchestra.run.smithi078.stdout: "new_removed_snaps": [], 2024-04-18T21:06:34.176 INFO:teuthology.orchestra.run.smithi078.stdout: "new_purged_snaps": [], 2024-04-18T21:06:34.176 INFO:teuthology.orchestra.run.smithi078.stdout: "crush_node_flags": {}, 2024-04-18T21:06:34.176 INFO:teuthology.orchestra.run.smithi078.stdout: "device_class_flags": {}, 2024-04-18T21:06:34.176 INFO:teuthology.orchestra.run.smithi078.stdout: "stretch_mode": { 2024-04-18T21:06:34.176 INFO:teuthology.orchestra.run.smithi078.stdout: "stretch_mode_enabled": false, 2024-04-18T21:06:34.176 INFO:teuthology.orchestra.run.smithi078.stdout: "stretch_bucket_count": 0, 2024-04-18T21:06:34.176 INFO:teuthology.orchestra.run.smithi078.stdout: "degraded_stretch_mode": 0, 2024-04-18T21:06:34.176 INFO:teuthology.orchestra.run.smithi078.stdout: "recovering_stretch_mode": 0, 2024-04-18T21:06:34.176 INFO:teuthology.orchestra.run.smithi078.stdout: "stretch_mode_bucket": 0 2024-04-18T21:06:34.176 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:06:34.176 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-04-18T21:06:34.178 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:34.178 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:34.179 INFO:tasks.thrashosds.thrasher:j is {'epoch': 47, 'fsid': 'dc017990-0393-4ab0-b604-5e7052fdc7bd', 'created': '2024-04-18T21:04:43.507538+0000', 'modified': '2024-04-18T21:06:32.679222+0000', 'last_up_change': '2024-04-18T21:04:52.492503+0000', 'last_in_change': '2024-04-18T21:04:44.402191+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T21:04:52.538153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8637441396713257, 'average_primary_affinity': 0.8600000143051147, 'average_primary_affinity_weighted': 0.8600000143051147}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-18T21:04:58.673793+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.8637441396713257, 'average_primary_affinity': 0.8600000143051147, 'average_primary_affinity_weighted': 0.8600000143051147}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T21:05:03.314171+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 0.8637441396713257, 'average_primary_affinity': 0.8600000143051147, 'average_primary_affinity_weighted': 0.8600000143051147}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T21:05:03.931699+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.2699999809265137, 'score_stable': 1.2699999809265137, 'optimal_score': 1, 'raw_score_acting': 1.2699999809265137, 'raw_score_stable': 1.2699999809265137, 'primary_affinity_weighted': 0.8637441396713257, 'average_primary_affinity': 0.8600000143051147, 'average_primary_affinity_weighted': 0.8600000143051147}}], 'osds': [{'osd': 0, 'uuid': '1854d737-3a67-416a-8c88-0f126505a0f2', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 32, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.132:6800', 'nonce': 1948809768}, {'type': 'v1', 'addr': '172.21.15.132:6801', 'nonce': 1948809768}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.132:6802', 'nonce': 1948809768}, {'type': 'v1', 'addr': '172.21.15.132:6803', 'nonce': 1948809768}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.132:6806', 'nonce': 1948809768}, {'type': 'v1', 'addr': '172.21.15.132:6807', 'nonce': 1948809768}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.132:6804', 'nonce': 1948809768}, {'type': 'v1', 'addr': '172.21.15.132:6805', 'nonce': 1948809768}]}, 'public_addr': '172.21.15.132:6801/1948809768', 'cluster_addr': '172.21.15.132:6803/1948809768', 'heartbeat_back_addr': '172.21.15.132:6807/1948809768', 'heartbeat_front_addr': '172.21.15.132:6805/1948809768', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'dfeae661-3f8a-4d41-b287-7eb02c16b91a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 32, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6800', 'nonce': 2040503167}, {'type': 'v1', 'addr': '172.21.15.150:6801', 'nonce': 2040503167}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6802', 'nonce': 2040503167}, {'type': 'v1', 'addr': '172.21.15.150:6803', 'nonce': 2040503167}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6806', 'nonce': 2040503167}, {'type': 'v1', 'addr': '172.21.15.150:6807', 'nonce': 2040503167}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6804', 'nonce': 2040503167}, {'type': 'v1', 'addr': '172.21.15.150:6805', 'nonce': 2040503167}]}, 'public_addr': '172.21.15.150:6801/2040503167', 'cluster_addr': '172.21.15.150:6803/2040503167', 'heartbeat_back_addr': '172.21.15.150:6807/2040503167', 'heartbeat_front_addr': '172.21.15.150:6805/2040503167', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '56a34021-e2dc-41ff-822c-7ec123466f25', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.5912322998046875, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6800', 'nonce': 429896900}, {'type': 'v1', 'addr': '172.21.15.187:6801', 'nonce': 429896900}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6802', 'nonce': 429896900}, {'type': 'v1', 'addr': '172.21.15.187:6803', 'nonce': 429896900}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6806', 'nonce': 429896900}, {'type': 'v1', 'addr': '172.21.15.187:6807', 'nonce': 429896900}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6804', 'nonce': 429896900}, {'type': 'v1', 'addr': '172.21.15.187:6805', 'nonce': 429896900}]}, 'public_addr': '172.21.15.187:6801/429896900', 'cluster_addr': '172.21.15.187:6803/429896900', 'heartbeat_back_addr': '172.21.15.187:6807/429896900', 'heartbeat_front_addr': '172.21.15.187:6805/429896900', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-18T21:04:49.804359+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-18T21:04:49.790978+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-18T21:04:49.762943+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-18T21:06:34.179 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:06:34.180 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:34.225 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:34.227+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:34.304 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:34.303+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:34.313 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:34.313 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:34.328 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:34.413 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:34.415+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:34.470 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:06:34.471 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-04-18T21:06:34.489 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":95,"stamp":"2024-04-18T21:06:32.683479+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597719,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":256,"num_write_kb":3483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":95900,"kb_used_data":2352,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":283019620,"statfs":{"total":289910292480,"available":289812090880,"internally_reserved":0,"allocated":2408448,"data_stored":1711010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.158776"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685864+0000","last_change":"2024-04-18T21:05:05.652795+0000","last_active":"2024-04-18T21:06:31.685864+0000","last_peered":"2024-04-18T21:06:31.685864+0000","last_clean":"2024-04-18T21:06:31.685864+0000","last_became_active":"2024-04-18T21:05:05.650121+0000","last_became_peered":"2024-04-18T21:05:05.650121+0000","last_unstale":"2024-04-18T21:06:31.685864+0000","last_undegraded":"2024-04-18T21:06:31.685864+0000","last_fullsized":"2024-04-18T21:06:31.685864+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685082+0000","last_change":"2024-04-18T21:05:05.657531+0000","last_active":"2024-04-18T21:06:31.685082+0000","last_peered":"2024-04-18T21:06:31.685082+0000","last_clean":"2024-04-18T21:06:31.685082+0000","last_became_active":"2024-04-18T21:05:05.653101+0000","last_became_peered":"2024-04-18T21:05:05.653101+0000","last_unstale":"2024-04-18T21:06:31.685082+0000","last_undegraded":"2024-04-18T21:06:31.685082+0000","last_fullsized":"2024-04-18T21:06:31.685082+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:32:23.929877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683945+0000","last_change":"2024-04-18T21:05:05.647965+0000","last_active":"2024-04-18T21:06:31.683945+0000","last_peered":"2024-04-18T21:06:31.683945+0000","last_clean":"2024-04-18T21:06:31.683945+0000","last_became_active":"2024-04-18T21:05:05.645931+0000","last_became_peered":"2024-04-18T21:05:05.645931+0000","last_unstale":"2024-04-18T21:06:31.683945+0000","last_undegraded":"2024-04-18T21:06:31.683945+0000","last_fullsized":"2024-04-18T21:06:31.683945+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:04.350492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683944+0000","last_change":"2024-04-18T21:05:05.629321+0000","last_active":"2024-04-18T21:06:31.683944+0000","last_peered":"2024-04-18T21:06:31.683944+0000","last_clean":"2024-04-18T21:06:31.683944+0000","last_became_active":"2024-04-18T21:05:05.627956+0000","last_became_peered":"2024-04-18T21:05:05.627956+0000","last_unstale":"2024-04-18T21:06:31.683944+0000","last_undegraded":"2024-04-18T21:06:31.683944+0000","last_fullsized":"2024-04-18T21:06:31.683944+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:15:28.458476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685405+0000","last_change":"2024-04-18T21:05:05.648710+0000","last_active":"2024-04-18T21:06:31.685405+0000","last_peered":"2024-04-18T21:06:31.685405+0000","last_clean":"2024-04-18T21:06:31.685405+0000","last_became_active":"2024-04-18T21:05:05.647801+0000","last_became_peered":"2024-04-18T21:05:05.647801+0000","last_unstale":"2024-04-18T21:06:31.685405+0000","last_undegraded":"2024-04-18T21:06:31.685405+0000","last_fullsized":"2024-04-18T21:06:31.685405+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:46:36.339289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683322+0000","last_change":"2024-04-18T21:05:05.629095+0000","last_active":"2024-04-18T21:06:31.683322+0000","last_peered":"2024-04-18T21:06:31.683322+0000","last_clean":"2024-04-18T21:06:31.683322+0000","last_became_active":"2024-04-18T21:05:05.627664+0000","last_became_peered":"2024-04-18T21:05:05.627664+0000","last_unstale":"2024-04-18T21:06:31.683322+0000","last_undegraded":"2024-04-18T21:06:31.683322+0000","last_fullsized":"2024-04-18T21:06:31.683322+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:51:28.440070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683427+0000","last_change":"2024-04-18T21:05:05.625047+0000","last_active":"2024-04-18T21:06:31.683427+0000","last_peered":"2024-04-18T21:06:31.683427+0000","last_clean":"2024-04-18T21:06:31.683427+0000","last_became_active":"2024-04-18T21:05:05.622781+0000","last_became_peered":"2024-04-18T21:05:05.622781+0000","last_unstale":"2024-04-18T21:06:31.683427+0000","last_undegraded":"2024-04-18T21:06:31.683427+0000","last_fullsized":"2024-04-18T21:06:31.683427+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:12.944469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683007+0000","last_change":"2024-04-18T21:05:05.640390+0000","last_active":"2024-04-18T21:06:31.683007+0000","last_peered":"2024-04-18T21:06:31.683007+0000","last_clean":"2024-04-18T21:06:31.683007+0000","last_became_active":"2024-04-18T21:05:05.638295+0000","last_became_peered":"2024-04-18T21:05:05.638295+0000","last_unstale":"2024-04-18T21:06:31.683007+0000","last_undegraded":"2024-04-18T21:06:31.683007+0000","last_fullsized":"2024-04-18T21:06:31.683007+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:34:31.132458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":66,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.610957+0000","last_change":"2024-04-18T21:05:05.660752+0000","last_active":"2024-04-18T21:06:31.610957+0000","last_peered":"2024-04-18T21:06:31.610957+0000","last_clean":"2024-04-18T21:06:31.610957+0000","last_became_active":"2024-04-18T21:05:05.659226+0000","last_became_peered":"2024-04-18T21:05:05.659226+0000","last_unstale":"2024-04-18T21:06:31.610957+0000","last_undegraded":"2024-04-18T21:06:31.610957+0000","last_fullsized":"2024-04-18T21:06:31.610957+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:20:45.938503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685339+0000","last_change":"2024-04-18T21:05:05.656660+0000","last_active":"2024-04-18T21:06:31.685339+0000","last_peered":"2024-04-18T21:06:31.685339+0000","last_clean":"2024-04-18T21:06:31.685339+0000","last_became_active":"2024-04-18T21:05:05.653829+0000","last_became_peered":"2024-04-18T21:05:05.653829+0000","last_unstale":"2024-04-18T21:06:31.685339+0000","last_undegraded":"2024-04-18T21:06:31.685339+0000","last_fullsized":"2024-04-18T21:06:31.685339+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:50:40.920146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684150+0000","last_change":"2024-04-18T21:05:05.646721+0000","last_active":"2024-04-18T21:06:31.684150+0000","last_peered":"2024-04-18T21:06:31.684150+0000","last_clean":"2024-04-18T21:06:31.684150+0000","last_became_active":"2024-04-18T21:05:05.643421+0000","last_became_peered":"2024-04-18T21:05:05.643421+0000","last_unstale":"2024-04-18T21:06:31.684150+0000","last_undegraded":"2024-04-18T21:06:31.684150+0000","last_fullsized":"2024-04-18T21:06:31.684150+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:14:51.873741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684748+0000","last_change":"2024-04-18T21:05:05.656320+0000","last_active":"2024-04-18T21:06:31.684748+0000","last_peered":"2024-04-18T21:06:31.684748+0000","last_clean":"2024-04-18T21:06:31.684748+0000","last_became_active":"2024-04-18T21:05:05.655508+0000","last_became_peered":"2024-04-18T21:05:05.655508+0000","last_unstale":"2024-04-18T21:06:31.684748+0000","last_undegraded":"2024-04-18T21:06:31.684748+0000","last_fullsized":"2024-04-18T21:06:31.684748+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:51.225379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684313+0000","last_change":"2024-04-18T21:05:05.649001+0000","last_active":"2024-04-18T21:06:31.684313+0000","last_peered":"2024-04-18T21:06:31.684313+0000","last_clean":"2024-04-18T21:06:31.684313+0000","last_became_active":"2024-04-18T21:05:05.648070+0000","last_became_peered":"2024-04-18T21:05:05.648070+0000","last_unstale":"2024-04-18T21:06:31.684313+0000","last_undegraded":"2024-04-18T21:06:31.684313+0000","last_fullsized":"2024-04-18T21:06:31.684313+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:56.408234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683624+0000","last_change":"2024-04-18T21:05:05.635880+0000","last_active":"2024-04-18T21:06:31.683624+0000","last_peered":"2024-04-18T21:06:31.683624+0000","last_clean":"2024-04-18T21:06:31.683624+0000","last_became_active":"2024-04-18T21:05:05.635089+0000","last_became_peered":"2024-04-18T21:05:05.635089+0000","last_unstale":"2024-04-18T21:06:31.683624+0000","last_undegraded":"2024-04-18T21:06:31.683624+0000","last_fullsized":"2024-04-18T21:06:31.683624+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:50:40.920146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683419+0000","last_change":"2024-04-18T21:05:05.639640+0000","last_active":"2024-04-18T21:06:31.683419+0000","last_peered":"2024-04-18T21:06:31.683419+0000","last_clean":"2024-04-18T21:06:31.683419+0000","last_became_active":"2024-04-18T21:05:05.637311+0000","last_became_peered":"2024-04-18T21:05:05.637311+0000","last_unstale":"2024-04-18T21:06:31.683419+0000","last_undegraded":"2024-04-18T21:06:31.683419+0000","last_fullsized":"2024-04-18T21:06:31.683419+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:20:45.938503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683092+0000","last_change":"2024-04-18T21:05:05.638203+0000","last_active":"2024-04-18T21:06:31.683092+0000","last_peered":"2024-04-18T21:06:31.683092+0000","last_clean":"2024-04-18T21:06:31.683092+0000","last_became_active":"2024-04-18T21:05:05.637352+0000","last_became_peered":"2024-04-18T21:05:05.637352+0000","last_unstale":"2024-04-18T21:06:31.683092+0000","last_undegraded":"2024-04-18T21:06:31.683092+0000","last_fullsized":"2024-04-18T21:06:31.683092+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":37,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685582+0000","last_change":"2024-04-18T21:06:01.036290+0000","last_active":"2024-04-18T21:06:31.685582+0000","last_peered":"2024-04-18T21:06:31.685582+0000","last_clean":"2024-04-18T21:06:31.685582+0000","last_became_active":"2024-04-18T21:06:01.035478+0000","last_became_peered":"2024-04-18T21:06:01.035478+0000","last_unstale":"2024-04-18T21:06:31.685582+0000","last_undegraded":"2024-04-18T21:06:31.685582+0000","last_fullsized":"2024-04-18T21:06:31.685582+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:14:08.347445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685826+0000","last_change":"2024-04-18T21:05:05.655261+0000","last_active":"2024-04-18T21:06:31.685826+0000","last_peered":"2024-04-18T21:06:31.685826+0000","last_clean":"2024-04-18T21:06:31.685826+0000","last_became_active":"2024-04-18T21:05:05.651388+0000","last_became_peered":"2024-04-18T21:05:05.651388+0000","last_unstale":"2024-04-18T21:06:31.685826+0000","last_undegraded":"2024-04-18T21:06:31.685826+0000","last_fullsized":"2024-04-18T21:06:31.685826+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:53.850184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":66,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.610439+0000","last_change":"2024-04-18T21:05:05.652710+0000","last_active":"2024-04-18T21:06:31.610439+0000","last_peered":"2024-04-18T21:06:31.610439+0000","last_clean":"2024-04-18T21:06:31.610439+0000","last_became_active":"2024-04-18T21:05:05.651929+0000","last_became_peered":"2024-04-18T21:05:05.651929+0000","last_unstale":"2024-04-18T21:06:31.610439+0000","last_undegraded":"2024-04-18T21:06:31.610439+0000","last_fullsized":"2024-04-18T21:06:31.610439+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:12.944469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684124+0000","last_change":"2024-04-18T21:05:05.638338+0000","last_active":"2024-04-18T21:06:31.684124+0000","last_peered":"2024-04-18T21:06:31.684124+0000","last_clean":"2024-04-18T21:06:31.684124+0000","last_became_active":"2024-04-18T21:05:05.637567+0000","last_became_peered":"2024-04-18T21:05:05.637567+0000","last_unstale":"2024-04-18T21:06:31.684124+0000","last_undegraded":"2024-04-18T21:06:31.684124+0000","last_fullsized":"2024-04-18T21:06:31.684124+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683958+0000","last_change":"2024-04-18T21:05:05.643606+0000","last_active":"2024-04-18T21:06:31.683958+0000","last_peered":"2024-04-18T21:06:31.683958+0000","last_clean":"2024-04-18T21:06:31.683958+0000","last_became_active":"2024-04-18T21:05:05.642991+0000","last_became_peered":"2024-04-18T21:05:05.642991+0000","last_unstale":"2024-04-18T21:06:31.683958+0000","last_undegraded":"2024-04-18T21:06:31.683958+0000","last_fullsized":"2024-04-18T21:06:31.683958+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:01.841786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684476+0000","last_change":"2024-04-18T21:05:05.650896+0000","last_active":"2024-04-18T21:06:31.684476+0000","last_peered":"2024-04-18T21:06:31.684476+0000","last_clean":"2024-04-18T21:06:31.684476+0000","last_became_active":"2024-04-18T21:05:05.650083+0000","last_became_peered":"2024-04-18T21:05:05.650083+0000","last_unstale":"2024-04-18T21:06:31.684476+0000","last_undegraded":"2024-04-18T21:06:31.684476+0000","last_fullsized":"2024-04-18T21:06:31.684476+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:43:55.788425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":37,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.682950+0000","last_change":"2024-04-18T21:06:01.034390+0000","last_active":"2024-04-18T21:06:31.682950+0000","last_peered":"2024-04-18T21:06:31.682950+0000","last_clean":"2024-04-18T21:06:31.682950+0000","last_became_active":"2024-04-18T21:06:01.033524+0000","last_became_peered":"2024-04-18T21:06:01.033524+0000","last_unstale":"2024-04-18T21:06:31.682950+0000","last_undegraded":"2024-04-18T21:06:31.682950+0000","last_fullsized":"2024-04-18T21:06:31.682950+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:28:17.539732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683563+0000","last_change":"2024-04-18T21:05:05.642755+0000","last_active":"2024-04-18T21:06:31.683563+0000","last_peered":"2024-04-18T21:06:31.683563+0000","last_clean":"2024-04-18T21:06:31.683563+0000","last_became_active":"2024-04-18T21:05:05.642150+0000","last_became_peered":"2024-04-18T21:05:05.642150+0000","last_unstale":"2024-04-18T21:06:31.683563+0000","last_undegraded":"2024-04-18T21:06:31.683563+0000","last_fullsized":"2024-04-18T21:06:31.683563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:29:22.647425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685978+0000","last_change":"2024-04-18T21:05:05.653741+0000","last_active":"2024-04-18T21:06:31.685978+0000","last_peered":"2024-04-18T21:06:31.685978+0000","last_clean":"2024-04-18T21:06:31.685978+0000","last_became_active":"2024-04-18T21:05:05.650174+0000","last_became_peered":"2024-04-18T21:05:05.650174+0000","last_unstale":"2024-04-18T21:06:31.685978+0000","last_undegraded":"2024-04-18T21:06:31.685978+0000","last_fullsized":"2024-04-18T21:06:31.685978+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:04.350492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":66,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.610977+0000","last_change":"2024-04-18T21:05:05.649581+0000","last_active":"2024-04-18T21:06:31.610977+0000","last_peered":"2024-04-18T21:06:31.610977+0000","last_clean":"2024-04-18T21:06:31.610977+0000","last_became_active":"2024-04-18T21:05:05.648233+0000","last_became_peered":"2024-04-18T21:05:05.648233+0000","last_unstale":"2024-04-18T21:06:31.610977+0000","last_undegraded":"2024-04-18T21:06:31.610977+0000","last_fullsized":"2024-04-18T21:06:31.610977+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685069+0000","last_change":"2024-04-18T21:05:05.646926+0000","last_active":"2024-04-18T21:06:31.685069+0000","last_peered":"2024-04-18T21:06:31.685069+0000","last_clean":"2024-04-18T21:06:31.685069+0000","last_became_active":"2024-04-18T21:05:05.644942+0000","last_became_peered":"2024-04-18T21:05:05.644942+0000","last_unstale":"2024-04-18T21:06:31.685069+0000","last_undegraded":"2024-04-18T21:06:31.685069+0000","last_fullsized":"2024-04-18T21:06:31.685069+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:53.850184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685257+0000","last_change":"2024-04-18T21:05:05.656314+0000","last_active":"2024-04-18T21:06:31.685257+0000","last_peered":"2024-04-18T21:06:31.685257+0000","last_clean":"2024-04-18T21:06:31.685257+0000","last_became_active":"2024-04-18T21:05:05.655364+0000","last_became_peered":"2024-04-18T21:05:05.655364+0000","last_unstale":"2024-04-18T21:06:31.685257+0000","last_undegraded":"2024-04-18T21:06:31.685257+0000","last_fullsized":"2024-04-18T21:06:31.685257+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:27:17.530889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":37,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684271+0000","last_change":"2024-04-18T21:06:01.033572+0000","last_active":"2024-04-18T21:06:31.684271+0000","last_peered":"2024-04-18T21:06:31.684271+0000","last_clean":"2024-04-18T21:06:31.684271+0000","last_became_active":"2024-04-18T21:06:01.032811+0000","last_became_peered":"2024-04-18T21:06:01.032811+0000","last_unstale":"2024-04-18T21:06:31.684271+0000","last_undegraded":"2024-04-18T21:06:31.684271+0000","last_fullsized":"2024-04-18T21:06:31.684271+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:38:45.452379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684713+0000","last_change":"2024-04-18T21:05:05.648084+0000","last_active":"2024-04-18T21:06:31.684713+0000","last_peered":"2024-04-18T21:06:31.684713+0000","last_clean":"2024-04-18T21:06:31.684713+0000","last_became_active":"2024-04-18T21:05:05.645340+0000","last_became_peered":"2024-04-18T21:05:05.645340+0000","last_unstale":"2024-04-18T21:06:31.684713+0000","last_undegraded":"2024-04-18T21:06:31.684713+0000","last_fullsized":"2024-04-18T21:06:31.684713+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:34:31.132458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":37,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683791+0000","last_change":"2024-04-18T21:06:01.034356+0000","last_active":"2024-04-18T21:06:31.683791+0000","last_peered":"2024-04-18T21:06:31.683791+0000","last_clean":"2024-04-18T21:06:31.683791+0000","last_became_active":"2024-04-18T21:06:01.033850+0000","last_became_peered":"2024-04-18T21:06:01.033850+0000","last_unstale":"2024-04-18T21:06:31.683791+0000","last_undegraded":"2024-04-18T21:06:31.683791+0000","last_fullsized":"2024-04-18T21:06:31.683791+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:28:32.020153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683349+0000","last_change":"2024-04-18T21:05:05.626677+0000","last_active":"2024-04-18T21:06:31.683349+0000","last_peered":"2024-04-18T21:06:31.683349+0000","last_clean":"2024-04-18T21:06:31.683349+0000","last_became_active":"2024-04-18T21:05:05.624250+0000","last_became_peered":"2024-04-18T21:05:05.624250+0000","last_unstale":"2024-04-18T21:06:31.683349+0000","last_undegraded":"2024-04-18T21:06:31.683349+0000","last_fullsized":"2024-04-18T21:06:31.683349+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:51.225379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685005+0000","last_change":"2024-04-18T21:05:05.649918+0000","last_active":"2024-04-18T21:06:31.685005+0000","last_peered":"2024-04-18T21:06:31.685005+0000","last_clean":"2024-04-18T21:06:31.685005+0000","last_became_active":"2024-04-18T21:05:05.647147+0000","last_became_peered":"2024-04-18T21:05:05.647147+0000","last_unstale":"2024-04-18T21:06:31.685005+0000","last_undegraded":"2024-04-18T21:06:31.685005+0000","last_fullsized":"2024-04-18T21:06:31.685005+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:51:28.440070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":72,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685208+0000","last_change":"2024-04-18T21:05:04.632748+0000","last_active":"2024-04-18T21:06:31.685208+0000","last_peered":"2024-04-18T21:06:31.685208+0000","last_clean":"2024-04-18T21:06:31.685208+0000","last_became_active":"2024-04-18T21:05:04.628407+0000","last_became_peered":"2024-04-18T21:05:04.628407+0000","last_unstale":"2024-04-18T21:06:31.685208+0000","last_undegraded":"2024-04-18T21:06:31.685208+0000","last_fullsized":"2024-04-18T21:06:31.685208+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:42:45.392908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685415+0000","last_change":"2024-04-18T21:05:05.649199+0000","last_active":"2024-04-18T21:06:31.685415+0000","last_peered":"2024-04-18T21:06:31.685415+0000","last_clean":"2024-04-18T21:06:31.685415+0000","last_became_active":"2024-04-18T21:05:05.646898+0000","last_became_peered":"2024-04-18T21:05:05.646898+0000","last_unstale":"2024-04-18T21:06:31.685415+0000","last_undegraded":"2024-04-18T21:06:31.685415+0000","last_fullsized":"2024-04-18T21:06:31.685415+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:31:31.842528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":68,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.609793+0000","last_change":"2024-04-18T21:05:04.638017+0000","last_active":"2024-04-18T21:06:31.609793+0000","last_peered":"2024-04-18T21:06:31.609793+0000","last_clean":"2024-04-18T21:06:31.609793+0000","last_became_active":"2024-04-18T21:05:04.637287+0000","last_became_peered":"2024-04-18T21:05:04.637287+0000","last_unstale":"2024-04-18T21:06:31.609793+0000","last_undegraded":"2024-04-18T21:06:31.609793+0000","last_fullsized":"2024-04-18T21:06:31.609793+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:25.891472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":37,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683922+0000","last_change":"2024-04-18T21:06:01.034755+0000","last_active":"2024-04-18T21:06:31.683922+0000","last_peered":"2024-04-18T21:06:31.683922+0000","last_clean":"2024-04-18T21:06:31.683922+0000","last_became_active":"2024-04-18T21:06:01.033889+0000","last_became_peered":"2024-04-18T21:06:01.033889+0000","last_unstale":"2024-04-18T21:06:31.683922+0000","last_undegraded":"2024-04-18T21:06:31.683922+0000","last_fullsized":"2024-04-18T21:06:31.683922+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:09:08.394894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":70,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684240+0000","last_change":"2024-04-18T21:05:04.628489+0000","last_active":"2024-04-18T21:06:31.684240+0000","last_peered":"2024-04-18T21:06:31.684240+0000","last_clean":"2024-04-18T21:06:31.684240+0000","last_became_active":"2024-04-18T21:05:04.627279+0000","last_became_peered":"2024-04-18T21:05:04.627279+0000","last_unstale":"2024-04-18T21:06:31.684240+0000","last_undegraded":"2024-04-18T21:06:31.684240+0000","last_fullsized":"2024-04-18T21:06:31.684240+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:43:23.420744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":66,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.610990+0000","last_change":"2024-04-18T21:05:05.649347+0000","last_active":"2024-04-18T21:06:31.610990+0000","last_peered":"2024-04-18T21:06:31.610990+0000","last_clean":"2024-04-18T21:06:31.610990+0000","last_became_active":"2024-04-18T21:05:05.648144+0000","last_became_peered":"2024-04-18T21:05:05.648144+0000","last_unstale":"2024-04-18T21:06:31.610990+0000","last_undegraded":"2024-04-18T21:06:31.610990+0000","last_fullsized":"2024-04-18T21:06:31.610990+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:51:28.440070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":78,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683454+0000","last_change":"2024-04-18T21:05:04.624089+0000","last_active":"2024-04-18T21:06:31.683454+0000","last_peered":"2024-04-18T21:06:31.683454+0000","last_clean":"2024-04-18T21:06:31.683454+0000","last_became_active":"2024-04-18T21:05:04.623238+0000","last_became_peered":"2024-04-18T21:05:04.623238+0000","last_unstale":"2024-04-18T21:06:31.683454+0000","last_undegraded":"2024-04-18T21:06:31.683454+0000","last_fullsized":"2024-04-18T21:06:31.683454+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:44:19.076499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":71,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684933+0000","last_change":"2024-04-18T21:05:04.633907+0000","last_active":"2024-04-18T21:06:31.684933+0000","last_peered":"2024-04-18T21:06:31.684933+0000","last_clean":"2024-04-18T21:06:31.684933+0000","last_became_active":"2024-04-18T21:05:04.630308+0000","last_became_peered":"2024-04-18T21:05:04.630308+0000","last_unstale":"2024-04-18T21:06:31.684933+0000","last_undegraded":"2024-04-18T21:06:31.684933+0000","last_fullsized":"2024-04-18T21:06:31.684933+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:55:46.219812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683649+0000","last_change":"2024-04-18T21:05:05.658572+0000","last_active":"2024-04-18T21:06:31.683649+0000","last_peered":"2024-04-18T21:06:31.683649+0000","last_clean":"2024-04-18T21:06:31.683649+0000","last_became_active":"2024-04-18T21:05:05.657842+0000","last_became_peered":"2024-04-18T21:05:05.657842+0000","last_unstale":"2024-04-18T21:06:31.683649+0000","last_undegraded":"2024-04-18T21:06:31.683649+0000","last_fullsized":"2024-04-18T21:06:31.683649+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:26:38.636530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":72,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.686098+0000","last_change":"2024-04-18T21:05:04.628541+0000","last_active":"2024-04-18T21:06:31.686098+0000","last_peered":"2024-04-18T21:06:31.686098+0000","last_clean":"2024-04-18T21:06:31.686098+0000","last_became_active":"2024-04-18T21:05:04.627407+0000","last_became_peered":"2024-04-18T21:05:04.627407+0000","last_unstale":"2024-04-18T21:06:31.686098+0000","last_undegraded":"2024-04-18T21:06:31.686098+0000","last_fullsized":"2024-04-18T21:06:31.686098+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:55:48.643174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683960+0000","last_change":"2024-04-18T21:05:05.651649+0000","last_active":"2024-04-18T21:06:31.683960+0000","last_peered":"2024-04-18T21:06:31.683960+0000","last_clean":"2024-04-18T21:06:31.683960+0000","last_became_active":"2024-04-18T21:05:05.646809+0000","last_became_peered":"2024-04-18T21:05:05.646809+0000","last_unstale":"2024-04-18T21:06:31.683960+0000","last_undegraded":"2024-04-18T21:06:31.683960+0000","last_fullsized":"2024-04-18T21:06:31.683960+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:23.698827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":71,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685634+0000","last_change":"2024-04-18T21:05:04.634055+0000","last_active":"2024-04-18T21:06:31.685634+0000","last_peered":"2024-04-18T21:06:31.685634+0000","last_clean":"2024-04-18T21:06:31.685634+0000","last_became_active":"2024-04-18T21:05:04.630736+0000","last_became_peered":"2024-04-18T21:05:04.630736+0000","last_unstale":"2024-04-18T21:06:31.685634+0000","last_undegraded":"2024-04-18T21:06:31.685634+0000","last_fullsized":"2024-04-18T21:06:31.685634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:06:44.001512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684524+0000","last_change":"2024-04-18T21:05:05.628869+0000","last_active":"2024-04-18T21:06:31.684524+0000","last_peered":"2024-04-18T21:06:31.684524+0000","last_clean":"2024-04-18T21:06:31.684524+0000","last_became_active":"2024-04-18T21:05:05.627071+0000","last_became_peered":"2024-04-18T21:05:05.627071+0000","last_unstale":"2024-04-18T21:06:31.684524+0000","last_undegraded":"2024-04-18T21:06:31.684524+0000","last_fullsized":"2024-04-18T21:06:31.684524+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:31:31.842528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":70,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685436+0000","last_change":"2024-04-18T21:05:04.625520+0000","last_active":"2024-04-18T21:06:31.685436+0000","last_peered":"2024-04-18T21:06:31.685436+0000","last_clean":"2024-04-18T21:06:31.685436+0000","last_became_active":"2024-04-18T21:05:04.624656+0000","last_became_peered":"2024-04-18T21:05:04.624656+0000","last_unstale":"2024-04-18T21:06:31.685436+0000","last_undegraded":"2024-04-18T21:06:31.685436+0000","last_fullsized":"2024-04-18T21:06:31.685436+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:56:05.795125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":66,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.609801+0000","last_change":"2024-04-18T21:05:05.649406+0000","last_active":"2024-04-18T21:06:31.609801+0000","last_peered":"2024-04-18T21:06:31.609801+0000","last_clean":"2024-04-18T21:06:31.609801+0000","last_became_active":"2024-04-18T21:05:05.648380+0000","last_became_peered":"2024-04-18T21:05:05.648380+0000","last_unstale":"2024-04-18T21:06:31.609801+0000","last_undegraded":"2024-04-18T21:06:31.609801+0000","last_fullsized":"2024-04-18T21:06:31.609801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":70,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.610472+0000","last_change":"2024-04-18T21:05:04.640216+0000","last_active":"2024-04-18T21:06:31.610472+0000","last_peered":"2024-04-18T21:06:31.610472+0000","last_clean":"2024-04-18T21:06:31.610472+0000","last_became_active":"2024-04-18T21:05:04.639349+0000","last_became_peered":"2024-04-18T21:05:04.639349+0000","last_unstale":"2024-04-18T21:06:31.610472+0000","last_undegraded":"2024-04-18T21:06:31.610472+0000","last_fullsized":"2024-04-18T21:06:31.610472+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:09:18.466987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684195+0000","last_change":"2024-04-18T21:05:05.628850+0000","last_active":"2024-04-18T21:06:31.684195+0000","last_peered":"2024-04-18T21:06:31.684195+0000","last_clean":"2024-04-18T21:06:31.684195+0000","last_became_active":"2024-04-18T21:05:05.627521+0000","last_became_peered":"2024-04-18T21:05:05.627521+0000","last_unstale":"2024-04-18T21:06:31.684195+0000","last_undegraded":"2024-04-18T21:06:31.684195+0000","last_fullsized":"2024-04-18T21:06:31.684195+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:14:37.912032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":70,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684862+0000","last_change":"2024-04-18T21:05:04.634674+0000","last_active":"2024-04-18T21:06:31.684862+0000","last_peered":"2024-04-18T21:06:31.684862+0000","last_clean":"2024-04-18T21:06:31.684862+0000","last_became_active":"2024-04-18T21:05:04.632284+0000","last_became_peered":"2024-04-18T21:05:04.632284+0000","last_unstale":"2024-04-18T21:06:31.684862+0000","last_undegraded":"2024-04-18T21:06:31.684862+0000","last_fullsized":"2024-04-18T21:06:31.684862+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:09:18.466987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685377+0000","last_change":"2024-04-18T21:05:05.647377+0000","last_active":"2024-04-18T21:06:31.685377+0000","last_peered":"2024-04-18T21:06:31.685377+0000","last_clean":"2024-04-18T21:06:31.685377+0000","last_became_active":"2024-04-18T21:05:05.645067+0000","last_became_peered":"2024-04-18T21:05:05.645067+0000","last_unstale":"2024-04-18T21:06:31.685377+0000","last_undegraded":"2024-04-18T21:06:31.685377+0000","last_fullsized":"2024-04-18T21:06:31.685377+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:29:30.243751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":70,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684495+0000","last_change":"2024-04-18T21:05:04.627578+0000","last_active":"2024-04-18T21:06:31.684495+0000","last_peered":"2024-04-18T21:06:31.684495+0000","last_clean":"2024-04-18T21:06:31.684495+0000","last_became_active":"2024-04-18T21:05:04.626786+0000","last_became_peered":"2024-04-18T21:05:04.626786+0000","last_unstale":"2024-04-18T21:06:31.684495+0000","last_undegraded":"2024-04-18T21:06:31.684495+0000","last_fullsized":"2024-04-18T21:06:31.684495+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:55:59.563512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684719+0000","last_change":"2024-04-18T21:05:05.640817+0000","last_active":"2024-04-18T21:06:31.684719+0000","last_peered":"2024-04-18T21:06:31.684719+0000","last_clean":"2024-04-18T21:06:31.684719+0000","last_became_active":"2024-04-18T21:05:05.635526+0000","last_became_peered":"2024-04-18T21:05:05.635526+0000","last_unstale":"2024-04-18T21:06:31.684719+0000","last_undegraded":"2024-04-18T21:06:31.684719+0000","last_fullsized":"2024-04-18T21:06:31.684719+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:44:29.823511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":70,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683954+0000","last_change":"2024-04-18T21:05:04.636499+0000","last_active":"2024-04-18T21:06:31.683954+0000","last_peered":"2024-04-18T21:06:31.683954+0000","last_clean":"2024-04-18T21:06:31.683954+0000","last_became_active":"2024-04-18T21:05:04.635830+0000","last_became_peered":"2024-04-18T21:05:04.635830+0000","last_unstale":"2024-04-18T21:06:31.683954+0000","last_undegraded":"2024-04-18T21:06:31.683954+0000","last_fullsized":"2024-04-18T21:06:31.683954+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:26:30.565175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":66,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.611166+0000","last_change":"2024-04-18T21:05:05.660974+0000","last_active":"2024-04-18T21:06:31.611166+0000","last_peered":"2024-04-18T21:06:31.611166+0000","last_clean":"2024-04-18T21:06:31.611166+0000","last_became_active":"2024-04-18T21:05:05.659287+0000","last_became_peered":"2024-04-18T21:05:05.659287+0000","last_unstale":"2024-04-18T21:06:31.611166+0000","last_undegraded":"2024-04-18T21:06:31.611166+0000","last_fullsized":"2024-04-18T21:06:31.611166+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:50:40.920146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":278,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685300+0000","last_change":"2024-04-18T21:04:54.511605+0000","last_active":"2024-04-18T21:06:31.685300+0000","last_peered":"2024-04-18T21:06:31.685300+0000","last_clean":"2024-04-18T21:06:31.685300+0000","last_became_active":"2024-04-18T21:04:54.510791+0000","last_became_peered":"2024-04-18T21:04:54.510791+0000","last_unstale":"2024-04-18T21:06:31.685300+0000","last_undegraded":"2024-04-18T21:06:31.685300+0000","last_fullsized":"2024-04-18T21:06:31.685300+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_clean_scrub_stamp":"2024-04-18T21:04:53.494814+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:46.262250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":76,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685430+0000","last_change":"2024-04-18T21:05:00.576671+0000","last_active":"2024-04-18T21:06:31.685430+0000","last_peered":"2024-04-18T21:06:31.685430+0000","last_clean":"2024-04-18T21:06:31.685430+0000","last_became_active":"2024-04-18T21:05:00.575933+0000","last_became_peered":"2024-04-18T21:05:00.575933+0000","last_unstale":"2024-04-18T21:06:31.685430+0000","last_undegraded":"2024-04-18T21:06:31.685430+0000","last_fullsized":"2024-04-18T21:06:31.685430+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:14:59.207959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":37,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684060+0000","last_change":"2024-04-18T21:06:01.034577+0000","last_active":"2024-04-18T21:06:31.684060+0000","last_peered":"2024-04-18T21:06:31.684060+0000","last_clean":"2024-04-18T21:06:31.684060+0000","last_became_active":"2024-04-18T21:06:01.033899+0000","last_became_peered":"2024-04-18T21:06:01.033899+0000","last_unstale":"2024-04-18T21:06:31.684060+0000","last_undegraded":"2024-04-18T21:06:31.684060+0000","last_fullsized":"2024-04-18T21:06:31.684060+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:13:40.375625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685499+0000","last_change":"2024-04-18T21:05:05.647623+0000","last_active":"2024-04-18T21:06:31.685499+0000","last_peered":"2024-04-18T21:06:31.685499+0000","last_clean":"2024-04-18T21:06:31.685499+0000","last_became_active":"2024-04-18T21:05:05.645640+0000","last_became_peered":"2024-04-18T21:05:05.645640+0000","last_unstale":"2024-04-18T21:06:31.685499+0000","last_undegraded":"2024-04-18T21:06:31.685499+0000","last_fullsized":"2024-04-18T21:06:31.685499+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:59.950421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":76,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684023+0000","last_change":"2024-04-18T21:05:00.571960+0000","last_active":"2024-04-18T21:06:31.684023+0000","last_peered":"2024-04-18T21:06:31.684023+0000","last_clean":"2024-04-18T21:06:31.684023+0000","last_became_active":"2024-04-18T21:05:00.571301+0000","last_became_peered":"2024-04-18T21:05:00.571301+0000","last_unstale":"2024-04-18T21:06:31.684023+0000","last_undegraded":"2024-04-18T21:06:31.684023+0000","last_fullsized":"2024-04-18T21:06:31.684023+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:31:59.262440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":37,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683128+0000","last_change":"2024-04-18T21:06:01.033769+0000","last_active":"2024-04-18T21:06:31.683128+0000","last_peered":"2024-04-18T21:06:31.683128+0000","last_clean":"2024-04-18T21:06:31.683128+0000","last_became_active":"2024-04-18T21:06:01.033157+0000","last_became_peered":"2024-04-18T21:06:01.033157+0000","last_unstale":"2024-04-18T21:06:31.683128+0000","last_undegraded":"2024-04-18T21:06:31.683128+0000","last_fullsized":"2024-04-18T21:06:31.683128+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:42:40.133263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685798+0000","last_change":"2024-04-18T21:05:05.654121+0000","last_active":"2024-04-18T21:06:31.685798+0000","last_peered":"2024-04-18T21:06:31.685798+0000","last_clean":"2024-04-18T21:06:31.685798+0000","last_became_active":"2024-04-18T21:05:05.651310+0000","last_became_peered":"2024-04-18T21:05:05.651310+0000","last_unstale":"2024-04-18T21:06:31.685798+0000","last_undegraded":"2024-04-18T21:06:31.685798+0000","last_fullsized":"2024-04-18T21:06:31.685798+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:01.841786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":74,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.610111+0000","last_change":"2024-04-18T21:05:00.578604+0000","last_active":"2024-04-18T21:06:31.610111+0000","last_peered":"2024-04-18T21:06:31.610111+0000","last_clean":"2024-04-18T21:06:31.610111+0000","last_became_active":"2024-04-18T21:05:00.577988+0000","last_became_peered":"2024-04-18T21:05:00.577988+0000","last_unstale":"2024-04-18T21:06:31.610111+0000","last_undegraded":"2024-04-18T21:06:31.610111+0000","last_fullsized":"2024-04-18T21:06:31.610111+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:54:54.201759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":70,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683966+0000","last_change":"2024-04-18T21:05:04.627627+0000","last_active":"2024-04-18T21:06:31.683966+0000","last_peered":"2024-04-18T21:06:31.683966+0000","last_clean":"2024-04-18T21:06:31.683966+0000","last_became_active":"2024-04-18T21:05:04.626850+0000","last_became_peered":"2024-04-18T21:05:04.626850+0000","last_unstale":"2024-04-18T21:06:31.683966+0000","last_undegraded":"2024-04-18T21:06:31.683966+0000","last_fullsized":"2024-04-18T21:06:31.683966+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:43:31.453080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":66,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.611206+0000","last_change":"2024-04-18T21:05:05.661488+0000","last_active":"2024-04-18T21:06:31.611206+0000","last_peered":"2024-04-18T21:06:31.611206+0000","last_clean":"2024-04-18T21:06:31.611206+0000","last_became_active":"2024-04-18T21:05:05.660283+0000","last_became_peered":"2024-04-18T21:05:05.660283+0000","last_unstale":"2024-04-18T21:06:31.611206+0000","last_undegraded":"2024-04-18T21:06:31.611206+0000","last_fullsized":"2024-04-18T21:06:31.611206+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:04.350492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":76,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685050+0000","last_change":"2024-04-18T21:05:00.576606+0000","last_active":"2024-04-18T21:06:31.685050+0000","last_peered":"2024-04-18T21:06:31.685050+0000","last_clean":"2024-04-18T21:06:31.685050+0000","last_became_active":"2024-04-18T21:05:00.575951+0000","last_became_peered":"2024-04-18T21:05:00.575951+0000","last_unstale":"2024-04-18T21:06:31.685050+0000","last_undegraded":"2024-04-18T21:06:31.685050+0000","last_fullsized":"2024-04-18T21:06:31.685050+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:32:17.612481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":70,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685186+0000","last_change":"2024-04-18T21:05:04.627296+0000","last_active":"2024-04-18T21:06:31.685186+0000","last_peered":"2024-04-18T21:06:31.685186+0000","last_clean":"2024-04-18T21:06:31.685186+0000","last_became_active":"2024-04-18T21:05:04.626801+0000","last_became_peered":"2024-04-18T21:05:04.626801+0000","last_unstale":"2024-04-18T21:06:31.685186+0000","last_undegraded":"2024-04-18T21:06:31.685186+0000","last_fullsized":"2024-04-18T21:06:31.685186+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:46:36.285416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":66,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.610437+0000","last_change":"2024-04-18T21:05:05.655152+0000","last_active":"2024-04-18T21:06:31.610437+0000","last_peered":"2024-04-18T21:06:31.610437+0000","last_clean":"2024-04-18T21:06:31.610437+0000","last_became_active":"2024-04-18T21:05:05.654506+0000","last_became_peered":"2024-04-18T21:05:05.654506+0000","last_unstale":"2024-04-18T21:06:31.610437+0000","last_undegraded":"2024-04-18T21:06:31.610437+0000","last_fullsized":"2024-04-18T21:06:31.610437+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:32:23.929877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":70,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685647+0000","last_change":"2024-04-18T21:05:04.628916+0000","last_active":"2024-04-18T21:06:31.685647+0000","last_peered":"2024-04-18T21:06:31.685647+0000","last_clean":"2024-04-18T21:06:31.685647+0000","last_became_active":"2024-04-18T21:05:04.628245+0000","last_became_peered":"2024-04-18T21:05:04.628245+0000","last_unstale":"2024-04-18T21:06:31.685647+0000","last_undegraded":"2024-04-18T21:06:31.685647+0000","last_fullsized":"2024-04-18T21:06:31.685647+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:34:58.562540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685320+0000","last_change":"2024-04-18T21:06:01.036156+0000","last_active":"2024-04-18T21:06:31.685320+0000","last_peered":"2024-04-18T21:06:31.685320+0000","last_clean":"2024-04-18T21:06:31.685320+0000","last_became_active":"2024-04-18T21:06:01.035478+0000","last_became_peered":"2024-04-18T21:06:01.035478+0000","last_unstale":"2024-04-18T21:06:31.685320+0000","last_undegraded":"2024-04-18T21:06:31.685320+0000","last_fullsized":"2024-04-18T21:06:31.685320+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:25:04.260649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684418+0000","last_change":"2024-04-18T21:05:05.646076+0000","last_active":"2024-04-18T21:06:31.684418+0000","last_peered":"2024-04-18T21:06:31.684418+0000","last_clean":"2024-04-18T21:06:31.684418+0000","last_became_active":"2024-04-18T21:05:05.645104+0000","last_became_peered":"2024-04-18T21:05:05.645104+0000","last_unstale":"2024-04-18T21:06:31.684418+0000","last_undegraded":"2024-04-18T21:06:31.684418+0000","last_fullsized":"2024-04-18T21:06:31.684418+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:34:38.427319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":68,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.610945+0000","last_change":"2024-04-18T21:05:04.639700+0000","last_active":"2024-04-18T21:06:31.610945+0000","last_peered":"2024-04-18T21:06:31.610945+0000","last_clean":"2024-04-18T21:06:31.610945+0000","last_became_active":"2024-04-18T21:05:04.638928+0000","last_became_peered":"2024-04-18T21:05:04.638928+0000","last_unstale":"2024-04-18T21:06:31.610945+0000","last_undegraded":"2024-04-18T21:06:31.610945+0000","last_fullsized":"2024-04-18T21:06:31.610945+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:00:08.877854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":76,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.686247+0000","last_change":"2024-04-18T21:05:00.576907+0000","last_active":"2024-04-18T21:06:31.686247+0000","last_peered":"2024-04-18T21:06:31.686247+0000","last_clean":"2024-04-18T21:06:31.686247+0000","last_became_active":"2024-04-18T21:05:00.576152+0000","last_became_peered":"2024-04-18T21:05:00.576152+0000","last_unstale":"2024-04-18T21:06:31.686247+0000","last_undegraded":"2024-04-18T21:06:31.686247+0000","last_fullsized":"2024-04-18T21:06:31.686247+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:25:07.270023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684849+0000","last_change":"2024-04-18T21:05:05.646026+0000","last_active":"2024-04-18T21:06:31.684849+0000","last_peered":"2024-04-18T21:06:31.684849+0000","last_clean":"2024-04-18T21:06:31.684849+0000","last_became_active":"2024-04-18T21:05:05.645192+0000","last_became_peered":"2024-04-18T21:05:05.645192+0000","last_unstale":"2024-04-18T21:06:31.684849+0000","last_undegraded":"2024-04-18T21:06:31.684849+0000","last_fullsized":"2024-04-18T21:06:31.684849+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:05:46.009381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":70,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.611585+0000","last_change":"2024-04-18T21:05:04.640732+0000","last_active":"2024-04-18T21:06:31.611585+0000","last_peered":"2024-04-18T21:06:31.611585+0000","last_clean":"2024-04-18T21:06:31.611585+0000","last_became_active":"2024-04-18T21:05:04.638505+0000","last_became_peered":"2024-04-18T21:05:04.638505+0000","last_unstale":"2024-04-18T21:06:31.611585+0000","last_undegraded":"2024-04-18T21:06:31.611585+0000","last_fullsized":"2024-04-18T21:06:31.611585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:34:58.562540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.686102+0000","last_change":"2024-04-18T21:06:01.036362+0000","last_active":"2024-04-18T21:06:31.686102+0000","last_peered":"2024-04-18T21:06:31.686102+0000","last_clean":"2024-04-18T21:06:31.686102+0000","last_became_active":"2024-04-18T21:06:01.035483+0000","last_became_peered":"2024-04-18T21:06:01.035483+0000","last_unstale":"2024-04-18T21:06:31.686102+0000","last_undegraded":"2024-04-18T21:06:31.686102+0000","last_fullsized":"2024-04-18T21:06:31.686102+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:42:36.106273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":37,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.682828+0000","last_change":"2024-04-18T21:06:01.032606+0000","last_active":"2024-04-18T21:06:31.682828+0000","last_peered":"2024-04-18T21:06:31.682828+0000","last_clean":"2024-04-18T21:06:31.682828+0000","last_became_active":"2024-04-18T21:06:01.032092+0000","last_became_peered":"2024-04-18T21:06:01.032092+0000","last_unstale":"2024-04-18T21:06:31.682828+0000","last_undegraded":"2024-04-18T21:06:31.682828+0000","last_fullsized":"2024-04-18T21:06:31.682828+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:14:08.347445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"21'3","reported_seq":71,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.611416+0000","last_change":"2024-04-18T21:05:04.639898+0000","last_active":"2024-04-18T21:06:31.611416+0000","last_peered":"2024-04-18T21:06:31.611416+0000","last_clean":"2024-04-18T21:06:31.611416+0000","last_became_active":"2024-04-18T21:05:04.639115+0000","last_became_peered":"2024-04-18T21:05:04.639115+0000","last_unstale":"2024-04-18T21:06:31.611416+0000","last_undegraded":"2024-04-18T21:06:31.611416+0000","last_fullsized":"2024-04-18T21:06:31.611416+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:44:19.076499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":76,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685205+0000","last_change":"2024-04-18T21:05:00.572414+0000","last_active":"2024-04-18T21:06:31.685205+0000","last_peered":"2024-04-18T21:06:31.685205+0000","last_clean":"2024-04-18T21:06:31.685205+0000","last_became_active":"2024-04-18T21:05:00.571755+0000","last_became_peered":"2024-04-18T21:05:00.571755+0000","last_unstale":"2024-04-18T21:06:31.685205+0000","last_undegraded":"2024-04-18T21:06:31.685205+0000","last_fullsized":"2024-04-18T21:06:31.685205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:15:02.061128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684067+0000","last_change":"2024-04-18T21:05:05.655898+0000","last_active":"2024-04-18T21:06:31.684067+0000","last_peered":"2024-04-18T21:06:31.684067+0000","last_clean":"2024-04-18T21:06:31.684067+0000","last_became_active":"2024-04-18T21:05:05.654111+0000","last_became_peered":"2024-04-18T21:05:05.654111+0000","last_unstale":"2024-04-18T21:06:31.684067+0000","last_undegraded":"2024-04-18T21:06:31.684067+0000","last_fullsized":"2024-04-18T21:06:31.684067+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:19:38.537080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684675+0000","last_change":"2024-04-18T21:05:05.641373+0000","last_active":"2024-04-18T21:06:31.684675+0000","last_peered":"2024-04-18T21:06:31.684675+0000","last_clean":"2024-04-18T21:06:31.684675+0000","last_became_active":"2024-04-18T21:05:05.634204+0000","last_became_peered":"2024-04-18T21:05:05.634204+0000","last_unstale":"2024-04-18T21:06:31.684675+0000","last_undegraded":"2024-04-18T21:06:31.684675+0000","last_fullsized":"2024-04-18T21:06:31.684675+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:27:35.995004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"21'10","reported_seq":80,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684752+0000","last_change":"2024-04-18T21:05:04.631271+0000","last_active":"2024-04-18T21:06:31.684752+0000","last_peered":"2024-04-18T21:06:31.684752+0000","last_clean":"2024-04-18T21:06:31.684752+0000","last_became_active":"2024-04-18T21:05:04.630442+0000","last_became_peered":"2024-04-18T21:05:04.630442+0000","last_unstale":"2024-04-18T21:06:31.684752+0000","last_undegraded":"2024-04-18T21:06:31.684752+0000","last_fullsized":"2024-04-18T21:06:31.684752+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:33:48.703994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":66,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.609539+0000","last_change":"2024-04-18T21:05:05.637894+0000","last_active":"2024-04-18T21:06:31.609539+0000","last_peered":"2024-04-18T21:06:31.609539+0000","last_clean":"2024-04-18T21:06:31.609539+0000","last_became_active":"2024-04-18T21:05:05.636846+0000","last_became_peered":"2024-04-18T21:05:05.636846+0000","last_unstale":"2024-04-18T21:06:31.609539+0000","last_undegraded":"2024-04-18T21:06:31.609539+0000","last_fullsized":"2024-04-18T21:06:31.609539+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:34:31.132458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":73,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.686084+0000","last_change":"2024-04-18T21:05:04.631152+0000","last_active":"2024-04-18T21:06:31.686084+0000","last_peered":"2024-04-18T21:06:31.686084+0000","last_clean":"2024-04-18T21:06:31.686084+0000","last_became_active":"2024-04-18T21:05:04.628900+0000","last_became_peered":"2024-04-18T21:05:04.628900+0000","last_unstale":"2024-04-18T21:06:31.686084+0000","last_undegraded":"2024-04-18T21:06:31.686084+0000","last_fullsized":"2024-04-18T21:06:31.686084+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:40:21.452052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":70,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684987+0000","last_change":"2024-04-18T21:05:04.629470+0000","last_active":"2024-04-18T21:06:31.684987+0000","last_peered":"2024-04-18T21:06:31.684987+0000","last_clean":"2024-04-18T21:06:31.684987+0000","last_became_active":"2024-04-18T21:05:04.628286+0000","last_became_peered":"2024-04-18T21:05:04.628286+0000","last_unstale":"2024-04-18T21:06:31.684987+0000","last_undegraded":"2024-04-18T21:06:31.684987+0000","last_fullsized":"2024-04-18T21:06:31.684987+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:00:08.877854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":66,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.609254+0000","last_change":"2024-04-18T21:05:05.642793+0000","last_active":"2024-04-18T21:06:31.609254+0000","last_peered":"2024-04-18T21:06:31.609254+0000","last_clean":"2024-04-18T21:06:31.609254+0000","last_became_active":"2024-04-18T21:05:05.641983+0000","last_became_peered":"2024-04-18T21:05:05.641983+0000","last_unstale":"2024-04-18T21:06:31.609254+0000","last_undegraded":"2024-04-18T21:06:31.609254+0000","last_fullsized":"2024-04-18T21:06:31.609254+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:46:36.339289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":68,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.611435+0000","last_change":"2024-04-18T21:05:04.641445+0000","last_active":"2024-04-18T21:06:31.611435+0000","last_peered":"2024-04-18T21:06:31.611435+0000","last_clean":"2024-04-18T21:06:31.611435+0000","last_became_active":"2024-04-18T21:05:04.640682+0000","last_became_peered":"2024-04-18T21:05:04.640682+0000","last_unstale":"2024-04-18T21:06:31.611435+0000","last_undegraded":"2024-04-18T21:06:31.611435+0000","last_fullsized":"2024-04-18T21:06:31.611435+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:46:36.285416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":66,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.609295+0000","last_change":"2024-04-18T21:05:05.641561+0000","last_active":"2024-04-18T21:06:31.609295+0000","last_peered":"2024-04-18T21:06:31.609295+0000","last_clean":"2024-04-18T21:06:31.609295+0000","last_became_active":"2024-04-18T21:05:05.640922+0000","last_became_peered":"2024-04-18T21:05:05.640922+0000","last_unstale":"2024-04-18T21:06:31.609295+0000","last_undegraded":"2024-04-18T21:06:31.609295+0000","last_fullsized":"2024-04-18T21:06:31.609295+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:56.408234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.686100+0000","last_change":"2024-04-18T21:05:05.651530+0000","last_active":"2024-04-18T21:06:31.686100+0000","last_peered":"2024-04-18T21:06:31.686100+0000","last_clean":"2024-04-18T21:06:31.686100+0000","last_became_active":"2024-04-18T21:05:05.648167+0000","last_became_peered":"2024-04-18T21:05:05.648167+0000","last_unstale":"2024-04-18T21:06:31.686100+0000","last_undegraded":"2024-04-18T21:06:31.686100+0000","last_fullsized":"2024-04-18T21:06:31.686100+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:14:51.873741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":37,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684257+0000","last_change":"2024-04-18T21:06:01.033325+0000","last_active":"2024-04-18T21:06:31.684257+0000","last_peered":"2024-04-18T21:06:31.684257+0000","last_clean":"2024-04-18T21:06:31.684257+0000","last_became_active":"2024-04-18T21:06:01.032763+0000","last_became_peered":"2024-04-18T21:06:01.032763+0000","last_unstale":"2024-04-18T21:06:31.684257+0000","last_undegraded":"2024-04-18T21:06:31.684257+0000","last_fullsized":"2024-04-18T21:06:31.684257+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:46:21.038602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":37,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684441+0000","last_change":"2024-04-18T21:06:01.034762+0000","last_active":"2024-04-18T21:06:31.684441+0000","last_peered":"2024-04-18T21:06:31.684441+0000","last_clean":"2024-04-18T21:06:31.684441+0000","last_became_active":"2024-04-18T21:06:01.033874+0000","last_became_peered":"2024-04-18T21:06:01.033874+0000","last_unstale":"2024-04-18T21:06:31.684441+0000","last_undegraded":"2024-04-18T21:06:31.684441+0000","last_fullsized":"2024-04-18T21:06:31.684441+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:36:21.285460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":68,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.609593+0000","last_change":"2024-04-18T21:05:04.637597+0000","last_active":"2024-04-18T21:06:31.609593+0000","last_peered":"2024-04-18T21:06:31.609593+0000","last_clean":"2024-04-18T21:06:31.609593+0000","last_became_active":"2024-04-18T21:05:04.636827+0000","last_became_peered":"2024-04-18T21:05:04.636827+0000","last_unstale":"2024-04-18T21:06:31.609593+0000","last_undegraded":"2024-04-18T21:06:31.609593+0000","last_fullsized":"2024-04-18T21:06:31.609593+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:43.511952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685121+0000","last_change":"2024-04-18T21:05:05.658971+0000","last_active":"2024-04-18T21:06:31.685121+0000","last_peered":"2024-04-18T21:06:31.685121+0000","last_clean":"2024-04-18T21:06:31.685121+0000","last_became_active":"2024-04-18T21:05:05.658363+0000","last_became_peered":"2024-04-18T21:05:05.658363+0000","last_unstale":"2024-04-18T21:06:31.685121+0000","last_undegraded":"2024-04-18T21:06:31.685121+0000","last_fullsized":"2024-04-18T21:06:31.685121+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:12.944469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":71,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684757+0000","last_change":"2024-04-18T21:05:04.636585+0000","last_active":"2024-04-18T21:06:31.684757+0000","last_peered":"2024-04-18T21:06:31.684757+0000","last_clean":"2024-04-18T21:06:31.684757+0000","last_became_active":"2024-04-18T21:05:04.635670+0000","last_became_peered":"2024-04-18T21:05:04.635670+0000","last_unstale":"2024-04-18T21:06:31.684757+0000","last_undegraded":"2024-04-18T21:06:31.684757+0000","last_fullsized":"2024-04-18T21:06:31.684757+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:34:33.779063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684825+0000","last_change":"2024-04-18T21:05:05.649960+0000","last_active":"2024-04-18T21:06:31.684825+0000","last_peered":"2024-04-18T21:06:31.684825+0000","last_clean":"2024-04-18T21:06:31.684825+0000","last_became_active":"2024-04-18T21:05:05.648528+0000","last_became_peered":"2024-04-18T21:05:05.648528+0000","last_unstale":"2024-04-18T21:06:31.684825+0000","last_undegraded":"2024-04-18T21:06:31.684825+0000","last_fullsized":"2024-04-18T21:06:31.684825+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:20:45.938503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":71,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685668+0000","last_change":"2024-04-18T21:05:04.630151+0000","last_active":"2024-04-18T21:06:31.685668+0000","last_peered":"2024-04-18T21:06:31.685668+0000","last_clean":"2024-04-18T21:06:31.685668+0000","last_became_active":"2024-04-18T21:05:04.627968+0000","last_became_peered":"2024-04-18T21:05:04.627968+0000","last_unstale":"2024-04-18T21:06:31.685668+0000","last_undegraded":"2024-04-18T21:06:31.685668+0000","last_fullsized":"2024-04-18T21:06:31.685668+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:00:33.393636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684404+0000","last_change":"2024-04-18T21:05:05.624840+0000","last_active":"2024-04-18T21:06:31.684404+0000","last_peered":"2024-04-18T21:06:31.684404+0000","last_clean":"2024-04-18T21:06:31.684404+0000","last_became_active":"2024-04-18T21:05:05.622950+0000","last_became_peered":"2024-04-18T21:05:05.622950+0000","last_unstale":"2024-04-18T21:06:31.684404+0000","last_undegraded":"2024-04-18T21:06:31.684404+0000","last_fullsized":"2024-04-18T21:06:31.684404+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:27:17.530889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":72,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684479+0000","last_change":"2024-04-18T21:05:04.626715+0000","last_active":"2024-04-18T21:06:31.684479+0000","last_peered":"2024-04-18T21:06:31.684479+0000","last_clean":"2024-04-18T21:06:31.684479+0000","last_became_active":"2024-04-18T21:05:04.625270+0000","last_became_peered":"2024-04-18T21:05:04.625270+0000","last_unstale":"2024-04-18T21:06:31.684479+0000","last_undegraded":"2024-04-18T21:06:31.684479+0000","last_fullsized":"2024-04-18T21:06:31.684479+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:43.511952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684241+0000","last_change":"2024-04-18T21:05:05.627962+0000","last_active":"2024-04-18T21:06:31.684241+0000","last_peered":"2024-04-18T21:06:31.684241+0000","last_clean":"2024-04-18T21:06:31.684241+0000","last_became_active":"2024-04-18T21:05:05.626698+0000","last_became_peered":"2024-04-18T21:05:05.626698+0000","last_unstale":"2024-04-18T21:06:31.684241+0000","last_undegraded":"2024-04-18T21:06:31.684241+0000","last_fullsized":"2024-04-18T21:06:31.684241+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:48:48.973087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":72,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.685682+0000","last_change":"2024-04-18T21:05:04.632776+0000","last_active":"2024-04-18T21:06:31.685682+0000","last_peered":"2024-04-18T21:06:31.685682+0000","last_clean":"2024-04-18T21:06:31.685682+0000","last_became_active":"2024-04-18T21:05:04.630142+0000","last_became_peered":"2024-04-18T21:05:04.630142+0000","last_unstale":"2024-04-18T21:06:31.685682+0000","last_undegraded":"2024-04-18T21:06:31.685682+0000","last_fullsized":"2024-04-18T21:06:31.685682+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:19:36.721897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.684760+0000","last_change":"2024-04-18T21:05:05.653025+0000","last_active":"2024-04-18T21:06:31.684760+0000","last_peered":"2024-04-18T21:06:31.684760+0000","last_clean":"2024-04-18T21:06:31.684760+0000","last_became_active":"2024-04-18T21:05:05.645039+0000","last_became_peered":"2024-04-18T21:05:05.645039+0000","last_unstale":"2024-04-18T21:06:31.684760+0000","last_undegraded":"2024-04-18T21:06:31.684760+0000","last_fullsized":"2024-04-18T21:06:31.684760+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":69,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.611266+0000","last_change":"2024-04-18T21:05:04.640134+0000","last_active":"2024-04-18T21:06:31.611266+0000","last_peered":"2024-04-18T21:06:31.611266+0000","last_clean":"2024-04-18T21:06:31.611266+0000","last_became_active":"2024-04-18T21:05:04.638597+0000","last_became_peered":"2024-04-18T21:05:04.638597+0000","last_unstale":"2024-04-18T21:06:31.611266+0000","last_undegraded":"2024-04-18T21:06:31.611266+0000","last_fullsized":"2024-04-18T21:06:31.611266+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:56:05.795125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.683778+0000","last_change":"2024-04-18T21:05:05.629022+0000","last_active":"2024-04-18T21:06:31.683778+0000","last_peered":"2024-04-18T21:06:31.683778+0000","last_clean":"2024-04-18T21:06:31.683778+0000","last_became_active":"2024-04-18T21:05:05.627643+0000","last_became_peered":"2024-04-18T21:05:05.627643+0000","last_unstale":"2024-04-18T21:06:31.683778+0000","last_undegraded":"2024-04-18T21:06:31.683778+0000","last_fullsized":"2024-04-18T21:06:31.683778+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:32:23.929877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":72,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-18T21:06:31.611308+0000","last_change":"2024-04-18T21:05:04.641338+0000","last_active":"2024-04-18T21:06:31.611308+0000","last_peered":"2024-04-18T21:06:31.611308+0000","last_clean":"2024-04-18T21:06:31.611308+0000","last_became_active":"2024-04-18T21:05:04.639958+0000","last_became_peered":"2024-04-18T21:05:04.639958+0000","last_unstale":"2024-04-18T21:06:31.611308+0000","last_undegraded":"2024-04-18T21:06:31.611308+0000","last_fullsized":"2024-04-18T21:06:31.611308+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:42:45.392908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7351,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738392,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35716,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336124,"statfs":{"total":96636764160,"available":96600190976,"internally_reserved":0,"allocated":385024,"data_stored":169652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738392,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32168,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339672,"statfs":{"total":96636764160,"available":96603824128,"internally_reserved":0,"allocated":1007616,"data_stored":770371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738390,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1015808,"data_stored":770987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:06:34.493 INFO:tasks.thrashosds.thrasher:Setting 4.2 to [2, 0, 1] 2024-04-18T21:06:34.493 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '4.2', '2', '0', '1'] 2024-04-18T21:06:34.493 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 4.2 2 0 1 2024-04-18T21:06:34.494 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:34.494 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:34.504 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:34.507 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:34.506+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:34.607 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:34.606+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:34.667 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:34.667 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:34.683 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:34.688 INFO:teuthology.orchestra.run.smithi078.stderr:noscrub is set 2024-04-18T21:06:34.729 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:34.730+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:34.809 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:34.806+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:34.815 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:34.815 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:34.829 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:34.840 INFO:teuthology.orchestra.run.smithi078.stderr:Error EINVAL: you must specify pairs of osd ids to be remapped 2024-04-18T21:06:34.845 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-18T21:06:34.846 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2024-04-18T21:06:34.909 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:34.910+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:34.993 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:34.993 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:35.007 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:35.010 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:35.010+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:35.111 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:35.110+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:35.123 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:35.123 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:35.137 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:35.212 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:35.215+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:35.267 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:35.267 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:35.281 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:35.313 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:35.314+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:35.397 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:35.397 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:35.411 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:35.413 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:35.414+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:35.484 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:06:35.514 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:35.510+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:35.529 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:35.529 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:35.543 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:35.615 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:35.614+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:35.619 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:06:35.619 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:06:35.639 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1: {} 2024-04-18T21:06:35.639 INFO:teuthology.orchestra.run.smithi078.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:06:35.660 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:06:35.660 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:35.675 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:06:35.675 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [], 2024-04-18T21:06:35.675 INFO:teuthology.orchestra.run.smithi150.stdout: "num_ops": 0 2024-04-18T21:06:35.676 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:06:35.689 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:35.716 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:35.718+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:35.811 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:06:35.811 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [], 2024-04-18T21:06:35.811 INFO:teuthology.orchestra.run.smithi150.stdout: "complaint_time": 30, 2024-04-18T21:06:35.811 INFO:teuthology.orchestra.run.smithi150.stdout: "num_blocked_ops": 0 2024-04-18T21:06:35.811 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:06:35.817 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:35.818+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:35.827 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:35.918 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:35.918+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:35.952 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:06:35.953 INFO:teuthology.orchestra.run.smithi150.stdout: "size": 20, 2024-04-18T21:06:35.953 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 600, 2024-04-18T21:06:35.953 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [ 2024-04-18T21:06:35.953 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.953 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-18T21:06:35.953 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:06:35.953 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 101.148050196, 2024-04-18T21:06:35.953 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0093051590000000003, 2024-04-18T21:06:35.953 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:35.953 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:35.953 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:35.953 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:35.954 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.954 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:35.954 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:06:35.954 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:35.954 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.954 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.954 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:35.954 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:06:35.954 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:35.954 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.954 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.954 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:35.954 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804851+0000", 2024-04-18T21:06:35.955 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7039999999999999e-06 2024-04-18T21:06:35.955 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.955 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.955 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:35.955 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804864+0000", 2024-04-18T21:06:35.955 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.276e-05 2024-04-18T21:06:35.955 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.955 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.955 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:35.955 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804895+0000", 2024-04-18T21:06:35.955 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.1204999999999997e-05 2024-04-18T21:06:35.955 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.955 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.955 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:35.955 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804908+0000", 2024-04-18T21:06:35.956 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3317e-05 2024-04-18T21:06:35.956 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.956 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.956 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:35.956 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805131+0000", 2024-04-18T21:06:35.956 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00022246700000000001 2024-04-18T21:06:35.956 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.956 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.956 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:35.956 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805171+0000", 2024-04-18T21:06:35.956 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.0164999999999999e-05 2024-04-18T21:06:35.956 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.956 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.956 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:35.956 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814086+0000", 2024-04-18T21:06:35.957 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0089155329999999998 2024-04-18T21:06:35.957 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.957 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.957 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:35.957 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814154+0000", 2024-04-18T21:06:35.957 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.8008000000000003e-05 2024-04-18T21:06:35.957 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:35.957 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:35.957 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:35.957 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.957 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.957 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-18T21:06:35.957 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:06:35.957 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 101.14728500299999, 2024-04-18T21:06:35.957 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0086469770000000001, 2024-04-18T21:06:35.958 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:35.958 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:35.958 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:35.958 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:35.958 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.958 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:35.958 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:06:35.958 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:35.958 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.958 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.958 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:35.958 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:06:35.958 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:35.958 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.959 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.959 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:35.959 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805616+0000", 2024-04-18T21:06:35.959 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7799999999999999e-06 2024-04-18T21:06:35.959 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.959 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.959 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:35.959 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805707+0000", 2024-04-18T21:06:35.959 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0917999999999999e-05 2024-04-18T21:06:35.959 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.959 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.959 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:35.959 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805739+0000", 2024-04-18T21:06:35.959 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.2512000000000003e-05 2024-04-18T21:06:35.960 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.960 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.960 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:35.960 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805763+0000", 2024-04-18T21:06:35.960 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3266000000000001e-05 2024-04-18T21:06:35.960 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.960 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.960 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:35.960 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.806024+0000", 2024-04-18T21:06:35.960 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000261716 2024-04-18T21:06:35.960 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.960 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.960 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:35.960 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.806073+0000", 2024-04-18T21:06:35.961 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.8844999999999997e-05 2024-04-18T21:06:35.961 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.961 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.961 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:35.961 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814162+0000", 2024-04-18T21:06:35.961 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0080882860000000001 2024-04-18T21:06:35.961 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.961 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.961 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:35.961 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814261+0000", 2024-04-18T21:06:35.961 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.9654000000000005e-05 2024-04-18T21:06:35.961 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:35.961 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:35.961 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:35.962 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.962 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.962 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'64)", 2024-04-18T21:06:35.962 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:06:35.962 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 101.145513959, 2024-04-18T21:06:35.962 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0089721509999999994, 2024-04-18T21:06:35.962 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:35.962 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:35.962 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:35.962 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:35.962 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.963 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:35.963 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:06:35.963 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:35.963 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.963 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.963 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:35.963 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:06:35.963 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:35.963 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.963 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.963 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:35.963 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807387+0000", 2024-04-18T21:06:35.963 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.0329999999999998e-06 2024-04-18T21:06:35.963 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.964 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.964 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:35.964 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807443+0000", 2024-04-18T21:06:35.964 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.5376e-05 2024-04-18T21:06:35.964 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.964 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.964 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:35.964 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807467+0000", 2024-04-18T21:06:35.964 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.4621999999999999e-05 2024-04-18T21:06:35.964 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.964 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.964 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:35.964 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807482+0000", 2024-04-18T21:06:35.964 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.436e-05 2024-04-18T21:06:35.964 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.964 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.965 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:35.965 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.809243+0000", 2024-04-18T21:06:35.965 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001761725 2024-04-18T21:06:35.965 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.965 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.965 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:35.965 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.809295+0000", 2024-04-18T21:06:35.965 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.1445e-05 2024-04-18T21:06:35.965 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.965 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.965 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:35.965 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.816293+0000", 2024-04-18T21:06:35.965 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0069981749999999997 2024-04-18T21:06:35.965 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.966 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.966 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:35.966 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.816357+0000", 2024-04-18T21:06:35.966 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.4414999999999999e-05 2024-04-18T21:06:35.966 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:35.966 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:35.966 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:35.966 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.966 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.966 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:35.966 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:06:35.966 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 90.337604588999994, 2024-04-18T21:06:35.966 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.040843365, 2024-04-18T21:06:35.967 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:35.967 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:35.967 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:35.967 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:35.967 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.967 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:35.967 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:06:35.967 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:35.967 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.967 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.967 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:35.967 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:06:35.967 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:35.967 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.967 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.968 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:35.968 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615297+0000", 2024-04-18T21:06:35.968 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2800000000000002e-06 2024-04-18T21:06:35.968 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.968 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.968 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:35.968 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615308+0000", 2024-04-18T21:06:35.968 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0813e-05 2024-04-18T21:06:35.968 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.968 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.968 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:35.968 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615330+0000", 2024-04-18T21:06:35.968 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2370000000000001e-05 2024-04-18T21:06:35.968 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.968 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.969 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:35.969 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615346+0000", 2024-04-18T21:06:35.969 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6200000000000001e-05 2024-04-18T21:06:35.969 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.969 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.969 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:35.969 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615470+0000", 2024-04-18T21:06:35.969 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012385799999999999 2024-04-18T21:06:35.969 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.969 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.969 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:35.969 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615488+0000", 2024-04-18T21:06:35.969 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7923000000000001e-05 2024-04-18T21:06:35.969 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.970 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.970 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:35.970 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.630993+0000", 2024-04-18T21:06:35.970 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.01550532 2024-04-18T21:06:35.970 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.970 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.970 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:35.970 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631165+0000", 2024-04-18T21:06:35.970 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000171588 2024-04-18T21:06:35.970 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.970 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.970 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:35.970 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631320+0000", 2024-04-18T21:06:35.970 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000155162 2024-04-18T21:06:35.971 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.971 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.971 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:35.971 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635157+0000", 2024-04-18T21:06:35.971 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0038370790000000002 2024-04-18T21:06:35.971 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.971 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.971 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:35.971 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.655904+0000", 2024-04-18T21:06:35.971 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.020746483999999999 2024-04-18T21:06:35.971 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.971 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.971 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:35.971 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656032+0000", 2024-04-18T21:06:35.972 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012864199999999999 2024-04-18T21:06:35.972 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.972 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.972 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:35.972 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656138+0000", 2024-04-18T21:06:35.972 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000105646 2024-04-18T21:06:35.972 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:35.972 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:35.972 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:35.972 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.972 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.972 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:35.972 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:06:35.972 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 90.337512416999999, 2024-04-18T21:06:35.972 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.041266444999999999, 2024-04-18T21:06:35.973 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:35.973 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:35.973 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:35.973 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:35.973 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.973 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:35.973 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:06:35.973 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:35.973 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.973 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.973 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:35.973 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:06:35.973 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:35.973 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.973 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.974 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:35.974 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615388+0000", 2024-04-18T21:06:35.974 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:06:35.974 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.974 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.974 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:35.974 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:06:35.974 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.7299999999999994e-06 2024-04-18T21:06:35.974 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.974 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.974 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:35.974 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615415+0000", 2024-04-18T21:06:35.974 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7807000000000001e-05 2024-04-18T21:06:35.975 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.975 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.975 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:35.975 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615431+0000", 2024-04-18T21:06:35.975 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6127e-05 2024-04-18T21:06:35.975 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.975 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.975 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:35.975 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615621+0000", 2024-04-18T21:06:35.975 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000189781 2024-04-18T21:06:35.975 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.975 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.975 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:35.975 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615634+0000", 2024-04-18T21:06:35.975 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3383e-05 2024-04-18T21:06:35.976 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.976 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.976 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:35.976 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631703+0000", 2024-04-18T21:06:35.976 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016068737 2024-04-18T21:06:35.976 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.976 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.976 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:35.976 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631809+0000", 2024-04-18T21:06:35.976 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000106823 2024-04-18T21:06:35.976 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.976 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.976 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:35.976 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631988+0000", 2024-04-18T21:06:35.977 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000179008 2024-04-18T21:06:35.977 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.977 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.977 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:35.977 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635172+0000", 2024-04-18T21:06:35.977 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.003183029 2024-04-18T21:06:35.977 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.977 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.977 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:35.977 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656392+0000", 2024-04-18T21:06:35.977 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.021220638999999999 2024-04-18T21:06:35.977 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.977 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.977 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:35.978 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656533+0000", 2024-04-18T21:06:35.978 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014126500000000001 2024-04-18T21:06:35.978 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.978 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.978 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:35.978 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656653+0000", 2024-04-18T21:06:35.978 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000119883 2024-04-18T21:06:35.978 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:35.978 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:35.978 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:35.978 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.978 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.978 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:35.978 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:06:35.979 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 90.337424994000003, 2024-04-18T21:06:35.979 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.042492302000000003, 2024-04-18T21:06:35.979 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:35.979 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:35.979 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:35.979 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:35.979 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.979 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:35.979 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:06:35.979 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:35.979 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.979 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.979 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:35.979 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:06:35.979 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:35.979 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.980 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.980 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:35.980 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615475+0000", 2024-04-18T21:06:35.980 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.17e-06 2024-04-18T21:06:35.980 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.980 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.980 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:35.980 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615528+0000", 2024-04-18T21:06:35.980 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.2159e-05 2024-04-18T21:06:35.980 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.980 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.980 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:35.980 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615542+0000", 2024-04-18T21:06:35.980 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4197e-05 2024-04-18T21:06:35.980 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.981 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.981 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:35.981 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615559+0000", 2024-04-18T21:06:35.981 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.749e-05 2024-04-18T21:06:35.981 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.981 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.981 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:35.981 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615685+0000", 2024-04-18T21:06:35.981 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012617499999999999 2024-04-18T21:06:35.981 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.981 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.981 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:35.981 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:06:35.981 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4749999999999999e-05 2024-04-18T21:06:35.981 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.982 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.982 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:35.982 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632332+0000", 2024-04-18T21:06:35.982 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016631988 2024-04-18T21:06:35.982 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.982 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.982 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:35.982 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632477+0000", 2024-04-18T21:06:35.982 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014437200000000001 2024-04-18T21:06:35.982 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.982 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.982 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:35.982 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632620+0000", 2024-04-18T21:06:35.983 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000143566 2024-04-18T21:06:35.983 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.983 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.983 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:35.983 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635185+0000", 2024-04-18T21:06:35.983 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0025644209999999999 2024-04-18T21:06:35.983 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.983 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.983 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:35.983 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657803+0000", 2024-04-18T21:06:35.983 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.022618743 2024-04-18T21:06:35.983 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.983 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.983 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:35.984 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657890+0000", 2024-04-18T21:06:35.984 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.6688999999999996e-05 2024-04-18T21:06:35.984 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.984 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.984 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:35.984 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657967+0000", 2024-04-18T21:06:35.984 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.6582000000000006e-05 2024-04-18T21:06:35.984 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:35.984 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:35.984 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:35.984 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.984 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.984 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:35.984 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:06:35.985 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 90.337294181999994, 2024-04-18T21:06:35.985 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.043603435000000003, 2024-04-18T21:06:35.985 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:35.985 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:35.985 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:35.985 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:35.985 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.985 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:35.985 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:06:35.985 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:35.985 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.985 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.985 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:35.985 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:06:35.985 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:35.986 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.986 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.986 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:35.986 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615607+0000", 2024-04-18T21:06:35.986 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4300000000000001e-06 2024-04-18T21:06:35.986 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.986 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.986 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:35.986 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615614+0000", 2024-04-18T21:06:35.986 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.4100000000000002e-06 2024-04-18T21:06:35.986 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.986 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.986 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:35.986 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615632+0000", 2024-04-18T21:06:35.986 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7863000000000002e-05 2024-04-18T21:06:35.987 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.987 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.987 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:35.987 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615647+0000", 2024-04-18T21:06:35.987 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5187e-05 2024-04-18T21:06:35.987 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.987 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.987 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:35.987 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615765+0000", 2024-04-18T21:06:35.987 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000117955 2024-04-18T21:06:35.987 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.987 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.987 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:35.987 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615781+0000", 2024-04-18T21:06:35.988 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6123000000000001e-05 2024-04-18T21:06:35.988 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.988 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.988 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:35.988 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633055+0000", 2024-04-18T21:06:35.988 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.017273909 2024-04-18T21:06:35.988 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.988 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.988 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:35.988 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633254+0000", 2024-04-18T21:06:35.988 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00019903799999999999 2024-04-18T21:06:35.988 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.988 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.988 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:35.988 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633624+0000", 2024-04-18T21:06:35.989 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000369656 2024-04-18T21:06:35.989 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.989 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.989 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:35.989 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635595+0000", 2024-04-18T21:06:35.989 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001971287 2024-04-18T21:06:35.989 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.989 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.989 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:35.989 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659026+0000", 2024-04-18T21:06:35.989 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.023431495 2024-04-18T21:06:35.989 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.989 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.989 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:35.989 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659117+0000", 2024-04-18T21:06:35.989 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0885999999999997e-05 2024-04-18T21:06:35.990 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.990 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.990 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:35.990 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659209+0000", 2024-04-18T21:06:35.990 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.1195999999999999e-05 2024-04-18T21:06:35.990 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:35.990 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:35.990 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:35.990 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.990 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.990 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:35.990 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:35.990 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 90.337228952999993, 2024-04-18T21:06:35.991 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.03492514, 2024-04-18T21:06:35.991 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:35.991 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:35.991 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:35.991 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:35.991 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.991 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:35.991 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:35.991 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:35.991 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.991 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.991 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:35.991 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:35.991 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:35.991 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.991 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.992 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:35.992 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:06:35.992 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.407e-06 2024-04-18T21:06:35.992 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.992 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.992 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:35.992 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615679+0000", 2024-04-18T21:06:35.992 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.2130000000000002e-06 2024-04-18T21:06:35.992 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.992 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.992 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:35.992 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615701+0000", 2024-04-18T21:06:35.992 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2316000000000001e-05 2024-04-18T21:06:35.992 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.992 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.993 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:35.993 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615717+0000", 2024-04-18T21:06:35.993 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6197000000000001e-05 2024-04-18T21:06:35.993 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.993 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.993 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:35.993 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615828+0000", 2024-04-18T21:06:35.993 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000110899 2024-04-18T21:06:35.993 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.993 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.993 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:35.993 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615840+0000", 2024-04-18T21:06:35.993 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.1423000000000001e-05 2024-04-18T21:06:35.994 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.994 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.994 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:35.994 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628046+0000", 2024-04-18T21:06:35.994 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.012206295000000001 2024-04-18T21:06:35.994 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.994 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.994 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:35.994 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628323+0000", 2024-04-18T21:06:35.994 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00027658700000000001 2024-04-18T21:06:35.994 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.994 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.994 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:35.994 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628599+0000", 2024-04-18T21:06:35.994 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00027676699999999997 2024-04-18T21:06:35.995 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.995 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.995 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:35.995 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634869+0000", 2024-04-18T21:06:35.995 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.006269536 2024-04-18T21:06:35.995 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.995 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.995 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:35.995 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650333+0000", 2024-04-18T21:06:35.995 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.015463645999999999 2024-04-18T21:06:35.995 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.995 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.995 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:35.995 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650474+0000", 2024-04-18T21:06:35.995 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014091799999999999 2024-04-18T21:06:35.995 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.996 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.996 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:35.996 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650595+0000", 2024-04-18T21:06:35.996 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012193600000000001 2024-04-18T21:06:35.996 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:35.996 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:35.996 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:35.996 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.996 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.996 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:35.996 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:06:35.996 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 90.337143843999996, 2024-04-18T21:06:35.996 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.040588320999999997, 2024-04-18T21:06:35.996 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:35.997 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:35.997 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:35.997 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:35.997 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.997 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:35.997 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:06:35.997 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:35.997 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.997 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.997 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:35.997 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:06:35.997 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:35.997 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.997 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.998 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:35.998 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615757+0000", 2024-04-18T21:06:35.998 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2270000000000001e-06 2024-04-18T21:06:35.998 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.998 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.998 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:35.998 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615765+0000", 2024-04-18T21:06:35.998 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.9400000000000002e-06 2024-04-18T21:06:35.998 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.998 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.998 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:35.998 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615785+0000", 2024-04-18T21:06:35.998 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.0749000000000001e-05 2024-04-18T21:06:35.999 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.999 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.999 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:35.999 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615804+0000", 2024-04-18T21:06:35.999 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.8774e-05 2024-04-18T21:06:35.999 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.999 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.999 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:35.999 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615888+0000", 2024-04-18T21:06:35.999 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.4111999999999997e-05 2024-04-18T21:06:35.999 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:35.999 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:35.999 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:35.999 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615895+0000", 2024-04-18T21:06:35.999 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.0469999999999996e-06 2024-04-18T21:06:35.999 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.000 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.000 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:36.000 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629280+0000", 2024-04-18T21:06:36.000 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.013384416 2024-04-18T21:06:36.000 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.000 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.000 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:36.000 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629488+0000", 2024-04-18T21:06:36.000 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00020852800000000001 2024-04-18T21:06:36.000 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.000 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.000 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:36.000 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629869+0000", 2024-04-18T21:06:36.000 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00038042300000000001 2024-04-18T21:06:36.000 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.000 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.001 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:36.001 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635041+0000", 2024-04-18T21:06:36.001 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.005172383 2024-04-18T21:06:36.001 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.001 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.001 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:36.001 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656125+0000", 2024-04-18T21:06:36.001 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.021084025999999999 2024-04-18T21:06:36.001 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.001 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.001 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:36.001 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656240+0000", 2024-04-18T21:06:36.001 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000115352 2024-04-18T21:06:36.001 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.001 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.002 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:36.002 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656344+0000", 2024-04-18T21:06:36.002 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00010334400000000001 2024-04-18T21:06:36.002 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:36.002 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:36.002 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:36.002 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.002 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.002 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:36.002 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:36.002 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 90.337076523999997, 2024-04-18T21:06:36.002 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.043549577999999999, 2024-04-18T21:06:36.002 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:36.002 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:36.003 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:36.003 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:36.003 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.003 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:36.003 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:36.003 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:36.003 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.003 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.003 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:36.003 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:36.003 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:36.003 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.003 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.003 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:36.004 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:36.004 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.5000000000000002e-07 2024-04-18T21:06:36.004 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.004 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.004 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:36.004 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615828+0000", 2024-04-18T21:06:36.004 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.2359999999999998e-06 2024-04-18T21:06:36.004 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.004 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.004 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:36.004 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615838+0000", 2024-04-18T21:06:36.004 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0087e-05 2024-04-18T21:06:36.004 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.004 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.004 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:36.005 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615846+0000", 2024-04-18T21:06:36.005 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.67e-06 2024-04-18T21:06:36.005 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.005 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.005 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:36.005 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615963+0000", 2024-04-18T21:06:36.005 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00011630500000000001 2024-04-18T21:06:36.005 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.005 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.005 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:36.005 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615979+0000", 2024-04-18T21:06:36.005 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.613e-05 2024-04-18T21:06:36.005 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.005 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.005 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:36.006 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632392+0000", 2024-04-18T21:06:36.006 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016413317 2024-04-18T21:06:36.006 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.006 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.006 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:36.006 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632568+0000", 2024-04-18T21:06:36.006 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00017539500000000001 2024-04-18T21:06:36.006 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.006 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.006 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:36.006 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632748+0000", 2024-04-18T21:06:36.006 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00017991799999999999 2024-04-18T21:06:36.006 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.006 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.007 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:36.007 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635542+0000", 2024-04-18T21:06:36.007 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00279481 2024-04-18T21:06:36.007 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.007 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.007 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:36.007 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659232+0000", 2024-04-18T21:06:36.007 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.023689212000000001 2024-04-18T21:06:36.007 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.007 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.007 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:36.007 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659314+0000", 2024-04-18T21:06:36.007 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.2528999999999995e-05 2024-04-18T21:06:36.007 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.008 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.008 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:36.008 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659372+0000", 2024-04-18T21:06:36.008 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.8218999999999999e-05 2024-04-18T21:06:36.008 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:36.008 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:36.008 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:36.008 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.008 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.008 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:36.008 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:06:36.008 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 90.337015092000001, 2024-04-18T21:06:36.008 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.039335347, 2024-04-18T21:06:36.008 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:36.009 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:36.009 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "started", 2024-04-18T21:06:36.009 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:36.009 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.009 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:36.009 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:06:36.009 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:36.009 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.009 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.009 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:36.009 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:06:36.009 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:36.009 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.009 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.010 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:36.010 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615885+0000", 2024-04-18T21:06:36.010 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2699999999999999e-06 2024-04-18T21:06:36.010 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.010 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.010 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:36.010 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615892+0000", 2024-04-18T21:06:36.010 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.6499999999999999e-06 2024-04-18T21:06:36.010 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.010 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.010 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:36.010 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615906+0000", 2024-04-18T21:06:36.010 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.393e-05 2024-04-18T21:06:36.011 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.011 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.011 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:36.011 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615919+0000", 2024-04-18T21:06:36.011 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2860000000000001e-05 2024-04-18T21:06:36.011 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.011 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.011 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:36.011 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616027+0000", 2024-04-18T21:06:36.011 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000107852 2024-04-18T21:06:36.011 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.011 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.011 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:36.011 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616037+0000", 2024-04-18T21:06:36.012 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:06:36.012 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.012 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.012 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:36.012 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622719+0000", 2024-04-18T21:06:36.012 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0066817220000000002 2024-04-18T21:06:36.012 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.012 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.012 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:36.012 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623006+0000", 2024-04-18T21:06:36.012 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00028783699999999999 2024-04-18T21:06:36.012 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.012 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.012 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:36.012 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.655220+0000", 2024-04-18T21:06:36.012 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.032213036 2024-04-18T21:06:36.013 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:36.013 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:36.013 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:36.013 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.013 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.013 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:36.013 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:36.013 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 90.336959418999996, 2024-04-18T21:06:36.013 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.032845253999999997, 2024-04-18T21:06:36.013 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:36.013 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:36.013 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "started", 2024-04-18T21:06:36.013 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:36.013 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.013 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:36.014 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:36.014 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:36.014 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.014 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.014 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:36.014 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:36.014 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:36.014 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.014 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.014 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:36.014 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615942+0000", 2024-04-18T21:06:36.014 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.717e-06 2024-04-18T21:06:36.014 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.014 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.015 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:36.015 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615946+0000", 2024-04-18T21:06:36.015 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.6e-06 2024-04-18T21:06:36.015 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.015 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.015 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:36.015 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615960+0000", 2024-04-18T21:06:36.015 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:06:36.015 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.015 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.015 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:36.015 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615968+0000", 2024-04-18T21:06:36.015 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.9070000000000007e-06 2024-04-18T21:06:36.015 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.015 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.016 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:36.016 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616100+0000", 2024-04-18T21:06:36.016 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000132402 2024-04-18T21:06:36.016 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.016 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.016 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:36.016 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616117+0000", 2024-04-18T21:06:36.016 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6653000000000001e-05 2024-04-18T21:06:36.016 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.016 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.016 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:36.016 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621566+0000", 2024-04-18T21:06:36.016 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0054497740000000001 2024-04-18T21:06:36.016 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.017 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.017 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:36.017 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622801+0000", 2024-04-18T21:06:36.017 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0012345710000000001 2024-04-18T21:06:36.017 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.017 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.017 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:36.017 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648785+0000", 2024-04-18T21:06:36.017 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.025984104000000001 2024-04-18T21:06:36.017 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:36.017 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:36.017 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:36.017 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.017 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.017 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:36.018 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:06:36.018 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 90.331108068999995, 2024-04-18T21:06:36.018 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.011561350999999999, 2024-04-18T21:06:36.018 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:36.018 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:36.018 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:36.018 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:36.018 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.018 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:36.018 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:06:36.018 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:36.018 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.018 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.018 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:36.018 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:06:36.018 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:36.019 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.019 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.019 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:36.019 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621792+0000", 2024-04-18T21:06:36.019 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.4000000000000001e-07 2024-04-18T21:06:36.019 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.019 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.019 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:36.019 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:06:36.019 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.1050000000000002e-05 2024-04-18T21:06:36.019 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.019 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.019 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:36.019 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622608+0000", 2024-04-18T21:06:36.019 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00077505900000000003 2024-04-18T21:06:36.019 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.020 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.020 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:36.020 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623879+0000", 2024-04-18T21:06:36.020 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0012705839999999999 2024-04-18T21:06:36.020 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.020 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.020 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:36.020 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624010+0000", 2024-04-18T21:06:36.020 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00013176900000000001 2024-04-18T21:06:36.020 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.020 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.020 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:36.020 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624058+0000", 2024-04-18T21:06:36.020 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.7299000000000002e-05 2024-04-18T21:06:36.020 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.021 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.021 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:36.021 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633262+0000", 2024-04-18T21:06:36.021 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0092048770000000002 2024-04-18T21:06:36.021 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.021 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.021 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:36.021 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633353+0000", 2024-04-18T21:06:36.021 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0073000000000003e-05 2024-04-18T21:06:36.021 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:36.021 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:36.021 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:36.021 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.021 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.021 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:36.022 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:06:36.022 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 90.328980682999997, 2024-04-18T21:06:36.022 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0098419370000000003, 2024-04-18T21:06:36.022 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:36.022 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:36.022 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:36.022 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:36.022 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.022 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:36.022 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:06:36.022 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:36.022 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.022 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.023 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:36.023 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:06:36.023 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:36.023 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.023 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.023 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:36.023 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623920+0000", 2024-04-18T21:06:36.023 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2240000000000001e-06 2024-04-18T21:06:36.023 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.023 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.023 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:36.023 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623933+0000", 2024-04-18T21:06:36.023 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3653e-05 2024-04-18T21:06:36.023 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.024 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.024 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:36.024 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623956+0000", 2024-04-18T21:06:36.024 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2059e-05 2024-04-18T21:06:36.024 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.024 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.024 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:36.024 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623975+0000", 2024-04-18T21:06:36.024 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.9806999999999999e-05 2024-04-18T21:06:36.024 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.024 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.024 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:36.024 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626943+0000", 2024-04-18T21:06:36.024 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0029681579999999998 2024-04-18T21:06:36.025 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.025 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.025 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:36.025 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626993+0000", 2024-04-18T21:06:36.025 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.9935999999999998e-05 2024-04-18T21:06:36.025 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.025 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.025 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:36.025 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633665+0000", 2024-04-18T21:06:36.025 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0066719250000000004 2024-04-18T21:06:36.025 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.025 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.025 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:36.025 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633761+0000", 2024-04-18T21:06:36.025 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.5174999999999996e-05 2024-04-18T21:06:36.026 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:36.026 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:36.026 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:36.026 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.026 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.026 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:36.026 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:06:36.026 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 90.328149064000002, 2024-04-18T21:06:36.026 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0090159079999999996, 2024-04-18T21:06:36.026 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:36.026 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:36.026 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:36.026 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:36.027 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.027 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:36.027 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:06:36.027 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:36.027 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.027 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.027 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:36.027 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:06:36.027 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:36.027 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.027 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.027 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:36.027 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624751+0000", 2024-04-18T21:06:36.027 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.7600000000000006e-07 2024-04-18T21:06:36.028 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.028 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.028 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:36.028 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624787+0000", 2024-04-18T21:06:36.028 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.6273000000000003e-05 2024-04-18T21:06:36.028 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.028 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.028 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:36.028 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625837+0000", 2024-04-18T21:06:36.028 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00104992 2024-04-18T21:06:36.028 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.028 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.028 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:36.028 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625860+0000", 2024-04-18T21:06:36.029 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3110000000000001e-05 2024-04-18T21:06:36.029 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.029 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.029 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:36.029 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625984+0000", 2024-04-18T21:06:36.029 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012399199999999999 2024-04-18T21:06:36.029 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.029 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.029 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:36.029 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626030+0000", 2024-04-18T21:06:36.029 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.5429999999999997e-05 2024-04-18T21:06:36.029 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.029 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.029 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:36.029 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633643+0000", 2024-04-18T21:06:36.030 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0076129320000000002 2024-04-18T21:06:36.030 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.030 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.030 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:36.030 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633766+0000", 2024-04-18T21:06:36.030 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000123275 2024-04-18T21:06:36.030 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:36.030 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:36.030 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:36.030 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.030 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.030 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:36.030 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:06:36.030 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 90.326895339999993, 2024-04-18T21:06:36.031 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0088669170000000002, 2024-04-18T21:06:36.031 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:36.031 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:36.031 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:36.031 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:36.031 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.031 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:36.031 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:06:36.031 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:36.031 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.031 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.031 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:36.031 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:06:36.031 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:36.031 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.032 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.032 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:36.032 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626005+0000", 2024-04-18T21:06:36.032 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.5000000000000001e-07 2024-04-18T21:06:36.032 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.032 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.032 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:36.032 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626028+0000", 2024-04-18T21:06:36.032 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2756999999999999e-05 2024-04-18T21:06:36.032 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.032 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.032 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:36.032 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626050+0000", 2024-04-18T21:06:36.032 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2140000000000001e-05 2024-04-18T21:06:36.033 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.033 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.033 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:36.033 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626065+0000", 2024-04-18T21:06:36.033 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5176e-05 2024-04-18T21:06:36.033 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.033 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.033 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:36.033 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628334+0000", 2024-04-18T21:06:36.033 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0022691439999999998 2024-04-18T21:06:36.033 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.033 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.033 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:36.033 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628379+0000", 2024-04-18T21:06:36.034 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.5420000000000002e-05 2024-04-18T21:06:36.034 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.034 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.034 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:36.034 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634770+0000", 2024-04-18T21:06:36.034 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0063908410000000004 2024-04-18T21:06:36.034 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.034 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.034 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:36.034 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634871+0000", 2024-04-18T21:06:36.034 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000100589 2024-04-18T21:06:36.034 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:36.034 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:36.034 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:36.034 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.035 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.035 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:13 3.10 e17/15 3:0d89b25e:::603.00000000:head v 17'8, mlcod=0'0)", 2024-04-18T21:06:36.035 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:06:36.035 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 90.308061910999996, 2024-04-18T21:06:36.035 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0090974379999999994, 2024-04-18T21:06:36.035 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:36.035 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:36.035 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:36.035 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:36.035 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.035 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:36.035 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:06:36.035 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:36.035 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.035 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.036 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:36.036 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:06:36.036 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:36.036 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.036 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.036 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:36.036 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644838+0000", 2024-04-18T21:06:36.036 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.569999999999999e-07 2024-04-18T21:06:36.036 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.036 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.036 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:36.036 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644846+0000", 2024-04-18T21:06:36.036 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.4499999999999998e-06 2024-04-18T21:06:36.036 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.036 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.037 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:36.037 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644861+0000", 2024-04-18T21:06:36.037 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5243e-05 2024-04-18T21:06:36.037 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.037 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.037 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:36.037 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644997+0000", 2024-04-18T21:06:36.037 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000135609 2024-04-18T21:06:36.037 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.037 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.037 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:36.037 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649150+0000", 2024-04-18T21:06:36.037 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0041536760000000002 2024-04-18T21:06:36.037 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.037 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.037 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:36.038 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649207+0000", 2024-04-18T21:06:36.038 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.6677e-05 2024-04-18T21:06:36.038 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.038 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.038 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:36.038 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.653840+0000", 2024-04-18T21:06:36.038 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0046329700000000001 2024-04-18T21:06:36.038 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.038 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.038 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:36.038 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.653935+0000", 2024-04-18T21:06:36.038 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.4856000000000001e-05 2024-04-18T21:06:36.038 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:36.039 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:36.039 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:36.039 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.039 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.039 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 3 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:06:36.039 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:06:36.039 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 90.305272751000004, 2024-04-18T21:06:36.039 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0087842319999999995, 2024-04-18T21:06:36.039 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:36.039 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:36.039 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "reached pg", 2024-04-18T21:06:36.039 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:36.039 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.039 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:36.039 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:06:36.040 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:36.040 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.040 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.040 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:36.040 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:06:36.040 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:36.040 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.040 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.040 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:36.040 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:06:36.040 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.8299999999999996e-07 2024-04-18T21:06:36.040 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.040 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.040 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:36.041 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647642+0000", 2024-04-18T21:06:36.041 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4724e-05 2024-04-18T21:06:36.041 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.041 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.041 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:36.041 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647679+0000", 2024-04-18T21:06:36.041 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.6662999999999998e-05 2024-04-18T21:06:36.041 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.041 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.041 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:36.041 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647735+0000", 2024-04-18T21:06:36.041 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.6196000000000002e-05 2024-04-18T21:06:36.041 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.041 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.041 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:36.042 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649865+0000", 2024-04-18T21:06:36.042 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0021299489999999999 2024-04-18T21:06:36.042 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.042 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.042 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:36.042 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656411+0000", 2024-04-18T21:06:36.042 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0065460170000000003 2024-04-18T21:06:36.042 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:36.042 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:36.042 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:36.042 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.042 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.042 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:36.043 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:06:36.043 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 90.305127554999999, 2024-04-18T21:06:36.043 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0095703190000000007, 2024-04-18T21:06:36.043 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:36.043 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:36.043 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:36.043 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:36.043 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.043 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:36.044 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:06:36.044 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:36.044 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.044 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.044 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:36.044 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:06:36.044 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:36.044 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.044 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.044 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:36.044 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647773+0000", 2024-04-18T21:06:36.044 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.046e-06 2024-04-18T21:06:36.044 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.044 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.044 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:36.045 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647795+0000", 2024-04-18T21:06:36.045 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2616000000000002e-05 2024-04-18T21:06:36.045 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.045 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.045 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:36.045 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647818+0000", 2024-04-18T21:06:36.045 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3110000000000001e-05 2024-04-18T21:06:36.045 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.045 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.045 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:36.045 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647834+0000", 2024-04-18T21:06:36.045 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5163e-05 2024-04-18T21:06:36.045 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.045 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.046 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:36.046 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650682+0000", 2024-04-18T21:06:36.046 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0028479759999999999 2024-04-18T21:06:36.046 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.046 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.046 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:36.046 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650730+0000", 2024-04-18T21:06:36.046 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.8375999999999999e-05 2024-04-18T21:06:36.046 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.046 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.046 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:36.046 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656751+0000", 2024-04-18T21:06:36.046 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0060211880000000002 2024-04-18T21:06:36.047 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.047 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.047 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:36.047 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657342+0000", 2024-04-18T21:06:36.047 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00059084399999999998 2024-04-18T21:06:36.047 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:36.047 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:36.047 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:36.047 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.047 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.047 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:36.047 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:06:36.047 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 90.304715268999999, 2024-04-18T21:06:36.047 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0092471759999999993, 2024-04-18T21:06:36.048 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:36.048 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:36.048 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:36.048 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:36.048 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.048 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:36.048 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:06:36.048 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:36.048 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.048 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.048 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:36.048 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:06:36.048 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:36.048 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.048 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.049 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:36.049 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648185+0000", 2024-04-18T21:06:36.049 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.5000000000000001e-07 2024-04-18T21:06:36.049 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.049 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.049 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:36.049 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648203+0000", 2024-04-18T21:06:36.049 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.8102999999999999e-05 2024-04-18T21:06:36.049 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.049 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.049 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:36.049 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648226+0000", 2024-04-18T21:06:36.049 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2921999999999998e-05 2024-04-18T21:06:36.049 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.050 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.050 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:36.050 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648241+0000", 2024-04-18T21:06:36.050 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5336999999999999e-05 2024-04-18T21:06:36.050 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.050 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.050 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:36.050 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.651268+0000", 2024-04-18T21:06:36.050 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0030271640000000002 2024-04-18T21:06:36.050 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.050 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.050 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:36.050 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.651319+0000", 2024-04-18T21:06:36.050 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.0843000000000001e-05 2024-04-18T21:06:36.051 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.051 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.051 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:36.051 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657347+0000", 2024-04-18T21:06:36.051 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0060279770000000003 2024-04-18T21:06:36.051 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:36.051 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:36.051 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:36.051 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657431+0000", 2024-04-18T21:06:36.051 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.3980000000000006e-05 2024-04-18T21:06:36.051 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:36.051 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:36.051 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:36.051 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:36.051 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:36.051 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:06:36.053 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:36.053 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:36.054+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:36.154 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:36.154+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:36.185 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:36.185 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:06:36.185 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-04-18T21:06:36.185 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:36.199 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:36.255 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:36.258+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:36.321 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:36.321 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:06:36.321 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-18T21:06:36.321 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-18T21:06:36.321 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:36.335 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:36.381 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:36.382+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:36.454 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:36.454 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-18T21:06:36.455 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-18T21:06:36.455 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:06:36.455 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.455 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:36.455 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:06:36.455 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 90.838665693999999, 2024-04-18T21:06:36.455 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.034065303999999998, 2024-04-18T21:06:36.455 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:36.455 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:36.455 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:36.455 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:36.455 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.455 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:36.455 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:06:36.455 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:36.456 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.456 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.456 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:36.456 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:06:36.456 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:36.456 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.456 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.456 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:36.456 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615254+0000", 2024-04-18T21:06:36.456 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7829999999999999e-06 2024-04-18T21:06:36.456 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.456 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.456 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:36.456 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615267+0000", 2024-04-18T21:06:36.457 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3334e-05 2024-04-18T21:06:36.457 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.457 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.457 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:36.457 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615294+0000", 2024-04-18T21:06:36.457 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7271999999999999e-05 2024-04-18T21:06:36.457 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.457 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.457 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:36.457 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615321+0000", 2024-04-18T21:06:36.457 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.637e-05 2024-04-18T21:06:36.457 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.457 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.457 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:36.458 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615479+0000", 2024-04-18T21:06:36.458 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000158493 2024-04-18T21:06:36.458 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.458 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.458 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:36.458 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615498+0000", 2024-04-18T21:06:36.458 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9148999999999999e-05 2024-04-18T21:06:36.458 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.458 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.458 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:36.458 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632915+0000", 2024-04-18T21:06:36.458 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.017416551999999998 2024-04-18T21:06:36.458 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.458 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.459 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:36.459 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633302+0000", 2024-04-18T21:06:36.459 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00038725000000000001 2024-04-18T21:06:36.459 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.459 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.459 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:36.459 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633638+0000", 2024-04-18T21:06:36.459 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000335946 2024-04-18T21:06:36.459 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.459 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.459 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:36.459 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645976+0000", 2024-04-18T21:06:36.459 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012337617 2024-04-18T21:06:36.459 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.460 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.460 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:36.460 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649080+0000", 2024-04-18T21:06:36.460 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031038929999999999 2024-04-18T21:06:36.460 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.460 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.460 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:36.460 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649207+0000", 2024-04-18T21:06:36.460 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000127537 2024-04-18T21:06:36.460 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.460 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.460 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:36.460 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649316+0000", 2024-04-18T21:06:36.460 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109108 2024-04-18T21:06:36.461 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:36.461 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:36.461 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:36.461 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.461 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.461 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:36.461 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:06:36.461 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 90.838532317000002, 2024-04-18T21:06:36.461 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036275764000000002, 2024-04-18T21:06:36.461 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:36.461 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:36.461 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:36.461 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:36.462 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.462 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:36.462 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:06:36.462 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:36.462 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.462 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.462 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:36.462 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:06:36.462 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:36.462 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.462 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.462 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:36.463 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615386+0000", 2024-04-18T21:06:36.463 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.573e-06 2024-04-18T21:06:36.463 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.463 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.463 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:36.463 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:06:36.463 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0723999999999999e-05 2024-04-18T21:06:36.463 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.463 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.463 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:36.463 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615418+0000", 2024-04-18T21:06:36.463 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0902000000000001e-05 2024-04-18T21:06:36.463 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.463 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.464 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:36.464 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615433+0000", 2024-04-18T21:06:36.464 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5319999999999999e-05 2024-04-18T21:06:36.464 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.464 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.464 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:36.464 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615659+0000", 2024-04-18T21:06:36.464 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000226095 2024-04-18T21:06:36.464 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.464 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.464 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:36.464 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:36.464 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1276e-05 2024-04-18T21:06:36.464 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.465 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.465 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:36.465 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643654+0000", 2024-04-18T21:06:36.465 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027983238000000001 2024-04-18T21:06:36.465 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.465 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.465 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:36.465 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643868+0000", 2024-04-18T21:06:36.465 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000214305 2024-04-18T21:06:36.465 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.465 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.465 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:36.465 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:06:36.465 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035892200000000002 2024-04-18T21:06:36.465 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.466 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.466 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:36.466 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646056+0000", 2024-04-18T21:06:36.466 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001829172 2024-04-18T21:06:36.466 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.466 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.466 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:36.466 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651406+0000", 2024-04-18T21:06:36.466 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0053504800000000003 2024-04-18T21:06:36.466 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.466 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.466 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:36.466 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651551+0000", 2024-04-18T21:06:36.466 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014427999999999999 2024-04-18T21:06:36.467 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.467 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.467 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:36.467 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651660+0000", 2024-04-18T21:06:36.467 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109477 2024-04-18T21:06:36.467 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:36.467 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:36.467 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:36.467 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.467 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.467 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:36.467 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:36.467 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 90.838458935000006, 2024-04-18T21:06:36.467 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045668994999999997, 2024-04-18T21:06:36.468 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:36.468 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:36.468 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:36.468 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:36.468 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.468 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:36.468 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:36.468 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:36.468 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.468 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.468 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:36.468 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:36.468 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:36.468 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.469 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.469 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:36.469 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615459+0000", 2024-04-18T21:06:36.469 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5030000000000001e-06 2024-04-18T21:06:36.469 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.469 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.469 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:36.469 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615506+0000", 2024-04-18T21:06:36.469 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6872000000000001e-05 2024-04-18T21:06:36.469 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.469 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.469 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:36.469 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615527+0000", 2024-04-18T21:06:36.469 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0763000000000001e-05 2024-04-18T21:06:36.469 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.470 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.470 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:36.470 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615551+0000", 2024-04-18T21:06:36.470 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4159e-05 2024-04-18T21:06:36.470 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.470 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.470 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:36.470 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615736+0000", 2024-04-18T21:06:36.470 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018499599999999999 2024-04-18T21:06:36.470 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.470 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.470 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:36.470 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615748+0000", 2024-04-18T21:06:36.470 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2272999999999999e-05 2024-04-18T21:06:36.471 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.471 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.471 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:36.471 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635481+0000", 2024-04-18T21:06:36.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019732772999999999 2024-04-18T21:06:36.471 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.471 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.471 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:36.471 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635791+0000", 2024-04-18T21:06:36.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031013299999999998 2024-04-18T21:06:36.471 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.471 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.471 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:36.471 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636101+0000", 2024-04-18T21:06:36.472 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030943300000000002 2024-04-18T21:06:36.472 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.472 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.472 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:36.472 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646043+0000", 2024-04-18T21:06:36.472 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099428139999999995 2024-04-18T21:06:36.472 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.472 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.472 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:36.472 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660991+0000", 2024-04-18T21:06:36.472 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014947142 2024-04-18T21:06:36.472 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.472 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.472 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:36.473 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661061+0000", 2024-04-18T21:06:36.473 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0438000000000006e-05 2024-04-18T21:06:36.473 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.473 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:36.473 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661127+0000", 2024-04-18T21:06:36.473 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5696000000000003e-05 2024-04-18T21:06:36.473 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:36.473 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:36.473 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:36.473 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.473 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:36.473 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:36.473 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 90.838246506999994, 2024-04-18T21:06:36.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045745085999999997, 2024-04-18T21:06:36.474 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:36.474 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:36.474 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:36.474 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:36.474 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.474 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:36.474 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:36.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:36.474 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.474 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.474 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:36.474 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:36.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:36.475 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.475 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:36.475 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:06:36.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7400000000000001e-06 2024-04-18T21:06:36.475 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.475 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:36.475 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:06:36.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8133e-05 2024-04-18T21:06:36.475 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.475 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:36.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615726+0000", 2024-04-18T21:06:36.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6132e-05 2024-04-18T21:06:36.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:36.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615742+0000", 2024-04-18T21:06:36.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6157000000000001e-05 2024-04-18T21:06:36.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:36.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615937+0000", 2024-04-18T21:06:36.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000194768 2024-04-18T21:06:36.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:36.477 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615950+0000", 2024-04-18T21:06:36.477 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3084e-05 2024-04-18T21:06:36.477 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.477 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.477 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:36.477 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643676+0000", 2024-04-18T21:06:36.477 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027725639999999999 2024-04-18T21:06:36.477 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.477 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.477 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:36.477 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643867+0000", 2024-04-18T21:06:36.477 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019075900000000001 2024-04-18T21:06:36.477 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.477 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.477 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:36.478 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:06:36.478 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036013799999999997 2024-04-18T21:06:36.478 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.478 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.478 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:36.478 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646068+0000", 2024-04-18T21:06:36.478 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001841536 2024-04-18T21:06:36.478 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.478 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.478 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:36.478 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661184+0000", 2024-04-18T21:06:36.478 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015115458999999999 2024-04-18T21:06:36.478 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.478 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.479 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:36.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661283+0000", 2024-04-18T21:06:36.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9502999999999999e-05 2024-04-18T21:06:36.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.479 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.479 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:36.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661415+0000", 2024-04-18T21:06:36.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000132037 2024-04-18T21:06:36.479 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:36.479 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:36.479 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:36.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.479 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.479 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:36.480 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:06:36.480 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 90.838124820000004, 2024-04-18T21:06:36.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036185947000000003, 2024-04-18T21:06:36.480 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:36.480 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:36.480 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:36.480 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:36.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:36.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:06:36.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:36.480 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:36.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:06:36.481 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:36.481 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:36.481 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615794+0000", 2024-04-18T21:06:36.481 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6440000000000001e-06 2024-04-18T21:06:36.481 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:36.481 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615803+0000", 2024-04-18T21:06:36.481 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1220000000000001e-06 2024-04-18T21:06:36.481 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:36.482 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615827+0000", 2024-04-18T21:06:36.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3997000000000001e-05 2024-04-18T21:06:36.482 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.482 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.482 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:36.482 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615899+0000", 2024-04-18T21:06:36.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2741e-05 2024-04-18T21:06:36.482 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.482 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.482 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:36.482 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616019+0000", 2024-04-18T21:06:36.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119874 2024-04-18T21:06:36.482 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.482 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.483 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:36.483 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616029+0000", 2024-04-18T21:06:36.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:06:36.483 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.483 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.483 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:36.483 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644823+0000", 2024-04-18T21:06:36.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.028793151999999999 2024-04-18T21:06:36.483 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.483 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.483 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:36.483 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645106+0000", 2024-04-18T21:06:36.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028379700000000002 2024-04-18T21:06:36.483 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:36.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645294+0000", 2024-04-18T21:06:36.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000187181 2024-04-18T21:06:36.484 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:36.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646763+0000", 2024-04-18T21:06:36.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0014691050000000001 2024-04-18T21:06:36.484 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:36.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651784+0000", 2024-04-18T21:06:36.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050211650000000002 2024-04-18T21:06:36.485 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:36.485 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651876+0000", 2024-04-18T21:06:36.485 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2503999999999994e-05 2024-04-18T21:06:36.485 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:36.485 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651978+0000", 2024-04-18T21:06:36.485 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000101475 2024-04-18T21:06:36.485 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:36.485 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:36.485 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:36.485 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.486 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.486 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:36.486 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:36.486 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 90.837976213000005, 2024-04-18T21:06:36.486 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032262322000000003, 2024-04-18T21:06:36.486 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:36.486 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:36.486 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:36.486 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:36.486 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.486 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:36.486 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:36.486 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:36.486 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.487 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.487 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:36.487 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:36.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:36.487 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.487 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.487 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:36.487 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615943+0000", 2024-04-18T21:06:36.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1959999999999998e-06 2024-04-18T21:06:36.487 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.487 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.487 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:36.487 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615956+0000", 2024-04-18T21:06:36.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3424000000000001e-05 2024-04-18T21:06:36.488 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.488 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:36.488 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615983+0000", 2024-04-18T21:06:36.488 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7072000000000001e-05 2024-04-18T21:06:36.488 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.488 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:36.488 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616006+0000", 2024-04-18T21:06:36.488 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2823000000000002e-05 2024-04-18T21:06:36.488 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.488 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:36.488 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616156+0000", 2024-04-18T21:06:36.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014962299999999999 2024-04-18T21:06:36.489 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.489 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:36.489 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616174+0000", 2024-04-18T21:06:36.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8082999999999999e-05 2024-04-18T21:06:36.489 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.489 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:36.489 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.629952+0000", 2024-04-18T21:06:36.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013778514 2024-04-18T21:06:36.489 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.489 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:36.489 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630201+0000", 2024-04-18T21:06:36.490 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024918100000000001 2024-04-18T21:06:36.490 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.490 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:36.490 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630386+0000", 2024-04-18T21:06:36.490 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018436900000000001 2024-04-18T21:06:36.490 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.490 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:36.490 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643169+0000", 2024-04-18T21:06:36.490 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012782774 2024-04-18T21:06:36.490 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.490 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:36.491 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.647924+0000", 2024-04-18T21:06:36.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004755787 2024-04-18T21:06:36.491 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.491 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.491 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:36.491 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648069+0000", 2024-04-18T21:06:36.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014459600000000001 2024-04-18T21:06:36.491 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.491 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.491 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:36.491 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648203+0000", 2024-04-18T21:06:36.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013388000000000001 2024-04-18T21:06:36.491 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:36.491 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:36.492 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:36.492 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.492 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:36.492 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:06:36.492 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 90.837867949, 2024-04-18T21:06:36.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032489736999999998, 2024-04-18T21:06:36.492 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:36.492 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:36.492 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:36.492 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:36.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:36.492 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:06:36.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:36.493 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.493 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.493 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:36.493 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:06:36.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:36.493 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.493 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.493 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:36.493 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616050+0000", 2024-04-18T21:06:36.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.606e-06 2024-04-18T21:06:36.493 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.493 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.493 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:36.493 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616061+0000", 2024-04-18T21:06:36.494 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0463e-05 2024-04-18T21:06:36.494 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.494 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.494 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:36.494 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616092+0000", 2024-04-18T21:06:36.494 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1415999999999999e-05 2024-04-18T21:06:36.494 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.494 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.494 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:36.494 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616109+0000", 2024-04-18T21:06:36.494 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6557000000000001e-05 2024-04-18T21:06:36.494 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.494 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.494 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:36.495 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616358+0000", 2024-04-18T21:06:36.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000249077 2024-04-18T21:06:36.495 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.495 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:36.495 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616370+0000", 2024-04-18T21:06:36.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2037e-05 2024-04-18T21:06:36.495 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.495 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:36.495 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.634920+0000", 2024-04-18T21:06:36.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018550397 2024-04-18T21:06:36.495 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:36.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640420+0000", 2024-04-18T21:06:36.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055000539999999999 2024-04-18T21:06:36.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:36.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648538+0000", 2024-04-18T21:06:36.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0081181299999999994 2024-04-18T21:06:36.496 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:36.496 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:36.496 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:36.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.496 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:36.496 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:06:36.497 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 90.837783627999997, 2024-04-18T21:06:36.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036090029000000003, 2024-04-18T21:06:36.497 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:36.497 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:36.497 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:36.497 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:36.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.497 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:36.497 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:06:36.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:36.497 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.497 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:36.497 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:06:36.498 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:36.498 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.498 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.498 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:36.498 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616134+0000", 2024-04-18T21:06:36.498 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.353e-06 2024-04-18T21:06:36.498 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.498 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.498 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:36.498 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616141+0000", 2024-04-18T21:06:36.498 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2770000000000002e-06 2024-04-18T21:06:36.498 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.498 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:36.499 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616160+0000", 2024-04-18T21:06:36.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.91e-05 2024-04-18T21:06:36.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:36.499 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616170+0000", 2024-04-18T21:06:36.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7699999999999996e-06 2024-04-18T21:06:36.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:36.499 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616275+0000", 2024-04-18T21:06:36.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105313 2024-04-18T21:06:36.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.500 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:36.500 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616288+0000", 2024-04-18T21:06:36.500 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3027000000000001e-05 2024-04-18T21:06:36.500 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.500 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:36.500 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646160+0000", 2024-04-18T21:06:36.500 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.029872019 2024-04-18T21:06:36.500 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.500 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:36.500 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646368+0000", 2024-04-18T21:06:36.500 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020811899999999999 2024-04-18T21:06:36.500 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.501 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.501 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:36.501 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652223+0000", 2024-04-18T21:06:36.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.005855051 2024-04-18T21:06:36.501 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:36.501 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:36.501 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:36.501 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.501 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.501 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:36.501 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:36.501 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 90.837726059000005, 2024-04-18T21:06:36.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043572403000000003, 2024-04-18T21:06:36.501 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:36.502 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:36.502 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:36.502 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:36.502 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.502 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:36.502 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:36.502 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:36.502 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.502 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.502 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:36.502 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:36.502 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:36.502 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.502 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:36.503 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616192+0000", 2024-04-18T21:06:36.503 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:06:36.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:36.503 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616203+0000", 2024-04-18T21:06:36.503 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0890000000000001e-05 2024-04-18T21:06:36.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:36.503 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616223+0000", 2024-04-18T21:06:36.503 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0409000000000001e-05 2024-04-18T21:06:36.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.504 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:36.504 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616238+0000", 2024-04-18T21:06:36.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5160000000000001e-05 2024-04-18T21:06:36.504 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.504 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:36.504 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616343+0000", 2024-04-18T21:06:36.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000104831 2024-04-18T21:06:36.504 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.504 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:36.504 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616357+0000", 2024-04-18T21:06:36.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3686000000000001e-05 2024-04-18T21:06:36.504 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.505 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.505 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:36.505 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635912+0000", 2024-04-18T21:06:36.505 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019554944000000001 2024-04-18T21:06:36.505 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.505 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.505 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:36.505 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636231+0000", 2024-04-18T21:06:36.505 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000318766 2024-04-18T21:06:36.505 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.505 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.505 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:36.505 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659763+0000", 2024-04-18T21:06:36.505 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023532474000000001 2024-04-18T21:06:36.505 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:36.506 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:36.506 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:36.506 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.506 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.506 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:36.506 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:06:36.506 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 90.833797352000005, 2024-04-18T21:06:36.506 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015007971, 2024-04-18T21:06:36.506 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:36.506 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:36.506 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:36.506 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:36.506 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.506 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:36.507 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:06:36.507 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:36.507 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.507 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.507 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:36.507 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:06:36.507 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:36.507 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.507 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.507 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:36.507 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620120+0000", 2024-04-18T21:06:36.507 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0359999999999999e-06 2024-04-18T21:06:36.507 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.507 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.507 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:36.508 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620157+0000", 2024-04-18T21:06:36.508 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6636e-05 2024-04-18T21:06:36.508 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.508 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.508 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:36.508 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620177+0000", 2024-04-18T21:06:36.508 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0247000000000001e-05 2024-04-18T21:06:36.508 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.508 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.508 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:36.508 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620195+0000", 2024-04-18T21:06:36.508 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7819e-05 2024-04-18T21:06:36.508 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.508 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.508 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:36.508 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620342+0000", 2024-04-18T21:06:36.509 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014643300000000001 2024-04-18T21:06:36.509 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.509 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.509 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:36.509 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620405+0000", 2024-04-18T21:06:36.509 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3522000000000006e-05 2024-04-18T21:06:36.509 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.509 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.509 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:36.509 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635016+0000", 2024-04-18T21:06:36.509 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014610840999999999 2024-04-18T21:06:36.509 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.509 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.509 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:36.510 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635127+0000", 2024-04-18T21:06:36.510 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111437 2024-04-18T21:06:36.510 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:36.510 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:36.510 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:36.510 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.510 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.510 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:36.510 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:06:36.510 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 90.833690083999997, 2024-04-18T21:06:36.510 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012693296, 2024-04-18T21:06:36.510 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:36.510 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:36.510 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:36.511 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:36.511 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.511 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:36.511 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:06:36.511 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:36.511 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.511 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.511 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:36.511 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:06:36.511 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:36.511 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.511 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.511 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:36.511 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620228+0000", 2024-04-18T21:06:36.511 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:06:36.512 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.512 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.512 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:36.512 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620236+0000", 2024-04-18T21:06:36.512 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.303e-06 2024-04-18T21:06:36.512 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.512 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.512 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:36.512 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620255+0000", 2024-04-18T21:06:36.512 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9406e-05 2024-04-18T21:06:36.512 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.512 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.512 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:36.512 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620274+0000", 2024-04-18T21:06:36.512 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8940000000000002e-05 2024-04-18T21:06:36.512 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.513 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.513 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:36.513 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:06:36.513 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001558753 2024-04-18T21:06:36.513 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.513 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.513 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:36.513 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621879+0000", 2024-04-18T21:06:36.513 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6359000000000001e-05 2024-04-18T21:06:36.513 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.513 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.513 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:36.513 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632841+0000", 2024-04-18T21:06:36.513 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010961907 2024-04-18T21:06:36.514 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.514 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.514 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:36.514 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632920+0000", 2024-04-18T21:06:36.514 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8714999999999994e-05 2024-04-18T21:06:36.514 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:36.514 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:36.514 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:36.514 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.514 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.514 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:36.514 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:06:36.514 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 90.832144321000001, 2024-04-18T21:06:36.514 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013445702, 2024-04-18T21:06:36.515 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:36.515 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:36.515 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:36.515 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:36.515 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.515 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:36.515 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:06:36.515 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:36.515 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.515 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.515 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:36.515 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:06:36.515 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:36.515 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.515 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.516 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:36.516 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621774+0000", 2024-04-18T21:06:36.516 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2500000000000001e-06 2024-04-18T21:06:36.516 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.516 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.516 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:36.516 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621786+0000", 2024-04-18T21:06:36.516 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2636000000000001e-05 2024-04-18T21:06:36.516 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.516 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.516 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:36.516 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621814+0000", 2024-04-18T21:06:36.516 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7823000000000001e-05 2024-04-18T21:06:36.516 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.516 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.516 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:36.517 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621844+0000", 2024-04-18T21:06:36.517 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9589000000000001e-05 2024-04-18T21:06:36.517 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.517 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.517 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:36.517 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622253+0000", 2024-04-18T21:06:36.517 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040963700000000002 2024-04-18T21:06:36.517 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.517 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.517 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:36.517 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622304+0000", 2024-04-18T21:06:36.517 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0868999999999997e-05 2024-04-18T21:06:36.517 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.517 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.517 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:36.518 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635133+0000", 2024-04-18T21:06:36.518 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012829136 2024-04-18T21:06:36.518 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.518 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.518 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:36.518 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635218+0000", 2024-04-18T21:06:36.518 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4761999999999999e-05 2024-04-18T21:06:36.518 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:36.518 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:36.518 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:36.518 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.518 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.518 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:36.518 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:06:36.519 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 90.832017561000001, 2024-04-18T21:06:36.519 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014162065, 2024-04-18T21:06:36.519 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:36.519 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:36.519 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:36.519 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:36.519 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.519 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:36.519 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:06:36.519 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:36.519 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.519 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.519 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:36.519 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:06:36.520 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:36.520 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.520 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.520 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:36.520 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621900+0000", 2024-04-18T21:06:36.520 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:06:36.520 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.520 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.520 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:36.520 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621910+0000", 2024-04-18T21:06:36.520 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0207000000000001e-05 2024-04-18T21:06:36.520 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.520 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.520 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:36.520 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621932+0000", 2024-04-18T21:06:36.521 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1789000000000001e-05 2024-04-18T21:06:36.521 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.521 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.521 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:36.521 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621946+0000", 2024-04-18T21:06:36.521 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4212999999999999e-05 2024-04-18T21:06:36.521 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.521 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.521 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:36.521 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624477+0000", 2024-04-18T21:06:36.521 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025303470000000001 2024-04-18T21:06:36.521 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.521 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.521 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:36.522 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624525+0000", 2024-04-18T21:06:36.522 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8084999999999998e-05 2024-04-18T21:06:36.522 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.522 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.522 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:36.522 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635976+0000", 2024-04-18T21:06:36.522 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.011451368999999999 2024-04-18T21:06:36.522 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.522 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.522 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:36.522 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636061+0000", 2024-04-18T21:06:36.522 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5094999999999998e-05 2024-04-18T21:06:36.522 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:36.522 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:36.523 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:36.523 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.523 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.523 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:06:36.523 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:06:36.523 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 90.822781935999998, 2024-04-18T21:06:36.523 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0098014739999999993, 2024-04-18T21:06:36.523 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:36.523 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:36.523 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:06:36.523 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:36.523 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.523 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:36.523 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:06:36.524 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:36.524 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.524 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.524 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:36.524 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:06:36.524 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:36.524 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.524 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.524 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:36.524 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631136+0000", 2024-04-18T21:06:36.524 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0139999999999999e-06 2024-04-18T21:06:36.524 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.524 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.524 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:36.524 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631152+0000", 2024-04-18T21:06:36.525 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6365999999999999e-05 2024-04-18T21:06:36.525 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.525 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.525 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:36.525 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631961+0000", 2024-04-18T21:06:36.525 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00080873100000000003 2024-04-18T21:06:36.525 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.525 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.525 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:36.525 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632021+0000", 2024-04-18T21:06:36.525 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0541999999999997e-05 2024-04-18T21:06:36.525 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.525 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.525 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:36.525 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633539+0000", 2024-04-18T21:06:36.525 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015175639999999999 2024-04-18T21:06:36.526 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.526 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.526 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:36.526 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640936+0000", 2024-04-18T21:06:36.526 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007397257 2024-04-18T21:06:36.526 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:36.526 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:36.526 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:36.526 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.526 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.526 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e17/15 ondisk, result = 0)", 2024-04-18T21:06:36.526 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:06:36.526 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 90.805320503000004, 2024-04-18T21:06:36.527 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00073592199999999997, 2024-04-18T21:06:36.527 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:36.527 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:36.527 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:36.527 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:36.527 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.527 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:36.527 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:06:36.527 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:36.527 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.527 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.527 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:36.527 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648596+0000", 2024-04-18T21:06:36.527 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:36.528 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.528 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.528 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:36.528 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648597+0000", 2024-04-18T21:06:36.528 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5300000000000003e-07 2024-04-18T21:06:36.528 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.528 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.528 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:36.528 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648605+0000", 2024-04-18T21:06:36.528 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3960000000000006e-06 2024-04-18T21:06:36.528 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.528 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.528 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:36.528 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648625+0000", 2024-04-18T21:06:36.528 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9987e-05 2024-04-18T21:06:36.529 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.529 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.529 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:36.529 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648643+0000", 2024-04-18T21:06:36.529 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7079e-05 2024-04-18T21:06:36.529 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.529 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.529 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:36.529 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649043+0000", 2024-04-18T21:06:36.529 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040083399999999998 2024-04-18T21:06:36.529 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.529 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.529 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:36.529 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649062+0000", 2024-04-18T21:06:36.529 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9052999999999999e-05 2024-04-18T21:06:36.530 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.530 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.530 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:36.530 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649332+0000", 2024-04-18T21:06:36.530 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026971999999999999 2024-04-18T21:06:36.530 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:36.530 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:36.530 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:36.530 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.530 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.530 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-18T21:06:36.530 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:06:36.530 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 90.802545601999995, 2024-04-18T21:06:36.530 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00086123999999999999, 2024-04-18T21:06:36.531 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:36.531 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:36.531 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:06:36.531 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:36.531 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.531 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:36.531 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:06:36.531 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:36.531 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.531 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.531 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:36.531 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651371+0000", 2024-04-18T21:06:36.531 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:36.531 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.532 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.532 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:36.532 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651372+0000", 2024-04-18T21:06:36.532 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7599999999999997e-07 2024-04-18T21:06:36.532 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.532 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.532 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:36.532 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651377+0000", 2024-04-18T21:06:36.532 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.22e-06 2024-04-18T21:06:36.532 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.532 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.532 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:36.532 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651394+0000", 2024-04-18T21:06:36.532 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6646999999999998e-05 2024-04-18T21:06:36.533 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.533 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.533 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:36.533 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651427+0000", 2024-04-18T21:06:36.533 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3682e-05 2024-04-18T21:06:36.533 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.533 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.533 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:36.533 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652029+0000", 2024-04-18T21:06:36.533 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00060152199999999995 2024-04-18T21:06:36.533 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.533 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.533 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:36.533 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652232+0000", 2024-04-18T21:06:36.533 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020359299999999999 2024-04-18T21:06:36.534 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:36.534 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:36.534 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:36.534 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.534 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.534 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:06:36.534 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:06:36.534 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 90.794518640000007, 2024-04-18T21:06:36.534 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0017426200000000001, 2024-04-18T21:06:36.534 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:36.534 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:36.534 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:36.534 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:36.535 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.535 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:36.535 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:06:36.535 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:36.535 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.535 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.535 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:36.535 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659398+0000", 2024-04-18T21:06:36.535 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:36.535 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.535 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.535 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:36.535 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659399+0000", 2024-04-18T21:06:36.535 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6000000000000002e-07 2024-04-18T21:06:36.535 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.536 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.536 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:36.536 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659405+0000", 2024-04-18T21:06:36.536 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5069999999999997e-06 2024-04-18T21:06:36.536 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.536 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.536 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:36.536 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659425+0000", 2024-04-18T21:06:36.536 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.927e-05 2024-04-18T21:06:36.536 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.536 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.536 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:36.536 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659443+0000", 2024-04-18T21:06:36.536 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8051999999999999e-05 2024-04-18T21:06:36.537 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.537 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.537 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:36.537 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660973+0000", 2024-04-18T21:06:36.537 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001530106 2024-04-18T21:06:36.537 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.537 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.537 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:36.537 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660983+0000", 2024-04-18T21:06:36.537 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0516999999999999e-05 2024-04-18T21:06:36.537 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.537 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.537 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:36.537 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661141+0000", 2024-04-18T21:06:36.538 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015730799999999999 2024-04-18T21:06:36.538 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:36.538 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:36.538 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:36.538 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.538 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.538 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-18T21:06:36.538 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:06:36.538 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 90.794302015, 2024-04-18T21:06:36.538 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001812311, 2024-04-18T21:06:36.538 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:36.538 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:36.538 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:36.538 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:36.539 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.539 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:36.539 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:06:36.539 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:36.539 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.539 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.539 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:36.539 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659615+0000", 2024-04-18T21:06:36.539 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:36.539 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.539 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.539 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:36.539 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659616+0000", 2024-04-18T21:06:36.539 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.277e-06 2024-04-18T21:06:36.540 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.540 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.540 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:36.540 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659625+0000", 2024-04-18T21:06:36.540 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5359999999999998e-06 2024-04-18T21:06:36.540 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.540 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.540 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:36.540 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659647+0000", 2024-04-18T21:06:36.540 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1857000000000001e-05 2024-04-18T21:06:36.540 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.540 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.540 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:36.540 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659664+0000", 2024-04-18T21:06:36.541 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6405999999999998e-05 2024-04-18T21:06:36.541 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.541 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.541 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:36.541 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661169+0000", 2024-04-18T21:06:36.541 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015054179999999999 2024-04-18T21:06:36.541 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.541 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.541 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:36.541 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661177+0000", 2024-04-18T21:06:36.541 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9680000000000006e-06 2024-04-18T21:06:36.541 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.541 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.541 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:36.541 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661427+0000", 2024-04-18T21:06:36.541 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024984900000000001 2024-04-18T21:06:36.542 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:36.542 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:36.542 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:36.542 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.542 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.542 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-18T21:06:36.542 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:06:36.542 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 88.841381407, 2024-04-18T21:06:36.542 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0030975030000000001, 2024-04-18T21:06:36.542 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:36.542 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:36.542 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:36.542 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:36.542 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.543 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:36.543 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:06:36.543 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:36.543 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.543 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.543 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:36.543 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612535+0000", 2024-04-18T21:06:36.543 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:36.543 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.543 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.543 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:36.543 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612538+0000", 2024-04-18T21:06:36.543 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6259999999999999e-06 2024-04-18T21:06:36.543 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.544 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.544 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:36.544 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612552+0000", 2024-04-18T21:06:36.544 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4073999999999999e-05 2024-04-18T21:06:36.544 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.544 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.544 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:36.544 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612585+0000", 2024-04-18T21:06:36.544 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3504999999999999e-05 2024-04-18T21:06:36.544 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.544 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.544 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:36.544 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612601+0000", 2024-04-18T21:06:36.544 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5194000000000001e-05 2024-04-18T21:06:36.545 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.545 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.545 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:36.545 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612746+0000", 2024-04-18T21:06:36.545 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145666 2024-04-18T21:06:36.545 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.545 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.545 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:36.545 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.612953+0000", 2024-04-18T21:06:36.545 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000207109 2024-04-18T21:06:36.545 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.545 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.545 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:36.545 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.613134+0000", 2024-04-18T21:06:36.546 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018041300000000001 2024-04-18T21:06:36.546 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.546 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.546 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:36.546 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.614411+0000", 2024-04-18T21:06:36.546 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0012769929999999999 2024-04-18T21:06:36.546 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.546 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.546 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:36.546 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615441+0000", 2024-04-18T21:06:36.546 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001029917 2024-04-18T21:06:36.546 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.546 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.546 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:36.547 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615522+0000", 2024-04-18T21:06:36.547 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1142000000000003e-05 2024-04-18T21:06:36.547 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.547 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.547 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:36.547 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:07.615633+0000", 2024-04-18T21:06:36.547 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000110864 2024-04-18T21:06:36.547 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:36.547 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:36.547 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:36.547 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.547 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.547 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-18T21:06:36.547 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:06:36.547 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 70.839095596000007, 2024-04-18T21:06:36.548 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088979039999999999, 2024-04-18T21:06:36.548 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:36.548 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:36.548 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:36.548 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:36.548 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.548 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:36.548 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:06:36.548 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:36.548 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.548 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.548 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:36.548 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:06:36.548 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:36.548 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.549 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.549 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:36.549 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614825+0000", 2024-04-18T21:06:36.549 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4829999999999999e-06 2024-04-18T21:06:36.549 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.549 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.549 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:36.549 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614843+0000", 2024-04-18T21:06:36.549 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8777e-05 2024-04-18T21:06:36.549 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.549 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.549 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:36.549 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614884+0000", 2024-04-18T21:06:36.549 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1051999999999999e-05 2024-04-18T21:06:36.549 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.550 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.550 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:36.550 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614903+0000", 2024-04-18T21:06:36.550 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9069999999999999e-05 2024-04-18T21:06:36.550 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.550 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.550 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:36.550 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615047+0000", 2024-04-18T21:06:36.550 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014374400000000001 2024-04-18T21:06:36.550 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.550 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.550 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:36.550 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615061+0000", 2024-04-18T21:06:36.551 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4063000000000001e-05 2024-04-18T21:06:36.551 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.551 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.551 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:36.551 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621064+0000", 2024-04-18T21:06:36.551 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0060029200000000001 2024-04-18T21:06:36.551 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.551 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.551 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:36.551 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621211+0000", 2024-04-18T21:06:36.551 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000147224 2024-04-18T21:06:36.551 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.551 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.551 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:36.552 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621396+0000", 2024-04-18T21:06:36.552 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018454699999999999 2024-04-18T21:06:36.552 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.552 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.552 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:36.552 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.622517+0000", 2024-04-18T21:06:36.552 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001121424 2024-04-18T21:06:36.552 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.552 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.552 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:36.552 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623571+0000", 2024-04-18T21:06:36.552 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010538660000000001 2024-04-18T21:06:36.552 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.552 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.552 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:36.552 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623658+0000", 2024-04-18T21:06:36.553 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6439000000000004e-05 2024-04-18T21:06:36.553 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:36.553 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:36.553 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:36.553 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623719+0000", 2024-04-18T21:06:36.553 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1295000000000002e-05 2024-04-18T21:06:36.553 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:36.553 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:36.553 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:36.553 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:36.553 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:36.553 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:36.555 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:36.555 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:36.554+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:36.634 INFO:tasks.workunit.client.0.smithi078.stderr:Note: switching to 'c46a99d99fa3e2dad10a5ce96141fec909e651df'. 2024-04-18T21:06:36.634 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-04-18T21:06:36.634 INFO:tasks.workunit.client.0.smithi078.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-18T21:06:36.634 INFO:tasks.workunit.client.0.smithi078.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-18T21:06:36.634 INFO:tasks.workunit.client.0.smithi078.stderr:state without impacting any branches by switching back to a branch. 2024-04-18T21:06:36.634 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-04-18T21:06:36.634 INFO:tasks.workunit.client.0.smithi078.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-18T21:06:36.634 INFO:tasks.workunit.client.0.smithi078.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-18T21:06:36.635 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-04-18T21:06:36.635 INFO:tasks.workunit.client.0.smithi078.stderr: git switch -c 2024-04-18T21:06:36.635 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-04-18T21:06:36.635 INFO:tasks.workunit.client.0.smithi078.stderr:Or undo this operation with: 2024-04-18T21:06:36.635 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-04-18T21:06:36.635 INFO:tasks.workunit.client.0.smithi078.stderr: git switch - 2024-04-18T21:06:36.635 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-04-18T21:06:36.635 INFO:tasks.workunit.client.0.smithi078.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-18T21:06:36.635 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-04-18T21:06:36.635 INFO:tasks.workunit.client.0.smithi078.stderr:HEAD is now at c46a99d99fa Merge pull request #56974 from rhcs-dashboard/fix-xmlsec-issue 2024-04-18T21:06:36.636 DEBUG:teuthology.orchestra.run.smithi078:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-18T21:06:36.642 INFO:tasks.workunit.client.0.smithi078.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-18T21:06:36.646 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-18T21:06:36.646 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-18T21:06:36.655 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:36.659+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:36.685 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:36.685 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:06:36.685 INFO:teuthology.orchestra.run.smithi132.stdout: "num_ops": 0 2024-04-18T21:06:36.685 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:36.700 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:36.705 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-18T21:06:36.756 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:36.754+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:36.822 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:36.822 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:06:36.822 INFO:teuthology.orchestra.run.smithi132.stdout: "complaint_time": 30, 2024-04-18T21:06:36.822 INFO:teuthology.orchestra.run.smithi132.stdout: "num_blocked_ops": 0 2024-04-18T21:06:36.823 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:36.836 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:36.882 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:36.882+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:36.955 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:36.955 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 20, 2024-04-18T21:06:36.955 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 600, 2024-04-18T21:06:36.955 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [ 2024-04-18T21:06:36.955 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.955 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:36.955 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:06:36.956 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 102.044282904, 2024-04-18T21:06:36.956 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.02518273, 2024-04-18T21:06:36.956 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:36.956 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:36.956 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:36.956 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:36.956 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:36.956 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:36.956 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 141 2024-04-18T21:06:36.956 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.956 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:36.956 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.956 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:36.956 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:06:36.957 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:36.957 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.957 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.957 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:36.957 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:06:36.957 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:36.957 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.957 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.957 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:36.957 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911562+0000", 2024-04-18T21:06:36.957 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9300000000000006e-07 2024-04-18T21:06:36.957 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.957 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.957 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:36.957 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911569+0000", 2024-04-18T21:06:36.957 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0169999999999999e-06 2024-04-18T21:06:36.958 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.958 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.958 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:36.958 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911582+0000", 2024-04-18T21:06:36.958 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.343e-05 2024-04-18T21:06:36.958 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.958 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.958 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:36.958 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911590+0000", 2024-04-18T21:06:36.958 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.413e-06 2024-04-18T21:06:36.958 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.958 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.958 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:36.959 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.933922+0000", 2024-04-18T21:06:36.959 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.022332093000000001 2024-04-18T21:06:36.959 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.959 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.959 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:36.959 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.934155+0000", 2024-04-18T21:06:36.959 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023378900000000001 2024-04-18T21:06:36.959 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.959 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.959 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:36.959 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.934514+0000", 2024-04-18T21:06:36.959 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00035859200000000003 2024-04-18T21:06:36.959 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.959 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.959 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:36.960 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.935973+0000", 2024-04-18T21:06:36.960 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001458705 2024-04-18T21:06:36.960 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.960 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.960 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:36.960 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936488+0000", 2024-04-18T21:06:36.960 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00051550000000000001 2024-04-18T21:06:36.960 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.960 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.960 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:36.960 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936636+0000", 2024-04-18T21:06:36.960 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014779800000000001 2024-04-18T21:06:36.960 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.960 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.960 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:36.960 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936743+0000", 2024-04-18T21:06:36.961 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010739999999999999 2024-04-18T21:06:36.961 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:36.961 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:36.961 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:36.961 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.961 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.961 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:36.961 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:36.961 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 101.92708392999999, 2024-04-18T21:06:36.961 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023654959999999999, 2024-04-18T21:06:36.961 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:36.961 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:36.961 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:36.961 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:36.961 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:36.962 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:36.962 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 163 2024-04-18T21:06:36.962 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.962 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:36.962 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.962 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:36.962 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:36.962 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:36.962 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.962 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.962 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:36.962 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:36.962 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:36.963 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.963 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.963 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:36.963 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:36.963 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0999999999999998e-07 2024-04-18T21:06:36.963 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.963 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.963 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:36.963 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028766+0000", 2024-04-18T21:06:36.963 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4700000000000001e-06 2024-04-18T21:06:36.963 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.963 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.963 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:36.963 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028775+0000", 2024-04-18T21:06:36.963 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.3190000000000001e-06 2024-04-18T21:06:36.964 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.964 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.964 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:36.964 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028782+0000", 2024-04-18T21:06:36.964 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.2300000000000002e-06 2024-04-18T21:06:36.964 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.964 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.964 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:36.964 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046667+0000", 2024-04-18T21:06:36.964 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017884356000000001 2024-04-18T21:06:36.964 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.964 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.964 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:36.965 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046788+0000", 2024-04-18T21:06:36.965 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012125000000000001 2024-04-18T21:06:36.965 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.965 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.965 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:36.965 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046982+0000", 2024-04-18T21:06:36.965 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019394 2024-04-18T21:06:36.965 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.965 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.965 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:36.965 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051969+0000", 2024-04-18T21:06:36.965 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0049868150000000003 2024-04-18T21:06:36.965 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.965 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.965 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:36.966 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052089+0000", 2024-04-18T21:06:36.966 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011993 2024-04-18T21:06:36.966 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.966 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.966 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:36.966 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052292+0000", 2024-04-18T21:06:36.966 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020345699999999999 2024-04-18T21:06:36.966 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.966 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.966 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:36.966 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052415+0000", 2024-04-18T21:06:36.966 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000122483 2024-04-18T21:06:36.966 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:36.966 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:36.967 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:36.967 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.967 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.967 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:36.967 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:36.967 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 101.927049698, 2024-04-18T21:06:36.967 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023864586, 2024-04-18T21:06:36.967 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:36.967 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:36.967 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:36.967 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:36.967 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:36.967 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:36.968 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 164 2024-04-18T21:06:36.968 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.968 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:36.968 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.968 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:36.968 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:36.968 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:36.968 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.968 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.968 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:36.968 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:36.968 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:36.968 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.968 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.969 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:36.969 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028795+0000", 2024-04-18T21:06:36.969 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7999999999999995e-07 2024-04-18T21:06:36.969 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.969 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.969 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:36.969 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028884+0000", 2024-04-18T21:06:36.969 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8997000000000002e-05 2024-04-18T21:06:36.969 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.969 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.969 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:36.969 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028895+0000", 2024-04-18T21:06:36.969 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1647e-05 2024-04-18T21:06:36.969 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.970 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.970 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:36.970 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028903+0000", 2024-04-18T21:06:36.970 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.909e-06 2024-04-18T21:06:36.970 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.970 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.970 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:36.970 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.047818+0000", 2024-04-18T21:06:36.970 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018914337 2024-04-18T21:06:36.970 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.970 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.970 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:36.970 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.048094+0000", 2024-04-18T21:06:36.970 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00027653500000000001 2024-04-18T21:06:36.971 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.971 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.971 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:36.971 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.048471+0000", 2024-04-18T21:06:36.971 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00037705799999999999 2024-04-18T21:06:36.971 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.971 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.971 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:36.971 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052516+0000", 2024-04-18T21:06:36.971 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0040452739999999997 2024-04-18T21:06:36.971 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.971 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.971 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:36.971 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052535+0000", 2024-04-18T21:06:36.971 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.84e-05 2024-04-18T21:06:36.972 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.972 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.972 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:36.972 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052603+0000", 2024-04-18T21:06:36.972 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.8095000000000004e-05 2024-04-18T21:06:36.972 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.972 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.972 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:36.972 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052659+0000", 2024-04-18T21:06:36.972 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5653999999999999e-05 2024-04-18T21:06:36.972 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:36.972 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:36.972 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:36.972 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.972 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.972 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:36.973 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:36.973 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 101.926926255, 2024-04-18T21:06:36.973 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024516458000000001, 2024-04-18T21:06:36.973 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:36.973 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:36.973 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:36.973 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:36.973 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:36.973 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:36.973 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 165 2024-04-18T21:06:36.973 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.973 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:36.973 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.973 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:36.973 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:36.974 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:36.974 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.974 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.974 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:36.974 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:36.974 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:36.974 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.974 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.974 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:36.974 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028918+0000", 2024-04-18T21:06:36.974 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8000000000000005e-07 2024-04-18T21:06:36.974 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.974 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.974 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:36.975 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028924+0000", 2024-04-18T21:06:36.975 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5659999999999997e-06 2024-04-18T21:06:36.975 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.975 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.975 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:36.975 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028933+0000", 2024-04-18T21:06:36.975 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.38e-06 2024-04-18T21:06:36.975 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.975 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.975 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:36.975 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028940+0000", 2024-04-18T21:06:36.975 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0060000000000003e-06 2024-04-18T21:06:36.975 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.975 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.975 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:36.975 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.050846+0000", 2024-04-18T21:06:36.976 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021906119000000002 2024-04-18T21:06:36.976 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.976 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.976 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:36.976 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051025+0000", 2024-04-18T21:06:36.976 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017850799999999999 2024-04-18T21:06:36.976 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.976 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.976 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:36.976 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051221+0000", 2024-04-18T21:06:36.976 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019608700000000001 2024-04-18T21:06:36.976 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.976 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.976 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:36.976 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052675+0000", 2024-04-18T21:06:36.976 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0014537899999999999 2024-04-18T21:06:36.977 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.977 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.977 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:36.977 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053311+0000", 2024-04-18T21:06:36.977 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00063613299999999999 2024-04-18T21:06:36.977 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.977 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.977 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:36.977 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053381+0000", 2024-04-18T21:06:36.977 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0074999999999996e-05 2024-04-18T21:06:36.977 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.977 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.977 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:36.977 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053434+0000", 2024-04-18T21:06:36.977 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3013999999999998e-05 2024-04-18T21:06:36.977 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:36.978 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:36.978 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:36.978 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.978 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.978 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:36.978 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:36.978 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 101.81362077599999, 2024-04-18T21:06:36.978 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023772793, 2024-04-18T21:06:36.978 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:36.978 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:36.978 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:36.978 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:36.978 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:36.978 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:36.978 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 187 2024-04-18T21:06:36.979 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.979 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:36.979 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.979 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:36.979 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:36.979 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:36.979 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.979 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.979 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:36.979 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:36.979 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:36.979 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.979 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.979 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:36.979 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142224+0000", 2024-04-18T21:06:36.980 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.47e-07 2024-04-18T21:06:36.980 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.980 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.980 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:36.980 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142233+0000", 2024-04-18T21:06:36.980 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0729999999999994e-06 2024-04-18T21:06:36.980 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.980 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.980 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:36.980 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142255+0000", 2024-04-18T21:06:36.980 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.2535999999999999e-05 2024-04-18T21:06:36.980 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.980 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.980 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:36.981 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142268+0000", 2024-04-18T21:06:36.981 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2686e-05 2024-04-18T21:06:36.981 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.981 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.981 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:36.981 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160497+0000", 2024-04-18T21:06:36.981 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018228779000000001 2024-04-18T21:06:36.981 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.981 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.981 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:36.981 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160634+0000", 2024-04-18T21:06:36.981 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000137315 2024-04-18T21:06:36.981 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.981 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.982 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:36.982 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160831+0000", 2024-04-18T21:06:36.982 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019683100000000001 2024-04-18T21:06:36.982 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.982 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.982 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:36.982 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165129+0000", 2024-04-18T21:06:36.982 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0042981299999999998 2024-04-18T21:06:36.982 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.982 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.982 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:36.982 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165776+0000", 2024-04-18T21:06:36.983 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00064702900000000003 2024-04-18T21:06:36.983 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.983 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.983 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:36.983 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165921+0000", 2024-04-18T21:06:36.983 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014506 2024-04-18T21:06:36.983 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.983 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.983 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:36.983 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165996+0000", 2024-04-18T21:06:36.983 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.4406999999999994e-05 2024-04-18T21:06:36.983 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:36.983 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:36.983 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:36.984 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.984 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.984 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:36.984 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:36.984 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 101.813560178, 2024-04-18T21:06:36.984 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026802157, 2024-04-18T21:06:36.984 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:36.984 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:36.984 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:36.984 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:36.984 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:36.984 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:36.985 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 188 2024-04-18T21:06:36.985 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.985 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:36.985 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.985 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:36.985 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:36.985 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:36.985 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.985 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.985 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:36.985 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:36.985 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:36.985 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.985 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.985 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:36.985 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142284+0000", 2024-04-18T21:06:36.986 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4e-07 2024-04-18T21:06:36.986 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.986 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.986 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:36.986 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142374+0000", 2024-04-18T21:06:36.986 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0099999999999995e-05 2024-04-18T21:06:36.986 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.986 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.986 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:36.986 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142386+0000", 2024-04-18T21:06:36.986 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1770000000000001e-05 2024-04-18T21:06:36.986 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.986 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.986 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:36.987 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142394+0000", 2024-04-18T21:06:36.987 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.2130000000000008e-06 2024-04-18T21:06:36.987 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.987 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.987 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:36.987 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.161743+0000", 2024-04-18T21:06:36.987 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019348644000000002 2024-04-18T21:06:36.987 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.987 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.987 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:36.987 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.161865+0000", 2024-04-18T21:06:36.987 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012210899999999999 2024-04-18T21:06:36.987 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.987 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.988 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:36.988 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.162055+0000", 2024-04-18T21:06:36.988 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000189994 2024-04-18T21:06:36.988 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.988 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.988 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:36.988 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165735+0000", 2024-04-18T21:06:36.988 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0036803270000000002 2024-04-18T21:06:36.988 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.988 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.988 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:36.988 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.168911+0000", 2024-04-18T21:06:36.988 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0031753689999999999 2024-04-18T21:06:36.988 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.988 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.988 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:36.988 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169012+0000", 2024-04-18T21:06:36.989 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010157699999999999 2024-04-18T21:06:36.989 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.989 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.989 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:36.989 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169086+0000", 2024-04-18T21:06:36.989 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3213999999999994e-05 2024-04-18T21:06:36.989 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:36.989 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:36.989 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:36.989 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.989 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.989 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:36.989 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:36.989 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 101.813434872, 2024-04-18T21:06:36.989 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026811423000000001, 2024-04-18T21:06:36.990 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:36.990 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:36.990 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:36.990 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:36.990 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:36.990 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:36.990 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 189 2024-04-18T21:06:36.990 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.990 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:36.990 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.990 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:36.990 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:36.990 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:36.991 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.991 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.991 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:36.991 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:36.991 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:36.991 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.991 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.991 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:36.991 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142410+0000", 2024-04-18T21:06:36.991 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:06:36.991 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.991 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.991 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:36.992 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142415+0000", 2024-04-18T21:06:36.992 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.7939999999999999e-06 2024-04-18T21:06:36.992 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.992 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.992 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:36.992 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142470+0000", 2024-04-18T21:06:36.992 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4537999999999999e-05 2024-04-18T21:06:36.992 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.992 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.992 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:36.992 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142481+0000", 2024-04-18T21:06:36.992 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0966e-05 2024-04-18T21:06:36.992 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.992 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.993 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:36.993 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.163493+0000", 2024-04-18T21:06:36.993 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021012444000000002 2024-04-18T21:06:36.993 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.993 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.993 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:36.993 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.163727+0000", 2024-04-18T21:06:36.993 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000233339 2024-04-18T21:06:36.993 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.993 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.993 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:36.993 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.164102+0000", 2024-04-18T21:06:36.993 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000374872 2024-04-18T21:06:36.993 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.993 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.994 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:36.994 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.166528+0000", 2024-04-18T21:06:36.994 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0024258729999999998 2024-04-18T21:06:36.994 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.994 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.994 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:36.994 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169101+0000", 2024-04-18T21:06:36.994 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0025737680000000001 2024-04-18T21:06:36.994 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.994 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.994 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:36.994 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169171+0000", 2024-04-18T21:06:36.994 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0148000000000007e-05 2024-04-18T21:06:36.994 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.994 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.995 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:36.995 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169220+0000", 2024-04-18T21:06:36.995 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8767999999999998e-05 2024-04-18T21:06:36.995 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:36.995 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:36.995 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:36.995 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.995 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.995 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:36.995 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:36.995 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 91.339862319999995, 2024-04-18T21:06:36.995 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024082777999999999, 2024-04-18T21:06:36.995 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:36.996 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:36.996 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:36.996 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:36.996 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.996 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:36.996 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:36.996 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:36.996 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.996 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.996 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:36.996 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:36.996 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:36.996 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.996 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.996 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:36.996 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615984+0000", 2024-04-18T21:06:36.997 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.9869999999999999e-06 2024-04-18T21:06:36.997 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.997 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.997 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:36.997 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615999+0000", 2024-04-18T21:06:36.997 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4646e-05 2024-04-18T21:06:36.997 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.997 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.997 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:36.997 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616028+0000", 2024-04-18T21:06:36.997 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8952999999999999e-05 2024-04-18T21:06:36.997 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.997 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.997 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:36.998 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616052+0000", 2024-04-18T21:06:36.998 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.3941999999999999e-05 2024-04-18T21:06:36.998 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.998 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.998 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:36.998 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618010+0000", 2024-04-18T21:06:36.998 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0019581780000000001 2024-04-18T21:06:36.998 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.998 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.998 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:36.998 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618322+0000", 2024-04-18T21:06:36.998 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00031158899999999997 2024-04-18T21:06:36.998 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.999 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.999 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:36.999 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618587+0000", 2024-04-18T21:06:36.999 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00026495700000000002 2024-04-18T21:06:36.999 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.999 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.999 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:36.999 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629262+0000", 2024-04-18T21:06:36.999 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010675877 2024-04-18T21:06:36.999 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:36.999 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:36.999 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:36.999 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.639773+0000", 2024-04-18T21:06:36.999 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0105109 2024-04-18T21:06:36.999 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.000 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.000 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:37.000 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.639926+0000", 2024-04-18T21:06:37.000 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000152349 2024-04-18T21:06:37.000 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.000 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.000 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:37.000 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640064+0000", 2024-04-18T21:06:37.000 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0001384 2024-04-18T21:06:37.000 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:37.000 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:37.000 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:37.000 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.000 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.000 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:37.001 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:37.001 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 91.339749646000001, 2024-04-18T21:06:37.001 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030215005999999999, 2024-04-18T21:06:37.001 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:37.001 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:37.001 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:37.001 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:37.001 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.001 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:37.001 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:37.001 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:37.001 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.001 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.001 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:37.001 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:37.001 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:37.002 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.002 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.002 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:37.002 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616095+0000", 2024-04-18T21:06:37.002 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.446e-06 2024-04-18T21:06:37.002 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.002 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.002 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:37.002 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616104+0000", 2024-04-18T21:06:37.002 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6200000000000005e-06 2024-04-18T21:06:37.002 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.002 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.002 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:37.002 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616132+0000", 2024-04-18T21:06:37.002 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7668999999999999e-05 2024-04-18T21:06:37.003 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.003 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.003 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:37.003 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616149+0000", 2024-04-18T21:06:37.003 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7047000000000001e-05 2024-04-18T21:06:37.003 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.003 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.003 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:37.003 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619287+0000", 2024-04-18T21:06:37.003 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0031381450000000002 2024-04-18T21:06:37.003 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.003 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.003 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:37.003 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619503+0000", 2024-04-18T21:06:37.003 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000216522 2024-04-18T21:06:37.004 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.004 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.004 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:37.004 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619930+0000", 2024-04-18T21:06:37.004 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00042604900000000001 2024-04-18T21:06:37.004 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.004 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.004 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:37.004 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629281+0000", 2024-04-18T21:06:37.004 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0093512230000000005 2024-04-18T21:06:37.004 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.004 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.004 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:37.004 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646022+0000", 2024-04-18T21:06:37.005 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016741156 2024-04-18T21:06:37.005 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.005 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.005 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:37.005 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646198+0000", 2024-04-18T21:06:37.005 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000176009 2024-04-18T21:06:37.005 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.005 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.005 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:37.005 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646309+0000", 2024-04-18T21:06:37.005 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011112000000000001 2024-04-18T21:06:37.005 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:37.005 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:37.005 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:37.006 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.006 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.006 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:37.006 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:37.006 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 91.339664822000003, 2024-04-18T21:06:37.006 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030501176000000001, 2024-04-18T21:06:37.006 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:37.006 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:37.006 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:37.006 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:37.006 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.006 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:37.006 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:37.007 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:37.007 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.007 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.007 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:37.007 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:37.007 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:37.007 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.007 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.007 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:37.007 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616180+0000", 2024-04-18T21:06:37.007 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1000000000000001e-06 2024-04-18T21:06:37.007 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.007 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.007 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:37.008 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616188+0000", 2024-04-18T21:06:37.008 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4069999999999993e-06 2024-04-18T21:06:37.008 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.008 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.008 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:37.008 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616207+0000", 2024-04-18T21:06:37.008 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8335999999999999e-05 2024-04-18T21:06:37.008 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.008 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.008 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:37.008 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616225+0000", 2024-04-18T21:06:37.008 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8652999999999999e-05 2024-04-18T21:06:37.008 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.008 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.008 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:37.008 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620977+0000", 2024-04-18T21:06:37.009 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047512220000000003 2024-04-18T21:06:37.009 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.009 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.009 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:37.009 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621279+0000", 2024-04-18T21:06:37.009 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000302646 2024-04-18T21:06:37.009 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.009 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.009 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:37.009 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621584+0000", 2024-04-18T21:06:37.009 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000305142 2024-04-18T21:06:37.009 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.009 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.009 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:37.009 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629352+0000", 2024-04-18T21:06:37.010 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0077673689999999997 2024-04-18T21:06:37.010 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.010 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.010 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:37.010 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646480+0000", 2024-04-18T21:06:37.010 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017128259 2024-04-18T21:06:37.010 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.010 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.010 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:37.010 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646591+0000", 2024-04-18T21:06:37.010 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011113899999999999 2024-04-18T21:06:37.010 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.010 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.010 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:37.011 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646680+0000", 2024-04-18T21:06:37.011 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8902999999999999e-05 2024-04-18T21:06:37.011 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:37.011 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:37.011 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:37.011 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.011 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.011 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:37.011 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:37.011 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 91.339598323000004, 2024-04-18T21:06:37.011 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030779760999999999, 2024-04-18T21:06:37.011 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:37.011 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:37.011 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:37.011 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:37.012 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.012 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:37.012 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:37.012 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:37.012 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.012 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.012 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:37.012 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:37.012 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:37.012 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.012 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.012 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:37.012 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616246+0000", 2024-04-18T21:06:37.012 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0499999999999999e-06 2024-04-18T21:06:37.012 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.012 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.013 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:37.013 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616253+0000", 2024-04-18T21:06:37.013 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.5989999999999998e-06 2024-04-18T21:06:37.013 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.013 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.013 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:37.013 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616273+0000", 2024-04-18T21:06:37.013 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9916999999999999e-05 2024-04-18T21:06:37.013 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.013 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.013 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:37.013 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616287+0000", 2024-04-18T21:06:37.013 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3669000000000001e-05 2024-04-18T21:06:37.013 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.013 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.013 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:37.013 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622203+0000", 2024-04-18T21:06:37.014 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.005916737 2024-04-18T21:06:37.014 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.014 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.014 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:37.014 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622379+0000", 2024-04-18T21:06:37.014 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000175596 2024-04-18T21:06:37.014 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.014 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.014 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:37.014 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622707+0000", 2024-04-18T21:06:37.014 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00032784600000000002 2024-04-18T21:06:37.014 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.014 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.014 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:37.015 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629366+0000", 2024-04-18T21:06:37.015 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0066593279999999999 2024-04-18T21:06:37.015 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.015 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.015 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:37.015 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646813+0000", 2024-04-18T21:06:37.015 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017447059000000001 2024-04-18T21:06:37.015 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.015 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.015 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:37.015 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646946+0000", 2024-04-18T21:06:37.015 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013301200000000001 2024-04-18T21:06:37.015 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.015 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.015 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:37.016 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647025+0000", 2024-04-18T21:06:37.016 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8948000000000004e-05 2024-04-18T21:06:37.016 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:37.016 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:37.016 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:37.016 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.016 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.016 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:37.016 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:37.016 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 91.339514504999997, 2024-04-18T21:06:37.016 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.031512165000000002, 2024-04-18T21:06:37.016 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:37.016 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:37.016 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:37.017 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:37.017 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.017 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:37.017 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:37.017 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:37.017 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.017 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.017 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:37.017 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:37.017 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:37.017 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.017 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.017 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:37.017 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616330+0000", 2024-04-18T21:06:37.017 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.15e-06 2024-04-18T21:06:37.018 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.018 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.018 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:37.018 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616337+0000", 2024-04-18T21:06:37.018 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.1289999999999998e-06 2024-04-18T21:06:37.018 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.018 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.018 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:37.018 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616447+0000", 2024-04-18T21:06:37.018 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109561 2024-04-18T21:06:37.018 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.018 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.018 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:37.018 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616496+0000", 2024-04-18T21:06:37.019 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8591999999999998e-05 2024-04-18T21:06:37.019 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.019 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.019 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:37.019 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.623786+0000", 2024-04-18T21:06:37.019 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0072906799999999999 2024-04-18T21:06:37.019 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.019 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.019 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:37.019 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.623973+0000", 2024-04-18T21:06:37.019 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018717199999999999 2024-04-18T21:06:37.019 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.019 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.019 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:37.019 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624260+0000", 2024-04-18T21:06:37.020 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00028630600000000001 2024-04-18T21:06:37.020 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.020 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.020 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:37.020 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629381+0000", 2024-04-18T21:06:37.020 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0051211340000000003 2024-04-18T21:06:37.020 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.020 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.020 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:37.020 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647631+0000", 2024-04-18T21:06:37.020 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018249771000000001 2024-04-18T21:06:37.020 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.020 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.020 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:37.020 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647761+0000", 2024-04-18T21:06:37.021 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013037300000000001 2024-04-18T21:06:37.021 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.021 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.021 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:37.021 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647841+0000", 2024-04-18T21:06:37.021 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.0296999999999994e-05 2024-04-18T21:06:37.021 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:37.021 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:37.021 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:37.021 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.021 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.021 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:37.021 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:37.021 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 91.339309021000005, 2024-04-18T21:06:37.021 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043251955000000002, 2024-04-18T21:06:37.022 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:37.022 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:37.022 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:37.022 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:37.022 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.022 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:37.022 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:37.022 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:37.022 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.022 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.022 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:37.022 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:37.022 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:37.022 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.023 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.023 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:37.023 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616536+0000", 2024-04-18T21:06:37.023 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2869999999999999e-06 2024-04-18T21:06:37.023 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.023 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.023 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:37.023 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616572+0000", 2024-04-18T21:06:37.023 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.6261999999999999e-05 2024-04-18T21:06:37.023 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.023 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.023 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:37.023 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616593+0000", 2024-04-18T21:06:37.023 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1310000000000001e-05 2024-04-18T21:06:37.023 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.024 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.024 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:37.024 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616614+0000", 2024-04-18T21:06:37.024 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.0936000000000001e-05 2024-04-18T21:06:37.024 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.024 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.024 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:37.024 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629501+0000", 2024-04-18T21:06:37.024 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.012886819000000001 2024-04-18T21:06:37.024 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.024 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.024 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:37.024 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629696+0000", 2024-04-18T21:06:37.024 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019485499999999999 2024-04-18T21:06:37.024 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.025 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.025 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:37.025 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629940+0000", 2024-04-18T21:06:37.025 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00024386399999999999 2024-04-18T21:06:37.025 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.025 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.025 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:37.025 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640100+0000", 2024-04-18T21:06:37.025 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010159645 2024-04-18T21:06:37.025 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.025 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.025 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:37.025 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659516+0000", 2024-04-18T21:06:37.025 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019416563000000001 2024-04-18T21:06:37.025 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.025 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.026 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:37.026 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659684+0000", 2024-04-18T21:06:37.026 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016750900000000001 2024-04-18T21:06:37.026 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.026 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.026 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:37.026 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659787+0000", 2024-04-18T21:06:37.026 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000102905 2024-04-18T21:06:37.026 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:37.026 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:37.026 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:37.026 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.026 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.026 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:37.027 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:37.027 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 91.339203898999997, 2024-04-18T21:06:37.027 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043581898000000001, 2024-04-18T21:06:37.027 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:37.027 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:37.027 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:37.027 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:37.027 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.027 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:37.027 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:37.027 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:37.027 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.027 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.027 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:37.027 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:37.027 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:37.028 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.028 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.028 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:37.028 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616641+0000", 2024-04-18T21:06:37.028 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:06:37.028 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.028 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.028 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:37.028 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616648+0000", 2024-04-18T21:06:37.028 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3860000000000001e-06 2024-04-18T21:06:37.028 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.028 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.028 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:37.028 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616666+0000", 2024-04-18T21:06:37.028 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7583000000000001e-05 2024-04-18T21:06:37.028 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.029 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.029 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:37.029 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616679+0000", 2024-04-18T21:06:37.029 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3322999999999999e-05 2024-04-18T21:06:37.029 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.029 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.029 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:37.029 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630373+0000", 2024-04-18T21:06:37.029 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013694207999999999 2024-04-18T21:06:37.029 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.029 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.029 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:37.029 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630545+0000", 2024-04-18T21:06:37.029 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000171683 2024-04-18T21:06:37.029 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.030 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.030 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:37.030 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630728+0000", 2024-04-18T21:06:37.030 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000182599 2024-04-18T21:06:37.030 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.030 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.030 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:37.030 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640600+0000", 2024-04-18T21:06:37.030 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0098726119999999994 2024-04-18T21:06:37.030 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.030 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.030 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:37.030 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659927+0000", 2024-04-18T21:06:37.030 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019326724999999999 2024-04-18T21:06:37.030 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.031 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.031 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:37.031 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660112+0000", 2024-04-18T21:06:37.031 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000185203 2024-04-18T21:06:37.031 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.031 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.031 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:37.031 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660222+0000", 2024-04-18T21:06:37.031 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109343 2024-04-18T21:06:37.031 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:37.031 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:37.031 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:37.031 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.032 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.032 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:37.032 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:37.032 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 91.338338540999999, 2024-04-18T21:06:37.032 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043121310000000003, 2024-04-18T21:06:37.032 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:37.032 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:37.032 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:37.032 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:37.032 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.032 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:37.032 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:37.032 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:37.032 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.033 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.033 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:37.033 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:37.033 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:37.033 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.033 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.033 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:37.033 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617506+0000", 2024-04-18T21:06:37.033 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9999999999999995e-07 2024-04-18T21:06:37.033 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.033 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.033 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:37.033 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617513+0000", 2024-04-18T21:06:37.034 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.9700000000000002e-06 2024-04-18T21:06:37.034 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.034 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.034 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:37.034 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617531+0000", 2024-04-18T21:06:37.034 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8105999999999999e-05 2024-04-18T21:06:37.034 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.034 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.034 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:37.034 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617545+0000", 2024-04-18T21:06:37.034 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3703000000000001e-05 2024-04-18T21:06:37.034 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.034 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.034 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:37.035 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632129+0000", 2024-04-18T21:06:37.035 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.014584135999999999 2024-04-18T21:06:37.035 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.035 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.035 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:37.035 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632361+0000", 2024-04-18T21:06:37.035 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023171800000000001 2024-04-18T21:06:37.035 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.035 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.035 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:37.035 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632804+0000", 2024-04-18T21:06:37.035 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000443549 2024-04-18T21:06:37.035 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.035 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.036 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:37.036 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646340+0000", 2024-04-18T21:06:37.036 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013535902000000001 2024-04-18T21:06:37.036 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.036 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.036 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:37.036 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660363+0000", 2024-04-18T21:06:37.036 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01402318 2024-04-18T21:06:37.036 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.036 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.036 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:37.036 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660523+0000", 2024-04-18T21:06:37.036 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00015989899999999999 2024-04-18T21:06:37.036 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.036 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.036 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:37.037 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660626+0000", 2024-04-18T21:06:37.037 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010314699999999999 2024-04-18T21:06:37.037 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:37.037 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:37.037 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:37.037 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.037 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.037 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:37.037 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:37.037 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 91.338198848000005, 2024-04-18T21:06:37.037 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024927483, 2024-04-18T21:06:37.037 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:37.037 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:37.037 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:37.037 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:37.037 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.038 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:37.038 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:37.038 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:37.038 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.038 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.038 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:37.038 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:37.038 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:37.038 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.038 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.038 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:37.038 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617646+0000", 2024-04-18T21:06:37.038 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3030000000000001e-06 2024-04-18T21:06:37.038 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.039 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.039 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:37.039 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617653+0000", 2024-04-18T21:06:37.039 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7530000000000004e-06 2024-04-18T21:06:37.039 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.039 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.039 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:37.039 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617673+0000", 2024-04-18T21:06:37.039 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9967e-05 2024-04-18T21:06:37.039 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.039 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.039 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:37.039 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617688+0000", 2024-04-18T21:06:37.039 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5153e-05 2024-04-18T21:06:37.039 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.039 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.040 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:37.040 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619244+0000", 2024-04-18T21:06:37.040 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001555531 2024-04-18T21:06:37.040 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.040 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.040 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:37.040 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619361+0000", 2024-04-18T21:06:37.040 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011784400000000001 2024-04-18T21:06:37.040 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.040 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.040 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:37.040 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619604+0000", 2024-04-18T21:06:37.040 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000243007 2024-04-18T21:06:37.040 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.040 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.040 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:37.041 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.625480+0000", 2024-04-18T21:06:37.041 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0058759349999999997 2024-04-18T21:06:37.041 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.041 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.041 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:37.041 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642342+0000", 2024-04-18T21:06:37.041 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016861373999999998 2024-04-18T21:06:37.041 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.041 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.041 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:37.041 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642484+0000", 2024-04-18T21:06:37.041 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000142423 2024-04-18T21:06:37.041 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.041 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.041 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:37.041 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642572+0000", 2024-04-18T21:06:37.042 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8193000000000001e-05 2024-04-18T21:06:37.042 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:37.042 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:37.042 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:37.042 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.042 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.042 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:37.042 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:37.042 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 91.337917344999994, 2024-04-18T21:06:37.042 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024956974999999999, 2024-04-18T21:06:37.042 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:37.042 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:37.042 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:37.042 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:37.042 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.043 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:37.043 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:37.043 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:37.043 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.043 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.043 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:37.043 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:37.043 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:37.043 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.043 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.043 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:37.043 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617928+0000", 2024-04-18T21:06:37.043 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5430000000000001e-06 2024-04-18T21:06:37.043 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.043 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.043 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:37.044 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617937+0000", 2024-04-18T21:06:37.044 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6629999999999999e-06 2024-04-18T21:06:37.044 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.044 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.044 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:37.044 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617955+0000", 2024-04-18T21:06:37.044 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8749999999999998e-05 2024-04-18T21:06:37.044 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.044 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.044 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:37.044 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617971+0000", 2024-04-18T21:06:37.044 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.605e-05 2024-04-18T21:06:37.044 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.044 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.044 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:37.045 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621019+0000", 2024-04-18T21:06:37.045 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0030472369999999999 2024-04-18T21:06:37.045 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.045 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.045 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:37.045 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621249+0000", 2024-04-18T21:06:37.045 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000230075 2024-04-18T21:06:37.045 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.045 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.045 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:37.045 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621450+0000", 2024-04-18T21:06:37.045 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020166499999999999 2024-04-18T21:06:37.045 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.045 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.045 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:37.046 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.626233+0000", 2024-04-18T21:06:37.046 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047827390000000003 2024-04-18T21:06:37.046 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.046 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.046 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:37.046 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642693+0000", 2024-04-18T21:06:37.046 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01645961 2024-04-18T21:06:37.046 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.046 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.046 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:37.046 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642798+0000", 2024-04-18T21:06:37.046 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010559499999999999 2024-04-18T21:06:37.046 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.047 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.047 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:37.047 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642883+0000", 2024-04-18T21:06:37.047 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5048000000000003e-05 2024-04-18T21:06:37.047 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:37.047 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:37.047 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:37.047 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.047 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.047 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:37.047 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:37.047 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 91.336221717000001, 2024-04-18T21:06:37.047 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024086478000000001, 2024-04-18T21:06:37.047 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:37.047 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:37.048 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:37.048 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:37.048 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.048 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:37.048 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:37.048 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:37.048 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.048 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.048 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:37.048 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:37.048 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:37.048 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.048 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.048 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:37.048 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619624+0000", 2024-04-18T21:06:37.048 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.75e-06 2024-04-18T21:06:37.049 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.049 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.049 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:37.049 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619637+0000", 2024-04-18T21:06:37.049 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3540000000000001e-05 2024-04-18T21:06:37.049 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.049 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.049 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:37.049 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619666+0000", 2024-04-18T21:06:37.049 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8685999999999999e-05 2024-04-18T21:06:37.049 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.049 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.049 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:37.049 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619685+0000", 2024-04-18T21:06:37.050 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8681999999999998e-05 2024-04-18T21:06:37.050 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.050 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.050 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:37.050 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622275+0000", 2024-04-18T21:06:37.050 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0025899260000000002 2024-04-18T21:06:37.050 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.050 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.050 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:37.050 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622572+0000", 2024-04-18T21:06:37.050 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00029722 2024-04-18T21:06:37.050 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.050 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.051 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:37.051 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622752+0000", 2024-04-18T21:06:37.051 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018065900000000001 2024-04-18T21:06:37.051 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.051 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.051 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:37.051 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.626326+0000", 2024-04-18T21:06:37.051 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035737310000000001 2024-04-18T21:06:37.051 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.051 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.051 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:37.051 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643565+0000", 2024-04-18T21:06:37.051 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017238430999999999 2024-04-18T21:06:37.051 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.051 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.051 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:37.052 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643646+0000", 2024-04-18T21:06:37.052 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.1481000000000001e-05 2024-04-18T21:06:37.052 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.052 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.052 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:37.052 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643708+0000", 2024-04-18T21:06:37.052 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.2372000000000005e-05 2024-04-18T21:06:37.052 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:37.052 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:37.052 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:37.052 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.052 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.052 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:37.052 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:37.052 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 91.336055564000006, 2024-04-18T21:06:37.052 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026822450000000001, 2024-04-18T21:06:37.053 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:37.053 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:37.053 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:37.053 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:37.053 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.053 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:37.053 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:37.053 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:37.053 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.053 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.053 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:37.053 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:37.053 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:37.053 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.054 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.054 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:37.054 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619789+0000", 2024-04-18T21:06:37.054 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:06:37.054 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.054 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.054 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:37.054 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619797+0000", 2024-04-18T21:06:37.054 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.6899999999999992e-06 2024-04-18T21:06:37.054 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.054 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.054 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:37.054 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619816+0000", 2024-04-18T21:06:37.054 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9352999999999999e-05 2024-04-18T21:06:37.054 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.055 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.055 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:37.055 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619832+0000", 2024-04-18T21:06:37.055 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6013000000000001e-05 2024-04-18T21:06:37.055 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.055 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.055 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:37.055 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620528+0000", 2024-04-18T21:06:37.055 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00069565600000000001 2024-04-18T21:06:37.055 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.055 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.055 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:37.055 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620735+0000", 2024-04-18T21:06:37.055 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000207025 2024-04-18T21:06:37.055 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.056 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.056 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:37.056 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620912+0000", 2024-04-18T21:06:37.056 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017748199999999999 2024-04-18T21:06:37.056 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.056 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.056 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:37.056 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.625605+0000", 2024-04-18T21:06:37.056 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0046924439999999996 2024-04-18T21:06:37.056 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.056 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.056 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:37.056 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646349+0000", 2024-04-18T21:06:37.056 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.020744318000000001 2024-04-18T21:06:37.056 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.056 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.057 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:37.057 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646483+0000", 2024-04-18T21:06:37.057 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013428999999999999 2024-04-18T21:06:37.057 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.057 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.057 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:37.057 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646611+0000", 2024-04-18T21:06:37.057 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012710299999999999 2024-04-18T21:06:37.057 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:37.057 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:37.057 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:37.057 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.057 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.057 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:37.057 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:06:37.057 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 91.335385130999995, 2024-04-18T21:06:37.058 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023516516000000001, 2024-04-18T21:06:37.058 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:37.058 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:37.058 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:06:37.058 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:37.058 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.058 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:37.058 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:06:37.058 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:37.058 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.058 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.058 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:37.058 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:06:37.058 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:37.059 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.059 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.059 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:37.059 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620460+0000", 2024-04-18T21:06:37.059 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.787e-06 2024-04-18T21:06:37.059 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.059 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.059 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:37.059 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620470+0000", 2024-04-18T21:06:37.059 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.2560000000000008e-06 2024-04-18T21:06:37.059 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.059 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.059 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:37.059 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620496+0000", 2024-04-18T21:06:37.059 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.6205999999999999e-05 2024-04-18T21:06:37.060 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.060 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.060 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:37.060 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620517+0000", 2024-04-18T21:06:37.060 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1223e-05 2024-04-18T21:06:37.060 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.060 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.060 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:37.060 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624060+0000", 2024-04-18T21:06:37.060 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035434160000000002 2024-04-18T21:06:37.060 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.060 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.060 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:37.060 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624390+0000", 2024-04-18T21:06:37.061 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00033000500000000002 2024-04-18T21:06:37.061 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:37.061 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:37.061 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:37.061 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643975+0000", 2024-04-18T21:06:37.061 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019584622999999999 2024-04-18T21:06:37.061 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:37.061 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:37.061 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:37.061 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:37.061 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:37.061 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:37.063 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:37.063 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:37.062+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:37.164 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:37.166+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:37.194 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:06:37.194 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [], 2024-04-18T21:06:37.194 INFO:teuthology.orchestra.run.smithi150.stdout: "num_ops": 0 2024-04-18T21:06:37.194 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:06:37.209 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:37.265 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:37.266+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:37.330 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:06:37.330 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [], 2024-04-18T21:06:37.330 INFO:teuthology.orchestra.run.smithi150.stdout: "complaint_time": 30, 2024-04-18T21:06:37.330 INFO:teuthology.orchestra.run.smithi150.stdout: "num_blocked_ops": 0 2024-04-18T21:06:37.330 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:06:37.344 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:37.365 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:37.366+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:37.387 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-18T21:06:37.463 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:06:37.464 INFO:teuthology.orchestra.run.smithi150.stdout: "size": 20, 2024-04-18T21:06:37.464 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 600, 2024-04-18T21:06:37.464 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [ 2024-04-18T21:06:37.464 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.464 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-18T21:06:37.464 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:06:37.464 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 102.659041157, 2024-04-18T21:06:37.464 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0093051590000000003, 2024-04-18T21:06:37.464 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:37.464 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:37.464 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:37.464 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:37.465 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.465 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:37.465 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:06:37.465 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:37.465 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.465 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.465 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:37.465 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:06:37.465 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:37.465 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.465 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.465 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:37.465 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804851+0000", 2024-04-18T21:06:37.465 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7039999999999999e-06 2024-04-18T21:06:37.465 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.465 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.466 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:37.466 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804864+0000", 2024-04-18T21:06:37.466 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.276e-05 2024-04-18T21:06:37.466 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.466 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.466 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:37.466 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804895+0000", 2024-04-18T21:06:37.466 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.1204999999999997e-05 2024-04-18T21:06:37.466 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.466 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.466 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:37.466 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804908+0000", 2024-04-18T21:06:37.466 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3317e-05 2024-04-18T21:06:37.466 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.467 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.467 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:37.467 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805131+0000", 2024-04-18T21:06:37.467 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00022246700000000001 2024-04-18T21:06:37.467 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.467 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.467 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:37.467 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805171+0000", 2024-04-18T21:06:37.467 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.0164999999999999e-05 2024-04-18T21:06:37.467 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.467 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.467 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:37.467 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814086+0000", 2024-04-18T21:06:37.467 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0089155329999999998 2024-04-18T21:06:37.467 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.467 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.468 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:37.468 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814154+0000", 2024-04-18T21:06:37.468 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.8008000000000003e-05 2024-04-18T21:06:37.468 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:37.468 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:37.468 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:37.468 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.468 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.468 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-18T21:06:37.468 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:06:37.468 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 102.658275964, 2024-04-18T21:06:37.468 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0086469770000000001, 2024-04-18T21:06:37.468 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:37.468 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:37.468 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:37.469 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:37.469 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.469 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:37.469 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:06:37.469 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:37.469 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.469 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.469 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:37.469 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805614+0000", 2024-04-18T21:06:37.469 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:37.469 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.469 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.469 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:37.469 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805616+0000", 2024-04-18T21:06:37.470 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7799999999999999e-06 2024-04-18T21:06:37.470 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.470 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.470 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:37.470 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805707+0000", 2024-04-18T21:06:37.470 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0917999999999999e-05 2024-04-18T21:06:37.470 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.470 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.470 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:37.470 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805739+0000", 2024-04-18T21:06:37.470 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.2512000000000003e-05 2024-04-18T21:06:37.470 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.470 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.471 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:37.471 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805763+0000", 2024-04-18T21:06:37.471 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3266000000000001e-05 2024-04-18T21:06:37.471 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.471 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.471 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:37.471 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.806024+0000", 2024-04-18T21:06:37.471 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000261716 2024-04-18T21:06:37.471 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.471 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.471 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:37.471 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.806073+0000", 2024-04-18T21:06:37.471 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.8844999999999997e-05 2024-04-18T21:06:37.471 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.471 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.471 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:37.471 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814162+0000", 2024-04-18T21:06:37.472 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0080882860000000001 2024-04-18T21:06:37.472 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.472 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.472 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:37.472 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814261+0000", 2024-04-18T21:06:37.472 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.9654000000000005e-05 2024-04-18T21:06:37.472 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:37.472 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:37.472 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:37.472 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.472 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.472 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'64)", 2024-04-18T21:06:37.472 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:06:37.472 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 102.65650492, 2024-04-18T21:06:37.472 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0089721509999999994, 2024-04-18T21:06:37.472 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:37.473 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:37.473 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:37.473 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:37.473 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.473 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:37.473 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:06:37.473 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:37.473 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.473 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.473 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:37.473 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:06:37.473 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:37.473 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.473 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.474 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:37.474 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807387+0000", 2024-04-18T21:06:37.474 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.0329999999999998e-06 2024-04-18T21:06:37.474 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.474 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.474 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:37.474 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807443+0000", 2024-04-18T21:06:37.474 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.5376e-05 2024-04-18T21:06:37.474 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.474 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.474 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:37.474 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807467+0000", 2024-04-18T21:06:37.474 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.4621999999999999e-05 2024-04-18T21:06:37.474 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.475 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.475 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:37.475 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807482+0000", 2024-04-18T21:06:37.475 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.436e-05 2024-04-18T21:06:37.475 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.475 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.475 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:37.475 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.809243+0000", 2024-04-18T21:06:37.475 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001761725 2024-04-18T21:06:37.475 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.475 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.475 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:37.475 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.809295+0000", 2024-04-18T21:06:37.475 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.1445e-05 2024-04-18T21:06:37.475 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.476 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.476 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:37.476 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.816293+0000", 2024-04-18T21:06:37.476 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0069981749999999997 2024-04-18T21:06:37.476 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.476 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.476 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:37.476 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.816357+0000", 2024-04-18T21:06:37.476 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.4414999999999999e-05 2024-04-18T21:06:37.476 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:37.476 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:37.476 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:37.476 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.476 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.476 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:37.476 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:06:37.477 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 91.848595549999999, 2024-04-18T21:06:37.477 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.040843365, 2024-04-18T21:06:37.477 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:37.477 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:37.477 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:37.477 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:37.477 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.477 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:37.477 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:06:37.477 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:37.477 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.477 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.477 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:37.477 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:06:37.477 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:37.477 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.478 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.478 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:37.478 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615297+0000", 2024-04-18T21:06:37.478 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2800000000000002e-06 2024-04-18T21:06:37.478 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.478 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.478 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:37.478 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615308+0000", 2024-04-18T21:06:37.478 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0813e-05 2024-04-18T21:06:37.478 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.478 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.478 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:37.478 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615330+0000", 2024-04-18T21:06:37.478 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2370000000000001e-05 2024-04-18T21:06:37.479 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.479 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.479 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:37.479 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615346+0000", 2024-04-18T21:06:37.479 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6200000000000001e-05 2024-04-18T21:06:37.479 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.479 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.479 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:37.479 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615470+0000", 2024-04-18T21:06:37.479 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012385799999999999 2024-04-18T21:06:37.479 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.479 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.479 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:37.479 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615488+0000", 2024-04-18T21:06:37.479 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7923000000000001e-05 2024-04-18T21:06:37.480 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.480 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.480 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:37.480 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.630993+0000", 2024-04-18T21:06:37.480 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.01550532 2024-04-18T21:06:37.480 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.480 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.480 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:37.480 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631165+0000", 2024-04-18T21:06:37.480 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000171588 2024-04-18T21:06:37.480 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.480 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.480 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:37.480 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631320+0000", 2024-04-18T21:06:37.480 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000155162 2024-04-18T21:06:37.481 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.481 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.481 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:37.481 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635157+0000", 2024-04-18T21:06:37.481 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0038370790000000002 2024-04-18T21:06:37.481 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.481 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.481 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:37.481 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.655904+0000", 2024-04-18T21:06:37.481 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.020746483999999999 2024-04-18T21:06:37.481 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.481 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.481 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:37.481 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656032+0000", 2024-04-18T21:06:37.481 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012864199999999999 2024-04-18T21:06:37.481 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.482 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.482 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:37.482 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656138+0000", 2024-04-18T21:06:37.482 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000105646 2024-04-18T21:06:37.482 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:37.482 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:37.482 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:37.482 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.482 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.482 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:37.482 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:06:37.482 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 91.848503378000004, 2024-04-18T21:06:37.482 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.041266444999999999, 2024-04-18T21:06:37.483 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:37.483 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:37.483 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:37.483 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:37.483 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.483 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:37.483 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:06:37.483 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:37.483 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.483 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.483 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:37.483 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:06:37.483 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:37.483 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.484 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.484 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:37.484 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615388+0000", 2024-04-18T21:06:37.484 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:06:37.484 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.484 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.484 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:37.484 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:06:37.484 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.7299999999999994e-06 2024-04-18T21:06:37.484 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.484 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.484 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:37.484 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615415+0000", 2024-04-18T21:06:37.484 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7807000000000001e-05 2024-04-18T21:06:37.484 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.485 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.485 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:37.485 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615431+0000", 2024-04-18T21:06:37.485 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6127e-05 2024-04-18T21:06:37.485 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.485 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.485 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:37.485 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615621+0000", 2024-04-18T21:06:37.485 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000189781 2024-04-18T21:06:37.485 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.485 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.485 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:37.485 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615634+0000", 2024-04-18T21:06:37.485 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3383e-05 2024-04-18T21:06:37.486 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.486 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.486 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:37.486 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631703+0000", 2024-04-18T21:06:37.486 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016068737 2024-04-18T21:06:37.486 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.486 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.486 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:37.486 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631809+0000", 2024-04-18T21:06:37.486 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000106823 2024-04-18T21:06:37.486 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.486 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.486 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:37.486 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631988+0000", 2024-04-18T21:06:37.486 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000179008 2024-04-18T21:06:37.487 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.487 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.487 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:37.487 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635172+0000", 2024-04-18T21:06:37.487 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.003183029 2024-04-18T21:06:37.487 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.487 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.487 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:37.487 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656392+0000", 2024-04-18T21:06:37.487 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.021220638999999999 2024-04-18T21:06:37.487 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.487 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.487 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:37.487 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656533+0000", 2024-04-18T21:06:37.487 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014126500000000001 2024-04-18T21:06:37.488 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.488 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.488 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:37.488 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656653+0000", 2024-04-18T21:06:37.488 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000119883 2024-04-18T21:06:37.488 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:37.488 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:37.488 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:37.488 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.488 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.488 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:37.488 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:06:37.488 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 91.848415954999993, 2024-04-18T21:06:37.488 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.042492302000000003, 2024-04-18T21:06:37.488 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:37.488 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:37.489 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:37.489 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:37.489 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.489 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:37.489 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:06:37.489 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:37.489 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.489 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.489 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:37.489 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:06:37.489 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:37.489 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.489 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.489 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:37.490 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615475+0000", 2024-04-18T21:06:37.490 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.17e-06 2024-04-18T21:06:37.490 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.490 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.490 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:37.490 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615528+0000", 2024-04-18T21:06:37.490 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.2159e-05 2024-04-18T21:06:37.490 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.490 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.490 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:37.490 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615542+0000", 2024-04-18T21:06:37.490 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4197e-05 2024-04-18T21:06:37.490 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.490 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.491 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:37.491 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615559+0000", 2024-04-18T21:06:37.491 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.749e-05 2024-04-18T21:06:37.491 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.491 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.491 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:37.491 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615685+0000", 2024-04-18T21:06:37.491 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012617499999999999 2024-04-18T21:06:37.491 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.491 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.491 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:37.491 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:06:37.491 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4749999999999999e-05 2024-04-18T21:06:37.491 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.491 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.491 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:37.492 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632332+0000", 2024-04-18T21:06:37.492 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016631988 2024-04-18T21:06:37.492 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.492 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.492 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:37.492 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632477+0000", 2024-04-18T21:06:37.492 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014437200000000001 2024-04-18T21:06:37.492 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.492 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.492 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:37.492 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632620+0000", 2024-04-18T21:06:37.492 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000143566 2024-04-18T21:06:37.492 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.492 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.492 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:37.493 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635185+0000", 2024-04-18T21:06:37.493 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0025644209999999999 2024-04-18T21:06:37.493 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.493 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.493 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:37.493 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657803+0000", 2024-04-18T21:06:37.493 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.022618743 2024-04-18T21:06:37.493 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.493 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.493 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:37.493 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657890+0000", 2024-04-18T21:06:37.493 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.6688999999999996e-05 2024-04-18T21:06:37.493 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.493 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.493 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:37.493 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657967+0000", 2024-04-18T21:06:37.494 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.6582000000000006e-05 2024-04-18T21:06:37.494 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:37.494 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:37.494 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:37.494 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.494 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.494 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:37.494 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:06:37.494 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 91.848285142999998, 2024-04-18T21:06:37.494 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.043603435000000003, 2024-04-18T21:06:37.494 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:37.494 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:37.494 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:37.495 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:37.495 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.495 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:37.495 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:06:37.495 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:37.495 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.495 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.495 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:37.495 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:06:37.495 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:37.495 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.495 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.495 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:37.495 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615607+0000", 2024-04-18T21:06:37.496 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4300000000000001e-06 2024-04-18T21:06:37.496 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.496 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.496 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:37.496 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615614+0000", 2024-04-18T21:06:37.496 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.4100000000000002e-06 2024-04-18T21:06:37.496 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.496 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.496 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:37.496 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615632+0000", 2024-04-18T21:06:37.496 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7863000000000002e-05 2024-04-18T21:06:37.496 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.496 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.496 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:37.496 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615647+0000", 2024-04-18T21:06:37.497 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5187e-05 2024-04-18T21:06:37.497 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.497 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.497 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:37.497 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615765+0000", 2024-04-18T21:06:37.497 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000117955 2024-04-18T21:06:37.497 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.497 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.497 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:37.497 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615781+0000", 2024-04-18T21:06:37.497 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6123000000000001e-05 2024-04-18T21:06:37.497 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.497 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.497 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:37.498 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633055+0000", 2024-04-18T21:06:37.498 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.017273909 2024-04-18T21:06:37.498 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.498 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.498 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:37.498 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633254+0000", 2024-04-18T21:06:37.498 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00019903799999999999 2024-04-18T21:06:37.498 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.498 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.498 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:37.498 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633624+0000", 2024-04-18T21:06:37.498 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000369656 2024-04-18T21:06:37.498 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.498 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.499 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:37.499 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635595+0000", 2024-04-18T21:06:37.499 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001971287 2024-04-18T21:06:37.499 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.499 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.499 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:37.499 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659026+0000", 2024-04-18T21:06:37.499 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.023431495 2024-04-18T21:06:37.499 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.499 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.499 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:37.499 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659117+0000", 2024-04-18T21:06:37.499 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0885999999999997e-05 2024-04-18T21:06:37.499 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.500 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.500 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:37.500 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659209+0000", 2024-04-18T21:06:37.500 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.1195999999999999e-05 2024-04-18T21:06:37.500 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:37.500 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:37.500 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:37.500 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.500 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.500 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:37.500 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:37.500 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 91.848219913999998, 2024-04-18T21:06:37.500 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.03492514, 2024-04-18T21:06:37.501 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:37.501 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:37.501 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:37.501 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:37.501 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.501 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:37.501 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:37.501 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:37.501 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.501 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.501 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:37.501 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:37.501 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:37.501 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.501 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.501 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:37.502 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:06:37.502 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.407e-06 2024-04-18T21:06:37.502 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.502 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.502 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:37.502 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615679+0000", 2024-04-18T21:06:37.502 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.2130000000000002e-06 2024-04-18T21:06:37.502 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.502 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.502 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:37.502 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615701+0000", 2024-04-18T21:06:37.502 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2316000000000001e-05 2024-04-18T21:06:37.502 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.503 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.503 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:37.503 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615717+0000", 2024-04-18T21:06:37.503 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6197000000000001e-05 2024-04-18T21:06:37.503 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.503 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.503 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:37.503 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615828+0000", 2024-04-18T21:06:37.503 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000110899 2024-04-18T21:06:37.503 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.503 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.503 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:37.503 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615840+0000", 2024-04-18T21:06:37.503 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.1423000000000001e-05 2024-04-18T21:06:37.504 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.504 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.504 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:37.504 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628046+0000", 2024-04-18T21:06:37.504 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.012206295000000001 2024-04-18T21:06:37.504 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.504 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.504 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:37.504 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628323+0000", 2024-04-18T21:06:37.504 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00027658700000000001 2024-04-18T21:06:37.504 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.504 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.504 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:37.504 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628599+0000", 2024-04-18T21:06:37.504 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00027676699999999997 2024-04-18T21:06:37.505 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.505 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.505 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:37.505 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634869+0000", 2024-04-18T21:06:37.505 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.006269536 2024-04-18T21:06:37.505 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.505 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.505 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:37.505 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650333+0000", 2024-04-18T21:06:37.505 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.015463645999999999 2024-04-18T21:06:37.505 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.505 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.505 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:37.505 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650474+0000", 2024-04-18T21:06:37.505 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014091799999999999 2024-04-18T21:06:37.506 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.506 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.506 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:37.506 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650595+0000", 2024-04-18T21:06:37.506 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012193600000000001 2024-04-18T21:06:37.506 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:37.506 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:37.506 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:37.506 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.506 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.506 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:37.506 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:06:37.506 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 91.848134805000001, 2024-04-18T21:06:37.507 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.040588320999999997, 2024-04-18T21:06:37.507 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:37.507 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:37.507 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:37.507 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:37.507 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.507 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:37.507 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:06:37.507 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:37.507 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.507 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.507 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:37.507 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:06:37.507 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:37.507 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.508 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.508 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:37.508 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615757+0000", 2024-04-18T21:06:37.508 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2270000000000001e-06 2024-04-18T21:06:37.508 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.508 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.508 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:37.508 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615765+0000", 2024-04-18T21:06:37.508 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.9400000000000002e-06 2024-04-18T21:06:37.508 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.508 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.508 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:37.508 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615785+0000", 2024-04-18T21:06:37.508 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.0749000000000001e-05 2024-04-18T21:06:37.508 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.508 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.509 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:37.509 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615804+0000", 2024-04-18T21:06:37.509 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.8774e-05 2024-04-18T21:06:37.509 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.509 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.509 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:37.509 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615888+0000", 2024-04-18T21:06:37.509 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.4111999999999997e-05 2024-04-18T21:06:37.509 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.509 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.509 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:37.509 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615895+0000", 2024-04-18T21:06:37.509 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.0469999999999996e-06 2024-04-18T21:06:37.509 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.509 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.510 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:37.510 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629280+0000", 2024-04-18T21:06:37.510 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.013384416 2024-04-18T21:06:37.510 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.510 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.510 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:37.510 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629488+0000", 2024-04-18T21:06:37.510 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00020852800000000001 2024-04-18T21:06:37.510 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.510 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.510 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:37.510 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629869+0000", 2024-04-18T21:06:37.510 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00038042300000000001 2024-04-18T21:06:37.510 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.510 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.511 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:37.511 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635041+0000", 2024-04-18T21:06:37.511 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.005172383 2024-04-18T21:06:37.511 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.511 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.511 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:37.511 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656125+0000", 2024-04-18T21:06:37.511 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.021084025999999999 2024-04-18T21:06:37.511 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.511 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.511 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:37.511 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656240+0000", 2024-04-18T21:06:37.511 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000115352 2024-04-18T21:06:37.511 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.511 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.511 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:37.512 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656344+0000", 2024-04-18T21:06:37.512 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00010334400000000001 2024-04-18T21:06:37.512 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:37.512 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:37.512 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:37.512 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.512 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.512 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:37.512 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:37.512 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 91.848067485000001, 2024-04-18T21:06:37.512 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.043549577999999999, 2024-04-18T21:06:37.512 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:37.512 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:37.512 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:37.512 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:37.512 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.513 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:37.513 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:37.513 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:37.513 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.513 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.513 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:37.513 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:37.513 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:37.513 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.513 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.513 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:37.513 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:37.514 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.5000000000000002e-07 2024-04-18T21:06:37.514 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.514 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.514 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:37.514 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615828+0000", 2024-04-18T21:06:37.514 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.2359999999999998e-06 2024-04-18T21:06:37.514 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.514 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.514 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:37.514 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615838+0000", 2024-04-18T21:06:37.514 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0087e-05 2024-04-18T21:06:37.514 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.514 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.514 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:37.515 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615846+0000", 2024-04-18T21:06:37.515 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.67e-06 2024-04-18T21:06:37.515 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.515 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.515 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:37.515 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615963+0000", 2024-04-18T21:06:37.515 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00011630500000000001 2024-04-18T21:06:37.515 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.515 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.515 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:37.515 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615979+0000", 2024-04-18T21:06:37.515 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.613e-05 2024-04-18T21:06:37.515 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.515 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.515 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:37.516 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632392+0000", 2024-04-18T21:06:37.516 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016413317 2024-04-18T21:06:37.516 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.516 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.516 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:37.516 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632568+0000", 2024-04-18T21:06:37.516 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00017539500000000001 2024-04-18T21:06:37.516 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.516 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.516 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:37.516 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632748+0000", 2024-04-18T21:06:37.516 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00017991799999999999 2024-04-18T21:06:37.516 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.516 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.516 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:37.517 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635542+0000", 2024-04-18T21:06:37.517 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00279481 2024-04-18T21:06:37.517 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.517 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.517 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:37.517 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659232+0000", 2024-04-18T21:06:37.517 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.023689212000000001 2024-04-18T21:06:37.517 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.517 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.517 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:37.517 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659314+0000", 2024-04-18T21:06:37.517 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.2528999999999995e-05 2024-04-18T21:06:37.517 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.517 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.517 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:37.518 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659372+0000", 2024-04-18T21:06:37.518 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.8218999999999999e-05 2024-04-18T21:06:37.518 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:37.518 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:37.518 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:37.518 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.518 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.518 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:37.518 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:06:37.518 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 91.848006053000006, 2024-04-18T21:06:37.518 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.039335347, 2024-04-18T21:06:37.518 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:37.518 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:37.518 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "started", 2024-04-18T21:06:37.518 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:37.519 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.519 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:37.519 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:06:37.519 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:37.519 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.519 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.519 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:37.519 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:06:37.519 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:37.519 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.519 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.519 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:37.519 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615885+0000", 2024-04-18T21:06:37.519 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2699999999999999e-06 2024-04-18T21:06:37.519 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.519 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.520 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:37.520 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615892+0000", 2024-04-18T21:06:37.520 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.6499999999999999e-06 2024-04-18T21:06:37.520 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.520 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.520 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:37.520 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615906+0000", 2024-04-18T21:06:37.520 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.393e-05 2024-04-18T21:06:37.520 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.520 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.520 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:37.520 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615919+0000", 2024-04-18T21:06:37.520 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2860000000000001e-05 2024-04-18T21:06:37.520 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.521 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.521 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:37.521 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616027+0000", 2024-04-18T21:06:37.521 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000107852 2024-04-18T21:06:37.521 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.521 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.521 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:37.521 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616037+0000", 2024-04-18T21:06:37.521 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:06:37.521 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.521 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.521 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:37.521 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622719+0000", 2024-04-18T21:06:37.522 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0066817220000000002 2024-04-18T21:06:37.522 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.522 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.522 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:37.522 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623006+0000", 2024-04-18T21:06:37.522 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00028783699999999999 2024-04-18T21:06:37.522 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.522 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.522 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:37.522 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.655220+0000", 2024-04-18T21:06:37.522 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.032213036 2024-04-18T21:06:37.522 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:37.522 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:37.522 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:37.523 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.523 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.523 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:37.523 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:37.523 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 91.84795038, 2024-04-18T21:06:37.523 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.032845253999999997, 2024-04-18T21:06:37.523 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:37.523 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:37.523 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "started", 2024-04-18T21:06:37.523 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:37.523 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.523 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:37.523 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:37.523 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:37.523 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.524 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.524 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:37.524 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:37.524 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:37.524 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.524 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.524 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:37.524 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615942+0000", 2024-04-18T21:06:37.524 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.717e-06 2024-04-18T21:06:37.524 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.524 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.524 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:37.524 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615946+0000", 2024-04-18T21:06:37.524 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.6e-06 2024-04-18T21:06:37.524 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.524 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.525 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:37.525 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615960+0000", 2024-04-18T21:06:37.525 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:06:37.525 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.525 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.525 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:37.525 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615968+0000", 2024-04-18T21:06:37.525 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.9070000000000007e-06 2024-04-18T21:06:37.525 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.525 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.525 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:37.525 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616100+0000", 2024-04-18T21:06:37.525 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000132402 2024-04-18T21:06:37.525 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.525 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.526 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:37.526 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616117+0000", 2024-04-18T21:06:37.526 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6653000000000001e-05 2024-04-18T21:06:37.526 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.526 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.526 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:37.526 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621566+0000", 2024-04-18T21:06:37.526 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0054497740000000001 2024-04-18T21:06:37.526 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.526 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.526 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:37.526 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622801+0000", 2024-04-18T21:06:37.526 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0012345710000000001 2024-04-18T21:06:37.526 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.526 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.526 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:37.527 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648785+0000", 2024-04-18T21:06:37.527 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.025984104000000001 2024-04-18T21:06:37.527 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:37.527 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:37.527 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:37.527 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.527 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.527 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:37.527 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:06:37.527 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 91.84209903, 2024-04-18T21:06:37.527 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.011561350999999999, 2024-04-18T21:06:37.527 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:37.527 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:37.527 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:37.527 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:37.527 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.528 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:37.528 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:06:37.528 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:37.528 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.528 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.528 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:37.528 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:06:37.528 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:37.528 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.528 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.528 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:37.528 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621792+0000", 2024-04-18T21:06:37.528 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.4000000000000001e-07 2024-04-18T21:06:37.528 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.528 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.528 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:37.528 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:06:37.529 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.1050000000000002e-05 2024-04-18T21:06:37.529 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.529 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.529 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:37.529 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622608+0000", 2024-04-18T21:06:37.529 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00077505900000000003 2024-04-18T21:06:37.529 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.529 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.529 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:37.529 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623879+0000", 2024-04-18T21:06:37.529 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0012705839999999999 2024-04-18T21:06:37.529 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.529 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.529 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:37.530 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624010+0000", 2024-04-18T21:06:37.530 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00013176900000000001 2024-04-18T21:06:37.530 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.530 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.530 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:37.530 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624058+0000", 2024-04-18T21:06:37.530 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.7299000000000002e-05 2024-04-18T21:06:37.530 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.530 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.530 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:37.530 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633262+0000", 2024-04-18T21:06:37.530 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0092048770000000002 2024-04-18T21:06:37.530 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.530 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.530 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:37.531 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633353+0000", 2024-04-18T21:06:37.531 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0073000000000003e-05 2024-04-18T21:06:37.531 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:37.531 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:37.531 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:37.531 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.531 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.531 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:37.531 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:06:37.531 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 91.839971644000002, 2024-04-18T21:06:37.531 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0098419370000000003, 2024-04-18T21:06:37.531 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:37.532 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:37.532 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:37.532 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:37.532 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.532 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:37.532 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:06:37.532 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:37.532 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.532 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.532 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:37.532 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:06:37.532 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:37.532 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.532 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.532 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:37.533 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623920+0000", 2024-04-18T21:06:37.533 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2240000000000001e-06 2024-04-18T21:06:37.533 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.533 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.533 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:37.533 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623933+0000", 2024-04-18T21:06:37.533 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3653e-05 2024-04-18T21:06:37.533 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.533 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.533 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:37.533 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623956+0000", 2024-04-18T21:06:37.533 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2059e-05 2024-04-18T21:06:37.533 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.533 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.534 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:37.534 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623975+0000", 2024-04-18T21:06:37.534 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.9806999999999999e-05 2024-04-18T21:06:37.534 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.534 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.534 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:37.534 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626943+0000", 2024-04-18T21:06:37.534 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0029681579999999998 2024-04-18T21:06:37.534 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.534 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.534 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:37.534 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626993+0000", 2024-04-18T21:06:37.534 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.9935999999999998e-05 2024-04-18T21:06:37.535 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.535 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.535 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:37.535 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633665+0000", 2024-04-18T21:06:37.535 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0066719250000000004 2024-04-18T21:06:37.535 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.535 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.535 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:37.535 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633761+0000", 2024-04-18T21:06:37.535 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.5174999999999996e-05 2024-04-18T21:06:37.535 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:37.535 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:37.535 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:37.535 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.536 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.536 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:37.536 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:06:37.536 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 91.839140025000006, 2024-04-18T21:06:37.536 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0090159079999999996, 2024-04-18T21:06:37.536 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:37.536 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:37.536 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:37.536 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:37.536 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.536 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:37.536 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:06:37.536 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:37.536 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.537 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.537 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:37.537 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:06:37.537 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:37.537 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.537 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.537 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:37.537 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624751+0000", 2024-04-18T21:06:37.537 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.7600000000000006e-07 2024-04-18T21:06:37.537 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.537 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.537 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:37.537 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624787+0000", 2024-04-18T21:06:37.537 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.6273000000000003e-05 2024-04-18T21:06:37.537 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.538 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.538 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:37.538 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625837+0000", 2024-04-18T21:06:37.538 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00104992 2024-04-18T21:06:37.538 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.538 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.538 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:37.538 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625860+0000", 2024-04-18T21:06:37.538 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3110000000000001e-05 2024-04-18T21:06:37.538 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.538 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.538 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:37.538 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625984+0000", 2024-04-18T21:06:37.538 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012399199999999999 2024-04-18T21:06:37.539 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.539 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.539 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:37.539 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626030+0000", 2024-04-18T21:06:37.539 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.5429999999999997e-05 2024-04-18T21:06:37.539 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.539 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.539 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:37.539 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633643+0000", 2024-04-18T21:06:37.539 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0076129320000000002 2024-04-18T21:06:37.539 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.539 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.539 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:37.539 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633766+0000", 2024-04-18T21:06:37.539 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000123275 2024-04-18T21:06:37.540 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:37.540 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:37.540 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:37.540 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.540 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.540 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:37.540 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:06:37.540 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 91.837886300999998, 2024-04-18T21:06:37.540 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0088669170000000002, 2024-04-18T21:06:37.540 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:37.540 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:37.540 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:37.540 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:37.540 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.541 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:37.541 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:06:37.541 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:37.541 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.541 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.541 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:37.541 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:06:37.541 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:37.541 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.541 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.541 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:37.541 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626005+0000", 2024-04-18T21:06:37.541 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.5000000000000001e-07 2024-04-18T21:06:37.541 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.541 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.542 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:37.542 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626028+0000", 2024-04-18T21:06:37.542 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2756999999999999e-05 2024-04-18T21:06:37.542 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.542 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.542 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:37.542 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626050+0000", 2024-04-18T21:06:37.542 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2140000000000001e-05 2024-04-18T21:06:37.542 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.542 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.542 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:37.542 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626065+0000", 2024-04-18T21:06:37.542 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5176e-05 2024-04-18T21:06:37.542 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.543 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.543 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:37.543 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628334+0000", 2024-04-18T21:06:37.543 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0022691439999999998 2024-04-18T21:06:37.543 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.543 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.543 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:37.543 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628379+0000", 2024-04-18T21:06:37.543 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.5420000000000002e-05 2024-04-18T21:06:37.543 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.543 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.543 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:37.543 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634770+0000", 2024-04-18T21:06:37.543 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0063908410000000004 2024-04-18T21:06:37.543 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.544 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.544 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:37.544 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634871+0000", 2024-04-18T21:06:37.544 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000100589 2024-04-18T21:06:37.544 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:37.544 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:37.544 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:37.544 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.544 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.544 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:13 3.10 e17/15 3:0d89b25e:::603.00000000:head v 17'8, mlcod=0'0)", 2024-04-18T21:06:37.544 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:06:37.544 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 91.819052872, 2024-04-18T21:06:37.544 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0090974379999999994, 2024-04-18T21:06:37.544 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:37.545 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:37.545 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:37.545 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:37.545 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.545 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:37.545 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:06:37.545 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:37.545 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.545 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.545 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:37.545 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:06:37.545 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:37.545 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.545 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.546 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:37.546 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644838+0000", 2024-04-18T21:06:37.546 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.569999999999999e-07 2024-04-18T21:06:37.546 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.546 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.546 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:37.546 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644846+0000", 2024-04-18T21:06:37.546 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.4499999999999998e-06 2024-04-18T21:06:37.546 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.546 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.546 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:37.546 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644861+0000", 2024-04-18T21:06:37.546 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5243e-05 2024-04-18T21:06:37.546 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.547 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.547 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:37.547 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644997+0000", 2024-04-18T21:06:37.547 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000135609 2024-04-18T21:06:37.547 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.547 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.547 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:37.547 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649150+0000", 2024-04-18T21:06:37.547 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0041536760000000002 2024-04-18T21:06:37.547 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.547 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.547 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:37.547 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649207+0000", 2024-04-18T21:06:37.547 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.6677e-05 2024-04-18T21:06:37.547 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.548 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.548 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:37.548 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.653840+0000", 2024-04-18T21:06:37.548 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0046329700000000001 2024-04-18T21:06:37.548 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.548 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.548 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:37.548 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.653935+0000", 2024-04-18T21:06:37.548 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.4856000000000001e-05 2024-04-18T21:06:37.548 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:37.548 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:37.548 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:37.548 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.548 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.549 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 3 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:06:37.549 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:06:37.549 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 91.816263711999994, 2024-04-18T21:06:37.549 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0087842319999999995, 2024-04-18T21:06:37.549 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:37.549 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:37.549 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "reached pg", 2024-04-18T21:06:37.549 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:37.549 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.549 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:37.549 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:06:37.549 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:37.549 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.549 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.549 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:37.550 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:06:37.550 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:37.550 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.550 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.550 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:37.550 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:06:37.550 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.8299999999999996e-07 2024-04-18T21:06:37.550 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.550 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.550 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:37.550 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647642+0000", 2024-04-18T21:06:37.550 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4724e-05 2024-04-18T21:06:37.550 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.550 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.551 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:37.551 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647679+0000", 2024-04-18T21:06:37.551 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.6662999999999998e-05 2024-04-18T21:06:37.551 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.551 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.551 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:37.551 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647735+0000", 2024-04-18T21:06:37.551 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.6196000000000002e-05 2024-04-18T21:06:37.551 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.551 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.551 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:37.551 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649865+0000", 2024-04-18T21:06:37.551 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0021299489999999999 2024-04-18T21:06:37.553 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.553 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.553 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:37.553 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656411+0000", 2024-04-18T21:06:37.553 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0065460170000000003 2024-04-18T21:06:37.553 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:37.553 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:37.553 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:37.553 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.553 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.554 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:37.554 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:06:37.554 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 91.816118516000003, 2024-04-18T21:06:37.554 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0095703190000000007, 2024-04-18T21:06:37.554 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:37.554 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:37.554 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:37.554 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:37.554 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.554 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:37.554 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:06:37.554 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:37.554 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.554 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.554 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:37.555 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:06:37.555 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:37.555 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.555 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.555 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:37.555 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647773+0000", 2024-04-18T21:06:37.555 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.046e-06 2024-04-18T21:06:37.555 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.555 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.555 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:37.555 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647795+0000", 2024-04-18T21:06:37.555 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2616000000000002e-05 2024-04-18T21:06:37.555 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.555 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.556 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:37.556 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647818+0000", 2024-04-18T21:06:37.556 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3110000000000001e-05 2024-04-18T21:06:37.556 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.556 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.556 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:37.556 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647834+0000", 2024-04-18T21:06:37.556 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5163e-05 2024-04-18T21:06:37.556 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.556 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.556 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:37.556 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650682+0000", 2024-04-18T21:06:37.556 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0028479759999999999 2024-04-18T21:06:37.556 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.557 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.557 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:37.557 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650730+0000", 2024-04-18T21:06:37.557 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.8375999999999999e-05 2024-04-18T21:06:37.557 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.557 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.557 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:37.557 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656751+0000", 2024-04-18T21:06:37.557 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0060211880000000002 2024-04-18T21:06:37.557 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.557 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.557 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:37.557 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657342+0000", 2024-04-18T21:06:37.557 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00059084399999999998 2024-04-18T21:06:37.557 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:37.558 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:37.558 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:37.558 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.558 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.558 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:37.558 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:06:37.558 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 91.815706230000004, 2024-04-18T21:06:37.558 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0092471759999999993, 2024-04-18T21:06:37.558 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:37.558 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:37.558 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:37.558 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:37.558 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.559 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:37.559 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:06:37.559 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:37.559 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.559 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.559 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:37.559 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:06:37.559 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:37.559 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.559 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.559 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:37.559 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648185+0000", 2024-04-18T21:06:37.559 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.5000000000000001e-07 2024-04-18T21:06:37.559 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.559 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.560 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:37.560 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648203+0000", 2024-04-18T21:06:37.560 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.8102999999999999e-05 2024-04-18T21:06:37.560 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.560 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.560 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:37.560 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648226+0000", 2024-04-18T21:06:37.560 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2921999999999998e-05 2024-04-18T21:06:37.560 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.560 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.560 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:37.560 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648241+0000", 2024-04-18T21:06:37.560 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5336999999999999e-05 2024-04-18T21:06:37.560 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.560 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.561 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:37.561 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.651268+0000", 2024-04-18T21:06:37.561 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0030271640000000002 2024-04-18T21:06:37.561 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.561 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.561 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:37.561 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.651319+0000", 2024-04-18T21:06:37.561 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.0843000000000001e-05 2024-04-18T21:06:37.561 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.561 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.561 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:37.561 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657347+0000", 2024-04-18T21:06:37.561 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0060279770000000003 2024-04-18T21:06:37.561 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:37.562 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:37.562 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:37.562 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657431+0000", 2024-04-18T21:06:37.562 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.3980000000000006e-05 2024-04-18T21:06:37.562 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:37.562 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:37.562 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:37.562 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:37.562 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:37.562 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:06:37.564 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-18T21:06:37.564 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-18T21:06:37.564 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-18T21:06:37.564 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-18T21:06:37.564 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-18T21:06:37.564 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:37.565 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:37.562+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:37.566 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-04-18T21:06:37.566 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-18T21:06:37.571 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-04-18T21:06:37.573 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-18T21:06:37.573 DEBUG:teuthology.orchestra.run.smithi078:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c46a99d99fa3e2dad10a5ce96141fec909e651df TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-04-18T21:06:37.622 INFO:tasks.workunit.client.0.smithi078.stderr:+ mkdir -p fsstress 2024-04-18T21:06:37.623 INFO:tasks.workunit.client.0.smithi078.stderr:+ pushd fsstress 2024-04-18T21:06:37.624 INFO:tasks.workunit.client.0.smithi078.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-18T21:06:37.624 INFO:tasks.workunit.client.0.smithi078.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-18T21:06:37.664 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:37.662+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:37.676 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:06:37.695 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:37.695 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:06:37.695 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-04-18T21:06:37.695 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:37.696 INFO:teuthology.orchestra.run.smithi078.stderr:nodeep-scrub is set 2024-04-18T21:06:37.710 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:37.797 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:37.798+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:37.813 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:06:37.813 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:06:37.832 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1: {} 2024-04-18T21:06:37.832 INFO:teuthology.orchestra.run.smithi078.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:06:37.850 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:06:37.851 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:37.866 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:37.862+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:37.875 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:37.875 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:37.891 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:37.967 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:37.966+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:38.056 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:38.056 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:38.067 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:38.067+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:38.070 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:38.168 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:38.166+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:38.201 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:38.201 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:38.216 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:38.269 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:38.271+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:38.340 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:38.341 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:38.355 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:38.370 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:38.371+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:38.470 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:38.470+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:38.478 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:38.478 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:38.495 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:38.573 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:38.570+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:38.606 INFO:tasks.workunit.client.0.smithi078.stderr:+ tar xzf ltp-full.tgz 2024-04-18T21:06:38.632 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:38.632 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:38.648 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:38.672 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:38.670+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:38.773 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:38.775+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:38.775 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:38.775 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:38.791 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:38.874 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:38.874+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:38.955 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:38.956 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:38.972 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:38.974 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:38.975+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:39.075 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:39.074+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:39.106 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:39.106 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:39.121 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:39.175 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:39.174+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:39.254 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:39.254 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:39.270 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:39.276 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:39.274+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:39.377 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:39.378+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:39.435 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:39.435 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:39.450 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:39.495 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:39.494+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:39.578 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:39.578+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:39.599 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:39.599 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:39.615 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:39.707 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:39.706+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:39.717 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-18T21:06:39.780 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:39.779+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:39.792 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:39.792 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:39.808 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:39.848 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-18T21:06:39.848 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-18T21:06:39.848 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-04-18T21:06:39.848 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-18T21:06:39.866 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:06:39.881 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:39.878+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:39.979 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:39.980 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:39.982 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:39.978+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:39.995 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:40.083 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:40.082+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:40.103 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:06:40.103 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:06:40.129 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1: {} 2024-04-18T21:06:40.129 INFO:teuthology.orchestra.run.smithi078.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:06:40.137 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:06:40.137 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [ 2024-04-18T21:06:40.137 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.137 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4534.0:745 4.10 e49/16 4:09277cea:::10000000559.00000000:head v 49'13, mlcod=49'11)", 2024-04-18T21:06:40.137 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:06:40.138806+0000", 2024-04-18T21:06:40.137 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 0.001382557, 2024-04-18T21:06:40.137 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0014395600000000001, 2024-04-18T21:06:40.137 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:40.137 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:40.137 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "started", 2024-04-18T21:06:40.137 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:40.137 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.137 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:40.138 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:40.138806+0000", 2024-04-18T21:06:40.138 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:40.138 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.138 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.138 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:40.138 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:40.138806+0000", 2024-04-18T21:06:40.138 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:40.138 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.138 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.138 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:40.139 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:40.138808+0000", 2024-04-18T21:06:40.139 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5859999999999999e-06 2024-04-18T21:06:40.139 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.139 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.139 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:40.140 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:40.138819+0000", 2024-04-18T21:06:40.140 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0896999999999999e-05 2024-04-18T21:06:40.140 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.140 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.140 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:40.140 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:40.138852+0000", 2024-04-18T21:06:40.140 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.3362999999999999e-05 2024-04-18T21:06:40.141 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.141 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.141 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:40.141 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:40.138875+0000", 2024-04-18T21:06:40.141 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2580000000000001e-05 2024-04-18T21:06:40.141 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.141 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.141 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:40.141 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:40.139084+0000", 2024-04-18T21:06:40.142 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000208851 2024-04-18T21:06:40.142 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.142 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.142 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:40.142 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:40.139143+0000", 2024-04-18T21:06:40.142 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.9299999999999998e-05 2024-04-18T21:06:40.142 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:40.143 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:40.143 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:40.143 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:40.143 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-04-18T21:06:40.143 INFO:teuthology.orchestra.run.smithi150.stdout: "num_ops": 1 2024-04-18T21:06:40.143 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:06:40.152 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:40.154 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:06:40.154 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:40.183 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:40.182+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:40.208 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:06:40.208 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-04-18T21:06:40.209 INFO:teuthology.orchestra.run.smithi078.stdout: "epoch": 49, 2024-04-18T21:06:40.209 INFO:teuthology.orchestra.run.smithi078.stdout: "fsid": "dc017990-0393-4ab0-b604-5e7052fdc7bd", 2024-04-18T21:06:40.209 INFO:teuthology.orchestra.run.smithi078.stdout: "created": "2024-04-18T21:04:43.507538+0000", 2024-04-18T21:06:40.209 INFO:teuthology.orchestra.run.smithi078.stdout: "modified": "2024-04-18T21:06:37.690782+0000", 2024-04-18T21:06:40.209 INFO:teuthology.orchestra.run.smithi078.stdout: "last_up_change": "2024-04-18T21:04:52.492503+0000", 2024-04-18T21:06:40.209 INFO:teuthology.orchestra.run.smithi078.stdout: "last_in_change": "2024-04-18T21:04:44.402191+0000", 2024-04-18T21:06:40.209 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-18T21:06:40.209 INFO:teuthology.orchestra.run.smithi078.stdout: "flags_num": 5806080, 2024-04-18T21:06:40.209 INFO:teuthology.orchestra.run.smithi078.stdout: "flags_set": [ 2024-04-18T21:06:40.209 INFO:teuthology.orchestra.run.smithi078.stdout: "nodeep-scrub", 2024-04-18T21:06:40.209 INFO:teuthology.orchestra.run.smithi078.stdout: "noscrub", 2024-04-18T21:06:40.209 INFO:teuthology.orchestra.run.smithi078.stdout: "pglog_hardlimit", 2024-04-18T21:06:40.209 INFO:teuthology.orchestra.run.smithi078.stdout: "purged_snapdirs", 2024-04-18T21:06:40.209 INFO:teuthology.orchestra.run.smithi078.stdout: "recovery_deletes", 2024-04-18T21:06:40.210 INFO:teuthology.orchestra.run.smithi078.stdout: "sortbitwise" 2024-04-18T21:06:40.210 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-04-18T21:06:40.210 INFO:teuthology.orchestra.run.smithi078.stdout: "crush_version": 4, 2024-04-18T21:06:40.210 INFO:teuthology.orchestra.run.smithi078.stdout: "full_ratio": 0.94999998807907104, 2024-04-18T21:06:40.210 INFO:teuthology.orchestra.run.smithi078.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-18T21:06:40.210 INFO:teuthology.orchestra.run.smithi078.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-18T21:06:40.210 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_snapshot": "", 2024-04-18T21:06:40.210 INFO:teuthology.orchestra.run.smithi078.stdout: "pool_max": 4, 2024-04-18T21:06:40.210 INFO:teuthology.orchestra.run.smithi078.stdout: "max_osd": 3, 2024-04-18T21:06:40.210 INFO:teuthology.orchestra.run.smithi078.stdout: "require_min_compat_client": "luminous", 2024-04-18T21:06:40.210 INFO:teuthology.orchestra.run.smithi078.stdout: "min_compat_client": "jewel", 2024-04-18T21:06:40.210 INFO:teuthology.orchestra.run.smithi078.stdout: "require_osd_release": "squid", 2024-04-18T21:06:40.210 INFO:teuthology.orchestra.run.smithi078.stdout: "allow_crimson": false, 2024-04-18T21:06:40.211 INFO:teuthology.orchestra.run.smithi078.stdout: "pools": [ 2024-04-18T21:06:40.211 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:40.211 INFO:teuthology.orchestra.run.smithi078.stdout: "pool": 1, 2024-04-18T21:06:40.211 INFO:teuthology.orchestra.run.smithi078.stdout: "pool_name": ".mgr", 2024-04-18T21:06:40.211 INFO:teuthology.orchestra.run.smithi078.stdout: "create_time": "2024-04-18T21:04:52.538153+0000", 2024-04-18T21:06:40.211 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-04-18T21:06:40.211 INFO:teuthology.orchestra.run.smithi078.stdout: "flags_names": "hashpspool", 2024-04-18T21:06:40.211 INFO:teuthology.orchestra.run.smithi078.stdout: "type": 1, 2024-04-18T21:06:40.211 INFO:teuthology.orchestra.run.smithi078.stdout: "size": 2, 2024-04-18T21:06:40.211 INFO:teuthology.orchestra.run.smithi078.stdout: "min_size": 1, 2024-04-18T21:06:40.211 INFO:teuthology.orchestra.run.smithi078.stdout: "crush_rule": 0, 2024-04-18T21:06:40.211 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:06:40.212 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:06:40.212 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:06:40.212 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:06:40.212 INFO:teuthology.orchestra.run.smithi078.stdout: "object_hash": 2, 2024-04-18T21:06:40.212 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:06:40.212 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num": 1, 2024-04-18T21:06:40.212 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_placement_num": 1, 2024-04-18T21:06:40.212 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_placement_num_target": 1, 2024-04-18T21:06:40.212 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_target": 1, 2024-04-18T21:06:40.212 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_pending": 1, 2024-04-18T21:06:40.212 INFO:teuthology.orchestra.run.smithi078.stdout: "last_pg_merge_meta": { 2024-04-18T21:06:40.212 INFO:teuthology.orchestra.run.smithi078.stdout: "source_pgid": "0.0", 2024-04-18T21:06:40.212 INFO:teuthology.orchestra.run.smithi078.stdout: "ready_epoch": 0, 2024-04-18T21:06:40.213 INFO:teuthology.orchestra.run.smithi078.stdout: "last_epoch_started": 0, 2024-04-18T21:06:40.213 INFO:teuthology.orchestra.run.smithi078.stdout: "last_epoch_clean": 0, 2024-04-18T21:06:40.213 INFO:teuthology.orchestra.run.smithi078.stdout: "source_version": "0'0", 2024-04-18T21:06:40.213 INFO:teuthology.orchestra.run.smithi078.stdout: "target_version": "0'0" 2024-04-18T21:06:40.213 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:40.213 INFO:teuthology.orchestra.run.smithi078.stdout: "last_change": "11", 2024-04-18T21:06:40.213 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend": "0", 2024-04-18T21:06:40.213 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:06:40.213 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:06:40.213 INFO:teuthology.orchestra.run.smithi078.stdout: "auid": 0, 2024-04-18T21:06:40.213 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:06:40.213 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_seq": 0, 2024-04-18T21:06:40.213 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_epoch": 0, 2024-04-18T21:06:40.213 INFO:teuthology.orchestra.run.smithi078.stdout: "pool_snaps": [], 2024-04-18T21:06:40.214 INFO:teuthology.orchestra.run.smithi078.stdout: "removed_snaps": "[]", 2024-04-18T21:06:40.214 INFO:teuthology.orchestra.run.smithi078.stdout: "quota_max_bytes": 0, 2024-04-18T21:06:40.214 INFO:teuthology.orchestra.run.smithi078.stdout: "quota_max_objects": 0, 2024-04-18T21:06:40.214 INFO:teuthology.orchestra.run.smithi078.stdout: "tiers": [], 2024-04-18T21:06:40.214 INFO:teuthology.orchestra.run.smithi078.stdout: "tier_of": -1, 2024-04-18T21:06:40.214 INFO:teuthology.orchestra.run.smithi078.stdout: "read_tier": -1, 2024-04-18T21:06:40.214 INFO:teuthology.orchestra.run.smithi078.stdout: "write_tier": -1, 2024-04-18T21:06:40.214 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_mode": "none", 2024-04-18T21:06:40.214 INFO:teuthology.orchestra.run.smithi078.stdout: "target_max_bytes": 0, 2024-04-18T21:06:40.214 INFO:teuthology.orchestra.run.smithi078.stdout: "target_max_objects": 0, 2024-04-18T21:06:40.214 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:06:40.214 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:06:40.215 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:06:40.215 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_min_flush_age": 0, 2024-04-18T21:06:40.215 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_min_evict_age": 0, 2024-04-18T21:06:40.215 INFO:teuthology.orchestra.run.smithi078.stdout: "erasure_code_profile": "", 2024-04-18T21:06:40.215 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_params": { 2024-04-18T21:06:40.215 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "none" 2024-04-18T21:06:40.215 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:40.215 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_period": 0, 2024-04-18T21:06:40.215 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_count": 0, 2024-04-18T21:06:40.215 INFO:teuthology.orchestra.run.smithi078.stdout: "use_gmt_hitset": true, 2024-04-18T21:06:40.215 INFO:teuthology.orchestra.run.smithi078.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:06:40.215 INFO:teuthology.orchestra.run.smithi078.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:06:40.215 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:06:40.216 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:06:40.216 INFO:teuthology.orchestra.run.smithi078.stdout: "grade_table": [], 2024-04-18T21:06:40.216 INFO:teuthology.orchestra.run.smithi078.stdout: "stripe_width": 0, 2024-04-18T21:06:40.216 INFO:teuthology.orchestra.run.smithi078.stdout: "expected_num_objects": 0, 2024-04-18T21:06:40.216 INFO:teuthology.orchestra.run.smithi078.stdout: "fast_read": false, 2024-04-18T21:06:40.216 INFO:teuthology.orchestra.run.smithi078.stdout: "options": { 2024-04-18T21:06:40.216 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_max": 32, 2024-04-18T21:06:40.216 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_min": 1 2024-04-18T21:06:40.216 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:40.216 INFO:teuthology.orchestra.run.smithi078.stdout: "application_metadata": { 2024-04-18T21:06:40.216 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": {} 2024-04-18T21:06:40.216 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:40.216 INFO:teuthology.orchestra.run.smithi078.stdout: "read_balance": { 2024-04-18T21:06:40.216 INFO:teuthology.orchestra.run.smithi078.stdout: "score_type": "Fair distribution", 2024-04-18T21:06:40.217 INFO:teuthology.orchestra.run.smithi078.stdout: "score_acting": 2.9900000095367432, 2024-04-18T21:06:40.217 INFO:teuthology.orchestra.run.smithi078.stdout: "score_stable": 2.9900000095367432, 2024-04-18T21:06:40.217 INFO:teuthology.orchestra.run.smithi078.stdout: "optimal_score": 0.67000001668930054, 2024-04-18T21:06:40.217 INFO:teuthology.orchestra.run.smithi078.stdout: "raw_score_acting": 2, 2024-04-18T21:06:40.217 INFO:teuthology.orchestra.run.smithi078.stdout: "raw_score_stable": 2, 2024-04-18T21:06:40.217 INFO:teuthology.orchestra.run.smithi078.stdout: "primary_affinity_weighted": 0.86374413967132568, 2024-04-18T21:06:40.217 INFO:teuthology.orchestra.run.smithi078.stdout: "average_primary_affinity": 0.86000001430511475, 2024-04-18T21:06:40.217 INFO:teuthology.orchestra.run.smithi078.stdout: "average_primary_affinity_weighted": 0.86000001430511475 2024-04-18T21:06:40.217 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:06:40.217 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:40.217 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:40.217 INFO:teuthology.orchestra.run.smithi078.stdout: "pool": 2, 2024-04-18T21:06:40.217 INFO:teuthology.orchestra.run.smithi078.stdout: "pool_name": "rbd", 2024-04-18T21:06:40.217 INFO:teuthology.orchestra.run.smithi078.stdout: "create_time": "2024-04-18T21:04:58.673793+0000", 2024-04-18T21:06:40.218 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-04-18T21:06:40.218 INFO:teuthology.orchestra.run.smithi078.stdout: "flags_names": "hashpspool", 2024-04-18T21:06:40.218 INFO:teuthology.orchestra.run.smithi078.stdout: "type": 1, 2024-04-18T21:06:40.218 INFO:teuthology.orchestra.run.smithi078.stdout: "size": 2, 2024-04-18T21:06:40.218 INFO:teuthology.orchestra.run.smithi078.stdout: "min_size": 1, 2024-04-18T21:06:40.218 INFO:teuthology.orchestra.run.smithi078.stdout: "crush_rule": 0, 2024-04-18T21:06:40.218 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:06:40.218 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:06:40.218 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:06:40.218 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:06:40.218 INFO:teuthology.orchestra.run.smithi078.stdout: "object_hash": 2, 2024-04-18T21:06:40.218 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:06:40.218 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num": 8, 2024-04-18T21:06:40.218 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_placement_num": 8, 2024-04-18T21:06:40.219 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_placement_num_target": 8, 2024-04-18T21:06:40.219 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_target": 8, 2024-04-18T21:06:40.219 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_pending": 8, 2024-04-18T21:06:40.219 INFO:teuthology.orchestra.run.smithi078.stdout: "last_pg_merge_meta": { 2024-04-18T21:06:40.219 INFO:teuthology.orchestra.run.smithi078.stdout: "source_pgid": "0.0", 2024-04-18T21:06:40.219 INFO:teuthology.orchestra.run.smithi078.stdout: "ready_epoch": 0, 2024-04-18T21:06:40.219 INFO:teuthology.orchestra.run.smithi078.stdout: "last_epoch_started": 0, 2024-04-18T21:06:40.219 INFO:teuthology.orchestra.run.smithi078.stdout: "last_epoch_clean": 0, 2024-04-18T21:06:40.219 INFO:teuthology.orchestra.run.smithi078.stdout: "source_version": "0'0", 2024-04-18T21:06:40.219 INFO:teuthology.orchestra.run.smithi078.stdout: "target_version": "0'0" 2024-04-18T21:06:40.219 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:40.219 INFO:teuthology.orchestra.run.smithi078.stdout: "last_change": "14", 2024-04-18T21:06:40.219 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend": "0", 2024-04-18T21:06:40.220 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:06:40.220 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:06:40.220 INFO:teuthology.orchestra.run.smithi078.stdout: "auid": 0, 2024-04-18T21:06:40.220 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:06:40.220 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_seq": 0, 2024-04-18T21:06:40.220 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_epoch": 0, 2024-04-18T21:06:40.220 INFO:teuthology.orchestra.run.smithi078.stdout: "pool_snaps": [], 2024-04-18T21:06:40.220 INFO:teuthology.orchestra.run.smithi078.stdout: "removed_snaps": "[]", 2024-04-18T21:06:40.220 INFO:teuthology.orchestra.run.smithi078.stdout: "quota_max_bytes": 0, 2024-04-18T21:06:40.220 INFO:teuthology.orchestra.run.smithi078.stdout: "quota_max_objects": 0, 2024-04-18T21:06:40.220 INFO:teuthology.orchestra.run.smithi078.stdout: "tiers": [], 2024-04-18T21:06:40.220 INFO:teuthology.orchestra.run.smithi078.stdout: "tier_of": -1, 2024-04-18T21:06:40.220 INFO:teuthology.orchestra.run.smithi078.stdout: "read_tier": -1, 2024-04-18T21:06:40.220 INFO:teuthology.orchestra.run.smithi078.stdout: "write_tier": -1, 2024-04-18T21:06:40.221 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_mode": "none", 2024-04-18T21:06:40.221 INFO:teuthology.orchestra.run.smithi078.stdout: "target_max_bytes": 0, 2024-04-18T21:06:40.221 INFO:teuthology.orchestra.run.smithi078.stdout: "target_max_objects": 0, 2024-04-18T21:06:40.221 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:06:40.221 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:06:40.221 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:06:40.221 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_min_flush_age": 0, 2024-04-18T21:06:40.221 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_min_evict_age": 0, 2024-04-18T21:06:40.221 INFO:teuthology.orchestra.run.smithi078.stdout: "erasure_code_profile": "", 2024-04-18T21:06:40.221 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_params": { 2024-04-18T21:06:40.221 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "none" 2024-04-18T21:06:40.221 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:40.221 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_period": 0, 2024-04-18T21:06:40.221 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_count": 0, 2024-04-18T21:06:40.222 INFO:teuthology.orchestra.run.smithi078.stdout: "use_gmt_hitset": true, 2024-04-18T21:06:40.222 INFO:teuthology.orchestra.run.smithi078.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:06:40.222 INFO:teuthology.orchestra.run.smithi078.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:06:40.222 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:06:40.222 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:06:40.222 INFO:teuthology.orchestra.run.smithi078.stdout: "grade_table": [], 2024-04-18T21:06:40.222 INFO:teuthology.orchestra.run.smithi078.stdout: "stripe_width": 0, 2024-04-18T21:06:40.222 INFO:teuthology.orchestra.run.smithi078.stdout: "expected_num_objects": 0, 2024-04-18T21:06:40.222 INFO:teuthology.orchestra.run.smithi078.stdout: "fast_read": false, 2024-04-18T21:06:40.222 INFO:teuthology.orchestra.run.smithi078.stdout: "options": {}, 2024-04-18T21:06:40.222 INFO:teuthology.orchestra.run.smithi078.stdout: "application_metadata": { 2024-04-18T21:06:40.222 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd": {} 2024-04-18T21:06:40.222 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:40.223 INFO:teuthology.orchestra.run.smithi078.stdout: "read_balance": { 2024-04-18T21:06:40.223 INFO:teuthology.orchestra.run.smithi078.stdout: "score_type": "Fair distribution", 2024-04-18T21:06:40.223 INFO:teuthology.orchestra.run.smithi078.stdout: "score_acting": 1.5, 2024-04-18T21:06:40.223 INFO:teuthology.orchestra.run.smithi078.stdout: "score_stable": 1.5, 2024-04-18T21:06:40.223 INFO:teuthology.orchestra.run.smithi078.stdout: "optimal_score": 1, 2024-04-18T21:06:40.223 INFO:teuthology.orchestra.run.smithi078.stdout: "raw_score_acting": 1.5, 2024-04-18T21:06:40.223 INFO:teuthology.orchestra.run.smithi078.stdout: "raw_score_stable": 1.5, 2024-04-18T21:06:40.223 INFO:teuthology.orchestra.run.smithi078.stdout: "primary_affinity_weighted": 0.86374413967132568, 2024-04-18T21:06:40.223 INFO:teuthology.orchestra.run.smithi078.stdout: "average_primary_affinity": 0.86000001430511475, 2024-04-18T21:06:40.223 INFO:teuthology.orchestra.run.smithi078.stdout: "average_primary_affinity_weighted": 0.86000001430511475 2024-04-18T21:06:40.223 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:06:40.223 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:40.224 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:40.224 INFO:teuthology.orchestra.run.smithi078.stdout: "pool": 3, 2024-04-18T21:06:40.224 INFO:teuthology.orchestra.run.smithi078.stdout: "pool_name": "cephfs_metadata", 2024-04-18T21:06:40.224 INFO:teuthology.orchestra.run.smithi078.stdout: "create_time": "2024-04-18T21:05:03.314171+0000", 2024-04-18T21:06:40.224 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-04-18T21:06:40.224 INFO:teuthology.orchestra.run.smithi078.stdout: "flags_names": "hashpspool", 2024-04-18T21:06:40.224 INFO:teuthology.orchestra.run.smithi078.stdout: "type": 1, 2024-04-18T21:06:40.224 INFO:teuthology.orchestra.run.smithi078.stdout: "size": 2, 2024-04-18T21:06:40.224 INFO:teuthology.orchestra.run.smithi078.stdout: "min_size": 1, 2024-04-18T21:06:40.224 INFO:teuthology.orchestra.run.smithi078.stdout: "crush_rule": 0, 2024-04-18T21:06:40.224 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:06:40.224 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:06:40.224 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:06:40.224 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:06:40.224 INFO:teuthology.orchestra.run.smithi078.stdout: "object_hash": 2, 2024-04-18T21:06:40.225 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:06:40.225 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num": 32, 2024-04-18T21:06:40.225 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_placement_num": 32, 2024-04-18T21:06:40.225 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_placement_num_target": 32, 2024-04-18T21:06:40.225 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_target": 32, 2024-04-18T21:06:40.225 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_pending": 32, 2024-04-18T21:06:40.225 INFO:teuthology.orchestra.run.smithi078.stdout: "last_pg_merge_meta": { 2024-04-18T21:06:40.225 INFO:teuthology.orchestra.run.smithi078.stdout: "source_pgid": "0.0", 2024-04-18T21:06:40.225 INFO:teuthology.orchestra.run.smithi078.stdout: "ready_epoch": 0, 2024-04-18T21:06:40.225 INFO:teuthology.orchestra.run.smithi078.stdout: "last_epoch_started": 0, 2024-04-18T21:06:40.225 INFO:teuthology.orchestra.run.smithi078.stdout: "last_epoch_clean": 0, 2024-04-18T21:06:40.225 INFO:teuthology.orchestra.run.smithi078.stdout: "source_version": "0'0", 2024-04-18T21:06:40.225 INFO:teuthology.orchestra.run.smithi078.stdout: "target_version": "0'0" 2024-04-18T21:06:40.226 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:40.226 INFO:teuthology.orchestra.run.smithi078.stdout: "last_change": "17", 2024-04-18T21:06:40.226 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend": "0", 2024-04-18T21:06:40.226 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:06:40.226 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:06:40.226 INFO:teuthology.orchestra.run.smithi078.stdout: "auid": 0, 2024-04-18T21:06:40.226 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:06:40.226 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_seq": 0, 2024-04-18T21:06:40.226 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_epoch": 0, 2024-04-18T21:06:40.226 INFO:teuthology.orchestra.run.smithi078.stdout: "pool_snaps": [], 2024-04-18T21:06:40.226 INFO:teuthology.orchestra.run.smithi078.stdout: "removed_snaps": "[]", 2024-04-18T21:06:40.226 INFO:teuthology.orchestra.run.smithi078.stdout: "quota_max_bytes": 0, 2024-04-18T21:06:40.226 INFO:teuthology.orchestra.run.smithi078.stdout: "quota_max_objects": 0, 2024-04-18T21:06:40.227 INFO:teuthology.orchestra.run.smithi078.stdout: "tiers": [], 2024-04-18T21:06:40.227 INFO:teuthology.orchestra.run.smithi078.stdout: "tier_of": -1, 2024-04-18T21:06:40.227 INFO:teuthology.orchestra.run.smithi078.stdout: "read_tier": -1, 2024-04-18T21:06:40.227 INFO:teuthology.orchestra.run.smithi078.stdout: "write_tier": -1, 2024-04-18T21:06:40.227 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_mode": "none", 2024-04-18T21:06:40.227 INFO:teuthology.orchestra.run.smithi078.stdout: "target_max_bytes": 0, 2024-04-18T21:06:40.227 INFO:teuthology.orchestra.run.smithi078.stdout: "target_max_objects": 0, 2024-04-18T21:06:40.227 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:06:40.227 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:06:40.227 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:06:40.227 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_min_flush_age": 0, 2024-04-18T21:06:40.227 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_min_evict_age": 0, 2024-04-18T21:06:40.227 INFO:teuthology.orchestra.run.smithi078.stdout: "erasure_code_profile": "", 2024-04-18T21:06:40.227 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_params": { 2024-04-18T21:06:40.228 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "none" 2024-04-18T21:06:40.228 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:40.228 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_period": 0, 2024-04-18T21:06:40.228 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_count": 0, 2024-04-18T21:06:40.228 INFO:teuthology.orchestra.run.smithi078.stdout: "use_gmt_hitset": true, 2024-04-18T21:06:40.228 INFO:teuthology.orchestra.run.smithi078.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:06:40.228 INFO:teuthology.orchestra.run.smithi078.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:06:40.228 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:06:40.228 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:06:40.228 INFO:teuthology.orchestra.run.smithi078.stdout: "grade_table": [], 2024-04-18T21:06:40.229 INFO:teuthology.orchestra.run.smithi078.stdout: "stripe_width": 0, 2024-04-18T21:06:40.229 INFO:teuthology.orchestra.run.smithi078.stdout: "expected_num_objects": 0, 2024-04-18T21:06:40.229 INFO:teuthology.orchestra.run.smithi078.stdout: "fast_read": false, 2024-04-18T21:06:40.229 INFO:teuthology.orchestra.run.smithi078.stdout: "options": { 2024-04-18T21:06:40.229 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_autoscale_bias": 4, 2024-04-18T21:06:40.229 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_min": 16, 2024-04-18T21:06:40.229 INFO:teuthology.orchestra.run.smithi078.stdout: "recovery_priority": 5 2024-04-18T21:06:40.229 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:40.229 INFO:teuthology.orchestra.run.smithi078.stdout: "application_metadata": { 2024-04-18T21:06:40.229 INFO:teuthology.orchestra.run.smithi078.stdout: "cephfs": { 2024-04-18T21:06:40.229 INFO:teuthology.orchestra.run.smithi078.stdout: "metadata": "cephfs" 2024-04-18T21:06:40.229 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:06:40.230 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:40.230 INFO:teuthology.orchestra.run.smithi078.stdout: "read_balance": { 2024-04-18T21:06:40.230 INFO:teuthology.orchestra.run.smithi078.stdout: "score_type": "Fair distribution", 2024-04-18T21:06:40.230 INFO:teuthology.orchestra.run.smithi078.stdout: "score_acting": 1.1299999952316284, 2024-04-18T21:06:40.230 INFO:teuthology.orchestra.run.smithi078.stdout: "score_stable": 1.1299999952316284, 2024-04-18T21:06:40.230 INFO:teuthology.orchestra.run.smithi078.stdout: "optimal_score": 1, 2024-04-18T21:06:40.230 INFO:teuthology.orchestra.run.smithi078.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-18T21:06:40.230 INFO:teuthology.orchestra.run.smithi078.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-18T21:06:40.230 INFO:teuthology.orchestra.run.smithi078.stdout: "primary_affinity_weighted": 0.86374413967132568, 2024-04-18T21:06:40.230 INFO:teuthology.orchestra.run.smithi078.stdout: "average_primary_affinity": 0.86000001430511475, 2024-04-18T21:06:40.230 INFO:teuthology.orchestra.run.smithi078.stdout: "average_primary_affinity_weighted": 0.86000001430511475 2024-04-18T21:06:40.230 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:06:40.230 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:40.231 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:40.231 INFO:teuthology.orchestra.run.smithi078.stdout: "pool": 4, 2024-04-18T21:06:40.231 INFO:teuthology.orchestra.run.smithi078.stdout: "pool_name": "cephfs_data", 2024-04-18T21:06:40.231 INFO:teuthology.orchestra.run.smithi078.stdout: "create_time": "2024-04-18T21:05:03.931699+0000", 2024-04-18T21:06:40.231 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-04-18T21:06:40.231 INFO:teuthology.orchestra.run.smithi078.stdout: "flags_names": "hashpspool", 2024-04-18T21:06:40.231 INFO:teuthology.orchestra.run.smithi078.stdout: "type": 1, 2024-04-18T21:06:40.231 INFO:teuthology.orchestra.run.smithi078.stdout: "size": 2, 2024-04-18T21:06:40.231 INFO:teuthology.orchestra.run.smithi078.stdout: "min_size": 1, 2024-04-18T21:06:40.231 INFO:teuthology.orchestra.run.smithi078.stdout: "crush_rule": 0, 2024-04-18T21:06:40.231 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_count": 0, 2024-04-18T21:06:40.231 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_target": 0, 2024-04-18T21:06:40.231 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T21:06:40.231 INFO:teuthology.orchestra.run.smithi078.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T21:06:40.232 INFO:teuthology.orchestra.run.smithi078.stdout: "object_hash": 2, 2024-04-18T21:06:40.232 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_autoscale_mode": "off", 2024-04-18T21:06:40.232 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num": 64, 2024-04-18T21:06:40.232 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_placement_num": 64, 2024-04-18T21:06:40.232 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_placement_num_target": 64, 2024-04-18T21:06:40.232 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_target": 64, 2024-04-18T21:06:40.232 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_pending": 64, 2024-04-18T21:06:40.232 INFO:teuthology.orchestra.run.smithi078.stdout: "last_pg_merge_meta": { 2024-04-18T21:06:40.232 INFO:teuthology.orchestra.run.smithi078.stdout: "source_pgid": "0.0", 2024-04-18T21:06:40.232 INFO:teuthology.orchestra.run.smithi078.stdout: "ready_epoch": 0, 2024-04-18T21:06:40.232 INFO:teuthology.orchestra.run.smithi078.stdout: "last_epoch_started": 0, 2024-04-18T21:06:40.232 INFO:teuthology.orchestra.run.smithi078.stdout: "last_epoch_clean": 0, 2024-04-18T21:06:40.232 INFO:teuthology.orchestra.run.smithi078.stdout: "source_version": "0'0", 2024-04-18T21:06:40.233 INFO:teuthology.orchestra.run.smithi078.stdout: "target_version": "0'0" 2024-04-18T21:06:40.233 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:40.233 INFO:teuthology.orchestra.run.smithi078.stdout: "last_change": "18", 2024-04-18T21:06:40.233 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend": "0", 2024-04-18T21:06:40.233 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T21:06:40.233 INFO:teuthology.orchestra.run.smithi078.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T21:06:40.233 INFO:teuthology.orchestra.run.smithi078.stdout: "auid": 0, 2024-04-18T21:06:40.233 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_mode": "selfmanaged", 2024-04-18T21:06:40.233 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_seq": 0, 2024-04-18T21:06:40.233 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_epoch": 0, 2024-04-18T21:06:40.233 INFO:teuthology.orchestra.run.smithi078.stdout: "pool_snaps": [], 2024-04-18T21:06:40.233 INFO:teuthology.orchestra.run.smithi078.stdout: "removed_snaps": "[]", 2024-04-18T21:06:40.233 INFO:teuthology.orchestra.run.smithi078.stdout: "quota_max_bytes": 0, 2024-04-18T21:06:40.233 INFO:teuthology.orchestra.run.smithi078.stdout: "quota_max_objects": 0, 2024-04-18T21:06:40.234 INFO:teuthology.orchestra.run.smithi078.stdout: "tiers": [], 2024-04-18T21:06:40.234 INFO:teuthology.orchestra.run.smithi078.stdout: "tier_of": -1, 2024-04-18T21:06:40.234 INFO:teuthology.orchestra.run.smithi078.stdout: "read_tier": -1, 2024-04-18T21:06:40.234 INFO:teuthology.orchestra.run.smithi078.stdout: "write_tier": -1, 2024-04-18T21:06:40.234 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_mode": "none", 2024-04-18T21:06:40.234 INFO:teuthology.orchestra.run.smithi078.stdout: "target_max_bytes": 0, 2024-04-18T21:06:40.234 INFO:teuthology.orchestra.run.smithi078.stdout: "target_max_objects": 0, 2024-04-18T21:06:40.234 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T21:06:40.234 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T21:06:40.234 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T21:06:40.234 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_min_flush_age": 0, 2024-04-18T21:06:40.234 INFO:teuthology.orchestra.run.smithi078.stdout: "cache_min_evict_age": 0, 2024-04-18T21:06:40.234 INFO:teuthology.orchestra.run.smithi078.stdout: "erasure_code_profile": "", 2024-04-18T21:06:40.235 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_params": { 2024-04-18T21:06:40.235 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "none" 2024-04-18T21:06:40.235 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:40.235 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_period": 0, 2024-04-18T21:06:40.235 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_count": 0, 2024-04-18T21:06:40.235 INFO:teuthology.orchestra.run.smithi078.stdout: "use_gmt_hitset": true, 2024-04-18T21:06:40.235 INFO:teuthology.orchestra.run.smithi078.stdout: "min_read_recency_for_promote": 0, 2024-04-18T21:06:40.235 INFO:teuthology.orchestra.run.smithi078.stdout: "min_write_recency_for_promote": 0, 2024-04-18T21:06:40.235 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T21:06:40.235 INFO:teuthology.orchestra.run.smithi078.stdout: "hit_set_search_last_n": 0, 2024-04-18T21:06:40.235 INFO:teuthology.orchestra.run.smithi078.stdout: "grade_table": [], 2024-04-18T21:06:40.235 INFO:teuthology.orchestra.run.smithi078.stdout: "stripe_width": 0, 2024-04-18T21:06:40.236 INFO:teuthology.orchestra.run.smithi078.stdout: "expected_num_objects": 0, 2024-04-18T21:06:40.236 INFO:teuthology.orchestra.run.smithi078.stdout: "fast_read": false, 2024-04-18T21:06:40.236 INFO:teuthology.orchestra.run.smithi078.stdout: "options": { 2024-04-18T21:06:40.236 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num_min": 64, 2024-04-18T21:06:40.236 INFO:teuthology.orchestra.run.smithi078.stdout: "target_size_ratio": 0.89999997615814209 2024-04-18T21:06:40.236 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:40.236 INFO:teuthology.orchestra.run.smithi078.stdout: "application_metadata": { 2024-04-18T21:06:40.236 INFO:teuthology.orchestra.run.smithi078.stdout: "cephfs": { 2024-04-18T21:06:40.236 INFO:teuthology.orchestra.run.smithi078.stdout: "data": "cephfs" 2024-04-18T21:06:40.236 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:06:40.236 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:40.236 INFO:teuthology.orchestra.run.smithi078.stdout: "read_balance": { 2024-04-18T21:06:40.236 INFO:teuthology.orchestra.run.smithi078.stdout: "score_type": "Fair distribution", 2024-04-18T21:06:40.236 INFO:teuthology.orchestra.run.smithi078.stdout: "score_acting": 1.2699999809265137, 2024-04-18T21:06:40.236 INFO:teuthology.orchestra.run.smithi078.stdout: "score_stable": 1.2699999809265137, 2024-04-18T21:06:40.237 INFO:teuthology.orchestra.run.smithi078.stdout: "optimal_score": 1, 2024-04-18T21:06:40.237 INFO:teuthology.orchestra.run.smithi078.stdout: "raw_score_acting": 1.2699999809265137, 2024-04-18T21:06:40.237 INFO:teuthology.orchestra.run.smithi078.stdout: "raw_score_stable": 1.2699999809265137, 2024-04-18T21:06:40.237 INFO:teuthology.orchestra.run.smithi078.stdout: "primary_affinity_weighted": 0.86374413967132568, 2024-04-18T21:06:40.237 INFO:teuthology.orchestra.run.smithi078.stdout: "average_primary_affinity": 0.86000001430511475, 2024-04-18T21:06:40.237 INFO:teuthology.orchestra.run.smithi078.stdout: "average_primary_affinity_weighted": 0.86000001430511475 2024-04-18T21:06:40.237 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:06:40.237 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:06:40.237 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-04-18T21:06:40.237 INFO:teuthology.orchestra.run.smithi078.stdout: "osds": [ 2024-04-18T21:06:40.237 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:40.238 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": 0, 2024-04-18T21:06:40.238 INFO:teuthology.orchestra.run.smithi078.stdout: "uuid": "1854d737-3a67-416a-8c88-0f126505a0f2", 2024-04-18T21:06:40.238 INFO:teuthology.orchestra.run.smithi078.stdout: "up": 1, 2024-04-18T21:06:40.238 INFO:teuthology.orchestra.run.smithi078.stdout: "in": 1, 2024-04-18T21:06:40.238 INFO:teuthology.orchestra.run.smithi078.stdout: "weight": 1, 2024-04-18T21:06:40.238 INFO:teuthology.orchestra.run.smithi078.stdout: "primary_affinity": 1, 2024-04-18T21:06:40.238 INFO:teuthology.orchestra.run.smithi078.stdout: "last_clean_begin": 0, 2024-04-18T21:06:40.238 INFO:teuthology.orchestra.run.smithi078.stdout: "last_clean_end": 0, 2024-04-18T21:06:40.238 INFO:teuthology.orchestra.run.smithi078.stdout: "up_from": 8, 2024-04-18T21:06:40.238 INFO:teuthology.orchestra.run.smithi078.stdout: "up_thru": 32, 2024-04-18T21:06:40.238 INFO:teuthology.orchestra.run.smithi078.stdout: "down_at": 0, 2024-04-18T21:06:40.238 INFO:teuthology.orchestra.run.smithi078.stdout: "lost_at": 0, 2024-04-18T21:06:40.239 INFO:teuthology.orchestra.run.smithi078.stdout: "public_addrs": { 2024-04-18T21:06:40.239 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:06:40.239 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:40.239 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:06:40.239 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.132:6800", 2024-04-18T21:06:40.239 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 1948809768 2024-04-18T21:06:40.239 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:40.239 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:40.239 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:06:40.239 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.132:6801", 2024-04-18T21:06:40.239 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 1948809768 2024-04-18T21:06:40.239 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:06:40.239 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:06:40.239 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:40.240 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_addrs": { 2024-04-18T21:06:40.240 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:06:40.240 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:40.240 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:06:40.240 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.132:6802", 2024-04-18T21:06:40.240 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 1948809768 2024-04-18T21:06:40.240 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:40.240 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:40.240 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:06:40.240 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.132:6803", 2024-04-18T21:06:40.240 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 1948809768 2024-04-18T21:06:40.240 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:06:40.240 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:06:40.240 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:40.240 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_back_addrs": { 2024-04-18T21:06:40.241 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:06:40.241 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:40.241 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:06:40.241 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.132:6806", 2024-04-18T21:06:40.241 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 1948809768 2024-04-18T21:06:40.241 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:40.241 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:40.241 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:06:40.241 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.132:6807", 2024-04-18T21:06:40.241 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 1948809768 2024-04-18T21:06:40.241 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:06:40.241 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:06:40.241 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:40.242 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_front_addrs": { 2024-04-18T21:06:40.242 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:06:40.242 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:40.242 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:06:40.242 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.132:6804", 2024-04-18T21:06:40.242 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 1948809768 2024-04-18T21:06:40.242 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:40.242 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:40.242 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:06:40.242 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.132:6805", 2024-04-18T21:06:40.242 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 1948809768 2024-04-18T21:06:40.242 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:06:40.242 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:06:40.242 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:40.242 INFO:teuthology.orchestra.run.smithi078.stdout: "public_addr": "172.21.15.132:6801/1948809768", 2024-04-18T21:06:40.243 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_addr": "172.21.15.132:6803/1948809768", 2024-04-18T21:06:40.243 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_back_addr": "172.21.15.132:6807/1948809768", 2024-04-18T21:06:40.243 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_front_addr": "172.21.15.132:6805/1948809768", 2024-04-18T21:06:40.243 INFO:teuthology.orchestra.run.smithi078.stdout: "state": [ 2024-04-18T21:06:40.243 INFO:teuthology.orchestra.run.smithi078.stdout: "exists", 2024-04-18T21:06:40.243 INFO:teuthology.orchestra.run.smithi078.stdout: "up" 2024-04-18T21:06:40.243 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:06:40.243 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:40.243 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:40.243 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": 1, 2024-04-18T21:06:40.244 INFO:teuthology.orchestra.run.smithi078.stdout: "uuid": "dfeae661-3f8a-4d41-b287-7eb02c16b91a", 2024-04-18T21:06:40.244 INFO:teuthology.orchestra.run.smithi078.stdout: "up": 1, 2024-04-18T21:06:40.244 INFO:teuthology.orchestra.run.smithi078.stdout: "in": 1, 2024-04-18T21:06:40.244 INFO:teuthology.orchestra.run.smithi078.stdout: "weight": 1, 2024-04-18T21:06:40.244 INFO:teuthology.orchestra.run.smithi078.stdout: "primary_affinity": 1, 2024-04-18T21:06:40.244 INFO:teuthology.orchestra.run.smithi078.stdout: "last_clean_begin": 0, 2024-04-18T21:06:40.244 INFO:teuthology.orchestra.run.smithi078.stdout: "last_clean_end": 0, 2024-04-18T21:06:40.244 INFO:teuthology.orchestra.run.smithi078.stdout: "up_from": 8, 2024-04-18T21:06:40.244 INFO:teuthology.orchestra.run.smithi078.stdout: "up_thru": 32, 2024-04-18T21:06:40.244 INFO:teuthology.orchestra.run.smithi078.stdout: "down_at": 0, 2024-04-18T21:06:40.244 INFO:teuthology.orchestra.run.smithi078.stdout: "lost_at": 0, 2024-04-18T21:06:40.244 INFO:teuthology.orchestra.run.smithi078.stdout: "public_addrs": { 2024-04-18T21:06:40.244 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:06:40.244 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:40.245 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:06:40.245 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.150:6800", 2024-04-18T21:06:40.245 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 2040503167 2024-04-18T21:06:40.245 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:40.245 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:40.245 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:06:40.245 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.150:6801", 2024-04-18T21:06:40.245 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 2040503167 2024-04-18T21:06:40.245 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:06:40.245 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:06:40.246 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:40.246 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_addrs": { 2024-04-18T21:06:40.246 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:06:40.246 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:40.246 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:06:40.246 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.150:6802", 2024-04-18T21:06:40.246 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 2040503167 2024-04-18T21:06:40.246 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:40.246 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:40.246 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:06:40.246 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.150:6803", 2024-04-18T21:06:40.246 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 2040503167 2024-04-18T21:06:40.247 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:06:40.247 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:06:40.247 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:40.247 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_back_addrs": { 2024-04-18T21:06:40.247 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:06:40.247 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:40.247 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:06:40.247 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.150:6806", 2024-04-18T21:06:40.247 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 2040503167 2024-04-18T21:06:40.247 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:40.247 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:40.247 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:06:40.247 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.150:6807", 2024-04-18T21:06:40.247 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 2040503167 2024-04-18T21:06:40.247 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:06:40.248 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:06:40.248 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:40.248 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_front_addrs": { 2024-04-18T21:06:40.248 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:06:40.248 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:40.248 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:06:40.248 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.150:6804", 2024-04-18T21:06:40.248 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 2040503167 2024-04-18T21:06:40.248 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:40.248 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:40.248 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:06:40.249 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.150:6805", 2024-04-18T21:06:40.249 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 2040503167 2024-04-18T21:06:40.249 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:06:40.249 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:06:40.249 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:40.249 INFO:teuthology.orchestra.run.smithi078.stdout: "public_addr": "172.21.15.150:6801/2040503167", 2024-04-18T21:06:40.249 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_addr": "172.21.15.150:6803/2040503167", 2024-04-18T21:06:40.249 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_back_addr": "172.21.15.150:6807/2040503167", 2024-04-18T21:06:40.249 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_front_addr": "172.21.15.150:6805/2040503167", 2024-04-18T21:06:40.250 INFO:teuthology.orchestra.run.smithi078.stdout: "state": [ 2024-04-18T21:06:40.250 INFO:teuthology.orchestra.run.smithi078.stdout: "exists", 2024-04-18T21:06:40.250 INFO:teuthology.orchestra.run.smithi078.stdout: "up" 2024-04-18T21:06:40.250 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:06:40.250 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:40.250 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:40.250 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": 2, 2024-04-18T21:06:40.250 INFO:teuthology.orchestra.run.smithi078.stdout: "uuid": "56a34021-e2dc-41ff-822c-7ec123466f25", 2024-04-18T21:06:40.251 INFO:teuthology.orchestra.run.smithi078.stdout: "up": 1, 2024-04-18T21:06:40.251 INFO:teuthology.orchestra.run.smithi078.stdout: "in": 1, 2024-04-18T21:06:40.251 INFO:teuthology.orchestra.run.smithi078.stdout: "weight": 1, 2024-04-18T21:06:40.251 INFO:teuthology.orchestra.run.smithi078.stdout: "primary_affinity": 0.5912322998046875, 2024-04-18T21:06:40.251 INFO:teuthology.orchestra.run.smithi078.stdout: "last_clean_begin": 0, 2024-04-18T21:06:40.251 INFO:teuthology.orchestra.run.smithi078.stdout: "last_clean_end": 0, 2024-04-18T21:06:40.251 INFO:teuthology.orchestra.run.smithi078.stdout: "up_from": 8, 2024-04-18T21:06:40.251 INFO:teuthology.orchestra.run.smithi078.stdout: "up_thru": 16, 2024-04-18T21:06:40.251 INFO:teuthology.orchestra.run.smithi078.stdout: "down_at": 0, 2024-04-18T21:06:40.251 INFO:teuthology.orchestra.run.smithi078.stdout: "lost_at": 0, 2024-04-18T21:06:40.251 INFO:teuthology.orchestra.run.smithi078.stdout: "public_addrs": { 2024-04-18T21:06:40.251 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:06:40.251 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:40.251 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:06:40.252 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.187:6800", 2024-04-18T21:06:40.252 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 429896900 2024-04-18T21:06:40.252 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:40.252 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:40.252 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:06:40.252 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.187:6801", 2024-04-18T21:06:40.252 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 429896900 2024-04-18T21:06:40.252 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:06:40.252 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:06:40.252 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:40.252 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_addrs": { 2024-04-18T21:06:40.252 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:06:40.252 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:40.252 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:06:40.253 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.187:6802", 2024-04-18T21:06:40.253 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 429896900 2024-04-18T21:06:40.253 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:40.253 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:40.253 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:06:40.253 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.187:6803", 2024-04-18T21:06:40.253 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 429896900 2024-04-18T21:06:40.253 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:06:40.253 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:06:40.253 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:40.253 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_back_addrs": { 2024-04-18T21:06:40.253 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:06:40.254 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:40.254 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:06:40.254 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.187:6806", 2024-04-18T21:06:40.254 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 429896900 2024-04-18T21:06:40.254 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:40.254 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:40.254 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:06:40.254 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.187:6807", 2024-04-18T21:06:40.254 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 429896900 2024-04-18T21:06:40.254 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:06:40.255 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:06:40.255 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:40.255 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_front_addrs": { 2024-04-18T21:06:40.255 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-04-18T21:06:40.255 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:40.255 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-04-18T21:06:40.255 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.187:6804", 2024-04-18T21:06:40.255 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 429896900 2024-04-18T21:06:40.255 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:40.255 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:40.255 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-04-18T21:06:40.255 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.187:6805", 2024-04-18T21:06:40.255 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 429896900 2024-04-18T21:06:40.255 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:06:40.256 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:06:40.256 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:40.256 INFO:teuthology.orchestra.run.smithi078.stdout: "public_addr": "172.21.15.187:6801/429896900", 2024-04-18T21:06:40.256 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_addr": "172.21.15.187:6803/429896900", 2024-04-18T21:06:40.256 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_back_addr": "172.21.15.187:6807/429896900", 2024-04-18T21:06:40.256 INFO:teuthology.orchestra.run.smithi078.stdout: "heartbeat_front_addr": "172.21.15.187:6805/429896900", 2024-04-18T21:06:40.256 INFO:teuthology.orchestra.run.smithi078.stdout: "state": [ 2024-04-18T21:06:40.256 INFO:teuthology.orchestra.run.smithi078.stdout: "exists", 2024-04-18T21:06:40.256 INFO:teuthology.orchestra.run.smithi078.stdout: "up" 2024-04-18T21:06:40.256 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-04-18T21:06:40.256 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:06:40.256 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-04-18T21:06:40.256 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_xinfo": [ 2024-04-18T21:06:40.257 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:40.257 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": 0, 2024-04-18T21:06:40.257 INFO:teuthology.orchestra.run.smithi078.stdout: "down_stamp": "0.000000", 2024-04-18T21:06:40.257 INFO:teuthology.orchestra.run.smithi078.stdout: "laggy_probability": 0, 2024-04-18T21:06:40.257 INFO:teuthology.orchestra.run.smithi078.stdout: "laggy_interval": 0, 2024-04-18T21:06:40.257 INFO:teuthology.orchestra.run.smithi078.stdout: "features": 4540701547738038271, 2024-04-18T21:06:40.257 INFO:teuthology.orchestra.run.smithi078.stdout: "old_weight": 0, 2024-04-18T21:06:40.257 INFO:teuthology.orchestra.run.smithi078.stdout: "last_purged_snaps_scrub": "2024-04-18T21:04:49.804359+0000", 2024-04-18T21:06:40.258 INFO:teuthology.orchestra.run.smithi078.stdout: "dead_epoch": 0 2024-04-18T21:06:40.258 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:40.258 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:40.258 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": 1, 2024-04-18T21:06:40.258 INFO:teuthology.orchestra.run.smithi078.stdout: "down_stamp": "0.000000", 2024-04-18T21:06:40.258 INFO:teuthology.orchestra.run.smithi078.stdout: "laggy_probability": 0, 2024-04-18T21:06:40.258 INFO:teuthology.orchestra.run.smithi078.stdout: "laggy_interval": 0, 2024-04-18T21:06:40.258 INFO:teuthology.orchestra.run.smithi078.stdout: "features": 4540701547738038271, 2024-04-18T21:06:40.258 INFO:teuthology.orchestra.run.smithi078.stdout: "old_weight": 0, 2024-04-18T21:06:40.258 INFO:teuthology.orchestra.run.smithi078.stdout: "last_purged_snaps_scrub": "2024-04-18T21:04:49.790978+0000", 2024-04-18T21:06:40.258 INFO:teuthology.orchestra.run.smithi078.stdout: "dead_epoch": 0 2024-04-18T21:06:40.258 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:40.259 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-18T21:06:40.259 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": 2, 2024-04-18T21:06:40.259 INFO:teuthology.orchestra.run.smithi078.stdout: "down_stamp": "0.000000", 2024-04-18T21:06:40.259 INFO:teuthology.orchestra.run.smithi078.stdout: "laggy_probability": 0, 2024-04-18T21:06:40.259 INFO:teuthology.orchestra.run.smithi078.stdout: "laggy_interval": 0, 2024-04-18T21:06:40.259 INFO:teuthology.orchestra.run.smithi078.stdout: "features": 4540701547738038271, 2024-04-18T21:06:40.259 INFO:teuthology.orchestra.run.smithi078.stdout: "old_weight": 0, 2024-04-18T21:06:40.259 INFO:teuthology.orchestra.run.smithi078.stdout: "last_purged_snaps_scrub": "2024-04-18T21:04:49.762943+0000", 2024-04-18T21:06:40.259 INFO:teuthology.orchestra.run.smithi078.stdout: "dead_epoch": 0 2024-04-18T21:06:40.259 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:06:40.259 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-04-18T21:06:40.259 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_upmap": [], 2024-04-18T21:06:40.260 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_upmap_items": [], 2024-04-18T21:06:40.260 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_upmap_primaries": [], 2024-04-18T21:06:40.260 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_temp": [], 2024-04-18T21:06:40.260 INFO:teuthology.orchestra.run.smithi078.stdout: "primary_temp": [], 2024-04-18T21:06:40.260 INFO:teuthology.orchestra.run.smithi078.stdout: "blocklist": {}, 2024-04-18T21:06:40.260 INFO:teuthology.orchestra.run.smithi078.stdout: "range_blocklist": {}, 2024-04-18T21:06:40.260 INFO:teuthology.orchestra.run.smithi078.stdout: "erasure_code_profiles": { 2024-04-18T21:06:40.260 INFO:teuthology.orchestra.run.smithi078.stdout: "default": { 2024-04-18T21:06:40.260 INFO:teuthology.orchestra.run.smithi078.stdout: "crush-failure-domain": "osd", 2024-04-18T21:06:40.260 INFO:teuthology.orchestra.run.smithi078.stdout: "k": "2", 2024-04-18T21:06:40.260 INFO:teuthology.orchestra.run.smithi078.stdout: "m": "1", 2024-04-18T21:06:40.260 INFO:teuthology.orchestra.run.smithi078.stdout: "plugin": "jerasure", 2024-04-18T21:06:40.260 INFO:teuthology.orchestra.run.smithi078.stdout: "technique": "reed_sol_van" 2024-04-18T21:06:40.260 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:06:40.261 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-18T21:06:40.261 INFO:teuthology.orchestra.run.smithi078.stdout: "removed_snaps_queue": [], 2024-04-18T21:06:40.261 INFO:teuthology.orchestra.run.smithi078.stdout: "new_removed_snaps": [], 2024-04-18T21:06:40.261 INFO:teuthology.orchestra.run.smithi078.stdout: "new_purged_snaps": [], 2024-04-18T21:06:40.261 INFO:teuthology.orchestra.run.smithi078.stdout: "crush_node_flags": {}, 2024-04-18T21:06:40.261 INFO:teuthology.orchestra.run.smithi078.stdout: "device_class_flags": {}, 2024-04-18T21:06:40.261 INFO:teuthology.orchestra.run.smithi078.stdout: "stretch_mode": { 2024-04-18T21:06:40.261 INFO:teuthology.orchestra.run.smithi078.stdout: "stretch_mode_enabled": false, 2024-04-18T21:06:40.261 INFO:teuthology.orchestra.run.smithi078.stdout: "stretch_bucket_count": 0, 2024-04-18T21:06:40.261 INFO:teuthology.orchestra.run.smithi078.stdout: "degraded_stretch_mode": 0, 2024-04-18T21:06:40.261 INFO:teuthology.orchestra.run.smithi078.stdout: "recovering_stretch_mode": 0, 2024-04-18T21:06:40.261 INFO:teuthology.orchestra.run.smithi078.stdout: "stretch_mode_bucket": 0 2024-04-18T21:06:40.261 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-18T21:06:40.262 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-04-18T21:06:40.263 INFO:tasks.thrashosds.thrasher:j is {'epoch': 49, 'fsid': 'dc017990-0393-4ab0-b604-5e7052fdc7bd', 'created': '2024-04-18T21:04:43.507538+0000', 'modified': '2024-04-18T21:06:37.690782+0000', 'last_up_change': '2024-04-18T21:04:52.492503+0000', 'last_in_change': '2024-04-18T21:04:44.402191+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T21:04:52.538153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8637441396713257, 'average_primary_affinity': 0.8600000143051147, 'average_primary_affinity_weighted': 0.8600000143051147}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-18T21:04:58.673793+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.8637441396713257, 'average_primary_affinity': 0.8600000143051147, 'average_primary_affinity_weighted': 0.8600000143051147}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T21:05:03.314171+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 0.8637441396713257, 'average_primary_affinity': 0.8600000143051147, 'average_primary_affinity_weighted': 0.8600000143051147}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T21:05:03.931699+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.2699999809265137, 'score_stable': 1.2699999809265137, 'optimal_score': 1, 'raw_score_acting': 1.2699999809265137, 'raw_score_stable': 1.2699999809265137, 'primary_affinity_weighted': 0.8637441396713257, 'average_primary_affinity': 0.8600000143051147, 'average_primary_affinity_weighted': 0.8600000143051147}}], 'osds': [{'osd': 0, 'uuid': '1854d737-3a67-416a-8c88-0f126505a0f2', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 32, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.132:6800', 'nonce': 1948809768}, {'type': 'v1', 'addr': '172.21.15.132:6801', 'nonce': 1948809768}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.132:6802', 'nonce': 1948809768}, {'type': 'v1', 'addr': '172.21.15.132:6803', 'nonce': 1948809768}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.132:6806', 'nonce': 1948809768}, {'type': 'v1', 'addr': '172.21.15.132:6807', 'nonce': 1948809768}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.132:6804', 'nonce': 1948809768}, {'type': 'v1', 'addr': '172.21.15.132:6805', 'nonce': 1948809768}]}, 'public_addr': '172.21.15.132:6801/1948809768', 'cluster_addr': '172.21.15.132:6803/1948809768', 'heartbeat_back_addr': '172.21.15.132:6807/1948809768', 'heartbeat_front_addr': '172.21.15.132:6805/1948809768', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'dfeae661-3f8a-4d41-b287-7eb02c16b91a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 32, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6800', 'nonce': 2040503167}, {'type': 'v1', 'addr': '172.21.15.150:6801', 'nonce': 2040503167}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6802', 'nonce': 2040503167}, {'type': 'v1', 'addr': '172.21.15.150:6803', 'nonce': 2040503167}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6806', 'nonce': 2040503167}, {'type': 'v1', 'addr': '172.21.15.150:6807', 'nonce': 2040503167}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6804', 'nonce': 2040503167}, {'type': 'v1', 'addr': '172.21.15.150:6805', 'nonce': 2040503167}]}, 'public_addr': '172.21.15.150:6801/2040503167', 'cluster_addr': '172.21.15.150:6803/2040503167', 'heartbeat_back_addr': '172.21.15.150:6807/2040503167', 'heartbeat_front_addr': '172.21.15.150:6805/2040503167', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '56a34021-e2dc-41ff-822c-7ec123466f25', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.5912322998046875, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6800', 'nonce': 429896900}, {'type': 'v1', 'addr': '172.21.15.187:6801', 'nonce': 429896900}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6802', 'nonce': 429896900}, {'type': 'v1', 'addr': '172.21.15.187:6803', 'nonce': 429896900}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6806', 'nonce': 429896900}, {'type': 'v1', 'addr': '172.21.15.187:6807', 'nonce': 429896900}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6804', 'nonce': 429896900}, {'type': 'v1', 'addr': '172.21.15.187:6805', 'nonce': 429896900}]}, 'public_addr': '172.21.15.187:6801/429896900', 'cluster_addr': '172.21.15.187:6803/429896900', 'heartbeat_back_addr': '172.21.15.187:6807/429896900', 'heartbeat_front_addr': '172.21.15.187:6805/429896900', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-18T21:04:49.804359+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-18T21:04:49.790978+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-18T21:04:49.762943+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-18T21:06:40.263 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:06:40.284 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:40.283+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:40.288 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:06:40.289 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [], 2024-04-18T21:06:40.289 INFO:teuthology.orchestra.run.smithi150.stdout: "complaint_time": 30, 2024-04-18T21:06:40.289 INFO:teuthology.orchestra.run.smithi150.stdout: "num_blocked_ops": 0 2024-04-18T21:06:40.289 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:06:40.304 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:40.385 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:40.382+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:40.478 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:06:40.478 INFO:teuthology.orchestra.run.smithi150.stdout: "size": 20, 2024-04-18T21:06:40.478 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 600, 2024-04-18T21:06:40.478 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [ 2024-04-18T21:06:40.478 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.478 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-18T21:06:40.478 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:06:40.479 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 105.673033691, 2024-04-18T21:06:40.479 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0093051590000000003, 2024-04-18T21:06:40.479 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:40.479 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:40.479 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:40.479 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:40.479 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.479 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:40.479 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:06:40.479 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:40.479 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.479 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.479 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:40.479 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:06:40.479 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:40.479 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.480 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.480 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:40.480 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804851+0000", 2024-04-18T21:06:40.480 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7039999999999999e-06 2024-04-18T21:06:40.480 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.480 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.480 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:40.480 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804864+0000", 2024-04-18T21:06:40.480 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.276e-05 2024-04-18T21:06:40.480 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.480 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.480 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:40.480 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804895+0000", 2024-04-18T21:06:40.480 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.1204999999999997e-05 2024-04-18T21:06:40.481 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.481 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.481 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:40.481 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804908+0000", 2024-04-18T21:06:40.481 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3317e-05 2024-04-18T21:06:40.481 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.481 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.481 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:40.481 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805131+0000", 2024-04-18T21:06:40.481 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00022246700000000001 2024-04-18T21:06:40.481 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.481 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.481 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:40.482 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805171+0000", 2024-04-18T21:06:40.482 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.0164999999999999e-05 2024-04-18T21:06:40.482 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.482 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.482 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:40.482 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814086+0000", 2024-04-18T21:06:40.482 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0089155329999999998 2024-04-18T21:06:40.482 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.482 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.482 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:40.483 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814154+0000", 2024-04-18T21:06:40.483 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.8008000000000003e-05 2024-04-18T21:06:40.483 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:40.483 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:40.483 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:40.483 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.483 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.483 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'64)", 2024-04-18T21:06:40.483 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:06:40.483 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 105.670497454, 2024-04-18T21:06:40.483 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0089721509999999994, 2024-04-18T21:06:40.483 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:40.484 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:40.484 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:40.484 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:40.484 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.484 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:40.484 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:06:40.484 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:40.484 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.484 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.484 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:40.484 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807385+0000", 2024-04-18T21:06:40.484 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:40.484 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.484 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.485 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:40.485 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807387+0000", 2024-04-18T21:06:40.485 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.0329999999999998e-06 2024-04-18T21:06:40.485 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.485 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.485 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:40.485 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807443+0000", 2024-04-18T21:06:40.485 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.5376e-05 2024-04-18T21:06:40.485 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.485 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.485 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:40.485 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807467+0000", 2024-04-18T21:06:40.485 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.4621999999999999e-05 2024-04-18T21:06:40.485 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.485 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.485 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:40.486 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.807482+0000", 2024-04-18T21:06:40.486 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.436e-05 2024-04-18T21:06:40.486 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.486 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.486 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:40.486 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.809243+0000", 2024-04-18T21:06:40.486 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001761725 2024-04-18T21:06:40.486 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.486 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.486 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:40.486 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.809295+0000", 2024-04-18T21:06:40.486 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.1445e-05 2024-04-18T21:06:40.487 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.487 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.487 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:40.487 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.816293+0000", 2024-04-18T21:06:40.487 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0069981749999999997 2024-04-18T21:06:40.487 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.487 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.487 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:40.487 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.816357+0000", 2024-04-18T21:06:40.487 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.4414999999999999e-05 2024-04-18T21:06:40.487 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:40.487 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:40.487 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:40.487 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.487 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.487 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:40.488 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:06:40.488 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 94.862588083999995, 2024-04-18T21:06:40.488 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.040843365, 2024-04-18T21:06:40.488 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:40.488 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:40.488 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:40.488 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:40.488 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.488 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:40.488 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:06:40.488 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:40.488 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.488 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.488 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:40.489 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:06:40.489 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:40.489 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.489 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.489 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:40.489 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615297+0000", 2024-04-18T21:06:40.489 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2800000000000002e-06 2024-04-18T21:06:40.489 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.489 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.489 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:40.489 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615308+0000", 2024-04-18T21:06:40.489 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0813e-05 2024-04-18T21:06:40.489 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.489 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.489 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:40.490 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615330+0000", 2024-04-18T21:06:40.490 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2370000000000001e-05 2024-04-18T21:06:40.490 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.490 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.490 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:40.490 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615346+0000", 2024-04-18T21:06:40.490 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6200000000000001e-05 2024-04-18T21:06:40.490 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.490 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.490 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:40.490 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615470+0000", 2024-04-18T21:06:40.490 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012385799999999999 2024-04-18T21:06:40.490 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.491 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.491 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:40.491 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615488+0000", 2024-04-18T21:06:40.491 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7923000000000001e-05 2024-04-18T21:06:40.491 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.491 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.491 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:40.491 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.630993+0000", 2024-04-18T21:06:40.491 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.01550532 2024-04-18T21:06:40.491 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.491 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.491 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:40.491 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631165+0000", 2024-04-18T21:06:40.491 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000171588 2024-04-18T21:06:40.491 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.492 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.492 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:40.492 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631320+0000", 2024-04-18T21:06:40.492 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000155162 2024-04-18T21:06:40.492 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.492 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.492 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:40.492 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635157+0000", 2024-04-18T21:06:40.492 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0038370790000000002 2024-04-18T21:06:40.492 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.492 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.492 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:40.492 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.655904+0000", 2024-04-18T21:06:40.492 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.020746483999999999 2024-04-18T21:06:40.493 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.493 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.493 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:40.493 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656032+0000", 2024-04-18T21:06:40.493 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012864199999999999 2024-04-18T21:06:40.493 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.493 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.493 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:40.493 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656138+0000", 2024-04-18T21:06:40.493 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000105646 2024-04-18T21:06:40.493 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:40.493 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:40.493 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:40.494 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.494 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.494 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:40.494 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:06:40.494 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 94.862495912, 2024-04-18T21:06:40.494 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.041266444999999999, 2024-04-18T21:06:40.494 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:40.494 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:40.494 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:40.494 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:40.494 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.494 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:40.494 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:06:40.494 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:40.495 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.495 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.495 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:40.495 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:06:40.495 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:40.495 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.495 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.495 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:40.495 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615388+0000", 2024-04-18T21:06:40.495 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:06:40.495 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.495 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.495 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:40.495 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:06:40.496 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.7299999999999994e-06 2024-04-18T21:06:40.496 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.496 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.496 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:40.496 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615415+0000", 2024-04-18T21:06:40.496 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7807000000000001e-05 2024-04-18T21:06:40.496 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.496 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.496 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:40.496 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615431+0000", 2024-04-18T21:06:40.496 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6127e-05 2024-04-18T21:06:40.496 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.496 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.496 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:40.497 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615621+0000", 2024-04-18T21:06:40.497 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000189781 2024-04-18T21:06:40.497 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.497 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.497 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:40.497 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615634+0000", 2024-04-18T21:06:40.497 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3383e-05 2024-04-18T21:06:40.497 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.497 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.497 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:40.497 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631703+0000", 2024-04-18T21:06:40.497 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016068737 2024-04-18T21:06:40.497 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.497 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.498 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:40.498 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631809+0000", 2024-04-18T21:06:40.498 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000106823 2024-04-18T21:06:40.498 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.498 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.498 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:40.498 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631988+0000", 2024-04-18T21:06:40.498 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000179008 2024-04-18T21:06:40.498 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.498 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.498 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:40.498 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635172+0000", 2024-04-18T21:06:40.499 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.003183029 2024-04-18T21:06:40.499 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.499 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.499 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:40.499 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656392+0000", 2024-04-18T21:06:40.499 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.021220638999999999 2024-04-18T21:06:40.499 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.499 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.499 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:40.499 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656533+0000", 2024-04-18T21:06:40.499 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014126500000000001 2024-04-18T21:06:40.500 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.500 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.500 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:40.500 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656653+0000", 2024-04-18T21:06:40.500 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000119883 2024-04-18T21:06:40.500 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:40.500 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:40.500 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:40.500 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.500 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.500 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:40.500 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:06:40.500 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 94.862408489000003, 2024-04-18T21:06:40.500 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.042492302000000003, 2024-04-18T21:06:40.501 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:40.501 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:40.501 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:40.501 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:40.501 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.501 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:40.501 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:06:40.501 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:40.501 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.501 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.501 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:40.501 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:06:40.501 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:40.501 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.501 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.502 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:40.502 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615475+0000", 2024-04-18T21:06:40.502 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.17e-06 2024-04-18T21:06:40.502 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.502 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.502 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:40.502 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615528+0000", 2024-04-18T21:06:40.502 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.2159e-05 2024-04-18T21:06:40.502 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.502 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.502 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:40.502 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615542+0000", 2024-04-18T21:06:40.502 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4197e-05 2024-04-18T21:06:40.503 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.503 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.503 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:40.503 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615559+0000", 2024-04-18T21:06:40.503 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.749e-05 2024-04-18T21:06:40.503 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.503 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.503 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:40.503 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615685+0000", 2024-04-18T21:06:40.503 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012617499999999999 2024-04-18T21:06:40.503 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.503 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.503 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:40.503 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:06:40.503 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4749999999999999e-05 2024-04-18T21:06:40.504 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.504 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.504 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:40.504 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632332+0000", 2024-04-18T21:06:40.504 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016631988 2024-04-18T21:06:40.504 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.504 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.504 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:40.504 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632477+0000", 2024-04-18T21:06:40.504 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014437200000000001 2024-04-18T21:06:40.504 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.504 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.504 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:40.504 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632620+0000", 2024-04-18T21:06:40.504 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000143566 2024-04-18T21:06:40.505 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.505 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.505 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:40.505 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635185+0000", 2024-04-18T21:06:40.505 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0025644209999999999 2024-04-18T21:06:40.505 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.505 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.505 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:40.505 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657803+0000", 2024-04-18T21:06:40.505 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.022618743 2024-04-18T21:06:40.505 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.505 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.505 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:40.505 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657890+0000", 2024-04-18T21:06:40.506 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.6688999999999996e-05 2024-04-18T21:06:40.506 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.506 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.506 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:40.506 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657967+0000", 2024-04-18T21:06:40.506 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.6582000000000006e-05 2024-04-18T21:06:40.506 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:40.506 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:40.506 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:40.506 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.506 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.506 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:40.506 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:06:40.507 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 94.862277676999994, 2024-04-18T21:06:40.507 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.043603435000000003, 2024-04-18T21:06:40.507 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:40.507 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:40.507 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:40.507 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:40.507 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.507 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:40.507 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:06:40.507 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:40.507 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.507 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.507 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:40.507 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:06:40.507 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:40.508 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.508 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.508 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:40.508 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615607+0000", 2024-04-18T21:06:40.508 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4300000000000001e-06 2024-04-18T21:06:40.508 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.508 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.508 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:40.508 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615614+0000", 2024-04-18T21:06:40.508 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.4100000000000002e-06 2024-04-18T21:06:40.508 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.508 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.508 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:40.508 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615632+0000", 2024-04-18T21:06:40.509 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7863000000000002e-05 2024-04-18T21:06:40.509 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.509 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.509 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:40.509 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615647+0000", 2024-04-18T21:06:40.509 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5187e-05 2024-04-18T21:06:40.509 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.509 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.509 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:40.509 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615765+0000", 2024-04-18T21:06:40.509 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000117955 2024-04-18T21:06:40.510 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.510 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.510 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:40.510 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615781+0000", 2024-04-18T21:06:40.510 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6123000000000001e-05 2024-04-18T21:06:40.510 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.510 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.510 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:40.510 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633055+0000", 2024-04-18T21:06:40.510 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.017273909 2024-04-18T21:06:40.510 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.511 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.511 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:40.511 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633254+0000", 2024-04-18T21:06:40.511 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00019903799999999999 2024-04-18T21:06:40.511 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.511 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.511 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:40.511 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633624+0000", 2024-04-18T21:06:40.511 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000369656 2024-04-18T21:06:40.511 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.511 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.511 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:40.511 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635595+0000", 2024-04-18T21:06:40.511 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001971287 2024-04-18T21:06:40.511 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.512 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.512 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:40.512 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659026+0000", 2024-04-18T21:06:40.512 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.023431495 2024-04-18T21:06:40.512 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.512 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.512 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:40.512 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659117+0000", 2024-04-18T21:06:40.512 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0885999999999997e-05 2024-04-18T21:06:40.512 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.512 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.512 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:40.512 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659209+0000", 2024-04-18T21:06:40.512 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.1195999999999999e-05 2024-04-18T21:06:40.513 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:40.513 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:40.513 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:40.513 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.513 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.513 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:40.513 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:40.513 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 94.862212447999994, 2024-04-18T21:06:40.513 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.03492514, 2024-04-18T21:06:40.513 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:40.513 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:40.513 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:40.513 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:40.513 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.514 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:40.514 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:40.514 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:40.514 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.514 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.514 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:40.514 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:40.514 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:40.514 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.514 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.514 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:40.514 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:06:40.514 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.407e-06 2024-04-18T21:06:40.515 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.515 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.515 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:40.515 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615679+0000", 2024-04-18T21:06:40.515 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.2130000000000002e-06 2024-04-18T21:06:40.515 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.515 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.515 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:40.515 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615701+0000", 2024-04-18T21:06:40.515 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2316000000000001e-05 2024-04-18T21:06:40.515 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.515 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.515 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:40.516 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615717+0000", 2024-04-18T21:06:40.516 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6197000000000001e-05 2024-04-18T21:06:40.516 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.516 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.516 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:40.516 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615828+0000", 2024-04-18T21:06:40.516 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000110899 2024-04-18T21:06:40.516 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.516 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.516 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:40.517 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615840+0000", 2024-04-18T21:06:40.517 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.1423000000000001e-05 2024-04-18T21:06:40.517 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.517 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.517 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:40.517 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628046+0000", 2024-04-18T21:06:40.517 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.012206295000000001 2024-04-18T21:06:40.517 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.517 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.517 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:40.517 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628323+0000", 2024-04-18T21:06:40.517 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00027658700000000001 2024-04-18T21:06:40.517 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.518 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.518 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:40.518 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628599+0000", 2024-04-18T21:06:40.518 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00027676699999999997 2024-04-18T21:06:40.518 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.518 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.518 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:40.518 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634869+0000", 2024-04-18T21:06:40.518 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.006269536 2024-04-18T21:06:40.518 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.518 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.518 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:40.518 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650333+0000", 2024-04-18T21:06:40.519 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.015463645999999999 2024-04-18T21:06:40.519 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.519 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.519 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:40.519 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650474+0000", 2024-04-18T21:06:40.519 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014091799999999999 2024-04-18T21:06:40.519 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.519 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.519 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:40.519 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650595+0000", 2024-04-18T21:06:40.519 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012193600000000001 2024-04-18T21:06:40.519 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:40.520 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:40.520 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:40.520 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.520 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.520 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:40.520 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:06:40.520 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 94.862127338999997, 2024-04-18T21:06:40.520 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.040588320999999997, 2024-04-18T21:06:40.520 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:40.520 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:40.520 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:40.520 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:40.520 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.520 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:40.520 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:06:40.521 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:40.521 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.521 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.521 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:40.521 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:06:40.521 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:40.521 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.521 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.521 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:40.521 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615757+0000", 2024-04-18T21:06:40.521 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2270000000000001e-06 2024-04-18T21:06:40.521 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.521 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.521 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:40.522 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615765+0000", 2024-04-18T21:06:40.522 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.9400000000000002e-06 2024-04-18T21:06:40.522 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.522 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.522 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:40.522 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615785+0000", 2024-04-18T21:06:40.522 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.0749000000000001e-05 2024-04-18T21:06:40.522 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.522 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.522 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:40.522 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615804+0000", 2024-04-18T21:06:40.522 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.8774e-05 2024-04-18T21:06:40.522 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.523 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.523 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:40.523 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615888+0000", 2024-04-18T21:06:40.523 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.4111999999999997e-05 2024-04-18T21:06:40.523 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.523 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.523 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:40.523 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615895+0000", 2024-04-18T21:06:40.523 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.0469999999999996e-06 2024-04-18T21:06:40.523 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.523 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.523 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:40.523 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629280+0000", 2024-04-18T21:06:40.523 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.013384416 2024-04-18T21:06:40.524 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.524 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.524 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:40.524 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629488+0000", 2024-04-18T21:06:40.524 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00020852800000000001 2024-04-18T21:06:40.524 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.524 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.524 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:40.524 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629869+0000", 2024-04-18T21:06:40.524 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00038042300000000001 2024-04-18T21:06:40.524 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.524 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.524 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:40.524 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635041+0000", 2024-04-18T21:06:40.525 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.005172383 2024-04-18T21:06:40.525 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.525 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.525 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:40.525 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656125+0000", 2024-04-18T21:06:40.525 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.021084025999999999 2024-04-18T21:06:40.525 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.525 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.525 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:40.525 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656240+0000", 2024-04-18T21:06:40.525 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000115352 2024-04-18T21:06:40.525 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.525 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.525 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:40.525 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656344+0000", 2024-04-18T21:06:40.525 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00010334400000000001 2024-04-18T21:06:40.526 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:40.526 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:40.526 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:40.526 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.526 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.526 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:40.526 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:40.526 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 94.862060018999998, 2024-04-18T21:06:40.526 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.043549577999999999, 2024-04-18T21:06:40.526 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:40.526 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:40.526 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:40.526 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:40.527 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.527 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:40.527 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:40.527 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:40.527 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.527 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.527 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:40.527 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:40.527 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:40.527 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.527 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.527 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:40.527 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:40.527 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.5000000000000002e-07 2024-04-18T21:06:40.528 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.528 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.528 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:40.528 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615828+0000", 2024-04-18T21:06:40.528 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.2359999999999998e-06 2024-04-18T21:06:40.528 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.528 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.528 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:40.528 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615838+0000", 2024-04-18T21:06:40.528 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0087e-05 2024-04-18T21:06:40.528 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.528 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.528 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:40.528 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615846+0000", 2024-04-18T21:06:40.528 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.67e-06 2024-04-18T21:06:40.528 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.529 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.529 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:40.529 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615963+0000", 2024-04-18T21:06:40.529 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00011630500000000001 2024-04-18T21:06:40.529 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.529 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.529 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:40.529 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615979+0000", 2024-04-18T21:06:40.529 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.613e-05 2024-04-18T21:06:40.529 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.529 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.529 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:40.530 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632392+0000", 2024-04-18T21:06:40.530 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016413317 2024-04-18T21:06:40.530 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.530 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.530 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:40.530 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632568+0000", 2024-04-18T21:06:40.530 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00017539500000000001 2024-04-18T21:06:40.530 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.530 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.530 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:40.530 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632748+0000", 2024-04-18T21:06:40.530 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00017991799999999999 2024-04-18T21:06:40.530 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.531 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.531 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:40.531 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635542+0000", 2024-04-18T21:06:40.531 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00279481 2024-04-18T21:06:40.531 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.531 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.531 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:40.531 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659232+0000", 2024-04-18T21:06:40.531 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.023689212000000001 2024-04-18T21:06:40.531 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.531 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.531 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:40.531 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659314+0000", 2024-04-18T21:06:40.532 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.2528999999999995e-05 2024-04-18T21:06:40.532 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.532 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.532 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:40.532 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659372+0000", 2024-04-18T21:06:40.532 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.8218999999999999e-05 2024-04-18T21:06:40.532 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:40.532 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:40.532 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:40.532 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.532 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.532 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:40.532 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:06:40.532 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 94.861998587000002, 2024-04-18T21:06:40.532 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.039335347, 2024-04-18T21:06:40.533 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:40.533 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:40.533 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "started", 2024-04-18T21:06:40.533 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:40.533 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.533 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:40.533 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:06:40.533 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:40.533 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.533 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.533 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:40.533 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:06:40.533 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:40.534 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.534 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.534 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:40.534 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615885+0000", 2024-04-18T21:06:40.534 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2699999999999999e-06 2024-04-18T21:06:40.534 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.534 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.534 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:40.534 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615892+0000", 2024-04-18T21:06:40.534 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.6499999999999999e-06 2024-04-18T21:06:40.534 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.534 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.535 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:40.535 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615906+0000", 2024-04-18T21:06:40.535 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.393e-05 2024-04-18T21:06:40.535 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.535 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.535 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:40.535 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615919+0000", 2024-04-18T21:06:40.535 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2860000000000001e-05 2024-04-18T21:06:40.535 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.535 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.535 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:40.535 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616027+0000", 2024-04-18T21:06:40.535 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000107852 2024-04-18T21:06:40.535 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.536 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.536 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:40.536 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616037+0000", 2024-04-18T21:06:40.536 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:06:40.536 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.536 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.536 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:40.536 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622719+0000", 2024-04-18T21:06:40.536 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0066817220000000002 2024-04-18T21:06:40.536 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.536 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.536 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:40.536 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623006+0000", 2024-04-18T21:06:40.536 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00028783699999999999 2024-04-18T21:06:40.537 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.537 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.537 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:40.537 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.655220+0000", 2024-04-18T21:06:40.537 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.032213036 2024-04-18T21:06:40.537 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:40.537 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:40.537 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:40.537 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.537 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.537 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:40.537 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:40.537 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 94.861942913999997, 2024-04-18T21:06:40.538 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.032845253999999997, 2024-04-18T21:06:40.538 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:40.538 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:40.538 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "started", 2024-04-18T21:06:40.538 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:40.538 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.538 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:40.538 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:40.538 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:40.538 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.538 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.538 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:40.539 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:40.539 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:40.539 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.539 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.539 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:40.539 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615942+0000", 2024-04-18T21:06:40.539 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.717e-06 2024-04-18T21:06:40.539 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.539 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.539 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:40.539 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615946+0000", 2024-04-18T21:06:40.539 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.6e-06 2024-04-18T21:06:40.539 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.539 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.540 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:40.540 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615960+0000", 2024-04-18T21:06:40.540 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:06:40.540 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.540 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.540 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:40.540 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615968+0000", 2024-04-18T21:06:40.540 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.9070000000000007e-06 2024-04-18T21:06:40.540 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.540 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.540 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:40.540 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616100+0000", 2024-04-18T21:06:40.540 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000132402 2024-04-18T21:06:40.541 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.541 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.541 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:40.541 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616117+0000", 2024-04-18T21:06:40.541 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6653000000000001e-05 2024-04-18T21:06:40.541 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.541 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.541 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:40.541 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621566+0000", 2024-04-18T21:06:40.541 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0054497740000000001 2024-04-18T21:06:40.541 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.541 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.541 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:40.541 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622801+0000", 2024-04-18T21:06:40.542 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0012345710000000001 2024-04-18T21:06:40.542 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.542 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.542 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:40.542 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648785+0000", 2024-04-18T21:06:40.542 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.025984104000000001 2024-04-18T21:06:40.542 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:40.542 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:40.542 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:40.542 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.542 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.542 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:40.542 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:06:40.542 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 94.856091563999996, 2024-04-18T21:06:40.543 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.011561350999999999, 2024-04-18T21:06:40.543 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:40.543 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:40.543 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:40.543 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:40.543 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.543 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:40.543 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:06:40.543 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:40.543 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.543 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.543 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:40.544 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:06:40.544 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:40.544 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.544 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.544 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:40.544 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621792+0000", 2024-04-18T21:06:40.544 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.4000000000000001e-07 2024-04-18T21:06:40.544 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.544 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.544 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:40.544 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:06:40.544 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.1050000000000002e-05 2024-04-18T21:06:40.544 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.544 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.544 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:40.545 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622608+0000", 2024-04-18T21:06:40.545 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00077505900000000003 2024-04-18T21:06:40.545 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.545 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.545 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:40.545 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623879+0000", 2024-04-18T21:06:40.545 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0012705839999999999 2024-04-18T21:06:40.545 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.545 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.545 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:40.545 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624010+0000", 2024-04-18T21:06:40.545 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00013176900000000001 2024-04-18T21:06:40.545 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.545 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.545 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:40.545 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624058+0000", 2024-04-18T21:06:40.546 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.7299000000000002e-05 2024-04-18T21:06:40.546 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.546 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.546 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:40.546 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633262+0000", 2024-04-18T21:06:40.546 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0092048770000000002 2024-04-18T21:06:40.546 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.546 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.546 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:40.546 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633353+0000", 2024-04-18T21:06:40.546 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0073000000000003e-05 2024-04-18T21:06:40.546 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:40.546 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:40.546 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:40.547 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.547 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.547 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:40.547 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:06:40.547 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 94.853964177999998, 2024-04-18T21:06:40.547 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0098419370000000003, 2024-04-18T21:06:40.547 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:40.547 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:40.547 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:40.547 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:40.547 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.547 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:40.547 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:06:40.548 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:40.548 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.548 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.548 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:40.548 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:06:40.548 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:40.548 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.548 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.548 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:40.548 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623920+0000", 2024-04-18T21:06:40.548 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2240000000000001e-06 2024-04-18T21:06:40.548 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.548 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.548 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:40.548 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623933+0000", 2024-04-18T21:06:40.549 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3653e-05 2024-04-18T21:06:40.549 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.549 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.549 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:40.549 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623956+0000", 2024-04-18T21:06:40.549 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2059e-05 2024-04-18T21:06:40.549 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.549 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.549 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:40.549 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623975+0000", 2024-04-18T21:06:40.549 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.9806999999999999e-05 2024-04-18T21:06:40.549 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.549 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.549 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:40.550 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626943+0000", 2024-04-18T21:06:40.550 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0029681579999999998 2024-04-18T21:06:40.550 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.550 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.550 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:40.550 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626993+0000", 2024-04-18T21:06:40.550 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.9935999999999998e-05 2024-04-18T21:06:40.550 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.550 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.550 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:40.550 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633665+0000", 2024-04-18T21:06:40.550 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0066719250000000004 2024-04-18T21:06:40.550 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.551 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.551 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:40.551 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633761+0000", 2024-04-18T21:06:40.551 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.5174999999999996e-05 2024-04-18T21:06:40.551 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:40.551 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:40.551 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:40.551 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.551 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.551 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:2 3.f e17/15 3:f1f69726:::400.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:40.552 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:06:40.552 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 94.853132559000002, 2024-04-18T21:06:40.552 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0090159079999999996, 2024-04-18T21:06:40.552 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:40.552 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:40.552 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:40.552 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:40.552 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.553 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:40.553 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:06:40.553 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:40.553 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.553 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.553 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:40.553 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624750+0000", 2024-04-18T21:06:40.553 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:40.553 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.553 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.554 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:40.554 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624751+0000", 2024-04-18T21:06:40.554 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.7600000000000006e-07 2024-04-18T21:06:40.554 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.554 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.554 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:40.554 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624787+0000", 2024-04-18T21:06:40.554 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.6273000000000003e-05 2024-04-18T21:06:40.554 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.554 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.554 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:40.554 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625837+0000", 2024-04-18T21:06:40.554 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00104992 2024-04-18T21:06:40.554 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.555 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.555 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:40.555 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625860+0000", 2024-04-18T21:06:40.555 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3110000000000001e-05 2024-04-18T21:06:40.555 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.555 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.555 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:40.555 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.625984+0000", 2024-04-18T21:06:40.555 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012399199999999999 2024-04-18T21:06:40.555 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.555 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.555 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:40.555 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626030+0000", 2024-04-18T21:06:40.556 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.5429999999999997e-05 2024-04-18T21:06:40.556 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.556 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.556 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:40.556 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633643+0000", 2024-04-18T21:06:40.556 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0076129320000000002 2024-04-18T21:06:40.556 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.556 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.556 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:40.556 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633766+0000", 2024-04-18T21:06:40.556 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000123275 2024-04-18T21:06:40.556 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:40.556 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:40.557 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:40.557 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.557 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.557 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:40.557 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:06:40.557 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 94.851878834999994, 2024-04-18T21:06:40.557 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0088669170000000002, 2024-04-18T21:06:40.557 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:40.557 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:40.557 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:40.557 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:40.557 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.557 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:40.557 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:06:40.558 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:40.558 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.558 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.558 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:40.558 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626004+0000", 2024-04-18T21:06:40.558 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:40.558 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.558 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.558 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:40.558 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626005+0000", 2024-04-18T21:06:40.558 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.5000000000000001e-07 2024-04-18T21:06:40.558 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.558 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.559 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:40.559 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626028+0000", 2024-04-18T21:06:40.559 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2756999999999999e-05 2024-04-18T21:06:40.559 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.559 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.559 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:40.559 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626050+0000", 2024-04-18T21:06:40.559 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2140000000000001e-05 2024-04-18T21:06:40.559 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.559 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.559 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:40.559 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626065+0000", 2024-04-18T21:06:40.559 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5176e-05 2024-04-18T21:06:40.559 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.559 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.560 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:40.560 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628334+0000", 2024-04-18T21:06:40.560 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0022691439999999998 2024-04-18T21:06:40.560 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.560 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.560 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:40.560 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628379+0000", 2024-04-18T21:06:40.560 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.5420000000000002e-05 2024-04-18T21:06:40.560 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.560 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.560 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:40.560 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634770+0000", 2024-04-18T21:06:40.560 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0063908410000000004 2024-04-18T21:06:40.560 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.560 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.561 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:40.561 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634871+0000", 2024-04-18T21:06:40.561 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000100589 2024-04-18T21:06:40.561 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:40.561 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:40.561 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:40.561 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.561 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.561 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:13 3.10 e17/15 3:0d89b25e:::603.00000000:head v 17'8, mlcod=0'0)", 2024-04-18T21:06:40.561 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:06:40.561 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 94.833045405999997, 2024-04-18T21:06:40.562 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0090974379999999994, 2024-04-18T21:06:40.562 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:40.562 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:40.562 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:40.562 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:40.562 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.562 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:40.562 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:06:40.562 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:40.562 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.562 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.562 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:40.562 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644837+0000", 2024-04-18T21:06:40.562 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:40.563 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.563 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.563 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:40.563 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644838+0000", 2024-04-18T21:06:40.563 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.569999999999999e-07 2024-04-18T21:06:40.563 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.563 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.563 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:40.563 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644846+0000", 2024-04-18T21:06:40.563 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.4499999999999998e-06 2024-04-18T21:06:40.563 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.563 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.563 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:40.563 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644861+0000", 2024-04-18T21:06:40.563 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5243e-05 2024-04-18T21:06:40.564 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.564 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.564 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:40.564 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.644997+0000", 2024-04-18T21:06:40.564 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000135609 2024-04-18T21:06:40.564 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.564 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.564 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:40.564 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649150+0000", 2024-04-18T21:06:40.564 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0041536760000000002 2024-04-18T21:06:40.564 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.564 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.564 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:40.564 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649207+0000", 2024-04-18T21:06:40.565 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.6677e-05 2024-04-18T21:06:40.565 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.565 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.565 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:40.565 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.653840+0000", 2024-04-18T21:06:40.565 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0046329700000000001 2024-04-18T21:06:40.565 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.565 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.565 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:40.565 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.653935+0000", 2024-04-18T21:06:40.565 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.4856000000000001e-05 2024-04-18T21:06:40.565 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:40.565 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:40.565 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:40.566 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.566 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.566 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 3 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:06:40.566 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:06:40.566 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 94.830256246000005, 2024-04-18T21:06:40.566 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0087842319999999995, 2024-04-18T21:06:40.566 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:40.566 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:40.566 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "reached pg", 2024-04-18T21:06:40.566 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:40.566 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.566 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:40.566 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:06:40.566 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:40.567 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.567 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.567 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:40.567 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:06:40.567 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:40.567 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.567 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.567 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:40.567 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647627+0000", 2024-04-18T21:06:40.567 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.8299999999999996e-07 2024-04-18T21:06:40.567 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.567 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.567 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:40.567 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647642+0000", 2024-04-18T21:06:40.568 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4724e-05 2024-04-18T21:06:40.568 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.568 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.568 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:40.568 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647679+0000", 2024-04-18T21:06:40.568 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.6662999999999998e-05 2024-04-18T21:06:40.568 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.568 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.568 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:40.568 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647735+0000", 2024-04-18T21:06:40.568 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.6196000000000002e-05 2024-04-18T21:06:40.568 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.568 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.569 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:40.569 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.649865+0000", 2024-04-18T21:06:40.569 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0021299489999999999 2024-04-18T21:06:40.569 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.569 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.569 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:40.569 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656411+0000", 2024-04-18T21:06:40.569 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0065460170000000003 2024-04-18T21:06:40.569 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:40.569 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:40.569 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:40.569 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.569 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.569 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:40.570 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:06:40.570 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 94.830111049999999, 2024-04-18T21:06:40.570 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0095703190000000007, 2024-04-18T21:06:40.570 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:40.570 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:40.570 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:40.570 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:40.570 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.570 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:40.570 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:06:40.570 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:40.570 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.570 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.571 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:40.571 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:06:40.571 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:40.571 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.571 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.571 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:40.571 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647773+0000", 2024-04-18T21:06:40.571 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.046e-06 2024-04-18T21:06:40.571 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.571 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.571 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:40.571 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647795+0000", 2024-04-18T21:06:40.571 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2616000000000002e-05 2024-04-18T21:06:40.572 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.572 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.572 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:40.572 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647818+0000", 2024-04-18T21:06:40.572 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3110000000000001e-05 2024-04-18T21:06:40.572 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.572 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.572 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:40.572 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647834+0000", 2024-04-18T21:06:40.572 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5163e-05 2024-04-18T21:06:40.572 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.572 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.572 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:40.573 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650682+0000", 2024-04-18T21:06:40.573 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0028479759999999999 2024-04-18T21:06:40.573 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.573 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.573 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:40.573 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650730+0000", 2024-04-18T21:06:40.573 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.8375999999999999e-05 2024-04-18T21:06:40.573 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.573 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.573 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:40.573 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656751+0000", 2024-04-18T21:06:40.573 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0060211880000000002 2024-04-18T21:06:40.573 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.574 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.574 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:40.574 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657342+0000", 2024-04-18T21:06:40.574 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00059084399999999998 2024-04-18T21:06:40.574 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:40.574 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:40.574 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:40.574 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.574 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.574 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:40.574 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:06:40.574 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 94.829698764, 2024-04-18T21:06:40.574 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0092471759999999993, 2024-04-18T21:06:40.575 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:40.575 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:40.575 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:40.575 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:40.575 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.575 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:40.575 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:06:40.575 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:40.575 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.575 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.575 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:40.575 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648184+0000", 2024-04-18T21:06:40.575 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:40.575 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.575 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.576 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:40.576 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648185+0000", 2024-04-18T21:06:40.576 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.5000000000000001e-07 2024-04-18T21:06:40.576 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.576 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.576 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:40.576 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648203+0000", 2024-04-18T21:06:40.576 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.8102999999999999e-05 2024-04-18T21:06:40.576 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.576 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.576 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:40.576 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648226+0000", 2024-04-18T21:06:40.576 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2921999999999998e-05 2024-04-18T21:06:40.576 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.576 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.577 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:40.577 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648241+0000", 2024-04-18T21:06:40.577 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5336999999999999e-05 2024-04-18T21:06:40.577 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.577 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.577 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:40.577 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.651268+0000", 2024-04-18T21:06:40.577 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0030271640000000002 2024-04-18T21:06:40.577 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.577 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.577 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:40.577 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.651319+0000", 2024-04-18T21:06:40.577 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.0843000000000001e-05 2024-04-18T21:06:40.577 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.578 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.578 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:40.578 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657347+0000", 2024-04-18T21:06:40.578 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0060279770000000003 2024-04-18T21:06:40.578 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.578 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.578 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:40.578 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657431+0000", 2024-04-18T21:06:40.578 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.3980000000000006e-05 2024-04-18T21:06:40.578 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:40.578 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:40.578 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:40.578 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.578 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.579 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4534.0:844 4.e e49/16 4:702433c9:::100000005ce.00000000:head v 49'10, mlcod=49'8)", 2024-04-18T21:06:40.579 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:06:40.253055+0000", 2024-04-18T21:06:40.579 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 0.224827265, 2024-04-18T21:06:40.579 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0086638210000000004, 2024-04-18T21:06:40.579 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:40.579 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:40.579 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:40.579 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:40.579 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.579 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:40.579 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:40.253055+0000", 2024-04-18T21:06:40.579 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:40.579 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.579 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.580 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:40.580 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:40.253055+0000", 2024-04-18T21:06:40.580 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:40.580 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.580 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.580 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:40.580 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:40.253057+0000", 2024-04-18T21:06:40.580 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5099999999999999e-06 2024-04-18T21:06:40.580 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.580 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.580 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:40.580 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:40.253105+0000", 2024-04-18T21:06:40.580 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.8433000000000002e-05 2024-04-18T21:06:40.580 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.581 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.581 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:40.581 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:40.253126+0000", 2024-04-18T21:06:40.581 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.0582999999999999e-05 2024-04-18T21:06:40.581 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.581 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.581 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:40.581 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:40.253142+0000", 2024-04-18T21:06:40.581 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6079999999999999e-05 2024-04-18T21:06:40.581 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.581 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.581 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:40.582 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:40.253236+0000", 2024-04-18T21:06:40.582 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.4306000000000001e-05 2024-04-18T21:06:40.582 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.582 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.582 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:40.582 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:40.253305+0000", 2024-04-18T21:06:40.582 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.8825999999999995e-05 2024-04-18T21:06:40.583 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.583 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.583 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:40.583 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:40.261658+0000", 2024-04-18T21:06:40.583 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0083531040000000001 2024-04-18T21:06:40.583 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:40.583 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:40.583 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:40.583 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:40.261719+0000", 2024-04-18T21:06:40.583 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.0979e-05 2024-04-18T21:06:40.583 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:40.583 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:40.583 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:40.584 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:40.584 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:40.584 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:06:40.585 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:40.586 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:40.587+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:40.620 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:06:40.622 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-04-18T21:06:40.636 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":101,"stamp":"2024-04-18T21:06:40.527368+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597719,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":256,"num_write_kb":3483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":95956,"kb_used_data":2408,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":283019564,"statfs":{"total":289910292480,"available":289812033536,"internally_reserved":0,"allocated":2465792,"data_stored":1740610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.843889"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:35.610120+0000","last_change":"2024-04-18T21:05:05.652795+0000","last_active":"2024-04-18T21:06:35.610120+0000","last_peered":"2024-04-18T21:06:35.610120+0000","last_clean":"2024-04-18T21:06:35.610120+0000","last_became_active":"2024-04-18T21:05:05.650121+0000","last_became_peered":"2024-04-18T21:05:05.650121+0000","last_unstale":"2024-04-18T21:06:35.610120+0000","last_undegraded":"2024-04-18T21:06:35.610120+0000","last_fullsized":"2024-04-18T21:06:35.610120+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:35.609952+0000","last_change":"2024-04-18T21:05:05.657531+0000","last_active":"2024-04-18T21:06:35.609952+0000","last_peered":"2024-04-18T21:06:35.609952+0000","last_clean":"2024-04-18T21:06:35.609952+0000","last_became_active":"2024-04-18T21:05:05.653101+0000","last_became_peered":"2024-04-18T21:05:05.653101+0000","last_unstale":"2024-04-18T21:06:35.609952+0000","last_undegraded":"2024-04-18T21:06:35.609952+0000","last_fullsized":"2024-04-18T21:06:35.609952+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:32:23.929877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.693657+0000","last_change":"2024-04-18T21:05:05.647965+0000","last_active":"2024-04-18T21:06:34.693657+0000","last_peered":"2024-04-18T21:06:34.693657+0000","last_clean":"2024-04-18T21:06:34.693657+0000","last_became_active":"2024-04-18T21:05:05.645931+0000","last_became_peered":"2024-04-18T21:05:05.645931+0000","last_unstale":"2024-04-18T21:06:34.693657+0000","last_undegraded":"2024-04-18T21:06:34.693657+0000","last_fullsized":"2024-04-18T21:06:34.693657+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:04.350492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.693445+0000","last_change":"2024-04-18T21:05:05.629321+0000","last_active":"2024-04-18T21:06:34.693445+0000","last_peered":"2024-04-18T21:06:34.693445+0000","last_clean":"2024-04-18T21:06:34.693445+0000","last_became_active":"2024-04-18T21:05:05.627956+0000","last_became_peered":"2024-04-18T21:05:05.627956+0000","last_unstale":"2024-04-18T21:06:34.693445+0000","last_undegraded":"2024-04-18T21:06:34.693445+0000","last_fullsized":"2024-04-18T21:06:34.693445+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:15:28.458476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:35.609615+0000","last_change":"2024-04-18T21:05:05.648710+0000","last_active":"2024-04-18T21:06:35.609615+0000","last_peered":"2024-04-18T21:06:35.609615+0000","last_clean":"2024-04-18T21:06:35.609615+0000","last_became_active":"2024-04-18T21:05:05.647801+0000","last_became_peered":"2024-04-18T21:05:05.647801+0000","last_unstale":"2024-04-18T21:06:35.609615+0000","last_undegraded":"2024-04-18T21:06:35.609615+0000","last_fullsized":"2024-04-18T21:06:35.609615+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:46:36.339289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.692202+0000","last_change":"2024-04-18T21:05:05.629095+0000","last_active":"2024-04-18T21:06:34.692202+0000","last_peered":"2024-04-18T21:06:34.692202+0000","last_clean":"2024-04-18T21:06:34.692202+0000","last_became_active":"2024-04-18T21:05:05.627664+0000","last_became_peered":"2024-04-18T21:05:05.627664+0000","last_unstale":"2024-04-18T21:06:34.692202+0000","last_undegraded":"2024-04-18T21:06:34.692202+0000","last_fullsized":"2024-04-18T21:06:34.692202+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:51:28.440070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.692286+0000","last_change":"2024-04-18T21:05:05.625047+0000","last_active":"2024-04-18T21:06:34.692286+0000","last_peered":"2024-04-18T21:06:34.692286+0000","last_clean":"2024-04-18T21:06:34.692286+0000","last_became_active":"2024-04-18T21:05:05.622781+0000","last_became_peered":"2024-04-18T21:05:05.622781+0000","last_unstale":"2024-04-18T21:06:34.692286+0000","last_undegraded":"2024-04-18T21:06:34.692286+0000","last_fullsized":"2024-04-18T21:06:34.692286+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:12.944469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.691764+0000","last_change":"2024-04-18T21:05:05.640390+0000","last_active":"2024-04-18T21:06:34.691764+0000","last_peered":"2024-04-18T21:06:34.691764+0000","last_clean":"2024-04-18T21:06:34.691764+0000","last_became_active":"2024-04-18T21:05:05.638295+0000","last_became_peered":"2024-04-18T21:05:05.638295+0000","last_unstale":"2024-04-18T21:06:34.691764+0000","last_undegraded":"2024-04-18T21:06:34.691764+0000","last_fullsized":"2024-04-18T21:06:34.691764+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:34:31.132458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":71,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.693559+0000","last_change":"2024-04-18T21:05:05.660752+0000","last_active":"2024-04-18T21:06:34.693559+0000","last_peered":"2024-04-18T21:06:34.693559+0000","last_clean":"2024-04-18T21:06:34.693559+0000","last_became_active":"2024-04-18T21:05:05.659226+0000","last_became_peered":"2024-04-18T21:05:05.659226+0000","last_unstale":"2024-04-18T21:06:34.693559+0000","last_undegraded":"2024-04-18T21:06:34.693559+0000","last_fullsized":"2024-04-18T21:06:34.693559+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:20:45.938503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:35.609936+0000","last_change":"2024-04-18T21:05:05.656660+0000","last_active":"2024-04-18T21:06:35.609936+0000","last_peered":"2024-04-18T21:06:35.609936+0000","last_clean":"2024-04-18T21:06:35.609936+0000","last_became_active":"2024-04-18T21:05:05.653829+0000","last_became_peered":"2024-04-18T21:05:05.653829+0000","last_unstale":"2024-04-18T21:06:35.609936+0000","last_undegraded":"2024-04-18T21:06:35.609936+0000","last_fullsized":"2024-04-18T21:06:35.609936+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:50:40.920146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.693794+0000","last_change":"2024-04-18T21:05:05.646721+0000","last_active":"2024-04-18T21:06:34.693794+0000","last_peered":"2024-04-18T21:06:34.693794+0000","last_clean":"2024-04-18T21:06:34.693794+0000","last_became_active":"2024-04-18T21:05:05.643421+0000","last_became_peered":"2024-04-18T21:05:05.643421+0000","last_unstale":"2024-04-18T21:06:34.693794+0000","last_undegraded":"2024-04-18T21:06:34.693794+0000","last_fullsized":"2024-04-18T21:06:34.693794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:14:51.873741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:35.609629+0000","last_change":"2024-04-18T21:05:05.656320+0000","last_active":"2024-04-18T21:06:35.609629+0000","last_peered":"2024-04-18T21:06:35.609629+0000","last_clean":"2024-04-18T21:06:35.609629+0000","last_became_active":"2024-04-18T21:05:05.655508+0000","last_became_peered":"2024-04-18T21:05:05.655508+0000","last_unstale":"2024-04-18T21:06:35.609629+0000","last_undegraded":"2024-04-18T21:06:35.609629+0000","last_fullsized":"2024-04-18T21:06:35.609629+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:51.225379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:35.609462+0000","last_change":"2024-04-18T21:05:05.649001+0000","last_active":"2024-04-18T21:06:35.609462+0000","last_peered":"2024-04-18T21:06:35.609462+0000","last_clean":"2024-04-18T21:06:35.609462+0000","last_became_active":"2024-04-18T21:05:05.648070+0000","last_became_peered":"2024-04-18T21:05:05.648070+0000","last_unstale":"2024-04-18T21:06:35.609462+0000","last_undegraded":"2024-04-18T21:06:35.609462+0000","last_fullsized":"2024-04-18T21:06:35.609462+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:56.408234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.692324+0000","last_change":"2024-04-18T21:05:05.635880+0000","last_active":"2024-04-18T21:06:34.692324+0000","last_peered":"2024-04-18T21:06:34.692324+0000","last_clean":"2024-04-18T21:06:34.692324+0000","last_became_active":"2024-04-18T21:05:05.635089+0000","last_became_peered":"2024-04-18T21:05:05.635089+0000","last_unstale":"2024-04-18T21:06:34.692324+0000","last_undegraded":"2024-04-18T21:06:34.692324+0000","last_fullsized":"2024-04-18T21:06:34.692324+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:50:40.920146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.692326+0000","last_change":"2024-04-18T21:05:05.639640+0000","last_active":"2024-04-18T21:06:34.692326+0000","last_peered":"2024-04-18T21:06:34.692326+0000","last_clean":"2024-04-18T21:06:34.692326+0000","last_became_active":"2024-04-18T21:05:05.637311+0000","last_became_peered":"2024-04-18T21:05:05.637311+0000","last_unstale":"2024-04-18T21:06:34.692326+0000","last_undegraded":"2024-04-18T21:06:34.692326+0000","last_fullsized":"2024-04-18T21:06:34.692326+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:20:45.938503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.691926+0000","last_change":"2024-04-18T21:05:05.638203+0000","last_active":"2024-04-18T21:06:34.691926+0000","last_peered":"2024-04-18T21:06:34.691926+0000","last_clean":"2024-04-18T21:06:34.691926+0000","last_became_active":"2024-04-18T21:05:05.637352+0000","last_became_peered":"2024-04-18T21:05:05.637352+0000","last_unstale":"2024-04-18T21:06:34.691926+0000","last_undegraded":"2024-04-18T21:06:34.691926+0000","last_fullsized":"2024-04-18T21:06:34.691926+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":41,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:35.609998+0000","last_change":"2024-04-18T21:06:01.036290+0000","last_active":"2024-04-18T21:06:35.609998+0000","last_peered":"2024-04-18T21:06:35.609998+0000","last_clean":"2024-04-18T21:06:35.609998+0000","last_became_active":"2024-04-18T21:06:01.035478+0000","last_became_peered":"2024-04-18T21:06:01.035478+0000","last_unstale":"2024-04-18T21:06:35.609998+0000","last_undegraded":"2024-04-18T21:06:35.609998+0000","last_fullsized":"2024-04-18T21:06:35.609998+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:14:08.347445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:35.610108+0000","last_change":"2024-04-18T21:05:05.655261+0000","last_active":"2024-04-18T21:06:35.610108+0000","last_peered":"2024-04-18T21:06:35.610108+0000","last_clean":"2024-04-18T21:06:35.610108+0000","last_became_active":"2024-04-18T21:05:05.651388+0000","last_became_peered":"2024-04-18T21:05:05.651388+0000","last_unstale":"2024-04-18T21:06:35.610108+0000","last_undegraded":"2024-04-18T21:06:35.610108+0000","last_fullsized":"2024-04-18T21:06:35.610108+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:53.850184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":71,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.693112+0000","last_change":"2024-04-18T21:05:05.652710+0000","last_active":"2024-04-18T21:06:34.693112+0000","last_peered":"2024-04-18T21:06:34.693112+0000","last_clean":"2024-04-18T21:06:34.693112+0000","last_became_active":"2024-04-18T21:05:05.651929+0000","last_became_peered":"2024-04-18T21:05:05.651929+0000","last_unstale":"2024-04-18T21:06:34.693112+0000","last_undegraded":"2024-04-18T21:06:34.693112+0000","last_fullsized":"2024-04-18T21:06:34.693112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:12.944469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.693606+0000","last_change":"2024-04-18T21:05:05.638338+0000","last_active":"2024-04-18T21:06:34.693606+0000","last_peered":"2024-04-18T21:06:34.693606+0000","last_clean":"2024-04-18T21:06:34.693606+0000","last_became_active":"2024-04-18T21:05:05.637567+0000","last_became_peered":"2024-04-18T21:05:05.637567+0000","last_unstale":"2024-04-18T21:06:34.693606+0000","last_undegraded":"2024-04-18T21:06:34.693606+0000","last_fullsized":"2024-04-18T21:06:34.693606+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.692666+0000","last_change":"2024-04-18T21:05:05.643606+0000","last_active":"2024-04-18T21:06:34.692666+0000","last_peered":"2024-04-18T21:06:34.692666+0000","last_clean":"2024-04-18T21:06:34.692666+0000","last_became_active":"2024-04-18T21:05:05.642991+0000","last_became_peered":"2024-04-18T21:05:05.642991+0000","last_unstale":"2024-04-18T21:06:34.692666+0000","last_undegraded":"2024-04-18T21:06:34.692666+0000","last_fullsized":"2024-04-18T21:06:34.692666+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:01.841786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:35.609134+0000","last_change":"2024-04-18T21:05:05.650896+0000","last_active":"2024-04-18T21:06:35.609134+0000","last_peered":"2024-04-18T21:06:35.609134+0000","last_clean":"2024-04-18T21:06:35.609134+0000","last_became_active":"2024-04-18T21:05:05.650083+0000","last_became_peered":"2024-04-18T21:05:05.650083+0000","last_unstale":"2024-04-18T21:06:35.609134+0000","last_undegraded":"2024-04-18T21:06:35.609134+0000","last_fullsized":"2024-04-18T21:06:35.609134+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:43:55.788425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":41,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.691835+0000","last_change":"2024-04-18T21:06:01.034390+0000","last_active":"2024-04-18T21:06:34.691835+0000","last_peered":"2024-04-18T21:06:34.691835+0000","last_clean":"2024-04-18T21:06:34.691835+0000","last_became_active":"2024-04-18T21:06:01.033524+0000","last_became_peered":"2024-04-18T21:06:01.033524+0000","last_unstale":"2024-04-18T21:06:34.691835+0000","last_undegraded":"2024-04-18T21:06:34.691835+0000","last_fullsized":"2024-04-18T21:06:34.691835+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:28:17.539732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:35.608750+0000","last_change":"2024-04-18T21:05:05.642755+0000","last_active":"2024-04-18T21:06:35.608750+0000","last_peered":"2024-04-18T21:06:35.608750+0000","last_clean":"2024-04-18T21:06:35.608750+0000","last_became_active":"2024-04-18T21:05:05.642150+0000","last_became_peered":"2024-04-18T21:05:05.642150+0000","last_unstale":"2024-04-18T21:06:35.608750+0000","last_undegraded":"2024-04-18T21:06:35.608750+0000","last_fullsized":"2024-04-18T21:06:35.608750+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:29:22.647425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:35.610166+0000","last_change":"2024-04-18T21:05:05.653741+0000","last_active":"2024-04-18T21:06:35.610166+0000","last_peered":"2024-04-18T21:06:35.610166+0000","last_clean":"2024-04-18T21:06:35.610166+0000","last_became_active":"2024-04-18T21:05:05.650174+0000","last_became_peered":"2024-04-18T21:05:05.650174+0000","last_unstale":"2024-04-18T21:06:35.610166+0000","last_undegraded":"2024-04-18T21:06:35.610166+0000","last_fullsized":"2024-04-18T21:06:35.610166+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:04.350492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":71,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.693663+0000","last_change":"2024-04-18T21:05:05.649581+0000","last_active":"2024-04-18T21:06:34.693663+0000","last_peered":"2024-04-18T21:06:34.693663+0000","last_clean":"2024-04-18T21:06:34.693663+0000","last_became_active":"2024-04-18T21:05:05.648233+0000","last_became_peered":"2024-04-18T21:05:05.648233+0000","last_unstale":"2024-04-18T21:06:34.693663+0000","last_undegraded":"2024-04-18T21:06:34.693663+0000","last_fullsized":"2024-04-18T21:06:34.693663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.694078+0000","last_change":"2024-04-18T21:05:05.646926+0000","last_active":"2024-04-18T21:06:34.694078+0000","last_peered":"2024-04-18T21:06:34.694078+0000","last_clean":"2024-04-18T21:06:34.694078+0000","last_became_active":"2024-04-18T21:05:05.644942+0000","last_became_peered":"2024-04-18T21:05:05.644942+0000","last_unstale":"2024-04-18T21:06:34.694078+0000","last_undegraded":"2024-04-18T21:06:34.694078+0000","last_fullsized":"2024-04-18T21:06:34.694078+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:53.850184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:35.610434+0000","last_change":"2024-04-18T21:05:05.656314+0000","last_active":"2024-04-18T21:06:35.610434+0000","last_peered":"2024-04-18T21:06:35.610434+0000","last_clean":"2024-04-18T21:06:35.610434+0000","last_became_active":"2024-04-18T21:05:05.655364+0000","last_became_peered":"2024-04-18T21:05:05.655364+0000","last_unstale":"2024-04-18T21:06:35.610434+0000","last_undegraded":"2024-04-18T21:06:35.610434+0000","last_fullsized":"2024-04-18T21:06:35.610434+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:27:17.530889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":41,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:35.609413+0000","last_change":"2024-04-18T21:06:01.033572+0000","last_active":"2024-04-18T21:06:35.609413+0000","last_peered":"2024-04-18T21:06:35.609413+0000","last_clean":"2024-04-18T21:06:35.609413+0000","last_became_active":"2024-04-18T21:06:01.032811+0000","last_became_peered":"2024-04-18T21:06:01.032811+0000","last_unstale":"2024-04-18T21:06:35.609413+0000","last_undegraded":"2024-04-18T21:06:35.609413+0000","last_fullsized":"2024-04-18T21:06:35.609413+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:38:45.452379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:35.609416+0000","last_change":"2024-04-18T21:05:05.648084+0000","last_active":"2024-04-18T21:06:35.609416+0000","last_peered":"2024-04-18T21:06:35.609416+0000","last_clean":"2024-04-18T21:06:35.609416+0000","last_became_active":"2024-04-18T21:05:05.645340+0000","last_became_peered":"2024-04-18T21:05:05.645340+0000","last_unstale":"2024-04-18T21:06:35.609416+0000","last_undegraded":"2024-04-18T21:06:35.609416+0000","last_fullsized":"2024-04-18T21:06:35.609416+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:34:31.132458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":41,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:35.608828+0000","last_change":"2024-04-18T21:06:01.034356+0000","last_active":"2024-04-18T21:06:35.608828+0000","last_peered":"2024-04-18T21:06:35.608828+0000","last_clean":"2024-04-18T21:06:35.608828+0000","last_became_active":"2024-04-18T21:06:01.033850+0000","last_became_peered":"2024-04-18T21:06:01.033850+0000","last_unstale":"2024-04-18T21:06:35.608828+0000","last_undegraded":"2024-04-18T21:06:35.608828+0000","last_fullsized":"2024-04-18T21:06:35.608828+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:28:32.020153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.692419+0000","last_change":"2024-04-18T21:05:05.626677+0000","last_active":"2024-04-18T21:06:34.692419+0000","last_peered":"2024-04-18T21:06:34.692419+0000","last_clean":"2024-04-18T21:06:34.692419+0000","last_became_active":"2024-04-18T21:05:05.624250+0000","last_became_peered":"2024-04-18T21:05:05.624250+0000","last_unstale":"2024-04-18T21:06:34.692419+0000","last_undegraded":"2024-04-18T21:06:34.692419+0000","last_fullsized":"2024-04-18T21:06:34.692419+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:50:51.225379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:35.609800+0000","last_change":"2024-04-18T21:05:05.649918+0000","last_active":"2024-04-18T21:06:35.609800+0000","last_peered":"2024-04-18T21:06:35.609800+0000","last_clean":"2024-04-18T21:06:35.609800+0000","last_became_active":"2024-04-18T21:05:05.647147+0000","last_became_peered":"2024-04-18T21:05:05.647147+0000","last_unstale":"2024-04-18T21:06:35.609800+0000","last_undegraded":"2024-04-18T21:06:35.609800+0000","last_fullsized":"2024-04-18T21:06:35.609800+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:51:28.440070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":76,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.693115+0000","last_change":"2024-04-18T21:05:04.632748+0000","last_active":"2024-04-18T21:06:34.693115+0000","last_peered":"2024-04-18T21:06:34.693115+0000","last_clean":"2024-04-18T21:06:34.693115+0000","last_became_active":"2024-04-18T21:05:04.628407+0000","last_became_peered":"2024-04-18T21:05:04.628407+0000","last_unstale":"2024-04-18T21:06:34.693115+0000","last_undegraded":"2024-04-18T21:06:34.693115+0000","last_fullsized":"2024-04-18T21:06:34.693115+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:42:45.392908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:35.610033+0000","last_change":"2024-04-18T21:05:05.649199+0000","last_active":"2024-04-18T21:06:35.610033+0000","last_peered":"2024-04-18T21:06:35.610033+0000","last_clean":"2024-04-18T21:06:35.610033+0000","last_became_active":"2024-04-18T21:05:05.646898+0000","last_became_peered":"2024-04-18T21:05:05.646898+0000","last_unstale":"2024-04-18T21:06:35.610033+0000","last_undegraded":"2024-04-18T21:06:35.610033+0000","last_fullsized":"2024-04-18T21:06:35.610033+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:31:31.842528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":73,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.692300+0000","last_change":"2024-04-18T21:05:04.638017+0000","last_active":"2024-04-18T21:06:34.692300+0000","last_peered":"2024-04-18T21:06:34.692300+0000","last_clean":"2024-04-18T21:06:34.692300+0000","last_became_active":"2024-04-18T21:05:04.637287+0000","last_became_peered":"2024-04-18T21:05:04.637287+0000","last_unstale":"2024-04-18T21:06:34.692300+0000","last_undegraded":"2024-04-18T21:06:34.692300+0000","last_fullsized":"2024-04-18T21:06:34.692300+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:25.891472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":41,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.693843+0000","last_change":"2024-04-18T21:06:01.034755+0000","last_active":"2024-04-18T21:06:34.693843+0000","last_peered":"2024-04-18T21:06:34.693843+0000","last_clean":"2024-04-18T21:06:34.693843+0000","last_became_active":"2024-04-18T21:06:01.033889+0000","last_became_peered":"2024-04-18T21:06:01.033889+0000","last_unstale":"2024-04-18T21:06:34.693843+0000","last_undegraded":"2024-04-18T21:06:34.693843+0000","last_fullsized":"2024-04-18T21:06:34.693843+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:09:08.394894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":74,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:35.609112+0000","last_change":"2024-04-18T21:05:04.628489+0000","last_active":"2024-04-18T21:06:35.609112+0000","last_peered":"2024-04-18T21:06:35.609112+0000","last_clean":"2024-04-18T21:06:35.609112+0000","last_became_active":"2024-04-18T21:05:04.627279+0000","last_became_peered":"2024-04-18T21:05:04.627279+0000","last_unstale":"2024-04-18T21:06:35.609112+0000","last_undegraded":"2024-04-18T21:06:35.609112+0000","last_fullsized":"2024-04-18T21:06:35.609112+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:43:23.420744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":71,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.693564+0000","last_change":"2024-04-18T21:05:05.649347+0000","last_active":"2024-04-18T21:06:34.693564+0000","last_peered":"2024-04-18T21:06:34.693564+0000","last_clean":"2024-04-18T21:06:34.693564+0000","last_became_active":"2024-04-18T21:05:05.648144+0000","last_became_peered":"2024-04-18T21:05:05.648144+0000","last_unstale":"2024-04-18T21:06:34.693564+0000","last_undegraded":"2024-04-18T21:06:34.693564+0000","last_fullsized":"2024-04-18T21:06:34.693564+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:51:28.440070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":82,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.692345+0000","last_change":"2024-04-18T21:05:04.624089+0000","last_active":"2024-04-18T21:06:34.692345+0000","last_peered":"2024-04-18T21:06:34.692345+0000","last_clean":"2024-04-18T21:06:34.692345+0000","last_became_active":"2024-04-18T21:05:04.623238+0000","last_became_peered":"2024-04-18T21:05:04.623238+0000","last_unstale":"2024-04-18T21:06:34.692345+0000","last_undegraded":"2024-04-18T21:06:34.692345+0000","last_fullsized":"2024-04-18T21:06:34.692345+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:44:19.076499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":75,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.694670+0000","last_change":"2024-04-18T21:05:04.633907+0000","last_active":"2024-04-18T21:06:34.694670+0000","last_peered":"2024-04-18T21:06:34.694670+0000","last_clean":"2024-04-18T21:06:34.694670+0000","last_became_active":"2024-04-18T21:05:04.630308+0000","last_became_peered":"2024-04-18T21:05:04.630308+0000","last_unstale":"2024-04-18T21:06:34.694670+0000","last_undegraded":"2024-04-18T21:06:34.694670+0000","last_fullsized":"2024-04-18T21:06:34.694670+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:55:46.219812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:35.608899+0000","last_change":"2024-04-18T21:05:05.658572+0000","last_active":"2024-04-18T21:06:35.608899+0000","last_peered":"2024-04-18T21:06:35.608899+0000","last_clean":"2024-04-18T21:06:35.608899+0000","last_became_active":"2024-04-18T21:05:05.657842+0000","last_became_peered":"2024-04-18T21:05:05.657842+0000","last_unstale":"2024-04-18T21:06:35.608899+0000","last_undegraded":"2024-04-18T21:06:35.608899+0000","last_fullsized":"2024-04-18T21:06:35.608899+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:26:38.636530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":76,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:35.610373+0000","last_change":"2024-04-18T21:05:04.628541+0000","last_active":"2024-04-18T21:06:35.610373+0000","last_peered":"2024-04-18T21:06:35.610373+0000","last_clean":"2024-04-18T21:06:35.610373+0000","last_became_active":"2024-04-18T21:05:04.627407+0000","last_became_peered":"2024-04-18T21:05:04.627407+0000","last_unstale":"2024-04-18T21:06:35.610373+0000","last_undegraded":"2024-04-18T21:06:35.610373+0000","last_fullsized":"2024-04-18T21:06:35.610373+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:55:48.643174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:35.608975+0000","last_change":"2024-04-18T21:05:05.651649+0000","last_active":"2024-04-18T21:06:35.608975+0000","last_peered":"2024-04-18T21:06:35.608975+0000","last_clean":"2024-04-18T21:06:35.608975+0000","last_became_active":"2024-04-18T21:05:05.646809+0000","last_became_peered":"2024-04-18T21:05:05.646809+0000","last_unstale":"2024-04-18T21:06:35.608975+0000","last_undegraded":"2024-04-18T21:06:35.608975+0000","last_fullsized":"2024-04-18T21:06:35.608975+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:23.698827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":75,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.694701+0000","last_change":"2024-04-18T21:05:04.634055+0000","last_active":"2024-04-18T21:06:34.694701+0000","last_peered":"2024-04-18T21:06:34.694701+0000","last_clean":"2024-04-18T21:06:34.694701+0000","last_became_active":"2024-04-18T21:05:04.630736+0000","last_became_peered":"2024-04-18T21:05:04.630736+0000","last_unstale":"2024-04-18T21:06:34.694701+0000","last_undegraded":"2024-04-18T21:06:34.694701+0000","last_fullsized":"2024-04-18T21:06:34.694701+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:06:44.001512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.692690+0000","last_change":"2024-04-18T21:05:05.628869+0000","last_active":"2024-04-18T21:06:34.692690+0000","last_peered":"2024-04-18T21:06:34.692690+0000","last_clean":"2024-04-18T21:06:34.692690+0000","last_became_active":"2024-04-18T21:05:05.627071+0000","last_became_peered":"2024-04-18T21:05:05.627071+0000","last_unstale":"2024-04-18T21:06:34.692690+0000","last_undegraded":"2024-04-18T21:06:34.692690+0000","last_fullsized":"2024-04-18T21:06:34.692690+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:31:31.842528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":74,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.694190+0000","last_change":"2024-04-18T21:05:04.625520+0000","last_active":"2024-04-18T21:06:34.694190+0000","last_peered":"2024-04-18T21:06:34.694190+0000","last_clean":"2024-04-18T21:06:34.694190+0000","last_became_active":"2024-04-18T21:05:04.624656+0000","last_became_peered":"2024-04-18T21:05:04.624656+0000","last_unstale":"2024-04-18T21:06:34.694190+0000","last_undegraded":"2024-04-18T21:06:34.694190+0000","last_fullsized":"2024-04-18T21:06:34.694190+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:56:05.795125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":71,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.692366+0000","last_change":"2024-04-18T21:05:05.649406+0000","last_active":"2024-04-18T21:06:34.692366+0000","last_peered":"2024-04-18T21:06:34.692366+0000","last_clean":"2024-04-18T21:06:34.692366+0000","last_became_active":"2024-04-18T21:05:05.648380+0000","last_became_peered":"2024-04-18T21:05:05.648380+0000","last_unstale":"2024-04-18T21:06:34.692366+0000","last_undegraded":"2024-04-18T21:06:34.692366+0000","last_fullsized":"2024-04-18T21:06:34.692366+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":75,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.692942+0000","last_change":"2024-04-18T21:05:04.640216+0000","last_active":"2024-04-18T21:06:34.692942+0000","last_peered":"2024-04-18T21:06:34.692942+0000","last_clean":"2024-04-18T21:06:34.692942+0000","last_became_active":"2024-04-18T21:05:04.639349+0000","last_became_peered":"2024-04-18T21:05:04.639349+0000","last_unstale":"2024-04-18T21:06:34.692942+0000","last_undegraded":"2024-04-18T21:06:34.692942+0000","last_fullsized":"2024-04-18T21:06:34.692942+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:09:18.466987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.693661+0000","last_change":"2024-04-18T21:05:05.628850+0000","last_active":"2024-04-18T21:06:34.693661+0000","last_peered":"2024-04-18T21:06:34.693661+0000","last_clean":"2024-04-18T21:06:34.693661+0000","last_became_active":"2024-04-18T21:05:05.627521+0000","last_became_peered":"2024-04-18T21:05:05.627521+0000","last_unstale":"2024-04-18T21:06:34.693661+0000","last_undegraded":"2024-04-18T21:06:34.693661+0000","last_fullsized":"2024-04-18T21:06:34.693661+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:14:37.912032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":74,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.692921+0000","last_change":"2024-04-18T21:05:04.634674+0000","last_active":"2024-04-18T21:06:34.692921+0000","last_peered":"2024-04-18T21:06:34.692921+0000","last_clean":"2024-04-18T21:06:34.692921+0000","last_became_active":"2024-04-18T21:05:04.632284+0000","last_became_peered":"2024-04-18T21:05:04.632284+0000","last_unstale":"2024-04-18T21:06:34.692921+0000","last_undegraded":"2024-04-18T21:06:34.692921+0000","last_fullsized":"2024-04-18T21:06:34.692921+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:09:18.466987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.694434+0000","last_change":"2024-04-18T21:05:05.647377+0000","last_active":"2024-04-18T21:06:34.694434+0000","last_peered":"2024-04-18T21:06:34.694434+0000","last_clean":"2024-04-18T21:06:34.694434+0000","last_became_active":"2024-04-18T21:05:05.645067+0000","last_became_peered":"2024-04-18T21:05:05.645067+0000","last_unstale":"2024-04-18T21:06:34.694434+0000","last_undegraded":"2024-04-18T21:06:34.694434+0000","last_fullsized":"2024-04-18T21:06:34.694434+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:29:30.243751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":74,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:35.609115+0000","last_change":"2024-04-18T21:05:04.627578+0000","last_active":"2024-04-18T21:06:35.609115+0000","last_peered":"2024-04-18T21:06:35.609115+0000","last_clean":"2024-04-18T21:06:35.609115+0000","last_became_active":"2024-04-18T21:05:04.626786+0000","last_became_peered":"2024-04-18T21:05:04.626786+0000","last_unstale":"2024-04-18T21:06:35.609115+0000","last_undegraded":"2024-04-18T21:06:35.609115+0000","last_fullsized":"2024-04-18T21:06:35.609115+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:55:59.563512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.694412+0000","last_change":"2024-04-18T21:05:05.640817+0000","last_active":"2024-04-18T21:06:34.694412+0000","last_peered":"2024-04-18T21:06:34.694412+0000","last_clean":"2024-04-18T21:06:34.694412+0000","last_became_active":"2024-04-18T21:05:05.635526+0000","last_became_peered":"2024-04-18T21:05:05.635526+0000","last_unstale":"2024-04-18T21:06:34.694412+0000","last_undegraded":"2024-04-18T21:06:34.694412+0000","last_fullsized":"2024-04-18T21:06:34.694412+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:44:29.823511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":74,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:35.609039+0000","last_change":"2024-04-18T21:05:04.636499+0000","last_active":"2024-04-18T21:06:35.609039+0000","last_peered":"2024-04-18T21:06:35.609039+0000","last_clean":"2024-04-18T21:06:35.609039+0000","last_became_active":"2024-04-18T21:05:04.635830+0000","last_became_peered":"2024-04-18T21:05:04.635830+0000","last_unstale":"2024-04-18T21:06:35.609039+0000","last_undegraded":"2024-04-18T21:06:35.609039+0000","last_fullsized":"2024-04-18T21:06:35.609039+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:26:30.565175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":71,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.693849+0000","last_change":"2024-04-18T21:05:05.660974+0000","last_active":"2024-04-18T21:06:34.693849+0000","last_peered":"2024-04-18T21:06:34.693849+0000","last_clean":"2024-04-18T21:06:34.693849+0000","last_became_active":"2024-04-18T21:05:05.659287+0000","last_became_peered":"2024-04-18T21:05:05.659287+0000","last_unstale":"2024-04-18T21:06:34.693849+0000","last_undegraded":"2024-04-18T21:06:34.693849+0000","last_fullsized":"2024-04-18T21:06:34.693849+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:50:40.920146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":282,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.692964+0000","last_change":"2024-04-18T21:04:54.511605+0000","last_active":"2024-04-18T21:06:34.692964+0000","last_peered":"2024-04-18T21:06:34.692964+0000","last_clean":"2024-04-18T21:06:34.692964+0000","last_became_active":"2024-04-18T21:04:54.510791+0000","last_became_peered":"2024-04-18T21:04:54.510791+0000","last_unstale":"2024-04-18T21:06:34.692964+0000","last_undegraded":"2024-04-18T21:06:34.692964+0000","last_fullsized":"2024-04-18T21:06:34.692964+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_clean_scrub_stamp":"2024-04-18T21:04:53.494814+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:46.262250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":80,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.693340+0000","last_change":"2024-04-18T21:05:00.576671+0000","last_active":"2024-04-18T21:06:34.693340+0000","last_peered":"2024-04-18T21:06:34.693340+0000","last_clean":"2024-04-18T21:06:34.693340+0000","last_became_active":"2024-04-18T21:05:00.575933+0000","last_became_peered":"2024-04-18T21:05:00.575933+0000","last_unstale":"2024-04-18T21:06:34.693340+0000","last_undegraded":"2024-04-18T21:06:34.693340+0000","last_fullsized":"2024-04-18T21:06:34.693340+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:14:59.207959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":41,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:35.609066+0000","last_change":"2024-04-18T21:06:01.034577+0000","last_active":"2024-04-18T21:06:35.609066+0000","last_peered":"2024-04-18T21:06:35.609066+0000","last_clean":"2024-04-18T21:06:35.609066+0000","last_became_active":"2024-04-18T21:06:01.033899+0000","last_became_peered":"2024-04-18T21:06:01.033899+0000","last_unstale":"2024-04-18T21:06:35.609066+0000","last_undegraded":"2024-04-18T21:06:35.609066+0000","last_fullsized":"2024-04-18T21:06:35.609066+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:13:40.375625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.694450+0000","last_change":"2024-04-18T21:05:05.647623+0000","last_active":"2024-04-18T21:06:34.694450+0000","last_peered":"2024-04-18T21:06:34.694450+0000","last_clean":"2024-04-18T21:06:34.694450+0000","last_became_active":"2024-04-18T21:05:05.645640+0000","last_became_peered":"2024-04-18T21:05:05.645640+0000","last_unstale":"2024-04-18T21:06:34.694450+0000","last_undegraded":"2024-04-18T21:06:34.694450+0000","last_fullsized":"2024-04-18T21:06:34.694450+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:50:59.950421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":80,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.693040+0000","last_change":"2024-04-18T21:05:00.571960+0000","last_active":"2024-04-18T21:06:34.693040+0000","last_peered":"2024-04-18T21:06:34.693040+0000","last_clean":"2024-04-18T21:06:34.693040+0000","last_became_active":"2024-04-18T21:05:00.571301+0000","last_became_peered":"2024-04-18T21:05:00.571301+0000","last_unstale":"2024-04-18T21:06:34.693040+0000","last_undegraded":"2024-04-18T21:06:34.693040+0000","last_fullsized":"2024-04-18T21:06:34.693040+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:31:59.262440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":41,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.692021+0000","last_change":"2024-04-18T21:06:01.033769+0000","last_active":"2024-04-18T21:06:34.692021+0000","last_peered":"2024-04-18T21:06:34.692021+0000","last_clean":"2024-04-18T21:06:34.692021+0000","last_became_active":"2024-04-18T21:06:01.033157+0000","last_became_peered":"2024-04-18T21:06:01.033157+0000","last_unstale":"2024-04-18T21:06:34.692021+0000","last_undegraded":"2024-04-18T21:06:34.692021+0000","last_fullsized":"2024-04-18T21:06:34.692021+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:42:40.133263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:35.610362+0000","last_change":"2024-04-18T21:05:05.654121+0000","last_active":"2024-04-18T21:06:35.610362+0000","last_peered":"2024-04-18T21:06:35.610362+0000","last_clean":"2024-04-18T21:06:35.610362+0000","last_became_active":"2024-04-18T21:05:05.651310+0000","last_became_peered":"2024-04-18T21:05:05.651310+0000","last_unstale":"2024-04-18T21:06:35.610362+0000","last_undegraded":"2024-04-18T21:06:35.610362+0000","last_fullsized":"2024-04-18T21:06:35.610362+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:01.841786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":79,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.692549+0000","last_change":"2024-04-18T21:05:00.578604+0000","last_active":"2024-04-18T21:06:34.692549+0000","last_peered":"2024-04-18T21:06:34.692549+0000","last_clean":"2024-04-18T21:06:34.692549+0000","last_became_active":"2024-04-18T21:05:00.577988+0000","last_became_peered":"2024-04-18T21:05:00.577988+0000","last_unstale":"2024-04-18T21:06:34.692549+0000","last_undegraded":"2024-04-18T21:06:34.692549+0000","last_fullsized":"2024-04-18T21:06:34.692549+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:54:54.201759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":74,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:35.609043+0000","last_change":"2024-04-18T21:05:04.627627+0000","last_active":"2024-04-18T21:06:35.609043+0000","last_peered":"2024-04-18T21:06:35.609043+0000","last_clean":"2024-04-18T21:06:35.609043+0000","last_became_active":"2024-04-18T21:05:04.626850+0000","last_became_peered":"2024-04-18T21:05:04.626850+0000","last_unstale":"2024-04-18T21:06:35.609043+0000","last_undegraded":"2024-04-18T21:06:35.609043+0000","last_fullsized":"2024-04-18T21:06:35.609043+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:43:31.453080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":71,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.693855+0000","last_change":"2024-04-18T21:05:05.661488+0000","last_active":"2024-04-18T21:06:34.693855+0000","last_peered":"2024-04-18T21:06:34.693855+0000","last_clean":"2024-04-18T21:06:34.693855+0000","last_became_active":"2024-04-18T21:05:05.660283+0000","last_became_peered":"2024-04-18T21:05:05.660283+0000","last_unstale":"2024-04-18T21:06:34.693855+0000","last_undegraded":"2024-04-18T21:06:34.693855+0000","last_fullsized":"2024-04-18T21:06:34.693855+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:04.350492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":80,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.693039+0000","last_change":"2024-04-18T21:05:00.576606+0000","last_active":"2024-04-18T21:06:34.693039+0000","last_peered":"2024-04-18T21:06:34.693039+0000","last_clean":"2024-04-18T21:06:34.693039+0000","last_became_active":"2024-04-18T21:05:00.575951+0000","last_became_peered":"2024-04-18T21:05:00.575951+0000","last_unstale":"2024-04-18T21:06:34.693039+0000","last_undegraded":"2024-04-18T21:06:34.693039+0000","last_fullsized":"2024-04-18T21:06:34.693039+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:32:17.612481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":74,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.693204+0000","last_change":"2024-04-18T21:05:04.627296+0000","last_active":"2024-04-18T21:06:34.693204+0000","last_peered":"2024-04-18T21:06:34.693204+0000","last_clean":"2024-04-18T21:06:34.693204+0000","last_became_active":"2024-04-18T21:05:04.626801+0000","last_became_peered":"2024-04-18T21:05:04.626801+0000","last_unstale":"2024-04-18T21:06:34.693204+0000","last_undegraded":"2024-04-18T21:06:34.693204+0000","last_fullsized":"2024-04-18T21:06:34.693204+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:46:36.285416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":71,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.693222+0000","last_change":"2024-04-18T21:05:05.655152+0000","last_active":"2024-04-18T21:06:34.693222+0000","last_peered":"2024-04-18T21:06:34.693222+0000","last_clean":"2024-04-18T21:06:34.693222+0000","last_became_active":"2024-04-18T21:05:05.654506+0000","last_became_peered":"2024-04-18T21:05:05.654506+0000","last_unstale":"2024-04-18T21:06:34.693222+0000","last_undegraded":"2024-04-18T21:06:34.693222+0000","last_fullsized":"2024-04-18T21:06:34.693222+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:32:23.929877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":74,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.694711+0000","last_change":"2024-04-18T21:05:04.628916+0000","last_active":"2024-04-18T21:06:34.694711+0000","last_peered":"2024-04-18T21:06:34.694711+0000","last_clean":"2024-04-18T21:06:34.694711+0000","last_became_active":"2024-04-18T21:05:04.628245+0000","last_became_peered":"2024-04-18T21:05:04.628245+0000","last_unstale":"2024-04-18T21:06:34.694711+0000","last_undegraded":"2024-04-18T21:06:34.694711+0000","last_fullsized":"2024-04-18T21:06:34.694711+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:34:58.562540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:35.610028+0000","last_change":"2024-04-18T21:06:01.036156+0000","last_active":"2024-04-18T21:06:35.610028+0000","last_peered":"2024-04-18T21:06:35.610028+0000","last_clean":"2024-04-18T21:06:35.610028+0000","last_became_active":"2024-04-18T21:06:01.035478+0000","last_became_peered":"2024-04-18T21:06:01.035478+0000","last_unstale":"2024-04-18T21:06:35.610028+0000","last_undegraded":"2024-04-18T21:06:35.610028+0000","last_fullsized":"2024-04-18T21:06:35.610028+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:25:04.260649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:35.609238+0000","last_change":"2024-04-18T21:05:05.646076+0000","last_active":"2024-04-18T21:06:35.609238+0000","last_peered":"2024-04-18T21:06:35.609238+0000","last_clean":"2024-04-18T21:06:35.609238+0000","last_became_active":"2024-04-18T21:05:05.645104+0000","last_became_peered":"2024-04-18T21:05:05.645104+0000","last_unstale":"2024-04-18T21:06:35.609238+0000","last_undegraded":"2024-04-18T21:06:35.609238+0000","last_fullsized":"2024-04-18T21:06:35.609238+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:34:38.427319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":73,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.693523+0000","last_change":"2024-04-18T21:05:04.639700+0000","last_active":"2024-04-18T21:06:34.693523+0000","last_peered":"2024-04-18T21:06:34.693523+0000","last_clean":"2024-04-18T21:06:34.693523+0000","last_became_active":"2024-04-18T21:05:04.638928+0000","last_became_peered":"2024-04-18T21:05:04.638928+0000","last_unstale":"2024-04-18T21:06:34.693523+0000","last_undegraded":"2024-04-18T21:06:34.693523+0000","last_fullsized":"2024-04-18T21:06:34.693523+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:00:08.877854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":80,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:35.610351+0000","last_change":"2024-04-18T21:05:00.576907+0000","last_active":"2024-04-18T21:06:35.610351+0000","last_peered":"2024-04-18T21:06:35.610351+0000","last_clean":"2024-04-18T21:06:35.610351+0000","last_became_active":"2024-04-18T21:05:00.576152+0000","last_became_peered":"2024-04-18T21:05:00.576152+0000","last_unstale":"2024-04-18T21:06:35.610351+0000","last_undegraded":"2024-04-18T21:06:35.610351+0000","last_fullsized":"2024-04-18T21:06:35.610351+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:25:07.270023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:35.609574+0000","last_change":"2024-04-18T21:05:05.646026+0000","last_active":"2024-04-18T21:06:35.609574+0000","last_peered":"2024-04-18T21:06:35.609574+0000","last_clean":"2024-04-18T21:06:35.609574+0000","last_became_active":"2024-04-18T21:05:05.645192+0000","last_became_peered":"2024-04-18T21:05:05.645192+0000","last_unstale":"2024-04-18T21:06:35.609574+0000","last_undegraded":"2024-04-18T21:06:35.609574+0000","last_fullsized":"2024-04-18T21:06:35.609574+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:05:46.009381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":75,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.694239+0000","last_change":"2024-04-18T21:05:04.640732+0000","last_active":"2024-04-18T21:06:34.694239+0000","last_peered":"2024-04-18T21:06:34.694239+0000","last_clean":"2024-04-18T21:06:34.694239+0000","last_became_active":"2024-04-18T21:05:04.638505+0000","last_became_peered":"2024-04-18T21:05:04.638505+0000","last_unstale":"2024-04-18T21:06:34.694239+0000","last_undegraded":"2024-04-18T21:06:34.694239+0000","last_fullsized":"2024-04-18T21:06:34.694239+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:34:58.562540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:35.610483+0000","last_change":"2024-04-18T21:06:01.036362+0000","last_active":"2024-04-18T21:06:35.610483+0000","last_peered":"2024-04-18T21:06:35.610483+0000","last_clean":"2024-04-18T21:06:35.610483+0000","last_became_active":"2024-04-18T21:06:01.035483+0000","last_became_peered":"2024-04-18T21:06:01.035483+0000","last_unstale":"2024-04-18T21:06:35.610483+0000","last_undegraded":"2024-04-18T21:06:35.610483+0000","last_fullsized":"2024-04-18T21:06:35.610483+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:42:36.106273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":41,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.691629+0000","last_change":"2024-04-18T21:06:01.032606+0000","last_active":"2024-04-18T21:06:34.691629+0000","last_peered":"2024-04-18T21:06:34.691629+0000","last_clean":"2024-04-18T21:06:34.691629+0000","last_became_active":"2024-04-18T21:06:01.032092+0000","last_became_peered":"2024-04-18T21:06:01.032092+0000","last_unstale":"2024-04-18T21:06:34.691629+0000","last_undegraded":"2024-04-18T21:06:34.691629+0000","last_fullsized":"2024-04-18T21:06:34.691629+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:14:08.347445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"21'3","reported_seq":76,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.694252+0000","last_change":"2024-04-18T21:05:04.639898+0000","last_active":"2024-04-18T21:06:34.694252+0000","last_peered":"2024-04-18T21:06:34.694252+0000","last_clean":"2024-04-18T21:06:34.694252+0000","last_became_active":"2024-04-18T21:05:04.639115+0000","last_became_peered":"2024-04-18T21:05:04.639115+0000","last_unstale":"2024-04-18T21:06:34.694252+0000","last_undegraded":"2024-04-18T21:06:34.694252+0000","last_fullsized":"2024-04-18T21:06:34.694252+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:44:19.076499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":80,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.694719+0000","last_change":"2024-04-18T21:05:00.572414+0000","last_active":"2024-04-18T21:06:34.694719+0000","last_peered":"2024-04-18T21:06:34.694719+0000","last_clean":"2024-04-18T21:06:34.694719+0000","last_became_active":"2024-04-18T21:05:00.571755+0000","last_became_peered":"2024-04-18T21:05:00.571755+0000","last_unstale":"2024-04-18T21:06:34.694719+0000","last_undegraded":"2024-04-18T21:06:34.694719+0000","last_fullsized":"2024-04-18T21:06:34.694719+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:15:02.061128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:35.608964+0000","last_change":"2024-04-18T21:05:05.655898+0000","last_active":"2024-04-18T21:06:35.608964+0000","last_peered":"2024-04-18T21:06:35.608964+0000","last_clean":"2024-04-18T21:06:35.608964+0000","last_became_active":"2024-04-18T21:05:05.654111+0000","last_became_peered":"2024-04-18T21:05:05.654111+0000","last_unstale":"2024-04-18T21:06:35.608964+0000","last_undegraded":"2024-04-18T21:06:35.608964+0000","last_fullsized":"2024-04-18T21:06:35.608964+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:19:38.537080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.692947+0000","last_change":"2024-04-18T21:05:05.641373+0000","last_active":"2024-04-18T21:06:34.692947+0000","last_peered":"2024-04-18T21:06:34.692947+0000","last_clean":"2024-04-18T21:06:34.692947+0000","last_became_active":"2024-04-18T21:05:05.634204+0000","last_became_peered":"2024-04-18T21:05:05.634204+0000","last_unstale":"2024-04-18T21:06:34.692947+0000","last_undegraded":"2024-04-18T21:06:34.692947+0000","last_fullsized":"2024-04-18T21:06:34.692947+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:27:35.995004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"21'10","reported_seq":84,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.693946+0000","last_change":"2024-04-18T21:05:04.631271+0000","last_active":"2024-04-18T21:06:34.693946+0000","last_peered":"2024-04-18T21:06:34.693946+0000","last_clean":"2024-04-18T21:06:34.693946+0000","last_became_active":"2024-04-18T21:05:04.630442+0000","last_became_peered":"2024-04-18T21:05:04.630442+0000","last_unstale":"2024-04-18T21:06:34.693946+0000","last_undegraded":"2024-04-18T21:06:34.693946+0000","last_fullsized":"2024-04-18T21:06:34.693946+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:33:48.703994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":71,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.691975+0000","last_change":"2024-04-18T21:05:05.637894+0000","last_active":"2024-04-18T21:06:34.691975+0000","last_peered":"2024-04-18T21:06:34.691975+0000","last_clean":"2024-04-18T21:06:34.691975+0000","last_became_active":"2024-04-18T21:05:05.636846+0000","last_became_peered":"2024-04-18T21:05:05.636846+0000","last_unstale":"2024-04-18T21:06:34.691975+0000","last_undegraded":"2024-04-18T21:06:34.691975+0000","last_fullsized":"2024-04-18T21:06:34.691975+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:34:31.132458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":77,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:35.610262+0000","last_change":"2024-04-18T21:05:04.631152+0000","last_active":"2024-04-18T21:06:35.610262+0000","last_peered":"2024-04-18T21:06:35.610262+0000","last_clean":"2024-04-18T21:06:35.610262+0000","last_became_active":"2024-04-18T21:05:04.628900+0000","last_became_peered":"2024-04-18T21:05:04.628900+0000","last_unstale":"2024-04-18T21:06:35.610262+0000","last_undegraded":"2024-04-18T21:06:35.610262+0000","last_fullsized":"2024-04-18T21:06:35.610262+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:40:21.452052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":74,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.694607+0000","last_change":"2024-04-18T21:05:04.629470+0000","last_active":"2024-04-18T21:06:34.694607+0000","last_peered":"2024-04-18T21:06:34.694607+0000","last_clean":"2024-04-18T21:06:34.694607+0000","last_became_active":"2024-04-18T21:05:04.628286+0000","last_became_peered":"2024-04-18T21:05:04.628286+0000","last_unstale":"2024-04-18T21:06:34.694607+0000","last_undegraded":"2024-04-18T21:06:34.694607+0000","last_fullsized":"2024-04-18T21:06:34.694607+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:00:08.877854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":71,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.691782+0000","last_change":"2024-04-18T21:05:05.642793+0000","last_active":"2024-04-18T21:06:34.691782+0000","last_peered":"2024-04-18T21:06:34.691782+0000","last_clean":"2024-04-18T21:06:34.691782+0000","last_became_active":"2024-04-18T21:05:05.641983+0000","last_became_peered":"2024-04-18T21:05:05.641983+0000","last_unstale":"2024-04-18T21:06:34.691782+0000","last_undegraded":"2024-04-18T21:06:34.691782+0000","last_fullsized":"2024-04-18T21:06:34.691782+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:46:36.339289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":73,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.694119+0000","last_change":"2024-04-18T21:05:04.641445+0000","last_active":"2024-04-18T21:06:34.694119+0000","last_peered":"2024-04-18T21:06:34.694119+0000","last_clean":"2024-04-18T21:06:34.694119+0000","last_became_active":"2024-04-18T21:05:04.640682+0000","last_became_peered":"2024-04-18T21:05:04.640682+0000","last_unstale":"2024-04-18T21:06:34.694119+0000","last_undegraded":"2024-04-18T21:06:34.694119+0000","last_fullsized":"2024-04-18T21:06:34.694119+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:46:36.285416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":71,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.692354+0000","last_change":"2024-04-18T21:05:05.641561+0000","last_active":"2024-04-18T21:06:34.692354+0000","last_peered":"2024-04-18T21:06:34.692354+0000","last_clean":"2024-04-18T21:06:34.692354+0000","last_became_active":"2024-04-18T21:05:05.640922+0000","last_became_peered":"2024-04-18T21:05:05.640922+0000","last_unstale":"2024-04-18T21:06:34.692354+0000","last_undegraded":"2024-04-18T21:06:34.692354+0000","last_fullsized":"2024-04-18T21:06:34.692354+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:56.408234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:35.610242+0000","last_change":"2024-04-18T21:05:05.651530+0000","last_active":"2024-04-18T21:06:35.610242+0000","last_peered":"2024-04-18T21:06:35.610242+0000","last_clean":"2024-04-18T21:06:35.610242+0000","last_became_active":"2024-04-18T21:05:05.648167+0000","last_became_peered":"2024-04-18T21:05:05.648167+0000","last_unstale":"2024-04-18T21:06:35.610242+0000","last_undegraded":"2024-04-18T21:06:35.610242+0000","last_fullsized":"2024-04-18T21:06:35.610242+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:14:51.873741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":41,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:35.609213+0000","last_change":"2024-04-18T21:06:01.033325+0000","last_active":"2024-04-18T21:06:35.609213+0000","last_peered":"2024-04-18T21:06:35.609213+0000","last_clean":"2024-04-18T21:06:35.609213+0000","last_became_active":"2024-04-18T21:06:01.032763+0000","last_became_peered":"2024-04-18T21:06:01.032763+0000","last_unstale":"2024-04-18T21:06:35.609213+0000","last_undegraded":"2024-04-18T21:06:35.609213+0000","last_fullsized":"2024-04-18T21:06:35.609213+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:46:21.038602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":41,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.694129+0000","last_change":"2024-04-18T21:06:01.034762+0000","last_active":"2024-04-18T21:06:34.694129+0000","last_peered":"2024-04-18T21:06:34.694129+0000","last_clean":"2024-04-18T21:06:34.694129+0000","last_became_active":"2024-04-18T21:06:01.033874+0000","last_became_peered":"2024-04-18T21:06:01.033874+0000","last_unstale":"2024-04-18T21:06:34.694129+0000","last_undegraded":"2024-04-18T21:06:34.694129+0000","last_fullsized":"2024-04-18T21:06:34.694129+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:36:21.285460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":73,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.692062+0000","last_change":"2024-04-18T21:05:04.637597+0000","last_active":"2024-04-18T21:06:34.692062+0000","last_peered":"2024-04-18T21:06:34.692062+0000","last_clean":"2024-04-18T21:06:34.692062+0000","last_became_active":"2024-04-18T21:05:04.636827+0000","last_became_peered":"2024-04-18T21:05:04.636827+0000","last_unstale":"2024-04-18T21:06:34.692062+0000","last_undegraded":"2024-04-18T21:06:34.692062+0000","last_fullsized":"2024-04-18T21:06:34.692062+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:43.511952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:35.609796+0000","last_change":"2024-04-18T21:05:05.658971+0000","last_active":"2024-04-18T21:06:35.609796+0000","last_peered":"2024-04-18T21:06:35.609796+0000","last_clean":"2024-04-18T21:06:35.609796+0000","last_became_active":"2024-04-18T21:05:05.658363+0000","last_became_peered":"2024-04-18T21:05:05.658363+0000","last_unstale":"2024-04-18T21:06:35.609796+0000","last_undegraded":"2024-04-18T21:06:35.609796+0000","last_fullsized":"2024-04-18T21:06:35.609796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:12.944469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":75,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:35.609413+0000","last_change":"2024-04-18T21:05:04.636585+0000","last_active":"2024-04-18T21:06:35.609413+0000","last_peered":"2024-04-18T21:06:35.609413+0000","last_clean":"2024-04-18T21:06:35.609413+0000","last_became_active":"2024-04-18T21:05:04.635670+0000","last_became_peered":"2024-04-18T21:05:04.635670+0000","last_unstale":"2024-04-18T21:06:35.609413+0000","last_undegraded":"2024-04-18T21:06:35.609413+0000","last_fullsized":"2024-04-18T21:06:35.609413+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:34:33.779063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:35.609694+0000","last_change":"2024-04-18T21:05:05.649960+0000","last_active":"2024-04-18T21:06:35.609694+0000","last_peered":"2024-04-18T21:06:35.609694+0000","last_clean":"2024-04-18T21:06:35.609694+0000","last_became_active":"2024-04-18T21:05:05.648528+0000","last_became_peered":"2024-04-18T21:05:05.648528+0000","last_unstale":"2024-04-18T21:06:35.609694+0000","last_undegraded":"2024-04-18T21:06:35.609694+0000","last_fullsized":"2024-04-18T21:06:35.609694+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:20:45.938503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":75,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:35.609705+0000","last_change":"2024-04-18T21:05:04.630151+0000","last_active":"2024-04-18T21:06:35.609705+0000","last_peered":"2024-04-18T21:06:35.609705+0000","last_clean":"2024-04-18T21:06:35.609705+0000","last_became_active":"2024-04-18T21:05:04.627968+0000","last_became_peered":"2024-04-18T21:05:04.627968+0000","last_unstale":"2024-04-18T21:06:35.609705+0000","last_undegraded":"2024-04-18T21:06:35.609705+0000","last_fullsized":"2024-04-18T21:06:35.609705+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:00:33.393636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.692824+0000","last_change":"2024-04-18T21:05:05.624840+0000","last_active":"2024-04-18T21:06:34.692824+0000","last_peered":"2024-04-18T21:06:34.692824+0000","last_clean":"2024-04-18T21:06:34.692824+0000","last_became_active":"2024-04-18T21:05:05.622950+0000","last_became_peered":"2024-04-18T21:05:05.622950+0000","last_unstale":"2024-04-18T21:06:34.692824+0000","last_undegraded":"2024-04-18T21:06:34.692824+0000","last_fullsized":"2024-04-18T21:06:34.692824+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:27:17.530889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":76,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.693872+0000","last_change":"2024-04-18T21:05:04.626715+0000","last_active":"2024-04-18T21:06:34.693872+0000","last_peered":"2024-04-18T21:06:34.693872+0000","last_clean":"2024-04-18T21:06:34.693872+0000","last_became_active":"2024-04-18T21:05:04.625270+0000","last_became_peered":"2024-04-18T21:05:04.625270+0000","last_unstale":"2024-04-18T21:06:34.693872+0000","last_undegraded":"2024-04-18T21:06:34.693872+0000","last_fullsized":"2024-04-18T21:06:34.693872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:43.511952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.692651+0000","last_change":"2024-04-18T21:05:05.627962+0000","last_active":"2024-04-18T21:06:34.692651+0000","last_peered":"2024-04-18T21:06:34.692651+0000","last_clean":"2024-04-18T21:06:34.692651+0000","last_became_active":"2024-04-18T21:05:05.626698+0000","last_became_peered":"2024-04-18T21:05:05.626698+0000","last_unstale":"2024-04-18T21:06:34.692651+0000","last_undegraded":"2024-04-18T21:06:34.692651+0000","last_fullsized":"2024-04-18T21:06:34.692651+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:48:48.973087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":76,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:35.610109+0000","last_change":"2024-04-18T21:05:04.632776+0000","last_active":"2024-04-18T21:06:35.610109+0000","last_peered":"2024-04-18T21:06:35.610109+0000","last_clean":"2024-04-18T21:06:35.610109+0000","last_became_active":"2024-04-18T21:05:04.630142+0000","last_became_peered":"2024-04-18T21:05:04.630142+0000","last_unstale":"2024-04-18T21:06:35.610109+0000","last_undegraded":"2024-04-18T21:06:35.610109+0000","last_fullsized":"2024-04-18T21:06:35.610109+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:19:36.721897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:35.609252+0000","last_change":"2024-04-18T21:05:05.653025+0000","last_active":"2024-04-18T21:06:35.609252+0000","last_peered":"2024-04-18T21:06:35.609252+0000","last_clean":"2024-04-18T21:06:35.609252+0000","last_became_active":"2024-04-18T21:05:05.645039+0000","last_became_peered":"2024-04-18T21:05:05.645039+0000","last_unstale":"2024-04-18T21:06:35.609252+0000","last_undegraded":"2024-04-18T21:06:35.609252+0000","last_fullsized":"2024-04-18T21:06:35.609252+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":74,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.694104+0000","last_change":"2024-04-18T21:05:04.640134+0000","last_active":"2024-04-18T21:06:34.694104+0000","last_peered":"2024-04-18T21:06:34.694104+0000","last_clean":"2024-04-18T21:06:34.694104+0000","last_became_active":"2024-04-18T21:05:04.638597+0000","last_became_peered":"2024-04-18T21:05:04.638597+0000","last_unstale":"2024-04-18T21:06:34.694104+0000","last_undegraded":"2024-04-18T21:06:34.694104+0000","last_fullsized":"2024-04-18T21:06:34.694104+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:56:05.795125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.692687+0000","last_change":"2024-04-18T21:05:05.629022+0000","last_active":"2024-04-18T21:06:34.692687+0000","last_peered":"2024-04-18T21:06:34.692687+0000","last_clean":"2024-04-18T21:06:34.692687+0000","last_became_active":"2024-04-18T21:05:05.627643+0000","last_became_peered":"2024-04-18T21:05:05.627643+0000","last_unstale":"2024-04-18T21:06:34.692687+0000","last_undegraded":"2024-04-18T21:06:34.692687+0000","last_fullsized":"2024-04-18T21:06:34.692687+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:32:23.929877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":77,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-18T21:06:34.694006+0000","last_change":"2024-04-18T21:05:04.641338+0000","last_active":"2024-04-18T21:06:34.694006+0000","last_peered":"2024-04-18T21:06:34.694006+0000","last_clean":"2024-04-18T21:06:34.694006+0000","last_became_active":"2024-04-18T21:05:04.639958+0000","last_became_peered":"2024-04-18T21:05:04.639958+0000","last_unstale":"2024-04-18T21:06:34.694006+0000","last_undegraded":"2024-04-18T21:06:34.694006+0000","last_fullsized":"2024-04-18T21:06:34.694006+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:42:45.392908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7351,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738393,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35744,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336096,"statfs":{"total":96636764160,"available":96600162304,"internally_reserved":0,"allocated":409600,"data_stored":182340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738393,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32180,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339660,"statfs":{"total":96636764160,"available":96603811840,"internally_reserved":0,"allocated":1024000,"data_stored":778827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738391,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1032192,"data_stored":779443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:06:40.640 INFO:tasks.thrashosds.thrasher:Setting 2.0 to [2, 0, 1] 2024-04-18T21:06:40.640 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '2.0', '2', '0', '1'] 2024-04-18T21:06:40.640 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 2.0 2 0 1 2024-04-18T21:06:40.685 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:40.686+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:40.707 INFO:teuthology.orchestra.run.smithi078.stderr:noscrub is unset 2024-04-18T21:06:40.723 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:40.724 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:06:40.724 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-04-18T21:06:40.724 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:40.739 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:40.786 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:40.782+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:40.887 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:40.887+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:40.916 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:40.916 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:06:40.916 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-18T21:06:40.916 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-18T21:06:40.916 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:40.932 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:40.988 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:40.986+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:41.011 INFO:teuthology.orchestra.run.smithi078.stderr:Error EINVAL: you must specify pairs of osd ids to be remapped 2024-04-18T21:06:41.017 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-18T21:06:41.017 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2024-04-18T21:06:41.073 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:41.073 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-18T21:06:41.073 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-18T21:06:41.074 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:06:41.074 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.074 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:41.074 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:06:41.074 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 95.456866027999993, 2024-04-18T21:06:41.074 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.034065303999999998, 2024-04-18T21:06:41.074 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:41.074 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:41.074 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:41.074 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:41.074 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.074 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:41.074 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:06:41.075 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:41.075 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.075 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.075 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:41.075 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615251+0000", 2024-04-18T21:06:41.075 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:41.075 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.075 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.075 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:41.075 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615254+0000", 2024-04-18T21:06:41.075 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7829999999999999e-06 2024-04-18T21:06:41.075 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.075 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.075 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:41.075 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615267+0000", 2024-04-18T21:06:41.076 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3334e-05 2024-04-18T21:06:41.076 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.076 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.076 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:41.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615294+0000", 2024-04-18T21:06:41.076 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7271999999999999e-05 2024-04-18T21:06:41.076 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.076 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.076 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:41.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615321+0000", 2024-04-18T21:06:41.076 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.637e-05 2024-04-18T21:06:41.076 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.076 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.076 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:41.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615479+0000", 2024-04-18T21:06:41.077 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000158493 2024-04-18T21:06:41.077 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.077 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.077 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:41.077 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615498+0000", 2024-04-18T21:06:41.077 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9148999999999999e-05 2024-04-18T21:06:41.077 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.077 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.077 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:41.077 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632915+0000", 2024-04-18T21:06:41.077 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.017416551999999998 2024-04-18T21:06:41.077 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.077 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.077 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:41.077 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633302+0000", 2024-04-18T21:06:41.078 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00038725000000000001 2024-04-18T21:06:41.078 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.078 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.078 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:41.078 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633638+0000", 2024-04-18T21:06:41.078 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000335946 2024-04-18T21:06:41.078 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.078 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.078 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:41.078 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645976+0000", 2024-04-18T21:06:41.078 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012337617 2024-04-18T21:06:41.078 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.078 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.078 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:41.079 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649080+0000", 2024-04-18T21:06:41.079 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031038929999999999 2024-04-18T21:06:41.079 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.079 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.079 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:41.079 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649207+0000", 2024-04-18T21:06:41.079 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000127537 2024-04-18T21:06:41.079 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.079 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.079 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:41.079 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.649316+0000", 2024-04-18T21:06:41.079 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109108 2024-04-18T21:06:41.079 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:41.079 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:41.079 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:41.080 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.080 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.080 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:41.080 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:06:41.080 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 95.456732650999996, 2024-04-18T21:06:41.080 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036275764000000002, 2024-04-18T21:06:41.080 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:41.080 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:41.080 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:41.080 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:41.080 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.080 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:41.080 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:06:41.080 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:41.081 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.081 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.081 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:41.081 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615384+0000", 2024-04-18T21:06:41.081 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:41.081 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.081 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.081 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:41.081 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615386+0000", 2024-04-18T21:06:41.081 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.573e-06 2024-04-18T21:06:41.081 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.081 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.081 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:41.081 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:06:41.081 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0723999999999999e-05 2024-04-18T21:06:41.082 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.082 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.082 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:41.082 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615418+0000", 2024-04-18T21:06:41.082 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0902000000000001e-05 2024-04-18T21:06:41.082 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.082 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.082 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:41.082 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615433+0000", 2024-04-18T21:06:41.082 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5319999999999999e-05 2024-04-18T21:06:41.082 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.082 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.082 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:41.082 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615659+0000", 2024-04-18T21:06:41.083 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000226095 2024-04-18T21:06:41.083 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.083 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.083 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:41.083 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:41.083 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1276e-05 2024-04-18T21:06:41.083 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.083 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.083 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:41.083 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643654+0000", 2024-04-18T21:06:41.083 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027983238000000001 2024-04-18T21:06:41.083 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.083 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.083 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:41.083 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643868+0000", 2024-04-18T21:06:41.084 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000214305 2024-04-18T21:06:41.084 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.084 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.084 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:41.084 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:06:41.084 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035892200000000002 2024-04-18T21:06:41.084 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.084 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.084 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:41.084 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646056+0000", 2024-04-18T21:06:41.084 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001829172 2024-04-18T21:06:41.084 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.084 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.084 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:41.084 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651406+0000", 2024-04-18T21:06:41.085 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0053504800000000003 2024-04-18T21:06:41.085 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.085 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.085 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:41.085 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651551+0000", 2024-04-18T21:06:41.085 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014427999999999999 2024-04-18T21:06:41.085 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.085 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.085 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:41.085 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651660+0000", 2024-04-18T21:06:41.085 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109477 2024-04-18T21:06:41.085 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:41.085 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:41.085 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:41.085 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.086 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.086 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:41.086 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:41.086 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 95.456659268999999, 2024-04-18T21:06:41.086 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045668994999999997, 2024-04-18T21:06:41.086 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:41.086 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:41.086 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:41.086 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:41.086 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.086 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:41.086 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:41.086 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:41.086 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.086 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.087 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:41.087 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:41.087 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:41.087 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.087 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:41.087 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615459+0000", 2024-04-18T21:06:41.087 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5030000000000001e-06 2024-04-18T21:06:41.087 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.087 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:41.087 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615506+0000", 2024-04-18T21:06:41.087 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6872000000000001e-05 2024-04-18T21:06:41.087 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.088 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:41.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615527+0000", 2024-04-18T21:06:41.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0763000000000001e-05 2024-04-18T21:06:41.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.088 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:41.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615551+0000", 2024-04-18T21:06:41.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4159e-05 2024-04-18T21:06:41.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.088 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:41.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615736+0000", 2024-04-18T21:06:41.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018499599999999999 2024-04-18T21:06:41.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.089 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.089 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:41.089 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615748+0000", 2024-04-18T21:06:41.089 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2272999999999999e-05 2024-04-18T21:06:41.089 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.089 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.089 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:41.089 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635481+0000", 2024-04-18T21:06:41.089 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019732772999999999 2024-04-18T21:06:41.089 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.089 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.089 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:41.089 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635791+0000", 2024-04-18T21:06:41.089 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031013299999999998 2024-04-18T21:06:41.090 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.090 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.090 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:41.090 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636101+0000", 2024-04-18T21:06:41.090 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030943300000000002 2024-04-18T21:06:41.090 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.090 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.090 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:41.090 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646043+0000", 2024-04-18T21:06:41.090 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099428139999999995 2024-04-18T21:06:41.090 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.090 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.090 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:41.090 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660991+0000", 2024-04-18T21:06:41.090 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014947142 2024-04-18T21:06:41.091 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.091 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.091 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:41.091 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661061+0000", 2024-04-18T21:06:41.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0438000000000006e-05 2024-04-18T21:06:41.091 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.091 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.091 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:41.091 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661127+0000", 2024-04-18T21:06:41.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5696000000000003e-05 2024-04-18T21:06:41.091 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:41.091 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:41.091 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:41.091 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.092 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.092 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:41.092 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:41.092 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 95.456446841000002, 2024-04-18T21:06:41.092 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045745085999999997, 2024-04-18T21:06:41.092 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:41.092 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:41.092 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:41.092 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:41.092 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.092 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:41.092 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:41.092 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:41.092 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.093 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:41.093 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:41.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:41.093 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.093 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:41.093 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:06:41.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7400000000000001e-06 2024-04-18T21:06:41.093 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.093 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:41.093 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:06:41.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8133e-05 2024-04-18T21:06:41.093 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.094 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:41.094 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615726+0000", 2024-04-18T21:06:41.094 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6132e-05 2024-04-18T21:06:41.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.094 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:41.094 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615742+0000", 2024-04-18T21:06:41.094 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6157000000000001e-05 2024-04-18T21:06:41.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.094 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:41.094 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615937+0000", 2024-04-18T21:06:41.094 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000194768 2024-04-18T21:06:41.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.095 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.095 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:41.095 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615950+0000", 2024-04-18T21:06:41.095 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3084e-05 2024-04-18T21:06:41.095 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.095 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.095 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:41.095 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643676+0000", 2024-04-18T21:06:41.095 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027725639999999999 2024-04-18T21:06:41.095 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.095 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.095 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:41.095 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643867+0000", 2024-04-18T21:06:41.096 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019075900000000001 2024-04-18T21:06:41.096 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.096 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.096 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:41.096 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:06:41.096 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036013799999999997 2024-04-18T21:06:41.096 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.096 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.096 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:41.096 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646068+0000", 2024-04-18T21:06:41.096 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001841536 2024-04-18T21:06:41.096 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.096 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.096 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:41.096 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661184+0000", 2024-04-18T21:06:41.097 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015115458999999999 2024-04-18T21:06:41.097 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.097 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.097 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:41.097 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661283+0000", 2024-04-18T21:06:41.097 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9502999999999999e-05 2024-04-18T21:06:41.097 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.097 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.097 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:41.097 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661415+0000", 2024-04-18T21:06:41.097 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000132037 2024-04-18T21:06:41.097 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:41.097 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:41.097 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:41.097 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.098 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.098 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:41.098 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:06:41.098 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 95.456325153999998, 2024-04-18T21:06:41.098 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036185947000000003, 2024-04-18T21:06:41.098 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:41.098 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:41.098 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:41.098 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:41.098 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.098 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:41.098 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:06:41.098 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:41.098 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.099 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.099 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:41.099 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615792+0000", 2024-04-18T21:06:41.099 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:41.099 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.099 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.099 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:41.099 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615794+0000", 2024-04-18T21:06:41.099 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6440000000000001e-06 2024-04-18T21:06:41.099 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.099 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.099 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:41.099 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615803+0000", 2024-04-18T21:06:41.099 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1220000000000001e-06 2024-04-18T21:06:41.099 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.100 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.100 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:41.100 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615827+0000", 2024-04-18T21:06:41.100 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3997000000000001e-05 2024-04-18T21:06:41.100 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.100 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.100 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:41.100 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615899+0000", 2024-04-18T21:06:41.100 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2741e-05 2024-04-18T21:06:41.100 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.100 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.100 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:41.100 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616019+0000", 2024-04-18T21:06:41.100 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119874 2024-04-18T21:06:41.101 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.101 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.101 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:41.101 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616029+0000", 2024-04-18T21:06:41.101 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:06:41.101 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.101 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.101 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:41.101 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644823+0000", 2024-04-18T21:06:41.101 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.028793151999999999 2024-04-18T21:06:41.101 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.101 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.101 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:41.101 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645106+0000", 2024-04-18T21:06:41.101 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028379700000000002 2024-04-18T21:06:41.102 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.102 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.102 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:41.102 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.645294+0000", 2024-04-18T21:06:41.102 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000187181 2024-04-18T21:06:41.102 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.102 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.102 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:41.102 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646763+0000", 2024-04-18T21:06:41.102 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0014691050000000001 2024-04-18T21:06:41.102 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.102 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.102 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:41.102 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651784+0000", 2024-04-18T21:06:41.103 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050211650000000002 2024-04-18T21:06:41.103 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.103 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.103 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:41.103 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651876+0000", 2024-04-18T21:06:41.103 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2503999999999994e-05 2024-04-18T21:06:41.103 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.103 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.103 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:41.103 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.651978+0000", 2024-04-18T21:06:41.103 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000101475 2024-04-18T21:06:41.103 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:41.103 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:41.103 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:41.103 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.104 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.104 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:41.104 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:41.104 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 95.456176546999998, 2024-04-18T21:06:41.104 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032262322000000003, 2024-04-18T21:06:41.104 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:41.104 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:41.104 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:41.104 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:41.104 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.104 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:41.104 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:41.104 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:41.104 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.104 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.105 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:41.105 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:41.105 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:41.105 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.105 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.105 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:41.105 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615943+0000", 2024-04-18T21:06:41.105 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1959999999999998e-06 2024-04-18T21:06:41.105 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.105 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.105 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:41.105 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615956+0000", 2024-04-18T21:06:41.105 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3424000000000001e-05 2024-04-18T21:06:41.105 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.106 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.106 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:41.106 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615983+0000", 2024-04-18T21:06:41.106 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7072000000000001e-05 2024-04-18T21:06:41.106 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.106 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.106 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:41.106 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616006+0000", 2024-04-18T21:06:41.106 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2823000000000002e-05 2024-04-18T21:06:41.106 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.106 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.106 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:41.106 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616156+0000", 2024-04-18T21:06:41.106 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014962299999999999 2024-04-18T21:06:41.106 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.107 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.107 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:41.107 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616174+0000", 2024-04-18T21:06:41.107 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8082999999999999e-05 2024-04-18T21:06:41.107 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.107 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.107 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:41.107 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.629952+0000", 2024-04-18T21:06:41.107 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013778514 2024-04-18T21:06:41.107 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.107 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.107 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:41.107 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630201+0000", 2024-04-18T21:06:41.107 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024918100000000001 2024-04-18T21:06:41.108 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.108 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.108 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:41.108 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.630386+0000", 2024-04-18T21:06:41.108 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018436900000000001 2024-04-18T21:06:41.108 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.108 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.108 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:41.108 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643169+0000", 2024-04-18T21:06:41.108 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012782774 2024-04-18T21:06:41.108 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.108 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.108 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:41.108 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.647924+0000", 2024-04-18T21:06:41.108 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004755787 2024-04-18T21:06:41.109 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.109 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.109 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:41.109 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648069+0000", 2024-04-18T21:06:41.109 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014459600000000001 2024-04-18T21:06:41.109 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.109 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.109 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:41.109 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648203+0000", 2024-04-18T21:06:41.109 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013388000000000001 2024-04-18T21:06:41.109 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:41.109 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:41.109 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:41.109 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.110 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.110 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:41.110 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:06:41.110 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 95.456068282999993, 2024-04-18T21:06:41.110 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.032489736999999998, 2024-04-18T21:06:41.110 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:41.110 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:41.110 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:41.110 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:41.110 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.110 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:41.110 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:06:41.110 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:41.110 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.110 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.111 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:41.111 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616049+0000", 2024-04-18T21:06:41.111 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:41.111 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.111 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.111 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:41.111 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616050+0000", 2024-04-18T21:06:41.111 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.606e-06 2024-04-18T21:06:41.111 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.111 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.111 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:41.111 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616061+0000", 2024-04-18T21:06:41.111 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0463e-05 2024-04-18T21:06:41.111 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.111 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.112 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:41.112 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616092+0000", 2024-04-18T21:06:41.112 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1415999999999999e-05 2024-04-18T21:06:41.112 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.112 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.112 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:41.112 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616109+0000", 2024-04-18T21:06:41.112 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6557000000000001e-05 2024-04-18T21:06:41.112 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.113 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.113 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:41.113 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616358+0000", 2024-04-18T21:06:41.113 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000249077 2024-04-18T21:06:41.113 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.113 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.113 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:41.113 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616370+0000", 2024-04-18T21:06:41.113 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2037e-05 2024-04-18T21:06:41.113 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.113 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.113 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:41.113 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.634920+0000", 2024-04-18T21:06:41.113 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018550397 2024-04-18T21:06:41.113 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.114 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.114 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:41.114 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640420+0000", 2024-04-18T21:06:41.114 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055000539999999999 2024-04-18T21:06:41.114 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.114 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.114 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:41.114 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.648538+0000", 2024-04-18T21:06:41.114 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0081181299999999994 2024-04-18T21:06:41.114 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:41.114 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:41.114 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:41.114 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.114 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.115 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:41.115 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:06:41.115 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 95.455983962000005, 2024-04-18T21:06:41.115 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036090029000000003, 2024-04-18T21:06:41.115 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:41.115 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:41.115 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:41.115 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:41.115 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.115 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:41.115 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:06:41.115 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:41.115 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.115 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.115 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:41.116 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616133+0000", 2024-04-18T21:06:41.116 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:41.116 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.116 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.116 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:41.116 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616134+0000", 2024-04-18T21:06:41.116 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.353e-06 2024-04-18T21:06:41.116 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.116 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.116 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:41.116 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616141+0000", 2024-04-18T21:06:41.116 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2770000000000002e-06 2024-04-18T21:06:41.116 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.117 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.117 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:41.117 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616160+0000", 2024-04-18T21:06:41.117 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.91e-05 2024-04-18T21:06:41.117 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.117 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.117 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:41.117 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616170+0000", 2024-04-18T21:06:41.117 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7699999999999996e-06 2024-04-18T21:06:41.117 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.117 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.117 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:41.117 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616275+0000", 2024-04-18T21:06:41.117 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105313 2024-04-18T21:06:41.117 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.118 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.118 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:41.118 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616288+0000", 2024-04-18T21:06:41.118 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3027000000000001e-05 2024-04-18T21:06:41.118 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.118 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.118 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:41.118 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646160+0000", 2024-04-18T21:06:41.118 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.029872019 2024-04-18T21:06:41.118 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.118 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.118 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:41.118 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646368+0000", 2024-04-18T21:06:41.118 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020811899999999999 2024-04-18T21:06:41.119 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.119 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.119 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:41.119 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.652223+0000", 2024-04-18T21:06:41.119 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.005855051 2024-04-18T21:06:41.119 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:41.119 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:41.119 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:41.119 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.119 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.119 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:41.119 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:41.119 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 95.455926392999999, 2024-04-18T21:06:41.119 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043572403000000003, 2024-04-18T21:06:41.119 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:41.120 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:41.120 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:41.120 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:41.120 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.120 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:41.120 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:41.120 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:41.120 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.120 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.120 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:41.120 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:41.120 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:41.120 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.120 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.120 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:41.121 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616192+0000", 2024-04-18T21:06:41.121 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:06:41.121 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.121 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.121 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:41.121 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616203+0000", 2024-04-18T21:06:41.121 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0890000000000001e-05 2024-04-18T21:06:41.121 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.121 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.121 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:41.121 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616223+0000", 2024-04-18T21:06:41.121 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0409000000000001e-05 2024-04-18T21:06:41.121 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.121 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.121 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:41.122 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616238+0000", 2024-04-18T21:06:41.122 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5160000000000001e-05 2024-04-18T21:06:41.122 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.122 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.122 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:41.122 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616343+0000", 2024-04-18T21:06:41.122 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000104831 2024-04-18T21:06:41.122 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.122 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.122 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:41.122 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616357+0000", 2024-04-18T21:06:41.122 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3686000000000001e-05 2024-04-18T21:06:41.122 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.122 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.123 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:41.123 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635912+0000", 2024-04-18T21:06:41.123 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019554944000000001 2024-04-18T21:06:41.123 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.123 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.123 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:41.123 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636231+0000", 2024-04-18T21:06:41.123 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000318766 2024-04-18T21:06:41.123 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.123 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.123 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:41.123 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659763+0000", 2024-04-18T21:06:41.123 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023532474000000001 2024-04-18T21:06:41.123 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:41.123 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:41.124 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:41.124 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.124 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.124 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:29 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:41.124 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:06:41.124 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 95.451997685999999, 2024-04-18T21:06:41.124 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015007971, 2024-04-18T21:06:41.124 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:41.124 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:41.124 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:41.124 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:41.124 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.124 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:41.124 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:06:41.125 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:41.125 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.125 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.125 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:41.125 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620119+0000", 2024-04-18T21:06:41.125 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:41.125 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.125 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.125 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:41.125 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620120+0000", 2024-04-18T21:06:41.125 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0359999999999999e-06 2024-04-18T21:06:41.125 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.125 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.125 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:41.125 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620157+0000", 2024-04-18T21:06:41.125 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6636e-05 2024-04-18T21:06:41.126 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.126 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.126 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:41.126 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620177+0000", 2024-04-18T21:06:41.126 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0247000000000001e-05 2024-04-18T21:06:41.126 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.126 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.126 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:41.126 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620195+0000", 2024-04-18T21:06:41.126 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7819e-05 2024-04-18T21:06:41.126 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.126 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.126 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:41.126 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620342+0000", 2024-04-18T21:06:41.127 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014643300000000001 2024-04-18T21:06:41.127 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.127 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.127 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:41.127 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620405+0000", 2024-04-18T21:06:41.127 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3522000000000006e-05 2024-04-18T21:06:41.127 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.127 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.127 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:41.127 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635016+0000", 2024-04-18T21:06:41.127 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014610840999999999 2024-04-18T21:06:41.127 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.127 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.127 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:41.128 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635127+0000", 2024-04-18T21:06:41.128 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111437 2024-04-18T21:06:41.128 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:41.128 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:41.128 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:41.128 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.128 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.128 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:41.128 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:06:41.128 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 95.451890418000005, 2024-04-18T21:06:41.128 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012693296, 2024-04-18T21:06:41.128 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:41.128 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:41.128 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:41.128 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:41.129 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.129 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:41.129 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:06:41.129 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:41.129 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.129 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.129 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:41.129 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620227+0000", 2024-04-18T21:06:41.129 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:41.129 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.129 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.129 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:41.129 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620228+0000", 2024-04-18T21:06:41.129 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:06:41.129 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.130 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.130 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:41.130 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620236+0000", 2024-04-18T21:06:41.130 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.303e-06 2024-04-18T21:06:41.130 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.130 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.130 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:41.130 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620255+0000", 2024-04-18T21:06:41.130 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9406e-05 2024-04-18T21:06:41.130 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.130 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.130 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:41.130 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.620274+0000", 2024-04-18T21:06:41.130 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8940000000000002e-05 2024-04-18T21:06:41.131 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.131 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.131 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:41.131 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:06:41.131 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001558753 2024-04-18T21:06:41.131 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.131 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.131 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:41.131 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621879+0000", 2024-04-18T21:06:41.131 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6359000000000001e-05 2024-04-18T21:06:41.131 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.131 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.131 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:41.131 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632841+0000", 2024-04-18T21:06:41.131 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010961907 2024-04-18T21:06:41.132 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.132 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.132 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:41.132 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632920+0000", 2024-04-18T21:06:41.132 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8714999999999994e-05 2024-04-18T21:06:41.132 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:41.132 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:41.132 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:41.132 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.132 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.132 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:41.132 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:06:41.132 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 95.450344654999995, 2024-04-18T21:06:41.133 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013445702, 2024-04-18T21:06:41.133 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:41.133 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:41.133 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:41.133 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:41.133 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.133 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:41.133 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:06:41.133 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:41.133 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.133 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.133 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:41.133 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621772+0000", 2024-04-18T21:06:41.133 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:41.134 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.134 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.134 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:41.134 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621774+0000", 2024-04-18T21:06:41.134 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2500000000000001e-06 2024-04-18T21:06:41.134 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.134 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.134 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:41.134 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621786+0000", 2024-04-18T21:06:41.134 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2636000000000001e-05 2024-04-18T21:06:41.134 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.134 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.134 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:41.134 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621814+0000", 2024-04-18T21:06:41.134 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7823000000000001e-05 2024-04-18T21:06:41.135 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.135 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.135 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:41.135 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621844+0000", 2024-04-18T21:06:41.135 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9589000000000001e-05 2024-04-18T21:06:41.135 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.135 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.135 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:41.135 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622253+0000", 2024-04-18T21:06:41.135 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040963700000000002 2024-04-18T21:06:41.135 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.135 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.135 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:41.135 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.622304+0000", 2024-04-18T21:06:41.136 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0868999999999997e-05 2024-04-18T21:06:41.136 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.136 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.136 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:41.136 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635133+0000", 2024-04-18T21:06:41.136 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012829136 2024-04-18T21:06:41.136 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.136 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.136 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:41.136 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635218+0000", 2024-04-18T21:06:41.136 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4761999999999999e-05 2024-04-18T21:06:41.136 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:41.136 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:41.136 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:41.136 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.137 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.137 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-18T21:06:41.137 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:06:41.137 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 95.450217894999994, 2024-04-18T21:06:41.137 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014162065, 2024-04-18T21:06:41.137 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:41.137 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:41.137 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:41.137 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:41.137 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.137 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:41.137 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:06:41.137 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:41.137 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.137 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.137 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:41.138 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621899+0000", 2024-04-18T21:06:41.138 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:41.138 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.138 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.138 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:41.138 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621900+0000", 2024-04-18T21:06:41.138 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:06:41.138 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.138 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.138 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:41.138 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621910+0000", 2024-04-18T21:06:41.138 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0207000000000001e-05 2024-04-18T21:06:41.138 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.138 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.139 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:41.139 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621932+0000", 2024-04-18T21:06:41.139 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1789000000000001e-05 2024-04-18T21:06:41.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.139 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.139 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:41.139 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.621946+0000", 2024-04-18T21:06:41.139 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4212999999999999e-05 2024-04-18T21:06:41.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.139 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.139 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:41.139 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624477+0000", 2024-04-18T21:06:41.139 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025303470000000001 2024-04-18T21:06:41.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.139 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.139 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:41.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.624525+0000", 2024-04-18T21:06:41.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8084999999999998e-05 2024-04-18T21:06:41.140 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.140 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.140 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:41.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635976+0000", 2024-04-18T21:06:41.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.011451368999999999 2024-04-18T21:06:41.140 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.140 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.140 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:41.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636061+0000", 2024-04-18T21:06:41.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5094999999999998e-05 2024-04-18T21:06:41.140 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:41.140 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:41.140 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:41.141 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.141 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.141 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-18T21:06:41.141 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:06:41.141 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 95.440982270000006, 2024-04-18T21:06:41.141 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0098014739999999993, 2024-04-18T21:06:41.141 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:41.141 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:41.141 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:06:41.141 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:41.141 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.141 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:41.141 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:06:41.141 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:41.141 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.142 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.142 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:41.142 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631135+0000", 2024-04-18T21:06:41.142 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:41.142 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.142 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.142 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:41.142 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631136+0000", 2024-04-18T21:06:41.142 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0139999999999999e-06 2024-04-18T21:06:41.142 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.142 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.142 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:41.142 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631152+0000", 2024-04-18T21:06:41.143 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6365999999999999e-05 2024-04-18T21:06:41.143 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.143 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:41.143 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.631961+0000", 2024-04-18T21:06:41.143 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00080873100000000003 2024-04-18T21:06:41.143 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.143 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:41.143 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.632021+0000", 2024-04-18T21:06:41.143 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0541999999999997e-05 2024-04-18T21:06:41.143 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.143 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:41.144 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.633539+0000", 2024-04-18T21:06:41.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015175639999999999 2024-04-18T21:06:41.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.144 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.144 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:41.144 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.640936+0000", 2024-04-18T21:06:41.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007397257 2024-04-18T21:06:41.144 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:41.144 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:41.144 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:41.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.144 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.144 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-18T21:06:41.144 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:06:41.144 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 75.457295930000001, 2024-04-18T21:06:41.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088979039999999999, 2024-04-18T21:06:41.145 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:41.145 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:41.145 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:41.145 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:41.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.145 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:41.145 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:06:41.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:41.145 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.145 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:41.145 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614821+0000", 2024-04-18T21:06:41.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:41.145 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.146 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.146 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:41.146 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614825+0000", 2024-04-18T21:06:41.146 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4829999999999999e-06 2024-04-18T21:06:41.146 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.146 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.146 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:41.146 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614843+0000", 2024-04-18T21:06:41.146 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8777e-05 2024-04-18T21:06:41.146 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.146 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.146 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:41.146 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614884+0000", 2024-04-18T21:06:41.146 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1051999999999999e-05 2024-04-18T21:06:41.146 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.147 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.147 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:41.147 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.614903+0000", 2024-04-18T21:06:41.147 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9069999999999999e-05 2024-04-18T21:06:41.147 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.147 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.147 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:41.147 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615047+0000", 2024-04-18T21:06:41.147 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014374400000000001 2024-04-18T21:06:41.147 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.147 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.147 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:41.147 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.615061+0000", 2024-04-18T21:06:41.147 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4063000000000001e-05 2024-04-18T21:06:41.148 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.148 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.148 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:41.148 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621064+0000", 2024-04-18T21:06:41.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0060029200000000001 2024-04-18T21:06:41.148 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.148 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.148 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:41.148 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621211+0000", 2024-04-18T21:06:41.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000147224 2024-04-18T21:06:41.148 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.148 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.148 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:41.148 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.621396+0000", 2024-04-18T21:06:41.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018454699999999999 2024-04-18T21:06:41.149 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.149 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.149 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:41.149 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.622517+0000", 2024-04-18T21:06:41.149 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001121424 2024-04-18T21:06:41.149 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.149 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.149 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:41.149 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623571+0000", 2024-04-18T21:06:41.149 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010538660000000001 2024-04-18T21:06:41.149 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.149 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.149 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:41.149 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623658+0000", 2024-04-18T21:06:41.149 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6439000000000004e-05 2024-04-18T21:06:41.150 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.150 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:41.150 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:25.623719+0000", 2024-04-18T21:06:41.150 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1295000000000002e-05 2024-04-18T21:06:41.150 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:41.150 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:41.150 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:41.150 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.150 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:845 4.37 4:edb21e58:::100000005cf.00000000:head [write 0~4982] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-18T21:06:41.150 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:40.252167+0000", 2024-04-18T21:06:41.150 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.81994968000000001, 2024-04-18T21:06:41.150 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0092473350000000006, 2024-04-18T21:06:41.151 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:41.151 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:41.151 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:41.151 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:06:41.151 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:06:41.151 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:41.151 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 845 2024-04-18T21:06:41.151 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.151 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:41.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.151 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:41.151 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:40.252167+0000", 2024-04-18T21:06:41.151 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:41.151 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.151 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:41.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:40.252167+0000", 2024-04-18T21:06:41.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:41.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.152 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:41.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:40.252170+0000", 2024-04-18T21:06:41.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.17e-06 2024-04-18T21:06:41.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.152 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:41.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:40.252188+0000", 2024-04-18T21:06:41.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8283000000000001e-05 2024-04-18T21:06:41.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.152 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:41.153 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:40.252217+0000", 2024-04-18T21:06:41.153 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8929e-05 2024-04-18T21:06:41.153 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.153 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.153 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:41.153 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:40.252232+0000", 2024-04-18T21:06:41.153 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.506e-05 2024-04-18T21:06:41.153 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.153 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.153 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:41.153 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:40.252364+0000", 2024-04-18T21:06:41.153 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013194899999999999 2024-04-18T21:06:41.153 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.153 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.153 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:41.154 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:40.252705+0000", 2024-04-18T21:06:41.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00034140400000000001 2024-04-18T21:06:41.154 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.154 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:41.154 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:40.253067+0000", 2024-04-18T21:06:41.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036204899999999998 2024-04-18T21:06:41.154 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.154 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:41.154 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:40.254575+0000", 2024-04-18T21:06:41.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001507453 2024-04-18T21:06:41.154 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:41.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:40.261199+0000", 2024-04-18T21:06:41.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0066242239999999997 2024-04-18T21:06:41.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:41.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:40.261346+0000", 2024-04-18T21:06:41.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014674499999999999 2024-04-18T21:06:41.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:41.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:40.261415+0000", 2024-04-18T21:06:41.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9068999999999999e-05 2024-04-18T21:06:41.155 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:41.155 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:41.156 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:41.156 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.156 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.156 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:56 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-18T21:06:41.156 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:40.629069+0000", 2024-04-18T21:06:41.156 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.443048304, 2024-04-18T21:06:41.156 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015717437000000001, 2024-04-18T21:06:41.156 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:41.156 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:41.156 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:41.156 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:41.156 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.156 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:41.156 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:40.629069+0000", 2024-04-18T21:06:41.156 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:41.157 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.157 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.157 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:41.157 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:40.629069+0000", 2024-04-18T21:06:41.157 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:41.157 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.157 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.157 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:41.157 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:40.629071+0000", 2024-04-18T21:06:41.157 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8449999999999999e-06 2024-04-18T21:06:41.157 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.157 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.157 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:41.157 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:40.629235+0000", 2024-04-18T21:06:41.157 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000164673 2024-04-18T21:06:41.158 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.158 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.158 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:41.158 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:40.629252+0000", 2024-04-18T21:06:41.158 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.681e-05 2024-04-18T21:06:41.158 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.158 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.158 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:41.158 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:40.629260+0000", 2024-04-18T21:06:41.158 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4850000000000003e-06 2024-04-18T21:06:41.158 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.158 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.158 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:41.158 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:40.629332+0000", 2024-04-18T21:06:41.158 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2516999999999997e-05 2024-04-18T21:06:41.159 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.159 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.159 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:41.159 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:40.629466+0000", 2024-04-18T21:06:41.159 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013419300000000001 2024-04-18T21:06:41.159 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.159 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.159 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:41.159 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:40.633693+0000", 2024-04-18T21:06:41.159 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042265150000000001 2024-04-18T21:06:41.159 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.159 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.159 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:41.159 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:40.638358+0000", 2024-04-18T21:06:41.159 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0046648189999999997 2024-04-18T21:06:41.160 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.160 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.160 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:41.160 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:40.644658+0000", 2024-04-18T21:06:41.160 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0063001929999999999 2024-04-18T21:06:41.160 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.160 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.160 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:41.160 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:40.644727+0000", 2024-04-18T21:06:41.160 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9580999999999997e-05 2024-04-18T21:06:41.160 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.160 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.160 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:41.160 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:40.644786+0000", 2024-04-18T21:06:41.160 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8805999999999999e-05 2024-04-18T21:06:41.161 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:41.161 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:41.161 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:41.161 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.161 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.161 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:1189 4.4 4:22daf5c1:::10000000789.00000000:head [write 0~3165] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-18T21:06:41.161 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:40.793669+0000", 2024-04-18T21:06:41.161 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.27844753700000002, 2024-04-18T21:06:41.161 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0080093149999999995, 2024-04-18T21:06:41.161 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:41.161 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:41.161 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:41.161 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:06:41.161 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:06:41.161 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:41.162 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 1189 2024-04-18T21:06:41.162 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.162 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:41.162 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.162 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:41.162 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:40.793669+0000", 2024-04-18T21:06:41.162 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:41.162 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.162 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.162 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:41.162 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:40.793669+0000", 2024-04-18T21:06:41.162 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:41.162 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.162 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.162 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:41.163 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:40.793671+0000", 2024-04-18T21:06:41.163 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4169999999999999e-06 2024-04-18T21:06:41.163 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.163 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.163 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:41.163 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:40.793678+0000", 2024-04-18T21:06:41.163 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4189999999999996e-06 2024-04-18T21:06:41.163 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.163 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.163 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:41.163 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:40.793691+0000", 2024-04-18T21:06:41.163 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2271e-05 2024-04-18T21:06:41.163 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.163 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.163 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:41.164 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:40.793697+0000", 2024-04-18T21:06:41.164 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9460000000000003e-06 2024-04-18T21:06:41.164 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.164 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.164 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:41.164 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:40.793742+0000", 2024-04-18T21:06:41.164 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5849000000000001e-05 2024-04-18T21:06:41.164 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.164 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.164 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:41.164 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:40.793855+0000", 2024-04-18T21:06:41.164 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000112831 2024-04-18T21:06:41.164 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.164 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.164 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:41.164 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:40.793964+0000", 2024-04-18T21:06:41.165 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000108935 2024-04-18T21:06:41.165 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.165 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.165 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:41.165 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:40.794986+0000", 2024-04-18T21:06:41.165 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001021901 2024-04-18T21:06:41.165 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.165 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.165 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:41.165 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:40.801428+0000", 2024-04-18T21:06:41.165 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.006441965 2024-04-18T21:06:41.165 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.165 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.165 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:41.165 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:40.801569+0000", 2024-04-18T21:06:41.166 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014116500000000001 2024-04-18T21:06:41.166 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.166 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.166 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:41.166 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:40.801679+0000", 2024-04-18T21:06:41.166 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109616 2024-04-18T21:06:41.166 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:41.166 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:41.166 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:41.166 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.166 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.166 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:1435 4.37 4:ed3dd789:::1000000088c.00000000:head [write 0~2486] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-18T21:06:41.166 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:41.032286+0000", 2024-04-18T21:06:41.166 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.039831437999999997, 2024-04-18T21:06:41.167 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0080171270000000006, 2024-04-18T21:06:41.167 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:41.167 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:41.167 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:41.167 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:06:41.167 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:06:41.167 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:41.167 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 1435 2024-04-18T21:06:41.167 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.167 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:41.167 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.167 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:41.167 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:41.032286+0000", 2024-04-18T21:06:41.167 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:41.167 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.168 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.168 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:41.168 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:41.032286+0000", 2024-04-18T21:06:41.168 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:41.168 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.168 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.168 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:41.168 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:41.032287+0000", 2024-04-18T21:06:41.168 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1900000000000001e-07 2024-04-18T21:06:41.168 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.168 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.168 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:41.168 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:41.032293+0000", 2024-04-18T21:06:41.168 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0000000000000002e-06 2024-04-18T21:06:41.168 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.169 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.169 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:41.169 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:41.032305+0000", 2024-04-18T21:06:41.169 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2969999999999999e-05 2024-04-18T21:06:41.169 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.169 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.169 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:41.169 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:41.032313+0000", 2024-04-18T21:06:41.169 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7549999999999994e-06 2024-04-18T21:06:41.169 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.169 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.169 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:41.169 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:41.032362+0000", 2024-04-18T21:06:41.169 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8974999999999998e-05 2024-04-18T21:06:41.169 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.170 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.170 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:41.170 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:41.032454+0000", 2024-04-18T21:06:41.170 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2286000000000004e-05 2024-04-18T21:06:41.170 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.170 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.170 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:41.170 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:41.032567+0000", 2024-04-18T21:06:41.170 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000112475 2024-04-18T21:06:41.170 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.170 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.170 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:41.170 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:41.033815+0000", 2024-04-18T21:06:41.170 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001248019 2024-04-18T21:06:41.170 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.171 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.171 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:41.171 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:41.040137+0000", 2024-04-18T21:06:41.171 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0063217999999999998 2024-04-18T21:06:41.171 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.171 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.171 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:41.171 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:41.040228+0000", 2024-04-18T21:06:41.171 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1686000000000003e-05 2024-04-18T21:06:41.171 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.171 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.171 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:41.171 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:41.040303+0000", 2024-04-18T21:06:41.171 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4241999999999998e-05 2024-04-18T21:06:41.171 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:41.172 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:41.172 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:41.172 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.172 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.172 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:1454 4.37 4:eea33a37:::100000008a0.00000000:head [write 0~2501] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-18T21:06:41.172 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:41.048550+0000", 2024-04-18T21:06:41.172 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.023567285, 2024-04-18T21:06:41.172 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0097979309999999993, 2024-04-18T21:06:41.172 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:41.172 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:41.172 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:41.172 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:06:41.172 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:06:41.172 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:41.172 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 1454 2024-04-18T21:06:41.173 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.173 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:41.173 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.173 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:41.173 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:41.048550+0000", 2024-04-18T21:06:41.173 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:41.173 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.173 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.173 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:41.173 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:41.048550+0000", 2024-04-18T21:06:41.173 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:41.173 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.173 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.173 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:41.173 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:41.048551+0000", 2024-04-18T21:06:41.174 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5239999999999999e-06 2024-04-18T21:06:41.174 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.174 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.174 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:41.174 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:41.048559+0000", 2024-04-18T21:06:41.174 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7999999999999999e-06 2024-04-18T21:06:41.174 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.174 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.174 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:41.174 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:41.048575+0000", 2024-04-18T21:06:41.174 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6056e-05 2024-04-18T21:06:41.174 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.174 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.174 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:41.175 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:41.048584+0000", 2024-04-18T21:06:41.175 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3860000000000007e-06 2024-04-18T21:06:41.175 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.175 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.175 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:41.175 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:41.048702+0000", 2024-04-18T21:06:41.175 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000118903 2024-04-18T21:06:41.175 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.175 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.175 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:41.175 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:41.048896+0000", 2024-04-18T21:06:41.175 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000193687 2024-04-18T21:06:41.175 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.175 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.175 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:41.175 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:41.049157+0000", 2024-04-18T21:06:41.176 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026092299999999998 2024-04-18T21:06:41.176 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.176 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.176 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:41.176 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:41.050195+0000", 2024-04-18T21:06:41.176 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010375930000000001 2024-04-18T21:06:41.176 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.176 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.176 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:41.176 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:41.058231+0000", 2024-04-18T21:06:41.176 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0080363819999999999 2024-04-18T21:06:41.176 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.176 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.176 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:41.176 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:41.058295+0000", 2024-04-18T21:06:41.177 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4173999999999999e-05 2024-04-18T21:06:41.177 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:41.177 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:41.177 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:41.177 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:41.058348+0000", 2024-04-18T21:06:41.177 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2503000000000002e-05 2024-04-18T21:06:41.177 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:41.177 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:41.177 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:41.177 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:41.177 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:41.177 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:41.179 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:41.179 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:41.178+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:41.279 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:41.278+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:41.320 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:41.320 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [ 2024-04-18T21:06:41.320 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.320 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:1739 4.29 4:95d2b609:::100000009cc.00000000:head [write 0~1803 in=1803b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-18T21:06:41.320 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:41.321543+0000", 2024-04-18T21:06:41.320 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.0016683869999999999, 2024-04-18T21:06:41.320 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0017158399999999999, 2024-04-18T21:06:41.320 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:41.321 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:41.321 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:06:41.321 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:41.321 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:06:41.321 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:41.321 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 1739 2024-04-18T21:06:41.321 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.321 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:41.321 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.321 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:41.321 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:41.321543+0000", 2024-04-18T21:06:41.321 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:41.321 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.321 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.322 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:41.322 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:41.321543+0000", 2024-04-18T21:06:41.322 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:41.322 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.322 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.322 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:41.322 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:41.321544+0000", 2024-04-18T21:06:41.322 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3600000000000003e-07 2024-04-18T21:06:41.322 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.322 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.322 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:41.322 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:41.321549+0000", 2024-04-18T21:06:41.322 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.5140000000000003e-06 2024-04-18T21:06:41.322 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.323 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.323 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:41.323 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:41.321558+0000", 2024-04-18T21:06:41.323 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.8260000000000005e-06 2024-04-18T21:06:41.323 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.323 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.323 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:41.323 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:41.321564+0000", 2024-04-18T21:06:41.323 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5779999999999998e-06 2024-04-18T21:06:41.323 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.323 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.323 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:41.323 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:41.321611+0000", 2024-04-18T21:06:41.323 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.6777999999999998e-05 2024-04-18T21:06:41.324 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.324 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.324 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:41.324 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:41.321765+0000", 2024-04-18T21:06:41.324 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00015378000000000001 2024-04-18T21:06:41.324 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.324 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.324 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:41.324 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:41.321942+0000", 2024-04-18T21:06:41.324 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017718700000000001 2024-04-18T21:06:41.324 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.324 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.324 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:41.324 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:41.322658+0000", 2024-04-18T21:06:41.325 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00071582099999999995 2024-04-18T21:06:41.325 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:41.325 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:41.325 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:41.325 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.325 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.325 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_repop_reply(client.4534.0:1739 4.29 e50/32)", 2024-04-18T21:06:41.325 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:41.323310+0000", 2024-04-18T21:06:41.325 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 4294967295.9999013, 2024-04-18T21:06:41.325 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4025999999999998e-05, 2024-04-18T21:06:41.325 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:41.325 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:41.325 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "queued for pg", 2024-04-18T21:06:41.325 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:41.325 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.326 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:41.326 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:41.323310+0000", 2024-04-18T21:06:41.326 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:41.326 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.326 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.326 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:41.326 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:41.323310+0000", 2024-04-18T21:06:41.326 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:41.326 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.326 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.326 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:41.326 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:41.323312+0000", 2024-04-18T21:06:41.326 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.243e-06 2024-04-18T21:06:41.326 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.327 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.327 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:41.327 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:41.323320+0000", 2024-04-18T21:06:41.327 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.3340000000000002e-06 2024-04-18T21:06:41.327 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.327 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.327 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:41.327 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:41.323339+0000", 2024-04-18T21:06:41.327 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.912e-05 2024-04-18T21:06:41.327 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.327 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.327 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:41.327 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:41.323354+0000", 2024-04-18T21:06:41.327 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5179e-05 2024-04-18T21:06:41.327 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:41.328 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:41.328 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:41.328 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:41.328 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2024-04-18T21:06:41.328 INFO:teuthology.orchestra.run.smithi132.stdout: "num_ops": 2 2024-04-18T21:06:41.328 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:41.337 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:41.379 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:41.379+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:41.480 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:41.478+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:41.510 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:41.510 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:06:41.511 INFO:teuthology.orchestra.run.smithi132.stdout: "complaint_time": 30, 2024-04-18T21:06:41.511 INFO:teuthology.orchestra.run.smithi132.stdout: "num_blocked_ops": 0 2024-04-18T21:06:41.511 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:41.526 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:41.615 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:41.614+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:41.683 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:41.683+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:41.697 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:41.697 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 20, 2024-04-18T21:06:41.697 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 600, 2024-04-18T21:06:41.697 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [ 2024-04-18T21:06:41.697 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.697 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:41.697 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:06:41.698 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 106.786773176, 2024-04-18T21:06:41.698 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.02518273, 2024-04-18T21:06:41.698 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:41.698 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:41.698 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:41.698 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:41.698 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:41.698 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:41.698 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 141 2024-04-18T21:06:41.698 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.698 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:41.698 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.698 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:41.698 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:06:41.699 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:41.699 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.699 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.699 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:41.699 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:06:41.699 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:41.699 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.699 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.699 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:41.699 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911562+0000", 2024-04-18T21:06:41.699 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9300000000000006e-07 2024-04-18T21:06:41.699 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.699 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.699 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:41.700 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911569+0000", 2024-04-18T21:06:41.700 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0169999999999999e-06 2024-04-18T21:06:41.700 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.700 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.700 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:41.700 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911582+0000", 2024-04-18T21:06:41.700 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.343e-05 2024-04-18T21:06:41.700 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.700 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.700 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:41.700 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911590+0000", 2024-04-18T21:06:41.700 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.413e-06 2024-04-18T21:06:41.700 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.700 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.700 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:41.701 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.933922+0000", 2024-04-18T21:06:41.701 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.022332093000000001 2024-04-18T21:06:41.701 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.701 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.701 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:41.701 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.934155+0000", 2024-04-18T21:06:41.701 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023378900000000001 2024-04-18T21:06:41.701 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.701 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.701 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:41.701 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.934514+0000", 2024-04-18T21:06:41.701 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00035859200000000003 2024-04-18T21:06:41.701 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.701 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.702 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:41.702 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.935973+0000", 2024-04-18T21:06:41.702 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001458705 2024-04-18T21:06:41.702 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.702 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.702 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:41.702 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936488+0000", 2024-04-18T21:06:41.702 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00051550000000000001 2024-04-18T21:06:41.702 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.702 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.702 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:41.702 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936636+0000", 2024-04-18T21:06:41.702 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014779800000000001 2024-04-18T21:06:41.702 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.703 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.703 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:41.703 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936743+0000", 2024-04-18T21:06:41.703 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010739999999999999 2024-04-18T21:06:41.703 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:41.703 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:41.703 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:41.703 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.703 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.703 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:41.703 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:41.703 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 106.66957420200001, 2024-04-18T21:06:41.703 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023654959999999999, 2024-04-18T21:06:41.703 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:41.704 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:41.704 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:41.704 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:41.704 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:41.704 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:41.704 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 163 2024-04-18T21:06:41.704 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.704 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:41.704 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.704 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:41.704 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:41.704 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:41.704 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.704 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.704 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:41.705 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:41.705 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:41.705 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.705 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.705 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:41.705 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:41.705 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0999999999999998e-07 2024-04-18T21:06:41.705 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.705 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.705 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:41.705 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028766+0000", 2024-04-18T21:06:41.705 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4700000000000001e-06 2024-04-18T21:06:41.705 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.705 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.706 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:41.706 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028775+0000", 2024-04-18T21:06:41.706 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.3190000000000001e-06 2024-04-18T21:06:41.706 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.706 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.706 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:41.706 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028782+0000", 2024-04-18T21:06:41.706 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.2300000000000002e-06 2024-04-18T21:06:41.706 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.706 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.706 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:41.706 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046667+0000", 2024-04-18T21:06:41.706 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017884356000000001 2024-04-18T21:06:41.706 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.707 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.707 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:41.707 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046788+0000", 2024-04-18T21:06:41.707 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012125000000000001 2024-04-18T21:06:41.707 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.707 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.707 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:41.707 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046982+0000", 2024-04-18T21:06:41.707 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019394 2024-04-18T21:06:41.707 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.707 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.707 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:41.707 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051969+0000", 2024-04-18T21:06:41.707 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0049868150000000003 2024-04-18T21:06:41.708 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.708 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.708 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:41.708 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052089+0000", 2024-04-18T21:06:41.708 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011993 2024-04-18T21:06:41.708 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.708 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.708 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:41.708 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052292+0000", 2024-04-18T21:06:41.708 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020345699999999999 2024-04-18T21:06:41.708 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.708 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.708 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:41.708 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052415+0000", 2024-04-18T21:06:41.709 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000122483 2024-04-18T21:06:41.709 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:41.709 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:41.709 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:41.709 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.709 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.709 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:41.709 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:41.709 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 106.66953997, 2024-04-18T21:06:41.709 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023864586, 2024-04-18T21:06:41.709 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:41.709 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:41.709 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:41.709 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:41.709 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:41.710 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:41.710 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 164 2024-04-18T21:06:41.710 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.710 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:41.710 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.710 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:41.710 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:41.710 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:41.710 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.710 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.710 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:41.710 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:41.710 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:41.710 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.711 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.711 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:41.711 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028795+0000", 2024-04-18T21:06:41.711 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7999999999999995e-07 2024-04-18T21:06:41.711 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.711 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.711 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:41.711 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028884+0000", 2024-04-18T21:06:41.711 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8997000000000002e-05 2024-04-18T21:06:41.711 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.711 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.711 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:41.711 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028895+0000", 2024-04-18T21:06:41.711 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1647e-05 2024-04-18T21:06:41.712 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.712 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.712 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:41.712 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028903+0000", 2024-04-18T21:06:41.712 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.909e-06 2024-04-18T21:06:41.712 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.712 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.712 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:41.712 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.047818+0000", 2024-04-18T21:06:41.712 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018914337 2024-04-18T21:06:41.712 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.712 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.712 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:41.712 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.048094+0000", 2024-04-18T21:06:41.712 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00027653500000000001 2024-04-18T21:06:41.713 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.713 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.713 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:41.713 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.048471+0000", 2024-04-18T21:06:41.713 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00037705799999999999 2024-04-18T21:06:41.713 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.713 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.713 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:41.713 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052516+0000", 2024-04-18T21:06:41.713 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0040452739999999997 2024-04-18T21:06:41.713 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.713 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.713 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:41.713 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052535+0000", 2024-04-18T21:06:41.713 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.84e-05 2024-04-18T21:06:41.714 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.714 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.714 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:41.714 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052603+0000", 2024-04-18T21:06:41.714 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.8095000000000004e-05 2024-04-18T21:06:41.714 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.714 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.714 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:41.714 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052659+0000", 2024-04-18T21:06:41.714 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5653999999999999e-05 2024-04-18T21:06:41.714 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:41.714 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:41.714 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:41.714 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.715 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.715 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:41.715 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:41.715 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 106.669416527, 2024-04-18T21:06:41.715 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024516458000000001, 2024-04-18T21:06:41.715 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:41.715 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:41.715 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:41.715 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:41.715 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:41.715 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:41.715 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 165 2024-04-18T21:06:41.715 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.715 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:41.716 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.716 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:41.716 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:41.716 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:41.716 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.716 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.716 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:41.716 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:41.716 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:41.716 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.716 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.716 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:41.716 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028918+0000", 2024-04-18T21:06:41.716 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8000000000000005e-07 2024-04-18T21:06:41.717 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.717 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.717 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:41.717 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028924+0000", 2024-04-18T21:06:41.717 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5659999999999997e-06 2024-04-18T21:06:41.717 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.717 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.717 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:41.717 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028933+0000", 2024-04-18T21:06:41.717 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.38e-06 2024-04-18T21:06:41.717 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.717 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.717 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:41.717 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028940+0000", 2024-04-18T21:06:41.717 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0060000000000003e-06 2024-04-18T21:06:41.718 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.718 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.718 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:41.718 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.050846+0000", 2024-04-18T21:06:41.718 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021906119000000002 2024-04-18T21:06:41.718 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.718 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.718 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:41.718 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051025+0000", 2024-04-18T21:06:41.718 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017850799999999999 2024-04-18T21:06:41.718 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.718 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.718 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:41.718 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051221+0000", 2024-04-18T21:06:41.719 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019608700000000001 2024-04-18T21:06:41.719 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.719 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.719 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:41.719 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052675+0000", 2024-04-18T21:06:41.719 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0014537899999999999 2024-04-18T21:06:41.719 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.719 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.719 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:41.719 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053311+0000", 2024-04-18T21:06:41.719 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00063613299999999999 2024-04-18T21:06:41.719 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.719 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.719 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:41.720 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053381+0000", 2024-04-18T21:06:41.720 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0074999999999996e-05 2024-04-18T21:06:41.720 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.720 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.720 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:41.720 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053434+0000", 2024-04-18T21:06:41.720 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3013999999999998e-05 2024-04-18T21:06:41.720 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:41.720 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:41.720 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:41.720 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.720 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.720 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:41.720 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:41.721 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 106.55611104800001, 2024-04-18T21:06:41.721 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023772793, 2024-04-18T21:06:41.721 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:41.721 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:41.721 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:41.721 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:41.721 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:41.721 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:41.721 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 187 2024-04-18T21:06:41.721 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.721 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:41.721 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.721 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:41.721 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:41.721 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:41.722 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.722 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.722 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:41.722 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:41.722 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:41.722 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.722 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.722 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:41.722 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142224+0000", 2024-04-18T21:06:41.722 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.47e-07 2024-04-18T21:06:41.722 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.722 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.722 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:41.722 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142233+0000", 2024-04-18T21:06:41.723 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0729999999999994e-06 2024-04-18T21:06:41.723 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.723 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.723 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:41.723 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142255+0000", 2024-04-18T21:06:41.723 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.2535999999999999e-05 2024-04-18T21:06:41.723 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.723 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.723 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:41.723 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142268+0000", 2024-04-18T21:06:41.723 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2686e-05 2024-04-18T21:06:41.723 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.723 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.723 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:41.724 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160497+0000", 2024-04-18T21:06:41.724 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018228779000000001 2024-04-18T21:06:41.724 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.724 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.724 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:41.724 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160634+0000", 2024-04-18T21:06:41.724 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000137315 2024-04-18T21:06:41.724 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.724 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.724 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:41.724 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160831+0000", 2024-04-18T21:06:41.724 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019683100000000001 2024-04-18T21:06:41.724 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.725 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.725 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:41.725 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165129+0000", 2024-04-18T21:06:41.725 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0042981299999999998 2024-04-18T21:06:41.725 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.725 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.725 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:41.725 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165776+0000", 2024-04-18T21:06:41.725 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00064702900000000003 2024-04-18T21:06:41.725 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.725 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.725 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:41.725 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165921+0000", 2024-04-18T21:06:41.725 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014506 2024-04-18T21:06:41.725 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.726 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.726 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:41.726 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165996+0000", 2024-04-18T21:06:41.726 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.4406999999999994e-05 2024-04-18T21:06:41.726 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:41.726 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:41.726 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:41.726 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.726 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.726 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:41.726 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:41.726 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 106.55605045, 2024-04-18T21:06:41.726 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026802157, 2024-04-18T21:06:41.726 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:41.727 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:41.727 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:41.727 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:41.727 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:41.727 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:41.727 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 188 2024-04-18T21:06:41.727 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.727 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:41.727 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.727 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:41.727 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:41.727 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:41.727 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.727 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.728 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:41.728 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:41.728 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:41.728 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.728 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.728 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:41.728 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142284+0000", 2024-04-18T21:06:41.728 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4e-07 2024-04-18T21:06:41.728 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.728 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.728 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:41.728 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142374+0000", 2024-04-18T21:06:41.728 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0099999999999995e-05 2024-04-18T21:06:41.728 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.729 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.729 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:41.729 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142386+0000", 2024-04-18T21:06:41.729 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1770000000000001e-05 2024-04-18T21:06:41.729 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.729 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.729 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:41.729 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142394+0000", 2024-04-18T21:06:41.729 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.2130000000000008e-06 2024-04-18T21:06:41.729 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.729 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.729 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:41.729 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.161743+0000", 2024-04-18T21:06:41.729 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019348644000000002 2024-04-18T21:06:41.729 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.730 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.730 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:41.730 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.161865+0000", 2024-04-18T21:06:41.730 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012210899999999999 2024-04-18T21:06:41.730 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.730 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.730 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:41.730 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.162055+0000", 2024-04-18T21:06:41.730 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000189994 2024-04-18T21:06:41.730 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.730 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.730 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:41.730 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165735+0000", 2024-04-18T21:06:41.730 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0036803270000000002 2024-04-18T21:06:41.731 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.731 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.731 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:41.731 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.168911+0000", 2024-04-18T21:06:41.731 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0031753689999999999 2024-04-18T21:06:41.731 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.731 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.731 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:41.731 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169012+0000", 2024-04-18T21:06:41.731 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010157699999999999 2024-04-18T21:06:41.731 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.731 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.731 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:41.731 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169086+0000", 2024-04-18T21:06:41.731 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3213999999999994e-05 2024-04-18T21:06:41.732 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:41.732 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:41.732 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:41.732 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.732 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.732 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:41.732 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:41.732 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 106.555925144, 2024-04-18T21:06:41.732 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026811423000000001, 2024-04-18T21:06:41.732 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:41.732 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:41.732 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:41.732 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:41.732 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:41.733 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:41.733 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 189 2024-04-18T21:06:41.733 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.733 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:41.733 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.733 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:41.733 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:41.733 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:41.733 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.733 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.733 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:41.733 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:41.733 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:41.733 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.734 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.734 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:41.734 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142410+0000", 2024-04-18T21:06:41.734 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:06:41.734 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.734 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.734 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:41.734 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142415+0000", 2024-04-18T21:06:41.734 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.7939999999999999e-06 2024-04-18T21:06:41.734 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.734 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.734 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:41.734 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142470+0000", 2024-04-18T21:06:41.734 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4537999999999999e-05 2024-04-18T21:06:41.735 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.735 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.735 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:41.735 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142481+0000", 2024-04-18T21:06:41.735 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0966e-05 2024-04-18T21:06:41.735 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.735 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.735 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:41.735 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.163493+0000", 2024-04-18T21:06:41.735 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021012444000000002 2024-04-18T21:06:41.735 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.735 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.735 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:41.735 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.163727+0000", 2024-04-18T21:06:41.735 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000233339 2024-04-18T21:06:41.736 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.736 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.736 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:41.736 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.164102+0000", 2024-04-18T21:06:41.736 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000374872 2024-04-18T21:06:41.736 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.736 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.736 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:41.736 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.166528+0000", 2024-04-18T21:06:41.736 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0024258729999999998 2024-04-18T21:06:41.736 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.736 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.736 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:41.736 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169101+0000", 2024-04-18T21:06:41.736 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0025737680000000001 2024-04-18T21:06:41.737 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.737 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.737 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:41.737 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169171+0000", 2024-04-18T21:06:41.737 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0148000000000007e-05 2024-04-18T21:06:41.737 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.737 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.737 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:41.737 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169220+0000", 2024-04-18T21:06:41.737 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8767999999999998e-05 2024-04-18T21:06:41.737 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:41.737 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:41.737 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:41.737 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.738 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.738 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:41.738 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:41.738 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 96.082352592000007, 2024-04-18T21:06:41.738 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024082777999999999, 2024-04-18T21:06:41.738 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:41.738 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:41.738 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:41.738 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:41.738 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.738 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:41.738 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:41.738 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:41.738 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.739 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.739 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:41.739 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:41.739 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:41.739 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.739 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.739 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:41.739 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615984+0000", 2024-04-18T21:06:41.739 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.9869999999999999e-06 2024-04-18T21:06:41.739 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.739 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.739 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:41.739 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615999+0000", 2024-04-18T21:06:41.739 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4646e-05 2024-04-18T21:06:41.739 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.740 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.740 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:41.740 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616028+0000", 2024-04-18T21:06:41.740 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8952999999999999e-05 2024-04-18T21:06:41.740 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.740 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.740 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:41.740 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616052+0000", 2024-04-18T21:06:41.740 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.3941999999999999e-05 2024-04-18T21:06:41.740 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.740 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.740 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:41.740 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618010+0000", 2024-04-18T21:06:41.740 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0019581780000000001 2024-04-18T21:06:41.741 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.741 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.741 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:41.741 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618322+0000", 2024-04-18T21:06:41.741 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00031158899999999997 2024-04-18T21:06:41.741 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.741 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.741 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:41.741 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618587+0000", 2024-04-18T21:06:41.741 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00026495700000000002 2024-04-18T21:06:41.741 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.741 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.741 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:41.741 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629262+0000", 2024-04-18T21:06:41.741 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010675877 2024-04-18T21:06:41.742 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.742 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.742 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:41.742 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.639773+0000", 2024-04-18T21:06:41.742 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0105109 2024-04-18T21:06:41.742 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.742 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.742 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:41.742 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.639926+0000", 2024-04-18T21:06:41.742 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000152349 2024-04-18T21:06:41.742 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.742 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.742 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:41.742 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640064+0000", 2024-04-18T21:06:41.742 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0001384 2024-04-18T21:06:41.743 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:41.743 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:41.743 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:41.743 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.743 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.743 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:41.743 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:41.743 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 96.082239917999999, 2024-04-18T21:06:41.743 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030215005999999999, 2024-04-18T21:06:41.743 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:41.743 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:41.743 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:41.743 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:41.743 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.744 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:41.744 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:41.744 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:41.744 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.744 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.744 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:41.744 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:41.744 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:41.744 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.744 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.744 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:41.744 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616095+0000", 2024-04-18T21:06:41.744 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.446e-06 2024-04-18T21:06:41.744 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.744 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.744 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:41.745 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616104+0000", 2024-04-18T21:06:41.745 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6200000000000005e-06 2024-04-18T21:06:41.745 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.745 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.745 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:41.745 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616132+0000", 2024-04-18T21:06:41.745 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7668999999999999e-05 2024-04-18T21:06:41.745 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.745 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.745 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:41.745 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616149+0000", 2024-04-18T21:06:41.745 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7047000000000001e-05 2024-04-18T21:06:41.745 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.746 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.746 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:41.746 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619287+0000", 2024-04-18T21:06:41.746 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0031381450000000002 2024-04-18T21:06:41.746 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.746 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.746 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:41.746 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619503+0000", 2024-04-18T21:06:41.746 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000216522 2024-04-18T21:06:41.746 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.746 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.746 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:41.746 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619930+0000", 2024-04-18T21:06:41.746 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00042604900000000001 2024-04-18T21:06:41.747 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.747 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.747 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:41.747 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629281+0000", 2024-04-18T21:06:41.747 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0093512230000000005 2024-04-18T21:06:41.747 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.747 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.747 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:41.747 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646022+0000", 2024-04-18T21:06:41.747 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016741156 2024-04-18T21:06:41.747 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.747 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.747 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:41.747 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646198+0000", 2024-04-18T21:06:41.748 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000176009 2024-04-18T21:06:41.748 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.748 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.748 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:41.748 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646309+0000", 2024-04-18T21:06:41.748 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011112000000000001 2024-04-18T21:06:41.748 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:41.748 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:41.748 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:41.748 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.748 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.748 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:41.748 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:41.748 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 96.082155094000001, 2024-04-18T21:06:41.749 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030501176000000001, 2024-04-18T21:06:41.749 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:41.749 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:41.749 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:41.749 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:41.749 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.749 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:41.749 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:41.749 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:41.749 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.749 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.749 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:41.749 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:41.750 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:41.750 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.750 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.750 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:41.750 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616180+0000", 2024-04-18T21:06:41.750 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1000000000000001e-06 2024-04-18T21:06:41.750 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.750 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.750 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:41.750 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616188+0000", 2024-04-18T21:06:41.750 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4069999999999993e-06 2024-04-18T21:06:41.750 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.750 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.750 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:41.751 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616207+0000", 2024-04-18T21:06:41.751 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8335999999999999e-05 2024-04-18T21:06:41.751 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.751 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.751 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:41.751 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616225+0000", 2024-04-18T21:06:41.751 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8652999999999999e-05 2024-04-18T21:06:41.751 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.751 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.751 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:41.751 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620977+0000", 2024-04-18T21:06:41.751 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047512220000000003 2024-04-18T21:06:41.751 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.751 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.752 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:41.752 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621279+0000", 2024-04-18T21:06:41.752 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000302646 2024-04-18T21:06:41.752 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.752 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.752 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:41.752 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621584+0000", 2024-04-18T21:06:41.752 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000305142 2024-04-18T21:06:41.752 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.752 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.752 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:41.752 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629352+0000", 2024-04-18T21:06:41.752 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0077673689999999997 2024-04-18T21:06:41.752 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.753 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.753 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:41.753 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646480+0000", 2024-04-18T21:06:41.753 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017128259 2024-04-18T21:06:41.753 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.753 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.753 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:41.753 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646591+0000", 2024-04-18T21:06:41.753 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011113899999999999 2024-04-18T21:06:41.753 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.753 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.753 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:41.753 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646680+0000", 2024-04-18T21:06:41.753 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8902999999999999e-05 2024-04-18T21:06:41.754 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:41.754 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:41.754 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:41.754 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.754 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.754 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:41.754 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:41.754 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 96.082088595000002, 2024-04-18T21:06:41.754 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030779760999999999, 2024-04-18T21:06:41.754 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:41.754 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:41.754 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:41.754 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:41.754 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.755 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:41.755 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:41.755 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:41.755 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.755 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.755 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:41.755 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:41.755 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:41.755 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.755 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.755 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:41.755 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616246+0000", 2024-04-18T21:06:41.755 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0499999999999999e-06 2024-04-18T21:06:41.755 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.756 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.756 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:41.756 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616253+0000", 2024-04-18T21:06:41.756 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.5989999999999998e-06 2024-04-18T21:06:41.756 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.756 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.756 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:41.756 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616273+0000", 2024-04-18T21:06:41.756 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9916999999999999e-05 2024-04-18T21:06:41.756 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.756 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.756 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:41.756 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616287+0000", 2024-04-18T21:06:41.757 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3669000000000001e-05 2024-04-18T21:06:41.757 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.757 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.757 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:41.757 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622203+0000", 2024-04-18T21:06:41.757 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.005916737 2024-04-18T21:06:41.757 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.757 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.757 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:41.757 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622379+0000", 2024-04-18T21:06:41.757 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000175596 2024-04-18T21:06:41.757 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.757 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.757 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:41.757 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622707+0000", 2024-04-18T21:06:41.758 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00032784600000000002 2024-04-18T21:06:41.758 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.758 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.758 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:41.758 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629366+0000", 2024-04-18T21:06:41.758 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0066593279999999999 2024-04-18T21:06:41.758 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.758 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.758 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:41.758 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646813+0000", 2024-04-18T21:06:41.758 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017447059000000001 2024-04-18T21:06:41.758 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.758 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.759 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:41.759 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646946+0000", 2024-04-18T21:06:41.759 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013301200000000001 2024-04-18T21:06:41.759 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.759 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.759 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:41.759 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647025+0000", 2024-04-18T21:06:41.759 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8948000000000004e-05 2024-04-18T21:06:41.759 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:41.759 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:41.759 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:41.759 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.759 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.759 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:41.759 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:41.760 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 96.082004776999995, 2024-04-18T21:06:41.760 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.031512165000000002, 2024-04-18T21:06:41.760 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:41.760 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:41.760 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:41.760 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:41.760 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.760 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:41.760 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:41.760 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:41.760 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.760 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.760 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:41.760 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:41.760 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:41.761 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.761 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.761 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:41.761 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616330+0000", 2024-04-18T21:06:41.761 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.15e-06 2024-04-18T21:06:41.761 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.761 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.761 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:41.761 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616337+0000", 2024-04-18T21:06:41.761 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.1289999999999998e-06 2024-04-18T21:06:41.761 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.761 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.761 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:41.761 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616447+0000", 2024-04-18T21:06:41.761 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109561 2024-04-18T21:06:41.762 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.762 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.762 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:41.762 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616496+0000", 2024-04-18T21:06:41.762 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8591999999999998e-05 2024-04-18T21:06:41.762 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.762 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.762 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:41.762 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.623786+0000", 2024-04-18T21:06:41.762 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0072906799999999999 2024-04-18T21:06:41.762 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.762 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.762 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:41.762 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.623973+0000", 2024-04-18T21:06:41.763 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018717199999999999 2024-04-18T21:06:41.763 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.763 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.763 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:41.763 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624260+0000", 2024-04-18T21:06:41.763 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00028630600000000001 2024-04-18T21:06:41.763 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.763 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.763 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:41.763 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629381+0000", 2024-04-18T21:06:41.763 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0051211340000000003 2024-04-18T21:06:41.763 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.763 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.763 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:41.763 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647631+0000", 2024-04-18T21:06:41.764 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018249771000000001 2024-04-18T21:06:41.764 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.764 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.764 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:41.764 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647761+0000", 2024-04-18T21:06:41.764 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013037300000000001 2024-04-18T21:06:41.764 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.764 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.764 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:41.764 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647841+0000", 2024-04-18T21:06:41.764 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.0296999999999994e-05 2024-04-18T21:06:41.764 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:41.764 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:41.764 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:41.764 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.765 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.765 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:41.765 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:41.765 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 96.081799293000003, 2024-04-18T21:06:41.765 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043251955000000002, 2024-04-18T21:06:41.765 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:41.765 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:41.765 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:41.765 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:41.765 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.765 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:41.765 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:41.765 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:41.765 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.766 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.766 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:41.766 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:41.766 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:41.766 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.766 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.766 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:41.766 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616536+0000", 2024-04-18T21:06:41.766 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2869999999999999e-06 2024-04-18T21:06:41.766 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.766 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.766 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:41.766 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616572+0000", 2024-04-18T21:06:41.767 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.6261999999999999e-05 2024-04-18T21:06:41.767 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.767 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.767 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:41.767 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616593+0000", 2024-04-18T21:06:41.767 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1310000000000001e-05 2024-04-18T21:06:41.767 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.767 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.767 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:41.767 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616614+0000", 2024-04-18T21:06:41.767 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.0936000000000001e-05 2024-04-18T21:06:41.767 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.767 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.767 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:41.768 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629501+0000", 2024-04-18T21:06:41.768 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.012886819000000001 2024-04-18T21:06:41.768 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.768 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.768 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:41.768 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629696+0000", 2024-04-18T21:06:41.768 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019485499999999999 2024-04-18T21:06:41.768 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.768 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.768 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:41.768 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629940+0000", 2024-04-18T21:06:41.768 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00024386399999999999 2024-04-18T21:06:41.768 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.768 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.769 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:41.769 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640100+0000", 2024-04-18T21:06:41.769 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010159645 2024-04-18T21:06:41.769 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.769 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.769 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:41.769 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659516+0000", 2024-04-18T21:06:41.769 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019416563000000001 2024-04-18T21:06:41.769 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.769 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.769 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:41.769 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659684+0000", 2024-04-18T21:06:41.769 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016750900000000001 2024-04-18T21:06:41.769 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.770 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.770 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:41.770 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659787+0000", 2024-04-18T21:06:41.770 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000102905 2024-04-18T21:06:41.770 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:41.770 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:41.770 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:41.770 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.770 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.770 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:41.770 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:41.770 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 96.081694170999995, 2024-04-18T21:06:41.770 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043581898000000001, 2024-04-18T21:06:41.770 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:41.770 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:41.771 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:41.771 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:41.771 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.771 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:41.771 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:41.771 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:41.771 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.771 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.771 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:41.771 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:41.771 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:41.771 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.771 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.772 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:41.772 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616641+0000", 2024-04-18T21:06:41.772 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:06:41.772 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.772 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.772 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:41.772 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616648+0000", 2024-04-18T21:06:41.772 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3860000000000001e-06 2024-04-18T21:06:41.772 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.772 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.772 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:41.772 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616666+0000", 2024-04-18T21:06:41.772 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7583000000000001e-05 2024-04-18T21:06:41.772 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.772 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.773 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:41.773 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616679+0000", 2024-04-18T21:06:41.773 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3322999999999999e-05 2024-04-18T21:06:41.773 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.773 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.773 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:41.773 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630373+0000", 2024-04-18T21:06:41.773 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013694207999999999 2024-04-18T21:06:41.773 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.773 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.773 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:41.773 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630545+0000", 2024-04-18T21:06:41.773 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000171683 2024-04-18T21:06:41.773 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.773 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.774 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:41.774 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630728+0000", 2024-04-18T21:06:41.774 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000182599 2024-04-18T21:06:41.774 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.774 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.774 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:41.774 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640600+0000", 2024-04-18T21:06:41.774 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0098726119999999994 2024-04-18T21:06:41.774 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.774 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.774 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:41.774 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659927+0000", 2024-04-18T21:06:41.774 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019326724999999999 2024-04-18T21:06:41.774 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.775 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.775 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:41.775 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660112+0000", 2024-04-18T21:06:41.775 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000185203 2024-04-18T21:06:41.775 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.775 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.775 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:41.775 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660222+0000", 2024-04-18T21:06:41.775 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109343 2024-04-18T21:06:41.775 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:41.775 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:41.775 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:41.775 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.775 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.775 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:41.776 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:41.776 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 96.080828812999997, 2024-04-18T21:06:41.776 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043121310000000003, 2024-04-18T21:06:41.776 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:41.776 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:41.776 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:41.776 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:41.776 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.776 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:41.776 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:41.776 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:41.776 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.776 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.777 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:41.777 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:41.777 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:41.777 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.777 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.777 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:41.777 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617506+0000", 2024-04-18T21:06:41.777 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9999999999999995e-07 2024-04-18T21:06:41.777 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.777 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.777 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:41.777 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617513+0000", 2024-04-18T21:06:41.777 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.9700000000000002e-06 2024-04-18T21:06:41.778 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.778 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.778 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:41.778 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617531+0000", 2024-04-18T21:06:41.778 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8105999999999999e-05 2024-04-18T21:06:41.778 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.778 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.778 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:41.778 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617545+0000", 2024-04-18T21:06:41.778 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3703000000000001e-05 2024-04-18T21:06:41.778 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.778 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.778 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:41.779 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632129+0000", 2024-04-18T21:06:41.779 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.014584135999999999 2024-04-18T21:06:41.779 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.779 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.779 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:41.779 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632361+0000", 2024-04-18T21:06:41.779 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023171800000000001 2024-04-18T21:06:41.779 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.779 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.779 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:41.779 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632804+0000", 2024-04-18T21:06:41.779 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000443549 2024-04-18T21:06:41.779 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.779 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.780 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:41.780 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646340+0000", 2024-04-18T21:06:41.780 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013535902000000001 2024-04-18T21:06:41.780 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.780 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.780 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:41.780 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660363+0000", 2024-04-18T21:06:41.780 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01402318 2024-04-18T21:06:41.780 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.780 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.780 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:41.780 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660523+0000", 2024-04-18T21:06:41.780 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00015989899999999999 2024-04-18T21:06:41.780 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.780 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.781 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:41.781 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660626+0000", 2024-04-18T21:06:41.781 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010314699999999999 2024-04-18T21:06:41.781 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:41.781 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:41.781 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:41.781 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.781 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.781 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:41.781 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:41.781 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 96.080689120000002, 2024-04-18T21:06:41.781 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024927483, 2024-04-18T21:06:41.781 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:41.781 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:41.781 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:41.782 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:41.782 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.782 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:41.782 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:41.782 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:41.782 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.782 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.782 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:41.782 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:41.782 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:41.782 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.782 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.782 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:41.782 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617646+0000", 2024-04-18T21:06:41.783 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3030000000000001e-06 2024-04-18T21:06:41.783 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.783 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.783 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:41.783 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617653+0000", 2024-04-18T21:06:41.783 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7530000000000004e-06 2024-04-18T21:06:41.783 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.783 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.783 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:41.783 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617673+0000", 2024-04-18T21:06:41.783 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9967e-05 2024-04-18T21:06:41.783 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.783 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.783 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:41.784 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617688+0000", 2024-04-18T21:06:41.784 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5153e-05 2024-04-18T21:06:41.784 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.784 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.784 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:41.784 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619244+0000", 2024-04-18T21:06:41.784 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001555531 2024-04-18T21:06:41.784 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.784 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.784 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:41.784 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619361+0000", 2024-04-18T21:06:41.784 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011784400000000001 2024-04-18T21:06:41.784 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.785 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.785 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:41.785 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619604+0000", 2024-04-18T21:06:41.785 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000243007 2024-04-18T21:06:41.785 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.785 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.785 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:41.785 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.625480+0000", 2024-04-18T21:06:41.785 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0058759349999999997 2024-04-18T21:06:41.785 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.785 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.785 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:41.785 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642342+0000", 2024-04-18T21:06:41.785 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016861373999999998 2024-04-18T21:06:41.786 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.786 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.786 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:41.786 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642484+0000", 2024-04-18T21:06:41.786 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000142423 2024-04-18T21:06:41.786 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.786 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.786 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:41.786 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642572+0000", 2024-04-18T21:06:41.786 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8193000000000001e-05 2024-04-18T21:06:41.786 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:41.786 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:41.786 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:41.786 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.787 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.787 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:41.787 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:41.787 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 96.080407617000006, 2024-04-18T21:06:41.787 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024956974999999999, 2024-04-18T21:06:41.787 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:41.787 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:41.787 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:41.787 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:41.787 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.787 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:41.787 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:41.787 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:41.787 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.788 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.788 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:41.788 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:41.788 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:41.788 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.788 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.788 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:41.788 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617928+0000", 2024-04-18T21:06:41.788 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5430000000000001e-06 2024-04-18T21:06:41.788 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.788 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.788 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:41.788 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617937+0000", 2024-04-18T21:06:41.788 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6629999999999999e-06 2024-04-18T21:06:41.789 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.789 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.789 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:41.789 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617955+0000", 2024-04-18T21:06:41.789 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8749999999999998e-05 2024-04-18T21:06:41.789 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.789 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.789 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:41.789 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617971+0000", 2024-04-18T21:06:41.789 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.605e-05 2024-04-18T21:06:41.789 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.789 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.789 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:41.789 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621019+0000", 2024-04-18T21:06:41.790 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0030472369999999999 2024-04-18T21:06:41.790 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.790 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.790 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:41.790 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621249+0000", 2024-04-18T21:06:41.790 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000230075 2024-04-18T21:06:41.790 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.790 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.790 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:41.790 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621450+0000", 2024-04-18T21:06:41.790 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020166499999999999 2024-04-18T21:06:41.790 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.790 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.791 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:41.791 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.626233+0000", 2024-04-18T21:06:41.791 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047827390000000003 2024-04-18T21:06:41.791 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.791 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.791 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:41.791 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642693+0000", 2024-04-18T21:06:41.791 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01645961 2024-04-18T21:06:41.791 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.791 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.791 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:41.791 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642798+0000", 2024-04-18T21:06:41.791 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010559499999999999 2024-04-18T21:06:41.791 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.792 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.792 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:41.792 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642883+0000", 2024-04-18T21:06:41.792 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5048000000000003e-05 2024-04-18T21:06:41.792 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:41.792 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:41.792 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:41.792 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.792 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.792 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:41.792 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:41.792 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 96.078711988999999, 2024-04-18T21:06:41.792 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024086478000000001, 2024-04-18T21:06:41.792 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:41.793 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:41.793 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:41.793 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:41.793 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.793 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:41.793 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:41.793 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:41.793 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.793 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.793 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:41.793 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:41.793 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:41.793 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.794 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.794 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:41.794 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619624+0000", 2024-04-18T21:06:41.794 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.75e-06 2024-04-18T21:06:41.794 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.794 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.794 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:41.794 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619637+0000", 2024-04-18T21:06:41.794 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3540000000000001e-05 2024-04-18T21:06:41.794 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.794 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.794 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:41.794 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619666+0000", 2024-04-18T21:06:41.794 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8685999999999999e-05 2024-04-18T21:06:41.795 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.795 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.795 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:41.795 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619685+0000", 2024-04-18T21:06:41.795 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8681999999999998e-05 2024-04-18T21:06:41.795 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.795 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.795 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:41.795 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622275+0000", 2024-04-18T21:06:41.795 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0025899260000000002 2024-04-18T21:06:41.795 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.795 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.795 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:41.795 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622572+0000", 2024-04-18T21:06:41.795 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00029722 2024-04-18T21:06:41.796 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.796 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.796 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:41.796 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622752+0000", 2024-04-18T21:06:41.796 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018065900000000001 2024-04-18T21:06:41.796 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.796 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.796 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:41.796 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.626326+0000", 2024-04-18T21:06:41.796 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035737310000000001 2024-04-18T21:06:41.796 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.796 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.796 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:41.796 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643565+0000", 2024-04-18T21:06:41.797 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017238430999999999 2024-04-18T21:06:41.797 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.797 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.797 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:41.797 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643646+0000", 2024-04-18T21:06:41.797 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.1481000000000001e-05 2024-04-18T21:06:41.797 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.797 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.797 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:41.797 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643708+0000", 2024-04-18T21:06:41.797 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.2372000000000005e-05 2024-04-18T21:06:41.797 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:41.797 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:41.797 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:41.798 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.798 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.798 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:41.798 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:41.798 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 96.078545836000004, 2024-04-18T21:06:41.798 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026822450000000001, 2024-04-18T21:06:41.798 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:41.798 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:41.798 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:41.798 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:41.798 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.798 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:41.798 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:41.799 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:41.799 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.799 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.799 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:41.799 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:41.799 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:41.799 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.799 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.799 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:41.799 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619789+0000", 2024-04-18T21:06:41.799 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:06:41.799 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.799 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.799 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:41.799 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619797+0000", 2024-04-18T21:06:41.800 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.6899999999999992e-06 2024-04-18T21:06:41.800 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.800 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.800 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:41.800 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619816+0000", 2024-04-18T21:06:41.800 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9352999999999999e-05 2024-04-18T21:06:41.800 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.800 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.800 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:41.800 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619832+0000", 2024-04-18T21:06:41.800 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6013000000000001e-05 2024-04-18T21:06:41.800 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.800 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.800 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:41.801 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620528+0000", 2024-04-18T21:06:41.801 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00069565600000000001 2024-04-18T21:06:41.801 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.801 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.801 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:41.801 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620735+0000", 2024-04-18T21:06:41.801 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000207025 2024-04-18T21:06:41.801 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.801 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.801 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:41.801 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620912+0000", 2024-04-18T21:06:41.801 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017748199999999999 2024-04-18T21:06:41.801 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.801 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.801 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:41.802 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.625605+0000", 2024-04-18T21:06:41.802 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0046924439999999996 2024-04-18T21:06:41.802 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.802 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.802 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:41.802 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646349+0000", 2024-04-18T21:06:41.802 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.020744318000000001 2024-04-18T21:06:41.802 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.802 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.802 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:41.802 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646483+0000", 2024-04-18T21:06:41.802 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013428999999999999 2024-04-18T21:06:41.802 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.803 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.803 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:41.803 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646611+0000", 2024-04-18T21:06:41.803 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012710299999999999 2024-04-18T21:06:41.803 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:41.803 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:41.803 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:41.803 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.803 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.803 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:41.803 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:06:41.803 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 96.077875402999993, 2024-04-18T21:06:41.803 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023516516000000001, 2024-04-18T21:06:41.803 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:41.804 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:41.804 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:06:41.804 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:41.804 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.804 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:41.804 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:06:41.804 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:41.804 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.804 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.804 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:41.804 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:06:41.804 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:41.804 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.804 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.804 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:41.805 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620460+0000", 2024-04-18T21:06:41.805 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.787e-06 2024-04-18T21:06:41.805 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.805 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.805 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:41.805 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620470+0000", 2024-04-18T21:06:41.805 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.2560000000000008e-06 2024-04-18T21:06:41.805 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.805 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.805 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:41.805 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620496+0000", 2024-04-18T21:06:41.805 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.6205999999999999e-05 2024-04-18T21:06:41.805 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.805 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.805 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:41.806 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620517+0000", 2024-04-18T21:06:41.806 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1223e-05 2024-04-18T21:06:41.806 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.806 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.806 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:41.806 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624060+0000", 2024-04-18T21:06:41.806 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035434160000000002 2024-04-18T21:06:41.806 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.806 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.806 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:41.806 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624390+0000", 2024-04-18T21:06:41.806 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00033000500000000002 2024-04-18T21:06:41.806 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:41.806 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:41.807 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:41.807 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643975+0000", 2024-04-18T21:06:41.807 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019584622999999999 2024-04-18T21:06:41.807 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:41.807 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:41.807 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:41.807 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:41.807 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:41.807 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:41.809 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:41.809 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:41.806+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:41.909 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:41.911+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:41.944 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:06:41.944 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [], 2024-04-18T21:06:41.944 INFO:teuthology.orchestra.run.smithi150.stdout: "num_ops": 0 2024-04-18T21:06:41.944 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:06:41.959 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:42.010 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:42.010+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:42.111 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:42.110+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:42.130 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:06:42.130 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [], 2024-04-18T21:06:42.131 INFO:teuthology.orchestra.run.smithi150.stdout: "complaint_time": 30, 2024-04-18T21:06:42.131 INFO:teuthology.orchestra.run.smithi150.stdout: "num_blocked_ops": 0 2024-04-18T21:06:42.131 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:06:42.146 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:42.175 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:06:42.212 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:42.210+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:42.277 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:06:42.277 INFO:teuthology.orchestra.run.smithi150.stdout: "size": 20, 2024-04-18T21:06:42.277 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 600, 2024-04-18T21:06:42.277 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [ 2024-04-18T21:06:42.277 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.278 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-18T21:06:42.278 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:06:42.278 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 107.472003461, 2024-04-18T21:06:42.278 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0093051590000000003, 2024-04-18T21:06:42.278 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:42.278 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:42.278 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:42.278 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:42.278 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.278 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:42.278 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:06:42.278 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:42.278 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.278 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.279 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:42.279 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:06:42.279 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:42.279 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.279 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.279 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:42.279 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804851+0000", 2024-04-18T21:06:42.279 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7039999999999999e-06 2024-04-18T21:06:42.279 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.279 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.279 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:42.279 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804864+0000", 2024-04-18T21:06:42.279 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.276e-05 2024-04-18T21:06:42.279 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.279 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.280 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:42.280 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804895+0000", 2024-04-18T21:06:42.280 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.1204999999999997e-05 2024-04-18T21:06:42.280 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.280 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.280 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:42.280 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804908+0000", 2024-04-18T21:06:42.280 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3317e-05 2024-04-18T21:06:42.280 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.280 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.280 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:42.280 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805131+0000", 2024-04-18T21:06:42.280 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00022246700000000001 2024-04-18T21:06:42.280 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.280 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.280 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:42.281 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805171+0000", 2024-04-18T21:06:42.281 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.0164999999999999e-05 2024-04-18T21:06:42.281 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.281 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.281 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:42.281 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814086+0000", 2024-04-18T21:06:42.281 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0089155329999999998 2024-04-18T21:06:42.281 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.281 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.281 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:42.281 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814154+0000", 2024-04-18T21:06:42.281 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.8008000000000003e-05 2024-04-18T21:06:42.281 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:42.281 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:42.282 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:42.282 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.282 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.282 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:42.282 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:06:42.282 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 96.661557853999994, 2024-04-18T21:06:42.282 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.040843365, 2024-04-18T21:06:42.282 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:42.282 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:42.282 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:42.282 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:42.282 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.282 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:42.283 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:06:42.283 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:42.283 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.283 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.283 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:42.283 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:06:42.283 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:42.283 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.283 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.283 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:42.283 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615297+0000", 2024-04-18T21:06:42.283 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2800000000000002e-06 2024-04-18T21:06:42.283 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.283 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.283 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:42.283 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615308+0000", 2024-04-18T21:06:42.284 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0813e-05 2024-04-18T21:06:42.284 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.284 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.284 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:42.284 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615330+0000", 2024-04-18T21:06:42.284 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2370000000000001e-05 2024-04-18T21:06:42.284 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.284 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.284 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:42.284 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615346+0000", 2024-04-18T21:06:42.284 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6200000000000001e-05 2024-04-18T21:06:42.284 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.284 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.284 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:42.285 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615470+0000", 2024-04-18T21:06:42.285 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012385799999999999 2024-04-18T21:06:42.285 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.285 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.285 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:42.285 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615488+0000", 2024-04-18T21:06:42.285 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7923000000000001e-05 2024-04-18T21:06:42.285 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.285 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.285 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:42.285 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.630993+0000", 2024-04-18T21:06:42.285 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.01550532 2024-04-18T21:06:42.285 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.285 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.285 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:42.286 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631165+0000", 2024-04-18T21:06:42.286 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000171588 2024-04-18T21:06:42.286 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.286 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.286 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:42.286 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631320+0000", 2024-04-18T21:06:42.286 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000155162 2024-04-18T21:06:42.286 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.286 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.286 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:42.286 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635157+0000", 2024-04-18T21:06:42.286 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0038370790000000002 2024-04-18T21:06:42.286 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.286 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.287 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:42.287 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.655904+0000", 2024-04-18T21:06:42.287 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.020746483999999999 2024-04-18T21:06:42.287 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.287 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.287 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:42.287 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656032+0000", 2024-04-18T21:06:42.287 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012864199999999999 2024-04-18T21:06:42.287 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.287 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.287 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:42.287 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656138+0000", 2024-04-18T21:06:42.287 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000105646 2024-04-18T21:06:42.287 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:42.287 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:42.287 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:42.287 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.288 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.288 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:42.288 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:06:42.288 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 96.661465681999999, 2024-04-18T21:06:42.288 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.041266444999999999, 2024-04-18T21:06:42.288 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:42.288 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:42.288 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:42.288 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:42.288 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.288 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:42.288 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:06:42.288 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:42.288 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.289 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.289 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:42.289 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:06:42.289 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:42.289 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.289 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.289 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:42.289 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615388+0000", 2024-04-18T21:06:42.289 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:06:42.289 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.289 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.289 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:42.289 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:06:42.289 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.7299999999999994e-06 2024-04-18T21:06:42.289 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.290 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.290 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:42.290 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615415+0000", 2024-04-18T21:06:42.290 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7807000000000001e-05 2024-04-18T21:06:42.290 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.290 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.290 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:42.290 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615431+0000", 2024-04-18T21:06:42.290 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6127e-05 2024-04-18T21:06:42.290 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.290 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.290 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:42.290 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615621+0000", 2024-04-18T21:06:42.290 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000189781 2024-04-18T21:06:42.291 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.291 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.291 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:42.291 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615634+0000", 2024-04-18T21:06:42.291 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3383e-05 2024-04-18T21:06:42.291 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.291 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.291 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:42.291 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631703+0000", 2024-04-18T21:06:42.291 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016068737 2024-04-18T21:06:42.291 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.291 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.291 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:42.291 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631809+0000", 2024-04-18T21:06:42.291 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000106823 2024-04-18T21:06:42.292 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.292 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.292 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:42.292 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631988+0000", 2024-04-18T21:06:42.292 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000179008 2024-04-18T21:06:42.292 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.292 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.292 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:42.292 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635172+0000", 2024-04-18T21:06:42.292 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.003183029 2024-04-18T21:06:42.292 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.292 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.292 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:42.292 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656392+0000", 2024-04-18T21:06:42.293 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.021220638999999999 2024-04-18T21:06:42.293 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.293 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.293 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:42.293 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656533+0000", 2024-04-18T21:06:42.293 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014126500000000001 2024-04-18T21:06:42.293 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.293 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.293 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:42.293 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656653+0000", 2024-04-18T21:06:42.293 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000119883 2024-04-18T21:06:42.293 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:42.293 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:42.293 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:42.294 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.294 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.294 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:42.294 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:06:42.294 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 96.661378259000003, 2024-04-18T21:06:42.294 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.042492302000000003, 2024-04-18T21:06:42.294 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:42.294 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:42.294 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:42.294 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:42.294 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.294 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:42.294 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:06:42.294 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:42.295 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.295 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.295 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:42.295 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:06:42.295 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:42.295 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.295 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.295 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:42.295 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615475+0000", 2024-04-18T21:06:42.295 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.17e-06 2024-04-18T21:06:42.295 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.295 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.295 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:42.295 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615528+0000", 2024-04-18T21:06:42.295 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.2159e-05 2024-04-18T21:06:42.295 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.296 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.296 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:42.296 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615542+0000", 2024-04-18T21:06:42.296 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4197e-05 2024-04-18T21:06:42.296 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.296 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.296 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:42.296 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615559+0000", 2024-04-18T21:06:42.296 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.749e-05 2024-04-18T21:06:42.296 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.296 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.296 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:42.296 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615685+0000", 2024-04-18T21:06:42.296 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012617499999999999 2024-04-18T21:06:42.296 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.296 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.297 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:42.297 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:06:42.297 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4749999999999999e-05 2024-04-18T21:06:42.297 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.297 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.297 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:42.297 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632332+0000", 2024-04-18T21:06:42.297 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016631988 2024-04-18T21:06:42.297 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.297 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.297 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:42.297 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632477+0000", 2024-04-18T21:06:42.297 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014437200000000001 2024-04-18T21:06:42.297 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.297 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.297 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:42.298 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632620+0000", 2024-04-18T21:06:42.298 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000143566 2024-04-18T21:06:42.298 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.298 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.298 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:42.298 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635185+0000", 2024-04-18T21:06:42.298 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0025644209999999999 2024-04-18T21:06:42.298 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.298 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.298 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:42.298 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657803+0000", 2024-04-18T21:06:42.298 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.022618743 2024-04-18T21:06:42.298 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.299 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.299 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:42.299 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657890+0000", 2024-04-18T21:06:42.299 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.6688999999999996e-05 2024-04-18T21:06:42.299 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.299 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.299 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:42.299 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657967+0000", 2024-04-18T21:06:42.299 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.6582000000000006e-05 2024-04-18T21:06:42.299 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:42.299 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:42.299 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:42.299 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.299 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.299 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:42.300 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:06:42.300 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 96.661247446999994, 2024-04-18T21:06:42.300 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.043603435000000003, 2024-04-18T21:06:42.300 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:42.300 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:42.300 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:42.300 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:42.300 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.300 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:42.300 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:06:42.300 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:42.300 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.300 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.300 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:42.300 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:06:42.300 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:42.301 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.301 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.301 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:42.301 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615607+0000", 2024-04-18T21:06:42.301 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4300000000000001e-06 2024-04-18T21:06:42.301 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.301 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.301 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:42.301 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615614+0000", 2024-04-18T21:06:42.301 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.4100000000000002e-06 2024-04-18T21:06:42.301 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.301 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.301 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:42.301 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615632+0000", 2024-04-18T21:06:42.302 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7863000000000002e-05 2024-04-18T21:06:42.302 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.302 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.302 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:42.302 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615647+0000", 2024-04-18T21:06:42.302 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5187e-05 2024-04-18T21:06:42.302 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.302 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.302 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:42.302 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615765+0000", 2024-04-18T21:06:42.302 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000117955 2024-04-18T21:06:42.302 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.302 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.302 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:42.303 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615781+0000", 2024-04-18T21:06:42.303 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6123000000000001e-05 2024-04-18T21:06:42.303 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.303 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.303 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:42.303 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633055+0000", 2024-04-18T21:06:42.303 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.017273909 2024-04-18T21:06:42.303 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.303 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.303 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:42.303 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633254+0000", 2024-04-18T21:06:42.303 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00019903799999999999 2024-04-18T21:06:42.303 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.303 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.303 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:42.304 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633624+0000", 2024-04-18T21:06:42.304 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000369656 2024-04-18T21:06:42.304 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.304 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.304 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:42.304 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635595+0000", 2024-04-18T21:06:42.304 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001971287 2024-04-18T21:06:42.304 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.304 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.304 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:42.304 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659026+0000", 2024-04-18T21:06:42.304 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.023431495 2024-04-18T21:06:42.304 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.304 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.304 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:42.305 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659117+0000", 2024-04-18T21:06:42.305 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0885999999999997e-05 2024-04-18T21:06:42.305 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.305 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.305 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:42.305 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659209+0000", 2024-04-18T21:06:42.305 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.1195999999999999e-05 2024-04-18T21:06:42.305 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:42.305 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:42.305 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:42.305 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.305 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.305 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:42.305 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:42.305 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 96.661182217999993, 2024-04-18T21:06:42.305 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.03492514, 2024-04-18T21:06:42.306 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:42.306 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:42.306 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:42.306 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:42.306 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.306 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:42.306 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:42.306 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:42.306 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.306 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.306 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:42.306 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:42.306 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:42.307 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.307 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.307 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:42.307 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:06:42.307 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.407e-06 2024-04-18T21:06:42.307 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.307 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.307 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:42.307 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615679+0000", 2024-04-18T21:06:42.307 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.2130000000000002e-06 2024-04-18T21:06:42.307 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.307 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.307 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:42.307 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615701+0000", 2024-04-18T21:06:42.307 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2316000000000001e-05 2024-04-18T21:06:42.307 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.308 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.308 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:42.308 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615717+0000", 2024-04-18T21:06:42.308 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6197000000000001e-05 2024-04-18T21:06:42.308 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.308 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.308 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:42.308 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615828+0000", 2024-04-18T21:06:42.308 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000110899 2024-04-18T21:06:42.308 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.308 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.308 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:42.308 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615840+0000", 2024-04-18T21:06:42.308 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.1423000000000001e-05 2024-04-18T21:06:42.309 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.309 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.309 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:42.309 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628046+0000", 2024-04-18T21:06:42.309 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.012206295000000001 2024-04-18T21:06:42.309 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.309 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.309 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:42.309 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628323+0000", 2024-04-18T21:06:42.309 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00027658700000000001 2024-04-18T21:06:42.309 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.309 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.309 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:42.309 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628599+0000", 2024-04-18T21:06:42.309 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00027676699999999997 2024-04-18T21:06:42.310 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.310 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.310 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:42.310 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634869+0000", 2024-04-18T21:06:42.310 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.006269536 2024-04-18T21:06:42.310 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.310 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.310 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:42.310 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650333+0000", 2024-04-18T21:06:42.310 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.015463645999999999 2024-04-18T21:06:42.310 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.310 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.310 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:42.310 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650474+0000", 2024-04-18T21:06:42.310 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014091799999999999 2024-04-18T21:06:42.310 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.311 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.311 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:42.311 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650595+0000", 2024-04-18T21:06:42.311 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012193600000000001 2024-04-18T21:06:42.311 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:42.311 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:42.311 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:42.311 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.311 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.311 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:42.311 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:06:42.311 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 96.661097108999996, 2024-04-18T21:06:42.311 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.040588320999999997, 2024-04-18T21:06:42.311 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:42.311 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:42.311 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:42.312 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:42.312 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.312 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:42.312 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:06:42.312 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:42.312 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.312 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.312 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:42.312 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:06:42.312 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:42.312 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.312 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.312 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:42.312 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615757+0000", 2024-04-18T21:06:42.312 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2270000000000001e-06 2024-04-18T21:06:42.313 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.313 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.313 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:42.313 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615765+0000", 2024-04-18T21:06:42.313 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.9400000000000002e-06 2024-04-18T21:06:42.313 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.313 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.313 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:42.313 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615785+0000", 2024-04-18T21:06:42.313 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.0749000000000001e-05 2024-04-18T21:06:42.313 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.313 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.313 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:42.313 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615804+0000", 2024-04-18T21:06:42.313 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.8774e-05 2024-04-18T21:06:42.314 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.314 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.314 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:42.314 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615888+0000", 2024-04-18T21:06:42.314 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.4111999999999997e-05 2024-04-18T21:06:42.314 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.314 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.314 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:42.314 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615895+0000", 2024-04-18T21:06:42.314 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.0469999999999996e-06 2024-04-18T21:06:42.314 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.314 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.314 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:42.314 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629280+0000", 2024-04-18T21:06:42.314 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.013384416 2024-04-18T21:06:42.315 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.315 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.315 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:42.315 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629488+0000", 2024-04-18T21:06:42.315 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00020852800000000001 2024-04-18T21:06:42.315 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.315 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.315 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:42.315 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629869+0000", 2024-04-18T21:06:42.315 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00038042300000000001 2024-04-18T21:06:42.315 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.315 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.315 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:42.315 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635041+0000", 2024-04-18T21:06:42.315 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.005172383 2024-04-18T21:06:42.316 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.316 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.316 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:42.316 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656125+0000", 2024-04-18T21:06:42.316 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.021084025999999999 2024-04-18T21:06:42.316 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.316 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.316 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:42.316 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656240+0000", 2024-04-18T21:06:42.316 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000115352 2024-04-18T21:06:42.316 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.316 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.316 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:42.316 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656344+0000", 2024-04-18T21:06:42.317 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00010334400000000001 2024-04-18T21:06:42.317 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:42.317 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:42.317 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:42.317 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.317 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.317 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:42.317 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:42.317 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 96.661029788999997, 2024-04-18T21:06:42.317 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.043549577999999999, 2024-04-18T21:06:42.317 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:42.317 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:42.317 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:42.317 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:42.317 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.318 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:42.318 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:42.318 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:42.318 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.318 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.318 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:42.318 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:42.318 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:42.318 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.318 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.318 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:42.318 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:42.318 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.5000000000000002e-07 2024-04-18T21:06:42.318 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.319 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.319 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:42.319 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615828+0000", 2024-04-18T21:06:42.319 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.2359999999999998e-06 2024-04-18T21:06:42.319 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.319 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.319 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:42.319 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615838+0000", 2024-04-18T21:06:42.319 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0087e-05 2024-04-18T21:06:42.319 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.319 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.319 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:42.319 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615846+0000", 2024-04-18T21:06:42.319 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.67e-06 2024-04-18T21:06:42.319 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.320 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.320 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:42.320 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615963+0000", 2024-04-18T21:06:42.320 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00011630500000000001 2024-04-18T21:06:42.320 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.320 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.320 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:42.320 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615979+0000", 2024-04-18T21:06:42.320 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.613e-05 2024-04-18T21:06:42.320 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.320 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.320 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:42.320 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632392+0000", 2024-04-18T21:06:42.320 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016413317 2024-04-18T21:06:42.321 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.321 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.321 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:42.321 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632568+0000", 2024-04-18T21:06:42.321 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00017539500000000001 2024-04-18T21:06:42.321 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.321 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.321 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:42.321 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632748+0000", 2024-04-18T21:06:42.321 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00017991799999999999 2024-04-18T21:06:42.321 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.321 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.321 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:42.321 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635542+0000", 2024-04-18T21:06:42.321 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00279481 2024-04-18T21:06:42.322 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.322 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.322 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:42.322 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659232+0000", 2024-04-18T21:06:42.322 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.023689212000000001 2024-04-18T21:06:42.322 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.322 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.322 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:42.322 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659314+0000", 2024-04-18T21:06:42.322 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.2528999999999995e-05 2024-04-18T21:06:42.322 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.322 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.322 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:42.322 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659372+0000", 2024-04-18T21:06:42.323 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.8218999999999999e-05 2024-04-18T21:06:42.323 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:42.323 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:42.323 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:42.323 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.323 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.323 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:42.323 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:06:42.323 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 96.660968357000002, 2024-04-18T21:06:42.323 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.039335347, 2024-04-18T21:06:42.323 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:42.323 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:42.323 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "started", 2024-04-18T21:06:42.323 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:42.323 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.323 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:42.324 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:06:42.324 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:42.324 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.324 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.324 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:42.324 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:06:42.324 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:42.324 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.324 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.324 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:42.324 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615885+0000", 2024-04-18T21:06:42.324 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2699999999999999e-06 2024-04-18T21:06:42.324 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.324 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.324 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:42.325 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615892+0000", 2024-04-18T21:06:42.325 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.6499999999999999e-06 2024-04-18T21:06:42.325 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.325 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.325 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:42.325 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615906+0000", 2024-04-18T21:06:42.325 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.393e-05 2024-04-18T21:06:42.325 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.325 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.325 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:42.325 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615919+0000", 2024-04-18T21:06:42.325 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2860000000000001e-05 2024-04-18T21:06:42.325 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.325 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.325 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:42.326 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616027+0000", 2024-04-18T21:06:42.326 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000107852 2024-04-18T21:06:42.326 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.326 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.326 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:42.326 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616037+0000", 2024-04-18T21:06:42.326 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:06:42.326 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.326 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.326 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:42.326 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622719+0000", 2024-04-18T21:06:42.326 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0066817220000000002 2024-04-18T21:06:42.326 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.326 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.326 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:42.327 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623006+0000", 2024-04-18T21:06:42.327 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00028783699999999999 2024-04-18T21:06:42.327 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.327 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.327 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:42.327 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.655220+0000", 2024-04-18T21:06:42.327 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.032213036 2024-04-18T21:06:42.327 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:42.327 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:42.327 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:42.327 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.327 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.327 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:42.327 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:42.327 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 96.660912683999996, 2024-04-18T21:06:42.327 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.032845253999999997, 2024-04-18T21:06:42.327 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:42.328 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:42.328 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "started", 2024-04-18T21:06:42.328 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:42.328 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.328 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:42.328 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:42.328 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:42.328 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.328 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.328 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:42.328 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:42.328 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:42.328 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.328 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.328 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:42.328 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615942+0000", 2024-04-18T21:06:42.328 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.717e-06 2024-04-18T21:06:42.329 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.329 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.329 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:42.329 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615946+0000", 2024-04-18T21:06:42.329 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.6e-06 2024-04-18T21:06:42.329 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.329 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.329 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:42.329 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615960+0000", 2024-04-18T21:06:42.329 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:06:42.329 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.329 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.329 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:42.329 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615968+0000", 2024-04-18T21:06:42.329 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.9070000000000007e-06 2024-04-18T21:06:42.330 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.330 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.330 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:42.330 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616100+0000", 2024-04-18T21:06:42.330 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000132402 2024-04-18T21:06:42.330 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.330 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.330 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:42.330 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616117+0000", 2024-04-18T21:06:42.330 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6653000000000001e-05 2024-04-18T21:06:42.330 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.330 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.330 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:42.330 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621566+0000", 2024-04-18T21:06:42.330 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0054497740000000001 2024-04-18T21:06:42.331 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.331 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.331 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:42.331 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622801+0000", 2024-04-18T21:06:42.331 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0012345710000000001 2024-04-18T21:06:42.331 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.331 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.331 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:42.331 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648785+0000", 2024-04-18T21:06:42.331 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.025984104000000001 2024-04-18T21:06:42.331 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:42.331 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:42.331 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:42.331 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.332 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.332 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:42.332 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:06:42.332 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 96.655061333999996, 2024-04-18T21:06:42.332 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.011561350999999999, 2024-04-18T21:06:42.332 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:42.332 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:42.332 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:42.332 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:42.332 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.332 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:42.332 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:06:42.332 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:42.332 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.332 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.333 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:42.333 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:06:42.333 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:42.333 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.333 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.333 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:42.333 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621792+0000", 2024-04-18T21:06:42.333 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.4000000000000001e-07 2024-04-18T21:06:42.333 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.333 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.333 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:42.333 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:06:42.333 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.1050000000000002e-05 2024-04-18T21:06:42.333 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.333 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.334 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:42.334 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622608+0000", 2024-04-18T21:06:42.334 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00077505900000000003 2024-04-18T21:06:42.334 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.334 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.334 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:42.334 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623879+0000", 2024-04-18T21:06:42.334 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0012705839999999999 2024-04-18T21:06:42.334 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.334 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.334 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:42.334 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624010+0000", 2024-04-18T21:06:42.334 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00013176900000000001 2024-04-18T21:06:42.334 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.335 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.335 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:42.335 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624058+0000", 2024-04-18T21:06:42.335 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.7299000000000002e-05 2024-04-18T21:06:42.335 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.335 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.335 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:42.335 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633262+0000", 2024-04-18T21:06:42.335 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0092048770000000002 2024-04-18T21:06:42.335 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.335 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.335 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:42.335 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633353+0000", 2024-04-18T21:06:42.335 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0073000000000003e-05 2024-04-18T21:06:42.335 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:42.336 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:42.336 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:42.336 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.336 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.336 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:42.336 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:06:42.336 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 96.652933947999998, 2024-04-18T21:06:42.336 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0098419370000000003, 2024-04-18T21:06:42.336 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:42.336 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:42.336 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:42.336 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:42.336 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.336 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:42.336 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:06:42.336 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:42.337 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.337 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.337 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:42.337 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:06:42.337 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:42.337 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.337 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.337 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:42.337 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623920+0000", 2024-04-18T21:06:42.337 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2240000000000001e-06 2024-04-18T21:06:42.337 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.337 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.337 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:42.337 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623933+0000", 2024-04-18T21:06:42.337 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3653e-05 2024-04-18T21:06:42.338 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.338 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.338 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:42.338 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623956+0000", 2024-04-18T21:06:42.338 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2059e-05 2024-04-18T21:06:42.338 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.338 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.338 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:42.338 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623975+0000", 2024-04-18T21:06:42.338 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.9806999999999999e-05 2024-04-18T21:06:42.338 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.338 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.338 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:42.339 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626943+0000", 2024-04-18T21:06:42.339 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0029681579999999998 2024-04-18T21:06:42.339 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.339 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.339 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:42.339 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626993+0000", 2024-04-18T21:06:42.339 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.9935999999999998e-05 2024-04-18T21:06:42.339 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.339 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.339 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:42.339 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633665+0000", 2024-04-18T21:06:42.339 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0066719250000000004 2024-04-18T21:06:42.339 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.339 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.339 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:42.340 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633761+0000", 2024-04-18T21:06:42.340 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.5174999999999996e-05 2024-04-18T21:06:42.340 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:42.340 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:42.340 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:42.340 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.340 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.340 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:42.340 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:06:42.340 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 96.629080819999999, 2024-04-18T21:06:42.340 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0095703190000000007, 2024-04-18T21:06:42.340 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:42.340 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:42.340 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:42.340 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:42.341 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.341 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:42.341 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:06:42.341 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:42.341 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.341 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.341 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:42.341 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:06:42.341 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:42.341 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.341 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.341 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:42.341 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647773+0000", 2024-04-18T21:06:42.341 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.046e-06 2024-04-18T21:06:42.342 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.342 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.342 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:42.342 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647795+0000", 2024-04-18T21:06:42.342 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2616000000000002e-05 2024-04-18T21:06:42.342 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.342 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.342 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:42.342 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647818+0000", 2024-04-18T21:06:42.342 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3110000000000001e-05 2024-04-18T21:06:42.342 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.342 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.342 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:42.342 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647834+0000", 2024-04-18T21:06:42.343 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5163e-05 2024-04-18T21:06:42.343 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.343 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.343 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:42.343 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650682+0000", 2024-04-18T21:06:42.343 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0028479759999999999 2024-04-18T21:06:42.343 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.343 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.343 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:42.343 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650730+0000", 2024-04-18T21:06:42.343 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.8375999999999999e-05 2024-04-18T21:06:42.343 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.343 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.343 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:42.343 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656751+0000", 2024-04-18T21:06:42.344 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0060211880000000002 2024-04-18T21:06:42.344 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.344 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.344 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:42.344 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657342+0000", 2024-04-18T21:06:42.344 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00059084399999999998 2024-04-18T21:06:42.344 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:42.344 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:42.344 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:42.344 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.344 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.344 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(client.4534.0:1156 4.14 4:28a2fcee:::10000000768.00000000:head [write 0~3012] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-18T21:06:42.344 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:06:40.762398+0000", 2024-04-18T21:06:42.344 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 1.5144545190000001, 2024-04-18T21:06:42.345 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0095362490000000001, 2024-04-18T21:06:42.345 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:42.345 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:42.345 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:42.345 INFO:teuthology.orchestra.run.smithi150.stdout: "client_info": { 2024-04-18T21:06:42.345 INFO:teuthology.orchestra.run.smithi150.stdout: "client": "client.4534", 2024-04-18T21:06:42.345 INFO:teuthology.orchestra.run.smithi150.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:42.345 INFO:teuthology.orchestra.run.smithi150.stdout: "tid": 1156 2024-04-18T21:06:42.345 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.345 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:42.345 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.345 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:42.345 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:40.762398+0000", 2024-04-18T21:06:42.345 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:42.345 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.345 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.346 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:42.346 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:40.762398+0000", 2024-04-18T21:06:42.346 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:42.346 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.346 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.346 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:42.346 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:40.762400+0000", 2024-04-18T21:06:42.346 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2699999999999999e-06 2024-04-18T21:06:42.346 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.346 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.346 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:42.346 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:40.762414+0000", 2024-04-18T21:06:42.346 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3607e-05 2024-04-18T21:06:42.346 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.347 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.347 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:42.347 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:40.762480+0000", 2024-04-18T21:06:42.347 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.6252000000000002e-05 2024-04-18T21:06:42.347 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.347 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.347 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:42.347 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:40.762500+0000", 2024-04-18T21:06:42.347 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.9894e-05 2024-04-18T21:06:42.347 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.347 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.347 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:42.347 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:40.762687+0000", 2024-04-18T21:06:42.347 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00018719799999999999 2024-04-18T21:06:42.348 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.348 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.348 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:42.348 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:40.763026+0000", 2024-04-18T21:06:42.348 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00033882399999999999 2024-04-18T21:06:42.348 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.348 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.348 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:42.348 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:40.763409+0000", 2024-04-18T21:06:42.348 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000382863 2024-04-18T21:06:42.348 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.348 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.348 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:42.348 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:40.764798+0000", 2024-04-18T21:06:42.348 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001389464 2024-04-18T21:06:42.349 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.349 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.349 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:42.349 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:40.771727+0000", 2024-04-18T21:06:42.349 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.006928343 2024-04-18T21:06:42.349 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.349 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.349 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:42.349 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:40.771856+0000", 2024-04-18T21:06:42.349 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012932800000000001 2024-04-18T21:06:42.349 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.349 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.349 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:42.349 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:40.771934+0000", 2024-04-18T21:06:42.350 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.8206000000000003e-05 2024-04-18T21:06:42.350 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:42.350 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:42.350 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:42.350 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.350 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.350 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(client.4534.0:1434 4.9 4:933e433d:::1000000088b.00000000:head [write 0~2488] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-18T21:06:42.350 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:06:41.032218+0000", 2024-04-18T21:06:42.350 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 1.244634673, 2024-04-18T21:06:42.350 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0096837620000000003, 2024-04-18T21:06:42.350 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:42.350 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:42.350 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:42.350 INFO:teuthology.orchestra.run.smithi150.stdout: "client_info": { 2024-04-18T21:06:42.351 INFO:teuthology.orchestra.run.smithi150.stdout: "client": "client.4534", 2024-04-18T21:06:42.351 INFO:teuthology.orchestra.run.smithi150.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:42.351 INFO:teuthology.orchestra.run.smithi150.stdout: "tid": 1434 2024-04-18T21:06:42.351 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.351 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:42.351 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.351 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:42.351 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.032218+0000", 2024-04-18T21:06:42.351 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:42.351 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.351 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.351 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:42.351 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.032218+0000", 2024-04-18T21:06:42.351 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:42.351 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.352 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.352 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:42.352 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.032220+0000", 2024-04-18T21:06:42.352 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.804e-06 2024-04-18T21:06:42.352 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.352 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.352 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:42.352 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.032231+0000", 2024-04-18T21:06:42.352 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0879999999999999e-05 2024-04-18T21:06:42.352 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.352 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.352 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:42.352 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.032250+0000", 2024-04-18T21:06:42.353 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.9913000000000001e-05 2024-04-18T21:06:42.353 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.353 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.353 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:42.353 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.032264+0000", 2024-04-18T21:06:42.353 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3247e-05 2024-04-18T21:06:42.353 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.353 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.353 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:42.353 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.032379+0000", 2024-04-18T21:06:42.353 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00011575500000000001 2024-04-18T21:06:42.353 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.353 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.353 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:42.353 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.032657+0000", 2024-04-18T21:06:42.354 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00027785400000000001 2024-04-18T21:06:42.354 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.354 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.354 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:42.354 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.032864+0000", 2024-04-18T21:06:42.354 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00020635799999999999 2024-04-18T21:06:42.354 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.354 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.354 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:42.354 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.034445+0000", 2024-04-18T21:06:42.354 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001581739 2024-04-18T21:06:42.354 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.354 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.354 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:42.354 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.041732+0000", 2024-04-18T21:06:42.355 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0072867030000000003 2024-04-18T21:06:42.355 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.355 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.355 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:42.355 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.041838+0000", 2024-04-18T21:06:42.355 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000105763 2024-04-18T21:06:42.355 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.355 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.355 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:42.355 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.041902+0000", 2024-04-18T21:06:42.355 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.3745999999999996e-05 2024-04-18T21:06:42.355 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:42.355 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:42.355 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:42.355 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.356 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.356 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(client.4534.0:1436 4.3b 4:dff36f63:::1000000088d.00000000:head [write 0~2490] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-18T21:06:42.356 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:06:41.033942+0000", 2024-04-18T21:06:42.356 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 1.242910695, 2024-04-18T21:06:42.356 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.010154763000000001, 2024-04-18T21:06:42.356 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:42.356 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:42.356 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:42.356 INFO:teuthology.orchestra.run.smithi150.stdout: "client_info": { 2024-04-18T21:06:42.356 INFO:teuthology.orchestra.run.smithi150.stdout: "client": "client.4534", 2024-04-18T21:06:42.356 INFO:teuthology.orchestra.run.smithi150.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:42.356 INFO:teuthology.orchestra.run.smithi150.stdout: "tid": 1436 2024-04-18T21:06:42.356 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.356 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:42.357 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.357 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:42.357 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.033942+0000", 2024-04-18T21:06:42.357 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:42.357 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.357 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.357 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:42.357 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.033942+0000", 2024-04-18T21:06:42.357 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:42.357 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.357 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.357 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:42.357 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.033944+0000", 2024-04-18T21:06:42.357 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.4370000000000001e-06 2024-04-18T21:06:42.357 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.358 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.358 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:42.358 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.033960+0000", 2024-04-18T21:06:42.358 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5492999999999999e-05 2024-04-18T21:06:42.358 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.358 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.358 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:42.358 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.033990+0000", 2024-04-18T21:06:42.358 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.0490000000000001e-05 2024-04-18T21:06:42.358 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.358 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.358 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:42.358 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.034011+0000", 2024-04-18T21:06:42.358 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.0843e-05 2024-04-18T21:06:42.359 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.359 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.359 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:42.359 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.034132+0000", 2024-04-18T21:06:42.359 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012118899999999999 2024-04-18T21:06:42.359 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.359 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.359 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:42.359 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.034362+0000", 2024-04-18T21:06:42.359 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00022924800000000001 2024-04-18T21:06:42.359 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.359 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.359 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:42.359 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.034659+0000", 2024-04-18T21:06:42.360 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00029773700000000001 2024-04-18T21:06:42.360 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.360 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.360 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:42.360 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.036064+0000", 2024-04-18T21:06:42.360 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0014046270000000001 2024-04-18T21:06:42.360 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.360 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.360 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:42.360 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.043846+0000", 2024-04-18T21:06:42.360 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0077818150000000001 2024-04-18T21:06:42.360 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.360 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.360 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:42.361 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.043982+0000", 2024-04-18T21:06:42.361 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00013665500000000001 2024-04-18T21:06:42.361 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.361 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.361 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:42.361 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.044097+0000", 2024-04-18T21:06:42.361 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00011422899999999999 2024-04-18T21:06:42.361 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:42.361 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:42.361 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:42.361 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.361 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.361 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(client.4534.0:1437 4.2 4:423b93e7:::1000000088e.00000000:head [write 0~2491] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-18T21:06:42.361 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:06:41.034717+0000", 2024-04-18T21:06:42.361 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 1.2421352990000001, 2024-04-18T21:06:42.362 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0094424239999999996, 2024-04-18T21:06:42.362 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:42.362 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:42.362 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:42.362 INFO:teuthology.orchestra.run.smithi150.stdout: "client_info": { 2024-04-18T21:06:42.362 INFO:teuthology.orchestra.run.smithi150.stdout: "client": "client.4534", 2024-04-18T21:06:42.362 INFO:teuthology.orchestra.run.smithi150.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:42.362 INFO:teuthology.orchestra.run.smithi150.stdout: "tid": 1437 2024-04-18T21:06:42.362 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.362 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:42.362 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.362 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:42.362 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.034717+0000", 2024-04-18T21:06:42.362 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:42.362 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.363 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.363 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:42.363 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.034717+0000", 2024-04-18T21:06:42.363 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:42.363 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.363 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.363 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:42.363 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.034719+0000", 2024-04-18T21:06:42.363 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.244e-06 2024-04-18T21:06:42.363 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.363 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.363 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:42.363 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.034733+0000", 2024-04-18T21:06:42.363 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3419e-05 2024-04-18T21:06:42.363 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.363 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.364 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:42.364 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.034750+0000", 2024-04-18T21:06:42.364 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6906999999999999e-05 2024-04-18T21:06:42.364 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.364 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.364 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:42.364 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.034762+0000", 2024-04-18T21:06:42.364 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2553e-05 2024-04-18T21:06:42.364 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.364 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.364 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:42.364 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.034851+0000", 2024-04-18T21:06:42.364 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.8739000000000005e-05 2024-04-18T21:06:42.364 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.364 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.365 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:42.365 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.035076+0000", 2024-04-18T21:06:42.365 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00022516800000000001 2024-04-18T21:06:42.365 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.365 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.365 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:42.365 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.035320+0000", 2024-04-18T21:06:42.365 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000243995 2024-04-18T21:06:42.365 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.365 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.365 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:42.365 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.037227+0000", 2024-04-18T21:06:42.365 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001906823 2024-04-18T21:06:42.365 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.366 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.366 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:42.366 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.043894+0000", 2024-04-18T21:06:42.366 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0066672049999999998 2024-04-18T21:06:42.366 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.366 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.366 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:42.366 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.044023+0000", 2024-04-18T21:06:42.366 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012901500000000001 2024-04-18T21:06:42.366 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.366 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.366 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:42.366 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.044160+0000", 2024-04-18T21:06:42.366 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00013635599999999999 2024-04-18T21:06:42.366 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:42.367 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:42.367 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:42.367 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.367 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.367 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4534.0:1562 4.31 e50/16 4:8c019499:::10000000915.00000000:head v 50'24, mlcod=50'22)", 2024-04-18T21:06:42.367 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:06:41.148969+0000", 2024-04-18T21:06:42.367 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 1.1278830580000001, 2024-04-18T21:06:42.367 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0092636070000000001, 2024-04-18T21:06:42.367 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:42.367 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:42.367 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:42.367 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:42.367 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.367 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:42.367 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.148969+0000", 2024-04-18T21:06:42.367 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:42.368 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.368 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.368 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:42.368 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.148969+0000", 2024-04-18T21:06:42.368 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:42.368 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.368 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.368 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:42.368 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.148971+0000", 2024-04-18T21:06:42.368 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2860000000000001e-06 2024-04-18T21:06:42.368 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.368 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.368 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:42.368 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.148988+0000", 2024-04-18T21:06:42.368 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.751e-05 2024-04-18T21:06:42.368 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.369 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.369 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:42.369 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.149003+0000", 2024-04-18T21:06:42.369 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4999e-05 2024-04-18T21:06:42.369 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.369 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.369 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:42.369 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.149013+0000", 2024-04-18T21:06:42.369 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.2799999999999992e-06 2024-04-18T21:06:42.369 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.369 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.369 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:42.369 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.149121+0000", 2024-04-18T21:06:42.369 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000108829 2024-04-18T21:06:42.370 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.370 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.370 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:42.370 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.149160+0000", 2024-04-18T21:06:42.370 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.8529999999999999e-05 2024-04-18T21:06:42.370 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.370 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.370 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:42.370 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.158164+0000", 2024-04-18T21:06:42.370 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0090040109999999993 2024-04-18T21:06:42.370 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.370 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.370 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:42.370 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.158233+0000", 2024-04-18T21:06:42.371 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.9162e-05 2024-04-18T21:06:42.371 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:42.371 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:42.371 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:42.371 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.371 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.371 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(client.4534.0:1577 4.3b 4:dd758eab:::10000000925.00000000:head [write 0~2459] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-18T21:06:42.371 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:06:41.161985+0000", 2024-04-18T21:06:42.371 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 1.1148671619999999, 2024-04-18T21:06:42.371 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.010166364000000001, 2024-04-18T21:06:42.371 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:42.371 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:42.371 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:42.371 INFO:teuthology.orchestra.run.smithi150.stdout: "client_info": { 2024-04-18T21:06:42.371 INFO:teuthology.orchestra.run.smithi150.stdout: "client": "client.4534", 2024-04-18T21:06:42.371 INFO:teuthology.orchestra.run.smithi150.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:42.371 INFO:teuthology.orchestra.run.smithi150.stdout: "tid": 1577 2024-04-18T21:06:42.372 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.372 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:42.372 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.372 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:42.372 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.161985+0000", 2024-04-18T21:06:42.372 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:42.372 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.372 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.372 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:42.372 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.161985+0000", 2024-04-18T21:06:42.372 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:42.372 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.372 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.372 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:42.373 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.161987+0000", 2024-04-18T21:06:42.373 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.477e-06 2024-04-18T21:06:42.373 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.373 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.373 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:42.373 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.161996+0000", 2024-04-18T21:06:42.373 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.9269999999999994e-06 2024-04-18T21:06:42.373 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.373 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.373 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:42.373 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.162013+0000", 2024-04-18T21:06:42.373 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7499999999999998e-05 2024-04-18T21:06:42.373 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.373 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.373 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:42.373 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.162024+0000", 2024-04-18T21:06:42.374 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0426e-05 2024-04-18T21:06:42.374 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.374 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.374 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:42.374 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.162146+0000", 2024-04-18T21:06:42.374 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012264900000000001 2024-04-18T21:06:42.374 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.374 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.374 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:42.374 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.162467+0000", 2024-04-18T21:06:42.374 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00032042399999999998 2024-04-18T21:06:42.374 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.374 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.374 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:42.375 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.162841+0000", 2024-04-18T21:06:42.375 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00037397599999999999 2024-04-18T21:06:42.375 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.375 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.375 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:42.375 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.164177+0000", 2024-04-18T21:06:42.375 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001336385 2024-04-18T21:06:42.375 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.375 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.375 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:42.375 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.171894+0000", 2024-04-18T21:06:42.375 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0077171490000000004 2024-04-18T21:06:42.375 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.375 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.375 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:42.376 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.172023+0000", 2024-04-18T21:06:42.376 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012887900000000001 2024-04-18T21:06:42.376 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.376 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.376 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:42.376 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.172152+0000", 2024-04-18T21:06:42.376 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000128572 2024-04-18T21:06:42.376 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:42.376 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:42.376 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:42.376 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.376 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.376 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(client.4534.0:1578 4.24 4:25a617e1:::10000000926.00000000:head [write 0~2453] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-18T21:06:42.376 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:06:41.162788+0000", 2024-04-18T21:06:42.376 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 1.114064465, 2024-04-18T21:06:42.377 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0094157770000000002, 2024-04-18T21:06:42.377 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:42.377 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:42.377 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:42.377 INFO:teuthology.orchestra.run.smithi150.stdout: "client_info": { 2024-04-18T21:06:42.377 INFO:teuthology.orchestra.run.smithi150.stdout: "client": "client.4534", 2024-04-18T21:06:42.377 INFO:teuthology.orchestra.run.smithi150.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:42.377 INFO:teuthology.orchestra.run.smithi150.stdout: "tid": 1578 2024-04-18T21:06:42.377 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.377 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:42.377 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.377 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:42.377 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.162788+0000", 2024-04-18T21:06:42.377 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:42.378 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.378 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.378 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:42.378 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.162788+0000", 2024-04-18T21:06:42.378 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:42.378 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.378 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.378 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:42.378 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.162789+0000", 2024-04-18T21:06:42.378 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.426e-06 2024-04-18T21:06:42.378 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.378 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.378 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:42.379 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.162798+0000", 2024-04-18T21:06:42.379 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.0839999999999992e-06 2024-04-18T21:06:42.379 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.379 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.379 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:42.379 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.162815+0000", 2024-04-18T21:06:42.379 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7745999999999999e-05 2024-04-18T21:06:42.379 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.379 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.379 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:42.379 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.162826+0000", 2024-04-18T21:06:42.379 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.098e-05 2024-04-18T21:06:42.379 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.379 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.379 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:42.380 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.162976+0000", 2024-04-18T21:06:42.380 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014927199999999999 2024-04-18T21:06:42.380 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.380 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.380 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:42.380 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.163203+0000", 2024-04-18T21:06:42.380 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00022780399999999999 2024-04-18T21:06:42.380 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.380 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.380 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:42.380 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.163473+0000", 2024-04-18T21:06:42.380 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000269838 2024-04-18T21:06:42.380 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.380 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.381 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:42.381 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.165742+0000", 2024-04-18T21:06:42.381 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0022690560000000002 2024-04-18T21:06:42.381 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.381 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.381 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:42.381 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.172002+0000", 2024-04-18T21:06:42.381 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0062600659999999999 2024-04-18T21:06:42.381 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.381 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.381 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:42.381 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.172135+0000", 2024-04-18T21:06:42.381 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00013241199999999999 2024-04-18T21:06:42.381 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:42.382 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:42.382 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:42.382 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.172204+0000", 2024-04-18T21:06:42.382 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.9092999999999997e-05 2024-04-18T21:06:42.382 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:42.382 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:42.382 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:42.382 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:42.382 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:42.382 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:06:42.383 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:06:42.384 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:06:42.384 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1: {} 2024-04-18T21:06:42.384 INFO:teuthology.orchestra.run.smithi078.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:06:42.385 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:42.385 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:42.382+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:42.388 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:06:42.388 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:42.484 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:42.482+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:42.523 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:42.523 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:42.539 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:42.585 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:42.582+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:42.686 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:42.686+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:42.712 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:42.712 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:42.727 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:42.729 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-18T21:06:42.787 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:42.786+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:42.888 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:42.886+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:42.903 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:42.903 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:42.917 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:42.988 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:42.986+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:43.058 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:43.058 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:43.074 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:43.089 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:43.091+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:43.190 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:43.191+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:43.253 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:43.253 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:43.270 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:43.291 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:43.291+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:43.391 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:43.391 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:43.392 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:43.390+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:43.407 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:43.493 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:43.495+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:43.542 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:43.542 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:43.557 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:43.594 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:43.594+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:43.695 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:43.694+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:43.734 INFO:teuthology.orchestra.run.smithi078.stderr:nodeep-scrub is unset 2024-04-18T21:06:43.736 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:43.737 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:43.753 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:43.801 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:43.803+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:43.880 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:43.880 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:43.896 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:43.897 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:43.894+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:43.998 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:43.998+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:44.033 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:44.033 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:44.049 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:44.100 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:44.098+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:44.174 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:44.174 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:44.190 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:44.200 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:44.199+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:44.303 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:44.303+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:44.329 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:44.329 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:44.345 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:44.404 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:44.402+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:44.405 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:06:44.506 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:44.506 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:44.506 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:44.502+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:44.519 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:44.572 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:06:44.572 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:06:44.594 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1: {} 2024-04-18T21:06:44.595 INFO:teuthology.orchestra.run.smithi078.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:06:44.607 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:44.607+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:44.619 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:06:44.620 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:44.711 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:44.710+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:44.714 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:44.714 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:06:44.714 INFO:teuthology.orchestra.run.smithi132.stdout: "complaint_time": 30, 2024-04-18T21:06:44.715 INFO:teuthology.orchestra.run.smithi132.stdout: "num_blocked_ops": 0 2024-04-18T21:06:44.715 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:44.735 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:44.811 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:44.810+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:44.880 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:44.880 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 20, 2024-04-18T21:06:44.880 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 600, 2024-04-18T21:06:44.880 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [ 2024-04-18T21:06:44.881 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.881 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:44.881 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:06:44.881 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 109.969854548, 2024-04-18T21:06:44.881 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.02518273, 2024-04-18T21:06:44.881 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:44.881 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:44.881 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.881 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:44.881 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:44.882 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:44.882 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 141 2024-04-18T21:06:44.882 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.882 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:44.882 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.882 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:44.882 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:06:44.882 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:44.883 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.883 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.883 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:44.883 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:06:44.883 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:44.883 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.883 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.883 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:44.883 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911562+0000", 2024-04-18T21:06:44.883 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9300000000000006e-07 2024-04-18T21:06:44.883 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.884 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.884 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:44.884 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911569+0000", 2024-04-18T21:06:44.884 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0169999999999999e-06 2024-04-18T21:06:44.884 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.884 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.884 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:44.884 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911582+0000", 2024-04-18T21:06:44.884 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.343e-05 2024-04-18T21:06:44.884 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.884 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.884 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.884 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911590+0000", 2024-04-18T21:06:44.884 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.413e-06 2024-04-18T21:06:44.884 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.885 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.885 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:44.885 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.933922+0000", 2024-04-18T21:06:44.885 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.022332093000000001 2024-04-18T21:06:44.885 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.885 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.885 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:44.885 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.934155+0000", 2024-04-18T21:06:44.885 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023378900000000001 2024-04-18T21:06:44.885 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.885 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.885 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:44.885 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.934514+0000", 2024-04-18T21:06:44.885 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00035859200000000003 2024-04-18T21:06:44.886 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.886 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.886 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:44.886 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.935973+0000", 2024-04-18T21:06:44.886 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001458705 2024-04-18T21:06:44.886 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.886 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.886 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.886 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936488+0000", 2024-04-18T21:06:44.886 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00051550000000000001 2024-04-18T21:06:44.886 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.886 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.886 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:44.886 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936636+0000", 2024-04-18T21:06:44.887 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014779800000000001 2024-04-18T21:06:44.887 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.887 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.887 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:44.887 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936743+0000", 2024-04-18T21:06:44.887 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010739999999999999 2024-04-18T21:06:44.887 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:44.887 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:44.887 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:44.887 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.887 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.888 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:44.888 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:44.888 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 109.852655574, 2024-04-18T21:06:44.888 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023654959999999999, 2024-04-18T21:06:44.888 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:44.888 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:44.888 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.888 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:44.888 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:44.888 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:44.889 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 163 2024-04-18T21:06:44.889 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.889 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:44.889 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.889 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:44.889 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:44.889 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:44.889 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.889 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.889 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:44.889 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:44.889 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:44.889 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.889 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.889 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:44.890 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:44.890 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0999999999999998e-07 2024-04-18T21:06:44.890 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.890 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.890 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:44.890 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028766+0000", 2024-04-18T21:06:44.890 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4700000000000001e-06 2024-04-18T21:06:44.890 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.890 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.890 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:44.890 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028775+0000", 2024-04-18T21:06:44.890 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.3190000000000001e-06 2024-04-18T21:06:44.890 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.890 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.890 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.891 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028782+0000", 2024-04-18T21:06:44.891 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.2300000000000002e-06 2024-04-18T21:06:44.891 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.891 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.891 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:44.891 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046667+0000", 2024-04-18T21:06:44.891 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017884356000000001 2024-04-18T21:06:44.891 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.891 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.891 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:44.891 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046788+0000", 2024-04-18T21:06:44.891 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012125000000000001 2024-04-18T21:06:44.891 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.891 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.892 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:44.892 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046982+0000", 2024-04-18T21:06:44.892 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019394 2024-04-18T21:06:44.892 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.892 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.892 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:44.892 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051969+0000", 2024-04-18T21:06:44.892 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0049868150000000003 2024-04-18T21:06:44.892 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.892 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.892 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.892 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052089+0000", 2024-04-18T21:06:44.892 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011993 2024-04-18T21:06:44.892 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.892 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.893 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:44.893 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052292+0000", 2024-04-18T21:06:44.893 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020345699999999999 2024-04-18T21:06:44.893 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.893 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.893 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:44.893 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052415+0000", 2024-04-18T21:06:44.893 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000122483 2024-04-18T21:06:44.893 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:44.893 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:44.893 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:44.893 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.893 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.893 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:44.893 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:44.894 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 109.85262134200001, 2024-04-18T21:06:44.894 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023864586, 2024-04-18T21:06:44.894 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:44.894 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:44.894 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.894 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:44.894 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:44.894 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:44.894 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 164 2024-04-18T21:06:44.894 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.894 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:44.894 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.894 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:44.894 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:44.895 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:44.895 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.895 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.895 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:44.895 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:44.895 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:44.895 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.895 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.895 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:44.895 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028795+0000", 2024-04-18T21:06:44.895 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7999999999999995e-07 2024-04-18T21:06:44.895 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.895 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.895 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:44.895 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028884+0000", 2024-04-18T21:06:44.896 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8997000000000002e-05 2024-04-18T21:06:44.896 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.896 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.896 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:44.896 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028895+0000", 2024-04-18T21:06:44.896 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1647e-05 2024-04-18T21:06:44.896 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.896 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.896 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.896 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028903+0000", 2024-04-18T21:06:44.896 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.909e-06 2024-04-18T21:06:44.896 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.896 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.896 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:44.896 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.047818+0000", 2024-04-18T21:06:44.897 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018914337 2024-04-18T21:06:44.897 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.897 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.897 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:44.897 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.048094+0000", 2024-04-18T21:06:44.897 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00027653500000000001 2024-04-18T21:06:44.897 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.897 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.897 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:44.897 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.048471+0000", 2024-04-18T21:06:44.897 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00037705799999999999 2024-04-18T21:06:44.897 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.897 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.897 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.897 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052516+0000", 2024-04-18T21:06:44.898 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0040452739999999997 2024-04-18T21:06:44.898 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.898 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.898 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:44.898 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052535+0000", 2024-04-18T21:06:44.898 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.84e-05 2024-04-18T21:06:44.898 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.898 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.898 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:44.898 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052603+0000", 2024-04-18T21:06:44.898 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.8095000000000004e-05 2024-04-18T21:06:44.898 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.898 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.898 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:44.899 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052659+0000", 2024-04-18T21:06:44.899 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5653999999999999e-05 2024-04-18T21:06:44.899 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:44.899 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:44.899 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:44.899 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.899 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.899 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:44.899 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:44.899 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 109.852497899, 2024-04-18T21:06:44.899 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024516458000000001, 2024-04-18T21:06:44.899 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:44.899 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:44.899 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.899 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:44.899 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:44.900 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:44.900 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 165 2024-04-18T21:06:44.900 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.900 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:44.900 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.900 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:44.900 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:44.900 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:44.900 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.900 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.900 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:44.900 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:44.900 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:44.900 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.900 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.901 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:44.901 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028918+0000", 2024-04-18T21:06:44.901 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8000000000000005e-07 2024-04-18T21:06:44.901 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.901 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.901 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:44.901 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028924+0000", 2024-04-18T21:06:44.901 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5659999999999997e-06 2024-04-18T21:06:44.901 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.901 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.901 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:44.901 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028933+0000", 2024-04-18T21:06:44.901 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.38e-06 2024-04-18T21:06:44.901 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.901 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.902 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.902 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028940+0000", 2024-04-18T21:06:44.902 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0060000000000003e-06 2024-04-18T21:06:44.902 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.902 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.902 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:44.902 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.050846+0000", 2024-04-18T21:06:44.902 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021906119000000002 2024-04-18T21:06:44.902 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.902 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.902 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:44.902 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051025+0000", 2024-04-18T21:06:44.902 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017850799999999999 2024-04-18T21:06:44.902 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.902 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.902 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:44.903 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051221+0000", 2024-04-18T21:06:44.903 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019608700000000001 2024-04-18T21:06:44.903 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.903 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.903 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:44.903 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052675+0000", 2024-04-18T21:06:44.903 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0014537899999999999 2024-04-18T21:06:44.903 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.903 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.903 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.903 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053311+0000", 2024-04-18T21:06:44.903 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00063613299999999999 2024-04-18T21:06:44.903 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.903 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.904 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:44.904 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053381+0000", 2024-04-18T21:06:44.904 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0074999999999996e-05 2024-04-18T21:06:44.904 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.904 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.904 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:44.904 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053434+0000", 2024-04-18T21:06:44.904 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3013999999999998e-05 2024-04-18T21:06:44.904 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:44.904 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:44.904 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:44.904 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.905 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.905 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:44.905 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:44.905 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 109.73919241999999, 2024-04-18T21:06:44.905 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023772793, 2024-04-18T21:06:44.905 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:44.905 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:44.905 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.905 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:44.905 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:44.905 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:44.905 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 187 2024-04-18T21:06:44.905 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.905 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:44.905 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.906 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:44.906 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:44.906 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:44.906 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.906 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.906 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:44.906 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:44.906 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:44.906 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.906 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.906 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:44.906 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142224+0000", 2024-04-18T21:06:44.906 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.47e-07 2024-04-18T21:06:44.906 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.906 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.907 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:44.907 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142233+0000", 2024-04-18T21:06:44.907 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0729999999999994e-06 2024-04-18T21:06:44.907 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.907 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.907 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:44.907 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142255+0000", 2024-04-18T21:06:44.907 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.2535999999999999e-05 2024-04-18T21:06:44.907 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.907 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.907 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.907 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142268+0000", 2024-04-18T21:06:44.907 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2686e-05 2024-04-18T21:06:44.907 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.907 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.908 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:44.908 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160497+0000", 2024-04-18T21:06:44.908 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018228779000000001 2024-04-18T21:06:44.908 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.908 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.908 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:44.908 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160634+0000", 2024-04-18T21:06:44.908 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000137315 2024-04-18T21:06:44.908 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.908 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.908 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:44.908 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160831+0000", 2024-04-18T21:06:44.908 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019683100000000001 2024-04-18T21:06:44.908 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.908 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.909 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.909 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165129+0000", 2024-04-18T21:06:44.909 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0042981299999999998 2024-04-18T21:06:44.909 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.909 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.909 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:44.909 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165776+0000", 2024-04-18T21:06:44.909 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00064702900000000003 2024-04-18T21:06:44.909 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.909 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.909 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:44.909 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165921+0000", 2024-04-18T21:06:44.909 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014506 2024-04-18T21:06:44.909 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.909 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.910 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:44.910 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165996+0000", 2024-04-18T21:06:44.910 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.4406999999999994e-05 2024-04-18T21:06:44.910 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:44.910 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:44.910 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:44.910 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.910 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.910 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:44.910 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:44.910 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 109.739131822, 2024-04-18T21:06:44.911 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026802157, 2024-04-18T21:06:44.913 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:44.913 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:44.913 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.914 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:44.914 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:44.914 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:44.914 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 188 2024-04-18T21:06:44.914 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.914 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:44.914 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.914 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:44.914 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:44.914 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:44.914 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.914 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.914 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:44.914 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:44.914 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:44.915 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.915 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.915 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:44.915 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142284+0000", 2024-04-18T21:06:44.915 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4e-07 2024-04-18T21:06:44.915 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.915 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.915 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:44.915 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142374+0000", 2024-04-18T21:06:44.915 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0099999999999995e-05 2024-04-18T21:06:44.916 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.916 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.916 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:44.916 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142386+0000", 2024-04-18T21:06:44.916 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1770000000000001e-05 2024-04-18T21:06:44.916 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.916 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.916 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.916 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142394+0000", 2024-04-18T21:06:44.916 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.2130000000000008e-06 2024-04-18T21:06:44.916 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.917 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.917 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:44.917 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.161743+0000", 2024-04-18T21:06:44.917 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019348644000000002 2024-04-18T21:06:44.917 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.917 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.917 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:44.917 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.161865+0000", 2024-04-18T21:06:44.917 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012210899999999999 2024-04-18T21:06:44.917 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.917 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.917 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:44.918 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.162055+0000", 2024-04-18T21:06:44.918 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000189994 2024-04-18T21:06:44.918 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.918 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.918 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.918 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165735+0000", 2024-04-18T21:06:44.918 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0036803270000000002 2024-04-18T21:06:44.918 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.918 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.918 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:44.918 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.168911+0000", 2024-04-18T21:06:44.918 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0031753689999999999 2024-04-18T21:06:44.919 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.919 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.919 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:44.919 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169012+0000", 2024-04-18T21:06:44.919 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010157699999999999 2024-04-18T21:06:44.919 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.919 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.919 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:44.919 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169086+0000", 2024-04-18T21:06:44.919 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3213999999999994e-05 2024-04-18T21:06:44.919 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:44.919 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:44.919 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:44.920 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.920 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.920 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:44.920 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:44.920 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 109.739006516, 2024-04-18T21:06:44.920 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026811423000000001, 2024-04-18T21:06:44.920 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:44.920 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:44.920 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.920 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:44.920 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:44.920 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:44.921 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 189 2024-04-18T21:06:44.921 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.921 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:44.921 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.921 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:44.921 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:44.921 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:44.921 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.921 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.921 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:44.921 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:44.921 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:44.922 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.922 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.922 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:44.922 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142410+0000", 2024-04-18T21:06:44.922 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:06:44.922 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.922 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.922 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:44.922 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142415+0000", 2024-04-18T21:06:44.922 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.7939999999999999e-06 2024-04-18T21:06:44.922 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.923 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.923 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:44.923 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142470+0000", 2024-04-18T21:06:44.923 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4537999999999999e-05 2024-04-18T21:06:44.923 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.923 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.923 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.923 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142481+0000", 2024-04-18T21:06:44.923 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0966e-05 2024-04-18T21:06:44.923 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.923 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.923 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:44.923 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.163493+0000", 2024-04-18T21:06:44.924 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021012444000000002 2024-04-18T21:06:44.924 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.924 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.924 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:44.924 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.163727+0000", 2024-04-18T21:06:44.924 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000233339 2024-04-18T21:06:44.924 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.924 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.924 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:44.924 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.164102+0000", 2024-04-18T21:06:44.924 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000374872 2024-04-18T21:06:44.924 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.924 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.925 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.925 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.166528+0000", 2024-04-18T21:06:44.925 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0024258729999999998 2024-04-18T21:06:44.925 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.925 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.925 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:44.925 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169101+0000", 2024-04-18T21:06:44.925 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0025737680000000001 2024-04-18T21:06:44.925 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.925 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.925 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:44.925 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169171+0000", 2024-04-18T21:06:44.925 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0148000000000007e-05 2024-04-18T21:06:44.926 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.926 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.926 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:44.926 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169220+0000", 2024-04-18T21:06:44.926 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8767999999999998e-05 2024-04-18T21:06:44.926 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:44.926 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:44.926 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:44.926 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.926 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.926 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:44.927 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:44.927 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 99.265433963999996, 2024-04-18T21:06:44.927 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024082777999999999, 2024-04-18T21:06:44.927 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:44.927 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:44.927 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.927 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:44.927 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.927 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:44.927 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:44.927 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:44.927 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.927 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.928 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:44.928 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:44.928 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:44.928 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.928 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.928 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:44.928 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615984+0000", 2024-04-18T21:06:44.928 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.9869999999999999e-06 2024-04-18T21:06:44.928 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.928 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.928 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:44.928 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615999+0000", 2024-04-18T21:06:44.928 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4646e-05 2024-04-18T21:06:44.929 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.929 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.929 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:44.929 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616028+0000", 2024-04-18T21:06:44.929 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8952999999999999e-05 2024-04-18T21:06:44.929 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.929 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.929 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.929 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616052+0000", 2024-04-18T21:06:44.929 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.3941999999999999e-05 2024-04-18T21:06:44.929 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.929 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.930 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:44.930 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618010+0000", 2024-04-18T21:06:44.930 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0019581780000000001 2024-04-18T21:06:44.930 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.930 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.930 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:44.930 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618322+0000", 2024-04-18T21:06:44.930 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00031158899999999997 2024-04-18T21:06:44.930 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.930 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.930 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:44.930 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618587+0000", 2024-04-18T21:06:44.931 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00026495700000000002 2024-04-18T21:06:44.931 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.931 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.931 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:44.931 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629262+0000", 2024-04-18T21:06:44.931 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010675877 2024-04-18T21:06:44.931 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.931 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.931 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.931 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.639773+0000", 2024-04-18T21:06:44.931 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0105109 2024-04-18T21:06:44.931 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.932 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.932 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:44.932 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.639926+0000", 2024-04-18T21:06:44.932 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000152349 2024-04-18T21:06:44.932 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.932 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.932 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:44.932 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640064+0000", 2024-04-18T21:06:44.932 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0001384 2024-04-18T21:06:44.932 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:44.932 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:44.932 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:44.933 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.933 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.933 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:44.933 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:44.933 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 99.265321290000003, 2024-04-18T21:06:44.933 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030215005999999999, 2024-04-18T21:06:44.933 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:44.933 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:44.933 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.933 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:44.933 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.933 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:44.934 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:44.934 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:44.934 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.934 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.934 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:44.934 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:44.934 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:44.934 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.934 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.934 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:44.934 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616095+0000", 2024-04-18T21:06:44.935 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.446e-06 2024-04-18T21:06:44.935 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.935 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.935 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:44.935 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616104+0000", 2024-04-18T21:06:44.935 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6200000000000005e-06 2024-04-18T21:06:44.935 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.935 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.935 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:44.935 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616132+0000", 2024-04-18T21:06:44.935 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7668999999999999e-05 2024-04-18T21:06:44.935 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.935 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.936 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.936 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616149+0000", 2024-04-18T21:06:44.936 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7047000000000001e-05 2024-04-18T21:06:44.936 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.936 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.936 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:44.936 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619287+0000", 2024-04-18T21:06:44.936 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0031381450000000002 2024-04-18T21:06:44.936 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.936 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.936 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:44.936 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619503+0000", 2024-04-18T21:06:44.937 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000216522 2024-04-18T21:06:44.937 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.937 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.937 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:44.937 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619930+0000", 2024-04-18T21:06:44.937 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00042604900000000001 2024-04-18T21:06:44.937 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.937 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.937 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:44.937 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629281+0000", 2024-04-18T21:06:44.937 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0093512230000000005 2024-04-18T21:06:44.937 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.937 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.938 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.938 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646022+0000", 2024-04-18T21:06:44.938 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016741156 2024-04-18T21:06:44.938 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.938 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.938 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:44.938 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646198+0000", 2024-04-18T21:06:44.938 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000176009 2024-04-18T21:06:44.938 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.938 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.938 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:44.938 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646309+0000", 2024-04-18T21:06:44.939 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011112000000000001 2024-04-18T21:06:44.939 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:44.939 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:44.939 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:44.939 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.939 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.939 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:44.939 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:44.939 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 99.265236466000005, 2024-04-18T21:06:44.939 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030501176000000001, 2024-04-18T21:06:44.939 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:44.940 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:44.940 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.940 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:44.940 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.940 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:44.940 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:44.940 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:44.940 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.940 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.940 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:44.940 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:44.940 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:44.941 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.941 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.941 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:44.941 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616180+0000", 2024-04-18T21:06:44.941 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1000000000000001e-06 2024-04-18T21:06:44.941 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.941 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.941 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:44.941 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616188+0000", 2024-04-18T21:06:44.941 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4069999999999993e-06 2024-04-18T21:06:44.941 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.941 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.941 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:44.942 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616207+0000", 2024-04-18T21:06:44.942 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8335999999999999e-05 2024-04-18T21:06:44.942 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.942 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.942 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.942 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616225+0000", 2024-04-18T21:06:44.942 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8652999999999999e-05 2024-04-18T21:06:44.942 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.942 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.942 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:44.942 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620977+0000", 2024-04-18T21:06:44.942 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047512220000000003 2024-04-18T21:06:44.943 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.943 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.943 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:44.943 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621279+0000", 2024-04-18T21:06:44.943 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000302646 2024-04-18T21:06:44.943 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.943 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.943 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:44.943 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621584+0000", 2024-04-18T21:06:44.943 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000305142 2024-04-18T21:06:44.943 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.943 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.944 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:44.944 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629352+0000", 2024-04-18T21:06:44.944 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0077673689999999997 2024-04-18T21:06:44.944 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.944 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.944 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.944 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646480+0000", 2024-04-18T21:06:44.944 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017128259 2024-04-18T21:06:44.944 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.944 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.944 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:44.944 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646591+0000", 2024-04-18T21:06:44.945 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011113899999999999 2024-04-18T21:06:44.945 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.945 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.945 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:44.945 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646680+0000", 2024-04-18T21:06:44.945 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8902999999999999e-05 2024-04-18T21:06:44.945 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:44.945 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:44.945 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:44.945 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.945 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.945 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:44.945 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:44.946 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 99.265169967000006, 2024-04-18T21:06:44.946 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030779760999999999, 2024-04-18T21:06:44.946 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:44.946 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:44.946 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.946 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:44.946 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.946 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:44.946 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:44.946 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:44.946 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.946 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.947 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:44.947 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:44.947 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:44.947 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.947 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.947 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:44.947 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616246+0000", 2024-04-18T21:06:44.947 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0499999999999999e-06 2024-04-18T21:06:44.947 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.947 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.947 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:44.947 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616253+0000", 2024-04-18T21:06:44.947 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.5989999999999998e-06 2024-04-18T21:06:44.948 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.948 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.948 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:44.948 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616273+0000", 2024-04-18T21:06:44.948 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9916999999999999e-05 2024-04-18T21:06:44.948 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.948 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.948 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.948 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616287+0000", 2024-04-18T21:06:44.948 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3669000000000001e-05 2024-04-18T21:06:44.948 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.948 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.948 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:44.949 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622203+0000", 2024-04-18T21:06:44.949 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.005916737 2024-04-18T21:06:44.949 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.949 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.949 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:44.949 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622379+0000", 2024-04-18T21:06:44.949 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000175596 2024-04-18T21:06:44.949 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.949 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.949 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:44.949 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622707+0000", 2024-04-18T21:06:44.949 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00032784600000000002 2024-04-18T21:06:44.950 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.950 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.950 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:44.950 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629366+0000", 2024-04-18T21:06:44.950 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0066593279999999999 2024-04-18T21:06:44.950 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.950 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.950 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.950 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646813+0000", 2024-04-18T21:06:44.950 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017447059000000001 2024-04-18T21:06:44.950 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.950 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.951 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:44.951 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646946+0000", 2024-04-18T21:06:44.951 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013301200000000001 2024-04-18T21:06:44.951 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.951 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.951 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:44.951 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647025+0000", 2024-04-18T21:06:44.951 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8948000000000004e-05 2024-04-18T21:06:44.951 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:44.951 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:44.951 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:44.951 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.952 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.952 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:44.952 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:44.952 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 99.265086148999998, 2024-04-18T21:06:44.952 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.031512165000000002, 2024-04-18T21:06:44.952 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:44.952 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:44.952 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.952 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:44.952 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.952 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:44.952 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:44.952 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:44.953 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.953 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.953 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:44.953 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:44.953 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:44.953 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.953 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.953 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:44.953 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616330+0000", 2024-04-18T21:06:44.953 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.15e-06 2024-04-18T21:06:44.953 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.953 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.954 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:44.954 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616337+0000", 2024-04-18T21:06:44.954 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.1289999999999998e-06 2024-04-18T21:06:44.954 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.954 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.954 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:44.954 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616447+0000", 2024-04-18T21:06:44.954 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109561 2024-04-18T21:06:44.954 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.954 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.954 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.954 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616496+0000", 2024-04-18T21:06:44.954 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8591999999999998e-05 2024-04-18T21:06:44.955 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.955 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.955 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:44.955 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.623786+0000", 2024-04-18T21:06:44.955 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0072906799999999999 2024-04-18T21:06:44.955 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.955 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.955 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:44.955 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.623973+0000", 2024-04-18T21:06:44.955 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018717199999999999 2024-04-18T21:06:44.955 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.955 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.955 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:44.956 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624260+0000", 2024-04-18T21:06:44.956 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00028630600000000001 2024-04-18T21:06:44.956 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.956 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.956 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:44.956 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629381+0000", 2024-04-18T21:06:44.956 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0051211340000000003 2024-04-18T21:06:44.956 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.956 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.956 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.956 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647631+0000", 2024-04-18T21:06:44.956 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018249771000000001 2024-04-18T21:06:44.956 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.957 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.957 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:44.957 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647761+0000", 2024-04-18T21:06:44.957 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013037300000000001 2024-04-18T21:06:44.957 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.957 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.957 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:44.957 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647841+0000", 2024-04-18T21:06:44.958 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.0296999999999994e-05 2024-04-18T21:06:44.958 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:44.958 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:44.958 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:44.958 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.958 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.958 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:44.958 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:44.958 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 99.264880665000007, 2024-04-18T21:06:44.958 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043251955000000002, 2024-04-18T21:06:44.958 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:44.958 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:44.958 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.959 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:44.959 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.959 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:44.959 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:44.959 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:44.959 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.959 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.959 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:44.959 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:44.959 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:44.959 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.959 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.960 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:44.960 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616536+0000", 2024-04-18T21:06:44.960 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2869999999999999e-06 2024-04-18T21:06:44.960 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.960 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.960 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:44.960 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616572+0000", 2024-04-18T21:06:44.960 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.6261999999999999e-05 2024-04-18T21:06:44.960 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.960 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.960 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:44.960 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616593+0000", 2024-04-18T21:06:44.961 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1310000000000001e-05 2024-04-18T21:06:44.961 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.961 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.961 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.961 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616614+0000", 2024-04-18T21:06:44.961 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.0936000000000001e-05 2024-04-18T21:06:44.961 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.961 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.961 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:44.961 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629501+0000", 2024-04-18T21:06:44.961 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.012886819000000001 2024-04-18T21:06:44.961 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.962 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.962 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:44.962 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629696+0000", 2024-04-18T21:06:44.962 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019485499999999999 2024-04-18T21:06:44.962 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.962 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.962 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:44.962 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629940+0000", 2024-04-18T21:06:44.962 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00024386399999999999 2024-04-18T21:06:44.962 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.962 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.962 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:44.963 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640100+0000", 2024-04-18T21:06:44.963 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010159645 2024-04-18T21:06:44.963 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.963 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.963 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.963 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659516+0000", 2024-04-18T21:06:44.963 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019416563000000001 2024-04-18T21:06:44.963 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.963 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.963 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:44.963 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659684+0000", 2024-04-18T21:06:44.963 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016750900000000001 2024-04-18T21:06:44.964 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.964 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.964 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:44.964 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659787+0000", 2024-04-18T21:06:44.964 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000102905 2024-04-18T21:06:44.964 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:44.964 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:44.964 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:44.964 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.964 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.964 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:44.965 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:44.965 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 99.264775542999999, 2024-04-18T21:06:44.965 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043581898000000001, 2024-04-18T21:06:44.965 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:44.965 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:44.965 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.965 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:44.965 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.965 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:44.965 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:44.965 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:44.965 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.966 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.966 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:44.966 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:44.966 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:44.966 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.966 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.966 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:44.966 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616641+0000", 2024-04-18T21:06:44.966 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:06:44.966 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.966 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.966 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:44.967 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616648+0000", 2024-04-18T21:06:44.967 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3860000000000001e-06 2024-04-18T21:06:44.967 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.967 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.967 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:44.967 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616666+0000", 2024-04-18T21:06:44.967 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7583000000000001e-05 2024-04-18T21:06:44.967 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.967 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.967 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.967 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616679+0000", 2024-04-18T21:06:44.967 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3322999999999999e-05 2024-04-18T21:06:44.967 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.968 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.968 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:44.968 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630373+0000", 2024-04-18T21:06:44.968 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013694207999999999 2024-04-18T21:06:44.968 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.968 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.968 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:44.968 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630545+0000", 2024-04-18T21:06:44.968 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000171683 2024-04-18T21:06:44.968 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.968 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.968 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:44.969 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630728+0000", 2024-04-18T21:06:44.969 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000182599 2024-04-18T21:06:44.969 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.969 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.969 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:44.969 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640600+0000", 2024-04-18T21:06:44.969 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0098726119999999994 2024-04-18T21:06:44.969 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.969 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.969 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.969 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659927+0000", 2024-04-18T21:06:44.970 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019326724999999999 2024-04-18T21:06:44.970 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.970 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.970 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:44.970 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660112+0000", 2024-04-18T21:06:44.970 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000185203 2024-04-18T21:06:44.970 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.970 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.970 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:44.970 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660222+0000", 2024-04-18T21:06:44.970 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109343 2024-04-18T21:06:44.970 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:44.971 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:44.971 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:44.971 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.971 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.971 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:44.971 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:44.971 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 99.263910185, 2024-04-18T21:06:44.971 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043121310000000003, 2024-04-18T21:06:44.971 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:44.971 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:44.971 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.971 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:44.972 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.972 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:44.972 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:44.972 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:44.972 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.972 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.972 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:44.972 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:44.972 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:44.972 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.972 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.972 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:44.972 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617506+0000", 2024-04-18T21:06:44.973 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9999999999999995e-07 2024-04-18T21:06:44.973 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.973 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.973 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:44.973 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617513+0000", 2024-04-18T21:06:44.973 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.9700000000000002e-06 2024-04-18T21:06:44.973 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.973 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.973 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:44.973 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617531+0000", 2024-04-18T21:06:44.973 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8105999999999999e-05 2024-04-18T21:06:44.974 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.974 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.974 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.974 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617545+0000", 2024-04-18T21:06:44.974 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3703000000000001e-05 2024-04-18T21:06:44.974 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.974 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.974 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:44.974 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632129+0000", 2024-04-18T21:06:44.974 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.014584135999999999 2024-04-18T21:06:44.974 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.974 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.975 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:44.975 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632361+0000", 2024-04-18T21:06:44.975 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023171800000000001 2024-04-18T21:06:44.975 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.975 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.975 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:44.975 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632804+0000", 2024-04-18T21:06:44.975 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000443549 2024-04-18T21:06:44.975 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.975 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.975 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:44.975 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646340+0000", 2024-04-18T21:06:44.976 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013535902000000001 2024-04-18T21:06:44.976 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.976 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.976 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.976 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660363+0000", 2024-04-18T21:06:44.976 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01402318 2024-04-18T21:06:44.976 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.976 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.976 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:44.976 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660523+0000", 2024-04-18T21:06:44.976 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00015989899999999999 2024-04-18T21:06:44.976 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.976 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.977 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:44.977 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660626+0000", 2024-04-18T21:06:44.977 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010314699999999999 2024-04-18T21:06:44.977 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:44.977 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:44.977 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:44.977 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.977 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.977 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:44.977 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:44.977 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 99.263770492000006, 2024-04-18T21:06:44.977 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024927483, 2024-04-18T21:06:44.977 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:44.978 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:44.978 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.978 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:44.978 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.978 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:44.978 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:44.978 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:44.978 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.978 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.978 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:44.978 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:44.978 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:44.979 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.979 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.979 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:44.979 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617646+0000", 2024-04-18T21:06:44.979 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3030000000000001e-06 2024-04-18T21:06:44.979 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.979 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.979 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:44.979 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617653+0000", 2024-04-18T21:06:44.979 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7530000000000004e-06 2024-04-18T21:06:44.979 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.979 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.980 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:44.980 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617673+0000", 2024-04-18T21:06:44.980 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9967e-05 2024-04-18T21:06:44.980 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.980 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.980 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.980 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617688+0000", 2024-04-18T21:06:44.980 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5153e-05 2024-04-18T21:06:44.980 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.980 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.980 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:44.980 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619244+0000", 2024-04-18T21:06:44.981 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001555531 2024-04-18T21:06:44.981 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.981 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.981 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:44.981 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619361+0000", 2024-04-18T21:06:44.981 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011784400000000001 2024-04-18T21:06:44.981 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.981 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.981 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:44.981 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619604+0000", 2024-04-18T21:06:44.981 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000243007 2024-04-18T21:06:44.981 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.981 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.982 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:44.982 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.625480+0000", 2024-04-18T21:06:44.982 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0058759349999999997 2024-04-18T21:06:44.982 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.982 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.982 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.982 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642342+0000", 2024-04-18T21:06:44.982 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016861373999999998 2024-04-18T21:06:44.982 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.982 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.982 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:44.982 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642484+0000", 2024-04-18T21:06:44.983 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000142423 2024-04-18T21:06:44.983 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.983 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.983 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:44.983 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642572+0000", 2024-04-18T21:06:44.983 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8193000000000001e-05 2024-04-18T21:06:44.983 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:44.983 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:44.983 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:44.983 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.983 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.983 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:44.984 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:44.984 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 99.263488988999995, 2024-04-18T21:06:44.984 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024956974999999999, 2024-04-18T21:06:44.984 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:44.984 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:44.984 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.984 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:44.984 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.984 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:44.984 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:44.984 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:44.984 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.984 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.985 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:44.985 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:44.985 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:44.985 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.985 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.985 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:44.985 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617928+0000", 2024-04-18T21:06:44.985 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5430000000000001e-06 2024-04-18T21:06:44.985 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.985 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.985 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:44.985 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617937+0000", 2024-04-18T21:06:44.986 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6629999999999999e-06 2024-04-18T21:06:44.986 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.986 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.986 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:44.986 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617955+0000", 2024-04-18T21:06:44.986 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8749999999999998e-05 2024-04-18T21:06:44.986 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.986 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.986 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.986 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617971+0000", 2024-04-18T21:06:44.986 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.605e-05 2024-04-18T21:06:44.986 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.987 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.987 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:44.987 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621019+0000", 2024-04-18T21:06:44.987 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0030472369999999999 2024-04-18T21:06:44.987 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.987 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.987 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:44.987 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621249+0000", 2024-04-18T21:06:44.987 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000230075 2024-04-18T21:06:44.987 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.987 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.987 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:44.987 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621450+0000", 2024-04-18T21:06:44.987 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020166499999999999 2024-04-18T21:06:44.988 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.988 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.988 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:44.988 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.626233+0000", 2024-04-18T21:06:44.988 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047827390000000003 2024-04-18T21:06:44.988 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.988 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.988 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.988 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642693+0000", 2024-04-18T21:06:44.988 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01645961 2024-04-18T21:06:44.988 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.988 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.989 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:44.989 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642798+0000", 2024-04-18T21:06:44.989 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010559499999999999 2024-04-18T21:06:44.989 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.989 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.989 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:44.989 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642883+0000", 2024-04-18T21:06:44.989 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5048000000000003e-05 2024-04-18T21:06:44.989 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:44.989 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:44.989 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:44.989 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.989 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.990 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:44.990 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:44.990 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 99.261793361000002, 2024-04-18T21:06:44.990 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024086478000000001, 2024-04-18T21:06:44.990 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:44.990 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:44.990 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.990 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:44.990 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.990 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:44.990 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:44.990 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:44.991 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.991 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.991 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:44.991 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:44.991 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:44.991 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.991 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.991 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:44.991 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619624+0000", 2024-04-18T21:06:44.991 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.75e-06 2024-04-18T21:06:44.991 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.991 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.991 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:44.992 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619637+0000", 2024-04-18T21:06:44.992 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3540000000000001e-05 2024-04-18T21:06:44.992 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.992 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.992 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:44.992 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619666+0000", 2024-04-18T21:06:44.992 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8685999999999999e-05 2024-04-18T21:06:44.992 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.992 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.992 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.992 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619685+0000", 2024-04-18T21:06:44.992 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8681999999999998e-05 2024-04-18T21:06:44.993 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.993 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.993 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:44.993 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622275+0000", 2024-04-18T21:06:44.993 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0025899260000000002 2024-04-18T21:06:44.993 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.993 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.993 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:44.993 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622572+0000", 2024-04-18T21:06:44.993 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00029722 2024-04-18T21:06:44.993 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.993 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.994 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:44.994 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622752+0000", 2024-04-18T21:06:44.994 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018065900000000001 2024-04-18T21:06:44.994 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.994 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.994 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:44.994 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.626326+0000", 2024-04-18T21:06:44.994 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035737310000000001 2024-04-18T21:06:44.994 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.994 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.994 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:44.994 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643565+0000", 2024-04-18T21:06:44.995 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017238430999999999 2024-04-18T21:06:44.995 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.995 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.995 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:44.995 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643646+0000", 2024-04-18T21:06:44.995 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.1481000000000001e-05 2024-04-18T21:06:44.995 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.995 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.995 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:44.995 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643708+0000", 2024-04-18T21:06:44.995 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.2372000000000005e-05 2024-04-18T21:06:44.995 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:44.995 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:44.995 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:44.996 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.996 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.996 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:44.996 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:44.996 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 99.261627207999993, 2024-04-18T21:06:44.996 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026822450000000001, 2024-04-18T21:06:44.996 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:44.996 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:44.996 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:44.996 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:44.996 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.996 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:44.996 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:44.997 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:44.997 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.997 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.997 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:44.997 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:44.997 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:44.997 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.997 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.997 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:44.997 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619789+0000", 2024-04-18T21:06:44.997 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:06:44.997 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.998 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.998 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:44.998 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619797+0000", 2024-04-18T21:06:44.998 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.6899999999999992e-06 2024-04-18T21:06:44.998 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.998 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.998 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:44.998 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619816+0000", 2024-04-18T21:06:44.998 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9352999999999999e-05 2024-04-18T21:06:44.998 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.998 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.998 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:44.999 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619832+0000", 2024-04-18T21:06:44.999 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6013000000000001e-05 2024-04-18T21:06:44.999 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.999 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.999 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:44.999 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620528+0000", 2024-04-18T21:06:44.999 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00069565600000000001 2024-04-18T21:06:44.999 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:44.999 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:44.999 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:44.999 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620735+0000", 2024-04-18T21:06:44.999 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000207025 2024-04-18T21:06:45.000 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:45.000 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:45.000 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:45.000 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620912+0000", 2024-04-18T21:06:45.000 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017748199999999999 2024-04-18T21:06:45.000 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:45.000 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:45.000 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:45.000 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.625605+0000", 2024-04-18T21:06:45.000 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0046924439999999996 2024-04-18T21:06:45.000 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:45.000 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:45.000 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:45.001 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646349+0000", 2024-04-18T21:06:45.001 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.020744318000000001 2024-04-18T21:06:45.001 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:45.001 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:45.001 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:45.001 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646483+0000", 2024-04-18T21:06:45.001 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013428999999999999 2024-04-18T21:06:45.001 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:45.001 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:45.001 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:45.001 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646611+0000", 2024-04-18T21:06:45.001 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012710299999999999 2024-04-18T21:06:45.001 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:45.002 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:45.002 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:45.002 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:45.002 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:45.002 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:45.002 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:06:45.002 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 99.260956774999997, 2024-04-18T21:06:45.002 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023516516000000001, 2024-04-18T21:06:45.002 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:45.002 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:45.002 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:06:45.002 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:45.003 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:45.003 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:45.003 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:06:45.003 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:45.003 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:45.003 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:45.003 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:45.003 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:06:45.003 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:45.003 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:45.003 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:45.003 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:45.003 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620460+0000", 2024-04-18T21:06:45.004 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.787e-06 2024-04-18T21:06:45.004 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:45.004 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:45.004 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:45.004 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620470+0000", 2024-04-18T21:06:45.004 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.2560000000000008e-06 2024-04-18T21:06:45.004 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:45.004 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:45.004 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:45.004 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620496+0000", 2024-04-18T21:06:45.004 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.6205999999999999e-05 2024-04-18T21:06:45.004 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:45.005 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:45.005 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:45.005 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620517+0000", 2024-04-18T21:06:45.005 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1223e-05 2024-04-18T21:06:45.005 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:45.005 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:45.005 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:45.005 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624060+0000", 2024-04-18T21:06:45.005 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035434160000000002 2024-04-18T21:06:45.005 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:45.005 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:45.005 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:45.005 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624390+0000", 2024-04-18T21:06:45.006 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00033000500000000002 2024-04-18T21:06:45.006 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:45.006 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:45.006 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:45.006 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643975+0000", 2024-04-18T21:06:45.006 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019584622999999999 2024-04-18T21:06:45.006 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:45.006 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:45.006 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:45.006 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:45.006 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:45.006 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:45.008 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:45.009 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:45.006+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:45.108 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:45.107+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:45.151 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:06:45.151 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [ 2024-04-18T21:06:45.151 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.151 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(client.4534.0:4796 4.1 4:81e2f1ab:::10000001686.00000000:head [write 0~740 in=740b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-18T21:06:45.152 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:06:45.152510+0000", 2024-04-18T21:06:45.152 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 0.0022626539999999998, 2024-04-18T21:06:45.152 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0022829090000000001, 2024-04-18T21:06:45.152 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:45.152 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:45.152 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:06:45.152 INFO:teuthology.orchestra.run.smithi150.stdout: "client_info": { 2024-04-18T21:06:45.152 INFO:teuthology.orchestra.run.smithi150.stdout: "client": "client.4534", 2024-04-18T21:06:45.152 INFO:teuthology.orchestra.run.smithi150.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:45.152 INFO:teuthology.orchestra.run.smithi150.stdout: "tid": 4796 2024-04-18T21:06:45.152 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.152 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:45.153 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.153 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:45.153 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:45.152510+0000", 2024-04-18T21:06:45.153 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:45.153 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.153 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.153 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:45.153 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:45.152510+0000", 2024-04-18T21:06:45.153 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:45.153 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.153 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.154 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:45.154 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:45.152512+0000", 2024-04-18T21:06:45.154 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6670000000000001e-06 2024-04-18T21:06:45.154 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.154 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.154 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:45.154 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:45.152520+0000", 2024-04-18T21:06:45.154 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.2630000000000003e-06 2024-04-18T21:06:45.154 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.154 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.154 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:45.154 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:45.152542+0000", 2024-04-18T21:06:45.155 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.1662e-05 2024-04-18T21:06:45.155 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.155 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.155 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:45.155 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:45.152556+0000", 2024-04-18T21:06:45.155 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.489e-05 2024-04-18T21:06:45.155 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.155 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.155 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:45.155 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:45.152674+0000", 2024-04-18T21:06:45.155 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000117353 2024-04-18T21:06:45.155 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.156 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.156 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:45.156 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:45.152890+0000", 2024-04-18T21:06:45.156 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000216455 2024-04-18T21:06:45.156 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.156 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.156 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:45.156 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:45.153120+0000", 2024-04-18T21:06:45.156 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00022965099999999999 2024-04-18T21:06:45.156 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.156 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.156 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:45.156 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:45.153973+0000", 2024-04-18T21:06:45.156 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00085338500000000002 2024-04-18T21:06:45.157 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:45.157 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:45.157 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:45.157 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.157 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.157 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop_reply(client.4534.0:4796 4.1 e51/16)", 2024-04-18T21:06:45.157 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:06:45.154767+0000", 2024-04-18T21:06:45.157 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 5.2750000000000003e-06, 2024-04-18T21:06:45.157 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.3281000000000005e-05, 2024-04-18T21:06:45.157 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:45.157 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:45.158 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "queued for pg", 2024-04-18T21:06:45.158 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:45.158 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.158 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:45.158 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:45.154767+0000", 2024-04-18T21:06:45.158 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:45.158 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.158 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.158 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:45.158 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:45.154767+0000", 2024-04-18T21:06:45.158 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:45.158 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.158 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.158 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:45.159 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:45.154768+0000", 2024-04-18T21:06:45.159 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.9300000000000006e-07 2024-04-18T21:06:45.159 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.159 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.159 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:45.159 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:45.154777+0000", 2024-04-18T21:06:45.159 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.1400000000000006e-06 2024-04-18T21:06:45.159 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.159 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.159 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:45.159 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:45.154793+0000", 2024-04-18T21:06:45.159 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.509e-05 2024-04-18T21:06:45.159 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.159 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.160 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:45.160 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:45.154805+0000", 2024-04-18T21:06:45.160 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2917e-05 2024-04-18T21:06:45.160 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:45.160 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:45.160 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:45.160 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:45.160 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-04-18T21:06:45.160 INFO:teuthology.orchestra.run.smithi150.stdout: "num_ops": 2 2024-04-18T21:06:45.160 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:06:45.167 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:45.209 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:45.206+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:45.309 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:45.311+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:45.346 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:06:45.346 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [], 2024-04-18T21:06:45.346 INFO:teuthology.orchestra.run.smithi150.stdout: "complaint_time": 30, 2024-04-18T21:06:45.346 INFO:teuthology.orchestra.run.smithi150.stdout: "num_blocked_ops": 0 2024-04-18T21:06:45.346 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:06:45.361 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:45.411 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:45.410+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:45.512 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:45.510+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:45.550 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:06:45.550 INFO:teuthology.orchestra.run.smithi150.stdout: "size": 20, 2024-04-18T21:06:45.551 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 600, 2024-04-18T21:06:45.551 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [ 2024-04-18T21:06:45.551 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.551 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4142.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-18T21:06:45.551 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:06:45.551 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 110.745172005, 2024-04-18T21:06:45.551 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0093051590000000003, 2024-04-18T21:06:45.551 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:45.551 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:45.551 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:45.551 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:45.551 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.551 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:45.551 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:06:45.551 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:45.552 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.552 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.552 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:45.552 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804849+0000", 2024-04-18T21:06:45.552 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:45.552 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.552 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.552 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:45.552 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804851+0000", 2024-04-18T21:06:45.552 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7039999999999999e-06 2024-04-18T21:06:45.552 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.552 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.552 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:45.552 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804864+0000", 2024-04-18T21:06:45.553 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.276e-05 2024-04-18T21:06:45.553 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.553 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.553 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:45.553 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804895+0000", 2024-04-18T21:06:45.553 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.1204999999999997e-05 2024-04-18T21:06:45.553 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.553 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.553 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:45.553 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.804908+0000", 2024-04-18T21:06:45.553 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3317e-05 2024-04-18T21:06:45.553 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.553 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.553 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:45.553 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805131+0000", 2024-04-18T21:06:45.554 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00022246700000000001 2024-04-18T21:06:45.554 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.554 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.554 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:45.554 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.805171+0000", 2024-04-18T21:06:45.554 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.0164999999999999e-05 2024-04-18T21:06:45.554 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.554 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.554 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:45.554 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814086+0000", 2024-04-18T21:06:45.554 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0089155329999999998 2024-04-18T21:06:45.554 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.554 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.554 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:45.555 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:04:54.814154+0000", 2024-04-18T21:06:45.555 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.8008000000000003e-05 2024-04-18T21:06:45.555 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:45.555 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:45.555 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:45.555 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.555 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.555 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:45.555 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:06:45.555 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 99.934726397999995, 2024-04-18T21:06:45.555 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.040843365, 2024-04-18T21:06:45.555 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:45.555 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:45.555 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:45.555 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:45.556 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.556 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:45.556 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:06:45.556 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:45.556 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.556 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.556 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:45.556 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:06:45.556 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:45.556 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.556 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.556 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:45.556 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615297+0000", 2024-04-18T21:06:45.556 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2800000000000002e-06 2024-04-18T21:06:45.556 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.557 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.557 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:45.557 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615308+0000", 2024-04-18T21:06:45.557 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0813e-05 2024-04-18T21:06:45.557 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.557 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.557 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:45.557 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615330+0000", 2024-04-18T21:06:45.557 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2370000000000001e-05 2024-04-18T21:06:45.557 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.557 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.557 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:45.557 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615346+0000", 2024-04-18T21:06:45.557 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6200000000000001e-05 2024-04-18T21:06:45.557 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.558 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.558 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:45.558 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615470+0000", 2024-04-18T21:06:45.558 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012385799999999999 2024-04-18T21:06:45.558 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.558 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.558 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:45.558 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615488+0000", 2024-04-18T21:06:45.558 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7923000000000001e-05 2024-04-18T21:06:45.558 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.558 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.558 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:45.558 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.630993+0000", 2024-04-18T21:06:45.559 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.01550532 2024-04-18T21:06:45.559 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.559 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.559 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:45.559 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631165+0000", 2024-04-18T21:06:45.559 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000171588 2024-04-18T21:06:45.559 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.559 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.559 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:45.559 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631320+0000", 2024-04-18T21:06:45.559 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000155162 2024-04-18T21:06:45.559 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.559 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.559 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:45.560 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635157+0000", 2024-04-18T21:06:45.560 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0038370790000000002 2024-04-18T21:06:45.560 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.560 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.560 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:45.560 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.655904+0000", 2024-04-18T21:06:45.560 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.020746483999999999 2024-04-18T21:06:45.560 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.560 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.560 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:45.560 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656032+0000", 2024-04-18T21:06:45.560 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012864199999999999 2024-04-18T21:06:45.560 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.560 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.560 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:45.561 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656138+0000", 2024-04-18T21:06:45.561 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000105646 2024-04-18T21:06:45.561 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:45.561 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:45.561 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:45.561 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.561 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.561 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:45.561 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:06:45.561 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 99.934634226, 2024-04-18T21:06:45.561 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.041266444999999999, 2024-04-18T21:06:45.561 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:45.561 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:45.561 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:45.562 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:45.562 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.562 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:45.562 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:06:45.562 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:45.562 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.562 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.562 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:45.562 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:06:45.562 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:45.562 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.562 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.562 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:45.562 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615388+0000", 2024-04-18T21:06:45.563 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:06:45.563 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.563 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.563 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:45.563 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:06:45.563 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.7299999999999994e-06 2024-04-18T21:06:45.563 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.563 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.563 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:45.563 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615415+0000", 2024-04-18T21:06:45.563 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7807000000000001e-05 2024-04-18T21:06:45.563 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.563 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.563 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:45.563 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615431+0000", 2024-04-18T21:06:45.564 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6127e-05 2024-04-18T21:06:45.564 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.564 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.564 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:45.564 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615621+0000", 2024-04-18T21:06:45.564 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000189781 2024-04-18T21:06:45.564 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.564 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.564 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:45.564 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615634+0000", 2024-04-18T21:06:45.564 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3383e-05 2024-04-18T21:06:45.564 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.564 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.564 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:45.565 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631703+0000", 2024-04-18T21:06:45.565 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016068737 2024-04-18T21:06:45.565 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.565 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.565 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:45.565 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631809+0000", 2024-04-18T21:06:45.565 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000106823 2024-04-18T21:06:45.565 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.565 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.565 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:45.565 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631988+0000", 2024-04-18T21:06:45.565 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000179008 2024-04-18T21:06:45.565 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.565 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.566 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:45.566 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635172+0000", 2024-04-18T21:06:45.566 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.003183029 2024-04-18T21:06:45.566 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.566 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.566 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:45.566 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656392+0000", 2024-04-18T21:06:45.566 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.021220638999999999 2024-04-18T21:06:45.566 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.566 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.566 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:45.566 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656533+0000", 2024-04-18T21:06:45.566 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014126500000000001 2024-04-18T21:06:45.566 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.567 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.567 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:45.567 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656653+0000", 2024-04-18T21:06:45.567 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000119883 2024-04-18T21:06:45.567 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:45.567 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:45.567 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:45.567 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.567 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.567 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:45.567 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:06:45.567 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 99.934546803000003, 2024-04-18T21:06:45.567 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.042492302000000003, 2024-04-18T21:06:45.567 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:45.567 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:45.568 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:45.568 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:45.568 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.568 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:45.568 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:06:45.568 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:45.568 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.568 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.568 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:45.568 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:06:45.568 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:45.568 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.568 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.568 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:45.568 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615475+0000", 2024-04-18T21:06:45.569 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.17e-06 2024-04-18T21:06:45.569 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.569 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.569 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:45.569 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615528+0000", 2024-04-18T21:06:45.569 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.2159e-05 2024-04-18T21:06:45.569 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.569 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.569 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:45.569 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615542+0000", 2024-04-18T21:06:45.569 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4197e-05 2024-04-18T21:06:45.569 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.569 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.569 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:45.569 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615559+0000", 2024-04-18T21:06:45.570 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.749e-05 2024-04-18T21:06:45.570 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.570 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.570 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:45.570 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615685+0000", 2024-04-18T21:06:45.570 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012617499999999999 2024-04-18T21:06:45.570 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.570 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.570 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:45.570 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:06:45.570 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4749999999999999e-05 2024-04-18T21:06:45.570 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.570 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.570 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:45.571 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632332+0000", 2024-04-18T21:06:45.571 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016631988 2024-04-18T21:06:45.571 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.571 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.571 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:45.571 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632477+0000", 2024-04-18T21:06:45.571 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014437200000000001 2024-04-18T21:06:45.571 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.571 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.571 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:45.571 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632620+0000", 2024-04-18T21:06:45.571 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000143566 2024-04-18T21:06:45.571 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.571 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.571 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:45.572 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635185+0000", 2024-04-18T21:06:45.572 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0025644209999999999 2024-04-18T21:06:45.572 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.572 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.572 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:45.572 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657803+0000", 2024-04-18T21:06:45.572 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.022618743 2024-04-18T21:06:45.572 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.572 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.572 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:45.572 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657890+0000", 2024-04-18T21:06:45.572 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.6688999999999996e-05 2024-04-18T21:06:45.572 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.572 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.573 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:45.573 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657967+0000", 2024-04-18T21:06:45.573 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.6582000000000006e-05 2024-04-18T21:06:45.573 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:45.573 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:45.573 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:45.573 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.573 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.573 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:45.573 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:06:45.573 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 99.934415990999995, 2024-04-18T21:06:45.573 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.043603435000000003, 2024-04-18T21:06:45.573 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:45.573 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:45.573 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:45.574 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:45.574 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.574 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:45.574 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:06:45.574 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:45.574 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.574 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.574 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:45.574 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:06:45.574 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:45.574 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.574 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.574 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:45.574 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615607+0000", 2024-04-18T21:06:45.574 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4300000000000001e-06 2024-04-18T21:06:45.575 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.575 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.575 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:45.575 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615614+0000", 2024-04-18T21:06:45.575 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.4100000000000002e-06 2024-04-18T21:06:45.575 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.575 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.575 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:45.575 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615632+0000", 2024-04-18T21:06:45.575 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7863000000000002e-05 2024-04-18T21:06:45.575 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.575 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.575 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:45.575 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615647+0000", 2024-04-18T21:06:45.576 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5187e-05 2024-04-18T21:06:45.576 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.576 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.576 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:45.576 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615765+0000", 2024-04-18T21:06:45.576 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000117955 2024-04-18T21:06:45.576 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.576 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.576 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:45.576 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615781+0000", 2024-04-18T21:06:45.576 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6123000000000001e-05 2024-04-18T21:06:45.576 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.576 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.576 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:45.576 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633055+0000", 2024-04-18T21:06:45.576 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.017273909 2024-04-18T21:06:45.577 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.577 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.577 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:45.577 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633254+0000", 2024-04-18T21:06:45.577 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00019903799999999999 2024-04-18T21:06:45.577 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.577 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.577 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:45.577 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633624+0000", 2024-04-18T21:06:45.577 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000369656 2024-04-18T21:06:45.577 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.577 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.577 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:45.577 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635595+0000", 2024-04-18T21:06:45.578 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001971287 2024-04-18T21:06:45.578 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.578 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.578 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:45.578 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659026+0000", 2024-04-18T21:06:45.578 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.023431495 2024-04-18T21:06:45.578 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.578 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.578 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:45.578 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659117+0000", 2024-04-18T21:06:45.578 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0885999999999997e-05 2024-04-18T21:06:45.578 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.578 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.579 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:45.579 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659209+0000", 2024-04-18T21:06:45.579 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.1195999999999999e-05 2024-04-18T21:06:45.579 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:45.579 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:45.579 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:45.579 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.579 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.579 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:45.579 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:45.579 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 99.934350761999994, 2024-04-18T21:06:45.579 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.03492514, 2024-04-18T21:06:45.579 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:45.579 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:45.579 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:45.580 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:45.580 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.580 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:45.580 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:45.580 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:45.580 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.580 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.580 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:45.580 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:45.580 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:45.580 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.580 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.580 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:45.580 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:06:45.580 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.407e-06 2024-04-18T21:06:45.581 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.581 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.581 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:45.581 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615679+0000", 2024-04-18T21:06:45.581 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.2130000000000002e-06 2024-04-18T21:06:45.581 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.581 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.581 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:45.581 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615701+0000", 2024-04-18T21:06:45.581 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2316000000000001e-05 2024-04-18T21:06:45.581 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.581 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.581 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:45.581 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615717+0000", 2024-04-18T21:06:45.581 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6197000000000001e-05 2024-04-18T21:06:45.582 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.582 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.582 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:45.582 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615828+0000", 2024-04-18T21:06:45.582 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000110899 2024-04-18T21:06:45.582 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.582 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.582 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:45.582 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615840+0000", 2024-04-18T21:06:45.582 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.1423000000000001e-05 2024-04-18T21:06:45.582 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.582 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.582 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:45.583 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628046+0000", 2024-04-18T21:06:45.583 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.012206295000000001 2024-04-18T21:06:45.583 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.583 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.583 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:45.583 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628323+0000", 2024-04-18T21:06:45.583 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00027658700000000001 2024-04-18T21:06:45.583 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.583 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.583 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:45.583 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628599+0000", 2024-04-18T21:06:45.583 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00027676699999999997 2024-04-18T21:06:45.583 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.583 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.583 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:45.583 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634869+0000", 2024-04-18T21:06:45.584 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.006269536 2024-04-18T21:06:45.584 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.584 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.584 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:45.584 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650333+0000", 2024-04-18T21:06:45.584 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.015463645999999999 2024-04-18T21:06:45.584 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.584 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.584 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:45.584 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650474+0000", 2024-04-18T21:06:45.584 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014091799999999999 2024-04-18T21:06:45.584 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.584 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.584 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:45.585 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650595+0000", 2024-04-18T21:06:45.585 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012193600000000001 2024-04-18T21:06:45.585 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:45.585 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:45.585 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:45.585 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.585 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.585 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:45.585 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:06:45.585 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 99.934265652999997, 2024-04-18T21:06:45.585 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.040588320999999997, 2024-04-18T21:06:45.585 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:45.585 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:45.585 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:45.585 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:45.586 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.586 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:45.586 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:06:45.586 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:45.586 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.586 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.586 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:45.586 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:06:45.586 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:45.586 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.586 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.586 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:45.586 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615757+0000", 2024-04-18T21:06:45.587 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2270000000000001e-06 2024-04-18T21:06:45.587 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.587 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.587 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:45.587 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615765+0000", 2024-04-18T21:06:45.587 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.9400000000000002e-06 2024-04-18T21:06:45.587 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.587 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.587 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:45.587 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615785+0000", 2024-04-18T21:06:45.587 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.0749000000000001e-05 2024-04-18T21:06:45.587 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.587 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.587 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:45.587 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615804+0000", 2024-04-18T21:06:45.588 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.8774e-05 2024-04-18T21:06:45.588 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.588 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.588 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:45.588 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615888+0000", 2024-04-18T21:06:45.588 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.4111999999999997e-05 2024-04-18T21:06:45.588 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.588 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.588 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:45.588 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615895+0000", 2024-04-18T21:06:45.588 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.0469999999999996e-06 2024-04-18T21:06:45.588 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.588 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.588 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:45.589 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629280+0000", 2024-04-18T21:06:45.589 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.013384416 2024-04-18T21:06:45.589 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.589 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.589 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:45.589 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629488+0000", 2024-04-18T21:06:45.589 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00020852800000000001 2024-04-18T21:06:45.589 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.589 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.589 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:45.589 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629869+0000", 2024-04-18T21:06:45.589 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00038042300000000001 2024-04-18T21:06:45.589 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.589 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.589 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:45.590 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635041+0000", 2024-04-18T21:06:45.590 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.005172383 2024-04-18T21:06:45.590 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.590 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.590 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:45.590 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656125+0000", 2024-04-18T21:06:45.590 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.021084025999999999 2024-04-18T21:06:45.590 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.590 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.590 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:45.590 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656240+0000", 2024-04-18T21:06:45.590 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000115352 2024-04-18T21:06:45.591 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.591 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.591 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:45.591 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656344+0000", 2024-04-18T21:06:45.591 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00010334400000000001 2024-04-18T21:06:45.591 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:45.591 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:45.591 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:45.591 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.591 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.591 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:45.591 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:45.591 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 99.934198332999998, 2024-04-18T21:06:45.591 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.043549577999999999, 2024-04-18T21:06:45.591 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:45.592 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:45.592 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:45.592 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:45.592 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.592 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:45.592 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:45.592 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:45.592 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.592 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.592 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:45.592 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:45.592 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:45.592 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.592 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.593 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:45.593 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:45.593 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.5000000000000002e-07 2024-04-18T21:06:45.593 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.593 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.593 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:45.593 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615828+0000", 2024-04-18T21:06:45.593 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.2359999999999998e-06 2024-04-18T21:06:45.593 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.593 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.593 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:45.593 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615838+0000", 2024-04-18T21:06:45.593 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0087e-05 2024-04-18T21:06:45.593 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.593 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.594 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:45.594 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615846+0000", 2024-04-18T21:06:45.594 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.67e-06 2024-04-18T21:06:45.594 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.594 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.594 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:45.594 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615963+0000", 2024-04-18T21:06:45.594 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00011630500000000001 2024-04-18T21:06:45.594 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.594 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.594 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:45.594 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615979+0000", 2024-04-18T21:06:45.594 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.613e-05 2024-04-18T21:06:45.595 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.595 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.595 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:45.595 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632392+0000", 2024-04-18T21:06:45.595 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016413317 2024-04-18T21:06:45.595 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.595 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.595 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:45.595 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632568+0000", 2024-04-18T21:06:45.595 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00017539500000000001 2024-04-18T21:06:45.595 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.595 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.595 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:45.595 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632748+0000", 2024-04-18T21:06:45.595 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00017991799999999999 2024-04-18T21:06:45.596 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.596 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.596 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:45.596 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635542+0000", 2024-04-18T21:06:45.596 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00279481 2024-04-18T21:06:45.596 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.596 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.596 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:45.596 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659232+0000", 2024-04-18T21:06:45.596 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.023689212000000001 2024-04-18T21:06:45.596 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.596 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.596 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:45.596 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659314+0000", 2024-04-18T21:06:45.596 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.2528999999999995e-05 2024-04-18T21:06:45.597 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.597 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.597 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:45.597 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659372+0000", 2024-04-18T21:06:45.597 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.8218999999999999e-05 2024-04-18T21:06:45.597 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:45.597 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:45.597 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:45.597 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.597 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.597 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:45.597 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:06:45.597 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 99.934136901000002, 2024-04-18T21:06:45.597 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.039335347, 2024-04-18T21:06:45.597 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:45.598 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:45.598 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "started", 2024-04-18T21:06:45.598 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:45.598 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.598 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:45.598 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:06:45.598 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:45.598 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.598 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.598 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:45.598 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:06:45.598 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:45.598 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.598 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.599 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:45.599 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615885+0000", 2024-04-18T21:06:45.599 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2699999999999999e-06 2024-04-18T21:06:45.599 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.599 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.599 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:45.599 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615892+0000", 2024-04-18T21:06:45.599 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.6499999999999999e-06 2024-04-18T21:06:45.599 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.599 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.599 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:45.599 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615906+0000", 2024-04-18T21:06:45.599 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.393e-05 2024-04-18T21:06:45.599 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.599 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.600 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:45.600 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615919+0000", 2024-04-18T21:06:45.600 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2860000000000001e-05 2024-04-18T21:06:45.600 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.600 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.600 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:45.600 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616027+0000", 2024-04-18T21:06:45.600 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000107852 2024-04-18T21:06:45.600 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.600 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.600 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:45.600 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616037+0000", 2024-04-18T21:06:45.600 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:06:45.600 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.600 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.601 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:45.601 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622719+0000", 2024-04-18T21:06:45.601 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0066817220000000002 2024-04-18T21:06:45.601 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.601 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.601 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:45.601 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623006+0000", 2024-04-18T21:06:45.601 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00028783699999999999 2024-04-18T21:06:45.601 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.601 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.601 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:45.601 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.655220+0000", 2024-04-18T21:06:45.601 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.032213036 2024-04-18T21:06:45.601 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:45.601 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:45.602 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:45.602 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.602 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.602 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:45.602 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:45.602 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 99.934081227999997, 2024-04-18T21:06:45.602 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.032845253999999997, 2024-04-18T21:06:45.602 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:45.602 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:45.602 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "started", 2024-04-18T21:06:45.602 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:45.602 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.602 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:45.602 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:45.602 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:45.603 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.603 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.603 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:45.603 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:45.603 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:45.603 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.603 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.603 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:45.603 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615942+0000", 2024-04-18T21:06:45.603 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.717e-06 2024-04-18T21:06:45.603 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.603 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.603 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:45.603 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615946+0000", 2024-04-18T21:06:45.603 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.6e-06 2024-04-18T21:06:45.604 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.604 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.604 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:45.604 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615960+0000", 2024-04-18T21:06:45.604 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:06:45.604 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.604 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.604 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:45.604 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615968+0000", 2024-04-18T21:06:45.604 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.9070000000000007e-06 2024-04-18T21:06:45.604 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.604 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.604 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:45.604 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616100+0000", 2024-04-18T21:06:45.604 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000132402 2024-04-18T21:06:45.605 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.605 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.605 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:45.605 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616117+0000", 2024-04-18T21:06:45.605 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6653000000000001e-05 2024-04-18T21:06:45.605 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.605 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.605 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:45.605 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621566+0000", 2024-04-18T21:06:45.605 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0054497740000000001 2024-04-18T21:06:45.605 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.605 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.605 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:45.605 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622801+0000", 2024-04-18T21:06:45.605 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0012345710000000001 2024-04-18T21:06:45.606 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.606 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.606 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:45.606 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648785+0000", 2024-04-18T21:06:45.606 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.025984104000000001 2024-04-18T21:06:45.606 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:45.606 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:45.606 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:45.606 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.606 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.606 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:45.606 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:06:45.606 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 99.928229877999996, 2024-04-18T21:06:45.607 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.011561350999999999, 2024-04-18T21:06:45.607 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:45.607 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:45.607 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:45.607 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:45.607 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.607 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:45.607 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:06:45.607 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:45.607 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.607 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.607 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:45.607 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:06:45.607 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:45.608 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.608 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.608 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:45.608 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621792+0000", 2024-04-18T21:06:45.608 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.4000000000000001e-07 2024-04-18T21:06:45.608 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.608 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.608 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:45.608 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:06:45.608 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.1050000000000002e-05 2024-04-18T21:06:45.608 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.608 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.608 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:45.608 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622608+0000", 2024-04-18T21:06:45.608 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00077505900000000003 2024-04-18T21:06:45.609 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.609 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.609 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:45.609 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623879+0000", 2024-04-18T21:06:45.609 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0012705839999999999 2024-04-18T21:06:45.609 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.609 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.609 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:45.609 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624010+0000", 2024-04-18T21:06:45.609 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00013176900000000001 2024-04-18T21:06:45.609 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.609 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.609 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:45.609 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624058+0000", 2024-04-18T21:06:45.609 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.7299000000000002e-05 2024-04-18T21:06:45.610 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.610 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.610 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:45.610 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633262+0000", 2024-04-18T21:06:45.610 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0092048770000000002 2024-04-18T21:06:45.610 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.610 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.610 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:45.610 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633353+0000", 2024-04-18T21:06:45.610 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0073000000000003e-05 2024-04-18T21:06:45.610 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:45.610 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:45.610 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:45.610 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.610 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.611 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:45.611 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:06:45.611 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 99.926102491999998, 2024-04-18T21:06:45.611 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0098419370000000003, 2024-04-18T21:06:45.611 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:45.611 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:45.611 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:45.611 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:45.611 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.611 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:45.611 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:06:45.611 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:45.611 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.611 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.611 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:45.612 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623919+0000", 2024-04-18T21:06:45.612 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:45.612 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.612 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.612 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:45.612 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623920+0000", 2024-04-18T21:06:45.612 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2240000000000001e-06 2024-04-18T21:06:45.612 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.612 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.612 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:45.612 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623933+0000", 2024-04-18T21:06:45.612 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3653e-05 2024-04-18T21:06:45.612 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.612 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.612 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:45.612 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623956+0000", 2024-04-18T21:06:45.613 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2059e-05 2024-04-18T21:06:45.613 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.613 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.613 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:45.613 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623975+0000", 2024-04-18T21:06:45.613 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.9806999999999999e-05 2024-04-18T21:06:45.613 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.613 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.613 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:45.613 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626943+0000", 2024-04-18T21:06:45.613 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0029681579999999998 2024-04-18T21:06:45.613 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.613 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.613 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:45.613 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.626993+0000", 2024-04-18T21:06:45.614 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.9935999999999998e-05 2024-04-18T21:06:45.614 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.614 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.614 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:45.614 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633665+0000", 2024-04-18T21:06:45.614 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0066719250000000004 2024-04-18T21:06:45.614 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.614 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.614 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:45.614 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633761+0000", 2024-04-18T21:06:45.614 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.5174999999999996e-05 2024-04-18T21:06:45.614 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:45.614 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:45.614 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:45.614 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.615 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.615 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:45.615 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:06:45.615 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 99.902249363999999, 2024-04-18T21:06:45.615 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0095703190000000007, 2024-04-18T21:06:45.615 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:45.615 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:45.615 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:45.615 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:45.615 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.615 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:45.615 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:06:45.615 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:45.615 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.615 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.616 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:45.616 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647772+0000", 2024-04-18T21:06:45.616 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:45.616 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.616 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.616 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:45.616 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647773+0000", 2024-04-18T21:06:45.616 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.046e-06 2024-04-18T21:06:45.616 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.616 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.616 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:45.616 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647795+0000", 2024-04-18T21:06:45.616 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2616000000000002e-05 2024-04-18T21:06:45.616 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.616 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.617 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:45.617 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647818+0000", 2024-04-18T21:06:45.617 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.3110000000000001e-05 2024-04-18T21:06:45.617 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.617 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.617 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:45.617 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.647834+0000", 2024-04-18T21:06:45.617 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5163e-05 2024-04-18T21:06:45.617 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.617 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.617 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:45.617 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650682+0000", 2024-04-18T21:06:45.617 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0028479759999999999 2024-04-18T21:06:45.617 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.618 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.618 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:45.618 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650730+0000", 2024-04-18T21:06:45.618 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.8375999999999999e-05 2024-04-18T21:06:45.618 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.618 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.618 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:45.618 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656751+0000", 2024-04-18T21:06:45.618 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0060211880000000002 2024-04-18T21:06:45.618 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.618 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.618 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:45.618 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657342+0000", 2024-04-18T21:06:45.619 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00059084399999999998 2024-04-18T21:06:45.619 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:45.619 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:45.619 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:45.619 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.619 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.619 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(client.4534.0:1156 4.14 4:28a2fcee:::10000000768.00000000:head [write 0~3012] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-18T21:06:45.619 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:06:40.762398+0000", 2024-04-18T21:06:45.619 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 4.7876230629999998, 2024-04-18T21:06:45.619 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0095362490000000001, 2024-04-18T21:06:45.619 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:45.619 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:45.619 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:45.619 INFO:teuthology.orchestra.run.smithi150.stdout: "client_info": { 2024-04-18T21:06:45.619 INFO:teuthology.orchestra.run.smithi150.stdout: "client": "client.4534", 2024-04-18T21:06:45.620 INFO:teuthology.orchestra.run.smithi150.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:45.620 INFO:teuthology.orchestra.run.smithi150.stdout: "tid": 1156 2024-04-18T21:06:45.620 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.620 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:45.620 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.620 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:45.620 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:40.762398+0000", 2024-04-18T21:06:45.620 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:45.620 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.620 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.620 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:45.620 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:40.762398+0000", 2024-04-18T21:06:45.620 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:45.620 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.620 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.621 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:45.621 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:40.762400+0000", 2024-04-18T21:06:45.621 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2699999999999999e-06 2024-04-18T21:06:45.621 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.621 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.621 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:45.621 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:40.762414+0000", 2024-04-18T21:06:45.621 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3607e-05 2024-04-18T21:06:45.621 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.621 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.621 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:45.621 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:40.762480+0000", 2024-04-18T21:06:45.621 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.6252000000000002e-05 2024-04-18T21:06:45.621 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.622 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.622 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:45.622 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:40.762500+0000", 2024-04-18T21:06:45.622 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.9894e-05 2024-04-18T21:06:45.622 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.622 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.622 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:45.622 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:40.762687+0000", 2024-04-18T21:06:45.622 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00018719799999999999 2024-04-18T21:06:45.622 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.622 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.622 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:45.622 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:40.763026+0000", 2024-04-18T21:06:45.622 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00033882399999999999 2024-04-18T21:06:45.623 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.623 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.623 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:45.623 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:40.763409+0000", 2024-04-18T21:06:45.623 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000382863 2024-04-18T21:06:45.623 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.623 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.623 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:45.623 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:40.764798+0000", 2024-04-18T21:06:45.623 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001389464 2024-04-18T21:06:45.623 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.623 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.623 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:45.623 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:40.771727+0000", 2024-04-18T21:06:45.624 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.006928343 2024-04-18T21:06:45.624 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.624 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.624 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:45.624 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:40.771856+0000", 2024-04-18T21:06:45.624 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012932800000000001 2024-04-18T21:06:45.624 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.624 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.624 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:45.624 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:40.771934+0000", 2024-04-18T21:06:45.624 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.8206000000000003e-05 2024-04-18T21:06:45.624 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:45.624 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:45.624 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:45.624 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.625 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.625 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(client.4534.0:1434 4.9 4:933e433d:::1000000088b.00000000:head [write 0~2488] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-18T21:06:45.625 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:06:41.032218+0000", 2024-04-18T21:06:45.625 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 4.517803217, 2024-04-18T21:06:45.625 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0096837620000000003, 2024-04-18T21:06:45.625 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:45.625 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:45.625 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:45.625 INFO:teuthology.orchestra.run.smithi150.stdout: "client_info": { 2024-04-18T21:06:45.625 INFO:teuthology.orchestra.run.smithi150.stdout: "client": "client.4534", 2024-04-18T21:06:45.625 INFO:teuthology.orchestra.run.smithi150.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:45.625 INFO:teuthology.orchestra.run.smithi150.stdout: "tid": 1434 2024-04-18T21:06:45.625 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.625 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:45.625 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.626 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:45.626 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.032218+0000", 2024-04-18T21:06:45.626 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:45.626 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.626 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.626 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:45.626 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.032218+0000", 2024-04-18T21:06:45.626 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:45.626 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.626 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.626 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:45.626 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.032220+0000", 2024-04-18T21:06:45.626 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.804e-06 2024-04-18T21:06:45.626 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.626 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.627 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:45.627 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.032231+0000", 2024-04-18T21:06:45.627 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0879999999999999e-05 2024-04-18T21:06:45.627 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.627 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.627 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:45.627 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.032250+0000", 2024-04-18T21:06:45.627 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.9913000000000001e-05 2024-04-18T21:06:45.627 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.627 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.627 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:45.627 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.032264+0000", 2024-04-18T21:06:45.627 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3247e-05 2024-04-18T21:06:45.627 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.627 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.627 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:45.628 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.032379+0000", 2024-04-18T21:06:45.628 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00011575500000000001 2024-04-18T21:06:45.628 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.628 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.628 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:45.628 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.032657+0000", 2024-04-18T21:06:45.628 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00027785400000000001 2024-04-18T21:06:45.628 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.628 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.628 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:45.628 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.032864+0000", 2024-04-18T21:06:45.628 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00020635799999999999 2024-04-18T21:06:45.628 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.628 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.628 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:45.629 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.034445+0000", 2024-04-18T21:06:45.629 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001581739 2024-04-18T21:06:45.629 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.629 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.629 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:45.629 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.041732+0000", 2024-04-18T21:06:45.629 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0072867030000000003 2024-04-18T21:06:45.629 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.629 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.629 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:45.629 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.041838+0000", 2024-04-18T21:06:45.629 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000105763 2024-04-18T21:06:45.629 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.629 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.629 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:45.630 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.041902+0000", 2024-04-18T21:06:45.630 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.3745999999999996e-05 2024-04-18T21:06:45.630 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:45.630 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:45.630 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:45.630 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.630 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.630 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(client.4534.0:1436 4.3b 4:dff36f63:::1000000088d.00000000:head [write 0~2490] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-18T21:06:45.630 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:06:41.033942+0000", 2024-04-18T21:06:45.630 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 4.5160792389999997, 2024-04-18T21:06:45.630 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.010154763000000001, 2024-04-18T21:06:45.630 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:45.630 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:45.631 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:45.631 INFO:teuthology.orchestra.run.smithi150.stdout: "client_info": { 2024-04-18T21:06:45.631 INFO:teuthology.orchestra.run.smithi150.stdout: "client": "client.4534", 2024-04-18T21:06:45.631 INFO:teuthology.orchestra.run.smithi150.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:45.631 INFO:teuthology.orchestra.run.smithi150.stdout: "tid": 1436 2024-04-18T21:06:45.631 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.631 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:45.631 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.631 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:45.631 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.033942+0000", 2024-04-18T21:06:45.631 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:45.631 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.631 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.631 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:45.631 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.033942+0000", 2024-04-18T21:06:45.632 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:45.632 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.632 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.632 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:45.632 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.033944+0000", 2024-04-18T21:06:45.632 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.4370000000000001e-06 2024-04-18T21:06:45.632 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.632 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.632 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:45.632 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.033960+0000", 2024-04-18T21:06:45.632 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5492999999999999e-05 2024-04-18T21:06:45.632 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.632 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.632 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:45.632 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.033990+0000", 2024-04-18T21:06:45.633 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.0490000000000001e-05 2024-04-18T21:06:45.633 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.633 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.633 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:45.633 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.034011+0000", 2024-04-18T21:06:45.633 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.0843e-05 2024-04-18T21:06:45.633 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.633 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.633 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:45.633 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.034132+0000", 2024-04-18T21:06:45.633 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012118899999999999 2024-04-18T21:06:45.633 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.633 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.633 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:45.633 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.034362+0000", 2024-04-18T21:06:45.634 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00022924800000000001 2024-04-18T21:06:45.634 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.634 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.634 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:45.634 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.034659+0000", 2024-04-18T21:06:45.634 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00029773700000000001 2024-04-18T21:06:45.634 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.634 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.634 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:45.634 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.036064+0000", 2024-04-18T21:06:45.634 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0014046270000000001 2024-04-18T21:06:45.634 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.634 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.634 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:45.635 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.043846+0000", 2024-04-18T21:06:45.635 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0077818150000000001 2024-04-18T21:06:45.635 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.635 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.635 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:45.635 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.043982+0000", 2024-04-18T21:06:45.635 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00013665500000000001 2024-04-18T21:06:45.635 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.635 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.635 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:45.635 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.044097+0000", 2024-04-18T21:06:45.635 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00011422899999999999 2024-04-18T21:06:45.635 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:45.635 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:45.635 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:45.635 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.636 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.636 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(client.4534.0:1437 4.2 4:423b93e7:::1000000088e.00000000:head [write 0~2491] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-18T21:06:45.636 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:06:41.034717+0000", 2024-04-18T21:06:45.636 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 4.5153038429999999, 2024-04-18T21:06:45.636 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0094424239999999996, 2024-04-18T21:06:45.636 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:45.636 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:45.636 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:45.636 INFO:teuthology.orchestra.run.smithi150.stdout: "client_info": { 2024-04-18T21:06:45.636 INFO:teuthology.orchestra.run.smithi150.stdout: "client": "client.4534", 2024-04-18T21:06:45.636 INFO:teuthology.orchestra.run.smithi150.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:45.636 INFO:teuthology.orchestra.run.smithi150.stdout: "tid": 1437 2024-04-18T21:06:45.636 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.636 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:45.637 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.637 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:45.637 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.034717+0000", 2024-04-18T21:06:45.637 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:45.637 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.637 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.637 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:45.637 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.034717+0000", 2024-04-18T21:06:45.637 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:45.637 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.637 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.637 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:45.637 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.034719+0000", 2024-04-18T21:06:45.637 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.244e-06 2024-04-18T21:06:45.637 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.638 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.638 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:45.638 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.034733+0000", 2024-04-18T21:06:45.638 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3419e-05 2024-04-18T21:06:45.638 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.638 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.638 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:45.638 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.034750+0000", 2024-04-18T21:06:45.638 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6906999999999999e-05 2024-04-18T21:06:45.638 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.638 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.638 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:45.638 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.034762+0000", 2024-04-18T21:06:45.638 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2553e-05 2024-04-18T21:06:45.639 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.639 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.639 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:45.639 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.034851+0000", 2024-04-18T21:06:45.639 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.8739000000000005e-05 2024-04-18T21:06:45.639 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.639 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.639 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:45.639 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.035076+0000", 2024-04-18T21:06:45.639 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00022516800000000001 2024-04-18T21:06:45.639 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.639 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.639 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:45.639 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.035320+0000", 2024-04-18T21:06:45.639 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000243995 2024-04-18T21:06:45.640 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.640 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.640 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:45.640 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.037227+0000", 2024-04-18T21:06:45.640 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001906823 2024-04-18T21:06:45.640 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.640 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.640 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:45.640 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.043894+0000", 2024-04-18T21:06:45.640 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0066672049999999998 2024-04-18T21:06:45.640 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.640 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.640 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:45.640 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.044023+0000", 2024-04-18T21:06:45.640 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012901500000000001 2024-04-18T21:06:45.641 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.641 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.641 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:45.641 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.044160+0000", 2024-04-18T21:06:45.641 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00013635599999999999 2024-04-18T21:06:45.641 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:45.641 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:45.641 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:45.641 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.641 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.641 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4534.0:1562 4.31 e50/16 4:8c019499:::10000000915.00000000:head v 50'24, mlcod=50'22)", 2024-04-18T21:06:45.641 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:06:41.148969+0000", 2024-04-18T21:06:45.641 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 4.4010516019999999, 2024-04-18T21:06:45.641 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0092636070000000001, 2024-04-18T21:06:45.641 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:45.642 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:45.642 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:45.642 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:45.642 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.642 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:45.642 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.148969+0000", 2024-04-18T21:06:45.642 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:45.642 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.642 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.642 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:45.642 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.148969+0000", 2024-04-18T21:06:45.642 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:45.642 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.642 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.642 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:45.643 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.148971+0000", 2024-04-18T21:06:45.643 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2860000000000001e-06 2024-04-18T21:06:45.643 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.643 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.643 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:45.643 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.148988+0000", 2024-04-18T21:06:45.643 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.751e-05 2024-04-18T21:06:45.643 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.643 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.643 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:45.643 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.149003+0000", 2024-04-18T21:06:45.643 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4999e-05 2024-04-18T21:06:45.643 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.643 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.643 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:45.644 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.149013+0000", 2024-04-18T21:06:45.644 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.2799999999999992e-06 2024-04-18T21:06:45.644 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.644 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.644 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:45.644 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.149121+0000", 2024-04-18T21:06:45.644 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000108829 2024-04-18T21:06:45.644 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.644 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.644 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:45.644 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.149160+0000", 2024-04-18T21:06:45.644 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.8529999999999999e-05 2024-04-18T21:06:45.644 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.644 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.645 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:45.645 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.158164+0000", 2024-04-18T21:06:45.645 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0090040109999999993 2024-04-18T21:06:45.645 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.645 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.645 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:45.645 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.158233+0000", 2024-04-18T21:06:45.645 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.9162e-05 2024-04-18T21:06:45.645 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:45.645 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:45.645 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:45.645 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.645 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.645 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(client.4534.0:1577 4.3b 4:dd758eab:::10000000925.00000000:head [write 0~2459] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-18T21:06:45.645 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:06:41.161985+0000", 2024-04-18T21:06:45.646 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 4.3880357060000001, 2024-04-18T21:06:45.646 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.010166364000000001, 2024-04-18T21:06:45.646 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:45.646 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:45.646 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:45.646 INFO:teuthology.orchestra.run.smithi150.stdout: "client_info": { 2024-04-18T21:06:45.646 INFO:teuthology.orchestra.run.smithi150.stdout: "client": "client.4534", 2024-04-18T21:06:45.646 INFO:teuthology.orchestra.run.smithi150.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:45.646 INFO:teuthology.orchestra.run.smithi150.stdout: "tid": 1577 2024-04-18T21:06:45.646 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.646 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:45.646 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.646 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:45.646 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.161985+0000", 2024-04-18T21:06:45.647 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:45.647 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.647 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.647 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:45.647 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.161985+0000", 2024-04-18T21:06:45.647 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:45.647 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.647 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.647 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:45.647 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.161987+0000", 2024-04-18T21:06:45.647 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.477e-06 2024-04-18T21:06:45.647 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.647 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.648 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:45.648 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.161996+0000", 2024-04-18T21:06:45.648 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.9269999999999994e-06 2024-04-18T21:06:45.648 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.648 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.648 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:45.648 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.162013+0000", 2024-04-18T21:06:45.648 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7499999999999998e-05 2024-04-18T21:06:45.648 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.648 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.648 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:45.648 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.162024+0000", 2024-04-18T21:06:45.648 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0426e-05 2024-04-18T21:06:45.648 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.648 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.649 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:45.649 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.162146+0000", 2024-04-18T21:06:45.649 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012264900000000001 2024-04-18T21:06:45.649 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.649 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.649 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:45.649 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.162467+0000", 2024-04-18T21:06:45.649 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00032042399999999998 2024-04-18T21:06:45.649 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.649 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.649 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:45.649 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.162841+0000", 2024-04-18T21:06:45.649 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00037397599999999999 2024-04-18T21:06:45.649 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.650 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.650 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:45.650 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.164177+0000", 2024-04-18T21:06:45.650 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001336385 2024-04-18T21:06:45.650 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.650 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.650 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:45.650 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.171894+0000", 2024-04-18T21:06:45.650 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0077171490000000004 2024-04-18T21:06:45.650 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.650 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.650 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:45.650 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.172023+0000", 2024-04-18T21:06:45.650 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012887900000000001 2024-04-18T21:06:45.651 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.651 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.651 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:45.651 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.172152+0000", 2024-04-18T21:06:45.651 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000128572 2024-04-18T21:06:45.651 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:45.651 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:45.651 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:45.651 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.651 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.651 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(client.4534.0:1578 4.24 4:25a617e1:::10000000926.00000000:head [write 0~2453] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-18T21:06:45.651 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:06:41.162788+0000", 2024-04-18T21:06:45.651 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 4.387233009, 2024-04-18T21:06:45.651 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0094157770000000002, 2024-04-18T21:06:45.651 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:45.652 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:45.652 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:45.652 INFO:teuthology.orchestra.run.smithi150.stdout: "client_info": { 2024-04-18T21:06:45.652 INFO:teuthology.orchestra.run.smithi150.stdout: "client": "client.4534", 2024-04-18T21:06:45.652 INFO:teuthology.orchestra.run.smithi150.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:45.652 INFO:teuthology.orchestra.run.smithi150.stdout: "tid": 1578 2024-04-18T21:06:45.652 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.652 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:45.652 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.652 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:45.652 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.162788+0000", 2024-04-18T21:06:45.652 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:45.652 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.652 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.652 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:45.653 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.162788+0000", 2024-04-18T21:06:45.653 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:45.653 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.653 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.653 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:45.653 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.162789+0000", 2024-04-18T21:06:45.653 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.426e-06 2024-04-18T21:06:45.653 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.653 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.653 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:45.653 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.162798+0000", 2024-04-18T21:06:45.653 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.0839999999999992e-06 2024-04-18T21:06:45.653 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.653 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.653 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:45.654 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.162815+0000", 2024-04-18T21:06:45.654 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7745999999999999e-05 2024-04-18T21:06:45.654 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.654 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.654 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:45.654 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.162826+0000", 2024-04-18T21:06:45.654 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.098e-05 2024-04-18T21:06:45.654 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.654 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.654 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:45.654 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.162976+0000", 2024-04-18T21:06:45.654 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014927199999999999 2024-04-18T21:06:45.654 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.655 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.655 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:45.655 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.163203+0000", 2024-04-18T21:06:45.655 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00022780399999999999 2024-04-18T21:06:45.655 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.655 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.655 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:45.655 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.163473+0000", 2024-04-18T21:06:45.655 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000269838 2024-04-18T21:06:45.655 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.655 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.655 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:45.655 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.165742+0000", 2024-04-18T21:06:45.655 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0022690560000000002 2024-04-18T21:06:45.655 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.655 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.656 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:45.656 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.172002+0000", 2024-04-18T21:06:45.656 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0062600659999999999 2024-04-18T21:06:45.656 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.656 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.656 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:45.656 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.172135+0000", 2024-04-18T21:06:45.656 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00013241199999999999 2024-04-18T21:06:45.656 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:45.656 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:45.656 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:45.656 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:41.172204+0000", 2024-04-18T21:06:45.656 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.9092999999999997e-05 2024-04-18T21:06:45.656 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:45.656 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:45.657 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:45.657 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:45.657 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:45.657 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:06:45.658 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:45.659 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:45.654+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:45.755 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-18T21:06:45.758 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:45.754+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:45.802 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:45.802 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:06:45.802 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.802 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:120 3.1f 3.1ba6bc1f (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:45.802 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.782808+0000", 2024-04-18T21:06:45.802 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.018557490999999999, 2024-04-18T21:06:45.802 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018595614999999999, 2024-04-18T21:06:45.803 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:45.803 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:45.803 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-18T21:06:45.803 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:45.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.803 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:45.803 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.782808+0000", 2024-04-18T21:06:45.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:45.803 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.803 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:45.803 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.782808+0000", 2024-04-18T21:06:45.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:45.803 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.804 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:45.804 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.782809+0000", 2024-04-18T21:06:45.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0100000000000001e-06 2024-04-18T21:06:45.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.804 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:45.804 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.782821+0000", 2024-04-18T21:06:45.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1901e-05 2024-04-18T21:06:45.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.804 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:45.804 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.782834+0000", 2024-04-18T21:06:45.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3305000000000001e-05 2024-04-18T21:06:45.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.804 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:45.805 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.782843+0000", 2024-04-18T21:06:45.805 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5439999999999999e-06 2024-04-18T21:06:45.805 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.805 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:45.805 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.805 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.805 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.805 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:121 3.1f 3.1ba6bc1f (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:45.805 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.783094+0000", 2024-04-18T21:06:45.805 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.018271116, 2024-04-18T21:06:45.805 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018438474, 2024-04-18T21:06:45.805 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:45.805 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:45.805 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-18T21:06:45.805 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:45.806 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.806 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:45.806 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.783094+0000", 2024-04-18T21:06:45.806 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:45.806 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.806 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.806 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:45.806 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.783094+0000", 2024-04-18T21:06:45.806 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:45.806 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.806 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.806 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:45.806 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.783095+0000", 2024-04-18T21:06:45.806 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:06:45.807 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.807 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.807 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:45.807 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.783101+0000", 2024-04-18T21:06:45.807 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9030000000000001e-06 2024-04-18T21:06:45.807 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.807 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.807 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:45.807 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.783115+0000", 2024-04-18T21:06:45.807 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3872e-05 2024-04-18T21:06:45.807 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.807 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.807 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:45.807 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.783124+0000", 2024-04-18T21:06:45.807 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6249999999999996e-06 2024-04-18T21:06:45.808 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.808 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:45.808 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.808 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.808 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.808 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:112 3.1f 3.1ba6bc1f (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:45.808 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.771321+0000", 2024-04-18T21:06:45.808 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.030044511999999999, 2024-04-18T21:06:45.808 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.030268113999999999, 2024-04-18T21:06:45.808 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:45.808 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:45.808 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-18T21:06:45.808 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:45.808 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:45.809 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771321+0000", 2024-04-18T21:06:45.809 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:45.809 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.809 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:45.809 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771321+0000", 2024-04-18T21:06:45.809 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:45.809 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.809 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:45.809 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771323+0000", 2024-04-18T21:06:45.809 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3740000000000001e-06 2024-04-18T21:06:45.809 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.809 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:45.809 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771359+0000", 2024-04-18T21:06:45.810 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5447999999999997e-05 2024-04-18T21:06:45.810 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.810 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.810 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:45.810 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771388+0000", 2024-04-18T21:06:45.810 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8915e-05 2024-04-18T21:06:45.810 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.810 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.810 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:45.810 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771410+0000", 2024-04-18T21:06:45.810 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1899000000000002e-05 2024-04-18T21:06:45.810 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.810 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:45.810 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.810 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.811 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.811 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:113 3.1f 3.1ba6bc1f (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:45.811 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.771472+0000", 2024-04-18T21:06:45.811 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.029893776, 2024-04-18T21:06:45.811 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.030170991000000001, 2024-04-18T21:06:45.811 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:45.811 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:45.811 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-18T21:06:45.811 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:45.811 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.811 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:45.811 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771472+0000", 2024-04-18T21:06:45.811 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:45.811 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.811 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.812 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:45.812 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771472+0000", 2024-04-18T21:06:45.812 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:45.812 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.812 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.812 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:45.812 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771473+0000", 2024-04-18T21:06:45.812 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3829999999999999e-06 2024-04-18T21:06:45.812 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.812 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.812 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:45.812 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771489+0000", 2024-04-18T21:06:45.812 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5797000000000001e-05 2024-04-18T21:06:45.813 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.813 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.813 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:45.813 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771509+0000", 2024-04-18T21:06:45.813 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0401999999999999e-05 2024-04-18T21:06:45.813 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.813 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.813 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:45.813 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771525+0000", 2024-04-18T21:06:45.813 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5099999999999999e-05 2024-04-18T21:06:45.813 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.813 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:45.813 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.813 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.814 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.814 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:114 3.1f 3.1ba6bc1f (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:45.814 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.771785+0000", 2024-04-18T21:06:45.814 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.029580431000000001, 2024-04-18T21:06:45.814 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.029910187000000001, 2024-04-18T21:06:45.814 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:45.814 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:45.814 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-18T21:06:45.814 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:45.814 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.814 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:45.814 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771785+0000", 2024-04-18T21:06:45.814 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:45.814 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.815 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.815 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:45.815 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771785+0000", 2024-04-18T21:06:45.815 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:45.815 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.815 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.815 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:45.815 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771787+0000", 2024-04-18T21:06:45.815 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0600000000000002e-06 2024-04-18T21:06:45.815 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.815 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.815 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:45.815 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771799+0000", 2024-04-18T21:06:45.815 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1503e-05 2024-04-18T21:06:45.816 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.816 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.816 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:45.816 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771829+0000", 2024-04-18T21:06:45.816 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.04e-05 2024-04-18T21:06:45.816 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.816 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.816 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:45.816 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771846+0000", 2024-04-18T21:06:45.816 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6608000000000001e-05 2024-04-18T21:06:45.816 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.816 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:45.816 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.816 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.817 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.817 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:100 3.1f 3:f83d65d8:::200.00000004:head [write 315055~1400 [fadvise_dontneed] in=1400b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:45.817 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757681+0000", 2024-04-18T21:06:45.817 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.043684560999999997, 2024-04-18T21:06:45.817 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.044121368000000001, 2024-04-18T21:06:45.817 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:45.817 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:45.817 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:06:45.817 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:45.817 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.817 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:45.817 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757681+0000", 2024-04-18T21:06:45.817 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:45.817 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.817 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.818 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:45.818 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757681+0000", 2024-04-18T21:06:45.818 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:45.818 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.818 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.818 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:45.818 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757682+0000", 2024-04-18T21:06:45.818 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8999999999999996e-07 2024-04-18T21:06:45.818 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.818 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.818 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:45.818 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757685+0000", 2024-04-18T21:06:45.818 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.766e-06 2024-04-18T21:06:45.818 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.819 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.819 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:45.819 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757715+0000", 2024-04-18T21:06:45.819 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9904e-05 2024-04-18T21:06:45.819 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.819 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.819 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:45.819 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757723+0000", 2024-04-18T21:06:45.819 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9899999999999997e-06 2024-04-18T21:06:45.819 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.819 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.819 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:45.819 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.796754+0000", 2024-04-18T21:06:45.819 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.039030774999999997 2024-04-18T21:06:45.819 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.820 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.820 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:45.820 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.796825+0000", 2024-04-18T21:06:45.820 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0511000000000003e-05 2024-04-18T21:06:45.820 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.820 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.820 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:45.820 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.796952+0000", 2024-04-18T21:06:45.820 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012720099999999999 2024-04-18T21:06:45.820 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.820 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.820 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:45.820 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.800774+0000", 2024-04-18T21:06:45.820 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0038226039999999998 2024-04-18T21:06:45.820 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.821 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:45.821 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.821 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.821 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.821 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:101 3.1f 3:f83d65d8:::200.00000004:head [write 316455~1401 [fadvise_dontneed] in=1401b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:45.821 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:06:45.821 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.043631797999999999, 2024-04-18T21:06:45.821 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.044151409000000003, 2024-04-18T21:06:45.821 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:45.821 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:45.821 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:06:45.821 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:45.821 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.821 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:45.822 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:06:45.822 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:45.822 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.822 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.822 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:45.822 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:06:45.822 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:45.822 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.822 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.822 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:45.822 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:06:45.822 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7700000000000004e-07 2024-04-18T21:06:45.823 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.823 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.823 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:45.823 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757745+0000", 2024-04-18T21:06:45.823 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0910000000000001e-05 2024-04-18T21:06:45.823 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.823 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.823 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:45.823 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757758+0000", 2024-04-18T21:06:45.823 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2593e-05 2024-04-18T21:06:45.823 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.823 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.823 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:45.823 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757765+0000", 2024-04-18T21:06:45.824 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1659999999999997e-06 2024-04-18T21:06:45.824 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.824 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.824 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:45.824 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.797782+0000", 2024-04-18T21:06:45.824 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.040017283000000001 2024-04-18T21:06:45.824 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.824 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.824 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:45.824 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.797949+0000", 2024-04-18T21:06:45.824 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016650399999999999 2024-04-18T21:06:45.824 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.824 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.824 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:45.824 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.798152+0000", 2024-04-18T21:06:45.825 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000203098 2024-04-18T21:06:45.825 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.825 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.825 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:45.825 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.800792+0000", 2024-04-18T21:06:45.825 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026394779999999998 2024-04-18T21:06:45.825 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.825 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:45.825 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.825 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.825 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.825 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:102 3.1f 3:f83d65d8:::200.00000004:head [write 317856~1403 [fadvise_dontneed] in=1403b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:45.825 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757775+0000", 2024-04-18T21:06:45.825 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.043590732, 2024-04-18T21:06:45.825 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.044192720999999997, 2024-04-18T21:06:45.826 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:45.826 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:45.826 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:06:45.826 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:45.826 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.826 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:45.826 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757775+0000", 2024-04-18T21:06:45.826 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:45.826 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.826 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.826 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:45.826 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757775+0000", 2024-04-18T21:06:45.826 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:45.826 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.827 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.827 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:45.827 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757776+0000", 2024-04-18T21:06:45.827 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5300000000000004e-07 2024-04-18T21:06:45.827 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.827 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.827 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:45.827 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757780+0000", 2024-04-18T21:06:45.827 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2270000000000004e-06 2024-04-18T21:06:45.827 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.827 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.827 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:45.827 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757792+0000", 2024-04-18T21:06:45.827 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2696e-05 2024-04-18T21:06:45.827 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.827 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.828 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:45.828 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757800+0000", 2024-04-18T21:06:45.828 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1439999999999997e-06 2024-04-18T21:06:45.828 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.828 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.828 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:45.828 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.798773+0000", 2024-04-18T21:06:45.828 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.040973074999999998 2024-04-18T21:06:45.828 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.828 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.828 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:45.828 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.798990+0000", 2024-04-18T21:06:45.828 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000217161 2024-04-18T21:06:45.828 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.828 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.828 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:45.828 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.799173+0000", 2024-04-18T21:06:45.829 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018295900000000001 2024-04-18T21:06:45.829 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.829 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:45.829 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.829 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.829 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.829 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:103 3.1f 3:f83d65d8:::200.00000004:head [write 319259~1404 [fadvise_dontneed] in=1404b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:45.829 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:06:45.829 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.043556886000000003, 2024-04-18T21:06:45.829 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.044279539, 2024-04-18T21:06:45.829 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:45.829 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:45.829 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:06:45.829 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:45.829 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.830 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:45.830 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:06:45.830 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:45.830 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.830 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.830 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:45.830 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:06:45.830 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:45.830 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.830 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.830 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:45.830 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:06:45.830 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4700000000000001e-07 2024-04-18T21:06:45.831 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.831 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.831 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:45.831 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757814+0000", 2024-04-18T21:06:45.831 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1829999999999996e-06 2024-04-18T21:06:45.831 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.831 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.831 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:45.831 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757825+0000", 2024-04-18T21:06:45.831 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1754e-05 2024-04-18T21:06:45.831 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.831 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.831 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:45.831 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757832+0000", 2024-04-18T21:06:45.831 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8430000000000004e-06 2024-04-18T21:06:45.831 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.832 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.832 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:45.832 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.799809+0000", 2024-04-18T21:06:45.832 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.041976960000000001 2024-04-18T21:06:45.832 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.832 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.832 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:45.832 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.799934+0000", 2024-04-18T21:06:45.832 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000125053 2024-04-18T21:06:45.832 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.832 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.832 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:45.832 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.800067+0000", 2024-04-18T21:06:45.832 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013276299999999999 2024-04-18T21:06:45.832 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.832 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:45.833 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.833 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.833 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.833 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:104 3.1f 3:f83d65d8:::200.00000004:head [write 320663~1405 [fadvise_dontneed] in=1405b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:45.833 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757841+0000", 2024-04-18T21:06:45.833 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.043524682000000002, 2024-04-18T21:06:45.833 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.044340444999999999, 2024-04-18T21:06:45.833 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:45.833 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:45.833 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:06:45.833 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:45.833 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.833 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:45.833 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757841+0000", 2024-04-18T21:06:45.833 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:45.834 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.834 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.834 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:45.834 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757841+0000", 2024-04-18T21:06:45.834 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:45.834 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.834 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.834 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:45.834 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757842+0000", 2024-04-18T21:06:45.834 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5000000000000002e-07 2024-04-18T21:06:45.834 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.834 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.834 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:45.834 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757852+0000", 2024-04-18T21:06:45.834 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.084e-05 2024-04-18T21:06:45.835 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.835 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.835 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:45.835 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757865+0000", 2024-04-18T21:06:45.835 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2643000000000001e-05 2024-04-18T21:06:45.835 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.835 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.835 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:45.835 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757872+0000", 2024-04-18T21:06:45.835 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8689999999999998e-06 2024-04-18T21:06:45.835 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.835 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.835 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:45.835 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.801102+0000", 2024-04-18T21:06:45.835 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043229837 2024-04-18T21:06:45.836 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.836 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.836 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:45.836 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.801291+0000", 2024-04-18T21:06:45.836 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000189641 2024-04-18T21:06:45.836 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.836 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.836 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:45.836 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.801640+0000", 2024-04-18T21:06:45.836 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000348971 2024-04-18T21:06:45.836 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.836 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:45.836 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.836 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.837 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.837 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:105 3.1f 3.1ba6bc1f (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:45.837 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:06:45.837 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.043484085999999998, 2024-04-18T21:06:45.837 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.044474614000000003, 2024-04-18T21:06:45.837 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:45.837 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:45.837 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-18T21:06:45.837 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:45.837 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.837 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:45.837 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:06:45.837 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:45.837 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.837 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.838 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:45.838 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:06:45.838 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:45.838 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.838 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.838 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:45.838 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:06:45.838 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2600000000000002e-07 2024-04-18T21:06:45.838 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.838 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.838 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:45.838 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757888+0000", 2024-04-18T21:06:45.838 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7130000000000002e-06 2024-04-18T21:06:45.839 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.839 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.839 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:45.839 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757906+0000", 2024-04-18T21:06:45.839 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7723999999999998e-05 2024-04-18T21:06:45.839 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.839 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.839 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:45.839 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757921+0000", 2024-04-18T21:06:45.839 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4936000000000001e-05 2024-04-18T21:06:45.839 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.839 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:45.839 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.839 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.839 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.840 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:115 3.1f 3.1ba6bc1f (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:45.840 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.775991+0000", 2024-04-18T21:06:45.840 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.02537474, 2024-04-18T21:06:45.840 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.026441718999999999, 2024-04-18T21:06:45.840 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:45.840 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:45.840 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-18T21:06:45.840 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:45.840 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.840 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:45.840 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.775991+0000", 2024-04-18T21:06:45.840 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:45.840 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.840 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.841 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:45.841 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.775991+0000", 2024-04-18T21:06:45.841 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:45.841 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.841 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.841 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:45.841 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.775993+0000", 2024-04-18T21:06:45.841 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5689999999999999e-06 2024-04-18T21:06:45.841 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.841 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.841 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:45.841 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.776020+0000", 2024-04-18T21:06:45.841 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6448000000000002e-05 2024-04-18T21:06:45.841 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.841 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.841 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:45.842 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.776044+0000", 2024-04-18T21:06:45.842 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4145999999999999e-05 2024-04-18T21:06:45.842 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.842 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.842 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:45.842 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.776060+0000", 2024-04-18T21:06:45.842 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6297e-05 2024-04-18T21:06:45.842 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.842 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:45.842 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.842 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.842 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.842 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:106 3.1f 3.1ba6bc1f (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:45.843 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757955+0000", 2024-04-18T21:06:45.843 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.043410856999999997, 2024-04-18T21:06:45.843 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.044583917000000001, 2024-04-18T21:06:45.843 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:45.843 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:45.843 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-18T21:06:45.843 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:45.843 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.843 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:45.843 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757955+0000", 2024-04-18T21:06:45.843 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:45.843 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.843 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.843 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:45.843 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757955+0000", 2024-04-18T21:06:45.843 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:45.844 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.844 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.844 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:45.844 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757956+0000", 2024-04-18T21:06:45.844 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.144e-06 2024-04-18T21:06:45.844 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.844 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.844 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:45.844 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757970+0000", 2024-04-18T21:06:45.844 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3899e-05 2024-04-18T21:06:45.844 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.844 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.845 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:45.845 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757988+0000", 2024-04-18T21:06:45.845 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8033000000000002e-05 2024-04-18T21:06:45.845 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.845 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.845 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:45.845 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758002+0000", 2024-04-18T21:06:45.845 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3973e-05 2024-04-18T21:06:45.846 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.846 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:45.846 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.846 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.846 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.846 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:116 3.1f 3.1ba6bc1f (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:45.846 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.776158+0000", 2024-04-18T21:06:45.846 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.025207156000000001, 2024-04-18T21:06:45.846 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.026479481999999999, 2024-04-18T21:06:45.846 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:45.846 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:45.846 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-18T21:06:45.846 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:45.847 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.847 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:45.847 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.776158+0000", 2024-04-18T21:06:45.847 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:45.847 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.847 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.847 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:45.847 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.776158+0000", 2024-04-18T21:06:45.847 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:45.847 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.847 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.847 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:45.847 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.776160+0000", 2024-04-18T21:06:45.847 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1570000000000001e-06 2024-04-18T21:06:45.847 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.848 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.848 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:45.848 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.776167+0000", 2024-04-18T21:06:45.848 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2919999999999998e-06 2024-04-18T21:06:45.848 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.848 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.848 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:45.848 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.776182+0000", 2024-04-18T21:06:45.848 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5094e-05 2024-04-18T21:06:45.848 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.848 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.848 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:45.848 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.776191+0000", 2024-04-18T21:06:45.848 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.4429999999999992e-06 2024-04-18T21:06:45.848 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.849 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:45.849 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.849 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.849 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.849 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:107 3.1f 3.1ba6bc1f (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:45.849 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758019+0000", 2024-04-18T21:06:45.849 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.043346230999999999, 2024-04-18T21:06:45.849 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.044696800000000002, 2024-04-18T21:06:45.849 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:45.849 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:45.849 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-18T21:06:45.849 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:45.849 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.849 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:45.850 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758019+0000", 2024-04-18T21:06:45.850 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:45.850 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.850 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.850 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:45.850 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758019+0000", 2024-04-18T21:06:45.850 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:45.850 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.850 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.850 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:45.850 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758021+0000", 2024-04-18T21:06:45.850 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1999999999999999e-06 2024-04-18T21:06:45.850 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.850 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.851 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:45.851 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758028+0000", 2024-04-18T21:06:45.851 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7200000000000006e-06 2024-04-18T21:06:45.851 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.851 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.851 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:45.851 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758050+0000", 2024-04-18T21:06:45.851 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1877000000000001e-05 2024-04-18T21:06:45.851 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.851 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.851 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:45.851 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758064+0000", 2024-04-18T21:06:45.851 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.383e-05 2024-04-18T21:06:45.851 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.852 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:45.852 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.852 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.852 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.852 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:117 3.1f 3.1ba6bc1f (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:45.852 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.776952+0000", 2024-04-18T21:06:45.852 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.024413589999999999, 2024-04-18T21:06:45.852 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.025852863, 2024-04-18T21:06:45.852 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:45.852 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:45.852 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-18T21:06:45.852 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:45.852 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.852 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:45.852 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.776952+0000", 2024-04-18T21:06:45.853 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:45.853 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.853 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.853 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:45.853 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.776952+0000", 2024-04-18T21:06:45.853 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:45.853 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.853 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.853 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:45.853 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.776954+0000", 2024-04-18T21:06:45.853 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.154e-06 2024-04-18T21:06:45.853 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.853 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.853 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:45.854 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.776972+0000", 2024-04-18T21:06:45.854 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8224999999999999e-05 2024-04-18T21:06:45.854 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.854 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.854 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:45.854 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.777003+0000", 2024-04-18T21:06:45.854 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0499999999999999e-05 2024-04-18T21:06:45.854 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.854 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.854 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:45.854 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.777022+0000", 2024-04-18T21:06:45.854 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9034000000000001e-05 2024-04-18T21:06:45.854 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.854 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:45.855 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.855 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.855 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.855 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:108 3.1f 3.1ba6bc1f (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:45.855 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:06:45.855 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.043283061999999997, 2024-04-18T21:06:45.855 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.044826170999999998, 2024-04-18T21:06:45.855 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:45.855 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:45.855 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-18T21:06:45.855 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:45.855 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.855 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:45.855 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:06:45.855 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:45.855 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.856 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.856 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:45.856 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:06:45.856 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:45.856 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.856 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.856 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:45.856 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758084+0000", 2024-04-18T21:06:45.856 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.124e-06 2024-04-18T21:06:45.856 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.856 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.856 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:45.856 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758100+0000", 2024-04-18T21:06:45.856 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6246e-05 2024-04-18T21:06:45.857 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.857 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.857 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:45.857 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758118+0000", 2024-04-18T21:06:45.857 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8267e-05 2024-04-18T21:06:45.857 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.857 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.857 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:45.857 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758134+0000", 2024-04-18T21:06:45.857 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5950000000000001e-05 2024-04-18T21:06:45.857 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.857 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:45.857 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.857 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.857 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.858 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:122 3.1f 3.1ba6bc1f (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:45.858 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.791536+0000", 2024-04-18T21:06:45.858 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0098291549999999991, 2024-04-18T21:06:45.858 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.011517408, 2024-04-18T21:06:45.858 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:45.858 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:45.858 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-18T21:06:45.858 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:45.858 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.858 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:45.858 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.791536+0000", 2024-04-18T21:06:45.858 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:45.858 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:45.859 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.791536+0000", 2024-04-18T21:06:45.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:45.859 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.860 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:45.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.791537+0000", 2024-04-18T21:06:45.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5600000000000004e-07 2024-04-18T21:06:45.860 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.860 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:45.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.791556+0000", 2024-04-18T21:06:45.861 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8558000000000001e-05 2024-04-18T21:06:45.861 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.861 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:45.861 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.791568+0000", 2024-04-18T21:06:45.861 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1817999999999999e-05 2024-04-18T21:06:45.861 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.861 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:45.862 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.791575+0000", 2024-04-18T21:06:45.862 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.464e-06 2024-04-18T21:06:45.862 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.862 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:45.862 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.862 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.862 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.862 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:109 3.1f 3.1ba6bc1f (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:45.862 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:06:45.863 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.043213695000000003, 2024-04-18T21:06:45.863 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045034853, 2024-04-18T21:06:45.863 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:45.863 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:45.863 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-18T21:06:45.863 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:45.863 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.863 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:45.863 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:06:45.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:45.864 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.864 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.864 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:45.864 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:06:45.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:45.864 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.864 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.864 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:45.864 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758153+0000", 2024-04-18T21:06:45.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1459999999999999e-06 2024-04-18T21:06:45.864 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.864 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.864 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:45.864 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758161+0000", 2024-04-18T21:06:45.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7999999999999999e-06 2024-04-18T21:06:45.865 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.865 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.865 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:45.865 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758179+0000", 2024-04-18T21:06:45.865 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7949999999999999e-05 2024-04-18T21:06:45.865 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.865 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.865 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:45.865 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758193+0000", 2024-04-18T21:06:45.865 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3773e-05 2024-04-18T21:06:45.865 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.865 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:45.865 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.865 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.865 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.866 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:110 3.1f 3.1ba6bc1f (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:45.866 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:06:45.866 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.043155286000000001, 2024-04-18T21:06:45.866 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045111946999999999, 2024-04-18T21:06:45.866 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:45.866 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:45.866 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-18T21:06:45.866 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:45.866 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.866 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:45.866 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:06:45.866 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:45.866 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.866 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:45.867 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:06:45.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:45.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:45.867 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758212+0000", 2024-04-18T21:06:45.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:06:45.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:45.867 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758219+0000", 2024-04-18T21:06:45.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4229999999999999e-06 2024-04-18T21:06:45.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.868 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:45.868 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758237+0000", 2024-04-18T21:06:45.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7966999999999999e-05 2024-04-18T21:06:45.868 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.868 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.868 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:45.868 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758252+0000", 2024-04-18T21:06:45.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5322999999999999e-05 2024-04-18T21:06:45.868 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.868 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:45.868 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.868 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.868 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.868 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:111 3.1f 3.1ba6bc1f (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:45.868 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:06:45.868 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.043094309999999997, 2024-04-18T21:06:45.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045160233000000001, 2024-04-18T21:06:45.869 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:45.869 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:45.869 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-18T21:06:45.869 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:45.869 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.869 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:45.869 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:06:45.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:45.869 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.869 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.869 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:45.869 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:06:45.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:45.869 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.870 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.870 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:45.870 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758272+0000", 2024-04-18T21:06:45.870 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1200000000000001e-06 2024-04-18T21:06:45.870 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.870 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.870 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:45.870 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758287+0000", 2024-04-18T21:06:45.870 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5017e-05 2024-04-18T21:06:45.870 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.870 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.870 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:45.870 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758309+0000", 2024-04-18T21:06:45.870 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1866e-05 2024-04-18T21:06:45.870 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.871 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.871 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:45.871 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758323+0000", 2024-04-18T21:06:45.871 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3606e-05 2024-04-18T21:06:45.871 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.871 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:45.871 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.871 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.871 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.871 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:5230 4.17 4.232334d7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-18T21:06:45.871 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.760650+0000", 2024-04-18T21:06:45.871 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.040715138999999997, 2024-04-18T21:06:45.871 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.042862408999999997, 2024-04-18T21:06:45.871 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:45.871 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:45.872 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-18T21:06:45.872 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:06:45.872 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:06:45.872 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:45.872 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 5230 2024-04-18T21:06:45.872 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.872 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:45.872 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.872 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:45.872 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760650+0000", 2024-04-18T21:06:45.872 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:45.872 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.872 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.872 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:45.872 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760650+0000", 2024-04-18T21:06:45.872 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:45.873 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.873 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.873 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:45.873 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760653+0000", 2024-04-18T21:06:45.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0829999999999998e-06 2024-04-18T21:06:45.873 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.873 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.873 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:45.873 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760664+0000", 2024-04-18T21:06:45.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.111e-05 2024-04-18T21:06:45.873 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.873 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.873 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:45.873 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760688+0000", 2024-04-18T21:06:45.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4837e-05 2024-04-18T21:06:45.874 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.874 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.874 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:45.874 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760702+0000", 2024-04-18T21:06:45.874 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3723000000000001e-05 2024-04-18T21:06:45.874 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.874 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:45.874 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.874 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.874 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.874 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:123 3.1f 3.1ba6bc1f (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:45.874 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.796874+0000", 2024-04-18T21:06:45.874 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0044917890000000004, 2024-04-18T21:06:45.875 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.006724687, 2024-04-18T21:06:45.875 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:45.875 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:45.875 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-18T21:06:45.875 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:45.875 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.875 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:45.875 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.796874+0000", 2024-04-18T21:06:45.875 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:45.875 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.875 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.875 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:45.875 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.796874+0000", 2024-04-18T21:06:45.875 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:45.875 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.876 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.876 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:45.876 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.796876+0000", 2024-04-18T21:06:45.876 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.587e-06 2024-04-18T21:06:45.876 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.876 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.876 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:45.876 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.796907+0000", 2024-04-18T21:06:45.876 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0626000000000001e-05 2024-04-18T21:06:45.876 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.876 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.876 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:45.876 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.796938+0000", 2024-04-18T21:06:45.876 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1050000000000003e-05 2024-04-18T21:06:45.877 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.877 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.877 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:45.877 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.796963+0000", 2024-04-18T21:06:45.877 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4482999999999999e-05 2024-04-18T21:06:45.877 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.877 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:45.877 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.877 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.877 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.877 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:118 3.1f 3.1ba6bc1f (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:45.877 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.781184+0000", 2024-04-18T21:06:45.877 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.020181237000000001, 2024-04-18T21:06:45.877 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.022466969999999999, 2024-04-18T21:06:45.877 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:45.877 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:45.878 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-18T21:06:45.878 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:45.878 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.878 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:45.878 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.781184+0000", 2024-04-18T21:06:45.878 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:45.878 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.878 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.878 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:45.878 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.781184+0000", 2024-04-18T21:06:45.878 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:45.878 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.878 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.879 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:45.879 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.781186+0000", 2024-04-18T21:06:45.879 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1059999999999998e-06 2024-04-18T21:06:45.879 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.879 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.879 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:45.879 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.781211+0000", 2024-04-18T21:06:45.879 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4997000000000001e-05 2024-04-18T21:06:45.879 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.879 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.879 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:45.879 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.781231+0000", 2024-04-18T21:06:45.879 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.984e-05 2024-04-18T21:06:45.879 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.879 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.880 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:45.880 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.781254+0000", 2024-04-18T21:06:45.880 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2359999999999999e-05 2024-04-18T21:06:45.880 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.880 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:45.880 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.880 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.880 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.880 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:119 3.1f 3.1ba6bc1f (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:45.880 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.781555+0000", 2024-04-18T21:06:45.880 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.019810827, 2024-04-18T21:06:45.880 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.022148053000000001, 2024-04-18T21:06:45.880 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:45.880 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:45.880 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-18T21:06:45.881 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:45.881 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.881 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:45.881 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.781555+0000", 2024-04-18T21:06:45.881 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:45.881 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.881 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.881 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:45.881 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.781555+0000", 2024-04-18T21:06:45.881 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:45.881 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.881 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.881 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:45.881 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.781556+0000", 2024-04-18T21:06:45.882 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.516e-06 2024-04-18T21:06:45.882 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.882 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.882 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:45.882 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.781574+0000", 2024-04-18T21:06:45.882 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7484000000000001e-05 2024-04-18T21:06:45.882 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.882 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.882 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:45.882 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.781591+0000", 2024-04-18T21:06:45.882 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7716000000000001e-05 2024-04-18T21:06:45.882 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.882 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.882 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:45.883 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.781602+0000", 2024-04-18T21:06:45.883 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1005999999999999e-05 2024-04-18T21:06:45.883 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.883 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:45.883 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.883 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.883 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.883 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:5247 4.f 4.a45dfb0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-18T21:06:45.883 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.781802+0000", 2024-04-18T21:06:45.883 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.019563313999999998, 2024-04-18T21:06:45.883 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.021952896999999999, 2024-04-18T21:06:45.883 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:45.883 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:45.883 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-18T21:06:45.883 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:06:45.884 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:06:45.884 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:45.884 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 5247 2024-04-18T21:06:45.884 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.884 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:45.884 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.884 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:45.884 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.781802+0000", 2024-04-18T21:06:45.884 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:45.884 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.884 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.884 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:45.884 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.781802+0000", 2024-04-18T21:06:45.884 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:45.884 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.884 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.885 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:45.885 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.781803+0000", 2024-04-18T21:06:45.885 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.6299999999999993e-07 2024-04-18T21:06:45.885 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.885 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.885 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:45.885 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.781808+0000", 2024-04-18T21:06:45.885 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.045e-06 2024-04-18T21:06:45.885 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.885 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.885 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:45.885 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.781820+0000", 2024-04-18T21:06:45.885 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1922999999999999e-05 2024-04-18T21:06:45.885 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:45.885 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:45.886 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:45.886 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.781829+0000", 2024-04-18T21:06:45.886 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6270000000000006e-06 2024-04-18T21:06:45.886 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.886 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:45.886 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.886 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:45.886 INFO:teuthology.orchestra.run.smithi187.stdout: ], 2024-04-18T21:06:45.886 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 26 2024-04-18T21:06:45.886 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:45.888 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:45.888 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:45.887+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:45.988 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:45.986+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:46.018 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-18T21:06:46.018 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-18T21:06:46.018 INFO:tasks.thrashosds.thrasher:Reweighting osd 0 to 0.9959131877161228 2024-04-18T21:06:46.018 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 0.9959131877161228 2024-04-18T21:06:46.029 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:46.029 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:06:46.029 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-18T21:06:46.029 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-18T21:06:46.029 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:46.045 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:46.090 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:46.086+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:46.191 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:46.191+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:46.227 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:46.227 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-18T21:06:46.228 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-18T21:06:46.228 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:06:46.228 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.228 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:46.228 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:46.228 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 100.609969621, 2024-04-18T21:06:46.228 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045668994999999997, 2024-04-18T21:06:46.228 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:46.228 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:46.228 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:46.228 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:46.228 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.228 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:46.228 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:46.229 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:46.229 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.229 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.229 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:46.229 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:46.229 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:46.229 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.229 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.229 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:46.229 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615459+0000", 2024-04-18T21:06:46.229 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5030000000000001e-06 2024-04-18T21:06:46.229 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.229 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.229 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:46.229 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615506+0000", 2024-04-18T21:06:46.230 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6872000000000001e-05 2024-04-18T21:06:46.230 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.230 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.230 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:46.230 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615527+0000", 2024-04-18T21:06:46.230 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0763000000000001e-05 2024-04-18T21:06:46.230 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.230 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.230 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:46.230 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615551+0000", 2024-04-18T21:06:46.230 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4159e-05 2024-04-18T21:06:46.230 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.230 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.230 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:46.231 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615736+0000", 2024-04-18T21:06:46.231 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018499599999999999 2024-04-18T21:06:46.231 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.231 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.231 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:46.231 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615748+0000", 2024-04-18T21:06:46.231 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2272999999999999e-05 2024-04-18T21:06:46.231 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.231 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.231 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:46.231 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635481+0000", 2024-04-18T21:06:46.231 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019732772999999999 2024-04-18T21:06:46.231 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.231 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.231 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:46.232 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635791+0000", 2024-04-18T21:06:46.232 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031013299999999998 2024-04-18T21:06:46.232 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.232 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.232 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:46.232 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636101+0000", 2024-04-18T21:06:46.232 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030943300000000002 2024-04-18T21:06:46.232 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.232 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.232 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:46.232 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646043+0000", 2024-04-18T21:06:46.232 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099428139999999995 2024-04-18T21:06:46.232 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.232 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.232 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:46.233 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660991+0000", 2024-04-18T21:06:46.233 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014947142 2024-04-18T21:06:46.233 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.233 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.233 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:46.233 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661061+0000", 2024-04-18T21:06:46.233 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0438000000000006e-05 2024-04-18T21:06:46.233 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.233 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.233 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:46.233 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661127+0000", 2024-04-18T21:06:46.233 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5696000000000003e-05 2024-04-18T21:06:46.233 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:46.233 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:46.234 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:46.234 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.234 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.234 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:46.234 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:46.234 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 100.60975719299999, 2024-04-18T21:06:46.234 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045745085999999997, 2024-04-18T21:06:46.234 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:46.234 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:46.234 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:46.234 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:46.234 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.234 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:46.234 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:46.234 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:46.235 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.235 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.235 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:46.235 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:46.235 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:46.235 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.235 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.235 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:46.235 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:06:46.235 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7400000000000001e-06 2024-04-18T21:06:46.235 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.235 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.235 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:46.235 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:06:46.236 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8133e-05 2024-04-18T21:06:46.236 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.236 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.236 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:46.236 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615726+0000", 2024-04-18T21:06:46.236 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6132e-05 2024-04-18T21:06:46.236 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.236 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.236 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:46.236 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615742+0000", 2024-04-18T21:06:46.236 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6157000000000001e-05 2024-04-18T21:06:46.236 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.237 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.237 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:46.237 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615937+0000", 2024-04-18T21:06:46.237 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000194768 2024-04-18T21:06:46.237 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.237 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.237 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:46.237 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615950+0000", 2024-04-18T21:06:46.237 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3084e-05 2024-04-18T21:06:46.237 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.237 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.237 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:46.237 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643676+0000", 2024-04-18T21:06:46.238 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027725639999999999 2024-04-18T21:06:46.238 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.238 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.238 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:46.238 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643867+0000", 2024-04-18T21:06:46.238 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019075900000000001 2024-04-18T21:06:46.238 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.238 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.238 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:46.238 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:06:46.238 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036013799999999997 2024-04-18T21:06:46.238 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.238 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.238 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:46.239 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646068+0000", 2024-04-18T21:06:46.239 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001841536 2024-04-18T21:06:46.239 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.239 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.239 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:46.239 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661184+0000", 2024-04-18T21:06:46.239 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015115458999999999 2024-04-18T21:06:46.239 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.239 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.239 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:46.239 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661283+0000", 2024-04-18T21:06:46.239 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9502999999999999e-05 2024-04-18T21:06:46.239 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.239 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.239 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:46.240 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661415+0000", 2024-04-18T21:06:46.240 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000132037 2024-04-18T21:06:46.240 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:46.240 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:46.240 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:46.240 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.240 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.240 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:46.240 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:46.240 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 100.609236745, 2024-04-18T21:06:46.240 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043572403000000003, 2024-04-18T21:06:46.240 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:46.240 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:46.240 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:46.240 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:46.241 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.241 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:46.241 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:46.241 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:46.241 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.241 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.241 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:46.241 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:46.241 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:46.241 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.241 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.241 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:46.241 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616192+0000", 2024-04-18T21:06:46.241 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:06:46.242 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.242 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.242 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:46.242 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616203+0000", 2024-04-18T21:06:46.242 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0890000000000001e-05 2024-04-18T21:06:46.242 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.242 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.242 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:46.242 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616223+0000", 2024-04-18T21:06:46.242 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0409000000000001e-05 2024-04-18T21:06:46.242 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.242 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.242 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:46.243 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616238+0000", 2024-04-18T21:06:46.243 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5160000000000001e-05 2024-04-18T21:06:46.243 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.243 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.243 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:46.243 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616343+0000", 2024-04-18T21:06:46.243 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000104831 2024-04-18T21:06:46.243 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.243 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.243 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:46.243 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616357+0000", 2024-04-18T21:06:46.243 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3686000000000001e-05 2024-04-18T21:06:46.243 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.243 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.244 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:46.244 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635912+0000", 2024-04-18T21:06:46.244 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019554944000000001 2024-04-18T21:06:46.244 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.244 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.244 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:46.244 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636231+0000", 2024-04-18T21:06:46.244 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000318766 2024-04-18T21:06:46.244 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.244 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.244 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:46.244 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659763+0000", 2024-04-18T21:06:46.244 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023532474000000001 2024-04-18T21:06:46.244 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:46.244 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:46.245 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:46.245 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.245 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.245 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:99 3.1f 3:f83d65d8:::200.00000004:head [write 313655~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:46.245 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757646+0000", 2024-04-18T21:06:46.245 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.46778096499999999, 2024-04-18T21:06:46.245 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043356459999999999, 2024-04-18T21:06:46.245 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:46.245 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:46.245 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:46.245 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:46.245 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.245 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:46.245 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757646+0000", 2024-04-18T21:06:46.245 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:46.246 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.246 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.246 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:46.246 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757646+0000", 2024-04-18T21:06:46.246 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:46.246 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.246 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.246 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:46.246 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757647+0000", 2024-04-18T21:06:46.246 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.44e-07 2024-04-18T21:06:46.246 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.246 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.246 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:46.246 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757656+0000", 2024-04-18T21:06:46.246 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6559999999999998e-06 2024-04-18T21:06:46.247 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.247 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.247 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:46.247 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757665+0000", 2024-04-18T21:06:46.247 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.6099999999999995e-06 2024-04-18T21:06:46.247 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.247 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.247 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:46.247 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757672+0000", 2024-04-18T21:06:46.247 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7270000000000001e-06 2024-04-18T21:06:46.247 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.247 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.248 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:46.248 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.794854+0000", 2024-04-18T21:06:46.248 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.037182448999999999 2024-04-18T21:06:46.248 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.248 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.248 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:46.248 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.795081+0000", 2024-04-18T21:06:46.248 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000226689 2024-04-18T21:06:46.248 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.248 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.248 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:46.248 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.795369+0000", 2024-04-18T21:06:46.248 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028752600000000003 2024-04-18T21:06:46.248 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.248 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.249 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:46.249 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.799725+0000", 2024-04-18T21:06:46.249 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043563509999999996 2024-04-18T21:06:46.249 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.249 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.249 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:46.249 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.800863+0000", 2024-04-18T21:06:46.249 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0011377799999999999 2024-04-18T21:06:46.249 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.249 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.249 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:46.249 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.800918+0000", 2024-04-18T21:06:46.249 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5547999999999997e-05 2024-04-18T21:06:46.249 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.249 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.250 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:46.250 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.801003+0000", 2024-04-18T21:06:46.250 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4480000000000004e-05 2024-04-18T21:06:46.250 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:46.250 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:46.250 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:46.250 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.250 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.250 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:100 3.1f 3:f83d65d8:::200.00000004:head [write 315055~1400 [fadvise_dontneed] in=1400b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:46.250 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757681+0000", 2024-04-18T21:06:46.250 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.46774634500000001, 2024-04-18T21:06:46.250 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045364542000000001, 2024-04-18T21:06:46.250 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:46.250 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:46.250 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:46.251 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:46.251 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.251 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:46.251 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757681+0000", 2024-04-18T21:06:46.251 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:46.251 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.251 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.251 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:46.251 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757681+0000", 2024-04-18T21:06:46.251 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:46.251 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.251 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.251 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:46.251 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757682+0000", 2024-04-18T21:06:46.251 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8999999999999996e-07 2024-04-18T21:06:46.252 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.252 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.252 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:46.252 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757685+0000", 2024-04-18T21:06:46.252 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.766e-06 2024-04-18T21:06:46.252 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.252 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.252 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:46.252 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757715+0000", 2024-04-18T21:06:46.252 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9904e-05 2024-04-18T21:06:46.252 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.252 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.252 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:46.252 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757723+0000", 2024-04-18T21:06:46.253 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9899999999999997e-06 2024-04-18T21:06:46.253 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.253 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.253 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:46.253 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.796754+0000", 2024-04-18T21:06:46.253 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.039030774999999997 2024-04-18T21:06:46.253 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.253 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.253 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:46.253 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.796825+0000", 2024-04-18T21:06:46.253 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0511000000000003e-05 2024-04-18T21:06:46.253 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.253 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.253 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:46.253 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.796952+0000", 2024-04-18T21:06:46.254 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012720099999999999 2024-04-18T21:06:46.254 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.254 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.254 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:46.254 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.800774+0000", 2024-04-18T21:06:46.254 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0038226039999999998 2024-04-18T21:06:46.254 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.254 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.254 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:46.254 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802920+0000", 2024-04-18T21:06:46.254 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002145194 2024-04-18T21:06:46.254 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.254 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.254 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:46.255 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802998+0000", 2024-04-18T21:06:46.255 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7836000000000005e-05 2024-04-18T21:06:46.255 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.255 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.255 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:46.255 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803046+0000", 2024-04-18T21:06:46.255 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8071000000000001e-05 2024-04-18T21:06:46.255 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:46.255 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:46.255 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:46.255 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.255 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.255 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:101 3.1f 3:f83d65d8:::200.00000004:head [write 316455~1401 [fadvise_dontneed] in=1401b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:46.255 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:06:46.255 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.467693582, 2024-04-18T21:06:46.256 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.048270212999999999, 2024-04-18T21:06:46.256 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:46.256 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:46.256 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:46.256 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:46.256 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.256 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:46.256 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:06:46.256 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:46.256 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.256 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.256 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:46.256 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:06:46.256 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:46.256 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.257 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.257 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:46.257 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:06:46.257 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7700000000000004e-07 2024-04-18T21:06:46.257 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.257 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.257 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:46.257 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757745+0000", 2024-04-18T21:06:46.257 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0910000000000001e-05 2024-04-18T21:06:46.257 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.257 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.257 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:46.257 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757758+0000", 2024-04-18T21:06:46.257 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2593e-05 2024-04-18T21:06:46.257 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.258 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.258 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:46.258 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757765+0000", 2024-04-18T21:06:46.258 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1659999999999997e-06 2024-04-18T21:06:46.258 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.258 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.258 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:46.258 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.797782+0000", 2024-04-18T21:06:46.258 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.040017283000000001 2024-04-18T21:06:46.258 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.258 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.258 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:46.258 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.797949+0000", 2024-04-18T21:06:46.258 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016650399999999999 2024-04-18T21:06:46.258 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.259 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.259 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:46.259 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.798152+0000", 2024-04-18T21:06:46.259 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000203098 2024-04-18T21:06:46.259 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.259 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.259 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:46.259 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.800792+0000", 2024-04-18T21:06:46.259 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026394779999999998 2024-04-18T21:06:46.259 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.259 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.259 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:46.259 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805921+0000", 2024-04-18T21:06:46.259 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0051295519999999999 2024-04-18T21:06:46.259 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.260 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.260 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:46.260 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805967+0000", 2024-04-18T21:06:46.260 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5457000000000002e-05 2024-04-18T21:06:46.260 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.260 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.260 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:46.260 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806004+0000", 2024-04-18T21:06:46.260 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7494999999999999e-05 2024-04-18T21:06:46.260 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:46.260 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:46.260 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:46.261 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.261 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.261 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:102 3.1f 3:f83d65d8:::200.00000004:head [write 317856~1403 [fadvise_dontneed] in=1403b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:46.261 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757775+0000", 2024-04-18T21:06:46.261 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.46765251600000002, 2024-04-18T21:06:46.261 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.048337705000000002, 2024-04-18T21:06:46.261 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:46.261 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:46.261 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:46.261 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:46.261 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.261 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:46.261 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757775+0000", 2024-04-18T21:06:46.261 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:46.261 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.262 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.262 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:46.262 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757775+0000", 2024-04-18T21:06:46.262 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:46.262 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.262 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.262 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:46.262 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757776+0000", 2024-04-18T21:06:46.262 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5300000000000004e-07 2024-04-18T21:06:46.262 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.262 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.262 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:46.262 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757780+0000", 2024-04-18T21:06:46.262 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2270000000000004e-06 2024-04-18T21:06:46.263 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.263 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.263 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:46.263 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757792+0000", 2024-04-18T21:06:46.263 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2696e-05 2024-04-18T21:06:46.263 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.263 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.263 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:46.263 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757800+0000", 2024-04-18T21:06:46.263 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1439999999999997e-06 2024-04-18T21:06:46.263 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.263 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.263 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:46.263 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.798773+0000", 2024-04-18T21:06:46.263 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.040973074999999998 2024-04-18T21:06:46.264 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.264 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.264 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:46.264 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.798990+0000", 2024-04-18T21:06:46.264 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000217161 2024-04-18T21:06:46.264 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.264 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.264 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:46.264 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.799173+0000", 2024-04-18T21:06:46.264 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018295900000000001 2024-04-18T21:06:46.264 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.264 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.264 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:46.264 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802469+0000", 2024-04-18T21:06:46.264 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032965350000000002 2024-04-18T21:06:46.265 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.265 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.265 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:46.265 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806042+0000", 2024-04-18T21:06:46.265 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035724630000000001 2024-04-18T21:06:46.265 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.265 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.265 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:46.265 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806077+0000", 2024-04-18T21:06:46.265 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4997999999999999e-05 2024-04-18T21:06:46.265 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.265 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.265 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:46.265 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806113+0000", 2024-04-18T21:06:46.265 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5794000000000003e-05 2024-04-18T21:06:46.266 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:46.266 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:46.266 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:46.266 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.266 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.266 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:103 3.1f 3:f83d65d8:::200.00000004:head [write 319259~1404 [fadvise_dontneed] in=1404b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:46.266 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:06:46.266 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.46761867000000001, 2024-04-18T21:06:46.266 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.048414481000000002, 2024-04-18T21:06:46.266 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:46.266 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:46.266 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:46.266 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:46.266 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.266 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:46.267 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:06:46.267 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:46.267 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.267 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.267 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:46.267 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:06:46.267 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:46.267 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.267 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.267 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:46.267 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:06:46.267 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4700000000000001e-07 2024-04-18T21:06:46.267 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.267 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.268 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:46.268 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757814+0000", 2024-04-18T21:06:46.268 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1829999999999996e-06 2024-04-18T21:06:46.268 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.268 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.268 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:46.268 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757825+0000", 2024-04-18T21:06:46.268 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1754e-05 2024-04-18T21:06:46.268 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.268 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.268 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:46.268 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757832+0000", 2024-04-18T21:06:46.268 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8430000000000004e-06 2024-04-18T21:06:46.268 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.268 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.269 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:46.269 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.799809+0000", 2024-04-18T21:06:46.269 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.041976960000000001 2024-04-18T21:06:46.269 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.269 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.269 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:46.269 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.799934+0000", 2024-04-18T21:06:46.269 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000125053 2024-04-18T21:06:46.269 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.269 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.269 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:46.269 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.800067+0000", 2024-04-18T21:06:46.269 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013276299999999999 2024-04-18T21:06:46.269 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.269 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.270 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:46.270 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804582+0000", 2024-04-18T21:06:46.270 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0045148899999999997 2024-04-18T21:06:46.270 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.270 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.270 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:46.270 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806158+0000", 2024-04-18T21:06:46.270 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001575894 2024-04-18T21:06:46.270 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.270 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.270 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:46.270 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806189+0000", 2024-04-18T21:06:46.270 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1423000000000001e-05 2024-04-18T21:06:46.270 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.271 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.271 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:46.271 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806223+0000", 2024-04-18T21:06:46.271 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4071e-05 2024-04-18T21:06:46.271 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:46.271 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:46.271 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:46.271 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.271 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.271 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:104 3.1f 3:f83d65d8:::200.00000004:head [write 320663~1405 [fadvise_dontneed] in=1405b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:46.271 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757841+0000", 2024-04-18T21:06:46.271 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.46758646599999998, 2024-04-18T21:06:46.271 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056381623999999998, 2024-04-18T21:06:46.271 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:46.271 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:46.272 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:46.272 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:46.272 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.272 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:46.272 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757841+0000", 2024-04-18T21:06:46.272 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:46.272 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.272 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.272 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:46.272 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757841+0000", 2024-04-18T21:06:46.272 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:46.272 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.272 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.272 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:46.272 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757842+0000", 2024-04-18T21:06:46.273 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5000000000000002e-07 2024-04-18T21:06:46.273 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.273 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.273 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:46.273 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757852+0000", 2024-04-18T21:06:46.273 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.084e-05 2024-04-18T21:06:46.273 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.273 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.273 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:46.273 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757865+0000", 2024-04-18T21:06:46.273 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2643000000000001e-05 2024-04-18T21:06:46.273 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.273 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.273 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:46.273 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757872+0000", 2024-04-18T21:06:46.274 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8689999999999998e-06 2024-04-18T21:06:46.274 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.274 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.274 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:46.274 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.801102+0000", 2024-04-18T21:06:46.274 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043229837 2024-04-18T21:06:46.274 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.274 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.274 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:46.274 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.801291+0000", 2024-04-18T21:06:46.274 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000189641 2024-04-18T21:06:46.274 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.274 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.274 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:46.275 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.801640+0000", 2024-04-18T21:06:46.275 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000348971 2024-04-18T21:06:46.275 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.275 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.275 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:46.275 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805849+0000", 2024-04-18T21:06:46.275 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042082739999999997 2024-04-18T21:06:46.275 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.275 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.275 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:46.275 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814135+0000", 2024-04-18T21:06:46.275 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0082867270000000007 2024-04-18T21:06:46.275 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.275 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.275 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:46.276 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814180+0000", 2024-04-18T21:06:46.276 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4982999999999999e-05 2024-04-18T21:06:46.276 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.276 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.276 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:46.276 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814223+0000", 2024-04-18T21:06:46.276 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2188999999999999e-05 2024-04-18T21:06:46.276 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:46.276 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:46.276 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:46.276 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.276 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.276 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:105 3.1f 3:f83d65d8:::200.00000004:head [write 322068~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:46.276 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:06:46.276 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.46754586999999997, 2024-04-18T21:06:46.277 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056513678999999997, 2024-04-18T21:06:46.277 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:46.277 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:46.277 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:46.277 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:46.277 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.277 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:46.277 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:06:46.277 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:46.277 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.277 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.277 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:46.277 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:06:46.277 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:46.277 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.278 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.278 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:46.278 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:06:46.278 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2600000000000002e-07 2024-04-18T21:06:46.278 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.278 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.278 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:46.278 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757888+0000", 2024-04-18T21:06:46.278 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7130000000000002e-06 2024-04-18T21:06:46.278 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.278 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.278 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:46.278 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757906+0000", 2024-04-18T21:06:46.278 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7723999999999998e-05 2024-04-18T21:06:46.279 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.279 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.279 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:46.279 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757921+0000", 2024-04-18T21:06:46.279 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4936000000000001e-05 2024-04-18T21:06:46.279 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.279 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.279 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:46.279 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802493+0000", 2024-04-18T21:06:46.279 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.044571927999999997 2024-04-18T21:06:46.279 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.279 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.279 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:46.279 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802537+0000", 2024-04-18T21:06:46.279 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4449000000000001e-05 2024-04-18T21:06:46.280 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.280 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.280 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:46.280 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802605+0000", 2024-04-18T21:06:46.280 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7945000000000001e-05 2024-04-18T21:06:46.280 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.280 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.280 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:46.280 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805852+0000", 2024-04-18T21:06:46.280 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032469909999999999 2024-04-18T21:06:46.280 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.280 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.281 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:46.281 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814298+0000", 2024-04-18T21:06:46.281 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084463309999999996 2024-04-18T21:06:46.281 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.281 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.281 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:46.281 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814355+0000", 2024-04-18T21:06:46.281 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6459999999999998e-05 2024-04-18T21:06:46.281 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.281 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.281 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:46.281 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814395+0000", 2024-04-18T21:06:46.281 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0475999999999997e-05 2024-04-18T21:06:46.281 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:46.281 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:46.282 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:46.282 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.282 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.282 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:106 3.1f 3:f83d65d8:::200.00000004:head [write 323467~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:46.282 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757955+0000", 2024-04-18T21:06:46.282 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.46747264100000002, 2024-04-18T21:06:46.282 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056539990999999998, 2024-04-18T21:06:46.282 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:46.282 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:46.282 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:46.282 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:46.282 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.282 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:46.282 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757955+0000", 2024-04-18T21:06:46.283 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:46.283 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.283 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.283 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:46.283 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757955+0000", 2024-04-18T21:06:46.283 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:46.283 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.283 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.283 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:46.283 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757956+0000", 2024-04-18T21:06:46.283 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.144e-06 2024-04-18T21:06:46.283 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.283 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.283 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:46.283 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757970+0000", 2024-04-18T21:06:46.284 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3899e-05 2024-04-18T21:06:46.284 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.284 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.284 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:46.284 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757988+0000", 2024-04-18T21:06:46.284 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8033000000000002e-05 2024-04-18T21:06:46.284 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.284 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.284 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:46.284 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758002+0000", 2024-04-18T21:06:46.284 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3973e-05 2024-04-18T21:06:46.284 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.284 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.284 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:46.285 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803072+0000", 2024-04-18T21:06:46.285 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045070194000000001 2024-04-18T21:06:46.285 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.285 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.285 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:46.285 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803125+0000", 2024-04-18T21:06:46.285 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3498000000000002e-05 2024-04-18T21:06:46.285 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.285 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.285 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:46.285 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803233+0000", 2024-04-18T21:06:46.285 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010704099999999999 2024-04-18T21:06:46.285 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.285 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.285 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:46.286 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805856+0000", 2024-04-18T21:06:46.286 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026233430000000002 2024-04-18T21:06:46.286 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.286 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.286 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:46.286 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814439+0000", 2024-04-18T21:06:46.286 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0085833839999999995 2024-04-18T21:06:46.286 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.286 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.286 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:46.286 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814469+0000", 2024-04-18T21:06:46.286 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9784000000000001e-05 2024-04-18T21:06:46.286 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.287 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.287 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:46.287 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814495+0000", 2024-04-18T21:06:46.287 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5698e-05 2024-04-18T21:06:46.287 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:46.287 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:46.287 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:46.287 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.287 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.287 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:107 3.1f 3:f83d65d8:::200.00000004:head [write 324866~1421 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:46.287 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758019+0000", 2024-04-18T21:06:46.287 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.46740801500000001, 2024-04-18T21:06:46.287 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056580563, 2024-04-18T21:06:46.287 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:46.287 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:46.288 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:46.288 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:46.288 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.288 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:46.288 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758019+0000", 2024-04-18T21:06:46.288 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:46.288 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.288 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.288 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:46.288 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758019+0000", 2024-04-18T21:06:46.288 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:46.288 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.288 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.288 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:46.289 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758021+0000", 2024-04-18T21:06:46.289 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1999999999999999e-06 2024-04-18T21:06:46.289 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.289 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.289 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:46.289 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758028+0000", 2024-04-18T21:06:46.289 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7200000000000006e-06 2024-04-18T21:06:46.289 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.289 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.289 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:46.289 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758050+0000", 2024-04-18T21:06:46.289 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1877000000000001e-05 2024-04-18T21:06:46.289 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.289 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.290 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:46.290 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758064+0000", 2024-04-18T21:06:46.290 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.383e-05 2024-04-18T21:06:46.290 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.290 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.290 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:46.290 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803593+0000", 2024-04-18T21:06:46.290 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045528831999999998 2024-04-18T21:06:46.290 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.290 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.290 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:46.290 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803635+0000", 2024-04-18T21:06:46.290 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1980000000000001e-05 2024-04-18T21:06:46.290 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.290 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.290 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:46.291 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803703+0000", 2024-04-18T21:06:46.291 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8542999999999997e-05 2024-04-18T21:06:46.291 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.291 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.291 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:46.291 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806123+0000", 2024-04-18T21:06:46.291 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002419769 2024-04-18T21:06:46.291 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.291 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.291 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:46.291 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814542+0000", 2024-04-18T21:06:46.291 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084189460000000001 2024-04-18T21:06:46.291 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.291 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.292 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:46.292 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814576+0000", 2024-04-18T21:06:46.292 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3679000000000001e-05 2024-04-18T21:06:46.292 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.292 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.292 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:46.292 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814600+0000", 2024-04-18T21:06:46.292 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4187000000000001e-05 2024-04-18T21:06:46.292 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:46.292 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:46.292 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:46.292 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.292 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.292 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:108 3.1f 3:f83d65d8:::200.00000004:head [write 326287~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:46.293 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:06:46.293 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.46734484599999998, 2024-04-18T21:06:46.293 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056616183, 2024-04-18T21:06:46.293 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:46.293 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:46.293 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:46.293 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:46.293 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.293 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:46.293 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:06:46.293 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:46.293 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.293 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.294 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:46.294 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:06:46.294 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:46.294 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.294 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.294 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:46.294 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758084+0000", 2024-04-18T21:06:46.294 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.124e-06 2024-04-18T21:06:46.294 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.294 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.294 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:46.294 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758100+0000", 2024-04-18T21:06:46.294 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6246e-05 2024-04-18T21:06:46.294 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.295 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.295 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:46.295 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758118+0000", 2024-04-18T21:06:46.295 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8267e-05 2024-04-18T21:06:46.295 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.295 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.295 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:46.295 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758134+0000", 2024-04-18T21:06:46.295 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5950000000000001e-05 2024-04-18T21:06:46.295 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.295 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.295 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:46.295 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803949+0000", 2024-04-18T21:06:46.295 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045815349999999998 2024-04-18T21:06:46.296 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.296 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.296 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:46.296 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804011+0000", 2024-04-18T21:06:46.296 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1044999999999996e-05 2024-04-18T21:06:46.296 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.296 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.296 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:46.296 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804128+0000", 2024-04-18T21:06:46.296 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117148 2024-04-18T21:06:46.296 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.296 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.296 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:46.296 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806794+0000", 2024-04-18T21:06:46.297 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002666692 2024-04-18T21:06:46.297 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.297 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.297 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:46.297 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814645+0000", 2024-04-18T21:06:46.297 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0078508880000000003 2024-04-18T21:06:46.297 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.297 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.297 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:46.297 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814678+0000", 2024-04-18T21:06:46.297 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3188999999999997e-05 2024-04-18T21:06:46.297 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.297 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.297 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:46.298 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814699+0000", 2024-04-18T21:06:46.298 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0284000000000001e-05 2024-04-18T21:06:46.298 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:46.298 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:46.298 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:46.298 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.298 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.298 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:109 3.1f 3:f83d65d8:::200.00000004:head [write 327693~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:46.298 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:06:46.298 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.46727547899999999, 2024-04-18T21:06:46.298 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056621036999999999, 2024-04-18T21:06:46.298 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:46.298 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:46.298 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:46.299 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:46.299 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.299 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:46.299 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:06:46.299 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:46.299 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.299 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.299 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:46.299 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:06:46.299 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:46.299 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.299 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.299 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:46.299 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758153+0000", 2024-04-18T21:06:46.300 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1459999999999999e-06 2024-04-18T21:06:46.300 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.300 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.300 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:46.300 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758161+0000", 2024-04-18T21:06:46.300 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7999999999999999e-06 2024-04-18T21:06:46.300 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.300 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.300 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:46.300 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758179+0000", 2024-04-18T21:06:46.300 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7949999999999999e-05 2024-04-18T21:06:46.300 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.300 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.300 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:46.300 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758193+0000", 2024-04-18T21:06:46.301 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3773e-05 2024-04-18T21:06:46.301 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.301 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.301 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:46.301 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804632+0000", 2024-04-18T21:06:46.301 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.046439469999999997 2024-04-18T21:06:46.301 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.301 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.301 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:46.301 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804790+0000", 2024-04-18T21:06:46.301 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015784300000000001 2024-04-18T21:06:46.301 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.301 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.301 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:46.302 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805056+0000", 2024-04-18T21:06:46.302 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026652400000000003 2024-04-18T21:06:46.302 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.302 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.302 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:46.302 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.808959+0000", 2024-04-18T21:06:46.302 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003903077 2024-04-18T21:06:46.302 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.302 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.302 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:46.302 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814728+0000", 2024-04-18T21:06:46.302 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0057682489999999996 2024-04-18T21:06:46.302 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.302 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.303 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:46.303 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814754+0000", 2024-04-18T21:06:46.303 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6673999999999999e-05 2024-04-18T21:06:46.303 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.303 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.303 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:46.303 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814773+0000", 2024-04-18T21:06:46.303 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8530999999999999e-05 2024-04-18T21:06:46.303 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:46.303 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:46.303 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:46.303 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.303 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.303 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:110 3.1f 3:f83d65d8:::200.00000004:head [write 329098~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:46.303 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:06:46.304 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.46721707000000001, 2024-04-18T21:06:46.304 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056669113, 2024-04-18T21:06:46.304 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:46.304 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:46.304 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:46.304 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:46.304 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.304 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:46.304 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:06:46.304 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:46.304 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.304 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.304 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:46.304 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:06:46.305 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:46.305 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.305 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.305 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:46.305 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758212+0000", 2024-04-18T21:06:46.305 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:06:46.305 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.305 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.305 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:46.305 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758219+0000", 2024-04-18T21:06:46.305 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4229999999999999e-06 2024-04-18T21:06:46.305 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.305 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.305 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:46.306 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758237+0000", 2024-04-18T21:06:46.306 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7966999999999999e-05 2024-04-18T21:06:46.306 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.306 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.306 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:46.306 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758252+0000", 2024-04-18T21:06:46.306 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5322999999999999e-05 2024-04-18T21:06:46.306 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.306 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.306 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:46.306 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805536+0000", 2024-04-18T21:06:46.306 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.047283861000000003 2024-04-18T21:06:46.306 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.306 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.306 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:46.307 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805579+0000", 2024-04-18T21:06:46.307 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2738999999999999e-05 2024-04-18T21:06:46.307 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.307 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.307 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:46.307 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805649+0000", 2024-04-18T21:06:46.307 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0213e-05 2024-04-18T21:06:46.307 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.307 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.307 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:46.307 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.808966+0000", 2024-04-18T21:06:46.307 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033166129999999999 2024-04-18T21:06:46.307 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.307 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.308 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:46.308 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814812+0000", 2024-04-18T21:06:46.308 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0058463589999999998 2024-04-18T21:06:46.308 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.308 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.308 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:46.308 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814854+0000", 2024-04-18T21:06:46.308 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1618e-05 2024-04-18T21:06:46.308 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.308 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.308 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:46.308 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814879+0000", 2024-04-18T21:06:46.309 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5754000000000001e-05 2024-04-18T21:06:46.309 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:46.309 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:46.309 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:46.309 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.309 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.309 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:111 3.1f 3:f83d65d8:::200.00000004:head [write 330499~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:46.309 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:06:46.309 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.46715609400000002, 2024-04-18T21:06:46.309 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058693793000000001, 2024-04-18T21:06:46.309 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:46.309 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:46.309 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:46.309 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:46.310 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.310 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:46.310 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:06:46.310 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:46.310 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.310 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.310 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:46.310 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:06:46.310 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:46.310 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.310 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.310 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:46.310 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758272+0000", 2024-04-18T21:06:46.310 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1200000000000001e-06 2024-04-18T21:06:46.311 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.311 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.311 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:46.311 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758287+0000", 2024-04-18T21:06:46.311 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5017e-05 2024-04-18T21:06:46.311 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.311 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.311 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:46.311 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758309+0000", 2024-04-18T21:06:46.311 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1866e-05 2024-04-18T21:06:46.311 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.311 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.311 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:46.311 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758323+0000", 2024-04-18T21:06:46.312 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3606e-05 2024-04-18T21:06:46.312 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.312 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.312 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:46.312 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806279+0000", 2024-04-18T21:06:46.312 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.047956061000000001 2024-04-18T21:06:46.312 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.312 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.312 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:46.312 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806350+0000", 2024-04-18T21:06:46.312 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1070999999999998e-05 2024-04-18T21:06:46.312 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.312 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.312 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:46.312 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806459+0000", 2024-04-18T21:06:46.312 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000108606 2024-04-18T21:06:46.313 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.313 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.313 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:46.313 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.809774+0000", 2024-04-18T21:06:46.313 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003314881 2024-04-18T21:06:46.313 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.313 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.313 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:46.313 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816910+0000", 2024-04-18T21:06:46.313 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0071367760000000001 2024-04-18T21:06:46.313 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.313 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.313 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:46.313 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816941+0000", 2024-04-18T21:06:46.313 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0846000000000002e-05 2024-04-18T21:06:46.314 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.314 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.314 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:46.314 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816965+0000", 2024-04-18T21:06:46.314 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3943000000000001e-05 2024-04-18T21:06:46.314 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:46.314 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:46.314 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:46.314 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.314 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.314 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:5230 4.17 4:eb2cc4c4:::1000000184c.00000000:head [write 0~2191] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-18T21:06:46.314 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.760650+0000", 2024-04-18T21:06:46.314 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.46477692300000001, 2024-04-18T21:06:46.314 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.054210577000000003, 2024-04-18T21:06:46.314 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:46.315 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:46.315 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:46.315 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:06:46.315 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:06:46.315 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:46.315 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 5230 2024-04-18T21:06:46.315 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.315 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:46.315 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.315 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:46.315 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760650+0000", 2024-04-18T21:06:46.315 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:46.315 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.315 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.315 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:46.316 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760650+0000", 2024-04-18T21:06:46.316 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:46.316 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.316 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.316 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:46.316 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760653+0000", 2024-04-18T21:06:46.316 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0829999999999998e-06 2024-04-18T21:06:46.316 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.316 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.316 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:46.316 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760664+0000", 2024-04-18T21:06:46.316 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.111e-05 2024-04-18T21:06:46.316 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.316 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.317 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:46.317 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760688+0000", 2024-04-18T21:06:46.317 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4837e-05 2024-04-18T21:06:46.317 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.317 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.317 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:46.317 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760702+0000", 2024-04-18T21:06:46.317 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3723000000000001e-05 2024-04-18T21:06:46.317 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.317 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.317 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:46.317 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806264+0000", 2024-04-18T21:06:46.317 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045562182 2024-04-18T21:06:46.317 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.317 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.318 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:46.318 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806351+0000", 2024-04-18T21:06:46.318 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6322000000000005e-05 2024-04-18T21:06:46.318 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.318 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.318 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:46.318 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806453+0000", 2024-04-18T21:06:46.318 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000102602 2024-04-18T21:06:46.318 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.318 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.318 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:46.318 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.808972+0000", 2024-04-18T21:06:46.318 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025184090000000001 2024-04-18T21:06:46.318 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.319 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.319 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:46.319 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814798+0000", 2024-04-18T21:06:46.319 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0058266689999999996 2024-04-18T21:06:46.319 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.319 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.319 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:46.319 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814839+0000", 2024-04-18T21:06:46.319 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0482000000000003e-05 2024-04-18T21:06:46.319 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.319 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.319 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:46.319 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814861+0000", 2024-04-18T21:06:46.319 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2158e-05 2024-04-18T21:06:46.319 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:46.320 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:46.320 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:46.320 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.320 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.320 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:112 3.1f 3:f83d65d8:::200.00000004:head [write 331898~20167 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:46.320 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.771321+0000", 2024-04-18T21:06:46.320 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.45410629600000002, 2024-04-18T21:06:46.320 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045740306000000001, 2024-04-18T21:06:46.320 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:46.320 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:46.320 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:46.320 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:46.320 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.321 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:46.321 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771321+0000", 2024-04-18T21:06:46.321 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:46.321 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.321 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.321 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:46.321 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771321+0000", 2024-04-18T21:06:46.321 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:46.321 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.321 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.321 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:46.321 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771323+0000", 2024-04-18T21:06:46.321 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3740000000000001e-06 2024-04-18T21:06:46.321 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.322 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.322 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:46.322 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771359+0000", 2024-04-18T21:06:46.322 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5447999999999997e-05 2024-04-18T21:06:46.322 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.322 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.322 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:46.322 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771388+0000", 2024-04-18T21:06:46.322 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8915e-05 2024-04-18T21:06:46.322 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.322 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.322 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:46.322 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771410+0000", 2024-04-18T21:06:46.323 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1899000000000002e-05 2024-04-18T21:06:46.323 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.323 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.323 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:46.323 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806827+0000", 2024-04-18T21:06:46.323 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.035417063999999998 2024-04-18T21:06:46.323 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.323 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.323 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:46.323 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806873+0000", 2024-04-18T21:06:46.323 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6261999999999999e-05 2024-04-18T21:06:46.323 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.323 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.323 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:46.323 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806946+0000", 2024-04-18T21:06:46.324 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3205000000000001e-05 2024-04-18T21:06:46.324 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.324 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.324 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:46.324 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.809781+0000", 2024-04-18T21:06:46.324 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002834937 2024-04-18T21:06:46.324 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.324 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.324 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:46.324 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817003+0000", 2024-04-18T21:06:46.324 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0072217959999999999 2024-04-18T21:06:46.324 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.324 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.324 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:46.324 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817038+0000", 2024-04-18T21:06:46.325 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4696999999999997e-05 2024-04-18T21:06:46.325 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.325 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.325 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:46.325 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817061+0000", 2024-04-18T21:06:46.325 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3708999999999999e-05 2024-04-18T21:06:46.325 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:46.325 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:46.325 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:46.325 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.325 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.325 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:113 3.1f 3:f83d65d8:::200.00000004:head [write 352065~3878 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:46.325 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.771472+0000", 2024-04-18T21:06:46.325 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.45395555999999998, 2024-04-18T21:06:46.326 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045689726, 2024-04-18T21:06:46.326 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:46.326 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:46.326 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:46.326 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:46.326 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.326 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:46.326 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771472+0000", 2024-04-18T21:06:46.326 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:46.326 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.326 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.326 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:46.326 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771472+0000", 2024-04-18T21:06:46.326 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:46.327 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.327 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.327 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:46.327 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771473+0000", 2024-04-18T21:06:46.327 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3829999999999999e-06 2024-04-18T21:06:46.327 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.327 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.327 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:46.327 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771489+0000", 2024-04-18T21:06:46.327 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5797000000000001e-05 2024-04-18T21:06:46.327 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.327 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.327 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:46.327 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771509+0000", 2024-04-18T21:06:46.328 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0401999999999999e-05 2024-04-18T21:06:46.328 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.328 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.328 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:46.328 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771525+0000", 2024-04-18T21:06:46.328 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5099999999999999e-05 2024-04-18T21:06:46.328 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.328 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.328 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:46.328 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807273+0000", 2024-04-18T21:06:46.328 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.035748488000000002 2024-04-18T21:06:46.328 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.328 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.328 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:46.328 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807343+0000", 2024-04-18T21:06:46.329 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0277000000000005e-05 2024-04-18T21:06:46.329 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.329 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.329 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:46.329 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807455+0000", 2024-04-18T21:06:46.329 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011171999999999999 2024-04-18T21:06:46.329 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.329 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.329 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:46.329 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.811509+0000", 2024-04-18T21:06:46.329 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0040543469999999998 2024-04-18T21:06:46.329 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.329 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.329 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:46.329 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817115+0000", 2024-04-18T21:06:46.330 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0056054520000000004 2024-04-18T21:06:46.330 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.330 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.330 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:46.330 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817142+0000", 2024-04-18T21:06:46.330 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7430999999999999e-05 2024-04-18T21:06:46.330 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.330 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.330 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:46.330 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817162+0000", 2024-04-18T21:06:46.330 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9329000000000001e-05 2024-04-18T21:06:46.330 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:46.330 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:46.330 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:46.331 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.331 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.331 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:114 3.1f 3:f83d65d8:::200.00000004:head [write 355943~1928 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:46.331 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.771785+0000", 2024-04-18T21:06:46.331 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.45364221500000002, 2024-04-18T21:06:46.331 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045480532999999997, 2024-04-18T21:06:46.331 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:46.331 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:46.331 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:46.331 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:46.331 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.331 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:46.331 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771785+0000", 2024-04-18T21:06:46.331 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:46.332 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.332 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.332 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:46.332 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771785+0000", 2024-04-18T21:06:46.332 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:46.332 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.332 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.332 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:46.332 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771787+0000", 2024-04-18T21:06:46.332 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0600000000000002e-06 2024-04-18T21:06:46.332 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.332 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.332 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:46.332 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771799+0000", 2024-04-18T21:06:46.332 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1503e-05 2024-04-18T21:06:46.333 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.333 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.333 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:46.333 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771829+0000", 2024-04-18T21:06:46.333 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.04e-05 2024-04-18T21:06:46.333 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.333 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.333 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:46.333 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771846+0000", 2024-04-18T21:06:46.333 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6608000000000001e-05 2024-04-18T21:06:46.333 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.333 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.333 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:46.334 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807856+0000", 2024-04-18T21:06:46.334 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036010480999999997 2024-04-18T21:06:46.334 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.334 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.334 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:46.334 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807899+0000", 2024-04-18T21:06:46.334 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2775999999999998e-05 2024-04-18T21:06:46.334 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.334 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.334 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:46.334 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807966+0000", 2024-04-18T21:06:46.334 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6793999999999998e-05 2024-04-18T21:06:46.334 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.334 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.335 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:46.335 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.811516+0000", 2024-04-18T21:06:46.335 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035497300000000001 2024-04-18T21:06:46.335 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.335 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.335 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:46.335 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817194+0000", 2024-04-18T21:06:46.335 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0056787030000000002 2024-04-18T21:06:46.335 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.335 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.335 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:46.335 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817231+0000", 2024-04-18T21:06:46.335 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6727000000000003e-05 2024-04-18T21:06:46.335 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:46.336 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:46.336 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:46.336 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817266+0000", 2024-04-18T21:06:46.336 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4751e-05 2024-04-18T21:06:46.336 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:46.336 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:46.336 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:46.336 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:46.336 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:46.336 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:46.338 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:46.338+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:46.338 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:46.439 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:46.439+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:46.491 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:46.491 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:06:46.491 INFO:teuthology.orchestra.run.smithi132.stdout: "num_ops": 0 2024-04-18T21:06:46.491 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:46.509 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:46.555 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:46.554+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:46.638 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:06:46.640 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:46.639+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:46.641 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:46.641 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:06:46.642 INFO:teuthology.orchestra.run.smithi132.stdout: "complaint_time": 30, 2024-04-18T21:06:46.642 INFO:teuthology.orchestra.run.smithi132.stdout: "num_blocked_ops": 0 2024-04-18T21:06:46.642 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:46.656 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:46.741 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:46.742+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:46.744 INFO:teuthology.orchestra.run.smithi078.stderr:noscrub is set 2024-04-18T21:06:46.744 INFO:teuthology.orchestra.run.smithi078.stderr:reweighted osd.0 to 0.995913 (fef4) 2024-04-18T21:06:46.786 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:06:46.787 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:06:46.812 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1: {} 2024-04-18T21:06:46.812 INFO:teuthology.orchestra.run.smithi078.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:06:46.834 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:46.834 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:46.835 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:06:46.835 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:46.841 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:46.842+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:46.851 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:46.942 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:46.943+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:46.991 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:46.992 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:47.006 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:47.043 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:47.042+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:47.144 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:47.142+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:47.183 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:47.183 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:47.199 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:47.249 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:47.250+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:47.332 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:47.332 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:47.345 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:47.346+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:47.348 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:47.447 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:47.446+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:47.483 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:47.483 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:47.499 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:47.548 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:47.546+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:47.631 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:47.631 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:47.646 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:47.649 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:47.650+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:47.750 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:47.750+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:47.822 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:47.822 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:47.837 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:47.887 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:47.886+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:47.951 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:47.950+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:47.975 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:47.975 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:47.990 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:48.087 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:48.086+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:48.153 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:48.154+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:48.169 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:48.169 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:48.183 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:48.254 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:48.254+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:48.355 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:48.354+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:48.362 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:48.362 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:48.378 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:48.456 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:48.454+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:48.516 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:48.516 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:48.531 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:48.556 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:48.554+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:48.657 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:48.658+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:48.661 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:48.661 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:48.678 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:48.758 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:48.758+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:48.771 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-18T21:06:48.803 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:48.804 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:48.820 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:48.853 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:06:48.861 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:48.862+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:48.957 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:48.957 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:48.959 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:48.958+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:48.972 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:49.028 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:06:49.028 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:06:49.053 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1: {} 2024-04-18T21:06:49.053 INFO:teuthology.orchestra.run.smithi078.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:06:49.060 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:49.058+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:49.074 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:06:49.074 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:49.144 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:49.144 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:06:49.144 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-18T21:06:49.145 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-18T21:06:49.145 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:49.161 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:49.161 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:49.158+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:49.262 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:49.262+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:49.339 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:49.339 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-18T21:06:49.339 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-18T21:06:49.339 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:06:49.339 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.339 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:49.339 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:49.339 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 103.72100094699999, 2024-04-18T21:06:49.339 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045668994999999997, 2024-04-18T21:06:49.339 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:49.340 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:49.340 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:49.340 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:49.340 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.340 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:49.340 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:49.340 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:49.340 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.340 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.340 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:49.340 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:49.340 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:49.340 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.340 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.340 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:49.341 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615459+0000", 2024-04-18T21:06:49.341 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5030000000000001e-06 2024-04-18T21:06:49.341 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.341 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.341 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:49.341 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615506+0000", 2024-04-18T21:06:49.341 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6872000000000001e-05 2024-04-18T21:06:49.341 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.341 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.341 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:49.341 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615527+0000", 2024-04-18T21:06:49.341 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0763000000000001e-05 2024-04-18T21:06:49.341 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.341 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.341 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:49.342 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615551+0000", 2024-04-18T21:06:49.342 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4159e-05 2024-04-18T21:06:49.342 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.342 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.342 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:49.342 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615736+0000", 2024-04-18T21:06:49.342 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018499599999999999 2024-04-18T21:06:49.342 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.342 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.342 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:49.342 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615748+0000", 2024-04-18T21:06:49.342 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2272999999999999e-05 2024-04-18T21:06:49.342 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.342 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.343 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:49.343 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635481+0000", 2024-04-18T21:06:49.343 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019732772999999999 2024-04-18T21:06:49.343 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.343 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.343 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:49.343 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635791+0000", 2024-04-18T21:06:49.343 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031013299999999998 2024-04-18T21:06:49.343 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.343 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.343 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:49.343 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636101+0000", 2024-04-18T21:06:49.343 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030943300000000002 2024-04-18T21:06:49.343 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.343 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.344 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:49.344 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646043+0000", 2024-04-18T21:06:49.344 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099428139999999995 2024-04-18T21:06:49.344 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.344 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.344 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:49.344 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660991+0000", 2024-04-18T21:06:49.344 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014947142 2024-04-18T21:06:49.344 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.344 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.344 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:49.344 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661061+0000", 2024-04-18T21:06:49.344 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0438000000000006e-05 2024-04-18T21:06:49.345 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.345 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.345 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:49.345 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661127+0000", 2024-04-18T21:06:49.345 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5696000000000003e-05 2024-04-18T21:06:49.345 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:49.345 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:49.345 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:49.345 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.345 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.345 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:49.345 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:49.345 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 103.720788519, 2024-04-18T21:06:49.345 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045745085999999997, 2024-04-18T21:06:49.346 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:49.346 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:49.346 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:49.346 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:49.346 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.346 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:49.346 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:49.346 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:49.346 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.346 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.346 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:49.346 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:49.346 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:49.346 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.347 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.347 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:49.347 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:06:49.347 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7400000000000001e-06 2024-04-18T21:06:49.347 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.347 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.347 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:49.347 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:06:49.347 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8133e-05 2024-04-18T21:06:49.347 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.347 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.347 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:49.347 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615726+0000", 2024-04-18T21:06:49.347 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6132e-05 2024-04-18T21:06:49.347 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.348 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.348 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:49.348 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615742+0000", 2024-04-18T21:06:49.348 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6157000000000001e-05 2024-04-18T21:06:49.348 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.348 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.348 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:49.348 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615937+0000", 2024-04-18T21:06:49.348 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000194768 2024-04-18T21:06:49.348 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.348 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.348 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:49.348 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615950+0000", 2024-04-18T21:06:49.348 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3084e-05 2024-04-18T21:06:49.348 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.349 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.349 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:49.349 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643676+0000", 2024-04-18T21:06:49.349 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027725639999999999 2024-04-18T21:06:49.349 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.349 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.349 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:49.349 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643867+0000", 2024-04-18T21:06:49.349 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019075900000000001 2024-04-18T21:06:49.349 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.349 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.349 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:49.349 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:06:49.350 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036013799999999997 2024-04-18T21:06:49.350 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.350 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.350 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:49.350 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646068+0000", 2024-04-18T21:06:49.350 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001841536 2024-04-18T21:06:49.350 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.350 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.350 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:49.350 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661184+0000", 2024-04-18T21:06:49.350 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015115458999999999 2024-04-18T21:06:49.350 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.351 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.351 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:49.351 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661283+0000", 2024-04-18T21:06:49.351 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9502999999999999e-05 2024-04-18T21:06:49.351 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.351 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.351 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:49.351 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661415+0000", 2024-04-18T21:06:49.351 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000132037 2024-04-18T21:06:49.351 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:49.351 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:49.351 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:49.351 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.351 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.352 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:49.352 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:49.352 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 103.72026807100001, 2024-04-18T21:06:49.352 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043572403000000003, 2024-04-18T21:06:49.352 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:49.352 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:49.352 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:49.352 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:49.352 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.352 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:49.352 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:49.352 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:49.352 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.353 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.353 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:49.353 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:49.353 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:49.353 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.353 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.353 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:49.353 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616192+0000", 2024-04-18T21:06:49.353 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:06:49.353 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.353 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.353 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:49.353 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616203+0000", 2024-04-18T21:06:49.353 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0890000000000001e-05 2024-04-18T21:06:49.353 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.353 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.354 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:49.354 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616223+0000", 2024-04-18T21:06:49.354 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0409000000000001e-05 2024-04-18T21:06:49.354 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.354 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.354 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:49.354 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616238+0000", 2024-04-18T21:06:49.354 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5160000000000001e-05 2024-04-18T21:06:49.354 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.354 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.354 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:49.354 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616343+0000", 2024-04-18T21:06:49.354 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000104831 2024-04-18T21:06:49.354 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.355 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.355 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:49.355 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616357+0000", 2024-04-18T21:06:49.355 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3686000000000001e-05 2024-04-18T21:06:49.355 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.355 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.355 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:49.355 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635912+0000", 2024-04-18T21:06:49.355 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019554944000000001 2024-04-18T21:06:49.355 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.355 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.355 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:49.355 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636231+0000", 2024-04-18T21:06:49.355 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000318766 2024-04-18T21:06:49.355 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.356 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.356 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:49.356 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659763+0000", 2024-04-18T21:06:49.356 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023532474000000001 2024-04-18T21:06:49.356 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:49.356 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:49.356 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:49.356 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.356 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.356 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:99 3.1f 3:f83d65d8:::200.00000004:head [write 313655~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:49.356 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757646+0000", 2024-04-18T21:06:49.356 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.5788122910000002, 2024-04-18T21:06:49.356 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043356459999999999, 2024-04-18T21:06:49.356 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:49.357 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:49.357 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:49.357 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:49.357 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.357 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:49.357 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757646+0000", 2024-04-18T21:06:49.357 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:49.357 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.357 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.357 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:49.357 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757646+0000", 2024-04-18T21:06:49.357 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:49.357 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.357 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.358 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:49.358 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757647+0000", 2024-04-18T21:06:49.358 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.44e-07 2024-04-18T21:06:49.358 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.358 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.358 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:49.358 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757656+0000", 2024-04-18T21:06:49.358 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6559999999999998e-06 2024-04-18T21:06:49.358 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.358 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.358 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:49.358 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757665+0000", 2024-04-18T21:06:49.358 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.6099999999999995e-06 2024-04-18T21:06:49.358 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.358 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.358 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:49.359 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757672+0000", 2024-04-18T21:06:49.359 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7270000000000001e-06 2024-04-18T21:06:49.359 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.359 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.359 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:49.359 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.794854+0000", 2024-04-18T21:06:49.359 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.037182448999999999 2024-04-18T21:06:49.359 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.359 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.359 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:49.359 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.795081+0000", 2024-04-18T21:06:49.359 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000226689 2024-04-18T21:06:49.359 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.359 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.360 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:49.360 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.795369+0000", 2024-04-18T21:06:49.360 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028752600000000003 2024-04-18T21:06:49.360 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.360 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.360 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:49.360 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.799725+0000", 2024-04-18T21:06:49.360 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043563509999999996 2024-04-18T21:06:49.360 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.360 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.360 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:49.360 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.800863+0000", 2024-04-18T21:06:49.360 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0011377799999999999 2024-04-18T21:06:49.361 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.361 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.361 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:49.361 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.800918+0000", 2024-04-18T21:06:49.361 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5547999999999997e-05 2024-04-18T21:06:49.361 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.361 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.361 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:49.361 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.801003+0000", 2024-04-18T21:06:49.361 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4480000000000004e-05 2024-04-18T21:06:49.361 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:49.361 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:49.361 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:49.362 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.362 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.362 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:100 3.1f 3:f83d65d8:::200.00000004:head [write 315055~1400 [fadvise_dontneed] in=1400b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:49.362 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757681+0000", 2024-04-18T21:06:49.362 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.5787776710000001, 2024-04-18T21:06:49.362 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045364542000000001, 2024-04-18T21:06:49.362 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:49.362 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:49.362 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:49.362 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:49.362 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.362 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:49.363 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757681+0000", 2024-04-18T21:06:49.363 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:49.363 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.363 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.363 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:49.363 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757681+0000", 2024-04-18T21:06:49.363 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:49.363 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.364 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.364 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:49.364 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757682+0000", 2024-04-18T21:06:49.364 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8999999999999996e-07 2024-04-18T21:06:49.364 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.364 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.364 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:49.364 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757685+0000", 2024-04-18T21:06:49.364 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.766e-06 2024-04-18T21:06:49.364 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.364 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.364 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:49.364 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757715+0000", 2024-04-18T21:06:49.364 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9904e-05 2024-04-18T21:06:49.365 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.365 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.365 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:49.365 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757723+0000", 2024-04-18T21:06:49.365 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9899999999999997e-06 2024-04-18T21:06:49.365 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.365 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.365 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:49.365 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.796754+0000", 2024-04-18T21:06:49.365 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.039030774999999997 2024-04-18T21:06:49.365 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.365 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.365 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:49.365 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.796825+0000", 2024-04-18T21:06:49.365 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0511000000000003e-05 2024-04-18T21:06:49.366 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.366 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.366 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:49.366 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.796952+0000", 2024-04-18T21:06:49.366 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012720099999999999 2024-04-18T21:06:49.366 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.366 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.366 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:49.366 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.800774+0000", 2024-04-18T21:06:49.366 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0038226039999999998 2024-04-18T21:06:49.366 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.366 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.366 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:49.366 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802920+0000", 2024-04-18T21:06:49.367 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002145194 2024-04-18T21:06:49.367 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.367 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.367 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:49.367 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802998+0000", 2024-04-18T21:06:49.367 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7836000000000005e-05 2024-04-18T21:06:49.367 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.367 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.367 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:49.367 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803046+0000", 2024-04-18T21:06:49.367 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8071000000000001e-05 2024-04-18T21:06:49.367 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:49.367 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:49.368 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:49.368 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.368 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.368 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:101 3.1f 3:f83d65d8:::200.00000004:head [write 316455~1401 [fadvise_dontneed] in=1401b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:49.368 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:06:49.368 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.5787249079999999, 2024-04-18T21:06:49.368 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.048270212999999999, 2024-04-18T21:06:49.368 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:49.368 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:49.368 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:49.368 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:49.368 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.369 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:49.369 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:06:49.369 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:49.369 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.369 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.369 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:49.369 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:06:49.369 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:49.369 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.369 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.369 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:49.369 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:06:49.369 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7700000000000004e-07 2024-04-18T21:06:49.369 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.370 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.370 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:49.370 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757745+0000", 2024-04-18T21:06:49.370 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0910000000000001e-05 2024-04-18T21:06:49.370 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.370 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.370 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:49.370 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757758+0000", 2024-04-18T21:06:49.370 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2593e-05 2024-04-18T21:06:49.370 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.370 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.370 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:49.370 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757765+0000", 2024-04-18T21:06:49.371 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1659999999999997e-06 2024-04-18T21:06:49.371 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.371 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.371 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:49.371 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.797782+0000", 2024-04-18T21:06:49.371 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.040017283000000001 2024-04-18T21:06:49.371 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.371 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.371 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:49.371 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.797949+0000", 2024-04-18T21:06:49.371 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016650399999999999 2024-04-18T21:06:49.371 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.372 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.372 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:49.372 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.798152+0000", 2024-04-18T21:06:49.372 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000203098 2024-04-18T21:06:49.372 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.372 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.372 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:49.372 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.800792+0000", 2024-04-18T21:06:49.372 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026394779999999998 2024-04-18T21:06:49.372 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.372 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.372 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:49.372 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805921+0000", 2024-04-18T21:06:49.372 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0051295519999999999 2024-04-18T21:06:49.373 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.373 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.373 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:49.373 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805967+0000", 2024-04-18T21:06:49.373 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5457000000000002e-05 2024-04-18T21:06:49.373 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.373 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.373 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:49.373 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806004+0000", 2024-04-18T21:06:49.373 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7494999999999999e-05 2024-04-18T21:06:49.373 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:49.373 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:49.373 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:49.373 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.374 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.374 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:102 3.1f 3:f83d65d8:::200.00000004:head [write 317856~1403 [fadvise_dontneed] in=1403b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:49.374 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757775+0000", 2024-04-18T21:06:49.374 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.5786838420000002, 2024-04-18T21:06:49.374 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.048337705000000002, 2024-04-18T21:06:49.374 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:49.374 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:49.374 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:49.374 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:49.374 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.374 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:49.374 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757775+0000", 2024-04-18T21:06:49.374 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:49.375 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.375 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.375 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:49.375 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757775+0000", 2024-04-18T21:06:49.375 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:49.375 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.375 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.375 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:49.375 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757776+0000", 2024-04-18T21:06:49.375 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5300000000000004e-07 2024-04-18T21:06:49.375 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.375 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.375 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:49.375 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757780+0000", 2024-04-18T21:06:49.375 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2270000000000004e-06 2024-04-18T21:06:49.376 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.376 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.376 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:49.376 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757792+0000", 2024-04-18T21:06:49.376 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2696e-05 2024-04-18T21:06:49.376 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.376 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.376 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:49.376 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757800+0000", 2024-04-18T21:06:49.376 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1439999999999997e-06 2024-04-18T21:06:49.376 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.376 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.376 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:49.376 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.798773+0000", 2024-04-18T21:06:49.376 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.040973074999999998 2024-04-18T21:06:49.377 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.377 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.377 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:49.377 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.798990+0000", 2024-04-18T21:06:49.377 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000217161 2024-04-18T21:06:49.377 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.377 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.377 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:49.377 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.799173+0000", 2024-04-18T21:06:49.377 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018295900000000001 2024-04-18T21:06:49.377 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.377 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.377 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:49.377 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802469+0000", 2024-04-18T21:06:49.377 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032965350000000002 2024-04-18T21:06:49.378 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.378 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.378 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:49.378 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806042+0000", 2024-04-18T21:06:49.378 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035724630000000001 2024-04-18T21:06:49.378 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.378 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.378 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:49.378 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806077+0000", 2024-04-18T21:06:49.378 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4997999999999999e-05 2024-04-18T21:06:49.378 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.378 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.378 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:49.379 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806113+0000", 2024-04-18T21:06:49.379 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5794000000000003e-05 2024-04-18T21:06:49.379 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:49.379 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:49.379 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:49.379 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.379 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.379 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:103 3.1f 3:f83d65d8:::200.00000004:head [write 319259~1404 [fadvise_dontneed] in=1404b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:49.379 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:06:49.379 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.5786499960000002, 2024-04-18T21:06:49.379 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.048414481000000002, 2024-04-18T21:06:49.379 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:49.379 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:49.379 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:49.379 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:49.380 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.380 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:49.380 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:06:49.380 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:49.380 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.380 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.380 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:49.380 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:06:49.380 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:49.380 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.380 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.380 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:49.380 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:06:49.380 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4700000000000001e-07 2024-04-18T21:06:49.381 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.381 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.381 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:49.381 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757814+0000", 2024-04-18T21:06:49.381 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1829999999999996e-06 2024-04-18T21:06:49.381 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.381 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.381 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:49.381 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757825+0000", 2024-04-18T21:06:49.381 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1754e-05 2024-04-18T21:06:49.381 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.381 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.381 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:49.381 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757832+0000", 2024-04-18T21:06:49.381 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8430000000000004e-06 2024-04-18T21:06:49.381 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.382 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.382 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:49.382 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.799809+0000", 2024-04-18T21:06:49.382 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.041976960000000001 2024-04-18T21:06:49.382 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.382 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.382 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:49.382 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.799934+0000", 2024-04-18T21:06:49.382 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000125053 2024-04-18T21:06:49.382 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.382 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.382 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:49.382 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.800067+0000", 2024-04-18T21:06:49.382 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013276299999999999 2024-04-18T21:06:49.383 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.383 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.383 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:49.383 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804582+0000", 2024-04-18T21:06:49.383 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0045148899999999997 2024-04-18T21:06:49.383 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.383 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.383 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:49.383 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806158+0000", 2024-04-18T21:06:49.383 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001575894 2024-04-18T21:06:49.383 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.383 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.383 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:49.383 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806189+0000", 2024-04-18T21:06:49.383 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1423000000000001e-05 2024-04-18T21:06:49.384 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.384 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.384 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:49.384 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806223+0000", 2024-04-18T21:06:49.384 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4071e-05 2024-04-18T21:06:49.384 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:49.384 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:49.384 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:49.384 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.384 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.384 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:104 3.1f 3:f83d65d8:::200.00000004:head [write 320663~1405 [fadvise_dontneed] in=1405b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:49.384 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757841+0000", 2024-04-18T21:06:49.384 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.5786177920000002, 2024-04-18T21:06:49.384 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056381623999999998, 2024-04-18T21:06:49.385 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:49.385 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:49.385 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:49.385 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:49.385 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.385 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:49.385 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757841+0000", 2024-04-18T21:06:49.385 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:49.385 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.385 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.385 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:49.385 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757841+0000", 2024-04-18T21:06:49.386 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:49.386 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.386 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.386 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:49.386 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757842+0000", 2024-04-18T21:06:49.386 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5000000000000002e-07 2024-04-18T21:06:49.386 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.386 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.386 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:49.386 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757852+0000", 2024-04-18T21:06:49.386 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.084e-05 2024-04-18T21:06:49.386 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.386 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.386 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:49.387 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757865+0000", 2024-04-18T21:06:49.387 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2643000000000001e-05 2024-04-18T21:06:49.387 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.387 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.387 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:49.387 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757872+0000", 2024-04-18T21:06:49.387 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8689999999999998e-06 2024-04-18T21:06:49.387 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.387 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.387 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:49.387 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.801102+0000", 2024-04-18T21:06:49.387 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043229837 2024-04-18T21:06:49.387 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.387 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.387 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:49.388 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.801291+0000", 2024-04-18T21:06:49.388 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000189641 2024-04-18T21:06:49.388 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.388 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.388 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:49.388 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.801640+0000", 2024-04-18T21:06:49.388 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000348971 2024-04-18T21:06:49.388 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.388 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.388 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:49.388 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805849+0000", 2024-04-18T21:06:49.388 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042082739999999997 2024-04-18T21:06:49.388 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.388 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.389 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:49.389 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814135+0000", 2024-04-18T21:06:49.389 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0082867270000000007 2024-04-18T21:06:49.389 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.389 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.389 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:49.389 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814180+0000", 2024-04-18T21:06:49.389 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4982999999999999e-05 2024-04-18T21:06:49.389 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.389 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.389 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:49.389 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814223+0000", 2024-04-18T21:06:49.389 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2188999999999999e-05 2024-04-18T21:06:49.389 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:49.390 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:49.390 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:49.390 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.390 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.390 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:105 3.1f 3:f83d65d8:::200.00000004:head [write 322068~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:49.390 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:06:49.390 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.5785771959999999, 2024-04-18T21:06:49.390 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056513678999999997, 2024-04-18T21:06:49.390 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:49.390 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:49.390 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:49.390 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:49.390 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.390 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:49.391 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:06:49.391 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:49.391 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.391 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.391 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:49.391 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:06:49.391 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:49.391 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.391 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.391 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:49.391 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:06:49.391 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2600000000000002e-07 2024-04-18T21:06:49.391 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.391 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.391 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:49.391 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757888+0000", 2024-04-18T21:06:49.392 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7130000000000002e-06 2024-04-18T21:06:49.392 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.392 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.392 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:49.392 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757906+0000", 2024-04-18T21:06:49.392 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7723999999999998e-05 2024-04-18T21:06:49.392 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.392 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.392 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:49.392 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757921+0000", 2024-04-18T21:06:49.392 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4936000000000001e-05 2024-04-18T21:06:49.392 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.392 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.392 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:49.392 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802493+0000", 2024-04-18T21:06:49.392 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.044571927999999997 2024-04-18T21:06:49.393 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.393 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.393 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:49.393 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802537+0000", 2024-04-18T21:06:49.393 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4449000000000001e-05 2024-04-18T21:06:49.393 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.393 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.393 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:49.393 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802605+0000", 2024-04-18T21:06:49.393 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7945000000000001e-05 2024-04-18T21:06:49.393 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.393 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.393 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:49.393 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805852+0000", 2024-04-18T21:06:49.393 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032469909999999999 2024-04-18T21:06:49.394 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.394 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.394 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:49.394 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814298+0000", 2024-04-18T21:06:49.394 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084463309999999996 2024-04-18T21:06:49.394 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.394 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.394 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:49.394 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814355+0000", 2024-04-18T21:06:49.394 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6459999999999998e-05 2024-04-18T21:06:49.394 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.394 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.394 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:49.394 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814395+0000", 2024-04-18T21:06:49.395 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0475999999999997e-05 2024-04-18T21:06:49.395 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:49.395 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:49.395 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:49.395 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.395 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.395 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:106 3.1f 3:f83d65d8:::200.00000004:head [write 323467~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:49.395 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757955+0000", 2024-04-18T21:06:49.395 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.5785039670000001, 2024-04-18T21:06:49.395 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056539990999999998, 2024-04-18T21:06:49.395 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:49.395 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:49.395 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:49.395 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:49.395 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.396 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:49.396 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757955+0000", 2024-04-18T21:06:49.396 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:49.396 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.396 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.396 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:49.396 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757955+0000", 2024-04-18T21:06:49.396 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:49.396 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.396 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.396 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:49.396 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757956+0000", 2024-04-18T21:06:49.396 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.144e-06 2024-04-18T21:06:49.396 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.397 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.397 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:49.397 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757970+0000", 2024-04-18T21:06:49.397 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3899e-05 2024-04-18T21:06:49.397 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.397 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.397 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:49.397 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757988+0000", 2024-04-18T21:06:49.397 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8033000000000002e-05 2024-04-18T21:06:49.397 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.397 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.397 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:49.397 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758002+0000", 2024-04-18T21:06:49.397 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3973e-05 2024-04-18T21:06:49.398 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.398 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.398 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:49.398 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803072+0000", 2024-04-18T21:06:49.398 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045070194000000001 2024-04-18T21:06:49.398 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.398 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.402 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:49.402 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803125+0000", 2024-04-18T21:06:49.402 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3498000000000002e-05 2024-04-18T21:06:49.402 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.402 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.402 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:49.402 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803233+0000", 2024-04-18T21:06:49.402 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010704099999999999 2024-04-18T21:06:49.402 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.402 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.403 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:49.403 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805856+0000", 2024-04-18T21:06:49.403 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026233430000000002 2024-04-18T21:06:49.403 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.403 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.403 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:49.403 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814439+0000", 2024-04-18T21:06:49.403 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0085833839999999995 2024-04-18T21:06:49.403 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.403 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.403 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:49.403 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814469+0000", 2024-04-18T21:06:49.403 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9784000000000001e-05 2024-04-18T21:06:49.403 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.404 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.404 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:49.404 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814495+0000", 2024-04-18T21:06:49.404 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5698e-05 2024-04-18T21:06:49.404 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:49.404 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:49.404 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:49.404 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.404 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.404 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:107 3.1f 3:f83d65d8:::200.00000004:head [write 324866~1421 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:49.404 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758019+0000", 2024-04-18T21:06:49.405 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.5784393410000002, 2024-04-18T21:06:49.405 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056580563, 2024-04-18T21:06:49.405 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:49.405 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:49.405 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:49.405 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:49.405 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.405 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:49.405 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758019+0000", 2024-04-18T21:06:49.405 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:49.405 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.405 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.405 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:49.405 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758019+0000", 2024-04-18T21:06:49.406 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:49.406 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.406 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.406 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:49.406 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758021+0000", 2024-04-18T21:06:49.406 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1999999999999999e-06 2024-04-18T21:06:49.406 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.406 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.406 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:49.406 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758028+0000", 2024-04-18T21:06:49.406 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7200000000000006e-06 2024-04-18T21:06:49.406 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.406 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.406 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:49.407 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758050+0000", 2024-04-18T21:06:49.407 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1877000000000001e-05 2024-04-18T21:06:49.407 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.407 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.407 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:49.407 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758064+0000", 2024-04-18T21:06:49.407 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.383e-05 2024-04-18T21:06:49.407 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.407 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.407 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:49.407 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803593+0000", 2024-04-18T21:06:49.407 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045528831999999998 2024-04-18T21:06:49.407 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.408 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.408 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:49.408 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803635+0000", 2024-04-18T21:06:49.408 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1980000000000001e-05 2024-04-18T21:06:49.408 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.408 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.408 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:49.408 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803703+0000", 2024-04-18T21:06:49.408 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8542999999999997e-05 2024-04-18T21:06:49.408 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.408 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.408 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:49.408 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806123+0000", 2024-04-18T21:06:49.408 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002419769 2024-04-18T21:06:49.409 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.409 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.409 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:49.409 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814542+0000", 2024-04-18T21:06:49.409 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084189460000000001 2024-04-18T21:06:49.409 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.409 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.409 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:49.409 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814576+0000", 2024-04-18T21:06:49.409 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3679000000000001e-05 2024-04-18T21:06:49.409 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.409 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.409 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:49.410 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814600+0000", 2024-04-18T21:06:49.410 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4187000000000001e-05 2024-04-18T21:06:49.410 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:49.410 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:49.410 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:49.410 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.410 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.410 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:108 3.1f 3:f83d65d8:::200.00000004:head [write 326287~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:49.410 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:06:49.410 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.578376172, 2024-04-18T21:06:49.410 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056616183, 2024-04-18T21:06:49.410 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:49.411 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:49.411 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:49.411 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:49.411 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.411 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:49.411 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:06:49.411 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:49.411 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.411 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.411 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:49.411 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:06:49.411 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:49.411 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.411 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.411 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:49.412 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758084+0000", 2024-04-18T21:06:49.412 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.124e-06 2024-04-18T21:06:49.412 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.412 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.412 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:49.412 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758100+0000", 2024-04-18T21:06:49.412 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6246e-05 2024-04-18T21:06:49.412 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.412 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.412 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:49.412 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758118+0000", 2024-04-18T21:06:49.412 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8267e-05 2024-04-18T21:06:49.412 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.412 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.412 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:49.413 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758134+0000", 2024-04-18T21:06:49.413 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5950000000000001e-05 2024-04-18T21:06:49.413 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.413 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.413 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:49.413 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803949+0000", 2024-04-18T21:06:49.413 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045815349999999998 2024-04-18T21:06:49.413 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.413 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.413 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:49.413 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804011+0000", 2024-04-18T21:06:49.413 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1044999999999996e-05 2024-04-18T21:06:49.413 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.413 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.414 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:49.414 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804128+0000", 2024-04-18T21:06:49.414 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117148 2024-04-18T21:06:49.414 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.414 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.414 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:49.414 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806794+0000", 2024-04-18T21:06:49.414 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002666692 2024-04-18T21:06:49.414 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.414 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.414 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:49.414 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814645+0000", 2024-04-18T21:06:49.414 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0078508880000000003 2024-04-18T21:06:49.414 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.415 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.415 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:49.415 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814678+0000", 2024-04-18T21:06:49.415 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3188999999999997e-05 2024-04-18T21:06:49.415 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.415 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.415 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:49.415 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814699+0000", 2024-04-18T21:06:49.415 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0284000000000001e-05 2024-04-18T21:06:49.415 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:49.415 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:49.415 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:49.415 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.415 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.416 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:109 3.1f 3:f83d65d8:::200.00000004:head [write 327693~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:49.416 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:06:49.416 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.578306805, 2024-04-18T21:06:49.416 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056621036999999999, 2024-04-18T21:06:49.416 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:49.416 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:49.416 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:49.416 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:49.416 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.416 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:49.416 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:06:49.416 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:49.416 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.417 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.417 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:49.417 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:06:49.417 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:49.417 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.417 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.417 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:49.417 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758153+0000", 2024-04-18T21:06:49.417 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1459999999999999e-06 2024-04-18T21:06:49.417 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.417 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.417 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:49.418 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758161+0000", 2024-04-18T21:06:49.418 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7999999999999999e-06 2024-04-18T21:06:49.418 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.418 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.418 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:49.418 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758179+0000", 2024-04-18T21:06:49.418 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7949999999999999e-05 2024-04-18T21:06:49.418 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.418 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.418 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:49.418 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758193+0000", 2024-04-18T21:06:49.418 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3773e-05 2024-04-18T21:06:49.418 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.418 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.419 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:49.419 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804632+0000", 2024-04-18T21:06:49.419 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.046439469999999997 2024-04-18T21:06:49.419 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.419 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.419 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:49.419 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804790+0000", 2024-04-18T21:06:49.419 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015784300000000001 2024-04-18T21:06:49.419 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.419 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.420 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:49.420 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805056+0000", 2024-04-18T21:06:49.420 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026652400000000003 2024-04-18T21:06:49.420 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.420 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.420 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:49.420 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.808959+0000", 2024-04-18T21:06:49.420 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003903077 2024-04-18T21:06:49.420 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.420 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.420 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:49.420 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814728+0000", 2024-04-18T21:06:49.420 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0057682489999999996 2024-04-18T21:06:49.421 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.421 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.421 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:49.421 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814754+0000", 2024-04-18T21:06:49.421 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6673999999999999e-05 2024-04-18T21:06:49.421 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.421 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.421 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:49.421 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814773+0000", 2024-04-18T21:06:49.421 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8530999999999999e-05 2024-04-18T21:06:49.421 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:49.421 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:49.421 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:49.421 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.421 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.422 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:110 3.1f 3:f83d65d8:::200.00000004:head [write 329098~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:49.422 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:06:49.422 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.5782483960000002, 2024-04-18T21:06:49.422 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056669113, 2024-04-18T21:06:49.422 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:49.422 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:49.422 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:49.422 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:49.422 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.422 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:49.422 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:06:49.422 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:49.423 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.423 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.423 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:49.423 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:06:49.423 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:49.423 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.423 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.423 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:49.423 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758212+0000", 2024-04-18T21:06:49.423 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:06:49.423 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.423 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.423 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:49.423 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758219+0000", 2024-04-18T21:06:49.423 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4229999999999999e-06 2024-04-18T21:06:49.423 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.424 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.424 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:49.424 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758237+0000", 2024-04-18T21:06:49.424 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7966999999999999e-05 2024-04-18T21:06:49.424 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.424 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.424 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:49.424 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758252+0000", 2024-04-18T21:06:49.424 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5322999999999999e-05 2024-04-18T21:06:49.424 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.424 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.424 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:49.424 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805536+0000", 2024-04-18T21:06:49.424 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.047283861000000003 2024-04-18T21:06:49.425 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.425 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.425 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:49.425 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805579+0000", 2024-04-18T21:06:49.425 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2738999999999999e-05 2024-04-18T21:06:49.425 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.425 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.425 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:49.425 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805649+0000", 2024-04-18T21:06:49.425 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0213e-05 2024-04-18T21:06:49.425 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.425 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.426 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:49.426 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.808966+0000", 2024-04-18T21:06:49.426 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033166129999999999 2024-04-18T21:06:49.426 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.426 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.426 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:49.426 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814812+0000", 2024-04-18T21:06:49.426 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0058463589999999998 2024-04-18T21:06:49.426 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.426 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.426 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:49.426 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814854+0000", 2024-04-18T21:06:49.426 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1618e-05 2024-04-18T21:06:49.427 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.427 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.427 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:49.427 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814879+0000", 2024-04-18T21:06:49.427 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5754000000000001e-05 2024-04-18T21:06:49.427 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:49.427 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:49.427 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:49.427 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.427 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.427 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:111 3.1f 3:f83d65d8:::200.00000004:head [write 330499~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:49.427 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:06:49.427 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.5781874199999999, 2024-04-18T21:06:49.427 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058693793000000001, 2024-04-18T21:06:49.427 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:49.428 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:49.428 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:49.428 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:49.428 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.428 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:49.428 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:06:49.428 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:49.428 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.428 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.429 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:49.429 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:06:49.429 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:49.429 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.429 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.429 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:49.429 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758272+0000", 2024-04-18T21:06:49.429 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1200000000000001e-06 2024-04-18T21:06:49.429 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.429 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.429 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:49.429 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758287+0000", 2024-04-18T21:06:49.429 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5017e-05 2024-04-18T21:06:49.430 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.430 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.430 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:49.430 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758309+0000", 2024-04-18T21:06:49.430 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1866e-05 2024-04-18T21:06:49.430 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.430 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.430 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:49.430 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758323+0000", 2024-04-18T21:06:49.430 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3606e-05 2024-04-18T21:06:49.430 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.430 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.430 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:49.430 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806279+0000", 2024-04-18T21:06:49.431 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.047956061000000001 2024-04-18T21:06:49.431 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.431 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.431 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:49.431 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806350+0000", 2024-04-18T21:06:49.431 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1070999999999998e-05 2024-04-18T21:06:49.431 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.431 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.431 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:49.431 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806459+0000", 2024-04-18T21:06:49.432 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000108606 2024-04-18T21:06:49.432 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.432 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.432 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:49.432 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.809774+0000", 2024-04-18T21:06:49.433 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003314881 2024-04-18T21:06:49.433 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.433 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.433 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:49.433 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816910+0000", 2024-04-18T21:06:49.433 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0071367760000000001 2024-04-18T21:06:49.433 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.433 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.433 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:49.433 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816941+0000", 2024-04-18T21:06:49.433 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0846000000000002e-05 2024-04-18T21:06:49.433 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.433 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.433 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:49.434 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816965+0000", 2024-04-18T21:06:49.434 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3943000000000001e-05 2024-04-18T21:06:49.434 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:49.434 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:49.434 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:49.434 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.434 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.434 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:5230 4.17 4:eb2cc4c4:::1000000184c.00000000:head [write 0~2191] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-18T21:06:49.434 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.760650+0000", 2024-04-18T21:06:49.434 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.575808249, 2024-04-18T21:06:49.434 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.054210577000000003, 2024-04-18T21:06:49.434 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:49.434 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:49.435 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:49.435 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:06:49.435 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:06:49.435 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:49.435 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 5230 2024-04-18T21:06:49.435 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.435 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:49.435 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.435 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:49.435 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760650+0000", 2024-04-18T21:06:49.435 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:49.435 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.435 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.435 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:49.435 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760650+0000", 2024-04-18T21:06:49.436 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:49.436 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.436 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.436 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:49.436 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760653+0000", 2024-04-18T21:06:49.436 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0829999999999998e-06 2024-04-18T21:06:49.436 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.436 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.436 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:49.436 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760664+0000", 2024-04-18T21:06:49.436 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.111e-05 2024-04-18T21:06:49.436 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.436 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.436 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:49.437 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760688+0000", 2024-04-18T21:06:49.437 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4837e-05 2024-04-18T21:06:49.437 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.437 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.437 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:49.437 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760702+0000", 2024-04-18T21:06:49.437 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3723000000000001e-05 2024-04-18T21:06:49.437 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.437 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.437 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:49.437 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806264+0000", 2024-04-18T21:06:49.437 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045562182 2024-04-18T21:06:49.437 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.437 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.438 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:49.438 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806351+0000", 2024-04-18T21:06:49.438 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6322000000000005e-05 2024-04-18T21:06:49.438 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.438 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.438 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:49.438 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806453+0000", 2024-04-18T21:06:49.438 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000102602 2024-04-18T21:06:49.438 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.438 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.438 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:49.438 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.808972+0000", 2024-04-18T21:06:49.438 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025184090000000001 2024-04-18T21:06:49.439 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.439 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.439 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:49.439 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814798+0000", 2024-04-18T21:06:49.439 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0058266689999999996 2024-04-18T21:06:49.439 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.439 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.439 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:49.439 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814839+0000", 2024-04-18T21:06:49.439 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0482000000000003e-05 2024-04-18T21:06:49.439 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.439 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.439 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:49.439 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814861+0000", 2024-04-18T21:06:49.439 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2158e-05 2024-04-18T21:06:49.440 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:49.440 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:49.440 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:49.440 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.440 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.440 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:112 3.1f 3:f83d65d8:::200.00000004:head [write 331898~20167 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:49.440 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.771321+0000", 2024-04-18T21:06:49.440 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.565137622, 2024-04-18T21:06:49.440 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045740306000000001, 2024-04-18T21:06:49.440 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:49.440 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:49.440 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:49.440 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:49.440 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.441 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:49.441 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771321+0000", 2024-04-18T21:06:49.441 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:49.441 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.441 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.441 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:49.441 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771321+0000", 2024-04-18T21:06:49.441 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:49.441 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.441 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.441 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:49.441 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771323+0000", 2024-04-18T21:06:49.441 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3740000000000001e-06 2024-04-18T21:06:49.441 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.442 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.442 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:49.442 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771359+0000", 2024-04-18T21:06:49.442 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5447999999999997e-05 2024-04-18T21:06:49.442 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.442 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.442 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:49.442 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771388+0000", 2024-04-18T21:06:49.442 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8915e-05 2024-04-18T21:06:49.442 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.442 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.442 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:49.442 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771410+0000", 2024-04-18T21:06:49.443 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1899000000000002e-05 2024-04-18T21:06:49.443 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.443 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.443 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:49.443 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806827+0000", 2024-04-18T21:06:49.443 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.035417063999999998 2024-04-18T21:06:49.443 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.443 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.443 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:49.443 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806873+0000", 2024-04-18T21:06:49.443 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6261999999999999e-05 2024-04-18T21:06:49.443 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.443 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.443 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:49.444 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806946+0000", 2024-04-18T21:06:49.444 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3205000000000001e-05 2024-04-18T21:06:49.444 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.444 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.444 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:49.444 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.809781+0000", 2024-04-18T21:06:49.444 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002834937 2024-04-18T21:06:49.444 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.444 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.444 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:49.444 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817003+0000", 2024-04-18T21:06:49.444 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0072217959999999999 2024-04-18T21:06:49.444 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.445 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.445 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:49.445 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817038+0000", 2024-04-18T21:06:49.445 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4696999999999997e-05 2024-04-18T21:06:49.445 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.445 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.445 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:49.445 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817061+0000", 2024-04-18T21:06:49.445 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3708999999999999e-05 2024-04-18T21:06:49.445 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:49.445 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:49.445 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:49.445 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.445 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.446 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:113 3.1f 3:f83d65d8:::200.00000004:head [write 352065~3878 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:49.446 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.771472+0000", 2024-04-18T21:06:49.446 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.5649868859999998, 2024-04-18T21:06:49.446 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045689726, 2024-04-18T21:06:49.446 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:49.446 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:49.446 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:49.446 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:49.446 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.446 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:49.446 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771472+0000", 2024-04-18T21:06:49.446 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:49.446 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.446 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.447 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:49.447 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771472+0000", 2024-04-18T21:06:49.447 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:49.447 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.447 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.447 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:49.447 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771473+0000", 2024-04-18T21:06:49.447 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3829999999999999e-06 2024-04-18T21:06:49.447 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.447 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.447 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:49.447 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771489+0000", 2024-04-18T21:06:49.447 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5797000000000001e-05 2024-04-18T21:06:49.447 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.447 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.447 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:49.448 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771509+0000", 2024-04-18T21:06:49.448 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0401999999999999e-05 2024-04-18T21:06:49.448 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.448 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.448 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:49.448 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771525+0000", 2024-04-18T21:06:49.448 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5099999999999999e-05 2024-04-18T21:06:49.448 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.448 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.448 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:49.448 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807273+0000", 2024-04-18T21:06:49.448 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.035748488000000002 2024-04-18T21:06:49.448 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.448 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.449 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:49.449 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807343+0000", 2024-04-18T21:06:49.449 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0277000000000005e-05 2024-04-18T21:06:49.449 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.449 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.449 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:49.449 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807455+0000", 2024-04-18T21:06:49.449 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011171999999999999 2024-04-18T21:06:49.449 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.449 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.449 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:49.449 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.811509+0000", 2024-04-18T21:06:49.449 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0040543469999999998 2024-04-18T21:06:49.449 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.450 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.450 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:49.450 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817115+0000", 2024-04-18T21:06:49.450 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0056054520000000004 2024-04-18T21:06:49.450 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.450 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.450 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:49.450 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817142+0000", 2024-04-18T21:06:49.450 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7430999999999999e-05 2024-04-18T21:06:49.450 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.450 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.450 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:49.450 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817162+0000", 2024-04-18T21:06:49.450 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9329000000000001e-05 2024-04-18T21:06:49.450 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:49.451 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:49.451 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:49.451 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.451 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.451 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:114 3.1f 3:f83d65d8:::200.00000004:head [write 355943~1928 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:49.451 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.771785+0000", 2024-04-18T21:06:49.451 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.5646735409999999, 2024-04-18T21:06:49.451 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045480532999999997, 2024-04-18T21:06:49.451 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:49.451 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:49.451 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:49.451 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:49.451 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.451 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:49.451 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771785+0000", 2024-04-18T21:06:49.451 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:49.452 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.452 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.452 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:49.452 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771785+0000", 2024-04-18T21:06:49.452 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:49.452 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.452 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.452 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:49.452 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771787+0000", 2024-04-18T21:06:49.452 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0600000000000002e-06 2024-04-18T21:06:49.452 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.452 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.452 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:49.452 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771799+0000", 2024-04-18T21:06:49.453 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1503e-05 2024-04-18T21:06:49.453 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.453 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.453 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:49.453 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771829+0000", 2024-04-18T21:06:49.453 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.04e-05 2024-04-18T21:06:49.453 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.453 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.453 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:49.453 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771846+0000", 2024-04-18T21:06:49.453 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6608000000000001e-05 2024-04-18T21:06:49.453 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.454 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.454 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:49.454 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807856+0000", 2024-04-18T21:06:49.454 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036010480999999997 2024-04-18T21:06:49.454 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.454 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.454 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:49.454 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807899+0000", 2024-04-18T21:06:49.454 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2775999999999998e-05 2024-04-18T21:06:49.454 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.454 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.454 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:49.455 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807966+0000", 2024-04-18T21:06:49.455 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6793999999999998e-05 2024-04-18T21:06:49.455 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.455 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.455 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:49.455 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.811516+0000", 2024-04-18T21:06:49.455 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035497300000000001 2024-04-18T21:06:49.455 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.455 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.455 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:49.455 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817194+0000", 2024-04-18T21:06:49.455 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0056787030000000002 2024-04-18T21:06:49.455 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.455 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.456 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:49.456 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817231+0000", 2024-04-18T21:06:49.456 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6727000000000003e-05 2024-04-18T21:06:49.456 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:49.456 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:49.456 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:49.456 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817266+0000", 2024-04-18T21:06:49.456 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4751e-05 2024-04-18T21:06:49.456 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:49.456 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:49.456 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:49.456 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:49.456 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:49.456 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:49.458 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:49.458+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:49.458 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:49.558 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:49.558+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:49.596 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:49.596 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [ 2024-04-18T21:06:49.596 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.596 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:8010 4.1a 4:5b1eb82d:::1000000247a.00000000:head [write 0~341 in=341b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-18T21:06:49.596 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:49.597723+0000", 2024-04-18T21:06:49.596 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.0013934559999999999, 2024-04-18T21:06:49.596 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001439358, 2024-04-18T21:06:49.596 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:49.597 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:49.597 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:06:49.597 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:49.597 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:06:49.597 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:49.597 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 8010 2024-04-18T21:06:49.597 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.597 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:49.597 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.597 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:49.597 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:49.597723+0000", 2024-04-18T21:06:49.597 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:49.598 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.598 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.598 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:49.598 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:49.597723+0000", 2024-04-18T21:06:49.598 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:49.598 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.598 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.598 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:49.598 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:49.597725+0000", 2024-04-18T21:06:49.598 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1500000000000002e-06 2024-04-18T21:06:49.598 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.598 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.598 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:49.599 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:49.597736+0000", 2024-04-18T21:06:49.599 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.058e-05 2024-04-18T21:06:49.599 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.599 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.599 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:49.599 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:49.597764+0000", 2024-04-18T21:06:49.599 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8235999999999999e-05 2024-04-18T21:06:49.599 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.599 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.599 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:49.599 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:49.597778+0000", 2024-04-18T21:06:49.599 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3903999999999999e-05 2024-04-18T21:06:49.599 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.600 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.600 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:49.600 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:49.597886+0000", 2024-04-18T21:06:49.600 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000107552 2024-04-18T21:06:49.600 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.600 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.600 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:49.600 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:49.598109+0000", 2024-04-18T21:06:49.600 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000223327 2024-04-18T21:06:49.600 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.600 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.600 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:49.600 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:49.598323+0000", 2024-04-18T21:06:49.600 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00021391499999999999 2024-04-18T21:06:49.600 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:49.601 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:49.601 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:49.601 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:49.601 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2024-04-18T21:06:49.601 INFO:teuthology.orchestra.run.smithi132.stdout: "num_ops": 1 2024-04-18T21:06:49.601 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:49.611 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:49.659 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:49.658+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:49.751 INFO:teuthology.orchestra.run.smithi078.stderr:nodeep-scrub is set 2024-04-18T21:06:49.761 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:49.758+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:49.789 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:49.789 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:06:49.790 INFO:teuthology.orchestra.run.smithi132.stdout: "complaint_time": 30, 2024-04-18T21:06:49.790 INFO:teuthology.orchestra.run.smithi132.stdout: "num_blocked_ops": 0 2024-04-18T21:06:49.790 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:49.806 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:49.861 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:49.862+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:49.937 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:49.937 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 20, 2024-04-18T21:06:49.937 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 600, 2024-04-18T21:06:49.937 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [ 2024-04-18T21:06:49.937 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.937 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:49.937 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:06:49.937 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 115.024396904, 2024-04-18T21:06:49.937 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.02518273, 2024-04-18T21:06:49.937 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:49.937 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:49.938 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:49.938 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:49.938 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:49.938 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:49.938 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 141 2024-04-18T21:06:49.938 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.938 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:49.938 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.938 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:49.938 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:06:49.938 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:49.938 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.938 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.939 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:49.939 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:06:49.939 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:49.939 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.939 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.939 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:49.939 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911562+0000", 2024-04-18T21:06:49.939 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9300000000000006e-07 2024-04-18T21:06:49.939 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.939 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.939 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:49.939 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911569+0000", 2024-04-18T21:06:49.939 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0169999999999999e-06 2024-04-18T21:06:49.940 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.940 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.940 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:49.940 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911582+0000", 2024-04-18T21:06:49.940 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.343e-05 2024-04-18T21:06:49.940 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.940 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.940 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:49.940 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911590+0000", 2024-04-18T21:06:49.940 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.413e-06 2024-04-18T21:06:49.940 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.940 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.940 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:49.940 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.933922+0000", 2024-04-18T21:06:49.941 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.022332093000000001 2024-04-18T21:06:49.941 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.941 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.941 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:49.941 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.934155+0000", 2024-04-18T21:06:49.941 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023378900000000001 2024-04-18T21:06:49.941 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.941 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.941 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:49.941 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.934514+0000", 2024-04-18T21:06:49.941 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00035859200000000003 2024-04-18T21:06:49.941 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.941 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.941 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:49.942 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.935973+0000", 2024-04-18T21:06:49.942 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001458705 2024-04-18T21:06:49.942 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.942 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.942 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:49.942 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936488+0000", 2024-04-18T21:06:49.942 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00051550000000000001 2024-04-18T21:06:49.942 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.942 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.942 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:49.942 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936636+0000", 2024-04-18T21:06:49.942 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014779800000000001 2024-04-18T21:06:49.942 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.942 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.943 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:49.943 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936743+0000", 2024-04-18T21:06:49.943 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010739999999999999 2024-04-18T21:06:49.943 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:49.943 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:49.943 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:49.943 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.943 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.943 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:49.943 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:49.943 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 114.90719793, 2024-04-18T21:06:49.943 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023654959999999999, 2024-04-18T21:06:49.943 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:49.943 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:49.943 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:49.944 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:49.944 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:49.944 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:49.944 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 163 2024-04-18T21:06:49.944 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.944 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:49.944 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.944 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:49.944 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:49.944 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:49.944 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.944 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.944 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:49.944 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:49.944 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:49.945 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.945 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.945 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:49.945 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:49.945 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0999999999999998e-07 2024-04-18T21:06:49.945 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.945 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.945 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:49.945 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028766+0000", 2024-04-18T21:06:49.945 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4700000000000001e-06 2024-04-18T21:06:49.945 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.945 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.945 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:49.945 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028775+0000", 2024-04-18T21:06:49.945 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.3190000000000001e-06 2024-04-18T21:06:49.946 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.946 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.946 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:49.946 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028782+0000", 2024-04-18T21:06:49.946 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.2300000000000002e-06 2024-04-18T21:06:49.946 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.946 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.946 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:49.946 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046667+0000", 2024-04-18T21:06:49.946 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017884356000000001 2024-04-18T21:06:49.946 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.946 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.946 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:49.946 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046788+0000", 2024-04-18T21:06:49.946 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012125000000000001 2024-04-18T21:06:49.946 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.947 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.947 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:49.947 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046982+0000", 2024-04-18T21:06:49.947 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019394 2024-04-18T21:06:49.947 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.947 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.947 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:49.947 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051969+0000", 2024-04-18T21:06:49.947 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0049868150000000003 2024-04-18T21:06:49.947 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.947 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.947 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:49.947 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052089+0000", 2024-04-18T21:06:49.948 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011993 2024-04-18T21:06:49.948 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.948 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.948 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:49.948 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052292+0000", 2024-04-18T21:06:49.948 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020345699999999999 2024-04-18T21:06:49.948 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.948 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.948 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:49.948 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052415+0000", 2024-04-18T21:06:49.948 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000122483 2024-04-18T21:06:49.948 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:49.948 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:49.948 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:49.949 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.949 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.949 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:49.949 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:49.949 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 114.90716369800001, 2024-04-18T21:06:49.949 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023864586, 2024-04-18T21:06:49.949 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:49.949 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:49.949 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:49.949 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:49.949 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:49.949 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:49.949 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 164 2024-04-18T21:06:49.949 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.949 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:49.950 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.950 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:49.950 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:49.950 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:49.950 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.950 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.950 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:49.950 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:49.950 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:49.950 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.950 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.950 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:49.951 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028795+0000", 2024-04-18T21:06:49.951 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7999999999999995e-07 2024-04-18T21:06:49.951 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.951 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.951 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:49.951 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028884+0000", 2024-04-18T21:06:49.951 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8997000000000002e-05 2024-04-18T21:06:49.951 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.951 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.951 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:49.951 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028895+0000", 2024-04-18T21:06:49.951 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1647e-05 2024-04-18T21:06:49.951 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.952 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.952 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:49.952 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028903+0000", 2024-04-18T21:06:49.952 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.909e-06 2024-04-18T21:06:49.952 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.952 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.952 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:49.952 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.047818+0000", 2024-04-18T21:06:49.952 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018914337 2024-04-18T21:06:49.952 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.952 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.952 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:49.952 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.048094+0000", 2024-04-18T21:06:49.952 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00027653500000000001 2024-04-18T21:06:49.953 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.953 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.953 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:49.953 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.048471+0000", 2024-04-18T21:06:49.953 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00037705799999999999 2024-04-18T21:06:49.953 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.953 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.953 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:49.953 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052516+0000", 2024-04-18T21:06:49.953 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0040452739999999997 2024-04-18T21:06:49.953 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.953 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.953 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:49.954 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052535+0000", 2024-04-18T21:06:49.954 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.84e-05 2024-04-18T21:06:49.954 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.954 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.954 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:49.954 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052603+0000", 2024-04-18T21:06:49.954 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.8095000000000004e-05 2024-04-18T21:06:49.954 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.954 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.954 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:49.954 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052659+0000", 2024-04-18T21:06:49.954 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5653999999999999e-05 2024-04-18T21:06:49.954 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:49.954 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:49.955 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:49.955 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.955 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.955 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:49.955 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:49.955 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 114.907040255, 2024-04-18T21:06:49.955 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024516458000000001, 2024-04-18T21:06:49.955 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:49.955 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:49.955 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:49.955 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:49.955 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:49.955 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:49.955 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 165 2024-04-18T21:06:49.955 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.955 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:49.956 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.956 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:49.956 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:49.956 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:49.956 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.956 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.956 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:49.956 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:49.956 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:49.956 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.956 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.956 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:49.956 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028918+0000", 2024-04-18T21:06:49.956 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8000000000000005e-07 2024-04-18T21:06:49.956 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.957 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.957 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:49.957 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028924+0000", 2024-04-18T21:06:49.957 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5659999999999997e-06 2024-04-18T21:06:49.957 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.957 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.957 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:49.957 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028933+0000", 2024-04-18T21:06:49.957 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.38e-06 2024-04-18T21:06:49.957 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.957 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.957 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:49.957 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028940+0000", 2024-04-18T21:06:49.957 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0060000000000003e-06 2024-04-18T21:06:49.957 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.957 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.958 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:49.958 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.050846+0000", 2024-04-18T21:06:49.958 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021906119000000002 2024-04-18T21:06:49.958 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.958 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.958 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:49.958 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051025+0000", 2024-04-18T21:06:49.958 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017850799999999999 2024-04-18T21:06:49.958 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.958 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.958 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:49.958 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051221+0000", 2024-04-18T21:06:49.958 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019608700000000001 2024-04-18T21:06:49.958 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.959 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.959 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:49.959 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052675+0000", 2024-04-18T21:06:49.959 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0014537899999999999 2024-04-18T21:06:49.959 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.959 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.959 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:49.959 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053311+0000", 2024-04-18T21:06:49.959 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00063613299999999999 2024-04-18T21:06:49.959 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.959 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.959 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:49.959 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053381+0000", 2024-04-18T21:06:49.959 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0074999999999996e-05 2024-04-18T21:06:49.959 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.960 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.960 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:49.960 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053434+0000", 2024-04-18T21:06:49.960 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3013999999999998e-05 2024-04-18T21:06:49.960 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:49.960 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:49.960 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:49.960 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.960 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.960 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:49.960 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:49.960 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 114.79373477599999, 2024-04-18T21:06:49.960 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023772793, 2024-04-18T21:06:49.960 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:49.961 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:49.961 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:49.961 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:49.961 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:49.961 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:49.961 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 187 2024-04-18T21:06:49.961 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.961 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:49.961 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.961 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:49.961 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:49.961 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:49.961 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.961 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.961 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:49.961 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:49.961 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:49.962 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.962 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.962 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:49.962 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142224+0000", 2024-04-18T21:06:49.962 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.47e-07 2024-04-18T21:06:49.962 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.962 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.962 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:49.962 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142233+0000", 2024-04-18T21:06:49.962 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0729999999999994e-06 2024-04-18T21:06:49.962 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.962 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.962 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:49.962 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142255+0000", 2024-04-18T21:06:49.962 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.2535999999999999e-05 2024-04-18T21:06:49.963 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.963 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.963 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:49.963 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142268+0000", 2024-04-18T21:06:49.963 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2686e-05 2024-04-18T21:06:49.963 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.963 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.963 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:49.963 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160497+0000", 2024-04-18T21:06:49.963 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018228779000000001 2024-04-18T21:06:49.963 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.963 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.963 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:49.963 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160634+0000", 2024-04-18T21:06:49.963 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000137315 2024-04-18T21:06:49.964 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.964 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.964 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:49.964 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160831+0000", 2024-04-18T21:06:49.964 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019683100000000001 2024-04-18T21:06:49.964 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.964 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.964 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:49.964 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165129+0000", 2024-04-18T21:06:49.964 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0042981299999999998 2024-04-18T21:06:49.964 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.964 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.965 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:49.965 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165776+0000", 2024-04-18T21:06:49.965 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00064702900000000003 2024-04-18T21:06:49.965 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.965 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.965 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:49.965 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165921+0000", 2024-04-18T21:06:49.965 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014506 2024-04-18T21:06:49.965 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.965 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.965 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:49.965 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165996+0000", 2024-04-18T21:06:49.965 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.4406999999999994e-05 2024-04-18T21:06:49.966 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:49.966 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:49.966 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:49.966 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.966 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.966 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:49.966 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:49.966 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 114.793674178, 2024-04-18T21:06:49.966 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026802157, 2024-04-18T21:06:49.966 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:49.966 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:49.966 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:49.967 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:49.967 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:49.967 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:49.967 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 188 2024-04-18T21:06:49.967 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.967 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:49.967 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.967 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:49.967 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:49.967 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:49.967 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.967 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.967 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:49.967 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:49.967 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:49.968 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.968 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.968 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:49.968 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142284+0000", 2024-04-18T21:06:49.968 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4e-07 2024-04-18T21:06:49.968 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.968 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.968 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:49.968 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142374+0000", 2024-04-18T21:06:49.968 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0099999999999995e-05 2024-04-18T21:06:49.968 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.968 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.968 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:49.969 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142386+0000", 2024-04-18T21:06:49.969 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1770000000000001e-05 2024-04-18T21:06:49.969 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.969 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.969 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:49.969 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142394+0000", 2024-04-18T21:06:49.969 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.2130000000000008e-06 2024-04-18T21:06:49.969 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.969 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.969 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:49.969 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.161743+0000", 2024-04-18T21:06:49.969 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019348644000000002 2024-04-18T21:06:49.969 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.969 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.969 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:49.970 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.161865+0000", 2024-04-18T21:06:49.970 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012210899999999999 2024-04-18T21:06:49.970 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.970 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.970 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:49.970 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.162055+0000", 2024-04-18T21:06:49.970 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000189994 2024-04-18T21:06:49.970 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.970 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.970 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:49.970 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165735+0000", 2024-04-18T21:06:49.970 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0036803270000000002 2024-04-18T21:06:49.971 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.971 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.971 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:49.971 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.168911+0000", 2024-04-18T21:06:49.971 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0031753689999999999 2024-04-18T21:06:49.971 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.971 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.971 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:49.971 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169012+0000", 2024-04-18T21:06:49.971 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010157699999999999 2024-04-18T21:06:49.971 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.971 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.971 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:49.971 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169086+0000", 2024-04-18T21:06:49.972 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3213999999999994e-05 2024-04-18T21:06:49.972 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:49.972 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:49.972 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:49.972 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.972 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.972 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:49.972 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:49.972 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 114.793548872, 2024-04-18T21:06:49.972 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026811423000000001, 2024-04-18T21:06:49.972 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:49.972 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:49.972 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:49.972 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:49.972 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:49.973 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:49.973 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 189 2024-04-18T21:06:49.973 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.973 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:49.973 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.973 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:49.973 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:49.973 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:49.973 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.973 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.973 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:49.973 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:49.973 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:49.973 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.973 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.974 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:49.974 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142410+0000", 2024-04-18T21:06:49.974 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:06:49.974 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.974 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.974 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:49.974 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142415+0000", 2024-04-18T21:06:49.974 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.7939999999999999e-06 2024-04-18T21:06:49.974 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.974 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.974 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:49.974 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142470+0000", 2024-04-18T21:06:49.974 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4537999999999999e-05 2024-04-18T21:06:49.974 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.975 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.975 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:49.975 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142481+0000", 2024-04-18T21:06:49.975 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0966e-05 2024-04-18T21:06:49.975 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.975 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.975 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:49.975 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.163493+0000", 2024-04-18T21:06:49.975 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021012444000000002 2024-04-18T21:06:49.975 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.975 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.975 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:49.975 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.163727+0000", 2024-04-18T21:06:49.975 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000233339 2024-04-18T21:06:49.975 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.976 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.976 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:49.976 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.164102+0000", 2024-04-18T21:06:49.976 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000374872 2024-04-18T21:06:49.976 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.976 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.976 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:49.976 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.166528+0000", 2024-04-18T21:06:49.976 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0024258729999999998 2024-04-18T21:06:49.976 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.976 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.976 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:49.976 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169101+0000", 2024-04-18T21:06:49.976 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0025737680000000001 2024-04-18T21:06:49.977 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.977 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.977 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:49.977 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169171+0000", 2024-04-18T21:06:49.977 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0148000000000007e-05 2024-04-18T21:06:49.977 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.977 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.977 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:49.977 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169220+0000", 2024-04-18T21:06:49.977 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8767999999999998e-05 2024-04-18T21:06:49.977 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:49.977 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:49.978 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:49.978 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.978 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.978 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:49.978 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:49.978 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 104.31997631999999, 2024-04-18T21:06:49.978 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024082777999999999, 2024-04-18T21:06:49.978 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:49.978 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:49.978 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:49.978 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:49.978 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.978 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:49.979 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:49.979 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:49.979 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.979 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.979 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:49.979 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:49.979 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:49.979 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.979 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.979 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:49.979 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615984+0000", 2024-04-18T21:06:49.979 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.9869999999999999e-06 2024-04-18T21:06:49.979 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.979 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.980 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:49.980 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615999+0000", 2024-04-18T21:06:49.980 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4646e-05 2024-04-18T21:06:49.980 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.980 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.980 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:49.980 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616028+0000", 2024-04-18T21:06:49.980 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8952999999999999e-05 2024-04-18T21:06:49.980 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.980 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.980 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:49.980 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616052+0000", 2024-04-18T21:06:49.980 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.3941999999999999e-05 2024-04-18T21:06:49.980 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.981 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.981 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:49.981 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618010+0000", 2024-04-18T21:06:49.981 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0019581780000000001 2024-04-18T21:06:49.981 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.981 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.981 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:49.981 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618322+0000", 2024-04-18T21:06:49.981 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00031158899999999997 2024-04-18T21:06:49.981 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.981 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.981 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:49.981 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618587+0000", 2024-04-18T21:06:49.981 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00026495700000000002 2024-04-18T21:06:49.981 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.981 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.982 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:49.982 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629262+0000", 2024-04-18T21:06:49.982 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010675877 2024-04-18T21:06:49.982 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.982 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.982 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:49.982 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.639773+0000", 2024-04-18T21:06:49.982 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0105109 2024-04-18T21:06:49.982 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.982 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.982 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:49.983 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.639926+0000", 2024-04-18T21:06:49.983 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000152349 2024-04-18T21:06:49.983 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.983 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.983 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:49.983 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640064+0000", 2024-04-18T21:06:49.983 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0001384 2024-04-18T21:06:49.983 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:49.983 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:49.983 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:49.983 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.983 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.983 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:49.983 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:49.984 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 104.319863646, 2024-04-18T21:06:49.984 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030215005999999999, 2024-04-18T21:06:49.984 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:49.984 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:49.984 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:49.984 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:49.984 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.984 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:49.984 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:49.984 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:49.984 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.984 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.984 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:49.984 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:49.984 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:49.985 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.985 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.985 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:49.985 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616095+0000", 2024-04-18T21:06:49.985 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.446e-06 2024-04-18T21:06:49.985 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.985 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.985 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:49.985 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616104+0000", 2024-04-18T21:06:49.985 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6200000000000005e-06 2024-04-18T21:06:49.985 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.985 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.985 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:49.985 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616132+0000", 2024-04-18T21:06:49.986 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7668999999999999e-05 2024-04-18T21:06:49.986 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.986 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.986 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:49.986 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616149+0000", 2024-04-18T21:06:49.986 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7047000000000001e-05 2024-04-18T21:06:49.986 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.986 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.986 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:49.986 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619287+0000", 2024-04-18T21:06:49.986 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0031381450000000002 2024-04-18T21:06:49.986 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.986 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.986 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:49.987 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619503+0000", 2024-04-18T21:06:49.987 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000216522 2024-04-18T21:06:49.987 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.987 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.987 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:49.987 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619930+0000", 2024-04-18T21:06:49.987 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00042604900000000001 2024-04-18T21:06:49.987 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.987 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.987 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:49.987 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629281+0000", 2024-04-18T21:06:49.987 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0093512230000000005 2024-04-18T21:06:49.987 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.987 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.988 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:49.988 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646022+0000", 2024-04-18T21:06:49.988 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016741156 2024-04-18T21:06:49.988 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.988 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.988 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:49.988 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646198+0000", 2024-04-18T21:06:49.988 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000176009 2024-04-18T21:06:49.988 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.988 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.988 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:49.988 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646309+0000", 2024-04-18T21:06:49.988 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011112000000000001 2024-04-18T21:06:49.988 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:49.989 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:49.989 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:49.989 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.989 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.989 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:49.989 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:49.989 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 104.319778822, 2024-04-18T21:06:49.989 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030501176000000001, 2024-04-18T21:06:49.989 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:49.989 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:49.989 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:49.989 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:49.989 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.989 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:49.990 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:49.990 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:49.990 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.990 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.990 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:49.990 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:49.990 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:49.990 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.990 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.990 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:49.990 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616180+0000", 2024-04-18T21:06:49.990 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1000000000000001e-06 2024-04-18T21:06:49.990 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.990 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.991 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:49.991 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616188+0000", 2024-04-18T21:06:49.991 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4069999999999993e-06 2024-04-18T21:06:49.991 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.991 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.991 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:49.991 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616207+0000", 2024-04-18T21:06:49.991 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8335999999999999e-05 2024-04-18T21:06:49.991 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.991 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.991 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:49.991 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616225+0000", 2024-04-18T21:06:49.991 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8652999999999999e-05 2024-04-18T21:06:49.991 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.991 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.992 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:49.992 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620977+0000", 2024-04-18T21:06:49.992 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047512220000000003 2024-04-18T21:06:49.992 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.992 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.992 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:49.992 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621279+0000", 2024-04-18T21:06:49.992 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000302646 2024-04-18T21:06:49.992 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.992 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.992 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:49.992 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621584+0000", 2024-04-18T21:06:49.992 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000305142 2024-04-18T21:06:49.992 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.992 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.992 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:49.993 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629352+0000", 2024-04-18T21:06:49.993 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0077673689999999997 2024-04-18T21:06:49.993 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.993 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.993 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:49.993 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646480+0000", 2024-04-18T21:06:49.993 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017128259 2024-04-18T21:06:49.993 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.993 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.993 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:49.993 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646591+0000", 2024-04-18T21:06:49.993 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011113899999999999 2024-04-18T21:06:49.993 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.993 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.994 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:49.994 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646680+0000", 2024-04-18T21:06:49.994 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8902999999999999e-05 2024-04-18T21:06:49.994 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:49.994 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:49.994 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:49.994 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.994 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.994 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:49.994 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:49.994 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 104.319712323, 2024-04-18T21:06:49.994 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030779760999999999, 2024-04-18T21:06:49.994 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:49.994 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:49.995 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:49.995 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:49.995 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.995 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:49.995 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:49.995 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:49.995 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.995 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.995 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:49.995 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:49.995 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:49.995 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.995 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.995 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:49.995 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616246+0000", 2024-04-18T21:06:49.995 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0499999999999999e-06 2024-04-18T21:06:49.996 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.996 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.996 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:49.996 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616253+0000", 2024-04-18T21:06:49.996 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.5989999999999998e-06 2024-04-18T21:06:49.996 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.996 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.996 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:49.996 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616273+0000", 2024-04-18T21:06:49.996 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9916999999999999e-05 2024-04-18T21:06:49.996 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.996 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.996 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:49.996 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616287+0000", 2024-04-18T21:06:49.996 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3669000000000001e-05 2024-04-18T21:06:49.996 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.997 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.997 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:49.997 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622203+0000", 2024-04-18T21:06:49.997 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.005916737 2024-04-18T21:06:49.997 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.997 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.997 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:49.997 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622379+0000", 2024-04-18T21:06:49.997 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000175596 2024-04-18T21:06:49.997 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.997 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.997 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:49.997 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622707+0000", 2024-04-18T21:06:49.998 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00032784600000000002 2024-04-18T21:06:49.998 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.998 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.998 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:49.998 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629366+0000", 2024-04-18T21:06:49.998 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0066593279999999999 2024-04-18T21:06:49.998 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.998 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.998 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:49.998 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646813+0000", 2024-04-18T21:06:49.998 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017447059000000001 2024-04-18T21:06:49.998 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.998 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.999 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:49.999 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646946+0000", 2024-04-18T21:06:49.999 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013301200000000001 2024-04-18T21:06:49.999 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.999 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.999 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:49.999 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647025+0000", 2024-04-18T21:06:49.999 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8948000000000004e-05 2024-04-18T21:06:49.999 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:49.999 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:49.999 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:49.999 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:49.999 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:49.999 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:50.000 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:50.000 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 104.319628505, 2024-04-18T21:06:50.000 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.031512165000000002, 2024-04-18T21:06:50.000 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:50.000 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:50.000 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:50.000 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:50.000 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.000 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:50.000 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:50.000 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:50.000 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.000 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.000 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:50.000 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:50.001 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:50.001 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.001 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.001 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:50.001 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616330+0000", 2024-04-18T21:06:50.001 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.15e-06 2024-04-18T21:06:50.001 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.001 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.001 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:50.001 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616337+0000", 2024-04-18T21:06:50.001 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.1289999999999998e-06 2024-04-18T21:06:50.001 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.001 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.001 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:50.002 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616447+0000", 2024-04-18T21:06:50.002 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109561 2024-04-18T21:06:50.002 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.002 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.002 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:50.002 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616496+0000", 2024-04-18T21:06:50.002 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8591999999999998e-05 2024-04-18T21:06:50.002 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.002 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.002 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:50.002 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.623786+0000", 2024-04-18T21:06:50.002 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0072906799999999999 2024-04-18T21:06:50.002 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.002 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.002 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:50.003 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.623973+0000", 2024-04-18T21:06:50.003 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018717199999999999 2024-04-18T21:06:50.003 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.003 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.003 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:50.003 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624260+0000", 2024-04-18T21:06:50.003 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00028630600000000001 2024-04-18T21:06:50.003 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.003 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.003 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:50.003 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629381+0000", 2024-04-18T21:06:50.003 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0051211340000000003 2024-04-18T21:06:50.003 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.003 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.003 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:50.004 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647631+0000", 2024-04-18T21:06:50.004 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018249771000000001 2024-04-18T21:06:50.004 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.004 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.004 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:50.004 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647761+0000", 2024-04-18T21:06:50.004 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013037300000000001 2024-04-18T21:06:50.004 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.004 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.004 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:50.004 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647841+0000", 2024-04-18T21:06:50.004 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.0296999999999994e-05 2024-04-18T21:06:50.004 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:50.004 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:50.004 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:50.004 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.005 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.005 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:50.005 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:50.005 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 104.31942302100001, 2024-04-18T21:06:50.005 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043251955000000002, 2024-04-18T21:06:50.005 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:50.005 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:50.005 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:50.005 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:50.005 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.005 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:50.005 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:50.005 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:50.005 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.006 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.006 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:50.006 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:50.006 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:50.006 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.006 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.006 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:50.006 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616536+0000", 2024-04-18T21:06:50.006 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2869999999999999e-06 2024-04-18T21:06:50.006 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.006 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.006 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:50.006 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616572+0000", 2024-04-18T21:06:50.006 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.6261999999999999e-05 2024-04-18T21:06:50.007 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.007 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.007 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:50.007 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616593+0000", 2024-04-18T21:06:50.007 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1310000000000001e-05 2024-04-18T21:06:50.007 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.007 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.007 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:50.007 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616614+0000", 2024-04-18T21:06:50.007 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.0936000000000001e-05 2024-04-18T21:06:50.007 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.007 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.007 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:50.007 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629501+0000", 2024-04-18T21:06:50.007 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.012886819000000001 2024-04-18T21:06:50.008 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.008 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.008 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:50.008 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629696+0000", 2024-04-18T21:06:50.008 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019485499999999999 2024-04-18T21:06:50.008 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.008 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.008 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:50.008 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629940+0000", 2024-04-18T21:06:50.008 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00024386399999999999 2024-04-18T21:06:50.008 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.008 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.008 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:50.008 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640100+0000", 2024-04-18T21:06:50.008 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010159645 2024-04-18T21:06:50.009 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.009 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.009 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:50.009 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659516+0000", 2024-04-18T21:06:50.009 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019416563000000001 2024-04-18T21:06:50.009 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.009 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.009 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:50.009 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659684+0000", 2024-04-18T21:06:50.009 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016750900000000001 2024-04-18T21:06:50.009 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.009 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.009 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:50.009 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659787+0000", 2024-04-18T21:06:50.010 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000102905 2024-04-18T21:06:50.010 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:50.010 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:50.010 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:50.010 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.010 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.010 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:50.010 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:50.010 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 104.319317899, 2024-04-18T21:06:50.010 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043581898000000001, 2024-04-18T21:06:50.010 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:50.010 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:50.010 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:50.010 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:50.010 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.011 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:50.011 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:50.011 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:50.011 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.011 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.011 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:50.011 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:50.011 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:50.011 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.011 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.011 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:50.011 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616641+0000", 2024-04-18T21:06:50.011 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:06:50.011 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.011 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.011 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:50.011 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616648+0000", 2024-04-18T21:06:50.012 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3860000000000001e-06 2024-04-18T21:06:50.012 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.012 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.012 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:50.012 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616666+0000", 2024-04-18T21:06:50.012 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7583000000000001e-05 2024-04-18T21:06:50.012 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.012 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.012 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:50.012 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616679+0000", 2024-04-18T21:06:50.012 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3322999999999999e-05 2024-04-18T21:06:50.012 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.012 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.012 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:50.012 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630373+0000", 2024-04-18T21:06:50.012 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013694207999999999 2024-04-18T21:06:50.013 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.013 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.013 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:50.013 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630545+0000", 2024-04-18T21:06:50.013 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000171683 2024-04-18T21:06:50.013 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.013 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.013 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:50.013 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630728+0000", 2024-04-18T21:06:50.013 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000182599 2024-04-18T21:06:50.013 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.013 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.013 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:50.013 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640600+0000", 2024-04-18T21:06:50.013 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0098726119999999994 2024-04-18T21:06:50.013 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.014 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.014 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:50.014 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659927+0000", 2024-04-18T21:06:50.014 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019326724999999999 2024-04-18T21:06:50.014 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.014 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.014 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:50.014 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660112+0000", 2024-04-18T21:06:50.014 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000185203 2024-04-18T21:06:50.014 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.014 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.014 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:50.014 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660222+0000", 2024-04-18T21:06:50.014 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109343 2024-04-18T21:06:50.015 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:50.015 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:50.015 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:50.015 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.015 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.015 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:50.015 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:50.015 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 104.318452541, 2024-04-18T21:06:50.015 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043121310000000003, 2024-04-18T21:06:50.015 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:50.015 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:50.015 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:50.015 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:50.016 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.016 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:50.016 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:50.016 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:50.016 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.016 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.016 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:50.016 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:50.016 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:50.016 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.016 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.016 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:50.016 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617506+0000", 2024-04-18T21:06:50.016 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9999999999999995e-07 2024-04-18T21:06:50.016 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.017 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.017 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:50.017 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617513+0000", 2024-04-18T21:06:50.017 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.9700000000000002e-06 2024-04-18T21:06:50.017 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.017 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.017 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:50.017 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617531+0000", 2024-04-18T21:06:50.017 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8105999999999999e-05 2024-04-18T21:06:50.017 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.017 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.017 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:50.017 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617545+0000", 2024-04-18T21:06:50.017 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3703000000000001e-05 2024-04-18T21:06:50.018 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.018 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.018 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:50.018 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632129+0000", 2024-04-18T21:06:50.018 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.014584135999999999 2024-04-18T21:06:50.018 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.018 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.018 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:50.018 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632361+0000", 2024-04-18T21:06:50.018 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023171800000000001 2024-04-18T21:06:50.018 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.018 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.019 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:50.019 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632804+0000", 2024-04-18T21:06:50.019 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000443549 2024-04-18T21:06:50.019 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.019 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.019 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:50.019 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646340+0000", 2024-04-18T21:06:50.019 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013535902000000001 2024-04-18T21:06:50.019 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.019 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.019 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:50.019 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660363+0000", 2024-04-18T21:06:50.019 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01402318 2024-04-18T21:06:50.019 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.020 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.020 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:50.020 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660523+0000", 2024-04-18T21:06:50.020 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00015989899999999999 2024-04-18T21:06:50.020 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.020 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.020 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:50.020 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660626+0000", 2024-04-18T21:06:50.020 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010314699999999999 2024-04-18T21:06:50.020 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:50.020 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:50.020 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:50.020 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.021 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.021 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:50.021 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:50.021 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 104.31831284800001, 2024-04-18T21:06:50.021 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024927483, 2024-04-18T21:06:50.021 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:50.021 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:50.021 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:50.021 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:50.021 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.021 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:50.021 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:50.021 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:50.021 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.022 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.022 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:50.022 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:50.022 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:50.022 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.022 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.022 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:50.022 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617646+0000", 2024-04-18T21:06:50.022 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3030000000000001e-06 2024-04-18T21:06:50.022 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.022 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.022 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:50.022 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617653+0000", 2024-04-18T21:06:50.022 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7530000000000004e-06 2024-04-18T21:06:50.023 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.023 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.023 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:50.023 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617673+0000", 2024-04-18T21:06:50.023 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9967e-05 2024-04-18T21:06:50.023 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.023 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.023 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:50.023 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617688+0000", 2024-04-18T21:06:50.023 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5153e-05 2024-04-18T21:06:50.023 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.023 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.023 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:50.024 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619244+0000", 2024-04-18T21:06:50.024 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001555531 2024-04-18T21:06:50.024 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.024 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.024 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:50.024 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619361+0000", 2024-04-18T21:06:50.024 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011784400000000001 2024-04-18T21:06:50.024 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.024 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.024 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:50.024 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619604+0000", 2024-04-18T21:06:50.024 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000243007 2024-04-18T21:06:50.024 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.024 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.024 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:50.025 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.625480+0000", 2024-04-18T21:06:50.025 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0058759349999999997 2024-04-18T21:06:50.025 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.025 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.025 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:50.025 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642342+0000", 2024-04-18T21:06:50.025 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016861373999999998 2024-04-18T21:06:50.025 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.025 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.025 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:50.025 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642484+0000", 2024-04-18T21:06:50.025 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000142423 2024-04-18T21:06:50.025 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.026 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.026 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:50.026 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642572+0000", 2024-04-18T21:06:50.026 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8193000000000001e-05 2024-04-18T21:06:50.026 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:50.026 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:50.026 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:50.026 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.026 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.026 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:50.026 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:50.026 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 104.31803134499999, 2024-04-18T21:06:50.026 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024956974999999999, 2024-04-18T21:06:50.026 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:50.027 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:50.027 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:50.027 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:50.027 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.027 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:50.027 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:50.027 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:50.027 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.027 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.027 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:50.027 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:50.027 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:50.027 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.027 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.027 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:50.028 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617928+0000", 2024-04-18T21:06:50.028 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5430000000000001e-06 2024-04-18T21:06:50.028 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.028 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.028 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:50.028 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617937+0000", 2024-04-18T21:06:50.028 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6629999999999999e-06 2024-04-18T21:06:50.028 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.028 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.028 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:50.028 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617955+0000", 2024-04-18T21:06:50.028 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8749999999999998e-05 2024-04-18T21:06:50.028 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.028 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.028 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:50.029 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617971+0000", 2024-04-18T21:06:50.029 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.605e-05 2024-04-18T21:06:50.029 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.029 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.029 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:50.029 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621019+0000", 2024-04-18T21:06:50.029 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0030472369999999999 2024-04-18T21:06:50.029 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.029 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.029 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:50.029 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621249+0000", 2024-04-18T21:06:50.029 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000230075 2024-04-18T21:06:50.029 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.029 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.030 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:50.030 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621450+0000", 2024-04-18T21:06:50.030 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020166499999999999 2024-04-18T21:06:50.030 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.030 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.030 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:50.030 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.626233+0000", 2024-04-18T21:06:50.030 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047827390000000003 2024-04-18T21:06:50.030 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.030 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.030 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:50.030 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642693+0000", 2024-04-18T21:06:50.031 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01645961 2024-04-18T21:06:50.031 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.031 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.031 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:50.031 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642798+0000", 2024-04-18T21:06:50.031 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010559499999999999 2024-04-18T21:06:50.031 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.031 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.031 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:50.031 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642883+0000", 2024-04-18T21:06:50.031 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5048000000000003e-05 2024-04-18T21:06:50.031 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:50.032 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:50.032 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:50.032 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.032 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.032 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:50.032 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:50.032 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 104.316335717, 2024-04-18T21:06:50.032 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024086478000000001, 2024-04-18T21:06:50.032 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:50.032 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:50.032 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:50.032 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:50.032 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.033 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:50.033 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:50.033 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:50.033 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.033 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.033 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:50.033 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:50.033 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:50.033 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.033 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.033 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:50.033 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619624+0000", 2024-04-18T21:06:50.033 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.75e-06 2024-04-18T21:06:50.033 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.034 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.034 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:50.034 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619637+0000", 2024-04-18T21:06:50.034 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3540000000000001e-05 2024-04-18T21:06:50.034 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.034 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.034 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:50.034 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619666+0000", 2024-04-18T21:06:50.034 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8685999999999999e-05 2024-04-18T21:06:50.034 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.034 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.034 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:50.034 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619685+0000", 2024-04-18T21:06:50.035 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8681999999999998e-05 2024-04-18T21:06:50.035 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.035 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.035 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:50.035 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622275+0000", 2024-04-18T21:06:50.035 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0025899260000000002 2024-04-18T21:06:50.035 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.035 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.035 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:50.035 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622572+0000", 2024-04-18T21:06:50.035 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00029722 2024-04-18T21:06:50.035 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.035 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.035 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:50.036 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622752+0000", 2024-04-18T21:06:50.036 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018065900000000001 2024-04-18T21:06:50.036 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.036 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.036 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:50.036 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.626326+0000", 2024-04-18T21:06:50.036 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035737310000000001 2024-04-18T21:06:50.036 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.036 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.036 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:50.036 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643565+0000", 2024-04-18T21:06:50.036 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017238430999999999 2024-04-18T21:06:50.036 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.036 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.037 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:50.037 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643646+0000", 2024-04-18T21:06:50.037 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.1481000000000001e-05 2024-04-18T21:06:50.037 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.037 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.037 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:50.037 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643708+0000", 2024-04-18T21:06:50.037 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.2372000000000005e-05 2024-04-18T21:06:50.037 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:50.037 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:50.037 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:50.037 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.037 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.037 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:50.038 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:50.038 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 104.31616956400001, 2024-04-18T21:06:50.038 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026822450000000001, 2024-04-18T21:06:50.038 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:50.038 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:50.038 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:50.038 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:50.038 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.038 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:50.038 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:50.038 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:50.038 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.039 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.039 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:50.039 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:50.039 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:50.039 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.039 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.039 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:50.039 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619789+0000", 2024-04-18T21:06:50.039 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:06:50.039 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.039 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.039 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:50.039 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619797+0000", 2024-04-18T21:06:50.039 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.6899999999999992e-06 2024-04-18T21:06:50.040 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.040 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.040 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:50.040 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619816+0000", 2024-04-18T21:06:50.040 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9352999999999999e-05 2024-04-18T21:06:50.040 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.040 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.040 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:50.040 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619832+0000", 2024-04-18T21:06:50.040 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6013000000000001e-05 2024-04-18T21:06:50.040 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.040 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.040 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:50.040 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620528+0000", 2024-04-18T21:06:50.040 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00069565600000000001 2024-04-18T21:06:50.041 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.041 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.041 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:50.041 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620735+0000", 2024-04-18T21:06:50.041 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000207025 2024-04-18T21:06:50.041 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.041 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.041 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:50.041 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620912+0000", 2024-04-18T21:06:50.041 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017748199999999999 2024-04-18T21:06:50.042 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.042 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.042 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:50.042 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.625605+0000", 2024-04-18T21:06:50.042 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0046924439999999996 2024-04-18T21:06:50.042 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.042 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.042 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:50.042 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646349+0000", 2024-04-18T21:06:50.042 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.020744318000000001 2024-04-18T21:06:50.042 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.042 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.043 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:50.043 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646483+0000", 2024-04-18T21:06:50.043 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013428999999999999 2024-04-18T21:06:50.043 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.043 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.043 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:50.043 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646611+0000", 2024-04-18T21:06:50.043 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012710299999999999 2024-04-18T21:06:50.043 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:50.043 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:50.043 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:50.043 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.043 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.043 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:50.044 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:06:50.044 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 104.315499131, 2024-04-18T21:06:50.044 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023516516000000001, 2024-04-18T21:06:50.044 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:50.044 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:50.044 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:06:50.044 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:50.044 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.044 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:50.044 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:06:50.044 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:50.044 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.044 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.044 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:50.044 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:06:50.045 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:50.045 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.045 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.045 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:50.045 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620460+0000", 2024-04-18T21:06:50.045 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.787e-06 2024-04-18T21:06:50.045 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.045 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.045 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:50.045 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620470+0000", 2024-04-18T21:06:50.045 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.2560000000000008e-06 2024-04-18T21:06:50.045 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.045 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.045 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:50.045 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620496+0000", 2024-04-18T21:06:50.045 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.6205999999999999e-05 2024-04-18T21:06:50.046 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.046 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.046 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:50.046 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620517+0000", 2024-04-18T21:06:50.046 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1223e-05 2024-04-18T21:06:50.046 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.046 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.046 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:50.046 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624060+0000", 2024-04-18T21:06:50.046 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035434160000000002 2024-04-18T21:06:50.046 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.046 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.046 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:50.046 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624390+0000", 2024-04-18T21:06:50.046 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00033000500000000002 2024-04-18T21:06:50.047 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:50.047 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:50.047 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:50.047 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643975+0000", 2024-04-18T21:06:50.047 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019584622999999999 2024-04-18T21:06:50.047 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:50.047 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:50.047 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:50.047 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:50.047 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:50.047 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:50.049 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:50.049 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:50.046+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:50.149 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:50.150+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:50.185 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:06:50.185 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [ 2024-04-18T21:06:50.185 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.185 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(client.4534.0:8372 4.33 4:cdc534e9:::10000002621.00000000:head [write 0~5105 in=5105b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:50.185 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:06:50.186750+0000", 2024-04-18T21:06:50.185 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 0.001684959, 2024-04-18T21:06:50.185 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001728158, 2024-04-18T21:06:50.185 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:50.186 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:50.186 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:06:50.186 INFO:teuthology.orchestra.run.smithi150.stdout: "client_info": { 2024-04-18T21:06:50.186 INFO:teuthology.orchestra.run.smithi150.stdout: "client": "client.4534", 2024-04-18T21:06:50.186 INFO:teuthology.orchestra.run.smithi150.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:50.186 INFO:teuthology.orchestra.run.smithi150.stdout: "tid": 8372 2024-04-18T21:06:50.186 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.186 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:50.186 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.186 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:50.186 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:50.186750+0000", 2024-04-18T21:06:50.186 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:50.187 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.187 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.187 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:50.187 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:50.186750+0000", 2024-04-18T21:06:50.187 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:50.187 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.187 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.187 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:50.187 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:50.186752+0000", 2024-04-18T21:06:50.187 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.6070000000000002e-06 2024-04-18T21:06:50.187 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.187 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.187 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:50.187 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:50.186772+0000", 2024-04-18T21:06:50.188 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.9400000000000001e-05 2024-04-18T21:06:50.188 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.188 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.188 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:50.188 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:50.186804+0000", 2024-04-18T21:06:50.188 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.2203000000000003e-05 2024-04-18T21:06:50.188 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.188 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.188 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:50.188 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:50.186822+0000", 2024-04-18T21:06:50.188 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7986999999999999e-05 2024-04-18T21:06:50.188 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.188 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.188 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:50.189 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:50.186984+0000", 2024-04-18T21:06:50.189 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000162008 2024-04-18T21:06:50.189 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.189 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.189 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:50.189 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:50.187249+0000", 2024-04-18T21:06:50.189 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00026541800000000001 2024-04-18T21:06:50.189 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.189 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.189 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:50.189 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:50.187481+0000", 2024-04-18T21:06:50.189 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00023133100000000001 2024-04-18T21:06:50.189 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:50.189 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:50.190 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:50.190 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:50.190 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-04-18T21:06:50.190 INFO:teuthology.orchestra.run.smithi150.stdout: "num_ops": 1 2024-04-18T21:06:50.190 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:06:50.200 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:50.250 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:50.250+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:50.351 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:50.350+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:50.373 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:06:50.373 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [], 2024-04-18T21:06:50.373 INFO:teuthology.orchestra.run.smithi150.stdout: "complaint_time": 30, 2024-04-18T21:06:50.373 INFO:teuthology.orchestra.run.smithi150.stdout: "num_blocked_ops": 0 2024-04-18T21:06:50.373 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:06:50.388 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:50.452 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:50.450+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:50.528 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:06:50.528 INFO:teuthology.orchestra.run.smithi150.stdout: "size": 20, 2024-04-18T21:06:50.529 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 600, 2024-04-18T21:06:50.529 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [ 2024-04-18T21:06:50.529 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.529 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:50.529 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:06:50.529 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 104.913681536, 2024-04-18T21:06:50.529 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.040843365, 2024-04-18T21:06:50.529 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:50.529 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:50.529 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:50.529 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:50.529 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.529 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:50.530 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:06:50.530 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:50.530 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.530 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.530 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:50.530 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615295+0000", 2024-04-18T21:06:50.530 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:50.530 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.530 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.530 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:50.530 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615297+0000", 2024-04-18T21:06:50.530 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2800000000000002e-06 2024-04-18T21:06:50.530 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.530 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.531 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:50.531 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615308+0000", 2024-04-18T21:06:50.531 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0813e-05 2024-04-18T21:06:50.531 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.531 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.531 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:50.531 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615330+0000", 2024-04-18T21:06:50.531 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2370000000000001e-05 2024-04-18T21:06:50.531 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.531 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.531 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:50.531 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615346+0000", 2024-04-18T21:06:50.531 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6200000000000001e-05 2024-04-18T21:06:50.531 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.532 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.532 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:50.532 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615470+0000", 2024-04-18T21:06:50.532 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012385799999999999 2024-04-18T21:06:50.532 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.532 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.532 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:50.532 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615488+0000", 2024-04-18T21:06:50.532 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7923000000000001e-05 2024-04-18T21:06:50.532 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.532 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.532 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:50.532 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.630993+0000", 2024-04-18T21:06:50.532 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.01550532 2024-04-18T21:06:50.533 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.533 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.533 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:50.533 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631165+0000", 2024-04-18T21:06:50.533 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000171588 2024-04-18T21:06:50.533 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.533 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.533 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:50.533 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631320+0000", 2024-04-18T21:06:50.533 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000155162 2024-04-18T21:06:50.533 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.533 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.533 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:50.533 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635157+0000", 2024-04-18T21:06:50.534 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0038370790000000002 2024-04-18T21:06:50.534 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.534 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.534 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:50.534 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.655904+0000", 2024-04-18T21:06:50.534 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.020746483999999999 2024-04-18T21:06:50.534 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.534 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.534 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:50.534 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656032+0000", 2024-04-18T21:06:50.534 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012864199999999999 2024-04-18T21:06:50.534 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.534 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.534 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:50.534 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656138+0000", 2024-04-18T21:06:50.535 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000105646 2024-04-18T21:06:50.535 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:50.535 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:50.535 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:50.535 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.535 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.535 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:50.535 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:06:50.535 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 104.913589364, 2024-04-18T21:06:50.535 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.041266444999999999, 2024-04-18T21:06:50.535 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:50.535 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:50.535 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:50.535 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:50.535 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.536 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:50.536 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:06:50.536 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:50.536 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.536 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.536 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:50.536 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615387+0000", 2024-04-18T21:06:50.536 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:50.536 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.536 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.536 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:50.536 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615388+0000", 2024-04-18T21:06:50.536 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:06:50.536 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.536 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.537 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:50.537 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615397+0000", 2024-04-18T21:06:50.537 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.7299999999999994e-06 2024-04-18T21:06:50.537 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.537 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.537 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:50.537 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615415+0000", 2024-04-18T21:06:50.537 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7807000000000001e-05 2024-04-18T21:06:50.537 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.537 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.537 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:50.537 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615431+0000", 2024-04-18T21:06:50.537 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6127e-05 2024-04-18T21:06:50.537 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.537 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.538 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:50.538 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615621+0000", 2024-04-18T21:06:50.538 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000189781 2024-04-18T21:06:50.538 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.538 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.538 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:50.538 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615634+0000", 2024-04-18T21:06:50.538 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3383e-05 2024-04-18T21:06:50.538 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.538 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.538 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:50.538 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631703+0000", 2024-04-18T21:06:50.538 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016068737 2024-04-18T21:06:50.538 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.538 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.539 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:50.539 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631809+0000", 2024-04-18T21:06:50.539 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000106823 2024-04-18T21:06:50.539 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.539 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.539 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:50.539 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.631988+0000", 2024-04-18T21:06:50.539 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000179008 2024-04-18T21:06:50.539 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.539 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.539 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:50.539 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635172+0000", 2024-04-18T21:06:50.539 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.003183029 2024-04-18T21:06:50.540 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.540 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.540 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:50.540 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656392+0000", 2024-04-18T21:06:50.540 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.021220638999999999 2024-04-18T21:06:50.540 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.540 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.540 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:50.540 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656533+0000", 2024-04-18T21:06:50.540 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014126500000000001 2024-04-18T21:06:50.540 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.540 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.540 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:50.540 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656653+0000", 2024-04-18T21:06:50.541 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000119883 2024-04-18T21:06:50.541 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:50.541 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:50.541 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:50.541 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.541 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.541 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:50.541 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:06:50.541 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 104.91350194100001, 2024-04-18T21:06:50.541 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.042492302000000003, 2024-04-18T21:06:50.541 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:50.541 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:50.541 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:50.541 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:50.542 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.542 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:50.542 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:06:50.542 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:50.542 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.542 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.542 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:50.542 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615474+0000", 2024-04-18T21:06:50.542 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:50.542 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.542 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.542 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:50.542 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615475+0000", 2024-04-18T21:06:50.542 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.17e-06 2024-04-18T21:06:50.543 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.543 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.543 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:50.543 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615528+0000", 2024-04-18T21:06:50.543 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.2159e-05 2024-04-18T21:06:50.543 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.543 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.543 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:50.543 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615542+0000", 2024-04-18T21:06:50.543 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4197e-05 2024-04-18T21:06:50.543 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.543 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.543 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:50.543 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615559+0000", 2024-04-18T21:06:50.543 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.749e-05 2024-04-18T21:06:50.543 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.544 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.544 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:50.544 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615685+0000", 2024-04-18T21:06:50.544 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012617499999999999 2024-04-18T21:06:50.544 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.544 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.544 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:50.544 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:06:50.544 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4749999999999999e-05 2024-04-18T21:06:50.544 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.544 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.544 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:50.544 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632332+0000", 2024-04-18T21:06:50.544 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016631988 2024-04-18T21:06:50.545 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.545 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.545 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:50.545 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632477+0000", 2024-04-18T21:06:50.545 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014437200000000001 2024-04-18T21:06:50.545 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.545 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.545 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:50.545 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632620+0000", 2024-04-18T21:06:50.545 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000143566 2024-04-18T21:06:50.545 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.545 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.545 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:50.545 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635185+0000", 2024-04-18T21:06:50.546 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0025644209999999999 2024-04-18T21:06:50.546 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.546 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.546 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:50.546 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657803+0000", 2024-04-18T21:06:50.546 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.022618743 2024-04-18T21:06:50.546 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.546 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.546 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:50.546 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657890+0000", 2024-04-18T21:06:50.546 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.6688999999999996e-05 2024-04-18T21:06:50.546 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.546 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.546 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:50.547 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.657967+0000", 2024-04-18T21:06:50.547 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.6582000000000006e-05 2024-04-18T21:06:50.547 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:50.547 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:50.547 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:50.547 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.547 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.547 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:50.547 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:06:50.547 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 104.913371129, 2024-04-18T21:06:50.547 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.043603435000000003, 2024-04-18T21:06:50.547 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:50.548 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:50.548 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:50.548 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:50.548 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.548 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:50.548 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:06:50.548 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:50.548 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.548 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.548 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:50.548 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615605+0000", 2024-04-18T21:06:50.548 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:50.548 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.548 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.548 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:50.548 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615607+0000", 2024-04-18T21:06:50.549 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4300000000000001e-06 2024-04-18T21:06:50.549 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.549 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.549 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:50.549 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615614+0000", 2024-04-18T21:06:50.549 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.4100000000000002e-06 2024-04-18T21:06:50.549 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.549 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.549 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:50.549 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615632+0000", 2024-04-18T21:06:50.549 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.7863000000000002e-05 2024-04-18T21:06:50.549 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.549 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.550 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:50.550 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615647+0000", 2024-04-18T21:06:50.550 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5187e-05 2024-04-18T21:06:50.550 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.550 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.550 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:50.550 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615765+0000", 2024-04-18T21:06:50.550 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000117955 2024-04-18T21:06:50.550 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.550 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.550 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:50.550 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615781+0000", 2024-04-18T21:06:50.550 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6123000000000001e-05 2024-04-18T21:06:50.550 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.551 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.551 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:50.551 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633055+0000", 2024-04-18T21:06:50.551 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.017273909 2024-04-18T21:06:50.551 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.551 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.551 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:50.551 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633254+0000", 2024-04-18T21:06:50.551 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00019903799999999999 2024-04-18T21:06:50.551 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.551 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.551 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:50.551 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633624+0000", 2024-04-18T21:06:50.551 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000369656 2024-04-18T21:06:50.551 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.551 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.552 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:50.552 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635595+0000", 2024-04-18T21:06:50.552 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001971287 2024-04-18T21:06:50.552 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.552 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.552 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:50.552 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659026+0000", 2024-04-18T21:06:50.552 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.023431495 2024-04-18T21:06:50.552 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.552 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.552 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:50.552 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659117+0000", 2024-04-18T21:06:50.552 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0885999999999997e-05 2024-04-18T21:06:50.552 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.552 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.552 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:50.552 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659209+0000", 2024-04-18T21:06:50.553 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.1195999999999999e-05 2024-04-18T21:06:50.553 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:50.553 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:50.553 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:50.553 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.553 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.553 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:50.553 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:50.553 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 104.9133059, 2024-04-18T21:06:50.553 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.03492514, 2024-04-18T21:06:50.553 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:50.553 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:50.553 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:50.553 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:50.553 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.553 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:50.553 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:50.554 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:50.554 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.554 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.554 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:50.554 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:50.554 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:50.554 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.554 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.554 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:50.554 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:06:50.554 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.407e-06 2024-04-18T21:06:50.554 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.554 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.554 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:50.554 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615679+0000", 2024-04-18T21:06:50.555 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.2130000000000002e-06 2024-04-18T21:06:50.555 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.555 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.555 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:50.555 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615701+0000", 2024-04-18T21:06:50.555 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2316000000000001e-05 2024-04-18T21:06:50.555 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.555 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.555 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:50.555 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615717+0000", 2024-04-18T21:06:50.555 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6197000000000001e-05 2024-04-18T21:06:50.555 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.555 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.555 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:50.555 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615828+0000", 2024-04-18T21:06:50.555 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000110899 2024-04-18T21:06:50.556 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.556 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.556 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:50.556 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615840+0000", 2024-04-18T21:06:50.556 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.1423000000000001e-05 2024-04-18T21:06:50.556 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.556 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.556 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:50.556 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628046+0000", 2024-04-18T21:06:50.556 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.012206295000000001 2024-04-18T21:06:50.556 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.556 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.556 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:50.556 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628323+0000", 2024-04-18T21:06:50.557 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00027658700000000001 2024-04-18T21:06:50.557 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.557 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.557 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:50.557 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.628599+0000", 2024-04-18T21:06:50.557 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00027676699999999997 2024-04-18T21:06:50.557 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.557 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.557 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:50.557 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.634869+0000", 2024-04-18T21:06:50.557 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.006269536 2024-04-18T21:06:50.557 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.557 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.557 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:50.557 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650333+0000", 2024-04-18T21:06:50.557 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.015463645999999999 2024-04-18T21:06:50.558 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.558 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.558 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:50.558 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650474+0000", 2024-04-18T21:06:50.558 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00014091799999999999 2024-04-18T21:06:50.558 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.558 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.558 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:50.558 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.650595+0000", 2024-04-18T21:06:50.558 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012193600000000001 2024-04-18T21:06:50.558 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:50.558 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:50.558 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:50.558 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.558 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.559 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:50.559 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:06:50.559 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 104.913220791, 2024-04-18T21:06:50.559 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.040588320999999997, 2024-04-18T21:06:50.559 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:50.559 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:50.559 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:50.559 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:50.559 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.559 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:50.559 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:06:50.559 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:50.559 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.559 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.559 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:50.559 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615755+0000", 2024-04-18T21:06:50.560 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:50.560 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.560 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.560 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:50.560 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615757+0000", 2024-04-18T21:06:50.560 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2270000000000001e-06 2024-04-18T21:06:50.560 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.560 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.560 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:50.560 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615765+0000", 2024-04-18T21:06:50.560 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.9400000000000002e-06 2024-04-18T21:06:50.560 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.560 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.560 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:50.560 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615785+0000", 2024-04-18T21:06:50.561 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.0749000000000001e-05 2024-04-18T21:06:50.561 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.561 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.561 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:50.561 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615804+0000", 2024-04-18T21:06:50.561 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.8774e-05 2024-04-18T21:06:50.561 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.561 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.561 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:50.561 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615888+0000", 2024-04-18T21:06:50.561 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.4111999999999997e-05 2024-04-18T21:06:50.561 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.561 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.561 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:50.561 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615895+0000", 2024-04-18T21:06:50.561 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.0469999999999996e-06 2024-04-18T21:06:50.562 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.562 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.562 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:50.562 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629280+0000", 2024-04-18T21:06:50.562 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.013384416 2024-04-18T21:06:50.562 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.562 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.562 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:50.562 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629488+0000", 2024-04-18T21:06:50.562 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00020852800000000001 2024-04-18T21:06:50.562 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.562 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.562 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:50.563 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.629869+0000", 2024-04-18T21:06:50.563 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00038042300000000001 2024-04-18T21:06:50.563 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.563 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.563 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:50.563 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635041+0000", 2024-04-18T21:06:50.563 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.005172383 2024-04-18T21:06:50.563 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.563 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.563 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:50.563 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656125+0000", 2024-04-18T21:06:50.563 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.021084025999999999 2024-04-18T21:06:50.563 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.563 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.563 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:50.563 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656240+0000", 2024-04-18T21:06:50.564 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000115352 2024-04-18T21:06:50.564 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.564 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.564 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:50.564 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.656344+0000", 2024-04-18T21:06:50.564 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00010334400000000001 2024-04-18T21:06:50.564 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:50.564 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:50.564 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:50.564 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.564 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.564 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:50.564 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:50.564 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 104.913153471, 2024-04-18T21:06:50.564 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.043549577999999999, 2024-04-18T21:06:50.564 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:50.564 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:50.565 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:50.565 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:50.565 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.565 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:50.565 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:50.565 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:50.565 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.565 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.565 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:50.565 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:50.565 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:50.565 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.565 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.565 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:50.565 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615823+0000", 2024-04-18T21:06:50.565 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.5000000000000002e-07 2024-04-18T21:06:50.565 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.566 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.566 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:50.566 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615828+0000", 2024-04-18T21:06:50.566 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.2359999999999998e-06 2024-04-18T21:06:50.566 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.566 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.566 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:50.566 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615838+0000", 2024-04-18T21:06:50.566 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0087e-05 2024-04-18T21:06:50.566 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.566 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.566 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:50.566 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615846+0000", 2024-04-18T21:06:50.566 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.67e-06 2024-04-18T21:06:50.566 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.567 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.567 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:50.567 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615963+0000", 2024-04-18T21:06:50.567 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00011630500000000001 2024-04-18T21:06:50.567 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.567 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.567 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:50.567 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615979+0000", 2024-04-18T21:06:50.567 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.613e-05 2024-04-18T21:06:50.567 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.567 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.567 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:50.567 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632392+0000", 2024-04-18T21:06:50.567 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016413317 2024-04-18T21:06:50.567 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.567 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.568 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:50.568 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632568+0000", 2024-04-18T21:06:50.568 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00017539500000000001 2024-04-18T21:06:50.568 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.568 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.568 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:50.568 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.632748+0000", 2024-04-18T21:06:50.568 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00017991799999999999 2024-04-18T21:06:50.568 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.568 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.568 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:50.568 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.635542+0000", 2024-04-18T21:06:50.568 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00279481 2024-04-18T21:06:50.568 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.568 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.568 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:50.569 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659232+0000", 2024-04-18T21:06:50.569 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.023689212000000001 2024-04-18T21:06:50.569 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.569 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.569 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:50.569 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659314+0000", 2024-04-18T21:06:50.569 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.2528999999999995e-05 2024-04-18T21:06:50.569 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.569 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.569 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:50.569 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.659372+0000", 2024-04-18T21:06:50.569 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.8218999999999999e-05 2024-04-18T21:06:50.569 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:50.569 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:50.569 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:50.569 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.570 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.570 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:50.570 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:06:50.570 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 104.91309203900001, 2024-04-18T21:06:50.570 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.039335347, 2024-04-18T21:06:50.570 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:50.570 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:50.570 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "started", 2024-04-18T21:06:50.570 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:50.570 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.570 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:50.570 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:06:50.570 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:50.570 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.570 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.571 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:50.571 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615884+0000", 2024-04-18T21:06:50.571 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:50.571 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.571 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.571 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:50.571 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615885+0000", 2024-04-18T21:06:50.571 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2699999999999999e-06 2024-04-18T21:06:50.571 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.571 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.571 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:50.571 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615892+0000", 2024-04-18T21:06:50.571 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.6499999999999999e-06 2024-04-18T21:06:50.571 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.571 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.572 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:50.572 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615906+0000", 2024-04-18T21:06:50.572 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.393e-05 2024-04-18T21:06:50.572 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.572 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.572 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:50.572 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615919+0000", 2024-04-18T21:06:50.572 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2860000000000001e-05 2024-04-18T21:06:50.572 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.572 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.572 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:50.572 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616027+0000", 2024-04-18T21:06:50.572 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000107852 2024-04-18T21:06:50.572 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.572 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.572 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:50.573 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616037+0000", 2024-04-18T21:06:50.573 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0190000000000001e-05 2024-04-18T21:06:50.573 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.573 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.573 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:50.573 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622719+0000", 2024-04-18T21:06:50.573 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0066817220000000002 2024-04-18T21:06:50.573 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.573 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.573 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:50.573 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623006+0000", 2024-04-18T21:06:50.573 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00028783699999999999 2024-04-18T21:06:50.573 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.573 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.573 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:50.573 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.655220+0000", 2024-04-18T21:06:50.574 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.032213036 2024-04-18T21:06:50.574 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:50.574 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:50.574 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:50.574 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.574 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.574 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:50.574 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:50.574 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 104.913036366, 2024-04-18T21:06:50.574 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.032845253999999997, 2024-04-18T21:06:50.574 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:50.574 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:50.574 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "started", 2024-04-18T21:06:50.574 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:50.575 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.575 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:50.575 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:50.575 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:50.575 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.575 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.575 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:50.575 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615940+0000", 2024-04-18T21:06:50.575 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:50.575 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.575 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.575 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:50.575 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615942+0000", 2024-04-18T21:06:50.575 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.717e-06 2024-04-18T21:06:50.575 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.575 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.576 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:50.576 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615946+0000", 2024-04-18T21:06:50.576 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.6e-06 2024-04-18T21:06:50.576 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.576 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.576 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:50.576 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615960+0000", 2024-04-18T21:06:50.576 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3526000000000001e-05 2024-04-18T21:06:50.576 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.576 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.576 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:50.576 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.615968+0000", 2024-04-18T21:06:50.576 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.9070000000000007e-06 2024-04-18T21:06:50.576 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.576 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.576 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:50.576 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616100+0000", 2024-04-18T21:06:50.577 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000132402 2024-04-18T21:06:50.577 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.577 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.577 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:50.577 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.616117+0000", 2024-04-18T21:06:50.577 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.6653000000000001e-05 2024-04-18T21:06:50.577 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.577 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.577 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:50.577 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621566+0000", 2024-04-18T21:06:50.577 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0054497740000000001 2024-04-18T21:06:50.577 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.577 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.577 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:50.577 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622801+0000", 2024-04-18T21:06:50.578 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0012345710000000001 2024-04-18T21:06:50.578 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.578 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.578 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:50.578 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.648785+0000", 2024-04-18T21:06:50.578 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.025984104000000001 2024-04-18T21:06:50.578 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:50.578 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:50.578 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:50.578 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.578 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.578 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-18T21:06:50.578 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:06:50.578 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 104.907185016, 2024-04-18T21:06:50.578 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.011561350999999999, 2024-04-18T21:06:50.579 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:50.579 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:50.579 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:50.579 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:50.579 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.579 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:50.579 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:06:50.579 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:50.579 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.579 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.579 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:50.579 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621791+0000", 2024-04-18T21:06:50.579 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:50.579 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.579 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.580 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:50.580 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621792+0000", 2024-04-18T21:06:50.580 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.4000000000000001e-07 2024-04-18T21:06:50.580 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.580 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.580 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:50.580 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.621833+0000", 2024-04-18T21:06:50.580 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.1050000000000002e-05 2024-04-18T21:06:50.580 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.580 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.580 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:50.580 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.622608+0000", 2024-04-18T21:06:50.580 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00077505900000000003 2024-04-18T21:06:50.580 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.581 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.581 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:50.581 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.623879+0000", 2024-04-18T21:06:50.581 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0012705839999999999 2024-04-18T21:06:50.581 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.581 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.581 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:50.581 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624010+0000", 2024-04-18T21:06:50.581 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00013176900000000001 2024-04-18T21:06:50.581 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.581 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.581 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:50.581 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.624058+0000", 2024-04-18T21:06:50.581 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.7299000000000002e-05 2024-04-18T21:06:50.582 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.582 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.582 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:50.582 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633262+0000", 2024-04-18T21:06:50.582 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0092048770000000002 2024-04-18T21:06:50.582 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.582 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.582 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:50.582 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:05:05.633353+0000", 2024-04-18T21:06:50.582 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.0073000000000003e-05 2024-04-18T21:06:50.582 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:50.582 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:50.582 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:50.583 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.583 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.583 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(client.4534.0:7710 4.2e 4:77b1ab89:::10000002318.00000000:head [write 0~2089] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-18T21:06:50.583 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:06:49.176698+0000", 2024-04-18T21:06:50.583 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 1.352278348, 2024-04-18T21:06:50.583 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.014497421, 2024-04-18T21:06:50.583 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:50.583 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:50.583 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:50.583 INFO:teuthology.orchestra.run.smithi150.stdout: "client_info": { 2024-04-18T21:06:50.583 INFO:teuthology.orchestra.run.smithi150.stdout: "client": "client.4534", 2024-04-18T21:06:50.583 INFO:teuthology.orchestra.run.smithi150.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:50.583 INFO:teuthology.orchestra.run.smithi150.stdout: "tid": 7710 2024-04-18T21:06:50.583 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.583 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:50.584 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.584 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:50.584 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.176698+0000", 2024-04-18T21:06:50.584 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:50.584 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.584 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.584 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:50.584 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.176698+0000", 2024-04-18T21:06:50.584 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:50.584 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.584 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.584 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:50.584 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.176700+0000", 2024-04-18T21:06:50.584 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2840000000000001e-06 2024-04-18T21:06:50.584 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.584 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.585 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:50.585 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.176712+0000", 2024-04-18T21:06:50.585 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.2079000000000001e-05 2024-04-18T21:06:50.585 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.585 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.585 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:50.585 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.176739+0000", 2024-04-18T21:06:50.585 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.6437000000000001e-05 2024-04-18T21:06:50.585 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.585 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.585 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:50.585 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.176753+0000", 2024-04-18T21:06:50.585 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.454e-05 2024-04-18T21:06:50.585 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.586 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.586 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:50.586 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.176892+0000", 2024-04-18T21:06:50.586 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00013916199999999999 2024-04-18T21:06:50.586 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.586 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.586 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:50.586 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.177171+0000", 2024-04-18T21:06:50.586 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00027869700000000001 2024-04-18T21:06:50.586 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.586 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.586 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:50.586 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.177447+0000", 2024-04-18T21:06:50.586 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00027578200000000002 2024-04-18T21:06:50.587 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.587 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.587 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:50.587 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.178946+0000", 2024-04-18T21:06:50.587 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0014992619999999999 2024-04-18T21:06:50.587 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.587 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.587 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:50.587 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.191075+0000", 2024-04-18T21:06:50.587 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.012129376000000001 2024-04-18T21:06:50.587 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.587 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.587 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:50.587 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.191147+0000", 2024-04-18T21:06:50.587 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.1103e-05 2024-04-18T21:06:50.588 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.588 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.588 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:50.588 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.191195+0000", 2024-04-18T21:06:50.588 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 4.8699000000000002e-05 2024-04-18T21:06:50.588 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:50.588 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:50.588 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:50.588 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.588 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.588 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(client.4534.0:7711 4.3e 4:7c5da77b:::10000002319.00000000:head [write 0~2374] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-18T21:06:50.588 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:06:49.177506+0000", 2024-04-18T21:06:50.588 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 1.3514700550000001, 2024-04-18T21:06:50.588 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.013498876999999999, 2024-04-18T21:06:50.589 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:50.589 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:50.589 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:50.589 INFO:teuthology.orchestra.run.smithi150.stdout: "client_info": { 2024-04-18T21:06:50.589 INFO:teuthology.orchestra.run.smithi150.stdout: "client": "client.4534", 2024-04-18T21:06:50.589 INFO:teuthology.orchestra.run.smithi150.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:50.589 INFO:teuthology.orchestra.run.smithi150.stdout: "tid": 7711 2024-04-18T21:06:50.589 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.589 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:50.589 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.589 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:50.589 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.177506+0000", 2024-04-18T21:06:50.589 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:50.589 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.589 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.589 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:50.590 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.177506+0000", 2024-04-18T21:06:50.590 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:50.590 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.590 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.590 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:50.590 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.177508+0000", 2024-04-18T21:06:50.590 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5269999999999999e-06 2024-04-18T21:06:50.590 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.590 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.590 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:50.590 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.177518+0000", 2024-04-18T21:06:50.590 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.893e-06 2024-04-18T21:06:50.590 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.590 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.591 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:50.591 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.177536+0000", 2024-04-18T21:06:50.591 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.8853000000000001e-05 2024-04-18T21:06:50.591 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.591 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.591 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:50.591 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.177548+0000", 2024-04-18T21:06:50.591 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.1914e-05 2024-04-18T21:06:50.591 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.591 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.591 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:50.591 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.177642+0000", 2024-04-18T21:06:50.591 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.3968999999999994e-05 2024-04-18T21:06:50.591 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.591 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.591 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:50.592 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.177864+0000", 2024-04-18T21:06:50.592 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000221728 2024-04-18T21:06:50.592 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.592 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.592 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:50.592 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.178117+0000", 2024-04-18T21:06:50.592 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00025278099999999999 2024-04-18T21:06:50.592 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.592 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.592 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:50.592 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.179465+0000", 2024-04-18T21:06:50.592 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0013478909999999999 2024-04-18T21:06:50.592 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.592 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.592 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:50.592 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.190860+0000", 2024-04-18T21:06:50.593 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.011394792000000001 2024-04-18T21:06:50.593 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.593 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.593 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:50.593 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.190939+0000", 2024-04-18T21:06:50.593 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 7.9660000000000006e-05 2024-04-18T21:06:50.593 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.593 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.593 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:50.593 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.191005+0000", 2024-04-18T21:06:50.593 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.5869000000000002e-05 2024-04-18T21:06:50.593 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:50.593 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:50.594 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:50.594 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.594 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.594 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(mds.0.3:140 3.1e e52/15 3:7bf7e7b5:::200.00000006:head v 52'2, mlcod=0'0)", 2024-04-18T21:06:50.594 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:06:49.181161+0000", 2024-04-18T21:06:50.594 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 1.3478153879999999, 2024-04-18T21:06:50.594 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.024669802000000001, 2024-04-18T21:06:50.594 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:50.594 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:50.594 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:50.594 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:50.594 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.594 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:50.594 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.181161+0000", 2024-04-18T21:06:50.595 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:50.595 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.595 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.595 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:50.595 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.181161+0000", 2024-04-18T21:06:50.595 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:50.595 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.595 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.595 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:50.595 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.181163+0000", 2024-04-18T21:06:50.595 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.9199999999999998e-06 2024-04-18T21:06:50.595 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.595 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.596 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:50.596 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.188448+0000", 2024-04-18T21:06:50.596 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0072856170000000003 2024-04-18T21:06:50.596 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.596 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.596 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:50.596 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.188474+0000", 2024-04-18T21:06:50.596 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.6016e-05 2024-04-18T21:06:50.596 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.596 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.596 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:50.596 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.188488+0000", 2024-04-18T21:06:50.596 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.3787e-05 2024-04-18T21:06:50.596 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.597 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.597 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:50.597 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.188641+0000", 2024-04-18T21:06:50.597 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00015234499999999999 2024-04-18T21:06:50.597 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.597 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.597 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:50.597 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.188697+0000", 2024-04-18T21:06:50.597 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.6103000000000001e-05 2024-04-18T21:06:50.597 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.597 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.597 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:50.597 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.205735+0000", 2024-04-18T21:06:50.597 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.017038508000000001 2024-04-18T21:06:50.598 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.598 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.598 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:50.598 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.205831+0000", 2024-04-18T21:06:50.598 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.5506000000000003e-05 2024-04-18T21:06:50.598 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:50.598 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:50.598 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:50.598 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.598 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.598 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(client.4534.0:7716 4.3e 4:7e7b2b5d:::1000000231e.00000000:head [write 0~7080] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-18T21:06:50.598 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:06:49.182457+0000", 2024-04-18T21:06:50.598 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 1.3465195730000001, 2024-04-18T21:06:50.599 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.011443658000000001, 2024-04-18T21:06:50.599 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:50.599 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:50.599 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:50.599 INFO:teuthology.orchestra.run.smithi150.stdout: "client_info": { 2024-04-18T21:06:50.599 INFO:teuthology.orchestra.run.smithi150.stdout: "client": "client.4534", 2024-04-18T21:06:50.599 INFO:teuthology.orchestra.run.smithi150.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:50.599 INFO:teuthology.orchestra.run.smithi150.stdout: "tid": 7716 2024-04-18T21:06:50.599 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.599 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:50.599 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.599 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:50.599 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.182457+0000", 2024-04-18T21:06:50.599 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:50.600 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.600 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.600 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:50.600 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.182457+0000", 2024-04-18T21:06:50.600 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:50.600 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.600 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.600 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:50.600 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.182459+0000", 2024-04-18T21:06:50.600 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.503e-06 2024-04-18T21:06:50.600 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.600 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.600 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:50.600 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.182489+0000", 2024-04-18T21:06:50.600 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.0207000000000001e-05 2024-04-18T21:06:50.600 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.601 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.601 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:50.601 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.182521+0000", 2024-04-18T21:06:50.601 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.2073000000000003e-05 2024-04-18T21:06:50.601 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.601 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.601 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:50.601 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.182536+0000", 2024-04-18T21:06:50.601 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5073e-05 2024-04-18T21:06:50.601 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.601 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.601 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:50.601 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.182667+0000", 2024-04-18T21:06:50.601 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000130462 2024-04-18T21:06:50.602 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.602 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.602 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:50.602 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.182893+0000", 2024-04-18T21:06:50.602 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00022593099999999999 2024-04-18T21:06:50.602 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.602 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.602 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:50.602 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.183102+0000", 2024-04-18T21:06:50.602 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000209261 2024-04-18T21:06:50.602 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.602 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.602 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:50.602 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.186799+0000", 2024-04-18T21:06:50.603 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0036965399999999999 2024-04-18T21:06:50.603 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.603 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.603 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:50.603 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.193752+0000", 2024-04-18T21:06:50.603 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0069537169999999999 2024-04-18T21:06:50.603 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.603 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.603 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:50.603 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.193839+0000", 2024-04-18T21:06:50.603 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.6395000000000002e-05 2024-04-18T21:06:50.603 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.603 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.603 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:50.603 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.193900+0000", 2024-04-18T21:06:50.603 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 6.1495999999999995e-05 2024-04-18T21:06:50.604 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:50.604 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:50.604 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:50.604 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.604 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.604 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(client.4534.0:7719 4.6 4:6225a109:::10000002321.00000000:head [write 0~514] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-18T21:06:50.604 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:06:49.185345+0000", 2024-04-18T21:06:50.604 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 1.34363111, 2024-04-18T21:06:50.604 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.016735647999999999, 2024-04-18T21:06:50.604 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:50.604 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:50.604 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:50.604 INFO:teuthology.orchestra.run.smithi150.stdout: "client_info": { 2024-04-18T21:06:50.604 INFO:teuthology.orchestra.run.smithi150.stdout: "client": "client.4534", 2024-04-18T21:06:50.605 INFO:teuthology.orchestra.run.smithi150.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:50.605 INFO:teuthology.orchestra.run.smithi150.stdout: "tid": 7719 2024-04-18T21:06:50.605 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.605 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:50.605 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.605 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:50.605 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.185345+0000", 2024-04-18T21:06:50.605 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:50.605 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.605 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.605 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:50.605 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.185345+0000", 2024-04-18T21:06:50.605 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:50.605 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.605 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.605 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:50.605 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.185347+0000", 2024-04-18T21:06:50.606 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.9099999999999999e-06 2024-04-18T21:06:50.606 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.606 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.606 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:50.606 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.185357+0000", 2024-04-18T21:06:50.606 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.8269999999999993e-06 2024-04-18T21:06:50.606 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.606 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.606 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:50.606 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.185377+0000", 2024-04-18T21:06:50.606 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.0513000000000002e-05 2024-04-18T21:06:50.606 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.606 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.606 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:50.606 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.185390+0000", 2024-04-18T21:06:50.607 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.287e-05 2024-04-18T21:06:50.607 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.607 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.607 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:50.607 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.185567+0000", 2024-04-18T21:06:50.607 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000176928 2024-04-18T21:06:50.607 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.607 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.607 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:50.607 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.186811+0000", 2024-04-18T21:06:50.607 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.001244279 2024-04-18T21:06:50.607 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.607 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.607 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:50.607 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.187257+0000", 2024-04-18T21:06:50.607 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00044518900000000002 2024-04-18T21:06:50.608 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.608 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.608 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:50.608 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.193653+0000", 2024-04-18T21:06:50.608 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0063965289999999998 2024-04-18T21:06:50.608 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.608 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.608 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:50.608 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.201641+0000", 2024-04-18T21:06:50.608 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0079874400000000002 2024-04-18T21:06:50.608 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.608 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.608 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:50.608 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.201947+0000", 2024-04-18T21:06:50.608 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00030644999999999999 2024-04-18T21:06:50.608 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.609 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.609 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:50.609 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.202081+0000", 2024-04-18T21:06:50.609 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00013371300000000001 2024-04-18T21:06:50.609 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:50.609 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:50.609 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:50.609 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.609 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.609 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(client.4534.0:7723 4.36 4:6fa89f54:::10000002325.00000000:head [write 0~631] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-18T21:06:50.609 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:06:49.189134+0000", 2024-04-18T21:06:50.609 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 1.3398418910000001, 2024-04-18T21:06:50.609 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.013202996, 2024-04-18T21:06:50.609 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:50.609 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:50.609 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:50.610 INFO:teuthology.orchestra.run.smithi150.stdout: "client_info": { 2024-04-18T21:06:50.610 INFO:teuthology.orchestra.run.smithi150.stdout: "client": "client.4534", 2024-04-18T21:06:50.610 INFO:teuthology.orchestra.run.smithi150.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:50.610 INFO:teuthology.orchestra.run.smithi150.stdout: "tid": 7723 2024-04-18T21:06:50.610 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.610 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:50.610 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.610 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:50.610 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.189134+0000", 2024-04-18T21:06:50.610 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:50.610 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.610 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.610 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:50.611 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.189134+0000", 2024-04-18T21:06:50.611 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:50.611 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.611 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.611 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:50.611 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.189137+0000", 2024-04-18T21:06:50.611 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.717e-06 2024-04-18T21:06:50.611 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.611 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.611 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:50.611 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.189152+0000", 2024-04-18T21:06:50.611 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.455e-05 2024-04-18T21:06:50.611 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.611 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.611 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:50.612 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.189174+0000", 2024-04-18T21:06:50.612 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.268e-05 2024-04-18T21:06:50.612 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.612 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.612 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:50.612 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.189188+0000", 2024-04-18T21:06:50.612 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.394e-05 2024-04-18T21:06:50.612 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.612 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.612 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:50.612 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.189289+0000", 2024-04-18T21:06:50.612 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000100902 2024-04-18T21:06:50.612 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.612 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.613 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:50.613 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.189570+0000", 2024-04-18T21:06:50.613 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00028067000000000001 2024-04-18T21:06:50.613 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.613 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.613 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:50.613 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.189805+0000", 2024-04-18T21:06:50.613 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00023505800000000001 2024-04-18T21:06:50.613 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.613 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.613 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:50.613 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.193958+0000", 2024-04-18T21:06:50.613 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0041532790000000002 2024-04-18T21:06:50.613 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.613 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.613 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:50.613 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.202100+0000", 2024-04-18T21:06:50.614 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0081423720000000002 2024-04-18T21:06:50.614 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.614 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.614 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:50.614 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.202231+0000", 2024-04-18T21:06:50.614 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00013013200000000001 2024-04-18T21:06:50.614 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.614 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.614 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:50.614 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.202337+0000", 2024-04-18T21:06:50.614 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000106696 2024-04-18T21:06:50.614 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:50.615 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:50.615 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:50.615 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.615 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.615 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_repop(client.4534.0:7725 4.e e52/16 4:723bef13:::10000002327.00000000:head v 52'104, mlcod=52'102)", 2024-04-18T21:06:50.615 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:06:49.192043+0000", 2024-04-18T21:06:50.615 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 1.336933124, 2024-04-18T21:06:50.615 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.010394665000000001, 2024-04-18T21:06:50.615 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:50.615 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:50.615 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:50.615 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:50.615 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.615 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:50.616 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.192043+0000", 2024-04-18T21:06:50.616 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:50.616 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.616 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.616 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:50.616 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.192043+0000", 2024-04-18T21:06:50.616 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:50.616 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.616 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.616 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:50.616 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.192045+0000", 2024-04-18T21:06:50.616 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.8500000000000001e-06 2024-04-18T21:06:50.616 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.616 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.617 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:50.617 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.192102+0000", 2024-04-18T21:06:50.617 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.6959000000000001e-05 2024-04-18T21:06:50.617 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.617 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.617 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:50.617 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.192130+0000", 2024-04-18T21:06:50.617 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.8039999999999999e-05 2024-04-18T21:06:50.617 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.617 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.617 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:50.617 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.192156+0000", 2024-04-18T21:06:50.617 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.6196000000000001e-05 2024-04-18T21:06:50.618 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.618 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.618 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:50.618 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.192255+0000", 2024-04-18T21:06:50.618 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.8542999999999995e-05 2024-04-18T21:06:50.618 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.618 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.618 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:50.618 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.192287+0000", 2024-04-18T21:06:50.618 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.2246000000000003e-05 2024-04-18T21:06:50.618 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.618 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.618 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:50.618 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.202343+0000", 2024-04-18T21:06:50.619 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.010055975 2024-04-18T21:06:50.619 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.619 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.619 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:50.619 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.202438+0000", 2024-04-18T21:06:50.619 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.4856000000000001e-05 2024-04-18T21:06:50.619 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:50.619 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:50.619 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:50.619 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.619 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.619 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(client.4534.0:8049 4.6 4:60f835ab:::100000024a7.00000000:head [write 0~1038] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-18T21:06:50.619 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:06:49.657735+0000", 2024-04-18T21:06:50.619 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 0.87124093700000005, 2024-04-18T21:06:50.619 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.011025626, 2024-04-18T21:06:50.620 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:50.620 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:50.620 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:50.620 INFO:teuthology.orchestra.run.smithi150.stdout: "client_info": { 2024-04-18T21:06:50.620 INFO:teuthology.orchestra.run.smithi150.stdout: "client": "client.4534", 2024-04-18T21:06:50.620 INFO:teuthology.orchestra.run.smithi150.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:50.620 INFO:teuthology.orchestra.run.smithi150.stdout: "tid": 8049 2024-04-18T21:06:50.620 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.620 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:50.620 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.620 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:50.620 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.657735+0000", 2024-04-18T21:06:50.620 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:50.620 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.621 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.621 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:50.621 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.657735+0000", 2024-04-18T21:06:50.621 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:50.621 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.621 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.621 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:50.621 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.657738+0000", 2024-04-18T21:06:50.621 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.587e-06 2024-04-18T21:06:50.621 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.621 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.621 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:50.621 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.657753+0000", 2024-04-18T21:06:50.621 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.5206e-05 2024-04-18T21:06:50.621 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.622 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.622 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:50.622 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.657789+0000", 2024-04-18T21:06:50.622 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.5834000000000003e-05 2024-04-18T21:06:50.622 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.622 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.622 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:50.622 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.657815+0000", 2024-04-18T21:06:50.622 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.6173000000000002e-05 2024-04-18T21:06:50.622 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.622 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.622 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:50.622 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.657927+0000", 2024-04-18T21:06:50.623 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00011164500000000001 2024-04-18T21:06:50.623 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.623 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.623 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:50.623 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.658149+0000", 2024-04-18T21:06:50.623 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00022255199999999999 2024-04-18T21:06:50.623 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.623 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.623 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:50.623 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.658415+0000", 2024-04-18T21:06:50.623 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00026572999999999999 2024-04-18T21:06:50.623 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.623 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.623 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:50.623 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.659654+0000", 2024-04-18T21:06:50.624 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0012388220000000001 2024-04-18T21:06:50.624 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.624 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.624 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:50.624 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.668621+0000", 2024-04-18T21:06:50.624 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0089671149999999995 2024-04-18T21:06:50.624 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.624 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.624 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:50.624 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.668703+0000", 2024-04-18T21:06:50.624 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 8.2086e-05 2024-04-18T21:06:50.624 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.624 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.624 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:50.625 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.668761+0000", 2024-04-18T21:06:50.625 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 5.7875999999999999e-05 2024-04-18T21:06:50.625 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:50.625 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:50.625 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:50.625 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.625 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.625 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(client.4534.0:8112 4.24 4:241b19f8:::100000024eb.00000000:head [write 0~1009] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:50.625 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:06:49.758046+0000", 2024-04-18T21:06:50.625 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 0.77092996499999999, 2024-04-18T21:06:50.625 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.014527734, 2024-04-18T21:06:50.625 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:50.625 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:50.625 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:50.625 INFO:teuthology.orchestra.run.smithi150.stdout: "client_info": { 2024-04-18T21:06:50.626 INFO:teuthology.orchestra.run.smithi150.stdout: "client": "client.4534", 2024-04-18T21:06:50.626 INFO:teuthology.orchestra.run.smithi150.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:50.626 INFO:teuthology.orchestra.run.smithi150.stdout: "tid": 8112 2024-04-18T21:06:50.626 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.626 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:50.626 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.626 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:50.626 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.758046+0000", 2024-04-18T21:06:50.626 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:50.626 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.626 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.626 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:50.626 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.758046+0000", 2024-04-18T21:06:50.626 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:50.626 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.627 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.627 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:50.627 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.758048+0000", 2024-04-18T21:06:50.627 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.1629999999999999e-06 2024-04-18T21:06:50.627 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.627 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.627 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:50.627 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.758062+0000", 2024-04-18T21:06:50.627 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.311e-05 2024-04-18T21:06:50.627 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.627 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.627 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:50.627 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.758093+0000", 2024-04-18T21:06:50.627 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.1612999999999997e-05 2024-04-18T21:06:50.627 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.627 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.628 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:50.628 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.758108+0000", 2024-04-18T21:06:50.628 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.4694e-05 2024-04-18T21:06:50.628 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.628 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.628 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:50.628 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.758239+0000", 2024-04-18T21:06:50.628 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000131221 2024-04-18T21:06:50.628 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.628 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.628 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:50.628 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.758250+0000", 2024-04-18T21:06:50.628 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0754000000000001e-05 2024-04-18T21:06:50.628 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.628 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.629 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:50.629 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.768431+0000", 2024-04-18T21:06:50.629 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.010181035999999999 2024-04-18T21:06:50.629 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.629 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.629 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:50.629 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.768632+0000", 2024-04-18T21:06:50.629 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00020156199999999999 2024-04-18T21:06:50.629 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.629 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.629 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:50.629 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.769277+0000", 2024-04-18T21:06:50.629 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00064458099999999997 2024-04-18T21:06:50.629 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.629 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.629 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:50.630 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.772203+0000", 2024-04-18T21:06:50.630 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0029262300000000002 2024-04-18T21:06:50.630 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.630 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.630 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:50.630 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.772347+0000", 2024-04-18T21:06:50.630 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000143406 2024-04-18T21:06:50.630 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.630 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.630 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:50.630 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.772473+0000", 2024-04-18T21:06:50.630 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00012651200000000001 2024-04-18T21:06:50.630 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.630 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.630 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:50.631 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.772574+0000", 2024-04-18T21:06:50.631 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000100852 2024-04-18T21:06:50.631 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:50.631 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:50.631 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:50.631 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.631 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.631 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "osd_op(client.4534.0:8113 4.14 4:298ca926:::100000024ed.00000000:head [write 0~5108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-18T21:06:50.631 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:06:49.760531+0000", 2024-04-18T21:06:50.631 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 0.76844495800000001, 2024-04-18T21:06:50.631 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.012295731000000001, 2024-04-18T21:06:50.631 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:06:50.631 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:06:50.631 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:50.632 INFO:teuthology.orchestra.run.smithi150.stdout: "client_info": { 2024-04-18T21:06:50.632 INFO:teuthology.orchestra.run.smithi150.stdout: "client": "client.4534", 2024-04-18T21:06:50.632 INFO:teuthology.orchestra.run.smithi150.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:50.632 INFO:teuthology.orchestra.run.smithi150.stdout: "tid": 8113 2024-04-18T21:06:50.632 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.632 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:06:50.632 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.632 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:06:50.632 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.760531+0000", 2024-04-18T21:06:50.632 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:50.632 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.632 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.632 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:06:50.632 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.760531+0000", 2024-04-18T21:06:50.632 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:06:50.632 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.633 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.633 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:06:50.633 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.760534+0000", 2024-04-18T21:06:50.633 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 2.2759999999999999e-06 2024-04-18T21:06:50.633 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.633 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.633 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:06:50.633 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.760552+0000", 2024-04-18T21:06:50.633 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.8134e-05 2024-04-18T21:06:50.633 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.633 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.633 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:06:50.633 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.760583+0000", 2024-04-18T21:06:50.633 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 3.1040000000000001e-05 2024-04-18T21:06:50.633 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.633 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.634 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:06:50.634 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.760597+0000", 2024-04-18T21:06:50.634 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.465e-05 2024-04-18T21:06:50.634 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.634 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.634 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:50.634 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.760727+0000", 2024-04-18T21:06:50.634 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000129672 2024-04-18T21:06:50.634 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.634 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.634 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op must wait for map", 2024-04-18T21:06:50.634 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.760737+0000", 2024-04-18T21:06:50.634 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.0156000000000001e-05 2024-04-18T21:06:50.634 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.635 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.635 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:06:50.635 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.768606+0000", 2024-04-18T21:06:50.635 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0078687419999999998 2024-04-18T21:06:50.635 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.635 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.635 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:06:50.635 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.768979+0000", 2024-04-18T21:06:50.635 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00037283299999999999 2024-04-18T21:06:50.635 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.635 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.635 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:50.635 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.769389+0000", 2024-04-18T21:06:50.635 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00041048899999999999 2024-04-18T21:06:50.635 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.635 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.635 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:50.636 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.772316+0000", 2024-04-18T21:06:50.636 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.0029267770000000002 2024-04-18T21:06:50.636 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.636 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.636 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "op_commit", 2024-04-18T21:06:50.636 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.772599+0000", 2024-04-18T21:06:50.636 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00028339100000000002 2024-04-18T21:06:50.636 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.636 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.636 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "commit_sent", 2024-04-18T21:06:50.636 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.772730+0000", 2024-04-18T21:06:50.636 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00013064899999999999 2024-04-18T21:06:50.636 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:06:50.636 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:06:50.636 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "done", 2024-04-18T21:06:50.636 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:06:49.772827+0000", 2024-04-18T21:06:50.637 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.6922000000000005e-05 2024-04-18T21:06:50.637 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:50.637 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:50.637 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:50.637 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:06:50.637 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:06:50.637 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:06:50.638 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:50.639 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:50.638+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:50.739 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:50.738+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:50.768 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:50.768 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:06:50.768 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-04-18T21:06:50.768 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:50.782 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:50.869 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:50.870+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:50.941 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:50.938+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:50.952 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:50.952 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:06:50.952 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-18T21:06:50.952 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-18T21:06:50.952 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:50.967 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:51.053 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:51.054+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:51.094 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:06:51.142 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:51.142+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:51.147 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:51.147 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-18T21:06:51.147 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-18T21:06:51.147 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:06:51.147 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.147 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:51.148 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:51.148 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 105.53063743200001, 2024-04-18T21:06:51.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045668994999999997, 2024-04-18T21:06:51.148 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:51.148 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:51.148 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:51.148 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:51.148 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.148 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:51.148 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:51.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:51.148 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.148 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.148 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:51.148 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:51.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:51.149 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.149 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.149 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:51.149 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615459+0000", 2024-04-18T21:06:51.149 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5030000000000001e-06 2024-04-18T21:06:51.149 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.149 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.149 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:51.149 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615506+0000", 2024-04-18T21:06:51.149 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6872000000000001e-05 2024-04-18T21:06:51.149 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.149 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.149 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:51.149 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615527+0000", 2024-04-18T21:06:51.149 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0763000000000001e-05 2024-04-18T21:06:51.150 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.150 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:51.150 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615551+0000", 2024-04-18T21:06:51.150 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4159e-05 2024-04-18T21:06:51.150 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.150 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:51.150 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615736+0000", 2024-04-18T21:06:51.150 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018499599999999999 2024-04-18T21:06:51.150 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.150 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:51.150 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615748+0000", 2024-04-18T21:06:51.151 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2272999999999999e-05 2024-04-18T21:06:51.151 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.151 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:51.151 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635481+0000", 2024-04-18T21:06:51.151 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019732772999999999 2024-04-18T21:06:51.151 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.151 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:51.151 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635791+0000", 2024-04-18T21:06:51.151 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031013299999999998 2024-04-18T21:06:51.151 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.152 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:51.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636101+0000", 2024-04-18T21:06:51.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030943300000000002 2024-04-18T21:06:51.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.152 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:51.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646043+0000", 2024-04-18T21:06:51.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099428139999999995 2024-04-18T21:06:51.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.152 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:51.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660991+0000", 2024-04-18T21:06:51.153 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014947142 2024-04-18T21:06:51.153 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.153 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.153 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:51.153 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661061+0000", 2024-04-18T21:06:51.153 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0438000000000006e-05 2024-04-18T21:06:51.153 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.153 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.153 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:51.153 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661127+0000", 2024-04-18T21:06:51.153 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5696000000000003e-05 2024-04-18T21:06:51.153 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:51.153 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:51.153 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:51.153 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.153 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.154 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:51.154 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:51.154 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 105.53042500399999, 2024-04-18T21:06:51.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045745085999999997, 2024-04-18T21:06:51.154 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:51.154 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:51.154 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:51.154 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:51.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.154 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:51.154 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:51.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:51.154 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:51.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:51.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:51.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:51.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:06:51.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7400000000000001e-06 2024-04-18T21:06:51.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:51.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:06:51.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8133e-05 2024-04-18T21:06:51.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.156 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.156 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:51.156 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615726+0000", 2024-04-18T21:06:51.156 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6132e-05 2024-04-18T21:06:51.156 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.156 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.156 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:51.156 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615742+0000", 2024-04-18T21:06:51.156 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6157000000000001e-05 2024-04-18T21:06:51.156 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.156 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.156 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:51.156 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615937+0000", 2024-04-18T21:06:51.156 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000194768 2024-04-18T21:06:51.156 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.156 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.157 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:51.157 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615950+0000", 2024-04-18T21:06:51.157 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3084e-05 2024-04-18T21:06:51.157 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.157 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.157 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:51.157 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643676+0000", 2024-04-18T21:06:51.157 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027725639999999999 2024-04-18T21:06:51.157 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.157 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.157 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:51.157 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643867+0000", 2024-04-18T21:06:51.157 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019075900000000001 2024-04-18T21:06:51.158 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.158 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.158 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:51.158 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:06:51.158 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036013799999999997 2024-04-18T21:06:51.158 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.158 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.158 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:51.158 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646068+0000", 2024-04-18T21:06:51.158 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001841536 2024-04-18T21:06:51.158 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.158 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.158 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:51.158 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661184+0000", 2024-04-18T21:06:51.159 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015115458999999999 2024-04-18T21:06:51.159 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.159 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.159 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:51.159 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661283+0000", 2024-04-18T21:06:51.159 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9502999999999999e-05 2024-04-18T21:06:51.159 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.159 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.159 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:51.159 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661415+0000", 2024-04-18T21:06:51.159 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000132037 2024-04-18T21:06:51.159 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:51.159 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:51.159 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:51.159 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.160 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.160 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:51.160 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:51.160 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 105.52990455600001, 2024-04-18T21:06:51.160 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043572403000000003, 2024-04-18T21:06:51.160 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:51.160 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:51.160 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:51.160 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:51.160 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.160 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:51.160 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:51.160 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:51.161 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.161 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.161 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:51.161 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:51.161 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:51.161 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.161 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.161 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:51.161 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616192+0000", 2024-04-18T21:06:51.161 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:06:51.161 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.161 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.161 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:51.161 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616203+0000", 2024-04-18T21:06:51.162 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0890000000000001e-05 2024-04-18T21:06:51.162 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.162 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.162 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:51.162 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616223+0000", 2024-04-18T21:06:51.162 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0409000000000001e-05 2024-04-18T21:06:51.162 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.162 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.162 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:51.162 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616238+0000", 2024-04-18T21:06:51.162 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5160000000000001e-05 2024-04-18T21:06:51.162 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.162 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.163 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:51.163 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616343+0000", 2024-04-18T21:06:51.163 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000104831 2024-04-18T21:06:51.163 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.163 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.163 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:51.163 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616357+0000", 2024-04-18T21:06:51.163 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3686000000000001e-05 2024-04-18T21:06:51.163 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.163 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.163 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:51.163 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635912+0000", 2024-04-18T21:06:51.163 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019554944000000001 2024-04-18T21:06:51.163 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.163 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.164 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:51.164 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636231+0000", 2024-04-18T21:06:51.164 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000318766 2024-04-18T21:06:51.164 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.164 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.164 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:51.164 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659763+0000", 2024-04-18T21:06:51.164 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023532474000000001 2024-04-18T21:06:51.164 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:51.164 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:51.164 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:51.164 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.164 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.164 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:99 3.1f 3:f83d65d8:::200.00000004:head [write 313655~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:51.165 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757646+0000", 2024-04-18T21:06:51.165 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 5.3884487759999997, 2024-04-18T21:06:51.165 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043356459999999999, 2024-04-18T21:06:51.165 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:51.165 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:51.165 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:51.165 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:51.165 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.165 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:51.165 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757646+0000", 2024-04-18T21:06:51.165 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:51.165 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.165 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.165 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:51.166 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757646+0000", 2024-04-18T21:06:51.166 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:51.166 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.166 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.166 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:51.166 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757647+0000", 2024-04-18T21:06:51.166 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.44e-07 2024-04-18T21:06:51.166 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.166 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.166 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:51.166 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757656+0000", 2024-04-18T21:06:51.166 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6559999999999998e-06 2024-04-18T21:06:51.166 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.166 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.167 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:51.167 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757665+0000", 2024-04-18T21:06:51.167 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.6099999999999995e-06 2024-04-18T21:06:51.167 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.167 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.167 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:51.167 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757672+0000", 2024-04-18T21:06:51.167 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7270000000000001e-06 2024-04-18T21:06:51.167 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.167 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.167 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:51.167 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.794854+0000", 2024-04-18T21:06:51.167 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.037182448999999999 2024-04-18T21:06:51.167 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.168 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.168 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:51.168 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.795081+0000", 2024-04-18T21:06:51.168 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000226689 2024-04-18T21:06:51.168 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.168 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.168 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:51.168 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.795369+0000", 2024-04-18T21:06:51.168 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028752600000000003 2024-04-18T21:06:51.168 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.168 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.168 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:51.168 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.799725+0000", 2024-04-18T21:06:51.168 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043563509999999996 2024-04-18T21:06:51.168 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.169 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.169 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:51.169 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.800863+0000", 2024-04-18T21:06:51.169 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0011377799999999999 2024-04-18T21:06:51.169 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.169 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.169 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:51.169 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.800918+0000", 2024-04-18T21:06:51.169 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5547999999999997e-05 2024-04-18T21:06:51.169 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.169 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.169 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:51.169 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.801003+0000", 2024-04-18T21:06:51.169 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4480000000000004e-05 2024-04-18T21:06:51.169 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:51.170 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:51.170 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:51.170 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.170 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.170 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:100 3.1f 3:f83d65d8:::200.00000004:head [write 315055~1400 [fadvise_dontneed] in=1400b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:51.170 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757681+0000", 2024-04-18T21:06:51.170 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 5.3884141559999996, 2024-04-18T21:06:51.170 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045364542000000001, 2024-04-18T21:06:51.170 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:51.170 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:51.170 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:51.170 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:51.170 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.170 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:51.171 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757681+0000", 2024-04-18T21:06:51.171 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:51.171 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.171 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.171 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:51.171 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757681+0000", 2024-04-18T21:06:51.171 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:51.171 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.171 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.171 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:51.171 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757682+0000", 2024-04-18T21:06:51.171 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8999999999999996e-07 2024-04-18T21:06:51.171 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.171 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.171 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:51.171 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757685+0000", 2024-04-18T21:06:51.172 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.766e-06 2024-04-18T21:06:51.172 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.172 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.172 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:51.172 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757715+0000", 2024-04-18T21:06:51.172 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9904e-05 2024-04-18T21:06:51.172 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.172 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.172 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:51.172 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757723+0000", 2024-04-18T21:06:51.172 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9899999999999997e-06 2024-04-18T21:06:51.172 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.172 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.172 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:51.172 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.796754+0000", 2024-04-18T21:06:51.173 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.039030774999999997 2024-04-18T21:06:51.173 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.173 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.173 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:51.173 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.796825+0000", 2024-04-18T21:06:51.173 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0511000000000003e-05 2024-04-18T21:06:51.173 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.173 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.173 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:51.173 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.796952+0000", 2024-04-18T21:06:51.173 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012720099999999999 2024-04-18T21:06:51.173 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.173 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.173 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:51.174 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.800774+0000", 2024-04-18T21:06:51.174 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0038226039999999998 2024-04-18T21:06:51.174 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.174 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.174 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:51.174 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802920+0000", 2024-04-18T21:06:51.174 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002145194 2024-04-18T21:06:51.174 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.174 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.174 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:51.174 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802998+0000", 2024-04-18T21:06:51.174 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7836000000000005e-05 2024-04-18T21:06:51.174 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.174 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.174 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:51.175 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803046+0000", 2024-04-18T21:06:51.175 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8071000000000001e-05 2024-04-18T21:06:51.175 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:51.175 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:51.175 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:51.175 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.175 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.175 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:101 3.1f 3:f83d65d8:::200.00000004:head [write 316455~1401 [fadvise_dontneed] in=1401b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:51.175 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:06:51.175 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 5.3883613930000003, 2024-04-18T21:06:51.175 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.048270212999999999, 2024-04-18T21:06:51.175 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:51.175 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:51.175 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:51.176 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:51.176 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.176 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:51.176 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:06:51.176 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:51.176 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.176 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.176 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:51.176 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:06:51.176 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:51.176 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.176 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.176 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:51.176 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:06:51.176 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7700000000000004e-07 2024-04-18T21:06:51.177 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.177 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.177 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:51.177 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757745+0000", 2024-04-18T21:06:51.177 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0910000000000001e-05 2024-04-18T21:06:51.177 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.177 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.177 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:51.177 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757758+0000", 2024-04-18T21:06:51.177 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2593e-05 2024-04-18T21:06:51.177 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.177 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.177 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:51.177 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757765+0000", 2024-04-18T21:06:51.177 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1659999999999997e-06 2024-04-18T21:06:51.177 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.178 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.178 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:51.178 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.797782+0000", 2024-04-18T21:06:51.178 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.040017283000000001 2024-04-18T21:06:51.178 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.178 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.178 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:51.178 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.797949+0000", 2024-04-18T21:06:51.178 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016650399999999999 2024-04-18T21:06:51.178 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.178 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.178 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:51.178 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.798152+0000", 2024-04-18T21:06:51.178 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000203098 2024-04-18T21:06:51.179 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.179 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.179 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:51.179 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.800792+0000", 2024-04-18T21:06:51.179 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026394779999999998 2024-04-18T21:06:51.179 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.179 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.179 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:51.179 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805921+0000", 2024-04-18T21:06:51.179 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0051295519999999999 2024-04-18T21:06:51.179 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.179 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.179 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:51.179 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805967+0000", 2024-04-18T21:06:51.179 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5457000000000002e-05 2024-04-18T21:06:51.180 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.180 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.180 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:51.180 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806004+0000", 2024-04-18T21:06:51.180 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7494999999999999e-05 2024-04-18T21:06:51.180 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:51.180 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:51.180 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:51.180 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.180 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.180 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:102 3.1f 3:f83d65d8:::200.00000004:head [write 317856~1403 [fadvise_dontneed] in=1403b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:51.180 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757775+0000", 2024-04-18T21:06:51.180 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 5.3883203269999997, 2024-04-18T21:06:51.180 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.048337705000000002, 2024-04-18T21:06:51.180 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:51.181 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:51.181 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:51.181 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:51.181 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.181 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:51.181 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757775+0000", 2024-04-18T21:06:51.181 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:51.181 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.181 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.181 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:51.181 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757775+0000", 2024-04-18T21:06:51.181 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:51.181 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.181 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.181 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:51.182 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757776+0000", 2024-04-18T21:06:51.182 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5300000000000004e-07 2024-04-18T21:06:51.182 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.182 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.182 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:51.182 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757780+0000", 2024-04-18T21:06:51.182 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2270000000000004e-06 2024-04-18T21:06:51.182 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.182 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.182 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:51.182 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757792+0000", 2024-04-18T21:06:51.182 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2696e-05 2024-04-18T21:06:51.182 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.183 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.183 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:51.183 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757800+0000", 2024-04-18T21:06:51.183 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1439999999999997e-06 2024-04-18T21:06:51.183 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.183 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.183 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:51.183 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.798773+0000", 2024-04-18T21:06:51.183 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.040973074999999998 2024-04-18T21:06:51.183 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.183 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.183 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:51.183 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.798990+0000", 2024-04-18T21:06:51.183 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000217161 2024-04-18T21:06:51.183 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.183 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.184 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:51.184 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.799173+0000", 2024-04-18T21:06:51.184 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018295900000000001 2024-04-18T21:06:51.184 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.184 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.184 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:51.184 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802469+0000", 2024-04-18T21:06:51.184 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032965350000000002 2024-04-18T21:06:51.184 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.184 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.184 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:51.184 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806042+0000", 2024-04-18T21:06:51.184 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035724630000000001 2024-04-18T21:06:51.184 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.184 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.184 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:51.185 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806077+0000", 2024-04-18T21:06:51.185 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4997999999999999e-05 2024-04-18T21:06:51.185 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.185 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.185 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:51.185 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806113+0000", 2024-04-18T21:06:51.185 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5794000000000003e-05 2024-04-18T21:06:51.185 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:51.185 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:51.185 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:51.185 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.185 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.185 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:103 3.1f 3:f83d65d8:::200.00000004:head [write 319259~1404 [fadvise_dontneed] in=1404b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:51.185 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:06:51.185 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 5.3882864809999997, 2024-04-18T21:06:51.186 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.048414481000000002, 2024-04-18T21:06:51.186 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:51.186 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:51.186 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:51.186 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:51.186 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.186 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:51.186 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:06:51.186 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:51.186 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.186 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.186 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:51.186 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:06:51.186 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:51.187 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.187 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.187 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:51.187 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:06:51.187 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4700000000000001e-07 2024-04-18T21:06:51.187 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.187 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.187 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:51.187 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757814+0000", 2024-04-18T21:06:51.187 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1829999999999996e-06 2024-04-18T21:06:51.187 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.187 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.187 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:51.187 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757825+0000", 2024-04-18T21:06:51.187 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1754e-05 2024-04-18T21:06:51.188 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.188 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.188 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:51.188 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757832+0000", 2024-04-18T21:06:51.188 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8430000000000004e-06 2024-04-18T21:06:51.188 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.188 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.188 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:51.188 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.799809+0000", 2024-04-18T21:06:51.188 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.041976960000000001 2024-04-18T21:06:51.188 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.188 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.188 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:51.188 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.799934+0000", 2024-04-18T21:06:51.188 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000125053 2024-04-18T21:06:51.189 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.189 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.189 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:51.189 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.800067+0000", 2024-04-18T21:06:51.189 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013276299999999999 2024-04-18T21:06:51.189 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.189 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.189 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:51.189 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804582+0000", 2024-04-18T21:06:51.189 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0045148899999999997 2024-04-18T21:06:51.189 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.189 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.189 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:51.189 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806158+0000", 2024-04-18T21:06:51.189 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001575894 2024-04-18T21:06:51.190 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.190 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.190 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:51.190 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806189+0000", 2024-04-18T21:06:51.190 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1423000000000001e-05 2024-04-18T21:06:51.190 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.190 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.190 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:51.190 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806223+0000", 2024-04-18T21:06:51.190 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4071e-05 2024-04-18T21:06:51.190 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:51.190 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:51.190 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:51.190 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.191 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.191 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:104 3.1f 3:f83d65d8:::200.00000004:head [write 320663~1405 [fadvise_dontneed] in=1405b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:51.191 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757841+0000", 2024-04-18T21:06:51.191 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 5.3882542769999997, 2024-04-18T21:06:51.191 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056381623999999998, 2024-04-18T21:06:51.191 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:51.191 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:51.191 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:51.191 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:51.191 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.191 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:51.191 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757841+0000", 2024-04-18T21:06:51.191 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:51.191 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.191 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.191 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:51.192 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757841+0000", 2024-04-18T21:06:51.192 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:51.192 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.192 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.192 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:51.192 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757842+0000", 2024-04-18T21:06:51.192 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5000000000000002e-07 2024-04-18T21:06:51.192 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.192 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.192 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:51.192 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757852+0000", 2024-04-18T21:06:51.192 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.084e-05 2024-04-18T21:06:51.192 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.192 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.192 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:51.193 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757865+0000", 2024-04-18T21:06:51.193 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2643000000000001e-05 2024-04-18T21:06:51.193 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.193 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.193 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:51.193 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757872+0000", 2024-04-18T21:06:51.193 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8689999999999998e-06 2024-04-18T21:06:51.193 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.193 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.193 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:51.193 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.801102+0000", 2024-04-18T21:06:51.193 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043229837 2024-04-18T21:06:51.193 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.193 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.193 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:51.194 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.801291+0000", 2024-04-18T21:06:51.194 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000189641 2024-04-18T21:06:51.194 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.194 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.194 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:51.194 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.801640+0000", 2024-04-18T21:06:51.194 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000348971 2024-04-18T21:06:51.194 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.194 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.194 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:51.194 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805849+0000", 2024-04-18T21:06:51.194 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042082739999999997 2024-04-18T21:06:51.194 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.194 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.194 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:51.195 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814135+0000", 2024-04-18T21:06:51.195 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0082867270000000007 2024-04-18T21:06:51.195 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.195 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.195 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:51.195 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814180+0000", 2024-04-18T21:06:51.195 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4982999999999999e-05 2024-04-18T21:06:51.195 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.195 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.195 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:51.195 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814223+0000", 2024-04-18T21:06:51.195 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2188999999999999e-05 2024-04-18T21:06:51.195 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:51.195 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:51.195 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:51.195 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.196 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.196 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:105 3.1f 3:f83d65d8:::200.00000004:head [write 322068~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:51.196 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:06:51.196 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 5.3882136809999999, 2024-04-18T21:06:51.196 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056513678999999997, 2024-04-18T21:06:51.196 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:51.196 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:51.196 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:51.196 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:51.196 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.196 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:51.196 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:06:51.196 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:51.196 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.197 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.197 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:51.197 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:06:51.197 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:51.197 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.197 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.197 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:51.197 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:06:51.197 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2600000000000002e-07 2024-04-18T21:06:51.197 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.197 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.197 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:51.197 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757888+0000", 2024-04-18T21:06:51.197 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7130000000000002e-06 2024-04-18T21:06:51.197 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.198 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.198 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:51.198 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757906+0000", 2024-04-18T21:06:51.198 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7723999999999998e-05 2024-04-18T21:06:51.198 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.198 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.198 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:51.198 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757921+0000", 2024-04-18T21:06:51.198 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4936000000000001e-05 2024-04-18T21:06:51.198 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.198 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.198 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:51.198 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802493+0000", 2024-04-18T21:06:51.198 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.044571927999999997 2024-04-18T21:06:51.199 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.199 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.199 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:51.199 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802537+0000", 2024-04-18T21:06:51.199 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4449000000000001e-05 2024-04-18T21:06:51.199 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.199 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.199 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:51.199 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802605+0000", 2024-04-18T21:06:51.199 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7945000000000001e-05 2024-04-18T21:06:51.199 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.199 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.199 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:51.199 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805852+0000", 2024-04-18T21:06:51.200 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032469909999999999 2024-04-18T21:06:51.200 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.200 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.200 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:51.200 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814298+0000", 2024-04-18T21:06:51.200 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084463309999999996 2024-04-18T21:06:51.200 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.200 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.200 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:51.200 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814355+0000", 2024-04-18T21:06:51.200 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6459999999999998e-05 2024-04-18T21:06:51.200 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.200 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.200 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:51.200 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814395+0000", 2024-04-18T21:06:51.201 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0475999999999997e-05 2024-04-18T21:06:51.201 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:51.201 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:51.201 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:51.201 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.201 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.201 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:106 3.1f 3:f83d65d8:::200.00000004:head [write 323467~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:51.201 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757955+0000", 2024-04-18T21:06:51.201 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 5.388140452, 2024-04-18T21:06:51.201 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056539990999999998, 2024-04-18T21:06:51.201 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:51.201 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:51.201 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:51.201 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:51.202 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.202 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:51.202 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757955+0000", 2024-04-18T21:06:51.202 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:51.202 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.202 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.202 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:51.202 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757955+0000", 2024-04-18T21:06:51.202 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:51.202 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.202 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.202 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:51.202 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757956+0000", 2024-04-18T21:06:51.202 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.144e-06 2024-04-18T21:06:51.203 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.203 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.203 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:51.203 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757970+0000", 2024-04-18T21:06:51.203 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3899e-05 2024-04-18T21:06:51.203 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.203 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.203 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:51.203 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757988+0000", 2024-04-18T21:06:51.203 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8033000000000002e-05 2024-04-18T21:06:51.203 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.203 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.203 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:51.203 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758002+0000", 2024-04-18T21:06:51.204 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3973e-05 2024-04-18T21:06:51.204 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.204 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.204 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:51.204 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803072+0000", 2024-04-18T21:06:51.204 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045070194000000001 2024-04-18T21:06:51.204 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.204 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.204 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:51.204 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803125+0000", 2024-04-18T21:06:51.204 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3498000000000002e-05 2024-04-18T21:06:51.204 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.204 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.205 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:51.205 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803233+0000", 2024-04-18T21:06:51.205 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010704099999999999 2024-04-18T21:06:51.205 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.205 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.205 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:51.205 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805856+0000", 2024-04-18T21:06:51.205 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026233430000000002 2024-04-18T21:06:51.205 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.205 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.205 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:51.205 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814439+0000", 2024-04-18T21:06:51.205 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0085833839999999995 2024-04-18T21:06:51.205 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.205 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.206 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:51.206 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814469+0000", 2024-04-18T21:06:51.206 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9784000000000001e-05 2024-04-18T21:06:51.206 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.206 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.206 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:51.206 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814495+0000", 2024-04-18T21:06:51.206 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5698e-05 2024-04-18T21:06:51.206 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:51.206 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:51.206 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:51.206 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.206 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.206 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:107 3.1f 3:f83d65d8:::200.00000004:head [write 324866~1421 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:51.207 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758019+0000", 2024-04-18T21:06:51.207 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 5.3880758259999997, 2024-04-18T21:06:51.207 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056580563, 2024-04-18T21:06:51.207 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:51.207 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:51.207 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:51.207 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:51.207 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.207 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:51.207 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758019+0000", 2024-04-18T21:06:51.207 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:51.207 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.207 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.208 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:51.208 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758019+0000", 2024-04-18T21:06:51.208 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:51.208 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.208 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.208 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:51.208 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758021+0000", 2024-04-18T21:06:51.208 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1999999999999999e-06 2024-04-18T21:06:51.208 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.208 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.208 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:51.208 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758028+0000", 2024-04-18T21:06:51.208 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7200000000000006e-06 2024-04-18T21:06:51.208 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.209 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.209 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:51.209 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758050+0000", 2024-04-18T21:06:51.209 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1877000000000001e-05 2024-04-18T21:06:51.209 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.209 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.209 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:51.209 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758064+0000", 2024-04-18T21:06:51.209 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.383e-05 2024-04-18T21:06:51.209 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.209 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.209 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:51.209 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803593+0000", 2024-04-18T21:06:51.209 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045528831999999998 2024-04-18T21:06:51.210 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.210 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.210 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:51.210 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803635+0000", 2024-04-18T21:06:51.210 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1980000000000001e-05 2024-04-18T21:06:51.210 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.210 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.210 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:51.210 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803703+0000", 2024-04-18T21:06:51.210 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8542999999999997e-05 2024-04-18T21:06:51.210 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.210 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.210 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:51.210 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806123+0000", 2024-04-18T21:06:51.211 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002419769 2024-04-18T21:06:51.211 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.211 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.211 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:51.211 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814542+0000", 2024-04-18T21:06:51.211 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084189460000000001 2024-04-18T21:06:51.211 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.211 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.211 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:51.211 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814576+0000", 2024-04-18T21:06:51.211 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3679000000000001e-05 2024-04-18T21:06:51.211 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.211 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.211 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:51.211 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814600+0000", 2024-04-18T21:06:51.212 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4187000000000001e-05 2024-04-18T21:06:51.212 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:51.212 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:51.212 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:51.212 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.212 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.212 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:108 3.1f 3:f83d65d8:::200.00000004:head [write 326287~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:51.212 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:06:51.212 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 5.388012657, 2024-04-18T21:06:51.212 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056616183, 2024-04-18T21:06:51.212 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:51.212 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:51.212 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:51.212 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:51.213 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.213 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:51.213 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:06:51.213 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:51.213 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.213 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.213 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:51.213 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:06:51.213 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:51.213 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.213 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.213 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:51.213 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758084+0000", 2024-04-18T21:06:51.213 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.124e-06 2024-04-18T21:06:51.213 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.214 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.214 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:51.214 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758100+0000", 2024-04-18T21:06:51.214 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6246e-05 2024-04-18T21:06:51.214 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.214 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.214 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:51.214 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758118+0000", 2024-04-18T21:06:51.214 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8267e-05 2024-04-18T21:06:51.214 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.214 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.214 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:51.214 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758134+0000", 2024-04-18T21:06:51.214 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5950000000000001e-05 2024-04-18T21:06:51.214 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.215 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.215 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:51.215 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803949+0000", 2024-04-18T21:06:51.215 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045815349999999998 2024-04-18T21:06:51.215 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.215 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.215 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:51.215 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804011+0000", 2024-04-18T21:06:51.215 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1044999999999996e-05 2024-04-18T21:06:51.215 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.215 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.215 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:51.215 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804128+0000", 2024-04-18T21:06:51.215 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117148 2024-04-18T21:06:51.215 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.215 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.216 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:51.216 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806794+0000", 2024-04-18T21:06:51.216 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002666692 2024-04-18T21:06:51.216 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.216 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.216 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:51.216 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814645+0000", 2024-04-18T21:06:51.216 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0078508880000000003 2024-04-18T21:06:51.216 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.216 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.216 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:51.216 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814678+0000", 2024-04-18T21:06:51.216 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3188999999999997e-05 2024-04-18T21:06:51.216 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.216 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.216 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:51.217 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814699+0000", 2024-04-18T21:06:51.217 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0284000000000001e-05 2024-04-18T21:06:51.217 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:51.217 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:51.217 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:51.217 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.217 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.217 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:109 3.1f 3:f83d65d8:::200.00000004:head [write 327693~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:51.217 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:06:51.217 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 5.3879432899999999, 2024-04-18T21:06:51.217 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056621036999999999, 2024-04-18T21:06:51.217 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:51.217 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:51.217 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:51.218 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:51.218 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.218 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:51.218 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:06:51.218 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:51.218 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.218 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.218 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:51.218 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:06:51.218 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:51.218 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.218 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.218 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:51.219 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758153+0000", 2024-04-18T21:06:51.219 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1459999999999999e-06 2024-04-18T21:06:51.219 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.219 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.219 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:51.219 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758161+0000", 2024-04-18T21:06:51.219 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7999999999999999e-06 2024-04-18T21:06:51.219 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.219 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.219 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:51.219 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758179+0000", 2024-04-18T21:06:51.219 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7949999999999999e-05 2024-04-18T21:06:51.219 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.219 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.220 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:51.220 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758193+0000", 2024-04-18T21:06:51.220 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3773e-05 2024-04-18T21:06:51.220 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.220 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.220 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:51.220 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804632+0000", 2024-04-18T21:06:51.220 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.046439469999999997 2024-04-18T21:06:51.220 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.220 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.220 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:51.220 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804790+0000", 2024-04-18T21:06:51.220 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015784300000000001 2024-04-18T21:06:51.220 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.220 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.221 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:51.221 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805056+0000", 2024-04-18T21:06:51.221 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026652400000000003 2024-04-18T21:06:51.221 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.221 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.221 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:51.221 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.808959+0000", 2024-04-18T21:06:51.221 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003903077 2024-04-18T21:06:51.221 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.221 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.221 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:51.221 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814728+0000", 2024-04-18T21:06:51.221 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0057682489999999996 2024-04-18T21:06:51.221 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.221 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.222 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:51.222 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814754+0000", 2024-04-18T21:06:51.222 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6673999999999999e-05 2024-04-18T21:06:51.222 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.222 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.222 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:51.222 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814773+0000", 2024-04-18T21:06:51.222 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8530999999999999e-05 2024-04-18T21:06:51.222 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:51.222 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:51.222 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:51.222 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.222 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.222 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:110 3.1f 3:f83d65d8:::200.00000004:head [write 329098~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:51.222 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:06:51.223 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 5.3878848809999997, 2024-04-18T21:06:51.223 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056669113, 2024-04-18T21:06:51.223 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:51.223 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:51.223 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:51.223 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:51.223 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.223 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:51.223 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:06:51.223 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:51.223 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.223 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.223 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:51.223 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:06:51.223 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:51.223 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.223 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.224 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:51.224 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758212+0000", 2024-04-18T21:06:51.224 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:06:51.224 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.224 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.224 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:51.224 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758219+0000", 2024-04-18T21:06:51.224 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4229999999999999e-06 2024-04-18T21:06:51.224 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.224 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.224 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:51.224 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758237+0000", 2024-04-18T21:06:51.224 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7966999999999999e-05 2024-04-18T21:06:51.224 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.224 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.225 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:51.225 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758252+0000", 2024-04-18T21:06:51.225 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5322999999999999e-05 2024-04-18T21:06:51.225 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.225 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.225 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:51.225 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805536+0000", 2024-04-18T21:06:51.225 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.047283861000000003 2024-04-18T21:06:51.225 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.225 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.225 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:51.225 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805579+0000", 2024-04-18T21:06:51.225 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2738999999999999e-05 2024-04-18T21:06:51.225 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.225 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.225 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:51.225 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805649+0000", 2024-04-18T21:06:51.226 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0213e-05 2024-04-18T21:06:51.226 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.226 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.226 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:51.226 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.808966+0000", 2024-04-18T21:06:51.226 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033166129999999999 2024-04-18T21:06:51.226 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.226 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.226 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:51.226 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814812+0000", 2024-04-18T21:06:51.226 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0058463589999999998 2024-04-18T21:06:51.226 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.226 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.226 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:51.226 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814854+0000", 2024-04-18T21:06:51.227 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1618e-05 2024-04-18T21:06:51.227 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.227 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.227 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:51.227 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814879+0000", 2024-04-18T21:06:51.227 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5754000000000001e-05 2024-04-18T21:06:51.227 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:51.227 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:51.227 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:51.227 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.227 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.227 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:111 3.1f 3:f83d65d8:::200.00000004:head [write 330499~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:51.227 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:06:51.227 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 5.3878239050000003, 2024-04-18T21:06:51.227 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058693793000000001, 2024-04-18T21:06:51.227 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:51.228 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:51.228 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:51.228 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:51.228 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.228 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:51.228 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:06:51.228 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:51.228 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.228 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.228 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:51.228 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:06:51.228 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:51.228 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.228 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.228 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:51.228 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758272+0000", 2024-04-18T21:06:51.229 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1200000000000001e-06 2024-04-18T21:06:51.229 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.229 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.229 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:51.229 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758287+0000", 2024-04-18T21:06:51.229 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5017e-05 2024-04-18T21:06:51.229 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.229 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.229 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:51.229 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758309+0000", 2024-04-18T21:06:51.229 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1866e-05 2024-04-18T21:06:51.229 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.229 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.229 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:51.229 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758323+0000", 2024-04-18T21:06:51.230 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3606e-05 2024-04-18T21:06:51.230 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.230 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.230 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:51.230 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806279+0000", 2024-04-18T21:06:51.230 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.047956061000000001 2024-04-18T21:06:51.230 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.230 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.230 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:51.230 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806350+0000", 2024-04-18T21:06:51.230 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1070999999999998e-05 2024-04-18T21:06:51.230 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.230 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.230 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:51.231 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806459+0000", 2024-04-18T21:06:51.231 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000108606 2024-04-18T21:06:51.231 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.231 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.231 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:51.231 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.809774+0000", 2024-04-18T21:06:51.231 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003314881 2024-04-18T21:06:51.231 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.231 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.231 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:51.231 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816910+0000", 2024-04-18T21:06:51.231 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0071367760000000001 2024-04-18T21:06:51.231 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.231 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.231 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:51.232 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816941+0000", 2024-04-18T21:06:51.232 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0846000000000002e-05 2024-04-18T21:06:51.232 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.232 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.232 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:51.232 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816965+0000", 2024-04-18T21:06:51.232 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3943000000000001e-05 2024-04-18T21:06:51.232 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:51.232 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:51.232 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:51.232 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.232 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.232 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:5230 4.17 4:eb2cc4c4:::1000000184c.00000000:head [write 0~2191] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-18T21:06:51.232 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.760650+0000", 2024-04-18T21:06:51.232 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 5.385444734, 2024-04-18T21:06:51.233 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.054210577000000003, 2024-04-18T21:06:51.233 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:51.233 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:51.233 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:51.233 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:06:51.233 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:06:51.233 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:51.233 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 5230 2024-04-18T21:06:51.233 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.233 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:51.233 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.233 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:51.233 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760650+0000", 2024-04-18T21:06:51.233 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:51.234 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.234 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.234 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:51.234 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760650+0000", 2024-04-18T21:06:51.234 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:51.234 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.234 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.234 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:51.234 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760653+0000", 2024-04-18T21:06:51.234 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0829999999999998e-06 2024-04-18T21:06:51.234 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.234 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.234 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:51.235 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760664+0000", 2024-04-18T21:06:51.235 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.111e-05 2024-04-18T21:06:51.235 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.235 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.235 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:51.235 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760688+0000", 2024-04-18T21:06:51.235 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4837e-05 2024-04-18T21:06:51.235 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.235 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.235 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:51.235 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760702+0000", 2024-04-18T21:06:51.235 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3723000000000001e-05 2024-04-18T21:06:51.235 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.235 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.235 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:51.235 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806264+0000", 2024-04-18T21:06:51.236 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045562182 2024-04-18T21:06:51.236 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.236 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.236 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:51.236 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806351+0000", 2024-04-18T21:06:51.236 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6322000000000005e-05 2024-04-18T21:06:51.236 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.236 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.236 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:51.236 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806453+0000", 2024-04-18T21:06:51.236 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000102602 2024-04-18T21:06:51.236 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.236 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.237 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:51.237 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.808972+0000", 2024-04-18T21:06:51.237 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025184090000000001 2024-04-18T21:06:51.237 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.237 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.237 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:51.237 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814798+0000", 2024-04-18T21:06:51.237 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0058266689999999996 2024-04-18T21:06:51.237 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.237 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.237 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:51.237 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814839+0000", 2024-04-18T21:06:51.237 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0482000000000003e-05 2024-04-18T21:06:51.237 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.238 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.238 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:51.238 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814861+0000", 2024-04-18T21:06:51.238 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2158e-05 2024-04-18T21:06:51.238 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:51.238 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:51.238 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:51.238 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.238 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.238 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:112 3.1f 3:f83d65d8:::200.00000004:head [write 331898~20167 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:51.238 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.771321+0000", 2024-04-18T21:06:51.238 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 5.3747741070000004, 2024-04-18T21:06:51.239 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045740306000000001, 2024-04-18T21:06:51.239 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:51.239 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:51.239 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:51.239 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:51.239 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.239 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:51.239 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771321+0000", 2024-04-18T21:06:51.239 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:51.239 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.239 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.239 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:51.239 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771321+0000", 2024-04-18T21:06:51.240 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:51.240 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.240 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.240 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:51.240 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771323+0000", 2024-04-18T21:06:51.240 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3740000000000001e-06 2024-04-18T21:06:51.240 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.240 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.240 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:51.240 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771359+0000", 2024-04-18T21:06:51.240 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5447999999999997e-05 2024-04-18T21:06:51.240 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.240 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.240 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:51.240 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771388+0000", 2024-04-18T21:06:51.240 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8915e-05 2024-04-18T21:06:51.241 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.241 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.241 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:51.241 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771410+0000", 2024-04-18T21:06:51.241 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1899000000000002e-05 2024-04-18T21:06:51.241 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.241 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.241 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:51.241 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806827+0000", 2024-04-18T21:06:51.241 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.035417063999999998 2024-04-18T21:06:51.241 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.241 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.241 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:51.241 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806873+0000", 2024-04-18T21:06:51.242 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6261999999999999e-05 2024-04-18T21:06:51.242 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.242 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.242 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:51.242 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806946+0000", 2024-04-18T21:06:51.242 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3205000000000001e-05 2024-04-18T21:06:51.242 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.242 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.242 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:51.242 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.809781+0000", 2024-04-18T21:06:51.242 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002834937 2024-04-18T21:06:51.242 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.242 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.242 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:51.243 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817003+0000", 2024-04-18T21:06:51.243 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0072217959999999999 2024-04-18T21:06:51.243 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.243 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.243 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:51.243 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817038+0000", 2024-04-18T21:06:51.243 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4696999999999997e-05 2024-04-18T21:06:51.243 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.243 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.243 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:51.243 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817061+0000", 2024-04-18T21:06:51.243 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3708999999999999e-05 2024-04-18T21:06:51.243 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:51.243 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:51.243 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:51.244 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.244 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.244 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:113 3.1f 3:f83d65d8:::200.00000004:head [write 352065~3878 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:51.244 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.771472+0000", 2024-04-18T21:06:51.244 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 5.3746233710000002, 2024-04-18T21:06:51.244 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045689726, 2024-04-18T21:06:51.244 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:51.244 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:51.244 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:51.244 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:51.244 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.244 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:51.244 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771472+0000", 2024-04-18T21:06:51.244 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:51.245 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.245 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.245 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:51.245 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771472+0000", 2024-04-18T21:06:51.245 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:51.245 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.245 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.245 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:51.245 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771473+0000", 2024-04-18T21:06:51.245 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3829999999999999e-06 2024-04-18T21:06:51.245 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.245 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.245 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:51.245 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771489+0000", 2024-04-18T21:06:51.245 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5797000000000001e-05 2024-04-18T21:06:51.246 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.246 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.246 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:51.246 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771509+0000", 2024-04-18T21:06:51.246 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0401999999999999e-05 2024-04-18T21:06:51.246 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.246 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.246 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:51.246 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771525+0000", 2024-04-18T21:06:51.246 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5099999999999999e-05 2024-04-18T21:06:51.246 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.246 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.246 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:51.247 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807273+0000", 2024-04-18T21:06:51.247 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.035748488000000002 2024-04-18T21:06:51.247 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.247 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.247 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:51.247 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807343+0000", 2024-04-18T21:06:51.247 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0277000000000005e-05 2024-04-18T21:06:51.247 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.247 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.247 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:51.247 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807455+0000", 2024-04-18T21:06:51.247 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011171999999999999 2024-04-18T21:06:51.247 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.247 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.247 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:51.248 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.811509+0000", 2024-04-18T21:06:51.248 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0040543469999999998 2024-04-18T21:06:51.248 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.248 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.248 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:51.248 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817115+0000", 2024-04-18T21:06:51.248 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0056054520000000004 2024-04-18T21:06:51.248 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.248 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.248 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:51.248 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817142+0000", 2024-04-18T21:06:51.248 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7430999999999999e-05 2024-04-18T21:06:51.248 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.248 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.249 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:51.249 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817162+0000", 2024-04-18T21:06:51.249 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9329000000000001e-05 2024-04-18T21:06:51.249 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:51.249 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:51.249 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:51.249 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.249 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.249 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:114 3.1f 3:f83d65d8:::200.00000004:head [write 355943~1928 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:51.249 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.771785+0000", 2024-04-18T21:06:51.249 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 5.3743100259999999, 2024-04-18T21:06:51.249 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045480532999999997, 2024-04-18T21:06:51.249 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:51.249 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:51.249 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:51.250 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:51.250 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.250 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:51.250 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771785+0000", 2024-04-18T21:06:51.250 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:51.250 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.250 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.250 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:51.250 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771785+0000", 2024-04-18T21:06:51.250 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:51.250 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.250 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.250 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:51.250 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771787+0000", 2024-04-18T21:06:51.250 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0600000000000002e-06 2024-04-18T21:06:51.251 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.251 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.251 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:51.251 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771799+0000", 2024-04-18T21:06:51.251 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1503e-05 2024-04-18T21:06:51.251 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.251 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.251 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:51.251 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771829+0000", 2024-04-18T21:06:51.251 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.04e-05 2024-04-18T21:06:51.251 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.251 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.251 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:51.251 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771846+0000", 2024-04-18T21:06:51.252 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6608000000000001e-05 2024-04-18T21:06:51.252 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.252 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.252 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:51.252 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807856+0000", 2024-04-18T21:06:51.252 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036010480999999997 2024-04-18T21:06:51.252 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.252 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.252 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:51.252 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807899+0000", 2024-04-18T21:06:51.252 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2775999999999998e-05 2024-04-18T21:06:51.252 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.252 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.252 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:51.253 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807966+0000", 2024-04-18T21:06:51.253 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6793999999999998e-05 2024-04-18T21:06:51.253 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.253 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.253 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:51.253 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.811516+0000", 2024-04-18T21:06:51.253 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035497300000000001 2024-04-18T21:06:51.253 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.253 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.253 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:51.253 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817194+0000", 2024-04-18T21:06:51.253 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0056787030000000002 2024-04-18T21:06:51.253 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.253 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.253 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:51.253 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817231+0000", 2024-04-18T21:06:51.254 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6727000000000003e-05 2024-04-18T21:06:51.254 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:51.254 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:51.254 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:51.254 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817266+0000", 2024-04-18T21:06:51.254 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4751e-05 2024-04-18T21:06:51.254 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:51.254 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:51.254 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:51.254 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:51.254 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:51.254 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:51.256 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:51.256 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:51.254+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:51.262 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:06:51.262 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:06:51.288 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1: {} 2024-04-18T21:06:51.288 INFO:teuthology.orchestra.run.smithi078.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:06:51.314 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:06:51.314 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:51.357 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:51.358+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:51.404 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:51.404 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:51.422 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:51.466 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:51.466+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:51.554 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:51.554 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:51.558 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:51.558+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:51.567 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:51.658 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:51.658+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:51.746 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:51.746 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:51.759 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:06:51.758+0000 7f942ee16640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21653) UID: 0 2024-04-18T21:06:51.761 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:06:51.770 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-18T21:06:51.770 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-18T21:06:51.770 INFO:tasks.thrashosds.thrasher:Killing osd 1, live_osds are [0, 1, 2] 2024-04-18T21:06:51.771 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.1 doing powercycle of ubuntu@smithi150.front.sepia.ceph.com 2024-04-18T21:06:51.771 INFO:teuthology.orchestra.console.smithi150:Power off 2024-04-18T21:06:51.771 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T21:06:51.779 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-18T21:06:51.794 DEBUG:teuthology.orchestra.console.smithi150:power off output: Chassis Power Control: Down/Off 2024-04-18T21:06:51.794 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T21:06:51.817 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on 2024-04-18T21:06:51.862 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:51.862+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:51.904 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:51.904 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:51.919 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-18T21:06:51.963 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:51.962+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:52.056 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:52.056 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:52.064 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:52.062+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:52.070 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-18T21:06:52.164 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:52.162+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:52.200 INFO:teuthology.orchestra.run.smithi150.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:52.200 INFO:teuthology.orchestra.run.smithi150.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:52.215 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:52.265 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:52.262+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:52.356 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:52.356 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:52.366 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:52.366+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:52.370 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:52.467 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:52.466+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:52.541 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:52.541 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:52.555 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:52.569 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:52.570+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:52.670 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:52.670+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:52.735 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:52.736 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:52.752 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:52.774 INFO:teuthology.orchestra.run.smithi078.stderr:noscrub is unset 2024-04-18T21:06:52.797 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:52.798+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:52.872 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:52.870+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:52.904 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:52.904 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:52.921 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:53.009 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:53.010+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:53.074 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:53.074+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:53.094 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:53.094 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:53.109 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:53.174 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:53.174+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:53.275 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:53.274+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:53.286 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:53.286 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:53.301 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:53.334 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:06:53.376 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:53.374+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:53.436 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:53.436 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:53.451 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:53.489 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:06:53.490 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:06:53.495 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:53.494+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:53.516 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1: {} 2024-04-18T21:06:53.516 INFO:teuthology.orchestra.run.smithi078.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:06:53.540 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:06:53.540 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:53.566 INFO:tasks.workunit.client.0.smithi078.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-18T21:06:53.569 INFO:tasks.workunit.client.0.smithi078.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-18T21:06:53.569 INFO:tasks.workunit.client.0.smithi078.stderr:+ make 2024-04-18T21:06:53.578 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:53.578+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:53.608 INFO:tasks.workunit.client.0.smithi078.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-18T21:06:53.631 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:53.631 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:06:53.631 INFO:teuthology.orchestra.run.smithi132.stdout: "complaint_time": 30, 2024-04-18T21:06:53.631 INFO:teuthology.orchestra.run.smithi132.stdout: "num_blocked_ops": 0 2024-04-18T21:06:53.631 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:53.645 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:53.690 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:53.690+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:53.770 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:53.771 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 20, 2024-04-18T21:06:53.771 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 600, 2024-04-18T21:06:53.771 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [ 2024-04-18T21:06:53.771 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.771 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:53.771 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:06:53.771 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 118.85821212800001, 2024-04-18T21:06:53.771 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.02518273, 2024-04-18T21:06:53.771 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:53.771 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:53.771 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:53.771 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:53.771 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:53.771 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:53.772 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 141 2024-04-18T21:06:53.772 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.772 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:53.772 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.772 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:53.772 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:06:53.772 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:53.772 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.772 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.772 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:53.772 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:06:53.772 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:53.772 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.772 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.773 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:53.773 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911562+0000", 2024-04-18T21:06:53.773 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9300000000000006e-07 2024-04-18T21:06:53.773 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.773 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.773 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:53.773 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911569+0000", 2024-04-18T21:06:53.773 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0169999999999999e-06 2024-04-18T21:06:53.773 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.773 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.773 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:53.773 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911582+0000", 2024-04-18T21:06:53.773 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.343e-05 2024-04-18T21:06:53.773 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.774 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.774 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:53.774 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911590+0000", 2024-04-18T21:06:53.774 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.413e-06 2024-04-18T21:06:53.774 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.774 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.774 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:53.774 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.933922+0000", 2024-04-18T21:06:53.774 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.022332093000000001 2024-04-18T21:06:53.774 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.774 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.774 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:53.774 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.934155+0000", 2024-04-18T21:06:53.774 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023378900000000001 2024-04-18T21:06:53.775 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.775 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.775 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:53.775 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.934514+0000", 2024-04-18T21:06:53.775 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00035859200000000003 2024-04-18T21:06:53.775 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.775 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.775 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:53.775 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.935973+0000", 2024-04-18T21:06:53.775 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001458705 2024-04-18T21:06:53.775 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.775 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.775 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:53.775 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936488+0000", 2024-04-18T21:06:53.776 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00051550000000000001 2024-04-18T21:06:53.776 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.776 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.776 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:53.776 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936636+0000", 2024-04-18T21:06:53.776 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014779800000000001 2024-04-18T21:06:53.776 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.776 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.776 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:53.776 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936743+0000", 2024-04-18T21:06:53.776 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010739999999999999 2024-04-18T21:06:53.776 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:53.776 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:53.776 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:53.777 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.777 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.777 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:53.777 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:53.777 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 118.741013154, 2024-04-18T21:06:53.777 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023654959999999999, 2024-04-18T21:06:53.777 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:53.777 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:53.777 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:53.777 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:53.777 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:53.777 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:53.777 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 163 2024-04-18T21:06:53.777 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.778 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:53.778 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.778 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:53.778 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:53.778 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:53.778 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.778 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.778 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:53.778 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:53.778 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:53.778 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.778 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.779 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:53.779 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028760+0000", 2024-04-18T21:06:53.779 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0999999999999998e-07 2024-04-18T21:06:53.779 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.779 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.779 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:53.779 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028766+0000", 2024-04-18T21:06:53.779 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4700000000000001e-06 2024-04-18T21:06:53.779 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.779 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.779 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:53.779 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028775+0000", 2024-04-18T21:06:53.779 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.3190000000000001e-06 2024-04-18T21:06:53.779 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.780 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.780 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:53.780 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028782+0000", 2024-04-18T21:06:53.780 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.2300000000000002e-06 2024-04-18T21:06:53.780 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.780 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.780 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:53.780 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046667+0000", 2024-04-18T21:06:53.780 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017884356000000001 2024-04-18T21:06:53.780 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.780 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.780 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:53.780 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046788+0000", 2024-04-18T21:06:53.780 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012125000000000001 2024-04-18T21:06:53.780 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.781 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.781 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:53.781 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.046982+0000", 2024-04-18T21:06:53.781 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019394 2024-04-18T21:06:53.781 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.781 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.781 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:53.781 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051969+0000", 2024-04-18T21:06:53.781 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0049868150000000003 2024-04-18T21:06:53.781 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.781 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.781 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:53.781 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052089+0000", 2024-04-18T21:06:53.781 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011993 2024-04-18T21:06:53.781 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.781 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.782 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:53.782 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052292+0000", 2024-04-18T21:06:53.782 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020345699999999999 2024-04-18T21:06:53.782 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.782 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.782 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:53.782 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052415+0000", 2024-04-18T21:06:53.782 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000122483 2024-04-18T21:06:53.782 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:53.782 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:53.782 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:53.782 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.782 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.782 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:53.782 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:53.783 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 118.740978922, 2024-04-18T21:06:53.783 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023864586, 2024-04-18T21:06:53.783 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:53.783 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:53.783 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:53.783 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:53.783 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:53.783 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:53.783 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 164 2024-04-18T21:06:53.783 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.783 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:53.783 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.783 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:53.783 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:53.783 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:53.783 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.784 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.784 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:53.784 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:53.784 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:53.784 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.784 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.784 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:53.784 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028795+0000", 2024-04-18T21:06:53.784 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7999999999999995e-07 2024-04-18T21:06:53.784 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.784 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.784 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:53.784 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028884+0000", 2024-04-18T21:06:53.784 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8997000000000002e-05 2024-04-18T21:06:53.784 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.785 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.785 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:53.785 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028895+0000", 2024-04-18T21:06:53.785 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1647e-05 2024-04-18T21:06:53.785 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.785 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.785 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:53.785 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028903+0000", 2024-04-18T21:06:53.785 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.909e-06 2024-04-18T21:06:53.785 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.785 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.785 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:53.785 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.047818+0000", 2024-04-18T21:06:53.786 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018914337 2024-04-18T21:06:53.786 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.786 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.786 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:53.786 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.048094+0000", 2024-04-18T21:06:53.786 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00027653500000000001 2024-04-18T21:06:53.786 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.786 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.786 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:53.786 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.048471+0000", 2024-04-18T21:06:53.786 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00037705799999999999 2024-04-18T21:06:53.786 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.786 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.786 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:53.786 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052516+0000", 2024-04-18T21:06:53.787 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0040452739999999997 2024-04-18T21:06:53.787 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.787 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.787 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:53.787 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052535+0000", 2024-04-18T21:06:53.787 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.84e-05 2024-04-18T21:06:53.787 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.787 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.787 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:53.787 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052603+0000", 2024-04-18T21:06:53.787 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.8095000000000004e-05 2024-04-18T21:06:53.787 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.787 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.787 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:53.787 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052659+0000", 2024-04-18T21:06:53.787 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5653999999999999e-05 2024-04-18T21:06:53.788 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:53.788 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:53.788 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:53.788 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.788 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.788 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:53.788 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:53.788 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 118.740855479, 2024-04-18T21:06:53.788 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024516458000000001, 2024-04-18T21:06:53.788 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:53.788 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:53.788 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:53.788 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:53.788 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:53.788 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:53.789 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 165 2024-04-18T21:06:53.789 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.789 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:53.789 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.789 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:53.789 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:53.789 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:53.789 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.789 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.789 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:53.789 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:53.789 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:53.789 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.789 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.789 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:53.790 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028918+0000", 2024-04-18T21:06:53.790 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8000000000000005e-07 2024-04-18T21:06:53.790 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.790 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.790 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:53.790 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028924+0000", 2024-04-18T21:06:53.790 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5659999999999997e-06 2024-04-18T21:06:53.790 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.790 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.790 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:53.790 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028933+0000", 2024-04-18T21:06:53.790 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.38e-06 2024-04-18T21:06:53.790 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.790 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.790 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:53.791 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028940+0000", 2024-04-18T21:06:53.791 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0060000000000003e-06 2024-04-18T21:06:53.791 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.791 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.791 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:53.791 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.050846+0000", 2024-04-18T21:06:53.791 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021906119000000002 2024-04-18T21:06:53.791 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.791 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.791 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:53.791 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051025+0000", 2024-04-18T21:06:53.791 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017850799999999999 2024-04-18T21:06:53.791 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.791 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.791 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:53.792 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051221+0000", 2024-04-18T21:06:53.792 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019608700000000001 2024-04-18T21:06:53.792 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.792 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.792 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:53.792 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052675+0000", 2024-04-18T21:06:53.792 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0014537899999999999 2024-04-18T21:06:53.792 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.792 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.792 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:53.792 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053311+0000", 2024-04-18T21:06:53.792 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00063613299999999999 2024-04-18T21:06:53.792 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.792 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.792 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:53.792 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053381+0000", 2024-04-18T21:06:53.792 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0074999999999996e-05 2024-04-18T21:06:53.793 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.793 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.793 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:53.793 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053434+0000", 2024-04-18T21:06:53.793 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3013999999999998e-05 2024-04-18T21:06:53.793 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:53.793 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:53.793 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:53.793 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.793 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.793 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:53.793 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:53.793 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 118.62755, 2024-04-18T21:06:53.793 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023772793, 2024-04-18T21:06:53.793 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:53.793 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:53.794 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:53.794 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:53.794 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:53.794 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:53.794 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 187 2024-04-18T21:06:53.794 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.794 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:53.794 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.794 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:53.794 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:53.794 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:53.794 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.794 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.795 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:53.795 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:53.795 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:53.795 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.795 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.795 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:53.795 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142224+0000", 2024-04-18T21:06:53.795 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.47e-07 2024-04-18T21:06:53.795 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.795 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.795 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:53.795 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142233+0000", 2024-04-18T21:06:53.795 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0729999999999994e-06 2024-04-18T21:06:53.796 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.796 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.796 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:53.796 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142255+0000", 2024-04-18T21:06:53.796 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.2535999999999999e-05 2024-04-18T21:06:53.796 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.796 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.796 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:53.796 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142268+0000", 2024-04-18T21:06:53.796 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2686e-05 2024-04-18T21:06:53.796 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.796 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.796 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:53.796 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160497+0000", 2024-04-18T21:06:53.796 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018228779000000001 2024-04-18T21:06:53.797 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.797 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.797 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:53.797 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160634+0000", 2024-04-18T21:06:53.797 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000137315 2024-04-18T21:06:53.797 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.797 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.797 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:53.797 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160831+0000", 2024-04-18T21:06:53.797 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019683100000000001 2024-04-18T21:06:53.797 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.797 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.797 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:53.797 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165129+0000", 2024-04-18T21:06:53.797 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0042981299999999998 2024-04-18T21:06:53.798 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.798 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.798 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:53.798 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165776+0000", 2024-04-18T21:06:53.798 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00064702900000000003 2024-04-18T21:06:53.798 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.798 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.798 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:53.798 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165921+0000", 2024-04-18T21:06:53.798 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014506 2024-04-18T21:06:53.798 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.798 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.798 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:53.798 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165996+0000", 2024-04-18T21:06:53.799 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.4406999999999994e-05 2024-04-18T21:06:53.799 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:53.799 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:53.799 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:53.799 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.799 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.799 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:53.799 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:53.799 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 118.62748940199999, 2024-04-18T21:06:53.799 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026802157, 2024-04-18T21:06:53.799 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:53.799 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:53.799 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:53.799 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:53.799 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:53.800 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:53.800 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 188 2024-04-18T21:06:53.800 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.800 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:53.800 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.800 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:53.800 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:53.800 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:53.800 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.800 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.800 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:53.800 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:53.800 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:53.800 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.800 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.801 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:53.801 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142284+0000", 2024-04-18T21:06:53.801 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4e-07 2024-04-18T21:06:53.801 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.801 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.801 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:53.801 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142374+0000", 2024-04-18T21:06:53.801 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0099999999999995e-05 2024-04-18T21:06:53.801 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.801 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.801 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:53.801 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142386+0000", 2024-04-18T21:06:53.801 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1770000000000001e-05 2024-04-18T21:06:53.801 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.801 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.801 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:53.802 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142394+0000", 2024-04-18T21:06:53.802 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.2130000000000008e-06 2024-04-18T21:06:53.802 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.802 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.802 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:53.802 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.161743+0000", 2024-04-18T21:06:53.802 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019348644000000002 2024-04-18T21:06:53.802 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.802 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.802 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:53.802 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.161865+0000", 2024-04-18T21:06:53.802 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012210899999999999 2024-04-18T21:06:53.802 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.802 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.802 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:53.802 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.162055+0000", 2024-04-18T21:06:53.803 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000189994 2024-04-18T21:06:53.803 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.803 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.803 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:53.803 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165735+0000", 2024-04-18T21:06:53.803 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0036803270000000002 2024-04-18T21:06:53.803 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.803 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.803 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:53.803 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.168911+0000", 2024-04-18T21:06:53.803 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0031753689999999999 2024-04-18T21:06:53.803 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.803 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.803 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:53.803 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169012+0000", 2024-04-18T21:06:53.804 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010157699999999999 2024-04-18T21:06:53.804 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.804 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.804 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:53.804 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169086+0000", 2024-04-18T21:06:53.804 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3213999999999994e-05 2024-04-18T21:06:53.804 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:53.804 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:53.804 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:53.804 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.804 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.804 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:53.804 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:53.804 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 118.62736409599999, 2024-04-18T21:06:53.804 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026811423000000001, 2024-04-18T21:06:53.805 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:53.805 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:53.805 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:53.805 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:53.805 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:53.805 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:53.805 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 189 2024-04-18T21:06:53.805 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.805 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:53.805 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.805 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:53.805 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:53.805 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:53.805 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.805 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.805 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:53.806 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:53.806 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:53.806 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.806 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.806 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:53.806 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142410+0000", 2024-04-18T21:06:53.806 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:06:53.806 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.806 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.806 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:53.806 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142415+0000", 2024-04-18T21:06:53.806 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.7939999999999999e-06 2024-04-18T21:06:53.806 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.807 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.807 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:53.807 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142470+0000", 2024-04-18T21:06:53.807 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4537999999999999e-05 2024-04-18T21:06:53.807 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.807 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.807 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:53.807 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142481+0000", 2024-04-18T21:06:53.807 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0966e-05 2024-04-18T21:06:53.807 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.807 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.807 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:53.807 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.163493+0000", 2024-04-18T21:06:53.807 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021012444000000002 2024-04-18T21:06:53.808 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.808 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.808 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:53.808 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.163727+0000", 2024-04-18T21:06:53.808 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000233339 2024-04-18T21:06:53.808 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.808 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.808 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:53.808 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.164102+0000", 2024-04-18T21:06:53.808 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000374872 2024-04-18T21:06:53.808 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.808 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.808 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:53.808 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.166528+0000", 2024-04-18T21:06:53.809 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0024258729999999998 2024-04-18T21:06:53.809 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.809 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.809 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:53.809 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169101+0000", 2024-04-18T21:06:53.809 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0025737680000000001 2024-04-18T21:06:53.809 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.809 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.809 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:53.809 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169171+0000", 2024-04-18T21:06:53.809 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0148000000000007e-05 2024-04-18T21:06:53.809 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.809 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.809 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:53.810 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169220+0000", 2024-04-18T21:06:53.810 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8767999999999998e-05 2024-04-18T21:06:53.810 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:53.810 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:53.810 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:53.810 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.810 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.810 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:53.810 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:53.810 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 108.153791544, 2024-04-18T21:06:53.810 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024082777999999999, 2024-04-18T21:06:53.810 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:53.810 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:53.811 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:53.811 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:53.811 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.811 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:53.811 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:53.811 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:53.811 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.811 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.811 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:53.811 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:53.811 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:53.811 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.811 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.811 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:53.811 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615984+0000", 2024-04-18T21:06:53.812 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.9869999999999999e-06 2024-04-18T21:06:53.812 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.812 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.812 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:53.812 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615999+0000", 2024-04-18T21:06:53.812 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4646e-05 2024-04-18T21:06:53.812 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.812 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.812 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:53.812 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616028+0000", 2024-04-18T21:06:53.812 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8952999999999999e-05 2024-04-18T21:06:53.812 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.812 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.812 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:53.813 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616052+0000", 2024-04-18T21:06:53.813 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.3941999999999999e-05 2024-04-18T21:06:53.813 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.813 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.813 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:53.813 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618010+0000", 2024-04-18T21:06:53.813 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0019581780000000001 2024-04-18T21:06:53.813 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.813 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.813 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:53.813 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618322+0000", 2024-04-18T21:06:53.813 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00031158899999999997 2024-04-18T21:06:53.813 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.814 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.814 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:53.814 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618587+0000", 2024-04-18T21:06:53.814 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00026495700000000002 2024-04-18T21:06:53.814 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.814 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.814 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:53.814 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629262+0000", 2024-04-18T21:06:53.814 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010675877 2024-04-18T21:06:53.814 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.814 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.814 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:53.815 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.639773+0000", 2024-04-18T21:06:53.815 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0105109 2024-04-18T21:06:53.815 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.815 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.815 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:53.815 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.639926+0000", 2024-04-18T21:06:53.815 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000152349 2024-04-18T21:06:53.815 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.815 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.815 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:53.815 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640064+0000", 2024-04-18T21:06:53.815 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0001384 2024-04-18T21:06:53.815 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:53.816 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:53.816 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:53.816 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.816 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.816 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:53.816 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:53.816 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 108.15367886999999, 2024-04-18T21:06:53.816 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030215005999999999, 2024-04-18T21:06:53.816 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:53.816 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:53.816 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:53.816 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:53.816 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.816 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:53.816 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:53.817 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:53.817 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.817 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.817 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:53.817 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:53.817 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:53.817 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.817 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.817 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:53.817 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616095+0000", 2024-04-18T21:06:53.817 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.446e-06 2024-04-18T21:06:53.817 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.817 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.818 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:53.818 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616104+0000", 2024-04-18T21:06:53.818 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6200000000000005e-06 2024-04-18T21:06:53.818 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.818 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.818 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:53.818 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616132+0000", 2024-04-18T21:06:53.818 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7668999999999999e-05 2024-04-18T21:06:53.818 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.818 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.818 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:53.818 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616149+0000", 2024-04-18T21:06:53.818 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7047000000000001e-05 2024-04-18T21:06:53.818 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.819 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.819 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:53.819 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619287+0000", 2024-04-18T21:06:53.819 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0031381450000000002 2024-04-18T21:06:53.819 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.819 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.819 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:53.819 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619503+0000", 2024-04-18T21:06:53.819 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000216522 2024-04-18T21:06:53.819 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.819 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.819 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:53.819 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619930+0000", 2024-04-18T21:06:53.819 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00042604900000000001 2024-04-18T21:06:53.819 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.819 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.820 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:53.820 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629281+0000", 2024-04-18T21:06:53.820 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0093512230000000005 2024-04-18T21:06:53.820 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.820 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.820 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:53.820 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646022+0000", 2024-04-18T21:06:53.820 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016741156 2024-04-18T21:06:53.820 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.820 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.820 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:53.820 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646198+0000", 2024-04-18T21:06:53.820 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000176009 2024-04-18T21:06:53.820 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.820 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.821 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:53.821 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646309+0000", 2024-04-18T21:06:53.821 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011112000000000001 2024-04-18T21:06:53.821 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:53.821 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:53.821 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:53.821 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.821 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.821 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:53.821 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:53.821 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 108.15359404599999, 2024-04-18T21:06:53.821 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030501176000000001, 2024-04-18T21:06:53.821 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:53.821 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:53.821 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:53.821 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:53.822 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.822 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:53.822 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:53.822 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:53.822 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.822 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.822 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:53.822 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:53.822 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:53.822 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.822 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.822 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:53.822 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616180+0000", 2024-04-18T21:06:53.822 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1000000000000001e-06 2024-04-18T21:06:53.822 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.823 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.823 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:53.823 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616188+0000", 2024-04-18T21:06:53.823 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4069999999999993e-06 2024-04-18T21:06:53.823 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.823 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.823 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:53.823 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616207+0000", 2024-04-18T21:06:53.823 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8335999999999999e-05 2024-04-18T21:06:53.823 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.823 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.823 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:53.824 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616225+0000", 2024-04-18T21:06:53.824 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8652999999999999e-05 2024-04-18T21:06:53.824 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.824 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.824 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:53.824 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620977+0000", 2024-04-18T21:06:53.824 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047512220000000003 2024-04-18T21:06:53.824 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.824 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.824 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:53.824 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621279+0000", 2024-04-18T21:06:53.824 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000302646 2024-04-18T21:06:53.825 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.825 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.825 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:53.825 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621584+0000", 2024-04-18T21:06:53.825 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000305142 2024-04-18T21:06:53.825 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.825 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.825 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:53.825 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629352+0000", 2024-04-18T21:06:53.825 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0077673689999999997 2024-04-18T21:06:53.825 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.825 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.825 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:53.826 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646480+0000", 2024-04-18T21:06:53.826 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017128259 2024-04-18T21:06:53.826 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.826 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.826 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:53.826 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646591+0000", 2024-04-18T21:06:53.826 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011113899999999999 2024-04-18T21:06:53.826 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.826 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.826 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:53.826 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646680+0000", 2024-04-18T21:06:53.826 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8902999999999999e-05 2024-04-18T21:06:53.826 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:53.827 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:53.827 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:53.827 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.827 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.827 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:53.827 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:53.827 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 108.153527547, 2024-04-18T21:06:53.827 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030779760999999999, 2024-04-18T21:06:53.827 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:53.827 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:53.827 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:53.827 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:53.827 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.827 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:53.827 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:53.827 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:53.828 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.828 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.828 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:53.828 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:53.828 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:53.828 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.828 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.828 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:53.828 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616246+0000", 2024-04-18T21:06:53.828 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0499999999999999e-06 2024-04-18T21:06:53.828 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.828 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.828 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:53.829 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616253+0000", 2024-04-18T21:06:53.829 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.5989999999999998e-06 2024-04-18T21:06:53.829 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.829 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.829 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:53.829 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616273+0000", 2024-04-18T21:06:53.829 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9916999999999999e-05 2024-04-18T21:06:53.829 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.829 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.829 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:53.829 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616287+0000", 2024-04-18T21:06:53.829 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3669000000000001e-05 2024-04-18T21:06:53.829 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.830 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.830 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:53.830 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622203+0000", 2024-04-18T21:06:53.830 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.005916737 2024-04-18T21:06:53.830 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.830 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.830 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:53.830 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622379+0000", 2024-04-18T21:06:53.830 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000175596 2024-04-18T21:06:53.830 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.830 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.830 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:53.830 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622707+0000", 2024-04-18T21:06:53.831 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00032784600000000002 2024-04-18T21:06:53.831 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.831 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.831 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:53.831 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629366+0000", 2024-04-18T21:06:53.831 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0066593279999999999 2024-04-18T21:06:53.831 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.831 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.831 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:53.831 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646813+0000", 2024-04-18T21:06:53.831 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017447059000000001 2024-04-18T21:06:53.831 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.831 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.831 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:53.831 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646946+0000", 2024-04-18T21:06:53.831 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013301200000000001 2024-04-18T21:06:53.832 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.832 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.832 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:53.832 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647025+0000", 2024-04-18T21:06:53.832 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8948000000000004e-05 2024-04-18T21:06:53.832 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:53.832 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:53.832 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:53.832 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.832 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.832 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:53.832 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:53.832 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 108.153443729, 2024-04-18T21:06:53.832 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.031512165000000002, 2024-04-18T21:06:53.833 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:53.833 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:53.833 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:53.833 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:53.833 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.833 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:53.833 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:53.833 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:53.833 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.833 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.833 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:53.833 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:53.834 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:53.834 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.834 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.834 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:53.834 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616330+0000", 2024-04-18T21:06:53.834 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.15e-06 2024-04-18T21:06:53.834 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.834 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.834 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:53.834 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616337+0000", 2024-04-18T21:06:53.834 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.1289999999999998e-06 2024-04-18T21:06:53.834 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.834 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.834 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:53.835 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616447+0000", 2024-04-18T21:06:53.835 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109561 2024-04-18T21:06:53.835 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.835 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.835 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:53.835 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616496+0000", 2024-04-18T21:06:53.835 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8591999999999998e-05 2024-04-18T21:06:53.835 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.835 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.835 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:53.835 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.623786+0000", 2024-04-18T21:06:53.835 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0072906799999999999 2024-04-18T21:06:53.835 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.835 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.835 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:53.835 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.623973+0000", 2024-04-18T21:06:53.836 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018717199999999999 2024-04-18T21:06:53.836 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.836 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.836 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:53.836 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624260+0000", 2024-04-18T21:06:53.836 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00028630600000000001 2024-04-18T21:06:53.836 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.836 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.836 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:53.836 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629381+0000", 2024-04-18T21:06:53.836 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0051211340000000003 2024-04-18T21:06:53.836 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.836 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.837 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:53.837 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647631+0000", 2024-04-18T21:06:53.837 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018249771000000001 2024-04-18T21:06:53.837 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.837 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.837 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:53.837 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647761+0000", 2024-04-18T21:06:53.837 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013037300000000001 2024-04-18T21:06:53.837 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.837 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.837 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:53.837 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647841+0000", 2024-04-18T21:06:53.837 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.0296999999999994e-05 2024-04-18T21:06:53.837 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:53.837 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:53.838 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:53.838 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.838 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.838 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:53.838 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:53.838 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 108.153238245, 2024-04-18T21:06:53.838 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043251955000000002, 2024-04-18T21:06:53.838 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:53.838 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:53.838 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:53.838 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:53.838 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.839 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:53.839 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:53.839 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:53.839 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.839 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.839 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:53.839 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:53.839 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:53.839 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.839 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.839 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:53.839 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616536+0000", 2024-04-18T21:06:53.840 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2869999999999999e-06 2024-04-18T21:06:53.840 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.840 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.840 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:53.840 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616572+0000", 2024-04-18T21:06:53.840 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.6261999999999999e-05 2024-04-18T21:06:53.840 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.840 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.840 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:53.840 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616593+0000", 2024-04-18T21:06:53.840 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1310000000000001e-05 2024-04-18T21:06:53.840 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.840 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.841 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:53.841 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616614+0000", 2024-04-18T21:06:53.841 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.0936000000000001e-05 2024-04-18T21:06:53.841 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.841 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.841 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:53.841 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629501+0000", 2024-04-18T21:06:53.841 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.012886819000000001 2024-04-18T21:06:53.841 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.841 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.841 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:53.841 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629696+0000", 2024-04-18T21:06:53.841 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019485499999999999 2024-04-18T21:06:53.841 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.842 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.842 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:53.842 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629940+0000", 2024-04-18T21:06:53.842 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00024386399999999999 2024-04-18T21:06:53.842 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.842 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.842 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:53.842 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640100+0000", 2024-04-18T21:06:53.842 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010159645 2024-04-18T21:06:53.842 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.842 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.842 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:53.843 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659516+0000", 2024-04-18T21:06:53.843 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019416563000000001 2024-04-18T21:06:53.843 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.843 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.843 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:53.843 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659684+0000", 2024-04-18T21:06:53.843 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016750900000000001 2024-04-18T21:06:53.843 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.843 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.843 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:53.843 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659787+0000", 2024-04-18T21:06:53.843 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000102905 2024-04-18T21:06:53.843 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:53.844 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:53.844 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:53.844 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.844 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.844 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:53.844 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:53.844 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 108.153133123, 2024-04-18T21:06:53.844 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043581898000000001, 2024-04-18T21:06:53.844 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:53.844 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:53.844 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:53.844 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:53.844 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.844 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:53.844 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:53.845 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:53.845 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.845 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.845 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:53.845 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:53.845 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:53.845 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.845 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.845 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:53.845 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616641+0000", 2024-04-18T21:06:53.845 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:06:53.845 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.845 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.846 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:53.846 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616648+0000", 2024-04-18T21:06:53.846 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3860000000000001e-06 2024-04-18T21:06:53.846 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.846 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.846 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:53.846 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616666+0000", 2024-04-18T21:06:53.846 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7583000000000001e-05 2024-04-18T21:06:53.846 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.846 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.846 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:53.846 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616679+0000", 2024-04-18T21:06:53.847 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3322999999999999e-05 2024-04-18T21:06:53.847 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.847 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.847 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:53.847 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630373+0000", 2024-04-18T21:06:53.847 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013694207999999999 2024-04-18T21:06:53.847 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.847 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.847 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:53.847 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630545+0000", 2024-04-18T21:06:53.847 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000171683 2024-04-18T21:06:53.847 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.847 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.848 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:53.848 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630728+0000", 2024-04-18T21:06:53.848 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000182599 2024-04-18T21:06:53.848 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.848 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.848 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:53.848 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640600+0000", 2024-04-18T21:06:53.848 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0098726119999999994 2024-04-18T21:06:53.848 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.848 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.848 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:53.848 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659927+0000", 2024-04-18T21:06:53.849 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019326724999999999 2024-04-18T21:06:53.849 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.849 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.849 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:53.849 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660112+0000", 2024-04-18T21:06:53.849 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000185203 2024-04-18T21:06:53.849 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.849 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.849 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:53.849 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660222+0000", 2024-04-18T21:06:53.849 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109343 2024-04-18T21:06:53.850 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:53.850 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:53.850 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:53.850 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.850 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.850 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:53.850 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:53.850 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 108.152267765, 2024-04-18T21:06:53.850 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043121310000000003, 2024-04-18T21:06:53.850 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:53.851 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:53.851 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:53.851 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:53.851 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.851 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:53.851 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:53.851 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:53.851 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.851 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.851 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:53.851 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:53.851 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:53.852 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.852 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.852 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:53.852 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617506+0000", 2024-04-18T21:06:53.852 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9999999999999995e-07 2024-04-18T21:06:53.852 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.852 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.852 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:53.852 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617513+0000", 2024-04-18T21:06:53.852 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.9700000000000002e-06 2024-04-18T21:06:53.852 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.853 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.853 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:53.853 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617531+0000", 2024-04-18T21:06:53.853 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8105999999999999e-05 2024-04-18T21:06:53.853 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.853 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.853 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:53.853 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617545+0000", 2024-04-18T21:06:53.853 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3703000000000001e-05 2024-04-18T21:06:53.853 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.853 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.853 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:53.854 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632129+0000", 2024-04-18T21:06:53.854 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.014584135999999999 2024-04-18T21:06:53.854 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.854 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.854 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:53.854 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632361+0000", 2024-04-18T21:06:53.854 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023171800000000001 2024-04-18T21:06:53.854 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.854 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.854 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:53.854 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632804+0000", 2024-04-18T21:06:53.855 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000443549 2024-04-18T21:06:53.855 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.855 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.855 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:53.855 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646340+0000", 2024-04-18T21:06:53.855 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013535902000000001 2024-04-18T21:06:53.855 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.855 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.855 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:53.855 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660363+0000", 2024-04-18T21:06:53.855 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01402318 2024-04-18T21:06:53.855 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.856 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.856 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:53.856 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660523+0000", 2024-04-18T21:06:53.856 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00015989899999999999 2024-04-18T21:06:53.856 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.856 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.856 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:53.856 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660626+0000", 2024-04-18T21:06:53.856 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010314699999999999 2024-04-18T21:06:53.856 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:53.856 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:53.856 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:53.856 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.857 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.857 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:53.857 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:53.857 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 108.152128072, 2024-04-18T21:06:53.857 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024927483, 2024-04-18T21:06:53.857 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:53.857 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:53.857 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:53.857 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:53.857 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.857 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:53.857 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:53.858 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:53.858 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.858 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.858 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:53.858 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:53.858 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:53.858 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.858 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.858 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:53.858 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617646+0000", 2024-04-18T21:06:53.858 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3030000000000001e-06 2024-04-18T21:06:53.858 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.858 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.859 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:53.859 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617653+0000", 2024-04-18T21:06:53.859 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7530000000000004e-06 2024-04-18T21:06:53.859 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.859 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.859 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:53.859 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617673+0000", 2024-04-18T21:06:53.859 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9967e-05 2024-04-18T21:06:53.859 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.859 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.859 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:53.859 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617688+0000", 2024-04-18T21:06:53.859 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5153e-05 2024-04-18T21:06:53.859 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.860 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.860 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:53.860 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619244+0000", 2024-04-18T21:06:53.860 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001555531 2024-04-18T21:06:53.860 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.860 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.860 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:53.860 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619361+0000", 2024-04-18T21:06:53.860 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011784400000000001 2024-04-18T21:06:53.860 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.860 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.860 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:53.860 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619604+0000", 2024-04-18T21:06:53.860 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000243007 2024-04-18T21:06:53.861 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.861 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.861 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:53.861 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.625480+0000", 2024-04-18T21:06:53.861 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0058759349999999997 2024-04-18T21:06:53.861 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.861 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.861 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:53.861 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642342+0000", 2024-04-18T21:06:53.861 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016861373999999998 2024-04-18T21:06:53.861 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.861 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.861 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:53.861 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642484+0000", 2024-04-18T21:06:53.862 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000142423 2024-04-18T21:06:53.862 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.862 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.862 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:53.862 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642572+0000", 2024-04-18T21:06:53.862 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8193000000000001e-05 2024-04-18T21:06:53.862 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:53.862 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:53.862 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:53.862 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.862 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.862 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:53.862 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:53.863 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 108.151846569, 2024-04-18T21:06:53.863 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024956974999999999, 2024-04-18T21:06:53.863 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:53.863 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:53.863 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:53.863 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:53.863 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.863 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:53.863 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:53.863 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:53.863 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.863 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.863 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:53.863 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:53.863 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:53.864 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.864 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.864 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:53.864 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617928+0000", 2024-04-18T21:06:53.864 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5430000000000001e-06 2024-04-18T21:06:53.864 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.864 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.864 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:53.864 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617937+0000", 2024-04-18T21:06:53.864 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6629999999999999e-06 2024-04-18T21:06:53.864 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.864 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.864 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:53.865 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617955+0000", 2024-04-18T21:06:53.865 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8749999999999998e-05 2024-04-18T21:06:53.865 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.865 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.865 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:53.865 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617971+0000", 2024-04-18T21:06:53.865 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.605e-05 2024-04-18T21:06:53.865 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.865 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.865 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:53.865 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621019+0000", 2024-04-18T21:06:53.865 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0030472369999999999 2024-04-18T21:06:53.865 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.865 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.866 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:53.866 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621249+0000", 2024-04-18T21:06:53.866 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000230075 2024-04-18T21:06:53.866 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.866 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.866 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:53.866 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621450+0000", 2024-04-18T21:06:53.866 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020166499999999999 2024-04-18T21:06:53.866 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.866 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.866 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:53.866 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.626233+0000", 2024-04-18T21:06:53.866 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047827390000000003 2024-04-18T21:06:53.866 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.867 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.867 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:53.867 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642693+0000", 2024-04-18T21:06:53.867 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01645961 2024-04-18T21:06:53.867 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.867 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.867 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:53.867 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642798+0000", 2024-04-18T21:06:53.867 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010559499999999999 2024-04-18T21:06:53.867 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.867 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.867 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:53.867 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642883+0000", 2024-04-18T21:06:53.867 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5048000000000003e-05 2024-04-18T21:06:53.868 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:53.868 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:53.868 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:53.868 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.868 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.868 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:53.868 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:53.868 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 108.15015094100001, 2024-04-18T21:06:53.868 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024086478000000001, 2024-04-18T21:06:53.868 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:53.868 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:53.868 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:53.869 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:53.869 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.869 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:53.869 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:53.869 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:53.869 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.869 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.869 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:53.869 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:53.869 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:53.869 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.869 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.869 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:53.869 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619624+0000", 2024-04-18T21:06:53.870 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.75e-06 2024-04-18T21:06:53.870 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.870 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.870 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:53.870 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619637+0000", 2024-04-18T21:06:53.870 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3540000000000001e-05 2024-04-18T21:06:53.870 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.870 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.870 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:53.870 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619666+0000", 2024-04-18T21:06:53.870 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8685999999999999e-05 2024-04-18T21:06:53.870 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.870 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.870 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:53.871 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619685+0000", 2024-04-18T21:06:53.871 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8681999999999998e-05 2024-04-18T21:06:53.871 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.871 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.871 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:53.871 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622275+0000", 2024-04-18T21:06:53.871 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0025899260000000002 2024-04-18T21:06:53.871 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.871 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.871 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:53.871 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622572+0000", 2024-04-18T21:06:53.871 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00029722 2024-04-18T21:06:53.871 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.872 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.872 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:53.872 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622752+0000", 2024-04-18T21:06:53.872 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018065900000000001 2024-04-18T21:06:53.872 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.872 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.872 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:53.872 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.626326+0000", 2024-04-18T21:06:53.872 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035737310000000001 2024-04-18T21:06:53.872 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.872 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.872 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:53.873 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643565+0000", 2024-04-18T21:06:53.873 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017238430999999999 2024-04-18T21:06:53.873 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.873 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.873 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:53.873 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643646+0000", 2024-04-18T21:06:53.873 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.1481000000000001e-05 2024-04-18T21:06:53.873 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.873 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.873 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:53.873 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643708+0000", 2024-04-18T21:06:53.873 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.2372000000000005e-05 2024-04-18T21:06:53.873 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:53.873 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:53.874 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:53.874 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.874 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.874 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:53.874 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:53.874 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 108.149984788, 2024-04-18T21:06:53.874 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026822450000000001, 2024-04-18T21:06:53.874 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:53.874 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:53.874 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:53.874 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:53.875 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.875 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:53.875 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:53.875 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:53.875 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.875 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.875 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:53.875 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:53.875 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:53.875 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.875 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.875 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:53.876 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619789+0000", 2024-04-18T21:06:53.876 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:06:53.876 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.876 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.876 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:53.876 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619797+0000", 2024-04-18T21:06:53.876 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.6899999999999992e-06 2024-04-18T21:06:53.876 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.876 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.876 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:53.876 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619816+0000", 2024-04-18T21:06:53.876 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9352999999999999e-05 2024-04-18T21:06:53.876 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.877 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.877 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:53.877 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619832+0000", 2024-04-18T21:06:53.877 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6013000000000001e-05 2024-04-18T21:06:53.877 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.877 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.877 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:53.877 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620528+0000", 2024-04-18T21:06:53.877 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00069565600000000001 2024-04-18T21:06:53.877 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.877 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.877 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:53.878 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620735+0000", 2024-04-18T21:06:53.878 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000207025 2024-04-18T21:06:53.878 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.878 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.878 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:53.878 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620912+0000", 2024-04-18T21:06:53.878 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017748199999999999 2024-04-18T21:06:53.878 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.878 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.878 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:53.878 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.625605+0000", 2024-04-18T21:06:53.879 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0046924439999999996 2024-04-18T21:06:53.879 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.879 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.879 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:53.879 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646349+0000", 2024-04-18T21:06:53.879 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.020744318000000001 2024-04-18T21:06:53.879 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.879 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.879 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:53.879 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646483+0000", 2024-04-18T21:06:53.879 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013428999999999999 2024-04-18T21:06:53.879 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.880 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.880 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:53.880 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646611+0000", 2024-04-18T21:06:53.880 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012710299999999999 2024-04-18T21:06:53.880 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:53.880 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:53.880 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:53.880 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.880 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.880 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:53.880 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:06:53.880 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 108.149314355, 2024-04-18T21:06:53.880 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023516516000000001, 2024-04-18T21:06:53.880 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:53.881 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:53.881 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:06:53.881 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:53.881 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.881 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:53.881 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:06:53.881 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:53.881 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.881 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.881 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:53.881 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620459+0000", 2024-04-18T21:06:53.881 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:53.882 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.882 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.882 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:53.882 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620460+0000", 2024-04-18T21:06:53.882 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.787e-06 2024-04-18T21:06:53.882 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.882 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.882 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:53.882 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620470+0000", 2024-04-18T21:06:53.882 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.2560000000000008e-06 2024-04-18T21:06:53.882 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.882 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.882 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:53.882 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620496+0000", 2024-04-18T21:06:53.883 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.6205999999999999e-05 2024-04-18T21:06:53.883 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.883 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.883 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:53.883 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620517+0000", 2024-04-18T21:06:53.883 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1223e-05 2024-04-18T21:06:53.883 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.883 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.883 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:53.883 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624060+0000", 2024-04-18T21:06:53.883 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035434160000000002 2024-04-18T21:06:53.883 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.883 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.883 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:53.883 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624390+0000", 2024-04-18T21:06:53.883 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00033000500000000002 2024-04-18T21:06:53.884 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:53.884 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:53.884 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:53.884 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643975+0000", 2024-04-18T21:06:53.884 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019584622999999999 2024-04-18T21:06:53.884 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:53.884 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:53.884 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:53.884 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:53.884 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:53.884 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:53.886 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:53.886 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:53.882+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:53.987 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:53.986+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:54.016 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:54.016 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:06:54.016 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-04-18T21:06:54.017 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:54.031 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:54.042 INFO:tasks.workunit.client.0.smithi078.stderr:++ readlink -f fsstress 2024-04-18T21:06:54.043 INFO:tasks.workunit.client.0.smithi078.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-18T21:06:54.043 INFO:tasks.workunit.client.0.smithi078.stderr:+ popd 2024-04-18T21:06:54.044 INFO:tasks.workunit.client.0.smithi078.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-18T21:06:54.045 INFO:tasks.workunit.client.0.smithi078.stderr:+ popd 2024-04-18T21:06:54.045 INFO:tasks.workunit.client.0.smithi078.stdout:~/cephtest/mnt.0/client.0/tmp 2024-04-18T21:06:54.045 INFO:tasks.workunit.client.0.smithi078.stderr:++ mktemp -d -p . 2024-04-18T21:06:54.047 INFO:tasks.workunit.client.0.smithi078.stderr:+ T=./tmp.FPBw8XtMy8 2024-04-18T21:06:54.047 INFO:tasks.workunit.client.0.smithi078.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.FPBw8XtMy8 -l 1 -n 1000 -p 10 -v 2024-04-18T21:06:54.049 INFO:tasks.workunit.client.0.smithi078.stdout:seed = 1713462110 2024-04-18T21:06:54.050 INFO:tasks.workunit.client.0.smithi078.stdout:0/0: truncate - no filename 2024-04-18T21:06:54.050 INFO:tasks.workunit.client.0.smithi078.stdout:0/1: truncate - no filename 2024-04-18T21:06:54.050 INFO:tasks.workunit.client.0.smithi078.stdout:0/2: truncate - no filename 2024-04-18T21:06:54.050 INFO:tasks.workunit.client.0.smithi078.stdout:0/3: rename - no filename 2024-04-18T21:06:54.050 INFO:tasks.workunit.client.0.smithi078.stdout:0/4: mkdir d0 0 2024-04-18T21:06:54.052 INFO:tasks.workunit.client.0.smithi078.stdout:0/5: rename d0 to d0/d1 22 2024-04-18T21:06:54.052 INFO:tasks.workunit.client.0.smithi078.stdout:0/6: dread - no filename 2024-04-18T21:06:54.052 INFO:tasks.workunit.client.0.smithi078.stdout:1/0: write - no filename 2024-04-18T21:06:54.052 INFO:tasks.workunit.client.0.smithi078.stdout:1/1: chown . 693638 1 2024-04-18T21:06:54.052 INFO:tasks.workunit.client.0.smithi078.stdout:1/2: read - no filename 2024-04-18T21:06:54.052 INFO:tasks.workunit.client.0.smithi078.stdout:1/3: read - no filename 2024-04-18T21:06:54.052 INFO:tasks.workunit.client.0.smithi078.stdout:1/4: rmdir - no directory 2024-04-18T21:06:54.052 INFO:tasks.workunit.client.0.smithi078.stdout:1/5: dwrite - no filename 2024-04-18T21:06:54.052 INFO:tasks.workunit.client.0.smithi078.stdout:1/6: fdatasync - no filename 2024-04-18T21:06:54.052 INFO:tasks.workunit.client.0.smithi078.stdout:9/0: creat f0 x:0 0 0 2024-04-18T21:06:54.052 INFO:tasks.workunit.client.0.smithi078.stdout:0/7: chown d0 0 1 2024-04-18T21:06:54.052 INFO:tasks.workunit.client.0.smithi078.stdout:0/8: readlink - no filename 2024-04-18T21:06:54.052 INFO:tasks.workunit.client.0.smithi078.stdout:0/9: dwrite - no filename 2024-04-18T21:06:54.052 INFO:tasks.workunit.client.0.smithi078.stdout:1/7: chown . 88 1 2024-04-18T21:06:54.052 INFO:tasks.workunit.client.0.smithi078.stdout:1/8: link - no file 2024-04-18T21:06:54.053 INFO:tasks.workunit.client.0.smithi078.stdout:1/9: rmdir - no directory 2024-04-18T21:06:54.053 INFO:tasks.workunit.client.0.smithi078.stdout:9/1: chown f0 6 1 2024-04-18T21:06:54.053 INFO:tasks.workunit.client.0.smithi078.stdout:2/0: unlink - no file 2024-04-18T21:06:54.054 INFO:tasks.workunit.client.0.smithi078.stdout:1/10: mkdir d0 0 2024-04-18T21:06:54.054 INFO:tasks.workunit.client.0.smithi078.stdout:1/11: write - no filename 2024-04-18T21:06:54.054 INFO:tasks.workunit.client.0.smithi078.stdout:1/12: link - no file 2024-04-18T21:06:54.054 INFO:tasks.workunit.client.0.smithi078.stdout:0/10: symlink d0/l2 0 2024-04-18T21:06:54.054 INFO:tasks.workunit.client.0.smithi078.stdout:0/11: write - no filename 2024-04-18T21:06:54.054 INFO:tasks.workunit.client.0.smithi078.stdout:0/12: dwrite - no filename 2024-04-18T21:06:54.054 INFO:tasks.workunit.client.0.smithi078.stdout:9/2: mknod c1 0 2024-04-18T21:06:54.054 INFO:tasks.workunit.client.0.smithi078.stdout:9/3: mknod c2 0 2024-04-18T21:06:54.054 INFO:tasks.workunit.client.0.smithi078.stdout:2/1: getdents . 0 2024-04-18T21:06:54.054 INFO:tasks.workunit.client.0.smithi078.stdout:3/0: dread - no filename 2024-04-18T21:06:54.054 INFO:tasks.workunit.client.0.smithi078.stdout:1/13: mkdir d0/d1 0 2024-04-18T21:06:54.054 INFO:tasks.workunit.client.0.smithi078.stdout:1/14: fsync - no filename 2024-04-18T21:06:54.055 INFO:tasks.workunit.client.0.smithi078.stdout:9/4: dread - f0 zero size 2024-04-18T21:06:54.055 INFO:tasks.workunit.client.0.smithi078.stdout:4/0: link - no file 2024-04-18T21:06:54.056 INFO:tasks.workunit.client.0.smithi078.stdout:3/1: creat f0 x:0 0 0 2024-04-18T21:06:54.056 INFO:tasks.workunit.client.0.smithi078.stdout:2/2: mkdir d0 0 2024-04-18T21:06:54.056 INFO:tasks.workunit.client.0.smithi078.stdout:9/5: symlink l3 0 2024-04-18T21:06:54.056 INFO:tasks.workunit.client.0.smithi078.stdout:5/0: dread - no filename 2024-04-18T21:06:54.056 INFO:tasks.workunit.client.0.smithi078.stdout:4/1: mkdir d0 0 2024-04-18T21:06:54.056 INFO:tasks.workunit.client.0.smithi078.stdout:4/2: dread - no filename 2024-04-18T21:06:54.056 INFO:tasks.workunit.client.0.smithi078.stdout:1/15: mknod d0/d1/c2 0 2024-04-18T21:06:54.056 INFO:tasks.workunit.client.0.smithi078.stdout:1/16: dwrite - no filename 2024-04-18T21:06:54.056 INFO:tasks.workunit.client.0.smithi078.stdout:1/17: dread - no filename 2024-04-18T21:06:54.056 INFO:tasks.workunit.client.0.smithi078.stdout:3/2: rename f0 to f1 0 2024-04-18T21:06:54.056 INFO:tasks.workunit.client.0.smithi078.stdout:9/6: rename c2 to c4 0 2024-04-18T21:06:54.056 INFO:tasks.workunit.client.0.smithi078.stdout:1/18: chown d0 10885832 1 2024-04-18T21:06:54.057 INFO:tasks.workunit.client.0.smithi078.stdout:2/3: symlink d0/l1 0 2024-04-18T21:06:54.057 INFO:tasks.workunit.client.0.smithi078.stdout:5/1: getdents . 0 2024-04-18T21:06:54.057 INFO:tasks.workunit.client.0.smithi078.stdout:4/3: symlink d0/l1 0 2024-04-18T21:06:54.057 INFO:tasks.workunit.client.0.smithi078.stdout:9/7: creat f5 x:0 0 0 2024-04-18T21:06:54.057 INFO:tasks.workunit.client.0.smithi078.stdout:4/4: chown d0 1253416738 1 2024-04-18T21:06:54.058 INFO:tasks.workunit.client.0.smithi078.stdout:4/5: dwrite - no filename 2024-04-18T21:06:54.058 INFO:tasks.workunit.client.0.smithi078.stdout:2/4: creat d0/f2 x:0 0 0 2024-04-18T21:06:54.058 INFO:tasks.workunit.client.0.smithi078.stdout:3/3: link f1 f2 0 2024-04-18T21:06:54.058 INFO:tasks.workunit.client.0.smithi078.stdout:6/0: creat f0 x:0 0 0 2024-04-18T21:06:54.058 INFO:tasks.workunit.client.0.smithi078.stdout:4/6: rename d0 to d0/d2 22 2024-04-18T21:06:54.059 INFO:tasks.workunit.client.0.smithi078.stdout:5/2: creat f0 x:0 0 0 2024-04-18T21:06:54.059 INFO:tasks.workunit.client.0.smithi078.stdout:3/4: truncate f2 570253 0 2024-04-18T21:06:54.059 INFO:tasks.workunit.client.0.smithi078.stdout:8/0: mkdir d0 0 2024-04-18T21:06:54.060 INFO:tasks.workunit.client.0.smithi078.stdout:2/5: unlink d0/l1 0 2024-04-18T21:06:54.060 INFO:tasks.workunit.client.0.smithi078.stdout:4/7: unlink d0/l1 0 2024-04-18T21:06:54.060 INFO:tasks.workunit.client.0.smithi078.stdout:7/0: creat f0 x:0 0 0 2024-04-18T21:06:54.060 INFO:tasks.workunit.client.0.smithi078.stdout:1/19: link d0/d1/c2 d0/d1/c3 0 2024-04-18T21:06:54.060 INFO:tasks.workunit.client.0.smithi078.stdout:3/5: chown f1 102975 1 2024-04-18T21:06:54.060 INFO:tasks.workunit.client.0.smithi078.stdout:3/6: readlink - no filename 2024-04-18T21:06:54.060 INFO:tasks.workunit.client.0.smithi078.stdout:5/3: rename f0 to f1 0 2024-04-18T21:06:54.060 INFO:tasks.workunit.client.0.smithi078.stdout:4/8: stat d0 0 2024-04-18T21:06:54.060 INFO:tasks.workunit.client.0.smithi078.stdout:4/9: write - no filename 2024-04-18T21:06:54.060 INFO:tasks.workunit.client.0.smithi078.stdout:4/10: write - no filename 2024-04-18T21:06:54.060 INFO:tasks.workunit.client.0.smithi078.stdout:4/11: dread - no filename 2024-04-18T21:06:54.060 INFO:tasks.workunit.client.0.smithi078.stdout:4/12: dwrite - no filename 2024-04-18T21:06:54.060 INFO:tasks.workunit.client.0.smithi078.stdout:4/13: link - no file 2024-04-18T21:06:54.061 INFO:tasks.workunit.client.0.smithi078.stdout:4/14: rename d0 to d0/d3 22 2024-04-18T21:06:54.061 INFO:tasks.workunit.client.0.smithi078.stdout:8/1: mknod d0/c1 0 2024-04-18T21:06:54.061 INFO:tasks.workunit.client.0.smithi078.stdout:5/4: fdatasync f1 0 2024-04-18T21:06:54.061 INFO:tasks.workunit.client.0.smithi078.stdout:1/20: mkdir d0/d1/d4 0 2024-04-18T21:06:54.061 INFO:tasks.workunit.client.0.smithi078.stdout:1/21: fsync - no filename 2024-04-18T21:06:54.061 INFO:tasks.workunit.client.0.smithi078.stdout:4/15: mknod d0/c4 0 2024-04-18T21:06:54.062 INFO:tasks.workunit.client.0.smithi078.stdout:4/16: truncate - no filename 2024-04-18T21:06:54.062 INFO:tasks.workunit.client.0.smithi078.stdout:3/7: write f2 [671837,128198] 0 2024-04-18T21:06:54.063 INFO:tasks.workunit.client.0.smithi078.stdout:1/22: creat d0/f5 x:0 0 0 2024-04-18T21:06:54.064 INFO:tasks.workunit.client.0.smithi078.stdout:5/5: truncate f1 925443 0 2024-04-18T21:06:54.065 INFO:tasks.workunit.client.0.smithi078.stdout:4/17: creat d0/f5 x:0 0 0 2024-04-18T21:06:54.066 INFO:tasks.workunit.client.0.smithi078.stdout:3/8: write f2 [858614,113455] 0 2024-04-18T21:06:54.067 INFO:tasks.workunit.client.0.smithi078.stdout:5/6: read f1 [632259,51824] 0 2024-04-18T21:06:54.068 INFO:tasks.workunit.client.0.smithi078.stdout:1/23: creat d0/d1/d4/f6 x:0 0 0 2024-04-18T21:06:54.069 INFO:tasks.workunit.client.0.smithi078.stdout:3/9: write f1 [420940,124369] 0 2024-04-18T21:06:54.072 INFO:tasks.workunit.client.0.smithi078.stdout:1/24: write d0/f5 [255256,103829] 0 2024-04-18T21:06:54.072 INFO:tasks.workunit.client.0.smithi078.stdout:5/7: write f1 [1238814,110590] 0 2024-04-18T21:06:54.073 INFO:tasks.workunit.client.0.smithi078.stdout:9/8: dwrite f0 [0,4194304] 0 2024-04-18T21:06:54.074 INFO:tasks.workunit.client.0.smithi078.stdout:6/1: dwrite f0 [0,4194304] 0 2024-04-18T21:06:54.076 INFO:tasks.workunit.client.0.smithi078.stdout:7/1: dwrite f0 [0,4194304] 0 2024-04-18T21:06:54.077 INFO:tasks.workunit.client.0.smithi078.stdout:5/8: write f1 [741878,22085] 0 2024-04-18T21:06:54.077 INFO:tasks.workunit.client.0.smithi078.stdout:5/9: chown f1 247121 1 2024-04-18T21:06:54.079 INFO:tasks.workunit.client.0.smithi078.stdout:5/10: write f1 [1327749,26958] 0 2024-04-18T21:06:54.079 INFO:tasks.workunit.client.0.smithi078.stdout:3/10: symlink l3 0 2024-04-18T21:06:54.081 INFO:tasks.workunit.client.0.smithi078.stdout:3/11: write f2 [103136,110939] 0 2024-04-18T21:06:54.083 INFO:tasks.workunit.client.0.smithi078.stdout:3/12: chown f2 344501143 1 2024-04-18T21:06:54.084 INFO:tasks.workunit.client.0.smithi078.stdout:0/13: getdents d0 0 2024-04-18T21:06:54.084 INFO:tasks.workunit.client.0.smithi078.stdout:2/6: getdents d0 0 2024-04-18T21:06:54.084 INFO:tasks.workunit.client.0.smithi078.stdout:8/2: getdents d0 0 2024-04-18T21:06:54.085 INFO:tasks.workunit.client.0.smithi078.stdout:6/2: mknod c1 0 2024-04-18T21:06:54.085 INFO:tasks.workunit.client.0.smithi078.stdout:8/3: dwrite - no filename 2024-04-18T21:06:54.085 INFO:tasks.workunit.client.0.smithi078.stdout:5/11: mknod c2 0 2024-04-18T21:06:54.085 INFO:tasks.workunit.client.0.smithi078.stdout:4/18: fsync d0/f5 0 2024-04-18T21:06:54.085 INFO:tasks.workunit.client.0.smithi078.stdout:0/14: rmdir d0 39 2024-04-18T21:06:54.085 INFO:tasks.workunit.client.0.smithi078.stdout:5/12: stat c2 0 2024-04-18T21:06:54.085 INFO:tasks.workunit.client.0.smithi078.stdout:8/4: mknod d0/c2 0 2024-04-18T21:06:54.086 INFO:tasks.workunit.client.0.smithi078.stdout:8/5: dwrite - no filename 2024-04-18T21:06:54.086 INFO:tasks.workunit.client.0.smithi078.stdout:8/6: dwrite - no filename 2024-04-18T21:06:54.086 INFO:tasks.workunit.client.0.smithi078.stdout:2/7: creat d0/f3 x:0 0 0 2024-04-18T21:06:54.086 INFO:tasks.workunit.client.0.smithi078.stdout:5/13: write f1 [1053976,93511] 0 2024-04-18T21:06:54.086 INFO:tasks.workunit.client.0.smithi078.stdout:4/19: write d0/f5 [369376,99627] 0 2024-04-18T21:06:54.086 INFO:tasks.workunit.client.0.smithi078.stdout:2/8: chown d0 34015 1 2024-04-18T21:06:54.087 INFO:tasks.workunit.client.0.smithi078.stdout:8/7: unlink d0/c2 0 2024-04-18T21:06:54.087 INFO:tasks.workunit.client.0.smithi078.stdout:8/8: truncate - no filename 2024-04-18T21:06:54.087 INFO:tasks.workunit.client.0.smithi078.stdout:5/14: stat f1 0 2024-04-18T21:06:54.087 INFO:tasks.workunit.client.0.smithi078.stdout:0/15: symlink d0/l3 0 2024-04-18T21:06:54.088 INFO:tasks.workunit.client.0.smithi078.stdout:1/25: fsync d0/d1/d4/f6 0 2024-04-18T21:06:54.089 INFO:tasks.workunit.client.0.smithi078.stdout:5/15: symlink l3 0 2024-04-18T21:06:54.089 INFO:tasks.workunit.client.0.smithi078.stdout:8/9: creat d0/f3 x:0 0 0 2024-04-18T21:06:54.089 INFO:tasks.workunit.client.0.smithi078.stdout:0/16: creat d0/f4 x:0 0 0 2024-04-18T21:06:54.091 INFO:tasks.workunit.client.0.smithi078.stdout:0/17: dread - d0/f4 zero size 2024-04-18T21:06:54.091 INFO:tasks.workunit.client.0.smithi078.stdout:8/10: dread - d0/f3 zero size 2024-04-18T21:06:54.094 INFO:tasks.workunit.client.0.smithi078.stdout:0/18: dread - d0/f4 zero size 2024-04-18T21:06:54.094 INFO:tasks.workunit.client.0.smithi078.stdout:8/11: mknod d0/c4 0 2024-04-18T21:06:54.094 INFO:tasks.workunit.client.0.smithi078.stdout:5/16: fsync f1 0 2024-04-18T21:06:54.094 INFO:tasks.workunit.client.0.smithi078.stdout:9/9: fdatasync f0 0 2024-04-18T21:06:54.097 INFO:tasks.workunit.client.0.smithi078.stdout:8/12: chown d0/c1 54 1 2024-04-18T21:06:54.098 INFO:tasks.workunit.client.0.smithi078.stdout:7/2: truncate f0 651645 0 2024-04-18T21:06:54.098 INFO:tasks.workunit.client.0.smithi078.stdout:3/13: dwrite f1 [0,4194304] 0 2024-04-18T21:06:54.102 INFO:tasks.workunit.client.0.smithi078.stdout:7/3: mkdir d1 0 2024-04-18T21:06:54.106 INFO:tasks.workunit.client.0.smithi078.stdout:8/13: creat d0/f5 x:0 0 0 2024-04-18T21:06:54.106 INFO:tasks.workunit.client.0.smithi078.stdout:4/20: dwrite d0/f5 [0,4194304] 0 2024-04-18T21:06:54.106 INFO:tasks.workunit.client.0.smithi078.stdout:2/9: dwrite d0/f3 [0,4194304] 0 2024-04-18T21:06:54.106 INFO:tasks.workunit.client.0.smithi078.stdout:8/14: chown d0 401724 1 2024-04-18T21:06:54.106 INFO:tasks.workunit.client.0.smithi078.stdout:7/4: mknod d1/c2 0 2024-04-18T21:06:54.107 INFO:tasks.workunit.client.0.smithi078.stdout:1/26: dwrite d0/f5 [0,4194304] 0 2024-04-18T21:06:54.109 INFO:tasks.workunit.client.0.smithi078.stdout:2/10: truncate d0/f2 223522 0 2024-04-18T21:06:54.109 INFO:tasks.workunit.client.0.smithi078.stdout:8/15: link d0/f3 d0/f6 0 2024-04-18T21:06:54.110 INFO:tasks.workunit.client.0.smithi078.stdout:1/27: dread - d0/d1/d4/f6 zero size 2024-04-18T21:06:54.110 INFO:tasks.workunit.client.0.smithi078.stdout:2/11: chown d0/f2 940 1 2024-04-18T21:06:54.111 INFO:tasks.workunit.client.0.smithi078.stdout:6/3: fsync f0 0 2024-04-18T21:06:54.111 INFO:tasks.workunit.client.0.smithi078.stdout:1/28: creat d0/f7 x:0 0 0 2024-04-18T21:06:54.112 INFO:tasks.workunit.client.0.smithi078.stdout:8/16: truncate d0/f5 738389 0 2024-04-18T21:06:54.112 INFO:tasks.workunit.client.0.smithi078.stdout:5/17: dwrite f1 [0,4194304] 0 2024-04-18T21:06:54.113 INFO:tasks.workunit.client.0.smithi078.stdout:3/14: dread f1 [0,4194304] 0 2024-04-18T21:06:54.113 INFO:tasks.workunit.client.0.smithi078.stdout:0/19: dwrite d0/f4 [0,4194304] 0 2024-04-18T21:06:54.115 INFO:tasks.workunit.client.0.smithi078.stdout:5/18: mkdir d4 0 2024-04-18T21:06:54.116 INFO:tasks.workunit.client.0.smithi078.stdout:0/20: creat d0/f5 x:0 0 0 2024-04-18T21:06:54.117 INFO:tasks.workunit.client.0.smithi078.stdout:0/21: dread - d0/f5 zero size 2024-04-18T21:06:54.117 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:54.118+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:54.119 INFO:tasks.workunit.client.0.smithi078.stdout:2/12: getdents d0 0 2024-04-18T21:06:54.120 INFO:tasks.workunit.client.0.smithi078.stdout:6/4: dread f0 [0,4194304] 0 2024-04-18T21:06:54.122 INFO:tasks.workunit.client.0.smithi078.stdout:6/5: chown f0 1787121362 1 2024-04-18T21:06:54.122 INFO:tasks.workunit.client.0.smithi078.stdout:7/5: fsync f0 0 2024-04-18T21:06:54.122 INFO:tasks.workunit.client.0.smithi078.stdout:2/13: symlink d0/l4 0 2024-04-18T21:06:54.123 INFO:tasks.workunit.client.0.smithi078.stdout:7/6: unlink f0 0 2024-04-18T21:06:54.123 INFO:tasks.workunit.client.0.smithi078.stdout:4/21: truncate d0/f5 677617 0 2024-04-18T21:06:54.124 INFO:tasks.workunit.client.0.smithi078.stdout:2/14: rmdir d0 39 2024-04-18T21:06:54.125 INFO:tasks.workunit.client.0.smithi078.stdout:6/6: write f0 [1240710,126956] 0 2024-04-18T21:06:54.128 INFO:tasks.workunit.client.0.smithi078.stdout:7/7: creat d1/f3 x:0 0 0 2024-04-18T21:06:54.128 INFO:tasks.workunit.client.0.smithi078.stdout:0/22: dread d0/f4 [0,4194304] 0 2024-04-18T21:06:54.128 INFO:tasks.workunit.client.0.smithi078.stdout:3/15: dwrite f1 [0,4194304] 0 2024-04-18T21:06:54.128 INFO:tasks.workunit.client.0.smithi078.stdout:7/8: stat d1/c2 0 2024-04-18T21:06:54.128 INFO:tasks.workunit.client.0.smithi078.stdout:8/17: dwrite d0/f3 [0,4194304] 0 2024-04-18T21:06:54.128 INFO:tasks.workunit.client.0.smithi078.stdout:2/15: write d0/f3 [4906803,20700] 0 2024-04-18T21:06:54.129 INFO:tasks.workunit.client.0.smithi078.stdout:5/19: dwrite f1 [0,4194304] 0 2024-04-18T21:06:54.129 INFO:tasks.workunit.client.0.smithi078.stdout:4/22: rename d0/c4 to d0/c6 0 2024-04-18T21:06:54.129 INFO:tasks.workunit.client.0.smithi078.stdout:7/9: truncate d1/f3 343045 0 2024-04-18T21:06:54.130 INFO:tasks.workunit.client.0.smithi078.stdout:5/20: write f1 [1707185,87623] 0 2024-04-18T21:06:54.130 INFO:tasks.workunit.client.0.smithi078.stdout:4/23: creat d0/f7 x:0 0 0 2024-04-18T21:06:54.131 INFO:tasks.workunit.client.0.smithi078.stdout:0/23: truncate d0/f4 78016 0 2024-04-18T21:06:54.132 INFO:tasks.workunit.client.0.smithi078.stdout:7/10: symlink d1/l4 0 2024-04-18T21:06:54.132 INFO:tasks.workunit.client.0.smithi078.stdout:8/18: symlink d0/l7 0 2024-04-18T21:06:54.132 INFO:tasks.workunit.client.0.smithi078.stdout:3/16: getdents . 0 2024-04-18T21:06:54.133 INFO:tasks.workunit.client.0.smithi078.stdout:5/21: rmdir d4 0 2024-04-18T21:06:54.133 INFO:tasks.workunit.client.0.smithi078.stdout:3/17: readlink l3 0 2024-04-18T21:06:54.133 INFO:tasks.workunit.client.0.smithi078.stdout:4/24: dread d0/f5 [0,4194304] 0 2024-04-18T21:06:54.133 INFO:tasks.workunit.client.0.smithi078.stdout:3/18: mkdir d4 0 2024-04-18T21:06:54.134 INFO:tasks.workunit.client.0.smithi078.stdout:5/22: rename l3 to l5 0 2024-04-18T21:06:54.134 INFO:tasks.workunit.client.0.smithi078.stdout:6/7: dread f0 [0,4194304] 0 2024-04-18T21:06:54.134 INFO:tasks.workunit.client.0.smithi078.stdout:7/11: truncate d1/f3 505506 0 2024-04-18T21:06:54.135 INFO:tasks.workunit.client.0.smithi078.stdout:5/23: read f1 [768958,111357] 0 2024-04-18T21:06:54.135 INFO:tasks.workunit.client.0.smithi078.stdout:4/25: mkdir d0/d8 0 2024-04-18T21:06:54.135 INFO:tasks.workunit.client.0.smithi078.stdout:7/12: rename d1 to d1/d5 22 2024-04-18T21:06:54.135 INFO:tasks.workunit.client.0.smithi078.stdout:6/8: mkdir d2 0 2024-04-18T21:06:54.135 INFO:tasks.workunit.client.0.smithi078.stdout:4/26: chown d0/f5 927 1 2024-04-18T21:06:54.136 INFO:tasks.workunit.client.0.smithi078.stdout:5/24: link f1 f6 0 2024-04-18T21:06:54.136 INFO:tasks.workunit.client.0.smithi078.stdout:4/27: dread - d0/f7 zero size 2024-04-18T21:06:54.136 INFO:tasks.workunit.client.0.smithi078.stdout:7/13: write d1/f3 [1069826,96532] 0 2024-04-18T21:06:54.136 INFO:tasks.workunit.client.0.smithi078.stdout:7/14: readlink d1/l4 0 2024-04-18T21:06:54.136 INFO:tasks.workunit.client.0.smithi078.stdout:5/25: write f6 [1191705,122446] 0 2024-04-18T21:06:54.136 INFO:tasks.workunit.client.0.smithi078.stdout:4/28: write d0/f7 [854731,100449] 0 2024-04-18T21:06:54.138 INFO:tasks.workunit.client.0.smithi078.stdout:4/29: mknod d0/d8/c9 0 2024-04-18T21:06:54.138 INFO:tasks.workunit.client.0.smithi078.stdout:4/30: readlink - no filename 2024-04-18T21:06:54.141 INFO:tasks.workunit.client.0.smithi078.stdout:6/9: dwrite f0 [4194304,4194304] 0 2024-04-18T21:06:54.142 INFO:tasks.workunit.client.0.smithi078.stdout:6/10: creat d2/f3 x:0 0 0 2024-04-18T21:06:54.143 INFO:tasks.workunit.client.0.smithi078.stdout:6/11: write f0 [7261197,87358] 0 2024-04-18T21:06:54.157 INFO:tasks.workunit.client.0.smithi078.stdout:8/19: truncate d0/f3 3612224 0 2024-04-18T21:06:54.158 INFO:tasks.workunit.client.0.smithi078.stdout:3/19: truncate f1 1163 0 2024-04-18T21:06:54.158 INFO:tasks.workunit.client.0.smithi078.stdout:7/15: truncate d1/f3 285808 0 2024-04-18T21:06:54.158 INFO:tasks.workunit.client.0.smithi078.stdout:4/31: getdents d0/d8 0 2024-04-18T21:06:54.158 INFO:tasks.workunit.client.0.smithi078.stdout:5/26: truncate f1 1352424 0 2024-04-18T21:06:54.159 INFO:tasks.workunit.client.0.smithi078.stdout:7/16: mkdir d1/d6 0 2024-04-18T21:06:54.159 INFO:tasks.workunit.client.0.smithi078.stdout:4/32: mknod d0/d8/ca 0 2024-04-18T21:06:54.162 INFO:tasks.workunit.client.0.smithi078.stdout:0/24: dwrite d0/f4 [0,4194304] 0 2024-04-18T21:06:54.164 INFO:tasks.workunit.client.0.smithi078.stdout:3/20: rename f1 to d4/f5 0 2024-04-18T21:06:54.166 INFO:tasks.workunit.client.0.smithi078.stdout:4/33: fsync d0/f7 0 2024-04-18T21:06:54.170 INFO:tasks.workunit.client.0.smithi078.stdout:5/27: dwrite f6 [0,4194304] 0 2024-04-18T21:06:54.170 INFO:tasks.workunit.client.0.smithi078.stdout:7/17: dwrite d1/f3 [0,4194304] 0 2024-04-18T21:06:54.171 INFO:tasks.workunit.client.0.smithi078.stdout:7/18: chown d1/f3 1912209976 1 2024-04-18T21:06:54.171 INFO:tasks.workunit.client.0.smithi078.stdout:7/19: mkdir d1/d7 0 2024-04-18T21:06:54.174 INFO:tasks.workunit.client.0.smithi078.stdout:3/21: dwrite d4/f5 [0,4194304] 0 2024-04-18T21:06:54.188 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:54.186+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:54.197 INFO:tasks.workunit.client.0.smithi078.stdout:7/20: fsync d1/f3 0 2024-04-18T21:06:54.198 INFO:tasks.workunit.client.0.smithi078.stdout:7/21: readlink d1/l4 0 2024-04-18T21:06:54.198 INFO:tasks.workunit.client.0.smithi078.stdout:7/22: readlink d1/l4 0 2024-04-18T21:06:54.198 INFO:tasks.workunit.client.0.smithi078.stdout:7/23: chown d1/d7 102844947 1 2024-04-18T21:06:54.203 INFO:tasks.workunit.client.0.smithi078.stdout:7/24: dwrite d1/f3 [0,4194304] 0 2024-04-18T21:06:54.204 INFO:tasks.workunit.client.0.smithi078.stdout:7/25: creat d1/d6/f8 x:0 0 0 2024-04-18T21:06:54.206 INFO:tasks.workunit.client.0.smithi078.stdout:7/26: creat d1/d7/f9 x:0 0 0 2024-04-18T21:06:54.207 INFO:tasks.workunit.client.0.smithi078.stdout:7/27: rename d1/l4 to d1/d6/la 0 2024-04-18T21:06:54.207 INFO:tasks.workunit.client.0.smithi078.stdout:7/28: rmdir d1/d6 39 2024-04-18T21:06:54.207 INFO:tasks.workunit.client.0.smithi078.stdout:7/29: creat d1/fb x:0 0 0 2024-04-18T21:06:54.212 INFO:tasks.workunit.client.0.smithi078.stdout:5/28: fsync f6 0 2024-04-18T21:06:54.213 INFO:tasks.workunit.client.0.smithi078.stdout:5/29: rename c2 to c7 0 2024-04-18T21:06:54.213 INFO:tasks.workunit.client.0.smithi078.stdout:7/30: rename d1/d7 to d1/d6/dc 0 2024-04-18T21:06:54.213 INFO:tasks.workunit.client.0.smithi078.stdout:5/30: chown l5 0 1 2024-04-18T21:06:54.213 INFO:tasks.workunit.client.0.smithi078.stdout:7/31: dread - d1/d6/dc/f9 zero size 2024-04-18T21:06:54.213 INFO:tasks.workunit.client.0.smithi078.stdout:5/31: fsync f6 0 2024-04-18T21:06:54.214 INFO:tasks.workunit.client.0.smithi078.stdout:5/32: unlink l5 0 2024-04-18T21:06:54.214 INFO:tasks.workunit.client.0.smithi078.stdout:7/32: creat d1/d6/dc/fd x:0 0 0 2024-04-18T21:06:54.214 INFO:tasks.workunit.client.0.smithi078.stdout:5/33: creat f8 x:0 0 0 2024-04-18T21:06:54.214 INFO:tasks.workunit.client.0.smithi078.stdout:5/34: write f1 [4726702,72434] 0 2024-04-18T21:06:54.218 INFO:tasks.workunit.client.0.smithi078.stdout:5/35: chown c7 48 1 2024-04-18T21:06:54.219 INFO:tasks.workunit.client.0.smithi078.stdout:5/36: unlink f1 0 2024-04-18T21:06:54.220 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:54.220 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:06:54.220 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-18T21:06:54.220 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-18T21:06:54.221 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:54.225 INFO:tasks.workunit.client.0.smithi078.stdout:5/37: dread f6 [0,4194304] 0 2024-04-18T21:06:54.227 INFO:tasks.workunit.client.0.smithi078.stdout:5/38: mkdir d9 0 2024-04-18T21:06:54.228 INFO:tasks.workunit.client.0.smithi078.stdout:5/39: truncate f8 456907 0 2024-04-18T21:06:54.228 INFO:tasks.workunit.client.0.smithi078.stdout:5/40: mkdir d9/da 0 2024-04-18T21:06:54.228 INFO:tasks.workunit.client.0.smithi078.stdout:5/41: readlink - no filename 2024-04-18T21:06:54.229 INFO:tasks.workunit.client.0.smithi078.stdout:5/42: rename f6 to d9/fb 0 2024-04-18T21:06:54.235 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:54.289 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:54.286+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:54.390 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:54.390+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:54.400 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:54.400 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-18T21:06:54.400 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-18T21:06:54.400 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:06:54.401 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.401 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:54.401 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:54.401 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 108.784050044, 2024-04-18T21:06:54.401 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045668994999999997, 2024-04-18T21:06:54.401 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:54.401 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:54.401 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:54.401 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:54.401 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.401 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:54.401 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:54.401 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:54.402 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.402 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.402 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:54.402 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:54.402 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:54.402 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.402 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.402 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:54.402 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615459+0000", 2024-04-18T21:06:54.402 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5030000000000001e-06 2024-04-18T21:06:54.402 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.402 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.402 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:54.402 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615506+0000", 2024-04-18T21:06:54.403 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6872000000000001e-05 2024-04-18T21:06:54.403 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.403 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.403 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:54.403 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615527+0000", 2024-04-18T21:06:54.403 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0763000000000001e-05 2024-04-18T21:06:54.403 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.403 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.403 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:54.403 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615551+0000", 2024-04-18T21:06:54.403 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4159e-05 2024-04-18T21:06:54.403 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.403 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.403 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:54.404 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615736+0000", 2024-04-18T21:06:54.404 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018499599999999999 2024-04-18T21:06:54.404 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.404 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.404 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:54.404 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615748+0000", 2024-04-18T21:06:54.404 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2272999999999999e-05 2024-04-18T21:06:54.404 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.404 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.404 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:54.404 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635481+0000", 2024-04-18T21:06:54.404 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019732772999999999 2024-04-18T21:06:54.404 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.405 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.405 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:54.405 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635791+0000", 2024-04-18T21:06:54.405 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031013299999999998 2024-04-18T21:06:54.405 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.405 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.405 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:54.405 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636101+0000", 2024-04-18T21:06:54.405 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030943300000000002 2024-04-18T21:06:54.405 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.405 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.405 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:54.405 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646043+0000", 2024-04-18T21:06:54.406 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099428139999999995 2024-04-18T21:06:54.406 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.406 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.406 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:54.406 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660991+0000", 2024-04-18T21:06:54.406 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014947142 2024-04-18T21:06:54.406 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.406 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.406 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:54.406 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661061+0000", 2024-04-18T21:06:54.406 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0438000000000006e-05 2024-04-18T21:06:54.406 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.407 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.407 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:54.407 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661127+0000", 2024-04-18T21:06:54.407 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5696000000000003e-05 2024-04-18T21:06:54.407 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:54.407 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:54.407 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:54.407 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.407 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.407 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:54.407 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:54.407 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 108.783837616, 2024-04-18T21:06:54.407 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045745085999999997, 2024-04-18T21:06:54.407 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:54.408 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:54.408 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:54.408 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:54.408 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.408 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:54.408 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:54.408 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:54.408 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.408 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.408 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:54.408 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:54.408 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:54.408 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.408 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.408 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:54.409 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:06:54.409 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7400000000000001e-06 2024-04-18T21:06:54.409 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.409 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.409 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:54.409 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:06:54.409 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8133e-05 2024-04-18T21:06:54.409 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.409 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.409 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:54.409 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615726+0000", 2024-04-18T21:06:54.409 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6132e-05 2024-04-18T21:06:54.409 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.409 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.410 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:54.410 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615742+0000", 2024-04-18T21:06:54.410 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6157000000000001e-05 2024-04-18T21:06:54.410 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.410 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.410 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:54.410 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615937+0000", 2024-04-18T21:06:54.410 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000194768 2024-04-18T21:06:54.410 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.410 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.410 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:54.410 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615950+0000", 2024-04-18T21:06:54.410 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3084e-05 2024-04-18T21:06:54.410 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.411 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.411 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:54.411 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643676+0000", 2024-04-18T21:06:54.411 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027725639999999999 2024-04-18T21:06:54.411 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.411 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.411 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:54.411 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643867+0000", 2024-04-18T21:06:54.411 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019075900000000001 2024-04-18T21:06:54.411 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.411 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.411 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:54.411 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:06:54.411 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036013799999999997 2024-04-18T21:06:54.411 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.412 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.412 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:54.412 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646068+0000", 2024-04-18T21:06:54.412 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001841536 2024-04-18T21:06:54.412 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.412 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.412 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:54.412 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661184+0000", 2024-04-18T21:06:54.412 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015115458999999999 2024-04-18T21:06:54.412 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.412 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.412 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:54.412 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661283+0000", 2024-04-18T21:06:54.412 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9502999999999999e-05 2024-04-18T21:06:54.412 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.413 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.413 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:54.413 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661415+0000", 2024-04-18T21:06:54.413 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000132037 2024-04-18T21:06:54.413 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:54.413 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:54.413 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:54.413 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.413 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.413 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:54.413 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:54.413 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 108.783317168, 2024-04-18T21:06:54.413 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043572403000000003, 2024-04-18T21:06:54.413 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:54.414 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:54.414 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:54.414 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:54.414 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.414 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:54.414 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:54.414 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:54.414 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.414 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.414 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:54.414 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:54.414 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:54.414 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.415 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.415 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:54.415 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616192+0000", 2024-04-18T21:06:54.415 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:06:54.415 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.415 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.415 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:54.415 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616203+0000", 2024-04-18T21:06:54.415 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0890000000000001e-05 2024-04-18T21:06:54.415 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.415 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.415 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:54.415 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616223+0000", 2024-04-18T21:06:54.415 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0409000000000001e-05 2024-04-18T21:06:54.415 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.416 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.416 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:54.416 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616238+0000", 2024-04-18T21:06:54.416 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5160000000000001e-05 2024-04-18T21:06:54.416 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.416 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.416 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:54.416 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616343+0000", 2024-04-18T21:06:54.416 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000104831 2024-04-18T21:06:54.416 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.416 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.416 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:54.417 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616357+0000", 2024-04-18T21:06:54.417 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3686000000000001e-05 2024-04-18T21:06:54.417 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.417 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.417 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:54.417 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635912+0000", 2024-04-18T21:06:54.417 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019554944000000001 2024-04-18T21:06:54.417 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.417 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.417 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:54.417 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636231+0000", 2024-04-18T21:06:54.417 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000318766 2024-04-18T21:06:54.417 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.417 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.418 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:54.418 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659763+0000", 2024-04-18T21:06:54.418 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023532474000000001 2024-04-18T21:06:54.418 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:54.418 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:54.418 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:54.418 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.418 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.418 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:99 3.1f 3:f83d65d8:::200.00000004:head [write 313655~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:54.418 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757646+0000", 2024-04-18T21:06:54.418 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.6418613880000006, 2024-04-18T21:06:54.418 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043356459999999999, 2024-04-18T21:06:54.418 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:54.419 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:54.419 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:54.419 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:54.419 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.419 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:54.419 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757646+0000", 2024-04-18T21:06:54.419 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:54.419 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.419 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.419 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:54.419 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757646+0000", 2024-04-18T21:06:54.419 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:54.419 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.419 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.420 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:54.420 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757647+0000", 2024-04-18T21:06:54.420 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.44e-07 2024-04-18T21:06:54.420 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.420 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.420 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:54.420 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757656+0000", 2024-04-18T21:06:54.420 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6559999999999998e-06 2024-04-18T21:06:54.420 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.420 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.420 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:54.420 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757665+0000", 2024-04-18T21:06:54.420 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.6099999999999995e-06 2024-04-18T21:06:54.420 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.420 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.421 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:54.421 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757672+0000", 2024-04-18T21:06:54.421 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7270000000000001e-06 2024-04-18T21:06:54.421 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.421 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.421 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:54.421 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.794854+0000", 2024-04-18T21:06:54.421 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.037182448999999999 2024-04-18T21:06:54.421 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.421 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.421 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:54.421 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.795081+0000", 2024-04-18T21:06:54.421 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000226689 2024-04-18T21:06:54.421 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.421 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.422 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:54.422 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.795369+0000", 2024-04-18T21:06:54.422 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028752600000000003 2024-04-18T21:06:54.422 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.422 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.422 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:54.422 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.799725+0000", 2024-04-18T21:06:54.422 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043563509999999996 2024-04-18T21:06:54.422 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.422 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.422 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:54.422 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.800863+0000", 2024-04-18T21:06:54.422 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0011377799999999999 2024-04-18T21:06:54.422 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.422 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.423 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:54.423 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.800918+0000", 2024-04-18T21:06:54.423 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5547999999999997e-05 2024-04-18T21:06:54.423 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.423 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.423 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:54.423 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.801003+0000", 2024-04-18T21:06:54.423 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4480000000000004e-05 2024-04-18T21:06:54.423 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:54.423 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:54.423 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:54.423 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.423 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.423 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:100 3.1f 3:f83d65d8:::200.00000004:head [write 315055~1400 [fadvise_dontneed] in=1400b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:54.424 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757681+0000", 2024-04-18T21:06:54.424 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.6418267679999996, 2024-04-18T21:06:54.424 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045364542000000001, 2024-04-18T21:06:54.424 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:54.424 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:54.424 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:54.424 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:54.424 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.424 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:54.424 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757681+0000", 2024-04-18T21:06:54.424 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:54.424 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.424 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.424 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:54.424 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757681+0000", 2024-04-18T21:06:54.425 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:54.425 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.425 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.425 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:54.425 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757682+0000", 2024-04-18T21:06:54.425 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8999999999999996e-07 2024-04-18T21:06:54.425 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.425 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.425 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:54.425 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757685+0000", 2024-04-18T21:06:54.425 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.766e-06 2024-04-18T21:06:54.425 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.425 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.425 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:54.425 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757715+0000", 2024-04-18T21:06:54.425 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9904e-05 2024-04-18T21:06:54.426 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.426 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.426 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:54.426 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757723+0000", 2024-04-18T21:06:54.426 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9899999999999997e-06 2024-04-18T21:06:54.426 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.426 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.426 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:54.426 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.796754+0000", 2024-04-18T21:06:54.426 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.039030774999999997 2024-04-18T21:06:54.426 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.426 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.426 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:54.427 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.796825+0000", 2024-04-18T21:06:54.427 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0511000000000003e-05 2024-04-18T21:06:54.427 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.427 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.427 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:54.427 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.796952+0000", 2024-04-18T21:06:54.427 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012720099999999999 2024-04-18T21:06:54.427 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.427 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.427 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:54.427 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.800774+0000", 2024-04-18T21:06:54.427 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0038226039999999998 2024-04-18T21:06:54.427 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.427 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.428 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:54.428 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802920+0000", 2024-04-18T21:06:54.428 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002145194 2024-04-18T21:06:54.428 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.428 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.428 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:54.428 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802998+0000", 2024-04-18T21:06:54.428 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7836000000000005e-05 2024-04-18T21:06:54.428 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.428 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.428 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:54.428 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803046+0000", 2024-04-18T21:06:54.428 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8071000000000001e-05 2024-04-18T21:06:54.429 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:54.429 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:54.429 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:54.429 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.429 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.429 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:101 3.1f 3:f83d65d8:::200.00000004:head [write 316455~1401 [fadvise_dontneed] in=1401b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:54.429 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:06:54.429 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.6417740050000003, 2024-04-18T21:06:54.429 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.048270212999999999, 2024-04-18T21:06:54.429 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:54.429 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:54.429 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:54.429 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:54.430 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.430 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:54.430 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:06:54.430 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:54.430 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.430 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.430 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:54.430 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:06:54.430 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:54.430 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.430 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.430 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:54.431 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:06:54.431 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7700000000000004e-07 2024-04-18T21:06:54.431 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.431 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.431 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:54.431 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757745+0000", 2024-04-18T21:06:54.431 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0910000000000001e-05 2024-04-18T21:06:54.431 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.431 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.431 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:54.431 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757758+0000", 2024-04-18T21:06:54.431 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2593e-05 2024-04-18T21:06:54.431 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.432 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.432 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:54.432 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757765+0000", 2024-04-18T21:06:54.432 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1659999999999997e-06 2024-04-18T21:06:54.432 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.432 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.432 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:54.432 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.797782+0000", 2024-04-18T21:06:54.432 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.040017283000000001 2024-04-18T21:06:54.432 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.432 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.432 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:54.432 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.797949+0000", 2024-04-18T21:06:54.432 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016650399999999999 2024-04-18T21:06:54.433 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.433 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.433 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:54.433 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.798152+0000", 2024-04-18T21:06:54.433 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000203098 2024-04-18T21:06:54.433 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.433 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.433 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:54.433 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.800792+0000", 2024-04-18T21:06:54.433 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026394779999999998 2024-04-18T21:06:54.433 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.433 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.433 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:54.433 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805921+0000", 2024-04-18T21:06:54.434 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0051295519999999999 2024-04-18T21:06:54.434 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.434 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.434 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:54.434 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805967+0000", 2024-04-18T21:06:54.434 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5457000000000002e-05 2024-04-18T21:06:54.434 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.434 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.434 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:54.434 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806004+0000", 2024-04-18T21:06:54.434 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7494999999999999e-05 2024-04-18T21:06:54.434 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:54.434 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:54.434 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:54.434 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.435 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.435 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:102 3.1f 3:f83d65d8:::200.00000004:head [write 317856~1403 [fadvise_dontneed] in=1403b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:54.435 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757775+0000", 2024-04-18T21:06:54.435 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.6417329390000006, 2024-04-18T21:06:54.435 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.048337705000000002, 2024-04-18T21:06:54.435 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:54.435 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:54.435 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:54.435 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:54.435 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.435 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:54.435 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757775+0000", 2024-04-18T21:06:54.435 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:54.436 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.436 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.436 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:54.436 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757775+0000", 2024-04-18T21:06:54.436 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:54.436 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.436 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.436 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:54.436 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757776+0000", 2024-04-18T21:06:54.436 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5300000000000004e-07 2024-04-18T21:06:54.436 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.436 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.436 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:54.436 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757780+0000", 2024-04-18T21:06:54.436 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2270000000000004e-06 2024-04-18T21:06:54.437 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.437 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.437 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:54.437 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757792+0000", 2024-04-18T21:06:54.437 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2696e-05 2024-04-18T21:06:54.437 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.437 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.437 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:54.437 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757800+0000", 2024-04-18T21:06:54.437 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1439999999999997e-06 2024-04-18T21:06:54.437 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.437 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.437 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:54.437 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.798773+0000", 2024-04-18T21:06:54.437 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.040973074999999998 2024-04-18T21:06:54.438 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.438 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.438 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:54.438 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.798990+0000", 2024-04-18T21:06:54.438 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000217161 2024-04-18T21:06:54.438 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.438 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.438 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:54.438 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.799173+0000", 2024-04-18T21:06:54.438 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018295900000000001 2024-04-18T21:06:54.438 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.438 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.438 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:54.439 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802469+0000", 2024-04-18T21:06:54.439 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032965350000000002 2024-04-18T21:06:54.439 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.439 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.439 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:54.439 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806042+0000", 2024-04-18T21:06:54.439 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035724630000000001 2024-04-18T21:06:54.439 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.439 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.439 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:54.439 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806077+0000", 2024-04-18T21:06:54.440 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4997999999999999e-05 2024-04-18T21:06:54.440 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.440 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.440 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:54.440 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806113+0000", 2024-04-18T21:06:54.440 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5794000000000003e-05 2024-04-18T21:06:54.440 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:54.440 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:54.440 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:54.440 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.440 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.440 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:103 3.1f 3:f83d65d8:::200.00000004:head [write 319259~1404 [fadvise_dontneed] in=1404b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:54.440 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:06:54.441 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.6416990929999997, 2024-04-18T21:06:54.441 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.048414481000000002, 2024-04-18T21:06:54.441 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:54.441 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:54.441 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:54.441 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:54.441 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.441 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:54.441 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:06:54.441 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:54.441 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.441 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.441 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:54.441 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:06:54.441 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:54.442 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.442 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.442 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:54.442 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:06:54.442 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4700000000000001e-07 2024-04-18T21:06:54.442 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.442 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.442 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:54.442 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757814+0000", 2024-04-18T21:06:54.442 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1829999999999996e-06 2024-04-18T21:06:54.442 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.442 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.443 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:54.443 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757825+0000", 2024-04-18T21:06:54.443 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1754e-05 2024-04-18T21:06:54.443 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.443 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.443 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:54.443 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757832+0000", 2024-04-18T21:06:54.443 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8430000000000004e-06 2024-04-18T21:06:54.443 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.443 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.443 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:54.443 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.799809+0000", 2024-04-18T21:06:54.443 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.041976960000000001 2024-04-18T21:06:54.443 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.443 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.444 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:54.444 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.799934+0000", 2024-04-18T21:06:54.444 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000125053 2024-04-18T21:06:54.444 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.444 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.444 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:54.444 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.800067+0000", 2024-04-18T21:06:54.444 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013276299999999999 2024-04-18T21:06:54.444 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.444 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.444 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:54.444 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804582+0000", 2024-04-18T21:06:54.444 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0045148899999999997 2024-04-18T21:06:54.444 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.444 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.444 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:54.445 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806158+0000", 2024-04-18T21:06:54.445 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001575894 2024-04-18T21:06:54.445 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.445 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.445 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:54.445 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806189+0000", 2024-04-18T21:06:54.445 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1423000000000001e-05 2024-04-18T21:06:54.445 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.445 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.445 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:54.445 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806223+0000", 2024-04-18T21:06:54.445 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4071e-05 2024-04-18T21:06:54.445 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:54.445 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:54.445 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:54.445 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.446 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.446 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:104 3.1f 3:f83d65d8:::200.00000004:head [write 320663~1405 [fadvise_dontneed] in=1405b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:54.446 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757841+0000", 2024-04-18T21:06:54.446 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.6416668889999997, 2024-04-18T21:06:54.446 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056381623999999998, 2024-04-18T21:06:54.446 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:54.446 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:54.446 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:54.446 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:54.446 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.446 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:54.446 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757841+0000", 2024-04-18T21:06:54.446 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:54.446 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.447 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.447 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:54.447 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757841+0000", 2024-04-18T21:06:54.447 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:54.447 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.447 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.447 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:54.447 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757842+0000", 2024-04-18T21:06:54.447 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5000000000000002e-07 2024-04-18T21:06:54.447 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.447 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.447 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:54.447 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757852+0000", 2024-04-18T21:06:54.447 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.084e-05 2024-04-18T21:06:54.447 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.447 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.448 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:54.448 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757865+0000", 2024-04-18T21:06:54.448 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2643000000000001e-05 2024-04-18T21:06:54.448 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.448 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.448 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:54.448 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757872+0000", 2024-04-18T21:06:54.448 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8689999999999998e-06 2024-04-18T21:06:54.448 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.448 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.448 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:54.448 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.801102+0000", 2024-04-18T21:06:54.448 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043229837 2024-04-18T21:06:54.448 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.448 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.448 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:54.449 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.801291+0000", 2024-04-18T21:06:54.449 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000189641 2024-04-18T21:06:54.449 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.449 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.449 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:54.449 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.801640+0000", 2024-04-18T21:06:54.449 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000348971 2024-04-18T21:06:54.449 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.449 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.449 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:54.449 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805849+0000", 2024-04-18T21:06:54.449 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042082739999999997 2024-04-18T21:06:54.449 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.449 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.449 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:54.450 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814135+0000", 2024-04-18T21:06:54.450 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0082867270000000007 2024-04-18T21:06:54.450 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.450 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.450 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:54.450 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814180+0000", 2024-04-18T21:06:54.450 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4982999999999999e-05 2024-04-18T21:06:54.450 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.450 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.450 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:54.450 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814223+0000", 2024-04-18T21:06:54.450 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2188999999999999e-05 2024-04-18T21:06:54.450 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:54.450 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:54.450 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:54.451 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.451 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.451 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:105 3.1f 3:f83d65d8:::200.00000004:head [write 322068~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:54.451 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:06:54.451 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.6416262929999998, 2024-04-18T21:06:54.451 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056513678999999997, 2024-04-18T21:06:54.451 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:54.451 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:54.451 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:54.451 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:54.451 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.451 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:54.451 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:06:54.451 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:54.451 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.451 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.452 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:54.452 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:06:54.452 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:54.452 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.452 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.452 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:54.452 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:06:54.452 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2600000000000002e-07 2024-04-18T21:06:54.452 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.452 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.452 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:54.452 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757888+0000", 2024-04-18T21:06:54.452 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7130000000000002e-06 2024-04-18T21:06:54.452 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.452 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.452 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:54.453 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757906+0000", 2024-04-18T21:06:54.453 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7723999999999998e-05 2024-04-18T21:06:54.453 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.453 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.453 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:54.453 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757921+0000", 2024-04-18T21:06:54.453 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4936000000000001e-05 2024-04-18T21:06:54.453 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.453 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.453 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:54.453 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802493+0000", 2024-04-18T21:06:54.453 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.044571927999999997 2024-04-18T21:06:54.453 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.453 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.454 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:54.454 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802537+0000", 2024-04-18T21:06:54.454 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4449000000000001e-05 2024-04-18T21:06:54.454 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.454 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.454 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:54.454 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802605+0000", 2024-04-18T21:06:54.454 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7945000000000001e-05 2024-04-18T21:06:54.454 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.454 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.454 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:54.454 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805852+0000", 2024-04-18T21:06:54.454 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032469909999999999 2024-04-18T21:06:54.454 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.455 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.455 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:54.455 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814298+0000", 2024-04-18T21:06:54.455 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084463309999999996 2024-04-18T21:06:54.455 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.455 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.455 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:54.455 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814355+0000", 2024-04-18T21:06:54.455 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6459999999999998e-05 2024-04-18T21:06:54.455 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.455 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.455 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:54.455 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814395+0000", 2024-04-18T21:06:54.456 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0475999999999997e-05 2024-04-18T21:06:54.456 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:54.456 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:54.456 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:54.456 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.456 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.456 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:106 3.1f 3:f83d65d8:::200.00000004:head [write 323467~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:54.456 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757955+0000", 2024-04-18T21:06:54.456 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.641553064, 2024-04-18T21:06:54.456 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056539990999999998, 2024-04-18T21:06:54.456 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:54.456 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:54.456 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:54.456 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:54.456 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.457 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:54.457 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757955+0000", 2024-04-18T21:06:54.457 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:54.457 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.457 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.457 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:54.457 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757955+0000", 2024-04-18T21:06:54.457 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:54.457 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.457 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.457 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:54.457 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757956+0000", 2024-04-18T21:06:54.457 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.144e-06 2024-04-18T21:06:54.457 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.457 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.458 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:54.458 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757970+0000", 2024-04-18T21:06:54.458 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3899e-05 2024-04-18T21:06:54.458 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.458 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.458 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:54.458 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757988+0000", 2024-04-18T21:06:54.458 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8033000000000002e-05 2024-04-18T21:06:54.458 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.458 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.458 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:54.458 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758002+0000", 2024-04-18T21:06:54.458 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3973e-05 2024-04-18T21:06:54.458 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.459 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.459 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:54.459 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803072+0000", 2024-04-18T21:06:54.459 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045070194000000001 2024-04-18T21:06:54.459 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.459 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.459 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:54.459 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803125+0000", 2024-04-18T21:06:54.459 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3498000000000002e-05 2024-04-18T21:06:54.459 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.459 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.459 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:54.459 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803233+0000", 2024-04-18T21:06:54.459 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010704099999999999 2024-04-18T21:06:54.459 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.460 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.460 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:54.460 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805856+0000", 2024-04-18T21:06:54.460 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026233430000000002 2024-04-18T21:06:54.460 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.460 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.460 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:54.460 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814439+0000", 2024-04-18T21:06:54.460 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0085833839999999995 2024-04-18T21:06:54.460 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.460 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.460 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:54.460 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814469+0000", 2024-04-18T21:06:54.460 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9784000000000001e-05 2024-04-18T21:06:54.461 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.461 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.461 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:54.461 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814495+0000", 2024-04-18T21:06:54.461 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5698e-05 2024-04-18T21:06:54.461 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:54.461 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:54.461 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:54.461 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.461 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.461 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:107 3.1f 3:f83d65d8:::200.00000004:head [write 324866~1421 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:54.461 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758019+0000", 2024-04-18T21:06:54.461 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.6414884379999997, 2024-04-18T21:06:54.461 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056580563, 2024-04-18T21:06:54.462 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:54.462 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:54.462 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:54.462 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:54.462 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.462 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:54.462 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758019+0000", 2024-04-18T21:06:54.462 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:54.462 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.462 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.462 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:54.462 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758019+0000", 2024-04-18T21:06:54.462 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:54.462 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.463 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.463 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:54.463 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758021+0000", 2024-04-18T21:06:54.463 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1999999999999999e-06 2024-04-18T21:06:54.463 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.463 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.463 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:54.463 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758028+0000", 2024-04-18T21:06:54.463 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7200000000000006e-06 2024-04-18T21:06:54.463 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.463 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.463 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:54.463 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758050+0000", 2024-04-18T21:06:54.463 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1877000000000001e-05 2024-04-18T21:06:54.463 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.463 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.464 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:54.464 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758064+0000", 2024-04-18T21:06:54.464 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.383e-05 2024-04-18T21:06:54.464 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.464 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.464 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:54.464 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803593+0000", 2024-04-18T21:06:54.464 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045528831999999998 2024-04-18T21:06:54.464 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.464 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.464 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:54.464 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803635+0000", 2024-04-18T21:06:54.464 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1980000000000001e-05 2024-04-18T21:06:54.464 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.464 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.464 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:54.465 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803703+0000", 2024-04-18T21:06:54.465 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8542999999999997e-05 2024-04-18T21:06:54.465 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.465 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.465 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:54.465 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806123+0000", 2024-04-18T21:06:54.465 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002419769 2024-04-18T21:06:54.465 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.465 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.465 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:54.465 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814542+0000", 2024-04-18T21:06:54.465 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084189460000000001 2024-04-18T21:06:54.465 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.465 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.466 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:54.466 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814576+0000", 2024-04-18T21:06:54.466 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3679000000000001e-05 2024-04-18T21:06:54.466 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.466 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.466 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:54.466 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814600+0000", 2024-04-18T21:06:54.466 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4187000000000001e-05 2024-04-18T21:06:54.466 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:54.466 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:54.466 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:54.466 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.466 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.466 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:108 3.1f 3:f83d65d8:::200.00000004:head [write 326287~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:54.467 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:06:54.467 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.6414252689999991, 2024-04-18T21:06:54.467 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056616183, 2024-04-18T21:06:54.467 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:54.467 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:54.467 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:54.467 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:54.467 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.467 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:54.467 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:06:54.467 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:54.467 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.467 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.467 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:54.467 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:06:54.468 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:54.468 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.468 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.468 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:54.468 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758084+0000", 2024-04-18T21:06:54.468 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.124e-06 2024-04-18T21:06:54.468 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.468 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.468 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:54.468 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758100+0000", 2024-04-18T21:06:54.468 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6246e-05 2024-04-18T21:06:54.468 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.468 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.468 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:54.469 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758118+0000", 2024-04-18T21:06:54.469 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8267e-05 2024-04-18T21:06:54.469 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.469 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.469 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:54.469 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758134+0000", 2024-04-18T21:06:54.469 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5950000000000001e-05 2024-04-18T21:06:54.469 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.469 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.469 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:54.469 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803949+0000", 2024-04-18T21:06:54.469 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045815349999999998 2024-04-18T21:06:54.469 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.469 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.469 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:54.470 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804011+0000", 2024-04-18T21:06:54.470 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1044999999999996e-05 2024-04-18T21:06:54.470 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.470 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.470 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:54.470 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804128+0000", 2024-04-18T21:06:54.470 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117148 2024-04-18T21:06:54.470 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.470 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.470 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:54.470 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806794+0000", 2024-04-18T21:06:54.470 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002666692 2024-04-18T21:06:54.470 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.470 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.470 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:54.471 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814645+0000", 2024-04-18T21:06:54.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0078508880000000003 2024-04-18T21:06:54.471 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.471 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.471 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:54.471 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814678+0000", 2024-04-18T21:06:54.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3188999999999997e-05 2024-04-18T21:06:54.471 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.471 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.471 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:54.471 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814699+0000", 2024-04-18T21:06:54.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0284000000000001e-05 2024-04-18T21:06:54.471 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:54.471 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:54.471 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:54.471 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.472 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.472 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:109 3.1f 3:f83d65d8:::200.00000004:head [write 327693~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:54.472 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:06:54.472 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.6413559020000008, 2024-04-18T21:06:54.472 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056621036999999999, 2024-04-18T21:06:54.472 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:54.472 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:54.472 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:54.472 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:54.472 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.472 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:54.472 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:06:54.472 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:54.472 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.472 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.473 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:54.473 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:06:54.473 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:54.473 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.473 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:54.473 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758153+0000", 2024-04-18T21:06:54.473 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1459999999999999e-06 2024-04-18T21:06:54.473 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.473 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:54.473 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758161+0000", 2024-04-18T21:06:54.473 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7999999999999999e-06 2024-04-18T21:06:54.473 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.473 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:54.474 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758179+0000", 2024-04-18T21:06:54.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7949999999999999e-05 2024-04-18T21:06:54.474 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.474 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.474 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:54.474 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758193+0000", 2024-04-18T21:06:54.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3773e-05 2024-04-18T21:06:54.474 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.474 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.474 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:54.474 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804632+0000", 2024-04-18T21:06:54.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.046439469999999997 2024-04-18T21:06:54.475 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.475 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:54.475 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804790+0000", 2024-04-18T21:06:54.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015784300000000001 2024-04-18T21:06:54.475 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.475 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:54.475 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805056+0000", 2024-04-18T21:06:54.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026652400000000003 2024-04-18T21:06:54.475 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.475 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:54.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.808959+0000", 2024-04-18T21:06:54.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003903077 2024-04-18T21:06:54.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:54.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814728+0000", 2024-04-18T21:06:54.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0057682489999999996 2024-04-18T21:06:54.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:54.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814754+0000", 2024-04-18T21:06:54.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6673999999999999e-05 2024-04-18T21:06:54.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.477 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.477 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:54.477 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814773+0000", 2024-04-18T21:06:54.477 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8530999999999999e-05 2024-04-18T21:06:54.477 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:54.477 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:54.477 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:54.477 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.477 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.477 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:110 3.1f 3:f83d65d8:::200.00000004:head [write 329098~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:54.477 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:06:54.477 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.6412974929999997, 2024-04-18T21:06:54.477 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056669113, 2024-04-18T21:06:54.477 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:54.477 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:54.478 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:54.478 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:54.478 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.478 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:54.478 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:06:54.478 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:54.478 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.478 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.478 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:54.478 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:06:54.478 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:54.478 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.478 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.478 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:54.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758212+0000", 2024-04-18T21:06:54.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:06:54.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.479 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.479 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:54.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758219+0000", 2024-04-18T21:06:54.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4229999999999999e-06 2024-04-18T21:06:54.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.479 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.479 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:54.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758237+0000", 2024-04-18T21:06:54.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7966999999999999e-05 2024-04-18T21:06:54.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.479 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:54.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758252+0000", 2024-04-18T21:06:54.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5322999999999999e-05 2024-04-18T21:06:54.480 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:54.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805536+0000", 2024-04-18T21:06:54.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.047283861000000003 2024-04-18T21:06:54.480 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:54.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805579+0000", 2024-04-18T21:06:54.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2738999999999999e-05 2024-04-18T21:06:54.480 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:54.481 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805649+0000", 2024-04-18T21:06:54.481 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0213e-05 2024-04-18T21:06:54.481 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:54.481 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.808966+0000", 2024-04-18T21:06:54.481 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033166129999999999 2024-04-18T21:06:54.481 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:54.481 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814812+0000", 2024-04-18T21:06:54.481 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0058463589999999998 2024-04-18T21:06:54.481 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:54.481 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814854+0000", 2024-04-18T21:06:54.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1618e-05 2024-04-18T21:06:54.482 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.482 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.482 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:54.482 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814879+0000", 2024-04-18T21:06:54.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5754000000000001e-05 2024-04-18T21:06:54.482 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:54.482 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:54.482 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:54.482 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.482 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.482 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:111 3.1f 3:f83d65d8:::200.00000004:head [write 330499~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:54.482 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:06:54.482 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.6412365169999994, 2024-04-18T21:06:54.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058693793000000001, 2024-04-18T21:06:54.483 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:54.483 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:54.483 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:54.483 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:54.483 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.483 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:54.483 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:06:54.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:54.483 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.483 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.483 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:54.483 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:06:54.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:54.483 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.483 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.483 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:54.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758272+0000", 2024-04-18T21:06:54.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1200000000000001e-06 2024-04-18T21:06:54.484 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:54.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758287+0000", 2024-04-18T21:06:54.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5017e-05 2024-04-18T21:06:54.484 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:54.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758309+0000", 2024-04-18T21:06:54.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1866e-05 2024-04-18T21:06:54.484 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:54.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758323+0000", 2024-04-18T21:06:54.485 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3606e-05 2024-04-18T21:06:54.485 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:54.485 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806279+0000", 2024-04-18T21:06:54.485 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.047956061000000001 2024-04-18T21:06:54.485 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:54.485 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806350+0000", 2024-04-18T21:06:54.485 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1070999999999998e-05 2024-04-18T21:06:54.485 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:54.485 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806459+0000", 2024-04-18T21:06:54.486 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000108606 2024-04-18T21:06:54.486 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.486 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.486 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:54.486 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.809774+0000", 2024-04-18T21:06:54.486 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003314881 2024-04-18T21:06:54.486 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.486 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.486 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:54.486 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816910+0000", 2024-04-18T21:06:54.486 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0071367760000000001 2024-04-18T21:06:54.486 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.487 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.487 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:54.487 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816941+0000", 2024-04-18T21:06:54.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0846000000000002e-05 2024-04-18T21:06:54.487 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.487 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.487 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:54.487 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816965+0000", 2024-04-18T21:06:54.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3943000000000001e-05 2024-04-18T21:06:54.487 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:54.487 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:54.487 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:54.487 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.487 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.487 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:5230 4.17 4:eb2cc4c4:::1000000184c.00000000:head [write 0~2191] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-18T21:06:54.488 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.760650+0000", 2024-04-18T21:06:54.488 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.638857346, 2024-04-18T21:06:54.488 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.054210577000000003, 2024-04-18T21:06:54.488 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:54.488 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:54.488 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:54.488 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:06:54.488 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:06:54.488 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:54.488 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 5230 2024-04-18T21:06:54.488 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.488 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:54.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.488 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:54.488 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760650+0000", 2024-04-18T21:06:54.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:54.489 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.489 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:54.489 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760650+0000", 2024-04-18T21:06:54.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:54.489 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.489 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:54.489 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760653+0000", 2024-04-18T21:06:54.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0829999999999998e-06 2024-04-18T21:06:54.489 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.489 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:54.489 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760664+0000", 2024-04-18T21:06:54.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.111e-05 2024-04-18T21:06:54.490 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.490 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:54.490 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760688+0000", 2024-04-18T21:06:54.490 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4837e-05 2024-04-18T21:06:54.490 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.490 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:54.490 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760702+0000", 2024-04-18T21:06:54.490 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3723000000000001e-05 2024-04-18T21:06:54.490 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.490 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:54.490 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806264+0000", 2024-04-18T21:06:54.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045562182 2024-04-18T21:06:54.491 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.491 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.491 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:54.491 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806351+0000", 2024-04-18T21:06:54.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6322000000000005e-05 2024-04-18T21:06:54.491 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.491 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.491 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:54.491 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806453+0000", 2024-04-18T21:06:54.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000102602 2024-04-18T21:06:54.491 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.491 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.491 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:54.491 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.808972+0000", 2024-04-18T21:06:54.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025184090000000001 2024-04-18T21:06:54.492 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:54.492 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814798+0000", 2024-04-18T21:06:54.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0058266689999999996 2024-04-18T21:06:54.492 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:54.492 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814839+0000", 2024-04-18T21:06:54.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0482000000000003e-05 2024-04-18T21:06:54.492 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:54.492 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814861+0000", 2024-04-18T21:06:54.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2158e-05 2024-04-18T21:06:54.492 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:54.492 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:54.493 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:54.493 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.493 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.493 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:112 3.1f 3:f83d65d8:::200.00000004:head [write 331898~20167 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:54.493 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.771321+0000", 2024-04-18T21:06:54.493 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.6281867190000003, 2024-04-18T21:06:54.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045740306000000001, 2024-04-18T21:06:54.493 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:54.493 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:54.493 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:54.493 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:54.493 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.493 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:54.493 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771321+0000", 2024-04-18T21:06:54.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:54.493 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.494 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.494 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:54.494 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771321+0000", 2024-04-18T21:06:54.494 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:54.494 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.494 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.494 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:54.494 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771323+0000", 2024-04-18T21:06:54.494 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3740000000000001e-06 2024-04-18T21:06:54.494 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.494 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.494 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:54.494 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771359+0000", 2024-04-18T21:06:54.494 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5447999999999997e-05 2024-04-18T21:06:54.494 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.495 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:54.495 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771388+0000", 2024-04-18T21:06:54.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8915e-05 2024-04-18T21:06:54.495 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.495 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:54.495 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771410+0000", 2024-04-18T21:06:54.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1899000000000002e-05 2024-04-18T21:06:54.495 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.495 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:54.495 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806827+0000", 2024-04-18T21:06:54.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.035417063999999998 2024-04-18T21:06:54.495 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:54.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806873+0000", 2024-04-18T21:06:54.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6261999999999999e-05 2024-04-18T21:06:54.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:54.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806946+0000", 2024-04-18T21:06:54.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3205000000000001e-05 2024-04-18T21:06:54.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:54.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.809781+0000", 2024-04-18T21:06:54.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002834937 2024-04-18T21:06:54.497 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.497 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:54.497 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817003+0000", 2024-04-18T21:06:54.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0072217959999999999 2024-04-18T21:06:54.497 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.497 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:54.497 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817038+0000", 2024-04-18T21:06:54.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4696999999999997e-05 2024-04-18T21:06:54.497 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.498 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:54.498 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817061+0000", 2024-04-18T21:06:54.498 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3708999999999999e-05 2024-04-18T21:06:54.498 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:54.498 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:54.498 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:54.498 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.498 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.498 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:113 3.1f 3:f83d65d8:::200.00000004:head [write 352065~3878 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:54.498 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.771472+0000", 2024-04-18T21:06:54.498 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.6280359830000002, 2024-04-18T21:06:54.498 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045689726, 2024-04-18T21:06:54.498 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:54.498 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:54.499 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:54.499 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:54.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:54.499 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771472+0000", 2024-04-18T21:06:54.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:54.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:54.499 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771472+0000", 2024-04-18T21:06:54.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:54.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.500 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:54.500 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771473+0000", 2024-04-18T21:06:54.500 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3829999999999999e-06 2024-04-18T21:06:54.500 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.500 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:54.500 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771489+0000", 2024-04-18T21:06:54.500 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5797000000000001e-05 2024-04-18T21:06:54.500 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.500 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:54.500 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771509+0000", 2024-04-18T21:06:54.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0401999999999999e-05 2024-04-18T21:06:54.501 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.501 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.501 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:54.501 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771525+0000", 2024-04-18T21:06:54.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5099999999999999e-05 2024-04-18T21:06:54.501 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.501 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.501 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:54.501 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807273+0000", 2024-04-18T21:06:54.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.035748488000000002 2024-04-18T21:06:54.501 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.501 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.501 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:54.501 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807343+0000", 2024-04-18T21:06:54.502 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0277000000000005e-05 2024-04-18T21:06:54.502 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.502 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.502 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:54.502 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807455+0000", 2024-04-18T21:06:54.502 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011171999999999999 2024-04-18T21:06:54.502 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.502 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.502 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:54.502 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.811509+0000", 2024-04-18T21:06:54.502 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0040543469999999998 2024-04-18T21:06:54.502 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.502 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.502 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:54.502 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817115+0000", 2024-04-18T21:06:54.503 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0056054520000000004 2024-04-18T21:06:54.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:54.503 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817142+0000", 2024-04-18T21:06:54.503 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7430999999999999e-05 2024-04-18T21:06:54.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:54.503 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817162+0000", 2024-04-18T21:06:54.503 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9329000000000001e-05 2024-04-18T21:06:54.503 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:54.503 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:54.503 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:54.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.504 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:114 3.1f 3:f83d65d8:::200.00000004:head [write 355943~1928 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:54.504 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.771785+0000", 2024-04-18T21:06:54.504 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.6277226379999998, 2024-04-18T21:06:54.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045480532999999997, 2024-04-18T21:06:54.504 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:54.504 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:54.504 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:54.504 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:54.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.504 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:54.504 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771785+0000", 2024-04-18T21:06:54.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:54.504 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.505 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.505 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:54.505 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771785+0000", 2024-04-18T21:06:54.505 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:54.505 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.505 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.505 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:54.505 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771787+0000", 2024-04-18T21:06:54.505 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0600000000000002e-06 2024-04-18T21:06:54.505 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.505 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.505 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:54.505 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771799+0000", 2024-04-18T21:06:54.505 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1503e-05 2024-04-18T21:06:54.505 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.505 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.506 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:54.506 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771829+0000", 2024-04-18T21:06:54.506 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.04e-05 2024-04-18T21:06:54.506 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.506 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.506 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:54.506 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771846+0000", 2024-04-18T21:06:54.506 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6608000000000001e-05 2024-04-18T21:06:54.506 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.506 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.506 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:54.506 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807856+0000", 2024-04-18T21:06:54.506 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036010480999999997 2024-04-18T21:06:54.506 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.507 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.507 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:54.507 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807899+0000", 2024-04-18T21:06:54.507 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2775999999999998e-05 2024-04-18T21:06:54.507 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.507 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.507 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:54.507 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807966+0000", 2024-04-18T21:06:54.507 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6793999999999998e-05 2024-04-18T21:06:54.507 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.507 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.507 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:54.507 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.811516+0000", 2024-04-18T21:06:54.507 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035497300000000001 2024-04-18T21:06:54.507 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.507 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.507 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:54.508 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817194+0000", 2024-04-18T21:06:54.508 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0056787030000000002 2024-04-18T21:06:54.508 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.508 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.508 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:54.508 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817231+0000", 2024-04-18T21:06:54.508 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6727000000000003e-05 2024-04-18T21:06:54.508 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:54.508 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:54.508 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:54.508 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817266+0000", 2024-04-18T21:06:54.508 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4751e-05 2024-04-18T21:06:54.508 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:54.508 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:54.508 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:54.508 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:54.509 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:54.509 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:54.510 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:54.511 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:54.510+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:54.610 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:54.610+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:54.641 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:54.641 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:06:54.641 INFO:teuthology.orchestra.run.smithi132.stdout: "num_ops": 0 2024-04-18T21:06:54.641 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:54.655 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:54.711 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:54.710+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:54.793 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-18T21:06:54.813 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:54.810+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:54.819 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:54.819 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:06:54.819 INFO:teuthology.orchestra.run.smithi132.stdout: "complaint_time": 30, 2024-04-18T21:06:54.820 INFO:teuthology.orchestra.run.smithi132.stdout: "num_blocked_ops": 0 2024-04-18T21:06:54.820 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:54.833 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:54.913 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:54.914+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:54.961 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:54.961 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 20, 2024-04-18T21:06:54.961 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 600, 2024-04-18T21:06:54.961 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [ 2024-04-18T21:06:54.961 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.962 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:54.962 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:06:54.962 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 120.049317669, 2024-04-18T21:06:54.962 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.02518273, 2024-04-18T21:06:54.962 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:54.962 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:54.962 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:54.962 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:54.962 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:54.962 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:54.962 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 141 2024-04-18T21:06:54.962 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.962 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:54.962 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.963 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:54.963 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:06:54.963 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:54.963 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.963 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.963 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:54.963 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:06:54.963 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:54.963 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.963 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.963 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:54.963 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911562+0000", 2024-04-18T21:06:54.963 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9300000000000006e-07 2024-04-18T21:06:54.963 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.963 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.963 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:54.964 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911569+0000", 2024-04-18T21:06:54.964 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0169999999999999e-06 2024-04-18T21:06:54.964 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.964 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.964 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:54.964 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911582+0000", 2024-04-18T21:06:54.964 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.343e-05 2024-04-18T21:06:54.964 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.964 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.964 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:54.964 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911590+0000", 2024-04-18T21:06:54.964 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.413e-06 2024-04-18T21:06:54.964 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.964 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.964 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:54.964 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.933922+0000", 2024-04-18T21:06:54.965 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.022332093000000001 2024-04-18T21:06:54.965 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.965 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.965 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:54.965 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.934155+0000", 2024-04-18T21:06:54.965 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023378900000000001 2024-04-18T21:06:54.965 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.965 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.965 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:54.965 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.934514+0000", 2024-04-18T21:06:54.965 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00035859200000000003 2024-04-18T21:06:54.965 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.965 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.965 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:54.965 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.935973+0000", 2024-04-18T21:06:54.966 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001458705 2024-04-18T21:06:54.966 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.966 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.966 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:54.966 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936488+0000", 2024-04-18T21:06:54.966 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00051550000000000001 2024-04-18T21:06:54.966 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.966 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.966 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:54.966 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936636+0000", 2024-04-18T21:06:54.967 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014779800000000001 2024-04-18T21:06:54.967 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.967 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.967 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:54.967 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936743+0000", 2024-04-18T21:06:54.967 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010739999999999999 2024-04-18T21:06:54.967 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:54.967 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:54.967 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:54.967 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.967 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.967 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:54.967 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:54.968 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 119.932084463, 2024-04-18T21:06:54.968 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023864586, 2024-04-18T21:06:54.968 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:54.968 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:54.968 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:54.968 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:54.968 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:54.968 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:54.968 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 164 2024-04-18T21:06:54.968 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.968 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:54.968 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.968 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:54.968 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:54.968 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:54.969 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.969 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.969 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:54.969 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:54.969 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:54.969 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.969 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.969 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:54.969 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028795+0000", 2024-04-18T21:06:54.969 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7999999999999995e-07 2024-04-18T21:06:54.969 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.969 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.969 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:54.969 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028884+0000", 2024-04-18T21:06:54.969 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8997000000000002e-05 2024-04-18T21:06:54.970 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.970 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.970 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:54.970 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028895+0000", 2024-04-18T21:06:54.970 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1647e-05 2024-04-18T21:06:54.970 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.970 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.970 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:54.970 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028903+0000", 2024-04-18T21:06:54.970 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.909e-06 2024-04-18T21:06:54.970 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.970 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.970 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:54.970 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.047818+0000", 2024-04-18T21:06:54.970 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018914337 2024-04-18T21:06:54.971 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.971 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.971 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:54.971 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.048094+0000", 2024-04-18T21:06:54.971 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00027653500000000001 2024-04-18T21:06:54.971 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.971 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.971 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:54.971 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.048471+0000", 2024-04-18T21:06:54.971 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00037705799999999999 2024-04-18T21:06:54.971 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.971 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.971 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:54.971 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052516+0000", 2024-04-18T21:06:54.971 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0040452739999999997 2024-04-18T21:06:54.971 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.972 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.972 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:54.972 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052535+0000", 2024-04-18T21:06:54.972 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.84e-05 2024-04-18T21:06:54.972 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.972 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.972 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:54.972 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052603+0000", 2024-04-18T21:06:54.972 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.8095000000000004e-05 2024-04-18T21:06:54.972 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.972 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.972 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:54.972 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052659+0000", 2024-04-18T21:06:54.972 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5653999999999999e-05 2024-04-18T21:06:54.972 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:54.972 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:54.973 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:54.973 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.973 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.973 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:54.973 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:54.973 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 119.93196102, 2024-04-18T21:06:54.973 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024516458000000001, 2024-04-18T21:06:54.973 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:54.973 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:54.973 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:54.973 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:54.973 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:54.973 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:54.973 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 165 2024-04-18T21:06:54.973 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.974 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:54.974 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.974 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:54.974 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:54.974 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:54.974 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.974 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.974 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:54.974 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:54.974 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:54.974 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.974 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.974 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:54.975 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028918+0000", 2024-04-18T21:06:54.975 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8000000000000005e-07 2024-04-18T21:06:54.975 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.975 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.975 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:54.975 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028924+0000", 2024-04-18T21:06:54.975 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5659999999999997e-06 2024-04-18T21:06:54.975 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.975 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.975 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:54.976 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028933+0000", 2024-04-18T21:06:54.976 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.38e-06 2024-04-18T21:06:54.976 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.976 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.976 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:54.976 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028940+0000", 2024-04-18T21:06:54.976 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0060000000000003e-06 2024-04-18T21:06:54.976 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.976 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.976 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:54.976 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.050846+0000", 2024-04-18T21:06:54.976 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021906119000000002 2024-04-18T21:06:54.976 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.976 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.976 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:54.977 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051025+0000", 2024-04-18T21:06:54.977 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017850799999999999 2024-04-18T21:06:54.977 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.977 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.977 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:54.977 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051221+0000", 2024-04-18T21:06:54.977 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019608700000000001 2024-04-18T21:06:54.977 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.977 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.977 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:54.977 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052675+0000", 2024-04-18T21:06:54.977 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0014537899999999999 2024-04-18T21:06:54.977 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.977 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.977 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:54.978 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053311+0000", 2024-04-18T21:06:54.978 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00063613299999999999 2024-04-18T21:06:54.978 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.978 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.978 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:54.978 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053381+0000", 2024-04-18T21:06:54.978 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0074999999999996e-05 2024-04-18T21:06:54.978 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.978 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.978 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:54.978 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053434+0000", 2024-04-18T21:06:54.978 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3013999999999998e-05 2024-04-18T21:06:54.978 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:54.978 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:54.978 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:54.979 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.979 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.979 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:54.979 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:54.979 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 119.818655541, 2024-04-18T21:06:54.979 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023772793, 2024-04-18T21:06:54.979 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:54.979 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:54.979 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:54.979 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:54.979 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:54.980 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:54.980 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 187 2024-04-18T21:06:54.980 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.980 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:54.980 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.980 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:54.980 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:54.980 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:54.980 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.980 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.980 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:54.980 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:54.980 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:54.980 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.980 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.980 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:54.981 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142224+0000", 2024-04-18T21:06:54.981 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.47e-07 2024-04-18T21:06:54.981 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.981 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.981 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:54.981 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142233+0000", 2024-04-18T21:06:54.981 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0729999999999994e-06 2024-04-18T21:06:54.981 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.981 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.981 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:54.981 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142255+0000", 2024-04-18T21:06:54.981 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.2535999999999999e-05 2024-04-18T21:06:54.981 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.981 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.981 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:54.982 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142268+0000", 2024-04-18T21:06:54.982 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2686e-05 2024-04-18T21:06:54.982 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.982 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.982 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:54.982 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160497+0000", 2024-04-18T21:06:54.982 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018228779000000001 2024-04-18T21:06:54.982 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.982 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.982 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:54.982 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160634+0000", 2024-04-18T21:06:54.982 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000137315 2024-04-18T21:06:54.982 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.983 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.983 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:54.983 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160831+0000", 2024-04-18T21:06:54.983 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019683100000000001 2024-04-18T21:06:54.983 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.983 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.983 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:54.983 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165129+0000", 2024-04-18T21:06:54.983 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0042981299999999998 2024-04-18T21:06:54.983 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.983 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.984 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:54.984 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165776+0000", 2024-04-18T21:06:54.984 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00064702900000000003 2024-04-18T21:06:54.984 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.984 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.984 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:54.984 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165921+0000", 2024-04-18T21:06:54.984 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014506 2024-04-18T21:06:54.984 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.984 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.984 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:54.985 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165996+0000", 2024-04-18T21:06:54.985 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.4406999999999994e-05 2024-04-18T21:06:54.985 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:54.985 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:54.985 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:54.985 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.985 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.985 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:54.985 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:54.985 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 119.81859494299999, 2024-04-18T21:06:54.985 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026802157, 2024-04-18T21:06:54.985 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:54.985 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:54.985 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:54.986 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:54.986 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:54.986 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:54.986 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 188 2024-04-18T21:06:54.986 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.986 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:54.986 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.986 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:54.986 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:54.986 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:54.986 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.986 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.987 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:54.987 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:54.987 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:54.987 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.987 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.987 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:54.987 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142284+0000", 2024-04-18T21:06:54.987 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4e-07 2024-04-18T21:06:54.987 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.987 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.987 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:54.987 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142374+0000", 2024-04-18T21:06:54.987 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0099999999999995e-05 2024-04-18T21:06:54.987 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.988 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.988 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:54.988 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142386+0000", 2024-04-18T21:06:54.988 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1770000000000001e-05 2024-04-18T21:06:54.988 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.988 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.988 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:54.988 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142394+0000", 2024-04-18T21:06:54.988 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.2130000000000008e-06 2024-04-18T21:06:54.988 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.988 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.988 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:54.989 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.161743+0000", 2024-04-18T21:06:54.989 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019348644000000002 2024-04-18T21:06:54.989 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.989 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.989 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:54.989 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.161865+0000", 2024-04-18T21:06:54.989 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012210899999999999 2024-04-18T21:06:54.989 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.989 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.989 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:54.989 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.162055+0000", 2024-04-18T21:06:54.989 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000189994 2024-04-18T21:06:54.989 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.990 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.990 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:54.990 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165735+0000", 2024-04-18T21:06:54.990 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0036803270000000002 2024-04-18T21:06:54.990 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.990 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.990 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:54.990 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.168911+0000", 2024-04-18T21:06:54.990 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0031753689999999999 2024-04-18T21:06:54.990 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.990 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.990 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:54.990 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169012+0000", 2024-04-18T21:06:54.990 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010157699999999999 2024-04-18T21:06:54.991 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.991 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.991 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:54.991 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169086+0000", 2024-04-18T21:06:54.991 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3213999999999994e-05 2024-04-18T21:06:54.991 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:54.991 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:54.991 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:54.991 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.991 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.991 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:54.991 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:54.991 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 119.81846963700001, 2024-04-18T21:06:54.991 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026811423000000001, 2024-04-18T21:06:54.991 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:54.992 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:54.992 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:54.992 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:54.992 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:54.992 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:54.992 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 189 2024-04-18T21:06:54.992 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.992 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:54.992 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.992 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:54.992 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:54.992 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:54.992 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.992 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.992 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:54.993 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:54.993 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:54.993 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.993 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.993 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:54.993 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142410+0000", 2024-04-18T21:06:54.993 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:06:54.993 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.993 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.993 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:54.993 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142415+0000", 2024-04-18T21:06:54.993 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.7939999999999999e-06 2024-04-18T21:06:54.993 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.993 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.993 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:54.994 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142470+0000", 2024-04-18T21:06:54.994 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4537999999999999e-05 2024-04-18T21:06:54.994 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.994 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.994 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:54.994 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142481+0000", 2024-04-18T21:06:54.994 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0966e-05 2024-04-18T21:06:54.994 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.994 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.994 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:54.994 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.163493+0000", 2024-04-18T21:06:54.994 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021012444000000002 2024-04-18T21:06:54.994 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.995 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.995 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:54.995 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.163727+0000", 2024-04-18T21:06:54.995 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000233339 2024-04-18T21:06:54.995 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.995 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.995 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:54.995 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.164102+0000", 2024-04-18T21:06:54.995 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000374872 2024-04-18T21:06:54.995 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.995 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.995 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:54.996 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.166528+0000", 2024-04-18T21:06:54.996 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0024258729999999998 2024-04-18T21:06:54.996 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.996 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.996 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:54.996 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169101+0000", 2024-04-18T21:06:54.996 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0025737680000000001 2024-04-18T21:06:54.996 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.996 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.996 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:54.996 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169171+0000", 2024-04-18T21:06:54.996 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0148000000000007e-05 2024-04-18T21:06:54.996 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.996 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.997 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:54.997 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169220+0000", 2024-04-18T21:06:54.997 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8767999999999998e-05 2024-04-18T21:06:54.997 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:54.997 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:54.997 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:54.997 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.997 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.997 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:54.997 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:54.997 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 109.344897085, 2024-04-18T21:06:54.997 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024082777999999999, 2024-04-18T21:06:54.997 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:54.998 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:54.998 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:54.998 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:54.998 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.998 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:54.998 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:54.998 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:54.998 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.998 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.998 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:54.998 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:54.998 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:54.999 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.999 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.999 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:54.999 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615984+0000", 2024-04-18T21:06:54.999 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.9869999999999999e-06 2024-04-18T21:06:54.999 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.999 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.999 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:54.999 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615999+0000", 2024-04-18T21:06:54.999 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4646e-05 2024-04-18T21:06:54.999 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:54.999 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:54.999 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:54.999 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616028+0000", 2024-04-18T21:06:55.000 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8952999999999999e-05 2024-04-18T21:06:55.000 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.000 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.000 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:55.000 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616052+0000", 2024-04-18T21:06:55.000 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.3941999999999999e-05 2024-04-18T21:06:55.000 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.000 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.000 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:55.000 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618010+0000", 2024-04-18T21:06:55.000 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0019581780000000001 2024-04-18T21:06:55.000 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.000 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.000 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:55.000 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618322+0000", 2024-04-18T21:06:55.000 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00031158899999999997 2024-04-18T21:06:55.001 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.001 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.001 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:55.001 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618587+0000", 2024-04-18T21:06:55.001 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00026495700000000002 2024-04-18T21:06:55.001 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.001 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.001 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:55.001 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629262+0000", 2024-04-18T21:06:55.001 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010675877 2024-04-18T21:06:55.002 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.002 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.002 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:55.002 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.639773+0000", 2024-04-18T21:06:55.002 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0105109 2024-04-18T21:06:55.002 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.002 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.002 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:55.002 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.639926+0000", 2024-04-18T21:06:55.002 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000152349 2024-04-18T21:06:55.002 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.002 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.002 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:55.003 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640064+0000", 2024-04-18T21:06:55.003 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0001384 2024-04-18T21:06:55.003 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:55.003 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:55.003 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:55.003 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.003 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.003 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:55.003 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:55.003 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 109.34478441100001, 2024-04-18T21:06:55.003 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030215005999999999, 2024-04-18T21:06:55.003 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:55.003 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:55.003 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:55.004 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:55.004 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.004 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:55.004 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:55.004 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:55.004 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.004 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.004 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:55.004 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:55.004 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:55.004 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.004 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.004 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:55.004 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616095+0000", 2024-04-18T21:06:55.004 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.446e-06 2024-04-18T21:06:55.005 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.005 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.005 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:55.005 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616104+0000", 2024-04-18T21:06:55.005 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6200000000000005e-06 2024-04-18T21:06:55.005 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.005 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.005 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:55.005 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616132+0000", 2024-04-18T21:06:55.005 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7668999999999999e-05 2024-04-18T21:06:55.005 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.005 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.005 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:55.006 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616149+0000", 2024-04-18T21:06:55.006 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7047000000000001e-05 2024-04-18T21:06:55.006 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.006 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.006 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:55.006 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619287+0000", 2024-04-18T21:06:55.006 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0031381450000000002 2024-04-18T21:06:55.006 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.006 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.006 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:55.006 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619503+0000", 2024-04-18T21:06:55.006 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000216522 2024-04-18T21:06:55.006 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.006 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.007 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:55.007 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619930+0000", 2024-04-18T21:06:55.007 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00042604900000000001 2024-04-18T21:06:55.007 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.007 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.007 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:55.007 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629281+0000", 2024-04-18T21:06:55.007 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0093512230000000005 2024-04-18T21:06:55.007 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.007 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.007 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:55.007 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646022+0000", 2024-04-18T21:06:55.007 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016741156 2024-04-18T21:06:55.007 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.008 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.008 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:55.008 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646198+0000", 2024-04-18T21:06:55.008 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000176009 2024-04-18T21:06:55.008 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.008 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.008 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:55.008 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646309+0000", 2024-04-18T21:06:55.008 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011112000000000001 2024-04-18T21:06:55.008 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:55.008 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:55.008 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:55.008 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.008 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.009 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:55.009 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:55.009 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 109.34469958699999, 2024-04-18T21:06:55.009 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030501176000000001, 2024-04-18T21:06:55.009 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:55.009 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:55.009 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:55.009 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:55.009 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.009 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:55.009 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:55.009 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:55.009 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.010 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.010 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:55.010 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:55.010 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:55.010 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.010 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.010 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:55.010 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616180+0000", 2024-04-18T21:06:55.010 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1000000000000001e-06 2024-04-18T21:06:55.010 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.010 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.011 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:55.011 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616188+0000", 2024-04-18T21:06:55.011 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4069999999999993e-06 2024-04-18T21:06:55.011 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.011 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.011 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:55.011 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616207+0000", 2024-04-18T21:06:55.011 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8335999999999999e-05 2024-04-18T21:06:55.011 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.011 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.011 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:55.011 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616225+0000", 2024-04-18T21:06:55.011 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8652999999999999e-05 2024-04-18T21:06:55.012 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.012 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.012 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:55.012 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620977+0000", 2024-04-18T21:06:55.012 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047512220000000003 2024-04-18T21:06:55.012 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.012 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.012 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:55.012 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621279+0000", 2024-04-18T21:06:55.012 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000302646 2024-04-18T21:06:55.012 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.012 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.012 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:55.012 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621584+0000", 2024-04-18T21:06:55.013 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000305142 2024-04-18T21:06:55.013 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.013 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.013 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:55.013 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629352+0000", 2024-04-18T21:06:55.013 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0077673689999999997 2024-04-18T21:06:55.013 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.013 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.013 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:55.013 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646480+0000", 2024-04-18T21:06:55.013 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017128259 2024-04-18T21:06:55.013 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.013 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.013 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:55.014 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646591+0000", 2024-04-18T21:06:55.014 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011113899999999999 2024-04-18T21:06:55.014 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.014 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.014 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:55.014 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646680+0000", 2024-04-18T21:06:55.014 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8902999999999999e-05 2024-04-18T21:06:55.014 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:55.014 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:55.014 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:55.014 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.014 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.014 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:55.015 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:55.015 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 109.34463308799999, 2024-04-18T21:06:55.015 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030779760999999999, 2024-04-18T21:06:55.015 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:55.015 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:55.015 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:55.015 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:55.015 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.015 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:55.015 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:55.015 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:55.015 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.015 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.015 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:55.015 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:55.015 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:55.016 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.016 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.016 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:55.016 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616246+0000", 2024-04-18T21:06:55.016 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0499999999999999e-06 2024-04-18T21:06:55.016 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.016 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.016 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:55.016 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616253+0000", 2024-04-18T21:06:55.016 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.5989999999999998e-06 2024-04-18T21:06:55.016 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.016 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.016 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:55.016 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616273+0000", 2024-04-18T21:06:55.016 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9916999999999999e-05 2024-04-18T21:06:55.017 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.017 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.017 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:55.017 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616287+0000", 2024-04-18T21:06:55.017 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3669000000000001e-05 2024-04-18T21:06:55.017 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.017 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.017 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:55.017 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622203+0000", 2024-04-18T21:06:55.017 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.005916737 2024-04-18T21:06:55.017 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.017 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.017 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:55.017 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622379+0000", 2024-04-18T21:06:55.017 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000175596 2024-04-18T21:06:55.018 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.018 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.018 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:55.018 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622707+0000", 2024-04-18T21:06:55.018 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00032784600000000002 2024-04-18T21:06:55.018 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.018 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.018 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:55.018 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629366+0000", 2024-04-18T21:06:55.018 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0066593279999999999 2024-04-18T21:06:55.018 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.018 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.018 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:55.019 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646813+0000", 2024-04-18T21:06:55.019 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017447059000000001 2024-04-18T21:06:55.019 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.019 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.019 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:55.019 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646946+0000", 2024-04-18T21:06:55.019 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013301200000000001 2024-04-18T21:06:55.019 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.019 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.019 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:55.019 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647025+0000", 2024-04-18T21:06:55.019 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8948000000000004e-05 2024-04-18T21:06:55.019 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:55.019 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:55.019 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:55.020 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.020 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.020 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:55.020 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:55.020 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 109.34454927, 2024-04-18T21:06:55.020 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.031512165000000002, 2024-04-18T21:06:55.020 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:55.020 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:55.020 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:55.020 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:55.020 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.020 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:55.020 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:55.020 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:55.020 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.020 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.021 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:55.021 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:55.021 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:55.021 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.021 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.021 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:55.021 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616330+0000", 2024-04-18T21:06:55.021 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.15e-06 2024-04-18T21:06:55.021 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.021 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.021 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:55.021 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616337+0000", 2024-04-18T21:06:55.021 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.1289999999999998e-06 2024-04-18T21:06:55.021 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.021 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.021 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:55.022 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616447+0000", 2024-04-18T21:06:55.022 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109561 2024-04-18T21:06:55.022 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.022 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.022 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:55.022 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616496+0000", 2024-04-18T21:06:55.022 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8591999999999998e-05 2024-04-18T21:06:55.022 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.022 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.022 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:55.022 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.623786+0000", 2024-04-18T21:06:55.022 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0072906799999999999 2024-04-18T21:06:55.022 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.022 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.022 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:55.023 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.623973+0000", 2024-04-18T21:06:55.023 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018717199999999999 2024-04-18T21:06:55.023 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.023 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.023 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:55.023 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624260+0000", 2024-04-18T21:06:55.023 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00028630600000000001 2024-04-18T21:06:55.023 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.023 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.023 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:55.023 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629381+0000", 2024-04-18T21:06:55.023 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0051211340000000003 2024-04-18T21:06:55.023 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.023 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.023 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:55.024 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647631+0000", 2024-04-18T21:06:55.024 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018249771000000001 2024-04-18T21:06:55.024 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.024 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.024 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:55.024 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647761+0000", 2024-04-18T21:06:55.024 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013037300000000001 2024-04-18T21:06:55.024 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.024 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.024 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:55.024 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647841+0000", 2024-04-18T21:06:55.024 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.0296999999999994e-05 2024-04-18T21:06:55.024 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:55.024 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:55.024 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:55.024 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.025 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.025 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:55.025 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:55.025 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 109.344343786, 2024-04-18T21:06:55.025 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043251955000000002, 2024-04-18T21:06:55.025 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:55.025 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:55.025 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:55.025 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:55.025 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.025 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:55.025 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:55.025 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:55.025 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.025 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.025 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:55.026 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:55.026 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:55.026 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.026 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.026 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:55.026 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616536+0000", 2024-04-18T21:06:55.026 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2869999999999999e-06 2024-04-18T21:06:55.026 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.026 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.026 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:55.026 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616572+0000", 2024-04-18T21:06:55.026 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.6261999999999999e-05 2024-04-18T21:06:55.026 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.026 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.026 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:55.026 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616593+0000", 2024-04-18T21:06:55.027 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1310000000000001e-05 2024-04-18T21:06:55.027 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.027 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.027 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:55.027 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616614+0000", 2024-04-18T21:06:55.027 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.0936000000000001e-05 2024-04-18T21:06:55.027 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.027 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.027 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:55.027 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629501+0000", 2024-04-18T21:06:55.027 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.012886819000000001 2024-04-18T21:06:55.027 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.027 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.027 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:55.027 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629696+0000", 2024-04-18T21:06:55.027 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019485499999999999 2024-04-18T21:06:55.028 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.028 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.028 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:55.028 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629940+0000", 2024-04-18T21:06:55.028 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00024386399999999999 2024-04-18T21:06:55.028 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.028 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.028 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:55.028 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640100+0000", 2024-04-18T21:06:55.028 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010159645 2024-04-18T21:06:55.028 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.028 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.028 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:55.028 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659516+0000", 2024-04-18T21:06:55.028 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019416563000000001 2024-04-18T21:06:55.028 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.029 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.029 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:55.029 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659684+0000", 2024-04-18T21:06:55.029 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016750900000000001 2024-04-18T21:06:55.029 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.029 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.029 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:55.029 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659787+0000", 2024-04-18T21:06:55.029 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000102905 2024-04-18T21:06:55.029 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:55.029 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:55.029 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:55.029 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.029 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.029 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:55.029 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:55.030 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 109.344238664, 2024-04-18T21:06:55.030 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043581898000000001, 2024-04-18T21:06:55.030 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:55.030 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:55.030 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:55.030 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:55.030 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.030 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:55.030 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:55.030 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:55.030 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.030 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.030 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:55.030 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:55.031 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:55.031 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.031 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.031 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:55.031 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616641+0000", 2024-04-18T21:06:55.031 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:06:55.031 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.031 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.031 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:55.031 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616648+0000", 2024-04-18T21:06:55.031 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3860000000000001e-06 2024-04-18T21:06:55.031 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.031 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.031 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:55.031 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616666+0000", 2024-04-18T21:06:55.031 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7583000000000001e-05 2024-04-18T21:06:55.032 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.032 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.032 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:55.032 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616679+0000", 2024-04-18T21:06:55.032 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3322999999999999e-05 2024-04-18T21:06:55.032 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.032 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.032 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:55.032 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630373+0000", 2024-04-18T21:06:55.032 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013694207999999999 2024-04-18T21:06:55.032 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.032 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.032 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:55.033 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630545+0000", 2024-04-18T21:06:55.033 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000171683 2024-04-18T21:06:55.033 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.033 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.033 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:55.033 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630728+0000", 2024-04-18T21:06:55.033 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000182599 2024-04-18T21:06:55.033 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.033 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.033 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:55.033 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640600+0000", 2024-04-18T21:06:55.033 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0098726119999999994 2024-04-18T21:06:55.033 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.034 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.034 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:55.034 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659927+0000", 2024-04-18T21:06:55.034 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019326724999999999 2024-04-18T21:06:55.034 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.034 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.034 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:55.034 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660112+0000", 2024-04-18T21:06:55.034 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000185203 2024-04-18T21:06:55.034 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.034 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.034 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:55.034 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660222+0000", 2024-04-18T21:06:55.034 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109343 2024-04-18T21:06:55.035 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:55.035 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:55.035 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:55.035 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.035 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.035 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:55.035 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:55.035 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 109.343373306, 2024-04-18T21:06:55.035 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043121310000000003, 2024-04-18T21:06:55.035 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:55.035 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:55.035 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:55.035 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:55.035 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.035 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:55.036 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:55.036 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:55.036 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.036 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.036 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:55.036 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:55.036 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:55.036 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.036 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.036 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:55.036 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617506+0000", 2024-04-18T21:06:55.036 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9999999999999995e-07 2024-04-18T21:06:55.036 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.036 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.037 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:55.037 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617513+0000", 2024-04-18T21:06:55.037 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.9700000000000002e-06 2024-04-18T21:06:55.037 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.037 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.037 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:55.037 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617531+0000", 2024-04-18T21:06:55.037 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8105999999999999e-05 2024-04-18T21:06:55.037 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.037 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.037 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:55.037 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617545+0000", 2024-04-18T21:06:55.037 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3703000000000001e-05 2024-04-18T21:06:55.037 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.037 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.038 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:55.038 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632129+0000", 2024-04-18T21:06:55.038 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.014584135999999999 2024-04-18T21:06:55.038 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.038 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.038 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:55.038 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632361+0000", 2024-04-18T21:06:55.038 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023171800000000001 2024-04-18T21:06:55.038 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.038 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.038 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:55.039 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632804+0000", 2024-04-18T21:06:55.039 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000443549 2024-04-18T21:06:55.039 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.039 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.039 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:55.039 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646340+0000", 2024-04-18T21:06:55.039 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013535902000000001 2024-04-18T21:06:55.039 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.039 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.039 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:55.039 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660363+0000", 2024-04-18T21:06:55.039 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01402318 2024-04-18T21:06:55.039 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.040 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.040 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:55.040 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660523+0000", 2024-04-18T21:06:55.040 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00015989899999999999 2024-04-18T21:06:55.040 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.040 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.040 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:55.040 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660626+0000", 2024-04-18T21:06:55.040 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010314699999999999 2024-04-18T21:06:55.040 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:55.040 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:55.040 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:55.040 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.040 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.040 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:55.040 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:55.040 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 109.343233613, 2024-04-18T21:06:55.041 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024927483, 2024-04-18T21:06:55.041 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:55.041 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:55.041 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:55.041 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:55.041 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.041 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:55.041 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:55.041 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:55.041 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.041 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.041 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:55.041 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:55.041 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:55.042 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.042 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.042 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:55.042 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617646+0000", 2024-04-18T21:06:55.042 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3030000000000001e-06 2024-04-18T21:06:55.042 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.042 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.042 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:55.042 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617653+0000", 2024-04-18T21:06:55.042 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7530000000000004e-06 2024-04-18T21:06:55.042 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.042 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.042 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:55.042 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617673+0000", 2024-04-18T21:06:55.043 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9967e-05 2024-04-18T21:06:55.043 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.043 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.043 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:55.043 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617688+0000", 2024-04-18T21:06:55.043 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5153e-05 2024-04-18T21:06:55.043 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.043 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.043 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:55.043 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619244+0000", 2024-04-18T21:06:55.043 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001555531 2024-04-18T21:06:55.043 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.043 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.043 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:55.043 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619361+0000", 2024-04-18T21:06:55.044 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011784400000000001 2024-04-18T21:06:55.044 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.044 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.044 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:55.044 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619604+0000", 2024-04-18T21:06:55.044 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000243007 2024-04-18T21:06:55.044 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.044 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.044 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:55.044 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.625480+0000", 2024-04-18T21:06:55.044 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0058759349999999997 2024-04-18T21:06:55.044 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.044 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.044 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:55.044 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642342+0000", 2024-04-18T21:06:55.045 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016861373999999998 2024-04-18T21:06:55.045 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.045 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.045 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:55.045 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642484+0000", 2024-04-18T21:06:55.045 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000142423 2024-04-18T21:06:55.045 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.045 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.045 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:55.045 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642572+0000", 2024-04-18T21:06:55.045 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8193000000000001e-05 2024-04-18T21:06:55.045 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:55.045 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:55.045 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:55.045 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.045 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.046 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:55.046 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:55.046 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 109.34295211, 2024-04-18T21:06:55.046 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024956974999999999, 2024-04-18T21:06:55.046 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:55.046 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:55.046 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:55.046 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:55.046 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.046 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:55.046 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:55.046 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:55.046 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.046 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.046 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:55.046 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:55.047 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:55.047 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.047 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.047 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:55.047 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617928+0000", 2024-04-18T21:06:55.047 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5430000000000001e-06 2024-04-18T21:06:55.047 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.047 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.047 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:55.047 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617937+0000", 2024-04-18T21:06:55.047 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6629999999999999e-06 2024-04-18T21:06:55.047 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.047 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.047 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:55.048 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617955+0000", 2024-04-18T21:06:55.048 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8749999999999998e-05 2024-04-18T21:06:55.048 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.048 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.048 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:55.048 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617971+0000", 2024-04-18T21:06:55.048 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.605e-05 2024-04-18T21:06:55.048 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.048 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.048 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:55.048 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621019+0000", 2024-04-18T21:06:55.048 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0030472369999999999 2024-04-18T21:06:55.048 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.048 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.048 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:55.049 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621249+0000", 2024-04-18T21:06:55.049 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000230075 2024-04-18T21:06:55.049 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.049 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.049 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:55.049 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621450+0000", 2024-04-18T21:06:55.049 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020166499999999999 2024-04-18T21:06:55.049 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.049 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.049 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:55.049 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.626233+0000", 2024-04-18T21:06:55.049 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047827390000000003 2024-04-18T21:06:55.049 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.049 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.049 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:55.050 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642693+0000", 2024-04-18T21:06:55.050 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01645961 2024-04-18T21:06:55.050 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.050 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.050 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:55.050 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642798+0000", 2024-04-18T21:06:55.050 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010559499999999999 2024-04-18T21:06:55.050 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.050 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.050 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:55.050 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642883+0000", 2024-04-18T21:06:55.050 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5048000000000003e-05 2024-04-18T21:06:55.050 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:55.051 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:55.051 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:55.051 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.051 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.051 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:55.051 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:55.051 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 109.34125648200001, 2024-04-18T21:06:55.051 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024086478000000001, 2024-04-18T21:06:55.051 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:55.051 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:55.051 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:55.051 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:55.051 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.051 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:55.051 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:55.052 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:55.052 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.052 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.052 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:55.052 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:55.052 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:55.052 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.052 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.052 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:55.052 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619624+0000", 2024-04-18T21:06:55.052 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.75e-06 2024-04-18T21:06:55.052 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.053 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.053 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:55.053 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619637+0000", 2024-04-18T21:06:55.053 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3540000000000001e-05 2024-04-18T21:06:55.053 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.053 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.053 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:55.053 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619666+0000", 2024-04-18T21:06:55.053 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8685999999999999e-05 2024-04-18T21:06:55.053 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.053 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.053 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:55.053 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619685+0000", 2024-04-18T21:06:55.053 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8681999999999998e-05 2024-04-18T21:06:55.053 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.054 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.054 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:55.054 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622275+0000", 2024-04-18T21:06:55.054 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0025899260000000002 2024-04-18T21:06:55.054 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.054 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.054 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:55.054 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622572+0000", 2024-04-18T21:06:55.054 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00029722 2024-04-18T21:06:55.054 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.054 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.054 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:55.054 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622752+0000", 2024-04-18T21:06:55.054 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018065900000000001 2024-04-18T21:06:55.054 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.055 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.055 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:55.055 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.626326+0000", 2024-04-18T21:06:55.055 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035737310000000001 2024-04-18T21:06:55.055 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.055 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.055 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:55.055 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643565+0000", 2024-04-18T21:06:55.055 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017238430999999999 2024-04-18T21:06:55.055 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.055 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.055 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:55.055 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643646+0000", 2024-04-18T21:06:55.055 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.1481000000000001e-05 2024-04-18T21:06:55.055 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.055 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.056 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:55.056 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643708+0000", 2024-04-18T21:06:55.056 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.2372000000000005e-05 2024-04-18T21:06:55.056 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:55.056 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:55.056 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:55.056 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.056 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.056 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:55.056 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:55.056 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 109.341090329, 2024-04-18T21:06:55.056 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026822450000000001, 2024-04-18T21:06:55.056 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:55.057 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:55.057 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:55.057 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:55.057 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.057 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:55.057 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:55.057 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:55.057 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.057 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.057 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:55.057 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:55.057 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:55.058 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.058 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.058 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:55.058 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619789+0000", 2024-04-18T21:06:55.058 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:06:55.058 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.058 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.058 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:55.058 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619797+0000", 2024-04-18T21:06:55.058 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.6899999999999992e-06 2024-04-18T21:06:55.058 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.059 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.059 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:55.059 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619816+0000", 2024-04-18T21:06:55.059 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9352999999999999e-05 2024-04-18T21:06:55.059 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.059 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.059 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:55.059 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619832+0000", 2024-04-18T21:06:55.059 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6013000000000001e-05 2024-04-18T21:06:55.059 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.059 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.059 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:55.059 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620528+0000", 2024-04-18T21:06:55.059 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00069565600000000001 2024-04-18T21:06:55.059 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.059 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.060 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:55.060 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620735+0000", 2024-04-18T21:06:55.060 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000207025 2024-04-18T21:06:55.060 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.060 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.060 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:55.060 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620912+0000", 2024-04-18T21:06:55.060 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017748199999999999 2024-04-18T21:06:55.060 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.060 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.060 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:55.060 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.625605+0000", 2024-04-18T21:06:55.060 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0046924439999999996 2024-04-18T21:06:55.060 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.060 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.061 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:55.061 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646349+0000", 2024-04-18T21:06:55.061 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.020744318000000001 2024-04-18T21:06:55.061 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.061 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.061 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:55.061 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646483+0000", 2024-04-18T21:06:55.061 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013428999999999999 2024-04-18T21:06:55.061 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.061 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.061 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:55.061 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646611+0000", 2024-04-18T21:06:55.061 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012710299999999999 2024-04-18T21:06:55.062 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:55.062 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:55.062 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:55.062 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.062 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.062 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:10648 4.1e 4:78e5e06c:::100000030c5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:06:55.062 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:54.081572+0000", 2024-04-18T21:06:55.062 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.87930610099999995, 2024-04-18T21:06:55.062 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.029353989, 2024-04-18T21:06:55.062 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:55.062 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:55.062 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:55.063 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:55.063 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:06:55.063 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:55.063 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 10648 2024-04-18T21:06:55.063 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.063 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:55.063 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.063 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:55.063 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:54.081572+0000", 2024-04-18T21:06:55.063 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:55.063 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.063 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.064 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:55.064 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:54.081572+0000", 2024-04-18T21:06:55.064 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:55.064 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.064 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.064 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:55.064 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:54.081575+0000", 2024-04-18T21:06:55.064 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.5129999999999999e-06 2024-04-18T21:06:55.064 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.064 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.064 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:55.064 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:54.091255+0000", 2024-04-18T21:06:55.064 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0096798330000000005 2024-04-18T21:06:55.064 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.064 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.065 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:55.065 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:54.091287+0000", 2024-04-18T21:06:55.065 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.2339999999999999e-05 2024-04-18T21:06:55.065 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.065 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.065 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:55.065 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:54.091306+0000", 2024-04-18T21:06:55.065 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9360000000000001e-05 2024-04-18T21:06:55.065 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.065 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.065 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:55.065 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:54.091438+0000", 2024-04-18T21:06:55.065 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013156499999999999 2024-04-18T21:06:55.065 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.066 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.066 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:55.066 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:54.091686+0000", 2024-04-18T21:06:55.066 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00024800700000000001 2024-04-18T21:06:55.066 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.066 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.066 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:55.066 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:54.091990+0000", 2024-04-18T21:06:55.066 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00030370100000000003 2024-04-18T21:06:55.066 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.066 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.066 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:55.067 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:54.108022+0000", 2024-04-18T21:06:55.067 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016031894000000001 2024-04-18T21:06:55.067 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.067 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.067 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:55.067 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:54.110767+0000", 2024-04-18T21:06:55.067 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0027452650000000002 2024-04-18T21:06:55.067 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.067 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.067 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:55.067 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:54.110857+0000", 2024-04-18T21:06:55.067 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0295000000000002e-05 2024-04-18T21:06:55.067 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.067 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.068 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:55.068 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:54.110926+0000", 2024-04-18T21:06:55.068 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.9215999999999996e-05 2024-04-18T21:06:55.068 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:55.068 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:55.068 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:55.068 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.068 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.068 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:265 3.13 3:ceffbd45:::200.0000000a:head [write 2989882~18774 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-18T21:06:55.068 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:54.136247+0000", 2024-04-18T21:06:55.068 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.82463126600000003, 2024-04-18T21:06:55.068 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024117454999999999, 2024-04-18T21:06:55.068 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:55.068 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:55.069 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:55.069 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:55.069 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.069 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:55.069 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:54.136247+0000", 2024-04-18T21:06:55.069 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:55.069 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.069 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.069 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:55.069 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:54.136247+0000", 2024-04-18T21:06:55.069 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:55.069 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.069 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.069 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:55.069 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:54.136249+0000", 2024-04-18T21:06:55.069 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1859999999999999e-06 2024-04-18T21:06:55.070 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.070 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.070 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:55.070 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:54.136281+0000", 2024-04-18T21:06:55.070 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.1653999999999999e-05 2024-04-18T21:06:55.070 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.070 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.070 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:55.070 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:54.136302+0000", 2024-04-18T21:06:55.070 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1073e-05 2024-04-18T21:06:55.070 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.070 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.070 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:55.070 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:54.136314+0000", 2024-04-18T21:06:55.070 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1883e-05 2024-04-18T21:06:55.070 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.071 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.071 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:55.071 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:54.136440+0000", 2024-04-18T21:06:55.071 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000126384 2024-04-18T21:06:55.071 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.071 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.071 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:55.071 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:54.136644+0000", 2024-04-18T21:06:55.071 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020357799999999999 2024-04-18T21:06:55.071 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.071 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.071 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:55.071 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:54.136885+0000", 2024-04-18T21:06:55.071 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00024144600000000001 2024-04-18T21:06:55.071 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.072 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.072 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:55.072 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:54.141955+0000", 2024-04-18T21:06:55.072 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0050695410000000003 2024-04-18T21:06:55.072 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.072 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.072 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:55.072 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:54.159888+0000", 2024-04-18T21:06:55.072 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017933278 2024-04-18T21:06:55.072 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.072 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.072 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:55.072 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:54.160179+0000", 2024-04-18T21:06:55.073 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00029060700000000002 2024-04-18T21:06:55.073 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:55.073 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:55.073 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:55.073 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:54.160365+0000", 2024-04-18T21:06:55.073 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000185825 2024-04-18T21:06:55.073 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:55.073 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:55.073 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:55.073 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:55.073 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:55.073 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:55.075 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:55.075 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:55.074+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:55.175 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:55.174+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:55.207 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:55.207 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:06:55.207 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-04-18T21:06:55.207 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:55.222 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:55.277 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:55.274+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:55.378 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:55.374+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:55.389 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:55.389 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:06:55.389 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-18T21:06:55.389 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-18T21:06:55.389 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:55.404 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:55.479 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:55.478+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:55.531 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:55.531 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-18T21:06:55.531 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-18T21:06:55.531 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:06:55.531 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.531 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:55.531 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:55.532 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 109.914471319, 2024-04-18T21:06:55.532 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045668994999999997, 2024-04-18T21:06:55.532 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:55.532 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:55.532 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:55.532 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:55.532 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.532 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:55.532 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:55.532 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:55.532 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.532 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.532 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:55.532 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:55.533 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:55.533 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.533 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.533 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:55.533 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615459+0000", 2024-04-18T21:06:55.533 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5030000000000001e-06 2024-04-18T21:06:55.533 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.533 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.533 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:55.533 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615506+0000", 2024-04-18T21:06:55.533 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6872000000000001e-05 2024-04-18T21:06:55.533 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.533 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.534 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:55.534 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615527+0000", 2024-04-18T21:06:55.534 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0763000000000001e-05 2024-04-18T21:06:55.534 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.534 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.534 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:55.534 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615551+0000", 2024-04-18T21:06:55.534 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4159e-05 2024-04-18T21:06:55.534 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.534 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.534 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:55.534 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615736+0000", 2024-04-18T21:06:55.534 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018499599999999999 2024-04-18T21:06:55.534 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.535 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.535 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:55.535 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615748+0000", 2024-04-18T21:06:55.535 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2272999999999999e-05 2024-04-18T21:06:55.535 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.535 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.535 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:55.535 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635481+0000", 2024-04-18T21:06:55.535 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019732772999999999 2024-04-18T21:06:55.535 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.535 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.535 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:55.535 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635791+0000", 2024-04-18T21:06:55.535 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031013299999999998 2024-04-18T21:06:55.535 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.536 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.536 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:55.536 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636101+0000", 2024-04-18T21:06:55.536 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030943300000000002 2024-04-18T21:06:55.536 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.536 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.536 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:55.536 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646043+0000", 2024-04-18T21:06:55.536 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099428139999999995 2024-04-18T21:06:55.536 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.536 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.536 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:55.536 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660991+0000", 2024-04-18T21:06:55.536 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014947142 2024-04-18T21:06:55.536 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.537 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.537 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:55.537 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661061+0000", 2024-04-18T21:06:55.537 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0438000000000006e-05 2024-04-18T21:06:55.537 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.537 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.537 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:55.537 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661127+0000", 2024-04-18T21:06:55.537 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5696000000000003e-05 2024-04-18T21:06:55.537 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:55.537 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:55.537 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:55.537 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.537 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.538 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:55.538 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:55.538 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 109.914258891, 2024-04-18T21:06:55.538 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045745085999999997, 2024-04-18T21:06:55.538 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:55.538 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:55.538 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:55.538 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:55.538 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.538 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:55.538 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:55.538 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:55.539 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.539 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.539 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:55.539 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:55.539 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:55.539 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.539 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.539 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:55.539 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:06:55.539 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7400000000000001e-06 2024-04-18T21:06:55.539 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.539 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.539 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:55.539 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:06:55.540 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8133e-05 2024-04-18T21:06:55.540 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.540 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.540 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:55.540 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615726+0000", 2024-04-18T21:06:55.540 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6132e-05 2024-04-18T21:06:55.540 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.540 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.540 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:55.540 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615742+0000", 2024-04-18T21:06:55.540 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6157000000000001e-05 2024-04-18T21:06:55.541 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.541 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.541 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:55.541 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615937+0000", 2024-04-18T21:06:55.541 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000194768 2024-04-18T21:06:55.541 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.541 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.541 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:55.541 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615950+0000", 2024-04-18T21:06:55.541 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3084e-05 2024-04-18T21:06:55.541 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.541 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.541 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:55.541 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643676+0000", 2024-04-18T21:06:55.542 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027725639999999999 2024-04-18T21:06:55.542 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.542 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.542 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:55.542 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643867+0000", 2024-04-18T21:06:55.542 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019075900000000001 2024-04-18T21:06:55.542 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.542 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.542 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:55.542 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:06:55.542 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036013799999999997 2024-04-18T21:06:55.542 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.542 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.543 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:55.543 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646068+0000", 2024-04-18T21:06:55.543 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001841536 2024-04-18T21:06:55.543 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.543 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.543 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:55.543 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661184+0000", 2024-04-18T21:06:55.543 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015115458999999999 2024-04-18T21:06:55.543 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.543 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.543 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:55.544 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661283+0000", 2024-04-18T21:06:55.544 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9502999999999999e-05 2024-04-18T21:06:55.544 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.544 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.544 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:55.544 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661415+0000", 2024-04-18T21:06:55.544 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000132037 2024-04-18T21:06:55.544 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:55.544 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:55.544 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:55.544 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.544 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.544 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:55.545 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:55.545 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 109.913738443, 2024-04-18T21:06:55.545 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043572403000000003, 2024-04-18T21:06:55.545 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:55.545 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:55.545 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:55.545 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:55.545 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.545 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:55.545 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:55.545 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:55.545 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.545 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.545 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:55.545 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:55.546 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:55.546 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.546 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.546 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:55.546 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616192+0000", 2024-04-18T21:06:55.546 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:06:55.546 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.546 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.546 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:55.546 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616203+0000", 2024-04-18T21:06:55.546 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0890000000000001e-05 2024-04-18T21:06:55.546 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.546 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.546 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:55.547 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616223+0000", 2024-04-18T21:06:55.547 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0409000000000001e-05 2024-04-18T21:06:55.547 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.547 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.547 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:55.547 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616238+0000", 2024-04-18T21:06:55.547 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5160000000000001e-05 2024-04-18T21:06:55.547 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.547 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.547 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:55.547 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616343+0000", 2024-04-18T21:06:55.547 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000104831 2024-04-18T21:06:55.547 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.547 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.547 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:55.548 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616357+0000", 2024-04-18T21:06:55.548 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3686000000000001e-05 2024-04-18T21:06:55.548 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.548 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.548 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:55.548 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635912+0000", 2024-04-18T21:06:55.548 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019554944000000001 2024-04-18T21:06:55.548 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.548 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.548 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:55.548 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636231+0000", 2024-04-18T21:06:55.548 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000318766 2024-04-18T21:06:55.548 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.548 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.548 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:55.549 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659763+0000", 2024-04-18T21:06:55.549 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023532474000000001 2024-04-18T21:06:55.549 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:55.549 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:55.549 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:55.549 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.549 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.549 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:99 3.1f 3:f83d65d8:::200.00000004:head [write 313655~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:55.549 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757646+0000", 2024-04-18T21:06:55.549 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.7722826630000004, 2024-04-18T21:06:55.549 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043356459999999999, 2024-04-18T21:06:55.549 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:55.549 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:55.549 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:55.550 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:55.550 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.550 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:55.550 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757646+0000", 2024-04-18T21:06:55.550 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:55.550 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.550 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.550 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:55.550 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757646+0000", 2024-04-18T21:06:55.550 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:55.551 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.551 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.551 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:55.551 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757647+0000", 2024-04-18T21:06:55.551 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.44e-07 2024-04-18T21:06:55.551 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.551 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.551 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:55.551 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757656+0000", 2024-04-18T21:06:55.551 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6559999999999998e-06 2024-04-18T21:06:55.551 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.551 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.551 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:55.551 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757665+0000", 2024-04-18T21:06:55.551 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.6099999999999995e-06 2024-04-18T21:06:55.552 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.552 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.552 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:55.552 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757672+0000", 2024-04-18T21:06:55.552 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7270000000000001e-06 2024-04-18T21:06:55.552 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.552 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.552 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:55.552 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.794854+0000", 2024-04-18T21:06:55.552 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.037182448999999999 2024-04-18T21:06:55.552 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.552 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.552 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:55.552 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.795081+0000", 2024-04-18T21:06:55.552 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000226689 2024-04-18T21:06:55.552 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.553 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.553 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:55.553 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.795369+0000", 2024-04-18T21:06:55.553 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028752600000000003 2024-04-18T21:06:55.553 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.553 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.553 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:55.553 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.799725+0000", 2024-04-18T21:06:55.553 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043563509999999996 2024-04-18T21:06:55.553 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.553 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.553 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:55.553 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.800863+0000", 2024-04-18T21:06:55.553 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0011377799999999999 2024-04-18T21:06:55.553 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.554 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.554 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:55.554 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.800918+0000", 2024-04-18T21:06:55.554 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5547999999999997e-05 2024-04-18T21:06:55.554 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.554 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.554 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:55.554 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.801003+0000", 2024-04-18T21:06:55.554 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4480000000000004e-05 2024-04-18T21:06:55.554 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:55.554 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:55.554 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:55.554 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.554 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.555 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:100 3.1f 3:f83d65d8:::200.00000004:head [write 315055~1400 [fadvise_dontneed] in=1400b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:55.555 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757681+0000", 2024-04-18T21:06:55.555 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.7722480429999994, 2024-04-18T21:06:55.555 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045364542000000001, 2024-04-18T21:06:55.555 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:55.555 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:55.555 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:55.555 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:55.555 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.555 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:55.555 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757681+0000", 2024-04-18T21:06:55.555 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:55.555 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.555 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.555 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:55.555 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757681+0000", 2024-04-18T21:06:55.556 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:55.556 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.556 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.556 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:55.556 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757682+0000", 2024-04-18T21:06:55.556 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8999999999999996e-07 2024-04-18T21:06:55.556 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.556 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.556 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:55.556 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757685+0000", 2024-04-18T21:06:55.556 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.766e-06 2024-04-18T21:06:55.556 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.556 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.556 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:55.556 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757715+0000", 2024-04-18T21:06:55.557 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9904e-05 2024-04-18T21:06:55.557 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.557 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.557 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:55.557 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757723+0000", 2024-04-18T21:06:55.557 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9899999999999997e-06 2024-04-18T21:06:55.557 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.557 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.557 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:55.557 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.796754+0000", 2024-04-18T21:06:55.557 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.039030774999999997 2024-04-18T21:06:55.557 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.557 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.557 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:55.557 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.796825+0000", 2024-04-18T21:06:55.557 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0511000000000003e-05 2024-04-18T21:06:55.557 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.558 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.558 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:55.558 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.796952+0000", 2024-04-18T21:06:55.558 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012720099999999999 2024-04-18T21:06:55.558 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.558 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.558 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:55.558 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.800774+0000", 2024-04-18T21:06:55.558 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0038226039999999998 2024-04-18T21:06:55.558 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.558 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.558 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:55.558 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802920+0000", 2024-04-18T21:06:55.558 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002145194 2024-04-18T21:06:55.559 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.559 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.559 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:55.559 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802998+0000", 2024-04-18T21:06:55.559 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7836000000000005e-05 2024-04-18T21:06:55.559 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.559 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.559 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:55.559 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803046+0000", 2024-04-18T21:06:55.559 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8071000000000001e-05 2024-04-18T21:06:55.559 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:55.559 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:55.559 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:55.559 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.559 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.560 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:101 3.1f 3:f83d65d8:::200.00000004:head [write 316455~1401 [fadvise_dontneed] in=1401b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:55.560 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:06:55.560 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.77219528, 2024-04-18T21:06:55.560 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.048270212999999999, 2024-04-18T21:06:55.560 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:55.560 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:55.560 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:55.560 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:55.560 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.560 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:55.560 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:06:55.561 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:55.561 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.561 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.561 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:55.561 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:06:55.561 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:55.561 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.561 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.561 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:55.561 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:06:55.561 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7700000000000004e-07 2024-04-18T21:06:55.561 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.561 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.561 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:55.561 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757745+0000", 2024-04-18T21:06:55.562 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0910000000000001e-05 2024-04-18T21:06:55.562 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.562 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.562 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:55.562 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757758+0000", 2024-04-18T21:06:55.562 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2593e-05 2024-04-18T21:06:55.562 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.562 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.562 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:55.562 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757765+0000", 2024-04-18T21:06:55.562 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1659999999999997e-06 2024-04-18T21:06:55.562 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.562 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.562 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:55.562 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.797782+0000", 2024-04-18T21:06:55.562 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.040017283000000001 2024-04-18T21:06:55.563 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.563 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.563 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:55.563 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.797949+0000", 2024-04-18T21:06:55.563 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016650399999999999 2024-04-18T21:06:55.563 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.563 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.563 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:55.563 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.798152+0000", 2024-04-18T21:06:55.563 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000203098 2024-04-18T21:06:55.563 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.563 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.563 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:55.563 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.800792+0000", 2024-04-18T21:06:55.563 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026394779999999998 2024-04-18T21:06:55.563 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.564 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.564 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:55.564 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805921+0000", 2024-04-18T21:06:55.564 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0051295519999999999 2024-04-18T21:06:55.564 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.564 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.564 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:55.564 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805967+0000", 2024-04-18T21:06:55.564 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5457000000000002e-05 2024-04-18T21:06:55.564 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.564 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.564 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:55.564 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806004+0000", 2024-04-18T21:06:55.564 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7494999999999999e-05 2024-04-18T21:06:55.564 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:55.565 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:55.565 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:55.565 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.565 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.565 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:102 3.1f 3:f83d65d8:::200.00000004:head [write 317856~1403 [fadvise_dontneed] in=1403b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:55.565 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757775+0000", 2024-04-18T21:06:55.565 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.7721542140000004, 2024-04-18T21:06:55.565 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.048337705000000002, 2024-04-18T21:06:55.565 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:55.565 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:55.565 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:55.565 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:55.565 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.565 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:55.565 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757775+0000", 2024-04-18T21:06:55.566 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:55.566 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.566 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.566 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:55.566 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757775+0000", 2024-04-18T21:06:55.566 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:55.566 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.566 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.566 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:55.566 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757776+0000", 2024-04-18T21:06:55.566 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5300000000000004e-07 2024-04-18T21:06:55.566 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.566 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.566 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:55.566 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757780+0000", 2024-04-18T21:06:55.567 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2270000000000004e-06 2024-04-18T21:06:55.567 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.567 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.567 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:55.567 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757792+0000", 2024-04-18T21:06:55.567 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2696e-05 2024-04-18T21:06:55.567 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.567 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.567 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:55.567 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757800+0000", 2024-04-18T21:06:55.567 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1439999999999997e-06 2024-04-18T21:06:55.567 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.567 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.567 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:55.567 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.798773+0000", 2024-04-18T21:06:55.567 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.040973074999999998 2024-04-18T21:06:55.568 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.568 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.568 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:55.568 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.798990+0000", 2024-04-18T21:06:55.568 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000217161 2024-04-18T21:06:55.568 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.568 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.568 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:55.568 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.799173+0000", 2024-04-18T21:06:55.568 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018295900000000001 2024-04-18T21:06:55.568 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.568 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.568 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:55.568 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802469+0000", 2024-04-18T21:06:55.569 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032965350000000002 2024-04-18T21:06:55.569 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.569 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.569 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:55.569 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806042+0000", 2024-04-18T21:06:55.569 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035724630000000001 2024-04-18T21:06:55.569 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.569 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.569 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:55.569 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806077+0000", 2024-04-18T21:06:55.569 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4997999999999999e-05 2024-04-18T21:06:55.569 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.569 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.569 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:55.569 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806113+0000", 2024-04-18T21:06:55.570 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5794000000000003e-05 2024-04-18T21:06:55.570 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:55.570 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:55.570 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:55.570 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.570 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.570 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:103 3.1f 3:f83d65d8:::200.00000004:head [write 319259~1404 [fadvise_dontneed] in=1404b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:55.570 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:06:55.570 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.7721203679999995, 2024-04-18T21:06:55.570 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.048414481000000002, 2024-04-18T21:06:55.570 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:55.570 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:55.570 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:55.570 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:55.570 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.570 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:55.571 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:06:55.571 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:55.571 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.571 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.571 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:55.571 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:06:55.571 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:55.571 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.571 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.571 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:55.571 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:06:55.571 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4700000000000001e-07 2024-04-18T21:06:55.571 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.571 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.571 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:55.571 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757814+0000", 2024-04-18T21:06:55.572 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1829999999999996e-06 2024-04-18T21:06:55.572 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.572 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.572 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:55.572 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757825+0000", 2024-04-18T21:06:55.572 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1754e-05 2024-04-18T21:06:55.572 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.572 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.572 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:55.572 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757832+0000", 2024-04-18T21:06:55.572 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8430000000000004e-06 2024-04-18T21:06:55.572 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.572 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.572 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:55.572 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.799809+0000", 2024-04-18T21:06:55.572 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.041976960000000001 2024-04-18T21:06:55.573 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.573 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.573 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:55.573 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.799934+0000", 2024-04-18T21:06:55.573 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000125053 2024-04-18T21:06:55.573 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.573 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.573 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:55.573 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.800067+0000", 2024-04-18T21:06:55.573 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013276299999999999 2024-04-18T21:06:55.573 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.573 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.573 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:55.573 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804582+0000", 2024-04-18T21:06:55.573 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0045148899999999997 2024-04-18T21:06:55.573 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.573 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.574 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:55.574 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806158+0000", 2024-04-18T21:06:55.574 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001575894 2024-04-18T21:06:55.574 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.574 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.574 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:55.574 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806189+0000", 2024-04-18T21:06:55.574 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1423000000000001e-05 2024-04-18T21:06:55.574 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.574 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.574 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:55.574 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806223+0000", 2024-04-18T21:06:55.574 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4071e-05 2024-04-18T21:06:55.574 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:55.574 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:55.574 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:55.575 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.575 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.575 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:104 3.1f 3:f83d65d8:::200.00000004:head [write 320663~1405 [fadvise_dontneed] in=1405b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:55.575 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757841+0000", 2024-04-18T21:06:55.575 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.7720881639999995, 2024-04-18T21:06:55.575 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056381623999999998, 2024-04-18T21:06:55.575 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:55.575 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:55.575 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:55.575 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:55.575 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.575 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:55.575 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757841+0000", 2024-04-18T21:06:55.576 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:55.576 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.576 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.576 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:55.576 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757841+0000", 2024-04-18T21:06:55.576 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:55.576 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.576 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.576 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:55.576 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757842+0000", 2024-04-18T21:06:55.576 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5000000000000002e-07 2024-04-18T21:06:55.576 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.576 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.576 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:55.576 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757852+0000", 2024-04-18T21:06:55.576 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.084e-05 2024-04-18T21:06:55.577 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.577 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.577 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:55.577 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757865+0000", 2024-04-18T21:06:55.577 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2643000000000001e-05 2024-04-18T21:06:55.577 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.577 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.577 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:55.577 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757872+0000", 2024-04-18T21:06:55.577 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8689999999999998e-06 2024-04-18T21:06:55.577 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.577 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.577 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:55.577 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.801102+0000", 2024-04-18T21:06:55.577 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043229837 2024-04-18T21:06:55.578 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.578 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.578 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:55.578 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.801291+0000", 2024-04-18T21:06:55.578 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000189641 2024-04-18T21:06:55.578 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.578 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.578 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:55.578 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.801640+0000", 2024-04-18T21:06:55.578 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000348971 2024-04-18T21:06:55.578 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.578 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.578 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:55.578 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805849+0000", 2024-04-18T21:06:55.579 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042082739999999997 2024-04-18T21:06:55.579 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.579 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.579 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:55.579 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814135+0000", 2024-04-18T21:06:55.579 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0082867270000000007 2024-04-18T21:06:55.579 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.579 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.579 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:55.579 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814180+0000", 2024-04-18T21:06:55.579 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4982999999999999e-05 2024-04-18T21:06:55.579 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.579 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.580 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:55.580 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814223+0000", 2024-04-18T21:06:55.580 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2188999999999999e-05 2024-04-18T21:06:55.580 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:55.580 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:55.580 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:55.580 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.580 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.580 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:105 3.1f 3:f83d65d8:::200.00000004:head [write 322068~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:55.580 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:06:55.580 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.7720475679999996, 2024-04-18T21:06:55.580 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056513678999999997, 2024-04-18T21:06:55.580 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:55.580 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:55.580 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:55.580 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:55.580 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.581 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:55.581 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:06:55.581 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:55.581 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.581 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.581 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:55.581 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:06:55.581 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:55.581 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.581 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.581 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:55.581 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:06:55.581 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2600000000000002e-07 2024-04-18T21:06:55.581 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.581 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.581 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:55.582 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757888+0000", 2024-04-18T21:06:55.582 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7130000000000002e-06 2024-04-18T21:06:55.582 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.582 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.582 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:55.582 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757906+0000", 2024-04-18T21:06:55.582 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7723999999999998e-05 2024-04-18T21:06:55.582 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.582 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.582 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:55.582 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757921+0000", 2024-04-18T21:06:55.582 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4936000000000001e-05 2024-04-18T21:06:55.582 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.582 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.582 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:55.583 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802493+0000", 2024-04-18T21:06:55.583 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.044571927999999997 2024-04-18T21:06:55.583 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.583 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.583 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:55.583 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802537+0000", 2024-04-18T21:06:55.583 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4449000000000001e-05 2024-04-18T21:06:55.583 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.583 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.583 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:55.583 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802605+0000", 2024-04-18T21:06:55.583 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7945000000000001e-05 2024-04-18T21:06:55.583 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.583 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.583 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:55.584 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805852+0000", 2024-04-18T21:06:55.584 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032469909999999999 2024-04-18T21:06:55.584 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.584 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.584 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:55.584 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814298+0000", 2024-04-18T21:06:55.584 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084463309999999996 2024-04-18T21:06:55.584 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.584 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.584 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:55.584 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814355+0000", 2024-04-18T21:06:55.584 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6459999999999998e-05 2024-04-18T21:06:55.584 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.584 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.584 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:55.585 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814395+0000", 2024-04-18T21:06:55.585 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0475999999999997e-05 2024-04-18T21:06:55.585 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:55.585 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:55.585 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:55.585 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.585 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.585 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:106 3.1f 3:f83d65d8:::200.00000004:head [write 323467~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:55.585 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757955+0000", 2024-04-18T21:06:55.585 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.7719743389999998, 2024-04-18T21:06:55.585 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056539990999999998, 2024-04-18T21:06:55.585 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:55.585 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:55.585 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:55.586 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:55.586 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.586 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:55.586 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757955+0000", 2024-04-18T21:06:55.586 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:55.586 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.586 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.586 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:55.586 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757955+0000", 2024-04-18T21:06:55.586 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:55.586 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.586 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.586 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:55.586 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757956+0000", 2024-04-18T21:06:55.586 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.144e-06 2024-04-18T21:06:55.587 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.587 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.587 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:55.587 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757970+0000", 2024-04-18T21:06:55.587 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3899e-05 2024-04-18T21:06:55.587 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.587 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.587 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:55.587 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757988+0000", 2024-04-18T21:06:55.587 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8033000000000002e-05 2024-04-18T21:06:55.587 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.587 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.587 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:55.587 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758002+0000", 2024-04-18T21:06:55.588 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3973e-05 2024-04-18T21:06:55.588 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.588 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.588 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:55.588 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803072+0000", 2024-04-18T21:06:55.588 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045070194000000001 2024-04-18T21:06:55.588 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.588 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.588 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:55.588 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803125+0000", 2024-04-18T21:06:55.588 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3498000000000002e-05 2024-04-18T21:06:55.588 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.588 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.589 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:55.589 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803233+0000", 2024-04-18T21:06:55.589 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010704099999999999 2024-04-18T21:06:55.589 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.589 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.589 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:55.589 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805856+0000", 2024-04-18T21:06:55.589 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026233430000000002 2024-04-18T21:06:55.589 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.589 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.589 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:55.589 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814439+0000", 2024-04-18T21:06:55.590 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0085833839999999995 2024-04-18T21:06:55.590 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.590 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.590 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:55.590 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814469+0000", 2024-04-18T21:06:55.590 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9784000000000001e-05 2024-04-18T21:06:55.590 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.590 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.590 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:55.590 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814495+0000", 2024-04-18T21:06:55.590 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5698e-05 2024-04-18T21:06:55.590 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:55.590 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:55.590 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:55.590 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.591 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.591 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:107 3.1f 3:f83d65d8:::200.00000004:head [write 324866~1421 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:55.591 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758019+0000", 2024-04-18T21:06:55.591 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.7719097129999994, 2024-04-18T21:06:55.591 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056580563, 2024-04-18T21:06:55.591 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:55.591 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:55.591 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:55.591 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:55.591 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.591 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:55.591 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758019+0000", 2024-04-18T21:06:55.591 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:55.591 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.592 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.592 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:55.592 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758019+0000", 2024-04-18T21:06:55.592 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:55.592 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.592 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.592 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:55.592 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758021+0000", 2024-04-18T21:06:55.592 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1999999999999999e-06 2024-04-18T21:06:55.592 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.592 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.592 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:55.592 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758028+0000", 2024-04-18T21:06:55.593 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7200000000000006e-06 2024-04-18T21:06:55.593 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.593 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.593 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:55.593 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758050+0000", 2024-04-18T21:06:55.593 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1877000000000001e-05 2024-04-18T21:06:55.593 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.593 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.593 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:55.593 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758064+0000", 2024-04-18T21:06:55.593 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.383e-05 2024-04-18T21:06:55.593 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.593 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.593 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:55.594 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803593+0000", 2024-04-18T21:06:55.594 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045528831999999998 2024-04-18T21:06:55.594 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.594 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.594 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:55.594 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803635+0000", 2024-04-18T21:06:55.594 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1980000000000001e-05 2024-04-18T21:06:55.594 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.594 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.594 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:55.594 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803703+0000", 2024-04-18T21:06:55.594 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8542999999999997e-05 2024-04-18T21:06:55.594 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.594 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.595 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:55.595 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806123+0000", 2024-04-18T21:06:55.595 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002419769 2024-04-18T21:06:55.595 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.595 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.595 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:55.595 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814542+0000", 2024-04-18T21:06:55.595 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084189460000000001 2024-04-18T21:06:55.595 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.595 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.595 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:55.595 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814576+0000", 2024-04-18T21:06:55.595 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3679000000000001e-05 2024-04-18T21:06:55.596 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.596 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.596 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:55.596 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814600+0000", 2024-04-18T21:06:55.596 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4187000000000001e-05 2024-04-18T21:06:55.596 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:55.596 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:55.596 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:55.596 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.596 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.596 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:108 3.1f 3:f83d65d8:::200.00000004:head [write 326287~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:55.596 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:06:55.596 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.7718465440000006, 2024-04-18T21:06:55.596 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056616183, 2024-04-18T21:06:55.597 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:55.597 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:55.597 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:55.597 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:55.597 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.597 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:55.597 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:06:55.597 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:55.597 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.597 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.597 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:55.597 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:06:55.597 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:55.597 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.598 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.598 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:55.598 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758084+0000", 2024-04-18T21:06:55.598 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.124e-06 2024-04-18T21:06:55.598 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.598 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.598 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:55.598 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758100+0000", 2024-04-18T21:06:55.598 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6246e-05 2024-04-18T21:06:55.598 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.598 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.598 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:55.598 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758118+0000", 2024-04-18T21:06:55.599 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8267e-05 2024-04-18T21:06:55.599 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.599 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.599 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:55.599 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758134+0000", 2024-04-18T21:06:55.599 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5950000000000001e-05 2024-04-18T21:06:55.599 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.599 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.599 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:55.599 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803949+0000", 2024-04-18T21:06:55.599 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045815349999999998 2024-04-18T21:06:55.599 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.599 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.599 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:55.600 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804011+0000", 2024-04-18T21:06:55.600 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1044999999999996e-05 2024-04-18T21:06:55.600 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.600 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.600 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:55.600 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804128+0000", 2024-04-18T21:06:55.600 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117148 2024-04-18T21:06:55.600 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.600 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.600 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:55.600 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806794+0000", 2024-04-18T21:06:55.600 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002666692 2024-04-18T21:06:55.600 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.600 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.601 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:55.601 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814645+0000", 2024-04-18T21:06:55.601 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0078508880000000003 2024-04-18T21:06:55.601 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.601 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.601 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:55.601 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814678+0000", 2024-04-18T21:06:55.601 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3188999999999997e-05 2024-04-18T21:06:55.601 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.601 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.601 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:55.601 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814699+0000", 2024-04-18T21:06:55.601 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0284000000000001e-05 2024-04-18T21:06:55.601 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:55.602 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:55.602 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:55.602 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.602 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.602 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:109 3.1f 3:f83d65d8:::200.00000004:head [write 327693~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:55.602 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:06:55.602 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.7717771770000006, 2024-04-18T21:06:55.602 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056621036999999999, 2024-04-18T21:06:55.602 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:55.602 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:55.602 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:55.602 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:55.603 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.603 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:55.603 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:06:55.603 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:55.603 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.603 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.603 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:55.603 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:06:55.603 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:55.603 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.603 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.603 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:55.603 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758153+0000", 2024-04-18T21:06:55.603 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1459999999999999e-06 2024-04-18T21:06:55.603 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.603 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.604 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:55.604 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758161+0000", 2024-04-18T21:06:55.604 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7999999999999999e-06 2024-04-18T21:06:55.604 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.604 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.604 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:55.604 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758179+0000", 2024-04-18T21:06:55.604 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7949999999999999e-05 2024-04-18T21:06:55.604 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.604 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.604 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:55.604 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758193+0000", 2024-04-18T21:06:55.604 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3773e-05 2024-04-18T21:06:55.604 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.605 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.605 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:55.605 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804632+0000", 2024-04-18T21:06:55.605 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.046439469999999997 2024-04-18T21:06:55.605 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.605 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.605 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:55.605 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804790+0000", 2024-04-18T21:06:55.605 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015784300000000001 2024-04-18T21:06:55.605 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.605 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.605 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:55.605 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805056+0000", 2024-04-18T21:06:55.605 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026652400000000003 2024-04-18T21:06:55.606 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.606 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.606 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:55.606 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.808959+0000", 2024-04-18T21:06:55.606 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003903077 2024-04-18T21:06:55.606 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.606 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.606 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:55.606 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814728+0000", 2024-04-18T21:06:55.606 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0057682489999999996 2024-04-18T21:06:55.606 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.606 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.606 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:55.606 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814754+0000", 2024-04-18T21:06:55.607 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6673999999999999e-05 2024-04-18T21:06:55.607 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.607 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.607 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:55.607 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814773+0000", 2024-04-18T21:06:55.607 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8530999999999999e-05 2024-04-18T21:06:55.607 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:55.607 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:55.607 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:55.607 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.607 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.607 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:110 3.1f 3:f83d65d8:::200.00000004:head [write 329098~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:55.607 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:06:55.607 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.7717187679999995, 2024-04-18T21:06:55.607 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056669113, 2024-04-18T21:06:55.607 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:55.608 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:55.608 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:55.608 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:55.608 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.608 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:55.608 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:06:55.608 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:55.608 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.608 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.608 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:55.608 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:06:55.608 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:55.608 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.609 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.609 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:55.609 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758212+0000", 2024-04-18T21:06:55.609 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:06:55.609 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.609 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.609 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:55.609 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758219+0000", 2024-04-18T21:06:55.609 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4229999999999999e-06 2024-04-18T21:06:55.609 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.609 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.609 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:55.609 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758237+0000", 2024-04-18T21:06:55.609 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7966999999999999e-05 2024-04-18T21:06:55.610 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.610 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.610 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:55.610 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758252+0000", 2024-04-18T21:06:55.610 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5322999999999999e-05 2024-04-18T21:06:55.610 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.610 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.610 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:55.610 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805536+0000", 2024-04-18T21:06:55.610 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.047283861000000003 2024-04-18T21:06:55.610 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.610 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.611 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:55.611 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805579+0000", 2024-04-18T21:06:55.611 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2738999999999999e-05 2024-04-18T21:06:55.611 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.611 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.611 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:55.611 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805649+0000", 2024-04-18T21:06:55.611 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0213e-05 2024-04-18T21:06:55.611 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.611 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.611 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:55.611 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.808966+0000", 2024-04-18T21:06:55.611 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033166129999999999 2024-04-18T21:06:55.611 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.612 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.612 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:55.612 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814812+0000", 2024-04-18T21:06:55.612 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0058463589999999998 2024-04-18T21:06:55.612 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.612 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.612 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:55.612 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814854+0000", 2024-04-18T21:06:55.612 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1618e-05 2024-04-18T21:06:55.612 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.612 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.612 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:55.612 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814879+0000", 2024-04-18T21:06:55.612 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5754000000000001e-05 2024-04-18T21:06:55.612 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:55.612 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:55.613 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:55.613 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.613 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.613 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:111 3.1f 3:f83d65d8:::200.00000004:head [write 330499~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:55.613 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:06:55.613 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.7716577919999992, 2024-04-18T21:06:55.613 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058693793000000001, 2024-04-18T21:06:55.613 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:55.613 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:55.613 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:55.613 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:55.613 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.613 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:55.613 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:06:55.614 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:55.614 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.614 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.614 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:55.614 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:06:55.614 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:55.614 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.614 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.614 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:55.614 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758272+0000", 2024-04-18T21:06:55.614 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1200000000000001e-06 2024-04-18T21:06:55.614 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.614 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.614 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:55.614 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758287+0000", 2024-04-18T21:06:55.615 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5017e-05 2024-04-18T21:06:55.615 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.615 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.615 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:55.615 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758309+0000", 2024-04-18T21:06:55.615 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1866e-05 2024-04-18T21:06:55.615 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.615 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.615 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:55.615 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758323+0000", 2024-04-18T21:06:55.615 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3606e-05 2024-04-18T21:06:55.615 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.615 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.615 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:55.616 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806279+0000", 2024-04-18T21:06:55.616 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.047956061000000001 2024-04-18T21:06:55.616 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.616 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.616 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:55.616 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806350+0000", 2024-04-18T21:06:55.616 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1070999999999998e-05 2024-04-18T21:06:55.616 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.616 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.616 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:55.616 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806459+0000", 2024-04-18T21:06:55.617 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000108606 2024-04-18T21:06:55.617 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.617 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.617 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:55.617 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.809774+0000", 2024-04-18T21:06:55.617 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003314881 2024-04-18T21:06:55.617 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.617 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.617 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:55.617 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816910+0000", 2024-04-18T21:06:55.617 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0071367760000000001 2024-04-18T21:06:55.617 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.617 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.618 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:55.618 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816941+0000", 2024-04-18T21:06:55.618 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0846000000000002e-05 2024-04-18T21:06:55.618 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.618 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.618 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:55.618 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816965+0000", 2024-04-18T21:06:55.618 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3943000000000001e-05 2024-04-18T21:06:55.618 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:55.618 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:55.618 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:55.618 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.619 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.619 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:5230 4.17 4:eb2cc4c4:::1000000184c.00000000:head [write 0~2191] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-18T21:06:55.619 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.760650+0000", 2024-04-18T21:06:55.619 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.7692786209999998, 2024-04-18T21:06:55.619 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.054210577000000003, 2024-04-18T21:06:55.619 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:55.619 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:55.619 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:55.619 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:06:55.619 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:06:55.619 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:55.619 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 5230 2024-04-18T21:06:55.619 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.620 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:55.620 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.620 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:55.620 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760650+0000", 2024-04-18T21:06:55.620 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:55.620 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.620 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.620 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:55.620 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760650+0000", 2024-04-18T21:06:55.620 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:55.620 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.620 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.620 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:55.620 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760653+0000", 2024-04-18T21:06:55.621 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0829999999999998e-06 2024-04-18T21:06:55.621 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.621 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.621 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:55.621 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760664+0000", 2024-04-18T21:06:55.621 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.111e-05 2024-04-18T21:06:55.621 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.621 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.621 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:55.621 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760688+0000", 2024-04-18T21:06:55.621 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4837e-05 2024-04-18T21:06:55.621 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.621 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.622 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:55.622 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760702+0000", 2024-04-18T21:06:55.622 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3723000000000001e-05 2024-04-18T21:06:55.622 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.622 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.622 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:55.622 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806264+0000", 2024-04-18T21:06:55.622 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045562182 2024-04-18T21:06:55.622 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.622 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.622 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:55.622 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806351+0000", 2024-04-18T21:06:55.623 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6322000000000005e-05 2024-04-18T21:06:55.623 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.623 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.623 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:55.623 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806453+0000", 2024-04-18T21:06:55.623 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000102602 2024-04-18T21:06:55.623 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.623 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.623 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:55.623 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.808972+0000", 2024-04-18T21:06:55.623 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025184090000000001 2024-04-18T21:06:55.623 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.623 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.624 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:55.624 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814798+0000", 2024-04-18T21:06:55.624 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0058266689999999996 2024-04-18T21:06:55.624 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.624 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.624 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:55.624 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814839+0000", 2024-04-18T21:06:55.624 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0482000000000003e-05 2024-04-18T21:06:55.624 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.624 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.624 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:55.624 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814861+0000", 2024-04-18T21:06:55.624 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2158e-05 2024-04-18T21:06:55.625 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:55.625 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:55.625 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:55.625 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.625 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.625 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:112 3.1f 3:f83d65d8:::200.00000004:head [write 331898~20167 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:55.625 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.771321+0000", 2024-04-18T21:06:55.625 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.7586079940000001, 2024-04-18T21:06:55.625 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045740306000000001, 2024-04-18T21:06:55.625 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:55.625 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:55.626 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:55.626 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:55.626 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.626 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:55.626 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771321+0000", 2024-04-18T21:06:55.626 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:55.626 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.626 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.626 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:55.626 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771321+0000", 2024-04-18T21:06:55.626 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:55.626 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.626 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.627 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:55.627 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771323+0000", 2024-04-18T21:06:55.627 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3740000000000001e-06 2024-04-18T21:06:55.627 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.627 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.627 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:55.627 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771359+0000", 2024-04-18T21:06:55.627 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5447999999999997e-05 2024-04-18T21:06:55.627 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.627 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.627 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:55.627 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771388+0000", 2024-04-18T21:06:55.627 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8915e-05 2024-04-18T21:06:55.627 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.628 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.628 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:55.628 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771410+0000", 2024-04-18T21:06:55.628 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1899000000000002e-05 2024-04-18T21:06:55.628 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.628 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.628 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:55.628 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806827+0000", 2024-04-18T21:06:55.628 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.035417063999999998 2024-04-18T21:06:55.628 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.628 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.628 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:55.628 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806873+0000", 2024-04-18T21:06:55.628 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6261999999999999e-05 2024-04-18T21:06:55.628 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.628 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.629 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:55.629 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806946+0000", 2024-04-18T21:06:55.629 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3205000000000001e-05 2024-04-18T21:06:55.629 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.629 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.629 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:55.629 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.809781+0000", 2024-04-18T21:06:55.629 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002834937 2024-04-18T21:06:55.629 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.629 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.629 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:55.629 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817003+0000", 2024-04-18T21:06:55.629 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0072217959999999999 2024-04-18T21:06:55.630 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.630 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.630 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:55.630 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817038+0000", 2024-04-18T21:06:55.630 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4696999999999997e-05 2024-04-18T21:06:55.630 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.630 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.630 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:55.630 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817061+0000", 2024-04-18T21:06:55.630 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3708999999999999e-05 2024-04-18T21:06:55.630 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:55.630 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:55.630 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:55.631 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.631 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.631 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:113 3.1f 3:f83d65d8:::200.00000004:head [write 352065~3878 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:55.631 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.771472+0000", 2024-04-18T21:06:55.631 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.758457258, 2024-04-18T21:06:55.631 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045689726, 2024-04-18T21:06:55.631 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:55.631 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:55.631 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:55.631 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:55.631 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.631 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:55.631 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771472+0000", 2024-04-18T21:06:55.632 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:55.632 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.632 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.632 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:55.632 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771472+0000", 2024-04-18T21:06:55.632 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:55.632 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.632 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.632 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:55.632 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771473+0000", 2024-04-18T21:06:55.632 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3829999999999999e-06 2024-04-18T21:06:55.632 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.633 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.633 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:55.633 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771489+0000", 2024-04-18T21:06:55.633 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5797000000000001e-05 2024-04-18T21:06:55.633 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.633 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.633 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:55.633 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771509+0000", 2024-04-18T21:06:55.633 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0401999999999999e-05 2024-04-18T21:06:55.633 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.633 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.633 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:55.633 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771525+0000", 2024-04-18T21:06:55.633 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5099999999999999e-05 2024-04-18T21:06:55.633 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.634 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.634 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:55.634 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807273+0000", 2024-04-18T21:06:55.634 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.035748488000000002 2024-04-18T21:06:55.634 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.634 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.634 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:55.634 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807343+0000", 2024-04-18T21:06:55.634 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0277000000000005e-05 2024-04-18T21:06:55.634 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.634 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.634 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:55.634 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807455+0000", 2024-04-18T21:06:55.634 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011171999999999999 2024-04-18T21:06:55.635 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.635 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.635 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:55.635 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.811509+0000", 2024-04-18T21:06:55.635 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0040543469999999998 2024-04-18T21:06:55.635 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.635 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.635 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:55.635 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817115+0000", 2024-04-18T21:06:55.635 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0056054520000000004 2024-04-18T21:06:55.635 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.635 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.635 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:55.635 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817142+0000", 2024-04-18T21:06:55.635 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7430999999999999e-05 2024-04-18T21:06:55.636 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.636 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.636 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:55.636 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817162+0000", 2024-04-18T21:06:55.636 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9329000000000001e-05 2024-04-18T21:06:55.636 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:55.636 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:55.636 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:55.636 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.636 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.636 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:114 3.1f 3:f83d65d8:::200.00000004:head [write 355943~1928 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:55.636 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.771785+0000", 2024-04-18T21:06:55.636 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.7581439129999996, 2024-04-18T21:06:55.636 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045480532999999997, 2024-04-18T21:06:55.637 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:55.637 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:55.637 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:55.637 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:55.637 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.637 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:55.637 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771785+0000", 2024-04-18T21:06:55.637 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:55.637 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.637 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.637 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:55.637 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771785+0000", 2024-04-18T21:06:55.637 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:55.638 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.638 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.638 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:55.638 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771787+0000", 2024-04-18T21:06:55.638 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0600000000000002e-06 2024-04-18T21:06:55.638 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.638 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.638 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:55.638 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771799+0000", 2024-04-18T21:06:55.638 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1503e-05 2024-04-18T21:06:55.638 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.638 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.638 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:55.638 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771829+0000", 2024-04-18T21:06:55.639 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.04e-05 2024-04-18T21:06:55.639 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.639 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.639 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:55.639 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771846+0000", 2024-04-18T21:06:55.639 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6608000000000001e-05 2024-04-18T21:06:55.639 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.639 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.639 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:55.639 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807856+0000", 2024-04-18T21:06:55.639 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036010480999999997 2024-04-18T21:06:55.639 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.639 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.639 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:55.639 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807899+0000", 2024-04-18T21:06:55.640 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2775999999999998e-05 2024-04-18T21:06:55.640 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.640 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.640 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:55.640 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807966+0000", 2024-04-18T21:06:55.640 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6793999999999998e-05 2024-04-18T21:06:55.640 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.640 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.640 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:55.640 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.811516+0000", 2024-04-18T21:06:55.640 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035497300000000001 2024-04-18T21:06:55.640 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.640 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.640 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:55.640 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817194+0000", 2024-04-18T21:06:55.640 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0056787030000000002 2024-04-18T21:06:55.640 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.641 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.641 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:55.641 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817231+0000", 2024-04-18T21:06:55.641 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6727000000000003e-05 2024-04-18T21:06:55.641 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:55.641 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:55.641 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:55.641 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817266+0000", 2024-04-18T21:06:55.641 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4751e-05 2024-04-18T21:06:55.641 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:55.641 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:55.641 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:55.641 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:55.641 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:55.641 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:55.642 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:06:55.643 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:55.642+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:55.643 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:55.744 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:55.742+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:55.775 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:55.775 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:06:55.775 INFO:teuthology.orchestra.run.smithi132.stdout: "num_ops": 0 2024-04-18T21:06:55.775 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:55.776 INFO:teuthology.orchestra.run.smithi078.stderr:nodeep-scrub is unset 2024-04-18T21:06:55.790 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:55.806 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:06:55.806 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:06:55.819 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T21:06:55.828 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1: {} 2024-04-18T21:06:55.828 INFO:teuthology.orchestra.run.smithi078.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-18T21:06:55.848 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:06:55.849 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:55.878 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:55.878+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:55.929 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on 2024-04-18T21:06:55.946 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:55.942+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:55.957 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:55.958 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:55.972 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:56.046 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:56.046+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:56.135 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:56.135 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:56.147 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:56.146+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:56.149 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:56.157 INFO:tasks.workunit.client.0.smithi078.stdout:9/10: sync 2024-04-18T21:06:56.158 INFO:tasks.workunit.client.0.smithi078.stdout:9/11: write f5 [315918,106990] 0 2024-04-18T21:06:56.159 INFO:tasks.workunit.client.0.smithi078.stdout:7/33: sync 2024-04-18T21:06:56.159 INFO:tasks.workunit.client.0.smithi078.stdout:6/12: sync 2024-04-18T21:06:56.159 INFO:tasks.workunit.client.0.smithi078.stdout:1/29: sync 2024-04-18T21:06:56.159 INFO:tasks.workunit.client.0.smithi078.stdout:5/43: sync 2024-04-18T21:06:56.159 INFO:tasks.workunit.client.0.smithi078.stdout:4/34: sync 2024-04-18T21:06:56.159 INFO:tasks.workunit.client.0.smithi078.stdout:2/16: sync 2024-04-18T21:06:56.159 INFO:tasks.workunit.client.0.smithi078.stdout:3/22: sync 2024-04-18T21:06:56.159 INFO:tasks.workunit.client.0.smithi078.stdout:8/20: sync 2024-04-18T21:06:56.159 INFO:tasks.workunit.client.0.smithi078.stdout:0/25: sync 2024-04-18T21:06:56.160 INFO:tasks.workunit.client.0.smithi078.stdout:8/21: symlink d0/l8 0 2024-04-18T21:06:56.160 INFO:tasks.workunit.client.0.smithi078.stdout:7/34: dread - d1/fb zero size 2024-04-18T21:06:56.160 INFO:tasks.workunit.client.0.smithi078.stdout:3/23: unlink f2 0 2024-04-18T21:06:56.160 INFO:tasks.workunit.client.0.smithi078.stdout:1/30: dread - d0/f7 zero size 2024-04-18T21:06:56.161 INFO:tasks.workunit.client.0.smithi078.stdout:6/13: rename f0 to d2/f4 0 2024-04-18T21:06:56.161 INFO:tasks.workunit.client.0.smithi078.stdout:6/14: chown d2 14783183 1 2024-04-18T21:06:56.161 INFO:tasks.workunit.client.0.smithi078.stdout:2/17: creat d0/f5 x:0 0 0 2024-04-18T21:06:56.161 INFO:tasks.workunit.client.0.smithi078.stdout:8/22: symlink d0/l9 0 2024-04-18T21:06:56.162 INFO:tasks.workunit.client.0.smithi078.stdout:1/31: dread - d0/d1/d4/f6 zero size 2024-04-18T21:06:56.162 INFO:tasks.workunit.client.0.smithi078.stdout:5/44: getdents d9/da 0 2024-04-18T21:06:56.163 INFO:tasks.workunit.client.0.smithi078.stdout:3/24: chown d4/f5 805762 1 2024-04-18T21:06:56.163 INFO:tasks.workunit.client.0.smithi078.stdout:2/18: rmdir d0 39 2024-04-18T21:06:56.163 INFO:tasks.workunit.client.0.smithi078.stdout:6/15: mkdir d2/d5 0 2024-04-18T21:06:56.163 INFO:tasks.workunit.client.0.smithi078.stdout:1/32: creat d0/f8 x:0 0 0 2024-04-18T21:06:56.163 INFO:tasks.workunit.client.0.smithi078.stdout:7/35: write d1/d6/f8 [959141,116019] 0 2024-04-18T21:06:56.164 INFO:tasks.workunit.client.0.smithi078.stdout:3/25: creat d4/f6 x:0 0 0 2024-04-18T21:06:56.164 INFO:tasks.workunit.client.0.smithi078.stdout:5/45: mknod d9/cc 0 2024-04-18T21:06:56.165 INFO:tasks.workunit.client.0.smithi078.stdout:7/36: chown d1/c2 7 1 2024-04-18T21:06:56.165 INFO:tasks.workunit.client.0.smithi078.stdout:1/33: symlink d0/l9 0 2024-04-18T21:06:56.165 INFO:tasks.workunit.client.0.smithi078.stdout:5/46: rmdir d9 39 2024-04-18T21:06:56.165 INFO:tasks.workunit.client.0.smithi078.stdout:5/47: readlink - no filename 2024-04-18T21:06:56.165 INFO:tasks.workunit.client.0.smithi078.stdout:3/26: chown d4/f6 216 1 2024-04-18T21:06:56.166 INFO:tasks.workunit.client.0.smithi078.stdout:2/19: read d0/f2 [9846,102209] 0 2024-04-18T21:06:56.166 INFO:tasks.workunit.client.0.smithi078.stdout:1/34: rename d0/l9 to d0/la 0 2024-04-18T21:06:56.167 INFO:tasks.workunit.client.0.smithi078.stdout:3/27: symlink d4/l7 0 2024-04-18T21:06:56.167 INFO:tasks.workunit.client.0.smithi078.stdout:2/20: chown d0/l4 2039 1 2024-04-18T21:06:56.167 INFO:tasks.workunit.client.0.smithi078.stdout:1/35: write d0/d1/d4/f6 [50891,89602] 0 2024-04-18T21:06:56.168 INFO:tasks.workunit.client.0.smithi078.stdout:3/28: chown d4/f5 127531414 1 2024-04-18T21:06:56.170 INFO:tasks.workunit.client.0.smithi078.stdout:3/29: unlink d4/f6 0 2024-04-18T21:06:56.171 INFO:tasks.workunit.client.0.smithi078.stdout:9/12: dread f0 [0,4194304] 0 2024-04-18T21:06:56.171 INFO:tasks.workunit.client.0.smithi078.stdout:1/36: symlink d0/d1/d4/lb 0 2024-04-18T21:06:56.174 INFO:tasks.workunit.client.0.smithi078.stdout:9/13: chown f0 1293 1 2024-04-18T21:06:56.181 INFO:tasks.workunit.client.0.smithi078.stdout:0/26: dwrite d0/f4 [0,4194304] 0 2024-04-18T21:06:56.183 INFO:tasks.workunit.client.0.smithi078.stdout:5/48: dwrite f8 [0,4194304] 0 2024-04-18T21:06:56.183 INFO:tasks.workunit.client.0.smithi078.stdout:0/27: readlink d0/l2 0 2024-04-18T21:06:56.183 INFO:tasks.workunit.client.0.smithi078.stdout:6/16: dwrite d2/f3 [0,4194304] 0 2024-04-18T21:06:56.184 INFO:tasks.workunit.client.0.smithi078.stdout:7/37: dwrite d1/d6/dc/f9 [0,4194304] 0 2024-04-18T21:06:56.185 INFO:tasks.workunit.client.0.smithi078.stdout:2/21: dwrite d0/f2 [0,4194304] 0 2024-04-18T21:06:56.186 INFO:tasks.workunit.client.0.smithi078.stdout:3/30: mknod d4/c8 0 2024-04-18T21:06:56.187 INFO:tasks.workunit.client.0.smithi078.stdout:5/49: write f8 [1770003,37893] 0 2024-04-18T21:06:56.187 INFO:tasks.workunit.client.0.smithi078.stdout:2/22: chown d0/f5 748459 1 2024-04-18T21:06:56.190 INFO:tasks.workunit.client.0.smithi078.stdout:9/14: creat f6 x:0 0 0 2024-04-18T21:06:56.190 INFO:tasks.workunit.client.0.smithi078.stdout:1/37: creat d0/d1/d4/fc x:0 0 0 2024-04-18T21:06:56.191 INFO:tasks.workunit.client.0.smithi078.stdout:4/35: truncate d0/f5 468898 0 2024-04-18T21:06:56.192 INFO:tasks.workunit.client.0.smithi078.stdout:9/15: chown f5 83765 1 2024-04-18T21:06:56.192 INFO:tasks.workunit.client.0.smithi078.stdout:0/28: mkdir d0/d6 0 2024-04-18T21:06:56.192 INFO:tasks.workunit.client.0.smithi078.stdout:6/17: mkdir d2/d6 0 2024-04-18T21:06:56.192 INFO:tasks.workunit.client.0.smithi078.stdout:7/38: mknod d1/d6/ce 0 2024-04-18T21:06:56.192 INFO:tasks.workunit.client.0.smithi078.stdout:6/18: chown d2/d5 232 1 2024-04-18T21:06:56.193 INFO:tasks.workunit.client.0.smithi078.stdout:3/31: fdatasync d4/f5 0 2024-04-18T21:06:56.193 INFO:tasks.workunit.client.0.smithi078.stdout:9/16: mkdir d7 0 2024-04-18T21:06:56.193 INFO:tasks.workunit.client.0.smithi078.stdout:3/32: creat d4/f9 x:0 0 0 2024-04-18T21:06:56.194 INFO:tasks.workunit.client.0.smithi078.stdout:7/39: creat d1/d6/ff x:0 0 0 2024-04-18T21:06:56.194 INFO:tasks.workunit.client.0.smithi078.stdout:0/29: rmdir d0/d6 0 2024-04-18T21:06:56.195 INFO:tasks.workunit.client.0.smithi078.stdout:2/23: rmdir d0 39 2024-04-18T21:06:56.195 INFO:tasks.workunit.client.0.smithi078.stdout:9/17: mknod d7/c8 0 2024-04-18T21:06:56.195 INFO:tasks.workunit.client.0.smithi078.stdout:6/19: creat d2/d5/f7 x:0 0 0 2024-04-18T21:06:56.196 INFO:tasks.workunit.client.0.smithi078.stdout:3/33: write d4/f5 [5214403,8090] 0 2024-04-18T21:06:56.196 INFO:tasks.workunit.client.0.smithi078.stdout:0/30: write d0/f4 [3217668,60080] 0 2024-04-18T21:06:56.196 INFO:tasks.workunit.client.0.smithi078.stdout:6/20: stat d2 0 2024-04-18T21:06:56.197 INFO:tasks.workunit.client.0.smithi078.stdout:0/31: fdatasync d0/f5 0 2024-04-18T21:06:56.197 INFO:tasks.workunit.client.0.smithi078.stdout:9/18: chown c4 145 1 2024-04-18T21:06:56.198 INFO:tasks.workunit.client.0.smithi078.stdout:3/34: chown d4/f5 0 1 2024-04-18T21:06:56.198 INFO:tasks.workunit.client.0.smithi078.stdout:6/21: unlink c1 0 2024-04-18T21:06:56.198 INFO:tasks.workunit.client.0.smithi078.stdout:2/24: rename d0/l4 to d0/l6 0 2024-04-18T21:06:56.198 INFO:tasks.workunit.client.0.smithi078.stdout:3/35: mkdir d4/da 0 2024-04-18T21:06:56.198 INFO:tasks.workunit.client.0.smithi078.stdout:6/22: mknod d2/d5/c8 0 2024-04-18T21:06:56.199 INFO:tasks.workunit.client.0.smithi078.stdout:7/40: getdents d1/d6/dc 0 2024-04-18T21:06:56.199 INFO:tasks.workunit.client.0.smithi078.stdout:6/23: mknod d2/c9 0 2024-04-18T21:06:56.200 INFO:tasks.workunit.client.0.smithi078.stdout:3/36: truncate d4/f9 270124 0 2024-04-18T21:06:56.200 INFO:tasks.workunit.client.0.smithi078.stdout:5/50: dread d9/fb [0,4194304] 0 2024-04-18T21:06:56.200 INFO:tasks.workunit.client.0.smithi078.stdout:7/41: mkdir d1/d6/d10 0 2024-04-18T21:06:56.200 INFO:tasks.workunit.client.0.smithi078.stdout:1/38: dread d0/f5 [0,4194304] 0 2024-04-18T21:06:56.201 INFO:tasks.workunit.client.0.smithi078.stdout:0/32: stat d0/l3 0 2024-04-18T21:06:56.201 INFO:tasks.workunit.client.0.smithi078.stdout:7/42: chown d1/d6/d10 1204377 1 2024-04-18T21:06:56.202 INFO:tasks.workunit.client.0.smithi078.stdout:7/43: chown d1/d6/dc 56 1 2024-04-18T21:06:56.203 INFO:tasks.workunit.client.0.smithi078.stdout:4/36: dwrite d0/f7 [0,4194304] 0 2024-04-18T21:06:56.204 INFO:tasks.workunit.client.0.smithi078.stdout:7/44: mkdir d1/d6/dc/d11 0 2024-04-18T21:06:56.205 INFO:tasks.workunit.client.0.smithi078.stdout:5/51: symlink d9/da/ld 0 2024-04-18T21:06:56.210 INFO:tasks.workunit.client.0.smithi078.stdout:5/52: creat d9/fe x:0 0 0 2024-04-18T21:06:56.211 INFO:tasks.workunit.client.0.smithi078.stdout:9/19: dwrite f5 [0,4194304] 0 2024-04-18T21:06:56.212 INFO:tasks.workunit.client.0.smithi078.stdout:6/24: fsync d2/f3 0 2024-04-18T21:06:56.216 INFO:tasks.workunit.client.0.smithi078.stdout:5/53: write f8 [2591908,118566] 0 2024-04-18T21:06:56.218 INFO:tasks.workunit.client.0.smithi078.stdout:0/33: dwrite d0/f5 [0,4194304] 0 2024-04-18T21:06:56.218 INFO:tasks.workunit.client.0.smithi078.stdout:9/20: creat d7/f9 x:0 0 0 2024-04-18T21:06:56.218 INFO:tasks.workunit.client.0.smithi078.stdout:1/39: dwrite d0/f8 [0,4194304] 0 2024-04-18T21:06:56.220 INFO:tasks.workunit.client.0.smithi078.stdout:5/54: dread - d9/fe zero size 2024-04-18T21:06:56.220 INFO:tasks.workunit.client.0.smithi078.stdout:7/45: dread d1/f3 [0,4194304] 0 2024-04-18T21:06:56.220 INFO:tasks.workunit.client.0.smithi078.stdout:6/25: write d2/d5/f7 [552783,23851] 0 2024-04-18T21:06:56.220 INFO:tasks.workunit.client.0.smithi078.stdout:3/37: dwrite d4/f5 [0,4194304] 0 2024-04-18T21:06:56.221 INFO:tasks.workunit.client.0.smithi078.stdout:0/34: truncate d0/f5 4445046 0 2024-04-18T21:06:56.222 INFO:tasks.workunit.client.0.smithi078.stdout:3/38: write d4/f9 [299450,25185] 0 2024-04-18T21:06:56.224 INFO:tasks.workunit.client.0.smithi078.stdout:1/40: creat d0/d1/fd x:0 0 0 2024-04-18T21:06:56.224 INFO:tasks.workunit.client.0.smithi078.stdout:5/55: rmdir d9/da 39 2024-04-18T21:06:56.224 INFO:tasks.workunit.client.0.smithi078.stdout:3/39: symlink d4/lb 0 2024-04-18T21:06:56.224 INFO:tasks.workunit.client.0.smithi078.stdout:7/46: write d1/f3 [3464581,21714] 0 2024-04-18T21:06:56.224 INFO:tasks.workunit.client.0.smithi078.stdout:4/37: dwrite d0/f7 [0,4194304] 0 2024-04-18T21:06:56.224 INFO:tasks.workunit.client.0.smithi078.stdout:1/41: chown d0/d1/c2 7664 1 2024-04-18T21:06:56.225 INFO:tasks.workunit.client.0.smithi078.stdout:7/47: mknod d1/d6/dc/c12 0 2024-04-18T21:06:56.225 INFO:tasks.workunit.client.0.smithi078.stdout:1/42: mknod d0/d1/d4/ce 0 2024-04-18T21:06:56.226 INFO:tasks.workunit.client.0.smithi078.stdout:4/38: link d0/d8/c9 d0/d8/cb 0 2024-04-18T21:06:56.226 INFO:tasks.workunit.client.0.smithi078.stdout:7/48: write d1/fb [547883,68261] 0 2024-04-18T21:06:56.227 INFO:tasks.workunit.client.0.smithi078.stdout:1/43: write d0/d1/fd [812354,92439] 0 2024-04-18T21:06:56.228 INFO:tasks.workunit.client.0.smithi078.stdout:7/49: dread - d1/d6/ff zero size 2024-04-18T21:06:56.229 INFO:tasks.workunit.client.0.smithi078.stdout:7/50: dread - d1/d6/ff zero size 2024-04-18T21:06:56.231 INFO:tasks.workunit.client.0.smithi078.stdout:5/56: write d9/fb [2912412,95460] 0 2024-04-18T21:06:56.231 INFO:tasks.workunit.client.0.smithi078.stdout:0/35: dwrite d0/f5 [0,4194304] 0 2024-04-18T21:06:56.232 INFO:tasks.workunit.client.0.smithi078.stdout:7/51: creat d1/d6/d10/f13 x:0 0 0 2024-04-18T21:06:56.233 INFO:tasks.workunit.client.0.smithi078.stdout:0/36: creat d0/f7 x:0 0 0 2024-04-18T21:06:56.234 INFO:tasks.workunit.client.0.smithi078.stdout:7/52: symlink d1/l14 0 2024-04-18T21:06:56.234 INFO:tasks.workunit.client.0.smithi078.stdout:5/57: creat d9/da/ff x:0 0 0 2024-04-18T21:06:56.235 INFO:tasks.workunit.client.0.smithi078.stdout:3/40: dwrite d4/f9 [0,4194304] 0 2024-04-18T21:06:56.235 INFO:tasks.workunit.client.0.smithi078.stdout:0/37: chown d0/f5 479810395 1 2024-04-18T21:06:56.235 INFO:tasks.workunit.client.0.smithi078.stdout:5/58: symlink d9/da/l10 0 2024-04-18T21:06:56.236 INFO:tasks.workunit.client.0.smithi078.stdout:0/38: readlink d0/l2 0 2024-04-18T21:06:56.236 INFO:tasks.workunit.client.0.smithi078.stdout:3/41: write d4/f5 [5759408,93168] 0 2024-04-18T21:06:56.237 INFO:tasks.workunit.client.0.smithi078.stdout:9/21: fdatasync f5 0 2024-04-18T21:06:56.237 INFO:tasks.workunit.client.0.smithi078.stdout:4/39: dread d0/f7 [0,4194304] 0 2024-04-18T21:06:56.238 INFO:tasks.workunit.client.0.smithi078.stdout:5/59: write d9/da/ff [449743,111928] 0 2024-04-18T21:06:56.238 INFO:tasks.workunit.client.0.smithi078.stdout:0/39: write d0/f4 [3736307,115563] 0 2024-04-18T21:06:56.239 INFO:tasks.workunit.client.0.smithi078.stdout:3/42: read d4/f9 [3379674,111559] 0 2024-04-18T21:06:56.240 INFO:tasks.workunit.client.0.smithi078.stdout:1/44: dwrite d0/d1/d4/fc [0,4194304] 0 2024-04-18T21:06:56.240 INFO:tasks.workunit.client.0.smithi078.stdout:3/43: mknod d4/da/cc 0 2024-04-18T21:06:56.242 INFO:tasks.workunit.client.0.smithi078.stdout:1/45: symlink d0/d1/d4/lf 0 2024-04-18T21:06:56.243 INFO:tasks.workunit.client.0.smithi078.stdout:3/44: write d4/f9 [582387,80334] 0 2024-04-18T21:06:56.244 INFO:tasks.workunit.client.0.smithi078.stdout:3/45: stat d4 0 2024-04-18T21:06:56.244 INFO:tasks.workunit.client.0.smithi078.stdout:4/40: rename d0/d8 to d0/dc 0 2024-04-18T21:06:56.244 INFO:tasks.workunit.client.0.smithi078.stdout:1/46: chown d0/d1/fd 1038527036 1 2024-04-18T21:06:56.245 INFO:tasks.workunit.client.0.smithi078.stdout:6/26: read d2/d5/f7 [500225,3837] 0 2024-04-18T21:06:56.245 INFO:tasks.workunit.client.0.smithi078.stdout:7/53: truncate d1/f3 1695432 0 2024-04-18T21:06:56.246 INFO:tasks.workunit.client.0.smithi078.stdout:3/46: creat d4/fd x:0 0 0 2024-04-18T21:06:56.246 INFO:tasks.workunit.client.0.smithi078.stdout:6/27: symlink d2/la 0 2024-04-18T21:06:56.247 INFO:tasks.workunit.client.0.smithi078.stdout:4/41: write d0/f7 [2374056,3183] 0 2024-04-18T21:06:56.247 INFO:tasks.workunit.client.0.smithi078.stdout:7/54: dread - d1/d6/ff zero size 2024-04-18T21:06:56.249 INFO:tasks.workunit.client.0.smithi078.stdout:4/42: mknod d0/dc/cd 0 2024-04-18T21:06:56.249 INFO:tasks.workunit.client.0.smithi078.stdout:3/47: link d4/lb d4/le 0 2024-04-18T21:06:56.249 INFO:tasks.workunit.client.0.smithi078.stdout:0/40: dwrite d0/f7 [0,4194304] 0 2024-04-18T21:06:56.250 INFO:tasks.workunit.client.0.smithi078.stdout:9/22: dwrite f0 [0,4194304] 0 2024-04-18T21:06:56.251 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:56.246+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:56.252 INFO:tasks.workunit.client.0.smithi078.stdout:0/41: stat d0/f7 0 2024-04-18T21:06:56.253 INFO:tasks.workunit.client.0.smithi078.stdout:3/48: chown l3 3411 1 2024-04-18T21:06:56.253 INFO:tasks.workunit.client.0.smithi078.stdout:4/43: rename d0/dc/cd to d0/dc/ce 0 2024-04-18T21:06:56.253 INFO:tasks.workunit.client.0.smithi078.stdout:9/23: creat d7/fa x:0 0 0 2024-04-18T21:06:56.253 INFO:tasks.workunit.client.0.smithi078.stdout:0/42: readlink d0/l2 0 2024-04-18T21:06:56.253 INFO:tasks.workunit.client.0.smithi078.stdout:5/60: fdatasync d9/fb 0 2024-04-18T21:06:56.253 INFO:tasks.workunit.client.0.smithi078.stdout:7/55: mknod d1/d6/dc/d11/c15 0 2024-04-18T21:06:56.254 INFO:tasks.workunit.client.0.smithi078.stdout:9/24: fsync f6 0 2024-04-18T21:06:56.254 INFO:tasks.workunit.client.0.smithi078.stdout:4/44: stat d0/f5 0 2024-04-18T21:06:56.257 INFO:tasks.workunit.client.0.smithi078.stdout:9/25: chown d7/fa 487 1 2024-04-18T21:06:56.257 INFO:tasks.workunit.client.0.smithi078.stdout:5/61: mknod d9/da/c11 0 2024-04-18T21:06:56.257 INFO:tasks.workunit.client.0.smithi078.stdout:4/45: mknod d0/dc/cf 0 2024-04-18T21:06:56.257 INFO:tasks.workunit.client.0.smithi078.stdout:6/28: dread d2/f4 [4194304,4194304] 0 2024-04-18T21:06:56.257 INFO:tasks.workunit.client.0.smithi078.stdout:9/26: rename d7/f9 to d7/fb 0 2024-04-18T21:06:56.258 INFO:tasks.workunit.client.0.smithi078.stdout:4/46: mkdir d0/dc/d10 0 2024-04-18T21:06:56.258 INFO:tasks.workunit.client.0.smithi078.stdout:1/47: dwrite d0/d1/d4/f6 [0,4194304] 0 2024-04-18T21:06:56.258 INFO:tasks.workunit.client.0.smithi078.stdout:9/27: dread - d7/fb zero size 2024-04-18T21:06:56.258 INFO:tasks.workunit.client.0.smithi078.stdout:9/28: fsync f5 0 2024-04-18T21:06:56.258 INFO:tasks.workunit.client.0.smithi078.stdout:6/29: rename d2/c9 to d2/d5/cb 0 2024-04-18T21:06:56.258 INFO:tasks.workunit.client.0.smithi078.stdout:1/48: unlink d0/d1/d4/f6 0 2024-04-18T21:06:56.259 INFO:tasks.workunit.client.0.smithi078.stdout:9/29: creat d7/fc x:0 0 0 2024-04-18T21:06:56.260 INFO:tasks.workunit.client.0.smithi078.stdout:4/47: link d0/dc/cb d0/c11 0 2024-04-18T21:06:56.260 INFO:tasks.workunit.client.0.smithi078.stdout:9/30: stat d7 0 2024-04-18T21:06:56.260 INFO:tasks.workunit.client.0.smithi078.stdout:6/30: fdatasync d2/d5/f7 0 2024-04-18T21:06:56.260 INFO:tasks.workunit.client.0.smithi078.stdout:4/48: truncate d0/f5 445255 0 2024-04-18T21:06:56.261 INFO:tasks.workunit.client.0.smithi078.stdout:4/49: creat d0/f12 x:0 0 0 2024-04-18T21:06:56.262 INFO:tasks.workunit.client.0.smithi078.stdout:5/62: dwrite d9/fb [0,4194304] 0 2024-04-18T21:06:56.263 INFO:tasks.workunit.client.0.smithi078.stdout:4/50: rename d0/c11 to d0/dc/c13 0 2024-04-18T21:06:56.264 INFO:tasks.workunit.client.0.smithi078.stdout:5/63: mknod d9/da/c12 0 2024-04-18T21:06:56.265 INFO:tasks.workunit.client.0.smithi078.stdout:5/64: chown d9/da/c12 535676852 1 2024-04-18T21:06:56.266 INFO:tasks.workunit.client.0.smithi078.stdout:5/65: chown d9/fe 5654 1 2024-04-18T21:06:56.267 INFO:tasks.workunit.client.0.smithi078.stdout:1/49: dwrite d0/d1/d4/fc [0,4194304] 0 2024-04-18T21:06:56.267 INFO:tasks.workunit.client.0.smithi078.stdout:9/31: dwrite d7/fb [0,4194304] 0 2024-04-18T21:06:56.268 INFO:tasks.workunit.client.0.smithi078.stdout:1/50: chown d0/d1/fd 57 1 2024-04-18T21:06:56.268 INFO:tasks.workunit.client.0.smithi078.stdout:5/66: dread d9/fb [4194304,4194304] 0 2024-04-18T21:06:56.269 INFO:tasks.workunit.client.0.smithi078.stdout:0/43: truncate d0/f7 625680 0 2024-04-18T21:06:56.269 INFO:tasks.workunit.client.0.smithi078.stdout:1/51: chown d0/d1/c3 237602908 1 2024-04-18T21:06:56.270 INFO:tasks.workunit.client.0.smithi078.stdout:9/32: creat d7/fd x:0 0 0 2024-04-18T21:06:56.270 INFO:tasks.workunit.client.0.smithi078.stdout:9/33: chown d7/fd 94636 1 2024-04-18T21:06:56.270 INFO:tasks.workunit.client.0.smithi078.stdout:0/44: creat d0/f8 x:0 0 0 2024-04-18T21:06:56.271 INFO:tasks.workunit.client.0.smithi078.stdout:0/45: stat d0/f7 0 2024-04-18T21:06:56.271 INFO:tasks.workunit.client.0.smithi078.stdout:9/34: write f0 [4151995,116676] 0 2024-04-18T21:06:56.271 INFO:tasks.workunit.client.0.smithi078.stdout:0/46: mkdir d0/d9 0 2024-04-18T21:06:56.272 INFO:tasks.workunit.client.0.smithi078.stdout:9/35: mknod d7/ce 0 2024-04-18T21:06:56.272 INFO:tasks.workunit.client.0.smithi078.stdout:9/36: write d7/fb [956027,121475] 0 2024-04-18T21:06:56.273 INFO:tasks.workunit.client.0.smithi078.stdout:0/47: mkdir d0/d9/da 0 2024-04-18T21:06:56.274 INFO:tasks.workunit.client.0.smithi078.stdout:9/37: truncate d7/fb 4867583 0 2024-04-18T21:06:56.274 INFO:tasks.workunit.client.0.smithi078.stdout:0/48: mkdir d0/d9/da/db 0 2024-04-18T21:06:56.274 INFO:tasks.workunit.client.0.smithi078.stdout:1/52: dread d0/f5 [0,4194304] 0 2024-04-18T21:06:56.276 INFO:tasks.workunit.client.0.smithi078.stdout:9/38: mkdir d7/df 0 2024-04-18T21:06:56.276 INFO:tasks.workunit.client.0.smithi078.stdout:1/53: symlink d0/d1/d4/l10 0 2024-04-18T21:06:56.276 INFO:tasks.workunit.client.0.smithi078.stdout:9/39: read f5 [4142831,126629] 0 2024-04-18T21:06:56.276 INFO:tasks.workunit.client.0.smithi078.stdout:5/67: dwrite f8 [0,4194304] 0 2024-04-18T21:06:56.276 INFO:tasks.workunit.client.0.smithi078.stdout:5/68: chown d9/da 0 1 2024-04-18T21:06:56.277 INFO:tasks.workunit.client.0.smithi078.stdout:5/69: creat d9/da/f13 x:0 0 0 2024-04-18T21:06:56.277 INFO:tasks.workunit.client.0.smithi078.stdout:5/70: rmdir d9/da 39 2024-04-18T21:06:56.278 INFO:tasks.workunit.client.0.smithi078.stdout:7/56: dread d1/fb [0,4194304] 0 2024-04-18T21:06:56.282 INFO:tasks.workunit.client.0.smithi078.stdout:1/54: dwrite d0/f7 [0,4194304] 0 2024-04-18T21:06:56.283 INFO:tasks.workunit.client.0.smithi078.stdout:7/57: dread d1/d6/dc/f9 [0,4194304] 0 2024-04-18T21:06:56.283 INFO:tasks.workunit.client.0.smithi078.stdout:7/58: stat d1/d6/dc/d11 0 2024-04-18T21:06:56.284 INFO:tasks.workunit.client.0.smithi078.stdout:9/40: fdatasync f0 0 2024-04-18T21:06:56.286 INFO:tasks.workunit.client.0.smithi078.stdout:0/49: dread d0/f7 [0,4194304] 0 2024-04-18T21:06:56.286 INFO:tasks.workunit.client.0.smithi078.stdout:9/41: creat d7/df/f10 x:0 0 0 2024-04-18T21:06:56.287 INFO:tasks.workunit.client.0.smithi078.stdout:9/42: mkdir d7/d11 0 2024-04-18T21:06:56.287 INFO:tasks.workunit.client.0.smithi078.stdout:9/43: read - d7/df/f10 zero size 2024-04-18T21:06:56.287 INFO:tasks.workunit.client.0.smithi078.stdout:0/50: link d0/l3 d0/d9/da/db/lc 0 2024-04-18T21:06:56.288 INFO:tasks.workunit.client.0.smithi078.stdout:9/44: symlink d7/df/l12 0 2024-04-18T21:06:56.289 INFO:tasks.workunit.client.0.smithi078.stdout:0/51: mkdir d0/d9/dd 0 2024-04-18T21:06:56.290 INFO:tasks.workunit.client.0.smithi078.stdout:9/45: unlink d7/fb 0 2024-04-18T21:06:56.290 INFO:tasks.workunit.client.0.smithi078.stdout:9/46: truncate f6 479998 0 2024-04-18T21:06:56.290 INFO:tasks.workunit.client.0.smithi078.stdout:9/47: stat d7/fa 0 2024-04-18T21:06:56.290 INFO:tasks.workunit.client.0.smithi078.stdout:9/48: chown f0 53028 1 2024-04-18T21:06:56.290 INFO:tasks.workunit.client.0.smithi078.stdout:9/49: creat d7/df/f13 x:0 0 0 2024-04-18T21:06:56.290 INFO:tasks.workunit.client.0.smithi078.stdout:9/50: mkdir d7/d14 0 2024-04-18T21:06:56.292 INFO:tasks.workunit.client.0.smithi078.stdout:9/51: symlink d7/d14/l15 0 2024-04-18T21:06:56.292 INFO:tasks.workunit.client.0.smithi078.stdout:9/52: stat f0 0 2024-04-18T21:06:56.292 INFO:tasks.workunit.client.0.smithi078.stdout:9/53: write f6 [844256,125045] 0 2024-04-18T21:06:56.292 INFO:tasks.workunit.client.0.smithi078.stdout:9/54: chown d7 12853 1 2024-04-18T21:06:56.292 INFO:tasks.workunit.client.0.smithi078.stdout:9/55: readlink l3 0 2024-04-18T21:06:56.294 INFO:tasks.workunit.client.0.smithi078.stdout:0/52: dwrite d0/f5 [0,4194304] 0 2024-04-18T21:06:56.295 INFO:tasks.workunit.client.0.smithi078.stdout:0/53: read d0/f5 [3248251,33511] 0 2024-04-18T21:06:56.297 INFO:tasks.workunit.client.0.smithi078.stdout:0/54: readlink d0/d9/da/db/lc 0 2024-04-18T21:06:56.298 INFO:tasks.workunit.client.0.smithi078.stdout:5/71: fdatasync f8 0 2024-04-18T21:06:56.298 INFO:tasks.workunit.client.0.smithi078.stdout:4/51: dwrite d0/f5 [0,4194304] 0 2024-04-18T21:06:56.298 INFO:tasks.workunit.client.0.smithi078.stdout:5/72: read d9/fb [3138160,107561] 0 2024-04-18T21:06:56.299 INFO:tasks.workunit.client.0.smithi078.stdout:4/52: write d0/f7 [4180581,19483] 0 2024-04-18T21:06:56.299 INFO:tasks.workunit.client.0.smithi078.stdout:0/55: chown d0/d9/da/db/lc 32669427 1 2024-04-18T21:06:56.300 INFO:tasks.workunit.client.0.smithi078.stdout:9/56: dread f5 [0,4194304] 0 2024-04-18T21:06:56.300 INFO:tasks.workunit.client.0.smithi078.stdout:1/55: fsync d0/d1/d4/fc 0 2024-04-18T21:06:56.301 INFO:tasks.workunit.client.0.smithi078.stdout:1/56: unlink d0/d1/d4/l10 0 2024-04-18T21:06:56.301 INFO:tasks.workunit.client.0.smithi078.stdout:5/73: link d9/da/c12 d9/c14 0 2024-04-18T21:06:56.305 INFO:tasks.workunit.client.0.smithi078.stdout:0/56: dwrite d0/f4 [0,4194304] 0 2024-04-18T21:06:56.306 INFO:tasks.workunit.client.0.smithi078.stdout:1/57: dread d0/d1/fd [0,4194304] 0 2024-04-18T21:06:56.306 INFO:tasks.workunit.client.0.smithi078.stdout:5/74: dread d9/da/ff [0,4194304] 0 2024-04-18T21:06:56.306 INFO:tasks.workunit.client.0.smithi078.stdout:1/58: unlink d0/f5 0 2024-04-18T21:06:56.307 INFO:tasks.workunit.client.0.smithi078.stdout:1/59: rmdir d0 39 2024-04-18T21:06:56.308 INFO:tasks.workunit.client.0.smithi078.stdout:1/60: mkdir d0/d11 0 2024-04-18T21:06:56.308 INFO:tasks.workunit.client.0.smithi078.stdout:1/61: stat d0/d1/d4/lb 0 2024-04-18T21:06:56.309 INFO:tasks.workunit.client.0.smithi078.stdout:1/62: symlink d0/d1/d4/l12 0 2024-04-18T21:06:56.310 INFO:tasks.workunit.client.0.smithi078.stdout:5/75: dread f8 [0,4194304] 0 2024-04-18T21:06:56.310 INFO:tasks.workunit.client.0.smithi078.stdout:1/63: unlink d0/d1/fd 0 2024-04-18T21:06:56.310 INFO:tasks.workunit.client.0.smithi078.stdout:5/76: write d9/da/f13 [8580,79533] 0 2024-04-18T21:06:56.311 INFO:tasks.workunit.client.0.smithi078.stdout:1/64: unlink d0/d1/d4/lf 0 2024-04-18T21:06:56.311 INFO:tasks.workunit.client.0.smithi078.stdout:1/65: mkdir d0/d13 0 2024-04-18T21:06:56.311 INFO:tasks.workunit.client.0.smithi078.stdout:1/66: chown d0/d1/c3 2678 1 2024-04-18T21:06:56.312 INFO:tasks.workunit.client.0.smithi078.stdout:1/67: symlink d0/d1/l14 0 2024-04-18T21:06:56.313 INFO:tasks.workunit.client.0.smithi078.stdout:1/68: rename d0/d1/d4/lb to d0/d1/d4/l15 0 2024-04-18T21:06:56.313 INFO:tasks.workunit.client.0.smithi078.stdout:1/69: mknod d0/d1/d4/c16 0 2024-04-18T21:06:56.314 INFO:tasks.workunit.client.0.smithi078.stdout:1/70: write d0/f8 [1578898,115568] 0 2024-04-18T21:06:56.314 INFO:tasks.workunit.client.0.smithi078.stdout:1/71: unlink d0/f7 0 2024-04-18T21:06:56.315 INFO:tasks.workunit.client.0.smithi078.stdout:9/57: dread f6 [0,4194304] 0 2024-04-18T21:06:56.315 INFO:tasks.workunit.client.0.smithi078.stdout:1/72: creat d0/d13/f17 x:0 0 0 2024-04-18T21:06:56.316 INFO:tasks.workunit.client.0.smithi078.stdout:1/73: creat d0/d11/f18 x:0 0 0 2024-04-18T21:06:56.316 INFO:tasks.workunit.client.0.smithi078.stdout:1/74: mknod d0/d11/c19 0 2024-04-18T21:06:56.317 INFO:tasks.workunit.client.0.smithi078.stdout:0/57: truncate d0/f5 2826840 0 2024-04-18T21:06:56.317 INFO:tasks.workunit.client.0.smithi078.stdout:0/58: write d0/f4 [4191698,58908] 0 2024-04-18T21:06:56.318 INFO:tasks.workunit.client.0.smithi078.stdout:0/59: symlink d0/d9/le 0 2024-04-18T21:06:56.319 INFO:tasks.workunit.client.0.smithi078.stdout:0/60: stat d0/l3 0 2024-04-18T21:06:56.319 INFO:tasks.workunit.client.0.smithi078.stdout:5/77: dread d9/da/f13 [0,4194304] 0 2024-04-18T21:06:56.319 INFO:tasks.workunit.client.0.smithi078.stdout:0/61: readlink d0/l3 0 2024-04-18T21:06:56.319 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:56.319 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:56.320 INFO:tasks.workunit.client.0.smithi078.stdout:5/78: symlink d9/l15 0 2024-04-18T21:06:56.320 INFO:tasks.workunit.client.0.smithi078.stdout:4/53: fsync d0/f5 0 2024-04-18T21:06:56.320 INFO:tasks.workunit.client.0.smithi078.stdout:0/62: chown d0/d9/da/db/lc 1018216 1 2024-04-18T21:06:56.321 INFO:tasks.workunit.client.0.smithi078.stdout:1/75: getdents d0/d1/d4 0 2024-04-18T21:06:56.322 INFO:tasks.workunit.client.0.smithi078.stdout:1/76: rmdir d0/d1 39 2024-04-18T21:06:56.324 INFO:tasks.workunit.client.0.smithi078.stdout:1/77: link d0/d1/d4/ce d0/d1/d4/c1a 0 2024-04-18T21:06:56.325 INFO:tasks.workunit.client.0.smithi078.stdout:1/78: read - d0/d13/f17 zero size 2024-04-18T21:06:56.326 INFO:tasks.workunit.client.0.smithi078.stdout:0/63: write d0/f5 [3702959,75485] 0 2024-04-18T21:06:56.327 INFO:tasks.workunit.client.0.smithi078.stdout:1/79: chown d0/d1/d4/c16 1876056 1 2024-04-18T21:06:56.327 INFO:tasks.workunit.client.0.smithi078.stdout:4/54: dwrite d0/f12 [0,4194304] 0 2024-04-18T21:06:56.328 INFO:tasks.workunit.client.0.smithi078.stdout:5/79: dwrite d9/da/f13 [0,4194304] 0 2024-04-18T21:06:56.328 INFO:tasks.workunit.client.0.smithi078.stdout:1/80: symlink d0/d1/l1b 0 2024-04-18T21:06:56.329 INFO:tasks.workunit.client.0.smithi078.stdout:5/80: symlink d9/da/l16 0 2024-04-18T21:06:56.329 INFO:tasks.workunit.client.0.smithi078.stdout:4/55: rename d0/dc/c9 to d0/dc/d10/c14 0 2024-04-18T21:06:56.332 INFO:tasks.workunit.client.0.smithi078.stdout:5/81: write d9/da/ff [1583953,32476] 0 2024-04-18T21:06:56.334 INFO:tasks.workunit.client.0.smithi078.stdout:5/82: creat d9/da/f17 x:0 0 0 2024-04-18T21:06:56.336 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:56.337 INFO:tasks.workunit.client.0.smithi078.stdout:5/83: creat d9/f18 x:0 0 0 2024-04-18T21:06:56.337 INFO:tasks.workunit.client.0.smithi078.stdout:0/64: dwrite d0/f7 [0,4194304] 0 2024-04-18T21:06:56.338 INFO:tasks.workunit.client.0.smithi078.stdout:5/84: truncate d9/fe 283455 0 2024-04-18T21:06:56.339 INFO:tasks.workunit.client.0.smithi078.stdout:1/81: dwrite d0/d1/d4/fc [0,4194304] 0 2024-04-18T21:06:56.339 INFO:tasks.workunit.client.0.smithi078.stdout:4/56: dwrite d0/f7 [0,4194304] 0 2024-04-18T21:06:56.339 INFO:tasks.workunit.client.0.smithi078.stdout:5/85: mknod d9/da/c19 0 2024-04-18T21:06:56.340 INFO:tasks.workunit.client.0.smithi078.stdout:1/82: creat d0/d1/f1c x:0 0 0 2024-04-18T21:06:56.340 INFO:tasks.workunit.client.0.smithi078.stdout:5/86: creat d9/da/f1a x:0 0 0 2024-04-18T21:06:56.340 INFO:tasks.workunit.client.0.smithi078.stdout:5/87: rmdir d9/da 39 2024-04-18T21:06:56.341 INFO:tasks.workunit.client.0.smithi078.stdout:1/83: mknod d0/d1/c1d 0 2024-04-18T21:06:56.341 INFO:tasks.workunit.client.0.smithi078.stdout:1/84: creat d0/d1/f1e x:0 0 0 2024-04-18T21:06:56.342 INFO:tasks.workunit.client.0.smithi078.stdout:5/88: creat d9/da/f1b x:0 0 0 2024-04-18T21:06:56.342 INFO:tasks.workunit.client.0.smithi078.stdout:5/89: fdatasync d9/f18 0 2024-04-18T21:06:56.342 INFO:tasks.workunit.client.0.smithi078.stdout:1/85: unlink d0/d1/l1b 0 2024-04-18T21:06:56.344 INFO:tasks.workunit.client.0.smithi078.stdout:5/90: truncate d9/da/f1b 868449 0 2024-04-18T21:06:56.346 INFO:tasks.workunit.client.0.smithi078.stdout:1/86: getdents d0/d1/d4 0 2024-04-18T21:06:56.347 INFO:tasks.workunit.client.0.smithi078.stdout:0/65: dwrite d0/f5 [0,4194304] 0 2024-04-18T21:06:56.348 INFO:tasks.workunit.client.0.smithi078.stdout:1/87: creat d0/f1f x:0 0 0 2024-04-18T21:06:56.349 INFO:tasks.workunit.client.0.smithi078.stdout:0/66: mkdir d0/d9/da/df 0 2024-04-18T21:06:56.349 INFO:tasks.workunit.client.0.smithi078.stdout:1/88: fdatasync d0/f8 0 2024-04-18T21:06:56.349 INFO:tasks.workunit.client.0.smithi078.stdout:4/57: dwrite d0/f12 [0,4194304] 0 2024-04-18T21:06:56.354 INFO:tasks.workunit.client.0.smithi078.stdout:4/58: symlink d0/dc/l15 0 2024-04-18T21:06:56.354 INFO:tasks.workunit.client.0.smithi078.stdout:0/67: creat d0/d9/da/f10 x:0 0 0 2024-04-18T21:06:56.355 INFO:tasks.workunit.client.0.smithi078.stdout:1/89: truncate d0/d13/f17 217861 0 2024-04-18T21:06:56.355 INFO:tasks.workunit.client.0.smithi078.stdout:0/68: read d0/f4 [530733,83075] 0 2024-04-18T21:06:56.355 INFO:tasks.workunit.client.0.smithi078.stdout:4/59: creat d0/dc/f16 x:0 0 0 2024-04-18T21:06:56.355 INFO:tasks.workunit.client.0.smithi078.stdout:8/23: sync 2024-04-18T21:06:56.355 INFO:tasks.workunit.client.0.smithi078.stdout:2/25: sync 2024-04-18T21:06:56.355 INFO:tasks.workunit.client.0.smithi078.stdout:2/26: stat d0 0 2024-04-18T21:06:56.355 INFO:tasks.workunit.client.0.smithi078.stdout:4/60: creat d0/f17 x:0 0 0 2024-04-18T21:06:56.355 INFO:tasks.workunit.client.0.smithi078.stdout:8/24: symlink d0/la 0 2024-04-18T21:06:56.355 INFO:tasks.workunit.client.0.smithi078.stdout:2/27: write d0/f2 [3314849,102587] 0 2024-04-18T21:06:56.355 INFO:tasks.workunit.client.0.smithi078.stdout:0/69: link d0/l3 d0/d9/da/db/l11 0 2024-04-18T21:06:56.355 INFO:tasks.workunit.client.0.smithi078.stdout:5/91: dwrite d9/da/f1a [0,4194304] 0 2024-04-18T21:06:56.355 INFO:tasks.workunit.client.0.smithi078.stdout:2/28: write d0/f3 [6263,43976] 0 2024-04-18T21:06:56.356 INFO:tasks.workunit.client.0.smithi078.stdout:1/90: getdents d0/d1 0 2024-04-18T21:06:56.358 INFO:tasks.workunit.client.0.smithi078.stdout:5/92: creat d9/f1c x:0 0 0 2024-04-18T21:06:56.358 INFO:tasks.workunit.client.0.smithi078.stdout:1/91: mknod d0/c20 0 2024-04-18T21:06:56.359 INFO:tasks.workunit.client.0.smithi078.stdout:4/61: dread d0/f12 [0,4194304] 0 2024-04-18T21:06:56.359 INFO:tasks.workunit.client.0.smithi078.stdout:5/93: truncate d9/f18 795747 0 2024-04-18T21:06:56.359 INFO:tasks.workunit.client.0.smithi078.stdout:0/70: dread d0/f7 [0,4194304] 0 2024-04-18T21:06:56.360 INFO:tasks.workunit.client.0.smithi078.stdout:4/62: creat d0/f18 x:0 0 0 2024-04-18T21:06:56.360 INFO:tasks.workunit.client.0.smithi078.stdout:1/92: write d0/d1/d4/fc [1262658,66804] 0 2024-04-18T21:06:56.360 INFO:tasks.workunit.client.0.smithi078.stdout:5/94: chown d9/fb 1295046713 1 2024-04-18T21:06:56.361 INFO:tasks.workunit.client.0.smithi078.stdout:0/71: write d0/f4 [2968023,65559] 0 2024-04-18T21:06:56.362 INFO:tasks.workunit.client.0.smithi078.stdout:4/63: creat d0/f19 x:0 0 0 2024-04-18T21:06:56.363 INFO:tasks.workunit.client.0.smithi078.stdout:1/93: creat d0/d11/f21 x:0 0 0 2024-04-18T21:06:56.364 INFO:tasks.workunit.client.0.smithi078.stdout:0/72: write d0/f4 [3602600,68354] 0 2024-04-18T21:06:56.364 INFO:tasks.workunit.client.0.smithi078.stdout:4/64: write d0/f17 [937998,1514] 0 2024-04-18T21:06:56.365 INFO:tasks.workunit.client.0.smithi078.stdout:8/25: dwrite d0/f5 [0,4194304] 0 2024-04-18T21:06:56.365 INFO:tasks.workunit.client.0.smithi078.stdout:4/65: write d0/f19 [577792,67250] 0 2024-04-18T21:06:56.368 INFO:tasks.workunit.client.0.smithi078.stdout:4/66: rename d0/dc/c13 to d0/dc/d10/c1a 0 2024-04-18T21:06:56.370 INFO:tasks.workunit.client.0.smithi078.stdout:5/95: dwrite f8 [0,4194304] 0 2024-04-18T21:06:56.372 INFO:tasks.workunit.client.0.smithi078.stdout:8/26: dread d0/f5 [0,4194304] 0 2024-04-18T21:06:56.373 INFO:tasks.workunit.client.0.smithi078.stdout:1/94: dwrite d0/d1/d4/fc [0,4194304] 0 2024-04-18T21:06:56.373 INFO:tasks.workunit.client.0.smithi078.stdout:8/27: chown d0/l8 655 1 2024-04-18T21:06:56.374 INFO:tasks.workunit.client.0.smithi078.stdout:1/95: rename d0/d1/f1c to d0/d11/f22 0 2024-04-18T21:06:56.375 INFO:tasks.workunit.client.0.smithi078.stdout:1/96: mknod d0/d1/d4/c23 0 2024-04-18T21:06:56.376 INFO:tasks.workunit.client.0.smithi078.stdout:8/28: truncate d0/f3 4598059 0 2024-04-18T21:06:56.376 INFO:tasks.workunit.client.0.smithi078.stdout:5/96: getdents d9 0 2024-04-18T21:06:56.376 INFO:tasks.workunit.client.0.smithi078.stdout:8/29: stat d0/c4 0 2024-04-18T21:06:56.377 INFO:tasks.workunit.client.0.smithi078.stdout:1/97: dread - d0/d11/f21 zero size 2024-04-18T21:06:56.377 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:56.378+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:56.378 INFO:tasks.workunit.client.0.smithi078.stdout:7/59: sync 2024-04-18T21:06:56.378 INFO:tasks.workunit.client.0.smithi078.stdout:3/49: sync 2024-04-18T21:06:56.378 INFO:tasks.workunit.client.0.smithi078.stdout:9/58: sync 2024-04-18T21:06:56.378 INFO:tasks.workunit.client.0.smithi078.stdout:6/31: sync 2024-04-18T21:06:56.378 INFO:tasks.workunit.client.0.smithi078.stdout:8/30: chown d0/f3 1416106340 1 2024-04-18T21:06:56.378 INFO:tasks.workunit.client.0.smithi078.stdout:0/73: sync 2024-04-18T21:06:56.380 INFO:tasks.workunit.client.0.smithi078.stdout:4/67: dwrite d0/f5 [0,4194304] 0 2024-04-18T21:06:56.380 INFO:tasks.workunit.client.0.smithi078.stdout:0/74: stat d0/d9/da/db 0 2024-04-18T21:06:56.381 INFO:tasks.workunit.client.0.smithi078.stdout:5/97: write d9/da/ff [2449369,93891] 0 2024-04-18T21:06:56.381 INFO:tasks.workunit.client.0.smithi078.stdout:4/68: chown d0 134563371 1 2024-04-18T21:06:56.381 INFO:tasks.workunit.client.0.smithi078.stdout:9/59: creat d7/f16 x:0 0 0 2024-04-18T21:06:56.381 INFO:tasks.workunit.client.0.smithi078.stdout:1/98: truncate d0/f8 1580513 0 2024-04-18T21:06:56.381 INFO:tasks.workunit.client.0.smithi078.stdout:7/60: read d1/f3 [1232758,113721] 0 2024-04-18T21:06:56.381 INFO:tasks.workunit.client.0.smithi078.stdout:6/32: creat d2/d6/fc x:0 0 0 2024-04-18T21:06:56.381 INFO:tasks.workunit.client.0.smithi078.stdout:0/75: mknod d0/d9/da/c12 0 2024-04-18T21:06:56.381 INFO:tasks.workunit.client.0.smithi078.stdout:4/69: creat d0/dc/d10/f1b x:0 0 0 2024-04-18T21:06:56.381 INFO:tasks.workunit.client.0.smithi078.stdout:8/31: write d0/f5 [391756,122764] 0 2024-04-18T21:06:56.381 INFO:tasks.workunit.client.0.smithi078.stdout:3/50: write d4/fd [128373,84670] 0 2024-04-18T21:06:56.381 INFO:tasks.workunit.client.0.smithi078.stdout:5/98: mkdir d9/da/d1d 0 2024-04-18T21:06:56.382 INFO:tasks.workunit.client.0.smithi078.stdout:6/33: write d2/f3 [3690522,30216] 0 2024-04-18T21:06:56.382 INFO:tasks.workunit.client.0.smithi078.stdout:9/60: unlink d7/f16 0 2024-04-18T21:06:56.382 INFO:tasks.workunit.client.0.smithi078.stdout:0/76: read d0/f4 [183363,3963] 0 2024-04-18T21:06:56.382 INFO:tasks.workunit.client.0.smithi078.stdout:1/99: creat d0/d1/f24 x:0 0 0 2024-04-18T21:06:56.382 INFO:tasks.workunit.client.0.smithi078.stdout:4/70: rmdir d0/dc/d10 39 2024-04-18T21:06:56.383 INFO:tasks.workunit.client.0.smithi078.stdout:3/51: mkdir d4/df 0 2024-04-18T21:06:56.384 INFO:tasks.workunit.client.0.smithi078.stdout:5/99: dread d9/fb [4194304,4194304] 0 2024-04-18T21:06:56.384 INFO:tasks.workunit.client.0.smithi078.stdout:1/100: chown d0/d1 9289079 1 2024-04-18T21:06:56.384 INFO:tasks.workunit.client.0.smithi078.stdout:4/71: chown d0/dc/d10 132350663 1 2024-04-18T21:06:56.384 INFO:tasks.workunit.client.0.smithi078.stdout:6/34: write d2/f3 [4132267,3092] 0 2024-04-18T21:06:56.384 INFO:tasks.workunit.client.0.smithi078.stdout:8/32: link d0/f3 d0/fb 0 2024-04-18T21:06:56.384 INFO:tasks.workunit.client.0.smithi078.stdout:9/61: symlink d7/d14/l17 0 2024-04-18T21:06:56.384 INFO:tasks.workunit.client.0.smithi078.stdout:7/61: rename d1/d6 to d1/d16 0 2024-04-18T21:06:56.384 INFO:tasks.workunit.client.0.smithi078.stdout:9/62: readlink d7/d14/l17 0 2024-04-18T21:06:56.385 INFO:tasks.workunit.client.0.smithi078.stdout:1/101: unlink d0/d1/f1e 0 2024-04-18T21:06:56.385 INFO:tasks.workunit.client.0.smithi078.stdout:0/77: creat d0/d9/da/db/f13 x:0 0 0 2024-04-18T21:06:56.385 INFO:tasks.workunit.client.0.smithi078.stdout:9/63: mknod d7/df/c18 0 2024-04-18T21:06:56.385 INFO:tasks.workunit.client.0.smithi078.stdout:6/35: truncate d2/d6/fc 291874 0 2024-04-18T21:06:56.385 INFO:tasks.workunit.client.0.smithi078.stdout:7/62: chown d1/f3 201242289 1 2024-04-18T21:06:56.386 INFO:tasks.workunit.client.0.smithi078.stdout:5/100: write d9/fe [852676,5037] 0 2024-04-18T21:06:56.386 INFO:tasks.workunit.client.0.smithi078.stdout:4/72: chown d0/c6 3400219 1 2024-04-18T21:06:56.386 INFO:tasks.workunit.client.0.smithi078.stdout:6/36: rename d2/d5 to d2/d6/dd 0 2024-04-18T21:06:56.387 INFO:tasks.workunit.client.0.smithi078.stdout:5/101: fdatasync d9/f18 0 2024-04-18T21:06:56.387 INFO:tasks.workunit.client.0.smithi078.stdout:7/63: write d1/fb [486135,90062] 0 2024-04-18T21:06:56.387 INFO:tasks.workunit.client.0.smithi078.stdout:2/29: dread d0/f3 [4194304,4194304] 0 2024-04-18T21:06:56.388 INFO:tasks.workunit.client.0.smithi078.stdout:4/73: mkdir d0/dc/d10/d1c 0 2024-04-18T21:06:56.389 INFO:tasks.workunit.client.0.smithi078.stdout:6/37: write d2/f4 [2585180,17576] 0 2024-04-18T21:06:56.389 INFO:tasks.workunit.client.0.smithi078.stdout:2/30: symlink d0/l7 0 2024-04-18T21:06:56.389 INFO:tasks.workunit.client.0.smithi078.stdout:9/64: chown d7/df/c18 59 1 2024-04-18T21:06:56.389 INFO:tasks.workunit.client.0.smithi078.stdout:7/64: readlink d1/l14 0 2024-04-18T21:06:56.390 INFO:tasks.workunit.client.0.smithi078.stdout:9/65: fsync d7/fa 0 2024-04-18T21:06:56.391 INFO:tasks.workunit.client.0.smithi078.stdout:5/102: write d9/da/f1b [76946,38862] 0 2024-04-18T21:06:56.391 INFO:tasks.workunit.client.0.smithi078.stdout:6/38: link d2/d6/fc d2/fe 0 2024-04-18T21:06:56.392 INFO:tasks.workunit.client.0.smithi078.stdout:7/65: truncate d1/f3 1686172 0 2024-04-18T21:06:56.392 INFO:tasks.workunit.client.0.smithi078.stdout:3/52: dwrite d4/f5 [4194304,4194304] 0 2024-04-18T21:06:56.393 INFO:tasks.workunit.client.0.smithi078.stdout:2/31: truncate d0/f5 649300 0 2024-04-18T21:06:56.394 INFO:tasks.workunit.client.0.smithi078.stdout:7/66: creat d1/d16/f17 x:0 0 0 2024-04-18T21:06:56.394 INFO:tasks.workunit.client.0.smithi078.stdout:6/39: unlink d2/d6/dd/f7 0 2024-04-18T21:06:56.394 INFO:tasks.workunit.client.0.smithi078.stdout:9/66: rename d7/d14/l15 to d7/d14/l19 0 2024-04-18T21:06:56.395 INFO:tasks.workunit.client.0.smithi078.stdout:0/78: dwrite d0/f5 [0,4194304] 0 2024-04-18T21:06:56.396 INFO:tasks.workunit.client.0.smithi078.stdout:7/67: creat d1/f18 x:0 0 0 2024-04-18T21:06:56.397 INFO:tasks.workunit.client.0.smithi078.stdout:3/53: rename d4/l7 to d4/df/l10 0 2024-04-18T21:06:56.397 INFO:tasks.workunit.client.0.smithi078.stdout:6/40: unlink d2/la 0 2024-04-18T21:06:56.397 INFO:tasks.workunit.client.0.smithi078.stdout:8/33: dread d0/fb [0,4194304] 0 2024-04-18T21:06:56.397 INFO:tasks.workunit.client.0.smithi078.stdout:9/67: unlink d7/fd 0 2024-04-18T21:06:56.397 INFO:tasks.workunit.client.0.smithi078.stdout:0/79: mkdir d0/d9/dd/d14 0 2024-04-18T21:06:56.399 INFO:tasks.workunit.client.0.smithi078.stdout:7/68: truncate d1/d16/f17 435777 0 2024-04-18T21:06:56.400 INFO:tasks.workunit.client.0.smithi078.stdout:4/74: dwrite d0/f17 [0,4194304] 0 2024-04-18T21:06:56.400 INFO:tasks.workunit.client.0.smithi078.stdout:5/103: dread d9/fb [0,4194304] 0 2024-04-18T21:06:56.400 INFO:tasks.workunit.client.0.smithi078.stdout:9/68: symlink d7/l1a 0 2024-04-18T21:06:56.400 INFO:tasks.workunit.client.0.smithi078.stdout:8/34: mknod d0/cc 0 2024-04-18T21:06:56.401 INFO:tasks.workunit.client.0.smithi078.stdout:8/35: readlink d0/la 0 2024-04-18T21:06:56.402 INFO:tasks.workunit.client.0.smithi078.stdout:2/32: dread d0/f2 [0,4194304] 0 2024-04-18T21:06:56.403 INFO:tasks.workunit.client.0.smithi078.stdout:8/36: chown d0/c1 2 1 2024-04-18T21:06:56.404 INFO:tasks.workunit.client.0.smithi078.stdout:7/69: unlink d1/d16/ce 0 2024-04-18T21:06:56.405 INFO:tasks.workunit.client.0.smithi078.stdout:6/41: dread d2/f3 [0,4194304] 0 2024-04-18T21:06:56.406 INFO:tasks.workunit.client.0.smithi078.stdout:0/80: getdents d0/d9/dd 0 2024-04-18T21:06:56.406 INFO:tasks.workunit.client.0.smithi078.stdout:4/75: rename d0/dc/f16 to d0/dc/f1d 0 2024-04-18T21:06:56.406 INFO:tasks.workunit.client.0.smithi078.stdout:2/33: write d0/f3 [4631697,54041] 0 2024-04-18T21:06:56.407 INFO:tasks.workunit.client.0.smithi078.stdout:7/70: dread - d1/d16/dc/fd zero size 2024-04-18T21:06:56.407 INFO:tasks.workunit.client.0.smithi078.stdout:4/76: stat d0 0 2024-04-18T21:06:56.407 INFO:tasks.workunit.client.0.smithi078.stdout:1/102: dread d0/f8 [0,4194304] 0 2024-04-18T21:06:56.408 INFO:tasks.workunit.client.0.smithi078.stdout:8/37: getdents d0 0 2024-04-18T21:06:56.409 INFO:tasks.workunit.client.0.smithi078.stdout:0/81: mkdir d0/d15 0 2024-04-18T21:06:56.410 INFO:tasks.workunit.client.0.smithi078.stdout:7/71: write d1/d16/ff [565357,60169] 0 2024-04-18T21:06:56.410 INFO:tasks.workunit.client.0.smithi078.stdout:3/54: dwrite d4/f5 [8388608,4194304] 0 2024-04-18T21:06:56.410 INFO:tasks.workunit.client.0.smithi078.stdout:5/104: dread d9/da/f1b [0,4194304] 0 2024-04-18T21:06:56.411 INFO:tasks.workunit.client.0.smithi078.stdout:8/38: fsync d0/f3 0 2024-04-18T21:06:56.411 INFO:tasks.workunit.client.0.smithi078.stdout:2/34: rename d0/f2 to d0/f8 0 2024-04-18T21:06:56.412 INFO:tasks.workunit.client.0.smithi078.stdout:4/77: creat d0/dc/f1e x:0 0 0 2024-04-18T21:06:56.412 INFO:tasks.workunit.client.0.smithi078.stdout:6/42: getdents d2 0 2024-04-18T21:06:56.413 INFO:tasks.workunit.client.0.smithi078.stdout:2/35: readlink d0/l7 0 2024-04-18T21:06:56.414 INFO:tasks.workunit.client.0.smithi078.stdout:9/69: dwrite d7/fa [0,4194304] 0 2024-04-18T21:06:56.414 INFO:tasks.workunit.client.0.smithi078.stdout:6/43: creat d2/ff x:0 0 0 2024-04-18T21:06:56.415 INFO:tasks.workunit.client.0.smithi078.stdout:0/82: link d0/f4 d0/f16 0 2024-04-18T21:06:56.415 INFO:tasks.workunit.client.0.smithi078.stdout:8/39: dread d0/f3 [4194304,4194304] 0 2024-04-18T21:06:56.416 INFO:tasks.workunit.client.0.smithi078.stdout:3/55: fsync d4/fd 0 2024-04-18T21:06:56.416 INFO:tasks.workunit.client.0.smithi078.stdout:6/44: symlink d2/d6/dd/l10 0 2024-04-18T21:06:56.416 INFO:tasks.workunit.client.0.smithi078.stdout:2/36: dread d0/f5 [0,4194304] 0 2024-04-18T21:06:56.417 INFO:tasks.workunit.client.0.smithi078.stdout:0/83: stat d0/l3 0 2024-04-18T21:06:56.417 INFO:tasks.workunit.client.0.smithi078.stdout:4/78: symlink d0/dc/d10/l1f 0 2024-04-18T21:06:56.417 INFO:tasks.workunit.client.0.smithi078.stdout:4/79: readlink d0/dc/l15 0 2024-04-18T21:06:56.421 INFO:tasks.workunit.client.0.smithi078.stdout:0/84: rmdir d0/d9/da 39 2024-04-18T21:06:56.422 INFO:tasks.workunit.client.0.smithi078.stdout:4/80: write d0/dc/f1e [102677,33684] 0 2024-04-18T21:06:56.423 INFO:tasks.workunit.client.0.smithi078.stdout:0/85: chown d0/d9 380483 1 2024-04-18T21:06:56.423 INFO:tasks.workunit.client.0.smithi078.stdout:5/105: truncate d9/da/ff 1423142 0 2024-04-18T21:06:56.425 INFO:tasks.workunit.client.0.smithi078.stdout:1/103: dwrite d0/d11/f22 [0,4194304] 0 2024-04-18T21:06:56.428 INFO:tasks.workunit.client.0.smithi078.stdout:4/81: creat d0/f20 x:0 0 0 2024-04-18T21:06:56.429 INFO:tasks.workunit.client.0.smithi078.stdout:7/72: dwrite d1/d16/f17 [0,4194304] 0 2024-04-18T21:06:56.430 INFO:tasks.workunit.client.0.smithi078.stdout:5/106: rename d9/da/f17 to d9/f1e 0 2024-04-18T21:06:56.431 INFO:tasks.workunit.client.0.smithi078.stdout:1/104: mknod d0/c25 0 2024-04-18T21:06:56.433 INFO:tasks.workunit.client.0.smithi078.stdout:4/82: creat d0/f21 x:0 0 0 2024-04-18T21:06:56.433 INFO:tasks.workunit.client.0.smithi078.stdout:2/37: dread d0/f8 [0,4194304] 0 2024-04-18T21:06:56.434 INFO:tasks.workunit.client.0.smithi078.stdout:8/40: dwrite d0/f5 [4194304,4194304] 0 2024-04-18T21:06:56.435 INFO:tasks.workunit.client.0.smithi078.stdout:5/107: write f8 [3469933,20115] 0 2024-04-18T21:06:56.436 INFO:tasks.workunit.client.0.smithi078.stdout:9/70: dwrite d7/fc [0,4194304] 0 2024-04-18T21:06:56.437 INFO:tasks.workunit.client.0.smithi078.stdout:1/105: chown d0/d1/f24 790 1 2024-04-18T21:06:56.437 INFO:tasks.workunit.client.0.smithi078.stdout:3/56: dwrite d4/fd [0,4194304] 0 2024-04-18T21:06:56.438 INFO:tasks.workunit.client.0.smithi078.stdout:8/41: read d0/f5 [619508,58743] 0 2024-04-18T21:06:56.439 INFO:tasks.workunit.client.0.smithi078.stdout:7/73: link d1/d16/d10/f13 d1/d16/d10/f19 0 2024-04-18T21:06:56.439 INFO:tasks.workunit.client.0.smithi078.stdout:2/38: write d0/f5 [688432,34009] 0 2024-04-18T21:06:56.440 INFO:tasks.workunit.client.0.smithi078.stdout:5/108: creat d9/da/f1f x:0 0 0 2024-04-18T21:06:56.440 INFO:tasks.workunit.client.0.smithi078.stdout:1/106: symlink d0/d1/d4/l26 0 2024-04-18T21:06:56.440 INFO:tasks.workunit.client.0.smithi078.stdout:8/42: creat d0/fd x:0 0 0 2024-04-18T21:06:56.441 INFO:tasks.workunit.client.0.smithi078.stdout:9/71: mkdir d7/d11/d1b 0 2024-04-18T21:06:56.441 INFO:tasks.workunit.client.0.smithi078.stdout:6/45: dwrite d2/fe [0,4194304] 0 2024-04-18T21:06:56.442 INFO:tasks.workunit.client.0.smithi078.stdout:3/57: truncate d4/fd 5000049 0 2024-04-18T21:06:56.442 INFO:tasks.workunit.client.0.smithi078.stdout:9/72: stat d7 0 2024-04-18T21:06:56.442 INFO:tasks.workunit.client.0.smithi078.stdout:7/74: creat d1/d16/d10/f1a x:0 0 0 2024-04-18T21:06:56.443 INFO:tasks.workunit.client.0.smithi078.stdout:0/86: dwrite d0/f8 [0,4194304] 0 2024-04-18T21:06:56.443 INFO:tasks.workunit.client.0.smithi078.stdout:5/109: write d9/fe [969053,123027] 0 2024-04-18T21:06:56.443 INFO:tasks.workunit.client.0.smithi078.stdout:9/73: truncate f6 1763651 0 2024-04-18T21:06:56.443 INFO:tasks.workunit.client.0.smithi078.stdout:8/43: chown d0/cc 0 1 2024-04-18T21:06:56.444 INFO:tasks.workunit.client.0.smithi078.stdout:3/58: chown d4/f9 6418 1 2024-04-18T21:06:56.444 INFO:tasks.workunit.client.0.smithi078.stdout:3/59: write d4/f9 [4473639,119009] 0 2024-04-18T21:06:56.445 INFO:tasks.workunit.client.0.smithi078.stdout:6/46: creat d2/d6/dd/f11 x:0 0 0 2024-04-18T21:06:56.446 INFO:tasks.workunit.client.0.smithi078.stdout:9/74: mknod d7/d11/c1c 0 2024-04-18T21:06:56.447 INFO:tasks.workunit.client.0.smithi078.stdout:6/47: creat d2/d6/f12 x:0 0 0 2024-04-18T21:06:56.447 INFO:tasks.workunit.client.0.smithi078.stdout:4/83: dread d0/dc/f1e [0,4194304] 0 2024-04-18T21:06:56.448 INFO:tasks.workunit.client.0.smithi078.stdout:5/110: write d9/fb [4664051,63690] 0 2024-04-18T21:06:56.448 INFO:tasks.workunit.client.0.smithi078.stdout:6/48: fdatasync d2/ff 0 2024-04-18T21:06:56.450 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:56.446+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:56.450 INFO:tasks.workunit.client.0.smithi078.stdout:2/39: dread d0/f3 [0,4194304] 0 2024-04-18T21:06:56.451 INFO:tasks.workunit.client.0.smithi078.stdout:6/49: write d2/f4 [4654561,49673] 0 2024-04-18T21:06:56.455 INFO:tasks.workunit.client.0.smithi078.stdout:3/60: dread d4/fd [0,4194304] 0 2024-04-18T21:06:56.455 INFO:tasks.workunit.client.0.smithi078.stdout:1/107: dwrite d0/d11/f22 [4194304,4194304] 0 2024-04-18T21:06:56.455 INFO:tasks.workunit.client.0.smithi078.stdout:2/40: getdents d0 0 2024-04-18T21:06:56.457 INFO:tasks.workunit.client.0.smithi078.stdout:1/108: rmdir d0/d13 39 2024-04-18T21:06:56.457 INFO:tasks.workunit.client.0.smithi078.stdout:2/41: write d0/f5 [709712,70579] 0 2024-04-18T21:06:56.457 INFO:tasks.workunit.client.0.smithi078.stdout:3/61: write d4/f9 [4172596,62656] 0 2024-04-18T21:06:56.458 INFO:tasks.workunit.client.0.smithi078.stdout:8/44: dwrite d0/fd [0,4194304] 0 2024-04-18T21:06:56.459 INFO:tasks.workunit.client.0.smithi078.stdout:1/109: creat d0/d1/d4/f27 x:0 0 0 2024-04-18T21:06:56.459 INFO:tasks.workunit.client.0.smithi078.stdout:4/84: dread d0/f17 [0,4194304] 0 2024-04-18T21:06:56.459 INFO:tasks.workunit.client.0.smithi078.stdout:2/42: write d0/f5 [1479831,2167] 0 2024-04-18T21:06:56.459 INFO:tasks.workunit.client.0.smithi078.stdout:3/62: truncate d4/fd 5300628 0 2024-04-18T21:06:56.460 INFO:tasks.workunit.client.0.smithi078.stdout:8/45: truncate d0/fd 4703300 0 2024-04-18T21:06:56.460 INFO:tasks.workunit.client.0.smithi078.stdout:9/75: dwrite d7/fc [0,4194304] 0 2024-04-18T21:06:56.461 INFO:tasks.workunit.client.0.smithi078.stdout:1/110: truncate d0/f1f 59505 0 2024-04-18T21:06:56.463 INFO:tasks.workunit.client.0.smithi078.stdout:1/111: write d0/d1/d4/f27 [891760,84166] 0 2024-04-18T21:06:56.467 INFO:tasks.workunit.client.0.smithi078.stdout:2/43: fsync d0/f5 0 2024-04-18T21:06:56.469 INFO:tasks.workunit.client.0.smithi078.stdout:8/46: creat d0/fe x:0 0 0 2024-04-18T21:06:56.469 INFO:tasks.workunit.client.0.smithi078.stdout:7/75: fsync d1/d16/d10/f19 0 2024-04-18T21:06:56.470 INFO:tasks.workunit.client.0.smithi078.stdout:6/50: truncate d2/f4 1662521 0 2024-04-18T21:06:56.471 INFO:tasks.workunit.client.0.smithi078.stdout:9/76: symlink d7/l1d 0 2024-04-18T21:06:56.472 INFO:tasks.workunit.client.0.smithi078.stdout:1/112: creat d0/d1/d4/f28 x:0 0 0 2024-04-18T21:06:56.472 INFO:tasks.workunit.client.0.smithi078.stdout:4/85: rename d0/f21 to d0/dc/f22 0 2024-04-18T21:06:56.473 INFO:tasks.workunit.client.0.smithi078.stdout:9/77: dread - d7/df/f10 zero size 2024-04-18T21:06:56.475 INFO:tasks.workunit.client.0.smithi078.stdout:4/86: fdatasync d0/dc/f22 0 2024-04-18T21:06:56.475 INFO:tasks.workunit.client.0.smithi078.stdout:1/113: fsync d0/d1/d4/f27 0 2024-04-18T21:06:56.475 INFO:tasks.workunit.client.0.smithi078.stdout:7/76: rename d1/d16/la to d1/d16/dc/d11/l1b 0 2024-04-18T21:06:56.475 INFO:tasks.workunit.client.0.smithi078.stdout:3/63: dwrite d4/f5 [8388608,4194304] 0 2024-04-18T21:06:56.476 INFO:tasks.workunit.client.0.smithi078.stdout:9/78: unlink d7/l1d 0 2024-04-18T21:06:56.478 INFO:tasks.workunit.client.0.smithi078.stdout:7/77: mkdir d1/d16/d1c 0 2024-04-18T21:06:56.480 INFO:tasks.workunit.client.0.smithi078.stdout:0/87: dwrite d0/f16 [0,4194304] 0 2024-04-18T21:06:56.480 INFO:tasks.workunit.client.0.smithi078.stdout:1/114: read d0/d1/d4/fc [2427793,116557] 0 2024-04-18T21:06:56.482 INFO:tasks.workunit.client.0.smithi078.stdout:6/51: fsync d2/f4 0 2024-04-18T21:06:56.482 INFO:tasks.workunit.client.0.smithi078.stdout:9/79: truncate f5 1584806 0 2024-04-18T21:06:56.483 INFO:tasks.workunit.client.0.smithi078.stdout:5/111: dwrite d9/da/ff [0,4194304] 0 2024-04-18T21:06:56.483 INFO:tasks.workunit.client.0.smithi078.stdout:8/47: dwrite d0/fd [0,4194304] 0 2024-04-18T21:06:56.484 INFO:tasks.workunit.client.0.smithi078.stdout:0/88: mkdir d0/d9/dd/d17 0 2024-04-18T21:06:56.484 INFO:tasks.workunit.client.0.smithi078.stdout:7/78: creat d1/f1d x:0 0 0 2024-04-18T21:06:56.485 INFO:tasks.workunit.client.0.smithi078.stdout:1/115: write d0/d1/f24 [424601,106293] 0 2024-04-18T21:06:56.487 INFO:tasks.workunit.client.0.smithi078.stdout:2/44: dwrite d0/f3 [4194304,4194304] 0 2024-04-18T21:06:56.487 INFO:tasks.workunit.client.0.smithi078.stdout:9/80: truncate d7/df/f13 619128 0 2024-04-18T21:06:56.487 INFO:tasks.workunit.client.0.smithi078.stdout:0/89: mknod d0/d9/c18 0 2024-04-18T21:06:56.488 INFO:tasks.workunit.client.0.smithi078.stdout:1/116: mknod d0/d11/c29 0 2024-04-18T21:06:56.490 INFO:tasks.workunit.client.0.smithi078.stdout:7/79: readlink d1/d16/dc/d11/l1b 0 2024-04-18T21:06:56.490 INFO:tasks.workunit.client.0.smithi078.stdout:9/81: mkdir d7/df/d1e 0 2024-04-18T21:06:56.490 INFO:tasks.workunit.client.0.smithi078.stdout:2/45: rename d0/f8 to d0/f9 0 2024-04-18T21:06:56.490 INFO:tasks.workunit.client.0.smithi078.stdout:1/117: chown d0/c20 0 1 2024-04-18T21:06:56.490 INFO:tasks.workunit.client.0.smithi078.stdout:5/112: write d9/da/ff [4303395,17381] 0 2024-04-18T21:06:56.490 INFO:tasks.workunit.client.0.smithi078.stdout:0/90: symlink d0/d15/l19 0 2024-04-18T21:06:56.490 INFO:tasks.workunit.client.0.smithi078.stdout:4/87: dwrite d0/f12 [0,4194304] 0 2024-04-18T21:06:56.490 INFO:tasks.workunit.client.0.smithi078.stdout:3/64: dread d4/f5 [8388608,4194304] 0 2024-04-18T21:06:56.491 INFO:tasks.workunit.client.0.smithi078.stdout:0/91: chown d0/d9/dd 69 1 2024-04-18T21:06:56.491 INFO:tasks.workunit.client.0.smithi078.stdout:7/80: chown d1/d16/dc/f9 222216726 1 2024-04-18T21:06:56.491 INFO:tasks.workunit.client.0.smithi078.stdout:2/46: symlink d0/la 0 2024-04-18T21:06:56.491 INFO:tasks.workunit.client.0.smithi078.stdout:9/82: symlink d7/d14/l1f 0 2024-04-18T21:06:56.492 INFO:tasks.workunit.client.0.smithi078.stdout:1/118: mkdir d0/d2a 0 2024-04-18T21:06:56.492 INFO:tasks.workunit.client.0.smithi078.stdout:4/88: write d0/dc/f1d [538352,43657] 0 2024-04-18T21:06:56.492 INFO:tasks.workunit.client.0.smithi078.stdout:2/47: mkdir d0/db 0 2024-04-18T21:06:56.492 INFO:tasks.workunit.client.0.smithi078.stdout:6/52: dread d2/d6/fc [0,4194304] 0 2024-04-18T21:06:56.492 INFO:tasks.workunit.client.0.smithi078.stdout:4/89: read d0/f7 [3497241,83636] 0 2024-04-18T21:06:56.493 INFO:tasks.workunit.client.0.smithi078.stdout:6/53: readlink d2/d6/dd/l10 0 2024-04-18T21:06:56.494 INFO:tasks.workunit.client.0.smithi078.stdout:4/90: symlink d0/l23 0 2024-04-18T21:06:56.494 INFO:tasks.workunit.client.0.smithi078.stdout:7/81: rename d1/d16/dc/f9 to d1/d16/dc/f1e 0 2024-04-18T21:06:56.494 INFO:tasks.workunit.client.0.smithi078.stdout:2/48: link d0/f9 d0/db/fc 0 2024-04-18T21:06:56.494 INFO:tasks.workunit.client.0.smithi078.stdout:1/119: link d0/d1/c1d d0/d1/d4/c2b 0 2024-04-18T21:06:56.494 INFO:tasks.workunit.client.0.smithi078.stdout:2/49: stat d0/f5 0 2024-04-18T21:06:56.495 INFO:tasks.workunit.client.0.smithi078.stdout:4/91: stat d0/dc/d10/d1c 0 2024-04-18T21:06:56.495 INFO:tasks.workunit.client.0.smithi078.stdout:4/92: readlink d0/dc/d10/l1f 0 2024-04-18T21:06:56.496 INFO:tasks.workunit.client.0.smithi078.stdout:0/92: dread d0/f5 [0,4194304] 0 2024-04-18T21:06:56.497 INFO:tasks.workunit.client.0.smithi078.stdout:2/50: creat d0/db/fd x:0 0 0 2024-04-18T21:06:56.497 INFO:tasks.workunit.client.0.smithi078.stdout:7/82: creat d1/f1f x:0 0 0 2024-04-18T21:06:56.498 INFO:tasks.workunit.client.0.smithi078.stdout:0/93: rmdir d0/d15 39 2024-04-18T21:06:56.498 INFO:tasks.workunit.client.0.smithi078.stdout:4/93: getdents d0/dc/d10/d1c 0 2024-04-18T21:06:56.498 INFO:tasks.workunit.client.0.smithi078.stdout:2/51: rmdir d0 39 2024-04-18T21:06:56.499 INFO:tasks.workunit.client.0.smithi078.stdout:7/83: truncate d1/f18 364545 0 2024-04-18T21:06:56.500 INFO:tasks.workunit.client.0.smithi078.stdout:3/65: fdatasync d4/f5 0 2024-04-18T21:06:56.500 INFO:tasks.workunit.client.0.smithi078.stdout:4/94: write d0/dc/f22 [362035,73846] 0 2024-04-18T21:06:56.501 INFO:tasks.workunit.client.0.smithi078.stdout:9/83: dwrite d7/df/f13 [0,4194304] 0 2024-04-18T21:06:56.501 INFO:tasks.workunit.client.0.smithi078.stdout:2/52: truncate d0/f5 748714 0 2024-04-18T21:06:56.502 INFO:tasks.workunit.client.0.smithi078.stdout:4/95: rmdir d0/dc 39 2024-04-18T21:06:56.503 INFO:tasks.workunit.client.0.smithi078.stdout:6/54: dwrite d2/f3 [4194304,4194304] 0 2024-04-18T21:06:56.503 INFO:tasks.workunit.client.0.smithi078.stdout:2/53: creat d0/fe x:0 0 0 2024-04-18T21:06:56.504 INFO:tasks.workunit.client.0.smithi078.stdout:8/48: truncate d0/fd 1720266 0 2024-04-18T21:06:56.505 INFO:tasks.workunit.client.0.smithi078.stdout:4/96: mknod d0/dc/d10/c24 0 2024-04-18T21:06:56.506 INFO:tasks.workunit.client.0.smithi078.stdout:6/55: chown d2/f3 1432424 1 2024-04-18T21:06:56.506 INFO:tasks.workunit.client.0.smithi078.stdout:2/54: truncate d0/fe 13720 0 2024-04-18T21:06:56.506 INFO:tasks.workunit.client.0.smithi078.stdout:1/120: dread d0/d1/d4/fc [0,4194304] 0 2024-04-18T21:06:56.507 INFO:tasks.workunit.client.0.smithi078.stdout:8/49: write d0/fe [571927,97438] 0 2024-04-18T21:06:56.507 INFO:tasks.workunit.client.0.smithi078.stdout:4/97: rmdir d0/dc/d10 39 2024-04-18T21:06:56.508 INFO:tasks.workunit.client.0.smithi078.stdout:2/55: mknod d0/cf 0 2024-04-18T21:06:56.508 INFO:tasks.workunit.client.0.smithi078.stdout:6/56: mknod d2/d6/c13 0 2024-04-18T21:06:56.508 INFO:tasks.workunit.client.0.smithi078.stdout:1/121: fdatasync d0/d11/f21 0 2024-04-18T21:06:56.509 INFO:tasks.workunit.client.0.smithi078.stdout:2/56: readlink d0/la 0 2024-04-18T21:06:56.509 INFO:tasks.workunit.client.0.smithi078.stdout:8/50: read d0/fe [634817,130243] 0 2024-04-18T21:06:56.509 INFO:tasks.workunit.client.0.smithi078.stdout:4/98: stat d0/dc/d10/c1a 0 2024-04-18T21:06:56.509 INFO:tasks.workunit.client.0.smithi078.stdout:1/122: stat d0/d11/f22 0 2024-04-18T21:06:56.509 INFO:tasks.workunit.client.0.smithi078.stdout:6/57: rmdir d2/d6/dd 39 2024-04-18T21:06:56.509 INFO:tasks.workunit.client.0.smithi078.stdout:0/94: dwrite d0/f4 [0,4194304] 0 2024-04-18T21:06:56.510 INFO:tasks.workunit.client.0.smithi078.stdout:2/57: creat d0/f10 x:0 0 0 2024-04-18T21:06:56.510 INFO:tasks.workunit.client.0.smithi078.stdout:2/58: readlink d0/l7 0 2024-04-18T21:06:56.510 INFO:tasks.workunit.client.0.smithi078.stdout:2/59: dread - d0/f10 zero size 2024-04-18T21:06:56.510 INFO:tasks.workunit.client.0.smithi078.stdout:9/84: dread d7/df/f13 [0,4194304] 0 2024-04-18T21:06:56.511 INFO:tasks.workunit.client.0.smithi078.stdout:1/123: write d0/d1/d4/f27 [422825,74978] 0 2024-04-18T21:06:56.511 INFO:tasks.workunit.client.0.smithi078.stdout:7/84: dread d1/f18 [0,4194304] 0 2024-04-18T21:06:56.512 INFO:tasks.workunit.client.0.smithi078.stdout:2/60: creat d0/f11 x:0 0 0 2024-04-18T21:06:56.513 INFO:tasks.workunit.client.0.smithi078.stdout:3/66: truncate d4/f9 2781581 0 2024-04-18T21:06:56.513 INFO:tasks.workunit.client.0.smithi078.stdout:2/61: readlink d0/l6 0 2024-04-18T21:06:56.514 INFO:tasks.workunit.client.0.smithi078.stdout:2/62: fdatasync d0/f10 0 2024-04-18T21:06:56.515 INFO:tasks.workunit.client.0.smithi078.stdout:8/51: getdents d0 0 2024-04-18T21:06:56.516 INFO:tasks.workunit.client.0.smithi078.stdout:6/58: creat d2/d6/f14 x:0 0 0 2024-04-18T21:06:56.516 INFO:tasks.workunit.client.0.smithi078.stdout:7/85: creat d1/f20 x:0 0 0 2024-04-18T21:06:56.516 INFO:tasks.workunit.client.0.smithi078.stdout:1/124: rename d0/d1/d4/f27 to d0/d13/f2c 0 2024-04-18T21:06:56.516 INFO:tasks.workunit.client.0.smithi078.stdout:3/67: unlink d4/lb 0 2024-04-18T21:06:56.517 INFO:tasks.workunit.client.0.smithi078.stdout:8/52: mknod d0/cf 0 2024-04-18T21:06:56.519 INFO:tasks.workunit.client.0.smithi078.stdout:7/86: dread - d1/f20 zero size 2024-04-18T21:06:56.519 INFO:tasks.workunit.client.0.smithi078.stdout:4/99: dwrite d0/dc/f22 [0,4194304] 0 2024-04-18T21:06:56.521 INFO:tasks.workunit.client.0.smithi078.stdout:0/95: dwrite d0/f4 [0,4194304] 0 2024-04-18T21:06:56.524 INFO:tasks.workunit.client.0.smithi078.stdout:9/85: dwrite d7/df/f13 [4194304,4194304] 0 2024-04-18T21:06:56.524 INFO:tasks.workunit.client.0.smithi078.stdout:8/53: mkdir d0/d10 0 2024-04-18T21:06:56.524 INFO:tasks.workunit.client.0.smithi078.stdout:3/68: unlink d4/da/cc 0 2024-04-18T21:06:56.525 INFO:tasks.workunit.client.0.smithi078.stdout:6/59: link d2/d6/dd/f11 d2/d6/dd/f15 0 2024-04-18T21:06:56.525 INFO:tasks.workunit.client.0.smithi078.stdout:7/87: creat d1/d16/d1c/f21 x:0 0 0 2024-04-18T21:06:56.525 INFO:tasks.workunit.client.0.smithi078.stdout:8/54: fdatasync d0/f6 0 2024-04-18T21:06:56.526 INFO:tasks.workunit.client.0.smithi078.stdout:5/113: creat d9/da/f20 x:0 0 0 2024-04-18T21:06:56.529 INFO:tasks.workunit.client.0.smithi078.stdout:2/63: dwrite d0/db/fd [0,4194304] 0 2024-04-18T21:06:56.532 INFO:tasks.workunit.client.0.smithi078.stdout:2/64: chown d0/cf 4920 1 2024-04-18T21:06:56.534 INFO:tasks.workunit.client.0.smithi078.stdout:2/65: truncate d0/f10 164689 0 2024-04-18T21:06:56.535 INFO:tasks.workunit.client.0.smithi078.stdout:5/114: mknod d9/da/d1d/c21 0 2024-04-18T21:06:56.535 INFO:tasks.workunit.client.0.smithi078.stdout:8/55: link d0/cc d0/d10/c11 0 2024-04-18T21:06:56.537 INFO:tasks.workunit.client.0.smithi078.stdout:9/86: dread d7/fa [0,4194304] 0 2024-04-18T21:06:56.537 INFO:tasks.workunit.client.0.smithi078.stdout:1/125: dwrite d0/d1/d4/f28 [0,4194304] 0 2024-04-18T21:06:56.538 INFO:tasks.workunit.client.0.smithi078.stdout:5/115: fsync d9/da/f1b 0 2024-04-18T21:06:56.540 INFO:tasks.workunit.client.0.smithi078.stdout:5/116: write d9/fe [1937241,103617] 0 2024-04-18T21:06:56.540 INFO:tasks.workunit.client.0.smithi078.stdout:9/87: rename d7/df/c18 to d7/d11/c20 0 2024-04-18T21:06:56.541 INFO:tasks.workunit.client.0.smithi078.stdout:9/88: creat d7/df/f21 x:0 0 0 2024-04-18T21:06:56.542 INFO:tasks.workunit.client.0.smithi078.stdout:8/56: dread d0/f5 [0,4194304] 0 2024-04-18T21:06:56.543 INFO:tasks.workunit.client.0.smithi078.stdout:0/96: fdatasync d0/f16 0 2024-04-18T21:06:56.544 INFO:tasks.workunit.client.0.smithi078.stdout:7/88: dwrite d1/d16/ff [0,4194304] 0 2024-04-18T21:06:56.548 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:56.548 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:56.549 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:56.546+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:56.550 INFO:tasks.workunit.client.0.smithi078.stdout:7/89: truncate d1/fb 966273 0 2024-04-18T21:06:56.550 INFO:tasks.workunit.client.0.smithi078.stdout:8/57: truncate d0/fb 176811 0 2024-04-18T21:06:56.558 INFO:tasks.workunit.client.0.smithi078.stdout:6/60: dwrite d2/d6/dd/f15 [0,4194304] 0 2024-04-18T21:06:56.558 INFO:tasks.workunit.client.0.smithi078.stdout:8/58: symlink d0/l12 0 2024-04-18T21:06:56.558 INFO:tasks.workunit.client.0.smithi078.stdout:7/90: mknod d1/d16/d10/c22 0 2024-04-18T21:06:56.558 INFO:tasks.workunit.client.0.smithi078.stdout:1/126: dwrite d0/f1f [0,4194304] 0 2024-04-18T21:06:56.559 INFO:tasks.workunit.client.0.smithi078.stdout:3/69: dwrite d4/f9 [0,4194304] 0 2024-04-18T21:06:56.559 INFO:tasks.workunit.client.0.smithi078.stdout:5/117: dwrite d9/da/f1a [4194304,4194304] 0 2024-04-18T21:06:56.559 INFO:tasks.workunit.client.0.smithi078.stdout:1/127: readlink d0/d1/d4/l12 0 2024-04-18T21:06:56.560 INFO:tasks.workunit.client.0.smithi078.stdout:8/59: mkdir d0/d10/d13 0 2024-04-18T21:06:56.560 INFO:tasks.workunit.client.0.smithi078.stdout:0/97: dread d0/f7 [0,4194304] 0 2024-04-18T21:06:56.561 INFO:tasks.workunit.client.0.smithi078.stdout:5/118: mknod d9/da/c22 0 2024-04-18T21:06:56.561 INFO:tasks.workunit.client.0.smithi078.stdout:2/66: dwrite d0/f9 [0,4194304] 0 2024-04-18T21:06:56.561 INFO:tasks.workunit.client.0.smithi078.stdout:1/128: creat d0/d11/f2d x:0 0 0 2024-04-18T21:06:56.561 INFO:tasks.workunit.client.0.smithi078.stdout:9/89: dwrite f5 [0,4194304] 0 2024-04-18T21:06:56.562 INFO:tasks.workunit.client.0.smithi078.stdout:3/70: mkdir d4/da/d11 0 2024-04-18T21:06:56.562 INFO:tasks.workunit.client.0.smithi078.stdout:8/60: write d0/f5 [524821,19777] 0 2024-04-18T21:06:56.562 INFO:tasks.workunit.client.0.smithi078.stdout:6/61: rename d2/d6/f12 to d2/d6/f16 0 2024-04-18T21:06:56.562 INFO:tasks.workunit.client.0.smithi078.stdout:7/91: getdents d1/d16/dc 0 2024-04-18T21:06:56.563 INFO:tasks.workunit.client.0.smithi078.stdout:5/119: creat d9/da/d1d/f23 x:0 0 0 2024-04-18T21:06:56.563 INFO:tasks.workunit.client.0.smithi078.stdout:2/67: creat d0/db/f12 x:0 0 0 2024-04-18T21:06:56.564 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:56.565 INFO:tasks.workunit.client.0.smithi078.stdout:8/61: fdatasync d0/f6 0 2024-04-18T21:06:56.565 INFO:tasks.workunit.client.0.smithi078.stdout:5/120: stat d9/cc 0 2024-04-18T21:06:56.565 INFO:tasks.workunit.client.0.smithi078.stdout:6/62: mknod d2/d6/dd/c17 0 2024-04-18T21:06:56.565 INFO:tasks.workunit.client.0.smithi078.stdout:2/68: write d0/db/fc [2062523,31058] 0 2024-04-18T21:06:56.565 INFO:tasks.workunit.client.0.smithi078.stdout:7/92: write d1/d16/dc/fd [414382,15375] 0 2024-04-18T21:06:56.566 INFO:tasks.workunit.client.0.smithi078.stdout:5/121: chown d9/da/f20 2868 1 2024-04-18T21:06:56.566 INFO:tasks.workunit.client.0.smithi078.stdout:7/93: dread - d1/f20 zero size 2024-04-18T21:06:56.567 INFO:tasks.workunit.client.0.smithi078.stdout:2/69: unlink d0/db/fd 0 2024-04-18T21:06:56.567 INFO:tasks.workunit.client.0.smithi078.stdout:5/122: truncate d9/da/f20 410331 0 2024-04-18T21:06:56.568 INFO:tasks.workunit.client.0.smithi078.stdout:0/98: dread d0/f4 [0,4194304] 0 2024-04-18T21:06:56.568 INFO:tasks.workunit.client.0.smithi078.stdout:3/71: dread d4/f9 [0,4194304] 0 2024-04-18T21:06:56.568 INFO:tasks.workunit.client.0.smithi078.stdout:8/62: rename d0/d10/d13 to d0/d10/d14 0 2024-04-18T21:06:56.569 INFO:tasks.workunit.client.0.smithi078.stdout:2/70: dread - d0/db/f12 zero size 2024-04-18T21:06:56.570 INFO:tasks.workunit.client.0.smithi078.stdout:2/71: unlink d0/f9 0 2024-04-18T21:06:56.570 INFO:tasks.workunit.client.0.smithi078.stdout:8/63: dread d0/f3 [0,4194304] 0 2024-04-18T21:06:56.571 INFO:tasks.workunit.client.0.smithi078.stdout:0/99: write d0/f8 [4927515,97521] 0 2024-04-18T21:06:56.573 INFO:tasks.workunit.client.0.smithi078.stdout:1/129: dwrite d0/d1/f24 [0,4194304] 0 2024-04-18T21:06:56.573 INFO:tasks.workunit.client.0.smithi078.stdout:7/94: link d1/d16/dc/d11/c15 d1/d16/d10/c23 0 2024-04-18T21:06:56.575 INFO:tasks.workunit.client.0.smithi078.stdout:0/100: write d0/f5 [3970490,71419] 0 2024-04-18T21:06:56.577 INFO:tasks.workunit.client.0.smithi078.stdout:1/130: truncate d0/d11/f21 82373 0 2024-04-18T21:06:56.577 INFO:tasks.workunit.client.0.smithi078.stdout:6/63: dwrite d2/d6/dd/f15 [0,4194304] 0 2024-04-18T21:06:56.577 INFO:tasks.workunit.client.0.smithi078.stdout:7/95: link d1/d16/dc/f1e d1/d16/dc/d11/f24 0 2024-04-18T21:06:56.578 INFO:tasks.workunit.client.0.smithi078.stdout:3/72: dread d4/f9 [0,4194304] 0 2024-04-18T21:06:56.579 INFO:tasks.workunit.client.0.smithi078.stdout:1/131: creat d0/d11/f2e x:0 0 0 2024-04-18T21:06:56.581 INFO:tasks.workunit.client.0.smithi078.stdout:7/96: unlink d1/d16/dc/d11/l1b 0 2024-04-18T21:06:56.581 INFO:tasks.workunit.client.0.smithi078.stdout:3/73: symlink d4/da/d11/l12 0 2024-04-18T21:06:56.581 INFO:tasks.workunit.client.0.smithi078.stdout:1/132: stat d0/d1/d4/c23 0 2024-04-18T21:06:56.583 INFO:tasks.workunit.client.0.smithi078.stdout:3/74: fdatasync d4/f9 0 2024-04-18T21:06:56.583 INFO:tasks.workunit.client.0.smithi078.stdout:7/97: fdatasync d1/d16/dc/fd 0 2024-04-18T21:06:56.583 INFO:tasks.workunit.client.0.smithi078.stdout:1/133: mkdir d0/d2a/d2f 0 2024-04-18T21:06:56.585 INFO:tasks.workunit.client.0.smithi078.stdout:2/72: dwrite d0/db/fc [0,4194304] 0 2024-04-18T21:06:56.585 INFO:tasks.workunit.client.0.smithi078.stdout:7/98: stat d1/d16/d10/f1a 0 2024-04-18T21:06:56.586 INFO:tasks.workunit.client.0.smithi078.stdout:7/99: mknod d1/d16/d10/c25 0 2024-04-18T21:06:56.587 INFO:tasks.workunit.client.0.smithi078.stdout:0/101: dwrite d0/f8 [0,4194304] 0 2024-04-18T21:06:56.587 INFO:tasks.workunit.client.0.smithi078.stdout:2/73: mknod d0/db/c13 0 2024-04-18T21:06:56.588 INFO:tasks.workunit.client.0.smithi078.stdout:7/100: stat d1/f3 0 2024-04-18T21:06:56.588 INFO:tasks.workunit.client.0.smithi078.stdout:2/74: readlink d0/la 0 2024-04-18T21:06:56.588 INFO:tasks.workunit.client.0.smithi078.stdout:6/64: dwrite d2/d6/f16 [0,4194304] 0 2024-04-18T21:06:56.588 INFO:tasks.workunit.client.0.smithi078.stdout:2/75: readlink d0/la 0 2024-04-18T21:06:56.588 INFO:tasks.workunit.client.0.smithi078.stdout:0/102: symlink d0/d9/dd/l1a 0 2024-04-18T21:06:56.588 INFO:tasks.workunit.client.0.smithi078.stdout:7/101: creat d1/d16/f26 x:0 0 0 2024-04-18T21:06:56.589 INFO:tasks.workunit.client.0.smithi078.stdout:2/76: rmdir d0 39 2024-04-18T21:06:56.589 INFO:tasks.workunit.client.0.smithi078.stdout:7/102: readlink d1/l14 0 2024-04-18T21:06:56.589 INFO:tasks.workunit.client.0.smithi078.stdout:6/65: mknod d2/d6/dd/c18 0 2024-04-18T21:06:56.590 INFO:tasks.workunit.client.0.smithi078.stdout:0/103: symlink d0/d9/dd/l1b 0 2024-04-18T21:06:56.590 INFO:tasks.workunit.client.0.smithi078.stdout:6/66: read - d2/ff zero size 2024-04-18T21:06:56.590 INFO:tasks.workunit.client.0.smithi078.stdout:7/103: chown d1/d16/d1c/f21 684070 1 2024-04-18T21:06:56.590 INFO:tasks.workunit.client.0.smithi078.stdout:6/67: fdatasync d2/f4 0 2024-04-18T21:06:56.591 INFO:tasks.workunit.client.0.smithi078.stdout:0/104: rmdir d0/d15 39 2024-04-18T21:06:56.591 INFO:tasks.workunit.client.0.smithi078.stdout:4/100: sync 2024-04-18T21:06:56.592 INFO:tasks.workunit.client.0.smithi078.stdout:6/68: mknod d2/d6/c19 0 2024-04-18T21:06:56.592 INFO:tasks.workunit.client.0.smithi078.stdout:3/75: write d4/fd [943253,104455] 0 2024-04-18T21:06:56.592 INFO:tasks.workunit.client.0.smithi078.stdout:0/105: symlink d0/d9/da/l1c 0 2024-04-18T21:06:56.593 INFO:tasks.workunit.client.0.smithi078.stdout:1/134: dwrite d0/d1/f24 [0,4194304] 0 2024-04-18T21:06:56.593 INFO:tasks.workunit.client.0.smithi078.stdout:3/76: chown d4/fd 703135 1 2024-04-18T21:06:56.593 INFO:tasks.workunit.client.0.smithi078.stdout:4/101: dread d0/dc/f1e [0,4194304] 0 2024-04-18T21:06:56.593 INFO:tasks.workunit.client.0.smithi078.stdout:0/106: write d0/f16 [4478738,86821] 0 2024-04-18T21:06:56.594 INFO:tasks.workunit.client.0.smithi078.stdout:6/69: creat d2/d6/f1a x:0 0 0 2024-04-18T21:06:56.594 INFO:tasks.workunit.client.0.smithi078.stdout:1/135: rename d0/f8 to d0/d13/f30 0 2024-04-18T21:06:56.595 INFO:tasks.workunit.client.0.smithi078.stdout:4/102: creat d0/f25 x:0 0 0 2024-04-18T21:06:56.596 INFO:tasks.workunit.client.0.smithi078.stdout:6/70: getdents d2 0 2024-04-18T21:06:56.596 INFO:tasks.workunit.client.0.smithi078.stdout:4/103: fdatasync d0/f5 0 2024-04-18T21:06:56.596 INFO:tasks.workunit.client.0.smithi078.stdout:0/107: link d0/f7 d0/d9/dd/d17/f1d 0 2024-04-18T21:06:56.597 INFO:tasks.workunit.client.0.smithi078.stdout:6/71: write d2/d6/f16 [1055198,85335] 0 2024-04-18T21:06:56.597 INFO:tasks.workunit.client.0.smithi078.stdout:0/108: chown d0/d9/dd/d17/f1d 55426 1 2024-04-18T21:06:56.598 INFO:tasks.workunit.client.0.smithi078.stdout:6/72: chown d2/d6/dd/l10 3 1 2024-04-18T21:06:56.598 INFO:tasks.workunit.client.0.smithi078.stdout:4/104: mknod d0/c26 0 2024-04-18T21:06:56.598 INFO:tasks.workunit.client.0.smithi078.stdout:0/109: write d0/d9/da/f10 [654724,121898] 0 2024-04-18T21:06:56.599 INFO:tasks.workunit.client.0.smithi078.stdout:3/77: dread d4/fd [0,4194304] 0 2024-04-18T21:06:56.599 INFO:tasks.workunit.client.0.smithi078.stdout:6/73: unlink d2/d6/dd/c18 0 2024-04-18T21:06:56.600 INFO:tasks.workunit.client.0.smithi078.stdout:4/105: symlink d0/dc/d10/d1c/l27 0 2024-04-18T21:06:56.601 INFO:tasks.workunit.client.0.smithi078.stdout:6/74: write d2/f4 [170908,123082] 0 2024-04-18T21:06:56.602 INFO:tasks.workunit.client.0.smithi078.stdout:9/90: fsync f5 0 2024-04-18T21:06:56.603 INFO:tasks.workunit.client.0.smithi078.stdout:4/106: creat d0/f28 x:0 0 0 2024-04-18T21:06:56.603 INFO:tasks.workunit.client.0.smithi078.stdout:6/75: mknod d2/d6/c1b 0 2024-04-18T21:06:56.604 INFO:tasks.workunit.client.0.smithi078.stdout:4/107: mkdir d0/dc/d29 0 2024-04-18T21:06:56.604 INFO:tasks.workunit.client.0.smithi078.stdout:1/136: dwrite d0/d13/f2c [0,4194304] 0 2024-04-18T21:06:56.607 INFO:tasks.workunit.client.0.smithi078.stdout:1/137: symlink d0/d11/l31 0 2024-04-18T21:06:56.607 INFO:tasks.workunit.client.0.smithi078.stdout:3/78: dread d4/fd [0,4194304] 0 2024-04-18T21:06:56.608 INFO:tasks.workunit.client.0.smithi078.stdout:2/77: dread d0/db/fc [0,4194304] 0 2024-04-18T21:06:56.608 INFO:tasks.workunit.client.0.smithi078.stdout:0/110: dread d0/f16 [0,4194304] 0 2024-04-18T21:06:56.609 INFO:tasks.workunit.client.0.smithi078.stdout:3/79: write d4/fd [5573079,1297] 0 2024-04-18T21:06:56.609 INFO:tasks.workunit.client.0.smithi078.stdout:1/138: truncate d0/d1/d4/f28 4210161 0 2024-04-18T21:06:56.610 INFO:tasks.workunit.client.0.smithi078.stdout:5/123: sync 2024-04-18T21:06:56.610 INFO:tasks.workunit.client.0.smithi078.stdout:4/108: link d0/dc/cb d0/dc/c2a 0 2024-04-18T21:06:56.610 INFO:tasks.workunit.client.0.smithi078.stdout:0/111: unlink d0/f7 0 2024-04-18T21:06:56.611 INFO:tasks.workunit.client.0.smithi078.stdout:7/104: dwrite d1/d16/dc/d11/f24 [0,4194304] 0 2024-04-18T21:06:56.611 INFO:tasks.workunit.client.0.smithi078.stdout:5/124: symlink d9/l24 0 2024-04-18T21:06:56.611 INFO:tasks.workunit.client.0.smithi078.stdout:4/109: write d0/f25 [559464,67581] 0 2024-04-18T21:06:56.612 INFO:tasks.workunit.client.0.smithi078.stdout:9/91: dread d7/fa [0,4194304] 0 2024-04-18T21:06:56.612 INFO:tasks.workunit.client.0.smithi078.stdout:1/139: write d0/d11/f21 [791806,104658] 0 2024-04-18T21:06:56.612 INFO:tasks.workunit.client.0.smithi078.stdout:6/76: dread d2/fe [0,4194304] 0 2024-04-18T21:06:56.612 INFO:tasks.workunit.client.0.smithi078.stdout:2/78: getdents d0 0 2024-04-18T21:06:56.613 INFO:tasks.workunit.client.0.smithi078.stdout:5/125: write d9/da/f1b [949675,6131] 0 2024-04-18T21:06:56.613 INFO:tasks.workunit.client.0.smithi078.stdout:0/112: mknod d0/d9/dd/d14/c1e 0 2024-04-18T21:06:56.613 INFO:tasks.workunit.client.0.smithi078.stdout:3/80: rename d4/f5 to d4/f13 0 2024-04-18T21:06:56.613 INFO:tasks.workunit.client.0.smithi078.stdout:9/92: read d7/fa [3312158,79967] 0 2024-04-18T21:06:56.613 INFO:tasks.workunit.client.0.smithi078.stdout:7/105: symlink d1/l27 0 2024-04-18T21:06:56.614 INFO:tasks.workunit.client.0.smithi078.stdout:4/110: dread - d0/f28 zero size 2024-04-18T21:06:56.614 INFO:tasks.workunit.client.0.smithi078.stdout:6/77: mkdir d2/d1c 0 2024-04-18T21:06:56.614 INFO:tasks.workunit.client.0.smithi078.stdout:5/126: stat d9/l24 0 2024-04-18T21:06:56.614 INFO:tasks.workunit.client.0.smithi078.stdout:9/93: write f5 [5156422,47400] 0 2024-04-18T21:06:56.614 INFO:tasks.workunit.client.0.smithi078.stdout:2/79: rename d0/la to d0/db/l14 0 2024-04-18T21:06:56.614 INFO:tasks.workunit.client.0.smithi078.stdout:3/81: read d4/fd [905706,92841] 0 2024-04-18T21:06:56.614 INFO:tasks.workunit.client.0.smithi078.stdout:4/111: write d0/f12 [2609973,76901] 0 2024-04-18T21:06:56.615 INFO:tasks.workunit.client.0.smithi078.stdout:4/112: readlink d0/l23 0 2024-04-18T21:06:56.615 INFO:tasks.workunit.client.0.smithi078.stdout:9/94: symlink d7/df/d1e/l22 0 2024-04-18T21:06:56.616 INFO:tasks.workunit.client.0.smithi078.stdout:2/80: truncate d0/db/f12 715374 0 2024-04-18T21:06:56.616 INFO:tasks.workunit.client.0.smithi078.stdout:9/95: getdents d7/d11/d1b 0 2024-04-18T21:06:56.617 INFO:tasks.workunit.client.0.smithi078.stdout:4/113: rename d0/dc/c2a to d0/dc/c2b 0 2024-04-18T21:06:56.617 INFO:tasks.workunit.client.0.smithi078.stdout:9/96: mkdir d7/d23 0 2024-04-18T21:06:56.617 INFO:tasks.workunit.client.0.smithi078.stdout:2/81: link d0/db/c13 d0/c15 0 2024-04-18T21:06:56.618 INFO:tasks.workunit.client.0.smithi078.stdout:4/114: chown d0/dc/cf 10 1 2024-04-18T21:06:56.618 INFO:tasks.workunit.client.0.smithi078.stdout:7/106: dread d1/d16/dc/f1e [0,4194304] 0 2024-04-18T21:06:56.619 INFO:tasks.workunit.client.0.smithi078.stdout:7/107: chown d1/d16/dc/d11/f24 26 1 2024-04-18T21:06:56.619 INFO:tasks.workunit.client.0.smithi078.stdout:2/82: link d0/f11 d0/db/f16 0 2024-04-18T21:06:56.620 INFO:tasks.workunit.client.0.smithi078.stdout:1/140: truncate d0/f1f 2220678 0 2024-04-18T21:06:56.621 INFO:tasks.workunit.client.0.smithi078.stdout:2/83: write d0/fe [660223,100393] 0 2024-04-18T21:06:56.621 INFO:tasks.workunit.client.0.smithi078.stdout:0/113: truncate d0/f5 1728512 0 2024-04-18T21:06:56.622 INFO:tasks.workunit.client.0.smithi078.stdout:9/97: dread d7/fa [0,4194304] 0 2024-04-18T21:06:56.622 INFO:tasks.workunit.client.0.smithi078.stdout:1/141: chown d0/d1/d4/c2b 10 1 2024-04-18T21:06:56.622 INFO:tasks.workunit.client.0.smithi078.stdout:6/78: truncate d2/d6/f16 3200074 0 2024-04-18T21:06:56.623 INFO:tasks.workunit.client.0.smithi078.stdout:1/142: fdatasync d0/d1/d4/f28 0 2024-04-18T21:06:56.623 INFO:tasks.workunit.client.0.smithi078.stdout:6/79: readlink d2/d6/dd/l10 0 2024-04-18T21:06:56.623 INFO:tasks.workunit.client.0.smithi078.stdout:9/98: link d7/df/f21 d7/f24 0 2024-04-18T21:06:56.623 INFO:tasks.workunit.client.0.smithi078.stdout:1/143: mkdir d0/d13/d32 0 2024-04-18T21:06:56.623 INFO:tasks.workunit.client.0.smithi078.stdout:8/64: dread d0/fe [0,4194304] 0 2024-04-18T21:06:56.624 INFO:tasks.workunit.client.0.smithi078.stdout:1/144: creat d0/d2a/d2f/f33 x:0 0 0 2024-04-18T21:06:56.625 INFO:tasks.workunit.client.0.smithi078.stdout:8/65: mknod d0/c15 0 2024-04-18T21:06:56.625 INFO:tasks.workunit.client.0.smithi078.stdout:2/84: dread d0/db/f12 [0,4194304] 0 2024-04-18T21:06:56.626 INFO:tasks.workunit.client.0.smithi078.stdout:0/114: dread d0/f16 [0,4194304] 0 2024-04-18T21:06:56.626 INFO:tasks.workunit.client.0.smithi078.stdout:1/145: creat d0/d1/d4/f34 x:0 0 0 2024-04-18T21:06:56.626 INFO:tasks.workunit.client.0.smithi078.stdout:8/66: link d0/cf d0/d10/c16 0 2024-04-18T21:06:56.627 INFO:tasks.workunit.client.0.smithi078.stdout:1/146: stat d0/d1/d4/ce 0 2024-04-18T21:06:56.627 INFO:tasks.workunit.client.0.smithi078.stdout:5/127: truncate d9/da/f13 3586563 0 2024-04-18T21:06:56.627 INFO:tasks.workunit.client.0.smithi078.stdout:0/115: dread - d0/d9/da/db/f13 zero size 2024-04-18T21:06:56.628 INFO:tasks.workunit.client.0.smithi078.stdout:2/85: link d0/db/l14 d0/l17 0 2024-04-18T21:06:56.628 INFO:tasks.workunit.client.0.smithi078.stdout:8/67: mknod d0/d10/d14/c17 0 2024-04-18T21:06:56.629 INFO:tasks.workunit.client.0.smithi078.stdout:1/147: mkdir d0/d13/d32/d35 0 2024-04-18T21:06:56.629 INFO:tasks.workunit.client.0.smithi078.stdout:0/116: symlink d0/d9/dd/d14/l1f 0 2024-04-18T21:06:56.630 INFO:tasks.workunit.client.0.smithi078.stdout:5/128: creat d9/f25 x:0 0 0 2024-04-18T21:06:56.630 INFO:tasks.workunit.client.0.smithi078.stdout:2/86: mkdir d0/db/d18 0 2024-04-18T21:06:56.630 INFO:tasks.workunit.client.0.smithi078.stdout:0/117: chown d0/d9 389537881 1 2024-04-18T21:06:56.630 INFO:tasks.workunit.client.0.smithi078.stdout:8/68: rename d0/f3 to d0/f18 0 2024-04-18T21:06:56.631 INFO:tasks.workunit.client.0.smithi078.stdout:9/99: dwrite d7/fa [4194304,4194304] 0 2024-04-18T21:06:56.631 INFO:tasks.workunit.client.0.smithi078.stdout:8/69: stat d0 0 2024-04-18T21:06:56.631 INFO:tasks.workunit.client.0.smithi078.stdout:2/87: readlink d0/l17 0 2024-04-18T21:06:56.631 INFO:tasks.workunit.client.0.smithi078.stdout:6/80: dwrite d2/d6/fc [0,4194304] 0 2024-04-18T21:06:56.631 INFO:tasks.workunit.client.0.smithi078.stdout:9/100: stat d7/df/f13 0 2024-04-18T21:06:56.632 INFO:tasks.workunit.client.0.smithi078.stdout:6/81: readlink d2/d6/dd/l10 0 2024-04-18T21:06:56.632 INFO:tasks.workunit.client.0.smithi078.stdout:2/88: truncate d0/db/f16 563571 0 2024-04-18T21:06:56.632 INFO:tasks.workunit.client.0.smithi078.stdout:6/82: unlink d2/f4 0 2024-04-18T21:06:56.633 INFO:tasks.workunit.client.0.smithi078.stdout:9/101: symlink d7/d11/d1b/l25 0 2024-04-18T21:06:56.633 INFO:tasks.workunit.client.0.smithi078.stdout:5/129: creat d9/da/d1d/f26 x:0 0 0 2024-04-18T21:06:56.633 INFO:tasks.workunit.client.0.smithi078.stdout:9/102: chown c1 5166 1 2024-04-18T21:06:56.633 INFO:tasks.workunit.client.0.smithi078.stdout:2/89: truncate d0/f11 1187842 0 2024-04-18T21:06:56.635 INFO:tasks.workunit.client.0.smithi078.stdout:2/90: write d0/fe [1603992,109579] 0 2024-04-18T21:06:56.635 INFO:tasks.workunit.client.0.smithi078.stdout:9/103: write d7/fa [7451036,57873] 0 2024-04-18T21:06:56.635 INFO:tasks.workunit.client.0.smithi078.stdout:6/83: link d2/d6/fc d2/d1c/f1d 0 2024-04-18T21:06:56.635 INFO:tasks.workunit.client.0.smithi078.stdout:5/130: mknod d9/c27 0 2024-04-18T21:06:56.636 INFO:tasks.workunit.client.0.smithi078.stdout:2/91: mknod d0/c19 0 2024-04-18T21:06:56.636 INFO:tasks.workunit.client.0.smithi078.stdout:9/104: mkdir d7/d14/d26 0 2024-04-18T21:06:56.637 INFO:tasks.workunit.client.0.smithi078.stdout:6/84: symlink d2/d1c/l1e 0 2024-04-18T21:06:56.640 INFO:tasks.workunit.client.0.smithi078.stdout:3/82: sync 2024-04-18T21:06:56.640 INFO:tasks.workunit.client.0.smithi078.stdout:4/115: sync 2024-04-18T21:06:56.640 INFO:tasks.workunit.client.0.smithi078.stdout:7/108: sync 2024-04-18T21:06:56.641 INFO:tasks.workunit.client.0.smithi078.stdout:6/85: stat d2/d6/dd/f11 0 2024-04-18T21:06:56.641 INFO:tasks.workunit.client.0.smithi078.stdout:1/148: dwrite d0/d11/f2e [0,4194304] 0 2024-04-18T21:06:56.641 INFO:tasks.workunit.client.0.smithi078.stdout:9/105: write d7/df/f13 [1704561,80851] 0 2024-04-18T21:06:56.641 INFO:tasks.workunit.client.0.smithi078.stdout:3/83: fsync d4/f9 0 2024-04-18T21:06:56.642 INFO:tasks.workunit.client.0.smithi078.stdout:8/70: getdents d0/d10 0 2024-04-18T21:06:56.643 INFO:tasks.workunit.client.0.smithi078.stdout:7/109: dread d1/fb [0,4194304] 0 2024-04-18T21:06:56.643 INFO:tasks.workunit.client.0.smithi078.stdout:0/118: dwrite d0/d9/da/db/f13 [0,4194304] 0 2024-04-18T21:06:56.644 INFO:tasks.workunit.client.0.smithi078.stdout:6/86: unlink d2/d6/dd/f11 0 2024-04-18T21:06:56.644 INFO:tasks.workunit.client.0.smithi078.stdout:8/71: rmdir d0/d10/d14 39 2024-04-18T21:06:56.644 INFO:tasks.workunit.client.0.smithi078.stdout:1/149: unlink d0/d1/c2 0 2024-04-18T21:06:56.645 INFO:tasks.workunit.client.0.smithi078.stdout:3/84: chown d4/c8 1867 1 2024-04-18T21:06:56.646 INFO:tasks.workunit.client.0.smithi078.stdout:4/116: rename d0/f25 to d0/f2c 0 2024-04-18T21:06:56.646 INFO:tasks.workunit.client.0.smithi078.stdout:9/106: link d7/d14/l17 d7/d14/l27 0 2024-04-18T21:06:56.647 INFO:tasks.workunit.client.0.smithi078.stdout:5/131: dwrite d9/da/f20 [0,4194304] 0 2024-04-18T21:06:56.647 INFO:tasks.workunit.client.0.smithi078.stdout:6/87: truncate d2/d1c/f1d 4966750 0 2024-04-18T21:06:56.647 INFO:tasks.workunit.client.0.smithi078.stdout:8/72: stat d0/fb 0 2024-04-18T21:06:56.647 INFO:tasks.workunit.client.0.smithi078.stdout:9/107: chown d7/d23 22948084 1 2024-04-18T21:06:56.647 INFO:tasks.workunit.client.0.smithi078.stdout:1/150: creat d0/d2a/d2f/f36 x:0 0 0 2024-04-18T21:06:56.648 INFO:tasks.workunit.client.0.smithi078.stdout:6/88: mkdir d2/d1f 0 2024-04-18T21:06:56.648 INFO:tasks.workunit.client.0.smithi078.stdout:0/119: getdents d0/d9/da/db 0 2024-04-18T21:06:56.648 INFO:tasks.workunit.client.0.smithi078.stdout:4/117: unlink d0/f18 0 2024-04-18T21:06:56.649 INFO:tasks.workunit.client.0.smithi078.stdout:8/73: dread d0/fb [0,4194304] 0 2024-04-18T21:06:56.649 INFO:tasks.workunit.client.0.smithi078.stdout:1/151: mknod d0/d13/c37 0 2024-04-18T21:06:56.649 INFO:tasks.workunit.client.0.smithi078.stdout:9/108: mknod d7/d14/c28 0 2024-04-18T21:06:56.649 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:56.650+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:56.650 INFO:tasks.workunit.client.0.smithi078.stdout:6/89: write d2/d6/f16 [324319,122629] 0 2024-04-18T21:06:56.650 INFO:tasks.workunit.client.0.smithi078.stdout:1/152: dread - d0/d2a/d2f/f33 zero size 2024-04-18T21:06:56.651 INFO:tasks.workunit.client.0.smithi078.stdout:4/118: mknod d0/c2d 0 2024-04-18T21:06:56.651 INFO:tasks.workunit.client.0.smithi078.stdout:9/109: rename d7/l1a to d7/d11/l29 0 2024-04-18T21:06:56.652 INFO:tasks.workunit.client.0.smithi078.stdout:3/85: dread d4/f9 [0,4194304] 0 2024-04-18T21:06:56.654 INFO:tasks.workunit.client.0.smithi078.stdout:9/110: fsync d7/f24 0 2024-04-18T21:06:56.654 INFO:tasks.workunit.client.0.smithi078.stdout:8/74: rename d0/d10/d14/c17 to d0/d10/d14/c19 0 2024-04-18T21:06:56.654 INFO:tasks.workunit.client.0.smithi078.stdout:6/90: link d2/fe d2/d1c/f20 0 2024-04-18T21:06:56.654 INFO:tasks.workunit.client.0.smithi078.stdout:7/110: dwrite d1/d16/dc/fd [0,4194304] 0 2024-04-18T21:06:56.655 INFO:tasks.workunit.client.0.smithi078.stdout:6/91: chown d2/d1c 0 1 2024-04-18T21:06:56.657 INFO:tasks.workunit.client.0.smithi078.stdout:9/111: write d7/fa [851221,4127] 0 2024-04-18T21:06:56.659 INFO:tasks.workunit.client.0.smithi078.stdout:5/132: dwrite d9/da/f1f [0,4194304] 0 2024-04-18T21:06:56.660 INFO:tasks.workunit.client.0.smithi078.stdout:8/75: rename d0/la to d0/l1a 0 2024-04-18T21:06:56.660 INFO:tasks.workunit.client.0.smithi078.stdout:1/153: dread d0/d11/f21 [0,4194304] 0 2024-04-18T21:06:56.661 INFO:tasks.workunit.client.0.smithi078.stdout:2/92: dwrite d0/db/f16 [0,4194304] 0 2024-04-18T21:06:56.661 INFO:tasks.workunit.client.0.smithi078.stdout:9/112: unlink d7/fc 0 2024-04-18T21:06:56.661 INFO:tasks.workunit.client.0.smithi078.stdout:7/111: mkdir d1/d28 0 2024-04-18T21:06:56.662 INFO:tasks.workunit.client.0.smithi078.stdout:8/76: chown d0/l7 1573 1 2024-04-18T21:06:56.663 INFO:tasks.workunit.client.0.smithi078.stdout:2/93: rename d0/db to d0/db/d18/d1a 22 2024-04-18T21:06:56.663 INFO:tasks.workunit.client.0.smithi078.stdout:0/120: dread d0/f5 [0,4194304] 0 2024-04-18T21:06:56.664 INFO:tasks.workunit.client.0.smithi078.stdout:7/112: unlink d1/fb 0 2024-04-18T21:06:56.666 INFO:tasks.workunit.client.0.smithi078.stdout:2/94: mknod d0/c1b 0 2024-04-18T21:06:56.667 INFO:tasks.workunit.client.0.smithi078.stdout:3/86: dwrite d4/f9 [0,4194304] 0 2024-04-18T21:06:56.667 INFO:tasks.workunit.client.0.smithi078.stdout:0/121: write d0/f8 [3390845,23877] 0 2024-04-18T21:06:56.667 INFO:tasks.workunit.client.0.smithi078.stdout:1/154: stat d0/d13/d32/d35 0 2024-04-18T21:06:56.668 INFO:tasks.workunit.client.0.smithi078.stdout:3/87: sync 2024-04-18T21:06:56.668 INFO:tasks.workunit.client.0.smithi078.stdout:4/119: dwrite d0/dc/f1e [0,4194304] 0 2024-04-18T21:06:56.669 INFO:tasks.workunit.client.0.smithi078.stdout:2/95: link d0/db/f16 d0/db/d18/f1c 0 2024-04-18T21:06:56.670 INFO:tasks.workunit.client.0.smithi078.stdout:0/122: read d0/d9/da/f10 [764923,31952] 0 2024-04-18T21:06:56.671 INFO:tasks.workunit.client.0.smithi078.stdout:6/92: dwrite d2/ff [0,4194304] 0 2024-04-18T21:06:56.671 INFO:tasks.workunit.client.0.smithi078.stdout:1/155: fsync d0/d1/d4/fc 0 2024-04-18T21:06:56.671 INFO:tasks.workunit.client.0.smithi078.stdout:4/120: mkdir d0/dc/d29/d2e 0 2024-04-18T21:06:56.672 INFO:tasks.workunit.client.0.smithi078.stdout:2/96: creat d0/f1d x:0 0 0 2024-04-18T21:06:56.672 INFO:tasks.workunit.client.0.smithi078.stdout:5/133: dread d9/f18 [0,4194304] 0 2024-04-18T21:06:56.673 INFO:tasks.workunit.client.0.smithi078.stdout:6/93: creat d2/f21 x:0 0 0 2024-04-18T21:06:56.673 INFO:tasks.workunit.client.0.smithi078.stdout:0/123: creat d0/d9/dd/d14/f20 x:0 0 0 2024-04-18T21:06:56.673 INFO:tasks.workunit.client.0.smithi078.stdout:4/121: mkdir d0/dc/d29/d2f 0 2024-04-18T21:06:56.675 INFO:tasks.workunit.client.0.smithi078.stdout:8/77: dwrite d0/fe [0,4194304] 0 2024-04-18T21:06:56.676 INFO:tasks.workunit.client.0.smithi078.stdout:2/97: rename d0/db/fc to d0/f1e 0 2024-04-18T21:06:56.676 INFO:tasks.workunit.client.0.smithi078.stdout:1/156: truncate d0/d2a/d2f/f36 210295 0 2024-04-18T21:06:56.676 INFO:tasks.workunit.client.0.smithi078.stdout:5/134: write d9/da/f1a [1542174,71904] 0 2024-04-18T21:06:56.676 INFO:tasks.workunit.client.0.smithi078.stdout:4/122: mknod d0/c30 0 2024-04-18T21:06:56.677 INFO:tasks.workunit.client.0.smithi078.stdout:0/124: mkdir d0/d15/d21 0 2024-04-18T21:06:56.677 INFO:tasks.workunit.client.0.smithi078.stdout:4/123: dread - d0/f28 zero size 2024-04-18T21:06:56.677 INFO:tasks.workunit.client.0.smithi078.stdout:8/78: fsync d0/f18 0 2024-04-18T21:06:56.679 INFO:tasks.workunit.client.0.smithi078.stdout:9/113: truncate d7/df/f13 5523199 0 2024-04-18T21:06:56.679 INFO:tasks.workunit.client.0.smithi078.stdout:2/98: write d0/f1e [2637128,33835] 0 2024-04-18T21:06:56.679 INFO:tasks.workunit.client.0.smithi078.stdout:7/113: dwrite d1/d16/f26 [0,4194304] 0 2024-04-18T21:06:56.679 INFO:tasks.workunit.client.0.smithi078.stdout:5/135: mknod d9/da/d1d/c28 0 2024-04-18T21:06:56.679 INFO:tasks.workunit.client.0.smithi078.stdout:4/124: chown d0/dc/f1e 14359648 1 2024-04-18T21:06:56.680 INFO:tasks.workunit.client.0.smithi078.stdout:1/157: getdents d0/d2a/d2f 0 2024-04-18T21:06:56.681 INFO:tasks.workunit.client.0.smithi078.stdout:7/114: write d1/f1d [174057,60587] 0 2024-04-18T21:06:56.681 INFO:tasks.workunit.client.0.smithi078.stdout:8/79: dread d0/fb [0,4194304] 0 2024-04-18T21:06:56.681 INFO:tasks.workunit.client.0.smithi078.stdout:4/125: chown d0/dc/f1d 3 1 2024-04-18T21:06:56.682 INFO:tasks.workunit.client.0.smithi078.stdout:9/114: creat d7/df/f2a x:0 0 0 2024-04-18T21:06:56.682 INFO:tasks.workunit.client.0.smithi078.stdout:3/88: dwrite d4/fd [0,4194304] 0 2024-04-18T21:06:56.682 INFO:tasks.workunit.client.0.smithi078.stdout:1/158: write d0/d11/f2d [288296,97564] 0 2024-04-18T21:06:56.682 INFO:tasks.workunit.client.0.smithi078.stdout:5/136: mkdir d9/da/d1d/d29 0 2024-04-18T21:06:56.684 INFO:tasks.workunit.client.0.smithi078.stdout:6/94: dread d2/fe [0,4194304] 0 2024-04-18T21:06:56.685 INFO:tasks.workunit.client.0.smithi078.stdout:3/89: read d4/f9 [315306,100127] 0 2024-04-18T21:06:56.685 INFO:tasks.workunit.client.0.smithi078.stdout:7/115: creat d1/d16/dc/d11/f29 x:0 0 0 2024-04-18T21:06:56.685 INFO:tasks.workunit.client.0.smithi078.stdout:9/115: chown d7/d14/c28 498 1 2024-04-18T21:06:56.686 INFO:tasks.workunit.client.0.smithi078.stdout:5/137: symlink d9/l2a 0 2024-04-18T21:06:56.686 INFO:tasks.workunit.client.0.smithi078.stdout:0/125: link d0/d9/da/db/lc d0/d9/dd/d17/l22 0 2024-04-18T21:06:56.686 INFO:tasks.workunit.client.0.smithi078.stdout:7/116: creat d1/d16/d1c/f2a x:0 0 0 2024-04-18T21:06:56.686 INFO:tasks.workunit.client.0.smithi078.stdout:7/117: sync 2024-04-18T21:06:56.687 INFO:tasks.workunit.client.0.smithi078.stdout:4/126: getdents d0/dc/d29 0 2024-04-18T21:06:56.687 INFO:tasks.workunit.client.0.smithi078.stdout:3/90: mknod d4/c14 0 2024-04-18T21:06:56.687 INFO:tasks.workunit.client.0.smithi078.stdout:6/95: stat d2/d1c/f20 0 2024-04-18T21:06:56.687 INFO:tasks.workunit.client.0.smithi078.stdout:5/138: write d9/f1c [707107,68871] 0 2024-04-18T21:06:56.687 INFO:tasks.workunit.client.0.smithi078.stdout:7/118: getdents d1/d28 0 2024-04-18T21:06:56.688 INFO:tasks.workunit.client.0.smithi078.stdout:3/91: write d4/fd [4808868,92318] 0 2024-04-18T21:06:56.688 INFO:tasks.workunit.client.0.smithi078.stdout:5/139: readlink d9/da/l10 0 2024-04-18T21:06:56.690 INFO:tasks.workunit.client.0.smithi078.stdout:5/140: unlink d9/da/c22 0 2024-04-18T21:06:56.690 INFO:tasks.workunit.client.0.smithi078.stdout:6/96: link d2/d1c/f20 d2/d1c/f22 0 2024-04-18T21:06:56.690 INFO:tasks.workunit.client.0.smithi078.stdout:3/92: symlink d4/df/l15 0 2024-04-18T21:06:56.690 INFO:tasks.workunit.client.0.smithi078.stdout:0/126: dread d0/f5 [0,4194304] 0 2024-04-18T21:06:56.690 INFO:tasks.workunit.client.0.smithi078.stdout:7/119: creat d1/d16/dc/d11/f2b x:0 0 0 2024-04-18T21:06:56.690 INFO:tasks.workunit.client.0.smithi078.stdout:8/80: truncate d0/fb 1032772 0 2024-04-18T21:06:56.690 INFO:tasks.workunit.client.0.smithi078.stdout:3/93: write d4/f13 [368906,119317] 0 2024-04-18T21:06:56.691 INFO:tasks.workunit.client.0.smithi078.stdout:7/120: unlink d1/d16/f17 0 2024-04-18T21:06:56.692 INFO:tasks.workunit.client.0.smithi078.stdout:0/127: creat d0/d9/f23 x:0 0 0 2024-04-18T21:06:56.692 INFO:tasks.workunit.client.0.smithi078.stdout:6/97: write d2/d1c/f22 [4008267,38379] 0 2024-04-18T21:06:56.692 INFO:tasks.workunit.client.0.smithi078.stdout:7/121: dread - d1/f1f zero size 2024-04-18T21:06:56.693 INFO:tasks.workunit.client.0.smithi078.stdout:5/141: link d9/da/ld d9/da/d1d/d29/l2b 0 2024-04-18T21:06:56.693 INFO:tasks.workunit.client.0.smithi078.stdout:6/98: mknod d2/c23 0 2024-04-18T21:06:56.693 INFO:tasks.workunit.client.0.smithi078.stdout:0/128: mknod d0/d9/dd/c24 0 2024-04-18T21:06:56.694 INFO:tasks.workunit.client.0.smithi078.stdout:5/142: stat d9/da/d1d/c21 0 2024-04-18T21:06:56.694 INFO:tasks.workunit.client.0.smithi078.stdout:1/159: dwrite d0/d1/d4/f28 [0,4194304] 0 2024-04-18T21:06:56.694 INFO:tasks.workunit.client.0.smithi078.stdout:8/81: getdents d0/d10/d14 0 2024-04-18T21:06:56.695 INFO:tasks.workunit.client.0.smithi078.stdout:0/129: fdatasync d0/d9/da/db/f13 0 2024-04-18T21:06:56.697 INFO:tasks.workunit.client.0.smithi078.stdout:8/82: symlink d0/d10/d14/l1b 0 2024-04-18T21:06:56.697 INFO:tasks.workunit.client.0.smithi078.stdout:1/160: creat d0/d2a/d2f/f38 x:0 0 0 2024-04-18T21:06:56.697 INFO:tasks.workunit.client.0.smithi078.stdout:2/99: dwrite d0/f5 [0,4194304] 0 2024-04-18T21:06:56.698 INFO:tasks.workunit.client.0.smithi078.stdout:3/94: fdatasync d4/f13 0 2024-04-18T21:06:56.699 INFO:tasks.workunit.client.0.smithi078.stdout:2/100: mkdir d0/d1f 0 2024-04-18T21:06:56.699 INFO:tasks.workunit.client.0.smithi078.stdout:1/161: creat d0/d13/d32/f39 x:0 0 0 2024-04-18T21:06:56.699 INFO:tasks.workunit.client.0.smithi078.stdout:0/130: creat d0/d9/da/df/f25 x:0 0 0 2024-04-18T21:06:56.699 INFO:tasks.workunit.client.0.smithi078.stdout:3/95: mknod d4/df/c16 0 2024-04-18T21:06:56.699 INFO:tasks.workunit.client.0.smithi078.stdout:2/101: symlink d0/l20 0 2024-04-18T21:06:56.700 INFO:tasks.workunit.client.0.smithi078.stdout:1/162: creat d0/d11/f3a x:0 0 0 2024-04-18T21:06:56.700 INFO:tasks.workunit.client.0.smithi078.stdout:8/83: creat d0/d10/f1c x:0 0 0 2024-04-18T21:06:56.700 INFO:tasks.workunit.client.0.smithi078.stdout:2/102: write d0/f10 [67690,21736] 0 2024-04-18T21:06:56.700 INFO:tasks.workunit.client.0.smithi078.stdout:5/143: dread d9/fb [0,4194304] 0 2024-04-18T21:06:56.700 INFO:tasks.workunit.client.0.smithi078.stdout:3/96: mkdir d4/df/d17 0 2024-04-18T21:06:56.700 INFO:tasks.workunit.client.0.smithi078.stdout:0/131: mknod d0/d9/da/db/c26 0 2024-04-18T21:06:56.701 INFO:tasks.workunit.client.0.smithi078.stdout:4/127: dread d0/dc/f1d [0,4194304] 0 2024-04-18T21:06:56.701 INFO:tasks.workunit.client.0.smithi078.stdout:1/163: getdents d0/d1 0 2024-04-18T21:06:56.701 INFO:tasks.workunit.client.0.smithi078.stdout:6/99: dread d2/f3 [0,4194304] 0 2024-04-18T21:06:56.702 INFO:tasks.workunit.client.0.smithi078.stdout:8/84: rename d0/cc to d0/d10/c1d 0 2024-04-18T21:06:56.702 INFO:tasks.workunit.client.0.smithi078.stdout:8/85: readlink d0/l9 0 2024-04-18T21:06:56.703 INFO:tasks.workunit.client.0.smithi078.stdout:6/100: creat d2/f24 x:0 0 0 2024-04-18T21:06:56.703 INFO:tasks.workunit.client.0.smithi078.stdout:5/144: symlink d9/da/d1d/d29/l2c 0 2024-04-18T21:06:56.703 INFO:tasks.workunit.client.0.smithi078.stdout:8/86: creat d0/d10/d14/f1e x:0 0 0 2024-04-18T21:06:56.704 INFO:tasks.workunit.client.0.smithi078.stdout:6/101: creat d2/d1f/f25 x:0 0 0 2024-04-18T21:06:56.705 INFO:tasks.workunit.client.0.smithi078.stdout:5/145: chown c7 18932707 1 2024-04-18T21:06:56.706 INFO:tasks.workunit.client.0.smithi078.stdout:7/122: write d1/d16/ff [4461549,16245] 0 2024-04-18T21:06:56.706 INFO:tasks.workunit.client.0.smithi078.stdout:7/123: sync 2024-04-18T21:06:56.706 INFO:tasks.workunit.client.0.smithi078.stdout:9/116: dread f6 [0,4194304] 0 2024-04-18T21:06:56.706 INFO:tasks.workunit.client.0.smithi078.stdout:6/102: symlink d2/d1c/l26 0 2024-04-18T21:06:56.706 INFO:tasks.workunit.client.0.smithi078.stdout:5/146: creat d9/da/f2d x:0 0 0 2024-04-18T21:06:56.708 INFO:tasks.workunit.client.0.smithi078.stdout:7/124: write d1/d16/d1c/f21 [1373,76463] 0 2024-04-18T21:06:56.708 INFO:tasks.workunit.client.0.smithi078.stdout:3/97: dwrite d4/f13 [0,4194304] 0 2024-04-18T21:06:56.708 INFO:tasks.workunit.client.0.smithi078.stdout:5/147: write d9/fe [1025561,93329] 0 2024-04-18T21:06:56.708 INFO:tasks.workunit.client.0.smithi078.stdout:1/164: dread d0/d1/d4/f28 [0,4194304] 0 2024-04-18T21:06:56.709 INFO:tasks.workunit.client.0.smithi078.stdout:6/103: write d2/d6/f1a [402562,120692] 0 2024-04-18T21:06:56.710 INFO:tasks.workunit.client.0.smithi078.stdout:1/165: creat d0/d13/f3b x:0 0 0 2024-04-18T21:06:56.710 INFO:tasks.workunit.client.0.smithi078.stdout:9/117: link d7/df/f10 d7/d14/d26/f2b 0 2024-04-18T21:06:56.711 INFO:tasks.workunit.client.0.smithi078.stdout:8/87: dread d0/f5 [0,4194304] 0 2024-04-18T21:06:56.711 INFO:tasks.workunit.client.0.smithi078.stdout:5/148: dread d9/f18 [0,4194304] 0 2024-04-18T21:06:56.712 INFO:tasks.workunit.client.0.smithi078.stdout:9/118: stat d7/d14/l17 0 2024-04-18T21:06:56.712 INFO:tasks.workunit.client.0.smithi078.stdout:4/128: dwrite d0/dc/f1d [0,4194304] 0 2024-04-18T21:06:56.712 INFO:tasks.workunit.client.0.smithi078.stdout:1/166: chown d0/d1/d4/c16 4012 1 2024-04-18T21:06:56.712 INFO:tasks.workunit.client.0.smithi078.stdout:9/119: rename d7 to d7/df/d2c 22 2024-04-18T21:06:56.713 INFO:tasks.workunit.client.0.smithi078.stdout:3/98: creat d4/f18 x:0 0 0 2024-04-18T21:06:56.714 INFO:tasks.workunit.client.0.smithi078.stdout:3/99: write d4/f13 [13588585,23319] 0 2024-04-18T21:06:56.714 INFO:tasks.workunit.client.0.smithi078.stdout:3/100: read - d4/f18 zero size 2024-04-18T21:06:56.715 INFO:tasks.workunit.client.0.smithi078.stdout:3/101: write d4/f13 [9365977,117377] 0 2024-04-18T21:06:56.715 INFO:tasks.workunit.client.0.smithi078.stdout:3/102: chown d4/da/d11 755114 1 2024-04-18T21:06:56.716 INFO:tasks.workunit.client.0.smithi078.stdout:5/149: unlink d9/f18 0 2024-04-18T21:06:56.717 INFO:tasks.workunit.client.0.smithi078.stdout:1/167: mkdir d0/d2a/d3c 0 2024-04-18T21:06:56.717 INFO:tasks.workunit.client.0.smithi078.stdout:2/103: write d0/db/f12 [441497,69045] 0 2024-04-18T21:06:56.718 INFO:tasks.workunit.client.0.smithi078.stdout:1/168: rmdir d0/d1/d4 39 2024-04-18T21:06:56.719 INFO:tasks.workunit.client.0.smithi078.stdout:2/104: write d0/fe [2114731,101396] 0 2024-04-18T21:06:56.719 INFO:tasks.workunit.client.0.smithi078.stdout:0/132: write d0/f5 [448580,110063] 0 2024-04-18T21:06:56.719 INFO:tasks.workunit.client.0.smithi078.stdout:4/129: dwrite d0/f28 [0,4194304] 0 2024-04-18T21:06:56.720 INFO:tasks.workunit.client.0.smithi078.stdout:1/169: unlink d0/d13/f30 0 2024-04-18T21:06:56.720 INFO:tasks.workunit.client.0.smithi078.stdout:9/120: rename d7/d14 to d7/d11/d2d 0 2024-04-18T21:06:56.721 INFO:tasks.workunit.client.0.smithi078.stdout:3/103: dread d4/f13 [8388608,4194304] 0 2024-04-18T21:06:56.721 INFO:tasks.workunit.client.0.smithi078.stdout:4/130: creat d0/dc/d29/f31 x:0 0 0 2024-04-18T21:06:56.722 INFO:tasks.workunit.client.0.smithi078.stdout:2/105: mkdir d0/db/d18/d21 0 2024-04-18T21:06:56.722 INFO:tasks.workunit.client.0.smithi078.stdout:5/150: fdatasync d9/fe 0 2024-04-18T21:06:56.722 INFO:tasks.workunit.client.0.smithi078.stdout:0/133: write d0/f16 [522011,104679] 0 2024-04-18T21:06:56.722 INFO:tasks.workunit.client.0.smithi078.stdout:9/121: write f0 [1614617,40606] 0 2024-04-18T21:06:56.724 INFO:tasks.workunit.client.0.smithi078.stdout:1/170: unlink d0/d1/d4/c2b 0 2024-04-18T21:06:56.724 INFO:tasks.workunit.client.0.smithi078.stdout:4/131: creat d0/dc/d10/f32 x:0 0 0 2024-04-18T21:06:56.725 INFO:tasks.workunit.client.0.smithi078.stdout:2/106: mknod d0/db/d18/d21/c22 0 2024-04-18T21:06:56.726 INFO:tasks.workunit.client.0.smithi078.stdout:5/151: rename d9/da/d1d to d9/d2e 0 2024-04-18T21:06:56.727 INFO:tasks.workunit.client.0.smithi078.stdout:9/122: mkdir d7/d11/d2d/d2e 0 2024-04-18T21:06:56.727 INFO:tasks.workunit.client.0.smithi078.stdout:4/132: write d0/dc/f1d [3879876,12075] 0 2024-04-18T21:06:56.727 INFO:tasks.workunit.client.0.smithi078.stdout:7/125: dwrite d1/d16/d10/f19 [0,4194304] 0 2024-04-18T21:06:56.729 INFO:tasks.workunit.client.0.smithi078.stdout:6/104: dwrite d2/d6/dd/f15 [0,4194304] 0 2024-04-18T21:06:56.730 INFO:tasks.workunit.client.0.smithi078.stdout:9/123: creat d7/df/d1e/f2f x:0 0 0 2024-04-18T21:06:56.731 INFO:tasks.workunit.client.0.smithi078.stdout:1/171: write d0/d1/f24 [2279163,122600] 0 2024-04-18T21:06:56.731 INFO:tasks.workunit.client.0.smithi078.stdout:5/152: write d9/fb [563451,3820] 0 2024-04-18T21:06:56.732 INFO:tasks.workunit.client.0.smithi078.stdout:1/172: sync 2024-04-18T21:06:56.732 INFO:tasks.workunit.client.0.smithi078.stdout:0/134: truncate d0/f5 1083080 0 2024-04-18T21:06:56.732 INFO:tasks.workunit.client.0.smithi078.stdout:4/133: unlink d0/dc/f22 0 2024-04-18T21:06:56.732 INFO:tasks.workunit.client.0.smithi078.stdout:2/107: link d0/f1e d0/db/d18/d21/f23 0 2024-04-18T21:06:56.732 INFO:tasks.workunit.client.0.smithi078.stdout:7/126: chown d1/d16/dc/d11/f29 716267 1 2024-04-18T21:06:56.733 INFO:tasks.workunit.client.0.smithi078.stdout:2/108: readlink d0/l20 0 2024-04-18T21:06:56.733 INFO:tasks.workunit.client.0.smithi078.stdout:6/105: rmdir d2/d1f 39 2024-04-18T21:06:56.733 INFO:tasks.workunit.client.0.smithi078.stdout:0/135: creat d0/d15/f27 x:0 0 0 2024-04-18T21:06:56.733 INFO:tasks.workunit.client.0.smithi078.stdout:9/124: creat d7/f30 x:0 0 0 2024-04-18T21:06:56.733 INFO:tasks.workunit.client.0.smithi078.stdout:4/134: chown d0/f19 225502 1 2024-04-18T21:06:56.733 INFO:tasks.workunit.client.0.smithi078.stdout:5/153: creat d9/d2e/d29/f2f x:0 0 0 2024-04-18T21:06:56.734 INFO:tasks.workunit.client.0.smithi078.stdout:3/104: dwrite d4/fd [4194304,4194304] 0 2024-04-18T21:06:56.734 INFO:tasks.workunit.client.0.smithi078.stdout:7/127: creat d1/d28/f2c x:0 0 0 2024-04-18T21:06:56.734 INFO:tasks.workunit.client.0.smithi078.stdout:2/109: symlink d0/db/l24 0 2024-04-18T21:06:56.734 INFO:tasks.workunit.client.0.smithi078.stdout:6/106: truncate d2/d6/f1a 670570 0 2024-04-18T21:06:56.735 INFO:tasks.workunit.client.0.smithi078.stdout:4/135: symlink d0/dc/l33 0 2024-04-18T21:06:56.735 INFO:tasks.workunit.client.0.smithi078.stdout:8/88: dwrite d0/fb [0,4194304] 0 2024-04-18T21:06:56.735 INFO:tasks.workunit.client.0.smithi078.stdout:0/136: mknod d0/d15/d21/c28 0 2024-04-18T21:06:56.736 INFO:tasks.workunit.client.0.smithi078.stdout:3/105: creat d4/df/f19 x:0 0 0 2024-04-18T21:06:56.736 INFO:tasks.workunit.client.0.smithi078.stdout:0/137: stat d0/d9/da 0 2024-04-18T21:06:56.736 INFO:tasks.workunit.client.0.smithi078.stdout:2/110: unlink d0/f11 0 2024-04-18T21:06:56.736 INFO:tasks.workunit.client.0.smithi078.stdout:4/136: rmdir d0/dc 39 2024-04-18T21:06:56.737 INFO:tasks.workunit.client.0.smithi078.stdout:0/138: write d0/f4 [1673948,36915] 0 2024-04-18T21:06:56.737 INFO:tasks.workunit.client.0.smithi078.stdout:3/106: symlink d4/df/d17/l1a 0 2024-04-18T21:06:56.738 INFO:tasks.workunit.client.0.smithi078.stdout:2/111: rename d0/l6 to d0/l25 0 2024-04-18T21:06:56.738 INFO:tasks.workunit.client.0.smithi078.stdout:8/89: write d0/d10/d14/f1e [300201,10862] 0 2024-04-18T21:06:56.738 INFO:tasks.workunit.client.0.smithi078.stdout:1/173: dread d0/d13/f17 [0,4194304] 0 2024-04-18T21:06:56.739 INFO:tasks.workunit.client.0.smithi078.stdout:3/107: rmdir d4/da/d11 39 2024-04-18T21:06:56.740 INFO:tasks.workunit.client.0.smithi078.stdout:0/139: rmdir d0/d9/da/df 39 2024-04-18T21:06:56.740 INFO:tasks.workunit.client.0.smithi078.stdout:4/137: creat d0/dc/d29/d2f/f34 x:0 0 0 2024-04-18T21:06:56.740 INFO:tasks.workunit.client.0.smithi078.stdout:8/90: write d0/fe [1166353,96654] 0 2024-04-18T21:06:56.743 INFO:tasks.workunit.client.0.smithi078.stdout:4/138: chown d0/dc/d10/d1c/l27 4799074 1 2024-04-18T21:06:56.743 INFO:tasks.workunit.client.0.smithi078.stdout:1/174: rename d0/f1f to d0/d1/d4/f3d 0 2024-04-18T21:06:56.743 INFO:tasks.workunit.client.0.smithi078.stdout:7/128: dread d1/d16/d10/f19 [0,4194304] 0 2024-04-18T21:06:56.744 INFO:tasks.workunit.client.0.smithi078.stdout:9/125: dwrite f6 [0,4194304] 0 2024-04-18T21:06:56.745 INFO:tasks.workunit.client.0.smithi078.stdout:1/175: creat d0/d1/f3e x:0 0 0 2024-04-18T21:06:56.745 INFO:tasks.workunit.client.0.smithi078.stdout:7/129: unlink d1/d16/d10/c23 0 2024-04-18T21:06:56.745 INFO:tasks.workunit.client.0.smithi078.stdout:6/107: dwrite d2/d6/f1a [0,4194304] 0 2024-04-18T21:06:56.746 INFO:tasks.workunit.client.0.smithi078.stdout:2/112: dread d0/f3 [4194304,4194304] 0 2024-04-18T21:06:56.746 INFO:tasks.workunit.client.0.smithi078.stdout:5/154: fsync d9/d2e/d29/f2f 0 2024-04-18T21:06:56.747 INFO:tasks.workunit.client.0.smithi078.stdout:9/126: rename d7/f30 to d7/d11/d2d/f31 0 2024-04-18T21:06:56.747 INFO:tasks.workunit.client.0.smithi078.stdout:7/130: mkdir d1/d16/d2d 0 2024-04-18T21:06:56.748 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:56.748 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:56.749 INFO:tasks.workunit.client.0.smithi078.stdout:1/176: creat d0/f3f x:0 0 0 2024-04-18T21:06:56.749 INFO:tasks.workunit.client.0.smithi078.stdout:1/177: dread - d0/f3f zero size 2024-04-18T21:06:56.749 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:56.746+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:56.750 INFO:tasks.workunit.client.0.smithi078.stdout:4/139: dread d0/f7 [0,4194304] 0 2024-04-18T21:06:56.750 INFO:tasks.workunit.client.0.smithi078.stdout:9/127: symlink d7/d11/d2d/d26/l32 0 2024-04-18T21:06:56.750 INFO:tasks.workunit.client.0.smithi078.stdout:0/140: dwrite d0/d9/f23 [0,4194304] 0 2024-04-18T21:06:56.751 INFO:tasks.workunit.client.0.smithi078.stdout:2/113: link d0/f3 d0/db/d18/f26 0 2024-04-18T21:06:56.751 INFO:tasks.workunit.client.0.smithi078.stdout:4/140: chown d0/dc/d10/f32 13629 1 2024-04-18T21:06:56.752 INFO:tasks.workunit.client.0.smithi078.stdout:1/178: mknod d0/d2a/d3c/c40 0 2024-04-18T21:06:56.752 INFO:tasks.workunit.client.0.smithi078.stdout:9/128: creat d7/d11/f33 x:0 0 0 2024-04-18T21:06:56.753 INFO:tasks.workunit.client.0.smithi078.stdout:4/141: creat d0/dc/d29/d2f/f35 x:0 0 0 2024-04-18T21:06:56.759 INFO:tasks.workunit.client.0.smithi078.stdout:7/131: dread d1/d16/dc/fd [0,4194304] 0 2024-04-18T21:06:56.759 INFO:tasks.workunit.client.0.smithi078.stdout:4/142: stat d0/dc/d10/c1a 0 2024-04-18T21:06:56.759 INFO:tasks.workunit.client.0.smithi078.stdout:6/108: dwrite d2/d6/fc [0,4194304] 0 2024-04-18T21:06:56.759 INFO:tasks.workunit.client.0.smithi078.stdout:6/109: mknod d2/d6/c27 0 2024-04-18T21:06:56.759 INFO:tasks.workunit.client.0.smithi078.stdout:7/132: write d1/d16/dc/fd [2645782,81778] 0 2024-04-18T21:06:56.759 INFO:tasks.workunit.client.0.smithi078.stdout:0/141: dread d0/f16 [0,4194304] 0 2024-04-18T21:06:56.759 INFO:tasks.workunit.client.0.smithi078.stdout:4/143: rename d0/f19 to d0/dc/d10/d1c/f36 0 2024-04-18T21:06:56.759 INFO:tasks.workunit.client.0.smithi078.stdout:4/144: rmdir d0/dc 39 2024-04-18T21:06:56.760 INFO:tasks.workunit.client.0.smithi078.stdout:7/133: creat d1/d16/dc/d11/f2e x:0 0 0 2024-04-18T21:06:56.760 INFO:tasks.workunit.client.0.smithi078.stdout:6/110: rename d2/d1c/l26 to d2/d6/dd/l28 0 2024-04-18T21:06:56.760 INFO:tasks.workunit.client.0.smithi078.stdout:7/134: mknod d1/c2f 0 2024-04-18T21:06:56.760 INFO:tasks.workunit.client.0.smithi078.stdout:6/111: read d2/d6/f16 [2629400,30183] 0 2024-04-18T21:06:56.761 INFO:tasks.workunit.client.0.smithi078.stdout:0/142: getdents d0/d9/da/df 0 2024-04-18T21:06:56.761 INFO:tasks.workunit.client.0.smithi078.stdout:7/135: symlink d1/d16/dc/l30 0 2024-04-18T21:06:56.761 INFO:tasks.workunit.client.0.smithi078.stdout:5/155: dread d9/fe [0,4194304] 0 2024-04-18T21:06:56.761 INFO:tasks.workunit.client.0.smithi078.stdout:6/112: creat d2/d1f/f29 x:0 0 0 2024-04-18T21:06:56.761 INFO:tasks.workunit.client.0.smithi078.stdout:7/136: chown d1/f1d 7 1 2024-04-18T21:06:56.762 INFO:tasks.workunit.client.0.smithi078.stdout:1/179: getdents d0/d1 0 2024-04-18T21:06:56.762 INFO:tasks.workunit.client.0.smithi078.stdout:5/156: chown d9/d2e/d29/l2b 1579 1 2024-04-18T21:06:56.762 INFO:tasks.workunit.client.0.smithi078.stdout:7/137: mkdir d1/d16/dc/d31 0 2024-04-18T21:06:56.762 INFO:tasks.workunit.client.0.smithi078.stdout:6/113: truncate d2/d1f/f25 742623 0 2024-04-18T21:06:56.763 INFO:tasks.workunit.client.0.smithi078.stdout:4/145: dread d0/dc/f1e [0,4194304] 0 2024-04-18T21:06:56.763 INFO:tasks.workunit.client.0.smithi078.stdout:7/138: fdatasync d1/f18 0 2024-04-18T21:06:56.763 INFO:tasks.workunit.client.0.smithi078.stdout:6/114: mknod d2/c2a 0 2024-04-18T21:06:56.763 INFO:tasks.workunit.client.0.smithi078.stdout:8/91: fdatasync d0/f6 0 2024-04-18T21:06:56.763 INFO:tasks.workunit.client.0.smithi078.stdout:0/143: fsync d0/f4 0 2024-04-18T21:06:56.764 INFO:tasks.workunit.client.0.smithi078.stdout:4/146: write d0/f12 [3782617,81305] 0 2024-04-18T21:06:56.764 INFO:tasks.workunit.client.0.smithi078.stdout:7/139: dread - d1/d16/d10/f1a zero size 2024-04-18T21:06:56.765 INFO:tasks.workunit.client.0.smithi078.stdout:8/92: write d0/fb [1478284,100900] 0 2024-04-18T21:06:56.765 INFO:tasks.workunit.client.0.smithi078.stdout:0/144: read d0/d9/f23 [1145740,39342] 0 2024-04-18T21:06:56.765 INFO:tasks.workunit.client.0.smithi078.stdout:2/114: mkdir d0/db/d18/d21/d27 0 2024-04-18T21:06:56.765 INFO:tasks.workunit.client.0.smithi078.stdout:6/115: chown d2/d6/fc 89620 1 2024-04-18T21:06:56.765 INFO:tasks.workunit.client.0.smithi078.stdout:5/157: dread d9/fe [0,4194304] 0 2024-04-18T21:06:56.766 INFO:tasks.workunit.client.0.smithi078.stdout:7/140: mkdir d1/d32 0 2024-04-18T21:06:56.766 INFO:tasks.workunit.client.0.smithi078.stdout:6/116: stat d2/d1c 0 2024-04-18T21:06:56.766 INFO:tasks.workunit.client.0.smithi078.stdout:4/147: mkdir d0/dc/d37 0 2024-04-18T21:06:56.766 INFO:tasks.workunit.client.0.smithi078.stdout:8/93: creat d0/f1f x:0 0 0 2024-04-18T21:06:56.767 INFO:tasks.workunit.client.0.smithi078.stdout:5/158: mknod d9/d2e/d29/c30 0 2024-04-18T21:06:56.767 INFO:tasks.workunit.client.0.smithi078.stdout:2/115: readlink d0/db/l24 0 2024-04-18T21:06:56.767 INFO:tasks.workunit.client.0.smithi078.stdout:0/145: symlink d0/d9/l29 0 2024-04-18T21:06:56.767 INFO:tasks.workunit.client.0.smithi078.stdout:8/94: stat d0/l8 0 2024-04-18T21:06:56.768 INFO:tasks.workunit.client.0.smithi078.stdout:5/159: symlink d9/d2e/l31 0 2024-04-18T21:06:56.768 INFO:tasks.workunit.client.0.smithi078.stdout:2/116: stat d0/db/f16 0 2024-04-18T21:06:56.769 INFO:tasks.workunit.client.0.smithi078.stdout:7/141: symlink d1/d16/dc/d11/l33 0 2024-04-18T21:06:56.770 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:56.770 INFO:tasks.workunit.client.0.smithi078.stdout:0/146: dread - d0/d15/f27 zero size 2024-04-18T21:06:56.771 INFO:tasks.workunit.client.0.smithi078.stdout:9/129: dwrite d7/f24 [0,4194304] 0 2024-04-18T21:06:56.771 INFO:tasks.workunit.client.0.smithi078.stdout:1/180: dwrite d0/d2a/d2f/f38 [0,4194304] 0 2024-04-18T21:06:56.772 INFO:tasks.workunit.client.0.smithi078.stdout:4/148: creat d0/dc/d29/d2f/f38 x:0 0 0 2024-04-18T21:06:56.773 INFO:tasks.workunit.client.0.smithi078.stdout:0/147: rmdir d0/d9/da/db 39 2024-04-18T21:06:56.773 INFO:tasks.workunit.client.0.smithi078.stdout:7/142: rename d1/d16/f8 to d1/d16/d1c/f34 0 2024-04-18T21:06:56.773 INFO:tasks.workunit.client.0.smithi078.stdout:1/181: rmdir d0/d1 39 2024-04-18T21:06:56.773 INFO:tasks.workunit.client.0.smithi078.stdout:4/149: readlink d0/dc/l15 0 2024-04-18T21:06:56.774 INFO:tasks.workunit.client.0.smithi078.stdout:1/182: creat d0/d13/d32/f41 x:0 0 0 2024-04-18T21:06:56.775 INFO:tasks.workunit.client.0.smithi078.stdout:7/143: fdatasync d1/d16/dc/d11/f24 0 2024-04-18T21:06:56.775 INFO:tasks.workunit.client.0.smithi078.stdout:0/148: chown d0/d9/c18 7202453 1 2024-04-18T21:06:56.776 INFO:tasks.workunit.client.0.smithi078.stdout:3/108: sync 2024-04-18T21:06:56.776 INFO:tasks.workunit.client.0.smithi078.stdout:9/130: sync 2024-04-18T21:06:56.776 INFO:tasks.workunit.client.0.smithi078.stdout:4/150: write d0/dc/d10/f1b [991958,113986] 0 2024-04-18T21:06:56.776 INFO:tasks.workunit.client.0.smithi078.stdout:1/183: creat d0/d11/f42 x:0 0 0 2024-04-18T21:06:56.776 INFO:tasks.workunit.client.0.smithi078.stdout:6/117: dwrite d2/d6/dd/f15 [0,4194304] 0 2024-04-18T21:06:56.777 INFO:tasks.workunit.client.0.smithi078.stdout:9/131: creat d7/d11/f34 x:0 0 0 2024-04-18T21:06:56.779 INFO:tasks.workunit.client.0.smithi078.stdout:8/95: dread d0/f18 [0,4194304] 0 2024-04-18T21:06:56.779 INFO:tasks.workunit.client.0.smithi078.stdout:0/149: write d0/f8 [2449495,32663] 0 2024-04-18T21:06:56.779 INFO:tasks.workunit.client.0.smithi078.stdout:4/151: creat d0/dc/d29/d2f/f39 x:0 0 0 2024-04-18T21:06:56.780 INFO:tasks.workunit.client.0.smithi078.stdout:1/184: symlink d0/l43 0 2024-04-18T21:06:56.780 INFO:tasks.workunit.client.0.smithi078.stdout:2/117: dwrite d0/f1d [0,4194304] 0 2024-04-18T21:06:56.782 INFO:tasks.workunit.client.0.smithi078.stdout:6/118: truncate d2/d6/f1a 4644913 0 2024-04-18T21:06:56.782 INFO:tasks.workunit.client.0.smithi078.stdout:2/118: write d0/f1d [2115862,75604] 0 2024-04-18T21:06:56.784 INFO:tasks.workunit.client.0.smithi078.stdout:4/152: truncate d0/dc/d10/d1c/f36 1415641 0 2024-04-18T21:06:56.784 INFO:tasks.workunit.client.0.smithi078.stdout:0/150: symlink d0/d9/da/l2a 0 2024-04-18T21:06:56.784 INFO:tasks.workunit.client.0.smithi078.stdout:8/96: symlink d0/d10/d14/l20 0 2024-04-18T21:06:56.787 INFO:tasks.workunit.client.0.smithi078.stdout:6/119: creat d2/f2b x:0 0 0 2024-04-18T21:06:56.787 INFO:tasks.workunit.client.0.smithi078.stdout:2/119: symlink d0/d1f/l28 0 2024-04-18T21:06:56.787 INFO:tasks.workunit.client.0.smithi078.stdout:1/185: getdents d0/d2a/d3c 0 2024-04-18T21:06:56.788 INFO:tasks.workunit.client.0.smithi078.stdout:7/144: dwrite d1/d16/dc/d11/f24 [0,4194304] 0 2024-04-18T21:06:56.788 INFO:tasks.workunit.client.0.smithi078.stdout:3/109: dwrite d4/f18 [0,4194304] 0 2024-04-18T21:06:56.788 INFO:tasks.workunit.client.0.smithi078.stdout:5/160: getdents d9/d2e/d29 0 2024-04-18T21:06:56.790 INFO:tasks.workunit.client.0.smithi078.stdout:8/97: creat d0/d10/d14/f21 x:0 0 0 2024-04-18T21:06:56.790 INFO:tasks.workunit.client.0.smithi078.stdout:4/153: write d0/dc/d10/d1c/f36 [2445500,35513] 0 2024-04-18T21:06:56.790 INFO:tasks.workunit.client.0.smithi078.stdout:7/145: mkdir d1/d28/d35 0 2024-04-18T21:06:56.791 INFO:tasks.workunit.client.0.smithi078.stdout:6/120: creat d2/d1f/f2c x:0 0 0 2024-04-18T21:06:56.792 INFO:tasks.workunit.client.0.smithi078.stdout:3/110: mknod d4/df/c1b 0 2024-04-18T21:06:56.792 INFO:tasks.workunit.client.0.smithi078.stdout:5/161: mkdir d9/da/d32 0 2024-04-18T21:06:56.793 INFO:tasks.workunit.client.0.smithi078.stdout:8/98: mkdir d0/d22 0 2024-04-18T21:06:56.793 INFO:tasks.workunit.client.0.smithi078.stdout:4/154: mkdir d0/dc/d10/d3a 0 2024-04-18T21:06:56.793 INFO:tasks.workunit.client.0.smithi078.stdout:2/120: mkdir d0/db/d18/d21/d27/d29 0 2024-04-18T21:06:56.793 INFO:tasks.workunit.client.0.smithi078.stdout:1/186: chown d0/d1/c1d 347922657 1 2024-04-18T21:06:56.794 INFO:tasks.workunit.client.0.smithi078.stdout:2/121: readlink d0/l20 0 2024-04-18T21:06:56.794 INFO:tasks.workunit.client.0.smithi078.stdout:3/111: chown d4/df/d17 5396749 1 2024-04-18T21:06:56.794 INFO:tasks.workunit.client.0.smithi078.stdout:7/146: creat d1/d16/d2d/f36 x:0 0 0 2024-04-18T21:06:56.794 INFO:tasks.workunit.client.0.smithi078.stdout:0/151: dwrite d0/f5 [0,4194304] 0 2024-04-18T21:06:56.795 INFO:tasks.workunit.client.0.smithi078.stdout:4/155: rmdir d0/dc/d29/d2e 0 2024-04-18T21:06:56.795 INFO:tasks.workunit.client.0.smithi078.stdout:8/99: rename d0/c15 to d0/d10/c23 0 2024-04-18T21:06:56.797 INFO:tasks.workunit.client.0.smithi078.stdout:2/122: mknod d0/db/c2a 0 2024-04-18T21:06:56.797 INFO:tasks.workunit.client.0.smithi078.stdout:4/156: truncate d0/dc/d10/f1b 1744440 0 2024-04-18T21:06:56.797 INFO:tasks.workunit.client.0.smithi078.stdout:7/147: link d1/d16/dc/d11/f24 d1/d16/dc/f37 0 2024-04-18T21:06:56.797 INFO:tasks.workunit.client.0.smithi078.stdout:1/187: rename d0/d1/d4/f34 to d0/d2a/d2f/f44 0 2024-04-18T21:06:56.797 INFO:tasks.workunit.client.0.smithi078.stdout:4/157: chown d0/dc/d10/l1f 49867 1 2024-04-18T21:06:56.797 INFO:tasks.workunit.client.0.smithi078.stdout:1/188: mkdir d0/d2a/d45 0 2024-04-18T21:06:56.797 INFO:tasks.workunit.client.0.smithi078.stdout:0/152: rename d0/f16 to d0/d9/dd/d14/f2b 0 2024-04-18T21:06:56.798 INFO:tasks.workunit.client.0.smithi078.stdout:0/153: rmdir d0/d9/da/df 39 2024-04-18T21:06:56.798 INFO:tasks.workunit.client.0.smithi078.stdout:4/158: creat d0/dc/d37/f3b x:0 0 0 2024-04-18T21:06:56.799 INFO:tasks.workunit.client.0.smithi078.stdout:3/112: dread d4/fd [0,4194304] 0 2024-04-18T21:06:56.799 INFO:tasks.workunit.client.0.smithi078.stdout:0/154: readlink d0/d9/dd/d14/l1f 0 2024-04-18T21:06:56.799 INFO:tasks.workunit.client.0.smithi078.stdout:3/113: chown d4 29085901 1 2024-04-18T21:06:56.799 INFO:tasks.workunit.client.0.smithi078.stdout:4/159: write d0/dc/d29/d2f/f39 [1007122,78959] 0 2024-04-18T21:06:56.800 INFO:tasks.workunit.client.0.smithi078.stdout:7/148: rmdir d1/d28/d35 0 2024-04-18T21:06:56.800 INFO:tasks.workunit.client.0.smithi078.stdout:3/114: chown d4/df/d17/l1a 92 1 2024-04-18T21:06:56.800 INFO:tasks.workunit.client.0.smithi078.stdout:0/155: unlink d0/d9/dd/d14/l1f 0 2024-04-18T21:06:56.801 INFO:tasks.workunit.client.0.smithi078.stdout:4/160: mknod d0/dc/d37/c3c 0 2024-04-18T21:06:56.801 INFO:tasks.workunit.client.0.smithi078.stdout:3/115: chown d4/df/c16 1022 1 2024-04-18T21:06:56.801 INFO:tasks.workunit.client.0.smithi078.stdout:7/149: mknod d1/d16/d2d/c38 0 2024-04-18T21:06:56.801 INFO:tasks.workunit.client.0.smithi078.stdout:0/156: write d0/d9/dd/d14/f2b [3763279,78156] 0 2024-04-18T21:06:56.802 INFO:tasks.workunit.client.0.smithi078.stdout:0/157: chown d0/d15/d21 61675488 1 2024-04-18T21:06:56.803 INFO:tasks.workunit.client.0.smithi078.stdout:7/150: mknod d1/d16/dc/d11/c39 0 2024-04-18T21:06:56.803 INFO:tasks.workunit.client.0.smithi078.stdout:8/100: dwrite d0/f1f [0,4194304] 0 2024-04-18T21:06:56.803 INFO:tasks.workunit.client.0.smithi078.stdout:3/116: link d4/c14 d4/c1c 0 2024-04-18T21:06:56.803 INFO:tasks.workunit.client.0.smithi078.stdout:7/151: mknod d1/d16/c3a 0 2024-04-18T21:06:56.803 INFO:tasks.workunit.client.0.smithi078.stdout:0/158: creat d0/d9/da/db/f2c x:0 0 0 2024-04-18T21:06:56.804 INFO:tasks.workunit.client.0.smithi078.stdout:8/101: creat d0/d22/f24 x:0 0 0 2024-04-18T21:06:56.804 INFO:tasks.workunit.client.0.smithi078.stdout:0/159: unlink d0/d9/da/c12 0 2024-04-18T21:06:56.804 INFO:tasks.workunit.client.0.smithi078.stdout:7/152: link d1/d16/d2d/f36 d1/d16/f3b 0 2024-04-18T21:06:56.805 INFO:tasks.workunit.client.0.smithi078.stdout:0/160: dread - d0/d15/f27 zero size 2024-04-18T21:06:56.805 INFO:tasks.workunit.client.0.smithi078.stdout:8/102: chown d0/fe 12757 1 2024-04-18T21:06:56.806 INFO:tasks.workunit.client.0.smithi078.stdout:7/153: write d1/d16/dc/fd [2485606,72258] 0 2024-04-18T21:06:56.806 INFO:tasks.workunit.client.0.smithi078.stdout:8/103: readlink d0/l1a 0 2024-04-18T21:06:56.806 INFO:tasks.workunit.client.0.smithi078.stdout:8/104: stat d0/d10/d14/c19 0 2024-04-18T21:06:56.806 INFO:tasks.workunit.client.0.smithi078.stdout:8/105: truncate d0/f18 4467032 0 2024-04-18T21:06:56.807 INFO:tasks.workunit.client.0.smithi078.stdout:8/106: fdatasync d0/fe 0 2024-04-18T21:06:56.807 INFO:tasks.workunit.client.0.smithi078.stdout:0/161: truncate d0/d9/f23 3718032 0 2024-04-18T21:06:56.807 INFO:tasks.workunit.client.0.smithi078.stdout:0/162: fsync d0/d9/dd/d14/f20 0 2024-04-18T21:06:56.808 INFO:tasks.workunit.client.0.smithi078.stdout:8/107: symlink d0/d10/d14/l25 0 2024-04-18T21:06:56.808 INFO:tasks.workunit.client.0.smithi078.stdout:0/163: creat d0/d9/f2d x:0 0 0 2024-04-18T21:06:56.809 INFO:tasks.workunit.client.0.smithi078.stdout:7/154: dread d1/d16/dc/fd [0,4194304] 0 2024-04-18T21:06:56.809 INFO:tasks.workunit.client.0.smithi078.stdout:0/164: read - d0/d9/da/df/f25 zero size 2024-04-18T21:06:56.810 INFO:tasks.workunit.client.0.smithi078.stdout:7/155: chown d1/d16/dc/f1e 763 1 2024-04-18T21:06:56.810 INFO:tasks.workunit.client.0.smithi078.stdout:7/156: chown d1/d16/dc/d11/f2b 298 1 2024-04-18T21:06:56.811 INFO:tasks.workunit.client.0.smithi078.stdout:0/165: mkdir d0/d9/dd/d17/d2e 0 2024-04-18T21:06:56.811 INFO:tasks.workunit.client.0.smithi078.stdout:0/166: mkdir d0/d9/d2f 0 2024-04-18T21:06:56.817 INFO:tasks.workunit.client.0.smithi078.stdout:7/157: dwrite d1/d16/dc/f37 [0,4194304] 0 2024-04-18T21:06:56.818 INFO:tasks.workunit.client.0.smithi078.stdout:0/167: dwrite d0/f8 [4194304,4194304] 0 2024-04-18T21:06:56.850 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:56.850+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:56.903 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:56.903 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:56.917 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:56.962 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:56.962+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:57.037 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:57.037 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:57.051 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:57.095 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:57.094+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:57.153 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:57.150+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:57.162 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-04-18T21:06:57.219 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:57.219 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:57.233 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:57.274 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:57.274+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:57.354 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:57.354+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:57.360 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:57.360 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:57.374 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:57.455 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:57.458+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:57.540 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:57.540 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:57.554 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:57.556 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:57.554+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:57.657 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:57.654+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:57.675 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:57.675 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:57.689 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:57.757 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:57.758+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:57.798 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-18T21:06:57.820 INFO:tasks.workunit.client.0.smithi078.stdout:1/189: rename d0/d13 to d0/d46 0 2024-04-18T21:06:57.821 INFO:tasks.workunit.client.0.smithi078.stdout:1/190: readlink d0/d1/d4/l26 0 2024-04-18T21:06:57.831 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:57.831 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:57.840 INFO:tasks.workunit.client.0.smithi078.stdout:9/132: truncate f0 3866472 0 2024-04-18T21:06:57.841 INFO:tasks.workunit.client.0.smithi078.stdout:9/133: mknod d7/d11/d2d/c35 0 2024-04-18T21:06:57.842 INFO:tasks.workunit.client.0.smithi078.stdout:9/134: fsync f6 0 2024-04-18T21:06:57.843 INFO:tasks.workunit.client.0.smithi078.stdout:9/135: getdents d7/d11/d2d/d2e 0 2024-04-18T21:06:57.845 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:57.846 INFO:tasks.workunit.client.0.smithi078.stdout:2/123: getdents d0/d1f 0 2024-04-18T21:06:57.846 INFO:tasks.workunit.client.0.smithi078.stdout:6/121: truncate d2/ff 509579 0 2024-04-18T21:06:57.849 INFO:tasks.workunit.client.0.smithi078.stdout:5/162: truncate d9/da/f1b 116013 0 2024-04-18T21:06:57.849 INFO:tasks.workunit.client.0.smithi078.stdout:4/161: truncate d0/f17 2851822 0 2024-04-18T21:06:57.849 INFO:tasks.workunit.client.0.smithi078.stdout:3/117: truncate d4/f13 8211428 0 2024-04-18T21:06:57.850 INFO:tasks.workunit.client.0.smithi078.stdout:8/108: truncate d0/fe 3913877 0 2024-04-18T21:06:57.851 INFO:tasks.workunit.client.0.smithi078.stdout:6/122: symlink d2/d1f/l2d 0 2024-04-18T21:06:57.852 INFO:tasks.workunit.client.0.smithi078.stdout:0/168: stat d0/d9/dd/d17/d2e 0 2024-04-18T21:06:57.852 INFO:tasks.workunit.client.0.smithi078.stdout:7/158: truncate d1/d16/d1c/f34 685331 0 2024-04-18T21:06:57.852 INFO:tasks.workunit.client.0.smithi078.stdout:5/163: creat d9/d2e/d29/f33 x:0 0 0 2024-04-18T21:06:57.853 INFO:tasks.workunit.client.0.smithi078.stdout:4/162: read d0/dc/d10/d1c/f36 [423874,115733] 0 2024-04-18T21:06:57.853 INFO:tasks.workunit.client.0.smithi078.stdout:8/109: creat d0/f26 x:0 0 0 2024-04-18T21:06:57.853 INFO:tasks.workunit.client.0.smithi078.stdout:3/118: write d4/fd [4540585,42827] 0 2024-04-18T21:06:57.855 INFO:tasks.workunit.client.0.smithi078.stdout:9/136: dwrite d7/fa [4194304,4194304] 0 2024-04-18T21:06:57.856 INFO:tasks.workunit.client.0.smithi078.stdout:8/110: write d0/d10/f1c [910170,83228] 0 2024-04-18T21:06:57.857 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:57.858+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:57.861 INFO:tasks.workunit.client.0.smithi078.stdout:5/164: dread d9/fb [0,4194304] 0 2024-04-18T21:06:57.866 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:06:57.871 INFO:tasks.workunit.client.0.smithi078.stdout:2/124: fdatasync d0/db/f16 0 2024-04-18T21:06:57.871 INFO:tasks.workunit.client.0.smithi078.stdout:0/169: mkdir d0/d15/d21/d30 0 2024-04-18T21:06:57.871 INFO:tasks.workunit.client.0.smithi078.stdout:4/163: fsync d0/f7 0 2024-04-18T21:06:57.873 INFO:tasks.workunit.client.0.smithi078.stdout:9/137: write d7/d11/d2d/d26/f2b [67178,45435] 0 2024-04-18T21:06:57.873 INFO:tasks.workunit.client.0.smithi078.stdout:9/138: dread - d7/d11/f33 zero size 2024-04-18T21:06:57.875 INFO:tasks.workunit.client.0.smithi078.stdout:0/170: unlink d0/d9/le 0 2024-04-18T21:06:57.875 INFO:tasks.workunit.client.0.smithi078.stdout:2/125: fsync d0/db/d18/f26 0 2024-04-18T21:06:57.875 INFO:tasks.workunit.client.0.smithi078.stdout:7/159: creat d1/f3c x:0 0 0 2024-04-18T21:06:57.876 INFO:tasks.workunit.client.0.smithi078.stdout:3/119: rename d4/df/d17/l1a to d4/l1d 0 2024-04-18T21:06:57.876 INFO:tasks.workunit.client.0.smithi078.stdout:4/164: symlink d0/dc/d37/l3d 0 2024-04-18T21:06:57.877 INFO:tasks.workunit.client.0.smithi078.stdout:5/165: creat d9/f34 x:0 0 0 2024-04-18T21:06:57.877 INFO:tasks.workunit.client.0.smithi078.stdout:2/126: creat d0/d1f/f2b x:0 0 0 2024-04-18T21:06:57.878 INFO:tasks.workunit.client.0.smithi078.stdout:0/171: truncate d0/d9/da/df/f25 625649 0 2024-04-18T21:06:57.878 INFO:tasks.workunit.client.0.smithi078.stdout:7/160: creat d1/d16/dc/d11/f3d x:0 0 0 2024-04-18T21:06:57.878 INFO:tasks.workunit.client.0.smithi078.stdout:5/166: creat d9/da/f35 x:0 0 0 2024-04-18T21:06:57.879 INFO:tasks.workunit.client.0.smithi078.stdout:3/120: mknod d4/da/d11/c1e 0 2024-04-18T21:06:57.880 INFO:tasks.workunit.client.0.smithi078.stdout:7/161: readlink d1/d16/dc/d11/l33 0 2024-04-18T21:06:57.880 INFO:tasks.workunit.client.0.smithi078.stdout:2/127: creat d0/db/d18/d21/f2c x:0 0 0 2024-04-18T21:06:57.880 INFO:tasks.workunit.client.0.smithi078.stdout:8/111: dwrite d0/f18 [4194304,4194304] 0 2024-04-18T21:06:57.881 INFO:tasks.workunit.client.0.smithi078.stdout:4/165: rename d0/c30 to d0/dc/c3e 0 2024-04-18T21:06:57.881 INFO:tasks.workunit.client.0.smithi078.stdout:5/167: creat d9/d2e/d29/f36 x:0 0 0 2024-04-18T21:06:57.881 INFO:tasks.workunit.client.0.smithi078.stdout:3/121: write d4/f18 [1030645,2782] 0 2024-04-18T21:06:57.882 INFO:tasks.workunit.client.0.smithi078.stdout:2/128: write d0/d1f/f2b [793636,38101] 0 2024-04-18T21:06:57.882 INFO:tasks.workunit.client.0.smithi078.stdout:8/112: truncate d0/f18 8626335 0 2024-04-18T21:06:57.883 INFO:tasks.workunit.client.0.smithi078.stdout:9/139: write d7/df/f13 [5333821,76071] 0 2024-04-18T21:06:57.884 INFO:tasks.workunit.client.0.smithi078.stdout:7/162: symlink d1/d16/d1c/l3e 0 2024-04-18T21:06:57.885 INFO:tasks.workunit.client.0.smithi078.stdout:0/172: truncate d0/f5 3488244 0 2024-04-18T21:06:57.885 INFO:tasks.workunit.client.0.smithi078.stdout:7/163: write d1/d16/f26 [121013,80156] 0 2024-04-18T21:06:57.886 INFO:tasks.workunit.client.0.smithi078.stdout:8/113: chown d0/d10/c1d 9167292 1 2024-04-18T21:06:57.886 INFO:tasks.workunit.client.0.smithi078.stdout:5/168: mknod d9/c37 0 2024-04-18T21:06:57.886 INFO:tasks.workunit.client.0.smithi078.stdout:9/140: mknod d7/d11/d1b/c36 0 2024-04-18T21:06:57.886 INFO:tasks.workunit.client.0.smithi078.stdout:2/129: creat d0/db/d18/d21/d27/d29/f2d x:0 0 0 2024-04-18T21:06:57.886 INFO:tasks.workunit.client.0.smithi078.stdout:8/114: chown d0/l1a 5695608 1 2024-04-18T21:06:57.887 INFO:tasks.workunit.client.0.smithi078.stdout:0/173: stat d0/d9/dd/d17/l22 0 2024-04-18T21:06:57.887 INFO:tasks.workunit.client.0.smithi078.stdout:5/169: chown d9/da/f1b 5 1 2024-04-18T21:06:57.887 INFO:tasks.workunit.client.0.smithi078.stdout:9/141: chown d7/d11/d2d/l27 0 1 2024-04-18T21:06:57.887 INFO:tasks.workunit.client.0.smithi078.stdout:8/115: write d0/f6 [3749439,108072] 0 2024-04-18T21:06:57.888 INFO:tasks.workunit.client.0.smithi078.stdout:7/164: rename d1/d16/ff to d1/d28/f3f 0 2024-04-18T21:06:57.888 INFO:tasks.workunit.client.0.smithi078.stdout:0/174: fsync d0/d9/da/db/f2c 0 2024-04-18T21:06:57.888 INFO:tasks.workunit.client.0.smithi078.stdout:2/130: stat d0/db/f12 0 2024-04-18T21:06:57.888 INFO:tasks.workunit.client.0.smithi078.stdout:5/170: rename d9/d2e/d29/l2c to d9/d2e/l38 0 2024-04-18T21:06:57.888 INFO:tasks.workunit.client.0.smithi078.stdout:7/165: write d1/f3c [700201,34608] 0 2024-04-18T21:06:57.889 INFO:tasks.workunit.client.0.smithi078.stdout:0/175: stat d0/d9/da/l1c 0 2024-04-18T21:06:57.889 INFO:tasks.workunit.client.0.smithi078.stdout:5/171: mknod d9/da/c39 0 2024-04-18T21:06:57.889 INFO:tasks.workunit.client.0.smithi078.stdout:7/166: dread - d1/d16/d10/f1a zero size 2024-04-18T21:06:57.890 INFO:tasks.workunit.client.0.smithi078.stdout:9/142: rename d7/d11/f33 to d7/f37 0 2024-04-18T21:06:57.890 INFO:tasks.workunit.client.0.smithi078.stdout:0/176: dread - d0/d9/da/db/f2c zero size 2024-04-18T21:06:57.890 INFO:tasks.workunit.client.0.smithi078.stdout:2/131: rmdir d0/db/d18/d21/d27/d29 39 2024-04-18T21:06:57.891 INFO:tasks.workunit.client.0.smithi078.stdout:0/177: stat d0/d9/l29 0 2024-04-18T21:06:57.891 INFO:tasks.workunit.client.0.smithi078.stdout:9/143: read d7/fa [8296893,105924] 0 2024-04-18T21:06:57.891 INFO:tasks.workunit.client.0.smithi078.stdout:7/167: mkdir d1/d16/d1c/d40 0 2024-04-18T21:06:57.892 INFO:tasks.workunit.client.0.smithi078.stdout:0/178: truncate d0/d15/f27 938801 0 2024-04-18T21:06:57.892 INFO:tasks.workunit.client.0.smithi078.stdout:7/168: fsync d1/d16/f3b 0 2024-04-18T21:06:57.893 INFO:tasks.workunit.client.0.smithi078.stdout:3/122: truncate d4/f9 2876593 0 2024-04-18T21:06:57.894 INFO:tasks.workunit.client.0.smithi078.stdout:7/169: fdatasync d1/d28/f3f 0 2024-04-18T21:06:57.894 INFO:tasks.workunit.client.0.smithi078.stdout:0/179: dread d0/d9/da/df/f25 [0,4194304] 0 2024-04-18T21:06:57.895 INFO:tasks.workunit.client.0.smithi078.stdout:7/170: fsync d1/f20 0 2024-04-18T21:06:57.895 INFO:tasks.workunit.client.0.smithi078.stdout:3/123: creat d4/df/f1f x:0 0 0 2024-04-18T21:06:57.896 INFO:tasks.workunit.client.0.smithi078.stdout:3/124: symlink d4/l20 0 2024-04-18T21:06:57.896 INFO:tasks.workunit.client.0.smithi078.stdout:7/171: write d1/d16/dc/f1e [2228360,56357] 0 2024-04-18T21:06:57.897 INFO:tasks.workunit.client.0.smithi078.stdout:9/144: dread f6 [0,4194304] 0 2024-04-18T21:06:57.897 INFO:tasks.workunit.client.0.smithi078.stdout:3/125: dread - d4/df/f1f zero size 2024-04-18T21:06:57.897 INFO:tasks.workunit.client.0.smithi078.stdout:3/126: chown d4/df 0 1 2024-04-18T21:06:57.899 INFO:tasks.workunit.client.0.smithi078.stdout:5/172: dwrite d9/f1e [0,4194304] 0 2024-04-18T21:06:57.900 INFO:tasks.workunit.client.0.smithi078.stdout:8/116: truncate d0/fb 2280179 0 2024-04-18T21:06:57.900 INFO:tasks.workunit.client.0.smithi078.stdout:2/132: truncate d0/f1d 1653126 0 2024-04-18T21:06:57.901 INFO:tasks.workunit.client.0.smithi078.stdout:5/173: fsync d9/d2e/d29/f36 0 2024-04-18T21:06:57.901 INFO:tasks.workunit.client.0.smithi078.stdout:7/172: rename d1/d28/f3f to d1/d32/f41 0 2024-04-18T21:06:57.902 INFO:tasks.workunit.client.0.smithi078.stdout:8/117: write d0/f26 [164911,9599] 0 2024-04-18T21:06:57.902 INFO:tasks.workunit.client.0.smithi078.stdout:3/127: unlink d4/da/d11/l12 0 2024-04-18T21:06:57.904 INFO:tasks.workunit.client.0.smithi078.stdout:3/128: dread - d4/df/f1f zero size 2024-04-18T21:06:57.905 INFO:tasks.workunit.client.0.smithi078.stdout:2/133: rmdir d0/db/d18/d21/d27 39 2024-04-18T21:06:57.905 INFO:tasks.workunit.client.0.smithi078.stdout:8/118: truncate d0/fd 1928967 0 2024-04-18T21:06:57.905 INFO:tasks.workunit.client.0.smithi078.stdout:3/129: stat d4/df/c1b 0 2024-04-18T21:06:57.905 INFO:tasks.workunit.client.0.smithi078.stdout:5/174: symlink d9/d2e/d29/l3a 0 2024-04-18T21:06:57.907 INFO:tasks.workunit.client.0.smithi078.stdout:8/119: rmdir d0/d10 39 2024-04-18T21:06:57.907 INFO:tasks.workunit.client.0.smithi078.stdout:4/166: dread d0/f17 [0,4194304] 0 2024-04-18T21:06:57.907 INFO:tasks.workunit.client.0.smithi078.stdout:9/145: dwrite f6 [4194304,4194304] 0 2024-04-18T21:06:57.907 INFO:tasks.workunit.client.0.smithi078.stdout:5/175: symlink d9/d2e/l3b 0 2024-04-18T21:06:57.908 INFO:tasks.workunit.client.0.smithi078.stdout:8/120: dread - d0/d22/f24 zero size 2024-04-18T21:06:57.909 INFO:tasks.workunit.client.0.smithi078.stdout:4/167: stat d0/dc/d10/f32 0 2024-04-18T21:06:57.909 INFO:tasks.workunit.client.0.smithi078.stdout:0/180: dwrite d0/d9/da/f10 [0,4194304] 0 2024-04-18T21:06:57.910 INFO:tasks.workunit.client.0.smithi078.stdout:4/168: mknod d0/dc/d29/c3f 0 2024-04-18T21:06:57.911 INFO:tasks.workunit.client.0.smithi078.stdout:2/134: dread - d0/db/d18/d21/d27/d29/f2d zero size 2024-04-18T21:06:57.911 INFO:tasks.workunit.client.0.smithi078.stdout:8/121: mknod d0/c27 0 2024-04-18T21:06:57.912 INFO:tasks.workunit.client.0.smithi078.stdout:9/146: rename d7/df/d1e/f2f to d7/d11/d2d/d26/f38 0 2024-04-18T21:06:57.913 INFO:tasks.workunit.client.0.smithi078.stdout:5/176: creat d9/f3c x:0 0 0 2024-04-18T21:06:57.913 INFO:tasks.workunit.client.0.smithi078.stdout:4/169: unlink d0/dc/d29/d2f/f34 0 2024-04-18T21:06:57.913 INFO:tasks.workunit.client.0.smithi078.stdout:5/177: fsync d9/da/f1f 0 2024-04-18T21:06:57.914 INFO:tasks.workunit.client.0.smithi078.stdout:7/173: dwrite d1/d16/dc/d11/f29 [0,4194304] 0 2024-04-18T21:06:57.914 INFO:tasks.workunit.client.0.smithi078.stdout:0/181: rename d0/d15/d21/d30 to d0/d9/dd/d17/d2e/d31 0 2024-04-18T21:06:57.914 INFO:tasks.workunit.client.0.smithi078.stdout:2/135: creat d0/f2e x:0 0 0 2024-04-18T21:06:57.915 INFO:tasks.workunit.client.0.smithi078.stdout:9/147: fsync d7/d11/d2d/d26/f2b 0 2024-04-18T21:06:57.915 INFO:tasks.workunit.client.0.smithi078.stdout:5/178: chown d9/da/l10 15404171 1 2024-04-18T21:06:57.915 INFO:tasks.workunit.client.0.smithi078.stdout:8/122: rename d0/d10/d14/c19 to d0/d10/d14/c28 0 2024-04-18T21:06:57.916 INFO:tasks.workunit.client.0.smithi078.stdout:5/179: chown d9/da/f1b 85 1 2024-04-18T21:06:57.918 INFO:tasks.workunit.client.0.smithi078.stdout:7/174: creat d1/d28/f42 x:0 0 0 2024-04-18T21:06:57.918 INFO:tasks.workunit.client.0.smithi078.stdout:9/148: creat d7/df/f39 x:0 0 0 2024-04-18T21:06:57.918 INFO:tasks.workunit.client.0.smithi078.stdout:8/123: rename d0/f18 to d0/d10/d14/f29 0 2024-04-18T21:06:57.919 INFO:tasks.workunit.client.0.smithi078.stdout:5/180: creat d9/d2e/f3d x:0 0 0 2024-04-18T21:06:57.922 INFO:tasks.workunit.client.0.smithi078.stdout:2/136: rename d0/db/d18/f26 to d0/db/d18/d21/d27/d29/f2f 0 2024-04-18T21:06:57.922 INFO:tasks.workunit.client.0.smithi078.stdout:9/149: creat d7/d11/d2d/f3a x:0 0 0 2024-04-18T21:06:57.923 INFO:tasks.workunit.client.0.smithi078.stdout:3/130: write d4/f9 [3579746,85520] 0 2024-04-18T21:06:57.924 INFO:tasks.workunit.client.0.smithi078.stdout:0/182: link d0/d9/da/l1c d0/d9/da/l32 0 2024-04-18T21:06:57.925 INFO:tasks.workunit.client.0.smithi078.stdout:7/175: getdents d1/d16/d2d 0 2024-04-18T21:06:57.926 INFO:tasks.workunit.client.0.smithi078.stdout:4/170: dwrite d0/dc/f1d [0,4194304] 0 2024-04-18T21:06:57.926 INFO:tasks.workunit.client.0.smithi078.stdout:9/150: creat d7/d11/d2d/d26/f3b x:0 0 0 2024-04-18T21:06:57.927 INFO:tasks.workunit.client.0.smithi078.stdout:0/183: getdents d0/d15 0 2024-04-18T21:06:57.928 INFO:tasks.workunit.client.0.smithi078.stdout:4/171: creat d0/dc/d10/d3a/f40 x:0 0 0 2024-04-18T21:06:57.928 INFO:tasks.workunit.client.0.smithi078.stdout:8/124: dwrite d0/f6 [0,4194304] 0 2024-04-18T21:06:57.928 INFO:tasks.workunit.client.0.smithi078.stdout:0/184: dread - d0/d9/dd/d14/f20 zero size 2024-04-18T21:06:57.929 INFO:tasks.workunit.client.0.smithi078.stdout:8/125: chown d0/f1f 59411 1 2024-04-18T21:06:57.929 INFO:tasks.workunit.client.0.smithi078.stdout:7/176: dread - d1/f1f zero size 2024-04-18T21:06:57.929 INFO:tasks.workunit.client.0.smithi078.stdout:8/126: chown d0/l9 260960564 1 2024-04-18T21:06:57.930 INFO:tasks.workunit.client.0.smithi078.stdout:8/127: mkdir d0/d10/d14/d2a 0 2024-04-18T21:06:57.930 INFO:tasks.workunit.client.0.smithi078.stdout:7/177: link d1/d16/d10/f19 d1/d28/f43 0 2024-04-18T21:06:57.931 INFO:tasks.workunit.client.0.smithi078.stdout:8/128: stat d0/d10/c23 0 2024-04-18T21:06:57.932 INFO:tasks.workunit.client.0.smithi078.stdout:8/129: chown d0/d10/c16 22671700 1 2024-04-18T21:06:57.933 INFO:tasks.workunit.client.0.smithi078.stdout:3/131: truncate d4/fd 1433374 0 2024-04-18T21:06:57.934 INFO:tasks.workunit.client.0.smithi078.stdout:4/172: truncate d0/dc/f1d 1073748 0 2024-04-18T21:06:57.934 INFO:tasks.workunit.client.0.smithi078.stdout:8/130: rename d0/l12 to d0/d10/d14/d2a/l2b 0 2024-04-18T21:06:57.934 INFO:tasks.workunit.client.0.smithi078.stdout:3/132: creat d4/da/d11/f21 x:0 0 0 2024-04-18T21:06:57.935 INFO:tasks.workunit.client.0.smithi078.stdout:4/173: dread - d0/dc/d29/f31 zero size 2024-04-18T21:06:57.936 INFO:tasks.workunit.client.0.smithi078.stdout:8/131: write d0/d10/f1c [39647,53508] 0 2024-04-18T21:06:57.936 INFO:tasks.workunit.client.0.smithi078.stdout:2/137: dwrite d0/f3 [0,4194304] 0 2024-04-18T21:06:57.936 INFO:tasks.workunit.client.0.smithi078.stdout:3/133: chown d4/da/d11/f21 1709199 1 2024-04-18T21:06:57.938 INFO:tasks.workunit.client.0.smithi078.stdout:4/174: mkdir d0/dc/d10/d41 0 2024-04-18T21:06:57.938 INFO:tasks.workunit.client.0.smithi078.stdout:8/132: unlink d0/c27 0 2024-04-18T21:06:57.938 INFO:tasks.workunit.client.0.smithi078.stdout:7/178: dwrite d1/d16/dc/d11/f24 [0,4194304] 0 2024-04-18T21:06:57.939 INFO:tasks.workunit.client.0.smithi078.stdout:2/138: mkdir d0/db/d18/d30 0 2024-04-18T21:06:57.939 INFO:tasks.workunit.client.0.smithi078.stdout:4/175: readlink d0/dc/d37/l3d 0 2024-04-18T21:06:57.939 INFO:tasks.workunit.client.0.smithi078.stdout:4/176: readlink d0/l23 0 2024-04-18T21:06:57.940 INFO:tasks.workunit.client.0.smithi078.stdout:7/179: creat d1/d16/d10/f44 x:0 0 0 2024-04-18T21:06:57.940 INFO:tasks.workunit.client.0.smithi078.stdout:8/133: truncate d0/d10/d14/f1e 1344554 0 2024-04-18T21:06:57.940 INFO:tasks.workunit.client.0.smithi078.stdout:2/139: fdatasync d0/f1d 0 2024-04-18T21:06:57.940 INFO:tasks.workunit.client.0.smithi078.stdout:4/177: read - d0/dc/d29/f31 zero size 2024-04-18T21:06:57.941 INFO:tasks.workunit.client.0.smithi078.stdout:7/180: mknod d1/d28/c45 0 2024-04-18T21:06:57.945 INFO:tasks.workunit.client.0.smithi078.stdout:3/134: getdents d4/da/d11 0 2024-04-18T21:06:57.946 INFO:tasks.workunit.client.0.smithi078.stdout:3/135: read - d4/df/f1f zero size 2024-04-18T21:06:57.946 INFO:tasks.workunit.client.0.smithi078.stdout:8/134: dwrite d0/fb [4194304,4194304] 0 2024-04-18T21:06:57.946 INFO:tasks.workunit.client.0.smithi078.stdout:3/136: write d4/f18 [316711,118057] 0 2024-04-18T21:06:57.948 INFO:tasks.workunit.client.0.smithi078.stdout:3/137: creat d4/da/d11/f22 x:0 0 0 2024-04-18T21:06:57.948 INFO:tasks.workunit.client.0.smithi078.stdout:8/135: creat d0/f2c x:0 0 0 2024-04-18T21:06:57.948 INFO:tasks.workunit.client.0.smithi078.stdout:8/136: chown d0/d10/d14/f29 14824115 1 2024-04-18T21:06:57.949 INFO:tasks.workunit.client.0.smithi078.stdout:8/137: mkdir d0/d10/d14/d2d 0 2024-04-18T21:06:57.953 INFO:tasks.workunit.client.0.smithi078.stdout:3/138: dwrite d4/f18 [0,4194304] 0 2024-04-18T21:06:57.954 INFO:tasks.workunit.client.0.smithi078.stdout:2/140: dread d0/fe [0,4194304] 0 2024-04-18T21:06:57.954 INFO:tasks.workunit.client.0.smithi078.stdout:2/141: chown d0 12 1 2024-04-18T21:06:57.959 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:57.958+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:57.960 INFO:tasks.workunit.client.0.smithi078.stdout:3/139: write d4/f13 [1352688,53626] 0 2024-04-18T21:06:57.960 INFO:tasks.workunit.client.0.smithi078.stdout:3/140: chown d4/da 47619 1 2024-04-18T21:06:57.960 INFO:tasks.workunit.client.0.smithi078.stdout:3/141: mkdir d4/da/d11/d23 0 2024-04-18T21:06:57.963 INFO:tasks.workunit.client.0.smithi078.stdout:2/142: dwrite d0/db/d18/d21/f23 [0,4194304] 0 2024-04-18T21:06:57.964 INFO:tasks.workunit.client.0.smithi078.stdout:3/142: truncate d4/f9 1774217 0 2024-04-18T21:06:57.965 INFO:tasks.workunit.client.0.smithi078.stdout:2/143: link d0/db/d18/d21/d27/d29/f2f d0/db/d18/d21/f31 0 2024-04-18T21:06:57.965 INFO:tasks.workunit.client.0.smithi078.stdout:3/143: truncate d4/df/f19 788244 0 2024-04-18T21:06:57.966 INFO:tasks.workunit.client.0.smithi078.stdout:3/144: mknod d4/df/d17/c24 0 2024-04-18T21:06:57.969 INFO:tasks.workunit.client.0.smithi078.stdout:3/145: fsync d4/f9 0 2024-04-18T21:06:57.971 INFO:tasks.workunit.client.0.smithi078.stdout:2/144: dwrite d0/f10 [0,4194304] 0 2024-04-18T21:06:57.972 INFO:tasks.workunit.client.0.smithi078.stdout:2/145: stat d0/db/d18/d21/d27/d29/f2f 0 2024-04-18T21:06:57.975 INFO:tasks.workunit.client.0.smithi078.stdout:3/146: dwrite d4/df/f19 [0,4194304] 0 2024-04-18T21:06:57.978 INFO:tasks.workunit.client.0.smithi078.stdout:3/147: creat d4/df/d17/f25 x:0 0 0 2024-04-18T21:06:57.982 INFO:tasks.workunit.client.0.smithi078.stdout:3/148: read - d4/da/d11/f22 zero size 2024-04-18T21:06:57.982 INFO:tasks.workunit.client.0.smithi078.stdout:2/146: dread d0/f3 [0,4194304] 0 2024-04-18T21:06:57.983 INFO:tasks.workunit.client.0.smithi078.stdout:3/149: chown d4/f13 2872535 1 2024-04-18T21:06:57.983 INFO:tasks.workunit.client.0.smithi078.stdout:2/147: creat d0/f32 x:0 0 0 2024-04-18T21:06:57.983 INFO:tasks.workunit.client.0.smithi078.stdout:2/148: dread - d0/db/d18/d21/d27/d29/f2d zero size 2024-04-18T21:06:57.983 INFO:tasks.workunit.client.0.smithi078.stdout:4/178: dread d0/f5 [0,4194304] 0 2024-04-18T21:06:57.983 INFO:tasks.workunit.client.0.smithi078.stdout:4/179: creat d0/dc/d10/f42 x:0 0 0 2024-04-18T21:06:57.987 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:06:57.987 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:06:57.987 INFO:tasks.workunit.client.0.smithi078.stdout:2/149: dwrite d0/db/d18/d21/d27/d29/f2f [8388608,4194304] 0 2024-04-18T21:06:57.988 INFO:tasks.workunit.client.0.smithi078.stdout:2/150: dread - d0/db/d18/d21/f2c zero size 2024-04-18T21:06:57.994 INFO:tasks.workunit.client.0.smithi078.stdout:2/151: dwrite d0/db/d18/d21/d27/d29/f2f [0,4194304] 0 2024-04-18T21:06:57.996 INFO:tasks.workunit.client.0.smithi078.stdout:2/152: mkdir d0/db/d18/d21/d27/d29/d33 0 2024-04-18T21:06:57.996 INFO:tasks.workunit.client.0.smithi078.stdout:2/153: readlink d0/db/l14 0 2024-04-18T21:06:57.997 INFO:tasks.workunit.client.0.smithi078.stdout:2/154: truncate d0/f32 182627 0 2024-04-18T21:06:57.998 INFO:tasks.workunit.client.0.smithi078.stdout:4/180: dread d0/dc/d29/d2f/f39 [0,4194304] 0 2024-04-18T21:06:57.998 INFO:tasks.workunit.client.0.smithi078.stdout:2/155: mkdir d0/d1f/d34 0 2024-04-18T21:06:57.998 INFO:tasks.workunit.client.0.smithi078.stdout:4/181: stat d0/dc/d37 0 2024-04-18T21:06:57.998 INFO:tasks.workunit.client.0.smithi078.stdout:4/182: fdatasync d0/f17 0 2024-04-18T21:06:57.999 INFO:tasks.workunit.client.0.smithi078.stdout:2/156: mknod d0/db/d18/d21/d27/d29/c35 0 2024-04-18T21:06:57.999 INFO:tasks.workunit.client.0.smithi078.stdout:4/183: write d0/f5 [3293051,64946] 0 2024-04-18T21:06:58.000 INFO:tasks.workunit.client.0.smithi078.stdout:2/157: write d0/db/f16 [1020748,120130] 0 2024-04-18T21:06:58.001 INFO:tasks.workunit.client.0.smithi078.stdout:4/184: truncate d0/dc/d10/d1c/f36 3367004 0 2024-04-18T21:06:58.002 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:58.003 INFO:tasks.workunit.client.0.smithi078.stdout:4/185: rename d0/dc/d10/l1f to d0/dc/d29/d2f/l43 0 2024-04-18T21:06:58.003 INFO:tasks.workunit.client.0.smithi078.stdout:4/186: write d0/dc/d29/f31 [646710,4483] 0 2024-04-18T21:06:58.003 INFO:tasks.workunit.client.0.smithi078.stdout:4/187: creat d0/dc/d29/f44 x:0 0 0 2024-04-18T21:06:58.004 INFO:tasks.workunit.client.0.smithi078.stdout:4/188: write d0/f5 [1025490,16488] 0 2024-04-18T21:06:58.005 INFO:tasks.workunit.client.0.smithi078.stdout:4/189: stat d0/dc/c3e 0 2024-04-18T21:06:58.005 INFO:tasks.workunit.client.0.smithi078.stdout:1/191: sync 2024-04-18T21:06:58.006 INFO:tasks.workunit.client.0.smithi078.stdout:2/158: dwrite d0/db/d18/d21/f31 [4194304,4194304] 0 2024-04-18T21:06:58.006 INFO:tasks.workunit.client.0.smithi078.stdout:4/190: creat d0/dc/d10/d41/f45 x:0 0 0 2024-04-18T21:06:58.007 INFO:tasks.workunit.client.0.smithi078.stdout:2/159: chown d0/db/d18/d21/c22 501706091 1 2024-04-18T21:06:58.008 INFO:tasks.workunit.client.0.smithi078.stdout:2/160: chown d0/l25 626059023 1 2024-04-18T21:06:58.009 INFO:tasks.workunit.client.0.smithi078.stdout:2/161: chown d0/db/d18/d21/d27/d29/c35 21 1 2024-04-18T21:06:58.010 INFO:tasks.workunit.client.0.smithi078.stdout:2/162: write d0/fe [2433586,422] 0 2024-04-18T21:06:58.015 INFO:tasks.workunit.client.0.smithi078.stdout:4/191: dwrite d0/dc/d10/f42 [0,4194304] 0 2024-04-18T21:06:58.018 INFO:tasks.workunit.client.0.smithi078.stdout:2/163: dwrite d0/f3 [4194304,4194304] 0 2024-04-18T21:06:58.029 INFO:tasks.workunit.client.0.smithi078.stdout:4/192: getdents d0/dc/d10 0 2024-04-18T21:06:58.030 INFO:tasks.workunit.client.0.smithi078.stdout:2/164: getdents d0/db/d18/d21 0 2024-04-18T21:06:58.031 INFO:tasks.workunit.client.0.smithi078.stdout:4/193: write d0/dc/d29/d2f/f35 [124135,75129] 0 2024-04-18T21:06:58.031 INFO:tasks.workunit.client.0.smithi078.stdout:4/194: readlink d0/l23 0 2024-04-18T21:06:58.031 INFO:tasks.workunit.client.0.smithi078.stdout:4/195: chown d0/dc/cb 1464 1 2024-04-18T21:06:58.032 INFO:tasks.workunit.client.0.smithi078.stdout:4/196: readlink d0/dc/d10/d1c/l27 0 2024-04-18T21:06:58.033 INFO:tasks.workunit.client.0.smithi078.stdout:4/197: unlink d0/l23 0 2024-04-18T21:06:58.034 INFO:tasks.workunit.client.0.smithi078.stdout:4/198: write d0/dc/f1d [1456898,34437] 0 2024-04-18T21:06:58.035 INFO:tasks.workunit.client.0.smithi078.stdout:4/199: truncate d0/f7 2550479 0 2024-04-18T21:06:58.036 INFO:tasks.workunit.client.0.smithi078.stdout:2/165: dwrite d0/db/f12 [0,4194304] 0 2024-04-18T21:06:58.037 INFO:tasks.workunit.client.0.smithi078.stdout:2/166: write d0/fe [2776183,78887] 0 2024-04-18T21:06:58.037 INFO:tasks.workunit.client.0.smithi078.stdout:2/167: readlink d0/l17 0 2024-04-18T21:06:58.038 INFO:tasks.workunit.client.0.smithi078.stdout:2/168: dread - d0/db/d18/d21/f2c zero size 2024-04-18T21:06:58.039 INFO:tasks.workunit.client.0.smithi078.stdout:2/169: write d0/db/d18/d21/d27/d29/f2f [1039380,87310] 0 2024-04-18T21:06:58.040 INFO:tasks.workunit.client.0.smithi078.stdout:2/170: rmdir d0/db/d18/d21 39 2024-04-18T21:06:58.043 INFO:tasks.workunit.client.0.smithi078.stdout:4/200: dwrite d0/dc/f1d [0,4194304] 0 2024-04-18T21:06:58.044 INFO:tasks.workunit.client.0.smithi078.stdout:4/201: write d0/dc/d10/f42 [2638085,115422] 0 2024-04-18T21:06:58.046 INFO:tasks.workunit.client.0.smithi078.stdout:4/202: mknod d0/dc/d10/d3a/c46 0 2024-04-18T21:06:58.046 INFO:tasks.workunit.client.0.smithi078.stdout:1/192: dread d0/d11/f2e [0,4194304] 0 2024-04-18T21:06:58.047 INFO:tasks.workunit.client.0.smithi078.stdout:4/203: creat d0/f47 x:0 0 0 2024-04-18T21:06:58.047 INFO:tasks.workunit.client.0.smithi078.stdout:1/193: getdents d0/d46 0 2024-04-18T21:06:58.048 INFO:tasks.workunit.client.0.smithi078.stdout:4/204: creat d0/f48 x:0 0 0 2024-04-18T21:06:58.051 INFO:tasks.workunit.client.0.smithi078.stdout:4/205: dread d0/f5 [0,4194304] 0 2024-04-18T21:06:58.052 INFO:tasks.workunit.client.0.smithi078.stdout:4/206: creat d0/dc/d29/d2f/f49 x:0 0 0 2024-04-18T21:06:58.053 INFO:tasks.workunit.client.0.smithi078.stdout:4/207: creat d0/dc/d10/d41/f4a x:0 0 0 2024-04-18T21:06:58.053 INFO:tasks.workunit.client.0.smithi078.stdout:4/208: dread - d0/dc/d10/d41/f45 zero size 2024-04-18T21:06:58.054 INFO:tasks.workunit.client.0.smithi078.stdout:4/209: mknod d0/dc/d29/d2f/c4b 0 2024-04-18T21:06:58.054 INFO:tasks.workunit.client.0.smithi078.stdout:4/210: rmdir d0/dc/d10 39 2024-04-18T21:06:58.060 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:58.062+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:58.061 INFO:tasks.workunit.client.0.smithi078.stdout:4/211: dread d0/f28 [0,4194304] 0 2024-04-18T21:06:58.065 INFO:tasks.workunit.client.0.smithi078.stdout:6/123: sync 2024-04-18T21:06:58.067 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:06:58.068 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:06:58.068 INFO:teuthology.orchestra.run.smithi078.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-18T21:06:58.070 INFO:tasks.workunit.client.0.smithi078.stdout:2/171: truncate d0/db/f12 2236948 0 2024-04-18T21:06:58.071 INFO:tasks.workunit.client.0.smithi078.stdout:4/212: link d0/dc/d29/d2f/f39 d0/dc/d29/f4c 0 2024-04-18T21:06:58.072 INFO:tasks.workunit.client.0.smithi078.stdout:2/172: fdatasync d0/db/d18/d21/d27/d29/f2d 0 2024-04-18T21:06:58.072 INFO:tasks.workunit.client.0.smithi078.stdout:4/213: symlink d0/dc/l4d 0 2024-04-18T21:06:58.073 INFO:tasks.workunit.client.0.smithi078.stdout:4/214: read - d0/f48 zero size 2024-04-18T21:06:58.073 INFO:tasks.workunit.client.0.smithi078.stdout:6/124: dwrite d2/d1c/f1d [0,4194304] 0 2024-04-18T21:06:58.073 INFO:tasks.workunit.client.0.smithi078.stdout:4/215: readlink d0/dc/l15 0 2024-04-18T21:06:58.073 INFO:tasks.workunit.client.0.smithi078.stdout:2/173: creat d0/db/f36 x:0 0 0 2024-04-18T21:06:58.074 INFO:tasks.workunit.client.0.smithi078.stdout:4/216: dread - d0/f47 zero size 2024-04-18T21:06:58.074 INFO:tasks.workunit.client.0.smithi078.stdout:2/174: truncate d0/f32 1056003 0 2024-04-18T21:06:58.074 INFO:tasks.workunit.client.0.smithi078.stdout:6/125: creat d2/d1f/f2e x:0 0 0 2024-04-18T21:06:58.075 INFO:tasks.workunit.client.0.smithi078.stdout:2/175: write d0/f5 [4777217,92188] 0 2024-04-18T21:06:58.075 INFO:tasks.workunit.client.0.smithi078.stdout:6/126: symlink d2/d1f/l2f 0 2024-04-18T21:06:58.075 INFO:tasks.workunit.client.0.smithi078.stdout:6/127: write d2/d1c/f20 [4131750,83352] 0 2024-04-18T21:06:58.077 INFO:tasks.workunit.client.0.smithi078.stdout:1/194: dread d0/d1/d4/fc [0,4194304] 0 2024-04-18T21:06:58.078 INFO:tasks.workunit.client.0.smithi078.stdout:6/128: fsync d2/d1f/f2e 0 2024-04-18T21:06:58.080 INFO:tasks.workunit.client.0.smithi078.stdout:2/176: dwrite d0/db/d18/d21/f2c [0,4194304] 0 2024-04-18T21:06:58.081 INFO:tasks.workunit.client.0.smithi078.stdout:2/177: chown d0/db/d18/d21 437987600 1 2024-04-18T21:06:58.083 INFO:tasks.workunit.client.0.smithi078.stdout:2/178: dread d0/db/f12 [0,4194304] 0 2024-04-18T21:06:58.089 INFO:tasks.workunit.client.0.smithi078.stdout:2/179: dwrite d0/db/d18/d21/d27/d29/f2f [12582912,4194304] 0 2024-04-18T21:06:58.095 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:06:58.095 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:06:58.097 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-18T21:06:58.098 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-18T21:06:58.120 INFO:tasks.workunit.client.0.smithi078.stdout:1/195: dread d0/d11/f22 [0,4194304] 0 2024-04-18T21:06:58.121 INFO:tasks.workunit.client.0.smithi078.stdout:1/196: symlink d0/d11/l47 0 2024-04-18T21:06:58.121 INFO:tasks.workunit.client.0.smithi078.stdout:1/197: chown d0/d1/d4/f28 274192641 1 2024-04-18T21:06:58.122 INFO:tasks.workunit.client.0.smithi078.stdout:1/198: fdatasync d0/d11/f22 0 2024-04-18T21:06:58.122 INFO:tasks.workunit.client.0.smithi078.stdout:1/199: chown d0/d2a/d2f/f44 996639 1 2024-04-18T21:06:58.122 INFO:tasks.workunit.client.0.smithi078.stdout:1/200: fsync d0/d1/f3e 0 2024-04-18T21:06:58.123 INFO:tasks.workunit.client.0.smithi078.stdout:1/201: fdatasync d0/d1/f24 0 2024-04-18T21:06:58.129 INFO:tasks.workunit.client.0.smithi078.stdout:2/180: dread d0/db/f16 [0,4194304] 0 2024-04-18T21:06:58.131 INFO:tasks.workunit.client.0.smithi078.stdout:1/202: dwrite d0/d46/f17 [0,4194304] 0 2024-04-18T21:06:58.131 INFO:tasks.workunit.client.0.smithi078.stdout:1/203: readlink d0/d1/l14 0 2024-04-18T21:06:58.132 INFO:tasks.workunit.client.0.smithi078.stdout:1/204: rename d0/d1/l14 to d0/d46/d32/d35/l48 0 2024-04-18T21:06:58.133 INFO:tasks.workunit.client.0.smithi078.stdout:2/181: dread d0/db/d18/d21/f2c [0,4194304] 0 2024-04-18T21:06:58.133 INFO:tasks.workunit.client.0.smithi078.stdout:1/205: truncate d0/d11/f18 994730 0 2024-04-18T21:06:58.134 INFO:tasks.workunit.client.0.smithi078.stdout:2/182: unlink d0/l25 0 2024-04-18T21:06:58.134 INFO:tasks.workunit.client.0.smithi078.stdout:2/183: readlink d0/d1f/l28 0 2024-04-18T21:06:58.134 INFO:tasks.workunit.client.0.smithi078.stdout:1/206: creat d0/d46/f49 x:0 0 0 2024-04-18T21:06:58.134 INFO:tasks.workunit.client.0.smithi078.stdout:2/184: fdatasync d0/fe 0 2024-04-18T21:06:58.136 INFO:tasks.workunit.client.0.smithi078.stdout:5/181: sync 2024-04-18T21:06:58.138 INFO:tasks.workunit.client.0.smithi078.stdout:2/185: dread d0/db/d18/d21/f2c [0,4194304] 0 2024-04-18T21:06:58.140 INFO:tasks.workunit.client.0.smithi078.stdout:1/207: dwrite d0/d46/f2c [4194304,4194304] 0 2024-04-18T21:06:58.141 INFO:tasks.workunit.client.0.smithi078.stdout:5/182: dwrite d9/da/f35 [0,4194304] 0 2024-04-18T21:06:58.142 INFO:tasks.workunit.client.0.smithi078.stdout:1/208: rmdir d0/d11 39 2024-04-18T21:06:58.142 INFO:tasks.workunit.client.0.smithi078.stdout:5/183: mkdir d9/da/d3e 0 2024-04-18T21:06:58.143 INFO:tasks.workunit.client.0.smithi078.stdout:1/209: write d0/f3f [286171,70615] 0 2024-04-18T21:06:58.143 INFO:tasks.workunit.client.0.smithi078.stdout:5/184: dread - d9/d2e/d29/f36 zero size 2024-04-18T21:06:58.144 INFO:tasks.workunit.client.0.smithi078.stdout:1/210: write d0/d46/f17 [4240099,127897] 0 2024-04-18T21:06:58.144 INFO:tasks.workunit.client.0.smithi078.stdout:2/186: dwrite d0/f5 [0,4194304] 0 2024-04-18T21:06:58.145 INFO:tasks.workunit.client.0.smithi078.stdout:1/211: symlink d0/d2a/d3c/l4a 0 2024-04-18T21:06:58.146 INFO:tasks.workunit.client.0.smithi078.stdout:1/212: fdatasync d0/d11/f2d 0 2024-04-18T21:06:58.147 INFO:tasks.workunit.client.0.smithi078.stdout:1/213: write d0/d11/f2d [811585,17427] 0 2024-04-18T21:06:58.149 INFO:tasks.workunit.client.0.smithi078.stdout:1/214: write d0/d2a/d2f/f44 [128443,68495] 0 2024-04-18T21:06:58.150 INFO:tasks.workunit.client.0.smithi078.stdout:1/215: readlink d0/la 0 2024-04-18T21:06:58.150 INFO:tasks.workunit.client.0.smithi078.stdout:5/185: dwrite d9/d2e/f23 [0,4194304] 0 2024-04-18T21:06:58.151 INFO:tasks.workunit.client.0.smithi078.stdout:1/216: rename d0/d1 to d0/d2a/d3c/d4b 0 2024-04-18T21:06:58.152 INFO:tasks.workunit.client.0.smithi078.stdout:1/217: dread - d0/d2a/d3c/d4b/f3e zero size 2024-04-18T21:06:58.152 INFO:tasks.workunit.client.0.smithi078.stdout:2/187: dwrite d0/db/f16 [0,4194304] 0 2024-04-18T21:06:58.154 INFO:tasks.workunit.client.0.smithi078.stdout:2/188: creat d0/db/d18/f37 x:0 0 0 2024-04-18T21:06:58.155 INFO:tasks.workunit.client.0.smithi078.stdout:2/189: rename d0/db/l14 to d0/db/d18/d21/d27/l38 0 2024-04-18T21:06:58.157 INFO:tasks.workunit.client.0.smithi078.stdout:2/190: unlink d0/db/d18/f37 0 2024-04-18T21:06:58.157 INFO:tasks.workunit.client.0.smithi078.stdout:5/186: dwrite d9/d2e/d29/f33 [0,4194304] 0 2024-04-18T21:06:58.157 INFO:tasks.workunit.client.0.smithi078.stdout:2/191: readlink d0/d1f/l28 0 2024-04-18T21:06:58.159 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:58.159 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 20, 2024-04-18T21:06:58.159 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 600, 2024-04-18T21:06:58.159 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [ 2024-04-18T21:06:58.159 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.159 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:58.159 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:06:58.159 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 123.240550336, 2024-04-18T21:06:58.159 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.02518273, 2024-04-18T21:06:58.160 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:58.160 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:58.160 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.160 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:58.160 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:58.160 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:58.160 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 141 2024-04-18T21:06:58.160 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.160 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:58.160 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.160 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:58.160 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:06:58.160 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:58.161 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.161 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.161 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:58.161 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911561+0000", 2024-04-18T21:06:58.161 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:58.161 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.161 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.161 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:58.161 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911562+0000", 2024-04-18T21:06:58.161 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9300000000000006e-07 2024-04-18T21:06:58.161 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.161 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.161 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:58.161 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911569+0000", 2024-04-18T21:06:58.162 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0169999999999999e-06 2024-04-18T21:06:58.162 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.162 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.162 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:58.162 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911582+0000", 2024-04-18T21:06:58.162 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.343e-05 2024-04-18T21:06:58.162 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.162 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.162 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.162 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.911590+0000", 2024-04-18T21:06:58.162 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.413e-06 2024-04-18T21:06:58.162 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.162 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.162 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:58.162 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.933922+0000", 2024-04-18T21:06:58.163 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.022332093000000001 2024-04-18T21:06:58.163 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.163 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.163 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:58.163 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.934155+0000", 2024-04-18T21:06:58.163 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023378900000000001 2024-04-18T21:06:58.163 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.163 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.163 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:58.163 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.934514+0000", 2024-04-18T21:06:58.163 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00035859200000000003 2024-04-18T21:06:58.163 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.163 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.163 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:58.163 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.935973+0000", 2024-04-18T21:06:58.163 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001458705 2024-04-18T21:06:58.164 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.164 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.164 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.164 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936488+0000", 2024-04-18T21:06:58.164 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00051550000000000001 2024-04-18T21:06:58.164 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.164 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.164 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:58.164 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936636+0000", 2024-04-18T21:06:58.164 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014779800000000001 2024-04-18T21:06:58.164 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.164 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.164 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:58.164 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:54.936743+0000", 2024-04-18T21:06:58.164 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010739999999999999 2024-04-18T21:06:58.165 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:58.165 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:58.165 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:58.165 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.165 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.165 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:58.165 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:58.165 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 123.12331713, 2024-04-18T21:06:58.165 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023864586, 2024-04-18T21:06:58.165 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:58.165 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:58.165 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.165 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:58.165 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:58.166 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:58.166 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 164 2024-04-18T21:06:58.166 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.166 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:58.166 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.166 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:58.166 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:58.166 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:58.166 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.166 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.166 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:58.166 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028794+0000", 2024-04-18T21:06:58.166 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:58.167 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.167 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.167 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:58.167 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028795+0000", 2024-04-18T21:06:58.167 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7999999999999995e-07 2024-04-18T21:06:58.167 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.167 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.167 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:58.167 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028884+0000", 2024-04-18T21:06:58.167 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8997000000000002e-05 2024-04-18T21:06:58.167 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.167 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.167 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:58.167 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028895+0000", 2024-04-18T21:06:58.167 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1647e-05 2024-04-18T21:06:58.167 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.168 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.168 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.168 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028903+0000", 2024-04-18T21:06:58.168 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.909e-06 2024-04-18T21:06:58.168 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.168 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.168 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:58.168 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.047818+0000", 2024-04-18T21:06:58.168 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018914337 2024-04-18T21:06:58.168 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.168 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.168 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:58.168 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.048094+0000", 2024-04-18T21:06:58.168 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00027653500000000001 2024-04-18T21:06:58.168 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.168 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.169 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:58.169 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.048471+0000", 2024-04-18T21:06:58.169 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00037705799999999999 2024-04-18T21:06:58.169 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.169 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.169 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.169 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052516+0000", 2024-04-18T21:06:58.169 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0040452739999999997 2024-04-18T21:06:58.169 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.169 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.169 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:58.169 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052535+0000", 2024-04-18T21:06:58.169 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.84e-05 2024-04-18T21:06:58.169 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.169 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.169 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:58.170 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052603+0000", 2024-04-18T21:06:58.170 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.8095000000000004e-05 2024-04-18T21:06:58.170 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.170 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.170 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:58.170 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052659+0000", 2024-04-18T21:06:58.170 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5653999999999999e-05 2024-04-18T21:06:58.170 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:58.170 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:58.170 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:58.170 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.170 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.170 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:58.170 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:58.170 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 123.123193687, 2024-04-18T21:06:58.171 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024516458000000001, 2024-04-18T21:06:58.171 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:58.171 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:58.171 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.171 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:58.171 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:58.171 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:58.171 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 165 2024-04-18T21:06:58.171 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.171 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:58.171 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.171 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:58.171 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:58.171 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:58.172 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.172 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.172 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:58.172 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028917+0000", 2024-04-18T21:06:58.172 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:58.172 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.172 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.172 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:58.172 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028918+0000", 2024-04-18T21:06:58.172 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8000000000000005e-07 2024-04-18T21:06:58.172 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.172 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.172 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:58.173 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028924+0000", 2024-04-18T21:06:58.173 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5659999999999997e-06 2024-04-18T21:06:58.173 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.173 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.173 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:58.173 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028933+0000", 2024-04-18T21:06:58.173 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.38e-06 2024-04-18T21:06:58.173 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.173 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.173 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.173 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.028940+0000", 2024-04-18T21:06:58.173 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0060000000000003e-06 2024-04-18T21:06:58.173 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.173 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.173 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:58.174 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.050846+0000", 2024-04-18T21:06:58.174 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021906119000000002 2024-04-18T21:06:58.174 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.174 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.174 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:58.174 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051025+0000", 2024-04-18T21:06:58.174 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017850799999999999 2024-04-18T21:06:58.174 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.174 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.174 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:58.174 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.051221+0000", 2024-04-18T21:06:58.174 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019608700000000001 2024-04-18T21:06:58.174 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.174 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.174 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:58.175 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.052675+0000", 2024-04-18T21:06:58.175 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0014537899999999999 2024-04-18T21:06:58.175 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.175 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.175 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.175 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053311+0000", 2024-04-18T21:06:58.175 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00063613299999999999 2024-04-18T21:06:58.175 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.175 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.175 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:58.175 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053381+0000", 2024-04-18T21:06:58.175 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0074999999999996e-05 2024-04-18T21:06:58.175 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.176 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.176 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:58.176 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.053434+0000", 2024-04-18T21:06:58.176 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3013999999999998e-05 2024-04-18T21:06:58.176 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:58.176 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:58.176 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:58.176 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.176 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.176 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:58.176 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:58.176 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 123.00988820800001, 2024-04-18T21:06:58.176 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023772793, 2024-04-18T21:06:58.177 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:58.177 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:58.177 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.177 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:58.177 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:58.177 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:58.177 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 187 2024-04-18T21:06:58.177 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.177 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:58.177 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.177 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:58.177 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:58.177 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:58.177 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.177 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.178 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:58.178 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142223+0000", 2024-04-18T21:06:58.178 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:58.178 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.178 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.178 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:58.178 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142224+0000", 2024-04-18T21:06:58.178 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.47e-07 2024-04-18T21:06:58.178 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.178 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.178 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:58.178 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142233+0000", 2024-04-18T21:06:58.178 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0729999999999994e-06 2024-04-18T21:06:58.178 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.179 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.179 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:58.179 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142255+0000", 2024-04-18T21:06:58.179 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.2535999999999999e-05 2024-04-18T21:06:58.179 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.179 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.179 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.179 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142268+0000", 2024-04-18T21:06:58.179 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2686e-05 2024-04-18T21:06:58.179 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.179 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.179 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:58.179 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160497+0000", 2024-04-18T21:06:58.179 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018228779000000001 2024-04-18T21:06:58.179 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.180 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.180 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:58.180 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160634+0000", 2024-04-18T21:06:58.180 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000137315 2024-04-18T21:06:58.180 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.180 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.180 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:58.180 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.160831+0000", 2024-04-18T21:06:58.180 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019683100000000001 2024-04-18T21:06:58.180 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.180 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.180 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.180 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165129+0000", 2024-04-18T21:06:58.180 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0042981299999999998 2024-04-18T21:06:58.180 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.180 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.181 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:58.181 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165776+0000", 2024-04-18T21:06:58.181 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00064702900000000003 2024-04-18T21:06:58.181 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.181 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.181 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:58.181 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165921+0000", 2024-04-18T21:06:58.181 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014506 2024-04-18T21:06:58.181 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.181 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.181 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:58.181 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165996+0000", 2024-04-18T21:06:58.181 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.4406999999999994e-05 2024-04-18T21:06:58.181 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:58.181 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:58.182 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:58.182 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.182 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.182 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:58.182 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:58.182 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 123.00982761, 2024-04-18T21:06:58.182 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026802157, 2024-04-18T21:06:58.182 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:58.182 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:58.182 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.182 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:58.182 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:58.182 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:58.182 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 188 2024-04-18T21:06:58.182 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.183 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:58.183 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.183 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:58.183 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:58.183 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:58.183 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.183 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.183 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:58.183 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142283+0000", 2024-04-18T21:06:58.183 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:58.183 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.183 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.183 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:58.183 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142284+0000", 2024-04-18T21:06:58.183 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4e-07 2024-04-18T21:06:58.184 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.184 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.184 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:58.184 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142374+0000", 2024-04-18T21:06:58.184 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0099999999999995e-05 2024-04-18T21:06:58.184 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.184 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.184 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:58.184 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142386+0000", 2024-04-18T21:06:58.184 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1770000000000001e-05 2024-04-18T21:06:58.184 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.184 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.184 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.184 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142394+0000", 2024-04-18T21:06:58.185 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.2130000000000008e-06 2024-04-18T21:06:58.185 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.185 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.185 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:58.185 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.161743+0000", 2024-04-18T21:06:58.185 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019348644000000002 2024-04-18T21:06:58.185 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.185 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.185 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:58.185 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.161865+0000", 2024-04-18T21:06:58.185 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012210899999999999 2024-04-18T21:06:58.185 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.185 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.185 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:58.186 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.162055+0000", 2024-04-18T21:06:58.186 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000189994 2024-04-18T21:06:58.186 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.186 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.186 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.186 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.165735+0000", 2024-04-18T21:06:58.186 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0036803270000000002 2024-04-18T21:06:58.186 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.186 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.186 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:58.186 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.168911+0000", 2024-04-18T21:06:58.186 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0031753689999999999 2024-04-18T21:06:58.186 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.187 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.187 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:58.187 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169012+0000", 2024-04-18T21:06:58.187 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010157699999999999 2024-04-18T21:06:58.187 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.187 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.187 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:58.187 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169086+0000", 2024-04-18T21:06:58.187 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3213999999999994e-05 2024-04-18T21:06:58.187 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:58.187 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:58.187 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:58.187 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.187 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.188 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4142.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-18T21:06:58.188 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:58.188 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 123.009702304, 2024-04-18T21:06:58.188 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026811423000000001, 2024-04-18T21:06:58.188 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:58.188 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:58.188 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.188 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:58.188 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4142", 2024-04-18T21:06:58.188 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "172.21.15.78:0/1530874597", 2024-04-18T21:06:58.188 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 189 2024-04-18T21:06:58.188 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.188 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:58.188 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.188 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:58.188 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:58.189 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:58.189 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.189 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.189 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:58.189 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142409+0000", 2024-04-18T21:06:58.189 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:58.189 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.189 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.189 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:58.189 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142410+0000", 2024-04-18T21:06:58.189 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.1299999999999998e-07 2024-04-18T21:06:58.189 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.189 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.189 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:58.189 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142415+0000", 2024-04-18T21:06:58.190 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.7939999999999999e-06 2024-04-18T21:06:58.190 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.190 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.190 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:58.190 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142470+0000", 2024-04-18T21:06:58.190 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4537999999999999e-05 2024-04-18T21:06:58.190 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.190 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.190 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.190 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.142481+0000", 2024-04-18T21:06:58.190 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0966e-05 2024-04-18T21:06:58.190 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.190 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.191 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:58.191 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.163493+0000", 2024-04-18T21:06:58.191 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021012444000000002 2024-04-18T21:06:58.191 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.191 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.191 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:58.191 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.163727+0000", 2024-04-18T21:06:58.191 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000233339 2024-04-18T21:06:58.191 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.191 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.192 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:58.192 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.164102+0000", 2024-04-18T21:06:58.192 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000374872 2024-04-18T21:06:58.192 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.192 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.192 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.192 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.166528+0000", 2024-04-18T21:06:58.192 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0024258729999999998 2024-04-18T21:06:58.192 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.192 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.192 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:58.192 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169101+0000", 2024-04-18T21:06:58.192 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0025737680000000001 2024-04-18T21:06:58.192 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.192 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.192 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:58.193 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169171+0000", 2024-04-18T21:06:58.193 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0148000000000007e-05 2024-04-18T21:06:58.193 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.193 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.193 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:58.193 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:04:55.169220+0000", 2024-04-18T21:06:58.193 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8767999999999998e-05 2024-04-18T21:06:58.193 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:58.193 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:58.193 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:58.193 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.193 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.193 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:58.193 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:58.193 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 112.53612975199999, 2024-04-18T21:06:58.194 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024082777999999999, 2024-04-18T21:06:58.194 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:58.194 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:58.194 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.194 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:58.194 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.194 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:58.194 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:58.194 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:58.194 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.194 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.194 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:58.194 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615981+0000", 2024-04-18T21:06:58.194 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:58.195 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.195 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.195 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:58.195 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615984+0000", 2024-04-18T21:06:58.195 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.9869999999999999e-06 2024-04-18T21:06:58.195 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.195 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.195 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:58.195 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.615999+0000", 2024-04-18T21:06:58.195 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4646e-05 2024-04-18T21:06:58.195 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.195 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.195 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:58.195 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616028+0000", 2024-04-18T21:06:58.195 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8952999999999999e-05 2024-04-18T21:06:58.195 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.196 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.196 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.196 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616052+0000", 2024-04-18T21:06:58.196 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.3941999999999999e-05 2024-04-18T21:06:58.196 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.196 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.196 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:58.196 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618010+0000", 2024-04-18T21:06:58.196 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0019581780000000001 2024-04-18T21:06:58.196 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.196 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.196 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:58.196 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618322+0000", 2024-04-18T21:06:58.196 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00031158899999999997 2024-04-18T21:06:58.196 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.197 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.197 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:58.197 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.618587+0000", 2024-04-18T21:06:58.197 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00026495700000000002 2024-04-18T21:06:58.197 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.197 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.197 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:58.197 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629262+0000", 2024-04-18T21:06:58.197 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010675877 2024-04-18T21:06:58.197 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.197 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.197 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.197 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.639773+0000", 2024-04-18T21:06:58.197 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0105109 2024-04-18T21:06:58.197 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.198 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.198 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:58.198 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.639926+0000", 2024-04-18T21:06:58.198 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000152349 2024-04-18T21:06:58.198 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.198 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.198 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:58.198 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640064+0000", 2024-04-18T21:06:58.198 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0001384 2024-04-18T21:06:58.198 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:58.198 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:58.198 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:58.198 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.198 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.198 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:58.199 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:58.199 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 112.536017078, 2024-04-18T21:06:58.199 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030215005999999999, 2024-04-18T21:06:58.199 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:58.199 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:58.199 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.199 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:58.199 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.199 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:58.199 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:58.199 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:58.199 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.199 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.199 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:58.199 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616094+0000", 2024-04-18T21:06:58.199 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:58.200 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.200 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.200 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:58.200 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616095+0000", 2024-04-18T21:06:58.200 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.446e-06 2024-04-18T21:06:58.200 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.200 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.200 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:58.200 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616104+0000", 2024-04-18T21:06:58.200 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6200000000000005e-06 2024-04-18T21:06:58.200 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.200 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.200 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:58.200 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616132+0000", 2024-04-18T21:06:58.200 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7668999999999999e-05 2024-04-18T21:06:58.200 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.201 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.201 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.201 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616149+0000", 2024-04-18T21:06:58.201 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7047000000000001e-05 2024-04-18T21:06:58.201 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.201 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.201 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:58.201 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619287+0000", 2024-04-18T21:06:58.201 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0031381450000000002 2024-04-18T21:06:58.201 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.201 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.201 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:58.201 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619503+0000", 2024-04-18T21:06:58.202 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000216522 2024-04-18T21:06:58.202 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.202 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.202 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:58.202 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619930+0000", 2024-04-18T21:06:58.202 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00042604900000000001 2024-04-18T21:06:58.202 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.202 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.202 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:58.202 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629281+0000", 2024-04-18T21:06:58.202 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0093512230000000005 2024-04-18T21:06:58.202 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.202 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.202 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.203 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646022+0000", 2024-04-18T21:06:58.203 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016741156 2024-04-18T21:06:58.203 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.203 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.203 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:58.203 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646198+0000", 2024-04-18T21:06:58.203 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000176009 2024-04-18T21:06:58.203 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.203 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.203 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:58.203 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646309+0000", 2024-04-18T21:06:58.203 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011112000000000001 2024-04-18T21:06:58.204 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:58.204 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:58.204 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:58.204 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.204 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.204 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:58.204 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:58.204 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 112.535932254, 2024-04-18T21:06:58.204 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030501176000000001, 2024-04-18T21:06:58.204 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:58.204 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:58.204 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.204 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:58.205 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.205 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:58.205 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:58.205 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:58.205 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.205 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.205 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:58.205 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616179+0000", 2024-04-18T21:06:58.205 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:58.205 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.205 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.206 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:58.206 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616180+0000", 2024-04-18T21:06:58.206 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1000000000000001e-06 2024-04-18T21:06:58.206 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.206 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.206 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:58.206 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616188+0000", 2024-04-18T21:06:58.206 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4069999999999993e-06 2024-04-18T21:06:58.206 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.206 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.207 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:58.207 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616207+0000", 2024-04-18T21:06:58.207 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8335999999999999e-05 2024-04-18T21:06:58.207 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.207 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.207 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.208 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616225+0000", 2024-04-18T21:06:58.208 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8652999999999999e-05 2024-04-18T21:06:58.208 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.208 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.208 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:58.208 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620977+0000", 2024-04-18T21:06:58.208 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047512220000000003 2024-04-18T21:06:58.208 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.208 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.208 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:58.208 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621279+0000", 2024-04-18T21:06:58.209 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000302646 2024-04-18T21:06:58.209 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.209 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.209 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:58.209 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621584+0000", 2024-04-18T21:06:58.209 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000305142 2024-04-18T21:06:58.209 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.209 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.209 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:58.209 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629352+0000", 2024-04-18T21:06:58.209 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0077673689999999997 2024-04-18T21:06:58.209 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.209 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.209 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.209 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646480+0000", 2024-04-18T21:06:58.210 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017128259 2024-04-18T21:06:58.210 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.210 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.210 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:58.210 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646591+0000", 2024-04-18T21:06:58.210 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011113899999999999 2024-04-18T21:06:58.210 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.210 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.210 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:58.210 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646680+0000", 2024-04-18T21:06:58.210 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8902999999999999e-05 2024-04-18T21:06:58.210 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:58.211 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:58.211 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:58.211 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.211 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.211 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:58.211 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:58.211 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 112.535865755, 2024-04-18T21:06:58.211 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030779760999999999, 2024-04-18T21:06:58.211 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:58.211 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:58.211 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.211 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:58.211 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.211 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:58.211 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:58.211 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:58.212 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.212 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.212 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:58.212 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616245+0000", 2024-04-18T21:06:58.212 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:58.212 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.212 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.212 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:58.212 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616246+0000", 2024-04-18T21:06:58.212 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0499999999999999e-06 2024-04-18T21:06:58.212 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.212 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.212 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:58.213 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616253+0000", 2024-04-18T21:06:58.213 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.5989999999999998e-06 2024-04-18T21:06:58.213 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.213 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.213 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:58.213 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616273+0000", 2024-04-18T21:06:58.213 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9916999999999999e-05 2024-04-18T21:06:58.213 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.213 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.213 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.213 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616287+0000", 2024-04-18T21:06:58.213 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3669000000000001e-05 2024-04-18T21:06:58.214 INFO:tasks.workunit.client.0.smithi078.stdout:2/192: fdatasync d0/db/d18/d21/f23 0 2024-04-18T21:06:58.214 INFO:tasks.workunit.client.0.smithi078.stdout:5/187: getdents d9/da/d32 0 2024-04-18T21:06:58.216 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.216 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.216 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:58.216 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622203+0000", 2024-04-18T21:06:58.216 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.005916737 2024-04-18T21:06:58.216 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.216 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.217 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:58.217 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622379+0000", 2024-04-18T21:06:58.217 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000175596 2024-04-18T21:06:58.217 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.217 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.217 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:58.217 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622707+0000", 2024-04-18T21:06:58.217 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00032784600000000002 2024-04-18T21:06:58.217 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.217 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.217 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:58.217 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629366+0000", 2024-04-18T21:06:58.217 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0066593279999999999 2024-04-18T21:06:58.217 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.217 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.217 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.218 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646813+0000", 2024-04-18T21:06:58.218 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017447059000000001 2024-04-18T21:06:58.218 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.218 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.218 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:58.218 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646946+0000", 2024-04-18T21:06:58.218 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013301200000000001 2024-04-18T21:06:58.218 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.218 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.218 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:58.218 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647025+0000", 2024-04-18T21:06:58.219 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8948000000000004e-05 2024-04-18T21:06:58.219 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:58.219 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:58.219 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:58.219 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.219 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.219 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:58.219 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:58.219 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 112.535781937, 2024-04-18T21:06:58.219 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.031512165000000002, 2024-04-18T21:06:58.219 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:58.219 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:58.219 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.219 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:58.219 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.220 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:58.220 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:58.220 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:58.220 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.220 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.220 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:58.220 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616329+0000", 2024-04-18T21:06:58.220 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:58.220 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.220 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.220 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:58.220 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616330+0000", 2024-04-18T21:06:58.220 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.15e-06 2024-04-18T21:06:58.220 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.220 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.220 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:58.221 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616337+0000", 2024-04-18T21:06:58.221 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.1289999999999998e-06 2024-04-18T21:06:58.221 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.221 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.221 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:58.221 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616447+0000", 2024-04-18T21:06:58.221 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109561 2024-04-18T21:06:58.221 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.221 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.221 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.221 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616496+0000", 2024-04-18T21:06:58.221 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8591999999999998e-05 2024-04-18T21:06:58.221 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.221 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.222 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:58.222 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.623786+0000", 2024-04-18T21:06:58.222 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0072906799999999999 2024-04-18T21:06:58.222 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.222 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.222 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:58.222 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.623973+0000", 2024-04-18T21:06:58.222 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018717199999999999 2024-04-18T21:06:58.222 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.222 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.222 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:58.222 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.624260+0000", 2024-04-18T21:06:58.222 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00028630600000000001 2024-04-18T21:06:58.223 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.223 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.223 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:58.223 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629381+0000", 2024-04-18T21:06:58.223 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0051211340000000003 2024-04-18T21:06:58.223 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.223 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.223 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.223 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647631+0000", 2024-04-18T21:06:58.223 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.018249771000000001 2024-04-18T21:06:58.223 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.223 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.223 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:58.223 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647761+0000", 2024-04-18T21:06:58.223 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013037300000000001 2024-04-18T21:06:58.223 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.224 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.224 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:58.224 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.647841+0000", 2024-04-18T21:06:58.224 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.0296999999999994e-05 2024-04-18T21:06:58.224 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:58.224 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:58.224 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:58.224 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.224 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.224 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:58.224 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:58.225 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 112.535576453, 2024-04-18T21:06:58.225 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043251955000000002, 2024-04-18T21:06:58.225 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:58.225 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:58.225 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.225 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:58.225 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.225 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:58.225 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:58.225 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:58.225 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.225 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.225 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:58.226 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:58.226 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:58.226 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.226 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.226 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:58.226 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616536+0000", 2024-04-18T21:06:58.226 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2869999999999999e-06 2024-04-18T21:06:58.226 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.226 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.226 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:58.226 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616572+0000", 2024-04-18T21:06:58.226 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.6261999999999999e-05 2024-04-18T21:06:58.227 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.227 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.227 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:58.227 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616593+0000", 2024-04-18T21:06:58.227 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1310000000000001e-05 2024-04-18T21:06:58.227 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.227 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.227 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.227 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616614+0000", 2024-04-18T21:06:58.227 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.0936000000000001e-05 2024-04-18T21:06:58.227 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.227 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.228 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:58.228 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629501+0000", 2024-04-18T21:06:58.228 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.012886819000000001 2024-04-18T21:06:58.228 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.228 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.228 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:58.228 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629696+0000", 2024-04-18T21:06:58.229 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019485499999999999 2024-04-18T21:06:58.229 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.229 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.229 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:58.229 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629940+0000", 2024-04-18T21:06:58.229 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00024386399999999999 2024-04-18T21:06:58.229 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.230 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.230 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:58.230 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640100+0000", 2024-04-18T21:06:58.230 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010159645 2024-04-18T21:06:58.230 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.230 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.230 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.230 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659516+0000", 2024-04-18T21:06:58.230 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019416563000000001 2024-04-18T21:06:58.230 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.230 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.230 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:58.230 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659684+0000", 2024-04-18T21:06:58.230 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016750900000000001 2024-04-18T21:06:58.231 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.231 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.231 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:58.231 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659787+0000", 2024-04-18T21:06:58.231 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000102905 2024-04-18T21:06:58.231 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:58.231 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:58.231 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:58.231 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.231 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.231 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:58.231 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:58.231 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 112.535471331, 2024-04-18T21:06:58.231 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043581898000000001, 2024-04-18T21:06:58.232 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:58.232 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:58.232 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.232 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:58.232 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.232 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:58.232 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:58.232 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:58.232 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.232 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.232 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:58.232 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:58.232 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:58.232 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.233 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.233 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:58.233 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616641+0000", 2024-04-18T21:06:58.233 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:06:58.233 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.233 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.233 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:58.233 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616648+0000", 2024-04-18T21:06:58.233 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3860000000000001e-06 2024-04-18T21:06:58.233 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.233 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.233 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:58.234 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616666+0000", 2024-04-18T21:06:58.234 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7583000000000001e-05 2024-04-18T21:06:58.234 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.234 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.234 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.234 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616679+0000", 2024-04-18T21:06:58.234 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3322999999999999e-05 2024-04-18T21:06:58.234 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.234 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.235 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:58.235 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630373+0000", 2024-04-18T21:06:58.235 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013694207999999999 2024-04-18T21:06:58.235 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.235 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.235 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:58.235 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630545+0000", 2024-04-18T21:06:58.235 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000171683 2024-04-18T21:06:58.235 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.235 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.235 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:58.235 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630728+0000", 2024-04-18T21:06:58.235 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000182599 2024-04-18T21:06:58.235 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.235 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.236 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:58.236 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640600+0000", 2024-04-18T21:06:58.236 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0098726119999999994 2024-04-18T21:06:58.236 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.236 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.236 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.236 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659927+0000", 2024-04-18T21:06:58.236 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019326724999999999 2024-04-18T21:06:58.236 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.236 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.236 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:58.236 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660112+0000", 2024-04-18T21:06:58.236 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000185203 2024-04-18T21:06:58.237 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.237 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.237 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:58.237 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660222+0000", 2024-04-18T21:06:58.237 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109343 2024-04-18T21:06:58.237 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:58.237 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:58.237 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:58.237 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.237 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.237 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:58.237 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:58.237 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 112.534605973, 2024-04-18T21:06:58.238 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043121310000000003, 2024-04-18T21:06:58.238 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:58.238 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:58.238 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.238 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:58.238 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.238 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:58.238 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:58.238 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:58.238 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.238 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.238 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:58.238 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:58.239 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:58.239 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.239 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.239 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:58.239 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617506+0000", 2024-04-18T21:06:58.239 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9999999999999995e-07 2024-04-18T21:06:58.239 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.239 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.239 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:58.239 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617513+0000", 2024-04-18T21:06:58.239 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.9700000000000002e-06 2024-04-18T21:06:58.239 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.239 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.239 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:58.240 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617531+0000", 2024-04-18T21:06:58.240 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8105999999999999e-05 2024-04-18T21:06:58.240 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.240 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.240 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.240 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617545+0000", 2024-04-18T21:06:58.240 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3703000000000001e-05 2024-04-18T21:06:58.240 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.240 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.240 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:58.240 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632129+0000", 2024-04-18T21:06:58.240 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.014584135999999999 2024-04-18T21:06:58.240 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.240 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.241 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:58.241 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632361+0000", 2024-04-18T21:06:58.241 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023171800000000001 2024-04-18T21:06:58.241 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.241 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.241 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:58.241 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632804+0000", 2024-04-18T21:06:58.241 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000443549 2024-04-18T21:06:58.241 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.241 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.241 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:58.241 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646340+0000", 2024-04-18T21:06:58.241 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013535902000000001 2024-04-18T21:06:58.241 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.242 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.242 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.242 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660363+0000", 2024-04-18T21:06:58.242 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01402318 2024-04-18T21:06:58.242 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.242 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.242 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:58.242 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660523+0000", 2024-04-18T21:06:58.242 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00015989899999999999 2024-04-18T21:06:58.242 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.242 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.242 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:58.242 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660626+0000", 2024-04-18T21:06:58.242 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010314699999999999 2024-04-18T21:06:58.243 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:58.243 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:58.243 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:58.243 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.243 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.243 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:58.243 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:58.243 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 112.53446628, 2024-04-18T21:06:58.243 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024927483, 2024-04-18T21:06:58.243 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:58.243 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:58.243 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.243 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:58.243 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.243 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:58.244 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:58.244 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:58.244 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.244 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.244 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:58.244 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617645+0000", 2024-04-18T21:06:58.244 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:58.244 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.244 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.244 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:58.244 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617646+0000", 2024-04-18T21:06:58.244 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3030000000000001e-06 2024-04-18T21:06:58.244 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.244 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.244 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:58.245 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617653+0000", 2024-04-18T21:06:58.245 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7530000000000004e-06 2024-04-18T21:06:58.245 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.245 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.245 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:58.245 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617673+0000", 2024-04-18T21:06:58.245 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9967e-05 2024-04-18T21:06:58.245 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.245 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.245 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.245 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617688+0000", 2024-04-18T21:06:58.245 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5153e-05 2024-04-18T21:06:58.245 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.245 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.246 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:58.246 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619244+0000", 2024-04-18T21:06:58.246 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001555531 2024-04-18T21:06:58.246 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.246 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.246 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:58.246 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619361+0000", 2024-04-18T21:06:58.246 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011784400000000001 2024-04-18T21:06:58.246 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.246 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.246 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:58.246 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619604+0000", 2024-04-18T21:06:58.246 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000243007 2024-04-18T21:06:58.247 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.247 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.247 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:58.247 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.625480+0000", 2024-04-18T21:06:58.247 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0058759349999999997 2024-04-18T21:06:58.247 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.247 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.247 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.247 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642342+0000", 2024-04-18T21:06:58.247 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016861373999999998 2024-04-18T21:06:58.247 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.247 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.247 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:58.247 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642484+0000", 2024-04-18T21:06:58.247 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000142423 2024-04-18T21:06:58.248 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.248 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.248 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:58.248 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642572+0000", 2024-04-18T21:06:58.248 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8193000000000001e-05 2024-04-18T21:06:58.248 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:58.248 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:58.248 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:58.248 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.248 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.248 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:58.248 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:58.248 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 112.53418477699999, 2024-04-18T21:06:58.248 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024956974999999999, 2024-04-18T21:06:58.249 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:58.249 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:58.249 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.249 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:58.249 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.249 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:58.249 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:58.249 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:58.249 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.249 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.249 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:58.249 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617926+0000", 2024-04-18T21:06:58.249 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:58.249 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.250 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.250 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:58.250 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617928+0000", 2024-04-18T21:06:58.250 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5430000000000001e-06 2024-04-18T21:06:58.250 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.250 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.250 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:58.250 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617937+0000", 2024-04-18T21:06:58.250 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6629999999999999e-06 2024-04-18T21:06:58.250 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.250 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.250 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:58.250 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617955+0000", 2024-04-18T21:06:58.251 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8749999999999998e-05 2024-04-18T21:06:58.251 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.251 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.251 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.251 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617971+0000", 2024-04-18T21:06:58.251 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.605e-05 2024-04-18T21:06:58.251 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.251 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.251 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:58.251 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621019+0000", 2024-04-18T21:06:58.251 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0030472369999999999 2024-04-18T21:06:58.251 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.251 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.251 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:58.251 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621249+0000", 2024-04-18T21:06:58.252 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000230075 2024-04-18T21:06:58.252 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.252 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.252 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:58.252 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.621450+0000", 2024-04-18T21:06:58.252 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020166499999999999 2024-04-18T21:06:58.252 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.252 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.252 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:58.252 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.626233+0000", 2024-04-18T21:06:58.252 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047827390000000003 2024-04-18T21:06:58.252 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.252 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.252 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.252 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642693+0000", 2024-04-18T21:06:58.252 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01645961 2024-04-18T21:06:58.253 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.253 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.253 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:58.253 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642798+0000", 2024-04-18T21:06:58.253 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010559499999999999 2024-04-18T21:06:58.253 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.253 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.253 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:58.253 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.642883+0000", 2024-04-18T21:06:58.253 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5048000000000003e-05 2024-04-18T21:06:58.253 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:58.253 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:58.253 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:58.253 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.253 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.253 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:58.254 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:58.254 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 112.532489149, 2024-04-18T21:06:58.254 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024086478000000001, 2024-04-18T21:06:58.254 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:58.254 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:58.254 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.254 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:58.254 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.254 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:58.254 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:58.254 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:58.255 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.255 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.255 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:58.255 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619622+0000", 2024-04-18T21:06:58.255 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:58.255 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.255 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.255 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:58.255 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619624+0000", 2024-04-18T21:06:58.255 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.75e-06 2024-04-18T21:06:58.255 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.255 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.255 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:58.255 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619637+0000", 2024-04-18T21:06:58.255 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3540000000000001e-05 2024-04-18T21:06:58.255 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.256 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.256 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:58.256 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619666+0000", 2024-04-18T21:06:58.256 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8685999999999999e-05 2024-04-18T21:06:58.256 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.256 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.256 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.256 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619685+0000", 2024-04-18T21:06:58.256 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8681999999999998e-05 2024-04-18T21:06:58.256 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.256 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.256 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:58.256 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622275+0000", 2024-04-18T21:06:58.256 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0025899260000000002 2024-04-18T21:06:58.256 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.257 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.257 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:58.257 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622572+0000", 2024-04-18T21:06:58.257 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00029722 2024-04-18T21:06:58.257 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.257 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.257 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:58.257 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.622752+0000", 2024-04-18T21:06:58.257 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018065900000000001 2024-04-18T21:06:58.257 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.257 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.257 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:58.257 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.626326+0000", 2024-04-18T21:06:58.257 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035737310000000001 2024-04-18T21:06:58.257 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.257 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.258 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.258 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643565+0000", 2024-04-18T21:06:58.258 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017238430999999999 2024-04-18T21:06:58.258 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.258 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.258 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:58.258 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643646+0000", 2024-04-18T21:06:58.258 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.1481000000000001e-05 2024-04-18T21:06:58.258 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.258 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.258 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:58.258 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.643708+0000", 2024-04-18T21:06:58.258 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.2372000000000005e-05 2024-04-18T21:06:58.258 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:58.259 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:58.259 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:58.259 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.259 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.259 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:58.259 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:58.259 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 112.532322996, 2024-04-18T21:06:58.259 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026822450000000001, 2024-04-18T21:06:58.259 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:58.259 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:58.259 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.259 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:58.259 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.259 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:58.259 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:58.259 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:58.260 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.260 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.260 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:58.260 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619788+0000", 2024-04-18T21:06:58.260 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:58.260 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.260 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.260 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:58.260 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619789+0000", 2024-04-18T21:06:58.260 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0759999999999999e-06 2024-04-18T21:06:58.260 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.260 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.260 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:58.260 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619797+0000", 2024-04-18T21:06:58.260 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.6899999999999992e-06 2024-04-18T21:06:58.261 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.261 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.261 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:58.261 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619816+0000", 2024-04-18T21:06:58.261 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9352999999999999e-05 2024-04-18T21:06:58.261 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.261 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.261 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.261 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.619832+0000", 2024-04-18T21:06:58.261 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6013000000000001e-05 2024-04-18T21:06:58.261 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.261 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.261 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:58.261 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620528+0000", 2024-04-18T21:06:58.261 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00069565600000000001 2024-04-18T21:06:58.262 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.262 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.262 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:58.262 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620735+0000", 2024-04-18T21:06:58.262 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000207025 2024-04-18T21:06:58.262 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.262 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.262 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:58.262 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.620912+0000", 2024-04-18T21:06:58.262 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017748199999999999 2024-04-18T21:06:58.262 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.262 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.262 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:58.262 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.625605+0000", 2024-04-18T21:06:58.262 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0046924439999999996 2024-04-18T21:06:58.263 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.263 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.263 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.263 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646349+0000", 2024-04-18T21:06:58.263 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.020744318000000001 2024-04-18T21:06:58.263 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.263 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.263 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:58.263 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646483+0000", 2024-04-18T21:06:58.263 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013428999999999999 2024-04-18T21:06:58.263 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.263 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.263 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:58.263 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646611+0000", 2024-04-18T21:06:58.263 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012710299999999999 2024-04-18T21:06:58.263 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:58.264 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:58.264 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:58.264 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.264 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.264 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:10648 4.1e 4:78e5e06c:::100000030c5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-18T21:06:58.264 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:54.081572+0000", 2024-04-18T21:06:58.264 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 4.0705387679999996, 2024-04-18T21:06:58.264 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.029353989, 2024-04-18T21:06:58.264 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:58.264 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:58.264 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.264 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:58.264 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:06:58.264 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:58.264 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 10648 2024-04-18T21:06:58.265 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.265 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:58.265 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.265 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:58.265 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:54.081572+0000", 2024-04-18T21:06:58.265 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:58.265 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.265 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.265 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:58.265 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:54.081572+0000", 2024-04-18T21:06:58.265 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:58.265 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.265 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.265 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:58.265 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:54.081575+0000", 2024-04-18T21:06:58.266 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.5129999999999999e-06 2024-04-18T21:06:58.266 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.266 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.266 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:58.266 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:54.091255+0000", 2024-04-18T21:06:58.266 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0096798330000000005 2024-04-18T21:06:58.266 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.266 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.266 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:58.266 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:54.091287+0000", 2024-04-18T21:06:58.266 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.2339999999999999e-05 2024-04-18T21:06:58.266 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.266 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.266 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.267 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:54.091306+0000", 2024-04-18T21:06:58.267 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9360000000000001e-05 2024-04-18T21:06:58.267 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.267 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.267 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:58.267 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:54.091438+0000", 2024-04-18T21:06:58.267 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013156499999999999 2024-04-18T21:06:58.267 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.267 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.267 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:58.267 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:54.091686+0000", 2024-04-18T21:06:58.267 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00024800700000000001 2024-04-18T21:06:58.267 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.267 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.267 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:58.268 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:54.091990+0000", 2024-04-18T21:06:58.268 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00030370100000000003 2024-04-18T21:06:58.268 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.268 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.268 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:58.268 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:54.108022+0000", 2024-04-18T21:06:58.268 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016031894000000001 2024-04-18T21:06:58.268 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.268 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.268 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.268 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:54.110767+0000", 2024-04-18T21:06:58.268 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0027452650000000002 2024-04-18T21:06:58.268 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.268 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.269 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:58.269 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:54.110857+0000", 2024-04-18T21:06:58.269 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0295000000000002e-05 2024-04-18T21:06:58.269 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.269 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.269 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:58.269 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:54.110926+0000", 2024-04-18T21:06:58.269 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.9215999999999996e-05 2024-04-18T21:06:58.269 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:58.269 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:58.269 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:58.269 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.269 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.269 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:265 3.13 3:ceffbd45:::200.0000000a:head [write 2989882~18774 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-18T21:06:58.269 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:54.136247+0000", 2024-04-18T21:06:58.270 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 4.0158639330000003, 2024-04-18T21:06:58.270 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024117454999999999, 2024-04-18T21:06:58.270 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:58.270 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:58.270 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.270 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:58.270 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.270 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:58.270 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:54.136247+0000", 2024-04-18T21:06:58.270 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:58.270 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.270 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.270 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:58.271 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:54.136247+0000", 2024-04-18T21:06:58.271 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:58.271 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.271 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.271 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:58.271 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:54.136249+0000", 2024-04-18T21:06:58.271 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1859999999999999e-06 2024-04-18T21:06:58.271 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.271 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.271 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:58.271 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:54.136281+0000", 2024-04-18T21:06:58.271 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.1653999999999999e-05 2024-04-18T21:06:58.271 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.272 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.272 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:58.272 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:54.136302+0000", 2024-04-18T21:06:58.272 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1073e-05 2024-04-18T21:06:58.272 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.272 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.272 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.272 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:54.136314+0000", 2024-04-18T21:06:58.272 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1883e-05 2024-04-18T21:06:58.272 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.272 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.272 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:58.272 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:54.136440+0000", 2024-04-18T21:06:58.272 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000126384 2024-04-18T21:06:58.272 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.273 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.273 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:58.273 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:54.136644+0000", 2024-04-18T21:06:58.273 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020357799999999999 2024-04-18T21:06:58.273 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.273 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.273 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:58.273 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:54.136885+0000", 2024-04-18T21:06:58.273 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00024144600000000001 2024-04-18T21:06:58.273 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.273 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.273 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.273 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:54.141955+0000", 2024-04-18T21:06:58.273 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0050695410000000003 2024-04-18T21:06:58.273 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.274 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.274 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:58.274 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:54.159888+0000", 2024-04-18T21:06:58.274 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017933278 2024-04-18T21:06:58.274 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.274 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.274 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:58.274 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:54.160179+0000", 2024-04-18T21:06:58.274 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00029060700000000002 2024-04-18T21:06:58.274 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:58.274 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:58.274 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:58.274 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:54.160365+0000", 2024-04-18T21:06:58.274 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000185825 2024-04-18T21:06:58.275 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:58.275 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:58.275 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:58.275 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:58.275 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:58.275 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:58.275 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:58.276 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:58.214+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:58.288 INFO:tasks.workunit.client.0.smithi078.stdout:1/218: dwrite d0/d2a/d3c/d4b/d4/f28 [0,4194304] 0 2024-04-18T21:06:58.289 INFO:tasks.workunit.client.0.smithi078.stdout:5/188: chown d9/d2e/d29/l2b 31256528 1 2024-04-18T21:06:58.289 INFO:tasks.workunit.client.0.smithi078.stdout:5/189: write d9/da/f2d [449626,90968] 0 2024-04-18T21:06:58.289 INFO:tasks.workunit.client.0.smithi078.stdout:1/219: write d0/d46/d32/f41 [499506,24174] 0 2024-04-18T21:06:58.289 INFO:tasks.workunit.client.0.smithi078.stdout:5/190: readlink d9/d2e/l38 0 2024-04-18T21:06:58.289 INFO:tasks.workunit.client.0.smithi078.stdout:5/191: chown d9/fe 7581 1 2024-04-18T21:06:58.289 INFO:tasks.workunit.client.0.smithi078.stdout:1/220: rename d0/d46/d32/f41 to d0/d46/d32/f4c 0 2024-04-18T21:06:58.289 INFO:tasks.workunit.client.0.smithi078.stdout:5/192: mknod d9/c3f 0 2024-04-18T21:06:58.289 INFO:tasks.workunit.client.0.smithi078.stdout:1/221: write d0/d11/f18 [127448,42659] 0 2024-04-18T21:06:58.289 INFO:tasks.workunit.client.0.smithi078.stdout:5/193: stat d9/da 0 2024-04-18T21:06:58.289 INFO:tasks.workunit.client.0.smithi078.stdout:1/222: dread d0/d2a/d3c/d4b/d4/f28 [0,4194304] 0 2024-04-18T21:06:58.289 INFO:tasks.workunit.client.0.smithi078.stdout:1/223: truncate d0/d2a/d3c/d4b/d4/f3d 2870849 0 2024-04-18T21:06:58.289 INFO:tasks.workunit.client.0.smithi078.stdout:5/194: dwrite f8 [0,4194304] 0 2024-04-18T21:06:58.289 INFO:tasks.workunit.client.0.smithi078.stdout:5/195: fdatasync d9/da/f1a 0 2024-04-18T21:06:58.289 INFO:tasks.workunit.client.0.smithi078.stdout:1/224: read d0/d11/f18 [708404,107473] 0 2024-04-18T21:06:58.289 INFO:tasks.workunit.client.0.smithi078.stdout:5/196: dwrite d9/d2e/f3d [0,4194304] 0 2024-04-18T21:06:58.289 INFO:tasks.workunit.client.0.smithi078.stdout:1/225: mkdir d0/d2a/d45/d4d 0 2024-04-18T21:06:58.290 INFO:tasks.workunit.client.0.smithi078.stdout:5/197: getdents d9/da/d32 0 2024-04-18T21:06:58.290 INFO:tasks.workunit.client.0.smithi078.stdout:1/226: symlink d0/d2a/d3c/d4b/l4e 0 2024-04-18T21:06:58.290 INFO:tasks.workunit.client.0.smithi078.stdout:5/198: rmdir d9/d2e 39 2024-04-18T21:06:58.290 INFO:tasks.workunit.client.0.smithi078.stdout:5/199: chown d9/da/f1a 90 1 2024-04-18T21:06:58.290 INFO:tasks.workunit.client.0.smithi078.stdout:5/200: dread - d9/f34 zero size 2024-04-18T21:06:58.290 INFO:tasks.workunit.client.0.smithi078.stdout:5/201: creat d9/d2e/d29/f40 x:0 0 0 2024-04-18T21:06:58.290 INFO:tasks.workunit.client.0.smithi078.stdout:5/202: truncate d9/d2e/d29/f2f 1008448 0 2024-04-18T21:06:58.290 INFO:tasks.workunit.client.0.smithi078.stdout:5/203: symlink d9/da/d32/l41 0 2024-04-18T21:06:58.290 INFO:tasks.workunit.client.0.smithi078.stdout:5/204: symlink d9/da/d32/l42 0 2024-04-18T21:06:58.290 INFO:tasks.workunit.client.0.smithi078.stdout:5/205: unlink d9/d2e/d29/l3a 0 2024-04-18T21:06:58.290 INFO:tasks.workunit.client.0.smithi078.stdout:5/206: dwrite d9/d2e/d29/f36 [0,4194304] 0 2024-04-18T21:06:58.290 INFO:tasks.workunit.client.0.smithi078.stdout:5/207: chown d9/d2e/c21 68453 1 2024-04-18T21:06:58.290 INFO:tasks.workunit.client.0.smithi078.stdout:5/208: creat d9/d2e/d29/f43 x:0 0 0 2024-04-18T21:06:58.290 INFO:tasks.workunit.client.0.smithi078.stdout:5/209: creat d9/f44 x:0 0 0 2024-04-18T21:06:58.291 INFO:tasks.workunit.client.0.smithi078.stdout:5/210: dwrite d9/d2e/d29/f2f [0,4194304] 0 2024-04-18T21:06:58.291 INFO:tasks.workunit.client.0.smithi078.stdout:5/211: read d9/d2e/d29/f2f [3945920,60691] 0 2024-04-18T21:06:58.291 INFO:tasks.workunit.client.0.smithi078.stdout:5/212: creat d9/d2e/d29/f45 x:0 0 0 2024-04-18T21:06:58.291 INFO:tasks.workunit.client.0.smithi078.stdout:5/213: rename d9/da/ld to d9/da/d32/l46 0 2024-04-18T21:06:58.291 INFO:tasks.workunit.client.0.smithi078.stdout:5/214: mknod d9/d2e/c47 0 2024-04-18T21:06:58.291 INFO:tasks.workunit.client.0.smithi078.stdout:5/215: write d9/da/f2d [1434084,3168] 0 2024-04-18T21:06:58.291 INFO:tasks.workunit.client.0.smithi078.stdout:5/216: dread d9/d2e/f3d [0,4194304] 0 2024-04-18T21:06:58.291 INFO:tasks.workunit.client.0.smithi078.stdout:5/217: truncate d9/f3c 775202 0 2024-04-18T21:06:58.291 INFO:tasks.workunit.client.0.smithi078.stdout:5/218: write d9/f44 [362355,54759] 0 2024-04-18T21:06:58.291 INFO:tasks.workunit.client.0.smithi078.stdout:5/219: mknod d9/da/c48 0 2024-04-18T21:06:58.291 INFO:tasks.workunit.client.0.smithi078.stdout:5/220: dread - d9/d2e/d29/f43 zero size 2024-04-18T21:06:58.291 INFO:tasks.workunit.client.0.smithi078.stdout:5/221: fsync d9/d2e/d29/f2f 0 2024-04-18T21:06:58.292 INFO:tasks.workunit.client.0.smithi078.stdout:5/222: truncate d9/fe 46853 0 2024-04-18T21:06:58.292 INFO:tasks.workunit.client.0.smithi078.stdout:5/223: read d9/f3c [104547,124760] 0 2024-04-18T21:06:58.292 INFO:tasks.workunit.client.0.smithi078.stdout:5/224: chown d9/d2e/d29/f45 10047 1 2024-04-18T21:06:58.292 INFO:tasks.workunit.client.0.smithi078.stdout:5/225: truncate d9/d2e/d29/f45 188820 0 2024-04-18T21:06:58.292 INFO:tasks.workunit.client.0.smithi078.stdout:5/226: mknod d9/d2e/d29/c49 0 2024-04-18T21:06:58.292 INFO:tasks.workunit.client.0.smithi078.stdout:5/227: rmdir d9/da 39 2024-04-18T21:06:58.292 INFO:tasks.workunit.client.0.smithi078.stdout:5/228: mkdir d9/d2e/d29/d4a 0 2024-04-18T21:06:58.292 INFO:tasks.workunit.client.0.smithi078.stdout:5/229: chown d9/d2e/l31 1480305603 1 2024-04-18T21:06:58.292 INFO:tasks.workunit.client.0.smithi078.stdout:5/230: write d9/d2e/d29/f43 [681066,81135] 0 2024-04-18T21:06:58.292 INFO:tasks.workunit.client.0.smithi078.stdout:5/231: mkdir d9/da/d4b 0 2024-04-18T21:06:58.292 INFO:tasks.workunit.client.0.smithi078.stdout:5/232: dwrite d9/da/ff [4194304,4194304] 0 2024-04-18T21:06:58.292 INFO:tasks.workunit.client.0.smithi078.stdout:5/233: truncate d9/da/f20 4927519 0 2024-04-18T21:06:58.293 INFO:tasks.workunit.client.0.smithi078.stdout:5/234: dread d9/da/f1b [0,4194304] 0 2024-04-18T21:06:58.293 INFO:tasks.workunit.client.0.smithi078.stdout:5/235: rename d9/d2e/d29/d4a to d9/da/d3e/d4c 0 2024-04-18T21:06:58.293 INFO:tasks.workunit.client.0.smithi078.stdout:5/236: unlink d9/da/f20 0 2024-04-18T21:06:58.293 INFO:tasks.workunit.client.0.smithi078.stdout:5/237: rename d9/f1c to d9/da/d4b/f4d 0 2024-04-18T21:06:58.293 INFO:tasks.workunit.client.0.smithi078.stdout:5/238: dwrite d9/f1e [0,4194304] 0 2024-04-18T21:06:58.293 INFO:tasks.workunit.client.0.smithi078.stdout:5/239: creat d9/da/d4b/f4e x:0 0 0 2024-04-18T21:06:58.293 INFO:tasks.workunit.client.0.smithi078.stdout:5/240: fsync d9/f3c 0 2024-04-18T21:06:58.293 INFO:tasks.workunit.client.0.smithi078.stdout:5/241: getdents d9/d2e 0 2024-04-18T21:06:58.293 INFO:tasks.workunit.client.0.smithi078.stdout:5/242: symlink d9/da/d3e/d4c/l4f 0 2024-04-18T21:06:58.293 INFO:tasks.workunit.client.0.smithi078.stdout:5/243: dwrite f8 [0,4194304] 0 2024-04-18T21:06:58.293 INFO:tasks.workunit.client.0.smithi078.stdout:5/244: symlink d9/d2e/l50 0 2024-04-18T21:06:58.293 INFO:tasks.workunit.client.0.smithi078.stdout:5/245: dwrite d9/d2e/f26 [0,4194304] 0 2024-04-18T21:06:58.293 INFO:tasks.workunit.client.0.smithi078.stdout:5/246: dwrite d9/da/d4b/f4e [0,4194304] 0 2024-04-18T21:06:58.293 INFO:tasks.workunit.client.0.smithi078.stdout:5/247: fsync d9/d2e/f23 0 2024-04-18T21:06:58.293 INFO:tasks.workunit.client.0.smithi078.stdout:7/181: sync 2024-04-18T21:06:58.293 INFO:tasks.workunit.client.0.smithi078.stdout:8/138: sync 2024-04-18T21:06:58.294 INFO:tasks.workunit.client.0.smithi078.stdout:4/217: sync 2024-04-18T21:06:58.294 INFO:tasks.workunit.client.0.smithi078.stdout:0/185: sync 2024-04-18T21:06:58.294 INFO:tasks.workunit.client.0.smithi078.stdout:9/151: sync 2024-04-18T21:06:58.294 INFO:tasks.workunit.client.0.smithi078.stdout:3/150: sync 2024-04-18T21:06:58.294 INFO:tasks.workunit.client.0.smithi078.stdout:6/129: sync 2024-04-18T21:06:58.294 INFO:tasks.workunit.client.0.smithi078.stdout:8/139: write d0/fb [2716330,127819] 0 2024-04-18T21:06:58.294 INFO:tasks.workunit.client.0.smithi078.stdout:7/182: dread - d1/d16/d1c/f2a zero size 2024-04-18T21:06:58.294 INFO:tasks.workunit.client.0.smithi078.stdout:7/183: readlink d1/d16/dc/l30 0 2024-04-18T21:06:58.294 INFO:tasks.workunit.client.0.smithi078.stdout:8/140: chown d0/d10/f1c 2 1 2024-04-18T21:06:58.294 INFO:tasks.workunit.client.0.smithi078.stdout:0/186: creat d0/d9/da/db/f33 x:0 0 0 2024-04-18T21:06:58.294 INFO:tasks.workunit.client.0.smithi078.stdout:0/187: chown d0/d15 21 1 2024-04-18T21:06:58.294 INFO:tasks.workunit.client.0.smithi078.stdout:3/151: rename d4/df/f19 to d4/df/f26 0 2024-04-18T21:06:58.294 INFO:tasks.workunit.client.0.smithi078.stdout:8/141: readlink d0/d10/d14/l25 0 2024-04-18T21:06:58.294 INFO:tasks.workunit.client.0.smithi078.stdout:7/184: creat d1/d16/f46 x:0 0 0 2024-04-18T21:06:58.295 INFO:tasks.workunit.client.0.smithi078.stdout:7/185: creat d1/d16/d2d/f47 x:0 0 0 2024-04-18T21:06:58.295 INFO:tasks.workunit.client.0.smithi078.stdout:0/188: rename d0/d15/d21/c28 to d0/d9/d2f/c34 0 2024-04-18T21:06:58.295 INFO:tasks.workunit.client.0.smithi078.stdout:5/248: write d9/d2e/d29/f33 [3191399,98783] 0 2024-04-18T21:06:58.295 INFO:tasks.workunit.client.0.smithi078.stdout:8/142: link d0/l8 d0/d10/d14/d2a/l2e 0 2024-04-18T21:06:58.295 INFO:tasks.workunit.client.0.smithi078.stdout:7/186: fsync d1/d16/d1c/f21 0 2024-04-18T21:06:58.295 INFO:tasks.workunit.client.0.smithi078.stdout:8/143: write d0/f1f [4946897,37291] 0 2024-04-18T21:06:58.295 INFO:tasks.workunit.client.0.smithi078.stdout:5/249: fdatasync d9/d2e/d29/f2f 0 2024-04-18T21:06:58.295 INFO:tasks.workunit.client.0.smithi078.stdout:0/189: rename d0/d9/dd/d14 to d0/d9/da/db/d35 0 2024-04-18T21:06:58.295 INFO:tasks.workunit.client.0.smithi078.stdout:6/130: dwrite d2/d1f/f25 [0,4194304] 0 2024-04-18T21:06:58.295 INFO:tasks.workunit.client.0.smithi078.stdout:9/152: truncate d7/fa 8025126 0 2024-04-18T21:06:58.295 INFO:tasks.workunit.client.0.smithi078.stdout:4/218: dwrite d0/f5 [0,4194304] 0 2024-04-18T21:06:58.295 INFO:tasks.workunit.client.0.smithi078.stdout:7/187: getdents d1/d16/dc 0 2024-04-18T21:06:58.295 INFO:tasks.workunit.client.0.smithi078.stdout:9/153: readlink d7/d11/d2d/d26/l32 0 2024-04-18T21:06:58.295 INFO:tasks.workunit.client.0.smithi078.stdout:3/152: dwrite d4/df/d17/f25 [0,4194304] 0 2024-04-18T21:06:58.296 INFO:tasks.workunit.client.0.smithi078.stdout:6/131: write d2/fe [1295421,123379] 0 2024-04-18T21:06:58.296 INFO:tasks.workunit.client.0.smithi078.stdout:5/250: getdents d9/d2e/d29 0 2024-04-18T21:06:58.296 INFO:tasks.workunit.client.0.smithi078.stdout:9/154: dread - d7/df/f39 zero size 2024-04-18T21:06:58.296 INFO:tasks.workunit.client.0.smithi078.stdout:4/219: stat d0/dc/d10/d1c/l27 0 2024-04-18T21:06:58.296 INFO:tasks.workunit.client.0.smithi078.stdout:6/132: mkdir d2/d1c/d30 0 2024-04-18T21:06:58.296 INFO:tasks.workunit.client.0.smithi078.stdout:9/155: mknod d7/c3c 0 2024-04-18T21:06:58.296 INFO:tasks.workunit.client.0.smithi078.stdout:5/251: creat d9/da/d32/f51 x:0 0 0 2024-04-18T21:06:58.296 INFO:tasks.workunit.client.0.smithi078.stdout:3/153: mknod d4/da/c27 0 2024-04-18T21:06:58.296 INFO:tasks.workunit.client.0.smithi078.stdout:8/144: dwrite d0/f2c [0,4194304] 0 2024-04-18T21:06:58.296 INFO:tasks.workunit.client.0.smithi078.stdout:3/154: chown d4/df/d17 1 1 2024-04-18T21:06:58.296 INFO:tasks.workunit.client.0.smithi078.stdout:5/252: write d9/d2e/d29/f33 [3064273,122385] 0 2024-04-18T21:06:58.296 INFO:tasks.workunit.client.0.smithi078.stdout:4/220: mkdir d0/dc/d29/d2f/d4e 0 2024-04-18T21:06:58.296 INFO:tasks.workunit.client.0.smithi078.stdout:9/156: rmdir d7/df/d1e 39 2024-04-18T21:06:58.296 INFO:tasks.workunit.client.0.smithi078.stdout:0/190: dwrite d0/d9/da/db/d35/f20 [0,4194304] 0 2024-04-18T21:06:58.296 INFO:tasks.workunit.client.0.smithi078.stdout:7/188: dread d1/d16/dc/d11/f29 [0,4194304] 0 2024-04-18T21:06:58.296 INFO:tasks.workunit.client.0.smithi078.stdout:3/155: rename d4/df/l15 to d4/da/d11/d23/l28 0 2024-04-18T21:06:58.296 INFO:tasks.workunit.client.0.smithi078.stdout:3/156: readlink d4/le 0 2024-04-18T21:06:58.297 INFO:tasks.workunit.client.0.smithi078.stdout:4/221: getdents d0/dc 0 2024-04-18T21:06:58.297 INFO:tasks.workunit.client.0.smithi078.stdout:9/157: link d7/d11/d2d/f31 d7/f3d 0 2024-04-18T21:06:58.297 INFO:tasks.workunit.client.0.smithi078.stdout:3/157: stat d4/le 0 2024-04-18T21:06:58.297 INFO:tasks.workunit.client.0.smithi078.stdout:0/191: truncate d0/f5 3077674 0 2024-04-18T21:06:58.297 INFO:tasks.workunit.client.0.smithi078.stdout:3/158: readlink d4/l20 0 2024-04-18T21:06:58.297 INFO:tasks.workunit.client.0.smithi078.stdout:8/145: write d0/fd [52601,29582] 0 2024-04-18T21:06:58.297 INFO:tasks.workunit.client.0.smithi078.stdout:6/133: dwrite d2/d1c/f22 [4194304,4194304] 0 2024-04-18T21:06:58.297 INFO:tasks.workunit.client.0.smithi078.stdout:4/222: chown d0/dc/d10/d41/f45 28 1 2024-04-18T21:06:58.297 INFO:tasks.workunit.client.0.smithi078.stdout:0/192: symlink d0/d9/da/db/d35/l36 0 2024-04-18T21:06:58.297 INFO:tasks.workunit.client.0.smithi078.stdout:8/146: write d0/fb [8133018,130292] 0 2024-04-18T21:06:58.297 INFO:tasks.workunit.client.0.smithi078.stdout:5/253: dread d9/d2e/d29/f33 [0,4194304] 0 2024-04-18T21:06:58.297 INFO:tasks.workunit.client.0.smithi078.stdout:6/134: write d2/f3 [7481565,72397] 0 2024-04-18T21:06:58.299 INFO:tasks.workunit.client.0.smithi078.stdout:8/147: symlink d0/d10/d14/d2d/l2f 0 2024-04-18T21:06:58.299 INFO:tasks.workunit.client.0.smithi078.stdout:7/189: dwrite d1/d28/f42 [0,4194304] 0 2024-04-18T21:06:58.299 INFO:tasks.workunit.client.0.smithi078.stdout:6/135: creat d2/d6/dd/f31 x:0 0 0 2024-04-18T21:06:58.299 INFO:tasks.workunit.client.0.smithi078.stdout:8/148: rename d0/d10/c1d to d0/d10/d14/d2d/c30 0 2024-04-18T21:06:58.300 INFO:tasks.workunit.client.0.smithi078.stdout:0/193: link d0/d9/dd/c24 d0/d9/dd/d17/c37 0 2024-04-18T21:06:58.300 INFO:tasks.workunit.client.0.smithi078.stdout:6/136: chown d2/f21 92288901 1 2024-04-18T21:06:58.300 INFO:tasks.workunit.client.0.smithi078.stdout:7/190: mknod d1/d28/c48 0 2024-04-18T21:06:58.300 INFO:tasks.workunit.client.0.smithi078.stdout:6/137: rename d2/f24 to d2/d6/dd/f32 0 2024-04-18T21:06:58.300 INFO:tasks.workunit.client.0.smithi078.stdout:0/194: link d0/d9/dd/d17/l22 d0/d9/da/db/l38 0 2024-04-18T21:06:58.300 INFO:tasks.workunit.client.0.smithi078.stdout:7/191: rename d1/d16/d1c/f21 to d1/d32/f49 0 2024-04-18T21:06:58.300 INFO:tasks.workunit.client.0.smithi078.stdout:0/195: unlink d0/f4 0 2024-04-18T21:06:58.300 INFO:tasks.workunit.client.0.smithi078.stdout:6/138: write d2/d1f/f29 [687600,32873] 0 2024-04-18T21:06:58.300 INFO:tasks.workunit.client.0.smithi078.stdout:7/192: dread - d1/d16/dc/d11/f2b zero size 2024-04-18T21:06:58.300 INFO:tasks.workunit.client.0.smithi078.stdout:0/196: creat d0/d9/dd/d17/d2e/f39 x:0 0 0 2024-04-18T21:06:58.300 INFO:tasks.workunit.client.0.smithi078.stdout:6/139: dread d2/d1c/f20 [4194304,4194304] 0 2024-04-18T21:06:58.300 INFO:tasks.workunit.client.0.smithi078.stdout:7/193: dread d1/d16/dc/d11/f24 [0,4194304] 0 2024-04-18T21:06:58.300 INFO:tasks.workunit.client.0.smithi078.stdout:9/158: read f5 [4054871,51207] 0 2024-04-18T21:06:58.300 INFO:tasks.workunit.client.0.smithi078.stdout:6/140: symlink d2/l33 0 2024-04-18T21:06:58.300 INFO:tasks.workunit.client.0.smithi078.stdout:9/159: read - d7/f3d zero size 2024-04-18T21:06:58.300 INFO:tasks.workunit.client.0.smithi078.stdout:7/194: symlink d1/d16/d10/l4a 0 2024-04-18T21:06:58.301 INFO:tasks.workunit.client.0.smithi078.stdout:9/160: mkdir d7/d23/d3e 0 2024-04-18T21:06:58.301 INFO:tasks.workunit.client.0.smithi078.stdout:9/161: stat d7/d11/d2d/d2e 0 2024-04-18T21:06:58.301 INFO:tasks.workunit.client.0.smithi078.stdout:0/197: dwrite d0/d9/da/db/f33 [0,4194304] 0 2024-04-18T21:06:58.302 INFO:tasks.workunit.client.0.smithi078.stdout:9/162: mkdir d7/d11/d2d/d3f 0 2024-04-18T21:06:58.304 INFO:tasks.workunit.client.0.smithi078.stdout:9/163: truncate d7/d11/f34 98372 0 2024-04-18T21:06:58.306 INFO:tasks.workunit.client.0.smithi078.stdout:0/198: dread d0/d9/da/db/f33 [0,4194304] 0 2024-04-18T21:06:58.306 INFO:tasks.workunit.client.0.smithi078.stdout:6/141: dwrite d2/d6/fc [0,4194304] 0 2024-04-18T21:06:58.306 INFO:tasks.workunit.client.0.smithi078.stdout:3/159: dwrite d4/f9 [0,4194304] 0 2024-04-18T21:06:58.307 INFO:tasks.workunit.client.0.smithi078.stdout:6/142: write d2/f21 [607868,20336] 0 2024-04-18T21:06:58.307 INFO:tasks.workunit.client.0.smithi078.stdout:0/199: write d0/d9/da/db/d35/f20 [126122,62887] 0 2024-04-18T21:06:58.308 INFO:tasks.workunit.client.0.smithi078.stdout:6/143: chown d2/d6/c19 17035 1 2024-04-18T21:06:58.309 INFO:tasks.workunit.client.0.smithi078.stdout:3/160: mknod d4/da/d11/d23/c29 0 2024-04-18T21:06:58.309 INFO:tasks.workunit.client.0.smithi078.stdout:6/144: mkdir d2/d34 0 2024-04-18T21:06:58.310 INFO:tasks.workunit.client.0.smithi078.stdout:3/161: write d4/f9 [1598240,80696] 0 2024-04-18T21:06:58.310 INFO:tasks.workunit.client.0.smithi078.stdout:3/162: fsync d4/f13 0 2024-04-18T21:06:58.310 INFO:tasks.workunit.client.0.smithi078.stdout:6/145: write d2/f21 [87799,92880] 0 2024-04-18T21:06:58.311 INFO:tasks.workunit.client.0.smithi078.stdout:6/146: mkdir d2/d34/d35 0 2024-04-18T21:06:58.311 INFO:tasks.workunit.client.0.smithi078.stdout:3/163: link d4/l20 d4/l2a 0 2024-04-18T21:06:58.312 INFO:tasks.workunit.client.0.smithi078.stdout:6/147: getdents d2/d1c/d30 0 2024-04-18T21:06:58.312 INFO:tasks.workunit.client.0.smithi078.stdout:3/164: chown d4/df/d17/f25 12430 1 2024-04-18T21:06:58.312 INFO:tasks.workunit.client.0.smithi078.stdout:6/148: symlink d2/d1c/d30/l36 0 2024-04-18T21:06:58.314 INFO:tasks.workunit.client.0.smithi078.stdout:6/149: mknod d2/d34/d35/c37 0 2024-04-18T21:06:58.314 INFO:tasks.workunit.client.0.smithi078.stdout:4/223: truncate d0/f28 4126964 0 2024-04-18T21:06:58.314 INFO:tasks.workunit.client.0.smithi078.stdout:7/195: rename d1/d28 to d1/d16/dc/d4b 0 2024-04-18T21:06:58.315 INFO:tasks.workunit.client.0.smithi078.stdout:0/200: rename d0/d15/d21 to d0/d15/d21/d3a 22 2024-04-18T21:06:58.315 INFO:tasks.workunit.client.0.smithi078.stdout:7/196: stat d1/d32/f41 0 2024-04-18T21:06:58.315 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:58.314+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:58.316 INFO:tasks.workunit.client.0.smithi078.stdout:3/165: dread d4/df/f26 [0,4194304] 0 2024-04-18T21:06:58.317 INFO:tasks.workunit.client.0.smithi078.stdout:3/166: chown d4/df/c16 1747233 1 2024-04-18T21:06:58.317 INFO:tasks.workunit.client.0.smithi078.stdout:2/193: sync 2024-04-18T21:06:58.317 INFO:tasks.workunit.client.0.smithi078.stdout:1/227: sync 2024-04-18T21:06:58.318 INFO:tasks.workunit.client.0.smithi078.stdout:1/228: read - d0/d46/f49 zero size 2024-04-18T21:06:58.318 INFO:tasks.workunit.client.0.smithi078.stdout:2/194: chown d0/db/d18/d21/d27/d29/d33 48986 1 2024-04-18T21:06:58.318 INFO:tasks.workunit.client.0.smithi078.stdout:9/164: dwrite d7/f3d [0,4194304] 0 2024-04-18T21:06:58.319 INFO:tasks.workunit.client.0.smithi078.stdout:2/195: chown d0/db/f36 62 1 2024-04-18T21:06:58.320 INFO:tasks.workunit.client.0.smithi078.stdout:2/196: creat d0/db/d18/d21/d27/d29/f39 x:0 0 0 2024-04-18T21:06:58.320 INFO:tasks.workunit.client.0.smithi078.stdout:1/229: fsync d0/d2a/d3c/d4b/d4/f3d 0 2024-04-18T21:06:58.321 INFO:tasks.workunit.client.0.smithi078.stdout:2/197: write d0/fe [1373447,19639] 0 2024-04-18T21:06:58.321 INFO:tasks.workunit.client.0.smithi078.stdout:5/254: dread d9/da/d4b/f4d [0,4194304] 0 2024-04-18T21:06:58.322 INFO:tasks.workunit.client.0.smithi078.stdout:1/230: symlink d0/l4f 0 2024-04-18T21:06:58.322 INFO:tasks.workunit.client.0.smithi078.stdout:2/198: stat d0/c1b 0 2024-04-18T21:06:58.322 INFO:tasks.workunit.client.0.smithi078.stdout:5/255: stat d9/da/d3e/d4c 0 2024-04-18T21:06:58.322 INFO:tasks.workunit.client.0.smithi078.stdout:2/199: chown d0/db/c2a 0 1 2024-04-18T21:06:58.323 INFO:tasks.workunit.client.0.smithi078.stdout:5/256: chown d9/da/d4b 12499545 1 2024-04-18T21:06:58.323 INFO:tasks.workunit.client.0.smithi078.stdout:5/257: write d9/d2e/d29/f2f [166131,75126] 0 2024-04-18T21:06:58.324 INFO:tasks.workunit.client.0.smithi078.stdout:3/167: truncate d4/f13 5599740 0 2024-04-18T21:06:58.325 INFO:tasks.workunit.client.0.smithi078.stdout:3/168: rmdir d4 39 2024-04-18T21:06:58.325 INFO:tasks.workunit.client.0.smithi078.stdout:5/258: symlink d9/da/d3e/l52 0 2024-04-18T21:06:58.325 INFO:tasks.workunit.client.0.smithi078.stdout:2/200: link d0/cf d0/db/d18/d21/d27/d29/d33/c3a 0 2024-04-18T21:06:58.325 INFO:tasks.workunit.client.0.smithi078.stdout:9/165: dwrite d7/df/f13 [0,4194304] 0 2024-04-18T21:06:58.325 INFO:tasks.workunit.client.0.smithi078.stdout:7/197: getdents d1 0 2024-04-18T21:06:58.326 INFO:tasks.workunit.client.0.smithi078.stdout:5/259: unlink d9/d2e/l3b 0 2024-04-18T21:06:58.327 INFO:tasks.workunit.client.0.smithi078.stdout:3/169: dread - d4/da/d11/f21 zero size 2024-04-18T21:06:58.327 INFO:tasks.workunit.client.0.smithi078.stdout:9/166: mkdir d7/df/d1e/d40 0 2024-04-18T21:06:58.327 INFO:tasks.workunit.client.0.smithi078.stdout:7/198: write d1/d16/f26 [2075260,40408] 0 2024-04-18T21:06:58.327 INFO:tasks.workunit.client.0.smithi078.stdout:5/260: fdatasync f8 0 2024-04-18T21:06:58.327 INFO:tasks.workunit.client.0.smithi078.stdout:0/201: getdents d0/d9/da/db/d35 0 2024-04-18T21:06:58.329 INFO:tasks.workunit.client.0.smithi078.stdout:9/167: write d7/f24 [439509,103242] 0 2024-04-18T21:06:58.329 INFO:tasks.workunit.client.0.smithi078.stdout:7/199: chown d1/d16/d1c/f2a 5 1 2024-04-18T21:06:58.330 INFO:tasks.workunit.client.0.smithi078.stdout:0/202: write d0/d9/da/db/d35/f20 [151961,89262] 0 2024-04-18T21:06:58.330 INFO:tasks.workunit.client.0.smithi078.stdout:6/150: truncate d2/f3 3315411 0 2024-04-18T21:06:58.330 INFO:tasks.workunit.client.0.smithi078.stdout:5/261: truncate d9/da/f1b 485813 0 2024-04-18T21:06:58.330 INFO:tasks.workunit.client.0.smithi078.stdout:9/168: chown d7/d11/d2d/d26 51 1 2024-04-18T21:06:58.330 INFO:tasks.workunit.client.0.smithi078.stdout:7/200: dread - d1/d16/d2d/f47 zero size 2024-04-18T21:06:58.331 INFO:tasks.workunit.client.0.smithi078.stdout:9/169: mknod d7/d23/c41 0 2024-04-18T21:06:58.331 INFO:tasks.workunit.client.0.smithi078.stdout:0/203: unlink d0/d9/dd/d17/f1d 0 2024-04-18T21:06:58.331 INFO:tasks.workunit.client.0.smithi078.stdout:6/151: fdatasync d2/d1c/f20 0 2024-04-18T21:06:58.332 INFO:tasks.workunit.client.0.smithi078.stdout:9/170: creat d7/df/f42 x:0 0 0 2024-04-18T21:06:58.332 INFO:tasks.workunit.client.0.smithi078.stdout:0/204: write d0/d9/da/db/f33 [4575603,66533] 0 2024-04-18T21:06:58.332 INFO:tasks.workunit.client.0.smithi078.stdout:6/152: unlink d2/d1c/f1d 0 2024-04-18T21:06:58.332 INFO:tasks.workunit.client.0.smithi078.stdout:9/171: symlink d7/l43 0 2024-04-18T21:06:58.333 INFO:tasks.workunit.client.0.smithi078.stdout:2/201: dread d0/db/f16 [0,4194304] 0 2024-04-18T21:06:58.334 INFO:tasks.workunit.client.0.smithi078.stdout:7/201: read d1/d16/d10/f13 [1309108,124029] 0 2024-04-18T21:06:58.334 INFO:tasks.workunit.client.0.smithi078.stdout:6/153: chown d2/d1f/f29 11657 1 2024-04-18T21:06:58.334 INFO:tasks.workunit.client.0.smithi078.stdout:9/172: symlink d7/df/d1e/l44 0 2024-04-18T21:06:58.334 INFO:tasks.workunit.client.0.smithi078.stdout:0/205: creat d0/d9/dd/d17/d2e/d31/f3b x:0 0 0 2024-04-18T21:06:58.335 INFO:tasks.workunit.client.0.smithi078.stdout:2/202: fdatasync d0/db/d18/d21/d27/d29/f39 0 2024-04-18T21:06:58.336 INFO:tasks.workunit.client.0.smithi078.stdout:6/154: rename d2/d6/c13 to d2/d34/d35/c38 0 2024-04-18T21:06:58.337 INFO:tasks.workunit.client.0.smithi078.stdout:0/206: stat d0/d9/d2f/c34 0 2024-04-18T21:06:58.337 INFO:tasks.workunit.client.0.smithi078.stdout:9/173: unlink d7/df/f39 0 2024-04-18T21:06:58.337 INFO:tasks.workunit.client.0.smithi078.stdout:2/203: readlink d0/d1f/l28 0 2024-04-18T21:06:58.337 INFO:tasks.workunit.client.0.smithi078.stdout:2/204: rmdir d0 39 2024-04-18T21:06:58.337 INFO:tasks.workunit.client.0.smithi078.stdout:9/174: fsync d7/df/f10 0 2024-04-18T21:06:58.338 INFO:tasks.workunit.client.0.smithi078.stdout:6/155: dread - d2/d1f/f2c zero size 2024-04-18T21:06:58.338 INFO:tasks.workunit.client.0.smithi078.stdout:5/262: dwrite d9/f34 [0,4194304] 0 2024-04-18T21:06:58.343 INFO:tasks.workunit.client.0.smithi078.stdout:6/156: creat d2/d1f/f39 x:0 0 0 2024-04-18T21:06:58.343 INFO:tasks.workunit.client.0.smithi078.stdout:9/175: mkdir d7/d11/d1b/d45 0 2024-04-18T21:06:58.344 INFO:tasks.workunit.client.0.smithi078.stdout:3/170: dwrite d4/fd [0,4194304] 0 2024-04-18T21:06:58.345 INFO:tasks.workunit.client.0.smithi078.stdout:7/202: dwrite d1/d16/dc/d11/f24 [0,4194304] 0 2024-04-18T21:06:58.345 INFO:tasks.workunit.client.0.smithi078.stdout:8/149: dread d0/fe [0,4194304] 0 2024-04-18T21:06:58.347 INFO:tasks.workunit.client.0.smithi078.stdout:6/157: mkdir d2/d1c/d3a 0 2024-04-18T21:06:58.347 INFO:tasks.workunit.client.0.smithi078.stdout:7/203: read d1/d16/dc/d4b/f42 [3840891,30298] 0 2024-04-18T21:06:58.347 INFO:tasks.workunit.client.0.smithi078.stdout:0/207: dwrite d0/d9/da/db/f33 [0,4194304] 0 2024-04-18T21:06:58.349 INFO:tasks.workunit.client.0.smithi078.stdout:0/208: mknod d0/d9/da/df/c3c 0 2024-04-18T21:06:58.349 INFO:tasks.workunit.client.0.smithi078.stdout:7/204: symlink d1/d16/dc/d4b/l4c 0 2024-04-18T21:06:58.350 INFO:tasks.workunit.client.0.smithi078.stdout:2/205: dwrite d0/f1e [0,4194304] 0 2024-04-18T21:06:58.351 INFO:tasks.workunit.client.0.smithi078.stdout:7/205: dread - d1/d16/d10/f44 zero size 2024-04-18T21:06:58.352 INFO:tasks.workunit.client.0.smithi078.stdout:7/206: symlink d1/d32/l4d 0 2024-04-18T21:06:58.352 INFO:tasks.workunit.client.0.smithi078.stdout:4/224: sync 2024-04-18T21:06:58.354 INFO:tasks.workunit.client.0.smithi078.stdout:3/171: dwrite d4/df/f26 [0,4194304] 0 2024-04-18T21:06:58.355 INFO:tasks.workunit.client.0.smithi078.stdout:2/206: write d0/db/f12 [1669406,8110] 0 2024-04-18T21:06:58.355 INFO:tasks.workunit.client.0.smithi078.stdout:6/158: read d2/fe [443382,2482] 0 2024-04-18T21:06:58.356 INFO:tasks.workunit.client.0.smithi078.stdout:9/176: dwrite d7/df/f21 [0,4194304] 0 2024-04-18T21:06:58.356 INFO:tasks.workunit.client.0.smithi078.stdout:5/263: truncate d9/f34 1364441 0 2024-04-18T21:06:58.356 INFO:tasks.workunit.client.0.smithi078.stdout:3/172: dread - d4/da/d11/f21 zero size 2024-04-18T21:06:58.356 INFO:tasks.workunit.client.0.smithi078.stdout:2/207: mknod d0/d1f/c3b 0 2024-04-18T21:06:58.357 INFO:tasks.workunit.client.0.smithi078.stdout:9/177: write d7/d11/d2d/d26/f2b [652797,67055] 0 2024-04-18T21:06:58.359 INFO:tasks.workunit.client.0.smithi078.stdout:0/209: dwrite d0/f8 [0,4194304] 0 2024-04-18T21:06:58.361 INFO:tasks.workunit.client.0.smithi078.stdout:9/178: creat d7/f46 x:0 0 0 2024-04-18T21:06:58.362 INFO:tasks.workunit.client.0.smithi078.stdout:4/225: dwrite d0/f48 [0,4194304] 0 2024-04-18T21:06:58.363 INFO:tasks.workunit.client.0.smithi078.stdout:0/210: fsync d0/d9/da/df/f25 0 2024-04-18T21:06:58.364 INFO:tasks.workunit.client.0.smithi078.stdout:3/173: rename d4/l2a to d4/df/d17/l2b 0 2024-04-18T21:06:58.365 INFO:tasks.workunit.client.0.smithi078.stdout:2/208: creat d0/db/d18/d21/d27/f3c x:0 0 0 2024-04-18T21:06:58.366 INFO:tasks.workunit.client.0.smithi078.stdout:9/179: rename d7/d11/d2d/d2e to d7/d11/d47 0 2024-04-18T21:06:58.366 INFO:tasks.workunit.client.0.smithi078.stdout:6/159: dwrite d2/d1f/f39 [0,4194304] 0 2024-04-18T21:06:58.366 INFO:tasks.workunit.client.0.smithi078.stdout:8/150: dwrite d0/fe [0,4194304] 0 2024-04-18T21:06:58.366 INFO:tasks.workunit.client.0.smithi078.stdout:1/231: dread d0/d2a/d2f/f38 [0,4194304] 0 2024-04-18T21:06:58.367 INFO:tasks.workunit.client.0.smithi078.stdout:3/174: write d4/da/d11/f21 [832661,110624] 0 2024-04-18T21:06:58.367 INFO:tasks.workunit.client.0.smithi078.stdout:6/160: chown d2/d34 5 1 2024-04-18T21:06:58.368 INFO:tasks.workunit.client.0.smithi078.stdout:3/175: stat d4/df/d17/c24 0 2024-04-18T21:06:58.368 INFO:tasks.workunit.client.0.smithi078.stdout:4/226: mkdir d0/dc/d29/d2f/d4e/d4f 0 2024-04-18T21:06:58.370 INFO:tasks.workunit.client.0.smithi078.stdout:8/151: rename d0/fe to d0/d10/d14/d2d/f31 0 2024-04-18T21:06:58.370 INFO:tasks.workunit.client.0.smithi078.stdout:2/209: symlink d0/db/d18/l3d 0 2024-04-18T21:06:58.370 INFO:tasks.workunit.client.0.smithi078.stdout:1/232: write d0/d2a/d3c/d4b/d4/f28 [3564285,5138] 0 2024-04-18T21:06:58.372 INFO:tasks.workunit.client.0.smithi078.stdout:0/211: link d0/d9/da/db/d35/l36 d0/d9/da/df/l3d 0 2024-04-18T21:06:58.372 INFO:tasks.workunit.client.0.smithi078.stdout:8/152: write d0/f26 [158702,113234] 0 2024-04-18T21:06:58.373 INFO:tasks.workunit.client.0.smithi078.stdout:6/161: rename d2/d1f/f39 to d2/d1c/d30/f3b 0 2024-04-18T21:06:58.373 INFO:tasks.workunit.client.0.smithi078.stdout:7/207: dwrite d1/f3 [0,4194304] 0 2024-04-18T21:06:58.374 INFO:tasks.workunit.client.0.smithi078.stdout:7/208: chown d1/f3 522597023 1 2024-04-18T21:06:58.374 INFO:tasks.workunit.client.0.smithi078.stdout:8/153: write d0/d10/f1c [1420716,101643] 0 2024-04-18T21:06:58.375 INFO:tasks.workunit.client.0.smithi078.stdout:2/210: write d0/db/d18/d21/f2c [1025037,82267] 0 2024-04-18T21:06:58.375 INFO:tasks.workunit.client.0.smithi078.stdout:1/233: rename d0/d2a/d45/d4d to d0/d2a/d2f/d50 0 2024-04-18T21:06:58.375 INFO:tasks.workunit.client.0.smithi078.stdout:6/162: write d2/d6/dd/f15 [3564819,33669] 0 2024-04-18T21:06:58.375 INFO:tasks.workunit.client.0.smithi078.stdout:8/154: fsync d0/fd 0 2024-04-18T21:06:58.375 INFO:tasks.workunit.client.0.smithi078.stdout:4/227: link d0/dc/d10/d41/f45 d0/f50 0 2024-04-18T21:06:58.376 INFO:tasks.workunit.client.0.smithi078.stdout:7/209: truncate d1/f20 401813 0 2024-04-18T21:06:58.376 INFO:tasks.workunit.client.0.smithi078.stdout:3/176: dread d4/f18 [0,4194304] 0 2024-04-18T21:06:58.377 INFO:tasks.workunit.client.0.smithi078.stdout:4/228: truncate d0/dc/d37/f3b 235830 0 2024-04-18T21:06:58.377 INFO:tasks.workunit.client.0.smithi078.stdout:9/180: dread d7/d11/d2d/f31 [0,4194304] 0 2024-04-18T21:06:58.378 INFO:tasks.workunit.client.0.smithi078.stdout:9/181: truncate d7/d11/d2d/f3a 43676 0 2024-04-18T21:06:58.378 INFO:tasks.workunit.client.0.smithi078.stdout:6/163: symlink d2/l3c 0 2024-04-18T21:06:58.378 INFO:tasks.workunit.client.0.smithi078.stdout:3/177: unlink d4/le 0 2024-04-18T21:06:58.379 INFO:tasks.workunit.client.0.smithi078.stdout:0/212: rename d0/d9/dd/c24 to d0/d9/dd/d17/c3e 0 2024-04-18T21:06:58.380 INFO:tasks.workunit.client.0.smithi078.stdout:7/210: getdents d1/d16/d10 0 2024-04-18T21:06:58.381 INFO:tasks.workunit.client.0.smithi078.stdout:5/264: sync 2024-04-18T21:06:58.382 INFO:tasks.workunit.client.0.smithi078.stdout:0/213: mkdir d0/d9/da/db/d35/d3f 0 2024-04-18T21:06:58.383 INFO:tasks.workunit.client.0.smithi078.stdout:6/164: rename d2/d1c/l1e to d2/d6/dd/l3d 0 2024-04-18T21:06:58.383 INFO:tasks.workunit.client.0.smithi078.stdout:2/211: dread d0/f32 [0,4194304] 0 2024-04-18T21:06:58.383 INFO:tasks.workunit.client.0.smithi078.stdout:2/212: sync 2024-04-18T21:06:58.384 INFO:tasks.workunit.client.0.smithi078.stdout:1/234: dwrite d0/d2a/d2f/f44 [0,4194304] 0 2024-04-18T21:06:58.385 INFO:tasks.workunit.client.0.smithi078.stdout:8/155: dwrite d0/fb [8388608,4194304] 0 2024-04-18T21:06:58.385 INFO:tasks.workunit.client.0.smithi078.stdout:5/265: read d9/d2e/d29/f43 [415781,114485] 0 2024-04-18T21:06:58.385 INFO:tasks.workunit.client.0.smithi078.stdout:2/213: rmdir d0/db/d18 39 2024-04-18T21:06:58.385 INFO:tasks.workunit.client.0.smithi078.stdout:6/165: symlink d2/d1f/l3e 0 2024-04-18T21:06:58.385 INFO:tasks.workunit.client.0.smithi078.stdout:8/156: stat d0/d22 0 2024-04-18T21:06:58.386 INFO:tasks.workunit.client.0.smithi078.stdout:9/182: dread d7/f3d [0,4194304] 0 2024-04-18T21:06:58.386 INFO:tasks.workunit.client.0.smithi078.stdout:6/166: chown d2/c2a 14 1 2024-04-18T21:06:58.386 INFO:tasks.workunit.client.0.smithi078.stdout:8/157: chown d0/d10/c16 464165 1 2024-04-18T21:06:58.386 INFO:tasks.workunit.client.0.smithi078.stdout:9/183: dread - d7/f37 zero size 2024-04-18T21:06:58.391 INFO:tasks.workunit.client.0.smithi078.stdout:1/235: mknod d0/d2a/d2f/c51 0 2024-04-18T21:06:58.391 INFO:tasks.workunit.client.0.smithi078.stdout:7/211: dread d1/d16/dc/d11/f24 [0,4194304] 0 2024-04-18T21:06:58.391 INFO:tasks.workunit.client.0.smithi078.stdout:9/184: write d7/f3d [4445157,125728] 0 2024-04-18T21:06:58.391 INFO:tasks.workunit.client.0.smithi078.stdout:6/167: link d2/d6/c19 d2/d34/d35/c3f 0 2024-04-18T21:06:58.391 INFO:tasks.workunit.client.0.smithi078.stdout:1/236: write d0/d2a/d3c/d4b/f24 [1504124,46432] 0 2024-04-18T21:06:58.391 INFO:tasks.workunit.client.0.smithi078.stdout:1/237: sync 2024-04-18T21:06:58.391 INFO:tasks.workunit.client.0.smithi078.stdout:1/238: chown d0/c25 1 1 2024-04-18T21:06:58.391 INFO:tasks.workunit.client.0.smithi078.stdout:8/158: link d0/d10/d14/d2d/l2f d0/l32 0 2024-04-18T21:06:58.391 INFO:tasks.workunit.client.0.smithi078.stdout:9/185: write f5 [4049628,76525] 0 2024-04-18T21:06:58.391 INFO:tasks.workunit.client.0.smithi078.stdout:7/212: creat d1/d16/f4e x:0 0 0 2024-04-18T21:06:58.392 INFO:tasks.workunit.client.0.smithi078.stdout:5/266: dread d9/da/ff [4194304,4194304] 0 2024-04-18T21:06:58.392 INFO:tasks.workunit.client.0.smithi078.stdout:2/214: rename d0/db/d18/d21/d27/d29/f39 to d0/db/d18/f3e 0 2024-04-18T21:06:58.392 INFO:tasks.workunit.client.0.smithi078.stdout:7/213: read - d1/d16/dc/d11/f3d zero size 2024-04-18T21:06:58.392 INFO:tasks.workunit.client.0.smithi078.stdout:8/159: write d0/f1f [5656646,106827] 0 2024-04-18T21:06:58.392 INFO:tasks.workunit.client.0.smithi078.stdout:1/239: mkdir d0/d2a/d3c/d4b/d52 0 2024-04-18T21:06:58.393 INFO:tasks.workunit.client.0.smithi078.stdout:9/186: getdents d7 0 2024-04-18T21:06:58.393 INFO:tasks.workunit.client.0.smithi078.stdout:1/240: mknod d0/c53 0 2024-04-18T21:06:58.394 INFO:tasks.workunit.client.0.smithi078.stdout:9/187: mknod d7/d11/c48 0 2024-04-18T21:06:58.394 INFO:tasks.workunit.client.0.smithi078.stdout:9/188: sync 2024-04-18T21:06:58.394 INFO:tasks.workunit.client.0.smithi078.stdout:4/229: truncate d0/dc/d10/f1b 1461944 0 2024-04-18T21:06:58.395 INFO:tasks.workunit.client.0.smithi078.stdout:4/230: chown d0/dc/d29/d2f/f39 109 1 2024-04-18T21:06:58.396 INFO:tasks.workunit.client.0.smithi078.stdout:6/168: dwrite d2/f21 [0,4194304] 0 2024-04-18T21:06:58.397 INFO:tasks.workunit.client.0.smithi078.stdout:4/231: link d0/dc/d10/f32 d0/dc/d29/f51 0 2024-04-18T21:06:58.398 INFO:tasks.workunit.client.0.smithi078.stdout:6/169: chown d2/d1f/l2f 58 1 2024-04-18T21:06:58.398 INFO:tasks.workunit.client.0.smithi078.stdout:2/215: dwrite d0/d1f/f2b [0,4194304] 0 2024-04-18T21:06:58.398 INFO:tasks.workunit.client.0.smithi078.stdout:4/232: chown d0/dc/d10/d41/f45 643 1 2024-04-18T21:06:58.399 INFO:tasks.workunit.client.0.smithi078.stdout:6/170: creat d2/d34/d35/f40 x:0 0 0 2024-04-18T21:06:58.399 INFO:tasks.workunit.client.0.smithi078.stdout:2/216: write d0/db/f36 [957962,76696] 0 2024-04-18T21:06:58.399 INFO:tasks.workunit.client.0.smithi078.stdout:6/171: sync 2024-04-18T21:06:58.399 INFO:tasks.workunit.client.0.smithi078.stdout:4/233: rmdir d0/dc/d10/d1c 39 2024-04-18T21:06:58.400 INFO:tasks.workunit.client.0.smithi078.stdout:2/217: creat d0/d1f/f3f x:0 0 0 2024-04-18T21:06:58.401 INFO:tasks.workunit.client.0.smithi078.stdout:0/214: mknod d0/d9/da/db/d35/d3f/c40 0 2024-04-18T21:06:58.401 INFO:tasks.workunit.client.0.smithi078.stdout:6/172: write d2/d6/dd/f31 [960576,99300] 0 2024-04-18T21:06:58.401 INFO:tasks.workunit.client.0.smithi078.stdout:8/160: dwrite d0/f1f [0,4194304] 0 2024-04-18T21:06:58.401 INFO:tasks.workunit.client.0.smithi078.stdout:2/218: chown d0/db/d18/d21/d27/f3c 705562650 1 2024-04-18T21:06:58.401 INFO:tasks.workunit.client.0.smithi078.stdout:0/215: creat d0/d9/da/db/d35/d3f/f41 x:0 0 0 2024-04-18T21:06:58.402 INFO:tasks.workunit.client.0.smithi078.stdout:2/219: chown d0/db/d18/d21/d27/d29/d33 23766392 1 2024-04-18T21:06:58.402 INFO:tasks.workunit.client.0.smithi078.stdout:2/220: unlink d0/d1f/l28 0 2024-04-18T21:06:58.404 INFO:tasks.workunit.client.0.smithi078.stdout:0/216: rename d0/d9/da/df/f25 to d0/d9/da/f42 0 2024-04-18T21:06:58.404 INFO:tasks.workunit.client.0.smithi078.stdout:5/267: truncate d9/f44 262236 0 2024-04-18T21:06:58.405 INFO:tasks.workunit.client.0.smithi078.stdout:2/221: mkdir d0/d1f/d34/d40 0 2024-04-18T21:06:58.406 INFO:tasks.workunit.client.0.smithi078.stdout:9/189: write f0 [448559,76174] 0 2024-04-18T21:06:58.406 INFO:tasks.workunit.client.0.smithi078.stdout:5/268: read d9/f1e [3783270,111015] 0 2024-04-18T21:06:58.406 INFO:tasks.workunit.client.0.smithi078.stdout:9/190: fdatasync f5 0 2024-04-18T21:06:58.407 INFO:tasks.workunit.client.0.smithi078.stdout:0/217: creat d0/d9/f43 x:0 0 0 2024-04-18T21:06:58.408 INFO:tasks.workunit.client.0.smithi078.stdout:5/269: mkdir d9/da/d3e/d4c/d53 0 2024-04-18T21:06:58.408 INFO:tasks.workunit.client.0.smithi078.stdout:0/218: fsync d0/d9/da/db/f13 0 2024-04-18T21:06:58.409 INFO:tasks.workunit.client.0.smithi078.stdout:9/191: write d7/df/f42 [429371,10547] 0 2024-04-18T21:06:58.409 INFO:tasks.workunit.client.0.smithi078.stdout:4/234: dwrite d0/dc/d29/d2f/f49 [0,4194304] 0 2024-04-18T21:06:58.409 INFO:tasks.workunit.client.0.smithi078.stdout:2/222: rename d0/db/d18/d21/d27/d29 to d0/db/d18/d21/d27/d29/d33/d41 22 2024-04-18T21:06:58.410 INFO:tasks.workunit.client.0.smithi078.stdout:8/161: dwrite d0/f5 [4194304,4194304] 0 2024-04-18T21:06:58.410 INFO:tasks.workunit.client.0.smithi078.stdout:6/173: dwrite d2/d1f/f2e [0,4194304] 0 2024-04-18T21:06:58.410 INFO:tasks.workunit.client.0.smithi078.stdout:2/223: stat d0/db/d18 0 2024-04-18T21:06:58.411 INFO:tasks.workunit.client.0.smithi078.stdout:6/174: dread - d2/f2b zero size 2024-04-18T21:06:58.414 INFO:tasks.workunit.client.0.smithi078.stdout:9/192: rename l3 to d7/d11/d47/l49 0 2024-04-18T21:06:58.414 INFO:tasks.workunit.client.0.smithi078.stdout:8/162: rename d0/d10/d14/l1b to d0/d10/d14/l33 0 2024-04-18T21:06:58.414 INFO:tasks.workunit.client.0.smithi078.stdout:6/175: unlink d2/d6/c27 0 2024-04-18T21:06:58.414 INFO:tasks.workunit.client.0.smithi078.stdout:4/235: mkdir d0/dc/d29/d2f/d4e/d4f/d52 0 2024-04-18T21:06:58.414 INFO:tasks.workunit.client.0.smithi078.stdout:6/176: stat d2/d34 0 2024-04-18T21:06:58.414 INFO:tasks.workunit.client.0.smithi078.stdout:9/193: readlink d7/d11/d2d/l1f 0 2024-04-18T21:06:58.414 INFO:tasks.workunit.client.0.smithi078.stdout:4/236: fdatasync d0/dc/f1d 0 2024-04-18T21:06:58.415 INFO:tasks.workunit.client.0.smithi078.stdout:0/219: creat d0/d9/da/db/d35/d3f/f44 x:0 0 0 2024-04-18T21:06:58.416 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:58.414+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:58.416 INFO:tasks.workunit.client.0.smithi078.stdout:2/224: link d0/db/l24 d0/d1f/d34/l42 0 2024-04-18T21:06:58.416 INFO:tasks.workunit.client.0.smithi078.stdout:9/194: stat d7/d11/d2d/l19 0 2024-04-18T21:06:58.416 INFO:tasks.workunit.client.0.smithi078.stdout:6/177: truncate d2/d1c/f22 8623111 0 2024-04-18T21:06:58.417 INFO:tasks.workunit.client.0.smithi078.stdout:8/163: getdents d0/d10/d14/d2d 0 2024-04-18T21:06:58.417 INFO:tasks.workunit.client.0.smithi078.stdout:4/237: creat d0/f53 x:0 0 0 2024-04-18T21:06:58.417 INFO:tasks.workunit.client.0.smithi078.stdout:5/270: dwrite d9/da/d4b/f4e [0,4194304] 0 2024-04-18T21:06:58.417 INFO:tasks.workunit.client.0.smithi078.stdout:6/178: readlink d2/d1f/l2f 0 2024-04-18T21:06:58.418 INFO:tasks.workunit.client.0.smithi078.stdout:0/220: rename d0/d9/dd/d17/c3e to d0/d9/dd/d17/c45 0 2024-04-18T21:06:58.418 INFO:tasks.workunit.client.0.smithi078.stdout:5/271: creat d9/da/d3e/d4c/f54 x:0 0 0 2024-04-18T21:06:58.418 INFO:tasks.workunit.client.0.smithi078.stdout:2/225: rename d0/db/d18/d21/d27/f3c to d0/d1f/f43 0 2024-04-18T21:06:58.419 INFO:tasks.workunit.client.0.smithi078.stdout:2/226: readlink d0/l7 0 2024-04-18T21:06:58.419 INFO:tasks.workunit.client.0.smithi078.stdout:4/238: mknod d0/dc/d29/d2f/d4e/d4f/d52/c54 0 2024-04-18T21:06:58.419 INFO:tasks.workunit.client.0.smithi078.stdout:0/221: rmdir d0/d9/da/db/d35 39 2024-04-18T21:06:58.419 INFO:tasks.workunit.client.0.smithi078.stdout:4/239: chown d0/f47 1891012916 1 2024-04-18T21:06:58.420 INFO:tasks.workunit.client.0.smithi078.stdout:9/195: rename d7/df/d1e/d40 to d7/d11/d1b/d4a 0 2024-04-18T21:06:58.420 INFO:tasks.workunit.client.0.smithi078.stdout:4/240: creat d0/dc/f55 x:0 0 0 2024-04-18T21:06:58.420 INFO:tasks.workunit.client.0.smithi078.stdout:5/272: getdents d9/da/d32 0 2024-04-18T21:06:58.420 INFO:tasks.workunit.client.0.smithi078.stdout:8/164: read d0/d10/d14/f1e [312614,103111] 0 2024-04-18T21:06:58.421 INFO:tasks.workunit.client.0.smithi078.stdout:9/196: chown d7/df/d1e/l44 65462013 1 2024-04-18T21:06:58.421 INFO:tasks.workunit.client.0.smithi078.stdout:5/273: mkdir d9/d2e/d29/d55 0 2024-04-18T21:06:58.421 INFO:tasks.workunit.client.0.smithi078.stdout:5/274: readlink d9/da/l16 0 2024-04-18T21:06:58.422 INFO:tasks.workunit.client.0.smithi078.stdout:9/197: mkdir d7/d11/d1b/d45/d4b 0 2024-04-18T21:06:58.422 INFO:tasks.workunit.client.0.smithi078.stdout:5/275: symlink d9/da/d3e/l56 0 2024-04-18T21:06:58.423 INFO:tasks.workunit.client.0.smithi078.stdout:9/198: write d7/d11/d2d/d26/f38 [584142,113760] 0 2024-04-18T21:06:58.423 INFO:tasks.workunit.client.0.smithi078.stdout:5/276: creat d9/da/d4b/f57 x:0 0 0 2024-04-18T21:06:58.426 INFO:tasks.workunit.client.0.smithi078.stdout:8/165: dwrite d0/fb [8388608,4194304] 0 2024-04-18T21:06:58.427 INFO:tasks.workunit.client.0.smithi078.stdout:8/166: symlink d0/d10/d14/d2d/l34 0 2024-04-18T21:06:58.429 INFO:tasks.workunit.client.0.smithi078.stdout:8/167: write d0/d10/d14/f1e [1240398,10301] 0 2024-04-18T21:06:58.430 INFO:tasks.workunit.client.0.smithi078.stdout:8/168: chown d0/d10/d14/c28 2169885 1 2024-04-18T21:06:58.431 INFO:tasks.workunit.client.0.smithi078.stdout:8/169: dread - d0/d10/d14/f21 zero size 2024-04-18T21:06:58.431 INFO:tasks.workunit.client.0.smithi078.stdout:8/170: creat d0/d10/d14/d2d/f35 x:0 0 0 2024-04-18T21:06:58.433 INFO:tasks.workunit.client.0.smithi078.stdout:9/199: rmdir d7/d11/d1b/d4a 0 2024-04-18T21:06:58.434 INFO:tasks.workunit.client.0.smithi078.stdout:8/171: dread d0/f5 [4194304,4194304] 0 2024-04-18T21:06:58.435 INFO:tasks.workunit.client.0.smithi078.stdout:8/172: creat d0/f36 x:0 0 0 2024-04-18T21:06:58.435 INFO:tasks.workunit.client.0.smithi078.stdout:4/241: link d0/dc/d10/d41/f45 d0/dc/d29/d2f/d4e/d4f/d52/f56 0 2024-04-18T21:06:58.436 INFO:tasks.workunit.client.0.smithi078.stdout:4/242: rename d0 to d0/d57 22 2024-04-18T21:06:58.436 INFO:tasks.workunit.client.0.smithi078.stdout:8/173: write d0/d10/d14/f21 [395541,32812] 0 2024-04-18T21:06:58.436 INFO:tasks.workunit.client.0.smithi078.stdout:4/243: fdatasync d0/dc/d29/f44 0 2024-04-18T21:06:58.437 INFO:tasks.workunit.client.0.smithi078.stdout:4/244: write d0/f53 [416814,115655] 0 2024-04-18T21:06:58.438 INFO:tasks.workunit.client.0.smithi078.stdout:4/245: fdatasync d0/f7 0 2024-04-18T21:06:58.439 INFO:tasks.workunit.client.0.smithi078.stdout:5/277: dwrite d9/fe [0,4194304] 0 2024-04-18T21:06:58.441 INFO:tasks.workunit.client.0.smithi078.stdout:8/174: dread d0/f1f [0,4194304] 0 2024-04-18T21:06:58.441 INFO:tasks.workunit.client.0.smithi078.stdout:5/278: creat d9/da/d4b/f58 x:0 0 0 2024-04-18T21:06:58.441 INFO:tasks.workunit.client.0.smithi078.stdout:5/279: chown d9/d2e/f3d 2 1 2024-04-18T21:06:58.447 INFO:tasks.workunit.client.0.smithi078.stdout:8/175: dwrite d0/d10/d14/d2d/f35 [0,4194304] 0 2024-04-18T21:06:58.449 INFO:tasks.workunit.client.0.smithi078.stdout:4/246: truncate d0/dc/f1e 623815 0 2024-04-18T21:06:58.449 INFO:tasks.workunit.client.0.smithi078.stdout:8/176: readlink d0/l32 0 2024-04-18T21:06:58.449 INFO:tasks.workunit.client.0.smithi078.stdout:4/247: rmdir d0/dc/d10/d41 39 2024-04-18T21:06:58.450 INFO:tasks.workunit.client.0.smithi078.stdout:8/177: mkdir d0/d22/d37 0 2024-04-18T21:06:58.450 INFO:tasks.workunit.client.0.smithi078.stdout:9/200: dread d7/d11/d2d/f3a [0,4194304] 0 2024-04-18T21:06:58.450 INFO:tasks.workunit.client.0.smithi078.stdout:8/178: chown d0/d10/f1c 30 1 2024-04-18T21:06:58.450 INFO:tasks.workunit.client.0.smithi078.stdout:9/201: readlink d7/d11/d2d/d26/l32 0 2024-04-18T21:06:58.450 INFO:tasks.workunit.client.0.smithi078.stdout:4/248: write d0/dc/d29/f31 [650651,129708] 0 2024-04-18T21:06:58.451 INFO:tasks.workunit.client.0.smithi078.stdout:1/241: dread d0/d46/d32/f4c [0,4194304] 0 2024-04-18T21:06:58.451 INFO:tasks.workunit.client.0.smithi078.stdout:9/202: write d7/f46 [946094,120753] 0 2024-04-18T21:06:58.451 INFO:tasks.workunit.client.0.smithi078.stdout:4/249: dread - d0/f20 zero size 2024-04-18T21:06:58.451 INFO:tasks.workunit.client.0.smithi078.stdout:8/179: mknod d0/d10/c38 0 2024-04-18T21:06:58.453 INFO:tasks.workunit.client.0.smithi078.stdout:8/180: symlink d0/d10/d14/d2a/l39 0 2024-04-18T21:06:58.454 INFO:tasks.workunit.client.0.smithi078.stdout:4/250: chown d0/dc/d10/d1c/l27 4 1 2024-04-18T21:06:58.454 INFO:tasks.workunit.client.0.smithi078.stdout:6/179: dread d2/d6/f16 [0,4194304] 0 2024-04-18T21:06:58.454 INFO:tasks.workunit.client.0.smithi078.stdout:5/280: fdatasync d9/fe 0 2024-04-18T21:06:58.455 INFO:tasks.workunit.client.0.smithi078.stdout:4/251: write d0/f20 [802752,16525] 0 2024-04-18T21:06:58.455 INFO:tasks.workunit.client.0.smithi078.stdout:6/180: readlink d2/l3c 0 2024-04-18T21:06:58.455 INFO:tasks.workunit.client.0.smithi078.stdout:4/252: chown d0/c26 3 1 2024-04-18T21:06:58.456 INFO:tasks.workunit.client.0.smithi078.stdout:5/281: rename d9/d2e/d29/f2f to d9/da/d3e/f59 0 2024-04-18T21:06:58.457 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:58.458 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:06:58.458 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.458 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4534.0:11248 4.0 e57/32 4:03d1e5dd:::100000030d7.00000001:head v 57'184, mlcod=57'182)", 2024-04-18T21:06:58.458 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:58.447067+0000", 2024-04-18T21:06:58.458 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.012754257999999999, 2024-04-18T21:06:58.458 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012776076000000001, 2024-04-18T21:06:58.458 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:58.458 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:58.458 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:58.458 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:58.458 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.458 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:58.458 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:58.447067+0000", 2024-04-18T21:06:58.459 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:58.459 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.459 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.459 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:58.459 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:58.447067+0000", 2024-04-18T21:06:58.459 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:58.459 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.459 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.459 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:58.459 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:58.447067+0000", 2024-04-18T21:06:58.459 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8999999999999998e-07 2024-04-18T21:06:58.459 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.459 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.459 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:58.460 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:58.453692+0000", 2024-04-18T21:06:58.460 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0066247040000000004 2024-04-18T21:06:58.460 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.460 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.460 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:58.460 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:58.453709+0000", 2024-04-18T21:06:58.460 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7754999999999999e-05 2024-04-18T21:06:58.460 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.460 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.460 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.460 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:58.453720+0000", 2024-04-18T21:06:58.460 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1137e-05 2024-04-18T21:06:58.460 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.460 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.461 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:58.461 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:58.453788+0000", 2024-04-18T21:06:58.461 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7308e-05 2024-04-18T21:06:58.461 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.461 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.461 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:58.461 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:58.453818+0000", 2024-04-18T21:06:58.461 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0385000000000001e-05 2024-04-18T21:06:58.461 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:58.461 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:58.461 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:58.461 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.461 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.461 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:11272 4.2d 4:b71db9e4:::100000032d3.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T21:06:58.461 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:58.451055+0000", 2024-04-18T21:06:58.462 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0087654340000000008, 2024-04-18T21:06:58.462 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088306789999999993, 2024-04-18T21:06:58.462 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:58.462 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:58.462 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:58.462 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:06:58.462 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:06:58.462 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:58.462 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 11272 2024-04-18T21:06:58.462 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.462 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:58.462 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.462 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:58.463 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:58.451055+0000", 2024-04-18T21:06:58.463 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:58.463 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.463 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.463 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:58.463 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:58.451055+0000", 2024-04-18T21:06:58.463 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:58.463 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.463 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.463 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:58.463 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:58.451056+0000", 2024-04-18T21:06:58.463 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0279999999999999e-06 2024-04-18T21:06:58.463 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.463 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.463 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:58.464 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:58.457059+0000", 2024-04-18T21:06:58.464 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0060024450000000003 2024-04-18T21:06:58.464 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.464 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.464 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:58.464 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:58.457073+0000", 2024-04-18T21:06:58.464 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4287000000000001e-05 2024-04-18T21:06:58.464 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.464 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.464 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.464 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:58.457084+0000", 2024-04-18T21:06:58.464 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1158000000000001e-05 2024-04-18T21:06:58.464 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.464 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.464 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:58.465 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:58.457174+0000", 2024-04-18T21:06:58.465 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9482999999999997e-05 2024-04-18T21:06:58.465 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.465 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.465 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:58.465 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:58.457415+0000", 2024-04-18T21:06:58.465 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024145899999999999 2024-04-18T21:06:58.465 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:58.465 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:58.465 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:58.465 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.465 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.465 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:11281 4.3e 4:7f35f880:::1000000316a.00000000:head [write 802752~16525 in=16525b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T21:06:58.465 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:58.457996+0000", 2024-04-18T21:06:58.465 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.001825171, 2024-04-18T21:06:58.466 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00193603, 2024-04-18T21:06:58.466 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:58.466 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:58.466 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:58.466 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:06:58.466 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:06:58.466 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:58.466 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 11281 2024-04-18T21:06:58.466 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.466 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:58.466 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.466 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:58.466 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:58.457996+0000", 2024-04-18T21:06:58.466 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:58.466 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.467 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.467 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:58.467 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:58.457996+0000", 2024-04-18T21:06:58.467 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:58.467 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.467 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.467 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:58.467 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:58.457997+0000", 2024-04-18T21:06:58.467 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.6800000000000009e-07 2024-04-18T21:06:58.467 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.467 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.467 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:58.467 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:58.458022+0000", 2024-04-18T21:06:58.467 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5292000000000001e-05 2024-04-18T21:06:58.468 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.468 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.468 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:58.468 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:58.458042+0000", 2024-04-18T21:06:58.468 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0225e-05 2024-04-18T21:06:58.468 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.468 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.468 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.468 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:58.458050+0000", 2024-04-18T21:06:58.468 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9230000000000002e-06 2024-04-18T21:06:58.468 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.468 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.468 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:58.468 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:58.458111+0000", 2024-04-18T21:06:58.469 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0797000000000001e-05 2024-04-18T21:06:58.469 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.469 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.469 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:58.469 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:58.458243+0000", 2024-04-18T21:06:58.469 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013183699999999999 2024-04-18T21:06:58.469 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:58.469 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:58.469 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:58.469 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.469 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.469 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:11282 4.33 4:cf068428:::100000030d3.00000000:head [read 131072~131072 [4@2280179] out=131072b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-04-18T21:06:58.469 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:58.459154+0000", 2024-04-18T21:06:58.469 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00066675800000000004, 2024-04-18T21:06:58.470 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00084960600000000004, 2024-04-18T21:06:58.470 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:58.470 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:58.470 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:58.470 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:06:58.470 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:06:58.470 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:58.470 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 11282 2024-04-18T21:06:58.470 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.470 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:58.470 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.470 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:58.470 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:58.459154+0000", 2024-04-18T21:06:58.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:58.471 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.471 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.471 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:58.471 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:58.459154+0000", 2024-04-18T21:06:58.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:58.471 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.471 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.471 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:58.471 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:58.459155+0000", 2024-04-18T21:06:58.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.049e-06 2024-04-18T21:06:58.471 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.471 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.471 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:58.471 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:58.459160+0000", 2024-04-18T21:06:58.472 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7489999999999998e-06 2024-04-18T21:06:58.472 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.472 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.472 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:58.472 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:58.459173+0000", 2024-04-18T21:06:58.472 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2741e-05 2024-04-18T21:06:58.472 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.472 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.472 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.472 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:58.459180+0000", 2024-04-18T21:06:58.472 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8779999999999998e-06 2024-04-18T21:06:58.472 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.472 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.472 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:58.473 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:58.459237+0000", 2024-04-18T21:06:58.473 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6623000000000003e-05 2024-04-18T21:06:58.473 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.473 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:58.473 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:58.459335+0000", 2024-04-18T21:06:58.473 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.789e-05 2024-04-18T21:06:58.473 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:58.473 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:58.473 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:58.473 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.473 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:858 3.13 e57/15 3:cb3d3880:::200.0000000d:head v 57'90, mlcod=57'86)", 2024-04-18T21:06:58.473 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:58.459346+0000", 2024-04-18T21:06:58.474 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00047503200000000002, 2024-04-18T21:06:58.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00074431300000000003, 2024-04-18T21:06:58.474 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:58.474 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:58.474 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:58.474 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:58.474 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.474 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:58.474 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:58.459346+0000", 2024-04-18T21:06:58.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:58.474 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.474 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.474 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:58.474 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:58.459346+0000", 2024-04-18T21:06:58.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:58.475 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.475 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:58.475 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:58.459346+0000", 2024-04-18T21:06:58.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1999999999999999e-07 2024-04-18T21:06:58.475 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.475 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:58.475 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:58.459356+0000", 2024-04-18T21:06:58.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.4609999999999997e-06 2024-04-18T21:06:58.475 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.475 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:58.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:58.459365+0000", 2024-04-18T21:06:58.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5070000000000006e-06 2024-04-18T21:06:58.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:58.459373+0000", 2024-04-18T21:06:58.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1899999999999998e-06 2024-04-18T21:06:58.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:58.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:58.459410+0000", 2024-04-18T21:06:58.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7113999999999997e-05 2024-04-18T21:06:58.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:58.477 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:58.459422+0000", 2024-04-18T21:06:58.477 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2736e-05 2024-04-18T21:06:58.477 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:58.477 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:58.477 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:58.477 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:58.477 INFO:teuthology.orchestra.run.smithi187.stdout: ], 2024-04-18T21:06:58.477 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 5 2024-04-18T21:06:58.477 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:58.480 INFO:tasks.workunit.client.0.smithi078.stdout:1/242: dwrite d0/d2a/d2f/f33 [0,4194304] 0 2024-04-18T21:06:58.480 INFO:tasks.workunit.client.0.smithi078.stdout:4/253: truncate d0/dc/d10/d41/f45 478285 0 2024-04-18T21:06:58.480 INFO:tasks.workunit.client.0.smithi078.stdout:1/243: fdatasync d0/d46/f17 0 2024-04-18T21:06:58.480 INFO:tasks.workunit.client.0.smithi078.stdout:4/254: creat d0/f58 x:0 0 0 2024-04-18T21:06:58.480 INFO:tasks.workunit.client.0.smithi078.stdout:1/244: creat d0/d2a/d45/f54 x:0 0 0 2024-04-18T21:06:58.481 INFO:tasks.workunit.client.0.smithi078.stdout:1/245: chown d0/d2a/d3c/d4b/d4/l15 19952 1 2024-04-18T21:06:58.481 INFO:tasks.workunit.client.0.smithi078.stdout:0/222: sync 2024-04-18T21:06:58.481 INFO:tasks.workunit.client.0.smithi078.stdout:0/223: rmdir d0/d9/dd 39 2024-04-18T21:06:58.481 INFO:tasks.workunit.client.0.smithi078.stdout:1/246: creat d0/d46/d32/d35/f55 x:0 0 0 2024-04-18T21:06:58.481 INFO:tasks.workunit.client.0.smithi078.stdout:6/181: dwrite d2/d1f/f25 [0,4194304] 0 2024-04-18T21:06:58.481 INFO:tasks.workunit.client.0.smithi078.stdout:6/182: dread - d2/d6/dd/f32 zero size 2024-04-18T21:06:58.481 INFO:tasks.workunit.client.0.smithi078.stdout:9/203: truncate d7/f3d 3639266 0 2024-04-18T21:06:58.481 INFO:tasks.workunit.client.0.smithi078.stdout:6/183: rename d2/c2a to d2/d34/d35/c41 0 2024-04-18T21:06:58.481 INFO:tasks.workunit.client.0.smithi078.stdout:4/255: dwrite d0/dc/d37/f3b [0,4194304] 0 2024-04-18T21:06:58.481 INFO:tasks.workunit.client.0.smithi078.stdout:0/224: read d0/d9/da/f10 [22140,107028] 0 2024-04-18T21:06:58.481 INFO:tasks.workunit.client.0.smithi078.stdout:3/178: dread d4/f13 [4194304,4194304] 0 2024-04-18T21:06:58.481 INFO:tasks.workunit.client.0.smithi078.stdout:2/227: dread d0/fe [0,4194304] 0 2024-04-18T21:06:58.481 INFO:tasks.workunit.client.0.smithi078.stdout:1/247: dwrite d0/d46/d32/f39 [0,4194304] 0 2024-04-18T21:06:58.481 INFO:tasks.workunit.client.0.smithi078.stdout:5/282: write d9/f44 [1259763,115287] 0 2024-04-18T21:06:58.481 INFO:tasks.workunit.client.0.smithi078.stdout:9/204: creat d7/df/f4c x:0 0 0 2024-04-18T21:06:58.482 INFO:tasks.workunit.client.0.smithi078.stdout:4/256: creat d0/dc/d10/d3a/f59 x:0 0 0 2024-04-18T21:06:58.482 INFO:tasks.workunit.client.0.smithi078.stdout:2/228: creat d0/d1f/f44 x:0 0 0 2024-04-18T21:06:58.482 INFO:tasks.workunit.client.0.smithi078.stdout:1/248: creat d0/d2a/d2f/f56 x:0 0 0 2024-04-18T21:06:58.482 INFO:tasks.workunit.client.0.smithi078.stdout:5/283: creat d9/da/d3e/d4c/f5a x:0 0 0 2024-04-18T21:06:58.482 INFO:tasks.workunit.client.0.smithi078.stdout:5/284: write d9/f34 [2375482,61200] 0 2024-04-18T21:06:58.482 INFO:tasks.workunit.client.0.smithi078.stdout:6/184: link d2/d6/f16 d2/d6/dd/f42 0 2024-04-18T21:06:58.482 INFO:tasks.workunit.client.0.smithi078.stdout:2/229: fdatasync d0/f2e 0 2024-04-18T21:06:58.482 INFO:tasks.workunit.client.0.smithi078.stdout:3/179: dread d4/df/d17/f25 [0,4194304] 0 2024-04-18T21:06:58.482 INFO:tasks.workunit.client.0.smithi078.stdout:9/205: dread d7/df/f13 [0,4194304] 0 2024-04-18T21:06:58.482 INFO:tasks.workunit.client.0.smithi078.stdout:1/249: rename d0/d2a/d3c/d4b/l4e to d0/d2a/d3c/d4b/d4/l57 0 2024-04-18T21:06:58.482 INFO:tasks.workunit.client.0.smithi078.stdout:2/230: symlink d0/d1f/l45 0 2024-04-18T21:06:58.482 INFO:tasks.workunit.client.0.smithi078.stdout:9/206: write f6 [3225418,45822] 0 2024-04-18T21:06:58.482 INFO:tasks.workunit.client.0.smithi078.stdout:5/285: dread d9/da/d4b/f4e [0,4194304] 0 2024-04-18T21:06:58.483 INFO:tasks.workunit.client.0.smithi078.stdout:9/207: read - d7/d11/d2d/d26/f3b zero size 2024-04-18T21:06:58.483 INFO:tasks.workunit.client.0.smithi078.stdout:2/231: rmdir d0/db/d18/d21/d27/d29 39 2024-04-18T21:06:58.483 INFO:tasks.workunit.client.0.smithi078.stdout:7/214: dread d1/d32/f41 [0,4194304] 0 2024-04-18T21:06:58.483 INFO:tasks.workunit.client.0.smithi078.stdout:0/225: dwrite d0/d9/da/db/d35/d3f/f44 [0,4194304] 0 2024-04-18T21:06:58.483 INFO:tasks.workunit.client.0.smithi078.stdout:6/185: dwrite d2/f21 [0,4194304] 0 2024-04-18T21:06:58.484 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:58.486 INFO:tasks.workunit.client.0.smithi078.stdout:6/186: dread - d2/d34/d35/f40 zero size 2024-04-18T21:06:58.486 INFO:tasks.workunit.client.0.smithi078.stdout:8/181: dread d0/f6 [0,4194304] 0 2024-04-18T21:06:58.486 INFO:tasks.workunit.client.0.smithi078.stdout:7/215: mkdir d1/d16/dc/d4f 0 2024-04-18T21:06:58.486 INFO:tasks.workunit.client.0.smithi078.stdout:0/226: rmdir d0/d9 39 2024-04-18T21:06:58.486 INFO:tasks.workunit.client.0.smithi078.stdout:9/208: mkdir d7/d11/d2d/d3f/d4d 0 2024-04-18T21:06:58.486 INFO:tasks.workunit.client.0.smithi078.stdout:2/232: rmdir d0/db/d18/d21/d27/d29 39 2024-04-18T21:06:58.486 INFO:tasks.workunit.client.0.smithi078.stdout:8/182: write d0/fd [716909,108808] 0 2024-04-18T21:06:58.487 INFO:tasks.workunit.client.0.smithi078.stdout:6/187: symlink d2/d6/dd/l43 0 2024-04-18T21:06:58.487 INFO:tasks.workunit.client.0.smithi078.stdout:7/216: write d1/d16/f4e [449661,122772] 0 2024-04-18T21:06:58.488 INFO:tasks.workunit.client.0.smithi078.stdout:9/209: write d7/f37 [584469,72785] 0 2024-04-18T21:06:58.488 INFO:tasks.workunit.client.0.smithi078.stdout:8/183: mkdir d0/d10/d14/d2a/d3a 0 2024-04-18T21:06:58.488 INFO:tasks.workunit.client.0.smithi078.stdout:4/257: dwrite d0/dc/d29/f51 [0,4194304] 0 2024-04-18T21:06:58.489 INFO:tasks.workunit.client.0.smithi078.stdout:6/188: write d2/d1f/f2e [4984328,73339] 0 2024-04-18T21:06:58.490 INFO:tasks.workunit.client.0.smithi078.stdout:8/184: rmdir d0/d10 39 2024-04-18T21:06:58.490 INFO:tasks.workunit.client.0.smithi078.stdout:4/258: truncate d0/f7 1592576 0 2024-04-18T21:06:58.491 INFO:tasks.workunit.client.0.smithi078.stdout:3/180: dwrite d4/f13 [0,4194304] 0 2024-04-18T21:06:58.491 INFO:tasks.workunit.client.0.smithi078.stdout:3/181: chown d4/da/d11/d23/c29 69707690 1 2024-04-18T21:06:58.494 INFO:tasks.workunit.client.0.smithi078.stdout:3/182: unlink d4/c8 0 2024-04-18T21:06:58.494 INFO:tasks.workunit.client.0.smithi078.stdout:8/185: write d0/f6 [10816541,41622] 0 2024-04-18T21:06:58.494 INFO:tasks.workunit.client.0.smithi078.stdout:4/259: fsync d0/dc/f1e 0 2024-04-18T21:06:58.495 INFO:tasks.workunit.client.0.smithi078.stdout:5/286: truncate d9/d2e/f26 1126181 0 2024-04-18T21:06:58.495 INFO:tasks.workunit.client.0.smithi078.stdout:4/260: rename d0/dc/d10 to d0/dc/d10/d5a 22 2024-04-18T21:06:58.496 INFO:tasks.workunit.client.0.smithi078.stdout:8/186: link d0/d10/c11 d0/d10/c3b 0 2024-04-18T21:06:58.496 INFO:tasks.workunit.client.0.smithi078.stdout:1/250: dwrite d0/d2a/d3c/d4b/d4/f3d [0,4194304] 0 2024-04-18T21:06:58.497 INFO:tasks.workunit.client.0.smithi078.stdout:8/187: mkdir d0/d10/d14/d2a/d3c 0 2024-04-18T21:06:58.497 INFO:tasks.workunit.client.0.smithi078.stdout:4/261: rename d0/dc/d29/d2f/d4e to d0/dc/d5b 0 2024-04-18T21:06:58.498 INFO:tasks.workunit.client.0.smithi078.stdout:8/188: mknod d0/d10/c3d 0 2024-04-18T21:06:58.498 INFO:tasks.workunit.client.0.smithi078.stdout:4/262: symlink d0/dc/d5b/d4f/d52/l5c 0 2024-04-18T21:06:58.498 INFO:tasks.workunit.client.0.smithi078.stdout:1/251: link d0/l43 d0/d2a/d3c/d4b/d52/l58 0 2024-04-18T21:06:58.500 INFO:tasks.workunit.client.0.smithi078.stdout:3/183: dwrite d4/da/d11/f21 [0,4194304] 0 2024-04-18T21:06:58.501 INFO:tasks.workunit.client.0.smithi078.stdout:3/184: write d4/df/f26 [1848596,54056] 0 2024-04-18T21:06:58.502 INFO:tasks.workunit.client.0.smithi078.stdout:5/287: dwrite d9/da/d32/f51 [0,4194304] 0 2024-04-18T21:06:58.502 INFO:tasks.workunit.client.0.smithi078.stdout:5/288: rmdir d9/d2e 39 2024-04-18T21:06:58.503 INFO:tasks.workunit.client.0.smithi078.stdout:3/185: creat d4/da/d11/f2c x:0 0 0 2024-04-18T21:06:58.503 INFO:tasks.workunit.client.0.smithi078.stdout:3/186: mkdir d4/d2d 0 2024-04-18T21:06:58.504 INFO:tasks.workunit.client.0.smithi078.stdout:5/289: getdents d9/d2e/d29/d55 0 2024-04-18T21:06:58.505 INFO:tasks.workunit.client.0.smithi078.stdout:2/233: truncate d0/db/d18/d21/f31 8893925 0 2024-04-18T21:06:58.506 INFO:tasks.workunit.client.0.smithi078.stdout:0/227: dread d0/d9/da/f42 [0,4194304] 0 2024-04-18T21:06:58.506 INFO:tasks.workunit.client.0.smithi078.stdout:2/234: mknod d0/db/d18/d21/c46 0 2024-04-18T21:06:58.507 INFO:tasks.workunit.client.0.smithi078.stdout:2/235: chown d0/d1f/f3f 126 1 2024-04-18T21:06:58.507 INFO:tasks.workunit.client.0.smithi078.stdout:0/228: write d0/d9/da/db/d35/d3f/f41 [620668,2491] 0 2024-04-18T21:06:58.508 INFO:tasks.workunit.client.0.smithi078.stdout:6/189: truncate d2/f21 1014504 0 2024-04-18T21:06:58.508 INFO:tasks.workunit.client.0.smithi078.stdout:2/236: creat d0/d1f/d34/d40/f47 x:0 0 0 2024-04-18T21:06:58.509 INFO:tasks.workunit.client.0.smithi078.stdout:4/263: rename d0/dc/f1e to d0/dc/d5b/d4f/f5d 0 2024-04-18T21:06:58.510 INFO:tasks.workunit.client.0.smithi078.stdout:6/190: creat d2/d6/f44 x:0 0 0 2024-04-18T21:06:58.510 INFO:tasks.workunit.client.0.smithi078.stdout:1/252: rename d0/d11/f42 to d0/d2a/d2f/d50/f59 0 2024-04-18T21:06:58.510 INFO:tasks.workunit.client.0.smithi078.stdout:7/217: dwrite d1/d16/dc/d4b/f43 [0,4194304] 0 2024-04-18T21:06:58.511 INFO:tasks.workunit.client.0.smithi078.stdout:4/264: chown d0/dc/d10/d1c/l27 1 1 2024-04-18T21:06:58.511 INFO:tasks.workunit.client.0.smithi078.stdout:6/191: readlink d2/d1c/d30/l36 0 2024-04-18T21:06:58.511 INFO:tasks.workunit.client.0.smithi078.stdout:6/192: chown d2/l3c 217 1 2024-04-18T21:06:58.513 INFO:tasks.workunit.client.0.smithi078.stdout:3/187: rename d4/df/c1b to d4/df/d17/c2e 0 2024-04-18T21:06:58.514 INFO:tasks.workunit.client.0.smithi078.stdout:0/229: dwrite d0/d9/f2d [0,4194304] 0 2024-04-18T21:06:58.516 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:58.514+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:58.517 INFO:tasks.workunit.client.0.smithi078.stdout:5/290: rename d9/da/d3e/l56 to d9/da/d4b/l5b 0 2024-04-18T21:06:58.517 INFO:tasks.workunit.client.0.smithi078.stdout:6/193: mkdir d2/d6/d45 0 2024-04-18T21:06:58.517 INFO:tasks.workunit.client.0.smithi078.stdout:4/265: rename d0/dc/d5b/d4f/d52 to d0/dc/d10/d41/d5e 0 2024-04-18T21:06:58.517 INFO:tasks.workunit.client.0.smithi078.stdout:7/218: dread d1/d32/f41 [0,4194304] 0 2024-04-18T21:06:58.517 INFO:tasks.workunit.client.0.smithi078.stdout:5/291: mknod d9/da/d4b/c5c 0 2024-04-18T21:06:58.517 INFO:tasks.workunit.client.0.smithi078.stdout:0/230: write d0/d9/da/db/f13 [3397408,76358] 0 2024-04-18T21:06:58.517 INFO:tasks.workunit.client.0.smithi078.stdout:4/266: chown d0/f20 30334 1 2024-04-18T21:06:58.518 INFO:tasks.workunit.client.0.smithi078.stdout:7/219: mknod d1/c50 0 2024-04-18T21:06:58.518 INFO:tasks.workunit.client.0.smithi078.stdout:6/194: fsync d2/d1c/f20 0 2024-04-18T21:06:58.518 INFO:tasks.workunit.client.0.smithi078.stdout:0/231: fdatasync d0/d9/f23 0 2024-04-18T21:06:58.518 INFO:tasks.workunit.client.0.smithi078.stdout:5/292: mkdir d9/d2e/d29/d55/d5d 0 2024-04-18T21:06:58.518 INFO:tasks.workunit.client.0.smithi078.stdout:0/232: readlink d0/l2 0 2024-04-18T21:06:58.518 INFO:tasks.workunit.client.0.smithi078.stdout:4/267: mkdir d0/dc/d10/d41/d5f 0 2024-04-18T21:06:58.518 INFO:tasks.workunit.client.0.smithi078.stdout:7/220: write d1/d16/d10/f13 [2196941,8905] 0 2024-04-18T21:06:58.519 INFO:tasks.workunit.client.0.smithi078.stdout:0/233: fsync d0/d9/da/db/d35/d3f/f41 0 2024-04-18T21:06:58.519 INFO:tasks.workunit.client.0.smithi078.stdout:7/221: write d1/d16/f4e [534377,54901] 0 2024-04-18T21:06:58.520 INFO:tasks.workunit.client.0.smithi078.stdout:0/234: stat d0/d15/d21 0 2024-04-18T21:06:58.520 INFO:tasks.workunit.client.0.smithi078.stdout:3/188: dwrite d4/da/d11/f22 [0,4194304] 0 2024-04-18T21:06:58.522 INFO:tasks.workunit.client.0.smithi078.stdout:6/195: dread d2/d6/dd/f42 [0,4194304] 0 2024-04-18T21:06:58.523 INFO:tasks.workunit.client.0.smithi078.stdout:7/222: creat d1/d16/dc/f51 x:0 0 0 2024-04-18T21:06:58.523 INFO:tasks.workunit.client.0.smithi078.stdout:6/196: mkdir d2/d34/d35/d46 0 2024-04-18T21:06:58.525 INFO:tasks.workunit.client.0.smithi078.stdout:8/189: truncate d0/d10/d14/f1e 86041 0 2024-04-18T21:06:58.526 INFO:tasks.workunit.client.0.smithi078.stdout:4/268: dwrite d0/dc/d10/f32 [4194304,4194304] 0 2024-04-18T21:06:58.526 INFO:tasks.workunit.client.0.smithi078.stdout:3/189: chown d4/df/d17/c2e 63945920 1 2024-04-18T21:06:58.528 INFO:tasks.workunit.client.0.smithi078.stdout:4/269: mkdir d0/dc/d10/d1c/d60 0 2024-04-18T21:06:58.528 INFO:tasks.workunit.client.0.smithi078.stdout:0/235: dwrite d0/f8 [0,4194304] 0 2024-04-18T21:06:58.529 INFO:tasks.workunit.client.0.smithi078.stdout:3/190: write d4/df/f26 [621235,114859] 0 2024-04-18T21:06:58.529 INFO:tasks.workunit.client.0.smithi078.stdout:3/191: rmdir d4/da/d11/d23 39 2024-04-18T21:06:58.530 INFO:tasks.workunit.client.0.smithi078.stdout:0/236: mkdir d0/d9/dd/d17/d2e/d46 0 2024-04-18T21:06:58.531 INFO:tasks.workunit.client.0.smithi078.stdout:6/197: dwrite d2/d6/f14 [0,4194304] 0 2024-04-18T21:06:58.532 INFO:tasks.workunit.client.0.smithi078.stdout:3/192: readlink d4/da/d11/d23/l28 0 2024-04-18T21:06:58.533 INFO:tasks.workunit.client.0.smithi078.stdout:0/237: symlink d0/d9/dd/d17/d2e/d46/l47 0 2024-04-18T21:06:58.533 INFO:tasks.workunit.client.0.smithi078.stdout:7/223: dwrite d1/d16/dc/f1e [0,4194304] 0 2024-04-18T21:06:58.537 INFO:tasks.workunit.client.0.smithi078.stdout:3/193: rename d4/da/d11/d23/c29 to d4/da/d11/d23/c2f 0 2024-04-18T21:06:58.537 INFO:tasks.workunit.client.0.smithi078.stdout:7/224: creat d1/d16/d10/f52 x:0 0 0 2024-04-18T21:06:58.538 INFO:tasks.workunit.client.0.smithi078.stdout:3/194: mkdir d4/d2d/d30 0 2024-04-18T21:06:58.539 INFO:tasks.workunit.client.0.smithi078.stdout:6/198: dwrite d2/d1f/f2c [0,4194304] 0 2024-04-18T21:06:58.540 INFO:tasks.workunit.client.0.smithi078.stdout:6/199: chown d2/l33 5 1 2024-04-18T21:06:58.541 INFO:tasks.workunit.client.0.smithi078.stdout:6/200: creat d2/d1f/f47 x:0 0 0 2024-04-18T21:06:58.541 INFO:tasks.workunit.client.0.smithi078.stdout:2/237: fdatasync d0/db/d18/d21/d27/d29/f2f 0 2024-04-18T21:06:58.542 INFO:tasks.workunit.client.0.smithi078.stdout:2/238: symlink d0/d1f/l48 0 2024-04-18T21:06:58.542 INFO:tasks.workunit.client.0.smithi078.stdout:6/201: creat d2/d6/dd/f48 x:0 0 0 2024-04-18T21:06:58.544 INFO:tasks.workunit.client.0.smithi078.stdout:6/202: truncate d2/d1c/f20 3494010 0 2024-04-18T21:06:58.545 INFO:tasks.workunit.client.0.smithi078.stdout:6/203: chown d2/d6/c19 68332 1 2024-04-18T21:06:58.546 INFO:tasks.workunit.client.0.smithi078.stdout:3/195: dwrite d4/df/f26 [0,4194304] 0 2024-04-18T21:06:58.547 INFO:tasks.workunit.client.0.smithi078.stdout:3/196: rmdir d4/df 39 2024-04-18T21:06:58.548 INFO:tasks.workunit.client.0.smithi078.stdout:3/197: dread - d4/df/f1f zero size 2024-04-18T21:06:58.549 INFO:tasks.workunit.client.0.smithi078.stdout:3/198: write d4/f18 [3462051,35137] 0 2024-04-18T21:06:58.549 INFO:tasks.workunit.client.0.smithi078.stdout:4/270: write d0/dc/d10/d41/d5e/f56 [1059184,53840] 0 2024-04-18T21:06:58.549 INFO:tasks.workunit.client.0.smithi078.stdout:7/225: truncate d1/d16/dc/f1e 417871 0 2024-04-18T21:06:58.550 INFO:tasks.workunit.client.0.smithi078.stdout:4/271: write d0/f12 [2745844,80474] 0 2024-04-18T21:06:58.550 INFO:tasks.workunit.client.0.smithi078.stdout:4/272: chown d0/f58 30289679 1 2024-04-18T21:06:58.552 INFO:tasks.workunit.client.0.smithi078.stdout:4/273: rename d0/dc/d29/d2f/f39 to d0/dc/d29/d2f/f61 0 2024-04-18T21:06:58.552 INFO:tasks.workunit.client.0.smithi078.stdout:2/239: read d0/db/d18/d21/f2c [354147,60203] 0 2024-04-18T21:06:58.553 INFO:tasks.workunit.client.0.smithi078.stdout:2/240: dread - d0/d1f/f3f zero size 2024-04-18T21:06:58.562 INFO:tasks.workunit.client.0.smithi078.stdout:8/190: dread d0/d10/f1c [0,4194304] 0 2024-04-18T21:06:58.563 INFO:tasks.workunit.client.0.smithi078.stdout:8/191: unlink d0/cf 0 2024-04-18T21:06:58.566 INFO:tasks.workunit.client.0.smithi078.stdout:6/204: truncate d2/d1f/f2c 268768 0 2024-04-18T21:06:58.566 INFO:tasks.workunit.client.0.smithi078.stdout:6/205: fsync d2/f3 0 2024-04-18T21:06:58.567 INFO:tasks.workunit.client.0.smithi078.stdout:3/199: truncate d4/da/d11/f22 1574670 0 2024-04-18T21:06:58.568 INFO:tasks.workunit.client.0.smithi078.stdout:3/200: symlink d4/da/d11/d23/l31 0 2024-04-18T21:06:58.569 INFO:tasks.workunit.client.0.smithi078.stdout:3/201: unlink d4/df/d17/f25 0 2024-04-18T21:06:58.569 INFO:tasks.workunit.client.0.smithi078.stdout:1/253: sync 2024-04-18T21:06:58.570 INFO:tasks.workunit.client.0.smithi078.stdout:1/254: symlink d0/d2a/d3c/l5a 0 2024-04-18T21:06:58.570 INFO:tasks.workunit.client.0.smithi078.stdout:3/202: chown d4/da/d11/d23/l31 1337268 1 2024-04-18T21:06:58.570 INFO:tasks.workunit.client.0.smithi078.stdout:7/226: dwrite d1/d16/dc/f37 [0,4194304] 0 2024-04-18T21:06:58.572 INFO:tasks.workunit.client.0.smithi078.stdout:9/210: dread f6 [4194304,4194304] 0 2024-04-18T21:06:58.572 INFO:tasks.workunit.client.0.smithi078.stdout:2/241: truncate d0/fe 2347695 0 2024-04-18T21:06:58.572 INFO:tasks.workunit.client.0.smithi078.stdout:2/242: fdatasync d0/f10 0 2024-04-18T21:06:58.573 INFO:tasks.workunit.client.0.smithi078.stdout:9/211: rmdir d7/d11/d2d/d3f 39 2024-04-18T21:06:58.573 INFO:tasks.workunit.client.0.smithi078.stdout:2/243: truncate d0/f1d 202911 0 2024-04-18T21:06:58.574 INFO:tasks.workunit.client.0.smithi078.stdout:6/206: fdatasync d2/d1c/f22 0 2024-04-18T21:06:58.574 INFO:tasks.workunit.client.0.smithi078.stdout:9/212: creat d7/d11/d2d/f4e x:0 0 0 2024-04-18T21:06:58.574 INFO:tasks.workunit.client.0.smithi078.stdout:2/244: mknod d0/db/d18/c49 0 2024-04-18T21:06:58.575 INFO:tasks.workunit.client.0.smithi078.stdout:2/245: chown d0/d1f/f2b 10 1 2024-04-18T21:06:58.576 INFO:tasks.workunit.client.0.smithi078.stdout:2/246: unlink d0/db/d18/d21/f23 0 2024-04-18T21:06:58.576 INFO:tasks.workunit.client.0.smithi078.stdout:7/227: dwrite d1/d16/d10/f13 [0,4194304] 0 2024-04-18T21:06:58.579 INFO:tasks.workunit.client.0.smithi078.stdout:7/228: mkdir d1/d16/dc/d11/d53 0 2024-04-18T21:06:58.579 INFO:tasks.workunit.client.0.smithi078.stdout:1/255: dwrite d0/d2a/d2f/f38 [4194304,4194304] 0 2024-04-18T21:06:58.580 INFO:tasks.workunit.client.0.smithi078.stdout:7/229: mknod d1/d16/d1c/c54 0 2024-04-18T21:06:58.580 INFO:tasks.workunit.client.0.smithi078.stdout:1/256: symlink d0/d2a/d3c/d4b/d4/l5b 0 2024-04-18T21:06:58.581 INFO:tasks.workunit.client.0.smithi078.stdout:2/247: getdents d0/db/d18/d21/d27 0 2024-04-18T21:06:58.581 INFO:tasks.workunit.client.0.smithi078.stdout:2/248: chown d0/d1f/c3b 1 1 2024-04-18T21:06:58.581 INFO:tasks.workunit.client.0.smithi078.stdout:7/230: creat d1/d16/dc/f55 x:0 0 0 2024-04-18T21:06:58.582 INFO:tasks.workunit.client.0.smithi078.stdout:2/249: dread - d0/f2e zero size 2024-04-18T21:06:58.582 INFO:tasks.workunit.client.0.smithi078.stdout:7/231: mknod d1/d16/dc/d4b/c56 0 2024-04-18T21:06:58.582 INFO:tasks.workunit.client.0.smithi078.stdout:2/250: dread - d0/db/d18/d21/d27/d29/f2d zero size 2024-04-18T21:06:58.583 INFO:tasks.workunit.client.0.smithi078.stdout:2/251: chown d0/d1f/f2b 12793 1 2024-04-18T21:06:58.583 INFO:tasks.workunit.client.0.smithi078.stdout:7/232: creat d1/f57 x:0 0 0 2024-04-18T21:06:58.584 INFO:tasks.workunit.client.0.smithi078.stdout:9/213: truncate d7/df/f21 3503895 0 2024-04-18T21:06:58.584 INFO:tasks.workunit.client.0.smithi078.stdout:7/233: unlink d1/d16/f3b 0 2024-04-18T21:06:58.584 INFO:tasks.workunit.client.0.smithi078.stdout:2/252: mknod d0/d1f/d34/c4a 0 2024-04-18T21:06:58.584 INFO:tasks.workunit.client.0.smithi078.stdout:9/214: readlink d7/df/d1e/l22 0 2024-04-18T21:06:58.585 INFO:tasks.workunit.client.0.smithi078.stdout:2/253: write d0/db/d18/f3e [564773,8250] 0 2024-04-18T21:06:58.585 INFO:tasks.workunit.client.0.smithi078.stdout:7/234: creat d1/d16/dc/d11/d53/f58 x:0 0 0 2024-04-18T21:06:58.585 INFO:tasks.workunit.client.0.smithi078.stdout:9/215: truncate d7/d11/d2d/d26/f3b 1044676 0 2024-04-18T21:06:58.586 INFO:tasks.workunit.client.0.smithi078.stdout:7/235: symlink d1/d16/d1c/d40/l59 0 2024-04-18T21:06:58.586 INFO:tasks.workunit.client.0.smithi078.stdout:7/236: read - d1/d16/f46 zero size 2024-04-18T21:06:58.591 INFO:tasks.workunit.client.0.smithi078.stdout:9/216: dwrite d7/df/f10 [0,4194304] 0 2024-04-18T21:06:58.592 INFO:tasks.workunit.client.0.smithi078.stdout:7/237: dwrite d1/f1d [0,4194304] 0 2024-04-18T21:06:58.592 INFO:tasks.workunit.client.0.smithi078.stdout:9/217: creat d7/d11/d2d/d3f/d4d/f4f x:0 0 0 2024-04-18T21:06:58.593 INFO:tasks.workunit.client.0.smithi078.stdout:9/218: read d7/f37 [301907,10904] 0 2024-04-18T21:06:58.594 INFO:tasks.workunit.client.0.smithi078.stdout:7/238: truncate d1/d16/dc/d11/f3d 236198 0 2024-04-18T21:06:58.595 INFO:tasks.workunit.client.0.smithi078.stdout:9/219: write d7/d11/d2d/f3a [191262,66257] 0 2024-04-18T21:06:58.596 INFO:tasks.workunit.client.0.smithi078.stdout:7/239: write d1/d16/dc/d4b/f2c [84614,87550] 0 2024-04-18T21:06:58.596 INFO:tasks.workunit.client.0.smithi078.stdout:9/220: chown d7/d11/d2d/d3f 34428 1 2024-04-18T21:06:58.601 INFO:tasks.workunit.client.0.smithi078.stdout:9/221: dwrite d7/df/f4c [0,4194304] 0 2024-04-18T21:06:58.602 INFO:tasks.workunit.client.0.smithi078.stdout:9/222: rmdir d7/d11/d2d/d26 39 2024-04-18T21:06:58.603 INFO:tasks.workunit.client.0.smithi078.stdout:9/223: fdatasync d7/f3d 0 2024-04-18T21:06:58.604 INFO:tasks.workunit.client.0.smithi078.stdout:9/224: truncate d7/d11/d2d/d3f/d4d/f4f 333488 0 2024-04-18T21:06:58.604 INFO:tasks.workunit.client.0.smithi078.stdout:9/225: getdents d7/d11/d1b/d45/d4b 0 2024-04-18T21:06:58.605 INFO:tasks.workunit.client.0.smithi078.stdout:9/226: mknod d7/d11/d2d/d3f/c50 0 2024-04-18T21:06:58.605 INFO:tasks.workunit.client.0.smithi078.stdout:9/227: mknod d7/c51 0 2024-04-18T21:06:58.606 INFO:tasks.workunit.client.0.smithi078.stdout:9/228: mknod d7/d11/d1b/c52 0 2024-04-18T21:06:58.608 INFO:tasks.workunit.client.0.smithi078.stdout:2/254: dwrite d0/f32 [0,4194304] 0 2024-04-18T21:06:58.610 INFO:tasks.workunit.client.0.smithi078.stdout:2/255: write d0/d1f/f43 [868249,35053] 0 2024-04-18T21:06:58.612 INFO:tasks.workunit.client.0.smithi078.stdout:0/238: sync 2024-04-18T21:06:58.612 INFO:tasks.workunit.client.0.smithi078.stdout:4/274: sync 2024-04-18T21:06:58.612 INFO:tasks.workunit.client.0.smithi078.stdout:5/293: sync 2024-04-18T21:06:58.612 INFO:tasks.workunit.client.0.smithi078.stdout:2/256: chown d0/c15 111103900 1 2024-04-18T21:06:58.613 INFO:tasks.workunit.client.0.smithi078.stdout:4/275: creat d0/dc/d5b/f62 x:0 0 0 2024-04-18T21:06:58.613 INFO:tasks.workunit.client.0.smithi078.stdout:9/229: dwrite d7/d11/d2d/d26/f3b [0,4194304] 0 2024-04-18T21:06:58.613 INFO:tasks.workunit.client.0.smithi078.stdout:0/239: chown d0/d9/da/db/l11 409355 1 2024-04-18T21:06:58.614 INFO:tasks.workunit.client.0.smithi078.stdout:0/240: rename d0 to d0/d9/da/db/d35/d3f/d48 22 2024-04-18T21:06:58.614 INFO:tasks.workunit.client.0.smithi078.stdout:9/230: dread d7/d11/d2d/f3a [0,4194304] 0 2024-04-18T21:06:58.614 INFO:tasks.workunit.client.0.smithi078.stdout:1/257: dread d0/d2a/d3c/d4b/d4/f28 [0,4194304] 0 2024-04-18T21:06:58.614 INFO:tasks.workunit.client.0.smithi078.stdout:9/231: chown d7/f37 101821595 1 2024-04-18T21:06:58.615 INFO:tasks.workunit.client.0.smithi078.stdout:2/257: symlink d0/db/d18/d21/d27/l4b 0 2024-04-18T21:06:58.615 INFO:tasks.workunit.client.0.smithi078.stdout:9/232: chown d7/d11/d2d/d26/f38 6 1 2024-04-18T21:06:58.615 INFO:tasks.workunit.client.0.smithi078.stdout:0/241: unlink d0/d15/l19 0 2024-04-18T21:06:58.615 INFO:tasks.workunit.client.0.smithi078.stdout:1/258: creat d0/d2a/d45/f5c x:0 0 0 2024-04-18T21:06:58.617 INFO:tasks.workunit.client.0.smithi078.stdout:4/276: creat d0/dc/f63 x:0 0 0 2024-04-18T21:06:58.617 INFO:tasks.workunit.client.0.smithi078.stdout:1/259: dread - d0/d2a/d3c/d4b/f3e zero size 2024-04-18T21:06:58.617 INFO:tasks.workunit.client.0.smithi078.stdout:1/260: rmdir d0/d46 39 2024-04-18T21:06:58.617 INFO:tasks.workunit.client.0.smithi078.stdout:0/242: truncate d0/d9/dd/d17/d2e/f39 41448 0 2024-04-18T21:06:58.617 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:58.614+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:58.618 INFO:tasks.workunit.client.0.smithi078.stdout:4/277: rename d0/dc/c2b to d0/dc/d37/c64 0 2024-04-18T21:06:58.618 INFO:tasks.workunit.client.0.smithi078.stdout:0/243: getdents d0/d9/da/db/d35/d3f 0 2024-04-18T21:06:58.618 INFO:tasks.workunit.client.0.smithi078.stdout:0/244: mknod d0/d9/dd/d17/d2e/d46/c49 0 2024-04-18T21:06:58.619 INFO:tasks.workunit.client.0.smithi078.stdout:0/245: creat d0/d9/dd/d17/d2e/d31/f4a x:0 0 0 2024-04-18T21:06:58.621 INFO:tasks.workunit.client.0.smithi078.stdout:4/278: dread d0/dc/d29/f51 [4194304,4194304] 0 2024-04-18T21:06:58.621 INFO:tasks.workunit.client.0.smithi078.stdout:4/279: mknod d0/dc/d10/d3a/c65 0 2024-04-18T21:06:58.622 INFO:tasks.workunit.client.0.smithi078.stdout:4/280: chown d0/dc/d10 2991710 1 2024-04-18T21:06:58.622 INFO:tasks.workunit.client.0.smithi078.stdout:1/261: dwrite d0/f3f [0,4194304] 0 2024-04-18T21:06:58.623 INFO:tasks.workunit.client.0.smithi078.stdout:1/262: readlink d0/d2a/d3c/d4b/d4/l5b 0 2024-04-18T21:06:58.628 INFO:tasks.workunit.client.0.smithi078.stdout:4/281: dwrite d0/dc/d10/d3a/f40 [0,4194304] 0 2024-04-18T21:06:58.630 INFO:tasks.workunit.client.0.smithi078.stdout:1/263: dwrite d0/d11/f22 [0,4194304] 0 2024-04-18T21:06:58.633 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:58.633 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:06:58.633 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-18T21:06:58.633 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-18T21:06:58.633 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:58.634 INFO:tasks.workunit.client.0.smithi078.stdout:1/264: dread d0/d2a/d3c/d4b/d4/f28 [0,4194304] 0 2024-04-18T21:06:58.634 INFO:tasks.workunit.client.0.smithi078.stdout:4/282: dwrite d0/dc/f55 [0,4194304] 0 2024-04-18T21:06:58.635 INFO:tasks.workunit.client.0.smithi078.stdout:1/265: creat d0/d2a/d45/f5d x:0 0 0 2024-04-18T21:06:58.635 INFO:tasks.workunit.client.0.smithi078.stdout:4/283: symlink d0/dc/d37/l66 0 2024-04-18T21:06:58.636 INFO:tasks.workunit.client.0.smithi078.stdout:4/284: readlink d0/dc/l15 0 2024-04-18T21:06:58.638 INFO:tasks.workunit.client.0.smithi078.stdout:5/294: truncate d9/f1e 4166707 0 2024-04-18T21:06:58.639 INFO:tasks.workunit.client.0.smithi078.stdout:1/266: dread d0/d2a/d2f/f33 [0,4194304] 0 2024-04-18T21:06:58.639 INFO:tasks.workunit.client.0.smithi078.stdout:1/267: mkdir d0/d2a/d3c/d4b/d5e 0 2024-04-18T21:06:58.640 INFO:tasks.workunit.client.0.smithi078.stdout:1/268: mkdir d0/d2a/d5f 0 2024-04-18T21:06:58.640 INFO:tasks.workunit.client.0.smithi078.stdout:2/258: link d0/db/d18/d21/d27/d29/f2d d0/db/d18/d21/d27/d29/d33/f4c 0 2024-04-18T21:06:58.641 INFO:tasks.workunit.client.0.smithi078.stdout:1/269: mknod d0/d46/c60 0 2024-04-18T21:06:58.641 INFO:tasks.workunit.client.0.smithi078.stdout:1/270: mkdir d0/d2a/d3c/d4b/d4/d61 0 2024-04-18T21:06:58.642 INFO:tasks.workunit.client.0.smithi078.stdout:1/271: creat d0/d2a/f62 x:0 0 0 2024-04-18T21:06:58.645 INFO:tasks.workunit.client.0.smithi078.stdout:4/285: write d0/f28 [475605,13809] 0 2024-04-18T21:06:58.646 INFO:tasks.workunit.client.0.smithi078.stdout:5/295: truncate d9/da/d3e/f59 384159 0 2024-04-18T21:06:58.646 INFO:tasks.workunit.client.0.smithi078.stdout:9/233: write d7/df/f21 [1061266,103046] 0 2024-04-18T21:06:58.647 INFO:tasks.workunit.client.0.smithi078.stdout:5/296: fdatasync d9/d2e/d29/f40 0 2024-04-18T21:06:58.647 INFO:tasks.workunit.client.0.smithi078.stdout:9/234: creat d7/f53 x:0 0 0 2024-04-18T21:06:58.647 INFO:tasks.workunit.client.0.smithi078.stdout:9/235: mkdir d7/df/d54 0 2024-04-18T21:06:58.648 INFO:tasks.workunit.client.0.smithi078.stdout:5/297: rename d9/da/d32/l46 to d9/da/d3e/d4c/l5e 0 2024-04-18T21:06:58.648 INFO:tasks.workunit.client.0.smithi078.stdout:5/298: stat d9/f44 0 2024-04-18T21:06:58.648 INFO:tasks.workunit.client.0.smithi078.stdout:1/272: read d0/d2a/d3c/d4b/f24 [1900798,83602] 0 2024-04-18T21:06:58.649 INFO:tasks.workunit.client.0.smithi078.stdout:1/273: mkdir d0/d2a/d63 0 2024-04-18T21:06:58.650 INFO:tasks.workunit.client.0.smithi078.stdout:5/299: rename d9/c14 to d9/da/d3e/d4c/d53/c5f 0 2024-04-18T21:06:58.651 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:06:58.652 INFO:tasks.workunit.client.0.smithi078.stdout:4/286: dread d0/f53 [0,4194304] 0 2024-04-18T21:06:58.652 INFO:tasks.workunit.client.0.smithi078.stdout:4/287: unlink d0/f12 0 2024-04-18T21:06:58.652 INFO:tasks.workunit.client.0.smithi078.stdout:9/236: dread d7/df/f13 [0,4194304] 0 2024-04-18T21:06:58.652 INFO:tasks.workunit.client.0.smithi078.stdout:6/207: sync 2024-04-18T21:06:58.653 INFO:tasks.workunit.client.0.smithi078.stdout:3/203: sync 2024-04-18T21:06:58.653 INFO:tasks.workunit.client.0.smithi078.stdout:7/240: sync 2024-04-18T21:06:58.653 INFO:tasks.workunit.client.0.smithi078.stdout:8/192: sync 2024-04-18T21:06:58.653 INFO:tasks.workunit.client.0.smithi078.stdout:0/246: sync 2024-04-18T21:06:58.654 INFO:tasks.workunit.client.0.smithi078.stdout:6/208: mknod d2/d1c/c49 0 2024-04-18T21:06:58.654 INFO:tasks.workunit.client.0.smithi078.stdout:3/204: write d4/f13 [4482053,64725] 0 2024-04-18T21:06:58.655 INFO:tasks.workunit.client.0.smithi078.stdout:8/193: fdatasync d0/d10/d14/f21 0 2024-04-18T21:06:58.656 INFO:tasks.workunit.client.0.smithi078.stdout:6/209: dread - d2/d6/f44 zero size 2024-04-18T21:06:58.656 INFO:tasks.workunit.client.0.smithi078.stdout:0/247: creat d0/d9/da/db/d35/f4b x:0 0 0 2024-04-18T21:06:58.656 INFO:tasks.workunit.client.0.smithi078.stdout:3/205: fdatasync d4/df/f1f 0 2024-04-18T21:06:58.657 INFO:tasks.workunit.client.0.smithi078.stdout:8/194: symlink d0/l3e 0 2024-04-18T21:06:58.658 INFO:tasks.workunit.client.0.smithi078.stdout:5/300: dwrite d9/da/d32/f51 [4194304,4194304] 0 2024-04-18T21:06:58.660 INFO:tasks.workunit.client.0.smithi078.stdout:9/237: dwrite d7/f53 [0,4194304] 0 2024-04-18T21:06:58.662 INFO:tasks.workunit.client.0.smithi078.stdout:7/241: dwrite d1/f3 [0,4194304] 0 2024-04-18T21:06:58.663 INFO:tasks.workunit.client.0.smithi078.stdout:7/242: mkdir d1/d16/d10/d5a 0 2024-04-18T21:06:58.663 INFO:tasks.workunit.client.0.smithi078.stdout:3/206: creat d4/da/d11/f32 x:0 0 0 2024-04-18T21:06:58.664 INFO:tasks.workunit.client.0.smithi078.stdout:5/301: dread d9/da/ff [4194304,4194304] 0 2024-04-18T21:06:58.665 INFO:tasks.workunit.client.0.smithi078.stdout:1/274: dread d0/d2a/d3c/d4b/d4/fc [0,4194304] 0 2024-04-18T21:06:58.668 INFO:tasks.workunit.client.0.smithi078.stdout:4/288: write d0/dc/d5b/d4f/f5d [817975,87334] 0 2024-04-18T21:06:58.669 INFO:tasks.workunit.client.0.smithi078.stdout:9/238: mkdir d7/d23/d3e/d55 0 2024-04-18T21:06:58.669 INFO:tasks.workunit.client.0.smithi078.stdout:7/243: rmdir d1/d16/d1c 39 2024-04-18T21:06:58.669 INFO:tasks.workunit.client.0.smithi078.stdout:3/207: creat d4/da/d11/d23/f33 x:0 0 0 2024-04-18T21:06:58.670 INFO:tasks.workunit.client.0.smithi078.stdout:1/275: symlink d0/d2a/d63/l64 0 2024-04-18T21:06:58.670 INFO:tasks.workunit.client.0.smithi078.stdout:7/244: creat d1/d16/dc/f5b x:0 0 0 2024-04-18T21:06:58.670 INFO:tasks.workunit.client.0.smithi078.stdout:2/259: dread d0/f10 [0,4194304] 0 2024-04-18T21:06:58.671 INFO:tasks.workunit.client.0.smithi078.stdout:3/208: creat d4/d2d/d30/f34 x:0 0 0 2024-04-18T21:06:58.671 INFO:tasks.workunit.client.0.smithi078.stdout:1/276: dread - d0/d2a/d2f/d50/f59 zero size 2024-04-18T21:06:58.671 INFO:tasks.workunit.client.0.smithi078.stdout:8/195: dwrite d0/d10/d14/d2d/f31 [0,4194304] 0 2024-04-18T21:06:58.673 INFO:tasks.workunit.client.0.smithi078.stdout:7/245: link d1/d16/d1c/l3e d1/d16/d10/l5c 0 2024-04-18T21:06:58.673 INFO:tasks.workunit.client.0.smithi078.stdout:1/277: rename d0/d11/f3a to d0/d2a/f65 0 2024-04-18T21:06:58.674 INFO:tasks.workunit.client.0.smithi078.stdout:7/246: creat d1/d32/f5d x:0 0 0 2024-04-18T21:06:58.674 INFO:tasks.workunit.client.0.smithi078.stdout:1/278: symlink d0/d2a/d3c/d4b/l66 0 2024-04-18T21:06:58.675 INFO:tasks.workunit.client.0.smithi078.stdout:6/210: truncate d2/f21 12073 0 2024-04-18T21:06:58.675 INFO:tasks.workunit.client.0.smithi078.stdout:7/247: readlink d1/l27 0 2024-04-18T21:06:58.675 INFO:tasks.workunit.client.0.smithi078.stdout:7/248: chown d1 195649 1 2024-04-18T21:06:58.675 INFO:tasks.workunit.client.0.smithi078.stdout:2/260: dread d0/f32 [0,4194304] 0 2024-04-18T21:06:58.676 INFO:tasks.workunit.client.0.smithi078.stdout:1/279: chown d0/d2a/d2f/f36 1 1 2024-04-18T21:06:58.676 INFO:tasks.workunit.client.0.smithi078.stdout:6/211: creat d2/d6/dd/f4a x:0 0 0 2024-04-18T21:06:58.677 INFO:tasks.workunit.client.0.smithi078.stdout:0/248: truncate d0/d9/da/db/f33 3756356 0 2024-04-18T21:06:58.677 INFO:tasks.workunit.client.0.smithi078.stdout:2/261: write d0/d1f/f3f [163666,54750] 0 2024-04-18T21:06:58.677 INFO:tasks.workunit.client.0.smithi078.stdout:8/196: dread d0/d10/d14/d2d/f35 [0,4194304] 0 2024-04-18T21:06:58.677 INFO:tasks.workunit.client.0.smithi078.stdout:4/289: sync 2024-04-18T21:06:58.678 INFO:tasks.workunit.client.0.smithi078.stdout:1/280: write d0/d46/f49 [573466,59907] 0 2024-04-18T21:06:58.678 INFO:tasks.workunit.client.0.smithi078.stdout:7/249: write d1/d16/dc/d11/f29 [2903439,36539] 0 2024-04-18T21:06:58.678 INFO:tasks.workunit.client.0.smithi078.stdout:6/212: write d2/d1c/f20 [1621854,38097] 0 2024-04-18T21:06:58.678 INFO:tasks.workunit.client.0.smithi078.stdout:0/249: mkdir d0/d9/d4c 0 2024-04-18T21:06:58.679 INFO:tasks.workunit.client.0.smithi078.stdout:5/302: write d9/da/f13 [2595603,54055] 0 2024-04-18T21:06:58.679 INFO:tasks.workunit.client.0.smithi078.stdout:3/209: dwrite d4/fd [0,4194304] 0 2024-04-18T21:06:58.679 INFO:tasks.workunit.client.0.smithi078.stdout:8/197: truncate d0/f26 443156 0 2024-04-18T21:06:58.679 INFO:tasks.workunit.client.0.smithi078.stdout:2/262: chown d0/db/f36 19 1 2024-04-18T21:06:58.680 INFO:tasks.workunit.client.0.smithi078.stdout:8/198: readlink d0/l1a 0 2024-04-18T21:06:58.680 INFO:tasks.workunit.client.0.smithi078.stdout:4/290: creat d0/dc/d10/d1c/f67 x:0 0 0 2024-04-18T21:06:58.680 INFO:tasks.workunit.client.0.smithi078.stdout:1/281: write d0/d11/f21 [592447,68115] 0 2024-04-18T21:06:58.680 INFO:tasks.workunit.client.0.smithi078.stdout:7/250: fdatasync d1/d32/f49 0 2024-04-18T21:06:58.680 INFO:tasks.workunit.client.0.smithi078.stdout:6/213: mkdir d2/d6/dd/d4b 0 2024-04-18T21:06:58.681 INFO:tasks.workunit.client.0.smithi078.stdout:2/263: write d0/f5 [5213229,90748] 0 2024-04-18T21:06:58.681 INFO:tasks.workunit.client.0.smithi078.stdout:3/210: readlink d4/da/d11/d23/l28 0 2024-04-18T21:06:58.681 INFO:tasks.workunit.client.0.smithi078.stdout:6/214: readlink d2/l3c 0 2024-04-18T21:06:58.682 INFO:tasks.workunit.client.0.smithi078.stdout:0/250: creat d0/d9/da/db/f4d x:0 0 0 2024-04-18T21:06:58.682 INFO:tasks.workunit.client.0.smithi078.stdout:1/282: creat d0/d46/d32/f67 x:0 0 0 2024-04-18T21:06:58.682 INFO:tasks.workunit.client.0.smithi078.stdout:4/291: mknod d0/dc/d10/d1c/d60/c68 0 2024-04-18T21:06:58.683 INFO:tasks.workunit.client.0.smithi078.stdout:3/211: write d4/da/d11/f2c [585004,112388] 0 2024-04-18T21:06:58.684 INFO:tasks.workunit.client.0.smithi078.stdout:8/199: dread d0/d10/f1c [0,4194304] 0 2024-04-18T21:06:58.684 INFO:tasks.workunit.client.0.smithi078.stdout:0/251: write d0/d9/da/db/d35/d3f/f44 [59738,86630] 0 2024-04-18T21:06:58.685 INFO:tasks.workunit.client.0.smithi078.stdout:3/212: rename d4/da/d11/d23 to d4/d2d/d30/d35 0 2024-04-18T21:06:58.686 INFO:tasks.workunit.client.0.smithi078.stdout:3/213: sync 2024-04-18T21:06:58.686 INFO:tasks.workunit.client.0.smithi078.stdout:8/200: chown d0/d10/d14/d2a/l2e 111927 1 2024-04-18T21:06:58.686 INFO:tasks.workunit.client.0.smithi078.stdout:5/303: dread d9/fe [0,4194304] 0 2024-04-18T21:06:58.686 INFO:tasks.workunit.client.0.smithi078.stdout:4/292: mknod d0/c69 0 2024-04-18T21:06:58.687 INFO:tasks.workunit.client.0.smithi078.stdout:6/215: dread d2/d6/f16 [0,4194304] 0 2024-04-18T21:06:58.687 INFO:tasks.workunit.client.0.smithi078.stdout:0/252: rename d0/d15/d21 to d0/d4e 0 2024-04-18T21:06:58.687 INFO:tasks.workunit.client.0.smithi078.stdout:6/216: fsync d2/d1f/f29 0 2024-04-18T21:06:58.687 INFO:tasks.workunit.client.0.smithi078.stdout:8/201: write d0/d10/d14/f21 [1297709,106686] 0 2024-04-18T21:06:58.688 INFO:tasks.workunit.client.0.smithi078.stdout:3/214: truncate d4/da/d11/f2c 922779 0 2024-04-18T21:06:58.688 INFO:tasks.workunit.client.0.smithi078.stdout:4/293: mkdir d0/dc/d10/d1c/d6a 0 2024-04-18T21:06:58.688 INFO:tasks.workunit.client.0.smithi078.stdout:5/304: creat d9/da/d32/f60 x:0 0 0 2024-04-18T21:06:58.689 INFO:tasks.workunit.client.0.smithi078.stdout:3/215: stat d4/df/f26 0 2024-04-18T21:06:58.689 INFO:tasks.workunit.client.0.smithi078.stdout:7/251: dwrite d1/d32/f5d [0,4194304] 0 2024-04-18T21:06:58.689 INFO:tasks.workunit.client.0.smithi078.stdout:5/305: chown d9/da/c19 239273827 1 2024-04-18T21:06:58.689 INFO:tasks.workunit.client.0.smithi078.stdout:6/217: symlink d2/d1c/d3a/l4c 0 2024-04-18T21:06:58.690 INFO:tasks.workunit.client.0.smithi078.stdout:0/253: write d0/d9/da/db/d35/d3f/f41 [682029,68491] 0 2024-04-18T21:06:58.690 INFO:tasks.workunit.client.0.smithi078.stdout:8/202: creat d0/d10/d14/d2d/f3f x:0 0 0 2024-04-18T21:06:58.690 INFO:tasks.workunit.client.0.smithi078.stdout:9/239: dread d7/df/f42 [0,4194304] 0 2024-04-18T21:06:58.692 INFO:tasks.workunit.client.0.smithi078.stdout:7/252: unlink d1/f1d 0 2024-04-18T21:06:58.692 INFO:tasks.workunit.client.0.smithi078.stdout:8/203: symlink d0/d10/d14/l40 0 2024-04-18T21:06:58.692 INFO:tasks.workunit.client.0.smithi078.stdout:0/254: mknod d0/d9/dd/d17/d2e/d31/c4f 0 2024-04-18T21:06:58.693 INFO:tasks.workunit.client.0.smithi078.stdout:4/294: creat d0/dc/d10/d41/d5f/f6b x:0 0 0 2024-04-18T21:06:58.693 INFO:tasks.workunit.client.0.smithi078.stdout:9/240: link d7/d11/d2d/d3f/d4d/f4f d7/d11/d1b/d45/d4b/f56 0 2024-04-18T21:06:58.693 INFO:tasks.workunit.client.0.smithi078.stdout:6/218: dread d2/d6/f16 [0,4194304] 0 2024-04-18T21:06:58.693 INFO:tasks.workunit.client.0.smithi078.stdout:3/216: link d4/df/d17/c24 d4/da/d11/c36 0 2024-04-18T21:06:58.693 INFO:tasks.workunit.client.0.smithi078.stdout:7/253: creat d1/f5e x:0 0 0 2024-04-18T21:06:58.693 INFO:tasks.workunit.client.0.smithi078.stdout:8/204: mkdir d0/d10/d14/d2a/d41 0 2024-04-18T21:06:58.694 INFO:tasks.workunit.client.0.smithi078.stdout:4/295: rmdir d0/dc/d37 39 2024-04-18T21:06:58.694 INFO:tasks.workunit.client.0.smithi078.stdout:3/217: stat d4/df/f26 0 2024-04-18T21:06:58.694 INFO:tasks.workunit.client.0.smithi078.stdout:6/219: unlink d2/d6/c1b 0 2024-04-18T21:06:58.694 INFO:tasks.workunit.client.0.smithi078.stdout:7/254: creat d1/d16/dc/f5f x:0 0 0 2024-04-18T21:06:58.694 INFO:tasks.workunit.client.0.smithi078.stdout:8/205: chown d0/d10/d14/l33 822419 1 2024-04-18T21:06:58.695 INFO:tasks.workunit.client.0.smithi078.stdout:4/296: mknod d0/dc/d10/d41/c6c 0 2024-04-18T21:06:58.695 INFO:tasks.workunit.client.0.smithi078.stdout:8/206: write d0/d10/f1c [217926,124127] 0 2024-04-18T21:06:58.696 INFO:tasks.workunit.client.0.smithi078.stdout:4/297: mkdir d0/dc/d29/d6d 0 2024-04-18T21:06:58.698 INFO:tasks.workunit.client.0.smithi078.stdout:9/241: dread d7/d11/d2d/d26/f2b [0,4194304] 0 2024-04-18T21:06:58.698 INFO:tasks.workunit.client.0.smithi078.stdout:8/207: rename d0/d10/c3b to d0/d10/c42 0 2024-04-18T21:06:58.699 INFO:tasks.workunit.client.0.smithi078.stdout:8/208: chown d0/d22 49181 1 2024-04-18T21:06:58.699 INFO:tasks.workunit.client.0.smithi078.stdout:9/242: mkdir d7/d57 0 2024-04-18T21:06:58.700 INFO:tasks.workunit.client.0.smithi078.stdout:7/255: dread d1/d16/dc/d11/f24 [0,4194304] 0 2024-04-18T21:06:58.701 INFO:tasks.workunit.client.0.smithi078.stdout:8/209: write d0/f26 [993682,51156] 0 2024-04-18T21:06:58.701 INFO:tasks.workunit.client.0.smithi078.stdout:9/243: stat d7/d11/d1b/d45/d4b/f56 0 2024-04-18T21:06:58.701 INFO:tasks.workunit.client.0.smithi078.stdout:7/256: stat d1/d16/dc/d4b/c45 0 2024-04-18T21:06:58.702 INFO:tasks.workunit.client.0.smithi078.stdout:2/264: dwrite d0/f1d [0,4194304] 0 2024-04-18T21:06:58.702 INFO:tasks.workunit.client.0.smithi078.stdout:2/265: sync 2024-04-18T21:06:58.702 INFO:tasks.workunit.client.0.smithi078.stdout:3/218: dwrite d4/f9 [0,4194304] 0 2024-04-18T21:06:58.703 INFO:tasks.workunit.client.0.smithi078.stdout:3/219: stat d4/da/d11 0 2024-04-18T21:06:58.704 INFO:tasks.workunit.client.0.smithi078.stdout:3/220: read - d4/d2d/d30/d35/f33 zero size 2024-04-18T21:06:58.704 INFO:tasks.workunit.client.0.smithi078.stdout:7/257: rename d1/d16/dc/d4b/f42 to d1/d16/dc/f60 0 2024-04-18T21:06:58.704 INFO:tasks.workunit.client.0.smithi078.stdout:9/244: write d7/d11/d2d/d3f/d4d/f4f [99540,47831] 0 2024-04-18T21:06:58.706 INFO:tasks.workunit.client.0.smithi078.stdout:7/258: symlink d1/d16/d1c/l61 0 2024-04-18T21:06:58.710 INFO:tasks.workunit.client.0.smithi078.stdout:7/259: rmdir d1/d16/dc/d4f 0 2024-04-18T21:06:58.711 INFO:tasks.workunit.client.0.smithi078.stdout:2/266: dwrite d0/db/d18/d21/f2c [0,4194304] 0 2024-04-18T21:06:58.712 INFO:tasks.workunit.client.0.smithi078.stdout:7/260: creat d1/d32/f62 x:0 0 0 2024-04-18T21:06:58.712 INFO:tasks.workunit.client.0.smithi078.stdout:0/255: dwrite d0/d9/da/db/d35/f2b [0,4194304] 0 2024-04-18T21:06:58.712 INFO:tasks.workunit.client.0.smithi078.stdout:3/221: dwrite d4/fd [4194304,4194304] 0 2024-04-18T21:06:58.715 INFO:tasks.workunit.client.0.smithi078.stdout:2/267: creat d0/f4d x:0 0 0 2024-04-18T21:06:58.716 INFO:tasks.workunit.client.0.smithi078.stdout:0/256: symlink d0/d9/da/df/l50 0 2024-04-18T21:06:58.717 INFO:tasks.workunit.client.0.smithi078.stdout:6/220: dwrite d2/d6/f16 [0,4194304] 0 2024-04-18T21:06:58.717 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:58.714+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:58.717 INFO:tasks.workunit.client.0.smithi078.stdout:6/221: readlink d2/d1f/l2f 0 2024-04-18T21:06:58.718 INFO:tasks.workunit.client.0.smithi078.stdout:8/210: truncate d0/d10/f1c 490393 0 2024-04-18T21:06:58.718 INFO:tasks.workunit.client.0.smithi078.stdout:3/222: getdents d4/df 0 2024-04-18T21:06:58.719 INFO:tasks.workunit.client.0.smithi078.stdout:3/223: readlink d4/df/d17/l2b 0 2024-04-18T21:06:58.720 INFO:tasks.workunit.client.0.smithi078.stdout:4/298: dwrite d0/f17 [0,4194304] 0 2024-04-18T21:06:58.722 INFO:tasks.workunit.client.0.smithi078.stdout:4/299: write d0/dc/d29/f31 [1273471,7579] 0 2024-04-18T21:06:58.723 INFO:tasks.workunit.client.0.smithi078.stdout:9/245: write d7/f3d [486202,80850] 0 2024-04-18T21:06:58.723 INFO:tasks.workunit.client.0.smithi078.stdout:1/283: dread d0/d2a/d2f/f44 [0,4194304] 0 2024-04-18T21:06:58.723 INFO:tasks.workunit.client.0.smithi078.stdout:7/261: dread d1/f18 [0,4194304] 0 2024-04-18T21:06:58.723 INFO:tasks.workunit.client.0.smithi078.stdout:8/211: dread d0/d10/d14/d2d/f31 [0,4194304] 0 2024-04-18T21:06:58.724 INFO:tasks.workunit.client.0.smithi078.stdout:9/246: fsync d7/df/f2a 0 2024-04-18T21:06:58.724 INFO:tasks.workunit.client.0.smithi078.stdout:6/222: dwrite d2/d1f/f2c [0,4194304] 0 2024-04-18T21:06:58.725 INFO:tasks.workunit.client.0.smithi078.stdout:2/268: read d0/db/d18/d21/d27/d29/f2f [5991814,12464] 0 2024-04-18T21:06:58.726 INFO:tasks.workunit.client.0.smithi078.stdout:4/300: rename d0/dc/d10/d1c/f36 to d0/dc/d29/d6d/f6e 0 2024-04-18T21:06:58.726 INFO:tasks.workunit.client.0.smithi078.stdout:1/284: truncate d0/d11/f18 763235 0 2024-04-18T21:06:58.727 INFO:tasks.workunit.client.0.smithi078.stdout:9/247: creat d7/df/d1e/f58 x:0 0 0 2024-04-18T21:06:58.727 INFO:tasks.workunit.client.0.smithi078.stdout:2/269: stat d0/db/d18/d21/d27/d29/d33/c3a 0 2024-04-18T21:06:58.728 INFO:tasks.workunit.client.0.smithi078.stdout:4/301: creat d0/dc/d5b/f6f x:0 0 0 2024-04-18T21:06:58.728 INFO:tasks.workunit.client.0.smithi078.stdout:9/248: readlink d7/d11/d2d/l27 0 2024-04-18T21:06:58.728 INFO:tasks.workunit.client.0.smithi078.stdout:1/285: symlink d0/d2a/d3c/d4b/l68 0 2024-04-18T21:06:58.729 INFO:tasks.workunit.client.0.smithi078.stdout:4/302: truncate d0/f53 1428389 0 2024-04-18T21:06:58.729 INFO:tasks.workunit.client.0.smithi078.stdout:9/249: readlink d7/d11/d1b/l25 0 2024-04-18T21:06:58.730 INFO:tasks.workunit.client.0.smithi078.stdout:2/270: rmdir d0/db/d18/d21/d27/d29/d33 39 2024-04-18T21:06:58.730 INFO:tasks.workunit.client.0.smithi078.stdout:3/224: dwrite d4/df/f1f [0,4194304] 0 2024-04-18T21:06:58.730 INFO:tasks.workunit.client.0.smithi078.stdout:1/286: mkdir d0/d11/d69 0 2024-04-18T21:06:58.730 INFO:tasks.workunit.client.0.smithi078.stdout:9/250: stat d7/d23/c41 0 2024-04-18T21:06:58.731 INFO:tasks.workunit.client.0.smithi078.stdout:4/303: symlink d0/dc/d10/d41/d5f/l70 0 2024-04-18T21:06:58.732 INFO:tasks.workunit.client.0.smithi078.stdout:1/287: write d0/d46/f17 [916730,32444] 0 2024-04-18T21:06:58.733 INFO:tasks.workunit.client.0.smithi078.stdout:6/223: dwrite d2/d1f/f25 [4194304,4194304] 0 2024-04-18T21:06:58.734 INFO:tasks.workunit.client.0.smithi078.stdout:1/288: symlink d0/l6a 0 2024-04-18T21:06:58.734 INFO:tasks.workunit.client.0.smithi078.stdout:6/224: chown d2/c23 3874 1 2024-04-18T21:06:58.735 INFO:tasks.workunit.client.0.smithi078.stdout:4/304: truncate d0/dc/d10/d1c/f67 1005014 0 2024-04-18T21:06:58.735 INFO:tasks.workunit.client.0.smithi078.stdout:6/225: chown d2/d34/d35/c38 22765 1 2024-04-18T21:06:58.736 INFO:tasks.workunit.client.0.smithi078.stdout:3/225: dread d4/da/d11/f21 [0,4194304] 0 2024-04-18T21:06:58.737 INFO:tasks.workunit.client.0.smithi078.stdout:3/226: fsync d4/da/d11/f32 0 2024-04-18T21:06:58.737 INFO:tasks.workunit.client.0.smithi078.stdout:8/212: truncate d0/f2c 1362228 0 2024-04-18T21:06:58.737 INFO:tasks.workunit.client.0.smithi078.stdout:1/289: dread d0/d46/d32/f39 [0,4194304] 0 2024-04-18T21:06:58.738 INFO:tasks.workunit.client.0.smithi078.stdout:7/262: write d1/d16/d2d/f36 [701691,12141] 0 2024-04-18T21:06:58.738 INFO:tasks.workunit.client.0.smithi078.stdout:6/226: stat d2/d6/dd/c8 0 2024-04-18T21:06:58.738 INFO:tasks.workunit.client.0.smithi078.stdout:3/227: rmdir d4/df 39 2024-04-18T21:06:58.739 INFO:tasks.workunit.client.0.smithi078.stdout:7/263: readlink d1/d16/d1c/l61 0 2024-04-18T21:06:58.739 INFO:tasks.workunit.client.0.smithi078.stdout:3/228: chown d4/d2d/d30 19195 1 2024-04-18T21:06:58.739 INFO:tasks.workunit.client.0.smithi078.stdout:4/305: dread d0/dc/d10/d1c/f67 [0,4194304] 0 2024-04-18T21:06:58.740 INFO:tasks.workunit.client.0.smithi078.stdout:9/251: dwrite d7/d11/d2d/d26/f2b [0,4194304] 0 2024-04-18T21:06:58.740 INFO:tasks.workunit.client.0.smithi078.stdout:3/229: readlink d4/d2d/d30/d35/l28 0 2024-04-18T21:06:58.741 INFO:tasks.workunit.client.0.smithi078.stdout:7/264: rmdir d1/d16/d10 39 2024-04-18T21:06:58.741 INFO:tasks.workunit.client.0.smithi078.stdout:1/290: creat d0/d2a/d3c/f6b x:0 0 0 2024-04-18T21:06:58.741 INFO:tasks.workunit.client.0.smithi078.stdout:9/252: fsync d7/d11/d2d/f3a 0 2024-04-18T21:06:58.742 INFO:tasks.workunit.client.0.smithi078.stdout:6/227: link d2/d1c/d3a/l4c d2/d1c/l4d 0 2024-04-18T21:06:58.742 INFO:tasks.workunit.client.0.smithi078.stdout:0/257: dwrite d0/d9/da/db/f33 [0,4194304] 0 2024-04-18T21:06:58.742 INFO:tasks.workunit.client.0.smithi078.stdout:3/230: symlink d4/df/l37 0 2024-04-18T21:06:58.742 INFO:tasks.workunit.client.0.smithi078.stdout:1/291: write d0/d11/f21 [395517,74705] 0 2024-04-18T21:06:58.743 INFO:tasks.workunit.client.0.smithi078.stdout:3/231: chown d4/df 383646 1 2024-04-18T21:06:58.744 INFO:tasks.workunit.client.0.smithi078.stdout:7/265: creat d1/d16/dc/d11/d53/f63 x:0 0 0 2024-04-18T21:06:58.744 INFO:tasks.workunit.client.0.smithi078.stdout:9/253: fdatasync d7/d11/d2d/f3a 0 2024-04-18T21:06:58.744 INFO:tasks.workunit.client.0.smithi078.stdout:4/306: getdents d0/dc/d37 0 2024-04-18T21:06:58.744 INFO:tasks.workunit.client.0.smithi078.stdout:1/292: symlink d0/d2a/d2f/d50/l6c 0 2024-04-18T21:06:58.745 INFO:tasks.workunit.client.0.smithi078.stdout:7/266: chown d1/d32/f49 4803 1 2024-04-18T21:06:58.745 INFO:tasks.workunit.client.0.smithi078.stdout:3/232: mknod d4/c38 0 2024-04-18T21:06:58.745 INFO:tasks.workunit.client.0.smithi078.stdout:3/233: dread - d4/d2d/d30/d35/f33 zero size 2024-04-18T21:06:58.745 INFO:tasks.workunit.client.0.smithi078.stdout:7/267: symlink d1/d16/dc/d11/l64 0 2024-04-18T21:06:58.745 INFO:tasks.workunit.client.0.smithi078.stdout:4/307: rename d0/dc/d10/d41/d5e to d0/dc/d5b/d71 0 2024-04-18T21:06:58.746 INFO:tasks.workunit.client.0.smithi078.stdout:3/234: fsync d4/f9 0 2024-04-18T21:06:58.748 INFO:tasks.workunit.client.0.smithi078.stdout:7/268: mkdir d1/d16/d65 0 2024-04-18T21:06:58.749 INFO:tasks.workunit.client.0.smithi078.stdout:1/293: unlink d0/d2a/d3c/l5a 0 2024-04-18T21:06:58.749 INFO:tasks.workunit.client.0.smithi078.stdout:3/235: chown d4/d2d/d30/d35/c2f 134 1 2024-04-18T21:06:58.751 INFO:tasks.workunit.client.0.smithi078.stdout:7/269: read d1/f3c [507234,86328] 0 2024-04-18T21:06:58.751 INFO:tasks.workunit.client.0.smithi078.stdout:3/236: write d4/da/d11/f32 [746115,91943] 0 2024-04-18T21:06:58.752 INFO:tasks.workunit.client.0.smithi078.stdout:0/258: dwrite d0/d9/da/db/f33 [0,4194304] 0 2024-04-18T21:06:58.753 INFO:tasks.workunit.client.0.smithi078.stdout:7/270: creat d1/d32/f66 x:0 0 0 2024-04-18T21:06:58.753 INFO:tasks.workunit.client.0.smithi078.stdout:9/254: dwrite d7/df/f10 [0,4194304] 0 2024-04-18T21:06:58.753 INFO:tasks.workunit.client.0.smithi078.stdout:3/237: rmdir d4/df/d17 39 2024-04-18T21:06:58.754 INFO:tasks.workunit.client.0.smithi078.stdout:0/259: write d0/d9/f2d [1622305,11803] 0 2024-04-18T21:06:58.755 INFO:tasks.workunit.client.0.smithi078.stdout:9/255: chown d7/d23/d3e/d55 20 1 2024-04-18T21:06:58.755 INFO:tasks.workunit.client.0.smithi078.stdout:4/308: dwrite d0/f5 [0,4194304] 0 2024-04-18T21:06:58.756 INFO:tasks.workunit.client.0.smithi078.stdout:0/260: chown d0/l3 169915 1 2024-04-18T21:06:58.756 INFO:tasks.workunit.client.0.smithi078.stdout:3/238: mknod d4/c39 0 2024-04-18T21:06:58.756 INFO:tasks.workunit.client.0.smithi078.stdout:9/256: creat d7/f59 x:0 0 0 2024-04-18T21:06:58.757 INFO:tasks.workunit.client.0.smithi078.stdout:4/309: rmdir d0 39 2024-04-18T21:06:58.757 INFO:tasks.workunit.client.0.smithi078.stdout:0/261: write d0/d9/da/db/f13 [53114,60493] 0 2024-04-18T21:06:58.759 INFO:tasks.workunit.client.0.smithi078.stdout:1/294: dwrite d0/d2a/d45/f5d [0,4194304] 0 2024-04-18T21:06:58.759 INFO:tasks.workunit.client.0.smithi078.stdout:9/257: unlink d7/f53 0 2024-04-18T21:06:58.759 INFO:tasks.workunit.client.0.smithi078.stdout:3/239: creat d4/df/d17/f3a x:0 0 0 2024-04-18T21:06:58.760 INFO:tasks.workunit.client.0.smithi078.stdout:0/262: getdents d0/d9/d4c 0 2024-04-18T21:06:58.760 INFO:tasks.workunit.client.0.smithi078.stdout:9/258: mkdir d7/d23/d3e/d5a 0 2024-04-18T21:06:58.760 INFO:tasks.workunit.client.0.smithi078.stdout:3/240: write d4/da/d11/f2c [249575,75889] 0 2024-04-18T21:06:58.761 INFO:tasks.workunit.client.0.smithi078.stdout:1/295: creat d0/d46/d32/d35/f6d x:0 0 0 2024-04-18T21:06:58.762 INFO:tasks.workunit.client.0.smithi078.stdout:1/296: fsync d0/d2a/f62 0 2024-04-18T21:06:58.763 INFO:tasks.workunit.client.0.smithi078.stdout:0/263: rename d0/d9/dd/d17/c37 to d0/d9/da/db/d35/c51 0 2024-04-18T21:06:58.763 INFO:tasks.workunit.client.0.smithi078.stdout:7/271: dwrite d1/d16/dc/d11/f29 [0,4194304] 0 2024-04-18T21:06:58.763 INFO:tasks.workunit.client.0.smithi078.stdout:7/272: read d1/f18 [333887,28768] 0 2024-04-18T21:06:58.764 INFO:tasks.workunit.client.0.smithi078.stdout:7/273: fdatasync d1/d16/dc/fd 0 2024-04-18T21:06:58.764 INFO:tasks.workunit.client.0.smithi078.stdout:3/241: link d4/c1c d4/d2d/d30/c3b 0 2024-04-18T21:06:58.764 INFO:tasks.workunit.client.0.smithi078.stdout:7/274: read - d1/d16/f46 zero size 2024-04-18T21:06:58.765 INFO:tasks.workunit.client.0.smithi078.stdout:7/275: chown d1/d16/dc/d11/l64 10391224 1 2024-04-18T21:06:58.767 INFO:tasks.workunit.client.0.smithi078.stdout:0/264: write d0/d9/da/db/d35/d3f/f44 [4112951,64070] 0 2024-04-18T21:06:58.767 INFO:tasks.workunit.client.0.smithi078.stdout:7/276: unlink d1/d16/dc/d11/c15 0 2024-04-18T21:06:58.768 INFO:tasks.workunit.client.0.smithi078.stdout:0/265: write d0/d9/da/db/d35/f4b [699792,27706] 0 2024-04-18T21:06:58.768 INFO:tasks.workunit.client.0.smithi078.stdout:7/277: rmdir d1/d16/dc/d11/d53 39 2024-04-18T21:06:58.769 INFO:tasks.workunit.client.0.smithi078.stdout:1/297: dwrite d0/d2a/d3c/d4b/d4/f28 [4194304,4194304] 0 2024-04-18T21:06:58.769 INFO:tasks.workunit.client.0.smithi078.stdout:7/278: mknod d1/d16/d2d/c67 0 2024-04-18T21:06:58.770 INFO:tasks.workunit.client.0.smithi078.stdout:0/266: write d0/d9/da/f10 [1734290,47087] 0 2024-04-18T21:06:58.771 INFO:tasks.workunit.client.0.smithi078.stdout:7/279: creat d1/d16/dc/d11/d53/f68 x:0 0 0 2024-04-18T21:06:58.771 INFO:tasks.workunit.client.0.smithi078.stdout:0/267: rmdir d0/d9/da/db/d35 39 2024-04-18T21:06:58.772 INFO:tasks.workunit.client.0.smithi078.stdout:7/280: creat d1/d16/dc/d11/f69 x:0 0 0 2024-04-18T21:06:58.772 INFO:tasks.workunit.client.0.smithi078.stdout:0/268: write d0/d9/da/db/d35/f20 [3092564,104940] 0 2024-04-18T21:06:58.773 INFO:tasks.workunit.client.0.smithi078.stdout:7/281: chown d1/d16/dc/fd 1 1 2024-04-18T21:06:58.773 INFO:tasks.workunit.client.0.smithi078.stdout:0/269: write d0/d9/da/db/d35/d3f/f44 [4180985,126284] 0 2024-04-18T21:06:58.786 INFO:tasks.workunit.client.0.smithi078.stdout:0/270: fsync d0/d9/da/db/d35/f20 0 2024-04-18T21:06:58.787 INFO:tasks.workunit.client.0.smithi078.stdout:4/310: truncate d0/dc/d37/f3b 542737 0 2024-04-18T21:06:58.787 INFO:tasks.workunit.client.0.smithi078.stdout:7/282: truncate d1/d16/f26 2712432 0 2024-04-18T21:06:58.788 INFO:tasks.workunit.client.0.smithi078.stdout:4/311: symlink d0/dc/d29/l72 0 2024-04-18T21:06:58.788 INFO:tasks.workunit.client.0.smithi078.stdout:7/283: creat d1/d16/d65/f6a x:0 0 0 2024-04-18T21:06:58.788 INFO:tasks.workunit.client.0.smithi078.stdout:4/312: mkdir d0/d73 0 2024-04-18T21:06:58.789 INFO:tasks.workunit.client.0.smithi078.stdout:7/284: creat d1/d16/dc/d11/d53/f6b x:0 0 0 2024-04-18T21:06:58.790 INFO:tasks.workunit.client.0.smithi078.stdout:1/298: fsync d0/d11/f21 0 2024-04-18T21:06:58.791 INFO:tasks.workunit.client.0.smithi078.stdout:1/299: write d0/d2a/d3c/d4b/d4/fc [526123,62444] 0 2024-04-18T21:06:58.791 INFO:tasks.workunit.client.0.smithi078.stdout:7/285: creat d1/d16/d65/f6c x:0 0 0 2024-04-18T21:06:58.793 INFO:tasks.workunit.client.0.smithi078.stdout:0/271: dwrite d0/f8 [0,4194304] 0 2024-04-18T21:06:58.794 INFO:tasks.workunit.client.0.smithi078.stdout:0/272: write d0/d15/f27 [39105,119958] 0 2024-04-18T21:06:58.796 INFO:tasks.workunit.client.0.smithi078.stdout:5/306: dread f8 [0,4194304] 0 2024-04-18T21:06:58.801 INFO:tasks.workunit.client.0.smithi078.stdout:4/313: write d0/f7 [2150033,56461] 0 2024-04-18T21:06:58.801 INFO:tasks.workunit.client.0.smithi078.stdout:3/242: dread d4/f18 [0,4194304] 0 2024-04-18T21:06:58.802 INFO:tasks.workunit.client.0.smithi078.stdout:8/213: dread d0/f2c [0,4194304] 0 2024-04-18T21:06:58.803 INFO:tasks.workunit.client.0.smithi078.stdout:1/300: dwrite d0/d2a/f65 [0,4194304] 0 2024-04-18T21:06:58.803 INFO:tasks.workunit.client.0.smithi078.stdout:7/286: dwrite d1/d16/d10/f52 [0,4194304] 0 2024-04-18T21:06:58.804 INFO:teuthology.orchestra.run.smithi078.stderr:noscrub is set 2024-04-18T21:06:58.805 INFO:tasks.workunit.client.0.smithi078.stdout:2/271: dread d0/db/d18/f1c [0,4194304] 0 2024-04-18T21:06:58.805 INFO:tasks.workunit.client.0.smithi078.stdout:5/307: truncate f8 1669873 0 2024-04-18T21:06:58.806 INFO:tasks.workunit.client.0.smithi078.stdout:3/243: readlink d4/l1d 0 2024-04-18T21:06:58.807 INFO:tasks.workunit.client.0.smithi078.stdout:5/308: write d9/d2e/d29/f36 [1828282,19526] 0 2024-04-18T21:06:58.807 INFO:tasks.workunit.client.0.smithi078.stdout:0/273: dwrite d0/d15/f27 [0,4194304] 0 2024-04-18T21:06:58.808 INFO:tasks.workunit.client.0.smithi078.stdout:1/301: fdatasync d0/d2a/d45/f5d 0 2024-04-18T21:06:58.810 INFO:tasks.workunit.client.0.smithi078.stdout:4/314: mkdir d0/dc/d10/d1c/d60/d74 0 2024-04-18T21:06:58.810 INFO:tasks.workunit.client.0.smithi078.stdout:5/309: mknod d9/da/c61 0 2024-04-18T21:06:58.810 INFO:tasks.workunit.client.0.smithi078.stdout:1/302: symlink d0/d2a/d3c/d4b/l6e 0 2024-04-18T21:06:58.810 INFO:tasks.workunit.client.0.smithi078.stdout:0/274: readlink d0/d9/da/df/l3d 0 2024-04-18T21:06:58.811 INFO:tasks.workunit.client.0.smithi078.stdout:3/244: creat d4/da/d11/f3c x:0 0 0 2024-04-18T21:06:58.811 INFO:tasks.workunit.client.0.smithi078.stdout:2/272: mkdir d0/db/d18/d21/d27/d29/d4e 0 2024-04-18T21:06:58.811 INFO:tasks.workunit.client.0.smithi078.stdout:4/315: creat d0/d73/f75 x:0 0 0 2024-04-18T21:06:58.811 INFO:tasks.workunit.client.0.smithi078.stdout:5/310: mkdir d9/d2e/d29/d55/d62 0 2024-04-18T21:06:58.811 INFO:tasks.workunit.client.0.smithi078.stdout:8/214: link d0/d10/c38 d0/c43 0 2024-04-18T21:06:58.812 INFO:tasks.workunit.client.0.smithi078.stdout:8/215: fdatasync d0/f6 0 2024-04-18T21:06:58.812 INFO:tasks.workunit.client.0.smithi078.stdout:8/216: chown d0/d10/d14/l25 5344274 1 2024-04-18T21:06:58.813 INFO:tasks.workunit.client.0.smithi078.stdout:8/217: chown d0/d10/d14/l25 14 1 2024-04-18T21:06:58.814 INFO:tasks.workunit.client.0.smithi078.stdout:1/303: symlink d0/d2a/d3c/d4b/d4/d61/l6f 0 2024-04-18T21:06:58.814 INFO:tasks.workunit.client.0.smithi078.stdout:4/316: creat d0/dc/d37/f76 x:0 0 0 2024-04-18T21:06:58.814 INFO:tasks.workunit.client.0.smithi078.stdout:8/218: readlink d0/l32 0 2024-04-18T21:06:58.814 INFO:tasks.workunit.client.0.smithi078.stdout:2/273: rename d0/db/d18/d21/c22 to d0/c4f 0 2024-04-18T21:06:58.819 INFO:tasks.workunit.client.0.smithi078.stdout:2/274: dread - d0/db/d18/d21/d27/d29/f2d zero size 2024-04-18T21:06:58.819 INFO:tasks.workunit.client.0.smithi078.stdout:8/219: fsync d0/d10/d14/f1e 0 2024-04-18T21:06:58.819 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:58.818+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:58.820 INFO:tasks.workunit.client.0.smithi078.stdout:3/245: dwrite d4/da/d11/f32 [0,4194304] 0 2024-04-18T21:06:58.821 INFO:tasks.workunit.client.0.smithi078.stdout:8/220: mknod d0/c44 0 2024-04-18T21:06:58.822 INFO:tasks.workunit.client.0.smithi078.stdout:0/275: dwrite d0/d9/dd/d17/d2e/d31/f3b [0,4194304] 0 2024-04-18T21:06:58.822 INFO:tasks.workunit.client.0.smithi078.stdout:5/311: dwrite d9/da/f1f [0,4194304] 0 2024-04-18T21:06:58.822 INFO:tasks.workunit.client.0.smithi078.stdout:1/304: dread d0/f3f [0,4194304] 0 2024-04-18T21:06:58.822 INFO:tasks.workunit.client.0.smithi078.stdout:3/246: write d4/d2d/d30/f34 [366746,52878] 0 2024-04-18T21:06:58.823 INFO:tasks.workunit.client.0.smithi078.stdout:8/221: truncate d0/f36 20898 0 2024-04-18T21:06:58.823 INFO:tasks.workunit.client.0.smithi078.stdout:8/222: stat d0/d10/d14 0 2024-04-18T21:06:58.824 INFO:tasks.workunit.client.0.smithi078.stdout:5/312: truncate d9/d2e/d29/f43 1145389 0 2024-04-18T21:06:58.827 INFO:tasks.workunit.client.0.smithi078.stdout:2/275: dwrite d0/f32 [0,4194304] 0 2024-04-18T21:06:58.828 INFO:tasks.workunit.client.0.smithi078.stdout:3/247: rmdir d4/df 39 2024-04-18T21:06:58.828 INFO:tasks.workunit.client.0.smithi078.stdout:6/228: dread d2/d1c/d30/f3b [0,4194304] 0 2024-04-18T21:06:58.829 INFO:tasks.workunit.client.0.smithi078.stdout:9/259: dread d7/df/f21 [0,4194304] 0 2024-04-18T21:06:58.829 INFO:tasks.workunit.client.0.smithi078.stdout:9/260: fsync d7/df/d1e/f58 0 2024-04-18T21:06:58.830 INFO:tasks.workunit.client.0.smithi078.stdout:9/261: dread - d7/df/f2a zero size 2024-04-18T21:06:58.830 INFO:tasks.workunit.client.0.smithi078.stdout:1/305: readlink d0/d2a/d3c/d4b/d52/l58 0 2024-04-18T21:06:58.831 INFO:tasks.workunit.client.0.smithi078.stdout:3/248: symlink d4/d2d/d30/l3d 0 2024-04-18T21:06:58.831 INFO:tasks.workunit.client.0.smithi078.stdout:5/313: chown d9/da/d3e/d4c/l5e 253814265 1 2024-04-18T21:06:58.832 INFO:tasks.workunit.client.0.smithi078.stdout:6/229: creat d2/d6/dd/d4b/f4e x:0 0 0 2024-04-18T21:06:58.832 INFO:tasks.workunit.client.0.smithi078.stdout:1/306: write d0/d2a/d2f/f56 [780713,29430] 0 2024-04-18T21:06:58.832 INFO:tasks.workunit.client.0.smithi078.stdout:4/317: dread d0/dc/d10/d41/f45 [0,4194304] 0 2024-04-18T21:06:58.833 INFO:tasks.workunit.client.0.smithi078.stdout:5/314: fdatasync d9/da/d4b/f4e 0 2024-04-18T21:06:58.833 INFO:tasks.workunit.client.0.smithi078.stdout:9/262: creat d7/d11/d1b/d45/d4b/f5b x:0 0 0 2024-04-18T21:06:58.834 INFO:tasks.workunit.client.0.smithi078.stdout:1/307: write d0/d2a/d2f/f38 [3086017,12667] 0 2024-04-18T21:06:58.834 INFO:tasks.workunit.client.0.smithi078.stdout:4/318: chown d0/d73/f75 1448706 1 2024-04-18T21:06:58.834 INFO:tasks.workunit.client.0.smithi078.stdout:5/315: readlink d9/d2e/l50 0 2024-04-18T21:06:58.834 INFO:tasks.workunit.client.0.smithi078.stdout:9/263: unlink d7/d11/f34 0 2024-04-18T21:06:58.835 INFO:tasks.workunit.client.0.smithi078.stdout:9/264: dread - d7/d11/d2d/f4e zero size 2024-04-18T21:06:58.836 INFO:tasks.workunit.client.0.smithi078.stdout:3/249: dread d4/f9 [0,4194304] 0 2024-04-18T21:06:58.836 INFO:tasks.workunit.client.0.smithi078.stdout:4/319: rename d0/dc/d5b/d4f/f5d to d0/dc/d5b/d4f/f77 0 2024-04-18T21:06:58.836 INFO:tasks.workunit.client.0.smithi078.stdout:9/265: creat d7/d11/d47/f5c x:0 0 0 2024-04-18T21:06:58.838 INFO:tasks.workunit.client.0.smithi078.stdout:9/266: mkdir d7/d11/d1b/d45/d4b/d5d 0 2024-04-18T21:06:58.841 INFO:tasks.workunit.client.0.smithi078.stdout:1/308: dwrite d0/d11/f2e [0,4194304] 0 2024-04-18T21:06:58.843 INFO:tasks.workunit.client.0.smithi078.stdout:3/250: dwrite d4/df/f26 [4194304,4194304] 0 2024-04-18T21:06:58.844 INFO:tasks.workunit.client.0.smithi078.stdout:1/309: mknod d0/d46/c70 0 2024-04-18T21:06:58.844 INFO:tasks.workunit.client.0.smithi078.stdout:8/223: dread d0/f26 [0,4194304] 0 2024-04-18T21:06:58.845 INFO:tasks.workunit.client.0.smithi078.stdout:9/267: dwrite d7/f37 [0,4194304] 0 2024-04-18T21:06:58.845 INFO:tasks.workunit.client.0.smithi078.stdout:1/310: dread - d0/d2a/d45/f54 zero size 2024-04-18T21:06:58.845 INFO:tasks.workunit.client.0.smithi078.stdout:1/311: chown d0/d46 57769 1 2024-04-18T21:06:58.846 INFO:tasks.workunit.client.0.smithi078.stdout:8/224: write d0/d22/f24 [216551,81002] 0 2024-04-18T21:06:58.846 INFO:tasks.workunit.client.0.smithi078.stdout:1/312: dread - d0/d2a/d45/f5c zero size 2024-04-18T21:06:58.846 INFO:tasks.workunit.client.0.smithi078.stdout:0/276: dread d0/d9/da/f42 [0,4194304] 0 2024-04-18T21:06:58.847 INFO:tasks.workunit.client.0.smithi078.stdout:9/268: truncate d7/d11/d2d/d3f/d4d/f4f 437155 0 2024-04-18T21:06:58.847 INFO:tasks.workunit.client.0.smithi078.stdout:0/277: chown d0/d9 525766568 1 2024-04-18T21:06:58.848 INFO:tasks.workunit.client.0.smithi078.stdout:3/251: link d4/l1d d4/da/d11/l3e 0 2024-04-18T21:06:58.848 INFO:tasks.workunit.client.0.smithi078.stdout:6/230: read d2/d6/f14 [815276,110484] 0 2024-04-18T21:06:58.848 INFO:tasks.workunit.client.0.smithi078.stdout:0/278: write d0/d9/f43 [759296,94576] 0 2024-04-18T21:06:58.848 INFO:tasks.workunit.client.0.smithi078.stdout:2/276: dwrite d0/fe [0,4194304] 0 2024-04-18T21:06:58.849 INFO:tasks.workunit.client.0.smithi078.stdout:6/231: creat d2/d34/d35/d46/f4f x:0 0 0 2024-04-18T21:06:58.850 INFO:tasks.workunit.client.0.smithi078.stdout:0/279: rename d0/d9/c18 to d0/d9/da/c52 0 2024-04-18T21:06:58.855 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:58.855 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-18T21:06:58.855 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-18T21:06:58.856 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:06:58.856 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.856 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:58.856 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:58.856 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 113.24023635099999, 2024-04-18T21:06:58.856 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045668994999999997, 2024-04-18T21:06:58.856 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:58.856 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:58.856 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.856 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:58.856 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.857 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:58.857 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:58.857 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:58.857 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.857 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.857 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:58.857 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:06:58.857 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:58.857 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.857 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.857 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:58.857 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615459+0000", 2024-04-18T21:06:58.857 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5030000000000001e-06 2024-04-18T21:06:58.858 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.858 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.858 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:58.858 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615506+0000", 2024-04-18T21:06:58.858 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6872000000000001e-05 2024-04-18T21:06:58.858 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.858 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.858 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:58.858 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615527+0000", 2024-04-18T21:06:58.858 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0763000000000001e-05 2024-04-18T21:06:58.858 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.858 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.858 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.858 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615551+0000", 2024-04-18T21:06:58.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4159e-05 2024-04-18T21:06:58.859 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:58.859 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615736+0000", 2024-04-18T21:06:58.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018499599999999999 2024-04-18T21:06:58.859 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:58.859 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615748+0000", 2024-04-18T21:06:58.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2272999999999999e-05 2024-04-18T21:06:58.859 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:58.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635481+0000", 2024-04-18T21:06:58.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019732772999999999 2024-04-18T21:06:58.860 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.860 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:58.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635791+0000", 2024-04-18T21:06:58.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031013299999999998 2024-04-18T21:06:58.860 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.860 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:58.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636101+0000", 2024-04-18T21:06:58.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030943300000000002 2024-04-18T21:06:58.861 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.861 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:58.861 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646043+0000", 2024-04-18T21:06:58.861 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099428139999999995 2024-04-18T21:06:58.861 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.861 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.861 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660991+0000", 2024-04-18T21:06:58.861 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014947142 2024-04-18T21:06:58.861 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.861 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:58.861 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661061+0000", 2024-04-18T21:06:58.862 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0438000000000006e-05 2024-04-18T21:06:58.862 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.862 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.862 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:58.862 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661127+0000", 2024-04-18T21:06:58.862 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5696000000000003e-05 2024-04-18T21:06:58.862 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:58.862 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:58.862 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:58.862 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.862 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.862 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:58.862 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:58.863 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 113.240023923, 2024-04-18T21:06:58.863 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045745085999999997, 2024-04-18T21:06:58.863 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:58.863 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:58.863 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.863 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:58.863 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.863 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:58.863 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:58.863 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:58.863 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.863 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.863 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:58.863 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:06:58.863 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:58.864 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.864 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.864 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:58.864 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:06:58.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7400000000000001e-06 2024-04-18T21:06:58.864 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.864 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.864 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:58.864 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:06:58.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8133e-05 2024-04-18T21:06:58.864 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.864 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.864 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:58.864 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615726+0000", 2024-04-18T21:06:58.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6132e-05 2024-04-18T21:06:58.864 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.864 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.865 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.865 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615742+0000", 2024-04-18T21:06:58.865 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6157000000000001e-05 2024-04-18T21:06:58.865 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.865 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.865 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:58.865 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615937+0000", 2024-04-18T21:06:58.865 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000194768 2024-04-18T21:06:58.865 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.865 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.865 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:06:58.865 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615950+0000", 2024-04-18T21:06:58.865 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3084e-05 2024-04-18T21:06:58.865 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.865 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.865 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:58.865 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643676+0000", 2024-04-18T21:06:58.866 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027725639999999999 2024-04-18T21:06:58.866 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.866 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.866 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:58.866 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643867+0000", 2024-04-18T21:06:58.866 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019075900000000001 2024-04-18T21:06:58.866 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.866 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.866 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:58.866 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:06:58.866 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036013799999999997 2024-04-18T21:06:58.866 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.866 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.866 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:58.866 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646068+0000", 2024-04-18T21:06:58.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001841536 2024-04-18T21:06:58.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.867 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661184+0000", 2024-04-18T21:06:58.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015115458999999999 2024-04-18T21:06:58.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:58.867 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661283+0000", 2024-04-18T21:06:58.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9502999999999999e-05 2024-04-18T21:06:58.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:58.868 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661415+0000", 2024-04-18T21:06:58.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000132037 2024-04-18T21:06:58.868 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:58.868 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:58.868 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:58.868 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.868 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.868 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:58.868 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:58.868 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 113.23950347500001, 2024-04-18T21:06:58.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043572403000000003, 2024-04-18T21:06:58.868 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:58.868 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:58.868 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:06:58.868 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:58.868 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.869 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:58.869 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:58.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:58.869 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.869 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.869 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:58.869 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616191+0000", 2024-04-18T21:06:58.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:58.869 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.869 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.869 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:58.869 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616192+0000", 2024-04-18T21:06:58.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:06:58.869 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.869 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.870 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:58.870 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616203+0000", 2024-04-18T21:06:58.870 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0890000000000001e-05 2024-04-18T21:06:58.870 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.870 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.870 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:58.870 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616223+0000", 2024-04-18T21:06:58.870 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0409000000000001e-05 2024-04-18T21:06:58.870 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.870 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.870 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.870 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616238+0000", 2024-04-18T21:06:58.870 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5160000000000001e-05 2024-04-18T21:06:58.870 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.870 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.871 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:58.871 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616343+0000", 2024-04-18T21:06:58.871 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000104831 2024-04-18T21:06:58.871 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.871 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.871 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:06:58.871 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.616357+0000", 2024-04-18T21:06:58.871 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3686000000000001e-05 2024-04-18T21:06:58.871 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.871 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.871 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:58.871 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635912+0000", 2024-04-18T21:06:58.871 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019554944000000001 2024-04-18T21:06:58.871 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.872 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.872 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:58.872 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636231+0000", 2024-04-18T21:06:58.872 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000318766 2024-04-18T21:06:58.872 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.872 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.872 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:58.872 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.659763+0000", 2024-04-18T21:06:58.872 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023532474000000001 2024-04-18T21:06:58.872 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:58.872 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:58.872 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:58.872 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.872 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.872 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:99 3.1f 3:f83d65d8:::200.00000004:head [write 313655~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:58.872 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757646+0000", 2024-04-18T21:06:58.873 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.098047695, 2024-04-18T21:06:58.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043356459999999999, 2024-04-18T21:06:58.873 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:58.873 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:58.873 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.873 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:58.873 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.873 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:58.873 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757646+0000", 2024-04-18T21:06:58.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:58.873 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.873 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.873 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:58.873 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757646+0000", 2024-04-18T21:06:58.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:58.874 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.874 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.874 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:58.874 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757647+0000", 2024-04-18T21:06:58.874 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.44e-07 2024-04-18T21:06:58.874 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.874 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.874 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:58.874 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757656+0000", 2024-04-18T21:06:58.874 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6559999999999998e-06 2024-04-18T21:06:58.874 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.874 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.874 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:58.874 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757665+0000", 2024-04-18T21:06:58.874 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.6099999999999995e-06 2024-04-18T21:06:58.875 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.875 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.875 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.875 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757672+0000", 2024-04-18T21:06:58.875 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7270000000000001e-06 2024-04-18T21:06:58.875 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.875 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.875 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:58.875 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.794854+0000", 2024-04-18T21:06:58.875 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.037182448999999999 2024-04-18T21:06:58.875 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.875 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.875 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:58.875 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.795081+0000", 2024-04-18T21:06:58.875 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000226689 2024-04-18T21:06:58.875 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.875 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.876 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:58.876 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.795369+0000", 2024-04-18T21:06:58.876 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028752600000000003 2024-04-18T21:06:58.876 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.876 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.876 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:58.876 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.799725+0000", 2024-04-18T21:06:58.876 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043563509999999996 2024-04-18T21:06:58.876 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.876 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.876 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.876 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.800863+0000", 2024-04-18T21:06:58.876 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0011377799999999999 2024-04-18T21:06:58.876 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.876 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.877 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:58.877 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.800918+0000", 2024-04-18T21:06:58.877 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5547999999999997e-05 2024-04-18T21:06:58.877 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.877 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.877 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:58.877 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.801003+0000", 2024-04-18T21:06:58.877 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4480000000000004e-05 2024-04-18T21:06:58.877 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:58.877 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:58.877 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:58.877 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.877 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.877 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:100 3.1f 3:f83d65d8:::200.00000004:head [write 315055~1400 [fadvise_dontneed] in=1400b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:58.878 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757681+0000", 2024-04-18T21:06:58.878 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.098013075000001, 2024-04-18T21:06:58.878 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045364542000000001, 2024-04-18T21:06:58.878 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:58.878 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:58.878 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.878 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:58.878 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.878 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:58.878 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757681+0000", 2024-04-18T21:06:58.878 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:58.878 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.878 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.878 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:58.879 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757681+0000", 2024-04-18T21:06:58.879 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:58.879 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.879 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.879 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:58.879 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757682+0000", 2024-04-18T21:06:58.879 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8999999999999996e-07 2024-04-18T21:06:58.879 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.879 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.879 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:58.879 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757685+0000", 2024-04-18T21:06:58.879 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.766e-06 2024-04-18T21:06:58.879 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.879 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.879 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:58.880 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757715+0000", 2024-04-18T21:06:58.880 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9904e-05 2024-04-18T21:06:58.880 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.880 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.880 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.880 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757723+0000", 2024-04-18T21:06:58.880 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9899999999999997e-06 2024-04-18T21:06:58.880 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.880 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.880 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:58.880 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.796754+0000", 2024-04-18T21:06:58.880 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.039030774999999997 2024-04-18T21:06:58.880 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.880 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.880 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:58.881 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.796825+0000", 2024-04-18T21:06:58.881 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0511000000000003e-05 2024-04-18T21:06:58.881 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.881 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.881 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:58.881 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.796952+0000", 2024-04-18T21:06:58.881 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012720099999999999 2024-04-18T21:06:58.881 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.881 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.881 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:58.881 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.800774+0000", 2024-04-18T21:06:58.881 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0038226039999999998 2024-04-18T21:06:58.881 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.881 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.881 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.882 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802920+0000", 2024-04-18T21:06:58.882 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002145194 2024-04-18T21:06:58.882 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.882 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.882 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:58.882 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802998+0000", 2024-04-18T21:06:58.882 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7836000000000005e-05 2024-04-18T21:06:58.882 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.882 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.882 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:58.882 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803046+0000", 2024-04-18T21:06:58.882 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8071000000000001e-05 2024-04-18T21:06:58.882 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:58.882 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:58.883 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:58.883 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.883 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.883 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:101 3.1f 3:f83d65d8:::200.00000004:head [write 316455~1401 [fadvise_dontneed] in=1401b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:58.883 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:06:58.883 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.097960312, 2024-04-18T21:06:58.883 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.048270212999999999, 2024-04-18T21:06:58.883 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:58.883 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:58.883 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.883 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:58.883 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.883 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:58.883 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:06:58.884 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:58.884 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.884 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.884 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:58.884 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:06:58.884 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:58.884 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.884 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.884 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:58.884 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:06:58.884 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7700000000000004e-07 2024-04-18T21:06:58.884 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.884 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.884 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:58.884 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757745+0000", 2024-04-18T21:06:58.885 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0910000000000001e-05 2024-04-18T21:06:58.885 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.885 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.885 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:58.885 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757758+0000", 2024-04-18T21:06:58.885 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2593e-05 2024-04-18T21:06:58.885 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.885 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.885 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.885 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757765+0000", 2024-04-18T21:06:58.885 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1659999999999997e-06 2024-04-18T21:06:58.885 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.885 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.885 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:58.886 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.797782+0000", 2024-04-18T21:06:58.886 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.040017283000000001 2024-04-18T21:06:58.886 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.886 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.886 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:58.886 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.797949+0000", 2024-04-18T21:06:58.886 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016650399999999999 2024-04-18T21:06:58.887 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.887 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.887 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:58.887 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.798152+0000", 2024-04-18T21:06:58.887 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000203098 2024-04-18T21:06:58.887 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.887 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.887 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:58.887 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.800792+0000", 2024-04-18T21:06:58.887 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026394779999999998 2024-04-18T21:06:58.887 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.887 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.887 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.888 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805921+0000", 2024-04-18T21:06:58.888 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0051295519999999999 2024-04-18T21:06:58.888 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.888 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.888 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:58.888 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805967+0000", 2024-04-18T21:06:58.888 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5457000000000002e-05 2024-04-18T21:06:58.888 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.888 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.888 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:58.888 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806004+0000", 2024-04-18T21:06:58.888 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7494999999999999e-05 2024-04-18T21:06:58.888 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:58.888 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:58.888 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:58.888 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.889 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.889 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:102 3.1f 3:f83d65d8:::200.00000004:head [write 317856~1403 [fadvise_dontneed] in=1403b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:58.889 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757775+0000", 2024-04-18T21:06:58.889 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.097919246, 2024-04-18T21:06:58.889 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.048337705000000002, 2024-04-18T21:06:58.889 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:58.889 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:58.889 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.889 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:58.889 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.889 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:58.889 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757775+0000", 2024-04-18T21:06:58.889 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:58.889 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.890 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.890 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:58.890 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757775+0000", 2024-04-18T21:06:58.890 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:58.890 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.890 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.890 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:58.890 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757776+0000", 2024-04-18T21:06:58.890 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5300000000000004e-07 2024-04-18T21:06:58.890 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.890 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.890 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:58.890 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757780+0000", 2024-04-18T21:06:58.891 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2270000000000004e-06 2024-04-18T21:06:58.891 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.891 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.891 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:58.891 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757792+0000", 2024-04-18T21:06:58.891 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2696e-05 2024-04-18T21:06:58.891 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.891 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.891 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.891 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757800+0000", 2024-04-18T21:06:58.891 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1439999999999997e-06 2024-04-18T21:06:58.891 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.891 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.891 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:58.892 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.798773+0000", 2024-04-18T21:06:58.892 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.040973074999999998 2024-04-18T21:06:58.892 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.892 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.892 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:58.892 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.798990+0000", 2024-04-18T21:06:58.892 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000217161 2024-04-18T21:06:58.892 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.892 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.892 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:58.892 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.799173+0000", 2024-04-18T21:06:58.892 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018295900000000001 2024-04-18T21:06:58.892 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.892 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.892 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:58.893 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802469+0000", 2024-04-18T21:06:58.893 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032965350000000002 2024-04-18T21:06:58.893 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.893 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.893 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.893 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806042+0000", 2024-04-18T21:06:58.893 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035724630000000001 2024-04-18T21:06:58.893 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.893 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.893 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:58.893 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806077+0000", 2024-04-18T21:06:58.893 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4997999999999999e-05 2024-04-18T21:06:58.893 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.893 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.893 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:58.893 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806113+0000", 2024-04-18T21:06:58.894 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5794000000000003e-05 2024-04-18T21:06:58.894 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:58.894 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:58.894 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:58.894 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.894 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.894 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:103 3.1f 3:f83d65d8:::200.00000004:head [write 319259~1404 [fadvise_dontneed] in=1404b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:58.894 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:06:58.894 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.097885399999999, 2024-04-18T21:06:58.894 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.048414481000000002, 2024-04-18T21:06:58.894 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:58.894 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:58.895 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.895 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:58.895 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.895 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:58.895 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:06:58.895 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:58.895 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.895 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.895 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:58.895 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:06:58.895 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:58.895 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.895 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.895 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:58.895 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:06:58.896 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4700000000000001e-07 2024-04-18T21:06:58.896 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.896 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.896 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:58.896 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757814+0000", 2024-04-18T21:06:58.896 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1829999999999996e-06 2024-04-18T21:06:58.896 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.896 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.896 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:58.896 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757825+0000", 2024-04-18T21:06:58.896 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1754e-05 2024-04-18T21:06:58.896 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.896 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.896 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.896 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757832+0000", 2024-04-18T21:06:58.897 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8430000000000004e-06 2024-04-18T21:06:58.897 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.897 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.897 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:58.897 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.799809+0000", 2024-04-18T21:06:58.897 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.041976960000000001 2024-04-18T21:06:58.897 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.897 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.897 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:58.897 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.799934+0000", 2024-04-18T21:06:58.897 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000125053 2024-04-18T21:06:58.897 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.897 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.897 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:58.897 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.800067+0000", 2024-04-18T21:06:58.898 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013276299999999999 2024-04-18T21:06:58.898 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.898 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.898 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:58.898 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804582+0000", 2024-04-18T21:06:58.898 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0045148899999999997 2024-04-18T21:06:58.898 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.898 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.898 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.898 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806158+0000", 2024-04-18T21:06:58.898 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001575894 2024-04-18T21:06:58.898 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.899 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.899 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:58.899 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806189+0000", 2024-04-18T21:06:58.899 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1423000000000001e-05 2024-04-18T21:06:58.899 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.899 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.900 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:58.900 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806223+0000", 2024-04-18T21:06:58.900 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4071e-05 2024-04-18T21:06:58.900 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:58.900 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:58.900 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:58.900 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.900 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.900 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:104 3.1f 3:f83d65d8:::200.00000004:head [write 320663~1405 [fadvise_dontneed] in=1405b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:58.900 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757841+0000", 2024-04-18T21:06:58.900 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.097853196000001, 2024-04-18T21:06:58.900 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056381623999999998, 2024-04-18T21:06:58.900 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:58.900 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:58.900 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.901 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:58.901 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.901 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:58.901 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757841+0000", 2024-04-18T21:06:58.901 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:58.901 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.901 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.901 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:58.901 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757841+0000", 2024-04-18T21:06:58.901 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:58.901 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.901 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.901 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:58.901 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757842+0000", 2024-04-18T21:06:58.901 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5000000000000002e-07 2024-04-18T21:06:58.901 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.902 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.902 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:58.902 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757852+0000", 2024-04-18T21:06:58.902 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.084e-05 2024-04-18T21:06:58.902 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.902 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.902 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:58.902 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757865+0000", 2024-04-18T21:06:58.902 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2643000000000001e-05 2024-04-18T21:06:58.902 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.902 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.902 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.902 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757872+0000", 2024-04-18T21:06:58.903 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8689999999999998e-06 2024-04-18T21:06:58.903 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.903 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.903 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:58.903 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.801102+0000", 2024-04-18T21:06:58.903 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043229837 2024-04-18T21:06:58.903 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.903 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.903 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:58.903 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.801291+0000", 2024-04-18T21:06:58.903 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000189641 2024-04-18T21:06:58.903 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.903 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.903 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:58.903 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.801640+0000", 2024-04-18T21:06:58.903 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000348971 2024-04-18T21:06:58.904 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.904 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.904 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:58.904 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805849+0000", 2024-04-18T21:06:58.904 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042082739999999997 2024-04-18T21:06:58.904 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.904 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.904 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.904 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814135+0000", 2024-04-18T21:06:58.904 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0082867270000000007 2024-04-18T21:06:58.904 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.904 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.904 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:58.904 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814180+0000", 2024-04-18T21:06:58.904 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4982999999999999e-05 2024-04-18T21:06:58.905 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.905 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.905 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:58.905 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814223+0000", 2024-04-18T21:06:58.905 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2188999999999999e-05 2024-04-18T21:06:58.905 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:58.905 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:58.905 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:58.905 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.905 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.905 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:105 3.1f 3:f83d65d8:::200.00000004:head [write 322068~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:58.905 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:06:58.905 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.097812599999999, 2024-04-18T21:06:58.905 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056513678999999997, 2024-04-18T21:06:58.905 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:58.905 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:58.906 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.906 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:58.906 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.906 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:58.906 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:06:58.906 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:58.906 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.906 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.906 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:58.906 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:06:58.906 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:58.906 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.906 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.906 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:58.906 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:06:58.906 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2600000000000002e-07 2024-04-18T21:06:58.907 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.907 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.907 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:58.907 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757888+0000", 2024-04-18T21:06:58.907 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7130000000000002e-06 2024-04-18T21:06:58.907 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.907 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.907 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:58.907 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757906+0000", 2024-04-18T21:06:58.907 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7723999999999998e-05 2024-04-18T21:06:58.907 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.907 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.907 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.907 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757921+0000", 2024-04-18T21:06:58.908 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4936000000000001e-05 2024-04-18T21:06:58.908 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.908 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.908 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:58.908 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802493+0000", 2024-04-18T21:06:58.908 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.044571927999999997 2024-04-18T21:06:58.908 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.908 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.908 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:58.908 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802537+0000", 2024-04-18T21:06:58.908 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4449000000000001e-05 2024-04-18T21:06:58.908 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.908 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.908 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:58.908 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802605+0000", 2024-04-18T21:06:58.909 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7945000000000001e-05 2024-04-18T21:06:58.909 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.909 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.909 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:58.909 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805852+0000", 2024-04-18T21:06:58.909 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032469909999999999 2024-04-18T21:06:58.909 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.909 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.909 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.909 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814298+0000", 2024-04-18T21:06:58.909 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084463309999999996 2024-04-18T21:06:58.909 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.909 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.909 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:58.909 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814355+0000", 2024-04-18T21:06:58.910 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6459999999999998e-05 2024-04-18T21:06:58.910 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.910 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.910 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:58.910 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814395+0000", 2024-04-18T21:06:58.910 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0475999999999997e-05 2024-04-18T21:06:58.910 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:58.910 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:58.910 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:58.910 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.910 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.910 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:106 3.1f 3:f83d65d8:::200.00000004:head [write 323467~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:58.911 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757955+0000", 2024-04-18T21:06:58.911 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.097739370999999, 2024-04-18T21:06:58.911 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056539990999999998, 2024-04-18T21:06:58.911 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:58.911 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:58.911 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.911 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:58.911 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.911 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:58.911 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757955+0000", 2024-04-18T21:06:58.911 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:58.911 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.911 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.911 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:58.912 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757955+0000", 2024-04-18T21:06:58.912 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:58.912 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.912 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.912 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:58.912 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757956+0000", 2024-04-18T21:06:58.912 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.144e-06 2024-04-18T21:06:58.912 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.912 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.912 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:58.912 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757970+0000", 2024-04-18T21:06:58.912 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3899e-05 2024-04-18T21:06:58.912 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.913 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.913 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:58.913 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757988+0000", 2024-04-18T21:06:58.913 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8033000000000002e-05 2024-04-18T21:06:58.913 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.914 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.914 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.914 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758002+0000", 2024-04-18T21:06:58.914 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3973e-05 2024-04-18T21:06:58.914 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.914 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.915 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:58.915 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803072+0000", 2024-04-18T21:06:58.915 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045070194000000001 2024-04-18T21:06:58.915 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.915 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.915 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:58.915 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803125+0000", 2024-04-18T21:06:58.915 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3498000000000002e-05 2024-04-18T21:06:58.915 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.915 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.915 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:58.915 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803233+0000", 2024-04-18T21:06:58.915 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010704099999999999 2024-04-18T21:06:58.915 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.916 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.916 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:58.916 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805856+0000", 2024-04-18T21:06:58.916 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026233430000000002 2024-04-18T21:06:58.916 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.916 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.916 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.916 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814439+0000", 2024-04-18T21:06:58.916 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0085833839999999995 2024-04-18T21:06:58.916 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.916 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.916 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:58.916 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814469+0000", 2024-04-18T21:06:58.916 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9784000000000001e-05 2024-04-18T21:06:58.917 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.917 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.917 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:58.917 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814495+0000", 2024-04-18T21:06:58.917 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5698e-05 2024-04-18T21:06:58.917 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:58.917 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:58.917 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:58.917 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.917 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.917 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:107 3.1f 3:f83d65d8:::200.00000004:head [write 324866~1421 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:58.917 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758019+0000", 2024-04-18T21:06:58.917 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.097674745000001, 2024-04-18T21:06:58.917 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056580563, 2024-04-18T21:06:58.918 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:58.918 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:58.918 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.918 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:58.918 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.918 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:58.918 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758019+0000", 2024-04-18T21:06:58.918 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:58.918 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.918 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.918 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:58.918 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758019+0000", 2024-04-18T21:06:58.919 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:58.919 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.919 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.919 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:58.919 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758021+0000", 2024-04-18T21:06:58.919 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1999999999999999e-06 2024-04-18T21:06:58.919 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.919 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.919 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:58.919 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758028+0000", 2024-04-18T21:06:58.919 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7200000000000006e-06 2024-04-18T21:06:58.919 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.920 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.920 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:58.920 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758050+0000", 2024-04-18T21:06:58.920 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1877000000000001e-05 2024-04-18T21:06:58.920 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.920 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.920 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.920 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758064+0000", 2024-04-18T21:06:58.920 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.383e-05 2024-04-18T21:06:58.920 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.920 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.920 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:58.920 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803593+0000", 2024-04-18T21:06:58.921 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045528831999999998 2024-04-18T21:06:58.921 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.921 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.921 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:58.921 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803635+0000", 2024-04-18T21:06:58.921 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1980000000000001e-05 2024-04-18T21:06:58.921 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.921 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.921 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:58.921 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803703+0000", 2024-04-18T21:06:58.921 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8542999999999997e-05 2024-04-18T21:06:58.921 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.921 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.921 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:58.922 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806123+0000", 2024-04-18T21:06:58.922 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002419769 2024-04-18T21:06:58.922 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.922 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.922 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.922 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814542+0000", 2024-04-18T21:06:58.922 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084189460000000001 2024-04-18T21:06:58.922 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.922 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.922 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:58.922 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814576+0000", 2024-04-18T21:06:58.922 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3679000000000001e-05 2024-04-18T21:06:58.922 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.922 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.922 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:58.923 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814600+0000", 2024-04-18T21:06:58.923 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4187000000000001e-05 2024-04-18T21:06:58.923 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:58.923 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:58.923 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:58.923 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.923 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.923 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:108 3.1f 3:f83d65d8:::200.00000004:head [write 326287~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:58.923 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:06:58.923 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.097611576, 2024-04-18T21:06:58.923 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056616183, 2024-04-18T21:06:58.923 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:58.923 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:58.924 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.924 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:58.924 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.924 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:58.924 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:06:58.924 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:58.924 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.924 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.924 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:58.924 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:06:58.924 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:58.924 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.924 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.924 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:58.925 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758084+0000", 2024-04-18T21:06:58.925 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.124e-06 2024-04-18T21:06:58.925 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.925 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.925 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:58.925 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758100+0000", 2024-04-18T21:06:58.925 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6246e-05 2024-04-18T21:06:58.925 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.925 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.925 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:58.925 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758118+0000", 2024-04-18T21:06:58.925 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8267e-05 2024-04-18T21:06:58.925 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.925 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.925 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.925 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758134+0000", 2024-04-18T21:06:58.926 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5950000000000001e-05 2024-04-18T21:06:58.926 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.926 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.926 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:58.926 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803949+0000", 2024-04-18T21:06:58.926 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045815349999999998 2024-04-18T21:06:58.926 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.926 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.926 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:58.926 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804011+0000", 2024-04-18T21:06:58.926 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1044999999999996e-05 2024-04-18T21:06:58.926 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.926 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.927 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:58.927 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804128+0000", 2024-04-18T21:06:58.927 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117148 2024-04-18T21:06:58.927 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.927 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.927 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:58.927 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806794+0000", 2024-04-18T21:06:58.927 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002666692 2024-04-18T21:06:58.927 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.927 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.927 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.927 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814645+0000", 2024-04-18T21:06:58.927 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0078508880000000003 2024-04-18T21:06:58.927 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.927 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.927 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:58.928 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814678+0000", 2024-04-18T21:06:58.928 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3188999999999997e-05 2024-04-18T21:06:58.928 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.928 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.928 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:58.928 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814699+0000", 2024-04-18T21:06:58.928 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0284000000000001e-05 2024-04-18T21:06:58.928 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:58.928 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:58.928 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:58.928 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.928 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.928 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:109 3.1f 3:f83d65d8:::200.00000004:head [write 327693~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:58.928 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:06:58.928 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.097542209, 2024-04-18T21:06:58.928 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056621036999999999, 2024-04-18T21:06:58.928 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:58.929 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:58.929 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.929 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:58.929 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.929 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:58.929 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:06:58.929 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:58.929 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.929 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.929 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:58.929 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:06:58.929 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:58.929 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.929 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.930 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:58.930 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758153+0000", 2024-04-18T21:06:58.930 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1459999999999999e-06 2024-04-18T21:06:58.930 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.930 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.930 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:58.930 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758161+0000", 2024-04-18T21:06:58.930 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7999999999999999e-06 2024-04-18T21:06:58.930 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.930 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.930 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:58.930 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758179+0000", 2024-04-18T21:06:58.931 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7949999999999999e-05 2024-04-18T21:06:58.931 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.931 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.931 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.931 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758193+0000", 2024-04-18T21:06:58.931 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3773e-05 2024-04-18T21:06:58.931 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.931 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.931 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:58.931 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804632+0000", 2024-04-18T21:06:58.931 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.046439469999999997 2024-04-18T21:06:58.931 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.931 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.931 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:58.931 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804790+0000", 2024-04-18T21:06:58.931 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015784300000000001 2024-04-18T21:06:58.932 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.932 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.932 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:58.932 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805056+0000", 2024-04-18T21:06:58.932 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026652400000000003 2024-04-18T21:06:58.932 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.932 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.932 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:58.932 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.808959+0000", 2024-04-18T21:06:58.932 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003903077 2024-04-18T21:06:58.932 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.932 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.932 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.932 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814728+0000", 2024-04-18T21:06:58.932 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0057682489999999996 2024-04-18T21:06:58.932 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.933 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.933 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:58.933 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814754+0000", 2024-04-18T21:06:58.933 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6673999999999999e-05 2024-04-18T21:06:58.933 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.933 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.933 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:58.933 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814773+0000", 2024-04-18T21:06:58.933 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8530999999999999e-05 2024-04-18T21:06:58.933 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:58.933 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:58.933 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:58.933 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.933 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.933 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:110 3.1f 3:f83d65d8:::200.00000004:head [write 329098~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:58.933 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:06:58.934 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.097483799999999, 2024-04-18T21:06:58.934 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056669113, 2024-04-18T21:06:58.934 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:58.934 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:58.934 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.934 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:58.934 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.934 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:58.934 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:06:58.934 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:58.934 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.934 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.934 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:58.934 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:06:58.934 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:58.935 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.935 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.935 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:58.935 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758212+0000", 2024-04-18T21:06:58.935 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:06:58.935 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.935 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.935 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:58.935 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758219+0000", 2024-04-18T21:06:58.935 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4229999999999999e-06 2024-04-18T21:06:58.935 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.935 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.935 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:58.935 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758237+0000", 2024-04-18T21:06:58.935 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7966999999999999e-05 2024-04-18T21:06:58.936 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.936 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.936 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.936 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758252+0000", 2024-04-18T21:06:58.936 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5322999999999999e-05 2024-04-18T21:06:58.936 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.936 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.936 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:58.936 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805536+0000", 2024-04-18T21:06:58.936 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.047283861000000003 2024-04-18T21:06:58.936 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.936 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.936 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:58.936 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805579+0000", 2024-04-18T21:06:58.936 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2738999999999999e-05 2024-04-18T21:06:58.937 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.937 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.937 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:58.937 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805649+0000", 2024-04-18T21:06:58.937 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0213e-05 2024-04-18T21:06:58.937 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.937 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.937 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:58.937 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.808966+0000", 2024-04-18T21:06:58.937 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033166129999999999 2024-04-18T21:06:58.937 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.937 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.937 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.937 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814812+0000", 2024-04-18T21:06:58.938 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0058463589999999998 2024-04-18T21:06:58.938 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.938 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.938 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:58.938 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814854+0000", 2024-04-18T21:06:58.938 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1618e-05 2024-04-18T21:06:58.938 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.938 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.938 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:58.938 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814879+0000", 2024-04-18T21:06:58.938 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5754000000000001e-05 2024-04-18T21:06:58.938 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:58.938 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:58.939 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:58.939 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.939 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.939 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:111 3.1f 3:f83d65d8:::200.00000004:head [write 330499~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:58.939 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:06:58.939 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.097422824000001, 2024-04-18T21:06:58.939 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058693793000000001, 2024-04-18T21:06:58.939 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:58.939 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:58.939 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.939 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:58.939 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.939 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:58.939 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:06:58.939 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:58.940 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.940 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.940 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:58.940 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:06:58.940 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:58.940 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.940 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.940 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:58.940 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758272+0000", 2024-04-18T21:06:58.940 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1200000000000001e-06 2024-04-18T21:06:58.940 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.940 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.940 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:58.940 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758287+0000", 2024-04-18T21:06:58.941 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5017e-05 2024-04-18T21:06:58.941 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.941 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.941 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:58.941 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758309+0000", 2024-04-18T21:06:58.941 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1866e-05 2024-04-18T21:06:58.941 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.941 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.941 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.941 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758323+0000", 2024-04-18T21:06:58.941 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3606e-05 2024-04-18T21:06:58.941 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.941 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.941 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:58.942 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806279+0000", 2024-04-18T21:06:58.942 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.047956061000000001 2024-04-18T21:06:58.942 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.942 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.942 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:58.942 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806350+0000", 2024-04-18T21:06:58.942 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1070999999999998e-05 2024-04-18T21:06:58.942 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.942 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.942 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:58.942 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806459+0000", 2024-04-18T21:06:58.942 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000108606 2024-04-18T21:06:58.942 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.942 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.943 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:58.943 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.809774+0000", 2024-04-18T21:06:58.943 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003314881 2024-04-18T21:06:58.943 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.943 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.943 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.943 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816910+0000", 2024-04-18T21:06:58.943 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0071367760000000001 2024-04-18T21:06:58.943 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.943 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.943 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:58.943 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816941+0000", 2024-04-18T21:06:58.943 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0846000000000002e-05 2024-04-18T21:06:58.943 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.944 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.944 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:58.944 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816965+0000", 2024-04-18T21:06:58.944 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3943000000000001e-05 2024-04-18T21:06:58.944 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:58.944 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:58.944 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:58.944 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.944 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.944 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:5230 4.17 4:eb2cc4c4:::1000000184c.00000000:head [write 0~2191] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-18T21:06:58.944 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.760650+0000", 2024-04-18T21:06:58.944 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.095043652999999, 2024-04-18T21:06:58.944 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.054210577000000003, 2024-04-18T21:06:58.944 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:58.944 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:58.945 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.945 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:06:58.945 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:06:58.945 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:58.945 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 5230 2024-04-18T21:06:58.945 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.945 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:58.945 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.945 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:58.945 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760650+0000", 2024-04-18T21:06:58.945 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:58.945 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.945 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.945 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:58.945 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760650+0000", 2024-04-18T21:06:58.946 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:58.946 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.946 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.946 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:58.946 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760653+0000", 2024-04-18T21:06:58.946 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0829999999999998e-06 2024-04-18T21:06:58.946 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.946 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.946 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:58.946 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760664+0000", 2024-04-18T21:06:58.946 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.111e-05 2024-04-18T21:06:58.946 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.946 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.946 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:58.946 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760688+0000", 2024-04-18T21:06:58.947 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4837e-05 2024-04-18T21:06:58.947 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.947 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.947 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.947 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760702+0000", 2024-04-18T21:06:58.947 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3723000000000001e-05 2024-04-18T21:06:58.947 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.947 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.947 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:58.947 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806264+0000", 2024-04-18T21:06:58.947 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045562182 2024-04-18T21:06:58.947 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.947 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.947 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:58.947 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806351+0000", 2024-04-18T21:06:58.948 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6322000000000005e-05 2024-04-18T21:06:58.948 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.948 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.948 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:58.948 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806453+0000", 2024-04-18T21:06:58.948 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000102602 2024-04-18T21:06:58.948 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.948 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.948 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:58.948 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.808972+0000", 2024-04-18T21:06:58.948 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025184090000000001 2024-04-18T21:06:58.948 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.948 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.948 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.949 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814798+0000", 2024-04-18T21:06:58.949 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0058266689999999996 2024-04-18T21:06:58.949 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.949 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.949 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:58.949 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814839+0000", 2024-04-18T21:06:58.949 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0482000000000003e-05 2024-04-18T21:06:58.949 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.949 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.949 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:58.949 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814861+0000", 2024-04-18T21:06:58.949 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2158e-05 2024-04-18T21:06:58.949 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:58.949 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:58.949 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:58.950 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.950 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.950 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:112 3.1f 3:f83d65d8:::200.00000004:head [write 331898~20167 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:58.950 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.771321+0000", 2024-04-18T21:06:58.950 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.084373026, 2024-04-18T21:06:58.950 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045740306000000001, 2024-04-18T21:06:58.950 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:58.950 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:58.950 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.950 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:58.950 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.950 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:58.950 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771321+0000", 2024-04-18T21:06:58.950 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:58.951 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.951 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.951 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:58.951 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771321+0000", 2024-04-18T21:06:58.951 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:58.951 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.951 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.951 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:58.951 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771323+0000", 2024-04-18T21:06:58.951 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3740000000000001e-06 2024-04-18T21:06:58.951 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.951 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.951 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:58.951 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771359+0000", 2024-04-18T21:06:58.952 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5447999999999997e-05 2024-04-18T21:06:58.952 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.952 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.952 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:58.952 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771388+0000", 2024-04-18T21:06:58.952 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8915e-05 2024-04-18T21:06:58.952 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.952 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.952 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.952 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771410+0000", 2024-04-18T21:06:58.952 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1899000000000002e-05 2024-04-18T21:06:58.952 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.952 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.952 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:58.953 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806827+0000", 2024-04-18T21:06:58.953 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.035417063999999998 2024-04-18T21:06:58.953 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.953 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.953 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:58.953 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806873+0000", 2024-04-18T21:06:58.953 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6261999999999999e-05 2024-04-18T21:06:58.953 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.953 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.953 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:58.953 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806946+0000", 2024-04-18T21:06:58.953 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3205000000000001e-05 2024-04-18T21:06:58.954 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.954 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.954 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:58.954 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.809781+0000", 2024-04-18T21:06:58.954 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002834937 2024-04-18T21:06:58.954 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.954 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.954 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.954 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817003+0000", 2024-04-18T21:06:58.954 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0072217959999999999 2024-04-18T21:06:58.954 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.954 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.955 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:58.955 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817038+0000", 2024-04-18T21:06:58.955 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4696999999999997e-05 2024-04-18T21:06:58.955 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.955 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.955 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:58.955 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817061+0000", 2024-04-18T21:06:58.955 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3708999999999999e-05 2024-04-18T21:06:58.955 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:58.955 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:58.955 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:58.955 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.955 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.955 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:113 3.1f 3:f83d65d8:::200.00000004:head [write 352065~3878 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:58.956 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.771472+0000", 2024-04-18T21:06:58.956 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.08422229, 2024-04-18T21:06:58.956 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045689726, 2024-04-18T21:06:58.956 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:58.956 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:58.956 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.956 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:58.956 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.956 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:58.956 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771472+0000", 2024-04-18T21:06:58.956 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:58.956 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.956 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.956 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:58.956 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771472+0000", 2024-04-18T21:06:58.957 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:58.957 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.957 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.957 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:58.957 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771473+0000", 2024-04-18T21:06:58.957 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3829999999999999e-06 2024-04-18T21:06:58.957 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.957 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.957 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:58.957 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771489+0000", 2024-04-18T21:06:58.957 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5797000000000001e-05 2024-04-18T21:06:58.957 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.957 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.957 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:58.957 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771509+0000", 2024-04-18T21:06:58.958 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0401999999999999e-05 2024-04-18T21:06:58.958 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.958 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.958 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.958 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771525+0000", 2024-04-18T21:06:58.958 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5099999999999999e-05 2024-04-18T21:06:58.958 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.958 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.958 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:58.958 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807273+0000", 2024-04-18T21:06:58.958 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.035748488000000002 2024-04-18T21:06:58.958 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.958 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.958 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:58.958 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807343+0000", 2024-04-18T21:06:58.959 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0277000000000005e-05 2024-04-18T21:06:58.959 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.959 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.959 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:58.959 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807455+0000", 2024-04-18T21:06:58.959 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011171999999999999 2024-04-18T21:06:58.959 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.959 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.959 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:58.959 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.811509+0000", 2024-04-18T21:06:58.959 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0040543469999999998 2024-04-18T21:06:58.959 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.959 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.959 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.959 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817115+0000", 2024-04-18T21:06:58.960 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0056054520000000004 2024-04-18T21:06:58.960 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.960 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.960 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:58.960 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817142+0000", 2024-04-18T21:06:58.960 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7430999999999999e-05 2024-04-18T21:06:58.960 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.960 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.960 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:58.960 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817162+0000", 2024-04-18T21:06:58.960 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9329000000000001e-05 2024-04-18T21:06:58.960 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:58.960 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:58.960 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:58.960 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.960 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.961 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:114 3.1f 3:f83d65d8:::200.00000004:head [write 355943~1928 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:06:58.961 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.771785+0000", 2024-04-18T21:06:58.961 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.083908944999999, 2024-04-18T21:06:58.961 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045480532999999997, 2024-04-18T21:06:58.961 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:58.961 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:58.961 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:58.961 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:58.961 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.961 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:58.961 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771785+0000", 2024-04-18T21:06:58.961 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:58.961 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.962 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.962 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:58.962 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771785+0000", 2024-04-18T21:06:58.962 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:58.962 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.962 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.962 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:58.963 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771787+0000", 2024-04-18T21:06:58.963 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0600000000000002e-06 2024-04-18T21:06:58.963 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.963 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.963 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:58.963 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771799+0000", 2024-04-18T21:06:58.964 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1503e-05 2024-04-18T21:06:58.964 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.964 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.964 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:58.964 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771829+0000", 2024-04-18T21:06:58.964 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.04e-05 2024-04-18T21:06:58.964 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.964 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.964 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:58.964 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771846+0000", 2024-04-18T21:06:58.964 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6608000000000001e-05 2024-04-18T21:06:58.964 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.965 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.965 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:58.965 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807856+0000", 2024-04-18T21:06:58.965 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036010480999999997 2024-04-18T21:06:58.965 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.965 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.965 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:06:58.965 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807899+0000", 2024-04-18T21:06:58.965 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2775999999999998e-05 2024-04-18T21:06:58.965 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.965 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.965 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:06:58.965 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807966+0000", 2024-04-18T21:06:58.965 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6793999999999998e-05 2024-04-18T21:06:58.966 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.966 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.966 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:06:58.966 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.811516+0000", 2024-04-18T21:06:58.966 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035497300000000001 2024-04-18T21:06:58.966 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.966 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.966 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:58.966 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817194+0000", 2024-04-18T21:06:58.966 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0056787030000000002 2024-04-18T21:06:58.966 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.966 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.966 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:06:58.966 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817231+0000", 2024-04-18T21:06:58.966 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6727000000000003e-05 2024-04-18T21:06:58.967 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:58.967 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:58.967 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:06:58.967 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817266+0000", 2024-04-18T21:06:58.967 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4751e-05 2024-04-18T21:06:58.967 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:58.967 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:58.967 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:58.967 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:58.967 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:58.967 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:58.970 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:06:58.974 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:58.966+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:58.985 INFO:tasks.workunit.client.0.smithi078.stdout:6/232: dwrite d2/d6/dd/d4b/f4e [0,4194304] 0 2024-04-18T21:06:58.985 INFO:tasks.workunit.client.0.smithi078.stdout:2/277: dwrite d0/db/d18/d21/f31 [4194304,4194304] 0 2024-04-18T21:06:58.986 INFO:tasks.workunit.client.0.smithi078.stdout:0/280: dwrite d0/d9/f2d [0,4194304] 0 2024-04-18T21:06:58.986 INFO:tasks.workunit.client.0.smithi078.stdout:0/281: unlink d0/d9/l29 0 2024-04-18T21:06:58.986 INFO:tasks.workunit.client.0.smithi078.stdout:6/233: link d2/ff d2/d1f/f50 0 2024-04-18T21:06:58.986 INFO:tasks.workunit.client.0.smithi078.stdout:1/313: truncate d0/d2a/d2f/f56 346990 0 2024-04-18T21:06:58.986 INFO:tasks.workunit.client.0.smithi078.stdout:1/314: mkdir d0/d46/d32/d35/d71 0 2024-04-18T21:06:58.986 INFO:tasks.workunit.client.0.smithi078.stdout:1/315: creat d0/d11/d69/f72 x:0 0 0 2024-04-18T21:06:58.986 INFO:tasks.workunit.client.0.smithi078.stdout:5/316: dread d9/da/f1b [0,4194304] 0 2024-04-18T21:06:58.986 INFO:tasks.workunit.client.0.smithi078.stdout:5/317: creat d9/d2e/d29/d55/d62/f63 x:0 0 0 2024-04-18T21:06:58.986 INFO:tasks.workunit.client.0.smithi078.stdout:5/318: creat d9/f64 x:0 0 0 2024-04-18T21:06:58.986 INFO:tasks.workunit.client.0.smithi078.stdout:8/225: dread d0/f6 [0,4194304] 0 2024-04-18T21:06:58.986 INFO:tasks.workunit.client.0.smithi078.stdout:8/226: chown d0/l9 202657769 1 2024-04-18T21:06:58.986 INFO:tasks.workunit.client.0.smithi078.stdout:6/234: dread d2/d6/dd/f31 [0,4194304] 0 2024-04-18T21:06:58.986 INFO:tasks.workunit.client.0.smithi078.stdout:4/320: dread d0/dc/d29/f4c [0,4194304] 0 2024-04-18T21:06:58.986 INFO:tasks.workunit.client.0.smithi078.stdout:1/316: fdatasync d0/d11/f2e 0 2024-04-18T21:06:58.987 INFO:tasks.workunit.client.0.smithi078.stdout:6/235: chown d2/d34/d35/d46 130349491 1 2024-04-18T21:06:58.987 INFO:tasks.workunit.client.0.smithi078.stdout:6/236: readlink d2/d1f/l2d 0 2024-04-18T21:06:58.987 INFO:tasks.workunit.client.0.smithi078.stdout:8/227: creat d0/f45 x:0 0 0 2024-04-18T21:06:58.987 INFO:tasks.workunit.client.0.smithi078.stdout:1/317: truncate d0/d46/d32/f67 123896 0 2024-04-18T21:06:58.987 INFO:tasks.workunit.client.0.smithi078.stdout:4/321: rename d0/dc/d29/f44 to d0/dc/d10/d41/f78 0 2024-04-18T21:06:58.987 INFO:tasks.workunit.client.0.smithi078.stdout:6/237: mknod d2/d34/d35/c51 0 2024-04-18T21:06:58.987 INFO:tasks.workunit.client.0.smithi078.stdout:1/318: readlink d0/d2a/d3c/d4b/l6e 0 2024-04-18T21:06:58.987 INFO:tasks.workunit.client.0.smithi078.stdout:8/228: dread d0/f2c [0,4194304] 0 2024-04-18T21:06:58.987 INFO:tasks.workunit.client.0.smithi078.stdout:6/238: rmdir d2/d34/d35/d46 39 2024-04-18T21:06:58.987 INFO:tasks.workunit.client.0.smithi078.stdout:3/252: truncate d4/df/f26 4464764 0 2024-04-18T21:06:58.987 INFO:tasks.workunit.client.0.smithi078.stdout:1/319: read d0/d2a/d2f/f44 [2125678,34110] 0 2024-04-18T21:06:58.987 INFO:tasks.workunit.client.0.smithi078.stdout:1/320: mkdir d0/d2a/d3c/d4b/d52/d73 0 2024-04-18T21:06:58.987 INFO:tasks.workunit.client.0.smithi078.stdout:4/322: read d0/dc/d37/f3b [197801,44465] 0 2024-04-18T21:06:58.987 INFO:tasks.workunit.client.0.smithi078.stdout:1/321: symlink d0/d2a/d63/l74 0 2024-04-18T21:06:58.988 INFO:tasks.workunit.client.0.smithi078.stdout:4/323: write d0/dc/d5b/f62 [861477,76304] 0 2024-04-18T21:06:58.988 INFO:tasks.workunit.client.0.smithi078.stdout:2/278: dwrite d0/db/d18/d21/d27/d29/f2d [0,4194304] 0 2024-04-18T21:06:58.988 INFO:tasks.workunit.client.0.smithi078.stdout:1/322: chown d0/d2a/d45/f5d 9719 1 2024-04-18T21:06:58.988 INFO:tasks.workunit.client.0.smithi078.stdout:4/324: getdents d0/dc/d5b/d71 0 2024-04-18T21:06:58.988 INFO:tasks.workunit.client.0.smithi078.stdout:3/253: dwrite d4/f9 [0,4194304] 0 2024-04-18T21:06:58.988 INFO:tasks.workunit.client.0.smithi078.stdout:6/239: dwrite d2/d1c/f20 [0,4194304] 0 2024-04-18T21:06:58.988 INFO:tasks.workunit.client.0.smithi078.stdout:4/325: write d0/f28 [575600,118651] 0 2024-04-18T21:06:58.988 INFO:tasks.workunit.client.0.smithi078.stdout:3/254: chown d4/da/d11/c1e 355 1 2024-04-18T21:06:58.988 INFO:tasks.workunit.client.0.smithi078.stdout:4/326: stat d0/dc/d29/d6d 0 2024-04-18T21:06:58.988 INFO:tasks.workunit.client.0.smithi078.stdout:4/327: write d0/dc/d29/d2f/f38 [612157,6878] 0 2024-04-18T21:06:58.988 INFO:tasks.workunit.client.0.smithi078.stdout:3/255: mknod d4/d2d/d30/c3f 0 2024-04-18T21:06:58.988 INFO:tasks.workunit.client.0.smithi078.stdout:4/328: creat d0/dc/d5b/d4f/f79 x:0 0 0 2024-04-18T21:06:58.988 INFO:tasks.workunit.client.0.smithi078.stdout:1/323: truncate d0/d11/f2e 3763282 0 2024-04-18T21:06:58.988 INFO:tasks.workunit.client.0.smithi078.stdout:1/324: rmdir d0/d2a/d63 39 2024-04-18T21:06:58.989 INFO:tasks.workunit.client.0.smithi078.stdout:4/329: creat d0/dc/d10/d1c/d60/f7a x:0 0 0 2024-04-18T21:06:58.989 INFO:tasks.workunit.client.0.smithi078.stdout:6/240: dwrite d2/d6/f44 [0,4194304] 0 2024-04-18T21:06:58.989 INFO:tasks.workunit.client.0.smithi078.stdout:4/330: mkdir d0/dc/d29/d6d/d7b 0 2024-04-18T21:06:58.989 INFO:tasks.workunit.client.0.smithi078.stdout:4/331: rename d0/dc/d29/d2f/f49 to d0/dc/d10/d1c/d60/f7c 0 2024-04-18T21:06:58.989 INFO:tasks.workunit.client.0.smithi078.stdout:6/241: symlink d2/d6/dd/l52 0 2024-04-18T21:06:58.989 INFO:tasks.workunit.client.0.smithi078.stdout:4/332: creat d0/dc/d29/f7d x:0 0 0 2024-04-18T21:06:58.989 INFO:tasks.workunit.client.0.smithi078.stdout:6/242: write d2/d6/dd/f31 [1001157,51737] 0 2024-04-18T21:06:58.989 INFO:tasks.workunit.client.0.smithi078.stdout:4/333: mkdir d0/dc/d10/d3a/d7e 0 2024-04-18T21:06:58.989 INFO:tasks.workunit.client.0.smithi078.stdout:6/243: creat d2/d1c/f53 x:0 0 0 2024-04-18T21:06:58.989 INFO:tasks.workunit.client.0.smithi078.stdout:4/334: mknod d0/dc/d29/d2f/c7f 0 2024-04-18T21:06:58.989 INFO:tasks.workunit.client.0.smithi078.stdout:6/244: rename d2/l33 to d2/d6/dd/d4b/l54 0 2024-04-18T21:06:58.989 INFO:tasks.workunit.client.0.smithi078.stdout:5/319: dread d9/f34 [0,4194304] 0 2024-04-18T21:06:58.989 INFO:tasks.workunit.client.0.smithi078.stdout:4/335: creat d0/dc/d10/d3a/d7e/f80 x:0 0 0 2024-04-18T21:06:58.989 INFO:tasks.workunit.client.0.smithi078.stdout:5/320: mkdir d9/d2e/d65 0 2024-04-18T21:06:58.990 INFO:tasks.workunit.client.0.smithi078.stdout:5/321: creat d9/d2e/f66 x:0 0 0 2024-04-18T21:06:58.990 INFO:tasks.workunit.client.0.smithi078.stdout:5/322: read - d9/da/d4b/f58 zero size 2024-04-18T21:06:58.990 INFO:tasks.workunit.client.0.smithi078.stdout:5/323: write d9/f34 [742002,21751] 0 2024-04-18T21:06:58.990 INFO:tasks.workunit.client.0.smithi078.stdout:5/324: mkdir d9/da/d3e/d4c/d67 0 2024-04-18T21:06:58.990 INFO:tasks.workunit.client.0.smithi078.stdout:5/325: write d9/da/d32/f51 [5031409,94177] 0 2024-04-18T21:06:58.990 INFO:tasks.workunit.client.0.smithi078.stdout:2/279: dread d0/d1f/f43 [0,4194304] 0 2024-04-18T21:06:58.990 INFO:tasks.workunit.client.0.smithi078.stdout:2/280: symlink d0/db/d18/d30/l50 0 2024-04-18T21:06:58.990 INFO:tasks.workunit.client.0.smithi078.stdout:1/325: dread d0/d46/f49 [0,4194304] 0 2024-04-18T21:06:58.990 INFO:tasks.workunit.client.0.smithi078.stdout:2/281: rename d0/db/d18/d21 to d0/db/d18/d21/d27/d51 22 2024-04-18T21:06:58.990 INFO:tasks.workunit.client.0.smithi078.stdout:1/326: mkdir d0/d2a/d3c/d4b/d4/d61/d75 0 2024-04-18T21:06:58.990 INFO:tasks.workunit.client.0.smithi078.stdout:2/282: rmdir d0 39 2024-04-18T21:06:58.990 INFO:tasks.workunit.client.0.smithi078.stdout:1/327: fsync d0/d46/f17 0 2024-04-18T21:06:58.990 INFO:tasks.workunit.client.0.smithi078.stdout:5/326: dwrite d9/da/d32/f60 [0,4194304] 0 2024-04-18T21:06:58.991 INFO:tasks.workunit.client.0.smithi078.stdout:7/287: sync 2024-04-18T21:06:58.991 INFO:tasks.workunit.client.0.smithi078.stdout:1/328: write d0/d2a/d3c/d4b/d4/f3d [3062579,61807] 0 2024-04-18T21:06:58.991 INFO:tasks.workunit.client.0.smithi078.stdout:6/245: dwrite d2/f21 [0,4194304] 0 2024-04-18T21:06:58.991 INFO:tasks.workunit.client.0.smithi078.stdout:5/327: chown d9/f1e 135547 1 2024-04-18T21:06:58.991 INFO:tasks.workunit.client.0.smithi078.stdout:1/329: creat d0/d2a/d45/f76 x:0 0 0 2024-04-18T21:06:58.991 INFO:tasks.workunit.client.0.smithi078.stdout:5/328: symlink d9/d2e/d65/l68 0 2024-04-18T21:06:58.991 INFO:tasks.workunit.client.0.smithi078.stdout:7/288: creat d1/f6d x:0 0 0 2024-04-18T21:06:58.991 INFO:tasks.workunit.client.0.smithi078.stdout:5/329: mknod d9/c69 0 2024-04-18T21:06:58.991 INFO:tasks.workunit.client.0.smithi078.stdout:7/289: creat d1/d16/dc/d11/f6e x:0 0 0 2024-04-18T21:06:58.991 INFO:tasks.workunit.client.0.smithi078.stdout:2/283: dwrite d0/d1f/f44 [0,4194304] 0 2024-04-18T21:06:58.991 INFO:tasks.workunit.client.0.smithi078.stdout:3/256: dread d4/da/d11/f22 [0,4194304] 0 2024-04-18T21:06:58.991 INFO:tasks.workunit.client.0.smithi078.stdout:3/257: write d4/f9 [2391441,81756] 0 2024-04-18T21:06:58.991 INFO:tasks.workunit.client.0.smithi078.stdout:7/290: dread d1/d16/dc/f37 [0,4194304] 0 2024-04-18T21:06:58.991 INFO:tasks.workunit.client.0.smithi078.stdout:2/284: dread d0/db/d18/f1c [0,4194304] 0 2024-04-18T21:06:58.991 INFO:tasks.workunit.client.0.smithi078.stdout:0/282: dread d0/d9/da/f10 [0,4194304] 0 2024-04-18T21:06:58.992 INFO:tasks.workunit.client.0.smithi078.stdout:7/291: mknod d1/d16/dc/d4b/c6f 0 2024-04-18T21:06:58.992 INFO:tasks.workunit.client.0.smithi078.stdout:2/285: chown d0/db/d18/d21/d27/d29/d33/c3a 56358 1 2024-04-18T21:06:58.992 INFO:tasks.workunit.client.0.smithi078.stdout:7/292: write d1/f20 [307098,52201] 0 2024-04-18T21:06:58.992 INFO:tasks.workunit.client.0.smithi078.stdout:0/283: rename d0/d9/da/db/f13 to d0/d15/f53 0 2024-04-18T21:06:58.992 INFO:tasks.workunit.client.0.smithi078.stdout:0/284: write d0/f8 [7183253,1423] 0 2024-04-18T21:06:58.992 INFO:tasks.workunit.client.0.smithi078.stdout:5/330: truncate d9/da/f13 2428829 0 2024-04-18T21:06:58.992 INFO:tasks.workunit.client.0.smithi078.stdout:7/293: symlink d1/d16/dc/d4b/l70 0 2024-04-18T21:06:58.992 INFO:tasks.workunit.client.0.smithi078.stdout:2/286: mknod d0/db/d18/d21/d27/c52 0 2024-04-18T21:06:58.992 INFO:tasks.workunit.client.0.smithi078.stdout:5/331: fdatasync d9/f3c 0 2024-04-18T21:06:58.992 INFO:tasks.workunit.client.0.smithi078.stdout:7/294: chown d1/d16/d10/d5a 502254919 1 2024-04-18T21:06:58.992 INFO:tasks.workunit.client.0.smithi078.stdout:1/330: dread d0/d2a/d2f/f56 [0,4194304] 0 2024-04-18T21:06:58.992 INFO:tasks.workunit.client.0.smithi078.stdout:0/285: rmdir d0/d9/da/db/d35/d3f 39 2024-04-18T21:06:58.992 INFO:tasks.workunit.client.0.smithi078.stdout:3/258: dwrite d4/f9 [0,4194304] 0 2024-04-18T21:06:58.992 INFO:tasks.workunit.client.0.smithi078.stdout:2/287: rename d0/f3 to d0/d1f/d34/f53 0 2024-04-18T21:06:58.993 INFO:tasks.workunit.client.0.smithi078.stdout:1/331: stat d0/d11/l47 0 2024-04-18T21:06:58.993 INFO:tasks.workunit.client.0.smithi078.stdout:5/332: dread d9/da/f1b [0,4194304] 0 2024-04-18T21:06:58.993 INFO:tasks.workunit.client.0.smithi078.stdout:8/229: dread d0/f5 [4194304,4194304] 0 2024-04-18T21:06:58.993 INFO:tasks.workunit.client.0.smithi078.stdout:0/286: dread d0/d9/dd/d17/d2e/f39 [0,4194304] 0 2024-04-18T21:06:58.993 INFO:tasks.workunit.client.0.smithi078.stdout:2/288: creat d0/f54 x:0 0 0 2024-04-18T21:06:58.993 INFO:tasks.workunit.client.0.smithi078.stdout:1/332: mkdir d0/d46/d77 0 2024-04-18T21:06:58.993 INFO:tasks.workunit.client.0.smithi078.stdout:0/287: chown d0/d9/da/db/lc 1 1 2024-04-18T21:06:58.993 INFO:tasks.workunit.client.0.smithi078.stdout:2/289: creat d0/f55 x:0 0 0 2024-04-18T21:06:58.993 INFO:tasks.workunit.client.0.smithi078.stdout:8/230: mknod d0/d10/c46 0 2024-04-18T21:06:58.993 INFO:tasks.workunit.client.0.smithi078.stdout:2/290: write d0/f4d [367342,123262] 0 2024-04-18T21:06:58.993 INFO:tasks.workunit.client.0.smithi078.stdout:5/333: truncate d9/da/d3e/f59 311798 0 2024-04-18T21:06:58.993 INFO:tasks.workunit.client.0.smithi078.stdout:1/333: rmdir d0/d2a/d3c/d4b/d4/d61 39 2024-04-18T21:06:58.993 INFO:tasks.workunit.client.0.smithi078.stdout:8/231: unlink d0/d22/f24 0 2024-04-18T21:06:58.993 INFO:tasks.workunit.client.0.smithi078.stdout:0/288: read d0/d9/dd/d17/d2e/f39 [23275,65822] 0 2024-04-18T21:06:58.994 INFO:tasks.workunit.client.0.smithi078.stdout:8/232: chown d0/d10/d14/d2a/l39 132973 1 2024-04-18T21:06:58.994 INFO:tasks.workunit.client.0.smithi078.stdout:0/289: write d0/d9/dd/d17/d2e/f39 [379658,52138] 0 2024-04-18T21:06:58.994 INFO:tasks.workunit.client.0.smithi078.stdout:2/291: link d0/db/d18/f1c d0/db/d18/d21/d27/f56 0 2024-04-18T21:06:58.994 INFO:tasks.workunit.client.0.smithi078.stdout:8/233: getdents d0/d10/d14/d2a/d3a 0 2024-04-18T21:06:58.994 INFO:tasks.workunit.client.0.smithi078.stdout:5/334: read d9/f1e [2474738,34760] 0 2024-04-18T21:06:58.994 INFO:tasks.workunit.client.0.smithi078.stdout:3/259: dread d4/da/d11/f2c [0,4194304] 0 2024-04-18T21:06:58.994 INFO:tasks.workunit.client.0.smithi078.stdout:8/234: dread - d0/d10/d14/d2d/f3f zero size 2024-04-18T21:06:58.994 INFO:tasks.workunit.client.0.smithi078.stdout:0/290: link d0/l2 d0/d9/da/db/l54 0 2024-04-18T21:06:58.994 INFO:tasks.workunit.client.0.smithi078.stdout:7/295: dwrite d1/d16/dc/f1e [0,4194304] 0 2024-04-18T21:06:58.994 INFO:tasks.workunit.client.0.smithi078.stdout:5/335: truncate d9/da/d3e/d4c/f5a 125729 0 2024-04-18T21:06:58.994 INFO:tasks.workunit.client.0.smithi078.stdout:1/334: dwrite d0/d46/d32/d35/f6d [0,4194304] 0 2024-04-18T21:06:58.994 INFO:tasks.workunit.client.0.smithi078.stdout:1/335: write d0/d2a/d2f/f36 [1149233,29895] 0 2024-04-18T21:06:58.994 INFO:tasks.workunit.client.0.smithi078.stdout:0/291: readlink d0/d9/da/df/l3d 0 2024-04-18T21:06:58.994 INFO:tasks.workunit.client.0.smithi078.stdout:1/336: truncate d0/d2a/d3c/d4b/f3e 518605 0 2024-04-18T21:06:58.995 INFO:tasks.workunit.client.0.smithi078.stdout:2/292: mkdir d0/db/d18/d21/d27/d29/d57 0 2024-04-18T21:06:58.995 INFO:tasks.workunit.client.0.smithi078.stdout:7/296: mknod d1/d32/c71 0 2024-04-18T21:06:58.995 INFO:tasks.workunit.client.0.smithi078.stdout:1/337: write d0/d2a/d45/f76 [45524,58363] 0 2024-04-18T21:06:58.995 INFO:tasks.workunit.client.0.smithi078.stdout:0/292: truncate d0/d9/dd/d17/d2e/d31/f3b 4285141 0 2024-04-18T21:06:58.995 INFO:tasks.workunit.client.0.smithi078.stdout:3/260: dwrite d4/d2d/d30/d35/f33 [0,4194304] 0 2024-04-18T21:06:58.995 INFO:tasks.workunit.client.0.smithi078.stdout:5/336: dwrite d9/d2e/d29/f40 [0,4194304] 0 2024-04-18T21:06:58.995 INFO:tasks.workunit.client.0.smithi078.stdout:0/293: fsync d0/d9/da/db/d35/d3f/f44 0 2024-04-18T21:06:58.995 INFO:tasks.workunit.client.0.smithi078.stdout:0/294: fsync d0/f8 0 2024-04-18T21:06:58.995 INFO:tasks.workunit.client.0.smithi078.stdout:3/261: truncate d4/f13 6394704 0 2024-04-18T21:06:58.995 INFO:tasks.workunit.client.0.smithi078.stdout:0/295: write d0/d15/f27 [1183592,29923] 0 2024-04-18T21:06:58.995 INFO:tasks.workunit.client.0.smithi078.stdout:1/338: rename d0/d2a/d3c/d4b/d52/d73 to d0/d2a/d2f/d50/d78 0 2024-04-18T21:06:58.995 INFO:tasks.workunit.client.0.smithi078.stdout:1/339: fdatasync d0/d2a/d3c/d4b/f24 0 2024-04-18T21:06:58.995 INFO:tasks.workunit.client.0.smithi078.stdout:3/262: creat d4/d2d/d30/f40 x:0 0 0 2024-04-18T21:06:58.995 INFO:tasks.workunit.client.0.smithi078.stdout:3/263: mkdir d4/df/d17/d41 0 2024-04-18T21:06:58.996 INFO:tasks.workunit.client.0.smithi078.stdout:1/340: write d0/d2a/d3c/d4b/d4/f28 [5024281,71140] 0 2024-04-18T21:06:58.996 INFO:tasks.workunit.client.0.smithi078.stdout:3/264: readlink d4/d2d/d30/l3d 0 2024-04-18T21:06:58.996 INFO:tasks.workunit.client.0.smithi078.stdout:3/265: rmdir d4/df 39 2024-04-18T21:06:58.996 INFO:tasks.workunit.client.0.smithi078.stdout:3/266: truncate d4/f13 6626176 0 2024-04-18T21:06:58.996 INFO:tasks.workunit.client.0.smithi078.stdout:3/267: chown d4/l20 27 1 2024-04-18T21:06:58.996 INFO:tasks.workunit.client.0.smithi078.stdout:3/268: mknod d4/df/d17/c42 0 2024-04-18T21:06:58.996 INFO:tasks.workunit.client.0.smithi078.stdout:0/296: dwrite d0/d15/f27 [0,4194304] 0 2024-04-18T21:06:58.996 INFO:tasks.workunit.client.0.smithi078.stdout:0/297: symlink d0/d9/d4c/l55 0 2024-04-18T21:06:58.996 INFO:tasks.workunit.client.0.smithi078.stdout:0/298: rmdir d0/d4e 0 2024-04-18T21:06:58.996 INFO:tasks.workunit.client.0.smithi078.stdout:2/293: dread d0/d1f/f3f [0,4194304] 0 2024-04-18T21:06:58.996 INFO:tasks.workunit.client.0.smithi078.stdout:0/299: getdents d0/d9/da/db 0 2024-04-18T21:06:58.996 INFO:tasks.workunit.client.0.smithi078.stdout:7/297: dread d1/d32/f41 [0,4194304] 0 2024-04-18T21:06:58.996 INFO:tasks.workunit.client.0.smithi078.stdout:7/298: creat d1/d32/f72 x:0 0 0 2024-04-18T21:06:58.996 INFO:tasks.workunit.client.0.smithi078.stdout:2/294: write d0/d1f/f2b [4958396,7146] 0 2024-04-18T21:06:58.996 INFO:tasks.workunit.client.0.smithi078.stdout:7/299: chown d1/d16/d2d/c38 113964950 1 2024-04-18T21:06:58.996 INFO:tasks.workunit.client.0.smithi078.stdout:2/295: rmdir d0/d1f 39 2024-04-18T21:06:58.997 INFO:tasks.workunit.client.0.smithi078.stdout:2/296: chown d0/db/d18/d21/d27/d29/d4e 59610 1 2024-04-18T21:06:58.997 INFO:tasks.workunit.client.0.smithi078.stdout:7/300: symlink d1/d16/dc/d31/l73 0 2024-04-18T21:06:58.997 INFO:tasks.workunit.client.0.smithi078.stdout:7/301: creat d1/d16/dc/f74 x:0 0 0 2024-04-18T21:06:58.997 INFO:tasks.workunit.client.0.smithi078.stdout:2/297: link d0/d1f/d34/f53 d0/db/d18/d21/d27/f58 0 2024-04-18T21:06:58.997 INFO:tasks.workunit.client.0.smithi078.stdout:7/302: rename d1/c2f to d1/d16/d10/d5a/c75 0 2024-04-18T21:06:58.997 INFO:tasks.workunit.client.0.smithi078.stdout:7/303: creat d1/d16/d10/d5a/f76 x:0 0 0 2024-04-18T21:06:58.997 INFO:tasks.workunit.client.0.smithi078.stdout:7/304: creat d1/d16/f77 x:0 0 0 2024-04-18T21:06:58.997 INFO:tasks.workunit.client.0.smithi078.stdout:7/305: creat d1/d16/dc/d11/d53/f78 x:0 0 0 2024-04-18T21:06:58.997 INFO:tasks.workunit.client.0.smithi078.stdout:8/235: dread d0/f6 [8388608,4194304] 0 2024-04-18T21:06:58.997 INFO:tasks.workunit.client.0.smithi078.stdout:2/298: dwrite d0/d1f/d34/f53 [0,4194304] 0 2024-04-18T21:06:58.997 INFO:tasks.workunit.client.0.smithi078.stdout:5/337: dread d9/d2e/d29/f33 [0,4194304] 0 2024-04-18T21:06:58.997 INFO:tasks.workunit.client.0.smithi078.stdout:2/299: mkdir d0/d1f/d34/d40/d59 0 2024-04-18T21:06:58.997 INFO:tasks.workunit.client.0.smithi078.stdout:2/300: write d0/d1f/f2b [1214192,47374] 0 2024-04-18T21:06:59.000 INFO:tasks.workunit.client.0.smithi078.stdout:0/300: dread d0/d9/da/db/d35/f20 [0,4194304] 0 2024-04-18T21:06:59.000 INFO:tasks.workunit.client.0.smithi078.stdout:2/301: creat d0/db/d18/f5a x:0 0 0 2024-04-18T21:06:59.000 INFO:tasks.workunit.client.0.smithi078.stdout:0/301: creat d0/d9/da/db/d35/d3f/f56 x:0 0 0 2024-04-18T21:06:59.000 INFO:tasks.workunit.client.0.smithi078.stdout:2/302: chown d0/d1f/d34/f53 483 1 2024-04-18T21:06:59.000 INFO:tasks.workunit.client.0.smithi078.stdout:2/303: write d0/db/f36 [305087,74879] 0 2024-04-18T21:06:59.001 INFO:tasks.workunit.client.0.smithi078.stdout:0/302: creat d0/d9/f57 x:0 0 0 2024-04-18T21:06:59.001 INFO:tasks.workunit.client.0.smithi078.stdout:0/303: fsync d0/d9/f23 0 2024-04-18T21:06:59.001 INFO:tasks.workunit.client.0.smithi078.stdout:2/304: getdents d0/d1f 0 2024-04-18T21:06:59.001 INFO:tasks.workunit.client.0.smithi078.stdout:2/305: read - d0/d1f/d34/d40/f47 zero size 2024-04-18T21:06:59.001 INFO:tasks.workunit.client.0.smithi078.stdout:2/306: fsync d0/f1e 0 2024-04-18T21:06:59.001 INFO:tasks.workunit.client.0.smithi078.stdout:2/307: mkdir d0/d1f/d5b 0 2024-04-18T21:06:59.001 INFO:tasks.workunit.client.0.smithi078.stdout:8/236: dread d0/fd [0,4194304] 0 2024-04-18T21:06:59.001 INFO:tasks.workunit.client.0.smithi078.stdout:0/304: dread d0/f8 [0,4194304] 0 2024-04-18T21:06:59.001 INFO:tasks.workunit.client.0.smithi078.stdout:8/237: mknod d0/d10/d14/d2a/d41/c47 0 2024-04-18T21:06:59.001 INFO:tasks.workunit.client.0.smithi078.stdout:0/305: write d0/d9/da/db/d35/f20 [4195100,48124] 0 2024-04-18T21:06:59.001 INFO:tasks.workunit.client.0.smithi078.stdout:8/238: chown d0/d10/d14/d2d/f31 110911671 1 2024-04-18T21:06:59.001 INFO:tasks.workunit.client.0.smithi078.stdout:0/306: mkdir d0/d9/d58 0 2024-04-18T21:06:59.001 INFO:tasks.workunit.client.0.smithi078.stdout:8/239: dread - d0/d10/d14/d2d/f3f zero size 2024-04-18T21:06:59.002 INFO:tasks.workunit.client.0.smithi078.stdout:8/240: read d0/f36 [17911,90131] 0 2024-04-18T21:06:59.002 INFO:tasks.workunit.client.0.smithi078.stdout:8/241: chown d0/l9 109143935 1 2024-04-18T21:06:59.002 INFO:tasks.workunit.client.0.smithi078.stdout:0/307: dread d0/d15/f27 [0,4194304] 0 2024-04-18T21:06:59.002 INFO:tasks.workunit.client.0.smithi078.stdout:6/246: sync 2024-04-18T21:06:59.002 INFO:tasks.workunit.client.0.smithi078.stdout:9/269: sync 2024-04-18T21:06:59.002 INFO:tasks.workunit.client.0.smithi078.stdout:4/336: sync 2024-04-18T21:06:59.002 INFO:tasks.workunit.client.0.smithi078.stdout:0/308: fdatasync d0/d9/da/db/d35/f2b 0 2024-04-18T21:06:59.002 INFO:tasks.workunit.client.0.smithi078.stdout:6/247: write d2/d6/f1a [437928,80507] 0 2024-04-18T21:06:59.002 INFO:tasks.workunit.client.0.smithi078.stdout:4/337: write d0/dc/d10/d41/f4a [588172,75558] 0 2024-04-18T21:06:59.002 INFO:tasks.workunit.client.0.smithi078.stdout:9/270: creat d7/d23/d3e/d5a/f5e x:0 0 0 2024-04-18T21:06:59.002 INFO:tasks.workunit.client.0.smithi078.stdout:4/338: truncate d0/dc/d10/d3a/f59 601217 0 2024-04-18T21:06:59.002 INFO:tasks.workunit.client.0.smithi078.stdout:9/271: link d7/d11/d2d/f4e d7/d11/d1b/f5f 0 2024-04-18T21:06:59.003 INFO:tasks.workunit.client.0.smithi078.stdout:9/272: fsync d7/df/f10 0 2024-04-18T21:06:59.003 INFO:tasks.workunit.client.0.smithi078.stdout:4/339: fsync d0/dc/d10/f32 0 2024-04-18T21:06:59.003 INFO:tasks.workunit.client.0.smithi078.stdout:9/273: dread - d7/d11/d47/f5c zero size 2024-04-18T21:06:59.003 INFO:tasks.workunit.client.0.smithi078.stdout:8/242: dread d0/d10/f1c [0,4194304] 0 2024-04-18T21:06:59.005 INFO:tasks.workunit.client.0.smithi078.stdout:0/309: dwrite d0/d9/da/db/f2c [0,4194304] 0 2024-04-18T21:06:59.005 INFO:tasks.workunit.client.0.smithi078.stdout:6/248: dwrite d2/d6/f14 [0,4194304] 0 2024-04-18T21:06:59.006 INFO:tasks.workunit.client.0.smithi078.stdout:4/340: dwrite d0/dc/d10/d41/d5f/f6b [0,4194304] 0 2024-04-18T21:06:59.007 INFO:tasks.workunit.client.0.smithi078.stdout:8/243: creat d0/d22/d37/f48 x:0 0 0 2024-04-18T21:06:59.007 INFO:tasks.workunit.client.0.smithi078.stdout:9/274: rmdir d7/d23/d3e/d55 0 2024-04-18T21:06:59.008 INFO:tasks.workunit.client.0.smithi078.stdout:9/275: write d7/df/f4c [1603496,14185] 0 2024-04-18T21:06:59.011 INFO:tasks.workunit.client.0.smithi078.stdout:4/341: stat d0/dc/f1d 0 2024-04-18T21:06:59.011 INFO:tasks.workunit.client.0.smithi078.stdout:6/249: symlink d2/d34/d35/l55 0 2024-04-18T21:06:59.011 INFO:tasks.workunit.client.0.smithi078.stdout:0/310: creat d0/d9/da/f59 x:0 0 0 2024-04-18T21:06:59.012 INFO:tasks.workunit.client.0.smithi078.stdout:6/250: write d2/d34/d35/f40 [589987,101739] 0 2024-04-18T21:06:59.012 INFO:tasks.workunit.client.0.smithi078.stdout:4/342: getdents d0/dc/d10/d1c 0 2024-04-18T21:06:59.013 INFO:tasks.workunit.client.0.smithi078.stdout:6/251: creat d2/d34/f56 x:0 0 0 2024-04-18T21:06:59.013 INFO:tasks.workunit.client.0.smithi078.stdout:0/311: creat d0/d9/f5a x:0 0 0 2024-04-18T21:06:59.013 INFO:tasks.workunit.client.0.smithi078.stdout:4/343: write d0/dc/d37/f76 [741103,130734] 0 2024-04-18T21:06:59.016 INFO:tasks.workunit.client.0.smithi078.stdout:6/252: mkdir d2/d34/d35/d57 0 2024-04-18T21:06:59.016 INFO:tasks.workunit.client.0.smithi078.stdout:0/312: truncate d0/d9/dd/d17/d2e/d31/f3b 5214973 0 2024-04-18T21:06:59.018 INFO:tasks.workunit.client.0.smithi078.stdout:8/244: dwrite d0/d10/d14/d2d/f35 [4194304,4194304] 0 2024-04-18T21:06:59.018 INFO:tasks.workunit.client.0.smithi078.stdout:0/313: truncate d0/d9/da/db/f4d 87159 0 2024-04-18T21:06:59.021 INFO:tasks.workunit.client.0.smithi078.stdout:9/276: dwrite d7/d11/d2d/f3a [0,4194304] 0 2024-04-18T21:06:59.023 INFO:tasks.workunit.client.0.smithi078.stdout:4/344: mkdir d0/dc/d10/d1c/d6a/d81 0 2024-04-18T21:06:59.023 INFO:tasks.workunit.client.0.smithi078.stdout:0/314: symlink d0/d9/da/db/d35/d3f/l5b 0 2024-04-18T21:06:59.023 INFO:tasks.workunit.client.0.smithi078.stdout:8/245: mknod d0/d10/d14/d2a/d3c/c49 0 2024-04-18T21:06:59.024 INFO:tasks.workunit.client.0.smithi078.stdout:9/277: creat d7/d11/d1b/d45/d4b/d5d/f60 x:0 0 0 2024-04-18T21:06:59.024 INFO:tasks.workunit.client.0.smithi078.stdout:0/315: truncate d0/d9/f23 4606582 0 2024-04-18T21:06:59.026 INFO:tasks.workunit.client.0.smithi078.stdout:8/246: mkdir d0/d10/d14/d2a/d4a 0 2024-04-18T21:06:59.026 INFO:tasks.workunit.client.0.smithi078.stdout:9/278: mknod d7/d11/d1b/c61 0 2024-04-18T21:06:59.026 INFO:tasks.workunit.client.0.smithi078.stdout:9/279: stat d7/d11/d2d/l1f 0 2024-04-18T21:06:59.026 INFO:tasks.workunit.client.0.smithi078.stdout:9/280: unlink d7/d11/c1c 0 2024-04-18T21:06:59.027 INFO:tasks.workunit.client.0.smithi078.stdout:9/281: readlink d7/d11/d2d/l1f 0 2024-04-18T21:06:59.031 INFO:tasks.workunit.client.0.smithi078.stdout:8/247: dwrite d0/d10/f1c [0,4194304] 0 2024-04-18T21:06:59.032 INFO:tasks.workunit.client.0.smithi078.stdout:9/282: dwrite d7/d23/d3e/d5a/f5e [0,4194304] 0 2024-04-18T21:06:59.036 INFO:tasks.workunit.client.0.smithi078.stdout:5/338: sync 2024-04-18T21:06:59.036 INFO:tasks.workunit.client.0.smithi078.stdout:1/341: sync 2024-04-18T21:06:59.036 INFO:tasks.workunit.client.0.smithi078.stdout:7/306: sync 2024-04-18T21:06:59.036 INFO:tasks.workunit.client.0.smithi078.stdout:2/308: sync 2024-04-18T21:06:59.036 INFO:tasks.workunit.client.0.smithi078.stdout:3/269: sync 2024-04-18T21:06:59.036 INFO:tasks.workunit.client.0.smithi078.stdout:8/248: sync 2024-04-18T21:06:59.037 INFO:tasks.workunit.client.0.smithi078.stdout:8/249: fsync d0/f2c 0 2024-04-18T21:06:59.037 INFO:tasks.workunit.client.0.smithi078.stdout:5/339: unlink d9/d2e/c28 0 2024-04-18T21:06:59.038 INFO:tasks.workunit.client.0.smithi078.stdout:8/250: read d0/f6 [5398504,87298] 0 2024-04-18T21:06:59.038 INFO:tasks.workunit.client.0.smithi078.stdout:7/307: rename d1/f6d to d1/d16/d65/f79 0 2024-04-18T21:06:59.039 INFO:tasks.workunit.client.0.smithi078.stdout:2/309: link d0/l20 d0/d1f/d34/l5c 0 2024-04-18T21:06:59.039 INFO:tasks.workunit.client.0.smithi078.stdout:1/342: truncate d0/d46/d32/d35/f55 761985 0 2024-04-18T21:06:59.039 INFO:tasks.workunit.client.0.smithi078.stdout:5/340: rename d9/da/d4b/f57 to d9/d2e/d65/f6a 0 2024-04-18T21:06:59.040 INFO:tasks.workunit.client.0.smithi078.stdout:8/251: mknod d0/d10/d14/d2d/c4b 0 2024-04-18T21:06:59.040 INFO:tasks.workunit.client.0.smithi078.stdout:7/308: write d1/d32/f66 [21033,128710] 0 2024-04-18T21:06:59.040 INFO:tasks.workunit.client.0.smithi078.stdout:5/341: fdatasync d9/d2e/f3d 0 2024-04-18T21:06:59.040 INFO:tasks.workunit.client.0.smithi078.stdout:1/343: write d0/d2a/d45/f54 [725098,126973] 0 2024-04-18T21:06:59.040 INFO:tasks.workunit.client.0.smithi078.stdout:8/252: read d0/d10/f1c [7052,76287] 0 2024-04-18T21:06:59.040 INFO:tasks.workunit.client.0.smithi078.stdout:7/309: write d1/d16/d10/f19 [1549741,75564] 0 2024-04-18T21:06:59.041 INFO:tasks.workunit.client.0.smithi078.stdout:1/344: chown d0/d46/d32/f39 4620 1 2024-04-18T21:06:59.041 INFO:tasks.workunit.client.0.smithi078.stdout:7/310: write d1/f5e [808491,81395] 0 2024-04-18T21:06:59.041 INFO:tasks.workunit.client.0.smithi078.stdout:1/345: symlink d0/d2a/d3c/d4b/d5e/l79 0 2024-04-18T21:06:59.042 INFO:tasks.workunit.client.0.smithi078.stdout:7/311: creat d1/d16/dc/d11/f7a x:0 0 0 2024-04-18T21:06:59.043 INFO:tasks.workunit.client.0.smithi078.stdout:1/346: write d0/d11/f22 [1492369,29926] 0 2024-04-18T21:06:59.044 INFO:tasks.workunit.client.0.smithi078.stdout:3/270: dwrite d4/df/d17/f3a [0,4194304] 0 2024-04-18T21:06:59.045 INFO:tasks.workunit.client.0.smithi078.stdout:8/253: dread d0/fb [4194304,4194304] 0 2024-04-18T21:06:59.046 INFO:tasks.workunit.client.0.smithi078.stdout:0/316: sync 2024-04-18T21:06:59.049 INFO:tasks.workunit.client.0.smithi078.stdout:3/271: fdatasync d4/f18 0 2024-04-18T21:06:59.049 INFO:tasks.workunit.client.0.smithi078.stdout:8/254: creat d0/d10/d14/f4c x:0 0 0 2024-04-18T21:06:59.050 INFO:tasks.workunit.client.0.smithi078.stdout:9/283: fdatasync d7/d11/d2d/f3a 0 2024-04-18T21:06:59.051 INFO:tasks.workunit.client.0.smithi078.stdout:1/347: mknod d0/d46/d77/c7a 0 2024-04-18T21:06:59.051 INFO:tasks.workunit.client.0.smithi078.stdout:6/253: write d2/ff [820753,38487] 0 2024-04-18T21:06:59.051 INFO:tasks.workunit.client.0.smithi078.stdout:4/345: truncate d0/f50 388246 0 2024-04-18T21:06:59.054 INFO:tasks.workunit.client.0.smithi078.stdout:7/312: getdents d1/d32 0 2024-04-18T21:06:59.054 INFO:tasks.workunit.client.0.smithi078.stdout:2/310: write d0/f1e [1138684,57499] 0 2024-04-18T21:06:59.054 INFO:tasks.workunit.client.0.smithi078.stdout:4/346: fsync d0/f5 0 2024-04-18T21:06:59.054 INFO:tasks.workunit.client.0.smithi078.stdout:1/348: fsync d0/d11/f2e 0 2024-04-18T21:06:59.055 INFO:tasks.workunit.client.0.smithi078.stdout:2/311: fdatasync d0/f1d 0 2024-04-18T21:06:59.055 INFO:tasks.workunit.client.0.smithi078.stdout:4/347: readlink d0/dc/d29/l72 0 2024-04-18T21:06:59.055 INFO:tasks.workunit.client.0.smithi078.stdout:3/272: read d4/fd [3869006,80751] 0 2024-04-18T21:06:59.055 INFO:tasks.workunit.client.0.smithi078.stdout:0/317: dread d0/d9/f43 [0,4194304] 0 2024-04-18T21:06:59.055 INFO:tasks.workunit.client.0.smithi078.stdout:7/313: rename d1/d32/f49 to d1/d16/d1c/d40/f7b 0 2024-04-18T21:06:59.055 INFO:tasks.workunit.client.0.smithi078.stdout:1/349: mknod d0/d2a/d2f/d50/c7b 0 2024-04-18T21:06:59.055 INFO:tasks.workunit.client.0.smithi078.stdout:2/312: mkdir d0/db/d18/d5d 0 2024-04-18T21:06:59.055 INFO:tasks.workunit.client.0.smithi078.stdout:4/348: truncate d0/dc/f63 619338 0 2024-04-18T21:06:59.055 INFO:tasks.workunit.client.0.smithi078.stdout:6/254: fdatasync d2/fe 0 2024-04-18T21:06:59.056 INFO:tasks.workunit.client.0.smithi078.stdout:7/314: mkdir d1/d16/d10/d7c 0 2024-04-18T21:06:59.056 INFO:tasks.workunit.client.0.smithi078.stdout:0/318: chown d0/d9/da/db/f4d 14 1 2024-04-18T21:06:59.056 INFO:tasks.workunit.client.0.smithi078.stdout:1/350: readlink d0/d46/d32/d35/l48 0 2024-04-18T21:06:59.058 INFO:tasks.workunit.client.0.smithi078.stdout:2/313: getdents d0 0 2024-04-18T21:06:59.058 INFO:tasks.workunit.client.0.smithi078.stdout:6/255: rename d2/d6/dd/f31 to d2/d1f/f58 0 2024-04-18T21:06:59.059 INFO:tasks.workunit.client.0.smithi078.stdout:0/319: creat d0/d9/dd/d17/d2e/d46/f5c x:0 0 0 2024-04-18T21:06:59.059 INFO:tasks.workunit.client.0.smithi078.stdout:4/349: getdents d0/dc/d5b/d4f 0 2024-04-18T21:06:59.059 INFO:tasks.workunit.client.0.smithi078.stdout:9/284: dwrite d7/f37 [4194304,4194304] 0 2024-04-18T21:06:59.059 INFO:tasks.workunit.client.0.smithi078.stdout:7/315: rename d1/d16/dc/f37 to d1/d16/d2d/f7d 0 2024-04-18T21:06:59.060 INFO:tasks.workunit.client.0.smithi078.stdout:2/314: mknod d0/db/d18/d21/d27/d29/c5e 0 2024-04-18T21:06:59.061 INFO:tasks.workunit.client.0.smithi078.stdout:4/350: chown d0/dc/d29 124 1 2024-04-18T21:06:59.062 INFO:tasks.workunit.client.0.smithi078.stdout:9/285: symlink d7/d11/d2d/d3f/d4d/l62 0 2024-04-18T21:06:59.062 INFO:tasks.workunit.client.0.smithi078.stdout:2/315: rmdir d0/db/d18/d21/d27/d29 39 2024-04-18T21:06:59.062 INFO:tasks.workunit.client.0.smithi078.stdout:7/316: mkdir d1/d16/d10/d7c/d7e 0 2024-04-18T21:06:59.063 INFO:tasks.workunit.client.0.smithi078.stdout:4/351: readlink d0/dc/d10/d41/d5f/l70 0 2024-04-18T21:06:59.063 INFO:tasks.workunit.client.0.smithi078.stdout:9/286: chown f5 716933 1 2024-04-18T21:06:59.063 INFO:tasks.workunit.client.0.smithi078.stdout:0/320: getdents d0/d9/d4c 0 2024-04-18T21:06:59.063 INFO:tasks.workunit.client.0.smithi078.stdout:8/255: dwrite d0/d10/d14/f21 [0,4194304] 0 2024-04-18T21:06:59.063 INFO:tasks.workunit.client.0.smithi078.stdout:6/256: truncate d2/fe 1036114 0 2024-04-18T21:06:59.064 INFO:tasks.workunit.client.0.smithi078.stdout:4/352: stat d0/c6 0 2024-04-18T21:06:59.066 INFO:tasks.workunit.client.0.smithi078.stdout:9/287: symlink d7/d11/d47/l63 0 2024-04-18T21:06:59.067 INFO:tasks.workunit.client.0.smithi078.stdout:1/351: dwrite d0/d2a/f62 [0,4194304] 0 2024-04-18T21:06:59.067 INFO:tasks.workunit.client.0.smithi078.stdout:8/256: mknod d0/d10/c4d 0 2024-04-18T21:06:59.067 INFO:tasks.workunit.client.0.smithi078.stdout:0/321: creat d0/d9/da/db/d35/f5d x:0 0 0 2024-04-18T21:06:59.067 INFO:tasks.workunit.client.0.smithi078.stdout:8/257: write d0/f2c [824143,46114] 0 2024-04-18T21:06:59.067 INFO:tasks.workunit.client.0.smithi078.stdout:2/316: link d0/db/d18/d21/d27/c52 d0/db/d18/d21/c5f 0 2024-04-18T21:06:59.068 INFO:tasks.workunit.client.0.smithi078.stdout:0/322: mknod d0/d9/dd/d17/c5e 0 2024-04-18T21:06:59.068 INFO:tasks.workunit.client.0.smithi078.stdout:5/342: dread d9/da/d4b/f4e [0,4194304] 0 2024-04-18T21:06:59.069 INFO:tasks.workunit.client.0.smithi078.stdout:0/323: creat d0/d15/f5f x:0 0 0 2024-04-18T21:06:59.069 INFO:tasks.workunit.client.0.smithi078.stdout:9/288: write d7/d11/d47/f5c [500173,43322] 0 2024-04-18T21:06:59.070 INFO:tasks.workunit.client.0.smithi078.stdout:5/343: symlink d9/l6b 0 2024-04-18T21:06:59.070 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:59.070+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:59.071 INFO:tasks.workunit.client.0.smithi078.stdout:0/324: chown d0/d9/da/db/d35/d3f/l5b 1832462 1 2024-04-18T21:06:59.071 INFO:tasks.workunit.client.0.smithi078.stdout:9/289: write d7/d11/d1b/d45/d4b/f56 [994722,20170] 0 2024-04-18T21:06:59.071 INFO:tasks.workunit.client.0.smithi078.stdout:0/325: sync 2024-04-18T21:06:59.071 INFO:tasks.workunit.client.0.smithi078.stdout:9/290: write d7/df/f13 [644240,75142] 0 2024-04-18T21:06:59.072 INFO:tasks.workunit.client.0.smithi078.stdout:8/258: dread d0/d10/d14/f29 [0,4194304] 0 2024-04-18T21:06:59.072 INFO:tasks.workunit.client.0.smithi078.stdout:9/291: creat d7/d11/d2d/d26/f64 x:0 0 0 2024-04-18T21:06:59.073 INFO:tasks.workunit.client.0.smithi078.stdout:8/259: fsync d0/d10/d14/d2d/f31 0 2024-04-18T21:06:59.073 INFO:tasks.workunit.client.0.smithi078.stdout:8/260: creat d0/d10/d14/d2a/d41/f4e x:0 0 0 2024-04-18T21:06:59.077 INFO:tasks.workunit.client.0.smithi078.stdout:1/352: read d0/d11/f18 [54263,98696] 0 2024-04-18T21:06:59.077 INFO:tasks.workunit.client.0.smithi078.stdout:0/326: dwrite d0/d9/da/db/d35/f5d [0,4194304] 0 2024-04-18T21:06:59.078 INFO:tasks.workunit.client.0.smithi078.stdout:0/327: readlink d0/d9/dd/l1b 0 2024-04-18T21:06:59.078 INFO:tasks.workunit.client.0.smithi078.stdout:1/353: write d0/d46/f49 [1484102,81862] 0 2024-04-18T21:06:59.079 INFO:tasks.workunit.client.0.smithi078.stdout:9/292: dwrite d7/d11/d2d/f31 [0,4194304] 0 2024-04-18T21:06:59.081 INFO:tasks.workunit.client.0.smithi078.stdout:8/261: dwrite d0/fd [0,4194304] 0 2024-04-18T21:06:59.082 INFO:tasks.workunit.client.0.smithi078.stdout:9/293: rmdir d7/d11/d2d/d26 39 2024-04-18T21:06:59.082 INFO:tasks.workunit.client.0.smithi078.stdout:8/262: symlink d0/d10/d14/d2a/d3c/l4f 0 2024-04-18T21:06:59.082 INFO:tasks.workunit.client.0.smithi078.stdout:0/328: link d0/d9/dd/d17/d2e/d46/l47 d0/d9/d2f/l60 0 2024-04-18T21:06:59.083 INFO:tasks.workunit.client.0.smithi078.stdout:1/354: symlink d0/d2a/d3c/d4b/d4/d61/d75/l7c 0 2024-04-18T21:06:59.083 INFO:tasks.workunit.client.0.smithi078.stdout:8/263: mknod d0/d10/d14/d2a/d41/c50 0 2024-04-18T21:06:59.084 INFO:tasks.workunit.client.0.smithi078.stdout:0/329: mknod d0/d9/dd/c61 0 2024-04-18T21:06:59.084 INFO:tasks.workunit.client.0.smithi078.stdout:1/355: rmdir d0/d2a/d3c/d4b/d52 39 2024-04-18T21:06:59.085 INFO:tasks.workunit.client.0.smithi078.stdout:8/264: chown d0/d10/c42 169 1 2024-04-18T21:06:59.085 INFO:tasks.workunit.client.0.smithi078.stdout:1/356: write d0/d2a/f62 [1534434,81700] 0 2024-04-18T21:06:59.085 INFO:tasks.workunit.client.0.smithi078.stdout:8/265: write d0/fd [3247277,11534] 0 2024-04-18T21:06:59.086 INFO:tasks.workunit.client.0.smithi078.stdout:3/273: dread d4/f13 [4194304,4194304] 0 2024-04-18T21:06:59.087 INFO:tasks.workunit.client.0.smithi078.stdout:4/353: truncate d0/dc/d10/f42 305906 0 2024-04-18T21:06:59.087 INFO:tasks.workunit.client.0.smithi078.stdout:1/357: rename d0/d2a/d63 to d0/d46/d7d 0 2024-04-18T21:06:59.087 INFO:tasks.workunit.client.0.smithi078.stdout:2/317: write d0/db/d18/d21/d27/f56 [1031998,126025] 0 2024-04-18T21:06:59.088 INFO:tasks.workunit.client.0.smithi078.stdout:4/354: mkdir d0/dc/d29/d6d/d82 0 2024-04-18T21:06:59.088 INFO:tasks.workunit.client.0.smithi078.stdout:3/274: write d4/da/d11/f21 [54008,60519] 0 2024-04-18T21:06:59.088 INFO:tasks.workunit.client.0.smithi078.stdout:4/355: sync 2024-04-18T21:06:59.088 INFO:tasks.workunit.client.0.smithi078.stdout:2/318: write d0/db/d18/f1c [4954414,127129] 0 2024-04-18T21:06:59.089 INFO:tasks.workunit.client.0.smithi078.stdout:1/358: creat d0/d2a/d3c/d4b/d4/d61/d75/f7e x:0 0 0 2024-04-18T21:06:59.089 INFO:tasks.workunit.client.0.smithi078.stdout:4/356: stat d0/dc/d5b/d71/l5c 0 2024-04-18T21:06:59.089 INFO:tasks.workunit.client.0.smithi078.stdout:0/330: dread d0/d9/da/f10 [0,4194304] 0 2024-04-18T21:06:59.089 INFO:tasks.workunit.client.0.smithi078.stdout:2/319: dread - d0/d1f/d34/d40/f47 zero size 2024-04-18T21:06:59.090 INFO:tasks.workunit.client.0.smithi078.stdout:1/359: creat d0/d11/f7f x:0 0 0 2024-04-18T21:06:59.090 INFO:tasks.workunit.client.0.smithi078.stdout:4/357: mkdir d0/dc/d5b/d4f/d83 0 2024-04-18T21:06:59.090 INFO:tasks.workunit.client.0.smithi078.stdout:0/331: creat d0/d9/d58/f62 x:0 0 0 2024-04-18T21:06:59.091 INFO:tasks.workunit.client.0.smithi078.stdout:8/266: dread d0/f5 [4194304,4194304] 0 2024-04-18T21:06:59.091 INFO:tasks.workunit.client.0.smithi078.stdout:8/267: chown d0/f2c 9370341 1 2024-04-18T21:06:59.091 INFO:tasks.workunit.client.0.smithi078.stdout:0/332: rmdir d0/d9/da/db/d35/d3f 39 2024-04-18T21:06:59.092 INFO:tasks.workunit.client.0.smithi078.stdout:0/333: read d0/f8 [1671229,59673] 0 2024-04-18T21:06:59.092 INFO:tasks.workunit.client.0.smithi078.stdout:8/268: creat d0/d10/f51 x:0 0 0 2024-04-18T21:06:59.094 INFO:tasks.workunit.client.0.smithi078.stdout:5/344: dwrite f8 [0,4194304] 0 2024-04-18T21:06:59.094 INFO:tasks.workunit.client.0.smithi078.stdout:2/320: dread d0/d1f/d34/f53 [4194304,4194304] 0 2024-04-18T21:06:59.095 INFO:tasks.workunit.client.0.smithi078.stdout:2/321: readlink d0/l7 0 2024-04-18T21:06:59.095 INFO:tasks.workunit.client.0.smithi078.stdout:2/322: read - d0/f2e zero size 2024-04-18T21:06:59.098 INFO:tasks.workunit.client.0.smithi078.stdout:5/345: getdents d9/d2e/d29/d55/d62 0 2024-04-18T21:06:59.098 INFO:tasks.workunit.client.0.smithi078.stdout:5/346: sync 2024-04-18T21:06:59.098 INFO:tasks.workunit.client.0.smithi078.stdout:5/347: sync 2024-04-18T21:06:59.099 INFO:tasks.workunit.client.0.smithi078.stdout:2/323: rename d0/db/d18/d21/d27/d29/d33/c3a to d0/d1f/d34/c60 0 2024-04-18T21:06:59.100 INFO:tasks.workunit.client.0.smithi078.stdout:5/348: symlink d9/da/d3e/l6c 0 2024-04-18T21:06:59.100 INFO:tasks.workunit.client.0.smithi078.stdout:8/269: dwrite d0/fd [4194304,4194304] 0 2024-04-18T21:06:59.100 INFO:tasks.workunit.client.0.smithi078.stdout:8/270: readlink d0/l8 0 2024-04-18T21:06:59.100 INFO:tasks.workunit.client.0.smithi078.stdout:8/271: write d0/d10/d14/f21 [577492,125101] 0 2024-04-18T21:06:59.102 INFO:tasks.workunit.client.0.smithi078.stdout:8/272: write d0/d10/d14/d2d/f35 [2423660,87459] 0 2024-04-18T21:06:59.103 INFO:tasks.workunit.client.0.smithi078.stdout:8/273: truncate d0/f26 1073415 0 2024-04-18T21:06:59.104 INFO:tasks.workunit.client.0.smithi078.stdout:8/274: rmdir d0/d22/d37 39 2024-04-18T21:06:59.104 INFO:tasks.workunit.client.0.smithi078.stdout:0/334: getdents d0/d9/d2f 0 2024-04-18T21:06:59.105 INFO:tasks.workunit.client.0.smithi078.stdout:9/294: truncate d7/d11/d2d/d26/f38 230378 0 2024-04-18T21:06:59.105 INFO:tasks.workunit.client.0.smithi078.stdout:0/335: chown d0/d9/d4c/l55 15801785 1 2024-04-18T21:06:59.105 INFO:tasks.workunit.client.0.smithi078.stdout:5/349: dwrite d9/da/d3e/d4c/f54 [0,4194304] 0 2024-04-18T21:06:59.107 INFO:tasks.workunit.client.0.smithi078.stdout:9/295: rename d7/c8 to d7/d23/d3e/d5a/c65 0 2024-04-18T21:06:59.107 INFO:tasks.workunit.client.0.smithi078.stdout:5/350: unlink d9/da/d4b/f58 0 2024-04-18T21:06:59.108 INFO:tasks.workunit.client.0.smithi078.stdout:9/296: readlink d7/d11/d1b/l25 0 2024-04-18T21:06:59.108 INFO:tasks.workunit.client.0.smithi078.stdout:9/297: stat f0 0 2024-04-18T21:06:59.108 INFO:tasks.workunit.client.0.smithi078.stdout:5/351: rmdir d9/d2e/d29/d55/d62 39 2024-04-18T21:06:59.108 INFO:tasks.workunit.client.0.smithi078.stdout:5/352: chown d9/da/c48 1549998 1 2024-04-18T21:06:59.109 INFO:tasks.workunit.client.0.smithi078.stdout:9/298: rename f5 to d7/d11/d1b/d45/d4b/d5d/f66 0 2024-04-18T21:06:59.109 INFO:tasks.workunit.client.0.smithi078.stdout:5/353: write d9/fe [2637551,32866] 0 2024-04-18T21:06:59.110 INFO:tasks.workunit.client.0.smithi078.stdout:9/299: mkdir d7/df/d67 0 2024-04-18T21:06:59.111 INFO:tasks.workunit.client.0.smithi078.stdout:9/300: fsync d7/df/d1e/f58 0 2024-04-18T21:06:59.112 INFO:tasks.workunit.client.0.smithi078.stdout:0/336: dwrite d0/d9/da/db/d35/f5d [0,4194304] 0 2024-04-18T21:06:59.112 INFO:tasks.workunit.client.0.smithi078.stdout:7/317: dread d1/d16/f26 [0,4194304] 0 2024-04-18T21:06:59.112 INFO:tasks.workunit.client.0.smithi078.stdout:3/275: truncate d4/df/f1f 806179 0 2024-04-18T21:06:59.113 INFO:tasks.workunit.client.0.smithi078.stdout:4/358: truncate d0/f17 3764270 0 2024-04-18T21:06:59.113 INFO:tasks.workunit.client.0.smithi078.stdout:0/337: dread d0/d9/da/f42 [0,4194304] 0 2024-04-18T21:06:59.114 INFO:tasks.workunit.client.0.smithi078.stdout:4/359: unlink d0/f5 0 2024-04-18T21:06:59.114 INFO:tasks.workunit.client.0.smithi078.stdout:7/318: rename d1/d32/c71 to d1/d16/dc/d4b/c7f 0 2024-04-18T21:06:59.114 INFO:tasks.workunit.client.0.smithi078.stdout:3/276: write d4/da/d11/f2c [1696142,54414] 0 2024-04-18T21:06:59.115 INFO:tasks.workunit.client.0.smithi078.stdout:0/338: creat d0/d9/d58/f63 x:0 0 0 2024-04-18T21:06:59.115 INFO:tasks.workunit.client.0.smithi078.stdout:7/319: chown d1/d16/dc/d4b/f2c 7 1 2024-04-18T21:06:59.115 INFO:tasks.workunit.client.0.smithi078.stdout:3/277: symlink d4/d2d/d30/d35/l43 0 2024-04-18T21:06:59.116 INFO:tasks.workunit.client.0.smithi078.stdout:7/320: creat d1/f80 x:0 0 0 2024-04-18T21:06:59.117 INFO:tasks.workunit.client.0.smithi078.stdout:7/321: getdents d1/d16/d10 0 2024-04-18T21:06:59.117 INFO:tasks.workunit.client.0.smithi078.stdout:9/301: read d7/df/f13 [2433593,97691] 0 2024-04-18T21:06:59.119 INFO:tasks.workunit.client.0.smithi078.stdout:9/302: chown d7/df/f42 1 1 2024-04-18T21:06:59.119 INFO:tasks.workunit.client.0.smithi078.stdout:7/322: symlink d1/d16/dc/d4b/l81 0 2024-04-18T21:06:59.120 INFO:tasks.workunit.client.0.smithi078.stdout:0/339: dread d0/d9/da/db/d35/f20 [0,4194304] 0 2024-04-18T21:06:59.121 INFO:tasks.workunit.client.0.smithi078.stdout:7/323: write d1/f5e [459052,91367] 0 2024-04-18T21:06:59.121 INFO:tasks.workunit.client.0.smithi078.stdout:9/303: mknod d7/d11/d2d/d3f/d4d/c68 0 2024-04-18T21:06:59.121 INFO:tasks.workunit.client.0.smithi078.stdout:4/360: dwrite d0/dc/d10/d3a/d7e/f80 [0,4194304] 0 2024-04-18T21:06:59.122 INFO:tasks.workunit.client.0.smithi078.stdout:0/340: chown d0/d9/da/db/f4d 22153400 1 2024-04-18T21:06:59.122 INFO:tasks.workunit.client.0.smithi078.stdout:3/278: dwrite d4/fd [0,4194304] 0 2024-04-18T21:06:59.125 INFO:tasks.workunit.client.0.smithi078.stdout:5/354: dread d9/d2e/d29/f45 [0,4194304] 0 2024-04-18T21:06:59.125 INFO:tasks.workunit.client.0.smithi078.stdout:9/304: mknod d7/d11/c69 0 2024-04-18T21:06:59.125 INFO:tasks.workunit.client.0.smithi078.stdout:7/324: rmdir d1/d16/dc/d11/d53 39 2024-04-18T21:06:59.125 INFO:tasks.workunit.client.0.smithi078.stdout:0/341: stat d0/d9/da/db/d35/l36 0 2024-04-18T21:06:59.125 INFO:tasks.workunit.client.0.smithi078.stdout:9/305: stat d7/d11/d2d/d26 0 2024-04-18T21:06:59.126 INFO:tasks.workunit.client.0.smithi078.stdout:9/306: chown d7/df/d67 91 1 2024-04-18T21:06:59.126 INFO:tasks.workunit.client.0.smithi078.stdout:7/325: write d1/d16/dc/d11/f3d [165456,49518] 0 2024-04-18T21:06:59.127 INFO:tasks.workunit.client.0.smithi078.stdout:5/355: mkdir d9/da/d3e/d4c/d6d 0 2024-04-18T21:06:59.127 INFO:tasks.workunit.client.0.smithi078.stdout:3/279: creat d4/df/d17/d41/f44 x:0 0 0 2024-04-18T21:06:59.127 INFO:tasks.workunit.client.0.smithi078.stdout:0/342: chown d0/d9/da/db/l54 2 1 2024-04-18T21:06:59.129 INFO:tasks.workunit.client.0.smithi078.stdout:9/307: mkdir d7/d11/d1b/d45/d4b/d5d/d6a 0 2024-04-18T21:06:59.129 INFO:tasks.workunit.client.0.smithi078.stdout:3/280: write d4/df/f26 [4935643,101828] 0 2024-04-18T21:06:59.130 INFO:tasks.workunit.client.0.smithi078.stdout:0/343: write d0/d9/da/f10 [2933656,28740] 0 2024-04-18T21:06:59.130 INFO:tasks.workunit.client.0.smithi078.stdout:7/326: write d1/d16/dc/d11/d53/f6b [16069,110398] 0 2024-04-18T21:06:59.130 INFO:tasks.workunit.client.0.smithi078.stdout:4/361: dwrite d0/dc/d10/d41/d5f/f6b [4194304,4194304] 0 2024-04-18T21:06:59.131 INFO:tasks.workunit.client.0.smithi078.stdout:9/308: unlink d7/d11/d2d/d3f/c50 0 2024-04-18T21:06:59.131 INFO:tasks.workunit.client.0.smithi078.stdout:3/281: mknod d4/df/d17/c45 0 2024-04-18T21:06:59.133 INFO:tasks.workunit.client.0.smithi078.stdout:6/257: dread d2/f3 [0,4194304] 0 2024-04-18T21:06:59.133 INFO:tasks.workunit.client.0.smithi078.stdout:3/282: mknod d4/d2d/c46 0 2024-04-18T21:06:59.133 INFO:tasks.workunit.client.0.smithi078.stdout:0/344: chown d0/d9/da/db/d35/d3f 31869870 1 2024-04-18T21:06:59.133 INFO:tasks.workunit.client.0.smithi078.stdout:1/360: dread d0/d2a/d3c/d4b/f24 [0,4194304] 0 2024-04-18T21:06:59.133 INFO:tasks.workunit.client.0.smithi078.stdout:9/309: write d7/df/d1e/f58 [969276,17265] 0 2024-04-18T21:06:59.133 INFO:tasks.workunit.client.0.smithi078.stdout:7/327: unlink d1/d16/dc/d11/d53/f6b 0 2024-04-18T21:06:59.134 INFO:tasks.workunit.client.0.smithi078.stdout:7/328: stat d1/d16/d10/d5a/f76 0 2024-04-18T21:06:59.135 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:59.135 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [ 2024-04-18T21:06:59.135 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.135 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:1145 3.13 3:cb3d3880:::200.0000000d:head [write 3168384~29155 [fadvise_dontneed] in=29155b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-18T21:06:59.135 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.123612+0000", 2024-04-18T21:06:59.135 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.012414521, 2024-04-18T21:06:59.135 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.012485454999999999, 2024-04-18T21:06:59.135 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:59.135 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:59.135 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:06:59.136 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:59.136 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.136 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:59.136 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.123612+0000", 2024-04-18T21:06:59.136 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.136 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.136 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.136 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:59.136 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.123612+0000", 2024-04-18T21:06:59.136 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.136 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.136 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.136 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:59.136 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.123613+0000", 2024-04-18T21:06:59.137 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.9599999999999998e-07 2024-04-18T21:06:59.137 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.137 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.137 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:59.137 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.123671+0000", 2024-04-18T21:06:59.137 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.8763e-05 2024-04-18T21:06:59.137 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.137 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.137 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:59.137 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.123682+0000", 2024-04-18T21:06:59.137 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0655999999999999e-05 2024-04-18T21:06:59.137 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.137 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.137 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:59.138 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.123688+0000", 2024-04-18T21:06:59.138 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.2570000000000004e-06 2024-04-18T21:06:59.138 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.138 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.138 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:59.138 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.123734+0000", 2024-04-18T21:06:59.138 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.5980999999999999e-05 2024-04-18T21:06:59.138 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.138 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.138 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:59.138 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.123857+0000", 2024-04-18T21:06:59.138 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012275400000000001 2024-04-18T21:06:59.138 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.139 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.139 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:59.139 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.123959+0000", 2024-04-18T21:06:59.139 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000102162 2024-04-18T21:06:59.139 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.139 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.139 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:59.139 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.125006+0000", 2024-04-18T21:06:59.139 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00104644 2024-04-18T21:06:59.139 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.139 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:59.139 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.139 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.140 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.140 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:1147 3.13 3:cb3d3880:::200.0000000d:head [write 3197539~6362 [fadvise_dontneed] in=6362b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-18T21:06:59.140 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.128003+0000", 2024-04-18T21:06:59.140 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.0080235749999999998, 2024-04-18T21:06:59.140 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0081970410000000004, 2024-04-18T21:06:59.140 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:59.140 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:59.140 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:06:59.140 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:59.140 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.140 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:59.140 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.128003+0000", 2024-04-18T21:06:59.140 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.140 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.141 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.141 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:59.141 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.128003+0000", 2024-04-18T21:06:59.141 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.141 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.141 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.141 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:59.141 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.128004+0000", 2024-04-18T21:06:59.141 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4589999999999999e-06 2024-04-18T21:06:59.141 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.141 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.141 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:59.141 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.128015+0000", 2024-04-18T21:06:59.142 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1029000000000001e-05 2024-04-18T21:06:59.142 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.142 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.142 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:59.142 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.128028+0000", 2024-04-18T21:06:59.142 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2611e-05 2024-04-18T21:06:59.142 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.142 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.142 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:59.142 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.128036+0000", 2024-04-18T21:06:59.142 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.3939999999999996e-06 2024-04-18T21:06:59.142 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.142 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.142 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:59.143 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.128087+0000", 2024-04-18T21:06:59.143 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.1051999999999998e-05 2024-04-18T21:06:59.143 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.143 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.143 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:59.143 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.128145+0000", 2024-04-18T21:06:59.143 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.7287999999999998e-05 2024-04-18T21:06:59.143 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.143 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.143 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:59.143 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.128233+0000", 2024-04-18T21:06:59.143 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8146999999999995e-05 2024-04-18T21:06:59.143 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.143 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.144 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:59.144 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.129434+0000", 2024-04-18T21:06:59.144 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001201117 2024-04-18T21:06:59.144 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.144 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:59.144 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.144 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.144 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.144 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11743 4.1a 4:5bf860e0:::1000000316e.00000001:head [write 0~4194304 [2@0] in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:06:59.144 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.103576+0000", 2024-04-18T21:06:59.144 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.032450406000000001, 2024-04-18T21:06:59.144 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.032669067000000003, 2024-04-18T21:06:59.144 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:59.144 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:59.144 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:06:59.145 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:59.145 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:06:59.145 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:59.145 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11743 2024-04-18T21:06:59.145 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.145 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:59.145 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.145 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:59.145 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.103576+0000", 2024-04-18T21:06:59.145 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.145 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.145 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.145 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:59.145 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.103576+0000", 2024-04-18T21:06:59.145 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.146 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.146 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.146 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:59.146 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.103643+0000", 2024-04-18T21:06:59.146 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.6665e-05 2024-04-18T21:06:59.146 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.146 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.146 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:59.146 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.109211+0000", 2024-04-18T21:06:59.146 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0055688530000000003 2024-04-18T21:06:59.146 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.146 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.146 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:59.146 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.109231+0000", 2024-04-18T21:06:59.147 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9123999999999999e-05 2024-04-18T21:06:59.147 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.147 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.147 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:59.147 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.109239+0000", 2024-04-18T21:06:59.147 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.704e-06 2024-04-18T21:06:59.147 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.147 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.147 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:59.147 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.109320+0000", 2024-04-18T21:06:59.147 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.0439999999999996e-05 2024-04-18T21:06:59.147 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.147 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.147 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:59.148 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.109404+0000", 2024-04-18T21:06:59.148 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4241999999999997e-05 2024-04-18T21:06:59.148 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.148 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.148 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:59.148 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.109553+0000", 2024-04-18T21:06:59.148 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014914 2024-04-18T21:06:59.148 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.148 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.148 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:59.148 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.120570+0000", 2024-04-18T21:06:59.148 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.011017153999999999 2024-04-18T21:06:59.148 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.148 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:59.148 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.149 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.149 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.149 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:1148 3.13 3:cb3d3880:::200.0000000d:head [write 3203901~3875 [fadvise_dontneed] in=3875b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-18T21:06:59.149 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.128504+0000", 2024-04-18T21:06:59.149 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.0075220210000000003, 2024-04-18T21:06:59.149 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0078001659999999999, 2024-04-18T21:06:59.149 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:59.149 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:59.149 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:06:59.149 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:59.149 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.149 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:59.150 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.128504+0000", 2024-04-18T21:06:59.150 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.150 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.150 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.150 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:59.150 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.128504+0000", 2024-04-18T21:06:59.150 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.150 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.150 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.150 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:59.150 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.128505+0000", 2024-04-18T21:06:59.150 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.102e-06 2024-04-18T21:06:59.150 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.150 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.151 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:59.151 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.128614+0000", 2024-04-18T21:06:59.151 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109061 2024-04-18T21:06:59.151 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.151 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.151 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:59.151 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.128626+0000", 2024-04-18T21:06:59.151 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1342000000000001e-05 2024-04-18T21:06:59.151 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.151 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.151 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:59.151 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.128635+0000", 2024-04-18T21:06:59.151 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.1300000000000007e-06 2024-04-18T21:06:59.151 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.152 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.152 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:59.152 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.128849+0000", 2024-04-18T21:06:59.152 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000214083 2024-04-18T21:06:59.152 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.152 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.152 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:59.152 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.128900+0000", 2024-04-18T21:06:59.152 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.1172999999999999e-05 2024-04-18T21:06:59.152 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.152 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.152 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:59.152 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.128975+0000", 2024-04-18T21:06:59.152 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.5257000000000001e-05 2024-04-18T21:06:59.152 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.152 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.153 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:59.153 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.129805+0000", 2024-04-18T21:06:59.153 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00082938900000000004 2024-04-18T21:06:59.153 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.153 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:59.153 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.153 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.153 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.153 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11770 4.24 4:27626b90:::10000003118.00000000:head [write 0~4194304 [2@1433374] in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:06:59.153 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.126721+0000", 2024-04-18T21:06:59.153 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.0093047689999999992, 2024-04-18T21:06:59.153 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0096245819999999996, 2024-04-18T21:06:59.153 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:59.153 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:59.153 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:06:59.154 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:59.154 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:06:59.154 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:59.154 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11770 2024-04-18T21:06:59.154 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.154 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:59.154 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.154 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:59.154 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.126721+0000", 2024-04-18T21:06:59.154 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.154 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.154 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.154 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:59.154 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.126721+0000", 2024-04-18T21:06:59.155 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.155 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.155 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.155 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:59.155 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.126722+0000", 2024-04-18T21:06:59.155 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.4900000000000004e-07 2024-04-18T21:06:59.155 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.155 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.155 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:59.155 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.134891+0000", 2024-04-18T21:06:59.155 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0081681930000000007 2024-04-18T21:06:59.155 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.155 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.155 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:59.156 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.134914+0000", 2024-04-18T21:06:59.156 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.3493e-05 2024-04-18T21:06:59.156 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.156 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.156 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:59.156 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.134924+0000", 2024-04-18T21:06:59.156 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.7550000000000006e-06 2024-04-18T21:06:59.156 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.156 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.156 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:59.156 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.135001+0000", 2024-04-18T21:06:59.156 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.6910999999999996e-05 2024-04-18T21:06:59.156 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.157 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.157 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:59.157 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.135119+0000", 2024-04-18T21:06:59.157 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000118282 2024-04-18T21:06:59.157 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.157 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:59.157 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.157 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.157 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.157 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11771 4.c 4:33faa5a0:::10000003215.00000000:head [read 2097152~2097152] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:06:59.157 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.134956+0000", 2024-04-18T21:06:59.157 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.0010707220000000001, 2024-04-18T21:06:59.157 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0014284969999999999, 2024-04-18T21:06:59.157 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:59.157 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:59.158 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:06:59.158 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:59.158 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:06:59.158 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:59.158 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11771 2024-04-18T21:06:59.158 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.158 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:59.158 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.158 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:59.158 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.134956+0000", 2024-04-18T21:06:59.158 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.158 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.158 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.159 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:59.159 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.134956+0000", 2024-04-18T21:06:59.159 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.159 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.159 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.159 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:59.159 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.134957+0000", 2024-04-18T21:06:59.159 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.835e-06 2024-04-18T21:06:59.159 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.159 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.159 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:59.159 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.134961+0000", 2024-04-18T21:06:59.159 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.6339999999999999e-06 2024-04-18T21:06:59.159 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.159 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.160 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:59.160 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.134970+0000", 2024-04-18T21:06:59.160 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.687e-06 2024-04-18T21:06:59.160 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.160 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.160 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:59.160 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.134976+0000", 2024-04-18T21:06:59.160 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.1999999999999999e-06 2024-04-18T21:06:59.160 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.160 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.160 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:59.160 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.135096+0000", 2024-04-18T21:06:59.160 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000120567 2024-04-18T21:06:59.160 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.161 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.161 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:59.161 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.135309+0000", 2024-04-18T21:06:59.161 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000212377 2024-04-18T21:06:59.161 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.161 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:59.161 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.161 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.161 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.161 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11773 4.30 4:0c7ec41f:::10000003201.00000001:head [write 741339~101828 [2@270460] in=101828b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:06:59.161 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.134998+0000", 2024-04-18T21:06:59.161 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.0010283530000000001, 2024-04-18T21:06:59.161 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0014515649999999999, 2024-04-18T21:06:59.161 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:59.161 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:59.162 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:06:59.162 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:59.162 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:06:59.162 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:59.162 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11773 2024-04-18T21:06:59.162 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.162 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:59.162 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.162 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:59.162 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.134998+0000", 2024-04-18T21:06:59.162 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.162 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.162 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.162 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:59.163 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.134998+0000", 2024-04-18T21:06:59.163 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.163 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.163 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.163 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:59.163 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.134998+0000", 2024-04-18T21:06:59.163 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3200000000000005e-07 2024-04-18T21:06:59.163 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.163 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.163 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:59.163 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.135041+0000", 2024-04-18T21:06:59.163 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.3003000000000001e-05 2024-04-18T21:06:59.163 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.163 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.164 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:59.164 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.135049+0000", 2024-04-18T21:06:59.164 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.9510000000000006e-06 2024-04-18T21:06:59.164 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.164 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.164 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:59.164 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.135055+0000", 2024-04-18T21:06:59.164 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.9569999999999999e-06 2024-04-18T21:06:59.164 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.164 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.164 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:59.164 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.135117+0000", 2024-04-18T21:06:59.164 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.1255999999999998e-05 2024-04-18T21:06:59.164 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.165 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.165 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:59.165 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.135206+0000", 2024-04-18T21:06:59.165 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.9862000000000001e-05 2024-04-18T21:06:59.165 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.165 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.165 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:59.165 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.135332+0000", 2024-04-18T21:06:59.165 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000125582 2024-04-18T21:06:59.165 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.165 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:59.165 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.165 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.165 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.165 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11774 4.e 4:730d0dd4:::1000000314a.00000000:head [write 2933656~28740 in=28740b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:06:59.166 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.135072+0000", 2024-04-18T21:06:59.166 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.00095414600000000001, 2024-04-18T21:06:59.166 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0014717949999999999, 2024-04-18T21:06:59.166 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:59.166 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:59.166 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:06:59.166 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:59.166 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:06:59.166 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:59.166 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11774 2024-04-18T21:06:59.166 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.166 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:59.166 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.166 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:59.167 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.135072+0000", 2024-04-18T21:06:59.167 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.167 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.167 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.167 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:59.167 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.135072+0000", 2024-04-18T21:06:59.167 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.167 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.167 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.167 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:59.167 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.135073+0000", 2024-04-18T21:06:59.167 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.2200000000000004e-07 2024-04-18T21:06:59.167 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.167 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.167 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:59.168 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.135091+0000", 2024-04-18T21:06:59.168 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8583000000000001e-05 2024-04-18T21:06:59.168 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.168 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.168 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:59.168 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.135100+0000", 2024-04-18T21:06:59.168 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.1609999999999992e-06 2024-04-18T21:06:59.168 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.168 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.168 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:59.168 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.135108+0000", 2024-04-18T21:06:59.168 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.515e-06 2024-04-18T21:06:59.168 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.168 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.168 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:59.168 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.135186+0000", 2024-04-18T21:06:59.169 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8257000000000006e-05 2024-04-18T21:06:59.169 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.169 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.169 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:59.169 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.135323+0000", 2024-04-18T21:06:59.169 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013720900000000001 2024-04-18T21:06:59.169 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.169 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:59.169 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.169 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.169 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.169 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_repop(client.4534.0:11772 4.26 e58/16 4:6526e7d7:::10000003243.00000000:head v 58'198, mlcod=57'196)", 2024-04-18T21:06:59.169 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.135499+0000", 2024-04-18T21:06:59.169 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.00052701400000000002, 2024-04-18T21:06:59.169 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0010816560000000001, 2024-04-18T21:06:59.169 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:59.170 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:59.170 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:06:59.170 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:59.170 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.170 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:59.170 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.135499+0000", 2024-04-18T21:06:59.170 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.170 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.170 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.170 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:59.170 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.135499+0000", 2024-04-18T21:06:59.170 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.170 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.170 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.171 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:59.171 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.135500+0000", 2024-04-18T21:06:59.171 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1850000000000001e-06 2024-04-18T21:06:59.171 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.171 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.171 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:59.171 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.135597+0000", 2024-04-18T21:06:59.171 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.6618000000000002e-05 2024-04-18T21:06:59.171 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.171 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.171 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:59.171 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.135610+0000", 2024-04-18T21:06:59.171 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2695e-05 2024-04-18T21:06:59.171 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.171 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.171 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:59.171 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.135617+0000", 2024-04-18T21:06:59.172 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.6410000000000002e-06 2024-04-18T21:06:59.172 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.172 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.172 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:59.172 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.135672+0000", 2024-04-18T21:06:59.172 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5037999999999997e-05 2024-04-18T21:06:59.172 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.172 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.172 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:59.172 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.135696+0000", 2024-04-18T21:06:59.172 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.3283000000000001e-05 2024-04-18T21:06:59.172 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.172 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:59.172 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.173 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.173 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.173 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_repop_reply(client.4534.0:11731 4.39 e58/16)", 2024-04-18T21:06:59.173 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.136614+0000", 2024-04-18T21:06:59.173 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 4294967295.9994121, 2024-04-18T21:06:59.173 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010937, 2024-04-18T21:06:59.173 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:59.173 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:59.173 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "reached pg", 2024-04-18T21:06:59.173 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:59.173 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.173 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:59.173 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136614+0000", 2024-04-18T21:06:59.173 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.174 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.174 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.174 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:59.174 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136614+0000", 2024-04-18T21:06:59.174 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.174 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.174 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.174 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:59.174 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136615+0000", 2024-04-18T21:06:59.174 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.3099999999999996e-07 2024-04-18T21:06:59.174 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.174 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.174 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:59.174 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136620+0000", 2024-04-18T21:06:59.175 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.9010000000000002e-06 2024-04-18T21:06:59.175 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.175 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.175 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:59.175 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136632+0000", 2024-04-18T21:06:59.175 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1929e-05 2024-04-18T21:06:59.175 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.175 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.175 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:59.175 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136639+0000", 2024-04-18T21:06:59.175 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.4200000000000001e-06 2024-04-18T21:06:59.175 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.175 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.175 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:59.175 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136681+0000", 2024-04-18T21:06:59.175 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.1807999999999997e-05 2024-04-18T21:06:59.176 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.176 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:59.176 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.176 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.176 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.176 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_repop_reply(client.4534.0:11743 4.1a e58/16)", 2024-04-18T21:06:59.176 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.136669+0000", 2024-04-18T21:06:59.176 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 4294967295.9993572, 2024-04-18T21:06:59.176 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000150815, 2024-04-18T21:06:59.176 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:59.176 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:59.176 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:06:59.176 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:59.176 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.176 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:59.176 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136669+0000", 2024-04-18T21:06:59.177 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.177 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.177 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.177 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:59.177 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136669+0000", 2024-04-18T21:06:59.177 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.177 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.177 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.177 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:59.177 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136669+0000", 2024-04-18T21:06:59.177 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.96e-07 2024-04-18T21:06:59.177 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.177 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.177 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:59.177 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136672+0000", 2024-04-18T21:06:59.177 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7420000000000002e-06 2024-04-18T21:06:59.178 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.178 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.178 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:59.178 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136679+0000", 2024-04-18T21:06:59.178 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3030000000000002e-06 2024-04-18T21:06:59.178 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.178 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.178 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:59.178 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136684+0000", 2024-04-18T21:06:59.178 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.0980000000000001e-06 2024-04-18T21:06:59.178 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.178 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.178 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:59.178 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136806+0000", 2024-04-18T21:06:59.178 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012197999999999999 2024-04-18T21:06:59.179 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.179 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.179 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:59.179 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136818+0000", 2024-04-18T21:06:59.179 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1868000000000001e-05 2024-04-18T21:06:59.179 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.179 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:59.179 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.179 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.179 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.179 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11731 4.39 4:9dcc5ecf:::1000000316e.00000000:head [write 3247277~11534 [2@1720266] in=11534b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:06:59.179 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.094419+0000", 2024-04-18T21:06:59.179 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.041606983, 2024-04-18T21:06:59.179 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.042530119999999998, 2024-04-18T21:06:59.179 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:59.179 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:59.180 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:59.180 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:59.180 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:06:59.180 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:59.180 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11731 2024-04-18T21:06:59.180 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.180 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:59.180 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.180 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:59.180 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094419+0000", 2024-04-18T21:06:59.180 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.180 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.180 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.180 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:59.180 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094419+0000", 2024-04-18T21:06:59.181 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.181 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.181 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.181 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:59.181 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094420+0000", 2024-04-18T21:06:59.181 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.6400000000000003e-07 2024-04-18T21:06:59.181 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.181 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.181 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:59.181 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094429+0000", 2024-04-18T21:06:59.181 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.2359999999999993e-06 2024-04-18T21:06:59.181 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.181 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.181 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:59.181 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094433+0000", 2024-04-18T21:06:59.181 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.155e-06 2024-04-18T21:06:59.182 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.182 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.182 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:59.182 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094436+0000", 2024-04-18T21:06:59.182 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.0529999999999998e-06 2024-04-18T21:06:59.182 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.182 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.182 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:59.182 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.099720+0000", 2024-04-18T21:06:59.182 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0052837370000000002 2024-04-18T21:06:59.182 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.182 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.182 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:59.182 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.099793+0000", 2024-04-18T21:06:59.182 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.2959000000000004e-05 2024-04-18T21:06:59.182 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.183 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.183 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:59.183 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.099884+0000", 2024-04-18T21:06:59.183 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.1032999999999994e-05 2024-04-18T21:06:59.183 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.183 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.183 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:59.183 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.103177+0000", 2024-04-18T21:06:59.183 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0032935210000000002 2024-04-18T21:06:59.183 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.183 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.183 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:59.183 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136826+0000", 2024-04-18T21:06:59.183 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.033648521000000001 2024-04-18T21:06:59.183 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.183 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.184 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:59.184 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136896+0000", 2024-04-18T21:06:59.184 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0457000000000007e-05 2024-04-18T21:06:59.184 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.184 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.184 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:59.184 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136949+0000", 2024-04-18T21:06:59.184 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.2984e-05 2024-04-18T21:06:59.184 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.184 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:59.184 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.184 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.184 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.184 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11760 4.a 4:537ce2fe:::100000033c1.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:06:59.184 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.116302+0000", 2024-04-18T21:06:59.185 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.019724007000000002, 2024-04-18T21:06:59.185 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.020849556000000002, 2024-04-18T21:06:59.185 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:59.185 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:59.185 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:06:59.185 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:59.185 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:06:59.185 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:59.185 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11760 2024-04-18T21:06:59.185 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.185 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:59.185 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.185 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:59.185 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.116302+0000", 2024-04-18T21:06:59.185 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.186 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.186 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.186 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:59.186 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.116302+0000", 2024-04-18T21:06:59.186 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.186 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.186 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.186 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:59.186 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.116303+0000", 2024-04-18T21:06:59.186 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9399999999999993e-07 2024-04-18T21:06:59.186 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.186 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.186 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:59.186 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.123481+0000", 2024-04-18T21:06:59.187 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0071778010000000001 2024-04-18T21:06:59.187 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.187 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.187 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:59.187 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.123497+0000", 2024-04-18T21:06:59.187 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5783000000000001e-05 2024-04-18T21:06:59.187 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.187 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.187 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:59.187 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.123505+0000", 2024-04-18T21:06:59.187 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5590000000000006e-06 2024-04-18T21:06:59.187 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.187 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.187 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:59.188 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.123579+0000", 2024-04-18T21:06:59.188 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3149e-05 2024-04-18T21:06:59.188 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.188 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.188 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:59.188 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.123743+0000", 2024-04-18T21:06:59.188 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016495299999999999 2024-04-18T21:06:59.188 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.188 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.188 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:59.188 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.123999+0000", 2024-04-18T21:06:59.188 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00025558800000000001 2024-04-18T21:06:59.188 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.188 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.188 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:59.189 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.134976+0000", 2024-04-18T21:06:59.189 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010977066000000001 2024-04-18T21:06:59.189 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.189 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:59.189 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.189 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.189 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2024-04-18T21:06:59.189 INFO:teuthology.orchestra.run.smithi132.stdout: "num_ops": 13 2024-04-18T21:06:59.189 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:59.191 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:06:59.191 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:59.190+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:59.200 INFO:tasks.workunit.client.0.smithi078.stdout:1/361: symlink d0/d2a/d3c/d4b/d4/d61/l80 0 2024-04-18T21:06:59.200 INFO:tasks.workunit.client.0.smithi078.stdout:4/362: truncate d0/dc/d29/d2f/f38 1020407 0 2024-04-18T21:06:59.200 INFO:tasks.workunit.client.0.smithi078.stdout:9/310: symlink d7/d11/d1b/d45/l6b 0 2024-04-18T21:06:59.200 INFO:tasks.workunit.client.0.smithi078.stdout:0/345: link d0/d9/f23 d0/d15/f64 0 2024-04-18T21:06:59.200 INFO:tasks.workunit.client.0.smithi078.stdout:1/362: rmdir d0 39 2024-04-18T21:06:59.200 INFO:tasks.workunit.client.0.smithi078.stdout:5/356: dwrite d9/da/ff [4194304,4194304] 0 2024-04-18T21:06:59.201 INFO:tasks.workunit.client.0.smithi078.stdout:0/346: write d0/d9/da/db/d35/d3f/f44 [3127824,117250] 0 2024-04-18T21:06:59.201 INFO:tasks.workunit.client.0.smithi078.stdout:1/363: mkdir d0/d2a/d45/d81 0 2024-04-18T21:06:59.201 INFO:tasks.workunit.client.0.smithi078.stdout:3/283: dread d4/f9 [0,4194304] 0 2024-04-18T21:06:59.201 INFO:tasks.workunit.client.0.smithi078.stdout:5/357: mknod d9/da/d3e/d4c/d53/c6e 0 2024-04-18T21:06:59.201 INFO:tasks.workunit.client.0.smithi078.stdout:7/329: dwrite d1/f3 [0,4194304] 0 2024-04-18T21:06:59.201 INFO:tasks.workunit.client.0.smithi078.stdout:8/275: dread d0/f1f [0,4194304] 0 2024-04-18T21:06:59.201 INFO:tasks.workunit.client.0.smithi078.stdout:6/258: write d2/f3 [3085737,68266] 0 2024-04-18T21:06:59.201 INFO:tasks.workunit.client.0.smithi078.stdout:9/311: dwrite d7/df/f21 [0,4194304] 0 2024-04-18T21:06:59.201 INFO:tasks.workunit.client.0.smithi078.stdout:4/363: dwrite d0/d73/f75 [0,4194304] 0 2024-04-18T21:06:59.201 INFO:tasks.workunit.client.0.smithi078.stdout:0/347: creat d0/d9/dd/d17/d2e/d31/f65 x:0 0 0 2024-04-18T21:06:59.201 INFO:tasks.workunit.client.0.smithi078.stdout:9/312: chown d7/df/l12 0 1 2024-04-18T21:06:59.201 INFO:tasks.workunit.client.0.smithi078.stdout:0/348: read d0/d9/da/f42 [83446,126631] 0 2024-04-18T21:06:59.201 INFO:tasks.workunit.client.0.smithi078.stdout:9/313: chown d7/d11/c69 1904763 1 2024-04-18T21:06:59.201 INFO:tasks.workunit.client.0.smithi078.stdout:3/284: mknod d4/da/c47 0 2024-04-18T21:06:59.201 INFO:tasks.workunit.client.0.smithi078.stdout:2/324: dread d0/f1e [0,4194304] 0 2024-04-18T21:06:59.202 INFO:tasks.workunit.client.0.smithi078.stdout:3/285: fsync d4/d2d/d30/f40 0 2024-04-18T21:06:59.202 INFO:tasks.workunit.client.0.smithi078.stdout:3/286: stat d4/da/d11/f3c 0 2024-04-18T21:06:59.202 INFO:tasks.workunit.client.0.smithi078.stdout:7/330: mkdir d1/d16/dc/d11/d53/d82 0 2024-04-18T21:06:59.202 INFO:tasks.workunit.client.0.smithi078.stdout:9/314: rename d7/d11/d2d/l27 to d7/df/d1e/l6c 0 2024-04-18T21:06:59.202 INFO:tasks.workunit.client.0.smithi078.stdout:1/364: link d0/d2a/d3c/d4b/d4/l12 d0/d2a/d2f/d50/d78/l82 0 2024-04-18T21:06:59.202 INFO:tasks.workunit.client.0.smithi078.stdout:7/331: dread - d1/d16/d65/f6a zero size 2024-04-18T21:06:59.202 INFO:tasks.workunit.client.0.smithi078.stdout:5/358: creat d9/d2e/d29/d55/f6f x:0 0 0 2024-04-18T21:06:59.202 INFO:tasks.workunit.client.0.smithi078.stdout:0/349: symlink d0/l66 0 2024-04-18T21:06:59.202 INFO:tasks.workunit.client.0.smithi078.stdout:2/325: creat d0/db/d18/d21/d27/d29/d57/f61 x:0 0 0 2024-04-18T21:06:59.202 INFO:tasks.workunit.client.0.smithi078.stdout:8/276: link d0/d10/d14/d2a/d3c/l4f d0/l52 0 2024-04-18T21:06:59.202 INFO:tasks.workunit.client.0.smithi078.stdout:0/350: mknod d0/d9/c67 0 2024-04-18T21:06:59.202 INFO:tasks.workunit.client.0.smithi078.stdout:2/326: write d0/f54 [281527,61527] 0 2024-04-18T21:06:59.202 INFO:tasks.workunit.client.0.smithi078.stdout:9/315: getdents d7/df 0 2024-04-18T21:06:59.202 INFO:tasks.workunit.client.0.smithi078.stdout:4/364: dwrite d0/dc/d10/f32 [4194304,4194304] 0 2024-04-18T21:06:59.202 INFO:tasks.workunit.client.0.smithi078.stdout:5/359: link d9/da/f1b d9/da/d32/f70 0 2024-04-18T21:06:59.203 INFO:tasks.workunit.client.0.smithi078.stdout:8/277: mknod d0/d10/d14/d2d/c53 0 2024-04-18T21:06:59.203 INFO:tasks.workunit.client.0.smithi078.stdout:4/365: chown d0/f50 11742408 1 2024-04-18T21:06:59.203 INFO:tasks.workunit.client.0.smithi078.stdout:0/351: chown d0/d9/da/c52 352 1 2024-04-18T21:06:59.203 INFO:tasks.workunit.client.0.smithi078.stdout:3/287: dwrite d4/da/d11/f3c [0,4194304] 0 2024-04-18T21:06:59.203 INFO:tasks.workunit.client.0.smithi078.stdout:8/278: truncate d0/d10/d14/d2a/d41/f4e 938112 0 2024-04-18T21:06:59.203 INFO:tasks.workunit.client.0.smithi078.stdout:3/288: fsync d4/da/d11/f2c 0 2024-04-18T21:06:59.203 INFO:tasks.workunit.client.0.smithi078.stdout:4/366: chown d0/dc/d10/d41/c6c 6167 1 2024-04-18T21:06:59.203 INFO:tasks.workunit.client.0.smithi078.stdout:0/352: getdents d0/d9/dd/d17 0 2024-04-18T21:06:59.203 INFO:tasks.workunit.client.0.smithi078.stdout:6/259: dwrite d2/d6/fc [0,4194304] 0 2024-04-18T21:06:59.203 INFO:tasks.workunit.client.0.smithi078.stdout:0/353: sync 2024-04-18T21:06:59.203 INFO:tasks.workunit.client.0.smithi078.stdout:0/354: sync 2024-04-18T21:06:59.203 INFO:tasks.workunit.client.0.smithi078.stdout:8/279: write d0/d10/f1c [4318006,10779] 0 2024-04-18T21:06:59.203 INFO:tasks.workunit.client.0.smithi078.stdout:6/260: creat d2/d6/f59 x:0 0 0 2024-04-18T21:06:59.203 INFO:tasks.workunit.client.0.smithi078.stdout:3/289: read d4/f18 [1267913,44661] 0 2024-04-18T21:06:59.203 INFO:tasks.workunit.client.0.smithi078.stdout:4/367: fdatasync d0/dc/d10/d1c/d60/f7c 0 2024-04-18T21:06:59.203 INFO:tasks.workunit.client.0.smithi078.stdout:0/355: write d0/d9/f43 [1877268,2136] 0 2024-04-18T21:06:59.204 INFO:tasks.workunit.client.0.smithi078.stdout:9/316: dwrite d7/d11/d2d/d26/f2b [0,4194304] 0 2024-04-18T21:06:59.204 INFO:tasks.workunit.client.0.smithi078.stdout:6/261: fdatasync d2/f3 0 2024-04-18T21:06:59.204 INFO:tasks.workunit.client.0.smithi078.stdout:2/327: dwrite d0/d1f/f44 [0,4194304] 0 2024-04-18T21:06:59.204 INFO:tasks.workunit.client.0.smithi078.stdout:3/290: creat d4/d2d/d30/f48 x:0 0 0 2024-04-18T21:06:59.204 INFO:tasks.workunit.client.0.smithi078.stdout:8/280: mknod d0/d10/d14/d2a/d41/c54 0 2024-04-18T21:06:59.204 INFO:tasks.workunit.client.0.smithi078.stdout:9/317: unlink d7/d11/d2d/l17 0 2024-04-18T21:06:59.204 INFO:tasks.workunit.client.0.smithi078.stdout:5/360: dwrite d9/da/d4b/f4d [0,4194304] 0 2024-04-18T21:06:59.204 INFO:tasks.workunit.client.0.smithi078.stdout:0/356: write d0/d9/da/db/f33 [1931085,2112] 0 2024-04-18T21:06:59.204 INFO:tasks.workunit.client.0.smithi078.stdout:5/361: fsync d9/f25 0 2024-04-18T21:06:59.204 INFO:tasks.workunit.client.0.smithi078.stdout:5/362: dread - d9/d2e/d65/f6a zero size 2024-04-18T21:06:59.204 INFO:tasks.workunit.client.0.smithi078.stdout:0/357: chown d0/d9/da/db/d35/f5d 45 1 2024-04-18T21:06:59.204 INFO:tasks.workunit.client.0.smithi078.stdout:8/281: creat d0/f55 x:0 0 0 2024-04-18T21:06:59.204 INFO:tasks.workunit.client.0.smithi078.stdout:9/318: creat d7/f6d x:0 0 0 2024-04-18T21:06:59.204 INFO:tasks.workunit.client.0.smithi078.stdout:4/368: rename d0/dc/d29/d6d/f6e to d0/f84 0 2024-04-18T21:06:59.204 INFO:tasks.workunit.client.0.smithi078.stdout:8/282: sync 2024-04-18T21:06:59.204 INFO:tasks.workunit.client.0.smithi078.stdout:0/358: creat d0/d9/da/db/f68 x:0 0 0 2024-04-18T21:06:59.205 INFO:tasks.workunit.client.0.smithi078.stdout:9/319: unlink f0 0 2024-04-18T21:06:59.205 INFO:tasks.workunit.client.0.smithi078.stdout:0/359: readlink d0/d9/d2f/l60 0 2024-04-18T21:06:59.205 INFO:tasks.workunit.client.0.smithi078.stdout:4/369: fsync d0/dc/d10/d3a/f59 0 2024-04-18T21:06:59.205 INFO:tasks.workunit.client.0.smithi078.stdout:9/320: chown d7/d11/d1b/d45/d4b/f56 6 1 2024-04-18T21:06:59.205 INFO:tasks.workunit.client.0.smithi078.stdout:0/360: readlink d0/d9/dd/l1a 0 2024-04-18T21:06:59.205 INFO:tasks.workunit.client.0.smithi078.stdout:4/370: mkdir d0/dc/d10/d85 0 2024-04-18T21:06:59.205 INFO:tasks.workunit.client.0.smithi078.stdout:9/321: getdents d7/df/d67 0 2024-04-18T21:06:59.205 INFO:tasks.workunit.client.0.smithi078.stdout:2/328: dwrite d0/d1f/d34/f53 [8388608,4194304] 0 2024-04-18T21:06:59.205 INFO:tasks.workunit.client.0.smithi078.stdout:0/361: getdents d0/d15 0 2024-04-18T21:06:59.205 INFO:tasks.workunit.client.0.smithi078.stdout:0/362: readlink d0/d9/dd/l1b 0 2024-04-18T21:06:59.205 INFO:tasks.workunit.client.0.smithi078.stdout:4/371: chown d0/dc/d10/d3a/c65 16 1 2024-04-18T21:06:59.205 INFO:tasks.workunit.client.0.smithi078.stdout:9/322: creat d7/d11/d2d/d3f/f6e x:0 0 0 2024-04-18T21:06:59.205 INFO:tasks.workunit.client.0.smithi078.stdout:2/329: mknod d0/d1f/d34/c62 0 2024-04-18T21:06:59.205 INFO:tasks.workunit.client.0.smithi078.stdout:0/363: mknod d0/d9/d4c/c69 0 2024-04-18T21:06:59.206 INFO:tasks.workunit.client.0.smithi078.stdout:9/323: symlink d7/d11/d2d/d26/l6f 0 2024-04-18T21:06:59.206 INFO:tasks.workunit.client.0.smithi078.stdout:0/364: chown d0/d9/da/l1c 12 1 2024-04-18T21:06:59.206 INFO:tasks.workunit.client.0.smithi078.stdout:9/324: truncate d7/fa 4933062 0 2024-04-18T21:06:59.206 INFO:tasks.workunit.client.0.smithi078.stdout:8/283: dwrite d0/f2c [0,4194304] 0 2024-04-18T21:06:59.206 INFO:tasks.workunit.client.0.smithi078.stdout:0/365: creat d0/d9/d4c/f6a x:0 0 0 2024-04-18T21:06:59.206 INFO:tasks.workunit.client.0.smithi078.stdout:9/325: truncate d7/d11/d2d/f4e 956588 0 2024-04-18T21:06:59.206 INFO:tasks.workunit.client.0.smithi078.stdout:4/372: dwrite d0/f28 [0,4194304] 0 2024-04-18T21:06:59.206 INFO:tasks.workunit.client.0.smithi078.stdout:0/366: mkdir d0/d9/d4c/d6b 0 2024-04-18T21:06:59.206 INFO:tasks.workunit.client.0.smithi078.stdout:9/326: mknod d7/d23/d3e/d5a/c70 0 2024-04-18T21:06:59.206 INFO:tasks.workunit.client.0.smithi078.stdout:4/373: write d0/dc/d37/f76 [1685469,114990] 0 2024-04-18T21:06:59.206 INFO:tasks.workunit.client.0.smithi078.stdout:0/367: write d0/d9/da/f10 [1441882,48955] 0 2024-04-18T21:06:59.206 INFO:tasks.workunit.client.0.smithi078.stdout:9/327: write d7/df/d1e/f58 [789178,129779] 0 2024-04-18T21:06:59.206 INFO:tasks.workunit.client.0.smithi078.stdout:0/368: mkdir d0/d6c 0 2024-04-18T21:06:59.207 INFO:tasks.workunit.client.0.smithi078.stdout:4/374: creat d0/dc/d10/d3a/d7e/f86 x:0 0 0 2024-04-18T21:06:59.207 INFO:tasks.workunit.client.0.smithi078.stdout:0/369: write d0/d9/f43 [938985,100990] 0 2024-04-18T21:06:59.207 INFO:tasks.workunit.client.0.smithi078.stdout:9/328: rename d7/d11/d2d/l1f to d7/d11/d1b/d45/d4b/d5d/d6a/l71 0 2024-04-18T21:06:59.207 INFO:tasks.workunit.client.0.smithi078.stdout:8/284: dwrite d0/d10/d14/d2d/f31 [0,4194304] 0 2024-04-18T21:06:59.207 INFO:tasks.workunit.client.0.smithi078.stdout:8/285: fdatasync d0/f5 0 2024-04-18T21:06:59.207 INFO:tasks.workunit.client.0.smithi078.stdout:1/365: dread d0/d11/f18 [0,4194304] 0 2024-04-18T21:06:59.207 INFO:tasks.workunit.client.0.smithi078.stdout:8/286: readlink d0/l52 0 2024-04-18T21:06:59.207 INFO:tasks.workunit.client.0.smithi078.stdout:1/366: write d0/d46/f49 [1705385,20730] 0 2024-04-18T21:06:59.207 INFO:tasks.workunit.client.0.smithi078.stdout:0/370: dwrite d0/f8 [4194304,4194304] 0 2024-04-18T21:06:59.207 INFO:tasks.workunit.client.0.smithi078.stdout:9/329: dwrite d7/df/f4c [0,4194304] 0 2024-04-18T21:06:59.207 INFO:tasks.workunit.client.0.smithi078.stdout:0/371: dread - d0/d15/f5f zero size 2024-04-18T21:06:59.207 INFO:tasks.workunit.client.0.smithi078.stdout:3/291: dread d4/df/f26 [0,4194304] 0 2024-04-18T21:06:59.209 INFO:tasks.workunit.client.0.smithi078.stdout:9/330: write d7/d11/d2d/d3f/d4d/f4f [1655249,82579] 0 2024-04-18T21:06:59.209 INFO:tasks.workunit.client.0.smithi078.stdout:9/331: chown d7/d23 258 1 2024-04-18T21:06:59.209 INFO:tasks.workunit.client.0.smithi078.stdout:8/287: creat d0/d10/d14/d2a/d4a/f56 x:0 0 0 2024-04-18T21:06:59.209 INFO:tasks.workunit.client.0.smithi078.stdout:0/372: creat d0/d9/d58/f6d x:0 0 0 2024-04-18T21:06:59.209 INFO:tasks.workunit.client.0.smithi078.stdout:9/332: mknod d7/d11/d2d/d3f/d4d/c72 0 2024-04-18T21:06:59.209 INFO:tasks.workunit.client.0.smithi078.stdout:1/367: creat d0/d2a/d5f/f83 x:0 0 0 2024-04-18T21:06:59.209 INFO:tasks.workunit.client.0.smithi078.stdout:3/292: symlink d4/df/l49 0 2024-04-18T21:06:59.209 INFO:tasks.workunit.client.0.smithi078.stdout:9/333: write d7/d23/d3e/d5a/f5e [2466955,89627] 0 2024-04-18T21:06:59.209 INFO:tasks.workunit.client.0.smithi078.stdout:6/262: dread d2/d6/f16 [0,4194304] 0 2024-04-18T21:06:59.209 INFO:tasks.workunit.client.0.smithi078.stdout:1/368: mknod d0/d2a/c84 0 2024-04-18T21:06:59.209 INFO:tasks.workunit.client.0.smithi078.stdout:3/293: unlink d4/df/f26 0 2024-04-18T21:06:59.210 INFO:tasks.workunit.client.0.smithi078.stdout:0/373: rename d0/d9/da/db/d35/d3f/f44 to d0/d9/da/db/d35/f6e 0 2024-04-18T21:06:59.210 INFO:tasks.workunit.client.0.smithi078.stdout:1/369: mkdir d0/d46/d32/d35/d85 0 2024-04-18T21:06:59.211 INFO:tasks.workunit.client.0.smithi078.stdout:0/374: stat d0/d15/f27 0 2024-04-18T21:06:59.212 INFO:tasks.workunit.client.0.smithi078.stdout:1/370: stat d0/d46/d32/d35/d85 0 2024-04-18T21:06:59.212 INFO:tasks.workunit.client.0.smithi078.stdout:8/288: dwrite d0/d10/d14/d2d/f31 [0,4194304] 0 2024-04-18T21:06:59.213 INFO:tasks.workunit.client.0.smithi078.stdout:9/334: dwrite d7/f46 [0,4194304] 0 2024-04-18T21:06:59.214 INFO:tasks.workunit.client.0.smithi078.stdout:0/375: creat d0/d9/da/db/d35/f6f x:0 0 0 2024-04-18T21:06:59.215 INFO:tasks.workunit.client.0.smithi078.stdout:9/335: write d7/d11/d2d/d3f/d4d/f4f [1319474,75484] 0 2024-04-18T21:06:59.215 INFO:tasks.workunit.client.0.smithi078.stdout:8/289: write d0/f1f [2366150,19175] 0 2024-04-18T21:06:59.215 INFO:tasks.workunit.client.0.smithi078.stdout:1/371: getdents d0/d46/d32 0 2024-04-18T21:06:59.215 INFO:tasks.workunit.client.0.smithi078.stdout:0/376: mkdir d0/d9/d4c/d70 0 2024-04-18T21:06:59.215 INFO:tasks.workunit.client.0.smithi078.stdout:0/377: sync 2024-04-18T21:06:59.216 INFO:tasks.workunit.client.0.smithi078.stdout:9/336: write d7/d23/d3e/d5a/f5e [3944851,71825] 0 2024-04-18T21:06:59.216 INFO:tasks.workunit.client.0.smithi078.stdout:9/337: sync 2024-04-18T21:06:59.216 INFO:tasks.workunit.client.0.smithi078.stdout:8/290: mknod d0/d10/d14/d2a/d4a/c57 0 2024-04-18T21:06:59.216 INFO:tasks.workunit.client.0.smithi078.stdout:1/372: truncate d0/d11/f18 1061842 0 2024-04-18T21:06:59.217 INFO:tasks.workunit.client.0.smithi078.stdout:8/291: creat d0/d10/d14/f58 x:0 0 0 2024-04-18T21:06:59.218 INFO:tasks.workunit.client.0.smithi078.stdout:1/373: read d0/d2a/f62 [1217977,95808] 0 2024-04-18T21:06:59.218 INFO:tasks.workunit.client.0.smithi078.stdout:9/338: mknod d7/d11/d1b/d45/d4b/c73 0 2024-04-18T21:06:59.218 INFO:tasks.workunit.client.0.smithi078.stdout:1/374: stat d0/d2a/d3c/d4b/d4/l5b 0 2024-04-18T21:06:59.218 INFO:tasks.workunit.client.0.smithi078.stdout:9/339: mkdir d7/d11/d1b/d45/d74 0 2024-04-18T21:06:59.219 INFO:tasks.workunit.client.0.smithi078.stdout:1/375: mknod d0/d2a/d3c/d4b/d4/d61/d75/c86 0 2024-04-18T21:06:59.220 INFO:tasks.workunit.client.0.smithi078.stdout:9/340: rename d7/d11/d2d/d26/f2b to d7/d23/f75 0 2024-04-18T21:06:59.220 INFO:tasks.workunit.client.0.smithi078.stdout:9/341: dread - d7/f59 zero size 2024-04-18T21:06:59.222 INFO:tasks.workunit.client.0.smithi078.stdout:9/342: truncate d7/d11/d1b/f5f 1985207 0 2024-04-18T21:06:59.224 INFO:tasks.workunit.client.0.smithi078.stdout:2/330: dread d0/f5 [0,4194304] 0 2024-04-18T21:06:59.225 INFO:tasks.workunit.client.0.smithi078.stdout:9/343: truncate d7/d11/d1b/d45/d4b/d5d/f60 942797 0 2024-04-18T21:06:59.225 INFO:tasks.workunit.client.0.smithi078.stdout:2/331: creat d0/db/d18/d30/f63 x:0 0 0 2024-04-18T21:06:59.227 INFO:tasks.workunit.client.0.smithi078.stdout:9/344: rename d7/d11/d2d/l19 to d7/df/l76 0 2024-04-18T21:06:59.227 INFO:tasks.workunit.client.0.smithi078.stdout:1/376: dwrite d0/d2a/d45/f54 [0,4194304] 0 2024-04-18T21:06:59.227 INFO:tasks.workunit.client.0.smithi078.stdout:3/294: dread d4/da/d11/f2c [0,4194304] 0 2024-04-18T21:06:59.227 INFO:tasks.workunit.client.0.smithi078.stdout:2/332: symlink d0/db/d18/d21/d27/d29/d33/l64 0 2024-04-18T21:06:59.228 INFO:tasks.workunit.client.0.smithi078.stdout:9/345: unlink d7/d11/d47/l63 0 2024-04-18T21:06:59.228 INFO:tasks.workunit.client.0.smithi078.stdout:1/377: creat d0/d2a/d5f/f87 x:0 0 0 2024-04-18T21:06:59.228 INFO:tasks.workunit.client.0.smithi078.stdout:2/333: mkdir d0/db/d65 0 2024-04-18T21:06:59.228 INFO:tasks.workunit.client.0.smithi078.stdout:6/263: dread d2/d1c/d30/f3b [0,4194304] 0 2024-04-18T21:06:59.229 INFO:tasks.workunit.client.0.smithi078.stdout:6/264: fdatasync d2/fe 0 2024-04-18T21:06:59.229 INFO:tasks.workunit.client.0.smithi078.stdout:8/292: write d0/f36 [494234,113254] 0 2024-04-18T21:06:59.230 INFO:tasks.workunit.client.0.smithi078.stdout:3/295: link d4/df/f1f d4/da/f4a 0 2024-04-18T21:06:59.230 INFO:tasks.workunit.client.0.smithi078.stdout:3/296: rmdir d4/df/d17 39 2024-04-18T21:06:59.231 INFO:tasks.workunit.client.0.smithi078.stdout:8/293: mkdir d0/d10/d14/d2a/d3a/d59 0 2024-04-18T21:06:59.231 INFO:tasks.workunit.client.0.smithi078.stdout:6/265: getdents d2/d1c/d3a 0 2024-04-18T21:06:59.231 INFO:tasks.workunit.client.0.smithi078.stdout:3/297: write d4/df/d17/d41/f44 [270512,61472] 0 2024-04-18T21:06:59.232 INFO:tasks.workunit.client.0.smithi078.stdout:6/266: symlink d2/d34/l5a 0 2024-04-18T21:06:59.232 INFO:tasks.workunit.client.0.smithi078.stdout:2/334: symlink d0/db/d18/d21/d27/d29/d57/l66 0 2024-04-18T21:06:59.232 INFO:tasks.workunit.client.0.smithi078.stdout:8/294: truncate d0/f5 2811329 0 2024-04-18T21:06:59.233 INFO:tasks.workunit.client.0.smithi078.stdout:3/298: mkdir d4/d2d/d30/d35/d4b 0 2024-04-18T21:06:59.233 INFO:tasks.workunit.client.0.smithi078.stdout:6/267: mkdir d2/d34/d35/d46/d5b 0 2024-04-18T21:06:59.234 INFO:tasks.workunit.client.0.smithi078.stdout:3/299: chown d4/d2d/d30/c3f 58065013 1 2024-04-18T21:06:59.235 INFO:tasks.workunit.client.0.smithi078.stdout:3/300: unlink d4/df/d17/c2e 0 2024-04-18T21:06:59.235 INFO:tasks.workunit.client.0.smithi078.stdout:6/268: stat d2/d1c/l4d 0 2024-04-18T21:06:59.236 INFO:tasks.workunit.client.0.smithi078.stdout:1/378: dwrite d0/d2a/d3c/f6b [0,4194304] 0 2024-04-18T21:06:59.237 INFO:tasks.workunit.client.0.smithi078.stdout:1/379: write d0/d11/f22 [8087152,36719] 0 2024-04-18T21:06:59.239 INFO:tasks.workunit.client.0.smithi078.stdout:1/380: unlink d0/d46/c70 0 2024-04-18T21:06:59.239 INFO:tasks.workunit.client.0.smithi078.stdout:6/269: symlink d2/d6/l5c 0 2024-04-18T21:06:59.239 INFO:tasks.workunit.client.0.smithi078.stdout:3/301: mknod d4/df/c4c 0 2024-04-18T21:06:59.240 INFO:tasks.workunit.client.0.smithi078.stdout:2/335: dwrite d0/db/f36 [0,4194304] 0 2024-04-18T21:06:59.242 INFO:tasks.workunit.client.0.smithi078.stdout:3/302: write d4/da/d11/f2c [2762542,75289] 0 2024-04-18T21:06:59.242 INFO:tasks.workunit.client.0.smithi078.stdout:1/381: rename d0/d46/d77/c7a to d0/d46/d32/d35/d85/c88 0 2024-04-18T21:06:59.244 INFO:tasks.workunit.client.0.smithi078.stdout:3/303: readlink d4/df/d17/l2b 0 2024-04-18T21:06:59.244 INFO:tasks.workunit.client.0.smithi078.stdout:9/346: dwrite d7/d11/d2d/d26/f38 [0,4194304] 0 2024-04-18T21:06:59.246 INFO:tasks.workunit.client.0.smithi078.stdout:7/332: dread d1/d16/dc/f60 [0,4194304] 0 2024-04-18T21:06:59.247 INFO:tasks.workunit.client.0.smithi078.stdout:7/333: fsync d1/d16/d1c/f2a 0 2024-04-18T21:06:59.247 INFO:tasks.workunit.client.0.smithi078.stdout:3/304: symlink d4/da/l4d 0 2024-04-18T21:06:59.248 INFO:tasks.workunit.client.0.smithi078.stdout:9/347: write d7/df/f10 [2246086,95554] 0 2024-04-18T21:06:59.249 INFO:tasks.workunit.client.0.smithi078.stdout:6/270: dwrite d2/d6/dd/f48 [0,4194304] 0 2024-04-18T21:06:59.249 INFO:tasks.workunit.client.0.smithi078.stdout:7/334: stat d1/d16/dc/d11/d53/d82 0 2024-04-18T21:06:59.250 INFO:tasks.workunit.client.0.smithi078.stdout:2/336: dwrite d0/f5 [4194304,4194304] 0 2024-04-18T21:06:59.250 INFO:tasks.workunit.client.0.smithi078.stdout:3/305: rename d4/c1c to d4/d2d/d30/c4e 0 2024-04-18T21:06:59.251 INFO:tasks.workunit.client.0.smithi078.stdout:7/335: dread - d1/d16/d65/f79 zero size 2024-04-18T21:06:59.251 INFO:tasks.workunit.client.0.smithi078.stdout:6/271: mkdir d2/d6/dd/d4b/d5d 0 2024-04-18T21:06:59.251 INFO:tasks.workunit.client.0.smithi078.stdout:3/306: creat d4/d2d/d30/d35/f4f x:0 0 0 2024-04-18T21:06:59.251 INFO:tasks.workunit.client.0.smithi078.stdout:2/337: rename d0/l7 to d0/db/d65/l67 0 2024-04-18T21:06:59.251 INFO:tasks.workunit.client.0.smithi078.stdout:6/272: write d2/d1f/f2e [2734425,114975] 0 2024-04-18T21:06:59.251 INFO:tasks.workunit.client.0.smithi078.stdout:1/382: dread d0/d11/f18 [0,4194304] 0 2024-04-18T21:06:59.252 INFO:tasks.workunit.client.0.smithi078.stdout:0/378: dread d0/d9/dd/d17/d2e/f39 [0,4194304] 0 2024-04-18T21:06:59.252 INFO:tasks.workunit.client.0.smithi078.stdout:3/307: link d4/d2d/d30/d35/l28 d4/df/l50 0 2024-04-18T21:06:59.253 INFO:tasks.workunit.client.0.smithi078.stdout:0/379: stat d0/d9/d2f 0 2024-04-18T21:06:59.254 INFO:tasks.workunit.client.0.smithi078.stdout:3/308: link d4/df/l50 d4/l51 0 2024-04-18T21:06:59.255 INFO:tasks.workunit.client.0.smithi078.stdout:3/309: write d4/df/d17/f3a [3369896,37356] 0 2024-04-18T21:06:59.257 INFO:tasks.workunit.client.0.smithi078.stdout:3/310: link d4/d2d/d30/c3f d4/d2d/d30/d35/c52 0 2024-04-18T21:06:59.257 INFO:tasks.workunit.client.0.smithi078.stdout:7/336: dwrite d1/d16/dc/d11/f24 [0,4194304] 0 2024-04-18T21:06:59.260 INFO:tasks.workunit.client.0.smithi078.stdout:3/311: symlink d4/d2d/d30/d35/d4b/l53 0 2024-04-18T21:06:59.262 INFO:tasks.workunit.client.0.smithi078.stdout:3/312: symlink d4/da/l54 0 2024-04-18T21:06:59.264 INFO:tasks.workunit.client.0.smithi078.stdout:7/337: dwrite d1/d16/d65/f6c [0,4194304] 0 2024-04-18T21:06:59.265 INFO:tasks.workunit.client.0.smithi078.stdout:9/348: dread d7/d11/d2d/f4e [0,4194304] 0 2024-04-18T21:06:59.266 INFO:tasks.workunit.client.0.smithi078.stdout:7/338: link d1/d16/d1c/d40/l59 d1/d16/dc/d11/d53/d82/l83 0 2024-04-18T21:06:59.266 INFO:tasks.workunit.client.0.smithi078.stdout:7/339: dread - d1/d16/dc/f5b zero size 2024-04-18T21:06:59.267 INFO:tasks.workunit.client.0.smithi078.stdout:7/340: creat d1/d16/d65/f84 x:0 0 0 2024-04-18T21:06:59.267 INFO:tasks.workunit.client.0.smithi078.stdout:7/341: dread - d1/d16/dc/f51 zero size 2024-04-18T21:06:59.268 INFO:tasks.workunit.client.0.smithi078.stdout:1/383: rename d0/d46 to d0/d2a/d5f/d89 0 2024-04-18T21:06:59.269 INFO:tasks.workunit.client.0.smithi078.stdout:2/338: write d0/f54 [708097,11037] 0 2024-04-18T21:06:59.269 INFO:tasks.workunit.client.0.smithi078.stdout:0/380: write d0/d9/da/f42 [1598621,61895] 0 2024-04-18T21:06:59.269 INFO:tasks.workunit.client.0.smithi078.stdout:1/384: dread d0/d11/f18 [0,4194304] 0 2024-04-18T21:06:59.269 INFO:tasks.workunit.client.0.smithi078.stdout:2/339: stat d0/db/d18/d21/d27/d29 0 2024-04-18T21:06:59.270 INFO:tasks.workunit.client.0.smithi078.stdout:5/363: dread d9/da/f13 [0,4194304] 0 2024-04-18T21:06:59.271 INFO:tasks.workunit.client.0.smithi078.stdout:7/342: dread d1/d16/dc/f1e [0,4194304] 0 2024-04-18T21:06:59.272 INFO:tasks.workunit.client.0.smithi078.stdout:7/343: dread - d1/d16/d10/f1a zero size 2024-04-18T21:06:59.274 INFO:tasks.workunit.client.0.smithi078.stdout:1/385: dread d0/d2a/d3c/d4b/f24 [0,4194304] 0 2024-04-18T21:06:59.274 INFO:tasks.workunit.client.0.smithi078.stdout:2/340: dread d0/db/d18/d21/d27/f58 [8388608,4194304] 0 2024-04-18T21:06:59.275 INFO:tasks.workunit.client.0.smithi078.stdout:1/386: chown d0/d2a/d3c/d4b/d52 876669 1 2024-04-18T21:06:59.276 INFO:tasks.workunit.client.0.smithi078.stdout:0/381: dwrite d0/d9/da/db/f33 [0,4194304] 0 2024-04-18T21:06:59.276 INFO:tasks.workunit.client.0.smithi078.stdout:6/273: fsync d2/d6/dd/f48 0 2024-04-18T21:06:59.276 INFO:tasks.workunit.client.0.smithi078.stdout:3/313: fdatasync d4/df/d17/f3a 0 2024-04-18T21:06:59.277 INFO:tasks.workunit.client.0.smithi078.stdout:1/387: symlink d0/d2a/d3c/d4b/d4/d61/d75/l8a 0 2024-04-18T21:06:59.277 INFO:tasks.workunit.client.0.smithi078.stdout:0/382: chown d0/l66 81286 1 2024-04-18T21:06:59.278 INFO:tasks.workunit.client.0.smithi078.stdout:0/383: fsync d0/d9/da/db/d35/d3f/f41 0 2024-04-18T21:06:59.279 INFO:tasks.workunit.client.0.smithi078.stdout:4/375: dread d0/f48 [0,4194304] 0 2024-04-18T21:06:59.281 INFO:tasks.workunit.client.0.smithi078.stdout:2/341: rename d0/db/d18/d30/f63 to d0/db/d18/d21/d27/f68 0 2024-04-18T21:06:59.281 INFO:tasks.workunit.client.0.smithi078.stdout:3/314: rmdir d4/da 39 2024-04-18T21:06:59.281 INFO:tasks.workunit.client.0.smithi078.stdout:6/274: mknod d2/d6/dd/d4b/c5e 0 2024-04-18T21:06:59.281 INFO:tasks.workunit.client.0.smithi078.stdout:1/388: dread d0/d2a/d2f/f56 [0,4194304] 0 2024-04-18T21:06:59.281 INFO:tasks.workunit.client.0.smithi078.stdout:9/349: dread d7/d11/d1b/d45/d4b/f56 [0,4194304] 0 2024-04-18T21:06:59.281 INFO:tasks.workunit.client.0.smithi078.stdout:0/384: fsync d0/d9/da/db/d35/f20 0 2024-04-18T21:06:59.281 INFO:tasks.workunit.client.0.smithi078.stdout:2/342: fsync d0/db/d18/f1c 0 2024-04-18T21:06:59.282 INFO:tasks.workunit.client.0.smithi078.stdout:9/350: stat d7/d11/d1b/c36 0 2024-04-18T21:06:59.282 INFO:tasks.workunit.client.0.smithi078.stdout:3/315: read d4/d2d/d30/f34 [182938,68641] 0 2024-04-18T21:06:59.282 INFO:tasks.workunit.client.0.smithi078.stdout:8/295: dread d0/d10/f1c [0,4194304] 0 2024-04-18T21:06:59.283 INFO:tasks.workunit.client.0.smithi078.stdout:6/275: rmdir d2/d34/d35/d46/d5b 0 2024-04-18T21:06:59.284 INFO:tasks.workunit.client.0.smithi078.stdout:2/343: getdents d0 0 2024-04-18T21:06:59.285 INFO:tasks.workunit.client.0.smithi078.stdout:6/276: link d2/d6/dd/d4b/f4e d2/d6/dd/d4b/f5f 0 2024-04-18T21:06:59.287 INFO:tasks.workunit.client.0.smithi078.stdout:0/385: dread d0/d9/da/db/d35/f20 [0,4194304] 0 2024-04-18T21:06:59.289 INFO:tasks.workunit.client.0.smithi078.stdout:5/364: dread d9/da/d3e/f59 [0,4194304] 0 2024-04-18T21:06:59.289 INFO:tasks.workunit.client.0.smithi078.stdout:6/277: write d2/d6/dd/f32 [689878,112608] 0 2024-04-18T21:06:59.291 INFO:tasks.workunit.client.0.smithi078.stdout:0/386: write d0/d9/d58/f6d [44082,73063] 0 2024-04-18T21:06:59.291 INFO:tasks.workunit.client.0.smithi078.stdout:1/389: dwrite d0/d2a/d5f/d89/f49 [0,4194304] 0 2024-04-18T21:06:59.291 INFO:tasks.workunit.client.0.smithi078.stdout:3/316: dwrite d4/f18 [0,4194304] 0 2024-04-18T21:06:59.291 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:59.290+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:59.292 INFO:tasks.workunit.client.0.smithi078.stdout:1/390: chown d0/d2a/d3c/d4b/d4/l5b 56717 1 2024-04-18T21:06:59.292 INFO:tasks.workunit.client.0.smithi078.stdout:8/296: dwrite d0/d10/f1c [0,4194304] 0 2024-04-18T21:06:59.293 INFO:tasks.workunit.client.0.smithi078.stdout:8/297: fsync d0/fd 0 2024-04-18T21:06:59.294 INFO:tasks.workunit.client.0.smithi078.stdout:4/376: write d0/dc/d10/f42 [352180,114364] 0 2024-04-18T21:06:59.294 INFO:tasks.workunit.client.0.smithi078.stdout:2/344: truncate d0/d1f/f2b 159202 0 2024-04-18T21:06:59.294 INFO:tasks.workunit.client.0.smithi078.stdout:8/298: fdatasync d0/f55 0 2024-04-18T21:06:59.295 INFO:tasks.workunit.client.0.smithi078.stdout:5/365: symlink d9/da/d3e/d4c/d67/l71 0 2024-04-18T21:06:59.295 INFO:tasks.workunit.client.0.smithi078.stdout:6/278: rmdir d2/d6/d45 0 2024-04-18T21:06:59.295 INFO:tasks.workunit.client.0.smithi078.stdout:1/391: dread d0/d2a/d3c/d4b/f3e [0,4194304] 0 2024-04-18T21:06:59.295 INFO:tasks.workunit.client.0.smithi078.stdout:6/279: fsync d2/d1c/f53 0 2024-04-18T21:06:59.296 INFO:tasks.workunit.client.0.smithi078.stdout:8/299: stat d0/d10/d14/d2d/f3f 0 2024-04-18T21:06:59.296 INFO:tasks.workunit.client.0.smithi078.stdout:7/344: dread d1/d16/d10/f52 [0,4194304] 0 2024-04-18T21:06:59.297 INFO:tasks.workunit.client.0.smithi078.stdout:2/345: read d0/db/d18/f3e [214008,119286] 0 2024-04-18T21:06:59.297 INFO:tasks.workunit.client.0.smithi078.stdout:1/392: symlink d0/d2a/d3c/d4b/d52/l8b 0 2024-04-18T21:06:59.297 INFO:tasks.workunit.client.0.smithi078.stdout:4/377: symlink d0/dc/l87 0 2024-04-18T21:06:59.298 INFO:tasks.workunit.client.0.smithi078.stdout:5/366: read d9/d2e/f23 [2130192,34750] 0 2024-04-18T21:06:59.298 INFO:tasks.workunit.client.0.smithi078.stdout:2/346: chown d0/d1f/d34 31331 1 2024-04-18T21:06:59.299 INFO:tasks.workunit.client.0.smithi078.stdout:1/393: chown d0/d2a/d3c/d4b/d4/d61/d75 754445263 1 2024-04-18T21:06:59.299 INFO:tasks.workunit.client.0.smithi078.stdout:4/378: write d0/f7 [945583,52462] 0 2024-04-18T21:06:59.300 INFO:tasks.workunit.client.0.smithi078.stdout:3/317: dwrite d4/f18 [0,4194304] 0 2024-04-18T21:06:59.301 INFO:tasks.workunit.client.0.smithi078.stdout:2/347: creat d0/db/d18/d21/d27/d29/f69 x:0 0 0 2024-04-18T21:06:59.302 INFO:tasks.workunit.client.0.smithi078.stdout:1/394: write d0/d2a/d5f/d89/d32/d35/f55 [94029,82347] 0 2024-04-18T21:06:59.303 INFO:tasks.workunit.client.0.smithi078.stdout:3/318: creat d4/d2d/f55 x:0 0 0 2024-04-18T21:06:59.303 INFO:tasks.workunit.client.0.smithi078.stdout:4/379: unlink d0/dc/d10/f1b 0 2024-04-18T21:06:59.303 INFO:tasks.workunit.client.0.smithi078.stdout:9/351: sync 2024-04-18T21:06:59.303 INFO:tasks.workunit.client.0.smithi078.stdout:0/387: dwrite d0/f8 [4194304,4194304] 0 2024-04-18T21:06:59.305 INFO:tasks.workunit.client.0.smithi078.stdout:9/352: mkdir d7/d11/d1b/d77 0 2024-04-18T21:06:59.305 INFO:tasks.workunit.client.0.smithi078.stdout:3/319: chown d4/d2d/d30/d35/d4b 451887 1 2024-04-18T21:06:59.305 INFO:tasks.workunit.client.0.smithi078.stdout:2/348: chown d0/db/d18/d21/d27/d29/c35 2577988 1 2024-04-18T21:06:59.306 INFO:tasks.workunit.client.0.smithi078.stdout:4/380: creat d0/dc/d29/d6d/d7b/f88 x:0 0 0 2024-04-18T21:06:59.306 INFO:tasks.workunit.client.0.smithi078.stdout:6/280: dread d2/d6/dd/f48 [0,4194304] 0 2024-04-18T21:06:59.307 INFO:tasks.workunit.client.0.smithi078.stdout:0/388: read d0/d9/f2d [1820142,91879] 0 2024-04-18T21:06:59.307 INFO:tasks.workunit.client.0.smithi078.stdout:8/300: dwrite d0/f1f [4194304,4194304] 0 2024-04-18T21:06:59.307 INFO:tasks.workunit.client.0.smithi078.stdout:9/353: mknod d7/d11/d1b/d45/d4b/d5d/c78 0 2024-04-18T21:06:59.308 INFO:tasks.workunit.client.0.smithi078.stdout:8/301: readlink d0/d10/d14/d2a/d3c/l4f 0 2024-04-18T21:06:59.310 INFO:tasks.workunit.client.0.smithi078.stdout:0/389: creat d0/d9/dd/d17/d2e/f71 x:0 0 0 2024-04-18T21:06:59.310 INFO:tasks.workunit.client.0.smithi078.stdout:9/354: symlink d7/d11/d2d/l79 0 2024-04-18T21:06:59.311 INFO:tasks.workunit.client.0.smithi078.stdout:8/302: chown d0/d10/d14/d2a/d41/c47 1898682079 1 2024-04-18T21:06:59.312 INFO:tasks.workunit.client.0.smithi078.stdout:0/390: fdatasync d0/f5 0 2024-04-18T21:06:59.313 INFO:tasks.workunit.client.0.smithi078.stdout:7/345: dwrite d1/d16/d1c/f34 [0,4194304] 0 2024-04-18T21:06:59.313 INFO:tasks.workunit.client.0.smithi078.stdout:9/355: chown d7/d11/d2d/l79 461651 1 2024-04-18T21:06:59.313 INFO:tasks.workunit.client.0.smithi078.stdout:3/320: sync 2024-04-18T21:06:59.313 INFO:tasks.workunit.client.0.smithi078.stdout:6/281: link d2/d34/d35/c41 d2/d34/d35/d57/c60 0 2024-04-18T21:06:59.314 INFO:tasks.workunit.client.0.smithi078.stdout:0/391: chown d0/d9/da/db/d35/d3f 2 1 2024-04-18T21:06:59.314 INFO:tasks.workunit.client.0.smithi078.stdout:7/346: fsync d1/d16/dc/f74 0 2024-04-18T21:06:59.315 INFO:tasks.workunit.client.0.smithi078.stdout:8/303: rmdir d0/d10/d14/d2a/d41 39 2024-04-18T21:06:59.315 INFO:tasks.workunit.client.0.smithi078.stdout:2/349: dwrite d0/f55 [0,4194304] 0 2024-04-18T21:06:59.315 INFO:tasks.workunit.client.0.smithi078.stdout:1/395: truncate d0/d11/f22 8147510 0 2024-04-18T21:06:59.316 INFO:tasks.workunit.client.0.smithi078.stdout:0/392: fdatasync d0/d9/da/db/d35/f5d 0 2024-04-18T21:06:59.316 INFO:tasks.workunit.client.0.smithi078.stdout:3/321: creat d4/d2d/d30/d35/f56 x:0 0 0 2024-04-18T21:06:59.322 INFO:tasks.workunit.client.0.smithi078.stdout:3/322: mkdir d4/da/d57 0 2024-04-18T21:06:59.325 INFO:tasks.workunit.client.0.smithi078.stdout:9/356: dwrite d7/f37 [4194304,4194304] 0 2024-04-18T21:06:59.325 INFO:tasks.workunit.client.0.smithi078.stdout:0/393: link d0/d9/da/df/c3c d0/d9/d58/c72 0 2024-04-18T21:06:59.326 INFO:tasks.workunit.client.0.smithi078.stdout:8/304: dread d0/d10/d14/d2d/f31 [0,4194304] 0 2024-04-18T21:06:59.326 INFO:tasks.workunit.client.0.smithi078.stdout:6/282: dwrite d2/f2b [0,4194304] 0 2024-04-18T21:06:59.328 INFO:tasks.workunit.client.0.smithi078.stdout:7/347: dwrite d1/f20 [0,4194304] 0 2024-04-18T21:06:59.328 INFO:tasks.workunit.client.0.smithi078.stdout:3/323: fdatasync d4/da/f4a 0 2024-04-18T21:06:59.328 INFO:tasks.workunit.client.0.smithi078.stdout:2/350: dwrite d0/db/d18/f3e [0,4194304] 0 2024-04-18T21:06:59.329 INFO:tasks.workunit.client.0.smithi078.stdout:1/396: dwrite d0/d2a/d2f/f36 [0,4194304] 0 2024-04-18T21:06:59.330 INFO:tasks.workunit.client.0.smithi078.stdout:6/283: creat d2/d1f/f61 x:0 0 0 2024-04-18T21:06:59.330 INFO:tasks.workunit.client.0.smithi078.stdout:5/367: dread d9/da/f1f [0,4194304] 0 2024-04-18T21:06:59.330 INFO:tasks.workunit.client.0.smithi078.stdout:8/305: write d0/d10/d14/d2d/f31 [2548527,71966] 0 2024-04-18T21:06:59.330 INFO:tasks.workunit.client.0.smithi078.stdout:0/394: rmdir d0/d9/da/db/d35/d3f 39 2024-04-18T21:06:59.330 INFO:tasks.workunit.client.0.smithi078.stdout:0/395: sync 2024-04-18T21:06:59.331 INFO:tasks.workunit.client.0.smithi078.stdout:6/284: mknod d2/d1c/c62 0 2024-04-18T21:06:59.331 INFO:tasks.workunit.client.0.smithi078.stdout:2/351: unlink d0/db/d18/d21/d27/c52 0 2024-04-18T21:06:59.332 INFO:tasks.workunit.client.0.smithi078.stdout:1/397: creat d0/d2a/d5f/d89/d77/f8c x:0 0 0 2024-04-18T21:06:59.332 INFO:tasks.workunit.client.0.smithi078.stdout:8/306: mkdir d0/d22/d37/d5a 0 2024-04-18T21:06:59.332 INFO:tasks.workunit.client.0.smithi078.stdout:7/348: link d1/d16/dc/d4b/c6f d1/d32/c85 0 2024-04-18T21:06:59.333 INFO:tasks.workunit.client.0.smithi078.stdout:0/396: fdatasync d0/d9/da/db/d35/f5d 0 2024-04-18T21:06:59.334 INFO:tasks.workunit.client.0.smithi078.stdout:8/307: readlink d0/d10/d14/d2d/l34 0 2024-04-18T21:06:59.334 INFO:tasks.workunit.client.0.smithi078.stdout:1/398: symlink d0/d2a/d3c/d4b/d5e/l8d 0 2024-04-18T21:06:59.334 INFO:tasks.workunit.client.0.smithi078.stdout:2/352: creat d0/db/d18/d21/d27/d29/d33/f6a x:0 0 0 2024-04-18T21:06:59.335 INFO:tasks.workunit.client.0.smithi078.stdout:0/397: write d0/d9/da/db/f4d [212609,40311] 0 2024-04-18T21:06:59.335 INFO:tasks.workunit.client.0.smithi078.stdout:6/285: truncate d2/d6/dd/d4b/f4e 2007168 0 2024-04-18T21:06:59.335 INFO:tasks.workunit.client.0.smithi078.stdout:8/308: write d0/d10/f51 [343006,105690] 0 2024-04-18T21:06:59.336 INFO:tasks.workunit.client.0.smithi078.stdout:3/324: dread d4/f18 [0,4194304] 0 2024-04-18T21:06:59.336 INFO:tasks.workunit.client.0.smithi078.stdout:9/357: dwrite d7/df/f4c [0,4194304] 0 2024-04-18T21:06:59.336 INFO:tasks.workunit.client.0.smithi078.stdout:6/286: chown d2/d6/dd/l52 198 1 2024-04-18T21:06:59.337 INFO:tasks.workunit.client.0.smithi078.stdout:9/358: chown d7/d11/d1b/c52 2 1 2024-04-18T21:06:59.337 INFO:tasks.workunit.client.0.smithi078.stdout:6/287: fdatasync d2/d1f/f50 0 2024-04-18T21:06:59.338 INFO:tasks.workunit.client.0.smithi078.stdout:1/399: rename d0/d2a/d3c/d4b/d5e/l79 to d0/d2a/d45/l8e 0 2024-04-18T21:06:59.338 INFO:tasks.workunit.client.0.smithi078.stdout:6/288: fsync d2/d6/f59 0 2024-04-18T21:06:59.339 INFO:tasks.workunit.client.0.smithi078.stdout:0/398: rename d0/d9/dd/d17/l22 to d0/d9/da/df/l73 0 2024-04-18T21:06:59.339 INFO:tasks.workunit.client.0.smithi078.stdout:9/359: write d7/d11/d2d/d3f/d4d/f4f [77321,54562] 0 2024-04-18T21:06:59.340 INFO:tasks.workunit.client.0.smithi078.stdout:2/353: dread d0/d1f/f44 [0,4194304] 0 2024-04-18T21:06:59.340 INFO:tasks.workunit.client.0.smithi078.stdout:1/400: rename d0/l4f to d0/d2a/l8f 0 2024-04-18T21:06:59.340 INFO:tasks.workunit.client.0.smithi078.stdout:9/360: write d7/df/f2a [145989,90983] 0 2024-04-18T21:06:59.341 INFO:tasks.workunit.client.0.smithi078.stdout:7/349: dwrite d1/d16/dc/d4b/f43 [0,4194304] 0 2024-04-18T21:06:59.341 INFO:tasks.workunit.client.0.smithi078.stdout:9/361: readlink d7/d11/d2d/d3f/d4d/l62 0 2024-04-18T21:06:59.342 INFO:tasks.workunit.client.0.smithi078.stdout:9/362: chown d7/f46 24523 1 2024-04-18T21:06:59.342 INFO:tasks.workunit.client.0.smithi078.stdout:7/350: mkdir d1/d16/dc/d86 0 2024-04-18T21:06:59.346 INFO:tasks.workunit.client.0.smithi078.stdout:6/289: dwrite d2/d1f/f61 [0,4194304] 0 2024-04-18T21:06:59.346 INFO:tasks.workunit.client.0.smithi078.stdout:7/351: dread d1/d16/dc/d11/f24 [0,4194304] 0 2024-04-18T21:06:59.346 INFO:tasks.workunit.client.0.smithi078.stdout:6/290: write d2/fe [2238171,641] 0 2024-04-18T21:06:59.347 INFO:tasks.workunit.client.0.smithi078.stdout:7/352: stat d1/d16/dc/d11/f69 0 2024-04-18T21:06:59.347 INFO:tasks.workunit.client.0.smithi078.stdout:7/353: dread - d1/d16/f77 zero size 2024-04-18T21:06:59.351 INFO:tasks.workunit.client.0.smithi078.stdout:6/291: dwrite d2/d6/fc [4194304,4194304] 0 2024-04-18T21:06:59.363 INFO:tasks.workunit.client.0.smithi078.stdout:7/354: dread d1/d32/f41 [0,4194304] 0 2024-04-18T21:06:59.363 INFO:tasks.workunit.client.0.smithi078.stdout:4/381: dread d0/f50 [0,4194304] 0 2024-04-18T21:06:59.363 INFO:tasks.workunit.client.0.smithi078.stdout:7/355: rmdir d1/d16/dc 39 2024-04-18T21:06:59.364 INFO:tasks.workunit.client.0.smithi078.stdout:4/382: creat d0/dc/d10/d1c/d60/d74/f89 x:0 0 0 2024-04-18T21:06:59.364 INFO:tasks.workunit.client.0.smithi078.stdout:7/356: readlink d1/d16/dc/d4b/l81 0 2024-04-18T21:06:59.365 INFO:tasks.workunit.client.0.smithi078.stdout:7/357: sync 2024-04-18T21:06:59.365 INFO:tasks.workunit.client.0.smithi078.stdout:4/383: creat d0/dc/d5b/f8a x:0 0 0 2024-04-18T21:06:59.365 INFO:tasks.workunit.client.0.smithi078.stdout:7/358: unlink d1/d16/dc/d4b/c7f 0 2024-04-18T21:06:59.366 INFO:tasks.workunit.client.0.smithi078.stdout:7/359: mknod d1/d16/d10/d7c/d7e/c87 0 2024-04-18T21:06:59.366 INFO:tasks.workunit.client.0.smithi078.stdout:7/360: mknod d1/c88 0 2024-04-18T21:06:59.367 INFO:tasks.workunit.client.0.smithi078.stdout:7/361: symlink d1/d32/l89 0 2024-04-18T21:06:59.368 INFO:tasks.workunit.client.0.smithi078.stdout:7/362: write d1/f1f [22262,121123] 0 2024-04-18T21:06:59.369 INFO:tasks.workunit.client.0.smithi078.stdout:7/363: write d1/d16/dc/f74 [269548,31625] 0 2024-04-18T21:06:59.370 INFO:tasks.workunit.client.0.smithi078.stdout:4/384: dwrite d0/f7 [0,4194304] 0 2024-04-18T21:06:59.372 INFO:tasks.workunit.client.0.smithi078.stdout:4/385: rename d0/dc/d10/d1c/d60/d74/f89 to d0/dc/d10/d1c/d6a/d81/f8b 0 2024-04-18T21:06:59.372 INFO:tasks.workunit.client.0.smithi078.stdout:7/364: getdents d1/d16/d10/d7c 0 2024-04-18T21:06:59.372 INFO:tasks.workunit.client.0.smithi078.stdout:7/365: fdatasync d1/d32/f66 0 2024-04-18T21:06:59.372 INFO:tasks.workunit.client.0.smithi078.stdout:7/366: dread - d1/d16/dc/f5f zero size 2024-04-18T21:06:59.373 INFO:tasks.workunit.client.0.smithi078.stdout:4/386: rename d0/dc/d10/d41/f78 to d0/dc/d29/d6d/f8c 0 2024-04-18T21:06:59.373 INFO:tasks.workunit.client.0.smithi078.stdout:7/367: stat d1/d16/dc/d11/f29 0 2024-04-18T21:06:59.373 INFO:tasks.workunit.client.0.smithi078.stdout:4/387: chown d0/dc/l15 108 1 2024-04-18T21:06:59.373 INFO:tasks.workunit.client.0.smithi078.stdout:7/368: readlink d1/d16/dc/d31/l73 0 2024-04-18T21:06:59.374 INFO:tasks.workunit.client.0.smithi078.stdout:4/388: creat d0/dc/d10/d85/f8d x:0 0 0 2024-04-18T21:06:59.374 INFO:tasks.workunit.client.0.smithi078.stdout:7/369: rename d1/f3 to d1/d16/d10/f8a 0 2024-04-18T21:06:59.375 INFO:tasks.workunit.client.0.smithi078.stdout:7/370: write d1/d16/dc/d11/d53/f58 [943132,28255] 0 2024-04-18T21:06:59.379 INFO:tasks.workunit.client.0.smithi078.stdout:7/371: dread d1/d32/f41 [0,4194304] 0 2024-04-18T21:06:59.379 INFO:tasks.workunit.client.0.smithi078.stdout:7/372: read - d1/d16/d10/d5a/f76 zero size 2024-04-18T21:06:59.380 INFO:tasks.workunit.client.0.smithi078.stdout:4/389: dwrite d0/dc/d29/d2f/f35 [0,4194304] 0 2024-04-18T21:06:59.380 INFO:tasks.workunit.client.0.smithi078.stdout:7/373: write d1/f5e [907705,115317] 0 2024-04-18T21:06:59.381 INFO:tasks.workunit.client.0.smithi078.stdout:4/390: write d0/dc/d10/d1c/d60/f7a [16094,105829] 0 2024-04-18T21:06:59.382 INFO:tasks.workunit.client.0.smithi078.stdout:1/401: write d0/d11/f2e [2338052,103745] 0 2024-04-18T21:06:59.382 INFO:tasks.workunit.client.0.smithi078.stdout:2/354: write d0/d1f/f2b [7133,63109] 0 2024-04-18T21:06:59.383 INFO:tasks.workunit.client.0.smithi078.stdout:4/391: write d0/dc/d29/d6d/d7b/f88 [534867,122712] 0 2024-04-18T21:06:59.383 INFO:tasks.workunit.client.0.smithi078.stdout:0/399: write d0/d9/dd/d17/d2e/f71 [726700,51970] 0 2024-04-18T21:06:59.384 INFO:tasks.workunit.client.0.smithi078.stdout:1/402: write d0/d11/f7f [388633,74583] 0 2024-04-18T21:06:59.385 INFO:tasks.workunit.client.0.smithi078.stdout:0/400: write d0/f8 [9037454,126370] 0 2024-04-18T21:06:59.387 INFO:tasks.workunit.client.0.smithi078.stdout:9/363: dwrite d7/fa [4194304,4194304] 0 2024-04-18T21:06:59.387 INFO:tasks.workunit.client.0.smithi078.stdout:1/403: rename d0/d2a/d3c/d4b/d4/d61/d75/l7c to d0/d2a/d3c/d4b/d4/d61/l90 0 2024-04-18T21:06:59.388 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:59.388 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:06:59.388 INFO:teuthology.orchestra.run.smithi132.stdout: "complaint_time": 30, 2024-04-18T21:06:59.388 INFO:teuthology.orchestra.run.smithi132.stdout: "num_blocked_ops": 0 2024-04-18T21:06:59.388 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:59.389 INFO:tasks.workunit.client.0.smithi078.stdout:9/364: write d7/f59 [989652,60516] 0 2024-04-18T21:06:59.389 INFO:tasks.workunit.client.0.smithi078.stdout:7/374: dwrite d1/d16/dc/d11/f7a [0,4194304] 0 2024-04-18T21:06:59.389 INFO:tasks.workunit.client.0.smithi078.stdout:7/375: sync 2024-04-18T21:06:59.389 INFO:tasks.workunit.client.0.smithi078.stdout:1/404: truncate d0/d11/f7f 472880 0 2024-04-18T21:06:59.389 INFO:tasks.workunit.client.0.smithi078.stdout:1/405: dread d0/d2a/d2f/f56 [0,4194304] 0 2024-04-18T21:06:59.390 INFO:tasks.workunit.client.0.smithi078.stdout:1/406: fsync d0/d2a/d2f/f38 0 2024-04-18T21:06:59.392 INFO:tasks.workunit.client.0.smithi078.stdout:0/401: dwrite d0/d9/d4c/f6a [0,4194304] 0 2024-04-18T21:06:59.392 INFO:tasks.workunit.client.0.smithi078.stdout:9/365: mkdir d7/d23/d7a 0 2024-04-18T21:06:59.392 INFO:tasks.workunit.client.0.smithi078.stdout:7/376: mkdir d1/d16/d10/d5a/d8b 0 2024-04-18T21:06:59.392 INFO:tasks.workunit.client.0.smithi078.stdout:4/392: dread d0/dc/d10/d3a/f59 [0,4194304] 0 2024-04-18T21:06:59.392 INFO:tasks.workunit.client.0.smithi078.stdout:1/407: creat d0/d2a/d3c/d4b/d5e/f91 x:0 0 0 2024-04-18T21:06:59.393 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:06:59.390+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:06:59.394 INFO:tasks.workunit.client.0.smithi078.stdout:0/402: creat d0/d9/d58/f74 x:0 0 0 2024-04-18T21:06:59.394 INFO:tasks.workunit.client.0.smithi078.stdout:1/408: creat d0/d2a/d5f/d89/d32/f92 x:0 0 0 2024-04-18T21:06:59.395 INFO:tasks.workunit.client.0.smithi078.stdout:0/403: sync 2024-04-18T21:06:59.395 INFO:tasks.workunit.client.0.smithi078.stdout:7/377: chown d1/d16/d1c/l3e 52152 1 2024-04-18T21:06:59.395 INFO:tasks.workunit.client.0.smithi078.stdout:7/378: read - d1/d16/dc/d11/d53/f68 zero size 2024-04-18T21:06:59.396 INFO:tasks.workunit.client.0.smithi078.stdout:9/366: mkdir d7/df/d1e/d7b 0 2024-04-18T21:06:59.397 INFO:tasks.workunit.client.0.smithi078.stdout:7/379: write d1/d32/f66 [1125209,103626] 0 2024-04-18T21:06:59.397 INFO:tasks.workunit.client.0.smithi078.stdout:7/380: sync 2024-04-18T21:06:59.397 INFO:tasks.workunit.client.0.smithi078.stdout:2/355: creat d0/db/d18/d21/d27/d29/f6b x:0 0 0 2024-04-18T21:06:59.397 INFO:tasks.workunit.client.0.smithi078.stdout:1/409: link d0/d2a/d5f/d89/d32/d35/l48 d0/d2a/d3c/d4b/d52/l93 0 2024-04-18T21:06:59.398 INFO:tasks.workunit.client.0.smithi078.stdout:9/367: mkdir d7/d11/d2d/d26/d7c 0 2024-04-18T21:06:59.398 INFO:tasks.workunit.client.0.smithi078.stdout:1/410: fdatasync d0/d2a/d3c/f6b 0 2024-04-18T21:06:59.400 INFO:tasks.workunit.client.0.smithi078.stdout:4/393: dwrite d0/dc/d5b/d4f/f77 [0,4194304] 0 2024-04-18T21:06:59.401 INFO:tasks.workunit.client.0.smithi078.stdout:4/394: rename d0/f20 to d0/dc/d10/d1c/f8e 0 2024-04-18T21:06:59.402 INFO:tasks.workunit.client.0.smithi078.stdout:4/395: rename d0/dc/d10/c14 to d0/dc/d29/d6d/d7b/c8f 0 2024-04-18T21:06:59.403 INFO:tasks.workunit.client.0.smithi078.stdout:7/381: dwrite d1/d16/dc/d11/d53/f68 [0,4194304] 0 2024-04-18T21:06:59.404 INFO:tasks.workunit.client.0.smithi078.stdout:4/396: rename d0/f47 to d0/dc/d10/d1c/d60/f90 0 2024-04-18T21:06:59.404 INFO:tasks.workunit.client.0.smithi078.stdout:7/382: mknod d1/d16/d10/d7c/c8c 0 2024-04-18T21:06:59.404 INFO:tasks.workunit.client.0.smithi078.stdout:7/383: fdatasync d1/d32/f5d 0 2024-04-18T21:06:59.405 INFO:tasks.workunit.client.0.smithi078.stdout:4/397: creat d0/dc/d10/d3a/f91 x:0 0 0 2024-04-18T21:06:59.405 INFO:tasks.workunit.client.0.smithi078.stdout:4/398: readlink d0/dc/d10/d41/d5f/l70 0 2024-04-18T21:06:59.409 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:06:59.410 INFO:tasks.workunit.client.0.smithi078.stdout:2/356: dread d0/d1f/f2b [0,4194304] 0 2024-04-18T21:06:59.410 INFO:tasks.workunit.client.0.smithi078.stdout:2/357: readlink d0/db/d18/d21/d27/d29/d57/l66 0 2024-04-18T21:06:59.411 INFO:tasks.workunit.client.0.smithi078.stdout:1/411: read d0/d2a/d5f/d89/f2c [1487902,5837] 0 2024-04-18T21:06:59.411 INFO:tasks.workunit.client.0.smithi078.stdout:0/404: read d0/d9/da/db/d35/f6e [2110028,17600] 0 2024-04-18T21:06:59.411 INFO:tasks.workunit.client.0.smithi078.stdout:4/399: dwrite d0/dc/d29/f51 [4194304,4194304] 0 2024-04-18T21:06:59.412 INFO:tasks.workunit.client.0.smithi078.stdout:1/412: rmdir d0/d2a/d2f/d50/d78 39 2024-04-18T21:06:59.412 INFO:tasks.workunit.client.0.smithi078.stdout:2/358: truncate d0/db/d18/d21/d27/d29/f69 822328 0 2024-04-18T21:06:59.412 INFO:tasks.workunit.client.0.smithi078.stdout:0/405: readlink d0/d9/da/db/lc 0 2024-04-18T21:06:59.412 INFO:tasks.workunit.client.0.smithi078.stdout:3/325: dread d4/da/d11/f21 [0,4194304] 0 2024-04-18T21:06:59.414 INFO:tasks.workunit.client.0.smithi078.stdout:1/413: dread - d0/d2a/d5f/d89/d32/f92 zero size 2024-04-18T21:06:59.414 INFO:tasks.workunit.client.0.smithi078.stdout:0/406: symlink d0/d9/da/db/l75 0 2024-04-18T21:06:59.414 INFO:tasks.workunit.client.0.smithi078.stdout:1/414: chown d0/d2a/d3c/d4b/d4/l5b 475893 1 2024-04-18T21:06:59.414 INFO:tasks.workunit.client.0.smithi078.stdout:3/326: getdents d4/d2d/d30/d35/d4b 0 2024-04-18T21:06:59.415 INFO:tasks.workunit.client.0.smithi078.stdout:3/327: truncate d4/df/d17/f3a 4399751 0 2024-04-18T21:06:59.415 INFO:tasks.workunit.client.0.smithi078.stdout:7/384: dread d1/f18 [0,4194304] 0 2024-04-18T21:06:59.417 INFO:tasks.workunit.client.0.smithi078.stdout:7/385: chown d1/d16/d2d/f47 90970 1 2024-04-18T21:06:59.418 INFO:tasks.workunit.client.0.smithi078.stdout:2/359: dwrite d0/f55 [0,4194304] 0 2024-04-18T21:06:59.418 INFO:tasks.workunit.client.0.smithi078.stdout:7/386: truncate d1/d16/dc/d11/f2e 285301 0 2024-04-18T21:06:59.418 INFO:tasks.workunit.client.0.smithi078.stdout:2/360: truncate d0/f10 4455027 0 2024-04-18T21:06:59.419 INFO:tasks.workunit.client.0.smithi078.stdout:0/407: dwrite d0/d9/da/db/d35/f2b [4194304,4194304] 0 2024-04-18T21:06:59.419 INFO:tasks.workunit.client.0.smithi078.stdout:2/361: chown d0/db/d18/d21/d27/d29/d57 304286 1 2024-04-18T21:06:59.422 INFO:tasks.workunit.client.0.smithi078.stdout:7/387: mknod d1/d16/dc/d11/d53/d82/c8d 0 2024-04-18T21:06:59.422 INFO:tasks.workunit.client.0.smithi078.stdout:7/388: sync 2024-04-18T21:06:59.423 INFO:tasks.workunit.client.0.smithi078.stdout:5/368: dread d9/da/d32/f60 [0,4194304] 0 2024-04-18T21:06:59.425 INFO:tasks.workunit.client.0.smithi078.stdout:0/408: dwrite d0/d9/d58/f74 [0,4194304] 0 2024-04-18T21:06:59.425 INFO:tasks.workunit.client.0.smithi078.stdout:7/389: creat d1/d16/d1c/d40/f8e x:0 0 0 2024-04-18T21:06:59.426 INFO:tasks.workunit.client.0.smithi078.stdout:4/400: truncate d0/dc/d5b/d4f/f77 1504925 0 2024-04-18T21:06:59.426 INFO:tasks.workunit.client.0.smithi078.stdout:3/328: write d4/da/f4a [7976,28146] 0 2024-04-18T21:06:59.426 INFO:tasks.workunit.client.0.smithi078.stdout:5/369: creat d9/d2e/d29/d55/f72 x:0 0 0 2024-04-18T21:06:59.427 INFO:tasks.workunit.client.0.smithi078.stdout:8/309: dread d0/d10/d14/d2d/f35 [0,4194304] 0 2024-04-18T21:06:59.427 INFO:tasks.workunit.client.0.smithi078.stdout:7/390: symlink d1/d16/l8f 0 2024-04-18T21:06:59.427 INFO:tasks.workunit.client.0.smithi078.stdout:5/370: unlink d9/f1e 0 2024-04-18T21:06:59.428 INFO:tasks.workunit.client.0.smithi078.stdout:3/329: rename d4/da/l4d to d4/da/d57/l58 0 2024-04-18T21:06:59.429 INFO:tasks.workunit.client.0.smithi078.stdout:0/409: link d0/d9/d2f/c34 d0/d9/da/df/c76 0 2024-04-18T21:06:59.429 INFO:tasks.workunit.client.0.smithi078.stdout:3/330: sync 2024-04-18T21:06:59.429 INFO:tasks.workunit.client.0.smithi078.stdout:8/310: fdatasync d0/d10/d14/d2d/f35 0 2024-04-18T21:06:59.429 INFO:tasks.workunit.client.0.smithi078.stdout:7/391: creat d1/d32/f90 x:0 0 0 2024-04-18T21:06:59.429 INFO:tasks.workunit.client.0.smithi078.stdout:4/401: link d0/dc/d10/d1c/d6a/d81/f8b d0/dc/d29/f92 0 2024-04-18T21:06:59.430 INFO:tasks.workunit.client.0.smithi078.stdout:8/311: chown d0/d10/d14/l25 11 1 2024-04-18T21:06:59.430 INFO:tasks.workunit.client.0.smithi078.stdout:6/292: dread d2/d6/f1a [0,4194304] 0 2024-04-18T21:06:59.430 INFO:tasks.workunit.client.0.smithi078.stdout:7/392: mkdir d1/d16/dc/d86/d91 0 2024-04-18T21:06:59.430 INFO:tasks.workunit.client.0.smithi078.stdout:6/293: rename d2/d34/d35/d46 to d2/d1c/d63 0 2024-04-18T21:06:59.431 INFO:tasks.workunit.client.0.smithi078.stdout:6/294: rename d2/d6 to d2/d6/dd/d4b/d5d/d64 22 2024-04-18T21:06:59.431 INFO:tasks.workunit.client.0.smithi078.stdout:6/295: fdatasync d2/d6/f16 0 2024-04-18T21:06:59.432 INFO:tasks.workunit.client.0.smithi078.stdout:4/402: symlink d0/dc/d5b/d71/l93 0 2024-04-18T21:06:59.432 INFO:tasks.workunit.client.0.smithi078.stdout:6/296: stat d2 0 2024-04-18T21:06:59.432 INFO:tasks.workunit.client.0.smithi078.stdout:5/371: dread d9/da/d32/f60 [0,4194304] 0 2024-04-18T21:06:59.433 INFO:tasks.workunit.client.0.smithi078.stdout:6/297: chown d2/d1f/f25 138790 1 2024-04-18T21:06:59.433 INFO:tasks.workunit.client.0.smithi078.stdout:7/393: write d1/d16/d10/f19 [3926790,94007] 0 2024-04-18T21:06:59.434 INFO:tasks.workunit.client.0.smithi078.stdout:6/298: mknod d2/d6/dd/d4b/c65 0 2024-04-18T21:06:59.435 INFO:tasks.workunit.client.0.smithi078.stdout:7/394: rmdir d1/d16/d10 39 2024-04-18T21:06:59.436 INFO:tasks.workunit.client.0.smithi078.stdout:0/410: dwrite d0/d9/f57 [0,4194304] 0 2024-04-18T21:06:59.436 INFO:tasks.workunit.client.0.smithi078.stdout:7/395: write d1/d32/f66 [703635,77674] 0 2024-04-18T21:06:59.436 INFO:tasks.workunit.client.0.smithi078.stdout:8/312: dwrite d0/f55 [0,4194304] 0 2024-04-18T21:06:59.437 INFO:tasks.workunit.client.0.smithi078.stdout:0/411: unlink d0/d9/da/db/l75 0 2024-04-18T21:06:59.437 INFO:tasks.workunit.client.0.smithi078.stdout:7/396: creat d1/d16/dc/d86/f92 x:0 0 0 2024-04-18T21:06:59.437 INFO:tasks.workunit.client.0.smithi078.stdout:8/313: symlink d0/d10/l5b 0 2024-04-18T21:06:59.437 INFO:tasks.workunit.client.0.smithi078.stdout:0/412: unlink d0/d9/dd/c61 0 2024-04-18T21:06:59.438 INFO:tasks.workunit.client.0.smithi078.stdout:8/314: chown d0/d10/d14/f29 89296322 1 2024-04-18T21:06:59.438 INFO:tasks.workunit.client.0.smithi078.stdout:0/413: creat d0/d9/f77 x:0 0 0 2024-04-18T21:06:59.438 INFO:tasks.workunit.client.0.smithi078.stdout:8/315: fsync d0/d10/d14/d2a/d41/f4e 0 2024-04-18T21:06:59.440 INFO:tasks.workunit.client.0.smithi078.stdout:0/414: link d0/d9/da/db/d35/f6f d0/d9/da/db/d35/f78 0 2024-04-18T21:06:59.442 INFO:tasks.workunit.client.0.smithi078.stdout:0/415: getdents d0/d9/da/db/d35/d3f 0 2024-04-18T21:06:59.443 INFO:tasks.workunit.client.0.smithi078.stdout:7/397: dwrite d1/d16/dc/d11/f2b [0,4194304] 0 2024-04-18T21:06:59.444 INFO:tasks.workunit.client.0.smithi078.stdout:0/416: mknod d0/d9/da/df/c79 0 2024-04-18T21:06:59.444 INFO:tasks.workunit.client.0.smithi078.stdout:7/398: fsync d1/f80 0 2024-04-18T21:06:59.444 INFO:tasks.workunit.client.0.smithi078.stdout:7/399: rmdir d1/d16/dc/d86 39 2024-04-18T21:06:59.445 INFO:tasks.workunit.client.0.smithi078.stdout:0/417: symlink d0/d6c/l7a 0 2024-04-18T21:06:59.445 INFO:tasks.workunit.client.0.smithi078.stdout:7/400: chown d1/d16/d65 1067351 1 2024-04-18T21:06:59.445 INFO:tasks.workunit.client.0.smithi078.stdout:8/316: dwrite d0/d10/d14/d2d/f35 [4194304,4194304] 0 2024-04-18T21:06:59.446 INFO:tasks.workunit.client.0.smithi078.stdout:7/401: chown d1/d16/d10/f44 90 1 2024-04-18T21:06:59.446 INFO:tasks.workunit.client.0.smithi078.stdout:0/418: getdents d0/d9/dd/d17/d2e/d31 0 2024-04-18T21:06:59.448 INFO:tasks.workunit.client.0.smithi078.stdout:2/362: truncate d0/db/f36 1017727 0 2024-04-18T21:06:59.450 INFO:tasks.workunit.client.0.smithi078.stdout:5/372: rename d9/d2e/d29 to d9/da/d3e/d4c/d6d/d73 0 2024-04-18T21:06:59.450 INFO:tasks.workunit.client.0.smithi078.stdout:6/299: rename d2/d34/l5a to d2/d34/d35/d57/l66 0 2024-04-18T21:06:59.452 INFO:tasks.workunit.client.0.smithi078.stdout:6/300: dread - d2/d34/f56 zero size 2024-04-18T21:06:59.452 INFO:tasks.workunit.client.0.smithi078.stdout:8/317: rename d0/d22/d37 to d0/d5c 0 2024-04-18T21:06:59.453 INFO:tasks.workunit.client.0.smithi078.stdout:3/331: read d4/da/f4a [783623,2493] 0 2024-04-18T21:06:59.454 INFO:tasks.workunit.client.0.smithi078.stdout:6/301: write d2/d6/f14 [1242115,9141] 0 2024-04-18T21:06:59.454 INFO:tasks.workunit.client.0.smithi078.stdout:7/402: rename d1/d16/d2d/c67 to d1/d16/d10/c93 0 2024-04-18T21:06:59.455 INFO:tasks.workunit.client.0.smithi078.stdout:6/302: mkdir d2/d1c/d67 0 2024-04-18T21:06:59.456 INFO:tasks.workunit.client.0.smithi078.stdout:7/403: fdatasync d1/d16/dc/d11/f24 0 2024-04-18T21:06:59.456 INFO:tasks.workunit.client.0.smithi078.stdout:3/332: mkdir d4/d2d/d30/d35/d4b/d59 0 2024-04-18T21:06:59.457 INFO:tasks.workunit.client.0.smithi078.stdout:4/403: dwrite d0/dc/d10/d41/f45 [0,4194304] 0 2024-04-18T21:06:59.458 INFO:tasks.workunit.client.0.smithi078.stdout:2/363: dwrite d0/db/d18/d21/d27/d29/d33/f4c [0,4194304] 0 2024-04-18T21:06:59.459 INFO:tasks.workunit.client.0.smithi078.stdout:3/333: truncate d4/df/d17/d41/f44 1364249 0 2024-04-18T21:06:59.460 INFO:tasks.workunit.client.0.smithi078.stdout:4/404: unlink d0/dc/d10/d41/f4a 0 2024-04-18T21:06:59.460 INFO:tasks.workunit.client.0.smithi078.stdout:6/303: link d2/d1c/f53 d2/d6/dd/f68 0 2024-04-18T21:06:59.461 INFO:tasks.workunit.client.0.smithi078.stdout:8/318: dwrite d0/fd [4194304,4194304] 0 2024-04-18T21:06:59.461 INFO:tasks.workunit.client.0.smithi078.stdout:6/304: truncate d2/d1f/f47 343490 0 2024-04-18T21:06:59.461 INFO:tasks.workunit.client.0.smithi078.stdout:9/368: dread d7/f24 [0,4194304] 0 2024-04-18T21:06:59.462 INFO:tasks.workunit.client.0.smithi078.stdout:8/319: write d0/f1f [1666082,28827] 0 2024-04-18T21:06:59.462 INFO:tasks.workunit.client.0.smithi078.stdout:6/305: write d2/d1f/f2c [2834493,62545] 0 2024-04-18T21:06:59.463 INFO:tasks.workunit.client.0.smithi078.stdout:8/320: mknod d0/d5c/c5d 0 2024-04-18T21:06:59.463 INFO:tasks.workunit.client.0.smithi078.stdout:9/369: readlink d7/d11/d47/l49 0 2024-04-18T21:06:59.463 INFO:tasks.workunit.client.0.smithi078.stdout:6/306: unlink d2/d6/dd/f4a 0 2024-04-18T21:06:59.463 INFO:tasks.workunit.client.0.smithi078.stdout:8/321: write d0/fb [6268118,1859] 0 2024-04-18T21:06:59.464 INFO:tasks.workunit.client.0.smithi078.stdout:9/370: readlink d7/df/l76 0 2024-04-18T21:06:59.464 INFO:tasks.workunit.client.0.smithi078.stdout:6/307: read - d2/d6/f59 zero size 2024-04-18T21:06:59.464 INFO:tasks.workunit.client.0.smithi078.stdout:9/371: creat d7/df/d54/f7d x:0 0 0 2024-04-18T21:06:59.464 INFO:tasks.workunit.client.0.smithi078.stdout:6/308: write d2/d1c/f22 [8899782,57141] 0 2024-04-18T21:06:59.465 INFO:tasks.workunit.client.0.smithi078.stdout:8/322: symlink d0/d10/d14/d2a/d3a/l5e 0 2024-04-18T21:06:59.465 INFO:tasks.workunit.client.0.smithi078.stdout:6/309: readlink d2/d6/dd/l43 0 2024-04-18T21:06:59.465 INFO:tasks.workunit.client.0.smithi078.stdout:9/372: creat d7/df/d1e/f7e x:0 0 0 2024-04-18T21:06:59.465 INFO:tasks.workunit.client.0.smithi078.stdout:8/323: rmdir d0/d10/d14/d2a/d3a/d59 0 2024-04-18T21:06:59.466 INFO:tasks.workunit.client.0.smithi078.stdout:9/373: rename d7/df/l76 to d7/d11/d2d/d26/l7f 0 2024-04-18T21:06:59.466 INFO:tasks.workunit.client.0.smithi078.stdout:8/324: mknod d0/d10/d14/d2a/d4a/c5f 0 2024-04-18T21:06:59.467 INFO:tasks.workunit.client.0.smithi078.stdout:9/374: write d7/df/f42 [389253,32292] 0 2024-04-18T21:06:59.468 INFO:tasks.workunit.client.0.smithi078.stdout:9/375: fsync d7/d11/d1b/d45/d4b/d5d/f66 0 2024-04-18T21:06:59.468 INFO:tasks.workunit.client.0.smithi078.stdout:9/376: chown d7/d11/d47/l49 984007831 1 2024-04-18T21:06:59.472 INFO:tasks.workunit.client.0.smithi078.stdout:0/419: getdents d0/d9/dd 0 2024-04-18T21:06:59.472 INFO:tasks.workunit.client.0.smithi078.stdout:8/325: dwrite d0/fd [4194304,4194304] 0 2024-04-18T21:06:59.473 INFO:tasks.workunit.client.0.smithi078.stdout:0/420: write d0/d9/da/db/f4d [713346,57639] 0 2024-04-18T21:06:59.473 INFO:tasks.workunit.client.0.smithi078.stdout:8/326: mkdir d0/d10/d60 0 2024-04-18T21:06:59.474 INFO:tasks.workunit.client.0.smithi078.stdout:1/415: dread d0/d11/f2e [0,4194304] 0 2024-04-18T21:06:59.476 INFO:tasks.workunit.client.0.smithi078.stdout:1/416: dread d0/d2a/d5f/d89/d32/f67 [0,4194304] 0 2024-04-18T21:06:59.478 INFO:tasks.workunit.client.0.smithi078.stdout:1/417: dread - d0/d2a/d5f/d89/d77/f8c zero size 2024-04-18T21:06:59.479 INFO:tasks.workunit.client.0.smithi078.stdout:7/404: truncate d1/f3c 263957 0 2024-04-18T21:06:59.479 INFO:tasks.workunit.client.0.smithi078.stdout:2/364: truncate d0/f10 2821968 0 2024-04-18T21:06:59.479 INFO:tasks.workunit.client.0.smithi078.stdout:4/405: write d0/dc/d10/d1c/f67 [1266337,57706] 0 2024-04-18T21:06:59.480 INFO:tasks.workunit.client.0.smithi078.stdout:1/418: symlink d0/d11/d69/l94 0 2024-04-18T21:06:59.480 INFO:tasks.workunit.client.0.smithi078.stdout:5/373: dread d9/da/f1b [0,4194304] 0 2024-04-18T21:06:59.481 INFO:tasks.workunit.client.0.smithi078.stdout:0/421: dwrite d0/d9/da/db/d35/d3f/f41 [0,4194304] 0 2024-04-18T21:06:59.481 INFO:tasks.workunit.client.0.smithi078.stdout:7/405: dread - d1/d16/dc/d11/f69 zero size 2024-04-18T21:06:59.482 INFO:tasks.workunit.client.0.smithi078.stdout:4/406: write d0/f58 [10454,16249] 0 2024-04-18T21:06:59.482 INFO:tasks.workunit.client.0.smithi078.stdout:5/374: chown d9/da/d3e/d4c/l5e 20746 1 2024-04-18T21:06:59.482 INFO:tasks.workunit.client.0.smithi078.stdout:8/327: dwrite d0/d10/d14/d2d/f31 [0,4194304] 0 2024-04-18T21:06:59.482 INFO:tasks.workunit.client.0.smithi078.stdout:0/422: write d0/d9/da/db/f33 [3450042,17707] 0 2024-04-18T21:06:59.483 INFO:tasks.workunit.client.0.smithi078.stdout:0/423: read - d0/d9/da/f59 zero size 2024-04-18T21:06:59.484 INFO:tasks.workunit.client.0.smithi078.stdout:1/419: mknod d0/d2a/d3c/d4b/d4/d61/c95 0 2024-04-18T21:06:59.484 INFO:tasks.workunit.client.0.smithi078.stdout:4/407: mknod d0/dc/d5b/d4f/c94 0 2024-04-18T21:06:59.484 INFO:tasks.workunit.client.0.smithi078.stdout:2/365: symlink d0/db/d18/d5d/l6c 0 2024-04-18T21:06:59.484 INFO:tasks.workunit.client.0.smithi078.stdout:8/328: truncate d0/d5c/f48 21137 0 2024-04-18T21:06:59.485 INFO:tasks.workunit.client.0.smithi078.stdout:1/420: symlink d0/d2a/d5f/d89/d32/d35/d71/l96 0 2024-04-18T21:06:59.486 INFO:tasks.workunit.client.0.smithi078.stdout:0/424: rename d0/d9/da/db/d35/c1e to d0/d9/d2f/c7b 0 2024-04-18T21:06:59.486 INFO:tasks.workunit.client.0.smithi078.stdout:1/421: creat d0/d11/d69/f97 x:0 0 0 2024-04-18T21:06:59.487 INFO:tasks.workunit.client.0.smithi078.stdout:0/425: creat d0/d9/d4c/d70/f7c x:0 0 0 2024-04-18T21:06:59.487 INFO:tasks.workunit.client.0.smithi078.stdout:1/422: truncate d0/d2a/d45/f5c 217986 0 2024-04-18T21:06:59.488 INFO:tasks.workunit.client.0.smithi078.stdout:1/423: unlink d0/l43 0 2024-04-18T21:06:59.489 INFO:tasks.workunit.client.0.smithi078.stdout:0/426: getdents d0/d9/dd/d17/d2e/d31 0 2024-04-18T21:06:59.489 INFO:tasks.workunit.client.0.smithi078.stdout:1/424: unlink d0/d2a/d3c/d4b/d5e/f91 0 2024-04-18T21:06:59.490 INFO:tasks.workunit.client.0.smithi078.stdout:1/425: chown d0/d2a/d3c/d4b 97 1 2024-04-18T21:06:59.491 INFO:tasks.workunit.client.0.smithi078.stdout:2/366: dwrite d0/d1f/f44 [4194304,4194304] 0 2024-04-18T21:06:59.493 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:59.490+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:59.494 INFO:tasks.workunit.client.0.smithi078.stdout:1/426: link d0/d2a/d5f/d89/f49 d0/d2a/d5f/d89/d32/d35/f98 0 2024-04-18T21:06:59.494 INFO:tasks.workunit.client.0.smithi078.stdout:2/367: getdents d0/d1f/d34/d40/d59 0 2024-04-18T21:06:59.495 INFO:tasks.workunit.client.0.smithi078.stdout:2/368: rename d0/c1b to d0/db/d18/d5d/c6d 0 2024-04-18T21:06:59.498 INFO:tasks.workunit.client.0.smithi078.stdout:4/408: truncate d0/dc/d10/d1c/f67 1112697 0 2024-04-18T21:06:59.498 INFO:tasks.workunit.client.0.smithi078.stdout:0/427: truncate d0/d9/da/f42 469256 0 2024-04-18T21:06:59.499 INFO:tasks.workunit.client.0.smithi078.stdout:4/409: unlink d0/f84 0 2024-04-18T21:06:59.500 INFO:tasks.workunit.client.0.smithi078.stdout:4/410: creat d0/dc/d10/f95 x:0 0 0 2024-04-18T21:06:59.500 INFO:tasks.workunit.client.0.smithi078.stdout:0/428: read d0/d9/da/db/d35/f4b [456119,17535] 0 2024-04-18T21:06:59.502 INFO:tasks.workunit.client.0.smithi078.stdout:7/406: dwrite d1/f20 [4194304,4194304] 0 2024-04-18T21:06:59.503 INFO:tasks.workunit.client.0.smithi078.stdout:7/407: truncate d1/d16/d65/f79 507190 0 2024-04-18T21:06:59.503 INFO:tasks.workunit.client.0.smithi078.stdout:6/310: dread d2/d1f/f2e [0,4194304] 0 2024-04-18T21:06:59.503 INFO:tasks.workunit.client.0.smithi078.stdout:6/311: readlink d2/d6/dd/l43 0 2024-04-18T21:06:59.504 INFO:tasks.workunit.client.0.smithi078.stdout:6/312: chown d2/d34/d35/c3f 580213 1 2024-04-18T21:06:59.504 INFO:tasks.workunit.client.0.smithi078.stdout:6/313: readlink d2/d1f/l2d 0 2024-04-18T21:06:59.505 INFO:tasks.workunit.client.0.smithi078.stdout:3/334: dread d4/da/d11/f32 [0,4194304] 0 2024-04-18T21:06:59.505 INFO:tasks.workunit.client.0.smithi078.stdout:3/335: chown d4/d2d/d30/l3d 2741628 1 2024-04-18T21:06:59.505 INFO:tasks.workunit.client.0.smithi078.stdout:4/411: rename d0/dc/d5b/d71/c54 to d0/dc/d10/d1c/d60/d74/c96 0 2024-04-18T21:06:59.507 INFO:tasks.workunit.client.0.smithi078.stdout:6/314: getdents d2/d34 0 2024-04-18T21:06:59.507 INFO:tasks.workunit.client.0.smithi078.stdout:3/336: creat d4/df/d17/f5a x:0 0 0 2024-04-18T21:06:59.507 INFO:tasks.workunit.client.0.smithi078.stdout:9/377: dread d7/df/f10 [0,4194304] 0 2024-04-18T21:06:59.507 INFO:tasks.workunit.client.0.smithi078.stdout:6/315: write d2/d6/dd/f42 [184968,91422] 0 2024-04-18T21:06:59.508 INFO:tasks.workunit.client.0.smithi078.stdout:9/378: write d7/d11/d2d/f3a [1933059,61968] 0 2024-04-18T21:06:59.508 INFO:tasks.workunit.client.0.smithi078.stdout:9/379: readlink d7/d11/d2d/l79 0 2024-04-18T21:06:59.509 INFO:tasks.workunit.client.0.smithi078.stdout:6/316: creat d2/d6/dd/f69 x:0 0 0 2024-04-18T21:06:59.511 INFO:tasks.workunit.client.0.smithi078.stdout:8/329: dread d0/fb [4194304,4194304] 0 2024-04-18T21:06:59.512 INFO:tasks.workunit.client.0.smithi078.stdout:8/330: write d0/d10/d14/d2d/f3f [601601,128736] 0 2024-04-18T21:06:59.513 INFO:tasks.workunit.client.0.smithi078.stdout:3/337: dwrite d4/df/f1f [0,4194304] 0 2024-04-18T21:06:59.514 INFO:tasks.workunit.client.0.smithi078.stdout:1/427: truncate d0/d2a/d5f/d89/d32/d35/f6d 1103017 0 2024-04-18T21:06:59.515 INFO:tasks.workunit.client.0.smithi078.stdout:1/428: creat d0/d2a/d5f/d89/d32/d35/f99 x:0 0 0 2024-04-18T21:06:59.516 INFO:tasks.workunit.client.0.smithi078.stdout:2/369: mkdir d0/db/d6e 0 2024-04-18T21:06:59.516 INFO:tasks.workunit.client.0.smithi078.stdout:1/429: stat d0/d2a/d5f/f83 0 2024-04-18T21:06:59.517 INFO:tasks.workunit.client.0.smithi078.stdout:3/338: dread d4/da/d11/f32 [0,4194304] 0 2024-04-18T21:06:59.519 INFO:tasks.workunit.client.0.smithi078.stdout:3/339: mknod d4/d2d/d30/c5b 0 2024-04-18T21:06:59.519 INFO:tasks.workunit.client.0.smithi078.stdout:4/412: truncate d0/dc/d10/d41/d5f/f6b 1695900 0 2024-04-18T21:06:59.519 INFO:tasks.workunit.client.0.smithi078.stdout:8/331: dwrite d0/d10/d14/d2d/f35 [0,4194304] 0 2024-04-18T21:06:59.520 INFO:tasks.workunit.client.0.smithi078.stdout:8/332: fsync d0/d10/d14/f58 0 2024-04-18T21:06:59.522 INFO:tasks.workunit.client.0.smithi078.stdout:4/413: symlink d0/dc/d37/l97 0 2024-04-18T21:06:59.522 INFO:tasks.workunit.client.0.smithi078.stdout:3/340: stat d4/df/l50 0 2024-04-18T21:06:59.522 INFO:tasks.workunit.client.0.smithi078.stdout:2/370: dwrite d0/db/d18/d21/d27/f56 [0,4194304] 0 2024-04-18T21:06:59.522 INFO:tasks.workunit.client.0.smithi078.stdout:1/430: dwrite d0/d11/f2d [0,4194304] 0 2024-04-18T21:06:59.524 INFO:tasks.workunit.client.0.smithi078.stdout:1/431: write d0/d2a/d5f/d89/f17 [1457396,10836] 0 2024-04-18T21:06:59.524 INFO:tasks.workunit.client.0.smithi078.stdout:2/371: write d0/db/d18/d21/d27/d29/f2d [3244552,66202] 0 2024-04-18T21:06:59.525 INFO:tasks.workunit.client.0.smithi078.stdout:1/432: creat d0/d2a/d2f/f9a x:0 0 0 2024-04-18T21:06:59.525 INFO:tasks.workunit.client.0.smithi078.stdout:2/372: symlink d0/db/d6e/l6f 0 2024-04-18T21:06:59.525 INFO:tasks.workunit.client.0.smithi078.stdout:9/380: write d7/d11/d1b/f5f [2562231,46530] 0 2024-04-18T21:06:59.526 INFO:tasks.workunit.client.0.smithi078.stdout:9/381: truncate d7/f6d 786287 0 2024-04-18T21:06:59.526 INFO:tasks.workunit.client.0.smithi078.stdout:2/373: write d0/db/d18/d21/d27/d29/d33/f6a [383538,57432] 0 2024-04-18T21:06:59.527 INFO:tasks.workunit.client.0.smithi078.stdout:9/382: write d7/f24 [80286,90428] 0 2024-04-18T21:06:59.527 INFO:tasks.workunit.client.0.smithi078.stdout:5/375: sync 2024-04-18T21:06:59.527 INFO:tasks.workunit.client.0.smithi078.stdout:7/408: sync 2024-04-18T21:06:59.528 INFO:tasks.workunit.client.0.smithi078.stdout:5/376: mknod d9/da/d3e/d4c/d53/c74 0 2024-04-18T21:06:59.528 INFO:tasks.workunit.client.0.smithi078.stdout:7/409: write d1/d16/dc/d11/d53/f68 [4902983,118695] 0 2024-04-18T21:06:59.533 INFO:tasks.workunit.client.0.smithi078.stdout:9/383: truncate d7/df/f21 729382 0 2024-04-18T21:06:59.534 INFO:tasks.workunit.client.0.smithi078.stdout:5/377: dwrite d9/da/d3e/d4c/f5a [0,4194304] 0 2024-04-18T21:06:59.536 INFO:tasks.workunit.client.0.smithi078.stdout:3/341: read d4/da/d11/f2c [2353581,25261] 0 2024-04-18T21:06:59.537 INFO:tasks.workunit.client.0.smithi078.stdout:3/342: write d4/df/d17/d41/f44 [1544049,89104] 0 2024-04-18T21:06:59.539 INFO:tasks.workunit.client.0.smithi078.stdout:9/384: dwrite d7/d11/d2d/f3a [0,4194304] 0 2024-04-18T21:06:59.540 INFO:tasks.workunit.client.0.smithi078.stdout:9/385: mkdir d7/d11/d80 0 2024-04-18T21:06:59.541 INFO:tasks.workunit.client.0.smithi078.stdout:9/386: symlink d7/d11/d2d/d26/d7c/l81 0 2024-04-18T21:06:59.542 INFO:tasks.workunit.client.0.smithi078.stdout:9/387: write d7/d11/d47/f5c [711114,103334] 0 2024-04-18T21:06:59.543 INFO:tasks.workunit.client.0.smithi078.stdout:9/388: stat d7/d11/d2d/f4e 0 2024-04-18T21:06:59.544 INFO:tasks.workunit.client.0.smithi078.stdout:9/389: symlink d7/d11/d1b/d77/l82 0 2024-04-18T21:06:59.544 INFO:tasks.workunit.client.0.smithi078.stdout:9/390: readlink d7/d11/l29 0 2024-04-18T21:06:59.545 INFO:tasks.workunit.client.0.smithi078.stdout:3/343: dwrite d4/da/d11/f21 [4194304,4194304] 0 2024-04-18T21:06:59.545 INFO:tasks.workunit.client.0.smithi078.stdout:4/414: dread d0/f2c [0,4194304] 0 2024-04-18T21:06:59.546 INFO:tasks.workunit.client.0.smithi078.stdout:9/391: write d7/d11/d1b/d45/d4b/f5b [354161,85957] 0 2024-04-18T21:06:59.546 INFO:tasks.workunit.client.0.smithi078.stdout:4/415: fsync d0/dc/d10/d3a/d7e/f86 0 2024-04-18T21:06:59.547 INFO:tasks.workunit.client.0.smithi078.stdout:3/344: symlink d4/d2d/l5c 0 2024-04-18T21:06:59.547 INFO:tasks.workunit.client.0.smithi078.stdout:4/416: rename d0/dc/d10/d41/d5f/f6b to d0/dc/d10/d41/d5f/f98 0 2024-04-18T21:06:59.548 INFO:tasks.workunit.client.0.smithi078.stdout:3/345: creat d4/d2d/f5d x:0 0 0 2024-04-18T21:06:59.549 INFO:tasks.workunit.client.0.smithi078.stdout:4/417: mknod d0/dc/d10/d1c/d60/c99 0 2024-04-18T21:06:59.549 INFO:tasks.workunit.client.0.smithi078.stdout:3/346: mkdir d4/da/d5e 0 2024-04-18T21:06:59.549 INFO:tasks.workunit.client.0.smithi078.stdout:4/418: stat d0 0 2024-04-18T21:06:59.550 INFO:tasks.workunit.client.0.smithi078.stdout:4/419: fdatasync d0/f28 0 2024-04-18T21:06:59.550 INFO:tasks.workunit.client.0.smithi078.stdout:3/347: creat d4/d2d/d30/d35/d4b/d59/f5f x:0 0 0 2024-04-18T21:06:59.551 INFO:tasks.workunit.client.0.smithi078.stdout:3/348: creat d4/d2d/d30/f60 x:0 0 0 2024-04-18T21:06:59.551 INFO:tasks.workunit.client.0.smithi078.stdout:9/392: dwrite d7/df/f42 [0,4194304] 0 2024-04-18T21:06:59.552 INFO:tasks.workunit.client.0.smithi078.stdout:6/317: sync 2024-04-18T21:06:59.552 INFO:tasks.workunit.client.0.smithi078.stdout:9/393: mkdir d7/d83 0 2024-04-18T21:06:59.553 INFO:tasks.workunit.client.0.smithi078.stdout:9/394: write d7/d23/f75 [1976056,13921] 0 2024-04-18T21:06:59.555 INFO:tasks.workunit.client.0.smithi078.stdout:9/395: creat d7/d11/d1b/f84 x:0 0 0 2024-04-18T21:06:59.556 INFO:tasks.workunit.client.0.smithi078.stdout:9/396: creat d7/df/d54/f85 x:0 0 0 2024-04-18T21:06:59.556 INFO:tasks.workunit.client.0.smithi078.stdout:0/429: dread d0/d9/da/db/d35/f6e [0,4194304] 0 2024-04-18T21:06:59.556 INFO:tasks.workunit.client.0.smithi078.stdout:9/397: creat d7/f86 x:0 0 0 2024-04-18T21:06:59.557 INFO:tasks.workunit.client.0.smithi078.stdout:0/430: mkdir d0/d9/d7d 0 2024-04-18T21:06:59.558 INFO:tasks.workunit.client.0.smithi078.stdout:3/349: dwrite d4/d2d/d30/d35/f33 [0,4194304] 0 2024-04-18T21:06:59.558 INFO:tasks.workunit.client.0.smithi078.stdout:0/431: creat d0/d9/d58/f7e x:0 0 0 2024-04-18T21:06:59.559 INFO:tasks.workunit.client.0.smithi078.stdout:0/432: fdatasync d0/d9/dd/d17/d2e/d31/f4a 0 2024-04-18T21:06:59.560 INFO:tasks.workunit.client.0.smithi078.stdout:0/433: chown d0/d9/dd/d17/d2e/d46/c49 2725894 1 2024-04-18T21:06:59.561 INFO:tasks.workunit.client.0.smithi078.stdout:9/398: read d7/df/f13 [1889017,9918] 0 2024-04-18T21:06:59.562 INFO:tasks.workunit.client.0.smithi078.stdout:8/333: dread d0/f2c [0,4194304] 0 2024-04-18T21:06:59.563 INFO:tasks.workunit.client.0.smithi078.stdout:9/399: truncate d7/d11/d1b/d45/d4b/d5d/f66 3276048 0 2024-04-18T21:06:59.563 INFO:tasks.workunit.client.0.smithi078.stdout:9/400: fdatasync d7/f6d 0 2024-04-18T21:06:59.564 INFO:tasks.workunit.client.0.smithi078.stdout:9/401: creat d7/d11/d1b/d77/f87 x:0 0 0 2024-04-18T21:06:59.565 INFO:tasks.workunit.client.0.smithi078.stdout:6/318: dread d2/d6/dd/f42 [0,4194304] 0 2024-04-18T21:06:59.566 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:06:59.566 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 20, 2024-04-18T21:06:59.566 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 600, 2024-04-18T21:06:59.566 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [ 2024-04-18T21:06:59.566 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.566 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:59.566 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:59.567 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 113.95028845, 2024-04-18T21:06:59.567 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043251955000000002, 2024-04-18T21:06:59.567 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:59.567 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:59.567 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:59.567 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:59.567 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.567 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:59.567 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:59.567 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.567 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.567 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.567 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:59.567 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:06:59.568 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.568 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.568 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.568 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:59.568 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616536+0000", 2024-04-18T21:06:59.568 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2869999999999999e-06 2024-04-18T21:06:59.568 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.568 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.568 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:59.568 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616572+0000", 2024-04-18T21:06:59.568 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.6261999999999999e-05 2024-04-18T21:06:59.568 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.568 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.568 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:59.568 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616593+0000", 2024-04-18T21:06:59.569 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1310000000000001e-05 2024-04-18T21:06:59.569 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.569 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.569 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:59.569 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616614+0000", 2024-04-18T21:06:59.569 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.0936000000000001e-05 2024-04-18T21:06:59.569 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.569 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.569 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:59.569 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629501+0000", 2024-04-18T21:06:59.569 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.012886819000000001 2024-04-18T21:06:59.569 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.569 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.569 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:59.569 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629696+0000", 2024-04-18T21:06:59.570 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019485499999999999 2024-04-18T21:06:59.570 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.570 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.570 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:59.570 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629940+0000", 2024-04-18T21:06:59.570 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00024386399999999999 2024-04-18T21:06:59.570 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.570 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.570 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:59.570 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640100+0000", 2024-04-18T21:06:59.570 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010159645 2024-04-18T21:06:59.570 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.570 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.570 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:59.571 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659516+0000", 2024-04-18T21:06:59.571 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019416563000000001 2024-04-18T21:06:59.571 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.571 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.571 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:59.571 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659684+0000", 2024-04-18T21:06:59.571 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016750900000000001 2024-04-18T21:06:59.571 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.571 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.571 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:59.571 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659787+0000", 2024-04-18T21:06:59.571 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000102905 2024-04-18T21:06:59.571 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.571 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:59.571 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.571 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.572 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.572 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:59.572 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:59.572 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 113.95018332799999, 2024-04-18T21:06:59.572 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043581898000000001, 2024-04-18T21:06:59.572 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:59.572 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:59.572 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:59.572 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:59.572 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.572 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:59.572 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:59.572 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.572 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.572 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.572 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:59.573 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:06:59.573 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.573 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.573 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.573 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:59.573 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616641+0000", 2024-04-18T21:06:59.573 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:06:59.573 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.573 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.573 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:59.573 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616648+0000", 2024-04-18T21:06:59.573 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3860000000000001e-06 2024-04-18T21:06:59.573 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.573 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.573 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:59.573 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616666+0000", 2024-04-18T21:06:59.574 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7583000000000001e-05 2024-04-18T21:06:59.574 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.574 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.574 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:59.574 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616679+0000", 2024-04-18T21:06:59.574 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3322999999999999e-05 2024-04-18T21:06:59.574 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.574 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.574 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:59.574 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630373+0000", 2024-04-18T21:06:59.574 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013694207999999999 2024-04-18T21:06:59.574 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.574 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.575 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:59.575 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630545+0000", 2024-04-18T21:06:59.575 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000171683 2024-04-18T21:06:59.575 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.575 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.575 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:59.575 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630728+0000", 2024-04-18T21:06:59.575 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000182599 2024-04-18T21:06:59.575 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.575 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.575 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:59.575 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640600+0000", 2024-04-18T21:06:59.575 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0098726119999999994 2024-04-18T21:06:59.575 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.575 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.576 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:59.576 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659927+0000", 2024-04-18T21:06:59.576 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019326724999999999 2024-04-18T21:06:59.576 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.576 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.576 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:59.576 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660112+0000", 2024-04-18T21:06:59.576 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000185203 2024-04-18T21:06:59.576 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.576 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.576 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:59.576 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660222+0000", 2024-04-18T21:06:59.576 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109343 2024-04-18T21:06:59.576 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.576 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:59.576 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.577 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.577 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.577 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:06:59.577 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:59.577 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 113.94931797, 2024-04-18T21:06:59.577 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043121310000000003, 2024-04-18T21:06:59.577 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:59.577 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:59.577 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:59.577 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:59.577 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.577 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:59.577 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:59.577 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.577 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.578 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.578 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:59.578 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:06:59.578 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.578 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.578 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.578 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:59.578 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617506+0000", 2024-04-18T21:06:59.578 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9999999999999995e-07 2024-04-18T21:06:59.578 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.578 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.578 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:59.578 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617513+0000", 2024-04-18T21:06:59.578 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.9700000000000002e-06 2024-04-18T21:06:59.578 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.579 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.579 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:59.579 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617531+0000", 2024-04-18T21:06:59.579 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8105999999999999e-05 2024-04-18T21:06:59.579 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.579 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.579 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:59.579 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617545+0000", 2024-04-18T21:06:59.579 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3703000000000001e-05 2024-04-18T21:06:59.579 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.579 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.579 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:59.579 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632129+0000", 2024-04-18T21:06:59.579 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.014584135999999999 2024-04-18T21:06:59.580 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.580 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.580 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:59.580 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632361+0000", 2024-04-18T21:06:59.580 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023171800000000001 2024-04-18T21:06:59.580 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.580 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.580 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:06:59.580 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632804+0000", 2024-04-18T21:06:59.580 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000443549 2024-04-18T21:06:59.580 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.580 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.580 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:59.580 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646340+0000", 2024-04-18T21:06:59.580 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013535902000000001 2024-04-18T21:06:59.580 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.580 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.581 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:59.581 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660363+0000", 2024-04-18T21:06:59.581 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01402318 2024-04-18T21:06:59.581 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.581 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.581 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:59.581 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660523+0000", 2024-04-18T21:06:59.581 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00015989899999999999 2024-04-18T21:06:59.581 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.581 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.581 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:59.581 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660626+0000", 2024-04-18T21:06:59.581 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010314699999999999 2024-04-18T21:06:59.581 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.581 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:59.581 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.582 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.582 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.582 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11157 4.24 4:26c08ea6:::100000030ca.00000000:head [write 0~4194304 [4@445255]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T21:06:59.582 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:58.275106+0000", 2024-04-18T21:06:59.582 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 1.291717155, 2024-04-18T21:06:59.582 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.039836415999999999, 2024-04-18T21:06:59.582 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:59.582 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:59.582 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:59.582 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:59.582 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:06:59.582 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:59.582 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11157 2024-04-18T21:06:59.582 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.582 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:59.583 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.583 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:59.583 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.275106+0000", 2024-04-18T21:06:59.583 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.583 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.583 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.583 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:59.583 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.275106+0000", 2024-04-18T21:06:59.583 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.583 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.583 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.583 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:59.583 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.275109+0000", 2024-04-18T21:06:59.583 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.9069999999999999e-06 2024-04-18T21:06:59.583 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.584 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.584 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:59.584 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.283969+0000", 2024-04-18T21:06:59.584 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0088600539999999992 2024-04-18T21:06:59.584 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.584 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.584 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:59.584 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.283998+0000", 2024-04-18T21:06:59.584 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.955e-05 2024-04-18T21:06:59.584 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.584 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.584 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:59.584 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.284013+0000", 2024-04-18T21:06:59.584 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4776e-05 2024-04-18T21:06:59.584 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.584 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.585 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:59.585 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.284160+0000", 2024-04-18T21:06:59.585 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000146558 2024-04-18T21:06:59.585 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.585 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.585 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:59.585 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.284375+0000", 2024-04-18T21:06:59.585 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00021484799999999999 2024-04-18T21:06:59.585 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.585 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.585 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:59.585 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.314661+0000", 2024-04-18T21:06:59.585 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030286160999999999 2024-04-18T21:06:59.585 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.585 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.586 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:59.586 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.314788+0000", 2024-04-18T21:06:59.586 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000126981 2024-04-18T21:06:59.586 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.586 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.586 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:59.586 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.314942+0000", 2024-04-18T21:06:59.586 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00015458099999999999 2024-04-18T21:06:59.586 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.586 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:59.586 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.586 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.586 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.586 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11357 4.38 4:1d691e75:::1000000312c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T21:06:59.586 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:58.595279+0000", 2024-04-18T21:06:59.586 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.97154441800000002, 2024-04-18T21:06:59.587 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.045901399000000002, 2024-04-18T21:06:59.587 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:59.587 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:59.587 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:59.587 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:59.587 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:06:59.587 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:59.587 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11357 2024-04-18T21:06:59.587 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.587 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:59.587 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.587 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:59.587 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.595279+0000", 2024-04-18T21:06:59.587 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.588 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.588 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.588 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:59.588 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.595279+0000", 2024-04-18T21:06:59.588 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.588 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.588 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.588 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:59.588 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.595280+0000", 2024-04-18T21:06:59.588 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.079e-06 2024-04-18T21:06:59.588 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.588 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.588 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:59.588 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600237+0000", 2024-04-18T21:06:59.589 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0049569089999999998 2024-04-18T21:06:59.589 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.589 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.589 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:59.589 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600254+0000", 2024-04-18T21:06:59.589 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7399000000000001e-05 2024-04-18T21:06:59.589 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.589 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.589 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:59.589 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600262+0000", 2024-04-18T21:06:59.589 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.174e-06 2024-04-18T21:06:59.589 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.589 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.589 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:59.589 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600359+0000", 2024-04-18T21:06:59.590 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.6358000000000001e-05 2024-04-18T21:06:59.590 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.590 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.590 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:59.590 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600507+0000", 2024-04-18T21:06:59.590 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014854199999999999 2024-04-18T21:06:59.590 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.590 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.590 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:59.590 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600748+0000", 2024-04-18T21:06:59.590 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000241361 2024-04-18T21:06:59.590 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.590 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.591 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:59.591 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.615590+0000", 2024-04-18T21:06:59.591 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.014841851 2024-04-18T21:06:59.591 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.591 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.591 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:59.591 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.639817+0000", 2024-04-18T21:06:59.591 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024226527000000001 2024-04-18T21:06:59.591 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.591 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.591 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:59.591 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.640962+0000", 2024-04-18T21:06:59.591 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001145561 2024-04-18T21:06:59.591 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.592 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.592 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:59.592 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.641180+0000", 2024-04-18T21:06:59.592 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00021763800000000001 2024-04-18T21:06:59.592 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.592 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:59.592 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.592 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.592 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.592 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11358 4.29 4:9445c8ea:::1000000317b.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T21:06:59.592 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:58.600285+0000", 2024-04-18T21:06:59.592 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.96653769599999995, 2024-04-18T21:06:59.592 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.040600426000000002, 2024-04-18T21:06:59.592 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:59.592 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:59.592 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:59.592 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:59.593 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:06:59.593 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:59.593 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11358 2024-04-18T21:06:59.593 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.593 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:59.593 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.593 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:59.593 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600285+0000", 2024-04-18T21:06:59.593 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.593 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.593 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.593 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:59.593 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600285+0000", 2024-04-18T21:06:59.593 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.593 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.594 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.594 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:59.594 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600286+0000", 2024-04-18T21:06:59.594 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.3099999999999996e-07 2024-04-18T21:06:59.594 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.594 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.594 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:59.594 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.605549+0000", 2024-04-18T21:06:59.594 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0052624170000000001 2024-04-18T21:06:59.594 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.594 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.594 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:59.594 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.605560+0000", 2024-04-18T21:06:59.594 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.165e-05 2024-04-18T21:06:59.595 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.595 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.595 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:59.595 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.605566+0000", 2024-04-18T21:06:59.595 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.0859999999999998e-06 2024-04-18T21:06:59.595 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.595 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.595 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:59.595 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.605647+0000", 2024-04-18T21:06:59.595 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.0411e-05 2024-04-18T21:06:59.595 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.595 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.595 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:59.595 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.605758+0000", 2024-04-18T21:06:59.595 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000111214 2024-04-18T21:06:59.595 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.596 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.596 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:59.596 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.605930+0000", 2024-04-18T21:06:59.596 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00017167199999999999 2024-04-18T21:06:59.596 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.596 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.596 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:59.596 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.615998+0000", 2024-04-18T21:06:59.596 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010067883 2024-04-18T21:06:59.596 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.596 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.596 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:59.596 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.640752+0000", 2024-04-18T21:06:59.596 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024754691999999998 2024-04-18T21:06:59.596 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.596 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.596 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:59.597 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.640813+0000", 2024-04-18T21:06:59.597 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.0909999999999998e-05 2024-04-18T21:06:59.597 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.597 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.597 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:59.597 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.640886+0000", 2024-04-18T21:06:59.597 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.2559999999999996e-05 2024-04-18T21:06:59.597 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.597 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:59.597 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.597 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.597 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.597 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11443 4.38 4:1d691e75:::1000000312c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T21:06:59.597 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:58.744218+0000", 2024-04-18T21:06:59.597 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.82260475200000005, 2024-04-18T21:06:59.598 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.051074359999999999, 2024-04-18T21:06:59.598 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:59.598 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:59.598 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:59.598 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:59.598 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:06:59.598 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:59.598 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11443 2024-04-18T21:06:59.598 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.598 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:59.598 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.598 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:59.598 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.744218+0000", 2024-04-18T21:06:59.598 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.599 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.599 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.599 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:59.599 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.744218+0000", 2024-04-18T21:06:59.599 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.599 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.599 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.599 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:59.599 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.744221+0000", 2024-04-18T21:06:59.599 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.3580000000000001e-06 2024-04-18T21:06:59.599 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.599 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.599 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:59.599 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753328+0000", 2024-04-18T21:06:59.599 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0091071339999999994 2024-04-18T21:06:59.600 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.600 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.600 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:59.600 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753351+0000", 2024-04-18T21:06:59.600 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.3479999999999999e-05 2024-04-18T21:06:59.600 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.600 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.600 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:59.600 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753363+0000", 2024-04-18T21:06:59.600 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1345000000000001e-05 2024-04-18T21:06:59.600 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.600 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.600 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:59.600 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753416+0000", 2024-04-18T21:06:59.601 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.2849999999999997e-05 2024-04-18T21:06:59.601 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.601 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.601 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:59.601 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753471+0000", 2024-04-18T21:06:59.601 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5717999999999997e-05 2024-04-18T21:06:59.601 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.601 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.601 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:59.601 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753560+0000", 2024-04-18T21:06:59.601 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8777999999999996e-05 2024-04-18T21:06:59.601 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.601 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.601 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:59.601 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.760182+0000", 2024-04-18T21:06:59.602 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0066216299999999999 2024-04-18T21:06:59.602 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.602 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.602 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:59.602 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.795094+0000", 2024-04-18T21:06:59.602 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.034912334000000003 2024-04-18T21:06:59.602 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.602 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.602 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:59.602 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.795221+0000", 2024-04-18T21:06:59.602 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012745899999999999 2024-04-18T21:06:59.602 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.602 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.602 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:59.602 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.795293+0000", 2024-04-18T21:06:59.603 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.1273999999999996e-05 2024-04-18T21:06:59.603 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.603 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:59.603 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.603 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.603 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.603 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11511 4.18 4:184fae4a:::1000000316d.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:06:59.603 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:58.838500+0000", 2024-04-18T21:06:59.603 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.72832287200000001, 2024-04-18T21:06:59.603 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.044451537999999999, 2024-04-18T21:06:59.603 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:59.603 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:59.603 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:59.603 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:59.603 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:06:59.603 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:59.603 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11511 2024-04-18T21:06:59.604 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.604 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:59.604 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.604 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:59.604 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.838500+0000", 2024-04-18T21:06:59.604 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.604 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.604 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.604 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:59.604 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.838500+0000", 2024-04-18T21:06:59.604 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.604 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.604 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.604 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:59.604 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.838501+0000", 2024-04-18T21:06:59.604 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.4799999999999997e-07 2024-04-18T21:06:59.605 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.605 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.605 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:59.605 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.847806+0000", 2024-04-18T21:06:59.605 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0093054250000000008 2024-04-18T21:06:59.605 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.605 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.605 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:59.605 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.847834+0000", 2024-04-18T21:06:59.605 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7161999999999998e-05 2024-04-18T21:06:59.605 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.605 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.605 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:59.605 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.847849+0000", 2024-04-18T21:06:59.605 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5217e-05 2024-04-18T21:06:59.605 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.606 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.606 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:59.606 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.847917+0000", 2024-04-18T21:06:59.606 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7896000000000002e-05 2024-04-18T21:06:59.606 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.606 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.606 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:59.606 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.848080+0000", 2024-04-18T21:06:59.606 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016328299999999999 2024-04-18T21:06:59.606 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.606 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.606 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:59.606 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.848348+0000", 2024-04-18T21:06:59.606 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00026766099999999998 2024-04-18T21:06:59.607 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.607 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.607 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:59.607 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.863288+0000", 2024-04-18T21:06:59.607 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.014940301 2024-04-18T21:06:59.607 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.607 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.607 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:59.607 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.882854+0000", 2024-04-18T21:06:59.607 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019566456999999999 2024-04-18T21:06:59.607 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.607 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.607 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:59.607 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.882904+0000", 2024-04-18T21:06:59.608 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.9620999999999998e-05 2024-04-18T21:06:59.608 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.608 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.608 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:59.608 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.882952+0000", 2024-04-18T21:06:59.608 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.7766999999999999e-05 2024-04-18T21:06:59.608 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.608 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:59.608 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.608 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.608 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.608 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11728 4.39 4:9dcc5ecf:::1000000316e.00000000:head [write 0~4194304 [2@1720266]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:06:59.608 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.088728+0000", 2024-04-18T21:06:59.608 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.47809500500000002, 2024-04-18T21:06:59.609 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.047519835000000003, 2024-04-18T21:06:59.609 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:59.609 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:59.609 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:59.609 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:59.609 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:06:59.609 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:59.609 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11728 2024-04-18T21:06:59.609 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.609 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:59.609 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.609 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:59.609 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.088728+0000", 2024-04-18T21:06:59.609 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.609 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.610 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.610 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:59.610 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.088728+0000", 2024-04-18T21:06:59.610 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.610 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.610 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.610 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:59.610 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.088729+0000", 2024-04-18T21:06:59.610 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1000000000000001e-06 2024-04-18T21:06:59.610 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.610 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.610 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:59.610 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094322+0000", 2024-04-18T21:06:59.610 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0055931349999999999 2024-04-18T21:06:59.611 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.611 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.611 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:59.611 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094334+0000", 2024-04-18T21:06:59.611 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1894e-05 2024-04-18T21:06:59.611 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.611 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.611 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:59.611 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094340+0000", 2024-04-18T21:06:59.611 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.8780000000000003e-06 2024-04-18T21:06:59.611 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.611 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.611 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:59.611 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094393+0000", 2024-04-18T21:06:59.611 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3275000000000001e-05 2024-04-18T21:06:59.612 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.612 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.612 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:59.612 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094479+0000", 2024-04-18T21:06:59.612 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5222999999999994e-05 2024-04-18T21:06:59.612 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.612 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.612 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:59.612 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094629+0000", 2024-04-18T21:06:59.612 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00015021699999999999 2024-04-18T21:06:59.612 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.612 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.612 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:59.612 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.102975+0000", 2024-04-18T21:06:59.613 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0083464460000000004 2024-04-18T21:06:59.613 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.613 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.613 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:59.613 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136142+0000", 2024-04-18T21:06:59.613 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.033166432000000003 2024-04-18T21:06:59.613 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.613 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.613 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:59.613 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136207+0000", 2024-04-18T21:06:59.613 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.5032999999999999e-05 2024-04-18T21:06:59.613 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.613 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.613 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:59.613 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136248+0000", 2024-04-18T21:06:59.613 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.1202000000000003e-05 2024-04-18T21:06:59.614 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.614 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:59.614 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.614 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.614 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.614 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11731 4.39 4:9dcc5ecf:::1000000316e.00000000:head [write 3247277~11534 [2@1720266] in=11534b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:06:59.614 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.094419+0000", 2024-04-18T21:06:59.614 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.47240380799999998, 2024-04-18T21:06:59.614 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.042530119999999998, 2024-04-18T21:06:59.614 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:59.615 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:59.615 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:59.615 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:59.615 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:06:59.615 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:59.616 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11731 2024-04-18T21:06:59.616 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.616 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:59.616 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.616 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:59.616 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094419+0000", 2024-04-18T21:06:59.616 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.616 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.616 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.617 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:59.617 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094419+0000", 2024-04-18T21:06:59.617 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.617 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.617 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.617 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:59.617 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094420+0000", 2024-04-18T21:06:59.617 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.6400000000000003e-07 2024-04-18T21:06:59.617 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.617 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.617 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:59.617 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094429+0000", 2024-04-18T21:06:59.617 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.2359999999999993e-06 2024-04-18T21:06:59.617 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.617 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.618 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:59.618 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094433+0000", 2024-04-18T21:06:59.618 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.155e-06 2024-04-18T21:06:59.618 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.618 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.618 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:59.618 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094436+0000", 2024-04-18T21:06:59.618 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.0529999999999998e-06 2024-04-18T21:06:59.618 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.618 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.618 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:59.618 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.099720+0000", 2024-04-18T21:06:59.618 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0052837370000000002 2024-04-18T21:06:59.619 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.619 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.619 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:59.619 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.099793+0000", 2024-04-18T21:06:59.619 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.2959000000000004e-05 2024-04-18T21:06:59.619 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.619 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.619 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:59.619 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.099884+0000", 2024-04-18T21:06:59.619 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.1032999999999994e-05 2024-04-18T21:06:59.619 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.619 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.619 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:59.619 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.103177+0000", 2024-04-18T21:06:59.620 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0032935210000000002 2024-04-18T21:06:59.620 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.620 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.620 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:59.620 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136826+0000", 2024-04-18T21:06:59.620 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.033648521000000001 2024-04-18T21:06:59.620 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.620 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.620 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:59.620 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136896+0000", 2024-04-18T21:06:59.620 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0457000000000007e-05 2024-04-18T21:06:59.620 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.620 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.620 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:59.620 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136949+0000", 2024-04-18T21:06:59.621 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.2984e-05 2024-04-18T21:06:59.621 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.621 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:59.621 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.621 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.621 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.621 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11847 4.a 4:51f063b7:::100000032b5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:06:59.621 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.229180+0000", 2024-04-18T21:06:59.621 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.33764294900000003, 2024-04-18T21:06:59.621 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.048001033999999998, 2024-04-18T21:06:59.621 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:59.621 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:59.621 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:59.621 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:59.621 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:06:59.622 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:59.622 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11847 2024-04-18T21:06:59.622 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.622 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:59.622 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.622 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:59.622 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.229180+0000", 2024-04-18T21:06:59.622 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.622 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.622 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.622 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:59.622 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.229180+0000", 2024-04-18T21:06:59.622 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.623 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.623 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.623 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:59.623 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.229181+0000", 2024-04-18T21:06:59.623 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.119e-06 2024-04-18T21:06:59.623 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.623 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.623 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:59.623 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.235951+0000", 2024-04-18T21:06:59.623 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0067702370000000001 2024-04-18T21:06:59.623 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.623 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.623 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:59.623 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.235965+0000", 2024-04-18T21:06:59.624 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3202e-05 2024-04-18T21:06:59.624 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.624 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.624 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:59.624 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.235973+0000", 2024-04-18T21:06:59.624 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8630000000000008e-06 2024-04-18T21:06:59.624 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.624 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.624 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:59.624 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.236047+0000", 2024-04-18T21:06:59.624 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.4453e-05 2024-04-18T21:06:59.624 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.624 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.624 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:59.624 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.236137+0000", 2024-04-18T21:06:59.625 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.9751000000000002e-05 2024-04-18T21:06:59.625 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.625 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.625 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:59.625 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.236266+0000", 2024-04-18T21:06:59.625 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000129257 2024-04-18T21:06:59.625 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.625 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.625 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:59.625 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.244520+0000", 2024-04-18T21:06:59.625 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0082538190000000008 2024-04-18T21:06:59.625 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.625 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.625 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:59.626 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.277093+0000", 2024-04-18T21:06:59.626 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.032573405999999999 2024-04-18T21:06:59.626 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.626 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.626 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:59.626 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.277144+0000", 2024-04-18T21:06:59.626 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.0553000000000002e-05 2024-04-18T21:06:59.626 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.626 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.626 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:59.626 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.277181+0000", 2024-04-18T21:06:59.626 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.7373999999999998e-05 2024-04-18T21:06:59.626 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.627 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:59.627 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.627 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.627 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.627 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11865 4.20 4:05ac8b44:::100000032da.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:06:59.627 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.236344+0000", 2024-04-18T21:06:59.627 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.33047890600000002, 2024-04-18T21:06:59.627 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.041070361999999999, 2024-04-18T21:06:59.627 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:59.627 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:59.627 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:59.627 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:59.627 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:06:59.628 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:59.628 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11865 2024-04-18T21:06:59.628 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.628 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:59.628 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.628 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:59.628 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.236344+0000", 2024-04-18T21:06:59.628 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.628 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.628 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.628 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:59.628 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.236344+0000", 2024-04-18T21:06:59.628 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.628 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.629 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.629 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:59.629 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.236345+0000", 2024-04-18T21:06:59.629 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.9100000000000004e-07 2024-04-18T21:06:59.629 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.629 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.629 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:59.629 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.244714+0000", 2024-04-18T21:06:59.629 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0083693380000000005 2024-04-18T21:06:59.629 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.629 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.629 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:59.629 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.244752+0000", 2024-04-18T21:06:59.629 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.7973999999999999e-05 2024-04-18T21:06:59.629 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.630 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.630 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:59.630 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.244767+0000", 2024-04-18T21:06:59.630 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5078e-05 2024-04-18T21:06:59.630 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.630 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.630 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:59.630 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.244876+0000", 2024-04-18T21:06:59.630 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000108878 2024-04-18T21:06:59.630 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.630 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.630 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:59.630 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.245009+0000", 2024-04-18T21:06:59.630 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013270999999999999 2024-04-18T21:06:59.631 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.631 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.631 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:59.631 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.245268+0000", 2024-04-18T21:06:59.631 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00025918099999999998 2024-04-18T21:06:59.631 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.631 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.631 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:59.631 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.255043+0000", 2024-04-18T21:06:59.631 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0097753849999999993 2024-04-18T21:06:59.631 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.631 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.631 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:59.631 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.277327+0000", 2024-04-18T21:06:59.632 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.022284014000000001 2024-04-18T21:06:59.632 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.632 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.632 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:59.632 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.277379+0000", 2024-04-18T21:06:59.632 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.1653000000000002e-05 2024-04-18T21:06:59.632 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.632 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.632 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:59.632 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.277415+0000", 2024-04-18T21:06:59.632 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.5559999999999998e-05 2024-04-18T21:06:59.632 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.632 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:59.633 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.633 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.633 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.633 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11877 4.1a 4:5a8c04dd:::10000003276.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:06:59.633 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.245072+0000", 2024-04-18T21:06:59.633 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.321751079, 2024-04-18T21:06:59.633 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.042262640999999997, 2024-04-18T21:06:59.633 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:59.633 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:59.633 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:59.633 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:59.633 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:06:59.633 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:59.633 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11877 2024-04-18T21:06:59.633 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.634 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:59.634 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.634 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:59.634 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.245072+0000", 2024-04-18T21:06:59.634 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.634 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.634 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.634 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:59.634 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.245072+0000", 2024-04-18T21:06:59.634 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.634 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.634 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.634 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:59.634 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.245073+0000", 2024-04-18T21:06:59.635 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.99e-07 2024-04-18T21:06:59.635 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.635 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.635 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:59.635 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.252178+0000", 2024-04-18T21:06:59.635 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0071052830000000004 2024-04-18T21:06:59.635 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.635 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.635 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:59.635 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.252192+0000", 2024-04-18T21:06:59.635 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3674e-05 2024-04-18T21:06:59.635 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.635 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.635 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:59.635 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.252199+0000", 2024-04-18T21:06:59.636 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.6790000000000005e-06 2024-04-18T21:06:59.636 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.636 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.636 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:59.636 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.252262+0000", 2024-04-18T21:06:59.636 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.2248000000000004e-05 2024-04-18T21:06:59.636 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.636 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.636 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:59.636 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.252323+0000", 2024-04-18T21:06:59.636 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.1074000000000005e-05 2024-04-18T21:06:59.636 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.636 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.636 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:59.636 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.252418+0000", 2024-04-18T21:06:59.637 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.5078e-05 2024-04-18T21:06:59.637 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.637 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.637 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:59.637 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.267118+0000", 2024-04-18T21:06:59.637 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.014699838 2024-04-18T21:06:59.637 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.637 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.637 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:59.637 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.287262+0000", 2024-04-18T21:06:59.637 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.020144447999999999 2024-04-18T21:06:59.637 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.637 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.637 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:59.637 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.287302+0000", 2024-04-18T21:06:59.637 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.0451000000000003e-05 2024-04-18T21:06:59.637 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.638 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.638 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:59.638 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.287335+0000", 2024-04-18T21:06:59.638 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.2169000000000003e-05 2024-04-18T21:06:59.638 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.638 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:59.638 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.638 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.638 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.638 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11945 4.2b 4:d5bfe239:::10000003209.00000001:head [write 0~2621440] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:06:59.638 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.327479+0000", 2024-04-18T21:06:59.638 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.23934435600000001, 2024-04-18T21:06:59.638 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.039076935, 2024-04-18T21:06:59.638 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:59.639 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:59.639 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:59.639 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:59.639 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:06:59.639 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:59.639 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11945 2024-04-18T21:06:59.639 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.639 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:59.639 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.639 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:59.639 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.327479+0000", 2024-04-18T21:06:59.639 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.639 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.640 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.640 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:59.640 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.327479+0000", 2024-04-18T21:06:59.640 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.640 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.640 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.640 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:59.640 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.327480+0000", 2024-04-18T21:06:59.640 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.4900000000000004e-07 2024-04-18T21:06:59.640 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.640 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.640 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:59.640 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.332495+0000", 2024-04-18T21:06:59.640 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0050155740000000001 2024-04-18T21:06:59.640 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.641 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.641 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:59.641 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.332511+0000", 2024-04-18T21:06:59.641 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5565000000000001e-05 2024-04-18T21:06:59.641 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.641 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.641 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:59.641 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.332526+0000", 2024-04-18T21:06:59.641 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5478999999999999e-05 2024-04-18T21:06:59.641 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.641 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.641 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:59.641 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.332864+0000", 2024-04-18T21:06:59.641 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000337389 2024-04-18T21:06:59.642 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.642 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.642 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:59.642 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.332991+0000", 2024-04-18T21:06:59.642 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012727300000000001 2024-04-18T21:06:59.642 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.642 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.642 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:59.642 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.333207+0000", 2024-04-18T21:06:59.642 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00021640900000000001 2024-04-18T21:06:59.642 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.642 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.642 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:59.643 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.348957+0000", 2024-04-18T21:06:59.643 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.015749821000000001 2024-04-18T21:06:59.643 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.643 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.643 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:59.643 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.366491+0000", 2024-04-18T21:06:59.643 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017533796000000001 2024-04-18T21:06:59.643 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.643 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.643 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:59.643 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.366530+0000", 2024-04-18T21:06:59.643 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.9428999999999998e-05 2024-04-18T21:06:59.643 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.644 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.644 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:59.644 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.366556+0000", 2024-04-18T21:06:59.644 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.5250999999999999e-05 2024-04-18T21:06:59.644 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.644 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:59.644 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.644 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.644 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.644 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11949 4.2b 4:d50cc3c5:::100000031c6.00000000:head [write 0~3145728] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:06:59.644 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.338113+0000", 2024-04-18T21:06:59.644 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.22871007300000001, 2024-04-18T21:06:59.644 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.046907847000000003, 2024-04-18T21:06:59.644 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:59.644 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:59.645 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:59.645 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:59.645 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:06:59.645 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:59.645 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11949 2024-04-18T21:06:59.645 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.645 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:59.645 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.645 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:59.645 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.338113+0000", 2024-04-18T21:06:59.645 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.645 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.645 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.645 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:59.645 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.338113+0000", 2024-04-18T21:06:59.646 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.646 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.646 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.646 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:59.646 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.338115+0000", 2024-04-18T21:06:59.646 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5659999999999999e-06 2024-04-18T21:06:59.646 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.646 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.646 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:59.646 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344146+0000", 2024-04-18T21:06:59.646 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0060309339999999999 2024-04-18T21:06:59.646 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.646 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.647 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:59.647 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344163+0000", 2024-04-18T21:06:59.647 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6994999999999999e-05 2024-04-18T21:06:59.647 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.647 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.647 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:59.647 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344171+0000", 2024-04-18T21:06:59.647 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5520000000000005e-06 2024-04-18T21:06:59.647 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.647 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.647 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:59.647 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344604+0000", 2024-04-18T21:06:59.647 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00043326299999999997 2024-04-18T21:06:59.647 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.647 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.648 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:59.648 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344687+0000", 2024-04-18T21:06:59.648 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.2952000000000001e-05 2024-04-18T21:06:59.648 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.648 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.648 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:59.648 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344792+0000", 2024-04-18T21:06:59.648 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000104635 2024-04-18T21:06:59.648 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.648 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.648 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:59.648 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.361867+0000", 2024-04-18T21:06:59.648 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017075245999999999 2024-04-18T21:06:59.648 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.648 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.649 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:59.649 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.384879+0000", 2024-04-18T21:06:59.649 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023011474000000001 2024-04-18T21:06:59.649 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.649 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.649 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:59.649 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.384976+0000", 2024-04-18T21:06:59.649 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.7399999999999996e-05 2024-04-18T21:06:59.649 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.649 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.649 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:59.649 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.385021+0000", 2024-04-18T21:06:59.649 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.4830000000000003e-05 2024-04-18T21:06:59.649 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.649 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:59.650 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.650 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.650 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.650 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:1204 3.13 3:cb3d3880:::200.0000000d:head [write 3865216~9192 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-18T21:06:59.650 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.346397+0000", 2024-04-18T21:06:59.650 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.220426279, 2024-04-18T21:06:59.650 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.038414269000000001, 2024-04-18T21:06:59.650 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:59.650 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:59.650 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:59.650 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:59.650 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.650 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:59.651 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.346397+0000", 2024-04-18T21:06:59.651 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.651 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.651 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.651 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:59.651 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.346397+0000", 2024-04-18T21:06:59.651 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.651 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.651 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.651 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:59.651 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.346398+0000", 2024-04-18T21:06:59.651 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0330000000000001e-06 2024-04-18T21:06:59.651 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.651 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.651 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:59.652 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.346416+0000", 2024-04-18T21:06:59.652 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7737e-05 2024-04-18T21:06:59.652 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.652 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.652 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:59.652 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.346430+0000", 2024-04-18T21:06:59.652 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3930999999999999e-05 2024-04-18T21:06:59.652 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.652 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.652 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:59.652 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.346438+0000", 2024-04-18T21:06:59.652 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8699999999999998e-06 2024-04-18T21:06:59.652 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.652 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.652 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:59.653 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.349995+0000", 2024-04-18T21:06:59.653 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035570300000000001 2024-04-18T21:06:59.653 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.653 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.653 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:59.653 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.350044+0000", 2024-04-18T21:06:59.653 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8937999999999998e-05 2024-04-18T21:06:59.653 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.653 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.653 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:59.653 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.350158+0000", 2024-04-18T21:06:59.653 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000114003 2024-04-18T21:06:59.653 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.653 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.653 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:59.654 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.362154+0000", 2024-04-18T21:06:59.654 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.011995874 2024-04-18T21:06:59.654 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.654 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.654 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:59.654 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.384670+0000", 2024-04-18T21:06:59.654 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.022515818 2024-04-18T21:06:59.654 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.654 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.654 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:59.654 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.384742+0000", 2024-04-18T21:06:59.654 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.2107999999999995e-05 2024-04-18T21:06:59.654 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.655 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.655 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:59.655 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.384811+0000", 2024-04-18T21:06:59.655 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.8926999999999999e-05 2024-04-18T21:06:59.655 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.655 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:59.655 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.655 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.655 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.655 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:1205 3.13 3:cb3d3880:::200.0000000d:head [write 3874408~2450 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-18T21:06:59.655 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.346454+0000", 2024-04-18T21:06:59.655 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.22036910900000001, 2024-04-18T21:06:59.655 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.038620711000000002, 2024-04-18T21:06:59.655 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:59.655 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:59.656 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:59.656 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:59.656 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.656 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:59.656 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.346454+0000", 2024-04-18T21:06:59.656 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.656 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.656 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.656 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:59.656 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.346454+0000", 2024-04-18T21:06:59.656 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.656 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.656 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.656 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:59.656 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.346455+0000", 2024-04-18T21:06:59.657 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.2800000000000005e-07 2024-04-18T21:06:59.657 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.657 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.657 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:59.657 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.346461+0000", 2024-04-18T21:06:59.657 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.9399999999999999e-06 2024-04-18T21:06:59.657 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.657 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.657 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:59.657 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.346471+0000", 2024-04-18T21:06:59.657 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0217000000000001e-05 2024-04-18T21:06:59.657 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.657 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.657 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:59.658 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.346480+0000", 2024-04-18T21:06:59.658 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5099999999999998e-06 2024-04-18T21:06:59.658 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.658 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.658 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:59.658 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.350695+0000", 2024-04-18T21:06:59.658 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0042154649999999998 2024-04-18T21:06:59.658 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.658 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.658 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:59.658 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.350778+0000", 2024-04-18T21:06:59.658 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.3041999999999995e-05 2024-04-18T21:06:59.658 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.658 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.659 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:59.659 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.350917+0000", 2024-04-18T21:06:59.659 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000138541 2024-04-18T21:06:59.659 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.659 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.659 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:59.659 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.362157+0000", 2024-04-18T21:06:59.659 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.011240807 2024-04-18T21:06:59.659 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.659 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.659 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:59.659 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.384967+0000", 2024-04-18T21:06:59.659 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.022809125999999999 2024-04-18T21:06:59.660 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.660 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.660 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:59.660 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.385029+0000", 2024-04-18T21:06:59.660 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.2930999999999998e-05 2024-04-18T21:06:59.660 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.660 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.660 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:59.660 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.385075+0000", 2024-04-18T21:06:59.660 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.5204000000000003e-05 2024-04-18T21:06:59.660 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.660 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:59.660 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.660 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.661 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.661 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:1206 3.13 3:cb3d3880:::200.0000000d:head [write 3876858~4702 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-18T21:06:59.661 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.346957+0000", 2024-04-18T21:06:59.661 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.21986598299999999, 2024-04-18T21:06:59.661 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.038492888000000003, 2024-04-18T21:06:59.661 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:59.661 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:59.661 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:59.661 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:59.661 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.661 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:59.661 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.346957+0000", 2024-04-18T21:06:59.661 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.661 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.661 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.662 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:59.662 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.346957+0000", 2024-04-18T21:06:59.662 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.662 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.662 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.662 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:59.662 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.346958+0000", 2024-04-18T21:06:59.662 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2640000000000001e-06 2024-04-18T21:06:59.662 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.662 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.662 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:59.662 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.346970+0000", 2024-04-18T21:06:59.662 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1447999999999999e-05 2024-04-18T21:06:59.662 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.663 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.663 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:59.663 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.346986+0000", 2024-04-18T21:06:59.663 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.668e-05 2024-04-18T21:06:59.663 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.663 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.663 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:59.663 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.346999+0000", 2024-04-18T21:06:59.663 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2785999999999999e-05 2024-04-18T21:06:59.663 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.663 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.663 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:59.663 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.351251+0000", 2024-04-18T21:06:59.663 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0042517950000000001 2024-04-18T21:06:59.663 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.664 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.664 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:59.664 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.351295+0000", 2024-04-18T21:06:59.664 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.3893999999999997e-05 2024-04-18T21:06:59.664 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.664 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.664 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:59.664 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.351358+0000", 2024-04-18T21:06:59.664 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.3509000000000005e-05 2024-04-18T21:06:59.664 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.664 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.664 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:59.664 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.362177+0000", 2024-04-18T21:06:59.664 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010818402 2024-04-18T21:06:59.665 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.665 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.665 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:59.665 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.385383+0000", 2024-04-18T21:06:59.665 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023206427000000002 2024-04-18T21:06:59.665 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.665 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.665 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:59.665 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.385422+0000", 2024-04-18T21:06:59.665 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.8994e-05 2024-04-18T21:06:59.665 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.665 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.665 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:59.665 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.385450+0000", 2024-04-18T21:06:59.665 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7688999999999999e-05 2024-04-18T21:06:59.666 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.666 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:59.666 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.666 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.666 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.666 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11988 4.0 4:01311cad:::1000000320a.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:06:59.666 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.384266+0000", 2024-04-18T21:06:59.666 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.18255660300000001, 2024-04-18T21:06:59.666 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.042482546000000003, 2024-04-18T21:06:59.666 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:59.666 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:59.666 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:59.666 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:59.666 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:06:59.667 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:59.667 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11988 2024-04-18T21:06:59.667 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.667 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:59.667 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.667 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:59.667 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.384266+0000", 2024-04-18T21:06:59.667 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.667 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.667 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.667 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:59.667 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.384266+0000", 2024-04-18T21:06:59.667 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.667 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.667 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.667 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:59.668 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.384268+0000", 2024-04-18T21:06:59.668 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.857e-06 2024-04-18T21:06:59.668 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.668 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.668 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:59.668 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.391524+0000", 2024-04-18T21:06:59.668 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0072557469999999999 2024-04-18T21:06:59.668 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.668 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.668 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:59.668 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.391546+0000", 2024-04-18T21:06:59.668 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1607000000000002e-05 2024-04-18T21:06:59.668 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.668 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.668 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:59.668 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.391559+0000", 2024-04-18T21:06:59.669 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3331e-05 2024-04-18T21:06:59.669 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.669 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.669 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:59.669 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.391639+0000", 2024-04-18T21:06:59.669 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.9511000000000005e-05 2024-04-18T21:06:59.669 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.669 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.669 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:59.669 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.391753+0000", 2024-04-18T21:06:59.669 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000114512 2024-04-18T21:06:59.669 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.669 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.669 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:59.669 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.391945+0000", 2024-04-18T21:06:59.670 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019234300000000001 2024-04-18T21:06:59.670 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.670 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.670 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:59.670 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.401085+0000", 2024-04-18T21:06:59.670 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0091394319999999994 2024-04-18T21:06:59.670 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.670 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.670 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:59.670 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.426658+0000", 2024-04-18T21:06:59.670 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.025573148 2024-04-18T21:06:59.670 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.670 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.671 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:59.671 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.426714+0000", 2024-04-18T21:06:59.671 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5937999999999999e-05 2024-04-18T21:06:59.671 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.671 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.671 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:59.671 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.426749+0000", 2024-04-18T21:06:59.671 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.5120000000000003e-05 2024-04-18T21:06:59.671 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.671 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:59.671 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.671 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.671 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.671 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:12041 4.38 4:1c8d9fef:::100000033ed.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:06:59.672 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.446812+0000", 2024-04-18T21:06:59.672 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.120010832, 2024-04-18T21:06:59.672 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.044749606999999997, 2024-04-18T21:06:59.672 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:06:59.672 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:06:59.672 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:06:59.672 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:06:59.672 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:06:59.672 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:06:59.672 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 12041 2024-04-18T21:06:59.672 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.672 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:06:59.672 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.672 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:06:59.673 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.446812+0000", 2024-04-18T21:06:59.673 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.673 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.673 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.673 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:06:59.673 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.446812+0000", 2024-04-18T21:06:59.673 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:06:59.673 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.673 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.673 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:06:59.673 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.446814+0000", 2024-04-18T21:06:59.673 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5099999999999999e-06 2024-04-18T21:06:59.673 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.673 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.674 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:06:59.674 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.452583+0000", 2024-04-18T21:06:59.674 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0057696379999999997 2024-04-18T21:06:59.674 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.674 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.674 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:06:59.674 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.452599+0000", 2024-04-18T21:06:59.674 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5701000000000001e-05 2024-04-18T21:06:59.674 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.674 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.674 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:06:59.674 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.452607+0000", 2024-04-18T21:06:59.674 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.7100000000000007e-06 2024-04-18T21:06:59.674 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.675 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.675 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:06:59.675 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.452718+0000", 2024-04-18T21:06:59.675 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000111257 2024-04-18T21:06:59.675 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.675 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.675 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:06:59.675 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.452924+0000", 2024-04-18T21:06:59.675 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000206066 2024-04-18T21:06:59.675 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.675 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.675 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:06:59.675 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.453088+0000", 2024-04-18T21:06:59.675 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016336700000000001 2024-04-18T21:06:59.676 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.676 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.676 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:06:59.676 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.469818+0000", 2024-04-18T21:06:59.676 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016730248999999999 2024-04-18T21:06:59.676 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.676 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.676 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:06:59.676 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.491505+0000", 2024-04-18T21:06:59.676 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021687366 2024-04-18T21:06:59.676 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.676 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.676 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:06:59.676 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.491537+0000", 2024-04-18T21:06:59.676 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.1888999999999999e-05 2024-04-18T21:06:59.677 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:06:59.677 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:06:59.677 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:06:59.677 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.491562+0000", 2024-04-18T21:06:59.677 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.4854e-05 2024-04-18T21:06:59.677 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.677 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:59.677 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.677 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:06:59.677 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:06:59.677 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:06:59.679 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:06:59.680 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:59.678+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:59.701 INFO:tasks.workunit.client.0.smithi078.stdout:9/402: write d7/df/f10 [1057347,100768] 0 2024-04-18T21:06:59.701 INFO:tasks.workunit.client.0.smithi078.stdout:6/319: creat d2/d6/dd/d4b/d5d/f6a x:0 0 0 2024-04-18T21:06:59.701 INFO:tasks.workunit.client.0.smithi078.stdout:9/403: write d7/df/d1e/f7e [796634,82190] 0 2024-04-18T21:06:59.702 INFO:tasks.workunit.client.0.smithi078.stdout:9/404: stat d7/d11/d2d/d26 0 2024-04-18T21:06:59.702 INFO:tasks.workunit.client.0.smithi078.stdout:0/434: write d0/d9/da/db/d35/f78 [302979,70554] 0 2024-04-18T21:06:59.702 INFO:tasks.workunit.client.0.smithi078.stdout:8/334: write d0/d10/d14/f1e [374209,7104] 0 2024-04-18T21:06:59.702 INFO:tasks.workunit.client.0.smithi078.stdout:8/335: rmdir d0/d10/d14/d2a/d41 39 2024-04-18T21:06:59.702 INFO:tasks.workunit.client.0.smithi078.stdout:0/435: rename d0/d9/dd/d17/d2e/d46 to d0/d9/dd/d17/d2e/d7f 0 2024-04-18T21:06:59.702 INFO:tasks.workunit.client.0.smithi078.stdout:8/336: chown d0/l7 1 1 2024-04-18T21:06:59.702 INFO:tasks.workunit.client.0.smithi078.stdout:9/405: dwrite d7/d11/d1b/d45/d4b/f5b [0,4194304] 0 2024-04-18T21:06:59.702 INFO:tasks.workunit.client.0.smithi078.stdout:8/337: creat d0/d22/f61 x:0 0 0 2024-04-18T21:06:59.702 INFO:tasks.workunit.client.0.smithi078.stdout:2/374: dread d0/f1d [0,4194304] 0 2024-04-18T21:06:59.702 INFO:tasks.workunit.client.0.smithi078.stdout:8/338: truncate d0/d10/d14/f4c 58139 0 2024-04-18T21:06:59.702 INFO:tasks.workunit.client.0.smithi078.stdout:2/375: mkdir d0/db/d18/d21/d27/d70 0 2024-04-18T21:06:59.702 INFO:tasks.workunit.client.0.smithi078.stdout:5/378: sync 2024-04-18T21:06:59.702 INFO:tasks.workunit.client.0.smithi078.stdout:1/433: sync 2024-04-18T21:06:59.702 INFO:tasks.workunit.client.0.smithi078.stdout:7/410: sync 2024-04-18T21:06:59.703 INFO:tasks.workunit.client.0.smithi078.stdout:7/411: mkdir d1/d16/d10/d7c/d94 0 2024-04-18T21:06:59.703 INFO:tasks.workunit.client.0.smithi078.stdout:5/379: mkdir d9/da/d3e/d4c/d6d/d75 0 2024-04-18T21:06:59.703 INFO:tasks.workunit.client.0.smithi078.stdout:9/406: dwrite d7/df/f2a [0,4194304] 0 2024-04-18T21:06:59.703 INFO:tasks.workunit.client.0.smithi078.stdout:5/380: chown f8 271736695 1 2024-04-18T21:06:59.703 INFO:tasks.workunit.client.0.smithi078.stdout:9/407: mkdir d7/df/d88 0 2024-04-18T21:06:59.703 INFO:tasks.workunit.client.0.smithi078.stdout:5/381: unlink d9/da/d3e/d4c/d6d/d73/c30 0 2024-04-18T21:06:59.703 INFO:tasks.workunit.client.0.smithi078.stdout:0/436: dwrite d0/d9/da/db/d35/f4b [0,4194304] 0 2024-04-18T21:06:59.703 INFO:tasks.workunit.client.0.smithi078.stdout:9/408: creat d7/df/d67/f89 x:0 0 0 2024-04-18T21:06:59.703 INFO:tasks.workunit.client.0.smithi078.stdout:5/382: rmdir d9/da/d3e/d4c 39 2024-04-18T21:06:59.703 INFO:tasks.workunit.client.0.smithi078.stdout:0/437: mkdir d0/d6c/d80 0 2024-04-18T21:06:59.703 INFO:tasks.workunit.client.0.smithi078.stdout:5/383: readlink d9/l2a 0 2024-04-18T21:06:59.703 INFO:tasks.workunit.client.0.smithi078.stdout:0/438: write d0/d9/da/db/d35/f5d [1430326,20107] 0 2024-04-18T21:06:59.703 INFO:tasks.workunit.client.0.smithi078.stdout:5/384: rename d9/da/f1a to d9/d2e/f76 0 2024-04-18T21:06:59.703 INFO:tasks.workunit.client.0.smithi078.stdout:5/385: chown d9/da/d3e/d4c/d6d/d73/d55/d62 37813 1 2024-04-18T21:06:59.704 INFO:tasks.workunit.client.0.smithi078.stdout:5/386: creat d9/f77 x:0 0 0 2024-04-18T21:06:59.704 INFO:tasks.workunit.client.0.smithi078.stdout:5/387: mkdir d9/da/d3e/d4c/d53/d78 0 2024-04-18T21:06:59.704 INFO:tasks.workunit.client.0.smithi078.stdout:8/339: write d0/f5 [1759538,43872] 0 2024-04-18T21:06:59.704 INFO:tasks.workunit.client.0.smithi078.stdout:2/376: truncate d0/db/d18/d21/d27/f58 4840719 0 2024-04-18T21:06:59.704 INFO:tasks.workunit.client.0.smithi078.stdout:5/388: mkdir d9/da/d3e/d4c/d79 0 2024-04-18T21:06:59.704 INFO:tasks.workunit.client.0.smithi078.stdout:2/377: creat d0/db/d18/d21/d27/d29/d4e/f71 x:0 0 0 2024-04-18T21:06:59.704 INFO:tasks.workunit.client.0.smithi078.stdout:5/389: creat d9/da/d3e/d4c/d6d/d75/f7a x:0 0 0 2024-04-18T21:06:59.704 INFO:tasks.workunit.client.0.smithi078.stdout:1/434: truncate d0/d2a/d5f/d89/d32/f39 1740372 0 2024-04-18T21:06:59.704 INFO:tasks.workunit.client.0.smithi078.stdout:1/435: mkdir d0/d2a/d2f/d9b 0 2024-04-18T21:06:59.704 INFO:tasks.workunit.client.0.smithi078.stdout:0/439: write d0/d9/f23 [3714340,107694] 0 2024-04-18T21:06:59.704 INFO:tasks.workunit.client.0.smithi078.stdout:1/436: unlink d0/d2a/d5f/d89/d32/d35/f98 0 2024-04-18T21:06:59.704 INFO:tasks.workunit.client.0.smithi078.stdout:8/340: dread d0/f55 [0,4194304] 0 2024-04-18T21:06:59.704 INFO:tasks.workunit.client.0.smithi078.stdout:0/440: dread - d0/d9/dd/d17/d2e/d7f/f5c zero size 2024-04-18T21:06:59.704 INFO:tasks.workunit.client.0.smithi078.stdout:1/437: write d0/d2a/d45/f5c [315769,88143] 0 2024-04-18T21:06:59.705 INFO:tasks.workunit.client.0.smithi078.stdout:0/441: stat d0/d9/d58/f63 0 2024-04-18T21:06:59.705 INFO:tasks.workunit.client.0.smithi078.stdout:8/341: mkdir d0/d10/d14/d62 0 2024-04-18T21:06:59.705 INFO:tasks.workunit.client.0.smithi078.stdout:0/442: mkdir d0/d9/d81 0 2024-04-18T21:06:59.705 INFO:tasks.workunit.client.0.smithi078.stdout:1/438: mkdir d0/d2a/d3c/d4b/d4/d61/d9c 0 2024-04-18T21:06:59.705 INFO:tasks.workunit.client.0.smithi078.stdout:2/378: dwrite d0/db/d18/d21/d27/d29/f2d [0,4194304] 0 2024-04-18T21:06:59.705 INFO:tasks.workunit.client.0.smithi078.stdout:1/439: fdatasync d0/d2a/d2f/f38 0 2024-04-18T21:06:59.705 INFO:tasks.workunit.client.0.smithi078.stdout:5/390: dwrite d9/da/f1b [0,4194304] 0 2024-04-18T21:06:59.705 INFO:tasks.workunit.client.0.smithi078.stdout:0/443: mkdir d0/d9/dd/d17/d82 0 2024-04-18T21:06:59.705 INFO:tasks.workunit.client.0.smithi078.stdout:2/379: mknod d0/db/d18/c72 0 2024-04-18T21:06:59.705 INFO:tasks.workunit.client.0.smithi078.stdout:0/444: mknod d0/d9/dd/d17/c83 0 2024-04-18T21:06:59.705 INFO:tasks.workunit.client.0.smithi078.stdout:2/380: link d0/db/d18/d21/c5f d0/d1f/d34/c73 0 2024-04-18T21:06:59.705 INFO:tasks.workunit.client.0.smithi078.stdout:0/445: creat d0/d9/da/f84 x:0 0 0 2024-04-18T21:06:59.705 INFO:tasks.workunit.client.0.smithi078.stdout:0/446: creat d0/d9/d4c/d70/f85 x:0 0 0 2024-04-18T21:06:59.705 INFO:tasks.workunit.client.0.smithi078.stdout:2/381: write d0/db/d18/d21/d27/d29/f69 [1794022,36394] 0 2024-04-18T21:06:59.705 INFO:tasks.workunit.client.0.smithi078.stdout:2/382: getdents d0/db/d18/d21/d27/d29/d4e 0 2024-04-18T21:06:59.706 INFO:tasks.workunit.client.0.smithi078.stdout:1/440: dwrite d0/d11/f2e [0,4194304] 0 2024-04-18T21:06:59.706 INFO:tasks.workunit.client.0.smithi078.stdout:2/383: write d0/f1d [1320562,74618] 0 2024-04-18T21:06:59.706 INFO:tasks.workunit.client.0.smithi078.stdout:1/441: rmdir d0/d2a/d5f/d89/d32/d35 39 2024-04-18T21:06:59.706 INFO:tasks.workunit.client.0.smithi078.stdout:2/384: rename d0/l17 to d0/db/d18/d21/d27/d29/d4e/l74 0 2024-04-18T21:06:59.706 INFO:tasks.workunit.client.0.smithi078.stdout:1/442: creat d0/d2a/d5f/d89/d77/f9d x:0 0 0 2024-04-18T21:06:59.706 INFO:tasks.workunit.client.0.smithi078.stdout:1/443: stat d0/d2a/d3c/d4b/l68 0 2024-04-18T21:06:59.706 INFO:tasks.workunit.client.0.smithi078.stdout:9/409: dread d7/d11/d2d/f31 [0,4194304] 0 2024-04-18T21:06:59.706 INFO:tasks.workunit.client.0.smithi078.stdout:1/444: creat d0/d2a/d3c/d4b/d4/d61/d75/f9e x:0 0 0 2024-04-18T21:06:59.706 INFO:tasks.workunit.client.0.smithi078.stdout:9/410: chown d7/d11/d2d/d26/l32 428 1 2024-04-18T21:06:59.706 INFO:tasks.workunit.client.0.smithi078.stdout:1/445: creat d0/f9f x:0 0 0 2024-04-18T21:06:59.706 INFO:tasks.workunit.client.0.smithi078.stdout:9/411: write d7/d11/d1b/d77/f87 [698809,106529] 0 2024-04-18T21:06:59.706 INFO:tasks.workunit.client.0.smithi078.stdout:9/412: rmdir d7/d11/d2d/d3f/d4d 39 2024-04-18T21:06:59.706 INFO:tasks.workunit.client.0.smithi078.stdout:1/446: truncate d0/d2a/d3c/d4b/f24 2692695 0 2024-04-18T21:06:59.706 INFO:tasks.workunit.client.0.smithi078.stdout:9/413: creat d7/df/f8a x:0 0 0 2024-04-18T21:06:59.707 INFO:tasks.workunit.client.0.smithi078.stdout:9/414: fdatasync d7/d11/d1b/f5f 0 2024-04-18T21:06:59.707 INFO:tasks.workunit.client.0.smithi078.stdout:1/447: truncate d0/d2a/d2f/f38 8885583 0 2024-04-18T21:06:59.707 INFO:tasks.workunit.client.0.smithi078.stdout:9/415: dread - d7/df/d67/f89 zero size 2024-04-18T21:06:59.707 INFO:tasks.workunit.client.0.smithi078.stdout:1/448: rename d0/d11/l31 to d0/d2a/d2f/d9b/la0 0 2024-04-18T21:06:59.707 INFO:tasks.workunit.client.0.smithi078.stdout:9/416: write f6 [53736,25884] 0 2024-04-18T21:06:59.707 INFO:tasks.workunit.client.0.smithi078.stdout:3/350: sync 2024-04-18T21:06:59.707 INFO:tasks.workunit.client.0.smithi078.stdout:4/420: sync 2024-04-18T21:06:59.707 INFO:tasks.workunit.client.0.smithi078.stdout:5/391: sync 2024-04-18T21:06:59.707 INFO:tasks.workunit.client.0.smithi078.stdout:9/417: unlink d7/d11/d1b/d77/l82 0 2024-04-18T21:06:59.707 INFO:tasks.workunit.client.0.smithi078.stdout:5/392: fsync d9/da/d3e/d4c/f5a 0 2024-04-18T21:06:59.707 INFO:tasks.workunit.client.0.smithi078.stdout:5/393: truncate d9/f3c 180513 0 2024-04-18T21:06:59.707 INFO:tasks.workunit.client.0.smithi078.stdout:5/394: fdatasync d9/f64 0 2024-04-18T21:06:59.707 INFO:tasks.workunit.client.0.smithi078.stdout:2/385: dread - d0/db/d18/d21/d27/d29/d4e/f71 zero size 2024-04-18T21:06:59.707 INFO:tasks.workunit.client.0.smithi078.stdout:3/351: rename d4/da/d11/c36 to d4/d2d/c61 0 2024-04-18T21:06:59.707 INFO:tasks.workunit.client.0.smithi078.stdout:7/412: dread d1/f3c [0,4194304] 0 2024-04-18T21:06:59.707 INFO:tasks.workunit.client.0.smithi078.stdout:5/395: creat d9/da/d3e/d4c/d67/f7b x:0 0 0 2024-04-18T21:06:59.708 INFO:tasks.workunit.client.0.smithi078.stdout:4/421: dread d0/dc/d10/d41/f45 [0,4194304] 0 2024-04-18T21:06:59.708 INFO:tasks.workunit.client.0.smithi078.stdout:8/342: dread d0/d10/f51 [0,4194304] 0 2024-04-18T21:06:59.708 INFO:tasks.workunit.client.0.smithi078.stdout:2/386: truncate d0/db/d18/d21/d27/d29/d33/f6a 630542 0 2024-04-18T21:06:59.708 INFO:tasks.workunit.client.0.smithi078.stdout:4/422: symlink d0/l9a 0 2024-04-18T21:06:59.708 INFO:tasks.workunit.client.0.smithi078.stdout:1/449: dwrite d0/d2a/d3c/d4b/d4/d61/d75/f7e [0,4194304] 0 2024-04-18T21:06:59.708 INFO:tasks.workunit.client.0.smithi078.stdout:7/413: link d1/d16/d10/l4a d1/d16/d10/d7c/d94/l95 0 2024-04-18T21:06:59.708 INFO:tasks.workunit.client.0.smithi078.stdout:7/414: fdatasync d1/d16/f46 0 2024-04-18T21:06:59.708 INFO:tasks.workunit.client.0.smithi078.stdout:9/418: dwrite d7/d11/d2d/f31 [0,4194304] 0 2024-04-18T21:06:59.708 INFO:tasks.workunit.client.0.smithi078.stdout:7/415: stat d1/d16/d1c/d40/f7b 0 2024-04-18T21:06:59.708 INFO:tasks.workunit.client.0.smithi078.stdout:3/352: dwrite d4/da/d11/f32 [0,4194304] 0 2024-04-18T21:06:59.708 INFO:tasks.workunit.client.0.smithi078.stdout:4/423: mkdir d0/dc/d10/d3a/d9b 0 2024-04-18T21:06:59.708 INFO:tasks.workunit.client.0.smithi078.stdout:9/419: mknod d7/c8b 0 2024-04-18T21:06:59.709 INFO:tasks.workunit.client.0.smithi078.stdout:2/387: creat d0/db/d18/d21/d27/d29/d33/f75 x:0 0 0 2024-04-18T21:06:59.709 INFO:tasks.workunit.client.0.smithi078.stdout:8/343: mknod d0/d10/d14/d2a/d41/c63 0 2024-04-18T21:06:59.709 INFO:tasks.workunit.client.0.smithi078.stdout:8/344: stat d0 0 2024-04-18T21:06:59.709 INFO:tasks.workunit.client.0.smithi078.stdout:8/345: rmdir d0/d10/d14/d2d 39 2024-04-18T21:06:59.709 INFO:tasks.workunit.client.0.smithi078.stdout:4/424: creat d0/dc/d10/d3a/f9c x:0 0 0 2024-04-18T21:06:59.709 INFO:tasks.workunit.client.0.smithi078.stdout:8/346: chown d0/c44 2091 1 2024-04-18T21:06:59.709 INFO:tasks.workunit.client.0.smithi078.stdout:4/425: creat d0/dc/d10/d85/f9d x:0 0 0 2024-04-18T21:06:59.709 INFO:tasks.workunit.client.0.smithi078.stdout:6/320: dread d2/f21 [0,4194304] 0 2024-04-18T21:06:59.709 INFO:tasks.workunit.client.0.smithi078.stdout:7/416: dwrite d1/d32/f62 [0,4194304] 0 2024-04-18T21:06:59.709 INFO:tasks.workunit.client.0.smithi078.stdout:8/347: creat d0/d10/d14/d2a/f64 x:0 0 0 2024-04-18T21:06:59.709 INFO:tasks.workunit.client.0.smithi078.stdout:6/321: mkdir d2/d1c/d6b 0 2024-04-18T21:06:59.709 INFO:tasks.workunit.client.0.smithi078.stdout:4/426: link d0/dc/d10/d3a/f40 d0/dc/d10/f9e 0 2024-04-18T21:06:59.709 INFO:tasks.workunit.client.0.smithi078.stdout:8/348: chown d0/f5 10335 1 2024-04-18T21:06:59.710 INFO:tasks.workunit.client.0.smithi078.stdout:3/353: dwrite d4/d2d/d30/d35/f33 [0,4194304] 0 2024-04-18T21:06:59.710 INFO:tasks.workunit.client.0.smithi078.stdout:6/322: creat d2/d1c/d30/f6c x:0 0 0 2024-04-18T21:06:59.710 INFO:tasks.workunit.client.0.smithi078.stdout:4/427: chown d0/dc/d10/d1c/d60/f7c 4 1 2024-04-18T21:06:59.710 INFO:tasks.workunit.client.0.smithi078.stdout:8/349: rename d0/d10/d14/d2a/d41/c63 to d0/d5c/d5a/c65 0 2024-04-18T21:06:59.710 INFO:tasks.workunit.client.0.smithi078.stdout:4/428: stat d0/dc/d10/d1c/d60/f7a 0 2024-04-18T21:06:59.710 INFO:tasks.workunit.client.0.smithi078.stdout:3/354: getdents d4/d2d/d30/d35 0 2024-04-18T21:06:59.710 INFO:tasks.workunit.client.0.smithi078.stdout:1/450: dread d0/d2a/d45/f76 [0,4194304] 0 2024-04-18T21:06:59.710 INFO:tasks.workunit.client.0.smithi078.stdout:6/323: link d2/d6/dd/f42 d2/d6/dd/d4b/d5d/f6d 0 2024-04-18T21:06:59.710 INFO:tasks.workunit.client.0.smithi078.stdout:8/350: unlink d0/d10/d14/l33 0 2024-04-18T21:06:59.710 INFO:tasks.workunit.client.0.smithi078.stdout:4/429: write d0/dc/d10/d1c/f67 [1010352,35759] 0 2024-04-18T21:06:59.710 INFO:tasks.workunit.client.0.smithi078.stdout:1/451: dread - d0/d2a/d2f/d50/f59 zero size 2024-04-18T21:06:59.710 INFO:tasks.workunit.client.0.smithi078.stdout:4/430: chown d0/dc/d5b/f62 1701724438 1 2024-04-18T21:06:59.710 INFO:tasks.workunit.client.0.smithi078.stdout:5/396: sync 2024-04-18T21:06:59.711 INFO:tasks.workunit.client.0.smithi078.stdout:5/397: sync 2024-04-18T21:06:59.711 INFO:tasks.workunit.client.0.smithi078.stdout:4/431: mknod d0/dc/d10/d3a/d7e/c9f 0 2024-04-18T21:06:59.711 INFO:tasks.workunit.client.0.smithi078.stdout:1/452: link d0/d2a/d3c/d4b/d4/d61/d75/f9e d0/d2a/d45/fa1 0 2024-04-18T21:06:59.711 INFO:tasks.workunit.client.0.smithi078.stdout:1/453: fdatasync d0/d11/f2e 0 2024-04-18T21:06:59.711 INFO:tasks.workunit.client.0.smithi078.stdout:4/432: dread - d0/dc/d10/d85/f8d zero size 2024-04-18T21:06:59.711 INFO:tasks.workunit.client.0.smithi078.stdout:3/355: dread d4/d2d/d30/d35/f33 [0,4194304] 0 2024-04-18T21:06:59.711 INFO:tasks.workunit.client.0.smithi078.stdout:4/433: write d0/dc/d5b/f6f [595622,10080] 0 2024-04-18T21:06:59.711 INFO:tasks.workunit.client.0.smithi078.stdout:9/420: dwrite d7/f46 [4194304,4194304] 0 2024-04-18T21:06:59.711 INFO:tasks.workunit.client.0.smithi078.stdout:4/434: chown d0/f50 2082626 1 2024-04-18T21:06:59.711 INFO:tasks.workunit.client.0.smithi078.stdout:2/388: dwrite d0/db/d18/d21/f31 [0,4194304] 0 2024-04-18T21:06:59.711 INFO:tasks.workunit.client.0.smithi078.stdout:3/356: mkdir d4/df/d62 0 2024-04-18T21:06:59.711 INFO:tasks.workunit.client.0.smithi078.stdout:4/435: dread - d0/dc/d10/d3a/d7e/f86 zero size 2024-04-18T21:06:59.711 INFO:tasks.workunit.client.0.smithi078.stdout:2/389: creat d0/db/d18/d21/d27/d29/d33/f76 x:0 0 0 2024-04-18T21:06:59.711 INFO:tasks.workunit.client.0.smithi078.stdout:7/417: write d1/f3c [272000,68679] 0 2024-04-18T21:06:59.711 INFO:tasks.workunit.client.0.smithi078.stdout:9/421: creat d7/d11/d2d/d3f/f8c x:0 0 0 2024-04-18T21:06:59.712 INFO:tasks.workunit.client.0.smithi078.stdout:4/436: rmdir d0/dc/d10/d3a/d9b 0 2024-04-18T21:06:59.712 INFO:tasks.workunit.client.0.smithi078.stdout:7/418: mknod d1/d16/d2d/c96 0 2024-04-18T21:06:59.712 INFO:tasks.workunit.client.0.smithi078.stdout:4/437: dread - d0/dc/d29/f7d zero size 2024-04-18T21:06:59.712 INFO:tasks.workunit.client.0.smithi078.stdout:9/422: creat d7/d11/d1b/d45/d4b/d5d/f8d x:0 0 0 2024-04-18T21:06:59.712 INFO:tasks.workunit.client.0.smithi078.stdout:8/351: rename d0/d5c/d5a/c65 to d0/c66 0 2024-04-18T21:06:59.712 INFO:tasks.workunit.client.0.smithi078.stdout:5/398: rename d9/da/d3e/d4c/d53 to d9/da/d3e/d4c/d67/d7c 0 2024-04-18T21:06:59.712 INFO:tasks.workunit.client.0.smithi078.stdout:9/423: write d7/f3d [1861815,68473] 0 2024-04-18T21:06:59.712 INFO:tasks.workunit.client.0.smithi078.stdout:4/438: chown d0/dc/d10/d1c/d6a/d81 56 1 2024-04-18T21:06:59.712 INFO:tasks.workunit.client.0.smithi078.stdout:3/357: dwrite d4/d2d/d30/d35/f4f [0,4194304] 0 2024-04-18T21:06:59.712 INFO:tasks.workunit.client.0.smithi078.stdout:8/352: write d0/f5 [2549156,104234] 0 2024-04-18T21:06:59.712 INFO:tasks.workunit.client.0.smithi078.stdout:5/399: write d9/fe [2902890,15819] 0 2024-04-18T21:06:59.712 INFO:tasks.workunit.client.0.smithi078.stdout:1/454: dwrite d0/d2a/d3c/d4b/f3e [0,4194304] 0 2024-04-18T21:06:59.712 INFO:tasks.workunit.client.0.smithi078.stdout:9/424: rename d7/c3c to d7/d83/c8e 0 2024-04-18T21:06:59.713 INFO:tasks.workunit.client.0.smithi078.stdout:3/358: symlink d4/da/d11/l63 0 2024-04-18T21:06:59.713 INFO:tasks.workunit.client.0.smithi078.stdout:8/353: rename d0/fb to d0/f67 0 2024-04-18T21:06:59.713 INFO:tasks.workunit.client.0.smithi078.stdout:1/455: write d0/d2a/d2f/f44 [6585,125371] 0 2024-04-18T21:06:59.713 INFO:tasks.workunit.client.0.smithi078.stdout:5/400: write d9/da/d3e/d4c/d6d/d73/d55/d62/f63 [617025,34256] 0 2024-04-18T21:06:59.713 INFO:tasks.workunit.client.0.smithi078.stdout:6/324: dread d2/d1f/f58 [0,4194304] 0 2024-04-18T21:06:59.713 INFO:tasks.workunit.client.0.smithi078.stdout:3/359: write d4/da/d11/f21 [5560687,108464] 0 2024-04-18T21:06:59.713 INFO:tasks.workunit.client.0.smithi078.stdout:9/425: rename d7/d11/d2d/c28 to d7/d57/c8f 0 2024-04-18T21:06:59.713 INFO:tasks.workunit.client.0.smithi078.stdout:1/456: readlink d0/d2a/d3c/d4b/d4/d61/l80 0 2024-04-18T21:06:59.713 INFO:tasks.workunit.client.0.smithi078.stdout:6/325: rmdir d2/d6/dd 39 2024-04-18T21:06:59.713 INFO:tasks.workunit.client.0.smithi078.stdout:5/401: symlink d9/d2e/l7d 0 2024-04-18T21:06:59.713 INFO:tasks.workunit.client.0.smithi078.stdout:4/439: dread d0/dc/d5b/d71/f56 [0,4194304] 0 2024-04-18T21:06:59.713 INFO:tasks.workunit.client.0.smithi078.stdout:6/326: rmdir d2/d1c 39 2024-04-18T21:06:59.713 INFO:tasks.workunit.client.0.smithi078.stdout:5/402: mknod d9/da/d3e/d4c/d79/c7e 0 2024-04-18T21:06:59.713 INFO:tasks.workunit.client.0.smithi078.stdout:7/419: dwrite d1/d32/f5d [4194304,4194304] 0 2024-04-18T21:06:59.713 INFO:tasks.workunit.client.0.smithi078.stdout:4/440: readlink d0/dc/d10/d1c/l27 0 2024-04-18T21:06:59.714 INFO:tasks.workunit.client.0.smithi078.stdout:6/327: write d2/d6/fc [4910496,28243] 0 2024-04-18T21:06:59.714 INFO:tasks.workunit.client.0.smithi078.stdout:5/403: read - d9/d2e/d65/f6a zero size 2024-04-18T21:06:59.714 INFO:tasks.workunit.client.0.smithi078.stdout:5/404: rename d9/cc to d9/da/d3e/d4c/d6d/c7f 0 2024-04-18T21:06:59.714 INFO:tasks.workunit.client.0.smithi078.stdout:9/426: dread d7/d11/d2d/f31 [0,4194304] 0 2024-04-18T21:06:59.714 INFO:tasks.workunit.client.0.smithi078.stdout:8/354: dwrite d0/d10/d14/f1e [0,4194304] 0 2024-04-18T21:06:59.714 INFO:tasks.workunit.client.0.smithi078.stdout:3/360: dwrite d4/d2d/d30/f34 [0,4194304] 0 2024-04-18T21:06:59.714 INFO:tasks.workunit.client.0.smithi078.stdout:4/441: link d0/dc/d29/l72 d0/dc/d10/d41/d5f/la0 0 2024-04-18T21:06:59.714 INFO:tasks.workunit.client.0.smithi078.stdout:6/328: symlink d2/d34/d35/d57/l6e 0 2024-04-18T21:06:59.714 INFO:tasks.workunit.client.0.smithi078.stdout:5/405: symlink d9/da/d3e/d4c/d6d/d75/l80 0 2024-04-18T21:06:59.714 INFO:tasks.workunit.client.0.smithi078.stdout:9/427: symlink d7/d11/d1b/d45/d4b/d5d/l90 0 2024-04-18T21:06:59.714 INFO:tasks.workunit.client.0.smithi078.stdout:7/420: dwrite d1/f80 [0,4194304] 0 2024-04-18T21:06:59.714 INFO:tasks.workunit.client.0.smithi078.stdout:9/428: creat d7/d83/f91 x:0 0 0 2024-04-18T21:06:59.714 INFO:tasks.workunit.client.0.smithi078.stdout:9/429: chown d7/c51 7 1 2024-04-18T21:06:59.715 INFO:tasks.workunit.client.0.smithi078.stdout:7/421: write d1/d32/f5d [7504576,95163] 0 2024-04-18T21:06:59.715 INFO:tasks.workunit.client.0.smithi078.stdout:4/442: fsync d0/dc/d10/d3a/f59 0 2024-04-18T21:06:59.715 INFO:tasks.workunit.client.0.smithi078.stdout:6/329: rename d2/d1c/f20 to d2/d6/dd/d4b/d5d/f6f 0 2024-04-18T21:06:59.715 INFO:tasks.workunit.client.0.smithi078.stdout:6/330: sync 2024-04-18T21:06:59.715 INFO:tasks.workunit.client.0.smithi078.stdout:9/430: mkdir d7/d11/d2d/d3f/d4d/d92 0 2024-04-18T21:06:59.715 INFO:tasks.workunit.client.0.smithi078.stdout:9/431: fdatasync d7/df/d1e/f7e 0 2024-04-18T21:06:59.715 INFO:tasks.workunit.client.0.smithi078.stdout:7/422: mkdir d1/d16/d10/d7c/d7e/d97 0 2024-04-18T21:06:59.715 INFO:tasks.workunit.client.0.smithi078.stdout:6/331: mknod d2/d6/dd/d4b/c70 0 2024-04-18T21:06:59.715 INFO:tasks.workunit.client.0.smithi078.stdout:4/443: getdents d0/dc/d29/d6d/d82 0 2024-04-18T21:06:59.715 INFO:tasks.workunit.client.0.smithi078.stdout:6/332: chown d2/d6/f16 47833079 1 2024-04-18T21:06:59.715 INFO:tasks.workunit.client.0.smithi078.stdout:8/355: dwrite d0/d10/d14/d2d/f35 [4194304,4194304] 0 2024-04-18T21:06:59.715 INFO:tasks.workunit.client.0.smithi078.stdout:7/423: truncate d1/d16/dc/d11/f29 4399876 0 2024-04-18T21:06:59.715 INFO:tasks.workunit.client.0.smithi078.stdout:4/444: chown d0/dc/d29/d2f/f35 52 1 2024-04-18T21:06:59.715 INFO:tasks.workunit.client.0.smithi078.stdout:5/406: dwrite d9/d2e/d65/f6a [0,4194304] 0 2024-04-18T21:06:59.716 INFO:tasks.workunit.client.0.smithi078.stdout:9/432: getdents d7/d11/d1b/d45 0 2024-04-18T21:06:59.716 INFO:tasks.workunit.client.0.smithi078.stdout:3/361: dwrite d4/d2d/d30/d35/f33 [0,4194304] 0 2024-04-18T21:06:59.716 INFO:tasks.workunit.client.0.smithi078.stdout:1/457: write d0/d2a/d5f/d89/d32/f67 [62472,60298] 0 2024-04-18T21:06:59.716 INFO:tasks.workunit.client.0.smithi078.stdout:8/356: unlink d0/d10/f51 0 2024-04-18T21:06:59.716 INFO:tasks.workunit.client.0.smithi078.stdout:9/433: rmdir d7/df/d54 39 2024-04-18T21:06:59.716 INFO:tasks.workunit.client.0.smithi078.stdout:6/333: write d2/d6/dd/d4b/d5d/f6f [3672852,116416] 0 2024-04-18T21:06:59.716 INFO:tasks.workunit.client.0.smithi078.stdout:7/424: symlink d1/d16/dc/d86/d91/l98 0 2024-04-18T21:06:59.716 INFO:tasks.workunit.client.0.smithi078.stdout:4/445: rename d0/dc/d10/d41/d5f/la0 to d0/dc/d29/d6d/la1 0 2024-04-18T21:06:59.716 INFO:tasks.workunit.client.0.smithi078.stdout:9/434: mkdir d7/d11/d1b/d45/d4b/d93 0 2024-04-18T21:06:59.716 INFO:tasks.workunit.client.0.smithi078.stdout:3/362: rename d4/d2d/d30/d35/f56 to d4/f64 0 2024-04-18T21:06:59.716 INFO:tasks.workunit.client.0.smithi078.stdout:6/334: link d2/d1f/f47 d2/d34/d35/d57/f71 0 2024-04-18T21:06:59.716 INFO:tasks.workunit.client.0.smithi078.stdout:8/357: link d0/f67 d0/d10/d14/d2a/f68 0 2024-04-18T21:06:59.716 INFO:tasks.workunit.client.0.smithi078.stdout:4/446: mknod d0/dc/d29/d6d/d82/ca2 0 2024-04-18T21:06:59.716 INFO:tasks.workunit.client.0.smithi078.stdout:7/425: symlink d1/d16/d10/l99 0 2024-04-18T21:06:59.717 INFO:tasks.workunit.client.0.smithi078.stdout:9/435: link d7/d11/d47/f5c d7/df/d1e/d7b/f94 0 2024-04-18T21:06:59.717 INFO:tasks.workunit.client.0.smithi078.stdout:3/363: creat d4/d2d/d30/d35/d4b/f65 x:0 0 0 2024-04-18T21:06:59.717 INFO:tasks.workunit.client.0.smithi078.stdout:4/447: creat d0/dc/d10/d41/d5f/fa3 x:0 0 0 2024-04-18T21:06:59.717 INFO:tasks.workunit.client.0.smithi078.stdout:8/358: creat d0/d10/d14/d2a/d3c/f69 x:0 0 0 2024-04-18T21:06:59.717 INFO:tasks.workunit.client.0.smithi078.stdout:9/436: write d7/d23/f75 [3668814,81054] 0 2024-04-18T21:06:59.717 INFO:tasks.workunit.client.0.smithi078.stdout:3/364: stat d4/c14 0 2024-04-18T21:06:59.717 INFO:tasks.workunit.client.0.smithi078.stdout:5/407: dwrite d9/d2e/d65/f6a [0,4194304] 0 2024-04-18T21:06:59.717 INFO:tasks.workunit.client.0.smithi078.stdout:4/448: dread - d0/dc/d5b/f8a zero size 2024-04-18T21:06:59.717 INFO:tasks.workunit.client.0.smithi078.stdout:3/365: chown d4/da/d11/f2c 247 1 2024-04-18T21:06:59.717 INFO:tasks.workunit.client.0.smithi078.stdout:4/449: dread - d0/dc/d10/d1c/d60/f90 zero size 2024-04-18T21:06:59.717 INFO:tasks.workunit.client.0.smithi078.stdout:1/458: dwrite d0/d2a/d2f/f9a [0,4194304] 0 2024-04-18T21:06:59.717 INFO:tasks.workunit.client.0.smithi078.stdout:8/359: rename d0/d10/l5b to d0/d5c/l6a 0 2024-04-18T21:06:59.717 INFO:tasks.workunit.client.0.smithi078.stdout:4/450: mknod d0/dc/d10/d1c/d60/d74/ca4 0 2024-04-18T21:06:59.717 INFO:tasks.workunit.client.0.smithi078.stdout:5/408: chown d9/f3c 2342 1 2024-04-18T21:06:59.718 INFO:tasks.workunit.client.0.smithi078.stdout:1/459: readlink d0/d2a/d3c/d4b/d4/l57 0 2024-04-18T21:06:59.718 INFO:tasks.workunit.client.0.smithi078.stdout:3/366: mkdir d4/da/d11/d66 0 2024-04-18T21:06:59.718 INFO:tasks.workunit.client.0.smithi078.stdout:4/451: write d0/f48 [3575854,125866] 0 2024-04-18T21:06:59.718 INFO:tasks.workunit.client.0.smithi078.stdout:3/367: dread d4/da/d11/f32 [0,4194304] 0 2024-04-18T21:06:59.718 INFO:tasks.workunit.client.0.smithi078.stdout:9/437: dwrite d7/df/d1e/f58 [0,4194304] 0 2024-04-18T21:06:59.718 INFO:tasks.workunit.client.0.smithi078.stdout:8/360: dwrite d0/d10/f1c [4194304,4194304] 0 2024-04-18T21:06:59.718 INFO:tasks.workunit.client.0.smithi078.stdout:1/460: mknod d0/d2a/d3c/d4b/d5e/ca2 0 2024-04-18T21:06:59.718 INFO:tasks.workunit.client.0.smithi078.stdout:0/447: dread d0/f5 [0,4194304] 0 2024-04-18T21:06:59.718 INFO:tasks.workunit.client.0.smithi078.stdout:9/438: dread - d7/df/d67/f89 zero size 2024-04-18T21:06:59.718 INFO:tasks.workunit.client.0.smithi078.stdout:3/368: getdents d4 0 2024-04-18T21:06:59.718 INFO:tasks.workunit.client.0.smithi078.stdout:8/361: rename d0/d10/d14/l25 to d0/d22/l6b 0 2024-04-18T21:06:59.718 INFO:tasks.workunit.client.0.smithi078.stdout:4/452: dwrite d0/f28 [0,4194304] 0 2024-04-18T21:06:59.718 INFO:tasks.workunit.client.0.smithi078.stdout:8/362: chown d0/d10/d14/d2a/d4a 1998585331 1 2024-04-18T21:06:59.722 INFO:tasks.workunit.client.0.smithi078.stdout:9/439: rename d7/d57 to d7/df/d54/d95 0 2024-04-18T21:06:59.722 INFO:tasks.workunit.client.0.smithi078.stdout:6/335: dread d2/d34/d35/d57/f71 [0,4194304] 0 2024-04-18T21:06:59.723 INFO:tasks.workunit.client.0.smithi078.stdout:4/453: creat d0/dc/d37/fa5 x:0 0 0 2024-04-18T21:06:59.723 INFO:tasks.workunit.client.0.smithi078.stdout:6/336: sync 2024-04-18T21:06:59.723 INFO:tasks.workunit.client.0.smithi078.stdout:5/409: dwrite d9/f3c [0,4194304] 0 2024-04-18T21:06:59.723 INFO:tasks.workunit.client.0.smithi078.stdout:6/337: read d2/d6/f16 [194659,112207] 0 2024-04-18T21:06:59.723 INFO:tasks.workunit.client.0.smithi078.stdout:0/448: dread d0/d9/d58/f74 [0,4194304] 0 2024-04-18T21:06:59.723 INFO:tasks.workunit.client.0.smithi078.stdout:1/461: link d0/d2a/d5f/d89/d32/d35/f99 d0/d2a/d5f/d89/d32/d35/d71/fa3 0 2024-04-18T21:06:59.723 INFO:tasks.workunit.client.0.smithi078.stdout:9/440: mknod d7/d11/d1b/d45/c96 0 2024-04-18T21:06:59.723 INFO:tasks.workunit.client.0.smithi078.stdout:8/363: link d0/f45 d0/d5c/d5a/f6c 0 2024-04-18T21:06:59.723 INFO:tasks.workunit.client.0.smithi078.stdout:6/338: creat d2/d1c/d67/f72 x:0 0 0 2024-04-18T21:06:59.723 INFO:tasks.workunit.client.0.smithi078.stdout:4/454: symlink d0/dc/d10/la6 0 2024-04-18T21:06:59.723 INFO:tasks.workunit.client.0.smithi078.stdout:1/462: mknod d0/d2a/d5f/d89/d77/ca4 0 2024-04-18T21:06:59.723 INFO:tasks.workunit.client.0.smithi078.stdout:5/410: creat d9/da/d3e/f81 x:0 0 0 2024-04-18T21:06:59.723 INFO:tasks.workunit.client.0.smithi078.stdout:2/390: dread d0/db/d18/d21/d27/d29/f69 [0,4194304] 0 2024-04-18T21:06:59.723 INFO:tasks.workunit.client.0.smithi078.stdout:3/369: dwrite d4/d2d/d30/f48 [0,4194304] 0 2024-04-18T21:06:59.723 INFO:tasks.workunit.client.0.smithi078.stdout:8/364: fsync d0/d10/d14/f58 0 2024-04-18T21:06:59.724 INFO:tasks.workunit.client.0.smithi078.stdout:4/455: fsync d0/dc/d10/f95 0 2024-04-18T21:06:59.724 INFO:tasks.workunit.client.0.smithi078.stdout:6/339: chown d2/d1f/f2e 373326 1 2024-04-18T21:06:59.724 INFO:tasks.workunit.client.0.smithi078.stdout:6/340: sync 2024-04-18T21:06:59.724 INFO:tasks.workunit.client.0.smithi078.stdout:1/463: mkdir d0/d2a/d45/da5 0 2024-04-18T21:06:59.724 INFO:tasks.workunit.client.0.smithi078.stdout:4/456: stat d0/c69 0 2024-04-18T21:06:59.724 INFO:tasks.workunit.client.0.smithi078.stdout:9/441: rmdir d7/d11/d1b/d45/d4b/d93 0 2024-04-18T21:06:59.724 INFO:tasks.workunit.client.0.smithi078.stdout:1/464: chown d0/d2a/c84 5023 1 2024-04-18T21:06:59.724 INFO:tasks.workunit.client.0.smithi078.stdout:5/411: mknod d9/da/d3e/d4c/d67/d7c/d78/c82 0 2024-04-18T21:06:59.724 INFO:tasks.workunit.client.0.smithi078.stdout:3/370: write d4/f18 [5114644,53243] 0 2024-04-18T21:06:59.724 INFO:tasks.workunit.client.0.smithi078.stdout:6/341: creat d2/d34/d35/d57/f73 x:0 0 0 2024-04-18T21:06:59.724 INFO:tasks.workunit.client.0.smithi078.stdout:2/391: rename d0/db/d18/d21/d27/d29/d33/f75 to d0/db/d18/d30/f77 0 2024-04-18T21:06:59.724 INFO:tasks.workunit.client.0.smithi078.stdout:1/465: write d0/d2a/d2f/f44 [2333769,27419] 0 2024-04-18T21:06:59.724 INFO:tasks.workunit.client.0.smithi078.stdout:3/371: chown d4/f13 200740219 1 2024-04-18T21:06:59.724 INFO:tasks.workunit.client.0.smithi078.stdout:8/365: rmdir d0/d10/d14/d2a 39 2024-04-18T21:06:59.724 INFO:tasks.workunit.client.0.smithi078.stdout:3/372: mknod d4/d2d/d30/d35/c67 0 2024-04-18T21:06:59.725 INFO:tasks.workunit.client.0.smithi078.stdout:9/442: dwrite d7/f24 [0,4194304] 0 2024-04-18T21:06:59.725 INFO:tasks.workunit.client.0.smithi078.stdout:4/457: dwrite d0/dc/d29/d2f/f61 [0,4194304] 0 2024-04-18T21:06:59.725 INFO:tasks.workunit.client.0.smithi078.stdout:9/443: write d7/f59 [1724072,6608] 0 2024-04-18T21:06:59.725 INFO:tasks.workunit.client.0.smithi078.stdout:3/373: dwrite d4/d2d/d30/d35/f33 [0,4194304] 0 2024-04-18T21:06:59.725 INFO:tasks.workunit.client.0.smithi078.stdout:4/458: mkdir d0/dc/d29/d2f/da7 0 2024-04-18T21:06:59.725 INFO:tasks.workunit.client.0.smithi078.stdout:9/444: mkdir d7/d11/d2d/d26/d97 0 2024-04-18T21:06:59.725 INFO:tasks.workunit.client.0.smithi078.stdout:3/374: chown d4/df/d17/c24 38602968 1 2024-04-18T21:06:59.725 INFO:tasks.workunit.client.0.smithi078.stdout:4/459: symlink d0/dc/d10/d85/la8 0 2024-04-18T21:06:59.725 INFO:tasks.workunit.client.0.smithi078.stdout:3/375: symlink d4/df/d17/d41/l68 0 2024-04-18T21:06:59.728 INFO:tasks.workunit.client.0.smithi078.stdout:9/445: dwrite d7/d11/d1b/d45/d4b/f56 [0,4194304] 0 2024-04-18T21:06:59.729 INFO:tasks.workunit.client.0.smithi078.stdout:4/460: dwrite d0/dc/d5b/d4f/f79 [0,4194304] 0 2024-04-18T21:06:59.730 INFO:tasks.workunit.client.0.smithi078.stdout:4/461: truncate d0/dc/d5b/d4f/f77 1864330 0 2024-04-18T21:06:59.730 INFO:tasks.workunit.client.0.smithi078.stdout:4/462: dread - d0/dc/d10/d85/f9d zero size 2024-04-18T21:06:59.731 INFO:tasks.workunit.client.0.smithi078.stdout:4/463: rename d0/dc/d10/d3a/d7e to d0/d73/da9 0 2024-04-18T21:06:59.732 INFO:tasks.workunit.client.0.smithi078.stdout:4/464: creat d0/dc/d29/faa x:0 0 0 2024-04-18T21:06:59.732 INFO:tasks.workunit.client.0.smithi078.stdout:4/465: unlink d0/dc/d10/d1c/d60/f7a 0 2024-04-18T21:06:59.733 INFO:tasks.workunit.client.0.smithi078.stdout:0/449: truncate d0/d9/da/db/d35/f78 39225 0 2024-04-18T21:06:59.733 INFO:tasks.workunit.client.0.smithi078.stdout:4/466: symlink d0/d73/lab 0 2024-04-18T21:06:59.734 INFO:tasks.workunit.client.0.smithi078.stdout:8/366: write d0/f67 [4833291,67748] 0 2024-04-18T21:06:59.734 INFO:tasks.workunit.client.0.smithi078.stdout:2/392: read d0/db/d18/f3e [3343620,56646] 0 2024-04-18T21:06:59.734 INFO:tasks.workunit.client.0.smithi078.stdout:0/450: write d0/d9/da/db/f2c [2086777,76599] 0 2024-04-18T21:06:59.735 INFO:tasks.workunit.client.0.smithi078.stdout:4/467: creat d0/dc/d29/d2f/fac x:0 0 0 2024-04-18T21:06:59.735 INFO:tasks.workunit.client.0.smithi078.stdout:8/367: link d0/f5 d0/d5c/d5a/f6d 0 2024-04-18T21:06:59.736 INFO:tasks.workunit.client.0.smithi078.stdout:6/342: sync 2024-04-18T21:06:59.736 INFO:tasks.workunit.client.0.smithi078.stdout:5/412: sync 2024-04-18T21:06:59.736 INFO:tasks.workunit.client.0.smithi078.stdout:2/393: chown d0/db/d18/d21/c5f 27033 1 2024-04-18T21:06:59.736 INFO:tasks.workunit.client.0.smithi078.stdout:0/451: symlink d0/d9/d81/l86 0 2024-04-18T21:06:59.736 INFO:tasks.workunit.client.0.smithi078.stdout:4/468: creat d0/dc/d29/d2f/da7/fad x:0 0 0 2024-04-18T21:06:59.738 INFO:tasks.workunit.client.0.smithi078.stdout:1/466: dwrite d0/d2a/d3c/d4b/f24 [0,4194304] 0 2024-04-18T21:06:59.738 INFO:tasks.workunit.client.0.smithi078.stdout:2/394: link d0/db/d18/d21/d27/d29/f2f d0/d1f/d34/f78 0 2024-04-18T21:06:59.739 INFO:tasks.workunit.client.0.smithi078.stdout:1/467: write d0/d11/f21 [913421,54464] 0 2024-04-18T21:06:59.740 INFO:tasks.workunit.client.0.smithi078.stdout:2/395: mkdir d0/db/d18/d21/d27/d79 0 2024-04-18T21:06:59.741 INFO:tasks.workunit.client.0.smithi078.stdout:1/468: unlink d0/d2a/d3c/d4b/l6e 0 2024-04-18T21:06:59.743 INFO:tasks.workunit.client.0.smithi078.stdout:8/368: dwrite d0/d22/f61 [0,4194304] 0 2024-04-18T21:06:59.744 INFO:tasks.workunit.client.0.smithi078.stdout:6/343: dwrite d2/d6/dd/f69 [0,4194304] 0 2024-04-18T21:06:59.744 INFO:tasks.workunit.client.0.smithi078.stdout:4/469: dread d0/f58 [0,4194304] 0 2024-04-18T21:06:59.745 INFO:tasks.workunit.client.0.smithi078.stdout:6/344: readlink d2/d1c/l4d 0 2024-04-18T21:06:59.746 INFO:tasks.workunit.client.0.smithi078.stdout:3/376: truncate d4/d2d/d30/d35/f4f 2918905 0 2024-04-18T21:06:59.746 INFO:tasks.workunit.client.0.smithi078.stdout:4/470: creat d0/dc/d5b/fae x:0 0 0 2024-04-18T21:06:59.747 INFO:tasks.workunit.client.0.smithi078.stdout:6/345: unlink d2/d6/dd/d4b/f4e 0 2024-04-18T21:06:59.747 INFO:tasks.workunit.client.0.smithi078.stdout:3/377: write d4/da/f4a [2501901,121404] 0 2024-04-18T21:06:59.749 INFO:tasks.workunit.client.0.smithi078.stdout:2/396: dread d0/db/d18/f1c [0,4194304] 0 2024-04-18T21:06:59.751 INFO:tasks.workunit.client.0.smithi078.stdout:9/446: truncate d7/f46 2095036 0 2024-04-18T21:06:59.752 INFO:tasks.workunit.client.0.smithi078.stdout:8/369: dwrite d0/d10/d14/f1e [0,4194304] 0 2024-04-18T21:06:59.752 INFO:tasks.workunit.client.0.smithi078.stdout:0/452: truncate d0/f8 5910120 0 2024-04-18T21:06:59.752 INFO:tasks.workunit.client.0.smithi078.stdout:9/447: mkdir d7/d11/d1b/d98 0 2024-04-18T21:06:59.753 INFO:tasks.workunit.client.0.smithi078.stdout:0/453: fsync d0/d9/da/db/f68 0 2024-04-18T21:06:59.754 INFO:tasks.workunit.client.0.smithi078.stdout:5/413: dread d9/da/d3e/d4c/d6d/d73/f43 [0,4194304] 0 2024-04-18T21:06:59.755 INFO:tasks.workunit.client.0.smithi078.stdout:4/471: truncate d0/dc/d10/d1c/f67 934903 0 2024-04-18T21:06:59.755 INFO:tasks.workunit.client.0.smithi078.stdout:3/378: dwrite d4/f18 [0,4194304] 0 2024-04-18T21:06:59.755 INFO:tasks.workunit.client.0.smithi078.stdout:4/472: dread - d0/dc/d10/d3a/f9c zero size 2024-04-18T21:06:59.757 INFO:tasks.workunit.client.0.smithi078.stdout:4/473: mkdir d0/dc/d10/d1c/d60/daf 0 2024-04-18T21:06:59.757 INFO:tasks.workunit.client.0.smithi078.stdout:3/379: rename d4/da/d57/l58 to d4/da/d11/d66/l69 0 2024-04-18T21:06:59.760 INFO:tasks.workunit.client.0.smithi078.stdout:3/380: dread - d4/df/d17/f5a zero size 2024-04-18T21:06:59.761 INFO:tasks.workunit.client.0.smithi078.stdout:4/474: symlink d0/dc/d29/d6d/d7b/lb0 0 2024-04-18T21:06:59.763 INFO:tasks.workunit.client.0.smithi078.stdout:2/397: dwrite d0/db/f36 [0,4194304] 0 2024-04-18T21:06:59.763 INFO:tasks.workunit.client.0.smithi078.stdout:8/370: write d0/d5c/d5a/f6d [2722667,88464] 0 2024-04-18T21:06:59.765 INFO:tasks.workunit.client.0.smithi078.stdout:3/381: chown d4/d2d/d30/l3d 868552656 1 2024-04-18T21:06:59.765 INFO:tasks.workunit.client.0.smithi078.stdout:0/454: dwrite d0/d9/d58/f6d [0,4194304] 0 2024-04-18T21:06:59.766 INFO:tasks.workunit.client.0.smithi078.stdout:8/371: symlink d0/d22/l6e 0 2024-04-18T21:06:59.766 INFO:tasks.workunit.client.0.smithi078.stdout:3/382: fdatasync d4/da/d11/f21 0 2024-04-18T21:06:59.766 INFO:tasks.workunit.client.0.smithi078.stdout:5/414: dwrite f8 [0,4194304] 0 2024-04-18T21:06:59.767 INFO:tasks.workunit.client.0.smithi078.stdout:0/455: readlink d0/d9/da/db/d35/l36 0 2024-04-18T21:06:59.768 INFO:tasks.workunit.client.0.smithi078.stdout:0/456: write d0/d9/dd/d17/d2e/d31/f4a [360419,1683] 0 2024-04-18T21:06:59.769 INFO:tasks.workunit.client.0.smithi078.stdout:4/475: truncate d0/d73/f75 2734510 0 2024-04-18T21:06:59.771 INFO:tasks.workunit.client.0.smithi078.stdout:4/476: unlink d0/dc/d29/d6d/la1 0 2024-04-18T21:06:59.773 INFO:tasks.workunit.client.0.smithi078.stdout:5/415: dwrite d9/da/d3e/f81 [0,4194304] 0 2024-04-18T21:06:59.774 INFO:tasks.workunit.client.0.smithi078.stdout:8/372: write d0/f45 [107593,130267] 0 2024-04-18T21:06:59.774 INFO:tasks.workunit.client.0.smithi078.stdout:3/383: truncate d4/da/d11/f32 228612 0 2024-04-18T21:06:59.775 INFO:tasks.workunit.client.0.smithi078.stdout:2/398: dwrite d0/d1f/d34/f78 [4194304,4194304] 0 2024-04-18T21:06:59.775 INFO:tasks.workunit.client.0.smithi078.stdout:5/416: symlink d9/d2e/d65/l83 0 2024-04-18T21:06:59.775 INFO:tasks.workunit.client.0.smithi078.stdout:3/384: write d4/d2d/d30/f34 [3062977,28758] 0 2024-04-18T21:06:59.776 INFO:tasks.workunit.client.0.smithi078.stdout:3/385: creat d4/f6a x:0 0 0 2024-04-18T21:06:59.778 INFO:tasks.workunit.client.0.smithi078.stdout:8/373: dread d0/d10/d14/d2a/f68 [8388608,4194304] 0 2024-04-18T21:06:59.779 INFO:tasks.workunit.client.0.smithi078.stdout:8/374: rename d0/d10/d14/d2a/d41 to d0/d10/d60/d6f 0 2024-04-18T21:06:59.779 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:59.778+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:59.781 INFO:tasks.workunit.client.0.smithi078.stdout:8/375: rmdir d0/d10/d14/d2a/d3a 39 2024-04-18T21:06:59.781 INFO:tasks.workunit.client.0.smithi078.stdout:5/417: dwrite d9/da/d3e/d4c/d6d/d73/f40 [0,4194304] 0 2024-04-18T21:06:59.782 INFO:tasks.workunit.client.0.smithi078.stdout:5/418: chown d9/da/d3e/d4c/d67/d7c 13 1 2024-04-18T21:06:59.783 INFO:tasks.workunit.client.0.smithi078.stdout:4/477: dwrite d0/dc/d10/d1c/d6a/d81/f8b [0,4194304] 0 2024-04-18T21:06:59.786 INFO:tasks.workunit.client.0.smithi078.stdout:3/386: symlink d4/da/d57/l6b 0 2024-04-18T21:06:59.789 INFO:tasks.workunit.client.0.smithi078.stdout:6/346: sync 2024-04-18T21:06:59.789 INFO:tasks.workunit.client.0.smithi078.stdout:9/448: sync 2024-04-18T21:06:59.789 INFO:tasks.workunit.client.0.smithi078.stdout:8/376: creat d0/d10/d14/f70 x:0 0 0 2024-04-18T21:06:59.789 INFO:tasks.workunit.client.0.smithi078.stdout:6/347: mkdir d2/d74 0 2024-04-18T21:06:59.789 INFO:tasks.workunit.client.0.smithi078.stdout:9/449: fdatasync d7/df/d1e/f58 0 2024-04-18T21:06:59.789 INFO:tasks.workunit.client.0.smithi078.stdout:3/387: mkdir d4/d2d/d6c 0 2024-04-18T21:06:59.790 INFO:tasks.workunit.client.0.smithi078.stdout:6/348: mkdir d2/d34/d75 0 2024-04-18T21:06:59.791 INFO:tasks.workunit.client.0.smithi078.stdout:5/419: dwrite d9/da/d3e/f81 [4194304,4194304] 0 2024-04-18T21:06:59.792 INFO:tasks.workunit.client.0.smithi078.stdout:3/388: creat d4/da/f6d x:0 0 0 2024-04-18T21:06:59.792 INFO:tasks.workunit.client.0.smithi078.stdout:5/420: stat d9/fe 0 2024-04-18T21:06:59.792 INFO:tasks.workunit.client.0.smithi078.stdout:9/450: getdents d7/df 0 2024-04-18T21:06:59.793 INFO:tasks.workunit.client.0.smithi078.stdout:4/478: dwrite d0/dc/d5b/d71/f56 [0,4194304] 0 2024-04-18T21:06:59.793 INFO:tasks.workunit.client.0.smithi078.stdout:6/349: rename d2/d6/dd/l28 to d2/d1f/l76 0 2024-04-18T21:06:59.794 INFO:tasks.workunit.client.0.smithi078.stdout:5/421: fsync d9/f64 0 2024-04-18T21:06:59.794 INFO:tasks.workunit.client.0.smithi078.stdout:9/451: write d7/df/f2a [4119499,58632] 0 2024-04-18T21:06:59.794 INFO:tasks.workunit.client.0.smithi078.stdout:4/479: stat d0/dc/d37/c3c 0 2024-04-18T21:06:59.794 INFO:tasks.workunit.client.0.smithi078.stdout:6/350: readlink d2/d34/d35/d57/l6e 0 2024-04-18T21:06:59.794 INFO:tasks.workunit.client.0.smithi078.stdout:6/351: dread - d2/d34/d35/d57/f73 zero size 2024-04-18T21:06:59.795 INFO:tasks.workunit.client.0.smithi078.stdout:9/452: read - d7/d11/d1b/d45/d4b/d5d/f8d zero size 2024-04-18T21:06:59.795 INFO:tasks.workunit.client.0.smithi078.stdout:3/389: symlink d4/d2d/d30/d35/d4b/d59/l6e 0 2024-04-18T21:06:59.795 INFO:tasks.workunit.client.0.smithi078.stdout:5/422: mknod d9/da/d3e/d4c/c84 0 2024-04-18T21:06:59.796 INFO:tasks.workunit.client.0.smithi078.stdout:9/453: dread - d7/d11/d1b/f84 zero size 2024-04-18T21:06:59.796 INFO:tasks.workunit.client.0.smithi078.stdout:6/352: rename d2/d6/fc to d2/d34/f77 0 2024-04-18T21:06:59.797 INFO:tasks.workunit.client.0.smithi078.stdout:9/454: symlink d7/d11/d1b/d77/l99 0 2024-04-18T21:06:59.797 INFO:tasks.workunit.client.0.smithi078.stdout:6/353: creat d2/d1c/d63/f78 x:0 0 0 2024-04-18T21:06:59.797 INFO:tasks.workunit.client.0.smithi078.stdout:3/390: truncate d4/d2d/d30/d35/d4b/d59/f5f 225701 0 2024-04-18T21:06:59.798 INFO:tasks.workunit.client.0.smithi078.stdout:1/469: dread d0/d11/f7f [0,4194304] 0 2024-04-18T21:06:59.798 INFO:tasks.workunit.client.0.smithi078.stdout:5/423: mknod d9/da/d3e/d4c/d6d/d73/d55/d5d/c85 0 2024-04-18T21:06:59.798 INFO:tasks.workunit.client.0.smithi078.stdout:6/354: symlink d2/d1c/l79 0 2024-04-18T21:06:59.801 INFO:tasks.workunit.client.0.smithi078.stdout:4/480: dwrite d0/dc/d10/d85/f9d [0,4194304] 0 2024-04-18T21:06:59.801 INFO:tasks.workunit.client.0.smithi078.stdout:6/355: mkdir d2/d7a 0 2024-04-18T21:06:59.802 INFO:tasks.workunit.client.0.smithi078.stdout:1/470: rename d0/d2a/d5f/d89/f2c to d0/d2a/d2f/d50/fa6 0 2024-04-18T21:06:59.802 INFO:tasks.workunit.client.0.smithi078.stdout:6/356: symlink d2/d74/l7b 0 2024-04-18T21:06:59.803 INFO:tasks.workunit.client.0.smithi078.stdout:4/481: creat d0/dc/d10/d1c/d60/d74/fb1 x:0 0 0 2024-04-18T21:06:59.804 INFO:tasks.workunit.client.0.smithi078.stdout:4/482: chown d0/dc/d10/d1c/d60/f7c 241579 1 2024-04-18T21:06:59.804 INFO:tasks.workunit.client.0.smithi078.stdout:1/471: unlink d0/d2a/d5f/d89/c60 0 2024-04-18T21:06:59.806 INFO:tasks.workunit.client.0.smithi078.stdout:9/455: dread d7/df/f2a [0,4194304] 0 2024-04-18T21:06:59.806 INFO:tasks.workunit.client.0.smithi078.stdout:4/483: mkdir d0/dc/d10/db2 0 2024-04-18T21:06:59.806 INFO:tasks.workunit.client.0.smithi078.stdout:6/357: getdents d2/d1f 0 2024-04-18T21:06:59.807 INFO:tasks.workunit.client.0.smithi078.stdout:9/456: fdatasync d7/d11/d2d/d3f/f6e 0 2024-04-18T21:06:59.807 INFO:tasks.workunit.client.0.smithi078.stdout:5/424: dwrite d9/da/f35 [0,4194304] 0 2024-04-18T21:06:59.807 INFO:tasks.workunit.client.0.smithi078.stdout:4/484: fsync d0/d73/f75 0 2024-04-18T21:06:59.808 INFO:tasks.workunit.client.0.smithi078.stdout:6/358: dread d2/d1f/f47 [0,4194304] 0 2024-04-18T21:06:59.808 INFO:tasks.workunit.client.0.smithi078.stdout:9/457: chown d7/df/f10 50 1 2024-04-18T21:06:59.809 INFO:tasks.workunit.client.0.smithi078.stdout:1/472: chown d0/d11/f7f 14 1 2024-04-18T21:06:59.809 INFO:tasks.workunit.client.0.smithi078.stdout:5/425: read d9/da/d32/f70 [1955568,104972] 0 2024-04-18T21:06:59.809 INFO:tasks.workunit.client.0.smithi078.stdout:4/485: mkdir d0/dc/d29/d2f/da7/db3 0 2024-04-18T21:06:59.809 INFO:tasks.workunit.client.0.smithi078.stdout:6/359: creat d2/d1c/d63/f7c x:0 0 0 2024-04-18T21:06:59.810 INFO:tasks.workunit.client.0.smithi078.stdout:8/377: dread d0/d10/d14/d2d/f3f [0,4194304] 0 2024-04-18T21:06:59.810 INFO:tasks.workunit.client.0.smithi078.stdout:8/378: rmdir d0/d10 39 2024-04-18T21:06:59.810 INFO:tasks.workunit.client.0.smithi078.stdout:5/426: read - d9/da/d3e/d4c/d67/f7b zero size 2024-04-18T21:06:59.810 INFO:tasks.workunit.client.0.smithi078.stdout:4/486: creat d0/dc/d29/d6d/d82/fb4 x:0 0 0 2024-04-18T21:06:59.811 INFO:tasks.workunit.client.0.smithi078.stdout:5/427: dread - d9/da/d3e/d4c/d6d/d73/d55/f6f zero size 2024-04-18T21:06:59.811 INFO:tasks.workunit.client.0.smithi078.stdout:4/487: creat d0/dc/d37/fb5 x:0 0 0 2024-04-18T21:06:59.812 INFO:tasks.workunit.client.0.smithi078.stdout:8/379: creat d0/d10/d14/d2a/f71 x:0 0 0 2024-04-18T21:06:59.812 INFO:tasks.workunit.client.0.smithi078.stdout:4/488: truncate d0/dc/d5b/fae 401053 0 2024-04-18T21:06:59.813 INFO:tasks.workunit.client.0.smithi078.stdout:8/380: stat d0/f36 0 2024-04-18T21:06:59.814 INFO:tasks.workunit.client.0.smithi078.stdout:8/381: mknod d0/c72 0 2024-04-18T21:06:59.814 INFO:tasks.workunit.client.0.smithi078.stdout:7/426: dread d1/d16/d1c/f34 [0,4194304] 0 2024-04-18T21:06:59.815 INFO:tasks.workunit.client.0.smithi078.stdout:8/382: symlink d0/d5c/l73 0 2024-04-18T21:06:59.815 INFO:tasks.workunit.client.0.smithi078.stdout:2/399: sync 2024-04-18T21:06:59.815 INFO:tasks.workunit.client.0.smithi078.stdout:7/427: fdatasync d1/d16/dc/f51 0 2024-04-18T21:06:59.815 INFO:tasks.workunit.client.0.smithi078.stdout:8/383: creat d0/d5c/f74 x:0 0 0 2024-04-18T21:06:59.816 INFO:tasks.workunit.client.0.smithi078.stdout:1/473: dwrite d0/d11/f7f [0,4194304] 0 2024-04-18T21:06:59.816 INFO:tasks.workunit.client.0.smithi078.stdout:8/384: readlink d0/d10/d14/l20 0 2024-04-18T21:06:59.817 INFO:tasks.workunit.client.0.smithi078.stdout:8/385: readlink d0/d22/l6e 0 2024-04-18T21:06:59.817 INFO:tasks.workunit.client.0.smithi078.stdout:8/386: stat d0/c44 0 2024-04-18T21:06:59.819 INFO:tasks.workunit.client.0.smithi078.stdout:8/387: unlink d0/d5c/l73 0 2024-04-18T21:06:59.819 INFO:tasks.workunit.client.0.smithi078.stdout:9/458: read d7/d11/d1b/f5f [495737,70191] 0 2024-04-18T21:06:59.820 INFO:tasks.workunit.client.0.smithi078.stdout:3/391: dread d4/da/d11/f22 [0,4194304] 0 2024-04-18T21:06:59.821 INFO:tasks.workunit.client.0.smithi078.stdout:1/474: rename d0/d2a/d5f/d89/d32/d35/d71/fa3 to d0/d2a/d5f/d89/d32/fa7 0 2024-04-18T21:06:59.822 INFO:tasks.workunit.client.0.smithi078.stdout:4/489: dwrite d0/d73/da9/f86 [0,4194304] 0 2024-04-18T21:06:59.823 INFO:tasks.workunit.client.0.smithi078.stdout:9/459: creat d7/d11/d1b/d45/d4b/d5d/f9a x:0 0 0 2024-04-18T21:06:59.823 INFO:tasks.workunit.client.0.smithi078.stdout:1/475: unlink d0/c53 0 2024-04-18T21:06:59.823 INFO:tasks.workunit.client.0.smithi078.stdout:8/388: write d0/d10/d14/d2d/f3f [1449219,55782] 0 2024-04-18T21:06:59.825 INFO:tasks.workunit.client.0.smithi078.stdout:4/490: rmdir d0/dc/d10/d1c 39 2024-04-18T21:06:59.825 INFO:tasks.workunit.client.0.smithi078.stdout:7/428: dwrite d1/d16/f46 [0,4194304] 0 2024-04-18T21:06:59.825 INFO:tasks.workunit.client.0.smithi078.stdout:9/460: unlink d7/d83/c8e 0 2024-04-18T21:06:59.825 INFO:tasks.workunit.client.0.smithi078.stdout:1/476: write d0/d2a/d2f/f38 [4794142,120896] 0 2024-04-18T21:06:59.825 INFO:tasks.workunit.client.0.smithi078.stdout:2/400: dwrite d0/f4d [0,4194304] 0 2024-04-18T21:06:59.826 INFO:tasks.workunit.client.0.smithi078.stdout:1/477: chown d0/d2a/d5f/f83 40488997 1 2024-04-18T21:06:59.826 INFO:tasks.workunit.client.0.smithi078.stdout:8/389: truncate d0/d10/d14/d2a/d3c/f69 399026 0 2024-04-18T21:06:59.827 INFO:tasks.workunit.client.0.smithi078.stdout:9/461: unlink d7/fa 0 2024-04-18T21:06:59.827 INFO:tasks.workunit.client.0.smithi078.stdout:2/401: creat d0/d1f/f7a x:0 0 0 2024-04-18T21:06:59.828 INFO:tasks.workunit.client.0.smithi078.stdout:7/429: mknod d1/d16/dc/d11/d53/d82/c9a 0 2024-04-18T21:06:59.828 INFO:tasks.workunit.client.0.smithi078.stdout:1/478: mkdir d0/d2a/d3c/da8 0 2024-04-18T21:06:59.828 INFO:tasks.workunit.client.0.smithi078.stdout:8/390: creat d0/d10/d14/d2a/d4a/f75 x:0 0 0 2024-04-18T21:06:59.828 INFO:tasks.workunit.client.0.smithi078.stdout:4/491: link d0/dc/d10/d85/f8d d0/dc/d5b/d71/fb6 0 2024-04-18T21:06:59.828 INFO:tasks.workunit.client.0.smithi078.stdout:7/430: write d1/d16/dc/d11/d53/f78 [349725,3207] 0 2024-04-18T21:06:59.829 INFO:tasks.workunit.client.0.smithi078.stdout:9/462: write d7/d11/d2d/f4e [460206,58468] 0 2024-04-18T21:06:59.830 INFO:tasks.workunit.client.0.smithi078.stdout:8/391: unlink d0/f2c 0 2024-04-18T21:06:59.830 INFO:tasks.workunit.client.0.smithi078.stdout:7/431: read - d1/d16/d1c/f2a zero size 2024-04-18T21:06:59.830 INFO:tasks.workunit.client.0.smithi078.stdout:4/492: write d0/dc/d10/d1c/f8e [1441930,85472] 0 2024-04-18T21:06:59.831 INFO:tasks.workunit.client.0.smithi078.stdout:1/479: rename d0/d2a/d3c/d4b/d4/l12 to d0/d2a/d3c/d4b/d4/d61/d75/la9 0 2024-04-18T21:06:59.832 INFO:tasks.workunit.client.0.smithi078.stdout:4/493: write d0/dc/d10/d41/d5f/fa3 [712039,8289] 0 2024-04-18T21:06:59.832 INFO:tasks.workunit.client.0.smithi078.stdout:7/432: creat d1/d16/dc/d4b/f9b x:0 0 0 2024-04-18T21:06:59.832 INFO:tasks.workunit.client.0.smithi078.stdout:2/402: dread d0/db/d18/d21/d27/d29/f2d [0,4194304] 0 2024-04-18T21:06:59.833 INFO:tasks.workunit.client.0.smithi078.stdout:8/392: getdents d0/d10/d14/d62 0 2024-04-18T21:06:59.833 INFO:tasks.workunit.client.0.smithi078.stdout:9/463: rmdir d7/d11/d2d/d3f/d4d/d92 0 2024-04-18T21:06:59.834 INFO:tasks.workunit.client.0.smithi078.stdout:4/494: rmdir d0/dc/d10 39 2024-04-18T21:06:59.834 INFO:tasks.workunit.client.0.smithi078.stdout:1/480: rename d0/d2a/d2f/c51 to d0/d11/caa 0 2024-04-18T21:06:59.834 INFO:tasks.workunit.client.0.smithi078.stdout:2/403: creat d0/d1f/d34/f7b x:0 0 0 2024-04-18T21:06:59.834 INFO:tasks.workunit.client.0.smithi078.stdout:1/481: fsync d0/d2a/f65 0 2024-04-18T21:06:59.835 INFO:tasks.workunit.client.0.smithi078.stdout:2/404: fsync d0/d1f/f44 0 2024-04-18T21:06:59.835 INFO:tasks.workunit.client.0.smithi078.stdout:4/495: creat d0/dc/d10/d41/d5f/fb7 x:0 0 0 2024-04-18T21:06:59.835 INFO:tasks.workunit.client.0.smithi078.stdout:8/393: truncate d0/d10/d14/d2a/d4a/f56 734418 0 2024-04-18T21:06:59.835 INFO:tasks.workunit.client.0.smithi078.stdout:2/405: write d0/d1f/d34/d40/f47 [507178,27740] 0 2024-04-18T21:06:59.836 INFO:tasks.workunit.client.0.smithi078.stdout:8/394: creat d0/d22/f76 x:0 0 0 2024-04-18T21:06:59.836 INFO:tasks.workunit.client.0.smithi078.stdout:2/406: mkdir d0/db/d18/d21/d27/d29/d57/d7c 0 2024-04-18T21:06:59.837 INFO:tasks.workunit.client.0.smithi078.stdout:2/407: stat d0/db/d18/d21/d27/d29/d4e/f71 0 2024-04-18T21:06:59.837 INFO:tasks.workunit.client.0.smithi078.stdout:8/395: link d0/c43 d0/d10/d14/d62/c77 0 2024-04-18T21:06:59.838 INFO:tasks.workunit.client.0.smithi078.stdout:2/408: dread - d0/db/d18/d21/d27/d29/d57/f61 zero size 2024-04-18T21:06:59.838 INFO:tasks.workunit.client.0.smithi078.stdout:8/396: truncate d0/d10/d60/d6f/f4e 1255548 0 2024-04-18T21:06:59.838 INFO:tasks.workunit.client.0.smithi078.stdout:8/397: chown d0/d22 259 1 2024-04-18T21:06:59.839 INFO:tasks.workunit.client.0.smithi078.stdout:1/482: fsync d0/d2a/d2f/f38 0 2024-04-18T21:06:59.839 INFO:tasks.workunit.client.0.smithi078.stdout:4/496: dread d0/dc/d10/d1c/d6a/d81/f8b [0,4194304] 0 2024-04-18T21:06:59.839 INFO:tasks.workunit.client.0.smithi078.stdout:8/398: chown d0/d10/d14/f58 483504442 1 2024-04-18T21:06:59.839 INFO:tasks.workunit.client.0.smithi078.stdout:1/483: creat d0/d2a/d5f/d89/d32/d35/fab x:0 0 0 2024-04-18T21:06:59.840 INFO:tasks.workunit.client.0.smithi078.stdout:8/399: creat d0/f78 x:0 0 0 2024-04-18T21:06:59.840 INFO:tasks.workunit.client.0.smithi078.stdout:8/400: write d0/f36 [884897,114930] 0 2024-04-18T21:06:59.841 INFO:tasks.workunit.client.0.smithi078.stdout:8/401: fdatasync d0/d5c/f48 0 2024-04-18T21:06:59.841 INFO:tasks.workunit.client.0.smithi078.stdout:1/484: creat d0/d2a/d5f/d89/d32/d35/d71/fac x:0 0 0 2024-04-18T21:06:59.841 INFO:tasks.workunit.client.0.smithi078.stdout:7/433: truncate d1/d16/d10/f19 1019175 0 2024-04-18T21:06:59.842 INFO:tasks.workunit.client.0.smithi078.stdout:1/485: unlink d0/d2a/d3c/d4b/d5e/l8d 0 2024-04-18T21:06:59.842 INFO:tasks.workunit.client.0.smithi078.stdout:8/402: chown d0/d10/d14/l40 10 1 2024-04-18T21:06:59.842 INFO:tasks.workunit.client.0.smithi078.stdout:7/434: dread - d1/d16/dc/d11/f6e zero size 2024-04-18T21:06:59.843 INFO:tasks.workunit.client.0.smithi078.stdout:1/486: creat d0/d2a/d45/da5/fad x:0 0 0 2024-04-18T21:06:59.843 INFO:tasks.workunit.client.0.smithi078.stdout:0/457: dread d0/d15/f27 [0,4194304] 0 2024-04-18T21:06:59.844 INFO:tasks.workunit.client.0.smithi078.stdout:0/458: chown d0/d9 78 1 2024-04-18T21:06:59.844 INFO:tasks.workunit.client.0.smithi078.stdout:0/459: fdatasync d0/d9/d58/f74 0 2024-04-18T21:06:59.844 INFO:tasks.workunit.client.0.smithi078.stdout:4/497: dread d0/dc/d10/d1c/f67 [0,4194304] 0 2024-04-18T21:06:59.845 INFO:tasks.workunit.client.0.smithi078.stdout:0/460: fsync d0/d9/dd/d17/d2e/f71 0 2024-04-18T21:06:59.846 INFO:tasks.workunit.client.0.smithi078.stdout:0/461: mknod d0/d9/c87 0 2024-04-18T21:06:59.846 INFO:tasks.workunit.client.0.smithi078.stdout:9/464: truncate d7/d11/d2d/f31 2573159 0 2024-04-18T21:06:59.848 INFO:tasks.workunit.client.0.smithi078.stdout:7/435: fdatasync d1/d16/dc/d11/d53/f78 0 2024-04-18T21:06:59.848 INFO:tasks.workunit.client.0.smithi078.stdout:9/465: mknod d7/d23/d7a/c9b 0 2024-04-18T21:06:59.849 INFO:tasks.workunit.client.0.smithi078.stdout:7/436: chown d1/d16/dc/d31 1953456 1 2024-04-18T21:06:59.850 INFO:tasks.workunit.client.0.smithi078.stdout:7/437: rmdir d1 39 2024-04-18T21:06:59.850 INFO:tasks.workunit.client.0.smithi078.stdout:9/466: mkdir d7/d11/d1b/d45/d4b/d5d/d6a/d9c 0 2024-04-18T21:06:59.852 INFO:tasks.workunit.client.0.smithi078.stdout:9/467: mkdir d7/df/d54/d95/d9d 0 2024-04-18T21:06:59.853 INFO:tasks.workunit.client.0.smithi078.stdout:9/468: chown d7/d11/d1b/c52 14585664 1 2024-04-18T21:06:59.854 INFO:tasks.workunit.client.0.smithi078.stdout:2/409: dread d0/db/f12 [0,4194304] 0 2024-04-18T21:06:59.854 INFO:tasks.workunit.client.0.smithi078.stdout:7/438: link d1/d16/c3a d1/d16/d10/c9c 0 2024-04-18T21:06:59.854 INFO:tasks.workunit.client.0.smithi078.stdout:1/487: dwrite d0/d11/f18 [0,4194304] 0 2024-04-18T21:06:59.854 INFO:tasks.workunit.client.0.smithi078.stdout:0/462: dwrite d0/d9/da/f84 [0,4194304] 0 2024-04-18T21:06:59.855 INFO:tasks.workunit.client.0.smithi078.stdout:7/439: dread - d1/d16/d10/f1a zero size 2024-04-18T21:06:59.855 INFO:tasks.workunit.client.0.smithi078.stdout:9/469: chown d7/df/d54/d95/c8f 0 1 2024-04-18T21:06:59.855 INFO:tasks.workunit.client.0.smithi078.stdout:0/463: read - d0/d9/d58/f62 zero size 2024-04-18T21:06:59.856 INFO:tasks.workunit.client.0.smithi078.stdout:7/440: write d1/f5e [1737806,87209] 0 2024-04-18T21:06:59.856 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:06:59.856 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:06:59.856 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:59.856 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:1411 3.18 3.ebe89178 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-18T21:06:59.857 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:59.858999+0000", 2024-04-18T21:06:59.857 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.000141242, 2024-04-18T21:06:59.857 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000162275, 2024-04-18T21:06:59.857 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:06:59.857 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:06:59.857 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-18T21:06:59.857 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:06:59.857 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:59.857 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:06:59.857 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.858999+0000", 2024-04-18T21:06:59.857 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:59.858 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:59.858 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:59.858 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:06:59.858 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.858999+0000", 2024-04-18T21:06:59.858 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:06:59.858 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:59.858 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:59.858 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:06:59.858 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.859000+0000", 2024-04-18T21:06:59.858 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3300000000000001e-07 2024-04-18T21:06:59.858 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:59.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:59.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:06:59.859 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.859012+0000", 2024-04-18T21:06:59.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2396e-05 2024-04-18T21:06:59.859 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:59.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:59.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:06:59.859 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.859020+0000", 2024-04-18T21:06:59.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1370000000000002e-06 2024-04-18T21:06:59.859 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:59.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:59.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:06:59.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.859027+0000", 2024-04-18T21:06:59.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8329999999999996e-06 2024-04-18T21:06:59.860 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:06:59.860 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:06:59.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:06:59.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.859136+0000", 2024-04-18T21:06:59.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109011 2024-04-18T21:06:59.860 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:59.860 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:06:59.860 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:59.860 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:06:59.860 INFO:teuthology.orchestra.run.smithi187.stdout: ], 2024-04-18T21:06:59.861 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 1 2024-04-18T21:06:59.861 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:06:59.862 INFO:tasks.workunit.client.0.smithi078.stdout:0/464: link d0/d15/f64 d0/d9/d7d/f88 0 2024-04-18T21:06:59.862 INFO:tasks.workunit.client.0.smithi078.stdout:9/470: link d7/d11/d1b/f84 d7/d83/f9e 0 2024-04-18T21:06:59.862 INFO:tasks.workunit.client.0.smithi078.stdout:9/471: read d7/df/f21 [3158247,78884] 0 2024-04-18T21:06:59.862 INFO:tasks.workunit.client.0.smithi078.stdout:0/465: mkdir d0/d9/d4c/d89 0 2024-04-18T21:06:59.862 INFO:tasks.workunit.client.0.smithi078.stdout:2/410: dread d0/f54 [0,4194304] 0 2024-04-18T21:06:59.862 INFO:tasks.workunit.client.0.smithi078.stdout:9/472: creat d7/d11/d80/f9f x:0 0 0 2024-04-18T21:06:59.862 INFO:tasks.workunit.client.0.smithi078.stdout:9/473: symlink d7/d11/d80/la0 0 2024-04-18T21:06:59.863 INFO:tasks.workunit.client.0.smithi078.stdout:2/411: mknod d0/db/d18/d21/c7d 0 2024-04-18T21:06:59.863 INFO:tasks.workunit.client.0.smithi078.stdout:1/488: dwrite d0/d2a/d3c/d4b/f3e [0,4194304] 0 2024-04-18T21:06:59.863 INFO:tasks.workunit.client.0.smithi078.stdout:2/412: truncate d0/d1f/f44 8199159 0 2024-04-18T21:06:59.863 INFO:tasks.workunit.client.0.smithi078.stdout:1/489: creat d0/d2a/d5f/d89/d32/d35/d71/fae x:0 0 0 2024-04-18T21:06:59.864 INFO:tasks.workunit.client.0.smithi078.stdout:2/413: chown d0/db/d18/d21/c5f 150787951 1 2024-04-18T21:06:59.864 INFO:tasks.workunit.client.0.smithi078.stdout:1/490: readlink d0/d2a/d3c/d4b/d52/l58 0 2024-04-18T21:06:59.865 INFO:tasks.workunit.client.0.smithi078.stdout:2/414: write d0/f1e [928095,117261] 0 2024-04-18T21:06:59.866 INFO:tasks.workunit.client.0.smithi078.stdout:1/491: chown d0/d2a/d3c/d4b/d4/d61/c95 81 1 2024-04-18T21:06:59.866 INFO:tasks.workunit.client.0.smithi078.stdout:2/415: creat d0/d1f/f7e x:0 0 0 2024-04-18T21:06:59.867 INFO:tasks.workunit.client.0.smithi078.stdout:1/492: unlink d0/d2a/d2f/d50/l6c 0 2024-04-18T21:06:59.869 INFO:tasks.workunit.client.0.smithi078.stdout:9/474: dwrite d7/d11/d1b/d77/f87 [0,4194304] 0 2024-04-18T21:06:59.871 INFO:tasks.workunit.client.0.smithi078.stdout:0/466: dread d0/d9/da/db/d35/f20 [0,4194304] 0 2024-04-18T21:06:59.875 INFO:tasks.workunit.client.0.smithi078.stdout:1/493: dwrite d0/d11/f2e [0,4194304] 0 2024-04-18T21:06:59.876 INFO:tasks.workunit.client.0.smithi078.stdout:8/403: dread d0/f5 [0,4194304] 0 2024-04-18T21:06:59.877 INFO:tasks.workunit.client.0.smithi078.stdout:6/360: sync 2024-04-18T21:06:59.877 INFO:tasks.workunit.client.0.smithi078.stdout:5/428: sync 2024-04-18T21:06:59.877 INFO:tasks.workunit.client.0.smithi078.stdout:3/392: sync 2024-04-18T21:06:59.879 INFO:tasks.workunit.client.0.smithi078.stdout:8/404: mknod d0/d5c/d5a/c79 0 2024-04-18T21:06:59.879 INFO:tasks.workunit.client.0.smithi078.stdout:1/494: mknod d0/d2a/d5f/caf 0 2024-04-18T21:06:59.879 INFO:tasks.workunit.client.0.smithi078.stdout:8/405: chown d0/d10/d14/d2a/d3c/l4f 438079820 1 2024-04-18T21:06:59.879 INFO:tasks.workunit.client.0.smithi078.stdout:5/429: dread - d9/da/d3e/d4c/d6d/d73/d55/f72 zero size 2024-04-18T21:06:59.879 INFO:tasks.workunit.client.0.smithi078.stdout:0/467: dread d0/d9/da/db/d35/f78 [0,4194304] 0 2024-04-18T21:06:59.880 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:06:59.881 INFO:tasks.workunit.client.0.smithi078.stdout:0/468: creat d0/d6c/f8a x:0 0 0 2024-04-18T21:06:59.881 INFO:tasks.workunit.client.0.smithi078.stdout:6/361: rename d2/d6/dd/l3d to d2/d1f/l7d 0 2024-04-18T21:06:59.881 INFO:tasks.workunit.client.0.smithi078.stdout:0/469: fsync d0/d9/d4c/d70/f85 0 2024-04-18T21:06:59.882 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:59.878+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:59.885 INFO:tasks.workunit.client.0.smithi078.stdout:1/495: truncate d0/d2a/d5f/d89/f17 1192145 0 2024-04-18T21:06:59.886 INFO:tasks.workunit.client.0.smithi078.stdout:6/362: dwrite d2/d1f/f2c [4194304,4194304] 0 2024-04-18T21:06:59.887 INFO:tasks.workunit.client.0.smithi078.stdout:1/496: creat d0/d2a/d5f/d89/d32/d35/d85/fb0 x:0 0 0 2024-04-18T21:06:59.887 INFO:tasks.workunit.client.0.smithi078.stdout:4/498: dread d0/dc/d29/f51 [4194304,4194304] 0 2024-04-18T21:06:59.888 INFO:tasks.workunit.client.0.smithi078.stdout:6/363: write d2/d1c/d67/f72 [551130,5081] 0 2024-04-18T21:06:59.889 INFO:tasks.workunit.client.0.smithi078.stdout:1/497: mknod d0/d2a/cb1 0 2024-04-18T21:06:59.889 INFO:tasks.workunit.client.0.smithi078.stdout:4/499: read - d0/dc/d10/f95 zero size 2024-04-18T21:06:59.889 INFO:tasks.workunit.client.0.smithi078.stdout:5/430: dwrite d9/da/d32/f70 [0,4194304] 0 2024-04-18T21:06:59.890 INFO:tasks.workunit.client.0.smithi078.stdout:8/406: dread d0/f45 [0,4194304] 0 2024-04-18T21:06:59.890 INFO:tasks.workunit.client.0.smithi078.stdout:1/498: truncate d0/d2a/d3c/f6b 4265291 0 2024-04-18T21:06:59.890 INFO:tasks.workunit.client.0.smithi078.stdout:5/431: write d9/d2e/f23 [357538,49690] 0 2024-04-18T21:06:59.891 INFO:tasks.workunit.client.0.smithi078.stdout:5/432: mkdir d9/da/d3e/d4c/d6d/d86 0 2024-04-18T21:06:59.896 INFO:tasks.workunit.client.0.smithi078.stdout:7/441: dread d1/d16/dc/d11/d53/f78 [0,4194304] 0 2024-04-18T21:06:59.897 INFO:tasks.workunit.client.0.smithi078.stdout:4/500: dwrite d0/dc/d10/d1c/d6a/d81/f8b [0,4194304] 0 2024-04-18T21:06:59.897 INFO:tasks.workunit.client.0.smithi078.stdout:7/442: fsync d1/d16/dc/d11/d53/f78 0 2024-04-18T21:06:59.898 INFO:tasks.workunit.client.0.smithi078.stdout:5/433: dwrite d9/da/d32/f70 [4194304,4194304] 0 2024-04-18T21:06:59.900 INFO:tasks.workunit.client.0.smithi078.stdout:8/407: read d0/d10/d14/d2a/d3c/f69 [209662,5397] 0 2024-04-18T21:06:59.900 INFO:tasks.workunit.client.0.smithi078.stdout:5/434: creat d9/da/d3e/d4c/f87 x:0 0 0 2024-04-18T21:06:59.900 INFO:tasks.workunit.client.0.smithi078.stdout:7/443: creat d1/d16/dc/d86/f9d x:0 0 0 2024-04-18T21:06:59.900 INFO:tasks.workunit.client.0.smithi078.stdout:8/408: dread - d0/d22/f76 zero size 2024-04-18T21:06:59.901 INFO:tasks.workunit.client.0.smithi078.stdout:5/435: mknod d9/d2e/d65/c88 0 2024-04-18T21:06:59.901 INFO:tasks.workunit.client.0.smithi078.stdout:8/409: readlink d0/d10/d14/l40 0 2024-04-18T21:06:59.901 INFO:tasks.workunit.client.0.smithi078.stdout:2/416: dread d0/db/d18/d21/d27/f58 [0,4194304] 0 2024-04-18T21:06:59.901 INFO:tasks.workunit.client.0.smithi078.stdout:8/410: unlink d0/f78 0 2024-04-18T21:06:59.902 INFO:tasks.workunit.client.0.smithi078.stdout:2/417: chown d0/db/d18/d21/d27/d29/d33/f76 71 1 2024-04-18T21:06:59.902 INFO:tasks.workunit.client.0.smithi078.stdout:8/411: rename d0/d10/d14/f4c to d0/d10/d60/d6f/f7a 0 2024-04-18T21:06:59.903 INFO:tasks.workunit.client.0.smithi078.stdout:5/436: creat d9/da/d3e/d4c/d6d/d73/d55/f89 x:0 0 0 2024-04-18T21:06:59.904 INFO:tasks.workunit.client.0.smithi078.stdout:2/418: creat d0/db/d18/d21/d27/d79/f7f x:0 0 0 2024-04-18T21:06:59.904 INFO:tasks.workunit.client.0.smithi078.stdout:2/419: readlink d0/d1f/l48 0 2024-04-18T21:06:59.905 INFO:tasks.workunit.client.0.smithi078.stdout:5/437: rename d9/da/d3e/d4c/d6d/d73/f36 to d9/da/d3e/d4c/f8a 0 2024-04-18T21:06:59.906 INFO:tasks.workunit.client.0.smithi078.stdout:2/420: write d0/db/d18/d21/d27/f56 [738125,91862] 0 2024-04-18T21:06:59.906 INFO:tasks.workunit.client.0.smithi078.stdout:5/438: write d9/f44 [38707,18275] 0 2024-04-18T21:06:59.907 INFO:tasks.workunit.client.0.smithi078.stdout:7/444: dwrite d1/d32/f62 [0,4194304] 0 2024-04-18T21:06:59.907 INFO:tasks.workunit.client.0.smithi078.stdout:2/421: readlink d0/db/d65/l67 0 2024-04-18T21:06:59.907 INFO:tasks.workunit.client.0.smithi078.stdout:5/439: mkdir d9/da/d4b/d8b 0 2024-04-18T21:06:59.908 INFO:tasks.workunit.client.0.smithi078.stdout:7/445: rmdir d1/d16/d2d 39 2024-04-18T21:06:59.909 INFO:tasks.workunit.client.0.smithi078.stdout:2/422: creat d0/db/d18/d21/d27/d29/d4e/f80 x:0 0 0 2024-04-18T21:06:59.909 INFO:tasks.workunit.client.0.smithi078.stdout:8/412: truncate d0/d5c/d5a/f6d 868339 0 2024-04-18T21:06:59.910 INFO:tasks.workunit.client.0.smithi078.stdout:8/413: mkdir d0/d5c/d5a/d7b 0 2024-04-18T21:06:59.910 INFO:tasks.workunit.client.0.smithi078.stdout:2/423: rename d0/f1e to d0/d1f/d34/f81 0 2024-04-18T21:06:59.913 INFO:tasks.workunit.client.0.smithi078.stdout:8/414: dread d0/d10/d14/d2a/d4a/f56 [0,4194304] 0 2024-04-18T21:06:59.914 INFO:tasks.workunit.client.0.smithi078.stdout:8/415: rename d0/d10/c46 to d0/d10/c7c 0 2024-04-18T21:06:59.914 INFO:tasks.workunit.client.0.smithi078.stdout:5/440: write d9/d2e/f26 [1646316,102567] 0 2024-04-18T21:06:59.915 INFO:tasks.workunit.client.0.smithi078.stdout:7/446: dwrite d1/d16/d65/f6c [0,4194304] 0 2024-04-18T21:06:59.915 INFO:tasks.workunit.client.0.smithi078.stdout:8/416: creat d0/d10/d14/d2a/d4a/f7d x:0 0 0 2024-04-18T21:06:59.916 INFO:tasks.workunit.client.0.smithi078.stdout:2/424: readlink d0/db/d18/d21/d27/l38 0 2024-04-18T21:06:59.916 INFO:tasks.workunit.client.0.smithi078.stdout:8/417: truncate d0/f45 728898 0 2024-04-18T21:06:59.917 INFO:tasks.workunit.client.0.smithi078.stdout:8/418: creat d0/d10/d14/d2a/d4a/f7e x:0 0 0 2024-04-18T21:06:59.917 INFO:tasks.workunit.client.0.smithi078.stdout:8/419: chown d0/d10/d14/c28 1505383 1 2024-04-18T21:06:59.919 INFO:tasks.workunit.client.0.smithi078.stdout:8/420: creat d0/d10/d60/d6f/f7f x:0 0 0 2024-04-18T21:06:59.919 INFO:tasks.workunit.client.0.smithi078.stdout:9/475: sync 2024-04-18T21:06:59.921 INFO:tasks.workunit.client.0.smithi078.stdout:6/364: dread d2/d6/dd/d4b/f5f [0,4194304] 0 2024-04-18T21:06:59.922 INFO:tasks.workunit.client.0.smithi078.stdout:2/425: dread d0/db/d18/d21/f31 [4194304,4194304] 0 2024-04-18T21:06:59.924 INFO:tasks.workunit.client.0.smithi078.stdout:7/447: dwrite d1/f57 [0,4194304] 0 2024-04-18T21:06:59.924 INFO:tasks.workunit.client.0.smithi078.stdout:5/441: dwrite d9/da/d3e/d4c/d6d/d73/d55/d62/f63 [0,4194304] 0 2024-04-18T21:06:59.925 INFO:tasks.workunit.client.0.smithi078.stdout:6/365: symlink d2/d6/dd/l7e 0 2024-04-18T21:06:59.925 INFO:tasks.workunit.client.0.smithi078.stdout:7/448: read - d1/d16/dc/f55 zero size 2024-04-18T21:06:59.926 INFO:tasks.workunit.client.0.smithi078.stdout:5/442: write d9/da/d32/f51 [6786026,47843] 0 2024-04-18T21:06:59.927 INFO:tasks.workunit.client.0.smithi078.stdout:6/366: write d2/d34/d35/f40 [873777,53008] 0 2024-04-18T21:06:59.927 INFO:tasks.workunit.client.0.smithi078.stdout:5/443: mkdir d9/da/d8c 0 2024-04-18T21:06:59.928 INFO:tasks.workunit.client.0.smithi078.stdout:8/421: dwrite d0/f36 [0,4194304] 0 2024-04-18T21:06:59.928 INFO:tasks.workunit.client.0.smithi078.stdout:7/449: write d1/d16/d1c/f34 [891582,77117] 0 2024-04-18T21:06:59.930 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T21:06:59.943 INFO:tasks.workunit.client.0.smithi078.stdout:9/476: dwrite d7/df/f21 [0,4194304] 0 2024-04-18T21:06:59.943 INFO:tasks.workunit.client.0.smithi078.stdout:6/367: rename d2/d7a to d2/d1c/d67/d7f 0 2024-04-18T21:06:59.943 INFO:tasks.workunit.client.0.smithi078.stdout:5/444: mkdir d9/da/d3e/d4c/d67/d8d 0 2024-04-18T21:06:59.943 INFO:tasks.workunit.client.0.smithi078.stdout:9/477: creat d7/d11/d2d/d3f/d4d/fa1 x:0 0 0 2024-04-18T21:06:59.943 INFO:tasks.workunit.client.0.smithi078.stdout:7/450: rename d1/d16/d10/f8a to d1/d16/d10/d7c/d7e/d97/f9e 0 2024-04-18T21:06:59.944 INFO:tasks.workunit.client.0.smithi078.stdout:5/445: chown d9/d2e/f66 451455664 1 2024-04-18T21:06:59.944 INFO:tasks.workunit.client.0.smithi078.stdout:9/478: chown d7/d23/f75 15982 1 2024-04-18T21:06:59.944 INFO:tasks.workunit.client.0.smithi078.stdout:5/446: write d9/da/d3e/f81 [7389350,15419] 0 2024-04-18T21:06:59.944 INFO:tasks.workunit.client.0.smithi078.stdout:7/451: symlink d1/d16/d10/d7c/d7e/d97/l9f 0 2024-04-18T21:06:59.944 INFO:tasks.workunit.client.0.smithi078.stdout:7/452: read - d1/d16/dc/f5b zero size 2024-04-18T21:06:59.944 INFO:tasks.workunit.client.0.smithi078.stdout:2/426: dwrite d0/db/d18/d21/d27/d29/d4e/f71 [0,4194304] 0 2024-04-18T21:06:59.944 INFO:tasks.workunit.client.0.smithi078.stdout:1/499: sync 2024-04-18T21:06:59.944 INFO:tasks.workunit.client.0.smithi078.stdout:0/470: sync 2024-04-18T21:06:59.944 INFO:tasks.workunit.client.0.smithi078.stdout:9/479: unlink d7/df/d54/f85 0 2024-04-18T21:06:59.944 INFO:tasks.workunit.client.0.smithi078.stdout:6/368: link d2/d6/f16 d2/d34/d35/f80 0 2024-04-18T21:06:59.944 INFO:tasks.workunit.client.0.smithi078.stdout:4/501: dread d0/dc/d29/f51 [0,4194304] 0 2024-04-18T21:06:59.944 INFO:tasks.workunit.client.0.smithi078.stdout:5/447: getdents d9/da/d8c 0 2024-04-18T21:06:59.944 INFO:tasks.workunit.client.0.smithi078.stdout:7/453: truncate d1/d16/d65/f6a 728258 0 2024-04-18T21:06:59.945 INFO:tasks.workunit.client.0.smithi078.stdout:8/422: dwrite d0/fd [4194304,4194304] 0 2024-04-18T21:06:59.945 INFO:tasks.workunit.client.0.smithi078.stdout:4/502: chown d0/dc/d29/d2f/f38 8546485 1 2024-04-18T21:06:59.945 INFO:tasks.workunit.client.0.smithi078.stdout:6/369: write d2/d6/f59 [536140,15097] 0 2024-04-18T21:06:59.945 INFO:tasks.workunit.client.0.smithi078.stdout:2/427: creat d0/db/d18/d21/d27/d29/d4e/f82 x:0 0 0 2024-04-18T21:06:59.945 INFO:tasks.workunit.client.0.smithi078.stdout:7/454: chown d1/d16/f26 22545596 1 2024-04-18T21:06:59.945 INFO:tasks.workunit.client.0.smithi078.stdout:6/370: write d2/d1c/d63/f78 [93859,54325] 0 2024-04-18T21:06:59.945 INFO:tasks.workunit.client.0.smithi078.stdout:4/503: write d0/dc/d10/d3a/f9c [692448,15768] 0 2024-04-18T21:06:59.945 INFO:tasks.workunit.client.0.smithi078.stdout:6/371: write d2/d6/dd/f32 [1427035,62759] 0 2024-04-18T21:06:59.945 INFO:tasks.workunit.client.0.smithi078.stdout:9/480: truncate d7/d11/d1b/d45/d4b/d5d/f8d 110321 0 2024-04-18T21:06:59.946 INFO:tasks.workunit.client.0.smithi078.stdout:8/423: mknod d0/d5c/d5a/d7b/c80 0 2024-04-18T21:06:59.947 INFO:tasks.workunit.client.0.smithi078.stdout:4/504: mkdir d0/dc/d5b/d4f/d83/db8 0 2024-04-18T21:06:59.947 INFO:tasks.workunit.client.0.smithi078.stdout:6/372: write d2/d6/dd/f69 [2785556,109257] 0 2024-04-18T21:06:59.947 INFO:tasks.workunit.client.0.smithi078.stdout:2/428: read d0/f10 [1091282,127027] 0 2024-04-18T21:06:59.947 INFO:tasks.workunit.client.0.smithi078.stdout:5/448: getdents d9/da/d3e/d4c/d67/d7c 0 2024-04-18T21:06:59.947 INFO:tasks.workunit.client.0.smithi078.stdout:8/424: chown d0/f55 1452 1 2024-04-18T21:06:59.947 INFO:tasks.workunit.client.0.smithi078.stdout:4/505: rmdir d0/d73 39 2024-04-18T21:06:59.947 INFO:tasks.workunit.client.0.smithi078.stdout:9/481: rmdir d7/d11/d1b/d45/d4b/d5d/d6a/d9c 0 2024-04-18T21:06:59.947 INFO:tasks.workunit.client.0.smithi078.stdout:5/449: readlink d9/da/d3e/d4c/d67/l71 0 2024-04-18T21:06:59.947 INFO:tasks.workunit.client.0.smithi078.stdout:8/425: dread - d0/d10/d14/d2a/f71 zero size 2024-04-18T21:06:59.948 INFO:tasks.workunit.client.0.smithi078.stdout:4/506: rename d0/dc/d37/fb5 to d0/dc/d10/d1c/d6a/fb9 0 2024-04-18T21:06:59.948 INFO:tasks.workunit.client.0.smithi078.stdout:2/429: dread d0/db/f16 [4194304,4194304] 0 2024-04-18T21:06:59.948 INFO:tasks.workunit.client.0.smithi078.stdout:5/450: chown d9/da/l10 24 1 2024-04-18T21:06:59.949 INFO:tasks.workunit.client.0.smithi078.stdout:6/373: getdents d2/d34/d35/d57 0 2024-04-18T21:06:59.949 INFO:tasks.workunit.client.0.smithi078.stdout:7/455: dwrite d1/d16/d10/f44 [0,4194304] 0 2024-04-18T21:06:59.950 INFO:tasks.workunit.client.0.smithi078.stdout:4/507: write d0/dc/d10/d85/f9d [174369,89395] 0 2024-04-18T21:06:59.951 INFO:tasks.workunit.client.0.smithi078.stdout:1/500: write d0/d2a/d5f/d89/f49 [5025787,127573] 0 2024-04-18T21:06:59.951 INFO:tasks.workunit.client.0.smithi078.stdout:5/451: creat d9/d2e/d65/f8e x:0 0 0 2024-04-18T21:06:59.951 INFO:tasks.workunit.client.0.smithi078.stdout:2/430: fsync d0/db/d18/d21/d27/d29/f6b 0 2024-04-18T21:06:59.951 INFO:tasks.workunit.client.0.smithi078.stdout:4/508: readlink d0/d73/lab 0 2024-04-18T21:06:59.952 INFO:tasks.workunit.client.0.smithi078.stdout:6/374: link d2/d1c/f53 d2/d1c/d63/f81 0 2024-04-18T21:06:59.952 INFO:tasks.workunit.client.0.smithi078.stdout:9/482: truncate d7/df/d1e/d7b/f94 589676 0 2024-04-18T21:06:59.952 INFO:tasks.workunit.client.0.smithi078.stdout:1/501: write d0/d2a/d45/da5/fad [128618,121801] 0 2024-04-18T21:06:59.953 INFO:tasks.workunit.client.0.smithi078.stdout:7/456: write d1/d16/dc/d11/f7a [4299338,13167] 0 2024-04-18T21:06:59.953 INFO:tasks.workunit.client.0.smithi078.stdout:2/431: symlink d0/d1f/l83 0 2024-04-18T21:06:59.954 INFO:tasks.workunit.client.0.smithi078.stdout:0/471: dwrite d0/d9/da/db/d35/f78 [0,4194304] 0 2024-04-18T21:06:59.954 INFO:tasks.workunit.client.0.smithi078.stdout:3/393: dread d4/fd [4194304,4194304] 0 2024-04-18T21:06:59.954 INFO:tasks.workunit.client.0.smithi078.stdout:4/509: creat d0/dc/d10/d1c/d60/d74/fba x:0 0 0 2024-04-18T21:06:59.955 INFO:tasks.workunit.client.0.smithi078.stdout:5/452: creat d9/da/d3e/d4c/d6d/d73/d55/f8f x:0 0 0 2024-04-18T21:06:59.955 INFO:tasks.workunit.client.0.smithi078.stdout:0/472: fsync d0/d9/d58/f63 0 2024-04-18T21:06:59.955 INFO:tasks.workunit.client.0.smithi078.stdout:9/483: creat d7/d11/d2d/d26/d97/fa2 x:0 0 0 2024-04-18T21:06:59.956 INFO:tasks.workunit.client.0.smithi078.stdout:2/432: mknod d0/d1f/d34/d40/c84 0 2024-04-18T21:06:59.956 INFO:tasks.workunit.client.0.smithi078.stdout:3/394: symlink d4/df/d17/d41/l6f 0 2024-04-18T21:06:59.956 INFO:tasks.workunit.client.0.smithi078.stdout:0/473: fdatasync d0/d9/f2d 0 2024-04-18T21:06:59.956 INFO:tasks.workunit.client.0.smithi078.stdout:5/453: rmdir d9/da/d3e/d4c/d6d/d73/d55 39 2024-04-18T21:06:59.956 INFO:tasks.workunit.client.0.smithi078.stdout:7/457: truncate d1/d16/d10/f13 1922386 0 2024-04-18T21:06:59.957 INFO:tasks.workunit.client.0.smithi078.stdout:5/454: write d9/da/ff [6265969,55658] 0 2024-04-18T21:06:59.958 INFO:tasks.workunit.client.0.smithi078.stdout:0/474: symlink d0/d9/dd/l8b 0 2024-04-18T21:06:59.959 INFO:tasks.workunit.client.0.smithi078.stdout:0/475: creat d0/d6c/f8c x:0 0 0 2024-04-18T21:06:59.962 INFO:tasks.workunit.client.0.smithi078.stdout:2/433: dwrite d0/db/d18/d21/d27/d29/f2d [0,4194304] 0 2024-04-18T21:06:59.963 INFO:tasks.workunit.client.0.smithi078.stdout:2/434: chown d0/f10 0 1 2024-04-18T21:06:59.964 INFO:tasks.workunit.client.0.smithi078.stdout:6/375: truncate d2/f21 3617240 0 2024-04-18T21:06:59.964 INFO:tasks.workunit.client.0.smithi078.stdout:2/435: chown d0/db/d18/d21/d27/d29/d33/f4c 89 1 2024-04-18T21:06:59.965 INFO:tasks.workunit.client.0.smithi078.stdout:4/510: dread d0/dc/d37/f3b [0,4194304] 0 2024-04-18T21:06:59.965 INFO:tasks.workunit.client.0.smithi078.stdout:6/376: write d2/d1c/d63/f78 [811136,44515] 0 2024-04-18T21:06:59.966 INFO:tasks.workunit.client.0.smithi078.stdout:0/476: dwrite d0/d6c/f8a [0,4194304] 0 2024-04-18T21:06:59.966 INFO:tasks.workunit.client.0.smithi078.stdout:5/455: rename d9/da/d3e/d4c/d6d/d73/d55 to d9/da/d90 0 2024-04-18T21:06:59.967 INFO:tasks.workunit.client.0.smithi078.stdout:1/502: truncate d0/d2a/d5f/d89/f49 1802839 0 2024-04-18T21:06:59.967 INFO:tasks.workunit.client.0.smithi078.stdout:4/511: symlink d0/dc/d10/d1c/lbb 0 2024-04-18T21:06:59.967 INFO:tasks.workunit.client.0.smithi078.stdout:6/377: unlink d2/d6/dd/cb 0 2024-04-18T21:06:59.967 INFO:tasks.workunit.client.0.smithi078.stdout:0/477: dread - d0/d9/d4c/d70/f7c zero size 2024-04-18T21:06:59.968 INFO:tasks.workunit.client.0.smithi078.stdout:2/436: link d0/db/d18/d21/d27/d29/d57/l66 d0/db/d18/d21/d27/d29/d4e/l85 0 2024-04-18T21:06:59.968 INFO:tasks.workunit.client.0.smithi078.stdout:5/456: write d9/d2e/f26 [1537460,53590] 0 2024-04-18T21:06:59.968 INFO:tasks.workunit.client.0.smithi078.stdout:4/512: mknod d0/dc/d5b/cbc 0 2024-04-18T21:06:59.968 INFO:tasks.workunit.client.0.smithi078.stdout:6/378: readlink d2/d34/d35/d57/l6e 0 2024-04-18T21:06:59.968 INFO:tasks.workunit.client.0.smithi078.stdout:4/513: sync 2024-04-18T21:06:59.968 INFO:tasks.workunit.client.0.smithi078.stdout:0/478: creat d0/d9/d81/f8d x:0 0 0 2024-04-18T21:06:59.969 INFO:tasks.workunit.client.0.smithi078.stdout:0/479: unlink d0/d15/f64 0 2024-04-18T21:06:59.969 INFO:tasks.workunit.client.0.smithi078.stdout:2/437: symlink d0/db/d18/d21/d27/d29/l86 0 2024-04-18T21:06:59.969 INFO:tasks.workunit.client.0.smithi078.stdout:4/514: unlink d0/dc/d10/f9e 0 2024-04-18T21:06:59.970 INFO:tasks.workunit.client.0.smithi078.stdout:0/480: chown d0/d9/dd/d17/d2e/d7f 16559120 1 2024-04-18T21:06:59.970 INFO:tasks.workunit.client.0.smithi078.stdout:6/379: creat d2/d6/dd/d4b/d5d/f82 x:0 0 0 2024-04-18T21:06:59.970 INFO:tasks.workunit.client.0.smithi078.stdout:4/515: rmdir d0/dc/d5b 39 2024-04-18T21:06:59.971 INFO:tasks.workunit.client.0.smithi078.stdout:0/481: symlink d0/d9/d4c/l8e 0 2024-04-18T21:06:59.971 INFO:tasks.workunit.client.0.smithi078.stdout:4/516: rmdir d0/dc/d29/d6d/d82 39 2024-04-18T21:06:59.971 INFO:tasks.workunit.client.0.smithi078.stdout:6/380: rename d2/d6/f44 to d2/d1c/d63/f83 0 2024-04-18T21:06:59.971 INFO:tasks.workunit.client.0.smithi078.stdout:2/438: write d0/db/d18/d21/d27/d29/d4e/f82 [153510,117577] 0 2024-04-18T21:06:59.972 INFO:tasks.workunit.client.0.smithi078.stdout:0/482: mkdir d0/d9/d4c/d8f 0 2024-04-18T21:06:59.972 INFO:tasks.workunit.client.0.smithi078.stdout:4/517: creat d0/d73/da9/fbd x:0 0 0 2024-04-18T21:06:59.972 INFO:tasks.workunit.client.0.smithi078.stdout:2/439: mkdir d0/d87 0 2024-04-18T21:06:59.973 INFO:tasks.workunit.client.0.smithi078.stdout:4/518: chown d0/dc/d29/d2f/c4b 808706458 1 2024-04-18T21:06:59.974 INFO:tasks.workunit.client.0.smithi078.stdout:4/519: fdatasync d0/dc/d29/d2f/da7/fad 0 2024-04-18T21:06:59.974 INFO:tasks.workunit.client.0.smithi078.stdout:4/520: sync 2024-04-18T21:06:59.974 INFO:tasks.workunit.client.0.smithi078.stdout:3/395: read d4/df/d17/f3a [1031705,50823] 0 2024-04-18T21:06:59.975 INFO:tasks.workunit.client.0.smithi078.stdout:4/521: chown d0/dc/d10/d1c/d60/c68 3229705 1 2024-04-18T21:06:59.975 INFO:tasks.workunit.client.0.smithi078.stdout:6/381: truncate d2/d6/f14 2520686 0 2024-04-18T21:06:59.976 INFO:tasks.workunit.client.0.smithi078.stdout:3/396: write d4/d2d/d30/d35/f33 [2033424,104427] 0 2024-04-18T21:06:59.976 INFO:tasks.workunit.client.0.smithi078.stdout:4/522: symlink d0/dc/d10/d41/d5f/lbe 0 2024-04-18T21:06:59.976 INFO:tasks.workunit.client.0.smithi078.stdout:0/483: dread d0/d9/da/db/d35/f20 [0,4194304] 0 2024-04-18T21:06:59.977 INFO:tasks.workunit.client.0.smithi078.stdout:4/523: write d0/d73/da9/f80 [2227422,127154] 0 2024-04-18T21:06:59.977 INFO:tasks.workunit.client.0.smithi078.stdout:0/484: readlink d0/d9/da/db/d35/l36 0 2024-04-18T21:06:59.977 INFO:tasks.workunit.client.0.smithi078.stdout:3/397: truncate d4/d2d/d30/f60 388645 0 2024-04-18T21:06:59.978 INFO:tasks.workunit.client.0.smithi078.stdout:4/524: chown d0/dc/d10/f42 3 1 2024-04-18T21:06:59.978 INFO:tasks.workunit.client.0.smithi078.stdout:3/398: write d4/df/f1f [312842,13065] 0 2024-04-18T21:06:59.979 INFO:tasks.workunit.client.0.smithi078.stdout:3/399: fsync d4/d2d/d30/d35/f4f 0 2024-04-18T21:06:59.979 INFO:tasks.workunit.client.0.smithi078.stdout:4/525: truncate d0/dc/d10/d1c/d60/f7c 746095 0 2024-04-18T21:06:59.980 INFO:tasks.workunit.client.0.smithi078.stdout:3/400: write d4/df/d17/d41/f44 [187031,52473] 0 2024-04-18T21:06:59.980 INFO:tasks.workunit.client.0.smithi078.stdout:4/526: creat d0/dc/d10/d1c/d6a/d81/fbf x:0 0 0 2024-04-18T21:06:59.982 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:06:59.978+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:06:59.983 INFO:tasks.workunit.client.0.smithi078.stdout:2/440: read d0/d1f/f2b [117695,56841] 0 2024-04-18T21:06:59.985 INFO:tasks.workunit.client.0.smithi078.stdout:2/441: fsync d0/db/d18/d21/d27/f68 0 2024-04-18T21:06:59.986 INFO:tasks.workunit.client.0.smithi078.stdout:5/457: dread d9/da/d32/f51 [4194304,4194304] 0 2024-04-18T21:06:59.987 INFO:tasks.workunit.client.0.smithi078.stdout:2/442: chown d0/db/d18/d21/d27/d29/d57 245482737 1 2024-04-18T21:06:59.987 INFO:tasks.workunit.client.0.smithi078.stdout:5/458: fdatasync f8 0 2024-04-18T21:06:59.987 INFO:tasks.workunit.client.0.smithi078.stdout:3/401: dwrite d4/da/d11/f2c [0,4194304] 0 2024-04-18T21:06:59.988 INFO:tasks.workunit.client.0.smithi078.stdout:4/527: dwrite d0/f58 [0,4194304] 0 2024-04-18T21:06:59.991 INFO:tasks.workunit.client.0.smithi078.stdout:5/459: creat d9/da/d3e/d4c/d67/f91 x:0 0 0 2024-04-18T21:06:59.993 INFO:tasks.workunit.client.0.smithi078.stdout:3/402: write d4/fd [6561346,70745] 0 2024-04-18T21:06:59.994 INFO:tasks.workunit.client.0.smithi078.stdout:3/403: creat d4/f70 x:0 0 0 2024-04-18T21:06:59.996 INFO:tasks.workunit.client.0.smithi078.stdout:2/443: dwrite d0/f55 [0,4194304] 0 2024-04-18T21:07:00.001 INFO:tasks.workunit.client.0.smithi078.stdout:2/444: write d0/d1f/d34/f53 [8586353,11752] 0 2024-04-18T21:07:00.003 INFO:tasks.workunit.client.0.smithi078.stdout:5/460: dwrite d9/da/d4b/f4e [0,4194304] 0 2024-04-18T21:07:00.004 INFO:tasks.workunit.client.0.smithi078.stdout:3/404: dwrite d4/df/f1f [4194304,4194304] 0 2024-04-18T21:07:00.004 INFO:tasks.workunit.client.0.smithi078.stdout:2/445: mkdir d0/d87/d88 0 2024-04-18T21:07:00.005 INFO:tasks.workunit.client.0.smithi078.stdout:4/528: dwrite d0/dc/d10/d3a/f40 [0,4194304] 0 2024-04-18T21:07:00.005 INFO:tasks.workunit.client.0.smithi078.stdout:3/405: write d4/f6a [156363,26369] 0 2024-04-18T21:07:00.006 INFO:tasks.workunit.client.0.smithi078.stdout:2/446: symlink d0/d87/l89 0 2024-04-18T21:07:00.007 INFO:tasks.workunit.client.0.smithi078.stdout:5/461: rmdir d9/da/d3e/d4c/d6d/d73 39 2024-04-18T21:07:00.007 INFO:tasks.workunit.client.0.smithi078.stdout:3/406: chown d4/d2d/f55 1 1 2024-04-18T21:07:00.007 INFO:tasks.workunit.client.0.smithi078.stdout:5/462: truncate d9/d2e/f66 740197 0 2024-04-18T21:07:00.008 INFO:tasks.workunit.client.0.smithi078.stdout:3/407: write d4/d2d/f55 [83718,11884] 0 2024-04-18T21:07:00.012 INFO:tasks.workunit.client.0.smithi078.stdout:9/484: dread d7/d23/d3e/d5a/f5e [0,4194304] 0 2024-04-18T21:07:00.013 INFO:tasks.workunit.client.0.smithi078.stdout:9/485: write d7/d11/d1b/d45/d4b/f56 [232207,60801] 0 2024-04-18T21:07:00.014 INFO:tasks.workunit.client.0.smithi078.stdout:2/447: truncate d0/db/d18/d21/f2c 76994 0 2024-04-18T21:07:00.014 INFO:tasks.workunit.client.0.smithi078.stdout:7/458: dread d1/d16/d10/d7c/d7e/d97/f9e [0,4194304] 0 2024-04-18T21:07:00.017 INFO:tasks.workunit.client.0.smithi078.stdout:9/486: read d7/f3d [419672,37128] 0 2024-04-18T21:07:00.017 INFO:tasks.workunit.client.0.smithi078.stdout:5/463: dwrite d9/da/d3e/d4c/f87 [0,4194304] 0 2024-04-18T21:07:00.017 INFO:tasks.workunit.client.0.smithi078.stdout:7/459: mknod d1/d16/d10/ca0 0 2024-04-18T21:07:00.017 INFO:tasks.workunit.client.0.smithi078.stdout:6/382: dread d2/d34/f77 [4194304,4194304] 0 2024-04-18T21:07:00.018 INFO:tasks.workunit.client.0.smithi078.stdout:7/460: unlink d1/d32/f62 0 2024-04-18T21:07:00.018 INFO:tasks.workunit.client.0.smithi078.stdout:9/487: chown d7/df/d1e/l44 424857 1 2024-04-18T21:07:00.018 INFO:tasks.workunit.client.0.smithi078.stdout:9/488: dread - d7/f86 zero size 2024-04-18T21:07:00.019 INFO:tasks.workunit.client.0.smithi078.stdout:5/464: link d9/l2a d9/da/d32/l92 0 2024-04-18T21:07:00.020 INFO:tasks.workunit.client.0.smithi078.stdout:6/383: rename d2/d34/d35/c38 to d2/d34/c84 0 2024-04-18T21:07:00.021 INFO:tasks.workunit.client.0.smithi078.stdout:9/489: rename d7/d83/f9e to d7/d11/d80/fa3 0 2024-04-18T21:07:00.021 INFO:tasks.workunit.client.0.smithi078.stdout:6/384: symlink d2/d1c/d30/l85 0 2024-04-18T21:07:00.021 INFO:tasks.workunit.client.0.smithi078.stdout:5/465: mkdir d9/da/d90/d62/d93 0 2024-04-18T21:07:00.023 INFO:tasks.workunit.client.0.smithi078.stdout:2/448: dwrite d0/f55 [4194304,4194304] 0 2024-04-18T21:07:00.024 INFO:tasks.workunit.client.0.smithi078.stdout:5/466: symlink d9/da/d3e/d4c/d67/l94 0 2024-04-18T21:07:00.025 INFO:tasks.workunit.client.0.smithi078.stdout:0/485: dread d0/f8 [0,4194304] 0 2024-04-18T21:07:00.027 INFO:tasks.workunit.client.0.smithi078.stdout:7/461: dwrite d1/d16/d10/f1a [0,4194304] 0 2024-04-18T21:07:00.027 INFO:tasks.workunit.client.0.smithi078.stdout:9/490: creat d7/d11/d1b/d45/d4b/d5d/fa4 x:0 0 0 2024-04-18T21:07:00.027 INFO:tasks.workunit.client.0.smithi078.stdout:5/467: symlink d9/d2e/d65/l95 0 2024-04-18T21:07:00.027 INFO:tasks.workunit.client.0.smithi078.stdout:2/449: creat d0/d87/f8a x:0 0 0 2024-04-18T21:07:00.027 INFO:tasks.workunit.client.0.smithi078.stdout:6/385: link d2/l3c d2/d1c/d6b/l86 0 2024-04-18T21:07:00.027 INFO:tasks.workunit.client.0.smithi078.stdout:0/486: mknod d0/d9/d4c/d8f/c90 0 2024-04-18T21:07:00.028 INFO:tasks.workunit.client.0.smithi078.stdout:4/529: dread d0/dc/d10/d1c/f8e [0,4194304] 0 2024-04-18T21:07:00.028 INFO:tasks.workunit.client.0.smithi078.stdout:6/386: fdatasync d2/d1f/f2c 0 2024-04-18T21:07:00.028 INFO:tasks.workunit.client.0.smithi078.stdout:9/491: creat d7/df/d67/fa5 x:0 0 0 2024-04-18T21:07:00.028 INFO:tasks.workunit.client.0.smithi078.stdout:0/487: sync 2024-04-18T21:07:00.029 INFO:tasks.workunit.client.0.smithi078.stdout:9/492: unlink d7/d11/d80/f9f 0 2024-04-18T21:07:00.029 INFO:tasks.workunit.client.0.smithi078.stdout:5/468: creat d9/da/d3e/d4c/d67/f96 x:0 0 0 2024-04-18T21:07:00.030 INFO:tasks.workunit.client.0.smithi078.stdout:0/488: creat d0/d9/dd/d17/d2e/d31/f91 x:0 0 0 2024-04-18T21:07:00.030 INFO:tasks.workunit.client.0.smithi078.stdout:4/530: truncate d0/dc/d5b/d71/fb6 277248 0 2024-04-18T21:07:00.031 INFO:tasks.workunit.client.0.smithi078.stdout:6/387: getdents d2/d6/dd/d4b 0 2024-04-18T21:07:00.031 INFO:tasks.workunit.client.0.smithi078.stdout:2/450: dread d0/f54 [0,4194304] 0 2024-04-18T21:07:00.031 INFO:tasks.workunit.client.0.smithi078.stdout:0/489: dread - d0/d9/d4c/d70/f7c zero size 2024-04-18T21:07:00.031 INFO:tasks.workunit.client.0.smithi078.stdout:4/531: creat d0/dc/d10/d41/fc0 x:0 0 0 2024-04-18T21:07:00.032 INFO:tasks.workunit.client.0.smithi078.stdout:6/388: dread d2/d1c/f22 [8388608,4194304] 0 2024-04-18T21:07:00.032 INFO:tasks.workunit.client.0.smithi078.stdout:0/490: creat d0/d6c/f92 x:0 0 0 2024-04-18T21:07:00.033 INFO:tasks.workunit.client.0.smithi078.stdout:2/451: unlink d0/d1f/d34/l5c 0 2024-04-18T21:07:00.033 INFO:tasks.workunit.client.0.smithi078.stdout:5/469: creat d9/da/d3e/d4c/d6d/d73/f97 x:0 0 0 2024-04-18T21:07:00.033 INFO:tasks.workunit.client.0.smithi078.stdout:4/532: fdatasync d0/dc/d29/d6d/d82/fb4 0 2024-04-18T21:07:00.034 INFO:tasks.workunit.client.0.smithi078.stdout:5/470: symlink d9/da/d32/l98 0 2024-04-18T21:07:00.034 INFO:tasks.workunit.client.0.smithi078.stdout:2/452: mkdir d0/db/d18/d21/d8b 0 2024-04-18T21:07:00.034 INFO:tasks.workunit.client.0.smithi078.stdout:1/503: dread d0/d2a/d3c/d4b/d4/f28 [4194304,4194304] 0 2024-04-18T21:07:00.035 INFO:tasks.workunit.client.0.smithi078.stdout:0/491: creat d0/d9/da/db/d35/d3f/f93 x:0 0 0 2024-04-18T21:07:00.035 INFO:tasks.workunit.client.0.smithi078.stdout:5/471: write d9/f3c [1899944,50815] 0 2024-04-18T21:07:00.036 INFO:tasks.workunit.client.0.smithi078.stdout:2/453: chown d0/d1f/c3b 1943122 1 2024-04-18T21:07:00.036 INFO:tasks.workunit.client.0.smithi078.stdout:4/533: read d0/dc/d5b/f62 [176289,96840] 0 2024-04-18T21:07:00.036 INFO:tasks.workunit.client.0.smithi078.stdout:4/534: write d0/d73/da9/f80 [2837231,84473] 0 2024-04-18T21:07:00.037 INFO:tasks.workunit.client.0.smithi078.stdout:5/472: mkdir d9/da/d99 0 2024-04-18T21:07:00.038 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:07:00.039 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:07:00.039 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-18T21:07:00.039 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-18T21:07:00.039 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:07:00.040 INFO:tasks.workunit.client.0.smithi078.stdout:1/504: dwrite d0/d2a/d2f/f9a [0,4194304] 0 2024-04-18T21:07:00.041 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on 2024-04-18T21:07:00.043 INFO:tasks.workunit.client.0.smithi078.stdout:0/492: dread d0/d9/dd/d17/d2e/d31/f4a [0,4194304] 0 2024-04-18T21:07:00.043 INFO:tasks.workunit.client.0.smithi078.stdout:4/535: dwrite d0/dc/d29/d2f/f35 [0,4194304] 0 2024-04-18T21:07:00.044 INFO:tasks.workunit.client.0.smithi078.stdout:6/389: read d2/d6/dd/f48 [893390,96452] 0 2024-04-18T21:07:00.044 INFO:tasks.workunit.client.0.smithi078.stdout:2/454: truncate d0/d1f/d34/f81 1030255 0 2024-04-18T21:07:00.046 INFO:tasks.workunit.client.0.smithi078.stdout:4/536: rename d0/dc/d5b/d71/l5c to d0/dc/d10/d41/lc1 0 2024-04-18T21:07:00.047 INFO:tasks.workunit.client.0.smithi078.stdout:0/493: symlink d0/d9/da/db/l94 0 2024-04-18T21:07:00.047 INFO:tasks.workunit.client.0.smithi078.stdout:6/390: symlink d2/d6/l87 0 2024-04-18T21:07:00.048 INFO:tasks.workunit.client.0.smithi078.stdout:8/426: dread d0/f55 [0,4194304] 0 2024-04-18T21:07:00.048 INFO:tasks.workunit.client.0.smithi078.stdout:6/391: write d2/f2b [1845327,46559] 0 2024-04-18T21:07:00.049 INFO:tasks.workunit.client.0.smithi078.stdout:4/537: write d0/dc/d29/f92 [757401,93305] 0 2024-04-18T21:07:00.049 INFO:tasks.workunit.client.0.smithi078.stdout:0/494: chown d0/d9/dd/d17/d2e/d31/c4f 14 1 2024-04-18T21:07:00.052 INFO:tasks.workunit.client.0.smithi078.stdout:1/505: dwrite d0/d2a/d2f/f38 [4194304,4194304] 0 2024-04-18T21:07:00.052 INFO:tasks.workunit.client.0.smithi078.stdout:4/538: readlink d0/dc/d5b/d71/l93 0 2024-04-18T21:07:00.052 INFO:tasks.workunit.client.0.smithi078.stdout:1/506: sync 2024-04-18T21:07:00.052 INFO:tasks.workunit.client.0.smithi078.stdout:0/495: fdatasync d0/d9/da/db/d35/f6f 0 2024-04-18T21:07:00.052 INFO:tasks.workunit.client.0.smithi078.stdout:3/408: dread d4/f9 [0,4194304] 0 2024-04-18T21:07:00.053 INFO:tasks.workunit.client.0.smithi078.stdout:8/427: creat d0/d10/d14/d2a/d3a/f81 x:0 0 0 2024-04-18T21:07:00.053 INFO:tasks.workunit.client.0.smithi078.stdout:4/539: creat d0/dc/d10/d1c/d6a/d81/fc2 x:0 0 0 2024-04-18T21:07:00.056 INFO:tasks.workunit.client.0.smithi078.stdout:3/409: truncate d4/d2d/d30/d35/d4b/d59/f5f 592371 0 2024-04-18T21:07:00.056 INFO:tasks.workunit.client.0.smithi078.stdout:4/540: write d0/dc/d5b/d4f/f79 [665414,84091] 0 2024-04-18T21:07:00.057 INFO:tasks.workunit.client.0.smithi078.stdout:8/428: link d0/d10/d14/d2a/l39 d0/d22/l82 0 2024-04-18T21:07:00.057 INFO:tasks.workunit.client.0.smithi078.stdout:3/410: read - d4/d2d/f5d zero size 2024-04-18T21:07:00.058 INFO:tasks.workunit.client.0.smithi078.stdout:9/493: dread d7/d11/d1b/f5f [0,4194304] 0 2024-04-18T21:07:00.058 INFO:tasks.workunit.client.0.smithi078.stdout:6/392: dwrite d2/d34/d35/d57/f73 [0,4194304] 0 2024-04-18T21:07:00.058 INFO:tasks.workunit.client.0.smithi078.stdout:9/494: readlink d7/df/d1e/l44 0 2024-04-18T21:07:00.059 INFO:tasks.workunit.client.0.smithi078.stdout:6/393: write d2/f3 [541097,91958] 0 2024-04-18T21:07:00.059 INFO:tasks.workunit.client.0.smithi078.stdout:6/394: sync 2024-04-18T21:07:00.060 INFO:tasks.workunit.client.0.smithi078.stdout:0/496: dwrite d0/d9/da/db/f2c [4194304,4194304] 0 2024-04-18T21:07:00.060 INFO:tasks.workunit.client.0.smithi078.stdout:9/495: dread - d7/d11/d1b/d45/d4b/d5d/f9a zero size 2024-04-18T21:07:00.060 INFO:tasks.workunit.client.0.smithi078.stdout:8/429: creat d0/d10/d14/d2d/f83 x:0 0 0 2024-04-18T21:07:00.061 INFO:tasks.workunit.client.0.smithi078.stdout:8/430: dread - d0/d10/d14/f58 zero size 2024-04-18T21:07:00.062 INFO:tasks.workunit.client.0.smithi078.stdout:6/395: symlink d2/d34/d75/l88 0 2024-04-18T21:07:00.063 INFO:tasks.workunit.client.0.smithi078.stdout:1/507: write d0/d2a/d5f/d89/d32/f39 [1330667,45688] 0 2024-04-18T21:07:00.064 INFO:tasks.workunit.client.0.smithi078.stdout:0/497: rename d0/l2 to d0/d9/da/db/d35/l95 0 2024-04-18T21:07:00.064 INFO:tasks.workunit.client.0.smithi078.stdout:6/396: creat d2/d6/dd/d4b/f89 x:0 0 0 2024-04-18T21:07:00.066 INFO:tasks.workunit.client.0.smithi078.stdout:0/498: symlink d0/d9/d81/l96 0 2024-04-18T21:07:00.067 INFO:tasks.workunit.client.0.smithi078.stdout:4/541: dwrite d0/dc/d10/d3a/f91 [0,4194304] 0 2024-04-18T21:07:00.068 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:00.069 INFO:tasks.workunit.client.0.smithi078.stdout:6/397: rename d2/d1c/d63/f83 to d2/d1c/d6b/f8a 0 2024-04-18T21:07:00.069 INFO:tasks.workunit.client.0.smithi078.stdout:0/499: rmdir d0/d9/da/db/d35 39 2024-04-18T21:07:00.069 INFO:tasks.workunit.client.0.smithi078.stdout:4/542: creat d0/fc3 x:0 0 0 2024-04-18T21:07:00.069 INFO:tasks.workunit.client.0.smithi078.stdout:3/411: dread d4/da/d11/f22 [0,4194304] 0 2024-04-18T21:07:00.069 INFO:tasks.workunit.client.0.smithi078.stdout:0/500: read - d0/d15/f5f zero size 2024-04-18T21:07:00.070 INFO:tasks.workunit.client.0.smithi078.stdout:1/508: rename d0/d2a/d3c/d4b/d4/d61/d75 to d0/d2a/d5f/d89/d32/db2 0 2024-04-18T21:07:00.070 INFO:tasks.workunit.client.0.smithi078.stdout:4/543: unlink d0/f2c 0 2024-04-18T21:07:00.070 INFO:tasks.workunit.client.0.smithi078.stdout:6/398: truncate d2/ff 542319 0 2024-04-18T21:07:00.072 INFO:tasks.workunit.client.0.smithi078.stdout:8/431: dwrite d0/d10/d14/f58 [0,4194304] 0 2024-04-18T21:07:00.072 INFO:tasks.workunit.client.0.smithi078.stdout:0/501: dread - d0/d9/d4c/d70/f85 zero size 2024-04-18T21:07:00.072 INFO:tasks.workunit.client.0.smithi078.stdout:3/412: mkdir d4/d2d/d30/d35/d71 0 2024-04-18T21:07:00.072 INFO:tasks.workunit.client.0.smithi078.stdout:1/509: dread - d0/d2a/d5f/d89/d77/f8c zero size 2024-04-18T21:07:00.072 INFO:tasks.workunit.client.0.smithi078.stdout:4/544: mkdir d0/dc/d5b/d4f/d83/dc4 0 2024-04-18T21:07:00.073 INFO:tasks.workunit.client.0.smithi078.stdout:7/462: dread d1/d16/dc/d11/f24 [0,4194304] 0 2024-04-18T21:07:00.074 INFO:tasks.workunit.client.0.smithi078.stdout:7/463: readlink d1/d16/d10/d7c/d94/l95 0 2024-04-18T21:07:00.074 INFO:tasks.workunit.client.0.smithi078.stdout:3/413: creat d4/da/d11/f72 x:0 0 0 2024-04-18T21:07:00.075 INFO:tasks.workunit.client.0.smithi078.stdout:3/414: mknod d4/d2d/c73 0 2024-04-18T21:07:00.075 INFO:tasks.workunit.client.0.smithi078.stdout:7/464: creat d1/d16/d1c/d40/fa1 x:0 0 0 2024-04-18T21:07:00.075 INFO:tasks.workunit.client.0.smithi078.stdout:1/510: dread - d0/d2a/d5f/d89/d32/d35/f99 zero size 2024-04-18T21:07:00.076 INFO:tasks.workunit.client.0.smithi078.stdout:7/465: fdatasync d1/f5e 0 2024-04-18T21:07:00.077 INFO:tasks.workunit.client.0.smithi078.stdout:1/511: write d0/d2a/d45/f5d [4229289,98465] 0 2024-04-18T21:07:00.079 INFO:tasks.workunit.client.0.smithi078.stdout:7/466: mkdir d1/d16/dc/d11/da2 0 2024-04-18T21:07:00.079 INFO:tasks.workunit.client.0.smithi078.stdout:6/399: dwrite d2/d1c/f22 [0,4194304] 0 2024-04-18T21:07:00.081 INFO:tasks.workunit.client.0.smithi078.stdout:7/467: dread - d1/d16/dc/f5b zero size 2024-04-18T21:07:00.081 INFO:tasks.workunit.client.0.smithi078.stdout:8/432: getdents d0/d22 0 2024-04-18T21:07:00.081 INFO:tasks.workunit.client.0.smithi078.stdout:6/400: mkdir d2/d1c/d63/d8b 0 2024-04-18T21:07:00.082 INFO:tasks.workunit.client.0.smithi078.stdout:0/502: dwrite d0/d9/f43 [0,4194304] 0 2024-04-18T21:07:00.082 INFO:tasks.workunit.client.0.smithi078.stdout:7/468: unlink d1/d16/dc/f51 0 2024-04-18T21:07:00.083 INFO:tasks.workunit.client.0.smithi078.stdout:6/401: mkdir d2/d1c/d3a/d8c 0 2024-04-18T21:07:00.083 INFO:tasks.workunit.client.0.smithi078.stdout:8/433: write d0/d10/d14/d2a/d4a/f7e [255587,8524] 0 2024-04-18T21:07:00.084 INFO:tasks.workunit.client.0.smithi078.stdout:7/469: write d1/d16/d65/f84 [1039407,62338] 0 2024-04-18T21:07:00.084 INFO:tasks.workunit.client.0.smithi078.stdout:0/503: creat d0/d9/d4c/d8f/f97 x:0 0 0 2024-04-18T21:07:00.084 INFO:tasks.workunit.client.0.smithi078.stdout:4/545: dread d0/dc/d5b/f6f [0,4194304] 0 2024-04-18T21:07:00.085 INFO:tasks.workunit.client.0.smithi078.stdout:3/415: dwrite d4/d2d/d30/d35/f33 [0,4194304] 0 2024-04-18T21:07:00.085 INFO:tasks.workunit.client.0.smithi078.stdout:2/455: dread d0/fe [0,4194304] 0 2024-04-18T21:07:00.086 INFO:tasks.workunit.client.0.smithi078.stdout:8/434: fdatasync d0/d10/d60/d6f/f7a 0 2024-04-18T21:07:00.087 INFO:tasks.workunit.client.0.smithi078.stdout:6/402: truncate d2/d1f/f47 1377344 0 2024-04-18T21:07:00.089 INFO:tasks.workunit.client.0.smithi078.stdout:7/470: chown d1/d16/d1c/d40/f8e 86 1 2024-04-18T21:07:00.089 INFO:tasks.workunit.client.0.smithi078.stdout:6/403: readlink d2/d6/dd/l7e 0 2024-04-18T21:07:00.089 INFO:tasks.workunit.client.0.smithi078.stdout:6/404: readlink d2/d1c/d3a/l4c 0 2024-04-18T21:07:00.089 INFO:tasks.workunit.client.0.smithi078.stdout:0/504: symlink d0/d9/da/db/d35/d3f/l98 0 2024-04-18T21:07:00.090 INFO:tasks.workunit.client.0.smithi078.stdout:6/405: rmdir d2/d1c/d63 39 2024-04-18T21:07:00.090 INFO:tasks.workunit.client.0.smithi078.stdout:0/505: read - d0/d9/da/db/d35/d3f/f93 zero size 2024-04-18T21:07:00.090 INFO:tasks.workunit.client.0.smithi078.stdout:8/435: getdents d0/d10/d14/d2d 0 2024-04-18T21:07:00.090 INFO:tasks.workunit.client.0.smithi078.stdout:2/456: truncate d0/fe 1657643 0 2024-04-18T21:07:00.091 INFO:tasks.workunit.client.0.smithi078.stdout:0/506: symlink d0/d6c/l99 0 2024-04-18T21:07:00.091 INFO:tasks.workunit.client.0.smithi078.stdout:6/406: mkdir d2/d6/d8d 0 2024-04-18T21:07:00.091 INFO:tasks.workunit.client.0.smithi078.stdout:8/436: rmdir d0/d10/d14 39 2024-04-18T21:07:00.091 INFO:tasks.workunit.client.0.smithi078.stdout:7/471: link d1/d16/d10/c93 d1/d16/d10/d5a/d8b/ca3 0 2024-04-18T21:07:00.093 INFO:tasks.workunit.client.0.smithi078.stdout:0/507: creat d0/f9a x:0 0 0 2024-04-18T21:07:00.093 INFO:tasks.workunit.client.0.smithi078.stdout:6/407: creat d2/d1c/d63/f8e x:0 0 0 2024-04-18T21:07:00.093 INFO:tasks.workunit.client.0.smithi078.stdout:8/437: write d0/f26 [1801771,12060] 0 2024-04-18T21:07:00.094 INFO:tasks.workunit.client.0.smithi078.stdout:7/472: mkdir d1/d16/dc/d11/d53/d82/da4 0 2024-04-18T21:07:00.094 INFO:tasks.workunit.client.0.smithi078.stdout:2/457: write d0/db/d18/d21/d27/d29/f69 [2109835,89223] 0 2024-04-18T21:07:00.095 INFO:tasks.workunit.client.0.smithi078.stdout:5/473: dread d9/da/ff [4194304,4194304] 0 2024-04-18T21:07:00.095 INFO:tasks.workunit.client.0.smithi078.stdout:8/438: fdatasync d0/f45 0 2024-04-18T21:07:00.095 INFO:tasks.workunit.client.0.smithi078.stdout:4/546: dwrite d0/dc/d5b/d71/fb6 [0,4194304] 0 2024-04-18T21:07:00.096 INFO:tasks.workunit.client.0.smithi078.stdout:5/474: chown d9/c27 3 1 2024-04-18T21:07:00.098 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:07:00.099 INFO:tasks.workunit.client.0.smithi078.stdout:4/547: creat d0/dc/d29/d2f/fc5 x:0 0 0 2024-04-18T21:07:00.099 INFO:tasks.workunit.client.0.smithi078.stdout:5/475: symlink d9/da/d3e/d4c/d6d/l9a 0 2024-04-18T21:07:00.101 INFO:tasks.workunit.client.0.smithi078.stdout:0/508: read d0/d9/f57 [986525,56185] 0 2024-04-18T21:07:00.101 INFO:tasks.workunit.client.0.smithi078.stdout:3/416: read d4/d2d/d30/f48 [1453668,94980] 0 2024-04-18T21:07:00.102 INFO:tasks.workunit.client.0.smithi078.stdout:4/548: stat d0/dc/d10/d41/lc1 0 2024-04-18T21:07:00.104 INFO:tasks.workunit.client.0.smithi078.stdout:7/473: dwrite d1/d16/d2d/f36 [0,4194304] 0 2024-04-18T21:07:00.104 INFO:tasks.workunit.client.0.smithi078.stdout:3/417: mkdir d4/df/d17/d74 0 2024-04-18T21:07:00.104 INFO:tasks.workunit.client.0.smithi078.stdout:2/458: dwrite d0/db/f12 [0,4194304] 0 2024-04-18T21:07:00.105 INFO:tasks.workunit.client.0.smithi078.stdout:0/509: mkdir d0/d9/d4c/d6b/d9b 0 2024-04-18T21:07:00.106 INFO:tasks.workunit.client.0.smithi078.stdout:7/474: fsync d1/d16/dc/d86/f92 0 2024-04-18T21:07:00.107 INFO:tasks.workunit.client.0.smithi078.stdout:2/459: unlink d0/db/d18/d21/f2c 0 2024-04-18T21:07:00.108 INFO:tasks.workunit.client.0.smithi078.stdout:4/549: rename d0/dc/ca to d0/dc/d5b/d4f/d83/cc6 0 2024-04-18T21:07:00.108 INFO:tasks.workunit.client.0.smithi078.stdout:7/475: write d1/d16/d1c/d40/f8e [359899,41803] 0 2024-04-18T21:07:00.108 INFO:tasks.workunit.client.0.smithi078.stdout:6/408: dread d2/d34/d35/f40 [0,4194304] 0 2024-04-18T21:07:00.108 INFO:tasks.workunit.client.0.smithi078.stdout:8/439: dwrite d0/d10/d14/d2a/f71 [0,4194304] 0 2024-04-18T21:07:00.108 INFO:tasks.workunit.client.0.smithi078.stdout:0/510: mknod d0/d9/dd/d17/d2e/c9c 0 2024-04-18T21:07:00.108 INFO:tasks.workunit.client.0.smithi078.stdout:4/550: stat d0/c69 0 2024-04-18T21:07:00.110 INFO:tasks.workunit.client.0.smithi078.stdout:2/460: symlink d0/db/d18/d21/d27/l8c 0 2024-04-18T21:07:00.110 INFO:tasks.workunit.client.0.smithi078.stdout:7/476: chown d1/d16/d65/f84 529 1 2024-04-18T21:07:00.110 INFO:tasks.workunit.client.0.smithi078.stdout:4/551: write d0/fc3 [1041714,100183] 0 2024-04-18T21:07:00.110 INFO:tasks.workunit.client.0.smithi078.stdout:3/418: rename d4/df/l37 to d4/df/d17/d74/l75 0 2024-04-18T21:07:00.110 INFO:tasks.workunit.client.0.smithi078.stdout:6/409: fsync d2/ff 0 2024-04-18T21:07:00.111 INFO:tasks.workunit.client.0.smithi078.stdout:8/440: creat d0/f84 x:0 0 0 2024-04-18T21:07:00.111 INFO:tasks.workunit.client.0.smithi078.stdout:3/419: chown d4/da/d11/l63 74407 1 2024-04-18T21:07:00.111 INFO:tasks.workunit.client.0.smithi078.stdout:0/511: truncate d0/d9/d58/f74 3246324 0 2024-04-18T21:07:00.112 INFO:tasks.workunit.client.0.smithi078.stdout:4/552: creat d0/dc/d29/d2f/da7/fc7 x:0 0 0 2024-04-18T21:07:00.112 INFO:tasks.workunit.client.0.smithi078.stdout:8/441: unlink d0/d10/d60/d6f/f4e 0 2024-04-18T21:07:00.112 INFO:tasks.workunit.client.0.smithi078.stdout:2/461: write d0/db/d18/d21/d27/f58 [6764201,114233] 0 2024-04-18T21:07:00.112 INFO:tasks.workunit.client.0.smithi078.stdout:7/477: truncate d1/d16/dc/d11/f24 5187767 0 2024-04-18T21:07:00.113 INFO:tasks.workunit.client.0.smithi078.stdout:6/410: write d2/d6/dd/d4b/d5d/f6f [4079199,4645] 0 2024-04-18T21:07:00.113 INFO:tasks.workunit.client.0.smithi078.stdout:3/420: mkdir d4/da/d76 0 2024-04-18T21:07:00.113 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:00.114+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:00.113 INFO:tasks.workunit.client.0.smithi078.stdout:7/478: mknod d1/d16/d1c/d40/ca5 0 2024-04-18T21:07:00.114 INFO:tasks.workunit.client.0.smithi078.stdout:6/411: symlink d2/d1c/d3a/d8c/l8f 0 2024-04-18T21:07:00.114 INFO:tasks.workunit.client.0.smithi078.stdout:4/553: symlink d0/dc/d29/d2f/lc8 0 2024-04-18T21:07:00.115 INFO:tasks.workunit.client.0.smithi078.stdout:4/554: write d0/dc/d10/d85/f9d [371451,85958] 0 2024-04-18T21:07:00.115 INFO:tasks.workunit.client.0.smithi078.stdout:6/412: chown d2/c23 0 1 2024-04-18T21:07:00.116 INFO:tasks.workunit.client.0.smithi078.stdout:2/462: rename d0/db/d6e/l6f to d0/db/d18/d21/d8b/l8d 0 2024-04-18T21:07:00.118 INFO:tasks.workunit.client.0.smithi078.stdout:3/421: dread d4/da/d11/f2c [0,4194304] 0 2024-04-18T21:07:00.118 INFO:tasks.workunit.client.0.smithi078.stdout:8/442: getdents d0/d10/d14/d62 0 2024-04-18T21:07:00.118 INFO:tasks.workunit.client.0.smithi078.stdout:4/555: creat d0/dc/d10/db2/fc9 x:0 0 0 2024-04-18T21:07:00.120 INFO:tasks.workunit.client.0.smithi078.stdout:3/422: chown d4/d2d/d30/d35/d4b/d59/l6e 130754 1 2024-04-18T21:07:00.120 INFO:tasks.workunit.client.0.smithi078.stdout:8/443: fsync d0/d5c/d5a/f6d 0 2024-04-18T21:07:00.121 INFO:tasks.workunit.client.0.smithi078.stdout:3/423: dread - d4/d2d/f5d zero size 2024-04-18T21:07:00.121 INFO:tasks.workunit.client.0.smithi078.stdout:4/556: symlink d0/dc/d5b/d4f/d83/lca 0 2024-04-18T21:07:00.122 INFO:tasks.workunit.client.0.smithi078.stdout:7/479: dwrite d1/d16/d1c/f2a [0,4194304] 0 2024-04-18T21:07:00.122 INFO:tasks.workunit.client.0.smithi078.stdout:3/424: creat d4/da/d76/f77 x:0 0 0 2024-04-18T21:07:00.124 INFO:tasks.workunit.client.0.smithi078.stdout:4/557: truncate d0/d73/da9/fbd 339479 0 2024-04-18T21:07:00.124 INFO:tasks.workunit.client.0.smithi078.stdout:3/425: fdatasync d4/f13 0 2024-04-18T21:07:00.125 INFO:tasks.workunit.client.0.smithi078.stdout:4/558: mkdir d0/d73/da9/dcb 0 2024-04-18T21:07:00.125 INFO:tasks.workunit.client.0.smithi078.stdout:7/480: mkdir d1/da6 0 2024-04-18T21:07:00.127 INFO:tasks.workunit.client.0.smithi078.stdout:3/426: fdatasync d4/f64 0 2024-04-18T21:07:00.127 INFO:tasks.workunit.client.0.smithi078.stdout:4/559: write d0/dc/d10/f42 [1004294,119742] 0 2024-04-18T21:07:00.128 INFO:tasks.workunit.client.0.smithi078.stdout:4/560: write d0/dc/d10/d1c/d60/d74/fb1 [566187,86337] 0 2024-04-18T21:07:00.130 INFO:tasks.workunit.client.0.smithi078.stdout:8/444: dwrite d0/d10/d14/d2a/d4a/f75 [0,4194304] 0 2024-04-18T21:07:00.132 INFO:tasks.workunit.client.0.smithi078.stdout:4/561: truncate d0/dc/d29/d2f/da7/fad 791448 0 2024-04-18T21:07:00.134 INFO:tasks.workunit.client.0.smithi078.stdout:3/427: rename d4/df/d17/c45 to d4/da/d11/c78 0 2024-04-18T21:07:00.134 INFO:tasks.workunit.client.0.smithi078.stdout:7/481: dwrite d1/d16/d10/d5a/f76 [0,4194304] 0 2024-04-18T21:07:00.135 INFO:tasks.workunit.client.0.smithi078.stdout:8/445: mknod d0/d10/d14/d2a/d4a/c85 0 2024-04-18T21:07:00.137 INFO:tasks.workunit.client.0.smithi078.stdout:3/428: unlink d4/df/f1f 0 2024-04-18T21:07:00.137 INFO:tasks.workunit.client.0.smithi078.stdout:8/446: fsync d0/f6 0 2024-04-18T21:07:00.138 INFO:tasks.workunit.client.0.smithi078.stdout:5/476: dread f8 [0,4194304] 0 2024-04-18T21:07:00.138 INFO:tasks.workunit.client.0.smithi078.stdout:7/482: rename d1/d32/c85 to d1/d16/ca7 0 2024-04-18T21:07:00.138 INFO:tasks.workunit.client.0.smithi078.stdout:3/429: creat d4/da/f79 x:0 0 0 2024-04-18T21:07:00.139 INFO:tasks.workunit.client.0.smithi078.stdout:5/477: mknod d9/da/d3e/d4c/d6d/d75/c9b 0 2024-04-18T21:07:00.139 INFO:tasks.workunit.client.0.smithi078.stdout:3/430: symlink d4/da/d11/l7a 0 2024-04-18T21:07:00.140 INFO:tasks.workunit.client.0.smithi078.stdout:7/483: creat d1/d16/dc/d11/fa8 x:0 0 0 2024-04-18T21:07:00.141 INFO:tasks.workunit.client.0.smithi078.stdout:4/562: dwrite d0/dc/d10/d1c/d60/d74/fb1 [0,4194304] 0 2024-04-18T21:07:00.141 INFO:tasks.workunit.client.0.smithi078.stdout:3/431: write d4/f70 [1047992,66717] 0 2024-04-18T21:07:00.141 INFO:tasks.workunit.client.0.smithi078.stdout:7/484: dread - d1/d16/dc/f5f zero size 2024-04-18T21:07:00.142 INFO:tasks.workunit.client.0.smithi078.stdout:3/432: chown d4/df/c4c 10894104 1 2024-04-18T21:07:00.143 INFO:tasks.workunit.client.0.smithi078.stdout:3/433: write d4/da/f79 [540986,121780] 0 2024-04-18T21:07:00.144 INFO:tasks.workunit.client.0.smithi078.stdout:4/563: creat d0/dc/d5b/d4f/d83/db8/fcc x:0 0 0 2024-04-18T21:07:00.145 INFO:tasks.workunit.client.0.smithi078.stdout:8/447: dwrite d0/f6 [4194304,4194304] 0 2024-04-18T21:07:00.145 INFO:tasks.workunit.client.0.smithi078.stdout:5/478: link d9/da/d3e/d4c/d67/d7c/c6e d9/da/d90/c9c 0 2024-04-18T21:07:00.145 INFO:tasks.workunit.client.0.smithi078.stdout:4/564: dread - d0/dc/d10/d1c/d6a/fb9 zero size 2024-04-18T21:07:00.146 INFO:tasks.workunit.client.0.smithi078.stdout:8/448: mknod d0/d10/d60/c86 0 2024-04-18T21:07:00.146 INFO:tasks.workunit.client.0.smithi078.stdout:5/479: symlink d9/da/d32/l9d 0 2024-04-18T21:07:00.147 INFO:tasks.workunit.client.0.smithi078.stdout:4/565: mknod d0/dc/d37/ccd 0 2024-04-18T21:07:00.147 INFO:tasks.workunit.client.0.smithi078.stdout:0/512: dread d0/d9/da/db/d35/f2b [4194304,4194304] 0 2024-04-18T21:07:00.147 INFO:tasks.workunit.client.0.smithi078.stdout:1/512: dread d0/d11/f18 [0,4194304] 0 2024-04-18T21:07:00.148 INFO:tasks.workunit.client.0.smithi078.stdout:8/449: stat d0/d10/c7c 0 2024-04-18T21:07:00.148 INFO:tasks.workunit.client.0.smithi078.stdout:4/566: stat d0/dc/d10/d85/f8d 0 2024-04-18T21:07:00.148 INFO:tasks.workunit.client.0.smithi078.stdout:1/513: write d0/d2a/f65 [3434098,118368] 0 2024-04-18T21:07:00.149 INFO:tasks.workunit.client.0.smithi078.stdout:0/513: chown d0/d9/da/f59 321 1 2024-04-18T21:07:00.149 INFO:tasks.workunit.client.0.smithi078.stdout:5/480: write d9/da/d3e/d4c/d6d/d73/f97 [915519,111645] 0 2024-04-18T21:07:00.151 INFO:tasks.workunit.client.0.smithi078.stdout:6/413: dread d2/d1f/f61 [0,4194304] 0 2024-04-18T21:07:00.152 INFO:tasks.workunit.client.0.smithi078.stdout:0/514: mkdir d0/d6c/d9d 0 2024-04-18T21:07:00.152 INFO:tasks.workunit.client.0.smithi078.stdout:9/496: dread d7/df/f10 [0,4194304] 0 2024-04-18T21:07:00.152 INFO:tasks.workunit.client.0.smithi078.stdout:8/450: symlink d0/d10/d14/d2a/d3c/l87 0 2024-04-18T21:07:00.153 INFO:tasks.workunit.client.0.smithi078.stdout:8/451: fdatasync d0/d10/d14/d2d/f35 0 2024-04-18T21:07:00.153 INFO:tasks.workunit.client.0.smithi078.stdout:0/515: creat d0/d6c/f9e x:0 0 0 2024-04-18T21:07:00.154 INFO:tasks.workunit.client.0.smithi078.stdout:9/497: readlink d7/d11/d2d/d26/l7f 0 2024-04-18T21:07:00.154 INFO:tasks.workunit.client.0.smithi078.stdout:5/481: getdents d9/d2e 0 2024-04-18T21:07:00.154 INFO:tasks.workunit.client.0.smithi078.stdout:2/463: dread d0/db/d18/f1c [0,4194304] 0 2024-04-18T21:07:00.155 INFO:tasks.workunit.client.0.smithi078.stdout:6/414: getdents d2/d34 0 2024-04-18T21:07:00.156 INFO:tasks.workunit.client.0.smithi078.stdout:4/567: truncate d0/f28 2431294 0 2024-04-18T21:07:00.156 INFO:tasks.workunit.client.0.smithi078.stdout:9/498: symlink d7/d11/d2d/d26/la6 0 2024-04-18T21:07:00.156 INFO:tasks.workunit.client.0.smithi078.stdout:8/452: truncate d0/d22/f76 583445 0 2024-04-18T21:07:00.157 INFO:tasks.workunit.client.0.smithi078.stdout:1/514: dwrite d0/d2a/d3c/d4b/d4/f3d [0,4194304] 0 2024-04-18T21:07:00.158 INFO:tasks.workunit.client.0.smithi078.stdout:5/482: rmdir d9/da/d3e/d4c/d6d/d73 39 2024-04-18T21:07:00.158 INFO:tasks.workunit.client.0.smithi078.stdout:9/499: fdatasync d7/d11/d2d/d26/d97/fa2 0 2024-04-18T21:07:00.158 INFO:tasks.workunit.client.0.smithi078.stdout:5/483: rmdir d9 39 2024-04-18T21:07:00.159 INFO:tasks.workunit.client.0.smithi078.stdout:6/415: write d2/d34/d35/f40 [1460098,42186] 0 2024-04-18T21:07:00.159 INFO:tasks.workunit.client.0.smithi078.stdout:4/568: write d0/dc/d5b/d4f/f77 [176999,106365] 0 2024-04-18T21:07:00.160 INFO:tasks.workunit.client.0.smithi078.stdout:5/484: creat d9/d2e/f9e x:0 0 0 2024-04-18T21:07:00.161 INFO:tasks.workunit.client.0.smithi078.stdout:0/516: truncate d0/d9/da/db/f33 3992431 0 2024-04-18T21:07:00.162 INFO:tasks.workunit.client.0.smithi078.stdout:6/416: truncate d2/d6/dd/f42 646490 0 2024-04-18T21:07:00.162 INFO:tasks.workunit.client.0.smithi078.stdout:0/517: stat d0/d9/da/db/d35/d3f/l98 0 2024-04-18T21:07:00.162 INFO:tasks.workunit.client.0.smithi078.stdout:5/485: mkdir d9/d9f 0 2024-04-18T21:07:00.162 INFO:tasks.workunit.client.0.smithi078.stdout:8/453: link d0/d10/d60/d6f/c54 d0/d10/d14/d2a/d3c/c88 0 2024-04-18T21:07:00.163 INFO:tasks.workunit.client.0.smithi078.stdout:7/485: dread d1/f5e [0,4194304] 0 2024-04-18T21:07:00.164 INFO:tasks.workunit.client.0.smithi078.stdout:6/417: write d2/d6/dd/f48 [237453,81347] 0 2024-04-18T21:07:00.164 INFO:tasks.workunit.client.0.smithi078.stdout:2/464: truncate d0/db/d18/d21/d27/d29/d33/f6a 159635 0 2024-04-18T21:07:00.164 INFO:tasks.workunit.client.0.smithi078.stdout:0/518: mknod d0/d9/d81/c9f 0 2024-04-18T21:07:00.166 INFO:tasks.workunit.client.0.smithi078.stdout:9/500: truncate d7/d11/d1b/f5f 945974 0 2024-04-18T21:07:00.166 INFO:tasks.workunit.client.0.smithi078.stdout:2/465: rmdir d0/d1f/d34/d40 39 2024-04-18T21:07:00.167 INFO:tasks.workunit.client.0.smithi078.stdout:5/486: rename d9/da/d3e/d4c/d6d/l9a to d9/da/d4b/d8b/la0 0 2024-04-18T21:07:00.167 INFO:tasks.workunit.client.0.smithi078.stdout:8/454: creat d0/f89 x:0 0 0 2024-04-18T21:07:00.167 INFO:tasks.workunit.client.0.smithi078.stdout:1/515: dwrite d0/d2a/d3c/d4b/f24 [0,4194304] 0 2024-04-18T21:07:00.167 INFO:tasks.workunit.client.0.smithi078.stdout:7/486: getdents d1/d16/dc/d4b 0 2024-04-18T21:07:00.168 INFO:tasks.workunit.client.0.smithi078.stdout:2/466: fsync d0/d1f/d34/f53 0 2024-04-18T21:07:00.169 INFO:tasks.workunit.client.0.smithi078.stdout:0/519: truncate d0/d9/da/f42 859083 0 2024-04-18T21:07:00.169 INFO:tasks.workunit.client.0.smithi078.stdout:4/569: dwrite d0/dc/f63 [0,4194304] 0 2024-04-18T21:07:00.169 INFO:tasks.workunit.client.0.smithi078.stdout:5/487: readlink d9/da/d3e/d4c/d67/l71 0 2024-04-18T21:07:00.169 INFO:tasks.workunit.client.0.smithi078.stdout:9/501: truncate d7/f6d 1308155 0 2024-04-18T21:07:00.170 INFO:tasks.workunit.client.0.smithi078.stdout:0/520: write d0/d9/f2d [4525399,53549] 0 2024-04-18T21:07:00.170 INFO:tasks.workunit.client.0.smithi078.stdout:1/516: truncate d0/d2a/d5f/d89/d32/f67 796490 0 2024-04-18T21:07:00.171 INFO:tasks.workunit.client.0.smithi078.stdout:8/455: creat d0/d5c/d5a/d7b/f8a x:0 0 0 2024-04-18T21:07:00.172 INFO:tasks.workunit.client.0.smithi078.stdout:8/456: fsync d0/d10/f1c 0 2024-04-18T21:07:00.172 INFO:tasks.workunit.client.0.smithi078.stdout:0/521: truncate d0/d9/dd/d17/d2e/d31/f65 873918 0 2024-04-18T21:07:00.172 INFO:tasks.workunit.client.0.smithi078.stdout:2/467: symlink d0/db/d18/d5d/l8e 0 2024-04-18T21:07:00.173 INFO:tasks.workunit.client.0.smithi078.stdout:9/502: creat d7/d11/d2d/d3f/d4d/fa7 x:0 0 0 2024-04-18T21:07:00.173 INFO:tasks.workunit.client.0.smithi078.stdout:7/487: creat d1/d16/d10/d7c/d7e/fa9 x:0 0 0 2024-04-18T21:07:00.173 INFO:tasks.workunit.client.0.smithi078.stdout:4/570: fsync d0/dc/d10/f32 0 2024-04-18T21:07:00.173 INFO:tasks.workunit.client.0.smithi078.stdout:8/457: mknod d0/d10/d60/c8b 0 2024-04-18T21:07:00.173 INFO:tasks.workunit.client.0.smithi078.stdout:7/488: fdatasync d1/d16/d1c/d40/f8e 0 2024-04-18T21:07:00.174 INFO:tasks.workunit.client.0.smithi078.stdout:5/488: creat d9/da/d3e/d4c/d6d/d73/fa1 x:0 0 0 2024-04-18T21:07:00.175 INFO:tasks.workunit.client.0.smithi078.stdout:9/503: mkdir d7/d23/d3e/d5a/da8 0 2024-04-18T21:07:00.175 INFO:tasks.workunit.client.0.smithi078.stdout:5/489: mknod d9/da/d3e/d4c/ca2 0 2024-04-18T21:07:00.176 INFO:tasks.workunit.client.0.smithi078.stdout:7/489: chown d1/d16/f77 818 1 2024-04-18T21:07:00.177 INFO:tasks.workunit.client.0.smithi078.stdout:9/504: symlink d7/d11/d1b/d45/d4b/d5d/d6a/la9 0 2024-04-18T21:07:00.178 INFO:tasks.workunit.client.0.smithi078.stdout:4/571: dread d0/dc/d10/d3a/f91 [0,4194304] 0 2024-04-18T21:07:00.179 INFO:tasks.workunit.client.0.smithi078.stdout:5/490: getdents d9/d2e/d65 0 2024-04-18T21:07:00.179 INFO:tasks.workunit.client.0.smithi078.stdout:7/490: creat d1/d16/dc/d11/d53/d82/da4/faa x:0 0 0 2024-04-18T21:07:00.179 INFO:tasks.workunit.client.0.smithi078.stdout:9/505: fdatasync d7/df/f13 0 2024-04-18T21:07:00.179 INFO:tasks.workunit.client.0.smithi078.stdout:5/491: write f8 [3710022,122387] 0 2024-04-18T21:07:00.180 INFO:tasks.workunit.client.0.smithi078.stdout:2/468: read d0/db/d18/d21/d27/d29/d33/f4c [909274,17784] 0 2024-04-18T21:07:00.180 INFO:tasks.workunit.client.0.smithi078.stdout:9/506: unlink d7/d11/d2d/d26/la6 0 2024-04-18T21:07:00.180 INFO:tasks.workunit.client.0.smithi078.stdout:2/469: dread - d0/d1f/f7a zero size 2024-04-18T21:07:00.181 INFO:tasks.workunit.client.0.smithi078.stdout:8/458: dwrite d0/d10/d14/d2a/d3a/f81 [0,4194304] 0 2024-04-18T21:07:00.181 INFO:tasks.workunit.client.0.smithi078.stdout:9/507: chown d7/d11/d2d/d26/f64 14 1 2024-04-18T21:07:00.182 INFO:tasks.workunit.client.0.smithi078.stdout:8/459: mknod d0/d10/d14/d2a/d3c/c8c 0 2024-04-18T21:07:00.183 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:00.182+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:00.183 INFO:tasks.workunit.client.0.smithi078.stdout:9/508: chown d7/d11/d1b/d45/d4b/f56 487 1 2024-04-18T21:07:00.183 INFO:tasks.workunit.client.0.smithi078.stdout:2/470: readlink d0/db/d18/d21/d27/d29/d4e/l85 0 2024-04-18T21:07:00.184 INFO:tasks.workunit.client.0.smithi078.stdout:2/471: fdatasync d0/f4d 0 2024-04-18T21:07:00.185 INFO:tasks.workunit.client.0.smithi078.stdout:8/460: getdents d0/d5c/d5a/d7b 0 2024-04-18T21:07:00.186 INFO:tasks.workunit.client.0.smithi078.stdout:2/472: unlink d0/db/d18/d21/d27/d29/d57/f61 0 2024-04-18T21:07:00.186 INFO:tasks.workunit.client.0.smithi078.stdout:5/492: dread d9/da/d4b/f4e [0,4194304] 0 2024-04-18T21:07:00.186 INFO:tasks.workunit.client.0.smithi078.stdout:2/473: chown d0/d1f/l48 15934367 1 2024-04-18T21:07:00.187 INFO:tasks.workunit.client.0.smithi078.stdout:8/461: truncate d0/d10/d60/d6f/f7a 921916 0 2024-04-18T21:07:00.187 INFO:tasks.workunit.client.0.smithi078.stdout:5/493: mknod d9/da/d3e/d4c/d67/ca3 0 2024-04-18T21:07:00.187 INFO:tasks.workunit.client.0.smithi078.stdout:7/491: dwrite d1/d16/dc/d11/d53/f78 [0,4194304] 0 2024-04-18T21:07:00.187 INFO:tasks.workunit.client.0.smithi078.stdout:2/474: fdatasync d0/db/f36 0 2024-04-18T21:07:00.189 INFO:tasks.workunit.client.0.smithi078.stdout:8/462: mkdir d0/d10/d8d 0 2024-04-18T21:07:00.189 INFO:tasks.workunit.client.0.smithi078.stdout:2/475: unlink d0/d1f/d34/c60 0 2024-04-18T21:07:00.191 INFO:tasks.workunit.client.0.smithi078.stdout:4/572: truncate d0/f7 2855985 0 2024-04-18T21:07:00.191 INFO:tasks.workunit.client.0.smithi078.stdout:5/494: rename d9/da/d90/d5d to d9/da/d90/d62/da4 0 2024-04-18T21:07:00.191 INFO:tasks.workunit.client.0.smithi078.stdout:2/476: fdatasync d0/db/f36 0 2024-04-18T21:07:00.191 INFO:tasks.workunit.client.0.smithi078.stdout:7/492: getdents d1/d16/d65 0 2024-04-18T21:07:00.194 INFO:tasks.workunit.client.0.smithi078.stdout:2/477: write d0/d1f/f3f [1238265,19082] 0 2024-04-18T21:07:00.194 INFO:tasks.workunit.client.0.smithi078.stdout:0/522: dwrite d0/d9/da/f42 [0,4194304] 0 2024-04-18T21:07:00.194 INFO:tasks.workunit.client.0.smithi078.stdout:7/493: fdatasync d1/d16/dc/d11/f24 0 2024-04-18T21:07:00.194 INFO:tasks.workunit.client.0.smithi078.stdout:9/509: dwrite d7/df/f10 [0,4194304] 0 2024-04-18T21:07:00.195 INFO:tasks.workunit.client.0.smithi078.stdout:7/494: creat d1/d16/d1c/fab x:0 0 0 2024-04-18T21:07:00.196 INFO:tasks.workunit.client.0.smithi078.stdout:6/418: dread d2/d6/dd/d4b/d5d/f6d [0,4194304] 0 2024-04-18T21:07:00.196 INFO:tasks.workunit.client.0.smithi078.stdout:4/573: getdents d0/dc/d29/d6d/d7b 0 2024-04-18T21:07:00.196 INFO:tasks.workunit.client.0.smithi078.stdout:2/478: rmdir d0/db/d18/d21/d27/d29/d33 39 2024-04-18T21:07:00.197 INFO:tasks.workunit.client.0.smithi078.stdout:0/523: link d0/d9/d4c/d70/f85 d0/d9/da/df/fa0 0 2024-04-18T21:07:00.197 INFO:tasks.workunit.client.0.smithi078.stdout:2/479: rmdir d0/db/d18 39 2024-04-18T21:07:00.201 INFO:tasks.workunit.client.0.smithi078.stdout:6/419: getdents d2/d34 0 2024-04-18T21:07:00.201 INFO:tasks.workunit.client.0.smithi078.stdout:8/463: dwrite d0/fd [4194304,4194304] 0 2024-04-18T21:07:00.201 INFO:tasks.workunit.client.0.smithi078.stdout:4/574: read d0/dc/d10/d1c/d60/d74/fb1 [1888964,93600] 0 2024-04-18T21:07:00.202 INFO:tasks.workunit.client.0.smithi078.stdout:6/420: mkdir d2/d34/d35/d57/d90 0 2024-04-18T21:07:00.203 INFO:tasks.workunit.client.0.smithi078.stdout:5/495: dwrite d9/da/d90/f6f [0,4194304] 0 2024-04-18T21:07:00.204 INFO:tasks.workunit.client.0.smithi078.stdout:8/464: readlink d0/d22/l6e 0 2024-04-18T21:07:00.206 INFO:tasks.workunit.client.0.smithi078.stdout:8/465: readlink d0/d10/d14/l40 0 2024-04-18T21:07:00.206 INFO:tasks.workunit.client.0.smithi078.stdout:6/421: symlink d2/d1c/d63/l91 0 2024-04-18T21:07:00.207 INFO:tasks.workunit.client.0.smithi078.stdout:4/575: mknod d0/dc/d10/cce 0 2024-04-18T21:07:00.208 INFO:tasks.workunit.client.0.smithi078.stdout:5/496: mkdir d9/da/d32/da5 0 2024-04-18T21:07:00.208 INFO:tasks.workunit.client.0.smithi078.stdout:9/510: dwrite d7/d11/d2d/f4e [0,4194304] 0 2024-04-18T21:07:00.210 INFO:tasks.workunit.client.0.smithi078.stdout:2/480: dwrite d0/db/d18/d21/d27/d79/f7f [0,4194304] 0 2024-04-18T21:07:00.210 INFO:tasks.workunit.client.0.smithi078.stdout:0/524: dwrite d0/d9/da/f84 [0,4194304] 0 2024-04-18T21:07:00.210 INFO:tasks.workunit.client.0.smithi078.stdout:6/422: creat d2/d1c/f92 x:0 0 0 2024-04-18T21:07:00.212 INFO:tasks.workunit.client.0.smithi078.stdout:9/511: symlink d7/d11/d2d/d3f/laa 0 2024-04-18T21:07:00.212 INFO:tasks.workunit.client.0.smithi078.stdout:8/466: link d0/f36 d0/d10/d14/d2a/f8e 0 2024-04-18T21:07:00.213 INFO:tasks.workunit.client.0.smithi078.stdout:2/481: rename d0/d1f/d34/c62 to d0/db/d18/d21/d8b/c8f 0 2024-04-18T21:07:00.213 INFO:tasks.workunit.client.0.smithi078.stdout:0/525: symlink d0/d9/dd/d17/d82/la1 0 2024-04-18T21:07:00.213 INFO:tasks.workunit.client.0.smithi078.stdout:8/467: readlink d0/d10/d14/d2a/d3c/l4f 0 2024-04-18T21:07:00.214 INFO:tasks.workunit.client.0.smithi078.stdout:9/512: creat d7/d23/d3e/d5a/fab x:0 0 0 2024-04-18T21:07:00.214 INFO:tasks.workunit.client.0.smithi078.stdout:0/526: chown d0/d9/dd/d17/d2e/f71 62202908 1 2024-04-18T21:07:00.214 INFO:tasks.workunit.client.0.smithi078.stdout:6/423: getdents d2/d1c/d3a/d8c 0 2024-04-18T21:07:00.215 INFO:tasks.workunit.client.0.smithi078.stdout:8/468: chown d0/d10/c4d 0 1 2024-04-18T21:07:00.215 INFO:tasks.workunit.client.0.smithi078.stdout:9/513: dread - d7/d11/d2d/d3f/f8c zero size 2024-04-18T21:07:00.215 INFO:tasks.workunit.client.0.smithi078.stdout:2/482: symlink d0/db/d18/d21/d27/d29/d4e/l90 0 2024-04-18T21:07:00.216 INFO:tasks.workunit.client.0.smithi078.stdout:6/424: write d2/d1f/f2c [3701405,89146] 0 2024-04-18T21:07:00.216 INFO:tasks.workunit.client.0.smithi078.stdout:4/576: dwrite d0/dc/d10/d85/f8d [4194304,4194304] 0 2024-04-18T21:07:00.216 INFO:tasks.workunit.client.0.smithi078.stdout:8/469: creat d0/d10/d14/d2a/d3a/f8f x:0 0 0 2024-04-18T21:07:00.216 INFO:tasks.workunit.client.0.smithi078.stdout:0/527: write d0/d9/da/db/d35/f4b [3914464,100247] 0 2024-04-18T21:07:00.218 INFO:tasks.workunit.client.0.smithi078.stdout:4/577: dread - d0/dc/d5b/f8a zero size 2024-04-18T21:07:00.218 INFO:tasks.workunit.client.0.smithi078.stdout:2/483: mknod d0/db/d18/d21/d27/d29/d57/c91 0 2024-04-18T21:07:00.218 INFO:tasks.workunit.client.0.smithi078.stdout:0/528: unlink d0/d9/d81/f8d 0 2024-04-18T21:07:00.218 INFO:tasks.workunit.client.0.smithi078.stdout:9/514: write d7/d11/d1b/d45/d4b/d5d/f60 [31008,17947] 0 2024-04-18T21:07:00.219 INFO:tasks.workunit.client.0.smithi078.stdout:0/529: dread - d0/d6c/f9e zero size 2024-04-18T21:07:00.219 INFO:tasks.workunit.client.0.smithi078.stdout:4/578: mkdir d0/dc/d5b/d71/dcf 0 2024-04-18T21:07:00.219 INFO:tasks.workunit.client.0.smithi078.stdout:9/515: creat d7/d11/d1b/d45/d74/fac x:0 0 0 2024-04-18T21:07:00.220 INFO:tasks.workunit.client.0.smithi078.stdout:2/484: write d0/db/d18/d21/d27/d29/f2d [4176395,57520] 0 2024-04-18T21:07:00.220 INFO:tasks.workunit.client.0.smithi078.stdout:0/530: mkdir d0/d9/da/db/d35/d3f/da2 0 2024-04-18T21:07:00.221 INFO:tasks.workunit.client.0.smithi078.stdout:9/516: stat d7/d11/d2d/d26/f64 0 2024-04-18T21:07:00.221 INFO:tasks.workunit.client.0.smithi078.stdout:0/531: chown d0/d6c/l7a 28184091 1 2024-04-18T21:07:00.221 INFO:tasks.workunit.client.0.smithi078.stdout:2/485: creat d0/db/d18/d21/d8b/f92 x:0 0 0 2024-04-18T21:07:00.221 INFO:tasks.workunit.client.0.smithi078.stdout:0/532: stat d0/d6c/d80 0 2024-04-18T21:07:00.222 INFO:tasks.workunit.client.0.smithi078.stdout:0/533: stat d0 0 2024-04-18T21:07:00.222 INFO:tasks.workunit.client.0.smithi078.stdout:9/517: mknod d7/d11/d80/cad 0 2024-04-18T21:07:00.222 INFO:tasks.workunit.client.0.smithi078.stdout:0/534: creat d0/d9/d58/fa3 x:0 0 0 2024-04-18T21:07:00.223 INFO:tasks.workunit.client.0.smithi078.stdout:9/518: link d7/c51 d7/d11/cae 0 2024-04-18T21:07:00.223 INFO:tasks.workunit.client.0.smithi078.stdout:2/486: creat d0/db/d18/d21/d27/f93 x:0 0 0 2024-04-18T21:07:00.224 INFO:tasks.workunit.client.0.smithi078.stdout:9/519: mknod d7/d11/d1b/caf 0 2024-04-18T21:07:00.224 INFO:tasks.workunit.client.0.smithi078.stdout:0/535: getdents d0/d9/d4c/d89 0 2024-04-18T21:07:00.224 INFO:tasks.workunit.client.0.smithi078.stdout:2/487: creat d0/db/d18/d21/d8b/f94 x:0 0 0 2024-04-18T21:07:00.225 INFO:tasks.workunit.client.0.smithi078.stdout:9/520: dread - d7/d11/d80/fa3 zero size 2024-04-18T21:07:00.225 INFO:tasks.workunit.client.0.smithi078.stdout:9/521: chown d7/df/d54 53 1 2024-04-18T21:07:00.227 INFO:tasks.workunit.client.0.smithi078.stdout:4/579: dwrite d0/dc/d10/d1c/d60/d74/fba [0,4194304] 0 2024-04-18T21:07:00.227 INFO:tasks.workunit.client.0.smithi078.stdout:0/536: rename d0/d9/f23 to d0/d9/da/fa4 0 2024-04-18T21:07:00.227 INFO:tasks.workunit.client.0.smithi078.stdout:9/522: mkdir d7/d23/d3e/d5a/da8/db0 0 2024-04-18T21:07:00.228 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:07:00.228 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-18T21:07:00.228 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-18T21:07:00.228 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:07:00.228 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.228 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:00.228 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:07:00.228 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 114.610818752, 2024-04-18T21:07:00.228 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045668994999999997, 2024-04-18T21:07:00.228 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:00.229 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:00.229 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:00.229 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:00.229 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.229 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:00.229 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:07:00.229 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:00.229 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.229 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.229 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:00.229 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:07:00.229 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:00.229 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.229 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.229 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:00.230 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615459+0000", 2024-04-18T21:07:00.230 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5030000000000001e-06 2024-04-18T21:07:00.230 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.230 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.230 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:00.230 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615506+0000", 2024-04-18T21:07:00.230 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6872000000000001e-05 2024-04-18T21:07:00.230 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.230 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.230 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:00.230 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615527+0000", 2024-04-18T21:07:00.230 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0763000000000001e-05 2024-04-18T21:07:00.230 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.231 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.231 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:00.231 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615551+0000", 2024-04-18T21:07:00.231 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4159e-05 2024-04-18T21:07:00.231 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.231 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.231 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:00.231 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615736+0000", 2024-04-18T21:07:00.231 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018499599999999999 2024-04-18T21:07:00.231 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.231 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.231 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:07:00.231 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615748+0000", 2024-04-18T21:07:00.231 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2272999999999999e-05 2024-04-18T21:07:00.231 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.232 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.232 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:00.232 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635481+0000", 2024-04-18T21:07:00.232 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019732772999999999 2024-04-18T21:07:00.232 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.232 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.232 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:00.232 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635791+0000", 2024-04-18T21:07:00.232 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031013299999999998 2024-04-18T21:07:00.232 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.232 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.232 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:00.232 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636101+0000", 2024-04-18T21:07:00.232 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030943300000000002 2024-04-18T21:07:00.233 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.233 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.233 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:00.233 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646043+0000", 2024-04-18T21:07:00.233 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099428139999999995 2024-04-18T21:07:00.233 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.233 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.233 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:00.233 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660991+0000", 2024-04-18T21:07:00.233 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014947142 2024-04-18T21:07:00.233 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.233 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.233 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:00.233 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661061+0000", 2024-04-18T21:07:00.234 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0438000000000006e-05 2024-04-18T21:07:00.234 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.234 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.234 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:00.234 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661127+0000", 2024-04-18T21:07:00.234 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5696000000000003e-05 2024-04-18T21:07:00.234 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:00.234 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:00.234 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:00.234 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.234 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.234 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:00.234 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:07:00.234 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 114.610606324, 2024-04-18T21:07:00.235 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045745085999999997, 2024-04-18T21:07:00.235 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:00.235 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:00.235 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:00.235 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:00.235 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.235 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:00.235 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:07:00.235 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:00.235 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.235 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.235 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:00.235 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:07:00.235 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:00.235 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.236 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.236 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:00.236 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:07:00.236 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7400000000000001e-06 2024-04-18T21:07:00.236 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.236 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.236 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:00.236 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:07:00.236 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8133e-05 2024-04-18T21:07:00.236 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.236 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.236 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:00.236 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615726+0000", 2024-04-18T21:07:00.236 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6132e-05 2024-04-18T21:07:00.236 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.237 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.237 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:00.237 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615742+0000", 2024-04-18T21:07:00.237 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6157000000000001e-05 2024-04-18T21:07:00.237 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.237 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.237 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:00.237 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615937+0000", 2024-04-18T21:07:00.237 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000194768 2024-04-18T21:07:00.237 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.237 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.237 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:07:00.237 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615950+0000", 2024-04-18T21:07:00.237 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3084e-05 2024-04-18T21:07:00.237 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.238 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.238 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:00.238 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643676+0000", 2024-04-18T21:07:00.238 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027725639999999999 2024-04-18T21:07:00.238 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.238 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.238 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:00.238 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643867+0000", 2024-04-18T21:07:00.238 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019075900000000001 2024-04-18T21:07:00.238 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.238 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.238 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:00.238 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:07:00.238 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036013799999999997 2024-04-18T21:07:00.239 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.239 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.239 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:00.239 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646068+0000", 2024-04-18T21:07:00.239 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001841536 2024-04-18T21:07:00.239 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.239 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.239 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:00.239 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661184+0000", 2024-04-18T21:07:00.239 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015115458999999999 2024-04-18T21:07:00.239 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.239 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.239 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:00.239 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661283+0000", 2024-04-18T21:07:00.239 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9502999999999999e-05 2024-04-18T21:07:00.240 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.240 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.240 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:00.240 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661415+0000", 2024-04-18T21:07:00.240 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000132037 2024-04-18T21:07:00.240 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:00.240 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:00.240 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:00.240 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.240 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.240 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:100 3.1f 3:f83d65d8:::200.00000004:head [write 315055~1400 [fadvise_dontneed] in=1400b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:00.240 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757681+0000", 2024-04-18T21:07:00.240 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 14.468595476000001, 2024-04-18T21:07:00.240 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045364542000000001, 2024-04-18T21:07:00.241 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:00.241 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:00.241 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:00.241 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:00.241 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.241 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:00.241 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757681+0000", 2024-04-18T21:07:00.241 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:00.241 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.241 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.241 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:00.241 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757681+0000", 2024-04-18T21:07:00.241 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:00.241 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.242 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.242 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:00.242 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757682+0000", 2024-04-18T21:07:00.242 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8999999999999996e-07 2024-04-18T21:07:00.242 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.242 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.242 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:00.242 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757685+0000", 2024-04-18T21:07:00.242 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.766e-06 2024-04-18T21:07:00.242 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.242 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.242 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:00.242 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757715+0000", 2024-04-18T21:07:00.242 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9904e-05 2024-04-18T21:07:00.242 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.243 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.243 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:00.243 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757723+0000", 2024-04-18T21:07:00.243 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9899999999999997e-06 2024-04-18T21:07:00.243 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.243 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.243 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:00.243 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.796754+0000", 2024-04-18T21:07:00.243 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.039030774999999997 2024-04-18T21:07:00.243 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.243 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.243 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:00.243 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.796825+0000", 2024-04-18T21:07:00.243 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0511000000000003e-05 2024-04-18T21:07:00.244 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.244 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.244 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:00.244 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.796952+0000", 2024-04-18T21:07:00.244 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012720099999999999 2024-04-18T21:07:00.244 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.244 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.244 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:00.244 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.800774+0000", 2024-04-18T21:07:00.244 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0038226039999999998 2024-04-18T21:07:00.244 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.244 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.244 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:00.244 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802920+0000", 2024-04-18T21:07:00.244 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002145194 2024-04-18T21:07:00.244 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.245 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.245 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:00.245 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802998+0000", 2024-04-18T21:07:00.245 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7836000000000005e-05 2024-04-18T21:07:00.245 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.245 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.245 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:00.245 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803046+0000", 2024-04-18T21:07:00.245 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8071000000000001e-05 2024-04-18T21:07:00.245 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:00.245 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:00.245 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:00.245 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.245 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.246 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:101 3.1f 3:f83d65d8:::200.00000004:head [write 316455~1401 [fadvise_dontneed] in=1401b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:00.246 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:07:00.246 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 14.468542713, 2024-04-18T21:07:00.246 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.048270212999999999, 2024-04-18T21:07:00.246 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:00.246 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:00.246 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:00.246 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:00.246 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.246 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:00.246 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:07:00.246 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:00.246 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.246 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.246 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:00.247 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:07:00.247 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:00.247 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.247 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.247 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:00.247 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:07:00.247 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7700000000000004e-07 2024-04-18T21:07:00.247 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.247 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.247 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:00.247 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757745+0000", 2024-04-18T21:07:00.247 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0910000000000001e-05 2024-04-18T21:07:00.247 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.247 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.247 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:00.248 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757758+0000", 2024-04-18T21:07:00.248 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2593e-05 2024-04-18T21:07:00.248 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.248 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.248 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:00.248 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757765+0000", 2024-04-18T21:07:00.248 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1659999999999997e-06 2024-04-18T21:07:00.248 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.248 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.248 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:00.248 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.797782+0000", 2024-04-18T21:07:00.248 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.040017283000000001 2024-04-18T21:07:00.248 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.248 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.248 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:00.249 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.797949+0000", 2024-04-18T21:07:00.249 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016650399999999999 2024-04-18T21:07:00.249 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.249 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.249 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:00.249 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.798152+0000", 2024-04-18T21:07:00.249 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000203098 2024-04-18T21:07:00.249 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.249 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.249 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:00.249 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.800792+0000", 2024-04-18T21:07:00.249 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026394779999999998 2024-04-18T21:07:00.249 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.249 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.249 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:00.250 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805921+0000", 2024-04-18T21:07:00.250 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0051295519999999999 2024-04-18T21:07:00.250 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.250 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.250 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:00.250 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805967+0000", 2024-04-18T21:07:00.250 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5457000000000002e-05 2024-04-18T21:07:00.250 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.250 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.250 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:00.250 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806004+0000", 2024-04-18T21:07:00.250 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7494999999999999e-05 2024-04-18T21:07:00.250 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:00.250 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:00.250 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:00.251 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.251 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.251 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:102 3.1f 3:f83d65d8:::200.00000004:head [write 317856~1403 [fadvise_dontneed] in=1403b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:00.251 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757775+0000", 2024-04-18T21:07:00.251 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 14.468501647, 2024-04-18T21:07:00.251 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.048337705000000002, 2024-04-18T21:07:00.251 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:00.251 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:00.251 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:00.251 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:00.251 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.251 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:00.251 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757775+0000", 2024-04-18T21:07:00.251 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:00.251 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.252 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.252 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:00.252 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757775+0000", 2024-04-18T21:07:00.252 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:00.252 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.252 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.252 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:00.252 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757776+0000", 2024-04-18T21:07:00.252 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5300000000000004e-07 2024-04-18T21:07:00.252 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.252 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.252 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:00.252 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757780+0000", 2024-04-18T21:07:00.252 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2270000000000004e-06 2024-04-18T21:07:00.252 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.253 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.253 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:00.253 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757792+0000", 2024-04-18T21:07:00.253 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2696e-05 2024-04-18T21:07:00.253 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.253 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.253 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:00.253 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757800+0000", 2024-04-18T21:07:00.253 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1439999999999997e-06 2024-04-18T21:07:00.253 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.253 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.253 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:00.253 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.798773+0000", 2024-04-18T21:07:00.253 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.040973074999999998 2024-04-18T21:07:00.253 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.254 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.254 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:00.254 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.798990+0000", 2024-04-18T21:07:00.254 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000217161 2024-04-18T21:07:00.254 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.254 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.254 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:00.254 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.799173+0000", 2024-04-18T21:07:00.254 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018295900000000001 2024-04-18T21:07:00.254 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.254 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.254 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:00.254 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802469+0000", 2024-04-18T21:07:00.254 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032965350000000002 2024-04-18T21:07:00.255 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.255 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.255 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:00.255 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806042+0000", 2024-04-18T21:07:00.255 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035724630000000001 2024-04-18T21:07:00.255 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.255 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.255 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:00.255 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806077+0000", 2024-04-18T21:07:00.255 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4997999999999999e-05 2024-04-18T21:07:00.255 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.255 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.255 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:00.255 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806113+0000", 2024-04-18T21:07:00.255 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5794000000000003e-05 2024-04-18T21:07:00.256 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:00.256 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:00.256 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:00.256 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.256 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.256 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:103 3.1f 3:f83d65d8:::200.00000004:head [write 319259~1404 [fadvise_dontneed] in=1404b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:00.256 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:07:00.256 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 14.468467800999999, 2024-04-18T21:07:00.256 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.048414481000000002, 2024-04-18T21:07:00.256 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:00.256 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:00.256 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:00.256 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:00.256 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.257 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:00.257 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:07:00.257 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:00.257 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.257 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.257 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:00.257 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:07:00.257 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:00.257 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.257 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.257 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:00.257 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:07:00.257 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4700000000000001e-07 2024-04-18T21:07:00.257 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.257 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.258 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:00.258 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757814+0000", 2024-04-18T21:07:00.258 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1829999999999996e-06 2024-04-18T21:07:00.258 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.258 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.258 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:00.258 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757825+0000", 2024-04-18T21:07:00.258 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1754e-05 2024-04-18T21:07:00.258 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.258 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.258 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:00.258 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757832+0000", 2024-04-18T21:07:00.258 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8430000000000004e-06 2024-04-18T21:07:00.258 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.258 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.259 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:00.259 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.799809+0000", 2024-04-18T21:07:00.259 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.041976960000000001 2024-04-18T21:07:00.259 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.259 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.259 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:00.259 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.799934+0000", 2024-04-18T21:07:00.259 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000125053 2024-04-18T21:07:00.259 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.259 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.259 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:00.259 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.800067+0000", 2024-04-18T21:07:00.259 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013276299999999999 2024-04-18T21:07:00.259 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.259 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.259 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:00.260 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804582+0000", 2024-04-18T21:07:00.260 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0045148899999999997 2024-04-18T21:07:00.260 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.260 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.260 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:00.260 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806158+0000", 2024-04-18T21:07:00.260 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001575894 2024-04-18T21:07:00.260 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.260 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.260 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:00.260 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806189+0000", 2024-04-18T21:07:00.260 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1423000000000001e-05 2024-04-18T21:07:00.260 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.260 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.260 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:00.260 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806223+0000", 2024-04-18T21:07:00.261 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4071e-05 2024-04-18T21:07:00.261 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:00.261 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:00.261 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:00.261 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.261 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.261 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:104 3.1f 3:f83d65d8:::200.00000004:head [write 320663~1405 [fadvise_dontneed] in=1405b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:00.261 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757841+0000", 2024-04-18T21:07:00.261 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 14.468435596999999, 2024-04-18T21:07:00.261 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056381623999999998, 2024-04-18T21:07:00.261 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:00.261 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:00.261 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:00.261 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:00.261 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.261 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:00.261 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757841+0000", 2024-04-18T21:07:00.262 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:00.262 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.262 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.262 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:00.262 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757841+0000", 2024-04-18T21:07:00.262 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:00.262 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.262 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.262 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:00.262 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757842+0000", 2024-04-18T21:07:00.262 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5000000000000002e-07 2024-04-18T21:07:00.262 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.262 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.263 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:00.263 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757852+0000", 2024-04-18T21:07:00.263 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.084e-05 2024-04-18T21:07:00.263 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.263 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.263 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:00.263 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757865+0000", 2024-04-18T21:07:00.263 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2643000000000001e-05 2024-04-18T21:07:00.263 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.263 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.263 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:00.263 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757872+0000", 2024-04-18T21:07:00.263 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8689999999999998e-06 2024-04-18T21:07:00.263 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.263 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.264 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:00.264 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.801102+0000", 2024-04-18T21:07:00.264 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043229837 2024-04-18T21:07:00.264 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.264 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.264 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:00.264 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.801291+0000", 2024-04-18T21:07:00.264 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000189641 2024-04-18T21:07:00.264 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.264 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.264 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:00.264 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.801640+0000", 2024-04-18T21:07:00.264 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000348971 2024-04-18T21:07:00.264 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.264 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.265 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:00.265 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805849+0000", 2024-04-18T21:07:00.265 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042082739999999997 2024-04-18T21:07:00.265 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.265 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.265 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:00.265 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814135+0000", 2024-04-18T21:07:00.265 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0082867270000000007 2024-04-18T21:07:00.265 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.265 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.265 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:00.265 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814180+0000", 2024-04-18T21:07:00.265 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4982999999999999e-05 2024-04-18T21:07:00.265 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.265 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.266 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:00.266 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814223+0000", 2024-04-18T21:07:00.266 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2188999999999999e-05 2024-04-18T21:07:00.266 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:00.266 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:00.266 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:00.266 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.266 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.266 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:105 3.1f 3:f83d65d8:::200.00000004:head [write 322068~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:00.266 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:07:00.266 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 14.468395000999999, 2024-04-18T21:07:00.266 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056513678999999997, 2024-04-18T21:07:00.266 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:00.266 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:00.266 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:00.267 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:00.267 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.267 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:00.267 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:07:00.267 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:00.267 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.267 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.267 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:00.267 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:07:00.267 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:00.267 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.267 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.267 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:00.267 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:07:00.267 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2600000000000002e-07 2024-04-18T21:07:00.267 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.268 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.268 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:00.268 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757888+0000", 2024-04-18T21:07:00.268 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7130000000000002e-06 2024-04-18T21:07:00.268 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.268 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.268 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:00.268 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757906+0000", 2024-04-18T21:07:00.268 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7723999999999998e-05 2024-04-18T21:07:00.268 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.268 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.268 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:00.268 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757921+0000", 2024-04-18T21:07:00.268 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4936000000000001e-05 2024-04-18T21:07:00.268 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.269 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.269 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:00.269 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802493+0000", 2024-04-18T21:07:00.269 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.044571927999999997 2024-04-18T21:07:00.269 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.269 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.269 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:00.269 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802537+0000", 2024-04-18T21:07:00.269 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4449000000000001e-05 2024-04-18T21:07:00.269 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.269 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.269 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:00.269 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802605+0000", 2024-04-18T21:07:00.269 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7945000000000001e-05 2024-04-18T21:07:00.269 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.269 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.269 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:00.270 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805852+0000", 2024-04-18T21:07:00.270 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032469909999999999 2024-04-18T21:07:00.270 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.270 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.270 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:00.270 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814298+0000", 2024-04-18T21:07:00.270 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084463309999999996 2024-04-18T21:07:00.270 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.270 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.270 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:00.270 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814355+0000", 2024-04-18T21:07:00.270 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6459999999999998e-05 2024-04-18T21:07:00.270 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.270 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.271 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:00.271 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814395+0000", 2024-04-18T21:07:00.271 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0475999999999997e-05 2024-04-18T21:07:00.271 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:00.271 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:00.271 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:00.271 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.271 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.271 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:106 3.1f 3:f83d65d8:::200.00000004:head [write 323467~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:00.271 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757955+0000", 2024-04-18T21:07:00.271 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 14.468321771999999, 2024-04-18T21:07:00.271 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056539990999999998, 2024-04-18T21:07:00.271 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:00.271 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:00.272 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:00.272 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:00.272 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.272 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:00.272 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757955+0000", 2024-04-18T21:07:00.272 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:00.272 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.272 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.272 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:00.272 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757955+0000", 2024-04-18T21:07:00.272 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:00.272 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.272 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.272 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:00.272 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757956+0000", 2024-04-18T21:07:00.273 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.144e-06 2024-04-18T21:07:00.273 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.273 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.273 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:00.273 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757970+0000", 2024-04-18T21:07:00.273 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3899e-05 2024-04-18T21:07:00.273 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.273 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.273 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:00.273 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757988+0000", 2024-04-18T21:07:00.273 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8033000000000002e-05 2024-04-18T21:07:00.273 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.273 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.273 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:00.273 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758002+0000", 2024-04-18T21:07:00.273 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3973e-05 2024-04-18T21:07:00.274 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.274 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.274 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:00.274 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803072+0000", 2024-04-18T21:07:00.274 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045070194000000001 2024-04-18T21:07:00.274 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.274 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.274 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:00.274 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803125+0000", 2024-04-18T21:07:00.274 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3498000000000002e-05 2024-04-18T21:07:00.274 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.274 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.274 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:00.274 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803233+0000", 2024-04-18T21:07:00.275 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010704099999999999 2024-04-18T21:07:00.275 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.275 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.275 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:00.275 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805856+0000", 2024-04-18T21:07:00.275 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026233430000000002 2024-04-18T21:07:00.275 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.275 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.275 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:00.275 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814439+0000", 2024-04-18T21:07:00.275 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0085833839999999995 2024-04-18T21:07:00.275 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.275 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.275 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:00.275 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814469+0000", 2024-04-18T21:07:00.276 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9784000000000001e-05 2024-04-18T21:07:00.276 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.276 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.276 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:00.276 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814495+0000", 2024-04-18T21:07:00.276 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5698e-05 2024-04-18T21:07:00.276 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:00.276 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:00.276 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:00.276 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.276 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.276 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:107 3.1f 3:f83d65d8:::200.00000004:head [write 324866~1421 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:00.276 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758019+0000", 2024-04-18T21:07:00.276 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 14.468257145999999, 2024-04-18T21:07:00.276 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056580563, 2024-04-18T21:07:00.277 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:00.277 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:00.277 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:00.277 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:00.277 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.277 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:00.277 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758019+0000", 2024-04-18T21:07:00.277 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:00.277 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.277 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.277 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:00.277 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758019+0000", 2024-04-18T21:07:00.277 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:00.277 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.277 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.277 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:00.278 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758021+0000", 2024-04-18T21:07:00.278 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1999999999999999e-06 2024-04-18T21:07:00.278 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.278 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.278 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:00.278 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758028+0000", 2024-04-18T21:07:00.278 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7200000000000006e-06 2024-04-18T21:07:00.278 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.278 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.278 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:00.278 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758050+0000", 2024-04-18T21:07:00.278 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1877000000000001e-05 2024-04-18T21:07:00.278 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.278 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.279 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:00.279 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758064+0000", 2024-04-18T21:07:00.279 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.383e-05 2024-04-18T21:07:00.279 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.279 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.279 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:00.279 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803593+0000", 2024-04-18T21:07:00.279 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045528831999999998 2024-04-18T21:07:00.279 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.279 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.279 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:00.279 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803635+0000", 2024-04-18T21:07:00.279 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1980000000000001e-05 2024-04-18T21:07:00.279 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.279 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.280 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:00.280 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803703+0000", 2024-04-18T21:07:00.280 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8542999999999997e-05 2024-04-18T21:07:00.280 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.280 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.280 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:00.280 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806123+0000", 2024-04-18T21:07:00.280 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002419769 2024-04-18T21:07:00.280 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.280 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.280 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:00.280 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814542+0000", 2024-04-18T21:07:00.280 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084189460000000001 2024-04-18T21:07:00.280 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.280 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.280 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:00.281 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814576+0000", 2024-04-18T21:07:00.281 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3679000000000001e-05 2024-04-18T21:07:00.281 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.281 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.281 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:00.281 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814600+0000", 2024-04-18T21:07:00.281 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4187000000000001e-05 2024-04-18T21:07:00.281 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:00.281 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:00.281 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:00.281 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.281 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.281 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:108 3.1f 3:f83d65d8:::200.00000004:head [write 326287~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:00.281 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:07:00.281 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 14.468193977, 2024-04-18T21:07:00.281 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056616183, 2024-04-18T21:07:00.282 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:00.282 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:00.282 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:00.282 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:00.282 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.282 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:00.282 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:07:00.282 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:00.282 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.282 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.282 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:00.282 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:07:00.282 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:00.282 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.282 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.283 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:00.283 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758084+0000", 2024-04-18T21:07:00.283 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.124e-06 2024-04-18T21:07:00.283 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.283 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.283 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:00.283 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758100+0000", 2024-04-18T21:07:00.283 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6246e-05 2024-04-18T21:07:00.283 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.283 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.283 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:00.283 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758118+0000", 2024-04-18T21:07:00.283 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8267e-05 2024-04-18T21:07:00.283 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.283 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.283 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:00.284 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758134+0000", 2024-04-18T21:07:00.284 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5950000000000001e-05 2024-04-18T21:07:00.284 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.284 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.284 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:00.284 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803949+0000", 2024-04-18T21:07:00.284 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045815349999999998 2024-04-18T21:07:00.284 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.284 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.284 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:00.284 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804011+0000", 2024-04-18T21:07:00.284 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1044999999999996e-05 2024-04-18T21:07:00.284 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.284 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.284 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:00.284 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804128+0000", 2024-04-18T21:07:00.285 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117148 2024-04-18T21:07:00.285 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.285 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.285 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:00.285 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806794+0000", 2024-04-18T21:07:00.285 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002666692 2024-04-18T21:07:00.285 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.285 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.285 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:00.285 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814645+0000", 2024-04-18T21:07:00.285 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0078508880000000003 2024-04-18T21:07:00.285 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.285 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.285 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:00.285 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814678+0000", 2024-04-18T21:07:00.285 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3188999999999997e-05 2024-04-18T21:07:00.286 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.286 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.286 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:00.286 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814699+0000", 2024-04-18T21:07:00.286 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0284000000000001e-05 2024-04-18T21:07:00.286 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:00.286 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:00.286 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:00.286 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.286 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.286 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:109 3.1f 3:f83d65d8:::200.00000004:head [write 327693~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:00.286 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:07:00.286 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 14.46812461, 2024-04-18T21:07:00.286 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056621036999999999, 2024-04-18T21:07:00.287 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:00.287 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:00.287 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:00.287 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:00.287 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.287 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:00.287 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:07:00.287 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:00.287 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.287 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.287 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:00.287 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:07:00.287 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:00.287 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.287 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.288 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:00.288 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758153+0000", 2024-04-18T21:07:00.288 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1459999999999999e-06 2024-04-18T21:07:00.288 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.288 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.288 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:00.288 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758161+0000", 2024-04-18T21:07:00.288 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7999999999999999e-06 2024-04-18T21:07:00.288 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.288 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.288 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:00.288 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758179+0000", 2024-04-18T21:07:00.288 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7949999999999999e-05 2024-04-18T21:07:00.288 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.288 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.288 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:00.289 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758193+0000", 2024-04-18T21:07:00.289 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3773e-05 2024-04-18T21:07:00.289 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.289 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.289 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:00.289 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804632+0000", 2024-04-18T21:07:00.289 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.046439469999999997 2024-04-18T21:07:00.289 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.289 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.289 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:00.289 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804790+0000", 2024-04-18T21:07:00.289 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015784300000000001 2024-04-18T21:07:00.289 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.289 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.289 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:00.289 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805056+0000", 2024-04-18T21:07:00.290 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026652400000000003 2024-04-18T21:07:00.290 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.290 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.290 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:00.290 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.808959+0000", 2024-04-18T21:07:00.290 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003903077 2024-04-18T21:07:00.290 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.290 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.290 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:00.290 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814728+0000", 2024-04-18T21:07:00.290 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0057682489999999996 2024-04-18T21:07:00.290 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.290 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.290 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:00.290 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814754+0000", 2024-04-18T21:07:00.291 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6673999999999999e-05 2024-04-18T21:07:00.291 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.291 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.291 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:00.291 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814773+0000", 2024-04-18T21:07:00.291 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8530999999999999e-05 2024-04-18T21:07:00.291 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:00.291 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:00.291 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:00.291 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.291 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.291 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:110 3.1f 3:f83d65d8:::200.00000004:head [write 329098~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:00.291 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:07:00.291 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 14.468066200999999, 2024-04-18T21:07:00.291 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056669113, 2024-04-18T21:07:00.292 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:00.292 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:00.292 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:00.292 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:00.292 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.292 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:00.292 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:07:00.292 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:00.292 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.292 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.292 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:00.292 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:07:00.292 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:00.292 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.292 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.293 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:00.293 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758212+0000", 2024-04-18T21:07:00.293 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:07:00.293 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.293 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.293 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:00.293 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758219+0000", 2024-04-18T21:07:00.293 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4229999999999999e-06 2024-04-18T21:07:00.293 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.293 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.293 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:00.293 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758237+0000", 2024-04-18T21:07:00.293 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7966999999999999e-05 2024-04-18T21:07:00.293 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.293 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.294 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:00.294 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758252+0000", 2024-04-18T21:07:00.294 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5322999999999999e-05 2024-04-18T21:07:00.294 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.294 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.294 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:00.294 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805536+0000", 2024-04-18T21:07:00.294 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.047283861000000003 2024-04-18T21:07:00.294 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.294 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.294 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:00.294 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805579+0000", 2024-04-18T21:07:00.294 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2738999999999999e-05 2024-04-18T21:07:00.294 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.294 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.295 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:00.295 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805649+0000", 2024-04-18T21:07:00.295 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0213e-05 2024-04-18T21:07:00.295 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.295 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.295 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:00.295 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.808966+0000", 2024-04-18T21:07:00.295 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033166129999999999 2024-04-18T21:07:00.295 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.295 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.295 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:00.295 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814812+0000", 2024-04-18T21:07:00.295 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0058463589999999998 2024-04-18T21:07:00.295 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.296 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.296 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:00.296 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814854+0000", 2024-04-18T21:07:00.296 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1618e-05 2024-04-18T21:07:00.296 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.296 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.296 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:00.296 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814879+0000", 2024-04-18T21:07:00.296 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5754000000000001e-05 2024-04-18T21:07:00.296 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:00.296 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:00.296 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:00.296 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.296 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.296 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:111 3.1f 3:f83d65d8:::200.00000004:head [write 330499~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:00.297 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:07:00.297 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 14.468005225000001, 2024-04-18T21:07:00.297 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058693793000000001, 2024-04-18T21:07:00.297 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:00.297 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:00.297 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:00.297 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:00.297 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.297 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:00.297 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:07:00.297 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:00.297 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.297 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.297 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:00.298 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:07:00.298 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:00.298 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.298 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.298 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:00.298 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758272+0000", 2024-04-18T21:07:00.298 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1200000000000001e-06 2024-04-18T21:07:00.298 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.298 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.298 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:00.298 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758287+0000", 2024-04-18T21:07:00.298 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5017e-05 2024-04-18T21:07:00.298 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.298 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.299 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:00.299 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758309+0000", 2024-04-18T21:07:00.299 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1866e-05 2024-04-18T21:07:00.299 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.299 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.299 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:00.299 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758323+0000", 2024-04-18T21:07:00.299 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3606e-05 2024-04-18T21:07:00.299 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.299 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.299 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:00.299 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806279+0000", 2024-04-18T21:07:00.299 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.047956061000000001 2024-04-18T21:07:00.299 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.300 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.300 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:00.300 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806350+0000", 2024-04-18T21:07:00.300 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1070999999999998e-05 2024-04-18T21:07:00.300 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.300 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.300 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:00.300 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806459+0000", 2024-04-18T21:07:00.300 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000108606 2024-04-18T21:07:00.300 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.300 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.300 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:00.300 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.809774+0000", 2024-04-18T21:07:00.300 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003314881 2024-04-18T21:07:00.300 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.301 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.301 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:00.301 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816910+0000", 2024-04-18T21:07:00.301 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0071367760000000001 2024-04-18T21:07:00.301 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.301 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.301 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:00.301 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816941+0000", 2024-04-18T21:07:00.301 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0846000000000002e-05 2024-04-18T21:07:00.301 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.301 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.301 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:00.301 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816965+0000", 2024-04-18T21:07:00.301 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3943000000000001e-05 2024-04-18T21:07:00.302 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:00.302 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:00.302 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:00.302 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.302 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.302 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:5230 4.17 4:eb2cc4c4:::1000000184c.00000000:head [write 0~2191] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-18T21:07:00.302 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.760650+0000", 2024-04-18T21:07:00.302 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 14.465626053999999, 2024-04-18T21:07:00.302 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.054210577000000003, 2024-04-18T21:07:00.302 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:00.302 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:00.302 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:00.302 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:07:00.303 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:07:00.303 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:00.303 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 5230 2024-04-18T21:07:00.303 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.303 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:00.303 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.303 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:00.303 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760650+0000", 2024-04-18T21:07:00.303 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:00.303 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.303 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.303 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:00.303 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760650+0000", 2024-04-18T21:07:00.303 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:00.303 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.304 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.304 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:00.304 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760653+0000", 2024-04-18T21:07:00.304 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0829999999999998e-06 2024-04-18T21:07:00.304 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.304 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.304 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:00.304 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760664+0000", 2024-04-18T21:07:00.304 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.111e-05 2024-04-18T21:07:00.304 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.304 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.304 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:00.304 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760688+0000", 2024-04-18T21:07:00.304 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4837e-05 2024-04-18T21:07:00.304 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.304 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.304 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:00.305 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760702+0000", 2024-04-18T21:07:00.305 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3723000000000001e-05 2024-04-18T21:07:00.305 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.305 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.305 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:00.305 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806264+0000", 2024-04-18T21:07:00.305 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045562182 2024-04-18T21:07:00.305 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.305 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.305 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:00.305 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806351+0000", 2024-04-18T21:07:00.305 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6322000000000005e-05 2024-04-18T21:07:00.305 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.305 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.305 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:00.306 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806453+0000", 2024-04-18T21:07:00.306 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000102602 2024-04-18T21:07:00.306 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.306 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.306 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:00.306 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.808972+0000", 2024-04-18T21:07:00.306 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025184090000000001 2024-04-18T21:07:00.306 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.306 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.306 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:00.306 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814798+0000", 2024-04-18T21:07:00.306 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0058266689999999996 2024-04-18T21:07:00.306 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.306 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.306 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:00.307 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814839+0000", 2024-04-18T21:07:00.307 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0482000000000003e-05 2024-04-18T21:07:00.307 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.307 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.307 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:00.307 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814861+0000", 2024-04-18T21:07:00.307 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2158e-05 2024-04-18T21:07:00.307 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:00.307 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:00.307 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:00.307 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.307 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.307 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:112 3.1f 3:f83d65d8:::200.00000004:head [write 331898~20167 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:00.307 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.771321+0000", 2024-04-18T21:07:00.307 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 14.454955427, 2024-04-18T21:07:00.308 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045740306000000001, 2024-04-18T21:07:00.308 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:00.308 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:00.308 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:00.308 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:00.308 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.308 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:00.308 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771321+0000", 2024-04-18T21:07:00.308 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:00.308 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.308 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.308 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:00.308 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771321+0000", 2024-04-18T21:07:00.308 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:00.308 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.309 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.309 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:00.309 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771323+0000", 2024-04-18T21:07:00.309 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3740000000000001e-06 2024-04-18T21:07:00.309 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.309 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.309 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:00.309 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771359+0000", 2024-04-18T21:07:00.309 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5447999999999997e-05 2024-04-18T21:07:00.309 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.309 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.309 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:00.309 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771388+0000", 2024-04-18T21:07:00.309 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8915e-05 2024-04-18T21:07:00.309 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.309 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.310 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:00.310 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771410+0000", 2024-04-18T21:07:00.310 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1899000000000002e-05 2024-04-18T21:07:00.310 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.310 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.310 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:00.310 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806827+0000", 2024-04-18T21:07:00.310 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.035417063999999998 2024-04-18T21:07:00.310 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.310 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.310 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:00.310 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806873+0000", 2024-04-18T21:07:00.310 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6261999999999999e-05 2024-04-18T21:07:00.310 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.310 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.311 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:00.311 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806946+0000", 2024-04-18T21:07:00.311 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3205000000000001e-05 2024-04-18T21:07:00.311 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.311 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.311 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:00.311 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.809781+0000", 2024-04-18T21:07:00.311 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002834937 2024-04-18T21:07:00.311 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.311 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.311 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:00.311 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817003+0000", 2024-04-18T21:07:00.311 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0072217959999999999 2024-04-18T21:07:00.311 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.311 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.311 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:00.312 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817038+0000", 2024-04-18T21:07:00.312 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4696999999999997e-05 2024-04-18T21:07:00.312 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.312 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.312 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:00.312 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817061+0000", 2024-04-18T21:07:00.312 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3708999999999999e-05 2024-04-18T21:07:00.312 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:00.312 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:00.312 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:00.312 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.312 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.312 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:113 3.1f 3:f83d65d8:::200.00000004:head [write 352065~3878 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:00.313 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.771472+0000", 2024-04-18T21:07:00.313 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 14.454804691, 2024-04-18T21:07:00.313 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045689726, 2024-04-18T21:07:00.313 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:00.313 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:00.313 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:00.313 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:00.313 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.313 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:00.313 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771472+0000", 2024-04-18T21:07:00.313 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:00.313 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.313 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.313 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:00.313 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771472+0000", 2024-04-18T21:07:00.313 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:00.314 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.314 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.314 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:00.314 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771473+0000", 2024-04-18T21:07:00.314 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3829999999999999e-06 2024-04-18T21:07:00.314 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.314 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.314 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:00.314 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771489+0000", 2024-04-18T21:07:00.314 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5797000000000001e-05 2024-04-18T21:07:00.314 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.314 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.314 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:00.314 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771509+0000", 2024-04-18T21:07:00.314 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0401999999999999e-05 2024-04-18T21:07:00.315 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.315 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.315 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:00.315 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771525+0000", 2024-04-18T21:07:00.315 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5099999999999999e-05 2024-04-18T21:07:00.315 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.315 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.315 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:00.315 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807273+0000", 2024-04-18T21:07:00.315 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.035748488000000002 2024-04-18T21:07:00.315 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.315 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.315 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:00.315 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807343+0000", 2024-04-18T21:07:00.315 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0277000000000005e-05 2024-04-18T21:07:00.315 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.315 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.316 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:00.316 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807455+0000", 2024-04-18T21:07:00.316 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011171999999999999 2024-04-18T21:07:00.316 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.316 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.316 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:00.316 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.811509+0000", 2024-04-18T21:07:00.316 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0040543469999999998 2024-04-18T21:07:00.316 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.316 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.316 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:00.316 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817115+0000", 2024-04-18T21:07:00.316 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0056054520000000004 2024-04-18T21:07:00.316 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.316 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.316 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:00.317 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817142+0000", 2024-04-18T21:07:00.317 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7430999999999999e-05 2024-04-18T21:07:00.317 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.317 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.317 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:00.317 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817162+0000", 2024-04-18T21:07:00.317 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9329000000000001e-05 2024-04-18T21:07:00.317 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:00.317 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:00.317 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:00.317 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.317 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.317 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:114 3.1f 3:f83d65d8:::200.00000004:head [write 355943~1928 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:00.317 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.771785+0000", 2024-04-18T21:07:00.317 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 14.454491345999999, 2024-04-18T21:07:00.317 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045480532999999997, 2024-04-18T21:07:00.318 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:00.318 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:00.318 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:00.318 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:00.318 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.318 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:00.318 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771785+0000", 2024-04-18T21:07:00.318 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:00.318 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.318 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.318 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:00.318 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771785+0000", 2024-04-18T21:07:00.318 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:00.318 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.318 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.318 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:00.319 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771787+0000", 2024-04-18T21:07:00.319 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0600000000000002e-06 2024-04-18T21:07:00.319 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.319 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.319 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:00.319 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771799+0000", 2024-04-18T21:07:00.319 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1503e-05 2024-04-18T21:07:00.319 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.319 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.319 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:00.319 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771829+0000", 2024-04-18T21:07:00.319 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.04e-05 2024-04-18T21:07:00.319 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.319 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.319 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:00.320 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771846+0000", 2024-04-18T21:07:00.320 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6608000000000001e-05 2024-04-18T21:07:00.320 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.320 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.320 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:00.320 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807856+0000", 2024-04-18T21:07:00.320 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036010480999999997 2024-04-18T21:07:00.320 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.320 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.320 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:00.320 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807899+0000", 2024-04-18T21:07:00.320 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2775999999999998e-05 2024-04-18T21:07:00.320 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.320 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.320 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:00.320 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807966+0000", 2024-04-18T21:07:00.321 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6793999999999998e-05 2024-04-18T21:07:00.321 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.321 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.321 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:00.321 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.811516+0000", 2024-04-18T21:07:00.321 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035497300000000001 2024-04-18T21:07:00.321 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.321 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.321 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:00.321 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817194+0000", 2024-04-18T21:07:00.321 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0056787030000000002 2024-04-18T21:07:00.321 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.321 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.321 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:00.321 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817231+0000", 2024-04-18T21:07:00.321 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6727000000000003e-05 2024-04-18T21:07:00.322 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.322 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.322 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:00.322 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817266+0000", 2024-04-18T21:07:00.322 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4751e-05 2024-04-18T21:07:00.322 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:00.322 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:00.322 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:00.322 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.322 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.322 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:11950 4.6 4:62753dda:::10000003222.00000000:head [write 3145728~1048576] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:00.322 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:59.346083+0000", 2024-04-18T21:07:00.322 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.88019346300000001, 2024-04-18T21:07:00.322 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.051281119999999999, 2024-04-18T21:07:00.322 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:00.323 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:00.323 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:00.323 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:07:00.323 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:07:00.323 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:00.323 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 11950 2024-04-18T21:07:00.323 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.323 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:00.323 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.323 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:00.323 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.346083+0000", 2024-04-18T21:07:00.323 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:00.323 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.323 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.323 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:00.323 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.346083+0000", 2024-04-18T21:07:00.324 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:00.324 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.324 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.324 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:00.324 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.346085+0000", 2024-04-18T21:07:00.324 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.736e-06 2024-04-18T21:07:00.324 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.324 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.324 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:00.324 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.349991+0000", 2024-04-18T21:07:00.324 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0039062960000000001 2024-04-18T21:07:00.324 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.324 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.324 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:00.324 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.350006+0000", 2024-04-18T21:07:00.324 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5327000000000001e-05 2024-04-18T21:07:00.324 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.325 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.325 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:00.325 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.350016+0000", 2024-04-18T21:07:00.325 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3570000000000004e-06 2024-04-18T21:07:00.325 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.325 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.325 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:00.325 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.360724+0000", 2024-04-18T21:07:00.325 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010708153999999999 2024-04-18T21:07:00.325 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.325 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.325 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:00.325 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.360839+0000", 2024-04-18T21:07:00.325 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000114877 2024-04-18T21:07:00.325 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.325 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.325 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:00.326 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.397285+0000", 2024-04-18T21:07:00.326 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036445957000000001 2024-04-18T21:07:00.326 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.326 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.326 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:00.326 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.397316+0000", 2024-04-18T21:07:00.326 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0926000000000002e-05 2024-04-18T21:07:00.326 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.326 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.326 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:00.326 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.397364+0000", 2024-04-18T21:07:00.326 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8489999999999998e-05 2024-04-18T21:07:00.326 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:00.326 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:00.326 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:00.326 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.327 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.327 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:12225 4.11 4:8acd30ee:::100000031ed.00000000:head [write 0~4194304 [2@86041]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:00.327 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:59.667090+0000", 2024-04-18T21:07:00.327 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.55918684799999996, 2024-04-18T21:07:00.327 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.047400059000000001, 2024-04-18T21:07:00.327 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:00.327 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:00.327 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:00.327 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:07:00.327 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:07:00.327 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:00.327 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 12225 2024-04-18T21:07:00.327 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.327 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:00.327 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.328 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:00.328 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.667090+0000", 2024-04-18T21:07:00.328 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:00.328 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.328 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.328 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:00.328 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.667090+0000", 2024-04-18T21:07:00.328 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:00.328 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.328 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.328 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:00.328 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.667091+0000", 2024-04-18T21:07:00.328 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3629999999999999e-06 2024-04-18T21:07:00.328 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.329 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.329 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:00.329 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.674492+0000", 2024-04-18T21:07:00.329 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0074007789999999997 2024-04-18T21:07:00.329 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.329 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.329 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:00.329 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.674508+0000", 2024-04-18T21:07:00.329 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6509999999999999e-05 2024-04-18T21:07:00.329 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.329 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.329 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:00.329 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.674518+0000", 2024-04-18T21:07:00.329 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.6290000000000005e-06 2024-04-18T21:07:00.330 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.330 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.330 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:00.330 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.674584+0000", 2024-04-18T21:07:00.330 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5597000000000002e-05 2024-04-18T21:07:00.330 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.330 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.330 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:00.330 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.674659+0000", 2024-04-18T21:07:00.330 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5168999999999998e-05 2024-04-18T21:07:00.330 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.330 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.330 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:00.330 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.674775+0000", 2024-04-18T21:07:00.331 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000116069 2024-04-18T21:07:00.331 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.331 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.331 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:00.331 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.685336+0000", 2024-04-18T21:07:00.331 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010561022999999999 2024-04-18T21:07:00.331 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.331 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.331 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:00.331 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.714413+0000", 2024-04-18T21:07:00.331 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.029077306000000001 2024-04-18T21:07:00.331 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.331 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.331 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:00.332 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.714455+0000", 2024-04-18T21:07:00.332 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1547e-05 2024-04-18T21:07:00.332 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:00.332 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:00.332 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:00.332 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.714490+0000", 2024-04-18T21:07:00.332 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5067000000000002e-05 2024-04-18T21:07:00.332 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:00.332 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:00.332 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:00.332 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:00.332 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:00.332 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:07:00.335 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:07:00.339 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:00.330+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:00.346 INFO:tasks.workunit.client.0.smithi078.stdout:4/580: write d0/dc/d29/f4c [221201,38883] 0 2024-04-18T21:07:00.346 INFO:tasks.workunit.client.0.smithi078.stdout:9/523: symlink d7/d11/d1b/lb1 0 2024-04-18T21:07:00.347 INFO:tasks.workunit.client.0.smithi078.stdout:4/581: write d0/dc/d29/f4c [654355,6350] 0 2024-04-18T21:07:00.347 INFO:tasks.workunit.client.0.smithi078.stdout:0/537: link d0/d9/dd/d17/d2e/d7f/c49 d0/d15/ca5 0 2024-04-18T21:07:00.347 INFO:tasks.workunit.client.0.smithi078.stdout:4/582: creat d0/dc/d5b/d4f/d83/fd0 x:0 0 0 2024-04-18T21:07:00.347 INFO:tasks.workunit.client.0.smithi078.stdout:4/583: write d0/d73/da9/f80 [166438,8935] 0 2024-04-18T21:07:00.347 INFO:tasks.workunit.client.0.smithi078.stdout:7/495: dread d1/d16/dc/fd [0,4194304] 0 2024-04-18T21:07:00.347 INFO:tasks.workunit.client.0.smithi078.stdout:7/496: dread - d1/d16/d1c/fab zero size 2024-04-18T21:07:00.347 INFO:tasks.workunit.client.0.smithi078.stdout:7/497: creat d1/d16/d10/d7c/d7e/fac x:0 0 0 2024-04-18T21:07:00.347 INFO:tasks.workunit.client.0.smithi078.stdout:7/498: creat d1/d16/d10/d5a/fad x:0 0 0 2024-04-18T21:07:00.347 INFO:tasks.workunit.client.0.smithi078.stdout:9/524: write d7/d11/d80/fa3 [472559,81546] 0 2024-04-18T21:07:00.347 INFO:tasks.workunit.client.0.smithi078.stdout:9/525: symlink d7/d11/d2d/d3f/lb2 0 2024-04-18T21:07:00.347 INFO:tasks.workunit.client.0.smithi078.stdout:8/470: sync 2024-04-18T21:07:00.347 INFO:tasks.workunit.client.0.smithi078.stdout:3/434: sync 2024-04-18T21:07:00.347 INFO:tasks.workunit.client.0.smithi078.stdout:7/499: truncate d1/f3c 316821 0 2024-04-18T21:07:00.347 INFO:tasks.workunit.client.0.smithi078.stdout:3/435: creat d4/da/d76/f7b x:0 0 0 2024-04-18T21:07:00.347 INFO:tasks.workunit.client.0.smithi078.stdout:0/538: truncate d0/d9/da/db/d35/f4b 3704804 0 2024-04-18T21:07:00.348 INFO:tasks.workunit.client.0.smithi078.stdout:7/500: symlink d1/d16/dc/d11/da2/lae 0 2024-04-18T21:07:00.348 INFO:tasks.workunit.client.0.smithi078.stdout:3/436: rename d4/c38 to d4/d2d/d30/d35/d71/c7c 0 2024-04-18T21:07:00.348 INFO:tasks.workunit.client.0.smithi078.stdout:9/526: dread d7/d11/d80/fa3 [0,4194304] 0 2024-04-18T21:07:00.348 INFO:tasks.workunit.client.0.smithi078.stdout:9/527: chown c4 0 1 2024-04-18T21:07:00.348 INFO:tasks.workunit.client.0.smithi078.stdout:0/539: mkdir d0/d9/da/db/da6 0 2024-04-18T21:07:00.348 INFO:tasks.workunit.client.0.smithi078.stdout:7/501: write d1/d16/d10/d5a/f76 [2426415,113773] 0 2024-04-18T21:07:00.348 INFO:tasks.workunit.client.0.smithi078.stdout:3/437: chown d4/d2d/d30/d35/l31 2359 1 2024-04-18T21:07:00.348 INFO:tasks.workunit.client.0.smithi078.stdout:9/528: chown d7/d11/d1b/d45 0 1 2024-04-18T21:07:00.348 INFO:tasks.workunit.client.0.smithi078.stdout:8/471: dwrite d0/d10/f1c [4194304,4194304] 0 2024-04-18T21:07:00.348 INFO:tasks.workunit.client.0.smithi078.stdout:9/529: dread d7/f6d [0,4194304] 0 2024-04-18T21:07:00.348 INFO:tasks.workunit.client.0.smithi078.stdout:8/472: creat d0/d5c/d5a/f90 x:0 0 0 2024-04-18T21:07:00.348 INFO:tasks.workunit.client.0.smithi078.stdout:9/530: creat d7/d11/d2d/d26/fb3 x:0 0 0 2024-04-18T21:07:00.348 INFO:tasks.workunit.client.0.smithi078.stdout:0/540: truncate d0/d9/dd/d17/d2e/d31/f65 733489 0 2024-04-18T21:07:00.348 INFO:tasks.workunit.client.0.smithi078.stdout:9/531: creat d7/d23/fb4 x:0 0 0 2024-04-18T21:07:00.349 INFO:tasks.workunit.client.0.smithi078.stdout:3/438: dwrite d4/f13 [4194304,4194304] 0 2024-04-18T21:07:00.349 INFO:tasks.workunit.client.0.smithi078.stdout:7/502: dwrite d1/d16/d65/f84 [0,4194304] 0 2024-04-18T21:07:00.349 INFO:tasks.workunit.client.0.smithi078.stdout:9/532: readlink d7/d11/d1b/l25 0 2024-04-18T21:07:00.349 INFO:tasks.workunit.client.0.smithi078.stdout:0/541: chown d0/d9/da/db/d35/d3f/l98 57 1 2024-04-18T21:07:00.349 INFO:tasks.workunit.client.0.smithi078.stdout:0/542: dread - d0/d9/d4c/d8f/f97 zero size 2024-04-18T21:07:00.349 INFO:tasks.workunit.client.0.smithi078.stdout:3/439: read d4/da/d11/f22 [727077,75142] 0 2024-04-18T21:07:00.349 INFO:tasks.workunit.client.0.smithi078.stdout:8/473: dwrite d0/d10/f1c [8388608,4194304] 0 2024-04-18T21:07:00.349 INFO:tasks.workunit.client.0.smithi078.stdout:3/440: dread - d4/d2d/d30/d35/d4b/f65 zero size 2024-04-18T21:07:00.349 INFO:tasks.workunit.client.0.smithi078.stdout:0/543: dread d0/d9/dd/d17/d2e/d31/f4a [0,4194304] 0 2024-04-18T21:07:00.349 INFO:tasks.workunit.client.0.smithi078.stdout:7/503: mknod d1/d16/dc/d11/d53/caf 0 2024-04-18T21:07:00.349 INFO:tasks.workunit.client.0.smithi078.stdout:8/474: mkdir d0/d10/d60/d6f/d91 0 2024-04-18T21:07:00.349 INFO:tasks.workunit.client.0.smithi078.stdout:0/544: unlink d0/d9/d4c/f6a 0 2024-04-18T21:07:00.349 INFO:tasks.workunit.client.0.smithi078.stdout:9/533: link d7/d11/d2d/f3a d7/d11/d2d/fb5 0 2024-04-18T21:07:00.349 INFO:tasks.workunit.client.0.smithi078.stdout:3/441: symlink d4/d2d/d6c/l7d 0 2024-04-18T21:07:00.349 INFO:tasks.workunit.client.0.smithi078.stdout:8/475: rmdir d0/d10/d60/d6f/d91 0 2024-04-18T21:07:00.350 INFO:tasks.workunit.client.0.smithi078.stdout:0/545: dread d0/d9/dd/d17/d2e/d31/f4a [0,4194304] 0 2024-04-18T21:07:00.350 INFO:tasks.workunit.client.0.smithi078.stdout:3/442: getdents d4/da 0 2024-04-18T21:07:00.350 INFO:tasks.workunit.client.0.smithi078.stdout:8/476: fsync d0/d10/d14/d2d/f31 0 2024-04-18T21:07:00.350 INFO:tasks.workunit.client.0.smithi078.stdout:0/546: chown d0/d9/da/db/d35/f6e 1577797030 1 2024-04-18T21:07:00.350 INFO:tasks.workunit.client.0.smithi078.stdout:7/504: dwrite d1/d16/dc/d11/f3d [0,4194304] 0 2024-04-18T21:07:00.350 INFO:tasks.workunit.client.0.smithi078.stdout:0/547: write d0/d9/da/db/f4d [509535,25405] 0 2024-04-18T21:07:00.350 INFO:tasks.workunit.client.0.smithi078.stdout:0/548: readlink d0/d9/d4c/l55 0 2024-04-18T21:07:00.350 INFO:tasks.workunit.client.0.smithi078.stdout:7/505: unlink d1/d16/dc/d4b/c45 0 2024-04-18T21:07:00.350 INFO:tasks.workunit.client.0.smithi078.stdout:0/549: creat d0/d9/d81/fa7 x:0 0 0 2024-04-18T21:07:00.350 INFO:tasks.workunit.client.0.smithi078.stdout:8/477: creat d0/d10/f92 x:0 0 0 2024-04-18T21:07:00.350 INFO:tasks.workunit.client.0.smithi078.stdout:7/506: stat d1/f3c 0 2024-04-18T21:07:00.350 INFO:tasks.workunit.client.0.smithi078.stdout:3/443: rename d4/d2d/d30/c3f to d4/c7e 0 2024-04-18T21:07:00.350 INFO:tasks.workunit.client.0.smithi078.stdout:0/550: dread - d0/d9/d58/f63 zero size 2024-04-18T21:07:00.350 INFO:tasks.workunit.client.0.smithi078.stdout:4/584: dread d0/dc/d29/d2f/f61 [0,4194304] 0 2024-04-18T21:07:00.350 INFO:tasks.workunit.client.0.smithi078.stdout:8/478: rename d0/d10/d14/d2a/d3a to d0/d10/d14/d2d/d93 0 2024-04-18T21:07:00.350 INFO:tasks.workunit.client.0.smithi078.stdout:7/507: chown d1/d16/dc/d11/d53/d82/c9a 0 1 2024-04-18T21:07:00.351 INFO:tasks.workunit.client.0.smithi078.stdout:0/551: write d0/d9/da/db/d35/d3f/f56 [502247,21167] 0 2024-04-18T21:07:00.351 INFO:tasks.workunit.client.0.smithi078.stdout:8/479: rmdir d0/d10/d14 39 2024-04-18T21:07:00.351 INFO:tasks.workunit.client.0.smithi078.stdout:9/534: fdatasync d7/d11/d2d/f4e 0 2024-04-18T21:07:00.351 INFO:tasks.workunit.client.0.smithi078.stdout:1/517: dread d0/d2a/d2f/f36 [0,4194304] 0 2024-04-18T21:07:00.351 INFO:tasks.workunit.client.0.smithi078.stdout:4/585: unlink d0/dc/d10/d1c/d6a/d81/fc2 0 2024-04-18T21:07:00.351 INFO:tasks.workunit.client.0.smithi078.stdout:0/552: write d0/d9/d4c/d8f/f97 [589407,22881] 0 2024-04-18T21:07:00.351 INFO:tasks.workunit.client.0.smithi078.stdout:8/480: rmdir d0/d10/d14/d2d 39 2024-04-18T21:07:00.351 INFO:tasks.workunit.client.0.smithi078.stdout:1/518: chown d0/d11/d69/f97 1880951504 1 2024-04-18T21:07:00.351 INFO:tasks.workunit.client.0.smithi078.stdout:8/481: readlink d0/l9 0 2024-04-18T21:07:00.351 INFO:tasks.workunit.client.0.smithi078.stdout:5/497: sync 2024-04-18T21:07:00.351 INFO:tasks.workunit.client.0.smithi078.stdout:9/535: creat d7/d23/d3e/d5a/fb6 x:0 0 0 2024-04-18T21:07:00.351 INFO:tasks.workunit.client.0.smithi078.stdout:4/586: write d0/dc/d29/f7d [194879,16928] 0 2024-04-18T21:07:00.351 INFO:tasks.workunit.client.0.smithi078.stdout:0/553: chown d0/d9/dd 184249 1 2024-04-18T21:07:00.351 INFO:tasks.workunit.client.0.smithi078.stdout:3/444: getdents d4 0 2024-04-18T21:07:00.351 INFO:tasks.workunit.client.0.smithi078.stdout:3/445: chown d4/da/d11 2721 1 2024-04-18T21:07:00.351 INFO:tasks.workunit.client.0.smithi078.stdout:9/536: dread - d7/df/f8a zero size 2024-04-18T21:07:00.351 INFO:tasks.workunit.client.0.smithi078.stdout:0/554: fsync d0/d9/da/db/f2c 0 2024-04-18T21:07:00.352 INFO:tasks.workunit.client.0.smithi078.stdout:4/587: mknod d0/dc/d10/d1c/cd1 0 2024-04-18T21:07:00.352 INFO:tasks.workunit.client.0.smithi078.stdout:5/498: rename d9/da/d3e/d4c/f87 to d9/da/d8c/fa6 0 2024-04-18T21:07:00.352 INFO:tasks.workunit.client.0.smithi078.stdout:8/482: getdents d0/d5c/d5a 0 2024-04-18T21:07:00.352 INFO:tasks.workunit.client.0.smithi078.stdout:9/537: mkdir d7/d11/d2d/d3f/db7 0 2024-04-18T21:07:00.352 INFO:tasks.workunit.client.0.smithi078.stdout:9/538: fdatasync d7/df/d1e/f7e 0 2024-04-18T21:07:00.352 INFO:tasks.workunit.client.0.smithi078.stdout:4/588: creat d0/dc/fd2 x:0 0 0 2024-04-18T21:07:00.352 INFO:tasks.workunit.client.0.smithi078.stdout:7/508: truncate d1/d16/dc/d11/d53/f78 1175035 0 2024-04-18T21:07:00.352 INFO:tasks.workunit.client.0.smithi078.stdout:0/555: rename d0/d9/da/df/l50 to d0/d9/dd/la8 0 2024-04-18T21:07:00.352 INFO:tasks.workunit.client.0.smithi078.stdout:5/499: write d9/da/d3e/d4c/d6d/d73/f33 [2655713,18501] 0 2024-04-18T21:07:00.352 INFO:tasks.workunit.client.0.smithi078.stdout:7/509: write d1/d16/d65/f6a [1002898,34391] 0 2024-04-18T21:07:00.352 INFO:tasks.workunit.client.0.smithi078.stdout:8/483: dread d0/d10/f1c [8388608,4194304] 0 2024-04-18T21:07:00.352 INFO:tasks.workunit.client.0.smithi078.stdout:0/556: mknod d0/d9/da/db/ca9 0 2024-04-18T21:07:00.352 INFO:tasks.workunit.client.0.smithi078.stdout:7/510: mkdir d1/d16/dc/d86/d91/db0 0 2024-04-18T21:07:00.352 INFO:tasks.workunit.client.0.smithi078.stdout:5/500: rename d9/da/d32/l41 to d9/da/d32/la7 0 2024-04-18T21:07:00.352 INFO:tasks.workunit.client.0.smithi078.stdout:1/519: dwrite d0/d11/f18 [4194304,4194304] 0 2024-04-18T21:07:00.352 INFO:tasks.workunit.client.0.smithi078.stdout:5/501: stat d9/da/d3e/d4c/ca2 0 2024-04-18T21:07:00.353 INFO:tasks.workunit.client.0.smithi078.stdout:8/484: chown d0/l7 6134820 1 2024-04-18T21:07:00.353 INFO:tasks.workunit.client.0.smithi078.stdout:3/446: dwrite d4/d2d/f55 [0,4194304] 0 2024-04-18T21:07:00.353 INFO:tasks.workunit.client.0.smithi078.stdout:7/511: creat d1/d16/dc/d11/da2/fb1 x:0 0 0 2024-04-18T21:07:00.353 INFO:tasks.workunit.client.0.smithi078.stdout:9/539: dwrite d7/d11/d2d/d3f/d4d/fa7 [0,4194304] 0 2024-04-18T21:07:00.353 INFO:tasks.workunit.client.0.smithi078.stdout:8/485: chown d0/d10/d14/d2d/l2f 1288165 1 2024-04-18T21:07:00.353 INFO:tasks.workunit.client.0.smithi078.stdout:4/589: getdents d0/dc/d10/d3a 0 2024-04-18T21:07:00.353 INFO:tasks.workunit.client.0.smithi078.stdout:1/520: creat d0/d2a/d3c/da8/fb3 x:0 0 0 2024-04-18T21:07:00.353 INFO:tasks.workunit.client.0.smithi078.stdout:2/488: dread d0/d1f/d34/f78 [4194304,4194304] 0 2024-04-18T21:07:00.353 INFO:tasks.workunit.client.0.smithi078.stdout:8/486: fsync d0/f36 0 2024-04-18T21:07:00.353 INFO:tasks.workunit.client.0.smithi078.stdout:4/590: write d0/dc/d10/d1c/d60/d74/fba [363512,58636] 0 2024-04-18T21:07:00.353 INFO:tasks.workunit.client.0.smithi078.stdout:1/521: symlink d0/d2a/d3c/d4b/d5e/lb4 0 2024-04-18T21:07:00.353 INFO:tasks.workunit.client.0.smithi078.stdout:8/487: write d0/d10/d14/d2a/f71 [958007,29164] 0 2024-04-18T21:07:00.353 INFO:tasks.workunit.client.0.smithi078.stdout:1/522: readlink d0/d11/d69/l94 0 2024-04-18T21:07:00.353 INFO:tasks.workunit.client.0.smithi078.stdout:7/512: creat d1/d16/dc/fb2 x:0 0 0 2024-04-18T21:07:00.353 INFO:tasks.workunit.client.0.smithi078.stdout:8/488: write d0/f1f [8306609,37805] 0 2024-04-18T21:07:00.353 INFO:tasks.workunit.client.0.smithi078.stdout:3/447: dwrite d4/da/d11/f3c [0,4194304] 0 2024-04-18T21:07:00.353 INFO:tasks.workunit.client.0.smithi078.stdout:8/489: link d0/d5c/d5a/f6c d0/d5c/f94 0 2024-04-18T21:07:00.354 INFO:tasks.workunit.client.0.smithi078.stdout:4/591: read - d0/dc/d10/d1c/d6a/fb9 zero size 2024-04-18T21:07:00.354 INFO:tasks.workunit.client.0.smithi078.stdout:8/490: creat d0/d22/f95 x:0 0 0 2024-04-18T21:07:00.354 INFO:tasks.workunit.client.0.smithi078.stdout:9/540: write d7/df/d1e/d7b/f94 [855411,17115] 0 2024-04-18T21:07:00.354 INFO:tasks.workunit.client.0.smithi078.stdout:1/523: symlink d0/d2a/d3c/d4b/lb5 0 2024-04-18T21:07:00.354 INFO:tasks.workunit.client.0.smithi078.stdout:9/541: fdatasync d7/f86 0 2024-04-18T21:07:00.354 INFO:tasks.workunit.client.0.smithi078.stdout:6/425: dread d2/d6/dd/f48 [0,4194304] 0 2024-04-18T21:07:00.354 INFO:tasks.workunit.client.0.smithi078.stdout:9/542: truncate d7/df/d1e/d7b/f94 1846818 0 2024-04-18T21:07:00.354 INFO:tasks.workunit.client.0.smithi078.stdout:1/524: creat d0/d2a/d3c/d4b/fb6 x:0 0 0 2024-04-18T21:07:00.354 INFO:tasks.workunit.client.0.smithi078.stdout:9/543: fsync d7/d11/d2d/f4e 0 2024-04-18T21:07:00.354 INFO:tasks.workunit.client.0.smithi078.stdout:6/426: creat d2/d1c/d30/f93 x:0 0 0 2024-04-18T21:07:00.354 INFO:tasks.workunit.client.0.smithi078.stdout:2/489: dwrite d0/db/d18/d21/d27/d29/d33/f76 [0,4194304] 0 2024-04-18T21:07:00.354 INFO:tasks.workunit.client.0.smithi078.stdout:1/525: chown d0/d2a/d5f/d89/d7d 1772 1 2024-04-18T21:07:00.354 INFO:tasks.workunit.client.0.smithi078.stdout:1/526: fdatasync d0/d11/f21 0 2024-04-18T21:07:00.354 INFO:tasks.workunit.client.0.smithi078.stdout:7/513: dwrite d1/f5e [0,4194304] 0 2024-04-18T21:07:00.354 INFO:tasks.workunit.client.0.smithi078.stdout:9/544: symlink d7/df/d54/lb8 0 2024-04-18T21:07:00.354 INFO:tasks.workunit.client.0.smithi078.stdout:2/490: mknod d0/db/d18/d21/d27/d29/d57/c95 0 2024-04-18T21:07:00.355 INFO:tasks.workunit.client.0.smithi078.stdout:7/514: mkdir d1/d16/dc/d86/d91/db3 0 2024-04-18T21:07:00.355 INFO:tasks.workunit.client.0.smithi078.stdout:9/545: creat d7/d11/d1b/d77/fb9 x:0 0 0 2024-04-18T21:07:00.355 INFO:tasks.workunit.client.0.smithi078.stdout:2/491: mkdir d0/db/d65/d96 0 2024-04-18T21:07:00.355 INFO:tasks.workunit.client.0.smithi078.stdout:9/546: mknod d7/df/d67/cba 0 2024-04-18T21:07:00.355 INFO:tasks.workunit.client.0.smithi078.stdout:7/515: mkdir d1/d16/dc/d86/d91/db4 0 2024-04-18T21:07:00.355 INFO:tasks.workunit.client.0.smithi078.stdout:6/427: link d2/d6/dd/f68 d2/d34/d35/f94 0 2024-04-18T21:07:00.355 INFO:tasks.workunit.client.0.smithi078.stdout:9/547: unlink d7/d11/d1b/d77/f87 0 2024-04-18T21:07:00.355 INFO:tasks.workunit.client.0.smithi078.stdout:7/516: truncate d1/d16/d2d/f47 755831 0 2024-04-18T21:07:00.355 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:07:00.356 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:07:00.356 INFO:teuthology.orchestra.run.smithi078.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-18T21:07:00.360 INFO:tasks.workunit.client.0.smithi078.stdout:2/492: truncate d0/d1f/d34/f78 1023981 0 2024-04-18T21:07:00.360 INFO:tasks.workunit.client.0.smithi078.stdout:9/548: getdents d7/df/d1e 0 2024-04-18T21:07:00.360 INFO:tasks.workunit.client.0.smithi078.stdout:2/493: mknod d0/db/d18/d21/d27/d29/c97 0 2024-04-18T21:07:00.360 INFO:tasks.workunit.client.0.smithi078.stdout:9/549: creat d7/fbb x:0 0 0 2024-04-18T21:07:00.360 INFO:tasks.workunit.client.0.smithi078.stdout:9/550: symlink d7/d11/d2d/d3f/db7/lbc 0 2024-04-18T21:07:00.361 INFO:tasks.workunit.client.0.smithi078.stdout:9/551: truncate d7/d11/d1b/d45/d4b/d5d/f66 973470 0 2024-04-18T21:07:00.361 INFO:tasks.workunit.client.0.smithi078.stdout:8/491: dread d0/f45 [0,4194304] 0 2024-04-18T21:07:00.361 INFO:tasks.workunit.client.0.smithi078.stdout:9/552: write d7/d23/f75 [4484407,53794] 0 2024-04-18T21:07:00.361 INFO:tasks.workunit.client.0.smithi078.stdout:8/492: symlink d0/d10/d14/d2d/l96 0 2024-04-18T21:07:00.361 INFO:tasks.workunit.client.0.smithi078.stdout:9/553: symlink d7/d23/d3e/d5a/da8/lbd 0 2024-04-18T21:07:00.361 INFO:tasks.workunit.client.0.smithi078.stdout:8/493: write d0/d10/d14/f58 [30357,35315] 0 2024-04-18T21:07:00.361 INFO:tasks.workunit.client.0.smithi078.stdout:9/554: chown d7/d11/d1b/d77/l99 8 1 2024-04-18T21:07:00.361 INFO:tasks.workunit.client.0.smithi078.stdout:8/494: chown d0/d10/c4d 762 1 2024-04-18T21:07:00.361 INFO:tasks.workunit.client.0.smithi078.stdout:8/495: dread - d0/d10/d14/d2d/f83 zero size 2024-04-18T21:07:00.361 INFO:tasks.workunit.client.0.smithi078.stdout:9/555: write d7/d11/d1b/d45/d4b/d5d/f60 [979217,50578] 0 2024-04-18T21:07:00.361 INFO:tasks.workunit.client.0.smithi078.stdout:8/496: truncate d0/d22/f95 1021772 0 2024-04-18T21:07:00.361 INFO:tasks.workunit.client.0.smithi078.stdout:8/497: dread - d0/d5c/f74 zero size 2024-04-18T21:07:00.361 INFO:tasks.workunit.client.0.smithi078.stdout:1/527: read d0/d2a/d5f/d89/d32/f67 [685183,68895] 0 2024-04-18T21:07:00.361 INFO:tasks.workunit.client.0.smithi078.stdout:8/498: link d0/c72 d0/d10/d8d/c97 0 2024-04-18T21:07:00.361 INFO:tasks.workunit.client.0.smithi078.stdout:1/528: write d0/d2a/d2f/f36 [1353152,84463] 0 2024-04-18T21:07:00.361 INFO:tasks.workunit.client.0.smithi078.stdout:8/499: unlink d0/d5c/d5a/d7b/c80 0 2024-04-18T21:07:00.361 INFO:tasks.workunit.client.0.smithi078.stdout:1/529: write d0/d2a/d2f/f56 [721287,110000] 0 2024-04-18T21:07:00.362 INFO:tasks.workunit.client.0.smithi078.stdout:6/428: dwrite d2/d6/dd/f42 [0,4194304] 0 2024-04-18T21:07:00.362 INFO:tasks.workunit.client.0.smithi078.stdout:6/429: readlink d2/d1f/l2d 0 2024-04-18T21:07:00.362 INFO:tasks.workunit.client.0.smithi078.stdout:9/556: dwrite d7/d11/d2d/d3f/f8c [0,4194304] 0 2024-04-18T21:07:00.362 INFO:tasks.workunit.client.0.smithi078.stdout:6/430: write d2/d6/dd/f42 [1731558,127695] 0 2024-04-18T21:07:00.362 INFO:tasks.workunit.client.0.smithi078.stdout:1/530: symlink d0/d2a/d2f/lb7 0 2024-04-18T21:07:00.362 INFO:tasks.workunit.client.0.smithi078.stdout:9/557: creat d7/d23/d7a/fbe x:0 0 0 2024-04-18T21:07:00.362 INFO:tasks.workunit.client.0.smithi078.stdout:6/431: creat d2/d6/dd/f95 x:0 0 0 2024-04-18T21:07:00.362 INFO:tasks.workunit.client.0.smithi078.stdout:1/531: creat d0/d2a/d2f/d9b/fb8 x:0 0 0 2024-04-18T21:07:00.362 INFO:tasks.workunit.client.0.smithi078.stdout:9/558: symlink d7/d11/d1b/d45/d4b/d5d/lbf 0 2024-04-18T21:07:00.362 INFO:tasks.workunit.client.0.smithi078.stdout:1/532: read - d0/d11/d69/f97 zero size 2024-04-18T21:07:00.362 INFO:tasks.workunit.client.0.smithi078.stdout:8/500: dread d0/d10/d14/d2a/f71 [0,4194304] 0 2024-04-18T21:07:00.362 INFO:tasks.workunit.client.0.smithi078.stdout:6/432: creat d2/d6/f96 x:0 0 0 2024-04-18T21:07:00.362 INFO:tasks.workunit.client.0.smithi078.stdout:1/533: readlink d0/d2a/d3c/d4b/d4/l57 0 2024-04-18T21:07:00.362 INFO:tasks.workunit.client.0.smithi078.stdout:8/501: creat d0/d5c/d5a/f98 x:0 0 0 2024-04-18T21:07:00.362 INFO:tasks.workunit.client.0.smithi078.stdout:6/433: creat d2/f97 x:0 0 0 2024-04-18T21:07:00.362 INFO:tasks.workunit.client.0.smithi078.stdout:1/534: write d0/d2a/d3c/d4b/fb6 [31634,99658] 0 2024-04-18T21:07:00.363 INFO:tasks.workunit.client.0.smithi078.stdout:6/434: chown d2/d6/dd/l43 60 1 2024-04-18T21:07:00.363 INFO:tasks.workunit.client.0.smithi078.stdout:8/502: dread d0/f45 [0,4194304] 0 2024-04-18T21:07:00.363 INFO:tasks.workunit.client.0.smithi078.stdout:1/535: mkdir d0/d2a/d5f/d89/d32/db2/db9 0 2024-04-18T21:07:00.363 INFO:tasks.workunit.client.0.smithi078.stdout:6/435: getdents d2/d34/d35/d57 0 2024-04-18T21:07:00.363 INFO:tasks.workunit.client.0.smithi078.stdout:1/536: chown d0/d2a/d5f/d89/d32/f39 33477240 1 2024-04-18T21:07:00.363 INFO:tasks.workunit.client.0.smithi078.stdout:0/557: sync 2024-04-18T21:07:00.363 INFO:tasks.workunit.client.0.smithi078.stdout:3/448: sync 2024-04-18T21:07:00.363 INFO:tasks.workunit.client.0.smithi078.stdout:0/558: chown d0/d9/dd/d17/d82/la1 1709 1 2024-04-18T21:07:00.363 INFO:tasks.workunit.client.0.smithi078.stdout:1/537: symlink d0/d2a/d45/lba 0 2024-04-18T21:07:00.363 INFO:tasks.workunit.client.0.smithi078.stdout:3/449: creat d4/df/d62/f7f x:0 0 0 2024-04-18T21:07:00.363 INFO:tasks.workunit.client.0.smithi078.stdout:9/559: dwrite d7/df/d67/f89 [0,4194304] 0 2024-04-18T21:07:00.363 INFO:tasks.workunit.client.0.smithi078.stdout:5/502: dread d9/f34 [0,4194304] 0 2024-04-18T21:07:00.363 INFO:tasks.workunit.client.0.smithi078.stdout:9/560: mkdir d7/df/dc0 0 2024-04-18T21:07:00.363 INFO:tasks.workunit.client.0.smithi078.stdout:0/559: mkdir d0/d9/d81/daa 0 2024-04-18T21:07:00.364 INFO:tasks.workunit.client.0.smithi078.stdout:1/538: symlink d0/d2a/d5f/d89/d32/db2/lbb 0 2024-04-18T21:07:00.364 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:07:00.364 INFO:tasks.workunit.client.0.smithi078.stdout:8/503: dwrite d0/d10/d14/d2a/d4a/f7d [0,4194304] 0 2024-04-18T21:07:00.364 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:07:00.365 INFO:tasks.workunit.client.0.smithi078.stdout:3/450: rename d4/l1d to d4/df/d17/l80 0 2024-04-18T21:07:00.365 INFO:tasks.workunit.client.0.smithi078.stdout:9/561: symlink d7/d83/lc1 0 2024-04-18T21:07:00.365 INFO:tasks.workunit.client.0.smithi078.stdout:6/436: dwrite d2/d1f/f25 [8388608,4194304] 0 2024-04-18T21:07:00.365 INFO:tasks.workunit.client.0.smithi078.stdout:9/562: read d7/d11/d2d/d3f/d4d/fa7 [3704581,106824] 0 2024-04-18T21:07:00.365 INFO:tasks.workunit.client.0.smithi078.stdout:5/503: rmdir d9/da/d90/d62/d93 0 2024-04-18T21:07:00.365 INFO:tasks.workunit.client.0.smithi078.stdout:5/504: fdatasync d9/d2e/f9e 0 2024-04-18T21:07:00.366 INFO:tasks.workunit.client.0.smithi078.stdout:5/505: readlink d9/d2e/l50 0 2024-04-18T21:07:00.366 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-18T21:07:00.366 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-18T21:07:00.369 INFO:tasks.workunit.client.0.smithi078.stdout:6/437: dread d2/d1f/f61 [0,4194304] 0 2024-04-18T21:07:00.370 INFO:tasks.workunit.client.0.smithi078.stdout:5/506: link d9/da/d3e/d4c/d67/f96 d9/da/d4b/fa8 0 2024-04-18T21:07:00.370 INFO:tasks.workunit.client.0.smithi078.stdout:1/539: getdents d0/d2a/d45 0 2024-04-18T21:07:00.370 INFO:tasks.workunit.client.0.smithi078.stdout:8/504: dwrite d0/d10/d14/d2d/d93/f8f [0,4194304] 0 2024-04-18T21:07:00.370 INFO:tasks.workunit.client.0.smithi078.stdout:5/507: rmdir d9/da/d90 39 2024-04-18T21:07:00.370 INFO:tasks.workunit.client.0.smithi078.stdout:1/540: rmdir d0/d11 39 2024-04-18T21:07:00.370 INFO:tasks.workunit.client.0.smithi078.stdout:6/438: write d2/d6/f96 [679328,93629] 0 2024-04-18T21:07:00.370 INFO:tasks.workunit.client.0.smithi078.stdout:8/505: stat d0/d10/d60/d6f/c50 0 2024-04-18T21:07:00.370 INFO:tasks.workunit.client.0.smithi078.stdout:5/508: creat d9/da/d32/da5/fa9 x:0 0 0 2024-04-18T21:07:00.370 INFO:tasks.workunit.client.0.smithi078.stdout:6/439: write d2/d1c/d63/f7c [841884,2301] 0 2024-04-18T21:07:00.370 INFO:tasks.workunit.client.0.smithi078.stdout:1/541: mknod d0/d2a/d5f/d89/d32/cbc 0 2024-04-18T21:07:00.370 INFO:tasks.workunit.client.0.smithi078.stdout:9/563: dwrite d7/df/d67/f89 [0,4194304] 0 2024-04-18T21:07:00.370 INFO:tasks.workunit.client.0.smithi078.stdout:3/451: creat d4/da/f81 x:0 0 0 2024-04-18T21:07:00.370 INFO:tasks.workunit.client.0.smithi078.stdout:8/506: creat d0/d10/d14/d2a/d3c/f99 x:0 0 0 2024-04-18T21:07:00.371 INFO:tasks.workunit.client.0.smithi078.stdout:5/509: write d9/d2e/d65/f8e [903317,61047] 0 2024-04-18T21:07:00.371 INFO:tasks.workunit.client.0.smithi078.stdout:9/564: write d7/f37 [8408928,47348] 0 2024-04-18T21:07:00.371 INFO:tasks.workunit.client.0.smithi078.stdout:1/542: write d0/d2a/d5f/d89/d32/d35/f55 [401668,5136] 0 2024-04-18T21:07:00.371 INFO:tasks.workunit.client.0.smithi078.stdout:9/565: stat d7/d11/d2d/d3f/db7/lbc 0 2024-04-18T21:07:00.371 INFO:tasks.workunit.client.0.smithi078.stdout:6/440: fdatasync d2/d1c/d6b/f8a 0 2024-04-18T21:07:00.371 INFO:tasks.workunit.client.0.smithi078.stdout:3/452: mknod d4/d2d/d30/c82 0 2024-04-18T21:07:00.371 INFO:tasks.workunit.client.0.smithi078.stdout:8/507: creat d0/d10/d14/f9a x:0 0 0 2024-04-18T21:07:00.371 INFO:tasks.workunit.client.0.smithi078.stdout:6/441: mkdir d2/d1c/d6b/d98 0 2024-04-18T21:07:00.371 INFO:tasks.workunit.client.0.smithi078.stdout:2/494: dread d0/db/f36 [0,4194304] 0 2024-04-18T21:07:00.371 INFO:tasks.workunit.client.0.smithi078.stdout:8/508: dread - d0/d10/d14/f70 zero size 2024-04-18T21:07:00.371 INFO:tasks.workunit.client.0.smithi078.stdout:2/495: read d0/db/f12 [3759328,24847] 0 2024-04-18T21:07:00.371 INFO:tasks.workunit.client.0.smithi078.stdout:6/442: chown d2/d1f/f25 769159948 1 2024-04-18T21:07:00.371 INFO:tasks.workunit.client.0.smithi078.stdout:2/496: mkdir d0/d87/d88/d98 0 2024-04-18T21:07:00.371 INFO:tasks.workunit.client.0.smithi078.stdout:0/560: dwrite d0/d9/dd/d17/d2e/d31/f65 [0,4194304] 0 2024-04-18T21:07:00.371 INFO:tasks.workunit.client.0.smithi078.stdout:2/497: dread - d0/db/d18/f5a zero size 2024-04-18T21:07:00.371 INFO:tasks.workunit.client.0.smithi078.stdout:0/561: fsync d0/d9/da/db/f2c 0 2024-04-18T21:07:00.372 INFO:tasks.workunit.client.0.smithi078.stdout:9/566: dwrite d7/df/d67/fa5 [0,4194304] 0 2024-04-18T21:07:00.372 INFO:tasks.workunit.client.0.smithi078.stdout:0/562: write d0/d9/da/db/d35/f6f [3192317,75871] 0 2024-04-18T21:07:00.372 INFO:tasks.workunit.client.0.smithi078.stdout:2/498: rename d0/db/d18/d5d/c6d to d0/db/c99 0 2024-04-18T21:07:00.372 INFO:tasks.workunit.client.0.smithi078.stdout:9/567: creat d7/d11/d47/fc2 x:0 0 0 2024-04-18T21:07:00.372 INFO:tasks.workunit.client.0.smithi078.stdout:6/443: dread d2/d6/f59 [0,4194304] 0 2024-04-18T21:07:00.372 INFO:tasks.workunit.client.0.smithi078.stdout:0/563: dwrite d0/d9/da/db/f2c [0,4194304] 0 2024-04-18T21:07:00.372 INFO:tasks.workunit.client.0.smithi078.stdout:6/444: getdents d2/d34/d75 0 2024-04-18T21:07:00.372 INFO:tasks.workunit.client.0.smithi078.stdout:6/445: readlink d2/d6/dd/l10 0 2024-04-18T21:07:00.372 INFO:tasks.workunit.client.0.smithi078.stdout:6/446: readlink d2/d1f/l3e 0 2024-04-18T21:07:00.372 INFO:tasks.workunit.client.0.smithi078.stdout:0/564: dread d0/d9/dd/d17/d2e/d31/f65 [0,4194304] 0 2024-04-18T21:07:00.373 INFO:tasks.workunit.client.0.smithi078.stdout:9/568: truncate f6 4896403 0 2024-04-18T21:07:00.373 INFO:tasks.workunit.client.0.smithi078.stdout:2/499: truncate d0/d1f/d34/d40/f47 10678 0 2024-04-18T21:07:00.373 INFO:tasks.workunit.client.0.smithi078.stdout:6/447: dwrite d2/f3 [0,4194304] 0 2024-04-18T21:07:00.373 INFO:tasks.workunit.client.0.smithi078.stdout:2/500: chown d0/db/d65/d96 19674 1 2024-04-18T21:07:00.374 INFO:tasks.workunit.client.0.smithi078.stdout:0/565: write d0/d9/d58/f74 [304461,8557] 0 2024-04-18T21:07:00.374 INFO:tasks.workunit.client.0.smithi078.stdout:2/501: unlink d0/d1f/l48 0 2024-04-18T21:07:00.375 INFO:tasks.workunit.client.0.smithi078.stdout:6/448: chown d2/d34/d35/d57/c60 234 1 2024-04-18T21:07:00.375 INFO:tasks.workunit.client.0.smithi078.stdout:0/566: mknod d0/d9/d7d/cab 0 2024-04-18T21:07:00.376 INFO:tasks.workunit.client.0.smithi078.stdout:2/502: write d0/f55 [3090100,20270] 0 2024-04-18T21:07:00.377 INFO:tasks.workunit.client.0.smithi078.stdout:2/503: chown d0/db/f12 0 1 2024-04-18T21:07:00.379 INFO:tasks.workunit.client.0.smithi078.stdout:9/569: dwrite d7/d11/d1b/d45/d4b/d5d/fa4 [0,4194304] 0 2024-04-18T21:07:00.380 INFO:tasks.workunit.client.0.smithi078.stdout:9/570: write d7/d11/d2d/d26/f38 [4351146,50775] 0 2024-04-18T21:07:00.381 INFO:tasks.workunit.client.0.smithi078.stdout:6/449: dwrite d2/d34/f77 [0,4194304] 0 2024-04-18T21:07:00.381 INFO:tasks.workunit.client.0.smithi078.stdout:6/450: chown d2/d6/dd/l43 8 1 2024-04-18T21:07:00.381 INFO:tasks.workunit.client.0.smithi078.stdout:0/567: read d0/d9/da/db/d35/f20 [1358797,39551] 0 2024-04-18T21:07:00.382 INFO:tasks.workunit.client.0.smithi078.stdout:6/451: rename d2/d6/f16 to d2/d1c/d6b/d98/f99 0 2024-04-18T21:07:00.383 INFO:tasks.workunit.client.0.smithi078.stdout:0/568: creat d0/d9/d4c/d6b/d9b/fac x:0 0 0 2024-04-18T21:07:00.383 INFO:tasks.workunit.client.0.smithi078.stdout:6/452: fsync d2/d1c/d67/f72 0 2024-04-18T21:07:00.383 INFO:tasks.workunit.client.0.smithi078.stdout:0/569: chown d0/d9/da/db/d35/f6f 169687360 1 2024-04-18T21:07:00.385 INFO:tasks.workunit.client.0.smithi078.stdout:4/592: sync 2024-04-18T21:07:00.385 INFO:tasks.workunit.client.0.smithi078.stdout:7/517: sync 2024-04-18T21:07:00.385 INFO:tasks.workunit.client.0.smithi078.stdout:4/593: dread - d0/dc/d10/d1c/d6a/fb9 zero size 2024-04-18T21:07:00.387 INFO:tasks.workunit.client.0.smithi078.stdout:7/518: rename d1/d16/dc/d86 to d1/d16/dc/d11/d53/d82/da4/db5 0 2024-04-18T21:07:00.387 INFO:tasks.workunit.client.0.smithi078.stdout:9/571: dread d7/df/d1e/f7e [0,4194304] 0 2024-04-18T21:07:00.388 INFO:tasks.workunit.client.0.smithi078.stdout:4/594: link d0/dc/d10/c24 d0/dc/d5b/d4f/cd3 0 2024-04-18T21:07:00.388 INFO:tasks.workunit.client.0.smithi078.stdout:7/519: symlink d1/d16/dc/d31/lb6 0 2024-04-18T21:07:00.390 INFO:tasks.workunit.client.0.smithi078.stdout:7/520: dread - d1/d16/d1c/d40/fa1 zero size 2024-04-18T21:07:00.391 INFO:tasks.workunit.client.0.smithi078.stdout:6/453: dwrite d2/d6/dd/d4b/d5d/f6d [4194304,4194304] 0 2024-04-18T21:07:00.393 INFO:tasks.workunit.client.0.smithi078.stdout:7/521: getdents d1/d16/dc/d11/d53/d82/da4/db5/d91/db0 0 2024-04-18T21:07:00.393 INFO:tasks.workunit.client.0.smithi078.stdout:6/454: write d2/d1f/f58 [1871321,100895] 0 2024-04-18T21:07:00.395 INFO:tasks.workunit.client.0.smithi078.stdout:9/572: dwrite d7/df/d1e/d7b/f94 [0,4194304] 0 2024-04-18T21:07:00.395 INFO:tasks.workunit.client.0.smithi078.stdout:7/522: dread - d1/d16/dc/f5b zero size 2024-04-18T21:07:00.396 INFO:tasks.workunit.client.0.smithi078.stdout:6/455: fdatasync d2/d6/dd/d4b/d5d/f6a 0 2024-04-18T21:07:00.396 INFO:tasks.workunit.client.0.smithi078.stdout:7/523: creat d1/d16/d2d/fb7 x:0 0 0 2024-04-18T21:07:00.396 INFO:tasks.workunit.client.0.smithi078.stdout:9/573: creat d7/d11/d1b/d77/fc3 x:0 0 0 2024-04-18T21:07:00.397 INFO:tasks.workunit.client.0.smithi078.stdout:4/595: truncate d0/dc/f63 316246 0 2024-04-18T21:07:00.397 INFO:tasks.workunit.client.0.smithi078.stdout:7/524: dread - d1/d16/d10/d5a/fad zero size 2024-04-18T21:07:00.397 INFO:tasks.workunit.client.0.smithi078.stdout:9/574: write d7/d11/d1b/d45/d4b/d5d/f9a [332772,59542] 0 2024-04-18T21:07:00.398 INFO:tasks.workunit.client.0.smithi078.stdout:4/596: fsync d0/dc/d5b/d4f/f77 0 2024-04-18T21:07:00.399 INFO:tasks.workunit.client.0.smithi078.stdout:6/456: getdents d2/d6/d8d 0 2024-04-18T21:07:00.400 INFO:tasks.workunit.client.0.smithi078.stdout:8/509: dread d0/d10/d14/f21 [0,4194304] 0 2024-04-18T21:07:00.400 INFO:tasks.workunit.client.0.smithi078.stdout:6/457: fdatasync d2/d1f/f61 0 2024-04-18T21:07:00.400 INFO:tasks.workunit.client.0.smithi078.stdout:4/597: write d0/dc/d29/f31 [448313,58527] 0 2024-04-18T21:07:00.401 INFO:tasks.workunit.client.0.smithi078.stdout:7/525: symlink d1/d16/dc/d11/d53/d82/da4/db5/d91/db3/lb8 0 2024-04-18T21:07:00.402 INFO:tasks.workunit.client.0.smithi078.stdout:0/570: dwrite d0/f8 [0,4194304] 0 2024-04-18T21:07:00.402 INFO:tasks.workunit.client.0.smithi078.stdout:8/510: read d0/d10/d14/d2d/d93/f8f [4153304,28599] 0 2024-04-18T21:07:00.403 INFO:tasks.workunit.client.0.smithi078.stdout:8/511: stat d0/d5c/d5a/c79 0 2024-04-18T21:07:00.403 INFO:tasks.workunit.client.0.smithi078.stdout:2/504: dwrite d0/d1f/d34/d40/f47 [0,4194304] 0 2024-04-18T21:07:00.403 INFO:tasks.workunit.client.0.smithi078.stdout:2/505: fsync d0/db/d18/d21/d27/d29/d4e/f80 0 2024-04-18T21:07:00.404 INFO:tasks.workunit.client.0.smithi078.stdout:7/526: creat d1/d16/dc/d11/d53/d82/da4/db5/fb9 x:0 0 0 2024-04-18T21:07:00.404 INFO:tasks.workunit.client.0.smithi078.stdout:0/571: creat d0/d9/da/db/d35/d3f/fad x:0 0 0 2024-04-18T21:07:00.405 INFO:tasks.workunit.client.0.smithi078.stdout:0/572: fdatasync d0/d15/f5f 0 2024-04-18T21:07:00.405 INFO:tasks.workunit.client.0.smithi078.stdout:8/512: rename d0/f67 to d0/d10/d14/f9b 0 2024-04-18T21:07:00.405 INFO:tasks.workunit.client.0.smithi078.stdout:0/573: fdatasync d0/d9/d4c/d70/f7c 0 2024-04-18T21:07:00.406 INFO:tasks.workunit.client.0.smithi078.stdout:1/543: dread d0/d2a/d2f/f33 [0,4194304] 0 2024-04-18T21:07:00.406 INFO:tasks.workunit.client.0.smithi078.stdout:8/513: chown d0/d10/c23 470005690 1 2024-04-18T21:07:00.407 INFO:tasks.workunit.client.0.smithi078.stdout:0/574: mkdir d0/d9/da/db/d35/d3f/dae 0 2024-04-18T21:07:00.407 INFO:tasks.workunit.client.0.smithi078.stdout:4/598: write d0/dc/d37/f3b [200854,75447] 0 2024-04-18T21:07:00.407 INFO:tasks.workunit.client.0.smithi078.stdout:9/575: read d7/df/f2a [570355,64199] 0 2024-04-18T21:07:00.408 INFO:tasks.workunit.client.0.smithi078.stdout:8/514: write d0/fd [8042875,128861] 0 2024-04-18T21:07:00.408 INFO:tasks.workunit.client.0.smithi078.stdout:0/575: rmdir d0/d15 39 2024-04-18T21:07:00.408 INFO:tasks.workunit.client.0.smithi078.stdout:8/515: write d0/f45 [1002665,30125] 0 2024-04-18T21:07:00.409 INFO:tasks.workunit.client.0.smithi078.stdout:1/544: write d0/d2a/d5f/d89/d32/d35/f55 [160047,98160] 0 2024-04-18T21:07:00.410 INFO:tasks.workunit.client.0.smithi078.stdout:9/576: rename d7/d23/d7a/c9b to d7/df/d1e/d7b/cc4 0 2024-04-18T21:07:00.410 INFO:tasks.workunit.client.0.smithi078.stdout:0/576: write d0/d9/d4c/d8f/f97 [216353,121458] 0 2024-04-18T21:07:00.411 INFO:tasks.workunit.client.0.smithi078.stdout:0/577: rename d0/d9/d4c/d70 to d0/d9/d7d/daf 0 2024-04-18T21:07:00.412 INFO:tasks.workunit.client.0.smithi078.stdout:2/506: dwrite d0/db/d18/f1c [4194304,4194304] 0 2024-04-18T21:07:00.412 INFO:tasks.workunit.client.0.smithi078.stdout:0/578: write d0/d9/f43 [2959162,129795] 0 2024-04-18T21:07:00.413 INFO:tasks.workunit.client.0.smithi078.stdout:9/577: truncate d7/d11/d1b/d45/d4b/d5d/f66 1594209 0 2024-04-18T21:07:00.413 INFO:tasks.workunit.client.0.smithi078.stdout:4/599: dread d0/dc/d10/d1c/d60/d74/fb1 [0,4194304] 0 2024-04-18T21:07:00.414 INFO:tasks.workunit.client.0.smithi078.stdout:9/578: symlink d7/d11/d2d/d26/d7c/lc5 0 2024-04-18T21:07:00.416 INFO:tasks.workunit.client.0.smithi078.stdout:4/600: rename d0/dc/d10/d85 to d0/dc/d10/d1c/d6a/d81/dd4 0 2024-04-18T21:07:00.417 INFO:tasks.workunit.client.0.smithi078.stdout:4/601: getdents d0/d73/da9 0 2024-04-18T21:07:00.417 INFO:tasks.workunit.client.0.smithi078.stdout:1/545: dwrite d0/d2a/d5f/d89/d77/f8c [0,4194304] 0 2024-04-18T21:07:00.418 INFO:tasks.workunit.client.0.smithi078.stdout:1/546: fsync d0/d2a/d5f/d89/f3b 0 2024-04-18T21:07:00.418 INFO:tasks.workunit.client.0.smithi078.stdout:4/602: chown d0/dc/d29/d6d/d7b/f88 4 1 2024-04-18T21:07:00.418 INFO:tasks.workunit.client.0.smithi078.stdout:4/603: chown d0/dc/d10/d41/d5f/l70 1031592 1 2024-04-18T21:07:00.419 INFO:tasks.workunit.client.0.smithi078.stdout:1/547: symlink d0/d2a/d5f/d89/d32/db2/lbd 0 2024-04-18T21:07:00.419 INFO:tasks.workunit.client.0.smithi078.stdout:4/604: read - d0/dc/d10/d1c/d6a/d81/fbf zero size 2024-04-18T21:07:00.420 INFO:tasks.workunit.client.0.smithi078.stdout:4/605: getdents d0/dc/d29/d6d/d7b 0 2024-04-18T21:07:00.421 INFO:tasks.workunit.client.0.smithi078.stdout:4/606: symlink d0/dc/d10/d41/ld5 0 2024-04-18T21:07:00.421 INFO:tasks.workunit.client.0.smithi078.stdout:4/607: chown d0/dc/d5b/d4f/d83/db8/fcc 236 1 2024-04-18T21:07:00.425 INFO:tasks.workunit.client.0.smithi078.stdout:4/608: getdents d0/dc/d10 0 2024-04-18T21:07:00.426 INFO:tasks.workunit.client.0.smithi078.stdout:4/609: creat d0/d73/da9/fd6 x:0 0 0 2024-04-18T21:07:00.426 INFO:tasks.workunit.client.0.smithi078.stdout:4/610: stat d0/dc/d29/d2f/c7f 0 2024-04-18T21:07:00.427 INFO:tasks.workunit.client.0.smithi078.stdout:4/611: truncate d0/dc/d5b/d4f/d83/db8/fcc 1008621 0 2024-04-18T21:07:00.428 INFO:tasks.workunit.client.0.smithi078.stdout:4/612: mkdir d0/dc/dd7 0 2024-04-18T21:07:00.428 INFO:tasks.workunit.client.0.smithi078.stdout:4/613: chown d0/c2d 65977013 1 2024-04-18T21:07:00.429 INFO:tasks.workunit.client.0.smithi078.stdout:4/614: getdents d0/dc/d10/d1c/d6a/d81/dd4 0 2024-04-18T21:07:00.430 INFO:tasks.workunit.client.0.smithi078.stdout:4/615: symlink d0/dc/d10/d41/d5f/ld8 0 2024-04-18T21:07:00.431 INFO:tasks.workunit.client.0.smithi078.stdout:4/616: rename d0/c26 to d0/dc/d5b/d71/cd9 0 2024-04-18T21:07:00.432 INFO:tasks.workunit.client.0.smithi078.stdout:4/617: creat d0/dc/d10/d1c/d6a/d81/dd4/fda x:0 0 0 2024-04-18T21:07:00.433 INFO:tasks.workunit.client.0.smithi078.stdout:4/618: fsync d0/dc/d29/d2f/da7/fc7 0 2024-04-18T21:07:00.434 INFO:tasks.workunit.client.0.smithi078.stdout:4/619: symlink d0/dc/d29/d6d/d7b/ldb 0 2024-04-18T21:07:00.434 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:00.434+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:00.435 INFO:tasks.workunit.client.0.smithi078.stdout:4/620: dread - d0/dc/d10/db2/fc9 zero size 2024-04-18T21:07:00.435 INFO:tasks.workunit.client.0.smithi078.stdout:9/579: dread d7/df/d1e/f58 [0,4194304] 0 2024-04-18T21:07:00.436 INFO:tasks.workunit.client.0.smithi078.stdout:9/580: symlink d7/d11/d2d/d3f/lc6 0 2024-04-18T21:07:00.436 INFO:tasks.workunit.client.0.smithi078.stdout:9/581: chown d7/d11/d1b/d45/d4b/d5d/fa4 1126 1 2024-04-18T21:07:00.437 INFO:tasks.workunit.client.0.smithi078.stdout:9/582: fsync d7/d11/d1b/f84 0 2024-04-18T21:07:00.438 INFO:tasks.workunit.client.0.smithi078.stdout:9/583: symlink d7/d23/d3e/d5a/da8/db0/lc7 0 2024-04-18T21:07:00.438 INFO:tasks.workunit.client.0.smithi078.stdout:9/584: creat d7/d11/d2d/d26/d7c/fc8 x:0 0 0 2024-04-18T21:07:00.440 INFO:tasks.workunit.client.0.smithi078.stdout:9/585: dread - d7/fbb zero size 2024-04-18T21:07:00.440 INFO:tasks.workunit.client.0.smithi078.stdout:9/586: rename d7/d11/d1b/d45/d4b/d5d/c78 to d7/d23/d3e/cc9 0 2024-04-18T21:07:00.440 INFO:tasks.workunit.client.0.smithi078.stdout:9/587: mkdir d7/d23/d3e/d5a/dca 0 2024-04-18T21:07:00.441 INFO:tasks.workunit.client.0.smithi078.stdout:9/588: mknod d7/d11/d1b/d45/d4b/d5d/ccb 0 2024-04-18T21:07:00.442 INFO:tasks.workunit.client.0.smithi078.stdout:9/589: write d7/d11/d1b/d45/d4b/d5d/fa4 [4253206,65765] 0 2024-04-18T21:07:00.443 INFO:tasks.workunit.client.0.smithi078.stdout:9/590: creat d7/d83/fcc x:0 0 0 2024-04-18T21:07:00.444 INFO:tasks.workunit.client.0.smithi078.stdout:9/591: chown d7/d11/d1b/d77/fb9 1120150 1 2024-04-18T21:07:00.444 INFO:tasks.workunit.client.0.smithi078.stdout:9/592: rmdir d7/d23/d3e 39 2024-04-18T21:07:00.448 INFO:tasks.workunit.client.0.smithi078.stdout:9/593: dread d7/df/d1e/f58 [0,4194304] 0 2024-04-18T21:07:00.448 INFO:tasks.workunit.client.0.smithi078.stdout:9/594: fdatasync d7/d11/d2d/d26/fb3 0 2024-04-18T21:07:00.449 INFO:tasks.workunit.client.0.smithi078.stdout:9/595: stat d7/d11/d1b/d45/d4b/c73 0 2024-04-18T21:07:00.449 INFO:tasks.workunit.client.0.smithi078.stdout:2/507: dread d0/db/d18/f3e [0,4194304] 0 2024-04-18T21:07:00.450 INFO:tasks.workunit.client.0.smithi078.stdout:9/596: mkdir d7/d11/d1b/dcd 0 2024-04-18T21:07:00.450 INFO:tasks.workunit.client.0.smithi078.stdout:2/508: chown d0/d1f/d34/f81 1 1 2024-04-18T21:07:00.450 INFO:tasks.workunit.client.0.smithi078.stdout:9/597: chown d7/d11/d2d/c35 44869 1 2024-04-18T21:07:00.451 INFO:tasks.workunit.client.0.smithi078.stdout:2/509: getdents d0/db/d65 0 2024-04-18T21:07:00.451 INFO:tasks.workunit.client.0.smithi078.stdout:9/598: getdents d7/df/d1e 0 2024-04-18T21:07:00.452 INFO:tasks.workunit.client.0.smithi078.stdout:2/510: mknod d0/c9a 0 2024-04-18T21:07:00.452 INFO:tasks.workunit.client.0.smithi078.stdout:0/579: dread d0/d9/f2d [0,4194304] 0 2024-04-18T21:07:00.452 INFO:tasks.workunit.client.0.smithi078.stdout:9/599: mkdir d7/df/d88/dce 0 2024-04-18T21:07:00.453 INFO:tasks.workunit.client.0.smithi078.stdout:0/580: creat d0/d9/da/fb0 x:0 0 0 2024-04-18T21:07:00.454 INFO:tasks.workunit.client.0.smithi078.stdout:1/548: dread d0/d11/f2d [0,4194304] 0 2024-04-18T21:07:00.455 INFO:tasks.workunit.client.0.smithi078.stdout:0/581: link d0/d9/c67 d0/d9/dd/d17/d2e/d7f/cb1 0 2024-04-18T21:07:00.455 INFO:tasks.workunit.client.0.smithi078.stdout:1/549: mknod d0/d11/d69/cbe 0 2024-04-18T21:07:00.455 INFO:tasks.workunit.client.0.smithi078.stdout:0/582: truncate d0/d9/f5a 290437 0 2024-04-18T21:07:00.457 INFO:tasks.workunit.client.0.smithi078.stdout:0/583: symlink d0/d9/da/lb2 0 2024-04-18T21:07:00.458 INFO:tasks.workunit.client.0.smithi078.stdout:0/584: symlink d0/d9/dd/d17/d82/lb3 0 2024-04-18T21:07:00.459 INFO:tasks.workunit.client.0.smithi078.stdout:2/511: dwrite d0/d1f/f44 [0,4194304] 0 2024-04-18T21:07:00.459 INFO:tasks.workunit.client.0.smithi078.stdout:9/600: dwrite d7/d11/d2d/d3f/d4d/fa7 [0,4194304] 0 2024-04-18T21:07:00.459 INFO:tasks.workunit.client.0.smithi078.stdout:0/585: truncate d0/d9/da/df/fa0 1001306 0 2024-04-18T21:07:00.460 INFO:tasks.workunit.client.0.smithi078.stdout:9/601: stat d7/d11/d80/la0 0 2024-04-18T21:07:00.465 INFO:tasks.workunit.client.0.smithi078.stdout:2/512: dwrite d0/db/d18/d21/d8b/f92 [0,4194304] 0 2024-04-18T21:07:00.466 INFO:tasks.workunit.client.0.smithi078.stdout:9/602: dwrite d7/d11/d2d/d3f/d4d/fa7 [0,4194304] 0 2024-04-18T21:07:00.467 INFO:tasks.workunit.client.0.smithi078.stdout:9/603: mkdir d7/dcf 0 2024-04-18T21:07:00.468 INFO:tasks.workunit.client.0.smithi078.stdout:9/604: dread - d7/d11/d47/fc2 zero size 2024-04-18T21:07:00.468 INFO:tasks.workunit.client.0.smithi078.stdout:2/513: truncate d0/db/d18/d21/f31 1766884 0 2024-04-18T21:07:00.468 INFO:tasks.workunit.client.0.smithi078.stdout:9/605: stat d7/f6d 0 2024-04-18T21:07:00.469 INFO:tasks.workunit.client.0.smithi078.stdout:2/514: mknod d0/db/d18/d21/c9b 0 2024-04-18T21:07:00.470 INFO:tasks.workunit.client.0.smithi078.stdout:2/515: rename d0/db/d18/d21/d27/d29/d33/l64 to d0/d1f/d34/d40/d59/l9c 0 2024-04-18T21:07:00.476 INFO:tasks.workunit.client.0.smithi078.stdout:2/516: dwrite d0/db/d18/d21/d27/d29/d33/f76 [0,4194304] 0 2024-04-18T21:07:00.481 INFO:tasks.workunit.client.0.smithi078.stdout:3/453: sync 2024-04-18T21:07:00.481 INFO:tasks.workunit.client.0.smithi078.stdout:5/510: sync 2024-04-18T21:07:00.481 INFO:tasks.workunit.client.0.smithi078.stdout:6/458: sync 2024-04-18T21:07:00.482 INFO:tasks.workunit.client.0.smithi078.stdout:3/454: write d4/f64 [87112,25721] 0 2024-04-18T21:07:00.482 INFO:tasks.workunit.client.0.smithi078.stdout:3/455: symlink d4/da/l83 0 2024-04-18T21:07:00.482 INFO:tasks.workunit.client.0.smithi078.stdout:3/456: chown d4/da/f81 3052 1 2024-04-18T21:07:00.483 INFO:tasks.workunit.client.0.smithi078.stdout:3/457: truncate d4/df/d17/f5a 39313 0 2024-04-18T21:07:00.484 INFO:tasks.workunit.client.0.smithi078.stdout:3/458: mkdir d4/d2d/d30/d84 0 2024-04-18T21:07:00.484 INFO:tasks.workunit.client.0.smithi078.stdout:3/459: truncate d4/d2d/d30/f60 660594 0 2024-04-18T21:07:00.485 INFO:tasks.workunit.client.0.smithi078.stdout:3/460: symlink d4/d2d/d30/d35/d71/l85 0 2024-04-18T21:07:00.486 INFO:tasks.workunit.client.0.smithi078.stdout:3/461: write d4/d2d/d30/d35/d4b/d59/f5f [72173,86696] 0 2024-04-18T21:07:00.486 INFO:tasks.workunit.client.0.smithi078.stdout:5/511: truncate d9/f3c 1055556 0 2024-04-18T21:07:00.486 INFO:tasks.workunit.client.0.smithi078.stdout:5/512: unlink d9/da/c61 0 2024-04-18T21:07:00.490 INFO:tasks.workunit.client.0.smithi078.stdout:2/517: dread d0/d1f/f2b [0,4194304] 0 2024-04-18T21:07:00.490 INFO:tasks.workunit.client.0.smithi078.stdout:2/518: rmdir d0/d1f 39 2024-04-18T21:07:00.493 INFO:tasks.workunit.client.0.smithi078.stdout:2/519: dread d0/db/d18/f3e [0,4194304] 0 2024-04-18T21:07:00.494 INFO:tasks.workunit.client.0.smithi078.stdout:1/550: dread d0/d11/f22 [4194304,4194304] 0 2024-04-18T21:07:00.494 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:00.494 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:00.495 INFO:tasks.workunit.client.0.smithi078.stdout:1/551: getdents d0/d2a/d3c/d4b/d4/d61/d9c 0 2024-04-18T21:07:00.496 INFO:tasks.workunit.client.0.smithi078.stdout:1/552: write d0/d2a/d2f/d9b/fb8 [76773,34996] 0 2024-04-18T21:07:00.497 INFO:tasks.workunit.client.0.smithi078.stdout:3/462: write d4/d2d/d30/d35/f4f [1782092,84595] 0 2024-04-18T21:07:00.497 INFO:tasks.workunit.client.0.smithi078.stdout:3/463: mknod d4/d2d/d30/d35/c86 0 2024-04-18T21:07:00.498 INFO:tasks.workunit.client.0.smithi078.stdout:3/464: write d4/da/d11/f3c [4569027,56114] 0 2024-04-18T21:07:00.499 INFO:tasks.workunit.client.0.smithi078.stdout:3/465: getdents d4/d2d/d30/d84 0 2024-04-18T21:07:00.511 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:07:00.512 INFO:tasks.workunit.client.0.smithi078.stdout:5/513: dread d9/da/d3e/d4c/d6d/d73/f97 [0,4194304] 0 2024-04-18T21:07:00.515 INFO:tasks.workunit.client.0.smithi078.stdout:7/527: sync 2024-04-18T21:07:00.515 INFO:tasks.workunit.client.0.smithi078.stdout:8/516: sync 2024-04-18T21:07:00.515 INFO:tasks.workunit.client.0.smithi078.stdout:4/621: sync 2024-04-18T21:07:00.515 INFO:tasks.workunit.client.0.smithi078.stdout:0/586: sync 2024-04-18T21:07:00.516 INFO:tasks.workunit.client.0.smithi078.stdout:4/622: mknod d0/dc/d10/d1c/cdc 0 2024-04-18T21:07:00.516 INFO:tasks.workunit.client.0.smithi078.stdout:8/517: write d0/d5c/f74 [123588,35362] 0 2024-04-18T21:07:00.517 INFO:tasks.workunit.client.0.smithi078.stdout:7/528: write d1/d16/dc/d11/d53/d82/da4/db5/fb9 [1014376,129946] 0 2024-04-18T21:07:00.517 INFO:tasks.workunit.client.0.smithi078.stdout:0/587: fsync d0/d9/da/db/f33 0 2024-04-18T21:07:00.517 INFO:tasks.workunit.client.0.smithi078.stdout:4/623: chown d0/dc/d10 2346661 1 2024-04-18T21:07:00.518 INFO:tasks.workunit.client.0.smithi078.stdout:8/518: symlink d0/d10/d60/l9c 0 2024-04-18T21:07:00.519 INFO:tasks.workunit.client.0.smithi078.stdout:0/588: write d0/d9/da/f10 [3623646,29863] 0 2024-04-18T21:07:00.519 INFO:tasks.workunit.client.0.smithi078.stdout:2/520: dread d0/db/d18/f1c [0,4194304] 0 2024-04-18T21:07:00.519 INFO:tasks.workunit.client.0.smithi078.stdout:4/624: unlink d0/c2d 0 2024-04-18T21:07:00.520 INFO:tasks.workunit.client.0.smithi078.stdout:7/529: rename d1/d16/d10/l5c to d1/d16/lba 0 2024-04-18T21:07:00.520 INFO:tasks.workunit.client.0.smithi078.stdout:5/514: dwrite d9/d2e/d65/f8e [0,4194304] 0 2024-04-18T21:07:00.520 INFO:tasks.workunit.client.0.smithi078.stdout:0/589: chown d0/d9/da/db/da6 443486 1 2024-04-18T21:07:00.520 INFO:tasks.workunit.client.0.smithi078.stdout:4/625: fdatasync d0/dc/d10/d1c/d60/f90 0 2024-04-18T21:07:00.520 INFO:tasks.workunit.client.0.smithi078.stdout:7/530: chown d1/d16/dc/d31/lb6 203 1 2024-04-18T21:07:00.522 INFO:tasks.workunit.client.0.smithi078.stdout:0/590: rename d0/d9/dd/d17/c45 to d0/d9/d81/daa/cb4 0 2024-04-18T21:07:00.522 INFO:tasks.workunit.client.0.smithi078.stdout:4/626: link d0/dc/d37/l3d d0/dc/d29/d6d/d7b/ldd 0 2024-04-18T21:07:00.522 INFO:tasks.workunit.client.0.smithi078.stdout:7/531: symlink d1/d16/dc/d11/d53/d82/da4/db5/d91/db0/lbb 0 2024-04-18T21:07:00.523 INFO:tasks.workunit.client.0.smithi078.stdout:0/591: chown d0/d9/d81/fa7 40852159 1 2024-04-18T21:07:00.524 INFO:tasks.workunit.client.0.smithi078.stdout:0/592: symlink d0/d9/dd/d17/d2e/d7f/lb5 0 2024-04-18T21:07:00.525 INFO:tasks.workunit.client.0.smithi078.stdout:0/593: mkdir d0/d9/d4c/d8f/db6 0 2024-04-18T21:07:00.525 INFO:tasks.workunit.client.0.smithi078.stdout:0/594: chown d0/d9/da/db/d35/d3f 81630736 1 2024-04-18T21:07:00.526 INFO:tasks.workunit.client.0.smithi078.stdout:5/515: dwrite d9/da/d3e/d4c/f8a [0,4194304] 0 2024-04-18T21:07:00.526 INFO:tasks.workunit.client.0.smithi078.stdout:0/595: truncate d0/d15/f5f 46617 0 2024-04-18T21:07:00.527 INFO:tasks.workunit.client.0.smithi078.stdout:7/532: fsync d1/d16/d65/f79 0 2024-04-18T21:07:00.528 INFO:tasks.workunit.client.0.smithi078.stdout:5/516: mkdir d9/d2e/d65/daa 0 2024-04-18T21:07:00.528 INFO:tasks.workunit.client.0.smithi078.stdout:0/596: symlink d0/d9/d4c/lb7 0 2024-04-18T21:07:00.530 INFO:tasks.workunit.client.0.smithi078.stdout:6/459: dread d2/f2b [0,4194304] 0 2024-04-18T21:07:00.530 INFO:tasks.workunit.client.0.smithi078.stdout:7/533: mkdir d1/d16/dc/d11/da2/dbc 0 2024-04-18T21:07:00.530 INFO:tasks.workunit.client.0.smithi078.stdout:0/597: creat d0/d9/dd/fb8 x:0 0 0 2024-04-18T21:07:00.530 INFO:tasks.workunit.client.0.smithi078.stdout:5/517: fsync d9/da/d4b/fa8 0 2024-04-18T21:07:00.531 INFO:tasks.workunit.client.0.smithi078.stdout:0/598: symlink d0/d9/d58/lb9 0 2024-04-18T21:07:00.531 INFO:tasks.workunit.client.0.smithi078.stdout:5/518: mknod d9/d9f/cab 0 2024-04-18T21:07:00.531 INFO:tasks.workunit.client.0.smithi078.stdout:7/534: creat d1/fbd x:0 0 0 2024-04-18T21:07:00.531 INFO:tasks.workunit.client.0.smithi078.stdout:9/606: dread f6 [0,4194304] 0 2024-04-18T21:07:00.531 INFO:tasks.workunit.client.0.smithi078.stdout:7/535: stat d1/d16/dc/f60 0 2024-04-18T21:07:00.532 INFO:tasks.workunit.client.0.smithi078.stdout:0/599: truncate d0/f5 2007627 0 2024-04-18T21:07:00.532 INFO:tasks.workunit.client.0.smithi078.stdout:7/536: chown d1/d16/f46 1012997 1 2024-04-18T21:07:00.532 INFO:tasks.workunit.client.0.smithi078.stdout:5/519: creat d9/da/d3e/d4c/d67/d7c/fac x:0 0 0 2024-04-18T21:07:00.532 INFO:tasks.workunit.client.0.smithi078.stdout:9/607: chown d7/df/d1e/d7b/f94 7647724 1 2024-04-18T21:07:00.533 INFO:tasks.workunit.client.0.smithi078.stdout:5/520: fdatasync d9/da/d3e/d4c/d6d/d73/f40 0 2024-04-18T21:07:00.533 INFO:tasks.workunit.client.0.smithi078.stdout:0/600: rename d0/d9/d4c/l55 to d0/d9/d4c/d6b/lba 0 2024-04-18T21:07:00.533 INFO:tasks.workunit.client.0.smithi078.stdout:9/608: creat d7/d11/d2d/fd0 x:0 0 0 2024-04-18T21:07:00.534 INFO:tasks.workunit.client.0.smithi078.stdout:5/521: write d9/d2e/f9e [2522,50575] 0 2024-04-18T21:07:00.534 INFO:tasks.workunit.client.0.smithi078.stdout:0/601: creat d0/d9/d4c/d6b/fbb x:0 0 0 2024-04-18T21:07:00.535 INFO:tasks.workunit.client.0.smithi078.stdout:0/602: stat d0/d9/dd 0 2024-04-18T21:07:00.535 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:00.534+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:00.536 INFO:tasks.workunit.client.0.smithi078.stdout:9/609: truncate d7/d11/d2d/d26/d97/fa2 857419 0 2024-04-18T21:07:00.536 INFO:tasks.workunit.client.0.smithi078.stdout:4/627: dread d0/dc/d10/d3a/f9c [0,4194304] 0 2024-04-18T21:07:00.537 INFO:tasks.workunit.client.0.smithi078.stdout:0/603: mknod d0/d9/d58/cbc 0 2024-04-18T21:07:00.538 INFO:tasks.workunit.client.0.smithi078.stdout:6/460: dwrite d2/d34/d35/d57/f71 [0,4194304] 0 2024-04-18T21:07:00.538 INFO:tasks.workunit.client.0.smithi078.stdout:4/628: mknod d0/dc/d10/d41/d5f/cde 0 2024-04-18T21:07:00.539 INFO:tasks.workunit.client.0.smithi078.stdout:0/604: creat d0/d9/d4c/d6b/fbd x:0 0 0 2024-04-18T21:07:00.539 INFO:tasks.workunit.client.0.smithi078.stdout:8/519: dread d0/f6 [0,4194304] 0 2024-04-18T21:07:00.540 INFO:tasks.workunit.client.0.smithi078.stdout:7/537: dwrite d1/d16/dc/d11/fa8 [0,4194304] 0 2024-04-18T21:07:00.543 INFO:tasks.workunit.client.0.smithi078.stdout:7/538: symlink d1/d16/dc/d11/d53/d82/da4/lbe 0 2024-04-18T21:07:00.545 INFO:tasks.workunit.client.0.smithi078.stdout:7/539: write d1/d16/dc/d11/f69 [952559,65547] 0 2024-04-18T21:07:00.545 INFO:tasks.workunit.client.0.smithi078.stdout:9/610: dwrite d7/d83/fcc [0,4194304] 0 2024-04-18T21:07:00.546 INFO:tasks.workunit.client.0.smithi078.stdout:5/522: truncate d9/da/f35 1757087 0 2024-04-18T21:07:00.546 INFO:tasks.workunit.client.0.smithi078.stdout:4/629: dwrite d0/dc/f1d [0,4194304] 0 2024-04-18T21:07:00.547 INFO:tasks.workunit.client.0.smithi078.stdout:7/540: symlink d1/d16/lbf 0 2024-04-18T21:07:00.547 INFO:tasks.workunit.client.0.smithi078.stdout:0/605: dwrite d0/d9/dd/d17/d2e/d31/f91 [0,4194304] 0 2024-04-18T21:07:00.548 INFO:tasks.workunit.client.0.smithi078.stdout:5/523: dread - d9/da/d3e/d4c/d6d/d73/fa1 zero size 2024-04-18T21:07:00.548 INFO:tasks.workunit.client.0.smithi078.stdout:7/541: dread - d1/d16/dc/d11/d53/d82/da4/db5/f92 zero size 2024-04-18T21:07:00.548 INFO:tasks.workunit.client.0.smithi078.stdout:0/606: write d0/d9/da/db/d35/f78 [3559911,53018] 0 2024-04-18T21:07:00.549 INFO:tasks.workunit.client.0.smithi078.stdout:7/542: readlink d1/d16/dc/d11/d53/d82/da4/lbe 0 2024-04-18T21:07:00.550 INFO:tasks.workunit.client.0.smithi078.stdout:0/607: read d0/d9/dd/d17/d2e/d31/f91 [1177857,33696] 0 2024-04-18T21:07:00.550 INFO:tasks.workunit.client.0.smithi078.stdout:5/524: truncate d9/da/d3e/d4c/d67/d7c/fac 165586 0 2024-04-18T21:07:00.550 INFO:tasks.workunit.client.0.smithi078.stdout:7/543: mkdir d1/d16/d10/d7c/dc0 0 2024-04-18T21:07:00.551 INFO:tasks.workunit.client.0.smithi078.stdout:0/608: rename d0/d9/d7d/daf to d0/d9/da/db/d35/d3f/dbe 0 2024-04-18T21:07:00.555 INFO:tasks.workunit.client.0.smithi078.stdout:3/466: sync 2024-04-18T21:07:00.555 INFO:tasks.workunit.client.0.smithi078.stdout:1/553: sync 2024-04-18T21:07:00.555 INFO:tasks.workunit.client.0.smithi078.stdout:5/525: dwrite d9/da/d3e/d4c/f54 [0,4194304] 0 2024-04-18T21:07:00.557 INFO:tasks.workunit.client.0.smithi078.stdout:5/526: mkdir d9/da/d3e/d4c/d6d/d75/dad 0 2024-04-18T21:07:00.558 INFO:tasks.workunit.client.0.smithi078.stdout:3/467: getdents d4/da/d5e 0 2024-04-18T21:07:00.558 INFO:tasks.workunit.client.0.smithi078.stdout:1/554: getdents d0/d11 0 2024-04-18T21:07:00.558 INFO:tasks.workunit.client.0.smithi078.stdout:5/527: readlink d9/da/d3e/d4c/l5e 0 2024-04-18T21:07:00.558 INFO:tasks.workunit.client.0.smithi078.stdout:3/468: write d4/df/d17/f3a [381000,23832] 0 2024-04-18T21:07:00.559 INFO:tasks.workunit.client.0.smithi078.stdout:1/555: read d0/d2a/d2f/d9b/fb8 [100893,16507] 0 2024-04-18T21:07:00.559 INFO:tasks.workunit.client.0.smithi078.stdout:5/528: write d9/da/d3e/d4c/d6d/d73/f97 [112612,86442] 0 2024-04-18T21:07:00.563 INFO:tasks.workunit.client.0.smithi078.stdout:1/556: dread d0/d2a/d5f/d89/d77/f8c [0,4194304] 0 2024-04-18T21:07:00.564 INFO:tasks.workunit.client.0.smithi078.stdout:1/557: mknod d0/d11/d69/cbf 0 2024-04-18T21:07:00.564 INFO:tasks.workunit.client.0.smithi078.stdout:7/544: write d1/d16/d10/f13 [1019352,110179] 0 2024-04-18T21:07:00.565 INFO:tasks.workunit.client.0.smithi078.stdout:5/529: dwrite d9/d2e/f26 [0,4194304] 0 2024-04-18T21:07:00.567 INFO:tasks.workunit.client.0.smithi078.stdout:9/611: dread d7/d11/d2d/d26/d97/fa2 [0,4194304] 0 2024-04-18T21:07:00.567 INFO:tasks.workunit.client.0.smithi078.stdout:5/530: unlink d9/d2e/f26 0 2024-04-18T21:07:00.568 INFO:tasks.workunit.client.0.smithi078.stdout:9/612: dread - d7/fbb zero size 2024-04-18T21:07:00.569 INFO:tasks.workunit.client.0.smithi078.stdout:0/609: read d0/d9/f57 [1577117,97061] 0 2024-04-18T21:07:00.569 INFO:tasks.workunit.client.0.smithi078.stdout:9/613: fdatasync d7/d11/d2d/d26/f3b 0 2024-04-18T21:07:00.569 INFO:tasks.workunit.client.0.smithi078.stdout:8/520: dread d0/d10/d14/d2a/d4a/f7e [0,4194304] 0 2024-04-18T21:07:00.569 INFO:tasks.workunit.client.0.smithi078.stdout:5/531: mknod d9/da/d32/cae 0 2024-04-18T21:07:00.570 INFO:tasks.workunit.client.0.smithi078.stdout:8/521: rmdir d0/d10/d8d 39 2024-04-18T21:07:00.570 INFO:tasks.workunit.client.0.smithi078.stdout:5/532: mkdir d9/da/d8c/daf 0 2024-04-18T21:07:00.572 INFO:tasks.workunit.client.0.smithi078.stdout:1/558: dwrite d0/d2a/d45/f54 [0,4194304] 0 2024-04-18T21:07:00.572 INFO:tasks.workunit.client.0.smithi078.stdout:7/545: dwrite d1/f1f [0,4194304] 0 2024-04-18T21:07:00.573 INFO:tasks.workunit.client.0.smithi078.stdout:5/533: chown d9/da/d3e/d4c/d6d/d75/l80 198 1 2024-04-18T21:07:00.573 INFO:tasks.workunit.client.0.smithi078.stdout:0/610: getdents d0/d9/da/db/d35/d3f 0 2024-04-18T21:07:00.574 INFO:tasks.workunit.client.0.smithi078.stdout:1/559: chown d0/d2a/d3c/d4b/f24 6 1 2024-04-18T21:07:00.574 INFO:tasks.workunit.client.0.smithi078.stdout:7/546: write d1/d16/dc/f5f [977322,129342] 0 2024-04-18T21:07:00.575 INFO:tasks.workunit.client.0.smithi078.stdout:8/522: dread d0/d5c/f48 [0,4194304] 0 2024-04-18T21:07:00.575 INFO:tasks.workunit.client.0.smithi078.stdout:1/560: fsync d0/d2a/d5f/d89/d32/d35/d71/fae 0 2024-04-18T21:07:00.576 INFO:tasks.workunit.client.0.smithi078.stdout:2/521: dread d0/f32 [0,4194304] 0 2024-04-18T21:07:00.576 INFO:tasks.workunit.client.0.smithi078.stdout:0/611: symlink d0/d9/lbf 0 2024-04-18T21:07:00.576 INFO:tasks.workunit.client.0.smithi078.stdout:7/547: link d1/f1f d1/d16/fc1 0 2024-04-18T21:07:00.576 INFO:tasks.workunit.client.0.smithi078.stdout:1/561: mknod d0/d2a/d45/cc0 0 2024-04-18T21:07:00.577 INFO:tasks.workunit.client.0.smithi078.stdout:8/523: mkdir d0/d10/d9d 0 2024-04-18T21:07:00.577 INFO:tasks.workunit.client.0.smithi078.stdout:0/612: creat d0/d9/d4c/d8f/fc0 x:0 0 0 2024-04-18T21:07:00.577 INFO:tasks.workunit.client.0.smithi078.stdout:2/522: symlink d0/db/d18/l9d 0 2024-04-18T21:07:00.577 INFO:tasks.workunit.client.0.smithi078.stdout:7/548: chown d1/d16/lbf 7 1 2024-04-18T21:07:00.577 INFO:tasks.workunit.client.0.smithi078.stdout:8/524: rmdir d0/d5c/d5a 39 2024-04-18T21:07:00.578 INFO:tasks.workunit.client.0.smithi078.stdout:0/613: mkdir d0/d9/d4c/d8f/db6/dc1 0 2024-04-18T21:07:00.578 INFO:tasks.workunit.client.0.smithi078.stdout:2/523: creat d0/d1f/f9e x:0 0 0 2024-04-18T21:07:00.579 INFO:tasks.workunit.client.0.smithi078.stdout:8/525: symlink d0/d10/d14/d2a/d3c/l9e 0 2024-04-18T21:07:00.579 INFO:tasks.workunit.client.0.smithi078.stdout:7/549: creat d1/d16/d10/d5a/fc2 x:0 0 0 2024-04-18T21:07:00.579 INFO:tasks.workunit.client.0.smithi078.stdout:9/614: dwrite d7/f3d [0,4194304] 0 2024-04-18T21:07:00.580 INFO:tasks.workunit.client.0.smithi078.stdout:9/615: write d7/df/d1e/f58 [3350163,123949] 0 2024-04-18T21:07:00.582 INFO:tasks.workunit.client.0.smithi078.stdout:0/614: readlink d0/d9/d4c/d6b/lba 0 2024-04-18T21:07:00.582 INFO:tasks.workunit.client.0.smithi078.stdout:8/526: symlink d0/d22/l9f 0 2024-04-18T21:07:00.582 INFO:tasks.workunit.client.0.smithi078.stdout:7/550: mkdir d1/d16/dc/d11/da2/dbc/dc3 0 2024-04-18T21:07:00.582 INFO:tasks.workunit.client.0.smithi078.stdout:9/616: mkdir d7/df/d54/d95/d9d/dd1 0 2024-04-18T21:07:00.582 INFO:tasks.workunit.client.0.smithi078.stdout:2/524: mknod d0/db/d18/d21/d27/d29/c9f 0 2024-04-18T21:07:00.583 INFO:tasks.workunit.client.0.smithi078.stdout:9/617: chown d7/d11/c20 822 1 2024-04-18T21:07:00.583 INFO:tasks.workunit.client.0.smithi078.stdout:8/527: mkdir d0/d10/d14/d2d/d93/da0 0 2024-04-18T21:07:00.583 INFO:tasks.workunit.client.0.smithi078.stdout:0/615: write d0/d9/da/db/d35/f2b [51789,71251] 0 2024-04-18T21:07:00.583 INFO:tasks.workunit.client.0.smithi078.stdout:1/562: truncate d0/d2a/d5f/d89/d32/f4c 184094 0 2024-04-18T21:07:00.584 INFO:tasks.workunit.client.0.smithi078.stdout:2/525: creat d0/db/d18/d21/d27/d29/fa0 x:0 0 0 2024-04-18T21:07:00.584 INFO:tasks.workunit.client.0.smithi078.stdout:1/563: chown d0/d2a/d5f/caf 5178 1 2024-04-18T21:07:00.585 INFO:tasks.workunit.client.0.smithi078.stdout:2/526: rmdir d0/db/d18/d21/d8b 39 2024-04-18T21:07:00.586 INFO:tasks.workunit.client.0.smithi078.stdout:1/564: rename d0/d2a/d45/da5 to d0/dc1 0 2024-04-18T21:07:00.586 INFO:tasks.workunit.client.0.smithi078.stdout:0/616: write d0/d9/d4c/d6b/fbd [201039,91589] 0 2024-04-18T21:07:00.589 INFO:tasks.workunit.client.0.smithi078.stdout:0/617: chown d0/d9/da/db/f4d 159 1 2024-04-18T21:07:00.590 INFO:tasks.workunit.client.0.smithi078.stdout:7/551: dwrite d1/d16/d1c/d40/f7b [0,4194304] 0 2024-04-18T21:07:00.592 INFO:tasks.workunit.client.0.smithi078.stdout:0/618: creat d0/d9/dd/d17/d82/fc2 x:0 0 0 2024-04-18T21:07:00.593 INFO:tasks.workunit.client.0.smithi078.stdout:8/528: dwrite d0/d10/d14/d2a/d4a/f7d [4194304,4194304] 0 2024-04-18T21:07:00.593 INFO:tasks.workunit.client.0.smithi078.stdout:9/618: dwrite d7/d11/d2d/d26/f38 [4194304,4194304] 0 2024-04-18T21:07:00.593 INFO:tasks.workunit.client.0.smithi078.stdout:7/552: write d1/d16/f77 [540400,47366] 0 2024-04-18T21:07:00.593 INFO:tasks.workunit.client.0.smithi078.stdout:0/619: chown d0/d9/dd/d17 0 1 2024-04-18T21:07:00.593 INFO:tasks.workunit.client.0.smithi078.stdout:8/529: readlink d0/d22/l9f 0 2024-04-18T21:07:00.594 INFO:tasks.workunit.client.0.smithi078.stdout:2/527: dwrite d0/db/d18/d21/d27/d29/d4e/f80 [0,4194304] 0 2024-04-18T21:07:00.595 INFO:tasks.workunit.client.0.smithi078.stdout:5/534: read d9/fb [1802915,95712] 0 2024-04-18T21:07:00.596 INFO:tasks.workunit.client.0.smithi078.stdout:7/553: unlink d1/d16/dc/d4b/f9b 0 2024-04-18T21:07:00.596 INFO:tasks.workunit.client.0.smithi078.stdout:8/530: creat d0/d10/d14/d2a/d4a/fa1 x:0 0 0 2024-04-18T21:07:00.596 INFO:tasks.workunit.client.0.smithi078.stdout:2/528: mkdir d0/d87/d88/da1 0 2024-04-18T21:07:00.596 INFO:tasks.workunit.client.0.smithi078.stdout:0/620: rename d0/d9/dd/d17/c5e to d0/d9/d81/cc3 0 2024-04-18T21:07:00.597 INFO:tasks.workunit.client.0.smithi078.stdout:2/529: rmdir d0/db/d18/d5d 39 2024-04-18T21:07:00.597 INFO:tasks.workunit.client.0.smithi078.stdout:7/554: creat d1/d16/dc/d11/da2/dbc/dc3/fc4 x:0 0 0 2024-04-18T21:07:00.598 INFO:tasks.workunit.client.0.smithi078.stdout:8/531: rename d0/d10/d14/c28 to d0/d10/d14/ca2 0 2024-04-18T21:07:00.598 INFO:tasks.workunit.client.0.smithi078.stdout:2/530: unlink d0/db/f16 0 2024-04-18T21:07:00.598 INFO:tasks.workunit.client.0.smithi078.stdout:0/621: rename d0/d9/d4c/c69 to d0/d9/da/db/cc4 0 2024-04-18T21:07:00.598 INFO:tasks.workunit.client.0.smithi078.stdout:8/532: chown d0/d10/d14/d2a/d4a/c85 316089 1 2024-04-18T21:07:00.598 INFO:tasks.workunit.client.0.smithi078.stdout:0/622: mkdir d0/d9/d4c/d8f/dc5 0 2024-04-18T21:07:00.599 INFO:tasks.workunit.client.0.smithi078.stdout:2/531: fsync d0/db/d18/f1c 0 2024-04-18T21:07:00.599 INFO:tasks.workunit.client.0.smithi078.stdout:0/623: chown d0/d9/da/db/d35/f2b 44 1 2024-04-18T21:07:00.599 INFO:tasks.workunit.client.0.smithi078.stdout:2/532: creat d0/db/d18/d5d/fa2 x:0 0 0 2024-04-18T21:07:00.600 INFO:tasks.workunit.client.0.smithi078.stdout:2/533: symlink d0/d1f/d5b/la3 0 2024-04-18T21:07:00.601 INFO:tasks.workunit.client.0.smithi078.stdout:1/565: truncate d0/d2a/d5f/d89/d32/f39 1440391 0 2024-04-18T21:07:00.602 INFO:tasks.workunit.client.0.smithi078.stdout:2/534: truncate d0/d1f/d34/f53 2188104 0 2024-04-18T21:07:00.602 INFO:tasks.workunit.client.0.smithi078.stdout:1/566: chown d0/d2a/d2f/f33 12878 1 2024-04-18T21:07:00.605 INFO:tasks.workunit.client.0.smithi078.stdout:8/533: dwrite d0/d10/d60/d6f/f7a [0,4194304] 0 2024-04-18T21:07:00.606 INFO:tasks.workunit.client.0.smithi078.stdout:8/534: creat d0/d10/fa3 x:0 0 0 2024-04-18T21:07:00.608 INFO:tasks.workunit.client.0.smithi078.stdout:8/535: rmdir d0/d5c/d5a/d7b 39 2024-04-18T21:07:00.608 INFO:tasks.workunit.client.0.smithi078.stdout:8/536: write d0/d5c/f94 [1551701,59125] 0 2024-04-18T21:07:00.609 INFO:tasks.workunit.client.0.smithi078.stdout:1/567: dwrite d0/d2a/d2f/f33 [0,4194304] 0 2024-04-18T21:07:00.609 INFO:tasks.workunit.client.0.smithi078.stdout:1/568: fsync d0/d2a/d2f/f56 0 2024-04-18T21:07:00.609 INFO:tasks.workunit.client.0.smithi078.stdout:3/469: dread d4/d2d/d30/d35/f4f [0,4194304] 0 2024-04-18T21:07:00.609 INFO:tasks.workunit.client.0.smithi078.stdout:8/537: write d0/d10/d14/d2a/f64 [1042699,81632] 0 2024-04-18T21:07:00.610 INFO:tasks.workunit.client.0.smithi078.stdout:1/569: chown d0/d2a/d5f/d89/d32/db2/f7e 392 1 2024-04-18T21:07:00.610 INFO:tasks.workunit.client.0.smithi078.stdout:8/538: read - d0/d10/d14/d2a/d4a/fa1 zero size 2024-04-18T21:07:00.612 INFO:tasks.workunit.client.0.smithi078.stdout:2/535: rename d0/d1f/c3b to d0/db/d18/ca4 0 2024-04-18T21:07:00.613 INFO:tasks.workunit.client.0.smithi078.stdout:8/539: creat d0/d5c/fa4 x:0 0 0 2024-04-18T21:07:00.615 INFO:tasks.workunit.client.0.smithi078.stdout:8/540: getdents d0/d10/d14/d2d/d93 0 2024-04-18T21:07:00.616 INFO:tasks.workunit.client.0.smithi078.stdout:3/470: dwrite d4/df/d17/f3a [0,4194304] 0 2024-04-18T21:07:00.617 INFO:tasks.workunit.client.0.smithi078.stdout:8/541: creat d0/d10/d14/fa5 x:0 0 0 2024-04-18T21:07:00.617 INFO:tasks.workunit.client.0.smithi078.stdout:1/570: dwrite d0/d2a/d3c/d4b/d4/f3d [4194304,4194304] 0 2024-04-18T21:07:00.617 INFO:tasks.workunit.client.0.smithi078.stdout:3/471: rmdir d4/d2d/d30/d35 39 2024-04-18T21:07:00.618 INFO:tasks.workunit.client.0.smithi078.stdout:8/542: truncate d0/d5c/fa4 836219 0 2024-04-18T21:07:00.618 INFO:tasks.workunit.client.0.smithi078.stdout:3/472: getdents d4 0 2024-04-18T21:07:00.618 INFO:tasks.workunit.client.0.smithi078.stdout:8/543: write d0/d5c/f94 [2617085,34967] 0 2024-04-18T21:07:00.619 INFO:tasks.workunit.client.0.smithi078.stdout:8/544: dread - d0/d5c/d5a/f98 zero size 2024-04-18T21:07:00.619 INFO:tasks.workunit.client.0.smithi078.stdout:8/545: symlink d0/d10/d9d/la6 0 2024-04-18T21:07:00.620 INFO:tasks.workunit.client.0.smithi078.stdout:8/546: dread - d0/d10/d60/d6f/f7f zero size 2024-04-18T21:07:00.621 INFO:tasks.workunit.client.0.smithi078.stdout:4/630: sync 2024-04-18T21:07:00.622 INFO:tasks.workunit.client.0.smithi078.stdout:8/547: chown d0/d22/l82 116207 1 2024-04-18T21:07:00.622 INFO:tasks.workunit.client.0.smithi078.stdout:4/631: symlink d0/dc/d10/d1c/d6a/ldf 0 2024-04-18T21:07:00.623 INFO:tasks.workunit.client.0.smithi078.stdout:8/548: creat d0/d10/d14/fa7 x:0 0 0 2024-04-18T21:07:00.623 INFO:tasks.workunit.client.0.smithi078.stdout:4/632: write d0/dc/d10/d41/d5f/fb7 [129643,6886] 0 2024-04-18T21:07:00.624 INFO:tasks.workunit.client.0.smithi078.stdout:8/549: fsync d0/d10/d14/d2a/f68 0 2024-04-18T21:07:00.625 INFO:tasks.workunit.client.0.smithi078.stdout:3/473: dwrite d4/d2d/d30/d35/d4b/d59/f5f [0,4194304] 0 2024-04-18T21:07:00.626 INFO:tasks.workunit.client.0.smithi078.stdout:8/550: mkdir d0/da8 0 2024-04-18T21:07:00.626 INFO:tasks.workunit.client.0.smithi078.stdout:6/461: dread d2/d1f/f58 [0,4194304] 0 2024-04-18T21:07:00.627 INFO:tasks.workunit.client.0.smithi078.stdout:8/551: creat d0/d10/d14/d2d/d93/fa9 x:0 0 0 2024-04-18T21:07:00.628 INFO:tasks.workunit.client.0.smithi078.stdout:6/462: link d2/d1c/d63/f78 d2/d1c/d6b/d98/f9a 0 2024-04-18T21:07:00.628 INFO:tasks.workunit.client.0.smithi078.stdout:8/552: chown d0/d10/d14/d62/c77 69618313 1 2024-04-18T21:07:00.628 INFO:tasks.workunit.client.0.smithi078.stdout:6/463: fdatasync d2/d6/dd/f95 0 2024-04-18T21:07:00.629 INFO:tasks.workunit.client.0.smithi078.stdout:1/571: write d0/d2a/d5f/d89/d32/fa7 [68083,9638] 0 2024-04-18T21:07:00.629 INFO:tasks.workunit.client.0.smithi078.stdout:8/553: unlink d0/fd 0 2024-04-18T21:07:00.629 INFO:tasks.workunit.client.0.smithi078.stdout:1/572: readlink d0/d2a/d3c/d4b/d52/l58 0 2024-04-18T21:07:00.630 INFO:tasks.workunit.client.0.smithi078.stdout:6/464: creat d2/d1c/f9b x:0 0 0 2024-04-18T21:07:00.630 INFO:tasks.workunit.client.0.smithi078.stdout:8/554: write d0/d10/d14/d2a/f68 [12151530,63750] 0 2024-04-18T21:07:00.630 INFO:tasks.workunit.client.0.smithi078.stdout:6/465: read - d2/d34/f56 zero size 2024-04-18T21:07:00.631 INFO:tasks.workunit.client.0.smithi078.stdout:1/573: chown d0/d2a/d5f/d89/d32/d35/l48 10 1 2024-04-18T21:07:00.633 INFO:tasks.workunit.client.0.smithi078.stdout:3/474: dwrite d4/da/d11/f3c [4194304,4194304] 0 2024-04-18T21:07:00.634 INFO:tasks.workunit.client.0.smithi078.stdout:6/466: dread d2/f2b [0,4194304] 0 2024-04-18T21:07:00.635 INFO:tasks.workunit.client.0.smithi078.stdout:3/475: creat d4/d2d/d30/d35/d4b/d59/f87 x:0 0 0 2024-04-18T21:07:00.635 INFO:tasks.workunit.client.0.smithi078.stdout:6/467: mkdir d2/d1c/d67/d7f/d9c 0 2024-04-18T21:07:00.635 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:00.634+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:00.636 INFO:tasks.workunit.client.0.smithi078.stdout:3/476: symlink d4/d2d/d30/l88 0 2024-04-18T21:07:00.636 INFO:tasks.workunit.client.0.smithi078.stdout:6/468: creat d2/f9d x:0 0 0 2024-04-18T21:07:00.636 INFO:tasks.workunit.client.0.smithi078.stdout:3/477: stat d4/df/d17 0 2024-04-18T21:07:00.636 INFO:tasks.workunit.client.0.smithi078.stdout:6/469: chown d2/d6/dd/f68 1 1 2024-04-18T21:07:00.636 INFO:tasks.workunit.client.0.smithi078.stdout:3/478: mknod d4/d2d/d30/d35/d4b/d59/c89 0 2024-04-18T21:07:00.638 INFO:tasks.workunit.client.0.smithi078.stdout:6/470: link d2/d6/dd/f68 d2/d6/f9e 0 2024-04-18T21:07:00.640 INFO:tasks.workunit.client.0.smithi078.stdout:6/471: read d2/d1c/d30/f3b [2425621,93740] 0 2024-04-18T21:07:00.640 INFO:tasks.workunit.client.0.smithi078.stdout:6/472: read - d2/d34/f56 zero size 2024-04-18T21:07:00.641 INFO:tasks.workunit.client.0.smithi078.stdout:4/633: dread d0/dc/d37/f3b [0,4194304] 0 2024-04-18T21:07:00.642 INFO:tasks.workunit.client.0.smithi078.stdout:4/634: creat d0/dc/d10/d3a/fe0 x:0 0 0 2024-04-18T21:07:00.643 INFO:tasks.workunit.client.0.smithi078.stdout:4/635: mkdir d0/dc/d5b/d71/dcf/de1 0 2024-04-18T21:07:00.643 INFO:tasks.workunit.client.0.smithi078.stdout:4/636: stat d0/dc/d10/d1c/d60/daf 0 2024-04-18T21:07:00.644 INFO:tasks.workunit.client.0.smithi078.stdout:4/637: readlink d0/dc/d37/l66 0 2024-04-18T21:07:00.646 INFO:tasks.workunit.client.0.smithi078.stdout:6/473: dwrite d2/d1f/f2c [4194304,4194304] 0 2024-04-18T21:07:00.647 INFO:tasks.workunit.client.0.smithi078.stdout:6/474: creat d2/d1c/d30/f9f x:0 0 0 2024-04-18T21:07:00.650 INFO:tasks.workunit.client.0.smithi078.stdout:4/638: dwrite d0/dc/f1d [0,4194304] 0 2024-04-18T21:07:00.651 INFO:tasks.workunit.client.0.smithi078.stdout:4/639: mkdir d0/dc/d29/de2 0 2024-04-18T21:07:00.653 INFO:tasks.workunit.client.0.smithi078.stdout:6/475: dwrite d2/d34/f77 [0,4194304] 0 2024-04-18T21:07:00.655 INFO:tasks.workunit.client.0.smithi078.stdout:7/555: sync 2024-04-18T21:07:00.655 INFO:tasks.workunit.client.0.smithi078.stdout:0/624: sync 2024-04-18T21:07:00.655 INFO:tasks.workunit.client.0.smithi078.stdout:6/476: unlink d2/d6/dd/d4b/f89 0 2024-04-18T21:07:00.655 INFO:tasks.workunit.client.0.smithi078.stdout:7/556: chown d1/d16/d1c/f34 197345707 1 2024-04-18T21:07:00.655 INFO:tasks.workunit.client.0.smithi078.stdout:0/625: chown d0/d9/da/db/f2c 5128707 1 2024-04-18T21:07:00.656 INFO:tasks.workunit.client.0.smithi078.stdout:6/477: mkdir d2/d1c/d63/da0 0 2024-04-18T21:07:00.656 INFO:tasks.workunit.client.0.smithi078.stdout:3/479: dread d4/f6a [0,4194304] 0 2024-04-18T21:07:00.656 INFO:tasks.workunit.client.0.smithi078.stdout:7/557: mknod d1/d16/d2d/cc5 0 2024-04-18T21:07:00.656 INFO:tasks.workunit.client.0.smithi078.stdout:6/478: mkdir d2/d1c/d63/da1 0 2024-04-18T21:07:00.657 INFO:tasks.workunit.client.0.smithi078.stdout:7/558: unlink d1/d16/l8f 0 2024-04-18T21:07:00.657 INFO:tasks.workunit.client.0.smithi078.stdout:0/626: creat d0/d9/da/db/da6/fc6 x:0 0 0 2024-04-18T21:07:00.657 INFO:tasks.workunit.client.0.smithi078.stdout:3/480: write d4/d2d/f55 [186768,76331] 0 2024-04-18T21:07:00.657 INFO:tasks.workunit.client.0.smithi078.stdout:6/479: dread - d2/d1c/f9b zero size 2024-04-18T21:07:00.657 INFO:tasks.workunit.client.0.smithi078.stdout:7/559: fdatasync d1/d16/f77 0 2024-04-18T21:07:00.658 INFO:tasks.workunit.client.0.smithi078.stdout:3/481: creat d4/da/d5e/f8a x:0 0 0 2024-04-18T21:07:00.658 INFO:tasks.workunit.client.0.smithi078.stdout:6/480: chown d2/d34/d35/d57/f73 238116357 1 2024-04-18T21:07:00.659 INFO:tasks.workunit.client.0.smithi078.stdout:7/560: write d1/d16/dc/f74 [79206,91964] 0 2024-04-18T21:07:00.659 INFO:tasks.workunit.client.0.smithi078.stdout:6/481: write d2/f97 [980708,74164] 0 2024-04-18T21:07:00.659 INFO:tasks.workunit.client.0.smithi078.stdout:3/482: creat d4/d2d/f8b x:0 0 0 2024-04-18T21:07:00.664 INFO:tasks.workunit.client.0.smithi078.stdout:4/640: dread d0/dc/d5b/f62 [0,4194304] 0 2024-04-18T21:07:00.664 INFO:tasks.workunit.client.0.smithi078.stdout:7/561: write d1/d16/dc/d11/d53/f78 [395865,1735] 0 2024-04-18T21:07:00.665 INFO:tasks.workunit.client.0.smithi078.stdout:6/482: dwrite d2/d1f/f61 [0,4194304] 0 2024-04-18T21:07:00.666 INFO:tasks.workunit.client.0.smithi078.stdout:9/619: dread d7/d11/d2d/d26/f3b [0,4194304] 0 2024-04-18T21:07:00.666 INFO:tasks.workunit.client.0.smithi078.stdout:4/641: truncate d0/dc/d29/d6d/f8c 157601 0 2024-04-18T21:07:00.666 INFO:tasks.workunit.client.0.smithi078.stdout:9/620: chown d7/d11/l29 4551 1 2024-04-18T21:07:00.667 INFO:tasks.workunit.client.0.smithi078.stdout:0/627: dread d0/d9/d4c/d6b/fbd [0,4194304] 0 2024-04-18T21:07:00.668 INFO:tasks.workunit.client.0.smithi078.stdout:7/562: mkdir d1/d16/d10/dc6 0 2024-04-18T21:07:00.668 INFO:tasks.workunit.client.0.smithi078.stdout:9/621: rename d7/f3d to d7/df/d54/fd2 0 2024-04-18T21:07:00.669 INFO:tasks.workunit.client.0.smithi078.stdout:6/483: creat d2/d34/d75/fa2 x:0 0 0 2024-04-18T21:07:00.669 INFO:tasks.workunit.client.0.smithi078.stdout:0/628: chown d0/l66 47406 1 2024-04-18T21:07:00.669 INFO:tasks.workunit.client.0.smithi078.stdout:6/484: dread - d2/f9d zero size 2024-04-18T21:07:00.669 INFO:tasks.workunit.client.0.smithi078.stdout:0/629: mkdir d0/dc7 0 2024-04-18T21:07:00.670 INFO:tasks.workunit.client.0.smithi078.stdout:9/622: creat d7/d11/d1b/d45/d4b/d5d/fd3 x:0 0 0 2024-04-18T21:07:00.670 INFO:tasks.workunit.client.0.smithi078.stdout:5/535: dread d9/da/d3e/d4c/f5a [0,4194304] 0 2024-04-18T21:07:00.670 INFO:tasks.workunit.client.0.smithi078.stdout:0/630: read - d0/f9a zero size 2024-04-18T21:07:00.670 INFO:tasks.workunit.client.0.smithi078.stdout:6/485: creat d2/d34/d35/d57/d90/fa3 x:0 0 0 2024-04-18T21:07:00.671 INFO:tasks.workunit.client.0.smithi078.stdout:3/483: dread d4/da/d11/f32 [0,4194304] 0 2024-04-18T21:07:00.671 INFO:tasks.workunit.client.0.smithi078.stdout:0/631: stat d0/d9/dd/d17/d2e/d31 0 2024-04-18T21:07:00.672 INFO:tasks.workunit.client.0.smithi078.stdout:9/623: write d7/d11/d2d/d3f/f6e [979266,113646] 0 2024-04-18T21:07:00.673 INFO:tasks.workunit.client.0.smithi078.stdout:0/632: readlink d0/l66 0 2024-04-18T21:07:00.673 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:00.673 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:00.673 INFO:tasks.workunit.client.0.smithi078.stdout:5/536: dread d9/da/d3e/d4c/d6d/d73/f45 [0,4194304] 0 2024-04-18T21:07:00.673 INFO:tasks.workunit.client.0.smithi078.stdout:3/484: creat d4/d2d/d30/d35/d71/f8c x:0 0 0 2024-04-18T21:07:00.674 INFO:tasks.workunit.client.0.smithi078.stdout:4/642: dwrite d0/dc/f55 [0,4194304] 0 2024-04-18T21:07:00.674 INFO:tasks.workunit.client.0.smithi078.stdout:5/537: readlink d9/da/l16 0 2024-04-18T21:07:00.675 INFO:tasks.workunit.client.0.smithi078.stdout:0/633: dread - d0/d9/dd/d17/d2e/d7f/f5c zero size 2024-04-18T21:07:00.675 INFO:tasks.workunit.client.0.smithi078.stdout:7/563: dread d1/d16/dc/f5f [0,4194304] 0 2024-04-18T21:07:00.675 INFO:tasks.workunit.client.0.smithi078.stdout:9/624: rmdir d7/df/d88 39 2024-04-18T21:07:00.675 INFO:tasks.workunit.client.0.smithi078.stdout:3/485: mknod d4/d2d/d30/d35/c8d 0 2024-04-18T21:07:00.675 INFO:tasks.workunit.client.0.smithi078.stdout:7/564: fdatasync d1/d16/fc1 0 2024-04-18T21:07:00.676 INFO:tasks.workunit.client.0.smithi078.stdout:5/538: creat d9/da/d3e/d4c/d67/d8d/fb0 x:0 0 0 2024-04-18T21:07:00.676 INFO:tasks.workunit.client.0.smithi078.stdout:9/625: creat d7/df/d1e/fd4 x:0 0 0 2024-04-18T21:07:00.676 INFO:tasks.workunit.client.0.smithi078.stdout:3/486: mknod d4/da/c8e 0 2024-04-18T21:07:00.676 INFO:tasks.workunit.client.0.smithi078.stdout:4/643: getdents d0/dc/d5b/d4f 0 2024-04-18T21:07:00.677 INFO:tasks.workunit.client.0.smithi078.stdout:0/634: getdents d0/d9/d2f 0 2024-04-18T21:07:00.677 INFO:tasks.workunit.client.0.smithi078.stdout:9/626: fdatasync d7/d11/d1b/d45/d4b/f56 0 2024-04-18T21:07:00.679 INFO:tasks.workunit.client.0.smithi078.stdout:4/644: chown d0/dc/d10/f95 1 1 2024-04-18T21:07:00.679 INFO:tasks.workunit.client.0.smithi078.stdout:8/555: dread d0/d5c/f94 [0,4194304] 0 2024-04-18T21:07:00.679 INFO:tasks.workunit.client.0.smithi078.stdout:8/556: dread - d0/d10/d14/fa7 zero size 2024-04-18T21:07:00.680 INFO:tasks.workunit.client.0.smithi078.stdout:9/627: write d7/d11/d1b/d45/d4b/d5d/fa4 [3892392,94600] 0 2024-04-18T21:07:00.680 INFO:tasks.workunit.client.0.smithi078.stdout:4/645: rename d0/dc/d29/d2f/c7f to d0/dc/d29/de2/ce3 0 2024-04-18T21:07:00.680 INFO:tasks.workunit.client.0.smithi078.stdout:7/565: write d1/d16/d10/d5a/fc2 [649643,4758] 0 2024-04-18T21:07:00.680 INFO:tasks.workunit.client.0.smithi078.stdout:9/628: mkdir d7/d11/d2d/d3f/d4d/dd5 0 2024-04-18T21:07:00.680 INFO:tasks.workunit.client.0.smithi078.stdout:0/635: write d0/d15/f27 [1265190,105682] 0 2024-04-18T21:07:00.681 INFO:tasks.workunit.client.0.smithi078.stdout:7/566: sync 2024-04-18T21:07:00.681 INFO:tasks.workunit.client.0.smithi078.stdout:0/636: chown d0/d9/da/c52 0 1 2024-04-18T21:07:00.683 INFO:tasks.workunit.client.0.smithi078.stdout:0/637: unlink d0/d9/d81/daa/cb4 0 2024-04-18T21:07:00.684 INFO:tasks.workunit.client.0.smithi078.stdout:5/539: dwrite d9/da/f1b [4194304,4194304] 0 2024-04-18T21:07:00.684 INFO:tasks.workunit.client.0.smithi078.stdout:5/540: readlink d9/l24 0 2024-04-18T21:07:00.686 INFO:tasks.workunit.client.0.smithi078.stdout:3/487: dwrite d4/f6a [0,4194304] 0 2024-04-18T21:07:00.686 INFO:tasks.workunit.client.0.smithi078.stdout:5/541: readlink d9/da/d3e/d4c/d67/l94 0 2024-04-18T21:07:00.686 INFO:tasks.workunit.client.0.smithi078.stdout:8/557: truncate d0/d22/f61 3085436 0 2024-04-18T21:07:00.686 INFO:tasks.workunit.client.0.smithi078.stdout:5/542: sync 2024-04-18T21:07:00.687 INFO:tasks.workunit.client.0.smithi078.stdout:9/629: truncate d7/d11/d2d/d3f/f6e 1006253 0 2024-04-18T21:07:00.687 INFO:tasks.workunit.client.0.smithi078.stdout:0/638: rmdir d0/d9/d4c/d8f/db6/dc1 0 2024-04-18T21:07:00.688 INFO:tasks.workunit.client.0.smithi078.stdout:3/488: mkdir d4/da/d5e/d8f 0 2024-04-18T21:07:00.689 INFO:tasks.workunit.client.0.smithi078.stdout:5/543: read - d9/da/d90/f8f zero size 2024-04-18T21:07:00.689 INFO:tasks.workunit.client.0.smithi078.stdout:4/646: dwrite d0/dc/d10/d3a/f91 [4194304,4194304] 0 2024-04-18T21:07:00.689 INFO:tasks.workunit.client.0.smithi078.stdout:8/558: write d0/d10/d14/f29 [3733007,115324] 0 2024-04-18T21:07:00.689 INFO:tasks.workunit.client.0.smithi078.stdout:0/639: chown d0/d9/f5a 910360 1 2024-04-18T21:07:00.690 INFO:tasks.workunit.client.0.smithi078.stdout:9/630: chown d7/d11/l29 17668820 1 2024-04-18T21:07:00.691 INFO:tasks.workunit.client.0.smithi078.stdout:4/647: dread - d0/dc/d29/d2f/fac zero size 2024-04-18T21:07:00.691 INFO:tasks.workunit.client.0.smithi078.stdout:7/567: dwrite d1/d16/dc/d11/f7a [4194304,4194304] 0 2024-04-18T21:07:00.692 INFO:tasks.workunit.client.0.smithi078.stdout:4/648: chown d0/f50 1 1 2024-04-18T21:07:00.693 INFO:tasks.workunit.client.0.smithi078.stdout:2/536: dread d0/db/d18/d21/d27/d79/f7f [0,4194304] 0 2024-04-18T21:07:00.694 INFO:tasks.workunit.client.0.smithi078.stdout:5/544: chown d9/l15 22 1 2024-04-18T21:07:00.694 INFO:tasks.workunit.client.0.smithi078.stdout:7/568: readlink d1/d16/dc/d4b/l4c 0 2024-04-18T21:07:00.695 INFO:tasks.workunit.client.0.smithi078.stdout:4/649: readlink d0/dc/d10/d41/d5f/l70 0 2024-04-18T21:07:00.695 INFO:tasks.workunit.client.0.smithi078.stdout:1/574: dread d0/d2a/d45/f5d [0,4194304] 0 2024-04-18T21:07:00.695 INFO:tasks.workunit.client.0.smithi078.stdout:5/545: mkdir d9/da/d3e/d4c/db1 0 2024-04-18T21:07:00.695 INFO:tasks.workunit.client.0.smithi078.stdout:2/537: symlink d0/d1f/d34/d40/la5 0 2024-04-18T21:07:00.696 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:07:00.696 INFO:tasks.workunit.client.0.smithi078.stdout:4/650: write d0/dc/d29/faa [1036312,23776] 0 2024-04-18T21:07:00.697 INFO:tasks.workunit.client.0.smithi078.stdout:0/640: dread - d0/d9/da/db/d35/d3f/fad zero size 2024-04-18T21:07:00.697 INFO:tasks.workunit.client.0.smithi078.stdout:2/538: write d0/d1f/f3f [328947,36763] 0 2024-04-18T21:07:00.697 INFO:tasks.workunit.client.0.smithi078.stdout:6/486: dread d2/d1c/d63/f78 [0,4194304] 0 2024-04-18T21:07:00.698 INFO:tasks.workunit.client.0.smithi078.stdout:4/651: write d0/dc/d37/fa5 [894509,35479] 0 2024-04-18T21:07:00.698 INFO:tasks.workunit.client.0.smithi078.stdout:1/575: rename d0/d2a/d5f/d89/d77 to d0/d2a/d5f/d89/dc2 0 2024-04-18T21:07:00.698 INFO:tasks.workunit.client.0.smithi078.stdout:0/641: write d0/d9/f43 [4077804,12758] 0 2024-04-18T21:07:00.699 INFO:tasks.workunit.client.0.smithi078.stdout:3/489: dwrite d4/da/f79 [0,4194304] 0 2024-04-18T21:07:00.701 INFO:tasks.workunit.client.0.smithi078.stdout:3/490: rename d4/df/c16 to d4/df/d17/c90 0 2024-04-18T21:07:00.701 INFO:tasks.workunit.client.0.smithi078.stdout:6/487: link d2/d1f/f50 d2/d6/dd/d4b/d5d/fa4 0 2024-04-18T21:07:00.702 INFO:tasks.workunit.client.0.smithi078.stdout:0/642: rename d0/d9/dd/d17/d2e/d31/f65 to d0/d9/d7d/fc8 0 2024-04-18T21:07:00.702 INFO:tasks.workunit.client.0.smithi078.stdout:7/569: dwrite d1/f80 [0,4194304] 0 2024-04-18T21:07:00.702 INFO:tasks.workunit.client.0.smithi078.stdout:3/491: creat d4/df/d17/d74/f91 x:0 0 0 2024-04-18T21:07:00.703 INFO:tasks.workunit.client.0.smithi078.stdout:3/492: creat d4/da/f92 x:0 0 0 2024-04-18T21:07:00.703 INFO:tasks.workunit.client.0.smithi078.stdout:6/488: getdents d2/d1c/d67 0 2024-04-18T21:07:00.703 INFO:tasks.workunit.client.0.smithi078.stdout:7/570: dread - d1/d16/d10/d5a/fad zero size 2024-04-18T21:07:00.703 INFO:tasks.workunit.client.0.smithi078.stdout:0/643: unlink d0/d9/da/db/d35/f78 0 2024-04-18T21:07:00.704 INFO:tasks.workunit.client.0.smithi078.stdout:6/489: creat d2/d34/fa5 x:0 0 0 2024-04-18T21:07:00.704 INFO:tasks.workunit.client.0.smithi078.stdout:7/571: unlink d1/d16/dc/d11/d53/f63 0 2024-04-18T21:07:00.704 INFO:tasks.workunit.client.0.smithi078.stdout:6/490: chown d2/d1c/d6b/d98/f99 821314494 1 2024-04-18T21:07:00.705 INFO:tasks.workunit.client.0.smithi078.stdout:7/572: fsync d1/d16/dc/d11/f2e 0 2024-04-18T21:07:00.706 INFO:tasks.workunit.client.0.smithi078.stdout:0/644: rename d0/d9/da/db/d35/d3f/fad to d0/d9/d4c/d8f/dc5/fc9 0 2024-04-18T21:07:00.706 INFO:tasks.workunit.client.0.smithi078.stdout:6/491: fsync d2/d1c/f53 0 2024-04-18T21:07:00.707 INFO:tasks.workunit.client.0.smithi078.stdout:6/492: chown d2/d6/dd/l7e 1 1 2024-04-18T21:07:00.707 INFO:tasks.workunit.client.0.smithi078.stdout:0/645: mkdir d0/d9/dd/d17/dca 0 2024-04-18T21:07:00.707 INFO:tasks.workunit.client.0.smithi078.stdout:6/493: dread - d2/f9d zero size 2024-04-18T21:07:00.707 INFO:tasks.workunit.client.0.smithi078.stdout:0/646: sync 2024-04-18T21:07:00.708 INFO:tasks.workunit.client.0.smithi078.stdout:0/647: mknod d0/d9/da/db/d35/d3f/dae/ccb 0 2024-04-18T21:07:00.709 INFO:tasks.workunit.client.0.smithi078.stdout:0/648: write d0/d9/d81/fa7 [954168,96373] 0 2024-04-18T21:07:00.712 INFO:tasks.workunit.client.0.smithi078.stdout:5/546: truncate d9/da/d32/f60 79096 0 2024-04-18T21:07:00.713 INFO:tasks.workunit.client.0.smithi078.stdout:5/547: stat d9/da/d3e/d4c/db1 0 2024-04-18T21:07:00.714 INFO:tasks.workunit.client.0.smithi078.stdout:6/494: dwrite d2/d6/dd/d4b/d5d/f6a [0,4194304] 0 2024-04-18T21:07:00.714 INFO:tasks.workunit.client.0.smithi078.stdout:5/548: stat d9/da/d3e/d4c 0 2024-04-18T21:07:00.715 INFO:tasks.workunit.client.0.smithi078.stdout:6/495: read - d2/d6/dd/d4b/d5d/f82 zero size 2024-04-18T21:07:00.715 INFO:tasks.workunit.client.0.smithi078.stdout:6/496: dread - d2/d1c/d63/f4f zero size 2024-04-18T21:07:00.716 INFO:tasks.workunit.client.0.smithi078.stdout:0/649: dwrite d0/d9/dd/d17/d2e/f39 [0,4194304] 0 2024-04-18T21:07:00.716 INFO:tasks.workunit.client.0.smithi078.stdout:6/497: symlink d2/d6/dd/d4b/la6 0 2024-04-18T21:07:00.717 INFO:tasks.workunit.client.0.smithi078.stdout:6/498: write d2/d34/d75/fa2 [893044,96474] 0 2024-04-18T21:07:00.719 INFO:tasks.workunit.client.0.smithi078.stdout:0/650: dread d0/d9/da/df/fa0 [0,4194304] 0 2024-04-18T21:07:00.719 INFO:tasks.workunit.client.0.smithi078.stdout:6/499: rmdir d2/d1c/d67/d7f/d9c 0 2024-04-18T21:07:00.720 INFO:tasks.workunit.client.0.smithi078.stdout:6/500: write d2/d1c/d30/f93 [645000,51588] 0 2024-04-18T21:07:00.721 INFO:tasks.workunit.client.0.smithi078.stdout:0/651: fdatasync d0/d9/d4c/d8f/dc5/fc9 0 2024-04-18T21:07:00.721 INFO:tasks.workunit.client.0.smithi078.stdout:5/549: dwrite d9/da/d3e/d4c/d6d/d73/f40 [0,4194304] 0 2024-04-18T21:07:00.723 INFO:tasks.workunit.client.0.smithi078.stdout:5/550: creat d9/da/d3e/d4c/d67/fb2 x:0 0 0 2024-04-18T21:07:00.724 INFO:tasks.workunit.client.0.smithi078.stdout:5/551: readlink d9/da/d3e/d4c/d6d/d75/l80 0 2024-04-18T21:07:00.726 INFO:tasks.workunit.client.0.smithi078.stdout:5/552: creat d9/da/d3e/d4c/d6d/d75/fb3 x:0 0 0 2024-04-18T21:07:00.727 INFO:tasks.workunit.client.0.smithi078.stdout:5/553: readlink d9/da/d32/l92 0 2024-04-18T21:07:00.728 INFO:tasks.workunit.client.0.smithi078.stdout:5/554: fsync d9/da/d3e/d4c/d67/f7b 0 2024-04-18T21:07:00.728 INFO:tasks.workunit.client.0.smithi078.stdout:6/501: dwrite d2/d1c/d30/f6c [0,4194304] 0 2024-04-18T21:07:00.728 INFO:tasks.workunit.client.0.smithi078.stdout:5/555: chown d9/da/c39 102003358 1 2024-04-18T21:07:00.729 INFO:tasks.workunit.client.0.smithi078.stdout:6/502: read d2/d1f/f61 [2327202,44043] 0 2024-04-18T21:07:00.729 INFO:tasks.workunit.client.0.smithi078.stdout:7/573: dwrite d1/d16/f26 [0,4194304] 0 2024-04-18T21:07:00.729 INFO:tasks.workunit.client.0.smithi078.stdout:4/652: dread d0/dc/d29/d6d/d7b/f88 [0,4194304] 0 2024-04-18T21:07:00.731 INFO:tasks.workunit.client.0.smithi078.stdout:6/503: write d2/f2b [4055548,57682] 0 2024-04-18T21:07:00.731 INFO:tasks.workunit.client.0.smithi078.stdout:7/574: rename d1/d32/l89 to d1/d16/lc7 0 2024-04-18T21:07:00.732 INFO:tasks.workunit.client.0.smithi078.stdout:6/504: symlink d2/d1c/d6b/d98/la7 0 2024-04-18T21:07:00.732 INFO:tasks.workunit.client.0.smithi078.stdout:6/505: chown d2/d1c/d3a/l4c 15732 1 2024-04-18T21:07:00.733 INFO:tasks.workunit.client.0.smithi078.stdout:5/556: rename d9/da/d4b/c5c to d9/da/d90/cb4 0 2024-04-18T21:07:00.735 INFO:tasks.workunit.client.0.smithi078.stdout:5/557: mknod d9/da/d3e/d4c/d67/d8d/cb5 0 2024-04-18T21:07:00.735 INFO:tasks.workunit.client.0.smithi078.stdout:6/506: link d2/d6/c19 d2/d6/ca8 0 2024-04-18T21:07:00.735 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:00.734+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:00.736 INFO:tasks.workunit.client.0.smithi078.stdout:7/575: link d1/d16/d10/d7c/c8c d1/d16/dc/d11/d53/d82/da4/db5/d91/db3/cc8 0 2024-04-18T21:07:00.736 INFO:tasks.workunit.client.0.smithi078.stdout:6/507: symlink d2/d1c/d3a/la9 0 2024-04-18T21:07:00.736 INFO:tasks.workunit.client.0.smithi078.stdout:5/558: rename d9/da/d3e/d4c/f54 to d9/da/d4b/d8b/fb6 0 2024-04-18T21:07:00.742 INFO:tasks.workunit.client.0.smithi078.stdout:9/631: dread d7/df/f10 [0,4194304] 0 2024-04-18T21:07:00.742 INFO:tasks.workunit.client.0.smithi078.stdout:5/559: dwrite d9/da/d90/f6f [4194304,4194304] 0 2024-04-18T21:07:00.743 INFO:tasks.workunit.client.0.smithi078.stdout:9/632: creat d7/d11/d2d/fd6 x:0 0 0 2024-04-18T21:07:00.743 INFO:tasks.workunit.client.0.smithi078.stdout:5/560: mkdir d9/db7 0 2024-04-18T21:07:00.744 INFO:tasks.workunit.client.0.smithi078.stdout:9/633: write d7/df/d67/f89 [2775236,69377] 0 2024-04-18T21:07:00.745 INFO:tasks.workunit.client.0.smithi078.stdout:0/652: dread d0/d15/f27 [0,4194304] 0 2024-04-18T21:07:00.746 INFO:tasks.workunit.client.0.smithi078.stdout:5/561: mkdir d9/da/d3e/d4c/db1/db8 0 2024-04-18T21:07:00.746 INFO:tasks.workunit.client.0.smithi078.stdout:0/653: unlink d0/d9/dd/l1b 0 2024-04-18T21:07:00.747 INFO:tasks.workunit.client.0.smithi078.stdout:5/562: write d9/fe [5174251,54796] 0 2024-04-18T21:07:00.749 INFO:tasks.workunit.client.0.smithi078.stdout:5/563: chown d9/da/d32/cae 13 1 2024-04-18T21:07:00.749 INFO:tasks.workunit.client.0.smithi078.stdout:2/539: dread d0/db/d18/d21/d27/d29/f2d [0,4194304] 0 2024-04-18T21:07:00.750 INFO:tasks.workunit.client.0.smithi078.stdout:6/508: dwrite d2/d6/dd/d4b/f5f [0,4194304] 0 2024-04-18T21:07:00.750 INFO:tasks.workunit.client.0.smithi078.stdout:5/564: creat d9/da/d32/fb9 x:0 0 0 2024-04-18T21:07:00.751 INFO:tasks.workunit.client.0.smithi078.stdout:6/509: fdatasync d2/d1c/d6b/d98/f9a 0 2024-04-18T21:07:00.751 INFO:tasks.workunit.client.0.smithi078.stdout:5/565: rename d9/db7 to d9/da/d3e/d4c/db1/dba 0 2024-04-18T21:07:00.751 INFO:tasks.workunit.client.0.smithi078.stdout:5/566: chown d9/da/d4b/fa8 132885394 1 2024-04-18T21:07:00.752 INFO:tasks.workunit.client.0.smithi078.stdout:5/567: write d9/da/f2d [1458617,78548] 0 2024-04-18T21:07:00.758 INFO:tasks.workunit.client.0.smithi078.stdout:1/576: dread d0/d2a/d3c/d4b/d4/f3d [0,4194304] 0 2024-04-18T21:07:00.760 INFO:tasks.workunit.client.0.smithi078.stdout:1/577: rename d0/d11/c19 to d0/d2a/d5f/d89/d32/db2/cc3 0 2024-04-18T21:07:00.760 INFO:tasks.workunit.client.0.smithi078.stdout:1/578: rmdir d0/d2a/d2f 39 2024-04-18T21:07:00.761 INFO:tasks.workunit.client.0.smithi078.stdout:7/576: dread d1/d16/d1c/d40/f8e [0,4194304] 0 2024-04-18T21:07:00.761 INFO:tasks.workunit.client.0.smithi078.stdout:1/579: fdatasync d0/d2a/d45/f76 0 2024-04-18T21:07:00.761 INFO:tasks.workunit.client.0.smithi078.stdout:8/559: dread d0/d10/d14/d2a/d4a/f75 [0,4194304] 0 2024-04-18T21:07:00.762 INFO:tasks.workunit.client.0.smithi078.stdout:7/577: chown d1/d16/dc/d11/f7a 3412933 1 2024-04-18T21:07:00.762 INFO:tasks.workunit.client.0.smithi078.stdout:3/493: dread d4/d2d/d30/f34 [0,4194304] 0 2024-04-18T21:07:00.762 INFO:tasks.workunit.client.0.smithi078.stdout:1/580: fdatasync d0/d2a/d5f/d89/d32/d35/f55 0 2024-04-18T21:07:00.763 INFO:tasks.workunit.client.0.smithi078.stdout:1/581: chown d0/d2a/d5f/f87 7609285 1 2024-04-18T21:07:00.763 INFO:tasks.workunit.client.0.smithi078.stdout:3/494: creat d4/da/d11/d66/f93 x:0 0 0 2024-04-18T21:07:00.763 INFO:tasks.workunit.client.0.smithi078.stdout:1/582: chown d0/d2a/c84 68 1 2024-04-18T21:07:00.764 INFO:tasks.workunit.client.0.smithi078.stdout:3/495: write d4/da/d11/d66/f93 [459191,30869] 0 2024-04-18T21:07:00.764 INFO:tasks.workunit.client.0.smithi078.stdout:1/583: fsync d0/d2a/d2f/d50/f59 0 2024-04-18T21:07:00.764 INFO:tasks.workunit.client.0.smithi078.stdout:3/496: symlink d4/l94 0 2024-04-18T21:07:00.765 INFO:tasks.workunit.client.0.smithi078.stdout:2/540: dread d0/d1f/d34/f81 [0,4194304] 0 2024-04-18T21:07:00.765 INFO:tasks.workunit.client.0.smithi078.stdout:2/541: mkdir d0/d87/da6 0 2024-04-18T21:07:00.766 INFO:tasks.workunit.client.0.smithi078.stdout:2/542: chown d0/db/d18/d21/d27/d29/f69 1978984843 1 2024-04-18T21:07:00.767 INFO:tasks.workunit.client.0.smithi078.stdout:2/543: write d0/db/f36 [1186304,30804] 0 2024-04-18T21:07:00.768 INFO:tasks.workunit.client.0.smithi078.stdout:7/578: dwrite d1/d16/dc/d11/f6e [0,4194304] 0 2024-04-18T21:07:00.768 INFO:tasks.workunit.client.0.smithi078.stdout:7/579: fdatasync d1/d16/d10/d5a/fc2 0 2024-04-18T21:07:00.770 INFO:tasks.workunit.client.0.smithi078.stdout:4/653: dread d0/d73/da9/f86 [0,4194304] 0 2024-04-18T21:07:00.770 INFO:tasks.workunit.client.0.smithi078.stdout:2/544: rmdir d0/d87/da6 0 2024-04-18T21:07:00.770 INFO:tasks.workunit.client.0.smithi078.stdout:7/580: truncate d1/d16/d1c/d40/fa1 957613 0 2024-04-18T21:07:00.770 INFO:tasks.workunit.client.0.smithi078.stdout:0/654: sync 2024-04-18T21:07:00.771 INFO:tasks.workunit.client.0.smithi078.stdout:2/545: unlink d0/d1f/d34/d40/la5 0 2024-04-18T21:07:00.771 INFO:tasks.workunit.client.0.smithi078.stdout:7/581: write d1/d32/f90 [149253,116794] 0 2024-04-18T21:07:00.771 INFO:tasks.workunit.client.0.smithi078.stdout:6/510: sync 2024-04-18T21:07:00.771 INFO:tasks.workunit.client.0.smithi078.stdout:4/654: truncate d0/dc/d29/d6d/d7b/f88 1307984 0 2024-04-18T21:07:00.771 INFO:tasks.workunit.client.0.smithi078.stdout:0/655: chown d0/d9/dd/fb8 4750857 1 2024-04-18T21:07:00.771 INFO:tasks.workunit.client.0.smithi078.stdout:2/546: write d0/f32 [896359,65415] 0 2024-04-18T21:07:00.772 INFO:tasks.workunit.client.0.smithi078.stdout:6/511: rmdir d2/d34/d35/d57/d90 39 2024-04-18T21:07:00.772 INFO:tasks.workunit.client.0.smithi078.stdout:0/656: fdatasync d0/d9/da/f84 0 2024-04-18T21:07:00.773 INFO:tasks.workunit.client.0.smithi078.stdout:4/655: chown d0/dc/d10/d1c/d60/d74/fba 63708449 1 2024-04-18T21:07:00.774 INFO:tasks.workunit.client.0.smithi078.stdout:4/656: mknod d0/d73/da9/ce4 0 2024-04-18T21:07:00.774 INFO:tasks.workunit.client.0.smithi078.stdout:2/547: link d0/db/d18/d21/d27/d29/f6b d0/db/d65/d96/fa7 0 2024-04-18T21:07:00.776 INFO:tasks.workunit.client.0.smithi078.stdout:4/657: write d0/dc/d29/d2f/fc5 [797740,53313] 0 2024-04-18T21:07:00.776 INFO:tasks.workunit.client.0.smithi078.stdout:0/657: link d0/d9/da/db/d35/l36 d0/d9/da/db/d35/d3f/da2/lcc 0 2024-04-18T21:07:00.776 INFO:tasks.workunit.client.0.smithi078.stdout:2/548: truncate d0/d1f/f7e 684697 0 2024-04-18T21:07:00.777 INFO:tasks.workunit.client.0.smithi078.stdout:4/658: chown d0/dc/d10/db2 434363404 1 2024-04-18T21:07:00.778 INFO:tasks.workunit.client.0.smithi078.stdout:2/549: chown d0/db/d18/d21/f31 31164 1 2024-04-18T21:07:00.778 INFO:tasks.workunit.client.0.smithi078.stdout:7/582: dwrite d1/d16/d1c/fab [0,4194304] 0 2024-04-18T21:07:00.779 INFO:tasks.workunit.client.0.smithi078.stdout:6/512: dwrite d2/d6/dd/d4b/f5f [4194304,4194304] 0 2024-04-18T21:07:00.781 INFO:tasks.workunit.client.0.smithi078.stdout:9/634: dread d7/d11/d47/f5c [0,4194304] 0 2024-04-18T21:07:00.782 INFO:tasks.workunit.client.0.smithi078.stdout:2/550: symlink d0/db/d18/d21/d27/d29/la8 0 2024-04-18T21:07:00.782 INFO:tasks.workunit.client.0.smithi078.stdout:9/635: write d7/d11/d1b/d45/d4b/d5d/fd3 [697105,89007] 0 2024-04-18T21:07:00.783 INFO:tasks.workunit.client.0.smithi078.stdout:0/658: dwrite d0/d9/da/fb0 [0,4194304] 0 2024-04-18T21:07:00.784 INFO:tasks.workunit.client.0.smithi078.stdout:2/551: chown d0/db/d18/d30/l50 3 1 2024-04-18T21:07:00.784 INFO:tasks.workunit.client.0.smithi078.stdout:2/552: chown d0/d1f/d34/f53 418 1 2024-04-18T21:07:00.785 INFO:tasks.workunit.client.0.smithi078.stdout:0/659: chown d0/d9/dd/d17/d2e/d31/f4a 0 1 2024-04-18T21:07:00.786 INFO:tasks.workunit.client.0.smithi078.stdout:2/553: dread d0/d1f/d34/f81 [0,4194304] 0 2024-04-18T21:07:00.787 INFO:tasks.workunit.client.0.smithi078.stdout:2/554: write d0/db/d18/d30/f77 [691378,28817] 0 2024-04-18T21:07:00.788 INFO:tasks.workunit.client.0.smithi078.stdout:2/555: dread - d0/db/d65/d96/fa7 zero size 2024-04-18T21:07:00.790 INFO:tasks.workunit.client.0.smithi078.stdout:2/556: truncate d0/db/d18/d21/d27/d29/d4e/f82 414463 0 2024-04-18T21:07:00.791 INFO:tasks.workunit.client.0.smithi078.stdout:0/660: dwrite d0/d9/f2d [4194304,4194304] 0 2024-04-18T21:07:00.792 INFO:tasks.workunit.client.0.smithi078.stdout:0/661: mknod d0/d15/ccd 0 2024-04-18T21:07:00.793 INFO:tasks.workunit.client.0.smithi078.stdout:0/662: mkdir d0/d9/da/db/d35/d3f/dbe/dce 0 2024-04-18T21:07:00.794 INFO:tasks.workunit.client.0.smithi078.stdout:0/663: creat d0/fcf x:0 0 0 2024-04-18T21:07:00.794 INFO:tasks.workunit.client.0.smithi078.stdout:8/560: dread d0/f55 [0,4194304] 0 2024-04-18T21:07:00.796 INFO:tasks.workunit.client.0.smithi078.stdout:0/664: mkdir d0/d9/d4c/d6b/dd0 0 2024-04-18T21:07:00.796 INFO:tasks.workunit.client.0.smithi078.stdout:0/665: chown d0/d9/da/db/d35/d3f/l98 3449 1 2024-04-18T21:07:00.803 INFO:tasks.workunit.client.0.smithi078.stdout:2/557: dread d0/d1f/d34/f53 [0,4194304] 0 2024-04-18T21:07:00.803 INFO:tasks.workunit.client.0.smithi078.stdout:2/558: chown d0/d1f/d34/c73 7 1 2024-04-18T21:07:00.803 INFO:tasks.workunit.client.0.smithi078.stdout:2/559: mkdir d0/da9 0 2024-04-18T21:07:00.804 INFO:tasks.workunit.client.0.smithi078.stdout:7/583: sync 2024-04-18T21:07:00.804 INFO:tasks.workunit.client.0.smithi078.stdout:7/584: readlink d1/l27 0 2024-04-18T21:07:00.806 INFO:tasks.workunit.client.0.smithi078.stdout:8/561: dread d0/f6 [8388608,4194304] 0 2024-04-18T21:07:00.807 INFO:tasks.workunit.client.0.smithi078.stdout:5/568: truncate d9/da/d32/f70 7671830 0 2024-04-18T21:07:00.808 INFO:tasks.workunit.client.0.smithi078.stdout:7/585: getdents d1/d16/d10/d7c/d7e 0 2024-04-18T21:07:00.808 INFO:tasks.workunit.client.0.smithi078.stdout:5/569: dread d9/da/d32/f60 [0,4194304] 0 2024-04-18T21:07:00.809 INFO:tasks.workunit.client.0.smithi078.stdout:7/586: creat d1/d16/dc/d31/fc9 x:0 0 0 2024-04-18T21:07:00.810 INFO:tasks.workunit.client.0.smithi078.stdout:1/584: dread d0/d2a/d3c/d4b/f24 [0,4194304] 0 2024-04-18T21:07:00.810 INFO:tasks.workunit.client.0.smithi078.stdout:5/570: dread - d9/da/d3e/d4c/d6d/d75/f7a zero size 2024-04-18T21:07:00.812 INFO:tasks.workunit.client.0.smithi078.stdout:1/585: symlink d0/d2a/d3c/d4b/d4/d61/d9c/lc4 0 2024-04-18T21:07:00.812 INFO:tasks.workunit.client.0.smithi078.stdout:5/571: rmdir d9/da/d3e/d4c/db1/dba 0 2024-04-18T21:07:00.815 INFO:tasks.workunit.client.0.smithi078.stdout:5/572: write d9/da/d3e/d4c/d6d/d75/fb3 [443986,5428] 0 2024-04-18T21:07:00.815 INFO:tasks.workunit.client.0.smithi078.stdout:1/586: creat d0/d2a/d3c/d4b/d52/fc5 x:0 0 0 2024-04-18T21:07:00.815 INFO:tasks.workunit.client.0.smithi078.stdout:9/636: dread d7/df/f21 [0,4194304] 0 2024-04-18T21:07:00.815 INFO:tasks.workunit.client.0.smithi078.stdout:3/497: getdents d4/da/d57 0 2024-04-18T21:07:00.816 INFO:tasks.workunit.client.0.smithi078.stdout:1/587: mkdir d0/d2a/d2f/dc6 0 2024-04-18T21:07:00.816 INFO:tasks.workunit.client.0.smithi078.stdout:9/637: chown d7/d11/d1b/d45/c96 105 1 2024-04-18T21:07:00.816 INFO:tasks.workunit.client.0.smithi078.stdout:3/498: rmdir d4/df/d17/d41 39 2024-04-18T21:07:00.816 INFO:tasks.workunit.client.0.smithi078.stdout:5/573: write d9/da/d32/fb9 [492151,106529] 0 2024-04-18T21:07:00.816 INFO:tasks.workunit.client.0.smithi078.stdout:7/587: dwrite d1/d32/f90 [0,4194304] 0 2024-04-18T21:07:00.816 INFO:tasks.workunit.client.0.smithi078.stdout:1/588: chown d0/d11/f2d 2096 1 2024-04-18T21:07:00.817 INFO:tasks.workunit.client.0.smithi078.stdout:4/659: write d0/dc/f63 [30249,56536] 0 2024-04-18T21:07:00.818 INFO:tasks.workunit.client.0.smithi078.stdout:1/589: creat d0/d2a/d2f/dc6/fc7 x:0 0 0 2024-04-18T21:07:00.819 INFO:tasks.workunit.client.0.smithi078.stdout:1/590: truncate d0/f9f 777705 0 2024-04-18T21:07:00.820 INFO:tasks.workunit.client.0.smithi078.stdout:3/499: dread d4/df/d17/f3a [0,4194304] 0 2024-04-18T21:07:00.820 INFO:tasks.workunit.client.0.smithi078.stdout:1/591: getdents d0/d2a/d3c/d4b/d5e 0 2024-04-18T21:07:00.821 INFO:tasks.workunit.client.0.smithi078.stdout:3/500: symlink d4/da/d5e/l95 0 2024-04-18T21:07:00.821 INFO:tasks.workunit.client.0.smithi078.stdout:1/592: write d0/d2a/d2f/f33 [3749765,13464] 0 2024-04-18T21:07:00.822 INFO:tasks.workunit.client.0.smithi078.stdout:3/501: write d4/fd [3608769,86939] 0 2024-04-18T21:07:00.822 INFO:tasks.workunit.client.0.smithi078.stdout:1/593: write d0/d2a/d5f/d89/d32/d35/fab [907269,6292] 0 2024-04-18T21:07:00.823 INFO:tasks.workunit.client.0.smithi078.stdout:1/594: chown d0/d2a/d5f/d89/d32/fa7 884 1 2024-04-18T21:07:00.824 INFO:tasks.workunit.client.0.smithi078.stdout:1/595: chown d0/d11/d69/f72 765013 1 2024-04-18T21:07:00.824 INFO:tasks.workunit.client.0.smithi078.stdout:4/660: dwrite d0/dc/d29/d6d/f8c [0,4194304] 0 2024-04-18T21:07:00.824 INFO:tasks.workunit.client.0.smithi078.stdout:9/638: read d7/d11/d1b/f5f [3403864,30982] 0 2024-04-18T21:07:00.825 INFO:tasks.workunit.client.0.smithi078.stdout:1/596: chown d0/d2a/d3c/d4b/d4/ce 12291854 1 2024-04-18T21:07:00.826 INFO:tasks.workunit.client.0.smithi078.stdout:1/597: write d0/d2a/f62 [2554346,14738] 0 2024-04-18T21:07:00.830 INFO:tasks.workunit.client.0.smithi078.stdout:6/513: truncate d2/d34/d35/d57/f73 613318 0 2024-04-18T21:07:00.831 INFO:tasks.workunit.client.0.smithi078.stdout:4/661: dwrite d0/dc/d10/db2/fc9 [0,4194304] 0 2024-04-18T21:07:00.831 INFO:tasks.workunit.client.0.smithi078.stdout:9/639: dwrite d7/d11/d1b/d45/d4b/d5d/f8d [0,4194304] 0 2024-04-18T21:07:00.833 INFO:tasks.workunit.client.0.smithi078.stdout:6/514: rename d2/d1c/d30/f6c to d2/d1c/d63/da0/faa 0 2024-04-18T21:07:00.833 INFO:tasks.workunit.client.0.smithi078.stdout:0/666: write d0/d9/da/df/fa0 [852380,88221] 0 2024-04-18T21:07:00.833 INFO:tasks.workunit.client.0.smithi078.stdout:1/598: dwrite d0/d2a/d2f/f36 [0,4194304] 0 2024-04-18T21:07:00.834 INFO:tasks.workunit.client.0.smithi078.stdout:4/662: getdents d0/dc/d37 0 2024-04-18T21:07:00.834 INFO:tasks.workunit.client.0.smithi078.stdout:6/515: read d2/d34/d75/fa2 [914426,111538] 0 2024-04-18T21:07:00.834 INFO:tasks.workunit.client.0.smithi078.stdout:1/599: stat d0/d2a/d2f/f33 0 2024-04-18T21:07:00.835 INFO:tasks.workunit.client.0.smithi078.stdout:0/667: truncate d0/d9/d58/f62 463240 0 2024-04-18T21:07:00.835 INFO:tasks.workunit.client.0.smithi078.stdout:6/516: chown d2/fe 3991269 1 2024-04-18T21:07:00.836 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:00.834+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:00.836 INFO:tasks.workunit.client.0.smithi078.stdout:0/668: chown d0/d9/da/db/f68 74603018 1 2024-04-18T21:07:00.836 INFO:tasks.workunit.client.0.smithi078.stdout:6/517: stat d2/d1c/d63/f8e 0 2024-04-18T21:07:00.836 INFO:tasks.workunit.client.0.smithi078.stdout:1/600: unlink d0/d2a/d5f/d89/d32/f4c 0 2024-04-18T21:07:00.836 INFO:tasks.workunit.client.0.smithi078.stdout:0/669: stat d0/d9/da/f59 0 2024-04-18T21:07:00.837 INFO:tasks.workunit.client.0.smithi078.stdout:7/588: dread d1/d16/dc/d11/d53/d82/da4/db5/fb9 [0,4194304] 0 2024-04-18T21:07:00.837 INFO:tasks.workunit.client.0.smithi078.stdout:6/518: mknod d2/d1c/d63/d8b/cab 0 2024-04-18T21:07:00.837 INFO:tasks.workunit.client.0.smithi078.stdout:9/640: dread d7/d11/d2d/d26/f3b [0,4194304] 0 2024-04-18T21:07:00.837 INFO:tasks.workunit.client.0.smithi078.stdout:0/670: mknod d0/d9/d4c/d8f/cd1 0 2024-04-18T21:07:00.837 INFO:tasks.workunit.client.0.smithi078.stdout:1/601: mkdir d0/d2a/d45/d81/dc8 0 2024-04-18T21:07:00.838 INFO:tasks.workunit.client.0.smithi078.stdout:6/519: write d2/d34/f77 [131562,104035] 0 2024-04-18T21:07:00.838 INFO:tasks.workunit.client.0.smithi078.stdout:9/641: mkdir d7/d11/d2d/d3f/db7/dd7 0 2024-04-18T21:07:00.839 INFO:tasks.workunit.client.0.smithi078.stdout:1/602: creat d0/d2a/d3c/d4b/d5e/fc9 x:0 0 0 2024-04-18T21:07:00.839 INFO:tasks.workunit.client.0.smithi078.stdout:6/520: truncate d2/d34/d35/f40 1814499 0 2024-04-18T21:07:00.839 INFO:tasks.workunit.client.0.smithi078.stdout:1/603: mkdir d0/dca 0 2024-04-18T21:07:00.839 INFO:tasks.workunit.client.0.smithi078.stdout:6/521: readlink d2/d1f/l76 0 2024-04-18T21:07:00.840 INFO:tasks.workunit.client.0.smithi078.stdout:6/522: mknod d2/d6/dd/cac 0 2024-04-18T21:07:00.841 INFO:tasks.workunit.client.0.smithi078.stdout:1/604: fdatasync d0/d2a/d5f/d89/dc2/f8c 0 2024-04-18T21:07:00.841 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-18T21:07:00.841 INFO:tasks.workunit.client.0.smithi078.stdout:4/663: dwrite d0/dc/d29/d2f/da7/fad [0,4194304] 0 2024-04-18T21:07:00.842 INFO:tasks.workunit.client.0.smithi078.stdout:6/523: truncate d2/d1c/f53 631518 0 2024-04-18T21:07:00.842 INFO:tasks.workunit.client.0.smithi078.stdout:4/664: truncate d0/dc/d29/faa 2002861 0 2024-04-18T21:07:00.844 INFO:tasks.workunit.client.0.smithi078.stdout:6/524: chown d2/d6/dd/cac 70 1 2024-04-18T21:07:00.844 INFO:tasks.workunit.client.0.smithi078.stdout:1/605: link d0/d2a/d3c/d4b/d5e/ca2 d0/d2a/d45/d81/dc8/ccb 0 2024-04-18T21:07:00.844 INFO:tasks.workunit.client.0.smithi078.stdout:7/589: dwrite d1/d32/f41 [0,4194304] 0 2024-04-18T21:07:00.844 INFO:tasks.workunit.client.0.smithi078.stdout:4/665: creat d0/dc/d29/d2f/da7/fe5 x:0 0 0 2024-04-18T21:07:00.844 INFO:tasks.workunit.client.0.smithi078.stdout:1/606: rmdir d0/d2a/d5f/d89 39 2024-04-18T21:07:00.844 INFO:tasks.workunit.client.0.smithi078.stdout:6/525: unlink d2/d6/dd/c17 0 2024-04-18T21:07:00.844 INFO:tasks.workunit.client.0.smithi078.stdout:4/666: creat d0/dc/d5b/d4f/fe6 x:0 0 0 2024-04-18T21:07:00.845 INFO:tasks.workunit.client.0.smithi078.stdout:2/560: write d0/f10 [638951,106648] 0 2024-04-18T21:07:00.845 INFO:tasks.workunit.client.0.smithi078.stdout:4/667: mknod d0/d73/da9/dcb/ce7 0 2024-04-18T21:07:00.846 INFO:tasks.workunit.client.0.smithi078.stdout:2/561: readlink d0/db/d18/l3d 0 2024-04-18T21:07:00.846 INFO:tasks.workunit.client.0.smithi078.stdout:4/668: creat d0/d73/fe8 x:0 0 0 2024-04-18T21:07:00.846 INFO:tasks.workunit.client.0.smithi078.stdout:4/669: chown d0/dc/d37/ccd 968684 1 2024-04-18T21:07:00.847 INFO:tasks.workunit.client.0.smithi078.stdout:2/562: getdents d0/db/d18/d21/d27/d29/d57/d7c 0 2024-04-18T21:07:00.847 INFO:tasks.workunit.client.0.smithi078.stdout:4/670: write d0/dc/d5b/d4f/d83/db8/fcc [1225983,52749] 0 2024-04-18T21:07:00.849 INFO:tasks.workunit.client.0.smithi078.stdout:1/607: dread d0/d2a/d45/f5d [0,4194304] 0 2024-04-18T21:07:00.850 INFO:tasks.workunit.client.0.smithi078.stdout:2/563: symlink d0/d1f/laa 0 2024-04-18T21:07:00.850 INFO:tasks.workunit.client.0.smithi078.stdout:8/562: truncate d0/d10/f1c 1216246 0 2024-04-18T21:07:00.850 INFO:tasks.workunit.client.0.smithi078.stdout:4/671: mknod d0/dc/d29/d6d/d82/ce9 0 2024-04-18T21:07:00.850 INFO:tasks.workunit.client.0.smithi078.stdout:5/574: write d9/da/f13 [1510815,60841] 0 2024-04-18T21:07:00.850 INFO:tasks.workunit.client.0.smithi078.stdout:4/672: fdatasync d0/dc/d5b/d71/f56 0 2024-04-18T21:07:00.851 INFO:tasks.workunit.client.0.smithi078.stdout:2/564: creat d0/db/d18/d30/fab x:0 0 0 2024-04-18T21:07:00.851 INFO:tasks.workunit.client.0.smithi078.stdout:1/608: creat d0/d2a/d3c/d4b/fcc x:0 0 0 2024-04-18T21:07:00.851 INFO:tasks.workunit.client.0.smithi078.stdout:2/565: chown d0/db/d18/d21/d27 258158 1 2024-04-18T21:07:00.851 INFO:tasks.workunit.client.0.smithi078.stdout:5/575: creat d9/da/d3e/d4c/d67/d7c/d78/fbb x:0 0 0 2024-04-18T21:07:00.852 INFO:tasks.workunit.client.0.smithi078.stdout:5/576: read - d9/da/d32/da5/fa9 zero size 2024-04-18T21:07:00.853 INFO:tasks.workunit.client.0.smithi078.stdout:2/566: rename d0/db/d18/d21/d27/d29/c97 to d0/d1f/d5b/cac 0 2024-04-18T21:07:00.855 INFO:tasks.workunit.client.0.smithi078.stdout:5/577: truncate d9/da/d3e/d4c/d67/f96 285874 0 2024-04-18T21:07:00.855 INFO:tasks.workunit.client.0.smithi078.stdout:3/502: dwrite d4/da/f4a [4194304,4194304] 0 2024-04-18T21:07:00.857 INFO:tasks.workunit.client.0.smithi078.stdout:3/503: rename d4/f9 to d4/da/d76/f96 0 2024-04-18T21:07:00.857 INFO:tasks.workunit.client.0.smithi078.stdout:4/673: dwrite d0/dc/fd2 [0,4194304] 0 2024-04-18T21:07:00.859 INFO:tasks.workunit.client.0.smithi078.stdout:4/674: dread - d0/dc/d5b/f8a zero size 2024-04-18T21:07:00.860 INFO:tasks.workunit.client.0.smithi078.stdout:4/675: symlink d0/dc/d29/d6d/d7b/lea 0 2024-04-18T21:07:00.861 INFO:tasks.workunit.client.0.smithi078.stdout:4/676: rename d0/dc/d10/d1c/d6a/d81/f8b to d0/dc/d5b/d4f/d83/db8/feb 0 2024-04-18T21:07:00.862 INFO:tasks.workunit.client.0.smithi078.stdout:4/677: creat d0/dc/d5b/d4f/fec x:0 0 0 2024-04-18T21:07:00.863 INFO:tasks.workunit.client.0.smithi078.stdout:4/678: chown d0/dc/d29/d6d/d7b/c8f 40 1 2024-04-18T21:07:00.863 INFO:tasks.workunit.client.0.smithi078.stdout:5/578: truncate d9/da/d4b/fa8 536293 0 2024-04-18T21:07:00.863 INFO:tasks.workunit.client.0.smithi078.stdout:5/579: mkdir d9/da/d3e/d4c/d6d/d75/dbc 0 2024-04-18T21:07:00.863 INFO:tasks.workunit.client.0.smithi078.stdout:4/679: truncate d0/f17 3503523 0 2024-04-18T21:07:00.864 INFO:tasks.workunit.client.0.smithi078.stdout:4/680: stat d0/dc/d10/d41/d5f/fb7 0 2024-04-18T21:07:00.865 INFO:tasks.workunit.client.0.smithi078.stdout:5/580: mkdir d9/da/d90/d62/da4/dbd 0 2024-04-18T21:07:00.865 INFO:tasks.workunit.client.0.smithi078.stdout:4/681: creat d0/dc/d10/d3a/fed x:0 0 0 2024-04-18T21:07:00.865 INFO:tasks.workunit.client.0.smithi078.stdout:5/581: mknod d9/d9f/cbe 0 2024-04-18T21:07:00.865 INFO:tasks.workunit.client.0.smithi078.stdout:9/642: read d7/f37 [5728020,32761] 0 2024-04-18T21:07:00.866 INFO:tasks.workunit.client.0.smithi078.stdout:4/682: dread - d0/dc/d29/d2f/fac zero size 2024-04-18T21:07:00.866 INFO:tasks.workunit.client.0.smithi078.stdout:5/582: write d9/da/d90/d62/f63 [2053537,25882] 0 2024-04-18T21:07:00.866 INFO:tasks.workunit.client.0.smithi078.stdout:9/643: chown d7/d11/d2d/d26/d7c/fc8 7 1 2024-04-18T21:07:00.867 INFO:tasks.workunit.client.0.smithi078.stdout:8/563: dread d0/d22/f76 [0,4194304] 0 2024-04-18T21:07:00.868 INFO:tasks.workunit.client.0.smithi078.stdout:3/504: creat d4/da/d11/f97 x:0 0 0 2024-04-18T21:07:00.868 INFO:tasks.workunit.client.0.smithi078.stdout:9/644: symlink d7/d23/d7a/ld8 0 2024-04-18T21:07:00.869 INFO:tasks.workunit.client.0.smithi078.stdout:8/564: creat d0/d10/d8d/faa x:0 0 0 2024-04-18T21:07:00.870 INFO:tasks.workunit.client.0.smithi078.stdout:3/505: creat d4/df/f98 x:0 0 0 2024-04-18T21:07:00.870 INFO:tasks.workunit.client.0.smithi078.stdout:8/565: write d0/d10/d14/d2a/f71 [4554140,783] 0 2024-04-18T21:07:00.871 INFO:tasks.workunit.client.0.smithi078.stdout:9/645: truncate d7/d11/d2d/d3f/f6e 1352514 0 2024-04-18T21:07:00.871 INFO:tasks.workunit.client.0.smithi078.stdout:3/506: unlink d4/d2d/d30/c4e 0 2024-04-18T21:07:00.872 INFO:tasks.workunit.client.0.smithi078.stdout:8/566: creat d0/d10/d14/d2d/d93/da0/fab x:0 0 0 2024-04-18T21:07:00.873 INFO:tasks.workunit.client.0.smithi078.stdout:3/507: write d4/d2d/f8b [1000445,72949] 0 2024-04-18T21:07:00.873 INFO:tasks.workunit.client.0.smithi078.stdout:4/683: dwrite d0/dc/d29/f31 [0,4194304] 0 2024-04-18T21:07:00.873 INFO:tasks.workunit.client.0.smithi078.stdout:8/567: fdatasync d0/d10/d14/f1e 0 2024-04-18T21:07:00.876 INFO:tasks.workunit.client.0.smithi078.stdout:8/568: creat d0/d10/d60/fac x:0 0 0 2024-04-18T21:07:00.876 INFO:tasks.workunit.client.0.smithi078.stdout:4/684: rename d0/dc/d5b/d4f/d83 to d0/dc/d10/d1c/d60/dee 0 2024-04-18T21:07:00.876 INFO:tasks.workunit.client.0.smithi078.stdout:5/583: dread d9/fb [4194304,4194304] 0 2024-04-18T21:07:00.876 INFO:tasks.workunit.client.0.smithi078.stdout:8/569: chown d0/d10/d14/d2d/c30 333648 1 2024-04-18T21:07:00.876 INFO:tasks.workunit.client.0.smithi078.stdout:8/570: readlink d0/l52 0 2024-04-18T21:07:00.877 INFO:tasks.workunit.client.0.smithi078.stdout:9/646: dread d7/df/f10 [0,4194304] 0 2024-04-18T21:07:00.877 INFO:tasks.workunit.client.0.smithi078.stdout:4/685: rename d0/dc/d10/f42 to d0/dc/dd7/fef 0 2024-04-18T21:07:00.877 INFO:tasks.workunit.client.0.smithi078.stdout:8/571: creat d0/d10/d14/d2d/d93/fad x:0 0 0 2024-04-18T21:07:00.878 INFO:tasks.workunit.client.0.smithi078.stdout:8/572: dread - d0/d10/d14/fa5 zero size 2024-04-18T21:07:00.880 INFO:tasks.workunit.client.0.smithi078.stdout:3/508: dwrite d4/df/d17/f5a [0,4194304] 0 2024-04-18T21:07:00.882 INFO:tasks.workunit.client.0.smithi078.stdout:5/584: dwrite d9/da/d3e/d4c/d67/d8d/fb0 [0,4194304] 0 2024-04-18T21:07:00.883 INFO:tasks.workunit.client.0.smithi078.stdout:5/585: symlink d9/da/d3e/d4c/db1/db8/lbf 0 2024-04-18T21:07:00.884 INFO:tasks.workunit.client.0.smithi078.stdout:5/586: mknod d9/da/d3e/d4c/d67/cc0 0 2024-04-18T21:07:00.885 INFO:tasks.workunit.client.0.smithi078.stdout:8/573: truncate d0/d10/d14/f1e 2288822 0 2024-04-18T21:07:00.886 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:00.886 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:00.886 INFO:tasks.workunit.client.0.smithi078.stdout:9/647: truncate d7/d11/d2d/d26/f38 1231913 0 2024-04-18T21:07:00.886 INFO:tasks.workunit.client.0.smithi078.stdout:8/574: dread - d0/d10/d14/d2d/d93/fa9 zero size 2024-04-18T21:07:00.887 INFO:tasks.workunit.client.0.smithi078.stdout:8/575: readlink d0/d22/l9f 0 2024-04-18T21:07:00.887 INFO:tasks.workunit.client.0.smithi078.stdout:9/648: getdents d7/d11/d2d/d3f/db7/dd7 0 2024-04-18T21:07:00.888 INFO:tasks.workunit.client.0.smithi078.stdout:4/686: link d0/dc/d37/c3c d0/dc/d10/d41/d5f/cf0 0 2024-04-18T21:07:00.888 INFO:tasks.workunit.client.0.smithi078.stdout:9/649: symlink d7/d11/d1b/d77/ld9 0 2024-04-18T21:07:00.889 INFO:tasks.workunit.client.0.smithi078.stdout:1/609: dread d0/d2a/d2f/f38 [4194304,4194304] 0 2024-04-18T21:07:00.890 INFO:tasks.workunit.client.0.smithi078.stdout:9/650: rename d7/d23/d7a to d7/d11/d2d/d26/d7c/dda 0 2024-04-18T21:07:00.890 INFO:tasks.workunit.client.0.smithi078.stdout:4/687: getdents d0/d73 0 2024-04-18T21:07:00.891 INFO:tasks.workunit.client.0.smithi078.stdout:1/610: read d0/d2a/d2f/f56 [216499,8636] 0 2024-04-18T21:07:00.892 INFO:tasks.workunit.client.0.smithi078.stdout:5/587: dwrite d9/da/d3e/d4c/d67/fb2 [0,4194304] 0 2024-04-18T21:07:00.892 INFO:tasks.workunit.client.0.smithi078.stdout:1/611: chown d0/d11/c29 1243 1 2024-04-18T21:07:00.892 INFO:tasks.workunit.client.0.smithi078.stdout:9/651: link d7/d23/fb4 d7/d11/d1b/d98/fdb 0 2024-04-18T21:07:00.893 INFO:tasks.workunit.client.0.smithi078.stdout:4/688: chown d0/dc/d10/d41/d5f/cf0 38102 1 2024-04-18T21:07:00.893 INFO:tasks.workunit.client.0.smithi078.stdout:9/652: dread - d7/df/d1e/fd4 zero size 2024-04-18T21:07:00.894 INFO:tasks.workunit.client.0.smithi078.stdout:5/588: mkdir d9/da/d90/d62/da4/dbd/dc1 0 2024-04-18T21:07:00.894 INFO:tasks.workunit.client.0.smithi078.stdout:4/689: chown d0/dc/d5b/d71/f56 1 1 2024-04-18T21:07:00.894 INFO:tasks.workunit.client.0.smithi078.stdout:9/653: chown d7/d11/d1b/d77/ld9 3077019 1 2024-04-18T21:07:00.895 INFO:tasks.workunit.client.0.smithi078.stdout:8/576: dwrite d0/d10/d14/d2d/d93/f8f [0,4194304] 0 2024-04-18T21:07:00.895 INFO:tasks.workunit.client.0.smithi078.stdout:5/589: creat d9/da/d3e/d4c/d6d/d75/dad/fc2 x:0 0 0 2024-04-18T21:07:00.895 INFO:tasks.workunit.client.0.smithi078.stdout:4/690: write d0/dc/d29/d2f/f38 [476577,34703] 0 2024-04-18T21:07:00.896 INFO:tasks.workunit.client.0.smithi078.stdout:9/654: write d7/d11/d2d/d26/fb3 [916087,91243] 0 2024-04-18T21:07:00.896 INFO:tasks.workunit.client.0.smithi078.stdout:8/577: chown d0/d10/d9d/la6 21 1 2024-04-18T21:07:00.896 INFO:tasks.workunit.client.0.smithi078.stdout:8/578: fdatasync d0/d10/d14/d2d/f83 0 2024-04-18T21:07:00.897 INFO:tasks.workunit.client.0.smithi078.stdout:5/590: creat d9/da/d3e/d4c/d6d/d73/fc3 x:0 0 0 2024-04-18T21:07:00.898 INFO:tasks.workunit.client.0.smithi078.stdout:8/579: truncate d0/d10/fa3 1008167 0 2024-04-18T21:07:00.898 INFO:tasks.workunit.client.0.smithi078.stdout:1/612: write d0/d11/f22 [3412305,77752] 0 2024-04-18T21:07:00.899 INFO:tasks.workunit.client.0.smithi078.stdout:8/580: unlink d0/c4 0 2024-04-18T21:07:00.900 INFO:tasks.workunit.client.0.smithi078.stdout:1/613: chown d0/d2a/d3c/d4b/d4/d61/l80 85 1 2024-04-18T21:07:00.901 INFO:tasks.workunit.client.0.smithi078.stdout:1/614: chown d0/d11/l47 7024 1 2024-04-18T21:07:00.902 INFO:tasks.workunit.client.0.smithi078.stdout:4/691: dwrite d0/dc/d29/f51 [4194304,4194304] 0 2024-04-18T21:07:00.903 INFO:tasks.workunit.client.0.smithi078.stdout:1/615: fdatasync d0/d2a/d5f/d89/d32/d35/d85/fb0 0 2024-04-18T21:07:00.904 INFO:tasks.workunit.client.0.smithi078.stdout:1/616: chown d0/d11/d69/f97 1014 1 2024-04-18T21:07:00.904 INFO:tasks.workunit.client.0.smithi078.stdout:5/591: dwrite d9/da/d90/f89 [0,4194304] 0 2024-04-18T21:07:00.905 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:07:00.905 INFO:tasks.workunit.client.0.smithi078.stdout:8/581: read d0/d10/f1c [656803,72876] 0 2024-04-18T21:07:00.906 INFO:tasks.workunit.client.0.smithi078.stdout:5/592: symlink d9/da/d3e/d4c/d6d/d75/lc4 0 2024-04-18T21:07:00.906 INFO:tasks.workunit.client.0.smithi078.stdout:5/593: rmdir d9/da/d3e/d4c 39 2024-04-18T21:07:00.908 INFO:tasks.workunit.client.0.smithi078.stdout:5/594: creat d9/da/d3e/d4c/d6d/d75/dbc/fc5 x:0 0 0 2024-04-18T21:07:00.909 INFO:tasks.workunit.client.0.smithi078.stdout:5/595: creat d9/d9f/fc6 x:0 0 0 2024-04-18T21:07:00.911 INFO:tasks.workunit.client.0.smithi078.stdout:8/582: dwrite d0/d10/d60/d6f/f7f [0,4194304] 0 2024-04-18T21:07:00.917 INFO:tasks.workunit.client.0.smithi078.stdout:9/655: dread d7/df/d1e/f58 [0,4194304] 0 2024-04-18T21:07:00.917 INFO:tasks.workunit.client.0.smithi078.stdout:8/583: dwrite d0/d10/d60/fac [0,4194304] 0 2024-04-18T21:07:00.919 INFO:tasks.workunit.client.0.smithi078.stdout:9/656: mkdir d7/d11/d2d/ddc 0 2024-04-18T21:07:00.919 INFO:tasks.workunit.client.0.smithi078.stdout:8/584: link d0/d10/d14/d2d/l34 d0/d10/d14/lae 0 2024-04-18T21:07:00.919 INFO:tasks.workunit.client.0.smithi078.stdout:8/585: chown d0/d10/d60/d6f/f7f 36 1 2024-04-18T21:07:00.921 INFO:tasks.workunit.client.0.smithi078.stdout:8/586: creat d0/d10/d14/d2a/d4a/faf x:0 0 0 2024-04-18T21:07:00.921 INFO:tasks.workunit.client.0.smithi078.stdout:8/587: creat d0/d10/d60/d6f/fb0 x:0 0 0 2024-04-18T21:07:00.922 INFO:tasks.workunit.client.0.smithi078.stdout:8/588: chown d0/d10/c38 3 1 2024-04-18T21:07:00.922 INFO:tasks.workunit.client.0.smithi078.stdout:8/589: chown d0/d10/d14/f29 0 1 2024-04-18T21:07:00.923 INFO:tasks.workunit.client.0.smithi078.stdout:8/590: creat d0/d10/d14/d2a/fb1 x:0 0 0 2024-04-18T21:07:00.923 INFO:tasks.workunit.client.0.smithi078.stdout:8/591: readlink d0/d10/d14/d2a/d3c/l87 0 2024-04-18T21:07:00.924 INFO:tasks.workunit.client.0.smithi078.stdout:8/592: rmdir d0/d5c/d5a/d7b 39 2024-04-18T21:07:00.924 INFO:tasks.workunit.client.0.smithi078.stdout:8/593: mkdir d0/d10/d14/d2a/d4a/db2 0 2024-04-18T21:07:00.925 INFO:tasks.workunit.client.0.smithi078.stdout:8/594: mknod d0/d5c/d5a/cb3 0 2024-04-18T21:07:00.926 INFO:tasks.workunit.client.0.smithi078.stdout:8/595: creat d0/d10/fb4 x:0 0 0 2024-04-18T21:07:00.926 INFO:tasks.workunit.client.0.smithi078.stdout:8/596: read - d0/d10/d14/d2d/d93/fa9 zero size 2024-04-18T21:07:00.927 INFO:tasks.workunit.client.0.smithi078.stdout:8/597: mkdir d0/d10/d14/d2d/d93/da0/db5 0 2024-04-18T21:07:00.930 INFO:tasks.workunit.client.0.smithi078.stdout:5/596: dread d9/da/d3e/d4c/d6d/d73/f97 [0,4194304] 0 2024-04-18T21:07:00.932 INFO:tasks.workunit.client.0.smithi078.stdout:5/597: getdents d9/da/d3e/d4c/d6d/d75/dad 0 2024-04-18T21:07:00.934 INFO:tasks.workunit.client.0.smithi078.stdout:3/509: dread d4/da/d11/f21 [4194304,4194304] 0 2024-04-18T21:07:00.934 INFO:tasks.workunit.client.0.smithi078.stdout:3/510: write d4/d2d/d30/d35/d4b/f65 [811102,33836] 0 2024-04-18T21:07:00.935 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:00.934+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:00.937 INFO:tasks.workunit.client.0.smithi078.stdout:1/617: dread d0/d2a/d5f/d89/f49 [0,4194304] 0 2024-04-18T21:07:00.938 INFO:tasks.workunit.client.0.smithi078.stdout:3/511: dread d4/da/d11/f21 [4194304,4194304] 0 2024-04-18T21:07:00.939 INFO:tasks.workunit.client.0.smithi078.stdout:3/512: symlink d4/da/l99 0 2024-04-18T21:07:00.940 INFO:tasks.workunit.client.0.smithi078.stdout:0/671: sync 2024-04-18T21:07:00.940 INFO:tasks.workunit.client.0.smithi078.stdout:7/590: sync 2024-04-18T21:07:00.940 INFO:tasks.workunit.client.0.smithi078.stdout:6/526: sync 2024-04-18T21:07:00.941 INFO:tasks.workunit.client.0.smithi078.stdout:6/527: symlink d2/lad 0 2024-04-18T21:07:00.941 INFO:tasks.workunit.client.0.smithi078.stdout:0/672: mkdir d0/d9/d4c/d8f/dc5/dd2 0 2024-04-18T21:07:00.941 INFO:tasks.workunit.client.0.smithi078.stdout:6/528: mknod d2/d34/cae 0 2024-04-18T21:07:00.942 INFO:tasks.workunit.client.0.smithi078.stdout:0/673: chown d0/d9/da/db/f2c 3475 1 2024-04-18T21:07:00.943 INFO:tasks.workunit.client.0.smithi078.stdout:6/529: mknod d2/d6/d8d/caf 0 2024-04-18T21:07:00.945 INFO:tasks.workunit.client.0.smithi078.stdout:1/618: dwrite d0/d2a/d5f/d89/f49 [0,4194304] 0 2024-04-18T21:07:00.946 INFO:tasks.workunit.client.0.smithi078.stdout:3/513: dwrite d4/da/d76/f77 [0,4194304] 0 2024-04-18T21:07:00.948 INFO:tasks.workunit.client.0.smithi078.stdout:3/514: rmdir d4/d2d/d30/d35/d71 39 2024-04-18T21:07:00.948 INFO:tasks.workunit.client.0.smithi078.stdout:7/591: dwrite d1/d16/dc/d11/d53/d82/da4/db5/f9d [0,4194304] 0 2024-04-18T21:07:00.949 INFO:tasks.workunit.client.0.smithi078.stdout:0/674: getdents d0/d9/da/df 0 2024-04-18T21:07:00.950 INFO:tasks.workunit.client.0.smithi078.stdout:1/619: mknod d0/ccd 0 2024-04-18T21:07:00.950 INFO:tasks.workunit.client.0.smithi078.stdout:1/620: stat d0/d2a/d2f/f9a 0 2024-04-18T21:07:00.950 INFO:tasks.workunit.client.0.smithi078.stdout:3/515: creat d4/d2d/d30/d35/d4b/d59/f9a x:0 0 0 2024-04-18T21:07:00.952 INFO:tasks.workunit.client.0.smithi078.stdout:3/516: chown d4/d2d/d30/d35/l31 455 1 2024-04-18T21:07:00.952 INFO:tasks.workunit.client.0.smithi078.stdout:3/517: readlink d4/da/l99 0 2024-04-18T21:07:00.953 INFO:tasks.workunit.client.0.smithi078.stdout:3/518: stat d4/d2d/d30/d35/d4b/d59/f87 0 2024-04-18T21:07:00.953 INFO:tasks.workunit.client.0.smithi078.stdout:3/519: mknod d4/d2d/d6c/c9b 0 2024-04-18T21:07:00.954 INFO:tasks.workunit.client.0.smithi078.stdout:6/530: dwrite d2/d1f/f50 [0,4194304] 0 2024-04-18T21:07:00.954 INFO:tasks.workunit.client.0.smithi078.stdout:1/621: dread d0/d2a/d2f/d9b/fb8 [0,4194304] 0 2024-04-18T21:07:00.955 INFO:tasks.workunit.client.0.smithi078.stdout:7/592: truncate d1/f80 825863 0 2024-04-18T21:07:00.955 INFO:tasks.workunit.client.0.smithi078.stdout:6/531: symlink d2/d6/dd/d4b/d5d/lb0 0 2024-04-18T21:07:00.955 INFO:tasks.workunit.client.0.smithi078.stdout:6/532: creat d2/d74/fb1 x:0 0 0 2024-04-18T21:07:00.956 INFO:tasks.workunit.client.0.smithi078.stdout:7/593: mknod d1/d16/d10/d5a/cca 0 2024-04-18T21:07:00.956 INFO:tasks.workunit.client.0.smithi078.stdout:6/533: chown d2/d1f/l76 20 1 2024-04-18T21:07:00.956 INFO:tasks.workunit.client.0.smithi078.stdout:7/594: write d1/d16/dc/f74 [183497,109483] 0 2024-04-18T21:07:00.959 INFO:tasks.workunit.client.0.smithi078.stdout:3/520: dread d4/da/d11/f22 [0,4194304] 0 2024-04-18T21:07:00.960 INFO:tasks.workunit.client.0.smithi078.stdout:3/521: fsync d4/d2d/d30/d35/d4b/f65 0 2024-04-18T21:07:00.961 INFO:tasks.workunit.client.0.smithi078.stdout:6/534: write d2/d1c/d63/f81 [1142406,122426] 0 2024-04-18T21:07:00.962 INFO:tasks.workunit.client.0.smithi078.stdout:6/535: creat d2/d1c/d30/fb2 x:0 0 0 2024-04-18T21:07:00.962 INFO:tasks.workunit.client.0.smithi078.stdout:3/522: link d4/f64 d4/d2d/d30/d35/d4b/f9c 0 2024-04-18T21:07:00.963 INFO:tasks.workunit.client.0.smithi078.stdout:7/595: dwrite d1/d16/dc/f1e [0,4194304] 0 2024-04-18T21:07:00.963 INFO:tasks.workunit.client.0.smithi078.stdout:1/622: dread d0/d2a/d5f/d89/d32/d35/f55 [0,4194304] 0 2024-04-18T21:07:00.966 INFO:tasks.workunit.client.0.smithi078.stdout:3/523: getdents d4/df 0 2024-04-18T21:07:00.969 INFO:tasks.workunit.client.0.smithi078.stdout:3/524: rmdir d4/da/d5e/d8f 0 2024-04-18T21:07:00.970 INFO:tasks.workunit.client.0.smithi078.stdout:5/598: dread d9/da/d90/f6f [0,4194304] 0 2024-04-18T21:07:00.970 INFO:tasks.workunit.client.0.smithi078.stdout:7/596: dwrite d1/d16/f46 [0,4194304] 0 2024-04-18T21:07:00.971 INFO:tasks.workunit.client.0.smithi078.stdout:6/536: dwrite d2/f3 [0,4194304] 0 2024-04-18T21:07:00.972 INFO:tasks.workunit.client.0.smithi078.stdout:7/597: fsync d1/d16/d10/d7c/d7e/fa9 0 2024-04-18T21:07:00.972 INFO:tasks.workunit.client.0.smithi078.stdout:5/599: fsync d9/da/d3e/d4c/d67/d8d/fb0 0 2024-04-18T21:07:00.972 INFO:tasks.workunit.client.0.smithi078.stdout:1/623: dwrite d0/d2a/d45/f5d [4194304,4194304] 0 2024-04-18T21:07:00.973 INFO:tasks.workunit.client.0.smithi078.stdout:5/600: chown d9/da/d3e/d4c/d6d/d75/l80 4494 1 2024-04-18T21:07:00.973 INFO:tasks.workunit.client.0.smithi078.stdout:1/624: fsync d0/d2a/d3c/d4b/d4/f28 0 2024-04-18T21:07:00.973 INFO:tasks.workunit.client.0.smithi078.stdout:3/525: link d4/d2d/d30/c82 d4/d2d/c9d 0 2024-04-18T21:07:00.974 INFO:tasks.workunit.client.0.smithi078.stdout:5/601: symlink d9/da/d8c/daf/lc7 0 2024-04-18T21:07:00.975 INFO:tasks.workunit.client.0.smithi078.stdout:7/598: creat d1/d16/d10/d7c/d7e/fcb x:0 0 0 2024-04-18T21:07:00.975 INFO:tasks.workunit.client.0.smithi078.stdout:1/625: symlink d0/dca/lce 0 2024-04-18T21:07:00.975 INFO:tasks.workunit.client.0.smithi078.stdout:3/526: creat d4/d2d/d30/d35/d71/f9e x:0 0 0 2024-04-18T21:07:00.976 INFO:tasks.workunit.client.0.smithi078.stdout:5/602: creat d9/d2e/fc8 x:0 0 0 2024-04-18T21:07:00.977 INFO:tasks.workunit.client.0.smithi078.stdout:1/626: write d0/d2a/d2f/f33 [508643,59969] 0 2024-04-18T21:07:00.977 INFO:tasks.workunit.client.0.smithi078.stdout:7/599: readlink d1/d16/d10/d7c/d7e/d97/l9f 0 2024-04-18T21:07:00.977 INFO:tasks.workunit.client.0.smithi078.stdout:1/627: rmdir d0 39 2024-04-18T21:07:00.977 INFO:tasks.workunit.client.0.smithi078.stdout:7/600: fdatasync d1/d16/d1c/fab 0 2024-04-18T21:07:00.978 INFO:tasks.workunit.client.0.smithi078.stdout:3/527: creat d4/d2d/d30/f9f x:0 0 0 2024-04-18T21:07:00.978 INFO:tasks.workunit.client.0.smithi078.stdout:1/628: chown d0/f3f 5 1 2024-04-18T21:07:00.978 INFO:tasks.workunit.client.0.smithi078.stdout:5/603: rename f8 to d9/da/d4b/d8b/fc9 0 2024-04-18T21:07:00.978 INFO:tasks.workunit.client.0.smithi078.stdout:5/604: readlink d9/l2a 0 2024-04-18T21:07:00.978 INFO:tasks.workunit.client.0.smithi078.stdout:6/537: dwrite d2/d6/dd/f42 [8388608,4194304] 0 2024-04-18T21:07:00.979 INFO:tasks.workunit.client.0.smithi078.stdout:3/528: mkdir d4/df/d17/d74/da0 0 2024-04-18T21:07:00.979 INFO:tasks.workunit.client.0.smithi078.stdout:1/629: rename d0/d2a/d3c/d4b/d4/c1a to d0/d11/ccf 0 2024-04-18T21:07:00.980 INFO:tasks.workunit.client.0.smithi078.stdout:7/601: creat d1/d16/dc/d11/d53/d82/da4/db5/d91/db0/fcc x:0 0 0 2024-04-18T21:07:00.981 INFO:tasks.workunit.client.0.smithi078.stdout:6/538: mkdir d2/d1c/db3 0 2024-04-18T21:07:00.981 INFO:tasks.workunit.client.0.smithi078.stdout:3/529: mkdir d4/da/d5e/da1 0 2024-04-18T21:07:00.981 INFO:tasks.workunit.client.0.smithi078.stdout:5/605: chown d9/da/d3e/d4c/d67/d7c/c6e 1021225 1 2024-04-18T21:07:00.981 INFO:tasks.workunit.client.0.smithi078.stdout:6/539: fdatasync d2/d1c/f53 0 2024-04-18T21:07:00.982 INFO:tasks.workunit.client.0.smithi078.stdout:1/630: write d0/d2a/d5f/f87 [884091,70229] 0 2024-04-18T21:07:00.982 INFO:tasks.workunit.client.0.smithi078.stdout:5/606: chown d9/f64 91800508 1 2024-04-18T21:07:00.983 INFO:tasks.workunit.client.0.smithi078.stdout:3/530: symlink d4/df/d17/la2 0 2024-04-18T21:07:00.983 INFO:tasks.workunit.client.0.smithi078.stdout:7/602: write d1/d16/dc/d11/d53/f58 [1074923,128692] 0 2024-04-18T21:07:00.983 INFO:tasks.workunit.client.0.smithi078.stdout:5/607: dread - d9/d2e/fc8 zero size 2024-04-18T21:07:00.983 INFO:tasks.workunit.client.0.smithi078.stdout:7/603: unlink d1/d16/fc1 0 2024-04-18T21:07:00.983 INFO:tasks.workunit.client.0.smithi078.stdout:6/540: rename d2/d1c/d63/da0/faa to d2/d1c/d3a/fb4 0 2024-04-18T21:07:00.983 INFO:tasks.workunit.client.0.smithi078.stdout:3/531: truncate d4/d2d/d30/d35/f33 4747009 0 2024-04-18T21:07:00.984 INFO:tasks.workunit.client.0.smithi078.stdout:3/532: chown d4/d2d/d30/d35/c2f 110048388 1 2024-04-18T21:07:00.984 INFO:tasks.workunit.client.0.smithi078.stdout:6/541: getdents d2/d6 0 2024-04-18T21:07:00.985 INFO:tasks.workunit.client.0.smithi078.stdout:3/533: write d4/f13 [3313139,81282] 0 2024-04-18T21:07:00.985 INFO:tasks.workunit.client.0.smithi078.stdout:3/534: fdatasync d4/df/f98 0 2024-04-18T21:07:00.986 INFO:tasks.workunit.client.0.smithi078.stdout:5/608: creat d9/da/d3e/d4c/d67/d8d/fca x:0 0 0 2024-04-18T21:07:00.986 INFO:tasks.workunit.client.0.smithi078.stdout:3/535: fsync d4/df/f98 0 2024-04-18T21:07:00.987 INFO:tasks.workunit.client.0.smithi078.stdout:7/604: dread d1/d16/d1c/fab [0,4194304] 0 2024-04-18T21:07:00.988 INFO:tasks.workunit.client.0.smithi078.stdout:7/605: fsync d1/d16/d10/d5a/fc2 0 2024-04-18T21:07:00.989 INFO:tasks.workunit.client.0.smithi078.stdout:3/536: link d4/df/d17/d41/l68 d4/df/d17/la3 0 2024-04-18T21:07:00.989 INFO:tasks.workunit.client.0.smithi078.stdout:1/631: dwrite d0/d2a/d3c/d4b/d4/f28 [0,4194304] 0 2024-04-18T21:07:00.990 INFO:tasks.workunit.client.0.smithi078.stdout:1/632: mkdir d0/d11/d69/dd0 0 2024-04-18T21:07:00.991 INFO:tasks.workunit.client.0.smithi078.stdout:1/633: getdents d0/dc1 0 2024-04-18T21:07:00.992 INFO:tasks.workunit.client.0.smithi078.stdout:1/634: mknod d0/dca/cd1 0 2024-04-18T21:07:00.992 INFO:tasks.workunit.client.0.smithi078.stdout:6/542: dwrite d2/d1c/d30/f9f [0,4194304] 0 2024-04-18T21:07:00.995 INFO:tasks.workunit.client.0.smithi078.stdout:3/537: dwrite d4/d2d/d30/f9f [0,4194304] 0 2024-04-18T21:07:00.996 INFO:tasks.workunit.client.0.smithi078.stdout:7/606: dwrite d1/d16/f77 [0,4194304] 0 2024-04-18T21:07:00.997 INFO:tasks.workunit.client.0.smithi078.stdout:6/543: rmdir d2/d34 39 2024-04-18T21:07:00.997 INFO:tasks.workunit.client.0.smithi078.stdout:3/538: creat d4/df/fa4 x:0 0 0 2024-04-18T21:07:00.997 INFO:tasks.workunit.client.0.smithi078.stdout:6/544: read d2/d6/dd/f42 [9732105,33108] 0 2024-04-18T21:07:00.999 INFO:tasks.workunit.client.0.smithi078.stdout:7/607: chown d1/d16/d10/d7c/d7e/fcb 3596 1 2024-04-18T21:07:00.999 INFO:tasks.workunit.client.0.smithi078.stdout:6/545: rename d2/d1c/d30/f93 to d2/d1c/d63/d8b/fb5 0 2024-04-18T21:07:01.001 INFO:tasks.workunit.client.0.smithi078.stdout:6/546: link d2/d1c/d63/d8b/fb5 d2/d1c/d67/d7f/fb6 0 2024-04-18T21:07:01.002 INFO:tasks.workunit.client.0.smithi078.stdout:1/635: write d0/d2a/d5f/d89/d32/db2/f9e [10016,105158] 0 2024-04-18T21:07:01.003 INFO:tasks.workunit.client.0.smithi078.stdout:6/547: mknod d2/d34/d35/d57/d90/cb7 0 2024-04-18T21:07:01.005 INFO:tasks.workunit.client.0.smithi078.stdout:1/636: symlink d0/d2a/d5f/d89/d32/d35/d85/ld2 0 2024-04-18T21:07:01.005 INFO:tasks.workunit.client.0.smithi078.stdout:6/548: rename d2/f9d to d2/d74/fb8 0 2024-04-18T21:07:01.005 INFO:tasks.workunit.client.0.smithi078.stdout:1/637: mkdir d0/dc1/dd3 0 2024-04-18T21:07:01.006 INFO:tasks.workunit.client.0.smithi078.stdout:7/608: dwrite d1/d16/d2d/f47 [0,4194304] 0 2024-04-18T21:07:01.006 INFO:tasks.workunit.client.0.smithi078.stdout:1/638: symlink d0/dc1/dd3/ld4 0 2024-04-18T21:07:01.006 INFO:tasks.workunit.client.0.smithi078.stdout:6/549: mkdir d2/d1c/d63/da1/db9 0 2024-04-18T21:07:01.007 INFO:tasks.workunit.client.0.smithi078.stdout:1/639: chown d0/d11/d69/l94 414 1 2024-04-18T21:07:01.007 INFO:tasks.workunit.client.0.smithi078.stdout:7/609: rmdir d1/d16/dc/d11/d53/d82/da4 39 2024-04-18T21:07:01.007 INFO:tasks.workunit.client.0.smithi078.stdout:1/640: symlink d0/d11/ld5 0 2024-04-18T21:07:01.008 INFO:tasks.workunit.client.0.smithi078.stdout:1/641: creat d0/d2a/d5f/d89/fd6 x:0 0 0 2024-04-18T21:07:01.008 INFO:tasks.workunit.client.0.smithi078.stdout:7/610: mkdir d1/d16/dc/d11/d53/d82/da4/db5/d91/dcd 0 2024-04-18T21:07:01.009 INFO:tasks.workunit.client.0.smithi078.stdout:1/642: write d0/d2a/d5f/d89/d32/d35/d71/fac [307994,116031] 0 2024-04-18T21:07:01.018 INFO:tasks.workunit.client.0.smithi078.stdout:1/643: dread d0/d2a/d45/f5c [0,4194304] 0 2024-04-18T21:07:01.019 INFO:tasks.workunit.client.0.smithi078.stdout:1/644: write d0/d11/f7f [1266810,101716] 0 2024-04-18T21:07:01.019 INFO:tasks.workunit.client.0.smithi078.stdout:1/645: write d0/f3f [2928996,35851] 0 2024-04-18T21:07:01.020 INFO:tasks.workunit.client.0.smithi078.stdout:1/646: write d0/d2a/d3c/d4b/d52/fc5 [964559,117567] 0 2024-04-18T21:07:01.021 INFO:tasks.workunit.client.0.smithi078.stdout:1/647: mkdir d0/d2a/d3c/d4b/d5e/dd7 0 2024-04-18T21:07:01.022 INFO:tasks.workunit.client.0.smithi078.stdout:1/648: write d0/d2a/d3c/d4b/d4/f3d [3913333,130157] 0 2024-04-18T21:07:01.022 INFO:tasks.workunit.client.0.smithi078.stdout:1/649: symlink d0/d2a/d5f/ld8 0 2024-04-18T21:07:01.023 INFO:tasks.workunit.client.0.smithi078.stdout:1/650: write d0/d2a/d2f/f9a [4613445,73870] 0 2024-04-18T21:07:01.023 INFO:tasks.workunit.client.0.smithi078.stdout:1/651: fdatasync d0/d2a/d3c/d4b/fcc 0 2024-04-18T21:07:01.024 INFO:tasks.workunit.client.0.smithi078.stdout:1/652: symlink d0/d2a/d3c/d4b/d4/ld9 0 2024-04-18T21:07:01.030 INFO:tasks.workunit.client.0.smithi078.stdout:1/653: dwrite d0/d2a/d5f/d89/dc2/f9d [0,4194304] 0 2024-04-18T21:07:01.031 INFO:tasks.workunit.client.0.smithi078.stdout:1/654: getdents d0/d11/d69/dd0 0 2024-04-18T21:07:01.032 INFO:tasks.workunit.client.0.smithi078.stdout:1/655: write d0/d2a/d45/f5d [1298187,121323] 0 2024-04-18T21:07:01.037 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:01.034+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:01.040 INFO:tasks.workunit.client.0.smithi078.stdout:1/656: read d0/d2a/d3c/f6b [3521867,119768] 0 2024-04-18T21:07:01.041 INFO:tasks.workunit.client.0.smithi078.stdout:1/657: write d0/d2a/d2f/d9b/fb8 [735495,2966] 0 2024-04-18T21:07:01.041 INFO:tasks.workunit.client.0.smithi078.stdout:1/658: dread - d0/d2a/d5f/d89/f3b zero size 2024-04-18T21:07:01.042 INFO:tasks.workunit.client.0.smithi078.stdout:1/659: mkdir d0/dda 0 2024-04-18T21:07:01.042 INFO:tasks.workunit.client.0.smithi078.stdout:1/660: fdatasync d0/d2a/d5f/d89/d32/d35/f55 0 2024-04-18T21:07:01.043 INFO:tasks.workunit.client.0.smithi078.stdout:1/661: rename d0/d2a/d5f/d89/d32/db2/la9 to d0/d2a/d2f/d50/d78/ldb 0 2024-04-18T21:07:01.044 INFO:tasks.workunit.client.0.smithi078.stdout:1/662: write d0/d2a/d5f/d89/d32/f92 [609364,43469] 0 2024-04-18T21:07:01.045 INFO:tasks.workunit.client.0.smithi078.stdout:1/663: creat d0/d2a/d2f/dc6/fdc x:0 0 0 2024-04-18T21:07:01.045 INFO:tasks.workunit.client.0.smithi078.stdout:1/664: fdatasync d0/d2a/d5f/d89/d32/db2/f7e 0 2024-04-18T21:07:01.046 INFO:tasks.workunit.client.0.smithi078.stdout:1/665: rename d0/d2a/d3c/d4b/d4/f28 to d0/dc1/fdd 0 2024-04-18T21:07:01.048 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:01.048 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:01.053 INFO:tasks.workunit.client.0.smithi078.stdout:1/666: dwrite d0/d2a/d3c/d4b/fb6 [0,4194304] 0 2024-04-18T21:07:01.053 INFO:tasks.workunit.client.0.smithi078.stdout:1/667: fdatasync d0/d2a/d5f/d89/d32/d35/d71/fae 0 2024-04-18T21:07:01.053 INFO:tasks.workunit.client.0.smithi078.stdout:1/668: unlink d0/d11/d69/l94 0 2024-04-18T21:07:01.054 INFO:tasks.workunit.client.0.smithi078.stdout:1/669: chown d0/d2a/d45/f5c 1755835 1 2024-04-18T21:07:01.054 INFO:tasks.workunit.client.0.smithi078.stdout:1/670: write d0/dc1/fad [619130,45695] 0 2024-04-18T21:07:01.056 INFO:tasks.workunit.client.0.smithi078.stdout:1/671: read d0/d2a/d3c/d4b/d4/f3d [7626417,32738] 0 2024-04-18T21:07:01.057 INFO:tasks.workunit.client.0.smithi078.stdout:1/672: unlink d0/dc1/fad 0 2024-04-18T21:07:01.057 INFO:tasks.workunit.client.0.smithi078.stdout:1/673: creat d0/d2a/d5f/d89/dc2/fde x:0 0 0 2024-04-18T21:07:01.058 INFO:tasks.workunit.client.0.smithi078.stdout:1/674: creat d0/d2a/d3c/d4b/d4/d61/fdf x:0 0 0 2024-04-18T21:07:01.059 INFO:tasks.workunit.client.0.smithi078.stdout:9/657: sync 2024-04-18T21:07:01.059 INFO:tasks.workunit.client.0.smithi078.stdout:4/692: sync 2024-04-18T21:07:01.059 INFO:tasks.workunit.client.0.smithi078.stdout:8/598: sync 2024-04-18T21:07:01.059 INFO:tasks.workunit.client.0.smithi078.stdout:2/567: sync 2024-04-18T21:07:01.059 INFO:tasks.workunit.client.0.smithi078.stdout:0/675: sync 2024-04-18T21:07:01.059 INFO:tasks.workunit.client.0.smithi078.stdout:2/568: readlink d0/d1f/l83 0 2024-04-18T21:07:01.059 INFO:tasks.workunit.client.0.smithi078.stdout:4/693: write d0/dc/f1d [2343272,109503] 0 2024-04-18T21:07:01.060 INFO:tasks.workunit.client.0.smithi078.stdout:8/599: chown d0/d10/d14/d2a/d4a/f56 206593 1 2024-04-18T21:07:01.060 INFO:tasks.workunit.client.0.smithi078.stdout:2/569: unlink d0/db/d18/d30/f77 0 2024-04-18T21:07:01.061 INFO:tasks.workunit.client.0.smithi078.stdout:9/658: rename d7/df/d1e/d7b/cc4 to d7/d11/d1b/dcd/cdd 0 2024-04-18T21:07:01.061 INFO:tasks.workunit.client.0.smithi078.stdout:8/600: write d0/d10/d14/f70 [1390,106594] 0 2024-04-18T21:07:01.061 INFO:tasks.workunit.client.0.smithi078.stdout:9/659: stat d7/d83/f91 0 2024-04-18T21:07:01.062 INFO:tasks.workunit.client.0.smithi078.stdout:9/660: stat d7/d11/d2d/c35 0 2024-04-18T21:07:01.062 INFO:tasks.workunit.client.0.smithi078.stdout:8/601: write d0/d10/d60/d6f/f7f [2112321,117519] 0 2024-04-18T21:07:01.063 INFO:tasks.workunit.client.0.smithi078.stdout:2/570: creat d0/d1f/d5b/fad x:0 0 0 2024-04-18T21:07:01.063 INFO:tasks.workunit.client.0.smithi078.stdout:9/661: rmdir d7/d11/d80 39 2024-04-18T21:07:01.064 INFO:tasks.workunit.client.0.smithi078.stdout:8/602: mkdir d0/d10/d14/d2a/d4a/db2/db6 0 2024-04-18T21:07:01.064 INFO:tasks.workunit.client.0.smithi078.stdout:9/662: chown d7/d23/d3e 39 1 2024-04-18T21:07:01.066 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:07:01.067 INFO:tasks.workunit.client.0.smithi078.stdout:8/603: rename d0/d5c/d5a/f6d to d0/d22/fb7 0 2024-04-18T21:07:01.067 INFO:tasks.workunit.client.0.smithi078.stdout:9/663: mkdir d7/d11/d2d/d3f/db7/dd7/dde 0 2024-04-18T21:07:01.067 INFO:tasks.workunit.client.0.smithi078.stdout:4/694: dwrite d0/dc/d10/d1c/d6a/d81/dd4/f8d [0,4194304] 0 2024-04-18T21:07:01.069 INFO:tasks.workunit.client.0.smithi078.stdout:1/675: dwrite d0/d2a/d5f/d89/d32/d35/f6d [0,4194304] 0 2024-04-18T21:07:01.071 INFO:tasks.workunit.client.0.smithi078.stdout:2/571: truncate d0/db/d18/d21/d27/d29/d33/f6a 707259 0 2024-04-18T21:07:01.071 INFO:tasks.workunit.client.0.smithi078.stdout:9/664: symlink d7/df/d54/d95/d9d/ldf 0 2024-04-18T21:07:01.071 INFO:tasks.workunit.client.0.smithi078.stdout:1/676: mknod d0/d11/d69/ce0 0 2024-04-18T21:07:01.072 INFO:tasks.workunit.client.0.smithi078.stdout:8/604: write d0/d10/d14/d2a/d4a/f75 [2657126,85540] 0 2024-04-18T21:07:01.072 INFO:tasks.workunit.client.0.smithi078.stdout:9/665: fsync d7/d11/d2d/fd6 0 2024-04-18T21:07:01.072 INFO:tasks.workunit.client.0.smithi078.stdout:1/677: mkdir d0/d2a/d3c/da8/de1 0 2024-04-18T21:07:01.073 INFO:tasks.workunit.client.0.smithi078.stdout:8/605: write d0/d10/d60/d6f/f7a [1431483,62920] 0 2024-04-18T21:07:01.073 INFO:tasks.workunit.client.0.smithi078.stdout:1/678: fdatasync d0/d2a/d3c/d4b/d4/f3d 0 2024-04-18T21:07:01.073 INFO:tasks.workunit.client.0.smithi078.stdout:8/606: stat d0/d10/d8d 0 2024-04-18T21:07:01.074 INFO:tasks.workunit.client.0.smithi078.stdout:8/607: creat d0/d22/fb8 x:0 0 0 2024-04-18T21:07:01.074 INFO:tasks.workunit.client.0.smithi078.stdout:1/679: creat d0/d2a/d3c/d4b/d4/fe2 x:0 0 0 2024-04-18T21:07:01.078 INFO:tasks.workunit.client.0.smithi078.stdout:9/666: dwrite d7/d11/d2d/d3f/f8c [4194304,4194304] 0 2024-04-18T21:07:01.080 INFO:tasks.workunit.client.0.smithi078.stdout:9/667: write d7/d11/d1b/d45/d4b/d5d/f8d [363417,77448] 0 2024-04-18T21:07:01.081 INFO:tasks.workunit.client.0.smithi078.stdout:1/680: dread d0/d2a/d5f/d89/d32/d35/d71/fac [0,4194304] 0 2024-04-18T21:07:01.082 INFO:tasks.workunit.client.0.smithi078.stdout:9/668: creat d7/d23/d3e/d5a/da8/db0/fe0 x:0 0 0 2024-04-18T21:07:01.082 INFO:tasks.workunit.client.0.smithi078.stdout:8/608: dwrite d0/d5c/fa4 [0,4194304] 0 2024-04-18T21:07:01.083 INFO:tasks.workunit.client.0.smithi078.stdout:8/609: chown d0/d10/d14/d2d/f3f 3319885 1 2024-04-18T21:07:01.083 INFO:tasks.workunit.client.0.smithi078.stdout:9/669: mkdir d7/df/d88/dce/de1 0 2024-04-18T21:07:01.083 INFO:tasks.workunit.client.0.smithi078.stdout:8/610: chown d0/d5c/d5a/d7b 7720 1 2024-04-18T21:07:01.084 INFO:tasks.workunit.client.0.smithi078.stdout:8/611: dread - d0/d10/d14/f9a zero size 2024-04-18T21:07:01.085 INFO:tasks.workunit.client.0.smithi078.stdout:8/612: write d0/d10/d14/d2d/d93/fad [489155,60281] 0 2024-04-18T21:07:01.086 INFO:tasks.workunit.client.0.smithi078.stdout:8/613: mkdir d0/d10/d14/d2d/d93/da0/db5/db9 0 2024-04-18T21:07:01.086 INFO:tasks.workunit.client.0.smithi078.stdout:8/614: write d0/d10/f92 [71258,73661] 0 2024-04-18T21:07:01.087 INFO:tasks.workunit.client.0.smithi078.stdout:8/615: mkdir d0/d10/d60/d6f/dba 0 2024-04-18T21:07:01.088 INFO:tasks.workunit.client.0.smithi078.stdout:8/616: truncate d0/d10/d14/d2a/f8e 4477403 0 2024-04-18T21:07:01.093 INFO:tasks.workunit.client.0.smithi078.stdout:0/676: dread d0/f8 [0,4194304] 0 2024-04-18T21:07:01.095 INFO:tasks.workunit.client.0.smithi078.stdout:0/677: write d0/d9/d4c/d8f/dc5/fc9 [121480,52886] 0 2024-04-18T21:07:01.095 INFO:tasks.workunit.client.0.smithi078.stdout:8/617: dwrite d0/d10/d60/d6f/fb0 [0,4194304] 0 2024-04-18T21:07:01.096 INFO:tasks.workunit.client.0.smithi078.stdout:8/618: write d0/d10/fa3 [1092680,101656] 0 2024-04-18T21:07:01.096 INFO:tasks.workunit.client.0.smithi078.stdout:0/678: mkdir d0/d9/d4c/d6b/dd3 0 2024-04-18T21:07:01.096 INFO:tasks.workunit.client.0.smithi078.stdout:0/679: read - d0/d9/d58/f63 zero size 2024-04-18T21:07:01.097 INFO:tasks.workunit.client.0.smithi078.stdout:8/619: mknod d0/d10/d14/d2a/cbb 0 2024-04-18T21:07:01.097 INFO:tasks.workunit.client.0.smithi078.stdout:0/680: readlink d0/d9/da/db/lc 0 2024-04-18T21:07:01.098 INFO:tasks.workunit.client.0.smithi078.stdout:0/681: creat d0/d15/fd4 x:0 0 0 2024-04-18T21:07:01.098 INFO:tasks.workunit.client.0.smithi078.stdout:8/620: rename d0/d10/d14/d2a/f68 to d0/d5c/d5a/fbc 0 2024-04-18T21:07:01.099 INFO:tasks.workunit.client.0.smithi078.stdout:8/621: fsync d0/d10/d14/d2d/d93/da0/fab 0 2024-04-18T21:07:01.100 INFO:tasks.workunit.client.0.smithi078.stdout:8/622: mkdir d0/d10/d14/d2a/dbd 0 2024-04-18T21:07:01.101 INFO:tasks.workunit.client.0.smithi078.stdout:8/623: link d0/d5c/fa4 d0/d10/d14/d2a/fbe 0 2024-04-18T21:07:01.102 INFO:tasks.workunit.client.0.smithi078.stdout:8/624: dread - d0/d10/d8d/faa zero size 2024-04-18T21:07:01.103 INFO:tasks.workunit.client.0.smithi078.stdout:8/625: rename d0/d5c/f74 to d0/d5c/d5a/d7b/fbf 0 2024-04-18T21:07:01.104 INFO:tasks.workunit.client.0.smithi078.stdout:8/626: dread - d0/d22/fb8 zero size 2024-04-18T21:07:01.104 INFO:tasks.workunit.client.0.smithi078.stdout:0/682: dwrite d0/d9/da/db/d35/f20 [0,4194304] 0 2024-04-18T21:07:01.106 INFO:tasks.workunit.client.0.smithi078.stdout:8/627: mkdir d0/d10/d9d/dc0 0 2024-04-18T21:07:01.106 INFO:tasks.workunit.client.0.smithi078.stdout:0/683: creat d0/d9/da/db/d35/d3f/dae/fd5 x:0 0 0 2024-04-18T21:07:01.107 INFO:tasks.workunit.client.0.smithi078.stdout:8/628: creat d0/d5c/d5a/fc1 x:0 0 0 2024-04-18T21:07:01.107 INFO:tasks.workunit.client.0.smithi078.stdout:8/629: mkdir d0/d10/d14/d2d/d93/da0/dc2 0 2024-04-18T21:07:01.108 INFO:tasks.workunit.client.0.smithi078.stdout:8/630: write d0/d10/d60/d6f/fb0 [3062239,9888] 0 2024-04-18T21:07:01.109 INFO:tasks.workunit.client.0.smithi078.stdout:8/631: fdatasync d0/f45 0 2024-04-18T21:07:01.120 INFO:tasks.workunit.client.0.smithi078.stdout:1/681: dread d0/f3f [0,4194304] 0 2024-04-18T21:07:01.120 INFO:tasks.workunit.client.0.smithi078.stdout:1/682: symlink d0/d2a/d2f/d9b/le3 0 2024-04-18T21:07:01.121 INFO:tasks.workunit.client.0.smithi078.stdout:1/683: truncate d0/d2a/d2f/dc6/fc7 903823 0 2024-04-18T21:07:01.122 INFO:tasks.workunit.client.0.smithi078.stdout:6/550: sync 2024-04-18T21:07:01.123 INFO:tasks.workunit.client.0.smithi078.stdout:3/539: sync 2024-04-18T21:07:01.123 INFO:tasks.workunit.client.0.smithi078.stdout:5/609: sync 2024-04-18T21:07:01.123 INFO:tasks.workunit.client.0.smithi078.stdout:9/670: dread d7/d11/d1b/d45/d4b/d5d/fa4 [0,4194304] 0 2024-04-18T21:07:01.123 INFO:tasks.workunit.client.0.smithi078.stdout:6/551: mkdir d2/d1c/d6b/dba 0 2024-04-18T21:07:01.123 INFO:tasks.workunit.client.0.smithi078.stdout:3/540: dread - d4/da/d11/f97 zero size 2024-04-18T21:07:01.124 INFO:tasks.workunit.client.0.smithi078.stdout:5/610: chown d9/f3c 664797253 1 2024-04-18T21:07:01.124 INFO:tasks.workunit.client.0.smithi078.stdout:9/671: mkdir d7/df/d1e/de2 0 2024-04-18T21:07:01.125 INFO:tasks.workunit.client.0.smithi078.stdout:8/632: dread d0/d10/d14/f29 [4194304,4194304] 0 2024-04-18T21:07:01.126 INFO:tasks.workunit.client.0.smithi078.stdout:9/672: symlink d7/d11/d2d/d3f/db7/dd7/dde/le3 0 2024-04-18T21:07:01.127 INFO:tasks.workunit.client.0.smithi078.stdout:8/633: write d0/d10/d14/d2d/d93/fad [529713,91655] 0 2024-04-18T21:07:01.128 INFO:tasks.workunit.client.0.smithi078.stdout:9/673: write d7/d83/fcc [375772,19486] 0 2024-04-18T21:07:01.129 INFO:tasks.workunit.client.0.smithi078.stdout:3/541: dread d4/da/d11/f21 [4194304,4194304] 0 2024-04-18T21:07:01.129 INFO:tasks.workunit.client.0.smithi078.stdout:1/684: dwrite d0/d2a/d5f/d89/f3b [0,4194304] 0 2024-04-18T21:07:01.131 INFO:tasks.workunit.client.0.smithi078.stdout:9/674: creat d7/df/d54/d95/fe4 x:0 0 0 2024-04-18T21:07:01.131 INFO:tasks.workunit.client.0.smithi078.stdout:6/552: dwrite d2/d34/fa5 [0,4194304] 0 2024-04-18T21:07:01.133 INFO:tasks.workunit.client.0.smithi078.stdout:6/553: write d2/d6/dd/d4b/d5d/f6a [4688701,55853] 0 2024-04-18T21:07:01.133 INFO:tasks.workunit.client.0.smithi078.stdout:1/685: creat d0/d2a/d5f/fe4 x:0 0 0 2024-04-18T21:07:01.133 INFO:tasks.workunit.client.0.smithi078.stdout:6/554: read - d2/d6/dd/f95 zero size 2024-04-18T21:07:01.134 INFO:tasks.workunit.client.0.smithi078.stdout:3/542: mknod d4/d2d/d30/d35/d4b/d59/ca5 0 2024-04-18T21:07:01.134 INFO:tasks.workunit.client.0.smithi078.stdout:1/686: readlink d0/d2a/d5f/d89/d32/db2/lbb 0 2024-04-18T21:07:01.135 INFO:tasks.workunit.client.0.smithi078.stdout:6/555: mkdir d2/d1c/db3/dbb 0 2024-04-18T21:07:01.135 INFO:tasks.workunit.client.0.smithi078.stdout:9/675: getdents d7/df/d1e/d7b 0 2024-04-18T21:07:01.136 INFO:tasks.workunit.client.0.smithi078.stdout:3/543: getdents d4/d2d/d30 0 2024-04-18T21:07:01.136 INFO:tasks.workunit.client.0.smithi078.stdout:6/556: mknod d2/d1c/d6b/dba/cbc 0 2024-04-18T21:07:01.136 INFO:tasks.workunit.client.0.smithi078.stdout:9/676: mkdir d7/d11/d2d/d26/d7c/dda/de5 0 2024-04-18T21:07:01.137 INFO:tasks.workunit.client.0.smithi078.stdout:3/544: rmdir d4/da/d5e/da1 0 2024-04-18T21:07:01.137 INFO:tasks.workunit.client.0.smithi078.stdout:6/557: write d2/d34/d35/f80 [10491513,90816] 0 2024-04-18T21:07:01.138 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:01.134+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:01.138 INFO:tasks.workunit.client.0.smithi078.stdout:3/545: fsync d4/da/d11/f3c 0 2024-04-18T21:07:01.138 INFO:tasks.workunit.client.0.smithi078.stdout:6/558: mknod d2/d6/cbd 0 2024-04-18T21:07:01.139 INFO:tasks.workunit.client.0.smithi078.stdout:9/677: link d7/d11/d1b/d45/d4b/d5d/f60 d7/d11/d2d/d3f/d4d/dd5/fe6 0 2024-04-18T21:07:01.139 INFO:tasks.workunit.client.0.smithi078.stdout:9/678: chown d7/d11/d1b 37442 1 2024-04-18T21:07:01.140 INFO:tasks.workunit.client.0.smithi078.stdout:3/546: symlink d4/df/d17/d74/la6 0 2024-04-18T21:07:01.140 INFO:tasks.workunit.client.0.smithi078.stdout:1/687: dwrite d0/d2a/d5f/d89/d32/d35/d71/fae [0,4194304] 0 2024-04-18T21:07:01.140 INFO:tasks.workunit.client.0.smithi078.stdout:9/679: read d7/f59 [618544,70471] 0 2024-04-18T21:07:01.143 INFO:tasks.workunit.client.0.smithi078.stdout:1/688: creat d0/d2a/d3c/d4b/d52/fe5 x:0 0 0 2024-04-18T21:07:01.144 INFO:tasks.workunit.client.0.smithi078.stdout:1/689: getdents d0/dc1 0 2024-04-18T21:07:01.146 INFO:tasks.workunit.client.0.smithi078.stdout:1/690: mknod d0/d2a/d5f/d89/d32/db2/db9/ce6 0 2024-04-18T21:07:01.146 INFO:tasks.workunit.client.0.smithi078.stdout:3/547: getdents d4/da/d5e 0 2024-04-18T21:07:01.146 INFO:tasks.workunit.client.0.smithi078.stdout:9/680: dwrite d7/d11/d2d/d3f/d4d/fa7 [0,4194304] 0 2024-04-18T21:07:01.147 INFO:tasks.workunit.client.0.smithi078.stdout:3/548: fdatasync d4/d2d/d30/d35/f33 0 2024-04-18T21:07:01.147 INFO:tasks.workunit.client.0.smithi078.stdout:9/681: stat d7/d11/d1b/d45/d4b/d5d/f8d 0 2024-04-18T21:07:01.148 INFO:tasks.workunit.client.0.smithi078.stdout:1/691: rename d0/d2a/d3c/d4b/d5e to d0/de7 0 2024-04-18T21:07:01.148 INFO:tasks.workunit.client.0.smithi078.stdout:3/549: write d4/d2d/d30/d35/d4b/d59/f87 [1016984,64685] 0 2024-04-18T21:07:01.149 INFO:tasks.workunit.client.0.smithi078.stdout:3/550: stat d4/da/d76/f96 0 2024-04-18T21:07:01.149 INFO:tasks.workunit.client.0.smithi078.stdout:1/692: write d0/d2a/d5f/d89/d32/d35/fab [169435,30327] 0 2024-04-18T21:07:01.149 INFO:tasks.workunit.client.0.smithi078.stdout:3/551: chown d4/da/d5e/f8a 4040 1 2024-04-18T21:07:01.151 INFO:tasks.workunit.client.0.smithi078.stdout:6/559: truncate d2/d6/dd/f42 8007732 0 2024-04-18T21:07:01.151 INFO:tasks.workunit.client.0.smithi078.stdout:5/611: dread d9/f44 [0,4194304] 0 2024-04-18T21:07:01.151 INFO:tasks.workunit.client.0.smithi078.stdout:1/693: rename d0/d2a/d2f/d50/c7b to d0/d2a/d5f/ce8 0 2024-04-18T21:07:01.152 INFO:tasks.workunit.client.0.smithi078.stdout:5/612: symlink d9/da/d8c/daf/lcb 0 2024-04-18T21:07:01.152 INFO:tasks.workunit.client.0.smithi078.stdout:1/694: rmdir d0/d2a/d5f/d89/d32/d35/d85 39 2024-04-18T21:07:01.153 INFO:tasks.workunit.client.0.smithi078.stdout:5/613: fsync d9/da/d3e/d4c/d67/d7c/d78/fbb 0 2024-04-18T21:07:01.154 INFO:tasks.workunit.client.0.smithi078.stdout:1/695: symlink d0/d2a/d3c/d4b/d4/le9 0 2024-04-18T21:07:01.154 INFO:tasks.workunit.client.0.smithi078.stdout:5/614: rmdir d9/da/d3e/d4c/d6d/d73 39 2024-04-18T21:07:01.155 INFO:tasks.workunit.client.0.smithi078.stdout:9/682: dwrite d7/d23/d3e/d5a/f5e [0,4194304] 0 2024-04-18T21:07:01.156 INFO:tasks.workunit.client.0.smithi078.stdout:1/696: truncate d0/d2a/d3c/d4b/fcc 712 0 2024-04-18T21:07:01.156 INFO:tasks.workunit.client.0.smithi078.stdout:9/683: creat d7/df/d88/dce/fe7 x:0 0 0 2024-04-18T21:07:01.156 INFO:tasks.workunit.client.0.smithi078.stdout:3/552: dwrite d4/da/d11/f3c [4194304,4194304] 0 2024-04-18T21:07:01.157 INFO:tasks.workunit.client.0.smithi078.stdout:9/684: stat d7/d11/d1b/d45/d4b/f56 0 2024-04-18T21:07:01.157 INFO:tasks.workunit.client.0.smithi078.stdout:1/697: mkdir d0/d2a/d45/d81/dea 0 2024-04-18T21:07:01.157 INFO:tasks.workunit.client.0.smithi078.stdout:3/553: readlink d4/df/d17/d41/l6f 0 2024-04-18T21:07:01.157 INFO:tasks.workunit.client.0.smithi078.stdout:1/698: chown d0/d2a/f62 22675 1 2024-04-18T21:07:01.157 INFO:tasks.workunit.client.0.smithi078.stdout:9/685: dread - d7/d11/d1b/d77/fb9 zero size 2024-04-18T21:07:01.158 INFO:tasks.workunit.client.0.smithi078.stdout:3/554: write d4/da/f92 [749864,97352] 0 2024-04-18T21:07:01.158 INFO:tasks.workunit.client.0.smithi078.stdout:9/686: mkdir d7/df/de8 0 2024-04-18T21:07:01.158 INFO:tasks.workunit.client.0.smithi078.stdout:1/699: symlink d0/d2a/d5f/d89/d32/d35/d71/leb 0 2024-04-18T21:07:01.159 INFO:tasks.workunit.client.0.smithi078.stdout:9/687: creat d7/df/fe9 x:0 0 0 2024-04-18T21:07:01.159 INFO:tasks.workunit.client.0.smithi078.stdout:9/688: fdatasync d7/df/d1e/fd4 0 2024-04-18T21:07:01.160 INFO:tasks.workunit.client.0.smithi078.stdout:9/689: write d7/d11/d2d/fd6 [138870,21501] 0 2024-04-18T21:07:01.162 INFO:tasks.workunit.client.0.smithi078.stdout:9/690: read d7/df/d1e/f7e [506018,68417] 0 2024-04-18T21:07:01.162 INFO:tasks.workunit.client.0.smithi078.stdout:9/691: chown d7/d11/d47/fc2 992842796 1 2024-04-18T21:07:01.163 INFO:tasks.workunit.client.0.smithi078.stdout:3/555: dread d4/d2d/d30/d35/d4b/d59/f87 [0,4194304] 0 2024-04-18T21:07:01.163 INFO:tasks.workunit.client.0.smithi078.stdout:9/692: write d7/d11/d2d/d26/fb3 [172387,77550] 0 2024-04-18T21:07:01.164 INFO:tasks.workunit.client.0.smithi078.stdout:4/695: sync 2024-04-18T21:07:01.164 INFO:tasks.workunit.client.0.smithi078.stdout:0/684: sync 2024-04-18T21:07:01.164 INFO:tasks.workunit.client.0.smithi078.stdout:7/611: sync 2024-04-18T21:07:01.164 INFO:tasks.workunit.client.0.smithi078.stdout:2/572: sync 2024-04-18T21:07:01.164 INFO:tasks.workunit.client.0.smithi078.stdout:6/560: sync 2024-04-18T21:07:01.165 INFO:tasks.workunit.client.0.smithi078.stdout:3/556: chown d4/da/d11/l63 6483 1 2024-04-18T21:07:01.165 INFO:tasks.workunit.client.0.smithi078.stdout:9/693: creat d7/d11/d1b/d77/fea x:0 0 0 2024-04-18T21:07:01.166 INFO:tasks.workunit.client.0.smithi078.stdout:6/561: write d2/d1c/d67/f72 [987558,95662] 0 2024-04-18T21:07:01.166 INFO:tasks.workunit.client.0.smithi078.stdout:1/700: dwrite d0/d2a/d5f/d89/d32/db2/f7e [0,4194304] 0 2024-04-18T21:07:01.166 INFO:tasks.workunit.client.0.smithi078.stdout:0/685: write d0/d9/da/db/d35/f5d [1688407,46999] 0 2024-04-18T21:07:01.166 INFO:tasks.workunit.client.0.smithi078.stdout:4/696: creat d0/dc/d29/d6d/ff1 x:0 0 0 2024-04-18T21:07:01.169 INFO:tasks.workunit.client.0.smithi078.stdout:6/562: rmdir d2/d1c/d63/da1 39 2024-04-18T21:07:01.169 INFO:tasks.workunit.client.0.smithi078.stdout:0/686: mknod d0/dc7/cd6 0 2024-04-18T21:07:01.170 INFO:tasks.workunit.client.0.smithi078.stdout:1/701: write d0/d2a/d5f/f83 [399478,121893] 0 2024-04-18T21:07:01.171 INFO:tasks.workunit.client.0.smithi078.stdout:6/563: chown d2/d1c/d67/f72 11042 1 2024-04-18T21:07:01.171 INFO:tasks.workunit.client.0.smithi078.stdout:7/612: mknod d1/d16/dc/d11/d53/d82/da4/db5/d91/cce 0 2024-04-18T21:07:01.171 INFO:tasks.workunit.client.0.smithi078.stdout:0/687: unlink d0/d9/d81/l96 0 2024-04-18T21:07:01.173 INFO:tasks.workunit.client.0.smithi078.stdout:0/688: stat d0/d9/d2f/l60 0 2024-04-18T21:07:01.173 INFO:tasks.workunit.client.0.smithi078.stdout:7/613: chown d1/d16/dc/f5b 27043 1 2024-04-18T21:07:01.174 INFO:tasks.workunit.client.0.smithi078.stdout:1/702: rename d0/d2a/d5f/f83 to d0/de7/dd7/fec 0 2024-04-18T21:07:01.174 INFO:tasks.workunit.client.0.smithi078.stdout:3/557: dwrite d4/d2d/d30/d35/d4b/d59/f9a [0,4194304] 0 2024-04-18T21:07:01.174 INFO:tasks.workunit.client.0.smithi078.stdout:2/573: dwrite d0/d1f/f2b [0,4194304] 0 2024-04-18T21:07:01.174 INFO:tasks.workunit.client.0.smithi078.stdout:7/614: mkdir d1/d16/d10/d7c/d94/dcf 0 2024-04-18T21:07:01.175 INFO:tasks.workunit.client.0.smithi078.stdout:3/558: mknod d4/df/d62/ca7 0 2024-04-18T21:07:01.176 INFO:tasks.workunit.client.0.smithi078.stdout:1/703: creat d0/d2a/d2f/d50/d78/fed x:0 0 0 2024-04-18T21:07:01.176 INFO:tasks.workunit.client.0.smithi078.stdout:2/574: fdatasync d0/db/d18/d21/d27/d29/fa0 0 2024-04-18T21:07:01.176 INFO:tasks.workunit.client.0.smithi078.stdout:0/689: rename d0/d9/c67 to d0/d9/d4c/d6b/d9b/cd7 0 2024-04-18T21:07:01.177 INFO:tasks.workunit.client.0.smithi078.stdout:1/704: rename d0/d11/l47 to d0/dca/lee 0 2024-04-18T21:07:01.177 INFO:tasks.workunit.client.0.smithi078.stdout:3/559: unlink d4/l20 0 2024-04-18T21:07:01.178 INFO:tasks.workunit.client.0.smithi078.stdout:0/690: creat d0/d9/da/db/d35/d3f/dbe/dce/fd8 x:0 0 0 2024-04-18T21:07:01.178 INFO:tasks.workunit.client.0.smithi078.stdout:3/560: read - d4/df/d17/d74/f91 zero size 2024-04-18T21:07:01.179 INFO:tasks.workunit.client.0.smithi078.stdout:1/705: dread - d0/d2a/d2f/dc6/fdc zero size 2024-04-18T21:07:01.179 INFO:tasks.workunit.client.0.smithi078.stdout:2/575: rename d0/d1f/d34/f7b to d0/fae 0 2024-04-18T21:07:01.179 INFO:tasks.workunit.client.0.smithi078.stdout:3/561: fdatasync d4/df/d62/f7f 0 2024-04-18T21:07:01.181 INFO:tasks.workunit.client.0.smithi078.stdout:4/697: dwrite d0/dc/d10/d1c/f67 [0,4194304] 0 2024-04-18T21:07:01.181 INFO:tasks.workunit.client.0.smithi078.stdout:2/576: stat d0/db/d18/d21/d8b/f94 0 2024-04-18T21:07:01.181 INFO:tasks.workunit.client.0.smithi078.stdout:3/562: creat d4/df/d17/d41/fa8 x:0 0 0 2024-04-18T21:07:01.182 INFO:tasks.workunit.client.0.smithi078.stdout:1/706: link d0/d11/f2d d0/d2a/d5f/d89/d32/db2/fef 0 2024-04-18T21:07:01.182 INFO:tasks.workunit.client.0.smithi078.stdout:4/698: unlink d0/f48 0 2024-04-18T21:07:01.183 INFO:tasks.workunit.client.0.smithi078.stdout:0/691: write d0/d9/d7d/f88 [2370845,86048] 0 2024-04-18T21:07:01.183 INFO:tasks.workunit.client.0.smithi078.stdout:3/563: mknod d4/da/d11/d66/ca9 0 2024-04-18T21:07:01.185 INFO:tasks.workunit.client.0.smithi078.stdout:1/707: write d0/d2a/d2f/d50/fa6 [9073115,52336] 0 2024-04-18T21:07:01.185 INFO:tasks.workunit.client.0.smithi078.stdout:9/694: dread d7/f59 [0,4194304] 0 2024-04-18T21:07:01.186 INFO:tasks.workunit.client.0.smithi078.stdout:3/564: mknod d4/da/d57/caa 0 2024-04-18T21:07:01.187 INFO:tasks.workunit.client.0.smithi078.stdout:1/708: symlink d0/d11/lf0 0 2024-04-18T21:07:01.188 INFO:tasks.workunit.client.0.smithi078.stdout:0/692: creat d0/fd9 x:0 0 0 2024-04-18T21:07:01.188 INFO:tasks.workunit.client.0.smithi078.stdout:4/699: rename d0/dc/d29/d2f/l43 to d0/dc/d5b/d71/dcf/de1/lf2 0 2024-04-18T21:07:01.189 INFO:tasks.workunit.client.0.smithi078.stdout:1/709: chown d0/d2a/d45/f76 227 1 2024-04-18T21:07:01.189 INFO:tasks.workunit.client.0.smithi078.stdout:5/615: sync 2024-04-18T21:07:01.190 INFO:tasks.workunit.client.0.smithi078.stdout:8/634: sync 2024-04-18T21:07:01.190 INFO:tasks.workunit.client.0.smithi078.stdout:7/615: sync 2024-04-18T21:07:01.190 INFO:tasks.workunit.client.0.smithi078.stdout:6/564: dread d2/d1f/f2e [0,4194304] 0 2024-04-18T21:07:01.192 INFO:tasks.workunit.client.0.smithi078.stdout:7/616: stat d1/d16/dc/d11/d53/d82/da4/db5/d91/db0 0 2024-04-18T21:07:01.192 INFO:tasks.workunit.client.0.smithi078.stdout:4/700: rename d0/dc/d29/d2f/da7 to d0/dc/d10/d1c/d60/dee/dc4/df3 0 2024-04-18T21:07:01.192 INFO:tasks.workunit.client.0.smithi078.stdout:6/565: rmdir d2/d1c/d67 39 2024-04-18T21:07:01.192 INFO:tasks.workunit.client.0.smithi078.stdout:0/693: getdents d0/d9/d2f 0 2024-04-18T21:07:01.193 INFO:tasks.workunit.client.0.smithi078.stdout:7/617: dread - d1/d16/dc/f55 zero size 2024-04-18T21:07:01.193 INFO:tasks.workunit.client.0.smithi078.stdout:9/695: dwrite d7/d11/d1b/d77/fb9 [0,4194304] 0 2024-04-18T21:07:01.194 INFO:tasks.workunit.client.0.smithi078.stdout:6/566: fsync d2/d1c/d67/f72 0 2024-04-18T21:07:01.195 INFO:tasks.workunit.client.0.smithi078.stdout:4/701: read - d0/dc/d10/d1c/d60/dee/dc4/df3/fe5 zero size 2024-04-18T21:07:01.195 INFO:tasks.workunit.client.0.smithi078.stdout:8/635: write d0/d22/fb7 [90536,43581] 0 2024-04-18T21:07:01.196 INFO:tasks.workunit.client.0.smithi078.stdout:7/618: symlink d1/d16/d10/d7c/d7e/d97/ld0 0 2024-04-18T21:07:01.196 INFO:tasks.workunit.client.0.smithi078.stdout:6/567: chown d2/d1c/d63/d8b/cab 27 1 2024-04-18T21:07:01.197 INFO:tasks.workunit.client.0.smithi078.stdout:9/696: link d7/fbb d7/d11/d1b/d77/feb 0 2024-04-18T21:07:01.198 INFO:tasks.workunit.client.0.smithi078.stdout:6/568: write d2/d34/d35/d57/f71 [3827700,3784] 0 2024-04-18T21:07:01.198 INFO:tasks.workunit.client.0.smithi078.stdout:4/702: truncate d0/dc/d5b/d71/f56 672412 0 2024-04-18T21:07:01.199 INFO:tasks.workunit.client.0.smithi078.stdout:4/703: sync 2024-04-18T21:07:01.199 INFO:tasks.workunit.client.0.smithi078.stdout:2/577: dread d0/f32 [0,4194304] 0 2024-04-18T21:07:01.199 INFO:tasks.workunit.client.0.smithi078.stdout:1/710: dwrite d0/d2a/d3c/d4b/d4/d61/fdf [0,4194304] 0 2024-04-18T21:07:01.199 INFO:tasks.workunit.client.0.smithi078.stdout:9/697: creat d7/d11/d1b/d45/d74/fec x:0 0 0 2024-04-18T21:07:01.200 INFO:tasks.workunit.client.0.smithi078.stdout:3/565: read d4/d2d/d30/f60 [374536,94883] 0 2024-04-18T21:07:01.202 INFO:tasks.workunit.client.0.smithi078.stdout:4/704: rmdir d0 39 2024-04-18T21:07:01.202 INFO:tasks.workunit.client.0.smithi078.stdout:6/569: creat d2/d34/d35/fbe x:0 0 0 2024-04-18T21:07:01.203 INFO:tasks.workunit.client.0.smithi078.stdout:9/698: link d7/d11/d2d/d26/l7f d7/d23/d3e/d5a/da8/led 0 2024-04-18T21:07:01.203 INFO:tasks.workunit.client.0.smithi078.stdout:6/570: mkdir d2/dbf 0 2024-04-18T21:07:01.203 INFO:tasks.workunit.client.0.smithi078.stdout:5/616: dread d9/da/d4b/fa8 [0,4194304] 0 2024-04-18T21:07:01.203 INFO:tasks.workunit.client.0.smithi078.stdout:2/578: getdents d0/d1f/d34/d40 0 2024-04-18T21:07:01.204 INFO:tasks.workunit.client.0.smithi078.stdout:8/636: dwrite d0/d10/d14/d2a/d4a/f7d [4194304,4194304] 0 2024-04-18T21:07:01.204 INFO:tasks.workunit.client.0.smithi078.stdout:6/571: rmdir d2/d1f 39 2024-04-18T21:07:01.205 INFO:tasks.workunit.client.0.smithi078.stdout:9/699: fdatasync d7/d11/d1b/d77/feb 0 2024-04-18T21:07:01.205 INFO:tasks.workunit.client.0.smithi078.stdout:2/579: mknod d0/db/d18/d21/d27/d29/d4e/caf 0 2024-04-18T21:07:01.205 INFO:tasks.workunit.client.0.smithi078.stdout:5/617: creat d9/da/d3e/d4c/d6d/d86/fcc x:0 0 0 2024-04-18T21:07:01.205 INFO:tasks.workunit.client.0.smithi078.stdout:8/637: getdents d0/d5c/d5a 0 2024-04-18T21:07:01.206 INFO:tasks.workunit.client.0.smithi078.stdout:4/705: creat d0/dc/d10/d1c/d60/dee/dc4/ff4 x:0 0 0 2024-04-18T21:07:01.207 INFO:tasks.workunit.client.0.smithi078.stdout:9/700: write d7/d11/d47/fc2 [412132,82423] 0 2024-04-18T21:07:01.207 INFO:tasks.workunit.client.0.smithi078.stdout:6/572: symlink d2/d1c/db3/lc0 0 2024-04-18T21:07:01.207 INFO:tasks.workunit.client.0.smithi078.stdout:1/711: truncate d0/dc1/fdd 2170054 0 2024-04-18T21:07:01.207 INFO:tasks.workunit.client.0.smithi078.stdout:4/706: chown d0/dc/d37/ccd 60 1 2024-04-18T21:07:01.208 INFO:tasks.workunit.client.0.smithi078.stdout:8/638: chown d0/c66 1079481 1 2024-04-18T21:07:01.208 INFO:tasks.workunit.client.0.smithi078.stdout:5/618: fdatasync d9/da/d32/f70 0 2024-04-18T21:07:01.208 INFO:tasks.workunit.client.0.smithi078.stdout:2/580: rename d0/d1f/d34/d40 to d0/db/d18/d21/db0 0 2024-04-18T21:07:01.208 INFO:tasks.workunit.client.0.smithi078.stdout:9/701: chown d7/d11/d1b/dcd/cdd 315296 1 2024-04-18T21:07:01.208 INFO:tasks.workunit.client.0.smithi078.stdout:4/707: write d0/dc/fd2 [944863,92188] 0 2024-04-18T21:07:01.208 INFO:tasks.workunit.client.0.smithi078.stdout:1/712: symlink d0/d11/d69/dd0/lf1 0 2024-04-18T21:07:01.209 INFO:tasks.workunit.client.0.smithi078.stdout:8/639: creat d0/d10/d60/d6f/dba/fc3 x:0 0 0 2024-04-18T21:07:01.209 INFO:tasks.workunit.client.0.smithi078.stdout:6/573: link d2/d1f/f58 d2/d1c/d30/fc1 0 2024-04-18T21:07:01.209 INFO:tasks.workunit.client.0.smithi078.stdout:9/702: creat d7/df/d1e/fee x:0 0 0 2024-04-18T21:07:01.209 INFO:tasks.workunit.client.0.smithi078.stdout:2/581: creat d0/db/fb1 x:0 0 0 2024-04-18T21:07:01.210 INFO:tasks.workunit.client.0.smithi078.stdout:1/713: write d0/d2a/d3c/d4b/f3e [113348,117278] 0 2024-04-18T21:07:01.211 INFO:tasks.workunit.client.0.smithi078.stdout:4/708: creat d0/dc/d10/ff5 x:0 0 0 2024-04-18T21:07:01.211 INFO:tasks.workunit.client.0.smithi078.stdout:8/640: rmdir d0/d10/d14/d2a/d3c 39 2024-04-18T21:07:01.211 INFO:tasks.workunit.client.0.smithi078.stdout:6/574: write d2/ff [3879366,121435] 0 2024-04-18T21:07:01.211 INFO:tasks.workunit.client.0.smithi078.stdout:9/703: rmdir d7/d11/d80 39 2024-04-18T21:07:01.213 INFO:tasks.workunit.client.0.smithi078.stdout:6/575: write d2/d1c/d30/f9f [1958032,62616] 0 2024-04-18T21:07:01.213 INFO:tasks.workunit.client.0.smithi078.stdout:4/709: mknod d0/dc/d10/d1c/cf6 0 2024-04-18T21:07:01.213 INFO:tasks.workunit.client.0.smithi078.stdout:1/714: link d0/d2a/d2f/f9a d0/d2a/ff2 0 2024-04-18T21:07:01.214 INFO:tasks.workunit.client.0.smithi078.stdout:2/582: chown d0/db/d18/d21/db0/d59/l9c 0 1 2024-04-18T21:07:01.216 INFO:tasks.workunit.client.0.smithi078.stdout:2/583: chown d0/db/d18/d30/fab 3884274 1 2024-04-18T21:07:01.217 INFO:tasks.workunit.client.0.smithi078.stdout:3/566: dread d4/da/f92 [0,4194304] 0 2024-04-18T21:07:01.217 INFO:tasks.workunit.client.0.smithi078.stdout:5/619: dwrite d9/f77 [0,4194304] 0 2024-04-18T21:07:01.217 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:01.217 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:01.220 INFO:tasks.workunit.client.0.smithi078.stdout:3/567: chown d4/d2d/d30/d35/d4b/d59/ca5 13029 1 2024-04-18T21:07:01.221 INFO:tasks.workunit.client.0.smithi078.stdout:8/641: dwrite d0/d5c/d5a/f90 [0,4194304] 0 2024-04-18T21:07:01.223 INFO:tasks.workunit.client.0.smithi078.stdout:6/576: dwrite d2/d34/d35/d57/f71 [0,4194304] 0 2024-04-18T21:07:01.223 INFO:tasks.workunit.client.0.smithi078.stdout:3/568: creat d4/df/fab x:0 0 0 2024-04-18T21:07:01.223 INFO:tasks.workunit.client.0.smithi078.stdout:9/704: dwrite d7/df/f13 [4194304,4194304] 0 2024-04-18T21:07:01.223 INFO:tasks.workunit.client.0.smithi078.stdout:4/710: dread d0/dc/d5b/f6f [0,4194304] 0 2024-04-18T21:07:01.224 INFO:tasks.workunit.client.0.smithi078.stdout:8/642: mknod d0/d10/d14/d2d/d93/da0/db5/cc4 0 2024-04-18T21:07:01.224 INFO:tasks.workunit.client.0.smithi078.stdout:2/584: truncate d0/d1f/f7e 471250 0 2024-04-18T21:07:01.225 INFO:tasks.workunit.client.0.smithi078.stdout:1/715: dwrite d0/d2a/d5f/d89/dc2/f9d [0,4194304] 0 2024-04-18T21:07:01.225 INFO:tasks.workunit.client.0.smithi078.stdout:9/705: symlink d7/lef 0 2024-04-18T21:07:01.225 INFO:tasks.workunit.client.0.smithi078.stdout:6/577: mkdir d2/d6/dd/dc2 0 2024-04-18T21:07:01.225 INFO:tasks.workunit.client.0.smithi078.stdout:3/569: truncate d4/df/d62/f7f 128532 0 2024-04-18T21:07:01.226 INFO:tasks.workunit.client.0.smithi078.stdout:9/706: write d7/df/f8a [524487,18941] 0 2024-04-18T21:07:01.226 INFO:tasks.workunit.client.0.smithi078.stdout:3/570: fdatasync d4/da/d5e/f8a 0 2024-04-18T21:07:01.227 INFO:tasks.workunit.client.0.smithi078.stdout:4/711: symlink d0/d73/da9/lf7 0 2024-04-18T21:07:01.229 INFO:tasks.workunit.client.0.smithi078.stdout:2/585: mkdir d0/d87/d88/d98/db2 0 2024-04-18T21:07:01.231 INFO:tasks.workunit.client.0.smithi078.stdout:8/643: link d0/d22/fb8 d0/d10/d14/d2a/d4a/db2/fc5 0 2024-04-18T21:07:01.231 INFO:tasks.workunit.client.0.smithi078.stdout:9/707: mkdir d7/d11/df0 0 2024-04-18T21:07:01.231 INFO:tasks.workunit.client.0.smithi078.stdout:2/586: fsync d0/d87/f8a 0 2024-04-18T21:07:01.231 INFO:tasks.workunit.client.0.smithi078.stdout:1/716: write d0/d11/f2d [774732,12710] 0 2024-04-18T21:07:01.231 INFO:tasks.workunit.client.0.smithi078.stdout:9/708: chown d7/d23/c41 23869 1 2024-04-18T21:07:01.232 INFO:tasks.workunit.client.0.smithi078.stdout:9/709: chown d7/df/d54/lb8 4020 1 2024-04-18T21:07:01.232 INFO:tasks.workunit.client.0.smithi078.stdout:8/644: mkdir d0/d5c/d5a/dc6 0 2024-04-18T21:07:01.232 INFO:tasks.workunit.client.0.smithi078.stdout:1/717: chown d0/d2a/d5f/d89/d7d/l74 296 1 2024-04-18T21:07:01.232 INFO:tasks.workunit.client.0.smithi078.stdout:2/587: chown d0/db/d18/d21/d27/d29/f2d 102594 1 2024-04-18T21:07:01.232 INFO:tasks.workunit.client.0.smithi078.stdout:1/718: sync 2024-04-18T21:07:01.233 INFO:tasks.workunit.client.0.smithi078.stdout:4/712: rename d0/dc/l33 to d0/dc/d10/lf8 0 2024-04-18T21:07:01.233 INFO:tasks.workunit.client.0.smithi078.stdout:8/645: chown d0/c72 32963 1 2024-04-18T21:07:01.234 INFO:tasks.workunit.client.0.smithi078.stdout:9/710: rename d7/d23/f75 to d7/d23/d3e/d5a/dca/ff1 0 2024-04-18T21:07:01.234 INFO:tasks.workunit.client.0.smithi078.stdout:4/713: rmdir d0/dc/dd7 39 2024-04-18T21:07:01.235 INFO:tasks.workunit.client.0.smithi078.stdout:8/646: chown d0/d22/f95 802440 1 2024-04-18T21:07:01.235 INFO:tasks.workunit.client.0.smithi078.stdout:6/578: dwrite d2/fe [4194304,4194304] 0 2024-04-18T21:07:01.236 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:01.237 INFO:tasks.workunit.client.0.smithi078.stdout:8/647: write d0/d10/d14/d2d/f35 [1654383,110969] 0 2024-04-18T21:07:01.237 INFO:tasks.workunit.client.0.smithi078.stdout:3/571: dwrite d4/da/d11/f2c [0,4194304] 0 2024-04-18T21:07:01.238 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:01.238+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:01.238 INFO:tasks.workunit.client.0.smithi078.stdout:3/572: chown d4/df/d62/f7f 14 1 2024-04-18T21:07:01.240 INFO:tasks.workunit.client.0.smithi078.stdout:9/711: creat d7/d23/d3e/d5a/dca/ff2 x:0 0 0 2024-04-18T21:07:01.240 INFO:tasks.workunit.client.0.smithi078.stdout:3/573: chown d4/d2d/c61 127542 1 2024-04-18T21:07:01.240 INFO:tasks.workunit.client.0.smithi078.stdout:6/579: mknod d2/d1c/d63/da0/cc3 0 2024-04-18T21:07:01.241 INFO:tasks.workunit.client.0.smithi078.stdout:8/648: creat d0/d10/d9d/dc0/fc7 x:0 0 0 2024-04-18T21:07:01.241 INFO:tasks.workunit.client.0.smithi078.stdout:4/714: rmdir d0/dc/d10/d41/d5f 39 2024-04-18T21:07:01.242 INFO:tasks.workunit.client.0.smithi078.stdout:1/719: dwrite d0/d2a/f65 [0,4194304] 0 2024-04-18T21:07:01.242 INFO:tasks.workunit.client.0.smithi078.stdout:1/720: sync 2024-04-18T21:07:01.244 INFO:tasks.workunit.client.0.smithi078.stdout:8/649: symlink d0/lc8 0 2024-04-18T21:07:01.244 INFO:tasks.workunit.client.0.smithi078.stdout:2/588: dwrite d0/db/d18/d21/d27/d29/d4e/f71 [4194304,4194304] 0 2024-04-18T21:07:01.246 INFO:tasks.workunit.client.0.smithi078.stdout:1/721: unlink d0/d11/caa 0 2024-04-18T21:07:01.248 INFO:tasks.workunit.client.0.smithi078.stdout:2/589: link d0/db/d18/d21/d27/d29/d4e/f71 d0/da9/fb3 0 2024-04-18T21:07:01.249 INFO:tasks.workunit.client.0.smithi078.stdout:8/650: write d0/d5c/d5a/d7b/fbf [515868,95838] 0 2024-04-18T21:07:01.249 INFO:tasks.workunit.client.0.smithi078.stdout:4/715: dread d0/dc/d29/f7d [0,4194304] 0 2024-04-18T21:07:01.249 INFO:tasks.workunit.client.0.smithi078.stdout:3/574: dwrite d4/f64 [0,4194304] 0 2024-04-18T21:07:01.251 INFO:tasks.workunit.client.0.smithi078.stdout:6/580: dwrite d2/d1c/f9b [0,4194304] 0 2024-04-18T21:07:01.252 INFO:tasks.workunit.client.0.smithi078.stdout:6/581: write d2/d6/dd/d4b/d5d/f6a [3082795,59458] 0 2024-04-18T21:07:01.252 INFO:tasks.workunit.client.0.smithi078.stdout:6/582: readlink d2/d6/dd/l43 0 2024-04-18T21:07:01.252 INFO:tasks.workunit.client.0.smithi078.stdout:3/575: rename d4/da/d76/f77 to d4/df/d62/fac 0 2024-04-18T21:07:01.253 INFO:tasks.workunit.client.0.smithi078.stdout:6/583: write d2/d1c/d30/f9f [2270095,120683] 0 2024-04-18T21:07:01.253 INFO:tasks.workunit.client.0.smithi078.stdout:8/651: rename d0/d10/d14/d2a/f64 to d0/d10/d60/d6f/dba/fc9 0 2024-04-18T21:07:01.254 INFO:tasks.workunit.client.0.smithi078.stdout:3/576: truncate d4/da/d11/f22 1701504 0 2024-04-18T21:07:01.254 INFO:tasks.workunit.client.0.smithi078.stdout:6/584: symlink d2/d34/d75/lc4 0 2024-04-18T21:07:01.255 INFO:tasks.workunit.client.0.smithi078.stdout:8/652: truncate d0/d10/d14/f1e 177675 0 2024-04-18T21:07:01.257 INFO:tasks.workunit.client.0.smithi078.stdout:2/590: write d0/d1f/d34/f81 [694229,35420] 0 2024-04-18T21:07:01.257 INFO:tasks.workunit.client.0.smithi078.stdout:1/722: write d0/dc1/fdd [1428338,67930] 0 2024-04-18T21:07:01.258 INFO:tasks.workunit.client.0.smithi078.stdout:3/577: getdents d4/df/d17/d74/da0 0 2024-04-18T21:07:01.261 INFO:tasks.workunit.client.0.smithi078.stdout:2/591: creat d0/db/d18/d21/d27/d29/fb4 x:0 0 0 2024-04-18T21:07:01.264 INFO:tasks.workunit.client.0.smithi078.stdout:2/592: stat d0/db/d18/d21/db0/d59 0 2024-04-18T21:07:01.264 INFO:tasks.workunit.client.0.smithi078.stdout:6/585: dwrite d2/d1c/d63/f81 [0,4194304] 0 2024-04-18T21:07:01.265 INFO:tasks.workunit.client.0.smithi078.stdout:4/716: dwrite d0/dc/d10/d41/d5f/f98 [0,4194304] 0 2024-04-18T21:07:01.269 INFO:tasks.workunit.client.0.smithi078.stdout:6/586: mknod d2/d1c/d67/cc5 0 2024-04-18T21:07:01.269 INFO:tasks.workunit.client.0.smithi078.stdout:2/593: creat d0/db/d18/d5d/fb5 x:0 0 0 2024-04-18T21:07:01.270 INFO:tasks.workunit.client.0.smithi078.stdout:2/594: chown d0/d1f/d34/c4a 948928395 1 2024-04-18T21:07:01.270 INFO:tasks.workunit.client.0.smithi078.stdout:1/723: dwrite d0/d2a/d5f/d89/d32/d35/d85/fb0 [0,4194304] 0 2024-04-18T21:07:01.271 INFO:tasks.workunit.client.0.smithi078.stdout:2/595: creat d0/db/fb6 x:0 0 0 2024-04-18T21:07:01.272 INFO:tasks.workunit.client.0.smithi078.stdout:1/724: chown d0/d2a/d2f/d50/f59 0 1 2024-04-18T21:07:01.272 INFO:tasks.workunit.client.0.smithi078.stdout:2/596: fsync d0/f1d 0 2024-04-18T21:07:01.272 INFO:tasks.workunit.client.0.smithi078.stdout:4/717: write d0/dc/d10/d41/f45 [1004709,121014] 0 2024-04-18T21:07:01.273 INFO:tasks.workunit.client.0.smithi078.stdout:2/597: creat d0/d1f/d34/fb7 x:0 0 0 2024-04-18T21:07:01.274 INFO:tasks.workunit.client.0.smithi078.stdout:4/718: readlink d0/dc/d10/d41/ld5 0 2024-04-18T21:07:01.274 INFO:tasks.workunit.client.0.smithi078.stdout:4/719: write d0/d73/fe8 [791662,31878] 0 2024-04-18T21:07:01.274 INFO:tasks.workunit.client.0.smithi078.stdout:2/598: fsync d0/db/d18/d21/d27/f56 0 2024-04-18T21:07:01.275 INFO:tasks.workunit.client.0.smithi078.stdout:4/720: write d0/dc/d29/d6d/ff1 [209425,21286] 0 2024-04-18T21:07:01.276 INFO:tasks.workunit.client.0.smithi078.stdout:0/694: dread d0/d6c/f8a [0,4194304] 0 2024-04-18T21:07:01.276 INFO:tasks.workunit.client.0.smithi078.stdout:1/725: dread d0/d2a/d45/fa1 [0,4194304] 0 2024-04-18T21:07:01.277 INFO:tasks.workunit.client.0.smithi078.stdout:4/721: unlink d0/dc/d37/c3c 0 2024-04-18T21:07:01.277 INFO:tasks.workunit.client.0.smithi078.stdout:6/587: dwrite d2/d1c/d63/f8e [0,4194304] 0 2024-04-18T21:07:01.278 INFO:tasks.workunit.client.0.smithi078.stdout:0/695: chown d0/d9/da/db/d35/d3f/l5b 15078 1 2024-04-18T21:07:01.278 INFO:tasks.workunit.client.0.smithi078.stdout:1/726: creat d0/d2a/d3c/da8/ff3 x:0 0 0 2024-04-18T21:07:01.280 INFO:tasks.workunit.client.0.smithi078.stdout:6/588: link d2/ff d2/d1c/d30/fc6 0 2024-04-18T21:07:01.280 INFO:tasks.workunit.client.0.smithi078.stdout:4/722: rename d0/dc/d10/d41/d5f/cf0 to d0/dc/d10/db2/cf9 0 2024-04-18T21:07:01.282 INFO:tasks.workunit.client.0.smithi078.stdout:6/589: write d2/d6/dd/d4b/d5d/fa4 [2918041,126257] 0 2024-04-18T21:07:01.282 INFO:tasks.workunit.client.0.smithi078.stdout:7/619: dread d1/d16/d10/d5a/f76 [0,4194304] 0 2024-04-18T21:07:01.283 INFO:tasks.workunit.client.0.smithi078.stdout:6/590: write d2/d34/d35/f80 [4971155,109509] 0 2024-04-18T21:07:01.283 INFO:tasks.workunit.client.0.smithi078.stdout:7/620: readlink d1/d16/dc/d11/d53/d82/l83 0 2024-04-18T21:07:01.284 INFO:tasks.workunit.client.0.smithi078.stdout:7/621: fsync d1/d16/dc/f5b 0 2024-04-18T21:07:01.284 INFO:tasks.workunit.client.0.smithi078.stdout:6/591: mknod d2/d1c/d67/cc7 0 2024-04-18T21:07:01.285 INFO:tasks.workunit.client.0.smithi078.stdout:1/727: dwrite d0/de7/fc9 [0,4194304] 0 2024-04-18T21:07:01.286 INFO:tasks.workunit.client.0.smithi078.stdout:1/728: fsync d0/d2a/d3c/d4b/d4/f3d 0 2024-04-18T21:07:01.289 INFO:tasks.workunit.client.0.smithi078.stdout:8/653: dread d0/d10/d14/d2a/d4a/f75 [0,4194304] 0 2024-04-18T21:07:01.291 INFO:tasks.workunit.client.0.smithi078.stdout:7/622: dwrite d1/d16/dc/d11/f2b [0,4194304] 0 2024-04-18T21:07:01.292 INFO:tasks.workunit.client.0.smithi078.stdout:6/592: truncate d2/d34/d35/f80 185531 0 2024-04-18T21:07:01.293 INFO:tasks.workunit.client.0.smithi078.stdout:5/620: dread d9/da/d8c/fa6 [0,4194304] 0 2024-04-18T21:07:01.293 INFO:tasks.workunit.client.0.smithi078.stdout:6/593: creat d2/d1c/d6b/dba/fc8 x:0 0 0 2024-04-18T21:07:01.294 INFO:tasks.workunit.client.0.smithi078.stdout:5/621: chown d9/da/f35 916 1 2024-04-18T21:07:01.294 INFO:tasks.workunit.client.0.smithi078.stdout:5/622: chown d9/d2e/d65/f6a 337212326 1 2024-04-18T21:07:01.294 INFO:tasks.workunit.client.0.smithi078.stdout:5/623: fsync d9/da/f1b 0 2024-04-18T21:07:01.295 INFO:tasks.workunit.client.0.smithi078.stdout:5/624: chown d9/da/d3e/d4c/d6d/d75/lc4 6 1 2024-04-18T21:07:01.296 INFO:tasks.workunit.client.0.smithi078.stdout:4/723: dread d0/dc/f63 [0,4194304] 0 2024-04-18T21:07:01.296 INFO:tasks.workunit.client.0.smithi078.stdout:1/729: dread d0/d2a/d5f/d89/d32/fa7 [0,4194304] 0 2024-04-18T21:07:01.297 INFO:tasks.workunit.client.0.smithi078.stdout:5/625: read - d9/da/d3e/d4c/d6d/d75/dbc/fc5 zero size 2024-04-18T21:07:01.297 INFO:tasks.workunit.client.0.smithi078.stdout:5/626: symlink d9/d2e/d65/lcd 0 2024-04-18T21:07:01.299 INFO:tasks.workunit.client.0.smithi078.stdout:5/627: creat d9/da/d3e/d4c/d79/fce x:0 0 0 2024-04-18T21:07:01.299 INFO:tasks.workunit.client.0.smithi078.stdout:6/594: dwrite d2/d6/dd/f48 [0,4194304] 0 2024-04-18T21:07:01.300 INFO:tasks.workunit.client.0.smithi078.stdout:6/595: fsync d2/d1f/f2e 0 2024-04-18T21:07:01.304 INFO:tasks.workunit.client.0.smithi078.stdout:4/724: dwrite d0/dc/d10/d41/d5f/fa3 [0,4194304] 0 2024-04-18T21:07:01.305 INFO:tasks.workunit.client.0.smithi078.stdout:5/628: dwrite d9/da/d90/d62/f63 [4194304,4194304] 0 2024-04-18T21:07:01.307 INFO:tasks.workunit.client.0.smithi078.stdout:5/629: unlink d9/da/d3e/d4c/d67/d7c/c6e 0 2024-04-18T21:07:01.307 INFO:tasks.workunit.client.0.smithi078.stdout:6/596: dwrite d2/d1c/d63/f81 [0,4194304] 0 2024-04-18T21:07:01.309 INFO:tasks.workunit.client.0.smithi078.stdout:5/630: dread d9/f44 [0,4194304] 0 2024-04-18T21:07:01.311 INFO:tasks.workunit.client.0.smithi078.stdout:1/730: truncate d0/d2a/d3c/d4b/d4/d61/fdf 476236 0 2024-04-18T21:07:01.311 INFO:tasks.workunit.client.0.smithi078.stdout:4/725: dwrite d0/dc/d5b/d4f/f77 [0,4194304] 0 2024-04-18T21:07:01.312 INFO:tasks.workunit.client.0.smithi078.stdout:4/726: chown d0/f17 1110718 1 2024-04-18T21:07:01.312 INFO:tasks.workunit.client.0.smithi078.stdout:1/731: fdatasync d0/d2a/d5f/d89/d32/d35/f6d 0 2024-04-18T21:07:01.313 INFO:tasks.workunit.client.0.smithi078.stdout:9/712: dread d7/df/d1e/f58 [0,4194304] 0 2024-04-18T21:07:01.313 INFO:tasks.workunit.client.0.smithi078.stdout:4/727: mkdir d0/dc/d37/dfa 0 2024-04-18T21:07:01.314 INFO:tasks.workunit.client.0.smithi078.stdout:5/631: truncate d9/d2e/f76 6894351 0 2024-04-18T21:07:01.314 INFO:tasks.workunit.client.0.smithi078.stdout:2/599: sync 2024-04-18T21:07:01.314 INFO:tasks.workunit.client.0.smithi078.stdout:8/654: sync 2024-04-18T21:07:01.315 INFO:tasks.workunit.client.0.smithi078.stdout:1/732: write d0/d2a/d3c/d4b/d52/fe5 [997511,99168] 0 2024-04-18T21:07:01.315 INFO:tasks.workunit.client.0.smithi078.stdout:4/728: fsync d0/f7 0 2024-04-18T21:07:01.316 INFO:tasks.workunit.client.0.smithi078.stdout:6/597: dwrite d2/d1f/f61 [0,4194304] 0 2024-04-18T21:07:01.316 INFO:tasks.workunit.client.0.smithi078.stdout:2/600: creat d0/db/d6e/fb8 x:0 0 0 2024-04-18T21:07:01.317 INFO:tasks.workunit.client.0.smithi078.stdout:6/598: truncate d2/d1c/f53 4959287 0 2024-04-18T21:07:01.318 INFO:tasks.workunit.client.0.smithi078.stdout:6/599: chown d2/d6/dd/d4b/d5d/fa4 3 1 2024-04-18T21:07:01.318 INFO:tasks.workunit.client.0.smithi078.stdout:1/733: mkdir d0/d2a/d3c/da8/df4 0 2024-04-18T21:07:01.318 INFO:tasks.workunit.client.0.smithi078.stdout:9/713: creat d7/df/d54/d95/d9d/dd1/ff3 x:0 0 0 2024-04-18T21:07:01.318 INFO:tasks.workunit.client.0.smithi078.stdout:8/655: creat d0/d10/d60/d6f/fca x:0 0 0 2024-04-18T21:07:01.319 INFO:tasks.workunit.client.0.smithi078.stdout:2/601: creat d0/db/d18/d21/d27/d70/fb9 x:0 0 0 2024-04-18T21:07:01.319 INFO:tasks.workunit.client.0.smithi078.stdout:6/600: creat d2/d1c/d30/fc9 x:0 0 0 2024-04-18T21:07:01.319 INFO:tasks.workunit.client.0.smithi078.stdout:5/632: rename d9/da/d90/f72 to d9/da/d4b/d8b/fcf 0 2024-04-18T21:07:01.320 INFO:tasks.workunit.client.0.smithi078.stdout:9/714: creat d7/df/d88/dce/ff4 x:0 0 0 2024-04-18T21:07:01.320 INFO:tasks.workunit.client.0.smithi078.stdout:8/656: readlink d0/d10/d14/d2a/l39 0 2024-04-18T21:07:01.320 INFO:tasks.workunit.client.0.smithi078.stdout:1/734: mknod d0/dc1/dd3/cf5 0 2024-04-18T21:07:01.320 INFO:tasks.workunit.client.0.smithi078.stdout:2/602: write d0/db/fb6 [910944,90041] 0 2024-04-18T21:07:01.320 INFO:tasks.workunit.client.0.smithi078.stdout:5/633: chown d9/fb 19235 1 2024-04-18T21:07:01.321 INFO:tasks.workunit.client.0.smithi078.stdout:8/657: dread - d0/d5c/d5a/fc1 zero size 2024-04-18T21:07:01.321 INFO:tasks.workunit.client.0.smithi078.stdout:9/715: unlink d7/d11/d1b/d77/fea 0 2024-04-18T21:07:01.321 INFO:tasks.workunit.client.0.smithi078.stdout:5/634: write d9/da/d3e/d4c/f5a [3732982,107061] 0 2024-04-18T21:07:01.321 INFO:tasks.workunit.client.0.smithi078.stdout:8/658: chown d0/d10/d14/fa7 52 1 2024-04-18T21:07:01.322 INFO:tasks.workunit.client.0.smithi078.stdout:5/635: chown d9/da/d3e/f59 321256360 1 2024-04-18T21:07:01.322 INFO:tasks.workunit.client.0.smithi078.stdout:9/716: truncate d7/d11/d2d/d26/f64 112686 0 2024-04-18T21:07:01.324 INFO:tasks.workunit.client.0.smithi078.stdout:9/717: link d7/d11/d1b/d77/fb9 d7/d11/d2d/ff5 0 2024-04-18T21:07:01.325 INFO:tasks.workunit.client.0.smithi078.stdout:9/718: mkdir d7/d11/df0/df6 0 2024-04-18T21:07:01.327 INFO:tasks.workunit.client.0.smithi078.stdout:9/719: write d7/df/f10 [954069,62216] 0 2024-04-18T21:07:01.327 INFO:tasks.workunit.client.0.smithi078.stdout:1/735: read d0/d11/f22 [3884396,115915] 0 2024-04-18T21:07:01.329 INFO:tasks.workunit.client.0.smithi078.stdout:9/720: stat d7/d11/d1b/d77/fc3 0 2024-04-18T21:07:01.330 INFO:tasks.workunit.client.0.smithi078.stdout:1/736: truncate d0/d2a/d45/f76 171762 0 2024-04-18T21:07:01.330 INFO:tasks.workunit.client.0.smithi078.stdout:5/636: dwrite d9/d2e/f66 [0,4194304] 0 2024-04-18T21:07:01.330 INFO:tasks.workunit.client.0.smithi078.stdout:8/659: dwrite d0/d5c/d5a/f90 [0,4194304] 0 2024-04-18T21:07:01.332 INFO:tasks.workunit.client.0.smithi078.stdout:6/601: dwrite d2/d6/f14 [0,4194304] 0 2024-04-18T21:07:01.334 INFO:tasks.workunit.client.0.smithi078.stdout:5/637: rmdir d9/da/d32 39 2024-04-18T21:07:01.334 INFO:tasks.workunit.client.0.smithi078.stdout:8/660: dread d0/d5c/fa4 [0,4194304] 0 2024-04-18T21:07:01.334 INFO:tasks.workunit.client.0.smithi078.stdout:1/737: rename d0/d2a/d5f/d89/d32/d35/f99 to d0/d11/d69/ff6 0 2024-04-18T21:07:01.335 INFO:tasks.workunit.client.0.smithi078.stdout:9/721: mknod d7/df/dc0/cf7 0 2024-04-18T21:07:01.335 INFO:tasks.workunit.client.0.smithi078.stdout:1/738: write d0/d2a/d5f/d89/d32/d35/f55 [1591759,69716] 0 2024-04-18T21:07:01.336 INFO:tasks.workunit.client.0.smithi078.stdout:5/638: write d9/da/ff [5813837,115906] 0 2024-04-18T21:07:01.336 INFO:tasks.workunit.client.0.smithi078.stdout:1/739: write d0/d2a/d5f/d89/d32/d35/f6d [164236,41812] 0 2024-04-18T21:07:01.337 INFO:tasks.workunit.client.0.smithi078.stdout:5/639: fsync d9/fe 0 2024-04-18T21:07:01.338 INFO:tasks.workunit.client.0.smithi078.stdout:6/602: creat d2/d6/fca x:0 0 0 2024-04-18T21:07:01.338 INFO:tasks.workunit.client.0.smithi078.stdout:9/722: link d7/d11/d2d/d3f/d4d/fa7 d7/d23/d3e/d5a/ff8 0 2024-04-18T21:07:01.338 INFO:tasks.workunit.client.0.smithi078.stdout:1/740: chown d0/d2a/d5f/d89/d32/db2/f7e 187 1 2024-04-18T21:07:01.338 INFO:tasks.workunit.client.0.smithi078.stdout:5/640: unlink d9/da/d3e/f81 0 2024-04-18T21:07:01.338 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:01.338+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:01.339 INFO:tasks.workunit.client.0.smithi078.stdout:2/603: dread d0/d1f/d34/f78 [0,4194304] 0 2024-04-18T21:07:01.339 INFO:tasks.workunit.client.0.smithi078.stdout:9/723: chown d7/df/d54/d95 14462 1 2024-04-18T21:07:01.339 INFO:tasks.workunit.client.0.smithi078.stdout:6/603: mkdir d2/d1c/d63/d8b/dcb 0 2024-04-18T21:07:01.339 INFO:tasks.workunit.client.0.smithi078.stdout:1/741: chown d0/d2a/d3c/d4b/l66 53376 1 2024-04-18T21:07:01.339 INFO:tasks.workunit.client.0.smithi078.stdout:5/641: chown d9/da/d4b/d8b/fb6 17 1 2024-04-18T21:07:01.340 INFO:tasks.workunit.client.0.smithi078.stdout:6/604: fsync d2/ff 0 2024-04-18T21:07:01.340 INFO:tasks.workunit.client.0.smithi078.stdout:9/724: mkdir d7/d11/d2d/d3f/df9 0 2024-04-18T21:07:01.341 INFO:tasks.workunit.client.0.smithi078.stdout:2/604: creat d0/db/d18/d5d/fba x:0 0 0 2024-04-18T21:07:01.341 INFO:tasks.workunit.client.0.smithi078.stdout:6/605: chown d2/dbf 127 1 2024-04-18T21:07:01.341 INFO:tasks.workunit.client.0.smithi078.stdout:3/578: dread d4/df/d17/f3a [0,4194304] 0 2024-04-18T21:07:01.342 INFO:tasks.workunit.client.0.smithi078.stdout:1/742: link d0/d2a/d45/fa1 d0/d2a/d45/d81/dc8/ff7 0 2024-04-18T21:07:01.342 INFO:tasks.workunit.client.0.smithi078.stdout:9/725: readlink d7/d11/d2d/d3f/db7/lbc 0 2024-04-18T21:07:01.342 INFO:tasks.workunit.client.0.smithi078.stdout:5/642: write d9/da/d3e/d4c/d6d/d73/f97 [1384239,75713] 0 2024-04-18T21:07:01.343 INFO:tasks.workunit.client.0.smithi078.stdout:3/579: write d4/da/d76/f96 [424339,83938] 0 2024-04-18T21:07:01.343 INFO:tasks.workunit.client.0.smithi078.stdout:1/743: creat d0/d2a/d2f/d50/d78/ff8 x:0 0 0 2024-04-18T21:07:01.344 INFO:tasks.workunit.client.0.smithi078.stdout:5/643: chown d9/da/d90/f8f 2 1 2024-04-18T21:07:01.344 INFO:tasks.workunit.client.0.smithi078.stdout:8/661: dwrite d0/d10/f1c [0,4194304] 0 2024-04-18T21:07:01.346 INFO:tasks.workunit.client.0.smithi078.stdout:6/606: dread d2/d1c/f53 [0,4194304] 0 2024-04-18T21:07:01.346 INFO:tasks.workunit.client.0.smithi078.stdout:8/662: symlink d0/d10/d8d/lcb 0 2024-04-18T21:07:01.347 INFO:tasks.workunit.client.0.smithi078.stdout:9/726: sync 2024-04-18T21:07:01.347 INFO:tasks.workunit.client.0.smithi078.stdout:1/744: sync 2024-04-18T21:07:01.348 INFO:tasks.workunit.client.0.smithi078.stdout:6/607: rename d2/d1c/d67/d7f to d2/d1c/d63/d8b/dcc 0 2024-04-18T21:07:01.348 INFO:tasks.workunit.client.0.smithi078.stdout:8/663: mkdir d0/d10/d14/d2a/d4a/db2/db6/dcc 0 2024-04-18T21:07:01.348 INFO:tasks.workunit.client.0.smithi078.stdout:2/605: write d0/fe [2163527,79733] 0 2024-04-18T21:07:01.349 INFO:tasks.workunit.client.0.smithi078.stdout:9/727: stat d7/d11/d1b/d45/d4b/d5d 0 2024-04-18T21:07:01.350 INFO:tasks.workunit.client.0.smithi078.stdout:6/608: mknod d2/d1c/d63/da0/ccd 0 2024-04-18T21:07:01.350 INFO:tasks.workunit.client.0.smithi078.stdout:1/745: rename d0/d2a/d45/f54 to d0/d2a/d3c/ff9 0 2024-04-18T21:07:01.351 INFO:tasks.workunit.client.0.smithi078.stdout:3/580: dwrite d4/da/f92 [0,4194304] 0 2024-04-18T21:07:01.351 INFO:tasks.workunit.client.0.smithi078.stdout:9/728: symlink d7/d11/d80/lfa 0 2024-04-18T21:07:01.351 INFO:tasks.workunit.client.0.smithi078.stdout:6/609: write d2/d1f/f29 [991401,36278] 0 2024-04-18T21:07:01.353 INFO:tasks.workunit.client.0.smithi078.stdout:3/581: read d4/f64 [4170455,119797] 0 2024-04-18T21:07:01.353 INFO:tasks.workunit.client.0.smithi078.stdout:0/696: dread d0/d9/dd/d17/d2e/f39 [0,4194304] 0 2024-04-18T21:07:01.354 INFO:tasks.workunit.client.0.smithi078.stdout:5/644: truncate d9/da/d3e/d4c/d6d/d73/f97 15169 0 2024-04-18T21:07:01.354 INFO:tasks.workunit.client.0.smithi078.stdout:6/610: mkdir d2/d34/dce 0 2024-04-18T21:07:01.355 INFO:tasks.workunit.client.0.smithi078.stdout:0/697: write d0/d9/d58/f6d [2022844,60642] 0 2024-04-18T21:07:01.355 INFO:tasks.workunit.client.0.smithi078.stdout:9/729: chown d7/d23/d3e/d5a/da8/db0/lc7 49191041 1 2024-04-18T21:07:01.358 INFO:tasks.workunit.client.0.smithi078.stdout:9/730: symlink d7/d11/d1b/d45/d4b/lfb 0 2024-04-18T21:07:01.358 INFO:tasks.workunit.client.0.smithi078.stdout:0/698: write d0/d9/da/db/da6/fc6 [895346,111558] 0 2024-04-18T21:07:01.359 INFO:tasks.workunit.client.0.smithi078.stdout:5/645: read d9/da/d32/f51 [5546597,73797] 0 2024-04-18T21:07:01.360 INFO:tasks.workunit.client.0.smithi078.stdout:2/606: dwrite d0/db/d18/d21/d8b/f94 [0,4194304] 0 2024-04-18T21:07:01.361 INFO:tasks.workunit.client.0.smithi078.stdout:1/746: dwrite d0/d2a/d3c/d4b/d52/fe5 [0,4194304] 0 2024-04-18T21:07:01.362 INFO:tasks.workunit.client.0.smithi078.stdout:3/582: truncate d4/df/d17/f3a 2267205 0 2024-04-18T21:07:01.362 INFO:tasks.workunit.client.0.smithi078.stdout:3/583: sync 2024-04-18T21:07:01.362 INFO:tasks.workunit.client.0.smithi078.stdout:0/699: mknod d0/d9/d4c/d8f/cda 0 2024-04-18T21:07:01.362 INFO:tasks.workunit.client.0.smithi078.stdout:7/623: dread d1/d16/d10/f44 [0,4194304] 0 2024-04-18T21:07:01.363 INFO:tasks.workunit.client.0.smithi078.stdout:1/747: fdatasync d0/d2a/d3c/da8/ff3 0 2024-04-18T21:07:01.363 INFO:tasks.workunit.client.0.smithi078.stdout:0/700: read d0/d9/da/f10 [1449752,33758] 0 2024-04-18T21:07:01.363 INFO:tasks.workunit.client.0.smithi078.stdout:3/584: chown d4/da/d11/f21 27784 1 2024-04-18T21:07:01.366 INFO:tasks.workunit.client.0.smithi078.stdout:1/748: dread - d0/d2a/d3c/da8/ff3 zero size 2024-04-18T21:07:01.366 INFO:tasks.workunit.client.0.smithi078.stdout:7/624: mknod d1/d16/d10/d7c/cd1 0 2024-04-18T21:07:01.366 INFO:tasks.workunit.client.0.smithi078.stdout:0/701: read - d0/d9/da/db/d35/d3f/dbe/f7c zero size 2024-04-18T21:07:01.367 INFO:tasks.workunit.client.0.smithi078.stdout:2/607: mkdir d0/db/d18/dbb 0 2024-04-18T21:07:01.367 INFO:tasks.workunit.client.0.smithi078.stdout:7/625: fdatasync d1/d16/f77 0 2024-04-18T21:07:01.367 INFO:tasks.workunit.client.0.smithi078.stdout:1/749: chown d0/d2a/d5f/d89/d32/fa7 501 1 2024-04-18T21:07:01.367 INFO:tasks.workunit.client.0.smithi078.stdout:3/585: unlink d4/df/d17/la3 0 2024-04-18T21:07:01.367 INFO:tasks.workunit.client.0.smithi078.stdout:1/750: stat d0/d2a/d3c 0 2024-04-18T21:07:01.367 INFO:tasks.workunit.client.0.smithi078.stdout:2/608: mkdir d0/db/d18/d21/d27/d29/d4e/dbc 0 2024-04-18T21:07:01.368 INFO:tasks.workunit.client.0.smithi078.stdout:7/626: mknod d1/d16/d10/d7c/d7e/d97/cd2 0 2024-04-18T21:07:01.368 INFO:tasks.workunit.client.0.smithi078.stdout:5/646: getdents d9/da/d3e/d4c/d67/d7c/d78 0 2024-04-18T21:07:01.368 INFO:tasks.workunit.client.0.smithi078.stdout:0/702: creat d0/d9/da/fdb x:0 0 0 2024-04-18T21:07:01.368 INFO:tasks.workunit.client.0.smithi078.stdout:2/609: chown d0/db/d18/ca4 18729 1 2024-04-18T21:07:01.368 INFO:tasks.workunit.client.0.smithi078.stdout:7/627: write d1/d16/d10/f44 [4175110,18985] 0 2024-04-18T21:07:01.370 INFO:tasks.workunit.client.0.smithi078.stdout:0/703: fdatasync d0/d9/dd/d17/d2e/d31/f91 0 2024-04-18T21:07:01.370 INFO:tasks.workunit.client.0.smithi078.stdout:7/628: stat d1/d16/lba 0 2024-04-18T21:07:01.370 INFO:tasks.workunit.client.0.smithi078.stdout:0/704: fsync d0/fd9 0 2024-04-18T21:07:01.370 INFO:tasks.workunit.client.0.smithi078.stdout:1/751: stat d0/d2a/d3c/d4b/d4/ld9 0 2024-04-18T21:07:01.372 INFO:tasks.workunit.client.0.smithi078.stdout:7/629: dread - d1/d16/dc/d11/da2/dbc/dc3/fc4 zero size 2024-04-18T21:07:01.373 INFO:tasks.workunit.client.0.smithi078.stdout:0/705: mkdir d0/d6c/d9d/ddc 0 2024-04-18T21:07:01.373 INFO:tasks.workunit.client.0.smithi078.stdout:2/610: write d0/db/d65/d96/fa7 [936446,50748] 0 2024-04-18T21:07:01.374 INFO:tasks.workunit.client.0.smithi078.stdout:9/731: dwrite d7/f46 [0,4194304] 0 2024-04-18T21:07:01.376 INFO:tasks.workunit.client.0.smithi078.stdout:7/630: write d1/d16/dc/d11/d53/f58 [1219576,112826] 0 2024-04-18T21:07:01.376 INFO:tasks.workunit.client.0.smithi078.stdout:2/611: mkdir d0/db/d65/dbd 0 2024-04-18T21:07:01.377 INFO:tasks.workunit.client.0.smithi078.stdout:3/586: dwrite d4/f18 [0,4194304] 0 2024-04-18T21:07:01.378 INFO:tasks.workunit.client.0.smithi078.stdout:5/647: dwrite d9/da/d90/d62/f63 [0,4194304] 0 2024-04-18T21:07:01.378 INFO:tasks.workunit.client.0.smithi078.stdout:2/612: fdatasync d0/db/d18/d5d/fa2 0 2024-04-18T21:07:01.380 INFO:tasks.workunit.client.0.smithi078.stdout:2/613: unlink d0/d1f/l45 0 2024-04-18T21:07:01.380 INFO:tasks.workunit.client.0.smithi078.stdout:3/587: creat d4/d2d/d30/d35/d4b/d59/fad x:0 0 0 2024-04-18T21:07:01.381 INFO:tasks.workunit.client.0.smithi078.stdout:2/614: write d0/db/d18/d21/d27/d29/f69 [492361,108488] 0 2024-04-18T21:07:01.382 INFO:tasks.workunit.client.0.smithi078.stdout:7/631: getdents d1/d16/d10/d7c 0 2024-04-18T21:07:01.382 INFO:tasks.workunit.client.0.smithi078.stdout:3/588: truncate d4/d2d/d30/f34 5088718 0 2024-04-18T21:07:01.382 INFO:tasks.workunit.client.0.smithi078.stdout:1/752: dwrite d0/d2a/d45/f76 [0,4194304] 0 2024-04-18T21:07:01.382 INFO:tasks.workunit.client.0.smithi078.stdout:8/664: dread d0/d10/d60/d6f/dba/fc9 [0,4194304] 0 2024-04-18T21:07:01.383 INFO:tasks.workunit.client.0.smithi078.stdout:1/753: chown d0/d2a/d2f/d50/d78 602158 1 2024-04-18T21:07:01.384 INFO:tasks.workunit.client.0.smithi078.stdout:4/729: dread d0/dc/d29/f51 [0,4194304] 0 2024-04-18T21:07:01.384 INFO:tasks.workunit.client.0.smithi078.stdout:4/730: sync 2024-04-18T21:07:01.386 INFO:tasks.workunit.client.0.smithi078.stdout:1/754: write d0/d2a/d5f/f87 [758205,127120] 0 2024-04-18T21:07:01.386 INFO:tasks.workunit.client.0.smithi078.stdout:2/615: mknod d0/db/d18/d21/d27/d29/d33/cbe 0 2024-04-18T21:07:01.387 INFO:tasks.workunit.client.0.smithi078.stdout:4/731: rmdir d0/dc/d10/db2 39 2024-04-18T21:07:01.387 INFO:tasks.workunit.client.0.smithi078.stdout:8/665: creat d0/da8/fcd x:0 0 0 2024-04-18T21:07:01.387 INFO:tasks.workunit.client.0.smithi078.stdout:2/616: stat d0/db/d18/d21/d27/d29/d57/c91 0 2024-04-18T21:07:01.388 INFO:tasks.workunit.client.0.smithi078.stdout:8/666: chown d0/d10/d14/d2d/f35 4 1 2024-04-18T21:07:01.389 INFO:tasks.workunit.client.0.smithi078.stdout:4/732: mknod d0/dc/d37/dfa/cfb 0 2024-04-18T21:07:01.389 INFO:tasks.workunit.client.0.smithi078.stdout:2/617: fsync d0/d1f/d34/f53 0 2024-04-18T21:07:01.390 INFO:tasks.workunit.client.0.smithi078.stdout:8/667: symlink d0/d10/d9d/dc0/lce 0 2024-04-18T21:07:01.392 INFO:tasks.workunit.client.0.smithi078.stdout:4/733: rmdir d0/dc/d10/d1c/d6a/d81/dd4 39 2024-04-18T21:07:01.392 INFO:tasks.workunit.client.0.smithi078.stdout:3/589: dwrite d4/df/f98 [0,4194304] 0 2024-04-18T21:07:01.394 INFO:tasks.workunit.client.0.smithi078.stdout:8/668: rename d0/d5c/d5a/f90 to d0/fcf 0 2024-04-18T21:07:01.394 INFO:tasks.workunit.client.0.smithi078.stdout:4/734: dread - d0/dc/d10/d1c/d60/f90 zero size 2024-04-18T21:07:01.395 INFO:tasks.workunit.client.0.smithi078.stdout:6/611: dread d2/d1c/d3a/fb4 [0,4194304] 0 2024-04-18T21:07:01.396 INFO:tasks.workunit.client.0.smithi078.stdout:1/755: dwrite d0/d2a/d2f/f44 [4194304,4194304] 0 2024-04-18T21:07:01.397 INFO:tasks.workunit.client.0.smithi078.stdout:6/612: stat d2/d34/d35/l55 0 2024-04-18T21:07:01.398 INFO:tasks.workunit.client.0.smithi078.stdout:4/735: creat d0/ffc x:0 0 0 2024-04-18T21:07:01.398 INFO:tasks.workunit.client.0.smithi078.stdout:1/756: rmdir d0/d2a/d5f/d89/dc2 39 2024-04-18T21:07:01.399 INFO:tasks.workunit.client.0.smithi078.stdout:6/613: unlink d2/d1c/f92 0 2024-04-18T21:07:01.399 INFO:tasks.workunit.client.0.smithi078.stdout:2/618: rename d0/db/d6e/fb8 to d0/db/d18/d21/d27/d29/fbf 0 2024-04-18T21:07:01.399 INFO:tasks.workunit.client.0.smithi078.stdout:8/669: creat d0/d5c/fd0 x:0 0 0 2024-04-18T21:07:01.401 INFO:tasks.workunit.client.0.smithi078.stdout:4/736: fdatasync d0/dc/d10/d41/d5f/f98 0 2024-04-18T21:07:01.401 INFO:tasks.workunit.client.0.smithi078.stdout:1/757: chown d0/d2a/d3c/d4b/d4/c16 2895698 1 2024-04-18T21:07:01.401 INFO:tasks.workunit.client.0.smithi078.stdout:8/670: write d0/d10/d14/fa7 [889201,27309] 0 2024-04-18T21:07:01.401 INFO:tasks.workunit.client.0.smithi078.stdout:8/671: sync 2024-04-18T21:07:01.402 INFO:tasks.workunit.client.0.smithi078.stdout:4/737: readlink d0/dc/d10/d41/lc1 0 2024-04-18T21:07:01.402 INFO:tasks.workunit.client.0.smithi078.stdout:6/614: rename d2/d1c/d63/d8b/cab to d2/ccf 0 2024-04-18T21:07:01.402 INFO:tasks.workunit.client.0.smithi078.stdout:3/590: dwrite d4/da/d11/f21 [0,4194304] 0 2024-04-18T21:07:01.403 INFO:tasks.workunit.client.0.smithi078.stdout:6/615: dread - d2/d34/f56 zero size 2024-04-18T21:07:01.403 INFO:tasks.workunit.client.0.smithi078.stdout:1/758: write d0/f3f [1754277,76521] 0 2024-04-18T21:07:01.403 INFO:tasks.workunit.client.0.smithi078.stdout:6/616: dread - d2/d74/fb8 zero size 2024-04-18T21:07:01.404 INFO:tasks.workunit.client.0.smithi078.stdout:1/759: read d0/d2a/d5f/d89/d32/d35/d85/fb0 [2965511,122604] 0 2024-04-18T21:07:01.404 INFO:tasks.workunit.client.0.smithi078.stdout:6/617: rmdir d2/d1c/d3a/d8c 39 2024-04-18T21:07:01.405 INFO:tasks.workunit.client.0.smithi078.stdout:6/618: write d2/fe [5245557,113831] 0 2024-04-18T21:07:01.405 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:01.405 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:01.407 INFO:tasks.workunit.client.0.smithi078.stdout:6/619: creat d2/d1c/d3a/fd0 x:0 0 0 2024-04-18T21:07:01.408 INFO:tasks.workunit.client.0.smithi078.stdout:6/620: creat d2/d1c/d63/d8b/fd1 x:0 0 0 2024-04-18T21:07:01.410 INFO:tasks.workunit.client.0.smithi078.stdout:0/706: dread d0/d9/f2d [0,4194304] 0 2024-04-18T21:07:01.412 INFO:tasks.workunit.client.0.smithi078.stdout:1/760: fsync d0/d2a/d5f/f87 0 2024-04-18T21:07:01.412 INFO:tasks.workunit.client.0.smithi078.stdout:3/591: dwrite d4/d2d/d30/d35/d71/f9e [0,4194304] 0 2024-04-18T21:07:01.413 INFO:tasks.workunit.client.0.smithi078.stdout:8/672: fsync d0/d5c/fd0 0 2024-04-18T21:07:01.413 INFO:tasks.workunit.client.0.smithi078.stdout:4/738: dwrite d0/dc/d10/d41/d5f/fb7 [0,4194304] 0 2024-04-18T21:07:01.413 INFO:tasks.workunit.client.0.smithi078.stdout:3/592: stat d4/da/d57/caa 0 2024-04-18T21:07:01.413 INFO:tasks.workunit.client.0.smithi078.stdout:9/732: dread d7/d23/d3e/d5a/dca/ff1 [0,4194304] 0 2024-04-18T21:07:01.414 INFO:tasks.workunit.client.0.smithi078.stdout:8/673: mknod d0/d10/d14/d2a/d3c/cd1 0 2024-04-18T21:07:01.414 INFO:tasks.workunit.client.0.smithi078.stdout:4/739: creat d0/dc/d37/dfa/ffd x:0 0 0 2024-04-18T21:07:01.415 INFO:tasks.workunit.client.0.smithi078.stdout:1/761: link d0/d2a/ff2 d0/d2a/d3c/ffa 0 2024-04-18T21:07:01.415 INFO:tasks.workunit.client.0.smithi078.stdout:9/733: chown d7/df/d1e/l6c 74596441 1 2024-04-18T21:07:01.415 INFO:tasks.workunit.client.0.smithi078.stdout:3/593: creat d4/df/d17/d41/fae x:0 0 0 2024-04-18T21:07:01.417 INFO:tasks.workunit.client.0.smithi078.stdout:9/734: symlink d7/d11/d1b/d45/d4b/lfc 0 2024-04-18T21:07:01.417 INFO:tasks.workunit.client.0.smithi078.stdout:1/762: creat d0/d2a/d45/d81/dc8/ffb x:0 0 0 2024-04-18T21:07:01.417 INFO:tasks.workunit.client.0.smithi078.stdout:8/674: rename d0/d10/d9d/dc0 to d0/d10/d14/d2d/d93/da0/db5/dd2 0 2024-04-18T21:07:01.419 INFO:tasks.workunit.client.0.smithi078.stdout:8/675: mknod d0/d10/d14/d2d/cd3 0 2024-04-18T21:07:01.420 INFO:tasks.workunit.client.0.smithi078.stdout:6/621: dread d2/d6/dd/d4b/d5d/f6d [0,4194304] 0 2024-04-18T21:07:01.421 INFO:tasks.workunit.client.0.smithi078.stdout:8/676: write d0/d10/d60/d6f/f7a [1280043,109717] 0 2024-04-18T21:07:01.422 INFO:tasks.workunit.client.0.smithi078.stdout:4/740: dwrite d0/dc/d37/f3b [0,4194304] 0 2024-04-18T21:07:01.424 INFO:tasks.workunit.client.0.smithi078.stdout:8/677: mknod d0/d10/d14/d2d/d93/da0/dc2/cd4 0 2024-04-18T21:07:01.424 INFO:tasks.workunit.client.0.smithi078.stdout:4/741: creat d0/dc/d10/d41/ffe x:0 0 0 2024-04-18T21:07:01.425 INFO:tasks.workunit.client.0.smithi078.stdout:4/742: mkdir d0/dc/d10/dff 0 2024-04-18T21:07:01.425 INFO:tasks.workunit.client.0.smithi078.stdout:8/678: rename d0/d22/f61 to d0/d5c/d5a/d7b/fd5 0 2024-04-18T21:07:01.426 INFO:tasks.workunit.client.0.smithi078.stdout:4/743: chown d0/dc/d5b 4200 1 2024-04-18T21:07:01.426 INFO:tasks.workunit.client.0.smithi078.stdout:4/744: symlink d0/dc/d29/de2/l100 0 2024-04-18T21:07:01.428 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:07:01.428 INFO:tasks.workunit.client.0.smithi078.stdout:6/622: truncate d2/d6/dd/d4b/d5d/f6f 2466751 0 2024-04-18T21:07:01.429 INFO:tasks.workunit.client.0.smithi078.stdout:4/745: rename d0/dc/d37/dfa/ffd to d0/dc/d37/f101 0 2024-04-18T21:07:01.430 INFO:tasks.workunit.client.0.smithi078.stdout:4/746: chown d0/d73/da9/lf7 1 1 2024-04-18T21:07:01.430 INFO:tasks.workunit.client.0.smithi078.stdout:6/623: mknod d2/d1c/d30/cd2 0 2024-04-18T21:07:01.432 INFO:tasks.workunit.client.0.smithi078.stdout:1/763: dwrite d0/d2a/d3c/f6b [0,4194304] 0 2024-04-18T21:07:01.432 INFO:tasks.workunit.client.0.smithi078.stdout:3/594: dwrite d4/df/d17/f3a [0,4194304] 0 2024-04-18T21:07:01.433 INFO:tasks.workunit.client.0.smithi078.stdout:9/735: read d7/df/d1e/d7b/f94 [2534862,92802] 0 2024-04-18T21:07:01.433 INFO:tasks.workunit.client.0.smithi078.stdout:5/648: dread d9/fe [0,4194304] 0 2024-04-18T21:07:01.434 INFO:tasks.workunit.client.0.smithi078.stdout:8/679: dwrite d0/d10/d14/d2a/d4a/f75 [4194304,4194304] 0 2024-04-18T21:07:01.435 INFO:tasks.workunit.client.0.smithi078.stdout:8/680: write d0/d5c/fd0 [222057,130666] 0 2024-04-18T21:07:01.435 INFO:tasks.workunit.client.0.smithi078.stdout:1/764: getdents d0/d2a/d2f 0 2024-04-18T21:07:01.436 INFO:tasks.workunit.client.0.smithi078.stdout:3/595: rename d4/da/d11/f32 to d4/da/d5e/faf 0 2024-04-18T21:07:01.436 INFO:tasks.workunit.client.0.smithi078.stdout:5/649: creat d9/da/d3e/d4c/d67/fd0 x:0 0 0 2024-04-18T21:07:01.436 INFO:tasks.workunit.client.0.smithi078.stdout:1/765: unlink d0/d2a/d5f/d89/d32/db2/f9e 0 2024-04-18T21:07:01.436 INFO:tasks.workunit.client.0.smithi078.stdout:9/736: rename d7/d11/d1b/d45/d74 to d7/d11/d2d/d3f/db7/dfd 0 2024-04-18T21:07:01.437 INFO:tasks.workunit.client.0.smithi078.stdout:3/596: mkdir d4/df/db0 0 2024-04-18T21:07:01.437 INFO:tasks.workunit.client.0.smithi078.stdout:5/650: creat d9/da/d4b/d8b/fd1 x:0 0 0 2024-04-18T21:07:01.437 INFO:tasks.workunit.client.0.smithi078.stdout:8/681: rename d0/d10/d14/d2a/d4a/f7d to d0/d10/d8d/fd6 0 2024-04-18T21:07:01.437 INFO:tasks.workunit.client.0.smithi078.stdout:1/766: unlink d0/d11/d69/f72 0 2024-04-18T21:07:01.437 INFO:tasks.workunit.client.0.smithi078.stdout:5/651: sync 2024-04-18T21:07:01.439 INFO:tasks.workunit.client.0.smithi078.stdout:3/597: rmdir d4/d2d/d30/d35 39 2024-04-18T21:07:01.440 INFO:tasks.workunit.client.0.smithi078.stdout:5/652: creat d9/d2e/fd2 x:0 0 0 2024-04-18T21:07:01.440 INFO:tasks.workunit.client.0.smithi078.stdout:9/737: getdents d7/d11/d2d/d3f/db7/dd7 0 2024-04-18T21:07:01.441 INFO:tasks.workunit.client.0.smithi078.stdout:1/767: rename d0/d2a/d3c/da8/fb3 to d0/d2a/d2f/d9b/ffc 0 2024-04-18T21:07:01.441 INFO:tasks.workunit.client.0.smithi078.stdout:9/738: readlink d7/df/d54/lb8 0 2024-04-18T21:07:01.441 INFO:tasks.workunit.client.0.smithi078.stdout:3/598: fdatasync d4/d2d/d30/f40 0 2024-04-18T21:07:01.442 INFO:tasks.workunit.client.0.smithi078.stdout:1/768: readlink d0/d2a/d2f/d9b/la0 0 2024-04-18T21:07:01.442 INFO:tasks.workunit.client.0.smithi078.stdout:3/599: mknod d4/d2d/d6c/cb1 0 2024-04-18T21:07:01.443 INFO:tasks.workunit.client.0.smithi078.stdout:1/769: chown d0/d2a/d2f/f38 8330838 1 2024-04-18T21:07:01.443 INFO:tasks.workunit.client.0.smithi078.stdout:8/682: dwrite d0/d10/f1c [0,4194304] 0 2024-04-18T21:07:01.443 INFO:tasks.workunit.client.0.smithi078.stdout:3/600: truncate d4/df/d17/d41/fae 442660 0 2024-04-18T21:07:01.444 INFO:tasks.workunit.client.0.smithi078.stdout:8/683: stat d0/d10/d14/fa5 0 2024-04-18T21:07:01.445 INFO:tasks.workunit.client.0.smithi078.stdout:1/770: truncate d0/d2a/d3c/d4b/fcc 51987 0 2024-04-18T21:07:01.445 INFO:tasks.workunit.client.0.smithi078.stdout:5/653: dread d9/d2e/f9e [0,4194304] 0 2024-04-18T21:07:01.445 INFO:tasks.workunit.client.0.smithi078.stdout:5/654: readlink d9/da/d3e/l6c 0 2024-04-18T21:07:01.445 INFO:tasks.workunit.client.0.smithi078.stdout:0/707: dread d0/d9/da/db/f4d [0,4194304] 0 2024-04-18T21:07:01.446 INFO:tasks.workunit.client.0.smithi078.stdout:5/655: chown d9/da/d3e/d4c/d67/fd0 6889 1 2024-04-18T21:07:01.448 INFO:tasks.workunit.client.0.smithi078.stdout:0/708: mknod d0/d9/da/db/cdd 0 2024-04-18T21:07:01.448 INFO:tasks.workunit.client.0.smithi078.stdout:1/771: creat d0/d2a/d5f/d89/d32/ffd x:0 0 0 2024-04-18T21:07:01.448 INFO:tasks.workunit.client.0.smithi078.stdout:3/601: creat d4/df/fb2 x:0 0 0 2024-04-18T21:07:01.449 INFO:tasks.workunit.client.0.smithi078.stdout:1/772: truncate d0/d2a/d2f/d50/d78/ff8 199202 0 2024-04-18T21:07:01.450 INFO:tasks.workunit.client.0.smithi078.stdout:7/632: dread d1/d16/d1c/f34 [0,4194304] 0 2024-04-18T21:07:01.451 INFO:tasks.workunit.client.0.smithi078.stdout:1/773: link d0/d2a/d2f/d50/d78/ldb d0/dc1/dd3/lfe 0 2024-04-18T21:07:01.451 INFO:tasks.workunit.client.0.smithi078.stdout:7/633: chown d1/d16/d65/f84 6318 1 2024-04-18T21:07:01.452 INFO:tasks.workunit.client.0.smithi078.stdout:7/634: mkdir d1/d16/d10/dc6/dd3 0 2024-04-18T21:07:01.452 INFO:tasks.workunit.client.0.smithi078.stdout:1/774: write d0/d2a/d3c/d4b/d4/fc [5091449,45414] 0 2024-04-18T21:07:01.452 INFO:tasks.workunit.client.0.smithi078.stdout:1/775: mkdir d0/de7/dff 0 2024-04-18T21:07:01.453 INFO:tasks.workunit.client.0.smithi078.stdout:1/776: readlink d0/d2a/d3c/d4b/d4/d61/d9c/lc4 0 2024-04-18T21:07:01.454 INFO:tasks.workunit.client.0.smithi078.stdout:6/624: truncate d2/d1c/d30/f3b 866417 0 2024-04-18T21:07:01.456 INFO:tasks.workunit.client.0.smithi078.stdout:6/625: getdents d2 0 2024-04-18T21:07:01.456 INFO:tasks.workunit.client.0.smithi078.stdout:1/777: read d0/d2a/d5f/d89/d32/f39 [1244216,46815] 0 2024-04-18T21:07:01.457 INFO:tasks.workunit.client.0.smithi078.stdout:6/626: dread d2/d34/d35/f80 [0,4194304] 0 2024-04-18T21:07:01.458 INFO:tasks.workunit.client.0.smithi078.stdout:1/778: mkdir d0/d2a/d5f/d89/dc2/d100 0 2024-04-18T21:07:01.458 INFO:tasks.workunit.client.0.smithi078.stdout:9/739: dread d7/d11/d2d/d3f/f6e [0,4194304] 0 2024-04-18T21:07:01.458 INFO:tasks.workunit.client.0.smithi078.stdout:7/635: dwrite d1/d16/dc/d4b/f43 [0,4194304] 0 2024-04-18T21:07:01.458 INFO:tasks.workunit.client.0.smithi078.stdout:6/627: write d2/d6/dd/f95 [461451,113654] 0 2024-04-18T21:07:01.460 INFO:tasks.workunit.client.0.smithi078.stdout:7/636: write d1/d16/d10/d7c/d7e/fcb [94121,16624] 0 2024-04-18T21:07:01.460 INFO:tasks.workunit.client.0.smithi078.stdout:2/619: dread d0/f5 [4194304,4194304] 0 2024-04-18T21:07:01.461 INFO:tasks.workunit.client.0.smithi078.stdout:6/628: symlink d2/d74/ld3 0 2024-04-18T21:07:01.461 INFO:tasks.workunit.client.0.smithi078.stdout:9/740: write d7/f24 [3756509,72275] 0 2024-04-18T21:07:01.462 INFO:tasks.workunit.client.0.smithi078.stdout:2/620: truncate d0/db/d18/d30/fab 931518 0 2024-04-18T21:07:01.462 INFO:tasks.workunit.client.0.smithi078.stdout:6/629: creat d2/d34/dce/fd4 x:0 0 0 2024-04-18T21:07:01.464 INFO:tasks.workunit.client.0.smithi078.stdout:6/630: dread - d2/d6/fca zero size 2024-04-18T21:07:01.465 INFO:tasks.workunit.client.0.smithi078.stdout:8/684: write d0/f36 [2951764,122188] 0 2024-04-18T21:07:01.465 INFO:tasks.workunit.client.0.smithi078.stdout:3/602: truncate d4/f18 1813188 0 2024-04-18T21:07:01.465 INFO:tasks.workunit.client.0.smithi078.stdout:2/621: symlink d0/db/d65/d96/lc0 0 2024-04-18T21:07:01.466 INFO:tasks.workunit.client.0.smithi078.stdout:2/622: write d0/db/fb1 [137194,27679] 0 2024-04-18T21:07:01.467 INFO:tasks.workunit.client.0.smithi078.stdout:3/603: creat d4/da/d11/d66/fb3 x:0 0 0 2024-04-18T21:07:01.467 INFO:tasks.workunit.client.0.smithi078.stdout:3/604: readlink d4/l94 0 2024-04-18T21:07:01.468 INFO:tasks.workunit.client.0.smithi078.stdout:8/685: write d0/d10/d8d/faa [693167,1558] 0 2024-04-18T21:07:01.468 INFO:tasks.workunit.client.0.smithi078.stdout:7/637: dwrite d1/d16/dc/d4b/f2c [0,4194304] 0 2024-04-18T21:07:01.470 INFO:tasks.workunit.client.0.smithi078.stdout:2/623: rename d0/c4f to d0/d87/d88/cc1 0 2024-04-18T21:07:01.470 INFO:tasks.workunit.client.0.smithi078.stdout:8/686: write d0/d10/d8d/fd6 [7700303,80749] 0 2024-04-18T21:07:01.471 INFO:tasks.workunit.client.0.smithi078.stdout:4/747: dread d0/dc/d10/d3a/f40 [0,4194304] 0 2024-04-18T21:07:01.472 INFO:tasks.workunit.client.0.smithi078.stdout:4/748: chown d0/d73/f75 5098 1 2024-04-18T21:07:01.472 INFO:tasks.workunit.client.0.smithi078.stdout:9/741: dwrite d7/d11/d1b/d45/d4b/d5d/fa4 [0,4194304] 0 2024-04-18T21:07:01.472 INFO:tasks.workunit.client.0.smithi078.stdout:7/638: creat d1/d16/dc/d11/d53/d82/da4/db5/d91/db0/fd4 x:0 0 0 2024-04-18T21:07:01.472 INFO:tasks.workunit.client.0.smithi078.stdout:8/687: creat d0/d5c/d5a/d7b/fd7 x:0 0 0 2024-04-18T21:07:01.472 INFO:tasks.workunit.client.0.smithi078.stdout:3/605: link d4/df/d17/l80 d4/df/d17/d41/lb4 0 2024-04-18T21:07:01.473 INFO:tasks.workunit.client.0.smithi078.stdout:4/749: stat d0/dc/d5b/d71/f56 0 2024-04-18T21:07:01.473 INFO:tasks.workunit.client.0.smithi078.stdout:2/624: link d0/db/d18/d21/d27/f58 d0/d1f/fc2 0 2024-04-18T21:07:01.473 INFO:tasks.workunit.client.0.smithi078.stdout:9/742: symlink d7/df/d1e/d7b/lfe 0 2024-04-18T21:07:01.473 INFO:tasks.workunit.client.0.smithi078.stdout:8/688: unlink d0/d10/d8d/faa 0 2024-04-18T21:07:01.473 INFO:tasks.workunit.client.0.smithi078.stdout:4/750: readlink d0/dc/d5b/d71/l93 0 2024-04-18T21:07:01.474 INFO:tasks.workunit.client.0.smithi078.stdout:2/625: unlink d0/db/d18/ca4 0 2024-04-18T21:07:01.474 INFO:tasks.workunit.client.0.smithi078.stdout:4/751: mknod d0/dc/d5b/d71/c102 0 2024-04-18T21:07:01.474 INFO:tasks.workunit.client.0.smithi078.stdout:8/689: write d0/fcf [4792386,89133] 0 2024-04-18T21:07:01.475 INFO:tasks.workunit.client.0.smithi078.stdout:9/743: read d7/df/f8a [448961,69057] 0 2024-04-18T21:07:01.475 INFO:tasks.workunit.client.0.smithi078.stdout:2/626: mknod d0/da9/cc3 0 2024-04-18T21:07:01.475 INFO:tasks.workunit.client.0.smithi078.stdout:8/690: fsync d0/d10/d60/d6f/f7f 0 2024-04-18T21:07:01.475 INFO:tasks.workunit.client.0.smithi078.stdout:2/627: fdatasync d0/db/d18/d30/fab 0 2024-04-18T21:07:01.476 INFO:tasks.workunit.client.0.smithi078.stdout:8/691: symlink d0/d10/d60/d6f/ld8 0 2024-04-18T21:07:01.478 INFO:tasks.workunit.client.0.smithi078.stdout:5/656: dread d9/da/d3e/d4c/f8a [0,4194304] 0 2024-04-18T21:07:01.478 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:01.478+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:01.479 INFO:tasks.workunit.client.0.smithi078.stdout:0/709: dread d0/d9/da/f42 [0,4194304] 0 2024-04-18T21:07:01.479 INFO:tasks.workunit.client.0.smithi078.stdout:4/752: dread d0/dc/d5b/f62 [0,4194304] 0 2024-04-18T21:07:01.479 INFO:tasks.workunit.client.0.smithi078.stdout:8/692: link d0/d10/d14/d2d/d93/f8f d0/d10/d14/d2a/d4a/db2/db6/fd9 0 2024-04-18T21:07:01.480 INFO:tasks.workunit.client.0.smithi078.stdout:0/710: mkdir d0/d9/da/df/dde 0 2024-04-18T21:07:01.482 INFO:tasks.workunit.client.0.smithi078.stdout:8/693: mknod d0/d10/d14/d2d/d93/da0/cda 0 2024-04-18T21:07:01.482 INFO:tasks.workunit.client.0.smithi078.stdout:4/753: getdents d0/dc/d10/d1c/d60/dee/dc4/df3/db3 0 2024-04-18T21:07:01.482 INFO:tasks.workunit.client.0.smithi078.stdout:9/744: dwrite d7/df/f4c [0,4194304] 0 2024-04-18T21:07:01.483 INFO:tasks.workunit.client.0.smithi078.stdout:3/606: truncate d4/d2d/d30/f34 2253987 0 2024-04-18T21:07:01.485 INFO:tasks.workunit.client.0.smithi078.stdout:1/779: dread d0/f3f [0,4194304] 0 2024-04-18T21:07:01.485 INFO:tasks.workunit.client.0.smithi078.stdout:5/657: dwrite d9/d2e/f3d [0,4194304] 0 2024-04-18T21:07:01.485 INFO:tasks.workunit.client.0.smithi078.stdout:8/694: creat d0/da8/fdb x:0 0 0 2024-04-18T21:07:01.487 INFO:tasks.workunit.client.0.smithi078.stdout:4/754: rmdir d0/dc/d29/de2 39 2024-04-18T21:07:01.487 INFO:tasks.workunit.client.0.smithi078.stdout:9/745: mknod d7/cff 0 2024-04-18T21:07:01.487 INFO:tasks.workunit.client.0.smithi078.stdout:8/695: write d0/d10/d60/d6f/fb0 [1275596,4160] 0 2024-04-18T21:07:01.487 INFO:tasks.workunit.client.0.smithi078.stdout:0/711: dwrite d0/d9/f5a [0,4194304] 0 2024-04-18T21:07:01.488 INFO:tasks.workunit.client.0.smithi078.stdout:4/755: dread - d0/dc/d37/f101 zero size 2024-04-18T21:07:01.488 INFO:tasks.workunit.client.0.smithi078.stdout:1/780: dread - d0/d2a/d45/d81/dc8/ffb zero size 2024-04-18T21:07:01.491 INFO:tasks.workunit.client.0.smithi078.stdout:4/756: rmdir d0/dc/d10/d1c/d6a 39 2024-04-18T21:07:01.491 INFO:tasks.workunit.client.0.smithi078.stdout:5/658: read d9/da/d3e/d4c/d67/fb2 [3297040,114743] 0 2024-04-18T21:07:01.491 INFO:tasks.workunit.client.0.smithi078.stdout:0/712: mkdir d0/d9/dd/d17/d2e/d7f/ddf 0 2024-04-18T21:07:01.491 INFO:tasks.workunit.client.0.smithi078.stdout:7/639: dread d1/d16/d65/f6a [0,4194304] 0 2024-04-18T21:07:01.492 INFO:tasks.workunit.client.0.smithi078.stdout:7/640: fsync d1/d16/dc/d11/d53/f68 0 2024-04-18T21:07:01.494 INFO:tasks.workunit.client.0.smithi078.stdout:8/696: dwrite d0/d10/d60/d6f/fb0 [0,4194304] 0 2024-04-18T21:07:01.494 INFO:tasks.workunit.client.0.smithi078.stdout:7/641: truncate d1/d16/dc/d11/d53/d82/da4/faa 30136 0 2024-04-18T21:07:01.495 INFO:tasks.workunit.client.0.smithi078.stdout:7/642: fsync d1/d16/d1c/d40/f8e 0 2024-04-18T21:07:01.495 INFO:tasks.workunit.client.0.smithi078.stdout:4/757: truncate d0/f17 3142657 0 2024-04-18T21:07:01.496 INFO:tasks.workunit.client.0.smithi078.stdout:5/659: dwrite d9/da/ff [0,4194304] 0 2024-04-18T21:07:01.497 INFO:tasks.workunit.client.0.smithi078.stdout:5/660: readlink d9/d2e/d65/l83 0 2024-04-18T21:07:01.498 INFO:tasks.workunit.client.0.smithi078.stdout:5/661: chown d9/da/d8c 260463 1 2024-04-18T21:07:01.499 INFO:tasks.workunit.client.0.smithi078.stdout:7/643: creat d1/d16/dc/d11/fd5 x:0 0 0 2024-04-18T21:07:01.499 INFO:tasks.workunit.client.0.smithi078.stdout:9/746: truncate d7/f46 420643 0 2024-04-18T21:07:01.500 INFO:tasks.workunit.client.0.smithi078.stdout:7/644: stat d1 0 2024-04-18T21:07:01.501 INFO:tasks.workunit.client.0.smithi078.stdout:3/607: dwrite d4/f18 [0,4194304] 0 2024-04-18T21:07:01.502 INFO:tasks.workunit.client.0.smithi078.stdout:9/747: truncate d7/d11/d2d/d3f/d4d/fa1 264930 0 2024-04-18T21:07:01.502 INFO:tasks.workunit.client.0.smithi078.stdout:4/758: dwrite d0/dc/d10/d41/ffe [0,4194304] 0 2024-04-18T21:07:01.503 INFO:tasks.workunit.client.0.smithi078.stdout:3/608: write d4/d2d/d30/f40 [713213,7213] 0 2024-04-18T21:07:01.504 INFO:tasks.workunit.client.0.smithi078.stdout:7/645: rename d1/d16/dc/d11/d53/d82/da4/db5/f9d to d1/d16/dc/fd6 0 2024-04-18T21:07:01.504 INFO:tasks.workunit.client.0.smithi078.stdout:9/748: creat d7/d11/d2d/d3f/f100 x:0 0 0 2024-04-18T21:07:01.504 INFO:tasks.workunit.client.0.smithi078.stdout:4/759: mknod d0/dc/d29/d6d/d7b/c103 0 2024-04-18T21:07:01.505 INFO:tasks.workunit.client.0.smithi078.stdout:6/631: sync 2024-04-18T21:07:01.508 INFO:tasks.workunit.client.0.smithi078.stdout:6/632: getdents d2/d1c/db3/dbb 0 2024-04-18T21:07:01.508 INFO:tasks.workunit.client.0.smithi078.stdout:5/662: dwrite d9/da/d3e/d4c/f5a [0,4194304] 0 2024-04-18T21:07:01.508 INFO:tasks.workunit.client.0.smithi078.stdout:5/663: stat d9/da/l10 0 2024-04-18T21:07:01.509 INFO:tasks.workunit.client.0.smithi078.stdout:8/697: dwrite d0/d10/d14/d2d/d93/f8f [0,4194304] 0 2024-04-18T21:07:01.510 INFO:tasks.workunit.client.0.smithi078.stdout:5/664: creat d9/da/d3e/d4c/d67/fd3 x:0 0 0 2024-04-18T21:07:01.511 INFO:tasks.workunit.client.0.smithi078.stdout:8/698: write d0/d10/d14/d2d/d93/fad [1094670,77738] 0 2024-04-18T21:07:01.512 INFO:tasks.workunit.client.0.smithi078.stdout:8/699: unlink d0/d10/d14/d2a/d4a/c5f 0 2024-04-18T21:07:01.512 INFO:tasks.workunit.client.0.smithi078.stdout:4/760: dwrite d0/dc/d10/d41/f45 [0,4194304] 0 2024-04-18T21:07:01.513 INFO:tasks.workunit.client.0.smithi078.stdout:8/700: rename d0/d5c/d5a/d7b/fd5 to d0/d10/d14/d2a/d4a/db2/fdc 0 2024-04-18T21:07:01.514 INFO:tasks.workunit.client.0.smithi078.stdout:8/701: mkdir d0/d10/d14/d2a/ddd 0 2024-04-18T21:07:01.514 INFO:tasks.workunit.client.0.smithi078.stdout:8/702: readlink d0/d10/d14/d2d/d93/l5e 0 2024-04-18T21:07:01.515 INFO:tasks.workunit.client.0.smithi078.stdout:8/703: mkdir d0/d10/d14/d2a/d4a/db2/db6/dcc/dde 0 2024-04-18T21:07:01.520 INFO:tasks.workunit.client.0.smithi078.stdout:8/704: dwrite d0/da8/fcd [0,4194304] 0 2024-04-18T21:07:01.521 INFO:tasks.workunit.client.0.smithi078.stdout:1/781: dread d0/d2a/d2f/f56 [0,4194304] 0 2024-04-18T21:07:01.524 INFO:tasks.workunit.client.0.smithi078.stdout:7/646: dread d1/f3c [0,4194304] 0 2024-04-18T21:07:01.525 INFO:tasks.workunit.client.0.smithi078.stdout:7/647: unlink d1/d16/dc/f5f 0 2024-04-18T21:07:01.527 INFO:tasks.workunit.client.0.smithi078.stdout:8/705: dwrite d0/d10/d14/d2d/d93/da0/fab [0,4194304] 0 2024-04-18T21:07:01.528 INFO:tasks.workunit.client.0.smithi078.stdout:8/706: chown d0/d10/d14/d2a/l39 794469 1 2024-04-18T21:07:01.528 INFO:tasks.workunit.client.0.smithi078.stdout:1/782: dwrite d0/d2a/d3c/d4b/fcc [0,4194304] 0 2024-04-18T21:07:01.529 INFO:tasks.workunit.client.0.smithi078.stdout:8/707: write d0/d10/d60/d6f/f7a [2579036,69751] 0 2024-04-18T21:07:01.529 INFO:tasks.workunit.client.0.smithi078.stdout:1/783: creat d0/dc1/f101 x:0 0 0 2024-04-18T21:07:01.530 INFO:tasks.workunit.client.0.smithi078.stdout:8/708: creat d0/d5c/d5a/dc6/fdf x:0 0 0 2024-04-18T21:07:01.531 INFO:tasks.workunit.client.0.smithi078.stdout:2/628: dread d0/db/d18/d21/d8b/f92 [0,4194304] 0 2024-04-18T21:07:01.531 INFO:tasks.workunit.client.0.smithi078.stdout:8/709: fdatasync d0/fcf 0 2024-04-18T21:07:01.532 INFO:tasks.workunit.client.0.smithi078.stdout:2/629: write d0/db/d18/d5d/fba [204570,36278] 0 2024-04-18T21:07:01.532 INFO:tasks.workunit.client.0.smithi078.stdout:8/710: symlink d0/d10/le0 0 2024-04-18T21:07:01.533 INFO:tasks.workunit.client.0.smithi078.stdout:2/630: write d0/db/d18/d21/d27/d29/fa0 [575959,89401] 0 2024-04-18T21:07:01.533 INFO:tasks.workunit.client.0.smithi078.stdout:8/711: creat d0/d10/d60/d6f/fe1 x:0 0 0 2024-04-18T21:07:01.534 INFO:tasks.workunit.client.0.smithi078.stdout:2/631: getdents d0/da9 0 2024-04-18T21:07:01.535 INFO:tasks.workunit.client.0.smithi078.stdout:8/712: dread - d0/d10/d14/fa5 zero size 2024-04-18T21:07:01.536 INFO:tasks.workunit.client.0.smithi078.stdout:1/784: dwrite d0/d2a/d5f/d89/d32/db2/fef [0,4194304] 0 2024-04-18T21:07:01.536 INFO:tasks.workunit.client.0.smithi078.stdout:2/632: link d0/d1f/f2b d0/d87/d88/da1/fc4 0 2024-04-18T21:07:01.536 INFO:tasks.workunit.client.0.smithi078.stdout:8/713: rmdir d0/d10/d14 39 2024-04-18T21:07:01.537 INFO:tasks.workunit.client.0.smithi078.stdout:2/633: fsync d0/d1f/f43 0 2024-04-18T21:07:01.538 INFO:tasks.workunit.client.0.smithi078.stdout:2/634: fdatasync d0/db/d18/f1c 0 2024-04-18T21:07:01.538 INFO:tasks.workunit.client.0.smithi078.stdout:8/714: write d0/d10/d14/fa7 [794661,1923] 0 2024-04-18T21:07:01.538 INFO:tasks.workunit.client.0.smithi078.stdout:2/635: chown d0/db/f36 0 1 2024-04-18T21:07:01.539 INFO:tasks.workunit.client.0.smithi078.stdout:1/785: dread d0/d2a/d5f/d89/d32/fa7 [0,4194304] 0 2024-04-18T21:07:01.539 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:01.538+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:01.540 INFO:tasks.workunit.client.0.smithi078.stdout:1/786: stat d0/d2a/d3c/d4b/d52/l93 0 2024-04-18T21:07:01.540 INFO:tasks.workunit.client.0.smithi078.stdout:1/787: chown d0/c25 1567 1 2024-04-18T21:07:01.541 INFO:tasks.workunit.client.0.smithi078.stdout:1/788: readlink d0/d2a/d3c/d4b/d4/l26 0 2024-04-18T21:07:01.543 INFO:tasks.workunit.client.0.smithi078.stdout:1/789: mknod d0/d2a/d5f/d89/d32/d35/d85/c102 0 2024-04-18T21:07:01.544 INFO:tasks.workunit.client.0.smithi078.stdout:2/636: dwrite d0/db/fb6 [0,4194304] 0 2024-04-18T21:07:01.544 INFO:tasks.workunit.client.0.smithi078.stdout:1/790: mkdir d0/d2a/d45/d81/dc8/d103 0 2024-04-18T21:07:01.545 INFO:tasks.workunit.client.0.smithi078.stdout:8/715: dwrite d0/d10/d14/d2a/d4a/f7e [0,4194304] 0 2024-04-18T21:07:01.548 INFO:tasks.workunit.client.0.smithi078.stdout:7/648: truncate d1/d16/dc/d11/f2b 2990604 0 2024-04-18T21:07:01.548 INFO:tasks.workunit.client.0.smithi078.stdout:0/713: sync 2024-04-18T21:07:01.548 INFO:tasks.workunit.client.0.smithi078.stdout:9/749: sync 2024-04-18T21:07:01.548 INFO:tasks.workunit.client.0.smithi078.stdout:5/665: sync 2024-04-18T21:07:01.549 INFO:tasks.workunit.client.0.smithi078.stdout:2/637: rmdir d0/db/d18/d21/d27/d29/d4e 39 2024-04-18T21:07:01.549 INFO:tasks.workunit.client.0.smithi078.stdout:6/633: dread d2/d1c/d30/fc1 [0,4194304] 0 2024-04-18T21:07:01.549 INFO:tasks.workunit.client.0.smithi078.stdout:8/716: mkdir d0/d10/d14/d2d/d93/da0/db5/de2 0 2024-04-18T21:07:01.549 INFO:tasks.workunit.client.0.smithi078.stdout:1/791: creat d0/d2a/d3c/da8/de1/f104 x:0 0 0 2024-04-18T21:07:01.549 INFO:tasks.workunit.client.0.smithi078.stdout:0/714: write d0/d9/f5a [1983819,124097] 0 2024-04-18T21:07:01.550 INFO:tasks.workunit.client.0.smithi078.stdout:5/666: mkdir d9/d9f/dd4 0 2024-04-18T21:07:01.550 INFO:tasks.workunit.client.0.smithi078.stdout:8/717: chown d0/d10/d14/l40 1 1 2024-04-18T21:07:01.550 INFO:tasks.workunit.client.0.smithi078.stdout:9/750: symlink d7/df/d88/l101 0 2024-04-18T21:07:01.550 INFO:tasks.workunit.client.0.smithi078.stdout:6/634: stat d2/d1c/d63/da0/cc3 0 2024-04-18T21:07:01.550 INFO:tasks.workunit.client.0.smithi078.stdout:0/715: chown d0/d9/da 1162 1 2024-04-18T21:07:01.550 INFO:tasks.workunit.client.0.smithi078.stdout:2/638: chown d0/db/d18/d21/d8b/f92 1778467 1 2024-04-18T21:07:01.551 INFO:tasks.workunit.client.0.smithi078.stdout:5/667: rmdir d9/da/d3e/d4c/d67/d7c 39 2024-04-18T21:07:01.551 INFO:tasks.workunit.client.0.smithi078.stdout:6/635: creat d2/d34/d35/d57/d90/fd5 x:0 0 0 2024-04-18T21:07:01.552 INFO:tasks.workunit.client.0.smithi078.stdout:9/751: symlink d7/d11/d2d/d26/d7c/dda/de5/l102 0 2024-04-18T21:07:01.552 INFO:tasks.workunit.client.0.smithi078.stdout:0/716: fdatasync d0/d9/dd/d17/d2e/d31/f4a 0 2024-04-18T21:07:01.552 INFO:tasks.workunit.client.0.smithi078.stdout:7/649: link d1/d16/d1c/c54 d1/d16/dc/d11/d53/d82/da4/db5/d91/db0/cd7 0 2024-04-18T21:07:01.552 INFO:tasks.workunit.client.0.smithi078.stdout:5/668: dread - d9/da/d3e/d4c/d6d/d86/fcc zero size 2024-04-18T21:07:01.553 INFO:tasks.workunit.client.0.smithi078.stdout:8/718: rename d0/d10/d14/d2d/f35 to d0/d10/d14/d2d/d93/da0/db5/de2/fe3 0 2024-04-18T21:07:01.553 INFO:tasks.workunit.client.0.smithi078.stdout:2/639: truncate d0/db/d18/d21/d27/f68 558715 0 2024-04-18T21:07:01.554 INFO:tasks.workunit.client.0.smithi078.stdout:0/717: write d0/d9/da/f42 [1410046,40996] 0 2024-04-18T21:07:01.554 INFO:tasks.workunit.client.0.smithi078.stdout:7/650: rename d1/l27 to d1/d16/d10/dc6/dd3/ld8 0 2024-04-18T21:07:01.555 INFO:tasks.workunit.client.0.smithi078.stdout:9/752: getdents d7/d23/d3e/d5a/da8 0 2024-04-18T21:07:01.555 INFO:tasks.workunit.client.0.smithi078.stdout:8/719: symlink d0/d10/d14/d2a/d4a/db2/db6/le4 0 2024-04-18T21:07:01.556 INFO:tasks.workunit.client.0.smithi078.stdout:7/651: readlink d1/d16/dc/d11/d53/d82/da4/lbe 0 2024-04-18T21:07:01.556 INFO:tasks.workunit.client.0.smithi078.stdout:5/669: getdents d9/da/d3e/d4c/d6d/d75 0 2024-04-18T21:07:01.556 INFO:tasks.workunit.client.0.smithi078.stdout:9/753: rmdir d7/df/d54/d95/d9d 39 2024-04-18T21:07:01.557 INFO:tasks.workunit.client.0.smithi078.stdout:7/652: mknod d1/d16/d10/d7c/d7e/cd9 0 2024-04-18T21:07:01.557 INFO:tasks.workunit.client.0.smithi078.stdout:1/792: dwrite d0/d2a/d3c/d4b/d4/f3d [0,4194304] 0 2024-04-18T21:07:01.558 INFO:tasks.workunit.client.0.smithi078.stdout:7/653: unlink d1/d16/f77 0 2024-04-18T21:07:01.558 INFO:tasks.workunit.client.0.smithi078.stdout:9/754: write d7/d11/d2d/d26/fb3 [1564312,58698] 0 2024-04-18T21:07:01.559 INFO:tasks.workunit.client.0.smithi078.stdout:1/793: unlink d0/d2a/d3c/d4b/d4/f3d 0 2024-04-18T21:07:01.559 INFO:tasks.workunit.client.0.smithi078.stdout:7/654: readlink d1/d16/dc/d11/d53/d82/da4/lbe 0 2024-04-18T21:07:01.561 INFO:tasks.workunit.client.0.smithi078.stdout:9/755: dread - d7/df/d54/d95/d9d/dd1/ff3 zero size 2024-04-18T21:07:01.561 INFO:tasks.workunit.client.0.smithi078.stdout:2/640: dwrite d0/db/d18/d5d/fba [0,4194304] 0 2024-04-18T21:07:01.561 INFO:tasks.workunit.client.0.smithi078.stdout:9/756: stat d7/dcf 0 2024-04-18T21:07:01.562 INFO:tasks.workunit.client.0.smithi078.stdout:7/655: link d1/f3c d1/d16/d10/d7c/d94/dcf/fda 0 2024-04-18T21:07:01.564 INFO:tasks.workunit.client.0.smithi078.stdout:7/656: unlink d1/d16/dc/d11/d53/d82/da4/db5/d91/db0/lbb 0 2024-04-18T21:07:01.567 INFO:tasks.workunit.client.0.smithi078.stdout:7/657: dread d1/d16/d1c/d40/fa1 [0,4194304] 0 2024-04-18T21:07:01.568 INFO:tasks.workunit.client.0.smithi078.stdout:9/757: write d7/d11/d2d/fb5 [2331535,127770] 0 2024-04-18T21:07:01.568 INFO:tasks.workunit.client.0.smithi078.stdout:3/609: dread d4/df/d17/f5a [0,4194304] 0 2024-04-18T21:07:01.568 INFO:tasks.workunit.client.0.smithi078.stdout:9/758: fsync d7/d23/d3e/d5a/f5e 0 2024-04-18T21:07:01.569 INFO:tasks.workunit.client.0.smithi078.stdout:7/658: rename d1/d16/dc/c12 to d1/d16/dc/d11/d53/d82/da4/db5/cdb 0 2024-04-18T21:07:01.569 INFO:tasks.workunit.client.0.smithi078.stdout:3/610: mkdir d4/d2d/d6c/db5 0 2024-04-18T21:07:01.569 INFO:tasks.workunit.client.0.smithi078.stdout:9/759: symlink d7/df/dc0/l103 0 2024-04-18T21:07:01.570 INFO:tasks.workunit.client.0.smithi078.stdout:3/611: symlink d4/da/d76/lb6 0 2024-04-18T21:07:01.570 INFO:tasks.workunit.client.0.smithi078.stdout:2/641: dread d0/db/d18/d21/d27/f68 [0,4194304] 0 2024-04-18T21:07:01.570 INFO:tasks.workunit.client.0.smithi078.stdout:7/659: mkdir d1/d16/dc/d11/d53/d82/da4/db5/d91/db4/ddc 0 2024-04-18T21:07:01.571 INFO:tasks.workunit.client.0.smithi078.stdout:7/660: stat d1/d16/dc/d11/fd5 0 2024-04-18T21:07:01.571 INFO:tasks.workunit.client.0.smithi078.stdout:3/612: unlink d4/d2d/d30/d35/c8d 0 2024-04-18T21:07:01.571 INFO:tasks.workunit.client.0.smithi078.stdout:2/642: mknod d0/d1f/d34/cc5 0 2024-04-18T21:07:01.572 INFO:tasks.workunit.client.0.smithi078.stdout:3/613: fsync d4/d2d/d30/f34 0 2024-04-18T21:07:01.572 INFO:tasks.workunit.client.0.smithi078.stdout:2/643: write d0/db/d18/d30/fab [91662,20102] 0 2024-04-18T21:07:01.573 INFO:tasks.workunit.client.0.smithi078.stdout:3/614: stat d4/d2d/d6c/cb1 0 2024-04-18T21:07:01.573 INFO:tasks.workunit.client.0.smithi078.stdout:2/644: creat d0/d1f/d5b/fc6 x:0 0 0 2024-04-18T21:07:01.575 INFO:tasks.workunit.client.0.smithi078.stdout:3/615: chown d4/da/d5e/faf 7691344 1 2024-04-18T21:07:01.575 INFO:tasks.workunit.client.0.smithi078.stdout:4/761: dread d0/dc/f55 [0,4194304] 0 2024-04-18T21:07:01.576 INFO:tasks.workunit.client.0.smithi078.stdout:4/762: write d0/dc/d5b/f62 [146142,113178] 0 2024-04-18T21:07:01.576 INFO:tasks.workunit.client.0.smithi078.stdout:9/760: dwrite d7/df/d54/d95/fe4 [0,4194304] 0 2024-04-18T21:07:01.578 INFO:tasks.workunit.client.0.smithi078.stdout:8/720: dread d0/f5 [0,4194304] 0 2024-04-18T21:07:01.578 INFO:tasks.workunit.client.0.smithi078.stdout:8/721: stat d0/d10/d60/d6f/f7f 0 2024-04-18T21:07:01.580 INFO:tasks.workunit.client.0.smithi078.stdout:4/763: link d0/d73/da9/fd6 d0/dc/d10/d1c/d60/dee/db8/f104 0 2024-04-18T21:07:01.580 INFO:tasks.workunit.client.0.smithi078.stdout:8/722: mknod d0/d5c/d5a/ce5 0 2024-04-18T21:07:01.580 INFO:tasks.workunit.client.0.smithi078.stdout:2/645: dwrite d0/db/d18/d21/d27/f68 [0,4194304] 0 2024-04-18T21:07:01.586 INFO:tasks.workunit.client.0.smithi078.stdout:7/661: dread d1/d16/dc/d11/d53/f58 [0,4194304] 0 2024-04-18T21:07:01.587 INFO:tasks.workunit.client.0.smithi078.stdout:7/662: rmdir d1/d16/dc/d11/d53/d82/da4 39 2024-04-18T21:07:01.589 INFO:tasks.workunit.client.0.smithi078.stdout:7/663: creat d1/d16/dc/d11/fdd x:0 0 0 2024-04-18T21:07:01.589 INFO:tasks.workunit.client.0.smithi078.stdout:2/646: dwrite d0/d1f/fc2 [0,4194304] 0 2024-04-18T21:07:01.590 INFO:tasks.workunit.client.0.smithi078.stdout:6/636: dread d2/ff [0,4194304] 0 2024-04-18T21:07:01.590 INFO:tasks.workunit.client.0.smithi078.stdout:2/647: write d0/d1f/d5b/fc6 [824493,43924] 0 2024-04-18T21:07:01.591 INFO:tasks.workunit.client.0.smithi078.stdout:8/723: read d0/d10/d14/f29 [1405890,58590] 0 2024-04-18T21:07:01.591 INFO:tasks.workunit.client.0.smithi078.stdout:2/648: mkdir d0/d87/d88/da1/dc7 0 2024-04-18T21:07:01.591 INFO:tasks.workunit.client.0.smithi078.stdout:6/637: mkdir d2/d6/dd6 0 2024-04-18T21:07:01.592 INFO:tasks.workunit.client.0.smithi078.stdout:6/638: mknod d2/d1c/d67/cd7 0 2024-04-18T21:07:01.592 INFO:tasks.workunit.client.0.smithi078.stdout:2/649: fsync d0/db/d18/f1c 0 2024-04-18T21:07:01.593 INFO:tasks.workunit.client.0.smithi078.stdout:0/718: dread d0/d9/da/f84 [0,4194304] 0 2024-04-18T21:07:01.593 INFO:tasks.workunit.client.0.smithi078.stdout:6/639: write d2/d1f/f58 [1585673,107071] 0 2024-04-18T21:07:01.593 INFO:tasks.workunit.client.0.smithi078.stdout:2/650: creat d0/db/d65/dbd/fc8 x:0 0 0 2024-04-18T21:07:01.594 INFO:tasks.workunit.client.0.smithi078.stdout:6/640: creat d2/d1c/d67/fd8 x:0 0 0 2024-04-18T21:07:01.594 INFO:tasks.workunit.client.0.smithi078.stdout:2/651: creat d0/d1f/d34/fc9 x:0 0 0 2024-04-18T21:07:01.595 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:01.595 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:01.595 INFO:tasks.workunit.client.0.smithi078.stdout:2/652: chown d0/d87/d88/cc1 4742838 1 2024-04-18T21:07:01.596 INFO:tasks.workunit.client.0.smithi078.stdout:2/653: chown d0/d1f/d5b/la3 21475277 1 2024-04-18T21:07:01.597 INFO:tasks.workunit.client.0.smithi078.stdout:0/719: dread d0/d9/f2d [0,4194304] 0 2024-04-18T21:07:01.597 INFO:tasks.workunit.client.0.smithi078.stdout:8/724: dwrite d0/fcf [4194304,4194304] 0 2024-04-18T21:07:01.597 INFO:tasks.workunit.client.0.smithi078.stdout:2/654: chown d0/db/l24 252182 1 2024-04-18T21:07:01.597 INFO:tasks.workunit.client.0.smithi078.stdout:0/720: chown d0/d9/d7d/fc8 94139 1 2024-04-18T21:07:01.597 INFO:tasks.workunit.client.0.smithi078.stdout:2/655: chown d0/d1f/d5b/fc6 32 1 2024-04-18T21:07:01.598 INFO:tasks.workunit.client.0.smithi078.stdout:8/725: fdatasync d0/d10/d14/f9b 0 2024-04-18T21:07:01.598 INFO:tasks.workunit.client.0.smithi078.stdout:8/726: write d0/f89 [285801,66610] 0 2024-04-18T21:07:01.599 INFO:tasks.workunit.client.0.smithi078.stdout:8/727: mknod d0/d10/d14/d2a/d3c/ce6 0 2024-04-18T21:07:01.601 INFO:tasks.workunit.client.0.smithi078.stdout:2/656: link d0/db/d18/d21/d27/d29/d33/cbe d0/db/d18/d21/d27/d29/cca 0 2024-04-18T21:07:01.601 INFO:tasks.workunit.client.0.smithi078.stdout:8/728: getdents d0/d10/d14/d2a/d4a/db2/db6/dcc 0 2024-04-18T21:07:01.604 INFO:tasks.workunit.client.0.smithi078.stdout:0/721: dwrite d0/d9/da/db/d35/f5d [0,4194304] 0 2024-04-18T21:07:01.606 INFO:tasks.workunit.client.0.smithi078.stdout:0/722: creat d0/d9/da/db/d35/d3f/fe0 x:0 0 0 2024-04-18T21:07:01.607 INFO:tasks.workunit.client.0.smithi078.stdout:1/794: dread d0/d2a/d5f/d89/dc2/f9d [0,4194304] 0 2024-04-18T21:07:01.611 INFO:tasks.workunit.client.0.smithi078.stdout:8/729: dread d0/d10/d14/f1e [0,4194304] 0 2024-04-18T21:07:01.611 INFO:tasks.workunit.client.0.smithi078.stdout:8/730: read d0/d10/f1c [1473266,90932] 0 2024-04-18T21:07:01.612 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:07:01.612 INFO:tasks.workunit.client.0.smithi078.stdout:8/731: dread - d0/d10/d60/d6f/fca zero size 2024-04-18T21:07:01.613 INFO:tasks.workunit.client.0.smithi078.stdout:4/764: dread d0/dc/d29/f4c [0,4194304] 0 2024-04-18T21:07:01.613 INFO:tasks.workunit.client.0.smithi078.stdout:8/732: write d0/d10/d14/d2d/f31 [4847301,45603] 0 2024-04-18T21:07:01.613 INFO:tasks.workunit.client.0.smithi078.stdout:4/765: write d0/dc/d5b/f62 [1763464,26646] 0 2024-04-18T21:07:01.614 INFO:tasks.workunit.client.0.smithi078.stdout:8/733: creat d0/d10/d14/d2a/fe7 x:0 0 0 2024-04-18T21:07:01.615 INFO:tasks.workunit.client.0.smithi078.stdout:4/766: getdents d0/dc/d37 0 2024-04-18T21:07:01.615 INFO:tasks.workunit.client.0.smithi078.stdout:8/734: unlink d0/d5c/fa4 0 2024-04-18T21:07:01.615 INFO:tasks.workunit.client.0.smithi078.stdout:4/767: readlink d0/dc/d10/d1c/l27 0 2024-04-18T21:07:01.616 INFO:tasks.workunit.client.0.smithi078.stdout:4/768: mknod d0/dc/d29/d6d/d7b/c105 0 2024-04-18T21:07:01.616 INFO:tasks.workunit.client.0.smithi078.stdout:1/795: dread d0/d2a/d2f/d9b/fb8 [0,4194304] 0 2024-04-18T21:07:01.617 INFO:tasks.workunit.client.0.smithi078.stdout:0/723: dread d0/d9/dd/d17/d2e/f71 [0,4194304] 0 2024-04-18T21:07:01.617 INFO:tasks.workunit.client.0.smithi078.stdout:4/769: creat d0/dc/d10/d1c/d60/dee/db8/f106 x:0 0 0 2024-04-18T21:07:01.617 INFO:tasks.workunit.client.0.smithi078.stdout:1/796: write d0/d11/d69/f97 [997229,115123] 0 2024-04-18T21:07:01.617 INFO:tasks.workunit.client.0.smithi078.stdout:2/657: dread d0/db/d18/f1c [0,4194304] 0 2024-04-18T21:07:01.618 INFO:tasks.workunit.client.0.smithi078.stdout:0/724: creat d0/d9/da/db/d35/d3f/fe1 x:0 0 0 2024-04-18T21:07:01.618 INFO:tasks.workunit.client.0.smithi078.stdout:1/797: mknod d0/d2a/d2f/dc6/c105 0 2024-04-18T21:07:01.618 INFO:tasks.workunit.client.0.smithi078.stdout:4/770: mknod d0/dc/d10/d1c/d6a/c107 0 2024-04-18T21:07:01.619 INFO:tasks.workunit.client.0.smithi078.stdout:5/670: sync 2024-04-18T21:07:01.619 INFO:tasks.workunit.client.0.smithi078.stdout:1/798: write d0/d2a/d3c/d4b/d4/fe2 [566119,38714] 0 2024-04-18T21:07:01.619 INFO:tasks.workunit.client.0.smithi078.stdout:4/771: creat d0/dc/d10/d1c/d6a/f108 x:0 0 0 2024-04-18T21:07:01.619 INFO:tasks.workunit.client.0.smithi078.stdout:2/658: getdents d0/db/d18/d21/d27/d29/d4e/dbc 0 2024-04-18T21:07:01.621 INFO:tasks.workunit.client.0.smithi078.stdout:4/772: write d0/dc/d29/d6d/ff1 [1095583,112807] 0 2024-04-18T21:07:01.621 INFO:tasks.workunit.client.0.smithi078.stdout:5/671: symlink d9/da/d3e/d4c/d6d/d73/ld5 0 2024-04-18T21:07:01.621 INFO:tasks.workunit.client.0.smithi078.stdout:5/672: chown d9/d2e/l50 581471890 1 2024-04-18T21:07:01.621 INFO:tasks.workunit.client.0.smithi078.stdout:4/773: write d0/dc/d10/d3a/fed [489673,74484] 0 2024-04-18T21:07:01.622 INFO:tasks.workunit.client.0.smithi078.stdout:5/673: dread - d9/da/d4b/d8b/fd1 zero size 2024-04-18T21:07:01.623 INFO:tasks.workunit.client.0.smithi078.stdout:5/674: fsync d9/da/d3e/d4c/d67/d8d/fca 0 2024-04-18T21:07:01.623 INFO:tasks.workunit.client.0.smithi078.stdout:9/761: dread d7/f37 [0,4194304] 0 2024-04-18T21:07:01.623 INFO:tasks.workunit.client.0.smithi078.stdout:4/774: getdents d0/dc/d10/d1c/d60/d74 0 2024-04-18T21:07:01.624 INFO:tasks.workunit.client.0.smithi078.stdout:5/675: truncate d9/d2e/f23 4735780 0 2024-04-18T21:07:01.624 INFO:tasks.workunit.client.0.smithi078.stdout:0/725: dread d0/d9/d81/fa7 [0,4194304] 0 2024-04-18T21:07:01.624 INFO:tasks.workunit.client.0.smithi078.stdout:1/799: dread d0/d2a/d5f/d89/d32/d35/d71/fac [0,4194304] 0 2024-04-18T21:07:01.624 INFO:tasks.workunit.client.0.smithi078.stdout:5/676: readlink d9/da/d3e/d4c/l5e 0 2024-04-18T21:07:01.625 INFO:tasks.workunit.client.0.smithi078.stdout:5/677: write d9/da/d4b/f4e [3800985,78834] 0 2024-04-18T21:07:01.625 INFO:tasks.workunit.client.0.smithi078.stdout:1/800: write d0/d2a/d3c/d4b/d52/fe5 [4406337,113442] 0 2024-04-18T21:07:01.626 INFO:tasks.workunit.client.0.smithi078.stdout:0/726: getdents d0/d9/d4c/d8f 0 2024-04-18T21:07:01.626 INFO:tasks.workunit.client.0.smithi078.stdout:1/801: write d0/dc1/f101 [852247,16192] 0 2024-04-18T21:07:01.626 INFO:tasks.workunit.client.0.smithi078.stdout:5/678: write d9/da/d32/da5/fa9 [630810,78158] 0 2024-04-18T21:07:01.627 INFO:tasks.workunit.client.0.smithi078.stdout:0/727: creat d0/d9/d81/fe2 x:0 0 0 2024-04-18T21:07:01.627 INFO:tasks.workunit.client.0.smithi078.stdout:1/802: creat d0/d2a/d2f/d9b/f106 x:0 0 0 2024-04-18T21:07:01.628 INFO:tasks.workunit.client.0.smithi078.stdout:5/679: read - d9/da/d3e/d4c/d6d/d75/dad/fc2 zero size 2024-04-18T21:07:01.628 INFO:tasks.workunit.client.0.smithi078.stdout:0/728: mkdir d0/d9/da/df/de3 0 2024-04-18T21:07:01.629 INFO:tasks.workunit.client.0.smithi078.stdout:0/729: truncate d0/d6c/f8a 4641547 0 2024-04-18T21:07:01.630 INFO:tasks.workunit.client.0.smithi078.stdout:5/680: fsync d9/da/d3e/d4c/d67/f96 0 2024-04-18T21:07:01.630 INFO:tasks.workunit.client.0.smithi078.stdout:4/775: dwrite d0/dc/d29/d2f/fc5 [0,4194304] 0 2024-04-18T21:07:01.630 INFO:tasks.workunit.client.0.smithi078.stdout:0/730: chown d0/d9/d81/daa 234643963 1 2024-04-18T21:07:01.631 INFO:tasks.workunit.client.0.smithi078.stdout:0/731: write d0/d9/dd/d17/d2e/d31/f4a [559694,54538] 0 2024-04-18T21:07:01.634 INFO:tasks.workunit.client.0.smithi078.stdout:4/776: mknod d0/dc/d29/d6d/d7b/c109 0 2024-04-18T21:07:01.634 INFO:tasks.workunit.client.0.smithi078.stdout:0/732: creat d0/d9/d4c/fe4 x:0 0 0 2024-04-18T21:07:01.634 INFO:tasks.workunit.client.0.smithi078.stdout:5/681: mknod d9/da/d99/cd6 0 2024-04-18T21:07:01.634 INFO:tasks.workunit.client.0.smithi078.stdout:0/733: dread - d0/fd9 zero size 2024-04-18T21:07:01.634 INFO:tasks.workunit.client.0.smithi078.stdout:2/659: truncate d0/db/d18/d21/d27/f56 389405 0 2024-04-18T21:07:01.635 INFO:tasks.workunit.client.0.smithi078.stdout:4/777: write d0/dc/d10/d1c/d60/f90 [893835,87485] 0 2024-04-18T21:07:01.636 INFO:tasks.workunit.client.0.smithi078.stdout:5/682: chown d9/da/d3e/d4c/f5a 1561 1 2024-04-18T21:07:01.636 INFO:tasks.workunit.client.0.smithi078.stdout:1/803: dwrite d0/d2a/d3c/da8/de1/f104 [0,4194304] 0 2024-04-18T21:07:01.637 INFO:tasks.workunit.client.0.smithi078.stdout:5/683: chown d9/da/d3e/d4c/d6d/d75/dbc/fc5 315212844 1 2024-04-18T21:07:01.638 INFO:tasks.workunit.client.0.smithi078.stdout:2/660: truncate d0/db/d18/d21/d27/d29/d4e/f82 1170647 0 2024-04-18T21:07:01.638 INFO:tasks.workunit.client.0.smithi078.stdout:5/684: dread d9/d2e/f9e [0,4194304] 0 2024-04-18T21:07:01.640 INFO:tasks.workunit.client.0.smithi078.stdout:5/685: rmdir d9/da/d3e/d4c/d6d/d75/dad 39 2024-04-18T21:07:01.640 INFO:tasks.workunit.client.0.smithi078.stdout:1/804: creat d0/d2a/d5f/d89/d32/d35/d85/f107 x:0 0 0 2024-04-18T21:07:01.640 INFO:tasks.workunit.client.0.smithi078.stdout:7/664: sync 2024-04-18T21:07:01.640 INFO:tasks.workunit.client.0.smithi078.stdout:6/641: sync 2024-04-18T21:07:01.640 INFO:tasks.workunit.client.0.smithi078.stdout:8/735: sync 2024-04-18T21:07:01.640 INFO:tasks.workunit.client.0.smithi078.stdout:3/616: sync 2024-04-18T21:07:01.640 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:01.638+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:01.641 INFO:tasks.workunit.client.0.smithi078.stdout:6/642: creat d2/d34/fd9 x:0 0 0 2024-04-18T21:07:01.642 INFO:tasks.workunit.client.0.smithi078.stdout:3/617: chown d4/d2d/d6c/c9b 130 1 2024-04-18T21:07:01.643 INFO:tasks.workunit.client.0.smithi078.stdout:7/665: write d1/d16/d2d/f7d [667688,70327] 0 2024-04-18T21:07:01.643 INFO:tasks.workunit.client.0.smithi078.stdout:9/762: dread f6 [0,4194304] 0 2024-04-18T21:07:01.643 INFO:tasks.workunit.client.0.smithi078.stdout:7/666: fsync d1/d16/d10/f13 0 2024-04-18T21:07:01.644 INFO:tasks.workunit.client.0.smithi078.stdout:8/736: link d0/d10/d14/d2d/d93/f81 d0/d10/d9d/fe8 0 2024-04-18T21:07:01.644 INFO:tasks.workunit.client.0.smithi078.stdout:9/763: fdatasync d7/d11/d2d/d3f/f100 0 2024-04-18T21:07:01.645 INFO:tasks.workunit.client.0.smithi078.stdout:7/667: fdatasync d1/d16/d10/d5a/fc2 0 2024-04-18T21:07:01.645 INFO:tasks.workunit.client.0.smithi078.stdout:6/643: truncate d2/d6/dd/d4b/d5d/f6d 1186570 0 2024-04-18T21:07:01.645 INFO:tasks.workunit.client.0.smithi078.stdout:9/764: readlink d7/df/dc0/l103 0 2024-04-18T21:07:01.645 INFO:tasks.workunit.client.0.smithi078.stdout:2/661: dwrite d0/d87/f8a [0,4194304] 0 2024-04-18T21:07:01.647 INFO:tasks.workunit.client.0.smithi078.stdout:3/618: dread d4/f18 [0,4194304] 0 2024-04-18T21:07:01.647 INFO:tasks.workunit.client.0.smithi078.stdout:6/644: chown d2/d1f/l7d 11892364 1 2024-04-18T21:07:01.647 INFO:tasks.workunit.client.0.smithi078.stdout:9/765: rename d7/d11/d1b/d77/ld9 to d7/d11/d2d/d3f/d4d/l104 0 2024-04-18T21:07:01.648 INFO:tasks.workunit.client.0.smithi078.stdout:3/619: mknod d4/d2d/d6c/db5/cb7 0 2024-04-18T21:07:01.648 INFO:tasks.workunit.client.0.smithi078.stdout:7/668: creat d1/d16/dc/d11/d53/d82/da4/db5/d91/db4/fde x:0 0 0 2024-04-18T21:07:01.649 INFO:tasks.workunit.client.0.smithi078.stdout:9/766: read - d7/d23/d3e/d5a/da8/db0/fe0 zero size 2024-04-18T21:07:01.649 INFO:tasks.workunit.client.0.smithi078.stdout:7/669: chown d1/d16/d65/f6a 254778 1 2024-04-18T21:07:01.650 INFO:tasks.workunit.client.0.smithi078.stdout:3/620: rename d4/d2d/f5d to d4/df/d17/fb8 0 2024-04-18T21:07:01.650 INFO:tasks.workunit.client.0.smithi078.stdout:7/670: symlink d1/d16/dc/d11/d53/d82/da4/db5/d91/db4/ldf 0 2024-04-18T21:07:01.651 INFO:tasks.workunit.client.0.smithi078.stdout:3/621: write d4/df/d17/f5a [4351270,25816] 0 2024-04-18T21:07:01.651 INFO:tasks.workunit.client.0.smithi078.stdout:6/645: read d2/d1c/d63/d8b/fb5 [42591,89364] 0 2024-04-18T21:07:01.652 INFO:tasks.workunit.client.0.smithi078.stdout:3/622: creat d4/df/d17/d74/fb9 x:0 0 0 2024-04-18T21:07:01.652 INFO:tasks.workunit.client.0.smithi078.stdout:8/737: creat d0/d10/d14/d2a/ddd/fe9 x:0 0 0 2024-04-18T21:07:01.653 INFO:tasks.workunit.client.0.smithi078.stdout:6/646: creat d2/d34/d75/fda x:0 0 0 2024-04-18T21:07:01.654 INFO:tasks.workunit.client.0.smithi078.stdout:6/647: truncate d2/d6/dd/d4b/d5d/fa4 1199379 0 2024-04-18T21:07:01.655 INFO:tasks.workunit.client.0.smithi078.stdout:6/648: readlink d2/d1f/l2d 0 2024-04-18T21:07:01.656 INFO:tasks.workunit.client.0.smithi078.stdout:6/649: dread - d2/d1c/d63/f4f zero size 2024-04-18T21:07:01.657 INFO:tasks.workunit.client.0.smithi078.stdout:2/662: dread d0/db/d18/d21/d27/d29/d4e/f82 [0,4194304] 0 2024-04-18T21:07:01.658 INFO:tasks.workunit.client.0.smithi078.stdout:6/650: write d2/d1c/d6b/dba/fc8 [111614,29745] 0 2024-04-18T21:07:01.659 INFO:tasks.workunit.client.0.smithi078.stdout:4/778: dread d0/dc/d10/d1c/d60/d74/fb1 [0,4194304] 0 2024-04-18T21:07:01.659 INFO:tasks.workunit.client.0.smithi078.stdout:2/663: chown d0/db/d18/d21/d27/d29/d4e/f80 710506 1 2024-04-18T21:07:01.660 INFO:tasks.workunit.client.0.smithi078.stdout:0/734: sync 2024-04-18T21:07:01.660 INFO:tasks.workunit.client.0.smithi078.stdout:3/623: dwrite d4/d2d/f8b [0,4194304] 0 2024-04-18T21:07:01.660 INFO:tasks.workunit.client.0.smithi078.stdout:6/651: creat d2/d6/fdb x:0 0 0 2024-04-18T21:07:01.660 INFO:tasks.workunit.client.0.smithi078.stdout:8/738: dwrite d0/d5c/d5a/d7b/fbf [0,4194304] 0 2024-04-18T21:07:01.661 INFO:tasks.workunit.client.0.smithi078.stdout:2/664: sync 2024-04-18T21:07:01.661 INFO:tasks.workunit.client.0.smithi078.stdout:3/624: sync 2024-04-18T21:07:01.662 INFO:tasks.workunit.client.0.smithi078.stdout:0/735: write d0/d9/d4c/d8f/dc5/fc9 [647364,9063] 0 2024-04-18T21:07:01.662 INFO:tasks.workunit.client.0.smithi078.stdout:8/739: chown d0/d10/d14/d2d/d93/da0/dc2/cd4 498729697 1 2024-04-18T21:07:01.663 INFO:tasks.workunit.client.0.smithi078.stdout:6/652: write d2/d34/d35/d57/d90/fd5 [175901,111290] 0 2024-04-18T21:07:01.664 INFO:tasks.workunit.client.0.smithi078.stdout:7/671: dread d1/d16/dc/d11/d53/d82/da4/db5/fb9 [0,4194304] 0 2024-04-18T21:07:01.664 INFO:tasks.workunit.client.0.smithi078.stdout:7/672: chown d1/d16/dc/d11/l33 12 1 2024-04-18T21:07:01.664 INFO:tasks.workunit.client.0.smithi078.stdout:9/767: truncate d7/d23/d3e/d5a/dca/ff1 163794 0 2024-04-18T21:07:01.664 INFO:tasks.workunit.client.0.smithi078.stdout:2/665: rmdir d0/db/d18/d21/db0 39 2024-04-18T21:07:01.664 INFO:tasks.workunit.client.0.smithi078.stdout:3/625: creat d4/da/d76/fba x:0 0 0 2024-04-18T21:07:01.665 INFO:tasks.workunit.client.0.smithi078.stdout:0/736: mkdir d0/d9/d4c/d6b/d9b/de5 0 2024-04-18T21:07:01.665 INFO:tasks.workunit.client.0.smithi078.stdout:8/740: write d0/d5c/d5a/d7b/f8a [99922,122339] 0 2024-04-18T21:07:01.667 INFO:tasks.workunit.client.0.smithi078.stdout:9/768: creat d7/d11/df0/df6/f105 x:0 0 0 2024-04-18T21:07:01.667 INFO:tasks.workunit.client.0.smithi078.stdout:7/673: chown d1/d16/d10/d7c/d94/dcf/fda 213057 1 2024-04-18T21:07:01.667 INFO:tasks.workunit.client.0.smithi078.stdout:6/653: creat d2/d1c/d3a/d8c/fdc x:0 0 0 2024-04-18T21:07:01.667 INFO:tasks.workunit.client.0.smithi078.stdout:6/654: fsync d2/d1c/d3a/fd0 0 2024-04-18T21:07:01.668 INFO:tasks.workunit.client.0.smithi078.stdout:9/769: readlink d7/d11/d1b/d45/d4b/lfb 0 2024-04-18T21:07:01.668 INFO:tasks.workunit.client.0.smithi078.stdout:7/674: mkdir d1/d16/d10/d7c/d94/de0 0 2024-04-18T21:07:01.669 INFO:tasks.workunit.client.0.smithi078.stdout:2/666: write d0/db/d18/d21/d27/d29/d4e/f71 [9156564,35420] 0 2024-04-18T21:07:01.669 INFO:tasks.workunit.client.0.smithi078.stdout:3/626: rename d4/df/l50 to d4/df/d17/d74/lbb 0 2024-04-18T21:07:01.669 INFO:tasks.workunit.client.0.smithi078.stdout:2/667: dread - d0/d1f/f9e zero size 2024-04-18T21:07:01.670 INFO:tasks.workunit.client.0.smithi078.stdout:9/770: readlink d7/d11/d2d/l79 0 2024-04-18T21:07:01.670 INFO:tasks.workunit.client.0.smithi078.stdout:6/655: rename d2/d6/dd/f69 to d2/fdd 0 2024-04-18T21:07:01.670 INFO:tasks.workunit.client.0.smithi078.stdout:3/627: creat d4/d2d/d6c/db5/fbc x:0 0 0 2024-04-18T21:07:01.670 INFO:tasks.workunit.client.0.smithi078.stdout:7/675: unlink d1/d16/d10/d7c/cd1 0 2024-04-18T21:07:01.670 INFO:tasks.workunit.client.0.smithi078.stdout:2/668: fdatasync d0/f55 0 2024-04-18T21:07:01.671 INFO:tasks.workunit.client.0.smithi078.stdout:7/676: readlink d1/d16/d10/l4a 0 2024-04-18T21:07:01.671 INFO:tasks.workunit.client.0.smithi078.stdout:9/771: mkdir d7/d11/d2d/d106 0 2024-04-18T21:07:01.671 INFO:tasks.workunit.client.0.smithi078.stdout:4/779: dread d0/d73/da9/fbd [0,4194304] 0 2024-04-18T21:07:01.673 INFO:tasks.workunit.client.0.smithi078.stdout:5/686: dread d9/da/d32/f51 [0,4194304] 0 2024-04-18T21:07:01.674 INFO:tasks.workunit.client.0.smithi078.stdout:2/669: write d0/db/d18/d21/d27/d29/f69 [605947,121812] 0 2024-04-18T21:07:01.675 INFO:tasks.workunit.client.0.smithi078.stdout:8/741: dwrite d0/d5c/f94 [0,4194304] 0 2024-04-18T21:07:01.675 INFO:tasks.workunit.client.0.smithi078.stdout:9/772: creat d7/d11/d80/f107 x:0 0 0 2024-04-18T21:07:01.675 INFO:tasks.workunit.client.0.smithi078.stdout:7/677: rmdir d1/d16/dc/d11/d53/d82/da4/db5 39 2024-04-18T21:07:01.676 INFO:tasks.workunit.client.0.smithi078.stdout:2/670: creat d0/d1f/fcb x:0 0 0 2024-04-18T21:07:01.676 INFO:tasks.workunit.client.0.smithi078.stdout:0/737: dwrite d0/d9/d58/f7e [0,4194304] 0 2024-04-18T21:07:01.676 INFO:tasks.workunit.client.0.smithi078.stdout:4/780: mknod d0/dc/d10/d1c/d60/daf/c10a 0 2024-04-18T21:07:01.677 INFO:tasks.workunit.client.0.smithi078.stdout:9/773: write d7/df/d67/f89 [1403236,99049] 0 2024-04-18T21:07:01.677 INFO:tasks.workunit.client.0.smithi078.stdout:3/628: link d4/da/d11/d66/l69 d4/da/d11/lbd 0 2024-04-18T21:07:01.678 INFO:tasks.workunit.client.0.smithi078.stdout:7/678: rename d1/d16/dc/d4b/l81 to d1/d16/d1c/le1 0 2024-04-18T21:07:01.678 INFO:tasks.workunit.client.0.smithi078.stdout:6/656: creat d2/d1c/d63/d8b/dcb/fde x:0 0 0 2024-04-18T21:07:01.678 INFO:tasks.workunit.client.0.smithi078.stdout:2/671: creat d0/db/d18/d21/d27/d29/d4e/fcc x:0 0 0 2024-04-18T21:07:01.678 INFO:tasks.workunit.client.0.smithi078.stdout:8/742: creat d0/d10/fea x:0 0 0 2024-04-18T21:07:01.679 INFO:tasks.workunit.client.0.smithi078.stdout:9/774: mknod d7/d11/d2d/d106/c108 0 2024-04-18T21:07:01.679 INFO:tasks.workunit.client.0.smithi078.stdout:7/679: fdatasync d1/d16/d1c/f2a 0 2024-04-18T21:07:01.679 INFO:tasks.workunit.client.0.smithi078.stdout:0/738: creat d0/d9/fe6 x:0 0 0 2024-04-18T21:07:01.680 INFO:tasks.workunit.client.0.smithi078.stdout:2/672: chown d0/d87/d88 148378377 1 2024-04-18T21:07:01.680 INFO:tasks.workunit.client.0.smithi078.stdout:6/657: creat d2/dbf/fdf x:0 0 0 2024-04-18T21:07:01.681 INFO:tasks.workunit.client.0.smithi078.stdout:5/687: dread d9/da/d3e/d4c/f5a [0,4194304] 0 2024-04-18T21:07:01.681 INFO:tasks.workunit.client.0.smithi078.stdout:2/673: unlink d0/d1f/d34/l42 0 2024-04-18T21:07:01.682 INFO:tasks.workunit.client.0.smithi078.stdout:3/629: rename d4/da/d57 to d4/da/d11/d66/dbe 0 2024-04-18T21:07:01.682 INFO:tasks.workunit.client.0.smithi078.stdout:5/688: creat d9/da/d90/d62/fd7 x:0 0 0 2024-04-18T21:07:01.683 INFO:tasks.workunit.client.0.smithi078.stdout:6/658: creat d2/d1f/fe0 x:0 0 0 2024-04-18T21:07:01.683 INFO:tasks.workunit.client.0.smithi078.stdout:2/674: symlink d0/db/d18/d21/d27/d29/d57/lcd 0 2024-04-18T21:07:01.683 INFO:tasks.workunit.client.0.smithi078.stdout:8/743: creat d0/d10/feb x:0 0 0 2024-04-18T21:07:01.684 INFO:tasks.workunit.client.0.smithi078.stdout:3/630: chown d4/d2d/f8b 502370 1 2024-04-18T21:07:01.684 INFO:tasks.workunit.client.0.smithi078.stdout:7/680: chown d1/d16/dc/d11/d53/d82/c8d 68874 1 2024-04-18T21:07:01.684 INFO:tasks.workunit.client.0.smithi078.stdout:8/744: chown d0/d22 3912 1 2024-04-18T21:07:01.685 INFO:tasks.workunit.client.0.smithi078.stdout:0/739: getdents d0/d6c/d9d 0 2024-04-18T21:07:01.686 INFO:tasks.workunit.client.0.smithi078.stdout:6/659: creat d2/d1c/d6b/d98/fe1 x:0 0 0 2024-04-18T21:07:01.686 INFO:tasks.workunit.client.0.smithi078.stdout:3/631: creat d4/da/d11/d66/fbf x:0 0 0 2024-04-18T21:07:01.687 INFO:tasks.workunit.client.0.smithi078.stdout:5/689: read d9/da/d3e/d4c/d67/d7c/fac [14276,20828] 0 2024-04-18T21:07:01.688 INFO:tasks.workunit.client.0.smithi078.stdout:6/660: creat d2/d1c/d63/d8b/dcb/fe2 x:0 0 0 2024-04-18T21:07:01.688 INFO:tasks.workunit.client.0.smithi078.stdout:4/781: dwrite d0/dc/d10/d1c/d60/dee/db8/fcc [0,4194304] 0 2024-04-18T21:07:01.688 INFO:tasks.workunit.client.0.smithi078.stdout:0/740: write d0/d9/da/fa4 [1451658,11023] 0 2024-04-18T21:07:01.688 INFO:tasks.workunit.client.0.smithi078.stdout:7/681: truncate d1/d16/d10/f19 5021605 0 2024-04-18T21:07:01.690 INFO:tasks.workunit.client.0.smithi078.stdout:8/745: mknod d0/d10/d14/d2a/d4a/db2/db6/dcc/cec 0 2024-04-18T21:07:01.691 INFO:tasks.workunit.client.0.smithi078.stdout:3/632: write d4/da/d11/d66/fb3 [921365,27128] 0 2024-04-18T21:07:01.691 INFO:tasks.workunit.client.0.smithi078.stdout:9/775: dwrite d7/d11/d2d/d26/d7c/dda/fbe [0,4194304] 0 2024-04-18T21:07:01.691 INFO:tasks.workunit.client.0.smithi078.stdout:7/682: creat d1/d16/d65/fe2 x:0 0 0 2024-04-18T21:07:01.692 INFO:tasks.workunit.client.0.smithi078.stdout:0/741: mkdir d0/d9/d4c/d6b/de7 0 2024-04-18T21:07:01.692 INFO:tasks.workunit.client.0.smithi078.stdout:7/683: chown d1/d32 1676796649 1 2024-04-18T21:07:01.693 INFO:tasks.workunit.client.0.smithi078.stdout:5/690: creat d9/da/d3e/d4c/d6d/d75/fd8 x:0 0 0 2024-04-18T21:07:01.693 INFO:tasks.workunit.client.0.smithi078.stdout:3/633: write d4/da/f81 [175295,122168] 0 2024-04-18T21:07:01.693 INFO:tasks.workunit.client.0.smithi078.stdout:2/675: dwrite d0/fe [0,4194304] 0 2024-04-18T21:07:01.694 INFO:tasks.workunit.client.0.smithi078.stdout:4/782: link d0/dc/d37/f76 d0/f10b 0 2024-04-18T21:07:01.694 INFO:tasks.workunit.client.0.smithi078.stdout:0/742: chown d0/d9/d4c/d8f/cd1 802 1 2024-04-18T21:07:01.694 INFO:tasks.workunit.client.0.smithi078.stdout:9/776: mknod d7/d11/d2d/d3f/df9/c109 0 2024-04-18T21:07:01.695 INFO:tasks.workunit.client.0.smithi078.stdout:1/805: dread d0/d2a/d2f/f9a [0,4194304] 0 2024-04-18T21:07:01.695 INFO:tasks.workunit.client.0.smithi078.stdout:8/746: mknod d0/d10/d14/d2d/d93/da0/db5/db9/ced 0 2024-04-18T21:07:01.696 INFO:tasks.workunit.client.0.smithi078.stdout:3/634: creat d4/df/d17/d74/da0/fc0 x:0 0 0 2024-04-18T21:07:01.696 INFO:tasks.workunit.client.0.smithi078.stdout:9/777: rename d7/d23 to d7/df/d54/d95/d9d/dd1/d10a 0 2024-04-18T21:07:01.697 INFO:tasks.workunit.client.0.smithi078.stdout:1/806: creat d0/d2a/d3c/da8/f108 x:0 0 0 2024-04-18T21:07:01.697 INFO:tasks.workunit.client.0.smithi078.stdout:4/783: mkdir d0/dc/d10/d1c/d6a/d81/dd4/d10c 0 2024-04-18T21:07:01.698 INFO:tasks.workunit.client.0.smithi078.stdout:8/747: getdents d0/d10/d14/d2a/dbd 0 2024-04-18T21:07:01.698 INFO:tasks.workunit.client.0.smithi078.stdout:7/684: chown d1/d16/d10/d5a/f76 71987521 1 2024-04-18T21:07:01.698 INFO:tasks.workunit.client.0.smithi078.stdout:3/635: symlink d4/d2d/d30/d84/lc1 0 2024-04-18T21:07:01.700 INFO:tasks.workunit.client.0.smithi078.stdout:1/807: creat d0/d11/d69/dd0/f109 x:0 0 0 2024-04-18T21:07:01.700 INFO:tasks.workunit.client.0.smithi078.stdout:8/748: chown d0/d10/d8d/c97 19642 1 2024-04-18T21:07:01.701 INFO:tasks.workunit.client.0.smithi078.stdout:8/749: rmdir d0/d5c/d5a/dc6 39 2024-04-18T21:07:01.701 INFO:tasks.workunit.client.0.smithi078.stdout:3/636: rename d4/d2d/d30/l88 to d4/d2d/d30/d35/lc2 0 2024-04-18T21:07:01.702 INFO:tasks.workunit.client.0.smithi078.stdout:7/685: rename d1/d16/dc/d11/d53/d82/da4/db5/d91/dcd to d1/d16/d10/d7c/d7e/de3 0 2024-04-18T21:07:01.702 INFO:tasks.workunit.client.0.smithi078.stdout:6/661: dread d2/d1c/d67/f72 [0,4194304] 0 2024-04-18T21:07:01.703 INFO:tasks.workunit.client.0.smithi078.stdout:3/637: mkdir d4/dc3 0 2024-04-18T21:07:01.703 INFO:tasks.workunit.client.0.smithi078.stdout:8/750: link d0/d10/fa3 d0/d10/fee 0 2024-04-18T21:07:01.703 INFO:tasks.workunit.client.0.smithi078.stdout:5/691: dwrite d9/da/d8c/fa6 [0,4194304] 0 2024-04-18T21:07:01.704 INFO:tasks.workunit.client.0.smithi078.stdout:6/662: write d2/d1f/f29 [375317,43480] 0 2024-04-18T21:07:01.704 INFO:tasks.workunit.client.0.smithi078.stdout:8/751: fsync d0/d10/d14/d2a/d4a/f7e 0 2024-04-18T21:07:01.706 INFO:tasks.workunit.client.0.smithi078.stdout:8/752: write d0/d10/d14/d2a/d4a/faf [515332,60740] 0 2024-04-18T21:07:01.706 INFO:tasks.workunit.client.0.smithi078.stdout:5/692: getdents d9/d2e/d65 0 2024-04-18T21:07:01.708 INFO:tasks.workunit.client.0.smithi078.stdout:4/784: dwrite d0/dc/dd7/fef [0,4194304] 0 2024-04-18T21:07:01.708 INFO:tasks.workunit.client.0.smithi078.stdout:5/693: rmdir d9/da/d90/d62/da4/dbd 39 2024-04-18T21:07:01.709 INFO:tasks.workunit.client.0.smithi078.stdout:8/753: creat d0/d10/d8d/fef x:0 0 0 2024-04-18T21:07:01.710 INFO:tasks.workunit.client.0.smithi078.stdout:0/743: getdents d0/d9/d4c/d6b 0 2024-04-18T21:07:01.710 INFO:tasks.workunit.client.0.smithi078.stdout:8/754: readlink d0/d10/d14/lae 0 2024-04-18T21:07:01.710 INFO:tasks.workunit.client.0.smithi078.stdout:2/676: dread d0/db/d65/d96/fa7 [0,4194304] 0 2024-04-18T21:07:01.712 INFO:tasks.workunit.client.0.smithi078.stdout:7/686: dwrite d1/d16/d65/f79 [0,4194304] 0 2024-04-18T21:07:01.713 INFO:tasks.workunit.client.0.smithi078.stdout:5/694: link c7 d9/da/d99/cd9 0 2024-04-18T21:07:01.714 INFO:tasks.workunit.client.0.smithi078.stdout:7/687: chown d1/d16/dc/d11/d53/f58 63522730 1 2024-04-18T21:07:01.714 INFO:tasks.workunit.client.0.smithi078.stdout:3/638: dwrite d4/d2d/d30/d35/d71/f9e [0,4194304] 0 2024-04-18T21:07:01.714 INFO:tasks.workunit.client.0.smithi078.stdout:5/695: fsync d9/da/d4b/f4e 0 2024-04-18T21:07:01.714 INFO:tasks.workunit.client.0.smithi078.stdout:2/677: link d0/db/d18/d21/d27/f68 d0/db/d65/d96/fce 0 2024-04-18T21:07:01.715 INFO:tasks.workunit.client.0.smithi078.stdout:2/678: fsync d0/d1f/d34/fb7 0 2024-04-18T21:07:01.715 INFO:tasks.workunit.client.0.smithi078.stdout:2/679: chown d0/d1f/f44 27604185 1 2024-04-18T21:07:01.719 INFO:tasks.workunit.client.0.smithi078.stdout:7/688: link d1/c2 d1/d16/dc/ce4 0 2024-04-18T21:07:01.720 INFO:tasks.workunit.client.0.smithi078.stdout:5/696: truncate d9/d2e/f23 1610966 0 2024-04-18T21:07:01.722 INFO:tasks.workunit.client.0.smithi078.stdout:0/744: dwrite d0/d9/da/db/da6/fc6 [0,4194304] 0 2024-04-18T21:07:01.723 INFO:tasks.workunit.client.0.smithi078.stdout:4/785: dwrite d0/dc/d5b/d71/f56 [4194304,4194304] 0 2024-04-18T21:07:01.723 INFO:tasks.workunit.client.0.smithi078.stdout:3/639: dwrite d4/df/d17/d74/fb9 [0,4194304] 0 2024-04-18T21:07:01.724 INFO:tasks.workunit.client.0.smithi078.stdout:7/689: creat d1/d16/dc/d4b/fe5 x:0 0 0 2024-04-18T21:07:01.724 INFO:tasks.workunit.client.0.smithi078.stdout:0/745: write d0/d9/d4c/d8f/fc0 [17061,128860] 0 2024-04-18T21:07:01.725 INFO:tasks.workunit.client.0.smithi078.stdout:5/697: symlink d9/da/d32/da5/lda 0 2024-04-18T21:07:01.725 INFO:tasks.workunit.client.0.smithi078.stdout:3/640: chown d4/d2d/d30/d35/d71 430959 1 2024-04-18T21:07:01.726 INFO:tasks.workunit.client.0.smithi078.stdout:0/746: write d0/d9/d81/fe2 [925577,107890] 0 2024-04-18T21:07:01.726 INFO:tasks.workunit.client.0.smithi078.stdout:2/680: dwrite d0/f2e [0,4194304] 0 2024-04-18T21:07:01.727 INFO:tasks.workunit.client.0.smithi078.stdout:0/747: stat d0/d9/da/db/f68 0 2024-04-18T21:07:01.727 INFO:tasks.workunit.client.0.smithi078.stdout:2/681: chown d0/da9/fb3 32472 1 2024-04-18T21:07:01.727 INFO:tasks.workunit.client.0.smithi078.stdout:7/690: mkdir d1/d16/d10/d7c/d94/de6 0 2024-04-18T21:07:01.727 INFO:tasks.workunit.client.0.smithi078.stdout:4/786: mknod d0/d73/da9/dcb/c10d 0 2024-04-18T21:07:01.728 INFO:tasks.workunit.client.0.smithi078.stdout:5/698: write d9/da/d3e/d4c/d6d/d75/dad/fc2 [529822,35801] 0 2024-04-18T21:07:01.729 INFO:tasks.workunit.client.0.smithi078.stdout:0/748: mkdir d0/d9/da/db/d35/d3f/dae/de8 0 2024-04-18T21:07:01.729 INFO:tasks.workunit.client.0.smithi078.stdout:2/682: dread d0/db/d18/f1c [0,4194304] 0 2024-04-18T21:07:01.729 INFO:tasks.workunit.client.0.smithi078.stdout:5/699: write d9/d2e/f66 [1751358,3428] 0 2024-04-18T21:07:01.730 INFO:tasks.workunit.client.0.smithi078.stdout:0/749: truncate d0/d9/da/db/d35/f5d 4460799 0 2024-04-18T21:07:01.731 INFO:tasks.workunit.client.0.smithi078.stdout:5/700: mknod d9/da/d3e/d4c/d67/d7c/d78/cdb 0 2024-04-18T21:07:01.731 INFO:tasks.workunit.client.0.smithi078.stdout:4/787: getdents d0 0 2024-04-18T21:07:01.731 INFO:tasks.workunit.client.0.smithi078.stdout:9/778: dread d7/df/d54/fd2 [0,4194304] 0 2024-04-18T21:07:01.732 INFO:tasks.workunit.client.0.smithi078.stdout:5/701: write d9/fe [475233,13927] 0 2024-04-18T21:07:01.732 INFO:tasks.workunit.client.0.smithi078.stdout:2/683: write d0/db/d65/d96/fa7 [1175857,128937] 0 2024-04-18T21:07:01.732 INFO:tasks.workunit.client.0.smithi078.stdout:4/788: write d0/dc/f1d [1778461,21749] 0 2024-04-18T21:07:01.733 INFO:tasks.workunit.client.0.smithi078.stdout:5/702: chown d9/d2e/f9e 973 1 2024-04-18T21:07:01.734 INFO:tasks.workunit.client.0.smithi078.stdout:5/703: fdatasync d9/da/d32/f70 0 2024-04-18T21:07:01.735 INFO:tasks.workunit.client.0.smithi078.stdout:7/691: truncate d1/d16/d65/f6c 2622889 0 2024-04-18T21:07:01.735 INFO:tasks.workunit.client.0.smithi078.stdout:9/779: truncate d7/d11/d1b/d77/fb9 443959 0 2024-04-18T21:07:01.735 INFO:tasks.workunit.client.0.smithi078.stdout:5/704: chown d9/da/d99 9 1 2024-04-18T21:07:01.735 INFO:tasks.workunit.client.0.smithi078.stdout:8/755: dread d0/d10/d8d/fd6 [0,4194304] 0 2024-04-18T21:07:01.736 INFO:tasks.workunit.client.0.smithi078.stdout:7/692: creat d1/d16/d10/fe7 x:0 0 0 2024-04-18T21:07:01.736 INFO:tasks.workunit.client.0.smithi078.stdout:9/780: chown d7/df/d54/d95 1235538315 1 2024-04-18T21:07:01.736 INFO:tasks.workunit.client.0.smithi078.stdout:8/756: unlink d0/d22/l82 0 2024-04-18T21:07:01.737 INFO:tasks.workunit.client.0.smithi078.stdout:5/705: symlink d9/da/d3e/d4c/d79/ldc 0 2024-04-18T21:07:01.737 INFO:tasks.workunit.client.0.smithi078.stdout:7/693: rmdir d1/d16/d1c/d40 39 2024-04-18T21:07:01.737 INFO:tasks.workunit.client.0.smithi078.stdout:5/706: dread d9/d2e/f9e [0,4194304] 0 2024-04-18T21:07:01.737 INFO:tasks.workunit.client.0.smithi078.stdout:7/694: mkdir d1/d16/dc/d31/de8 0 2024-04-18T21:07:01.738 INFO:tasks.workunit.client.0.smithi078.stdout:8/757: creat d0/d10/d14/d2a/d4a/db2/ff0 x:0 0 0 2024-04-18T21:07:01.738 INFO:tasks.workunit.client.0.smithi078.stdout:9/781: getdents d7/d11/d2d/d26/d7c 0 2024-04-18T21:07:01.738 INFO:tasks.workunit.client.0.smithi078.stdout:0/750: dwrite d0/d15/f5f [0,4194304] 0 2024-04-18T21:07:01.738 INFO:tasks.workunit.client.0.smithi078.stdout:7/695: creat d1/d16/d65/fe9 x:0 0 0 2024-04-18T21:07:01.739 INFO:tasks.workunit.client.0.smithi078.stdout:8/758: chown d0/d10/d14/d2a/f8e 8218080 1 2024-04-18T21:07:01.739 INFO:tasks.workunit.client.0.smithi078.stdout:9/782: fsync d7/df/d54/d95/d9d/dd1/d10a/d3e/d5a/ff8 0 2024-04-18T21:07:01.739 INFO:tasks.workunit.client.0.smithi078.stdout:8/759: stat d0/d10/d9d/fe8 0 2024-04-18T21:07:01.741 INFO:tasks.workunit.client.0.smithi078.stdout:9/783: dread - d7/df/d54/f7d zero size 2024-04-18T21:07:01.741 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:01.742+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:01.743 INFO:tasks.workunit.client.0.smithi078.stdout:7/696: mknod d1/d16/dc/d11/d53/d82/da4/db5/d91/db0/cea 0 2024-04-18T21:07:01.743 INFO:tasks.workunit.client.0.smithi078.stdout:7/697: symlink d1/da6/leb 0 2024-04-18T21:07:01.744 INFO:tasks.workunit.client.0.smithi078.stdout:7/698: dread - d1/d16/d10/d7c/d7e/fac zero size 2024-04-18T21:07:01.744 INFO:tasks.workunit.client.0.smithi078.stdout:7/699: stat d1/c88 0 2024-04-18T21:07:01.746 INFO:tasks.workunit.client.0.smithi078.stdout:0/751: dwrite d0/d9/d7d/fc8 [0,4194304] 0 2024-04-18T21:07:01.746 INFO:tasks.workunit.client.0.smithi078.stdout:7/700: rmdir d1/d16/dc/d11/da2/dbc/dc3 39 2024-04-18T21:07:01.747 INFO:tasks.workunit.client.0.smithi078.stdout:7/701: fsync d1/d16/dc/d4b/f43 0 2024-04-18T21:07:01.747 INFO:tasks.workunit.client.0.smithi078.stdout:0/752: write d0/d9/f2d [8662533,88665] 0 2024-04-18T21:07:01.748 INFO:tasks.workunit.client.0.smithi078.stdout:8/760: dwrite d0/d10/d14/d2d/d93/da0/db5/de2/fe3 [0,4194304] 0 2024-04-18T21:07:01.750 INFO:tasks.workunit.client.0.smithi078.stdout:2/684: dwrite d0/db/d65/d96/fce [4194304,4194304] 0 2024-04-18T21:07:01.753 INFO:tasks.workunit.client.0.smithi078.stdout:8/761: mknod d0/d10/d14/d2d/d93/da0/cf1 0 2024-04-18T21:07:01.753 INFO:tasks.workunit.client.0.smithi078.stdout:7/702: truncate d1/d16/d1c/d40/fa1 1790347 0 2024-04-18T21:07:01.754 INFO:tasks.workunit.client.0.smithi078.stdout:2/685: stat d0/db/d18/f3e 0 2024-04-18T21:07:01.754 INFO:tasks.workunit.client.0.smithi078.stdout:8/762: dread - d0/d10/d14/d2d/f83 zero size 2024-04-18T21:07:01.754 INFO:tasks.workunit.client.0.smithi078.stdout:7/703: mknod d1/d16/d10/d7c/d7e/cec 0 2024-04-18T21:07:01.755 INFO:tasks.workunit.client.0.smithi078.stdout:2/686: write d0/db/d18/d21/d27/d29/d4e/f80 [2903453,91145] 0 2024-04-18T21:07:01.755 INFO:tasks.workunit.client.0.smithi078.stdout:0/753: dwrite d0/d9/da/db/d35/d3f/dbe/f85 [0,4194304] 0 2024-04-18T21:07:01.756 INFO:tasks.workunit.client.0.smithi078.stdout:8/763: chown d0/d10/d14/d2a/d4a/c57 5433 1 2024-04-18T21:07:01.757 INFO:tasks.workunit.client.0.smithi078.stdout:7/704: mknod d1/d16/dc/d11/d53/d82/da4/db5/ced 0 2024-04-18T21:07:01.757 INFO:tasks.workunit.client.0.smithi078.stdout:2/687: unlink d0/db/d18/d21/d27/l8c 0 2024-04-18T21:07:01.757 INFO:tasks.workunit.client.0.smithi078.stdout:8/764: dread - d0/d10/d14/d2d/d93/da0/db5/dd2/fc7 zero size 2024-04-18T21:07:01.757 INFO:tasks.workunit.client.0.smithi078.stdout:0/754: mknod d0/d9/d4c/d6b/d9b/ce9 0 2024-04-18T21:07:01.758 INFO:tasks.workunit.client.0.smithi078.stdout:8/765: truncate d0/f45 4916888 0 2024-04-18T21:07:01.759 INFO:tasks.workunit.client.0.smithi078.stdout:2/688: chown d0/db/d18/d21/d27/d29/d4e/f82 677518061 1 2024-04-18T21:07:01.759 INFO:tasks.workunit.client.0.smithi078.stdout:9/784: dwrite f6 [4194304,4194304] 0 2024-04-18T21:07:01.759 INFO:tasks.workunit.client.0.smithi078.stdout:0/755: rename d0/d9/da/db/l94 to d0/d9/dd/d17/d2e/lea 0 2024-04-18T21:07:01.759 INFO:tasks.workunit.client.0.smithi078.stdout:2/689: fdatasync d0/f1d 0 2024-04-18T21:07:01.760 INFO:tasks.workunit.client.0.smithi078.stdout:8/766: readlink d0/d10/d14/d2a/d3c/l87 0 2024-04-18T21:07:01.760 INFO:tasks.workunit.client.0.smithi078.stdout:0/756: creat d0/d9/d4c/feb x:0 0 0 2024-04-18T21:07:01.760 INFO:tasks.workunit.client.0.smithi078.stdout:8/767: chown d0/d10/d14/fa5 430 1 2024-04-18T21:07:01.761 INFO:tasks.workunit.client.0.smithi078.stdout:0/757: dread - d0/d6c/f8c zero size 2024-04-18T21:07:01.761 INFO:tasks.workunit.client.0.smithi078.stdout:8/768: write d0/d5c/d5a/f98 [802927,462] 0 2024-04-18T21:07:01.762 INFO:tasks.workunit.client.0.smithi078.stdout:8/769: dread - d0/f84 zero size 2024-04-18T21:07:01.767 INFO:tasks.workunit.client.0.smithi078.stdout:8/770: dwrite d0/d5c/d5a/d7b/f8a [0,4194304] 0 2024-04-18T21:07:01.768 INFO:tasks.workunit.client.0.smithi078.stdout:8/771: write d0/d10/d14/d2a/d4a/db2/db6/fd9 [2810076,106046] 0 2024-04-18T21:07:01.772 INFO:tasks.workunit.client.0.smithi078.stdout:4/789: sync 2024-04-18T21:07:01.773 INFO:tasks.workunit.client.0.smithi078.stdout:4/790: write d0/f58 [3642114,67124] 0 2024-04-18T21:07:01.775 INFO:tasks.workunit.client.0.smithi078.stdout:4/791: unlink d0/dc/d10/d1c/cf6 0 2024-04-18T21:07:01.776 INFO:tasks.workunit.client.0.smithi078.stdout:8/772: dwrite d0/d10/d14/d2a/fe7 [0,4194304] 0 2024-04-18T21:07:01.777 INFO:tasks.workunit.client.0.smithi078.stdout:4/792: unlink d0/dc/d5b/d4f/fec 0 2024-04-18T21:07:01.777 INFO:tasks.workunit.client.0.smithi078.stdout:8/773: chown d0/d10/d9d 117 1 2024-04-18T21:07:01.777 INFO:tasks.workunit.client.0.smithi078.stdout:4/793: fdatasync d0/dc/d10/d3a/fe0 0 2024-04-18T21:07:01.777 INFO:tasks.workunit.client.0.smithi078.stdout:1/808: dread d0/d2a/d5f/d89/d32/d35/d85/fb0 [0,4194304] 0 2024-04-18T21:07:01.780 INFO:tasks.workunit.client.0.smithi078.stdout:1/809: rmdir d0/d2a/d3c/d4b/d4 39 2024-04-18T21:07:01.781 INFO:tasks.workunit.client.0.smithi078.stdout:4/794: creat d0/dc/d10/f10e x:0 0 0 2024-04-18T21:07:01.781 INFO:tasks.workunit.client.0.smithi078.stdout:1/810: write d0/d2a/d45/f5c [230207,109507] 0 2024-04-18T21:07:01.781 INFO:tasks.workunit.client.0.smithi078.stdout:4/795: mkdir d0/dc/d10/d1c/d60/dee/db8/d10f 0 2024-04-18T21:07:01.782 INFO:tasks.workunit.client.0.smithi078.stdout:3/641: dread d4/d2d/d30/f34 [0,4194304] 0 2024-04-18T21:07:01.782 INFO:tasks.workunit.client.0.smithi078.stdout:1/811: write d0/d2a/d5f/d89/d32/d35/f6d [3671612,15127] 0 2024-04-18T21:07:01.784 INFO:tasks.workunit.client.0.smithi078.stdout:2/690: dread d0/db/f36 [0,4194304] 0 2024-04-18T21:07:01.784 INFO:tasks.workunit.client.0.smithi078.stdout:9/785: dread d7/d11/d2d/fd6 [0,4194304] 0 2024-04-18T21:07:01.784 INFO:tasks.workunit.client.0.smithi078.stdout:4/796: rename d0/dc/d37 to d0/dc/d10/d1c/d110 0 2024-04-18T21:07:01.784 INFO:tasks.workunit.client.0.smithi078.stdout:1/812: write d0/d2a/d3c/da8/ff3 [893451,12009] 0 2024-04-18T21:07:01.785 INFO:tasks.workunit.client.0.smithi078.stdout:2/691: chown d0/db/d18/d21/d27/d29/d4e/l85 6 1 2024-04-18T21:07:01.785 INFO:tasks.workunit.client.0.smithi078.stdout:9/786: mknod d7/d11/d2d/d106/c10b 0 2024-04-18T21:07:01.786 INFO:tasks.workunit.client.0.smithi078.stdout:9/787: fsync d7/df/f42 0 2024-04-18T21:07:01.786 INFO:tasks.workunit.client.0.smithi078.stdout:2/692: readlink d0/db/d65/d96/lc0 0 2024-04-18T21:07:01.786 INFO:tasks.workunit.client.0.smithi078.stdout:6/663: dread d2/d6/dd/f15 [0,4194304] 0 2024-04-18T21:07:01.787 INFO:tasks.workunit.client.0.smithi078.stdout:9/788: creat d7/d11/d2d/d26/d7c/f10c x:0 0 0 2024-04-18T21:07:01.787 INFO:tasks.workunit.client.0.smithi078.stdout:6/664: chown d2/d6 11 1 2024-04-18T21:07:01.787 INFO:tasks.workunit.client.0.smithi078.stdout:6/665: dread - d2/d74/fb8 zero size 2024-04-18T21:07:01.787 INFO:tasks.workunit.client.0.smithi078.stdout:9/789: dread - d7/df/d54/d95/d9d/dd1/d10a/d3e/d5a/fb6 zero size 2024-04-18T21:07:01.788 INFO:tasks.workunit.client.0.smithi078.stdout:6/666: mknod d2/d1c/d63/d8b/dcc/ce3 0 2024-04-18T21:07:01.789 INFO:tasks.workunit.client.0.smithi078.stdout:9/790: link d7/d11/d80/f107 d7/d11/d2d/d26/d7c/dda/de5/f10d 0 2024-04-18T21:07:01.789 INFO:tasks.workunit.client.0.smithi078.stdout:6/667: creat d2/d34/d35/d57/d90/fe4 x:0 0 0 2024-04-18T21:07:01.790 INFO:tasks.workunit.client.0.smithi078.stdout:9/791: dread - d7/d11/df0/df6/f105 zero size 2024-04-18T21:07:01.790 INFO:tasks.workunit.client.0.smithi078.stdout:6/668: readlink d2/d6/dd/d4b/d5d/lb0 0 2024-04-18T21:07:01.791 INFO:tasks.workunit.client.0.smithi078.stdout:3/642: dread d4/d2d/d30/d35/f4f [0,4194304] 0 2024-04-18T21:07:01.791 INFO:tasks.workunit.client.0.smithi078.stdout:9/792: mkdir d7/d11/d2d/d26/d7c/dda/d10e 0 2024-04-18T21:07:01.792 INFO:tasks.workunit.client.0.smithi078.stdout:6/669: rename d2/d6/dd/d4b/d5d/f82 to d2/d1c/d30/fe5 0 2024-04-18T21:07:01.792 INFO:tasks.workunit.client.0.smithi078.stdout:3/643: chown d4/d2d/d30/d35/d4b/d59/c89 123184 1 2024-04-18T21:07:01.793 INFO:tasks.workunit.client.0.smithi078.stdout:2/693: dwrite d0/f2e [0,4194304] 0 2024-04-18T21:07:01.793 INFO:tasks.workunit.client.0.smithi078.stdout:9/793: symlink d7/d11/d1b/d98/l10f 0 2024-04-18T21:07:01.793 INFO:tasks.workunit.client.0.smithi078.stdout:6/670: fdatasync d2/f3 0 2024-04-18T21:07:01.793 INFO:tasks.workunit.client.0.smithi078.stdout:3/644: dread - d4/da/d11/f97 zero size 2024-04-18T21:07:01.793 INFO:tasks.workunit.client.0.smithi078.stdout:2/694: fsync d0/db/fb1 0 2024-04-18T21:07:01.794 INFO:tasks.workunit.client.0.smithi078.stdout:3/645: fsync d4/da/f6d 0 2024-04-18T21:07:01.794 INFO:tasks.workunit.client.0.smithi078.stdout:9/794: mkdir d7/d11/df0/d110 0 2024-04-18T21:07:01.794 INFO:tasks.workunit.client.0.smithi078.stdout:9/795: mknod d7/c111 0 2024-04-18T21:07:01.794 INFO:tasks.workunit.client.0.smithi078.stdout:2/695: creat d0/db/d18/d21/d27/d70/fcf x:0 0 0 2024-04-18T21:07:01.796 INFO:tasks.workunit.client.0.smithi078.stdout:9/796: rename d7/df/d54/d95/d9d/dd1/d10a/d3e/d5a/da8/db0/lc7 to d7/df/d54/d95/d9d/dd1/d10a/l112 0 2024-04-18T21:07:01.797 INFO:tasks.workunit.client.0.smithi078.stdout:0/758: fdatasync d0/d9/da/df/fa0 0 2024-04-18T21:07:01.797 INFO:tasks.workunit.client.0.smithi078.stdout:9/797: mkdir d7/d11/d2d/d3f/db7/dfd/d113 0 2024-04-18T21:07:01.798 INFO:tasks.workunit.client.0.smithi078.stdout:9/798: creat d7/df/d1e/de2/f114 x:0 0 0 2024-04-18T21:07:01.802 INFO:tasks.workunit.client.0.smithi078.stdout:6/671: write d2/d1c/d63/d8b/fb5 [138779,63683] 0 2024-04-18T21:07:01.802 INFO:tasks.workunit.client.0.smithi078.stdout:1/813: write d0/d2a/d3c/d4b/d4/d61/fdf [573537,97400] 0 2024-04-18T21:07:01.802 INFO:tasks.workunit.client.0.smithi078.stdout:2/696: truncate d0/db/d18/d21/d8b/f92 3290750 0 2024-04-18T21:07:01.802 INFO:tasks.workunit.client.0.smithi078.stdout:3/646: dwrite d4/d2d/f8b [0,4194304] 0 2024-04-18T21:07:01.802 INFO:tasks.workunit.client.0.smithi078.stdout:5/707: dread d9/da/f1b [4194304,4194304] 0 2024-04-18T21:07:01.803 INFO:tasks.workunit.client.0.smithi078.stdout:1/814: rmdir d0/d2a/d5f 39 2024-04-18T21:07:01.803 INFO:tasks.workunit.client.0.smithi078.stdout:5/708: stat d9/da/f1f 0 2024-04-18T21:07:01.804 INFO:tasks.workunit.client.0.smithi078.stdout:2/697: write d0/d1f/f43 [102883,88023] 0 2024-04-18T21:07:01.804 INFO:tasks.workunit.client.0.smithi078.stdout:6/672: creat d2/d34/dce/fe6 x:0 0 0 2024-04-18T21:07:01.804 INFO:tasks.workunit.client.0.smithi078.stdout:9/799: read d7/d11/d1b/f5f [412528,66204] 0 2024-04-18T21:07:01.804 INFO:tasks.workunit.client.0.smithi078.stdout:6/673: stat d2/d6/l87 0 2024-04-18T21:07:01.805 INFO:tasks.workunit.client.0.smithi078.stdout:2/698: mkdir d0/d87/d88/da1/dc7/dd0 0 2024-04-18T21:07:01.805 INFO:tasks.workunit.client.0.smithi078.stdout:9/800: write d7/df/d54/fd2 [3951535,104972] 0 2024-04-18T21:07:01.806 INFO:tasks.workunit.client.0.smithi078.stdout:0/759: dwrite d0/d6c/f8a [4194304,4194304] 0 2024-04-18T21:07:01.806 INFO:tasks.workunit.client.0.smithi078.stdout:2/699: chown d0/db/d65/d96 1386340 1 2024-04-18T21:07:01.810 INFO:tasks.workunit.client.0.smithi078.stdout:6/674: link d2/d1f/l76 d2/d1c/d63/da0/le7 0 2024-04-18T21:07:01.813 INFO:tasks.workunit.client.0.smithi078.stdout:6/675: stat d2/d1c/d63/da0/ccd 0 2024-04-18T21:07:01.813 INFO:tasks.workunit.client.0.smithi078.stdout:1/815: dwrite d0/d2a/d2f/d50/fa6 [4194304,4194304] 0 2024-04-18T21:07:01.813 INFO:tasks.workunit.client.0.smithi078.stdout:7/705: dread d1/d16/dc/d11/f6e [0,4194304] 0 2024-04-18T21:07:01.815 INFO:tasks.workunit.client.0.smithi078.stdout:5/709: dwrite d9/da/d3e/d4c/d6d/d73/f40 [0,4194304] 0 2024-04-18T21:07:01.815 INFO:tasks.workunit.client.0.smithi078.stdout:2/700: dwrite d0/f1d [0,4194304] 0 2024-04-18T21:07:01.815 INFO:tasks.workunit.client.0.smithi078.stdout:6/676: rename d2/l3c to d2/d34/le8 0 2024-04-18T21:07:01.816 INFO:tasks.workunit.client.0.smithi078.stdout:7/706: mkdir d1/d16/dc/d31/dee 0 2024-04-18T21:07:01.816 INFO:tasks.workunit.client.0.smithi078.stdout:0/760: dwrite d0/fcf [0,4194304] 0 2024-04-18T21:07:01.816 INFO:tasks.workunit.client.0.smithi078.stdout:1/816: write d0/d2a/d5f/d89/d32/ffd [575016,129589] 0 2024-04-18T21:07:01.819 INFO:teuthology.orchestra.run.smithi078.stderr:nodeep-scrub is set 2024-04-18T21:07:01.819 INFO:tasks.workunit.client.0.smithi078.stdout:2/701: write d0/db/f36 [1289704,60962] 0 2024-04-18T21:07:01.821 INFO:tasks.workunit.client.0.smithi078.stdout:7/707: write d1/d16/d2d/f36 [1863198,115169] 0 2024-04-18T21:07:01.823 INFO:tasks.workunit.client.0.smithi078.stdout:4/797: dread d0/dc/d10/d1c/d110/f3b [0,4194304] 0 2024-04-18T21:07:01.824 INFO:tasks.workunit.client.0.smithi078.stdout:0/761: mknod d0/d9/d58/cec 0 2024-04-18T21:07:01.824 INFO:tasks.workunit.client.0.smithi078.stdout:5/710: dwrite d9/da/d4b/d8b/fc9 [0,4194304] 0 2024-04-18T21:07:01.824 INFO:tasks.workunit.client.0.smithi078.stdout:1/817: rename d0/d11/f2e to d0/dda/f10a 0 2024-04-18T21:07:01.824 INFO:tasks.workunit.client.0.smithi078.stdout:7/708: symlink d1/da6/lef 0 2024-04-18T21:07:01.825 INFO:tasks.workunit.client.0.smithi078.stdout:2/702: creat d0/fd1 x:0 0 0 2024-04-18T21:07:01.825 INFO:tasks.workunit.client.0.smithi078.stdout:6/677: chown d2/d6/fca 4 1 2024-04-18T21:07:01.825 INFO:tasks.workunit.client.0.smithi078.stdout:0/762: symlink d0/d9/da/db/led 0 2024-04-18T21:07:01.826 INFO:tasks.workunit.client.0.smithi078.stdout:4/798: chown d0/dc/d29/d6d/d7b/ldd 0 1 2024-04-18T21:07:01.826 INFO:tasks.workunit.client.0.smithi078.stdout:5/711: chown d9/da/d3e/d4c/d6d/d75/lc4 66020731 1 2024-04-18T21:07:01.827 INFO:tasks.workunit.client.0.smithi078.stdout:7/709: write d1/d16/dc/d11/f6e [2590144,123413] 0 2024-04-18T21:07:01.827 INFO:tasks.workunit.client.0.smithi078.stdout:2/703: mkdir d0/db/d6e/dd2 0 2024-04-18T21:07:01.827 INFO:tasks.workunit.client.0.smithi078.stdout:0/763: creat d0/d15/fee x:0 0 0 2024-04-18T21:07:01.828 INFO:tasks.workunit.client.0.smithi078.stdout:2/704: stat d0/db 0 2024-04-18T21:07:01.828 INFO:tasks.workunit.client.0.smithi078.stdout:7/710: rmdir d1/d32 39 2024-04-18T21:07:01.828 INFO:tasks.workunit.client.0.smithi078.stdout:6/678: write d2/d6/dd/f15 [2266536,29645] 0 2024-04-18T21:07:01.829 INFO:tasks.workunit.client.0.smithi078.stdout:9/801: dread d7/d11/d1b/d77/fb9 [0,4194304] 0 2024-04-18T21:07:01.829 INFO:tasks.workunit.client.0.smithi078.stdout:1/818: rename d0/d2a/d3c/d4b/d4/d61/d9c/lc4 to d0/d2a/d3c/d4b/l10b 0 2024-04-18T21:07:01.829 INFO:tasks.workunit.client.0.smithi078.stdout:5/712: write d9/da/d90/f6f [8003037,25705] 0 2024-04-18T21:07:01.830 INFO:tasks.workunit.client.0.smithi078.stdout:7/711: mknod d1/d16/d10/d7c/d7e/de3/cf0 0 2024-04-18T21:07:01.830 INFO:tasks.workunit.client.0.smithi078.stdout:9/802: chown d7/df/d67/fa5 5294 1 2024-04-18T21:07:01.831 INFO:tasks.workunit.client.0.smithi078.stdout:1/819: symlink d0/d2a/d3c/da8/df4/l10c 0 2024-04-18T21:07:01.831 INFO:tasks.workunit.client.0.smithi078.stdout:6/679: creat d2/d6/fe9 x:0 0 0 2024-04-18T21:07:01.831 INFO:tasks.workunit.client.0.smithi078.stdout:8/774: sync 2024-04-18T21:07:01.831 INFO:tasks.workunit.client.0.smithi078.stdout:5/713: symlink d9/da/d3e/d4c/d6d/ldd 0 2024-04-18T21:07:01.832 INFO:tasks.workunit.client.0.smithi078.stdout:6/680: mkdir d2/d6/dea 0 2024-04-18T21:07:01.832 INFO:tasks.workunit.client.0.smithi078.stdout:9/803: rename d7/df/d1e to d7/df/d54/d115 0 2024-04-18T21:07:01.832 INFO:tasks.workunit.client.0.smithi078.stdout:1/820: fsync d0/d2a/d5f/d89/d32/f67 0 2024-04-18T21:07:01.833 INFO:tasks.workunit.client.0.smithi078.stdout:9/804: dread - d7/d11/d2d/d26/d7c/dda/de5/f10d zero size 2024-04-18T21:07:01.834 INFO:tasks.workunit.client.0.smithi078.stdout:7/712: rename d1/f20 to d1/d16/d10/d7c/d94/de6/ff1 0 2024-04-18T21:07:01.835 INFO:tasks.workunit.client.0.smithi078.stdout:9/805: stat d7/d11/d1b/d45/d4b/lfb 0 2024-04-18T21:07:01.835 INFO:tasks.workunit.client.0.smithi078.stdout:7/713: write d1/d16/dc/f74 [425103,97139] 0 2024-04-18T21:07:01.835 INFO:tasks.workunit.client.0.smithi078.stdout:9/806: read - d7/fbb zero size 2024-04-18T21:07:01.836 INFO:tasks.workunit.client.0.smithi078.stdout:5/714: truncate d9/da/d3e/d4c/d6d/d73/f43 2154971 0 2024-04-18T21:07:01.836 INFO:tasks.workunit.client.0.smithi078.stdout:1/821: write d0/d11/f21 [1778487,103814] 0 2024-04-18T21:07:01.836 INFO:tasks.workunit.client.0.smithi078.stdout:6/681: rename d2/d6/dd/d4b to d2/d1c/d6b/dba/deb 0 2024-04-18T21:07:01.837 INFO:tasks.workunit.client.0.smithi078.stdout:5/715: rmdir d9/da/d99 39 2024-04-18T21:07:01.838 INFO:tasks.workunit.client.0.smithi078.stdout:1/822: stat d0/d2a/d3c/d4b/l68 0 2024-04-18T21:07:01.838 INFO:tasks.workunit.client.0.smithi078.stdout:9/807: write d7/df/f8a [670165,129590] 0 2024-04-18T21:07:01.838 INFO:tasks.workunit.client.0.smithi078.stdout:7/714: chown d1/d16/d10/d5a/d8b/ca3 1386 1 2024-04-18T21:07:01.839 INFO:tasks.workunit.client.0.smithi078.stdout:6/682: write d2/d6/fca [210007,11203] 0 2024-04-18T21:07:01.839 INFO:tasks.workunit.client.0.smithi078.stdout:8/775: dwrite d0/d5c/d5a/fbc [12582912,4194304] 0 2024-04-18T21:07:01.839 INFO:tasks.workunit.client.0.smithi078.stdout:7/715: fsync d1/fbd 0 2024-04-18T21:07:01.839 INFO:tasks.workunit.client.0.smithi078.stdout:9/808: fsync d7/d83/f91 0 2024-04-18T21:07:01.840 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:01.840 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:01.840 INFO:tasks.workunit.client.0.smithi078.stdout:8/776: fdatasync d0/d10/d14/f70 0 2024-04-18T21:07:01.841 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:01.842+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:01.841 INFO:tasks.workunit.client.0.smithi078.stdout:1/823: rename d0/d2a/d2f/dc6/c105 to d0/d2a/d45/d81/dc8/d103/c10d 0 2024-04-18T21:07:01.841 INFO:tasks.workunit.client.0.smithi078.stdout:6/683: mknod d2/d6/dd/cec 0 2024-04-18T21:07:01.842 INFO:tasks.workunit.client.0.smithi078.stdout:2/705: dwrite d0/db/d65/d96/fce [0,4194304] 0 2024-04-18T21:07:01.843 INFO:tasks.workunit.client.0.smithi078.stdout:9/809: mkdir d7/df/d54/d95/d9d/dd1/d10a/d3e/d5a/da8/d116 0 2024-04-18T21:07:01.843 INFO:tasks.workunit.client.0.smithi078.stdout:6/684: readlink d2/d1c/d6b/dba/deb/la6 0 2024-04-18T21:07:01.843 INFO:tasks.workunit.client.0.smithi078.stdout:2/706: dread - d0/d1f/d34/fb7 zero size 2024-04-18T21:07:01.843 INFO:tasks.workunit.client.0.smithi078.stdout:7/716: creat d1/d16/dc/d11/d53/d82/da4/db5/d91/db4/ddc/ff2 x:0 0 0 2024-04-18T21:07:01.843 INFO:tasks.workunit.client.0.smithi078.stdout:9/810: chown d7/d11/d2d/ddc 11 1 2024-04-18T21:07:01.844 INFO:tasks.workunit.client.0.smithi078.stdout:6/685: fdatasync d2/d1c/f22 0 2024-04-18T21:07:01.844 INFO:tasks.workunit.client.0.smithi078.stdout:2/707: mkdir d0/db/d6e/dd2/dd3 0 2024-04-18T21:07:01.846 INFO:tasks.workunit.client.0.smithi078.stdout:6/686: creat d2/d34/fed x:0 0 0 2024-04-18T21:07:01.846 INFO:tasks.workunit.client.0.smithi078.stdout:7/717: creat d1/d16/dc/d11/d53/d82/da4/ff3 x:0 0 0 2024-04-18T21:07:01.846 INFO:tasks.workunit.client.0.smithi078.stdout:7/718: fdatasync d1/d16/f26 0 2024-04-18T21:07:01.847 INFO:tasks.workunit.client.0.smithi078.stdout:7/719: readlink d1/d16/dc/l30 0 2024-04-18T21:07:01.847 INFO:tasks.workunit.client.0.smithi078.stdout:3/647: dread d4/d2d/d30/f48 [0,4194304] 0 2024-04-18T21:07:01.848 INFO:tasks.workunit.client.0.smithi078.stdout:3/648: dread - d4/da/f6d zero size 2024-04-18T21:07:01.848 INFO:tasks.workunit.client.0.smithi078.stdout:6/687: dread d2/d6/fca [0,4194304] 0 2024-04-18T21:07:01.848 INFO:tasks.workunit.client.0.smithi078.stdout:3/649: unlink d4/d2d/f8b 0 2024-04-18T21:07:01.849 INFO:tasks.workunit.client.0.smithi078.stdout:6/688: fdatasync d2/d1c/d3a/fb4 0 2024-04-18T21:07:01.849 INFO:tasks.workunit.client.0.smithi078.stdout:3/650: mkdir d4/df/d17/d74/dc4 0 2024-04-18T21:07:01.852 INFO:tasks.workunit.client.0.smithi078.stdout:6/689: creat d2/d1c/db3/dbb/fee x:0 0 0 2024-04-18T21:07:01.852 INFO:tasks.workunit.client.0.smithi078.stdout:1/824: rename d0/d2a/d2f to d0/d2a/d5f/d89/d32/db2/d10e 0 2024-04-18T21:07:01.852 INFO:tasks.workunit.client.0.smithi078.stdout:2/708: dwrite d0/f32 [0,4194304] 0 2024-04-18T21:07:01.854 INFO:tasks.workunit.client.0.smithi078.stdout:6/690: stat d2/d1c/d6b/dba/deb/d5d/f6d 0 2024-04-18T21:07:01.854 INFO:tasks.workunit.client.0.smithi078.stdout:6/691: chown d2/d1c/d3a/d8c/fdc 15842314 1 2024-04-18T21:07:01.857 INFO:tasks.workunit.client.0.smithi078.stdout:3/651: rename d4/df/d17 to d4/df/db0/dc5 0 2024-04-18T21:07:01.858 INFO:tasks.workunit.client.0.smithi078.stdout:1/825: rename d0/d2a/d5f/ld8 to d0/d2a/d5f/d89/d32/d35/d71/l10f 0 2024-04-18T21:07:01.858 INFO:tasks.workunit.client.0.smithi078.stdout:3/652: stat d4/d2d/d30/c5b 0 2024-04-18T21:07:01.859 INFO:tasks.workunit.client.0.smithi078.stdout:4/799: dread d0/dc/d29/d2f/f35 [0,4194304] 0 2024-04-18T21:07:01.859 INFO:tasks.workunit.client.0.smithi078.stdout:1/826: chown d0/d2a/d45/d81/dea 2 1 2024-04-18T21:07:01.860 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:07:01.861 INFO:tasks.workunit.client.0.smithi078.stdout:4/800: fdatasync d0/dc/d10/d3a/fe0 0 2024-04-18T21:07:01.861 INFO:tasks.workunit.client.0.smithi078.stdout:3/653: symlink d4/d2d/d30/d84/lc6 0 2024-04-18T21:07:01.861 INFO:tasks.workunit.client.0.smithi078.stdout:5/716: dread d9/da/f1f [0,4194304] 0 2024-04-18T21:07:01.862 INFO:tasks.workunit.client.0.smithi078.stdout:3/654: fdatasync d4/da/f6d 0 2024-04-18T21:07:01.862 INFO:tasks.workunit.client.0.smithi078.stdout:4/801: dread d0/d73/da9/fbd [0,4194304] 0 2024-04-18T21:07:01.862 INFO:tasks.workunit.client.0.smithi078.stdout:2/709: dwrite d0/db/d18/d21/d27/f56 [0,4194304] 0 2024-04-18T21:07:01.862 INFO:tasks.workunit.client.0.smithi078.stdout:5/717: dread - d9/da/d3e/d4c/d67/fd3 zero size 2024-04-18T21:07:01.863 INFO:tasks.workunit.client.0.smithi078.stdout:4/802: stat d0/dc/d10/d1c/d110/f101 0 2024-04-18T21:07:01.864 INFO:tasks.workunit.client.0.smithi078.stdout:1/827: link d0/d2a/d3c/d4b/d4/fe2 d0/d2a/d5f/d89/d32/db2/d10e/d50/d78/f110 0 2024-04-18T21:07:01.864 INFO:tasks.workunit.client.0.smithi078.stdout:3/655: creat d4/da/fc7 x:0 0 0 2024-04-18T21:07:01.864 INFO:tasks.workunit.client.0.smithi078.stdout:2/710: mknod d0/d87/d88/cd4 0 2024-04-18T21:07:01.864 INFO:tasks.workunit.client.0.smithi078.stdout:5/718: creat d9/da/d3e/d4c/fde x:0 0 0 2024-04-18T21:07:01.865 INFO:tasks.workunit.client.0.smithi078.stdout:3/656: fsync d4/d2d/f55 0 2024-04-18T21:07:01.865 INFO:tasks.workunit.client.0.smithi078.stdout:4/803: fsync d0/dc/d10/d1c/d60/f7c 0 2024-04-18T21:07:01.866 INFO:tasks.workunit.client.0.smithi078.stdout:3/657: chown d4/d2d/c73 455910674 1 2024-04-18T21:07:01.866 INFO:tasks.workunit.client.0.smithi078.stdout:1/828: creat d0/d2a/d5f/d89/d32/db2/d10e/d9b/f111 x:0 0 0 2024-04-18T21:07:01.866 INFO:tasks.workunit.client.0.smithi078.stdout:4/804: readlink d0/dc/d10/d1c/d6a/ldf 0 2024-04-18T21:07:01.867 INFO:tasks.workunit.client.0.smithi078.stdout:1/829: write d0/d2a/d5f/d89/d32/f67 [966401,121970] 0 2024-04-18T21:07:01.867 INFO:tasks.workunit.client.0.smithi078.stdout:3/658: truncate d4/df/db0/dc5/d74/da0/fc0 233253 0 2024-04-18T21:07:01.867 INFO:tasks.workunit.client.0.smithi078.stdout:4/805: mknod d0/dc/d10/d41/d5f/c111 0 2024-04-18T21:07:01.868 INFO:tasks.workunit.client.0.smithi078.stdout:2/711: read d0/db/d18/d21/d8b/f94 [1711438,60832] 0 2024-04-18T21:07:01.868 INFO:tasks.workunit.client.0.smithi078.stdout:4/806: unlink d0/dc/d10/d1c/d60/dee/dc4/df3/fc7 0 2024-04-18T21:07:01.869 INFO:tasks.workunit.client.0.smithi078.stdout:3/659: link d4/d2d/d30/c3b d4/d2d/d30/d35/d4b/d59/cc8 0 2024-04-18T21:07:01.869 INFO:tasks.workunit.client.0.smithi078.stdout:4/807: dread - d0/dc/d10/d1c/d6a/f108 zero size 2024-04-18T21:07:01.870 INFO:tasks.workunit.client.0.smithi078.stdout:3/660: getdents d4 0 2024-04-18T21:07:01.873 INFO:tasks.workunit.client.0.smithi078.stdout:3/661: mknod d4/d2d/d30/cc9 0 2024-04-18T21:07:01.873 INFO:tasks.workunit.client.0.smithi078.stdout:3/662: rmdir d4/da/d11/d66 39 2024-04-18T21:07:01.874 INFO:tasks.workunit.client.0.smithi078.stdout:1/830: dwrite d0/d2a/d45/d81/dc8/ffb [0,4194304] 0 2024-04-18T21:07:01.875 INFO:tasks.workunit.client.0.smithi078.stdout:2/712: dwrite d0/d1f/f9e [0,4194304] 0 2024-04-18T21:07:01.875 INFO:tasks.workunit.client.0.smithi078.stdout:1/831: creat d0/de7/f112 x:0 0 0 2024-04-18T21:07:01.878 INFO:tasks.workunit.client.0.smithi078.stdout:1/832: mkdir d0/d2a/d5f/d89/d32/d35/d113 0 2024-04-18T21:07:01.878 INFO:tasks.workunit.client.0.smithi078.stdout:5/719: truncate d9/da/d3e/d4c/d6d/d75/dad/fc2 413496 0 2024-04-18T21:07:01.878 INFO:tasks.workunit.client.0.smithi078.stdout:2/713: rename d0/db/d18/d21/d27/d29/d4e to d0/d1f/d34/dd5 0 2024-04-18T21:07:01.878 INFO:tasks.workunit.client.0.smithi078.stdout:1/833: creat d0/de7/dd7/f114 x:0 0 0 2024-04-18T21:07:01.880 INFO:tasks.workunit.client.0.smithi078.stdout:1/834: dread - d0/d2a/d5f/d89/d32/db2/d10e/d9b/f111 zero size 2024-04-18T21:07:01.880 INFO:tasks.workunit.client.0.smithi078.stdout:5/720: mkdir d9/da/d3e/d4c/d6d/d73/ddf 0 2024-04-18T21:07:01.880 INFO:tasks.workunit.client.0.smithi078.stdout:6/692: dread d2/d6/dd/f68 [0,4194304] 0 2024-04-18T21:07:01.881 INFO:tasks.workunit.client.0.smithi078.stdout:1/835: readlink d0/d11/lf0 0 2024-04-18T21:07:01.882 INFO:tasks.workunit.client.0.smithi078.stdout:5/721: dread - d9/da/d3e/d4c/d6d/d86/fcc zero size 2024-04-18T21:07:01.883 INFO:tasks.workunit.client.0.smithi078.stdout:0/764: dread d0/f8 [4194304,4194304] 0 2024-04-18T21:07:01.884 INFO:tasks.workunit.client.0.smithi078.stdout:0/765: readlink d0/d9/da/l2a 0 2024-04-18T21:07:01.885 INFO:tasks.workunit.client.0.smithi078.stdout:0/766: fdatasync d0/d6c/f9e 0 2024-04-18T21:07:01.885 INFO:tasks.workunit.client.0.smithi078.stdout:2/714: dwrite d0/db/d18/d21/d27/d29/f6b [0,4194304] 0 2024-04-18T21:07:01.886 INFO:tasks.workunit.client.0.smithi078.stdout:0/767: chown d0/d6c 65443 1 2024-04-18T21:07:01.886 INFO:tasks.workunit.client.0.smithi078.stdout:3/663: dread d4/da/d11/f22 [0,4194304] 0 2024-04-18T21:07:01.887 INFO:tasks.workunit.client.0.smithi078.stdout:2/715: write d0/f32 [3858733,6390] 0 2024-04-18T21:07:01.887 INFO:tasks.workunit.client.0.smithi078.stdout:0/768: fdatasync d0/d9/da/f42 0 2024-04-18T21:07:01.888 INFO:tasks.workunit.client.0.smithi078.stdout:8/777: dread d0/d10/d14/f21 [0,4194304] 0 2024-04-18T21:07:01.889 INFO:tasks.workunit.client.0.smithi078.stdout:5/722: mknod d9/da/d90/d62/da4/dbd/ce0 0 2024-04-18T21:07:01.889 INFO:tasks.workunit.client.0.smithi078.stdout:6/693: dwrite d2/d34/fa5 [0,4194304] 0 2024-04-18T21:07:01.890 INFO:tasks.workunit.client.0.smithi078.stdout:0/769: write d0/d9/da/db/d35/f5d [1505073,57386] 0 2024-04-18T21:07:01.891 INFO:tasks.workunit.client.0.smithi078.stdout:5/723: stat d9/da/d90/c9c 0 2024-04-18T21:07:01.891 INFO:tasks.workunit.client.0.smithi078.stdout:7/720: sync 2024-04-18T21:07:01.891 INFO:tasks.workunit.client.0.smithi078.stdout:3/664: mkdir d4/da/d11/d66/dca 0 2024-04-18T21:07:01.891 INFO:tasks.workunit.client.0.smithi078.stdout:0/770: creat d0/d9/d2f/fef x:0 0 0 2024-04-18T21:07:01.892 INFO:tasks.workunit.client.0.smithi078.stdout:7/721: mkdir d1/d16/d2d/df4 0 2024-04-18T21:07:01.893 INFO:tasks.workunit.client.0.smithi078.stdout:5/724: read - d9/da/d3e/d4c/fde zero size 2024-04-18T21:07:01.893 INFO:tasks.workunit.client.0.smithi078.stdout:1/836: dwrite d0/d2a/d5f/d89/d32/d35/f55 [0,4194304] 0 2024-04-18T21:07:01.893 INFO:tasks.workunit.client.0.smithi078.stdout:3/665: rename d4/fd to d4/d2d/d6c/fcb 0 2024-04-18T21:07:01.894 INFO:tasks.workunit.client.0.smithi078.stdout:0/771: write d0/d9/da/db/f4d [451478,49578] 0 2024-04-18T21:07:01.895 INFO:tasks.workunit.client.0.smithi078.stdout:7/722: write d1/d16/d10/d7c/d7e/fcb [916547,87063] 0 2024-04-18T21:07:01.895 INFO:tasks.workunit.client.0.smithi078.stdout:5/725: creat d9/da/d32/da5/fe1 x:0 0 0 2024-04-18T21:07:01.895 INFO:tasks.workunit.client.0.smithi078.stdout:1/837: creat d0/d2a/d5f/d89/f115 x:0 0 0 2024-04-18T21:07:01.896 INFO:tasks.workunit.client.0.smithi078.stdout:1/838: stat d0/dda 0 2024-04-18T21:07:01.896 INFO:tasks.workunit.client.0.smithi078.stdout:5/726: chown d9/da/d8c/fa6 374754 1 2024-04-18T21:07:01.896 INFO:tasks.workunit.client.0.smithi078.stdout:2/716: dwrite d0/fd1 [0,4194304] 0 2024-04-18T21:07:01.896 INFO:tasks.workunit.client.0.smithi078.stdout:7/723: readlink d1/d16/dc/d11/da2/lae 0 2024-04-18T21:07:01.897 INFO:tasks.workunit.client.0.smithi078.stdout:6/694: truncate d2/d6/dd/f32 500948 0 2024-04-18T21:07:01.897 INFO:tasks.workunit.client.0.smithi078.stdout:1/839: fdatasync d0/d2a/d5f/d89/d32/db2/d10e/d9b/f111 0 2024-04-18T21:07:01.898 INFO:tasks.workunit.client.0.smithi078.stdout:7/724: write d1/d16/dc/d11/d53/d82/da4/faa [35957,108428] 0 2024-04-18T21:07:01.900 INFO:tasks.workunit.client.0.smithi078.stdout:0/772: dread d0/d9/da/df/fa0 [0,4194304] 0 2024-04-18T21:07:01.901 INFO:tasks.workunit.client.0.smithi078.stdout:2/717: mkdir d0/d1f/d34/dd6 0 2024-04-18T21:07:01.902 INFO:tasks.workunit.client.0.smithi078.stdout:3/666: symlink d4/df/d62/lcc 0 2024-04-18T21:07:01.903 INFO:tasks.workunit.client.0.smithi078.stdout:7/725: rename d1/d16/d10/l99 to d1/d16/dc/d11/d53/d82/da4/db5/d91/db3/lf5 0 2024-04-18T21:07:01.903 INFO:tasks.workunit.client.0.smithi078.stdout:2/718: dread - d0/db/d18/d5d/fa2 zero size 2024-04-18T21:07:01.905 INFO:tasks.workunit.client.0.smithi078.stdout:2/719: fsync d0/db/d18/d21/d27/d79/f7f 0 2024-04-18T21:07:01.905 INFO:tasks.workunit.client.0.smithi078.stdout:5/727: dwrite d9/da/d8c/fa6 [4194304,4194304] 0 2024-04-18T21:07:01.905 INFO:tasks.workunit.client.0.smithi078.stdout:6/695: dwrite d2/d1c/d63/d8b/dcb/fde [0,4194304] 0 2024-04-18T21:07:01.906 INFO:tasks.workunit.client.0.smithi078.stdout:5/728: dread - d9/da/d3e/d4c/d67/f7b zero size 2024-04-18T21:07:01.906 INFO:tasks.workunit.client.0.smithi078.stdout:7/726: read d1/f80 [73748,100268] 0 2024-04-18T21:07:01.906 INFO:tasks.workunit.client.0.smithi078.stdout:2/720: mkdir d0/d1f/dd7 0 2024-04-18T21:07:01.907 INFO:tasks.workunit.client.0.smithi078.stdout:6/696: creat d2/d1c/d63/d8b/fef x:0 0 0 2024-04-18T21:07:01.907 INFO:tasks.workunit.client.0.smithi078.stdout:5/729: chown d9/da/d3e/d4c/l5e 36962 1 2024-04-18T21:07:01.908 INFO:tasks.workunit.client.0.smithi078.stdout:0/773: dwrite d0/d15/f27 [0,4194304] 0 2024-04-18T21:07:01.912 INFO:tasks.workunit.client.0.smithi078.stdout:6/697: mknod d2/d34/d35/d57/cf0 0 2024-04-18T21:07:01.912 INFO:tasks.workunit.client.0.smithi078.stdout:0/774: symlink d0/d9/dd/d17/d82/lf0 0 2024-04-18T21:07:01.913 INFO:tasks.workunit.client.0.smithi078.stdout:7/727: dwrite d1/d16/dc/d4b/f43 [0,4194304] 0 2024-04-18T21:07:01.913 INFO:tasks.workunit.client.0.smithi078.stdout:4/808: dread d0/dc/d10/f32 [4194304,4194304] 0 2024-04-18T21:07:01.915 INFO:tasks.workunit.client.0.smithi078.stdout:4/809: readlink d0/dc/d10/d1c/d6a/ldf 0 2024-04-18T21:07:01.916 INFO:tasks.workunit.client.0.smithi078.stdout:5/730: dwrite d9/da/d90/d62/fd7 [0,4194304] 0 2024-04-18T21:07:01.917 INFO:tasks.workunit.client.0.smithi078.stdout:4/810: link d0/dc/d10/d1c/d110/fa5 d0/dc/d29/d2f/f112 0 2024-04-18T21:07:01.918 INFO:tasks.workunit.client.0.smithi078.stdout:5/731: read d9/da/d3e/d4c/d6d/d75/fb3 [253352,80439] 0 2024-04-18T21:07:01.919 INFO:tasks.workunit.client.0.smithi078.stdout:5/732: link d9/d2e/l31 d9/da/d3e/d4c/d6d/d75/dbc/le2 0 2024-04-18T21:07:01.922 INFO:tasks.workunit.client.0.smithi078.stdout:5/733: rename d9/da/d3e/d4c/d6d/c7f to d9/da/d3e/d4c/db1/db8/ce3 0 2024-04-18T21:07:01.923 INFO:tasks.workunit.client.0.smithi078.stdout:5/734: rename d9/da/d4b/f4d to d9/da/d90/d62/da4/dbd/dc1/fe4 0 2024-04-18T21:07:01.924 INFO:tasks.workunit.client.0.smithi078.stdout:5/735: mkdir d9/da/d32/da5/de5 0 2024-04-18T21:07:01.924 INFO:tasks.workunit.client.0.smithi078.stdout:5/736: write d9/da/d8c/fa6 [6959212,3502] 0 2024-04-18T21:07:01.926 INFO:tasks.workunit.client.0.smithi078.stdout:8/778: dread d0/d10/d14/d2a/f71 [0,4194304] 0 2024-04-18T21:07:01.927 INFO:tasks.workunit.client.0.smithi078.stdout:8/779: mkdir d0/d10/d14/d2a/d4a/db2/db6/dcc/df2 0 2024-04-18T21:07:01.927 INFO:tasks.workunit.client.0.smithi078.stdout:1/840: truncate d0/d11/d69/f97 325949 0 2024-04-18T21:07:01.928 INFO:tasks.workunit.client.0.smithi078.stdout:3/667: write d4/d2d/d30/f34 [710083,1439] 0 2024-04-18T21:07:01.928 INFO:tasks.workunit.client.0.smithi078.stdout:1/841: fsync d0/d2a/ff2 0 2024-04-18T21:07:01.929 INFO:tasks.workunit.client.0.smithi078.stdout:3/668: symlink d4/d2d/d6c/db5/lcd 0 2024-04-18T21:07:01.933 INFO:tasks.workunit.client.0.smithi078.stdout:8/780: dwrite d0/d10/d14/d2d/d93/da0/db5/de2/fe3 [8388608,4194304] 0 2024-04-18T21:07:01.934 INFO:tasks.workunit.client.0.smithi078.stdout:8/781: chown d0/f26 111104 1 2024-04-18T21:07:01.934 INFO:tasks.workunit.client.0.smithi078.stdout:1/842: dwrite d0/d11/f22 [4194304,4194304] 0 2024-04-18T21:07:01.935 INFO:tasks.workunit.client.0.smithi078.stdout:1/843: mkdir d0/dca/d116 0 2024-04-18T21:07:01.936 INFO:tasks.workunit.client.0.smithi078.stdout:1/844: mkdir d0/d2a/d45/d81/d117 0 2024-04-18T21:07:01.937 INFO:tasks.workunit.client.0.smithi078.stdout:4/811: truncate d0/dc/d10/f32 3020772 0 2024-04-18T21:07:01.937 INFO:tasks.workunit.client.0.smithi078.stdout:5/737: write d9/da/f1b [4321369,17296] 0 2024-04-18T21:07:01.938 INFO:tasks.workunit.client.0.smithi078.stdout:4/812: chown d0/d73/f75 440 1 2024-04-18T21:07:01.940 INFO:tasks.workunit.client.0.smithi078.stdout:5/738: creat d9/da/d90/d62/da4/dbd/fe6 x:0 0 0 2024-04-18T21:07:01.941 INFO:tasks.workunit.client.0.smithi078.stdout:4/813: creat d0/dc/d10/d1c/d6a/f113 x:0 0 0 2024-04-18T21:07:01.941 INFO:tasks.workunit.client.0.smithi078.stdout:6/698: dwrite d2/d6/dd/f68 [4194304,4194304] 0 2024-04-18T21:07:01.941 INFO:tasks.workunit.client.0.smithi078.stdout:2/721: dwrite d0/d1f/f2b [0,4194304] 0 2024-04-18T21:07:01.942 INFO:tasks.workunit.client.0.smithi078.stdout:4/814: rmdir d0/dc/d5b/d4f 39 2024-04-18T21:07:01.943 INFO:tasks.workunit.client.0.smithi078.stdout:5/739: rename d9/da/d3e/d4c/d67/d8d to d9/da/de7 0 2024-04-18T21:07:01.943 INFO:tasks.workunit.client.0.smithi078.stdout:8/782: dwrite d0/d10/d14/d2d/f3f [0,4194304] 0 2024-04-18T21:07:01.943 INFO:tasks.workunit.client.0.smithi078.stdout:6/699: read - d2/d74/fb1 zero size 2024-04-18T21:07:01.944 INFO:tasks.workunit.client.0.smithi078.stdout:4/815: unlink d0/dc/d10/d1c/d110/ccd 0 2024-04-18T21:07:01.944 INFO:tasks.workunit.client.0.smithi078.stdout:8/783: creat d0/da8/ff3 x:0 0 0 2024-04-18T21:07:01.944 INFO:tasks.workunit.client.0.smithi078.stdout:5/740: write d9/da/f13 [1369772,101251] 0 2024-04-18T21:07:01.946 INFO:tasks.workunit.client.0.smithi078.stdout:5/741: mkdir d9/d2e/d65/de8 0 2024-04-18T21:07:01.946 INFO:tasks.workunit.client.0.smithi078.stdout:4/816: unlink d0/dc/d29/d2f/f38 0 2024-04-18T21:07:01.947 INFO:tasks.workunit.client.0.smithi078.stdout:1/845: dwrite d0/d2a/d5f/d89/d32/db2/d10e/d50/fa6 [4194304,4194304] 0 2024-04-18T21:07:01.947 INFO:tasks.workunit.client.0.smithi078.stdout:8/784: unlink d0/d22/l6b 0 2024-04-18T21:07:01.947 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:01.950+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:01.947 INFO:tasks.workunit.client.0.smithi078.stdout:1/846: fsync d0/d2a/d5f/fe4 0 2024-04-18T21:07:01.948 INFO:tasks.workunit.client.0.smithi078.stdout:9/811: dread d7/d11/d2d/d3f/f8c [4194304,4194304] 0 2024-04-18T21:07:01.949 INFO:tasks.workunit.client.0.smithi078.stdout:9/812: fsync d7/f37 0 2024-04-18T21:07:01.949 INFO:tasks.workunit.client.0.smithi078.stdout:5/742: symlink d9/da/d3e/d4c/d6d/le9 0 2024-04-18T21:07:01.950 INFO:tasks.workunit.client.0.smithi078.stdout:8/785: unlink d0/d10/c16 0 2024-04-18T21:07:01.950 INFO:tasks.workunit.client.0.smithi078.stdout:1/847: creat d0/d2a/d5f/d89/d32/db2/d10e/d50/d78/f118 x:0 0 0 2024-04-18T21:07:01.950 INFO:tasks.workunit.client.0.smithi078.stdout:5/743: fsync d9/d2e/fc8 0 2024-04-18T21:07:01.950 INFO:tasks.workunit.client.0.smithi078.stdout:9/813: chown d7/df/d54/d95 171091 1 2024-04-18T21:07:01.951 INFO:tasks.workunit.client.0.smithi078.stdout:6/700: dwrite d2/d34/fed [0,4194304] 0 2024-04-18T21:07:01.952 INFO:tasks.workunit.client.0.smithi078.stdout:1/848: truncate d0/d2a/d3c/da8/f108 741007 0 2024-04-18T21:07:01.952 INFO:tasks.workunit.client.0.smithi078.stdout:6/701: write d2/d34/fd9 [687923,67791] 0 2024-04-18T21:07:01.952 INFO:tasks.workunit.client.0.smithi078.stdout:9/814: symlink d7/d11/d1b/dcd/l117 0 2024-04-18T21:07:01.952 INFO:tasks.workunit.client.0.smithi078.stdout:8/786: mkdir d0/d10/d14/d2a/d4a/db2/db6/df4 0 2024-04-18T21:07:01.953 INFO:tasks.workunit.client.0.smithi078.stdout:1/849: symlink d0/d2a/d5f/d89/d32/db2/d10e/d50/d78/l119 0 2024-04-18T21:07:01.954 INFO:tasks.workunit.client.0.smithi078.stdout:5/744: fdatasync d9/da/d90/d62/fd7 0 2024-04-18T21:07:01.954 INFO:tasks.workunit.client.0.smithi078.stdout:4/817: dwrite d0/dc/d10/d1c/d60/dee/dc4/df3/fe5 [0,4194304] 0 2024-04-18T21:07:01.956 INFO:tasks.workunit.client.0.smithi078.stdout:3/669: write d4/d2d/d30/d35/d4b/f9c [3727741,16560] 0 2024-04-18T21:07:01.958 INFO:tasks.workunit.client.0.smithi078.stdout:5/745: creat d9/d9f/dd4/fea x:0 0 0 2024-04-18T21:07:01.958 INFO:tasks.workunit.client.0.smithi078.stdout:4/818: chown d0/dc/d10/c1a 6584 1 2024-04-18T21:07:01.958 INFO:tasks.workunit.client.0.smithi078.stdout:3/670: stat d4/d2d/d30/d35/d71/c7c 0 2024-04-18T21:07:01.959 INFO:tasks.workunit.client.0.smithi078.stdout:8/787: write d0/d10/d14/d2d/d93/f81 [966487,11480] 0 2024-04-18T21:07:01.961 INFO:tasks.workunit.client.0.smithi078.stdout:4/819: creat d0/dc/d10/d3a/f114 x:0 0 0 2024-04-18T21:07:01.961 INFO:tasks.workunit.client.0.smithi078.stdout:3/671: mkdir d4/da/d76/dce 0 2024-04-18T21:07:01.961 INFO:tasks.workunit.client.0.smithi078.stdout:8/788: chown d0/d10/d60 498285979 1 2024-04-18T21:07:01.962 INFO:tasks.workunit.client.0.smithi078.stdout:6/702: dwrite d2/d34/d35/d57/d90/fd5 [0,4194304] 0 2024-04-18T21:07:01.963 INFO:tasks.workunit.client.0.smithi078.stdout:1/850: dwrite d0/d2a/d5f/d89/d32/db2/d10e/f44 [8388608,4194304] 0 2024-04-18T21:07:01.964 INFO:tasks.workunit.client.0.smithi078.stdout:8/789: mknod d0/d10/d14/d2a/dbd/cf5 0 2024-04-18T21:07:01.964 INFO:tasks.workunit.client.0.smithi078.stdout:6/703: mkdir d2/d1c/db3/dbb/df1 0 2024-04-18T21:07:01.964 INFO:tasks.workunit.client.0.smithi078.stdout:4/820: truncate d0/dc/d29/d6d/d7b/f88 1677024 0 2024-04-18T21:07:01.964 INFO:tasks.workunit.client.0.smithi078.stdout:3/672: link d4/da/d11/d66/fbf d4/df/fcf 0 2024-04-18T21:07:01.964 INFO:tasks.workunit.client.0.smithi078.stdout:6/704: dread - d2/d1c/d3a/d8c/fdc zero size 2024-04-18T21:07:01.965 INFO:tasks.workunit.client.0.smithi078.stdout:3/673: write d4/d2d/d30/f9f [4276625,26592] 0 2024-04-18T21:07:01.965 INFO:tasks.workunit.client.0.smithi078.stdout:4/821: truncate d0/dc/d10/d41/d5f/fb7 4228215 0 2024-04-18T21:07:01.966 INFO:tasks.workunit.client.0.smithi078.stdout:3/674: mkdir d4/da/d11/d66/dbe/dd0 0 2024-04-18T21:07:01.967 INFO:tasks.workunit.client.0.smithi078.stdout:3/675: write d4/f70 [1661796,101672] 0 2024-04-18T21:07:01.967 INFO:tasks.workunit.client.0.smithi078.stdout:4/822: link d0/f7 d0/dc/d10/d1c/d6a/d81/dd4/f115 0 2024-04-18T21:07:01.968 INFO:tasks.workunit.client.0.smithi078.stdout:3/676: dread - d4/d2d/d30/d35/d4b/d59/fad zero size 2024-04-18T21:07:01.968 INFO:tasks.workunit.client.0.smithi078.stdout:4/823: creat d0/dc/d29/d6d/d7b/f116 x:0 0 0 2024-04-18T21:07:01.969 INFO:tasks.workunit.client.0.smithi078.stdout:4/824: unlink d0/dc/d10/d1c/d60/daf/c10a 0 2024-04-18T21:07:01.970 INFO:tasks.workunit.client.0.smithi078.stdout:1/851: dwrite d0/d2a/d3c/f6b [0,4194304] 0 2024-04-18T21:07:01.970 INFO:tasks.workunit.client.0.smithi078.stdout:5/746: truncate d9/da/d32/f70 1009945 0 2024-04-18T21:07:01.971 INFO:tasks.workunit.client.0.smithi078.stdout:5/747: readlink d9/da/d8c/daf/lcb 0 2024-04-18T21:07:01.971 INFO:tasks.workunit.client.0.smithi078.stdout:5/748: write d9/da/d3e/d4c/d67/fd3 [1036324,60908] 0 2024-04-18T21:07:01.972 INFO:tasks.workunit.client.0.smithi078.stdout:6/705: truncate d2/d1c/f53 1062802 0 2024-04-18T21:07:01.972 INFO:tasks.workunit.client.0.smithi078.stdout:4/825: symlink d0/dc/d10/d1c/d60/dee/dc4/l117 0 2024-04-18T21:07:01.973 INFO:tasks.workunit.client.0.smithi078.stdout:1/852: symlink d0/dc1/dd3/l11a 0 2024-04-18T21:07:01.973 INFO:tasks.workunit.client.0.smithi078.stdout:5/749: chown d9/d2e/f9e 4152060 1 2024-04-18T21:07:01.974 INFO:tasks.workunit.client.0.smithi078.stdout:6/706: mknod d2/d1f/cf2 0 2024-04-18T21:07:01.974 INFO:tasks.workunit.client.0.smithi078.stdout:1/853: write d0/d2a/d5f/d89/d32/d35/fab [948452,82046] 0 2024-04-18T21:07:01.974 INFO:tasks.workunit.client.0.smithi078.stdout:5/750: write d9/da/de7/fca [496664,79819] 0 2024-04-18T21:07:01.975 INFO:tasks.workunit.client.0.smithi078.stdout:6/707: mknod d2/d34/dce/cf3 0 2024-04-18T21:07:01.975 INFO:tasks.workunit.client.0.smithi078.stdout:1/854: symlink d0/d2a/d5f/d89/d32/d35/d85/l11b 0 2024-04-18T21:07:01.975 INFO:tasks.workunit.client.0.smithi078.stdout:5/751: mkdir d9/da/d90/deb 0 2024-04-18T21:07:01.976 INFO:tasks.workunit.client.0.smithi078.stdout:5/752: write d9/da/ff [579846,25193] 0 2024-04-18T21:07:01.976 INFO:tasks.workunit.client.0.smithi078.stdout:6/708: write d2/d34/dce/fe6 [283927,82910] 0 2024-04-18T21:07:01.978 INFO:tasks.workunit.client.0.smithi078.stdout:6/709: stat d2/d1c/d6b/l86 0 2024-04-18T21:07:01.978 INFO:tasks.workunit.client.0.smithi078.stdout:7/728: dread d1/d16/f46 [0,4194304] 0 2024-04-18T21:07:01.980 INFO:tasks.workunit.client.0.smithi078.stdout:4/826: dwrite d0/dc/d10/d1c/d6a/fb9 [0,4194304] 0 2024-04-18T21:07:01.983 INFO:tasks.workunit.client.0.smithi078.stdout:1/855: dread d0/d2a/d5f/d89/d32/fa7 [0,4194304] 0 2024-04-18T21:07:01.985 INFO:tasks.workunit.client.0.smithi078.stdout:1/856: write d0/d2a/d45/f5c [177051,8002] 0 2024-04-18T21:07:01.985 INFO:tasks.workunit.client.0.smithi078.stdout:6/710: dwrite d2/d34/d35/d57/d90/fd5 [4194304,4194304] 0 2024-04-18T21:07:01.987 INFO:tasks.workunit.client.0.smithi078.stdout:1/857: readlink d0/d2a/d5f/d89/d32/d35/d85/ld2 0 2024-04-18T21:07:01.988 INFO:tasks.workunit.client.0.smithi078.stdout:4/827: dwrite d0/dc/d10/d1c/f8e [0,4194304] 0 2024-04-18T21:07:01.988 INFO:tasks.workunit.client.0.smithi078.stdout:8/790: dread d0/d22/f95 [0,4194304] 0 2024-04-18T21:07:01.990 INFO:tasks.workunit.client.0.smithi078.stdout:6/711: mkdir d2/d6/dea/df4 0 2024-04-18T21:07:01.990 INFO:tasks.workunit.client.0.smithi078.stdout:1/858: link d0/d2a/d5f/d89/d32/ffd d0/dda/f11c 0 2024-04-18T21:07:01.991 INFO:tasks.workunit.client.0.smithi078.stdout:1/859: symlink d0/d2a/d5f/d89/d32/d35/d71/l11d 0 2024-04-18T21:07:01.991 INFO:tasks.workunit.client.0.smithi078.stdout:6/712: rename d2/d1c/d3a/la9 to d2/d1c/d63/d8b/lf5 0 2024-04-18T21:07:01.992 INFO:tasks.workunit.client.0.smithi078.stdout:6/713: rename d2/d34/dce/fe6 to d2/d1c/d6b/ff6 0 2024-04-18T21:07:01.993 INFO:tasks.workunit.client.0.smithi078.stdout:6/714: chown d2/d6/dd/dc2 21 1 2024-04-18T21:07:01.994 INFO:tasks.workunit.client.0.smithi078.stdout:8/791: dwrite d0/d10/d14/f70 [0,4194304] 0 2024-04-18T21:07:01.994 INFO:tasks.workunit.client.0.smithi078.stdout:6/715: unlink d2/d6/f1a 0 2024-04-18T21:07:01.995 INFO:tasks.workunit.client.0.smithi078.stdout:6/716: write d2/d1f/f2e [2851927,95331] 0 2024-04-18T21:07:01.995 INFO:tasks.workunit.client.0.smithi078.stdout:8/792: read d0/d5c/d5a/d7b/f8a [2021554,124547] 0 2024-04-18T21:07:01.996 INFO:tasks.workunit.client.0.smithi078.stdout:6/717: chown d2/d34/d35/fbe 375678 1 2024-04-18T21:07:01.998 INFO:tasks.workunit.client.0.smithi078.stdout:1/860: dwrite d0/d2a/d5f/d89/d32/d35/d71/fae [0,4194304] 0 2024-04-18T21:07:01.999 INFO:tasks.workunit.client.0.smithi078.stdout:9/815: dread d7/f37 [0,4194304] 0 2024-04-18T21:07:02.000 INFO:tasks.workunit.client.0.smithi078.stdout:1/861: mknod d0/d2a/d5f/d89/d32/db2/d10e/d50/c11e 0 2024-04-18T21:07:02.001 INFO:tasks.workunit.client.0.smithi078.stdout:9/816: mknod d7/d11/d1b/d45/c118 0 2024-04-18T21:07:02.002 INFO:tasks.workunit.client.0.smithi078.stdout:1/862: chown d0/d2a/d3c/d4b/d52/fc5 3948756 1 2024-04-18T21:07:02.002 INFO:tasks.workunit.client.0.smithi078.stdout:8/793: dwrite d0/d10/d14/d2d/f83 [0,4194304] 0 2024-04-18T21:07:02.003 INFO:tasks.workunit.client.0.smithi078.stdout:6/718: dwrite d2/d6/fe9 [0,4194304] 0 2024-04-18T21:07:02.005 INFO:tasks.workunit.client.0.smithi078.stdout:3/677: dread d4/da/d11/d66/f93 [0,4194304] 0 2024-04-18T21:07:02.006 INFO:tasks.workunit.client.0.smithi078.stdout:6/719: creat d2/d6/dd/ff7 x:0 0 0 2024-04-18T21:07:02.008 INFO:tasks.workunit.client.0.smithi078.stdout:1/863: dread d0/d2a/d5f/d89/d32/db2/d10e/f44 [8388608,4194304] 0 2024-04-18T21:07:02.008 INFO:tasks.workunit.client.0.smithi078.stdout:0/775: sync 2024-04-18T21:07:02.008 INFO:tasks.workunit.client.0.smithi078.stdout:2/722: sync 2024-04-18T21:07:02.008 INFO:tasks.workunit.client.0.smithi078.stdout:6/720: write d2/d1c/d3a/fd0 [390012,91077] 0 2024-04-18T21:07:02.010 INFO:tasks.workunit.client.0.smithi078.stdout:1/864: mknod d0/de7/c11f 0 2024-04-18T21:07:02.011 INFO:tasks.workunit.client.0.smithi078.stdout:0/776: creat d0/d9/da/df/de3/ff1 x:0 0 0 2024-04-18T21:07:02.011 INFO:tasks.workunit.client.0.smithi078.stdout:2/723: creat d0/db/fd8 x:0 0 0 2024-04-18T21:07:02.011 INFO:tasks.workunit.client.0.smithi078.stdout:6/721: symlink d2/d1c/d6b/dba/deb/d5d/lf8 0 2024-04-18T21:07:02.011 INFO:tasks.workunit.client.0.smithi078.stdout:8/794: dwrite d0/d10/d60/d6f/fe1 [0,4194304] 0 2024-04-18T21:07:02.011 INFO:tasks.workunit.client.0.smithi078.stdout:3/678: dread d4/d2d/d30/f34 [0,4194304] 0 2024-04-18T21:07:02.012 INFO:tasks.workunit.client.0.smithi078.stdout:2/724: chown d0/db/d18/d21/c7d 1686432 1 2024-04-18T21:07:02.013 INFO:tasks.workunit.client.0.smithi078.stdout:3/679: creat d4/df/db0/fd1 x:0 0 0 2024-04-18T21:07:02.013 INFO:tasks.workunit.client.0.smithi078.stdout:6/722: chown d2/d1c/d6b/dba/deb/d5d/fa4 2768441 1 2024-04-18T21:07:02.014 INFO:tasks.workunit.client.0.smithi078.stdout:2/725: rmdir d0/d1f/dd7 0 2024-04-18T21:07:02.014 INFO:tasks.workunit.client.0.smithi078.stdout:9/817: read d7/f37 [7682063,48044] 0 2024-04-18T21:07:02.014 INFO:tasks.workunit.client.0.smithi078.stdout:3/680: mknod d4/da/d11/cd2 0 2024-04-18T21:07:02.014 INFO:tasks.workunit.client.0.smithi078.stdout:2/726: stat d0/f10 0 2024-04-18T21:07:02.014 INFO:tasks.workunit.client.0.smithi078.stdout:0/777: read d0/d9/d58/f62 [171786,77523] 0 2024-04-18T21:07:02.015 INFO:tasks.workunit.client.0.smithi078.stdout:6/723: symlink d2/dbf/lf9 0 2024-04-18T21:07:02.015 INFO:tasks.workunit.client.0.smithi078.stdout:2/727: fdatasync d0/d1f/f7e 0 2024-04-18T21:07:02.016 INFO:tasks.workunit.client.0.smithi078.stdout:9/818: write d7/d83/f91 [847105,111770] 0 2024-04-18T21:07:02.016 INFO:tasks.workunit.client.0.smithi078.stdout:6/724: fsync d2/d1c/d30/fc9 0 2024-04-18T21:07:02.016 INFO:tasks.workunit.client.0.smithi078.stdout:3/681: rename d4/d2d/d30/d35/l31 to d4/df/db0/dc5/d74/ld3 0 2024-04-18T21:07:02.016 INFO:tasks.workunit.client.0.smithi078.stdout:2/728: fdatasync d0/db/d18/d21/d27/d29/fa0 0 2024-04-18T21:07:02.016 INFO:tasks.workunit.client.0.smithi078.stdout:6/725: mknod d2/d34/d75/cfa 0 2024-04-18T21:07:02.018 INFO:tasks.workunit.client.0.smithi078.stdout:9/819: creat d7/df/f119 x:0 0 0 2024-04-18T21:07:02.018 INFO:tasks.workunit.client.0.smithi078.stdout:1/865: dread d0/d2a/d5f/d89/d32/db2/d10e/f56 [0,4194304] 0 2024-04-18T21:07:02.018 INFO:tasks.workunit.client.0.smithi078.stdout:2/729: creat d0/db/d18/dbb/fd9 x:0 0 0 2024-04-18T21:07:02.021 INFO:tasks.workunit.client.0.smithi078.stdout:3/682: read d4/f6a [45581,27658] 0 2024-04-18T21:07:02.022 INFO:tasks.workunit.client.0.smithi078.stdout:2/730: dread d0/d1f/f9e [0,4194304] 0 2024-04-18T21:07:02.022 INFO:tasks.workunit.client.0.smithi078.stdout:5/753: dread d9/da/f2d [0,4194304] 0 2024-04-18T21:07:02.023 INFO:tasks.workunit.client.0.smithi078.stdout:2/731: mkdir d0/da9/dda 0 2024-04-18T21:07:02.024 INFO:tasks.workunit.client.0.smithi078.stdout:5/754: symlink d9/da/d90/lec 0 2024-04-18T21:07:02.024 INFO:tasks.workunit.client.0.smithi078.stdout:9/820: dwrite d7/d11/d80/fa3 [0,4194304] 0 2024-04-18T21:07:02.025 INFO:tasks.workunit.client.0.smithi078.stdout:5/755: fdatasync d9/da/d3e/d4c/d6d/d73/fa1 0 2024-04-18T21:07:02.026 INFO:tasks.workunit.client.0.smithi078.stdout:1/866: dread d0/d2a/d45/fa1 [0,4194304] 0 2024-04-18T21:07:02.027 INFO:tasks.workunit.client.0.smithi078.stdout:8/795: write d0/d22/fb8 [937508,101302] 0 2024-04-18T21:07:02.027 INFO:tasks.workunit.client.0.smithi078.stdout:9/821: link d7/d11/d1b/f5f d7/df/d54/d95/d9d/dd1/d10a/d3e/d5a/da8/f11a 0 2024-04-18T21:07:02.028 INFO:tasks.workunit.client.0.smithi078.stdout:8/796: readlink d0/d10/d60/d6f/ld8 0 2024-04-18T21:07:02.028 INFO:tasks.workunit.client.0.smithi078.stdout:2/732: dread d0/f32 [0,4194304] 0 2024-04-18T21:07:02.028 INFO:tasks.workunit.client.0.smithi078.stdout:9/822: rename d7/d11/d2d/f4e to d7/d11/d47/f11b 0 2024-04-18T21:07:02.029 INFO:tasks.workunit.client.0.smithi078.stdout:9/823: dread - d7/d11/d2d/fd0 zero size 2024-04-18T21:07:02.029 INFO:tasks.workunit.client.0.smithi078.stdout:8/797: symlink d0/d10/d14/d2a/d4a/db2/db6/dcc/lf6 0 2024-04-18T21:07:02.030 INFO:tasks.workunit.client.0.smithi078.stdout:2/733: rename d0/d1f/f44 to d0/db/d18/d21/db0/fdb 0 2024-04-18T21:07:02.030 INFO:tasks.workunit.client.0.smithi078.stdout:9/824: creat d7/df/d54/d115/de2/f11c x:0 0 0 2024-04-18T21:07:02.031 INFO:tasks.workunit.client.0.smithi078.stdout:8/798: symlink d0/d10/d14/d2d/d93/lf7 0 2024-04-18T21:07:02.031 INFO:tasks.workunit.client.0.smithi078.stdout:2/734: mkdir d0/db/d18/d21/db0/ddc 0 2024-04-18T21:07:02.032 INFO:tasks.workunit.client.0.smithi078.stdout:9/825: symlink d7/d11/d2d/l11d 0 2024-04-18T21:07:02.032 INFO:tasks.workunit.client.0.smithi078.stdout:8/799: chown d0/d10/d60/d6f/f7a 1773 1 2024-04-18T21:07:02.033 INFO:tasks.workunit.client.0.smithi078.stdout:9/826: write f6 [5316159,128817] 0 2024-04-18T21:07:02.033 INFO:tasks.workunit.client.0.smithi078.stdout:2/735: write d0/db/fb1 [901623,81388] 0 2024-04-18T21:07:02.033 INFO:tasks.workunit.client.0.smithi078.stdout:1/867: dwrite d0/d2a/d45/d81/dc8/ffb [0,4194304] 0 2024-04-18T21:07:02.034 INFO:tasks.workunit.client.0.smithi078.stdout:4/828: dread d0/dc/d29/f4c [0,4194304] 0 2024-04-18T21:07:02.035 INFO:tasks.workunit.client.0.smithi078.stdout:2/736: unlink d0/d1f/d5b/la3 0 2024-04-18T21:07:02.035 INFO:tasks.workunit.client.0.smithi078.stdout:8/800: unlink d0/d10/d14/d2a/d4a/f75 0 2024-04-18T21:07:02.035 INFO:tasks.workunit.client.0.smithi078.stdout:4/829: unlink d0/dc/dd7/fef 0 2024-04-18T21:07:02.036 INFO:tasks.workunit.client.0.smithi078.stdout:1/868: chown d0/d11/ccf 37152133 1 2024-04-18T21:07:02.036 INFO:tasks.workunit.client.0.smithi078.stdout:6/726: dread d2/d1f/f29 [0,4194304] 0 2024-04-18T21:07:02.036 INFO:tasks.workunit.client.0.smithi078.stdout:4/830: mknod d0/dc/d10/d1c/d60/c118 0 2024-04-18T21:07:02.036 INFO:tasks.workunit.client.0.smithi078.stdout:2/737: mkdir d0/db/d18/d21/db0/ddc/ddd 0 2024-04-18T21:07:02.037 INFO:tasks.workunit.client.0.smithi078.stdout:1/869: mknod d0/d2a/d45/d81/d117/c120 0 2024-04-18T21:07:02.037 INFO:tasks.workunit.client.0.smithi078.stdout:2/738: chown d0/db/d6e/dd2 330 1 2024-04-18T21:07:02.037 INFO:tasks.workunit.client.0.smithi078.stdout:1/870: stat d0/d2a/d5f/d89/d32/db2/lbb 0 2024-04-18T21:07:02.038 INFO:tasks.workunit.client.0.smithi078.stdout:1/871: fdatasync d0/d2a/ff2 0 2024-04-18T21:07:02.038 INFO:tasks.workunit.client.0.smithi078.stdout:2/739: write d0/db/d18/d21/db0/f47 [2698231,130860] 0 2024-04-18T21:07:02.038 INFO:tasks.workunit.client.0.smithi078.stdout:1/872: stat d0/d2a/d3c/da8/f108 0 2024-04-18T21:07:02.039 INFO:tasks.workunit.client.0.smithi078.stdout:2/740: write d0/d1f/f2b [3009398,104480] 0 2024-04-18T21:07:02.040 INFO:tasks.workunit.client.0.smithi078.stdout:0/778: truncate d0/d9/da/fb0 2357783 0 2024-04-18T21:07:02.040 INFO:tasks.workunit.client.0.smithi078.stdout:2/741: mkdir d0/db/d18/dbb/dde 0 2024-04-18T21:07:02.041 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:02.042+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:02.041 INFO:tasks.workunit.client.0.smithi078.stdout:1/873: getdents d0/d2a/d5f/d89/d32/db2/d10e/d50 0 2024-04-18T21:07:02.042 INFO:tasks.workunit.client.0.smithi078.stdout:7/729: dread d1/d32/f66 [0,4194304] 0 2024-04-18T21:07:02.042 INFO:tasks.workunit.client.0.smithi078.stdout:2/742: truncate d0/d1f/d5b/fad 589369 0 2024-04-18T21:07:02.043 INFO:tasks.workunit.client.0.smithi078.stdout:5/756: write d9/da/f35 [1388857,45319] 0 2024-04-18T21:07:02.043 INFO:tasks.workunit.client.0.smithi078.stdout:0/779: rename d0/d9/d81/fe2 to d0/d9/dd/d17/ff2 0 2024-04-18T21:07:02.043 INFO:tasks.workunit.client.0.smithi078.stdout:8/801: read d0/d22/fb7 [68897,76218] 0 2024-04-18T21:07:02.043 INFO:tasks.workunit.client.0.smithi078.stdout:9/827: truncate d7/d11/d2d/f31 1911090 0 2024-04-18T21:07:02.043 INFO:tasks.workunit.client.0.smithi078.stdout:6/727: dwrite d2/d6/fe9 [0,4194304] 0 2024-04-18T21:07:02.044 INFO:tasks.workunit.client.0.smithi078.stdout:5/757: chown d9/da/d32/l92 0 1 2024-04-18T21:07:02.045 INFO:tasks.workunit.client.0.smithi078.stdout:6/728: chown d2/d34/c84 2322321 1 2024-04-18T21:07:02.045 INFO:tasks.workunit.client.0.smithi078.stdout:0/780: creat d0/d9/dd/d17/d2e/d7f/ff3 x:0 0 0 2024-04-18T21:07:02.045 INFO:tasks.workunit.client.0.smithi078.stdout:7/730: symlink d1/d16/dc/d11/da2/dbc/lf6 0 2024-04-18T21:07:02.045 INFO:tasks.workunit.client.0.smithi078.stdout:2/743: creat d0/db/d18/d21/d27/d29/d33/fdf x:0 0 0 2024-04-18T21:07:02.045 INFO:tasks.workunit.client.0.smithi078.stdout:8/802: symlink d0/d5c/d5a/d7b/lf8 0 2024-04-18T21:07:02.046 INFO:tasks.workunit.client.0.smithi078.stdout:5/758: chown d9/da/d3e/d4c/d67/l94 5475 1 2024-04-18T21:07:02.046 INFO:tasks.workunit.client.0.smithi078.stdout:6/729: dread - d2/d1c/d63/d8b/fd1 zero size 2024-04-18T21:07:02.046 INFO:tasks.workunit.client.0.smithi078.stdout:1/874: getdents d0/d11/d69/dd0 0 2024-04-18T21:07:02.046 INFO:tasks.workunit.client.0.smithi078.stdout:2/744: chown d0/db/d65/dbd 13 1 2024-04-18T21:07:02.047 INFO:tasks.workunit.client.0.smithi078.stdout:9/828: write d7/d11/d47/f5c [2166783,100543] 0 2024-04-18T21:07:02.047 INFO:tasks.workunit.client.0.smithi078.stdout:0/781: symlink d0/d9/da/lf4 0 2024-04-18T21:07:02.047 INFO:tasks.workunit.client.0.smithi078.stdout:5/759: creat d9/da/d99/fed x:0 0 0 2024-04-18T21:07:02.048 INFO:tasks.workunit.client.0.smithi078.stdout:8/803: write d0/d10/d60/d6f/fe1 [4734109,106685] 0 2024-04-18T21:07:02.048 INFO:tasks.workunit.client.0.smithi078.stdout:2/745: rmdir d0/d1f/d34 39 2024-04-18T21:07:02.048 INFO:tasks.workunit.client.0.smithi078.stdout:1/875: mkdir d0/d2a/d45/d121 0 2024-04-18T21:07:02.049 INFO:tasks.workunit.client.0.smithi078.stdout:0/782: creat d0/ff5 x:0 0 0 2024-04-18T21:07:02.049 INFO:tasks.workunit.client.0.smithi078.stdout:5/760: mkdir d9/d9f/dd4/dee 0 2024-04-18T21:07:02.049 INFO:tasks.workunit.client.0.smithi078.stdout:3/683: sync 2024-04-18T21:07:02.050 INFO:tasks.workunit.client.0.smithi078.stdout:2/746: write d0/d1f/d34/f53 [1174190,35534] 0 2024-04-18T21:07:02.050 INFO:tasks.workunit.client.0.smithi078.stdout:7/731: link d1/d16/d10/d7c/d94/dcf/fda d1/d16/dc/ff7 0 2024-04-18T21:07:02.050 INFO:tasks.workunit.client.0.smithi078.stdout:9/829: link d7/d11/d1b/d45/d4b/c73 d7/d11/d2d/c11e 0 2024-04-18T21:07:02.051 INFO:tasks.workunit.client.0.smithi078.stdout:0/783: unlink d0/d9/d58/f7e 0 2024-04-18T21:07:02.051 INFO:tasks.workunit.client.0.smithi078.stdout:8/804: creat d0/d10/d14/d2d/d93/da0/db5/ff9 x:0 0 0 2024-04-18T21:07:02.051 INFO:tasks.workunit.client.0.smithi078.stdout:3/684: write d4/da/d76/f7b [234816,81667] 0 2024-04-18T21:07:02.051 INFO:tasks.workunit.client.0.smithi078.stdout:5/761: truncate d9/d2e/f9e 851602 0 2024-04-18T21:07:02.053 INFO:tasks.workunit.client.0.smithi078.stdout:7/732: symlink d1/d16/d2d/df4/lf8 0 2024-04-18T21:07:02.054 INFO:tasks.workunit.client.0.smithi078.stdout:0/784: fsync d0/d9/d81/fa7 0 2024-04-18T21:07:02.054 INFO:tasks.workunit.client.0.smithi078.stdout:8/805: mkdir d0/d10/d14/d2d/d93/da0/dc2/dfa 0 2024-04-18T21:07:02.055 INFO:tasks.workunit.client.0.smithi078.stdout:6/730: dwrite d2/d34/fd9 [0,4194304] 0 2024-04-18T21:07:02.055 INFO:tasks.workunit.client.0.smithi078.stdout:7/733: chown d1/d16/d65/fe9 0 1 2024-04-18T21:07:02.056 INFO:tasks.workunit.client.0.smithi078.stdout:0/785: chown d0/d9/da/df/fa0 0 1 2024-04-18T21:07:02.056 INFO:tasks.workunit.client.0.smithi078.stdout:4/831: dread d0/d73/da9/f80 [0,4194304] 0 2024-04-18T21:07:02.056 INFO:tasks.workunit.client.0.smithi078.stdout:7/734: stat d1/d16/dc/d31/lb6 0 2024-04-18T21:07:02.057 INFO:tasks.workunit.client.0.smithi078.stdout:4/832: fdatasync d0/dc/d10/d1c/d60/d74/fba 0 2024-04-18T21:07:02.058 INFO:tasks.workunit.client.0.smithi078.stdout:1/876: dwrite d0/d2a/d3c/d4b/d52/fc5 [0,4194304] 0 2024-04-18T21:07:02.058 INFO:tasks.workunit.client.0.smithi078.stdout:8/806: symlink d0/da8/lfb 0 2024-04-18T21:07:02.058 INFO:tasks.workunit.client.0.smithi078.stdout:3/685: creat d4/d2d/d30/fd4 x:0 0 0 2024-04-18T21:07:02.058 INFO:tasks.workunit.client.0.smithi078.stdout:0/786: write d0/d9/f57 [3652954,25574] 0 2024-04-18T21:07:02.059 INFO:tasks.workunit.client.0.smithi078.stdout:8/807: chown d0/d10/d14/d2d/cd3 22 1 2024-04-18T21:07:02.059 INFO:tasks.workunit.client.0.smithi078.stdout:7/735: symlink d1/d16/dc/d11/d53/d82/lf9 0 2024-04-18T21:07:02.061 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:02.061 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:02.061 INFO:tasks.workunit.client.0.smithi078.stdout:3/686: fsync d4/d2d/d30/d35/d71/f9e 0 2024-04-18T21:07:02.062 INFO:tasks.workunit.client.0.smithi078.stdout:1/877: chown d0/d2a/d5f/d89/fd6 104554 1 2024-04-18T21:07:02.062 INFO:tasks.workunit.client.0.smithi078.stdout:6/731: fsync d2/d6/fe9 0 2024-04-18T21:07:02.062 INFO:tasks.workunit.client.0.smithi078.stdout:9/830: dread d7/f46 [0,4194304] 0 2024-04-18T21:07:02.062 INFO:tasks.workunit.client.0.smithi078.stdout:9/831: sync 2024-04-18T21:07:02.062 INFO:tasks.workunit.client.0.smithi078.stdout:5/762: write d9/da/d4b/fa8 [917000,46080] 0 2024-04-18T21:07:02.062 INFO:tasks.workunit.client.0.smithi078.stdout:4/833: creat d0/dc/d5b/f119 x:0 0 0 2024-04-18T21:07:02.064 INFO:tasks.workunit.client.0.smithi078.stdout:3/687: rename d4/c39 to d4/dc3/cd5 0 2024-04-18T21:07:02.064 INFO:tasks.workunit.client.0.smithi078.stdout:6/732: creat d2/d1c/db3/dbb/ffb x:0 0 0 2024-04-18T21:07:02.066 INFO:tasks.workunit.client.0.smithi078.stdout:1/878: rename d0/d2a/d5f/d89/d32/db2/d10e/d50/d78/l82 to d0/d2a/d5f/d89/d32/d35/d113/l122 0 2024-04-18T21:07:02.067 INFO:tasks.workunit.client.0.smithi078.stdout:0/787: dwrite d0/d9/da/fa4 [0,4194304] 0 2024-04-18T21:07:02.067 INFO:tasks.workunit.client.0.smithi078.stdout:5/763: rename d9/da/d90/d62/da4/dbd to d9/d9f/dd4/dee/def 0 2024-04-18T21:07:02.068 INFO:tasks.workunit.client.0.smithi078.stdout:9/832: dread d7/d11/d2d/d3f/f8c [4194304,4194304] 0 2024-04-18T21:07:02.068 INFO:tasks.workunit.client.0.smithi078.stdout:7/736: dwrite d1/d32/f90 [0,4194304] 0 2024-04-18T21:07:02.069 INFO:tasks.workunit.client.0.smithi078.stdout:5/764: creat d9/da/d8c/daf/ff0 x:0 0 0 2024-04-18T21:07:02.069 INFO:tasks.workunit.client.0.smithi078.stdout:6/733: rename d2/d6/d8d to d2/d1c/d63/da1/dfc 0 2024-04-18T21:07:02.069 INFO:tasks.workunit.client.0.smithi078.stdout:8/808: dwrite d0/d5c/d5a/f98 [0,4194304] 0 2024-04-18T21:07:02.070 INFO:tasks.workunit.client.0.smithi078.stdout:7/737: mkdir d1/d16/d65/dfa 0 2024-04-18T21:07:02.070 INFO:tasks.workunit.client.0.smithi078.stdout:5/765: write d9/f77 [3568944,121460] 0 2024-04-18T21:07:02.071 INFO:tasks.workunit.client.0.smithi078.stdout:1/879: truncate d0/d2a/d5f/d89/d32/db2/d10e/d50/f59 660531 0 2024-04-18T21:07:02.071 INFO:tasks.workunit.client.0.smithi078.stdout:5/766: stat d9/d9f/cab 0 2024-04-18T21:07:02.071 INFO:tasks.workunit.client.0.smithi078.stdout:6/734: truncate d2/d1f/fe0 522051 0 2024-04-18T21:07:02.072 INFO:tasks.workunit.client.0.smithi078.stdout:0/788: rename d0/f8 to d0/d9/dd/d17/d82/ff6 0 2024-04-18T21:07:02.072 INFO:tasks.workunit.client.0.smithi078.stdout:5/767: fdatasync d9/fb 0 2024-04-18T21:07:02.073 INFO:tasks.workunit.client.0.smithi078.stdout:6/735: creat d2/d6/dd/dc2/ffd x:0 0 0 2024-04-18T21:07:02.074 INFO:tasks.workunit.client.0.smithi078.stdout:0/789: chown d0/d9/da/db/d35/d3f/l5b 1709518 1 2024-04-18T21:07:02.074 INFO:tasks.workunit.client.0.smithi078.stdout:1/880: truncate d0/d2a/d5f/d89/d32/d35/d85/fb0 3887879 0 2024-04-18T21:07:02.074 INFO:tasks.workunit.client.0.smithi078.stdout:7/738: link d1/d16/dc/d4b/c6f d1/d16/dc/d11/d53/cfb 0 2024-04-18T21:07:02.075 INFO:tasks.workunit.client.0.smithi078.stdout:5/768: creat d9/da/d3e/d4c/d6d/d73/ff1 x:0 0 0 2024-04-18T21:07:02.075 INFO:tasks.workunit.client.0.smithi078.stdout:7/739: chown d1/d16/dc/d11/d53/f58 316029 1 2024-04-18T21:07:02.075 INFO:tasks.workunit.client.0.smithi078.stdout:1/881: dread - d0/d2a/d5f/d89/d32/db2/d10e/d9b/f106 zero size 2024-04-18T21:07:02.075 INFO:tasks.workunit.client.0.smithi078.stdout:0/790: getdents d0/d9/da/db/d35 0 2024-04-18T21:07:02.076 INFO:tasks.workunit.client.0.smithi078.stdout:7/740: write d1/d16/dc/d11/f2e [1248193,62259] 0 2024-04-18T21:07:02.076 INFO:tasks.workunit.client.0.smithi078.stdout:5/769: getdents d9/da/d3e/d4c/d6d/d75 0 2024-04-18T21:07:02.077 INFO:tasks.workunit.client.0.smithi078.stdout:1/882: write d0/d2a/d5f/d89/d32/db2/d10e/dc6/fc7 [446063,2947] 0 2024-04-18T21:07:02.077 INFO:tasks.workunit.client.0.smithi078.stdout:7/741: stat d1/d16/dc/d11/d53/d82/da4/db5/fb9 0 2024-04-18T21:07:02.079 INFO:tasks.workunit.client.0.smithi078.stdout:9/833: fsync d7/df/d54/fd2 0 2024-04-18T21:07:02.079 INFO:tasks.workunit.client.0.smithi078.stdout:5/770: mkdir d9/d2e/d65/de8/df2 0 2024-04-18T21:07:02.079 INFO:tasks.workunit.client.0.smithi078.stdout:1/883: symlink d0/d2a/d5f/d89/l123 0 2024-04-18T21:07:02.079 INFO:tasks.workunit.client.0.smithi078.stdout:7/742: creat d1/d32/ffc x:0 0 0 2024-04-18T21:07:02.079 INFO:tasks.workunit.client.0.smithi078.stdout:3/688: truncate d4/df/fcf 152033 0 2024-04-18T21:07:02.080 INFO:tasks.workunit.client.0.smithi078.stdout:1/884: creat d0/dc1/f124 x:0 0 0 2024-04-18T21:07:02.080 INFO:tasks.workunit.client.0.smithi078.stdout:9/834: symlink d7/df/d88/l11f 0 2024-04-18T21:07:02.080 INFO:tasks.workunit.client.0.smithi078.stdout:6/736: dwrite d2/d34/fed [0,4194304] 0 2024-04-18T21:07:02.081 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:07:02.082 INFO:tasks.workunit.client.0.smithi078.stdout:7/743: write d1/d16/dc/d11/d53/d82/da4/db5/d91/db4/fde [193999,11718] 0 2024-04-18T21:07:02.082 INFO:tasks.workunit.client.0.smithi078.stdout:6/737: write d2/d1c/db3/dbb/fee [68130,114434] 0 2024-04-18T21:07:02.082 INFO:tasks.workunit.client.0.smithi078.stdout:7/744: chown d1/d16/d1c/d40/f8e 132 1 2024-04-18T21:07:02.083 INFO:tasks.workunit.client.0.smithi078.stdout:5/771: rename d9/da/c19 to d9/da/cf3 0 2024-04-18T21:07:02.083 INFO:tasks.workunit.client.0.smithi078.stdout:1/885: rmdir d0/de7/dd7 39 2024-04-18T21:07:02.084 INFO:tasks.workunit.client.0.smithi078.stdout:9/835: mkdir d7/df/d88/dce/de1/d120 0 2024-04-18T21:07:02.084 INFO:tasks.workunit.client.0.smithi078.stdout:7/745: write d1/d16/dc/d11/fa8 [1997590,111188] 0 2024-04-18T21:07:02.084 INFO:tasks.workunit.client.0.smithi078.stdout:6/738: fdatasync d2/d1c/d6b/dba/deb/d5d/f6d 0 2024-04-18T21:07:02.085 INFO:tasks.workunit.client.0.smithi078.stdout:6/739: read - d2/dbf/fdf zero size 2024-04-18T21:07:02.086 INFO:tasks.workunit.client.0.smithi078.stdout:2/747: dread d0/db/d18/d21/d27/d29/f69 [0,4194304] 0 2024-04-18T21:07:02.086 INFO:tasks.workunit.client.0.smithi078.stdout:5/772: rename d9/da/d3e/d4c/d6d/d73/f97 to d9/d2e/d65/de8/ff4 0 2024-04-18T21:07:02.086 INFO:tasks.workunit.client.0.smithi078.stdout:9/836: mkdir d7/dcf/d121 0 2024-04-18T21:07:02.086 INFO:tasks.workunit.client.0.smithi078.stdout:5/773: readlink d9/l24 0 2024-04-18T21:07:02.087 INFO:tasks.workunit.client.0.smithi078.stdout:6/740: fsync d2/d1c/d63/d8b/fef 0 2024-04-18T21:07:02.087 INFO:tasks.workunit.client.0.smithi078.stdout:9/837: creat d7/d11/d2d/d3f/d4d/f122 x:0 0 0 2024-04-18T21:07:02.087 INFO:tasks.workunit.client.0.smithi078.stdout:7/746: mknod d1/d16/dc/d11/d53/d82/da4/db5/cfd 0 2024-04-18T21:07:02.088 INFO:tasks.workunit.client.0.smithi078.stdout:5/774: mknod d9/d2e/cf5 0 2024-04-18T21:07:02.088 INFO:tasks.workunit.client.0.smithi078.stdout:2/748: symlink d0/d1f/d34/dd5/dbc/le0 0 2024-04-18T21:07:02.088 INFO:tasks.workunit.client.0.smithi078.stdout:0/791: dwrite d0/f5 [0,4194304] 0 2024-04-18T21:07:02.088 INFO:tasks.workunit.client.0.smithi078.stdout:6/741: write d2/d6/dd/ff7 [97036,91140] 0 2024-04-18T21:07:02.089 INFO:tasks.workunit.client.0.smithi078.stdout:7/747: readlink d1/d16/d1c/l61 0 2024-04-18T21:07:02.089 INFO:tasks.workunit.client.0.smithi078.stdout:9/838: mknod d7/d11/d2d/d3f/db7/dd7/c123 0 2024-04-18T21:07:02.092 INFO:tasks.workunit.client.0.smithi078.stdout:7/748: chown d1/d16/d2d/c38 0 1 2024-04-18T21:07:02.092 INFO:tasks.workunit.client.0.smithi078.stdout:2/749: mkdir d0/db/d18/d21/de1 0 2024-04-18T21:07:02.092 INFO:tasks.workunit.client.0.smithi078.stdout:2/750: dread - d0/db/fd8 zero size 2024-04-18T21:07:02.092 INFO:tasks.workunit.client.0.smithi078.stdout:9/839: write d7/d11/d1b/d45/d4b/d5d/f8d [574054,127577] 0 2024-04-18T21:07:02.092 INFO:tasks.workunit.client.0.smithi078.stdout:2/751: creat d0/db/d18/d21/db0/d59/fe2 x:0 0 0 2024-04-18T21:07:02.092 INFO:tasks.workunit.client.0.smithi078.stdout:7/749: readlink d1/d16/dc/d11/d53/d82/da4/db5/d91/db3/lb8 0 2024-04-18T21:07:02.093 INFO:tasks.workunit.client.0.smithi078.stdout:7/750: mkdir d1/d16/dc/d11/d53/d82/dfe 0 2024-04-18T21:07:02.094 INFO:tasks.workunit.client.0.smithi078.stdout:7/751: readlink d1/d16/d1c/l3e 0 2024-04-18T21:07:02.095 INFO:tasks.workunit.client.0.smithi078.stdout:6/742: dwrite d2/d6/dd/f15 [0,4194304] 0 2024-04-18T21:07:02.096 INFO:tasks.workunit.client.0.smithi078.stdout:7/752: truncate d1/d16/dc/d11/f2b 1633878 0 2024-04-18T21:07:02.097 INFO:tasks.workunit.client.0.smithi078.stdout:6/743: truncate d2/d6/dd/ff7 1102410 0 2024-04-18T21:07:02.097 INFO:tasks.workunit.client.0.smithi078.stdout:7/753: truncate d1/d16/d2d/f7d 5752013 0 2024-04-18T21:07:02.098 INFO:tasks.workunit.client.0.smithi078.stdout:4/834: dread d0/f28 [0,4194304] 0 2024-04-18T21:07:02.100 INFO:tasks.workunit.client.0.smithi078.stdout:3/689: truncate d4/d2d/d30/d35/f4f 117483 0 2024-04-18T21:07:02.101 INFO:tasks.workunit.client.0.smithi078.stdout:5/775: truncate d9/d2e/f66 2724134 0 2024-04-18T21:07:02.102 INFO:tasks.workunit.client.0.smithi078.stdout:3/690: fsync d4/f13 0 2024-04-18T21:07:02.102 INFO:tasks.workunit.client.0.smithi078.stdout:2/752: dwrite d0/db/d18/d5d/fb5 [0,4194304] 0 2024-04-18T21:07:02.102 INFO:tasks.workunit.client.0.smithi078.stdout:7/754: mkdir d1/d16/dc/d11/da2/dbc/dc3/dff 0 2024-04-18T21:07:02.105 INFO:tasks.workunit.client.0.smithi078.stdout:7/755: symlink d1/da6/l100 0 2024-04-18T21:07:02.105 INFO:tasks.workunit.client.0.smithi078.stdout:4/835: truncate d0/dc/d10/d1c/d60/d74/fba 1590597 0 2024-04-18T21:07:02.106 INFO:tasks.workunit.client.0.smithi078.stdout:3/691: write d4/f6a [3319516,58601] 0 2024-04-18T21:07:02.106 INFO:tasks.workunit.client.0.smithi078.stdout:6/744: dwrite d2/d1c/d30/fb2 [0,4194304] 0 2024-04-18T21:07:02.107 INFO:tasks.workunit.client.0.smithi078.stdout:0/792: dwrite d0/d9/da/fb0 [0,4194304] 0 2024-04-18T21:07:02.108 INFO:tasks.workunit.client.0.smithi078.stdout:3/692: symlink d4/df/db0/ld6 0 2024-04-18T21:07:02.109 INFO:tasks.workunit.client.0.smithi078.stdout:0/793: dread - d0/d9/f77 zero size 2024-04-18T21:07:02.109 INFO:tasks.workunit.client.0.smithi078.stdout:6/745: symlink d2/d1c/d6b/d98/lfe 0 2024-04-18T21:07:02.110 INFO:tasks.workunit.client.0.smithi078.stdout:5/776: dwrite d9/f25 [0,4194304] 0 2024-04-18T21:07:02.110 INFO:tasks.workunit.client.0.smithi078.stdout:7/756: link d1/d16/lbf d1/d16/dc/l101 0 2024-04-18T21:07:02.111 INFO:tasks.workunit.client.0.smithi078.stdout:0/794: chown d0/d9/da/df/c3c 163 1 2024-04-18T21:07:02.111 INFO:tasks.workunit.client.0.smithi078.stdout:3/693: chown d4/da/d11/d66/dbe/caa 15315717 1 2024-04-18T21:07:02.112 INFO:tasks.workunit.client.0.smithi078.stdout:6/746: mkdir d2/d1c/d30/dff 0 2024-04-18T21:07:02.112 INFO:tasks.workunit.client.0.smithi078.stdout:8/809: dread d0/d10/d14/f9b [4194304,4194304] 0 2024-04-18T21:07:02.113 INFO:tasks.workunit.client.0.smithi078.stdout:0/795: write d0/d9/dd/d17/d2e/d7f/ff3 [53574,129685] 0 2024-04-18T21:07:02.113 INFO:tasks.workunit.client.0.smithi078.stdout:6/747: fdatasync d2/d1c/d3a/fb4 0 2024-04-18T21:07:02.113 INFO:tasks.workunit.client.0.smithi078.stdout:0/796: chown d0/l66 930722 1 2024-04-18T21:07:02.114 INFO:tasks.workunit.client.0.smithi078.stdout:8/810: write d0/d10/fb4 [729155,71375] 0 2024-04-18T21:07:02.115 INFO:tasks.workunit.client.0.smithi078.stdout:0/797: rmdir d0/d9/d2f 39 2024-04-18T21:07:02.115 INFO:tasks.workunit.client.0.smithi078.stdout:8/811: creat d0/d10/d14/d62/ffc x:0 0 0 2024-04-18T21:07:02.116 INFO:tasks.workunit.client.0.smithi078.stdout:8/812: fdatasync d0/d10/f92 0 2024-04-18T21:07:02.118 INFO:tasks.workunit.client.0.smithi078.stdout:7/757: rename d1/d16/dc/d11/d53/d82/da4/db5/d91/db0/fcc to d1/d16/d10/d7c/d94/f102 0 2024-04-18T21:07:02.118 INFO:tasks.workunit.client.0.smithi078.stdout:8/813: rmdir d0/d10/d14/d2d/d93/da0 39 2024-04-18T21:07:02.118 INFO:tasks.workunit.client.0.smithi078.stdout:0/798: rename d0/d9/da/db/d35/d3f/dbe/dce to d0/d9/da/df/dde/df7 0 2024-04-18T21:07:02.119 INFO:tasks.workunit.client.0.smithi078.stdout:7/758: chown d1/d16/d10/d7c/d7e/c87 515949532 1 2024-04-18T21:07:02.119 INFO:tasks.workunit.client.0.smithi078.stdout:0/799: write d0/d9/d4c/feb [1006250,84951] 0 2024-04-18T21:07:02.119 INFO:tasks.workunit.client.0.smithi078.stdout:3/694: dwrite d4/d2d/d30/d35/d4b/d59/fad [0,4194304] 0 2024-04-18T21:07:02.120 INFO:tasks.workunit.client.0.smithi078.stdout:3/695: fsync d4/df/fa4 0 2024-04-18T21:07:02.124 INFO:tasks.workunit.client.0.smithi078.stdout:7/759: mknod d1/d16/dc/d11/d53/d82/da4/db5/d91/c103 0 2024-04-18T21:07:02.124 INFO:tasks.workunit.client.0.smithi078.stdout:0/800: rename d0/d9/da/df/c79 to d0/d9/d4c/d8f/dc5/cf8 0 2024-04-18T21:07:02.124 INFO:tasks.workunit.client.0.smithi078.stdout:3/696: creat d4/da/d11/d66/dbe/dd0/fd7 x:0 0 0 2024-04-18T21:07:02.125 INFO:tasks.workunit.client.0.smithi078.stdout:8/814: truncate d0/d10/d14/fa7 399895 0 2024-04-18T21:07:02.125 INFO:tasks.workunit.client.0.smithi078.stdout:3/697: stat d4/d2d/d6c 0 2024-04-18T21:07:02.125 INFO:tasks.workunit.client.0.smithi078.stdout:1/886: dread d0/d2a/d3c/d4b/d52/fe5 [0,4194304] 0 2024-04-18T21:07:02.126 INFO:tasks.workunit.client.0.smithi078.stdout:0/801: unlink d0/d9/da/fdb 0 2024-04-18T21:07:02.126 INFO:tasks.workunit.client.0.smithi078.stdout:7/760: chown d1/d16/dc/d11/d53/d82/da4/db5/d91/db3/lb8 13682 1 2024-04-18T21:07:02.126 INFO:tasks.workunit.client.0.smithi078.stdout:8/815: write d0/d10/d60/d6f/dba/fc9 [365811,89749] 0 2024-04-18T21:07:02.127 INFO:tasks.workunit.client.0.smithi078.stdout:0/802: chown d0/d9/d4c/l8e 507966350 1 2024-04-18T21:07:02.127 INFO:tasks.workunit.client.0.smithi078.stdout:0/803: read - d0/d9/d4c/d6b/fbb zero size 2024-04-18T21:07:02.127 INFO:tasks.workunit.client.0.smithi078.stdout:7/761: write d1/d16/dc/d11/d53/f58 [1400915,118013] 0 2024-04-18T21:07:02.128 INFO:tasks.workunit.client.0.smithi078.stdout:8/816: mkdir d0/d10/d14/d2d/d93/da0/db5/de2/dfd 0 2024-04-18T21:07:02.128 INFO:tasks.workunit.client.0.smithi078.stdout:7/762: symlink d1/d16/dc/d31/l104 0 2024-04-18T21:07:02.128 INFO:tasks.workunit.client.0.smithi078.stdout:0/804: creat d0/dc7/ff9 x:0 0 0 2024-04-18T21:07:02.129 INFO:tasks.workunit.client.0.smithi078.stdout:5/777: dread d9/da/d3e/d4c/d6d/d75/dad/fc2 [0,4194304] 0 2024-04-18T21:07:02.129 INFO:tasks.workunit.client.0.smithi078.stdout:0/805: unlink d0/d9/da/f10 0 2024-04-18T21:07:02.129 INFO:tasks.workunit.client.0.smithi078.stdout:8/817: creat d0/d10/d14/d2a/ddd/ffe x:0 0 0 2024-04-18T21:07:02.129 INFO:tasks.workunit.client.0.smithi078.stdout:7/763: mknod d1/d16/dc/d11/d53/c105 0 2024-04-18T21:07:02.129 INFO:tasks.workunit.client.0.smithi078.stdout:2/753: dread d0/f10 [0,4194304] 0 2024-04-18T21:07:02.132 INFO:tasks.workunit.client.0.smithi078.stdout:0/806: symlink d0/d9/lfa 0 2024-04-18T21:07:02.132 INFO:tasks.workunit.client.0.smithi078.stdout:5/778: creat d9/da/d3e/d4c/d6d/d75/dad/ff6 x:0 0 0 2024-04-18T21:07:02.132 INFO:tasks.workunit.client.0.smithi078.stdout:2/754: mkdir d0/db/d18/d21/d27/d29/de3 0 2024-04-18T21:07:02.132 INFO:tasks.workunit.client.0.smithi078.stdout:5/779: mknod d9/d2e/d65/cf7 0 2024-04-18T21:07:02.133 INFO:tasks.workunit.client.0.smithi078.stdout:2/755: creat d0/db/d6e/dd2/fe4 x:0 0 0 2024-04-18T21:07:02.133 INFO:tasks.workunit.client.0.smithi078.stdout:5/780: sync 2024-04-18T21:07:02.134 INFO:tasks.workunit.client.0.smithi078.stdout:2/756: write d0/f32 [4206790,111468] 0 2024-04-18T21:07:02.134 INFO:tasks.workunit.client.0.smithi078.stdout:5/781: dread - d9/da/d3e/d4c/d6d/d73/fa1 zero size 2024-04-18T21:07:02.135 INFO:tasks.workunit.client.0.smithi078.stdout:5/782: sync 2024-04-18T21:07:02.135 INFO:tasks.workunit.client.0.smithi078.stdout:2/757: mknod d0/db/d18/d21/db0/ddc/ce5 0 2024-04-18T21:07:02.135 INFO:tasks.workunit.client.0.smithi078.stdout:1/887: dread d0/d2a/ff2 [4194304,4194304] 0 2024-04-18T21:07:02.136 INFO:tasks.workunit.client.0.smithi078.stdout:2/758: symlink d0/db/d18/dbb/dde/le6 0 2024-04-18T21:07:02.136 INFO:tasks.workunit.client.0.smithi078.stdout:5/783: truncate d9/da/d32/f60 63573 0 2024-04-18T21:07:02.137 INFO:tasks.workunit.client.0.smithi078.stdout:1/888: truncate d0/d2a/d3c/da8/f108 969234 0 2024-04-18T21:07:02.138 INFO:tasks.workunit.client.0.smithi078.stdout:2/759: creat d0/db/d65/fe7 x:0 0 0 2024-04-18T21:07:02.139 INFO:tasks.workunit.client.0.smithi078.stdout:0/807: dwrite d0/d9/da/db/da6/fc6 [0,4194304] 0 2024-04-18T21:07:02.139 INFO:tasks.workunit.client.0.smithi078.stdout:2/760: mknod d0/db/d18/dbb/dde/ce8 0 2024-04-18T21:07:02.140 INFO:tasks.workunit.client.0.smithi078.stdout:1/889: symlink d0/d2a/d5f/d89/d32/db2/d10e/d50/d78/l125 0 2024-04-18T21:07:02.141 INFO:tasks.workunit.client.0.smithi078.stdout:2/761: write d0/f2e [779714,29553] 0 2024-04-18T21:07:02.141 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:02.142+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:02.142 INFO:tasks.workunit.client.0.smithi078.stdout:1/890: write d0/d2a/d5f/fe4 [907076,88076] 0 2024-04-18T21:07:02.143 INFO:tasks.workunit.client.0.smithi078.stdout:4/836: dread d0/dc/d10/d3a/f9c [0,4194304] 0 2024-04-18T21:07:02.144 INFO:tasks.workunit.client.0.smithi078.stdout:3/698: dwrite d4/d2d/d30/d35/f4f [0,4194304] 0 2024-04-18T21:07:02.145 INFO:tasks.workunit.client.0.smithi078.stdout:7/764: dwrite d1/d16/dc/f60 [0,4194304] 0 2024-04-18T21:07:02.146 INFO:tasks.workunit.client.0.smithi078.stdout:2/762: link d0/db/d65/fe7 d0/d87/d88/d98/db2/fe9 0 2024-04-18T21:07:02.146 INFO:tasks.workunit.client.0.smithi078.stdout:1/891: symlink d0/d2a/d45/d81/d117/l126 0 2024-04-18T21:07:02.147 INFO:tasks.workunit.client.0.smithi078.stdout:4/837: mkdir d0/dc/d10/d1c/d60/dee/db8/d10f/d11a 0 2024-04-18T21:07:02.147 INFO:tasks.workunit.client.0.smithi078.stdout:3/699: readlink d4/d2d/d30/l3d 0 2024-04-18T21:07:02.147 INFO:tasks.workunit.client.0.smithi078.stdout:3/700: sync 2024-04-18T21:07:02.147 INFO:tasks.workunit.client.0.smithi078.stdout:7/765: stat d1/d16/d10/c9c 0 2024-04-18T21:07:02.147 INFO:tasks.workunit.client.0.smithi078.stdout:3/701: sync 2024-04-18T21:07:02.148 INFO:tasks.workunit.client.0.smithi078.stdout:2/763: rmdir d0/da9/dda 0 2024-04-18T21:07:02.149 INFO:tasks.workunit.client.0.smithi078.stdout:0/808: dwrite d0/d9/f2d [0,4194304] 0 2024-04-18T21:07:02.149 INFO:tasks.workunit.client.0.smithi078.stdout:4/838: write d0/dc/d10/d41/f45 [6726663,57729] 0 2024-04-18T21:07:02.150 INFO:tasks.workunit.client.0.smithi078.stdout:7/766: creat d1/d16/d2d/f106 x:0 0 0 2024-04-18T21:07:02.151 INFO:tasks.workunit.client.0.smithi078.stdout:7/767: write d1/d16/dc/f60 [3366995,129561] 0 2024-04-18T21:07:02.151 INFO:tasks.workunit.client.0.smithi078.stdout:4/839: creat d0/dc/d10/d1c/f11b x:0 0 0 2024-04-18T21:07:02.151 INFO:tasks.workunit.client.0.smithi078.stdout:0/809: truncate d0/d9/da/db/d35/f4b 3746204 0 2024-04-18T21:07:02.153 INFO:tasks.workunit.client.0.smithi078.stdout:7/768: mknod d1/d16/dc/c107 0 2024-04-18T21:07:02.153 INFO:tasks.workunit.client.0.smithi078.stdout:0/810: chown d0/d9/da/fa4 3327661 1 2024-04-18T21:07:02.153 INFO:tasks.workunit.client.0.smithi078.stdout:2/764: truncate d0/d87/f8a 856276 0 2024-04-18T21:07:02.154 INFO:tasks.workunit.client.0.smithi078.stdout:4/840: rmdir d0/dc/d5b/d71 39 2024-04-18T21:07:02.155 INFO:tasks.workunit.client.0.smithi078.stdout:2/765: chown d0/d87/d88 361250 1 2024-04-18T21:07:02.155 INFO:tasks.workunit.client.0.smithi078.stdout:1/892: dwrite d0/d2a/d45/f76 [0,4194304] 0 2024-04-18T21:07:02.155 INFO:tasks.workunit.client.0.smithi078.stdout:7/769: dread - d1/d16/d65/fe9 zero size 2024-04-18T21:07:02.155 INFO:tasks.workunit.client.0.smithi078.stdout:4/841: readlink d0/dc/d29/d6d/d7b/lb0 0 2024-04-18T21:07:02.156 INFO:tasks.workunit.client.0.smithi078.stdout:4/842: sync 2024-04-18T21:07:02.157 INFO:tasks.workunit.client.0.smithi078.stdout:0/811: mknod d0/d9/dd/d17/d2e/cfb 0 2024-04-18T21:07:02.157 INFO:tasks.workunit.client.0.smithi078.stdout:6/748: dread d2/d1f/f61 [0,4194304] 0 2024-04-18T21:07:02.158 INFO:tasks.workunit.client.0.smithi078.stdout:7/770: write d1/d16/dc/d11/d53/d82/da4/db5/d91/db4/ddc/ff2 [799598,82489] 0 2024-04-18T21:07:02.158 INFO:tasks.workunit.client.0.smithi078.stdout:1/893: creat d0/dda/f127 x:0 0 0 2024-04-18T21:07:02.158 INFO:tasks.workunit.client.0.smithi078.stdout:3/702: dwrite d4/da/d11/d66/f93 [0,4194304] 0 2024-04-18T21:07:02.159 INFO:tasks.workunit.client.0.smithi078.stdout:9/840: dread d7/d11/d47/f11b [0,4194304] 0 2024-04-18T21:07:02.159 INFO:tasks.workunit.client.0.smithi078.stdout:2/766: mknod d0/db/d18/d21/d27/cea 0 2024-04-18T21:07:02.160 INFO:tasks.workunit.client.0.smithi078.stdout:0/812: fsync d0/d9/d7d/fc8 0 2024-04-18T21:07:02.160 INFO:tasks.workunit.client.0.smithi078.stdout:4/843: symlink d0/dc/d10/d1c/l11c 0 2024-04-18T21:07:02.160 INFO:tasks.workunit.client.0.smithi078.stdout:6/749: write d2/d1c/d63/f8e [1127712,90065] 0 2024-04-18T21:07:02.160 INFO:tasks.workunit.client.0.smithi078.stdout:7/771: symlink d1/d16/d10/l108 0 2024-04-18T21:07:02.162 INFO:tasks.workunit.client.0.smithi078.stdout:7/772: dread - d1/d16/d10/d7c/d7e/fa9 zero size 2024-04-18T21:07:02.162 INFO:tasks.workunit.client.0.smithi078.stdout:3/703: readlink d4/df/db0/dc5/d41/lb4 0 2024-04-18T21:07:02.162 INFO:tasks.workunit.client.0.smithi078.stdout:1/894: symlink d0/de7/dff/l128 0 2024-04-18T21:07:02.162 INFO:tasks.workunit.client.0.smithi078.stdout:1/895: sync 2024-04-18T21:07:02.162 INFO:tasks.workunit.client.0.smithi078.stdout:9/841: mkdir d7/df/d54/d95/d9d/dd1/d10a/d124 0 2024-04-18T21:07:02.162 INFO:tasks.workunit.client.0.smithi078.stdout:0/813: mknod d0/d9/d4c/d8f/dc5/dd2/cfc 0 2024-04-18T21:07:02.162 INFO:tasks.workunit.client.0.smithi078.stdout:7/773: fsync d1/d16/d10/f13 0 2024-04-18T21:07:02.163 INFO:tasks.workunit.client.0.smithi078.stdout:3/704: rmdir d4/df/db0 39 2024-04-18T21:07:02.163 INFO:tasks.workunit.client.0.smithi078.stdout:1/896: chown d0/d2a/d5f/d89/d32/db2/d10e/d9b/ffc 541 1 2024-04-18T21:07:02.164 INFO:tasks.workunit.client.0.smithi078.stdout:3/705: readlink d4/da/l83 0 2024-04-18T21:07:02.165 INFO:tasks.workunit.client.0.smithi078.stdout:1/897: rename d0/la to d0/l129 0 2024-04-18T21:07:02.165 INFO:tasks.workunit.client.0.smithi078.stdout:3/706: truncate d4/d2d/d30/fd4 575155 0 2024-04-18T21:07:02.166 INFO:tasks.workunit.client.0.smithi078.stdout:9/842: dread d7/f6d [0,4194304] 0 2024-04-18T21:07:02.166 INFO:tasks.workunit.client.0.smithi078.stdout:3/707: chown d4/d2d/d30/fd4 17548023 1 2024-04-18T21:07:02.166 INFO:tasks.workunit.client.0.smithi078.stdout:1/898: creat d0/dc1/dd3/f12a x:0 0 0 2024-04-18T21:07:02.168 INFO:tasks.workunit.client.0.smithi078.stdout:3/708: creat d4/dc3/fd8 x:0 0 0 2024-04-18T21:07:02.168 INFO:tasks.workunit.client.0.smithi078.stdout:6/750: dwrite d2/d1c/d6b/d98/f9a [0,4194304] 0 2024-04-18T21:07:02.168 INFO:tasks.workunit.client.0.smithi078.stdout:1/899: symlink d0/d2a/d5f/d89/d32/d35/d71/l12b 0 2024-04-18T21:07:02.169 INFO:tasks.workunit.client.0.smithi078.stdout:6/751: symlink d2/d1c/d6b/l100 0 2024-04-18T21:07:02.170 INFO:tasks.workunit.client.0.smithi078.stdout:1/900: write d0/d2a/d5f/d89/f115 [639171,122429] 0 2024-04-18T21:07:02.170 INFO:tasks.workunit.client.0.smithi078.stdout:9/843: truncate d7/df/d54/d95/d9d/dd1/d10a/d3e/d5a/f5e 2084764 0 2024-04-18T21:07:02.171 INFO:tasks.workunit.client.0.smithi078.stdout:4/844: dwrite d0/f10b [0,4194304] 0 2024-04-18T21:07:02.171 INFO:tasks.workunit.client.0.smithi078.stdout:6/752: creat d2/d1c/d63/d8b/dcb/f101 x:0 0 0 2024-04-18T21:07:02.171 INFO:tasks.workunit.client.0.smithi078.stdout:2/767: truncate d0/db/f12 760720 0 2024-04-18T21:07:02.172 INFO:tasks.workunit.client.0.smithi078.stdout:9/844: mkdir d7/d11/d2d/d3f/db7/dfd/d113/d125 0 2024-04-18T21:07:02.172 INFO:tasks.workunit.client.0.smithi078.stdout:6/753: fdatasync d2/f97 0 2024-04-18T21:07:02.172 INFO:tasks.workunit.client.0.smithi078.stdout:4/845: unlink d0/dc/d29/f92 0 2024-04-18T21:07:02.174 INFO:tasks.workunit.client.0.smithi078.stdout:6/754: write d2/f2b [2016044,52305] 0 2024-04-18T21:07:02.174 INFO:tasks.workunit.client.0.smithi078.stdout:4/846: chown d0/dc/d29/f7d 22523 1 2024-04-18T21:07:02.174 INFO:tasks.workunit.client.0.smithi078.stdout:9/845: truncate d7/d11/d2d/d26/fb3 2286833 0 2024-04-18T21:07:02.176 INFO:tasks.workunit.client.0.smithi078.stdout:3/709: dwrite d4/d2d/d30/f48 [0,4194304] 0 2024-04-18T21:07:02.176 INFO:tasks.workunit.client.0.smithi078.stdout:6/755: mknod d2/d34/d35/d57/c102 0 2024-04-18T21:07:02.176 INFO:tasks.workunit.client.0.smithi078.stdout:9/846: mkdir d7/d11/d2d/d3f/d126 0 2024-04-18T21:07:02.177 INFO:tasks.workunit.client.0.smithi078.stdout:6/756: fdatasync d2/d6/fe9 0 2024-04-18T21:07:02.177 INFO:tasks.workunit.client.0.smithi078.stdout:3/710: mkdir d4/df/db0/dd9 0 2024-04-18T21:07:02.178 INFO:tasks.workunit.client.0.smithi078.stdout:1/901: dwrite d0/d11/f18 [0,4194304] 0 2024-04-18T21:07:02.178 INFO:tasks.workunit.client.0.smithi078.stdout:6/757: mknod d2/dbf/c103 0 2024-04-18T21:07:02.179 INFO:tasks.workunit.client.0.smithi078.stdout:9/847: mknod d7/d11/d2d/d3f/db7/dfd/d113/d125/c127 0 2024-04-18T21:07:02.179 INFO:tasks.workunit.client.0.smithi078.stdout:6/758: creat d2/d1c/d6b/f104 x:0 0 0 2024-04-18T21:07:02.181 INFO:tasks.workunit.client.0.smithi078.stdout:2/768: dwrite d0/d1f/d34/dd5/fcc [0,4194304] 0 2024-04-18T21:07:02.184 INFO:tasks.workunit.client.0.smithi078.stdout:2/769: unlink d0/c9a 0 2024-04-18T21:07:02.184 INFO:tasks.workunit.client.0.smithi078.stdout:4/847: truncate d0/dc/d10/d1c/d6a/d81/dd4/f9d 834912 0 2024-04-18T21:07:02.187 INFO:tasks.workunit.client.0.smithi078.stdout:1/902: dwrite d0/dc1/fdd [0,4194304] 0 2024-04-18T21:07:02.188 INFO:tasks.workunit.client.0.smithi078.stdout:3/711: truncate d4/da/d76/f7b 271581 0 2024-04-18T21:07:02.188 INFO:tasks.workunit.client.0.smithi078.stdout:4/848: symlink d0/dc/d10/d1c/d60/dee/db8/d10f/l11d 0 2024-04-18T21:07:02.188 INFO:tasks.workunit.client.0.smithi078.stdout:6/759: truncate d2/d1f/f2c 1510553 0 2024-04-18T21:07:02.188 INFO:tasks.workunit.client.0.smithi078.stdout:1/903: write d0/dda/f127 [272450,35732] 0 2024-04-18T21:07:02.188 INFO:tasks.workunit.client.0.smithi078.stdout:6/760: rmdir d2/d1c/d63/da1/dfc 39 2024-04-18T21:07:02.189 INFO:tasks.workunit.client.0.smithi078.stdout:9/848: dwrite d7/df/d67/fa5 [0,4194304] 0 2024-04-18T21:07:02.189 INFO:tasks.workunit.client.0.smithi078.stdout:4/849: write d0/dc/d5b/d4f/f79 [1902314,92906] 0 2024-04-18T21:07:02.190 INFO:tasks.workunit.client.0.smithi078.stdout:4/850: chown d0/dc/d10/d41 281 1 2024-04-18T21:07:02.190 INFO:tasks.workunit.client.0.smithi078.stdout:9/849: chown d7/d11/d1b/dcd 180496300 1 2024-04-18T21:07:02.190 INFO:tasks.workunit.client.0.smithi078.stdout:6/761: creat d2/d34/d35/f105 x:0 0 0 2024-04-18T21:07:02.190 INFO:tasks.workunit.client.0.smithi078.stdout:1/904: rename d0/d2a/d3c/da8/de1/f104 to d0/d2a/d5f/d89/d32/d35/d113/f12c 0 2024-04-18T21:07:02.191 INFO:tasks.workunit.client.0.smithi078.stdout:4/851: fsync d0/f28 0 2024-04-18T21:07:02.191 INFO:tasks.workunit.client.0.smithi078.stdout:4/852: readlink d0/dc/l15 0 2024-04-18T21:07:02.191 INFO:tasks.workunit.client.0.smithi078.stdout:1/905: chown d0/d11/d69/f97 58461976 1 2024-04-18T21:07:02.191 INFO:tasks.workunit.client.0.smithi078.stdout:6/762: chown d2/d1c/d63/da0/le7 13 1 2024-04-18T21:07:02.192 INFO:tasks.workunit.client.0.smithi078.stdout:4/853: write d0/dc/d10/d41/f45 [4410396,125913] 0 2024-04-18T21:07:02.193 INFO:tasks.workunit.client.0.smithi078.stdout:1/906: creat d0/f12d x:0 0 0 2024-04-18T21:07:02.193 INFO:tasks.workunit.client.0.smithi078.stdout:6/763: symlink d2/d1c/d63/l106 0 2024-04-18T21:07:02.194 INFO:tasks.workunit.client.0.smithi078.stdout:4/854: mkdir d0/dc/d10/d1c/d6a/d81/d11e 0 2024-04-18T21:07:02.194 INFO:tasks.workunit.client.0.smithi078.stdout:6/764: chown d2/d6/f14 1282166008 1 2024-04-18T21:07:02.195 INFO:tasks.workunit.client.0.smithi078.stdout:4/855: truncate d0/dc/d29/d2f/f61 4860407 0 2024-04-18T21:07:02.195 INFO:tasks.workunit.client.0.smithi078.stdout:6/765: rename d2/d1c/d63/da0/cc3 to d2/d1c/d63/d8b/dcc/c107 0 2024-04-18T21:07:02.197 INFO:tasks.workunit.client.0.smithi078.stdout:6/766: rename d2/d1c/d63/d8b/dcb/f101 to d2/d1c/d3a/d8c/f108 0 2024-04-18T21:07:02.198 INFO:tasks.workunit.client.0.smithi078.stdout:9/850: dwrite d7/f24 [0,4194304] 0 2024-04-18T21:07:02.199 INFO:tasks.workunit.client.0.smithi078.stdout:1/907: dwrite d0/f9f [0,4194304] 0 2024-04-18T21:07:02.200 INFO:tasks.workunit.client.0.smithi078.stdout:1/908: dread - d0/f12d zero size 2024-04-18T21:07:02.200 INFO:tasks.workunit.client.0.smithi078.stdout:6/767: symlink d2/d1c/d6b/dba/deb/d5d/l109 0 2024-04-18T21:07:02.201 INFO:tasks.workunit.client.0.smithi078.stdout:1/909: rmdir d0/de7/dd7 39 2024-04-18T21:07:02.201 INFO:tasks.workunit.client.0.smithi078.stdout:1/910: sync 2024-04-18T21:07:02.201 INFO:tasks.workunit.client.0.smithi078.stdout:6/768: read d2/d1c/d6b/d98/f9a [3104600,104447] 0 2024-04-18T21:07:02.201 INFO:tasks.workunit.client.0.smithi078.stdout:1/911: write d0/f9f [638877,46348] 0 2024-04-18T21:07:02.202 INFO:tasks.workunit.client.0.smithi078.stdout:6/769: chown d2/d1c/d6b/f104 5339843 1 2024-04-18T21:07:02.203 INFO:tasks.workunit.client.0.smithi078.stdout:6/770: symlink d2/d1c/d3a/d8c/l10a 0 2024-04-18T21:07:02.203 INFO:tasks.workunit.client.0.smithi078.stdout:1/912: rename d0/d2a/d3c/d4b/d4/fe2 to d0/d2a/d5f/d89/d32/f12e 0 2024-04-18T21:07:02.204 INFO:tasks.workunit.client.0.smithi078.stdout:6/771: mknod d2/d1c/d63/da1/dfc/c10b 0 2024-04-18T21:07:02.204 INFO:tasks.workunit.client.0.smithi078.stdout:6/772: fdatasync d2/d34/fd9 0 2024-04-18T21:07:02.205 INFO:tasks.workunit.client.0.smithi078.stdout:1/913: link d0/d2a/d5f/d89/f49 d0/d2a/d5f/d89/d32/db2/db9/f12f 0 2024-04-18T21:07:02.207 INFO:tasks.workunit.client.0.smithi078.stdout:6/773: rename d2/d34/d35/f94 to d2/d74/f10c 0 2024-04-18T21:07:02.208 INFO:tasks.workunit.client.0.smithi078.stdout:6/774: write d2/d1c/db3/dbb/ffb [625522,113129] 0 2024-04-18T21:07:02.209 INFO:tasks.workunit.client.0.smithi078.stdout:9/851: dwrite d7/df/d54/d95/d9d/dd1/d10a/d3e/d5a/dca/ff1 [0,4194304] 0 2024-04-18T21:07:02.209 INFO:tasks.workunit.client.0.smithi078.stdout:9/852: write d7/df/f8a [900762,112832] 0 2024-04-18T21:07:02.210 INFO:tasks.workunit.client.0.smithi078.stdout:9/853: mknod d7/d11/d2d/c128 0 2024-04-18T21:07:02.212 INFO:tasks.workunit.client.0.smithi078.stdout:9/854: creat d7/d11/df0/d110/f129 x:0 0 0 2024-04-18T21:07:02.212 INFO:tasks.workunit.client.0.smithi078.stdout:9/855: mknod d7/c12a 0 2024-04-18T21:07:02.213 INFO:tasks.workunit.client.0.smithi078.stdout:1/914: truncate d0/d2a/d3c/d4b/f3e 3748848 0 2024-04-18T21:07:02.214 INFO:tasks.workunit.client.0.smithi078.stdout:6/775: dwrite d2/d1c/d6b/dba/deb/f5f [4194304,4194304] 0 2024-04-18T21:07:02.216 INFO:tasks.workunit.client.0.smithi078.stdout:1/915: mknod d0/d2a/d3c/d4b/d52/c130 0 2024-04-18T21:07:02.217 INFO:tasks.workunit.client.0.smithi078.stdout:1/916: creat d0/d2a/d45/d81/dea/f131 x:0 0 0 2024-04-18T21:07:02.218 INFO:tasks.workunit.client.0.smithi078.stdout:9/856: dwrite d7/d11/d1b/f84 [0,4194304] 0 2024-04-18T21:07:02.219 INFO:tasks.workunit.client.0.smithi078.stdout:9/857: truncate d7/d11/d2d/fd0 1008772 0 2024-04-18T21:07:02.219 INFO:tasks.workunit.client.0.smithi078.stdout:9/858: write d7/d83/f91 [1490809,81957] 0 2024-04-18T21:07:02.220 INFO:tasks.workunit.client.0.smithi078.stdout:9/859: creat d7/d11/d47/f12b x:0 0 0 2024-04-18T21:07:02.220 INFO:tasks.workunit.client.0.smithi078.stdout:9/860: symlink d7/df/d54/d115/d7b/l12c 0 2024-04-18T21:07:02.221 INFO:tasks.workunit.client.0.smithi078.stdout:9/861: fdatasync d7/d11/d2d/f3a 0 2024-04-18T21:07:02.223 INFO:tasks.workunit.client.0.smithi078.stdout:4/856: dread d0/d73/da9/fbd [0,4194304] 0 2024-04-18T21:07:02.224 INFO:tasks.workunit.client.0.smithi078.stdout:3/712: dread d4/df/db0/dc5/d41/fae [0,4194304] 0 2024-04-18T21:07:02.225 INFO:tasks.workunit.client.0.smithi078.stdout:4/857: creat d0/dc/d29/de2/f11f x:0 0 0 2024-04-18T21:07:02.226 INFO:tasks.workunit.client.0.smithi078.stdout:4/858: mkdir d0/dc/d29/d120 0 2024-04-18T21:07:02.227 INFO:tasks.workunit.client.0.smithi078.stdout:9/862: dwrite d7/d83/fcc [0,4194304] 0 2024-04-18T21:07:02.227 INFO:tasks.workunit.client.0.smithi078.stdout:4/859: truncate d0/dc/d10/ff5 528845 0 2024-04-18T21:07:02.229 INFO:tasks.workunit.client.0.smithi078.stdout:9/863: mknod d7/c12d 0 2024-04-18T21:07:02.230 INFO:tasks.workunit.client.0.smithi078.stdout:9/864: truncate d7/fbb 333298 0 2024-04-18T21:07:02.230 INFO:tasks.workunit.client.0.smithi078.stdout:3/713: dwrite d4/f6a [4194304,4194304] 0 2024-04-18T21:07:02.232 INFO:tasks.workunit.client.0.smithi078.stdout:3/714: mkdir d4/df/db0/dc5/d41/dda 0 2024-04-18T21:07:02.232 INFO:tasks.workunit.client.0.smithi078.stdout:8/818: dread d0/d10/d14/d2d/d93/f81 [0,4194304] 0 2024-04-18T21:07:02.232 INFO:tasks.workunit.client.0.smithi078.stdout:8/819: fdatasync d0/d10/d14/f70 0 2024-04-18T21:07:02.233 INFO:tasks.workunit.client.0.smithi078.stdout:3/715: mknod d4/cdb 0 2024-04-18T21:07:02.234 INFO:tasks.workunit.client.0.smithi078.stdout:3/716: write d4/da/f81 [1303658,78791] 0 2024-04-18T21:07:02.234 INFO:tasks.workunit.client.0.smithi078.stdout:8/820: creat d0/d10/d14/d2a/d4a/db2/fff x:0 0 0 2024-04-18T21:07:02.235 INFO:tasks.workunit.client.0.smithi078.stdout:4/860: read d0/dc/d10/d1c/d60/d74/fba [642487,85626] 0 2024-04-18T21:07:02.236 INFO:tasks.workunit.client.0.smithi078.stdout:4/861: sync 2024-04-18T21:07:02.236 INFO:tasks.workunit.client.0.smithi078.stdout:3/717: stat d4/da/d76/lb6 0 2024-04-18T21:07:02.236 INFO:tasks.workunit.client.0.smithi078.stdout:3/718: sync 2024-04-18T21:07:02.236 INFO:tasks.workunit.client.0.smithi078.stdout:5/784: dread d9/da/d32/f51 [0,4194304] 0 2024-04-18T21:07:02.236 INFO:tasks.workunit.client.0.smithi078.stdout:9/865: dread d7/f37 [4194304,4194304] 0 2024-04-18T21:07:02.236 INFO:tasks.workunit.client.0.smithi078.stdout:4/862: chown d0/dc/d10/d41 5 1 2024-04-18T21:07:02.236 INFO:tasks.workunit.client.0.smithi078.stdout:5/785: sync 2024-04-18T21:07:02.236 INFO:tasks.workunit.client.0.smithi078.stdout:3/719: readlink d4/da/l99 0 2024-04-18T21:07:02.237 INFO:tasks.workunit.client.0.smithi078.stdout:9/866: mkdir d7/d11/d1b/d45/d12e 0 2024-04-18T21:07:02.237 INFO:tasks.workunit.client.0.smithi078.stdout:8/821: getdents d0/d10/d14/d2a/d4a/db2/db6 0 2024-04-18T21:07:02.237 INFO:tasks.workunit.client.0.smithi078.stdout:9/867: readlink d7/df/l12 0 2024-04-18T21:07:02.237 INFO:tasks.workunit.client.0.smithi078.stdout:5/786: rename d9/d2e/d65/cf7 to d9/da/d32/da5/de5/cf8 0 2024-04-18T21:07:02.237 INFO:tasks.workunit.client.0.smithi078.stdout:8/822: chown d0/d10/c23 2 1 2024-04-18T21:07:02.238 INFO:tasks.workunit.client.0.smithi078.stdout:9/868: mkdir d7/d11/d2d/d26/d12f 0 2024-04-18T21:07:02.238 INFO:tasks.workunit.client.0.smithi078.stdout:8/823: write d0/d5c/d5a/dc6/fdf [882728,9324] 0 2024-04-18T21:07:02.238 INFO:tasks.workunit.client.0.smithi078.stdout:3/720: truncate d4/da/f6d 401837 0 2024-04-18T21:07:02.239 INFO:tasks.workunit.client.0.smithi078.stdout:8/824: unlink d0/d5c/fd0 0 2024-04-18T21:07:02.239 INFO:tasks.workunit.client.0.smithi078.stdout:0/814: dread d0/d9/d81/fa7 [0,4194304] 0 2024-04-18T21:07:02.240 INFO:tasks.workunit.client.0.smithi078.stdout:3/721: mknod d4/df/db0/cdc 0 2024-04-18T21:07:02.241 INFO:tasks.workunit.client.0.smithi078.stdout:9/869: fsync d7/fbb 0 2024-04-18T21:07:02.242 INFO:tasks.workunit.client.0.smithi078.stdout:0/815: getdents d0/d6c/d80 0 2024-04-18T21:07:02.242 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:02.242+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:02.242 INFO:tasks.workunit.client.0.smithi078.stdout:6/776: dread d2/d6/dd/f68 [0,4194304] 0 2024-04-18T21:07:02.244 INFO:tasks.workunit.client.0.smithi078.stdout:3/722: creat d4/d2d/d30/d35/d4b/d59/fdd x:0 0 0 2024-04-18T21:07:02.244 INFO:tasks.workunit.client.0.smithi078.stdout:4/863: dwrite d0/dc/d10/d3a/f114 [0,4194304] 0 2024-04-18T21:07:02.245 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:02.245 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:02.245 INFO:tasks.workunit.client.0.smithi078.stdout:6/777: mknod d2/d1c/d63/d8b/dcc/c10d 0 2024-04-18T21:07:02.246 INFO:tasks.workunit.client.0.smithi078.stdout:5/787: dwrite d9/da/d8c/daf/ff0 [0,4194304] 0 2024-04-18T21:07:02.246 INFO:tasks.workunit.client.0.smithi078.stdout:4/864: chown d0/dc/d5b/d4f/fe6 119324316 1 2024-04-18T21:07:02.247 INFO:tasks.workunit.client.0.smithi078.stdout:9/870: rename d7/d11/d2d/d26/d7c/dda/de5 to d7/df/d54/d95/d9d/dd1/d10a/d3e/d5a/da8/d116/d130 0 2024-04-18T21:07:02.248 INFO:tasks.workunit.client.0.smithi078.stdout:6/778: creat d2/d1c/d63/da1/f10e x:0 0 0 2024-04-18T21:07:02.248 INFO:tasks.workunit.client.0.smithi078.stdout:0/816: read d0/d9/dd/d17/d2e/f39 [704796,35942] 0 2024-04-18T21:07:02.248 INFO:tasks.workunit.client.0.smithi078.stdout:5/788: dread - d9/da/d3e/d4c/d67/f7b zero size 2024-04-18T21:07:02.248 INFO:tasks.workunit.client.0.smithi078.stdout:8/825: dwrite d0/f89 [0,4194304] 0 2024-04-18T21:07:02.249 INFO:tasks.workunit.client.0.smithi078.stdout:3/723: link d4/d2d/c73 d4/da/d11/d66/dca/cde 0 2024-04-18T21:07:02.249 INFO:tasks.workunit.client.0.smithi078.stdout:8/826: sync 2024-04-18T21:07:02.250 INFO:tasks.workunit.client.0.smithi078.stdout:5/789: dread - d9/d2e/fc8 zero size 2024-04-18T21:07:02.251 INFO:tasks.workunit.client.0.smithi078.stdout:2/770: dread d0/d1f/d34/f81 [0,4194304] 0 2024-04-18T21:07:02.251 INFO:tasks.workunit.client.0.smithi078.stdout:6/779: creat d2/d1c/d63/da1/db9/f10f x:0 0 0 2024-04-18T21:07:02.252 INFO:tasks.workunit.client.0.smithi078.stdout:9/871: write d7/df/d54/d95/d9d/dd1/d10a/d3e/d5a/da8/f11a [1621256,112989] 0 2024-04-18T21:07:02.252 INFO:tasks.workunit.client.0.smithi078.stdout:3/724: truncate d4/d2d/d30/d35/d71/f9e 770613 0 2024-04-18T21:07:02.252 INFO:tasks.workunit.client.0.smithi078.stdout:5/790: mknod d9/da/d3e/cf9 0 2024-04-18T21:07:02.253 INFO:tasks.workunit.client.0.smithi078.stdout:6/780: chown d2/d1c/d3a/d8c/l8f 6 1 2024-04-18T21:07:02.253 INFO:tasks.workunit.client.0.smithi078.stdout:3/725: stat d4/d2d/d30/f9f 0 2024-04-18T21:07:02.256 INFO:tasks.workunit.client.0.smithi078.stdout:8/827: getdents d0/d10/d14/d2a/d4a/db2/db6/dcc 0 2024-04-18T21:07:02.256 INFO:tasks.workunit.client.0.smithi078.stdout:2/771: link d0/f32 d0/db/d65/d96/feb 0 2024-04-18T21:07:02.256 INFO:tasks.workunit.client.0.smithi078.stdout:8/828: write d0/d10/d14/d2a/d4a/db2/fff [654619,94849] 0 2024-04-18T21:07:02.256 INFO:tasks.workunit.client.0.smithi078.stdout:8/829: sync 2024-04-18T21:07:02.257 INFO:tasks.workunit.client.0.smithi078.stdout:0/817: dwrite d0/d9/d58/f6d [0,4194304] 0 2024-04-18T21:07:02.257 INFO:tasks.workunit.client.0.smithi078.stdout:3/726: rename d4/df/db0/dc5/d74 to d4/da/ddf 0 2024-04-18T21:07:02.257 INFO:tasks.workunit.client.0.smithi078.stdout:9/872: truncate d7/df/d88/dce/fe7 496088 0 2024-04-18T21:07:02.259 INFO:tasks.workunit.client.0.smithi078.stdout:2/772: creat d0/db/fec x:0 0 0 2024-04-18T21:07:02.259 INFO:tasks.workunit.client.0.smithi078.stdout:3/727: dread - d4/dc3/fd8 zero size 2024-04-18T21:07:02.259 INFO:tasks.workunit.client.0.smithi078.stdout:2/773: fdatasync d0/d1f/f3f 0 2024-04-18T21:07:02.261 INFO:tasks.workunit.client.0.smithi078.stdout:3/728: mkdir d4/da/d5e/de0 0 2024-04-18T21:07:02.261 INFO:tasks.workunit.client.0.smithi078.stdout:2/774: mknod d0/d1f/d34/dd5/ced 0 2024-04-18T21:07:02.261 INFO:tasks.workunit.client.0.smithi078.stdout:3/729: chown d4/da 203712 1 2024-04-18T21:07:02.262 INFO:tasks.workunit.client.0.smithi078.stdout:6/781: dwrite d2/f2b [4194304,4194304] 0 2024-04-18T21:07:02.264 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:07:02.264 INFO:tasks.workunit.client.0.smithi078.stdout:5/791: dwrite d9/da/d3e/d4c/d6d/d73/f45 [0,4194304] 0 2024-04-18T21:07:02.266 INFO:tasks.workunit.client.0.smithi078.stdout:0/818: dwrite d0/d9/fe6 [0,4194304] 0 2024-04-18T21:07:02.266 INFO:tasks.workunit.client.0.smithi078.stdout:1/917: dread d0/d2a/d5f/d89/d32/d35/d113/f12c [0,4194304] 0 2024-04-18T21:07:02.267 INFO:tasks.workunit.client.0.smithi078.stdout:2/775: link d0/f2e d0/db/d18/d21/db0/d59/fee 0 2024-04-18T21:07:02.268 INFO:tasks.workunit.client.0.smithi078.stdout:5/792: link d9/d2e/c47 d9/da/de7/cfa 0 2024-04-18T21:07:02.268 INFO:tasks.workunit.client.0.smithi078.stdout:2/776: fsync d0/d1f/fc2 0 2024-04-18T21:07:02.268 INFO:tasks.workunit.client.0.smithi078.stdout:1/918: symlink d0/d2a/d3c/da8/df4/l132 0 2024-04-18T21:07:02.268 INFO:tasks.workunit.client.0.smithi078.stdout:6/782: creat d2/f110 x:0 0 0 2024-04-18T21:07:02.271 INFO:tasks.workunit.client.0.smithi078.stdout:2/777: unlink d0/fd1 0 2024-04-18T21:07:02.271 INFO:tasks.workunit.client.0.smithi078.stdout:3/730: dwrite d4/df/f98 [0,4194304] 0 2024-04-18T21:07:02.271 INFO:tasks.workunit.client.0.smithi078.stdout:6/783: mkdir d2/d1c/d6b/d111 0 2024-04-18T21:07:02.272 INFO:tasks.workunit.client.0.smithi078.stdout:7/774: dread d1/d16/d10/f1a [0,4194304] 0 2024-04-18T21:07:02.272 INFO:tasks.workunit.client.0.smithi078.stdout:2/778: write d0/db/d18/d21/d27/d29/fb4 [973959,6771] 0 2024-04-18T21:07:02.273 INFO:tasks.workunit.client.0.smithi078.stdout:3/731: creat d4/d2d/d30/fe1 x:0 0 0 2024-04-18T21:07:02.273 INFO:tasks.workunit.client.0.smithi078.stdout:7/775: fsync d1/d16/f4e 0 2024-04-18T21:07:02.273 INFO:tasks.workunit.client.0.smithi078.stdout:1/919: getdents d0/d2a/d5f/d89/d32/db2/db9 0 2024-04-18T21:07:02.274 INFO:tasks.workunit.client.0.smithi078.stdout:7/776: fsync d1/d16/d10/fe7 0 2024-04-18T21:07:02.275 INFO:tasks.workunit.client.0.smithi078.stdout:0/819: dwrite d0/d9/da/df/fa0 [4194304,4194304] 0 2024-04-18T21:07:02.275 INFO:tasks.workunit.client.0.smithi078.stdout:3/732: chown d4/d2d/c73 23705 1 2024-04-18T21:07:02.276 INFO:tasks.workunit.client.0.smithi078.stdout:7/777: chown d1/d16/d1c/f34 83024 1 2024-04-18T21:07:02.276 INFO:tasks.workunit.client.0.smithi078.stdout:0/820: chown d0/d6c/l7a 10 1 2024-04-18T21:07:02.276 INFO:tasks.workunit.client.0.smithi078.stdout:7/778: chown d1/d16/d10/d7c/d7e/cd9 160239339 1 2024-04-18T21:07:02.277 INFO:tasks.workunit.client.0.smithi078.stdout:6/784: link d2/d1c/d63/da1/db9/f10f d2/d1c/d63/da0/f112 0 2024-04-18T21:07:02.277 INFO:tasks.workunit.client.0.smithi078.stdout:0/821: mknod d0/d9/dd/cfd 0 2024-04-18T21:07:02.277 INFO:tasks.workunit.client.0.smithi078.stdout:7/779: unlink d1/da6/l100 0 2024-04-18T21:07:02.278 INFO:tasks.workunit.client.0.smithi078.stdout:2/779: link d0/db/d18/d21/d27/d29/d33/cbe d0/db/d18/d21/d27/d29/de3/cef 0 2024-04-18T21:07:02.278 INFO:tasks.workunit.client.0.smithi078.stdout:0/822: read - d0/d9/d2f/fef zero size 2024-04-18T21:07:02.279 INFO:tasks.workunit.client.0.smithi078.stdout:7/780: write d1/d16/d10/f44 [2112262,63491] 0 2024-04-18T21:07:02.279 INFO:tasks.workunit.client.0.smithi078.stdout:6/785: getdents d2/d34 0 2024-04-18T21:07:02.280 INFO:tasks.workunit.client.0.smithi078.stdout:0/823: write d0/d9/dd/d17/d2e/d31/f4a [1443740,10852] 0 2024-04-18T21:07:02.282 INFO:tasks.workunit.client.0.smithi078.stdout:1/920: write d0/d2a/d3c/ffa [2187127,73360] 0 2024-04-18T21:07:02.282 INFO:tasks.workunit.client.0.smithi078.stdout:0/824: mknod d0/d9/da/df/dde/cfe 0 2024-04-18T21:07:02.282 INFO:tasks.workunit.client.0.smithi078.stdout:3/733: dwrite d4/d2d/d30/f9f [0,4194304] 0 2024-04-18T21:07:02.283 INFO:tasks.workunit.client.0.smithi078.stdout:7/781: rename d1/d16/dc/d11/d53/d82/da4/faa to d1/d16/dc/d4b/f109 0 2024-04-18T21:07:02.283 INFO:tasks.workunit.client.0.smithi078.stdout:3/734: fsync d4/da/d11/f72 0 2024-04-18T21:07:02.283 INFO:tasks.workunit.client.0.smithi078.stdout:0/825: unlink d0/d9/c87 0 2024-04-18T21:07:02.284 INFO:tasks.workunit.client.0.smithi078.stdout:1/921: chown d0/d2a/d5f/d89/d7d/l64 22119 1 2024-04-18T21:07:02.284 INFO:tasks.workunit.client.0.smithi078.stdout:1/922: readlink d0/d2a/d3c/d4b/d52/l93 0 2024-04-18T21:07:02.284 INFO:tasks.workunit.client.0.smithi078.stdout:0/826: mknod d0/d9/dd/cff 0 2024-04-18T21:07:02.285 INFO:tasks.workunit.client.0.smithi078.stdout:7/782: rename d1/d16/d65/fe9 to d1/f10a 0 2024-04-18T21:07:02.285 INFO:tasks.workunit.client.0.smithi078.stdout:0/827: rename d0/d9/d4c/l8e to d0/d9/dd/d17/d2e/l100 0 2024-04-18T21:07:02.286 INFO:tasks.workunit.client.0.smithi078.stdout:7/783: mkdir d1/d16/dc/d11/da2/dbc/dc3/d10b 0 2024-04-18T21:07:02.287 INFO:tasks.workunit.client.0.smithi078.stdout:7/784: creat d1/d16/d10/d7c/f10c x:0 0 0 2024-04-18T21:07:02.287 INFO:tasks.workunit.client.0.smithi078.stdout:7/785: mkdir d1/d16/d10d 0 2024-04-18T21:07:02.288 INFO:tasks.workunit.client.0.smithi078.stdout:7/786: rename d1/d16/d10/d7c/d94 to d1/d16/d65/d10e 0 2024-04-18T21:07:02.289 INFO:tasks.workunit.client.0.smithi078.stdout:7/787: unlink d1/d16/d1c/d40/ca5 0 2024-04-18T21:07:02.290 INFO:tasks.workunit.client.0.smithi078.stdout:7/788: write d1/d16/d10/fe7 [674370,117491] 0 2024-04-18T21:07:02.291 INFO:tasks.workunit.client.0.smithi078.stdout:0/828: dwrite d0/d9/da/db/d35/f5d [0,4194304] 0 2024-04-18T21:07:02.291 INFO:tasks.workunit.client.0.smithi078.stdout:7/789: fsync d1/f1f 0 2024-04-18T21:07:02.292 INFO:tasks.workunit.client.0.smithi078.stdout:0/829: chown d0/d9/d4c/d8f/dc5 34998943 1 2024-04-18T21:07:02.293 INFO:tasks.workunit.client.0.smithi078.stdout:0/830: creat d0/d9/d4c/d6b/de7/f101 x:0 0 0 2024-04-18T21:07:02.295 INFO:tasks.workunit.client.0.smithi078.stdout:7/790: dread d1/d16/dc/d4b/f109 [0,4194304] 0 2024-04-18T21:07:02.296 INFO:tasks.workunit.client.0.smithi078.stdout:7/791: rmdir d1/d16/dc/d11/d53/d82/da4/db5/d91/db4/ddc 39 2024-04-18T21:07:02.298 INFO:tasks.workunit.client.0.smithi078.stdout:0/831: dwrite d0/d9/f77 [0,4194304] 0 2024-04-18T21:07:02.300 INFO:tasks.workunit.client.0.smithi078.stdout:9/873: dread d7/df/d54/d95/fe4 [0,4194304] 0 2024-04-18T21:07:02.300 INFO:tasks.workunit.client.0.smithi078.stdout:9/874: chown d7/d11/d80 37916044 1 2024-04-18T21:07:02.301 INFO:tasks.workunit.client.0.smithi078.stdout:9/875: creat d7/d11/f131 x:0 0 0 2024-04-18T21:07:02.302 INFO:tasks.workunit.client.0.smithi078.stdout:5/793: dread d9/da/d32/fb9 [0,4194304] 0 2024-04-18T21:07:02.302 INFO:tasks.workunit.client.0.smithi078.stdout:9/876: write d7/d11/d2d/fd0 [182371,20421] 0 2024-04-18T21:07:02.303 INFO:tasks.workunit.client.0.smithi078.stdout:5/794: write d9/da/d4b/d8b/fd1 [116521,14691] 0 2024-04-18T21:07:02.303 INFO:tasks.workunit.client.0.smithi078.stdout:9/877: stat d7/d11/c69 0 2024-04-18T21:07:02.304 INFO:tasks.workunit.client.0.smithi078.stdout:3/735: truncate d4/da/f4a 1198811 0 2024-04-18T21:07:02.304 INFO:tasks.workunit.client.0.smithi078.stdout:7/792: getdents d1 0 2024-04-18T21:07:02.306 INFO:tasks.workunit.client.0.smithi078.stdout:0/832: dwrite d0/d9/f2d [4194304,4194304] 0 2024-04-18T21:07:02.308 INFO:tasks.workunit.client.0.smithi078.stdout:9/878: rmdir d7/d11/d2d/d3f/db7/dfd/d113/d125 39 2024-04-18T21:07:02.308 INFO:tasks.workunit.client.0.smithi078.stdout:7/793: mknod d1/d16/d10/d5a/c10f 0 2024-04-18T21:07:02.308 INFO:tasks.workunit.client.0.smithi078.stdout:3/736: mkdir d4/df/db0/dc5/d41/dda/de2 0 2024-04-18T21:07:02.308 INFO:tasks.workunit.client.0.smithi078.stdout:2/780: dwrite d0/d1f/f7e [0,4194304] 0 2024-04-18T21:07:02.308 INFO:tasks.workunit.client.0.smithi078.stdout:9/879: chown d7/df/d54/d115/fd4 210 1 2024-04-18T21:07:02.309 INFO:tasks.workunit.client.0.smithi078.stdout:6/786: dread d2/f3 [0,4194304] 0 2024-04-18T21:07:02.309 INFO:tasks.workunit.client.0.smithi078.stdout:2/781: symlink d0/d87/d88/lf0 0 2024-04-18T21:07:02.310 INFO:tasks.workunit.client.0.smithi078.stdout:3/737: rename d4/df/d62/ca7 to d4/da/d11/d66/dbe/dd0/ce3 0 2024-04-18T21:07:02.310 INFO:tasks.workunit.client.0.smithi078.stdout:6/787: creat d2/d1c/d63/d8b/dcc/f113 x:0 0 0 2024-04-18T21:07:02.310 INFO:tasks.workunit.client.0.smithi078.stdout:1/923: write d0/d11/d69/f97 [484840,2083] 0 2024-04-18T21:07:02.311 INFO:tasks.workunit.client.0.smithi078.stdout:1/924: read d0/d11/f21 [405908,58108] 0 2024-04-18T21:07:02.311 INFO:tasks.workunit.client.0.smithi078.stdout:5/795: dwrite d9/d2e/f3d [0,4194304] 0 2024-04-18T21:07:02.314 INFO:tasks.workunit.client.0.smithi078.stdout:3/738: rename d4/da/d11/d66/fbf to d4/da/d11/d66/dbe/dd0/fe4 0 2024-04-18T21:07:02.314 INFO:tasks.workunit.client.0.smithi078.stdout:5/796: fsync d9/da/f2d 0 2024-04-18T21:07:02.314 INFO:tasks.workunit.client.0.smithi078.stdout:1/925: creat d0/d2a/d5f/d89/d32/db2/d10e/f133 x:0 0 0 2024-04-18T21:07:02.314 INFO:tasks.workunit.client.0.smithi078.stdout:3/739: dread - d4/df/fb2 zero size 2024-04-18T21:07:02.314 INFO:tasks.workunit.client.0.smithi078.stdout:5/797: chown d9/da/d3e/d4c/d6d/d75/dad/fc2 16561446 1 2024-04-18T21:07:02.315 INFO:tasks.workunit.client.0.smithi078.stdout:3/740: mkdir d4/da/ddf/da0/de5 0 2024-04-18T21:07:02.316 INFO:tasks.workunit.client.0.smithi078.stdout:5/798: rmdir d9/da/d8c/daf 39 2024-04-18T21:07:02.317 INFO:tasks.workunit.client.0.smithi078.stdout:1/926: truncate d0/d2a/d5f/d89/d32/d35/fab 1378665 0 2024-04-18T21:07:02.317 INFO:tasks.workunit.client.0.smithi078.stdout:5/799: fdatasync d9/da/d90/f6f 0 2024-04-18T21:07:02.317 INFO:tasks.workunit.client.0.smithi078.stdout:2/782: dwrite d0/db/d18/d5d/fba [0,4194304] 0 2024-04-18T21:07:02.320 INFO:tasks.workunit.client.0.smithi078.stdout:3/741: truncate d4/d2d/d30/d35/f33 966448 0 2024-04-18T21:07:02.320 INFO:tasks.workunit.client.0.smithi078.stdout:2/783: creat d0/db/d18/dbb/ff1 x:0 0 0 2024-04-18T21:07:02.324 INFO:tasks.workunit.client.0.smithi078.stdout:5/800: dwrite d9/da/d90/d62/f63 [4194304,4194304] 0 2024-04-18T21:07:02.325 INFO:tasks.workunit.client.0.smithi078.stdout:1/927: dwrite d0/d2a/d5f/d89/d32/db2/d10e/d50/d78/ff8 [0,4194304] 0 2024-04-18T21:07:02.327 INFO:tasks.workunit.client.0.smithi078.stdout:1/928: creat d0/d2a/d5f/d89/f134 x:0 0 0 2024-04-18T21:07:02.327 INFO:tasks.workunit.client.0.smithi078.stdout:2/784: dwrite d0/db/d18/d21/d27/f93 [0,4194304] 0 2024-04-18T21:07:02.327 INFO:tasks.workunit.client.0.smithi078.stdout:3/742: dwrite d4/df/d62/fac [0,4194304] 0 2024-04-18T21:07:02.329 INFO:tasks.workunit.client.0.smithi078.stdout:2/785: mknod d0/d1f/d34/dd5/cf2 0 2024-04-18T21:07:02.329 INFO:tasks.workunit.client.0.smithi078.stdout:1/929: creat d0/d2a/d45/d121/f135 x:0 0 0 2024-04-18T21:07:02.330 INFO:tasks.workunit.client.0.smithi078.stdout:3/743: mkdir d4/df/de6 0 2024-04-18T21:07:02.330 INFO:tasks.workunit.client.0.smithi078.stdout:2/786: rmdir d0/db/d18/d21/d27/d29/d33 39 2024-04-18T21:07:02.330 INFO:tasks.workunit.client.0.smithi078.stdout:1/930: mknod d0/d2a/d5f/d89/d32/db2/db9/c136 0 2024-04-18T21:07:02.330 INFO:tasks.workunit.client.0.smithi078.stdout:2/787: unlink d0/f10 0 2024-04-18T21:07:02.331 INFO:tasks.workunit.client.0.smithi078.stdout:3/744: creat d4/df/db0/dc5/d41/fe7 x:0 0 0 2024-04-18T21:07:02.332 INFO:tasks.workunit.client.0.smithi078.stdout:1/931: chown d0/d2a/d3c/da8/f108 17 1 2024-04-18T21:07:02.332 INFO:tasks.workunit.client.0.smithi078.stdout:6/788: sync 2024-04-18T21:07:02.333 INFO:tasks.workunit.client.0.smithi078.stdout:2/788: symlink d0/lf3 0 2024-04-18T21:07:02.333 INFO:tasks.workunit.client.0.smithi078.stdout:6/789: readlink d2/d1c/l4d 0 2024-04-18T21:07:02.333 INFO:tasks.workunit.client.0.smithi078.stdout:1/932: rmdir d0/d2a/d3c/d4b/d52 39 2024-04-18T21:07:02.333 INFO:tasks.workunit.client.0.smithi078.stdout:3/745: mknod d4/d2d/d30/d35/d71/ce8 0 2024-04-18T21:07:02.334 INFO:tasks.workunit.client.0.smithi078.stdout:8/830: dread d0/d10/d14/d2d/f3f [0,4194304] 0 2024-04-18T21:07:02.334 INFO:tasks.workunit.client.0.smithi078.stdout:3/746: rmdir d4/df/db0/dc5/d41/dda 39 2024-04-18T21:07:02.334 INFO:tasks.workunit.client.0.smithi078.stdout:3/747: chown d4/df 1458862 1 2024-04-18T21:07:02.335 INFO:tasks.workunit.client.0.smithi078.stdout:1/933: mknod d0/d2a/d5f/d89/d32/d35/d85/c137 0 2024-04-18T21:07:02.336 INFO:tasks.workunit.client.0.smithi078.stdout:1/934: fdatasync d0/d2a/d5f/d89/f49 0 2024-04-18T21:07:02.336 INFO:tasks.workunit.client.0.smithi078.stdout:8/831: symlink d0/d10/d60/d6f/l100 0 2024-04-18T21:07:02.337 INFO:tasks.workunit.client.0.smithi078.stdout:1/935: mknod d0/dca/c138 0 2024-04-18T21:07:02.338 INFO:tasks.workunit.client.0.smithi078.stdout:8/832: symlink d0/d10/d14/d2d/d93/da0/db5/l101 0 2024-04-18T21:07:02.338 INFO:tasks.workunit.client.0.smithi078.stdout:8/833: chown d0/d10/d14/d2a/d3c/c49 224763899 1 2024-04-18T21:07:02.339 INFO:tasks.workunit.client.0.smithi078.stdout:3/748: dread d4/d2d/d30/d35/f4f [0,4194304] 0 2024-04-18T21:07:02.339 INFO:tasks.workunit.client.0.smithi078.stdout:6/790: dwrite d2/d6/fe9 [4194304,4194304] 0 2024-04-18T21:07:02.340 INFO:tasks.workunit.client.0.smithi078.stdout:8/834: creat d0/d10/d14/d2a/ddd/f102 x:0 0 0 2024-04-18T21:07:02.340 INFO:tasks.workunit.client.0.smithi078.stdout:3/749: creat d4/d2d/d30/d84/fe9 x:0 0 0 2024-04-18T21:07:02.340 INFO:tasks.workunit.client.0.smithi078.stdout:6/791: chown d2/dbf/lf9 10 1 2024-04-18T21:07:02.341 INFO:tasks.workunit.client.0.smithi078.stdout:3/750: read - d4/dc3/fd8 zero size 2024-04-18T21:07:02.341 INFO:tasks.workunit.client.0.smithi078.stdout:8/835: dread - d0/d10/d14/d2a/ddd/fe9 zero size 2024-04-18T21:07:02.341 INFO:tasks.workunit.client.0.smithi078.stdout:3/751: chown d4/f6a 31414 1 2024-04-18T21:07:02.342 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:02.342+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:02.342 INFO:tasks.workunit.client.0.smithi078.stdout:3/752: rename d4/d2d/d30/d35/l43 to d4/d2d/d30/d84/lea 0 2024-04-18T21:07:02.344 INFO:tasks.workunit.client.0.smithi078.stdout:9/880: dread d7/f37 [0,4194304] 0 2024-04-18T21:07:02.345 INFO:tasks.workunit.client.0.smithi078.stdout:9/881: fsync d7/df/d54/d95/d9d/dd1/d10a/d3e/d5a/fb6 0 2024-04-18T21:07:02.346 INFO:tasks.workunit.client.0.smithi078.stdout:6/792: truncate d2/d6/dd/f15 2435400 0 2024-04-18T21:07:02.346 INFO:tasks.workunit.client.0.smithi078.stdout:9/882: mknod d7/d11/d2d/d3f/c132 0 2024-04-18T21:07:02.347 INFO:tasks.workunit.client.0.smithi078.stdout:6/793: creat d2/d1c/d30/f114 x:0 0 0 2024-04-18T21:07:02.347 INFO:tasks.workunit.client.0.smithi078.stdout:6/794: unlink d2/d6/cbd 0 2024-04-18T21:07:02.347 INFO:tasks.workunit.client.0.smithi078.stdout:9/883: mknod d7/d11/d2d/d3f/db7/c133 0 2024-04-18T21:07:02.348 INFO:tasks.workunit.client.0.smithi078.stdout:6/795: symlink d2/d6/l115 0 2024-04-18T21:07:02.348 INFO:tasks.workunit.client.0.smithi078.stdout:9/884: stat d7/d11/d1b/d45/d4b/d5d 0 2024-04-18T21:07:02.349 INFO:tasks.workunit.client.0.smithi078.stdout:6/796: rmdir d2/d1c/d30/dff 0 2024-04-18T21:07:02.349 INFO:tasks.workunit.client.0.smithi078.stdout:9/885: creat d7/d11/f134 x:0 0 0 2024-04-18T21:07:02.350 INFO:tasks.workunit.client.0.smithi078.stdout:9/886: symlink d7/df/d54/d115/de2/l135 0 2024-04-18T21:07:02.350 INFO:tasks.workunit.client.0.smithi078.stdout:9/887: stat d7/df/d88/dce/de1/d120 0 2024-04-18T21:07:02.355 INFO:tasks.workunit.client.0.smithi078.stdout:4/865: dread d0/dc/d10/d41/f45 [4194304,4194304] 0 2024-04-18T21:07:02.356 INFO:tasks.workunit.client.0.smithi078.stdout:4/866: write d0/fc3 [1838731,95216] 0 2024-04-18T21:07:02.358 INFO:tasks.workunit.client.0.smithi078.stdout:4/867: chown d0/dc/d10/d1c/d6a/d81/dd4/f9d 680 1 2024-04-18T21:07:02.360 INFO:tasks.workunit.client.0.smithi078.stdout:6/797: dwrite d2/d1c/d63/da0/f112 [0,4194304] 0 2024-04-18T21:07:02.360 INFO:tasks.workunit.client.0.smithi078.stdout:9/888: dwrite d7/d11/d2d/d3f/f6e [0,4194304] 0 2024-04-18T21:07:02.363 INFO:tasks.workunit.client.0.smithi078.stdout:5/801: dread d9/da/f13 [0,4194304] 0 2024-04-18T21:07:02.363 INFO:tasks.workunit.client.0.smithi078.stdout:6/798: symlink d2/d34/l116 0 2024-04-18T21:07:02.364 INFO:tasks.workunit.client.0.smithi078.stdout:5/802: dread - d9/d9f/fc6 zero size 2024-04-18T21:07:02.365 INFO:tasks.workunit.client.0.smithi078.stdout:5/803: symlink d9/d9f/dd4/dee/lfb 0 2024-04-18T21:07:02.366 INFO:tasks.workunit.client.0.smithi078.stdout:6/799: mkdir d2/d1c/d117 0 2024-04-18T21:07:02.366 INFO:tasks.workunit.client.0.smithi078.stdout:5/804: sync 2024-04-18T21:07:02.366 INFO:tasks.workunit.client.0.smithi078.stdout:5/805: fdatasync d9/f34 0 2024-04-18T21:07:02.367 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:07:02.367 INFO:tasks.workunit.client.0.smithi078.stdout:6/800: rename d2/d6/dd/c8 to d2/d1c/d6b/c118 0 2024-04-18T21:07:02.368 INFO:tasks.workunit.client.0.smithi078.stdout:6/801: dread - d2/d1c/d30/fe5 zero size 2024-04-18T21:07:02.368 INFO:tasks.workunit.client.0.smithi078.stdout:5/806: creat d9/da/d3e/d4c/d6d/d86/ffc x:0 0 0 2024-04-18T21:07:02.369 INFO:tasks.workunit.client.0.smithi078.stdout:5/807: write d9/da/d4b/fa8 [1667199,10718] 0 2024-04-18T21:07:02.369 INFO:tasks.workunit.client.0.smithi078.stdout:9/889: truncate d7/df/f8a 540370 0 2024-04-18T21:07:02.370 INFO:tasks.workunit.client.0.smithi078.stdout:9/890: fdatasync d7/d11/d2d/f3a 0 2024-04-18T21:07:02.371 INFO:tasks.workunit.client.0.smithi078.stdout:7/794: dread d1/f1f [0,4194304] 0 2024-04-18T21:07:02.371 INFO:tasks.workunit.client.0.smithi078.stdout:9/891: rename d7/d11/d2d/d26/d7c/lc5 to d7/df/de8/l136 0 2024-04-18T21:07:02.372 INFO:tasks.workunit.client.0.smithi078.stdout:9/892: fdatasync d7/d11/d1b/d77/fc3 0 2024-04-18T21:07:02.373 INFO:tasks.workunit.client.0.smithi078.stdout:0/833: dread d0/d9/f57 [0,4194304] 0 2024-04-18T21:07:02.373 INFO:tasks.workunit.client.0.smithi078.stdout:7/795: truncate d1/d16/d10/d7c/d7e/fac 257846 0 2024-04-18T21:07:02.374 INFO:tasks.workunit.client.0.smithi078.stdout:9/893: symlink d7/df/d54/d115/de2/l137 0 2024-04-18T21:07:02.374 INFO:tasks.workunit.client.0.smithi078.stdout:5/808: dread d9/d2e/f3d [0,4194304] 0 2024-04-18T21:07:02.374 INFO:tasks.workunit.client.0.smithi078.stdout:5/809: stat d9/f3c 0 2024-04-18T21:07:02.375 INFO:tasks.workunit.client.0.smithi078.stdout:9/894: chown d7/df/d54/d95/d9d/dd1/d10a/d124 11 1 2024-04-18T21:07:02.376 INFO:tasks.workunit.client.0.smithi078.stdout:2/789: dread d0/f4d [0,4194304] 0 2024-04-18T21:07:02.377 INFO:tasks.workunit.client.0.smithi078.stdout:5/810: getdents d9/da/d4b 0 2024-04-18T21:07:02.377 INFO:tasks.workunit.client.0.smithi078.stdout:7/796: rename d1/d16/dc/d11/d53/d82/da4/db5/d91/db3/lb8 to d1/d16/dc/d11/da2/l110 0 2024-04-18T21:07:02.377 INFO:tasks.workunit.client.0.smithi078.stdout:2/790: unlink d0/d1f/d34/f78 0 2024-04-18T21:07:02.377 INFO:tasks.workunit.client.0.smithi078.stdout:9/895: chown d7/df/d54/d95/d9d/dd1/d10a/d3e/d5a/da8/f11a 24 1 2024-04-18T21:07:02.378 INFO:tasks.workunit.client.0.smithi078.stdout:6/802: dread d2/d1c/d30/fc6 [0,4194304] 0 2024-04-18T21:07:02.378 INFO:tasks.workunit.client.0.smithi078.stdout:5/811: chown d9/da/d3e/d4c/d6d/d73/f33 189688419 1 2024-04-18T21:07:02.378 INFO:tasks.workunit.client.0.smithi078.stdout:2/791: chown d0/db/d65/l67 111134900 1 2024-04-18T21:07:02.378 INFO:tasks.workunit.client.0.smithi078.stdout:6/803: stat d2/d1c/d30/l85 0 2024-04-18T21:07:02.379 INFO:tasks.workunit.client.0.smithi078.stdout:2/792: write d0/db/fd8 [143109,30164] 0 2024-04-18T21:07:02.380 INFO:tasks.workunit.client.0.smithi078.stdout:9/896: unlink d7/df/d54/d115/d7b/l12c 0 2024-04-18T21:07:02.380 INFO:tasks.workunit.client.0.smithi078.stdout:0/834: dread d0/d9/da/db/d35/f5d [0,4194304] 0 2024-04-18T21:07:02.380 INFO:tasks.workunit.client.0.smithi078.stdout:7/797: symlink d1/d16/dc/d11/d53/d82/da4/db5/d91/db4/l111 0 2024-04-18T21:07:02.383 INFO:tasks.workunit.client.0.smithi078.stdout:0/835: fsync d0/d9/da/db/d35/f6f 0 2024-04-18T21:07:02.386 INFO:tasks.workunit.client.0.smithi078.stdout:7/798: mkdir d1/d16/dc/d11/d53/d82/d112 0 2024-04-18T21:07:02.386 INFO:tasks.workunit.client.0.smithi078.stdout:1/936: dread d0/d11/f22 [0,4194304] 0 2024-04-18T21:07:02.386 INFO:tasks.workunit.client.0.smithi078.stdout:9/897: dread d7/d11/d1b/d45/d4b/d5d/fa4 [4194304,4194304] 0 2024-04-18T21:07:02.387 INFO:tasks.workunit.client.0.smithi078.stdout:4/868: dread d0/dc/f1d [0,4194304] 0 2024-04-18T21:07:02.388 INFO:tasks.workunit.client.0.smithi078.stdout:7/799: read - d1/d32/f72 zero size 2024-04-18T21:07:02.388 INFO:tasks.workunit.client.0.smithi078.stdout:6/804: dwrite d2/d1f/f25 [8388608,4194304] 0 2024-04-18T21:07:02.389 INFO:tasks.workunit.client.0.smithi078.stdout:5/812: dwrite d9/da/d3e/d4c/d67/f91 [0,4194304] 0 2024-04-18T21:07:02.392 INFO:tasks.workunit.client.0.smithi078.stdout:8/836: dread d0/d10/d14/d2d/d93/da0/fab [0,4194304] 0 2024-04-18T21:07:02.394 INFO:tasks.workunit.client.0.smithi078.stdout:2/793: dwrite d0/d1f/f7e [4194304,4194304] 0 2024-04-18T21:07:02.396 INFO:tasks.workunit.client.0.smithi078.stdout:6/805: unlink d2/d1f/fe0 0 2024-04-18T21:07:02.396 INFO:tasks.workunit.client.0.smithi078.stdout:5/813: mkdir d9/da/d3e/d4c/d67/d7c/dfd 0 2024-04-18T21:07:02.397 INFO:tasks.workunit.client.0.smithi078.stdout:4/869: mkdir d0/dc/d10/d1c/d60/daf/d121 0 2024-04-18T21:07:02.397 INFO:tasks.workunit.client.0.smithi078.stdout:9/898: rename d7/d11/df0/df6 to d7/df/d88/dce/de1/d138 0 2024-04-18T21:07:02.397 INFO:tasks.workunit.client.0.smithi078.stdout:3/753: dread d4/da/ddf/fb9 [0,4194304] 0 2024-04-18T21:07:02.397 INFO:tasks.workunit.client.0.smithi078.stdout:2/794: fsync d0/d1f/d34/dd5/f82 0 2024-04-18T21:07:02.398 INFO:tasks.workunit.client.0.smithi078.stdout:7/800: dwrite d1/d16/dc/d11/d53/f68 [0,4194304] 0 2024-04-18T21:07:02.398 INFO:tasks.workunit.client.0.smithi078.stdout:1/937: dwrite d0/d2a/d5f/d89/d32/db2/d10e/f133 [0,4194304] 0 2024-04-18T21:07:02.400 INFO:tasks.workunit.client.0.smithi078.stdout:9/899: chown d7/df/d54/d115/fee 70 1 2024-04-18T21:07:02.400 INFO:tasks.workunit.client.0.smithi078.stdout:1/938: fsync d0/d2a/d45/d81/dc8/ffb 0 2024-04-18T21:07:02.400 INFO:tasks.workunit.client.0.smithi078.stdout:2/795: write d0/d1f/d34/dd5/fcc [4165484,111033] 0 2024-04-18T21:07:02.400 INFO:tasks.workunit.client.0.smithi078.stdout:8/837: getdents d0/d10/d14/d2d/d93/da0 0 2024-04-18T21:07:02.401 INFO:tasks.workunit.client.0.smithi078.stdout:6/806: symlink d2/d34/dce/l119 0 2024-04-18T21:07:02.401 INFO:tasks.workunit.client.0.smithi078.stdout:3/754: mkdir d4/da/d11/d66/deb 0 2024-04-18T21:07:02.401 INFO:tasks.workunit.client.0.smithi078.stdout:5/814: creat d9/da/d3e/d4c/db1/ffe x:0 0 0 2024-04-18T21:07:02.402 INFO:tasks.workunit.client.0.smithi078.stdout:2/796: symlink d0/da9/lf4 0 2024-04-18T21:07:02.402 INFO:tasks.workunit.client.0.smithi078.stdout:9/900: mknod d7/df/d54/d115/d7b/c139 0 2024-04-18T21:07:02.402 INFO:tasks.workunit.client.0.smithi078.stdout:4/870: creat d0/dc/d29/f122 x:0 0 0 2024-04-18T21:07:02.402 INFO:tasks.workunit.client.0.smithi078.stdout:1/939: read d0/d2a/d5f/d89/d32/d35/d113/f12c [3646558,111313] 0 2024-04-18T21:07:02.403 INFO:tasks.workunit.client.0.smithi078.stdout:6/807: write d2/d6/dd/f95 [772976,20536] 0 2024-04-18T21:07:02.403 INFO:tasks.workunit.client.0.smithi078.stdout:7/801: mknod d1/d16/dc/d11/d53/d82/da4/db5/d91/db4/ddc/c113 0 2024-04-18T21:07:02.403 INFO:tasks.workunit.client.0.smithi078.stdout:2/797: rmdir d0/db/d18/d21 39 2024-04-18T21:07:02.403 INFO:tasks.workunit.client.0.smithi078.stdout:3/755: creat d4/d2d/d30/fec x:0 0 0 2024-04-18T21:07:02.404 INFO:tasks.workunit.client.0.smithi078.stdout:3/756: chown d4/da/f92 534282780 1 2024-04-18T21:07:02.404 INFO:tasks.workunit.client.0.smithi078.stdout:6/808: chown d2/d1c/d63/da1/db9/f10f 573 1 2024-04-18T21:07:02.405 INFO:tasks.workunit.client.0.smithi078.stdout:9/901: unlink d7/df/d54/d95/d9d/dd1/d10a/d3e/d5a/c70 0 2024-04-18T21:07:02.405 INFO:tasks.workunit.client.0.smithi078.stdout:4/871: rename d0/d73/da9 to d0/dc/d10/d1c/d60/d123 0 2024-04-18T21:07:02.405 INFO:tasks.workunit.client.0.smithi078.stdout:6/809: readlink d2/d34/l116 0 2024-04-18T21:07:02.405 INFO:tasks.workunit.client.0.smithi078.stdout:3/757: fsync d4/d2d/d6c/fcb 0 2024-04-18T21:07:02.406 INFO:tasks.workunit.client.0.smithi078.stdout:4/872: write d0/dc/d29/f122 [58057,68568] 0 2024-04-18T21:07:02.406 INFO:tasks.workunit.client.0.smithi078.stdout:1/940: rename d0/de7/fc9 to d0/d2a/d5f/d89/dc2/d100/f139 0 2024-04-18T21:07:02.406 INFO:tasks.workunit.client.0.smithi078.stdout:2/798: creat d0/d1f/d34/dd6/ff5 x:0 0 0 2024-04-18T21:07:02.408 INFO:tasks.workunit.client.0.smithi078.stdout:4/873: mknod d0/dc/d10/d1c/d6a/c124 0 2024-04-18T21:07:02.408 INFO:tasks.workunit.client.0.smithi078.stdout:1/941: fsync d0/d2a/d5f/d89/d32/db2/d10e/dc6/fdc 0 2024-04-18T21:07:02.408 INFO:tasks.workunit.client.0.smithi078.stdout:6/810: rename d2/d1c/d63/d8b/dcb/fde to d2/d34/d35/f11a 0 2024-04-18T21:07:02.408 INFO:tasks.workunit.client.0.smithi078.stdout:9/902: truncate d7/d11/d2d/fd6 367696 0 2024-04-18T21:07:02.409 INFO:tasks.workunit.client.0.smithi078.stdout:1/942: dread - d0/d2a/d5f/d89/fd6 zero size 2024-04-18T21:07:02.409 INFO:tasks.workunit.client.0.smithi078.stdout:4/874: mkdir d0/dc/d10/d1c/d6a/d81/dd4/d10c/d125 0 2024-04-18T21:07:02.409 INFO:tasks.workunit.client.0.smithi078.stdout:9/903: creat d7/d11/d47/f13a x:0 0 0 2024-04-18T21:07:02.409 INFO:tasks.workunit.client.0.smithi078.stdout:1/943: stat d0/d2a/d5f/d89/dc2/d100/f139 0 2024-04-18T21:07:02.410 INFO:tasks.workunit.client.0.smithi078.stdout:9/904: creat d7/f13b x:0 0 0 2024-04-18T21:07:02.410 INFO:tasks.workunit.client.0.smithi078.stdout:4/875: rename d0/dc/d29/f51 to d0/dc/dd7/f126 0 2024-04-18T21:07:02.411 INFO:tasks.workunit.client.0.smithi078.stdout:9/905: creat d7/d11/d2d/d3f/db7/dfd/f13c x:0 0 0 2024-04-18T21:07:02.411 INFO:tasks.workunit.client.0.smithi078.stdout:1/944: rename d0/d2a/d3c/da8/df4 to d0/d2a/d45/d121/d13a 0 2024-04-18T21:07:02.411 INFO:tasks.workunit.client.0.smithi078.stdout:4/876: symlink d0/dc/dd7/l127 0 2024-04-18T21:07:02.411 INFO:tasks.workunit.client.0.smithi078.stdout:2/799: dread d0/d1f/f7e [4194304,4194304] 0 2024-04-18T21:07:02.411 INFO:tasks.workunit.client.0.smithi078.stdout:9/906: fsync d7/df/d54/d115/de2/f114 0 2024-04-18T21:07:02.413 INFO:tasks.workunit.client.0.smithi078.stdout:5/815: read d9/da/d3e/d4c/d67/fd3 [266263,88416] 0 2024-04-18T21:07:02.413 INFO:tasks.workunit.client.0.smithi078.stdout:1/945: write d0/d2a/d5f/d89/dc2/d100/f139 [4372351,22967] 0 2024-04-18T21:07:02.413 INFO:tasks.workunit.client.0.smithi078.stdout:9/907: rename d7/c111 to d7/d11/d2d/d3f/db7/dfd/d113/c13d 0 2024-04-18T21:07:02.414 INFO:tasks.workunit.client.0.smithi078.stdout:1/946: link d0/d11/d69/f97 d0/d2a/d5f/d89/d32/d35/d113/f13b 0 2024-04-18T21:07:02.415 INFO:tasks.workunit.client.0.smithi078.stdout:9/908: rename d7/d11/d1b/d45/d4b/d5d/d6a to d7/d11/d2d/d26/d12f/d13e 0 2024-04-18T21:07:02.415 INFO:tasks.workunit.client.0.smithi078.stdout:9/909: dread - d7/d11/d2d/d26/d7c/fc8 zero size 2024-04-18T21:07:02.421 INFO:tasks.workunit.client.0.smithi078.stdout:7/802: dwrite d1/d16/dc/d11/f2b [0,4194304] 0 2024-04-18T21:07:02.422 INFO:tasks.workunit.client.0.smithi078.stdout:3/758: dwrite d4/da/d11/f22 [0,4194304] 0 2024-04-18T21:07:02.422 INFO:tasks.workunit.client.0.smithi078.stdout:6/811: write d2/fe [238623,87791] 0 2024-04-18T21:07:02.423 INFO:tasks.workunit.client.0.smithi078.stdout:9/910: dwrite d7/d11/d47/f11b [4194304,4194304] 0 2024-04-18T21:07:02.424 INFO:tasks.workunit.client.0.smithi078.stdout:6/812: stat d2/d1c/d6b/dba/deb/d5d/l109 0 2024-04-18T21:07:02.424 INFO:tasks.workunit.client.0.smithi078.stdout:7/803: truncate d1/d16/d1c/d40/f8e 901338 0 2024-04-18T21:07:02.424 INFO:tasks.workunit.client.0.smithi078.stdout:9/911: fsync d7/df/d67/fa5 0 2024-04-18T21:07:02.425 INFO:tasks.workunit.client.0.smithi078.stdout:7/804: fdatasync d1/d16/d1c/d40/f8e 0 2024-04-18T21:07:02.425 INFO:tasks.workunit.client.0.smithi078.stdout:7/805: fsync d1/d16/dc/fb2 0 2024-04-18T21:07:02.425 INFO:tasks.workunit.client.0.smithi078.stdout:4/877: truncate d0/dc/f55 1943577 0 2024-04-18T21:07:02.426 INFO:tasks.workunit.client.0.smithi078.stdout:2/800: truncate d0/db/fb6 322191 0 2024-04-18T21:07:02.426 INFO:tasks.workunit.client.0.smithi078.stdout:7/806: write d1/f57 [757537,122666] 0 2024-04-18T21:07:02.426 INFO:tasks.workunit.client.0.smithi078.stdout:5/816: truncate d9/da/d8c/daf/ff0 2380356 0 2024-04-18T21:07:02.427 INFO:tasks.workunit.client.0.smithi078.stdout:3/759: rename d4/da/l99 to d4/da/d5e/led 0 2024-04-18T21:07:02.427 INFO:tasks.workunit.client.0.smithi078.stdout:9/912: creat d7/df/d54/d115/de2/f13f x:0 0 0 2024-04-18T21:07:02.427 INFO:tasks.workunit.client.0.smithi078.stdout:7/807: readlink d1/d16/dc/d11/da2/dbc/lf6 0 2024-04-18T21:07:02.428 INFO:tasks.workunit.client.0.smithi078.stdout:4/878: write d0/dc/d29/d6d/f8c [42509,119319] 0 2024-04-18T21:07:02.429 INFO:tasks.workunit.client.0.smithi078.stdout:5/817: mkdir d9/d9f/dd4/dee/def/dff 0 2024-04-18T21:07:02.429 INFO:tasks.workunit.client.0.smithi078.stdout:9/913: creat d7/df/d54/d95/d9d/dd1/d10a/d3e/f140 x:0 0 0 2024-04-18T21:07:02.429 INFO:tasks.workunit.client.0.smithi078.stdout:0/836: dread d0/d9/da/db/d35/f6e [0,4194304] 0 2024-04-18T21:07:02.429 INFO:tasks.workunit.client.0.smithi078.stdout:7/808: chown d1/c2 18932234 1 2024-04-18T21:07:02.430 INFO:tasks.workunit.client.0.smithi078.stdout:4/879: chown d0/dc/dd7/f126 546 1 2024-04-18T21:07:02.430 INFO:tasks.workunit.client.0.smithi078.stdout:5/818: chown d9/da/d3e/d4c/d6d/d75/lc4 5671 1 2024-04-18T21:07:02.430 INFO:tasks.workunit.client.0.smithi078.stdout:3/760: chown d4/d2d/d30/d35/d4b/d59/cc8 1299917 1 2024-04-18T21:07:02.430 INFO:tasks.workunit.client.0.smithi078.stdout:0/837: readlink d0/d9/da/l2a 0 2024-04-18T21:07:02.430 INFO:tasks.workunit.client.0.smithi078.stdout:9/914: fdatasync d7/d11/d2d/d3f/d4d/f122 0 2024-04-18T21:07:02.431 INFO:tasks.workunit.client.0.smithi078.stdout:0/838: write d0/f5 [1693287,92505] 0 2024-04-18T21:07:02.431 INFO:tasks.workunit.client.0.smithi078.stdout:3/761: mknod d4/dc3/cee 0 2024-04-18T21:07:02.432 INFO:tasks.workunit.client.0.smithi078.stdout:0/839: readlink d0/d9/da/lb2 0 2024-04-18T21:07:02.433 INFO:tasks.workunit.client.0.smithi078.stdout:4/880: truncate d0/dc/d10/d1c/d60/dee/db8/f106 99077 0 2024-04-18T21:07:02.433 INFO:tasks.workunit.client.0.smithi078.stdout:7/809: getdents d1/d16/dc/d11/d53/d82/da4/db5/d91/db4 0 2024-04-18T21:07:02.433 INFO:tasks.workunit.client.0.smithi078.stdout:3/762: mknod d4/da/d76/dce/cef 0 2024-04-18T21:07:02.434 INFO:tasks.workunit.client.0.smithi078.stdout:7/810: dread - d1/fbd zero size 2024-04-18T21:07:02.435 INFO:tasks.workunit.client.0.smithi078.stdout:4/881: mkdir d0/dc/dd7/d128 0 2024-04-18T21:07:02.435 INFO:tasks.workunit.client.0.smithi078.stdout:0/840: truncate d0/d9/d4c/d6b/fbb 469987 0 2024-04-18T21:07:02.435 INFO:tasks.workunit.client.0.smithi078.stdout:9/915: rename d7/df/d54/d95/d9d/dd1/d10a/d3e/d5a/da8 to d7/df/d54/d95/d9d/dd1/d141 0 2024-04-18T21:07:02.435 INFO:tasks.workunit.client.0.smithi078.stdout:3/763: symlink d4/da/d11/d66/dca/lf0 0 2024-04-18T21:07:02.436 INFO:tasks.workunit.client.0.smithi078.stdout:4/882: chown d0/dc/d10/d3a/fe0 4449 1 2024-04-18T21:07:02.438 INFO:tasks.workunit.client.0.smithi078.stdout:5/819: dread d9/da/d3e/d4c/d67/f91 [0,4194304] 0 2024-04-18T21:07:02.438 INFO:tasks.workunit.client.0.smithi078.stdout:2/801: dwrite d0/db/d18/d21/db0/d59/fe2 [0,4194304] 0 2024-04-18T21:07:02.438 INFO:tasks.workunit.client.0.smithi078.stdout:4/883: truncate d0/dc/d5b/f8a 441069 0 2024-04-18T21:07:02.439 INFO:tasks.workunit.client.0.smithi078.stdout:4/884: chown d0/dc/d10/d1c/d110/l66 213659009 1 2024-04-18T21:07:02.439 INFO:tasks.workunit.client.0.smithi078.stdout:5/820: symlink d9/da/d3e/d4c/d67/d7c/d78/l100 0 2024-04-18T21:07:02.439 INFO:tasks.workunit.client.0.smithi078.stdout:2/802: creat d0/db/d6e/ff6 x:0 0 0 2024-04-18T21:07:02.441 INFO:tasks.workunit.client.0.smithi078.stdout:6/813: truncate d2/d1f/f25 9752337 0 2024-04-18T21:07:02.441 INFO:tasks.workunit.client.0.smithi078.stdout:4/885: chown d0/dc/d10/d1c/d60/d123/fbd 190184 1 2024-04-18T21:07:02.442 INFO:tasks.workunit.client.0.smithi078.stdout:5/821: unlink d9/d2e/d65/f6a 0 2024-04-18T21:07:02.443 INFO:tasks.workunit.client.0.smithi078.stdout:2/803: write d0/db/d18/d21/d27/d29/fb4 [527286,60206] 0 2024-04-18T21:07:02.443 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:02.442+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:02.444 INFO:tasks.workunit.client.0.smithi078.stdout:5/822: symlink d9/da/d3e/d4c/l101 0 2024-04-18T21:07:02.445 INFO:tasks.workunit.client.0.smithi078.stdout:9/916: dwrite d7/d11/d2d/d26/d7c/f10c [0,4194304] 0 2024-04-18T21:07:02.445 INFO:tasks.workunit.client.0.smithi078.stdout:4/886: creat d0/dc/d10/d1c/d60/daf/f129 x:0 0 0 2024-04-18T21:07:02.445 INFO:tasks.workunit.client.0.smithi078.stdout:5/823: write d9/f25 [4364036,98745] 0 2024-04-18T21:07:02.446 INFO:tasks.workunit.client.0.smithi078.stdout:9/917: readlink d7/d11/d2d/l11d 0 2024-04-18T21:07:02.446 INFO:tasks.workunit.client.0.smithi078.stdout:0/841: dwrite d0/d9/da/db/da6/fc6 [0,4194304] 0 2024-04-18T21:07:02.447 INFO:tasks.workunit.client.0.smithi078.stdout:7/811: dwrite d1/d32/f5d [4194304,4194304] 0 2024-04-18T21:07:02.448 INFO:tasks.workunit.client.0.smithi078.stdout:2/804: symlink d0/db/d18/d21/d27/d29/d33/lf7 0 2024-04-18T21:07:02.448 INFO:tasks.workunit.client.0.smithi078.stdout:5/824: unlink d9/d9f/fc6 0 2024-04-18T21:07:02.449 INFO:tasks.workunit.client.0.smithi078.stdout:0/842: write d0/d15/f53 [3630498,13296] 0 2024-04-18T21:07:02.450 INFO:tasks.workunit.client.0.smithi078.stdout:5/825: chown d9/d2e/d65 2985019 1 2024-04-18T21:07:02.451 INFO:tasks.workunit.client.0.smithi078.stdout:5/826: fdatasync d9/da/f35 0 2024-04-18T21:07:02.451 INFO:tasks.workunit.client.0.smithi078.stdout:0/843: creat d0/d9/da/f102 x:0 0 0 2024-04-18T21:07:02.452 INFO:tasks.workunit.client.0.smithi078.stdout:6/814: dwrite d2/d1c/d6b/f104 [0,4194304] 0 2024-04-18T21:07:02.452 INFO:tasks.workunit.client.0.smithi078.stdout:0/844: stat d0/d9/dd/d17/d2e/d7f/f5c 0 2024-04-18T21:07:02.453 INFO:tasks.workunit.client.0.smithi078.stdout:5/827: creat d9/da/d8c/f102 x:0 0 0 2024-04-18T21:07:02.454 INFO:tasks.workunit.client.0.smithi078.stdout:0/845: chown d0/d9/d4c/d8f/c90 61644557 1 2024-04-18T21:07:02.454 INFO:tasks.workunit.client.0.smithi078.stdout:6/815: truncate d2/d34/d35/fbe 173575 0 2024-04-18T21:07:02.455 INFO:tasks.workunit.client.0.smithi078.stdout:9/918: dwrite d7/d11/d2d/d3f/db7/dfd/f13c [0,4194304] 0 2024-04-18T21:07:02.455 INFO:tasks.workunit.client.0.smithi078.stdout:4/887: read d0/dc/fd2 [446122,74009] 0 2024-04-18T21:07:02.457 INFO:tasks.workunit.client.0.smithi078.stdout:2/805: dread d0/d1f/f7e [4194304,4194304] 0 2024-04-18T21:07:02.457 INFO:tasks.workunit.client.0.smithi078.stdout:7/812: dwrite d1/d16/dc/d11/fa8 [0,4194304] 0 2024-04-18T21:07:02.458 INFO:tasks.workunit.client.0.smithi078.stdout:9/919: truncate d7/d11/d1b/d77/fc3 379508 0 2024-04-18T21:07:02.459 INFO:tasks.workunit.client.0.smithi078.stdout:6/816: fsync d2/d1c/d6b/d98/f9a 0 2024-04-18T21:07:02.459 INFO:tasks.workunit.client.0.smithi078.stdout:4/888: rmdir d0/dc/d10/d1c/d6a 39 2024-04-18T21:07:02.459 INFO:tasks.workunit.client.0.smithi078.stdout:0/846: creat d0/d9/da/db/da6/f103 x:0 0 0 2024-04-18T21:07:02.459 INFO:tasks.workunit.client.0.smithi078.stdout:9/920: creat d7/d11/d2d/d3f/db7/dfd/f142 x:0 0 0 2024-04-18T21:07:02.460 INFO:tasks.workunit.client.0.smithi078.stdout:5/828: rename d9/da/d90/d62/da4/c85 to d9/c103 0 2024-04-18T21:07:02.460 INFO:tasks.workunit.client.0.smithi078.stdout:2/806: creat d0/db/d18/d30/ff8 x:0 0 0 2024-04-18T21:07:02.460 INFO:tasks.workunit.client.0.smithi078.stdout:0/847: readlink d0/d9/da/lf4 0 2024-04-18T21:07:02.460 INFO:tasks.workunit.client.0.smithi078.stdout:2/807: dread - d0/db/fec zero size 2024-04-18T21:07:02.461 INFO:tasks.workunit.client.0.smithi078.stdout:6/817: mkdir d2/d1c/d63/da1/db9/d11b 0 2024-04-18T21:07:02.461 INFO:tasks.workunit.client.0.smithi078.stdout:7/813: creat d1/d16/d1c/f114 x:0 0 0 2024-04-18T21:07:02.461 INFO:tasks.workunit.client.0.smithi078.stdout:0/848: chown d0/d9/d81/daa 88 1 2024-04-18T21:07:02.461 INFO:tasks.workunit.client.0.smithi078.stdout:4/889: creat d0/dc/dd7/d128/f12a x:0 0 0 2024-04-18T21:07:02.462 INFO:tasks.workunit.client.0.smithi078.stdout:0/849: readlink d0/d9/dd/d17/d2e/d7f/l47 0 2024-04-18T21:07:02.462 INFO:tasks.workunit.client.0.smithi078.stdout:2/808: chown d0/db/d18/d21/d27/f58 1959699042 1 2024-04-18T21:07:02.462 INFO:tasks.workunit.client.0.smithi078.stdout:4/890: dread - d0/dc/d10/d1c/d6a/f108 zero size 2024-04-18T21:07:02.463 INFO:tasks.workunit.client.0.smithi078.stdout:4/891: stat d0/d73/f75 0 2024-04-18T21:07:02.465 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:02.465 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:02.469 INFO:tasks.workunit.client.0.smithi078.stdout:6/818: dwrite d2/f3 [0,4194304] 0 2024-04-18T21:07:02.469 INFO:tasks.workunit.client.0.smithi078.stdout:0/850: dwrite d0/d9/f43 [4194304,4194304] 0 2024-04-18T21:07:02.470 INFO:tasks.workunit.client.0.smithi078.stdout:6/819: write d2/d34/d35/f40 [844858,15364] 0 2024-04-18T21:07:02.470 INFO:tasks.workunit.client.0.smithi078.stdout:2/809: dwrite d0/db/d65/d96/fa7 [0,4194304] 0 2024-04-18T21:07:02.471 INFO:tasks.workunit.client.0.smithi078.stdout:4/892: dwrite d0/d73/fe8 [0,4194304] 0 2024-04-18T21:07:02.471 INFO:tasks.workunit.client.0.smithi078.stdout:6/820: symlink d2/d1f/l11c 0 2024-04-18T21:07:02.472 INFO:tasks.workunit.client.0.smithi078.stdout:2/810: chown d0/db/d18/d21/c5f 3869 1 2024-04-18T21:07:02.472 INFO:tasks.workunit.client.0.smithi078.stdout:4/893: chown d0/d73 35994620 1 2024-04-18T21:07:02.472 INFO:tasks.workunit.client.0.smithi078.stdout:2/811: rename d0/db/d18 to d0/db/d18/d30/df9 22 2024-04-18T21:07:02.473 INFO:tasks.workunit.client.0.smithi078.stdout:6/821: rename d2/d34/d75/fa2 to d2/d1c/d63/da0/f11d 0 2024-04-18T21:07:02.474 INFO:tasks.workunit.client.0.smithi078.stdout:6/822: creat d2/d1c/d6b/dba/f11e x:0 0 0 2024-04-18T21:07:02.474 INFO:tasks.workunit.client.0.smithi078.stdout:0/851: dread d0/d9/f43 [4194304,4194304] 0 2024-04-18T21:07:02.475 INFO:tasks.workunit.client.0.smithi078.stdout:9/921: write d7/f6d [135199,77348] 0 2024-04-18T21:07:02.475 INFO:tasks.workunit.client.0.smithi078.stdout:5/829: truncate d9/da/d3e/d4c/d67/f91 694400 0 2024-04-18T21:07:02.476 INFO:tasks.workunit.client.0.smithi078.stdout:9/922: write d7/df/f21 [2565836,37391] 0 2024-04-18T21:07:02.477 INFO:tasks.workunit.client.0.smithi078.stdout:0/852: write d0/d9/dd/d17/d2e/d31/f91 [3738586,30810] 0 2024-04-18T21:07:02.477 INFO:tasks.workunit.client.0.smithi078.stdout:5/830: chown d9/da/d3e/d4c/d67/d7c/d78/l100 372 1 2024-04-18T21:07:02.478 INFO:tasks.workunit.client.0.smithi078.stdout:2/812: dread d0/d1f/f7e [0,4194304] 0 2024-04-18T21:07:02.478 INFO:tasks.workunit.client.0.smithi078.stdout:5/831: readlink d9/da/l16 0 2024-04-18T21:07:02.478 INFO:tasks.workunit.client.0.smithi078.stdout:2/813: fsync d0/d1f/f7a 0 2024-04-18T21:07:02.479 INFO:tasks.workunit.client.0.smithi078.stdout:5/832: creat d9/d2e/f104 x:0 0 0 2024-04-18T21:07:02.479 INFO:tasks.workunit.client.0.smithi078.stdout:4/894: dwrite d0/dc/d10/d1c/d110/f3b [4194304,4194304] 0 2024-04-18T21:07:02.479 INFO:tasks.workunit.client.0.smithi078.stdout:2/814: mknod d0/db/d18/d21/d8b/cfa 0 2024-04-18T21:07:02.481 INFO:tasks.workunit.client.0.smithi078.stdout:5/833: fsync d9/da/d3e/d4c/f5a 0 2024-04-18T21:07:02.482 INFO:tasks.workunit.client.0.smithi078.stdout:8/838: sync 2024-04-18T21:07:02.482 INFO:tasks.workunit.client.0.smithi078.stdout:1/947: sync 2024-04-18T21:07:02.483 INFO:tasks.workunit.client.0.smithi078.stdout:2/815: mknod d0/db/d18/d21/d27/cfb 0 2024-04-18T21:07:02.483 INFO:tasks.workunit.client.0.smithi078.stdout:5/834: dread - d9/da/d3e/d4c/d79/fce zero size 2024-04-18T21:07:02.483 INFO:tasks.workunit.client.0.smithi078.stdout:7/814: truncate d1/f5e 3230981 0 2024-04-18T21:07:02.484 INFO:tasks.workunit.client.0.smithi078.stdout:1/948: chown d0/d2a/d45/d121/d13a/l10c 3858 1 2024-04-18T21:07:02.484 INFO:tasks.workunit.client.0.smithi078.stdout:1/949: fsync d0/d11/f22 0 2024-04-18T21:07:02.485 INFO:tasks.workunit.client.0.smithi078.stdout:2/816: mkdir d0/db/d18/d21/d27/d29/de3/dfc 0 2024-04-18T21:07:02.486 INFO:tasks.workunit.client.0.smithi078.stdout:2/817: stat d0/d87/d88/d98/db2/fe9 0 2024-04-18T21:07:02.486 INFO:tasks.workunit.client.0.smithi078.stdout:0/853: truncate d0/d9/f77 836822 0 2024-04-18T21:07:02.487 INFO:tasks.workunit.client.0.smithi078.stdout:2/818: write d0/fae [888295,121611] 0 2024-04-18T21:07:02.487 INFO:tasks.workunit.client.0.smithi078.stdout:1/950: creat d0/d2a/d5f/d89/d32/f13c x:0 0 0 2024-04-18T21:07:02.490 INFO:tasks.workunit.client.0.smithi078.stdout:2/819: rmdir d0/db/d18/d21/d8b 39 2024-04-18T21:07:02.490 INFO:tasks.workunit.client.0.smithi078.stdout:7/815: link d1/d16/d1c/d40/f7b d1/d16/dc/d11/da2/dbc/dc3/dff/f115 0 2024-04-18T21:07:02.490 INFO:tasks.workunit.client.0.smithi078.stdout:0/854: rename d0/d9/dd/d17/d82/ff6 to d0/d6c/d9d/f104 0 2024-04-18T21:07:02.490 INFO:tasks.workunit.client.0.smithi078.stdout:1/951: creat d0/d2a/d45/d81/dc8/f13d x:0 0 0 2024-04-18T21:07:02.490 INFO:tasks.workunit.client.0.smithi078.stdout:2/820: readlink d0/d1f/d34/dd5/l85 0 2024-04-18T21:07:02.490 INFO:tasks.workunit.client.0.smithi078.stdout:1/952: mknod d0/d11/c13e 0 2024-04-18T21:07:02.491 INFO:tasks.workunit.client.0.smithi078.stdout:3/764: dread d4/da/f4a [0,4194304] 0 2024-04-18T21:07:02.491 INFO:tasks.workunit.client.0.smithi078.stdout:5/835: dwrite d9/da/d32/da5/fe1 [0,4194304] 0 2024-04-18T21:07:02.491 INFO:tasks.workunit.client.0.smithi078.stdout:0/855: creat d0/d9/da/f105 x:0 0 0 2024-04-18T21:07:02.492 INFO:tasks.workunit.client.0.smithi078.stdout:2/821: rename d0/d1f/d34/dd5/f82 to d0/d87/d88/d98/ffd 0 2024-04-18T21:07:02.492 INFO:tasks.workunit.client.0.smithi078.stdout:4/895: truncate d0/dc/d10/d1c/d60/dee/dc4/df3/fe5 3113048 0 2024-04-18T21:07:02.493 INFO:tasks.workunit.client.0.smithi078.stdout:3/765: getdents d4/d2d 0 2024-04-18T21:07:02.494 INFO:tasks.workunit.client.0.smithi078.stdout:5/836: link d9/da/d3e/d4c/d6d/d73/fa1 d9/da/d90/deb/f105 0 2024-04-18T21:07:02.495 INFO:tasks.workunit.client.0.smithi078.stdout:3/766: fsync d4/f6a 0 2024-04-18T21:07:02.495 INFO:tasks.workunit.client.0.smithi078.stdout:7/816: dread d1/d16/dc/d11/f2b [0,4194304] 0 2024-04-18T21:07:02.495 INFO:tasks.workunit.client.0.smithi078.stdout:2/822: mkdir d0/d1f/d5b/dfe 0 2024-04-18T21:07:02.495 INFO:tasks.workunit.client.0.smithi078.stdout:3/767: fsync d4/df/fa4 0 2024-04-18T21:07:02.496 INFO:tasks.workunit.client.0.smithi078.stdout:2/823: stat d0/d1f/fcb 0 2024-04-18T21:07:02.498 INFO:tasks.workunit.client.0.smithi078.stdout:1/953: write d0/d2a/d45/d81/dc8/ff7 [105223,61436] 0 2024-04-18T21:07:02.498 INFO:tasks.workunit.client.0.smithi078.stdout:4/896: rename d0/dc/d10/d1c/d60/dee/dc4/l117 to d0/dc/d10/d1c/d110/dfa/l12b 0 2024-04-18T21:07:02.498 INFO:tasks.workunit.client.0.smithi078.stdout:2/824: creat d0/db/d18/d21/d27/d79/fff x:0 0 0 2024-04-18T21:07:02.499 INFO:tasks.workunit.client.0.smithi078.stdout:0/856: dread d0/d9/da/db/d35/f5d [0,4194304] 0 2024-04-18T21:07:02.500 INFO:tasks.workunit.client.0.smithi078.stdout:8/839: dwrite d0/d10/d14/fa7 [0,4194304] 0 2024-04-18T21:07:02.501 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:02.501 INFO:tasks.workunit.client.0.smithi078.stdout:5/837: read d9/f25 [2579671,742] 0 2024-04-18T21:07:02.501 INFO:tasks.workunit.client.0.smithi078.stdout:1/954: write d0/de7/dd7/fec [710159,67267] 0 2024-04-18T21:07:02.501 INFO:tasks.workunit.client.0.smithi078.stdout:4/897: chown d0/dc/d5b/d71/dcf/de1 499123089 1 2024-04-18T21:07:02.503 INFO:tasks.workunit.client.0.smithi078.stdout:0/857: truncate d0/d9/da/db/d35/f6e 4659686 0 2024-04-18T21:07:02.503 INFO:tasks.workunit.client.0.smithi078.stdout:8/840: rename d0/d10/d14/d2a/d4a/db2/db6/dcc/df2 to d0/d10/d14/d2d/d93/da0/db5/d103 0 2024-04-18T21:07:02.504 INFO:tasks.workunit.client.0.smithi078.stdout:7/817: dwrite d1/d16/d10/d7c/f10c [0,4194304] 0 2024-04-18T21:07:02.504 INFO:tasks.workunit.client.0.smithi078.stdout:8/841: fsync d0/d10/d14/f70 0 2024-04-18T21:07:02.505 INFO:tasks.workunit.client.0.smithi078.stdout:0/858: symlink d0/d9/da/df/de3/l106 0 2024-04-18T21:07:02.506 INFO:tasks.workunit.client.0.smithi078.stdout:8/842: write d0/d5c/d5a/dc6/fdf [1149742,71805] 0 2024-04-18T21:07:02.506 INFO:tasks.workunit.client.0.smithi078.stdout:0/859: chown d0/d9/d4c/d8f/dc5/fc9 1200 1 2024-04-18T21:07:02.508 INFO:tasks.workunit.client.0.smithi078.stdout:8/843: mkdir d0/d10/d14/d2a/d4a/db2/db6/dcc/dde/d104 0 2024-04-18T21:07:02.509 INFO:tasks.workunit.client.0.smithi078.stdout:2/825: dwrite d0/db/d18/d21/d27/d70/fcf [0,4194304] 0 2024-04-18T21:07:02.509 INFO:tasks.workunit.client.0.smithi078.stdout:8/844: write d0/f6 [13786277,116699] 0 2024-04-18T21:07:02.510 INFO:tasks.workunit.client.0.smithi078.stdout:0/860: link d0/d9/da/db/l54 d0/d9/d58/l107 0 2024-04-18T21:07:02.510 INFO:tasks.workunit.client.0.smithi078.stdout:2/826: symlink d0/db/d18/d5d/l100 0 2024-04-18T21:07:02.511 INFO:tasks.workunit.client.0.smithi078.stdout:9/923: dread d7/d11/d2d/fd6 [0,4194304] 0 2024-04-18T21:07:02.511 INFO:tasks.workunit.client.0.smithi078.stdout:0/861: read - d0/fd9 zero size 2024-04-18T21:07:02.512 INFO:tasks.workunit.client.0.smithi078.stdout:9/924: symlink d7/df/d54/l143 0 2024-04-18T21:07:02.512 INFO:tasks.workunit.client.0.smithi078.stdout:0/862: readlink d0/d9/dd/l1a 0 2024-04-18T21:07:02.513 INFO:tasks.workunit.client.0.smithi078.stdout:8/845: link d0/d10/d14/d2a/d3c/c8c d0/d10/c105 0 2024-04-18T21:07:02.513 INFO:tasks.workunit.client.0.smithi078.stdout:9/925: fdatasync d7/df/f2a 0 2024-04-18T21:07:02.513 INFO:tasks.workunit.client.0.smithi078.stdout:6/823: dread d2/d1f/f29 [0,4194304] 0 2024-04-18T21:07:02.513 INFO:tasks.workunit.client.0.smithi078.stdout:0/863: rmdir d0/d9/d4c/d8f 39 2024-04-18T21:07:02.514 INFO:tasks.workunit.client.0.smithi078.stdout:6/824: stat d2/d1c/d63/d8b/fd1 0 2024-04-18T21:07:02.515 INFO:tasks.workunit.client.0.smithi078.stdout:9/926: mknod d7/d11/c144 0 2024-04-18T21:07:02.515 INFO:tasks.workunit.client.0.smithi078.stdout:8/846: truncate d0/d10/d14/f1e 515453 0 2024-04-18T21:07:02.515 INFO:tasks.workunit.client.0.smithi078.stdout:0/864: creat d0/d9/dd/d17/dca/f108 x:0 0 0 2024-04-18T21:07:02.516 INFO:tasks.workunit.client.0.smithi078.stdout:6/825: creat d2/d1c/d6b/f11f x:0 0 0 2024-04-18T21:07:02.516 INFO:tasks.workunit.client.0.smithi078.stdout:1/955: dread d0/dc1/f101 [0,4194304] 0 2024-04-18T21:07:02.518 INFO:tasks.workunit.client.0.smithi078.stdout:4/898: dwrite d0/dc/d10/d1c/d60/d123/fd6 [0,4194304] 0 2024-04-18T21:07:02.518 INFO:tasks.workunit.client.0.smithi078.stdout:0/865: write d0/d9/f2d [4825876,51426] 0 2024-04-18T21:07:02.518 INFO:tasks.workunit.client.0.smithi078.stdout:6/826: write d2/d1c/d30/fb2 [653040,40323] 0 2024-04-18T21:07:02.518 INFO:tasks.workunit.client.0.smithi078.stdout:1/956: dread - d0/d2a/d45/d81/dea/f131 zero size 2024-04-18T21:07:02.520 INFO:tasks.workunit.client.0.smithi078.stdout:0/866: creat d0/d9/da/df/de3/f109 x:0 0 0 2024-04-18T21:07:02.520 INFO:tasks.workunit.client.0.smithi078.stdout:1/957: dread d0/d11/d69/ff6 [0,4194304] 0 2024-04-18T21:07:02.520 INFO:tasks.workunit.client.0.smithi078.stdout:2/827: dwrite d0/db/d18/d21/d27/d29/d33/fdf [0,4194304] 0 2024-04-18T21:07:02.521 INFO:tasks.workunit.client.0.smithi078.stdout:0/867: dread - d0/d9/d4c/fe4 zero size 2024-04-18T21:07:02.522 INFO:tasks.workunit.client.0.smithi078.stdout:2/828: readlink d0/db/d18/d5d/l6c 0 2024-04-18T21:07:02.522 INFO:tasks.workunit.client.0.smithi078.stdout:4/899: write d0/dc/d10/d41/ffe [4503200,70270] 0 2024-04-18T21:07:02.523 INFO:tasks.workunit.client.0.smithi078.stdout:6/827: link d2/d1c/c62 d2/d6/c120 0 2024-04-18T21:07:02.523 INFO:tasks.workunit.client.0.smithi078.stdout:4/900: chown d0/f58 1113097 1 2024-04-18T21:07:02.524 INFO:tasks.workunit.client.0.smithi078.stdout:0/868: write d0/d9/da/db/d35/d3f/dbe/f7c [782117,59402] 0 2024-04-18T21:07:02.525 INFO:tasks.workunit.client.0.smithi078.stdout:6/828: write d2/d1c/d6b/dba/deb/d5d/f6a [4586091,29249] 0 2024-04-18T21:07:02.526 INFO:tasks.workunit.client.0.smithi078.stdout:8/847: dwrite d0/d10/d14/d2a/fb1 [0,4194304] 0 2024-04-18T21:07:02.526 INFO:tasks.workunit.client.0.smithi078.stdout:4/901: creat d0/dc/d29/de2/f12c x:0 0 0 2024-04-18T21:07:02.527 INFO:tasks.workunit.client.0.smithi078.stdout:6/829: fsync d2/d1c/d30/fc1 0 2024-04-18T21:07:02.527 INFO:tasks.workunit.client.0.smithi078.stdout:8/848: chown d0/d10/d14/d2d/d93/da0/dc2/dfa 5 1 2024-04-18T21:07:02.528 INFO:tasks.workunit.client.0.smithi078.stdout:0/869: rename d0/d9/d4c/d8f/fc0 to d0/d9/d4c/d6b/dd3/f10a 0 2024-04-18T21:07:02.530 INFO:tasks.workunit.client.0.smithi078.stdout:6/830: symlink d2/d1c/d63/d8b/dcc/l121 0 2024-04-18T21:07:02.530 INFO:tasks.workunit.client.0.smithi078.stdout:8/849: mkdir d0/d22/d106 0 2024-04-18T21:07:02.530 INFO:tasks.workunit.client.0.smithi078.stdout:0/870: creat d0/d9/d7d/f10b x:0 0 0 2024-04-18T21:07:02.531 INFO:tasks.workunit.client.0.smithi078.stdout:9/927: truncate d7/df/d54/d115/f58 3483447 0 2024-04-18T21:07:02.531 INFO:tasks.workunit.client.0.smithi078.stdout:8/850: rmdir d0/d10/d14/d2a/d3c 39 2024-04-18T21:07:02.531 INFO:tasks.workunit.client.0.smithi078.stdout:2/829: dwrite d0/d1f/d34/dd6/ff5 [0,4194304] 0 2024-04-18T21:07:02.531 INFO:tasks.workunit.client.0.smithi078.stdout:0/871: creat d0/d9/d81/daa/f10c x:0 0 0 2024-04-18T21:07:02.532 INFO:tasks.workunit.client.0.smithi078.stdout:0/872: unlink d0/d6c/l99 0 2024-04-18T21:07:02.533 INFO:tasks.workunit.client.0.smithi078.stdout:0/873: readlink d0/d9/dd/d17/d2e/d7f/l47 0 2024-04-18T21:07:02.533 INFO:tasks.workunit.client.0.smithi078.stdout:9/928: link d7/d11/d2d/d3f/db7/dfd/f142 d7/d11/d2d/d3f/d126/f145 0 2024-04-18T21:07:02.535 INFO:tasks.workunit.client.0.smithi078.stdout:0/874: link d0/d9/d4c/d6b/d9b/ce9 d0/d9/d7d/c10d 0 2024-04-18T21:07:02.536 INFO:tasks.workunit.client.0.smithi078.stdout:0/875: symlink d0/d9/d4c/d8f/l10e 0 2024-04-18T21:07:02.537 INFO:tasks.workunit.client.0.smithi078.stdout:7/818: dread d1/d16/d1c/d40/f7b [0,4194304] 0 2024-04-18T21:07:02.537 INFO:tasks.workunit.client.0.smithi078.stdout:0/876: rmdir d0/d9/d81 39 2024-04-18T21:07:02.538 INFO:tasks.workunit.client.0.smithi078.stdout:2/830: dwrite d0/d1f/fcb [0,4194304] 0 2024-04-18T21:07:02.539 INFO:tasks.workunit.client.0.smithi078.stdout:7/819: creat d1/d16/dc/d11/da2/dbc/f116 x:0 0 0 2024-04-18T21:07:02.540 INFO:tasks.workunit.client.0.smithi078.stdout:3/768: sync 2024-04-18T21:07:02.540 INFO:tasks.workunit.client.0.smithi078.stdout:2/831: write d0/db/d18/f1c [4427468,11483] 0 2024-04-18T21:07:02.541 INFO:tasks.workunit.client.0.smithi078.stdout:7/820: mknod d1/d16/d2d/df4/c117 0 2024-04-18T21:07:02.542 INFO:tasks.workunit.client.0.smithi078.stdout:4/902: read d0/dc/d29/d2f/f35 [1549909,35774] 0 2024-04-18T21:07:02.542 INFO:tasks.workunit.client.0.smithi078.stdout:0/877: creat d0/d9/d4c/d89/f10f x:0 0 0 2024-04-18T21:07:02.542 INFO:tasks.workunit.client.0.smithi078.stdout:3/769: readlink d4/da/d5e/led 0 2024-04-18T21:07:02.542 INFO:tasks.workunit.client.0.smithi078.stdout:2/832: symlink d0/db/d18/d21/d27/d29/de3/l101 0 2024-04-18T21:07:02.545 INFO:tasks.workunit.client.0.smithi078.stdout:0/878: mknod d0/d6c/d9d/c110 0 2024-04-18T21:07:02.545 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:02.546+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:02.546 INFO:tasks.workunit.client.0.smithi078.stdout:0/879: rmdir d0/d9/d4c/d6b/d9b 39 2024-04-18T21:07:02.547 INFO:tasks.workunit.client.0.smithi078.stdout:0/880: rmdir d0/d9/d4c/d8f/dc5 39 2024-04-18T21:07:02.549 INFO:tasks.workunit.client.0.smithi078.stdout:4/903: dwrite d0/dc/d10/d1c/d60/d123/fd6 [0,4194304] 0 2024-04-18T21:07:02.549 INFO:tasks.workunit.client.0.smithi078.stdout:3/770: dwrite d4/df/d62/f7f [0,4194304] 0 2024-04-18T21:07:02.550 INFO:tasks.workunit.client.0.smithi078.stdout:0/881: getdents d0/d9/d4c/d6b/de7 0 2024-04-18T21:07:02.550 INFO:tasks.workunit.client.0.smithi078.stdout:4/904: creat d0/dc/dd7/d128/f12d x:0 0 0 2024-04-18T21:07:02.551 INFO:tasks.workunit.client.0.smithi078.stdout:4/905: mkdir d0/dc/d10/d1c/d60/dee/dc4/d12e 0 2024-04-18T21:07:02.551 INFO:tasks.workunit.client.0.smithi078.stdout:3/771: link d4/d2d/d30/d84/lc6 d4/da/d11/d66/lf1 0 2024-04-18T21:07:02.552 INFO:tasks.workunit.client.0.smithi078.stdout:9/929: dread d7/f6d [0,4194304] 0 2024-04-18T21:07:02.552 INFO:tasks.workunit.client.0.smithi078.stdout:2/833: write d0/f32 [1469853,70505] 0 2024-04-18T21:07:02.554 INFO:tasks.workunit.client.0.smithi078.stdout:3/772: creat d4/ff2 x:0 0 0 2024-04-18T21:07:02.554 INFO:tasks.workunit.client.0.smithi078.stdout:2/834: chown d0/d1f/d34/dd5/fcc 6228126 1 2024-04-18T21:07:02.554 INFO:tasks.workunit.client.0.smithi078.stdout:9/930: creat d7/df/d54/d95/d9d/dd1/d10a/d124/f146 x:0 0 0 2024-04-18T21:07:02.554 INFO:tasks.workunit.client.0.smithi078.stdout:3/773: write d4/da/d11/f72 [709715,26530] 0 2024-04-18T21:07:02.555 INFO:tasks.workunit.client.0.smithi078.stdout:4/906: rename d0/dc/d10/d1c/d60/d123/dcb/ce7 to d0/dc/d10/d1c/d110/c12f 0 2024-04-18T21:07:02.555 INFO:tasks.workunit.client.0.smithi078.stdout:0/882: read d0/d9/da/db/d35/f20 [829754,120620] 0 2024-04-18T21:07:02.557 INFO:tasks.workunit.client.0.smithi078.stdout:0/883: write d0/d9/da/fa4 [2747781,106374] 0 2024-04-18T21:07:02.557 INFO:tasks.workunit.client.0.smithi078.stdout:4/907: truncate d0/dc/d10/d1c/d6a/f113 1027246 0 2024-04-18T21:07:02.557 INFO:tasks.workunit.client.0.smithi078.stdout:2/835: link d0/db/d18/l3d d0/d1f/d34/dd6/l102 0 2024-04-18T21:07:02.560 INFO:tasks.workunit.client.0.smithi078.stdout:0/884: fsync d0/d9/f57 0 2024-04-18T21:07:02.560 INFO:tasks.workunit.client.0.smithi078.stdout:2/836: creat d0/db/d18/d21/d27/d29/d33/f103 x:0 0 0 2024-04-18T21:07:02.560 INFO:tasks.workunit.client.0.smithi078.stdout:6/831: dread d2/d1f/f2c [0,4194304] 0 2024-04-18T21:07:02.562 INFO:tasks.workunit.client.0.smithi078.stdout:0/885: fsync d0/d6c/d9d/f104 0 2024-04-18T21:07:02.562 INFO:tasks.workunit.client.0.smithi078.stdout:3/774: write d4/da/d76/f7b [29066,44415] 0 2024-04-18T21:07:02.562 INFO:tasks.workunit.client.0.smithi078.stdout:6/832: symlink d2/d6/dd6/l122 0 2024-04-18T21:07:02.563 INFO:tasks.workunit.client.0.smithi078.stdout:3/775: rename d4/d2d/d6c/c9b to d4/cf3 0 2024-04-18T21:07:02.564 INFO:tasks.workunit.client.0.smithi078.stdout:0/886: creat d0/d9/da/db/d35/d3f/da2/f111 x:0 0 0 2024-04-18T21:07:02.564 INFO:tasks.workunit.client.0.smithi078.stdout:4/908: dwrite d0/dc/d10/d41/fc0 [0,4194304] 0 2024-04-18T21:07:02.567 INFO:tasks.workunit.client.0.smithi078.stdout:0/887: rename d0/d9/f5a to d0/d9/d4c/d8f/db6/f112 0 2024-04-18T21:07:02.568 INFO:tasks.workunit.client.0.smithi078.stdout:0/888: chown d0/d9/d4c/d89 17358 1 2024-04-18T21:07:02.569 INFO:tasks.workunit.client.0.smithi078.stdout:0/889: creat d0/dc7/f113 x:0 0 0 2024-04-18T21:07:02.569 INFO:tasks.workunit.client.0.smithi078.stdout:4/909: getdents d0/dc/d10/d1c/d60/dee/dc4/df3 0 2024-04-18T21:07:02.569 INFO:tasks.workunit.client.0.smithi078.stdout:0/890: chown d0/d9/d7d 7 1 2024-04-18T21:07:02.570 INFO:tasks.workunit.client.0.smithi078.stdout:8/851: dread d0/d5c/d5a/d7b/fbf [0,4194304] 0 2024-04-18T21:07:02.570 INFO:tasks.workunit.client.0.smithi078.stdout:4/910: mknod d0/dc/d10/d1c/d60/dee/dc4/c130 0 2024-04-18T21:07:02.571 INFO:tasks.workunit.client.0.smithi078.stdout:4/911: stat d0/f50 0 2024-04-18T21:07:02.571 INFO:tasks.workunit.client.0.smithi078.stdout:6/833: dread d2/d74/f10c [0,4194304] 0 2024-04-18T21:07:02.571 INFO:tasks.workunit.client.0.smithi078.stdout:8/852: symlink d0/da8/l107 0 2024-04-18T21:07:02.572 INFO:tasks.workunit.client.0.smithi078.stdout:0/891: creat d0/d9/d4c/d6b/d9b/de5/f114 x:0 0 0 2024-04-18T21:07:02.572 INFO:tasks.workunit.client.0.smithi078.stdout:4/912: chown d0/dc/d10/c24 42 1 2024-04-18T21:07:02.572 INFO:tasks.workunit.client.0.smithi078.stdout:0/892: stat d0/d9/dd/d17/ff2 0 2024-04-18T21:07:02.572 INFO:tasks.workunit.client.0.smithi078.stdout:8/853: chown d0/d5c/d5a/dc6/fdf 8207754 1 2024-04-18T21:07:02.573 INFO:tasks.workunit.client.0.smithi078.stdout:0/893: creat d0/f115 x:0 0 0 2024-04-18T21:07:02.573 INFO:tasks.workunit.client.0.smithi078.stdout:0/894: rmdir d0/d9/d4c/d6b/dd3 39 2024-04-18T21:07:02.574 INFO:tasks.workunit.client.0.smithi078.stdout:0/895: rmdir d0 39 2024-04-18T21:07:02.576 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:07:02.576 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:07:02.576 INFO:tasks.workunit.client.0.smithi078.stdout:5/838: dread d9/d2e/f76 [4194304,4194304] 0 2024-04-18T21:07:02.576 INFO:tasks.workunit.client.0.smithi078.stdout:9/931: dread d7/d11/d2d/d26/f38 [0,4194304] 0 2024-04-18T21:07:02.577 INFO:teuthology.orchestra.run.smithi078.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-18T21:07:02.578 INFO:tasks.workunit.client.0.smithi078.stdout:5/839: rmdir d9/da/d90/d62 39 2024-04-18T21:07:02.579 INFO:tasks.workunit.client.0.smithi078.stdout:6/834: dwrite d2/d1c/f9b [4194304,4194304] 0 2024-04-18T21:07:02.580 INFO:tasks.workunit.client.0.smithi078.stdout:4/913: dwrite d0/dc/d10/d1c/d60/daf/f129 [0,4194304] 0 2024-04-18T21:07:02.582 INFO:tasks.workunit.client.0.smithi078.stdout:0/896: truncate d0/d9/da/db/d35/d3f/f41 544259 0 2024-04-18T21:07:02.583 INFO:tasks.workunit.client.0.smithi078.stdout:6/835: symlink d2/d1c/d63/d8b/l123 0 2024-04-18T21:07:02.585 INFO:tasks.workunit.client.0.smithi078.stdout:0/897: truncate d0/d9/da/f105 1000889 0 2024-04-18T21:07:02.586 INFO:tasks.workunit.client.0.smithi078.stdout:9/932: dwrite d7/d11/d2d/d26/d7c/dda/fbe [0,4194304] 0 2024-04-18T21:07:02.586 INFO:tasks.workunit.client.0.smithi078.stdout:5/840: dwrite d9/da/f35 [0,4194304] 0 2024-04-18T21:07:02.588 INFO:tasks.workunit.client.0.smithi078.stdout:0/898: write d0/d9/dd/d17/d2e/d31/f3b [373238,109212] 0 2024-04-18T21:07:02.588 INFO:tasks.workunit.client.0.smithi078.stdout:6/836: rename d2/d1c/d63/da1/dfc to d2/d1c/d3a/d124 0 2024-04-18T21:07:02.589 INFO:tasks.workunit.client.0.smithi078.stdout:4/914: dwrite d0/dc/d10/d1c/d6a/f108 [0,4194304] 0 2024-04-18T21:07:02.589 INFO:tasks.workunit.client.0.smithi078.stdout:9/933: rename d7/df/d54/d95/d9d/dd1/d10a/d3e/d5a/fab to d7/d11/d2d/d3f/db7/f147 0 2024-04-18T21:07:02.591 INFO:tasks.workunit.client.0.smithi078.stdout:9/934: symlink d7/d11/d2d/d3f/l148 0 2024-04-18T21:07:02.592 INFO:tasks.workunit.client.0.smithi078.stdout:4/915: creat d0/dc/d10/d41/d5f/f131 x:0 0 0 2024-04-18T21:07:02.593 INFO:tasks.workunit.client.0.smithi078.stdout:7/821: dread d1/d16/f26 [0,4194304] 0 2024-04-18T21:07:02.594 INFO:tasks.workunit.client.0.smithi078.stdout:4/916: symlink d0/dc/d10/d1c/d60/l132 0 2024-04-18T21:07:02.594 INFO:tasks.workunit.client.0.smithi078.stdout:9/935: mkdir d7/df/d54/d95/d9d/dd1/d10a/d3e/d5a/d149 0 2024-04-18T21:07:02.595 INFO:tasks.workunit.client.0.smithi078.stdout:7/822: chown d1/d16/dc/l30 0 1 2024-04-18T21:07:02.595 INFO:tasks.workunit.client.0.smithi078.stdout:5/841: dwrite d9/da/d8c/fa6 [0,4194304] 0 2024-04-18T21:07:02.596 INFO:tasks.workunit.client.0.smithi078.stdout:4/917: write d0/dc/d5b/d4f/f77 [2498211,111719] 0 2024-04-18T21:07:02.596 INFO:tasks.workunit.client.0.smithi078.stdout:9/936: chown d7/d11/d2d/d3f/db7/dfd/fac 11489 1 2024-04-18T21:07:02.596 INFO:tasks.workunit.client.0.smithi078.stdout:0/899: dwrite d0/d6c/f8a [4194304,4194304] 0 2024-04-18T21:07:02.596 INFO:tasks.workunit.client.0.smithi078.stdout:7/823: creat d1/d16/dc/f118 x:0 0 0 2024-04-18T21:07:02.597 INFO:tasks.workunit.client.0.smithi078.stdout:0/900: read - d0/d6c/f8c zero size 2024-04-18T21:07:02.598 INFO:tasks.workunit.client.0.smithi078.stdout:9/937: rename d7/df/f21 to d7/d11/d1b/d45/f14a 0 2024-04-18T21:07:02.599 INFO:tasks.workunit.client.0.smithi078.stdout:4/918: write d0/dc/d10/d1c/d60/dee/dc4/df3/fad [686641,40169] 0 2024-04-18T21:07:02.599 INFO:tasks.workunit.client.0.smithi078.stdout:0/901: write d0/d9/da/df/de3/ff1 [428678,130186] 0 2024-04-18T21:07:02.601 INFO:tasks.workunit.client.0.smithi078.stdout:2/837: dread d0/db/d18/d21/d27/d79/f7f [0,4194304] 0 2024-04-18T21:07:02.601 INFO:tasks.workunit.client.0.smithi078.stdout:7/824: rename d1/d16/dc/d11/da2/dbc/dc3/d10b to d1/d16/dc/d11/d53/d82/d119 0 2024-04-18T21:07:02.601 INFO:tasks.workunit.client.0.smithi078.stdout:4/919: mknod d0/dc/d10/db2/c133 0 2024-04-18T21:07:02.602 INFO:tasks.workunit.client.0.smithi078.stdout:6/837: read d2/d6/dd/f95 [601100,119235] 0 2024-04-18T21:07:02.603 INFO:tasks.workunit.client.0.smithi078.stdout:1/958: dread d0/d11/f2d [0,4194304] 0 2024-04-18T21:07:02.603 INFO:tasks.workunit.client.0.smithi078.stdout:4/920: write d0/dc/d10/d41/d5f/fb7 [2267931,98865] 0 2024-04-18T21:07:02.604 INFO:tasks.workunit.client.0.smithi078.stdout:6/838: read d2/d1c/d63/d8b/fb5 [495861,35748] 0 2024-04-18T21:07:02.605 INFO:tasks.workunit.client.0.smithi078.stdout:5/842: dwrite d9/d2e/f3d [0,4194304] 0 2024-04-18T21:07:02.608 INFO:tasks.workunit.client.0.smithi078.stdout:6/839: creat d2/d1c/d6b/dba/deb/d5d/f125 x:0 0 0 2024-04-18T21:07:02.608 INFO:tasks.workunit.client.0.smithi078.stdout:0/902: dwrite d0/d9/da/db/da6/f103 [0,4194304] 0 2024-04-18T21:07:02.608 INFO:tasks.workunit.client.0.smithi078.stdout:7/825: symlink d1/d16/dc/d11/da2/dbc/l11a 0 2024-04-18T21:07:02.609 INFO:tasks.workunit.client.0.smithi078.stdout:0/903: chown d0/d9/da/db/f4d 736996580 1 2024-04-18T21:07:02.609 INFO:tasks.workunit.client.0.smithi078.stdout:4/921: getdents d0 0 2024-04-18T21:07:02.609 INFO:tasks.workunit.client.0.smithi078.stdout:3/776: sync 2024-04-18T21:07:02.609 INFO:tasks.workunit.client.0.smithi078.stdout:8/854: sync 2024-04-18T21:07:02.609 INFO:tasks.workunit.client.0.smithi078.stdout:6/840: creat d2/d1f/f126 x:0 0 0 2024-04-18T21:07:02.610 INFO:tasks.workunit.client.0.smithi078.stdout:5/843: getdents d9/d9f/dd4/dee/def 0 2024-04-18T21:07:02.610 INFO:tasks.workunit.client.0.smithi078.stdout:6/841: unlink d2/fe 0 2024-04-18T21:07:02.610 INFO:tasks.workunit.client.0.smithi078.stdout:8/855: chown d0/d5c/d5a/f98 0 1 2024-04-18T21:07:02.610 INFO:tasks.workunit.client.0.smithi078.stdout:4/922: fsync d0/dc/d5b/f6f 0 2024-04-18T21:07:02.611 INFO:tasks.workunit.client.0.smithi078.stdout:3/777: fsync d4/d2d/d30/d35/d71/f9e 0 2024-04-18T21:07:02.611 INFO:tasks.workunit.client.0.smithi078.stdout:6/842: chown d2/d34/f56 119222 1 2024-04-18T21:07:02.612 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:07:02.612 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:07:02.612 INFO:tasks.workunit.client.0.smithi078.stdout:6/843: fsync d2/d1c/d3a/fd0 0 2024-04-18T21:07:02.613 INFO:tasks.workunit.client.0.smithi078.stdout:6/844: dread - d2/d1c/d63/d8b/fd1 zero size 2024-04-18T21:07:02.613 INFO:tasks.workunit.client.0.smithi078.stdout:2/838: dwrite d0/d87/f8a [0,4194304] 0 2024-04-18T21:07:02.616 INFO:tasks.workunit.client.0.smithi078.stdout:0/904: rename d0/d9/da/df/dde/cfe to d0/d9/dd/d17/d2e/c116 0 2024-04-18T21:07:02.616 INFO:tasks.workunit.client.0.smithi078.stdout:5/844: unlink d9/da/f1b 0 2024-04-18T21:07:02.616 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-18T21:07:02.617 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-18T21:07:02.617 INFO:tasks.workunit.client.0.smithi078.stdout:2/839: unlink d0/d87/d88/d98/db2/fe9 0 2024-04-18T21:07:02.617 INFO:tasks.workunit.client.0.smithi078.stdout:0/905: fdatasync d0/d9/da/df/fa0 0 2024-04-18T21:07:02.617 INFO:tasks.workunit.client.0.smithi078.stdout:5/845: mkdir d9/da/d3e/d4c/d6d/d86/d106 0 2024-04-18T21:07:02.618 INFO:tasks.workunit.client.0.smithi078.stdout:2/840: creat d0/d87/d88/d98/f104 x:0 0 0 2024-04-18T21:07:02.618 INFO:tasks.workunit.client.0.smithi078.stdout:5/846: creat d9/da/d3e/d4c/d6d/d75/f107 x:0 0 0 2024-04-18T21:07:02.619 INFO:tasks.workunit.client.0.smithi078.stdout:0/906: rename d0/d9/dd/d17/d2e/d7f/c49 to d0/d9/d4c/d6b/dd3/c117 0 2024-04-18T21:07:02.620 INFO:tasks.workunit.client.0.smithi078.stdout:0/907: chown d0/f5 31 1 2024-04-18T21:07:02.620 INFO:tasks.workunit.client.0.smithi078.stdout:5/847: mkdir d9/da/d3e/d4c/d6d/d73/d108 0 2024-04-18T21:07:02.621 INFO:tasks.workunit.client.0.smithi078.stdout:5/848: dread - d9/da/d8c/f102 zero size 2024-04-18T21:07:02.621 INFO:tasks.workunit.client.0.smithi078.stdout:0/908: creat d0/d9/d4c/d8f/db6/f118 x:0 0 0 2024-04-18T21:07:02.621 INFO:tasks.workunit.client.0.smithi078.stdout:4/923: dwrite d0/f50 [4194304,4194304] 0 2024-04-18T21:07:02.622 INFO:tasks.workunit.client.0.smithi078.stdout:5/849: creat d9/da/d32/f109 x:0 0 0 2024-04-18T21:07:02.622 INFO:tasks.workunit.client.0.smithi078.stdout:0/909: truncate d0/d9/f57 616547 0 2024-04-18T21:07:02.623 INFO:tasks.workunit.client.0.smithi078.stdout:5/850: getdents d9/da 0 2024-04-18T21:07:02.623 INFO:tasks.workunit.client.0.smithi078.stdout:0/910: creat d0/d9/d4c/d6b/dd3/f119 x:0 0 0 2024-04-18T21:07:02.623 INFO:tasks.workunit.client.0.smithi078.stdout:4/924: creat d0/dc/d10/d1c/d6a/d81/f134 x:0 0 0 2024-04-18T21:07:02.624 INFO:tasks.workunit.client.0.smithi078.stdout:5/851: unlink d9/f3c 0 2024-04-18T21:07:02.626 INFO:tasks.workunit.client.0.smithi078.stdout:0/911: mknod d0/d9/da/db/d35/d3f/c11a 0 2024-04-18T21:07:02.626 INFO:tasks.workunit.client.0.smithi078.stdout:5/852: mkdir d9/d2e/d10a 0 2024-04-18T21:07:02.627 INFO:tasks.workunit.client.0.smithi078.stdout:0/912: read - d0/f9a zero size 2024-04-18T21:07:02.630 INFO:tasks.workunit.client.0.smithi078.stdout:4/925: dwrite d0/dc/d10/d3a/f91 [4194304,4194304] 0 2024-04-18T21:07:02.634 INFO:tasks.workunit.client.0.smithi078.stdout:0/913: dwrite d0/d9/d4c/d8f/dc5/fc9 [0,4194304] 0 2024-04-18T21:07:02.635 INFO:tasks.workunit.client.0.smithi078.stdout:9/938: dread d7/d11/d2d/ff5 [0,4194304] 0 2024-04-18T21:07:02.637 INFO:tasks.workunit.client.0.smithi078.stdout:8/856: truncate d0/f1f 5170818 0 2024-04-18T21:07:02.638 INFO:tasks.workunit.client.0.smithi078.stdout:8/857: write d0/d10/d14/d2a/fb1 [4330001,24841] 0 2024-04-18T21:07:02.641 INFO:tasks.workunit.client.0.smithi078.stdout:8/858: truncate d0/d10/d60/d6f/f7a 4595978 0 2024-04-18T21:07:02.641 INFO:tasks.workunit.client.0.smithi078.stdout:0/914: dwrite d0/d9/da/fa4 [0,4194304] 0 2024-04-18T21:07:02.641 INFO:tasks.workunit.client.0.smithi078.stdout:1/959: dread d0/d2a/d5f/d89/f17 [0,4194304] 0 2024-04-18T21:07:02.641 INFO:tasks.workunit.client.0.smithi078.stdout:9/939: dread d7/d11/d2d/d26/d7c/f10c [0,4194304] 0 2024-04-18T21:07:02.641 INFO:tasks.workunit.client.0.smithi078.stdout:9/940: mknod d7/d11/d2d/d26/c14b 0 2024-04-18T21:07:02.642 INFO:tasks.workunit.client.0.smithi078.stdout:1/960: rmdir d0/d2a/d45/d121/d13a 39 2024-04-18T21:07:02.642 INFO:tasks.workunit.client.0.smithi078.stdout:8/859: mkdir d0/d10/d14/d2d/d93/da0/db5/de2/dfd/d108 0 2024-04-18T21:07:02.642 INFO:tasks.workunit.client.0.smithi078.stdout:0/915: getdents d0/d9/dd/d17/d2e/d7f/ddf 0 2024-04-18T21:07:02.643 INFO:tasks.workunit.client.0.smithi078.stdout:9/941: rename d7/d11/d2d/d3f/lb2 to d7/d83/l14c 0 2024-04-18T21:07:02.643 INFO:tasks.workunit.client.0.smithi078.stdout:8/860: unlink d0/d10/d14/d2a/d4a/db2/db6/fd9 0 2024-04-18T21:07:02.644 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:02.646+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:02.644 INFO:tasks.workunit.client.0.smithi078.stdout:9/942: write d7/df/d54/d95/d9d/dd1/d10a/d3e/f140 [215882,75746] 0 2024-04-18T21:07:02.644 INFO:tasks.workunit.client.0.smithi078.stdout:4/926: write d0/dc/d10/d1c/d6a/d81/dd4/f9d [593018,103079] 0 2024-04-18T21:07:02.645 INFO:tasks.workunit.client.0.smithi078.stdout:8/861: symlink d0/d10/d14/d2d/d93/da0/dc2/l109 0 2024-04-18T21:07:02.646 INFO:tasks.workunit.client.0.smithi078.stdout:9/943: unlink d7/df/fe9 0 2024-04-18T21:07:02.646 INFO:tasks.workunit.client.0.smithi078.stdout:8/862: chown d0/c1 127020656 1 2024-04-18T21:07:02.646 INFO:tasks.workunit.client.0.smithi078.stdout:9/944: mknod d7/d11/d47/c14d 0 2024-04-18T21:07:02.646 INFO:tasks.workunit.client.0.smithi078.stdout:8/863: unlink d0/d10/d60/d6f/fca 0 2024-04-18T21:07:02.648 INFO:tasks.workunit.client.0.smithi078.stdout:5/853: creat d9/da/d32/f10b x:0 0 0 2024-04-18T21:07:02.650 INFO:tasks.workunit.client.0.smithi078.stdout:4/927: truncate d0/f58 804766 0 2024-04-18T21:07:02.651 INFO:tasks.workunit.client.0.smithi078.stdout:4/928: symlink d0/dc/d10/d1c/d60/daf/l135 0 2024-04-18T21:07:02.654 INFO:tasks.workunit.client.0.smithi078.stdout:1/961: dwrite d0/d2a/d5f/d89/d32/f12e [0,4194304] 0 2024-04-18T21:07:02.655 INFO:tasks.workunit.client.0.smithi078.stdout:8/864: dwrite d0/d5c/d5a/f6c [0,4194304] 0 2024-04-18T21:07:02.655 INFO:tasks.workunit.client.0.smithi078.stdout:1/962: fsync d0/d2a/d45/d121/f135 0 2024-04-18T21:07:02.656 INFO:tasks.workunit.client.0.smithi078.stdout:5/854: dwrite d9/da/d3e/d4c/d67/f7b [0,4194304] 0 2024-04-18T21:07:02.657 INFO:tasks.workunit.client.0.smithi078.stdout:1/963: fdatasync d0/d2a/d5f/d89/dc2/d100/f139 0 2024-04-18T21:07:02.659 INFO:tasks.workunit.client.0.smithi078.stdout:4/929: getdents d0/dc/d10/d1c/d60/dee 0 2024-04-18T21:07:02.659 INFO:tasks.workunit.client.0.smithi078.stdout:8/865: creat d0/d10/d14/d2d/d93/da0/db5/d103/f10a x:0 0 0 2024-04-18T21:07:02.659 INFO:tasks.workunit.client.0.smithi078.stdout:1/964: unlink d0/d2a/ff2 0 2024-04-18T21:07:02.660 INFO:tasks.workunit.client.0.smithi078.stdout:8/866: mknod d0/d5c/c10b 0 2024-04-18T21:07:02.660 INFO:tasks.workunit.client.0.smithi078.stdout:4/930: write d0/dc/d29/f31 [3479243,59061] 0 2024-04-18T21:07:02.661 INFO:tasks.workunit.client.0.smithi078.stdout:3/778: dread d4/da/f92 [0,4194304] 0 2024-04-18T21:07:02.661 INFO:tasks.workunit.client.0.smithi078.stdout:4/931: readlink d0/dc/d29/d6d/d7b/ldd 0 2024-04-18T21:07:02.662 INFO:tasks.workunit.client.0.smithi078.stdout:1/965: link d0/dca/lce d0/d2a/d5f/d89/d7d/l13f 0 2024-04-18T21:07:02.663 INFO:tasks.workunit.client.0.smithi078.stdout:5/855: write d9/da/d32/f70 [987070,22084] 0 2024-04-18T21:07:02.663 INFO:tasks.workunit.client.0.smithi078.stdout:1/966: fdatasync d0/d11/f2d 0 2024-04-18T21:07:02.664 INFO:tasks.workunit.client.0.smithi078.stdout:1/967: write d0/d2a/d5f/d89/d32/db2/d10e/d50/d78/ff8 [4992243,28150] 0 2024-04-18T21:07:02.665 INFO:tasks.workunit.client.0.smithi078.stdout:1/968: unlink d0/d2a/d5f/d89/d32/db2/d10e/dc6/fdc 0 2024-04-18T21:07:02.666 INFO:tasks.workunit.client.0.smithi078.stdout:4/932: truncate d0/dc/d10/d1c/d60/d123/f80 2895975 0 2024-04-18T21:07:02.667 INFO:tasks.workunit.client.0.smithi078.stdout:4/933: link d0/dc/d10/db2/c133 d0/dc/dd7/c136 0 2024-04-18T21:07:02.668 INFO:tasks.workunit.client.0.smithi078.stdout:5/856: dwrite d9/da/d3e/d4c/fde [0,4194304] 0 2024-04-18T21:07:02.669 INFO:tasks.workunit.client.0.smithi078.stdout:5/857: symlink d9/da/d99/l10c 0 2024-04-18T21:07:02.671 INFO:tasks.workunit.client.0.smithi078.stdout:5/858: mknod d9/da/d3e/d4c/d6d/d73/ddf/c10d 0 2024-04-18T21:07:02.672 INFO:tasks.workunit.client.0.smithi078.stdout:6/845: dread d2/d34/f77 [0,4194304] 0 2024-04-18T21:07:02.673 INFO:tasks.workunit.client.0.smithi078.stdout:5/859: symlink d9/d9f/dd4/dee/def/dff/l10e 0 2024-04-18T21:07:02.673 INFO:tasks.workunit.client.0.smithi078.stdout:6/846: rmdir d2 39 2024-04-18T21:07:02.673 INFO:tasks.workunit.client.0.smithi078.stdout:8/867: read d0/d10/d60/d6f/f7f [2099078,102603] 0 2024-04-18T21:07:02.674 INFO:tasks.workunit.client.0.smithi078.stdout:1/969: truncate d0/d2a/d5f/fe4 174913 0 2024-04-18T21:07:02.674 INFO:tasks.workunit.client.0.smithi078.stdout:5/860: dread - d9/d2e/fd2 zero size 2024-04-18T21:07:02.675 INFO:tasks.workunit.client.0.smithi078.stdout:5/861: readlink d9/da/d3e/l52 0 2024-04-18T21:07:02.675 INFO:tasks.workunit.client.0.smithi078.stdout:4/934: dwrite d0/dc/d10/d3a/f91 [4194304,4194304] 0 2024-04-18T21:07:02.675 INFO:tasks.workunit.client.0.smithi078.stdout:1/970: mkdir d0/d2a/d5f/d89/d32/db2/d10e/d9b/d140 0 2024-04-18T21:07:02.678 INFO:tasks.workunit.client.0.smithi078.stdout:6/847: rename d2/d1c/d30/f3b to d2/d1c/d117/f127 0 2024-04-18T21:07:02.678 INFO:tasks.workunit.client.0.smithi078.stdout:4/935: chown d0/f58 13689 1 2024-04-18T21:07:02.678 INFO:tasks.workunit.client.0.smithi078.stdout:6/848: readlink d2/d1f/l76 0 2024-04-18T21:07:02.678 INFO:tasks.workunit.client.0.smithi078.stdout:4/936: mknod d0/dc/d5b/d4f/c137 0 2024-04-18T21:07:02.679 INFO:tasks.workunit.client.0.smithi078.stdout:6/849: rmdir d2/d1c/d3a/d124 39 2024-04-18T21:07:02.680 INFO:tasks.workunit.client.0.smithi078.stdout:4/937: write d0/dc/d10/d1c/d60/d123/fd6 [5077764,1059] 0 2024-04-18T21:07:02.680 INFO:tasks.workunit.client.0.smithi078.stdout:4/938: chown d0/l9a 9145362 1 2024-04-18T21:07:02.681 INFO:tasks.workunit.client.0.smithi078.stdout:4/939: creat d0/dc/d10/d1c/d110/f138 x:0 0 0 2024-04-18T21:07:02.681 INFO:tasks.workunit.client.0.smithi078.stdout:6/850: truncate d2/d34/d35/d57/f73 475504 0 2024-04-18T21:07:02.682 INFO:tasks.workunit.client.0.smithi078.stdout:4/940: write d0/dc/d10/d3a/f114 [3726189,101623] 0 2024-04-18T21:07:02.683 INFO:tasks.workunit.client.0.smithi078.stdout:5/862: dread d9/da/f13 [0,4194304] 0 2024-04-18T21:07:02.683 INFO:tasks.workunit.client.0.smithi078.stdout:4/941: chown d0/dc/d10/d1c/d60/dee/db8/f106 5789129 1 2024-04-18T21:07:02.684 INFO:tasks.workunit.client.0.smithi078.stdout:5/863: truncate d9/da/d3e/d4c/d6d/d75/dbc/fc5 954339 0 2024-04-18T21:07:02.687 INFO:tasks.workunit.client.0.smithi078.stdout:4/942: dread d0/dc/d10/d1c/d60/daf/f129 [0,4194304] 0 2024-04-18T21:07:02.688 INFO:tasks.workunit.client.0.smithi078.stdout:4/943: fsync d0/dc/d10/d1c/d60/dee/db8/f106 0 2024-04-18T21:07:02.689 INFO:tasks.workunit.client.0.smithi078.stdout:4/944: mkdir d0/dc/d10/d1c/d6a/d81/dd4/d139 0 2024-04-18T21:07:02.689 INFO:tasks.workunit.client.0.smithi078.stdout:4/945: chown d0/f58 7959549 1 2024-04-18T21:07:02.689 INFO:tasks.workunit.client.0.smithi078.stdout:0/916: dread d0/d9/da/df/fa0 [0,4194304] 0 2024-04-18T21:07:02.689 INFO:tasks.workunit.client.0.smithi078.stdout:4/946: read - d0/dc/dd7/d128/f12d zero size 2024-04-18T21:07:02.690 INFO:tasks.workunit.client.0.smithi078.stdout:8/868: truncate d0/d10/d14/f29 7203830 0 2024-04-18T21:07:02.690 INFO:tasks.workunit.client.0.smithi078.stdout:4/947: write d0/dc/fd2 [2931243,95319] 0 2024-04-18T21:07:02.691 INFO:tasks.workunit.client.0.smithi078.stdout:4/948: creat d0/dc/d10/d1c/d60/d123/dcb/f13a x:0 0 0 2024-04-18T21:07:02.691 INFO:tasks.workunit.client.0.smithi078.stdout:1/971: truncate d0/d2a/d5f/d89/f115 294099 0 2024-04-18T21:07:02.693 INFO:tasks.workunit.client.0.smithi078.stdout:1/972: mkdir d0/dca/d116/d141 0 2024-04-18T21:07:02.693 INFO:tasks.workunit.client.0.smithi078.stdout:6/851: write d2/d34/f77 [3174594,128236] 0 2024-04-18T21:07:02.694 INFO:tasks.workunit.client.0.smithi078.stdout:3/779: dread d4/f6a [0,4194304] 0 2024-04-18T21:07:02.694 INFO:tasks.workunit.client.0.smithi078.stdout:1/973: rename d0/d2a/d5f/d89/d32/db2/d10e/d50/d78/fed to d0/d2a/d45/d81/dc8/f142 0 2024-04-18T21:07:02.695 INFO:tasks.workunit.client.0.smithi078.stdout:3/780: write d4/d2d/d30/f48 [744668,28755] 0 2024-04-18T21:07:02.695 INFO:tasks.workunit.client.0.smithi078.stdout:1/974: creat d0/d2a/d3c/da8/de1/f143 x:0 0 0 2024-04-18T21:07:02.695 INFO:tasks.workunit.client.0.smithi078.stdout:5/864: truncate d9/d9f/dd4/dee/def/dc1/fe4 499446 0 2024-04-18T21:07:02.696 INFO:tasks.workunit.client.0.smithi078.stdout:1/975: readlink d0/d2a/d5f/d89/d32/d35/d71/leb 0 2024-04-18T21:07:02.696 INFO:tasks.workunit.client.0.smithi078.stdout:0/917: truncate d0/f5 3848859 0 2024-04-18T21:07:02.697 INFO:tasks.workunit.client.0.smithi078.stdout:3/781: rename d4/df/db0/dc5/f3a to d4/df/db0/ff4 0 2024-04-18T21:07:02.698 INFO:tasks.workunit.client.0.smithi078.stdout:0/918: read - d0/d9/d81/daa/f10c zero size 2024-04-18T21:07:02.699 INFO:tasks.workunit.client.0.smithi078.stdout:1/976: creat d0/d2a/d3c/d4b/f144 x:0 0 0 2024-04-18T21:07:02.699 INFO:tasks.workunit.client.0.smithi078.stdout:0/919: fdatasync d0/d9/dd/d17/dca/f108 0 2024-04-18T21:07:02.699 INFO:tasks.workunit.client.0.smithi078.stdout:3/782: fsync d4/d2d/d30/d35/f33 0 2024-04-18T21:07:02.699 INFO:tasks.workunit.client.0.smithi078.stdout:4/949: read d0/dc/fd2 [1593176,70425] 0 2024-04-18T21:07:02.700 INFO:tasks.workunit.client.0.smithi078.stdout:3/783: write d4/df/fa4 [102019,84704] 0 2024-04-18T21:07:02.700 INFO:tasks.workunit.client.0.smithi078.stdout:1/977: mkdir d0/de7/d145 0 2024-04-18T21:07:02.701 INFO:tasks.workunit.client.0.smithi078.stdout:3/784: chown d4/da/d76/f96 45493054 1 2024-04-18T21:07:02.702 INFO:tasks.workunit.client.0.smithi078.stdout:5/865: dwrite d9/da/d3e/d4c/fde [0,4194304] 0 2024-04-18T21:07:02.703 INFO:tasks.workunit.client.0.smithi078.stdout:1/978: getdents d0/d2a/d5f/d89/dc2/d100 0 2024-04-18T21:07:02.705 INFO:tasks.workunit.client.0.smithi078.stdout:3/785: creat d4/df/db0/dc5/d41/dda/de2/ff5 x:0 0 0 2024-04-18T21:07:02.707 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:07:02.707 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-18T21:07:02.707 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-18T21:07:02.708 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:07:02.708 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.708 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:02.708 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:07:02.708 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 117.092955473, 2024-04-18T21:07:02.708 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045668994999999997, 2024-04-18T21:07:02.708 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:02.708 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:02.708 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:02.708 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:02.708 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.708 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:02.708 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:07:02.708 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:02.709 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.709 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.709 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:02.709 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:07:02.709 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:02.709 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.709 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.709 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:02.709 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615459+0000", 2024-04-18T21:07:02.709 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5030000000000001e-06 2024-04-18T21:07:02.709 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.709 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.709 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:02.709 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615506+0000", 2024-04-18T21:07:02.709 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6872000000000001e-05 2024-04-18T21:07:02.710 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.710 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.710 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:02.710 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615527+0000", 2024-04-18T21:07:02.710 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0763000000000001e-05 2024-04-18T21:07:02.710 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.710 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.710 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:02.710 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615551+0000", 2024-04-18T21:07:02.710 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4159e-05 2024-04-18T21:07:02.710 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.710 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.710 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:02.710 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615736+0000", 2024-04-18T21:07:02.710 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018499599999999999 2024-04-18T21:07:02.711 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.711 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.711 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:07:02.711 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615748+0000", 2024-04-18T21:07:02.711 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2272999999999999e-05 2024-04-18T21:07:02.711 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.711 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.711 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:02.711 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635481+0000", 2024-04-18T21:07:02.711 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019732772999999999 2024-04-18T21:07:02.711 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.711 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.711 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:02.711 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635791+0000", 2024-04-18T21:07:02.711 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031013299999999998 2024-04-18T21:07:02.711 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.712 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.712 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:02.712 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636101+0000", 2024-04-18T21:07:02.712 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030943300000000002 2024-04-18T21:07:02.712 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.712 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.712 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:02.712 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646043+0000", 2024-04-18T21:07:02.712 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099428139999999995 2024-04-18T21:07:02.712 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.712 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.712 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:02.712 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660991+0000", 2024-04-18T21:07:02.712 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014947142 2024-04-18T21:07:02.712 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.712 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.713 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:02.713 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661061+0000", 2024-04-18T21:07:02.713 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0438000000000006e-05 2024-04-18T21:07:02.713 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.713 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.713 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:02.713 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661127+0000", 2024-04-18T21:07:02.713 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5696000000000003e-05 2024-04-18T21:07:02.713 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:02.713 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:02.713 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:02.713 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.713 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.713 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:02.714 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:07:02.714 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 117.09274304500001, 2024-04-18T21:07:02.714 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045745085999999997, 2024-04-18T21:07:02.714 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:02.714 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:02.714 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:02.714 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:02.714 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.714 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:02.714 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:07:02.714 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:02.714 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.714 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.714 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:02.715 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:07:02.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:02.715 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.715 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.715 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:02.715 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:07:02.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7400000000000001e-06 2024-04-18T21:07:02.715 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.715 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.715 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:02.715 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:07:02.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8133e-05 2024-04-18T21:07:02.715 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.715 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.716 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:02.716 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615726+0000", 2024-04-18T21:07:02.716 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6132e-05 2024-04-18T21:07:02.716 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.716 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.716 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:02.716 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615742+0000", 2024-04-18T21:07:02.716 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6157000000000001e-05 2024-04-18T21:07:02.716 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.716 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.716 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:02.716 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615937+0000", 2024-04-18T21:07:02.716 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000194768 2024-04-18T21:07:02.716 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.716 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.717 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:07:02.717 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615950+0000", 2024-04-18T21:07:02.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3084e-05 2024-04-18T21:07:02.717 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.717 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:02.717 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643676+0000", 2024-04-18T21:07:02.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027725639999999999 2024-04-18T21:07:02.717 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.717 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:02.717 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643867+0000", 2024-04-18T21:07:02.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019075900000000001 2024-04-18T21:07:02.717 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.717 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:02.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:07:02.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036013799999999997 2024-04-18T21:07:02.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:02.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646068+0000", 2024-04-18T21:07:02.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001841536 2024-04-18T21:07:02.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:02.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661184+0000", 2024-04-18T21:07:02.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015115458999999999 2024-04-18T21:07:02.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:02.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661283+0000", 2024-04-18T21:07:02.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9502999999999999e-05 2024-04-18T21:07:02.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.719 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:02.719 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661415+0000", 2024-04-18T21:07:02.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000132037 2024-04-18T21:07:02.719 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:02.719 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:02.719 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:02.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.719 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:101 3.1f 3:f83d65d8:::200.00000004:head [write 316455~1401 [fadvise_dontneed] in=1401b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:02.719 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:07:02.719 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 16.950679434000001, 2024-04-18T21:07:02.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.048270212999999999, 2024-04-18T21:07:02.719 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:02.720 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:02.720 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:02.720 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:02.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:02.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:07:02.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:02.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:02.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:07:02.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:02.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:02.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:07:02.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7700000000000004e-07 2024-04-18T21:07:02.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:02.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757745+0000", 2024-04-18T21:07:02.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0910000000000001e-05 2024-04-18T21:07:02.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:02.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757758+0000", 2024-04-18T21:07:02.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2593e-05 2024-04-18T21:07:02.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:02.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757765+0000", 2024-04-18T21:07:02.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1659999999999997e-06 2024-04-18T21:07:02.722 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.722 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.722 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:02.722 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.797782+0000", 2024-04-18T21:07:02.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.040017283000000001 2024-04-18T21:07:02.722 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.722 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.722 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:02.722 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.797949+0000", 2024-04-18T21:07:02.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016650399999999999 2024-04-18T21:07:02.722 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.722 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.722 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:02.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.798152+0000", 2024-04-18T21:07:02.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000203098 2024-04-18T21:07:02.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:02.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.800792+0000", 2024-04-18T21:07:02.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026394779999999998 2024-04-18T21:07:02.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:02.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805921+0000", 2024-04-18T21:07:02.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0051295519999999999 2024-04-18T21:07:02.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:02.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805967+0000", 2024-04-18T21:07:02.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5457000000000002e-05 2024-04-18T21:07:02.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.724 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:02.724 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806004+0000", 2024-04-18T21:07:02.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7494999999999999e-05 2024-04-18T21:07:02.724 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:02.724 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:02.724 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:02.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.724 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:102 3.1f 3:f83d65d8:::200.00000004:head [write 317856~1403 [fadvise_dontneed] in=1403b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:02.724 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757775+0000", 2024-04-18T21:07:02.724 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 16.950638368, 2024-04-18T21:07:02.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.048337705000000002, 2024-04-18T21:07:02.724 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:02.725 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:02.725 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:02.725 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:02.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:02.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757775+0000", 2024-04-18T21:07:02.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:02.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:02.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757775+0000", 2024-04-18T21:07:02.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:02.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:02.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757776+0000", 2024-04-18T21:07:02.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5300000000000004e-07 2024-04-18T21:07:02.726 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.726 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.726 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:02.726 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757780+0000", 2024-04-18T21:07:02.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2270000000000004e-06 2024-04-18T21:07:02.726 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.726 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.726 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:02.726 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757792+0000", 2024-04-18T21:07:02.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2696e-05 2024-04-18T21:07:02.726 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.726 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.726 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:02.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757800+0000", 2024-04-18T21:07:02.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1439999999999997e-06 2024-04-18T21:07:02.727 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:02.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.798773+0000", 2024-04-18T21:07:02.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.040973074999999998 2024-04-18T21:07:02.727 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:02.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.798990+0000", 2024-04-18T21:07:02.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000217161 2024-04-18T21:07:02.727 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:02.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.799173+0000", 2024-04-18T21:07:02.728 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018295900000000001 2024-04-18T21:07:02.728 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.728 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:02.728 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802469+0000", 2024-04-18T21:07:02.728 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032965350000000002 2024-04-18T21:07:02.728 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.728 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:02.728 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806042+0000", 2024-04-18T21:07:02.728 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035724630000000001 2024-04-18T21:07:02.728 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.728 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:02.728 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806077+0000", 2024-04-18T21:07:02.728 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4997999999999999e-05 2024-04-18T21:07:02.729 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.729 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:02.729 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806113+0000", 2024-04-18T21:07:02.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5794000000000003e-05 2024-04-18T21:07:02.729 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:02.729 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:02.729 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:02.729 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.729 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:103 3.1f 3:f83d65d8:::200.00000004:head [write 319259~1404 [fadvise_dontneed] in=1404b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:02.729 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:07:02.729 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 16.950604521999999, 2024-04-18T21:07:02.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.048414481000000002, 2024-04-18T21:07:02.729 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:02.729 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:02.730 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:02.730 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:02.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.730 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:02.730 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:07:02.730 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:02.730 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.730 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:02.730 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:07:02.730 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:02.730 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.730 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:02.730 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:07:02.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4700000000000001e-07 2024-04-18T21:07:02.731 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.731 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.731 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:02.731 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757814+0000", 2024-04-18T21:07:02.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1829999999999996e-06 2024-04-18T21:07:02.731 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.731 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.731 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:02.731 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757825+0000", 2024-04-18T21:07:02.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1754e-05 2024-04-18T21:07:02.731 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.731 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.731 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:02.731 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757832+0000", 2024-04-18T21:07:02.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8430000000000004e-06 2024-04-18T21:07:02.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.732 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:02.732 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.799809+0000", 2024-04-18T21:07:02.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.041976960000000001 2024-04-18T21:07:02.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.732 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:02.732 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.799934+0000", 2024-04-18T21:07:02.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000125053 2024-04-18T21:07:02.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.732 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:02.732 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.800067+0000", 2024-04-18T21:07:02.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013276299999999999 2024-04-18T21:07:02.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:02.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804582+0000", 2024-04-18T21:07:02.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0045148899999999997 2024-04-18T21:07:02.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:02.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806158+0000", 2024-04-18T21:07:02.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001575894 2024-04-18T21:07:02.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:02.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806189+0000", 2024-04-18T21:07:02.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1423000000000001e-05 2024-04-18T21:07:02.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.734 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:02.734 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806223+0000", 2024-04-18T21:07:02.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4071e-05 2024-04-18T21:07:02.734 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:02.734 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:02.734 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:02.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.734 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:104 3.1f 3:f83d65d8:::200.00000004:head [write 320663~1405 [fadvise_dontneed] in=1405b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:02.734 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757841+0000", 2024-04-18T21:07:02.734 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 16.950572317999999, 2024-04-18T21:07:02.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056381623999999998, 2024-04-18T21:07:02.735 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:02.735 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:02.735 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:02.735 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:02.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:02.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757841+0000", 2024-04-18T21:07:02.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:02.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:02.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757841+0000", 2024-04-18T21:07:02.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:02.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.736 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:02.736 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757842+0000", 2024-04-18T21:07:02.736 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5000000000000002e-07 2024-04-18T21:07:02.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.736 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:02.736 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757852+0000", 2024-04-18T21:07:02.736 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.084e-05 2024-04-18T21:07:02.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.736 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:02.736 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757865+0000", 2024-04-18T21:07:02.736 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2643000000000001e-05 2024-04-18T21:07:02.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.737 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:02.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757872+0000", 2024-04-18T21:07:02.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8689999999999998e-06 2024-04-18T21:07:02.737 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.737 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:02.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.801102+0000", 2024-04-18T21:07:02.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043229837 2024-04-18T21:07:02.737 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.737 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:02.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.801291+0000", 2024-04-18T21:07:02.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000189641 2024-04-18T21:07:02.737 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.738 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:02.738 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.801640+0000", 2024-04-18T21:07:02.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000348971 2024-04-18T21:07:02.738 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.738 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.738 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:02.738 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805849+0000", 2024-04-18T21:07:02.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042082739999999997 2024-04-18T21:07:02.738 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.738 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.738 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:02.738 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814135+0000", 2024-04-18T21:07:02.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0082867270000000007 2024-04-18T21:07:02.738 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:02.739 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814180+0000", 2024-04-18T21:07:02.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4982999999999999e-05 2024-04-18T21:07:02.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:02.739 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814223+0000", 2024-04-18T21:07:02.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2188999999999999e-05 2024-04-18T21:07:02.739 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:02.739 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:02.739 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:02.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.739 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:105 3.1f 3:f83d65d8:::200.00000004:head [write 322068~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:02.740 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:07:02.740 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 16.950531722000001, 2024-04-18T21:07:02.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056513678999999997, 2024-04-18T21:07:02.740 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:02.740 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:02.740 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:02.740 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:02.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.740 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:02.740 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:07:02.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:02.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.740 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:02.740 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:07:02.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:02.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:02.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:07:02.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2600000000000002e-07 2024-04-18T21:07:02.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:02.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757888+0000", 2024-04-18T21:07:02.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7130000000000002e-06 2024-04-18T21:07:02.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:02.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757906+0000", 2024-04-18T21:07:02.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7723999999999998e-05 2024-04-18T21:07:02.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.742 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:02.742 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757921+0000", 2024-04-18T21:07:02.742 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4936000000000001e-05 2024-04-18T21:07:02.742 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.742 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.742 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:02.742 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802493+0000", 2024-04-18T21:07:02.742 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.044571927999999997 2024-04-18T21:07:02.742 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.742 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.742 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:02.742 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802537+0000", 2024-04-18T21:07:02.742 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4449000000000001e-05 2024-04-18T21:07:02.742 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:02.743 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802605+0000", 2024-04-18T21:07:02.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7945000000000001e-05 2024-04-18T21:07:02.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:02.743 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805852+0000", 2024-04-18T21:07:02.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032469909999999999 2024-04-18T21:07:02.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:02.743 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814298+0000", 2024-04-18T21:07:02.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084463309999999996 2024-04-18T21:07:02.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.744 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:02.744 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814355+0000", 2024-04-18T21:07:02.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6459999999999998e-05 2024-04-18T21:07:02.744 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.744 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.744 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:02.744 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814395+0000", 2024-04-18T21:07:02.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0475999999999997e-05 2024-04-18T21:07:02.744 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:02.744 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:02.744 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:02.744 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.744 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.744 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:106 3.1f 3:f83d65d8:::200.00000004:head [write 323467~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:02.744 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757955+0000", 2024-04-18T21:07:02.744 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 16.950458492999999, 2024-04-18T21:07:02.745 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056539990999999998, 2024-04-18T21:07:02.745 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:02.745 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:02.745 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:02.745 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:02.745 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.745 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:02.745 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757955+0000", 2024-04-18T21:07:02.745 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:02.745 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.745 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.745 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:02.745 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757955+0000", 2024-04-18T21:07:02.745 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:02.745 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.745 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.745 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:02.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757956+0000", 2024-04-18T21:07:02.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.144e-06 2024-04-18T21:07:02.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:02.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757970+0000", 2024-04-18T21:07:02.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3899e-05 2024-04-18T21:07:02.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:02.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757988+0000", 2024-04-18T21:07:02.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8033000000000002e-05 2024-04-18T21:07:02.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:02.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758002+0000", 2024-04-18T21:07:02.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3973e-05 2024-04-18T21:07:02.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:02.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803072+0000", 2024-04-18T21:07:02.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045070194000000001 2024-04-18T21:07:02.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:02.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803125+0000", 2024-04-18T21:07:02.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3498000000000002e-05 2024-04-18T21:07:02.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.748 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:02.748 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803233+0000", 2024-04-18T21:07:02.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010704099999999999 2024-04-18T21:07:02.748 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.748 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:02.748 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805856+0000", 2024-04-18T21:07:02.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026233430000000002 2024-04-18T21:07:02.748 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.748 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:02.748 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814439+0000", 2024-04-18T21:07:02.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0085833839999999995 2024-04-18T21:07:02.749 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.749 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.749 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:02.749 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814469+0000", 2024-04-18T21:07:02.749 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9784000000000001e-05 2024-04-18T21:07:02.749 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.749 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.749 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:02.749 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814495+0000", 2024-04-18T21:07:02.749 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5698e-05 2024-04-18T21:07:02.749 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:02.749 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:02.749 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:02.749 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.749 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.750 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:107 3.1f 3:f83d65d8:::200.00000004:head [write 324866~1421 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:02.750 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758019+0000", 2024-04-18T21:07:02.750 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 16.950393866999999, 2024-04-18T21:07:02.750 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056580563, 2024-04-18T21:07:02.750 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:02.750 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:02.750 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:02.750 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:02.750 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.750 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:02.750 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758019+0000", 2024-04-18T21:07:02.750 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:02.750 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.750 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:02.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758019+0000", 2024-04-18T21:07:02.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:02.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:02.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758021+0000", 2024-04-18T21:07:02.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1999999999999999e-06 2024-04-18T21:07:02.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:02.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758028+0000", 2024-04-18T21:07:02.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7200000000000006e-06 2024-04-18T21:07:02.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.752 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:02.752 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758050+0000", 2024-04-18T21:07:02.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1877000000000001e-05 2024-04-18T21:07:02.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.752 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:02.752 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758064+0000", 2024-04-18T21:07:02.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.383e-05 2024-04-18T21:07:02.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.752 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:02.752 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803593+0000", 2024-04-18T21:07:02.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045528831999999998 2024-04-18T21:07:02.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.753 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:02.753 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803635+0000", 2024-04-18T21:07:02.753 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1980000000000001e-05 2024-04-18T21:07:02.753 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.753 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:02.753 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803703+0000", 2024-04-18T21:07:02.753 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8542999999999997e-05 2024-04-18T21:07:02.753 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.753 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:02.753 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806123+0000", 2024-04-18T21:07:02.753 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002419769 2024-04-18T21:07:02.753 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.754 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:02.754 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814542+0000", 2024-04-18T21:07:02.754 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084189460000000001 2024-04-18T21:07:02.754 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.754 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.754 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:02.754 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814576+0000", 2024-04-18T21:07:02.754 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3679000000000001e-05 2024-04-18T21:07:02.754 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.754 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.754 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:02.754 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814600+0000", 2024-04-18T21:07:02.754 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4187000000000001e-05 2024-04-18T21:07:02.754 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:02.754 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:02.755 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:02.755 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.755 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.755 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:108 3.1f 3:f83d65d8:::200.00000004:head [write 326287~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:02.755 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:07:02.755 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 16.950330697999998, 2024-04-18T21:07:02.755 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056616183, 2024-04-18T21:07:02.755 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:02.755 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:02.755 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:02.755 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:02.755 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.755 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:02.755 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:07:02.755 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:02.756 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.756 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:02.756 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:07:02.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:02.756 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.756 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:02.756 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758084+0000", 2024-04-18T21:07:02.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.124e-06 2024-04-18T21:07:02.756 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.756 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:02.756 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758100+0000", 2024-04-18T21:07:02.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6246e-05 2024-04-18T21:07:02.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.757 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.757 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:02.757 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758118+0000", 2024-04-18T21:07:02.757 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8267e-05 2024-04-18T21:07:02.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.757 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.757 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:02.757 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758134+0000", 2024-04-18T21:07:02.757 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5950000000000001e-05 2024-04-18T21:07:02.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.757 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.757 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:02.757 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803949+0000", 2024-04-18T21:07:02.758 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045815349999999998 2024-04-18T21:07:02.758 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.758 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.758 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:02.758 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804011+0000", 2024-04-18T21:07:02.758 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1044999999999996e-05 2024-04-18T21:07:02.758 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.758 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.758 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:02.758 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804128+0000", 2024-04-18T21:07:02.758 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117148 2024-04-18T21:07:02.758 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.758 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.758 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:02.759 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806794+0000", 2024-04-18T21:07:02.759 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002666692 2024-04-18T21:07:02.759 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.759 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:02.759 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814645+0000", 2024-04-18T21:07:02.759 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0078508880000000003 2024-04-18T21:07:02.759 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.759 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:02.759 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814678+0000", 2024-04-18T21:07:02.759 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3188999999999997e-05 2024-04-18T21:07:02.759 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.759 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:02.760 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814699+0000", 2024-04-18T21:07:02.760 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0284000000000001e-05 2024-04-18T21:07:02.760 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:02.760 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:02.760 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:02.760 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.760 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.760 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:109 3.1f 3:f83d65d8:::200.00000004:head [write 327693~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:02.760 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:07:02.760 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 16.950261331, 2024-04-18T21:07:02.760 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056621036999999999, 2024-04-18T21:07:02.760 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:02.760 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:02.760 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:02.761 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:02.761 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.761 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:02.761 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:07:02.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:02.761 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.761 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.761 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:02.761 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:07:02.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:02.761 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.761 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.761 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:02.761 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758153+0000", 2024-04-18T21:07:02.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1459999999999999e-06 2024-04-18T21:07:02.762 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.762 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.762 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:02.762 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758161+0000", 2024-04-18T21:07:02.762 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7999999999999999e-06 2024-04-18T21:07:02.762 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.762 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.762 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:02.762 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758179+0000", 2024-04-18T21:07:02.762 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7949999999999999e-05 2024-04-18T21:07:02.762 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.762 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.762 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:02.762 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758193+0000", 2024-04-18T21:07:02.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3773e-05 2024-04-18T21:07:02.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.763 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:02.763 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804632+0000", 2024-04-18T21:07:02.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.046439469999999997 2024-04-18T21:07:02.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.763 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:02.763 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804790+0000", 2024-04-18T21:07:02.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015784300000000001 2024-04-18T21:07:02.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.763 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:02.763 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805056+0000", 2024-04-18T21:07:02.764 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026652400000000003 2024-04-18T21:07:02.764 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.764 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.764 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:02.764 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.808959+0000", 2024-04-18T21:07:02.764 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003903077 2024-04-18T21:07:02.764 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.764 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.764 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:02.764 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814728+0000", 2024-04-18T21:07:02.764 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0057682489999999996 2024-04-18T21:07:02.764 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.764 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.764 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:02.764 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814754+0000", 2024-04-18T21:07:02.765 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6673999999999999e-05 2024-04-18T21:07:02.765 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.765 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.765 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:02.765 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814773+0000", 2024-04-18T21:07:02.765 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8530999999999999e-05 2024-04-18T21:07:02.765 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:02.765 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:02.765 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:02.765 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.765 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.765 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:110 3.1f 3:f83d65d8:::200.00000004:head [write 329098~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:02.765 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:07:02.765 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 16.950202921999999, 2024-04-18T21:07:02.765 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056669113, 2024-04-18T21:07:02.765 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:02.766 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:02.766 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:02.766 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:02.766 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.766 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:02.766 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:07:02.766 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:02.766 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.766 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.766 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:02.766 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:07:02.766 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:02.766 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.766 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.766 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:02.767 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758212+0000", 2024-04-18T21:07:02.767 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:07:02.767 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.767 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.767 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:02.767 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758219+0000", 2024-04-18T21:07:02.767 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4229999999999999e-06 2024-04-18T21:07:02.767 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.767 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.767 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:02.767 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758237+0000", 2024-04-18T21:07:02.767 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7966999999999999e-05 2024-04-18T21:07:02.767 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.767 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.768 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:02.768 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758252+0000", 2024-04-18T21:07:02.768 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5322999999999999e-05 2024-04-18T21:07:02.768 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.768 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.768 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:02.768 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805536+0000", 2024-04-18T21:07:02.768 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.047283861000000003 2024-04-18T21:07:02.768 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.768 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.768 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:02.768 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805579+0000", 2024-04-18T21:07:02.768 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2738999999999999e-05 2024-04-18T21:07:02.768 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.768 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.769 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:02.769 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805649+0000", 2024-04-18T21:07:02.769 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0213e-05 2024-04-18T21:07:02.769 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.769 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.769 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:02.769 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.808966+0000", 2024-04-18T21:07:02.769 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033166129999999999 2024-04-18T21:07:02.769 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.769 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.769 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:02.769 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814812+0000", 2024-04-18T21:07:02.769 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0058463589999999998 2024-04-18T21:07:02.769 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.769 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.770 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:02.770 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814854+0000", 2024-04-18T21:07:02.770 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1618e-05 2024-04-18T21:07:02.770 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.770 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.770 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:02.770 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814879+0000", 2024-04-18T21:07:02.770 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5754000000000001e-05 2024-04-18T21:07:02.770 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:02.770 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:02.770 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:02.770 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.770 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.770 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:111 3.1f 3:f83d65d8:::200.00000004:head [write 330499~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:02.771 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:07:02.771 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 16.950141945999999, 2024-04-18T21:07:02.771 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058693793000000001, 2024-04-18T21:07:02.771 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:02.771 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:02.771 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:02.771 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:02.771 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.771 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:02.771 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:07:02.771 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:02.771 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.771 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.772 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:02.772 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:07:02.772 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:02.772 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.772 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.772 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:02.772 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758272+0000", 2024-04-18T21:07:02.772 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1200000000000001e-06 2024-04-18T21:07:02.772 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.772 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.772 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:02.772 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758287+0000", 2024-04-18T21:07:02.772 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5017e-05 2024-04-18T21:07:02.772 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.773 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.773 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:02.773 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758309+0000", 2024-04-18T21:07:02.773 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1866e-05 2024-04-18T21:07:02.773 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.773 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.773 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:02.773 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758323+0000", 2024-04-18T21:07:02.773 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3606e-05 2024-04-18T21:07:02.773 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.773 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.773 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:02.773 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806279+0000", 2024-04-18T21:07:02.773 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.047956061000000001 2024-04-18T21:07:02.773 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.773 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.774 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:02.774 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806350+0000", 2024-04-18T21:07:02.774 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1070999999999998e-05 2024-04-18T21:07:02.774 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.774 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.774 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:02.774 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806459+0000", 2024-04-18T21:07:02.774 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000108606 2024-04-18T21:07:02.774 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.774 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.774 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:02.774 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.809774+0000", 2024-04-18T21:07:02.774 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003314881 2024-04-18T21:07:02.774 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.774 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.775 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:02.775 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816910+0000", 2024-04-18T21:07:02.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0071367760000000001 2024-04-18T21:07:02.775 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.775 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.775 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:02.775 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816941+0000", 2024-04-18T21:07:02.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0846000000000002e-05 2024-04-18T21:07:02.775 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.775 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.775 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:02.775 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816965+0000", 2024-04-18T21:07:02.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3943000000000001e-05 2024-04-18T21:07:02.775 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:02.775 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:02.776 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:02.776 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.776 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.776 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:5230 4.17 4:eb2cc4c4:::1000000184c.00000000:head [write 0~2191] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-18T21:07:02.776 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.760650+0000", 2024-04-18T21:07:02.776 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 16.947762775000001, 2024-04-18T21:07:02.776 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.054210577000000003, 2024-04-18T21:07:02.776 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:02.776 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:02.776 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:02.776 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:07:02.776 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:07:02.776 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:02.776 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 5230 2024-04-18T21:07:02.776 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.776 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:02.777 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.777 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:02.777 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760650+0000", 2024-04-18T21:07:02.777 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:02.777 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.777 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.777 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:02.777 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760650+0000", 2024-04-18T21:07:02.777 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:02.777 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.777 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.777 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:02.777 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760653+0000", 2024-04-18T21:07:02.777 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0829999999999998e-06 2024-04-18T21:07:02.778 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.778 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.778 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:02.778 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760664+0000", 2024-04-18T21:07:02.778 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.111e-05 2024-04-18T21:07:02.778 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.778 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.778 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:02.778 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760688+0000", 2024-04-18T21:07:02.778 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4837e-05 2024-04-18T21:07:02.778 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.778 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.778 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:02.778 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760702+0000", 2024-04-18T21:07:02.779 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3723000000000001e-05 2024-04-18T21:07:02.779 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.779 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.779 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:02.779 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806264+0000", 2024-04-18T21:07:02.779 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045562182 2024-04-18T21:07:02.779 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.779 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.779 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:02.779 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806351+0000", 2024-04-18T21:07:02.779 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6322000000000005e-05 2024-04-18T21:07:02.779 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.779 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.779 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:02.779 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806453+0000", 2024-04-18T21:07:02.779 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000102602 2024-04-18T21:07:02.779 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:02.780 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.808972+0000", 2024-04-18T21:07:02.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025184090000000001 2024-04-18T21:07:02.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:02.780 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814798+0000", 2024-04-18T21:07:02.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0058266689999999996 2024-04-18T21:07:02.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:02.780 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814839+0000", 2024-04-18T21:07:02.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0482000000000003e-05 2024-04-18T21:07:02.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.781 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:02.781 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814861+0000", 2024-04-18T21:07:02.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2158e-05 2024-04-18T21:07:02.781 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:02.781 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:02.781 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:02.781 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.781 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.781 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:112 3.1f 3:f83d65d8:::200.00000004:head [write 331898~20167 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:02.781 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.771321+0000", 2024-04-18T21:07:02.781 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 16.937092148000001, 2024-04-18T21:07:02.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045740306000000001, 2024-04-18T21:07:02.781 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:02.781 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:02.781 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:02.781 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:02.781 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.782 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:02.782 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771321+0000", 2024-04-18T21:07:02.782 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:02.782 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.782 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.782 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:02.782 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771321+0000", 2024-04-18T21:07:02.782 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:02.782 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.782 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.782 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:02.782 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771323+0000", 2024-04-18T21:07:02.782 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3740000000000001e-06 2024-04-18T21:07:02.782 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.782 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.783 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:02.783 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771359+0000", 2024-04-18T21:07:02.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5447999999999997e-05 2024-04-18T21:07:02.783 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.783 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.783 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:02.783 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771388+0000", 2024-04-18T21:07:02.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8915e-05 2024-04-18T21:07:02.783 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.783 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.783 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:02.783 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771410+0000", 2024-04-18T21:07:02.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1899000000000002e-05 2024-04-18T21:07:02.783 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.783 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.783 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:02.784 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806827+0000", 2024-04-18T21:07:02.784 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.035417063999999998 2024-04-18T21:07:02.784 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.784 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.784 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:02.784 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806873+0000", 2024-04-18T21:07:02.784 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6261999999999999e-05 2024-04-18T21:07:02.784 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.784 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.784 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:02.784 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806946+0000", 2024-04-18T21:07:02.784 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3205000000000001e-05 2024-04-18T21:07:02.784 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.784 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.784 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:02.785 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.809781+0000", 2024-04-18T21:07:02.785 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002834937 2024-04-18T21:07:02.785 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.785 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.785 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:02.785 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817003+0000", 2024-04-18T21:07:02.785 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0072217959999999999 2024-04-18T21:07:02.785 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.785 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.785 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:02.785 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817038+0000", 2024-04-18T21:07:02.785 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4696999999999997e-05 2024-04-18T21:07:02.785 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.785 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.785 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:02.786 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817061+0000", 2024-04-18T21:07:02.786 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3708999999999999e-05 2024-04-18T21:07:02.786 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:02.786 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:02.786 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:02.786 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.786 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.786 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:113 3.1f 3:f83d65d8:::200.00000004:head [write 352065~3878 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:02.786 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.771472+0000", 2024-04-18T21:07:02.786 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 16.936941411999999, 2024-04-18T21:07:02.786 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045689726, 2024-04-18T21:07:02.786 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:02.786 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:02.787 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:02.787 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:02.787 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.787 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:02.787 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771472+0000", 2024-04-18T21:07:02.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:02.787 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.787 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.787 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:02.787 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771472+0000", 2024-04-18T21:07:02.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:02.787 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.787 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.787 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:02.787 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771473+0000", 2024-04-18T21:07:02.788 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3829999999999999e-06 2024-04-18T21:07:02.788 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:02.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771489+0000", 2024-04-18T21:07:02.788 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5797000000000001e-05 2024-04-18T21:07:02.788 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:02.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771509+0000", 2024-04-18T21:07:02.788 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0401999999999999e-05 2024-04-18T21:07:02.788 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:02.789 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771525+0000", 2024-04-18T21:07:02.789 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5099999999999999e-05 2024-04-18T21:07:02.789 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.789 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.789 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:02.789 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807273+0000", 2024-04-18T21:07:02.789 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.035748488000000002 2024-04-18T21:07:02.789 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.789 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.789 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:02.789 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807343+0000", 2024-04-18T21:07:02.789 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0277000000000005e-05 2024-04-18T21:07:02.789 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.789 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.789 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:02.790 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807455+0000", 2024-04-18T21:07:02.790 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011171999999999999 2024-04-18T21:07:02.790 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.790 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.790 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:02.790 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.811509+0000", 2024-04-18T21:07:02.790 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0040543469999999998 2024-04-18T21:07:02.790 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.790 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.790 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:02.790 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817115+0000", 2024-04-18T21:07:02.790 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0056054520000000004 2024-04-18T21:07:02.790 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.790 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.790 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:02.791 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817142+0000", 2024-04-18T21:07:02.791 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7430999999999999e-05 2024-04-18T21:07:02.791 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.791 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.791 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:02.791 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817162+0000", 2024-04-18T21:07:02.791 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9329000000000001e-05 2024-04-18T21:07:02.791 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:02.791 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:02.791 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:02.791 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.791 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.791 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:114 3.1f 3:f83d65d8:::200.00000004:head [write 355943~1928 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:02.791 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.771785+0000", 2024-04-18T21:07:02.791 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 16.936628067000001, 2024-04-18T21:07:02.792 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045480532999999997, 2024-04-18T21:07:02.792 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:02.792 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:02.792 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:02.792 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:02.792 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.792 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:02.792 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771785+0000", 2024-04-18T21:07:02.792 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:02.792 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.792 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.792 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:02.792 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771785+0000", 2024-04-18T21:07:02.792 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:02.792 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.792 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.793 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:02.793 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771787+0000", 2024-04-18T21:07:02.793 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0600000000000002e-06 2024-04-18T21:07:02.793 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.793 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.793 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:02.793 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771799+0000", 2024-04-18T21:07:02.793 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1503e-05 2024-04-18T21:07:02.793 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.793 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.793 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:02.793 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771829+0000", 2024-04-18T21:07:02.793 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.04e-05 2024-04-18T21:07:02.793 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.793 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.794 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:02.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771846+0000", 2024-04-18T21:07:02.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6608000000000001e-05 2024-04-18T21:07:02.794 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.794 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.794 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:02.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807856+0000", 2024-04-18T21:07:02.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036010480999999997 2024-04-18T21:07:02.794 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.794 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.794 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:02.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807899+0000", 2024-04-18T21:07:02.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2775999999999998e-05 2024-04-18T21:07:02.794 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.795 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:02.795 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807966+0000", 2024-04-18T21:07:02.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6793999999999998e-05 2024-04-18T21:07:02.795 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.795 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:02.795 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.811516+0000", 2024-04-18T21:07:02.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035497300000000001 2024-04-18T21:07:02.795 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.795 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:02.795 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817194+0000", 2024-04-18T21:07:02.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0056787030000000002 2024-04-18T21:07:02.796 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.796 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.796 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:02.796 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817231+0000", 2024-04-18T21:07:02.796 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6727000000000003e-05 2024-04-18T21:07:02.796 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.796 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.796 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:02.796 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817266+0000", 2024-04-18T21:07:02.796 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4751e-05 2024-04-18T21:07:02.796 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:02.796 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:02.796 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:02.796 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.796 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.797 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:11950 4.6 4:62753dda:::10000003222.00000000:head [write 3145728~1048576] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:02.797 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:59.346083+0000", 2024-04-18T21:07:02.797 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.3623301840000002, 2024-04-18T21:07:02.797 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.051281119999999999, 2024-04-18T21:07:02.797 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:02.797 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:02.797 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:02.797 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:07:02.797 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:07:02.797 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:02.797 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 11950 2024-04-18T21:07:02.797 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.797 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:02.797 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.798 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:02.798 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.346083+0000", 2024-04-18T21:07:02.798 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:02.798 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.798 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:02.798 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.346083+0000", 2024-04-18T21:07:02.798 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:02.798 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.798 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:02.798 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.346085+0000", 2024-04-18T21:07:02.798 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.736e-06 2024-04-18T21:07:02.798 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:02.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.349991+0000", 2024-04-18T21:07:02.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0039062960000000001 2024-04-18T21:07:02.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:02.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.350006+0000", 2024-04-18T21:07:02.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5327000000000001e-05 2024-04-18T21:07:02.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:02.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.350016+0000", 2024-04-18T21:07:02.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3570000000000004e-06 2024-04-18T21:07:02.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.800 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.800 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:02.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.360724+0000", 2024-04-18T21:07:02.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010708153999999999 2024-04-18T21:07:02.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.800 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.800 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:02.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.360839+0000", 2024-04-18T21:07:02.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000114877 2024-04-18T21:07:02.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.800 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.800 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:02.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.397285+0000", 2024-04-18T21:07:02.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036445957000000001 2024-04-18T21:07:02.801 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.801 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.801 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:02.801 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.397316+0000", 2024-04-18T21:07:02.801 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0926000000000002e-05 2024-04-18T21:07:02.801 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.801 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.801 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:02.801 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.397364+0000", 2024-04-18T21:07:02.801 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8489999999999998e-05 2024-04-18T21:07:02.801 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:02.801 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:02.801 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:02.801 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.801 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.801 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:12225 4.11 4:8acd30ee:::100000031ed.00000000:head [write 0~4194304 [2@86041]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:02.802 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:59.667090+0000", 2024-04-18T21:07:02.802 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.0413235689999998, 2024-04-18T21:07:02.802 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.047400059000000001, 2024-04-18T21:07:02.802 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:02.802 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:02.802 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:02.802 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:07:02.802 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:07:02.802 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:02.802 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 12225 2024-04-18T21:07:02.802 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.802 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:02.802 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.802 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:02.803 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.667090+0000", 2024-04-18T21:07:02.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:02.803 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.803 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:02.803 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.667090+0000", 2024-04-18T21:07:02.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:02.803 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.803 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:02.803 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.667091+0000", 2024-04-18T21:07:02.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3629999999999999e-06 2024-04-18T21:07:02.803 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.803 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:02.803 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.674492+0000", 2024-04-18T21:07:02.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0074007789999999997 2024-04-18T21:07:02.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.804 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:02.804 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.674508+0000", 2024-04-18T21:07:02.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6509999999999999e-05 2024-04-18T21:07:02.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.804 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:02.804 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.674518+0000", 2024-04-18T21:07:02.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.6290000000000005e-06 2024-04-18T21:07:02.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.804 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:02.804 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.674584+0000", 2024-04-18T21:07:02.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5597000000000002e-05 2024-04-18T21:07:02.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.805 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.805 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:02.805 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.674659+0000", 2024-04-18T21:07:02.805 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5168999999999998e-05 2024-04-18T21:07:02.805 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.805 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.805 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:02.805 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.674775+0000", 2024-04-18T21:07:02.805 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000116069 2024-04-18T21:07:02.805 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.805 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.805 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:02.805 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.685336+0000", 2024-04-18T21:07:02.805 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010561022999999999 2024-04-18T21:07:02.805 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.805 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.805 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:02.806 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.714413+0000", 2024-04-18T21:07:02.806 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.029077306000000001 2024-04-18T21:07:02.806 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.806 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.806 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:02.806 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.714455+0000", 2024-04-18T21:07:02.806 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1547e-05 2024-04-18T21:07:02.806 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.806 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.806 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:02.806 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.714490+0000", 2024-04-18T21:07:02.806 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5067000000000002e-05 2024-04-18T21:07:02.806 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:02.806 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:02.807 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:02.807 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.807 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.807 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:12689 4.26 4:64a7f444:::100000033e5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:02.807 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:00.208067+0000", 2024-04-18T21:07:02.807 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 2.5003465299999998, 2024-04-18T21:07:02.807 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066681457, 2024-04-18T21:07:02.807 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:02.807 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:02.807 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:02.807 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:07:02.807 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:07:02.807 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:02.807 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 12689 2024-04-18T21:07:02.807 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.807 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:02.807 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:02.808 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.208067+0000", 2024-04-18T21:07:02.808 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:02.808 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.808 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:02.808 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.208067+0000", 2024-04-18T21:07:02.808 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:02.808 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.808 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:02.808 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.208069+0000", 2024-04-18T21:07:02.808 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1500000000000002e-06 2024-04-18T21:07:02.808 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.808 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:02.809 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216162+0000", 2024-04-18T21:07:02.809 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0080933159999999997 2024-04-18T21:07:02.809 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.809 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:02.809 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216181+0000", 2024-04-18T21:07:02.809 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8573e-05 2024-04-18T21:07:02.809 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.809 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:02.809 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216192+0000", 2024-04-18T21:07:02.809 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0767999999999999e-05 2024-04-18T21:07:02.809 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.809 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:02.810 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216259+0000", 2024-04-18T21:07:02.810 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7977000000000003e-05 2024-04-18T21:07:02.810 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.810 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.810 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:02.810 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216635+0000", 2024-04-18T21:07:02.810 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00037591300000000002 2024-04-18T21:07:02.810 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.810 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.810 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:02.810 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216929+0000", 2024-04-18T21:07:02.810 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00029314800000000002 2024-04-18T21:07:02.810 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.811 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.811 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:02.811 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.232918+0000", 2024-04-18T21:07:02.811 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015989903 2024-04-18T21:07:02.811 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.811 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.811 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:02.811 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.274643+0000", 2024-04-18T21:07:02.811 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.041724281000000002 2024-04-18T21:07:02.811 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.811 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.811 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:02.811 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.274701+0000", 2024-04-18T21:07:02.811 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8304999999999998e-05 2024-04-18T21:07:02.811 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:02.812 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:02.812 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:02.812 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.274748+0000", 2024-04-18T21:07:02.812 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7123000000000003e-05 2024-04-18T21:07:02.812 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:02.812 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:02.812 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:02.812 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:02.812 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:02.812 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:07:02.814 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:02.814+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:02.815 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:07:02.829 INFO:tasks.workunit.client.0.smithi078.stdout:8/869: dwrite d0/d10/d14/f29 [4194304,4194304] 0 2024-04-18T21:07:02.829 INFO:tasks.workunit.client.0.smithi078.stdout:0/920: dwrite d0/d6c/f9e [0,4194304] 0 2024-04-18T21:07:02.829 INFO:tasks.workunit.client.0.smithi078.stdout:4/950: dwrite d0/dc/d5b/fae [0,4194304] 0 2024-04-18T21:07:02.829 INFO:tasks.workunit.client.0.smithi078.stdout:8/870: creat d0/d10/d8d/f10c x:0 0 0 2024-04-18T21:07:02.829 INFO:tasks.workunit.client.0.smithi078.stdout:0/921: write d0/d9/da/df/de3/f109 [683234,15886] 0 2024-04-18T21:07:02.829 INFO:tasks.workunit.client.0.smithi078.stdout:0/922: read - d0/dc7/f113 zero size 2024-04-18T21:07:02.829 INFO:tasks.workunit.client.0.smithi078.stdout:5/866: dwrite d9/da/d3e/d4c/f5a [0,4194304] 0 2024-04-18T21:07:02.829 INFO:tasks.workunit.client.0.smithi078.stdout:1/979: dwrite d0/d2a/d45/d81/dc8/ffb [0,4194304] 0 2024-04-18T21:07:02.829 INFO:tasks.workunit.client.0.smithi078.stdout:3/786: dwrite d4/df/db0/ff4 [0,4194304] 0 2024-04-18T21:07:02.830 INFO:tasks.workunit.client.0.smithi078.stdout:4/951: chown d0/dc/d10/d1c/d6a/d81/dd4/f115 476 1 2024-04-18T21:07:02.830 INFO:tasks.workunit.client.0.smithi078.stdout:8/871: creat d0/d10/d14/d2a/d4a/db2/db6/f10d x:0 0 0 2024-04-18T21:07:02.830 INFO:tasks.workunit.client.0.smithi078.stdout:0/923: symlink d0/d9/d81/l11b 0 2024-04-18T21:07:02.830 INFO:tasks.workunit.client.0.smithi078.stdout:5/867: mknod d9/c10f 0 2024-04-18T21:07:02.830 INFO:tasks.workunit.client.0.smithi078.stdout:5/868: fsync d9/da/f35 0 2024-04-18T21:07:02.830 INFO:tasks.workunit.client.0.smithi078.stdout:4/952: truncate d0/dc/d10/d1c/d60/dee/dc4/ff4 1047498 0 2024-04-18T21:07:02.830 INFO:tasks.workunit.client.0.smithi078.stdout:3/787: rename d4/df/fab to d4/da/ddf/dc4/ff6 0 2024-04-18T21:07:02.830 INFO:tasks.workunit.client.0.smithi078.stdout:5/869: symlink d9/da/d8c/daf/l110 0 2024-04-18T21:07:02.830 INFO:tasks.workunit.client.0.smithi078.stdout:4/953: link d0/dc/d10/d1c/d60/d123/c9f d0/dc/d10/d1c/d6a/c13b 0 2024-04-18T21:07:02.830 INFO:tasks.workunit.client.0.smithi078.stdout:3/788: readlink d4/da/ddf/lbb 0 2024-04-18T21:07:02.830 INFO:tasks.workunit.client.0.smithi078.stdout:3/789: write d4/df/f98 [3346992,3110] 0 2024-04-18T21:07:02.830 INFO:tasks.workunit.client.0.smithi078.stdout:5/870: rename d9/da/d3e/d4c/d67/d7c/c5f to d9/d2e/d65/c111 0 2024-04-18T21:07:02.830 INFO:tasks.workunit.client.0.smithi078.stdout:8/872: dwrite d0/d10/d14/f29 [0,4194304] 0 2024-04-18T21:07:02.830 INFO:tasks.workunit.client.0.smithi078.stdout:3/790: creat d4/da/d5e/de0/ff7 x:0 0 0 2024-04-18T21:07:02.830 INFO:tasks.workunit.client.0.smithi078.stdout:0/924: dwrite d0/d9/dd/d17/d2e/d7f/ff3 [0,4194304] 0 2024-04-18T21:07:02.831 INFO:tasks.workunit.client.0.smithi078.stdout:5/871: fsync d9/da/d3e/d4c/d67/f7b 0 2024-04-18T21:07:02.831 INFO:tasks.workunit.client.0.smithi078.stdout:8/873: chown d0/d10/d14/d2d/l34 830 1 2024-04-18T21:07:02.831 INFO:tasks.workunit.client.0.smithi078.stdout:0/925: truncate d0/d9/dd/d17/d2e/f71 362013 0 2024-04-18T21:07:02.831 INFO:tasks.workunit.client.0.smithi078.stdout:5/872: link d9/da/de7/fb0 d9/da/d3e/d4c/d67/d7c/dfd/f112 0 2024-04-18T21:07:02.831 INFO:tasks.workunit.client.0.smithi078.stdout:7/826: sync 2024-04-18T21:07:02.831 INFO:tasks.workunit.client.0.smithi078.stdout:5/873: creat d9/da/d3e/d4c/d67/d7c/f113 x:0 0 0 2024-04-18T21:07:02.831 INFO:tasks.workunit.client.0.smithi078.stdout:8/874: creat d0/d10/d14/d2d/d93/f10e x:0 0 0 2024-04-18T21:07:02.831 INFO:tasks.workunit.client.0.smithi078.stdout:8/875: mknod d0/d10/d14/d2a/c10f 0 2024-04-18T21:07:02.831 INFO:tasks.workunit.client.0.smithi078.stdout:8/876: chown d0/d10/d14/d2d/d93/da0/db5/dd2/fc7 0 1 2024-04-18T21:07:02.831 INFO:tasks.workunit.client.0.smithi078.stdout:3/791: dwrite d4/f64 [0,4194304] 0 2024-04-18T21:07:02.831 INFO:tasks.workunit.client.0.smithi078.stdout:8/877: rename d0/d10/d60/d6f/dba to d0/d5c/d110 0 2024-04-18T21:07:02.831 INFO:tasks.workunit.client.0.smithi078.stdout:3/792: write d4/d2d/d6c/fcb [5735781,49582] 0 2024-04-18T21:07:02.831 INFO:tasks.workunit.client.0.smithi078.stdout:8/878: dread - d0/d5c/d5a/fc1 zero size 2024-04-18T21:07:02.831 INFO:tasks.workunit.client.0.smithi078.stdout:3/793: unlink d4/da/d11/cd2 0 2024-04-18T21:07:02.831 INFO:tasks.workunit.client.0.smithi078.stdout:8/879: mknod d0/d10/d14/d2a/d4a/db2/c111 0 2024-04-18T21:07:02.831 INFO:tasks.workunit.client.0.smithi078.stdout:3/794: fdatasync d4/df/fcf 0 2024-04-18T21:07:02.832 INFO:tasks.workunit.client.0.smithi078.stdout:3/795: dwrite d4/da/f81 [0,4194304] 0 2024-04-18T21:07:02.832 INFO:tasks.workunit.client.0.smithi078.stdout:0/926: dread d0/d9/dd/d17/ff2 [0,4194304] 0 2024-04-18T21:07:02.832 INFO:tasks.workunit.client.0.smithi078.stdout:0/927: fdatasync d0/d15/f5f 0 2024-04-18T21:07:02.832 INFO:tasks.workunit.client.0.smithi078.stdout:0/928: fdatasync d0/d9/d58/f6d 0 2024-04-18T21:07:02.832 INFO:tasks.workunit.client.0.smithi078.stdout:4/954: dread d0/dc/d29/d2f/f61 [0,4194304] 0 2024-04-18T21:07:02.832 INFO:tasks.workunit.client.0.smithi078.stdout:5/874: dread d9/da/d3e/d4c/d67/f91 [0,4194304] 0 2024-04-18T21:07:02.832 INFO:tasks.workunit.client.0.smithi078.stdout:0/929: rename d0/d9/da/db/da6/fc6 to d0/d9/d4c/d8f/dc5/dd2/f11c 0 2024-04-18T21:07:02.832 INFO:tasks.workunit.client.0.smithi078.stdout:5/875: truncate d9/da/d3e/d4c/d6d/d75/f107 983245 0 2024-04-18T21:07:02.832 INFO:tasks.workunit.client.0.smithi078.stdout:4/955: truncate d0/dc/d10/f32 1338662 0 2024-04-18T21:07:02.832 INFO:tasks.workunit.client.0.smithi078.stdout:4/956: mkdir d0/dc/d10/d1c/d6a/d81/dd4/d10c/d13c 0 2024-04-18T21:07:02.832 INFO:tasks.workunit.client.0.smithi078.stdout:0/930: rename d0/d6c/f9e to d0/d9/d4c/d6b/d9b/f11d 0 2024-04-18T21:07:02.832 INFO:tasks.workunit.client.0.smithi078.stdout:5/876: link d9/da/d3e/d4c/d6d/d75/dbc/fc5 d9/d9f/dd4/dee/def/f114 0 2024-04-18T21:07:02.832 INFO:tasks.workunit.client.0.smithi078.stdout:3/796: dwrite d4/f64 [4194304,4194304] 0 2024-04-18T21:07:02.832 INFO:tasks.workunit.client.0.smithi078.stdout:3/797: truncate d4/d2d/d30/f9f 4432593 0 2024-04-18T21:07:02.833 INFO:tasks.workunit.client.0.smithi078.stdout:3/798: readlink d4/d2d/d30/d84/lc1 0 2024-04-18T21:07:02.833 INFO:tasks.workunit.client.0.smithi078.stdout:4/957: creat d0/dc/d5b/d71/dcf/f13d x:0 0 0 2024-04-18T21:07:02.833 INFO:tasks.workunit.client.0.smithi078.stdout:0/931: creat d0/d9/dd/d17/d2e/f11e x:0 0 0 2024-04-18T21:07:02.833 INFO:tasks.workunit.client.0.smithi078.stdout:0/932: write d0/d9/fe6 [4611963,28786] 0 2024-04-18T21:07:02.833 INFO:tasks.workunit.client.0.smithi078.stdout:5/877: mknod d9/d9f/dd4/dee/def/dc1/c115 0 2024-04-18T21:07:02.833 INFO:tasks.workunit.client.0.smithi078.stdout:3/799: creat d4/d2d/d30/d35/d71/ff8 x:0 0 0 2024-04-18T21:07:02.833 INFO:tasks.workunit.client.0.smithi078.stdout:5/878: rmdir d9/da/d3e/d4c 39 2024-04-18T21:07:02.833 INFO:tasks.workunit.client.0.smithi078.stdout:5/879: dread - d9/f64 zero size 2024-04-18T21:07:02.833 INFO:tasks.workunit.client.0.smithi078.stdout:5/880: dread d9/da/d3e/d4c/d67/f7b [0,4194304] 0 2024-04-18T21:07:02.833 INFO:tasks.workunit.client.0.smithi078.stdout:5/881: write d9/da/d4b/d8b/fc9 [2721895,24205] 0 2024-04-18T21:07:02.833 INFO:tasks.workunit.client.0.smithi078.stdout:4/958: truncate d0/dc/d10/d41/d5f/fb7 3471016 0 2024-04-18T21:07:02.833 INFO:tasks.workunit.client.0.smithi078.stdout:7/827: dread d1/f3c [0,4194304] 0 2024-04-18T21:07:02.833 INFO:tasks.workunit.client.0.smithi078.stdout:4/959: rmdir d0/dc/d10/db2 39 2024-04-18T21:07:02.833 INFO:tasks.workunit.client.0.smithi078.stdout:7/828: fsync d1/d16/dc/d4b/fe5 0 2024-04-18T21:07:02.834 INFO:tasks.workunit.client.0.smithi078.stdout:3/800: dread d4/d2d/d30/d35/d4b/f65 [0,4194304] 0 2024-04-18T21:07:02.834 INFO:tasks.workunit.client.0.smithi078.stdout:4/960: getdents d0/dc/d10/d41 0 2024-04-18T21:07:02.834 INFO:tasks.workunit.client.0.smithi078.stdout:0/933: read d0/d9/f2d [4351673,37793] 0 2024-04-18T21:07:02.834 INFO:tasks.workunit.client.0.smithi078.stdout:7/829: write d1/d16/dc/d11/f2e [847732,57776] 0 2024-04-18T21:07:02.834 INFO:tasks.workunit.client.0.smithi078.stdout:3/801: chown d4/da/d76/f96 11 1 2024-04-18T21:07:02.834 INFO:tasks.workunit.client.0.smithi078.stdout:4/961: creat d0/dc/d5b/d71/f13e x:0 0 0 2024-04-18T21:07:02.834 INFO:tasks.workunit.client.0.smithi078.stdout:0/934: creat d0/d9/d58/f11f x:0 0 0 2024-04-18T21:07:02.834 INFO:tasks.workunit.client.0.smithi078.stdout:7/830: chown d1/d16/d10/d7c/d7e/d97/cd2 2639227 1 2024-04-18T21:07:02.834 INFO:tasks.workunit.client.0.smithi078.stdout:4/962: creat d0/dc/d10/db2/f13f x:0 0 0 2024-04-18T21:07:02.834 INFO:tasks.workunit.client.0.smithi078.stdout:0/935: creat d0/d9/da/db/d35/d3f/da2/f120 x:0 0 0 2024-04-18T21:07:02.834 INFO:tasks.workunit.client.0.smithi078.stdout:7/831: rmdir d1/d16/dc/d11/da2/dbc/dc3 39 2024-04-18T21:07:02.834 INFO:tasks.workunit.client.0.smithi078.stdout:5/882: dwrite d9/d2e/f9e [0,4194304] 0 2024-04-18T21:07:02.834 INFO:tasks.workunit.client.0.smithi078.stdout:7/832: mknod d1/d16/c11b 0 2024-04-18T21:07:02.835 INFO:tasks.workunit.client.0.smithi078.stdout:7/833: write d1/d16/d10/f13 [5667474,38942] 0 2024-04-18T21:07:02.835 INFO:tasks.workunit.client.0.smithi078.stdout:7/834: chown d1/d16/d1c/f114 58 1 2024-04-18T21:07:02.835 INFO:tasks.workunit.client.0.smithi078.stdout:4/963: read d0/dc/d10/ff5 [234422,98644] 0 2024-04-18T21:07:02.835 INFO:tasks.workunit.client.0.smithi078.stdout:7/835: unlink d1/f5e 0 2024-04-18T21:07:02.835 INFO:tasks.workunit.client.0.smithi078.stdout:4/964: creat d0/dc/d29/d2f/f140 x:0 0 0 2024-04-18T21:07:02.835 INFO:tasks.workunit.client.0.smithi078.stdout:4/965: chown d0/dc/d10/d1c/d6a/d81/dd4/la8 52 1 2024-04-18T21:07:02.835 INFO:tasks.workunit.client.0.smithi078.stdout:7/836: creat d1/d16/d1c/f11c x:0 0 0 2024-04-18T21:07:02.835 INFO:tasks.workunit.client.0.smithi078.stdout:4/966: symlink d0/dc/d10/d1c/d60/dee/dc4/d12e/l141 0 2024-04-18T21:07:02.835 INFO:tasks.workunit.client.0.smithi078.stdout:7/837: chown d1/d16/dc/d11/d53/d82/da4/db5/d91/db4/ddc/ff2 128277 1 2024-04-18T21:07:02.835 INFO:tasks.workunit.client.0.smithi078.stdout:4/967: fsync d0/dc/d10/d1c/d110/f138 0 2024-04-18T21:07:02.835 INFO:tasks.workunit.client.0.smithi078.stdout:5/883: dwrite d9/da/d3e/d4c/d67/fd0 [0,4194304] 0 2024-04-18T21:07:02.835 INFO:tasks.workunit.client.0.smithi078.stdout:4/968: fdatasync d0/dc/d10/d1c/d6a/d81/dd4/fda 0 2024-04-18T21:07:02.835 INFO:tasks.workunit.client.0.smithi078.stdout:1/980: dread d0/d2a/d5f/d89/d32/db2/d10e/f38 [0,4194304] 0 2024-04-18T21:07:02.835 INFO:tasks.workunit.client.0.smithi078.stdout:1/981: creat d0/d2a/d5f/d89/dc2/d100/f146 x:0 0 0 2024-04-18T21:07:02.835 INFO:tasks.workunit.client.0.smithi078.stdout:1/982: fsync d0/d2a/d5f/d89/d32/db2/d10e/f44 0 2024-04-18T21:07:02.835 INFO:tasks.workunit.client.0.smithi078.stdout:1/983: write d0/d2a/d5f/d89/dc2/f9d [884799,84143] 0 2024-04-18T21:07:02.836 INFO:tasks.workunit.client.0.smithi078.stdout:1/984: write d0/d2a/d5f/d89/d32/f92 [1514309,89496] 0 2024-04-18T21:07:02.836 INFO:tasks.workunit.client.0.smithi078.stdout:5/884: dread d9/d9f/dd4/dee/def/f114 [0,4194304] 0 2024-04-18T21:07:02.836 INFO:tasks.workunit.client.0.smithi078.stdout:1/985: creat d0/d2a/d5f/d89/d32/db2/d10e/d50/d78/f147 x:0 0 0 2024-04-18T21:07:02.836 INFO:tasks.workunit.client.0.smithi078.stdout:4/969: write d0/dc/d10/f32 [821950,48497] 0 2024-04-18T21:07:02.836 INFO:tasks.workunit.client.0.smithi078.stdout:5/885: creat d9/da/d8c/f116 x:0 0 0 2024-04-18T21:07:02.836 INFO:tasks.workunit.client.0.smithi078.stdout:1/986: chown d0/d2a/d5f/d89/d32/db2/lbd 5460 1 2024-04-18T21:07:02.836 INFO:tasks.workunit.client.0.smithi078.stdout:4/970: write d0/dc/d29/f31 [1375836,19167] 0 2024-04-18T21:07:02.836 INFO:tasks.workunit.client.0.smithi078.stdout:5/886: fdatasync d9/da/d3e/d4c/d67/d7c/d78/fbb 0 2024-04-18T21:07:02.836 INFO:tasks.workunit.client.0.smithi078.stdout:1/987: mknod d0/d2a/d5f/d89/d32/db2/db9/c148 0 2024-04-18T21:07:02.836 INFO:tasks.workunit.client.0.smithi078.stdout:5/887: link d9/l2a d9/da/d99/l117 0 2024-04-18T21:07:02.836 INFO:tasks.workunit.client.0.smithi078.stdout:5/888: mkdir d9/da/d90/deb/d118 0 2024-04-18T21:07:02.836 INFO:tasks.workunit.client.0.smithi078.stdout:5/889: chown d9/da/d4b/f4e 242 1 2024-04-18T21:07:02.836 INFO:tasks.workunit.client.0.smithi078.stdout:4/971: dread d0/dc/d5b/fae [0,4194304] 0 2024-04-18T21:07:02.836 INFO:tasks.workunit.client.0.smithi078.stdout:4/972: dread - d0/dc/d5b/d71/dcf/f13d zero size 2024-04-18T21:07:02.836 INFO:tasks.workunit.client.0.smithi078.stdout:1/988: dwrite d0/d11/f7f [0,4194304] 0 2024-04-18T21:07:02.836 INFO:tasks.workunit.client.0.smithi078.stdout:4/973: dwrite d0/dc/d5b/f119 [0,4194304] 0 2024-04-18T21:07:02.837 INFO:tasks.workunit.client.0.smithi078.stdout:4/974: unlink d0/dc/d29/d6d/ff1 0 2024-04-18T21:07:02.837 INFO:tasks.workunit.client.0.smithi078.stdout:4/975: rmdir d0/dc/d5b/d71 39 2024-04-18T21:07:02.837 INFO:tasks.workunit.client.0.smithi078.stdout:1/989: truncate d0/d2a/d5f/d89/d32/db2/d10e/d50/d78/f110 1604390 0 2024-04-18T21:07:02.837 INFO:tasks.workunit.client.0.smithi078.stdout:4/976: write d0/dc/d10/d1c/d110/f76 [2580052,63932] 0 2024-04-18T21:07:02.837 INFO:tasks.workunit.client.0.smithi078.stdout:5/890: dread d9/da/d4b/fa8 [0,4194304] 0 2024-04-18T21:07:02.837 INFO:tasks.workunit.client.0.smithi078.stdout:4/977: creat d0/dc/d10/d1c/d6a/d81/d11e/f142 x:0 0 0 2024-04-18T21:07:02.837 INFO:tasks.workunit.client.0.smithi078.stdout:5/891: write d9/da/ff [4913316,43885] 0 2024-04-18T21:07:02.837 INFO:tasks.workunit.client.0.smithi078.stdout:4/978: write d0/dc/d29/f122 [342500,67738] 0 2024-04-18T21:07:02.837 INFO:tasks.workunit.client.0.smithi078.stdout:5/892: rmdir d9/da/d32/da5 39 2024-04-18T21:07:02.837 INFO:tasks.workunit.client.0.smithi078.stdout:4/979: unlink d0/dc/d5b/d71/l93 0 2024-04-18T21:07:02.837 INFO:tasks.workunit.client.0.smithi078.stdout:5/893: mknod d9/da/d3e/d4c/db1/c119 0 2024-04-18T21:07:02.837 INFO:tasks.workunit.client.0.smithi078.stdout:4/980: truncate d0/dc/d10/ff5 706173 0 2024-04-18T21:07:02.837 INFO:tasks.workunit.client.0.smithi078.stdout:5/894: rename d9/da/d3e/d4c/d67/fb2 to d9/da/d3e/d4c/d6d/d86/f11a 0 2024-04-18T21:07:02.837 INFO:tasks.workunit.client.0.smithi078.stdout:6/852: sync 2024-04-18T21:07:02.837 INFO:tasks.workunit.client.0.smithi078.stdout:2/841: sync 2024-04-18T21:07:02.838 INFO:tasks.workunit.client.0.smithi078.stdout:9/945: sync 2024-04-18T21:07:02.838 INFO:tasks.workunit.client.0.smithi078.stdout:9/946: mkdir d7/d11/d2d/d3f/db7/dd7/d14e 0 2024-04-18T21:07:02.838 INFO:tasks.workunit.client.0.smithi078.stdout:2/842: truncate d0/db/d65/d96/fa7 4505680 0 2024-04-18T21:07:02.838 INFO:tasks.workunit.client.0.smithi078.stdout:1/990: dread d0/dc1/f101 [0,4194304] 0 2024-04-18T21:07:02.838 INFO:tasks.workunit.client.0.smithi078.stdout:4/981: dwrite d0/dc/d10/d3a/f114 [0,4194304] 0 2024-04-18T21:07:02.838 INFO:tasks.workunit.client.0.smithi078.stdout:9/947: chown d7/d11/d80/f107 30 1 2024-04-18T21:07:02.838 INFO:tasks.workunit.client.0.smithi078.stdout:6/853: link d2/d74/ld3 d2/d34/d35/d57/d90/l128 0 2024-04-18T21:07:02.838 INFO:tasks.workunit.client.0.smithi078.stdout:5/895: dwrite d9/da/d3e/d4c/d67/fd0 [0,4194304] 0 2024-04-18T21:07:02.838 INFO:tasks.workunit.client.0.smithi078.stdout:6/854: fdatasync d2/d6/dd/f68 0 2024-04-18T21:07:02.838 INFO:tasks.workunit.client.0.smithi078.stdout:4/982: mkdir d0/dc/d5b/d71/dcf/d143 0 2024-04-18T21:07:02.838 INFO:tasks.workunit.client.0.smithi078.stdout:5/896: fdatasync d9/da/d32/f10b 0 2024-04-18T21:07:02.838 INFO:tasks.workunit.client.0.smithi078.stdout:6/855: creat d2/d6/dea/df4/f129 x:0 0 0 2024-04-18T21:07:02.838 INFO:tasks.workunit.client.0.smithi078.stdout:5/897: chown d9/d9f/dd4/dee/def/dc1/fe4 123 1 2024-04-18T21:07:02.838 INFO:tasks.workunit.client.0.smithi078.stdout:5/898: write d9/da/d3e/d4c/db1/ffe [469232,120520] 0 2024-04-18T21:07:02.839 INFO:tasks.workunit.client.0.smithi078.stdout:6/856: read d2/d1c/d63/da0/f112 [1566589,56974] 0 2024-04-18T21:07:02.839 INFO:tasks.workunit.client.0.smithi078.stdout:5/899: rename d9/da/d3e/d4c/d6d/d75/dbc to d9/da/d4b/d11b 0 2024-04-18T21:07:02.839 INFO:tasks.workunit.client.0.smithi078.stdout:6/857: creat d2/d34/f12a x:0 0 0 2024-04-18T21:07:02.839 INFO:tasks.workunit.client.0.smithi078.stdout:4/983: dwrite d0/fc3 [0,4194304] 0 2024-04-18T21:07:02.839 INFO:tasks.workunit.client.0.smithi078.stdout:6/858: getdents d2/d1c/d6b/dba/deb 0 2024-04-18T21:07:02.839 INFO:tasks.workunit.client.0.smithi078.stdout:6/859: write d2/d34/f56 [982499,56077] 0 2024-04-18T21:07:02.839 INFO:tasks.workunit.client.0.smithi078.stdout:4/984: write d0/dc/d10/d3a/f40 [85935,107732] 0 2024-04-18T21:07:02.839 INFO:tasks.workunit.client.0.smithi078.stdout:4/985: fdatasync d0/dc/d29/d2f/f140 0 2024-04-18T21:07:02.839 INFO:tasks.workunit.client.0.smithi078.stdout:6/860: write d2/d1c/db3/dbb/ffb [234906,25282] 0 2024-04-18T21:07:02.839 INFO:tasks.workunit.client.0.smithi078.stdout:6/861: creat d2/d34/f12b x:0 0 0 2024-04-18T21:07:02.839 INFO:tasks.workunit.client.0.smithi078.stdout:4/986: rmdir d0/dc/d10/d41/d5f 39 2024-04-18T21:07:02.839 INFO:tasks.workunit.client.0.smithi078.stdout:6/862: chown d2/d34/d35/c37 5512 1 2024-04-18T21:07:02.839 INFO:tasks.workunit.client.0.smithi078.stdout:5/900: dwrite d9/f34 [0,4194304] 0 2024-04-18T21:07:02.839 INFO:tasks.workunit.client.0.smithi078.stdout:4/987: write d0/dc/d10/d3a/f91 [430346,27919] 0 2024-04-18T21:07:02.839 INFO:tasks.workunit.client.0.smithi078.stdout:4/988: truncate d0/dc/d10/db2/f13f 22842 0 2024-04-18T21:07:02.839 INFO:tasks.workunit.client.0.smithi078.stdout:5/901: write d9/d2e/d65/de8/ff4 [429828,37963] 0 2024-04-18T21:07:02.840 INFO:tasks.workunit.client.0.smithi078.stdout:6/863: dwrite d2/d6/dea/df4/f129 [0,4194304] 0 2024-04-18T21:07:02.840 INFO:tasks.workunit.client.0.smithi078.stdout:9/948: read d7/df/d54/d95/d9d/dd1/d10a/d3e/d5a/f5e [1961272,111416] 0 2024-04-18T21:07:02.840 INFO:tasks.workunit.client.0.smithi078.stdout:6/864: dwrite d2/d6/dd/f68 [0,4194304] 0 2024-04-18T21:07:02.840 INFO:tasks.workunit.client.0.smithi078.stdout:9/949: creat d7/df/d54/d115/f14f x:0 0 0 2024-04-18T21:07:02.840 INFO:tasks.workunit.client.0.smithi078.stdout:9/950: rmdir d7/df/d88 39 2024-04-18T21:07:02.840 INFO:tasks.workunit.client.0.smithi078.stdout:6/865: write d2/d34/d35/f40 [2424138,18126] 0 2024-04-18T21:07:02.840 INFO:tasks.workunit.client.0.smithi078.stdout:9/951: readlink d7/d11/d1b/l25 0 2024-04-18T21:07:02.840 INFO:tasks.workunit.client.0.smithi078.stdout:6/866: creat d2/d1c/d63/f12c x:0 0 0 2024-04-18T21:07:02.840 INFO:tasks.workunit.client.0.smithi078.stdout:9/952: creat d7/d11/d2d/d3f/db7/dd7/dde/f150 x:0 0 0 2024-04-18T21:07:02.841 INFO:tasks.workunit.client.0.smithi078.stdout:2/843: dread d0/db/d18/d5d/fb5 [0,4194304] 0 2024-04-18T21:07:02.841 INFO:tasks.workunit.client.0.smithi078.stdout:2/844: mknod d0/db/d18/d21/d27/d70/c105 0 2024-04-18T21:07:02.842 INFO:tasks.workunit.client.0.smithi078.stdout:2/845: readlink d0/db/d18/d5d/l100 0 2024-04-18T21:07:02.842 INFO:tasks.workunit.client.0.smithi078.stdout:9/953: dwrite d7/d11/d2d/d26/f64 [0,4194304] 0 2024-04-18T21:07:02.842 INFO:tasks.workunit.client.0.smithi078.stdout:9/954: readlink d7/df/dc0/l103 0 2024-04-18T21:07:02.842 INFO:tasks.workunit.client.0.smithi078.stdout:9/955: symlink d7/d11/d2d/d26/d12f/l151 0 2024-04-18T21:07:02.842 INFO:tasks.workunit.client.0.smithi078.stdout:6/867: dwrite d2/d1f/f2c [0,4194304] 0 2024-04-18T21:07:02.842 INFO:tasks.workunit.client.0.smithi078.stdout:2/846: dwrite d0/d1f/f7e [8388608,4194304] 0 2024-04-18T21:07:02.842 INFO:tasks.workunit.client.0.smithi078.stdout:2/847: readlink d0/d1f/laa 0 2024-04-18T21:07:02.842 INFO:tasks.workunit.client.0.smithi078.stdout:2/848: chown d0/f5 0 1 2024-04-18T21:07:02.842 INFO:tasks.workunit.client.0.smithi078.stdout:8/880: sync 2024-04-18T21:07:02.842 INFO:tasks.workunit.client.0.smithi078.stdout:0/936: sync 2024-04-18T21:07:02.842 INFO:tasks.workunit.client.0.smithi078.stdout:3/802: sync 2024-04-18T21:07:02.842 INFO:tasks.workunit.client.0.smithi078.stdout:7/838: sync 2024-04-18T21:07:02.842 INFO:tasks.workunit.client.0.smithi078.stdout:5/902: sync 2024-04-18T21:07:02.843 INFO:tasks.workunit.client.0.smithi078.stdout:3/803: stat d4/da/f79 0 2024-04-18T21:07:02.843 INFO:tasks.workunit.client.0.smithi078.stdout:8/881: read d0/d5c/d5a/f6c [290181,89424] 0 2024-04-18T21:07:02.844 INFO:tasks.workunit.client.0.smithi078.stdout:0/937: mknod d0/d15/c121 0 2024-04-18T21:07:02.844 INFO:tasks.workunit.client.0.smithi078.stdout:5/903: creat d9/d9f/dd4/dee/def/f11c x:0 0 0 2024-04-18T21:07:02.845 INFO:tasks.workunit.client.0.smithi078.stdout:3/804: unlink l3 0 2024-04-18T21:07:02.845 INFO:tasks.workunit.client.0.smithi078.stdout:2/849: mkdir d0/db/d18/dbb/dde/d106 0 2024-04-18T21:07:02.845 INFO:tasks.workunit.client.0.smithi078.stdout:8/882: dread - d0/d10/d14/d2a/d4a/fa1 zero size 2024-04-18T21:07:02.845 INFO:tasks.workunit.client.0.smithi078.stdout:7/839: creat d1/d16/dc/d11/d53/d82/da4/f11d x:0 0 0 2024-04-18T21:07:02.845 INFO:tasks.workunit.client.0.smithi078.stdout:0/938: mkdir d0/d9/d81/d122 0 2024-04-18T21:07:02.846 INFO:tasks.workunit.client.0.smithi078.stdout:2/850: mknod d0/d1f/d34/dd5/c107 0 2024-04-18T21:07:02.846 INFO:tasks.workunit.client.0.smithi078.stdout:6/868: getdents d2/d1c/d6b/dba/deb/d5d 0 2024-04-18T21:07:02.846 INFO:tasks.workunit.client.0.smithi078.stdout:0/939: rmdir d0/d9/d7d 39 2024-04-18T21:07:02.847 INFO:tasks.workunit.client.0.smithi078.stdout:2/851: dread - d0/db/d18/d21/d27/d70/fb9 zero size 2024-04-18T21:07:02.847 INFO:tasks.workunit.client.0.smithi078.stdout:7/840: mkdir d1/d16/dc/d11/d53/d82/dfe/d11e 0 2024-04-18T21:07:02.848 INFO:tasks.workunit.client.0.smithi078.stdout:6/869: creat d2/d34/d75/f12d x:0 0 0 2024-04-18T21:07:02.848 INFO:tasks.workunit.client.0.smithi078.stdout:0/940: creat d0/d9/d81/d122/f123 x:0 0 0 2024-04-18T21:07:02.848 INFO:tasks.workunit.client.0.smithi078.stdout:9/956: dwrite d7/d11/d1b/d45/d4b/d5d/f66 [0,4194304] 0 2024-04-18T21:07:02.848 INFO:tasks.workunit.client.0.smithi078.stdout:7/841: write d1/d16/dc/f5b [567769,51767] 0 2024-04-18T21:07:02.849 INFO:tasks.workunit.client.0.smithi078.stdout:8/883: rename d0/d10/d14/d2d/d93/da0/db5/de2/dfd/d108 to d0/d5c/d5a/dc6/d112 0 2024-04-18T21:07:02.850 INFO:tasks.workunit.client.0.smithi078.stdout:2/852: creat d0/db/d18/d21/d27/d29/d57/f108 x:0 0 0 2024-04-18T21:07:02.850 INFO:tasks.workunit.client.0.smithi078.stdout:0/941: mknod d0/d9/da/df/c124 0 2024-04-18T21:07:02.850 INFO:tasks.workunit.client.0.smithi078.stdout:8/884: stat d0/d10/d14/d2d/d93/f81 0 2024-04-18T21:07:02.851 INFO:tasks.workunit.client.0.smithi078.stdout:6/870: rename d2/d1c/d6b/dba/deb/d5d/f6a to d2/d1c/d63/f12e 0 2024-04-18T21:07:02.851 INFO:tasks.workunit.client.0.smithi078.stdout:0/942: symlink d0/d9/d81/l125 0 2024-04-18T21:07:02.851 INFO:tasks.workunit.client.0.smithi078.stdout:2/853: truncate d0/db/d18/dbb/ff1 831354 0 2024-04-18T21:07:02.852 INFO:tasks.workunit.client.0.smithi078.stdout:0/943: write d0/d9/da/f84 [1430371,112513] 0 2024-04-18T21:07:02.853 INFO:tasks.workunit.client.0.smithi078.stdout:0/944: write d0/d6c/f92 [402676,97663] 0 2024-04-18T21:07:02.853 INFO:tasks.workunit.client.0.smithi078.stdout:2/854: creat d0/db/d18/d21/d27/d29/d57/d7c/f109 x:0 0 0 2024-04-18T21:07:02.855 INFO:tasks.workunit.client.0.smithi078.stdout:2/855: symlink d0/db/d18/dbb/dde/d106/l10a 0 2024-04-18T21:07:02.855 INFO:tasks.workunit.client.0.smithi078.stdout:9/957: dwrite d7/d11/d1b/d45/d4b/d5d/f9a [0,4194304] 0 2024-04-18T21:07:02.856 INFO:tasks.workunit.client.0.smithi078.stdout:4/989: dread d0/dc/d10/d1c/d60/d74/fba [0,4194304] 0 2024-04-18T21:07:02.858 INFO:tasks.workunit.client.0.smithi078.stdout:9/958: mkdir d7/d11/d2d/d3f/db7/dfd/d113/d152 0 2024-04-18T21:07:02.859 INFO:tasks.workunit.client.0.smithi078.stdout:6/871: dread d2/d1c/d6b/dba/deb/d5d/fa4 [0,4194304] 0 2024-04-18T21:07:02.861 INFO:tasks.workunit.client.0.smithi078.stdout:6/872: readlink d2/d1c/d6b/d98/la7 0 2024-04-18T21:07:02.862 INFO:tasks.workunit.client.0.smithi078.stdout:0/945: dwrite d0/d9/da/db/d35/f20 [0,4194304] 0 2024-04-18T21:07:02.862 INFO:tasks.workunit.client.0.smithi078.stdout:6/873: creat d2/d1c/d117/f12f x:0 0 0 2024-04-18T21:07:02.863 INFO:tasks.workunit.client.0.smithi078.stdout:9/959: dread d7/df/d88/dce/fe7 [0,4194304] 0 2024-04-18T21:07:02.864 INFO:tasks.workunit.client.0.smithi078.stdout:1/991: dread d0/d2a/d3c/d4b/fcc [0,4194304] 0 2024-04-18T21:07:02.864 INFO:tasks.workunit.client.0.smithi078.stdout:6/874: write d2/d74/fb1 [677042,84857] 0 2024-04-18T21:07:02.865 INFO:tasks.workunit.client.0.smithi078.stdout:4/990: dwrite d0/dc/d5b/d4f/f79 [0,4194304] 0 2024-04-18T21:07:02.865 INFO:tasks.workunit.client.0.smithi078.stdout:1/992: readlink d0/d2a/d3c/d4b/d4/le9 0 2024-04-18T21:07:02.866 INFO:tasks.workunit.client.0.smithi078.stdout:9/960: truncate d7/d11/d2d/d3f/d4d/f4f 4901803 0 2024-04-18T21:07:02.866 INFO:tasks.workunit.client.0.smithi078.stdout:6/875: mknod d2/d6/dea/c130 0 2024-04-18T21:07:02.866 INFO:tasks.workunit.client.0.smithi078.stdout:1/993: readlink d0/d2a/d3c/d4b/d52/l58 0 2024-04-18T21:07:02.868 INFO:tasks.workunit.client.0.smithi078.stdout:4/991: rmdir d0/dc/d10/d1c/d60/dee/db8/d10f 39 2024-04-18T21:07:02.869 INFO:tasks.workunit.client.0.smithi078.stdout:4/992: chown d0/dc/d10/f10e 80822 1 2024-04-18T21:07:02.869 INFO:tasks.workunit.client.0.smithi078.stdout:6/876: creat d2/d1c/d63/d8b/dcb/f131 x:0 0 0 2024-04-18T21:07:02.869 INFO:tasks.workunit.client.0.smithi078.stdout:9/961: creat d7/d11/d2d/d26/d7c/dda/f153 x:0 0 0 2024-04-18T21:07:02.870 INFO:tasks.workunit.client.0.smithi078.stdout:1/994: rename d0/dca/d116/d141 to d0/d11/d69/d149 0 2024-04-18T21:07:02.870 INFO:tasks.workunit.client.0.smithi078.stdout:6/877: fdatasync d2/d1c/d67/f72 0 2024-04-18T21:07:02.870 INFO:tasks.workunit.client.0.smithi078.stdout:0/946: dwrite d0/d9/da/df/fa0 [0,4194304] 0 2024-04-18T21:07:02.870 INFO:tasks.workunit.client.0.smithi078.stdout:1/995: chown d0/d2a/d3c/ff9 0 1 2024-04-18T21:07:02.871 INFO:tasks.workunit.client.0.smithi078.stdout:6/878: write d2/d34/d35/d57/d90/fd5 [9006653,90040] 0 2024-04-18T21:07:02.872 INFO:tasks.workunit.client.0.smithi078.stdout:5/904: dread d9/da/f35 [0,4194304] 0 2024-04-18T21:07:02.872 INFO:tasks.workunit.client.0.smithi078.stdout:1/996: dread d0/d2a/d5f/d89/f17 [0,4194304] 0 2024-04-18T21:07:02.873 INFO:tasks.workunit.client.0.smithi078.stdout:9/962: rename d7/d11/c20 to d7/df/d88/dce/de1/d138/c154 0 2024-04-18T21:07:02.873 INFO:tasks.workunit.client.0.smithi078.stdout:4/993: mknod d0/dc/d10/d1c/d60/dee/db8/d10f/c144 0 2024-04-18T21:07:02.873 INFO:tasks.workunit.client.0.smithi078.stdout:1/997: mkdir d0/dc1/dd3/d14a 0 2024-04-18T21:07:02.873 INFO:tasks.workunit.client.0.smithi078.stdout:6/879: creat d2/d1c/d3a/d124/f132 x:0 0 0 2024-04-18T21:07:02.874 INFO:tasks.workunit.client.0.smithi078.stdout:1/998: stat d0/dca/lee 0 2024-04-18T21:07:02.875 INFO:tasks.workunit.client.0.smithi078.stdout:4/994: creat d0/dc/d10/d1c/d60/d123/dcb/f145 x:0 0 0 2024-04-18T21:07:02.875 INFO:tasks.workunit.client.0.smithi078.stdout:6/880: creat d2/d6/dd/f133 x:0 0 0 2024-04-18T21:07:02.876 INFO:tasks.workunit.client.0.smithi078.stdout:6/881: write d2/d6/dd/ff7 [573333,37170] 0 2024-04-18T21:07:02.876 INFO:tasks.workunit.client.0.smithi078.stdout:1/999: truncate d0/d2a/d5f/d89/d32/db2/d10e/d50/d78/f110 269233 0 2024-04-18T21:07:02.878 INFO:tasks.workunit.client.0.smithi078.stdout:0/947: write d0/d9/dd/d17/d2e/f71 [542909,34178] 0 2024-04-18T21:07:02.880 INFO:tasks.workunit.client.0.smithi078.stdout:2/856: dread d0/f5 [4194304,4194304] 0 2024-04-18T21:07:02.882 INFO:tasks.workunit.client.0.smithi078.stdout:8/885: dread d0/d10/d14/d2a/fbe [0,4194304] 0 2024-04-18T21:07:02.882 INFO:tasks.workunit.client.0.smithi078.stdout:4/995: dwrite d0/dc/d10/d3a/f59 [0,4194304] 0 2024-04-18T21:07:02.883 INFO:tasks.workunit.client.0.smithi078.stdout:2/857: mknod d0/db/c10b 0 2024-04-18T21:07:02.883 INFO:tasks.workunit.client.0.smithi078.stdout:6/882: dwrite d2/d34/d75/f12d [0,4194304] 0 2024-04-18T21:07:02.884 INFO:tasks.workunit.client.0.smithi078.stdout:8/886: readlink d0/d10/d14/d2a/l39 0 2024-04-18T21:07:02.884 INFO:tasks.workunit.client.0.smithi078.stdout:4/996: write d0/dc/d5b/d71/f56 [8736766,84993] 0 2024-04-18T21:07:02.885 INFO:tasks.workunit.client.0.smithi078.stdout:9/963: dwrite d7/d11/d1b/d77/feb [0,4194304] 0 2024-04-18T21:07:02.886 INFO:tasks.workunit.client.0.smithi078.stdout:2/858: getdents d0/db/d18/d21/d27/d29/de3/dfc 0 2024-04-18T21:07:02.886 INFO:tasks.workunit.client.0.smithi078.stdout:2/859: mknod d0/db/c10c 0 2024-04-18T21:07:02.887 INFO:tasks.workunit.client.0.smithi078.stdout:2/860: stat d0/d1f/d34/dd5/l74 0 2024-04-18T21:07:02.887 INFO:tasks.workunit.client.0.smithi078.stdout:2/861: stat d0/d1f/d5b/fc6 0 2024-04-18T21:07:02.889 INFO:tasks.workunit.client.0.smithi078.stdout:9/964: link d7/df/d54/d95/d9d/dd1/d10a/l112 d7/df/d54/d95/d9d/l155 0 2024-04-18T21:07:02.890 INFO:tasks.workunit.client.0.smithi078.stdout:2/862: chown d0/db/l24 1250 1 2024-04-18T21:07:02.890 INFO:tasks.workunit.client.0.smithi078.stdout:9/965: truncate d7/d11/f134 441483 0 2024-04-18T21:07:02.891 INFO:tasks.workunit.client.0.smithi078.stdout:4/997: dwrite d0/dc/d10/d3a/f9c [0,4194304] 0 2024-04-18T21:07:02.892 INFO:tasks.workunit.client.0.smithi078.stdout:4/998: stat d0/dc/d10/d1c/d6a/ldf 0 2024-04-18T21:07:02.892 INFO:tasks.workunit.client.0.smithi078.stdout:9/966: rename d7/d11/d2d/d3f/db7/dfd/fec to d7/d11/df0/d110/f156 0 2024-04-18T21:07:02.893 INFO:tasks.workunit.client.0.smithi078.stdout:9/967: dread - d7/df/d88/dce/ff4 zero size 2024-04-18T21:07:02.893 INFO:tasks.workunit.client.0.smithi078.stdout:4/999: write d0/dc/d29/d2f/f140 [67550,18132] 0 2024-04-18T21:07:02.897 INFO:tasks.workunit.client.0.smithi078.stdout:2/863: dwrite d0/d1f/d5b/fc6 [0,4194304] 0 2024-04-18T21:07:02.902 INFO:tasks.workunit.client.0.smithi078.stdout:2/864: dwrite d0/db/d65/dbd/fc8 [0,4194304] 0 2024-04-18T21:07:02.903 INFO:tasks.workunit.client.0.smithi078.stdout:2/865: mknod d0/db/d18/d21/db0/ddc/c10d 0 2024-04-18T21:07:02.904 INFO:tasks.workunit.client.0.smithi078.stdout:2/866: mknod d0/db/d18/d21/d27/d29/de3/dfc/c10e 0 2024-04-18T21:07:02.907 INFO:tasks.workunit.client.0.smithi078.stdout:2/867: rename d0/db/d18/d21/d8b/c8f to d0/db/d18/d21/db0/ddc/c10f 0 2024-04-18T21:07:02.907 INFO:tasks.workunit.client.0.smithi078.stdout:6/883: dread d2/d1f/f58 [0,4194304] 0 2024-04-18T21:07:02.908 INFO:tasks.workunit.client.0.smithi078.stdout:2/868: dread d0/db/d18/dbb/ff1 [0,4194304] 0 2024-04-18T21:07:02.909 INFO:tasks.workunit.client.0.smithi078.stdout:2/869: unlink d0/d1f/d34/dd5/ced 0 2024-04-18T21:07:02.910 INFO:tasks.workunit.client.0.smithi078.stdout:2/870: write d0/db/d18/d21/d27/d29/d57/d7c/f109 [164601,69364] 0 2024-04-18T21:07:02.910 INFO:tasks.workunit.client.0.smithi078.stdout:2/871: fsync d0/db/d18/d21/d27/d29/fbf 0 2024-04-18T21:07:02.912 INFO:tasks.workunit.client.0.smithi078.stdout:2/872: read d0/db/d18/d30/fab [157602,113476] 0 2024-04-18T21:07:02.913 INFO:tasks.workunit.client.0.smithi078.stdout:2/873: chown d0/db/d18/d21/d27/d29/d57/d7c/f109 813656526 1 2024-04-18T21:07:02.913 INFO:tasks.workunit.client.0.smithi078.stdout:2/874: fsync d0/d1f/d34/f53 0 2024-04-18T21:07:02.914 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:02.914+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:02.914 INFO:tasks.workunit.client.0.smithi078.stdout:2/875: write d0/db/d18/d5d/fa2 [855381,19512] 0 2024-04-18T21:07:02.914 INFO:tasks.workunit.client.0.smithi078.stdout:2/876: symlink d0/da9/l110 0 2024-04-18T21:07:02.915 INFO:tasks.workunit.client.0.smithi078.stdout:2/877: link d0/d1f/d34/dd5/fcc d0/db/d18/d21/d27/d70/f111 0 2024-04-18T21:07:02.920 INFO:tasks.workunit.client.0.smithi078.stdout:2/878: dwrite d0/db/d65/d96/feb [4194304,4194304] 0 2024-04-18T21:07:02.921 INFO:tasks.workunit.client.0.smithi078.stdout:2/879: symlink d0/db/d18/d21/db0/d59/l112 0 2024-04-18T21:07:02.922 INFO:tasks.workunit.client.0.smithi078.stdout:2/880: fsync d0/db/d18/f5a 0 2024-04-18T21:07:02.922 INFO:tasks.workunit.client.0.smithi078.stdout:2/881: symlink d0/db/d18/dbb/l113 0 2024-04-18T21:07:02.923 INFO:tasks.workunit.client.0.smithi078.stdout:2/882: readlink d0/db/d18/d5d/l100 0 2024-04-18T21:07:02.924 INFO:tasks.workunit.client.0.smithi078.stdout:2/883: mkdir d0/db/d6e/dd2/dd3/d114 0 2024-04-18T21:07:02.924 INFO:tasks.workunit.client.0.smithi078.stdout:2/884: unlink d0/db/d18/f5a 0 2024-04-18T21:07:02.925 INFO:tasks.workunit.client.0.smithi078.stdout:2/885: mknod d0/db/d18/d21/d27/d29/c115 0 2024-04-18T21:07:02.926 INFO:tasks.workunit.client.0.smithi078.stdout:2/886: readlink d0/db/d18/d21/db0/d59/l9c 0 2024-04-18T21:07:02.926 INFO:tasks.workunit.client.0.smithi078.stdout:8/887: dread d0/fcf [4194304,4194304] 0 2024-04-18T21:07:02.927 INFO:tasks.workunit.client.0.smithi078.stdout:2/887: unlink d0/db/d18/d21/d27/d29/d33/f4c 0 2024-04-18T21:07:02.927 INFO:tasks.workunit.client.0.smithi078.stdout:8/888: truncate d0/d22/fb8 1646878 0 2024-04-18T21:07:02.927 INFO:tasks.workunit.client.0.smithi078.stdout:2/888: read - d0/d1f/d34/fc9 zero size 2024-04-18T21:07:02.928 INFO:tasks.workunit.client.0.smithi078.stdout:2/889: truncate d0/d87/d88/d98/ffd 1231400 0 2024-04-18T21:07:02.929 INFO:tasks.workunit.client.0.smithi078.stdout:2/890: creat d0/d1f/f116 x:0 0 0 2024-04-18T21:07:02.930 INFO:tasks.workunit.client.0.smithi078.stdout:2/891: rename d0/f54 to d0/db/d18/d21/db0/f117 0 2024-04-18T21:07:02.931 INFO:tasks.workunit.client.0.smithi078.stdout:2/892: creat d0/db/d18/dbb/dde/f118 x:0 0 0 2024-04-18T21:07:02.932 INFO:tasks.workunit.client.0.smithi078.stdout:3/805: sync 2024-04-18T21:07:02.932 INFO:tasks.workunit.client.0.smithi078.stdout:7/842: sync 2024-04-18T21:07:02.932 INFO:tasks.workunit.client.0.smithi078.stdout:2/893: truncate d0/db/d18/dbb/fd9 169119 0 2024-04-18T21:07:02.933 INFO:tasks.workunit.client.0.smithi078.stdout:8/889: dwrite d0/d10/d14/d2d/d93/da0/fab [4194304,4194304] 0 2024-04-18T21:07:02.933 INFO:tasks.workunit.client.0.smithi078.stdout:7/843: dread - d1/d16/dc/d11/fd5 zero size 2024-04-18T21:07:02.934 INFO:tasks.workunit.client.0.smithi078.stdout:8/890: chown d0/d10/d14/d2a/f71 420902953 1 2024-04-18T21:07:02.934 INFO:tasks.workunit.client.0.smithi078.stdout:2/894: rename d0/cf to d0/db/d18/d21/d27/d29/de3/dfc/c119 0 2024-04-18T21:07:02.934 INFO:tasks.workunit.client.0.smithi078.stdout:9/968: dread d7/d11/d1b/d45/d4b/f56 [0,4194304] 0 2024-04-18T21:07:02.935 INFO:tasks.workunit.client.0.smithi078.stdout:2/895: mknod d0/da9/c11a 0 2024-04-18T21:07:02.935 INFO:tasks.workunit.client.0.smithi078.stdout:8/891: link d0/d10/d8d/fef d0/f113 0 2024-04-18T21:07:02.935 INFO:tasks.workunit.client.0.smithi078.stdout:9/969: mkdir d7/d11/d2d/d26/d12f/d13e/d157 0 2024-04-18T21:07:02.936 INFO:tasks.workunit.client.0.smithi078.stdout:8/892: write d0/f36 [1444655,59574] 0 2024-04-18T21:07:02.936 INFO:tasks.workunit.client.0.smithi078.stdout:9/970: fsync d7/d11/d47/f11b 0 2024-04-18T21:07:02.937 INFO:tasks.workunit.client.0.smithi078.stdout:8/893: mkdir d0/d10/d14/d2d/d114 0 2024-04-18T21:07:02.937 INFO:tasks.workunit.client.0.smithi078.stdout:2/896: getdents d0/db/d18/dbb/dde/d106 0 2024-04-18T21:07:02.937 INFO:tasks.workunit.client.0.smithi078.stdout:8/894: chown d0/d10/fb4 252204 1 2024-04-18T21:07:02.938 INFO:tasks.workunit.client.0.smithi078.stdout:9/971: unlink d7/df/d54/d95/d9d/dd1/d141/d116/d130/f10d 0 2024-04-18T21:07:02.938 INFO:tasks.workunit.client.0.smithi078.stdout:8/895: unlink d0/d10/d14/d2a/d4a/db2/db6/f10d 0 2024-04-18T21:07:02.938 INFO:tasks.workunit.client.0.smithi078.stdout:9/972: mknod d7/d11/d2d/d26/d97/c158 0 2024-04-18T21:07:02.939 INFO:tasks.workunit.client.0.smithi078.stdout:9/973: rmdir d7/d11/d80 39 2024-04-18T21:07:02.939 INFO:tasks.workunit.client.0.smithi078.stdout:8/896: write d0/d10/d14/d2d/d93/da0/db5/ff9 [645852,85905] 0 2024-04-18T21:07:02.941 INFO:tasks.workunit.client.0.smithi078.stdout:8/897: rename d0/d22/l9f to d0/d5c/l115 0 2024-04-18T21:07:02.942 INFO:tasks.workunit.client.0.smithi078.stdout:2/897: dwrite d0/f55 [4194304,4194304] 0 2024-04-18T21:07:02.945 INFO:tasks.workunit.client.0.smithi078.stdout:9/974: dwrite d7/d11/d47/f13a [0,4194304] 0 2024-04-18T21:07:02.946 INFO:tasks.workunit.client.0.smithi078.stdout:9/975: write d7/df/d54/d95/d9d/dd1/ff3 [906799,123828] 0 2024-04-18T21:07:02.948 INFO:tasks.workunit.client.0.smithi078.stdout:9/976: link d7/fbb d7/df/d54/d95/d9d/dd1/d10a/d3e/d5a/d149/f159 0 2024-04-18T21:07:02.949 INFO:tasks.workunit.client.0.smithi078.stdout:9/977: symlink d7/d11/d2d/d3f/d4d/dd5/l15a 0 2024-04-18T21:07:02.949 INFO:tasks.workunit.client.0.smithi078.stdout:9/978: chown d7/df/d54 33506370 1 2024-04-18T21:07:02.950 INFO:tasks.workunit.client.0.smithi078.stdout:2/898: dwrite d0/db/d18/d21/db0/d59/fee [0,4194304] 0 2024-04-18T21:07:02.950 INFO:tasks.workunit.client.0.smithi078.stdout:9/979: rmdir d7/d11/d1b/d45/d4b 39 2024-04-18T21:07:02.951 INFO:tasks.workunit.client.0.smithi078.stdout:9/980: rmdir d7/df/d54/d95/d9d/dd1 39 2024-04-18T21:07:02.952 INFO:tasks.workunit.client.0.smithi078.stdout:9/981: creat d7/df/d67/f15b x:0 0 0 2024-04-18T21:07:02.953 INFO:tasks.workunit.client.0.smithi078.stdout:9/982: write d7/d11/d1b/d45/d4b/f56 [5273707,75197] 0 2024-04-18T21:07:02.955 INFO:tasks.workunit.client.0.smithi078.stdout:9/983: rename d7/d11/d47 to d7/d11/d2d/d3f/db7/dfd/d15c 0 2024-04-18T21:07:02.956 INFO:tasks.workunit.client.0.smithi078.stdout:9/984: link d7/df/d88/dce/de1/d138/c154 d7/d11/d2d/c15d 0 2024-04-18T21:07:02.957 INFO:tasks.workunit.client.0.smithi078.stdout:9/985: mknod d7/d11/d2d/d26/d12f/d13e/d157/c15e 0 2024-04-18T21:07:02.958 INFO:tasks.workunit.client.0.smithi078.stdout:9/986: mknod d7/d11/d2d/d3f/db7/dd7/dde/c15f 0 2024-04-18T21:07:02.958 INFO:tasks.workunit.client.0.smithi078.stdout:5/905: sync 2024-04-18T21:07:02.958 INFO:tasks.workunit.client.0.smithi078.stdout:6/884: sync 2024-04-18T21:07:02.958 INFO:tasks.workunit.client.0.smithi078.stdout:0/948: sync 2024-04-18T21:07:02.958 INFO:tasks.workunit.client.0.smithi078.stdout:7/844: sync 2024-04-18T21:07:02.959 INFO:tasks.workunit.client.0.smithi078.stdout:3/806: sync 2024-04-18T21:07:02.959 INFO:tasks.workunit.client.0.smithi078.stdout:2/899: dread d0/db/d18/d21/d27/d29/d57/d7c/f109 [0,4194304] 0 2024-04-18T21:07:02.959 INFO:tasks.workunit.client.0.smithi078.stdout:0/949: fsync d0/d9/d4c/d6b/d9b/fac 0 2024-04-18T21:07:02.959 INFO:tasks.workunit.client.0.smithi078.stdout:3/807: creat d4/da/d5e/ff9 x:0 0 0 2024-04-18T21:07:02.959 INFO:tasks.workunit.client.0.smithi078.stdout:7/845: chown d1/d16/dc/d11/d53/d82/lf9 16 1 2024-04-18T21:07:02.960 INFO:tasks.workunit.client.0.smithi078.stdout:5/906: truncate d9/da/d3e/d4c/d67/f91 1088191 0 2024-04-18T21:07:02.960 INFO:tasks.workunit.client.0.smithi078.stdout:0/950: write d0/d9/d81/d122/f123 [534390,63516] 0 2024-04-18T21:07:02.960 INFO:tasks.workunit.client.0.smithi078.stdout:7/846: dread - d1/d16/d10/d5a/fad zero size 2024-04-18T21:07:02.960 INFO:tasks.workunit.client.0.smithi078.stdout:3/808: creat d4/da/d11/ffa x:0 0 0 2024-04-18T21:07:02.961 INFO:tasks.workunit.client.0.smithi078.stdout:7/847: write d1/d16/dc/f55 [428051,5714] 0 2024-04-18T21:07:02.961 INFO:tasks.workunit.client.0.smithi078.stdout:5/907: creat d9/da/d3e/d4c/d67/d7c/f11d x:0 0 0 2024-04-18T21:07:02.961 INFO:tasks.workunit.client.0.smithi078.stdout:3/809: mkdir d4/d2d/d30/d84/dfb 0 2024-04-18T21:07:02.962 INFO:tasks.workunit.client.0.smithi078.stdout:0/951: truncate d0/d9/da/db/da6/f103 4704208 0 2024-04-18T21:07:02.962 INFO:tasks.workunit.client.0.smithi078.stdout:3/810: unlink d4/l51 0 2024-04-18T21:07:02.962 INFO:tasks.workunit.client.0.smithi078.stdout:5/908: rename d9/da/d90/lec to d9/da/d4b/l11e 0 2024-04-18T21:07:02.962 INFO:tasks.workunit.client.0.smithi078.stdout:0/952: creat d0/d9/dd/d17/d82/f126 x:0 0 0 2024-04-18T21:07:02.963 INFO:tasks.workunit.client.0.smithi078.stdout:3/811: creat d4/df/db0/dd9/ffc x:0 0 0 2024-04-18T21:07:02.963 INFO:tasks.workunit.client.0.smithi078.stdout:0/953: mknod d0/d9/d81/c127 0 2024-04-18T21:07:02.963 INFO:tasks.workunit.client.0.smithi078.stdout:3/812: rmdir d4/d2d/d6c 39 2024-04-18T21:07:02.963 INFO:tasks.workunit.client.0.smithi078.stdout:0/954: dread - d0/d9/d2f/fef zero size 2024-04-18T21:07:02.964 INFO:tasks.workunit.client.0.smithi078.stdout:0/955: dread - d0/d9/d81/daa/f10c zero size 2024-04-18T21:07:02.965 INFO:tasks.workunit.client.0.smithi078.stdout:3/813: mkdir d4/df/db0/dc5/d41/dfd 0 2024-04-18T21:07:02.965 INFO:tasks.workunit.client.0.smithi078.stdout:0/956: fsync d0/d9/d4c/d8f/db6/f112 0 2024-04-18T21:07:02.966 INFO:tasks.workunit.client.0.smithi078.stdout:9/987: truncate d7/d11/d2d/d26/d7c/f10c 4039339 0 2024-04-18T21:07:02.966 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:07:02.967 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [ 2024-04-18T21:07:02.967 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:02.967 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:2669 3.d 3:b02ffd62:::200.00000010:head [write 1934144~31435 [fadvise_dontneed] in=31435b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-18T21:07:02.967 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:02.969828+0000", 2024-04-18T21:07:02.967 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.00022521299999999999, 2024-04-18T21:07:02.967 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00024516300000000001, 2024-04-18T21:07:02.967 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:02.967 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:02.967 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:07:02.967 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:02.967 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:02.967 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:02.967 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:02.969828+0000", 2024-04-18T21:07:02.967 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:02.968 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:02.968 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:02.968 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:02.968 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:02.969828+0000", 2024-04-18T21:07:02.968 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:02.968 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:02.968 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:02.968 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:02.968 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:02.969829+0000", 2024-04-18T21:07:02.968 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.7400000000000002e-07 2024-04-18T21:07:02.968 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:02.968 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:02.968 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:02.968 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:02.969854+0000", 2024-04-18T21:07:02.968 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.4703999999999999e-05 2024-04-18T21:07:02.969 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:02.969 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:02.969 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:02.969 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:02.969866+0000", 2024-04-18T21:07:02.969 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1683e-05 2024-04-18T21:07:02.969 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:02.969 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:02.969 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:02.969 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:02.969872+0000", 2024-04-18T21:07:02.969 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.8869999999999997e-06 2024-04-18T21:07:02.969 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:02.969 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:02.969 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:02.969 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:02.969914+0000", 2024-04-18T21:07:02.969 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.2849999999999998e-05 2024-04-18T21:07:02.970 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:02.970 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:02.970 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:02.970 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:02.969965+0000", 2024-04-18T21:07:02.970 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.0655000000000002e-05 2024-04-18T21:07:02.970 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:02.970 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:02.970 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:02.970 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:02.970 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:02.970 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:14992 4.1a 4:5a092286:::10000003255.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-18T21:07:02.970 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:02.954325+0000", 2024-04-18T21:07:02.970 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.015728487999999999, 2024-04-18T21:07:02.970 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.015805829, 2024-04-18T21:07:02.971 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:02.971 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:02.971 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:07:02.971 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:02.971 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:02.971 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:02.971 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 14992 2024-04-18T21:07:02.971 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:02.971 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:02.971 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:02.971 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:02.971 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:02.954325+0000", 2024-04-18T21:07:02.971 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:02.971 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:02.971 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:02.972 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:02.972 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:02.954325+0000", 2024-04-18T21:07:02.972 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:02.972 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:02.972 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:02.972 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:02.972 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:02.954327+0000", 2024-04-18T21:07:02.972 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3820000000000001e-06 2024-04-18T21:07:02.972 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:02.972 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:02.972 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:02.972 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:02.960982+0000", 2024-04-18T21:07:02.972 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0066554930000000002 2024-04-18T21:07:02.972 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:02.973 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:02.973 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:02.973 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:02.961012+0000", 2024-04-18T21:07:02.973 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.9532000000000001e-05 2024-04-18T21:07:02.973 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:02.973 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:02.973 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:02.973 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:02.961031+0000", 2024-04-18T21:07:02.973 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8916999999999999e-05 2024-04-18T21:07:02.973 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:02.973 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:02.973 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:02.973 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:02.961117+0000", 2024-04-18T21:07:02.973 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6685000000000001e-05 2024-04-18T21:07:02.973 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:02.974 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:02.974 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:02.974 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:02.961202+0000", 2024-04-18T21:07:02.974 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4665000000000003e-05 2024-04-18T21:07:02.974 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:02.974 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:02.974 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:02.974 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:02.961301+0000", 2024-04-18T21:07:02.974 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.8913999999999995e-05 2024-04-18T21:07:02.974 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:02.974 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:02.974 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:02.974 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:02.974 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:02.975 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:14998 4.18 4:18c6d816:::10000003304.00000000:head [write 428051~5714 in=5714b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-18T21:07:02.975 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:02.965396+0000", 2024-04-18T21:07:02.975 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.0046580060000000001, 2024-04-18T21:07:02.975 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0047788980000000002, 2024-04-18T21:07:02.975 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:02.975 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:02.975 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:07:02.975 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:02.975 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:02.975 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:02.975 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 14998 2024-04-18T21:07:02.975 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:02.975 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:02.975 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:02.975 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:02.976 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:02.965396+0000", 2024-04-18T21:07:02.976 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:02.976 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:02.976 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:02.976 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:02.976 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:02.965396+0000", 2024-04-18T21:07:02.976 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:02.976 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:02.976 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:02.976 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:02.976 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:02.965398+0000", 2024-04-18T21:07:02.976 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9910000000000001e-06 2024-04-18T21:07:02.976 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:02.976 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:02.977 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:02.977 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:02.965417+0000", 2024-04-18T21:07:02.977 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9276999999999999e-05 2024-04-18T21:07:02.977 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:02.977 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:02.977 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:02.977 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:02.965442+0000", 2024-04-18T21:07:02.977 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.4927e-05 2024-04-18T21:07:02.977 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:02.977 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:02.977 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:02.977 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:02.965461+0000", 2024-04-18T21:07:02.977 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8794e-05 2024-04-18T21:07:02.977 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:02.977 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:02.978 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:02.978 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:02.965536+0000", 2024-04-18T21:07:02.978 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.5405000000000001e-05 2024-04-18T21:07:02.978 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:02.978 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:02.978 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:02.978 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:02.965628+0000", 2024-04-18T21:07:02.978 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.2176999999999995e-05 2024-04-18T21:07:02.978 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:02.978 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:02.978 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:02.978 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:02.965711+0000", 2024-04-18T21:07:02.978 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.2225999999999995e-05 2024-04-18T21:07:02.978 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:02.978 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:02.979 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:02.979 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:02.979 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2024-04-18T21:07:02.979 INFO:teuthology.orchestra.run.smithi132.stdout: "num_ops": 3 2024-04-18T21:07:02.979 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:07:02.981 INFO:tasks.workunit.client.0.smithi078.stdout:3/814: creat d4/df/db0/dc5/d41/ffe x:0 0 0 2024-04-18T21:07:02.981 INFO:tasks.workunit.client.0.smithi078.stdout:3/815: fsync d4/da/d11/f72 0 2024-04-18T21:07:02.981 INFO:tasks.workunit.client.0.smithi078.stdout:9/988: unlink d7/d11/d1b/d45/d4b/d5d/f60 0 2024-04-18T21:07:02.981 INFO:tasks.workunit.client.0.smithi078.stdout:7/848: dwrite d1/d16/dc/f118 [0,4194304] 0 2024-04-18T21:07:02.981 INFO:tasks.workunit.client.0.smithi078.stdout:7/849: chown d1/d16/dc/d11/d53/d82/c8d 990334857 1 2024-04-18T21:07:02.981 INFO:tasks.workunit.client.0.smithi078.stdout:6/885: dwrite d2/ff [0,4194304] 0 2024-04-18T21:07:02.981 INFO:tasks.workunit.client.0.smithi078.stdout:7/850: getdents d1/d16/dc/d11/da2 0 2024-04-18T21:07:02.981 INFO:tasks.workunit.client.0.smithi078.stdout:6/886: creat d2/d1c/d63/da1/db9/f134 x:0 0 0 2024-04-18T21:07:02.981 INFO:tasks.workunit.client.0.smithi078.stdout:6/887: creat d2/d74/f135 x:0 0 0 2024-04-18T21:07:02.982 INFO:tasks.workunit.client.0.smithi078.stdout:7/851: readlink d1/d16/d2d/df4/lf8 0 2024-04-18T21:07:02.982 INFO:tasks.workunit.client.0.smithi078.stdout:0/957: dwrite d0/d9/dd/d17/d82/fc2 [0,4194304] 0 2024-04-18T21:07:02.982 INFO:tasks.workunit.client.0.smithi078.stdout:7/852: chown d1/c88 1699 1 2024-04-18T21:07:02.982 INFO:tasks.workunit.client.0.smithi078.stdout:6/888: chown d2/d34/d35/d57/f73 4670 1 2024-04-18T21:07:02.982 INFO:tasks.workunit.client.0.smithi078.stdout:7/853: unlink d1/d16/dc/fb2 0 2024-04-18T21:07:02.982 INFO:tasks.workunit.client.0.smithi078.stdout:6/889: symlink d2/d1c/l136 0 2024-04-18T21:07:02.982 INFO:tasks.workunit.client.0.smithi078.stdout:9/989: dwrite d7/d11/d2d/d3f/d4d/f4f [0,4194304] 0 2024-04-18T21:07:02.982 INFO:tasks.workunit.client.0.smithi078.stdout:6/890: mkdir d2/d1c/d63/d137 0 2024-04-18T21:07:02.982 INFO:tasks.workunit.client.0.smithi078.stdout:7/854: creat d1/d16/dc/d11/d53/d82/da4/db5/d91/db3/f11f x:0 0 0 2024-04-18T21:07:02.982 INFO:tasks.workunit.client.0.smithi078.stdout:9/990: mkdir d7/df/d54/d95/d9d/dd1/d10a/d3e/d5a/dca/d160 0 2024-04-18T21:07:02.982 INFO:tasks.workunit.client.0.smithi078.stdout:7/855: symlink d1/d16/dc/d11/d53/d82/da4/db5/d91/db0/l120 0 2024-04-18T21:07:02.983 INFO:tasks.workunit.client.0.smithi078.stdout:7/856: rename d1/d16/d10/f52 to d1/d16/dc/d11/da2/dbc/f121 0 2024-04-18T21:07:02.983 INFO:tasks.workunit.client.0.smithi078.stdout:0/958: dwrite d0/d9/d58/f62 [0,4194304] 0 2024-04-18T21:07:02.983 INFO:tasks.workunit.client.0.smithi078.stdout:0/959: symlink d0/d6c/d9d/ddc/l128 0 2024-04-18T21:07:02.983 INFO:tasks.workunit.client.0.smithi078.stdout:0/960: mknod d0/d9/d81/c129 0 2024-04-18T21:07:02.984 INFO:tasks.workunit.client.0.smithi078.stdout:0/961: readlink d0/d9/lfa 0 2024-04-18T21:07:02.984 INFO:tasks.workunit.client.0.smithi078.stdout:9/991: dwrite d7/d11/d2d/d3f/db7/dfd/d15c/f12b [0,4194304] 0 2024-04-18T21:07:02.986 INFO:tasks.workunit.client.0.smithi078.stdout:0/962: creat d0/d9/dd/d17/f12a x:0 0 0 2024-04-18T21:07:02.988 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:07:02.988 INFO:tasks.workunit.client.0.smithi078.stdout:0/963: rmdir d0/d9/da/db/d35/d3f/da2 39 2024-04-18T21:07:02.990 INFO:tasks.workunit.client.0.smithi078.stdout:8/898: sync 2024-04-18T21:07:02.991 INFO:tasks.workunit.client.0.smithi078.stdout:3/816: sync 2024-04-18T21:07:02.991 INFO:tasks.workunit.client.0.smithi078.stdout:3/817: dread - d4/d2d/d30/d84/fe9 zero size 2024-04-18T21:07:02.992 INFO:tasks.workunit.client.0.smithi078.stdout:8/899: write d0/d10/d14/d2a/d4a/faf [1555318,79003] 0 2024-04-18T21:07:02.992 INFO:tasks.workunit.client.0.smithi078.stdout:3/818: rmdir d4/da/d76 39 2024-04-18T21:07:02.994 INFO:tasks.workunit.client.0.smithi078.stdout:3/819: creat d4/da/d11/d66/deb/fff x:0 0 0 2024-04-18T21:07:02.994 INFO:tasks.workunit.client.0.smithi078.stdout:8/900: mkdir d0/d10/d14/d2a/d4a/db2/db6/df4/d116 0 2024-04-18T21:07:02.994 INFO:tasks.workunit.client.0.smithi078.stdout:0/964: dwrite d0/d9/da/db/d35/d3f/fe1 [0,4194304] 0 2024-04-18T21:07:02.995 INFO:tasks.workunit.client.0.smithi078.stdout:2/900: dread d0/db/d65/d96/fa7 [0,4194304] 0 2024-04-18T21:07:02.995 INFO:tasks.workunit.client.0.smithi078.stdout:3/820: fdatasync d4/d2d/d30/fd4 0 2024-04-18T21:07:02.995 INFO:tasks.workunit.client.0.smithi078.stdout:0/965: stat d0/d9/da/df/fa0 0 2024-04-18T21:07:02.995 INFO:tasks.workunit.client.0.smithi078.stdout:5/909: sync 2024-04-18T21:07:02.996 INFO:tasks.workunit.client.0.smithi078.stdout:8/901: unlink d0/d10/d14/d2a/d4a/db2/fc5 0 2024-04-18T21:07:02.997 INFO:tasks.workunit.client.0.smithi078.stdout:0/966: creat d0/d9/da/db/da6/f12b x:0 0 0 2024-04-18T21:07:02.997 INFO:tasks.workunit.client.0.smithi078.stdout:3/821: mknod d4/c100 0 2024-04-18T21:07:02.997 INFO:tasks.workunit.client.0.smithi078.stdout:8/902: symlink d0/d10/d14/d2a/l117 0 2024-04-18T21:07:02.998 INFO:tasks.workunit.client.0.smithi078.stdout:3/822: creat d4/da/d11/d66/dbe/f101 x:0 0 0 2024-04-18T21:07:02.998 INFO:tasks.workunit.client.0.smithi078.stdout:6/891: read d2/d1c/d30/fb2 [4138459,60727] 0 2024-04-18T21:07:02.999 INFO:tasks.workunit.client.0.smithi078.stdout:8/903: mkdir d0/d10/d14/d2a/d4a/db2/db6/df4/d118 0 2024-04-18T21:07:02.999 INFO:tasks.workunit.client.0.smithi078.stdout:8/904: sync 2024-04-18T21:07:03.000 INFO:tasks.workunit.client.0.smithi078.stdout:6/892: truncate d2/d1c/d63/d8b/dcb/fe2 177473 0 2024-04-18T21:07:03.002 INFO:tasks.workunit.client.0.smithi078.stdout:0/967: dwrite d0/d9/d4c/d6b/d9b/fac [0,4194304] 0 2024-04-18T21:07:03.004 INFO:tasks.workunit.client.0.smithi078.stdout:9/992: read d7/d11/d1b/d45/d4b/d5d/f8d [3287935,94560] 0 2024-04-18T21:07:03.005 INFO:tasks.workunit.client.0.smithi078.stdout:0/968: creat d0/d9/d81/f12c x:0 0 0 2024-04-18T21:07:03.005 INFO:tasks.workunit.client.0.smithi078.stdout:9/993: symlink d7/d11/df0/d110/l161 0 2024-04-18T21:07:03.005 INFO:tasks.workunit.client.0.smithi078.stdout:9/994: chown d7/df/d67 96083 1 2024-04-18T21:07:03.006 INFO:tasks.workunit.client.0.smithi078.stdout:6/893: dwrite d2/d34/f12b [0,4194304] 0 2024-04-18T21:07:03.006 INFO:tasks.workunit.client.0.smithi078.stdout:0/969: chown d0/f5 10 1 2024-04-18T21:07:03.006 INFO:tasks.workunit.client.0.smithi078.stdout:5/910: write d9/da/de7/fb0 [1576378,23235] 0 2024-04-18T21:07:03.008 INFO:tasks.workunit.client.0.smithi078.stdout:6/894: creat d2/d1c/d6b/dba/deb/f138 x:0 0 0 2024-04-18T21:07:03.008 INFO:tasks.workunit.client.0.smithi078.stdout:5/911: creat d9/d9f/dd4/f11f x:0 0 0 2024-04-18T21:07:03.008 INFO:tasks.workunit.client.0.smithi078.stdout:6/895: sync 2024-04-18T21:07:03.008 INFO:tasks.workunit.client.0.smithi078.stdout:3/823: truncate d4/d2d/d30/d35/d4b/d59/fad 876646 0 2024-04-18T21:07:03.008 INFO:tasks.workunit.client.0.smithi078.stdout:7/857: dread d1/d16/dc/d11/f69 [0,4194304] 0 2024-04-18T21:07:03.009 INFO:tasks.workunit.client.0.smithi078.stdout:3/824: chown d4/da/c27 75757 1 2024-04-18T21:07:03.010 INFO:tasks.workunit.client.0.smithi078.stdout:5/912: mkdir d9/da/d3e/d4c/d6d/d73/d120 0 2024-04-18T21:07:03.010 INFO:tasks.workunit.client.0.smithi078.stdout:5/913: sync 2024-04-18T21:07:03.010 INFO:tasks.workunit.client.0.smithi078.stdout:3/825: unlink d4/d2d/d6c/fcb 0 2024-04-18T21:07:03.011 INFO:tasks.workunit.client.0.smithi078.stdout:5/914: chown d9/da/d3e/d4c/d6d/d73/ddf/c10d 364 1 2024-04-18T21:07:03.011 INFO:tasks.workunit.client.0.smithi078.stdout:3/826: rmdir d4/df/de6 0 2024-04-18T21:07:03.012 INFO:tasks.workunit.client.0.smithi078.stdout:5/915: fdatasync d9/d2e/f9e 0 2024-04-18T21:07:03.012 INFO:tasks.workunit.client.0.smithi078.stdout:9/995: dwrite d7/df/d54/d115/f14f [0,4194304] 0 2024-04-18T21:07:03.012 INFO:tasks.workunit.client.0.smithi078.stdout:3/827: write d4/da/f79 [1481679,117686] 0 2024-04-18T21:07:03.013 INFO:tasks.workunit.client.0.smithi078.stdout:5/916: creat d9/da/d90/d62/da4/f121 x:0 0 0 2024-04-18T21:07:03.013 INFO:tasks.workunit.client.0.smithi078.stdout:9/996: link d7/d11/d1b/d45/d4b/d5d/fd3 d7/d11/d2d/d3f/df9/f162 0 2024-04-18T21:07:03.014 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~6s 2024-04-18T21:07:03.014 INFO:tasks.workunit.client.0.smithi078.stdout:3/828: mknod d4/d2d/d30/d35/d71/c102 0 2024-04-18T21:07:03.014 INFO:tasks.workunit.client.0.smithi078.stdout:9/997: mkdir d7/df/d88/dce/de1/d138/d163 0 2024-04-18T21:07:03.015 INFO:tasks.workunit.client.0.smithi078.stdout:3/829: rmdir d4 39 2024-04-18T21:07:03.015 INFO:tasks.workunit.client.0.smithi078.stdout:5/917: getdents d9/d2e 0 2024-04-18T21:07:03.015 INFO:tasks.workunit.client.0.smithi078.stdout:9/998: symlink d7/d11/d2d/l164 0 2024-04-18T21:07:03.016 INFO:tasks.workunit.client.0.smithi078.stdout:5/918: mkdir d9/d9f/dd4/dee/def/dff/d122 0 2024-04-18T21:07:03.016 INFO:tasks.workunit.client.0.smithi078.stdout:9/999: getdents d7/d11/d2d/d3f/d126 0 2024-04-18T21:07:03.017 INFO:tasks.workunit.client.0.smithi078.stdout:5/919: creat d9/da/d3e/d4c/db1/f123 x:0 0 0 2024-04-18T21:07:03.017 INFO:tasks.workunit.client.0.smithi078.stdout:5/920: write d9/da/d3e/d4c/d6d/d86/ffc [626390,130463] 0 2024-04-18T21:07:03.018 INFO:tasks.workunit.client.0.smithi078.stdout:5/921: read - d9/da/d8c/f116 zero size 2024-04-18T21:07:03.020 INFO:tasks.workunit.client.0.smithi078.stdout:3/830: read d4/d2d/d30/f60 [216919,58467] 0 2024-04-18T21:07:03.022 INFO:tasks.workunit.client.0.smithi078.stdout:6/896: truncate d2/d1f/f2c 36707 0 2024-04-18T21:07:03.022 INFO:tasks.workunit.client.0.smithi078.stdout:3/831: rename d4/df/db0/ld6 to d4/d2d/d30/d35/d4b/d59/l103 0 2024-04-18T21:07:03.022 INFO:tasks.workunit.client.0.smithi078.stdout:6/897: rmdir d2/d1c/d63/d8b 39 2024-04-18T21:07:03.023 INFO:tasks.workunit.client.0.smithi078.stdout:7/858: dread d1/d32/f66 [0,4194304] 0 2024-04-18T21:07:03.023 INFO:tasks.workunit.client.0.smithi078.stdout:3/832: symlink d4/df/db0/dc5/d41/dda/de2/l104 0 2024-04-18T21:07:03.023 INFO:tasks.workunit.client.0.smithi078.stdout:6/898: unlink d2/d1c/d63/d8b/dcc/c107 0 2024-04-18T21:07:03.023 INFO:tasks.workunit.client.0.smithi078.stdout:3/833: symlink d4/df/db0/l105 0 2024-04-18T21:07:03.023 INFO:tasks.workunit.client.0.smithi078.stdout:6/899: creat d2/dbf/f139 x:0 0 0 2024-04-18T21:07:03.024 INFO:tasks.workunit.client.0.smithi078.stdout:7/859: creat d1/d16/dc/d11/d53/d82/f122 x:0 0 0 2024-04-18T21:07:03.024 INFO:tasks.workunit.client.0.smithi078.stdout:3/834: mknod d4/d2d/d30/d35/c106 0 2024-04-18T21:07:03.024 INFO:tasks.workunit.client.0.smithi078.stdout:7/860: fdatasync d1/d16/dc/d11/f69 0 2024-04-18T21:07:03.025 INFO:tasks.workunit.client.0.smithi078.stdout:3/835: write d4/d2d/d30/fd4 [474036,84146] 0 2024-04-18T21:07:03.025 INFO:tasks.workunit.client.0.smithi078.stdout:3/836: chown d4/dc3 319 1 2024-04-18T21:07:03.026 INFO:tasks.workunit.client.0.smithi078.stdout:7/861: creat d1/d16/dc/d31/f123 x:0 0 0 2024-04-18T21:07:03.026 INFO:tasks.workunit.client.0.smithi078.stdout:7/862: mknod d1/d16/d10/c124 0 2024-04-18T21:07:03.027 INFO:tasks.workunit.client.0.smithi078.stdout:8/905: dread d0/f1f [0,4194304] 0 2024-04-18T21:07:03.027 INFO:tasks.workunit.client.0.smithi078.stdout:7/863: unlink d1/d32/l4d 0 2024-04-18T21:07:03.027 INFO:tasks.workunit.client.0.smithi078.stdout:6/900: dread d2/d1c/f53 [0,4194304] 0 2024-04-18T21:07:03.028 INFO:tasks.workunit.client.0.smithi078.stdout:7/864: write d1/d16/dc/d11/d53/d82/da4/db5/d91/db0/fd4 [464503,27605] 0 2024-04-18T21:07:03.029 INFO:tasks.workunit.client.0.smithi078.stdout:6/901: link d2/d6/f59 d2/d1c/d3a/f13a 0 2024-04-18T21:07:03.030 INFO:tasks.workunit.client.0.smithi078.stdout:7/865: write d1/d16/dc/d11/da2/dbc/dc3/dff/f115 [3017946,61122] 0 2024-04-18T21:07:03.031 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:03.034+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:03.031 INFO:tasks.workunit.client.0.smithi078.stdout:8/906: dread d0/f45 [0,4194304] 0 2024-04-18T21:07:03.031 INFO:tasks.workunit.client.0.smithi078.stdout:3/837: truncate d4/da/ddf/da0/fc0 196159 0 2024-04-18T21:07:03.032 INFO:tasks.workunit.client.0.smithi078.stdout:8/907: write d0/da8/fcd [55099,4617] 0 2024-04-18T21:07:03.033 INFO:tasks.workunit.client.0.smithi078.stdout:3/838: rename d4/d2d/d6c/db5/cb7 to d4/dc3/c107 0 2024-04-18T21:07:03.033 INFO:tasks.workunit.client.0.smithi078.stdout:8/908: chown d0/d10/d14/d2d/f3f 9 1 2024-04-18T21:07:03.034 INFO:tasks.workunit.client.0.smithi078.stdout:3/839: stat d4/d2d/d30/d35/lc2 0 2024-04-18T21:07:03.035 INFO:tasks.workunit.client.0.smithi078.stdout:5/922: dwrite d9/da/d3e/d4c/d6d/d75/dad/fc2 [0,4194304] 0 2024-04-18T21:07:03.036 INFO:tasks.workunit.client.0.smithi078.stdout:5/923: sync 2024-04-18T21:07:03.036 INFO:tasks.workunit.client.0.smithi078.stdout:8/909: write d0/d10/d60/d6f/fe1 [677314,20382] 0 2024-04-18T21:07:03.036 INFO:tasks.workunit.client.0.smithi078.stdout:6/902: dwrite d2/d34/f12a [0,4194304] 0 2024-04-18T21:07:03.037 INFO:tasks.workunit.client.0.smithi078.stdout:5/924: dread - d9/da/d3e/d4c/db1/f123 zero size 2024-04-18T21:07:03.039 INFO:tasks.workunit.client.0.smithi078.stdout:6/903: creat d2/d1c/d63/d137/f13b x:0 0 0 2024-04-18T21:07:03.039 INFO:tasks.workunit.client.0.smithi078.stdout:5/925: fdatasync d9/da/d4b/d8b/fcf 0 2024-04-18T21:07:03.039 INFO:tasks.workunit.client.0.smithi078.stdout:6/904: mknod d2/d34/c13c 0 2024-04-18T21:07:03.040 INFO:tasks.workunit.client.0.smithi078.stdout:5/926: write d9/da/d90/d62/da4/f121 [220677,594] 0 2024-04-18T21:07:03.041 INFO:tasks.workunit.client.0.smithi078.stdout:6/905: mknod d2/d1c/d63/d8b/dcc/c13d 0 2024-04-18T21:07:03.042 INFO:tasks.workunit.client.0.smithi078.stdout:3/840: write d4/d2d/d30/d35/f33 [458240,108292] 0 2024-04-18T21:07:03.042 INFO:tasks.workunit.client.0.smithi078.stdout:6/906: chown d2/d1c/d63/f8e 9033024 1 2024-04-18T21:07:03.042 INFO:tasks.workunit.client.0.smithi078.stdout:6/907: fsync d2/d6/dd/ff7 0 2024-04-18T21:07:03.044 INFO:tasks.workunit.client.0.smithi078.stdout:8/910: truncate d0/d5c/d5a/d7b/fbf 2659137 0 2024-04-18T21:07:03.044 INFO:tasks.workunit.client.0.smithi078.stdout:2/901: dread d0/fe [0,4194304] 0 2024-04-18T21:07:03.045 INFO:tasks.workunit.client.0.smithi078.stdout:7/866: dread d1/d16/d1c/d40/f8e [0,4194304] 0 2024-04-18T21:07:03.046 INFO:tasks.workunit.client.0.smithi078.stdout:6/908: getdents d2/d1c/d6b 0 2024-04-18T21:07:03.046 INFO:tasks.workunit.client.0.smithi078.stdout:3/841: getdents d4/df/db0/dc5 0 2024-04-18T21:07:03.046 INFO:tasks.workunit.client.0.smithi078.stdout:8/911: dread - d0/d10/d14/d2a/ddd/f102 zero size 2024-04-18T21:07:03.046 INFO:tasks.workunit.client.0.smithi078.stdout:7/867: unlink d1/d16/d10/d7c/d7e/fac 0 2024-04-18T21:07:03.046 INFO:tasks.workunit.client.0.smithi078.stdout:5/927: dwrite d9/d2e/f3d [0,4194304] 0 2024-04-18T21:07:03.047 INFO:tasks.workunit.client.0.smithi078.stdout:2/902: getdents d0/db/d65/dbd 0 2024-04-18T21:07:03.047 INFO:tasks.workunit.client.0.smithi078.stdout:0/970: dread d0/d9/da/db/d35/f5d [0,4194304] 0 2024-04-18T21:07:03.049 INFO:tasks.workunit.client.0.smithi078.stdout:3/842: creat d4/df/db0/dc5/d41/dda/f108 x:0 0 0 2024-04-18T21:07:03.049 INFO:tasks.workunit.client.0.smithi078.stdout:0/971: creat d0/d9/da/df/dde/f12d x:0 0 0 2024-04-18T21:07:03.050 INFO:tasks.workunit.client.0.smithi078.stdout:7/868: creat d1/d16/d65/d10e/dcf/f125 x:0 0 0 2024-04-18T21:07:03.050 INFO:tasks.workunit.client.0.smithi078.stdout:2/903: read d0/db/d18/d21/d27/d29/f2d [2036720,25206] 0 2024-04-18T21:07:03.051 INFO:tasks.workunit.client.0.smithi078.stdout:8/912: creat d0/d22/d106/f119 x:0 0 0 2024-04-18T21:07:03.051 INFO:tasks.workunit.client.0.smithi078.stdout:5/928: creat d9/da/d32/da5/f124 x:0 0 0 2024-04-18T21:07:03.051 INFO:tasks.workunit.client.0.smithi078.stdout:3/843: creat d4/da/ddf/da0/de5/f109 x:0 0 0 2024-04-18T21:07:03.052 INFO:tasks.workunit.client.0.smithi078.stdout:8/913: chown d0/d10/d60/l9c 241988 1 2024-04-18T21:07:03.052 INFO:tasks.workunit.client.0.smithi078.stdout:2/904: read d0/db/d65/dbd/fc8 [1567512,63677] 0 2024-04-18T21:07:03.052 INFO:tasks.workunit.client.0.smithi078.stdout:2/905: fdatasync d0/f5 0 2024-04-18T21:07:03.053 INFO:tasks.workunit.client.0.smithi078.stdout:6/909: dwrite d2/d74/fb1 [0,4194304] 0 2024-04-18T21:07:03.053 INFO:tasks.workunit.client.0.smithi078.stdout:3/844: symlink d4/da/ddf/da0/de5/l10a 0 2024-04-18T21:07:03.053 INFO:tasks.workunit.client.0.smithi078.stdout:5/929: symlink d9/d2e/d65/de8/df2/l125 0 2024-04-18T21:07:03.053 INFO:tasks.workunit.client.0.smithi078.stdout:8/914: mknod d0/d10/d8d/c11a 0 2024-04-18T21:07:03.054 INFO:tasks.workunit.client.0.smithi078.stdout:2/906: fsync d0/db/d18/d5d/fa2 0 2024-04-18T21:07:03.054 INFO:tasks.workunit.client.0.smithi078.stdout:8/915: stat d0/d10/d14/d62/c77 0 2024-04-18T21:07:03.054 INFO:tasks.workunit.client.0.smithi078.stdout:6/910: creat d2/d1c/d6b/d98/f13e x:0 0 0 2024-04-18T21:07:03.054 INFO:tasks.workunit.client.0.smithi078.stdout:7/869: link d1/d16/d10/d7c/d7e/c87 d1/d16/d1c/c126 0 2024-04-18T21:07:03.055 INFO:tasks.workunit.client.0.smithi078.stdout:3/845: write d4/d2d/d30/d35/f4f [3653839,16460] 0 2024-04-18T21:07:03.055 INFO:tasks.workunit.client.0.smithi078.stdout:2/907: dread - d0/db/d18/d21/d27/d29/d33/f103 zero size 2024-04-18T21:07:03.056 INFO:tasks.workunit.client.0.smithi078.stdout:5/930: read d9/da/d90/d62/fd7 [3695341,370] 0 2024-04-18T21:07:03.057 INFO:tasks.workunit.client.0.smithi078.stdout:7/870: write d1/d16/d65/d10e/f102 [431220,108819] 0 2024-04-18T21:07:03.057 INFO:tasks.workunit.client.0.smithi078.stdout:3/846: creat d4/d2d/d6c/db5/f10b x:0 0 0 2024-04-18T21:07:03.058 INFO:tasks.workunit.client.0.smithi078.stdout:0/972: dwrite d0/d9/d4c/d6b/dd3/f119 [0,4194304] 0 2024-04-18T21:07:03.059 INFO:tasks.workunit.client.0.smithi078.stdout:3/847: chown d4/d2d/d30/fd4 15437571 1 2024-04-18T21:07:03.059 INFO:tasks.workunit.client.0.smithi078.stdout:7/871: readlink d1/d16/d10/d7c/d7e/d97/ld0 0 2024-04-18T21:07:03.061 INFO:tasks.workunit.client.0.smithi078.stdout:5/931: creat d9/da/d90/deb/d118/f126 x:0 0 0 2024-04-18T21:07:03.061 INFO:tasks.workunit.client.0.smithi078.stdout:0/973: unlink d0/d9/dd/d17/d2e/f71 0 2024-04-18T21:07:03.061 INFO:tasks.workunit.client.0.smithi078.stdout:3/848: symlink d4/da/d11/d66/dca/l10c 0 2024-04-18T21:07:03.062 INFO:tasks.workunit.client.0.smithi078.stdout:0/974: stat d0 0 2024-04-18T21:07:03.062 INFO:tasks.workunit.client.0.smithi078.stdout:2/908: dread d0/fe [0,4194304] 0 2024-04-18T21:07:03.063 INFO:tasks.workunit.client.0.smithi078.stdout:6/911: dwrite d2/d1c/d63/d8b/fd1 [0,4194304] 0 2024-04-18T21:07:03.064 INFO:tasks.workunit.client.0.smithi078.stdout:3/849: creat d4/da/d11/d66/f10d x:0 0 0 2024-04-18T21:07:03.064 INFO:tasks.workunit.client.0.smithi078.stdout:2/909: readlink d0/db/d18/l9d 0 2024-04-18T21:07:03.064 INFO:tasks.workunit.client.0.smithi078.stdout:8/916: dwrite d0/d10/d14/d2a/d4a/faf [0,4194304] 0 2024-04-18T21:07:03.065 INFO:tasks.workunit.client.0.smithi078.stdout:2/910: chown d0/d1f/d34/fb7 767566227 1 2024-04-18T21:07:03.065 INFO:tasks.workunit.client.0.smithi078.stdout:6/912: write d2/d6/dd/f42 [1798125,128384] 0 2024-04-18T21:07:03.065 INFO:tasks.workunit.client.0.smithi078.stdout:0/975: mknod d0/d9/da/db/da6/c12e 0 2024-04-18T21:07:03.066 INFO:tasks.workunit.client.0.smithi078.stdout:8/917: mkdir d0/d10/d14/d2a/d4a/db2/db6/dcc/d11b 0 2024-04-18T21:07:03.067 INFO:tasks.workunit.client.0.smithi078.stdout:5/932: link d9/da/d32/l42 d9/d9f/dd4/dee/l127 0 2024-04-18T21:07:03.067 INFO:tasks.workunit.client.0.smithi078.stdout:6/913: creat d2/d1c/d63/d8b/dcb/f13f x:0 0 0 2024-04-18T21:07:03.067 INFO:tasks.workunit.client.0.smithi078.stdout:2/911: getdents d0/d87/d88 0 2024-04-18T21:07:03.067 INFO:tasks.workunit.client.0.smithi078.stdout:0/976: dread - d0/d9/d4c/d6b/de7/f101 zero size 2024-04-18T21:07:03.067 INFO:tasks.workunit.client.0.smithi078.stdout:7/872: dwrite d1/d16/d65/f79 [0,4194304] 0 2024-04-18T21:07:03.068 INFO:tasks.workunit.client.0.smithi078.stdout:8/918: write d0/d10/d60/d6f/fe1 [3257777,74436] 0 2024-04-18T21:07:03.070 INFO:tasks.workunit.client.0.smithi078.stdout:8/919: write d0/f36 [1774292,27126] 0 2024-04-18T21:07:03.070 INFO:tasks.workunit.client.0.smithi078.stdout:0/977: mkdir d0/d9/da/df/de3/d12f 0 2024-04-18T21:07:03.072 INFO:tasks.workunit.client.0.smithi078.stdout:7/873: rename d1/d16/dc/d11/d53/d82/da4/db5/ced to d1/d16/d65/d10e/de6/c127 0 2024-04-18T21:07:03.072 INFO:tasks.workunit.client.0.smithi078.stdout:2/912: fdatasync d0/db/d18/d21/d27/d29/d33/f6a 0 2024-04-18T21:07:03.072 INFO:tasks.workunit.client.0.smithi078.stdout:0/978: symlink d0/d9/dd/d17/d2e/d7f/ddf/l130 0 2024-04-18T21:07:03.074 INFO:tasks.workunit.client.0.smithi078.stdout:0/979: readlink d0/d9/d58/l107 0 2024-04-18T21:07:03.074 INFO:tasks.workunit.client.0.smithi078.stdout:7/874: rmdir d1/d16/dc/d11/d53/d82/da4/db5/d91/db0 39 2024-04-18T21:07:03.074 INFO:tasks.workunit.client.0.smithi078.stdout:6/914: dwrite d2/d1c/d63/d8b/fef [0,4194304] 0 2024-04-18T21:07:03.074 INFO:tasks.workunit.client.0.smithi078.stdout:7/875: readlink d1/d16/dc/d31/lb6 0 2024-04-18T21:07:03.076 INFO:tasks.workunit.client.0.smithi078.stdout:6/915: symlink d2/d34/dce/l140 0 2024-04-18T21:07:03.076 INFO:tasks.workunit.client.0.smithi078.stdout:0/980: write d0/d9/dd/d17/d2e/d31/f91 [442661,35211] 0 2024-04-18T21:07:03.080 INFO:tasks.workunit.client.0.smithi078.stdout:6/916: creat d2/d1c/d63/d8b/dcc/f141 x:0 0 0 2024-04-18T21:07:03.080 INFO:tasks.workunit.client.0.smithi078.stdout:8/920: dwrite d0/f5 [0,4194304] 0 2024-04-18T21:07:03.081 INFO:tasks.workunit.client.0.smithi078.stdout:2/913: dwrite d0/d1f/f7e [0,4194304] 0 2024-04-18T21:07:03.082 INFO:tasks.workunit.client.0.smithi078.stdout:6/917: symlink d2/d1c/d63/da1/db9/l142 0 2024-04-18T21:07:03.083 INFO:tasks.workunit.client.0.smithi078.stdout:2/914: creat d0/db/d65/d96/f11b x:0 0 0 2024-04-18T21:07:03.083 INFO:tasks.workunit.client.0.smithi078.stdout:3/850: dread d4/da/f6d [0,4194304] 0 2024-04-18T21:07:03.085 INFO:tasks.workunit.client.0.smithi078.stdout:3/851: rmdir d4/df 39 2024-04-18T21:07:03.086 INFO:tasks.workunit.client.0.smithi078.stdout:7/876: dwrite d1/d16/dc/d11/d53/d82/da4/db5/d91/db3/f11f [0,4194304] 0 2024-04-18T21:07:03.086 INFO:tasks.workunit.client.0.smithi078.stdout:3/852: mknod d4/d2d/d6c/c10e 0 2024-04-18T21:07:03.087 INFO:tasks.workunit.client.0.smithi078.stdout:2/915: link d0/db/d18/d21/c5f d0/c11c 0 2024-04-18T21:07:03.087 INFO:tasks.workunit.client.0.smithi078.stdout:0/981: dwrite d0/d9/dd/d17/d2e/d31/f4a [0,4194304] 0 2024-04-18T21:07:03.088 INFO:tasks.workunit.client.0.smithi078.stdout:3/853: mkdir d4/dc3/d10f 0 2024-04-18T21:07:03.088 INFO:tasks.workunit.client.0.smithi078.stdout:3/854: chown d4/da/d11/d66/dbe/f101 48539 1 2024-04-18T21:07:03.088 INFO:tasks.workunit.client.0.smithi078.stdout:0/982: creat d0/d9/da/db/da6/f131 x:0 0 0 2024-04-18T21:07:03.089 INFO:tasks.workunit.client.0.smithi078.stdout:3/855: unlink d4/da/d5e/f8a 0 2024-04-18T21:07:03.089 INFO:tasks.workunit.client.0.smithi078.stdout:0/983: chown d0/d9/d58/f11f 77 1 2024-04-18T21:07:03.090 INFO:tasks.workunit.client.0.smithi078.stdout:0/984: mknod d0/d9/d4c/d6b/dd3/c132 0 2024-04-18T21:07:03.091 INFO:tasks.workunit.client.0.smithi078.stdout:0/985: rename d0/d9/d58/cbc to d0/d9/da/db/d35/d3f/dae/c133 0 2024-04-18T21:07:03.094 INFO:tasks.workunit.client.0.smithi078.stdout:0/986: truncate d0/d9/da/db/d35/d3f/dbe/f7c 1076618 0 2024-04-18T21:07:03.094 INFO:tasks.workunit.client.0.smithi078.stdout:0/987: symlink d0/d9/dd/l134 0 2024-04-18T21:07:03.095 INFO:tasks.workunit.client.0.smithi078.stdout:3/856: dwrite d4/da/d76/fba [0,4194304] 0 2024-04-18T21:07:03.096 INFO:tasks.workunit.client.0.smithi078.stdout:0/988: rename d0/d6c/d9d to d0/d9/da/db/d35/d3f/dae/de8/d135 0 2024-04-18T21:07:03.096 INFO:tasks.workunit.client.0.smithi078.stdout:8/921: fdatasync d0/d10/d14/d2a/f8e 0 2024-04-18T21:07:03.098 INFO:tasks.workunit.client.0.smithi078.stdout:7/877: write d1/f3c [1287770,37358] 0 2024-04-18T21:07:03.098 INFO:tasks.workunit.client.0.smithi078.stdout:2/916: truncate d0/db/f36 3049127 0 2024-04-18T21:07:03.099 INFO:tasks.workunit.client.0.smithi078.stdout:8/922: symlink d0/d10/d60/l11c 0 2024-04-18T21:07:03.100 INFO:tasks.workunit.client.0.smithi078.stdout:2/917: creat d0/db/f11d x:0 0 0 2024-04-18T21:07:03.100 INFO:tasks.workunit.client.0.smithi078.stdout:7/878: readlink d1/d16/dc/d11/d53/d82/da4/lbe 0 2024-04-18T21:07:03.101 INFO:tasks.workunit.client.0.smithi078.stdout:8/923: chown d0/d10/d14/fa7 0 1 2024-04-18T21:07:03.101 INFO:tasks.workunit.client.0.smithi078.stdout:7/879: dread - d1/d16/dc/d11/da2/dbc/dc3/fc4 zero size 2024-04-18T21:07:03.102 INFO:tasks.workunit.client.0.smithi078.stdout:2/918: creat d0/db/d18/d21/db0/ddc/ddd/f11e x:0 0 0 2024-04-18T21:07:03.103 INFO:tasks.workunit.client.0.smithi078.stdout:7/880: chown d1/d16/d10/d7c/dc0 3 1 2024-04-18T21:07:03.103 INFO:tasks.workunit.client.0.smithi078.stdout:3/857: dwrite d4/df/f98 [0,4194304] 0 2024-04-18T21:07:03.104 INFO:tasks.workunit.client.0.smithi078.stdout:7/881: chown d1/d16/dc/d11/d53/f58 31857865 1 2024-04-18T21:07:03.105 INFO:tasks.workunit.client.0.smithi078.stdout:0/989: dwrite d0/d9/da/db/d35/d3f/fe0 [0,4194304] 0 2024-04-18T21:07:03.105 INFO:tasks.workunit.client.0.smithi078.stdout:3/858: getdents d4/d2d 0 2024-04-18T21:07:03.105 INFO:tasks.workunit.client.0.smithi078.stdout:3/859: sync 2024-04-18T21:07:03.107 INFO:tasks.workunit.client.0.smithi078.stdout:0/990: unlink d0/d9/d4c/lb7 0 2024-04-18T21:07:03.107 INFO:tasks.workunit.client.0.smithi078.stdout:3/860: readlink d4/da/ddf/lbb 0 2024-04-18T21:07:03.109 INFO:tasks.workunit.client.0.smithi078.stdout:0/991: unlink d0/d9/d4c/d6b/dd3/f10a 0 2024-04-18T21:07:03.110 INFO:tasks.workunit.client.0.smithi078.stdout:2/919: dwrite d0/d1f/d5b/fc6 [0,4194304] 0 2024-04-18T21:07:03.110 INFO:tasks.workunit.client.0.smithi078.stdout:3/861: write d4/df/db0/dc5/d41/dda/de2/ff5 [457450,26896] 0 2024-04-18T21:07:03.112 INFO:tasks.workunit.client.0.smithi078.stdout:0/992: dread - d0/d9/da/db/d35/d3f/dae/fd5 zero size 2024-04-18T21:07:03.112 INFO:tasks.workunit.client.0.smithi078.stdout:7/882: dwrite d1/d16/d65/f84 [0,4194304] 0 2024-04-18T21:07:03.112 INFO:tasks.workunit.client.0.smithi078.stdout:3/862: chown d4/df/db0/dc5/f5a 150761535 1 2024-04-18T21:07:03.113 INFO:tasks.workunit.client.0.smithi078.stdout:0/993: stat d0/d9/da/df/c124 0 2024-04-18T21:07:03.113 INFO:tasks.workunit.client.0.smithi078.stdout:3/863: write d4/f64 [9050777,14863] 0 2024-04-18T21:07:03.115 INFO:tasks.workunit.client.0.smithi078.stdout:2/920: rename d0/d87/d88 to d0/db/d6e/dd2/dd3/d11f 0 2024-04-18T21:07:03.115 INFO:tasks.workunit.client.0.smithi078.stdout:7/883: stat d1/d16/d1c/d40/fa1 0 2024-04-18T21:07:03.115 INFO:tasks.workunit.client.0.smithi078.stdout:7/884: chown d1/d16/dc/d4b/c6f 63 1 2024-04-18T21:07:03.115 INFO:tasks.workunit.client.0.smithi078.stdout:8/924: dwrite d0/d10/fa3 [0,4194304] 0 2024-04-18T21:07:03.115 INFO:tasks.workunit.client.0.smithi078.stdout:5/933: dread d9/da/d8c/daf/ff0 [0,4194304] 0 2024-04-18T21:07:03.116 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:03.118+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:03.116 INFO:tasks.workunit.client.0.smithi078.stdout:2/921: rename d0/db/d65/d96/feb to d0/db/d18/d21/db0/f120 0 2024-04-18T21:07:03.116 INFO:tasks.workunit.client.0.smithi078.stdout:5/934: fdatasync d9/f25 0 2024-04-18T21:07:03.117 INFO:tasks.workunit.client.0.smithi078.stdout:2/922: chown d0/db/d18/d21/d27/d29/fbf 5530 1 2024-04-18T21:07:03.117 INFO:tasks.workunit.client.0.smithi078.stdout:2/923: sync 2024-04-18T21:07:03.118 INFO:tasks.workunit.client.0.smithi078.stdout:2/924: mknod d0/d1f/c121 0 2024-04-18T21:07:03.119 INFO:tasks.workunit.client.0.smithi078.stdout:0/994: dwrite d0/d6c/f92 [0,4194304] 0 2024-04-18T21:07:03.121 INFO:tasks.workunit.client.0.smithi078.stdout:0/995: creat d0/d6c/d80/f136 x:0 0 0 2024-04-18T21:07:03.122 INFO:tasks.workunit.client.0.smithi078.stdout:3/864: dwrite d4/da/f6d [0,4194304] 0 2024-04-18T21:07:03.123 INFO:tasks.workunit.client.0.smithi078.stdout:3/865: write d4/f6a [8712832,83964] 0 2024-04-18T21:07:03.124 INFO:tasks.workunit.client.0.smithi078.stdout:0/996: rename d0/d9/dd/d17/ff2 to d0/d9/da/db/d35/d3f/dae/de8/d135/f137 0 2024-04-18T21:07:03.124 INFO:tasks.workunit.client.0.smithi078.stdout:5/935: dwrite d9/da/d3e/d4c/d6d/d73/f40 [0,4194304] 0 2024-04-18T21:07:03.125 INFO:tasks.workunit.client.0.smithi078.stdout:5/936: write d9/da/d3e/d4c/d6d/d73/f40 [5202901,3562] 0 2024-04-18T21:07:03.126 INFO:tasks.workunit.client.0.smithi078.stdout:5/937: write d9/da/d90/f89 [1037464,117417] 0 2024-04-18T21:07:03.126 INFO:tasks.workunit.client.0.smithi078.stdout:5/938: chown d9/da/d3e/d4c/d6d/d73/ddf/c10d 1554132374 1 2024-04-18T21:07:03.127 INFO:tasks.workunit.client.0.smithi078.stdout:5/939: chown d9/da/d3e/d4c/d6d/d73/ddf/c10d 143 1 2024-04-18T21:07:03.127 INFO:tasks.workunit.client.0.smithi078.stdout:5/940: chown d9/da/d3e/d4c/d6d/d86/d106 6023 1 2024-04-18T21:07:03.128 INFO:tasks.workunit.client.0.smithi078.stdout:5/941: sync 2024-04-18T21:07:03.134 INFO:tasks.workunit.client.0.smithi078.stdout:5/942: read d9/da/de7/fb0 [2447501,40226] 0 2024-04-18T21:07:03.134 INFO:tasks.workunit.client.0.smithi078.stdout:8/925: dread d0/d22/fb8 [0,4194304] 0 2024-04-18T21:07:03.134 INFO:tasks.workunit.client.0.smithi078.stdout:5/943: dread - d9/da/d90/deb/d118/f126 zero size 2024-04-18T21:07:03.135 INFO:tasks.workunit.client.0.smithi078.stdout:5/944: write d9/da/f35 [3355358,25292] 0 2024-04-18T21:07:03.139 INFO:tasks.workunit.client.0.smithi078.stdout:8/926: dwrite d0/f89 [0,4194304] 0 2024-04-18T21:07:03.141 INFO:tasks.workunit.client.0.smithi078.stdout:6/918: dread d2/d1c/d63/d8b/fb5 [0,4194304] 0 2024-04-18T21:07:03.141 INFO:tasks.workunit.client.0.smithi078.stdout:5/945: dwrite d9/d2e/fd2 [0,4194304] 0 2024-04-18T21:07:03.141 INFO:tasks.workunit.client.0.smithi078.stdout:8/927: truncate d0/d10/d14/f1e 1321296 0 2024-04-18T21:07:03.142 INFO:tasks.workunit.client.0.smithi078.stdout:5/946: unlink d9/d2e/l7d 0 2024-04-18T21:07:03.144 INFO:tasks.workunit.client.0.smithi078.stdout:6/919: mknod d2/d1c/d63/da1/db9/c143 0 2024-04-18T21:07:03.144 INFO:tasks.workunit.client.0.smithi078.stdout:8/928: rename d0/d10/d14/d2a/fb1 to d0/d5c/d5a/d7b/f11d 0 2024-04-18T21:07:03.144 INFO:tasks.workunit.client.0.smithi078.stdout:5/947: stat d9/da/d3e/d4c/d67/f91 0 2024-04-18T21:07:03.145 INFO:tasks.workunit.client.0.smithi078.stdout:6/920: creat d2/dbf/f144 x:0 0 0 2024-04-18T21:07:03.145 INFO:tasks.workunit.client.0.smithi078.stdout:8/929: symlink d0/d10/d14/d2a/d4a/db2/l11e 0 2024-04-18T21:07:03.146 INFO:tasks.workunit.client.0.smithi078.stdout:8/930: creat d0/d10/d14/d2a/dbd/f11f x:0 0 0 2024-04-18T21:07:03.150 INFO:tasks.workunit.client.0.smithi078.stdout:5/948: dwrite d9/da/d8c/f116 [0,4194304] 0 2024-04-18T21:07:03.151 INFO:tasks.workunit.client.0.smithi078.stdout:6/921: dwrite d2/d1c/d63/da1/db9/f10f [0,4194304] 0 2024-04-18T21:07:03.153 INFO:tasks.workunit.client.0.smithi078.stdout:8/931: truncate d0/d5c/d5a/d7b/f11d 449721 0 2024-04-18T21:07:03.153 INFO:tasks.workunit.client.0.smithi078.stdout:6/922: symlink d2/d1c/d6b/dba/deb/l145 0 2024-04-18T21:07:03.155 INFO:tasks.workunit.client.0.smithi078.stdout:6/923: creat d2/d1c/f146 x:0 0 0 2024-04-18T21:07:03.158 INFO:tasks.workunit.client.0.smithi078.stdout:5/949: dwrite d9/d9f/dd4/f11f [0,4194304] 0 2024-04-18T21:07:03.159 INFO:tasks.workunit.client.0.smithi078.stdout:2/925: dread d0/d1f/d34/dd6/ff5 [0,4194304] 0 2024-04-18T21:07:03.159 INFO:tasks.workunit.client.0.smithi078.stdout:2/926: sync 2024-04-18T21:07:03.161 INFO:tasks.workunit.client.0.smithi078.stdout:5/950: getdents d9/da/d99 0 2024-04-18T21:07:03.162 INFO:tasks.workunit.client.0.smithi078.stdout:2/927: mkdir d0/db/d18/d21/de1/d122 0 2024-04-18T21:07:03.162 INFO:tasks.workunit.client.0.smithi078.stdout:2/928: sync 2024-04-18T21:07:03.162 INFO:tasks.workunit.client.0.smithi078.stdout:8/932: dwrite d0/d10/d14/d2a/d4a/f56 [0,4194304] 0 2024-04-18T21:07:03.163 INFO:tasks.workunit.client.0.smithi078.stdout:5/951: symlink d9/l128 0 2024-04-18T21:07:03.164 INFO:tasks.workunit.client.0.smithi078.stdout:2/929: creat d0/db/d18/d21/d27/d29/de3/f123 x:0 0 0 2024-04-18T21:07:03.164 INFO:tasks.workunit.client.0.smithi078.stdout:8/933: rmdir d0/d10/d14/d2a/ddd 39 2024-04-18T21:07:03.164 INFO:tasks.workunit.client.0.smithi078.stdout:5/952: rename d9/d2e/d65 to d9/d9f/dd4/dee/def/dc1/d129 0 2024-04-18T21:07:03.166 INFO:tasks.workunit.client.0.smithi078.stdout:2/930: getdents d0/db/d18/d21/d27/d29 0 2024-04-18T21:07:03.167 INFO:tasks.workunit.client.0.smithi078.stdout:2/931: truncate d0/d1f/d34/fc9 274635 0 2024-04-18T21:07:03.168 INFO:tasks.workunit.client.0.smithi078.stdout:6/924: dread d2/d1c/db3/dbb/fee [0,4194304] 0 2024-04-18T21:07:03.168 INFO:tasks.workunit.client.0.smithi078.stdout:3/866: dread d4/df/d62/fac [0,4194304] 0 2024-04-18T21:07:03.168 INFO:tasks.workunit.client.0.smithi078.stdout:2/932: unlink d0/f32 0 2024-04-18T21:07:03.168 INFO:tasks.workunit.client.0.smithi078.stdout:6/925: readlink d2/d1c/d6b/dba/deb/la6 0 2024-04-18T21:07:03.169 INFO:tasks.workunit.client.0.smithi078.stdout:3/867: symlink d4/d2d/d30/d35/l110 0 2024-04-18T21:07:03.170 INFO:tasks.workunit.client.0.smithi078.stdout:8/934: dwrite d0/d10/d14/f9a [0,4194304] 0 2024-04-18T21:07:03.171 INFO:tasks.workunit.client.0.smithi078.stdout:8/935: creat d0/d10/d14/d2d/d93/da0/f120 x:0 0 0 2024-04-18T21:07:03.172 INFO:tasks.workunit.client.0.smithi078.stdout:8/936: write d0/d10/d14/d2a/fbe [4443330,87447] 0 2024-04-18T21:07:03.174 INFO:tasks.workunit.client.0.smithi078.stdout:2/933: truncate d0/d1f/f7e 4630370 0 2024-04-18T21:07:03.179 INFO:tasks.workunit.client.0.smithi078.stdout:5/953: dread d9/da/d3e/d4c/d67/f91 [0,4194304] 0 2024-04-18T21:07:03.179 INFO:tasks.workunit.client.0.smithi078.stdout:2/934: dwrite d0/d1f/d5b/fad [0,4194304] 0 2024-04-18T21:07:03.180 INFO:tasks.workunit.client.0.smithi078.stdout:5/954: stat d9/da/d3e/d4c/db1/db8/lbf 0 2024-04-18T21:07:03.181 INFO:tasks.workunit.client.0.smithi078.stdout:5/955: rmdir d9/da/d3e/d4c/d6d/d86 39 2024-04-18T21:07:03.181 INFO:tasks.workunit.client.0.smithi078.stdout:2/935: mknod d0/db/d18/d21/db0/ddc/ddd/c124 0 2024-04-18T21:07:03.182 INFO:tasks.workunit.client.0.smithi078.stdout:5/956: symlink d9/da/d3e/d4c/d6d/l12a 0 2024-04-18T21:07:03.182 INFO:tasks.workunit.client.0.smithi078.stdout:2/936: write d0/db/d18/d21/db0/fdb [7590284,60243] 0 2024-04-18T21:07:03.183 INFO:tasks.workunit.client.0.smithi078.stdout:2/937: chown d0/fae 1692777 1 2024-04-18T21:07:03.183 INFO:tasks.workunit.client.0.smithi078.stdout:2/938: truncate d0/db/d18/d21/d27/d29/f69 2885889 0 2024-04-18T21:07:03.185 INFO:tasks.workunit.client.0.smithi078.stdout:2/939: creat d0/db/d18/d21/d27/d29/d57/f125 x:0 0 0 2024-04-18T21:07:03.185 INFO:tasks.workunit.client.0.smithi078.stdout:2/940: sync 2024-04-18T21:07:03.187 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:07:03.187 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:07:03.187 INFO:teuthology.orchestra.run.smithi132.stdout: "complaint_time": 30, 2024-04-18T21:07:03.187 INFO:teuthology.orchestra.run.smithi132.stdout: "num_blocked_ops": 0 2024-04-18T21:07:03.187 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:07:03.188 INFO:tasks.workunit.client.0.smithi078.stdout:5/957: dwrite d9/da/d3e/d4c/d6d/d73/fc3 [0,4194304] 0 2024-04-18T21:07:03.191 INFO:tasks.workunit.client.0.smithi078.stdout:5/958: mknod d9/da/d32/c12b 0 2024-04-18T21:07:03.191 INFO:tasks.workunit.client.0.smithi078.stdout:2/941: dwrite d0/db/d18/d21/d27/d29/d33/f76 [0,4194304] 0 2024-04-18T21:07:03.192 INFO:tasks.workunit.client.0.smithi078.stdout:3/868: dread d4/df/db0/dc5/d41/dda/de2/ff5 [0,4194304] 0 2024-04-18T21:07:03.192 INFO:tasks.workunit.client.0.smithi078.stdout:6/926: dread d2/d1c/d6b/d98/f99 [0,4194304] 0 2024-04-18T21:07:03.193 INFO:tasks.workunit.client.0.smithi078.stdout:6/927: chown d2/d6/f14 6 1 2024-04-18T21:07:03.193 INFO:tasks.workunit.client.0.smithi078.stdout:3/869: creat d4/da/d5e/f111 x:0 0 0 2024-04-18T21:07:03.194 INFO:tasks.workunit.client.0.smithi078.stdout:2/942: link d0/db/d18/dbb/fd9 d0/db/d18/d21/f126 0 2024-04-18T21:07:03.194 INFO:tasks.workunit.client.0.smithi078.stdout:3/870: fdatasync d4/d2d/d30/d35/d4b/d59/f5f 0 2024-04-18T21:07:03.194 INFO:tasks.workunit.client.0.smithi078.stdout:6/928: mknod d2/d34/d35/c147 0 2024-04-18T21:07:03.194 INFO:tasks.workunit.client.0.smithi078.stdout:6/929: sync 2024-04-18T21:07:03.195 INFO:tasks.workunit.client.0.smithi078.stdout:6/930: stat d2/d1c/d6b/dba/cbc 0 2024-04-18T21:07:03.195 INFO:tasks.workunit.client.0.smithi078.stdout:3/871: write d4/d2d/d30/d35/d4b/d59/f9a [3003874,81] 0 2024-04-18T21:07:03.195 INFO:tasks.workunit.client.0.smithi078.stdout:2/943: symlink d0/db/d6e/dd2/dd3/d11f/l127 0 2024-04-18T21:07:03.196 INFO:tasks.workunit.client.0.smithi078.stdout:6/931: fsync d2/d1c/d6b/dba/f11e 0 2024-04-18T21:07:03.196 INFO:tasks.workunit.client.0.smithi078.stdout:2/944: chown d0/db/d18/d21/db0/ddc/ddd/c124 7 1 2024-04-18T21:07:03.196 INFO:tasks.workunit.client.0.smithi078.stdout:6/932: fdatasync d2/d1c/d6b/d98/f13e 0 2024-04-18T21:07:03.197 INFO:tasks.workunit.client.0.smithi078.stdout:3/872: rename d4/da/d5e/l95 to d4/dc3/d10f/l112 0 2024-04-18T21:07:03.197 INFO:tasks.workunit.client.0.smithi078.stdout:3/873: write d4/da/d11/f97 [252175,41952] 0 2024-04-18T21:07:03.197 INFO:tasks.workunit.client.0.smithi078.stdout:2/945: truncate d0/d1f/d34/f81 1495890 0 2024-04-18T21:07:03.198 INFO:tasks.workunit.client.0.smithi078.stdout:2/946: chown d0/db/d18/d21/d27/d29/de3/dfc 26043895 1 2024-04-18T21:07:03.198 INFO:tasks.workunit.client.0.smithi078.stdout:3/874: creat d4/da/d76/f113 x:0 0 0 2024-04-18T21:07:03.199 INFO:tasks.workunit.client.0.smithi078.stdout:2/947: write d0/d1f/f43 [1172733,5910] 0 2024-04-18T21:07:03.202 INFO:tasks.workunit.client.0.smithi078.stdout:2/948: truncate d0/db/d18/d21/d27/d29/fbf 531410 0 2024-04-18T21:07:03.203 INFO:tasks.workunit.client.0.smithi078.stdout:5/959: dwrite d9/da/d3e/f59 [0,4194304] 0 2024-04-18T21:07:03.203 INFO:tasks.workunit.client.0.smithi078.stdout:2/949: truncate d0/f55 8939816 0 2024-04-18T21:07:03.203 INFO:tasks.workunit.client.0.smithi078.stdout:6/933: dwrite d2/d1c/d6b/dba/deb/f138 [0,4194304] 0 2024-04-18T21:07:03.204 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:07:03.204 INFO:tasks.workunit.client.0.smithi078.stdout:7/885: dread d1/d16/d10/f13 [0,4194304] 0 2024-04-18T21:07:03.205 INFO:tasks.workunit.client.0.smithi078.stdout:7/886: chown d1/d16/d65/d10e 477638 1 2024-04-18T21:07:03.206 INFO:tasks.workunit.client.0.smithi078.stdout:3/875: dread d4/da/f4a [0,4194304] 0 2024-04-18T21:07:03.206 INFO:tasks.workunit.client.0.smithi078.stdout:5/960: rmdir d9/da/d32/da5/de5 39 2024-04-18T21:07:03.206 INFO:tasks.workunit.client.0.smithi078.stdout:6/934: creat d2/d1c/d6b/dba/f148 x:0 0 0 2024-04-18T21:07:03.207 INFO:tasks.workunit.client.0.smithi078.stdout:7/887: rmdir d1/d16/d65/d10e/dcf 39 2024-04-18T21:07:03.207 INFO:tasks.workunit.client.0.smithi078.stdout:2/950: rename d0/db/d18/d5d/l100 to d0/db/d18/d21/d27/d29/d33/l128 0 2024-04-18T21:07:03.207 INFO:tasks.workunit.client.0.smithi078.stdout:3/876: sync 2024-04-18T21:07:03.207 INFO:tasks.workunit.client.0.smithi078.stdout:6/935: symlink d2/dbf/l149 0 2024-04-18T21:07:03.207 INFO:tasks.workunit.client.0.smithi078.stdout:5/961: dread - d9/da/d4b/d8b/fcf zero size 2024-04-18T21:07:03.207 INFO:tasks.workunit.client.0.smithi078.stdout:3/877: creat d4/df/db0/f114 x:0 0 0 2024-04-18T21:07:03.208 INFO:tasks.workunit.client.0.smithi078.stdout:2/951: creat d0/d1f/d34/f129 x:0 0 0 2024-04-18T21:07:03.208 INFO:tasks.workunit.client.0.smithi078.stdout:3/878: fsync d4/da/d11/d66/deb/fff 0 2024-04-18T21:07:03.210 INFO:tasks.workunit.client.0.smithi078.stdout:3/879: mknod d4/df/db0/dc5/d41/dfd/c115 0 2024-04-18T21:07:03.210 INFO:tasks.workunit.client.0.smithi078.stdout:2/952: symlink d0/l12a 0 2024-04-18T21:07:03.210 INFO:tasks.workunit.client.0.smithi078.stdout:7/888: rename d1/d16/f4e to d1/f128 0 2024-04-18T21:07:03.211 INFO:tasks.workunit.client.0.smithi078.stdout:3/880: symlink d4/da/d5e/l116 0 2024-04-18T21:07:03.212 INFO:tasks.workunit.client.0.smithi078.stdout:7/889: fdatasync d1/f57 0 2024-04-18T21:07:03.212 INFO:tasks.workunit.client.0.smithi078.stdout:5/962: getdents d9/da 0 2024-04-18T21:07:03.212 INFO:tasks.workunit.client.0.smithi078.stdout:7/890: sync 2024-04-18T21:07:03.212 INFO:tasks.workunit.client.0.smithi078.stdout:0/997: dread d0/d9/da/db/f33 [0,4194304] 0 2024-04-18T21:07:03.213 INFO:tasks.workunit.client.0.smithi078.stdout:3/881: fdatasync d4/da/d11/d66/dbe/f101 0 2024-04-18T21:07:03.213 INFO:tasks.workunit.client.0.smithi078.stdout:7/891: chown d1/d32/f66 1272 1 2024-04-18T21:07:03.213 INFO:tasks.workunit.client.0.smithi078.stdout:2/953: creat d0/db/d18/d21/d27/d29/d57/d7c/f12b x:0 0 0 2024-04-18T21:07:03.214 INFO:tasks.workunit.client.0.smithi078.stdout:6/936: dwrite d2/d1c/d6b/d98/f99 [0,4194304] 0 2024-04-18T21:07:03.214 INFO:tasks.workunit.client.0.smithi078.stdout:0/998: creat d0/d9/da/db/f138 x:0 0 0 2024-04-18T21:07:03.215 INFO:tasks.workunit.client.0.smithi078.stdout:0/999: write d0/d9/d4c/fe4 [276808,119569] 0 2024-04-18T21:07:03.216 INFO:tasks.workunit.client.0.smithi078.stdout:5/963: write d9/da/d3e/d4c/d67/f96 [858518,29958] 0 2024-04-18T21:07:03.216 INFO:tasks.workunit.client.0.smithi078.stdout:7/892: mkdir d1/d16/d65/d10e/de6/d129 0 2024-04-18T21:07:03.216 INFO:tasks.workunit.client.0.smithi078.stdout:6/937: unlink d2/d1c/d6b/f8a 0 2024-04-18T21:07:03.218 INFO:tasks.workunit.client.0.smithi078.stdout:6/938: creat d2/f14a x:0 0 0 2024-04-18T21:07:03.218 INFO:tasks.workunit.client.0.smithi078.stdout:7/893: unlink d1/d16/dc/d11/d53/d82/da4/db5/cdb 0 2024-04-18T21:07:03.219 INFO:tasks.workunit.client.0.smithi078.stdout:6/939: mknod d2/d1c/d6b/d98/c14b 0 2024-04-18T21:07:03.220 INFO:tasks.workunit.client.0.smithi078.stdout:7/894: mknod d1/d16/dc/d11/d53/d82/da4/c12a 0 2024-04-18T21:07:03.222 INFO:tasks.workunit.client.0.smithi078.stdout:8/937: dread d0/d10/d14/fa7 [0,4194304] 0 2024-04-18T21:07:03.222 INFO:tasks.workunit.client.0.smithi078.stdout:3/882: dwrite d4/da/f4a [0,4194304] 0 2024-04-18T21:07:03.222 INFO:tasks.workunit.client.0.smithi078.stdout:7/895: readlink d1/d16/d10/d7c/d7e/d97/ld0 0 2024-04-18T21:07:03.222 INFO:tasks.workunit.client.0.smithi078.stdout:6/940: getdents d2/d1c/db3/dbb/df1 0 2024-04-18T21:07:03.222 INFO:tasks.workunit.client.0.smithi078.stdout:6/941: stat d2/ff 0 2024-04-18T21:07:03.222 INFO:tasks.workunit.client.0.smithi078.stdout:6/942: sync 2024-04-18T21:07:03.223 INFO:tasks.workunit.client.0.smithi078.stdout:3/883: chown d4/d2d/d30/d35/c106 646504261 1 2024-04-18T21:07:03.223 INFO:tasks.workunit.client.0.smithi078.stdout:8/938: creat d0/d10/d8d/f121 x:0 0 0 2024-04-18T21:07:03.223 INFO:tasks.workunit.client.0.smithi078.stdout:6/943: write d2/d1c/f146 [255347,96499] 0 2024-04-18T21:07:03.224 INFO:tasks.workunit.client.0.smithi078.stdout:3/884: creat d4/d2d/d30/d35/f117 x:0 0 0 2024-04-18T21:07:03.224 INFO:tasks.workunit.client.0.smithi078.stdout:5/964: dwrite d9/da/d3e/d4c/d67/d7c/f113 [0,4194304] 0 2024-04-18T21:07:03.224 INFO:tasks.workunit.client.0.smithi078.stdout:6/944: fdatasync d2/d1f/f2c 0 2024-04-18T21:07:03.225 INFO:tasks.workunit.client.0.smithi078.stdout:6/945: dread - d2/d1c/d63/d8b/dcc/f141 zero size 2024-04-18T21:07:03.225 INFO:tasks.workunit.client.0.smithi078.stdout:5/965: chown d9/da/d3e/d4c/d6d/d73/ld5 490 1 2024-04-18T21:07:03.226 INFO:tasks.workunit.client.0.smithi078.stdout:5/966: rmdir d9/da/d3e/d4c/d79 39 2024-04-18T21:07:03.227 INFO:tasks.workunit.client.0.smithi078.stdout:7/896: write d1/f18 [381299,57543] 0 2024-04-18T21:07:03.228 INFO:tasks.workunit.client.0.smithi078.stdout:7/897: mknod d1/d16/c12b 0 2024-04-18T21:07:03.228 INFO:tasks.workunit.client.0.smithi078.stdout:7/898: creat d1/d16/dc/d31/dee/f12c x:0 0 0 2024-04-18T21:07:03.229 INFO:tasks.workunit.client.0.smithi078.stdout:3/885: rename d4/d2d/d30 to d4/da/ddf/dc4/d118 0 2024-04-18T21:07:03.230 INFO:tasks.workunit.client.0.smithi078.stdout:3/886: rmdir d4/da/ddf/dc4/d118/d35/d71 39 2024-04-18T21:07:03.231 INFO:tasks.workunit.client.0.smithi078.stdout:3/887: truncate d4/da/ddf/dc4/d118/fd4 996132 0 2024-04-18T21:07:03.232 INFO:tasks.workunit.client.0.smithi078.stdout:3/888: readlink d4/da/d11/l3e 0 2024-04-18T21:07:03.232 INFO:tasks.workunit.client.0.smithi078.stdout:5/967: dwrite d9/da/de7/fb0 [0,4194304] 0 2024-04-18T21:07:03.234 INFO:tasks.workunit.client.0.smithi078.stdout:7/899: dwrite d1/d16/d10/d5a/f76 [4194304,4194304] 0 2024-04-18T21:07:03.234 INFO:tasks.workunit.client.0.smithi078.stdout:5/968: link d9/da/d3e/d4c/d67/d7c/fac d9/da/d3e/d4c/d67/f12c 0 2024-04-18T21:07:03.235 INFO:tasks.workunit.client.0.smithi078.stdout:7/900: chown d1/d16/dc/d11/d53/d82/da4/db5/d91/cce 208 1 2024-04-18T21:07:03.236 INFO:tasks.workunit.client.0.smithi078.stdout:7/901: write d1/d16/d2d/f36 [1056741,65198] 0 2024-04-18T21:07:03.237 INFO:tasks.workunit.client.0.smithi078.stdout:7/902: stat d1/d16/dc/d11/f2b 0 2024-04-18T21:07:03.238 INFO:tasks.workunit.client.0.smithi078.stdout:7/903: unlink d1/d16/dc/f5b 0 2024-04-18T21:07:03.239 INFO:tasks.workunit.client.0.smithi078.stdout:7/904: write d1/d16/dc/d11/f24 [3113122,94119] 0 2024-04-18T21:07:03.240 INFO:tasks.workunit.client.0.smithi078.stdout:3/889: truncate d4/d2d/f55 3907586 0 2024-04-18T21:07:03.241 INFO:tasks.workunit.client.0.smithi078.stdout:5/969: dwrite d9/fe [0,4194304] 0 2024-04-18T21:07:03.241 INFO:tasks.workunit.client.0.smithi078.stdout:6/946: dread d2/d6/dd/ff7 [0,4194304] 0 2024-04-18T21:07:03.243 INFO:tasks.workunit.client.0.smithi078.stdout:7/905: mkdir d1/d16/dc/d31/de8/d12d 0 2024-04-18T21:07:03.244 INFO:tasks.workunit.client.0.smithi078.stdout:5/970: fsync d9/da/d3e/d4c/d6d/d86/f11a 0 2024-04-18T21:07:03.244 INFO:tasks.workunit.client.0.smithi078.stdout:6/947: fdatasync d2/d1f/f25 0 2024-04-18T21:07:03.244 INFO:tasks.workunit.client.0.smithi078.stdout:3/890: link d4/da/ddf/dc4/d118/d35/d4b/f9c d4/da/f119 0 2024-04-18T21:07:03.244 INFO:tasks.workunit.client.0.smithi078.stdout:7/906: dread - d1/d16/d2d/fb7 zero size 2024-04-18T21:07:03.245 INFO:tasks.workunit.client.0.smithi078.stdout:6/948: creat d2/f14c x:0 0 0 2024-04-18T21:07:03.245 INFO:tasks.workunit.client.0.smithi078.stdout:7/907: write d1/d16/dc/d11/da2/dbc/dc3/fc4 [794754,79717] 0 2024-04-18T21:07:03.246 INFO:tasks.workunit.client.0.smithi078.stdout:6/949: mknod d2/d34/d75/c14d 0 2024-04-18T21:07:03.246 INFO:tasks.workunit.client.0.smithi078.stdout:3/891: truncate d4/da/ddf/dc4/d118/d35/d4b/f65 1490512 0 2024-04-18T21:07:03.247 INFO:tasks.workunit.client.0.smithi078.stdout:5/971: truncate d9/da/d3e/d4c/d67/d7c/d78/fbb 350631 0 2024-04-18T21:07:03.247 INFO:tasks.workunit.client.0.smithi078.stdout:7/908: mkdir d1/d16/d65/d12e 0 2024-04-18T21:07:03.247 INFO:tasks.workunit.client.0.smithi078.stdout:6/950: unlink d2/d74/fb8 0 2024-04-18T21:07:03.247 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:03.250+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:03.248 INFO:tasks.workunit.client.0.smithi078.stdout:3/892: mkdir d4/da/ddf/dc4/d118/d35/d4b/d11a 0 2024-04-18T21:07:03.248 INFO:tasks.workunit.client.0.smithi078.stdout:6/951: unlink d2/d1c/l4d 0 2024-04-18T21:07:03.248 INFO:tasks.workunit.client.0.smithi078.stdout:6/952: fdatasync d2/d34/f77 0 2024-04-18T21:07:03.248 INFO:tasks.workunit.client.0.smithi078.stdout:5/972: dread d9/da/d3e/d4c/d67/f12c [0,4194304] 0 2024-04-18T21:07:03.249 INFO:tasks.workunit.client.0.smithi078.stdout:7/909: link d1/d16/d10/c25 d1/d16/d10/d7c/d7e/de3/c12f 0 2024-04-18T21:07:03.249 INFO:tasks.workunit.client.0.smithi078.stdout:3/893: creat d4/da/f11b x:0 0 0 2024-04-18T21:07:03.249 INFO:tasks.workunit.client.0.smithi078.stdout:5/973: sync 2024-04-18T21:07:03.249 INFO:tasks.workunit.client.0.smithi078.stdout:5/974: sync 2024-04-18T21:07:03.250 INFO:tasks.workunit.client.0.smithi078.stdout:6/953: mkdir d2/d1c/db3/dbb/df1/d14e 0 2024-04-18T21:07:03.250 INFO:tasks.workunit.client.0.smithi078.stdout:5/975: creat d9/da/d99/f12d x:0 0 0 2024-04-18T21:07:03.250 INFO:tasks.workunit.client.0.smithi078.stdout:3/894: rename d4/da/fc7 to d4/d2d/d6c/f11c 0 2024-04-18T21:07:03.250 INFO:tasks.workunit.client.0.smithi078.stdout:5/976: mknod d9/da/d3e/d4c/d6d/c12e 0 2024-04-18T21:07:03.251 INFO:tasks.workunit.client.0.smithi078.stdout:7/910: dread d1/d16/d1c/d40/fa1 [0,4194304] 0 2024-04-18T21:07:03.252 INFO:tasks.workunit.client.0.smithi078.stdout:7/911: creat d1/d16/dc/d11/da2/dbc/f130 x:0 0 0 2024-04-18T21:07:03.252 INFO:tasks.workunit.client.0.smithi078.stdout:7/912: creat d1/d16/d10/d7c/f131 x:0 0 0 2024-04-18T21:07:03.256 INFO:tasks.workunit.client.0.smithi078.stdout:3/895: truncate d4/f6a 1256698 0 2024-04-18T21:07:03.258 INFO:tasks.workunit.client.0.smithi078.stdout:3/896: mkdir d4/d2d/d11d 0 2024-04-18T21:07:03.258 INFO:tasks.workunit.client.0.smithi078.stdout:2/954: dread d0/d1f/d34/dd5/f80 [0,4194304] 0 2024-04-18T21:07:03.259 INFO:tasks.workunit.client.0.smithi078.stdout:7/913: dwrite d1/d16/d1c/d40/f8e [0,4194304] 0 2024-04-18T21:07:03.259 INFO:tasks.workunit.client.0.smithi078.stdout:3/897: creat d4/df/f11e x:0 0 0 2024-04-18T21:07:03.259 INFO:tasks.workunit.client.0.smithi078.stdout:2/955: read - d0/db/fec zero size 2024-04-18T21:07:03.259 INFO:tasks.workunit.client.0.smithi078.stdout:3/898: fdatasync d4/f64 0 2024-04-18T21:07:03.260 INFO:tasks.workunit.client.0.smithi078.stdout:2/956: symlink d0/d1f/d34/dd6/l12c 0 2024-04-18T21:07:03.260 INFO:tasks.workunit.client.0.smithi078.stdout:5/977: dwrite d9/fb [0,4194304] 0 2024-04-18T21:07:03.262 INFO:tasks.workunit.client.0.smithi078.stdout:3/899: mkdir d4/d11f 0 2024-04-18T21:07:03.262 INFO:tasks.workunit.client.0.smithi078.stdout:6/954: read d2/d34/fa5 [126132,21843] 0 2024-04-18T21:07:03.263 INFO:tasks.workunit.client.0.smithi078.stdout:5/978: unlink d9/c103 0 2024-04-18T21:07:03.263 INFO:tasks.workunit.client.0.smithi078.stdout:2/957: creat d0/d1f/f12d x:0 0 0 2024-04-18T21:07:03.263 INFO:tasks.workunit.client.0.smithi078.stdout:6/955: symlink d2/d1c/db3/dbb/df1/d14e/l14f 0 2024-04-18T21:07:03.263 INFO:tasks.workunit.client.0.smithi078.stdout:3/900: link d4/cf3 d4/c120 0 2024-04-18T21:07:03.263 INFO:tasks.workunit.client.0.smithi078.stdout:2/958: mknod d0/d87/c12e 0 2024-04-18T21:07:03.264 INFO:tasks.workunit.client.0.smithi078.stdout:5/979: truncate d9/d2e/f76 6575118 0 2024-04-18T21:07:03.264 INFO:tasks.workunit.client.0.smithi078.stdout:2/959: write d0/f2e [2654084,76891] 0 2024-04-18T21:07:03.265 INFO:tasks.workunit.client.0.smithi078.stdout:6/956: write d2/d1c/d6b/dba/f148 [665059,16037] 0 2024-04-18T21:07:03.265 INFO:tasks.workunit.client.0.smithi078.stdout:3/901: write d4/df/db0/dd9/ffc [136800,94996] 0 2024-04-18T21:07:03.265 INFO:tasks.workunit.client.0.smithi078.stdout:5/980: readlink d9/da/d3e/d4c/d6d/le9 0 2024-04-18T21:07:03.265 INFO:tasks.workunit.client.0.smithi078.stdout:3/902: dread - d4/da/d5e/de0/ff7 zero size 2024-04-18T21:07:03.266 INFO:tasks.workunit.client.0.smithi078.stdout:2/960: truncate d0/d1f/d34/dd5/fcc 5190212 0 2024-04-18T21:07:03.266 INFO:tasks.workunit.client.0.smithi078.stdout:5/981: rename d9/fb to d9/d9f/dd4/dee/def/dc1/d129/daa/f12f 0 2024-04-18T21:07:03.267 INFO:tasks.workunit.client.0.smithi078.stdout:3/903: write d4/da/ddf/dc4/d118/f9f [99615,98284] 0 2024-04-18T21:07:03.267 INFO:tasks.workunit.client.0.smithi078.stdout:5/982: mkdir d9/da/d3e/d4c/d67/d7c/dfd/d130 0 2024-04-18T21:07:03.268 INFO:tasks.workunit.client.0.smithi078.stdout:3/904: fdatasync d4/da/ddf/dc4/d118/d35/d71/f9e 0 2024-04-18T21:07:03.269 INFO:tasks.workunit.client.0.smithi078.stdout:8/939: dread d0/d10/d14/f29 [0,4194304] 0 2024-04-18T21:07:03.269 INFO:tasks.workunit.client.0.smithi078.stdout:5/983: truncate d9/da/d3e/d4c/d6d/d73/ff1 877072 0 2024-04-18T21:07:03.269 INFO:tasks.workunit.client.0.smithi078.stdout:3/905: write d4/da/d11/d66/f93 [1982105,83158] 0 2024-04-18T21:07:03.270 INFO:tasks.workunit.client.0.smithi078.stdout:6/957: dread d2/d1c/d3a/fd0 [0,4194304] 0 2024-04-18T21:07:03.270 INFO:tasks.workunit.client.0.smithi078.stdout:5/984: mkdir d9/da/d99/d131 0 2024-04-18T21:07:03.270 INFO:tasks.workunit.client.0.smithi078.stdout:8/940: write d0/d10/d14/f70 [1237031,81514] 0 2024-04-18T21:07:03.271 INFO:tasks.workunit.client.0.smithi078.stdout:3/906: write d4/da/ddf/da0/de5/f109 [264481,17843] 0 2024-04-18T21:07:03.271 INFO:tasks.workunit.client.0.smithi078.stdout:6/958: write d2/d1c/d3a/d124/f132 [98051,20781] 0 2024-04-18T21:07:03.272 INFO:tasks.workunit.client.0.smithi078.stdout:8/941: fdatasync d0/d10/d14/d2a/f71 0 2024-04-18T21:07:03.273 INFO:tasks.workunit.client.0.smithi078.stdout:6/959: symlink d2/d1c/d30/l150 0 2024-04-18T21:07:03.273 INFO:tasks.workunit.client.0.smithi078.stdout:6/960: unlink d2/d1c/d63/da0/ccd 0 2024-04-18T21:07:03.274 INFO:tasks.workunit.client.0.smithi078.stdout:8/942: rename d0/d10/d14/d2a/f8e to d0/d10/d14/d2d/d93/da0/db5/dd2/f122 0 2024-04-18T21:07:03.274 INFO:tasks.workunit.client.0.smithi078.stdout:2/961: dwrite d0/db/d18/d21/d27/d29/f2d [0,4194304] 0 2024-04-18T21:07:03.274 INFO:tasks.workunit.client.0.smithi078.stdout:6/961: creat d2/d1c/d6b/f151 x:0 0 0 2024-04-18T21:07:03.274 INFO:tasks.workunit.client.0.smithi078.stdout:2/962: readlink d0/db/d18/dbb/l113 0 2024-04-18T21:07:03.275 INFO:tasks.workunit.client.0.smithi078.stdout:8/943: write d0/d10/d14/d2d/d93/da0/db5/d103/f10a [481322,127878] 0 2024-04-18T21:07:03.276 INFO:tasks.workunit.client.0.smithi078.stdout:7/914: dread d1/d16/dc/d11/d53/f58 [0,4194304] 0 2024-04-18T21:07:03.278 INFO:tasks.workunit.client.0.smithi078.stdout:7/915: creat d1/d16/d10/d5a/f132 x:0 0 0 2024-04-18T21:07:03.278 INFO:tasks.workunit.client.0.smithi078.stdout:6/962: rename d2/d1f/l3e to d2/d1c/d3a/l152 0 2024-04-18T21:07:03.278 INFO:tasks.workunit.client.0.smithi078.stdout:6/963: sync 2024-04-18T21:07:03.278 INFO:tasks.workunit.client.0.smithi078.stdout:8/944: creat d0/d10/d14/d2a/d4a/db2/db6/df4/d116/f123 x:0 0 0 2024-04-18T21:07:03.278 INFO:tasks.workunit.client.0.smithi078.stdout:6/964: chown d2/d1c/d63/da0/f11d 297 1 2024-04-18T21:07:03.280 INFO:tasks.workunit.client.0.smithi078.stdout:8/945: getdents d0/d22 0 2024-04-18T21:07:03.280 INFO:tasks.workunit.client.0.smithi078.stdout:7/916: symlink d1/d16/dc/d11/d53/d82/da4/db5/d91/l133 0 2024-04-18T21:07:03.280 INFO:tasks.workunit.client.0.smithi078.stdout:8/946: fdatasync d0/da8/ff3 0 2024-04-18T21:07:03.281 INFO:tasks.workunit.client.0.smithi078.stdout:6/965: link d2/d34/d35/d57/d90/fe4 d2/d6/dd/f153 0 2024-04-18T21:07:03.281 INFO:tasks.workunit.client.0.smithi078.stdout:8/947: rmdir d0/d10/d14/d2d/d93/da0 39 2024-04-18T21:07:03.281 INFO:tasks.workunit.client.0.smithi078.stdout:2/963: dwrite d0/db/d18/d21/d27/d29/f69 [0,4194304] 0 2024-04-18T21:07:03.281 INFO:tasks.workunit.client.0.smithi078.stdout:8/948: sync 2024-04-18T21:07:03.282 INFO:tasks.workunit.client.0.smithi078.stdout:7/917: unlink d1/d16/dc/d11/d53/d82/da4/db5/d91/db3/cc8 0 2024-04-18T21:07:03.282 INFO:tasks.workunit.client.0.smithi078.stdout:6/966: rename d2/d1c/d6b/l100 to d2/d1c/d63/d8b/dcb/l154 0 2024-04-18T21:07:03.282 INFO:tasks.workunit.client.0.smithi078.stdout:2/964: read - d0/db/d6e/dd2/dd3/d11f/d98/f104 zero size 2024-04-18T21:07:03.283 INFO:tasks.workunit.client.0.smithi078.stdout:6/967: mknod d2/d1c/d63/da1/db9/c155 0 2024-04-18T21:07:03.285 INFO:tasks.workunit.client.0.smithi078.stdout:7/918: dread d1/d16/d2d/f7d [4194304,4194304] 0 2024-04-18T21:07:03.285 INFO:tasks.workunit.client.0.smithi078.stdout:6/968: write d2/d1c/d6b/d98/f99 [3636187,28365] 0 2024-04-18T21:07:03.285 INFO:tasks.workunit.client.0.smithi078.stdout:8/949: truncate d0/d10/d14/d2d/d93/da0/db5/ff9 792040 0 2024-04-18T21:07:03.285 INFO:tasks.workunit.client.0.smithi078.stdout:3/907: read d4/da/ddf/dc4/d118/f9f [3917814,18625] 0 2024-04-18T21:07:03.287 INFO:tasks.workunit.client.0.smithi078.stdout:6/969: getdents d2/d1c/d6b/d111 0 2024-04-18T21:07:03.288 INFO:tasks.workunit.client.0.smithi078.stdout:3/908: truncate d4/da/ddf/da0/fc0 1098575 0 2024-04-18T21:07:03.289 INFO:tasks.workunit.client.0.smithi078.stdout:6/970: mkdir d2/d1c/db3/dbb/df1/d14e/d156 0 2024-04-18T21:07:03.290 INFO:tasks.workunit.client.0.smithi078.stdout:2/965: dwrite d0/db/d18/d5d/fb5 [0,4194304] 0 2024-04-18T21:07:03.290 INFO:tasks.workunit.client.0.smithi078.stdout:6/971: dread - d2/d34/d35/d57/d90/fa3 zero size 2024-04-18T21:07:03.290 INFO:tasks.workunit.client.0.smithi078.stdout:5/985: dwrite d9/da/d32/f60 [0,4194304] 0 2024-04-18T21:07:03.292 INFO:tasks.workunit.client.0.smithi078.stdout:2/966: truncate d0/db/d18/d21/d27/d29/d57/f108 872622 0 2024-04-18T21:07:03.293 INFO:tasks.workunit.client.0.smithi078.stdout:8/950: truncate d0/da8/fcd 3196621 0 2024-04-18T21:07:03.293 INFO:tasks.workunit.client.0.smithi078.stdout:8/951: sync 2024-04-18T21:07:03.293 INFO:tasks.workunit.client.0.smithi078.stdout:6/972: symlink d2/d34/d75/l157 0 2024-04-18T21:07:03.293 INFO:tasks.workunit.client.0.smithi078.stdout:5/986: symlink d9/da/d3e/l132 0 2024-04-18T21:07:03.294 INFO:tasks.workunit.client.0.smithi078.stdout:6/973: fsync d2/d6/f59 0 2024-04-18T21:07:03.295 INFO:tasks.workunit.client.0.smithi078.stdout:2/967: link d0/db/d6e/dd2/dd3/d11f/lf0 d0/db/d18/d21/de1/l12f 0 2024-04-18T21:07:03.295 INFO:tasks.workunit.client.0.smithi078.stdout:8/952: symlink d0/d10/d14/d2d/d93/da0/dc2/dfa/l124 0 2024-04-18T21:07:03.295 INFO:tasks.workunit.client.0.smithi078.stdout:3/909: dwrite d4/da/f92 [0,4194304] 0 2024-04-18T21:07:03.295 INFO:tasks.workunit.client.0.smithi078.stdout:5/987: creat d9/d9f/dd4/dee/def/dc1/d129/de8/df2/f133 x:0 0 0 2024-04-18T21:07:03.295 INFO:tasks.workunit.client.0.smithi078.stdout:8/953: fsync d0/d10/d14/d62/ffc 0 2024-04-18T21:07:03.296 INFO:tasks.workunit.client.0.smithi078.stdout:2/968: write d0/db/f11d [6813,110687] 0 2024-04-18T21:07:03.296 INFO:tasks.workunit.client.0.smithi078.stdout:6/974: creat d2/d1c/db3/dbb/df1/d14e/f158 x:0 0 0 2024-04-18T21:07:03.297 INFO:tasks.workunit.client.0.smithi078.stdout:3/910: mknod d4/da/ddf/dc4/d118/d35/d4b/c121 0 2024-04-18T21:07:03.297 INFO:tasks.workunit.client.0.smithi078.stdout:6/975: creat d2/d34/dce/f159 x:0 0 0 2024-04-18T21:07:03.297 INFO:tasks.workunit.client.0.smithi078.stdout:5/988: creat d9/da/d3e/d4c/d6d/d73/f134 x:0 0 0 2024-04-18T21:07:03.297 INFO:tasks.workunit.client.0.smithi078.stdout:8/954: creat d0/d10/d14/d2a/dbd/f125 x:0 0 0 2024-04-18T21:07:03.297 INFO:tasks.workunit.client.0.smithi078.stdout:6/976: mkdir d2/d1f/d15a 0 2024-04-18T21:07:03.297 INFO:tasks.workunit.client.0.smithi078.stdout:3/911: mkdir d4/da/ddf/dc4/d122 0 2024-04-18T21:07:03.299 INFO:tasks.workunit.client.0.smithi078.stdout:5/989: mknod d9/d9f/dd4/dee/def/dc1/d129/de8/df2/c135 0 2024-04-18T21:07:03.299 INFO:tasks.workunit.client.0.smithi078.stdout:3/912: rmdir d4/df/db0/dc5/d41/dda/de2 39 2024-04-18T21:07:03.303 INFO:tasks.workunit.client.0.smithi078.stdout:5/990: creat d9/da/d3e/d4c/d67/d7c/f136 x:0 0 0 2024-04-18T21:07:03.303 INFO:tasks.workunit.client.0.smithi078.stdout:3/913: link d4/da/d11/f72 d4/dc3/d10f/f123 0 2024-04-18T21:07:03.303 INFO:tasks.workunit.client.0.smithi078.stdout:5/991: dread - d9/d2e/fc8 zero size 2024-04-18T21:07:03.304 INFO:tasks.workunit.client.0.smithi078.stdout:3/914: mknod d4/da/ddf/dc4/d118/d35/d4b/d59/c124 0 2024-04-18T21:07:03.304 INFO:tasks.workunit.client.0.smithi078.stdout:6/977: dwrite d2/d6/dd/f68 [0,4194304] 0 2024-04-18T21:07:03.305 INFO:tasks.workunit.client.0.smithi078.stdout:5/992: rename d9/da/d3e/d4c/d79 to d9/da/d3e/d4c/d6d/d75/dad/d137 0 2024-04-18T21:07:03.306 INFO:tasks.workunit.client.0.smithi078.stdout:3/915: creat d4/da/ddf/dc4/d118/d35/d4b/f125 x:0 0 0 2024-04-18T21:07:03.307 INFO:tasks.workunit.client.0.smithi078.stdout:3/916: read d4/da/d11/f21 [5610117,31461] 0 2024-04-18T21:07:03.307 INFO:tasks.workunit.client.0.smithi078.stdout:5/993: mkdir d9/da/d3e/d4c/d6d/d86/d106/d138 0 2024-04-18T21:07:03.308 INFO:tasks.workunit.client.0.smithi078.stdout:3/917: mknod d4/da/ddf/dc4/d118/d35/d4b/d11a/c126 0 2024-04-18T21:07:03.310 INFO:tasks.workunit.client.0.smithi078.stdout:3/918: dread - d4/da/d11/d66/f10d zero size 2024-04-18T21:07:03.310 INFO:tasks.workunit.client.0.smithi078.stdout:3/919: fdatasync d4/da/d11/d66/fb3 0 2024-04-18T21:07:03.311 INFO:tasks.workunit.client.0.smithi078.stdout:6/978: dwrite d2/f110 [0,4194304] 0 2024-04-18T21:07:03.311 INFO:tasks.workunit.client.0.smithi078.stdout:7/919: dread d1/d32/f90 [0,4194304] 0 2024-04-18T21:07:03.312 INFO:tasks.workunit.client.0.smithi078.stdout:3/920: creat d4/da/ddf/dc4/d118/d35/d71/f127 x:0 0 0 2024-04-18T21:07:03.313 INFO:tasks.workunit.client.0.smithi078.stdout:7/920: truncate d1/d16/dc/fd 1528556 0 2024-04-18T21:07:03.313 INFO:tasks.workunit.client.0.smithi078.stdout:3/921: chown d4/da/ddf/dc4/d118/d35/f117 430371 1 2024-04-18T21:07:03.313 INFO:tasks.workunit.client.0.smithi078.stdout:3/922: stat d4/da/f4a 0 2024-04-18T21:07:03.314 INFO:tasks.workunit.client.0.smithi078.stdout:3/923: unlink d4/dc3/fd8 0 2024-04-18T21:07:03.314 INFO:tasks.workunit.client.0.smithi078.stdout:5/994: truncate d9/da/d3e/d4c/d6d/d73/f33 2386879 0 2024-04-18T21:07:03.316 INFO:tasks.workunit.client.0.smithi078.stdout:5/995: link d9/da/d3e/d4c/f8a d9/da/d32/da5/de5/f139 0 2024-04-18T21:07:03.316 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:03.318+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:03.319 INFO:tasks.workunit.client.0.smithi078.stdout:6/979: truncate d2/d1c/d63/f81 1966885 0 2024-04-18T21:07:03.319 INFO:tasks.workunit.client.0.smithi078.stdout:7/921: dwrite d1/f18 [0,4194304] 0 2024-04-18T21:07:03.319 INFO:tasks.workunit.client.0.smithi078.stdout:5/996: rename d9/da/d3e/d4c/d6d/d75/fd8 to d9/da/d3e/d4c/d6d/d73/f13a 0 2024-04-18T21:07:03.319 INFO:tasks.workunit.client.0.smithi078.stdout:6/980: symlink d2/d74/l15b 0 2024-04-18T21:07:03.320 INFO:tasks.workunit.client.0.smithi078.stdout:5/997: write d9/f64 [430292,27422] 0 2024-04-18T21:07:03.320 INFO:tasks.workunit.client.0.smithi078.stdout:3/924: dwrite d4/df/db0/fd1 [0,4194304] 0 2024-04-18T21:07:03.321 INFO:tasks.workunit.client.0.smithi078.stdout:6/981: rename d2/d6/dea/df4 to d2/d6/dea/df4/d15c 22 2024-04-18T21:07:03.321 INFO:tasks.workunit.client.0.smithi078.stdout:5/998: mkdir d9/da/d4b/d11b/d13b 0 2024-04-18T21:07:03.321 INFO:tasks.workunit.client.0.smithi078.stdout:6/982: fsync d2/d1c/d63/da1/db9/f10f 0 2024-04-18T21:07:03.322 INFO:tasks.workunit.client.0.smithi078.stdout:3/925: creat d4/da/ddf/da0/f128 x:0 0 0 2024-04-18T21:07:03.322 INFO:tasks.workunit.client.0.smithi078.stdout:5/999: mkdir d9/da/d32/da5/de5/d13c 0 2024-04-18T21:07:03.322 INFO:tasks.workunit.client.0.smithi078.stdout:6/983: symlink d2/d6/l15d 0 2024-04-18T21:07:03.323 INFO:tasks.workunit.client.0.smithi078.stdout:6/984: write d2/d1c/f146 [1388339,26655] 0 2024-04-18T21:07:03.323 INFO:tasks.workunit.client.0.smithi078.stdout:7/922: dread d1/d16/d10/f13 [0,4194304] 0 2024-04-18T21:07:03.325 INFO:tasks.workunit.client.0.smithi078.stdout:7/923: dread - d1/d16/d2d/fb7 zero size 2024-04-18T21:07:03.325 INFO:tasks.workunit.client.0.smithi078.stdout:6/985: write d2/d34/d75/fda [227608,97465] 0 2024-04-18T21:07:03.325 INFO:tasks.workunit.client.0.smithi078.stdout:6/986: chown d2/d34/fa5 138693 1 2024-04-18T21:07:03.325 INFO:tasks.workunit.client.0.smithi078.stdout:7/924: read - d1/d16/d10/d5a/f132 zero size 2024-04-18T21:07:03.326 INFO:tasks.workunit.client.0.smithi078.stdout:6/987: mkdir d2/d1c/d63/d8b/dcb/d15e 0 2024-04-18T21:07:03.327 INFO:tasks.workunit.client.0.smithi078.stdout:7/925: readlink d1/d16/dc/d11/d53/d82/da4/db5/d91/db0/l120 0 2024-04-18T21:07:03.327 INFO:tasks.workunit.client.0.smithi078.stdout:6/988: dread - d2/f14a zero size 2024-04-18T21:07:03.328 INFO:tasks.workunit.client.0.smithi078.stdout:7/926: dread - d1/d16/dc/d11/fdd zero size 2024-04-18T21:07:03.328 INFO:tasks.workunit.client.0.smithi078.stdout:6/989: mkdir d2/d1c/d63/d8b/dcc/d15f 0 2024-04-18T21:07:03.329 INFO:tasks.workunit.client.0.smithi078.stdout:6/990: unlink d2/d1c/d6b/dba/f148 0 2024-04-18T21:07:03.329 INFO:tasks.workunit.client.0.smithi078.stdout:7/927: creat d1/d16/dc/d11/d53/d82/dfe/d11e/f134 x:0 0 0 2024-04-18T21:07:03.330 INFO:tasks.workunit.client.0.smithi078.stdout:3/926: dwrite d4/da/ddf/dc4/ff6 [0,4194304] 0 2024-04-18T21:07:03.330 INFO:tasks.workunit.client.0.smithi078.stdout:6/991: fdatasync d2/d1c/f53 0 2024-04-18T21:07:03.330 INFO:tasks.workunit.client.0.smithi078.stdout:2/969: dread d0/d1f/f2b [0,4194304] 0 2024-04-18T21:07:03.331 INFO:tasks.workunit.client.0.smithi078.stdout:3/927: mknod d4/da/d11/d66/c129 0 2024-04-18T21:07:03.332 INFO:tasks.workunit.client.0.smithi078.stdout:3/928: chown d4/da/ddf/dc4/d118/d35/d71/ff8 79571885 1 2024-04-18T21:07:03.332 INFO:tasks.workunit.client.0.smithi078.stdout:3/929: readlink d4/da/ddf/dc4/d118/d35/lc2 0 2024-04-18T21:07:03.333 INFO:tasks.workunit.client.0.smithi078.stdout:3/930: dread - d4/da/d11/d66/dbe/dd0/fd7 zero size 2024-04-18T21:07:03.333 INFO:tasks.workunit.client.0.smithi078.stdout:7/928: dread d1/f18 [0,4194304] 0 2024-04-18T21:07:03.334 INFO:tasks.workunit.client.0.smithi078.stdout:3/931: creat d4/da/d5e/f12a x:0 0 0 2024-04-18T21:07:03.334 INFO:tasks.workunit.client.0.smithi078.stdout:7/929: dread - d1/d16/dc/d11/d53/d82/da4/ff3 zero size 2024-04-18T21:07:03.335 INFO:tasks.workunit.client.0.smithi078.stdout:3/932: mkdir d4/da/ddf/dc4/d118/d84/dfb/d12b 0 2024-04-18T21:07:03.336 INFO:tasks.workunit.client.0.smithi078.stdout:3/933: rename d4/da/d76/fba to d4/df/f12c 0 2024-04-18T21:07:03.336 INFO:tasks.workunit.client.0.smithi078.stdout:8/955: dread d0/d10/f1c [0,4194304] 0 2024-04-18T21:07:03.337 INFO:tasks.workunit.client.0.smithi078.stdout:3/934: mkdir d4/d2d/d6c/d12d 0 2024-04-18T21:07:03.337 INFO:tasks.workunit.client.0.smithi078.stdout:8/956: write d0/d10/d14/f9b [2942847,29712] 0 2024-04-18T21:07:03.338 INFO:tasks.workunit.client.0.smithi078.stdout:3/935: dread - d4/da/ddf/dc4/d118/d35/f117 zero size 2024-04-18T21:07:03.338 INFO:tasks.workunit.client.0.smithi078.stdout:8/957: write d0/d10/d14/d2a/ddd/fe9 [579397,76947] 0 2024-04-18T21:07:03.338 INFO:tasks.workunit.client.0.smithi078.stdout:3/936: write d4/da/ddf/dc4/d118/d84/fe9 [193246,24515] 0 2024-04-18T21:07:03.339 INFO:tasks.workunit.client.0.smithi078.stdout:8/958: creat d0/d10/d14/d2d/d93/f126 x:0 0 0 2024-04-18T21:07:03.340 INFO:tasks.workunit.client.0.smithi078.stdout:8/959: creat d0/d10/d14/d2d/d93/f127 x:0 0 0 2024-04-18T21:07:03.340 INFO:tasks.workunit.client.0.smithi078.stdout:8/960: sync 2024-04-18T21:07:03.341 INFO:tasks.workunit.client.0.smithi078.stdout:8/961: creat d0/d10/d14/d2d/f128 x:0 0 0 2024-04-18T21:07:03.342 INFO:tasks.workunit.client.0.smithi078.stdout:8/962: creat d0/d10/d14/f129 x:0 0 0 2024-04-18T21:07:03.342 INFO:tasks.workunit.client.0.smithi078.stdout:8/963: mknod d0/d10/d14/d2a/d4a/db2/db6/df4/d116/c12a 0 2024-04-18T21:07:03.344 INFO:tasks.workunit.client.0.smithi078.stdout:6/992: write d2/f21 [698424,53605] 0 2024-04-18T21:07:03.350 INFO:tasks.workunit.client.0.smithi078.stdout:7/930: write d1/f1f [3168187,11670] 0 2024-04-18T21:07:03.354 INFO:tasks.workunit.client.0.smithi078.stdout:3/937: dwrite d4/df/fcf [0,4194304] 0 2024-04-18T21:07:03.354 INFO:tasks.workunit.client.0.smithi078.stdout:3/938: sync 2024-04-18T21:07:03.355 INFO:tasks.workunit.client.0.smithi078.stdout:3/939: write d4/df/f12c [727658,67494] 0 2024-04-18T21:07:03.355 INFO:tasks.workunit.client.0.smithi078.stdout:7/931: dwrite d1/d16/dc/f55 [0,4194304] 0 2024-04-18T21:07:03.356 INFO:tasks.workunit.client.0.smithi078.stdout:3/940: rename d4/dc3/d10f to d4/dc3/d12e 0 2024-04-18T21:07:03.356 INFO:tasks.workunit.client.0.smithi078.stdout:3/941: stat d4/da/c27 0 2024-04-18T21:07:03.357 INFO:tasks.workunit.client.0.smithi078.stdout:7/932: link d1/d16/dc/d4b/c48 d1/d16/d10/dc6/dd3/c135 0 2024-04-18T21:07:03.357 INFO:tasks.workunit.client.0.smithi078.stdout:3/942: chown d4/f13 6 1 2024-04-18T21:07:03.358 INFO:tasks.workunit.client.0.smithi078.stdout:7/933: chown d1/d16/d65/fe2 866 1 2024-04-18T21:07:03.362 INFO:tasks.workunit.client.0.smithi078.stdout:8/964: dread d0/f55 [0,4194304] 0 2024-04-18T21:07:03.363 INFO:tasks.workunit.client.0.smithi078.stdout:8/965: creat d0/d10/d14/d2d/d93/da0/dc2/dfa/f12b x:0 0 0 2024-04-18T21:07:03.365 INFO:tasks.workunit.client.0.smithi078.stdout:8/966: dread d0/f55 [0,4194304] 0 2024-04-18T21:07:03.370 INFO:tasks.workunit.client.0.smithi078.stdout:7/934: dread d1/d16/dc/d11/d53/d82/da4/db5/d91/db0/fd4 [0,4194304] 0 2024-04-18T21:07:03.372 INFO:tasks.workunit.client.0.smithi078.stdout:7/935: rename d1/d16/d10/dc6/dd3/c135 to d1/d16/dc/d11/d53/d82/da4/c136 0 2024-04-18T21:07:03.373 INFO:tasks.workunit.client.0.smithi078.stdout:7/936: rmdir d1/d16/dc/d11/d53/d82/d112 0 2024-04-18T21:07:03.374 INFO:tasks.workunit.client.0.smithi078.stdout:7/937: chown d1/d16/dc/d11/d53/d82/da4/db5/d91/db4/ddc/ff2 830504564 1 2024-04-18T21:07:03.375 INFO:tasks.workunit.client.0.smithi078.stdout:7/938: mkdir d1/d16/d10/d7c/d7e/de3/d137 0 2024-04-18T21:07:03.376 INFO:tasks.workunit.client.0.smithi078.stdout:7/939: creat d1/d16/d10/d7c/dc0/f138 x:0 0 0 2024-04-18T21:07:03.377 INFO:tasks.workunit.client.0.smithi078.stdout:7/940: mknod d1/d16/dc/d11/d53/d82/c139 0 2024-04-18T21:07:03.377 INFO:tasks.workunit.client.0.smithi078.stdout:7/941: fdatasync d1/f1f 0 2024-04-18T21:07:03.378 INFO:tasks.workunit.client.0.smithi078.stdout:7/942: sync 2024-04-18T21:07:03.378 INFO:tasks.workunit.client.0.smithi078.stdout:3/943: dread d4/da/ddf/dc4/d118/d35/d71/f9e [0,4194304] 0 2024-04-18T21:07:03.382 INFO:tasks.workunit.client.0.smithi078.stdout:6/993: dread d2/d6/f14 [0,4194304] 0 2024-04-18T21:07:03.384 INFO:tasks.workunit.client.0.smithi078.stdout:6/994: mknod d2/d1c/d63/d8b/dcb/d15e/c160 0 2024-04-18T21:07:03.384 INFO:tasks.workunit.client.0.smithi078.stdout:7/943: truncate d1/f3c 283305 0 2024-04-18T21:07:03.385 INFO:tasks.workunit.client.0.smithi078.stdout:2/970: dread d0/d1f/f7e [0,4194304] 0 2024-04-18T21:07:03.385 INFO:tasks.workunit.client.0.smithi078.stdout:6/995: rename d2/d1c/d6b/l86 to d2/d1c/d63/l161 0 2024-04-18T21:07:03.385 INFO:tasks.workunit.client.0.smithi078.stdout:2/971: fdatasync d0/db/d18/d21/d27/f58 0 2024-04-18T21:07:03.386 INFO:tasks.workunit.client.0.smithi078.stdout:6/996: rmdir d2/dbf 39 2024-04-18T21:07:03.386 INFO:tasks.workunit.client.0.smithi078.stdout:7/944: read d1/d16/dc/f118 [3563826,53661] 0 2024-04-18T21:07:03.386 INFO:tasks.workunit.client.0.smithi078.stdout:2/972: chown d0/d1f/f7a 4 1 2024-04-18T21:07:03.387 INFO:tasks.workunit.client.0.smithi078.stdout:6/997: symlink d2/d1c/l162 0 2024-04-18T21:07:03.387 INFO:tasks.workunit.client.0.smithi078.stdout:7/945: symlink d1/d16/dc/d11/da2/l13a 0 2024-04-18T21:07:03.387 INFO:tasks.workunit.client.0.smithi078.stdout:2/973: unlink d0/db/d18/d21/d27/d29/de3/l101 0 2024-04-18T21:07:03.387 INFO:tasks.workunit.client.0.smithi078.stdout:7/946: fdatasync d1/d16/d2d/f47 0 2024-04-18T21:07:03.389 INFO:tasks.workunit.client.0.smithi078.stdout:7/947: fsync d1/d16/d65/d10e/dcf/fda 0 2024-04-18T21:07:03.390 INFO:tasks.workunit.client.0.smithi078.stdout:7/948: creat d1/d16/d10/d7c/d7e/d97/f13b x:0 0 0 2024-04-18T21:07:03.392 INFO:tasks.workunit.client.0.smithi078.stdout:7/949: read d1/d16/d1c/f34 [3049961,122667] 0 2024-04-18T21:07:03.393 INFO:tasks.workunit.client.0.smithi078.stdout:2/974: dwrite d0/d1f/f2b [0,4194304] 0 2024-04-18T21:07:03.393 INFO:tasks.workunit.client.0.smithi078.stdout:7/950: creat d1/d16/dc/d11/da2/f13c x:0 0 0 2024-04-18T21:07:03.394 INFO:tasks.workunit.client.0.smithi078.stdout:7/951: creat d1/d16/dc/f13d x:0 0 0 2024-04-18T21:07:03.397 INFO:tasks.workunit.client.0.smithi078.stdout:6/998: dread d2/d1f/f58 [0,4194304] 0 2024-04-18T21:07:03.398 INFO:tasks.workunit.client.0.smithi078.stdout:8/967: dread d0/d10/d60/d6f/fb0 [0,4194304] 0 2024-04-18T21:07:03.398 INFO:tasks.workunit.client.0.smithi078.stdout:6/999: rmdir d2/d1c/d6b/d98 39 2024-04-18T21:07:03.399 INFO:tasks.workunit.client.0.smithi078.stdout:8/968: write d0/d10/fa3 [3574002,61388] 0 2024-04-18T21:07:03.399 INFO:tasks.workunit.client.0.smithi078.stdout:8/969: sync 2024-04-18T21:07:03.399 INFO:tasks.workunit.client.0.smithi078.stdout:2/975: dread d0/db/d18/d21/d27/d29/d33/f76 [0,4194304] 0 2024-04-18T21:07:03.399 INFO:tasks.workunit.client.0.smithi078.stdout:7/952: dread d1/d32/f90 [0,4194304] 0 2024-04-18T21:07:03.401 INFO:tasks.workunit.client.0.smithi078.stdout:8/970: mknod d0/d10/d14/d2d/d93/c12c 0 2024-04-18T21:07:03.401 INFO:tasks.workunit.client.0.smithi078.stdout:7/953: symlink d1/da6/l13e 0 2024-04-18T21:07:03.401 INFO:tasks.workunit.client.0.smithi078.stdout:2/976: rename d0/db/d18/d21/d27/d29/c9f to d0/d1f/d34/c130 0 2024-04-18T21:07:03.402 INFO:tasks.workunit.client.0.smithi078.stdout:2/977: write d0/f2e [975532,48717] 0 2024-04-18T21:07:03.403 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:07:03.403 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 20, 2024-04-18T21:07:03.404 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 600, 2024-04-18T21:07:03.404 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [ 2024-04-18T21:07:03.404 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.404 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:03.404 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:07:03.404 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 117.786949925, 2024-04-18T21:07:03.404 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043251955000000002, 2024-04-18T21:07:03.404 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:03.404 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:03.404 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:03.404 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:03.404 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.404 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:03.404 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:07:03.405 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:03.405 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.405 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.405 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:03.405 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:07:03.405 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:03.405 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.405 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.405 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:03.405 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616536+0000", 2024-04-18T21:07:03.405 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2869999999999999e-06 2024-04-18T21:07:03.405 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.405 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.405 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:03.405 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616572+0000", 2024-04-18T21:07:03.406 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.6261999999999999e-05 2024-04-18T21:07:03.406 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.406 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.406 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:03.406 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616593+0000", 2024-04-18T21:07:03.406 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1310000000000001e-05 2024-04-18T21:07:03.406 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.406 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.406 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:03.406 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616614+0000", 2024-04-18T21:07:03.406 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.0936000000000001e-05 2024-04-18T21:07:03.406 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.406 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.407 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:03.407 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629501+0000", 2024-04-18T21:07:03.407 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.012886819000000001 2024-04-18T21:07:03.407 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.407 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.407 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:03.407 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629696+0000", 2024-04-18T21:07:03.407 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019485499999999999 2024-04-18T21:07:03.407 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.407 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.407 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:03.407 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629940+0000", 2024-04-18T21:07:03.407 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00024386399999999999 2024-04-18T21:07:03.407 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.407 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.408 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:03.408 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640100+0000", 2024-04-18T21:07:03.408 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010159645 2024-04-18T21:07:03.408 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.408 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.408 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:03.408 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659516+0000", 2024-04-18T21:07:03.408 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019416563000000001 2024-04-18T21:07:03.408 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.408 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.408 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:03.408 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659684+0000", 2024-04-18T21:07:03.408 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016750900000000001 2024-04-18T21:07:03.408 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.408 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.408 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:03.409 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659787+0000", 2024-04-18T21:07:03.409 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000102905 2024-04-18T21:07:03.409 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:03.409 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:03.409 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:03.409 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.409 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.409 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:03.409 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:07:03.409 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 117.78684480299999, 2024-04-18T21:07:03.409 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043581898000000001, 2024-04-18T21:07:03.409 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:03.409 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:03.409 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:03.409 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:03.409 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.410 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:03.410 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:07:03.410 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:03.410 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.410 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.410 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:03.410 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:07:03.410 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:03.410 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.410 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.410 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:03.410 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616641+0000", 2024-04-18T21:07:03.410 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:07:03.410 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.410 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.411 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:03.411 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616648+0000", 2024-04-18T21:07:03.411 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3860000000000001e-06 2024-04-18T21:07:03.411 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.411 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.411 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:03.411 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616666+0000", 2024-04-18T21:07:03.411 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7583000000000001e-05 2024-04-18T21:07:03.411 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.411 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.411 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:03.411 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616679+0000", 2024-04-18T21:07:03.411 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3322999999999999e-05 2024-04-18T21:07:03.411 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.411 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.411 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:03.412 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630373+0000", 2024-04-18T21:07:03.412 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013694207999999999 2024-04-18T21:07:03.412 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.412 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.412 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:03.412 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630545+0000", 2024-04-18T21:07:03.412 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000171683 2024-04-18T21:07:03.412 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.412 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.412 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:03.412 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630728+0000", 2024-04-18T21:07:03.412 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000182599 2024-04-18T21:07:03.412 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.412 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.412 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:03.413 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640600+0000", 2024-04-18T21:07:03.413 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0098726119999999994 2024-04-18T21:07:03.413 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.413 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.413 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:03.413 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659927+0000", 2024-04-18T21:07:03.413 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019326724999999999 2024-04-18T21:07:03.413 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.413 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.413 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:03.413 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660112+0000", 2024-04-18T21:07:03.413 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000185203 2024-04-18T21:07:03.413 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.413 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.413 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:03.414 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660222+0000", 2024-04-18T21:07:03.414 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109343 2024-04-18T21:07:03.414 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:03.414 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:03.414 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:03.414 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.414 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.414 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:03.414 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:07:03.414 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 117.785979445, 2024-04-18T21:07:03.414 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043121310000000003, 2024-04-18T21:07:03.414 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:03.414 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:03.414 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:03.415 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:03.415 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.415 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:03.415 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:07:03.415 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:03.415 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.415 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.415 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:03.415 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:07:03.415 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:03.415 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.415 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.415 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:03.415 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617506+0000", 2024-04-18T21:07:03.416 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9999999999999995e-07 2024-04-18T21:07:03.416 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.416 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.416 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:03.416 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617513+0000", 2024-04-18T21:07:03.416 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.9700000000000002e-06 2024-04-18T21:07:03.416 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.416 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.416 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:03.416 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617531+0000", 2024-04-18T21:07:03.416 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8105999999999999e-05 2024-04-18T21:07:03.416 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.416 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.417 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:03.417 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617545+0000", 2024-04-18T21:07:03.417 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3703000000000001e-05 2024-04-18T21:07:03.417 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.417 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.417 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:03.417 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632129+0000", 2024-04-18T21:07:03.417 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.014584135999999999 2024-04-18T21:07:03.417 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.417 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.417 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:03.417 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632361+0000", 2024-04-18T21:07:03.417 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023171800000000001 2024-04-18T21:07:03.417 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.418 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.418 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:03.418 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632804+0000", 2024-04-18T21:07:03.418 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000443549 2024-04-18T21:07:03.418 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.418 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.418 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:03.418 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646340+0000", 2024-04-18T21:07:03.418 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013535902000000001 2024-04-18T21:07:03.418 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.418 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.418 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:03.418 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660363+0000", 2024-04-18T21:07:03.419 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01402318 2024-04-18T21:07:03.419 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.419 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.419 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:03.419 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660523+0000", 2024-04-18T21:07:03.419 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00015989899999999999 2024-04-18T21:07:03.419 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.419 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.419 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:03.419 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660626+0000", 2024-04-18T21:07:03.419 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010314699999999999 2024-04-18T21:07:03.419 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:03.419 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:03.419 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:03.419 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.420 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.420 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11357 4.38 4:1d691e75:::1000000312c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T21:07:03.420 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:58.595279+0000", 2024-04-18T21:07:03.420 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 4.8082058930000002, 2024-04-18T21:07:03.420 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.045901399000000002, 2024-04-18T21:07:03.420 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:03.420 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:03.420 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:03.420 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:03.420 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:03.420 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:03.420 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11357 2024-04-18T21:07:03.420 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.420 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:03.420 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.420 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:03.421 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.595279+0000", 2024-04-18T21:07:03.421 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:03.421 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.421 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.421 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:03.421 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.595279+0000", 2024-04-18T21:07:03.421 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:03.421 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.421 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.421 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:03.421 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.595280+0000", 2024-04-18T21:07:03.421 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.079e-06 2024-04-18T21:07:03.421 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.421 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.421 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:03.422 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600237+0000", 2024-04-18T21:07:03.422 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0049569089999999998 2024-04-18T21:07:03.422 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.422 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.422 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:03.422 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600254+0000", 2024-04-18T21:07:03.422 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7399000000000001e-05 2024-04-18T21:07:03.422 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.422 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.422 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:03.422 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600262+0000", 2024-04-18T21:07:03.422 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.174e-06 2024-04-18T21:07:03.422 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.422 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.423 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:03.423 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600359+0000", 2024-04-18T21:07:03.423 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.6358000000000001e-05 2024-04-18T21:07:03.423 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.423 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.423 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:03.423 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600507+0000", 2024-04-18T21:07:03.423 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014854199999999999 2024-04-18T21:07:03.423 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.423 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.423 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:03.423 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600748+0000", 2024-04-18T21:07:03.423 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000241361 2024-04-18T21:07:03.423 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.424 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.424 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:03.424 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.615590+0000", 2024-04-18T21:07:03.424 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.014841851 2024-04-18T21:07:03.424 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.424 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.424 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:03.424 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.639817+0000", 2024-04-18T21:07:03.424 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024226527000000001 2024-04-18T21:07:03.424 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.424 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.424 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:03.424 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.640962+0000", 2024-04-18T21:07:03.424 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001145561 2024-04-18T21:07:03.424 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.424 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.425 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:03.425 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.641180+0000", 2024-04-18T21:07:03.425 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00021763800000000001 2024-04-18T21:07:03.425 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:03.425 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:03.425 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:03.425 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.425 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.425 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11443 4.38 4:1d691e75:::1000000312c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T21:07:03.425 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:58.744218+0000", 2024-04-18T21:07:03.425 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 4.6592662269999998, 2024-04-18T21:07:03.425 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.051074359999999999, 2024-04-18T21:07:03.425 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:03.425 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:03.425 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:03.425 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:03.426 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:03.426 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:03.426 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11443 2024-04-18T21:07:03.426 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.426 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:03.426 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.426 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:03.426 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.744218+0000", 2024-04-18T21:07:03.426 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:03.426 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.426 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.426 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:03.426 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.744218+0000", 2024-04-18T21:07:03.426 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:03.427 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.427 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.427 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:03.427 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.744221+0000", 2024-04-18T21:07:03.427 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.3580000000000001e-06 2024-04-18T21:07:03.427 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.427 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.427 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:03.427 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753328+0000", 2024-04-18T21:07:03.427 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0091071339999999994 2024-04-18T21:07:03.427 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.427 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.427 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:03.427 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753351+0000", 2024-04-18T21:07:03.427 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.3479999999999999e-05 2024-04-18T21:07:03.427 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.428 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.428 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:03.428 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753363+0000", 2024-04-18T21:07:03.428 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1345000000000001e-05 2024-04-18T21:07:03.428 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.428 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.428 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:03.428 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753416+0000", 2024-04-18T21:07:03.428 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.2849999999999997e-05 2024-04-18T21:07:03.428 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.428 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.428 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:03.428 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753471+0000", 2024-04-18T21:07:03.428 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5717999999999997e-05 2024-04-18T21:07:03.428 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.429 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.429 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:03.429 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753560+0000", 2024-04-18T21:07:03.429 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8777999999999996e-05 2024-04-18T21:07:03.429 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.429 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.429 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:03.429 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.760182+0000", 2024-04-18T21:07:03.429 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0066216299999999999 2024-04-18T21:07:03.429 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.429 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.429 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:03.429 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.795094+0000", 2024-04-18T21:07:03.429 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.034912334000000003 2024-04-18T21:07:03.429 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.430 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.430 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:03.430 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.795221+0000", 2024-04-18T21:07:03.430 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012745899999999999 2024-04-18T21:07:03.430 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.430 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.430 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:03.430 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.795293+0000", 2024-04-18T21:07:03.430 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.1273999999999996e-05 2024-04-18T21:07:03.430 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:03.430 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:03.430 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:03.430 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.430 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.431 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11511 4.18 4:184fae4a:::1000000316d.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:03.431 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:58.838500+0000", 2024-04-18T21:07:03.431 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 4.5649843470000002, 2024-04-18T21:07:03.431 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.044451537999999999, 2024-04-18T21:07:03.431 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:03.431 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:03.431 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:03.431 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:03.431 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:03.431 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:03.431 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11511 2024-04-18T21:07:03.431 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.431 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:03.431 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.431 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:03.431 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.838500+0000", 2024-04-18T21:07:03.432 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:03.432 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.432 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.432 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:03.432 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.838500+0000", 2024-04-18T21:07:03.432 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:03.432 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.432 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.432 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:03.432 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.838501+0000", 2024-04-18T21:07:03.432 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.4799999999999997e-07 2024-04-18T21:07:03.432 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.432 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.432 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:03.432 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.847806+0000", 2024-04-18T21:07:03.433 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0093054250000000008 2024-04-18T21:07:03.433 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.433 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.433 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:03.433 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.847834+0000", 2024-04-18T21:07:03.433 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7161999999999998e-05 2024-04-18T21:07:03.433 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.433 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.433 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:03.433 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.847849+0000", 2024-04-18T21:07:03.433 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5217e-05 2024-04-18T21:07:03.433 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.433 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.433 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:03.433 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.847917+0000", 2024-04-18T21:07:03.433 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7896000000000002e-05 2024-04-18T21:07:03.434 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.434 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.434 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:03.434 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.848080+0000", 2024-04-18T21:07:03.434 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016328299999999999 2024-04-18T21:07:03.434 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.434 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.434 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:03.434 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.848348+0000", 2024-04-18T21:07:03.434 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00026766099999999998 2024-04-18T21:07:03.434 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.434 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.434 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:03.434 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.863288+0000", 2024-04-18T21:07:03.434 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.014940301 2024-04-18T21:07:03.435 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.435 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.435 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:03.435 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.882854+0000", 2024-04-18T21:07:03.435 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019566456999999999 2024-04-18T21:07:03.435 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.435 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.435 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:03.435 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.882904+0000", 2024-04-18T21:07:03.435 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.9620999999999998e-05 2024-04-18T21:07:03.435 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.435 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.435 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:03.435 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.882952+0000", 2024-04-18T21:07:03.436 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.7766999999999999e-05 2024-04-18T21:07:03.436 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:03.436 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:03.436 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:03.436 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.436 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.436 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11728 4.39 4:9dcc5ecf:::1000000316e.00000000:head [write 0~4194304 [2@1720266]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:03.436 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.088728+0000", 2024-04-18T21:07:03.436 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 4.3147564799999998, 2024-04-18T21:07:03.436 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.047519835000000003, 2024-04-18T21:07:03.436 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:03.436 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:03.436 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:03.436 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:03.437 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:03.437 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:03.437 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11728 2024-04-18T21:07:03.437 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.437 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:03.437 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.437 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:03.437 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.088728+0000", 2024-04-18T21:07:03.437 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:03.437 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.437 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.437 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:03.437 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.088728+0000", 2024-04-18T21:07:03.437 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:03.437 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.437 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.438 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:03.438 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.088729+0000", 2024-04-18T21:07:03.438 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1000000000000001e-06 2024-04-18T21:07:03.438 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.438 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.438 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:03.438 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094322+0000", 2024-04-18T21:07:03.438 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0055931349999999999 2024-04-18T21:07:03.438 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.438 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.438 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:03.438 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094334+0000", 2024-04-18T21:07:03.438 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1894e-05 2024-04-18T21:07:03.438 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.439 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.439 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:03.439 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094340+0000", 2024-04-18T21:07:03.439 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.8780000000000003e-06 2024-04-18T21:07:03.439 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.439 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.439 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:03.439 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094393+0000", 2024-04-18T21:07:03.439 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3275000000000001e-05 2024-04-18T21:07:03.439 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.439 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.439 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:03.439 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094479+0000", 2024-04-18T21:07:03.439 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5222999999999994e-05 2024-04-18T21:07:03.439 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.440 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.440 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:03.440 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094629+0000", 2024-04-18T21:07:03.440 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00015021699999999999 2024-04-18T21:07:03.440 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.440 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.440 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:03.440 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.102975+0000", 2024-04-18T21:07:03.440 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0083464460000000004 2024-04-18T21:07:03.440 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.440 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.440 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:03.440 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136142+0000", 2024-04-18T21:07:03.440 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.033166432000000003 2024-04-18T21:07:03.440 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.441 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.441 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:03.441 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136207+0000", 2024-04-18T21:07:03.441 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.5032999999999999e-05 2024-04-18T21:07:03.441 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.441 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.441 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:03.441 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136248+0000", 2024-04-18T21:07:03.441 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.1202000000000003e-05 2024-04-18T21:07:03.441 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:03.441 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:03.441 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:03.441 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.441 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.441 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11731 4.39 4:9dcc5ecf:::1000000316e.00000000:head [write 3247277~11534 [2@1720266] in=11534b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:03.441 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.094419+0000", 2024-04-18T21:07:03.442 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 4.3090652829999998, 2024-04-18T21:07:03.442 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.042530119999999998, 2024-04-18T21:07:03.442 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:03.442 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:03.442 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:03.442 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:03.442 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:03.442 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:03.442 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11731 2024-04-18T21:07:03.442 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.442 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:03.442 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.442 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:03.442 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094419+0000", 2024-04-18T21:07:03.443 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:03.443 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.443 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.443 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:03.443 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094419+0000", 2024-04-18T21:07:03.443 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:03.443 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.443 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.443 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:03.443 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094420+0000", 2024-04-18T21:07:03.443 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.6400000000000003e-07 2024-04-18T21:07:03.443 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.443 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.443 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:03.443 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094429+0000", 2024-04-18T21:07:03.444 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.2359999999999993e-06 2024-04-18T21:07:03.444 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.444 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.444 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:03.444 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094433+0000", 2024-04-18T21:07:03.444 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.155e-06 2024-04-18T21:07:03.444 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.444 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.444 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:03.444 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094436+0000", 2024-04-18T21:07:03.444 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.0529999999999998e-06 2024-04-18T21:07:03.444 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.444 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.444 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:03.444 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.099720+0000", 2024-04-18T21:07:03.444 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0052837370000000002 2024-04-18T21:07:03.445 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.445 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.445 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:03.445 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.099793+0000", 2024-04-18T21:07:03.445 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.2959000000000004e-05 2024-04-18T21:07:03.445 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.445 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.445 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:03.445 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.099884+0000", 2024-04-18T21:07:03.445 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.1032999999999994e-05 2024-04-18T21:07:03.445 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.445 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.445 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:03.445 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.103177+0000", 2024-04-18T21:07:03.445 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0032935210000000002 2024-04-18T21:07:03.446 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.446 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.446 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:03.446 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136826+0000", 2024-04-18T21:07:03.446 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.033648521000000001 2024-04-18T21:07:03.446 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.446 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.446 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:03.446 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136896+0000", 2024-04-18T21:07:03.446 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0457000000000007e-05 2024-04-18T21:07:03.446 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.446 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.446 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:03.446 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136949+0000", 2024-04-18T21:07:03.446 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.2984e-05 2024-04-18T21:07:03.447 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:03.447 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:03.447 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:03.447 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.447 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.447 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11847 4.a 4:51f063b7:::100000032b5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:03.447 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.229180+0000", 2024-04-18T21:07:03.447 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 4.1743044239999998, 2024-04-18T21:07:03.447 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.048001033999999998, 2024-04-18T21:07:03.447 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:03.447 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:03.447 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:03.447 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:03.447 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:03.448 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:03.448 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11847 2024-04-18T21:07:03.448 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.448 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:03.448 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.448 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:03.448 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.229180+0000", 2024-04-18T21:07:03.448 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:03.448 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.448 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.448 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:03.448 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.229180+0000", 2024-04-18T21:07:03.448 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:03.448 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.449 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.449 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:03.449 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.229181+0000", 2024-04-18T21:07:03.449 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.119e-06 2024-04-18T21:07:03.449 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.449 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.449 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:03.449 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.235951+0000", 2024-04-18T21:07:03.449 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0067702370000000001 2024-04-18T21:07:03.449 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.449 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.449 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:03.449 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.235965+0000", 2024-04-18T21:07:03.449 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3202e-05 2024-04-18T21:07:03.449 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.450 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.450 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:03.450 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.235973+0000", 2024-04-18T21:07:03.450 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8630000000000008e-06 2024-04-18T21:07:03.450 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.450 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.450 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:03.450 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.236047+0000", 2024-04-18T21:07:03.450 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.4453e-05 2024-04-18T21:07:03.450 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.450 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.450 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:03.450 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.236137+0000", 2024-04-18T21:07:03.450 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.9751000000000002e-05 2024-04-18T21:07:03.451 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.451 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.451 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:03.451 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.236266+0000", 2024-04-18T21:07:03.451 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000129257 2024-04-18T21:07:03.451 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.451 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.451 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:03.451 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.244520+0000", 2024-04-18T21:07:03.451 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0082538190000000008 2024-04-18T21:07:03.451 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.451 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.451 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:03.451 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.277093+0000", 2024-04-18T21:07:03.451 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.032573405999999999 2024-04-18T21:07:03.452 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.452 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.452 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:03.452 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.277144+0000", 2024-04-18T21:07:03.452 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.0553000000000002e-05 2024-04-18T21:07:03.452 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.452 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.452 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:03.452 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.277181+0000", 2024-04-18T21:07:03.452 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.7373999999999998e-05 2024-04-18T21:07:03.452 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:03.452 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:03.452 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:03.452 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.452 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.452 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11949 4.2b 4:d50cc3c5:::100000031c6.00000000:head [write 0~3145728] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:03.453 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.338113+0000", 2024-04-18T21:07:03.453 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 4.0653715479999999, 2024-04-18T21:07:03.453 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.046907847000000003, 2024-04-18T21:07:03.453 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:03.453 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:03.453 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:03.453 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:03.453 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:03.453 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:03.453 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11949 2024-04-18T21:07:03.453 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.453 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:03.453 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.453 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:03.453 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.338113+0000", 2024-04-18T21:07:03.454 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:03.454 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.454 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.454 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:03.454 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.338113+0000", 2024-04-18T21:07:03.454 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:03.454 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.454 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.454 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:03.454 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.338115+0000", 2024-04-18T21:07:03.454 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5659999999999999e-06 2024-04-18T21:07:03.454 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.454 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.454 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:03.454 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344146+0000", 2024-04-18T21:07:03.455 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0060309339999999999 2024-04-18T21:07:03.455 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.455 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.455 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:03.455 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344163+0000", 2024-04-18T21:07:03.455 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6994999999999999e-05 2024-04-18T21:07:03.455 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.455 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.455 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:03.455 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344171+0000", 2024-04-18T21:07:03.455 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5520000000000005e-06 2024-04-18T21:07:03.455 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.455 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.455 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:03.455 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344604+0000", 2024-04-18T21:07:03.456 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00043326299999999997 2024-04-18T21:07:03.456 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.456 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.456 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:03.456 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344687+0000", 2024-04-18T21:07:03.456 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.2952000000000001e-05 2024-04-18T21:07:03.456 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.456 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.456 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:03.456 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344792+0000", 2024-04-18T21:07:03.456 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000104635 2024-04-18T21:07:03.456 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.456 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.456 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:03.456 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.361867+0000", 2024-04-18T21:07:03.456 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017075245999999999 2024-04-18T21:07:03.457 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.457 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.457 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:03.457 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.384879+0000", 2024-04-18T21:07:03.457 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023011474000000001 2024-04-18T21:07:03.457 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.457 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.457 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:03.457 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.384976+0000", 2024-04-18T21:07:03.457 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.7399999999999996e-05 2024-04-18T21:07:03.457 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.457 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.457 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:03.457 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.385021+0000", 2024-04-18T21:07:03.457 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.4830000000000003e-05 2024-04-18T21:07:03.457 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:03.457 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:03.458 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:03.458 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.458 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.458 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11988 4.0 4:01311cad:::1000000320a.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:03.458 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.384266+0000", 2024-04-18T21:07:03.458 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 4.0192180779999997, 2024-04-18T21:07:03.458 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.042482546000000003, 2024-04-18T21:07:03.458 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:03.458 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:03.458 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:03.458 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:03.458 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:03.458 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:03.459 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11988 2024-04-18T21:07:03.459 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.459 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:03.459 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.459 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:03.459 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.384266+0000", 2024-04-18T21:07:03.459 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:03.459 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.459 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.459 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:03.459 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.384266+0000", 2024-04-18T21:07:03.459 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:03.459 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.459 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.459 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:03.460 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.384268+0000", 2024-04-18T21:07:03.460 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.857e-06 2024-04-18T21:07:03.460 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.460 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.460 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:03.460 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.391524+0000", 2024-04-18T21:07:03.460 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0072557469999999999 2024-04-18T21:07:03.460 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.460 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.460 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:03.460 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.391546+0000", 2024-04-18T21:07:03.460 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1607000000000002e-05 2024-04-18T21:07:03.460 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.460 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.460 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:03.460 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.391559+0000", 2024-04-18T21:07:03.461 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3331e-05 2024-04-18T21:07:03.461 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.461 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.461 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:03.461 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.391639+0000", 2024-04-18T21:07:03.461 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.9511000000000005e-05 2024-04-18T21:07:03.461 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.461 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.461 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:03.461 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.391753+0000", 2024-04-18T21:07:03.461 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000114512 2024-04-18T21:07:03.461 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.461 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.461 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:03.461 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.391945+0000", 2024-04-18T21:07:03.461 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019234300000000001 2024-04-18T21:07:03.462 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.462 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.462 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:03.462 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.401085+0000", 2024-04-18T21:07:03.462 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0091394319999999994 2024-04-18T21:07:03.462 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.462 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.462 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:03.462 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.426658+0000", 2024-04-18T21:07:03.462 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.025573148 2024-04-18T21:07:03.462 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.462 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.462 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:03.462 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.426714+0000", 2024-04-18T21:07:03.462 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5937999999999999e-05 2024-04-18T21:07:03.463 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.463 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.463 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:03.463 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.426749+0000", 2024-04-18T21:07:03.463 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.5120000000000003e-05 2024-04-18T21:07:03.463 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:03.463 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:03.463 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:03.463 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.463 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.463 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:12041 4.38 4:1c8d9fef:::100000033ed.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:03.463 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.446812+0000", 2024-04-18T21:07:03.463 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 3.9566723069999998, 2024-04-18T21:07:03.463 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.044749606999999997, 2024-04-18T21:07:03.463 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:03.463 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:03.464 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:03.464 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:03.464 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:03.464 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:03.464 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 12041 2024-04-18T21:07:03.464 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.464 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:03.464 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.464 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:03.464 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.446812+0000", 2024-04-18T21:07:03.464 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:03.464 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.464 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.464 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:03.464 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.446812+0000", 2024-04-18T21:07:03.464 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:03.464 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.465 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.465 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:03.465 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.446814+0000", 2024-04-18T21:07:03.465 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5099999999999999e-06 2024-04-18T21:07:03.465 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.465 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.465 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:03.465 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.452583+0000", 2024-04-18T21:07:03.465 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0057696379999999997 2024-04-18T21:07:03.465 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.465 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.465 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:03.465 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.452599+0000", 2024-04-18T21:07:03.465 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5701000000000001e-05 2024-04-18T21:07:03.465 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.466 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.466 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:03.466 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.452607+0000", 2024-04-18T21:07:03.466 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.7100000000000007e-06 2024-04-18T21:07:03.466 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.466 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.466 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:03.466 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.452718+0000", 2024-04-18T21:07:03.466 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000111257 2024-04-18T21:07:03.466 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.466 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.466 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:03.466 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.452924+0000", 2024-04-18T21:07:03.466 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000206066 2024-04-18T21:07:03.466 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.467 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.467 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:03.467 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.453088+0000", 2024-04-18T21:07:03.467 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016336700000000001 2024-04-18T21:07:03.467 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.467 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.467 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:03.467 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.469818+0000", 2024-04-18T21:07:03.467 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016730248999999999 2024-04-18T21:07:03.467 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.467 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.467 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:03.467 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.491505+0000", 2024-04-18T21:07:03.467 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021687366 2024-04-18T21:07:03.468 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.468 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.468 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:03.468 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.491537+0000", 2024-04-18T21:07:03.468 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.1888999999999999e-05 2024-04-18T21:07:03.468 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.468 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.468 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:03.468 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.491562+0000", 2024-04-18T21:07:03.468 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.4854e-05 2024-04-18T21:07:03.468 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:03.468 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:03.468 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:03.468 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.468 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.469 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:12228 4.16 4:6a8d8629:::100000033d5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:03.469 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.681634+0000", 2024-04-18T21:07:03.469 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 3.7218500790000002, 2024-04-18T21:07:03.469 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043430791000000003, 2024-04-18T21:07:03.469 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:03.469 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:03.469 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:03.469 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:03.469 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:03.469 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:03.469 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 12228 2024-04-18T21:07:03.469 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.469 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:03.469 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.469 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:03.470 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.681634+0000", 2024-04-18T21:07:03.470 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:03.470 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.470 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.470 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:03.470 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.681634+0000", 2024-04-18T21:07:03.470 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:03.470 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.470 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.470 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:03.470 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.681637+0000", 2024-04-18T21:07:03.470 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.418e-06 2024-04-18T21:07:03.470 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.470 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.470 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:03.471 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.688982+0000", 2024-04-18T21:07:03.471 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0073447870000000002 2024-04-18T21:07:03.471 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.471 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.471 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:03.471 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.688998+0000", 2024-04-18T21:07:03.471 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6330000000000001e-05 2024-04-18T21:07:03.471 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.471 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.471 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:03.471 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.689009+0000", 2024-04-18T21:07:03.471 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1236999999999999e-05 2024-04-18T21:07:03.471 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.471 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.472 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:03.472 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.689083+0000", 2024-04-18T21:07:03.472 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3415000000000001e-05 2024-04-18T21:07:03.472 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.472 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.472 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:03.472 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.689237+0000", 2024-04-18T21:07:03.472 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00015420899999999999 2024-04-18T21:07:03.472 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.472 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.472 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:03.472 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.689419+0000", 2024-04-18T21:07:03.472 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018242099999999999 2024-04-18T21:07:03.472 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.472 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.473 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:03.473 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.711630+0000", 2024-04-18T21:07:03.473 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.022210475 2024-04-18T21:07:03.473 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.473 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.473 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:03.473 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.724956+0000", 2024-04-18T21:07:03.473 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013325887999999999 2024-04-18T21:07:03.473 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.473 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.473 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:03.473 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.725019+0000", 2024-04-18T21:07:03.473 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.3757999999999995e-05 2024-04-18T21:07:03.473 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.473 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.474 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:03.474 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.725065+0000", 2024-04-18T21:07:03.474 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.5853000000000003e-05 2024-04-18T21:07:03.474 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:03.474 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:03.474 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:03.474 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.474 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.474 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_repop(client.4534.0:12689 4.26 e58/16 4:64a7f444:::100000033e5.00000000:head v 58'205, mlcod=58'203)", 2024-04-18T21:07:03.474 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:00.217785+0000", 2024-04-18T21:07:03.474 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 3.1856995120000002, 2024-04-18T21:07:03.474 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.052245469000000003, 2024-04-18T21:07:03.474 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:03.474 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:03.475 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:03.475 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:03.475 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.475 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:03.475 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.217785+0000", 2024-04-18T21:07:03.475 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:03.475 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.475 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.475 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:03.475 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.217785+0000", 2024-04-18T21:07:03.475 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:03.475 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.475 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.475 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:03.476 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.217786+0000", 2024-04-18T21:07:03.476 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6700000000000002e-07 2024-04-18T21:07:03.476 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.476 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.476 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:03.476 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225111+0000", 2024-04-18T21:07:03.476 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0073251119999999999 2024-04-18T21:07:03.476 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.476 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.476 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:03.476 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225126+0000", 2024-04-18T21:07:03.476 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.541e-05 2024-04-18T21:07:03.476 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.476 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.476 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:03.477 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225137+0000", 2024-04-18T21:07:03.477 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0890000000000001e-05 2024-04-18T21:07:03.477 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.477 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.477 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:03.477 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225244+0000", 2024-04-18T21:07:03.477 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000106555 2024-04-18T21:07:03.477 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.477 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.477 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:03.477 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225276+0000", 2024-04-18T21:07:03.477 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.2574999999999999e-05 2024-04-18T21:07:03.477 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.477 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.478 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:03.478 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.269985+0000", 2024-04-18T21:07:03.478 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.044708422999999997 2024-04-18T21:07:03.478 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.478 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.478 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:03.478 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.270031+0000", 2024-04-18T21:07:03.478 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.5636999999999997e-05 2024-04-18T21:07:03.478 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:03.478 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:03.478 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:03.478 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.478 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.478 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:12692 4.3a 4:5c788ec1:::100000032ff.00000000:head [write 0~4194304 [2@945974]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:03.479 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:00.225134+0000", 2024-04-18T21:07:03.479 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 3.1783504570000001, 2024-04-18T21:07:03.479 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.048311640000000003, 2024-04-18T21:07:03.479 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:03.479 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:03.479 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:03.479 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:03.479 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:03.479 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:03.479 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 12692 2024-04-18T21:07:03.479 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.479 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:03.479 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.479 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:03.479 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225134+0000", 2024-04-18T21:07:03.479 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:03.480 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.480 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.480 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:03.480 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225134+0000", 2024-04-18T21:07:03.480 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:03.480 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.480 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.480 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:03.480 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225136+0000", 2024-04-18T21:07:03.480 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4160000000000001e-06 2024-04-18T21:07:03.480 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.480 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.480 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:03.480 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231408+0000", 2024-04-18T21:07:03.480 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.006272517 2024-04-18T21:07:03.481 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.481 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.481 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:03.481 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231437+0000", 2024-04-18T21:07:03.481 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.9119e-05 2024-04-18T21:07:03.481 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.481 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.481 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:03.481 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231456+0000", 2024-04-18T21:07:03.481 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8544999999999999e-05 2024-04-18T21:07:03.481 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.481 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.481 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:03.481 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231579+0000", 2024-04-18T21:07:03.482 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000123762 2024-04-18T21:07:03.482 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.482 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.482 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:03.482 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231690+0000", 2024-04-18T21:07:03.482 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000110349 2024-04-18T21:07:03.482 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.482 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.482 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:03.482 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231903+0000", 2024-04-18T21:07:03.482 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000212695 2024-04-18T21:07:03.482 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.482 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.482 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:03.483 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.253911+0000", 2024-04-18T21:07:03.483 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.022008706999999999 2024-04-18T21:07:03.483 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.483 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.483 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:03.483 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.273383+0000", 2024-04-18T21:07:03.483 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019471568000000002 2024-04-18T21:07:03.483 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.483 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.483 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:03.483 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.273418+0000", 2024-04-18T21:07:03.483 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.5265999999999997e-05 2024-04-18T21:07:03.483 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.483 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.483 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:03.484 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.273446+0000", 2024-04-18T21:07:03.484 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7696e-05 2024-04-18T21:07:03.484 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:03.484 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:03.484 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:03.484 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.484 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.484 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:12693 4.2b 4:d71e94ee:::10000003509.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:03.484 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:00.231503+0000", 2024-04-18T21:07:03.484 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 3.1719816729999999, 2024-04-18T21:07:03.484 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.042620511999999999, 2024-04-18T21:07:03.484 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:03.484 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:03.484 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:03.484 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:03.485 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:03.485 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:03.485 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 12693 2024-04-18T21:07:03.485 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.485 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:03.485 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.485 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:03.485 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231503+0000", 2024-04-18T21:07:03.485 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:03.485 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.485 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.485 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:03.485 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231503+0000", 2024-04-18T21:07:03.485 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:03.485 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.486 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.486 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:03.486 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231505+0000", 2024-04-18T21:07:03.486 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9530000000000002e-06 2024-04-18T21:07:03.486 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.486 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.486 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:03.486 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.238278+0000", 2024-04-18T21:07:03.486 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0067732269999999997 2024-04-18T21:07:03.486 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.486 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.486 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:03.486 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.238295+0000", 2024-04-18T21:07:03.486 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7268000000000001e-05 2024-04-18T21:07:03.487 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.487 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.487 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:03.487 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.238303+0000", 2024-04-18T21:07:03.487 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.1559999999999995e-06 2024-04-18T21:07:03.487 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.487 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.487 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:03.487 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.238370+0000", 2024-04-18T21:07:03.487 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.6959999999999996e-05 2024-04-18T21:07:03.487 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.487 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.487 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:03.487 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.238569+0000", 2024-04-18T21:07:03.487 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000198242 2024-04-18T21:07:03.487 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.488 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.488 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:03.488 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.238840+0000", 2024-04-18T21:07:03.488 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00027115 2024-04-18T21:07:03.488 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.488 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.488 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:03.488 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.268210+0000", 2024-04-18T21:07:03.488 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.029370216000000001 2024-04-18T21:07:03.488 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.488 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.488 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:03.488 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.274023+0000", 2024-04-18T21:07:03.488 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0058133009999999999 2024-04-18T21:07:03.488 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.489 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.489 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:03.489 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.274064+0000", 2024-04-18T21:07:03.489 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.0157000000000002e-05 2024-04-18T21:07:03.489 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.489 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.489 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:03.489 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.274123+0000", 2024-04-18T21:07:03.489 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.9882e-05 2024-04-18T21:07:03.489 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:03.489 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:03.489 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:03.489 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.489 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.489 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:15008 4.2b 4:d5496710:::100000033cf.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-18T21:07:03.490 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:02.998996+0000", 2024-04-18T21:07:03.490 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.40448839599999997, 2024-04-18T21:07:03.490 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.042584729000000002, 2024-04-18T21:07:03.490 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:03.490 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:03.490 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:03.490 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:03.490 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:03.490 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:03.490 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 15008 2024-04-18T21:07:03.490 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.490 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:03.490 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.490 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:03.491 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:02.998996+0000", 2024-04-18T21:07:03.491 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:03.491 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.491 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.491 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:03.491 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:02.998996+0000", 2024-04-18T21:07:03.491 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:03.491 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.491 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.491 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:03.491 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:02.998997+0000", 2024-04-18T21:07:03.491 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.4000000000000001e-07 2024-04-18T21:07:03.491 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.491 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.492 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:03.492 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.005534+0000", 2024-04-18T21:07:03.492 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0065367339999999998 2024-04-18T21:07:03.492 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.492 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.492 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:03.492 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.005562+0000", 2024-04-18T21:07:03.492 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8861999999999999e-05 2024-04-18T21:07:03.492 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.492 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.492 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:03.492 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.005582+0000", 2024-04-18T21:07:03.492 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9987e-05 2024-04-18T21:07:03.492 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.493 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.493 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:03.493 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.005659+0000", 2024-04-18T21:07:03.493 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.6570999999999996e-05 2024-04-18T21:07:03.493 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.493 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.493 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:03.493 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.005841+0000", 2024-04-18T21:07:03.493 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018223600000000001 2024-04-18T21:07:03.493 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.493 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.493 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:03.493 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.005976+0000", 2024-04-18T21:07:03.493 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000135165 2024-04-18T21:07:03.493 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.494 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.494 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:03.494 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.015878+0000", 2024-04-18T21:07:03.494 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0099018390000000008 2024-04-18T21:07:03.494 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.494 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.494 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:03.494 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.041515+0000", 2024-04-18T21:07:03.494 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.025636982999999999 2024-04-18T21:07:03.494 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.494 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.494 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:03.494 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.041554+0000", 2024-04-18T21:07:03.495 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.8679e-05 2024-04-18T21:07:03.495 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.495 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.495 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:03.495 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.041581+0000", 2024-04-18T21:07:03.495 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7033e-05 2024-04-18T21:07:03.495 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:03.495 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:03.495 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:03.495 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.495 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.495 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:15085 4.20 4:04677f23:::100000034fe.00000000:head [write 0~4194304 [2@471250]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-18T21:07:03.495 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:03.092507+0000", 2024-04-18T21:07:03.495 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.31097794299999998, 2024-04-18T21:07:03.496 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.042978905999999997, 2024-04-18T21:07:03.496 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:03.496 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:03.496 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:03.496 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:03.496 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:03.496 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:03.496 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 15085 2024-04-18T21:07:03.496 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.496 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:03.496 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.496 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:03.496 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.092507+0000", 2024-04-18T21:07:03.496 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:03.496 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.496 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.496 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:03.497 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.092507+0000", 2024-04-18T21:07:03.497 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:03.497 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.497 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.497 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:03.497 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.092507+0000", 2024-04-18T21:07:03.497 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8299999999999996e-07 2024-04-18T21:07:03.497 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.497 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.497 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:03.497 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.099434+0000", 2024-04-18T21:07:03.497 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.006926176 2024-04-18T21:07:03.497 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.497 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.497 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:03.497 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.099451+0000", 2024-04-18T21:07:03.498 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7733000000000001e-05 2024-04-18T21:07:03.498 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.498 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.498 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:03.498 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.099460+0000", 2024-04-18T21:07:03.498 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5990000000000002e-06 2024-04-18T21:07:03.498 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.498 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.498 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:03.498 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.099519+0000", 2024-04-18T21:07:03.498 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.9106e-05 2024-04-18T21:07:03.498 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.498 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.498 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:03.498 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.099637+0000", 2024-04-18T21:07:03.499 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000117917 2024-04-18T21:07:03.499 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.499 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.499 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:03.499 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.099893+0000", 2024-04-18T21:07:03.499 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00025568800000000001 2024-04-18T21:07:03.499 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.499 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.499 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:03.499 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.125269+0000", 2024-04-18T21:07:03.499 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.025376177999999999 2024-04-18T21:07:03.499 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.499 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.499 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:03.500 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.135427+0000", 2024-04-18T21:07:03.500 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010158149 2024-04-18T21:07:03.500 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.500 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.500 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:03.500 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.135461+0000", 2024-04-18T21:07:03.500 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.4440999999999998e-05 2024-04-18T21:07:03.500 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.500 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.500 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:03.500 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.135486+0000", 2024-04-18T21:07:03.500 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.4136000000000001e-05 2024-04-18T21:07:03.500 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:03.500 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:03.500 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:03.501 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.501 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.501 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:15094 4.c 4:32870457:::10000003692.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-18T21:07:03.501 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:03.107374+0000", 2024-04-18T21:07:03.501 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.296110133, 2024-04-18T21:07:03.501 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.061575983000000001, 2024-04-18T21:07:03.501 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:03.501 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:03.501 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:03.501 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:03.501 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:03.501 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:03.501 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 15094 2024-04-18T21:07:03.501 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.501 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:03.502 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.502 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:03.502 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.107374+0000", 2024-04-18T21:07:03.502 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:03.502 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.502 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.502 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:03.502 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.107374+0000", 2024-04-18T21:07:03.502 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:03.502 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.502 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.502 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:03.502 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.107376+0000", 2024-04-18T21:07:03.502 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3969999999999999e-06 2024-04-18T21:07:03.502 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.503 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.503 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:03.503 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115698+0000", 2024-04-18T21:07:03.503 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0083223989999999994 2024-04-18T21:07:03.503 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.503 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.503 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:03.503 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115713+0000", 2024-04-18T21:07:03.503 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4385e-05 2024-04-18T21:07:03.503 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.503 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.503 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:03.503 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115722+0000", 2024-04-18T21:07:03.503 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0759999999999992e-06 2024-04-18T21:07:03.504 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.504 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.504 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:03.504 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115784+0000", 2024-04-18T21:07:03.504 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.2348999999999995e-05 2024-04-18T21:07:03.504 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.504 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.504 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:03.504 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115849+0000", 2024-04-18T21:07:03.504 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.4964999999999999e-05 2024-04-18T21:07:03.504 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.504 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.504 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:03.504 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.116054+0000", 2024-04-18T21:07:03.504 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020483400000000001 2024-04-18T21:07:03.505 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.505 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.505 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:03.505 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.125769+0000", 2024-04-18T21:07:03.505 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0097153340000000008 2024-04-18T21:07:03.505 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.505 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.505 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:03.505 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.168834+0000", 2024-04-18T21:07:03.505 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043064527999999998 2024-04-18T21:07:03.505 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.505 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.505 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:03.505 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.168882+0000", 2024-04-18T21:07:03.505 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.7919e-05 2024-04-18T21:07:03.506 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.506 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.506 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:03.506 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.168950+0000", 2024-04-18T21:07:03.506 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.8796999999999999e-05 2024-04-18T21:07:03.506 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:03.506 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:03.506 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:03.506 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.506 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.506 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:15133 4.38 4:1c73eb83:::1000000398c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-18T21:07:03.506 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:03.155031+0000", 2024-04-18T21:07:03.506 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.248453592, 2024-04-18T21:07:03.506 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.044078787000000001, 2024-04-18T21:07:03.506 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:03.507 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:03.507 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:03.507 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:03.507 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:03.507 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:03.507 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 15133 2024-04-18T21:07:03.507 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.507 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:03.507 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.507 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:03.507 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.155031+0000", 2024-04-18T21:07:03.507 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:03.507 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.509 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.509 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:03.509 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.155031+0000", 2024-04-18T21:07:03.509 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:03.509 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.509 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.509 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:03.509 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.155033+0000", 2024-04-18T21:07:03.509 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.84e-06 2024-04-18T21:07:03.510 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.510 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.510 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:03.510 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.161994+0000", 2024-04-18T21:07:03.510 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0069607779999999999 2024-04-18T21:07:03.510 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.510 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.510 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:03.510 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.162008+0000", 2024-04-18T21:07:03.510 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4399000000000001e-05 2024-04-18T21:07:03.510 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.510 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.510 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:03.510 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.162018+0000", 2024-04-18T21:07:03.511 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.7149999999999993e-06 2024-04-18T21:07:03.511 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.511 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.511 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:03.511 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.162073+0000", 2024-04-18T21:07:03.511 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4803999999999999e-05 2024-04-18T21:07:03.511 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.511 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.511 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:03.511 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.162215+0000", 2024-04-18T21:07:03.511 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014222900000000001 2024-04-18T21:07:03.511 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.511 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.511 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:03.511 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.162341+0000", 2024-04-18T21:07:03.511 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012579400000000001 2024-04-18T21:07:03.512 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.512 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.512 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:03.512 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.169445+0000", 2024-04-18T21:07:03.512 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0071040360000000002 2024-04-18T21:07:03.512 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.512 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.512 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:03.512 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.199046+0000", 2024-04-18T21:07:03.512 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.029601639999999999 2024-04-18T21:07:03.512 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.512 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.512 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:03.512 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.199082+0000", 2024-04-18T21:07:03.512 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.6134999999999999e-05 2024-04-18T21:07:03.512 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:03.513 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:03.513 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:03.513 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.199110+0000", 2024-04-18T21:07:03.513 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7416999999999999e-05 2024-04-18T21:07:03.513 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:03.513 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:03.513 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:03.513 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:03.513 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:03.513 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:07:03.517 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:07:03.521 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:03.514+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:03.526 INFO:tasks.workunit.client.0.smithi078.stdout:8/971: mkdir d0/d10/d14/d2a/d4a/db2/db6/df4/d116/d12d 0 2024-04-18T21:07:03.526 INFO:tasks.workunit.client.0.smithi078.stdout:7/954: creat d1/d16/d65/d10e/de6/d129/f13f x:0 0 0 2024-04-18T21:07:03.526 INFO:tasks.workunit.client.0.smithi078.stdout:3/944: dread d4/da/f81 [0,4194304] 0 2024-04-18T21:07:03.526 INFO:tasks.workunit.client.0.smithi078.stdout:8/972: getdents d0/d10/d8d 0 2024-04-18T21:07:03.526 INFO:tasks.workunit.client.0.smithi078.stdout:3/945: stat d4/da/ddf/dc4/d118/d84/dfb 0 2024-04-18T21:07:03.526 INFO:tasks.workunit.client.0.smithi078.stdout:8/973: write d0/d10/d14/d2d/f128 [280340,59018] 0 2024-04-18T21:07:03.526 INFO:tasks.workunit.client.0.smithi078.stdout:8/974: write d0/d10/d14/d2a/dbd/f125 [525064,43384] 0 2024-04-18T21:07:03.526 INFO:tasks.workunit.client.0.smithi078.stdout:8/975: symlink d0/d10/d14/d62/l12e 0 2024-04-18T21:07:03.526 INFO:tasks.workunit.client.0.smithi078.stdout:8/976: rmdir d0/d5c/d5a/d7b 39 2024-04-18T21:07:03.527 INFO:tasks.workunit.client.0.smithi078.stdout:3/946: write d4/da/ddf/dc4/d118/d35/d4b/f9c [8184122,44951] 0 2024-04-18T21:07:03.527 INFO:tasks.workunit.client.0.smithi078.stdout:3/947: fdatasync d4/da/d76/f113 0 2024-04-18T21:07:03.527 INFO:tasks.workunit.client.0.smithi078.stdout:8/977: getdents d0/d10/d14/d2a/dbd 0 2024-04-18T21:07:03.527 INFO:tasks.workunit.client.0.smithi078.stdout:7/955: dwrite d1/d16/dc/d11/f2b [0,4194304] 0 2024-04-18T21:07:03.527 INFO:tasks.workunit.client.0.smithi078.stdout:3/948: read - d4/da/ddf/da0/f128 zero size 2024-04-18T21:07:03.527 INFO:tasks.workunit.client.0.smithi078.stdout:8/978: mknod d0/c12f 0 2024-04-18T21:07:03.527 INFO:tasks.workunit.client.0.smithi078.stdout:7/956: write d1/d16/d1c/fab [2407426,41220] 0 2024-04-18T21:07:03.527 INFO:tasks.workunit.client.0.smithi078.stdout:8/979: write d0/d10/d60/d6f/fe1 [3165547,86771] 0 2024-04-18T21:07:03.527 INFO:tasks.workunit.client.0.smithi078.stdout:3/949: chown d4/da/ddf/dc4/d118/f40 1922273 1 2024-04-18T21:07:03.527 INFO:tasks.workunit.client.0.smithi078.stdout:7/957: dread - d1/d16/dc/d11/da2/dbc/f130 zero size 2024-04-18T21:07:03.527 INFO:tasks.workunit.client.0.smithi078.stdout:3/950: rename d4/da/ddf/da0/de5/l10a to d4/da/d11/d66/dbe/l12f 0 2024-04-18T21:07:03.527 INFO:tasks.workunit.client.0.smithi078.stdout:7/958: write d1/d16/d65/d10e/de6/ff1 [6382636,104532] 0 2024-04-18T21:07:03.527 INFO:tasks.workunit.client.0.smithi078.stdout:7/959: creat d1/d16/dc/d11/da2/dbc/dc3/f140 x:0 0 0 2024-04-18T21:07:03.527 INFO:tasks.workunit.client.0.smithi078.stdout:7/960: rmdir d1/d16/d1c 39 2024-04-18T21:07:03.528 INFO:tasks.workunit.client.0.smithi078.stdout:7/961: symlink d1/d16/dc/d31/dee/l141 0 2024-04-18T21:07:03.528 INFO:tasks.workunit.client.0.smithi078.stdout:7/962: creat d1/d16/dc/d31/dee/f142 x:0 0 0 2024-04-18T21:07:03.528 INFO:tasks.workunit.client.0.smithi078.stdout:8/980: dwrite d0/d10/d14/d2a/d4a/f7e [4194304,4194304] 0 2024-04-18T21:07:03.528 INFO:tasks.workunit.client.0.smithi078.stdout:7/963: unlink d1/d16/dc/d11/d53/caf 0 2024-04-18T21:07:03.528 INFO:tasks.workunit.client.0.smithi078.stdout:8/981: dread - d0/d10/d14/d2a/d4a/db2/db6/df4/d116/f123 zero size 2024-04-18T21:07:03.528 INFO:tasks.workunit.client.0.smithi078.stdout:7/964: rename d1/f128 to d1/d16/dc/d11/d53/d82/da4/f143 0 2024-04-18T21:07:03.528 INFO:tasks.workunit.client.0.smithi078.stdout:7/965: chown d1/d16/dc/l30 50665992 1 2024-04-18T21:07:03.528 INFO:tasks.workunit.client.0.smithi078.stdout:2/978: dwrite d0/db/d18/d21/d27/d29/d33/f6a [0,4194304] 0 2024-04-18T21:07:03.528 INFO:tasks.workunit.client.0.smithi078.stdout:7/966: mkdir d1/d16/d10/d5a/d144 0 2024-04-18T21:07:03.528 INFO:tasks.workunit.client.0.smithi078.stdout:8/982: rename d0/d10/d14/d2d/f128 to d0/d10/d14/d2d/d93/da0/db5/db9/f130 0 2024-04-18T21:07:03.528 INFO:tasks.workunit.client.0.smithi078.stdout:2/979: creat d0/db/d18/d21/d27/d29/d33/f131 x:0 0 0 2024-04-18T21:07:03.528 INFO:tasks.workunit.client.0.smithi078.stdout:7/967: creat d1/da6/f145 x:0 0 0 2024-04-18T21:07:03.528 INFO:tasks.workunit.client.0.smithi078.stdout:8/983: symlink d0/d10/d14/d2a/d4a/db2/l131 0 2024-04-18T21:07:03.528 INFO:tasks.workunit.client.0.smithi078.stdout:2/980: write d0/db/d6e/dd2/fe4 [255526,117045] 0 2024-04-18T21:07:03.529 INFO:tasks.workunit.client.0.smithi078.stdout:8/984: write d0/f84 [200193,83171] 0 2024-04-18T21:07:03.529 INFO:tasks.workunit.client.0.smithi078.stdout:7/968: getdents d1/d16/d10/d7c/dc0 0 2024-04-18T21:07:03.529 INFO:tasks.workunit.client.0.smithi078.stdout:8/985: read d0/d5c/d5a/fbc [5203721,77719] 0 2024-04-18T21:07:03.529 INFO:tasks.workunit.client.0.smithi078.stdout:7/969: read d1/d16/dc/d11/f24 [4730687,123970] 0 2024-04-18T21:07:03.529 INFO:tasks.workunit.client.0.smithi078.stdout:2/981: read d0/d1f/fcb [2383101,21603] 0 2024-04-18T21:07:03.529 INFO:tasks.workunit.client.0.smithi078.stdout:8/986: mkdir d0/d10/d14/d2a/d4a/db2/db6/df4/d116/d132 0 2024-04-18T21:07:03.529 INFO:tasks.workunit.client.0.smithi078.stdout:7/970: creat d1/d16/dc/d11/d53/d82/dfe/d11e/f146 x:0 0 0 2024-04-18T21:07:03.529 INFO:tasks.workunit.client.0.smithi078.stdout:2/982: write d0/db/d65/d96/f11b [522272,19978] 0 2024-04-18T21:07:03.529 INFO:tasks.workunit.client.0.smithi078.stdout:2/983: creat d0/db/d6e/dd2/dd3/d114/f132 x:0 0 0 2024-04-18T21:07:03.529 INFO:tasks.workunit.client.0.smithi078.stdout:2/984: getdents d0/db/d18/d21/db0/d59 0 2024-04-18T21:07:03.529 INFO:tasks.workunit.client.0.smithi078.stdout:2/985: rename d0/d1f/d34/dd5 to d0/db/d18/d21/d27/d29/d57/d7c/d133 0 2024-04-18T21:07:03.529 INFO:tasks.workunit.client.0.smithi078.stdout:8/987: dwrite d0/f55 [0,4194304] 0 2024-04-18T21:07:03.529 INFO:tasks.workunit.client.0.smithi078.stdout:2/986: creat d0/db/d18/dbb/dde/d106/f134 x:0 0 0 2024-04-18T21:07:03.529 INFO:tasks.workunit.client.0.smithi078.stdout:8/988: creat d0/d10/d14/d2d/d93/da0/dc2/dfa/f133 x:0 0 0 2024-04-18T21:07:03.529 INFO:tasks.workunit.client.0.smithi078.stdout:2/987: mknod d0/db/d18/d21/d27/d29/de3/c135 0 2024-04-18T21:07:03.530 INFO:tasks.workunit.client.0.smithi078.stdout:2/988: creat d0/db/d18/d21/d27/d29/de3/f136 x:0 0 0 2024-04-18T21:07:03.530 INFO:tasks.workunit.client.0.smithi078.stdout:2/989: creat d0/d1f/d5b/f137 x:0 0 0 2024-04-18T21:07:03.530 INFO:tasks.workunit.client.0.smithi078.stdout:2/990: creat d0/d87/f138 x:0 0 0 2024-04-18T21:07:03.530 INFO:tasks.workunit.client.0.smithi078.stdout:2/991: rename d0/da9/c11a to d0/db/d6e/dd2/dd3/d11f/c139 0 2024-04-18T21:07:03.530 INFO:tasks.workunit.client.0.smithi078.stdout:2/992: rename d0/db/d18/d21/d27/d29/d57/d7c/d133/l85 to d0/db/d18/d21/de1/l13a 0 2024-04-18T21:07:03.530 INFO:tasks.workunit.client.0.smithi078.stdout:7/971: dread d1/d16/dc/ff7 [0,4194304] 0 2024-04-18T21:07:03.530 INFO:tasks.workunit.client.0.smithi078.stdout:7/972: fsync d1/d16/d65/fe2 0 2024-04-18T21:07:03.530 INFO:tasks.workunit.client.0.smithi078.stdout:3/951: sync 2024-04-18T21:07:03.530 INFO:tasks.workunit.client.0.smithi078.stdout:2/993: dwrite d0/db/d18/d21/d27/d29/d57/d7c/d133/f80 [0,4194304] 0 2024-04-18T21:07:03.530 INFO:tasks.workunit.client.0.smithi078.stdout:2/994: write d0/db/d18/d21/d27/d29/d57/f125 [954524,119958] 0 2024-04-18T21:07:03.530 INFO:tasks.workunit.client.0.smithi078.stdout:2/995: dread - d0/db/d18/dbb/dde/f118 zero size 2024-04-18T21:07:03.530 INFO:tasks.workunit.client.0.smithi078.stdout:7/973: dwrite d1/d16/d10/d7c/d7e/d97/f9e [0,4194304] 0 2024-04-18T21:07:03.530 INFO:tasks.workunit.client.0.smithi078.stdout:7/974: creat d1/d16/d10/d7c/d7e/de3/d137/f147 x:0 0 0 2024-04-18T21:07:03.530 INFO:tasks.workunit.client.0.smithi078.stdout:3/952: write d4/da/d11/f72 [1702288,122053] 0 2024-04-18T21:07:03.531 INFO:tasks.workunit.client.0.smithi078.stdout:3/953: creat d4/da/ddf/dc4/d118/d35/d4b/f130 x:0 0 0 2024-04-18T21:07:03.531 INFO:tasks.workunit.client.0.smithi078.stdout:3/954: symlink d4/dc3/l131 0 2024-04-18T21:07:03.531 INFO:tasks.workunit.client.0.smithi078.stdout:3/955: creat d4/da/d11/d66/f132 x:0 0 0 2024-04-18T21:07:03.531 INFO:tasks.workunit.client.0.smithi078.stdout:7/975: dwrite d1/f80 [0,4194304] 0 2024-04-18T21:07:03.531 INFO:tasks.workunit.client.0.smithi078.stdout:3/956: dread - d4/d2d/d6c/db5/fbc zero size 2024-04-18T21:07:03.531 INFO:tasks.workunit.client.0.smithi078.stdout:3/957: creat d4/df/db0/f133 x:0 0 0 2024-04-18T21:07:03.531 INFO:tasks.workunit.client.0.smithi078.stdout:7/976: link d1/d16/d10/d7c/d7e/de3/cf0 d1/d16/dc/d11/d53/d82/da4/db5/d91/db3/c148 0 2024-04-18T21:07:03.531 INFO:tasks.workunit.client.0.smithi078.stdout:2/996: read d0/db/d18/d21/d27/d29/d57/d7c/d133/f71 [4870144,12872] 0 2024-04-18T21:07:03.531 INFO:tasks.workunit.client.0.smithi078.stdout:3/958: getdents d4/da/d11 0 2024-04-18T21:07:03.531 INFO:tasks.workunit.client.0.smithi078.stdout:7/977: readlink d1/d16/dc/d11/d53/d82/da4/lbe 0 2024-04-18T21:07:03.531 INFO:tasks.workunit.client.0.smithi078.stdout:2/997: fsync d0/db/f36 0 2024-04-18T21:07:03.531 INFO:tasks.workunit.client.0.smithi078.stdout:3/959: unlink d4/da/d11/d66/dbe/l6b 0 2024-04-18T21:07:03.531 INFO:tasks.workunit.client.0.smithi078.stdout:7/978: write d1/d32/f41 [2433902,6020] 0 2024-04-18T21:07:03.531 INFO:tasks.workunit.client.0.smithi078.stdout:2/998: mkdir d0/db/d18/d21/d27/d13b 0 2024-04-18T21:07:03.532 INFO:tasks.workunit.client.0.smithi078.stdout:3/960: mknod d4/d2d/d6c/d12d/c134 0 2024-04-18T21:07:03.532 INFO:tasks.workunit.client.0.smithi078.stdout:2/999: creat d0/db/d18/d21/d27/d29/d57/d7c/d133/dbc/f13c x:0 0 0 2024-04-18T21:07:03.532 INFO:tasks.workunit.client.0.smithi078.stdout:3/961: read d4/da/ddf/dc4/d118/fd4 [127217,49448] 0 2024-04-18T21:07:03.532 INFO:tasks.workunit.client.0.smithi078.stdout:7/979: dwrite d1/d16/dc/d11/d53/d82/da4/ff3 [0,4194304] 0 2024-04-18T21:07:03.532 INFO:tasks.workunit.client.0.smithi078.stdout:7/980: getdents d1/d16/dc/d31/de8/d12d 0 2024-04-18T21:07:03.532 INFO:tasks.workunit.client.0.smithi078.stdout:7/981: dwrite d1/d16/dc/d4b/f43 [4194304,4194304] 0 2024-04-18T21:07:03.532 INFO:tasks.workunit.client.0.smithi078.stdout:7/982: truncate d1/d16/dc/d4b/fe5 943401 0 2024-04-18T21:07:03.532 INFO:tasks.workunit.client.0.smithi078.stdout:7/983: dread - d1/d32/f72 zero size 2024-04-18T21:07:03.532 INFO:tasks.workunit.client.0.smithi078.stdout:7/984: unlink d1/d16/dc/d11/d53/d82/da4/db5/d91/db3/f11f 0 2024-04-18T21:07:03.532 INFO:tasks.workunit.client.0.smithi078.stdout:7/985: creat d1/d16/dc/d11/d53/d82/da4/db5/d91/db3/f149 x:0 0 0 2024-04-18T21:07:03.532 INFO:tasks.workunit.client.0.smithi078.stdout:7/986: symlink d1/d16/d10/dc6/l14a 0 2024-04-18T21:07:03.532 INFO:tasks.workunit.client.0.smithi078.stdout:7/987: dread - d1/d16/dc/d11/da2/fb1 zero size 2024-04-18T21:07:03.532 INFO:tasks.workunit.client.0.smithi078.stdout:7/988: fsync d1/d16/d2d/f47 0 2024-04-18T21:07:03.532 INFO:tasks.workunit.client.0.smithi078.stdout:8/989: dread d0/f5 [0,4194304] 0 2024-04-18T21:07:03.532 INFO:tasks.workunit.client.0.smithi078.stdout:8/990: readlink d0/d22/l6e 0 2024-04-18T21:07:03.532 INFO:tasks.workunit.client.0.smithi078.stdout:8/991: mknod d0/d10/d14/d2d/d93/da0/c134 0 2024-04-18T21:07:03.533 INFO:tasks.workunit.client.0.smithi078.stdout:3/962: dread d4/d2d/f55 [0,4194304] 0 2024-04-18T21:07:03.533 INFO:tasks.workunit.client.0.smithi078.stdout:3/963: link d4/da/d5e/l116 d4/da/d11/d66/deb/l135 0 2024-04-18T21:07:03.533 INFO:tasks.workunit.client.0.smithi078.stdout:3/964: stat d4/d2d/d6c/c10e 0 2024-04-18T21:07:03.533 INFO:tasks.workunit.client.0.smithi078.stdout:3/965: rename d4/da/ddf/dc4/ff6 to d4/da/ddf/dc4/d122/f136 0 2024-04-18T21:07:03.533 INFO:tasks.workunit.client.0.smithi078.stdout:8/992: dwrite d0/d10/feb [0,4194304] 0 2024-04-18T21:07:03.533 INFO:tasks.workunit.client.0.smithi078.stdout:8/993: write d0/d10/d14/d2d/d93/da0/f120 [412809,14676] 0 2024-04-18T21:07:03.533 INFO:tasks.workunit.client.0.smithi078.stdout:8/994: read - d0/da8/fdb zero size 2024-04-18T21:07:03.533 INFO:tasks.workunit.client.0.smithi078.stdout:8/995: rename d0/d5c/c5d to d0/d5c/d5a/dc6/c135 0 2024-04-18T21:07:03.533 INFO:tasks.workunit.client.0.smithi078.stdout:8/996: chown d0/d5c/d5a/dc6/d112 96 1 2024-04-18T21:07:03.533 INFO:tasks.workunit.client.0.smithi078.stdout:3/966: dwrite d4/dc3/d12e/f123 [0,4194304] 0 2024-04-18T21:07:03.533 INFO:tasks.workunit.client.0.smithi078.stdout:3/967: creat d4/da/ddf/da0/de5/f137 x:0 0 0 2024-04-18T21:07:03.533 INFO:tasks.workunit.client.0.smithi078.stdout:3/968: mkdir d4/da/d11/d66/dbe/dd0/d138 0 2024-04-18T21:07:03.533 INFO:tasks.workunit.client.0.smithi078.stdout:3/969: rename d4/d2d/d6c/d12d/c134 to d4/da/ddf/da0/de5/c139 0 2024-04-18T21:07:03.533 INFO:tasks.workunit.client.0.smithi078.stdout:8/997: dwrite d0/f45 [4194304,4194304] 0 2024-04-18T21:07:03.533 INFO:tasks.workunit.client.0.smithi078.stdout:8/998: dread - d0/d10/d8d/f121 zero size 2024-04-18T21:07:03.533 INFO:tasks.workunit.client.0.smithi078.stdout:8/999: creat d0/d10/d14/d2a/d4a/db2/f136 x:0 0 0 2024-04-18T21:07:03.533 INFO:tasks.workunit.client.0.smithi078.stdout:7/989: sync 2024-04-18T21:07:03.534 INFO:tasks.workunit.client.0.smithi078.stdout:3/970: dread d4/da/f119 [0,4194304] 0 2024-04-18T21:07:03.534 INFO:tasks.workunit.client.0.smithi078.stdout:3/971: link d4/df/fcf d4/da/d76/dce/f13a 0 2024-04-18T21:07:03.534 INFO:tasks.workunit.client.0.smithi078.stdout:3/972: creat d4/df/db0/dc5/d41/dda/f13b x:0 0 0 2024-04-18T21:07:03.534 INFO:tasks.workunit.client.0.smithi078.stdout:3/973: mknod d4/da/c13c 0 2024-04-18T21:07:03.535 INFO:tasks.workunit.client.0.smithi078.stdout:7/990: dread d1/d16/dc/f60 [0,4194304] 0 2024-04-18T21:07:03.535 INFO:tasks.workunit.client.0.smithi078.stdout:7/991: getdents d1 0 2024-04-18T21:07:03.535 INFO:tasks.workunit.client.0.smithi078.stdout:7/992: mknod d1/d16/d65/d12e/c14b 0 2024-04-18T21:07:03.535 INFO:tasks.workunit.client.0.smithi078.stdout:7/993: dread - d1/d16/dc/d31/f123 zero size 2024-04-18T21:07:03.536 INFO:tasks.workunit.client.0.smithi078.stdout:7/994: dread d1/d16/dc/d11/d53/d82/da4/db5/d91/db4/fde [0,4194304] 0 2024-04-18T21:07:03.537 INFO:tasks.workunit.client.0.smithi078.stdout:7/995: unlink d1/d16/dc/d31/fc9 0 2024-04-18T21:07:03.538 INFO:tasks.workunit.client.0.smithi078.stdout:7/996: link d1/d16/dc/d11/d53/d82/da4/db5/d91/db0/fd4 d1/d16/dc/d31/de8/f14c 0 2024-04-18T21:07:03.539 INFO:tasks.workunit.client.0.smithi078.stdout:7/997: mkdir d1/d16/d10/d7c/d7e/d97/d14d 0 2024-04-18T21:07:03.540 INFO:tasks.workunit.client.0.smithi078.stdout:7/998: creat d1/d16/d65/f14e x:0 0 0 2024-04-18T21:07:03.543 INFO:tasks.workunit.client.0.smithi078.stdout:7/999: dread d1/d16/dc/f55 [0,4194304] 0 2024-04-18T21:07:03.544 INFO:tasks.workunit.client.0.smithi078.stdout:3/974: dread d4/da/ddf/dc4/d118/d35/d4b/d59/f9a [0,4194304] 0 2024-04-18T21:07:03.559 INFO:tasks.workunit.client.0.smithi078.stdout:3/975: dread d4/da/d11/f2c [0,4194304] 0 2024-04-18T21:07:03.559 INFO:tasks.workunit.client.0.smithi078.stdout:3/976: write d4/da/d11/d66/f10d [25164,97655] 0 2024-04-18T21:07:03.564 INFO:tasks.workunit.client.0.smithi078.stdout:3/977: dwrite d4/da/ddf/dc4/d118/d35/d4b/d59/f5f [0,4194304] 0 2024-04-18T21:07:03.565 INFO:tasks.workunit.client.0.smithi078.stdout:3/978: readlink d4/da/d11/l63 0 2024-04-18T21:07:03.566 INFO:tasks.workunit.client.0.smithi078.stdout:3/979: fsync d4/df/d62/fac 0 2024-04-18T21:07:03.566 INFO:tasks.workunit.client.0.smithi078.stdout:3/980: rmdir d4/df/d62 39 2024-04-18T21:07:03.571 INFO:tasks.workunit.client.0.smithi078.stdout:3/981: dwrite d4/f13 [0,4194304] 0 2024-04-18T21:07:03.571 INFO:tasks.workunit.client.0.smithi078.stdout:3/982: readlink d4/df/db0/dc5/d41/lb4 0 2024-04-18T21:07:03.575 INFO:tasks.workunit.client.0.smithi078.stdout:3/983: write d4/da/d5e/faf [1017366,21224] 0 2024-04-18T21:07:03.576 INFO:tasks.workunit.client.0.smithi078.stdout:3/984: mknod d4/da/d11/d66/dca/c13d 0 2024-04-18T21:07:03.576 INFO:tasks.workunit.client.0.smithi078.stdout:3/985: write d4/da/ddf/da0/f128 [905305,119187] 0 2024-04-18T21:07:03.577 INFO:tasks.workunit.client.0.smithi078.stdout:3/986: creat d4/d2d/d6c/db5/f13e x:0 0 0 2024-04-18T21:07:03.578 INFO:tasks.workunit.client.0.smithi078.stdout:3/987: truncate d4/da/ddf/fb9 4555869 0 2024-04-18T21:07:03.578 INFO:tasks.workunit.client.0.smithi078.stdout:3/988: rmdir d4/da/ddf/dc4/d118/d35/d4b/d59 39 2024-04-18T21:07:03.579 INFO:tasks.workunit.client.0.smithi078.stdout:3/989: rename d4/df/db0/dc5/d41/ffe to d4/da/ddf/dc4/d118/d84/dfb/d12b/f13f 0 2024-04-18T21:07:03.580 INFO:tasks.workunit.client.0.smithi078.stdout:3/990: chown d4/df/db0/ff4 143216030 1 2024-04-18T21:07:03.580 INFO:tasks.workunit.client.0.smithi078.stdout:3/991: chown d4/d2d/f55 4974327 1 2024-04-18T21:07:03.589 INFO:tasks.workunit.client.0.smithi078.stdout:3/992: write d4/d2d/f55 [2163605,28479] 0 2024-04-18T21:07:03.590 INFO:tasks.workunit.client.0.smithi078.stdout:3/993: rmdir d4/dc3 39 2024-04-18T21:07:03.590 INFO:tasks.workunit.client.0.smithi078.stdout:3/994: readlink d4/da/d11/d66/dbe/l12f 0 2024-04-18T21:07:03.591 INFO:tasks.workunit.client.0.smithi078.stdout:3/995: fsync d4/da/d11/f21 0 2024-04-18T21:07:03.595 INFO:tasks.workunit.client.0.smithi078.stdout:3/996: dwrite d4/da/f79 [4194304,4194304] 0 2024-04-18T21:07:03.596 INFO:tasks.workunit.client.0.smithi078.stdout:3/997: chown d4/da/d5e/faf 3 1 2024-04-18T21:07:03.598 INFO:tasks.workunit.client.0.smithi078.stdout:3/998: link d4/df/db0/dc5/d41/lb4 d4/df/db0/dc5/d41/dda/de2/l140 0 2024-04-18T21:07:03.599 INFO:tasks.workunit.client.0.smithi078.stdout:3/999: link d4/da/f79 d4/da/ddf/dc4/d118/d35/d4b/d11a/f141 0 2024-04-18T21:07:03.601 INFO:tasks.workunit.client.0.smithi078.stderr:+ rm -rf -- ./tmp.FPBw8XtMy8 2024-04-18T21:07:03.617 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:03.618+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:03.658 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:07:03.658 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:07:03.658 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-04-18T21:07:03.658 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:07:03.672 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:07:03.718 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:03.718+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:03.798 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:07:03.798 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:07:03.798 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-18T21:07:03.798 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-18T21:07:03.798 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:07:03.814 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:03.818 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:03.818+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:03.858 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-18T21:07:03.919 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:03.921+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:03.983 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:07:03.984 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-18T21:07:03.984 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-18T21:07:03.984 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:07:03.984 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:03.984 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:03.984 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:07:03.984 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 118.366533023, 2024-04-18T21:07:03.984 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045668994999999997, 2024-04-18T21:07:03.984 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:03.984 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:03.984 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:03.984 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:03.985 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:03.985 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:03.985 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:07:03.985 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:03.985 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:03.985 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:03.985 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:03.985 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:07:03.985 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:03.985 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:03.985 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:03.985 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:03.985 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615459+0000", 2024-04-18T21:07:03.985 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5030000000000001e-06 2024-04-18T21:07:03.986 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:03.986 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:03.986 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:03.986 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615506+0000", 2024-04-18T21:07:03.986 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6872000000000001e-05 2024-04-18T21:07:03.986 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:03.986 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:03.986 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:03.986 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615527+0000", 2024-04-18T21:07:03.986 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0763000000000001e-05 2024-04-18T21:07:03.986 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:03.986 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:03.987 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:03.987 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615551+0000", 2024-04-18T21:07:03.987 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4159e-05 2024-04-18T21:07:03.987 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:03.987 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:03.987 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:03.987 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615736+0000", 2024-04-18T21:07:03.987 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018499599999999999 2024-04-18T21:07:03.987 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:03.987 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:03.987 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:07:03.987 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615748+0000", 2024-04-18T21:07:03.987 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2272999999999999e-05 2024-04-18T21:07:03.987 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:03.987 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:03.987 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:03.988 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635481+0000", 2024-04-18T21:07:03.988 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019732772999999999 2024-04-18T21:07:03.988 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:03.988 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:03.988 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:03.988 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635791+0000", 2024-04-18T21:07:03.988 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031013299999999998 2024-04-18T21:07:03.988 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:03.988 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:03.988 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:03.988 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636101+0000", 2024-04-18T21:07:03.988 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030943300000000002 2024-04-18T21:07:03.988 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:03.988 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:03.988 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:03.988 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646043+0000", 2024-04-18T21:07:03.989 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099428139999999995 2024-04-18T21:07:03.989 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:03.989 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:03.989 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:03.989 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660991+0000", 2024-04-18T21:07:03.989 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014947142 2024-04-18T21:07:03.989 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:03.989 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:03.989 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:03.989 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661061+0000", 2024-04-18T21:07:03.989 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0438000000000006e-05 2024-04-18T21:07:03.989 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:03.989 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:03.989 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:03.990 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661127+0000", 2024-04-18T21:07:03.990 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5696000000000003e-05 2024-04-18T21:07:03.990 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:03.990 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:03.990 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:03.990 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:03.990 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:03.990 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:03.990 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:07:03.990 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 118.366320595, 2024-04-18T21:07:03.990 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045745085999999997, 2024-04-18T21:07:03.990 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:03.991 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:03.991 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:03.991 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:03.991 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:03.991 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:03.991 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:07:03.991 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:03.991 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:03.991 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:03.991 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:03.991 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:07:03.991 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:03.991 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:03.992 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:03.992 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:03.992 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:07:03.992 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7400000000000001e-06 2024-04-18T21:07:03.992 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:03.992 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:03.992 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:03.992 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:07:03.992 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8133e-05 2024-04-18T21:07:03.992 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:03.992 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:03.992 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:03.992 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615726+0000", 2024-04-18T21:07:03.992 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6132e-05 2024-04-18T21:07:03.993 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:03.993 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:03.993 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:03.993 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615742+0000", 2024-04-18T21:07:03.993 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6157000000000001e-05 2024-04-18T21:07:03.993 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:03.993 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:03.993 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:03.993 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615937+0000", 2024-04-18T21:07:03.993 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000194768 2024-04-18T21:07:03.993 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:03.993 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:03.993 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:07:03.993 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615950+0000", 2024-04-18T21:07:03.993 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3084e-05 2024-04-18T21:07:03.993 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:03.994 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:03.994 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:03.994 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643676+0000", 2024-04-18T21:07:03.994 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027725639999999999 2024-04-18T21:07:03.994 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:03.994 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:03.994 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:03.994 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643867+0000", 2024-04-18T21:07:03.994 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019075900000000001 2024-04-18T21:07:03.994 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:03.994 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:03.994 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:03.995 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:07:03.995 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036013799999999997 2024-04-18T21:07:03.995 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:03.995 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:03.995 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:03.995 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646068+0000", 2024-04-18T21:07:03.995 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001841536 2024-04-18T21:07:03.995 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:03.995 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:03.995 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:03.995 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661184+0000", 2024-04-18T21:07:03.995 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015115458999999999 2024-04-18T21:07:03.995 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:03.995 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:03.995 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:03.996 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661283+0000", 2024-04-18T21:07:03.996 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9502999999999999e-05 2024-04-18T21:07:03.996 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:03.996 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:03.996 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:03.996 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661415+0000", 2024-04-18T21:07:03.996 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000132037 2024-04-18T21:07:03.996 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:03.996 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:03.996 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:03.996 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:03.996 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:03.996 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:101 3.1f 3:f83d65d8:::200.00000004:head [write 316455~1401 [fadvise_dontneed] in=1401b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:03.996 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:07:03.997 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.224256984, 2024-04-18T21:07:03.997 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.048270212999999999, 2024-04-18T21:07:03.997 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:03.997 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:03.997 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:03.997 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:03.997 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:03.997 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:03.997 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:07:03.997 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:03.997 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:03.997 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:03.997 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:03.997 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:07:03.998 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:03.998 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:03.998 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:03.998 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:03.998 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:07:03.998 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7700000000000004e-07 2024-04-18T21:07:03.998 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:03.998 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:03.998 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:03.998 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757745+0000", 2024-04-18T21:07:03.998 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0910000000000001e-05 2024-04-18T21:07:03.998 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:03.998 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:03.998 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:03.999 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757758+0000", 2024-04-18T21:07:03.999 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2593e-05 2024-04-18T21:07:03.999 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:03.999 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:03.999 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:03.999 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757765+0000", 2024-04-18T21:07:03.999 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1659999999999997e-06 2024-04-18T21:07:03.999 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:03.999 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:03.999 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:03.999 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.797782+0000", 2024-04-18T21:07:03.999 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.040017283000000001 2024-04-18T21:07:03.999 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:03.999 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.000 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:04.000 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.797949+0000", 2024-04-18T21:07:04.000 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016650399999999999 2024-04-18T21:07:04.000 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.000 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.000 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:04.000 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.798152+0000", 2024-04-18T21:07:04.000 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000203098 2024-04-18T21:07:04.000 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.000 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.000 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:04.000 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.800792+0000", 2024-04-18T21:07:04.000 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026394779999999998 2024-04-18T21:07:04.000 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.000 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.001 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:04.001 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805921+0000", 2024-04-18T21:07:04.001 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0051295519999999999 2024-04-18T21:07:04.001 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.001 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.001 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:04.001 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805967+0000", 2024-04-18T21:07:04.001 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5457000000000002e-05 2024-04-18T21:07:04.001 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.001 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.001 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:04.001 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806004+0000", 2024-04-18T21:07:04.001 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7494999999999999e-05 2024-04-18T21:07:04.001 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:04.001 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:04.002 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:04.002 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.002 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.002 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:102 3.1f 3:f83d65d8:::200.00000004:head [write 317856~1403 [fadvise_dontneed] in=1403b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:04.002 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757775+0000", 2024-04-18T21:07:04.002 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.224215917999999, 2024-04-18T21:07:04.002 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.048337705000000002, 2024-04-18T21:07:04.002 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:04.002 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:04.002 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:04.002 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:04.002 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.002 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:04.003 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757775+0000", 2024-04-18T21:07:04.003 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:04.003 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.003 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.003 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:04.003 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757775+0000", 2024-04-18T21:07:04.003 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:04.003 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.003 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.003 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:04.003 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757776+0000", 2024-04-18T21:07:04.003 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5300000000000004e-07 2024-04-18T21:07:04.003 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.003 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.003 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:04.003 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757780+0000", 2024-04-18T21:07:04.004 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2270000000000004e-06 2024-04-18T21:07:04.004 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.004 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.004 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:04.004 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757792+0000", 2024-04-18T21:07:04.004 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2696e-05 2024-04-18T21:07:04.004 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.004 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.004 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:04.004 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757800+0000", 2024-04-18T21:07:04.004 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1439999999999997e-06 2024-04-18T21:07:04.004 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.004 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.004 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:04.004 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.798773+0000", 2024-04-18T21:07:04.005 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.040973074999999998 2024-04-18T21:07:04.005 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.005 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.005 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:04.005 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.798990+0000", 2024-04-18T21:07:04.005 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000217161 2024-04-18T21:07:04.005 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.005 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.005 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:04.005 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.799173+0000", 2024-04-18T21:07:04.005 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018295900000000001 2024-04-18T21:07:04.005 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.005 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.005 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:04.005 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802469+0000", 2024-04-18T21:07:04.005 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032965350000000002 2024-04-18T21:07:04.006 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.006 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.006 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:04.006 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806042+0000", 2024-04-18T21:07:04.006 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035724630000000001 2024-04-18T21:07:04.006 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.006 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.006 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:04.006 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806077+0000", 2024-04-18T21:07:04.006 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4997999999999999e-05 2024-04-18T21:07:04.006 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.006 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.006 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:04.006 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806113+0000", 2024-04-18T21:07:04.006 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5794000000000003e-05 2024-04-18T21:07:04.006 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:04.007 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:04.007 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:04.007 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.007 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.007 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:103 3.1f 3:f83d65d8:::200.00000004:head [write 319259~1404 [fadvise_dontneed] in=1404b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:04.007 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:07:04.007 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.224182072000001, 2024-04-18T21:07:04.007 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.048414481000000002, 2024-04-18T21:07:04.007 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:04.007 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:04.007 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:04.007 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:04.007 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.007 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:04.008 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:07:04.008 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:04.008 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.008 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.008 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:04.008 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:07:04.008 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:04.008 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.008 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.008 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:04.008 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:07:04.008 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4700000000000001e-07 2024-04-18T21:07:04.008 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.008 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.008 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:04.009 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757814+0000", 2024-04-18T21:07:04.009 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1829999999999996e-06 2024-04-18T21:07:04.009 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.009 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.009 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:04.009 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757825+0000", 2024-04-18T21:07:04.009 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1754e-05 2024-04-18T21:07:04.009 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.009 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.009 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:04.009 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757832+0000", 2024-04-18T21:07:04.009 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8430000000000004e-06 2024-04-18T21:07:04.009 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.009 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.009 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:04.010 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.799809+0000", 2024-04-18T21:07:04.010 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.041976960000000001 2024-04-18T21:07:04.010 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.010 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.010 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:04.010 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.799934+0000", 2024-04-18T21:07:04.010 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000125053 2024-04-18T21:07:04.010 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.010 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.010 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:04.010 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.800067+0000", 2024-04-18T21:07:04.010 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013276299999999999 2024-04-18T21:07:04.010 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.010 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.010 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:04.011 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804582+0000", 2024-04-18T21:07:04.011 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0045148899999999997 2024-04-18T21:07:04.011 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.011 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.011 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:04.011 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806158+0000", 2024-04-18T21:07:04.011 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001575894 2024-04-18T21:07:04.011 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.011 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.011 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:04.011 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806189+0000", 2024-04-18T21:07:04.011 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1423000000000001e-05 2024-04-18T21:07:04.011 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.011 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.011 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:04.011 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806223+0000", 2024-04-18T21:07:04.012 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4071e-05 2024-04-18T21:07:04.012 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:04.012 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:04.012 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:04.012 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.012 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.012 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:104 3.1f 3:f83d65d8:::200.00000004:head [write 320663~1405 [fadvise_dontneed] in=1405b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:04.012 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757841+0000", 2024-04-18T21:07:04.012 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.224149868000001, 2024-04-18T21:07:04.012 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056381623999999998, 2024-04-18T21:07:04.012 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:04.012 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:04.012 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:04.012 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:04.012 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.012 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:04.013 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757841+0000", 2024-04-18T21:07:04.013 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:04.013 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.013 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.013 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:04.013 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757841+0000", 2024-04-18T21:07:04.013 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:04.013 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.013 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.013 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:04.013 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757842+0000", 2024-04-18T21:07:04.013 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5000000000000002e-07 2024-04-18T21:07:04.013 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.013 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.013 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:04.013 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757852+0000", 2024-04-18T21:07:04.014 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.084e-05 2024-04-18T21:07:04.014 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.014 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.014 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:04.014 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757865+0000", 2024-04-18T21:07:04.014 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2643000000000001e-05 2024-04-18T21:07:04.014 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.014 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.014 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:04.014 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757872+0000", 2024-04-18T21:07:04.014 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8689999999999998e-06 2024-04-18T21:07:04.014 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.014 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.014 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:04.015 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.801102+0000", 2024-04-18T21:07:04.015 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043229837 2024-04-18T21:07:04.015 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.015 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.015 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:04.015 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.801291+0000", 2024-04-18T21:07:04.015 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000189641 2024-04-18T21:07:04.015 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.015 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.015 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:04.015 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.801640+0000", 2024-04-18T21:07:04.015 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000348971 2024-04-18T21:07:04.015 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.015 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.016 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:04.016 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805849+0000", 2024-04-18T21:07:04.016 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042082739999999997 2024-04-18T21:07:04.016 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.016 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.016 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:04.016 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814135+0000", 2024-04-18T21:07:04.016 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0082867270000000007 2024-04-18T21:07:04.016 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.016 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.016 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:04.016 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814180+0000", 2024-04-18T21:07:04.016 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4982999999999999e-05 2024-04-18T21:07:04.017 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.017 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.017 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:04.017 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814223+0000", 2024-04-18T21:07:04.017 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2188999999999999e-05 2024-04-18T21:07:04.017 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:04.017 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:04.017 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:04.017 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.017 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.017 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:105 3.1f 3:f83d65d8:::200.00000004:head [write 322068~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:04.017 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:07:04.017 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.224109272, 2024-04-18T21:07:04.018 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056513678999999997, 2024-04-18T21:07:04.018 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:04.018 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:04.018 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:04.018 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:04.018 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.018 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:04.018 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:07:04.018 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:04.018 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.018 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.018 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:04.018 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:07:04.018 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:04.019 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.019 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.019 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:04.019 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:07:04.019 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2600000000000002e-07 2024-04-18T21:07:04.019 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.019 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.019 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:04.019 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757888+0000", 2024-04-18T21:07:04.019 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7130000000000002e-06 2024-04-18T21:07:04.019 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.019 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.019 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:04.019 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757906+0000", 2024-04-18T21:07:04.020 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7723999999999998e-05 2024-04-18T21:07:04.020 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.020 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.020 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:04.020 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757921+0000", 2024-04-18T21:07:04.020 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4936000000000001e-05 2024-04-18T21:07:04.020 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.020 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.020 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:04.020 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802493+0000", 2024-04-18T21:07:04.020 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.044571927999999997 2024-04-18T21:07:04.020 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.020 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.021 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:04.021 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802537+0000", 2024-04-18T21:07:04.021 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4449000000000001e-05 2024-04-18T21:07:04.021 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.021 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.021 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:04.021 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802605+0000", 2024-04-18T21:07:04.021 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7945000000000001e-05 2024-04-18T21:07:04.021 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.021 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.021 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:04.021 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805852+0000", 2024-04-18T21:07:04.021 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032469909999999999 2024-04-18T21:07:04.021 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.021 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.022 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:04.022 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814298+0000", 2024-04-18T21:07:04.022 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084463309999999996 2024-04-18T21:07:04.022 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.022 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.022 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:04.022 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814355+0000", 2024-04-18T21:07:04.022 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6459999999999998e-05 2024-04-18T21:07:04.022 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.022 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.022 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:04.022 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814395+0000", 2024-04-18T21:07:04.022 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0475999999999997e-05 2024-04-18T21:07:04.022 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:04.023 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:04.023 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:04.023 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.023 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.023 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:106 3.1f 3:f83d65d8:::200.00000004:head [write 323467~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:04.023 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757955+0000", 2024-04-18T21:07:04.023 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.224036043000002, 2024-04-18T21:07:04.023 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056539990999999998, 2024-04-18T21:07:04.023 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:04.023 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:04.023 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:04.023 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:04.024 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.024 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:04.024 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757955+0000", 2024-04-18T21:07:04.024 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:04.024 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.024 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.024 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:04.024 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757955+0000", 2024-04-18T21:07:04.024 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:04.024 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.024 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.024 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:04.024 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757956+0000", 2024-04-18T21:07:04.025 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.144e-06 2024-04-18T21:07:04.025 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.025 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.025 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:04.025 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757970+0000", 2024-04-18T21:07:04.025 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3899e-05 2024-04-18T21:07:04.025 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.025 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.025 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:04.025 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757988+0000", 2024-04-18T21:07:04.025 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8033000000000002e-05 2024-04-18T21:07:04.025 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.025 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.026 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:04.026 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758002+0000", 2024-04-18T21:07:04.026 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3973e-05 2024-04-18T21:07:04.026 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.026 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.026 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:04.026 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803072+0000", 2024-04-18T21:07:04.026 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045070194000000001 2024-04-18T21:07:04.026 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.026 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.026 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:04.026 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803125+0000", 2024-04-18T21:07:04.026 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3498000000000002e-05 2024-04-18T21:07:04.026 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.026 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.027 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:04.027 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803233+0000", 2024-04-18T21:07:04.027 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010704099999999999 2024-04-18T21:07:04.027 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.027 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.027 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:04.027 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805856+0000", 2024-04-18T21:07:04.027 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026233430000000002 2024-04-18T21:07:04.027 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.027 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.027 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:04.027 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814439+0000", 2024-04-18T21:07:04.027 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0085833839999999995 2024-04-18T21:07:04.027 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.028 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.028 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:04.028 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814469+0000", 2024-04-18T21:07:04.028 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9784000000000001e-05 2024-04-18T21:07:04.028 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.028 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.028 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:04.028 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814495+0000", 2024-04-18T21:07:04.028 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5698e-05 2024-04-18T21:07:04.028 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:04.028 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:04.028 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:04.028 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.028 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.029 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:107 3.1f 3:f83d65d8:::200.00000004:head [write 324866~1421 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:04.029 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758019+0000", 2024-04-18T21:07:04.029 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.223971417000001, 2024-04-18T21:07:04.029 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056580563, 2024-04-18T21:07:04.029 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:04.029 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:04.029 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:04.029 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:04.029 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.029 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:04.029 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758019+0000", 2024-04-18T21:07:04.029 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:04.029 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.030 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.030 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:04.030 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758019+0000", 2024-04-18T21:07:04.030 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:04.030 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.030 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.030 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:04.030 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758021+0000", 2024-04-18T21:07:04.030 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1999999999999999e-06 2024-04-18T21:07:04.030 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.030 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.030 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:04.030 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758028+0000", 2024-04-18T21:07:04.031 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7200000000000006e-06 2024-04-18T21:07:04.031 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.031 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.031 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:04.031 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758050+0000", 2024-04-18T21:07:04.031 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1877000000000001e-05 2024-04-18T21:07:04.031 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.031 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.031 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:04.031 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758064+0000", 2024-04-18T21:07:04.031 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.383e-05 2024-04-18T21:07:04.031 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.031 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.031 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:04.031 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803593+0000", 2024-04-18T21:07:04.032 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045528831999999998 2024-04-18T21:07:04.032 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.032 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.032 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:04.032 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803635+0000", 2024-04-18T21:07:04.032 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1980000000000001e-05 2024-04-18T21:07:04.032 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.032 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.032 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:04.032 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803703+0000", 2024-04-18T21:07:04.032 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8542999999999997e-05 2024-04-18T21:07:04.032 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.032 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.032 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:04.032 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806123+0000", 2024-04-18T21:07:04.032 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002419769 2024-04-18T21:07:04.033 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.033 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.033 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:04.033 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814542+0000", 2024-04-18T21:07:04.033 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084189460000000001 2024-04-18T21:07:04.033 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.033 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.033 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:04.033 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814576+0000", 2024-04-18T21:07:04.033 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3679000000000001e-05 2024-04-18T21:07:04.033 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.033 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.033 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:04.033 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814600+0000", 2024-04-18T21:07:04.033 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4187000000000001e-05 2024-04-18T21:07:04.033 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:04.034 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:04.034 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:04.034 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.034 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.034 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:108 3.1f 3:f83d65d8:::200.00000004:head [write 326287~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:04.034 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:07:04.034 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.223908248000001, 2024-04-18T21:07:04.034 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056616183, 2024-04-18T21:07:04.034 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:04.034 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:04.034 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:04.034 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:04.034 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.035 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:04.035 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:07:04.035 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:04.035 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.035 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.035 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:04.035 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:07:04.035 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:04.035 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.035 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.035 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:04.035 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758084+0000", 2024-04-18T21:07:04.035 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.124e-06 2024-04-18T21:07:04.035 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.036 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.036 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:04.036 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758100+0000", 2024-04-18T21:07:04.036 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6246e-05 2024-04-18T21:07:04.036 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.036 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.036 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:04.036 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758118+0000", 2024-04-18T21:07:04.036 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8267e-05 2024-04-18T21:07:04.036 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.036 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.036 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:04.036 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758134+0000", 2024-04-18T21:07:04.036 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5950000000000001e-05 2024-04-18T21:07:04.037 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.037 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.037 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:04.037 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803949+0000", 2024-04-18T21:07:04.037 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045815349999999998 2024-04-18T21:07:04.037 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.037 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.037 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:04.037 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804011+0000", 2024-04-18T21:07:04.037 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1044999999999996e-05 2024-04-18T21:07:04.037 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.037 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.037 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:04.038 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804128+0000", 2024-04-18T21:07:04.038 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117148 2024-04-18T21:07:04.038 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.038 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.038 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:04.038 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806794+0000", 2024-04-18T21:07:04.038 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002666692 2024-04-18T21:07:04.038 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.038 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.038 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:04.038 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814645+0000", 2024-04-18T21:07:04.038 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0078508880000000003 2024-04-18T21:07:04.039 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.039 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.039 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:04.039 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814678+0000", 2024-04-18T21:07:04.039 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3188999999999997e-05 2024-04-18T21:07:04.039 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.039 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.039 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:04.039 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814699+0000", 2024-04-18T21:07:04.039 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0284000000000001e-05 2024-04-18T21:07:04.039 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:04.039 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:04.039 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:04.039 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.040 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.040 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:109 3.1f 3:f83d65d8:::200.00000004:head [write 327693~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:04.040 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:07:04.040 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.223838880999999, 2024-04-18T21:07:04.040 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056621036999999999, 2024-04-18T21:07:04.040 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:04.040 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:04.040 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:04.040 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:04.040 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.040 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:04.040 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:07:04.040 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:04.040 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.040 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.041 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:04.041 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:07:04.041 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:04.041 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.041 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.041 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:04.041 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758153+0000", 2024-04-18T21:07:04.041 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1459999999999999e-06 2024-04-18T21:07:04.041 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.041 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.041 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:04.041 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758161+0000", 2024-04-18T21:07:04.041 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7999999999999999e-06 2024-04-18T21:07:04.041 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.042 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.042 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:04.042 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758179+0000", 2024-04-18T21:07:04.042 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7949999999999999e-05 2024-04-18T21:07:04.042 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.042 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.042 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:04.042 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758193+0000", 2024-04-18T21:07:04.042 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3773e-05 2024-04-18T21:07:04.042 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.042 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.042 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:04.042 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804632+0000", 2024-04-18T21:07:04.042 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.046439469999999997 2024-04-18T21:07:04.042 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.043 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.043 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:04.043 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804790+0000", 2024-04-18T21:07:04.043 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015784300000000001 2024-04-18T21:07:04.043 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.043 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.043 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:04.043 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805056+0000", 2024-04-18T21:07:04.043 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026652400000000003 2024-04-18T21:07:04.043 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.043 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.043 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:04.043 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.808959+0000", 2024-04-18T21:07:04.043 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003903077 2024-04-18T21:07:04.043 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.043 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.044 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:04.044 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814728+0000", 2024-04-18T21:07:04.044 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0057682489999999996 2024-04-18T21:07:04.044 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.044 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.044 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:04.044 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814754+0000", 2024-04-18T21:07:04.044 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6673999999999999e-05 2024-04-18T21:07:04.044 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.044 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.044 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:04.044 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814773+0000", 2024-04-18T21:07:04.044 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8530999999999999e-05 2024-04-18T21:07:04.044 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:04.045 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:04.045 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:04.045 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.045 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.045 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:110 3.1f 3:f83d65d8:::200.00000004:head [write 329098~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:04.045 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:07:04.045 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.223780472000001, 2024-04-18T21:07:04.045 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056669113, 2024-04-18T21:07:04.045 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:04.045 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:04.045 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:04.045 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:04.045 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.045 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:04.045 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:07:04.046 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:04.046 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.046 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.046 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:04.046 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:07:04.046 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:04.046 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.046 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.046 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:04.046 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758212+0000", 2024-04-18T21:07:04.046 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:07:04.046 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.046 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.046 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:04.047 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758219+0000", 2024-04-18T21:07:04.047 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4229999999999999e-06 2024-04-18T21:07:04.047 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.047 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.047 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:04.047 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758237+0000", 2024-04-18T21:07:04.047 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7966999999999999e-05 2024-04-18T21:07:04.047 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.047 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.047 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:04.047 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758252+0000", 2024-04-18T21:07:04.047 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5322999999999999e-05 2024-04-18T21:07:04.047 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.047 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.047 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:04.048 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805536+0000", 2024-04-18T21:07:04.048 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.047283861000000003 2024-04-18T21:07:04.048 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.048 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.048 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:04.048 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805579+0000", 2024-04-18T21:07:04.048 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2738999999999999e-05 2024-04-18T21:07:04.048 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.048 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.048 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:04.048 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805649+0000", 2024-04-18T21:07:04.048 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0213e-05 2024-04-18T21:07:04.048 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.048 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.048 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:04.049 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.808966+0000", 2024-04-18T21:07:04.049 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033166129999999999 2024-04-18T21:07:04.049 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.049 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.049 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:04.049 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814812+0000", 2024-04-18T21:07:04.049 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0058463589999999998 2024-04-18T21:07:04.049 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.049 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.049 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:04.049 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814854+0000", 2024-04-18T21:07:04.049 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1618e-05 2024-04-18T21:07:04.049 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.050 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.050 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:04.050 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814879+0000", 2024-04-18T21:07:04.050 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5754000000000001e-05 2024-04-18T21:07:04.050 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:04.050 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:04.050 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:04.050 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.050 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.050 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:111 3.1f 3:f83d65d8:::200.00000004:head [write 330499~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:04.050 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:07:04.050 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.223719496000001, 2024-04-18T21:07:04.050 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058693793000000001, 2024-04-18T21:07:04.050 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:04.051 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:04.051 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:04.051 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:04.051 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.051 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:04.051 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:07:04.051 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:04.051 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.051 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.051 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:04.051 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:07:04.051 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:04.051 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.051 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.052 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:04.052 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758272+0000", 2024-04-18T21:07:04.052 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1200000000000001e-06 2024-04-18T21:07:04.052 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.052 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.052 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:04.052 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758287+0000", 2024-04-18T21:07:04.052 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5017e-05 2024-04-18T21:07:04.052 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.052 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.052 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:04.052 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758309+0000", 2024-04-18T21:07:04.052 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1866e-05 2024-04-18T21:07:04.053 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.053 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.053 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:04.053 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758323+0000", 2024-04-18T21:07:04.053 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3606e-05 2024-04-18T21:07:04.053 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.053 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.053 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:04.053 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806279+0000", 2024-04-18T21:07:04.053 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.047956061000000001 2024-04-18T21:07:04.053 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.053 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.053 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:04.053 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806350+0000", 2024-04-18T21:07:04.054 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1070999999999998e-05 2024-04-18T21:07:04.054 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.054 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.054 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:04.054 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806459+0000", 2024-04-18T21:07:04.054 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000108606 2024-04-18T21:07:04.054 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.054 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.054 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:04.054 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.809774+0000", 2024-04-18T21:07:04.054 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003314881 2024-04-18T21:07:04.054 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.054 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.054 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:04.054 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816910+0000", 2024-04-18T21:07:04.055 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0071367760000000001 2024-04-18T21:07:04.055 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.055 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.055 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:04.055 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816941+0000", 2024-04-18T21:07:04.055 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0846000000000002e-05 2024-04-18T21:07:04.055 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.055 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.055 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:04.055 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816965+0000", 2024-04-18T21:07:04.055 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3943000000000001e-05 2024-04-18T21:07:04.055 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:04.055 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:04.055 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:04.056 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.056 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.056 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:5230 4.17 4:eb2cc4c4:::1000000184c.00000000:head [write 0~2191] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-18T21:07:04.056 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.760650+0000", 2024-04-18T21:07:04.056 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.221340325, 2024-04-18T21:07:04.056 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.054210577000000003, 2024-04-18T21:07:04.056 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:04.056 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:04.056 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:04.056 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:07:04.056 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:07:04.056 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:04.056 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 5230 2024-04-18T21:07:04.056 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.056 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:04.057 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.057 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:04.057 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760650+0000", 2024-04-18T21:07:04.057 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:04.057 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.057 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.057 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:04.057 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760650+0000", 2024-04-18T21:07:04.057 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:04.057 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.057 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.057 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:04.057 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760653+0000", 2024-04-18T21:07:04.057 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0829999999999998e-06 2024-04-18T21:07:04.058 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.058 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.058 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:04.058 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760664+0000", 2024-04-18T21:07:04.058 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.111e-05 2024-04-18T21:07:04.058 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.058 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.058 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:04.058 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760688+0000", 2024-04-18T21:07:04.058 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4837e-05 2024-04-18T21:07:04.058 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.058 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.058 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:04.058 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760702+0000", 2024-04-18T21:07:04.059 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3723000000000001e-05 2024-04-18T21:07:04.059 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.059 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.059 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:04.059 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806264+0000", 2024-04-18T21:07:04.059 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045562182 2024-04-18T21:07:04.059 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.059 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.059 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:04.059 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806351+0000", 2024-04-18T21:07:04.059 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6322000000000005e-05 2024-04-18T21:07:04.059 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.059 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.059 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:04.060 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806453+0000", 2024-04-18T21:07:04.060 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000102602 2024-04-18T21:07:04.060 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.060 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.060 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:04.060 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.808972+0000", 2024-04-18T21:07:04.060 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025184090000000001 2024-04-18T21:07:04.060 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.060 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.060 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:04.060 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814798+0000", 2024-04-18T21:07:04.060 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0058266689999999996 2024-04-18T21:07:04.060 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.060 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.060 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:04.061 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814839+0000", 2024-04-18T21:07:04.061 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0482000000000003e-05 2024-04-18T21:07:04.061 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.061 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.061 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:04.061 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814861+0000", 2024-04-18T21:07:04.061 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2158e-05 2024-04-18T21:07:04.061 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:04.061 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:04.061 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:04.061 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.061 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.061 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:112 3.1f 3:f83d65d8:::200.00000004:head [write 331898~20167 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:04.061 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.771321+0000", 2024-04-18T21:07:04.061 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.210669698, 2024-04-18T21:07:04.062 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045740306000000001, 2024-04-18T21:07:04.062 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:04.062 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:04.062 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:04.062 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:04.062 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.062 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:04.062 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771321+0000", 2024-04-18T21:07:04.062 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:04.062 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.062 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.062 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:04.062 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771321+0000", 2024-04-18T21:07:04.062 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:04.063 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.063 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.063 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:04.063 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771323+0000", 2024-04-18T21:07:04.063 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3740000000000001e-06 2024-04-18T21:07:04.063 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.063 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.063 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:04.063 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771359+0000", 2024-04-18T21:07:04.063 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5447999999999997e-05 2024-04-18T21:07:04.063 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.063 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.063 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:04.063 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771388+0000", 2024-04-18T21:07:04.063 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8915e-05 2024-04-18T21:07:04.064 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.064 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.064 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:04.064 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771410+0000", 2024-04-18T21:07:04.064 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1899000000000002e-05 2024-04-18T21:07:04.064 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.064 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.064 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:04.064 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806827+0000", 2024-04-18T21:07:04.064 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.035417063999999998 2024-04-18T21:07:04.064 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.064 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.064 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:04.064 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806873+0000", 2024-04-18T21:07:04.064 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6261999999999999e-05 2024-04-18T21:07:04.065 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.065 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.065 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:04.065 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806946+0000", 2024-04-18T21:07:04.065 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3205000000000001e-05 2024-04-18T21:07:04.065 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.065 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.065 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:04.065 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.809781+0000", 2024-04-18T21:07:04.065 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002834937 2024-04-18T21:07:04.065 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.065 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.065 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:04.065 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817003+0000", 2024-04-18T21:07:04.065 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0072217959999999999 2024-04-18T21:07:04.066 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.066 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.066 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:04.066 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817038+0000", 2024-04-18T21:07:04.066 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4696999999999997e-05 2024-04-18T21:07:04.066 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.066 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.066 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:04.066 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817061+0000", 2024-04-18T21:07:04.066 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3708999999999999e-05 2024-04-18T21:07:04.066 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:04.066 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:04.067 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:04.067 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.067 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.067 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:113 3.1f 3:f83d65d8:::200.00000004:head [write 352065~3878 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:04.067 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.771472+0000", 2024-04-18T21:07:04.067 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.210518961999998, 2024-04-18T21:07:04.067 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045689726, 2024-04-18T21:07:04.067 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:04.067 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:04.067 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:04.067 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:04.067 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.067 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:04.068 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771472+0000", 2024-04-18T21:07:04.068 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:04.068 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.068 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.068 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:04.068 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771472+0000", 2024-04-18T21:07:04.068 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:04.068 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.068 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.068 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:04.068 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771473+0000", 2024-04-18T21:07:04.068 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3829999999999999e-06 2024-04-18T21:07:04.068 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.068 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.069 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:04.069 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771489+0000", 2024-04-18T21:07:04.069 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5797000000000001e-05 2024-04-18T21:07:04.069 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.069 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.069 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:04.069 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771509+0000", 2024-04-18T21:07:04.069 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0401999999999999e-05 2024-04-18T21:07:04.069 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.069 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.069 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:04.069 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771525+0000", 2024-04-18T21:07:04.069 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5099999999999999e-05 2024-04-18T21:07:04.069 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.070 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.070 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:04.070 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807273+0000", 2024-04-18T21:07:04.070 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.035748488000000002 2024-04-18T21:07:04.070 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.070 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.070 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:04.070 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807343+0000", 2024-04-18T21:07:04.070 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0277000000000005e-05 2024-04-18T21:07:04.070 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.070 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.070 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:04.070 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807455+0000", 2024-04-18T21:07:04.070 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011171999999999999 2024-04-18T21:07:04.070 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.071 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.071 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:04.071 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.811509+0000", 2024-04-18T21:07:04.071 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0040543469999999998 2024-04-18T21:07:04.071 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.071 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.071 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:04.071 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817115+0000", 2024-04-18T21:07:04.071 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0056054520000000004 2024-04-18T21:07:04.071 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.071 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.071 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:04.071 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817142+0000", 2024-04-18T21:07:04.071 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7430999999999999e-05 2024-04-18T21:07:04.072 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.072 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.072 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:04.072 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817162+0000", 2024-04-18T21:07:04.072 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9329000000000001e-05 2024-04-18T21:07:04.072 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:04.072 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:04.072 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:04.072 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.072 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.072 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:11950 4.6 4:62753dda:::10000003222.00000000:head [write 3145728~1048576] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:04.072 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:59.346083+0000", 2024-04-18T21:07:04.072 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.6359077339999999, 2024-04-18T21:07:04.072 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.051281119999999999, 2024-04-18T21:07:04.072 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:04.073 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:04.073 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:04.073 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:07:04.073 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:07:04.073 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:04.073 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 11950 2024-04-18T21:07:04.073 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.073 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:04.073 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.073 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:04.073 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.346083+0000", 2024-04-18T21:07:04.073 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:04.073 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.074 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.074 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:04.074 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.346083+0000", 2024-04-18T21:07:04.074 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:04.074 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.074 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.074 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:04.074 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.346085+0000", 2024-04-18T21:07:04.074 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.736e-06 2024-04-18T21:07:04.074 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.074 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.074 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:04.074 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.349991+0000", 2024-04-18T21:07:04.074 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0039062960000000001 2024-04-18T21:07:04.075 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.075 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.075 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:04.075 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.350006+0000", 2024-04-18T21:07:04.075 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5327000000000001e-05 2024-04-18T21:07:04.075 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.075 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.075 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:04.075 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.350016+0000", 2024-04-18T21:07:04.075 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3570000000000004e-06 2024-04-18T21:07:04.075 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.075 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.075 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:04.075 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.360724+0000", 2024-04-18T21:07:04.075 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010708153999999999 2024-04-18T21:07:04.076 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.076 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.076 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:04.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.360839+0000", 2024-04-18T21:07:04.076 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000114877 2024-04-18T21:07:04.076 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.076 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.076 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:04.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.397285+0000", 2024-04-18T21:07:04.076 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036445957000000001 2024-04-18T21:07:04.076 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.076 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.076 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:04.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.397316+0000", 2024-04-18T21:07:04.076 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0926000000000002e-05 2024-04-18T21:07:04.077 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.077 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.077 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:04.077 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.397364+0000", 2024-04-18T21:07:04.077 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8489999999999998e-05 2024-04-18T21:07:04.077 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:04.077 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:04.077 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:04.077 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.077 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.077 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:12225 4.11 4:8acd30ee:::100000031ed.00000000:head [write 0~4194304 [2@86041]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:04.077 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:59.667090+0000", 2024-04-18T21:07:04.077 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.314901119, 2024-04-18T21:07:04.077 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.047400059000000001, 2024-04-18T21:07:04.077 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:04.078 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:04.078 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:04.078 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:07:04.078 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:07:04.078 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:04.078 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 12225 2024-04-18T21:07:04.078 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.078 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:04.078 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.078 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:04.078 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.667090+0000", 2024-04-18T21:07:04.078 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:04.078 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.079 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.079 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:04.079 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.667090+0000", 2024-04-18T21:07:04.079 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:04.079 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.079 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.079 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:04.079 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.667091+0000", 2024-04-18T21:07:04.079 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3629999999999999e-06 2024-04-18T21:07:04.079 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.079 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.079 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:04.079 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.674492+0000", 2024-04-18T21:07:04.079 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0074007789999999997 2024-04-18T21:07:04.079 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.080 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.080 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:04.080 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.674508+0000", 2024-04-18T21:07:04.080 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6509999999999999e-05 2024-04-18T21:07:04.080 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.080 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.080 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:04.080 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.674518+0000", 2024-04-18T21:07:04.080 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.6290000000000005e-06 2024-04-18T21:07:04.080 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.080 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.080 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:04.080 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.674584+0000", 2024-04-18T21:07:04.080 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5597000000000002e-05 2024-04-18T21:07:04.081 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.081 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.081 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:04.081 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.674659+0000", 2024-04-18T21:07:04.081 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5168999999999998e-05 2024-04-18T21:07:04.081 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.081 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.081 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:04.081 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.674775+0000", 2024-04-18T21:07:04.081 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000116069 2024-04-18T21:07:04.081 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.081 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.081 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:04.081 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.685336+0000", 2024-04-18T21:07:04.081 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010561022999999999 2024-04-18T21:07:04.081 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.082 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.082 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:04.082 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.714413+0000", 2024-04-18T21:07:04.082 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.029077306000000001 2024-04-18T21:07:04.082 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.082 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.082 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:04.082 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.714455+0000", 2024-04-18T21:07:04.082 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1547e-05 2024-04-18T21:07:04.082 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.082 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.082 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:04.082 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.714490+0000", 2024-04-18T21:07:04.083 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5067000000000002e-05 2024-04-18T21:07:04.083 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:04.083 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:04.083 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:04.083 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.083 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.083 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:12689 4.26 4:64a7f444:::100000033e5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:04.083 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:00.208067+0000", 2024-04-18T21:07:04.083 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.77392408, 2024-04-18T21:07:04.083 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066681457, 2024-04-18T21:07:04.083 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:04.083 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:04.083 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:04.083 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:07:04.084 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:07:04.084 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:04.084 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 12689 2024-04-18T21:07:04.084 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.084 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:04.084 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.084 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:04.084 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.208067+0000", 2024-04-18T21:07:04.084 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:04.084 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.084 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.084 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:04.084 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.208067+0000", 2024-04-18T21:07:04.085 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:04.085 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.085 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.085 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:04.085 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.208069+0000", 2024-04-18T21:07:04.085 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1500000000000002e-06 2024-04-18T21:07:04.085 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.085 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.085 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:04.085 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216162+0000", 2024-04-18T21:07:04.085 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0080933159999999997 2024-04-18T21:07:04.085 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.085 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.085 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:04.086 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216181+0000", 2024-04-18T21:07:04.086 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8573e-05 2024-04-18T21:07:04.086 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.086 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.086 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:04.086 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216192+0000", 2024-04-18T21:07:04.086 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0767999999999999e-05 2024-04-18T21:07:04.086 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.086 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.086 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:04.086 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216259+0000", 2024-04-18T21:07:04.086 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7977000000000003e-05 2024-04-18T21:07:04.086 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.087 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:04.087 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216635+0000", 2024-04-18T21:07:04.087 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00037591300000000002 2024-04-18T21:07:04.087 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.087 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:04.087 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216929+0000", 2024-04-18T21:07:04.087 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00029314800000000002 2024-04-18T21:07:04.087 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.087 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:04.087 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.232918+0000", 2024-04-18T21:07:04.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015989903 2024-04-18T21:07:04.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.088 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:04.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.274643+0000", 2024-04-18T21:07:04.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.041724281000000002 2024-04-18T21:07:04.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.088 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:04.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.274701+0000", 2024-04-18T21:07:04.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8304999999999998e-05 2024-04-18T21:07:04.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.088 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:04.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.274748+0000", 2024-04-18T21:07:04.089 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7123000000000003e-05 2024-04-18T21:07:04.089 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:04.089 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:04.089 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:04.089 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.089 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.089 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4534.0:15094 4.c e59/16 4:32870457:::10000003692.00000000:head v 59'213, mlcod=59'211)", 2024-04-18T21:07:04.089 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:03.117817+0000", 2024-04-18T21:07:04.089 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.86417400899999997, 2024-04-18T21:07:04.089 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.049868875999999999, 2024-04-18T21:07:04.089 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:04.089 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:04.089 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:04.089 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:04.089 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.090 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:04.090 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.117817+0000", 2024-04-18T21:07:04.090 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:04.090 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.090 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.090 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:04.090 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.117817+0000", 2024-04-18T21:07:04.090 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:04.090 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.090 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.090 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:04.090 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.117817+0000", 2024-04-18T21:07:04.090 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0200000000000003e-07 2024-04-18T21:07:04.090 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.091 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.091 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:04.091 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.140525+0000", 2024-04-18T21:07:04.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.022707775999999999 2024-04-18T21:07:04.091 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.091 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.091 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:04.091 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.140549+0000", 2024-04-18T21:07:04.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4456000000000001e-05 2024-04-18T21:07:04.091 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.091 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.091 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:04.091 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.140563+0000", 2024-04-18T21:07:04.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.329e-05 2024-04-18T21:07:04.092 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.092 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.092 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:04.092 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.140797+0000", 2024-04-18T21:07:04.092 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023447400000000001 2024-04-18T21:07:04.092 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.092 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.092 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:04.092 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.140842+0000", 2024-04-18T21:07:04.092 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5287000000000002e-05 2024-04-18T21:07:04.092 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.092 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.092 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:04.093 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.167577+0000", 2024-04-18T21:07:04.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.026734745000000001 2024-04-18T21:07:04.093 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:04.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:04.093 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:04.093 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.167686+0000", 2024-04-18T21:07:04.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000108446 2024-04-18T21:07:04.093 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:04.093 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:04.093 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:04.093 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:04.093 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:04.093 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:07:04.094 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T21:07:04.104 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:04.097+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:04.105 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:07:04.196 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:04.197+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:04.203 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off 2024-04-18T21:07:04.237 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:07:04.237 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:07:04.237 INFO:teuthology.orchestra.run.smithi132.stdout: "num_ops": 0 2024-04-18T21:07:04.237 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:07:04.251 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:07:04.296 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:04.297+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:04.304 INFO:teuthology.orchestra.console.smithi150:Power off completed 2024-04-18T21:07:04.398 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:04.397+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:04.417 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:07:04.417 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:07:04.417 INFO:teuthology.orchestra.run.smithi132.stdout: "complaint_time": 30, 2024-04-18T21:07:04.417 INFO:teuthology.orchestra.run.smithi132.stdout: "num_blocked_ops": 0 2024-04-18T21:07:04.417 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:07:04.431 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:07:04.519 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:04.521+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:04.599 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:04.601+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:04.600 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:07:04.600 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 20, 2024-04-18T21:07:04.601 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 600, 2024-04-18T21:07:04.601 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [ 2024-04-18T21:07:04.601 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.601 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:04.601 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:07:04.601 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 118.983352725, 2024-04-18T21:07:04.601 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043251955000000002, 2024-04-18T21:07:04.601 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:04.601 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:04.601 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:04.601 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:04.601 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.601 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:04.601 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:07:04.602 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:04.602 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.602 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.602 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:04.602 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:07:04.602 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:04.602 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.602 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.602 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:04.602 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616536+0000", 2024-04-18T21:07:04.602 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2869999999999999e-06 2024-04-18T21:07:04.602 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.602 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.602 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:04.603 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616572+0000", 2024-04-18T21:07:04.603 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.6261999999999999e-05 2024-04-18T21:07:04.603 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.603 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.603 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:04.603 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616593+0000", 2024-04-18T21:07:04.603 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1310000000000001e-05 2024-04-18T21:07:04.603 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.603 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.603 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:04.603 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616614+0000", 2024-04-18T21:07:04.603 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.0936000000000001e-05 2024-04-18T21:07:04.603 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.604 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.604 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:04.604 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629501+0000", 2024-04-18T21:07:04.604 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.012886819000000001 2024-04-18T21:07:04.604 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.604 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.604 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:04.604 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629696+0000", 2024-04-18T21:07:04.604 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019485499999999999 2024-04-18T21:07:04.604 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.604 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.604 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:04.604 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629940+0000", 2024-04-18T21:07:04.604 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00024386399999999999 2024-04-18T21:07:04.604 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.605 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.605 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:04.605 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640100+0000", 2024-04-18T21:07:04.605 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010159645 2024-04-18T21:07:04.605 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.605 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.605 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:04.605 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659516+0000", 2024-04-18T21:07:04.605 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019416563000000001 2024-04-18T21:07:04.605 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.605 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.605 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:04.605 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659684+0000", 2024-04-18T21:07:04.605 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016750900000000001 2024-04-18T21:07:04.605 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.606 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.606 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:04.606 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659787+0000", 2024-04-18T21:07:04.606 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000102905 2024-04-18T21:07:04.606 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:04.606 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:04.606 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:04.606 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.606 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.606 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:04.606 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:07:04.606 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 118.983247603, 2024-04-18T21:07:04.606 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043581898000000001, 2024-04-18T21:07:04.607 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:04.607 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:04.607 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:04.607 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:04.607 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.607 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:04.607 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:07:04.607 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:04.607 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.607 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.607 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:04.607 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:07:04.607 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:04.607 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.607 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.608 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:04.608 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616641+0000", 2024-04-18T21:07:04.608 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:07:04.608 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.608 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.608 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:04.608 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616648+0000", 2024-04-18T21:07:04.608 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3860000000000001e-06 2024-04-18T21:07:04.608 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.608 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.608 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:04.608 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616666+0000", 2024-04-18T21:07:04.608 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7583000000000001e-05 2024-04-18T21:07:04.609 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.609 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.609 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:04.609 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616679+0000", 2024-04-18T21:07:04.609 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3322999999999999e-05 2024-04-18T21:07:04.609 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.609 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.609 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:04.609 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630373+0000", 2024-04-18T21:07:04.609 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013694207999999999 2024-04-18T21:07:04.609 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.609 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.609 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:04.609 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630545+0000", 2024-04-18T21:07:04.609 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000171683 2024-04-18T21:07:04.610 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.610 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.610 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:04.610 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630728+0000", 2024-04-18T21:07:04.610 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000182599 2024-04-18T21:07:04.610 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.610 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.610 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:04.610 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640600+0000", 2024-04-18T21:07:04.610 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0098726119999999994 2024-04-18T21:07:04.610 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.610 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.610 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:04.610 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659927+0000", 2024-04-18T21:07:04.611 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019326724999999999 2024-04-18T21:07:04.611 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.611 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.611 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:04.611 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660112+0000", 2024-04-18T21:07:04.611 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000185203 2024-04-18T21:07:04.611 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.611 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.611 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:04.611 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660222+0000", 2024-04-18T21:07:04.611 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109343 2024-04-18T21:07:04.611 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:04.611 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:04.611 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:04.611 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.612 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.612 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:04.612 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:07:04.612 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 118.982382245, 2024-04-18T21:07:04.612 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043121310000000003, 2024-04-18T21:07:04.612 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:04.612 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:04.612 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:04.612 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:04.612 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.612 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:04.612 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:07:04.612 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:04.612 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.613 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.613 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:04.613 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:07:04.613 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:04.613 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.613 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.613 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:04.613 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617506+0000", 2024-04-18T21:07:04.613 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9999999999999995e-07 2024-04-18T21:07:04.613 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.613 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.613 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:04.613 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617513+0000", 2024-04-18T21:07:04.613 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.9700000000000002e-06 2024-04-18T21:07:04.614 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.614 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.614 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:04.614 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617531+0000", 2024-04-18T21:07:04.614 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8105999999999999e-05 2024-04-18T21:07:04.614 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.614 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.614 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:04.614 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617545+0000", 2024-04-18T21:07:04.614 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3703000000000001e-05 2024-04-18T21:07:04.614 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.614 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.615 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:04.615 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632129+0000", 2024-04-18T21:07:04.615 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.014584135999999999 2024-04-18T21:07:04.615 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.615 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.615 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:04.615 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632361+0000", 2024-04-18T21:07:04.615 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023171800000000001 2024-04-18T21:07:04.615 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.615 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.615 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:04.615 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632804+0000", 2024-04-18T21:07:04.615 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000443549 2024-04-18T21:07:04.616 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.616 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.616 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:04.616 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646340+0000", 2024-04-18T21:07:04.616 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013535902000000001 2024-04-18T21:07:04.616 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.616 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.616 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:04.616 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660363+0000", 2024-04-18T21:07:04.616 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01402318 2024-04-18T21:07:04.616 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.616 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.616 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:04.616 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660523+0000", 2024-04-18T21:07:04.617 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00015989899999999999 2024-04-18T21:07:04.617 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.617 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.617 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:04.617 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660626+0000", 2024-04-18T21:07:04.617 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010314699999999999 2024-04-18T21:07:04.617 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:04.617 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:04.617 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:04.617 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.617 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.617 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11357 4.38 4:1d691e75:::1000000312c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T21:07:04.617 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:58.595279+0000", 2024-04-18T21:07:04.617 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 6.0046086929999998, 2024-04-18T21:07:04.617 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.045901399000000002, 2024-04-18T21:07:04.618 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:04.618 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:04.618 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:04.618 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:04.618 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:04.618 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:04.618 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11357 2024-04-18T21:07:04.618 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.618 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:04.618 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.618 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:04.618 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.595279+0000", 2024-04-18T21:07:04.618 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:04.619 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.619 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.619 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:04.619 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.595279+0000", 2024-04-18T21:07:04.619 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:04.619 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.619 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.619 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:04.619 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.595280+0000", 2024-04-18T21:07:04.619 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.079e-06 2024-04-18T21:07:04.619 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.619 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.619 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:04.619 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600237+0000", 2024-04-18T21:07:04.620 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0049569089999999998 2024-04-18T21:07:04.620 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.620 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.620 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:04.620 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600254+0000", 2024-04-18T21:07:04.620 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7399000000000001e-05 2024-04-18T21:07:04.620 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.620 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.620 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:04.620 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600262+0000", 2024-04-18T21:07:04.620 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.174e-06 2024-04-18T21:07:04.620 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.620 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.620 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:04.621 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600359+0000", 2024-04-18T21:07:04.621 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.6358000000000001e-05 2024-04-18T21:07:04.621 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.621 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.621 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:04.621 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600507+0000", 2024-04-18T21:07:04.621 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014854199999999999 2024-04-18T21:07:04.621 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.621 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.621 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:04.621 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600748+0000", 2024-04-18T21:07:04.621 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000241361 2024-04-18T21:07:04.621 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.621 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.621 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:04.622 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.615590+0000", 2024-04-18T21:07:04.622 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.014841851 2024-04-18T21:07:04.622 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.622 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.622 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:04.622 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.639817+0000", 2024-04-18T21:07:04.622 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024226527000000001 2024-04-18T21:07:04.622 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.622 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.622 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:04.622 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.640962+0000", 2024-04-18T21:07:04.623 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001145561 2024-04-18T21:07:04.623 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.623 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.623 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:04.623 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.641180+0000", 2024-04-18T21:07:04.623 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00021763800000000001 2024-04-18T21:07:04.623 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:04.623 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:04.623 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:04.623 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.623 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.623 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11443 4.38 4:1d691e75:::1000000312c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T21:07:04.623 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:58.744218+0000", 2024-04-18T21:07:04.623 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 5.8556690270000002, 2024-04-18T21:07:04.623 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.051074359999999999, 2024-04-18T21:07:04.624 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:04.624 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:04.624 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:04.624 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:04.624 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:04.624 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:04.624 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11443 2024-04-18T21:07:04.624 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.624 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:04.624 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.624 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:04.624 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.744218+0000", 2024-04-18T21:07:04.624 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:04.624 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.625 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.625 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:04.625 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.744218+0000", 2024-04-18T21:07:04.625 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:04.625 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.625 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.625 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:04.625 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.744221+0000", 2024-04-18T21:07:04.625 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.3580000000000001e-06 2024-04-18T21:07:04.625 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.625 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.625 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:04.625 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753328+0000", 2024-04-18T21:07:04.625 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0091071339999999994 2024-04-18T21:07:04.625 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.626 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.626 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:04.626 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753351+0000", 2024-04-18T21:07:04.626 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.3479999999999999e-05 2024-04-18T21:07:04.626 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.626 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.626 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:04.626 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753363+0000", 2024-04-18T21:07:04.626 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1345000000000001e-05 2024-04-18T21:07:04.626 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.626 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.626 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:04.626 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753416+0000", 2024-04-18T21:07:04.626 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.2849999999999997e-05 2024-04-18T21:07:04.627 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.627 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.627 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:04.627 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753471+0000", 2024-04-18T21:07:04.627 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5717999999999997e-05 2024-04-18T21:07:04.627 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.627 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.627 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:04.627 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753560+0000", 2024-04-18T21:07:04.627 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8777999999999996e-05 2024-04-18T21:07:04.627 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.627 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.628 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:04.628 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.760182+0000", 2024-04-18T21:07:04.628 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0066216299999999999 2024-04-18T21:07:04.628 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.628 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.628 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:04.628 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.795094+0000", 2024-04-18T21:07:04.628 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.034912334000000003 2024-04-18T21:07:04.628 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.628 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.628 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:04.628 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.795221+0000", 2024-04-18T21:07:04.628 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012745899999999999 2024-04-18T21:07:04.629 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.629 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.629 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:04.629 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.795293+0000", 2024-04-18T21:07:04.629 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.1273999999999996e-05 2024-04-18T21:07:04.629 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:04.629 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:04.629 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:04.629 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.629 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.629 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11511 4.18 4:184fae4a:::1000000316d.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:04.629 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:58.838500+0000", 2024-04-18T21:07:04.629 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 5.7613871469999998, 2024-04-18T21:07:04.629 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.044451537999999999, 2024-04-18T21:07:04.630 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:04.630 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:04.630 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:04.630 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:04.630 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:04.630 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:04.630 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11511 2024-04-18T21:07:04.630 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.630 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:04.630 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.631 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:04.631 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.838500+0000", 2024-04-18T21:07:04.631 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:04.631 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.631 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.631 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:04.631 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.838500+0000", 2024-04-18T21:07:04.631 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:04.631 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.631 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.631 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:04.631 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.838501+0000", 2024-04-18T21:07:04.631 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.4799999999999997e-07 2024-04-18T21:07:04.631 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.631 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.632 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:04.632 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.847806+0000", 2024-04-18T21:07:04.632 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0093054250000000008 2024-04-18T21:07:04.632 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.632 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.632 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:04.632 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.847834+0000", 2024-04-18T21:07:04.632 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7161999999999998e-05 2024-04-18T21:07:04.632 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.632 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.632 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:04.632 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.847849+0000", 2024-04-18T21:07:04.632 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5217e-05 2024-04-18T21:07:04.633 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.633 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.633 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:04.633 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.847917+0000", 2024-04-18T21:07:04.633 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7896000000000002e-05 2024-04-18T21:07:04.633 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.633 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.633 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:04.633 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.848080+0000", 2024-04-18T21:07:04.633 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016328299999999999 2024-04-18T21:07:04.633 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.633 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.633 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:04.634 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.848348+0000", 2024-04-18T21:07:04.634 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00026766099999999998 2024-04-18T21:07:04.634 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.634 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.634 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:04.634 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.863288+0000", 2024-04-18T21:07:04.634 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.014940301 2024-04-18T21:07:04.634 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.634 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.634 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:04.634 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.882854+0000", 2024-04-18T21:07:04.634 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019566456999999999 2024-04-18T21:07:04.634 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.635 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.635 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:04.635 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.882904+0000", 2024-04-18T21:07:04.635 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.9620999999999998e-05 2024-04-18T21:07:04.635 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.635 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.635 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:04.635 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.882952+0000", 2024-04-18T21:07:04.635 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.7766999999999999e-05 2024-04-18T21:07:04.635 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:04.635 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:04.635 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:04.635 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.636 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.636 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11728 4.39 4:9dcc5ecf:::1000000316e.00000000:head [write 0~4194304 [2@1720266]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:04.636 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.088728+0000", 2024-04-18T21:07:04.636 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 5.5111592800000002, 2024-04-18T21:07:04.636 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.047519835000000003, 2024-04-18T21:07:04.636 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:04.636 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:04.636 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:04.636 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:04.636 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:04.636 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:04.636 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11728 2024-04-18T21:07:04.636 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.636 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:04.636 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.637 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:04.637 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.088728+0000", 2024-04-18T21:07:04.637 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:04.637 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.637 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.637 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:04.637 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.088728+0000", 2024-04-18T21:07:04.637 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:04.637 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.637 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.637 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:04.637 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.088729+0000", 2024-04-18T21:07:04.637 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1000000000000001e-06 2024-04-18T21:07:04.637 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.638 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.638 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:04.638 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094322+0000", 2024-04-18T21:07:04.638 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0055931349999999999 2024-04-18T21:07:04.638 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.638 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.638 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:04.638 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094334+0000", 2024-04-18T21:07:04.638 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1894e-05 2024-04-18T21:07:04.638 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.638 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.638 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:04.638 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094340+0000", 2024-04-18T21:07:04.638 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.8780000000000003e-06 2024-04-18T21:07:04.638 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.639 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.639 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:04.639 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094393+0000", 2024-04-18T21:07:04.639 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3275000000000001e-05 2024-04-18T21:07:04.639 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.639 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.639 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:04.639 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094479+0000", 2024-04-18T21:07:04.639 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5222999999999994e-05 2024-04-18T21:07:04.639 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.639 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.639 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:04.639 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094629+0000", 2024-04-18T21:07:04.639 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00015021699999999999 2024-04-18T21:07:04.640 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.640 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.640 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:04.640 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.102975+0000", 2024-04-18T21:07:04.640 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0083464460000000004 2024-04-18T21:07:04.640 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.640 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.640 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:04.640 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136142+0000", 2024-04-18T21:07:04.640 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.033166432000000003 2024-04-18T21:07:04.640 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.640 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.640 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:04.640 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136207+0000", 2024-04-18T21:07:04.641 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.5032999999999999e-05 2024-04-18T21:07:04.641 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.641 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.641 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:04.641 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136248+0000", 2024-04-18T21:07:04.641 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.1202000000000003e-05 2024-04-18T21:07:04.641 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:04.641 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:04.641 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:04.641 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.641 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.641 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11731 4.39 4:9dcc5ecf:::1000000316e.00000000:head [write 3247277~11534 [2@1720266] in=11534b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:04.641 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.094419+0000", 2024-04-18T21:07:04.642 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 5.5054680830000002, 2024-04-18T21:07:04.642 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.042530119999999998, 2024-04-18T21:07:04.642 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:04.642 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:04.642 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:04.642 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:04.642 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:04.642 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:04.642 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11731 2024-04-18T21:07:04.642 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.642 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:04.642 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.643 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:04.643 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094419+0000", 2024-04-18T21:07:04.643 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:04.643 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.643 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.643 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:04.643 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094419+0000", 2024-04-18T21:07:04.643 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:04.643 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.643 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.643 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:04.643 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094420+0000", 2024-04-18T21:07:04.643 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.6400000000000003e-07 2024-04-18T21:07:04.643 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.644 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.644 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:04.644 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094429+0000", 2024-04-18T21:07:04.644 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.2359999999999993e-06 2024-04-18T21:07:04.644 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.644 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.644 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:04.644 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094433+0000", 2024-04-18T21:07:04.644 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.155e-06 2024-04-18T21:07:04.644 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.644 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.644 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:04.644 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094436+0000", 2024-04-18T21:07:04.644 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.0529999999999998e-06 2024-04-18T21:07:04.645 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.645 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.645 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:04.645 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.099720+0000", 2024-04-18T21:07:04.645 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0052837370000000002 2024-04-18T21:07:04.645 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.645 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.645 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:04.645 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.099793+0000", 2024-04-18T21:07:04.645 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.2959000000000004e-05 2024-04-18T21:07:04.645 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.645 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.645 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:04.646 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.099884+0000", 2024-04-18T21:07:04.646 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.1032999999999994e-05 2024-04-18T21:07:04.646 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.646 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.646 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:04.646 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.103177+0000", 2024-04-18T21:07:04.646 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0032935210000000002 2024-04-18T21:07:04.646 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.646 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.646 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:04.646 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136826+0000", 2024-04-18T21:07:04.646 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.033648521000000001 2024-04-18T21:07:04.646 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.647 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.647 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:04.647 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136896+0000", 2024-04-18T21:07:04.647 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0457000000000007e-05 2024-04-18T21:07:04.647 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.647 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.647 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:04.647 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136949+0000", 2024-04-18T21:07:04.647 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.2984e-05 2024-04-18T21:07:04.647 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:04.647 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:04.647 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:04.647 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.647 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.648 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11847 4.a 4:51f063b7:::100000032b5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:04.648 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.229180+0000", 2024-04-18T21:07:04.648 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 5.3707072240000002, 2024-04-18T21:07:04.648 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.048001033999999998, 2024-04-18T21:07:04.648 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:04.648 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:04.648 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:04.648 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:04.648 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:04.648 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:04.648 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11847 2024-04-18T21:07:04.648 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.648 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:04.648 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.649 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:04.649 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.229180+0000", 2024-04-18T21:07:04.649 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:04.649 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.649 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.649 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:04.649 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.229180+0000", 2024-04-18T21:07:04.649 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:04.649 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.649 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.649 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:04.649 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.229181+0000", 2024-04-18T21:07:04.649 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.119e-06 2024-04-18T21:07:04.649 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.650 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.650 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:04.650 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.235951+0000", 2024-04-18T21:07:04.650 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0067702370000000001 2024-04-18T21:07:04.650 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.650 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.650 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:04.650 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.235965+0000", 2024-04-18T21:07:04.650 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3202e-05 2024-04-18T21:07:04.650 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.650 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.650 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:04.650 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.235973+0000", 2024-04-18T21:07:04.650 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8630000000000008e-06 2024-04-18T21:07:04.651 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.651 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.651 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:04.651 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.236047+0000", 2024-04-18T21:07:04.651 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.4453e-05 2024-04-18T21:07:04.651 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.651 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.651 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:04.651 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.236137+0000", 2024-04-18T21:07:04.651 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.9751000000000002e-05 2024-04-18T21:07:04.651 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.651 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.651 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:04.652 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.236266+0000", 2024-04-18T21:07:04.652 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000129257 2024-04-18T21:07:04.652 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.652 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.652 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:04.652 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.244520+0000", 2024-04-18T21:07:04.652 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0082538190000000008 2024-04-18T21:07:04.652 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.652 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.652 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:04.652 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.277093+0000", 2024-04-18T21:07:04.652 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.032573405999999999 2024-04-18T21:07:04.652 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.652 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.652 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:04.653 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.277144+0000", 2024-04-18T21:07:04.653 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.0553000000000002e-05 2024-04-18T21:07:04.653 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.653 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.653 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:04.653 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.277181+0000", 2024-04-18T21:07:04.653 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.7373999999999998e-05 2024-04-18T21:07:04.653 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:04.653 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:04.653 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:04.653 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.653 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.653 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11949 4.2b 4:d50cc3c5:::100000031c6.00000000:head [write 0~3145728] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:04.653 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.338113+0000", 2024-04-18T21:07:04.653 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 5.2617743480000003, 2024-04-18T21:07:04.654 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.046907847000000003, 2024-04-18T21:07:04.654 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:04.654 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:04.654 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:04.654 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:04.654 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:04.654 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:04.654 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11949 2024-04-18T21:07:04.654 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.654 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:04.654 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.654 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:04.654 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.338113+0000", 2024-04-18T21:07:04.654 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:04.654 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.655 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.655 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:04.655 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.338113+0000", 2024-04-18T21:07:04.655 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:04.655 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.655 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.655 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:04.655 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.338115+0000", 2024-04-18T21:07:04.655 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5659999999999999e-06 2024-04-18T21:07:04.655 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.655 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.655 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:04.655 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344146+0000", 2024-04-18T21:07:04.655 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0060309339999999999 2024-04-18T21:07:04.655 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.656 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.656 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:04.656 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344163+0000", 2024-04-18T21:07:04.656 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6994999999999999e-05 2024-04-18T21:07:04.656 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.656 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.656 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:04.656 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344171+0000", 2024-04-18T21:07:04.656 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5520000000000005e-06 2024-04-18T21:07:04.656 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.656 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.656 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:04.656 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344604+0000", 2024-04-18T21:07:04.657 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00043326299999999997 2024-04-18T21:07:04.657 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.657 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.657 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:04.657 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344687+0000", 2024-04-18T21:07:04.657 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.2952000000000001e-05 2024-04-18T21:07:04.657 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.657 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.657 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:04.657 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344792+0000", 2024-04-18T21:07:04.657 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000104635 2024-04-18T21:07:04.657 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.657 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.658 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:04.658 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.361867+0000", 2024-04-18T21:07:04.658 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017075245999999999 2024-04-18T21:07:04.658 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.658 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.658 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:04.658 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.384879+0000", 2024-04-18T21:07:04.658 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023011474000000001 2024-04-18T21:07:04.658 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.658 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.658 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:04.658 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.384976+0000", 2024-04-18T21:07:04.658 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.7399999999999996e-05 2024-04-18T21:07:04.658 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.659 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.659 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:04.659 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.385021+0000", 2024-04-18T21:07:04.659 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.4830000000000003e-05 2024-04-18T21:07:04.659 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:04.659 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:04.659 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:04.659 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.659 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.659 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11988 4.0 4:01311cad:::1000000320a.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:04.659 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.384266+0000", 2024-04-18T21:07:04.659 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 5.2156208780000002, 2024-04-18T21:07:04.659 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.042482546000000003, 2024-04-18T21:07:04.659 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:04.660 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:04.660 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:04.660 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:04.660 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:04.660 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:04.660 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11988 2024-04-18T21:07:04.660 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.660 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:04.660 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.660 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:04.660 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.384266+0000", 2024-04-18T21:07:04.660 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:04.660 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.660 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.660 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:04.661 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.384266+0000", 2024-04-18T21:07:04.661 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:04.661 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.661 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.661 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:04.661 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.384268+0000", 2024-04-18T21:07:04.661 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.857e-06 2024-04-18T21:07:04.661 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.661 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.661 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:04.661 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.391524+0000", 2024-04-18T21:07:04.661 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0072557469999999999 2024-04-18T21:07:04.661 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.661 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.661 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:04.661 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.391546+0000", 2024-04-18T21:07:04.662 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1607000000000002e-05 2024-04-18T21:07:04.662 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.662 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.662 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:04.662 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.391559+0000", 2024-04-18T21:07:04.662 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3331e-05 2024-04-18T21:07:04.662 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.662 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.662 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:04.662 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.391639+0000", 2024-04-18T21:07:04.662 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.9511000000000005e-05 2024-04-18T21:07:04.662 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.662 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.662 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:04.662 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.391753+0000", 2024-04-18T21:07:04.663 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000114512 2024-04-18T21:07:04.663 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.663 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.663 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:04.663 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.391945+0000", 2024-04-18T21:07:04.663 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019234300000000001 2024-04-18T21:07:04.663 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.663 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.663 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:04.663 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.401085+0000", 2024-04-18T21:07:04.663 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0091394319999999994 2024-04-18T21:07:04.663 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.663 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.663 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:04.663 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.426658+0000", 2024-04-18T21:07:04.663 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.025573148 2024-04-18T21:07:04.664 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.664 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.664 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:04.664 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.426714+0000", 2024-04-18T21:07:04.664 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5937999999999999e-05 2024-04-18T21:07:04.664 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.664 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.664 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:04.664 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.426749+0000", 2024-04-18T21:07:04.664 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.5120000000000003e-05 2024-04-18T21:07:04.664 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:04.664 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:04.664 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:04.664 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.664 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.664 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:12041 4.38 4:1c8d9fef:::100000033ed.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:04.665 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.446812+0000", 2024-04-18T21:07:04.665 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 5.1530751070000003, 2024-04-18T21:07:04.665 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.044749606999999997, 2024-04-18T21:07:04.665 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:04.665 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:04.665 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:04.665 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:04.665 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:04.665 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:04.665 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 12041 2024-04-18T21:07:04.665 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.665 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:04.665 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.665 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:04.666 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.446812+0000", 2024-04-18T21:07:04.666 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:04.666 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.666 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.666 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:04.666 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.446812+0000", 2024-04-18T21:07:04.666 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:04.666 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.666 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.666 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:04.666 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.446814+0000", 2024-04-18T21:07:04.666 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5099999999999999e-06 2024-04-18T21:07:04.666 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.666 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.667 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:04.667 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.452583+0000", 2024-04-18T21:07:04.667 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0057696379999999997 2024-04-18T21:07:04.667 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.667 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.667 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:04.667 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.452599+0000", 2024-04-18T21:07:04.667 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5701000000000001e-05 2024-04-18T21:07:04.667 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.667 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.667 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:04.667 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.452607+0000", 2024-04-18T21:07:04.667 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.7100000000000007e-06 2024-04-18T21:07:04.667 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.667 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.668 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:04.668 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.452718+0000", 2024-04-18T21:07:04.668 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000111257 2024-04-18T21:07:04.668 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.668 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.668 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:04.668 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.452924+0000", 2024-04-18T21:07:04.668 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000206066 2024-04-18T21:07:04.668 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.668 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.668 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:04.668 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.453088+0000", 2024-04-18T21:07:04.668 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016336700000000001 2024-04-18T21:07:04.668 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.669 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.669 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:04.669 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.469818+0000", 2024-04-18T21:07:04.669 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016730248999999999 2024-04-18T21:07:04.669 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.669 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.669 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:04.669 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.491505+0000", 2024-04-18T21:07:04.669 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021687366 2024-04-18T21:07:04.669 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.669 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.669 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:04.669 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.491537+0000", 2024-04-18T21:07:04.670 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.1888999999999999e-05 2024-04-18T21:07:04.670 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.670 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.670 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:04.670 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.491562+0000", 2024-04-18T21:07:04.670 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.4854e-05 2024-04-18T21:07:04.670 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:04.670 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:04.670 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:04.670 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.670 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.670 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:12228 4.16 4:6a8d8629:::100000033d5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:04.670 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.681634+0000", 2024-04-18T21:07:04.671 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 4.9182528789999997, 2024-04-18T21:07:04.671 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043430791000000003, 2024-04-18T21:07:04.671 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:04.671 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:04.671 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:04.671 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:04.671 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:04.671 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:04.671 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 12228 2024-04-18T21:07:04.671 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.671 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:04.671 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.671 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:04.671 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.681634+0000", 2024-04-18T21:07:04.671 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:04.672 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.672 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.672 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:04.672 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.681634+0000", 2024-04-18T21:07:04.672 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:04.672 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.672 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.672 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:04.672 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.681637+0000", 2024-04-18T21:07:04.672 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.418e-06 2024-04-18T21:07:04.672 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.672 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.672 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:04.672 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.688982+0000", 2024-04-18T21:07:04.672 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0073447870000000002 2024-04-18T21:07:04.673 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.673 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.673 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:04.673 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.688998+0000", 2024-04-18T21:07:04.673 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6330000000000001e-05 2024-04-18T21:07:04.673 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.673 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.673 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:04.673 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.689009+0000", 2024-04-18T21:07:04.673 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1236999999999999e-05 2024-04-18T21:07:04.673 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.673 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.673 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:04.673 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.689083+0000", 2024-04-18T21:07:04.673 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3415000000000001e-05 2024-04-18T21:07:04.674 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.674 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.674 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:04.674 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.689237+0000", 2024-04-18T21:07:04.674 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00015420899999999999 2024-04-18T21:07:04.674 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.674 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.674 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:04.674 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.689419+0000", 2024-04-18T21:07:04.674 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018242099999999999 2024-04-18T21:07:04.674 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.674 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.674 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:04.674 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.711630+0000", 2024-04-18T21:07:04.675 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.022210475 2024-04-18T21:07:04.675 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.675 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.675 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:04.675 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.724956+0000", 2024-04-18T21:07:04.675 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013325887999999999 2024-04-18T21:07:04.675 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.675 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.675 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:04.675 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.725019+0000", 2024-04-18T21:07:04.675 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.3757999999999995e-05 2024-04-18T21:07:04.675 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.675 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.675 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:04.675 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.725065+0000", 2024-04-18T21:07:04.676 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.5853000000000003e-05 2024-04-18T21:07:04.676 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:04.676 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:04.676 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:04.676 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.676 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.676 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_repop(client.4534.0:12689 4.26 e58/16 4:64a7f444:::100000033e5.00000000:head v 58'205, mlcod=58'203)", 2024-04-18T21:07:04.676 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:00.217785+0000", 2024-04-18T21:07:04.676 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 4.3821023119999998, 2024-04-18T21:07:04.676 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.052245469000000003, 2024-04-18T21:07:04.676 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:04.676 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:04.676 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:04.676 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:04.676 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.677 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:04.677 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.217785+0000", 2024-04-18T21:07:04.677 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:04.677 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.677 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.677 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:04.677 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.217785+0000", 2024-04-18T21:07:04.677 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:04.677 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.677 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.677 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:04.677 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.217786+0000", 2024-04-18T21:07:04.677 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6700000000000002e-07 2024-04-18T21:07:04.677 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.678 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.678 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:04.678 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225111+0000", 2024-04-18T21:07:04.678 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0073251119999999999 2024-04-18T21:07:04.678 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.678 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.678 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:04.678 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225126+0000", 2024-04-18T21:07:04.678 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.541e-05 2024-04-18T21:07:04.678 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.678 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.678 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:04.678 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225137+0000", 2024-04-18T21:07:04.678 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0890000000000001e-05 2024-04-18T21:07:04.679 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.679 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.679 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:04.679 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225244+0000", 2024-04-18T21:07:04.679 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000106555 2024-04-18T21:07:04.679 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.679 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.679 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:04.679 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225276+0000", 2024-04-18T21:07:04.679 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.2574999999999999e-05 2024-04-18T21:07:04.679 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.679 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.679 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:04.679 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.269985+0000", 2024-04-18T21:07:04.679 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.044708422999999997 2024-04-18T21:07:04.680 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.680 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.680 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:04.680 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.270031+0000", 2024-04-18T21:07:04.680 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.5636999999999997e-05 2024-04-18T21:07:04.680 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:04.680 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:04.680 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:04.680 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.680 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.680 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:12692 4.3a 4:5c788ec1:::100000032ff.00000000:head [write 0~4194304 [2@945974]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:04.680 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:00.225134+0000", 2024-04-18T21:07:04.680 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 4.3747532570000001, 2024-04-18T21:07:04.680 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.048311640000000003, 2024-04-18T21:07:04.680 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:04.681 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:04.681 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:04.681 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:04.681 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:04.681 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:04.681 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 12692 2024-04-18T21:07:04.681 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.681 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:04.681 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.681 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:04.681 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225134+0000", 2024-04-18T21:07:04.681 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:04.681 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.681 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.681 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:04.681 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225134+0000", 2024-04-18T21:07:04.682 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:04.682 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.682 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.682 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:04.682 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225136+0000", 2024-04-18T21:07:04.682 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4160000000000001e-06 2024-04-18T21:07:04.682 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.682 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.682 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:04.682 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231408+0000", 2024-04-18T21:07:04.682 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.006272517 2024-04-18T21:07:04.682 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.682 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.682 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:04.683 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231437+0000", 2024-04-18T21:07:04.683 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.9119e-05 2024-04-18T21:07:04.683 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.683 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.683 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:04.683 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231456+0000", 2024-04-18T21:07:04.683 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8544999999999999e-05 2024-04-18T21:07:04.683 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.683 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.683 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:04.683 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231579+0000", 2024-04-18T21:07:04.683 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000123762 2024-04-18T21:07:04.683 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.683 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.683 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:04.684 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231690+0000", 2024-04-18T21:07:04.684 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000110349 2024-04-18T21:07:04.684 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.684 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.684 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:04.684 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231903+0000", 2024-04-18T21:07:04.684 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000212695 2024-04-18T21:07:04.684 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.684 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.684 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:04.684 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.253911+0000", 2024-04-18T21:07:04.684 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.022008706999999999 2024-04-18T21:07:04.684 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.684 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.684 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:04.684 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.273383+0000", 2024-04-18T21:07:04.685 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019471568000000002 2024-04-18T21:07:04.685 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.685 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.685 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:04.685 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.273418+0000", 2024-04-18T21:07:04.685 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.5265999999999997e-05 2024-04-18T21:07:04.685 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.685 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.685 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:04.685 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.273446+0000", 2024-04-18T21:07:04.685 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7696e-05 2024-04-18T21:07:04.685 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:04.685 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:04.686 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:04.686 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.686 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.686 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:12693 4.2b 4:d71e94ee:::10000003509.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:04.686 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:00.231503+0000", 2024-04-18T21:07:04.686 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 4.3683844729999999, 2024-04-18T21:07:04.686 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.042620511999999999, 2024-04-18T21:07:04.686 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:04.686 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:04.686 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:04.686 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:04.686 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:04.686 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:04.686 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 12693 2024-04-18T21:07:04.686 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.687 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:04.687 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.687 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:04.687 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231503+0000", 2024-04-18T21:07:04.687 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:04.687 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.687 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.687 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:04.687 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231503+0000", 2024-04-18T21:07:04.687 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:04.687 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.687 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.687 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:04.687 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231505+0000", 2024-04-18T21:07:04.687 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9530000000000002e-06 2024-04-18T21:07:04.687 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.688 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.688 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:04.688 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.238278+0000", 2024-04-18T21:07:04.688 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0067732269999999997 2024-04-18T21:07:04.688 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.688 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.688 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:04.688 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.238295+0000", 2024-04-18T21:07:04.688 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7268000000000001e-05 2024-04-18T21:07:04.688 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.688 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.688 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:04.688 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.238303+0000", 2024-04-18T21:07:04.688 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.1559999999999995e-06 2024-04-18T21:07:04.689 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.689 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.689 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:04.689 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.238370+0000", 2024-04-18T21:07:04.689 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.6959999999999996e-05 2024-04-18T21:07:04.689 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.689 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.689 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:04.689 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.238569+0000", 2024-04-18T21:07:04.689 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000198242 2024-04-18T21:07:04.689 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.689 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.689 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:04.689 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.238840+0000", 2024-04-18T21:07:04.690 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00027115 2024-04-18T21:07:04.690 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.690 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.690 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:04.690 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.268210+0000", 2024-04-18T21:07:04.690 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.029370216000000001 2024-04-18T21:07:04.690 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.690 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.690 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:04.690 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.274023+0000", 2024-04-18T21:07:04.690 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0058133009999999999 2024-04-18T21:07:04.690 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.690 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.690 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:04.690 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.274064+0000", 2024-04-18T21:07:04.691 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.0157000000000002e-05 2024-04-18T21:07:04.691 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.691 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.691 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:04.691 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.274123+0000", 2024-04-18T21:07:04.691 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.9882e-05 2024-04-18T21:07:04.691 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:04.691 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:04.691 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:04.691 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.691 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.691 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:15008 4.2b 4:d5496710:::100000033cf.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-18T21:07:04.691 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:02.998996+0000", 2024-04-18T21:07:04.691 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 1.6008911960000001, 2024-04-18T21:07:04.692 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.042584729000000002, 2024-04-18T21:07:04.692 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:04.692 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:04.692 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:04.692 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:04.692 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:04.692 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:04.692 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 15008 2024-04-18T21:07:04.692 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.692 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:04.692 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.692 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:04.692 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:02.998996+0000", 2024-04-18T21:07:04.692 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:04.692 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.692 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.693 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:04.693 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:02.998996+0000", 2024-04-18T21:07:04.693 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:04.693 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.693 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.693 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:04.693 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:02.998997+0000", 2024-04-18T21:07:04.693 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.4000000000000001e-07 2024-04-18T21:07:04.693 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.693 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.693 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:04.693 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.005534+0000", 2024-04-18T21:07:04.693 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0065367339999999998 2024-04-18T21:07:04.693 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.693 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.694 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:04.694 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.005562+0000", 2024-04-18T21:07:04.694 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8861999999999999e-05 2024-04-18T21:07:04.694 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.694 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.694 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:04.694 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.005582+0000", 2024-04-18T21:07:04.694 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9987e-05 2024-04-18T21:07:04.694 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.694 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.694 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:04.694 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.005659+0000", 2024-04-18T21:07:04.694 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.6570999999999996e-05 2024-04-18T21:07:04.694 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.694 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.694 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:04.695 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.005841+0000", 2024-04-18T21:07:04.695 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018223600000000001 2024-04-18T21:07:04.695 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.695 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.695 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:04.695 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.005976+0000", 2024-04-18T21:07:04.695 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000135165 2024-04-18T21:07:04.695 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.695 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.695 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:04.695 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.015878+0000", 2024-04-18T21:07:04.695 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0099018390000000008 2024-04-18T21:07:04.695 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.695 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.696 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:04.696 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.041515+0000", 2024-04-18T21:07:04.696 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.025636982999999999 2024-04-18T21:07:04.696 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.696 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.696 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:04.696 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.041554+0000", 2024-04-18T21:07:04.696 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.8679e-05 2024-04-18T21:07:04.696 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.696 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.696 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:04.696 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.041581+0000", 2024-04-18T21:07:04.696 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7033e-05 2024-04-18T21:07:04.696 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:04.696 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:04.696 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:04.697 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.697 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.697 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:15085 4.20 4:04677f23:::100000034fe.00000000:head [write 0~4194304 [2@471250]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-18T21:07:04.697 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:03.092507+0000", 2024-04-18T21:07:04.697 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 1.5073807430000001, 2024-04-18T21:07:04.697 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.042978905999999997, 2024-04-18T21:07:04.697 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:04.697 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:04.697 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:04.697 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:04.697 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:04.697 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:04.697 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 15085 2024-04-18T21:07:04.697 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.697 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:04.698 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.698 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:04.698 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.092507+0000", 2024-04-18T21:07:04.698 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:04.698 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.698 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.698 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:04.698 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.092507+0000", 2024-04-18T21:07:04.698 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:04.698 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.698 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.698 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:04.698 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.092507+0000", 2024-04-18T21:07:04.698 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8299999999999996e-07 2024-04-18T21:07:04.699 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.699 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.699 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:04.699 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.099434+0000", 2024-04-18T21:07:04.699 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.006926176 2024-04-18T21:07:04.699 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.699 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.699 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:04.699 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.099451+0000", 2024-04-18T21:07:04.699 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7733000000000001e-05 2024-04-18T21:07:04.699 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.699 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.699 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:04.699 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.099460+0000", 2024-04-18T21:07:04.699 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5990000000000002e-06 2024-04-18T21:07:04.700 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.700 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.700 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:04.700 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.099519+0000", 2024-04-18T21:07:04.700 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.9106e-05 2024-04-18T21:07:04.700 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.700 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.700 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:04.700 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.099637+0000", 2024-04-18T21:07:04.700 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000117917 2024-04-18T21:07:04.700 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.700 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.700 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:04.700 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.099893+0000", 2024-04-18T21:07:04.700 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00025568800000000001 2024-04-18T21:07:04.701 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.701 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.701 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:04.701 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.125269+0000", 2024-04-18T21:07:04.701 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.025376177999999999 2024-04-18T21:07:04.701 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.701 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.701 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:04.701 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.135427+0000", 2024-04-18T21:07:04.701 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010158149 2024-04-18T21:07:04.701 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.701 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.701 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:04.701 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.135461+0000", 2024-04-18T21:07:04.701 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.4440999999999998e-05 2024-04-18T21:07:04.701 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.702 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.702 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:04.702 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.135486+0000", 2024-04-18T21:07:04.702 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.4136000000000001e-05 2024-04-18T21:07:04.702 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:04.702 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:04.702 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:04.702 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.702 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.702 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:15094 4.c 4:32870457:::10000003692.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-18T21:07:04.702 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:03.107374+0000", 2024-04-18T21:07:04.702 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 1.492512933, 2024-04-18T21:07:04.702 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.061575983000000001, 2024-04-18T21:07:04.703 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:04.703 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:04.703 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:04.703 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:04.703 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:04.703 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:04.703 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 15094 2024-04-18T21:07:04.703 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.703 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:04.703 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.703 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:04.703 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.107374+0000", 2024-04-18T21:07:04.703 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:04.703 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.703 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.704 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:04.704 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.107374+0000", 2024-04-18T21:07:04.704 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:04.704 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.704 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.704 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:04.704 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.107376+0000", 2024-04-18T21:07:04.704 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3969999999999999e-06 2024-04-18T21:07:04.704 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.704 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.704 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:04.704 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115698+0000", 2024-04-18T21:07:04.704 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0083223989999999994 2024-04-18T21:07:04.704 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.704 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.704 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:04.705 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115713+0000", 2024-04-18T21:07:04.705 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4385e-05 2024-04-18T21:07:04.705 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.705 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.705 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:04.705 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115722+0000", 2024-04-18T21:07:04.705 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0759999999999992e-06 2024-04-18T21:07:04.705 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.705 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.705 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:04.705 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115784+0000", 2024-04-18T21:07:04.705 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.2348999999999995e-05 2024-04-18T21:07:04.705 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.705 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.705 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:04.706 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115849+0000", 2024-04-18T21:07:04.706 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.4964999999999999e-05 2024-04-18T21:07:04.706 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.706 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.706 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:04.706 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.116054+0000", 2024-04-18T21:07:04.706 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020483400000000001 2024-04-18T21:07:04.706 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.706 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.706 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:04.706 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.125769+0000", 2024-04-18T21:07:04.706 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0097153340000000008 2024-04-18T21:07:04.706 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.706 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.706 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:04.707 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.168834+0000", 2024-04-18T21:07:04.707 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043064527999999998 2024-04-18T21:07:04.707 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.707 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.707 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:04.707 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.168882+0000", 2024-04-18T21:07:04.707 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.7919e-05 2024-04-18T21:07:04.707 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.707 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.707 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:04.707 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.168950+0000", 2024-04-18T21:07:04.707 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.8796999999999999e-05 2024-04-18T21:07:04.707 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:04.707 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:04.707 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:04.708 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.708 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.708 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:15133 4.38 4:1c73eb83:::1000000398c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-18T21:07:04.708 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:03.155031+0000", 2024-04-18T21:07:04.708 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 1.4448563919999999, 2024-04-18T21:07:04.708 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.044078787000000001, 2024-04-18T21:07:04.708 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:04.708 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:04.708 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:04.708 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:04.708 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:04.708 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:04.708 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 15133 2024-04-18T21:07:04.708 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.708 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:04.709 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.709 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:04.709 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.155031+0000", 2024-04-18T21:07:04.709 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:04.709 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.709 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.709 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:04.709 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.155031+0000", 2024-04-18T21:07:04.709 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:04.709 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.709 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.709 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:04.709 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.155033+0000", 2024-04-18T21:07:04.709 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.84e-06 2024-04-18T21:07:04.709 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.710 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.710 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:04.710 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.161994+0000", 2024-04-18T21:07:04.710 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0069607779999999999 2024-04-18T21:07:04.710 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.710 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.710 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:04.710 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.162008+0000", 2024-04-18T21:07:04.710 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4399000000000001e-05 2024-04-18T21:07:04.710 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.710 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.710 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:04.710 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.162018+0000", 2024-04-18T21:07:04.710 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.7149999999999993e-06 2024-04-18T21:07:04.711 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.711 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.711 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:04.711 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.162073+0000", 2024-04-18T21:07:04.711 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4803999999999999e-05 2024-04-18T21:07:04.711 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.711 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.711 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:04.711 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.162215+0000", 2024-04-18T21:07:04.711 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014222900000000001 2024-04-18T21:07:04.711 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.711 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.711 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:04.711 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.162341+0000", 2024-04-18T21:07:04.711 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012579400000000001 2024-04-18T21:07:04.712 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.712 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.712 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:04.712 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.169445+0000", 2024-04-18T21:07:04.712 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0071040360000000002 2024-04-18T21:07:04.712 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.712 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.712 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:04.712 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.199046+0000", 2024-04-18T21:07:04.712 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.029601639999999999 2024-04-18T21:07:04.712 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.712 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.712 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:04.712 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.199082+0000", 2024-04-18T21:07:04.712 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.6134999999999999e-05 2024-04-18T21:07:04.713 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:04.713 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:04.713 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:04.713 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.199110+0000", 2024-04-18T21:07:04.713 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7416999999999999e-05 2024-04-18T21:07:04.713 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:04.713 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:04.713 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:04.713 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:04.713 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:04.713 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:07:04.713 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:07:04.715 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:07:04.716 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:04.714+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:04.816 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:04.814+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:04.850 INFO:teuthology.orchestra.run.smithi078.stderr:noscrub is unset 2024-04-18T21:07:04.852 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:07:04.852 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:07:04.852 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-04-18T21:07:04.852 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:07:04.862 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:07:04.862 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:07:04.862 INFO:teuthology.orchestra.run.smithi078.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-18T21:07:04.868 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:07:04.884 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:07:04.885 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:07:04.887 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-18T21:07:04.887 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-18T21:07:04.957 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:04.958+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:05.018 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:05.017+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:05.038 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:05.039 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:05.054 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:05.149 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:05.150+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:05.218 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:05.218+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:05.233 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:05.233 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:05.249 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:07:05.319 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:05.321+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:05.381 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:05.381 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:05.395 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:07:05.439 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:05.441+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:05.520 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:05.521+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:05.559 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:05.559 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:05.573 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:07:05.620 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:05.618+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:05.722 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:05.721+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:05.756 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:05.756 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:05.775 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:07:05.822 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:05.821+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:05.921 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:05.921 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:05.922 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:05.922+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:05.935 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:07:06.025 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:06.026+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:06.095 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:06.095 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:06.109 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:06.153 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:06.154+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:06.225 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:06.225+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:06.276 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:06.277 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:06.291 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:07:06.339 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:06.341+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:06.422 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:06.422 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:06.425 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:06.426+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:06.437 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:07:06.526 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:06.529+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:06.600 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:06.600 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:06.615 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:07:06.658 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:06.661+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:06.728 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:06.729+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:06.812 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:06.813 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:06.829 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:06.830+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:06.834 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:07:06.870 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-18T21:07:06.888 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:07:06.929 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:06.930+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:06.998 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:06.999 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:07.012 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:07:07.030 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:07.033+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:07.081 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:07:07.082 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:07:07.082 INFO:teuthology.orchestra.run.smithi078.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-18T21:07:07.114 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:07:07.114 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:07:07.118 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-18T21:07:07.118 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-18T21:07:07.130 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:07.133+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:07.173 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:07:07.173 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:07:07.173 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-18T21:07:07.173 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-18T21:07:07.174 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:07:07.189 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:07.233 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:07.234+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:07.314 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:07:07.314 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-18T21:07:07.314 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-18T21:07:07.315 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:07:07.315 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.315 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:07.315 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:07:07.315 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 121.69944492400001, 2024-04-18T21:07:07.315 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045668994999999997, 2024-04-18T21:07:07.315 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:07.315 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:07.315 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.315 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:07.315 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.315 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:07.315 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:07:07.315 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:07.316 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.316 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.316 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:07.316 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:07:07.316 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:07.316 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.316 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.316 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:07.316 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615459+0000", 2024-04-18T21:07:07.316 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5030000000000001e-06 2024-04-18T21:07:07.316 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.316 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.316 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:07.316 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615506+0000", 2024-04-18T21:07:07.316 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6872000000000001e-05 2024-04-18T21:07:07.317 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.317 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.317 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:07.317 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615527+0000", 2024-04-18T21:07:07.317 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0763000000000001e-05 2024-04-18T21:07:07.317 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.317 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.317 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.317 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615551+0000", 2024-04-18T21:07:07.317 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4159e-05 2024-04-18T21:07:07.317 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.317 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.317 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:07.317 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615736+0000", 2024-04-18T21:07:07.317 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018499599999999999 2024-04-18T21:07:07.318 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.318 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.318 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:07:07.318 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615748+0000", 2024-04-18T21:07:07.318 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2272999999999999e-05 2024-04-18T21:07:07.318 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.318 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.318 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:07.318 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635481+0000", 2024-04-18T21:07:07.318 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019732772999999999 2024-04-18T21:07:07.318 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.318 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.318 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:07.319 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635791+0000", 2024-04-18T21:07:07.319 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031013299999999998 2024-04-18T21:07:07.319 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.319 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.319 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:07.319 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636101+0000", 2024-04-18T21:07:07.319 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030943300000000002 2024-04-18T21:07:07.319 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.319 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.319 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:07.319 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646043+0000", 2024-04-18T21:07:07.319 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099428139999999995 2024-04-18T21:07:07.319 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.319 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.319 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.320 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660991+0000", 2024-04-18T21:07:07.320 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014947142 2024-04-18T21:07:07.320 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.320 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.320 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:07.320 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661061+0000", 2024-04-18T21:07:07.320 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0438000000000006e-05 2024-04-18T21:07:07.320 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.320 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.320 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:07.320 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661127+0000", 2024-04-18T21:07:07.320 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5696000000000003e-05 2024-04-18T21:07:07.320 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:07.320 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:07.320 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:07.321 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.321 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.321 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:07.321 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:07:07.321 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 121.69923249599999, 2024-04-18T21:07:07.321 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045745085999999997, 2024-04-18T21:07:07.321 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:07.321 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:07.321 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.321 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:07.321 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.321 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:07.321 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:07:07.321 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:07.321 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.322 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.322 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:07.322 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:07:07.322 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:07.322 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.322 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.322 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:07.322 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:07:07.322 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7400000000000001e-06 2024-04-18T21:07:07.322 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.322 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.322 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:07.322 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:07:07.322 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8133e-05 2024-04-18T21:07:07.323 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.323 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.323 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:07.323 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615726+0000", 2024-04-18T21:07:07.323 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6132e-05 2024-04-18T21:07:07.323 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.323 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.323 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.323 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615742+0000", 2024-04-18T21:07:07.323 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6157000000000001e-05 2024-04-18T21:07:07.323 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.323 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.323 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:07.323 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615937+0000", 2024-04-18T21:07:07.324 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000194768 2024-04-18T21:07:07.324 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.324 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.324 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:07:07.324 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615950+0000", 2024-04-18T21:07:07.324 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3084e-05 2024-04-18T21:07:07.324 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.324 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.324 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:07.324 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643676+0000", 2024-04-18T21:07:07.324 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027725639999999999 2024-04-18T21:07:07.324 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.324 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.324 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:07.325 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643867+0000", 2024-04-18T21:07:07.325 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019075900000000001 2024-04-18T21:07:07.325 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.325 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.325 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:07.325 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:07:07.325 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036013799999999997 2024-04-18T21:07:07.325 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.325 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.325 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:07.325 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646068+0000", 2024-04-18T21:07:07.325 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001841536 2024-04-18T21:07:07.325 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.325 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.325 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.326 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661184+0000", 2024-04-18T21:07:07.326 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015115458999999999 2024-04-18T21:07:07.326 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.326 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.326 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:07.326 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661283+0000", 2024-04-18T21:07:07.326 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9502999999999999e-05 2024-04-18T21:07:07.326 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.326 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.326 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:07.326 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661415+0000", 2024-04-18T21:07:07.326 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000132037 2024-04-18T21:07:07.326 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:07.326 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:07.326 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:07.327 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.327 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.327 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:101 3.1f 3:f83d65d8:::200.00000004:head [write 316455~1401 [fadvise_dontneed] in=1401b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:07.327 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:07:07.327 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 21.557168884999999, 2024-04-18T21:07:07.327 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.048270212999999999, 2024-04-18T21:07:07.327 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:07.327 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:07.327 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.327 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:07.327 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.327 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:07.327 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:07:07.327 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:07.328 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.328 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.328 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:07.328 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:07:07.328 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:07.328 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.328 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.328 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:07.328 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:07:07.328 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7700000000000004e-07 2024-04-18T21:07:07.328 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.328 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.328 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:07.328 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757745+0000", 2024-04-18T21:07:07.328 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0910000000000001e-05 2024-04-18T21:07:07.329 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.329 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.329 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:07.329 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757758+0000", 2024-04-18T21:07:07.329 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2593e-05 2024-04-18T21:07:07.329 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.329 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.329 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.329 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757765+0000", 2024-04-18T21:07:07.329 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1659999999999997e-06 2024-04-18T21:07:07.329 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.329 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.329 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:07.329 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.797782+0000", 2024-04-18T21:07:07.330 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.040017283000000001 2024-04-18T21:07:07.330 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.330 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.330 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:07.330 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.797949+0000", 2024-04-18T21:07:07.330 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016650399999999999 2024-04-18T21:07:07.330 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.330 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.330 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:07.330 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.798152+0000", 2024-04-18T21:07:07.330 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000203098 2024-04-18T21:07:07.330 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.330 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.330 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:07.331 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.800792+0000", 2024-04-18T21:07:07.331 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026394779999999998 2024-04-18T21:07:07.331 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.331 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.331 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.331 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805921+0000", 2024-04-18T21:07:07.331 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0051295519999999999 2024-04-18T21:07:07.331 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.331 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.331 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:07.331 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805967+0000", 2024-04-18T21:07:07.331 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5457000000000002e-05 2024-04-18T21:07:07.331 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.331 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.331 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:07.331 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806004+0000", 2024-04-18T21:07:07.332 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7494999999999999e-05 2024-04-18T21:07:07.332 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:07.332 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:07.332 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:07.332 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.332 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.332 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:102 3.1f 3:f83d65d8:::200.00000004:head [write 317856~1403 [fadvise_dontneed] in=1403b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:07.332 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757775+0000", 2024-04-18T21:07:07.332 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 21.557127819000002, 2024-04-18T21:07:07.332 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.048337705000000002, 2024-04-18T21:07:07.332 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:07.332 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:07.332 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.332 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:07.333 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.333 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:07.333 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757775+0000", 2024-04-18T21:07:07.333 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:07.333 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.333 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.333 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:07.333 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757775+0000", 2024-04-18T21:07:07.333 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:07.333 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.333 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.333 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:07.333 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757776+0000", 2024-04-18T21:07:07.333 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5300000000000004e-07 2024-04-18T21:07:07.334 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.334 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.334 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:07.334 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757780+0000", 2024-04-18T21:07:07.334 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2270000000000004e-06 2024-04-18T21:07:07.334 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.334 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.334 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:07.334 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757792+0000", 2024-04-18T21:07:07.334 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2696e-05 2024-04-18T21:07:07.334 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.334 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.334 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.334 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757800+0000", 2024-04-18T21:07:07.334 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1439999999999997e-06 2024-04-18T21:07:07.335 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.335 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.335 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:07.335 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.798773+0000", 2024-04-18T21:07:07.335 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.040973074999999998 2024-04-18T21:07:07.335 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.335 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.335 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:07.335 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.798990+0000", 2024-04-18T21:07:07.335 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000217161 2024-04-18T21:07:07.335 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.335 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.335 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:07.335 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.799173+0000", 2024-04-18T21:07:07.336 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018295900000000001 2024-04-18T21:07:07.336 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.336 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.336 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:07.336 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802469+0000", 2024-04-18T21:07:07.336 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032965350000000002 2024-04-18T21:07:07.336 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.336 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.336 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.336 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806042+0000", 2024-04-18T21:07:07.336 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035724630000000001 2024-04-18T21:07:07.336 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.336 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.336 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:07.336 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806077+0000", 2024-04-18T21:07:07.337 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4997999999999999e-05 2024-04-18T21:07:07.337 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.337 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.337 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:07.337 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806113+0000", 2024-04-18T21:07:07.337 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5794000000000003e-05 2024-04-18T21:07:07.337 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:07.337 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:07.337 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:07.337 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.337 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.337 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:103 3.1f 3:f83d65d8:::200.00000004:head [write 319259~1404 [fadvise_dontneed] in=1404b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:07.337 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:07:07.338 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 21.557093973000001, 2024-04-18T21:07:07.338 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.048414481000000002, 2024-04-18T21:07:07.338 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:07.338 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:07.338 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.338 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:07.338 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.338 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:07.338 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:07:07.338 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:07.338 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.338 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.338 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:07.338 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:07:07.339 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:07.339 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.339 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.339 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:07.339 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:07:07.339 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4700000000000001e-07 2024-04-18T21:07:07.339 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.339 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.339 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:07.339 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757814+0000", 2024-04-18T21:07:07.339 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1829999999999996e-06 2024-04-18T21:07:07.339 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.339 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.339 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:07.340 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757825+0000", 2024-04-18T21:07:07.340 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1754e-05 2024-04-18T21:07:07.340 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.340 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.340 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.340 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757832+0000", 2024-04-18T21:07:07.340 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8430000000000004e-06 2024-04-18T21:07:07.340 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.340 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.340 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:07.340 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.799809+0000", 2024-04-18T21:07:07.340 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.041976960000000001 2024-04-18T21:07:07.340 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.341 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.341 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:07.341 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.799934+0000", 2024-04-18T21:07:07.341 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000125053 2024-04-18T21:07:07.341 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.341 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.341 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:07.341 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.800067+0000", 2024-04-18T21:07:07.341 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013276299999999999 2024-04-18T21:07:07.341 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.341 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.341 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:07.341 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804582+0000", 2024-04-18T21:07:07.342 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0045148899999999997 2024-04-18T21:07:07.342 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.342 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.342 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.342 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806158+0000", 2024-04-18T21:07:07.342 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001575894 2024-04-18T21:07:07.342 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.342 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.342 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:07.342 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806189+0000", 2024-04-18T21:07:07.342 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1423000000000001e-05 2024-04-18T21:07:07.342 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.342 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.343 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:07.343 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806223+0000", 2024-04-18T21:07:07.343 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4071e-05 2024-04-18T21:07:07.343 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:07.343 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:07.343 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:07.343 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.343 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.343 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:104 3.1f 3:f83d65d8:::200.00000004:head [write 320663~1405 [fadvise_dontneed] in=1405b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:07.343 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757841+0000", 2024-04-18T21:07:07.343 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 21.557061769000001, 2024-04-18T21:07:07.343 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056381623999999998, 2024-04-18T21:07:07.343 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:07.343 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:07.344 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.344 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:07.344 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.344 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:07.344 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757841+0000", 2024-04-18T21:07:07.344 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:07.344 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.344 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.344 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:07.344 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757841+0000", 2024-04-18T21:07:07.344 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:07.344 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.344 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.344 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:07.345 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757842+0000", 2024-04-18T21:07:07.345 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5000000000000002e-07 2024-04-18T21:07:07.345 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.345 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.345 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:07.345 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757852+0000", 2024-04-18T21:07:07.345 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.084e-05 2024-04-18T21:07:07.345 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.345 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.345 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:07.345 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757865+0000", 2024-04-18T21:07:07.345 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2643000000000001e-05 2024-04-18T21:07:07.345 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.345 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.346 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.346 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757872+0000", 2024-04-18T21:07:07.346 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8689999999999998e-06 2024-04-18T21:07:07.346 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.346 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.346 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:07.346 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.801102+0000", 2024-04-18T21:07:07.346 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043229837 2024-04-18T21:07:07.346 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.346 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.346 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:07.346 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.801291+0000", 2024-04-18T21:07:07.346 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000189641 2024-04-18T21:07:07.346 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.347 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.347 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:07.347 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.801640+0000", 2024-04-18T21:07:07.347 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000348971 2024-04-18T21:07:07.347 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.347 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.347 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:07.347 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805849+0000", 2024-04-18T21:07:07.347 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042082739999999997 2024-04-18T21:07:07.347 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.347 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.347 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.347 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814135+0000", 2024-04-18T21:07:07.347 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0082867270000000007 2024-04-18T21:07:07.347 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.348 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.348 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:07.348 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814180+0000", 2024-04-18T21:07:07.348 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4982999999999999e-05 2024-04-18T21:07:07.348 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.348 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.348 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:07.348 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814223+0000", 2024-04-18T21:07:07.348 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2188999999999999e-05 2024-04-18T21:07:07.348 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:07.348 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:07.348 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:07.348 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.348 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.348 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:105 3.1f 3:f83d65d8:::200.00000004:head [write 322068~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:07.349 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:07:07.349 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 21.557021172999999, 2024-04-18T21:07:07.349 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056513678999999997, 2024-04-18T21:07:07.349 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:07.349 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:07.349 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.349 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:07.349 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.349 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:07.349 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:07:07.349 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:07.349 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.349 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.349 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:07.349 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:07:07.350 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:07.350 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.350 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.350 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:07.350 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:07:07.350 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2600000000000002e-07 2024-04-18T21:07:07.350 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.350 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.350 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:07.350 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757888+0000", 2024-04-18T21:07:07.350 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7130000000000002e-06 2024-04-18T21:07:07.350 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.350 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.350 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:07.351 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757906+0000", 2024-04-18T21:07:07.351 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7723999999999998e-05 2024-04-18T21:07:07.351 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.351 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.351 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.351 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757921+0000", 2024-04-18T21:07:07.351 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4936000000000001e-05 2024-04-18T21:07:07.351 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.351 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.351 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:07.351 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802493+0000", 2024-04-18T21:07:07.351 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.044571927999999997 2024-04-18T21:07:07.351 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.351 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.351 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:07.352 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802537+0000", 2024-04-18T21:07:07.352 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4449000000000001e-05 2024-04-18T21:07:07.352 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.352 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.352 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:07.352 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802605+0000", 2024-04-18T21:07:07.352 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7945000000000001e-05 2024-04-18T21:07:07.352 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.352 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.352 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:07.352 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805852+0000", 2024-04-18T21:07:07.352 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032469909999999999 2024-04-18T21:07:07.352 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.352 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.352 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.353 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814298+0000", 2024-04-18T21:07:07.353 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084463309999999996 2024-04-18T21:07:07.353 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.353 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.353 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:07.353 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814355+0000", 2024-04-18T21:07:07.353 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6459999999999998e-05 2024-04-18T21:07:07.353 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.353 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.353 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:07.353 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814395+0000", 2024-04-18T21:07:07.353 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0475999999999997e-05 2024-04-18T21:07:07.353 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:07.353 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:07.353 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:07.354 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.354 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.354 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:106 3.1f 3:f83d65d8:::200.00000004:head [write 323467~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:07.354 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757955+0000", 2024-04-18T21:07:07.354 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 21.556947944000001, 2024-04-18T21:07:07.354 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056539990999999998, 2024-04-18T21:07:07.354 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:07.354 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:07.354 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.354 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:07.354 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.354 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:07.354 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757955+0000", 2024-04-18T21:07:07.354 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:07.355 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.355 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.355 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:07.355 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757955+0000", 2024-04-18T21:07:07.355 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:07.355 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.355 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.355 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:07.355 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757956+0000", 2024-04-18T21:07:07.355 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.144e-06 2024-04-18T21:07:07.355 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.355 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.355 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:07.355 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757970+0000", 2024-04-18T21:07:07.355 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3899e-05 2024-04-18T21:07:07.356 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.356 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.356 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:07.356 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757988+0000", 2024-04-18T21:07:07.356 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8033000000000002e-05 2024-04-18T21:07:07.356 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.356 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.356 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.356 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758002+0000", 2024-04-18T21:07:07.356 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3973e-05 2024-04-18T21:07:07.356 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.356 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.356 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:07.356 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803072+0000", 2024-04-18T21:07:07.356 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045070194000000001 2024-04-18T21:07:07.356 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.357 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.357 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:07.357 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803125+0000", 2024-04-18T21:07:07.357 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3498000000000002e-05 2024-04-18T21:07:07.357 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.357 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.357 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:07.357 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803233+0000", 2024-04-18T21:07:07.357 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010704099999999999 2024-04-18T21:07:07.357 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.357 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.357 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:07.357 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805856+0000", 2024-04-18T21:07:07.357 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026233430000000002 2024-04-18T21:07:07.358 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.358 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.358 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.358 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814439+0000", 2024-04-18T21:07:07.358 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0085833839999999995 2024-04-18T21:07:07.358 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.358 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.358 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:07.358 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814469+0000", 2024-04-18T21:07:07.358 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9784000000000001e-05 2024-04-18T21:07:07.358 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.358 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.358 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:07.358 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814495+0000", 2024-04-18T21:07:07.359 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5698e-05 2024-04-18T21:07:07.359 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:07.359 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:07.359 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:07.359 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.359 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.359 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:107 3.1f 3:f83d65d8:::200.00000004:head [write 324866~1421 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:07.359 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758019+0000", 2024-04-18T21:07:07.359 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 21.556883318000001, 2024-04-18T21:07:07.359 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056580563, 2024-04-18T21:07:07.359 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:07.359 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:07.359 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.359 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:07.359 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.359 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:07.360 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758019+0000", 2024-04-18T21:07:07.360 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:07.360 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.360 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.360 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:07.360 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758019+0000", 2024-04-18T21:07:07.360 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:07.360 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.360 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.360 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:07.360 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758021+0000", 2024-04-18T21:07:07.360 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1999999999999999e-06 2024-04-18T21:07:07.360 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.360 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.360 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:07.361 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758028+0000", 2024-04-18T21:07:07.361 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7200000000000006e-06 2024-04-18T21:07:07.361 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.361 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.361 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:07.361 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758050+0000", 2024-04-18T21:07:07.361 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1877000000000001e-05 2024-04-18T21:07:07.361 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.361 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.361 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.361 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758064+0000", 2024-04-18T21:07:07.361 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.383e-05 2024-04-18T21:07:07.361 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.361 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.361 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:07.362 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803593+0000", 2024-04-18T21:07:07.362 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045528831999999998 2024-04-18T21:07:07.362 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.362 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.362 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:07.362 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803635+0000", 2024-04-18T21:07:07.362 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1980000000000001e-05 2024-04-18T21:07:07.362 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.362 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.362 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:07.362 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803703+0000", 2024-04-18T21:07:07.362 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8542999999999997e-05 2024-04-18T21:07:07.362 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.362 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.362 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:07.363 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806123+0000", 2024-04-18T21:07:07.363 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002419769 2024-04-18T21:07:07.363 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.363 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.363 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.363 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814542+0000", 2024-04-18T21:07:07.363 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084189460000000001 2024-04-18T21:07:07.363 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.363 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.363 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:07.363 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814576+0000", 2024-04-18T21:07:07.363 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3679000000000001e-05 2024-04-18T21:07:07.363 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.363 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.363 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:07.363 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814600+0000", 2024-04-18T21:07:07.364 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4187000000000001e-05 2024-04-18T21:07:07.364 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:07.364 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:07.364 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:07.364 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.364 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.364 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:108 3.1f 3:f83d65d8:::200.00000004:head [write 326287~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:07.364 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:07:07.364 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 21.556820149, 2024-04-18T21:07:07.364 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056616183, 2024-04-18T21:07:07.364 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:07.364 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:07.364 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.364 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:07.364 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.365 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:07.365 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:07:07.365 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:07.365 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.365 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.365 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:07.365 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:07:07.365 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:07.365 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.365 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.365 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:07.365 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758084+0000", 2024-04-18T21:07:07.365 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.124e-06 2024-04-18T21:07:07.365 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.365 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.365 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:07.366 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758100+0000", 2024-04-18T21:07:07.366 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6246e-05 2024-04-18T21:07:07.366 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.366 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.366 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:07.366 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758118+0000", 2024-04-18T21:07:07.366 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8267e-05 2024-04-18T21:07:07.366 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.366 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.366 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.366 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758134+0000", 2024-04-18T21:07:07.366 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5950000000000001e-05 2024-04-18T21:07:07.366 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.366 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.366 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:07.367 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803949+0000", 2024-04-18T21:07:07.367 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045815349999999998 2024-04-18T21:07:07.367 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.367 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.367 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:07.367 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804011+0000", 2024-04-18T21:07:07.367 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1044999999999996e-05 2024-04-18T21:07:07.367 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.367 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.367 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:07.367 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804128+0000", 2024-04-18T21:07:07.367 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117148 2024-04-18T21:07:07.367 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.367 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.367 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:07.368 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806794+0000", 2024-04-18T21:07:07.368 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002666692 2024-04-18T21:07:07.368 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.368 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.368 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.368 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814645+0000", 2024-04-18T21:07:07.368 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0078508880000000003 2024-04-18T21:07:07.368 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.368 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.368 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:07.368 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814678+0000", 2024-04-18T21:07:07.368 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3188999999999997e-05 2024-04-18T21:07:07.368 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.368 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.368 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:07.368 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814699+0000", 2024-04-18T21:07:07.369 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0284000000000001e-05 2024-04-18T21:07:07.369 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:07.369 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:07.369 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:07.369 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.369 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.369 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:109 3.1f 3:f83d65d8:::200.00000004:head [write 327693~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:07.369 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:07:07.369 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 21.556750782000002, 2024-04-18T21:07:07.369 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056621036999999999, 2024-04-18T21:07:07.369 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:07.369 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:07.369 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.369 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:07.369 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.370 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:07.370 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:07:07.370 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:07.370 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.370 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.370 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:07.370 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:07:07.370 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:07.370 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.370 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.370 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:07.370 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758153+0000", 2024-04-18T21:07:07.370 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1459999999999999e-06 2024-04-18T21:07:07.370 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.371 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.371 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:07.371 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758161+0000", 2024-04-18T21:07:07.371 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7999999999999999e-06 2024-04-18T21:07:07.371 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.371 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.371 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:07.371 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758179+0000", 2024-04-18T21:07:07.371 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7949999999999999e-05 2024-04-18T21:07:07.371 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.371 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.371 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.371 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758193+0000", 2024-04-18T21:07:07.371 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3773e-05 2024-04-18T21:07:07.372 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.372 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.372 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:07.372 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804632+0000", 2024-04-18T21:07:07.372 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.046439469999999997 2024-04-18T21:07:07.372 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.372 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.372 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:07.372 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804790+0000", 2024-04-18T21:07:07.372 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015784300000000001 2024-04-18T21:07:07.372 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.372 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.372 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:07.372 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805056+0000", 2024-04-18T21:07:07.372 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026652400000000003 2024-04-18T21:07:07.372 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.373 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.373 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:07.373 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.808959+0000", 2024-04-18T21:07:07.373 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003903077 2024-04-18T21:07:07.373 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.373 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.373 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.373 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814728+0000", 2024-04-18T21:07:07.373 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0057682489999999996 2024-04-18T21:07:07.373 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.373 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.373 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:07.373 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814754+0000", 2024-04-18T21:07:07.373 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6673999999999999e-05 2024-04-18T21:07:07.373 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.374 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.374 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:07.374 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814773+0000", 2024-04-18T21:07:07.374 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8530999999999999e-05 2024-04-18T21:07:07.374 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:07.374 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:07.374 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:07.374 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.374 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.374 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:110 3.1f 3:f83d65d8:::200.00000004:head [write 329098~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:07.374 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:07:07.374 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 21.556692373000001, 2024-04-18T21:07:07.374 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056669113, 2024-04-18T21:07:07.374 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:07.375 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:07.375 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.375 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:07.375 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.375 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:07.375 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:07:07.375 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:07.375 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.375 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.375 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:07.375 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:07:07.375 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:07.375 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.375 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.375 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:07.375 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758212+0000", 2024-04-18T21:07:07.376 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:07:07.376 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.376 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.376 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:07.376 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758219+0000", 2024-04-18T21:07:07.376 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4229999999999999e-06 2024-04-18T21:07:07.376 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.376 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.376 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:07.376 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758237+0000", 2024-04-18T21:07:07.376 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7966999999999999e-05 2024-04-18T21:07:07.376 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.376 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.376 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.376 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758252+0000", 2024-04-18T21:07:07.376 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5322999999999999e-05 2024-04-18T21:07:07.377 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.377 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.377 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:07.377 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805536+0000", 2024-04-18T21:07:07.377 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.047283861000000003 2024-04-18T21:07:07.377 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.377 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.377 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:07.377 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805579+0000", 2024-04-18T21:07:07.377 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2738999999999999e-05 2024-04-18T21:07:07.377 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.377 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.377 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:07.377 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805649+0000", 2024-04-18T21:07:07.378 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0213e-05 2024-04-18T21:07:07.378 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.378 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.378 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:07.378 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.808966+0000", 2024-04-18T21:07:07.378 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033166129999999999 2024-04-18T21:07:07.378 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.378 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.378 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.378 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814812+0000", 2024-04-18T21:07:07.378 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0058463589999999998 2024-04-18T21:07:07.378 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.378 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.378 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:07.378 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814854+0000", 2024-04-18T21:07:07.378 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1618e-05 2024-04-18T21:07:07.379 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.379 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.379 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:07.379 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814879+0000", 2024-04-18T21:07:07.379 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5754000000000001e-05 2024-04-18T21:07:07.379 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:07.379 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:07.379 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:07.379 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.379 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.379 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:111 3.1f 3:f83d65d8:::200.00000004:head [write 330499~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:07.379 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:07:07.379 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 21.556631397, 2024-04-18T21:07:07.379 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058693793000000001, 2024-04-18T21:07:07.379 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:07.379 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:07.380 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.380 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:07.380 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.380 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:07.380 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:07:07.380 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:07.380 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.380 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.380 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:07.380 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:07:07.380 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:07.380 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.380 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.380 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:07.380 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758272+0000", 2024-04-18T21:07:07.381 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1200000000000001e-06 2024-04-18T21:07:07.381 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.381 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.381 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:07.381 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758287+0000", 2024-04-18T21:07:07.381 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5017e-05 2024-04-18T21:07:07.381 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.381 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.381 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:07.381 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758309+0000", 2024-04-18T21:07:07.381 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1866e-05 2024-04-18T21:07:07.381 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.381 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.381 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.381 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758323+0000", 2024-04-18T21:07:07.382 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3606e-05 2024-04-18T21:07:07.382 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.382 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.382 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:07.382 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806279+0000", 2024-04-18T21:07:07.382 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.047956061000000001 2024-04-18T21:07:07.382 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.382 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.382 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:07.382 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806350+0000", 2024-04-18T21:07:07.382 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1070999999999998e-05 2024-04-18T21:07:07.382 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.382 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.382 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:07.383 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806459+0000", 2024-04-18T21:07:07.383 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000108606 2024-04-18T21:07:07.383 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.383 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.383 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:07.383 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.809774+0000", 2024-04-18T21:07:07.383 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003314881 2024-04-18T21:07:07.383 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.383 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.383 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.383 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816910+0000", 2024-04-18T21:07:07.383 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0071367760000000001 2024-04-18T21:07:07.383 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.383 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.383 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:07.383 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816941+0000", 2024-04-18T21:07:07.384 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0846000000000002e-05 2024-04-18T21:07:07.384 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.384 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.384 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:07.384 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816965+0000", 2024-04-18T21:07:07.384 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3943000000000001e-05 2024-04-18T21:07:07.384 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:07.384 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:07.384 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:07.384 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.384 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.384 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:5230 4.17 4:eb2cc4c4:::1000000184c.00000000:head [write 0~2191] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-18T21:07:07.384 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.760650+0000", 2024-04-18T21:07:07.384 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 21.554252225999999, 2024-04-18T21:07:07.384 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.054210577000000003, 2024-04-18T21:07:07.385 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:07.385 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:07.385 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.385 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:07:07.385 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:07:07.385 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:07.385 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 5230 2024-04-18T21:07:07.385 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.385 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:07.385 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.385 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:07.385 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760650+0000", 2024-04-18T21:07:07.385 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:07.385 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.385 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.385 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:07.386 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760650+0000", 2024-04-18T21:07:07.386 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:07.386 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.386 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.386 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:07.386 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760653+0000", 2024-04-18T21:07:07.386 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0829999999999998e-06 2024-04-18T21:07:07.386 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.386 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.386 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:07.386 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760664+0000", 2024-04-18T21:07:07.386 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.111e-05 2024-04-18T21:07:07.386 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.386 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.386 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:07.386 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760688+0000", 2024-04-18T21:07:07.387 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4837e-05 2024-04-18T21:07:07.387 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.387 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.387 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.387 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760702+0000", 2024-04-18T21:07:07.387 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3723000000000001e-05 2024-04-18T21:07:07.387 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.387 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.387 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:07.387 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806264+0000", 2024-04-18T21:07:07.387 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045562182 2024-04-18T21:07:07.387 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.387 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.387 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:07.387 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806351+0000", 2024-04-18T21:07:07.387 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6322000000000005e-05 2024-04-18T21:07:07.388 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.388 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.388 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:07.388 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806453+0000", 2024-04-18T21:07:07.388 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000102602 2024-04-18T21:07:07.388 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.388 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.388 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:07.388 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.808972+0000", 2024-04-18T21:07:07.388 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025184090000000001 2024-04-18T21:07:07.388 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.388 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.388 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.388 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814798+0000", 2024-04-18T21:07:07.388 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0058266689999999996 2024-04-18T21:07:07.388 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.389 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.389 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:07.389 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814839+0000", 2024-04-18T21:07:07.389 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0482000000000003e-05 2024-04-18T21:07:07.389 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.389 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.389 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:07.389 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814861+0000", 2024-04-18T21:07:07.389 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2158e-05 2024-04-18T21:07:07.389 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:07.389 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:07.389 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:07.389 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.389 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.389 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:112 3.1f 3:f83d65d8:::200.00000004:head [write 331898~20167 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:07.389 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.771321+0000", 2024-04-18T21:07:07.390 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 21.543581598999999, 2024-04-18T21:07:07.390 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045740306000000001, 2024-04-18T21:07:07.390 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:07.390 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:07.390 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.390 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:07.390 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.390 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:07.390 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771321+0000", 2024-04-18T21:07:07.390 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:07.390 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.390 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.390 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:07.390 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771321+0000", 2024-04-18T21:07:07.390 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:07.390 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.391 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.391 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:07.391 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771323+0000", 2024-04-18T21:07:07.391 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3740000000000001e-06 2024-04-18T21:07:07.391 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.391 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.391 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:07.391 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771359+0000", 2024-04-18T21:07:07.391 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5447999999999997e-05 2024-04-18T21:07:07.391 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.391 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.391 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:07.391 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771388+0000", 2024-04-18T21:07:07.391 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8915e-05 2024-04-18T21:07:07.391 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.392 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.392 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.392 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771410+0000", 2024-04-18T21:07:07.392 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1899000000000002e-05 2024-04-18T21:07:07.392 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.392 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.392 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:07.392 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806827+0000", 2024-04-18T21:07:07.392 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.035417063999999998 2024-04-18T21:07:07.392 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.392 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.392 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:07.392 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806873+0000", 2024-04-18T21:07:07.392 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6261999999999999e-05 2024-04-18T21:07:07.392 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.393 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.393 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:07.393 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806946+0000", 2024-04-18T21:07:07.393 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3205000000000001e-05 2024-04-18T21:07:07.393 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.393 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.393 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:07.393 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.809781+0000", 2024-04-18T21:07:07.393 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002834937 2024-04-18T21:07:07.393 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.393 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.393 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.393 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817003+0000", 2024-04-18T21:07:07.393 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0072217959999999999 2024-04-18T21:07:07.393 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.393 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.394 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:07.394 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817038+0000", 2024-04-18T21:07:07.394 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4696999999999997e-05 2024-04-18T21:07:07.394 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.394 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.394 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:07.394 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817061+0000", 2024-04-18T21:07:07.394 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3708999999999999e-05 2024-04-18T21:07:07.394 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:07.394 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:07.394 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:07.394 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.394 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.395 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:113 3.1f 3:f83d65d8:::200.00000004:head [write 352065~3878 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:07.395 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.771472+0000", 2024-04-18T21:07:07.395 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 21.543430863000001, 2024-04-18T21:07:07.395 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045689726, 2024-04-18T21:07:07.395 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:07.398 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:07.398 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.398 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:07.398 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.398 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:07.398 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771472+0000", 2024-04-18T21:07:07.398 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:07.399 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.399 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.399 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:07.399 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771472+0000", 2024-04-18T21:07:07.399 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:07.399 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.399 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.399 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:07.399 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771473+0000", 2024-04-18T21:07:07.399 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3829999999999999e-06 2024-04-18T21:07:07.399 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.399 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.399 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:07.399 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771489+0000", 2024-04-18T21:07:07.399 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5797000000000001e-05 2024-04-18T21:07:07.400 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.400 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.400 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:07.400 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771509+0000", 2024-04-18T21:07:07.400 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0401999999999999e-05 2024-04-18T21:07:07.400 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.400 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.400 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.400 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771525+0000", 2024-04-18T21:07:07.400 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5099999999999999e-05 2024-04-18T21:07:07.400 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.400 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.400 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:07.400 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807273+0000", 2024-04-18T21:07:07.400 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.035748488000000002 2024-04-18T21:07:07.401 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.401 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.401 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:07.401 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807343+0000", 2024-04-18T21:07:07.401 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0277000000000005e-05 2024-04-18T21:07:07.401 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.401 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.401 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:07.401 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807455+0000", 2024-04-18T21:07:07.401 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011171999999999999 2024-04-18T21:07:07.401 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.401 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.401 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:07.401 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.811509+0000", 2024-04-18T21:07:07.401 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0040543469999999998 2024-04-18T21:07:07.401 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.402 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.402 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.402 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817115+0000", 2024-04-18T21:07:07.402 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0056054520000000004 2024-04-18T21:07:07.402 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.402 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.402 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:07.402 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817142+0000", 2024-04-18T21:07:07.402 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7430999999999999e-05 2024-04-18T21:07:07.402 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.402 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.402 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:07.402 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817162+0000", 2024-04-18T21:07:07.402 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9329000000000001e-05 2024-04-18T21:07:07.402 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:07.403 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:07.403 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:07.403 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.403 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.403 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:11950 4.6 4:62753dda:::10000003222.00000000:head [write 3145728~1048576] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:07.403 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:59.346083+0000", 2024-04-18T21:07:07.403 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 7.968819635, 2024-04-18T21:07:07.403 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.051281119999999999, 2024-04-18T21:07:07.403 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:07.403 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:07.403 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.403 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:07:07.403 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:07:07.403 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:07.403 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 11950 2024-04-18T21:07:07.404 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.404 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:07.404 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.404 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:07.404 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.346083+0000", 2024-04-18T21:07:07.404 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:07.404 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.404 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.404 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:07.404 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.346083+0000", 2024-04-18T21:07:07.404 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:07.404 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.404 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.404 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:07.404 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.346085+0000", 2024-04-18T21:07:07.404 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.736e-06 2024-04-18T21:07:07.404 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.405 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.405 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:07.405 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.349991+0000", 2024-04-18T21:07:07.405 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0039062960000000001 2024-04-18T21:07:07.405 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.405 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.405 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:07.405 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.350006+0000", 2024-04-18T21:07:07.405 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5327000000000001e-05 2024-04-18T21:07:07.405 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.405 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.405 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.405 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.350016+0000", 2024-04-18T21:07:07.405 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3570000000000004e-06 2024-04-18T21:07:07.405 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.406 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.406 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:07.406 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.360724+0000", 2024-04-18T21:07:07.406 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010708153999999999 2024-04-18T21:07:07.406 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.406 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.406 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:07.406 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.360839+0000", 2024-04-18T21:07:07.406 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000114877 2024-04-18T21:07:07.406 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.406 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.406 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:07.406 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.397285+0000", 2024-04-18T21:07:07.406 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036445957000000001 2024-04-18T21:07:07.407 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.407 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.407 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:07.407 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.397316+0000", 2024-04-18T21:07:07.407 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0926000000000002e-05 2024-04-18T21:07:07.407 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.407 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.407 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:07.407 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.397364+0000", 2024-04-18T21:07:07.407 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8489999999999998e-05 2024-04-18T21:07:07.407 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:07.407 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:07.407 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:07.407 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.407 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.407 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:12225 4.11 4:8acd30ee:::100000031ed.00000000:head [write 0~4194304 [2@86041]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:07.408 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:59.667090+0000", 2024-04-18T21:07:07.408 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 7.6478130200000001, 2024-04-18T21:07:07.408 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.047400059000000001, 2024-04-18T21:07:07.408 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:07.408 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:07.408 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.408 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:07:07.408 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:07:07.408 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:07.408 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 12225 2024-04-18T21:07:07.408 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.408 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:07.408 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.408 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:07.408 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.667090+0000", 2024-04-18T21:07:07.409 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:07.409 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.409 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.409 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:07.409 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.667090+0000", 2024-04-18T21:07:07.409 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:07.409 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.409 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.409 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:07.409 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.667091+0000", 2024-04-18T21:07:07.409 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3629999999999999e-06 2024-04-18T21:07:07.409 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.409 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.409 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:07.409 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.674492+0000", 2024-04-18T21:07:07.409 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0074007789999999997 2024-04-18T21:07:07.410 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.410 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.410 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:07.410 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.674508+0000", 2024-04-18T21:07:07.410 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6509999999999999e-05 2024-04-18T21:07:07.410 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.410 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.410 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.410 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.674518+0000", 2024-04-18T21:07:07.410 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.6290000000000005e-06 2024-04-18T21:07:07.410 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.410 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.410 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:07.410 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.674584+0000", 2024-04-18T21:07:07.411 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5597000000000002e-05 2024-04-18T21:07:07.411 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.411 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.411 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:07.411 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.674659+0000", 2024-04-18T21:07:07.411 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5168999999999998e-05 2024-04-18T21:07:07.411 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.411 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.411 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:07.411 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.674775+0000", 2024-04-18T21:07:07.411 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000116069 2024-04-18T21:07:07.411 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.411 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.411 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:07.411 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.685336+0000", 2024-04-18T21:07:07.411 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010561022999999999 2024-04-18T21:07:07.412 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.412 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.412 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.412 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.714413+0000", 2024-04-18T21:07:07.412 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.029077306000000001 2024-04-18T21:07:07.412 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.412 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.412 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:07.412 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.714455+0000", 2024-04-18T21:07:07.412 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1547e-05 2024-04-18T21:07:07.412 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.412 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.412 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:07.412 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.714490+0000", 2024-04-18T21:07:07.412 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5067000000000002e-05 2024-04-18T21:07:07.412 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:07.413 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:07.413 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:07.413 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.413 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.413 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:12689 4.26 4:64a7f444:::100000033e5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:07.413 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:00.208067+0000", 2024-04-18T21:07:07.413 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 7.1068359809999997, 2024-04-18T21:07:07.413 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066681457, 2024-04-18T21:07:07.413 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:07.413 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:07.413 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.413 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:07:07.413 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:07:07.413 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:07.413 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 12689 2024-04-18T21:07:07.414 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.414 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:07.414 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.414 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:07.414 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.208067+0000", 2024-04-18T21:07:07.414 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:07.414 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.414 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.414 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:07.414 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.208067+0000", 2024-04-18T21:07:07.414 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:07.414 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.414 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.414 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:07.414 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.208069+0000", 2024-04-18T21:07:07.415 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1500000000000002e-06 2024-04-18T21:07:07.415 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.415 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.415 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:07.415 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216162+0000", 2024-04-18T21:07:07.415 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0080933159999999997 2024-04-18T21:07:07.415 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.415 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.415 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:07.415 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216181+0000", 2024-04-18T21:07:07.415 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8573e-05 2024-04-18T21:07:07.415 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.415 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.415 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.415 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216192+0000", 2024-04-18T21:07:07.416 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0767999999999999e-05 2024-04-18T21:07:07.416 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.416 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.416 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:07.416 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216259+0000", 2024-04-18T21:07:07.416 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7977000000000003e-05 2024-04-18T21:07:07.416 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.416 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.416 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:07.416 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216635+0000", 2024-04-18T21:07:07.416 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00037591300000000002 2024-04-18T21:07:07.416 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.416 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.416 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:07.416 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216929+0000", 2024-04-18T21:07:07.416 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00029314800000000002 2024-04-18T21:07:07.417 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.417 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.417 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:07.417 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.232918+0000", 2024-04-18T21:07:07.417 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015989903 2024-04-18T21:07:07.417 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.417 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.417 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.417 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.274643+0000", 2024-04-18T21:07:07.417 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.041724281000000002 2024-04-18T21:07:07.417 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.417 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.417 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:07.417 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.274701+0000", 2024-04-18T21:07:07.417 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8304999999999998e-05 2024-04-18T21:07:07.417 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.418 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.418 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:07.418 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.274748+0000", 2024-04-18T21:07:07.418 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7123000000000003e-05 2024-04-18T21:07:07.418 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:07.418 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:07.418 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:07.418 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.418 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.418 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4534.0:15094 4.c e59/16 4:32870457:::10000003692.00000000:head v 59'213, mlcod=59'211)", 2024-04-18T21:07:07.418 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:03.117817+0000", 2024-04-18T21:07:07.418 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.1970859100000002, 2024-04-18T21:07:07.418 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.049868875999999999, 2024-04-18T21:07:07.418 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:07.418 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:07.419 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.419 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:07.419 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.419 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:07.419 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.117817+0000", 2024-04-18T21:07:07.419 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:07.419 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.419 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.419 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:07.419 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.117817+0000", 2024-04-18T21:07:07.419 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:07.419 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.419 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.419 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:07.419 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.117817+0000", 2024-04-18T21:07:07.419 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0200000000000003e-07 2024-04-18T21:07:07.420 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.420 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.420 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:07.420 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.140525+0000", 2024-04-18T21:07:07.420 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.022707775999999999 2024-04-18T21:07:07.420 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.420 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.420 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:07.420 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.140549+0000", 2024-04-18T21:07:07.420 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4456000000000001e-05 2024-04-18T21:07:07.420 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.420 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.420 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.420 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.140563+0000", 2024-04-18T21:07:07.420 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.329e-05 2024-04-18T21:07:07.421 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.421 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.421 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:07.421 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.140797+0000", 2024-04-18T21:07:07.421 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023447400000000001 2024-04-18T21:07:07.421 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.421 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.421 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:07.421 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.140842+0000", 2024-04-18T21:07:07.421 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5287000000000002e-05 2024-04-18T21:07:07.421 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.421 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.421 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:07.421 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.167577+0000", 2024-04-18T21:07:07.421 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.026734745000000001 2024-04-18T21:07:07.421 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:07.422 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:07.422 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:07.422 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.167686+0000", 2024-04-18T21:07:07.422 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000108446 2024-04-18T21:07:07.422 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:07.422 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:07.422 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:07.422 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:07.422 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:07.422 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:07:07.424 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:07.426+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:07.424 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:07:07.525 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:07.522+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:07.560 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:07:07.560 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:07:07.560 INFO:teuthology.orchestra.run.smithi132.stdout: "num_ops": 0 2024-04-18T21:07:07.560 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:07:07.575 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:07:07.588 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-18T21:07:07.588 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-18T21:07:07.625 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:07.625+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:07.699 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:07:07.699 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:07:07.699 INFO:teuthology.orchestra.run.smithi132.stdout: "complaint_time": 30, 2024-04-18T21:07:07.700 INFO:teuthology.orchestra.run.smithi132.stdout: "num_blocked_ops": 0 2024-04-18T21:07:07.700 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:07:07.714 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:07:07.727 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:07.726+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:07.828 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:07.830+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:07.851 INFO:teuthology.orchestra.run.smithi078.stderr:nodeep-scrub is unset 2024-04-18T21:07:07.893 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:07:07.893 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 20, 2024-04-18T21:07:07.893 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 600, 2024-04-18T21:07:07.893 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [ 2024-04-18T21:07:07.893 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.893 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:07.894 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:07:07.894 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 122.27807948500001, 2024-04-18T21:07:07.894 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043251955000000002, 2024-04-18T21:07:07.894 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:07.894 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:07.894 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.894 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:07.894 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.894 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:07.894 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:07:07.894 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:07.894 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.894 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.895 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:07.895 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:07:07.895 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:07.895 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.895 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.895 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:07.895 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616536+0000", 2024-04-18T21:07:07.895 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2869999999999999e-06 2024-04-18T21:07:07.895 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.895 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.895 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:07.895 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616572+0000", 2024-04-18T21:07:07.895 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.6261999999999999e-05 2024-04-18T21:07:07.895 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.895 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.896 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:07.896 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616593+0000", 2024-04-18T21:07:07.896 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1310000000000001e-05 2024-04-18T21:07:07.896 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.896 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.896 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.896 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616614+0000", 2024-04-18T21:07:07.896 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.0936000000000001e-05 2024-04-18T21:07:07.896 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.896 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.896 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:07.896 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629501+0000", 2024-04-18T21:07:07.896 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.012886819000000001 2024-04-18T21:07:07.896 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.896 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.897 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:07.897 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629696+0000", 2024-04-18T21:07:07.897 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019485499999999999 2024-04-18T21:07:07.897 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.897 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.897 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:07.897 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629940+0000", 2024-04-18T21:07:07.897 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00024386399999999999 2024-04-18T21:07:07.897 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.897 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.897 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:07.897 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640100+0000", 2024-04-18T21:07:07.897 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010159645 2024-04-18T21:07:07.897 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.897 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.898 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.898 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659516+0000", 2024-04-18T21:07:07.898 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019416563000000001 2024-04-18T21:07:07.898 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.898 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.898 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:07.898 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659684+0000", 2024-04-18T21:07:07.898 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016750900000000001 2024-04-18T21:07:07.898 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.898 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.898 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:07.898 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659787+0000", 2024-04-18T21:07:07.898 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000102905 2024-04-18T21:07:07.898 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:07.898 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:07.898 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:07.899 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.899 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.899 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:07.899 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:07:07.899 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 122.277974363, 2024-04-18T21:07:07.899 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043581898000000001, 2024-04-18T21:07:07.899 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:07.899 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:07.899 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.899 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:07.899 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.899 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:07.899 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:07:07.899 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:07.899 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.900 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.900 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:07.900 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:07:07.900 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:07.900 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.900 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.900 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:07.900 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616641+0000", 2024-04-18T21:07:07.900 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:07:07.900 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.900 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.900 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:07.900 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616648+0000", 2024-04-18T21:07:07.900 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3860000000000001e-06 2024-04-18T21:07:07.900 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.901 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.901 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:07.901 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616666+0000", 2024-04-18T21:07:07.901 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7583000000000001e-05 2024-04-18T21:07:07.901 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.901 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.901 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.901 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616679+0000", 2024-04-18T21:07:07.901 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3322999999999999e-05 2024-04-18T21:07:07.901 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.901 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.901 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:07.901 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630373+0000", 2024-04-18T21:07:07.901 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013694207999999999 2024-04-18T21:07:07.901 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.901 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.902 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:07.902 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630545+0000", 2024-04-18T21:07:07.902 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000171683 2024-04-18T21:07:07.902 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.902 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.902 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:07.902 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630728+0000", 2024-04-18T21:07:07.902 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000182599 2024-04-18T21:07:07.902 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.902 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.902 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:07.902 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640600+0000", 2024-04-18T21:07:07.902 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0098726119999999994 2024-04-18T21:07:07.902 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.902 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.903 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.903 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659927+0000", 2024-04-18T21:07:07.903 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019326724999999999 2024-04-18T21:07:07.903 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.903 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.903 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:07.903 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660112+0000", 2024-04-18T21:07:07.903 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000185203 2024-04-18T21:07:07.903 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.903 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.903 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:07.903 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660222+0000", 2024-04-18T21:07:07.903 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109343 2024-04-18T21:07:07.903 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:07.903 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:07.904 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:07.904 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.904 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.904 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:07.904 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:07:07.904 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 122.277109005, 2024-04-18T21:07:07.904 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043121310000000003, 2024-04-18T21:07:07.904 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:07.904 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:07.904 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.904 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:07.904 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.904 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:07.904 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:07:07.904 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:07.904 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.905 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.905 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:07.905 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:07:07.905 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:07.905 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.905 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.905 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:07.905 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617506+0000", 2024-04-18T21:07:07.905 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9999999999999995e-07 2024-04-18T21:07:07.905 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.905 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.905 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:07.905 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617513+0000", 2024-04-18T21:07:07.905 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.9700000000000002e-06 2024-04-18T21:07:07.905 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.905 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.906 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:07.906 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617531+0000", 2024-04-18T21:07:07.906 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8105999999999999e-05 2024-04-18T21:07:07.906 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.906 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.906 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.906 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617545+0000", 2024-04-18T21:07:07.906 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3703000000000001e-05 2024-04-18T21:07:07.906 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.906 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.906 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:07.906 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632129+0000", 2024-04-18T21:07:07.906 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.014584135999999999 2024-04-18T21:07:07.906 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.907 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.907 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:07.907 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632361+0000", 2024-04-18T21:07:07.907 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023171800000000001 2024-04-18T21:07:07.907 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.907 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.907 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:07.907 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632804+0000", 2024-04-18T21:07:07.907 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000443549 2024-04-18T21:07:07.907 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.907 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.907 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:07.907 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646340+0000", 2024-04-18T21:07:07.907 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013535902000000001 2024-04-18T21:07:07.907 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.908 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.908 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.908 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660363+0000", 2024-04-18T21:07:07.908 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01402318 2024-04-18T21:07:07.908 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.908 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.908 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:07.908 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660523+0000", 2024-04-18T21:07:07.908 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00015989899999999999 2024-04-18T21:07:07.908 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.908 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.908 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:07.908 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660626+0000", 2024-04-18T21:07:07.908 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010314699999999999 2024-04-18T21:07:07.909 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:07.909 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:07.909 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:07.909 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.909 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.909 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11357 4.38 4:1d691e75:::1000000312c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T21:07:07.909 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:58.595279+0000", 2024-04-18T21:07:07.909 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 9.2993354529999994, 2024-04-18T21:07:07.909 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.045901399000000002, 2024-04-18T21:07:07.909 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:07.909 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:07.909 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.909 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:07.909 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:07.909 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:07.910 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11357 2024-04-18T21:07:07.910 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.910 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:07.910 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.910 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:07.910 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.595279+0000", 2024-04-18T21:07:07.910 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:07.910 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.910 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.910 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:07.910 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.595279+0000", 2024-04-18T21:07:07.910 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:07.910 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.910 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.911 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:07.911 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.595280+0000", 2024-04-18T21:07:07.911 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.079e-06 2024-04-18T21:07:07.911 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.911 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.911 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:07.911 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600237+0000", 2024-04-18T21:07:07.911 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0049569089999999998 2024-04-18T21:07:07.911 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.911 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.911 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:07.911 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600254+0000", 2024-04-18T21:07:07.911 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7399000000000001e-05 2024-04-18T21:07:07.911 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.911 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.912 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.912 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600262+0000", 2024-04-18T21:07:07.912 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.174e-06 2024-04-18T21:07:07.912 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.912 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.912 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:07.912 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600359+0000", 2024-04-18T21:07:07.912 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.6358000000000001e-05 2024-04-18T21:07:07.912 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.912 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.912 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:07.912 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600507+0000", 2024-04-18T21:07:07.912 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014854199999999999 2024-04-18T21:07:07.912 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.912 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.912 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:07.913 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600748+0000", 2024-04-18T21:07:07.913 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000241361 2024-04-18T21:07:07.913 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.913 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.913 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:07.913 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.615590+0000", 2024-04-18T21:07:07.913 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.014841851 2024-04-18T21:07:07.913 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.913 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.913 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.913 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.639817+0000", 2024-04-18T21:07:07.913 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024226527000000001 2024-04-18T21:07:07.913 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.913 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.913 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:07.914 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.640962+0000", 2024-04-18T21:07:07.914 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001145561 2024-04-18T21:07:07.914 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.914 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.914 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:07.914 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.641180+0000", 2024-04-18T21:07:07.914 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00021763800000000001 2024-04-18T21:07:07.914 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:07.914 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:07.914 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:07.914 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.914 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.914 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11443 4.38 4:1d691e75:::1000000312c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T21:07:07.914 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:58.744218+0000", 2024-04-18T21:07:07.914 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 9.1503957870000008, 2024-04-18T21:07:07.914 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.051074359999999999, 2024-04-18T21:07:07.915 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:07.915 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:07.915 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.915 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:07.915 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:07.915 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:07.915 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11443 2024-04-18T21:07:07.915 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.915 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:07.915 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.915 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:07.915 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.744218+0000", 2024-04-18T21:07:07.915 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:07.915 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.915 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.916 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:07.916 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.744218+0000", 2024-04-18T21:07:07.916 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:07.916 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.916 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.916 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:07.916 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.744221+0000", 2024-04-18T21:07:07.916 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.3580000000000001e-06 2024-04-18T21:07:07.916 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.916 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.916 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:07.916 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753328+0000", 2024-04-18T21:07:07.916 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0091071339999999994 2024-04-18T21:07:07.916 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.916 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.917 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:07.917 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753351+0000", 2024-04-18T21:07:07.917 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.3479999999999999e-05 2024-04-18T21:07:07.917 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.917 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.917 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.917 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753363+0000", 2024-04-18T21:07:07.917 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1345000000000001e-05 2024-04-18T21:07:07.917 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.917 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.917 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:07.917 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753416+0000", 2024-04-18T21:07:07.917 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.2849999999999997e-05 2024-04-18T21:07:07.917 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.917 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.918 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:07.918 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753471+0000", 2024-04-18T21:07:07.918 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5717999999999997e-05 2024-04-18T21:07:07.918 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.918 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.918 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:07.918 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753560+0000", 2024-04-18T21:07:07.918 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8777999999999996e-05 2024-04-18T21:07:07.918 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.918 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.918 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:07.918 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.760182+0000", 2024-04-18T21:07:07.918 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0066216299999999999 2024-04-18T21:07:07.918 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.918 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.919 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.919 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.795094+0000", 2024-04-18T21:07:07.919 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.034912334000000003 2024-04-18T21:07:07.919 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.919 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.919 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:07.919 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.795221+0000", 2024-04-18T21:07:07.919 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012745899999999999 2024-04-18T21:07:07.919 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.919 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.919 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:07.919 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.795293+0000", 2024-04-18T21:07:07.919 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.1273999999999996e-05 2024-04-18T21:07:07.919 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:07.919 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:07.919 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:07.920 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.920 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.920 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11511 4.18 4:184fae4a:::1000000316d.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:07.920 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:58.838500+0000", 2024-04-18T21:07:07.920 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 9.0561139070000003, 2024-04-18T21:07:07.920 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.044451537999999999, 2024-04-18T21:07:07.920 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:07.920 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:07.920 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.920 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:07.920 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:07.920 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:07.920 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11511 2024-04-18T21:07:07.920 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.920 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:07.921 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.921 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:07.921 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.838500+0000", 2024-04-18T21:07:07.921 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:07.921 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.921 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.921 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:07.921 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.838500+0000", 2024-04-18T21:07:07.921 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:07.921 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.921 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.921 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:07.921 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.838501+0000", 2024-04-18T21:07:07.921 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.4799999999999997e-07 2024-04-18T21:07:07.922 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.922 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.922 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:07.922 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.847806+0000", 2024-04-18T21:07:07.922 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0093054250000000008 2024-04-18T21:07:07.922 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.922 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.922 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:07.922 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.847834+0000", 2024-04-18T21:07:07.922 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7161999999999998e-05 2024-04-18T21:07:07.922 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.922 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.922 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.922 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.847849+0000", 2024-04-18T21:07:07.923 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5217e-05 2024-04-18T21:07:07.923 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.923 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.923 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:07.923 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.847917+0000", 2024-04-18T21:07:07.923 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7896000000000002e-05 2024-04-18T21:07:07.923 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.923 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.923 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:07.923 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.848080+0000", 2024-04-18T21:07:07.923 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016328299999999999 2024-04-18T21:07:07.923 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.923 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.923 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:07.923 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.848348+0000", 2024-04-18T21:07:07.924 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00026766099999999998 2024-04-18T21:07:07.924 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.924 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.924 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:07.924 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.863288+0000", 2024-04-18T21:07:07.924 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.014940301 2024-04-18T21:07:07.924 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.924 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.924 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.924 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.882854+0000", 2024-04-18T21:07:07.924 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019566456999999999 2024-04-18T21:07:07.924 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.924 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.924 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:07.924 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.882904+0000", 2024-04-18T21:07:07.925 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.9620999999999998e-05 2024-04-18T21:07:07.925 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.925 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.925 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:07.925 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.882952+0000", 2024-04-18T21:07:07.925 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.7766999999999999e-05 2024-04-18T21:07:07.925 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:07.925 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:07.925 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:07.925 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.925 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.925 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11728 4.39 4:9dcc5ecf:::1000000316e.00000000:head [write 0~4194304 [2@1720266]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:07.925 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.088728+0000", 2024-04-18T21:07:07.925 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 8.8058860400000007, 2024-04-18T21:07:07.925 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.047519835000000003, 2024-04-18T21:07:07.926 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:07.926 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:07.926 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.926 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:07.926 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:07.926 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:07.926 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11728 2024-04-18T21:07:07.926 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.926 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:07.926 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.926 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:07.926 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.088728+0000", 2024-04-18T21:07:07.926 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:07.926 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.926 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.926 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:07.927 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.088728+0000", 2024-04-18T21:07:07.927 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:07.927 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.927 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.927 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:07.927 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.088729+0000", 2024-04-18T21:07:07.927 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1000000000000001e-06 2024-04-18T21:07:07.927 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.927 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.927 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:07.927 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094322+0000", 2024-04-18T21:07:07.927 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0055931349999999999 2024-04-18T21:07:07.927 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.927 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.927 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:07.928 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094334+0000", 2024-04-18T21:07:07.928 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1894e-05 2024-04-18T21:07:07.928 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.928 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.928 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.928 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094340+0000", 2024-04-18T21:07:07.928 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.8780000000000003e-06 2024-04-18T21:07:07.928 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.928 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.928 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:07.928 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094393+0000", 2024-04-18T21:07:07.928 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3275000000000001e-05 2024-04-18T21:07:07.928 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.928 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.928 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:07.929 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094479+0000", 2024-04-18T21:07:07.929 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5222999999999994e-05 2024-04-18T21:07:07.929 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.929 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.929 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:07.929 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094629+0000", 2024-04-18T21:07:07.929 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00015021699999999999 2024-04-18T21:07:07.929 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.929 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.929 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:07.929 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.102975+0000", 2024-04-18T21:07:07.929 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0083464460000000004 2024-04-18T21:07:07.929 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.930 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.930 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.930 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136142+0000", 2024-04-18T21:07:07.930 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.033166432000000003 2024-04-18T21:07:07.930 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.930 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.930 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:07.930 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136207+0000", 2024-04-18T21:07:07.930 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.5032999999999999e-05 2024-04-18T21:07:07.930 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.930 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.930 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:07.930 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136248+0000", 2024-04-18T21:07:07.930 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.1202000000000003e-05 2024-04-18T21:07:07.930 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:07.931 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:07.931 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:07.931 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.931 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.931 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11731 4.39 4:9dcc5ecf:::1000000316e.00000000:head [write 3247277~11534 [2@1720266] in=11534b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:07.931 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.094419+0000", 2024-04-18T21:07:07.931 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 8.8001948429999999, 2024-04-18T21:07:07.931 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.042530119999999998, 2024-04-18T21:07:07.931 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:07.931 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:07.931 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.931 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:07.931 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:07.931 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:07.932 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11731 2024-04-18T21:07:07.932 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.932 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:07.932 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.932 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:07.932 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094419+0000", 2024-04-18T21:07:07.932 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:07.932 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.932 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.932 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:07.932 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094419+0000", 2024-04-18T21:07:07.932 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:07.932 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.932 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.933 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:07.933 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094420+0000", 2024-04-18T21:07:07.933 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.6400000000000003e-07 2024-04-18T21:07:07.933 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.933 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.933 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:07.933 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094429+0000", 2024-04-18T21:07:07.933 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.2359999999999993e-06 2024-04-18T21:07:07.933 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.933 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.933 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:07.933 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094433+0000", 2024-04-18T21:07:07.933 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.155e-06 2024-04-18T21:07:07.934 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.934 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.934 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.934 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094436+0000", 2024-04-18T21:07:07.934 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.0529999999999998e-06 2024-04-18T21:07:07.934 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.934 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.934 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:07.934 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.099720+0000", 2024-04-18T21:07:07.934 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0052837370000000002 2024-04-18T21:07:07.934 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.934 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.934 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:07.934 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.099793+0000", 2024-04-18T21:07:07.935 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.2959000000000004e-05 2024-04-18T21:07:07.935 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.935 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.935 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:07.935 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.099884+0000", 2024-04-18T21:07:07.935 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.1032999999999994e-05 2024-04-18T21:07:07.935 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.935 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.935 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:07.935 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.103177+0000", 2024-04-18T21:07:07.935 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0032935210000000002 2024-04-18T21:07:07.935 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.935 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.935 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.935 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136826+0000", 2024-04-18T21:07:07.936 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.033648521000000001 2024-04-18T21:07:07.936 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.936 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.936 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:07.936 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136896+0000", 2024-04-18T21:07:07.936 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0457000000000007e-05 2024-04-18T21:07:07.936 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.936 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.936 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:07.936 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136949+0000", 2024-04-18T21:07:07.936 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.2984e-05 2024-04-18T21:07:07.936 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:07.936 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:07.936 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:07.937 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.937 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.937 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11847 4.a 4:51f063b7:::100000032b5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:07.937 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.229180+0000", 2024-04-18T21:07:07.937 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 8.6654339839999999, 2024-04-18T21:07:07.937 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.048001033999999998, 2024-04-18T21:07:07.937 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:07.937 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:07.937 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.937 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:07.937 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:07.937 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:07.937 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11847 2024-04-18T21:07:07.937 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.938 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:07.938 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.938 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:07.938 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.229180+0000", 2024-04-18T21:07:07.938 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:07.938 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.938 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.938 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:07.938 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.229180+0000", 2024-04-18T21:07:07.938 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:07.938 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.938 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.938 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:07.938 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.229181+0000", 2024-04-18T21:07:07.939 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.119e-06 2024-04-18T21:07:07.939 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.939 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.939 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:07.939 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.235951+0000", 2024-04-18T21:07:07.939 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0067702370000000001 2024-04-18T21:07:07.939 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.939 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.939 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:07.939 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.235965+0000", 2024-04-18T21:07:07.939 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3202e-05 2024-04-18T21:07:07.939 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.939 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.939 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.940 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.235973+0000", 2024-04-18T21:07:07.940 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8630000000000008e-06 2024-04-18T21:07:07.940 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.940 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.940 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:07.940 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.236047+0000", 2024-04-18T21:07:07.940 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.4453e-05 2024-04-18T21:07:07.940 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.940 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.940 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:07.940 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.236137+0000", 2024-04-18T21:07:07.940 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.9751000000000002e-05 2024-04-18T21:07:07.940 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.940 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.940 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:07.941 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.236266+0000", 2024-04-18T21:07:07.941 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000129257 2024-04-18T21:07:07.941 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.941 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.941 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:07.941 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.244520+0000", 2024-04-18T21:07:07.941 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0082538190000000008 2024-04-18T21:07:07.941 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.941 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.941 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.941 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.277093+0000", 2024-04-18T21:07:07.941 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.032573405999999999 2024-04-18T21:07:07.941 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.941 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.941 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:07.942 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.277144+0000", 2024-04-18T21:07:07.942 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.0553000000000002e-05 2024-04-18T21:07:07.942 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.942 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.942 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:07.942 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.277181+0000", 2024-04-18T21:07:07.942 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.7373999999999998e-05 2024-04-18T21:07:07.942 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:07.942 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:07.942 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:07.942 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.942 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.942 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11949 4.2b 4:d50cc3c5:::100000031c6.00000000:head [write 0~3145728] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:07.942 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.338113+0000", 2024-04-18T21:07:07.943 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 8.5565011079999991, 2024-04-18T21:07:07.943 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.046907847000000003, 2024-04-18T21:07:07.943 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:07.943 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:07.943 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.943 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:07.943 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:07.943 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:07.943 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11949 2024-04-18T21:07:07.943 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.943 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:07.943 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.943 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:07.943 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.338113+0000", 2024-04-18T21:07:07.944 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:07.944 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.944 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.944 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:07.944 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.338113+0000", 2024-04-18T21:07:07.944 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:07.944 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.944 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.944 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:07.944 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.338115+0000", 2024-04-18T21:07:07.944 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5659999999999999e-06 2024-04-18T21:07:07.944 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.944 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.944 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:07.944 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344146+0000", 2024-04-18T21:07:07.944 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0060309339999999999 2024-04-18T21:07:07.945 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.945 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.945 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:07.945 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344163+0000", 2024-04-18T21:07:07.945 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6994999999999999e-05 2024-04-18T21:07:07.945 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.945 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.945 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.945 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344171+0000", 2024-04-18T21:07:07.945 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5520000000000005e-06 2024-04-18T21:07:07.945 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.945 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.945 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:07.945 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344604+0000", 2024-04-18T21:07:07.946 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00043326299999999997 2024-04-18T21:07:07.946 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.946 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.946 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:07.946 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344687+0000", 2024-04-18T21:07:07.946 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.2952000000000001e-05 2024-04-18T21:07:07.946 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.946 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.946 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:07.946 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344792+0000", 2024-04-18T21:07:07.946 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000104635 2024-04-18T21:07:07.946 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.946 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.946 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:07.947 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.361867+0000", 2024-04-18T21:07:07.947 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017075245999999999 2024-04-18T21:07:07.947 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.947 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.947 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.947 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.384879+0000", 2024-04-18T21:07:07.947 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023011474000000001 2024-04-18T21:07:07.947 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.947 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.947 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:07.947 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.384976+0000", 2024-04-18T21:07:07.947 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.7399999999999996e-05 2024-04-18T21:07:07.947 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.947 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.947 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:07.947 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.385021+0000", 2024-04-18T21:07:07.948 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.4830000000000003e-05 2024-04-18T21:07:07.948 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:07.948 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:07.948 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:07.948 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.948 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.948 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11988 4.0 4:01311cad:::1000000320a.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:07.948 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.384266+0000", 2024-04-18T21:07:07.948 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 8.5103476380000007, 2024-04-18T21:07:07.948 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.042482546000000003, 2024-04-18T21:07:07.948 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:07.948 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:07.948 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.948 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:07.948 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:07.948 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:07.949 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11988 2024-04-18T21:07:07.949 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.949 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:07.949 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.949 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:07.949 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.384266+0000", 2024-04-18T21:07:07.949 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:07.949 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.949 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.949 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:07.949 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.384266+0000", 2024-04-18T21:07:07.949 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:07.949 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.949 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.949 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:07.950 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.384268+0000", 2024-04-18T21:07:07.950 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.857e-06 2024-04-18T21:07:07.950 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.950 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.950 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:07.950 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.391524+0000", 2024-04-18T21:07:07.950 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0072557469999999999 2024-04-18T21:07:07.950 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.950 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.950 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:07.950 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.391546+0000", 2024-04-18T21:07:07.950 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1607000000000002e-05 2024-04-18T21:07:07.950 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.950 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.951 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.951 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.391559+0000", 2024-04-18T21:07:07.951 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3331e-05 2024-04-18T21:07:07.951 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.951 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.951 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:07.951 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.391639+0000", 2024-04-18T21:07:07.951 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.9511000000000005e-05 2024-04-18T21:07:07.951 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.951 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.951 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:07.951 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.391753+0000", 2024-04-18T21:07:07.951 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000114512 2024-04-18T21:07:07.951 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.951 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.951 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:07.952 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.391945+0000", 2024-04-18T21:07:07.952 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019234300000000001 2024-04-18T21:07:07.952 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.952 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.952 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:07.952 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.401085+0000", 2024-04-18T21:07:07.952 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0091394319999999994 2024-04-18T21:07:07.952 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.952 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.952 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.952 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.426658+0000", 2024-04-18T21:07:07.952 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.025573148 2024-04-18T21:07:07.952 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.952 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.952 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:07.953 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.426714+0000", 2024-04-18T21:07:07.953 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5937999999999999e-05 2024-04-18T21:07:07.953 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.953 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.953 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:07.953 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.426749+0000", 2024-04-18T21:07:07.953 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.5120000000000003e-05 2024-04-18T21:07:07.953 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:07.953 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:07.953 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:07.953 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.953 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.953 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:12041 4.38 4:1c8d9fef:::100000033ed.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:07.953 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.446812+0000", 2024-04-18T21:07:07.953 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 8.4478018670000008, 2024-04-18T21:07:07.954 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.044749606999999997, 2024-04-18T21:07:07.954 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:07.954 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:07.954 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.954 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:07.954 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:07.954 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:07.954 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 12041 2024-04-18T21:07:07.954 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.954 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:07.954 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.954 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:07.954 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.446812+0000", 2024-04-18T21:07:07.955 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:07.955 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.955 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.955 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:07.955 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.446812+0000", 2024-04-18T21:07:07.955 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:07.955 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.955 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.955 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:07.955 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.446814+0000", 2024-04-18T21:07:07.955 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5099999999999999e-06 2024-04-18T21:07:07.955 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.955 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.955 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:07.955 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.452583+0000", 2024-04-18T21:07:07.956 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0057696379999999997 2024-04-18T21:07:07.956 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.956 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.956 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:07.956 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.452599+0000", 2024-04-18T21:07:07.956 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5701000000000001e-05 2024-04-18T21:07:07.956 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.956 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.956 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.956 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.452607+0000", 2024-04-18T21:07:07.956 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.7100000000000007e-06 2024-04-18T21:07:07.956 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.956 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.956 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:07.956 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.452718+0000", 2024-04-18T21:07:07.957 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000111257 2024-04-18T21:07:07.957 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.957 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.957 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:07.957 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.452924+0000", 2024-04-18T21:07:07.957 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000206066 2024-04-18T21:07:07.957 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.957 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.957 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:07.957 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.453088+0000", 2024-04-18T21:07:07.957 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016336700000000001 2024-04-18T21:07:07.957 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.957 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.957 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:07.957 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.469818+0000", 2024-04-18T21:07:07.957 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016730248999999999 2024-04-18T21:07:07.958 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.958 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.958 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.958 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.491505+0000", 2024-04-18T21:07:07.958 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021687366 2024-04-18T21:07:07.958 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.958 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.958 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:07.958 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.491537+0000", 2024-04-18T21:07:07.958 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.1888999999999999e-05 2024-04-18T21:07:07.958 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.958 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.958 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:07.959 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.491562+0000", 2024-04-18T21:07:07.959 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.4854e-05 2024-04-18T21:07:07.959 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:07.959 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:07.959 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:07.959 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.959 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.959 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:12228 4.16 4:6a8d8629:::100000033d5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:07.959 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.681634+0000", 2024-04-18T21:07:07.959 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 8.2129796390000003, 2024-04-18T21:07:07.959 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043430791000000003, 2024-04-18T21:07:07.959 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:07.959 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:07.959 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.959 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:07.960 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:07.960 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:07.960 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 12228 2024-04-18T21:07:07.960 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.960 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:07.960 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.960 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:07.960 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.681634+0000", 2024-04-18T21:07:07.960 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:07.960 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.960 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.960 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:07.960 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.681634+0000", 2024-04-18T21:07:07.960 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:07.961 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.961 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.961 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:07.961 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.681637+0000", 2024-04-18T21:07:07.961 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.418e-06 2024-04-18T21:07:07.961 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.961 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.961 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:07.961 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.688982+0000", 2024-04-18T21:07:07.961 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0073447870000000002 2024-04-18T21:07:07.961 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.961 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.961 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:07.961 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.688998+0000", 2024-04-18T21:07:07.961 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6330000000000001e-05 2024-04-18T21:07:07.961 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.962 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.962 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.962 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.689009+0000", 2024-04-18T21:07:07.962 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1236999999999999e-05 2024-04-18T21:07:07.962 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.962 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.962 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:07.962 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.689083+0000", 2024-04-18T21:07:07.962 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3415000000000001e-05 2024-04-18T21:07:07.962 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.962 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.962 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:07.962 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.689237+0000", 2024-04-18T21:07:07.962 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00015420899999999999 2024-04-18T21:07:07.963 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.963 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.963 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:07.963 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.689419+0000", 2024-04-18T21:07:07.963 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018242099999999999 2024-04-18T21:07:07.963 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.963 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.963 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:07.963 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.711630+0000", 2024-04-18T21:07:07.963 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.022210475 2024-04-18T21:07:07.963 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.963 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.963 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.963 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.724956+0000", 2024-04-18T21:07:07.963 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013325887999999999 2024-04-18T21:07:07.963 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.964 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.964 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:07.964 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.725019+0000", 2024-04-18T21:07:07.964 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.3757999999999995e-05 2024-04-18T21:07:07.964 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.964 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.964 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:07.964 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.725065+0000", 2024-04-18T21:07:07.964 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.5853000000000003e-05 2024-04-18T21:07:07.964 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:07.964 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:07.964 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:07.964 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.964 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.965 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_repop(client.4534.0:12689 4.26 e58/16 4:64a7f444:::100000033e5.00000000:head v 58'205, mlcod=58'203)", 2024-04-18T21:07:07.965 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:00.217785+0000", 2024-04-18T21:07:07.965 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 7.6768290720000003, 2024-04-18T21:07:07.965 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.052245469000000003, 2024-04-18T21:07:07.965 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:07.965 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:07.965 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.965 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:07.965 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.965 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:07.965 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.217785+0000", 2024-04-18T21:07:07.965 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:07.965 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.965 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.965 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:07.965 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.217785+0000", 2024-04-18T21:07:07.965 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:07.966 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.966 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.966 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:07.966 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.217786+0000", 2024-04-18T21:07:07.966 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6700000000000002e-07 2024-04-18T21:07:07.966 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.966 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.966 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:07.966 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225111+0000", 2024-04-18T21:07:07.966 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0073251119999999999 2024-04-18T21:07:07.966 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.966 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.966 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:07.966 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225126+0000", 2024-04-18T21:07:07.967 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.541e-05 2024-04-18T21:07:07.967 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.967 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.967 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.967 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225137+0000", 2024-04-18T21:07:07.967 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0890000000000001e-05 2024-04-18T21:07:07.967 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.967 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.967 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:07.967 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225244+0000", 2024-04-18T21:07:07.967 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000106555 2024-04-18T21:07:07.967 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.967 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.967 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:07.967 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225276+0000", 2024-04-18T21:07:07.968 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.2574999999999999e-05 2024-04-18T21:07:07.968 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.968 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.968 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:07.968 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.269985+0000", 2024-04-18T21:07:07.968 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.044708422999999997 2024-04-18T21:07:07.968 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.968 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.968 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:07.968 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.270031+0000", 2024-04-18T21:07:07.968 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.5636999999999997e-05 2024-04-18T21:07:07.968 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:07.968 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:07.968 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:07.968 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.968 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.968 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:12692 4.3a 4:5c788ec1:::100000032ff.00000000:head [write 0~4194304 [2@945974]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:07.969 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:00.225134+0000", 2024-04-18T21:07:07.969 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 7.6694800169999997, 2024-04-18T21:07:07.969 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.048311640000000003, 2024-04-18T21:07:07.969 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:07.969 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:07.969 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.969 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:07.969 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:07.969 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:07.969 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 12692 2024-04-18T21:07:07.969 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.969 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:07.969 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.969 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:07.969 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225134+0000", 2024-04-18T21:07:07.970 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:07.970 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.970 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.970 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:07.970 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225134+0000", 2024-04-18T21:07:07.970 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:07.970 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.970 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.970 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:07.970 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225136+0000", 2024-04-18T21:07:07.970 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4160000000000001e-06 2024-04-18T21:07:07.970 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.970 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.970 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:07.970 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231408+0000", 2024-04-18T21:07:07.971 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.006272517 2024-04-18T21:07:07.971 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.971 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.971 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:07.971 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231437+0000", 2024-04-18T21:07:07.971 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.9119e-05 2024-04-18T21:07:07.971 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.971 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.971 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.971 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231456+0000", 2024-04-18T21:07:07.971 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8544999999999999e-05 2024-04-18T21:07:07.971 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.971 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.971 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:07.972 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231579+0000", 2024-04-18T21:07:07.972 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000123762 2024-04-18T21:07:07.972 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.972 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.972 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:07.972 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231690+0000", 2024-04-18T21:07:07.972 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000110349 2024-04-18T21:07:07.972 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.972 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.972 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:07.972 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231903+0000", 2024-04-18T21:07:07.972 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000212695 2024-04-18T21:07:07.972 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.972 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.972 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.973 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.253911+0000", 2024-04-18T21:07:07.973 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.022008706999999999 2024-04-18T21:07:07.973 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.973 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.973 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:07.973 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.273383+0000", 2024-04-18T21:07:07.973 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019471568000000002 2024-04-18T21:07:07.973 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.973 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.973 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:07.973 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.273418+0000", 2024-04-18T21:07:07.973 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.5265999999999997e-05 2024-04-18T21:07:07.973 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.973 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.973 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:07.973 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.273446+0000", 2024-04-18T21:07:07.974 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7696e-05 2024-04-18T21:07:07.974 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:07.974 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:07.974 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:07.974 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.974 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.974 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:12693 4.2b 4:d71e94ee:::10000003509.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:07.974 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:00.231503+0000", 2024-04-18T21:07:07.974 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 7.6631112330000004, 2024-04-18T21:07:07.974 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.042620511999999999, 2024-04-18T21:07:07.974 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:07.974 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:07.974 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.975 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:07.975 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:07.975 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:07.975 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 12693 2024-04-18T21:07:07.975 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.975 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:07.975 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.975 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:07.975 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231503+0000", 2024-04-18T21:07:07.975 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:07.975 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.975 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.975 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:07.975 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231503+0000", 2024-04-18T21:07:07.975 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:07.975 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.976 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.976 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:07.976 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231505+0000", 2024-04-18T21:07:07.976 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9530000000000002e-06 2024-04-18T21:07:07.976 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.976 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.976 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:07.976 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.238278+0000", 2024-04-18T21:07:07.976 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0067732269999999997 2024-04-18T21:07:07.976 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.976 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.976 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:07.976 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.238295+0000", 2024-04-18T21:07:07.976 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7268000000000001e-05 2024-04-18T21:07:07.976 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.977 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.977 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.977 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.238303+0000", 2024-04-18T21:07:07.977 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.1559999999999995e-06 2024-04-18T21:07:07.977 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.977 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.977 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:07.977 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.238370+0000", 2024-04-18T21:07:07.977 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.6959999999999996e-05 2024-04-18T21:07:07.977 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.977 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.977 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:07.977 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.238569+0000", 2024-04-18T21:07:07.977 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000198242 2024-04-18T21:07:07.977 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.977 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.977 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:07.978 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.238840+0000", 2024-04-18T21:07:07.978 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00027115 2024-04-18T21:07:07.978 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.978 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.978 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.978 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.268210+0000", 2024-04-18T21:07:07.978 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.029370216000000001 2024-04-18T21:07:07.978 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.978 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.978 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:07.978 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.274023+0000", 2024-04-18T21:07:07.978 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0058133009999999999 2024-04-18T21:07:07.978 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.978 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.978 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:07.979 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.274064+0000", 2024-04-18T21:07:07.979 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.0157000000000002e-05 2024-04-18T21:07:07.979 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.979 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.979 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:07.979 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.274123+0000", 2024-04-18T21:07:07.979 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.9882e-05 2024-04-18T21:07:07.979 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:07.979 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:07.979 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:07.979 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.979 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.979 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:15008 4.2b 4:d5496710:::100000033cf.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-18T21:07:07.979 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:02.998996+0000", 2024-04-18T21:07:07.979 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 4.8956179559999997, 2024-04-18T21:07:07.980 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.042584729000000002, 2024-04-18T21:07:07.980 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:07.980 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:07.980 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.980 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:07.980 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:07.980 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:07.980 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 15008 2024-04-18T21:07:07.980 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.980 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:07.980 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.980 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:07.980 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:02.998996+0000", 2024-04-18T21:07:07.980 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:07.980 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.980 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.981 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:07.981 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:02.998996+0000", 2024-04-18T21:07:07.981 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:07.981 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.981 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.981 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:07.981 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:02.998997+0000", 2024-04-18T21:07:07.981 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.4000000000000001e-07 2024-04-18T21:07:07.981 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.981 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.981 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:07.981 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.005534+0000", 2024-04-18T21:07:07.981 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0065367339999999998 2024-04-18T21:07:07.981 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.981 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.981 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:07.981 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.005562+0000", 2024-04-18T21:07:07.982 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8861999999999999e-05 2024-04-18T21:07:07.982 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.982 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.982 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.982 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.005582+0000", 2024-04-18T21:07:07.982 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9987e-05 2024-04-18T21:07:07.982 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.982 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.982 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:07.982 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.005659+0000", 2024-04-18T21:07:07.982 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.6570999999999996e-05 2024-04-18T21:07:07.982 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.982 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.982 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:07.982 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.005841+0000", 2024-04-18T21:07:07.983 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018223600000000001 2024-04-18T21:07:07.983 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.983 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.983 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:07.983 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.005976+0000", 2024-04-18T21:07:07.983 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000135165 2024-04-18T21:07:07.983 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.983 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.983 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:07.983 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.015878+0000", 2024-04-18T21:07:07.983 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0099018390000000008 2024-04-18T21:07:07.983 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.983 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.983 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.983 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.041515+0000", 2024-04-18T21:07:07.984 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.025636982999999999 2024-04-18T21:07:07.984 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.984 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.984 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:07.984 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.041554+0000", 2024-04-18T21:07:07.984 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.8679e-05 2024-04-18T21:07:07.984 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.984 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.984 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:07.984 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.041581+0000", 2024-04-18T21:07:07.984 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7033e-05 2024-04-18T21:07:07.984 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:07.984 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:07.984 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:07.984 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.984 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.985 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:15085 4.20 4:04677f23:::100000034fe.00000000:head [write 0~4194304 [2@471250]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-18T21:07:07.985 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:03.092507+0000", 2024-04-18T21:07:07.985 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 4.8021075030000002, 2024-04-18T21:07:07.985 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.042978905999999997, 2024-04-18T21:07:07.985 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:07.985 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:07.985 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.985 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:07.985 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:07.985 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:07.985 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 15085 2024-04-18T21:07:07.985 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.985 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:07.985 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.986 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:07.986 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.092507+0000", 2024-04-18T21:07:07.986 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:07.986 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.986 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.986 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:07.986 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.092507+0000", 2024-04-18T21:07:07.986 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:07.986 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.986 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.986 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:07.986 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.092507+0000", 2024-04-18T21:07:07.986 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8299999999999996e-07 2024-04-18T21:07:07.986 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.986 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.987 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:07.987 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.099434+0000", 2024-04-18T21:07:07.987 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.006926176 2024-04-18T21:07:07.987 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.987 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.987 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:07.987 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.099451+0000", 2024-04-18T21:07:07.987 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7733000000000001e-05 2024-04-18T21:07:07.987 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.987 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.987 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.987 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.099460+0000", 2024-04-18T21:07:07.987 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5990000000000002e-06 2024-04-18T21:07:07.987 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.987 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.988 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:07.988 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.099519+0000", 2024-04-18T21:07:07.988 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.9106e-05 2024-04-18T21:07:07.988 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.988 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.988 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:07.988 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.099637+0000", 2024-04-18T21:07:07.988 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000117917 2024-04-18T21:07:07.988 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.988 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.988 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:07.988 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.099893+0000", 2024-04-18T21:07:07.988 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00025568800000000001 2024-04-18T21:07:07.988 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.988 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.988 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:07.989 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.125269+0000", 2024-04-18T21:07:07.989 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.025376177999999999 2024-04-18T21:07:07.989 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.989 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.989 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.989 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.135427+0000", 2024-04-18T21:07:07.989 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010158149 2024-04-18T21:07:07.989 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.989 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.989 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:07.989 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.135461+0000", 2024-04-18T21:07:07.989 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.4440999999999998e-05 2024-04-18T21:07:07.989 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.989 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.989 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:07.989 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.135486+0000", 2024-04-18T21:07:07.990 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.4136000000000001e-05 2024-04-18T21:07:07.990 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:07.990 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:07.990 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:07.990 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.990 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.990 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:15094 4.c 4:32870457:::10000003692.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-18T21:07:07.990 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:03.107374+0000", 2024-04-18T21:07:07.990 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 4.7872396930000001, 2024-04-18T21:07:07.990 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.061575983000000001, 2024-04-18T21:07:07.990 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:07.990 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:07.990 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.990 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:07.990 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:07.991 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:07.991 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 15094 2024-04-18T21:07:07.991 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.991 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:07.991 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.991 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:07.991 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.107374+0000", 2024-04-18T21:07:07.991 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:07.991 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.991 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.991 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:07.991 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.107374+0000", 2024-04-18T21:07:07.991 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:07.991 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.991 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.991 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:07.992 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.107376+0000", 2024-04-18T21:07:07.992 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3969999999999999e-06 2024-04-18T21:07:07.992 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.992 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.992 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:07.992 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115698+0000", 2024-04-18T21:07:07.992 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0083223989999999994 2024-04-18T21:07:07.992 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.992 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.992 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:07.992 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115713+0000", 2024-04-18T21:07:07.992 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4385e-05 2024-04-18T21:07:07.992 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.992 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.992 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.992 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115722+0000", 2024-04-18T21:07:07.992 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0759999999999992e-06 2024-04-18T21:07:07.993 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.993 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.993 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:07.993 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115784+0000", 2024-04-18T21:07:07.993 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.2348999999999995e-05 2024-04-18T21:07:07.993 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.993 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.993 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:07.993 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115849+0000", 2024-04-18T21:07:07.993 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.4964999999999999e-05 2024-04-18T21:07:07.993 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.993 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.993 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:07.993 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.116054+0000", 2024-04-18T21:07:07.993 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020483400000000001 2024-04-18T21:07:07.994 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.994 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.994 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:07.994 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.125769+0000", 2024-04-18T21:07:07.994 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0097153340000000008 2024-04-18T21:07:07.994 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.994 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.994 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.994 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.168834+0000", 2024-04-18T21:07:07.994 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043064527999999998 2024-04-18T21:07:07.994 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.994 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.994 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:07.994 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.168882+0000", 2024-04-18T21:07:07.994 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.7919e-05 2024-04-18T21:07:07.994 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.995 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.995 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:07.995 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.168950+0000", 2024-04-18T21:07:07.995 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.8796999999999999e-05 2024-04-18T21:07:07.995 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:07.995 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:07.995 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:07.995 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.995 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.995 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:15133 4.38 4:1c73eb83:::1000000398c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-18T21:07:07.995 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:03.155031+0000", 2024-04-18T21:07:07.995 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 4.7395831519999998, 2024-04-18T21:07:07.995 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.044078787000000001, 2024-04-18T21:07:07.995 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:07.995 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:07.995 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:07.996 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:07.996 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:07.996 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:07.996 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 15133 2024-04-18T21:07:07.996 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.996 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:07.996 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.996 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:07.996 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.155031+0000", 2024-04-18T21:07:07.996 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:07.996 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.996 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.996 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:07.996 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.155031+0000", 2024-04-18T21:07:07.996 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:07.997 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.997 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.997 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:07.997 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.155033+0000", 2024-04-18T21:07:07.997 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.84e-06 2024-04-18T21:07:07.997 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.997 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.997 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:07.997 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.161994+0000", 2024-04-18T21:07:07.997 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0069607779999999999 2024-04-18T21:07:07.997 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.997 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.997 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:07.997 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.162008+0000", 2024-04-18T21:07:07.997 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4399000000000001e-05 2024-04-18T21:07:07.998 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.998 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.998 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:07.998 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.162018+0000", 2024-04-18T21:07:07.998 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.7149999999999993e-06 2024-04-18T21:07:07.998 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.998 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.998 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:07.998 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.162073+0000", 2024-04-18T21:07:07.998 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4803999999999999e-05 2024-04-18T21:07:07.998 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.998 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.998 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:07.998 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.162215+0000", 2024-04-18T21:07:07.999 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014222900000000001 2024-04-18T21:07:07.999 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.999 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.999 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:07.999 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.162341+0000", 2024-04-18T21:07:07.999 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012579400000000001 2024-04-18T21:07:07.999 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.999 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.999 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:07.999 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.169445+0000", 2024-04-18T21:07:07.999 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0071040360000000002 2024-04-18T21:07:07.999 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:07.999 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:07.999 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:07.999 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.199046+0000", 2024-04-18T21:07:08.000 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.029601639999999999 2024-04-18T21:07:08.000 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:08.000 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:08.000 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:08.000 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.199082+0000", 2024-04-18T21:07:08.000 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.6134999999999999e-05 2024-04-18T21:07:08.000 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:08.000 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:08.000 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:08.000 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.199110+0000", 2024-04-18T21:07:08.000 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7416999999999999e-05 2024-04-18T21:07:08.000 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:08.000 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:08.000 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:08.001 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:08.001 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:08.001 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:07:08.002 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:07:08.002 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:08.001+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:08.103 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:08.105+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:08.137 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:07:08.137 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:07:08.138 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-04-18T21:07:08.138 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:07:08.152 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:07:08.204 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:08.202+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:08.279 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:07:08.279 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:07:08.279 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-18T21:07:08.279 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-18T21:07:08.279 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:07:08.295 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:08.304 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:08.305+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:08.405 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:08.405+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:08.466 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:07:08.467 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-18T21:07:08.467 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-18T21:07:08.467 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:07:08.467 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.467 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:08.467 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:07:08.467 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 122.849758455, 2024-04-18T21:07:08.467 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045668994999999997, 2024-04-18T21:07:08.467 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:08.467 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:08.467 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:08.467 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:08.468 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.468 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:08.468 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:07:08.468 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:08.468 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.468 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.468 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:08.468 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:07:08.468 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:08.468 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.468 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.468 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:08.468 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615459+0000", 2024-04-18T21:07:08.469 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5030000000000001e-06 2024-04-18T21:07:08.469 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.469 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.469 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:08.469 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615506+0000", 2024-04-18T21:07:08.469 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6872000000000001e-05 2024-04-18T21:07:08.469 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.469 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.469 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:08.469 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615527+0000", 2024-04-18T21:07:08.469 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0763000000000001e-05 2024-04-18T21:07:08.469 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.470 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.470 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:08.470 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615551+0000", 2024-04-18T21:07:08.470 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4159e-05 2024-04-18T21:07:08.470 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.470 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.470 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:08.470 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615736+0000", 2024-04-18T21:07:08.470 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018499599999999999 2024-04-18T21:07:08.470 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.470 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.470 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:07:08.470 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615748+0000", 2024-04-18T21:07:08.470 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2272999999999999e-05 2024-04-18T21:07:08.471 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.471 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.471 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:08.471 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635481+0000", 2024-04-18T21:07:08.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019732772999999999 2024-04-18T21:07:08.471 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.471 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.471 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:08.471 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635791+0000", 2024-04-18T21:07:08.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031013299999999998 2024-04-18T21:07:08.471 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.471 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.471 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:08.472 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636101+0000", 2024-04-18T21:07:08.472 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030943300000000002 2024-04-18T21:07:08.472 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.472 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.472 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:08.472 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646043+0000", 2024-04-18T21:07:08.472 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099428139999999995 2024-04-18T21:07:08.472 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.472 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.472 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:08.472 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660991+0000", 2024-04-18T21:07:08.472 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014947142 2024-04-18T21:07:08.472 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.473 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:08.473 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661061+0000", 2024-04-18T21:07:08.473 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0438000000000006e-05 2024-04-18T21:07:08.473 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.473 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:08.473 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661127+0000", 2024-04-18T21:07:08.473 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5696000000000003e-05 2024-04-18T21:07:08.473 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:08.473 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:08.473 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:08.473 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.474 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:08.474 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:07:08.474 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 122.849546027, 2024-04-18T21:07:08.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045745085999999997, 2024-04-18T21:07:08.474 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:08.474 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:08.474 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:08.474 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:08.474 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.474 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:08.474 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:07:08.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:08.474 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.474 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.475 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:08.475 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:07:08.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:08.475 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.475 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:08.475 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:07:08.599 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7400000000000001e-06 2024-04-18T21:07:08.599 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.599 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.599 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:08.599 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:07:08.599 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8133e-05 2024-04-18T21:07:08.599 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.599 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.599 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:08.599 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615726+0000", 2024-04-18T21:07:08.599 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6132e-05 2024-04-18T21:07:08.600 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.600 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.600 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:08.600 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615742+0000", 2024-04-18T21:07:08.600 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6157000000000001e-05 2024-04-18T21:07:08.600 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.600 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.600 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:08.601 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615937+0000", 2024-04-18T21:07:08.601 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000194768 2024-04-18T21:07:08.601 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.601 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.601 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:07:08.601 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615950+0000", 2024-04-18T21:07:08.601 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3084e-05 2024-04-18T21:07:08.601 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.602 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.602 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:08.602 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643676+0000", 2024-04-18T21:07:08.602 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027725639999999999 2024-04-18T21:07:08.602 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.602 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.602 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:08.602 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643867+0000", 2024-04-18T21:07:08.602 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019075900000000001 2024-04-18T21:07:08.602 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.603 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.603 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:08.603 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:07:08.603 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036013799999999997 2024-04-18T21:07:08.603 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.603 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.603 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:08.603 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646068+0000", 2024-04-18T21:07:08.603 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001841536 2024-04-18T21:07:08.603 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.603 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.603 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:08.603 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661184+0000", 2024-04-18T21:07:08.604 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015115458999999999 2024-04-18T21:07:08.604 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.604 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.604 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:08.604 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661283+0000", 2024-04-18T21:07:08.604 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9502999999999999e-05 2024-04-18T21:07:08.604 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.604 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.604 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:08.604 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661415+0000", 2024-04-18T21:07:08.605 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000132037 2024-04-18T21:07:08.605 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:08.605 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:08.605 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:08.605 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.605 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.605 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:101 3.1f 3:f83d65d8:::200.00000004:head [write 316455~1401 [fadvise_dontneed] in=1401b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:08.606 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:07:08.606 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.707482416000001, 2024-04-18T21:07:08.606 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.048270212999999999, 2024-04-18T21:07:08.606 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:08.606 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:08.606 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:08.606 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:08.606 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.606 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:08.606 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:07:08.606 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:08.607 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.607 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.607 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:08.607 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:07:08.607 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:08.607 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.607 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.607 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:08.607 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:07:08.607 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7700000000000004e-07 2024-04-18T21:07:08.608 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.608 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.608 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:08.608 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757745+0000", 2024-04-18T21:07:08.608 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0910000000000001e-05 2024-04-18T21:07:08.608 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.608 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.608 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:08.608 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757758+0000", 2024-04-18T21:07:08.609 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2593e-05 2024-04-18T21:07:08.609 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.609 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.609 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:08.609 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757765+0000", 2024-04-18T21:07:08.609 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1659999999999997e-06 2024-04-18T21:07:08.609 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.609 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.610 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:08.610 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.797782+0000", 2024-04-18T21:07:08.610 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.040017283000000001 2024-04-18T21:07:08.610 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.610 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.610 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:08.610 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.797949+0000", 2024-04-18T21:07:08.610 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016650399999999999 2024-04-18T21:07:08.611 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.611 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.611 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:08.611 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.798152+0000", 2024-04-18T21:07:08.611 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000203098 2024-04-18T21:07:08.611 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.611 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.611 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:08.612 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.800792+0000", 2024-04-18T21:07:08.612 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026394779999999998 2024-04-18T21:07:08.612 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.612 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.612 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:08.612 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805921+0000", 2024-04-18T21:07:08.612 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0051295519999999999 2024-04-18T21:07:08.612 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.612 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.612 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:08.612 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805967+0000", 2024-04-18T21:07:08.612 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5457000000000002e-05 2024-04-18T21:07:08.613 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.613 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.613 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:08.613 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806004+0000", 2024-04-18T21:07:08.613 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7494999999999999e-05 2024-04-18T21:07:08.613 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:08.613 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:08.613 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:08.613 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.613 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.613 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:102 3.1f 3:f83d65d8:::200.00000004:head [write 317856~1403 [fadvise_dontneed] in=1403b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:08.613 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757775+0000", 2024-04-18T21:07:08.613 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.70744135, 2024-04-18T21:07:08.614 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.048337705000000002, 2024-04-18T21:07:08.614 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:08.614 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:08.614 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:08.614 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:08.614 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.614 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:08.614 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757775+0000", 2024-04-18T21:07:08.614 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:08.615 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.615 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.615 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:08.615 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757775+0000", 2024-04-18T21:07:08.615 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:08.615 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.615 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.615 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:08.615 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757776+0000", 2024-04-18T21:07:08.615 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5300000000000004e-07 2024-04-18T21:07:08.615 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.616 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.616 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:08.616 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757780+0000", 2024-04-18T21:07:08.616 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2270000000000004e-06 2024-04-18T21:07:08.616 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.616 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.616 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:08.616 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757792+0000", 2024-04-18T21:07:08.616 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2696e-05 2024-04-18T21:07:08.617 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.617 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.617 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:08.617 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757800+0000", 2024-04-18T21:07:08.617 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1439999999999997e-06 2024-04-18T21:07:08.617 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.617 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.617 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:08.618 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.798773+0000", 2024-04-18T21:07:08.618 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.040973074999999998 2024-04-18T21:07:08.618 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.618 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.618 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:08.618 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.798990+0000", 2024-04-18T21:07:08.618 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000217161 2024-04-18T21:07:08.618 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.619 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.619 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:08.619 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.799173+0000", 2024-04-18T21:07:08.619 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018295900000000001 2024-04-18T21:07:08.619 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.619 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.619 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:08.621 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802469+0000", 2024-04-18T21:07:08.621 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032965350000000002 2024-04-18T21:07:08.621 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.621 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.621 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:08.621 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806042+0000", 2024-04-18T21:07:08.621 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035724630000000001 2024-04-18T21:07:08.621 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.622 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.622 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:08.622 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806077+0000", 2024-04-18T21:07:08.622 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4997999999999999e-05 2024-04-18T21:07:08.622 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.622 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.623 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:08.623 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806113+0000", 2024-04-18T21:07:08.623 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5794000000000003e-05 2024-04-18T21:07:08.623 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:08.623 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:08.623 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:08.623 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.623 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.623 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:103 3.1f 3:f83d65d8:::200.00000004:head [write 319259~1404 [fadvise_dontneed] in=1404b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:08.623 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:07:08.623 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.707407503999999, 2024-04-18T21:07:08.624 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.048414481000000002, 2024-04-18T21:07:08.624 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:08.624 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:08.624 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:08.624 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:08.624 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.624 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:08.624 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:07:08.624 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:08.624 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.624 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.624 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:08.625 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:07:08.625 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:08.625 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.625 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.625 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:08.625 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:07:08.625 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4700000000000001e-07 2024-04-18T21:07:08.625 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.625 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.626 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:08.626 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757814+0000", 2024-04-18T21:07:08.626 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1829999999999996e-06 2024-04-18T21:07:08.626 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.626 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.626 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:08.626 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757825+0000", 2024-04-18T21:07:08.626 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1754e-05 2024-04-18T21:07:08.626 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.626 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.627 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:08.627 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757832+0000", 2024-04-18T21:07:08.627 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8430000000000004e-06 2024-04-18T21:07:08.627 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.627 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.627 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:08.627 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.799809+0000", 2024-04-18T21:07:08.627 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.041976960000000001 2024-04-18T21:07:08.628 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.628 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.628 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:08.628 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.799934+0000", 2024-04-18T21:07:08.628 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000125053 2024-04-18T21:07:08.628 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.628 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.628 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:08.628 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.800067+0000", 2024-04-18T21:07:08.629 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013276299999999999 2024-04-18T21:07:08.629 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.629 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.629 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:08.629 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804582+0000", 2024-04-18T21:07:08.629 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0045148899999999997 2024-04-18T21:07:08.629 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.629 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.629 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:08.630 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806158+0000", 2024-04-18T21:07:08.630 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001575894 2024-04-18T21:07:08.630 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.630 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.630 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:08.630 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806189+0000", 2024-04-18T21:07:08.630 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1423000000000001e-05 2024-04-18T21:07:08.630 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.631 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.631 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:08.631 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806223+0000", 2024-04-18T21:07:08.631 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4071e-05 2024-04-18T21:07:08.631 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:08.631 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:08.631 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:08.631 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.631 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.631 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:104 3.1f 3:f83d65d8:::200.00000004:head [write 320663~1405 [fadvise_dontneed] in=1405b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:08.631 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757841+0000", 2024-04-18T21:07:08.632 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.707375299999999, 2024-04-18T21:07:08.632 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056381623999999998, 2024-04-18T21:07:08.632 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:08.632 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:08.632 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:08.632 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:08.632 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.633 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:08.633 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757841+0000", 2024-04-18T21:07:08.633 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:08.633 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.633 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.633 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:08.633 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757841+0000", 2024-04-18T21:07:08.633 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:08.634 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.634 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.634 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:08.634 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757842+0000", 2024-04-18T21:07:08.634 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5000000000000002e-07 2024-04-18T21:07:08.634 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.634 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.634 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:08.634 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757852+0000", 2024-04-18T21:07:08.635 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.084e-05 2024-04-18T21:07:08.635 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.635 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.635 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:08.635 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757865+0000", 2024-04-18T21:07:08.635 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2643000000000001e-05 2024-04-18T21:07:08.635 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.635 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.635 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:08.635 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757872+0000", 2024-04-18T21:07:08.636 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8689999999999998e-06 2024-04-18T21:07:08.636 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.636 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.636 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:08.636 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.801102+0000", 2024-04-18T21:07:08.636 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043229837 2024-04-18T21:07:08.636 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.636 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.637 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:08.637 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.801291+0000", 2024-04-18T21:07:08.637 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000189641 2024-04-18T21:07:08.637 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.637 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.637 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:08.637 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.801640+0000", 2024-04-18T21:07:08.637 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000348971 2024-04-18T21:07:08.637 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.638 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.638 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:08.638 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805849+0000", 2024-04-18T21:07:08.638 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042082739999999997 2024-04-18T21:07:08.638 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.638 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.638 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:08.638 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814135+0000", 2024-04-18T21:07:08.639 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0082867270000000007 2024-04-18T21:07:08.639 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.639 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.639 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:08.639 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814180+0000", 2024-04-18T21:07:08.639 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4982999999999999e-05 2024-04-18T21:07:08.640 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.640 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.640 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:08.640 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814223+0000", 2024-04-18T21:07:08.640 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2188999999999999e-05 2024-04-18T21:07:08.640 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:08.640 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:08.640 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:08.640 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.641 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.641 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:105 3.1f 3:f83d65d8:::200.00000004:head [write 322068~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:08.641 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:07:08.641 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.707334704000001, 2024-04-18T21:07:08.641 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056513678999999997, 2024-04-18T21:07:08.641 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:08.641 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:08.641 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:08.641 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:08.641 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.642 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:08.642 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:07:08.642 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:08.642 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.642 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.642 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:08.642 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:07:08.642 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:08.642 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.642 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.643 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:08.643 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:07:08.643 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2600000000000002e-07 2024-04-18T21:07:08.643 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.643 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.643 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:08.643 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757888+0000", 2024-04-18T21:07:08.643 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7130000000000002e-06 2024-04-18T21:07:08.644 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.644 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.644 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:08.644 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757906+0000", 2024-04-18T21:07:08.644 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7723999999999998e-05 2024-04-18T21:07:08.644 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.644 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.644 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:08.645 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757921+0000", 2024-04-18T21:07:08.645 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4936000000000001e-05 2024-04-18T21:07:08.645 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.645 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.645 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:08.645 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802493+0000", 2024-04-18T21:07:08.645 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.044571927999999997 2024-04-18T21:07:08.645 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.646 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.646 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:08.646 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802537+0000", 2024-04-18T21:07:08.646 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4449000000000001e-05 2024-04-18T21:07:08.646 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.646 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.646 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:08.646 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802605+0000", 2024-04-18T21:07:08.647 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7945000000000001e-05 2024-04-18T21:07:08.647 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.647 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.647 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:08.647 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805852+0000", 2024-04-18T21:07:08.647 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032469909999999999 2024-04-18T21:07:08.647 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.648 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.648 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:08.648 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814298+0000", 2024-04-18T21:07:08.648 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084463309999999996 2024-04-18T21:07:08.648 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.648 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.648 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:08.648 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814355+0000", 2024-04-18T21:07:08.649 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6459999999999998e-05 2024-04-18T21:07:08.649 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.649 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.649 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:08.649 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814395+0000", 2024-04-18T21:07:08.649 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0475999999999997e-05 2024-04-18T21:07:08.649 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:08.649 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:08.649 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:08.650 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.650 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.650 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:106 3.1f 3:f83d65d8:::200.00000004:head [write 323467~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:08.650 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757955+0000", 2024-04-18T21:07:08.650 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.707261474999999, 2024-04-18T21:07:08.650 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056539990999999998, 2024-04-18T21:07:08.650 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:08.651 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:08.651 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:08.651 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:08.651 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.651 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:08.651 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757955+0000", 2024-04-18T21:07:08.651 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:08.651 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.651 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.652 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:08.652 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757955+0000", 2024-04-18T21:07:08.652 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:08.652 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.652 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.652 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:08.652 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757956+0000", 2024-04-18T21:07:08.652 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.144e-06 2024-04-18T21:07:08.653 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.653 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.653 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:08.653 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757970+0000", 2024-04-18T21:07:08.653 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3899e-05 2024-04-18T21:07:08.653 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.653 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.653 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:08.653 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757988+0000", 2024-04-18T21:07:08.654 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8033000000000002e-05 2024-04-18T21:07:08.654 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.654 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.654 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:08.654 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758002+0000", 2024-04-18T21:07:08.654 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3973e-05 2024-04-18T21:07:08.654 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.654 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.654 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:08.655 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803072+0000", 2024-04-18T21:07:08.655 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045070194000000001 2024-04-18T21:07:08.655 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.655 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.655 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:08.655 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803125+0000", 2024-04-18T21:07:08.655 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3498000000000002e-05 2024-04-18T21:07:08.655 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.655 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.655 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:08.656 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803233+0000", 2024-04-18T21:07:08.656 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010704099999999999 2024-04-18T21:07:08.656 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.656 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.656 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:08.656 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805856+0000", 2024-04-18T21:07:08.656 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026233430000000002 2024-04-18T21:07:08.657 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.657 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.657 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:08.657 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814439+0000", 2024-04-18T21:07:08.657 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0085833839999999995 2024-04-18T21:07:08.657 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.657 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.657 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:08.657 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814469+0000", 2024-04-18T21:07:08.657 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9784000000000001e-05 2024-04-18T21:07:08.658 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.658 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.658 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:08.658 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814495+0000", 2024-04-18T21:07:08.658 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5698e-05 2024-04-18T21:07:08.658 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:08.658 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:08.658 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:08.659 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.659 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.659 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:107 3.1f 3:f83d65d8:::200.00000004:head [write 324866~1421 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:08.659 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758019+0000", 2024-04-18T21:07:08.659 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.707196848999999, 2024-04-18T21:07:08.659 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056580563, 2024-04-18T21:07:08.659 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:08.660 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:08.660 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:08.660 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:08.660 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.660 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:08.660 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758019+0000", 2024-04-18T21:07:08.660 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:08.660 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.660 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.661 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:08.661 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758019+0000", 2024-04-18T21:07:08.661 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:08.661 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.661 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.661 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:08.661 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758021+0000", 2024-04-18T21:07:08.661 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1999999999999999e-06 2024-04-18T21:07:08.661 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.662 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.662 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:08.662 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758028+0000", 2024-04-18T21:07:08.662 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7200000000000006e-06 2024-04-18T21:07:08.662 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.662 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.662 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:08.662 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758050+0000", 2024-04-18T21:07:08.663 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1877000000000001e-05 2024-04-18T21:07:08.663 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.663 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.663 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:08.663 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758064+0000", 2024-04-18T21:07:08.663 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.383e-05 2024-04-18T21:07:08.663 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.663 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.664 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:08.664 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803593+0000", 2024-04-18T21:07:08.664 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045528831999999998 2024-04-18T21:07:08.664 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.664 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.664 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:08.664 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803635+0000", 2024-04-18T21:07:08.664 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1980000000000001e-05 2024-04-18T21:07:08.665 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.665 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.665 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:08.665 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803703+0000", 2024-04-18T21:07:08.665 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8542999999999997e-05 2024-04-18T21:07:08.665 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.665 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.665 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:08.665 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806123+0000", 2024-04-18T21:07:08.666 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002419769 2024-04-18T21:07:08.666 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.666 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.666 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:08.666 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814542+0000", 2024-04-18T21:07:08.666 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084189460000000001 2024-04-18T21:07:08.666 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.666 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.666 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:08.667 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814576+0000", 2024-04-18T21:07:08.667 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3679000000000001e-05 2024-04-18T21:07:08.667 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.667 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.667 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:08.667 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814600+0000", 2024-04-18T21:07:08.667 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4187000000000001e-05 2024-04-18T21:07:08.667 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:08.667 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:08.668 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:08.668 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.668 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.668 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:108 3.1f 3:f83d65d8:::200.00000004:head [write 326287~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:08.668 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:07:08.668 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.707133679999998, 2024-04-18T21:07:08.668 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056616183, 2024-04-18T21:07:08.668 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:08.669 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:08.669 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:08.669 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:08.669 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.669 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:08.669 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:07:08.669 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:08.670 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.670 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.670 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:08.670 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:07:08.670 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:08.670 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.670 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.671 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:08.671 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758084+0000", 2024-04-18T21:07:08.671 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.124e-06 2024-04-18T21:07:08.671 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.671 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.671 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:08.671 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758100+0000", 2024-04-18T21:07:08.671 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6246e-05 2024-04-18T21:07:08.672 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.672 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.672 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:08.672 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758118+0000", 2024-04-18T21:07:08.672 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8267e-05 2024-04-18T21:07:08.672 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.672 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.673 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:08.673 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758134+0000", 2024-04-18T21:07:08.673 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5950000000000001e-05 2024-04-18T21:07:08.673 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.673 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.673 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:08.673 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803949+0000", 2024-04-18T21:07:08.674 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045815349999999998 2024-04-18T21:07:08.674 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.674 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.674 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:08.674 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804011+0000", 2024-04-18T21:07:08.674 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1044999999999996e-05 2024-04-18T21:07:08.674 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.675 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.675 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:08.675 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804128+0000", 2024-04-18T21:07:08.675 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117148 2024-04-18T21:07:08.675 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.675 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.675 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:08.675 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806794+0000", 2024-04-18T21:07:08.676 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002666692 2024-04-18T21:07:08.676 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.676 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.676 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:08.676 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814645+0000", 2024-04-18T21:07:08.676 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0078508880000000003 2024-04-18T21:07:08.676 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.676 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.676 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:08.677 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814678+0000", 2024-04-18T21:07:08.677 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3188999999999997e-05 2024-04-18T21:07:08.677 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.677 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.677 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:08.677 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814699+0000", 2024-04-18T21:07:08.677 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0284000000000001e-05 2024-04-18T21:07:08.677 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:08.678 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:08.678 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:08.678 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.678 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.678 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:109 3.1f 3:f83d65d8:::200.00000004:head [write 327693~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:08.678 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:07:08.678 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.707064313, 2024-04-18T21:07:08.678 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056621036999999999, 2024-04-18T21:07:08.679 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:08.679 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:08.679 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:08.679 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:08.679 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.679 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:08.679 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:07:08.679 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:08.679 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.680 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.680 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:08.680 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:07:08.680 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:08.680 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.680 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.680 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:08.681 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758153+0000", 2024-04-18T21:07:08.681 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1459999999999999e-06 2024-04-18T21:07:08.681 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.681 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.681 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:08.681 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758161+0000", 2024-04-18T21:07:08.682 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7999999999999999e-06 2024-04-18T21:07:08.682 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.682 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.682 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:08.682 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758179+0000", 2024-04-18T21:07:08.682 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7949999999999999e-05 2024-04-18T21:07:08.682 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.682 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.683 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:08.683 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758193+0000", 2024-04-18T21:07:08.683 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3773e-05 2024-04-18T21:07:08.683 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.683 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.683 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:08.684 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804632+0000", 2024-04-18T21:07:08.684 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.046439469999999997 2024-04-18T21:07:08.684 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.684 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.684 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:08.684 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804790+0000", 2024-04-18T21:07:08.684 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015784300000000001 2024-04-18T21:07:08.685 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.685 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.685 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:08.685 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805056+0000", 2024-04-18T21:07:08.685 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026652400000000003 2024-04-18T21:07:08.685 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.685 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.685 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:08.686 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.808959+0000", 2024-04-18T21:07:08.686 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003903077 2024-04-18T21:07:08.686 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.686 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.686 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:08.686 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814728+0000", 2024-04-18T21:07:08.686 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0057682489999999996 2024-04-18T21:07:08.686 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.686 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.687 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:08.687 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814754+0000", 2024-04-18T21:07:08.687 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6673999999999999e-05 2024-04-18T21:07:08.687 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.687 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.687 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:08.687 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814773+0000", 2024-04-18T21:07:08.687 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8530999999999999e-05 2024-04-18T21:07:08.688 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:08.688 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:08.688 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:08.688 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.688 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.688 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:110 3.1f 3:f83d65d8:::200.00000004:head [write 329098~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:08.688 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:07:08.688 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.707005903999999, 2024-04-18T21:07:08.688 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056669113, 2024-04-18T21:07:08.688 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:08.689 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:08.689 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:08.689 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:08.689 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.689 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:08.689 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:07:08.689 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:08.689 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.689 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.689 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:08.690 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:07:08.690 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:08.690 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.690 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.690 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:08.690 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758212+0000", 2024-04-18T21:07:08.690 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:07:08.690 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.690 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.691 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:08.691 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758219+0000", 2024-04-18T21:07:08.691 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4229999999999999e-06 2024-04-18T21:07:08.691 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.691 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.691 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:08.691 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758237+0000", 2024-04-18T21:07:08.691 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7966999999999999e-05 2024-04-18T21:07:08.691 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.691 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.692 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:08.692 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758252+0000", 2024-04-18T21:07:08.692 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5322999999999999e-05 2024-04-18T21:07:08.692 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.692 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.692 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:08.692 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805536+0000", 2024-04-18T21:07:08.692 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.047283861000000003 2024-04-18T21:07:08.692 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.693 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.693 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:08.693 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805579+0000", 2024-04-18T21:07:08.693 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2738999999999999e-05 2024-04-18T21:07:08.693 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.693 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.693 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:08.693 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805649+0000", 2024-04-18T21:07:08.693 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0213e-05 2024-04-18T21:07:08.693 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.694 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.694 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:08.694 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.808966+0000", 2024-04-18T21:07:08.694 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033166129999999999 2024-04-18T21:07:08.694 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.694 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.694 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:08.694 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814812+0000", 2024-04-18T21:07:08.695 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0058463589999999998 2024-04-18T21:07:08.695 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.695 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.695 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:08.695 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814854+0000", 2024-04-18T21:07:08.695 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1618e-05 2024-04-18T21:07:08.695 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.695 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.695 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:08.696 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814879+0000", 2024-04-18T21:07:08.696 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5754000000000001e-05 2024-04-18T21:07:08.696 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:08.696 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:08.696 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:08.696 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.696 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.697 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:111 3.1f 3:f83d65d8:::200.00000004:head [write 330499~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:08.697 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:07:08.697 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.706944927999999, 2024-04-18T21:07:08.697 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058693793000000001, 2024-04-18T21:07:08.697 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:08.697 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:08.698 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:08.698 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:08.698 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.698 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:08.698 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:07:08.698 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:08.698 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.699 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.699 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:08.699 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:07:08.699 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:08.699 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.699 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.699 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:08.699 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758272+0000", 2024-04-18T21:07:08.700 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1200000000000001e-06 2024-04-18T21:07:08.700 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.700 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.700 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:08.700 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758287+0000", 2024-04-18T21:07:08.700 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5017e-05 2024-04-18T21:07:08.700 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.700 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.701 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:08.701 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758309+0000", 2024-04-18T21:07:08.701 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1866e-05 2024-04-18T21:07:08.701 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.701 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.701 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:08.701 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758323+0000", 2024-04-18T21:07:08.701 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3606e-05 2024-04-18T21:07:08.702 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.702 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.702 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:08.702 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806279+0000", 2024-04-18T21:07:08.702 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.047956061000000001 2024-04-18T21:07:08.702 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.703 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.703 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:08.703 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806350+0000", 2024-04-18T21:07:08.703 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1070999999999998e-05 2024-04-18T21:07:08.703 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.703 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.703 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:08.703 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806459+0000", 2024-04-18T21:07:08.704 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000108606 2024-04-18T21:07:08.704 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.704 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.704 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:08.704 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.809774+0000", 2024-04-18T21:07:08.704 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003314881 2024-04-18T21:07:08.704 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.704 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.704 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:08.705 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816910+0000", 2024-04-18T21:07:08.705 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0071367760000000001 2024-04-18T21:07:08.705 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.705 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.705 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:08.705 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816941+0000", 2024-04-18T21:07:08.705 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0846000000000002e-05 2024-04-18T21:07:08.706 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.706 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.706 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:08.706 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816965+0000", 2024-04-18T21:07:08.706 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3943000000000001e-05 2024-04-18T21:07:08.706 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:08.706 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:08.706 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:08.707 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.707 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.707 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:5230 4.17 4:eb2cc4c4:::1000000184c.00000000:head [write 0~2191] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-18T21:07:08.707 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.760650+0000", 2024-04-18T21:07:08.707 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.704565757000001, 2024-04-18T21:07:08.707 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.054210577000000003, 2024-04-18T21:07:08.707 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:08.708 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:08.708 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:08.708 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:07:08.708 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:07:08.708 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:08.708 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 5230 2024-04-18T21:07:08.708 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.708 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:08.708 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.709 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:08.709 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760650+0000", 2024-04-18T21:07:08.709 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:08.709 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.709 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.709 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:08.709 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760650+0000", 2024-04-18T21:07:08.710 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:08.710 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.710 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.710 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:08.710 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760653+0000", 2024-04-18T21:07:08.710 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0829999999999998e-06 2024-04-18T21:07:08.710 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.710 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.711 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:08.711 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760664+0000", 2024-04-18T21:07:08.711 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.111e-05 2024-04-18T21:07:08.711 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.711 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.711 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:08.711 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760688+0000", 2024-04-18T21:07:08.712 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4837e-05 2024-04-18T21:07:08.712 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.712 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.712 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:08.712 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760702+0000", 2024-04-18T21:07:08.713 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3723000000000001e-05 2024-04-18T21:07:08.713 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.713 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.713 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:08.713 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806264+0000", 2024-04-18T21:07:08.713 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045562182 2024-04-18T21:07:08.713 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.713 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.714 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:08.714 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806351+0000", 2024-04-18T21:07:08.714 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6322000000000005e-05 2024-04-18T21:07:08.714 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.714 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.714 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:08.714 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806453+0000", 2024-04-18T21:07:08.714 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000102602 2024-04-18T21:07:08.714 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.715 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.715 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:08.715 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.808972+0000", 2024-04-18T21:07:08.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025184090000000001 2024-04-18T21:07:08.715 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.715 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.715 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:08.715 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814798+0000", 2024-04-18T21:07:08.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0058266689999999996 2024-04-18T21:07:08.715 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.716 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.716 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:08.716 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814839+0000", 2024-04-18T21:07:08.716 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0482000000000003e-05 2024-04-18T21:07:08.716 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.716 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.716 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:08.716 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814861+0000", 2024-04-18T21:07:08.716 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2158e-05 2024-04-18T21:07:08.717 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:08.717 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:08.717 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:08.717 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.717 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:112 3.1f 3:f83d65d8:::200.00000004:head [write 331898~20167 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:08.717 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.771321+0000", 2024-04-18T21:07:08.717 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.693895130000001, 2024-04-18T21:07:08.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045740306000000001, 2024-04-18T21:07:08.718 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:08.718 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:08.718 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:08.718 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:08.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:08.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771321+0000", 2024-04-18T21:07:08.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:08.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.719 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:08.719 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771321+0000", 2024-04-18T21:07:08.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:08.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.719 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:08.719 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771323+0000", 2024-04-18T21:07:08.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3740000000000001e-06 2024-04-18T21:07:08.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:08.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771359+0000", 2024-04-18T21:07:08.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5447999999999997e-05 2024-04-18T21:07:08.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:08.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771388+0000", 2024-04-18T21:07:08.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8915e-05 2024-04-18T21:07:08.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:08.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771410+0000", 2024-04-18T21:07:08.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1899000000000002e-05 2024-04-18T21:07:08.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:08.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806827+0000", 2024-04-18T21:07:08.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.035417063999999998 2024-04-18T21:07:08.722 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.722 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.722 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:08.722 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806873+0000", 2024-04-18T21:07:08.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6261999999999999e-05 2024-04-18T21:07:08.722 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.722 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.722 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:08.722 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806946+0000", 2024-04-18T21:07:08.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3205000000000001e-05 2024-04-18T21:07:08.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:08.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.809781+0000", 2024-04-18T21:07:08.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002834937 2024-04-18T21:07:08.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.724 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:08.724 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817003+0000", 2024-04-18T21:07:08.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0072217959999999999 2024-04-18T21:07:08.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.724 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:08.724 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817038+0000", 2024-04-18T21:07:08.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4696999999999997e-05 2024-04-18T21:07:08.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:08.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817061+0000", 2024-04-18T21:07:08.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3708999999999999e-05 2024-04-18T21:07:08.725 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:08.725 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:08.725 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:08.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.725 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:113 3.1f 3:f83d65d8:::200.00000004:head [write 352065~3878 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:08.725 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.771472+0000", 2024-04-18T21:07:08.725 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.693744393999999, 2024-04-18T21:07:08.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045689726, 2024-04-18T21:07:08.726 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:08.726 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:08.726 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:08.726 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:08.726 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.726 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:08.726 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771472+0000", 2024-04-18T21:07:08.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:08.726 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:08.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771472+0000", 2024-04-18T21:07:08.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:08.727 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:08.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771473+0000", 2024-04-18T21:07:08.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3829999999999999e-06 2024-04-18T21:07:08.728 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.728 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:08.728 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771489+0000", 2024-04-18T21:07:08.728 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5797000000000001e-05 2024-04-18T21:07:08.728 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.728 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:08.728 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771509+0000", 2024-04-18T21:07:08.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0401999999999999e-05 2024-04-18T21:07:08.729 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.729 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:08.729 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771525+0000", 2024-04-18T21:07:08.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5099999999999999e-05 2024-04-18T21:07:08.729 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.729 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:08.730 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807273+0000", 2024-04-18T21:07:08.730 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.035748488000000002 2024-04-18T21:07:08.730 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.730 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:08.730 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807343+0000", 2024-04-18T21:07:08.730 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0277000000000005e-05 2024-04-18T21:07:08.730 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.730 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:08.731 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807455+0000", 2024-04-18T21:07:08.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011171999999999999 2024-04-18T21:07:08.731 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.731 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.731 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:08.731 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.811509+0000", 2024-04-18T21:07:08.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0040543469999999998 2024-04-18T21:07:08.731 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.731 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.731 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:08.731 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817115+0000", 2024-04-18T21:07:08.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0056054520000000004 2024-04-18T21:07:08.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.732 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:08.732 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817142+0000", 2024-04-18T21:07:08.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7430999999999999e-05 2024-04-18T21:07:08.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:08.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817162+0000", 2024-04-18T21:07:08.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9329000000000001e-05 2024-04-18T21:07:08.733 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:08.733 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:08.733 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:08.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.734 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:11950 4.6 4:62753dda:::10000003222.00000000:head [write 3145728~1048576] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:08.734 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:59.346083+0000", 2024-04-18T21:07:08.734 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.1191331659999992, 2024-04-18T21:07:08.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.051281119999999999, 2024-04-18T21:07:08.734 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:08.734 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:08.734 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:08.734 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:07:08.734 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:07:08.734 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:08.735 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 11950 2024-04-18T21:07:08.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.735 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:08.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:08.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.346083+0000", 2024-04-18T21:07:08.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:08.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.736 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:08.736 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.346083+0000", 2024-04-18T21:07:08.736 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:08.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.736 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:08.736 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.346085+0000", 2024-04-18T21:07:08.736 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.736e-06 2024-04-18T21:07:08.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.737 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:08.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.349991+0000", 2024-04-18T21:07:08.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0039062960000000001 2024-04-18T21:07:08.737 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.737 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:08.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.350006+0000", 2024-04-18T21:07:08.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5327000000000001e-05 2024-04-18T21:07:08.738 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.738 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.738 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:08.738 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.350016+0000", 2024-04-18T21:07:08.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3570000000000004e-06 2024-04-18T21:07:08.738 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.738 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.738 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:08.738 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.360724+0000", 2024-04-18T21:07:08.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010708153999999999 2024-04-18T21:07:08.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:08.739 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.360839+0000", 2024-04-18T21:07:08.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000114877 2024-04-18T21:07:08.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:08.740 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.397285+0000", 2024-04-18T21:07:08.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036445957000000001 2024-04-18T21:07:08.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.740 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:08.740 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.397316+0000", 2024-04-18T21:07:08.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0926000000000002e-05 2024-04-18T21:07:08.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:08.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.397364+0000", 2024-04-18T21:07:08.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8489999999999998e-05 2024-04-18T21:07:08.741 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:08.741 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:08.741 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:08.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.741 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:12225 4.11 4:8acd30ee:::100000031ed.00000000:head [write 0~4194304 [2@86041]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:08.742 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:59.667090+0000", 2024-04-18T21:07:08.742 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.7981265509999993, 2024-04-18T21:07:08.742 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.047400059000000001, 2024-04-18T21:07:08.742 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:08.742 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:08.742 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:08.742 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:07:08.742 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:07:08.742 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:08.743 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 12225 2024-04-18T21:07:08.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.743 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:08.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:08.743 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.667090+0000", 2024-04-18T21:07:08.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:08.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:08.743 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.667090+0000", 2024-04-18T21:07:08.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:08.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.744 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.744 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:08.744 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.667091+0000", 2024-04-18T21:07:08.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3629999999999999e-06 2024-04-18T21:07:08.744 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.744 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.744 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:08.744 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.674492+0000", 2024-04-18T21:07:08.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0074007789999999997 2024-04-18T21:07:08.744 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.744 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.744 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:08.744 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.674508+0000", 2024-04-18T21:07:08.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6509999999999999e-05 2024-04-18T21:07:08.745 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.745 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.745 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:08.745 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.674518+0000", 2024-04-18T21:07:08.745 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.6290000000000005e-06 2024-04-18T21:07:08.745 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.745 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.745 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:08.745 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.674584+0000", 2024-04-18T21:07:08.745 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5597000000000002e-05 2024-04-18T21:07:08.745 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:08.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.674659+0000", 2024-04-18T21:07:08.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5168999999999998e-05 2024-04-18T21:07:08.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:08.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.674775+0000", 2024-04-18T21:07:08.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000116069 2024-04-18T21:07:08.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:08.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.685336+0000", 2024-04-18T21:07:08.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010561022999999999 2024-04-18T21:07:08.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:08.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.714413+0000", 2024-04-18T21:07:08.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.029077306000000001 2024-04-18T21:07:08.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:08.748 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.714455+0000", 2024-04-18T21:07:08.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1547e-05 2024-04-18T21:07:08.748 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.748 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:08.748 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.714490+0000", 2024-04-18T21:07:08.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5067000000000002e-05 2024-04-18T21:07:08.748 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:08.748 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:08.748 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:08.748 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.748 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:12689 4.26 4:64a7f444:::100000033e5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:08.749 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:00.208067+0000", 2024-04-18T21:07:08.749 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.2571495119999998, 2024-04-18T21:07:08.749 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066681457, 2024-04-18T21:07:08.749 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:08.749 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:08.749 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:08.749 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:07:08.749 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:07:08.749 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:08.749 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 12689 2024-04-18T21:07:08.749 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.750 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:08.750 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.750 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:08.750 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.208067+0000", 2024-04-18T21:07:08.750 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:08.750 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.750 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.750 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:08.750 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.208067+0000", 2024-04-18T21:07:08.750 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:08.750 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.750 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.750 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:08.750 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.208069+0000", 2024-04-18T21:07:08.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1500000000000002e-06 2024-04-18T21:07:08.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:08.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216162+0000", 2024-04-18T21:07:08.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0080933159999999997 2024-04-18T21:07:08.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:08.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216181+0000", 2024-04-18T21:07:08.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8573e-05 2024-04-18T21:07:08.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.752 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:08.752 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216192+0000", 2024-04-18T21:07:08.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0767999999999999e-05 2024-04-18T21:07:08.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.752 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:08.752 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216259+0000", 2024-04-18T21:07:08.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7977000000000003e-05 2024-04-18T21:07:08.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.753 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:08.753 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216635+0000", 2024-04-18T21:07:08.753 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00037591300000000002 2024-04-18T21:07:08.753 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.753 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:08.753 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216929+0000", 2024-04-18T21:07:08.753 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00029314800000000002 2024-04-18T21:07:08.753 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.754 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.754 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:08.754 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.232918+0000", 2024-04-18T21:07:08.754 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015989903 2024-04-18T21:07:08.754 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.754 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.754 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:08.754 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.274643+0000", 2024-04-18T21:07:08.754 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.041724281000000002 2024-04-18T21:07:08.754 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.755 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.755 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:08.755 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.274701+0000", 2024-04-18T21:07:08.755 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8304999999999998e-05 2024-04-18T21:07:08.755 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.755 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.755 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:08.755 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.274748+0000", 2024-04-18T21:07:08.755 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7123000000000003e-05 2024-04-18T21:07:08.755 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:08.756 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:08.756 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:08.756 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.756 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4534.0:15094 4.c e59/16 4:32870457:::10000003692.00000000:head v 59'213, mlcod=59'211)", 2024-04-18T21:07:08.756 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:03.117817+0000", 2024-04-18T21:07:08.756 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 5.3473994410000003, 2024-04-18T21:07:08.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.049868875999999999, 2024-04-18T21:07:08.756 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:08.756 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:08.756 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:08.757 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:08.757 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.757 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:08.757 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.117817+0000", 2024-04-18T21:07:08.757 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:08.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.757 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.757 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:08.757 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.117817+0000", 2024-04-18T21:07:08.757 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:08.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.757 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.758 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:08.758 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.117817+0000", 2024-04-18T21:07:08.758 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0200000000000003e-07 2024-04-18T21:07:08.758 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.758 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.758 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:08.758 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.140525+0000", 2024-04-18T21:07:08.758 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.022707775999999999 2024-04-18T21:07:08.758 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.758 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.759 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:08.759 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.140549+0000", 2024-04-18T21:07:08.759 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4456000000000001e-05 2024-04-18T21:07:08.759 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.759 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:08.759 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.140563+0000", 2024-04-18T21:07:08.759 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.329e-05 2024-04-18T21:07:08.759 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.760 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:08.760 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.140797+0000", 2024-04-18T21:07:08.760 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023447400000000001 2024-04-18T21:07:08.760 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.760 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.760 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:08.760 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.140842+0000", 2024-04-18T21:07:08.760 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5287000000000002e-05 2024-04-18T21:07:08.760 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.760 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.761 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:08.761 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.167577+0000", 2024-04-18T21:07:08.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.026734745000000001 2024-04-18T21:07:08.761 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:08.761 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:08.761 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:08.761 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.167686+0000", 2024-04-18T21:07:08.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000108446 2024-04-18T21:07:08.761 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:08.761 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:08.761 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:08.761 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:08.761 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:08.761 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:07:08.764 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:07:08.766 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:08.762+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:08.864 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:08.865+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:08.917 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:07:08.917 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:07:08.917 INFO:teuthology.orchestra.run.smithi132.stdout: "num_ops": 0 2024-04-18T21:07:08.917 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:07:08.931 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:07:08.979 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:08.981+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:09.064 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~12s 2024-04-18T21:07:09.065 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:09.065+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:09.104 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:07:09.104 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:07:09.104 INFO:teuthology.orchestra.run.smithi132.stdout: "complaint_time": 30, 2024-04-18T21:07:09.104 INFO:teuthology.orchestra.run.smithi132.stdout: "num_blocked_ops": 0 2024-04-18T21:07:09.104 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:07:09.119 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:07:09.120 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:07:09.166 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:09.166+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:09.260 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:07:09.260 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:07:09.261 INFO:teuthology.orchestra.run.smithi078.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-18T21:07:09.267 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:09.266+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:09.283 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:07:09.283 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:07:09.285 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-18T21:07:09.286 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-18T21:07:09.291 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:09.291 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:09.306 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:07:09.368 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:09.366+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:09.405 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2024-04-18T21:07:09.405 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-18T21:07:09.405 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2024-04-18T21:07:09.405 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 3.0 2024-04-18T21:07:09.438 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:09.438 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:09.453 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:07:09.469 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:09.469+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:09.570 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:09.570+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:09.619 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:09.620 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:09.634 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:09.671 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:09.673+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:09.704 INFO:teuthology.orchestra.run.smithi078.stdout:moved 0 / 210 (0%) 2024-04-18T21:07:09.704 INFO:teuthology.orchestra.run.smithi078.stdout:avg 105 2024-04-18T21:07:09.704 INFO:teuthology.orchestra.run.smithi078.stdout:stddev 33.5037 -> 33.5037 (expected baseline 7.24569) 2024-04-18T21:07:09.704 INFO:teuthology.orchestra.run.smithi078.stdout:min osd.0 with 71 -> 71 pgs (0.67619 -> 0.67619 * mean) 2024-04-18T21:07:09.704 INFO:teuthology.orchestra.run.smithi078.stdout:max osd.2 with 72 -> 72 pgs (0.685714 -> 0.685714 * mean) 2024-04-18T21:07:09.704 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:07:09.705 INFO:teuthology.orchestra.run.smithi078.stdout:oload 1000 2024-04-18T21:07:09.705 INFO:teuthology.orchestra.run.smithi078.stdout:max_change 3 2024-04-18T21:07:09.705 INFO:teuthology.orchestra.run.smithi078.stdout:max_change_osds 4 2024-04-18T21:07:09.705 INFO:teuthology.orchestra.run.smithi078.stdout:average_utilization 0.0063 2024-04-18T21:07:09.705 INFO:teuthology.orchestra.run.smithi078.stdout:overload_utilization 0.0630 2024-04-18T21:07:09.705 INFO:teuthology.orchestra.run.smithi078.stderr:no change 2024-04-18T21:07:09.723 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2024-04-18T21:07:09.724 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 0.05 2024-04-18T21:07:09.771 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:09.770+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:09.801 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:09.801 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:09.817 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:07:09.872 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:09.873+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:09.875 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-18T21:07:09.955 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:09.955 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:09.970 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:07:09.973 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:09.970+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:10.035 INFO:teuthology.orchestra.run.smithi078.stdout:moved 0 / 210 (0%) 2024-04-18T21:07:10.035 INFO:teuthology.orchestra.run.smithi078.stdout:avg 105 2024-04-18T21:07:10.035 INFO:teuthology.orchestra.run.smithi078.stdout:stddev 33.5037 -> 33.5037 (expected baseline 7.24569) 2024-04-18T21:07:10.036 INFO:teuthology.orchestra.run.smithi078.stdout:min osd.0 with 71 -> 71 pgs (0.67619 -> 0.67619 * mean) 2024-04-18T21:07:10.036 INFO:teuthology.orchestra.run.smithi078.stdout:max osd.2 with 72 -> 72 pgs (0.685714 -> 0.685714 * mean) 2024-04-18T21:07:10.036 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:07:10.036 INFO:teuthology.orchestra.run.smithi078.stdout:oload 1000 2024-04-18T21:07:10.036 INFO:teuthology.orchestra.run.smithi078.stdout:max_change 0.05 2024-04-18T21:07:10.036 INFO:teuthology.orchestra.run.smithi078.stdout:max_change_osds 4 2024-04-18T21:07:10.036 INFO:teuthology.orchestra.run.smithi078.stdout:average_utilization 0.0063 2024-04-18T21:07:10.036 INFO:teuthology.orchestra.run.smithi078.stdout:overload_utilization 0.0630 2024-04-18T21:07:10.036 INFO:teuthology.orchestra.run.smithi078.stderr:no change 2024-04-18T21:07:10.056 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '110', 'type': 'reweight-by-utilization'} 2024-04-18T21:07:10.056 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 110 1.0 2024-04-18T21:07:10.073 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:10.074+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:10.142 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:10.142 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:10.157 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:07:10.174 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:10.174+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:10.273 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:10.273 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:10.275 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:10.274+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:10.289 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:07:10.376 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:10.377+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:10.421 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:10.421 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:10.437 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:07:10.477 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:10.477+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:10.560 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:10.561 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:10.576 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:10.577 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:10.578+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:10.678 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:10.677+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:10.692 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:10.692 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:10.707 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:07:10.779 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:10.778+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:10.867 INFO:teuthology.orchestra.run.smithi078.stderr:noscrub is set 2024-04-18T21:07:10.871 INFO:teuthology.orchestra.run.smithi078.stdout:moved 32 / 210 (15.2381%) 2024-04-18T21:07:10.872 INFO:teuthology.orchestra.run.smithi078.stdout:avg 105 2024-04-18T21:07:10.872 INFO:teuthology.orchestra.run.smithi078.stdout:stddev 33.5037 -> 48.9745 (expected baseline 7.24569) 2024-04-18T21:07:10.872 INFO:teuthology.orchestra.run.smithi078.stdout:min osd.0 with 71 -> 39 pgs (0.67619 -> 0.371429 * mean) 2024-04-18T21:07:10.872 INFO:teuthology.orchestra.run.smithi078.stdout:max osd.2 with 72 -> 84 pgs (0.685714 -> 0.8 * mean) 2024-04-18T21:07:10.872 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:07:10.872 INFO:teuthology.orchestra.run.smithi078.stdout:oload 110 2024-04-18T21:07:10.872 INFO:teuthology.orchestra.run.smithi078.stdout:max_change 1 2024-04-18T21:07:10.872 INFO:teuthology.orchestra.run.smithi078.stdout:max_change_osds 4 2024-04-18T21:07:10.872 INFO:teuthology.orchestra.run.smithi078.stdout:average_utilization 0.0063 2024-04-18T21:07:10.872 INFO:teuthology.orchestra.run.smithi078.stdout:overload_utilization 0.0069 2024-04-18T21:07:10.873 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 weight 0.9959 -> 0.5623 2024-04-18T21:07:10.880 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:10.881+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:10.883 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:10.883 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:10.892 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2024-04-18T21:07:10.892 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 110 1.0 2024-04-18T21:07:10.899 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:07:10.991 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:10.993+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:11.058 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:11.058 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:11.073 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:07:11.082 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:11.082+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:11.184 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:11.185+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:11.204 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-04-18T21:07:11.206+0000 7fbe02969640 -1 mgr.server reply reply (1) Operation not permitted no change 2024-04-18T21:07:11.205 INFO:teuthology.orchestra.run.smithi078.stdout:moved 22 / 210 (10.4762%) 2024-04-18T21:07:11.205 INFO:teuthology.orchestra.run.smithi078.stdout:avg 105 2024-04-18T21:07:11.205 INFO:teuthology.orchestra.run.smithi078.stdout:stddev 48.9745 -> 62.7096 (expected baseline 7.24569) 2024-04-18T21:07:11.205 INFO:teuthology.orchestra.run.smithi078.stdout:min osd.0 with 39 -> 17 pgs (0.371429 -> 0.161905 * mean) 2024-04-18T21:07:11.205 INFO:teuthology.orchestra.run.smithi078.stdout:max osd.2 with 84 -> 94 pgs (0.8 -> 0.895238 * mean) 2024-04-18T21:07:11.205 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:07:11.205 INFO:teuthology.orchestra.run.smithi078.stdout:oload 110 2024-04-18T21:07:11.205 INFO:teuthology.orchestra.run.smithi078.stdout:max_change 1 2024-04-18T21:07:11.205 INFO:teuthology.orchestra.run.smithi078.stdout:max_change_osds 4 2024-04-18T21:07:11.205 INFO:teuthology.orchestra.run.smithi078.stdout:average_utilization 0.0063 2024-04-18T21:07:11.205 INFO:teuthology.orchestra.run.smithi078.stdout:overload_utilization 0.0069 2024-04-18T21:07:11.205 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 weight 0.5623 -> 0.3175 2024-04-18T21:07:11.206 INFO:teuthology.orchestra.run.smithi078.stderr:no change 2024-04-18T21:07:11.222 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '1000', 'type': 'reweight-by-utilization'} 2024-04-18T21:07:11.222 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 1000 3.0 2024-04-18T21:07:11.238 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:11.238 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:11.252 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:07:11.287 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:07:11.297 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:11.298+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:11.383 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:11.383 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:11.384 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:11.382+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:11.398 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:07:11.432 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:07:11.432 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:07:11.432 INFO:teuthology.orchestra.run.smithi078.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-18T21:07:11.449 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:07:11.449 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:07:11.452 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-18T21:07:11.453 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-18T21:07:11.485 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:11.485+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:11.518 INFO:teuthology.orchestra.run.smithi078.stdout:moved 0 / 210 (0%) 2024-04-18T21:07:11.519 INFO:teuthology.orchestra.run.smithi078.stdout:avg 105 2024-04-18T21:07:11.519 INFO:teuthology.orchestra.run.smithi078.stdout:stddev 48.9745 -> 48.9745 (expected baseline 7.24569) 2024-04-18T21:07:11.519 INFO:teuthology.orchestra.run.smithi078.stdout:min osd.0 with 39 -> 39 pgs (0.371429 -> 0.371429 * mean) 2024-04-18T21:07:11.519 INFO:teuthology.orchestra.run.smithi078.stdout:max osd.2 with 84 -> 84 pgs (0.8 -> 0.8 * mean) 2024-04-18T21:07:11.519 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:07:11.519 INFO:teuthology.orchestra.run.smithi078.stdout:oload 1000 2024-04-18T21:07:11.519 INFO:teuthology.orchestra.run.smithi078.stdout:max_change 3 2024-04-18T21:07:11.519 INFO:teuthology.orchestra.run.smithi078.stdout:max_change_osds 4 2024-04-18T21:07:11.519 INFO:teuthology.orchestra.run.smithi078.stdout:average_utilization 0.0063 2024-04-18T21:07:11.519 INFO:teuthology.orchestra.run.smithi078.stdout:overload_utilization 0.0630 2024-04-18T21:07:11.519 INFO:teuthology.orchestra.run.smithi078.stderr:no change 2024-04-18T21:07:11.557 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:07:11.558 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:07:11.558 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-18T21:07:11.558 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-18T21:07:11.558 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:07:11.572 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:11.586 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:11.585+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:11.687 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:11.689+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:11.699 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:07:11.699 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-18T21:07:11.699 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-18T21:07:11.699 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:07:11.700 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.700 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:11.700 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:07:11.700 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 126.08257609, 2024-04-18T21:07:11.700 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045668994999999997, 2024-04-18T21:07:11.700 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:11.700 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:11.700 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.700 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:11.700 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.700 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:11.700 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:07:11.700 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:11.701 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.701 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.701 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:11.701 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:07:11.701 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:11.701 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.701 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.701 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:11.701 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615459+0000", 2024-04-18T21:07:11.701 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5030000000000001e-06 2024-04-18T21:07:11.701 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.701 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.702 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:11.702 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615506+0000", 2024-04-18T21:07:11.702 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6872000000000001e-05 2024-04-18T21:07:11.702 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.702 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.702 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:11.702 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615527+0000", 2024-04-18T21:07:11.702 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0763000000000001e-05 2024-04-18T21:07:11.702 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.702 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.702 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.702 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615551+0000", 2024-04-18T21:07:11.702 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4159e-05 2024-04-18T21:07:11.703 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.703 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.703 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:11.703 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615736+0000", 2024-04-18T21:07:11.703 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018499599999999999 2024-04-18T21:07:11.703 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.703 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.703 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:07:11.703 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615748+0000", 2024-04-18T21:07:11.703 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2272999999999999e-05 2024-04-18T21:07:11.703 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.703 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.703 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:11.703 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635481+0000", 2024-04-18T21:07:11.703 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019732772999999999 2024-04-18T21:07:11.704 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.704 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.704 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:11.704 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635791+0000", 2024-04-18T21:07:11.704 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031013299999999998 2024-04-18T21:07:11.704 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.704 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.704 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:11.704 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636101+0000", 2024-04-18T21:07:11.704 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030943300000000002 2024-04-18T21:07:11.704 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.704 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.704 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:11.704 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646043+0000", 2024-04-18T21:07:11.705 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099428139999999995 2024-04-18T21:07:11.705 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.705 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.705 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:11.705 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660991+0000", 2024-04-18T21:07:11.705 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014947142 2024-04-18T21:07:11.705 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.705 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.705 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:11.705 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661061+0000", 2024-04-18T21:07:11.705 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0438000000000006e-05 2024-04-18T21:07:11.705 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.705 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.705 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:11.705 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661127+0000", 2024-04-18T21:07:11.706 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5696000000000003e-05 2024-04-18T21:07:11.706 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:11.706 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:11.706 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:11.706 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.706 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.706 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:11.706 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:07:11.706 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 126.08236366200001, 2024-04-18T21:07:11.706 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045745085999999997, 2024-04-18T21:07:11.706 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:11.706 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:11.706 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.706 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:11.707 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.707 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:11.707 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:07:11.707 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:11.707 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.707 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.707 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:11.707 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:07:11.707 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:11.707 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.707 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.707 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:11.707 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:07:11.707 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7400000000000001e-06 2024-04-18T21:07:11.707 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.707 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.708 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:11.708 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:07:11.708 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8133e-05 2024-04-18T21:07:11.708 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.708 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.708 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:11.708 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615726+0000", 2024-04-18T21:07:11.708 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6132e-05 2024-04-18T21:07:11.708 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.708 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.708 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.708 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615742+0000", 2024-04-18T21:07:11.708 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6157000000000001e-05 2024-04-18T21:07:11.708 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.708 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.708 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:11.709 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615937+0000", 2024-04-18T21:07:11.709 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000194768 2024-04-18T21:07:11.709 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.709 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.709 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:07:11.709 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615950+0000", 2024-04-18T21:07:11.709 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3084e-05 2024-04-18T21:07:11.709 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.709 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.709 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:11.709 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643676+0000", 2024-04-18T21:07:11.709 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027725639999999999 2024-04-18T21:07:11.709 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.709 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.710 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:11.710 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643867+0000", 2024-04-18T21:07:11.710 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019075900000000001 2024-04-18T21:07:11.710 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.710 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.710 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:11.710 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:07:11.710 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036013799999999997 2024-04-18T21:07:11.710 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.710 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.710 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:11.710 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646068+0000", 2024-04-18T21:07:11.711 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001841536 2024-04-18T21:07:11.711 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.711 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.711 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:11.711 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661184+0000", 2024-04-18T21:07:11.711 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015115458999999999 2024-04-18T21:07:11.711 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.711 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.711 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:11.711 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661283+0000", 2024-04-18T21:07:11.711 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9502999999999999e-05 2024-04-18T21:07:11.711 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.711 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.711 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:11.711 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661415+0000", 2024-04-18T21:07:11.712 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000132037 2024-04-18T21:07:11.713 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:11.713 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:11.713 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:11.713 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.713 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.713 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:101 3.1f 3:f83d65d8:::200.00000004:head [write 316455~1401 [fadvise_dontneed] in=1401b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:11.713 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:07:11.713 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.940300051000001, 2024-04-18T21:07:11.714 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.048270212999999999, 2024-04-18T21:07:11.714 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:11.714 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:11.714 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.714 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:11.714 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.714 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:11.714 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:07:11.714 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:11.714 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.714 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.714 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:11.714 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:07:11.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:11.715 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.715 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.715 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:11.715 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:07:11.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7700000000000004e-07 2024-04-18T21:07:11.715 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.715 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.715 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:11.715 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757745+0000", 2024-04-18T21:07:11.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0910000000000001e-05 2024-04-18T21:07:11.715 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.715 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.715 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:11.715 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757758+0000", 2024-04-18T21:07:11.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2593e-05 2024-04-18T21:07:11.716 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.716 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.716 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.716 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757765+0000", 2024-04-18T21:07:11.716 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1659999999999997e-06 2024-04-18T21:07:11.716 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.716 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.716 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:11.716 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.797782+0000", 2024-04-18T21:07:11.716 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.040017283000000001 2024-04-18T21:07:11.716 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.716 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.716 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:11.716 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.797949+0000", 2024-04-18T21:07:11.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016650399999999999 2024-04-18T21:07:11.717 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.717 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:11.717 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.798152+0000", 2024-04-18T21:07:11.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000203098 2024-04-18T21:07:11.717 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.717 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:11.717 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.800792+0000", 2024-04-18T21:07:11.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026394779999999998 2024-04-18T21:07:11.717 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.717 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:11.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805921+0000", 2024-04-18T21:07:11.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0051295519999999999 2024-04-18T21:07:11.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:11.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805967+0000", 2024-04-18T21:07:11.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5457000000000002e-05 2024-04-18T21:07:11.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:11.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806004+0000", 2024-04-18T21:07:11.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7494999999999999e-05 2024-04-18T21:07:11.718 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:11.719 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:11.719 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:11.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.719 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:102 3.1f 3:f83d65d8:::200.00000004:head [write 317856~1403 [fadvise_dontneed] in=1403b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:11.719 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757775+0000", 2024-04-18T21:07:11.719 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.940258985, 2024-04-18T21:07:11.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.048337705000000002, 2024-04-18T21:07:11.719 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:11.719 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:11.719 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.719 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:11.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.719 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:11.719 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757775+0000", 2024-04-18T21:07:11.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:11.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:11.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757775+0000", 2024-04-18T21:07:11.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:11.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:11.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757776+0000", 2024-04-18T21:07:11.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5300000000000004e-07 2024-04-18T21:07:11.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:11.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757780+0000", 2024-04-18T21:07:11.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2270000000000004e-06 2024-04-18T21:07:11.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:11.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757792+0000", 2024-04-18T21:07:11.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2696e-05 2024-04-18T21:07:11.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757800+0000", 2024-04-18T21:07:11.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1439999999999997e-06 2024-04-18T21:07:11.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:11.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.798773+0000", 2024-04-18T21:07:11.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.040973074999999998 2024-04-18T21:07:11.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.722 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.722 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:11.722 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.798990+0000", 2024-04-18T21:07:11.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000217161 2024-04-18T21:07:11.722 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.722 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.722 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:11.722 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.799173+0000", 2024-04-18T21:07:11.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018295900000000001 2024-04-18T21:07:11.722 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.722 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.722 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:11.722 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802469+0000", 2024-04-18T21:07:11.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032965350000000002 2024-04-18T21:07:11.722 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:11.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806042+0000", 2024-04-18T21:07:11.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035724630000000001 2024-04-18T21:07:11.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:11.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806077+0000", 2024-04-18T21:07:11.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4997999999999999e-05 2024-04-18T21:07:11.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:11.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806113+0000", 2024-04-18T21:07:11.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5794000000000003e-05 2024-04-18T21:07:11.723 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:11.723 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:11.724 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:11.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.724 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:103 3.1f 3:f83d65d8:::200.00000004:head [write 319259~1404 [fadvise_dontneed] in=1404b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:11.724 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:07:11.724 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.940225138999999, 2024-04-18T21:07:11.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.048414481000000002, 2024-04-18T21:07:11.724 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:11.724 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:11.724 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.724 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:11.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.724 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:11.724 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:07:11.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:11.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:11.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:07:11.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:11.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:11.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:07:11.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4700000000000001e-07 2024-04-18T21:07:11.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:11.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757814+0000", 2024-04-18T21:07:11.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1829999999999996e-06 2024-04-18T21:07:11.726 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.726 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.726 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:11.726 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757825+0000", 2024-04-18T21:07:11.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1754e-05 2024-04-18T21:07:11.726 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.726 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.726 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.726 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757832+0000", 2024-04-18T21:07:11.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8430000000000004e-06 2024-04-18T21:07:11.726 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.726 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.726 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:11.726 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.799809+0000", 2024-04-18T21:07:11.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.041976960000000001 2024-04-18T21:07:11.727 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:11.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.799934+0000", 2024-04-18T21:07:11.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000125053 2024-04-18T21:07:11.727 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:11.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.800067+0000", 2024-04-18T21:07:11.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013276299999999999 2024-04-18T21:07:11.727 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:11.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804582+0000", 2024-04-18T21:07:11.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0045148899999999997 2024-04-18T21:07:11.728 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.728 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:11.728 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806158+0000", 2024-04-18T21:07:11.728 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001575894 2024-04-18T21:07:11.728 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.728 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:11.728 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806189+0000", 2024-04-18T21:07:11.728 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1423000000000001e-05 2024-04-18T21:07:11.728 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.728 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:11.728 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806223+0000", 2024-04-18T21:07:11.728 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4071e-05 2024-04-18T21:07:11.728 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:11.729 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:11.729 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:11.729 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.729 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:104 3.1f 3:f83d65d8:::200.00000004:head [write 320663~1405 [fadvise_dontneed] in=1405b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:11.729 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757841+0000", 2024-04-18T21:07:11.729 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.940192934999999, 2024-04-18T21:07:11.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056381623999999998, 2024-04-18T21:07:11.729 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:11.729 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:11.729 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.729 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:11.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.730 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:11.730 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757841+0000", 2024-04-18T21:07:11.730 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:11.730 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.730 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:11.730 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757841+0000", 2024-04-18T21:07:11.730 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:11.730 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.730 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:11.730 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757842+0000", 2024-04-18T21:07:11.730 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5000000000000002e-07 2024-04-18T21:07:11.730 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.731 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.731 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:11.731 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757852+0000", 2024-04-18T21:07:11.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.084e-05 2024-04-18T21:07:11.731 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.731 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.731 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:11.731 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757865+0000", 2024-04-18T21:07:11.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2643000000000001e-05 2024-04-18T21:07:11.731 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.731 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.731 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.731 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757872+0000", 2024-04-18T21:07:11.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8689999999999998e-06 2024-04-18T21:07:11.731 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.732 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:11.732 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.801102+0000", 2024-04-18T21:07:11.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043229837 2024-04-18T21:07:11.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.732 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:11.732 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.801291+0000", 2024-04-18T21:07:11.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000189641 2024-04-18T21:07:11.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.732 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:11.732 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.801640+0000", 2024-04-18T21:07:11.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000348971 2024-04-18T21:07:11.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:11.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805849+0000", 2024-04-18T21:07:11.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042082739999999997 2024-04-18T21:07:11.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:11.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814135+0000", 2024-04-18T21:07:11.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0082867270000000007 2024-04-18T21:07:11.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:11.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814180+0000", 2024-04-18T21:07:11.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4982999999999999e-05 2024-04-18T21:07:11.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.734 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:11.734 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814223+0000", 2024-04-18T21:07:11.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2188999999999999e-05 2024-04-18T21:07:11.734 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:11.734 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:11.734 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:11.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.734 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:105 3.1f 3:f83d65d8:::200.00000004:head [write 322068~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:11.734 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:07:11.734 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.940152339000001, 2024-04-18T21:07:11.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056513678999999997, 2024-04-18T21:07:11.734 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:11.735 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:11.735 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.735 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:11.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:11.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:07:11.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:11.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:11.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:07:11.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:11.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.736 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:11.736 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:07:11.736 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2600000000000002e-07 2024-04-18T21:07:11.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.736 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:11.736 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757888+0000", 2024-04-18T21:07:11.736 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7130000000000002e-06 2024-04-18T21:07:11.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.736 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:11.736 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757906+0000", 2024-04-18T21:07:11.736 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7723999999999998e-05 2024-04-18T21:07:11.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.737 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757921+0000", 2024-04-18T21:07:11.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4936000000000001e-05 2024-04-18T21:07:11.737 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.737 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:11.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802493+0000", 2024-04-18T21:07:11.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.044571927999999997 2024-04-18T21:07:11.737 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.737 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:11.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802537+0000", 2024-04-18T21:07:11.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4449000000000001e-05 2024-04-18T21:07:11.738 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.738 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.738 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:11.738 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802605+0000", 2024-04-18T21:07:11.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7945000000000001e-05 2024-04-18T21:07:11.738 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.738 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.738 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:11.738 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805852+0000", 2024-04-18T21:07:11.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032469909999999999 2024-04-18T21:07:11.738 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.738 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.738 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:11.738 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814298+0000", 2024-04-18T21:07:11.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084463309999999996 2024-04-18T21:07:11.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:11.739 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814355+0000", 2024-04-18T21:07:11.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6459999999999998e-05 2024-04-18T21:07:11.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:11.739 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814395+0000", 2024-04-18T21:07:11.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0475999999999997e-05 2024-04-18T21:07:11.739 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:11.739 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:11.739 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:11.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.740 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:106 3.1f 3:f83d65d8:::200.00000004:head [write 323467~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:11.740 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757955+0000", 2024-04-18T21:07:11.740 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.940079109999999, 2024-04-18T21:07:11.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056539990999999998, 2024-04-18T21:07:11.740 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:11.740 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:11.740 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.740 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:11.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.740 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:11.740 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757955+0000", 2024-04-18T21:07:11.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:11.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:11.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757955+0000", 2024-04-18T21:07:11.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:11.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:11.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757956+0000", 2024-04-18T21:07:11.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.144e-06 2024-04-18T21:07:11.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:11.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757970+0000", 2024-04-18T21:07:11.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3899e-05 2024-04-18T21:07:11.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.742 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:11.742 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757988+0000", 2024-04-18T21:07:11.742 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8033000000000002e-05 2024-04-18T21:07:11.742 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.742 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.742 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.742 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758002+0000", 2024-04-18T21:07:11.742 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3973e-05 2024-04-18T21:07:11.742 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.742 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.742 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:11.742 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803072+0000", 2024-04-18T21:07:11.742 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045070194000000001 2024-04-18T21:07:11.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:11.743 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803125+0000", 2024-04-18T21:07:11.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3498000000000002e-05 2024-04-18T21:07:11.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:11.743 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803233+0000", 2024-04-18T21:07:11.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010704099999999999 2024-04-18T21:07:11.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:11.743 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805856+0000", 2024-04-18T21:07:11.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026233430000000002 2024-04-18T21:07:11.744 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.744 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.744 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:11.744 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814439+0000", 2024-04-18T21:07:11.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0085833839999999995 2024-04-18T21:07:11.744 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.744 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.744 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:11.744 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814469+0000", 2024-04-18T21:07:11.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9784000000000001e-05 2024-04-18T21:07:11.744 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.744 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.744 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:11.745 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814495+0000", 2024-04-18T21:07:11.745 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5698e-05 2024-04-18T21:07:11.745 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:11.745 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:11.745 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:11.745 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.745 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.745 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:107 3.1f 3:f83d65d8:::200.00000004:head [write 324866~1421 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:11.745 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758019+0000", 2024-04-18T21:07:11.745 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.940014483999999, 2024-04-18T21:07:11.745 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056580563, 2024-04-18T21:07:11.745 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:11.745 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:11.745 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.745 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:11.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:11.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758019+0000", 2024-04-18T21:07:11.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:11.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:11.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758019+0000", 2024-04-18T21:07:11.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:11.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:11.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758021+0000", 2024-04-18T21:07:11.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1999999999999999e-06 2024-04-18T21:07:11.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:11.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758028+0000", 2024-04-18T21:07:11.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7200000000000006e-06 2024-04-18T21:07:11.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:11.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758050+0000", 2024-04-18T21:07:11.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1877000000000001e-05 2024-04-18T21:07:11.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.748 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758064+0000", 2024-04-18T21:07:11.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.383e-05 2024-04-18T21:07:11.748 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.748 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:11.748 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803593+0000", 2024-04-18T21:07:11.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045528831999999998 2024-04-18T21:07:11.748 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.748 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:11.748 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803635+0000", 2024-04-18T21:07:11.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1980000000000001e-05 2024-04-18T21:07:11.748 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.749 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.749 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:11.749 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803703+0000", 2024-04-18T21:07:11.749 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8542999999999997e-05 2024-04-18T21:07:11.749 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.749 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.749 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:11.749 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806123+0000", 2024-04-18T21:07:11.749 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002419769 2024-04-18T21:07:11.749 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.749 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.749 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:11.749 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814542+0000", 2024-04-18T21:07:11.750 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084189460000000001 2024-04-18T21:07:11.750 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.750 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.750 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:11.750 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814576+0000", 2024-04-18T21:07:11.750 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3679000000000001e-05 2024-04-18T21:07:11.750 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.750 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.750 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:11.750 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814600+0000", 2024-04-18T21:07:11.750 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4187000000000001e-05 2024-04-18T21:07:11.750 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:11.750 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:11.751 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:11.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.751 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:108 3.1f 3:f83d65d8:::200.00000004:head [write 326287~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:11.751 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:07:11.751 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.939951314999998, 2024-04-18T21:07:11.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056616183, 2024-04-18T21:07:11.751 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:11.751 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:11.751 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.751 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:11.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:11.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:07:11.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:11.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.752 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:11.752 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:07:11.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:11.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.752 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:11.752 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758084+0000", 2024-04-18T21:07:11.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.124e-06 2024-04-18T21:07:11.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.753 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:11.753 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758100+0000", 2024-04-18T21:07:11.753 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6246e-05 2024-04-18T21:07:11.753 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.753 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:11.753 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758118+0000", 2024-04-18T21:07:11.753 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8267e-05 2024-04-18T21:07:11.753 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.753 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.753 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758134+0000", 2024-04-18T21:07:11.753 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5950000000000001e-05 2024-04-18T21:07:11.753 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.754 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.754 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:11.754 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803949+0000", 2024-04-18T21:07:11.754 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045815349999999998 2024-04-18T21:07:11.754 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.754 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.754 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:11.754 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804011+0000", 2024-04-18T21:07:11.754 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1044999999999996e-05 2024-04-18T21:07:11.754 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.754 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.754 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:11.754 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804128+0000", 2024-04-18T21:07:11.755 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117148 2024-04-18T21:07:11.755 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.755 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.755 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:11.755 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806794+0000", 2024-04-18T21:07:11.755 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002666692 2024-04-18T21:07:11.755 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.755 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.755 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:11.755 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814645+0000", 2024-04-18T21:07:11.755 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0078508880000000003 2024-04-18T21:07:11.755 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.755 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.755 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:11.755 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814678+0000", 2024-04-18T21:07:11.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3188999999999997e-05 2024-04-18T21:07:11.756 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.756 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:11.756 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814699+0000", 2024-04-18T21:07:11.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0284000000000001e-05 2024-04-18T21:07:11.756 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:11.756 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:11.756 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:11.756 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.756 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:109 3.1f 3:f83d65d8:::200.00000004:head [write 327693~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:11.756 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:07:11.756 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.939881948, 2024-04-18T21:07:11.757 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056621036999999999, 2024-04-18T21:07:11.757 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:11.757 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:11.757 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.757 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:11.757 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.757 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:11.757 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:07:11.757 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:11.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.757 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.757 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:11.757 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:07:11.757 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:11.758 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.758 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.758 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:11.758 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758153+0000", 2024-04-18T21:07:11.758 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1459999999999999e-06 2024-04-18T21:07:11.758 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.758 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.758 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:11.758 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758161+0000", 2024-04-18T21:07:11.758 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7999999999999999e-06 2024-04-18T21:07:11.758 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.758 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.758 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:11.759 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758179+0000", 2024-04-18T21:07:11.759 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7949999999999999e-05 2024-04-18T21:07:11.759 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.759 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.759 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758193+0000", 2024-04-18T21:07:11.759 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3773e-05 2024-04-18T21:07:11.759 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.759 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:11.759 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804632+0000", 2024-04-18T21:07:11.759 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.046439469999999997 2024-04-18T21:07:11.759 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.760 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:11.760 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804790+0000", 2024-04-18T21:07:11.760 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015784300000000001 2024-04-18T21:07:11.760 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.760 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.760 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:11.760 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805056+0000", 2024-04-18T21:07:11.760 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026652400000000003 2024-04-18T21:07:11.760 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.760 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.760 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:11.760 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.808959+0000", 2024-04-18T21:07:11.760 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003903077 2024-04-18T21:07:11.760 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.760 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.761 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:11.761 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814728+0000", 2024-04-18T21:07:11.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0057682489999999996 2024-04-18T21:07:11.761 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.761 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.761 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:11.761 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814754+0000", 2024-04-18T21:07:11.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6673999999999999e-05 2024-04-18T21:07:11.761 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.761 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.761 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:11.761 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814773+0000", 2024-04-18T21:07:11.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8530999999999999e-05 2024-04-18T21:07:11.762 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:11.762 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:11.762 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:11.762 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.762 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.762 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:110 3.1f 3:f83d65d8:::200.00000004:head [write 329098~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:11.762 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:07:11.762 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.939823538999999, 2024-04-18T21:07:11.762 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056669113, 2024-04-18T21:07:11.762 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:11.762 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:11.762 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.762 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:11.762 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.762 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:11.763 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:07:11.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:11.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.763 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:11.763 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:07:11.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:11.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.763 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:11.763 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758212+0000", 2024-04-18T21:07:11.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:07:11.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.763 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:11.764 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758219+0000", 2024-04-18T21:07:11.764 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4229999999999999e-06 2024-04-18T21:07:11.764 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.764 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.764 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:11.764 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758237+0000", 2024-04-18T21:07:11.764 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7966999999999999e-05 2024-04-18T21:07:11.764 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.764 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.764 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.764 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758252+0000", 2024-04-18T21:07:11.764 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5322999999999999e-05 2024-04-18T21:07:11.764 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.765 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.765 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:11.765 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805536+0000", 2024-04-18T21:07:11.765 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.047283861000000003 2024-04-18T21:07:11.765 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.765 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.765 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:11.765 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805579+0000", 2024-04-18T21:07:11.765 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2738999999999999e-05 2024-04-18T21:07:11.765 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.765 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.765 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:11.765 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805649+0000", 2024-04-18T21:07:11.765 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0213e-05 2024-04-18T21:07:11.765 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.766 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.766 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:11.766 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.808966+0000", 2024-04-18T21:07:11.766 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033166129999999999 2024-04-18T21:07:11.766 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.766 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.766 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:11.766 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814812+0000", 2024-04-18T21:07:11.766 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0058463589999999998 2024-04-18T21:07:11.766 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.766 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.766 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:11.766 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814854+0000", 2024-04-18T21:07:11.766 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1618e-05 2024-04-18T21:07:11.767 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.767 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.767 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:11.767 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814879+0000", 2024-04-18T21:07:11.767 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5754000000000001e-05 2024-04-18T21:07:11.767 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:11.767 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:11.767 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:11.767 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.767 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.767 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:111 3.1f 3:f83d65d8:::200.00000004:head [write 330499~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:11.767 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:07:11.767 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.939762562999999, 2024-04-18T21:07:11.767 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058693793000000001, 2024-04-18T21:07:11.768 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:11.768 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:11.768 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.768 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:11.768 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.768 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:11.768 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:07:11.768 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:11.768 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.768 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.768 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:11.768 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:07:11.768 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:11.769 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.769 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.769 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:11.769 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758272+0000", 2024-04-18T21:07:11.769 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1200000000000001e-06 2024-04-18T21:07:11.769 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.769 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.769 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:11.769 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758287+0000", 2024-04-18T21:07:11.769 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5017e-05 2024-04-18T21:07:11.769 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.769 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.769 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:11.770 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758309+0000", 2024-04-18T21:07:11.770 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1866e-05 2024-04-18T21:07:11.770 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.770 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.770 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.770 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758323+0000", 2024-04-18T21:07:11.770 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3606e-05 2024-04-18T21:07:11.770 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.770 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.770 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:11.770 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806279+0000", 2024-04-18T21:07:11.770 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.047956061000000001 2024-04-18T21:07:11.770 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.770 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.771 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:11.771 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806350+0000", 2024-04-18T21:07:11.771 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1070999999999998e-05 2024-04-18T21:07:11.771 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.771 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.771 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:11.771 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806459+0000", 2024-04-18T21:07:11.771 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000108606 2024-04-18T21:07:11.771 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.771 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.771 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:11.771 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.809774+0000", 2024-04-18T21:07:11.771 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003314881 2024-04-18T21:07:11.771 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.771 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.772 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:11.772 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816910+0000", 2024-04-18T21:07:11.772 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0071367760000000001 2024-04-18T21:07:11.772 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.772 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.772 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:11.772 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816941+0000", 2024-04-18T21:07:11.772 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0846000000000002e-05 2024-04-18T21:07:11.772 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.772 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.772 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:11.772 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816965+0000", 2024-04-18T21:07:11.772 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3943000000000001e-05 2024-04-18T21:07:11.773 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:11.773 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:11.773 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:11.773 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.773 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.773 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:5230 4.17 4:eb2cc4c4:::1000000184c.00000000:head [write 0~2191] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-18T21:07:11.773 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.760650+0000", 2024-04-18T21:07:11.773 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.937383392000001, 2024-04-18T21:07:11.773 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.054210577000000003, 2024-04-18T21:07:11.773 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:11.773 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:11.773 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.773 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:07:11.773 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:07:11.774 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:11.774 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 5230 2024-04-18T21:07:11.774 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.774 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:11.774 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.774 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:11.774 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760650+0000", 2024-04-18T21:07:11.774 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:11.774 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.774 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.774 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:11.774 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760650+0000", 2024-04-18T21:07:11.774 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:11.775 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.775 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.775 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:11.775 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760653+0000", 2024-04-18T21:07:11.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0829999999999998e-06 2024-04-18T21:07:11.775 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.775 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.775 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:11.775 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760664+0000", 2024-04-18T21:07:11.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.111e-05 2024-04-18T21:07:11.775 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.775 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.775 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:11.776 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760688+0000", 2024-04-18T21:07:11.776 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4837e-05 2024-04-18T21:07:11.776 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.776 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.776 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.776 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760702+0000", 2024-04-18T21:07:11.776 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3723000000000001e-05 2024-04-18T21:07:11.776 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.776 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.776 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:11.776 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806264+0000", 2024-04-18T21:07:11.776 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045562182 2024-04-18T21:07:11.776 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.777 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.777 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:11.777 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806351+0000", 2024-04-18T21:07:11.777 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6322000000000005e-05 2024-04-18T21:07:11.777 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.777 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.777 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:11.777 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806453+0000", 2024-04-18T21:07:11.777 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000102602 2024-04-18T21:07:11.777 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.777 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.777 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:11.777 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.808972+0000", 2024-04-18T21:07:11.777 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025184090000000001 2024-04-18T21:07:11.777 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.778 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.778 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:11.778 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814798+0000", 2024-04-18T21:07:11.778 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0058266689999999996 2024-04-18T21:07:11.778 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.778 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.778 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:11.778 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814839+0000", 2024-04-18T21:07:11.778 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0482000000000003e-05 2024-04-18T21:07:11.778 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.778 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.778 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:11.778 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814861+0000", 2024-04-18T21:07:11.778 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2158e-05 2024-04-18T21:07:11.779 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:11.779 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:11.779 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:11.779 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.779 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.779 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:112 3.1f 3:f83d65d8:::200.00000004:head [write 331898~20167 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:11.779 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.771321+0000", 2024-04-18T21:07:11.779 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.926712765000001, 2024-04-18T21:07:11.779 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045740306000000001, 2024-04-18T21:07:11.779 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:11.779 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:11.779 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.779 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:11.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:11.780 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771321+0000", 2024-04-18T21:07:11.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:11.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:11.780 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771321+0000", 2024-04-18T21:07:11.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:11.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:11.780 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771323+0000", 2024-04-18T21:07:11.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3740000000000001e-06 2024-04-18T21:07:11.781 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.781 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.781 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:11.781 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771359+0000", 2024-04-18T21:07:11.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5447999999999997e-05 2024-04-18T21:07:11.781 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.781 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.781 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:11.781 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771388+0000", 2024-04-18T21:07:11.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8915e-05 2024-04-18T21:07:11.781 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.781 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.781 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.782 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771410+0000", 2024-04-18T21:07:11.782 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1899000000000002e-05 2024-04-18T21:07:11.782 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.782 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.782 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:11.782 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806827+0000", 2024-04-18T21:07:11.782 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.035417063999999998 2024-04-18T21:07:11.782 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.782 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.782 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:11.782 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806873+0000", 2024-04-18T21:07:11.782 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6261999999999999e-05 2024-04-18T21:07:11.782 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.782 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.783 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:11.783 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806946+0000", 2024-04-18T21:07:11.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3205000000000001e-05 2024-04-18T21:07:11.783 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.783 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.783 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:11.783 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.809781+0000", 2024-04-18T21:07:11.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002834937 2024-04-18T21:07:11.783 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.783 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.783 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:11.783 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817003+0000", 2024-04-18T21:07:11.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0072217959999999999 2024-04-18T21:07:11.783 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.783 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.784 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:11.784 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817038+0000", 2024-04-18T21:07:11.784 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4696999999999997e-05 2024-04-18T21:07:11.784 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.784 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.784 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:11.784 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817061+0000", 2024-04-18T21:07:11.784 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3708999999999999e-05 2024-04-18T21:07:11.784 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:11.784 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:11.784 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:11.784 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.784 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.784 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:113 3.1f 3:f83d65d8:::200.00000004:head [write 352065~3878 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:11.784 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.771472+0000", 2024-04-18T21:07:11.785 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.926562028999999, 2024-04-18T21:07:11.785 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045689726, 2024-04-18T21:07:11.785 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:11.785 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:11.785 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.785 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:11.785 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.785 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:11.785 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771472+0000", 2024-04-18T21:07:11.785 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:11.785 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.785 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.785 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:11.785 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771472+0000", 2024-04-18T21:07:11.785 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:11.786 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.786 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.786 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:11.786 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771473+0000", 2024-04-18T21:07:11.786 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3829999999999999e-06 2024-04-18T21:07:11.786 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.786 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.786 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:11.786 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771489+0000", 2024-04-18T21:07:11.786 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5797000000000001e-05 2024-04-18T21:07:11.786 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.786 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.786 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:11.787 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771509+0000", 2024-04-18T21:07:11.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0401999999999999e-05 2024-04-18T21:07:11.787 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.787 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.787 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.787 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771525+0000", 2024-04-18T21:07:11.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5099999999999999e-05 2024-04-18T21:07:11.787 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.787 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.787 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:11.787 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807273+0000", 2024-04-18T21:07:11.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.035748488000000002 2024-04-18T21:07:11.787 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:11.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807343+0000", 2024-04-18T21:07:11.788 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0277000000000005e-05 2024-04-18T21:07:11.788 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:11.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807455+0000", 2024-04-18T21:07:11.788 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011171999999999999 2024-04-18T21:07:11.788 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:11.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.811509+0000", 2024-04-18T21:07:11.788 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0040543469999999998 2024-04-18T21:07:11.788 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.789 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:11.789 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817115+0000", 2024-04-18T21:07:11.789 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0056054520000000004 2024-04-18T21:07:11.789 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.789 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.789 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:11.789 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817142+0000", 2024-04-18T21:07:11.789 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7430999999999999e-05 2024-04-18T21:07:11.789 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.789 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.789 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:11.789 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817162+0000", 2024-04-18T21:07:11.789 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9329000000000001e-05 2024-04-18T21:07:11.789 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:11.789 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:11.790 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:11.790 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.790 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.790 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:11950 4.6 4:62753dda:::10000003222.00000000:head [write 3145728~1048576] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:11.790 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:59.346083+0000", 2024-04-18T21:07:11.790 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 12.351950800999999, 2024-04-18T21:07:11.790 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.051281119999999999, 2024-04-18T21:07:11.790 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:11.790 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:11.790 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.790 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:07:11.790 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:07:11.790 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:11.790 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 11950 2024-04-18T21:07:11.790 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.791 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:11.791 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.791 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:11.791 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.346083+0000", 2024-04-18T21:07:11.791 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:11.791 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.791 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.791 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:11.791 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.346083+0000", 2024-04-18T21:07:11.791 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:11.791 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.791 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.791 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:11.791 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.346085+0000", 2024-04-18T21:07:11.791 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.736e-06 2024-04-18T21:07:11.791 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.792 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.792 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:11.792 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.349991+0000", 2024-04-18T21:07:11.792 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0039062960000000001 2024-04-18T21:07:11.792 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.792 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.792 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:11.792 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.350006+0000", 2024-04-18T21:07:11.792 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5327000000000001e-05 2024-04-18T21:07:11.792 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.792 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.792 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.792 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.350016+0000", 2024-04-18T21:07:11.792 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3570000000000004e-06 2024-04-18T21:07:11.792 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.793 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.793 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:11.793 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.360724+0000", 2024-04-18T21:07:11.793 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010708153999999999 2024-04-18T21:07:11.793 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.793 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.793 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:11.793 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.360839+0000", 2024-04-18T21:07:11.793 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000114877 2024-04-18T21:07:11.793 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.793 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.793 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:11.793 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.397285+0000", 2024-04-18T21:07:11.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036445957000000001 2024-04-18T21:07:11.794 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.794 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.794 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:11.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.397316+0000", 2024-04-18T21:07:11.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0926000000000002e-05 2024-04-18T21:07:11.794 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.794 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.794 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:11.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.397364+0000", 2024-04-18T21:07:11.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8489999999999998e-05 2024-04-18T21:07:11.794 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:11.794 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:11.794 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:11.794 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.795 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:12225 4.11 4:8acd30ee:::100000031ed.00000000:head [write 0~4194304 [2@86041]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:11.795 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:59.667090+0000", 2024-04-18T21:07:11.795 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 12.030944185999999, 2024-04-18T21:07:11.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.047400059000000001, 2024-04-18T21:07:11.795 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:11.795 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:11.795 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.795 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:07:11.795 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:07:11.795 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:11.795 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 12225 2024-04-18T21:07:11.796 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.796 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:11.796 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.796 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:11.796 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.667090+0000", 2024-04-18T21:07:11.796 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:11.796 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.796 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.796 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:11.796 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.667090+0000", 2024-04-18T21:07:11.796 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:11.796 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.796 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.796 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:11.796 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.667091+0000", 2024-04-18T21:07:11.797 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3629999999999999e-06 2024-04-18T21:07:11.797 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.797 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.797 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:11.797 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.674492+0000", 2024-04-18T21:07:11.797 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0074007789999999997 2024-04-18T21:07:11.797 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.797 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.797 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:11.797 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.674508+0000", 2024-04-18T21:07:11.797 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6509999999999999e-05 2024-04-18T21:07:11.797 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.797 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.797 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.797 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.674518+0000", 2024-04-18T21:07:11.798 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.6290000000000005e-06 2024-04-18T21:07:11.798 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.798 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:11.798 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.674584+0000", 2024-04-18T21:07:11.798 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5597000000000002e-05 2024-04-18T21:07:11.798 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.798 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:11.798 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.674659+0000", 2024-04-18T21:07:11.798 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5168999999999998e-05 2024-04-18T21:07:11.798 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:11.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.674775+0000", 2024-04-18T21:07:11.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000116069 2024-04-18T21:07:11.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:11.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.685336+0000", 2024-04-18T21:07:11.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010561022999999999 2024-04-18T21:07:11.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:11.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.714413+0000", 2024-04-18T21:07:11.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.029077306000000001 2024-04-18T21:07:11.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.800 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.800 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:11.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.714455+0000", 2024-04-18T21:07:11.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1547e-05 2024-04-18T21:07:11.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.800 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.800 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:11.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.714490+0000", 2024-04-18T21:07:11.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5067000000000002e-05 2024-04-18T21:07:11.800 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:11.800 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:11.800 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:11.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.801 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.801 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:12689 4.26 4:64a7f444:::100000033e5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:11.801 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:00.208067+0000", 2024-04-18T21:07:11.801 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 11.489967147, 2024-04-18T21:07:11.801 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066681457, 2024-04-18T21:07:11.801 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:11.801 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:11.801 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.801 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:07:11.801 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:07:11.801 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:11.801 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 12689 2024-04-18T21:07:11.802 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.802 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:11.802 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.802 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:11.802 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.208067+0000", 2024-04-18T21:07:11.802 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:11.802 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.802 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.802 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:11.802 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.208067+0000", 2024-04-18T21:07:11.802 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:11.802 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.802 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.803 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:11.803 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.208069+0000", 2024-04-18T21:07:11.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1500000000000002e-06 2024-04-18T21:07:11.803 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.803 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:11.803 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216162+0000", 2024-04-18T21:07:11.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0080933159999999997 2024-04-18T21:07:11.803 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.803 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:11.803 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216181+0000", 2024-04-18T21:07:11.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8573e-05 2024-04-18T21:07:11.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.804 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.804 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216192+0000", 2024-04-18T21:07:11.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0767999999999999e-05 2024-04-18T21:07:11.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.804 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:11.804 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216259+0000", 2024-04-18T21:07:11.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7977000000000003e-05 2024-04-18T21:07:11.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.804 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:11.804 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216635+0000", 2024-04-18T21:07:11.805 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00037591300000000002 2024-04-18T21:07:11.805 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.805 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.805 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:11.805 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216929+0000", 2024-04-18T21:07:11.805 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00029314800000000002 2024-04-18T21:07:11.805 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.805 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.805 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:11.805 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.232918+0000", 2024-04-18T21:07:11.805 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015989903 2024-04-18T21:07:11.805 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.805 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.806 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:11.806 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.274643+0000", 2024-04-18T21:07:11.806 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.041724281000000002 2024-04-18T21:07:11.806 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.806 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.806 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:11.806 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.274701+0000", 2024-04-18T21:07:11.806 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8304999999999998e-05 2024-04-18T21:07:11.806 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.806 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.806 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:11.806 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.274748+0000", 2024-04-18T21:07:11.806 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7123000000000003e-05 2024-04-18T21:07:11.807 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:11.807 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:11.807 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:11.807 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.807 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.807 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4534.0:15094 4.c e59/16 4:32870457:::10000003692.00000000:head v 59'213, mlcod=59'211)", 2024-04-18T21:07:11.807 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:03.117817+0000", 2024-04-18T21:07:11.807 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.5802170760000003, 2024-04-18T21:07:11.807 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.049868875999999999, 2024-04-18T21:07:11.807 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:11.807 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:11.807 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:11.807 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:11.807 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:11.808 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.117817+0000", 2024-04-18T21:07:11.808 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:11.808 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.808 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:11.808 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.117817+0000", 2024-04-18T21:07:11.808 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:11.808 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.808 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:11.808 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.117817+0000", 2024-04-18T21:07:11.808 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0200000000000003e-07 2024-04-18T21:07:11.808 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.808 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:11.809 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.140525+0000", 2024-04-18T21:07:11.809 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.022707775999999999 2024-04-18T21:07:11.809 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.809 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:11.809 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.140549+0000", 2024-04-18T21:07:11.809 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4456000000000001e-05 2024-04-18T21:07:11.809 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.809 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.809 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.140563+0000", 2024-04-18T21:07:11.809 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.329e-05 2024-04-18T21:07:11.809 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.809 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:11.810 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.140797+0000", 2024-04-18T21:07:11.810 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023447400000000001 2024-04-18T21:07:11.810 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.810 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.810 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:11.810 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.140842+0000", 2024-04-18T21:07:11.810 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5287000000000002e-05 2024-04-18T21:07:11.810 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.810 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.810 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:11.810 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.167577+0000", 2024-04-18T21:07:11.810 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.026734745000000001 2024-04-18T21:07:11.810 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:11.811 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:11.811 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:11.811 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.167686+0000", 2024-04-18T21:07:11.811 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000108446 2024-04-18T21:07:11.811 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:11.811 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:11.811 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:11.811 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:11.811 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:11.811 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:07:11.813 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:07:11.813 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:11.813+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:11.913 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:11.914+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:11.948 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:07:11.948 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [ 2024-04-18T21:07:11.948 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.948 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7671 4.31 4.ed85a931 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:11.949 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882728+0000", 2024-04-18T21:07:11.949 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.068031537000000003, 2024-04-18T21:07:11.949 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.068076832000000004, 2024-04-18T21:07:11.949 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:11.949 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:11.949 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "waiting for peered", 2024-04-18T21:07:11.949 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:11.949 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.949 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:11.949 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882728+0000", 2024-04-18T21:07:11.949 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:11.949 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.950 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.950 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:11.950 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882728+0000", 2024-04-18T21:07:11.950 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:11.950 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.950 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.950 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:11.950 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882728+0000", 2024-04-18T21:07:11.950 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.0399999999999996e-07 2024-04-18T21:07:11.950 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.950 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.950 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:11.950 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882731+0000", 2024-04-18T21:07:11.950 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.5239999999999999e-06 2024-04-18T21:07:11.950 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.951 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.951 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:11.951 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882739+0000", 2024-04-18T21:07:11.951 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4020000000000002e-06 2024-04-18T21:07:11.951 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.951 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.951 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.951 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882744+0000", 2024-04-18T21:07:11.951 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.1410000000000004e-06 2024-04-18T21:07:11.951 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.951 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.951 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:11.951 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882836+0000", 2024-04-18T21:07:11.951 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.2094000000000003e-05 2024-04-18T21:07:11.951 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.952 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.952 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:07:11.952 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882849+0000", 2024-04-18T21:07:11.952 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3087e-05 2024-04-18T21:07:11.952 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.952 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.952 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:11.952 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.889522+0000", 2024-04-18T21:07:11.952 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0066730950000000004 2024-04-18T21:07:11.952 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.952 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.952 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:11.952 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.889530+0000", 2024-04-18T21:07:11.953 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8699999999999992e-06 2024-04-18T21:07:11.953 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:11.953 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:11.953 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:11.953 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.953 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.953 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7691 4.d 4.69ca2c0d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:11.953 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882753+0000", 2024-04-18T21:07:11.953 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.068006557999999995, 2024-04-18T21:07:11.953 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.068174061999999994, 2024-04-18T21:07:11.953 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:11.953 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:11.953 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "waiting for peered", 2024-04-18T21:07:11.953 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:11.954 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.954 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:11.954 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882753+0000", 2024-04-18T21:07:11.954 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:11.954 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.954 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.954 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:11.954 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882753+0000", 2024-04-18T21:07:11.954 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:11.954 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.954 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.954 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:11.954 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882753+0000", 2024-04-18T21:07:11.955 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.9000000000000002e-07 2024-04-18T21:07:11.955 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.955 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.955 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:11.955 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882755+0000", 2024-04-18T21:07:11.955 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.4040000000000002e-06 2024-04-18T21:07:11.955 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.955 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.955 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:11.955 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882762+0000", 2024-04-18T21:07:11.955 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.6229999999999999e-06 2024-04-18T21:07:11.955 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.955 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.956 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.956 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882769+0000", 2024-04-18T21:07:11.956 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.1559999999999998e-06 2024-04-18T21:07:11.956 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.956 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.956 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:11.956 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882875+0000", 2024-04-18T21:07:11.956 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000105491 2024-04-18T21:07:11.956 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.956 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.956 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:07:11.956 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882879+0000", 2024-04-18T21:07:11.957 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.9999999999999998e-06 2024-04-18T21:07:11.957 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.957 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.957 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:11.957 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.892072+0000", 2024-04-18T21:07:11.957 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0091930989999999997 2024-04-18T21:07:11.957 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.957 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.957 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:11.957 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.892083+0000", 2024-04-18T21:07:11.957 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1070000000000001e-05 2024-04-18T21:07:11.957 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:11.957 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:11.957 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:11.957 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.958 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.958 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7616 4.d 4.6d57ef8d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:11.958 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882522+0000", 2024-04-18T21:07:11.958 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.068236799000000001, 2024-04-18T21:07:11.958 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.068516170000000001, 2024-04-18T21:07:11.958 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:11.958 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:11.958 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "waiting for peered", 2024-04-18T21:07:11.958 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:11.958 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.958 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:11.958 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882522+0000", 2024-04-18T21:07:11.958 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:11.958 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.959 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.959 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:11.959 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882522+0000", 2024-04-18T21:07:11.959 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:11.959 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.959 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.959 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:11.959 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882524+0000", 2024-04-18T21:07:11.959 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4720000000000001e-06 2024-04-18T21:07:11.959 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.959 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.959 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:11.959 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882531+0000", 2024-04-18T21:07:11.960 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7830000000000001e-06 2024-04-18T21:07:11.960 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.960 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.960 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:11.960 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882549+0000", 2024-04-18T21:07:11.960 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8765000000000001e-05 2024-04-18T21:07:11.960 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.960 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.960 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.960 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882562+0000", 2024-04-18T21:07:11.960 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3117e-05 2024-04-18T21:07:11.960 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.960 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.961 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:11.961 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882690+0000", 2024-04-18T21:07:11.961 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012794799999999999 2024-04-18T21:07:11.961 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.961 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.961 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op must wait for map", 2024-04-18T21:07:11.961 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882701+0000", 2024-04-18T21:07:11.961 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0215e-05 2024-04-18T21:07:11.961 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.961 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.961 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:11.961 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.891964+0000", 2024-04-18T21:07:11.961 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0092636130000000004 2024-04-18T21:07:11.961 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.961 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.962 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:11.962 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.891976+0000", 2024-04-18T21:07:11.962 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1973e-05 2024-04-18T21:07:11.962 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:11.962 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:11.962 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:11.962 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.962 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.962 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7628 4.31 4.b39fe931 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:11.962 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882610+0000", 2024-04-18T21:07:11.962 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.068149069000000007, 2024-04-18T21:07:11.962 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.068535585999999996, 2024-04-18T21:07:11.962 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:11.962 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:11.963 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "waiting for peered", 2024-04-18T21:07:11.963 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:11.963 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.963 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:11.963 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882610+0000", 2024-04-18T21:07:11.963 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:11.963 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.963 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.963 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:11.963 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882610+0000", 2024-04-18T21:07:11.963 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:11.963 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.963 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.963 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:11.963 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882611+0000", 2024-04-18T21:07:11.963 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.4199999999999995e-07 2024-04-18T21:07:11.964 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.964 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.964 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:11.964 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882614+0000", 2024-04-18T21:07:11.964 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.4300000000000002e-06 2024-04-18T21:07:11.964 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.964 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.964 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:11.964 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882623+0000", 2024-04-18T21:07:11.964 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8740000000000001e-06 2024-04-18T21:07:11.964 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.964 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.964 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.964 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882629+0000", 2024-04-18T21:07:11.964 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.4330000000000001e-06 2024-04-18T21:07:11.964 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.965 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.965 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:11.965 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882706+0000", 2024-04-18T21:07:11.965 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.6280999999999997e-05 2024-04-18T21:07:11.965 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.965 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.965 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op must wait for map", 2024-04-18T21:07:11.965 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882715+0000", 2024-04-18T21:07:11.965 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.1679999999999993e-06 2024-04-18T21:07:11.965 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.965 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.965 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:11.965 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.889481+0000", 2024-04-18T21:07:11.965 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0067656979999999997 2024-04-18T21:07:11.966 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.966 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.966 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:11.966 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.889493+0000", 2024-04-18T21:07:11.966 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2451e-05 2024-04-18T21:07:11.966 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:11.966 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:11.966 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:11.966 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.966 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.966 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7630 4.d 4.4013440d (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:11.966 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882645+0000", 2024-04-18T21:07:11.966 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.068113784999999996, 2024-04-18T21:07:11.966 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.068607451999999999, 2024-04-18T21:07:11.967 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:11.967 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:11.967 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "waiting for peered", 2024-04-18T21:07:11.967 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:11.967 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.967 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:11.967 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882645+0000", 2024-04-18T21:07:11.967 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:11.967 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.967 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.967 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:11.967 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882645+0000", 2024-04-18T21:07:11.967 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:11.967 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.968 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.968 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:11.968 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882646+0000", 2024-04-18T21:07:11.968 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.3599999999999999e-07 2024-04-18T21:07:11.968 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.968 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.968 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:11.968 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882648+0000", 2024-04-18T21:07:11.968 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.5809999999999999e-06 2024-04-18T21:07:11.968 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.968 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.968 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:11.968 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882655+0000", 2024-04-18T21:07:11.969 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7909999999999999e-06 2024-04-18T21:07:11.969 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.969 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.969 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.969 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882661+0000", 2024-04-18T21:07:11.969 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3920000000000002e-06 2024-04-18T21:07:11.969 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.969 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.969 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:11.969 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882825+0000", 2024-04-18T21:07:11.969 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016480100000000001 2024-04-18T21:07:11.969 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.969 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.969 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:07:11.970 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882840+0000", 2024-04-18T21:07:11.970 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4656e-05 2024-04-18T21:07:11.970 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.970 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.970 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:11.970 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.892020+0000", 2024-04-18T21:07:11.970 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0091804680000000007 2024-04-18T21:07:11.970 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.970 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.970 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:11.970 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.892026+0000", 2024-04-18T21:07:11.970 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4580000000000001e-06 2024-04-18T21:07:11.970 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:11.971 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:11.971 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:11.971 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.971 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.971 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7651 4.13 4.a3d8a993 (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:11.971 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882696+0000", 2024-04-18T21:07:11.971 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.068063371999999997, 2024-04-18T21:07:11.971 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.068663475000000002, 2024-04-18T21:07:11.971 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:11.971 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:11.971 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "waiting for peered", 2024-04-18T21:07:11.971 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:11.971 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.971 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:11.971 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882696+0000", 2024-04-18T21:07:11.971 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:11.972 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.972 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.972 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:11.972 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882696+0000", 2024-04-18T21:07:11.972 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:11.972 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.972 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.972 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:11.972 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882696+0000", 2024-04-18T21:07:11.972 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.06e-07 2024-04-18T21:07:11.972 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.972 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.972 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:11.972 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882699+0000", 2024-04-18T21:07:11.972 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.1039999999999998e-06 2024-04-18T21:07:11.973 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.973 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.973 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:11.973 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882707+0000", 2024-04-18T21:07:11.973 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.593e-06 2024-04-18T21:07:11.973 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.973 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.973 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:11.973 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882712+0000", 2024-04-18T21:07:11.973 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.541e-06 2024-04-18T21:07:11.973 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.973 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.973 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:11.974 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882870+0000", 2024-04-18T21:07:11.974 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000157999 2024-04-18T21:07:11.974 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.974 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.974 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op must wait for map", 2024-04-18T21:07:11.974 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882885+0000", 2024-04-18T21:07:11.974 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4989e-05 2024-04-18T21:07:11.974 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.974 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.974 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:11.974 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.891447+0000", 2024-04-18T21:07:11.974 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0085618540000000007 2024-04-18T21:07:11.974 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:11.974 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:11.974 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:11.975 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.891457+0000", 2024-04-18T21:07:11.975 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.6399999999999992e-06 2024-04-18T21:07:11.975 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:11.975 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:11.975 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:11.975 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:11.975 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2024-04-18T21:07:11.975 INFO:teuthology.orchestra.run.smithi132.stdout: "num_ops": 6 2024-04-18T21:07:11.975 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:07:11.976 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:07:12.023 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:12.025+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:12.099 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:07:12.099 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:07:12.099 INFO:teuthology.orchestra.run.smithi132.stdout: "complaint_time": 30, 2024-04-18T21:07:12.099 INFO:teuthology.orchestra.run.smithi132.stdout: "num_blocked_ops": 0 2024-04-18T21:07:12.099 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:07:12.115 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:07:12.115 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:12.114+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:12.215 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:12.217+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:12.284 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:07:12.284 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 20, 2024-04-18T21:07:12.284 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 600, 2024-04-18T21:07:12.284 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [ 2024-04-18T21:07:12.284 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.284 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:12.285 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:07:12.285 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 126.666951891, 2024-04-18T21:07:12.285 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043251955000000002, 2024-04-18T21:07:12.285 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:12.285 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:12.285 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:12.285 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:12.285 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.285 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:12.285 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:07:12.285 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:12.285 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.285 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.285 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:12.285 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:07:12.286 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:12.286 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.286 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.286 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:12.286 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616536+0000", 2024-04-18T21:07:12.286 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2869999999999999e-06 2024-04-18T21:07:12.286 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.286 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.286 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:12.286 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616572+0000", 2024-04-18T21:07:12.286 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.6261999999999999e-05 2024-04-18T21:07:12.286 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.286 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.286 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:12.287 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616593+0000", 2024-04-18T21:07:12.287 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1310000000000001e-05 2024-04-18T21:07:12.287 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.287 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.287 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:12.287 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616614+0000", 2024-04-18T21:07:12.287 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.0936000000000001e-05 2024-04-18T21:07:12.287 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.287 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.287 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:12.287 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629501+0000", 2024-04-18T21:07:12.287 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.012886819000000001 2024-04-18T21:07:12.287 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.287 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.287 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:12.288 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629696+0000", 2024-04-18T21:07:12.288 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019485499999999999 2024-04-18T21:07:12.288 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.288 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.288 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:12.288 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629940+0000", 2024-04-18T21:07:12.288 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00024386399999999999 2024-04-18T21:07:12.288 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.288 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.288 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:12.288 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640100+0000", 2024-04-18T21:07:12.288 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010159645 2024-04-18T21:07:12.288 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.288 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.288 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:12.288 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659516+0000", 2024-04-18T21:07:12.289 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019416563000000001 2024-04-18T21:07:12.289 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.289 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.289 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:12.289 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659684+0000", 2024-04-18T21:07:12.289 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016750900000000001 2024-04-18T21:07:12.289 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.289 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.289 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:12.289 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659787+0000", 2024-04-18T21:07:12.289 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000102905 2024-04-18T21:07:12.289 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:12.289 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:12.289 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:12.289 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.289 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.290 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:12.290 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:07:12.290 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 126.666846769, 2024-04-18T21:07:12.290 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043581898000000001, 2024-04-18T21:07:12.290 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:12.290 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:12.290 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:12.290 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:12.290 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.290 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:12.290 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:07:12.290 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:12.290 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.290 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.290 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:12.291 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:07:12.291 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:12.291 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.291 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.291 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:12.291 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616641+0000", 2024-04-18T21:07:12.291 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:07:12.291 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.291 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.291 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:12.291 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616648+0000", 2024-04-18T21:07:12.291 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3860000000000001e-06 2024-04-18T21:07:12.291 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.291 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.291 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:12.291 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616666+0000", 2024-04-18T21:07:12.292 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7583000000000001e-05 2024-04-18T21:07:12.292 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.292 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.292 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:12.292 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616679+0000", 2024-04-18T21:07:12.292 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3322999999999999e-05 2024-04-18T21:07:12.292 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.292 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.292 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:12.292 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630373+0000", 2024-04-18T21:07:12.292 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013694207999999999 2024-04-18T21:07:12.292 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.292 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.292 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:12.292 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630545+0000", 2024-04-18T21:07:12.292 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000171683 2024-04-18T21:07:12.293 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.293 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.293 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:12.293 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630728+0000", 2024-04-18T21:07:12.293 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000182599 2024-04-18T21:07:12.293 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.293 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.293 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:12.293 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640600+0000", 2024-04-18T21:07:12.293 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0098726119999999994 2024-04-18T21:07:12.293 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.293 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.293 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:12.293 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659927+0000", 2024-04-18T21:07:12.293 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019326724999999999 2024-04-18T21:07:12.293 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.294 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.294 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:12.294 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660112+0000", 2024-04-18T21:07:12.294 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000185203 2024-04-18T21:07:12.294 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.294 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.294 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:12.294 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660222+0000", 2024-04-18T21:07:12.294 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109343 2024-04-18T21:07:12.294 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:12.294 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:12.294 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:12.294 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.294 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.294 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:12.294 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:07:12.295 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 126.665981411, 2024-04-18T21:07:12.295 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043121310000000003, 2024-04-18T21:07:12.295 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:12.295 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:12.295 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:12.295 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:12.295 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.295 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:12.295 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:07:12.295 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:12.295 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.295 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.295 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:12.295 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617505+0000", 2024-04-18T21:07:12.295 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:12.296 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.296 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.296 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:12.296 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617506+0000", 2024-04-18T21:07:12.296 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9999999999999995e-07 2024-04-18T21:07:12.296 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.296 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.296 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:12.296 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617513+0000", 2024-04-18T21:07:12.296 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.9700000000000002e-06 2024-04-18T21:07:12.296 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.296 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.296 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:12.296 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617531+0000", 2024-04-18T21:07:12.296 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8105999999999999e-05 2024-04-18T21:07:12.296 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.297 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.297 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:12.297 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.617545+0000", 2024-04-18T21:07:12.297 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3703000000000001e-05 2024-04-18T21:07:12.297 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.297 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.297 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:12.297 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632129+0000", 2024-04-18T21:07:12.297 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.014584135999999999 2024-04-18T21:07:12.297 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.297 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.297 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:12.297 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632361+0000", 2024-04-18T21:07:12.297 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00023171800000000001 2024-04-18T21:07:12.297 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.298 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.298 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:12.298 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.632804+0000", 2024-04-18T21:07:12.298 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000443549 2024-04-18T21:07:12.298 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.298 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.298 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:12.298 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.646340+0000", 2024-04-18T21:07:12.298 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013535902000000001 2024-04-18T21:07:12.298 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.298 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.298 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:12.298 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660363+0000", 2024-04-18T21:07:12.298 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.01402318 2024-04-18T21:07:12.298 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.299 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.299 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:12.299 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660523+0000", 2024-04-18T21:07:12.299 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00015989899999999999 2024-04-18T21:07:12.299 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.299 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.299 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:12.299 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660626+0000", 2024-04-18T21:07:12.299 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00010314699999999999 2024-04-18T21:07:12.299 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:12.299 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:12.299 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:12.299 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.299 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.299 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11357 4.38 4:1d691e75:::1000000312c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T21:07:12.300 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:58.595279+0000", 2024-04-18T21:07:12.300 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 13.688207859, 2024-04-18T21:07:12.300 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.045901399000000002, 2024-04-18T21:07:12.300 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:12.300 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:12.300 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:12.300 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:12.300 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:12.300 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:12.300 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11357 2024-04-18T21:07:12.300 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.300 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:12.300 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.300 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:12.300 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.595279+0000", 2024-04-18T21:07:12.300 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:12.301 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.301 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.301 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:12.301 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.595279+0000", 2024-04-18T21:07:12.301 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:12.301 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.301 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.301 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:12.301 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.595280+0000", 2024-04-18T21:07:12.301 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.079e-06 2024-04-18T21:07:12.301 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.301 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.301 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:12.301 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600237+0000", 2024-04-18T21:07:12.301 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0049569089999999998 2024-04-18T21:07:12.302 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.302 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.302 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:12.302 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600254+0000", 2024-04-18T21:07:12.302 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7399000000000001e-05 2024-04-18T21:07:12.302 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.302 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.302 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:12.302 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600262+0000", 2024-04-18T21:07:12.302 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.174e-06 2024-04-18T21:07:12.302 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.302 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.302 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:12.302 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600359+0000", 2024-04-18T21:07:12.302 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.6358000000000001e-05 2024-04-18T21:07:12.302 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.303 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.303 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:12.303 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600507+0000", 2024-04-18T21:07:12.303 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014854199999999999 2024-04-18T21:07:12.303 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.303 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.303 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:12.303 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600748+0000", 2024-04-18T21:07:12.303 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000241361 2024-04-18T21:07:12.303 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.303 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.303 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:12.303 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.615590+0000", 2024-04-18T21:07:12.303 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.014841851 2024-04-18T21:07:12.303 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.303 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.303 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:12.304 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.639817+0000", 2024-04-18T21:07:12.304 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024226527000000001 2024-04-18T21:07:12.304 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.304 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.304 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:12.304 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.640962+0000", 2024-04-18T21:07:12.304 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001145561 2024-04-18T21:07:12.304 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.304 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.304 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:12.304 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.641180+0000", 2024-04-18T21:07:12.304 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00021763800000000001 2024-04-18T21:07:12.304 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:12.304 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:12.304 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:12.304 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.305 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.305 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11443 4.38 4:1d691e75:::1000000312c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T21:07:12.305 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:58.744218+0000", 2024-04-18T21:07:12.305 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 13.539268193, 2024-04-18T21:07:12.305 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.051074359999999999, 2024-04-18T21:07:12.305 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:12.305 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:12.305 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:12.305 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:12.305 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:12.305 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:12.305 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11443 2024-04-18T21:07:12.305 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.305 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:12.305 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.305 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:12.306 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.744218+0000", 2024-04-18T21:07:12.306 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:12.306 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.306 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.306 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:12.306 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.744218+0000", 2024-04-18T21:07:12.306 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:12.306 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.306 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.306 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:12.306 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.744221+0000", 2024-04-18T21:07:12.306 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.3580000000000001e-06 2024-04-18T21:07:12.306 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.306 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.306 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:12.307 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753328+0000", 2024-04-18T21:07:12.307 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0091071339999999994 2024-04-18T21:07:12.307 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.307 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.307 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:12.307 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753351+0000", 2024-04-18T21:07:12.307 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.3479999999999999e-05 2024-04-18T21:07:12.307 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.307 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.307 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:12.307 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753363+0000", 2024-04-18T21:07:12.307 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1345000000000001e-05 2024-04-18T21:07:12.307 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.307 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.307 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:12.307 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753416+0000", 2024-04-18T21:07:12.307 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.2849999999999997e-05 2024-04-18T21:07:12.308 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.308 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.308 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:12.308 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753471+0000", 2024-04-18T21:07:12.308 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5717999999999997e-05 2024-04-18T21:07:12.308 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.308 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.308 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:12.308 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753560+0000", 2024-04-18T21:07:12.308 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8777999999999996e-05 2024-04-18T21:07:12.308 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.308 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.308 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:12.308 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.760182+0000", 2024-04-18T21:07:12.308 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0066216299999999999 2024-04-18T21:07:12.308 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.309 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.309 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:12.309 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.795094+0000", 2024-04-18T21:07:12.309 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.034912334000000003 2024-04-18T21:07:12.309 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.309 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.309 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:12.309 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.795221+0000", 2024-04-18T21:07:12.309 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012745899999999999 2024-04-18T21:07:12.309 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.309 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.309 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:12.309 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.795293+0000", 2024-04-18T21:07:12.309 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.1273999999999996e-05 2024-04-18T21:07:12.310 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:12.310 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:12.310 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:12.310 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.310 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.310 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11511 4.18 4:184fae4a:::1000000316d.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:12.310 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:58.838500+0000", 2024-04-18T21:07:12.310 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 13.444986312999999, 2024-04-18T21:07:12.310 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.044451537999999999, 2024-04-18T21:07:12.310 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:12.310 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:12.310 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:12.310 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:12.310 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:12.311 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:12.311 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11511 2024-04-18T21:07:12.311 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.311 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:12.311 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.311 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:12.311 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.838500+0000", 2024-04-18T21:07:12.311 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:12.311 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.311 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.311 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:12.311 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.838500+0000", 2024-04-18T21:07:12.311 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:12.311 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.311 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.311 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:12.312 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.838501+0000", 2024-04-18T21:07:12.312 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.4799999999999997e-07 2024-04-18T21:07:12.312 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.312 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.312 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:12.312 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.847806+0000", 2024-04-18T21:07:12.312 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0093054250000000008 2024-04-18T21:07:12.312 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.312 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.312 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:12.312 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.847834+0000", 2024-04-18T21:07:12.312 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7161999999999998e-05 2024-04-18T21:07:12.312 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.312 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.312 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:12.312 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.847849+0000", 2024-04-18T21:07:12.313 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5217e-05 2024-04-18T21:07:12.313 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.313 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.313 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:12.313 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.847917+0000", 2024-04-18T21:07:12.313 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7896000000000002e-05 2024-04-18T21:07:12.313 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.313 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.313 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:12.313 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.848080+0000", 2024-04-18T21:07:12.313 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016328299999999999 2024-04-18T21:07:12.313 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.313 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.313 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:12.313 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.848348+0000", 2024-04-18T21:07:12.313 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00026766099999999998 2024-04-18T21:07:12.314 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.314 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.314 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:12.314 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.863288+0000", 2024-04-18T21:07:12.314 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.014940301 2024-04-18T21:07:12.314 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.314 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.314 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:12.314 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.882854+0000", 2024-04-18T21:07:12.314 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019566456999999999 2024-04-18T21:07:12.314 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.314 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.314 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:12.314 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.882904+0000", 2024-04-18T21:07:12.314 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.9620999999999998e-05 2024-04-18T21:07:12.315 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.315 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.315 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:12.315 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.882952+0000", 2024-04-18T21:07:12.315 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.7766999999999999e-05 2024-04-18T21:07:12.315 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:12.315 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:12.315 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:12.315 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.315 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.315 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11728 4.39 4:9dcc5ecf:::1000000316e.00000000:head [write 0~4194304 [2@1720266]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:12.315 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.088728+0000", 2024-04-18T21:07:12.315 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 13.194758446, 2024-04-18T21:07:12.315 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.047519835000000003, 2024-04-18T21:07:12.315 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:12.315 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:12.316 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:12.316 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:12.316 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:12.316 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:12.316 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11728 2024-04-18T21:07:12.316 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.316 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:12.316 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.316 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:12.316 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.088728+0000", 2024-04-18T21:07:12.316 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:12.316 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.316 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.316 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:12.316 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.088728+0000", 2024-04-18T21:07:12.316 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:12.317 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.317 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.317 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:12.317 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.088729+0000", 2024-04-18T21:07:12.317 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1000000000000001e-06 2024-04-18T21:07:12.317 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.317 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.317 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:12.317 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094322+0000", 2024-04-18T21:07:12.317 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0055931349999999999 2024-04-18T21:07:12.317 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.317 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.317 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:12.317 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094334+0000", 2024-04-18T21:07:12.317 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1894e-05 2024-04-18T21:07:12.318 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.318 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.318 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:12.318 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094340+0000", 2024-04-18T21:07:12.318 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.8780000000000003e-06 2024-04-18T21:07:12.318 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.318 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.318 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:12.318 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094393+0000", 2024-04-18T21:07:12.318 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3275000000000001e-05 2024-04-18T21:07:12.318 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.318 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.318 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:12.318 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094479+0000", 2024-04-18T21:07:12.319 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5222999999999994e-05 2024-04-18T21:07:12.319 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.319 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.319 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:12.319 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094629+0000", 2024-04-18T21:07:12.319 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00015021699999999999 2024-04-18T21:07:12.319 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.319 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.319 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:12.319 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.102975+0000", 2024-04-18T21:07:12.319 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0083464460000000004 2024-04-18T21:07:12.319 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.319 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.319 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:12.319 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136142+0000", 2024-04-18T21:07:12.319 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.033166432000000003 2024-04-18T21:07:12.319 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.320 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.320 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:12.320 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136207+0000", 2024-04-18T21:07:12.320 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.5032999999999999e-05 2024-04-18T21:07:12.320 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.320 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.320 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:12.320 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136248+0000", 2024-04-18T21:07:12.320 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.1202000000000003e-05 2024-04-18T21:07:12.320 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:12.320 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:12.320 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:12.320 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.320 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.320 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11731 4.39 4:9dcc5ecf:::1000000316e.00000000:head [write 3247277~11534 [2@1720266] in=11534b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:12.320 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.094419+0000", 2024-04-18T21:07:12.321 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 13.189067249000001, 2024-04-18T21:07:12.321 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.042530119999999998, 2024-04-18T21:07:12.321 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:12.321 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:12.321 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:12.321 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:12.321 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:12.321 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:12.321 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11731 2024-04-18T21:07:12.321 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.321 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:12.321 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.321 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:12.321 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094419+0000", 2024-04-18T21:07:12.321 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:12.322 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.322 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.322 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:12.322 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094419+0000", 2024-04-18T21:07:12.322 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:12.322 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.322 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.322 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:12.322 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094420+0000", 2024-04-18T21:07:12.322 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.6400000000000003e-07 2024-04-18T21:07:12.322 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.322 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.322 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:12.322 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094429+0000", 2024-04-18T21:07:12.322 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.2359999999999993e-06 2024-04-18T21:07:12.323 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.323 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.323 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:12.323 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094433+0000", 2024-04-18T21:07:12.323 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.155e-06 2024-04-18T21:07:12.323 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.323 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.323 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:12.323 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094436+0000", 2024-04-18T21:07:12.323 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.0529999999999998e-06 2024-04-18T21:07:12.323 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.323 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.323 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:12.323 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.099720+0000", 2024-04-18T21:07:12.323 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0052837370000000002 2024-04-18T21:07:12.323 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.324 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.324 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:12.324 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.099793+0000", 2024-04-18T21:07:12.324 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.2959000000000004e-05 2024-04-18T21:07:12.324 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.324 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.324 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:12.324 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.099884+0000", 2024-04-18T21:07:12.324 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.1032999999999994e-05 2024-04-18T21:07:12.324 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.324 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.324 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:12.324 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.103177+0000", 2024-04-18T21:07:12.324 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0032935210000000002 2024-04-18T21:07:12.324 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.324 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.325 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:12.325 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136826+0000", 2024-04-18T21:07:12.325 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.033648521000000001 2024-04-18T21:07:12.325 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.325 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.325 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:12.325 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136896+0000", 2024-04-18T21:07:12.325 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0457000000000007e-05 2024-04-18T21:07:12.325 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.325 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.325 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:12.325 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136949+0000", 2024-04-18T21:07:12.325 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.2984e-05 2024-04-18T21:07:12.325 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:12.325 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:12.325 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:12.326 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.326 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.326 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11847 4.a 4:51f063b7:::100000032b5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:12.326 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.229180+0000", 2024-04-18T21:07:12.326 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 13.054306390000001, 2024-04-18T21:07:12.326 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.048001033999999998, 2024-04-18T21:07:12.326 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:12.326 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:12.326 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:12.326 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:12.326 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:12.326 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:12.326 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11847 2024-04-18T21:07:12.326 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.326 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:12.327 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.327 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:12.327 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.229180+0000", 2024-04-18T21:07:12.327 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:12.327 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.327 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.327 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:12.327 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.229180+0000", 2024-04-18T21:07:12.327 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:12.327 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.327 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.327 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:12.327 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.229181+0000", 2024-04-18T21:07:12.327 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.119e-06 2024-04-18T21:07:12.327 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.327 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.328 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:12.328 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.235951+0000", 2024-04-18T21:07:12.328 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0067702370000000001 2024-04-18T21:07:12.328 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.328 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.328 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:12.328 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.235965+0000", 2024-04-18T21:07:12.328 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3202e-05 2024-04-18T21:07:12.328 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.328 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.328 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:12.328 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.235973+0000", 2024-04-18T21:07:12.328 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8630000000000008e-06 2024-04-18T21:07:12.328 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.328 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.328 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:12.329 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.236047+0000", 2024-04-18T21:07:12.329 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.4453e-05 2024-04-18T21:07:12.329 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.329 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.329 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:12.329 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.236137+0000", 2024-04-18T21:07:12.329 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.9751000000000002e-05 2024-04-18T21:07:12.329 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.329 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.329 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:12.329 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.236266+0000", 2024-04-18T21:07:12.329 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000129257 2024-04-18T21:07:12.329 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.329 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.329 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:12.329 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.244520+0000", 2024-04-18T21:07:12.329 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0082538190000000008 2024-04-18T21:07:12.330 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.330 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.330 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:12.330 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.277093+0000", 2024-04-18T21:07:12.330 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.032573405999999999 2024-04-18T21:07:12.330 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.330 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.330 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:12.330 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.277144+0000", 2024-04-18T21:07:12.330 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.0553000000000002e-05 2024-04-18T21:07:12.330 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.330 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.330 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:12.330 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.277181+0000", 2024-04-18T21:07:12.330 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.7373999999999998e-05 2024-04-18T21:07:12.330 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:12.331 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:12.331 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:12.331 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.331 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.331 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11949 4.2b 4:d50cc3c5:::100000031c6.00000000:head [write 0~3145728] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:12.331 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.338113+0000", 2024-04-18T21:07:12.331 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 12.945373514, 2024-04-18T21:07:12.331 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.046907847000000003, 2024-04-18T21:07:12.331 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:12.331 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:12.331 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:12.331 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:12.331 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:12.331 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:12.332 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11949 2024-04-18T21:07:12.332 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.332 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:12.332 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.332 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:12.332 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.338113+0000", 2024-04-18T21:07:12.332 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:12.332 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.332 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.332 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:12.332 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.338113+0000", 2024-04-18T21:07:12.332 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:12.332 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.332 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.332 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:12.333 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.338115+0000", 2024-04-18T21:07:12.333 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5659999999999999e-06 2024-04-18T21:07:12.333 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.333 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.333 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:12.333 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344146+0000", 2024-04-18T21:07:12.333 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0060309339999999999 2024-04-18T21:07:12.333 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.333 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.333 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:12.333 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344163+0000", 2024-04-18T21:07:12.333 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6994999999999999e-05 2024-04-18T21:07:12.333 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.333 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.334 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:12.334 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344171+0000", 2024-04-18T21:07:12.334 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5520000000000005e-06 2024-04-18T21:07:12.334 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.334 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.334 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:12.334 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344604+0000", 2024-04-18T21:07:12.334 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00043326299999999997 2024-04-18T21:07:12.334 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.334 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.334 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:12.334 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344687+0000", 2024-04-18T21:07:12.334 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.2952000000000001e-05 2024-04-18T21:07:12.334 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.334 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.334 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:12.335 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344792+0000", 2024-04-18T21:07:12.335 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000104635 2024-04-18T21:07:12.335 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.335 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.335 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:12.335 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.361867+0000", 2024-04-18T21:07:12.335 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017075245999999999 2024-04-18T21:07:12.335 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.335 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.335 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:12.335 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.384879+0000", 2024-04-18T21:07:12.335 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023011474000000001 2024-04-18T21:07:12.335 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.335 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.336 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:12.336 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.384976+0000", 2024-04-18T21:07:12.336 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.7399999999999996e-05 2024-04-18T21:07:12.336 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.336 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.336 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:12.336 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.385021+0000", 2024-04-18T21:07:12.336 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.4830000000000003e-05 2024-04-18T21:07:12.336 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:12.336 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:12.336 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:12.336 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.336 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.336 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11988 4.0 4:01311cad:::1000000320a.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:12.336 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.384266+0000", 2024-04-18T21:07:12.336 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 12.899220044, 2024-04-18T21:07:12.337 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.042482546000000003, 2024-04-18T21:07:12.337 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:12.337 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:12.337 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:12.337 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:12.337 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:12.337 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:12.337 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11988 2024-04-18T21:07:12.337 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.337 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:12.337 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.337 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:12.337 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.384266+0000", 2024-04-18T21:07:12.337 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:12.337 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.338 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.338 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:12.338 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.384266+0000", 2024-04-18T21:07:12.338 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:12.338 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.338 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.338 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:12.338 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.384268+0000", 2024-04-18T21:07:12.338 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.857e-06 2024-04-18T21:07:12.338 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.338 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.338 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:12.338 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.391524+0000", 2024-04-18T21:07:12.338 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0072557469999999999 2024-04-18T21:07:12.339 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.339 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.339 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:12.339 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.391546+0000", 2024-04-18T21:07:12.339 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1607000000000002e-05 2024-04-18T21:07:12.339 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.339 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.339 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:12.339 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.391559+0000", 2024-04-18T21:07:12.339 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3331e-05 2024-04-18T21:07:12.339 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.339 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.339 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:12.339 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.391639+0000", 2024-04-18T21:07:12.339 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.9511000000000005e-05 2024-04-18T21:07:12.339 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.340 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.340 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:12.340 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.391753+0000", 2024-04-18T21:07:12.340 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000114512 2024-04-18T21:07:12.340 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.340 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.340 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:12.340 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.391945+0000", 2024-04-18T21:07:12.340 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019234300000000001 2024-04-18T21:07:12.340 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.340 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.340 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:12.340 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.401085+0000", 2024-04-18T21:07:12.340 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0091394319999999994 2024-04-18T21:07:12.340 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.340 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.341 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:12.341 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.426658+0000", 2024-04-18T21:07:12.341 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.025573148 2024-04-18T21:07:12.341 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.341 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.341 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:12.341 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.426714+0000", 2024-04-18T21:07:12.341 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5937999999999999e-05 2024-04-18T21:07:12.341 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.341 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.341 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:12.341 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.426749+0000", 2024-04-18T21:07:12.341 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.5120000000000003e-05 2024-04-18T21:07:12.341 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:12.341 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:12.342 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:12.342 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.342 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.342 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:12041 4.38 4:1c8d9fef:::100000033ed.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:12.342 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.446812+0000", 2024-04-18T21:07:12.342 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 12.836674273, 2024-04-18T21:07:12.342 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.044749606999999997, 2024-04-18T21:07:12.342 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:12.342 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:12.342 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:12.342 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:12.342 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:12.342 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:12.342 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 12041 2024-04-18T21:07:12.342 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.342 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:12.343 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.343 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:12.343 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.446812+0000", 2024-04-18T21:07:12.343 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:12.343 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.343 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.343 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:12.343 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.446812+0000", 2024-04-18T21:07:12.343 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:12.343 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.343 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.343 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:12.343 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.446814+0000", 2024-04-18T21:07:12.343 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5099999999999999e-06 2024-04-18T21:07:12.343 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.343 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.344 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:12.344 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.452583+0000", 2024-04-18T21:07:12.344 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0057696379999999997 2024-04-18T21:07:12.344 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.344 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.344 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:12.344 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.452599+0000", 2024-04-18T21:07:12.344 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5701000000000001e-05 2024-04-18T21:07:12.344 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.344 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.344 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:12.344 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.452607+0000", 2024-04-18T21:07:12.344 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.7100000000000007e-06 2024-04-18T21:07:12.344 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.344 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.344 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:12.345 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.452718+0000", 2024-04-18T21:07:12.345 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000111257 2024-04-18T21:07:12.345 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.345 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.345 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:12.345 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.452924+0000", 2024-04-18T21:07:12.345 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000206066 2024-04-18T21:07:12.345 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.345 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.345 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:12.345 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.453088+0000", 2024-04-18T21:07:12.345 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016336700000000001 2024-04-18T21:07:12.345 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.345 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.345 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:12.345 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.469818+0000", 2024-04-18T21:07:12.345 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016730248999999999 2024-04-18T21:07:12.346 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.346 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.346 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:12.346 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.491505+0000", 2024-04-18T21:07:12.346 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021687366 2024-04-18T21:07:12.346 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.346 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.346 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:12.346 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.491537+0000", 2024-04-18T21:07:12.346 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.1888999999999999e-05 2024-04-18T21:07:12.346 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.346 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.346 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:12.347 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.491562+0000", 2024-04-18T21:07:12.347 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.4854e-05 2024-04-18T21:07:12.347 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:12.347 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:12.347 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:12.347 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.347 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.347 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:12228 4.16 4:6a8d8629:::100000033d5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:12.347 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.681634+0000", 2024-04-18T21:07:12.347 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 12.601852044999999, 2024-04-18T21:07:12.347 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043430791000000003, 2024-04-18T21:07:12.347 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:12.347 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:12.347 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:12.347 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:12.348 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:12.348 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:12.348 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 12228 2024-04-18T21:07:12.348 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.348 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:12.348 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.348 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:12.348 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.681634+0000", 2024-04-18T21:07:12.348 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:12.348 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.348 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.348 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:12.348 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.681634+0000", 2024-04-18T21:07:12.348 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:12.348 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.349 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.349 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:12.349 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.681637+0000", 2024-04-18T21:07:12.349 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.418e-06 2024-04-18T21:07:12.349 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.349 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.349 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:12.349 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.688982+0000", 2024-04-18T21:07:12.349 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0073447870000000002 2024-04-18T21:07:12.349 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.349 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.349 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:12.349 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.688998+0000", 2024-04-18T21:07:12.349 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6330000000000001e-05 2024-04-18T21:07:12.349 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.349 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.350 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:12.350 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.689009+0000", 2024-04-18T21:07:12.350 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1236999999999999e-05 2024-04-18T21:07:12.350 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.350 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.350 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:12.350 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.689083+0000", 2024-04-18T21:07:12.350 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3415000000000001e-05 2024-04-18T21:07:12.350 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.350 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.350 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:12.350 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.689237+0000", 2024-04-18T21:07:12.350 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00015420899999999999 2024-04-18T21:07:12.350 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.351 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.351 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:12.351 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.689419+0000", 2024-04-18T21:07:12.351 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018242099999999999 2024-04-18T21:07:12.351 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.351 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.351 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:12.351 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.711630+0000", 2024-04-18T21:07:12.351 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.022210475 2024-04-18T21:07:12.351 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.351 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.351 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:12.351 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.724956+0000", 2024-04-18T21:07:12.351 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013325887999999999 2024-04-18T21:07:12.352 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.352 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.352 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:12.352 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.725019+0000", 2024-04-18T21:07:12.352 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.3757999999999995e-05 2024-04-18T21:07:12.352 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.352 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.352 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:12.352 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.725065+0000", 2024-04-18T21:07:12.352 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.5853000000000003e-05 2024-04-18T21:07:12.352 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:12.352 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:12.352 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:12.352 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.352 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.352 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_repop(client.4534.0:12689 4.26 e58/16 4:64a7f444:::100000033e5.00000000:head v 58'205, mlcod=58'203)", 2024-04-18T21:07:12.353 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:00.217785+0000", 2024-04-18T21:07:12.353 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 12.065701477999999, 2024-04-18T21:07:12.353 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.052245469000000003, 2024-04-18T21:07:12.353 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:12.353 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:12.353 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:12.353 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:12.353 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.353 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:12.353 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.217785+0000", 2024-04-18T21:07:12.353 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:12.353 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.353 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.353 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:12.353 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.217785+0000", 2024-04-18T21:07:12.354 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:12.354 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.354 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.354 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:12.354 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.217786+0000", 2024-04-18T21:07:12.354 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6700000000000002e-07 2024-04-18T21:07:12.354 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.354 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.354 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:12.354 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225111+0000", 2024-04-18T21:07:12.354 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0073251119999999999 2024-04-18T21:07:12.354 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.354 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.354 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:12.355 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225126+0000", 2024-04-18T21:07:12.355 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.541e-05 2024-04-18T21:07:12.355 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.355 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.355 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:12.355 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225137+0000", 2024-04-18T21:07:12.355 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0890000000000001e-05 2024-04-18T21:07:12.355 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.355 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.355 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:12.355 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225244+0000", 2024-04-18T21:07:12.355 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000106555 2024-04-18T21:07:12.355 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.355 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.356 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:12.356 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225276+0000", 2024-04-18T21:07:12.356 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.2574999999999999e-05 2024-04-18T21:07:12.356 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.356 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.356 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:12.356 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.269985+0000", 2024-04-18T21:07:12.356 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.044708422999999997 2024-04-18T21:07:12.356 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.356 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.356 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:12.356 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.270031+0000", 2024-04-18T21:07:12.356 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.5636999999999997e-05 2024-04-18T21:07:12.356 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:12.356 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:12.357 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:12.357 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.357 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.357 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:12692 4.3a 4:5c788ec1:::100000032ff.00000000:head [write 0~4194304 [2@945974]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:12.357 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:00.225134+0000", 2024-04-18T21:07:12.357 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 12.058352423000001, 2024-04-18T21:07:12.357 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.048311640000000003, 2024-04-18T21:07:12.357 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:12.357 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:12.357 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:12.357 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:12.357 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:12.357 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:12.357 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 12692 2024-04-18T21:07:12.358 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.358 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:12.358 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.358 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:12.358 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225134+0000", 2024-04-18T21:07:12.358 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:12.358 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.358 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.358 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:12.358 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225134+0000", 2024-04-18T21:07:12.358 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:12.358 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.358 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.359 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:12.359 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225136+0000", 2024-04-18T21:07:12.359 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4160000000000001e-06 2024-04-18T21:07:12.359 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.359 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.359 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:12.359 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231408+0000", 2024-04-18T21:07:12.359 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.006272517 2024-04-18T21:07:12.359 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.359 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.359 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:12.359 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231437+0000", 2024-04-18T21:07:12.359 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.9119e-05 2024-04-18T21:07:12.359 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.359 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.360 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:12.360 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231456+0000", 2024-04-18T21:07:12.360 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8544999999999999e-05 2024-04-18T21:07:12.360 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.360 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.360 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:12.360 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231579+0000", 2024-04-18T21:07:12.360 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000123762 2024-04-18T21:07:12.360 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.360 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.360 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:12.360 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231690+0000", 2024-04-18T21:07:12.360 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000110349 2024-04-18T21:07:12.360 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.360 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.361 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:12.361 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231903+0000", 2024-04-18T21:07:12.361 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000212695 2024-04-18T21:07:12.361 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.361 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.361 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:12.361 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.253911+0000", 2024-04-18T21:07:12.361 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.022008706999999999 2024-04-18T21:07:12.361 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.361 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.361 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:12.361 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.273383+0000", 2024-04-18T21:07:12.361 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019471568000000002 2024-04-18T21:07:12.361 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.361 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.362 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:12.362 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.273418+0000", 2024-04-18T21:07:12.362 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.5265999999999997e-05 2024-04-18T21:07:12.362 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.362 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.362 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:12.362 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.273446+0000", 2024-04-18T21:07:12.362 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7696e-05 2024-04-18T21:07:12.362 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:12.362 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:12.362 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:12.362 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.362 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.362 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:12693 4.2b 4:d71e94ee:::10000003509.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:12.363 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:00.231503+0000", 2024-04-18T21:07:12.363 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 12.051983638999999, 2024-04-18T21:07:12.363 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.042620511999999999, 2024-04-18T21:07:12.363 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:12.363 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:12.363 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:12.363 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:12.363 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:12.363 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:12.363 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 12693 2024-04-18T21:07:12.363 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.363 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:12.363 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.363 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:12.363 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231503+0000", 2024-04-18T21:07:12.363 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:12.364 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.364 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.364 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:12.364 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231503+0000", 2024-04-18T21:07:12.364 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:12.364 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.364 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.364 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:12.364 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231505+0000", 2024-04-18T21:07:12.364 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9530000000000002e-06 2024-04-18T21:07:12.364 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.364 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.364 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:12.364 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.238278+0000", 2024-04-18T21:07:12.364 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0067732269999999997 2024-04-18T21:07:12.365 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.365 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.365 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:12.365 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.238295+0000", 2024-04-18T21:07:12.365 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7268000000000001e-05 2024-04-18T21:07:12.365 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.365 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.365 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:12.365 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.238303+0000", 2024-04-18T21:07:12.365 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.1559999999999995e-06 2024-04-18T21:07:12.365 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.365 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.365 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:12.365 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.238370+0000", 2024-04-18T21:07:12.365 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.6959999999999996e-05 2024-04-18T21:07:12.365 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.366 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.366 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:12.366 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.238569+0000", 2024-04-18T21:07:12.366 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000198242 2024-04-18T21:07:12.366 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.366 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.366 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:12.366 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.238840+0000", 2024-04-18T21:07:12.366 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00027115 2024-04-18T21:07:12.366 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.366 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.366 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:12.366 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.268210+0000", 2024-04-18T21:07:12.367 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.029370216000000001 2024-04-18T21:07:12.367 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.367 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.367 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:12.367 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.274023+0000", 2024-04-18T21:07:12.367 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0058133009999999999 2024-04-18T21:07:12.367 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.367 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.367 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:12.367 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.274064+0000", 2024-04-18T21:07:12.367 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.0157000000000002e-05 2024-04-18T21:07:12.367 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.367 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.367 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:12.367 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.274123+0000", 2024-04-18T21:07:12.367 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.9882e-05 2024-04-18T21:07:12.368 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:12.368 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:12.368 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:12.368 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.368 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.368 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:15008 4.2b 4:d5496710:::100000033cf.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-18T21:07:12.368 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:02.998996+0000", 2024-04-18T21:07:12.368 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 9.2844903619999997, 2024-04-18T21:07:12.368 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.042584729000000002, 2024-04-18T21:07:12.368 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:12.368 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:12.368 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:12.368 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:12.368 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:12.368 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:12.369 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 15008 2024-04-18T21:07:12.369 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.369 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:12.369 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.369 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:12.369 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:02.998996+0000", 2024-04-18T21:07:12.369 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:12.369 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.369 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.369 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:12.369 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:02.998996+0000", 2024-04-18T21:07:12.369 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:12.369 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.369 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.369 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:12.370 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:02.998997+0000", 2024-04-18T21:07:12.370 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.4000000000000001e-07 2024-04-18T21:07:12.370 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.370 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.370 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:12.370 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.005534+0000", 2024-04-18T21:07:12.370 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0065367339999999998 2024-04-18T21:07:12.370 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.370 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.370 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:12.370 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.005562+0000", 2024-04-18T21:07:12.370 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8861999999999999e-05 2024-04-18T21:07:12.371 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.371 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.371 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:12.371 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.005582+0000", 2024-04-18T21:07:12.371 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9987e-05 2024-04-18T21:07:12.371 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.371 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.371 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:12.371 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.005659+0000", 2024-04-18T21:07:12.371 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.6570999999999996e-05 2024-04-18T21:07:12.371 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.371 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.371 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:12.371 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.005841+0000", 2024-04-18T21:07:12.371 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018223600000000001 2024-04-18T21:07:12.372 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.372 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.372 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:12.372 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.005976+0000", 2024-04-18T21:07:12.372 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000135165 2024-04-18T21:07:12.372 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.372 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.372 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:12.372 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.015878+0000", 2024-04-18T21:07:12.372 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0099018390000000008 2024-04-18T21:07:12.372 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.372 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.372 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:12.372 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.041515+0000", 2024-04-18T21:07:12.372 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.025636982999999999 2024-04-18T21:07:12.373 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.373 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.373 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:12.373 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.041554+0000", 2024-04-18T21:07:12.373 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.8679e-05 2024-04-18T21:07:12.373 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.373 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.373 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:12.373 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.041581+0000", 2024-04-18T21:07:12.373 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7033e-05 2024-04-18T21:07:12.373 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:12.373 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:12.373 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:12.373 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.373 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.373 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:15085 4.20 4:04677f23:::100000034fe.00000000:head [write 0~4194304 [2@471250]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-18T21:07:12.374 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:03.092507+0000", 2024-04-18T21:07:12.374 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 9.1909799089999993, 2024-04-18T21:07:12.374 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.042978905999999997, 2024-04-18T21:07:12.374 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:12.374 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:12.374 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:12.374 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:12.374 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:12.374 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:12.374 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 15085 2024-04-18T21:07:12.374 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.374 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:12.374 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.375 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:12.375 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.092507+0000", 2024-04-18T21:07:12.375 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:12.375 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.375 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.375 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:12.375 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.092507+0000", 2024-04-18T21:07:12.375 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:12.375 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.375 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.375 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:12.375 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.092507+0000", 2024-04-18T21:07:12.375 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8299999999999996e-07 2024-04-18T21:07:12.375 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.375 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.376 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:12.376 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.099434+0000", 2024-04-18T21:07:12.376 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.006926176 2024-04-18T21:07:12.376 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.376 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.376 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:12.376 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.099451+0000", 2024-04-18T21:07:12.376 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7733000000000001e-05 2024-04-18T21:07:12.376 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.376 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.376 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:12.376 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.099460+0000", 2024-04-18T21:07:12.376 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5990000000000002e-06 2024-04-18T21:07:12.376 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.376 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.377 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:12.377 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.099519+0000", 2024-04-18T21:07:12.377 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.9106e-05 2024-04-18T21:07:12.377 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.377 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.377 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:12.377 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.099637+0000", 2024-04-18T21:07:12.377 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000117917 2024-04-18T21:07:12.377 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.377 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.377 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:12.377 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.099893+0000", 2024-04-18T21:07:12.377 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00025568800000000001 2024-04-18T21:07:12.377 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.377 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.377 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:12.378 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.125269+0000", 2024-04-18T21:07:12.378 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.025376177999999999 2024-04-18T21:07:12.378 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.378 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.378 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:12.378 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.135427+0000", 2024-04-18T21:07:12.378 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010158149 2024-04-18T21:07:12.378 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.378 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.378 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:12.378 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.135461+0000", 2024-04-18T21:07:12.378 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.4440999999999998e-05 2024-04-18T21:07:12.378 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.378 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.378 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:12.379 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.135486+0000", 2024-04-18T21:07:12.379 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.4136000000000001e-05 2024-04-18T21:07:12.379 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:12.379 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:12.379 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:12.379 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.379 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.379 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:15094 4.c 4:32870457:::10000003692.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-18T21:07:12.379 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:03.107374+0000", 2024-04-18T21:07:12.379 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 9.1761120989999991, 2024-04-18T21:07:12.379 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.061575983000000001, 2024-04-18T21:07:12.379 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:12.379 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:12.379 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:12.379 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:12.380 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:12.380 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:12.380 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 15094 2024-04-18T21:07:12.380 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.380 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:12.380 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.380 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:12.380 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.107374+0000", 2024-04-18T21:07:12.380 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:12.380 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.380 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.380 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:12.380 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.107374+0000", 2024-04-18T21:07:12.380 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:12.380 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.381 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.381 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:12.381 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.107376+0000", 2024-04-18T21:07:12.381 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3969999999999999e-06 2024-04-18T21:07:12.381 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.381 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.381 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:12.381 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115698+0000", 2024-04-18T21:07:12.381 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0083223989999999994 2024-04-18T21:07:12.381 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.381 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.381 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:12.381 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115713+0000", 2024-04-18T21:07:12.381 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4385e-05 2024-04-18T21:07:12.381 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.381 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.382 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:12.382 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115722+0000", 2024-04-18T21:07:12.382 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0759999999999992e-06 2024-04-18T21:07:12.382 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.382 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.382 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:12.382 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115784+0000", 2024-04-18T21:07:12.382 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.2348999999999995e-05 2024-04-18T21:07:12.382 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.382 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.382 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:12.382 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115849+0000", 2024-04-18T21:07:12.382 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.4964999999999999e-05 2024-04-18T21:07:12.382 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.382 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.383 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:12.383 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.116054+0000", 2024-04-18T21:07:12.383 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020483400000000001 2024-04-18T21:07:12.383 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.383 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.383 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:12.383 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.125769+0000", 2024-04-18T21:07:12.383 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0097153340000000008 2024-04-18T21:07:12.383 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.383 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.383 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:12.383 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.168834+0000", 2024-04-18T21:07:12.383 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043064527999999998 2024-04-18T21:07:12.383 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.383 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.384 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:12.384 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.168882+0000", 2024-04-18T21:07:12.384 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.7919e-05 2024-04-18T21:07:12.384 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.384 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.384 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:12.384 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.168950+0000", 2024-04-18T21:07:12.384 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.8796999999999999e-05 2024-04-18T21:07:12.384 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:12.384 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:12.384 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:12.384 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.384 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.384 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:15133 4.38 4:1c73eb83:::1000000398c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-18T21:07:12.384 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:03.155031+0000", 2024-04-18T21:07:12.385 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 9.1284555580000006, 2024-04-18T21:07:12.385 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.044078787000000001, 2024-04-18T21:07:12.385 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:12.385 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:12.385 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:12.385 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:12.385 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:12.385 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:12.385 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 15133 2024-04-18T21:07:12.385 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.385 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:12.385 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.385 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:12.385 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.155031+0000", 2024-04-18T21:07:12.385 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:12.385 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.386 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.386 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:12.386 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.155031+0000", 2024-04-18T21:07:12.386 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:12.386 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.386 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.386 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:12.386 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.155033+0000", 2024-04-18T21:07:12.386 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.84e-06 2024-04-18T21:07:12.386 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.386 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.386 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:12.386 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.161994+0000", 2024-04-18T21:07:12.386 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0069607779999999999 2024-04-18T21:07:12.387 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.387 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.387 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:12.387 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.162008+0000", 2024-04-18T21:07:12.387 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4399000000000001e-05 2024-04-18T21:07:12.387 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.387 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.387 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:12.387 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.162018+0000", 2024-04-18T21:07:12.387 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.7149999999999993e-06 2024-04-18T21:07:12.387 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.387 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.387 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:12.387 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.162073+0000", 2024-04-18T21:07:12.387 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4803999999999999e-05 2024-04-18T21:07:12.387 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.388 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.388 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:12.388 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.162215+0000", 2024-04-18T21:07:12.388 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014222900000000001 2024-04-18T21:07:12.388 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.388 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.388 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:12.388 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.162341+0000", 2024-04-18T21:07:12.388 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012579400000000001 2024-04-18T21:07:12.388 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.388 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.388 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:12.388 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.169445+0000", 2024-04-18T21:07:12.388 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0071040360000000002 2024-04-18T21:07:12.388 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.389 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.389 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:12.389 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.199046+0000", 2024-04-18T21:07:12.389 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.029601639999999999 2024-04-18T21:07:12.389 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.389 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.389 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:12.389 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.199082+0000", 2024-04-18T21:07:12.389 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.6134999999999999e-05 2024-04-18T21:07:12.389 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:12.389 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:12.389 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:12.389 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.199110+0000", 2024-04-18T21:07:12.389 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7416999999999999e-05 2024-04-18T21:07:12.389 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:12.390 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:12.390 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:12.390 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:12.390 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:12.390 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:07:12.391 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:07:12.392 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:12.390+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:12.492 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:12.493+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:12.521 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:07:12.521 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:07:12.521 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.521 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:7694 3.6 3.4b2c82a6 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-18T21:07:12.522 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:11.672522+0000", 2024-04-18T21:07:12.522 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.85159088599999999, 2024-04-18T21:07:12.522 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.851617968, 2024-04-18T21:07:12.522 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:12.522 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:12.522 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for peered", 2024-04-18T21:07:12.522 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:12.522 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.522 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:12.522 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672522+0000", 2024-04-18T21:07:12.522 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:12.522 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.522 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.522 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:12.523 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672522+0000", 2024-04-18T21:07:12.523 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:12.523 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.523 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.523 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:12.523 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672525+0000", 2024-04-18T21:07:12.523 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.366e-06 2024-04-18T21:07:12.523 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.523 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.523 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:12.523 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672540+0000", 2024-04-18T21:07:12.523 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4949999999999999e-05 2024-04-18T21:07:12.523 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.523 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.523 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:12.524 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672569+0000", 2024-04-18T21:07:12.524 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8714999999999999e-05 2024-04-18T21:07:12.524 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.524 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.524 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:12.524 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672581+0000", 2024-04-18T21:07:12.524 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1949e-05 2024-04-18T21:07:12.524 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.524 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.524 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:12.524 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672704+0000", 2024-04-18T21:07:12.524 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000122915 2024-04-18T21:07:12.524 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.524 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.524 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:12.525 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672714+0000", 2024-04-18T21:07:12.525 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0698e-05 2024-04-18T21:07:12.525 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.525 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.525 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:12.525 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.910993+0000", 2024-04-18T21:07:12.525 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.23827911199999999 2024-04-18T21:07:12.525 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.525 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.525 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:12.525 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.911017+0000", 2024-04-18T21:07:12.525 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3419999999999999e-05 2024-04-18T21:07:12.525 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:12.525 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:12.525 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:12.526 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:12.526 INFO:teuthology.orchestra.run.smithi187.stdout: ], 2024-04-18T21:07:12.526 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 1 2024-04-18T21:07:12.526 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:07:12.536 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:07:12.592 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:12.593+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:12.659 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:07:12.659 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:07:12.659 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-18T21:07:12.659 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-18T21:07:12.659 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:07:12.673 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:12.717 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:12.718+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:12.795 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:07:12.795 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-18T21:07:12.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-18T21:07:12.795 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:07:12.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.795 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:12.795 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:07:12.795 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 127.177767092, 2024-04-18T21:07:12.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045668994999999997, 2024-04-18T21:07:12.795 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:12.795 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:12.795 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:12.795 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:12.796 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.796 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:12.796 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:07:12.796 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:12.796 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.796 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.796 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:12.796 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615458+0000", 2024-04-18T21:07:12.796 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:12.796 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.796 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.796 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:12.796 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615459+0000", 2024-04-18T21:07:12.796 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5030000000000001e-06 2024-04-18T21:07:12.796 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.796 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.797 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:12.797 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615506+0000", 2024-04-18T21:07:12.797 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6872000000000001e-05 2024-04-18T21:07:12.797 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.797 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.797 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:12.797 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615527+0000", 2024-04-18T21:07:12.797 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0763000000000001e-05 2024-04-18T21:07:12.797 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.797 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.797 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:12.797 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615551+0000", 2024-04-18T21:07:12.797 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4159e-05 2024-04-18T21:07:12.797 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.797 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.797 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:12.798 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615736+0000", 2024-04-18T21:07:12.798 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018499599999999999 2024-04-18T21:07:12.798 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.798 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-18T21:07:12.798 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615748+0000", 2024-04-18T21:07:12.798 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2272999999999999e-05 2024-04-18T21:07:12.798 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.798 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:12.798 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635481+0000", 2024-04-18T21:07:12.798 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019732772999999999 2024-04-18T21:07:12.798 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.798 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:12.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.635791+0000", 2024-04-18T21:07:12.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031013299999999998 2024-04-18T21:07:12.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:12.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.636101+0000", 2024-04-18T21:07:12.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030943300000000002 2024-04-18T21:07:12.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:12.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646043+0000", 2024-04-18T21:07:12.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099428139999999995 2024-04-18T21:07:12.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:12.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.660991+0000", 2024-04-18T21:07:12.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014947142 2024-04-18T21:07:12.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.800 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.800 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:12.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661061+0000", 2024-04-18T21:07:12.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0438000000000006e-05 2024-04-18T21:07:12.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.800 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.800 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:12.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661127+0000", 2024-04-18T21:07:12.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5696000000000003e-05 2024-04-18T21:07:12.800 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:12.800 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:12.800 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:12.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.800 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.801 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:12.801 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:07:12.801 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 127.177554664, 2024-04-18T21:07:12.801 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045745085999999997, 2024-04-18T21:07:12.801 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:12.801 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:12.801 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:12.801 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:12.801 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.801 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:12.801 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:07:12.801 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:12.801 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.801 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.801 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:12.802 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:07:12.802 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:12.802 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.802 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.802 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:12.802 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:07:12.802 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7400000000000001e-06 2024-04-18T21:07:12.802 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.802 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.802 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:12.802 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:07:12.802 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8133e-05 2024-04-18T21:07:12.802 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.802 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.802 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:12.802 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615726+0000", 2024-04-18T21:07:12.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6132e-05 2024-04-18T21:07:12.803 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.803 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:12.803 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615742+0000", 2024-04-18T21:07:12.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6157000000000001e-05 2024-04-18T21:07:12.803 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.803 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:12.803 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615937+0000", 2024-04-18T21:07:12.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000194768 2024-04-18T21:07:12.803 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.803 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:07:12.803 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615950+0000", 2024-04-18T21:07:12.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3084e-05 2024-04-18T21:07:12.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.804 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:12.804 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643676+0000", 2024-04-18T21:07:12.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027725639999999999 2024-04-18T21:07:12.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.804 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:12.804 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643867+0000", 2024-04-18T21:07:12.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019075900000000001 2024-04-18T21:07:12.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.804 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:12.804 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:07:12.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036013799999999997 2024-04-18T21:07:12.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.805 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.805 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:12.805 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646068+0000", 2024-04-18T21:07:12.805 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001841536 2024-04-18T21:07:12.805 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.805 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.805 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:12.805 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661184+0000", 2024-04-18T21:07:12.805 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015115458999999999 2024-04-18T21:07:12.805 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.805 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.805 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:12.805 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661283+0000", 2024-04-18T21:07:12.805 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9502999999999999e-05 2024-04-18T21:07:12.805 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.805 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.806 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:12.806 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661415+0000", 2024-04-18T21:07:12.806 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000132037 2024-04-18T21:07:12.806 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:12.806 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:12.806 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:12.806 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.806 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.806 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:101 3.1f 3:f83d65d8:::200.00000004:head [write 316455~1401 [fadvise_dontneed] in=1401b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:12.806 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:07:12.806 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 27.035491053000001, 2024-04-18T21:07:12.806 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.048270212999999999, 2024-04-18T21:07:12.806 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:12.806 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:12.806 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:12.806 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:12.807 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.807 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:12.807 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:07:12.807 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:12.807 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.807 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.807 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:12.807 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:07:12.807 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:12.807 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.807 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.807 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:12.807 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:07:12.807 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7700000000000004e-07 2024-04-18T21:07:12.807 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.807 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:12.808 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757745+0000", 2024-04-18T21:07:12.808 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0910000000000001e-05 2024-04-18T21:07:12.808 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.808 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:12.808 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757758+0000", 2024-04-18T21:07:12.808 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2593e-05 2024-04-18T21:07:12.808 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.808 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:12.808 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757765+0000", 2024-04-18T21:07:12.808 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1659999999999997e-06 2024-04-18T21:07:12.808 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.809 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:12.809 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.797782+0000", 2024-04-18T21:07:12.809 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.040017283000000001 2024-04-18T21:07:12.809 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.809 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:12.809 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.797949+0000", 2024-04-18T21:07:12.809 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016650399999999999 2024-04-18T21:07:12.809 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.809 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:12.809 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.798152+0000", 2024-04-18T21:07:12.809 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000203098 2024-04-18T21:07:12.809 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.810 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:12.810 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.800792+0000", 2024-04-18T21:07:12.810 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026394779999999998 2024-04-18T21:07:12.810 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.810 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.810 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:12.810 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805921+0000", 2024-04-18T21:07:12.810 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0051295519999999999 2024-04-18T21:07:12.810 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.810 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.810 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:12.810 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805967+0000", 2024-04-18T21:07:12.810 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5457000000000002e-05 2024-04-18T21:07:12.810 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.810 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.811 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:12.811 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806004+0000", 2024-04-18T21:07:12.811 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7494999999999999e-05 2024-04-18T21:07:12.811 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:12.811 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:12.811 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:12.811 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.811 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.811 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:102 3.1f 3:f83d65d8:::200.00000004:head [write 317856~1403 [fadvise_dontneed] in=1403b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:12.811 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757775+0000", 2024-04-18T21:07:12.811 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 27.035449987, 2024-04-18T21:07:12.811 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.048337705000000002, 2024-04-18T21:07:12.811 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:12.811 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:12.811 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:12.811 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:12.812 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.812 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:12.812 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757775+0000", 2024-04-18T21:07:12.812 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:12.812 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.812 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.812 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:12.812 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757775+0000", 2024-04-18T21:07:12.812 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:12.812 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.812 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.812 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:12.812 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757776+0000", 2024-04-18T21:07:12.812 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5300000000000004e-07 2024-04-18T21:07:12.812 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.812 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.813 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:12.813 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757780+0000", 2024-04-18T21:07:12.813 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2270000000000004e-06 2024-04-18T21:07:12.813 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.813 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.813 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:12.813 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757792+0000", 2024-04-18T21:07:12.813 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2696e-05 2024-04-18T21:07:12.813 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.813 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.813 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:12.813 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757800+0000", 2024-04-18T21:07:12.813 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1439999999999997e-06 2024-04-18T21:07:12.813 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.813 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.813 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:12.813 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.798773+0000", 2024-04-18T21:07:12.814 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.040973074999999998 2024-04-18T21:07:12.814 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.814 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.814 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:12.814 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.798990+0000", 2024-04-18T21:07:12.814 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000217161 2024-04-18T21:07:12.814 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.814 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.814 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:12.814 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.799173+0000", 2024-04-18T21:07:12.814 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018295900000000001 2024-04-18T21:07:12.814 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.814 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.814 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:12.814 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802469+0000", 2024-04-18T21:07:12.815 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032965350000000002 2024-04-18T21:07:12.815 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.815 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.815 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:12.815 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806042+0000", 2024-04-18T21:07:12.815 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035724630000000001 2024-04-18T21:07:12.815 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.815 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.815 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:12.815 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806077+0000", 2024-04-18T21:07:12.815 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4997999999999999e-05 2024-04-18T21:07:12.815 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.815 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.815 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:12.815 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806113+0000", 2024-04-18T21:07:12.816 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5794000000000003e-05 2024-04-18T21:07:12.816 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:12.816 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:12.816 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:12.816 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.816 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.816 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:103 3.1f 3:f83d65d8:::200.00000004:head [write 319259~1404 [fadvise_dontneed] in=1404b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:12.816 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:07:12.816 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 27.035416140999999, 2024-04-18T21:07:12.816 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.048414481000000002, 2024-04-18T21:07:12.816 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:12.816 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:12.816 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:12.816 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:12.816 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.816 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:12.816 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:07:12.817 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:12.817 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.817 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.817 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:12.817 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:07:12.817 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:12.817 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.817 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.817 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:12.817 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:07:12.817 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4700000000000001e-07 2024-04-18T21:07:12.817 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.817 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.817 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:12.817 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757814+0000", 2024-04-18T21:07:12.817 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1829999999999996e-06 2024-04-18T21:07:12.818 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.818 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.818 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:12.818 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757825+0000", 2024-04-18T21:07:12.818 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1754e-05 2024-04-18T21:07:12.818 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.818 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.818 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:12.818 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757832+0000", 2024-04-18T21:07:12.818 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8430000000000004e-06 2024-04-18T21:07:12.818 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.818 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.818 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:12.818 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.799809+0000", 2024-04-18T21:07:12.818 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.041976960000000001 2024-04-18T21:07:12.819 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.819 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.819 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:12.819 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.799934+0000", 2024-04-18T21:07:12.819 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000125053 2024-04-18T21:07:12.819 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.819 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.819 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:12.819 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.800067+0000", 2024-04-18T21:07:12.819 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013276299999999999 2024-04-18T21:07:12.819 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.819 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.819 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:12.819 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804582+0000", 2024-04-18T21:07:12.819 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0045148899999999997 2024-04-18T21:07:12.820 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.820 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.820 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:12.820 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806158+0000", 2024-04-18T21:07:12.820 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001575894 2024-04-18T21:07:12.820 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.820 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.820 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:12.820 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806189+0000", 2024-04-18T21:07:12.820 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1423000000000001e-05 2024-04-18T21:07:12.820 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.820 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.820 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:12.820 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806223+0000", 2024-04-18T21:07:12.821 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4071e-05 2024-04-18T21:07:12.821 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:12.821 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:12.821 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:12.821 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.821 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.821 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:104 3.1f 3:f83d65d8:::200.00000004:head [write 320663~1405 [fadvise_dontneed] in=1405b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:12.821 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757841+0000", 2024-04-18T21:07:12.821 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 27.035383936999999, 2024-04-18T21:07:12.821 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056381623999999998, 2024-04-18T21:07:12.821 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:12.821 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:12.821 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:12.821 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:12.821 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.822 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:12.822 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757841+0000", 2024-04-18T21:07:12.822 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:12.822 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.822 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.822 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:12.822 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757841+0000", 2024-04-18T21:07:12.822 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:12.822 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.822 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.822 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:12.822 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757842+0000", 2024-04-18T21:07:12.822 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5000000000000002e-07 2024-04-18T21:07:12.822 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.823 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.823 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:12.823 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757852+0000", 2024-04-18T21:07:12.823 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.084e-05 2024-04-18T21:07:12.823 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.823 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.823 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:12.823 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757865+0000", 2024-04-18T21:07:12.823 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2643000000000001e-05 2024-04-18T21:07:12.823 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.823 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.823 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:12.823 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757872+0000", 2024-04-18T21:07:12.823 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8689999999999998e-06 2024-04-18T21:07:12.823 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.823 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.824 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:12.824 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.801102+0000", 2024-04-18T21:07:12.824 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043229837 2024-04-18T21:07:12.824 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.824 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.824 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:12.824 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.801291+0000", 2024-04-18T21:07:12.824 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000189641 2024-04-18T21:07:12.824 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.824 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.824 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:12.824 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.801640+0000", 2024-04-18T21:07:12.824 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000348971 2024-04-18T21:07:12.824 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.824 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.825 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:12.825 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805849+0000", 2024-04-18T21:07:12.825 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042082739999999997 2024-04-18T21:07:12.825 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.825 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.825 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:12.825 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814135+0000", 2024-04-18T21:07:12.825 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0082867270000000007 2024-04-18T21:07:12.825 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.825 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.825 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:12.825 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814180+0000", 2024-04-18T21:07:12.825 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4982999999999999e-05 2024-04-18T21:07:12.825 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.825 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.825 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:12.826 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814223+0000", 2024-04-18T21:07:12.826 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2188999999999999e-05 2024-04-18T21:07:12.826 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:12.826 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:12.826 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:12.826 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.826 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.826 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:105 3.1f 3:f83d65d8:::200.00000004:head [write 322068~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:12.826 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:07:12.826 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 27.035343341000001, 2024-04-18T21:07:12.826 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056513678999999997, 2024-04-18T21:07:12.826 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:12.826 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:12.826 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:12.827 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:12.827 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.827 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:12.827 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:07:12.827 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:12.827 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.827 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.827 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:12.827 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:07:12.827 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:12.827 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.827 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.827 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:12.827 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:07:12.827 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2600000000000002e-07 2024-04-18T21:07:12.827 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.827 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.828 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:12.828 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757888+0000", 2024-04-18T21:07:12.828 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7130000000000002e-06 2024-04-18T21:07:12.828 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.828 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.828 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:12.828 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757906+0000", 2024-04-18T21:07:12.828 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7723999999999998e-05 2024-04-18T21:07:12.828 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.828 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.828 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:12.828 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757921+0000", 2024-04-18T21:07:12.828 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4936000000000001e-05 2024-04-18T21:07:12.828 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.828 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.829 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:12.829 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802493+0000", 2024-04-18T21:07:12.829 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.044571927999999997 2024-04-18T21:07:12.829 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.829 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.829 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:12.829 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802537+0000", 2024-04-18T21:07:12.829 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4449000000000001e-05 2024-04-18T21:07:12.829 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.829 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.829 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:12.829 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802605+0000", 2024-04-18T21:07:12.829 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7945000000000001e-05 2024-04-18T21:07:12.829 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.829 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.829 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:12.830 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805852+0000", 2024-04-18T21:07:12.830 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032469909999999999 2024-04-18T21:07:12.830 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.830 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.830 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:12.830 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814298+0000", 2024-04-18T21:07:12.830 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084463309999999996 2024-04-18T21:07:12.830 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.830 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.830 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:12.830 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814355+0000", 2024-04-18T21:07:12.830 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6459999999999998e-05 2024-04-18T21:07:12.830 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.830 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.830 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:12.831 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814395+0000", 2024-04-18T21:07:12.831 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0475999999999997e-05 2024-04-18T21:07:12.831 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:12.831 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:12.831 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:12.831 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.831 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.831 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:106 3.1f 3:f83d65d8:::200.00000004:head [write 323467~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:12.831 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757955+0000", 2024-04-18T21:07:12.831 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 27.035270111999999, 2024-04-18T21:07:12.831 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056539990999999998, 2024-04-18T21:07:12.831 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:12.831 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:12.831 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:12.831 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:12.831 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.832 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:12.832 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757955+0000", 2024-04-18T21:07:12.832 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:12.832 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.832 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.832 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:12.832 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757955+0000", 2024-04-18T21:07:12.832 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:12.832 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.832 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.832 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:12.832 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757956+0000", 2024-04-18T21:07:12.832 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.144e-06 2024-04-18T21:07:12.832 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.832 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.832 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:12.833 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757970+0000", 2024-04-18T21:07:12.833 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3899e-05 2024-04-18T21:07:12.833 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.833 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.833 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:12.833 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757988+0000", 2024-04-18T21:07:12.833 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8033000000000002e-05 2024-04-18T21:07:12.833 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.833 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.833 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:12.833 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758002+0000", 2024-04-18T21:07:12.833 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3973e-05 2024-04-18T21:07:12.833 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.833 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.833 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:12.834 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803072+0000", 2024-04-18T21:07:12.834 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045070194000000001 2024-04-18T21:07:12.834 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.834 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.834 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:12.834 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803125+0000", 2024-04-18T21:07:12.834 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3498000000000002e-05 2024-04-18T21:07:12.834 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.834 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.834 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:12.834 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803233+0000", 2024-04-18T21:07:12.834 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010704099999999999 2024-04-18T21:07:12.834 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.834 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.834 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:12.835 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805856+0000", 2024-04-18T21:07:12.835 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026233430000000002 2024-04-18T21:07:12.835 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.835 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.835 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:12.835 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814439+0000", 2024-04-18T21:07:12.835 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0085833839999999995 2024-04-18T21:07:12.835 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.835 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.835 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:12.835 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814469+0000", 2024-04-18T21:07:12.835 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9784000000000001e-05 2024-04-18T21:07:12.835 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.835 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.835 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:12.836 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814495+0000", 2024-04-18T21:07:12.836 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5698e-05 2024-04-18T21:07:12.836 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:12.836 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:12.836 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:12.836 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.836 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.836 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:107 3.1f 3:f83d65d8:::200.00000004:head [write 324866~1421 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:12.836 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758019+0000", 2024-04-18T21:07:12.836 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 27.035205485999999, 2024-04-18T21:07:12.836 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056580563, 2024-04-18T21:07:12.836 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:12.836 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:12.836 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:12.836 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:12.836 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.836 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:12.837 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758019+0000", 2024-04-18T21:07:12.837 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:12.837 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.837 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.837 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:12.837 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758019+0000", 2024-04-18T21:07:12.837 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:12.837 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.837 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.837 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:12.837 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758021+0000", 2024-04-18T21:07:12.837 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1999999999999999e-06 2024-04-18T21:07:12.837 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.837 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.837 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:12.837 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758028+0000", 2024-04-18T21:07:12.838 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7200000000000006e-06 2024-04-18T21:07:12.838 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.838 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.838 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:12.838 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758050+0000", 2024-04-18T21:07:12.838 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1877000000000001e-05 2024-04-18T21:07:12.838 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.838 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.838 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:12.838 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758064+0000", 2024-04-18T21:07:12.838 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.383e-05 2024-04-18T21:07:12.838 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.838 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.838 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:12.838 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803593+0000", 2024-04-18T21:07:12.839 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045528831999999998 2024-04-18T21:07:12.839 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.839 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.839 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:12.839 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803635+0000", 2024-04-18T21:07:12.839 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1980000000000001e-05 2024-04-18T21:07:12.839 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.839 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.839 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:12.839 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803703+0000", 2024-04-18T21:07:12.839 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8542999999999997e-05 2024-04-18T21:07:12.839 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.839 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.839 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:12.839 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806123+0000", 2024-04-18T21:07:12.840 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002419769 2024-04-18T21:07:12.840 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.840 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.840 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:12.840 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814542+0000", 2024-04-18T21:07:12.840 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084189460000000001 2024-04-18T21:07:12.840 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.840 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.840 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:12.840 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814576+0000", 2024-04-18T21:07:12.840 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3679000000000001e-05 2024-04-18T21:07:12.840 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.840 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.840 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:12.840 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814600+0000", 2024-04-18T21:07:12.840 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4187000000000001e-05 2024-04-18T21:07:12.841 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:12.841 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:12.841 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:12.841 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.841 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.841 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:108 3.1f 3:f83d65d8:::200.00000004:head [write 326287~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:12.841 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:07:12.841 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 27.035142316999998, 2024-04-18T21:07:12.841 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056616183, 2024-04-18T21:07:12.841 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:12.841 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:12.841 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:12.841 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:12.841 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.841 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:12.841 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:07:12.841 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:12.842 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.842 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.842 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:12.842 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:07:12.842 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:12.842 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.842 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.842 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:12.842 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758084+0000", 2024-04-18T21:07:12.842 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.124e-06 2024-04-18T21:07:12.842 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.842 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.842 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:12.842 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758100+0000", 2024-04-18T21:07:12.842 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6246e-05 2024-04-18T21:07:12.842 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.843 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.843 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:12.843 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758118+0000", 2024-04-18T21:07:12.843 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8267e-05 2024-04-18T21:07:12.843 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.843 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.843 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:12.843 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758134+0000", 2024-04-18T21:07:12.843 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5950000000000001e-05 2024-04-18T21:07:12.843 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.843 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.843 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:12.843 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803949+0000", 2024-04-18T21:07:12.843 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045815349999999998 2024-04-18T21:07:12.843 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.843 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.844 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:12.844 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804011+0000", 2024-04-18T21:07:12.844 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1044999999999996e-05 2024-04-18T21:07:12.844 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.844 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.844 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:12.844 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804128+0000", 2024-04-18T21:07:12.844 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117148 2024-04-18T21:07:12.844 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.844 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.844 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:12.844 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806794+0000", 2024-04-18T21:07:12.844 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002666692 2024-04-18T21:07:12.844 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.845 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.845 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:12.845 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814645+0000", 2024-04-18T21:07:12.845 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0078508880000000003 2024-04-18T21:07:12.845 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.845 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.845 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:12.845 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814678+0000", 2024-04-18T21:07:12.845 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3188999999999997e-05 2024-04-18T21:07:12.845 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.845 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.845 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:12.845 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814699+0000", 2024-04-18T21:07:12.845 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0284000000000001e-05 2024-04-18T21:07:12.845 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:12.845 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:12.846 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:12.846 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.846 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.846 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:109 3.1f 3:f83d65d8:::200.00000004:head [write 327693~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:12.846 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:07:12.846 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 27.03507295, 2024-04-18T21:07:12.846 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056621036999999999, 2024-04-18T21:07:12.846 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:12.846 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:12.846 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:12.846 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:12.846 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.846 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:12.846 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:07:12.846 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:12.847 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.847 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.847 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:12.847 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:07:12.847 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:12.847 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.847 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.847 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:12.847 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758153+0000", 2024-04-18T21:07:12.847 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1459999999999999e-06 2024-04-18T21:07:12.847 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.847 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.847 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:12.847 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758161+0000", 2024-04-18T21:07:12.847 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7999999999999999e-06 2024-04-18T21:07:12.847 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.847 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.848 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:12.848 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758179+0000", 2024-04-18T21:07:12.848 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7949999999999999e-05 2024-04-18T21:07:12.848 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.848 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.848 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:12.848 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758193+0000", 2024-04-18T21:07:12.848 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3773e-05 2024-04-18T21:07:12.848 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.848 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.848 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:12.848 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804632+0000", 2024-04-18T21:07:12.848 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.046439469999999997 2024-04-18T21:07:12.848 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.849 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.849 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:12.849 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804790+0000", 2024-04-18T21:07:12.849 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015784300000000001 2024-04-18T21:07:12.849 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.849 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.849 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:12.849 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805056+0000", 2024-04-18T21:07:12.849 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026652400000000003 2024-04-18T21:07:12.849 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.849 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.849 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:12.849 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.808959+0000", 2024-04-18T21:07:12.849 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003903077 2024-04-18T21:07:12.849 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.849 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.850 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:12.850 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814728+0000", 2024-04-18T21:07:12.850 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0057682489999999996 2024-04-18T21:07:12.850 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.850 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.850 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:12.850 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814754+0000", 2024-04-18T21:07:12.850 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6673999999999999e-05 2024-04-18T21:07:12.850 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.850 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.850 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:12.850 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814773+0000", 2024-04-18T21:07:12.850 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8530999999999999e-05 2024-04-18T21:07:12.850 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:12.850 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:12.850 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:12.851 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.851 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.851 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:110 3.1f 3:f83d65d8:::200.00000004:head [write 329098~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:12.851 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:07:12.851 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 27.035014540999999, 2024-04-18T21:07:12.851 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056669113, 2024-04-18T21:07:12.851 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:12.851 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:12.851 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:12.851 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:12.851 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.851 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:12.851 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:07:12.851 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:12.851 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.851 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.852 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:12.852 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:07:12.852 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:12.852 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.852 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.852 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:12.852 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758212+0000", 2024-04-18T21:07:12.852 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:07:12.852 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.852 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.852 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:12.852 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758219+0000", 2024-04-18T21:07:12.852 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4229999999999999e-06 2024-04-18T21:07:12.852 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.852 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.852 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:12.853 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758237+0000", 2024-04-18T21:07:12.853 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7966999999999999e-05 2024-04-18T21:07:12.853 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.853 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.853 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:12.853 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758252+0000", 2024-04-18T21:07:12.853 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5322999999999999e-05 2024-04-18T21:07:12.853 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.853 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.853 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:12.853 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805536+0000", 2024-04-18T21:07:12.853 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.047283861000000003 2024-04-18T21:07:12.853 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.853 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.853 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:12.853 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805579+0000", 2024-04-18T21:07:12.853 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2738999999999999e-05 2024-04-18T21:07:12.854 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.854 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.854 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:12.854 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805649+0000", 2024-04-18T21:07:12.854 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0213e-05 2024-04-18T21:07:12.854 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.854 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.854 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:12.854 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.808966+0000", 2024-04-18T21:07:12.854 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033166129999999999 2024-04-18T21:07:12.854 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.854 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.854 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:12.854 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814812+0000", 2024-04-18T21:07:12.854 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0058463589999999998 2024-04-18T21:07:12.855 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.855 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.855 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:12.855 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814854+0000", 2024-04-18T21:07:12.855 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1618e-05 2024-04-18T21:07:12.855 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.855 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.855 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:12.855 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814879+0000", 2024-04-18T21:07:12.855 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5754000000000001e-05 2024-04-18T21:07:12.855 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:12.855 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:12.855 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:12.855 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.855 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.855 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:111 3.1f 3:f83d65d8:::200.00000004:head [write 330499~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:12.856 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:07:12.856 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 27.034953564999999, 2024-04-18T21:07:12.856 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058693793000000001, 2024-04-18T21:07:12.856 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:12.856 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:12.856 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:12.856 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:12.856 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.856 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:12.856 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:07:12.856 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:12.856 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.856 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.856 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:12.856 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:07:12.857 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:12.857 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.857 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.857 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:12.857 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758272+0000", 2024-04-18T21:07:12.857 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1200000000000001e-06 2024-04-18T21:07:12.857 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.857 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.857 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:12.857 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758287+0000", 2024-04-18T21:07:12.857 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5017e-05 2024-04-18T21:07:12.857 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.857 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.857 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:12.857 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758309+0000", 2024-04-18T21:07:12.857 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1866e-05 2024-04-18T21:07:12.858 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.858 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.858 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:12.858 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758323+0000", 2024-04-18T21:07:12.858 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3606e-05 2024-04-18T21:07:12.858 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.858 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.858 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:12.858 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806279+0000", 2024-04-18T21:07:12.858 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.047956061000000001 2024-04-18T21:07:12.858 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.858 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.858 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:12.858 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806350+0000", 2024-04-18T21:07:12.858 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1070999999999998e-05 2024-04-18T21:07:12.858 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:12.859 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806459+0000", 2024-04-18T21:07:12.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000108606 2024-04-18T21:07:12.859 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:12.859 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.809774+0000", 2024-04-18T21:07:12.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003314881 2024-04-18T21:07:12.859 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:12.859 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816910+0000", 2024-04-18T21:07:12.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0071367760000000001 2024-04-18T21:07:12.859 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:12.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816941+0000", 2024-04-18T21:07:12.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0846000000000002e-05 2024-04-18T21:07:12.860 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.860 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:12.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816965+0000", 2024-04-18T21:07:12.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3943000000000001e-05 2024-04-18T21:07:12.860 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:12.860 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:12.860 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:12.860 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.860 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.860 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:5230 4.17 4:eb2cc4c4:::1000000184c.00000000:head [write 0~2191] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-18T21:07:12.860 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.760650+0000", 2024-04-18T21:07:12.860 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 27.032574394000001, 2024-04-18T21:07:12.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.054210577000000003, 2024-04-18T21:07:12.861 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:12.861 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:12.861 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:12.861 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:07:12.861 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:07:12.861 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:12.861 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 5230 2024-04-18T21:07:12.861 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.861 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:12.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.861 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:12.861 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760650+0000", 2024-04-18T21:07:12.861 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:12.861 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.861 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:12.861 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760650+0000", 2024-04-18T21:07:12.862 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:12.862 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.862 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.862 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:12.862 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760653+0000", 2024-04-18T21:07:12.862 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0829999999999998e-06 2024-04-18T21:07:12.862 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.862 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.862 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:12.862 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760664+0000", 2024-04-18T21:07:12.862 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.111e-05 2024-04-18T21:07:12.862 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.862 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.862 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:12.863 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760688+0000", 2024-04-18T21:07:12.863 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4837e-05 2024-04-18T21:07:12.863 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.863 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.863 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:12.863 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760702+0000", 2024-04-18T21:07:12.863 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3723000000000001e-05 2024-04-18T21:07:12.863 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.863 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.863 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:12.863 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806264+0000", 2024-04-18T21:07:12.863 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045562182 2024-04-18T21:07:12.863 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.863 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.863 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:12.863 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806351+0000", 2024-04-18T21:07:12.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6322000000000005e-05 2024-04-18T21:07:12.864 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.864 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.864 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:12.864 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806453+0000", 2024-04-18T21:07:12.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000102602 2024-04-18T21:07:12.864 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.864 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.864 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:12.864 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.808972+0000", 2024-04-18T21:07:12.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025184090000000001 2024-04-18T21:07:12.864 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.864 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.864 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:12.864 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814798+0000", 2024-04-18T21:07:12.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0058266689999999996 2024-04-18T21:07:12.865 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.865 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.865 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:12.865 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814839+0000", 2024-04-18T21:07:12.865 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0482000000000003e-05 2024-04-18T21:07:12.865 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.865 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.865 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:12.865 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814861+0000", 2024-04-18T21:07:12.865 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2158e-05 2024-04-18T21:07:12.865 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:12.865 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:12.865 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:12.865 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.865 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.865 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:112 3.1f 3:f83d65d8:::200.00000004:head [write 331898~20167 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:12.866 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.771321+0000", 2024-04-18T21:07:12.866 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 27.021903767000001, 2024-04-18T21:07:12.866 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045740306000000001, 2024-04-18T21:07:12.866 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:12.866 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:12.866 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:12.866 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:12.866 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.866 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:12.866 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771321+0000", 2024-04-18T21:07:12.866 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:12.866 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.866 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.866 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:12.866 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771321+0000", 2024-04-18T21:07:12.866 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:12.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:12.867 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771323+0000", 2024-04-18T21:07:12.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3740000000000001e-06 2024-04-18T21:07:12.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:12.867 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771359+0000", 2024-04-18T21:07:12.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5447999999999997e-05 2024-04-18T21:07:12.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:12.867 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771388+0000", 2024-04-18T21:07:12.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8915e-05 2024-04-18T21:07:12.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.868 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.868 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:12.868 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771410+0000", 2024-04-18T21:07:12.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1899000000000002e-05 2024-04-18T21:07:12.868 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.868 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.868 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:12.868 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806827+0000", 2024-04-18T21:07:12.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.035417063999999998 2024-04-18T21:07:12.868 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.868 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.868 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:12.868 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806873+0000", 2024-04-18T21:07:12.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6261999999999999e-05 2024-04-18T21:07:12.868 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.868 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.869 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:12.869 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806946+0000", 2024-04-18T21:07:12.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3205000000000001e-05 2024-04-18T21:07:12.869 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.869 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.869 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:12.869 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.809781+0000", 2024-04-18T21:07:12.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002834937 2024-04-18T21:07:12.869 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.869 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.869 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:12.869 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817003+0000", 2024-04-18T21:07:12.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0072217959999999999 2024-04-18T21:07:12.869 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.869 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.869 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:12.870 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817038+0000", 2024-04-18T21:07:12.870 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4696999999999997e-05 2024-04-18T21:07:12.870 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.870 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.870 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:12.870 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817061+0000", 2024-04-18T21:07:12.870 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3708999999999999e-05 2024-04-18T21:07:12.870 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:12.870 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:12.870 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:12.870 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.870 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.870 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:113 3.1f 3:f83d65d8:::200.00000004:head [write 352065~3878 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:12.870 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.771472+0000", 2024-04-18T21:07:12.870 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 27.021753030999999, 2024-04-18T21:07:12.870 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045689726, 2024-04-18T21:07:12.871 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:12.871 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:12.871 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:12.871 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:12.871 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.871 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:12.871 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771472+0000", 2024-04-18T21:07:12.871 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:12.871 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.871 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.871 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:12.871 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771472+0000", 2024-04-18T21:07:12.871 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:12.871 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.871 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.871 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:12.872 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771473+0000", 2024-04-18T21:07:12.872 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3829999999999999e-06 2024-04-18T21:07:12.872 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.872 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.872 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:12.872 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771489+0000", 2024-04-18T21:07:12.872 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5797000000000001e-05 2024-04-18T21:07:12.872 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.872 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.872 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:12.872 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771509+0000", 2024-04-18T21:07:12.872 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0401999999999999e-05 2024-04-18T21:07:12.872 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.872 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.872 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:12.873 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.771525+0000", 2024-04-18T21:07:12.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5099999999999999e-05 2024-04-18T21:07:12.873 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.873 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.873 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:12.873 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807273+0000", 2024-04-18T21:07:12.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.035748488000000002 2024-04-18T21:07:12.873 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.873 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.873 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:12.873 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807343+0000", 2024-04-18T21:07:12.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0277000000000005e-05 2024-04-18T21:07:12.873 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.873 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.873 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:12.873 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.807455+0000", 2024-04-18T21:07:12.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011171999999999999 2024-04-18T21:07:12.874 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.874 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.874 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:12.874 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.811509+0000", 2024-04-18T21:07:12.874 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0040543469999999998 2024-04-18T21:07:12.874 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.874 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.874 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:12.874 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817115+0000", 2024-04-18T21:07:12.874 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0056054520000000004 2024-04-18T21:07:12.874 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.874 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.874 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:12.874 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817142+0000", 2024-04-18T21:07:12.874 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7430999999999999e-05 2024-04-18T21:07:12.874 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.875 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.875 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:12.875 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.817162+0000", 2024-04-18T21:07:12.875 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9329000000000001e-05 2024-04-18T21:07:12.875 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:12.875 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:12.875 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:12.875 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.875 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.875 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:11950 4.6 4:62753dda:::10000003222.00000000:head [write 3145728~1048576] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:12.875 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:59.346083+0000", 2024-04-18T21:07:12.875 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.447141802999999, 2024-04-18T21:07:12.875 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.051281119999999999, 2024-04-18T21:07:12.875 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:12.875 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:12.875 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:12.876 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:07:12.876 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:07:12.876 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:12.876 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 11950 2024-04-18T21:07:12.876 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.876 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:12.876 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.876 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:12.876 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.346083+0000", 2024-04-18T21:07:12.876 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:12.876 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.876 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.876 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:12.876 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.346083+0000", 2024-04-18T21:07:12.876 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:12.876 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.876 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.877 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:12.877 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.346085+0000", 2024-04-18T21:07:12.877 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.736e-06 2024-04-18T21:07:12.877 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.877 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.877 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:12.877 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.349991+0000", 2024-04-18T21:07:12.877 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0039062960000000001 2024-04-18T21:07:12.877 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.877 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.877 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:12.877 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.350006+0000", 2024-04-18T21:07:12.877 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5327000000000001e-05 2024-04-18T21:07:12.877 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.877 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.877 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:12.878 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.350016+0000", 2024-04-18T21:07:12.878 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3570000000000004e-06 2024-04-18T21:07:12.878 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.878 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.878 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:12.878 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.360724+0000", 2024-04-18T21:07:12.878 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010708153999999999 2024-04-18T21:07:12.878 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.878 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.878 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:12.878 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.360839+0000", 2024-04-18T21:07:12.878 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000114877 2024-04-18T21:07:12.878 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.878 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.878 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:12.878 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.397285+0000", 2024-04-18T21:07:12.878 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036445957000000001 2024-04-18T21:07:12.879 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.879 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.879 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:12.879 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.397316+0000", 2024-04-18T21:07:12.879 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0926000000000002e-05 2024-04-18T21:07:12.879 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.879 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.879 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:12.879 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.397364+0000", 2024-04-18T21:07:12.879 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8489999999999998e-05 2024-04-18T21:07:12.879 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:12.879 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:12.879 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:12.879 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.879 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.879 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:12225 4.11 4:8acd30ee:::100000031ed.00000000:head [write 0~4194304 [2@86041]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:12.880 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:59.667090+0000", 2024-04-18T21:07:12.880 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.126135187999999, 2024-04-18T21:07:12.880 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.047400059000000001, 2024-04-18T21:07:12.880 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:12.880 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:12.880 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:12.880 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:07:12.880 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:07:12.880 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:12.880 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 12225 2024-04-18T21:07:12.880 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.880 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:12.880 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.880 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:12.880 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.667090+0000", 2024-04-18T21:07:12.880 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:12.881 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.881 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.881 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:12.881 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.667090+0000", 2024-04-18T21:07:12.881 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:12.881 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.881 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.881 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:12.881 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.667091+0000", 2024-04-18T21:07:12.881 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3629999999999999e-06 2024-04-18T21:07:12.881 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.881 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.881 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:12.881 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.674492+0000", 2024-04-18T21:07:12.881 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0074007789999999997 2024-04-18T21:07:12.881 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.881 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.882 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:12.882 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.674508+0000", 2024-04-18T21:07:12.882 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6509999999999999e-05 2024-04-18T21:07:12.882 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.882 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.882 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:12.882 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.674518+0000", 2024-04-18T21:07:12.882 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.6290000000000005e-06 2024-04-18T21:07:12.882 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.882 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.882 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:12.882 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.674584+0000", 2024-04-18T21:07:12.882 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5597000000000002e-05 2024-04-18T21:07:12.882 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.882 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.883 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:12.883 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.674659+0000", 2024-04-18T21:07:12.883 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5168999999999998e-05 2024-04-18T21:07:12.883 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.883 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.883 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:12.883 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.674775+0000", 2024-04-18T21:07:12.883 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000116069 2024-04-18T21:07:12.883 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.883 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.883 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:12.883 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.685336+0000", 2024-04-18T21:07:12.883 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010561022999999999 2024-04-18T21:07:12.883 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.883 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.883 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:12.883 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.714413+0000", 2024-04-18T21:07:12.884 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.029077306000000001 2024-04-18T21:07:12.884 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.884 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.884 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:12.884 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.714455+0000", 2024-04-18T21:07:12.884 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1547e-05 2024-04-18T21:07:12.884 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.884 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.884 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:12.884 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.714490+0000", 2024-04-18T21:07:12.884 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5067000000000002e-05 2024-04-18T21:07:12.884 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:12.884 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:12.884 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:12.884 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.884 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.885 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:12689 4.26 4:64a7f444:::100000033e5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:12.885 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:00.208067+0000", 2024-04-18T21:07:12.885 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 12.585158149, 2024-04-18T21:07:12.885 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066681457, 2024-04-18T21:07:12.885 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:12.885 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:12.885 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:12.885 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:07:12.885 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:07:12.885 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:12.885 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 12689 2024-04-18T21:07:12.885 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.885 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:12.885 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.885 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:12.886 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.208067+0000", 2024-04-18T21:07:12.886 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:12.886 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.886 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.886 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:12.886 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.208067+0000", 2024-04-18T21:07:12.886 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:12.886 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.886 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.886 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:12.886 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.208069+0000", 2024-04-18T21:07:12.886 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1500000000000002e-06 2024-04-18T21:07:12.886 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.886 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.886 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:12.886 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216162+0000", 2024-04-18T21:07:12.887 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0080933159999999997 2024-04-18T21:07:12.887 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.887 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.887 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:12.887 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216181+0000", 2024-04-18T21:07:12.887 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8573e-05 2024-04-18T21:07:12.887 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.887 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.887 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:12.887 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216192+0000", 2024-04-18T21:07:12.887 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0767999999999999e-05 2024-04-18T21:07:12.887 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.887 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.887 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:12.887 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216259+0000", 2024-04-18T21:07:12.887 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7977000000000003e-05 2024-04-18T21:07:12.888 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.888 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.888 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:12.888 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216635+0000", 2024-04-18T21:07:12.888 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00037591300000000002 2024-04-18T21:07:12.888 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.888 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.888 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:12.888 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216929+0000", 2024-04-18T21:07:12.888 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00029314800000000002 2024-04-18T21:07:12.888 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.888 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.888 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:12.888 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.232918+0000", 2024-04-18T21:07:12.888 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015989903 2024-04-18T21:07:12.888 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.888 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.889 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:12.889 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.274643+0000", 2024-04-18T21:07:12.889 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.041724281000000002 2024-04-18T21:07:12.889 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.889 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.889 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:12.889 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.274701+0000", 2024-04-18T21:07:12.889 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8304999999999998e-05 2024-04-18T21:07:12.889 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.889 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.889 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:12.889 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.274748+0000", 2024-04-18T21:07:12.889 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7123000000000003e-05 2024-04-18T21:07:12.889 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:12.889 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:12.889 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:12.890 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.890 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.890 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4534.0:15094 4.c e59/16 4:32870457:::10000003692.00000000:head v 59'213, mlcod=59'211)", 2024-04-18T21:07:12.890 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:03.117817+0000", 2024-04-18T21:07:12.890 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.6754080780000002, 2024-04-18T21:07:12.890 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.049868875999999999, 2024-04-18T21:07:12.890 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:12.890 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:12.890 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:12.890 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:12.890 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.890 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:12.890 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.117817+0000", 2024-04-18T21:07:12.890 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:12.890 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.890 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.890 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:12.891 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.117817+0000", 2024-04-18T21:07:12.891 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:12.891 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.891 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.891 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:12.891 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.117817+0000", 2024-04-18T21:07:12.891 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0200000000000003e-07 2024-04-18T21:07:12.891 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.891 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.891 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:12.891 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.140525+0000", 2024-04-18T21:07:12.891 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.022707775999999999 2024-04-18T21:07:12.891 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.891 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.891 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:12.891 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.140549+0000", 2024-04-18T21:07:12.892 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4456000000000001e-05 2024-04-18T21:07:12.892 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.892 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.892 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:12.892 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.140563+0000", 2024-04-18T21:07:12.892 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.329e-05 2024-04-18T21:07:12.892 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.892 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.892 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:12.892 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.140797+0000", 2024-04-18T21:07:12.892 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023447400000000001 2024-04-18T21:07:12.892 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.892 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.892 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:12.892 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.140842+0000", 2024-04-18T21:07:12.892 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5287000000000002e-05 2024-04-18T21:07:12.892 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.893 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.893 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:12.893 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.167577+0000", 2024-04-18T21:07:12.893 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.026734745000000001 2024-04-18T21:07:12.893 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:12.893 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:12.893 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:12.893 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.167686+0000", 2024-04-18T21:07:12.893 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000108446 2024-04-18T21:07:12.893 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:12.893 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:12.893 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:12.893 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:12.893 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:12.893 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:07:12.894 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:12.794+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:12.894 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:07:12.895 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-18T21:07:12.941 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:12.938+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:12.997 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:12.997+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:13.078 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:07:13.078 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [ 2024-04-18T21:07:13.078 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.078 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_repop(mds.0.3:8392 4.11 e64/16 4:8a31a010:::100000019ce.00000000:head v 64'317, mlcod=64'311)", 2024-04-18T21:07:13.078 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:13.076412+0000", 2024-04-18T21:07:13.078 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.004143023, 2024-04-18T21:07:13.078 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0041652640000000001, 2024-04-18T21:07:13.079 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:13.079 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:13.079 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:07:13.079 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:13.079 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.079 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:13.079 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.076412+0000", 2024-04-18T21:07:13.079 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.079 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.079 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.079 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:13.079 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.076412+0000", 2024-04-18T21:07:13.079 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.079 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.079 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.079 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:13.080 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.076413+0000", 2024-04-18T21:07:13.080 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.8500000000000001e-07 2024-04-18T21:07:13.080 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.080 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.080 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:13.080 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.076417+0000", 2024-04-18T21:07:13.080 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.7060000000000003e-06 2024-04-18T21:07:13.080 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.080 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.080 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:13.080 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.076426+0000", 2024-04-18T21:07:13.080 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.0479999999999999e-06 2024-04-18T21:07:13.080 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.080 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.080 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:13.080 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.076433+0000", 2024-04-18T21:07:13.081 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0389999999999999e-06 2024-04-18T21:07:13.081 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.081 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.081 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:13.081 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.078200+0000", 2024-04-18T21:07:13.081 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001767345 2024-04-18T21:07:13.081 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.081 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.081 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:13.081 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.078219+0000", 2024-04-18T21:07:13.081 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.9398999999999998e-05 2024-04-18T21:07:13.081 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.081 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:13.081 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.081 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.082 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.082 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:8395 4.1 4:825af6c4:::100000019d1.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-18T21:07:13.082 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:13.076586+0000", 2024-04-18T21:07:13.082 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.003968722, 2024-04-18T21:07:13.082 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0040708589999999996, 2024-04-18T21:07:13.082 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:13.082 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:13.082 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:07:13.082 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:13.082 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.082 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:13.082 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.076586+0000", 2024-04-18T21:07:13.082 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.082 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.082 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.082 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:13.083 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.076586+0000", 2024-04-18T21:07:13.083 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.083 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.083 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.083 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:13.083 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.076587+0000", 2024-04-18T21:07:13.083 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.9899999999999999e-07 2024-04-18T21:07:13.083 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.083 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.083 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:13.083 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.076591+0000", 2024-04-18T21:07:13.083 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.9060000000000004e-06 2024-04-18T21:07:13.083 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.083 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.083 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:13.083 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.076600+0000", 2024-04-18T21:07:13.084 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.3720000000000005e-06 2024-04-18T21:07:13.084 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.084 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.084 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:13.084 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.076608+0000", 2024-04-18T21:07:13.084 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.7309999999999999e-06 2024-04-18T21:07:13.084 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.084 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.084 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:13.084 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.078069+0000", 2024-04-18T21:07:13.084 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0014607590000000001 2024-04-18T21:07:13.084 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.084 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.084 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:13.084 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.078247+0000", 2024-04-18T21:07:13.085 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000178431 2024-04-18T21:07:13.085 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.085 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:13.085 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.085 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.085 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.085 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:8396 4.1a 4:58e314cf:::100000019d2.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-18T21:07:13.085 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:13.076750+0000", 2024-04-18T21:07:13.085 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.0038054970000000001, 2024-04-18T21:07:13.085 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0039747530000000001, 2024-04-18T21:07:13.085 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:13.085 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:13.085 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:07:13.085 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:13.085 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.086 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:13.086 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.076750+0000", 2024-04-18T21:07:13.086 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.086 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.086 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.086 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:13.086 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.076750+0000", 2024-04-18T21:07:13.086 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.086 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.086 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.086 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:13.086 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.076750+0000", 2024-04-18T21:07:13.086 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.9100000000000003e-07 2024-04-18T21:07:13.086 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.086 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.087 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:13.087 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.076754+0000", 2024-04-18T21:07:13.087 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.4580000000000002e-06 2024-04-18T21:07:13.087 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.087 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.087 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:13.087 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.076763+0000", 2024-04-18T21:07:13.087 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.3689999999999996e-06 2024-04-18T21:07:13.087 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.087 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.087 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:13.087 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.076771+0000", 2024-04-18T21:07:13.087 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8620000000000003e-06 2024-04-18T21:07:13.087 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.087 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.087 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:13.088 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.076836+0000", 2024-04-18T21:07:13.088 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.5147000000000005e-05 2024-04-18T21:07:13.088 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.088 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.088 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:13.088 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.076914+0000", 2024-04-18T21:07:13.088 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8005999999999998e-05 2024-04-18T21:07:13.088 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.088 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.088 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:13.088 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.077007+0000", 2024-04-18T21:07:13.088 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.2658000000000006e-05 2024-04-18T21:07:13.088 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.088 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.088 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:13.089 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.078288+0000", 2024-04-18T21:07:13.089 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001281337 2024-04-18T21:07:13.089 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.089 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:13.089 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.089 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.089 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.089 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:8405 4.1a 4:5a6234a2:::100000019e5.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-18T21:07:13.089 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:13.078495+0000", 2024-04-18T21:07:13.089 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.002059731, 2024-04-18T21:07:13.089 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0023082409999999999, 2024-04-18T21:07:13.089 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:13.089 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:13.089 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:07:13.089 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:13.090 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.090 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:13.090 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.078495+0000", 2024-04-18T21:07:13.090 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.090 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.090 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.090 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:13.090 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.078495+0000", 2024-04-18T21:07:13.090 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.090 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.090 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.090 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:13.090 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.078496+0000", 2024-04-18T21:07:13.090 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3099999999999998e-07 2024-04-18T21:07:13.090 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.091 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.091 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:13.091 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.078499+0000", 2024-04-18T21:07:13.091 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.6110000000000001e-06 2024-04-18T21:07:13.091 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.091 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.091 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:13.091 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.078506+0000", 2024-04-18T21:07:13.091 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.0489999999999998e-06 2024-04-18T21:07:13.091 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.091 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.091 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:13.091 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.078511+0000", 2024-04-18T21:07:13.091 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5879999999999997e-06 2024-04-18T21:07:13.091 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.092 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.092 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:13.092 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.078562+0000", 2024-04-18T21:07:13.092 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.0726000000000002e-05 2024-04-18T21:07:13.092 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.092 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.092 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:13.092 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.078700+0000", 2024-04-18T21:07:13.092 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00013839700000000001 2024-04-18T21:07:13.092 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.092 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.092 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:13.092 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.078786+0000", 2024-04-18T21:07:13.092 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5420999999999994e-05 2024-04-18T21:07:13.092 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.093 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.093 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:13.093 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.080130+0000", 2024-04-18T21:07:13.093 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0013439330000000001 2024-04-18T21:07:13.093 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.093 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:13.093 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.093 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.093 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.093 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:8408 3.e 3:7026fa6c:::100000019e8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-18T21:07:13.093 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:13.079549+0000", 2024-04-18T21:07:13.093 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.0010060539999999999, 2024-04-18T21:07:13.093 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0013256520000000001, 2024-04-18T21:07:13.093 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:13.093 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:13.094 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:07:13.094 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:13.094 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.094 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:13.094 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.079549+0000", 2024-04-18T21:07:13.094 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.094 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.094 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.094 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:13.094 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.079549+0000", 2024-04-18T21:07:13.094 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.094 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.094 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.094 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:13.094 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.079552+0000", 2024-04-18T21:07:13.094 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.2710000000000001e-06 2024-04-18T21:07:13.095 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.095 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.095 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:13.095 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.079556+0000", 2024-04-18T21:07:13.095 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.6950000000000002e-06 2024-04-18T21:07:13.095 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.095 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.095 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:13.095 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.079564+0000", 2024-04-18T21:07:13.095 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.1540000000000002e-06 2024-04-18T21:07:13.095 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.095 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.095 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:13.095 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.079570+0000", 2024-04-18T21:07:13.095 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5550000000000002e-06 2024-04-18T21:07:13.095 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.096 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.096 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:13.096 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.079622+0000", 2024-04-18T21:07:13.096 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.2510999999999999e-05 2024-04-18T21:07:13.096 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.096 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.096 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:13.096 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.079766+0000", 2024-04-18T21:07:13.096 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000143836 2024-04-18T21:07:13.096 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.096 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:13.096 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.096 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.096 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.096 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:8409 4.2c 4:370ecbd7:::100000019e9.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-18T21:07:13.097 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:13.079589+0000", 2024-04-18T21:07:13.097 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.00096636400000000005, 2024-04-18T21:07:13.097 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001345735, 2024-04-18T21:07:13.097 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:13.097 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:13.097 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:07:13.097 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:13.097 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.097 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:13.097 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.079589+0000", 2024-04-18T21:07:13.097 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.097 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.097 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.097 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:13.097 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.079589+0000", 2024-04-18T21:07:13.097 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.098 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.098 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.098 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:13.098 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.079589+0000", 2024-04-18T21:07:13.098 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.3600000000000003e-07 2024-04-18T21:07:13.098 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.098 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.098 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:13.098 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.079592+0000", 2024-04-18T21:07:13.098 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.8009999999999999e-06 2024-04-18T21:07:13.098 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.098 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.098 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:13.098 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.079600+0000", 2024-04-18T21:07:13.099 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3339999999999996e-06 2024-04-18T21:07:13.099 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.099 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.099 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:13.099 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.079605+0000", 2024-04-18T21:07:13.099 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.7429999999999999e-06 2024-04-18T21:07:13.099 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.099 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.099 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:13.099 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.079660+0000", 2024-04-18T21:07:13.099 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4678000000000001e-05 2024-04-18T21:07:13.099 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.099 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.099 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:13.099 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.079775+0000", 2024-04-18T21:07:13.099 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000114512 2024-04-18T21:07:13.099 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.100 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.100 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:13.100 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.079863+0000", 2024-04-18T21:07:13.100 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8546000000000002e-05 2024-04-18T21:07:13.100 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.100 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.100 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:13.100 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.080793+0000", 2024-04-18T21:07:13.100 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00092987400000000002 2024-04-18T21:07:13.100 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.100 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:13.100 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.100 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.100 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.100 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:8411 4.1d 4:b931a63c:::100000019eb.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-18T21:07:13.100 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:13.079693+0000", 2024-04-18T21:07:13.101 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.00086219699999999999, 2024-04-18T21:07:13.101 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0013185779999999999, 2024-04-18T21:07:13.101 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:13.101 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:13.101 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:13.101 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:13.101 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.101 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:13.101 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.079693+0000", 2024-04-18T21:07:13.101 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.101 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.101 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.101 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:13.101 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.079693+0000", 2024-04-18T21:07:13.101 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.101 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.102 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.102 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:13.102 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.079694+0000", 2024-04-18T21:07:13.102 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.4700000000000001e-07 2024-04-18T21:07:13.102 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.102 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.102 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:13.102 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.079697+0000", 2024-04-18T21:07:13.102 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.4139999999999998e-06 2024-04-18T21:07:13.102 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.102 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.102 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:13.102 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.079707+0000", 2024-04-18T21:07:13.102 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.944e-06 2024-04-18T21:07:13.103 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.103 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.103 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:13.103 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.079713+0000", 2024-04-18T21:07:13.103 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.3369999999999996e-06 2024-04-18T21:07:13.103 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.103 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.103 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:13.103 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.079761+0000", 2024-04-18T21:07:13.103 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.7095999999999998e-05 2024-04-18T21:07:13.103 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.103 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.103 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:13.103 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.079877+0000", 2024-04-18T21:07:13.103 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011640400000000001 2024-04-18T21:07:13.104 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.104 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.104 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:13.104 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.080856+0000", 2024-04-18T21:07:13.104 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00097873500000000011 2024-04-18T21:07:13.104 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.104 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.104 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:13.104 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.080933+0000", 2024-04-18T21:07:13.104 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.7645000000000006e-05 2024-04-18T21:07:13.104 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.104 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.104 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:13.104 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.081016+0000", 2024-04-18T21:07:13.105 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.3014000000000002e-05 2024-04-18T21:07:13.105 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.105 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:13.105 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.105 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.105 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.105 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_repop(mds.0.3:8406 4.11 e64/16 4:8a755855:::100000019e6.00000000:head v 64'318, mlcod=64'311)", 2024-04-18T21:07:13.105 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:13.079945+0000", 2024-04-18T21:07:13.105 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.00061030999999999998, 2024-04-18T21:07:13.105 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0011197819999999999, 2024-04-18T21:07:13.105 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:13.105 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:13.105 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:13.105 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:13.105 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.106 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:13.106 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.079945+0000", 2024-04-18T21:07:13.106 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.106 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.106 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.106 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:13.106 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.079945+0000", 2024-04-18T21:07:13.106 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.106 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.106 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.106 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:13.106 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.079945+0000", 2024-04-18T21:07:13.106 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.1099999999999996e-07 2024-04-18T21:07:13.106 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.107 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.107 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:13.107 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.079951+0000", 2024-04-18T21:07:13.107 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3380000000000004e-06 2024-04-18T21:07:13.107 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.107 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.107 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:13.107 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.079978+0000", 2024-04-18T21:07:13.107 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.6945999999999999e-05 2024-04-18T21:07:13.107 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.107 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.107 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:13.107 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.079984+0000", 2024-04-18T21:07:13.107 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.1120000000000001e-06 2024-04-18T21:07:13.107 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.108 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.108 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:13.108 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.080083+0000", 2024-04-18T21:07:13.108 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.8856000000000004e-05 2024-04-18T21:07:13.108 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.108 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.108 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:13.108 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.080193+0000", 2024-04-18T21:07:13.109 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011019 2024-04-18T21:07:13.109 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.109 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.109 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:13.109 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.081023+0000", 2024-04-18T21:07:13.109 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00083039099999999999 2024-04-18T21:07:13.109 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.109 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.109 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:13.109 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.081065+0000", 2024-04-18T21:07:13.110 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.1437999999999999e-05 2024-04-18T21:07:13.110 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.110 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:13.110 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.110 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.110 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.110 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:8416 4.1a 4:5bc1a1a5:::100000019f0.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-18T21:07:13.110 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:13.080408+0000", 2024-04-18T21:07:13.110 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.00014684600000000001, 2024-04-18T21:07:13.110 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00069662000000000001, 2024-04-18T21:07:13.110 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:13.110 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:13.110 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:07:13.110 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:13.110 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.110 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:13.111 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.080408+0000", 2024-04-18T21:07:13.111 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.111 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.111 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.111 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:13.111 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.080408+0000", 2024-04-18T21:07:13.111 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.111 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.111 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.111 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:13.111 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.080409+0000", 2024-04-18T21:07:13.111 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8899999999999998e-07 2024-04-18T21:07:13.111 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.111 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.111 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:13.111 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.080413+0000", 2024-04-18T21:07:13.112 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.1069999999999998e-06 2024-04-18T21:07:13.112 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.112 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.112 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:13.112 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.080423+0000", 2024-04-18T21:07:13.112 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.8849999999999994e-06 2024-04-18T21:07:13.112 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.112 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.112 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:13.112 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.080430+0000", 2024-04-18T21:07:13.112 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.1849999999999998e-06 2024-04-18T21:07:13.112 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.112 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.112 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:13.112 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.080475+0000", 2024-04-18T21:07:13.112 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.5003000000000003e-05 2024-04-18T21:07:13.113 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.113 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.113 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:13.113 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.080587+0000", 2024-04-18T21:07:13.113 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000111999 2024-04-18T21:07:13.113 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.113 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.113 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:13.113 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.080682+0000", 2024-04-18T21:07:13.113 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.4449000000000003e-05 2024-04-18T21:07:13.113 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.113 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:13.113 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.113 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.113 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.113 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:8390 4.1b 4:db48852d:::100000019cc.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-18T21:07:13.114 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:13.075715+0000", 2024-04-18T21:07:13.114 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.004840034, 2024-04-18T21:07:13.114 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0054248409999999997, 2024-04-18T21:07:13.114 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:13.114 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:13.114 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:07:13.114 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:13.114 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.114 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:13.114 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.075715+0000", 2024-04-18T21:07:13.114 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.114 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.114 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.114 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:13.114 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.075715+0000", 2024-04-18T21:07:13.114 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.115 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.115 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.115 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:13.115 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.075716+0000", 2024-04-18T21:07:13.115 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.5499999999999998e-07 2024-04-18T21:07:13.115 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.115 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.115 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:13.115 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.075718+0000", 2024-04-18T21:07:13.115 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.6589999999999999e-06 2024-04-18T21:07:13.115 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.115 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.115 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:13.115 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.075724+0000", 2024-04-18T21:07:13.115 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.2040000000000002e-06 2024-04-18T21:07:13.115 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.116 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.116 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:13.116 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.075729+0000", 2024-04-18T21:07:13.116 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8040000000000001e-06 2024-04-18T21:07:13.116 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.116 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.116 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:13.116 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.077667+0000", 2024-04-18T21:07:13.116 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0019379079999999999 2024-04-18T21:07:13.116 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.116 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.116 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:13.116 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.077748+0000", 2024-04-18T21:07:13.116 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.0674999999999996e-05 2024-04-18T21:07:13.116 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.117 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.117 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:13.117 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.077801+0000", 2024-04-18T21:07:13.117 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3597999999999997e-05 2024-04-18T21:07:13.117 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.117 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.117 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:13.117 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:13.079402+0000", 2024-04-18T21:07:13.117 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0016008680000000001 2024-04-18T21:07:13.117 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.117 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:13.117 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.117 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.117 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2024-04-18T21:07:13.117 INFO:teuthology.orchestra.run.smithi132.stdout: "num_ops": 10 2024-04-18T21:07:13.117 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:07:13.119 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:07:13.119 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:13.121+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:13.220 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:13.218+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:13.320 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:13.321+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:13.325 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:07:13.325 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:07:13.325 INFO:teuthology.orchestra.run.smithi132.stdout: "complaint_time": 30, 2024-04-18T21:07:13.325 INFO:teuthology.orchestra.run.smithi132.stdout: "num_blocked_ops": 0 2024-04-18T21:07:13.325 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:07:13.339 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:07:13.427 INFO:teuthology.orchestra.run.smithi078.stderr:nodeep-scrub is set 2024-04-18T21:07:13.428 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:13.429+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:13.453 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:07:13.521 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:13.521+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:13.526 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:07:13.527 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 20, 2024-04-18T21:07:13.527 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 600, 2024-04-18T21:07:13.527 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [ 2024-04-18T21:07:13.527 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.527 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:13.527 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:07:13.527 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 127.911205362, 2024-04-18T21:07:13.527 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043251955000000002, 2024-04-18T21:07:13.527 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:13.527 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:13.527 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:13.527 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:13.527 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.528 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:13.528 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:07:13.528 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.528 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.528 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.528 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:13.528 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:07:13.528 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.528 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.528 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.528 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:13.528 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616536+0000", 2024-04-18T21:07:13.528 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2869999999999999e-06 2024-04-18T21:07:13.528 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.529 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.529 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:13.529 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616572+0000", 2024-04-18T21:07:13.529 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.6261999999999999e-05 2024-04-18T21:07:13.529 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.529 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.529 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:13.529 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616593+0000", 2024-04-18T21:07:13.529 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1310000000000001e-05 2024-04-18T21:07:13.529 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.529 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.529 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:13.529 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616614+0000", 2024-04-18T21:07:13.529 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.0936000000000001e-05 2024-04-18T21:07:13.529 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.530 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.530 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:13.530 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629501+0000", 2024-04-18T21:07:13.530 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.012886819000000001 2024-04-18T21:07:13.530 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.530 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.530 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:13.530 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629696+0000", 2024-04-18T21:07:13.530 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019485499999999999 2024-04-18T21:07:13.530 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.530 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.530 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:13.530 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629940+0000", 2024-04-18T21:07:13.531 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00024386399999999999 2024-04-18T21:07:13.531 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.531 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.531 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:13.531 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640100+0000", 2024-04-18T21:07:13.531 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010159645 2024-04-18T21:07:13.531 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.531 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.531 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:13.531 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659516+0000", 2024-04-18T21:07:13.531 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019416563000000001 2024-04-18T21:07:13.531 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.531 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.531 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:13.531 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659684+0000", 2024-04-18T21:07:13.532 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016750900000000001 2024-04-18T21:07:13.532 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.532 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.532 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:13.532 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659787+0000", 2024-04-18T21:07:13.532 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000102905 2024-04-18T21:07:13.532 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.532 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:13.532 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.532 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.532 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.532 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:13.532 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:07:13.532 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 127.91110024, 2024-04-18T21:07:13.532 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043581898000000001, 2024-04-18T21:07:13.533 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:13.533 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:13.533 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:13.533 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:13.533 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.533 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:13.533 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:07:13.533 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.533 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.533 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.533 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:13.533 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:07:13.533 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.533 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.533 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.534 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:13.534 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616641+0000", 2024-04-18T21:07:13.534 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:07:13.534 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.534 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.534 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:13.534 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616648+0000", 2024-04-18T21:07:13.534 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3860000000000001e-06 2024-04-18T21:07:13.534 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.534 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.534 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:13.534 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616666+0000", 2024-04-18T21:07:13.534 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7583000000000001e-05 2024-04-18T21:07:13.534 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.535 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.535 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:13.535 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616679+0000", 2024-04-18T21:07:13.535 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3322999999999999e-05 2024-04-18T21:07:13.535 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.535 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.535 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:13.535 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630373+0000", 2024-04-18T21:07:13.535 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013694207999999999 2024-04-18T21:07:13.535 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.535 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.535 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:13.535 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630545+0000", 2024-04-18T21:07:13.535 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000171683 2024-04-18T21:07:13.535 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.536 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.536 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:13.536 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630728+0000", 2024-04-18T21:07:13.536 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000182599 2024-04-18T21:07:13.536 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.536 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.536 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:13.536 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640600+0000", 2024-04-18T21:07:13.536 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0098726119999999994 2024-04-18T21:07:13.536 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.536 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.536 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:13.536 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659927+0000", 2024-04-18T21:07:13.536 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019326724999999999 2024-04-18T21:07:13.537 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.537 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.537 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:13.537 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660112+0000", 2024-04-18T21:07:13.537 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000185203 2024-04-18T21:07:13.537 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.537 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.537 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:13.537 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660222+0000", 2024-04-18T21:07:13.537 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109343 2024-04-18T21:07:13.537 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.537 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:13.537 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.537 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.537 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.537 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11357 4.38 4:1d691e75:::1000000312c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T21:07:13.537 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:58.595279+0000", 2024-04-18T21:07:13.538 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 14.932461330000001, 2024-04-18T21:07:13.538 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.045901399000000002, 2024-04-18T21:07:13.538 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:13.538 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:13.538 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:13.538 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:13.538 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:13.538 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:13.538 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11357 2024-04-18T21:07:13.538 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.538 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:13.538 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.538 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:13.539 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.595279+0000", 2024-04-18T21:07:13.539 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.539 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.539 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.539 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:13.539 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.595279+0000", 2024-04-18T21:07:13.539 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.539 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.539 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.539 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:13.539 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.595280+0000", 2024-04-18T21:07:13.539 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.079e-06 2024-04-18T21:07:13.539 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.539 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.539 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:13.540 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600237+0000", 2024-04-18T21:07:13.540 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0049569089999999998 2024-04-18T21:07:13.540 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.540 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.540 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:13.540 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600254+0000", 2024-04-18T21:07:13.540 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7399000000000001e-05 2024-04-18T21:07:13.540 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.540 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.540 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:13.540 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600262+0000", 2024-04-18T21:07:13.540 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.174e-06 2024-04-18T21:07:13.540 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.540 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.541 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:13.541 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600359+0000", 2024-04-18T21:07:13.541 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.6358000000000001e-05 2024-04-18T21:07:13.541 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.541 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.541 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:13.541 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600507+0000", 2024-04-18T21:07:13.541 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014854199999999999 2024-04-18T21:07:13.541 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.541 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.541 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:13.541 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600748+0000", 2024-04-18T21:07:13.541 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000241361 2024-04-18T21:07:13.541 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.541 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.541 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:13.542 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.615590+0000", 2024-04-18T21:07:13.542 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.014841851 2024-04-18T21:07:13.542 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.542 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.542 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:13.542 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.639817+0000", 2024-04-18T21:07:13.542 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024226527000000001 2024-04-18T21:07:13.542 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.542 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.542 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:13.542 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.640962+0000", 2024-04-18T21:07:13.542 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001145561 2024-04-18T21:07:13.542 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.543 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.543 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:13.543 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.641180+0000", 2024-04-18T21:07:13.543 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00021763800000000001 2024-04-18T21:07:13.543 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.543 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:13.543 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.543 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.543 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.543 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11443 4.38 4:1d691e75:::1000000312c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T21:07:13.543 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:58.744218+0000", 2024-04-18T21:07:13.543 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 14.783521664, 2024-04-18T21:07:13.543 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.051074359999999999, 2024-04-18T21:07:13.543 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:13.543 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:13.543 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:13.543 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:13.544 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:13.544 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:13.544 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11443 2024-04-18T21:07:13.544 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.544 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:13.544 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.544 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:13.544 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.744218+0000", 2024-04-18T21:07:13.544 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.544 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.544 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.544 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:13.544 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.744218+0000", 2024-04-18T21:07:13.544 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.544 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.544 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.545 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:13.545 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.744221+0000", 2024-04-18T21:07:13.545 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.3580000000000001e-06 2024-04-18T21:07:13.545 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.545 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.545 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:13.545 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753328+0000", 2024-04-18T21:07:13.545 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0091071339999999994 2024-04-18T21:07:13.545 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.545 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.545 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:13.545 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753351+0000", 2024-04-18T21:07:13.545 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.3479999999999999e-05 2024-04-18T21:07:13.545 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.545 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.545 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:13.546 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753363+0000", 2024-04-18T21:07:13.546 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1345000000000001e-05 2024-04-18T21:07:13.546 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.546 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.546 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:13.546 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753416+0000", 2024-04-18T21:07:13.546 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.2849999999999997e-05 2024-04-18T21:07:13.546 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.546 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.546 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:13.546 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753471+0000", 2024-04-18T21:07:13.546 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5717999999999997e-05 2024-04-18T21:07:13.546 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.546 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.546 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:13.547 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753560+0000", 2024-04-18T21:07:13.547 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8777999999999996e-05 2024-04-18T21:07:13.547 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.547 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.547 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:13.547 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.760182+0000", 2024-04-18T21:07:13.547 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0066216299999999999 2024-04-18T21:07:13.547 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.547 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.547 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:13.547 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.795094+0000", 2024-04-18T21:07:13.547 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.034912334000000003 2024-04-18T21:07:13.547 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.547 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.547 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:13.548 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.795221+0000", 2024-04-18T21:07:13.548 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012745899999999999 2024-04-18T21:07:13.548 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.548 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.548 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:13.548 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.795293+0000", 2024-04-18T21:07:13.548 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.1273999999999996e-05 2024-04-18T21:07:13.548 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.548 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:13.548 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.548 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.548 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.548 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11511 4.18 4:184fae4a:::1000000316d.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:13.548 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:58.838500+0000", 2024-04-18T21:07:13.549 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 14.689239784, 2024-04-18T21:07:13.549 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.044451537999999999, 2024-04-18T21:07:13.549 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:13.549 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:13.549 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:13.549 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:13.549 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:13.549 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:13.549 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11511 2024-04-18T21:07:13.549 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.549 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:13.549 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.549 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:13.549 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.838500+0000", 2024-04-18T21:07:13.550 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.550 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.550 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.550 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:13.550 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.838500+0000", 2024-04-18T21:07:13.550 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.550 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.550 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.550 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:13.550 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.838501+0000", 2024-04-18T21:07:13.550 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.4799999999999997e-07 2024-04-18T21:07:13.550 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.550 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.550 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:13.551 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.847806+0000", 2024-04-18T21:07:13.551 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0093054250000000008 2024-04-18T21:07:13.551 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.551 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.551 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:13.551 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.847834+0000", 2024-04-18T21:07:13.551 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7161999999999998e-05 2024-04-18T21:07:13.551 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.551 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.551 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:13.551 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.847849+0000", 2024-04-18T21:07:13.551 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5217e-05 2024-04-18T21:07:13.551 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.551 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.551 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:13.551 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.847917+0000", 2024-04-18T21:07:13.552 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7896000000000002e-05 2024-04-18T21:07:13.552 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.552 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.552 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:13.552 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.848080+0000", 2024-04-18T21:07:13.552 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016328299999999999 2024-04-18T21:07:13.552 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.552 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.552 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:13.552 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.848348+0000", 2024-04-18T21:07:13.552 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00026766099999999998 2024-04-18T21:07:13.552 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.552 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.552 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:13.552 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.863288+0000", 2024-04-18T21:07:13.553 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.014940301 2024-04-18T21:07:13.553 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.553 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.553 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:13.553 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.882854+0000", 2024-04-18T21:07:13.553 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019566456999999999 2024-04-18T21:07:13.553 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.553 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.553 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:13.553 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.882904+0000", 2024-04-18T21:07:13.553 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.9620999999999998e-05 2024-04-18T21:07:13.553 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.553 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.553 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:13.554 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.882952+0000", 2024-04-18T21:07:13.554 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.7766999999999999e-05 2024-04-18T21:07:13.554 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.554 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:13.554 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.554 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.554 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.554 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11728 4.39 4:9dcc5ecf:::1000000316e.00000000:head [write 0~4194304 [2@1720266]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:13.554 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.088728+0000", 2024-04-18T21:07:13.554 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 14.439011917, 2024-04-18T21:07:13.554 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.047519835000000003, 2024-04-18T21:07:13.554 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:13.554 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:13.554 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:13.555 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:13.555 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:13.555 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:13.555 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11728 2024-04-18T21:07:13.555 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.555 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:13.555 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.555 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:13.555 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.088728+0000", 2024-04-18T21:07:13.555 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.555 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.555 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.555 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:13.555 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.088728+0000", 2024-04-18T21:07:13.555 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.555 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.556 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.556 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:13.556 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.088729+0000", 2024-04-18T21:07:13.556 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1000000000000001e-06 2024-04-18T21:07:13.556 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.556 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.556 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:13.556 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094322+0000", 2024-04-18T21:07:13.556 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0055931349999999999 2024-04-18T21:07:13.556 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.556 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.556 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:13.556 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094334+0000", 2024-04-18T21:07:13.556 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1894e-05 2024-04-18T21:07:13.556 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.557 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.557 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:13.557 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094340+0000", 2024-04-18T21:07:13.557 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.8780000000000003e-06 2024-04-18T21:07:13.557 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.557 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.557 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:13.557 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094393+0000", 2024-04-18T21:07:13.557 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3275000000000001e-05 2024-04-18T21:07:13.557 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.557 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.557 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:13.557 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094479+0000", 2024-04-18T21:07:13.557 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5222999999999994e-05 2024-04-18T21:07:13.558 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.558 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.558 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:13.558 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094629+0000", 2024-04-18T21:07:13.558 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00015021699999999999 2024-04-18T21:07:13.558 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.558 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.558 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:13.558 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.102975+0000", 2024-04-18T21:07:13.558 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0083464460000000004 2024-04-18T21:07:13.558 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.558 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.558 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:13.558 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136142+0000", 2024-04-18T21:07:13.559 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.033166432000000003 2024-04-18T21:07:13.559 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.559 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.559 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:13.559 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136207+0000", 2024-04-18T21:07:13.559 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.5032999999999999e-05 2024-04-18T21:07:13.559 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.559 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.559 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:13.559 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136248+0000", 2024-04-18T21:07:13.559 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.1202000000000003e-05 2024-04-18T21:07:13.559 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.559 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:13.559 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.559 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.560 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.560 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11847 4.a 4:51f063b7:::100000032b5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:13.560 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.229180+0000", 2024-04-18T21:07:13.560 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 14.298559860999999, 2024-04-18T21:07:13.560 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.048001033999999998, 2024-04-18T21:07:13.560 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:13.560 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:13.560 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:13.560 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:13.560 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:13.560 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:13.560 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11847 2024-04-18T21:07:13.560 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.561 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:13.561 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.561 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:13.561 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.229180+0000", 2024-04-18T21:07:13.561 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.561 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.561 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.561 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:13.561 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.229180+0000", 2024-04-18T21:07:13.561 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.561 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.561 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.561 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:13.561 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.229181+0000", 2024-04-18T21:07:13.562 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.119e-06 2024-04-18T21:07:13.562 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.562 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.562 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:13.562 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.235951+0000", 2024-04-18T21:07:13.562 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0067702370000000001 2024-04-18T21:07:13.562 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.562 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.562 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:13.562 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.235965+0000", 2024-04-18T21:07:13.562 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3202e-05 2024-04-18T21:07:13.562 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.562 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.562 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:13.562 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.235973+0000", 2024-04-18T21:07:13.563 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8630000000000008e-06 2024-04-18T21:07:13.563 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.563 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.563 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:13.563 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.236047+0000", 2024-04-18T21:07:13.563 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.4453e-05 2024-04-18T21:07:13.563 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.563 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.563 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:13.563 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.236137+0000", 2024-04-18T21:07:13.563 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.9751000000000002e-05 2024-04-18T21:07:13.563 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.563 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.563 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:13.564 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.236266+0000", 2024-04-18T21:07:13.564 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000129257 2024-04-18T21:07:13.564 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.564 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.564 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:13.564 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.244520+0000", 2024-04-18T21:07:13.564 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0082538190000000008 2024-04-18T21:07:13.564 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.564 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.564 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:13.564 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.277093+0000", 2024-04-18T21:07:13.564 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.032573405999999999 2024-04-18T21:07:13.564 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.564 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.564 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:13.564 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.277144+0000", 2024-04-18T21:07:13.564 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.0553000000000002e-05 2024-04-18T21:07:13.565 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.565 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.565 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:13.565 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.277181+0000", 2024-04-18T21:07:13.565 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.7373999999999998e-05 2024-04-18T21:07:13.565 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.565 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:13.565 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.565 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.565 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.565 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11949 4.2b 4:d50cc3c5:::100000031c6.00000000:head [write 0~3145728] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:13.565 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.338113+0000", 2024-04-18T21:07:13.565 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 14.189626985, 2024-04-18T21:07:13.565 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.046907847000000003, 2024-04-18T21:07:13.565 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:13.566 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:13.566 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:13.566 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:13.566 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:13.566 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:13.566 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11949 2024-04-18T21:07:13.566 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.566 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:13.566 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.566 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:13.566 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.338113+0000", 2024-04-18T21:07:13.566 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.566 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.567 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.567 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:13.567 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.338113+0000", 2024-04-18T21:07:13.567 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.567 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.567 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.567 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:13.567 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.338115+0000", 2024-04-18T21:07:13.567 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5659999999999999e-06 2024-04-18T21:07:13.567 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.567 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.567 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:13.567 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344146+0000", 2024-04-18T21:07:13.567 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0060309339999999999 2024-04-18T21:07:13.567 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.568 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.568 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:13.568 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344163+0000", 2024-04-18T21:07:13.568 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6994999999999999e-05 2024-04-18T21:07:13.568 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.568 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.568 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:13.568 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344171+0000", 2024-04-18T21:07:13.568 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5520000000000005e-06 2024-04-18T21:07:13.568 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.568 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.568 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:13.568 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344604+0000", 2024-04-18T21:07:13.568 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00043326299999999997 2024-04-18T21:07:13.568 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.569 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.569 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:13.569 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344687+0000", 2024-04-18T21:07:13.569 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.2952000000000001e-05 2024-04-18T21:07:13.569 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.569 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.569 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:13.569 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344792+0000", 2024-04-18T21:07:13.569 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000104635 2024-04-18T21:07:13.569 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.569 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.569 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:13.569 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.361867+0000", 2024-04-18T21:07:13.569 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017075245999999999 2024-04-18T21:07:13.570 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.570 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.570 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:13.570 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.384879+0000", 2024-04-18T21:07:13.570 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023011474000000001 2024-04-18T21:07:13.570 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.570 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.570 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:13.570 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.384976+0000", 2024-04-18T21:07:13.570 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.7399999999999996e-05 2024-04-18T21:07:13.570 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.570 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.570 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:13.570 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.385021+0000", 2024-04-18T21:07:13.571 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.4830000000000003e-05 2024-04-18T21:07:13.571 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.571 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:13.571 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.571 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.571 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.571 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:12041 4.38 4:1c8d9fef:::100000033ed.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:13.571 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.446812+0000", 2024-04-18T21:07:13.571 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 14.080927744, 2024-04-18T21:07:13.571 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.044749606999999997, 2024-04-18T21:07:13.571 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:13.571 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:13.571 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:13.571 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:13.571 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:13.572 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:13.572 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 12041 2024-04-18T21:07:13.572 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.572 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:13.572 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.572 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:13.572 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.446812+0000", 2024-04-18T21:07:13.572 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.572 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.572 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.572 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:13.572 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.446812+0000", 2024-04-18T21:07:13.572 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.572 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.572 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.573 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:13.573 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.446814+0000", 2024-04-18T21:07:13.573 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5099999999999999e-06 2024-04-18T21:07:13.573 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.573 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.573 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:13.573 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.452583+0000", 2024-04-18T21:07:13.573 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0057696379999999997 2024-04-18T21:07:13.573 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.573 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.573 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:13.573 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.452599+0000", 2024-04-18T21:07:13.573 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5701000000000001e-05 2024-04-18T21:07:13.573 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.573 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.574 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:13.574 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.452607+0000", 2024-04-18T21:07:13.574 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.7100000000000007e-06 2024-04-18T21:07:13.574 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.574 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.574 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:13.574 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.452718+0000", 2024-04-18T21:07:13.574 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000111257 2024-04-18T21:07:13.574 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.574 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.574 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:13.574 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.452924+0000", 2024-04-18T21:07:13.574 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000206066 2024-04-18T21:07:13.574 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.574 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.575 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:13.575 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.453088+0000", 2024-04-18T21:07:13.575 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016336700000000001 2024-04-18T21:07:13.575 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.575 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.575 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:13.575 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.469818+0000", 2024-04-18T21:07:13.575 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016730248999999999 2024-04-18T21:07:13.575 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.575 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.575 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:13.575 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.491505+0000", 2024-04-18T21:07:13.575 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021687366 2024-04-18T21:07:13.575 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.576 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.576 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:13.576 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.491537+0000", 2024-04-18T21:07:13.576 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.1888999999999999e-05 2024-04-18T21:07:13.576 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.576 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.576 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:13.576 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.491562+0000", 2024-04-18T21:07:13.576 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.4854e-05 2024-04-18T21:07:13.576 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.576 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:13.576 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.576 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.576 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.576 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:12228 4.16 4:6a8d8629:::100000033d5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:13.577 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.681634+0000", 2024-04-18T21:07:13.577 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 13.846105516, 2024-04-18T21:07:13.577 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043430791000000003, 2024-04-18T21:07:13.577 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:13.577 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:13.577 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:13.577 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:13.577 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:13.577 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:13.577 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 12228 2024-04-18T21:07:13.577 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.577 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:13.577 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.577 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:13.577 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.681634+0000", 2024-04-18T21:07:13.578 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.578 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.578 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.578 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:13.578 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.681634+0000", 2024-04-18T21:07:13.578 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.578 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.578 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.578 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:13.578 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.681637+0000", 2024-04-18T21:07:13.578 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.418e-06 2024-04-18T21:07:13.578 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.578 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.578 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:13.579 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.688982+0000", 2024-04-18T21:07:13.579 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0073447870000000002 2024-04-18T21:07:13.579 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.579 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.579 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:13.579 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.688998+0000", 2024-04-18T21:07:13.579 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6330000000000001e-05 2024-04-18T21:07:13.579 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.579 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.579 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:13.579 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.689009+0000", 2024-04-18T21:07:13.579 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1236999999999999e-05 2024-04-18T21:07:13.579 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.579 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.580 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:13.580 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.689083+0000", 2024-04-18T21:07:13.580 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3415000000000001e-05 2024-04-18T21:07:13.580 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.580 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.580 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:13.580 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.689237+0000", 2024-04-18T21:07:13.580 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00015420899999999999 2024-04-18T21:07:13.580 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.580 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.580 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:13.580 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.689419+0000", 2024-04-18T21:07:13.580 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018242099999999999 2024-04-18T21:07:13.580 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.581 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.581 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:13.581 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.711630+0000", 2024-04-18T21:07:13.581 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.022210475 2024-04-18T21:07:13.581 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.581 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.581 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:13.581 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.724956+0000", 2024-04-18T21:07:13.581 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013325887999999999 2024-04-18T21:07:13.581 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.581 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.581 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:13.581 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.725019+0000", 2024-04-18T21:07:13.581 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.3757999999999995e-05 2024-04-18T21:07:13.582 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.582 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.582 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:13.582 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.725065+0000", 2024-04-18T21:07:13.582 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.5853000000000003e-05 2024-04-18T21:07:13.582 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.582 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:13.582 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.582 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.582 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.582 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_repop(client.4534.0:12689 4.26 e58/16 4:64a7f444:::100000033e5.00000000:head v 58'205, mlcod=58'203)", 2024-04-18T21:07:13.582 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:00.217785+0000", 2024-04-18T21:07:13.582 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 13.309954949, 2024-04-18T21:07:13.583 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.052245469000000003, 2024-04-18T21:07:13.583 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:13.583 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:13.583 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:13.583 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:13.583 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.583 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:13.583 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.217785+0000", 2024-04-18T21:07:13.583 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.583 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.583 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.583 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:13.583 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.217785+0000", 2024-04-18T21:07:13.583 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.583 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.584 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.584 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:13.584 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.217786+0000", 2024-04-18T21:07:13.584 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6700000000000002e-07 2024-04-18T21:07:13.584 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.584 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.584 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:13.584 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225111+0000", 2024-04-18T21:07:13.584 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0073251119999999999 2024-04-18T21:07:13.584 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.584 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.584 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:13.584 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225126+0000", 2024-04-18T21:07:13.584 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.541e-05 2024-04-18T21:07:13.585 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.585 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.585 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:13.585 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225137+0000", 2024-04-18T21:07:13.585 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0890000000000001e-05 2024-04-18T21:07:13.585 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.585 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.585 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:13.585 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225244+0000", 2024-04-18T21:07:13.585 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000106555 2024-04-18T21:07:13.585 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.585 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.585 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:13.585 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225276+0000", 2024-04-18T21:07:13.586 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.2574999999999999e-05 2024-04-18T21:07:13.586 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.586 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.586 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:13.586 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.269985+0000", 2024-04-18T21:07:13.586 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.044708422999999997 2024-04-18T21:07:13.586 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.586 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.586 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:13.586 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.270031+0000", 2024-04-18T21:07:13.586 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.5636999999999997e-05 2024-04-18T21:07:13.586 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.586 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:13.586 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.587 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.587 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.587 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:12692 4.3a 4:5c788ec1:::100000032ff.00000000:head [write 0~4194304 [2@945974]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:13.587 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:00.225134+0000", 2024-04-18T21:07:13.587 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 13.302605893999999, 2024-04-18T21:07:13.587 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.048311640000000003, 2024-04-18T21:07:13.587 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:13.587 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:13.587 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:13.587 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:13.587 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:13.587 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:13.587 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 12692 2024-04-18T21:07:13.588 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.588 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:13.588 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.588 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:13.588 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225134+0000", 2024-04-18T21:07:13.588 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.588 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.588 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.588 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:13.588 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225134+0000", 2024-04-18T21:07:13.588 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.589 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.589 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.589 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:13.589 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225136+0000", 2024-04-18T21:07:13.589 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4160000000000001e-06 2024-04-18T21:07:13.589 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.589 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.589 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:13.589 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231408+0000", 2024-04-18T21:07:13.589 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.006272517 2024-04-18T21:07:13.589 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.589 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.589 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:13.589 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231437+0000", 2024-04-18T21:07:13.590 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.9119e-05 2024-04-18T21:07:13.590 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.590 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.590 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:13.590 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231456+0000", 2024-04-18T21:07:13.590 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8544999999999999e-05 2024-04-18T21:07:13.590 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.590 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.590 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:13.590 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231579+0000", 2024-04-18T21:07:13.590 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000123762 2024-04-18T21:07:13.590 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.590 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.590 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:13.591 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231690+0000", 2024-04-18T21:07:13.591 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000110349 2024-04-18T21:07:13.591 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.591 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.591 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:13.591 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231903+0000", 2024-04-18T21:07:13.591 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000212695 2024-04-18T21:07:13.591 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.591 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.591 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:13.591 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.253911+0000", 2024-04-18T21:07:13.591 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.022008706999999999 2024-04-18T21:07:13.591 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.591 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.591 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:13.592 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.273383+0000", 2024-04-18T21:07:13.592 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019471568000000002 2024-04-18T21:07:13.592 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.592 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.592 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:13.592 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.273418+0000", 2024-04-18T21:07:13.592 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.5265999999999997e-05 2024-04-18T21:07:13.592 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.592 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.592 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:13.592 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.273446+0000", 2024-04-18T21:07:13.592 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7696e-05 2024-04-18T21:07:13.592 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.592 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:13.593 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.593 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.593 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.593 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:15094 4.c 4:32870457:::10000003692.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-18T21:07:13.593 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:03.107374+0000", 2024-04-18T21:07:13.593 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 10.42036557, 2024-04-18T21:07:13.593 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.061575983000000001, 2024-04-18T21:07:13.593 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:13.593 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:13.593 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:13.593 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:13.593 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:13.593 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:13.593 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 15094 2024-04-18T21:07:13.594 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.594 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:13.594 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.594 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:13.594 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.107374+0000", 2024-04-18T21:07:13.594 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.594 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.594 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.594 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:13.594 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.107374+0000", 2024-04-18T21:07:13.594 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.594 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.594 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.594 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:13.595 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.107376+0000", 2024-04-18T21:07:13.595 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3969999999999999e-06 2024-04-18T21:07:13.595 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.595 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.595 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:13.595 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115698+0000", 2024-04-18T21:07:13.595 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0083223989999999994 2024-04-18T21:07:13.595 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.595 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.595 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:13.595 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115713+0000", 2024-04-18T21:07:13.595 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4385e-05 2024-04-18T21:07:13.595 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.595 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.596 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:13.596 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115722+0000", 2024-04-18T21:07:13.596 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0759999999999992e-06 2024-04-18T21:07:13.596 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.596 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.596 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:13.596 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115784+0000", 2024-04-18T21:07:13.596 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.2348999999999995e-05 2024-04-18T21:07:13.596 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.596 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.596 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:13.596 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115849+0000", 2024-04-18T21:07:13.596 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.4964999999999999e-05 2024-04-18T21:07:13.596 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.596 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.597 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:13.597 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.116054+0000", 2024-04-18T21:07:13.597 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020483400000000001 2024-04-18T21:07:13.597 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.597 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.597 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:13.597 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.125769+0000", 2024-04-18T21:07:13.597 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0097153340000000008 2024-04-18T21:07:13.597 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.597 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.597 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:13.597 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.168834+0000", 2024-04-18T21:07:13.597 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043064527999999998 2024-04-18T21:07:13.597 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.598 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.598 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:13.598 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.168882+0000", 2024-04-18T21:07:13.598 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.7919e-05 2024-04-18T21:07:13.598 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.598 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.598 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:13.598 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.168950+0000", 2024-04-18T21:07:13.598 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.8796999999999999e-05 2024-04-18T21:07:13.598 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.598 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:13.598 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.598 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.598 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.599 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:15133 4.38 4:1c73eb83:::1000000398c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-18T21:07:13.599 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:03.155031+0000", 2024-04-18T21:07:13.599 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 10.372709028999999, 2024-04-18T21:07:13.599 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.044078787000000001, 2024-04-18T21:07:13.599 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:13.599 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:13.599 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:13.599 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:13.599 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:13.599 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:13.599 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 15133 2024-04-18T21:07:13.599 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.599 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:13.599 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.599 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:13.600 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.155031+0000", 2024-04-18T21:07:13.600 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.600 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.600 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.600 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:13.600 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.155031+0000", 2024-04-18T21:07:13.600 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.600 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.600 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.600 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:13.600 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.155033+0000", 2024-04-18T21:07:13.600 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.84e-06 2024-04-18T21:07:13.600 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.600 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.600 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:13.601 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.161994+0000", 2024-04-18T21:07:13.601 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0069607779999999999 2024-04-18T21:07:13.601 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.601 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.601 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:13.601 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.162008+0000", 2024-04-18T21:07:13.601 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4399000000000001e-05 2024-04-18T21:07:13.601 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.601 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.601 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:13.601 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.162018+0000", 2024-04-18T21:07:13.601 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.7149999999999993e-06 2024-04-18T21:07:13.601 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.601 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.601 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:13.602 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.162073+0000", 2024-04-18T21:07:13.602 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4803999999999999e-05 2024-04-18T21:07:13.602 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.602 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.602 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:13.602 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.162215+0000", 2024-04-18T21:07:13.602 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014222900000000001 2024-04-18T21:07:13.602 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.602 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.602 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:13.602 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.162341+0000", 2024-04-18T21:07:13.602 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012579400000000001 2024-04-18T21:07:13.602 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.603 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.603 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:13.603 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.169445+0000", 2024-04-18T21:07:13.603 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0071040360000000002 2024-04-18T21:07:13.603 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.603 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.603 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:13.603 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.199046+0000", 2024-04-18T21:07:13.603 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.029601639999999999 2024-04-18T21:07:13.603 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.603 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.603 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:13.603 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.199082+0000", 2024-04-18T21:07:13.603 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.6134999999999999e-05 2024-04-18T21:07:13.604 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.604 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.604 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:13.604 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.199110+0000", 2024-04-18T21:07:13.604 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7416999999999999e-05 2024-04-18T21:07:13.604 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.604 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:13.604 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.604 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.604 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.604 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7616 4.d 4:b1f7eab6:::10000001d5f.00000000:head [delete] snapc 1=[] RETRY=2 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:13.604 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882522+0000", 2024-04-18T21:07:13.604 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 1.6452176779999999, 2024-04-18T21:07:13.605 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.086006255, 2024-04-18T21:07:13.605 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:13.605 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:13.605 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "reached pg", 2024-04-18T21:07:13.605 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:13.605 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.605 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:13.605 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882522+0000", 2024-04-18T21:07:13.605 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.605 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.605 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.605 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:13.605 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882522+0000", 2024-04-18T21:07:13.605 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.606 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.606 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.606 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:13.606 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882524+0000", 2024-04-18T21:07:13.606 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4720000000000001e-06 2024-04-18T21:07:13.606 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.606 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.606 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:13.606 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882531+0000", 2024-04-18T21:07:13.606 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7830000000000001e-06 2024-04-18T21:07:13.606 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.606 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.606 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:13.607 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882549+0000", 2024-04-18T21:07:13.607 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8765000000000001e-05 2024-04-18T21:07:13.607 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.607 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.607 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:13.607 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882562+0000", 2024-04-18T21:07:13.607 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3117e-05 2024-04-18T21:07:13.607 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.607 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.607 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:13.607 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882690+0000", 2024-04-18T21:07:13.608 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012794799999999999 2024-04-18T21:07:13.608 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.608 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.608 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op must wait for map", 2024-04-18T21:07:13.608 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882701+0000", 2024-04-18T21:07:13.608 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0215e-05 2024-04-18T21:07:13.608 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.608 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.608 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:13.608 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.891964+0000", 2024-04-18T21:07:13.608 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0092636130000000004 2024-04-18T21:07:13.608 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.609 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.609 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:13.609 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.891976+0000", 2024-04-18T21:07:13.609 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1973e-05 2024-04-18T21:07:13.609 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.609 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.609 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:13.609 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.959520+0000", 2024-04-18T21:07:13.609 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0675436009999999 2024-04-18T21:07:13.610 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.610 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.610 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for missing object", 2024-04-18T21:07:13.610 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.959662+0000", 2024-04-18T21:07:13.610 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014253000000000001 2024-04-18T21:07:13.610 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.610 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.610 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:13.610 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.968480+0000", 2024-04-18T21:07:13.610 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0088178409999999999 2024-04-18T21:07:13.610 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.611 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.611 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:13.611 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.968529+0000", 2024-04-18T21:07:13.611 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8396999999999998e-05 2024-04-18T21:07:13.611 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.611 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:13.611 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.611 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.611 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.611 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7628 4.31 4:8c97f9cd:::10000001d6c.00000000:head [delete] snapc 1=[] RETRY=2 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:13.611 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882610+0000", 2024-04-18T21:07:13.611 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 1.6451299480000001, 2024-04-18T21:07:13.611 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.08538018, 2024-04-18T21:07:13.611 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:13.611 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:13.612 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "reached pg", 2024-04-18T21:07:13.612 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:13.612 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.612 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:13.612 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882610+0000", 2024-04-18T21:07:13.612 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.612 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.612 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.612 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:13.612 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882610+0000", 2024-04-18T21:07:13.612 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.612 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.612 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.612 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:13.613 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882611+0000", 2024-04-18T21:07:13.613 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.4199999999999995e-07 2024-04-18T21:07:13.613 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.613 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.613 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:13.613 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882614+0000", 2024-04-18T21:07:13.613 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.4300000000000002e-06 2024-04-18T21:07:13.613 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.613 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.613 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:13.613 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882623+0000", 2024-04-18T21:07:13.613 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8740000000000001e-06 2024-04-18T21:07:13.613 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.613 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.613 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:13.614 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882629+0000", 2024-04-18T21:07:13.614 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.4330000000000001e-06 2024-04-18T21:07:13.614 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.614 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.614 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:13.614 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882706+0000", 2024-04-18T21:07:13.614 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.6280999999999997e-05 2024-04-18T21:07:13.614 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.614 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.614 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op must wait for map", 2024-04-18T21:07:13.614 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882715+0000", 2024-04-18T21:07:13.614 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.1679999999999993e-06 2024-04-18T21:07:13.614 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.615 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.615 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:13.615 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.889481+0000", 2024-04-18T21:07:13.615 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0067656979999999997 2024-04-18T21:07:13.615 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.615 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.615 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:13.615 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.889493+0000", 2024-04-18T21:07:13.615 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2451e-05 2024-04-18T21:07:13.615 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.615 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.615 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:13.615 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.940942+0000", 2024-04-18T21:07:13.615 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0514491720000001 2024-04-18T21:07:13.615 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.616 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.616 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for missing object", 2024-04-18T21:07:13.616 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.941134+0000", 2024-04-18T21:07:13.616 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019150600000000001 2024-04-18T21:07:13.616 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.616 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.616 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:13.616 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.967914+0000", 2024-04-18T21:07:13.616 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026780202999999999 2024-04-18T21:07:13.616 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.616 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.616 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:13.616 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.967990+0000", 2024-04-18T21:07:13.616 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.6322000000000006e-05 2024-04-18T21:07:13.616 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.616 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:13.617 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.617 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.617 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.617 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7630 4.d 4:b022c802:::10000001d6e.00000000:head [delete] snapc 1=[] RETRY=2 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:13.617 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882645+0000", 2024-04-18T21:07:13.617 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 1.6450946640000002, 2024-04-18T21:07:13.617 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0858072780000001, 2024-04-18T21:07:13.617 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:13.617 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:13.617 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "reached pg", 2024-04-18T21:07:13.617 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:13.617 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.617 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:13.617 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882645+0000", 2024-04-18T21:07:13.618 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.618 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.618 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.618 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:13.618 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882645+0000", 2024-04-18T21:07:13.618 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.618 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.618 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.618 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:13.618 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882646+0000", 2024-04-18T21:07:13.618 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.3599999999999999e-07 2024-04-18T21:07:13.618 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.618 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.618 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:13.619 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882648+0000", 2024-04-18T21:07:13.619 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.5809999999999999e-06 2024-04-18T21:07:13.619 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.619 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.619 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:13.619 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882655+0000", 2024-04-18T21:07:13.619 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7909999999999999e-06 2024-04-18T21:07:13.619 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.619 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.619 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:13.619 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882661+0000", 2024-04-18T21:07:13.619 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3920000000000002e-06 2024-04-18T21:07:13.619 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.619 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.620 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:13.620 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882825+0000", 2024-04-18T21:07:13.620 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016480100000000001 2024-04-18T21:07:13.620 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.620 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.620 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:07:13.620 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882840+0000", 2024-04-18T21:07:13.620 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4656e-05 2024-04-18T21:07:13.620 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.620 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.620 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:13.620 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.892020+0000", 2024-04-18T21:07:13.620 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0091804680000000007 2024-04-18T21:07:13.620 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.620 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.621 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:13.621 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.892026+0000", 2024-04-18T21:07:13.621 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4580000000000001e-06 2024-04-18T21:07:13.621 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.621 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.621 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:13.621 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.959913+0000", 2024-04-18T21:07:13.621 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.067887289 2024-04-18T21:07:13.621 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.621 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.621 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for missing object", 2024-04-18T21:07:13.621 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.960034+0000", 2024-04-18T21:07:13.622 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000120445 2024-04-18T21:07:13.622 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.622 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.622 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:13.622 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.968407+0000", 2024-04-18T21:07:13.622 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0083734010000000008 2024-04-18T21:07:13.622 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.622 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.622 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:13.622 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.968453+0000", 2024-04-18T21:07:13.622 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.5559999999999997e-05 2024-04-18T21:07:13.622 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.622 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:13.623 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.623 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.623 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.623 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7651 4.13 4:c9951bc5:::10000001e1b.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:13.623 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882696+0000", 2024-04-18T21:07:13.623 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 1.6450442509999998, 2024-04-18T21:07:13.623 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.088382095, 2024-04-18T21:07:13.623 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:13.623 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:13.623 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:13.623 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:13.623 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.623 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:13.623 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882696+0000", 2024-04-18T21:07:13.623 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.624 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.624 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.624 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:13.624 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882696+0000", 2024-04-18T21:07:13.624 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.624 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.624 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.624 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:13.624 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882696+0000", 2024-04-18T21:07:13.624 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.06e-07 2024-04-18T21:07:13.624 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.624 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.624 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:13.624 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882699+0000", 2024-04-18T21:07:13.625 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.1039999999999998e-06 2024-04-18T21:07:13.625 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.625 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.625 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:13.625 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882707+0000", 2024-04-18T21:07:13.625 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.593e-06 2024-04-18T21:07:13.625 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.625 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.625 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:13.625 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882712+0000", 2024-04-18T21:07:13.625 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.541e-06 2024-04-18T21:07:13.625 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.625 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.625 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:13.626 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882870+0000", 2024-04-18T21:07:13.626 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000157999 2024-04-18T21:07:13.626 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.626 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.626 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op must wait for map", 2024-04-18T21:07:13.626 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882885+0000", 2024-04-18T21:07:13.626 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4989e-05 2024-04-18T21:07:13.626 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.626 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.626 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:13.626 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.891447+0000", 2024-04-18T21:07:13.626 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0085618540000000007 2024-04-18T21:07:13.626 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.626 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.627 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:13.627 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.891457+0000", 2024-04-18T21:07:13.627 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.6399999999999992e-06 2024-04-18T21:07:13.627 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.627 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.627 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:13.627 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.964840+0000", 2024-04-18T21:07:13.627 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.073383279 2024-04-18T21:07:13.627 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.627 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.627 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:13.627 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.965078+0000", 2024-04-18T21:07:13.627 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000237581 2024-04-18T21:07:13.627 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.627 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.628 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:13.628 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.965299+0000", 2024-04-18T21:07:13.628 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00022087699999999999 2024-04-18T21:07:13.628 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.628 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.628 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:13.628 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.969505+0000", 2024-04-18T21:07:13.628 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.004206123 2024-04-18T21:07:13.628 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.628 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.628 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:13.628 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.970898+0000", 2024-04-18T21:07:13.628 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001393434 2024-04-18T21:07:13.628 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.629 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.629 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:13.629 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.970936+0000", 2024-04-18T21:07:13.629 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.7647000000000001e-05 2024-04-18T21:07:13.629 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.629 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.629 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:13.629 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.971078+0000", 2024-04-18T21:07:13.629 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014192799999999999 2024-04-18T21:07:13.629 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.629 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:13.629 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.629 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.629 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.629 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7671 4.31 4:8c95a1b7:::10000001e2f.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:13.630 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882728+0000", 2024-04-18T21:07:13.630 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 1.6450124160000001, 2024-04-18T21:07:13.630 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.084467606, 2024-04-18T21:07:13.630 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:13.630 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:13.630 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:13.630 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:13.630 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.630 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:13.630 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882728+0000", 2024-04-18T21:07:13.630 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.630 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.630 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.630 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:13.630 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882728+0000", 2024-04-18T21:07:13.631 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.631 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.631 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.631 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:13.631 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882728+0000", 2024-04-18T21:07:13.631 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.0399999999999996e-07 2024-04-18T21:07:13.631 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.631 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.631 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:13.631 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882731+0000", 2024-04-18T21:07:13.631 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.5239999999999999e-06 2024-04-18T21:07:13.631 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.631 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.631 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:13.631 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882739+0000", 2024-04-18T21:07:13.632 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4020000000000002e-06 2024-04-18T21:07:13.632 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.632 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.632 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:13.632 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882744+0000", 2024-04-18T21:07:13.632 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.1410000000000004e-06 2024-04-18T21:07:13.632 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.632 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.632 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:13.632 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882836+0000", 2024-04-18T21:07:13.632 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.2094000000000003e-05 2024-04-18T21:07:13.632 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.632 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.632 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:07:13.633 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882849+0000", 2024-04-18T21:07:13.633 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3087e-05 2024-04-18T21:07:13.633 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.633 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.633 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:13.633 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.889522+0000", 2024-04-18T21:07:13.633 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0066730950000000004 2024-04-18T21:07:13.633 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.633 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.633 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:13.633 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.889530+0000", 2024-04-18T21:07:13.633 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8699999999999992e-06 2024-04-18T21:07:13.633 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.633 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.633 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:13.634 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.941173+0000", 2024-04-18T21:07:13.634 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.051642658 2024-04-18T21:07:13.634 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.634 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.634 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:13.634 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.941392+0000", 2024-04-18T21:07:13.634 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00021854099999999999 2024-04-18T21:07:13.634 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.634 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.634 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:13.634 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.941618+0000", 2024-04-18T21:07:13.634 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0002265 2024-04-18T21:07:13.634 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.634 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.635 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:13.635 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.945390+0000", 2024-04-18T21:07:13.635 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0037723460000000002 2024-04-18T21:07:13.635 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.635 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.635 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:13.635 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.966905+0000", 2024-04-18T21:07:13.635 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021514559999999999 2024-04-18T21:07:13.635 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.635 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.635 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:13.635 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.966972+0000", 2024-04-18T21:07:13.635 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.6740000000000001e-05 2024-04-18T21:07:13.635 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.636 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.636 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:13.636 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.967195+0000", 2024-04-18T21:07:13.636 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000223544 2024-04-18T21:07:13.636 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.636 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:13.636 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.636 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.636 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.636 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7691 4.d 4:b0345396:::10000001e43.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:13.636 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882753+0000", 2024-04-18T21:07:13.636 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 1.6449874370000002, 2024-04-18T21:07:13.636 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.085135618, 2024-04-18T21:07:13.636 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:13.636 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:13.637 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:13.637 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:13.637 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.637 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:13.637 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882753+0000", 2024-04-18T21:07:13.637 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.637 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.637 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.637 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:13.637 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882753+0000", 2024-04-18T21:07:13.637 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:13.637 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.637 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.637 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:13.637 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882753+0000", 2024-04-18T21:07:13.638 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.9000000000000002e-07 2024-04-18T21:07:13.638 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.638 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.638 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:13.638 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882755+0000", 2024-04-18T21:07:13.638 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.4040000000000002e-06 2024-04-18T21:07:13.638 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.638 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.638 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:13.638 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882762+0000", 2024-04-18T21:07:13.638 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.6229999999999999e-06 2024-04-18T21:07:13.638 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.638 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.638 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:13.639 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882769+0000", 2024-04-18T21:07:13.639 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.1559999999999998e-06 2024-04-18T21:07:13.639 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.639 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.639 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:13.639 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882875+0000", 2024-04-18T21:07:13.639 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000105491 2024-04-18T21:07:13.639 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.639 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.639 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:07:13.639 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882879+0000", 2024-04-18T21:07:13.639 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.9999999999999998e-06 2024-04-18T21:07:13.639 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.639 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.639 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:13.640 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.892072+0000", 2024-04-18T21:07:13.640 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0091930989999999997 2024-04-18T21:07:13.640 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.640 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.640 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:13.640 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.892083+0000", 2024-04-18T21:07:13.640 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1070000000000001e-05 2024-04-18T21:07:13.640 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.640 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.640 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:13.640 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.960162+0000", 2024-04-18T21:07:13.640 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0680791869999999 2024-04-18T21:07:13.640 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.640 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.640 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:13.641 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.960314+0000", 2024-04-18T21:07:13.641 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000152139 2024-04-18T21:07:13.641 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.641 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.641 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:13.641 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.960469+0000", 2024-04-18T21:07:13.641 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000154444 2024-04-18T21:07:13.641 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.641 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.641 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:13.641 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.964018+0000", 2024-04-18T21:07:13.641 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035494179999999999 2024-04-18T21:07:13.641 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.641 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.641 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:13.641 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.967680+0000", 2024-04-18T21:07:13.642 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.003662046 2024-04-18T21:07:13.642 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.642 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.642 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:13.642 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.967738+0000", 2024-04-18T21:07:13.642 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.7946999999999999e-05 2024-04-18T21:07:13.642 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:13.642 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:13.642 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:13.642 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.967888+0000", 2024-04-18T21:07:13.642 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000150204 2024-04-18T21:07:13.642 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.642 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:13.642 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.643 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:13.643 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:13.643 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:07:13.644 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:07:13.644 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:07:13.644 INFO:teuthology.orchestra.run.smithi078.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-18T21:07:13.645 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:07:13.645 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:07:13.646 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-18T21:07:13.646 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:07:13.646 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-18T21:07:13.647 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:13.642+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:13.745 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:13.745+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:13.785 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:13.785 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:13.800 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:07:13.845 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:13.845+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:13.935 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:13.935 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:13.946 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:13.945+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:13.950 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:14.047 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:14.046+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:14.074 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:14.074 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:14.089 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:07:14.148 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:14.149+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:14.228 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:14.228 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:14.242 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:07:14.287 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:14.289+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:14.349 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:14.349+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:14.414 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:14.414 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:14.429 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:07:14.450 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:14.450+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:14.551 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:14.550+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:14.602 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:14.602 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:14.617 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:07:14.665 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:14.666+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:14.753 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:14.753+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:14.754 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:14.754 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:14.772 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:07:14.854 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:14.853+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:14.870 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~18s 2024-04-18T21:07:14.937 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:14.937 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:14.952 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:14.954 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:14.953+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:15.055 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:15.054+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:15.079 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:15.079 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:15.095 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:07:15.155 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:15.154+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:15.230 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:15.230 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:15.245 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:07:15.291 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:15.293+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:15.357 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:15.357+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:15.366 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:15.367 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:15.381 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:07:15.450 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-18T21:07:15.457 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:15.458+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:15.550 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:15.550 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:15.558 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:15.561+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:15.565 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:07:15.647 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:07:15.659 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:15.661+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:15.698 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:15.698 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:15.714 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:07:15.761 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:15.762+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:15.795 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:07:15.795 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:07:15.795 INFO:teuthology.orchestra.run.smithi078.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-18T21:07:15.817 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:07:15.817 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:07:15.820 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-18T21:07:15.820 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-18T21:07:15.861 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:15.861+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:15.863 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:07:15.863 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:07:15.863 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-18T21:07:15.863 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-18T21:07:15.863 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:07:15.887 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:15.973 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:15.974+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:16.063 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:16.062+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:16.083 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:07:16.083 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-18T21:07:16.083 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-18T21:07:16.084 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:07:16.084 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.084 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:16.084 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:07:16.084 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 130.46847347900001, 2024-04-18T21:07:16.084 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045745085999999997, 2024-04-18T21:07:16.084 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:16.084 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:16.084 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:16.084 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:16.084 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.084 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:16.084 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:07:16.084 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:16.085 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.085 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.085 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:16.085 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615670+0000", 2024-04-18T21:07:16.085 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:16.085 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.085 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.085 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:16.085 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615672+0000", 2024-04-18T21:07:16.085 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7400000000000001e-06 2024-04-18T21:07:16.085 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.085 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.085 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:16.086 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615700+0000", 2024-04-18T21:07:16.086 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8133e-05 2024-04-18T21:07:16.086 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.086 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.086 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:16.086 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615726+0000", 2024-04-18T21:07:16.086 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6132e-05 2024-04-18T21:07:16.086 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.086 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.086 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:16.086 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615742+0000", 2024-04-18T21:07:16.086 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6157000000000001e-05 2024-04-18T21:07:16.087 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.087 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:16.087 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615937+0000", 2024-04-18T21:07:16.087 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000194768 2024-04-18T21:07:16.087 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.087 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:07:16.087 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.615950+0000", 2024-04-18T21:07:16.087 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3084e-05 2024-04-18T21:07:16.087 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.087 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:16.087 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643676+0000", 2024-04-18T21:07:16.087 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027725639999999999 2024-04-18T21:07:16.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.088 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:16.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.643867+0000", 2024-04-18T21:07:16.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019075900000000001 2024-04-18T21:07:16.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.088 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:16.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.644227+0000", 2024-04-18T21:07:16.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036013799999999997 2024-04-18T21:07:16.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.088 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:16.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.646068+0000", 2024-04-18T21:07:16.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001841536 2024-04-18T21:07:16.089 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.089 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.089 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:16.089 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661184+0000", 2024-04-18T21:07:16.089 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015115458999999999 2024-04-18T21:07:16.089 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.089 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.089 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:16.089 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661283+0000", 2024-04-18T21:07:16.089 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9502999999999999e-05 2024-04-18T21:07:16.089 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.089 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.089 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:16.089 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:05:05.661415+0000", 2024-04-18T21:07:16.090 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000132037 2024-04-18T21:07:16.090 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:16.090 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:16.090 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:16.090 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.090 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.090 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:101 3.1f 3:f83d65d8:::200.00000004:head [write 316455~1401 [fadvise_dontneed] in=1401b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:16.090 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:07:16.090 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 30.326409867999999, 2024-04-18T21:07:16.090 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.048270212999999999, 2024-04-18T21:07:16.090 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:16.090 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:16.090 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:16.090 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:16.091 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.091 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:16.091 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:07:16.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:16.091 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.091 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.091 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:16.091 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:07:16.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:16.091 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.091 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.091 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:16.091 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757734+0000", 2024-04-18T21:07:16.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7700000000000004e-07 2024-04-18T21:07:16.092 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.092 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.092 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:16.092 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757745+0000", 2024-04-18T21:07:16.092 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0910000000000001e-05 2024-04-18T21:07:16.092 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.092 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.092 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:16.092 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757758+0000", 2024-04-18T21:07:16.092 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2593e-05 2024-04-18T21:07:16.092 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.092 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.092 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:16.092 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757765+0000", 2024-04-18T21:07:16.092 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1659999999999997e-06 2024-04-18T21:07:16.092 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.093 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:16.093 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.797782+0000", 2024-04-18T21:07:16.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.040017283000000001 2024-04-18T21:07:16.093 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.093 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:16.093 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.797949+0000", 2024-04-18T21:07:16.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016650399999999999 2024-04-18T21:07:16.093 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.093 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:16.093 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.798152+0000", 2024-04-18T21:07:16.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000203098 2024-04-18T21:07:16.093 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.094 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:16.094 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.800792+0000", 2024-04-18T21:07:16.094 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026394779999999998 2024-04-18T21:07:16.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.094 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:16.094 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805921+0000", 2024-04-18T21:07:16.094 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0051295519999999999 2024-04-18T21:07:16.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.094 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:16.094 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805967+0000", 2024-04-18T21:07:16.094 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5457000000000002e-05 2024-04-18T21:07:16.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.095 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.095 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:16.095 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806004+0000", 2024-04-18T21:07:16.095 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7494999999999999e-05 2024-04-18T21:07:16.095 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:16.095 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:16.095 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:16.095 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.095 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.095 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:102 3.1f 3:f83d65d8:::200.00000004:head [write 317856~1403 [fadvise_dontneed] in=1403b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:16.095 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757775+0000", 2024-04-18T21:07:16.095 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 30.326368802000001, 2024-04-18T21:07:16.095 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.048337705000000002, 2024-04-18T21:07:16.095 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:16.095 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:16.096 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:16.096 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:16.096 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.096 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:16.096 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757775+0000", 2024-04-18T21:07:16.096 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:16.096 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.096 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.096 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:16.096 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757775+0000", 2024-04-18T21:07:16.096 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:16.096 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.096 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.096 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:16.096 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757776+0000", 2024-04-18T21:07:16.097 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5300000000000004e-07 2024-04-18T21:07:16.097 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.097 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.097 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:16.097 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757780+0000", 2024-04-18T21:07:16.097 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2270000000000004e-06 2024-04-18T21:07:16.097 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.097 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.097 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:16.097 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757792+0000", 2024-04-18T21:07:16.097 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2696e-05 2024-04-18T21:07:16.097 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.097 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.097 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:16.097 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757800+0000", 2024-04-18T21:07:16.098 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1439999999999997e-06 2024-04-18T21:07:16.098 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.098 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.098 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:16.098 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.798773+0000", 2024-04-18T21:07:16.098 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.040973074999999998 2024-04-18T21:07:16.098 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.098 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.098 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:16.098 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.798990+0000", 2024-04-18T21:07:16.098 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000217161 2024-04-18T21:07:16.098 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.098 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.098 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:16.099 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.799173+0000", 2024-04-18T21:07:16.099 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018295900000000001 2024-04-18T21:07:16.099 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.099 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.099 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:16.099 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802469+0000", 2024-04-18T21:07:16.099 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032965350000000002 2024-04-18T21:07:16.099 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.099 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.099 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:16.099 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806042+0000", 2024-04-18T21:07:16.099 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035724630000000001 2024-04-18T21:07:16.099 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.100 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.100 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:16.100 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806077+0000", 2024-04-18T21:07:16.100 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4997999999999999e-05 2024-04-18T21:07:16.100 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.100 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.100 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:16.100 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806113+0000", 2024-04-18T21:07:16.100 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5794000000000003e-05 2024-04-18T21:07:16.100 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:16.100 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:16.100 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:16.100 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.100 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.100 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:103 3.1f 3:f83d65d8:::200.00000004:head [write 319259~1404 [fadvise_dontneed] in=1404b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:16.101 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:07:16.101 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 30.326334956, 2024-04-18T21:07:16.101 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.048414481000000002, 2024-04-18T21:07:16.101 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:16.101 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:16.101 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:16.101 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:16.101 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.101 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:16.101 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:07:16.101 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:16.101 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.101 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.101 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:16.101 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:07:16.102 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:16.102 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.102 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.102 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:16.102 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757809+0000", 2024-04-18T21:07:16.102 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4700000000000001e-07 2024-04-18T21:07:16.102 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.102 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.102 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:16.102 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757814+0000", 2024-04-18T21:07:16.102 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1829999999999996e-06 2024-04-18T21:07:16.102 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.102 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.102 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:16.103 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757825+0000", 2024-04-18T21:07:16.103 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1754e-05 2024-04-18T21:07:16.103 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.103 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.103 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:16.103 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757832+0000", 2024-04-18T21:07:16.103 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8430000000000004e-06 2024-04-18T21:07:16.103 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.103 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.103 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:16.103 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.799809+0000", 2024-04-18T21:07:16.103 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.041976960000000001 2024-04-18T21:07:16.103 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.103 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.104 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:16.104 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.799934+0000", 2024-04-18T21:07:16.104 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000125053 2024-04-18T21:07:16.104 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.104 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.104 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:16.104 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.800067+0000", 2024-04-18T21:07:16.104 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013276299999999999 2024-04-18T21:07:16.104 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.104 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.104 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:16.104 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804582+0000", 2024-04-18T21:07:16.104 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0045148899999999997 2024-04-18T21:07:16.104 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.105 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.105 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:16.105 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806158+0000", 2024-04-18T21:07:16.105 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001575894 2024-04-18T21:07:16.105 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.105 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.105 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:16.105 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806189+0000", 2024-04-18T21:07:16.105 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1423000000000001e-05 2024-04-18T21:07:16.105 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.105 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.105 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:16.105 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806223+0000", 2024-04-18T21:07:16.105 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4071e-05 2024-04-18T21:07:16.105 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:16.106 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:16.106 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:16.106 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.106 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.106 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:104 3.1f 3:f83d65d8:::200.00000004:head [write 320663~1405 [fadvise_dontneed] in=1405b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:16.106 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757841+0000", 2024-04-18T21:07:16.106 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 30.326302752, 2024-04-18T21:07:16.106 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056381623999999998, 2024-04-18T21:07:16.106 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:16.106 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:16.106 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:16.106 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:16.106 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.106 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:16.106 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757841+0000", 2024-04-18T21:07:16.107 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:16.107 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.107 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.107 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:16.107 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757841+0000", 2024-04-18T21:07:16.107 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:16.107 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.107 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.107 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:16.107 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757842+0000", 2024-04-18T21:07:16.107 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5000000000000002e-07 2024-04-18T21:07:16.107 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.107 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.107 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:16.107 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757852+0000", 2024-04-18T21:07:16.108 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.084e-05 2024-04-18T21:07:16.108 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.108 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.108 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:16.108 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757865+0000", 2024-04-18T21:07:16.108 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2643000000000001e-05 2024-04-18T21:07:16.108 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.108 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.108 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:16.108 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757872+0000", 2024-04-18T21:07:16.108 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8689999999999998e-06 2024-04-18T21:07:16.108 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.108 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.108 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:16.108 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.801102+0000", 2024-04-18T21:07:16.108 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.043229837 2024-04-18T21:07:16.109 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.109 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.109 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:16.109 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.801291+0000", 2024-04-18T21:07:16.109 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000189641 2024-04-18T21:07:16.109 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.109 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.109 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:16.109 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.801640+0000", 2024-04-18T21:07:16.109 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000348971 2024-04-18T21:07:16.109 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.109 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.109 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:16.109 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805849+0000", 2024-04-18T21:07:16.110 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042082739999999997 2024-04-18T21:07:16.110 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.110 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.110 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:16.110 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814135+0000", 2024-04-18T21:07:16.110 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0082867270000000007 2024-04-18T21:07:16.110 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.110 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.110 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:16.110 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814180+0000", 2024-04-18T21:07:16.110 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4982999999999999e-05 2024-04-18T21:07:16.110 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.110 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.110 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:16.110 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814223+0000", 2024-04-18T21:07:16.111 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2188999999999999e-05 2024-04-18T21:07:16.111 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:16.111 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:16.111 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:16.111 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.111 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.111 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:105 3.1f 3:f83d65d8:::200.00000004:head [write 322068~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:16.111 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:07:16.111 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 30.326262155999999, 2024-04-18T21:07:16.111 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056513678999999997, 2024-04-18T21:07:16.111 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:16.111 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:16.111 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:16.111 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:16.111 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.112 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:16.112 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:07:16.112 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:16.112 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.112 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.112 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:16.112 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:07:16.112 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:16.112 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.112 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.112 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:16.112 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757882+0000", 2024-04-18T21:07:16.112 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2600000000000002e-07 2024-04-18T21:07:16.112 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.112 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.113 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:16.113 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757888+0000", 2024-04-18T21:07:16.113 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7130000000000002e-06 2024-04-18T21:07:16.113 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.113 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.113 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:16.113 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757906+0000", 2024-04-18T21:07:16.113 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7723999999999998e-05 2024-04-18T21:07:16.113 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.113 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.113 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:16.113 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757921+0000", 2024-04-18T21:07:16.113 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4936000000000001e-05 2024-04-18T21:07:16.113 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.114 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.114 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:16.114 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802493+0000", 2024-04-18T21:07:16.114 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.044571927999999997 2024-04-18T21:07:16.114 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.114 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.114 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:16.114 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802537+0000", 2024-04-18T21:07:16.114 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4449000000000001e-05 2024-04-18T21:07:16.114 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.114 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.114 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:16.114 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.802605+0000", 2024-04-18T21:07:16.114 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7945000000000001e-05 2024-04-18T21:07:16.114 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.115 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.115 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:16.115 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805852+0000", 2024-04-18T21:07:16.115 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032469909999999999 2024-04-18T21:07:16.115 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.115 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.115 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:16.115 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814298+0000", 2024-04-18T21:07:16.115 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084463309999999996 2024-04-18T21:07:16.115 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.115 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.115 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:16.115 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814355+0000", 2024-04-18T21:07:16.115 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6459999999999998e-05 2024-04-18T21:07:16.115 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.116 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.116 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:16.116 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814395+0000", 2024-04-18T21:07:16.116 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0475999999999997e-05 2024-04-18T21:07:16.116 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:16.116 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:16.116 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:16.116 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.116 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.116 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:106 3.1f 3:f83d65d8:::200.00000004:head [write 323467~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:16.116 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.757955+0000", 2024-04-18T21:07:16.116 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 30.326188927, 2024-04-18T21:07:16.116 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056539990999999998, 2024-04-18T21:07:16.116 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:16.116 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:16.116 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:16.117 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:16.117 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.117 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:16.117 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757955+0000", 2024-04-18T21:07:16.117 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:16.117 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.117 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.117 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:16.117 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757955+0000", 2024-04-18T21:07:16.117 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:16.117 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.117 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.117 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:16.117 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757956+0000", 2024-04-18T21:07:16.118 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.144e-06 2024-04-18T21:07:16.118 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.118 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.118 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:16.118 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757970+0000", 2024-04-18T21:07:16.118 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3899e-05 2024-04-18T21:07:16.118 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.118 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.118 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:16.118 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.757988+0000", 2024-04-18T21:07:16.118 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8033000000000002e-05 2024-04-18T21:07:16.118 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.118 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.118 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:16.119 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758002+0000", 2024-04-18T21:07:16.119 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3973e-05 2024-04-18T21:07:16.119 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.119 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.119 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:16.119 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803072+0000", 2024-04-18T21:07:16.119 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045070194000000001 2024-04-18T21:07:16.119 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.119 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.119 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:16.119 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803125+0000", 2024-04-18T21:07:16.119 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3498000000000002e-05 2024-04-18T21:07:16.119 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.119 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.120 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:16.120 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803233+0000", 2024-04-18T21:07:16.120 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010704099999999999 2024-04-18T21:07:16.120 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.120 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.120 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:16.120 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805856+0000", 2024-04-18T21:07:16.120 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026233430000000002 2024-04-18T21:07:16.120 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.120 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.120 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:16.120 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814439+0000", 2024-04-18T21:07:16.120 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0085833839999999995 2024-04-18T21:07:16.120 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.120 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.120 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:16.121 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814469+0000", 2024-04-18T21:07:16.121 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9784000000000001e-05 2024-04-18T21:07:16.121 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.121 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.121 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:16.121 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814495+0000", 2024-04-18T21:07:16.121 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5698e-05 2024-04-18T21:07:16.121 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:16.121 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:16.121 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:16.121 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.121 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.121 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:107 3.1f 3:f83d65d8:::200.00000004:head [write 324866~1421 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:16.121 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758019+0000", 2024-04-18T21:07:16.121 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 30.326124301, 2024-04-18T21:07:16.122 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056580563, 2024-04-18T21:07:16.122 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:16.122 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:16.122 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:16.122 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:16.122 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.122 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:16.122 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758019+0000", 2024-04-18T21:07:16.122 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:16.122 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.122 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.122 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:16.122 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758019+0000", 2024-04-18T21:07:16.122 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:16.123 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.123 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.123 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:16.123 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758021+0000", 2024-04-18T21:07:16.123 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1999999999999999e-06 2024-04-18T21:07:16.123 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.123 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.123 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:16.123 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758028+0000", 2024-04-18T21:07:16.123 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7200000000000006e-06 2024-04-18T21:07:16.123 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.123 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.123 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:16.123 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758050+0000", 2024-04-18T21:07:16.123 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1877000000000001e-05 2024-04-18T21:07:16.123 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.124 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.124 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:16.124 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758064+0000", 2024-04-18T21:07:16.124 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.383e-05 2024-04-18T21:07:16.124 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.124 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.124 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:16.124 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803593+0000", 2024-04-18T21:07:16.124 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045528831999999998 2024-04-18T21:07:16.124 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.124 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.124 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:16.124 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803635+0000", 2024-04-18T21:07:16.124 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1980000000000001e-05 2024-04-18T21:07:16.125 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.125 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.125 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:16.125 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803703+0000", 2024-04-18T21:07:16.125 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8542999999999997e-05 2024-04-18T21:07:16.125 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.125 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.125 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:16.125 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806123+0000", 2024-04-18T21:07:16.125 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002419769 2024-04-18T21:07:16.125 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.125 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.125 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:16.125 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814542+0000", 2024-04-18T21:07:16.125 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084189460000000001 2024-04-18T21:07:16.126 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.126 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.126 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:16.126 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814576+0000", 2024-04-18T21:07:16.126 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3679000000000001e-05 2024-04-18T21:07:16.126 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.126 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.126 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:16.126 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814600+0000", 2024-04-18T21:07:16.126 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4187000000000001e-05 2024-04-18T21:07:16.126 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:16.126 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:16.126 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:16.127 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.127 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.127 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:108 3.1f 3:f83d65d8:::200.00000004:head [write 326287~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:16.127 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:07:16.127 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 30.326061132, 2024-04-18T21:07:16.127 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056616183, 2024-04-18T21:07:16.127 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:16.127 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:16.127 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:16.127 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:16.127 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.127 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:16.127 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:07:16.127 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:16.127 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.128 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.128 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:16.128 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:07:16.128 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:16.128 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.128 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.128 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:16.128 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758084+0000", 2024-04-18T21:07:16.128 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.124e-06 2024-04-18T21:07:16.128 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.128 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.128 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:16.128 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758100+0000", 2024-04-18T21:07:16.128 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6246e-05 2024-04-18T21:07:16.128 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.129 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.129 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:16.129 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758118+0000", 2024-04-18T21:07:16.129 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8267e-05 2024-04-18T21:07:16.129 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.129 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.129 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:16.129 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758134+0000", 2024-04-18T21:07:16.129 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5950000000000001e-05 2024-04-18T21:07:16.129 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.129 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.129 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:16.129 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803949+0000", 2024-04-18T21:07:16.129 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045815349999999998 2024-04-18T21:07:16.129 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.130 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.130 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:16.130 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804011+0000", 2024-04-18T21:07:16.130 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1044999999999996e-05 2024-04-18T21:07:16.130 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.130 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.130 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:16.130 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804128+0000", 2024-04-18T21:07:16.130 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117148 2024-04-18T21:07:16.130 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.130 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.130 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:16.130 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806794+0000", 2024-04-18T21:07:16.130 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002666692 2024-04-18T21:07:16.130 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.131 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.131 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:16.131 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814645+0000", 2024-04-18T21:07:16.131 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0078508880000000003 2024-04-18T21:07:16.131 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.131 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.131 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:16.131 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814678+0000", 2024-04-18T21:07:16.131 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3188999999999997e-05 2024-04-18T21:07:16.131 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.131 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.131 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:16.131 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814699+0000", 2024-04-18T21:07:16.131 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0284000000000001e-05 2024-04-18T21:07:16.131 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:16.132 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:16.132 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:16.132 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.132 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.132 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:109 3.1f 3:f83d65d8:::200.00000004:head [write 327693~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:16.132 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:07:16.132 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 30.325991765000001, 2024-04-18T21:07:16.132 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056621036999999999, 2024-04-18T21:07:16.132 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:16.132 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:16.132 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:16.132 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:16.132 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.132 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:16.132 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:07:16.133 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:16.133 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.133 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.133 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:16.133 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:07:16.133 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:16.133 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.133 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.133 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:16.133 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758153+0000", 2024-04-18T21:07:16.133 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1459999999999999e-06 2024-04-18T21:07:16.133 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.133 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.133 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:16.133 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758161+0000", 2024-04-18T21:07:16.134 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7999999999999999e-06 2024-04-18T21:07:16.134 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.134 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.134 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:16.134 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758179+0000", 2024-04-18T21:07:16.134 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7949999999999999e-05 2024-04-18T21:07:16.134 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.134 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.134 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:16.134 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758193+0000", 2024-04-18T21:07:16.134 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3773e-05 2024-04-18T21:07:16.134 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.134 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.134 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:16.134 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804632+0000", 2024-04-18T21:07:16.135 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.046439469999999997 2024-04-18T21:07:16.135 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.135 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.135 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:16.135 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804790+0000", 2024-04-18T21:07:16.135 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015784300000000001 2024-04-18T21:07:16.135 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.135 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.135 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:16.135 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805056+0000", 2024-04-18T21:07:16.135 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026652400000000003 2024-04-18T21:07:16.135 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.135 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.136 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:16.136 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.808959+0000", 2024-04-18T21:07:16.136 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003903077 2024-04-18T21:07:16.136 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.136 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.136 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:16.136 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814728+0000", 2024-04-18T21:07:16.136 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0057682489999999996 2024-04-18T21:07:16.136 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.136 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.136 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:16.136 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814754+0000", 2024-04-18T21:07:16.136 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6673999999999999e-05 2024-04-18T21:07:16.136 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.136 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.137 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:16.137 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814773+0000", 2024-04-18T21:07:16.137 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8530999999999999e-05 2024-04-18T21:07:16.137 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:16.137 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:16.137 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:16.137 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.137 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.137 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:110 3.1f 3:f83d65d8:::200.00000004:head [write 329098~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:16.137 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:07:16.137 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 30.325933356, 2024-04-18T21:07:16.137 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056669113, 2024-04-18T21:07:16.137 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:16.137 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:16.137 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:16.137 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:16.138 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.138 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:16.138 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:07:16.138 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:16.138 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.138 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.138 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:16.138 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:07:16.138 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:16.138 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.138 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.138 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:16.138 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758212+0000", 2024-04-18T21:07:16.138 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:07:16.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.139 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.139 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:16.139 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758219+0000", 2024-04-18T21:07:16.139 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4229999999999999e-06 2024-04-18T21:07:16.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.139 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.139 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:16.139 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758237+0000", 2024-04-18T21:07:16.139 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7966999999999999e-05 2024-04-18T21:07:16.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.139 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.139 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:16.139 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758252+0000", 2024-04-18T21:07:16.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5322999999999999e-05 2024-04-18T21:07:16.140 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.140 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.140 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:16.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805536+0000", 2024-04-18T21:07:16.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.047283861000000003 2024-04-18T21:07:16.140 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.140 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.140 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:16.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805579+0000", 2024-04-18T21:07:16.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2738999999999999e-05 2024-04-18T21:07:16.140 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.140 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.140 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:16.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805649+0000", 2024-04-18T21:07:16.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0213e-05 2024-04-18T21:07:16.141 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.141 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.141 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:16.141 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.808966+0000", 2024-04-18T21:07:16.141 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033166129999999999 2024-04-18T21:07:16.141 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.141 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.141 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:16.141 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814812+0000", 2024-04-18T21:07:16.141 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0058463589999999998 2024-04-18T21:07:16.141 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.141 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.141 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:16.141 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814854+0000", 2024-04-18T21:07:16.141 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1618e-05 2024-04-18T21:07:16.141 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.142 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.142 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:16.142 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814879+0000", 2024-04-18T21:07:16.142 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5754000000000001e-05 2024-04-18T21:07:16.142 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:16.142 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:16.142 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:16.142 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.142 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.142 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:111 3.1f 3:f83d65d8:::200.00000004:head [write 330499~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:16.142 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:07:16.142 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 30.32587238, 2024-04-18T21:07:16.142 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058693793000000001, 2024-04-18T21:07:16.143 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:16.143 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:16.143 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:16.143 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:16.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.143 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:16.143 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:07:16.143 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:16.143 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.143 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:16.143 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:07:16.143 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:16.143 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.144 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:16.144 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758272+0000", 2024-04-18T21:07:16.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1200000000000001e-06 2024-04-18T21:07:16.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.144 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.144 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:16.144 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758287+0000", 2024-04-18T21:07:16.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5017e-05 2024-04-18T21:07:16.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.144 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.144 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:16.144 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758309+0000", 2024-04-18T21:07:16.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1866e-05 2024-04-18T21:07:16.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.144 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.144 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:16.145 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758323+0000", 2024-04-18T21:07:16.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3606e-05 2024-04-18T21:07:16.145 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.145 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:16.145 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806279+0000", 2024-04-18T21:07:16.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.047956061000000001 2024-04-18T21:07:16.145 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.145 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:16.145 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806350+0000", 2024-04-18T21:07:16.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1070999999999998e-05 2024-04-18T21:07:16.145 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.145 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:16.145 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806459+0000", 2024-04-18T21:07:16.146 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000108606 2024-04-18T21:07:16.146 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.146 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.146 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:16.146 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.809774+0000", 2024-04-18T21:07:16.146 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003314881 2024-04-18T21:07:16.146 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.146 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.146 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:16.146 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816910+0000", 2024-04-18T21:07:16.146 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0071367760000000001 2024-04-18T21:07:16.146 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.146 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.146 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:16.147 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816941+0000", 2024-04-18T21:07:16.147 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0846000000000002e-05 2024-04-18T21:07:16.147 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.147 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.147 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:16.147 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816965+0000", 2024-04-18T21:07:16.147 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3943000000000001e-05 2024-04-18T21:07:16.147 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:16.147 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:16.147 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:16.147 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.147 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.147 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:5230 4.17 4:eb2cc4c4:::1000000184c.00000000:head [write 0~2191] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-18T21:07:16.147 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.760650+0000", 2024-04-18T21:07:16.148 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 30.323493208999999, 2024-04-18T21:07:16.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.054210577000000003, 2024-04-18T21:07:16.148 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:16.148 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:16.148 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:16.148 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:07:16.148 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:07:16.148 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:16.148 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 5230 2024-04-18T21:07:16.148 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.148 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:16.148 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.148 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:16.148 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760650+0000", 2024-04-18T21:07:16.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:16.148 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.149 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.149 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:16.149 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760650+0000", 2024-04-18T21:07:16.149 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:16.149 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.149 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.149 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:16.149 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760653+0000", 2024-04-18T21:07:16.149 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0829999999999998e-06 2024-04-18T21:07:16.149 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.149 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.149 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:16.149 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760664+0000", 2024-04-18T21:07:16.149 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.111e-05 2024-04-18T21:07:16.149 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.150 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:16.150 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760688+0000", 2024-04-18T21:07:16.150 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4837e-05 2024-04-18T21:07:16.150 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.150 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:16.150 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.760702+0000", 2024-04-18T21:07:16.150 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3723000000000001e-05 2024-04-18T21:07:16.150 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.150 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:16.150 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806264+0000", 2024-04-18T21:07:16.151 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045562182 2024-04-18T21:07:16.151 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.151 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:16.151 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806351+0000", 2024-04-18T21:07:16.151 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6322000000000005e-05 2024-04-18T21:07:16.151 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.151 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:16.151 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806453+0000", 2024-04-18T21:07:16.151 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000102602 2024-04-18T21:07:16.151 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.151 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:16.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.808972+0000", 2024-04-18T21:07:16.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025184090000000001 2024-04-18T21:07:16.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.152 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:16.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814798+0000", 2024-04-18T21:07:16.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0058266689999999996 2024-04-18T21:07:16.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.152 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:16.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814839+0000", 2024-04-18T21:07:16.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0482000000000003e-05 2024-04-18T21:07:16.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.152 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:16.153 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814861+0000", 2024-04-18T21:07:16.153 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2158e-05 2024-04-18T21:07:16.153 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:16.153 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:16.153 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:16.153 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.153 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.153 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:11950 4.6 4:62753dda:::10000003222.00000000:head [write 3145728~1048576] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:16.153 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:59.346083+0000", 2024-04-18T21:07:16.153 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 16.738060617999999, 2024-04-18T21:07:16.153 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.051281119999999999, 2024-04-18T21:07:16.153 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:16.153 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:16.153 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:16.153 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:07:16.153 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:07:16.154 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:16.154 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 11950 2024-04-18T21:07:16.154 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.154 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:16.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.154 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:16.154 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.346083+0000", 2024-04-18T21:07:16.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:16.154 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.154 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:16.154 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.346083+0000", 2024-04-18T21:07:16.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:16.154 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:16.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.346085+0000", 2024-04-18T21:07:16.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.736e-06 2024-04-18T21:07:16.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:16.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.349991+0000", 2024-04-18T21:07:16.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0039062960000000001 2024-04-18T21:07:16.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:16.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.350006+0000", 2024-04-18T21:07:16.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5327000000000001e-05 2024-04-18T21:07:16.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.156 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.156 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:16.156 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.350016+0000", 2024-04-18T21:07:16.156 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3570000000000004e-06 2024-04-18T21:07:16.156 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.156 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.156 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:16.156 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.360724+0000", 2024-04-18T21:07:16.156 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010708153999999999 2024-04-18T21:07:16.156 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.156 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.156 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:16.156 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.360839+0000", 2024-04-18T21:07:16.156 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000114877 2024-04-18T21:07:16.157 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.157 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.157 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:16.157 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.397285+0000", 2024-04-18T21:07:16.157 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036445957000000001 2024-04-18T21:07:16.157 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.157 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.157 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:16.157 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.397316+0000", 2024-04-18T21:07:16.157 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0926000000000002e-05 2024-04-18T21:07:16.157 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.157 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.157 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:16.157 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.397364+0000", 2024-04-18T21:07:16.157 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8489999999999998e-05 2024-04-18T21:07:16.157 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:16.158 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:16.158 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:16.158 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.158 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.158 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:12225 4.11 4:8acd30ee:::100000031ed.00000000:head [write 0~4194304 [2@86041]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:16.158 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:59.667090+0000", 2024-04-18T21:07:16.158 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 16.417054003000001, 2024-04-18T21:07:16.158 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.047400059000000001, 2024-04-18T21:07:16.158 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:16.158 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:16.158 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:16.158 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:07:16.158 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:07:16.158 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:16.159 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 12225 2024-04-18T21:07:16.159 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.159 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:16.159 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.159 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:16.159 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.667090+0000", 2024-04-18T21:07:16.159 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:16.159 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.159 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.159 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:16.159 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.667090+0000", 2024-04-18T21:07:16.159 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:16.159 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.159 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.159 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:16.160 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.667091+0000", 2024-04-18T21:07:16.160 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3629999999999999e-06 2024-04-18T21:07:16.160 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.160 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.160 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:16.160 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.674492+0000", 2024-04-18T21:07:16.160 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0074007789999999997 2024-04-18T21:07:16.160 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.160 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.160 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:16.160 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.674508+0000", 2024-04-18T21:07:16.160 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6509999999999999e-05 2024-04-18T21:07:16.160 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.160 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.160 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:16.161 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.674518+0000", 2024-04-18T21:07:16.161 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.6290000000000005e-06 2024-04-18T21:07:16.161 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.161 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.161 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:16.161 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.674584+0000", 2024-04-18T21:07:16.161 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5597000000000002e-05 2024-04-18T21:07:16.161 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.161 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.161 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:16.161 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.674659+0000", 2024-04-18T21:07:16.161 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5168999999999998e-05 2024-04-18T21:07:16.161 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.161 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.162 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:16.162 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.674775+0000", 2024-04-18T21:07:16.162 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000116069 2024-04-18T21:07:16.162 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.162 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.162 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:16.162 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.685336+0000", 2024-04-18T21:07:16.162 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010561022999999999 2024-04-18T21:07:16.162 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.162 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.162 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:16.162 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.714413+0000", 2024-04-18T21:07:16.162 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.029077306000000001 2024-04-18T21:07:16.163 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.163 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.163 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:16.163 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.714455+0000", 2024-04-18T21:07:16.163 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1547e-05 2024-04-18T21:07:16.163 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.163 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.163 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:16.163 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:59.714490+0000", 2024-04-18T21:07:16.163 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5067000000000002e-05 2024-04-18T21:07:16.163 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:16.163 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:16.163 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:16.163 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.164 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.164 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:12689 4.26 4:64a7f444:::100000033e5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:16.164 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:00.208067+0000", 2024-04-18T21:07:16.164 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 15.876076963999999, 2024-04-18T21:07:16.164 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066681457, 2024-04-18T21:07:16.164 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:16.164 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:16.164 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:16.164 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:07:16.164 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:07:16.164 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:16.164 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 12689 2024-04-18T21:07:16.164 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.164 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:16.164 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.165 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:16.165 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.208067+0000", 2024-04-18T21:07:16.165 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:16.165 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.165 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.165 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:16.165 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.208067+0000", 2024-04-18T21:07:16.165 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:16.165 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.165 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.165 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:16.165 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.208069+0000", 2024-04-18T21:07:16.165 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1500000000000002e-06 2024-04-18T21:07:16.165 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.165 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.166 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:16.166 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216162+0000", 2024-04-18T21:07:16.166 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0080933159999999997 2024-04-18T21:07:16.166 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.166 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.166 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:16.166 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216181+0000", 2024-04-18T21:07:16.166 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8573e-05 2024-04-18T21:07:16.166 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.166 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.166 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:16.166 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216192+0000", 2024-04-18T21:07:16.166 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0767999999999999e-05 2024-04-18T21:07:16.166 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.167 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.167 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:16.167 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216259+0000", 2024-04-18T21:07:16.167 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7977000000000003e-05 2024-04-18T21:07:16.167 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.167 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.167 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:16.167 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216635+0000", 2024-04-18T21:07:16.167 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00037591300000000002 2024-04-18T21:07:16.167 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.167 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.167 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:16.167 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216929+0000", 2024-04-18T21:07:16.167 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00029314800000000002 2024-04-18T21:07:16.167 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.168 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.168 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:16.168 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.232918+0000", 2024-04-18T21:07:16.168 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015989903 2024-04-18T21:07:16.168 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.168 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.168 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:16.168 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.274643+0000", 2024-04-18T21:07:16.168 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.041724281000000002 2024-04-18T21:07:16.168 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.168 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.168 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:16.168 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.274701+0000", 2024-04-18T21:07:16.168 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8304999999999998e-05 2024-04-18T21:07:16.168 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.169 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.169 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:16.169 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.274748+0000", 2024-04-18T21:07:16.169 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7123000000000003e-05 2024-04-18T21:07:16.169 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:16.169 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:16.169 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:16.169 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.169 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.169 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4534.0:15094 4.c e59/16 4:32870457:::10000003692.00000000:head v 59'213, mlcod=59'211)", 2024-04-18T21:07:16.169 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:03.117817+0000", 2024-04-18T21:07:16.169 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 12.966326893, 2024-04-18T21:07:16.169 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.049868875999999999, 2024-04-18T21:07:16.170 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:16.170 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:16.170 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:16.170 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:16.170 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.170 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:16.170 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.117817+0000", 2024-04-18T21:07:16.170 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:16.170 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.170 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.170 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:16.170 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.117817+0000", 2024-04-18T21:07:16.170 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:16.171 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.171 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.171 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:16.171 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.117817+0000", 2024-04-18T21:07:16.171 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0200000000000003e-07 2024-04-18T21:07:16.171 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.171 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.171 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:16.171 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.140525+0000", 2024-04-18T21:07:16.171 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.022707775999999999 2024-04-18T21:07:16.171 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.171 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.171 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:16.171 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.140549+0000", 2024-04-18T21:07:16.171 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4456000000000001e-05 2024-04-18T21:07:16.172 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.172 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.172 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:16.172 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.140563+0000", 2024-04-18T21:07:16.172 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.329e-05 2024-04-18T21:07:16.172 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.172 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.172 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:16.172 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.140797+0000", 2024-04-18T21:07:16.172 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023447400000000001 2024-04-18T21:07:16.172 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.172 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.172 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:16.172 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.140842+0000", 2024-04-18T21:07:16.172 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5287000000000002e-05 2024-04-18T21:07:16.173 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.173 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.173 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:16.173 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.167577+0000", 2024-04-18T21:07:16.173 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.026734745000000001 2024-04-18T21:07:16.173 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.173 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.173 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:16.173 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:03.167686+0000", 2024-04-18T21:07:16.173 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000108446 2024-04-18T21:07:16.173 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:16.173 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:16.173 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:16.173 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.174 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.174 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:7694 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-18T21:07:16.174 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:11.672522+0000", 2024-04-18T21:07:16.174 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.4116219240000003, 2024-04-18T21:07:16.174 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2954970370000001, 2024-04-18T21:07:16.174 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:16.174 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:16.174 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:16.174 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:16.174 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.174 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:16.174 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672522+0000", 2024-04-18T21:07:16.174 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:16.174 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.174 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.174 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:16.175 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672522+0000", 2024-04-18T21:07:16.175 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:16.175 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.175 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.175 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:16.175 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672525+0000", 2024-04-18T21:07:16.175 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.366e-06 2024-04-18T21:07:16.175 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.175 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.175 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:16.175 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672540+0000", 2024-04-18T21:07:16.175 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4949999999999999e-05 2024-04-18T21:07:16.175 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.175 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.175 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:16.176 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672569+0000", 2024-04-18T21:07:16.176 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8714999999999999e-05 2024-04-18T21:07:16.176 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.176 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.176 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:16.176 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672581+0000", 2024-04-18T21:07:16.176 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1949e-05 2024-04-18T21:07:16.176 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.176 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.176 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:16.176 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672704+0000", 2024-04-18T21:07:16.176 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000122915 2024-04-18T21:07:16.176 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.176 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.176 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:16.177 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672714+0000", 2024-04-18T21:07:16.177 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0698e-05 2024-04-18T21:07:16.177 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.177 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.177 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:16.177 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.910993+0000", 2024-04-18T21:07:16.177 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.23827911199999999 2024-04-18T21:07:16.177 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.177 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.177 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:16.177 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.911017+0000", 2024-04-18T21:07:16.177 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3419999999999999e-05 2024-04-18T21:07:16.177 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.177 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.177 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:16.178 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.952146+0000", 2024-04-18T21:07:16.178 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0411288869999999 2024-04-18T21:07:16.178 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.178 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.178 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:16.178 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.952467+0000", 2024-04-18T21:07:16.178 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00032165399999999999 2024-04-18T21:07:16.178 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.178 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.178 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:16.178 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.954086+0000", 2024-04-18T21:07:16.178 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0016184820000000001 2024-04-18T21:07:16.178 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.179 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.179 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:16.179 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.960573+0000", 2024-04-18T21:07:16.179 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064874240000000003 2024-04-18T21:07:16.179 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.179 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.179 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:16.179 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.967786+0000", 2024-04-18T21:07:16.179 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0072125069999999999 2024-04-18T21:07:16.179 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.179 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.179 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:16.179 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.967897+0000", 2024-04-18T21:07:16.179 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111679 2024-04-18T21:07:16.180 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.180 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.180 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:16.180 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.968019+0000", 2024-04-18T21:07:16.180 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000121279 2024-04-18T21:07:16.180 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:16.180 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:16.180 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:16.180 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.180 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.180 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:7696 3.f 3:f376ae95:::200.00000016:head [write 3681546~512758 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:16.180 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:12.760706+0000", 2024-04-18T21:07:16.180 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.3234375219999999, 2024-04-18T21:07:16.180 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.24998282899999999, 2024-04-18T21:07:16.180 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:16.181 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:16.181 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:16.181 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:16.181 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.181 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:16.181 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.760706+0000", 2024-04-18T21:07:16.181 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:16.181 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.181 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.181 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:16.181 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.760706+0000", 2024-04-18T21:07:16.181 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:16.181 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.181 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.181 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:16.182 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.760710+0000", 2024-04-18T21:07:16.182 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2100000000000003e-06 2024-04-18T21:07:16.182 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.182 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.182 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:16.182 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.761972+0000", 2024-04-18T21:07:16.182 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0012615689999999999 2024-04-18T21:07:16.182 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.182 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.182 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:16.182 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762012+0000", 2024-04-18T21:07:16.182 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0145999999999998e-05 2024-04-18T21:07:16.182 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.182 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.182 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:16.183 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762030+0000", 2024-04-18T21:07:16.183 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8312999999999999e-05 2024-04-18T21:07:16.183 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.183 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.183 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:16.183 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762158+0000", 2024-04-18T21:07:16.183 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012805600000000001 2024-04-18T21:07:16.183 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.183 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.183 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:16.183 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762174+0000", 2024-04-18T21:07:16.183 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5645999999999999e-05 2024-04-18T21:07:16.183 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.183 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.184 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:16.184 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.926080+0000", 2024-04-18T21:07:16.184 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.16390581900000001 2024-04-18T21:07:16.184 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.184 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.184 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for missing object", 2024-04-18T21:07:16.184 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.926149+0000", 2024-04-18T21:07:16.184 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9172999999999997e-05 2024-04-18T21:07:16.184 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.184 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.184 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:16.184 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.002156+0000", 2024-04-18T21:07:16.184 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.076006972000000006 2024-04-18T21:07:16.184 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.184 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.185 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for rw locks", 2024-04-18T21:07:16.185 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.002294+0000", 2024-04-18T21:07:16.185 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000138011 2024-04-18T21:07:16.185 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.185 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.185 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:16.185 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.005436+0000", 2024-04-18T21:07:16.185 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031422749999999999 2024-04-18T21:07:16.185 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.185 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.185 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:16.185 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.005577+0000", 2024-04-18T21:07:16.185 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014105399999999999 2024-04-18T21:07:16.185 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.186 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.186 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:16.186 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.005725+0000", 2024-04-18T21:07:16.186 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014721100000000001 2024-04-18T21:07:16.186 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.186 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.186 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:16.186 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.009143+0000", 2024-04-18T21:07:16.186 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0034179380000000001 2024-04-18T21:07:16.186 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.186 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.186 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:16.186 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.010522+0000", 2024-04-18T21:07:16.186 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0013790919999999999 2024-04-18T21:07:16.186 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.187 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.187 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:16.187 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.010586+0000", 2024-04-18T21:07:16.187 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4713000000000002e-05 2024-04-18T21:07:16.187 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.187 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.187 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:16.187 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.010689+0000", 2024-04-18T21:07:16.187 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000102631 2024-04-18T21:07:16.187 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:16.187 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:16.187 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:16.187 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.187 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.187 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:7697 3.16 3:6b6b4f13:::200.0000001c:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:16.188 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:12.762074+0000", 2024-04-18T21:07:16.188 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.3220693739999998, 2024-04-18T21:07:16.188 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.2056489, 2024-04-18T21:07:16.188 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:16.188 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:16.188 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:07:16.188 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:16.188 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.188 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:16.188 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762074+0000", 2024-04-18T21:07:16.188 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:16.188 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.188 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.188 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:16.188 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762074+0000", 2024-04-18T21:07:16.188 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:16.189 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.189 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.189 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:16.189 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762076+0000", 2024-04-18T21:07:16.189 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.793e-06 2024-04-18T21:07:16.189 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.189 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.189 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:16.189 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762083+0000", 2024-04-18T21:07:16.189 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7129999999999999e-06 2024-04-18T21:07:16.189 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.189 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.189 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:16.189 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762104+0000", 2024-04-18T21:07:16.190 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1480000000000001e-05 2024-04-18T21:07:16.190 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.190 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.190 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:16.190 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762121+0000", 2024-04-18T21:07:16.190 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.632e-05 2024-04-18T21:07:16.190 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.190 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.190 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:16.190 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762224+0000", 2024-04-18T21:07:16.190 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010346800000000001 2024-04-18T21:07:16.190 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.190 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.190 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:16.191 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762238+0000", 2024-04-18T21:07:16.191 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3482999999999999e-05 2024-04-18T21:07:16.191 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.191 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.191 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:16.191 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.946932+0000", 2024-04-18T21:07:16.191 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.18469451000000001 2024-04-18T21:07:16.191 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.191 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.191 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:16.191 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.947261+0000", 2024-04-18T21:07:16.191 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00032857399999999999 2024-04-18T21:07:16.191 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:16.191 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:16.191 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:16.191 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.967723+0000", 2024-04-18T21:07:16.192 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020462559000000002 2024-04-18T21:07:16.192 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:16.192 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:16.192 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:16.192 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:16.192 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:16.192 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:07:16.193 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:07:16.194 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:16.193+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:16.294 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:16.294+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:16.328 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:07:16.329 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [ 2024-04-18T21:07:16.329 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.329 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_repop(mds.0.3:12245 3.14 e67/63 3:2e600548:::200.0000001a:head v 67'185, mlcod=67'183)", 2024-04-18T21:07:16.329 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:16.331578+0000", 2024-04-18T21:07:16.329 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.00018138099999999999, 2024-04-18T21:07:16.329 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00022139699999999999, 2024-04-18T21:07:16.329 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:16.329 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:16.329 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:07:16.329 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:16.329 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.329 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:16.329 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:16.331578+0000", 2024-04-18T21:07:16.330 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:16.330 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.330 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.330 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:16.330 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:16.331578+0000", 2024-04-18T21:07:16.330 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:16.330 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.330 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.330 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:16.330 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:16.331579+0000", 2024-04-18T21:07:16.330 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.0400000000000005e-07 2024-04-18T21:07:16.330 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.330 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.330 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:16.331 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:16.331595+0000", 2024-04-18T21:07:16.331 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6030999999999999e-05 2024-04-18T21:07:16.331 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.331 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.331 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:16.331 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:16.331606+0000", 2024-04-18T21:07:16.331 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1104000000000001e-05 2024-04-18T21:07:16.331 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.331 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.331 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:16.331 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:16.331611+0000", 2024-04-18T21:07:16.331 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3630000000000002e-06 2024-04-18T21:07:16.331 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.331 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.331 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:16.332 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:16.331710+0000", 2024-04-18T21:07:16.332 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.8795000000000005e-05 2024-04-18T21:07:16.332 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.332 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.332 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:16.332 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:16.331763+0000", 2024-04-18T21:07:16.332 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.2871000000000003e-05 2024-04-18T21:07:16.332 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:16.332 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:16.332 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:16.332 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:16.332 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2024-04-18T21:07:16.332 INFO:teuthology.orchestra.run.smithi132.stdout: "num_ops": 1 2024-04-18T21:07:16.332 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:07:16.343 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:07:16.394 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:16.393+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:16.434 INFO:teuthology.orchestra.run.smithi078.stderr:noscrub is unset 2024-04-18T21:07:16.475 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:07:16.475 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:07:16.475 INFO:teuthology.orchestra.run.smithi132.stdout: "complaint_time": 30, 2024-04-18T21:07:16.475 INFO:teuthology.orchestra.run.smithi132.stdout: "num_blocked_ops": 0 2024-04-18T21:07:16.475 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:07:16.491 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:07:16.535 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:16.537+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:16.537 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2024-04-18T21:07:16.537 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-18T21:07:16.537 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-04-18T21:07:16.538 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-18T21:07:16.538 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-18T21:07:16.538 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-04-18T21:07:16.596 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:16.594+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:16.669 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:07:16.669 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 20, 2024-04-18T21:07:16.669 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 600, 2024-04-18T21:07:16.669 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [ 2024-04-18T21:07:16.669 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.669 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:16.670 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:07:16.670 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 131.05152703600001, 2024-04-18T21:07:16.670 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043251955000000002, 2024-04-18T21:07:16.670 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:16.670 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:16.670 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:16.670 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:16.670 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.670 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:16.670 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:07:16.670 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:16.670 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.670 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.671 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:16.671 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616535+0000", 2024-04-18T21:07:16.671 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:16.671 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.671 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.671 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:16.671 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616536+0000", 2024-04-18T21:07:16.671 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2869999999999999e-06 2024-04-18T21:07:16.671 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.671 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.671 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:16.671 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616572+0000", 2024-04-18T21:07:16.671 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.6261999999999999e-05 2024-04-18T21:07:16.671 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.671 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.672 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:16.672 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616593+0000", 2024-04-18T21:07:16.672 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1310000000000001e-05 2024-04-18T21:07:16.672 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.672 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.672 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:16.672 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616614+0000", 2024-04-18T21:07:16.672 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.0936000000000001e-05 2024-04-18T21:07:16.672 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.672 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.672 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:16.672 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629501+0000", 2024-04-18T21:07:16.672 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.012886819000000001 2024-04-18T21:07:16.672 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.673 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.673 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:16.673 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629696+0000", 2024-04-18T21:07:16.673 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019485499999999999 2024-04-18T21:07:16.673 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.673 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.673 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:16.673 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.629940+0000", 2024-04-18T21:07:16.673 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00024386399999999999 2024-04-18T21:07:16.673 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.673 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.673 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:16.673 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640100+0000", 2024-04-18T21:07:16.673 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.010159645 2024-04-18T21:07:16.673 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.674 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.674 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:16.674 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659516+0000", 2024-04-18T21:07:16.674 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019416563000000001 2024-04-18T21:07:16.674 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.674 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.674 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:16.674 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659684+0000", 2024-04-18T21:07:16.674 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016750900000000001 2024-04-18T21:07:16.674 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.674 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.674 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:16.674 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659787+0000", 2024-04-18T21:07:16.674 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000102905 2024-04-18T21:07:16.675 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:16.675 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:16.675 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:16.675 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.675 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.675 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:16.675 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:07:16.675 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 131.051421914, 2024-04-18T21:07:16.675 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043581898000000001, 2024-04-18T21:07:16.675 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:16.675 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:16.675 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:16.675 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:16.675 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.676 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:16.676 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:07:16.676 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:16.676 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.676 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.676 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:16.676 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:07:16.676 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:16.676 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.676 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.676 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:16.676 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616641+0000", 2024-04-18T21:07:16.676 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:07:16.676 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.676 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.676 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:16.677 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616648+0000", 2024-04-18T21:07:16.677 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3860000000000001e-06 2024-04-18T21:07:16.677 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.677 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.677 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:16.677 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616666+0000", 2024-04-18T21:07:16.677 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7583000000000001e-05 2024-04-18T21:07:16.677 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.677 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.677 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:16.677 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616679+0000", 2024-04-18T21:07:16.677 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3322999999999999e-05 2024-04-18T21:07:16.677 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.677 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.677 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:16.678 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630373+0000", 2024-04-18T21:07:16.678 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013694207999999999 2024-04-18T21:07:16.678 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.678 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.678 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:16.678 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630545+0000", 2024-04-18T21:07:16.678 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000171683 2024-04-18T21:07:16.678 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.678 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.678 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:16.678 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630728+0000", 2024-04-18T21:07:16.678 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000182599 2024-04-18T21:07:16.678 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.678 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.679 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:16.679 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640600+0000", 2024-04-18T21:07:16.679 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0098726119999999994 2024-04-18T21:07:16.679 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.679 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.679 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:16.679 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659927+0000", 2024-04-18T21:07:16.679 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019326724999999999 2024-04-18T21:07:16.679 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.679 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.679 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:16.679 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660112+0000", 2024-04-18T21:07:16.679 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000185203 2024-04-18T21:07:16.679 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.680 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.680 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:16.680 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660222+0000", 2024-04-18T21:07:16.680 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109343 2024-04-18T21:07:16.680 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:16.680 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:16.680 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:16.680 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.680 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.680 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11357 4.38 4:1d691e75:::1000000312c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T21:07:16.680 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:58.595279+0000", 2024-04-18T21:07:16.680 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 18.072783004000001, 2024-04-18T21:07:16.680 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.045901399000000002, 2024-04-18T21:07:16.680 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:16.681 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:16.681 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:16.681 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:16.681 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:16.681 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:16.681 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11357 2024-04-18T21:07:16.681 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.681 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:16.681 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.681 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:16.681 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.595279+0000", 2024-04-18T21:07:16.681 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:16.682 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.682 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.682 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:16.682 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.595279+0000", 2024-04-18T21:07:16.682 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:16.682 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.682 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.682 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:16.682 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.595280+0000", 2024-04-18T21:07:16.682 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.079e-06 2024-04-18T21:07:16.682 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.682 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.682 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:16.683 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600237+0000", 2024-04-18T21:07:16.683 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0049569089999999998 2024-04-18T21:07:16.683 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.683 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.683 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:16.683 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600254+0000", 2024-04-18T21:07:16.683 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7399000000000001e-05 2024-04-18T21:07:16.683 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.683 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.683 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:16.683 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600262+0000", 2024-04-18T21:07:16.683 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.174e-06 2024-04-18T21:07:16.683 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.683 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.683 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:16.684 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600359+0000", 2024-04-18T21:07:16.684 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.6358000000000001e-05 2024-04-18T21:07:16.684 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.684 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.684 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:16.684 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600507+0000", 2024-04-18T21:07:16.684 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014854199999999999 2024-04-18T21:07:16.684 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.684 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.684 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:16.684 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600748+0000", 2024-04-18T21:07:16.684 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000241361 2024-04-18T21:07:16.684 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.684 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.684 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:16.685 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.615590+0000", 2024-04-18T21:07:16.685 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.014841851 2024-04-18T21:07:16.685 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.685 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.685 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:16.685 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.639817+0000", 2024-04-18T21:07:16.685 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024226527000000001 2024-04-18T21:07:16.685 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.685 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.685 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:16.685 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.640962+0000", 2024-04-18T21:07:16.685 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001145561 2024-04-18T21:07:16.685 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.685 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.685 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:16.686 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.641180+0000", 2024-04-18T21:07:16.686 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00021763800000000001 2024-04-18T21:07:16.686 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:16.686 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:16.686 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:16.686 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.686 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.686 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11443 4.38 4:1d691e75:::1000000312c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T21:07:16.686 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:58.744218+0000", 2024-04-18T21:07:16.686 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 17.923843338000001, 2024-04-18T21:07:16.686 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.051074359999999999, 2024-04-18T21:07:16.686 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:16.686 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:16.687 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:16.687 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:16.687 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:16.687 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:16.687 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11443 2024-04-18T21:07:16.687 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.687 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:16.687 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.687 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:16.687 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.744218+0000", 2024-04-18T21:07:16.687 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:16.687 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.687 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.687 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:16.688 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.744218+0000", 2024-04-18T21:07:16.688 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:16.688 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.688 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.688 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:16.688 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.744221+0000", 2024-04-18T21:07:16.688 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.3580000000000001e-06 2024-04-18T21:07:16.688 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.688 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.688 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:16.688 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753328+0000", 2024-04-18T21:07:16.688 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0091071339999999994 2024-04-18T21:07:16.688 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.688 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.689 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:16.689 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753351+0000", 2024-04-18T21:07:16.689 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.3479999999999999e-05 2024-04-18T21:07:16.689 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.689 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.689 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:16.689 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753363+0000", 2024-04-18T21:07:16.689 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1345000000000001e-05 2024-04-18T21:07:16.689 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.689 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.689 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:16.689 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753416+0000", 2024-04-18T21:07:16.689 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.2849999999999997e-05 2024-04-18T21:07:16.689 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.690 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.690 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:16.690 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753471+0000", 2024-04-18T21:07:16.690 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5717999999999997e-05 2024-04-18T21:07:16.690 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.690 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.690 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:16.690 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753560+0000", 2024-04-18T21:07:16.690 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8777999999999996e-05 2024-04-18T21:07:16.690 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.690 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.690 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:16.690 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.760182+0000", 2024-04-18T21:07:16.691 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0066216299999999999 2024-04-18T21:07:16.691 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.691 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.691 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:16.691 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.795094+0000", 2024-04-18T21:07:16.691 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.034912334000000003 2024-04-18T21:07:16.691 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.691 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.691 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:16.691 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.795221+0000", 2024-04-18T21:07:16.691 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012745899999999999 2024-04-18T21:07:16.691 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.691 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.691 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:16.692 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.795293+0000", 2024-04-18T21:07:16.692 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.1273999999999996e-05 2024-04-18T21:07:16.692 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:16.692 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:16.692 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:16.692 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.692 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.692 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11511 4.18 4:184fae4a:::1000000316d.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:16.692 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:58.838500+0000", 2024-04-18T21:07:16.692 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 17.829561458000001, 2024-04-18T21:07:16.692 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.044451537999999999, 2024-04-18T21:07:16.692 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:16.692 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:16.692 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:16.692 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:16.693 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:16.693 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:16.693 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11511 2024-04-18T21:07:16.693 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.693 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:16.693 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.693 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:16.693 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.838500+0000", 2024-04-18T21:07:16.693 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:16.693 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.693 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.693 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:16.693 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.838500+0000", 2024-04-18T21:07:16.693 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:16.693 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.694 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.694 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:16.694 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.838501+0000", 2024-04-18T21:07:16.694 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.4799999999999997e-07 2024-04-18T21:07:16.694 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.694 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.694 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:16.694 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.847806+0000", 2024-04-18T21:07:16.694 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0093054250000000008 2024-04-18T21:07:16.694 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.694 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.694 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:16.694 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.847834+0000", 2024-04-18T21:07:16.694 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7161999999999998e-05 2024-04-18T21:07:16.695 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.695 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.695 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:16.695 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.847849+0000", 2024-04-18T21:07:16.695 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5217e-05 2024-04-18T21:07:16.695 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.695 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.695 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:16.695 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.847917+0000", 2024-04-18T21:07:16.695 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7896000000000002e-05 2024-04-18T21:07:16.695 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.695 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.695 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:16.695 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.848080+0000", 2024-04-18T21:07:16.695 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016328299999999999 2024-04-18T21:07:16.696 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.696 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.696 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:16.696 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.848348+0000", 2024-04-18T21:07:16.696 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00026766099999999998 2024-04-18T21:07:16.696 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.696 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.696 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:16.696 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.863288+0000", 2024-04-18T21:07:16.696 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.014940301 2024-04-18T21:07:16.696 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.696 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.696 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:16.696 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.882854+0000", 2024-04-18T21:07:16.696 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019566456999999999 2024-04-18T21:07:16.696 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.697 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.697 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:16.697 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.882904+0000", 2024-04-18T21:07:16.697 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.9620999999999998e-05 2024-04-18T21:07:16.697 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.697 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.697 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:16.697 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.882952+0000", 2024-04-18T21:07:16.697 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.7766999999999999e-05 2024-04-18T21:07:16.697 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:16.697 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:16.697 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:16.697 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.697 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.697 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11728 4.39 4:9dcc5ecf:::1000000316e.00000000:head [write 0~4194304 [2@1720266]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:16.698 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.088728+0000", 2024-04-18T21:07:16.698 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 17.579333591000001, 2024-04-18T21:07:16.698 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.047519835000000003, 2024-04-18T21:07:16.698 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:16.698 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:16.698 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:16.698 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:16.698 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:16.698 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:16.698 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11728 2024-04-18T21:07:16.698 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.698 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:16.698 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.698 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:16.699 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.088728+0000", 2024-04-18T21:07:16.699 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:16.699 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.699 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.699 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:16.699 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.088728+0000", 2024-04-18T21:07:16.699 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:16.699 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.699 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.699 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:16.699 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.088729+0000", 2024-04-18T21:07:16.699 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1000000000000001e-06 2024-04-18T21:07:16.699 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.699 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.699 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:16.699 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094322+0000", 2024-04-18T21:07:16.700 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0055931349999999999 2024-04-18T21:07:16.700 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.700 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.700 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:16.700 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094334+0000", 2024-04-18T21:07:16.700 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1894e-05 2024-04-18T21:07:16.700 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.700 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.700 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:16.700 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094340+0000", 2024-04-18T21:07:16.700 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.8780000000000003e-06 2024-04-18T21:07:16.700 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.700 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.700 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:16.700 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094393+0000", 2024-04-18T21:07:16.700 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3275000000000001e-05 2024-04-18T21:07:16.701 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.701 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.701 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:16.701 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094479+0000", 2024-04-18T21:07:16.701 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5222999999999994e-05 2024-04-18T21:07:16.701 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.701 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.701 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:16.701 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094629+0000", 2024-04-18T21:07:16.701 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00015021699999999999 2024-04-18T21:07:16.701 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.701 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.701 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:16.701 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.102975+0000", 2024-04-18T21:07:16.701 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0083464460000000004 2024-04-18T21:07:16.701 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.702 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.702 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:16.702 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136142+0000", 2024-04-18T21:07:16.702 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.033166432000000003 2024-04-18T21:07:16.702 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.702 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.702 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:16.702 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136207+0000", 2024-04-18T21:07:16.702 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.5032999999999999e-05 2024-04-18T21:07:16.702 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.702 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.702 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:16.702 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136248+0000", 2024-04-18T21:07:16.702 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.1202000000000003e-05 2024-04-18T21:07:16.703 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:16.703 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:16.703 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:16.703 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.703 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.703 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11847 4.a 4:51f063b7:::100000032b5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:16.703 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.229180+0000", 2024-04-18T21:07:16.703 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 17.438881535, 2024-04-18T21:07:16.703 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.048001033999999998, 2024-04-18T21:07:16.703 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:16.703 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:16.703 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:16.703 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:16.703 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:16.703 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:16.704 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11847 2024-04-18T21:07:16.704 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.704 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:16.704 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.704 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:16.704 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.229180+0000", 2024-04-18T21:07:16.704 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:16.704 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.704 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.704 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:16.704 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.229180+0000", 2024-04-18T21:07:16.704 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:16.704 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.704 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.705 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:16.705 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.229181+0000", 2024-04-18T21:07:16.705 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.119e-06 2024-04-18T21:07:16.705 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.705 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.705 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:16.705 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.235951+0000", 2024-04-18T21:07:16.705 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0067702370000000001 2024-04-18T21:07:16.705 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.705 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.705 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:16.705 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.235965+0000", 2024-04-18T21:07:16.705 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3202e-05 2024-04-18T21:07:16.705 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.706 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.706 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:16.706 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.235973+0000", 2024-04-18T21:07:16.706 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8630000000000008e-06 2024-04-18T21:07:16.706 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.706 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.706 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:16.706 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.236047+0000", 2024-04-18T21:07:16.706 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.4453e-05 2024-04-18T21:07:16.706 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.706 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.706 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:16.706 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.236137+0000", 2024-04-18T21:07:16.707 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.9751000000000002e-05 2024-04-18T21:07:16.707 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.707 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.707 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:16.707 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.236266+0000", 2024-04-18T21:07:16.707 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000129257 2024-04-18T21:07:16.707 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.707 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.707 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:16.707 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.244520+0000", 2024-04-18T21:07:16.707 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0082538190000000008 2024-04-18T21:07:16.707 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.707 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.707 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:16.707 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.277093+0000", 2024-04-18T21:07:16.708 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.032573405999999999 2024-04-18T21:07:16.708 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.708 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.708 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:16.708 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.277144+0000", 2024-04-18T21:07:16.708 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.0553000000000002e-05 2024-04-18T21:07:16.708 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.708 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.708 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:16.708 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.277181+0000", 2024-04-18T21:07:16.708 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.7373999999999998e-05 2024-04-18T21:07:16.708 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:16.708 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:16.708 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:16.709 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.709 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.709 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11949 4.2b 4:d50cc3c5:::100000031c6.00000000:head [write 0~3145728] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:16.709 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.338113+0000", 2024-04-18T21:07:16.709 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 17.329948658999999, 2024-04-18T21:07:16.709 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.046907847000000003, 2024-04-18T21:07:16.709 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:16.709 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:16.709 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:16.709 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:16.709 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:16.709 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:16.709 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11949 2024-04-18T21:07:16.709 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.709 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:16.710 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.710 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:16.710 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.338113+0000", 2024-04-18T21:07:16.710 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:16.710 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.710 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.710 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:16.710 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.338113+0000", 2024-04-18T21:07:16.710 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:16.710 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.710 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.710 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:16.710 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.338115+0000", 2024-04-18T21:07:16.710 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5659999999999999e-06 2024-04-18T21:07:16.711 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.711 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.711 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:16.711 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344146+0000", 2024-04-18T21:07:16.711 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0060309339999999999 2024-04-18T21:07:16.711 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.711 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.711 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:16.711 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344163+0000", 2024-04-18T21:07:16.711 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6994999999999999e-05 2024-04-18T21:07:16.711 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.711 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.711 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:16.711 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344171+0000", 2024-04-18T21:07:16.711 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5520000000000005e-06 2024-04-18T21:07:16.712 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.712 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.712 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:16.712 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344604+0000", 2024-04-18T21:07:16.712 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00043326299999999997 2024-04-18T21:07:16.712 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.712 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.712 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:16.712 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344687+0000", 2024-04-18T21:07:16.712 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.2952000000000001e-05 2024-04-18T21:07:16.712 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.712 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.712 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:16.712 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344792+0000", 2024-04-18T21:07:16.712 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000104635 2024-04-18T21:07:16.713 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.713 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.713 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:16.713 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.361867+0000", 2024-04-18T21:07:16.713 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017075245999999999 2024-04-18T21:07:16.713 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.713 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.713 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:16.713 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.384879+0000", 2024-04-18T21:07:16.713 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023011474000000001 2024-04-18T21:07:16.713 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.713 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.713 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:16.713 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.384976+0000", 2024-04-18T21:07:16.713 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.7399999999999996e-05 2024-04-18T21:07:16.714 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.714 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.714 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:16.714 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.385021+0000", 2024-04-18T21:07:16.714 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.4830000000000003e-05 2024-04-18T21:07:16.714 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:16.714 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:16.714 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:16.714 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.714 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.714 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:12041 4.38 4:1c8d9fef:::100000033ed.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:16.714 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.446812+0000", 2024-04-18T21:07:16.714 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 17.221249417999999, 2024-04-18T21:07:16.714 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.044749606999999997, 2024-04-18T21:07:16.715 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:16.715 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:16.715 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:16.715 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:16.715 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:16.715 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:16.715 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 12041 2024-04-18T21:07:16.715 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.715 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:16.715 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.715 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:16.715 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.446812+0000", 2024-04-18T21:07:16.715 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:16.715 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.715 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.716 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:16.716 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.446812+0000", 2024-04-18T21:07:16.716 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:16.716 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.716 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.716 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:16.716 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.446814+0000", 2024-04-18T21:07:16.716 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5099999999999999e-06 2024-04-18T21:07:16.716 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.716 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.716 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:16.716 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.452583+0000", 2024-04-18T21:07:16.716 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0057696379999999997 2024-04-18T21:07:16.716 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.716 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.717 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:16.717 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.452599+0000", 2024-04-18T21:07:16.717 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5701000000000001e-05 2024-04-18T21:07:16.717 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.717 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.717 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:16.717 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.452607+0000", 2024-04-18T21:07:16.717 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.7100000000000007e-06 2024-04-18T21:07:16.717 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.717 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.717 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:16.717 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.452718+0000", 2024-04-18T21:07:16.717 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000111257 2024-04-18T21:07:16.717 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.717 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.718 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:16.718 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.452924+0000", 2024-04-18T21:07:16.718 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000206066 2024-04-18T21:07:16.718 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.718 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.718 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:16.718 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.453088+0000", 2024-04-18T21:07:16.718 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016336700000000001 2024-04-18T21:07:16.718 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.718 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.718 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:16.718 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.469818+0000", 2024-04-18T21:07:16.718 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016730248999999999 2024-04-18T21:07:16.718 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.718 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.719 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:16.719 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.491505+0000", 2024-04-18T21:07:16.719 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021687366 2024-04-18T21:07:16.719 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.719 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.719 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:16.719 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.491537+0000", 2024-04-18T21:07:16.719 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.1888999999999999e-05 2024-04-18T21:07:16.719 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.719 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.719 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:16.719 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.491562+0000", 2024-04-18T21:07:16.719 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.4854e-05 2024-04-18T21:07:16.719 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:16.719 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:16.720 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:16.720 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.720 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.720 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:12228 4.16 4:6a8d8629:::100000033d5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:16.720 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.681634+0000", 2024-04-18T21:07:16.720 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 16.986427190000001, 2024-04-18T21:07:16.720 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043430791000000003, 2024-04-18T21:07:16.720 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:16.720 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:16.720 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:16.720 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:16.720 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:16.720 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:16.720 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 12228 2024-04-18T21:07:16.720 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.720 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:16.721 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.721 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:16.721 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.681634+0000", 2024-04-18T21:07:16.721 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:16.721 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.721 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.721 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:16.721 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.681634+0000", 2024-04-18T21:07:16.721 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:16.721 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.721 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.721 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:16.721 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.681637+0000", 2024-04-18T21:07:16.721 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.418e-06 2024-04-18T21:07:16.721 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.722 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.722 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:16.722 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.688982+0000", 2024-04-18T21:07:16.722 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0073447870000000002 2024-04-18T21:07:16.722 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.722 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.722 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:16.722 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.688998+0000", 2024-04-18T21:07:16.722 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6330000000000001e-05 2024-04-18T21:07:16.722 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.722 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.722 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:16.722 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.689009+0000", 2024-04-18T21:07:16.722 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1236999999999999e-05 2024-04-18T21:07:16.723 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.723 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.723 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:16.723 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.689083+0000", 2024-04-18T21:07:16.723 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3415000000000001e-05 2024-04-18T21:07:16.723 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.723 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.723 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:16.723 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.689237+0000", 2024-04-18T21:07:16.723 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00015420899999999999 2024-04-18T21:07:16.723 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.723 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.723 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:16.723 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.689419+0000", 2024-04-18T21:07:16.723 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00018242099999999999 2024-04-18T21:07:16.724 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.724 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.724 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:16.724 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.711630+0000", 2024-04-18T21:07:16.724 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.022210475 2024-04-18T21:07:16.724 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.724 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.724 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:16.724 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.724956+0000", 2024-04-18T21:07:16.724 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013325887999999999 2024-04-18T21:07:16.724 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.724 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.724 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:16.724 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.725019+0000", 2024-04-18T21:07:16.725 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.3757999999999995e-05 2024-04-18T21:07:16.725 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.725 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.725 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:16.725 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.725065+0000", 2024-04-18T21:07:16.725 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.5853000000000003e-05 2024-04-18T21:07:16.725 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:16.725 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:16.725 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:16.725 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.725 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.725 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_repop(client.4534.0:12689 4.26 e58/16 4:64a7f444:::100000033e5.00000000:head v 58'205, mlcod=58'203)", 2024-04-18T21:07:16.725 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:00.217785+0000", 2024-04-18T21:07:16.725 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 16.450276623000001, 2024-04-18T21:07:16.726 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.052245469000000003, 2024-04-18T21:07:16.726 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:16.726 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:16.726 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:16.726 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:16.726 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.726 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:16.726 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.217785+0000", 2024-04-18T21:07:16.726 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:16.726 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.726 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.726 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:16.726 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.217785+0000", 2024-04-18T21:07:16.726 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:16.726 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.726 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.727 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:16.727 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.217786+0000", 2024-04-18T21:07:16.727 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6700000000000002e-07 2024-04-18T21:07:16.727 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.727 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.727 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:16.727 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225111+0000", 2024-04-18T21:07:16.727 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0073251119999999999 2024-04-18T21:07:16.727 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.727 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.727 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:16.727 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225126+0000", 2024-04-18T21:07:16.727 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.541e-05 2024-04-18T21:07:16.727 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.727 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.727 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:16.728 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225137+0000", 2024-04-18T21:07:16.728 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0890000000000001e-05 2024-04-18T21:07:16.728 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.728 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.728 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:16.728 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225244+0000", 2024-04-18T21:07:16.728 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000106555 2024-04-18T21:07:16.728 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.728 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.728 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:16.728 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225276+0000", 2024-04-18T21:07:16.728 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.2574999999999999e-05 2024-04-18T21:07:16.728 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.728 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.728 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:16.728 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.269985+0000", 2024-04-18T21:07:16.729 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.044708422999999997 2024-04-18T21:07:16.729 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.729 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.729 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:16.729 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.270031+0000", 2024-04-18T21:07:16.729 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.5636999999999997e-05 2024-04-18T21:07:16.729 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:16.729 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:16.729 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:16.729 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.729 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.729 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:12692 4.3a 4:5c788ec1:::100000032ff.00000000:head [write 0~4194304 [2@945974]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:16.729 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:00.225134+0000", 2024-04-18T21:07:16.729 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 16.442927568000002, 2024-04-18T21:07:16.729 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.048311640000000003, 2024-04-18T21:07:16.730 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:16.730 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:16.730 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:16.730 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:16.730 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:16.730 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:16.730 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 12692 2024-04-18T21:07:16.730 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.730 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:16.730 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.730 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:16.730 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225134+0000", 2024-04-18T21:07:16.730 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:16.730 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.730 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.731 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:16.731 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225134+0000", 2024-04-18T21:07:16.731 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:16.731 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.731 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.731 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:16.731 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225136+0000", 2024-04-18T21:07:16.731 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4160000000000001e-06 2024-04-18T21:07:16.731 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.731 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.731 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:16.731 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231408+0000", 2024-04-18T21:07:16.731 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.006272517 2024-04-18T21:07:16.731 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.732 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.732 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:16.732 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231437+0000", 2024-04-18T21:07:16.732 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.9119e-05 2024-04-18T21:07:16.732 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.732 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.732 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:16.732 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231456+0000", 2024-04-18T21:07:16.732 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8544999999999999e-05 2024-04-18T21:07:16.732 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.732 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.732 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:16.732 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231579+0000", 2024-04-18T21:07:16.732 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000123762 2024-04-18T21:07:16.732 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.732 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.733 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:16.733 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231690+0000", 2024-04-18T21:07:16.733 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000110349 2024-04-18T21:07:16.733 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.733 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.733 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:16.733 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231903+0000", 2024-04-18T21:07:16.733 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000212695 2024-04-18T21:07:16.733 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.733 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.733 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:16.733 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.253911+0000", 2024-04-18T21:07:16.733 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.022008706999999999 2024-04-18T21:07:16.733 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.733 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.734 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:16.734 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.273383+0000", 2024-04-18T21:07:16.734 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019471568000000002 2024-04-18T21:07:16.734 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.734 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.734 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:16.734 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.273418+0000", 2024-04-18T21:07:16.734 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.5265999999999997e-05 2024-04-18T21:07:16.734 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.734 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.734 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:16.734 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.273446+0000", 2024-04-18T21:07:16.734 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7696e-05 2024-04-18T21:07:16.734 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:16.734 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:16.735 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:16.735 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.735 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.735 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:15094 4.c 4:32870457:::10000003692.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-18T21:07:16.735 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:03.107374+0000", 2024-04-18T21:07:16.735 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 13.560687244, 2024-04-18T21:07:16.735 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.061575983000000001, 2024-04-18T21:07:16.735 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:16.735 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:16.735 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:16.735 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:16.735 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:16.735 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:16.735 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 15094 2024-04-18T21:07:16.735 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.736 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:16.736 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.736 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:16.736 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.107374+0000", 2024-04-18T21:07:16.736 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:16.736 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.736 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.736 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:16.736 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.107374+0000", 2024-04-18T21:07:16.736 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:16.736 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.736 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.736 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:16.736 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.107376+0000", 2024-04-18T21:07:16.736 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3969999999999999e-06 2024-04-18T21:07:16.737 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.737 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.737 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:16.737 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115698+0000", 2024-04-18T21:07:16.737 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0083223989999999994 2024-04-18T21:07:16.737 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.737 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.737 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:16.737 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115713+0000", 2024-04-18T21:07:16.737 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4385e-05 2024-04-18T21:07:16.737 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.737 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.737 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:16.737 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115722+0000", 2024-04-18T21:07:16.737 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0759999999999992e-06 2024-04-18T21:07:16.737 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.738 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.738 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:16.738 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115784+0000", 2024-04-18T21:07:16.738 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.2348999999999995e-05 2024-04-18T21:07:16.738 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.738 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.738 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:16.738 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115849+0000", 2024-04-18T21:07:16.738 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.4964999999999999e-05 2024-04-18T21:07:16.738 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.738 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.738 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:16.738 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.116054+0000", 2024-04-18T21:07:16.738 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020483400000000001 2024-04-18T21:07:16.739 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.739 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.739 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:16.739 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.125769+0000", 2024-04-18T21:07:16.739 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0097153340000000008 2024-04-18T21:07:16.739 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.739 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.739 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:16.739 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.168834+0000", 2024-04-18T21:07:16.739 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043064527999999998 2024-04-18T21:07:16.739 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.739 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.739 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:16.739 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.168882+0000", 2024-04-18T21:07:16.739 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.7919e-05 2024-04-18T21:07:16.739 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.740 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.740 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:16.740 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.168950+0000", 2024-04-18T21:07:16.740 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.8796999999999999e-05 2024-04-18T21:07:16.740 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:16.740 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:16.740 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:16.740 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.740 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.740 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:15133 4.38 4:1c73eb83:::1000000398c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-18T21:07:16.740 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:03.155031+0000", 2024-04-18T21:07:16.740 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 13.513030703, 2024-04-18T21:07:16.740 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.044078787000000001, 2024-04-18T21:07:16.740 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:16.740 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:16.740 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:16.741 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:16.741 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:16.741 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:16.741 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 15133 2024-04-18T21:07:16.741 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.741 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:16.741 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.741 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:16.741 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.155031+0000", 2024-04-18T21:07:16.741 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:16.741 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.741 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.741 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:16.741 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.155031+0000", 2024-04-18T21:07:16.741 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:16.741 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.742 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.742 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:16.742 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.155033+0000", 2024-04-18T21:07:16.742 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.84e-06 2024-04-18T21:07:16.742 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.742 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.742 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:16.742 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.161994+0000", 2024-04-18T21:07:16.742 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0069607779999999999 2024-04-18T21:07:16.742 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.742 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.742 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:16.742 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.162008+0000", 2024-04-18T21:07:16.742 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4399000000000001e-05 2024-04-18T21:07:16.742 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.743 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.743 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:16.743 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.162018+0000", 2024-04-18T21:07:16.743 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.7149999999999993e-06 2024-04-18T21:07:16.743 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.743 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.743 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:16.743 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.162073+0000", 2024-04-18T21:07:16.743 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4803999999999999e-05 2024-04-18T21:07:16.743 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.743 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.743 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:16.743 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.162215+0000", 2024-04-18T21:07:16.743 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014222900000000001 2024-04-18T21:07:16.743 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.743 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.744 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:16.744 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.162341+0000", 2024-04-18T21:07:16.744 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012579400000000001 2024-04-18T21:07:16.744 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.744 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.744 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:16.744 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.169445+0000", 2024-04-18T21:07:16.744 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0071040360000000002 2024-04-18T21:07:16.744 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.744 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.744 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:16.744 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.199046+0000", 2024-04-18T21:07:16.744 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.029601639999999999 2024-04-18T21:07:16.744 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.744 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.744 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:16.744 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.199082+0000", 2024-04-18T21:07:16.745 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.6134999999999999e-05 2024-04-18T21:07:16.745 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.745 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.745 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:16.745 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.199110+0000", 2024-04-18T21:07:16.745 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7416999999999999e-05 2024-04-18T21:07:16.745 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:16.745 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:16.745 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:16.745 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.745 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.745 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7616 4.d 4:b1f7eab6:::10000001d5f.00000000:head [delete] snapc 1=[] RETRY=2 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:16.745 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882522+0000", 2024-04-18T21:07:16.745 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 4.7855393519999998, 2024-04-18T21:07:16.745 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.086006255, 2024-04-18T21:07:16.746 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:16.746 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:16.746 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "reached pg", 2024-04-18T21:07:16.746 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:16.746 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.746 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:16.746 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882522+0000", 2024-04-18T21:07:16.746 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:16.746 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.746 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.746 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:16.746 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882522+0000", 2024-04-18T21:07:16.746 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:16.746 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.746 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.747 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:16.747 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882524+0000", 2024-04-18T21:07:16.747 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4720000000000001e-06 2024-04-18T21:07:16.747 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.747 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.747 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:16.747 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882531+0000", 2024-04-18T21:07:16.747 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7830000000000001e-06 2024-04-18T21:07:16.747 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.747 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.747 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:16.747 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882549+0000", 2024-04-18T21:07:16.747 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8765000000000001e-05 2024-04-18T21:07:16.747 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.747 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.748 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:16.748 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882562+0000", 2024-04-18T21:07:16.748 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3117e-05 2024-04-18T21:07:16.748 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.748 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.748 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:16.748 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882690+0000", 2024-04-18T21:07:16.748 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012794799999999999 2024-04-18T21:07:16.748 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.748 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.748 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op must wait for map", 2024-04-18T21:07:16.748 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882701+0000", 2024-04-18T21:07:16.748 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0215e-05 2024-04-18T21:07:16.748 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.748 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.749 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:16.749 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.891964+0000", 2024-04-18T21:07:16.749 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0092636130000000004 2024-04-18T21:07:16.749 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.749 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.749 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:16.749 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.891976+0000", 2024-04-18T21:07:16.749 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1973e-05 2024-04-18T21:07:16.749 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.749 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.749 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:16.749 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.959520+0000", 2024-04-18T21:07:16.749 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0675436009999999 2024-04-18T21:07:16.749 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.749 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.749 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for missing object", 2024-04-18T21:07:16.750 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.959662+0000", 2024-04-18T21:07:16.750 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014253000000000001 2024-04-18T21:07:16.750 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.750 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.750 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:16.750 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.968480+0000", 2024-04-18T21:07:16.750 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0088178409999999999 2024-04-18T21:07:16.750 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.750 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.750 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:16.750 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.968529+0000", 2024-04-18T21:07:16.750 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8396999999999998e-05 2024-04-18T21:07:16.750 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:16.750 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:16.751 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:16.751 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.751 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.751 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7628 4.31 4:8c97f9cd:::10000001d6c.00000000:head [delete] snapc 1=[] RETRY=2 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:16.751 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882610+0000", 2024-04-18T21:07:16.751 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 4.7854516220000001, 2024-04-18T21:07:16.751 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.08538018, 2024-04-18T21:07:16.751 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:16.751 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:16.751 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "reached pg", 2024-04-18T21:07:16.751 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:16.751 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.751 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:16.751 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882610+0000", 2024-04-18T21:07:16.751 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:16.751 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.751 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.752 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:16.752 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882610+0000", 2024-04-18T21:07:16.752 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:16.752 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.752 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.752 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:16.752 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882611+0000", 2024-04-18T21:07:16.752 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.4199999999999995e-07 2024-04-18T21:07:16.752 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.752 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.752 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:16.752 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882614+0000", 2024-04-18T21:07:16.752 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.4300000000000002e-06 2024-04-18T21:07:16.752 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.752 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.753 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:16.753 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882623+0000", 2024-04-18T21:07:16.753 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8740000000000001e-06 2024-04-18T21:07:16.753 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.753 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.753 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:16.753 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882629+0000", 2024-04-18T21:07:16.753 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.4330000000000001e-06 2024-04-18T21:07:16.753 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.753 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.753 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:16.753 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882706+0000", 2024-04-18T21:07:16.753 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.6280999999999997e-05 2024-04-18T21:07:16.753 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.753 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.754 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op must wait for map", 2024-04-18T21:07:16.754 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882715+0000", 2024-04-18T21:07:16.754 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.1679999999999993e-06 2024-04-18T21:07:16.754 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.754 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.754 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:16.754 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.889481+0000", 2024-04-18T21:07:16.754 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0067656979999999997 2024-04-18T21:07:16.754 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.754 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.754 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:16.754 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.889493+0000", 2024-04-18T21:07:16.754 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2451e-05 2024-04-18T21:07:16.755 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.755 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.755 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:16.755 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.940942+0000", 2024-04-18T21:07:16.755 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0514491720000001 2024-04-18T21:07:16.755 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.755 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.755 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for missing object", 2024-04-18T21:07:16.755 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.941134+0000", 2024-04-18T21:07:16.755 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019150600000000001 2024-04-18T21:07:16.755 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.755 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.755 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:16.755 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.967914+0000", 2024-04-18T21:07:16.755 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026780202999999999 2024-04-18T21:07:16.755 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.756 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.756 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:16.756 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.967990+0000", 2024-04-18T21:07:16.756 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.6322000000000006e-05 2024-04-18T21:07:16.756 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:16.756 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:16.756 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:16.756 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.756 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.756 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7630 4.d 4:b022c802:::10000001d6e.00000000:head [delete] snapc 1=[] RETRY=2 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:16.756 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882645+0000", 2024-04-18T21:07:16.756 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 4.7854163380000001, 2024-04-18T21:07:16.756 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0858072780000001, 2024-04-18T21:07:16.756 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:16.757 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:16.757 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "reached pg", 2024-04-18T21:07:16.757 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:16.757 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.757 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:16.757 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882645+0000", 2024-04-18T21:07:16.757 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:16.757 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.757 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.757 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:16.757 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882645+0000", 2024-04-18T21:07:16.757 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:16.757 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.757 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.758 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:16.758 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882646+0000", 2024-04-18T21:07:16.758 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.3599999999999999e-07 2024-04-18T21:07:16.758 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.758 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.758 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:16.758 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882648+0000", 2024-04-18T21:07:16.758 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.5809999999999999e-06 2024-04-18T21:07:16.758 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.758 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.758 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:16.758 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882655+0000", 2024-04-18T21:07:16.758 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7909999999999999e-06 2024-04-18T21:07:16.758 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.758 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.759 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:16.759 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882661+0000", 2024-04-18T21:07:16.759 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3920000000000002e-06 2024-04-18T21:07:16.759 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.759 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.759 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:16.759 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882825+0000", 2024-04-18T21:07:16.759 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016480100000000001 2024-04-18T21:07:16.759 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.759 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.759 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:07:16.759 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882840+0000", 2024-04-18T21:07:16.759 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4656e-05 2024-04-18T21:07:16.759 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.759 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.759 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:16.760 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.892020+0000", 2024-04-18T21:07:16.760 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0091804680000000007 2024-04-18T21:07:16.760 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.760 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.760 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:16.760 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.892026+0000", 2024-04-18T21:07:16.760 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4580000000000001e-06 2024-04-18T21:07:16.760 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.760 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.760 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:16.760 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.959913+0000", 2024-04-18T21:07:16.760 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.067887289 2024-04-18T21:07:16.760 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.760 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.760 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for missing object", 2024-04-18T21:07:16.760 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.960034+0000", 2024-04-18T21:07:16.761 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000120445 2024-04-18T21:07:16.761 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.761 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.761 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:16.761 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.968407+0000", 2024-04-18T21:07:16.761 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0083734010000000008 2024-04-18T21:07:16.761 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.761 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.761 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:16.761 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.968453+0000", 2024-04-18T21:07:16.761 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.5559999999999997e-05 2024-04-18T21:07:16.761 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:16.761 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:16.761 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:16.761 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.762 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.762 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7651 4.13 4:c9951bc5:::10000001e1b.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:16.762 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882696+0000", 2024-04-18T21:07:16.762 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 4.7853659249999998, 2024-04-18T21:07:16.762 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.088382095, 2024-04-18T21:07:16.762 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:16.762 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:16.762 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:16.762 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:16.762 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.762 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:16.762 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882696+0000", 2024-04-18T21:07:16.762 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:16.762 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.763 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.763 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:16.763 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882696+0000", 2024-04-18T21:07:16.763 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:16.763 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.763 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.763 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:16.763 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882696+0000", 2024-04-18T21:07:16.763 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.06e-07 2024-04-18T21:07:16.763 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.763 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.763 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:16.763 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882699+0000", 2024-04-18T21:07:16.763 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.1039999999999998e-06 2024-04-18T21:07:16.764 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.764 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.764 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:16.764 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882707+0000", 2024-04-18T21:07:16.764 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.593e-06 2024-04-18T21:07:16.764 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.764 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.764 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:16.764 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882712+0000", 2024-04-18T21:07:16.764 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.541e-06 2024-04-18T21:07:16.764 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.764 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.764 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:16.764 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882870+0000", 2024-04-18T21:07:16.765 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000157999 2024-04-18T21:07:16.765 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.765 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.765 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op must wait for map", 2024-04-18T21:07:16.765 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882885+0000", 2024-04-18T21:07:16.765 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4989e-05 2024-04-18T21:07:16.765 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.765 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.765 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:16.765 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.891447+0000", 2024-04-18T21:07:16.765 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0085618540000000007 2024-04-18T21:07:16.765 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.765 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.765 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:16.765 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.891457+0000", 2024-04-18T21:07:16.766 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.6399999999999992e-06 2024-04-18T21:07:16.766 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.766 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.766 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:16.766 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.964840+0000", 2024-04-18T21:07:16.766 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.073383279 2024-04-18T21:07:16.766 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.766 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.766 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:16.766 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.965078+0000", 2024-04-18T21:07:16.766 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000237581 2024-04-18T21:07:16.766 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.766 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.766 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:16.766 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.965299+0000", 2024-04-18T21:07:16.767 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00022087699999999999 2024-04-18T21:07:16.767 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.767 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.767 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:16.767 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.969505+0000", 2024-04-18T21:07:16.767 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.004206123 2024-04-18T21:07:16.767 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.767 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.767 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:16.767 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.970898+0000", 2024-04-18T21:07:16.767 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001393434 2024-04-18T21:07:16.767 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.767 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.767 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:16.768 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.970936+0000", 2024-04-18T21:07:16.768 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.7647000000000001e-05 2024-04-18T21:07:16.768 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.768 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.768 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:16.768 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.971078+0000", 2024-04-18T21:07:16.768 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014192799999999999 2024-04-18T21:07:16.768 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:16.768 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:16.768 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:16.768 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.768 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.768 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7671 4.31 4:8c95a1b7:::10000001e2f.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:16.768 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882728+0000", 2024-04-18T21:07:16.769 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 4.7853340900000001, 2024-04-18T21:07:16.769 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.084467606, 2024-04-18T21:07:16.769 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:16.769 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:16.769 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:16.769 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:16.769 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.769 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:16.769 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882728+0000", 2024-04-18T21:07:16.769 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:16.769 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.769 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.769 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:16.769 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882728+0000", 2024-04-18T21:07:16.769 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:16.770 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.770 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.770 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:16.770 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882728+0000", 2024-04-18T21:07:16.770 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.0399999999999996e-07 2024-04-18T21:07:16.770 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.770 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.770 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:16.770 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882731+0000", 2024-04-18T21:07:16.770 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.5239999999999999e-06 2024-04-18T21:07:16.770 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.770 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.770 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:16.770 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882739+0000", 2024-04-18T21:07:16.771 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4020000000000002e-06 2024-04-18T21:07:16.771 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.771 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.771 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:16.771 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882744+0000", 2024-04-18T21:07:16.771 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.1410000000000004e-06 2024-04-18T21:07:16.771 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.771 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.771 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:16.771 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882836+0000", 2024-04-18T21:07:16.771 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.2094000000000003e-05 2024-04-18T21:07:16.771 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.771 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.771 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:07:16.771 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882849+0000", 2024-04-18T21:07:16.771 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3087e-05 2024-04-18T21:07:16.772 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.772 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.772 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:16.772 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.889522+0000", 2024-04-18T21:07:16.772 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0066730950000000004 2024-04-18T21:07:16.772 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.772 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.772 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:16.772 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.889530+0000", 2024-04-18T21:07:16.772 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8699999999999992e-06 2024-04-18T21:07:16.772 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.772 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.772 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:16.772 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.941173+0000", 2024-04-18T21:07:16.772 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.051642658 2024-04-18T21:07:16.773 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.773 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.773 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:16.773 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.941392+0000", 2024-04-18T21:07:16.773 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00021854099999999999 2024-04-18T21:07:16.773 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.773 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.773 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:16.773 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.941618+0000", 2024-04-18T21:07:16.773 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0002265 2024-04-18T21:07:16.773 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.773 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.773 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:16.773 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.945390+0000", 2024-04-18T21:07:16.773 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0037723460000000002 2024-04-18T21:07:16.773 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.774 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.774 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:16.774 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.966905+0000", 2024-04-18T21:07:16.774 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021514559999999999 2024-04-18T21:07:16.774 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.774 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.774 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:16.774 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.966972+0000", 2024-04-18T21:07:16.774 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.6740000000000001e-05 2024-04-18T21:07:16.774 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.774 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.774 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:16.774 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.967195+0000", 2024-04-18T21:07:16.774 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000223544 2024-04-18T21:07:16.774 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:16.775 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:16.775 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:16.775 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.775 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.775 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7691 4.d 4:b0345396:::10000001e43.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:16.775 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882753+0000", 2024-04-18T21:07:16.775 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 4.7853091110000001, 2024-04-18T21:07:16.775 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.085135618, 2024-04-18T21:07:16.775 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:16.775 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:16.775 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:16.775 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:16.775 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.775 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:16.775 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882753+0000", 2024-04-18T21:07:16.775 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:16.776 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.776 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.776 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:16.776 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882753+0000", 2024-04-18T21:07:16.776 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:16.776 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.776 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.776 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:16.776 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882753+0000", 2024-04-18T21:07:16.776 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.9000000000000002e-07 2024-04-18T21:07:16.776 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.776 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.776 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:16.776 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882755+0000", 2024-04-18T21:07:16.776 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.4040000000000002e-06 2024-04-18T21:07:16.777 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.777 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.777 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:16.777 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882762+0000", 2024-04-18T21:07:16.777 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.6229999999999999e-06 2024-04-18T21:07:16.777 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.777 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.777 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:16.777 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882769+0000", 2024-04-18T21:07:16.777 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.1559999999999998e-06 2024-04-18T21:07:16.777 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.777 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.777 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:16.777 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882875+0000", 2024-04-18T21:07:16.777 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000105491 2024-04-18T21:07:16.777 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.778 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.778 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:07:16.778 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882879+0000", 2024-04-18T21:07:16.778 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.9999999999999998e-06 2024-04-18T21:07:16.778 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.778 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.778 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:16.778 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.892072+0000", 2024-04-18T21:07:16.778 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0091930989999999997 2024-04-18T21:07:16.778 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.778 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.778 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:16.778 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.892083+0000", 2024-04-18T21:07:16.778 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1070000000000001e-05 2024-04-18T21:07:16.778 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.779 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.779 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:16.779 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.960162+0000", 2024-04-18T21:07:16.779 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0680791869999999 2024-04-18T21:07:16.779 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.779 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.779 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:16.779 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.960314+0000", 2024-04-18T21:07:16.779 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000152139 2024-04-18T21:07:16.779 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.779 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.779 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:16.779 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.960469+0000", 2024-04-18T21:07:16.779 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000154444 2024-04-18T21:07:16.780 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.780 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.780 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:16.780 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.964018+0000", 2024-04-18T21:07:16.780 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035494179999999999 2024-04-18T21:07:16.780 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.780 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.780 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:16.780 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.967680+0000", 2024-04-18T21:07:16.780 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.003662046 2024-04-18T21:07:16.780 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.780 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.780 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:16.780 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.967738+0000", 2024-04-18T21:07:16.780 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.7946999999999999e-05 2024-04-18T21:07:16.780 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:16.780 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:16.781 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:16.781 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.967888+0000", 2024-04-18T21:07:16.781 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000150204 2024-04-18T21:07:16.781 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:16.781 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:16.781 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:16.781 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:16.781 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:16.781 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:07:16.783 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:07:16.783 INFO:teuthology.orchestra.run.smithi187.stdout: "success": "" 2024-04-18T21:07:16.783 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:07:16.783 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:07:16.784 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:16.781+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:16.883 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:16.885+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:16.983 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:16.985+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:17.015 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:07:17.015 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:07:17.015 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.015 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:13630 4.3a 4:5dd73928:::10000000eba.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e68)", 2024-04-18T21:07:17.015 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:17.012297+0000", 2024-04-18T21:07:17.015 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0018078230000000001, 2024-04-18T21:07:17.015 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018387049999999999, 2024-04-18T21:07:17.015 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:17.015 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:17.015 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:07:17.015 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:17.015 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.016 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:17.016 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012297+0000", 2024-04-18T21:07:17.016 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.016 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.016 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.016 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:17.016 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012297+0000", 2024-04-18T21:07:17.016 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.016 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.016 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.016 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:17.016 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012297+0000", 2024-04-18T21:07:17.016 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.03e-07 2024-04-18T21:07:17.016 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.017 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.017 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:17.017 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012299+0000", 2024-04-18T21:07:17.017 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.869e-06 2024-04-18T21:07:17.017 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.017 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.017 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:17.017 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012305+0000", 2024-04-18T21:07:17.017 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.305e-06 2024-04-18T21:07:17.017 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.017 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.017 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.017 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012309+0000", 2024-04-18T21:07:17.017 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3680000000000004e-06 2024-04-18T21:07:17.017 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.017 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.018 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.018 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012354+0000", 2024-04-18T21:07:17.018 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4861999999999998e-05 2024-04-18T21:07:17.018 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.018 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.018 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:17.018 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012460+0000", 2024-04-18T21:07:17.018 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000106294 2024-04-18T21:07:17.018 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.018 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.018 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:17.018 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012563+0000", 2024-04-18T21:07:17.018 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000102997 2024-04-18T21:07:17.019 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.019 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.019 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:17.019 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.014126+0000", 2024-04-18T21:07:17.019 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001562405 2024-04-18T21:07:17.019 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.019 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.019 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.019 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.019 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.019 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:13631 4.2f 4:f55d25ed:::10000000ebb.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e68)", 2024-04-18T21:07:17.019 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:17.012320+0000", 2024-04-18T21:07:17.019 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.001785352, 2024-04-18T21:07:17.019 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001900592, 2024-04-18T21:07:17.019 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:17.020 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:17.020 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:07:17.020 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:17.020 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.020 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:17.020 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012320+0000", 2024-04-18T21:07:17.020 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.020 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.020 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.020 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:17.020 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012320+0000", 2024-04-18T21:07:17.020 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.020 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.020 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.020 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:17.021 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012320+0000", 2024-04-18T21:07:17.021 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5199999999999998e-07 2024-04-18T21:07:17.021 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.021 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.021 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:17.021 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012322+0000", 2024-04-18T21:07:17.021 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.807e-06 2024-04-18T21:07:17.021 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.021 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.021 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:17.021 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012327+0000", 2024-04-18T21:07:17.021 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7350000000000001e-06 2024-04-18T21:07:17.021 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.021 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.021 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.022 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012333+0000", 2024-04-18T21:07:17.022 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1270000000000002e-06 2024-04-18T21:07:17.022 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.022 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.022 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.022 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012543+0000", 2024-04-18T21:07:17.022 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000210845 2024-04-18T21:07:17.022 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.022 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.022 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:17.022 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012659+0000", 2024-04-18T21:07:17.022 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011538499999999999 2024-04-18T21:07:17.022 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.022 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.023 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.023 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.023 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.023 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:13632 4.35 4:afb1823f:::10000000ebc.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e68)", 2024-04-18T21:07:17.023 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:17.012342+0000", 2024-04-18T21:07:17.023 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.001762605, 2024-04-18T21:07:17.023 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001942362, 2024-04-18T21:07:17.023 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:17.023 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:17.023 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:07:17.023 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:17.023 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.023 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:17.023 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012342+0000", 2024-04-18T21:07:17.023 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.024 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.024 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.024 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:17.024 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012342+0000", 2024-04-18T21:07:17.024 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.024 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.024 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.024 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:17.024 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012343+0000", 2024-04-18T21:07:17.024 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6800000000000001e-07 2024-04-18T21:07:17.024 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.024 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.024 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:17.024 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012345+0000", 2024-04-18T21:07:17.024 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9740000000000001e-06 2024-04-18T21:07:17.025 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.025 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.025 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:17.025 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012350+0000", 2024-04-18T21:07:17.025 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4949999999999999e-06 2024-04-18T21:07:17.025 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.025 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.025 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.025 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012356+0000", 2024-04-18T21:07:17.025 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8320000000000002e-06 2024-04-18T21:07:17.025 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.025 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.025 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.025 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012975+0000", 2024-04-18T21:07:17.025 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00061871300000000001 2024-04-18T21:07:17.026 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.026 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.026 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:17.026 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013084+0000", 2024-04-18T21:07:17.026 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109252 2024-04-18T21:07:17.026 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.026 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.026 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:17.026 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013187+0000", 2024-04-18T21:07:17.026 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010274500000000001 2024-04-18T21:07:17.026 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.026 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.026 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.026 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.027 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.027 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:13635 4.7 4:e1bf6635:::10000000ebf.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e68)", 2024-04-18T21:07:17.027 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:17.012375+0000", 2024-04-18T21:07:17.027 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.001730229, 2024-04-18T21:07:17.027 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019839580000000001, 2024-04-18T21:07:17.027 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:17.027 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:17.027 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:07:17.027 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:17.027 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.027 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:17.027 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012375+0000", 2024-04-18T21:07:17.027 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.027 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.027 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.028 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:17.028 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012375+0000", 2024-04-18T21:07:17.028 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.028 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.028 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.028 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:17.028 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012375+0000", 2024-04-18T21:07:17.028 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7000000000000005e-07 2024-04-18T21:07:17.028 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.028 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.028 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:17.028 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012378+0000", 2024-04-18T21:07:17.028 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8890000000000002e-06 2024-04-18T21:07:17.028 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.029 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.029 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:17.029 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012385+0000", 2024-04-18T21:07:17.029 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7630000000000003e-06 2024-04-18T21:07:17.029 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.029 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.029 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.029 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012392+0000", 2024-04-18T21:07:17.029 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7170000000000002e-06 2024-04-18T21:07:17.029 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.029 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.029 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.029 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012938+0000", 2024-04-18T21:07:17.029 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00054640000000000005 2024-04-18T21:07:17.030 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.030 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.030 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:17.030 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013059+0000", 2024-04-18T21:07:17.030 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012078699999999999 2024-04-18T21:07:17.030 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.030 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.030 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.030 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.030 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.030 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:13602 4.29 4:94dec803:::10000000e9e.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e68)", 2024-04-18T21:07:17.030 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:17.008494+0000", 2024-04-18T21:07:17.031 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0056109660000000002, 2024-04-18T21:07:17.031 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0059344419999999998, 2024-04-18T21:07:17.031 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:17.031 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:17.031 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:07:17.031 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:17.031 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.031 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:17.031 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.008494+0000", 2024-04-18T21:07:17.031 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.031 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.031 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.031 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:17.031 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.008494+0000", 2024-04-18T21:07:17.032 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.032 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.032 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.032 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:17.032 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.008494+0000", 2024-04-18T21:07:17.032 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9100000000000004e-07 2024-04-18T21:07:17.032 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.032 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.032 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:17.032 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.008497+0000", 2024-04-18T21:07:17.032 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0609999999999998e-06 2024-04-18T21:07:17.032 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.032 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.032 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:17.033 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.008504+0000", 2024-04-18T21:07:17.033 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.323e-06 2024-04-18T21:07:17.033 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.033 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.033 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.033 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.008510+0000", 2024-04-18T21:07:17.033 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0349999999999998e-06 2024-04-18T21:07:17.033 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.033 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.033 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.033 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.009665+0000", 2024-04-18T21:07:17.033 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001155466 2024-04-18T21:07:17.033 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.033 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.034 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:17.034 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.009769+0000", 2024-04-18T21:07:17.034 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010327000000000001 2024-04-18T21:07:17.034 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.034 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.034 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:17.034 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.009893+0000", 2024-04-18T21:07:17.034 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012447200000000001 2024-04-18T21:07:17.034 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.034 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.034 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.034 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.034 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.034 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:13636 4.33 4:ce84bc90:::10000000ec0.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e68)", 2024-04-18T21:07:17.034 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:17.012400+0000", 2024-04-18T21:07:17.035 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0017051270000000001, 2024-04-18T21:07:17.035 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0021041940000000002, 2024-04-18T21:07:17.035 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:17.035 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:17.035 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:07:17.035 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:17.035 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.035 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:17.035 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012400+0000", 2024-04-18T21:07:17.035 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.035 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.035 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.035 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:17.035 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012400+0000", 2024-04-18T21:07:17.035 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.035 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.036 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.036 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:17.036 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012400+0000", 2024-04-18T21:07:17.036 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9099999999999999e-07 2024-04-18T21:07:17.036 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.036 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.036 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:17.036 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012402+0000", 2024-04-18T21:07:17.036 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.995e-06 2024-04-18T21:07:17.036 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.036 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.036 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:17.036 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012408+0000", 2024-04-18T21:07:17.036 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8470000000000001e-06 2024-04-18T21:07:17.036 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.037 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.037 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.037 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012413+0000", 2024-04-18T21:07:17.037 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1379999999999998e-06 2024-04-18T21:07:17.037 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.037 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.037 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.037 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012999+0000", 2024-04-18T21:07:17.037 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000585798 2024-04-18T21:07:17.037 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.037 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.037 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:17.037 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013153+0000", 2024-04-18T21:07:17.037 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015368900000000001 2024-04-18T21:07:17.037 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.038 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.038 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.038 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.038 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.038 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:13637 4.3f 4:fff7d10c:::10000000ec1.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e68)", 2024-04-18T21:07:17.038 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:17.012423+0000", 2024-04-18T21:07:17.038 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.001681739, 2024-04-18T21:07:17.038 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0021431150000000001, 2024-04-18T21:07:17.038 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:17.038 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:17.038 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:07:17.038 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:17.038 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.038 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:17.038 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012423+0000", 2024-04-18T21:07:17.039 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.039 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.039 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.039 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:17.039 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012423+0000", 2024-04-18T21:07:17.039 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.039 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.039 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.039 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:17.039 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012424+0000", 2024-04-18T21:07:17.039 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0499999999999999e-07 2024-04-18T21:07:17.039 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.039 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.039 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:17.040 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012426+0000", 2024-04-18T21:07:17.040 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3290000000000001e-06 2024-04-18T21:07:17.040 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.040 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.040 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:17.040 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012432+0000", 2024-04-18T21:07:17.040 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6109999999999999e-06 2024-04-18T21:07:17.040 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.040 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.040 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.040 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012438+0000", 2024-04-18T21:07:17.040 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4070000000000001e-06 2024-04-18T21:07:17.040 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.040 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.040 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.040 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013045+0000", 2024-04-18T21:07:17.041 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00060754199999999998 2024-04-18T21:07:17.041 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.041 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.041 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:17.041 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013265+0000", 2024-04-18T21:07:17.041 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00021919299999999999 2024-04-18T21:07:17.041 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.041 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.041 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.041 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.041 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.041 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:13607 4.31 4:8c54da95:::10000000ea3.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e68)", 2024-04-18T21:07:17.041 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:17.008737+0000", 2024-04-18T21:07:17.041 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0053674719999999999, 2024-04-18T21:07:17.041 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0058888999999999999, 2024-04-18T21:07:17.041 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:17.042 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:17.042 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:07:17.042 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:17.042 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.042 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:17.042 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.008737+0000", 2024-04-18T21:07:17.042 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.042 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.042 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.042 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:17.042 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.008737+0000", 2024-04-18T21:07:17.042 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.042 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.043 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.043 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:17.043 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.008738+0000", 2024-04-18T21:07:17.043 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9999999999999996e-07 2024-04-18T21:07:17.043 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.043 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.043 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:17.043 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.008742+0000", 2024-04-18T21:07:17.043 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4750000000000002e-06 2024-04-18T21:07:17.043 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.043 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.043 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:17.043 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.008754+0000", 2024-04-18T21:07:17.043 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2549e-05 2024-04-18T21:07:17.044 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.044 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.044 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.044 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.008761+0000", 2024-04-18T21:07:17.044 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8809999999999998e-06 2024-04-18T21:07:17.044 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.044 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.044 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.044 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.010489+0000", 2024-04-18T21:07:17.044 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0017274980000000001 2024-04-18T21:07:17.044 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.044 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.044 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:17.044 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.011205+0000", 2024-04-18T21:07:17.045 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00071590900000000003 2024-04-18T21:07:17.045 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.045 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.045 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:17.045 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.011298+0000", 2024-04-18T21:07:17.045 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3375999999999995e-05 2024-04-18T21:07:17.045 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.045 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.045 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.045 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.045 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.045 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:13634 4.30 e68/16 4:0d395898:::10000000ebe.00000000:head v 68'360, mlcod=68'358)", 2024-04-18T21:07:17.045 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:17.012513+0000", 2024-04-18T21:07:17.045 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.001591758, 2024-04-18T21:07:17.045 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0021770209999999999, 2024-04-18T21:07:17.046 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:17.046 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:17.046 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:07:17.046 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:17.046 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.046 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:17.046 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012513+0000", 2024-04-18T21:07:17.046 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.046 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.046 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.046 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:17.046 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012513+0000", 2024-04-18T21:07:17.046 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.046 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.046 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.046 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:17.047 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012513+0000", 2024-04-18T21:07:17.047 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2899999999999999e-07 2024-04-18T21:07:17.047 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.047 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.047 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:17.047 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012517+0000", 2024-04-18T21:07:17.047 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6669999999999998e-06 2024-04-18T21:07:17.047 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.047 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.047 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:17.047 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012524+0000", 2024-04-18T21:07:17.047 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6089999999999997e-06 2024-04-18T21:07:17.047 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.047 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.047 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.047 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012529+0000", 2024-04-18T21:07:17.048 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4859999999999997e-06 2024-04-18T21:07:17.048 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.048 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.048 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.048 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013098+0000", 2024-04-18T21:07:17.048 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000568535 2024-04-18T21:07:17.048 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.048 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.048 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:17.048 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013116+0000", 2024-04-18T21:07:17.048 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7980000000000001e-05 2024-04-18T21:07:17.048 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.048 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.048 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.048 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.048 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.049 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:13607 4.31 e68/66)", 2024-04-18T21:07:17.049 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:17.012791+0000", 2024-04-18T21:07:17.049 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.001313399, 2024-04-18T21:07:17.049 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019543579999999998, 2024-04-18T21:07:17.049 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:17.049 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:17.049 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-18T21:07:17.049 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:17.049 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.049 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:17.049 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012791+0000", 2024-04-18T21:07:17.049 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.049 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.049 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.050 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:17.050 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012791+0000", 2024-04-18T21:07:17.050 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.050 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.050 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.050 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:17.050 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012792+0000", 2024-04-18T21:07:17.050 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2600000000000002e-07 2024-04-18T21:07:17.050 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.050 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.050 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:17.050 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012796+0000", 2024-04-18T21:07:17.050 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0180000000000003e-06 2024-04-18T21:07:17.050 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.050 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.050 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:17.051 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012805+0000", 2024-04-18T21:07:17.051 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0149999999999992e-06 2024-04-18T21:07:17.051 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.051 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.051 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.051 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012811+0000", 2024-04-18T21:07:17.051 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3060000000000003e-06 2024-04-18T21:07:17.051 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.051 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.051 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.051 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.051 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.051 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:13582 4.29 4:9796eaf4:::10000000e8a.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e68)", 2024-04-18T21:07:17.051 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:17.005992+0000", 2024-04-18T21:07:17.051 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0081129930000000006, 2024-04-18T21:07:17.051 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0089276530000000007, 2024-04-18T21:07:17.052 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:17.052 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:17.052 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:07:17.052 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:17.052 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.052 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:17.052 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.005992+0000", 2024-04-18T21:07:17.052 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.052 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.052 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.052 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:17.052 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.005992+0000", 2024-04-18T21:07:17.052 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.052 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.052 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.052 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:17.053 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.005993+0000", 2024-04-18T21:07:17.053 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2999999999999999e-07 2024-04-18T21:07:17.053 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.053 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.053 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:17.053 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.005997+0000", 2024-04-18T21:07:17.053 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8060000000000001e-06 2024-04-18T21:07:17.053 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.053 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.053 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:17.053 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.006005+0000", 2024-04-18T21:07:17.053 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2859999999999999e-06 2024-04-18T21:07:17.053 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.053 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.053 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.053 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.006013+0000", 2024-04-18T21:07:17.054 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8509999999999999e-06 2024-04-18T21:07:17.054 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.054 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.054 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.054 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.007989+0000", 2024-04-18T21:07:17.054 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019765609999999999 2024-04-18T21:07:17.054 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.054 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.054 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:17.054 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.008124+0000", 2024-04-18T21:07:17.054 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000134881 2024-04-18T21:07:17.054 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.054 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.054 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:17.054 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.008358+0000", 2024-04-18T21:07:17.054 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000233802 2024-04-18T21:07:17.055 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.055 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.055 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:17.055 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013800+0000", 2024-04-18T21:07:17.055 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.005442204 2024-04-18T21:07:17.055 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.055 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.055 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:17.055 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.014276+0000", 2024-04-18T21:07:17.055 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00047633300000000001 2024-04-18T21:07:17.055 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.055 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.055 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.055 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.055 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.056 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:13642 4.3f 4:fc68dcb4:::10000000ec6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e68)", 2024-04-18T21:07:17.056 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:17.013067+0000", 2024-04-18T21:07:17.056 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0010379390000000001, 2024-04-18T21:07:17.056 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019378380000000001, 2024-04-18T21:07:17.056 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:17.056 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:17.056 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:07:17.056 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:17.056 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.056 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:17.056 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013067+0000", 2024-04-18T21:07:17.056 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.056 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.056 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.056 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:17.056 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013067+0000", 2024-04-18T21:07:17.057 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.057 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.057 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.057 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:17.057 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013068+0000", 2024-04-18T21:07:17.057 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9899999999999999e-07 2024-04-18T21:07:17.057 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.057 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.057 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:17.057 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013072+0000", 2024-04-18T21:07:17.057 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4460000000000003e-06 2024-04-18T21:07:17.057 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.057 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.057 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:17.057 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013080+0000", 2024-04-18T21:07:17.057 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1629999999999996e-06 2024-04-18T21:07:17.058 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.058 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.058 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.058 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013089+0000", 2024-04-18T21:07:17.058 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2519999999999999e-06 2024-04-18T21:07:17.058 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.058 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.058 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.058 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.014193+0000", 2024-04-18T21:07:17.058 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001104542 2024-04-18T21:07:17.058 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.058 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.058 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:17.059 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.014309+0000", 2024-04-18T21:07:17.059 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000115328 2024-04-18T21:07:17.059 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.059 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.059 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.059 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.059 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.059 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:13643 4.26 4:67df70de:::10000000ec7.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e68)", 2024-04-18T21:07:17.059 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:17.013101+0000", 2024-04-18T21:07:17.059 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.001003566, 2024-04-18T21:07:17.059 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019735640000000001, 2024-04-18T21:07:17.059 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:17.059 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:17.059 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:07:17.059 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:17.060 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.060 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:17.060 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013101+0000", 2024-04-18T21:07:17.060 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.060 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.060 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.060 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:17.060 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013101+0000", 2024-04-18T21:07:17.060 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.060 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.060 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.060 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:17.060 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013102+0000", 2024-04-18T21:07:17.060 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1799999999999995e-07 2024-04-18T21:07:17.060 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.061 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.061 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:17.061 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013104+0000", 2024-04-18T21:07:17.061 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5110000000000002e-06 2024-04-18T21:07:17.061 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.061 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.061 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:17.061 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013111+0000", 2024-04-18T21:07:17.061 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8279999999999997e-06 2024-04-18T21:07:17.061 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.061 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.061 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.061 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013117+0000", 2024-04-18T21:07:17.061 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.383e-06 2024-04-18T21:07:17.061 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.061 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.062 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.062 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013666+0000", 2024-04-18T21:07:17.062 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000549853 2024-04-18T21:07:17.062 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.062 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.062 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:17.062 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013773+0000", 2024-04-18T21:07:17.062 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000106433 2024-04-18T21:07:17.062 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.062 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.062 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:17.062 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013863+0000", 2024-04-18T21:07:17.062 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9727000000000003e-05 2024-04-18T21:07:17.062 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.063 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.063 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.063 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.063 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.063 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:13644 4.b 4:d0333eef:::10000000ec8.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e68)", 2024-04-18T21:07:17.063 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:17.013126+0000", 2024-04-18T21:07:17.063 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00097894600000000007, 2024-04-18T21:07:17.063 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0020275599999999999, 2024-04-18T21:07:17.063 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:17.063 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:17.063 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:07:17.063 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:17.063 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.063 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:17.063 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013126+0000", 2024-04-18T21:07:17.064 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.064 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.064 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.064 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:17.064 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013126+0000", 2024-04-18T21:07:17.064 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.064 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.064 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.064 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:17.064 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013126+0000", 2024-04-18T21:07:17.064 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0100000000000005e-07 2024-04-18T21:07:17.064 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.064 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.064 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:17.064 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013129+0000", 2024-04-18T21:07:17.065 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2699999999999999e-06 2024-04-18T21:07:17.065 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.065 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.065 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:17.065 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013136+0000", 2024-04-18T21:07:17.065 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9249999999999998e-06 2024-04-18T21:07:17.065 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.065 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.065 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.065 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013141+0000", 2024-04-18T21:07:17.065 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5330000000000002e-06 2024-04-18T21:07:17.065 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.065 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.065 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.065 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013183+0000", 2024-04-18T21:07:17.066 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2240000000000002e-05 2024-04-18T21:07:17.066 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.066 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.066 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:17.066 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013283+0000", 2024-04-18T21:07:17.066 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9605999999999995e-05 2024-04-18T21:07:17.066 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.066 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.066 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:17.066 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013364+0000", 2024-04-18T21:07:17.066 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0962000000000002e-05 2024-04-18T21:07:17.066 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.066 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.066 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:17.067 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.014628+0000", 2024-04-18T21:07:17.067 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001263861 2024-04-18T21:07:17.067 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.067 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.067 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.067 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.067 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.067 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:13610 4.29 4.78d474e9 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e68)", 2024-04-18T21:07:17.067 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:17.009640+0000", 2024-04-18T21:07:17.067 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0044644250000000002, 2024-04-18T21:07:17.067 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055866960000000004, 2024-04-18T21:07:17.067 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:17.067 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:17.067 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-18T21:07:17.067 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:17.067 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.068 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:17.068 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.009640+0000", 2024-04-18T21:07:17.068 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.068 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.068 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.068 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:17.068 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.009640+0000", 2024-04-18T21:07:17.068 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.068 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.068 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.068 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:17.068 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.009641+0000", 2024-04-18T21:07:17.068 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1699999999999997e-07 2024-04-18T21:07:17.068 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.068 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.069 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:17.069 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.009645+0000", 2024-04-18T21:07:17.069 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4630000000000001e-06 2024-04-18T21:07:17.069 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.069 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.069 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:17.069 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.009651+0000", 2024-04-18T21:07:17.069 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5320000000000003e-06 2024-04-18T21:07:17.069 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.069 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.069 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.069 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.009657+0000", 2024-04-18T21:07:17.069 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9900000000000002e-06 2024-04-18T21:07:17.069 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.069 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.069 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.070 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.070 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.070 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:13639 4.1b e68/16 4:d9cd8a55:::10000000ec3.00000000:head v 68'276, mlcod=68'273)", 2024-04-18T21:07:17.070 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:17.013151+0000", 2024-04-18T21:07:17.070 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00095346099999999996, 2024-04-18T21:07:17.070 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0021206329999999998, 2024-04-18T21:07:17.070 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:17.070 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:17.070 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:07:17.070 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:17.070 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.070 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:17.070 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013151+0000", 2024-04-18T21:07:17.070 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.070 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.070 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.071 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:17.071 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013151+0000", 2024-04-18T21:07:17.071 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.071 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.071 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.071 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:17.071 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013152+0000", 2024-04-18T21:07:17.071 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7199999999999998e-07 2024-04-18T21:07:17.071 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.071 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.071 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:17.071 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013157+0000", 2024-04-18T21:07:17.071 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3820000000000003e-06 2024-04-18T21:07:17.071 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.071 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.072 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:17.072 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013168+0000", 2024-04-18T21:07:17.072 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0074999999999999e-05 2024-04-18T21:07:17.072 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.072 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.072 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.072 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013173+0000", 2024-04-18T21:07:17.072 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9379999999999997e-06 2024-04-18T21:07:17.072 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.072 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.072 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.072 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.014217+0000", 2024-04-18T21:07:17.072 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010433199999999999 2024-04-18T21:07:17.072 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.072 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.072 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:17.073 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.014234+0000", 2024-04-18T21:07:17.073 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7241999999999999e-05 2024-04-18T21:07:17.073 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.073 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.073 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.073 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.073 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.073 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:13646 4.d 4:b2a0d212:::10000000eca.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e68)", 2024-04-18T21:07:17.073 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:17.013704+0000", 2024-04-18T21:07:17.073 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00040096100000000003, 2024-04-18T21:07:17.073 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0016284139999999999, 2024-04-18T21:07:17.073 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:17.073 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:17.073 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:07:17.073 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:17.073 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.074 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:17.074 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013704+0000", 2024-04-18T21:07:17.074 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.074 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.074 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.074 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:17.074 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013704+0000", 2024-04-18T21:07:17.074 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.074 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.074 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.074 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:17.074 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013705+0000", 2024-04-18T21:07:17.074 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8100000000000001e-07 2024-04-18T21:07:17.074 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.074 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.075 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:17.075 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013709+0000", 2024-04-18T21:07:17.075 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5750000000000002e-06 2024-04-18T21:07:17.075 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.075 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.075 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:17.075 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013718+0000", 2024-04-18T21:07:17.075 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.67e-06 2024-04-18T21:07:17.075 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.075 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.075 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.075 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013725+0000", 2024-04-18T21:07:17.075 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8410000000000002e-06 2024-04-18T21:07:17.075 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.075 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.075 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013771+0000", 2024-04-18T21:07:17.076 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5998999999999998e-05 2024-04-18T21:07:17.076 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.076 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.076 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:17.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013881+0000", 2024-04-18T21:07:17.076 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109924 2024-04-18T21:07:17.076 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.076 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.076 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:17.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.014010+0000", 2024-04-18T21:07:17.076 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012909900000000001 2024-04-18T21:07:17.076 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.076 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.076 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:17.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.015107+0000", 2024-04-18T21:07:17.077 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010968359999999999 2024-04-18T21:07:17.077 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.077 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.077 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.077 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.077 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.077 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:13645 4.2c e68/16 4:34a22dc0:::10000000ec9.00000000:head v 68'341, mlcod=68'339)", 2024-04-18T21:07:17.077 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:17.013744+0000", 2024-04-18T21:07:17.077 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00036081500000000001, 2024-04-18T21:07:17.077 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0016558720000000001, 2024-04-18T21:07:17.077 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:17.077 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:17.077 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:07:17.077 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:17.077 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.077 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:17.078 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013744+0000", 2024-04-18T21:07:17.078 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.078 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.078 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.078 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:17.078 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013744+0000", 2024-04-18T21:07:17.078 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.078 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.078 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.078 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:17.078 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013745+0000", 2024-04-18T21:07:17.078 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5099999999999999e-07 2024-04-18T21:07:17.078 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.078 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.078 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:17.079 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013750+0000", 2024-04-18T21:07:17.079 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.536e-06 2024-04-18T21:07:17.079 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.079 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.079 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:17.079 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013759+0000", 2024-04-18T21:07:17.079 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8680000000000005e-06 2024-04-18T21:07:17.079 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.079 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.079 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.079 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013765+0000", 2024-04-18T21:07:17.079 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3860000000000004e-06 2024-04-18T21:07:17.079 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.079 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.079 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.079 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013821+0000", 2024-04-18T21:07:17.080 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5795999999999999e-05 2024-04-18T21:07:17.080 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.080 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.080 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:17.080 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013839+0000", 2024-04-18T21:07:17.080 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7688000000000001e-05 2024-04-18T21:07:17.080 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.080 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.080 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.080 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.080 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.080 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:13614 4.21 4.4b185b21 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e68)", 2024-04-18T21:07:17.080 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:17.010482+0000", 2024-04-18T21:07:17.080 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0036230260000000001, 2024-04-18T21:07:17.080 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0049797829999999998, 2024-04-18T21:07:17.081 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:17.081 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:17.081 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-18T21:07:17.081 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:17.081 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.081 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:17.081 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.010482+0000", 2024-04-18T21:07:17.081 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.081 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.081 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.081 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:17.081 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.010482+0000", 2024-04-18T21:07:17.081 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.081 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.081 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.081 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:17.082 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.010482+0000", 2024-04-18T21:07:17.082 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3500000000000002e-07 2024-04-18T21:07:17.082 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.082 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.082 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:17.082 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.010484+0000", 2024-04-18T21:07:17.082 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6160000000000001e-06 2024-04-18T21:07:17.082 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.082 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.082 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:17.082 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.010488+0000", 2024-04-18T21:07:17.082 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0260000000000001e-06 2024-04-18T21:07:17.082 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.082 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.082 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.083 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.010492+0000", 2024-04-18T21:07:17.083 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5950000000000001e-06 2024-04-18T21:07:17.083 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.083 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.083 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.083 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.083 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.083 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:13647 4.28 4:14481510:::10000000ecb.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e68)", 2024-04-18T21:07:17.083 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:17.013913+0000", 2024-04-18T21:07:17.083 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00019168599999999999, 2024-04-18T21:07:17.083 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001603307, 2024-04-18T21:07:17.083 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:17.083 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:17.083 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:07:17.083 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:17.083 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.084 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:17.084 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013913+0000", 2024-04-18T21:07:17.084 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.084 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.084 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.084 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:17.084 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013913+0000", 2024-04-18T21:07:17.084 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.084 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.084 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.084 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:17.084 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013914+0000", 2024-04-18T21:07:17.084 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6600000000000005e-07 2024-04-18T21:07:17.084 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.084 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.084 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:17.085 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013918+0000", 2024-04-18T21:07:17.085 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.391e-06 2024-04-18T21:07:17.085 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.085 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.085 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:17.085 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013927+0000", 2024-04-18T21:07:17.085 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5280000000000003e-06 2024-04-18T21:07:17.085 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.085 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.085 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.085 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013934+0000", 2024-04-18T21:07:17.085 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.153e-06 2024-04-18T21:07:17.085 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.085 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.085 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.085 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013998+0000", 2024-04-18T21:07:17.086 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4135999999999997e-05 2024-04-18T21:07:17.086 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.086 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.086 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:17.086 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.014828+0000", 2024-04-18T21:07:17.086 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00082965999999999997 2024-04-18T21:07:17.086 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.086 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.086 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.086 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.086 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.086 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:13648 4.28 4.34edb768 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e68)", 2024-04-18T21:07:17.086 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:17.013959+0000", 2024-04-18T21:07:17.086 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00014537799999999999, 2024-04-18T21:07:17.086 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0016216519999999999, 2024-04-18T21:07:17.087 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:17.087 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:17.087 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-18T21:07:17.087 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:17.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.087 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:17.087 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013959+0000", 2024-04-18T21:07:17.087 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.087 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.087 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:17.087 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013959+0000", 2024-04-18T21:07:17.087 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.087 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.087 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:17.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013960+0000", 2024-04-18T21:07:17.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1399999999999997e-07 2024-04-18T21:07:17.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.088 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:17.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013963+0000", 2024-04-18T21:07:17.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.118e-06 2024-04-18T21:07:17.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.088 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:17.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013971+0000", 2024-04-18T21:07:17.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8080000000000005e-06 2024-04-18T21:07:17.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.088 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013977+0000", 2024-04-18T21:07:17.089 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9970000000000004e-06 2024-04-18T21:07:17.089 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.089 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.089 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.089 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.089 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.089 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:13649 4.36 4:6c234d40:::10000000ecd.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e68)", 2024-04-18T21:07:17.089 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:17.014014+0000", 2024-04-18T21:07:17.089 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.1317999999999995e-05, 2024-04-18T21:07:17.089 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0016323679999999999, 2024-04-18T21:07:17.089 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:17.089 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:17.089 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:07:17.089 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:17.089 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.089 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:17.090 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.014014+0000", 2024-04-18T21:07:17.090 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.090 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.090 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.090 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:17.090 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.014014+0000", 2024-04-18T21:07:17.090 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.090 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.090 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.090 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:17.090 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.014014+0000", 2024-04-18T21:07:17.090 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.37e-07 2024-04-18T21:07:17.090 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.090 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.090 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:17.090 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.014017+0000", 2024-04-18T21:07:17.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9950000000000001e-06 2024-04-18T21:07:17.091 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.091 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.091 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:17.091 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.014025+0000", 2024-04-18T21:07:17.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5100000000000001e-06 2024-04-18T21:07:17.091 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.091 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.091 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.091 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.014030+0000", 2024-04-18T21:07:17.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5740000000000003e-06 2024-04-18T21:07:17.091 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.091 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.091 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.091 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.014153+0000", 2024-04-18T21:07:17.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012322200000000001 2024-04-18T21:07:17.092 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.092 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.092 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:17.092 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.014340+0000", 2024-04-18T21:07:17.092 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018682799999999999 2024-04-18T21:07:17.092 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.092 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.092 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.092 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.092 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.092 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:13650 4.2e 4:75ec9afc:::10000000ece.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e68)", 2024-04-18T21:07:17.092 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:17.014199+0000", 2024-04-18T21:07:17.092 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4294967295.9999061, 2024-04-18T21:07:17.092 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015302320000000001, 2024-04-18T21:07:17.092 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:17.093 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:17.093 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:07:17.093 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:17.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.093 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:17.093 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.014199+0000", 2024-04-18T21:07:17.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.093 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.093 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:17.093 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.014199+0000", 2024-04-18T21:07:17.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.093 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.093 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:17.093 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.014200+0000", 2024-04-18T21:07:17.094 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9999999999999996e-07 2024-04-18T21:07:17.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.094 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:17.094 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.014203+0000", 2024-04-18T21:07:17.094 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.799e-06 2024-04-18T21:07:17.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.094 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:17.094 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.014212+0000", 2024-04-18T21:07:17.094 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6349999999999995e-06 2024-04-18T21:07:17.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.094 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.094 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.014219+0000", 2024-04-18T21:07:17.095 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6359999999999997e-06 2024-04-18T21:07:17.095 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.095 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.095 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.095 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.014533+0000", 2024-04-18T21:07:17.095 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031429599999999999 2024-04-18T21:07:17.095 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.095 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.095 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:17.095 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.014645+0000", 2024-04-18T21:07:17.095 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011207199999999999 2024-04-18T21:07:17.095 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.095 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.095 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.095 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.096 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.096 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:13621 4.38 e68/63)", 2024-04-18T21:07:17.096 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:17.014244+0000", 2024-04-18T21:07:17.096 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4294967295.9998612, 2024-04-18T21:07:17.096 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015670899999999999, 2024-04-18T21:07:17.096 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:17.096 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:17.096 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-18T21:07:17.096 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:17.096 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.096 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:17.096 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.014244+0000", 2024-04-18T21:07:17.096 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.096 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.096 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.096 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:17.097 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.014244+0000", 2024-04-18T21:07:17.097 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.097 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.097 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.097 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:17.097 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.014244+0000", 2024-04-18T21:07:17.097 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4600000000000004e-07 2024-04-18T21:07:17.097 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.097 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.097 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:17.097 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.014248+0000", 2024-04-18T21:07:17.097 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9840000000000003e-06 2024-04-18T21:07:17.097 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.097 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.097 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:17.098 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.014258+0000", 2024-04-18T21:07:17.098 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.6760000000000002e-06 2024-04-18T21:07:17.098 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.098 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.098 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.098 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.014264+0000", 2024-04-18T21:07:17.098 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9170000000000003e-06 2024-04-18T21:07:17.098 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.098 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.098 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.098 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.098 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.098 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:13582 4.29 e68/63 ondisk, result = 0)", 2024-04-18T21:07:17.098 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:17.010709+0000", 2024-04-18T21:07:17.098 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0033955040000000001, 2024-04-18T21:07:17.099 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0051541950000000003, 2024-04-18T21:07:17.099 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:17.099 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:17.099 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:07:17.099 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:17.099 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.099 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:17.099 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.010709+0000", 2024-04-18T21:07:17.099 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.099 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.099 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.099 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:17.099 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.010709+0000", 2024-04-18T21:07:17.099 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.099 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.099 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.100 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:17.100 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.010710+0000", 2024-04-18T21:07:17.100 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.36e-07 2024-04-18T21:07:17.100 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.100 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.100 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:17.100 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.010712+0000", 2024-04-18T21:07:17.100 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0600000000000002e-06 2024-04-18T21:07:17.100 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.100 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.100 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:17.100 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.010718+0000", 2024-04-18T21:07:17.100 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8120000000000002e-06 2024-04-18T21:07:17.100 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.100 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.100 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.101 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.010723+0000", 2024-04-18T21:07:17.101 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1010000000000002e-06 2024-04-18T21:07:17.101 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.101 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.101 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.101 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013787+0000", 2024-04-18T21:07:17.101 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003064893 2024-04-18T21:07:17.101 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.101 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.101 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:17.101 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.013794+0000", 2024-04-18T21:07:17.101 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9079999999999998e-06 2024-04-18T21:07:17.101 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.101 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.101 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.101 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.101 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.102 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:13651 4.38 4.d2f0c538 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e68)", 2024-04-18T21:07:17.102 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:17.014292+0000", 2024-04-18T21:07:17.102 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4294967295.9998131, 2024-04-18T21:07:17.102 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001652658, 2024-04-18T21:07:17.102 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:17.102 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:17.102 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-18T21:07:17.102 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:17.102 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.102 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:17.102 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.014292+0000", 2024-04-18T21:07:17.102 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.102 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.102 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.102 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:17.103 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.014292+0000", 2024-04-18T21:07:17.103 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.103 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.103 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.103 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:17.103 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.014293+0000", 2024-04-18T21:07:17.103 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1999999999999999e-07 2024-04-18T21:07:17.103 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.103 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.103 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:17.103 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.014296+0000", 2024-04-18T21:07:17.103 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4819999999999999e-06 2024-04-18T21:07:17.103 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.103 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.103 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:17.103 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.014305+0000", 2024-04-18T21:07:17.104 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9900000000000003e-06 2024-04-18T21:07:17.104 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.104 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.104 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.104 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.014312+0000", 2024-04-18T21:07:17.104 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4840000000000001e-06 2024-04-18T21:07:17.104 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.104 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.104 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.104 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.104 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.104 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:13602 4.29 e68/63)", 2024-04-18T21:07:17.104 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:17.011077+0000", 2024-04-18T21:07:17.104 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0030283459999999999, 2024-04-18T21:07:17.104 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0049172060000000004, 2024-04-18T21:07:17.104 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:17.105 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:17.105 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-18T21:07:17.105 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:17.105 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.105 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:17.105 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.011077+0000", 2024-04-18T21:07:17.105 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.105 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.105 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.105 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:17.105 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.011077+0000", 2024-04-18T21:07:17.105 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.105 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.105 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.105 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:17.106 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.011077+0000", 2024-04-18T21:07:17.106 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5899999999999996e-07 2024-04-18T21:07:17.106 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.106 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.106 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:17.106 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.011081+0000", 2024-04-18T21:07:17.106 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7129999999999999e-06 2024-04-18T21:07:17.106 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.106 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.106 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:17.106 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.011089+0000", 2024-04-18T21:07:17.106 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8310000000000001e-06 2024-04-18T21:07:17.106 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.106 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.106 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.107 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.011095+0000", 2024-04-18T21:07:17.107 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4579999999999998e-06 2024-04-18T21:07:17.107 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.107 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.107 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.107 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.107 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.107 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:13653 4.f 4:f1f20700:::10000000ed1.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e68)", 2024-04-18T21:07:17.107 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:17.014325+0000", 2024-04-18T21:07:17.107 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4294967295.9997797, 2024-04-18T21:07:17.107 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001725741, 2024-04-18T21:07:17.107 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:17.107 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:17.107 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:07:17.107 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:17.108 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.108 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:17.108 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.014325+0000", 2024-04-18T21:07:17.108 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.108 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.108 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.108 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:17.108 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.014325+0000", 2024-04-18T21:07:17.108 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.108 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.108 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.108 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:17.108 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.014326+0000", 2024-04-18T21:07:17.108 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5899999999999996e-07 2024-04-18T21:07:17.108 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.108 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.109 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:17.109 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.014328+0000", 2024-04-18T21:07:17.109 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.661e-06 2024-04-18T21:07:17.109 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.109 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.109 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:17.109 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.014336+0000", 2024-04-18T21:07:17.109 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2609999999999996e-06 2024-04-18T21:07:17.109 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.109 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.109 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.109 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.014341+0000", 2024-04-18T21:07:17.109 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3639999999999998e-06 2024-04-18T21:07:17.109 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.109 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.109 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.110 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.014391+0000", 2024-04-18T21:07:17.110 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9851000000000001e-05 2024-04-18T21:07:17.110 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.110 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.110 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:17.110 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.014513+0000", 2024-04-18T21:07:17.110 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012231199999999999 2024-04-18T21:07:17.110 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.110 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.110 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.110 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.110 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.110 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:13621 4.38 4:1e025b40:::10000000eb1.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e68)", 2024-04-18T21:07:17.110 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:17.012130+0000", 2024-04-18T21:07:17.110 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0019744459999999999, 2024-04-18T21:07:17.110 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0039935179999999997, 2024-04-18T21:07:17.111 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:17.111 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:17.111 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-18T21:07:17.111 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:17.111 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.111 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:17.111 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012130+0000", 2024-04-18T21:07:17.111 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.111 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.111 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.111 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:17.111 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012130+0000", 2024-04-18T21:07:17.111 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.111 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.111 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.112 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:17.112 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012131+0000", 2024-04-18T21:07:17.112 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6799999999999999e-07 2024-04-18T21:07:17.112 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.112 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.112 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:17.112 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012136+0000", 2024-04-18T21:07:17.112 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2350000000000001e-06 2024-04-18T21:07:17.112 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.112 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.112 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:17.112 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012145+0000", 2024-04-18T21:07:17.112 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0000000000000002e-06 2024-04-18T21:07:17.112 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.112 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.112 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.113 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012151+0000", 2024-04-18T21:07:17.113 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3679999999999998e-06 2024-04-18T21:07:17.113 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.113 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.113 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.113 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012202+0000", 2024-04-18T21:07:17.113 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1406000000000002e-05 2024-04-18T21:07:17.113 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.113 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.113 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:17.113 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012329+0000", 2024-04-18T21:07:17.113 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012708000000000001 2024-04-18T21:07:17.113 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.113 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.113 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:17.113 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012565+0000", 2024-04-18T21:07:17.114 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023582799999999999 2024-04-18T21:07:17.114 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.114 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.114 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.114 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.114 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.114 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:13625 4.19 4.d5ddba19 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e68)", 2024-04-18T21:07:17.114 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:17.012199+0000", 2024-04-18T21:07:17.114 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0019056819999999999, 2024-04-18T21:07:17.114 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0039842990000000002, 2024-04-18T21:07:17.114 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:17.114 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:17.114 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-18T21:07:17.114 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:17.114 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.114 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:17.115 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012199+0000", 2024-04-18T21:07:17.115 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.115 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.115 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.115 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:17.115 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012199+0000", 2024-04-18T21:07:17.115 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.115 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.115 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.115 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:17.115 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012200+0000", 2024-04-18T21:07:17.115 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6199999999999998e-07 2024-04-18T21:07:17.115 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.115 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.115 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:17.115 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012203+0000", 2024-04-18T21:07:17.116 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8040000000000002e-06 2024-04-18T21:07:17.116 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.116 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.116 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:17.116 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012210+0000", 2024-04-18T21:07:17.116 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4710000000000001e-06 2024-04-18T21:07:17.116 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.116 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.116 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.116 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.012215+0000", 2024-04-18T21:07:17.116 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0640000000000001e-06 2024-04-18T21:07:17.116 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.116 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.116 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.116 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.116 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.117 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:13654 4.4 4:2053bea6:::10000000ed2.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e68)", 2024-04-18T21:07:17.117 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:17.015111+0000", 2024-04-18T21:07:17.117 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4294967295.9989939, 2024-04-18T21:07:17.117 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0011290429999999999, 2024-04-18T21:07:17.117 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:17.117 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:17.117 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:07:17.117 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:17.117 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.117 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:17.117 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.015111+0000", 2024-04-18T21:07:17.117 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.117 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.117 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.117 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:17.118 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.015111+0000", 2024-04-18T21:07:17.118 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.118 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.118 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.118 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:17.118 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.015112+0000", 2024-04-18T21:07:17.118 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.018e-06 2024-04-18T21:07:17.118 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.118 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.118 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:17.118 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.015116+0000", 2024-04-18T21:07:17.118 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.946e-06 2024-04-18T21:07:17.118 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.118 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.118 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:17.119 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.015126+0000", 2024-04-18T21:07:17.119 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7070000000000004e-06 2024-04-18T21:07:17.119 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.119 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.119 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.119 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.015133+0000", 2024-04-18T21:07:17.119 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8110000000000003e-06 2024-04-18T21:07:17.119 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.119 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.119 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.119 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.015201+0000", 2024-04-18T21:07:17.119 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7428999999999994e-05 2024-04-18T21:07:17.119 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.119 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.119 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:17.119 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.015296+0000", 2024-04-18T21:07:17.120 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5452999999999996e-05 2024-04-18T21:07:17.120 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.120 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.120 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.120 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.120 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.120 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:13655 4.7 4:e35b0da0:::10000000ed3.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e68)", 2024-04-18T21:07:17.120 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:17.015152+0000", 2024-04-18T21:07:17.120 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4294967295.9989524, 2024-04-18T21:07:17.120 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0011781490000000001, 2024-04-18T21:07:17.120 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:17.120 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:17.120 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:07:17.120 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:17.120 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.120 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:17.121 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.015152+0000", 2024-04-18T21:07:17.121 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.121 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.121 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.121 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:17.121 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.015152+0000", 2024-04-18T21:07:17.121 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.121 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.121 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.121 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:17.121 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.015153+0000", 2024-04-18T21:07:17.121 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2099999999999996e-07 2024-04-18T21:07:17.121 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.121 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.121 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:17.122 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.015156+0000", 2024-04-18T21:07:17.122 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7609999999999999e-06 2024-04-18T21:07:17.122 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.122 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.122 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:17.122 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.015165+0000", 2024-04-18T21:07:17.122 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.431e-06 2024-04-18T21:07:17.122 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.122 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.122 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.122 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.015172+0000", 2024-04-18T21:07:17.122 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8070000000000002e-06 2024-04-18T21:07:17.122 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.122 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.122 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.122 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.015275+0000", 2024-04-18T21:07:17.123 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010306699999999999 2024-04-18T21:07:17.123 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.123 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.123 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:17.123 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:17.015353+0000", 2024-04-18T21:07:17.123 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7595999999999994e-05 2024-04-18T21:07:17.123 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.123 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.123 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.123 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.123 INFO:teuthology.orchestra.run.smithi187.stdout: ], 2024-04-18T21:07:17.123 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 32 2024-04-18T21:07:17.123 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:07:17.124 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:07:17.125 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:17.125+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:17.225 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:17.226+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:17.255 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:07:17.255 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:07:17.255 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-18T21:07:17.255 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-18T21:07:17.255 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:07:17.270 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:17.357 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:17.358+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:17.428 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:17.426+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:17.443 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:07:17.443 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-18T21:07:17.443 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-18T21:07:17.443 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:07:17.443 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.444 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:108 3.1f 3:f83d65d8:::200.00000004:head [write 326287~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:17.444 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:07:17.444 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 31.683515037999999, 2024-04-18T21:07:17.444 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056616183, 2024-04-18T21:07:17.444 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:17.444 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:17.444 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:17.444 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:17.444 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.444 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:17.444 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:07:17.444 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.445 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.445 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.445 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:17.445 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:07:17.445 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.445 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.445 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.445 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:17.445 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758084+0000", 2024-04-18T21:07:17.445 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.124e-06 2024-04-18T21:07:17.445 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.445 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.446 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:17.446 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758100+0000", 2024-04-18T21:07:17.446 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6246e-05 2024-04-18T21:07:17.446 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.446 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.446 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:17.446 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758118+0000", 2024-04-18T21:07:17.446 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8267e-05 2024-04-18T21:07:17.446 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.446 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.446 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.446 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758134+0000", 2024-04-18T21:07:17.447 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5950000000000001e-05 2024-04-18T21:07:17.447 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.447 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.447 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.447 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803949+0000", 2024-04-18T21:07:17.447 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045815349999999998 2024-04-18T21:07:17.447 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.447 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.447 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:17.447 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804011+0000", 2024-04-18T21:07:17.447 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1044999999999996e-05 2024-04-18T21:07:17.447 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.447 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.448 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:17.448 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804128+0000", 2024-04-18T21:07:17.448 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117148 2024-04-18T21:07:17.448 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.448 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.448 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:17.448 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806794+0000", 2024-04-18T21:07:17.448 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002666692 2024-04-18T21:07:17.448 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.448 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.448 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:17.448 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814645+0000", 2024-04-18T21:07:17.448 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0078508880000000003 2024-04-18T21:07:17.449 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.449 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.449 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:17.449 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814678+0000", 2024-04-18T21:07:17.449 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3188999999999997e-05 2024-04-18T21:07:17.449 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.449 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.449 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:17.449 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814699+0000", 2024-04-18T21:07:17.449 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0284000000000001e-05 2024-04-18T21:07:17.449 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.449 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.449 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.450 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.450 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.450 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:109 3.1f 3:f83d65d8:::200.00000004:head [write 327693~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:17.450 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:07:17.450 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 31.683445671000001, 2024-04-18T21:07:17.450 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056621036999999999, 2024-04-18T21:07:17.450 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:17.450 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:17.450 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:17.450 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:17.450 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.450 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:17.450 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:07:17.451 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.451 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.451 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.451 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:17.451 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:07:17.451 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.451 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.451 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.451 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:17.451 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758153+0000", 2024-04-18T21:07:17.451 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1459999999999999e-06 2024-04-18T21:07:17.451 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.452 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.452 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:17.452 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758161+0000", 2024-04-18T21:07:17.452 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7999999999999999e-06 2024-04-18T21:07:17.452 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.452 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.452 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:17.452 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758179+0000", 2024-04-18T21:07:17.452 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7949999999999999e-05 2024-04-18T21:07:17.452 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.452 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.452 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.452 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758193+0000", 2024-04-18T21:07:17.453 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3773e-05 2024-04-18T21:07:17.453 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.453 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.453 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.453 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804632+0000", 2024-04-18T21:07:17.453 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.046439469999999997 2024-04-18T21:07:17.453 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.453 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.453 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:17.453 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804790+0000", 2024-04-18T21:07:17.453 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015784300000000001 2024-04-18T21:07:17.453 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.453 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.453 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:17.453 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805056+0000", 2024-04-18T21:07:17.454 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026652400000000003 2024-04-18T21:07:17.454 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.454 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.454 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:17.454 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.808959+0000", 2024-04-18T21:07:17.454 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003903077 2024-04-18T21:07:17.454 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.454 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.454 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:17.454 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814728+0000", 2024-04-18T21:07:17.454 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0057682489999999996 2024-04-18T21:07:17.454 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.454 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.454 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:17.455 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814754+0000", 2024-04-18T21:07:17.455 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6673999999999999e-05 2024-04-18T21:07:17.455 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.455 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.455 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:17.455 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814773+0000", 2024-04-18T21:07:17.455 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8530999999999999e-05 2024-04-18T21:07:17.455 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.455 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.455 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.455 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.455 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.455 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:110 3.1f 3:f83d65d8:::200.00000004:head [write 329098~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:17.455 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:07:17.455 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 31.683387262, 2024-04-18T21:07:17.456 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056669113, 2024-04-18T21:07:17.456 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:17.456 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:17.456 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:17.456 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:17.456 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.456 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:17.456 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:07:17.456 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.456 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.456 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.456 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:17.456 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:07:17.456 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.456 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.456 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.457 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:17.457 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758212+0000", 2024-04-18T21:07:17.457 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:07:17.457 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.457 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.457 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:17.457 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758219+0000", 2024-04-18T21:07:17.457 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4229999999999999e-06 2024-04-18T21:07:17.457 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.457 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.457 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:17.457 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758237+0000", 2024-04-18T21:07:17.457 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7966999999999999e-05 2024-04-18T21:07:17.458 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.458 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.458 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.458 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758252+0000", 2024-04-18T21:07:17.458 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5322999999999999e-05 2024-04-18T21:07:17.458 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.458 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.458 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.458 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805536+0000", 2024-04-18T21:07:17.458 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.047283861000000003 2024-04-18T21:07:17.458 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.458 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.458 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:17.459 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805579+0000", 2024-04-18T21:07:17.459 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2738999999999999e-05 2024-04-18T21:07:17.459 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.459 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.459 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:17.459 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805649+0000", 2024-04-18T21:07:17.459 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0213e-05 2024-04-18T21:07:17.459 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.459 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.459 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:17.459 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.808966+0000", 2024-04-18T21:07:17.459 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033166129999999999 2024-04-18T21:07:17.460 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.460 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.460 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:17.460 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814812+0000", 2024-04-18T21:07:17.460 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0058463589999999998 2024-04-18T21:07:17.460 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.460 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.460 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:17.460 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814854+0000", 2024-04-18T21:07:17.460 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1618e-05 2024-04-18T21:07:17.460 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.460 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.461 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:17.461 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814879+0000", 2024-04-18T21:07:17.461 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5754000000000001e-05 2024-04-18T21:07:17.461 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.461 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.461 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.461 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.461 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.461 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:111 3.1f 3:f83d65d8:::200.00000004:head [write 330499~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:17.461 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:07:17.461 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 31.683326286, 2024-04-18T21:07:17.461 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058693793000000001, 2024-04-18T21:07:17.462 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:17.462 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:17.462 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:17.462 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:17.462 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.462 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:17.462 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:07:17.462 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.462 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.462 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.462 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:17.462 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:07:17.462 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.463 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.463 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.463 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:17.463 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758272+0000", 2024-04-18T21:07:17.463 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1200000000000001e-06 2024-04-18T21:07:17.463 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.463 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.463 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:17.463 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758287+0000", 2024-04-18T21:07:17.463 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5017e-05 2024-04-18T21:07:17.463 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.463 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.463 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:17.464 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758309+0000", 2024-04-18T21:07:17.464 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1866e-05 2024-04-18T21:07:17.464 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.464 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.464 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.464 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758323+0000", 2024-04-18T21:07:17.464 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3606e-05 2024-04-18T21:07:17.464 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.464 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.464 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.464 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806279+0000", 2024-04-18T21:07:17.464 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.047956061000000001 2024-04-18T21:07:17.464 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.465 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.465 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:17.465 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806350+0000", 2024-04-18T21:07:17.465 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1070999999999998e-05 2024-04-18T21:07:17.465 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.465 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.465 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:17.465 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806459+0000", 2024-04-18T21:07:17.465 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000108606 2024-04-18T21:07:17.465 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.465 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.465 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:17.465 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.809774+0000", 2024-04-18T21:07:17.466 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003314881 2024-04-18T21:07:17.466 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.466 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.466 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:17.466 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816910+0000", 2024-04-18T21:07:17.466 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0071367760000000001 2024-04-18T21:07:17.466 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.466 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.466 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:17.466 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816941+0000", 2024-04-18T21:07:17.466 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0846000000000002e-05 2024-04-18T21:07:17.466 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.466 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.467 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:17.467 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816965+0000", 2024-04-18T21:07:17.467 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3943000000000001e-05 2024-04-18T21:07:17.467 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.467 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.467 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.467 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.467 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.467 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:12689 4.26 4:64a7f444:::100000033e5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:17.467 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:00.208067+0000", 2024-04-18T21:07:17.467 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 17.233530869999999, 2024-04-18T21:07:17.467 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066681457, 2024-04-18T21:07:17.468 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:17.468 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:17.468 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:17.468 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:07:17.468 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:07:17.468 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:17.468 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 12689 2024-04-18T21:07:17.468 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.468 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:17.468 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.468 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:17.468 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.208067+0000", 2024-04-18T21:07:17.468 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.469 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.469 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.469 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:17.469 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.208067+0000", 2024-04-18T21:07:17.469 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.469 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.469 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.469 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:17.469 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.208069+0000", 2024-04-18T21:07:17.469 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1500000000000002e-06 2024-04-18T21:07:17.469 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.469 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.470 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:17.470 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216162+0000", 2024-04-18T21:07:17.470 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0080933159999999997 2024-04-18T21:07:17.470 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.470 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.470 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:17.470 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216181+0000", 2024-04-18T21:07:17.470 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8573e-05 2024-04-18T21:07:17.470 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.470 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.470 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.470 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216192+0000", 2024-04-18T21:07:17.470 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0767999999999999e-05 2024-04-18T21:07:17.471 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.471 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.471 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.471 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216259+0000", 2024-04-18T21:07:17.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7977000000000003e-05 2024-04-18T21:07:17.471 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.471 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.471 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:17.471 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216635+0000", 2024-04-18T21:07:17.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00037591300000000002 2024-04-18T21:07:17.471 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.471 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.471 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:17.472 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216929+0000", 2024-04-18T21:07:17.472 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00029314800000000002 2024-04-18T21:07:17.472 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.472 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.472 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:17.472 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.232918+0000", 2024-04-18T21:07:17.472 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015989903 2024-04-18T21:07:17.472 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.472 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.472 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:17.472 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.274643+0000", 2024-04-18T21:07:17.472 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.041724281000000002 2024-04-18T21:07:17.472 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.473 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:17.473 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.274701+0000", 2024-04-18T21:07:17.473 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8304999999999998e-05 2024-04-18T21:07:17.473 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.473 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:17.473 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.274748+0000", 2024-04-18T21:07:17.473 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7123000000000003e-05 2024-04-18T21:07:17.473 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.473 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.473 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.474 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.474 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.474 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:7694 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-18T21:07:17.474 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:11.672522+0000", 2024-04-18T21:07:17.474 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 5.7690758300000002, 2024-04-18T21:07:17.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2954970370000001, 2024-04-18T21:07:17.474 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:17.474 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:17.474 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:17.474 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:17.474 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.474 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:17.474 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672522+0000", 2024-04-18T21:07:17.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.475 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.475 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:17.475 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672522+0000", 2024-04-18T21:07:17.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.475 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.475 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:17.475 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672525+0000", 2024-04-18T21:07:17.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.366e-06 2024-04-18T21:07:17.475 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:17.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672540+0000", 2024-04-18T21:07:17.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4949999999999999e-05 2024-04-18T21:07:17.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:17.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672569+0000", 2024-04-18T21:07:17.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8714999999999999e-05 2024-04-18T21:07:17.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672581+0000", 2024-04-18T21:07:17.477 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1949e-05 2024-04-18T21:07:17.477 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.477 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.477 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.477 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672704+0000", 2024-04-18T21:07:17.477 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000122915 2024-04-18T21:07:17.477 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.477 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.477 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:17.477 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672714+0000", 2024-04-18T21:07:17.477 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0698e-05 2024-04-18T21:07:17.477 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.477 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.478 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.478 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.910993+0000", 2024-04-18T21:07:17.478 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.23827911199999999 2024-04-18T21:07:17.478 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.478 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.478 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:17.478 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.911017+0000", 2024-04-18T21:07:17.478 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3419999999999999e-05 2024-04-18T21:07:17.478 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.478 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.478 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.478 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.952146+0000", 2024-04-18T21:07:17.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0411288869999999 2024-04-18T21:07:17.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.479 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.479 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:17.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.952467+0000", 2024-04-18T21:07:17.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00032165399999999999 2024-04-18T21:07:17.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.479 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.479 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:17.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.954086+0000", 2024-04-18T21:07:17.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0016184820000000001 2024-04-18T21:07:17.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.479 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:17.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.960573+0000", 2024-04-18T21:07:17.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064874240000000003 2024-04-18T21:07:17.480 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:17.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.967786+0000", 2024-04-18T21:07:17.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0072125069999999999 2024-04-18T21:07:17.480 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:17.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.967897+0000", 2024-04-18T21:07:17.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111679 2024-04-18T21:07:17.481 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:17.481 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.968019+0000", 2024-04-18T21:07:17.481 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000121279 2024-04-18T21:07:17.481 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.481 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.481 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.481 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.481 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:7696 3.f 3:f376ae95:::200.00000016:head [write 3681546~512758 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:17.481 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:12.760706+0000", 2024-04-18T21:07:17.481 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.6808914279999998, 2024-04-18T21:07:17.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.24998282899999999, 2024-04-18T21:07:17.482 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:17.482 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:17.482 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:17.482 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:17.482 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.482 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:17.482 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.760706+0000", 2024-04-18T21:07:17.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.482 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.482 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.482 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:17.482 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.760706+0000", 2024-04-18T21:07:17.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.483 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.483 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.483 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:17.483 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.760710+0000", 2024-04-18T21:07:17.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2100000000000003e-06 2024-04-18T21:07:17.483 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.483 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.483 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:17.483 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.761972+0000", 2024-04-18T21:07:17.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0012615689999999999 2024-04-18T21:07:17.483 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.483 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:17.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762012+0000", 2024-04-18T21:07:17.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0145999999999998e-05 2024-04-18T21:07:17.484 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762030+0000", 2024-04-18T21:07:17.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8312999999999999e-05 2024-04-18T21:07:17.484 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762158+0000", 2024-04-18T21:07:17.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012805600000000001 2024-04-18T21:07:17.485 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:17.485 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762174+0000", 2024-04-18T21:07:17.485 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5645999999999999e-05 2024-04-18T21:07:17.485 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.485 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.926080+0000", 2024-04-18T21:07:17.485 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.16390581900000001 2024-04-18T21:07:17.485 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for missing object", 2024-04-18T21:07:17.485 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.926149+0000", 2024-04-18T21:07:17.486 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9172999999999997e-05 2024-04-18T21:07:17.486 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.486 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.486 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.486 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.002156+0000", 2024-04-18T21:07:17.486 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.076006972000000006 2024-04-18T21:07:17.486 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.486 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.486 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for rw locks", 2024-04-18T21:07:17.486 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.002294+0000", 2024-04-18T21:07:17.486 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000138011 2024-04-18T21:07:17.486 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.486 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.487 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.487 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.005436+0000", 2024-04-18T21:07:17.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031422749999999999 2024-04-18T21:07:17.487 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.487 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.487 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:17.487 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.005577+0000", 2024-04-18T21:07:17.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014105399999999999 2024-04-18T21:07:17.487 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.487 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.487 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:17.487 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.005725+0000", 2024-04-18T21:07:17.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014721100000000001 2024-04-18T21:07:17.488 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.488 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:17.488 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.009143+0000", 2024-04-18T21:07:17.488 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0034179380000000001 2024-04-18T21:07:17.488 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.488 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:17.488 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.010522+0000", 2024-04-18T21:07:17.488 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0013790919999999999 2024-04-18T21:07:17.488 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.488 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:17.488 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.010586+0000", 2024-04-18T21:07:17.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4713000000000002e-05 2024-04-18T21:07:17.489 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.489 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:17.489 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.010689+0000", 2024-04-18T21:07:17.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000102631 2024-04-18T21:07:17.489 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.489 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.489 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.489 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.489 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:7697 3.16 3:6b6b4f13:::200.0000001c:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:17.490 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:12.762074+0000", 2024-04-18T21:07:17.490 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.6795232799999997, 2024-04-18T21:07:17.490 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.2056489, 2024-04-18T21:07:17.490 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:17.490 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:17.490 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:07:17.490 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:17.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.490 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:17.490 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762074+0000", 2024-04-18T21:07:17.490 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.490 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.491 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:17.491 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762074+0000", 2024-04-18T21:07:17.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.491 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.491 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.491 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:17.491 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762076+0000", 2024-04-18T21:07:17.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.793e-06 2024-04-18T21:07:17.491 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.491 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.491 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:17.491 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762083+0000", 2024-04-18T21:07:17.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7129999999999999e-06 2024-04-18T21:07:17.491 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:17.492 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762104+0000", 2024-04-18T21:07:17.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1480000000000001e-05 2024-04-18T21:07:17.492 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.492 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762121+0000", 2024-04-18T21:07:17.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.632e-05 2024-04-18T21:07:17.492 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.492 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762224+0000", 2024-04-18T21:07:17.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010346800000000001 2024-04-18T21:07:17.493 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.493 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.493 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:17.493 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762238+0000", 2024-04-18T21:07:17.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3482999999999999e-05 2024-04-18T21:07:17.493 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.493 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.493 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.493 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.946932+0000", 2024-04-18T21:07:17.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.18469451000000001 2024-04-18T21:07:17.493 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.493 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.493 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:17.494 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.947261+0000", 2024-04-18T21:07:17.494 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00032857399999999999 2024-04-18T21:07:17.494 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.494 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.494 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:17.494 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.967723+0000", 2024-04-18T21:07:17.494 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020462559000000002 2024-04-18T21:07:17.494 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.494 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.494 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.494 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.494 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.494 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:10831 4.13 4:c948684f:::1000000032e.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:17.495 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.823266+0000", 2024-04-18T21:07:17.495 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 1.618331891, 2024-04-18T21:07:17.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.65275881599999996, 2024-04-18T21:07:17.495 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:17.495 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:17.495 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:17.495 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:17.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.495 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:17.495 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823266+0000", 2024-04-18T21:07:17.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.495 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.495 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:17.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823266+0000", 2024-04-18T21:07:17.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:17.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823266+0000", 2024-04-18T21:07:17.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9800000000000004e-07 2024-04-18T21:07:17.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:17.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823269+0000", 2024-04-18T21:07:17.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3259999999999998e-06 2024-04-18T21:07:17.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.497 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:17.497 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823274+0000", 2024-04-18T21:07:17.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9830000000000001e-06 2024-04-18T21:07:17.497 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.497 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.497 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823280+0000", 2024-04-18T21:07:17.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1540000000000001e-06 2024-04-18T21:07:17.497 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.497 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.497 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823313+0000", 2024-04-18T21:07:17.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3667000000000001e-05 2024-04-18T21:07:17.497 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.498 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:17.498 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823321+0000", 2024-04-18T21:07:17.498 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1200000000000002e-06 2024-04-18T21:07:17.498 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.498 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.498 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.498 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.470069+0000", 2024-04-18T21:07:17.498 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.64674728999999997 2024-04-18T21:07:17.498 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.498 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.498 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:17.498 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.470457+0000", 2024-04-18T21:07:17.498 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00038800899999999998 2024-04-18T21:07:17.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:17.499 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.470755+0000", 2024-04-18T21:07:17.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00029781399999999998 2024-04-18T21:07:17.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:17.499 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.474041+0000", 2024-04-18T21:07:17.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032860670000000002 2024-04-18T21:07:17.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:17.500 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.475621+0000", 2024-04-18T21:07:17.500 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001579925 2024-04-18T21:07:17.500 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.500 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:17.500 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.475750+0000", 2024-04-18T21:07:17.500 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000129002 2024-04-18T21:07:17.500 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.500 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:17.500 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.476024+0000", 2024-04-18T21:07:17.500 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000274961 2024-04-18T21:07:17.500 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.500 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.501 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.501 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.501 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.501 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11326 4.13 4:cbbbc9f0:::100000010c6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:17.501 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.917113+0000", 2024-04-18T21:07:17.501 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 1.5244846889999999, 2024-04-18T21:07:17.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.56159817899999998, 2024-04-18T21:07:17.501 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:17.501 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:17.501 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:17.501 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:17.501 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.501 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:17.501 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917113+0000", 2024-04-18T21:07:17.502 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.502 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.502 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.502 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:17.502 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917113+0000", 2024-04-18T21:07:17.502 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.502 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.502 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.502 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:17.502 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917114+0000", 2024-04-18T21:07:17.502 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5099999999999999e-07 2024-04-18T21:07:17.502 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:17.503 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917123+0000", 2024-04-18T21:07:17.503 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5859999999999994e-06 2024-04-18T21:07:17.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:17.503 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917130+0000", 2024-04-18T21:07:17.503 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9800000000000001e-06 2024-04-18T21:07:17.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.503 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917136+0000", 2024-04-18T21:07:17.503 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.502e-06 2024-04-18T21:07:17.504 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.504 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.504 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917239+0000", 2024-04-18T21:07:17.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000103286 2024-04-18T21:07:17.504 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.504 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:17.504 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917247+0000", 2024-04-18T21:07:17.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.49e-06 2024-04-18T21:07:17.504 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.504 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.505 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.472462+0000", 2024-04-18T21:07:17.505 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.55521418899999997 2024-04-18T21:07:17.505 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.505 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.505 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:17.505 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.472801+0000", 2024-04-18T21:07:17.505 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00033935600000000002 2024-04-18T21:07:17.505 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.505 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.505 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:17.505 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.473101+0000", 2024-04-18T21:07:17.505 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030031399999999998 2024-04-18T21:07:17.506 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.506 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.506 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:17.506 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.475574+0000", 2024-04-18T21:07:17.506 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0024732310000000002 2024-04-18T21:07:17.506 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.506 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.506 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:17.506 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.478287+0000", 2024-04-18T21:07:17.506 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027122349999999999 2024-04-18T21:07:17.507 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.507 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.507 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:17.507 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.478467+0000", 2024-04-18T21:07:17.507 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000180645 2024-04-18T21:07:17.507 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.507 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.507 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:17.507 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.478711+0000", 2024-04-18T21:07:17.507 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024371399999999999 2024-04-18T21:07:17.508 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.508 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.508 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.508 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.508 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.508 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11394 4.13 4:cb2e645e:::10000001109.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:17.508 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.925453+0000", 2024-04-18T21:07:17.508 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 1.5161441660000001, 2024-04-18T21:07:17.508 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.55363756900000005, 2024-04-18T21:07:17.508 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:17.508 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:17.508 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:17.509 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:17.509 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.509 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:17.509 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925453+0000", 2024-04-18T21:07:17.509 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.509 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.509 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.509 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:17.509 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925453+0000", 2024-04-18T21:07:17.509 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.509 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.509 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.509 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:17.509 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925454+0000", 2024-04-18T21:07:17.510 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1699999999999997e-07 2024-04-18T21:07:17.510 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.510 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.510 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:17.510 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925458+0000", 2024-04-18T21:07:17.510 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7280000000000001e-06 2024-04-18T21:07:17.510 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.510 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.510 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:17.510 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925467+0000", 2024-04-18T21:07:17.510 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7169999999999997e-06 2024-04-18T21:07:17.510 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.510 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.511 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.511 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925474+0000", 2024-04-18T21:07:17.511 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1350000000000003e-06 2024-04-18T21:07:17.511 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.511 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.511 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.511 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925523+0000", 2024-04-18T21:07:17.511 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9616000000000001e-05 2024-04-18T21:07:17.511 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.511 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.511 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:17.511 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925530+0000", 2024-04-18T21:07:17.511 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0099999999999998e-06 2024-04-18T21:07:17.511 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.512 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.512 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.512 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.474474+0000", 2024-04-18T21:07:17.512 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.548943242 2024-04-18T21:07:17.512 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.512 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.512 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:17.512 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.474692+0000", 2024-04-18T21:07:17.512 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00021829799999999999 2024-04-18T21:07:17.512 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.512 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.512 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:17.512 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.474879+0000", 2024-04-18T21:07:17.513 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000187095 2024-04-18T21:07:17.513 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.513 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.513 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:17.513 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.478733+0000", 2024-04-18T21:07:17.513 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003853871 2024-04-18T21:07:17.513 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.513 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.513 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:17.513 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.478840+0000", 2024-04-18T21:07:17.513 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000106623 2024-04-18T21:07:17.513 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.513 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.513 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:17.514 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.478919+0000", 2024-04-18T21:07:17.514 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9326000000000006e-05 2024-04-18T21:07:17.514 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.514 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.514 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:17.514 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479091+0000", 2024-04-18T21:07:17.514 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000172091 2024-04-18T21:07:17.514 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.514 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.514 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.515 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.515 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.515 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11417 4.13 4:cae4f303:::1000000111f.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:17.515 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.927998+0000", 2024-04-18T21:07:17.515 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 1.5135995260000001, 2024-04-18T21:07:17.515 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.55142600900000005, 2024-04-18T21:07:17.515 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:17.515 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:17.515 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:17.515 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:17.516 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.516 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:17.516 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.927998+0000", 2024-04-18T21:07:17.516 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.516 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.516 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.516 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:17.516 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.927998+0000", 2024-04-18T21:07:17.516 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.516 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.517 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.517 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:17.517 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.927999+0000", 2024-04-18T21:07:17.517 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2800000000000005e-07 2024-04-18T21:07:17.517 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.517 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.517 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:17.517 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.928003+0000", 2024-04-18T21:07:17.517 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0060000000000003e-06 2024-04-18T21:07:17.517 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.517 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.518 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:17.518 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.928012+0000", 2024-04-18T21:07:17.518 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.4129999999999995e-06 2024-04-18T21:07:17.518 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.518 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.518 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.518 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.928019+0000", 2024-04-18T21:07:17.518 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5590000000000002e-06 2024-04-18T21:07:17.518 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.518 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.518 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.518 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.928075+0000", 2024-04-18T21:07:17.519 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5927000000000002e-05 2024-04-18T21:07:17.519 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.519 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.519 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:17.519 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.928091+0000", 2024-04-18T21:07:17.519 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5724999999999999e-05 2024-04-18T21:07:17.519 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.519 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.519 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.519 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.476117+0000", 2024-04-18T21:07:17.519 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.54802609899999999 2024-04-18T21:07:17.519 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.519 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.520 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:17.520 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.476310+0000", 2024-04-18T21:07:17.520 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019318100000000001 2024-04-18T21:07:17.520 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.520 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.520 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:17.520 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.476469+0000", 2024-04-18T21:07:17.520 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015902599999999999 2024-04-18T21:07:17.520 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.520 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.520 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:17.520 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479198+0000", 2024-04-18T21:07:17.520 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027292010000000001 2024-04-18T21:07:17.521 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.521 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.521 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:17.521 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479225+0000", 2024-04-18T21:07:17.521 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6483e-05 2024-04-18T21:07:17.521 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.521 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.521 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:17.521 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479301+0000", 2024-04-18T21:07:17.521 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5935999999999999e-05 2024-04-18T21:07:17.521 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.521 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.521 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:17.521 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479424+0000", 2024-04-18T21:07:17.522 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012352500000000001 2024-04-18T21:07:17.522 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.522 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.522 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.522 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.522 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.522 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11538 4.13 4:ca7a7383:::10000001196.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:17.522 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.942641+0000", 2024-04-18T21:07:17.522 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 1.4989568449999999, 2024-04-18T21:07:17.522 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.538204715, 2024-04-18T21:07:17.522 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:17.522 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:17.522 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:17.522 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:17.523 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.523 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:17.523 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942641+0000", 2024-04-18T21:07:17.523 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.523 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.523 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.523 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:17.523 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942641+0000", 2024-04-18T21:07:17.523 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.523 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.523 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.523 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:17.523 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942641+0000", 2024-04-18T21:07:17.523 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4099999999999998e-07 2024-04-18T21:07:17.524 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.524 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.524 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:17.524 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942645+0000", 2024-04-18T21:07:17.524 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.788e-06 2024-04-18T21:07:17.524 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.524 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.524 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:17.524 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942654+0000", 2024-04-18T21:07:17.524 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2089999999999994e-06 2024-04-18T21:07:17.524 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.524 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.524 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.524 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942668+0000", 2024-04-18T21:07:17.524 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3925e-05 2024-04-18T21:07:17.525 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.525 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.525 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.525 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942898+0000", 2024-04-18T21:07:17.525 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00022961800000000001 2024-04-18T21:07:17.525 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.525 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.525 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:17.525 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942907+0000", 2024-04-18T21:07:17.525 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6219999999999998e-06 2024-04-18T21:07:17.525 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.525 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.525 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.525 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.477120+0000", 2024-04-18T21:07:17.525 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.53421297400000001 2024-04-18T21:07:17.526 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.526 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.526 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:17.526 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.477466+0000", 2024-04-18T21:07:17.526 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00034685899999999998 2024-04-18T21:07:17.526 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.526 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.526 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:17.526 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.477717+0000", 2024-04-18T21:07:17.526 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00025019799999999998 2024-04-18T21:07:17.526 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.526 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.526 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:17.527 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479518+0000", 2024-04-18T21:07:17.527 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00180105 2024-04-18T21:07:17.527 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.527 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.527 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:17.527 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.480481+0000", 2024-04-18T21:07:17.527 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00096356100000000004 2024-04-18T21:07:17.527 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.527 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.527 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:17.527 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.480618+0000", 2024-04-18T21:07:17.527 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013678599999999999 2024-04-18T21:07:17.527 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.527 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.528 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:17.528 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.480845+0000", 2024-04-18T21:07:17.528 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00022738399999999999 2024-04-18T21:07:17.528 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.528 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.528 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.528 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.528 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.528 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11574 4.13 4:c9cea989:::100000011b9.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:17.528 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.947550+0000", 2024-04-18T21:07:17.528 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 1.4940471040000001, 2024-04-18T21:07:17.529 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.53632730500000003, 2024-04-18T21:07:17.529 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:17.529 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:17.529 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:17.529 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:17.529 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.529 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:17.529 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947550+0000", 2024-04-18T21:07:17.529 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.529 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.529 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.529 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:17.530 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947550+0000", 2024-04-18T21:07:17.530 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.530 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.530 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.530 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:17.530 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947551+0000", 2024-04-18T21:07:17.530 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6599999999999996e-07 2024-04-18T21:07:17.530 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.530 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.530 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:17.530 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947554+0000", 2024-04-18T21:07:17.530 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6230000000000001e-06 2024-04-18T21:07:17.531 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.531 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.531 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:17.531 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947562+0000", 2024-04-18T21:07:17.531 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2179999999999999e-06 2024-04-18T21:07:17.531 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.531 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.531 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.531 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947567+0000", 2024-04-18T21:07:17.531 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3009999999999997e-06 2024-04-18T21:07:17.532 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.532 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.532 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.532 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947624+0000", 2024-04-18T21:07:17.532 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6823999999999997e-05 2024-04-18T21:07:17.532 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.532 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.532 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:17.532 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947633+0000", 2024-04-18T21:07:17.532 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9330000000000007e-06 2024-04-18T21:07:17.532 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.532 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.532 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.533 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479591+0000", 2024-04-18T21:07:17.533 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.53195765500000003 2024-04-18T21:07:17.533 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.533 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.533 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:17.533 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479781+0000", 2024-04-18T21:07:17.533 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000190034 2024-04-18T21:07:17.533 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.533 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.533 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:17.533 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479936+0000", 2024-04-18T21:07:17.533 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000154959 2024-04-18T21:07:17.533 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.533 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.533 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:17.534 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.483428+0000", 2024-04-18T21:07:17.534 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003492294 2024-04-18T21:07:17.534 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.534 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.534 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:17.534 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.483479+0000", 2024-04-18T21:07:17.534 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0868999999999997e-05 2024-04-18T21:07:17.534 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.534 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.534 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:17.534 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.483594+0000", 2024-04-18T21:07:17.534 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000115499 2024-04-18T21:07:17.535 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.535 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.535 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:17.535 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.483878+0000", 2024-04-18T21:07:17.535 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028352999999999999 2024-04-18T21:07:17.535 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.535 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.535 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.535 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.535 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.535 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11596 4.13 4:c88ce457:::100000011ce.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:17.535 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.955066+0000", 2024-04-18T21:07:17.535 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 1.486531695, 2024-04-18T21:07:17.535 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.52924763200000002, 2024-04-18T21:07:17.535 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:17.536 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:17.536 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:17.536 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:17.536 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.536 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:17.536 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955066+0000", 2024-04-18T21:07:17.536 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.536 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.536 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.536 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:17.536 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955066+0000", 2024-04-18T21:07:17.536 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.536 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.537 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.537 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:17.537 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955066+0000", 2024-04-18T21:07:17.537 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4900000000000001e-07 2024-04-18T21:07:17.537 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.537 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.537 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:17.537 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955068+0000", 2024-04-18T21:07:17.537 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0190000000000001e-06 2024-04-18T21:07:17.537 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.537 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.537 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:17.537 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955076+0000", 2024-04-18T21:07:17.538 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.537e-06 2024-04-18T21:07:17.538 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.538 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.538 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.538 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955080+0000", 2024-04-18T21:07:17.538 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1760000000000003e-06 2024-04-18T21:07:17.538 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.538 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.538 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.538 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955129+0000", 2024-04-18T21:07:17.538 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8480999999999999e-05 2024-04-18T21:07:17.538 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.539 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.539 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:17.539 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955134+0000", 2024-04-18T21:07:17.539 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1610000000000002e-06 2024-04-18T21:07:17.539 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.539 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.539 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.539 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.480932+0000", 2024-04-18T21:07:17.539 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.52579809799999999 2024-04-18T21:07:17.539 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.539 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.539 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:17.539 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.481149+0000", 2024-04-18T21:07:17.539 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00021709100000000001 2024-04-18T21:07:17.540 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.540 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.540 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:17.540 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.481303+0000", 2024-04-18T21:07:17.540 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000153752 2024-04-18T21:07:17.540 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.540 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.540 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:17.540 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.483927+0000", 2024-04-18T21:07:17.540 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026241189999999998 2024-04-18T21:07:17.540 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.540 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.540 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:17.540 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.484028+0000", 2024-04-18T21:07:17.540 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010134899999999999 2024-04-18T21:07:17.540 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.541 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.541 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:17.541 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.484138+0000", 2024-04-18T21:07:17.541 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011015599999999999 2024-04-18T21:07:17.541 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.541 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.541 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:17.541 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.484314+0000", 2024-04-18T21:07:17.541 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017524399999999999 2024-04-18T21:07:17.541 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.541 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.541 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.541 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.541 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.541 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11800 4.13 4:cacc00c7:::10000001296.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:17.541 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.989042+0000", 2024-04-18T21:07:17.542 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 1.452556027, 2024-04-18T21:07:17.542 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.49832004299999999, 2024-04-18T21:07:17.542 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:17.542 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:17.542 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:17.542 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:17.542 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.542 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:17.542 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989042+0000", 2024-04-18T21:07:17.542 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.542 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.542 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.542 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:17.542 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989042+0000", 2024-04-18T21:07:17.543 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.543 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.543 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.543 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:17.543 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989042+0000", 2024-04-18T21:07:17.543 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5200000000000002e-07 2024-04-18T21:07:17.543 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.543 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.543 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:17.543 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989044+0000", 2024-04-18T21:07:17.543 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2589999999999999e-06 2024-04-18T21:07:17.543 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.543 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.543 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:17.543 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989051+0000", 2024-04-18T21:07:17.544 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6340000000000003e-06 2024-04-18T21:07:17.544 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.544 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.544 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.544 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989062+0000", 2024-04-18T21:07:17.544 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1043000000000001e-05 2024-04-18T21:07:17.544 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.544 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.544 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.544 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989367+0000", 2024-04-18T21:07:17.544 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000305249 2024-04-18T21:07:17.544 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.544 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.544 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:17.544 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989376+0000", 2024-04-18T21:07:17.544 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4570000000000005e-06 2024-04-18T21:07:17.545 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.545 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.545 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.545 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.482011+0000", 2024-04-18T21:07:17.545 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.49263514200000003 2024-04-18T21:07:17.545 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.545 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.545 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:17.545 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.482397+0000", 2024-04-18T21:07:17.545 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000385986 2024-04-18T21:07:17.545 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.545 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.545 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:17.545 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.482689+0000", 2024-04-18T21:07:17.545 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00029179800000000001 2024-04-18T21:07:17.546 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.546 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.546 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:17.546 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.487008+0000", 2024-04-18T21:07:17.546 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043196129999999999 2024-04-18T21:07:17.546 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.546 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.546 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:17.546 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.487113+0000", 2024-04-18T21:07:17.546 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010498899999999999 2024-04-18T21:07:17.546 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.546 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.546 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:17.547 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.487192+0000", 2024-04-18T21:07:17.547 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8778999999999999e-05 2024-04-18T21:07:17.547 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.547 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.547 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:17.547 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.487362+0000", 2024-04-18T21:07:17.547 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016964200000000001 2024-04-18T21:07:17.547 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.547 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.547 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.547 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.547 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.547 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11888 4.13 4:ca460221:::10000002cd3.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:17.548 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:16.002068+0000", 2024-04-18T21:07:17.548 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 1.439529367, 2024-04-18T21:07:17.548 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.48938242199999998, 2024-04-18T21:07:17.548 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:17.548 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:17.548 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:17.548 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:17.548 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.548 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:17.548 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002068+0000", 2024-04-18T21:07:17.548 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.548 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.548 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.549 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:17.549 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002068+0000", 2024-04-18T21:07:17.549 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.549 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.549 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.549 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:17.549 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002069+0000", 2024-04-18T21:07:17.549 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7899999999999999e-07 2024-04-18T21:07:17.549 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.549 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.549 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:17.549 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002071+0000", 2024-04-18T21:07:17.549 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.356e-06 2024-04-18T21:07:17.549 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.550 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.550 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:17.550 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002078+0000", 2024-04-18T21:07:17.550 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.562e-06 2024-04-18T21:07:17.550 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.550 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.550 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.550 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002083+0000", 2024-04-18T21:07:17.550 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1939999999999997e-06 2024-04-18T21:07:17.550 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.550 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.550 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.550 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002125+0000", 2024-04-18T21:07:17.550 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2548e-05 2024-04-18T21:07:17.551 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.551 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.551 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:17.551 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002132+0000", 2024-04-18T21:07:17.551 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9360000000000002e-06 2024-04-18T21:07:17.551 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.551 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.551 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.551 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.484392+0000", 2024-04-18T21:07:17.551 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.48225933500000001 2024-04-18T21:07:17.551 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.551 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.551 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:17.551 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.484630+0000", 2024-04-18T21:07:17.552 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023872499999999999 2024-04-18T21:07:17.552 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.552 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.552 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:17.552 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.484812+0000", 2024-04-18T21:07:17.552 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000181232 2024-04-18T21:07:17.552 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.552 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.552 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:17.552 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.490995+0000", 2024-04-18T21:07:17.552 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0061831459999999996 2024-04-18T21:07:17.552 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.552 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.552 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:17.553 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491132+0000", 2024-04-18T21:07:17.553 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000137145 2024-04-18T21:07:17.553 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.553 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.553 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:17.553 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491219+0000", 2024-04-18T21:07:17.553 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7466000000000006e-05 2024-04-18T21:07:17.553 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.553 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.553 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:17.553 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491451+0000", 2024-04-18T21:07:17.553 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023129800000000001 2024-04-18T21:07:17.554 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.554 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.554 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.554 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.554 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.554 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:12057 4.13 4:cacbe4c4:::10000002d77.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:17.554 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:16.028144+0000", 2024-04-18T21:07:17.554 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 1.413453756, 2024-04-18T21:07:17.554 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.46365036100000001, 2024-04-18T21:07:17.554 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:17.554 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:17.554 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:17.554 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:17.554 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.555 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:17.555 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028144+0000", 2024-04-18T21:07:17.555 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.555 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.555 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.555 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:17.555 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028144+0000", 2024-04-18T21:07:17.555 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.555 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.555 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.555 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:17.555 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028144+0000", 2024-04-18T21:07:17.555 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9800000000000003e-07 2024-04-18T21:07:17.555 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.555 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.556 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:17.556 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028147+0000", 2024-04-18T21:07:17.556 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.773e-06 2024-04-18T21:07:17.556 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.556 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.556 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:17.556 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028154+0000", 2024-04-18T21:07:17.556 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8940000000000004e-06 2024-04-18T21:07:17.556 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.556 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.556 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.556 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028160+0000", 2024-04-18T21:07:17.556 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7219999999999996e-06 2024-04-18T21:07:17.556 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.557 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.557 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.557 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028227+0000", 2024-04-18T21:07:17.557 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6711000000000006e-05 2024-04-18T21:07:17.557 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.557 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.557 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:17.557 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028250+0000", 2024-04-18T21:07:17.557 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3010000000000002e-05 2024-04-18T21:07:17.557 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.557 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.557 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.557 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.487484+0000", 2024-04-18T21:07:17.557 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.45923466600000001 2024-04-18T21:07:17.558 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.558 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.558 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:17.558 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.487750+0000", 2024-04-18T21:07:17.558 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026618799999999999 2024-04-18T21:07:17.558 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.558 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.558 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:17.558 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.487915+0000", 2024-04-18T21:07:17.558 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016425500000000001 2024-04-18T21:07:17.558 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.558 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.558 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:17.558 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491559+0000", 2024-04-18T21:07:17.559 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003644109 2024-04-18T21:07:17.559 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.559 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.559 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:17.559 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491586+0000", 2024-04-18T21:07:17.559 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.743e-05 2024-04-18T21:07:17.559 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.559 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.559 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:17.559 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491662+0000", 2024-04-18T21:07:17.559 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5978999999999999e-05 2024-04-18T21:07:17.559 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.559 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.560 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:17.560 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491794+0000", 2024-04-18T21:07:17.560 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013202600000000001 2024-04-18T21:07:17.560 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.560 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.560 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.560 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.560 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.560 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:12078 4.13 4:c93107e9:::10000002d8c.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:17.560 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:16.031090+0000", 2024-04-18T21:07:17.560 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 1.4105078899999999, 2024-04-18T21:07:17.560 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.461078355, 2024-04-18T21:07:17.561 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:17.561 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:17.561 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:17.561 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:17.561 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.561 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:17.561 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031090+0000", 2024-04-18T21:07:17.561 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.561 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.561 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.561 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:17.561 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031090+0000", 2024-04-18T21:07:17.561 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.562 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.562 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.562 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:17.562 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031090+0000", 2024-04-18T21:07:17.562 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6599999999999996e-07 2024-04-18T21:07:17.562 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.562 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.562 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:17.562 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031093+0000", 2024-04-18T21:07:17.562 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7659999999999999e-06 2024-04-18T21:07:17.562 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.562 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.562 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:17.563 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031099+0000", 2024-04-18T21:07:17.563 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2269999999999998e-06 2024-04-18T21:07:17.563 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.563 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.563 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.563 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031103+0000", 2024-04-18T21:07:17.563 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7929999999999999e-06 2024-04-18T21:07:17.563 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.563 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.563 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.563 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031147+0000", 2024-04-18T21:07:17.563 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3742000000000002e-05 2024-04-18T21:07:17.563 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.563 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.564 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:17.564 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031154+0000", 2024-04-18T21:07:17.564 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1999999999999997e-06 2024-04-18T21:07:17.564 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.564 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.564 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.564 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.488743+0000", 2024-04-18T21:07:17.564 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.45758900200000002 2024-04-18T21:07:17.564 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.564 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.564 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:17.564 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.488980+0000", 2024-04-18T21:07:17.564 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023704499999999999 2024-04-18T21:07:17.565 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.565 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.565 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:17.565 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.489166+0000", 2024-04-18T21:07:17.565 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018544500000000001 2024-04-18T21:07:17.565 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.565 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.565 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:17.565 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491810+0000", 2024-04-18T21:07:17.565 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026448219999999998 2024-04-18T21:07:17.565 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.565 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.565 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:17.565 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491903+0000", 2024-04-18T21:07:17.566 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2305999999999993e-05 2024-04-18T21:07:17.566 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.566 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.566 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:17.566 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491987+0000", 2024-04-18T21:07:17.566 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4581999999999998e-05 2024-04-18T21:07:17.566 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.566 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.566 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:17.566 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.492168+0000", 2024-04-18T21:07:17.566 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018075900000000001 2024-04-18T21:07:17.566 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.566 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.566 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.566 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.567 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.567 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:12081 4.13 4:cafa1dfa:::10000002d8f.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:17.567 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:16.031865+0000", 2024-04-18T21:07:17.567 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 1.409732856, 2024-04-18T21:07:17.567 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.460588628, 2024-04-18T21:07:17.567 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:17.567 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:17.567 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:17.567 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:17.567 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.567 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:17.567 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031865+0000", 2024-04-18T21:07:17.567 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.567 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.568 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.568 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:17.568 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031865+0000", 2024-04-18T21:07:17.568 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:17.568 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.568 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.568 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:17.568 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031865+0000", 2024-04-18T21:07:17.568 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4799999999999998e-07 2024-04-18T21:07:17.568 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.568 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.568 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:17.568 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031868+0000", 2024-04-18T21:07:17.568 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6570000000000001e-06 2024-04-18T21:07:17.568 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.569 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.569 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:17.569 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031874+0000", 2024-04-18T21:07:17.569 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4370000000000004e-06 2024-04-18T21:07:17.569 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.569 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.569 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.569 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031879+0000", 2024-04-18T21:07:17.569 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8729999999999998e-06 2024-04-18T21:07:17.569 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.569 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.569 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.569 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031924+0000", 2024-04-18T21:07:17.569 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4314999999999998e-05 2024-04-18T21:07:17.570 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.570 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.570 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:17.570 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031929+0000", 2024-04-18T21:07:17.570 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9980000000000003e-06 2024-04-18T21:07:17.570 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.570 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.570 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:17.570 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.489813+0000", 2024-04-18T21:07:17.570 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.45788481800000003 2024-04-18T21:07:17.570 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.570 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.570 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:17.570 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.490188+0000", 2024-04-18T21:07:17.571 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00037420699999999999 2024-04-18T21:07:17.571 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.571 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.571 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:17.571 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.490423+0000", 2024-04-18T21:07:17.571 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023582400000000001 2024-04-18T21:07:17.571 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.571 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.571 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:17.571 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.492238+0000", 2024-04-18T21:07:17.571 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018143930000000001 2024-04-18T21:07:17.571 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.571 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.571 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:17.572 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.492256+0000", 2024-04-18T21:07:17.572 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7706999999999998e-05 2024-04-18T21:07:17.572 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.572 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.572 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:17.572 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.492323+0000", 2024-04-18T21:07:17.572 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7222000000000001e-05 2024-04-18T21:07:17.572 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:17.572 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:17.572 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:17.572 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.492453+0000", 2024-04-18T21:07:17.572 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000130529 2024-04-18T21:07:17.572 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.572 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.572 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.572 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:17.573 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:17.573 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:07:17.574 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:07:17.575 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:17.573+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:17.675 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:17.674+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:17.711 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:07:17.711 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [ 2024-04-18T21:07:17.711 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:17.711 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_repop(mds.0.3:13910 3.19 e68/63 3:9d0ed013:::200.0000001b:head v 68'116, mlcod=68'114)", 2024-04-18T21:07:17.711 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:17.712871+0000", 2024-04-18T21:07:17.711 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.0011174080000000001, 2024-04-18T21:07:17.711 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001154714, 2024-04-18T21:07:17.711 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:17.712 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:17.712 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:07:17.712 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:17.712 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:17.712 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:17.712 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:17.712871+0000", 2024-04-18T21:07:17.712 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:17.712 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:17.712 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:17.712 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:17.712 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:17.712871+0000", 2024-04-18T21:07:17.712 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:17.712 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:17.713 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:17.713 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:17.713 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:17.712873+0000", 2024-04-18T21:07:17.713 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1399999999999998e-06 2024-04-18T21:07:17.713 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:17.713 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:17.713 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:17.713 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:17.712906+0000", 2024-04-18T21:07:17.713 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.2638999999999997e-05 2024-04-18T21:07:17.713 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:17.713 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:17.713 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:17.713 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:17.712933+0000", 2024-04-18T21:07:17.713 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.6749000000000001e-05 2024-04-18T21:07:17.714 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:17.714 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:17.714 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:17.714 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:17.712946+0000", 2024-04-18T21:07:17.714 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.313e-05 2024-04-18T21:07:17.714 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:17.714 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:17.714 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:17.714 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:17.713015+0000", 2024-04-18T21:07:17.714 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.9416000000000001e-05 2024-04-18T21:07:17.714 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:17.714 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:17.714 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:17.714 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:17.713038+0000", 2024-04-18T21:07:17.714 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.2719999999999999e-05 2024-04-18T21:07:17.715 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:17.715 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:17.715 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:17.715 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:17.715 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2024-04-18T21:07:17.715 INFO:teuthology.orchestra.run.smithi132.stdout: "num_ops": 1 2024-04-18T21:07:17.715 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:07:17.725 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:07:17.776 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:17.774+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:17.821 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:07:17.876 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:17.877+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:17.884 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:07:17.884 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:07:17.884 INFO:teuthology.orchestra.run.smithi132.stdout: "complaint_time": 30, 2024-04-18T21:07:17.884 INFO:teuthology.orchestra.run.smithi132.stdout: "num_blocked_ops": 0 2024-04-18T21:07:17.884 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:07:17.898 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:07:17.961 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:07:17.962 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:07:17.962 INFO:teuthology.orchestra.run.smithi078.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-18T21:07:17.977 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:17.978+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:17.985 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:07:17.985 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:07:17.988 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-18T21:07:17.988 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-18T21:07:18.064 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:18.064 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:18.077 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:18.077+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:18.079 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:07:18.179 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:18.181+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:18.213 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:18.213 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:18.227 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:07:18.280 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:18.281+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:18.356 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:18.357 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:18.371 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:18.381 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:18.381+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:18.455 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-18T21:07:18.482 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:18.482+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:18.499 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:18.499 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:18.514 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:07:18.583 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:18.585+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:18.645 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:18.645 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:18.659 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:07:18.703 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:18.705+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:18.786 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:18.785+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:18.841 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:18.841 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:18.863 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:07:18.907 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:18.909+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:18.987 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:18.986+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:19.024 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:19.024 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:19.038 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:07:19.088 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:19.089+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:19.170 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:19.170 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:19.184 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:07:19.229 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:19.230+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:19.289 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:19.286+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:19.307 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:19.307 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:19.322 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:19.390 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:19.389+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:19.454 INFO:teuthology.orchestra.run.smithi078.stderr:nodeep-scrub is unset 2024-04-18T21:07:19.491 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:19.493+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:19.495 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:19.495 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:19.510 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:07:19.591 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:19.590+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:19.644 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:19.644 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:19.659 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:07:19.693 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:19.690+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:19.789 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:19.789 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:19.794 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:19.793+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:19.809 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:07:19.895 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:19.894+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:19.989 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:07:19.995 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:19.997+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:20.000 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:20.000 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:20.015 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:07:20.096 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:20.094+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:20.132 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:20.132 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:20.146 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:07:20.149 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:07:20.149 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:07:20.149 INFO:teuthology.orchestra.run.smithi078.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-18T21:07:20.170 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:07:20.171 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:07:20.173 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-18T21:07:20.174 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-18T21:07:20.197 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:20.197+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:20.298 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:20.298+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:20.308 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:07:20.308 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:07:20.308 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-18T21:07:20.308 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-18T21:07:20.308 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:07:20.323 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:20.413 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:20.414+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:20.500 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:20.501+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:20.505 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:07:20.505 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-18T21:07:20.505 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-18T21:07:20.505 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:07:20.506 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.506 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:108 3.1f 3:f83d65d8:::200.00000004:head [write 326287~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:20.506 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:07:20.506 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 34.745040975999999, 2024-04-18T21:07:20.506 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056616183, 2024-04-18T21:07:20.506 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:20.507 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:20.507 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.507 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:20.507 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.507 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:20.507 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:07:20.507 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:20.507 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.507 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.508 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:20.508 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:07:20.508 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:20.508 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.508 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.508 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:20.508 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758084+0000", 2024-04-18T21:07:20.508 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.124e-06 2024-04-18T21:07:20.508 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.508 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.508 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:20.508 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758100+0000", 2024-04-18T21:07:20.508 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6246e-05 2024-04-18T21:07:20.509 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.509 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.509 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:20.509 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758118+0000", 2024-04-18T21:07:20.509 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8267e-05 2024-04-18T21:07:20.509 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.509 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.509 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.509 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758134+0000", 2024-04-18T21:07:20.509 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5950000000000001e-05 2024-04-18T21:07:20.509 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.509 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.509 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:20.510 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803949+0000", 2024-04-18T21:07:20.510 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045815349999999998 2024-04-18T21:07:20.510 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.510 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.510 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:20.510 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804011+0000", 2024-04-18T21:07:20.510 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1044999999999996e-05 2024-04-18T21:07:20.510 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.510 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.510 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:20.510 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804128+0000", 2024-04-18T21:07:20.510 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117148 2024-04-18T21:07:20.510 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.511 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.511 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:20.511 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806794+0000", 2024-04-18T21:07:20.511 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002666692 2024-04-18T21:07:20.511 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.511 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.511 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:20.511 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814645+0000", 2024-04-18T21:07:20.511 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0078508880000000003 2024-04-18T21:07:20.511 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.512 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.512 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:20.512 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814678+0000", 2024-04-18T21:07:20.512 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3188999999999997e-05 2024-04-18T21:07:20.512 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.512 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.513 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:20.513 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814699+0000", 2024-04-18T21:07:20.513 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0284000000000001e-05 2024-04-18T21:07:20.513 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:20.513 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:20.513 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:20.513 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.513 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.513 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:109 3.1f 3:f83d65d8:::200.00000004:head [write 327693~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:20.513 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:07:20.514 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 34.744971608999997, 2024-04-18T21:07:20.514 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056621036999999999, 2024-04-18T21:07:20.514 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:20.514 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:20.514 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.514 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:20.514 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.514 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:20.514 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:07:20.514 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:20.514 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.514 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.514 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:20.514 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:07:20.515 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:20.515 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.515 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.515 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:20.515 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758153+0000", 2024-04-18T21:07:20.515 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1459999999999999e-06 2024-04-18T21:07:20.515 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.515 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.515 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:20.515 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758161+0000", 2024-04-18T21:07:20.515 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7999999999999999e-06 2024-04-18T21:07:20.515 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.515 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.515 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:20.516 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758179+0000", 2024-04-18T21:07:20.516 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7949999999999999e-05 2024-04-18T21:07:20.516 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.516 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.516 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.516 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758193+0000", 2024-04-18T21:07:20.516 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3773e-05 2024-04-18T21:07:20.516 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.516 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.516 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:20.516 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804632+0000", 2024-04-18T21:07:20.516 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.046439469999999997 2024-04-18T21:07:20.516 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.516 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.517 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:20.517 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804790+0000", 2024-04-18T21:07:20.517 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015784300000000001 2024-04-18T21:07:20.517 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.517 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.517 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:20.517 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805056+0000", 2024-04-18T21:07:20.517 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026652400000000003 2024-04-18T21:07:20.517 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.517 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.517 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:20.517 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.808959+0000", 2024-04-18T21:07:20.517 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003903077 2024-04-18T21:07:20.518 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.518 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.518 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:20.518 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814728+0000", 2024-04-18T21:07:20.518 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0057682489999999996 2024-04-18T21:07:20.518 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.518 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.518 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:20.518 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814754+0000", 2024-04-18T21:07:20.518 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6673999999999999e-05 2024-04-18T21:07:20.518 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.518 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.518 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:20.519 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814773+0000", 2024-04-18T21:07:20.519 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8530999999999999e-05 2024-04-18T21:07:20.519 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:20.519 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:20.519 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:20.519 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.519 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.519 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:110 3.1f 3:f83d65d8:::200.00000004:head [write 329098~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:20.519 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:07:20.519 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 34.744913199999999, 2024-04-18T21:07:20.519 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056669113, 2024-04-18T21:07:20.519 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:20.519 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:20.520 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.520 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:20.520 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.520 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:20.520 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:07:20.520 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:20.520 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.520 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.520 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:20.520 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:07:20.520 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:20.521 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.521 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.521 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:20.521 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758212+0000", 2024-04-18T21:07:20.521 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:07:20.521 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.521 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.522 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:20.522 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758219+0000", 2024-04-18T21:07:20.522 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4229999999999999e-06 2024-04-18T21:07:20.522 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.522 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.522 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:20.522 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758237+0000", 2024-04-18T21:07:20.523 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7966999999999999e-05 2024-04-18T21:07:20.523 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.523 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.523 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.523 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758252+0000", 2024-04-18T21:07:20.523 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5322999999999999e-05 2024-04-18T21:07:20.523 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.523 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.523 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:20.523 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805536+0000", 2024-04-18T21:07:20.523 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.047283861000000003 2024-04-18T21:07:20.523 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.523 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.523 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:20.524 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805579+0000", 2024-04-18T21:07:20.524 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2738999999999999e-05 2024-04-18T21:07:20.524 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.524 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.524 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:20.524 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805649+0000", 2024-04-18T21:07:20.524 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0213e-05 2024-04-18T21:07:20.524 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.524 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.524 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:20.524 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.808966+0000", 2024-04-18T21:07:20.524 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033166129999999999 2024-04-18T21:07:20.524 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.524 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.525 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:20.525 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814812+0000", 2024-04-18T21:07:20.525 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0058463589999999998 2024-04-18T21:07:20.525 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.525 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.525 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:20.525 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814854+0000", 2024-04-18T21:07:20.525 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1618e-05 2024-04-18T21:07:20.525 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.525 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.525 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:20.525 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814879+0000", 2024-04-18T21:07:20.525 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5754000000000001e-05 2024-04-18T21:07:20.525 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:20.525 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:20.525 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:20.526 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.526 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.526 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:111 3.1f 3:f83d65d8:::200.00000004:head [write 330499~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:20.526 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:07:20.526 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 34.744852223999999, 2024-04-18T21:07:20.526 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058693793000000001, 2024-04-18T21:07:20.526 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:20.526 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:20.526 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.526 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:20.526 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.526 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:20.527 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:07:20.527 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:20.527 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.527 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.527 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:20.527 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:07:20.527 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:20.527 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.527 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.527 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:20.527 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758272+0000", 2024-04-18T21:07:20.527 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1200000000000001e-06 2024-04-18T21:07:20.527 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.527 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.527 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:20.528 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758287+0000", 2024-04-18T21:07:20.528 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5017e-05 2024-04-18T21:07:20.528 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.528 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.528 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:20.528 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758309+0000", 2024-04-18T21:07:20.528 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1866e-05 2024-04-18T21:07:20.528 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.528 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.528 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.528 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758323+0000", 2024-04-18T21:07:20.528 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3606e-05 2024-04-18T21:07:20.528 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.528 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.528 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:20.529 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806279+0000", 2024-04-18T21:07:20.529 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.047956061000000001 2024-04-18T21:07:20.529 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.529 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.529 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:20.529 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806350+0000", 2024-04-18T21:07:20.529 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1070999999999998e-05 2024-04-18T21:07:20.529 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.529 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.529 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:20.529 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806459+0000", 2024-04-18T21:07:20.529 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000108606 2024-04-18T21:07:20.529 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.529 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.529 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:20.530 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.809774+0000", 2024-04-18T21:07:20.530 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003314881 2024-04-18T21:07:20.530 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.530 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.530 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:20.530 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816910+0000", 2024-04-18T21:07:20.530 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0071367760000000001 2024-04-18T21:07:20.530 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.530 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.530 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:20.530 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816941+0000", 2024-04-18T21:07:20.530 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0846000000000002e-05 2024-04-18T21:07:20.531 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.531 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.531 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:20.531 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816965+0000", 2024-04-18T21:07:20.531 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3943000000000001e-05 2024-04-18T21:07:20.531 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:20.531 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:20.531 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:20.531 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.531 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.531 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:12689 4.26 4:64a7f444:::100000033e5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:20.531 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:00.208067+0000", 2024-04-18T21:07:20.531 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.295056807999998, 2024-04-18T21:07:20.531 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066681457, 2024-04-18T21:07:20.532 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:20.532 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:20.532 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.532 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:07:20.532 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:07:20.532 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:20.532 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 12689 2024-04-18T21:07:20.532 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.532 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:20.532 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.532 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:20.532 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.208067+0000", 2024-04-18T21:07:20.532 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:20.532 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.532 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.533 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:20.533 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.208067+0000", 2024-04-18T21:07:20.533 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:20.533 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.533 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.533 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:20.533 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.208069+0000", 2024-04-18T21:07:20.533 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1500000000000002e-06 2024-04-18T21:07:20.533 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.533 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.533 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:20.533 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216162+0000", 2024-04-18T21:07:20.533 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0080933159999999997 2024-04-18T21:07:20.533 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.533 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.534 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:20.534 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216181+0000", 2024-04-18T21:07:20.534 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8573e-05 2024-04-18T21:07:20.534 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.534 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.534 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.534 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216192+0000", 2024-04-18T21:07:20.534 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0767999999999999e-05 2024-04-18T21:07:20.534 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.535 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.535 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:20.535 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216259+0000", 2024-04-18T21:07:20.535 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7977000000000003e-05 2024-04-18T21:07:20.535 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.535 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.536 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:20.536 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216635+0000", 2024-04-18T21:07:20.536 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00037591300000000002 2024-04-18T21:07:20.536 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.536 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.536 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:20.536 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216929+0000", 2024-04-18T21:07:20.536 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00029314800000000002 2024-04-18T21:07:20.536 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.536 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.536 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:20.536 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.232918+0000", 2024-04-18T21:07:20.537 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015989903 2024-04-18T21:07:20.537 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.537 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.537 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:20.537 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.274643+0000", 2024-04-18T21:07:20.537 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.041724281000000002 2024-04-18T21:07:20.537 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.537 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.537 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:20.537 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.274701+0000", 2024-04-18T21:07:20.537 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8304999999999998e-05 2024-04-18T21:07:20.537 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.537 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.538 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:20.538 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.274748+0000", 2024-04-18T21:07:20.538 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7123000000000003e-05 2024-04-18T21:07:20.538 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:20.538 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:20.538 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:20.538 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.538 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.538 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:7694 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-18T21:07:20.538 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:11.672522+0000", 2024-04-18T21:07:20.538 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.8306017679999993, 2024-04-18T21:07:20.538 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2954970370000001, 2024-04-18T21:07:20.539 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:20.539 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:20.539 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.539 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:20.539 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.539 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:20.540 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672522+0000", 2024-04-18T21:07:20.540 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:20.540 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.540 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.540 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:20.540 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672522+0000", 2024-04-18T21:07:20.540 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:20.540 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.541 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.541 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:20.541 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672525+0000", 2024-04-18T21:07:20.541 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.366e-06 2024-04-18T21:07:20.541 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.541 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.541 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:20.541 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672540+0000", 2024-04-18T21:07:20.541 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4949999999999999e-05 2024-04-18T21:07:20.541 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.541 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.541 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:20.541 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672569+0000", 2024-04-18T21:07:20.541 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8714999999999999e-05 2024-04-18T21:07:20.541 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.542 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.542 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.542 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672581+0000", 2024-04-18T21:07:20.542 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1949e-05 2024-04-18T21:07:20.542 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.542 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.542 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:20.542 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672704+0000", 2024-04-18T21:07:20.542 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000122915 2024-04-18T21:07:20.542 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.542 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.542 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:20.542 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672714+0000", 2024-04-18T21:07:20.542 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0698e-05 2024-04-18T21:07:20.543 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.543 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.543 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:20.543 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.910993+0000", 2024-04-18T21:07:20.543 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.23827911199999999 2024-04-18T21:07:20.543 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.543 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.543 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:20.543 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.911017+0000", 2024-04-18T21:07:20.543 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3419999999999999e-05 2024-04-18T21:07:20.543 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.543 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.543 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:20.543 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.952146+0000", 2024-04-18T21:07:20.544 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0411288869999999 2024-04-18T21:07:20.544 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.544 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.544 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:20.544 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.952467+0000", 2024-04-18T21:07:20.544 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00032165399999999999 2024-04-18T21:07:20.544 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.544 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.544 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:20.544 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.954086+0000", 2024-04-18T21:07:20.544 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0016184820000000001 2024-04-18T21:07:20.544 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.544 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.544 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:20.545 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.960573+0000", 2024-04-18T21:07:20.545 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064874240000000003 2024-04-18T21:07:20.545 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.545 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.545 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:20.545 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.967786+0000", 2024-04-18T21:07:20.545 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0072125069999999999 2024-04-18T21:07:20.545 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.545 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.545 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:20.545 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.967897+0000", 2024-04-18T21:07:20.545 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111679 2024-04-18T21:07:20.545 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.545 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.545 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:20.546 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.968019+0000", 2024-04-18T21:07:20.546 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000121279 2024-04-18T21:07:20.546 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:20.546 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:20.546 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:20.546 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.546 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.546 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:7696 3.f 3:f376ae95:::200.00000016:head [write 3681546~512758 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:20.546 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:12.760706+0000", 2024-04-18T21:07:20.546 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 7.7424173659999997, 2024-04-18T21:07:20.546 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.24998282899999999, 2024-04-18T21:07:20.547 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:20.547 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:20.547 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.547 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:20.547 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.547 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:20.547 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.760706+0000", 2024-04-18T21:07:20.547 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:20.547 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.547 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.547 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:20.547 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.760706+0000", 2024-04-18T21:07:20.547 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:20.547 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.547 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.547 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:20.548 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.760710+0000", 2024-04-18T21:07:20.548 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2100000000000003e-06 2024-04-18T21:07:20.548 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.548 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.548 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:20.548 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.761972+0000", 2024-04-18T21:07:20.548 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0012615689999999999 2024-04-18T21:07:20.548 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.548 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.548 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:20.548 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762012+0000", 2024-04-18T21:07:20.548 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0145999999999998e-05 2024-04-18T21:07:20.548 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.548 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.549 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.549 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762030+0000", 2024-04-18T21:07:20.549 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8312999999999999e-05 2024-04-18T21:07:20.549 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.549 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.549 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:20.549 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762158+0000", 2024-04-18T21:07:20.549 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012805600000000001 2024-04-18T21:07:20.549 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.549 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.549 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:20.549 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762174+0000", 2024-04-18T21:07:20.549 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5645999999999999e-05 2024-04-18T21:07:20.549 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.549 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.550 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:20.550 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.926080+0000", 2024-04-18T21:07:20.550 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.16390581900000001 2024-04-18T21:07:20.550 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.550 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.550 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for missing object", 2024-04-18T21:07:20.550 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.926149+0000", 2024-04-18T21:07:20.550 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9172999999999997e-05 2024-04-18T21:07:20.550 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.551 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.551 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:20.551 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.002156+0000", 2024-04-18T21:07:20.551 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.076006972000000006 2024-04-18T21:07:20.551 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.551 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.551 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for rw locks", 2024-04-18T21:07:20.551 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.002294+0000", 2024-04-18T21:07:20.551 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000138011 2024-04-18T21:07:20.551 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.551 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.551 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:20.551 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.005436+0000", 2024-04-18T21:07:20.551 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031422749999999999 2024-04-18T21:07:20.551 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.552 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.552 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:20.552 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.005577+0000", 2024-04-18T21:07:20.552 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014105399999999999 2024-04-18T21:07:20.552 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.552 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.552 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:20.552 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.005725+0000", 2024-04-18T21:07:20.552 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014721100000000001 2024-04-18T21:07:20.552 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.552 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.552 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:20.552 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.009143+0000", 2024-04-18T21:07:20.553 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0034179380000000001 2024-04-18T21:07:20.553 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.553 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.553 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:20.553 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.010522+0000", 2024-04-18T21:07:20.553 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0013790919999999999 2024-04-18T21:07:20.553 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.553 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.553 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:20.553 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.010586+0000", 2024-04-18T21:07:20.553 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4713000000000002e-05 2024-04-18T21:07:20.553 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.553 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.553 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:20.554 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.010689+0000", 2024-04-18T21:07:20.554 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000102631 2024-04-18T21:07:20.554 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:20.554 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:20.554 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:20.554 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.554 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.554 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:7697 3.16 3:6b6b4f13:::200.0000001c:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:20.554 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:12.762074+0000", 2024-04-18T21:07:20.554 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 7.7410492179999997, 2024-04-18T21:07:20.554 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.2056489, 2024-04-18T21:07:20.555 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:20.555 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:20.555 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:07:20.555 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:20.555 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.555 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:20.555 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762074+0000", 2024-04-18T21:07:20.555 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:20.555 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.555 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.555 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:20.555 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762074+0000", 2024-04-18T21:07:20.555 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:20.555 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.556 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.556 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:20.556 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762076+0000", 2024-04-18T21:07:20.556 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.793e-06 2024-04-18T21:07:20.556 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.556 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.556 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:20.556 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762083+0000", 2024-04-18T21:07:20.556 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7129999999999999e-06 2024-04-18T21:07:20.556 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.556 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.556 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:20.556 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762104+0000", 2024-04-18T21:07:20.556 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1480000000000001e-05 2024-04-18T21:07:20.556 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.557 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.557 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.557 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762121+0000", 2024-04-18T21:07:20.557 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.632e-05 2024-04-18T21:07:20.557 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.557 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.557 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:20.557 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762224+0000", 2024-04-18T21:07:20.557 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010346800000000001 2024-04-18T21:07:20.557 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.557 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.557 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:20.557 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762238+0000", 2024-04-18T21:07:20.558 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3482999999999999e-05 2024-04-18T21:07:20.558 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.558 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.558 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:20.558 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.946932+0000", 2024-04-18T21:07:20.558 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.18469451000000001 2024-04-18T21:07:20.558 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.558 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.558 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:20.558 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.947261+0000", 2024-04-18T21:07:20.558 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00032857399999999999 2024-04-18T21:07:20.558 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.558 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.558 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:20.559 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.967723+0000", 2024-04-18T21:07:20.559 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020462559000000002 2024-04-18T21:07:20.559 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:20.559 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:20.559 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:20.559 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.559 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.559 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:10831 4.13 4:c948684f:::1000000032e.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:20.559 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.823266+0000", 2024-04-18T21:07:20.559 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.6798578290000004, 2024-04-18T21:07:20.559 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.65275881599999996, 2024-04-18T21:07:20.559 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:20.560 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:20.560 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.560 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:20.560 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.560 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:20.560 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823266+0000", 2024-04-18T21:07:20.560 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:20.560 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.560 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.560 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:20.560 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823266+0000", 2024-04-18T21:07:20.560 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:20.561 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.561 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.561 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:20.561 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823266+0000", 2024-04-18T21:07:20.561 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9800000000000004e-07 2024-04-18T21:07:20.561 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.561 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.561 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:20.561 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823269+0000", 2024-04-18T21:07:20.561 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3259999999999998e-06 2024-04-18T21:07:20.561 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.561 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.561 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:20.561 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823274+0000", 2024-04-18T21:07:20.561 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9830000000000001e-06 2024-04-18T21:07:20.562 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.562 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.562 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.562 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823280+0000", 2024-04-18T21:07:20.562 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1540000000000001e-06 2024-04-18T21:07:20.562 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.562 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.562 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:20.562 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823313+0000", 2024-04-18T21:07:20.562 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3667000000000001e-05 2024-04-18T21:07:20.562 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.562 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.562 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:20.562 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823321+0000", 2024-04-18T21:07:20.563 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1200000000000002e-06 2024-04-18T21:07:20.563 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.563 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.563 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:20.563 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.470069+0000", 2024-04-18T21:07:20.563 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.64674728999999997 2024-04-18T21:07:20.563 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.563 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.563 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:20.563 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.470457+0000", 2024-04-18T21:07:20.563 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00038800899999999998 2024-04-18T21:07:20.563 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.563 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.563 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:20.563 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.470755+0000", 2024-04-18T21:07:20.564 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00029781399999999998 2024-04-18T21:07:20.564 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.564 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.564 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:20.564 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.474041+0000", 2024-04-18T21:07:20.564 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032860670000000002 2024-04-18T21:07:20.564 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.564 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.564 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:20.564 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.475621+0000", 2024-04-18T21:07:20.564 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001579925 2024-04-18T21:07:20.564 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.564 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.565 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:20.565 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.475750+0000", 2024-04-18T21:07:20.565 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000129002 2024-04-18T21:07:20.565 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.565 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.565 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:20.565 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.476024+0000", 2024-04-18T21:07:20.565 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000274961 2024-04-18T21:07:20.565 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:20.565 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:20.565 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:20.565 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.565 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.565 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11326 4.13 4:cbbbc9f0:::100000010c6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:20.565 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.917113+0000", 2024-04-18T21:07:20.566 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.5860106270000003, 2024-04-18T21:07:20.566 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.56159817899999998, 2024-04-18T21:07:20.566 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:20.566 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:20.566 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.566 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:20.566 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.566 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:20.566 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917113+0000", 2024-04-18T21:07:20.567 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:20.567 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.567 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.567 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:20.567 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917113+0000", 2024-04-18T21:07:20.567 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:20.567 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.567 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.567 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:20.567 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917114+0000", 2024-04-18T21:07:20.567 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5099999999999999e-07 2024-04-18T21:07:20.568 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.568 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.568 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:20.568 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917123+0000", 2024-04-18T21:07:20.568 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5859999999999994e-06 2024-04-18T21:07:20.568 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.568 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.568 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:20.568 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917130+0000", 2024-04-18T21:07:20.568 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9800000000000001e-06 2024-04-18T21:07:20.568 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.568 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.568 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.568 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917136+0000", 2024-04-18T21:07:20.568 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.502e-06 2024-04-18T21:07:20.569 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.569 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.569 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:20.569 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917239+0000", 2024-04-18T21:07:20.569 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000103286 2024-04-18T21:07:20.569 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.569 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.569 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:20.569 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917247+0000", 2024-04-18T21:07:20.569 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.49e-06 2024-04-18T21:07:20.569 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.569 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.569 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:20.569 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.472462+0000", 2024-04-18T21:07:20.570 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.55521418899999997 2024-04-18T21:07:20.570 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.570 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.570 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:20.570 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.472801+0000", 2024-04-18T21:07:20.570 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00033935600000000002 2024-04-18T21:07:20.570 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.570 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.570 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:20.570 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.473101+0000", 2024-04-18T21:07:20.570 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030031399999999998 2024-04-18T21:07:20.570 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.570 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.571 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:20.571 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.475574+0000", 2024-04-18T21:07:20.571 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0024732310000000002 2024-04-18T21:07:20.571 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.571 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.571 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:20.571 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.478287+0000", 2024-04-18T21:07:20.571 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027122349999999999 2024-04-18T21:07:20.571 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.571 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.571 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:20.571 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.478467+0000", 2024-04-18T21:07:20.571 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000180645 2024-04-18T21:07:20.571 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.571 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.572 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:20.572 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.478711+0000", 2024-04-18T21:07:20.572 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024371399999999999 2024-04-18T21:07:20.572 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:20.572 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:20.572 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:20.572 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.572 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.572 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11394 4.13 4:cb2e645e:::10000001109.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:20.572 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.925453+0000", 2024-04-18T21:07:20.572 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.5776701040000001, 2024-04-18T21:07:20.572 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.55363756900000005, 2024-04-18T21:07:20.572 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:20.572 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:20.573 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.573 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:20.573 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.573 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:20.573 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925453+0000", 2024-04-18T21:07:20.573 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:20.573 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.573 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.573 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:20.573 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925453+0000", 2024-04-18T21:07:20.573 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:20.573 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.573 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.573 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:20.573 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925454+0000", 2024-04-18T21:07:20.574 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1699999999999997e-07 2024-04-18T21:07:20.574 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.574 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.574 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:20.574 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925458+0000", 2024-04-18T21:07:20.574 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7280000000000001e-06 2024-04-18T21:07:20.574 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.574 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.574 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:20.574 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925467+0000", 2024-04-18T21:07:20.574 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7169999999999997e-06 2024-04-18T21:07:20.574 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.575 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.575 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.575 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925474+0000", 2024-04-18T21:07:20.575 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1350000000000003e-06 2024-04-18T21:07:20.575 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.575 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.575 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:20.575 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925523+0000", 2024-04-18T21:07:20.575 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9616000000000001e-05 2024-04-18T21:07:20.575 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.575 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.575 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:20.575 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925530+0000", 2024-04-18T21:07:20.575 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0099999999999998e-06 2024-04-18T21:07:20.575 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.576 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.576 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:20.576 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.474474+0000", 2024-04-18T21:07:20.576 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.548943242 2024-04-18T21:07:20.576 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.576 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.576 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:20.576 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.474692+0000", 2024-04-18T21:07:20.576 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00021829799999999999 2024-04-18T21:07:20.576 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.576 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.576 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:20.576 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.474879+0000", 2024-04-18T21:07:20.576 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000187095 2024-04-18T21:07:20.576 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.576 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.577 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:20.577 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.478733+0000", 2024-04-18T21:07:20.577 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003853871 2024-04-18T21:07:20.577 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.577 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.577 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:20.577 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.478840+0000", 2024-04-18T21:07:20.577 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000106623 2024-04-18T21:07:20.577 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.577 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.577 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:20.577 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.478919+0000", 2024-04-18T21:07:20.577 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9326000000000006e-05 2024-04-18T21:07:20.577 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.577 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.578 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:20.578 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479091+0000", 2024-04-18T21:07:20.578 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000172091 2024-04-18T21:07:20.578 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:20.578 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:20.578 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:20.578 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.578 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.578 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11417 4.13 4:cae4f303:::1000000111f.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:20.578 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.927998+0000", 2024-04-18T21:07:20.578 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.5751254640000001, 2024-04-18T21:07:20.578 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.55142600900000005, 2024-04-18T21:07:20.578 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:20.578 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:20.579 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.579 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:20.579 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.579 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:20.579 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.927998+0000", 2024-04-18T21:07:20.579 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:20.579 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.579 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.579 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:20.579 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.927998+0000", 2024-04-18T21:07:20.579 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:20.579 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.579 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.579 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:20.579 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.927999+0000", 2024-04-18T21:07:20.580 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2800000000000005e-07 2024-04-18T21:07:20.580 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.580 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.580 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:20.580 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.928003+0000", 2024-04-18T21:07:20.580 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0060000000000003e-06 2024-04-18T21:07:20.580 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.580 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.580 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:20.580 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.928012+0000", 2024-04-18T21:07:20.580 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.4129999999999995e-06 2024-04-18T21:07:20.580 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.580 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.581 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.581 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.928019+0000", 2024-04-18T21:07:20.581 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5590000000000002e-06 2024-04-18T21:07:20.581 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.581 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.581 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:20.581 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.928075+0000", 2024-04-18T21:07:20.581 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5927000000000002e-05 2024-04-18T21:07:20.581 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.581 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.581 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:20.581 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.928091+0000", 2024-04-18T21:07:20.581 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5724999999999999e-05 2024-04-18T21:07:20.581 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.581 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.581 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:20.582 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.476117+0000", 2024-04-18T21:07:20.582 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.54802609899999999 2024-04-18T21:07:20.582 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.582 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.582 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:20.582 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.476310+0000", 2024-04-18T21:07:20.582 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019318100000000001 2024-04-18T21:07:20.582 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.582 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.582 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:20.582 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.476469+0000", 2024-04-18T21:07:20.582 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015902599999999999 2024-04-18T21:07:20.582 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.582 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.583 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:20.583 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479198+0000", 2024-04-18T21:07:20.583 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027292010000000001 2024-04-18T21:07:20.583 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.583 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.583 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:20.583 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479225+0000", 2024-04-18T21:07:20.583 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6483e-05 2024-04-18T21:07:20.583 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.583 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.584 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:20.584 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479301+0000", 2024-04-18T21:07:20.584 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5935999999999999e-05 2024-04-18T21:07:20.584 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.584 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.584 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:20.584 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479424+0000", 2024-04-18T21:07:20.584 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012352500000000001 2024-04-18T21:07:20.584 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:20.584 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:20.584 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:20.584 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.584 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.584 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11538 4.13 4:ca7a7383:::10000001196.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:20.584 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.942641+0000", 2024-04-18T21:07:20.585 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.5604827830000003, 2024-04-18T21:07:20.585 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.538204715, 2024-04-18T21:07:20.585 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:20.585 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:20.585 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.585 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:20.585 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.585 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:20.585 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942641+0000", 2024-04-18T21:07:20.585 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:20.585 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.585 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.585 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:20.585 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942641+0000", 2024-04-18T21:07:20.585 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:20.586 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.586 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.586 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:20.586 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942641+0000", 2024-04-18T21:07:20.586 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4099999999999998e-07 2024-04-18T21:07:20.586 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.586 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.586 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:20.587 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942645+0000", 2024-04-18T21:07:20.587 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.788e-06 2024-04-18T21:07:20.587 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.587 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.587 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:20.587 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942654+0000", 2024-04-18T21:07:20.587 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2089999999999994e-06 2024-04-18T21:07:20.587 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.587 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.587 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.587 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942668+0000", 2024-04-18T21:07:20.587 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3925e-05 2024-04-18T21:07:20.587 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.588 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.588 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:20.588 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942898+0000", 2024-04-18T21:07:20.588 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00022961800000000001 2024-04-18T21:07:20.588 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.588 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.588 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:20.588 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942907+0000", 2024-04-18T21:07:20.588 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6219999999999998e-06 2024-04-18T21:07:20.588 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.588 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.588 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:20.589 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.477120+0000", 2024-04-18T21:07:20.589 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.53421297400000001 2024-04-18T21:07:20.589 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.589 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.589 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:20.589 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.477466+0000", 2024-04-18T21:07:20.590 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00034685899999999998 2024-04-18T21:07:20.590 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.590 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.590 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:20.590 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.477717+0000", 2024-04-18T21:07:20.590 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00025019799999999998 2024-04-18T21:07:20.591 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.591 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.591 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:20.591 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479518+0000", 2024-04-18T21:07:20.591 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00180105 2024-04-18T21:07:20.591 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.591 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.592 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:20.592 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.480481+0000", 2024-04-18T21:07:20.592 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00096356100000000004 2024-04-18T21:07:20.592 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.592 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.592 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:20.592 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.480618+0000", 2024-04-18T21:07:20.592 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013678599999999999 2024-04-18T21:07:20.593 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.593 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.593 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:20.593 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.480845+0000", 2024-04-18T21:07:20.593 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00022738399999999999 2024-04-18T21:07:20.593 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:20.593 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:20.593 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:20.593 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.594 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.594 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11574 4.13 4:c9cea989:::100000011b9.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:20.594 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.947550+0000", 2024-04-18T21:07:20.594 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.5555730419999998, 2024-04-18T21:07:20.594 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.53632730500000003, 2024-04-18T21:07:20.594 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:20.594 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:20.594 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.594 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:20.594 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.594 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:20.594 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947550+0000", 2024-04-18T21:07:20.594 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:20.594 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.594 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.595 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:20.595 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947550+0000", 2024-04-18T21:07:20.595 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:20.595 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.595 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.595 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:20.595 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947551+0000", 2024-04-18T21:07:20.595 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6599999999999996e-07 2024-04-18T21:07:20.595 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.595 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.595 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:20.595 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947554+0000", 2024-04-18T21:07:20.595 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6230000000000001e-06 2024-04-18T21:07:20.595 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.595 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.596 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:20.596 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947562+0000", 2024-04-18T21:07:20.596 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2179999999999999e-06 2024-04-18T21:07:20.596 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.596 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.596 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.596 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947567+0000", 2024-04-18T21:07:20.596 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3009999999999997e-06 2024-04-18T21:07:20.596 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.596 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.596 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:20.596 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947624+0000", 2024-04-18T21:07:20.596 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6823999999999997e-05 2024-04-18T21:07:20.596 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.596 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.597 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:20.597 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947633+0000", 2024-04-18T21:07:20.597 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9330000000000007e-06 2024-04-18T21:07:20.597 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.597 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.597 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:20.597 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479591+0000", 2024-04-18T21:07:20.597 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.53195765500000003 2024-04-18T21:07:20.597 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.597 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.597 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:20.597 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479781+0000", 2024-04-18T21:07:20.597 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000190034 2024-04-18T21:07:20.597 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.598 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.598 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:20.598 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479936+0000", 2024-04-18T21:07:20.598 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000154959 2024-04-18T21:07:20.598 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.598 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.598 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:20.598 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.483428+0000", 2024-04-18T21:07:20.598 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003492294 2024-04-18T21:07:20.598 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.598 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.598 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:20.598 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.483479+0000", 2024-04-18T21:07:20.598 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0868999999999997e-05 2024-04-18T21:07:20.599 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.599 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.599 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:20.599 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.483594+0000", 2024-04-18T21:07:20.599 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000115499 2024-04-18T21:07:20.599 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.599 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.599 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:20.599 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.483878+0000", 2024-04-18T21:07:20.599 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028352999999999999 2024-04-18T21:07:20.599 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:20.599 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:20.599 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:20.599 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.600 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.600 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11596 4.13 4:c88ce457:::100000011ce.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:20.600 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.955066+0000", 2024-04-18T21:07:20.600 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.548057633, 2024-04-18T21:07:20.600 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.52924763200000002, 2024-04-18T21:07:20.600 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:20.600 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:20.600 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.600 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:20.600 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.600 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:20.600 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955066+0000", 2024-04-18T21:07:20.600 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:20.600 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.600 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.601 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:20.601 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955066+0000", 2024-04-18T21:07:20.601 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:20.601 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.601 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.601 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:20.601 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955066+0000", 2024-04-18T21:07:20.601 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4900000000000001e-07 2024-04-18T21:07:20.601 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.601 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.601 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:20.601 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955068+0000", 2024-04-18T21:07:20.601 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0190000000000001e-06 2024-04-18T21:07:20.601 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.601 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.602 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:20.602 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955076+0000", 2024-04-18T21:07:20.602 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.537e-06 2024-04-18T21:07:20.602 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.602 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.602 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.602 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955080+0000", 2024-04-18T21:07:20.602 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1760000000000003e-06 2024-04-18T21:07:20.602 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.602 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.602 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:20.602 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955129+0000", 2024-04-18T21:07:20.602 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8480999999999999e-05 2024-04-18T21:07:20.602 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.603 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.603 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:20.603 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955134+0000", 2024-04-18T21:07:20.603 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1610000000000002e-06 2024-04-18T21:07:20.603 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.603 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.603 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:20.603 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.480932+0000", 2024-04-18T21:07:20.603 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.52579809799999999 2024-04-18T21:07:20.603 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.603 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.603 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:20.603 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.481149+0000", 2024-04-18T21:07:20.603 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00021709100000000001 2024-04-18T21:07:20.603 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.604 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.604 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:20.604 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.481303+0000", 2024-04-18T21:07:20.604 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000153752 2024-04-18T21:07:20.604 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.604 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.604 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:20.604 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.483927+0000", 2024-04-18T21:07:20.604 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026241189999999998 2024-04-18T21:07:20.604 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.604 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.604 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:20.604 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.484028+0000", 2024-04-18T21:07:20.604 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010134899999999999 2024-04-18T21:07:20.605 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.605 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.605 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:20.605 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.484138+0000", 2024-04-18T21:07:20.605 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011015599999999999 2024-04-18T21:07:20.605 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.605 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.605 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:20.605 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.484314+0000", 2024-04-18T21:07:20.605 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017524399999999999 2024-04-18T21:07:20.605 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:20.606 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:20.606 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:20.606 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.606 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.606 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11800 4.13 4:cacc00c7:::10000001296.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:20.606 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.989042+0000", 2024-04-18T21:07:20.606 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.5140819649999999, 2024-04-18T21:07:20.606 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.49832004299999999, 2024-04-18T21:07:20.606 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:20.606 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:20.606 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.606 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:20.606 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.607 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:20.607 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989042+0000", 2024-04-18T21:07:20.607 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:20.607 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.607 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.607 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:20.607 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989042+0000", 2024-04-18T21:07:20.607 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:20.607 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.607 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.607 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:20.607 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989042+0000", 2024-04-18T21:07:20.607 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5200000000000002e-07 2024-04-18T21:07:20.607 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.607 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.608 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:20.608 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989044+0000", 2024-04-18T21:07:20.608 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2589999999999999e-06 2024-04-18T21:07:20.608 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.608 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.608 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:20.608 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989051+0000", 2024-04-18T21:07:20.608 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6340000000000003e-06 2024-04-18T21:07:20.608 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.608 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.608 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.608 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989062+0000", 2024-04-18T21:07:20.608 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1043000000000001e-05 2024-04-18T21:07:20.608 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.609 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.609 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:20.609 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989367+0000", 2024-04-18T21:07:20.609 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000305249 2024-04-18T21:07:20.609 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.609 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.609 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:20.609 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989376+0000", 2024-04-18T21:07:20.609 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4570000000000005e-06 2024-04-18T21:07:20.609 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.609 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.609 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:20.609 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.482011+0000", 2024-04-18T21:07:20.609 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.49263514200000003 2024-04-18T21:07:20.609 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.610 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.610 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:20.610 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.482397+0000", 2024-04-18T21:07:20.610 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000385986 2024-04-18T21:07:20.610 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.610 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.610 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:20.610 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.482689+0000", 2024-04-18T21:07:20.610 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00029179800000000001 2024-04-18T21:07:20.610 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.610 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.610 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:20.610 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.487008+0000", 2024-04-18T21:07:20.610 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043196129999999999 2024-04-18T21:07:20.611 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.611 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.611 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:20.611 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.487113+0000", 2024-04-18T21:07:20.611 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010498899999999999 2024-04-18T21:07:20.611 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.611 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.611 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:20.611 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.487192+0000", 2024-04-18T21:07:20.611 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8778999999999999e-05 2024-04-18T21:07:20.611 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.611 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.611 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:20.611 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.487362+0000", 2024-04-18T21:07:20.612 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016964200000000001 2024-04-18T21:07:20.612 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:20.612 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:20.612 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:20.612 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.612 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.612 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11888 4.13 4:ca460221:::10000002cd3.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:20.612 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:16.002068+0000", 2024-04-18T21:07:20.612 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.5010553049999995, 2024-04-18T21:07:20.612 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.48938242199999998, 2024-04-18T21:07:20.612 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:20.612 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:20.612 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.612 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:20.612 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.613 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:20.613 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002068+0000", 2024-04-18T21:07:20.613 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:20.613 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.613 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.613 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:20.613 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002068+0000", 2024-04-18T21:07:20.613 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:20.613 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.613 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.613 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:20.613 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002069+0000", 2024-04-18T21:07:20.613 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7899999999999999e-07 2024-04-18T21:07:20.613 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.614 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.614 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:20.614 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002071+0000", 2024-04-18T21:07:20.614 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.356e-06 2024-04-18T21:07:20.614 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.614 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.614 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:20.614 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002078+0000", 2024-04-18T21:07:20.614 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.562e-06 2024-04-18T21:07:20.614 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.614 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.614 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.614 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002083+0000", 2024-04-18T21:07:20.614 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1939999999999997e-06 2024-04-18T21:07:20.615 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.615 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.615 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:20.615 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002125+0000", 2024-04-18T21:07:20.615 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2548e-05 2024-04-18T21:07:20.615 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.615 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.615 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:20.615 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002132+0000", 2024-04-18T21:07:20.615 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9360000000000002e-06 2024-04-18T21:07:20.615 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.615 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.615 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:20.615 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.484392+0000", 2024-04-18T21:07:20.616 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.48225933500000001 2024-04-18T21:07:20.616 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.616 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.616 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:20.616 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.484630+0000", 2024-04-18T21:07:20.616 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023872499999999999 2024-04-18T21:07:20.616 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.616 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.616 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:20.616 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.484812+0000", 2024-04-18T21:07:20.616 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000181232 2024-04-18T21:07:20.616 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.616 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.616 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:20.616 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.490995+0000", 2024-04-18T21:07:20.617 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0061831459999999996 2024-04-18T21:07:20.617 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.617 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.617 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:20.617 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491132+0000", 2024-04-18T21:07:20.617 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000137145 2024-04-18T21:07:20.617 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.617 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.617 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:20.617 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491219+0000", 2024-04-18T21:07:20.617 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7466000000000006e-05 2024-04-18T21:07:20.617 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.617 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.617 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:20.617 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491451+0000", 2024-04-18T21:07:20.618 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023129800000000001 2024-04-18T21:07:20.618 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:20.618 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:20.618 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:20.618 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.618 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.618 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:12057 4.13 4:cacbe4c4:::10000002d77.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:20.618 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:16.028144+0000", 2024-04-18T21:07:20.618 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.474979694, 2024-04-18T21:07:20.618 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.46365036100000001, 2024-04-18T21:07:20.618 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:20.618 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:20.618 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.619 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:20.619 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.619 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:20.619 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028144+0000", 2024-04-18T21:07:20.619 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:20.619 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.619 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.619 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:20.619 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028144+0000", 2024-04-18T21:07:20.619 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:20.619 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.619 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.619 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:20.619 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028144+0000", 2024-04-18T21:07:20.620 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9800000000000003e-07 2024-04-18T21:07:20.620 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.620 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.620 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:20.620 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028147+0000", 2024-04-18T21:07:20.620 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.773e-06 2024-04-18T21:07:20.620 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.620 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.620 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:20.620 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028154+0000", 2024-04-18T21:07:20.620 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8940000000000004e-06 2024-04-18T21:07:20.620 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.620 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.620 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.620 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028160+0000", 2024-04-18T21:07:20.621 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7219999999999996e-06 2024-04-18T21:07:20.621 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.621 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.621 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:20.621 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028227+0000", 2024-04-18T21:07:20.621 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6711000000000006e-05 2024-04-18T21:07:20.621 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.621 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.621 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:20.621 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028250+0000", 2024-04-18T21:07:20.621 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3010000000000002e-05 2024-04-18T21:07:20.621 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.622 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.622 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:20.622 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.487484+0000", 2024-04-18T21:07:20.622 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.45923466600000001 2024-04-18T21:07:20.622 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.622 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.622 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:20.622 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.487750+0000", 2024-04-18T21:07:20.622 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026618799999999999 2024-04-18T21:07:20.622 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.622 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.623 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:20.623 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.487915+0000", 2024-04-18T21:07:20.623 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016425500000000001 2024-04-18T21:07:20.623 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.623 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.623 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:20.623 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491559+0000", 2024-04-18T21:07:20.623 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003644109 2024-04-18T21:07:20.623 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.623 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.623 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:20.623 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491586+0000", 2024-04-18T21:07:20.623 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.743e-05 2024-04-18T21:07:20.623 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.624 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.624 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:20.624 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491662+0000", 2024-04-18T21:07:20.624 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5978999999999999e-05 2024-04-18T21:07:20.624 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.624 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.624 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:20.624 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491794+0000", 2024-04-18T21:07:20.624 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013202600000000001 2024-04-18T21:07:20.624 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:20.624 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:20.624 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:20.624 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.624 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.625 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:12078 4.13 4:c93107e9:::10000002d8c.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:20.625 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:16.031090+0000", 2024-04-18T21:07:20.625 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.4720338279999998, 2024-04-18T21:07:20.625 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.461078355, 2024-04-18T21:07:20.625 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:20.625 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:20.625 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.625 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:20.625 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.625 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:20.625 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031090+0000", 2024-04-18T21:07:20.625 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:20.626 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.626 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.626 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:20.626 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031090+0000", 2024-04-18T21:07:20.626 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:20.626 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.626 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.626 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:20.626 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031090+0000", 2024-04-18T21:07:20.626 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6599999999999996e-07 2024-04-18T21:07:20.626 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.626 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.626 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:20.627 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031093+0000", 2024-04-18T21:07:20.627 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7659999999999999e-06 2024-04-18T21:07:20.627 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.627 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.627 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:20.627 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031099+0000", 2024-04-18T21:07:20.627 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2269999999999998e-06 2024-04-18T21:07:20.627 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.627 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.627 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.627 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031103+0000", 2024-04-18T21:07:20.627 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7929999999999999e-06 2024-04-18T21:07:20.627 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.627 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.628 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:20.628 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031147+0000", 2024-04-18T21:07:20.628 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3742000000000002e-05 2024-04-18T21:07:20.628 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.628 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.628 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:20.628 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031154+0000", 2024-04-18T21:07:20.628 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1999999999999997e-06 2024-04-18T21:07:20.628 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.628 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.628 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:20.628 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.488743+0000", 2024-04-18T21:07:20.628 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.45758900200000002 2024-04-18T21:07:20.628 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.628 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.629 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:20.629 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.488980+0000", 2024-04-18T21:07:20.629 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023704499999999999 2024-04-18T21:07:20.629 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.629 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.629 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:20.629 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.489166+0000", 2024-04-18T21:07:20.629 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018544500000000001 2024-04-18T21:07:20.629 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.629 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.629 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:20.629 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491810+0000", 2024-04-18T21:07:20.629 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026448219999999998 2024-04-18T21:07:20.630 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.630 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.630 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:20.630 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491903+0000", 2024-04-18T21:07:20.630 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2305999999999993e-05 2024-04-18T21:07:20.630 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.630 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.630 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:20.630 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491987+0000", 2024-04-18T21:07:20.630 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4581999999999998e-05 2024-04-18T21:07:20.630 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.630 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.630 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:20.630 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.492168+0000", 2024-04-18T21:07:20.631 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018075900000000001 2024-04-18T21:07:20.631 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:20.631 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:20.631 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:20.631 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.631 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.631 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:12081 4.13 4:cafa1dfa:::10000002d8f.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:20.631 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:16.031865+0000", 2024-04-18T21:07:20.631 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.4712587939999997, 2024-04-18T21:07:20.631 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.460588628, 2024-04-18T21:07:20.631 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:20.631 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:20.631 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:20.631 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:20.632 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.632 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:20.632 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031865+0000", 2024-04-18T21:07:20.632 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:20.632 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.632 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.632 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:20.632 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031865+0000", 2024-04-18T21:07:20.632 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:20.632 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.632 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.632 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:20.632 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031865+0000", 2024-04-18T21:07:20.632 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4799999999999998e-07 2024-04-18T21:07:20.633 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.633 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.633 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:20.633 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031868+0000", 2024-04-18T21:07:20.633 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6570000000000001e-06 2024-04-18T21:07:20.633 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.633 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.633 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:20.633 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031874+0000", 2024-04-18T21:07:20.633 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4370000000000004e-06 2024-04-18T21:07:20.633 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.633 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.633 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:20.633 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031879+0000", 2024-04-18T21:07:20.633 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8729999999999998e-06 2024-04-18T21:07:20.634 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.634 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.634 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:20.634 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031924+0000", 2024-04-18T21:07:20.634 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4314999999999998e-05 2024-04-18T21:07:20.634 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.634 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.634 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:20.634 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031929+0000", 2024-04-18T21:07:20.634 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9980000000000003e-06 2024-04-18T21:07:20.634 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.634 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.634 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:20.635 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.489813+0000", 2024-04-18T21:07:20.635 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.45788481800000003 2024-04-18T21:07:20.635 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.635 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.635 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:20.635 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.490188+0000", 2024-04-18T21:07:20.635 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00037420699999999999 2024-04-18T21:07:20.635 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.635 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.635 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:20.635 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.490423+0000", 2024-04-18T21:07:20.635 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023582400000000001 2024-04-18T21:07:20.635 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.635 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.636 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:20.636 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.492238+0000", 2024-04-18T21:07:20.636 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018143930000000001 2024-04-18T21:07:20.636 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.636 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.636 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:20.636 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.492256+0000", 2024-04-18T21:07:20.636 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7706999999999998e-05 2024-04-18T21:07:20.636 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.636 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.636 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:20.636 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.492323+0000", 2024-04-18T21:07:20.636 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7222000000000001e-05 2024-04-18T21:07:20.636 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:20.636 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:20.637 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:20.637 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.492453+0000", 2024-04-18T21:07:20.637 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000130529 2024-04-18T21:07:20.637 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:20.637 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:20.637 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:20.637 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:20.637 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:20.637 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:07:20.639 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:07:20.640 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:20.637+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:20.738 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~24s 2024-04-18T21:07:20.739 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:20.738+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:20.774 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:07:20.774 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:07:20.774 INFO:teuthology.orchestra.run.smithi132.stdout: "num_ops": 0 2024-04-18T21:07:20.774 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:07:20.789 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:07:20.839 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:20.841+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:20.933 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:07:20.933 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:07:20.933 INFO:teuthology.orchestra.run.smithi132.stdout: "complaint_time": 30, 2024-04-18T21:07:20.933 INFO:teuthology.orchestra.run.smithi132.stdout: "num_blocked_ops": 0 2024-04-18T21:07:20.933 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:07:20.941 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:20.941+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:20.956 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:07:21.043 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:21.045+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:21.113 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:07:21.113 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 20, 2024-04-18T21:07:21.113 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 600, 2024-04-18T21:07:21.113 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [ 2024-04-18T21:07:21.113 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.113 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:21.114 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:07:21.114 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 135.49763437799999, 2024-04-18T21:07:21.114 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043581898000000001, 2024-04-18T21:07:21.114 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:21.114 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:21.114 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:21.114 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:21.114 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.114 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:21.114 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:07:21.114 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:21.114 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.114 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.114 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:21.115 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:07:21.115 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:21.115 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.115 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.115 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:21.115 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616641+0000", 2024-04-18T21:07:21.115 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:07:21.115 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.115 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.115 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:21.115 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616648+0000", 2024-04-18T21:07:21.115 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3860000000000001e-06 2024-04-18T21:07:21.115 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.115 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.115 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:21.116 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616666+0000", 2024-04-18T21:07:21.116 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7583000000000001e-05 2024-04-18T21:07:21.116 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.116 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.116 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:21.116 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616679+0000", 2024-04-18T21:07:21.116 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3322999999999999e-05 2024-04-18T21:07:21.116 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.116 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.116 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:21.116 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630373+0000", 2024-04-18T21:07:21.116 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013694207999999999 2024-04-18T21:07:21.116 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.116 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.116 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:21.116 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630545+0000", 2024-04-18T21:07:21.117 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000171683 2024-04-18T21:07:21.117 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.117 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.117 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:21.117 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630728+0000", 2024-04-18T21:07:21.117 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000182599 2024-04-18T21:07:21.117 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.117 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.117 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:21.117 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640600+0000", 2024-04-18T21:07:21.117 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0098726119999999994 2024-04-18T21:07:21.117 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.117 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.117 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:21.117 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659927+0000", 2024-04-18T21:07:21.117 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019326724999999999 2024-04-18T21:07:21.118 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.118 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.118 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:21.118 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660112+0000", 2024-04-18T21:07:21.118 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000185203 2024-04-18T21:07:21.118 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.118 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.118 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:21.118 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660222+0000", 2024-04-18T21:07:21.118 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109343 2024-04-18T21:07:21.118 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:21.118 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:21.118 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:21.118 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.119 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.119 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11357 4.38 4:1d691e75:::1000000312c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T21:07:21.119 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:58.595279+0000", 2024-04-18T21:07:21.119 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 22.518995468, 2024-04-18T21:07:21.119 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.045901399000000002, 2024-04-18T21:07:21.119 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:21.119 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:21.119 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:21.119 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:21.119 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:21.119 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:21.119 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11357 2024-04-18T21:07:21.119 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.119 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:21.119 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.120 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:21.120 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.595279+0000", 2024-04-18T21:07:21.120 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:21.120 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.120 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.120 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:21.120 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.595279+0000", 2024-04-18T21:07:21.120 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:21.120 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.120 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.120 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:21.120 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.595280+0000", 2024-04-18T21:07:21.120 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.079e-06 2024-04-18T21:07:21.120 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.120 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.120 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:21.121 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600237+0000", 2024-04-18T21:07:21.121 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0049569089999999998 2024-04-18T21:07:21.121 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.121 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.121 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:21.121 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600254+0000", 2024-04-18T21:07:21.121 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7399000000000001e-05 2024-04-18T21:07:21.121 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.121 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.121 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:21.121 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600262+0000", 2024-04-18T21:07:21.121 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.174e-06 2024-04-18T21:07:21.121 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.121 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.121 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:21.121 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600359+0000", 2024-04-18T21:07:21.122 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.6358000000000001e-05 2024-04-18T21:07:21.122 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.122 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.122 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:21.122 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600507+0000", 2024-04-18T21:07:21.122 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014854199999999999 2024-04-18T21:07:21.122 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.122 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.122 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:21.122 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600748+0000", 2024-04-18T21:07:21.122 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000241361 2024-04-18T21:07:21.122 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.122 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.122 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:21.122 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.615590+0000", 2024-04-18T21:07:21.122 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.014841851 2024-04-18T21:07:21.123 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.123 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.123 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:21.123 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.639817+0000", 2024-04-18T21:07:21.123 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024226527000000001 2024-04-18T21:07:21.123 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.123 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.123 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:21.123 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.640962+0000", 2024-04-18T21:07:21.123 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001145561 2024-04-18T21:07:21.123 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.123 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.123 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:21.123 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.641180+0000", 2024-04-18T21:07:21.123 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00021763800000000001 2024-04-18T21:07:21.123 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:21.124 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:21.124 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:21.124 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.124 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.124 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11443 4.38 4:1d691e75:::1000000312c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T21:07:21.124 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:58.744218+0000", 2024-04-18T21:07:21.124 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 22.370055802, 2024-04-18T21:07:21.124 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.051074359999999999, 2024-04-18T21:07:21.124 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:21.124 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:21.124 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:21.124 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:21.124 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:21.124 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:21.124 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11443 2024-04-18T21:07:21.124 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.125 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:21.125 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.125 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:21.125 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.744218+0000", 2024-04-18T21:07:21.125 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:21.125 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.125 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.125 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:21.125 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.744218+0000", 2024-04-18T21:07:21.125 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:21.125 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.125 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.125 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:21.125 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.744221+0000", 2024-04-18T21:07:21.125 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.3580000000000001e-06 2024-04-18T21:07:21.125 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.126 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.126 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:21.126 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753328+0000", 2024-04-18T21:07:21.126 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0091071339999999994 2024-04-18T21:07:21.126 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.126 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.126 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:21.126 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753351+0000", 2024-04-18T21:07:21.126 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.3479999999999999e-05 2024-04-18T21:07:21.126 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.126 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.127 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:21.127 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753363+0000", 2024-04-18T21:07:21.127 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1345000000000001e-05 2024-04-18T21:07:21.127 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.127 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.127 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:21.127 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753416+0000", 2024-04-18T21:07:21.127 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.2849999999999997e-05 2024-04-18T21:07:21.127 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.127 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.127 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:21.127 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753471+0000", 2024-04-18T21:07:21.127 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5717999999999997e-05 2024-04-18T21:07:21.127 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.128 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.128 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:21.128 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753560+0000", 2024-04-18T21:07:21.128 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8777999999999996e-05 2024-04-18T21:07:21.128 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.128 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.128 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:21.128 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.760182+0000", 2024-04-18T21:07:21.128 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0066216299999999999 2024-04-18T21:07:21.128 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.128 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.128 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:21.128 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.795094+0000", 2024-04-18T21:07:21.129 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.034912334000000003 2024-04-18T21:07:21.129 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.129 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.129 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:21.129 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.795221+0000", 2024-04-18T21:07:21.129 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012745899999999999 2024-04-18T21:07:21.129 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.129 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.129 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:21.129 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.795293+0000", 2024-04-18T21:07:21.129 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.1273999999999996e-05 2024-04-18T21:07:21.129 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:21.129 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:21.129 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:21.130 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.130 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.130 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11511 4.18 4:184fae4a:::1000000316d.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:21.130 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:58.838500+0000", 2024-04-18T21:07:21.130 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 22.275773921999999, 2024-04-18T21:07:21.130 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.044451537999999999, 2024-04-18T21:07:21.130 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:21.130 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:21.130 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:21.130 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:21.130 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:21.130 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:21.130 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11511 2024-04-18T21:07:21.130 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.130 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:21.131 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.131 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:21.131 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.838500+0000", 2024-04-18T21:07:21.131 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:21.131 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.131 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.131 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:21.131 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.838500+0000", 2024-04-18T21:07:21.131 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:21.131 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.131 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.131 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:21.131 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.838501+0000", 2024-04-18T21:07:21.131 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.4799999999999997e-07 2024-04-18T21:07:21.132 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.132 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.132 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:21.132 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.847806+0000", 2024-04-18T21:07:21.132 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0093054250000000008 2024-04-18T21:07:21.132 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.132 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.132 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:21.132 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.847834+0000", 2024-04-18T21:07:21.132 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7161999999999998e-05 2024-04-18T21:07:21.132 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.132 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.132 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:21.132 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.847849+0000", 2024-04-18T21:07:21.132 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5217e-05 2024-04-18T21:07:21.133 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.133 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.133 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:21.133 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.847917+0000", 2024-04-18T21:07:21.133 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7896000000000002e-05 2024-04-18T21:07:21.133 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.133 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.133 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:21.133 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.848080+0000", 2024-04-18T21:07:21.133 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016328299999999999 2024-04-18T21:07:21.133 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.133 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.133 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:21.133 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.848348+0000", 2024-04-18T21:07:21.133 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00026766099999999998 2024-04-18T21:07:21.134 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.134 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.134 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:21.134 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.863288+0000", 2024-04-18T21:07:21.134 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.014940301 2024-04-18T21:07:21.134 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.134 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.134 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:21.134 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.882854+0000", 2024-04-18T21:07:21.134 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019566456999999999 2024-04-18T21:07:21.134 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.134 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.134 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:21.135 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.882904+0000", 2024-04-18T21:07:21.135 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.9620999999999998e-05 2024-04-18T21:07:21.135 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.135 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.135 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:21.135 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.882952+0000", 2024-04-18T21:07:21.135 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.7766999999999999e-05 2024-04-18T21:07:21.135 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:21.135 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:21.135 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:21.135 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.135 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.135 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11728 4.39 4:9dcc5ecf:::1000000316e.00000000:head [write 0~4194304 [2@1720266]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:21.135 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.088728+0000", 2024-04-18T21:07:21.136 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 22.025546055, 2024-04-18T21:07:21.136 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.047519835000000003, 2024-04-18T21:07:21.136 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:21.136 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:21.136 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:21.136 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:21.136 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:21.136 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:21.136 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11728 2024-04-18T21:07:21.136 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.136 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:21.136 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.136 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:21.136 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.088728+0000", 2024-04-18T21:07:21.136 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:21.136 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.137 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.137 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:21.137 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.088728+0000", 2024-04-18T21:07:21.137 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:21.137 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.137 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.137 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:21.137 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.088729+0000", 2024-04-18T21:07:21.137 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1000000000000001e-06 2024-04-18T21:07:21.137 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.137 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.137 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:21.137 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094322+0000", 2024-04-18T21:07:21.137 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0055931349999999999 2024-04-18T21:07:21.137 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.137 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.138 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:21.138 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094334+0000", 2024-04-18T21:07:21.138 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1894e-05 2024-04-18T21:07:21.138 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.138 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.138 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:21.138 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094340+0000", 2024-04-18T21:07:21.138 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.8780000000000003e-06 2024-04-18T21:07:21.138 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.138 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.138 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:21.138 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094393+0000", 2024-04-18T21:07:21.138 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3275000000000001e-05 2024-04-18T21:07:21.138 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.138 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.139 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:21.139 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094479+0000", 2024-04-18T21:07:21.139 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5222999999999994e-05 2024-04-18T21:07:21.139 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.139 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.139 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:21.139 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094629+0000", 2024-04-18T21:07:21.139 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00015021699999999999 2024-04-18T21:07:21.139 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.139 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.139 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:21.139 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.102975+0000", 2024-04-18T21:07:21.139 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0083464460000000004 2024-04-18T21:07:21.139 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.140 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.140 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:21.140 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136142+0000", 2024-04-18T21:07:21.140 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.033166432000000003 2024-04-18T21:07:21.140 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.140 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.140 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:21.140 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136207+0000", 2024-04-18T21:07:21.140 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.5032999999999999e-05 2024-04-18T21:07:21.140 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.140 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.140 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:21.140 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136248+0000", 2024-04-18T21:07:21.140 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.1202000000000003e-05 2024-04-18T21:07:21.140 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:21.141 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:21.141 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:21.141 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.141 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.141 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11847 4.a 4:51f063b7:::100000032b5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:21.141 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.229180+0000", 2024-04-18T21:07:21.141 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 21.885093998999999, 2024-04-18T21:07:21.141 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.048001033999999998, 2024-04-18T21:07:21.141 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:21.141 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:21.141 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:21.141 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:21.141 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:21.141 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:21.142 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11847 2024-04-18T21:07:21.142 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.142 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:21.142 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.142 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:21.142 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.229180+0000", 2024-04-18T21:07:21.142 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:21.142 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.142 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.142 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:21.142 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.229180+0000", 2024-04-18T21:07:21.142 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:21.142 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.143 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.143 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:21.143 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.229181+0000", 2024-04-18T21:07:21.143 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.119e-06 2024-04-18T21:07:21.143 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.143 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.143 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:21.143 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.235951+0000", 2024-04-18T21:07:21.143 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0067702370000000001 2024-04-18T21:07:21.143 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.143 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.143 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:21.144 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.235965+0000", 2024-04-18T21:07:21.144 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3202e-05 2024-04-18T21:07:21.144 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.144 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.144 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:21.144 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.235973+0000", 2024-04-18T21:07:21.144 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8630000000000008e-06 2024-04-18T21:07:21.144 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.144 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.144 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:21.144 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.236047+0000", 2024-04-18T21:07:21.144 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.4453e-05 2024-04-18T21:07:21.144 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.144 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.145 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:21.145 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.236137+0000", 2024-04-18T21:07:21.145 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.9751000000000002e-05 2024-04-18T21:07:21.145 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.145 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.145 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:21.145 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.236266+0000", 2024-04-18T21:07:21.145 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000129257 2024-04-18T21:07:21.145 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.145 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.145 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:21.145 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.244520+0000", 2024-04-18T21:07:21.145 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0082538190000000008 2024-04-18T21:07:21.145 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.146 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.146 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:21.146 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.277093+0000", 2024-04-18T21:07:21.146 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.032573405999999999 2024-04-18T21:07:21.146 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.146 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.146 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:21.146 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.277144+0000", 2024-04-18T21:07:21.146 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.0553000000000002e-05 2024-04-18T21:07:21.146 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.146 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.146 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:21.146 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.277181+0000", 2024-04-18T21:07:21.147 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.7373999999999998e-05 2024-04-18T21:07:21.147 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:21.147 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:21.147 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:21.147 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.147 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.147 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11949 4.2b 4:d50cc3c5:::100000031c6.00000000:head [write 0~3145728] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:21.147 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.338113+0000", 2024-04-18T21:07:21.147 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 21.776161123000001, 2024-04-18T21:07:21.147 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.046907847000000003, 2024-04-18T21:07:21.147 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:21.147 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:21.147 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:21.147 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:21.148 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:21.148 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:21.148 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11949 2024-04-18T21:07:21.148 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.148 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:21.148 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.148 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:21.148 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.338113+0000", 2024-04-18T21:07:21.148 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:21.148 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.148 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.148 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:21.148 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.338113+0000", 2024-04-18T21:07:21.148 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:21.148 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.148 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.148 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:21.149 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.338115+0000", 2024-04-18T21:07:21.149 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5659999999999999e-06 2024-04-18T21:07:21.149 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.149 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.149 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:21.149 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344146+0000", 2024-04-18T21:07:21.149 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0060309339999999999 2024-04-18T21:07:21.149 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.149 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.149 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:21.150 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344163+0000", 2024-04-18T21:07:21.150 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6994999999999999e-05 2024-04-18T21:07:21.150 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.150 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.150 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:21.150 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344171+0000", 2024-04-18T21:07:21.150 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5520000000000005e-06 2024-04-18T21:07:21.150 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.150 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.150 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:21.150 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344604+0000", 2024-04-18T21:07:21.150 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00043326299999999997 2024-04-18T21:07:21.150 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.150 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.151 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:21.151 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344687+0000", 2024-04-18T21:07:21.151 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.2952000000000001e-05 2024-04-18T21:07:21.151 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.151 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.151 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:21.151 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344792+0000", 2024-04-18T21:07:21.151 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000104635 2024-04-18T21:07:21.151 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.151 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.151 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:21.151 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.361867+0000", 2024-04-18T21:07:21.151 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017075245999999999 2024-04-18T21:07:21.151 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.151 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.151 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:21.152 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.384879+0000", 2024-04-18T21:07:21.152 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023011474000000001 2024-04-18T21:07:21.152 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.152 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.152 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:21.152 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.384976+0000", 2024-04-18T21:07:21.152 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.7399999999999996e-05 2024-04-18T21:07:21.152 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.152 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.152 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:21.152 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.385021+0000", 2024-04-18T21:07:21.152 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.4830000000000003e-05 2024-04-18T21:07:21.152 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:21.152 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:21.152 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:21.152 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.153 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.153 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:12041 4.38 4:1c8d9fef:::100000033ed.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:21.153 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.446812+0000", 2024-04-18T21:07:21.153 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 21.667461882000001, 2024-04-18T21:07:21.153 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.044749606999999997, 2024-04-18T21:07:21.153 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:21.153 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:21.153 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:21.153 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:21.153 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:21.153 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:21.153 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 12041 2024-04-18T21:07:21.153 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.153 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:21.154 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.154 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:21.154 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.446812+0000", 2024-04-18T21:07:21.154 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:21.154 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.154 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.154 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:21.154 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.446812+0000", 2024-04-18T21:07:21.154 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:21.154 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.154 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.154 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:21.154 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.446814+0000", 2024-04-18T21:07:21.154 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5099999999999999e-06 2024-04-18T21:07:21.155 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.155 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.155 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:21.155 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.452583+0000", 2024-04-18T21:07:21.155 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0057696379999999997 2024-04-18T21:07:21.155 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.155 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.155 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:21.155 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.452599+0000", 2024-04-18T21:07:21.155 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5701000000000001e-05 2024-04-18T21:07:21.155 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.155 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.155 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:21.156 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.452607+0000", 2024-04-18T21:07:21.156 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.7100000000000007e-06 2024-04-18T21:07:21.156 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.156 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.156 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:21.156 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.452718+0000", 2024-04-18T21:07:21.156 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000111257 2024-04-18T21:07:21.156 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.156 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.156 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:21.156 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.452924+0000", 2024-04-18T21:07:21.156 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000206066 2024-04-18T21:07:21.156 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.157 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.157 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:21.157 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.453088+0000", 2024-04-18T21:07:21.157 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016336700000000001 2024-04-18T21:07:21.157 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.157 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.157 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:21.157 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.469818+0000", 2024-04-18T21:07:21.157 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016730248999999999 2024-04-18T21:07:21.157 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.157 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.157 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:21.157 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.491505+0000", 2024-04-18T21:07:21.157 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021687366 2024-04-18T21:07:21.158 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.158 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.158 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:21.158 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.491537+0000", 2024-04-18T21:07:21.158 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.1888999999999999e-05 2024-04-18T21:07:21.158 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.158 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.158 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:21.158 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.491562+0000", 2024-04-18T21:07:21.158 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.4854e-05 2024-04-18T21:07:21.158 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:21.158 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:21.158 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:21.159 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.159 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.159 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_repop(client.4534.0:12689 4.26 e58/16 4:64a7f444:::100000033e5.00000000:head v 58'205, mlcod=58'203)", 2024-04-18T21:07:21.159 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:00.217785+0000", 2024-04-18T21:07:21.159 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 20.896489086999999, 2024-04-18T21:07:21.159 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.052245469000000003, 2024-04-18T21:07:21.159 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:21.159 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:21.159 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:21.159 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:21.159 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.159 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:21.159 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.217785+0000", 2024-04-18T21:07:21.159 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:21.160 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.160 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.160 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:21.160 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.217785+0000", 2024-04-18T21:07:21.160 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:21.160 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.160 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.160 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:21.160 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.217786+0000", 2024-04-18T21:07:21.160 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6700000000000002e-07 2024-04-18T21:07:21.160 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.160 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.160 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:21.160 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225111+0000", 2024-04-18T21:07:21.160 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0073251119999999999 2024-04-18T21:07:21.161 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.161 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.161 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:21.161 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225126+0000", 2024-04-18T21:07:21.161 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.541e-05 2024-04-18T21:07:21.161 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.161 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.161 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:21.161 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225137+0000", 2024-04-18T21:07:21.161 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0890000000000001e-05 2024-04-18T21:07:21.161 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.161 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.161 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:21.161 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225244+0000", 2024-04-18T21:07:21.162 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000106555 2024-04-18T21:07:21.162 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.162 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.162 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:21.162 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225276+0000", 2024-04-18T21:07:21.162 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.2574999999999999e-05 2024-04-18T21:07:21.162 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.162 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.162 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:21.162 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.269985+0000", 2024-04-18T21:07:21.162 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.044708422999999997 2024-04-18T21:07:21.162 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.162 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.162 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:21.163 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.270031+0000", 2024-04-18T21:07:21.163 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.5636999999999997e-05 2024-04-18T21:07:21.163 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:21.163 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:21.163 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:21.163 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.163 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.163 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:12692 4.3a 4:5c788ec1:::100000032ff.00000000:head [write 0~4194304 [2@945974]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:21.163 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:00.225134+0000", 2024-04-18T21:07:21.163 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 20.889140032, 2024-04-18T21:07:21.163 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.048311640000000003, 2024-04-18T21:07:21.163 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:21.163 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:21.163 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:21.164 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:21.164 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:21.164 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:21.164 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 12692 2024-04-18T21:07:21.164 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.164 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:21.164 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.164 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:21.164 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225134+0000", 2024-04-18T21:07:21.164 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:21.164 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.164 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.164 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:21.164 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225134+0000", 2024-04-18T21:07:21.165 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:21.165 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.165 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.165 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:21.165 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225136+0000", 2024-04-18T21:07:21.165 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4160000000000001e-06 2024-04-18T21:07:21.165 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.165 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.165 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:21.165 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231408+0000", 2024-04-18T21:07:21.165 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.006272517 2024-04-18T21:07:21.165 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.165 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.165 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:21.165 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231437+0000", 2024-04-18T21:07:21.165 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.9119e-05 2024-04-18T21:07:21.166 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.166 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.166 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:21.166 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231456+0000", 2024-04-18T21:07:21.166 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8544999999999999e-05 2024-04-18T21:07:21.166 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.166 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.166 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:21.166 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231579+0000", 2024-04-18T21:07:21.166 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000123762 2024-04-18T21:07:21.167 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.167 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.167 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:21.167 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231690+0000", 2024-04-18T21:07:21.167 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000110349 2024-04-18T21:07:21.167 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.167 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.167 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:21.167 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231903+0000", 2024-04-18T21:07:21.167 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000212695 2024-04-18T21:07:21.167 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.168 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.168 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:21.168 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.253911+0000", 2024-04-18T21:07:21.168 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.022008706999999999 2024-04-18T21:07:21.168 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.168 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.168 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:21.168 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.273383+0000", 2024-04-18T21:07:21.168 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019471568000000002 2024-04-18T21:07:21.168 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.168 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.168 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:21.168 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.273418+0000", 2024-04-18T21:07:21.168 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.5265999999999997e-05 2024-04-18T21:07:21.168 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.169 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.169 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:21.169 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.273446+0000", 2024-04-18T21:07:21.169 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7696e-05 2024-04-18T21:07:21.169 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:21.169 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:21.169 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:21.169 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.169 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.169 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:15094 4.c 4:32870457:::10000003692.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-18T21:07:21.169 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:03.107374+0000", 2024-04-18T21:07:21.169 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 18.006899707999999, 2024-04-18T21:07:21.169 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.061575983000000001, 2024-04-18T21:07:21.169 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:21.170 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:21.170 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:21.170 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:21.170 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:21.170 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:21.170 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 15094 2024-04-18T21:07:21.170 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.170 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:21.170 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.170 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:21.170 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.107374+0000", 2024-04-18T21:07:21.170 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:21.171 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.171 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.171 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:21.171 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.107374+0000", 2024-04-18T21:07:21.171 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:21.171 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.171 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.171 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:21.171 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.107376+0000", 2024-04-18T21:07:21.171 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3969999999999999e-06 2024-04-18T21:07:21.171 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.171 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.171 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:21.171 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115698+0000", 2024-04-18T21:07:21.171 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0083223989999999994 2024-04-18T21:07:21.171 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.172 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.172 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:21.172 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115713+0000", 2024-04-18T21:07:21.172 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4385e-05 2024-04-18T21:07:21.172 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.172 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.172 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:21.172 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115722+0000", 2024-04-18T21:07:21.172 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0759999999999992e-06 2024-04-18T21:07:21.172 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.172 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.172 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:21.172 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115784+0000", 2024-04-18T21:07:21.172 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.2348999999999995e-05 2024-04-18T21:07:21.172 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.173 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.173 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:21.173 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115849+0000", 2024-04-18T21:07:21.173 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.4964999999999999e-05 2024-04-18T21:07:21.173 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.173 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.173 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:21.173 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.116054+0000", 2024-04-18T21:07:21.173 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020483400000000001 2024-04-18T21:07:21.173 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.173 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.173 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:21.173 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.125769+0000", 2024-04-18T21:07:21.173 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0097153340000000008 2024-04-18T21:07:21.173 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.173 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.174 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:21.174 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.168834+0000", 2024-04-18T21:07:21.174 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043064527999999998 2024-04-18T21:07:21.174 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.174 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.174 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:21.174 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.168882+0000", 2024-04-18T21:07:21.174 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.7919e-05 2024-04-18T21:07:21.174 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.174 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.174 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:21.174 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.168950+0000", 2024-04-18T21:07:21.174 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.8796999999999999e-05 2024-04-18T21:07:21.174 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:21.175 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:21.175 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:21.175 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.175 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.175 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:15133 4.38 4:1c73eb83:::1000000398c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-18T21:07:21.175 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:03.155031+0000", 2024-04-18T21:07:21.175 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 17.959243167, 2024-04-18T21:07:21.175 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.044078787000000001, 2024-04-18T21:07:21.175 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:21.175 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:21.175 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:21.175 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:21.175 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:21.176 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:21.176 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 15133 2024-04-18T21:07:21.176 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.176 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:21.176 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.176 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:21.176 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.155031+0000", 2024-04-18T21:07:21.176 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:21.176 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.176 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.176 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:21.176 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.155031+0000", 2024-04-18T21:07:21.176 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:21.176 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.177 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.177 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:21.177 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.155033+0000", 2024-04-18T21:07:21.177 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.84e-06 2024-04-18T21:07:21.177 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.177 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.177 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:21.177 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.161994+0000", 2024-04-18T21:07:21.177 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0069607779999999999 2024-04-18T21:07:21.177 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.177 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.177 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:21.177 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.162008+0000", 2024-04-18T21:07:21.177 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4399000000000001e-05 2024-04-18T21:07:21.177 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.177 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.178 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:21.178 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.162018+0000", 2024-04-18T21:07:21.178 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.7149999999999993e-06 2024-04-18T21:07:21.178 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.178 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.178 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:21.178 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.162073+0000", 2024-04-18T21:07:21.178 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4803999999999999e-05 2024-04-18T21:07:21.178 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.178 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.178 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:21.178 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.162215+0000", 2024-04-18T21:07:21.178 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014222900000000001 2024-04-18T21:07:21.178 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.179 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.179 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:21.179 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.162341+0000", 2024-04-18T21:07:21.179 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012579400000000001 2024-04-18T21:07:21.179 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.179 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.179 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:21.179 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.169445+0000", 2024-04-18T21:07:21.179 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0071040360000000002 2024-04-18T21:07:21.179 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.179 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.179 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:21.179 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.199046+0000", 2024-04-18T21:07:21.179 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.029601639999999999 2024-04-18T21:07:21.179 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.179 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.180 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:21.180 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.199082+0000", 2024-04-18T21:07:21.180 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.6134999999999999e-05 2024-04-18T21:07:21.180 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.180 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.180 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:21.180 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.199110+0000", 2024-04-18T21:07:21.180 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7416999999999999e-05 2024-04-18T21:07:21.180 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:21.180 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:21.180 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:21.180 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.180 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.180 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7616 4.d 4:b1f7eab6:::10000001d5f.00000000:head [delete] snapc 1=[] RETRY=2 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:21.181 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882522+0000", 2024-04-18T21:07:21.181 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 9.2317518159999992, 2024-04-18T21:07:21.181 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.086006255, 2024-04-18T21:07:21.181 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:21.181 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:21.181 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "reached pg", 2024-04-18T21:07:21.181 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:21.181 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.181 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:21.181 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882522+0000", 2024-04-18T21:07:21.181 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:21.181 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.181 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.181 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:21.181 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882522+0000", 2024-04-18T21:07:21.182 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:21.182 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.182 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.182 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:21.182 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882524+0000", 2024-04-18T21:07:21.182 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4720000000000001e-06 2024-04-18T21:07:21.182 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.182 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.182 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:21.182 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882531+0000", 2024-04-18T21:07:21.182 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7830000000000001e-06 2024-04-18T21:07:21.182 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.182 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.183 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:21.183 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882549+0000", 2024-04-18T21:07:21.183 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8765000000000001e-05 2024-04-18T21:07:21.183 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.183 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.183 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:21.183 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882562+0000", 2024-04-18T21:07:21.183 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3117e-05 2024-04-18T21:07:21.183 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.183 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.183 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:21.183 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882690+0000", 2024-04-18T21:07:21.183 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012794799999999999 2024-04-18T21:07:21.183 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.183 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.184 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op must wait for map", 2024-04-18T21:07:21.184 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882701+0000", 2024-04-18T21:07:21.184 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0215e-05 2024-04-18T21:07:21.184 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.184 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.184 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:21.184 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.891964+0000", 2024-04-18T21:07:21.184 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0092636130000000004 2024-04-18T21:07:21.184 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.184 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.184 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:21.184 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.891976+0000", 2024-04-18T21:07:21.185 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1973e-05 2024-04-18T21:07:21.185 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.185 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.185 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:21.185 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.959520+0000", 2024-04-18T21:07:21.185 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0675436009999999 2024-04-18T21:07:21.185 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.185 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.185 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for missing object", 2024-04-18T21:07:21.185 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.959662+0000", 2024-04-18T21:07:21.185 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014253000000000001 2024-04-18T21:07:21.185 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.185 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.185 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:21.185 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.968480+0000", 2024-04-18T21:07:21.185 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0088178409999999999 2024-04-18T21:07:21.186 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.186 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.186 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:21.186 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.968529+0000", 2024-04-18T21:07:21.186 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8396999999999998e-05 2024-04-18T21:07:21.186 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:21.186 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:21.186 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:21.186 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.186 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.186 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7628 4.31 4:8c97f9cd:::10000001d6c.00000000:head [delete] snapc 1=[] RETRY=2 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:21.186 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882610+0000", 2024-04-18T21:07:21.186 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 9.2316640860000003, 2024-04-18T21:07:21.186 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.08538018, 2024-04-18T21:07:21.186 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:21.187 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:21.187 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "reached pg", 2024-04-18T21:07:21.187 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:21.187 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.187 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:21.187 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882610+0000", 2024-04-18T21:07:21.187 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:21.187 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.187 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.187 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:21.187 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882610+0000", 2024-04-18T21:07:21.187 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:21.187 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.187 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.188 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:21.188 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882611+0000", 2024-04-18T21:07:21.188 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.4199999999999995e-07 2024-04-18T21:07:21.188 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.188 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.188 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:21.188 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882614+0000", 2024-04-18T21:07:21.188 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.4300000000000002e-06 2024-04-18T21:07:21.188 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.188 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.189 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:21.189 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882623+0000", 2024-04-18T21:07:21.189 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8740000000000001e-06 2024-04-18T21:07:21.189 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.189 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.189 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:21.189 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882629+0000", 2024-04-18T21:07:21.189 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.4330000000000001e-06 2024-04-18T21:07:21.189 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.189 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.189 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:21.189 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882706+0000", 2024-04-18T21:07:21.190 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.6280999999999997e-05 2024-04-18T21:07:21.190 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.190 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.190 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op must wait for map", 2024-04-18T21:07:21.190 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882715+0000", 2024-04-18T21:07:21.190 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.1679999999999993e-06 2024-04-18T21:07:21.190 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.190 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.190 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:21.190 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.889481+0000", 2024-04-18T21:07:21.190 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0067656979999999997 2024-04-18T21:07:21.190 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.190 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.190 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:21.190 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.889493+0000", 2024-04-18T21:07:21.191 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2451e-05 2024-04-18T21:07:21.191 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.191 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.191 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:21.191 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.940942+0000", 2024-04-18T21:07:21.191 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0514491720000001 2024-04-18T21:07:21.191 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.191 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.191 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for missing object", 2024-04-18T21:07:21.191 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.941134+0000", 2024-04-18T21:07:21.191 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019150600000000001 2024-04-18T21:07:21.191 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.191 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.191 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:21.192 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.967914+0000", 2024-04-18T21:07:21.192 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026780202999999999 2024-04-18T21:07:21.192 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.192 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.192 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:21.192 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.967990+0000", 2024-04-18T21:07:21.192 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.6322000000000006e-05 2024-04-18T21:07:21.192 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:21.192 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:21.192 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:21.192 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.192 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.192 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7630 4.d 4:b022c802:::10000001d6e.00000000:head [delete] snapc 1=[] RETRY=2 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:21.192 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882645+0000", 2024-04-18T21:07:21.192 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 9.2316288019999995, 2024-04-18T21:07:21.193 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0858072780000001, 2024-04-18T21:07:21.193 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:21.193 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:21.193 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "reached pg", 2024-04-18T21:07:21.193 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:21.193 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.193 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:21.193 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882645+0000", 2024-04-18T21:07:21.193 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:21.193 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.193 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.193 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:21.193 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882645+0000", 2024-04-18T21:07:21.193 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:21.193 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.193 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.194 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:21.194 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882646+0000", 2024-04-18T21:07:21.194 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.3599999999999999e-07 2024-04-18T21:07:21.194 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.194 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.194 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:21.194 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882648+0000", 2024-04-18T21:07:21.194 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.5809999999999999e-06 2024-04-18T21:07:21.194 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.194 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.194 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:21.194 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882655+0000", 2024-04-18T21:07:21.194 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7909999999999999e-06 2024-04-18T21:07:21.195 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.195 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.195 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:21.195 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882661+0000", 2024-04-18T21:07:21.195 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3920000000000002e-06 2024-04-18T21:07:21.195 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.195 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.195 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:21.195 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882825+0000", 2024-04-18T21:07:21.195 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016480100000000001 2024-04-18T21:07:21.195 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.195 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.195 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:07:21.195 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882840+0000", 2024-04-18T21:07:21.196 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4656e-05 2024-04-18T21:07:21.196 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.196 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.196 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:21.196 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.892020+0000", 2024-04-18T21:07:21.196 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0091804680000000007 2024-04-18T21:07:21.196 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.196 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.196 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:21.196 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.892026+0000", 2024-04-18T21:07:21.196 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4580000000000001e-06 2024-04-18T21:07:21.196 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.196 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.196 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:21.196 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.959913+0000", 2024-04-18T21:07:21.197 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.067887289 2024-04-18T21:07:21.197 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.197 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.197 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for missing object", 2024-04-18T21:07:21.197 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.960034+0000", 2024-04-18T21:07:21.197 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000120445 2024-04-18T21:07:21.197 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.197 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.197 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:21.197 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.968407+0000", 2024-04-18T21:07:21.197 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0083734010000000008 2024-04-18T21:07:21.197 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.197 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.198 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:21.198 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.968453+0000", 2024-04-18T21:07:21.198 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.5559999999999997e-05 2024-04-18T21:07:21.198 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:21.198 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:21.198 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:21.198 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.198 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.198 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7651 4.13 4:c9951bc5:::10000001e1b.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:21.198 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882696+0000", 2024-04-18T21:07:21.198 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 9.2315783889999992, 2024-04-18T21:07:21.198 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.088382095, 2024-04-18T21:07:21.198 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:21.198 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:21.199 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:21.199 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:21.199 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.199 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:21.199 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882696+0000", 2024-04-18T21:07:21.199 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:21.199 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.199 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.199 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:21.199 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882696+0000", 2024-04-18T21:07:21.199 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:21.199 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.199 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.199 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:21.199 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882696+0000", 2024-04-18T21:07:21.199 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.06e-07 2024-04-18T21:07:21.200 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.200 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.200 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:21.200 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882699+0000", 2024-04-18T21:07:21.200 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.1039999999999998e-06 2024-04-18T21:07:21.200 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.200 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.200 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:21.200 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882707+0000", 2024-04-18T21:07:21.200 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.593e-06 2024-04-18T21:07:21.200 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.200 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.200 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:21.201 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882712+0000", 2024-04-18T21:07:21.201 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.541e-06 2024-04-18T21:07:21.201 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.201 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.201 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:21.201 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882870+0000", 2024-04-18T21:07:21.201 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000157999 2024-04-18T21:07:21.201 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.201 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.201 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op must wait for map", 2024-04-18T21:07:21.201 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882885+0000", 2024-04-18T21:07:21.201 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4989e-05 2024-04-18T21:07:21.201 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.201 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.201 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:21.201 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.891447+0000", 2024-04-18T21:07:21.202 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0085618540000000007 2024-04-18T21:07:21.202 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.202 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.202 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:21.202 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.891457+0000", 2024-04-18T21:07:21.202 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.6399999999999992e-06 2024-04-18T21:07:21.202 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.202 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.202 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:21.202 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.964840+0000", 2024-04-18T21:07:21.202 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.073383279 2024-04-18T21:07:21.202 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.202 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.202 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:21.202 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.965078+0000", 2024-04-18T21:07:21.202 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000237581 2024-04-18T21:07:21.203 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.203 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.203 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:21.203 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.965299+0000", 2024-04-18T21:07:21.203 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00022087699999999999 2024-04-18T21:07:21.203 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.203 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.203 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:21.203 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.969505+0000", 2024-04-18T21:07:21.203 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.004206123 2024-04-18T21:07:21.203 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.203 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.203 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:21.203 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.970898+0000", 2024-04-18T21:07:21.204 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001393434 2024-04-18T21:07:21.204 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.204 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.204 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:21.204 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.970936+0000", 2024-04-18T21:07:21.204 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.7647000000000001e-05 2024-04-18T21:07:21.204 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.204 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.204 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:21.204 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.971078+0000", 2024-04-18T21:07:21.204 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014192799999999999 2024-04-18T21:07:21.205 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:21.205 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:21.205 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:21.205 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.205 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.205 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7671 4.31 4:8c95a1b7:::10000001e2f.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:21.205 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882728+0000", 2024-04-18T21:07:21.205 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 9.2315465539999995, 2024-04-18T21:07:21.205 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.084467606, 2024-04-18T21:07:21.205 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:21.205 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:21.205 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:21.205 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:21.206 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.206 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:21.206 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882728+0000", 2024-04-18T21:07:21.206 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:21.206 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.206 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.206 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:21.206 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882728+0000", 2024-04-18T21:07:21.206 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:21.206 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.206 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.206 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:21.206 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882728+0000", 2024-04-18T21:07:21.207 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.0399999999999996e-07 2024-04-18T21:07:21.207 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.207 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.207 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:21.207 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882731+0000", 2024-04-18T21:07:21.207 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.5239999999999999e-06 2024-04-18T21:07:21.207 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.207 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.207 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:21.207 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882739+0000", 2024-04-18T21:07:21.207 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4020000000000002e-06 2024-04-18T21:07:21.207 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.207 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.207 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:21.207 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882744+0000", 2024-04-18T21:07:21.208 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.1410000000000004e-06 2024-04-18T21:07:21.208 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.208 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.208 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:21.208 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882836+0000", 2024-04-18T21:07:21.208 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.2094000000000003e-05 2024-04-18T21:07:21.208 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.208 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.208 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:07:21.208 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882849+0000", 2024-04-18T21:07:21.208 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3087e-05 2024-04-18T21:07:21.208 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.208 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.209 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:21.209 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.889522+0000", 2024-04-18T21:07:21.209 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0066730950000000004 2024-04-18T21:07:21.209 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.209 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.210 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:21.210 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.889530+0000", 2024-04-18T21:07:21.210 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8699999999999992e-06 2024-04-18T21:07:21.210 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.210 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.210 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:21.210 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.941173+0000", 2024-04-18T21:07:21.210 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.051642658 2024-04-18T21:07:21.210 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.210 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.210 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:21.211 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.941392+0000", 2024-04-18T21:07:21.211 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00021854099999999999 2024-04-18T21:07:21.211 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.211 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.211 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:21.211 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.941618+0000", 2024-04-18T21:07:21.211 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0002265 2024-04-18T21:07:21.211 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.211 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.211 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:21.211 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.945390+0000", 2024-04-18T21:07:21.211 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0037723460000000002 2024-04-18T21:07:21.211 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.212 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.212 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:21.212 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.966905+0000", 2024-04-18T21:07:21.212 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021514559999999999 2024-04-18T21:07:21.212 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.212 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.212 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:21.212 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.966972+0000", 2024-04-18T21:07:21.212 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.6740000000000001e-05 2024-04-18T21:07:21.212 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.212 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.212 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:21.212 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.967195+0000", 2024-04-18T21:07:21.213 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000223544 2024-04-18T21:07:21.213 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:21.213 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:21.213 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:21.213 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.213 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.213 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7691 4.d 4:b0345396:::10000001e43.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:21.213 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882753+0000", 2024-04-18T21:07:21.213 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 9.2315215750000004, 2024-04-18T21:07:21.213 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.085135618, 2024-04-18T21:07:21.213 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:21.213 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:21.213 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:21.213 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:21.213 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.214 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:21.214 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882753+0000", 2024-04-18T21:07:21.214 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:21.214 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.214 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.214 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:21.214 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882753+0000", 2024-04-18T21:07:21.214 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:21.214 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.214 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.214 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:21.214 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882753+0000", 2024-04-18T21:07:21.214 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.9000000000000002e-07 2024-04-18T21:07:21.214 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.215 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.215 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:21.215 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882755+0000", 2024-04-18T21:07:21.215 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.4040000000000002e-06 2024-04-18T21:07:21.215 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.215 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.215 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:21.215 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882762+0000", 2024-04-18T21:07:21.215 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.6229999999999999e-06 2024-04-18T21:07:21.215 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.215 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.215 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:21.215 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882769+0000", 2024-04-18T21:07:21.215 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.1559999999999998e-06 2024-04-18T21:07:21.216 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.216 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.216 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:21.216 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882875+0000", 2024-04-18T21:07:21.216 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000105491 2024-04-18T21:07:21.216 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.216 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.216 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:07:21.217 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882879+0000", 2024-04-18T21:07:21.217 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.9999999999999998e-06 2024-04-18T21:07:21.217 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.217 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.217 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:21.217 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.892072+0000", 2024-04-18T21:07:21.217 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0091930989999999997 2024-04-18T21:07:21.217 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.218 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.218 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:21.218 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.892083+0000", 2024-04-18T21:07:21.218 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1070000000000001e-05 2024-04-18T21:07:21.218 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.218 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.218 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:21.219 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.960162+0000", 2024-04-18T21:07:21.219 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0680791869999999 2024-04-18T21:07:21.219 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.219 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.219 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:21.219 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.960314+0000", 2024-04-18T21:07:21.219 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000152139 2024-04-18T21:07:21.219 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.219 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.219 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:21.219 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.960469+0000", 2024-04-18T21:07:21.219 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000154444 2024-04-18T21:07:21.219 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.219 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.220 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:21.220 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.964018+0000", 2024-04-18T21:07:21.220 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035494179999999999 2024-04-18T21:07:21.220 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.220 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.220 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:21.220 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.967680+0000", 2024-04-18T21:07:21.220 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.003662046 2024-04-18T21:07:21.220 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.220 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.220 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:21.220 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.967738+0000", 2024-04-18T21:07:21.220 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.7946999999999999e-05 2024-04-18T21:07:21.220 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.220 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.221 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:21.221 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.967888+0000", 2024-04-18T21:07:21.221 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000150204 2024-04-18T21:07:21.221 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:21.221 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:21.221 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:21.221 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.221 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.221 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:17090 4.39 4:9d5d3d9b:::100000020cf.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e69)", 2024-04-18T21:07:21.221 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:20.889261+0000", 2024-04-18T21:07:21.221 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.22501358699999999, 2024-04-18T21:07:21.221 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043495370999999998, 2024-04-18T21:07:21.221 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:21.221 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:21.221 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:21.222 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:21.222 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.222 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:21.222 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889261+0000", 2024-04-18T21:07:21.222 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:21.222 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.222 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.222 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:21.222 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889261+0000", 2024-04-18T21:07:21.222 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:21.222 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.222 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.222 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:21.222 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889261+0000", 2024-04-18T21:07:21.223 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.0500000000000003e-07 2024-04-18T21:07:21.223 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.223 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.223 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:21.223 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889264+0000", 2024-04-18T21:07:21.223 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.0570000000000001e-06 2024-04-18T21:07:21.223 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.223 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.223 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:21.223 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889273+0000", 2024-04-18T21:07:21.223 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6500000000000002e-06 2024-04-18T21:07:21.223 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.223 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.223 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:21.223 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889279+0000", 2024-04-18T21:07:21.223 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.5629999999999997e-06 2024-04-18T21:07:21.224 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.224 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.224 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:21.224 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889329+0000", 2024-04-18T21:07:21.224 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.9929000000000003e-05 2024-04-18T21:07:21.224 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.224 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.224 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:21.224 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889448+0000", 2024-04-18T21:07:21.224 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011830800000000001 2024-04-18T21:07:21.224 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.224 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.224 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:21.224 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889557+0000", 2024-04-18T21:07:21.224 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000108923 2024-04-18T21:07:21.224 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.225 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.225 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:21.225 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.890930+0000", 2024-04-18T21:07:21.225 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001372938 2024-04-18T21:07:21.225 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.225 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.225 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:21.225 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.932626+0000", 2024-04-18T21:07:21.225 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.041696735999999998 2024-04-18T21:07:21.225 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.225 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.225 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:21.225 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.932692+0000", 2024-04-18T21:07:21.225 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.6177e-05 2024-04-18T21:07:21.226 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.226 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.226 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:21.226 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.932756+0000", 2024-04-18T21:07:21.226 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.3485000000000006e-05 2024-04-18T21:07:21.226 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:21.226 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:21.226 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:21.226 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.226 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.226 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:17096 4.3c 4:3d6bd5a0:::100000020d5.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e69)", 2024-04-18T21:07:21.226 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:20.889704+0000", 2024-04-18T21:07:21.226 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.22457063099999999, 2024-04-18T21:07:21.226 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043604966000000002, 2024-04-18T21:07:21.227 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:21.227 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:21.227 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:21.227 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:21.227 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.227 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:21.227 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889704+0000", 2024-04-18T21:07:21.227 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:21.227 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.227 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.227 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:21.227 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889704+0000", 2024-04-18T21:07:21.227 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:21.227 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.227 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.228 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:21.228 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889704+0000", 2024-04-18T21:07:21.228 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.0699999999999996e-07 2024-04-18T21:07:21.228 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.228 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.228 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:21.228 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889708+0000", 2024-04-18T21:07:21.228 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.1509999999999997e-06 2024-04-18T21:07:21.228 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.228 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.228 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:21.228 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889718+0000", 2024-04-18T21:07:21.228 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0929999999999992e-06 2024-04-18T21:07:21.228 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.228 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.229 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:21.229 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889724+0000", 2024-04-18T21:07:21.229 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.883e-06 2024-04-18T21:07:21.229 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.229 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.229 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:21.229 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889783+0000", 2024-04-18T21:07:21.229 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.8217000000000002e-05 2024-04-18T21:07:21.229 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.229 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.229 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:21.229 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889877+0000", 2024-04-18T21:07:21.229 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.4494999999999996e-05 2024-04-18T21:07:21.230 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.230 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.230 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:21.230 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889947+0000", 2024-04-18T21:07:21.230 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.9702000000000005e-05 2024-04-18T21:07:21.230 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.230 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.230 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:21.230 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.890981+0000", 2024-04-18T21:07:21.230 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0010340659999999999 2024-04-18T21:07:21.230 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.230 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.230 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:21.230 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.933196+0000", 2024-04-18T21:07:21.231 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.042215036999999997 2024-04-18T21:07:21.231 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.231 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.231 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:21.231 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.933252+0000", 2024-04-18T21:07:21.231 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.6029999999999997e-05 2024-04-18T21:07:21.231 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:21.231 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:21.231 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:21.231 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.933308+0000", 2024-04-18T21:07:21.231 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.6484999999999999e-05 2024-04-18T21:07:21.231 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:21.231 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:21.231 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:21.232 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:21.232 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:21.232 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:07:21.233 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:07:21.233 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:21.233+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:21.334 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:21.334+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:21.364 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:07:21.364 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:07:21.365 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-04-18T21:07:21.365 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:07:21.378 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:07:21.435 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:21.437+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:21.474 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-18T21:07:21.536 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:21.534+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:21.544 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:07:21.544 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:07:21.544 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-18T21:07:21.545 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-18T21:07:21.545 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:07:21.559 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:21.637 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:21.637+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:21.662 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-04-18T21:07:21.662 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-18T21:07:21.731 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:07:21.731 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-18T21:07:21.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-18T21:07:21.731 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:07:21.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.732 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:108 3.1f 3:f83d65d8:::200.00000004:head [write 326287~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:21.732 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:07:21.732 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 35.971776920000003, 2024-04-18T21:07:21.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056616183, 2024-04-18T21:07:21.732 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:21.732 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:21.732 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:21.732 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:21.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.732 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:21.732 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:07:21.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:21.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:21.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:07:21.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:21.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:21.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758084+0000", 2024-04-18T21:07:21.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.124e-06 2024-04-18T21:07:21.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:21.734 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758100+0000", 2024-04-18T21:07:21.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6246e-05 2024-04-18T21:07:21.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.734 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:21.734 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758118+0000", 2024-04-18T21:07:21.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8267e-05 2024-04-18T21:07:21.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.734 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:21.734 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758134+0000", 2024-04-18T21:07:21.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5950000000000001e-05 2024-04-18T21:07:21.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:21.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803949+0000", 2024-04-18T21:07:21.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045815349999999998 2024-04-18T21:07:21.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:21.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804011+0000", 2024-04-18T21:07:21.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1044999999999996e-05 2024-04-18T21:07:21.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:21.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804128+0000", 2024-04-18T21:07:21.736 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117148 2024-04-18T21:07:21.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.736 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:21.736 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806794+0000", 2024-04-18T21:07:21.736 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002666692 2024-04-18T21:07:21.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.736 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:21.736 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814645+0000", 2024-04-18T21:07:21.736 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0078508880000000003 2024-04-18T21:07:21.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.736 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:21.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814678+0000", 2024-04-18T21:07:21.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3188999999999997e-05 2024-04-18T21:07:21.737 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.737 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:21.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814699+0000", 2024-04-18T21:07:21.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0284000000000001e-05 2024-04-18T21:07:21.737 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:21.737 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:21.737 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:21.737 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.737 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:109 3.1f 3:f83d65d8:::200.00000004:head [write 327693~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:21.737 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:07:21.737 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 35.971707553000002, 2024-04-18T21:07:21.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056621036999999999, 2024-04-18T21:07:21.738 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:21.738 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:21.738 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:21.738 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:21.738 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.738 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:21.738 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:07:21.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:21.738 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.738 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.738 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:21.738 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:07:21.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:21.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:21.739 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758153+0000", 2024-04-18T21:07:21.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1459999999999999e-06 2024-04-18T21:07:21.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:21.739 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758161+0000", 2024-04-18T21:07:21.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7999999999999999e-06 2024-04-18T21:07:21.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:21.739 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758179+0000", 2024-04-18T21:07:21.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7949999999999999e-05 2024-04-18T21:07:21.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.740 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:21.740 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758193+0000", 2024-04-18T21:07:21.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3773e-05 2024-04-18T21:07:21.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.740 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:21.740 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804632+0000", 2024-04-18T21:07:21.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.046439469999999997 2024-04-18T21:07:21.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.740 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:21.740 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804790+0000", 2024-04-18T21:07:21.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015784300000000001 2024-04-18T21:07:21.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:21.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805056+0000", 2024-04-18T21:07:21.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026652400000000003 2024-04-18T21:07:21.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:21.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.808959+0000", 2024-04-18T21:07:21.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003903077 2024-04-18T21:07:21.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:21.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814728+0000", 2024-04-18T21:07:21.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0057682489999999996 2024-04-18T21:07:21.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.742 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:21.742 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814754+0000", 2024-04-18T21:07:21.742 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6673999999999999e-05 2024-04-18T21:07:21.742 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.742 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.742 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:21.742 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814773+0000", 2024-04-18T21:07:21.742 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8530999999999999e-05 2024-04-18T21:07:21.742 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:21.742 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:21.742 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:21.742 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.742 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.743 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:110 3.1f 3:f83d65d8:::200.00000004:head [write 329098~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:21.743 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:07:21.743 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 35.971649143999997, 2024-04-18T21:07:21.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056669113, 2024-04-18T21:07:21.743 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:21.743 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:21.743 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:21.743 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:21.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:21.743 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:07:21.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:21.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:21.744 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:07:21.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:21.744 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.744 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.744 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:21.744 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758212+0000", 2024-04-18T21:07:21.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:07:21.744 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.744 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.744 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:21.744 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758219+0000", 2024-04-18T21:07:21.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4229999999999999e-06 2024-04-18T21:07:21.744 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.744 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.745 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:21.745 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758237+0000", 2024-04-18T21:07:21.745 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7966999999999999e-05 2024-04-18T21:07:21.745 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.745 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.745 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:21.745 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758252+0000", 2024-04-18T21:07:21.745 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5322999999999999e-05 2024-04-18T21:07:21.745 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.745 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.745 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:21.745 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805536+0000", 2024-04-18T21:07:21.745 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.047283861000000003 2024-04-18T21:07:21.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:21.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805579+0000", 2024-04-18T21:07:21.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2738999999999999e-05 2024-04-18T21:07:21.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:21.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805649+0000", 2024-04-18T21:07:21.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0213e-05 2024-04-18T21:07:21.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:21.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.808966+0000", 2024-04-18T21:07:21.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033166129999999999 2024-04-18T21:07:21.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:21.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814812+0000", 2024-04-18T21:07:21.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0058463589999999998 2024-04-18T21:07:21.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:21.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814854+0000", 2024-04-18T21:07:21.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1618e-05 2024-04-18T21:07:21.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.748 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:21.748 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814879+0000", 2024-04-18T21:07:21.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5754000000000001e-05 2024-04-18T21:07:21.748 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:21.748 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:21.748 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:21.748 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.748 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:111 3.1f 3:f83d65d8:::200.00000004:head [write 330499~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:21.748 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:07:21.748 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 35.971588167999997, 2024-04-18T21:07:21.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058693793000000001, 2024-04-18T21:07:21.748 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:21.748 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:21.748 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:21.749 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:21.749 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.749 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:21.749 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:07:21.749 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:21.749 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.749 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.749 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:21.749 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:07:21.749 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:21.749 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.749 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.749 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:21.749 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758272+0000", 2024-04-18T21:07:21.749 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1200000000000001e-06 2024-04-18T21:07:21.750 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.750 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.750 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:21.750 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758287+0000", 2024-04-18T21:07:21.750 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5017e-05 2024-04-18T21:07:21.750 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.750 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.750 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:21.750 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758309+0000", 2024-04-18T21:07:21.750 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1866e-05 2024-04-18T21:07:21.750 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.750 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.750 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:21.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758323+0000", 2024-04-18T21:07:21.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3606e-05 2024-04-18T21:07:21.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:21.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806279+0000", 2024-04-18T21:07:21.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.047956061000000001 2024-04-18T21:07:21.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:21.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806350+0000", 2024-04-18T21:07:21.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1070999999999998e-05 2024-04-18T21:07:21.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.752 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:21.752 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806459+0000", 2024-04-18T21:07:21.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000108606 2024-04-18T21:07:21.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.752 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:21.752 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.809774+0000", 2024-04-18T21:07:21.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003314881 2024-04-18T21:07:21.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.752 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:21.752 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816910+0000", 2024-04-18T21:07:21.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0071367760000000001 2024-04-18T21:07:21.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.753 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:21.753 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816941+0000", 2024-04-18T21:07:21.753 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0846000000000002e-05 2024-04-18T21:07:21.753 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.753 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:21.753 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816965+0000", 2024-04-18T21:07:21.753 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3943000000000001e-05 2024-04-18T21:07:21.753 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:21.753 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:21.753 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:21.753 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.753 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:12689 4.26 4:64a7f444:::100000033e5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:21.753 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:00.208067+0000", 2024-04-18T21:07:21.754 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 21.521792752, 2024-04-18T21:07:21.754 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066681457, 2024-04-18T21:07:21.754 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:21.754 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:21.754 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:21.754 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:07:21.754 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:07:21.754 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:21.754 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 12689 2024-04-18T21:07:21.754 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.754 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:21.754 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.754 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:21.754 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.208067+0000", 2024-04-18T21:07:21.755 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:21.755 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.755 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.755 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:21.755 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.208067+0000", 2024-04-18T21:07:21.755 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:21.755 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.755 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.755 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:21.755 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.208069+0000", 2024-04-18T21:07:21.755 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1500000000000002e-06 2024-04-18T21:07:21.755 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.756 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:21.756 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216162+0000", 2024-04-18T21:07:21.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0080933159999999997 2024-04-18T21:07:21.756 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.756 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:21.756 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216181+0000", 2024-04-18T21:07:21.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8573e-05 2024-04-18T21:07:21.756 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.756 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:21.756 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216192+0000", 2024-04-18T21:07:21.757 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0767999999999999e-05 2024-04-18T21:07:21.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.757 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.757 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:21.757 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216259+0000", 2024-04-18T21:07:21.757 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7977000000000003e-05 2024-04-18T21:07:21.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.757 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.757 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:21.757 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216635+0000", 2024-04-18T21:07:21.757 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00037591300000000002 2024-04-18T21:07:21.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.757 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.757 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:21.758 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216929+0000", 2024-04-18T21:07:21.758 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00029314800000000002 2024-04-18T21:07:21.758 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.758 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.758 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:21.758 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.232918+0000", 2024-04-18T21:07:21.758 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015989903 2024-04-18T21:07:21.758 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.758 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.758 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:21.758 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.274643+0000", 2024-04-18T21:07:21.758 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.041724281000000002 2024-04-18T21:07:21.758 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.758 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.759 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:21.759 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.274701+0000", 2024-04-18T21:07:21.759 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8304999999999998e-05 2024-04-18T21:07:21.759 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.759 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:21.759 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.274748+0000", 2024-04-18T21:07:21.759 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7123000000000003e-05 2024-04-18T21:07:21.759 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:21.759 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:21.759 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:21.759 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.759 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:7694 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-18T21:07:21.760 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:11.672522+0000", 2024-04-18T21:07:21.760 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 10.057337712000001, 2024-04-18T21:07:21.760 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2954970370000001, 2024-04-18T21:07:21.760 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:21.760 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:21.760 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:21.760 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:21.760 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.760 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:21.760 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672522+0000", 2024-04-18T21:07:21.760 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:21.760 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.760 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.761 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:21.761 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672522+0000", 2024-04-18T21:07:21.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:21.761 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.761 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.761 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:21.761 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672525+0000", 2024-04-18T21:07:21.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.366e-06 2024-04-18T21:07:21.761 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.761 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.761 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:21.761 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672540+0000", 2024-04-18T21:07:21.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4949999999999999e-05 2024-04-18T21:07:21.761 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.761 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.762 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:21.762 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672569+0000", 2024-04-18T21:07:21.762 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8714999999999999e-05 2024-04-18T21:07:21.762 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.762 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.762 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:21.762 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672581+0000", 2024-04-18T21:07:21.762 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1949e-05 2024-04-18T21:07:21.762 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.762 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.762 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:21.762 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672704+0000", 2024-04-18T21:07:21.762 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000122915 2024-04-18T21:07:21.762 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.763 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:21.763 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672714+0000", 2024-04-18T21:07:21.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0698e-05 2024-04-18T21:07:21.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.763 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:21.763 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.910993+0000", 2024-04-18T21:07:21.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.23827911199999999 2024-04-18T21:07:21.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.763 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:21.763 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.911017+0000", 2024-04-18T21:07:21.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3419999999999999e-05 2024-04-18T21:07:21.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.764 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.764 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:21.764 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.952146+0000", 2024-04-18T21:07:21.764 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0411288869999999 2024-04-18T21:07:21.764 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.764 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.764 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:21.764 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.952467+0000", 2024-04-18T21:07:21.764 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00032165399999999999 2024-04-18T21:07:21.764 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.764 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.764 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:21.764 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.954086+0000", 2024-04-18T21:07:21.765 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0016184820000000001 2024-04-18T21:07:21.765 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.765 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.765 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:21.765 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.960573+0000", 2024-04-18T21:07:21.765 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064874240000000003 2024-04-18T21:07:21.765 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.765 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.765 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:21.765 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.967786+0000", 2024-04-18T21:07:21.765 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0072125069999999999 2024-04-18T21:07:21.765 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.765 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.765 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:21.766 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.967897+0000", 2024-04-18T21:07:21.766 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111679 2024-04-18T21:07:21.766 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.766 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.766 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:21.766 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.968019+0000", 2024-04-18T21:07:21.766 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000121279 2024-04-18T21:07:21.766 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:21.766 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:21.766 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:21.766 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.766 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.766 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:7696 3.f 3:f376ae95:::200.00000016:head [write 3681546~512758 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:21.766 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:12.760706+0000", 2024-04-18T21:07:21.767 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.9691533099999994, 2024-04-18T21:07:21.767 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.24998282899999999, 2024-04-18T21:07:21.767 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:21.767 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:21.767 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:21.767 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:21.767 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.767 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:21.767 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.760706+0000", 2024-04-18T21:07:21.767 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:21.767 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.767 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.767 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:21.767 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.760706+0000", 2024-04-18T21:07:21.767 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:21.767 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.768 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.768 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:21.768 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.760710+0000", 2024-04-18T21:07:21.768 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2100000000000003e-06 2024-04-18T21:07:21.768 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.768 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.768 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:21.768 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.761972+0000", 2024-04-18T21:07:21.768 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0012615689999999999 2024-04-18T21:07:21.768 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.768 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.768 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:21.768 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762012+0000", 2024-04-18T21:07:21.768 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0145999999999998e-05 2024-04-18T21:07:21.768 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.768 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.769 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:21.769 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762030+0000", 2024-04-18T21:07:21.769 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8312999999999999e-05 2024-04-18T21:07:21.769 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.769 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.769 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:21.769 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762158+0000", 2024-04-18T21:07:21.769 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012805600000000001 2024-04-18T21:07:21.769 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.769 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.769 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:21.769 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762174+0000", 2024-04-18T21:07:21.769 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5645999999999999e-05 2024-04-18T21:07:21.769 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.770 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.770 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:21.770 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.926080+0000", 2024-04-18T21:07:21.770 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.16390581900000001 2024-04-18T21:07:21.770 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.770 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.770 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for missing object", 2024-04-18T21:07:21.770 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.926149+0000", 2024-04-18T21:07:21.770 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9172999999999997e-05 2024-04-18T21:07:21.770 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.770 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.770 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:21.770 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.002156+0000", 2024-04-18T21:07:21.771 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.076006972000000006 2024-04-18T21:07:21.771 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.771 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.771 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for rw locks", 2024-04-18T21:07:21.771 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.002294+0000", 2024-04-18T21:07:21.771 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000138011 2024-04-18T21:07:21.771 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.771 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.771 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:21.771 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.005436+0000", 2024-04-18T21:07:21.771 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031422749999999999 2024-04-18T21:07:21.771 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.771 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.771 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:21.772 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.005577+0000", 2024-04-18T21:07:21.772 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014105399999999999 2024-04-18T21:07:21.772 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.772 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.772 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:21.772 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.005725+0000", 2024-04-18T21:07:21.772 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014721100000000001 2024-04-18T21:07:21.772 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.772 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.772 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:21.772 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.009143+0000", 2024-04-18T21:07:21.772 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0034179380000000001 2024-04-18T21:07:21.772 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.772 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.772 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:21.773 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.010522+0000", 2024-04-18T21:07:21.773 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0013790919999999999 2024-04-18T21:07:21.773 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.773 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.773 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:21.773 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.010586+0000", 2024-04-18T21:07:21.773 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4713000000000002e-05 2024-04-18T21:07:21.773 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.773 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.773 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:21.773 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.010689+0000", 2024-04-18T21:07:21.773 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000102631 2024-04-18T21:07:21.773 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:21.773 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:21.774 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:21.774 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.774 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.774 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:7697 3.16 3:6b6b4f13:::200.0000001c:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:21.774 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:12.762074+0000", 2024-04-18T21:07:21.774 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.9677851620000002, 2024-04-18T21:07:21.774 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.2056489, 2024-04-18T21:07:21.774 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:21.774 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:21.774 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:07:21.774 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:21.774 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.774 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:21.775 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762074+0000", 2024-04-18T21:07:21.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:21.775 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.775 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.775 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:21.775 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762074+0000", 2024-04-18T21:07:21.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:21.775 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.775 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.775 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:21.775 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762076+0000", 2024-04-18T21:07:21.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.793e-06 2024-04-18T21:07:21.775 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.775 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.775 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:21.776 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762083+0000", 2024-04-18T21:07:21.776 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7129999999999999e-06 2024-04-18T21:07:21.776 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.776 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.776 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:21.776 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762104+0000", 2024-04-18T21:07:21.776 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1480000000000001e-05 2024-04-18T21:07:21.776 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.776 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.776 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:21.776 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762121+0000", 2024-04-18T21:07:21.776 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.632e-05 2024-04-18T21:07:21.776 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.776 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.777 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:21.777 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762224+0000", 2024-04-18T21:07:21.777 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010346800000000001 2024-04-18T21:07:21.777 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.777 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.777 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:21.777 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762238+0000", 2024-04-18T21:07:21.777 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3482999999999999e-05 2024-04-18T21:07:21.777 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.777 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.777 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:21.777 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.946932+0000", 2024-04-18T21:07:21.777 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.18469451000000001 2024-04-18T21:07:21.777 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.777 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.778 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:21.778 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.947261+0000", 2024-04-18T21:07:21.778 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00032857399999999999 2024-04-18T21:07:21.778 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.778 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.778 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:21.778 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.967723+0000", 2024-04-18T21:07:21.778 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020462559000000002 2024-04-18T21:07:21.778 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:21.778 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:21.778 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:21.778 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.778 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.778 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:10831 4.13 4:c948684f:::1000000032e.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:21.778 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.823266+0000", 2024-04-18T21:07:21.779 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 5.906593773, 2024-04-18T21:07:21.779 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.65275881599999996, 2024-04-18T21:07:21.779 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:21.779 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:21.779 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:21.779 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:21.779 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.779 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:21.779 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823266+0000", 2024-04-18T21:07:21.779 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:21.779 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.779 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.779 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:21.779 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823266+0000", 2024-04-18T21:07:21.779 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:21.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:21.780 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823266+0000", 2024-04-18T21:07:21.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9800000000000004e-07 2024-04-18T21:07:21.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:21.780 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823269+0000", 2024-04-18T21:07:21.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3259999999999998e-06 2024-04-18T21:07:21.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:21.780 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823274+0000", 2024-04-18T21:07:21.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9830000000000001e-06 2024-04-18T21:07:21.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.781 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.781 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:21.781 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823280+0000", 2024-04-18T21:07:21.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1540000000000001e-06 2024-04-18T21:07:21.781 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.781 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.781 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:21.781 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823313+0000", 2024-04-18T21:07:21.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3667000000000001e-05 2024-04-18T21:07:21.781 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.781 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.781 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:21.781 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823321+0000", 2024-04-18T21:07:21.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1200000000000002e-06 2024-04-18T21:07:21.781 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.782 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.782 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:21.782 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.470069+0000", 2024-04-18T21:07:21.782 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.64674728999999997 2024-04-18T21:07:21.782 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.782 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.782 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:21.782 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.470457+0000", 2024-04-18T21:07:21.782 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00038800899999999998 2024-04-18T21:07:21.782 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.782 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.782 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:21.782 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.470755+0000", 2024-04-18T21:07:21.782 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00029781399999999998 2024-04-18T21:07:21.782 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.783 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.783 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:21.783 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.474041+0000", 2024-04-18T21:07:21.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032860670000000002 2024-04-18T21:07:21.783 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.783 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.783 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:21.783 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.475621+0000", 2024-04-18T21:07:21.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001579925 2024-04-18T21:07:21.783 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.783 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.783 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:21.783 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.475750+0000", 2024-04-18T21:07:21.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000129002 2024-04-18T21:07:21.783 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.784 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.784 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:21.784 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.476024+0000", 2024-04-18T21:07:21.784 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000274961 2024-04-18T21:07:21.784 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:21.784 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:21.784 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:21.784 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.784 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.784 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11326 4.13 4:cbbbc9f0:::100000010c6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:21.784 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.917113+0000", 2024-04-18T21:07:21.784 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 5.8127465709999999, 2024-04-18T21:07:21.784 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.56159817899999998, 2024-04-18T21:07:21.784 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:21.784 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:21.785 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:21.785 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:21.785 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.785 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:21.785 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917113+0000", 2024-04-18T21:07:21.785 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:21.785 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.785 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.785 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:21.785 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917113+0000", 2024-04-18T21:07:21.785 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:21.785 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.785 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.785 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:21.786 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917114+0000", 2024-04-18T21:07:21.786 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5099999999999999e-07 2024-04-18T21:07:21.786 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.786 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.786 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:21.786 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917123+0000", 2024-04-18T21:07:21.786 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5859999999999994e-06 2024-04-18T21:07:21.786 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.786 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.786 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:21.786 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917130+0000", 2024-04-18T21:07:21.786 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9800000000000001e-06 2024-04-18T21:07:21.786 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.786 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.787 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:21.787 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917136+0000", 2024-04-18T21:07:21.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.502e-06 2024-04-18T21:07:21.787 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.787 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.787 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:21.787 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917239+0000", 2024-04-18T21:07:21.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000103286 2024-04-18T21:07:21.787 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.787 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.787 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:21.787 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917247+0000", 2024-04-18T21:07:21.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.49e-06 2024-04-18T21:07:21.787 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:21.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.472462+0000", 2024-04-18T21:07:21.788 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.55521418899999997 2024-04-18T21:07:21.788 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:21.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.472801+0000", 2024-04-18T21:07:21.788 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00033935600000000002 2024-04-18T21:07:21.788 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:21.789 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.473101+0000", 2024-04-18T21:07:21.789 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030031399999999998 2024-04-18T21:07:21.789 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.789 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.789 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:21.789 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.475574+0000", 2024-04-18T21:07:21.789 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0024732310000000002 2024-04-18T21:07:21.789 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.789 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.789 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:21.789 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.478287+0000", 2024-04-18T21:07:21.789 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027122349999999999 2024-04-18T21:07:21.790 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.790 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.790 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:21.790 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.478467+0000", 2024-04-18T21:07:21.790 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000180645 2024-04-18T21:07:21.790 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.790 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.790 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:21.790 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.478711+0000", 2024-04-18T21:07:21.790 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024371399999999999 2024-04-18T21:07:21.790 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:21.790 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:21.790 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:21.790 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.791 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.791 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11394 4.13 4:cb2e645e:::10000001109.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:21.791 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.925453+0000", 2024-04-18T21:07:21.791 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 5.8044060479999997, 2024-04-18T21:07:21.791 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.55363756900000005, 2024-04-18T21:07:21.791 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:21.791 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:21.791 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:21.791 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:21.791 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.791 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:21.791 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925453+0000", 2024-04-18T21:07:21.791 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:21.791 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.794 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.794 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:21.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925453+0000", 2024-04-18T21:07:21.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:21.794 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.794 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.794 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:21.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925454+0000", 2024-04-18T21:07:21.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1699999999999997e-07 2024-04-18T21:07:21.794 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.794 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.795 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:21.795 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925458+0000", 2024-04-18T21:07:21.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7280000000000001e-06 2024-04-18T21:07:21.795 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.795 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:21.795 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925467+0000", 2024-04-18T21:07:21.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7169999999999997e-06 2024-04-18T21:07:21.795 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.795 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:21.795 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925474+0000", 2024-04-18T21:07:21.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1350000000000003e-06 2024-04-18T21:07:21.795 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.795 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:21.796 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925523+0000", 2024-04-18T21:07:21.796 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9616000000000001e-05 2024-04-18T21:07:21.796 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.796 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.796 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:21.796 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925530+0000", 2024-04-18T21:07:21.796 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0099999999999998e-06 2024-04-18T21:07:21.796 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.796 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.796 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:21.796 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.474474+0000", 2024-04-18T21:07:21.796 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.548943242 2024-04-18T21:07:21.796 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.796 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.796 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:21.797 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.474692+0000", 2024-04-18T21:07:21.797 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00021829799999999999 2024-04-18T21:07:21.797 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.797 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.797 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:21.797 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.474879+0000", 2024-04-18T21:07:21.797 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000187095 2024-04-18T21:07:21.797 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.797 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.797 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:21.797 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.478733+0000", 2024-04-18T21:07:21.797 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003853871 2024-04-18T21:07:21.798 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.798 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:21.798 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.478840+0000", 2024-04-18T21:07:21.798 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000106623 2024-04-18T21:07:21.798 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.798 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:21.798 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.478919+0000", 2024-04-18T21:07:21.798 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9326000000000006e-05 2024-04-18T21:07:21.798 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:21.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479091+0000", 2024-04-18T21:07:21.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000172091 2024-04-18T21:07:21.799 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:21.799 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:21.799 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:21.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.799 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11417 4.13 4:cae4f303:::1000000111f.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:21.799 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.927998+0000", 2024-04-18T21:07:21.799 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 5.8018614079999997, 2024-04-18T21:07:21.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.55142600900000005, 2024-04-18T21:07:21.800 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:21.800 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:21.800 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:21.800 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:21.800 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.800 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:21.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.927998+0000", 2024-04-18T21:07:21.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:21.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.800 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.800 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:21.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.927998+0000", 2024-04-18T21:07:21.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:21.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.801 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.801 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:21.801 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.927999+0000", 2024-04-18T21:07:21.801 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2800000000000005e-07 2024-04-18T21:07:21.801 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.801 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.801 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:21.801 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.928003+0000", 2024-04-18T21:07:21.801 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0060000000000003e-06 2024-04-18T21:07:21.801 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.801 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.801 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:21.801 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.928012+0000", 2024-04-18T21:07:21.801 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.4129999999999995e-06 2024-04-18T21:07:21.801 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.801 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.802 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:21.802 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.928019+0000", 2024-04-18T21:07:21.802 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5590000000000002e-06 2024-04-18T21:07:21.802 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.802 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.802 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:21.802 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.928075+0000", 2024-04-18T21:07:21.802 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5927000000000002e-05 2024-04-18T21:07:21.802 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.802 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.802 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:21.802 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.928091+0000", 2024-04-18T21:07:21.802 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5724999999999999e-05 2024-04-18T21:07:21.803 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.803 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:21.803 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.476117+0000", 2024-04-18T21:07:21.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.54802609899999999 2024-04-18T21:07:21.803 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.803 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:21.803 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.476310+0000", 2024-04-18T21:07:21.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019318100000000001 2024-04-18T21:07:21.803 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.804 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:21.804 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.476469+0000", 2024-04-18T21:07:21.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015902599999999999 2024-04-18T21:07:21.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.804 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:21.804 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479198+0000", 2024-04-18T21:07:21.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027292010000000001 2024-04-18T21:07:21.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.804 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:21.804 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479225+0000", 2024-04-18T21:07:21.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6483e-05 2024-04-18T21:07:21.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.805 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:21.805 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479301+0000", 2024-04-18T21:07:21.805 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5935999999999999e-05 2024-04-18T21:07:21.805 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.805 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.805 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:21.805 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479424+0000", 2024-04-18T21:07:21.805 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012352500000000001 2024-04-18T21:07:21.805 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:21.805 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:21.805 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:21.805 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.805 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.806 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11538 4.13 4:ca7a7383:::10000001196.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:21.806 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.942641+0000", 2024-04-18T21:07:21.806 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 5.787218727, 2024-04-18T21:07:21.806 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.538204715, 2024-04-18T21:07:21.806 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:21.806 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:21.806 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:21.806 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:21.806 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.806 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:21.806 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942641+0000", 2024-04-18T21:07:21.806 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:21.806 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.807 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.807 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:21.807 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942641+0000", 2024-04-18T21:07:21.807 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:21.807 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.807 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.807 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:21.807 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942641+0000", 2024-04-18T21:07:21.807 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4099999999999998e-07 2024-04-18T21:07:21.807 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.807 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.807 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:21.807 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942645+0000", 2024-04-18T21:07:21.808 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.788e-06 2024-04-18T21:07:21.808 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.808 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:21.808 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942654+0000", 2024-04-18T21:07:21.808 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2089999999999994e-06 2024-04-18T21:07:21.808 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.808 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:21.808 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942668+0000", 2024-04-18T21:07:21.808 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3925e-05 2024-04-18T21:07:21.808 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.808 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:21.808 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942898+0000", 2024-04-18T21:07:21.809 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00022961800000000001 2024-04-18T21:07:21.809 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.809 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:21.809 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942907+0000", 2024-04-18T21:07:21.809 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6219999999999998e-06 2024-04-18T21:07:21.809 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.809 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:21.809 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.477120+0000", 2024-04-18T21:07:21.809 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.53421297400000001 2024-04-18T21:07:21.809 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.810 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.810 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:21.810 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.477466+0000", 2024-04-18T21:07:21.810 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00034685899999999998 2024-04-18T21:07:21.810 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.810 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.810 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:21.810 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.477717+0000", 2024-04-18T21:07:21.810 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00025019799999999998 2024-04-18T21:07:21.810 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.810 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.810 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:21.810 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479518+0000", 2024-04-18T21:07:21.811 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00180105 2024-04-18T21:07:21.811 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.811 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.811 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:21.811 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.480481+0000", 2024-04-18T21:07:21.811 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00096356100000000004 2024-04-18T21:07:21.811 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.811 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.811 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:21.811 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.480618+0000", 2024-04-18T21:07:21.811 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013678599999999999 2024-04-18T21:07:21.811 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.811 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.811 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:21.812 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.480845+0000", 2024-04-18T21:07:21.812 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00022738399999999999 2024-04-18T21:07:21.812 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:21.812 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:21.812 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:21.812 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.812 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.812 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11574 4.13 4:c9cea989:::100000011b9.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:21.812 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.947550+0000", 2024-04-18T21:07:21.812 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 5.7823089860000003, 2024-04-18T21:07:21.812 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.53632730500000003, 2024-04-18T21:07:21.812 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:21.812 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:21.812 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:21.812 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:21.813 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.813 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:21.813 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947550+0000", 2024-04-18T21:07:21.813 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:21.813 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.813 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.813 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:21.813 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947550+0000", 2024-04-18T21:07:21.813 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:21.813 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.813 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.813 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:21.813 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947551+0000", 2024-04-18T21:07:21.813 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6599999999999996e-07 2024-04-18T21:07:21.813 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.814 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.814 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:21.814 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947554+0000", 2024-04-18T21:07:21.814 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6230000000000001e-06 2024-04-18T21:07:21.814 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.814 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.814 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:21.814 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947562+0000", 2024-04-18T21:07:21.814 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2179999999999999e-06 2024-04-18T21:07:21.814 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.814 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.814 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:21.814 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947567+0000", 2024-04-18T21:07:21.814 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3009999999999997e-06 2024-04-18T21:07:21.815 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.815 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.815 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:21.815 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947624+0000", 2024-04-18T21:07:21.815 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6823999999999997e-05 2024-04-18T21:07:21.815 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.815 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.815 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:21.815 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947633+0000", 2024-04-18T21:07:21.815 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9330000000000007e-06 2024-04-18T21:07:21.815 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.815 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.815 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:21.815 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479591+0000", 2024-04-18T21:07:21.815 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.53195765500000003 2024-04-18T21:07:21.816 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.816 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.816 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:21.816 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479781+0000", 2024-04-18T21:07:21.816 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000190034 2024-04-18T21:07:21.816 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.816 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.816 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:21.816 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479936+0000", 2024-04-18T21:07:21.816 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000154959 2024-04-18T21:07:21.816 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.816 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.816 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:21.817 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.483428+0000", 2024-04-18T21:07:21.817 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003492294 2024-04-18T21:07:21.817 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.817 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.817 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:21.817 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.483479+0000", 2024-04-18T21:07:21.817 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0868999999999997e-05 2024-04-18T21:07:21.817 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.817 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.817 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:21.817 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.483594+0000", 2024-04-18T21:07:21.817 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000115499 2024-04-18T21:07:21.817 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.817 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.817 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:21.817 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.483878+0000", 2024-04-18T21:07:21.818 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028352999999999999 2024-04-18T21:07:21.818 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:21.818 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:21.818 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:21.818 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.818 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.818 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11596 4.13 4:c88ce457:::100000011ce.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:21.818 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.955066+0000", 2024-04-18T21:07:21.818 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 5.7747935769999996, 2024-04-18T21:07:21.818 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.52924763200000002, 2024-04-18T21:07:21.818 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:21.818 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:21.818 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:21.818 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:21.819 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.819 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:21.819 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955066+0000", 2024-04-18T21:07:21.819 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:21.819 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.819 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.819 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:21.819 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955066+0000", 2024-04-18T21:07:21.819 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:21.819 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.819 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.819 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:21.819 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955066+0000", 2024-04-18T21:07:21.820 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4900000000000001e-07 2024-04-18T21:07:21.820 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.820 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.820 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:21.820 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955068+0000", 2024-04-18T21:07:21.820 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0190000000000001e-06 2024-04-18T21:07:21.820 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.820 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.820 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:21.820 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955076+0000", 2024-04-18T21:07:21.820 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.537e-06 2024-04-18T21:07:21.820 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.820 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.820 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:21.821 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955080+0000", 2024-04-18T21:07:21.821 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1760000000000003e-06 2024-04-18T21:07:21.821 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.821 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.821 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:21.821 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955129+0000", 2024-04-18T21:07:21.821 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8480999999999999e-05 2024-04-18T21:07:21.821 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.821 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.821 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:21.821 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955134+0000", 2024-04-18T21:07:21.821 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1610000000000002e-06 2024-04-18T21:07:21.821 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.821 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.821 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:21.821 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.480932+0000", 2024-04-18T21:07:21.822 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.52579809799999999 2024-04-18T21:07:21.822 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.822 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.822 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:21.822 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.481149+0000", 2024-04-18T21:07:21.822 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00021709100000000001 2024-04-18T21:07:21.822 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.822 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.822 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:21.822 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.481303+0000", 2024-04-18T21:07:21.822 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000153752 2024-04-18T21:07:21.822 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.822 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.822 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:21.823 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.483927+0000", 2024-04-18T21:07:21.823 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026241189999999998 2024-04-18T21:07:21.823 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.823 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.823 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:21.823 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.484028+0000", 2024-04-18T21:07:21.823 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010134899999999999 2024-04-18T21:07:21.823 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.823 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.823 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:21.823 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.484138+0000", 2024-04-18T21:07:21.823 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011015599999999999 2024-04-18T21:07:21.823 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.824 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.824 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:21.824 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.484314+0000", 2024-04-18T21:07:21.824 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017524399999999999 2024-04-18T21:07:21.824 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:21.824 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:21.824 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:21.824 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.824 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.824 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11800 4.13 4:cacc00c7:::10000001296.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:21.824 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.989042+0000", 2024-04-18T21:07:21.824 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 5.7408179090000004, 2024-04-18T21:07:21.824 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.49832004299999999, 2024-04-18T21:07:21.824 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:21.825 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:21.825 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:21.825 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:21.825 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.825 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:21.825 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989042+0000", 2024-04-18T21:07:21.825 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:21.825 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.825 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.825 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:21.825 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989042+0000", 2024-04-18T21:07:21.825 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:21.825 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.825 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.825 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:21.825 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989042+0000", 2024-04-18T21:07:21.826 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5200000000000002e-07 2024-04-18T21:07:21.826 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.826 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.826 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:21.826 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989044+0000", 2024-04-18T21:07:21.826 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2589999999999999e-06 2024-04-18T21:07:21.826 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.826 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.826 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:21.826 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989051+0000", 2024-04-18T21:07:21.826 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6340000000000003e-06 2024-04-18T21:07:21.826 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.826 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.826 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:21.827 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989062+0000", 2024-04-18T21:07:21.827 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1043000000000001e-05 2024-04-18T21:07:21.827 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.827 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.827 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:21.827 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989367+0000", 2024-04-18T21:07:21.827 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000305249 2024-04-18T21:07:21.827 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.827 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.827 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:21.827 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989376+0000", 2024-04-18T21:07:21.827 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4570000000000005e-06 2024-04-18T21:07:21.827 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.827 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.828 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:21.828 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.482011+0000", 2024-04-18T21:07:21.828 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.49263514200000003 2024-04-18T21:07:21.828 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.828 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.828 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:21.828 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.482397+0000", 2024-04-18T21:07:21.828 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000385986 2024-04-18T21:07:21.828 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.828 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.828 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:21.828 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.482689+0000", 2024-04-18T21:07:21.828 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00029179800000000001 2024-04-18T21:07:21.829 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.829 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.829 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:21.829 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.487008+0000", 2024-04-18T21:07:21.829 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043196129999999999 2024-04-18T21:07:21.829 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.829 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.829 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:21.829 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.487113+0000", 2024-04-18T21:07:21.829 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010498899999999999 2024-04-18T21:07:21.829 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.829 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.829 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:21.829 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.487192+0000", 2024-04-18T21:07:21.829 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8778999999999999e-05 2024-04-18T21:07:21.830 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.830 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.830 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:21.830 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.487362+0000", 2024-04-18T21:07:21.830 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016964200000000001 2024-04-18T21:07:21.830 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:21.830 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:21.830 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:21.830 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.830 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.830 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11888 4.13 4:ca460221:::10000002cd3.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:21.830 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:16.002068+0000", 2024-04-18T21:07:21.830 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 5.727791249, 2024-04-18T21:07:21.831 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.48938242199999998, 2024-04-18T21:07:21.831 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:21.831 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:21.831 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:21.831 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:21.831 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.831 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:21.831 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002068+0000", 2024-04-18T21:07:21.831 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:21.831 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.831 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.831 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:21.831 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002068+0000", 2024-04-18T21:07:21.831 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:21.832 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.832 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.832 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:21.832 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002069+0000", 2024-04-18T21:07:21.832 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7899999999999999e-07 2024-04-18T21:07:21.832 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.832 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.832 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:21.832 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002071+0000", 2024-04-18T21:07:21.832 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.356e-06 2024-04-18T21:07:21.832 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.832 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.832 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:21.832 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002078+0000", 2024-04-18T21:07:21.833 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.562e-06 2024-04-18T21:07:21.833 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.833 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.833 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:21.833 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002083+0000", 2024-04-18T21:07:21.833 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1939999999999997e-06 2024-04-18T21:07:21.833 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.833 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.833 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:21.833 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002125+0000", 2024-04-18T21:07:21.833 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2548e-05 2024-04-18T21:07:21.833 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.833 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.833 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:21.834 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002132+0000", 2024-04-18T21:07:21.834 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9360000000000002e-06 2024-04-18T21:07:21.834 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.834 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.834 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:21.834 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.484392+0000", 2024-04-18T21:07:21.834 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.48225933500000001 2024-04-18T21:07:21.834 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.834 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.834 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:21.834 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.484630+0000", 2024-04-18T21:07:21.834 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023872499999999999 2024-04-18T21:07:21.834 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.835 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.835 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:21.835 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.484812+0000", 2024-04-18T21:07:21.835 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000181232 2024-04-18T21:07:21.835 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.835 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.835 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:21.835 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.490995+0000", 2024-04-18T21:07:21.835 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0061831459999999996 2024-04-18T21:07:21.835 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.835 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.835 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:21.835 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491132+0000", 2024-04-18T21:07:21.835 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000137145 2024-04-18T21:07:21.835 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.836 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.836 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:21.836 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491219+0000", 2024-04-18T21:07:21.836 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7466000000000006e-05 2024-04-18T21:07:21.836 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.836 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.836 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:21.836 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491451+0000", 2024-04-18T21:07:21.836 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023129800000000001 2024-04-18T21:07:21.836 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:21.836 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:21.836 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:21.836 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.836 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.836 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:12057 4.13 4:cacbe4c4:::10000002d77.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:21.837 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:16.028144+0000", 2024-04-18T21:07:21.837 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 5.7017156379999996, 2024-04-18T21:07:21.837 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.46365036100000001, 2024-04-18T21:07:21.837 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:21.837 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:21.837 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:21.837 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:21.837 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.837 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:21.837 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028144+0000", 2024-04-18T21:07:21.837 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:21.837 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.837 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.838 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:21.838 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028144+0000", 2024-04-18T21:07:21.838 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:21.838 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.838 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.838 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:21.838 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028144+0000", 2024-04-18T21:07:21.838 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9800000000000003e-07 2024-04-18T21:07:21.838 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.838 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.838 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:21.838 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028147+0000", 2024-04-18T21:07:21.838 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.773e-06 2024-04-18T21:07:21.839 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.839 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.839 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:21.839 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028154+0000", 2024-04-18T21:07:21.839 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8940000000000004e-06 2024-04-18T21:07:21.839 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.839 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.839 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:21.839 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028160+0000", 2024-04-18T21:07:21.839 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7219999999999996e-06 2024-04-18T21:07:21.839 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.839 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.839 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:21.839 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028227+0000", 2024-04-18T21:07:21.840 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6711000000000006e-05 2024-04-18T21:07:21.840 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.840 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.840 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:21.840 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028250+0000", 2024-04-18T21:07:21.840 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3010000000000002e-05 2024-04-18T21:07:21.840 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.840 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.840 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:21.840 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.487484+0000", 2024-04-18T21:07:21.840 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.45923466600000001 2024-04-18T21:07:21.840 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.840 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.840 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:21.841 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.487750+0000", 2024-04-18T21:07:21.841 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026618799999999999 2024-04-18T21:07:21.841 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.841 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.841 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:21.841 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.487915+0000", 2024-04-18T21:07:21.841 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016425500000000001 2024-04-18T21:07:21.841 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.841 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.841 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:21.841 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491559+0000", 2024-04-18T21:07:21.841 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003644109 2024-04-18T21:07:21.841 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.841 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.842 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:21.842 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491586+0000", 2024-04-18T21:07:21.842 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.743e-05 2024-04-18T21:07:21.842 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.842 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.842 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:21.842 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491662+0000", 2024-04-18T21:07:21.842 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5978999999999999e-05 2024-04-18T21:07:21.842 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.842 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.842 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:21.842 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491794+0000", 2024-04-18T21:07:21.842 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013202600000000001 2024-04-18T21:07:21.842 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:21.842 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:21.843 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:21.843 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.843 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.843 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:12078 4.13 4:c93107e9:::10000002d8c.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:21.843 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:16.031090+0000", 2024-04-18T21:07:21.843 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 5.6987697720000003, 2024-04-18T21:07:21.843 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.461078355, 2024-04-18T21:07:21.843 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:21.843 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:21.843 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:21.843 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:21.843 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.843 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:21.843 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031090+0000", 2024-04-18T21:07:21.843 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:21.844 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.844 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.844 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:21.844 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031090+0000", 2024-04-18T21:07:21.844 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:21.844 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.844 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.844 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:21.844 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031090+0000", 2024-04-18T21:07:21.844 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6599999999999996e-07 2024-04-18T21:07:21.844 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.844 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.844 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:21.845 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031093+0000", 2024-04-18T21:07:21.845 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7659999999999999e-06 2024-04-18T21:07:21.845 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.845 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.845 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:21.845 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031099+0000", 2024-04-18T21:07:21.845 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2269999999999998e-06 2024-04-18T21:07:21.845 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.845 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.845 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:21.845 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031103+0000", 2024-04-18T21:07:21.845 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7929999999999999e-06 2024-04-18T21:07:21.845 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.845 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.845 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:21.846 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031147+0000", 2024-04-18T21:07:21.846 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3742000000000002e-05 2024-04-18T21:07:21.846 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.846 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.846 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:21.846 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031154+0000", 2024-04-18T21:07:21.846 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1999999999999997e-06 2024-04-18T21:07:21.846 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.846 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.846 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:21.846 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.488743+0000", 2024-04-18T21:07:21.846 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.45758900200000002 2024-04-18T21:07:21.846 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.846 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.847 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:21.847 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.488980+0000", 2024-04-18T21:07:21.847 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023704499999999999 2024-04-18T21:07:21.847 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.847 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.847 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:21.847 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.489166+0000", 2024-04-18T21:07:21.847 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018544500000000001 2024-04-18T21:07:21.847 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.847 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.847 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:21.847 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491810+0000", 2024-04-18T21:07:21.847 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026448219999999998 2024-04-18T21:07:21.847 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.847 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.847 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:21.847 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491903+0000", 2024-04-18T21:07:21.848 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2305999999999993e-05 2024-04-18T21:07:21.848 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.848 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.848 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:21.848 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491987+0000", 2024-04-18T21:07:21.848 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4581999999999998e-05 2024-04-18T21:07:21.848 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.848 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.848 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:21.848 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.492168+0000", 2024-04-18T21:07:21.848 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018075900000000001 2024-04-18T21:07:21.848 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:21.848 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:21.848 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:21.849 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.849 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.849 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:12081 4.13 4:cafa1dfa:::10000002d8f.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:21.849 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:16.031865+0000", 2024-04-18T21:07:21.849 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 5.6979947380000002, 2024-04-18T21:07:21.849 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.460588628, 2024-04-18T21:07:21.849 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:21.849 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:21.849 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:21.849 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:21.849 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.849 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:21.849 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031865+0000", 2024-04-18T21:07:21.849 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:21.849 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.849 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.850 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:21.850 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031865+0000", 2024-04-18T21:07:21.850 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:21.850 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.850 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.850 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:21.850 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031865+0000", 2024-04-18T21:07:21.850 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4799999999999998e-07 2024-04-18T21:07:21.850 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.850 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.850 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:21.850 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031868+0000", 2024-04-18T21:07:21.850 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6570000000000001e-06 2024-04-18T21:07:21.850 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.850 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.850 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:21.851 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031874+0000", 2024-04-18T21:07:21.851 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4370000000000004e-06 2024-04-18T21:07:21.851 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.851 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.851 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:21.851 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031879+0000", 2024-04-18T21:07:21.851 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8729999999999998e-06 2024-04-18T21:07:21.851 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.851 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.851 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:21.851 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031924+0000", 2024-04-18T21:07:21.851 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4314999999999998e-05 2024-04-18T21:07:21.851 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.851 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.852 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:21.852 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031929+0000", 2024-04-18T21:07:21.852 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9980000000000003e-06 2024-04-18T21:07:21.852 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.852 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.852 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:21.852 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.489813+0000", 2024-04-18T21:07:21.852 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.45788481800000003 2024-04-18T21:07:21.852 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.852 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.852 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:21.852 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.490188+0000", 2024-04-18T21:07:21.852 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00037420699999999999 2024-04-18T21:07:21.852 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.852 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.853 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:21.853 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.490423+0000", 2024-04-18T21:07:21.853 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023582400000000001 2024-04-18T21:07:21.853 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.853 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.853 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:21.853 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.492238+0000", 2024-04-18T21:07:21.853 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018143930000000001 2024-04-18T21:07:21.853 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.853 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.853 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:21.853 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.492256+0000", 2024-04-18T21:07:21.853 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7706999999999998e-05 2024-04-18T21:07:21.853 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.853 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.853 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:21.854 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.492323+0000", 2024-04-18T21:07:21.854 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7222000000000001e-05 2024-04-18T21:07:21.854 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:21.854 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:21.854 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:21.854 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.492453+0000", 2024-04-18T21:07:21.854 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000130529 2024-04-18T21:07:21.854 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:21.854 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:21.854 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:21.854 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:21.854 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:21.854 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:07:21.855 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2024-04-18T21:07:21.855 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-18T21:07:21.855 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-04-18T21:07:21.855 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-18T21:07:21.855 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-18T21:07:21.855 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-04-18T21:07:21.857 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:07:21.858 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:21.854+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:21.953 DEBUG:teuthology.parallel:result is None 2024-04-18T21:07:21.954 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-18T21:07:21.957 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:21.957+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:21.971 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-18T21:07:21.971 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-18T21:07:21.980 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-18T21:07:21.980 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-04-18T21:07:21.980 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-18T21:07:21.998 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:07:21.998 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:07:21.998 INFO:teuthology.orchestra.run.smithi132.stdout: "num_ops": 0 2024-04-18T21:07:21.998 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:07:21.998 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:07:21.998 INFO:teuthology.orchestra.run.smithi132.stdout: "success": "" 2024-04-18T21:07:21.998 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:07:22.015 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:07:22.017 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-04-18T21:07:22.017 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-18T21:07:22.059 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:22.061+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:22.069 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T21:07:22.158 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:22.158+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:22.176 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:07:22.178 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:07:22.178 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:07:22.178 INFO:teuthology.orchestra.run.smithi132.stdout: "complaint_time": 30, 2024-04-18T21:07:22.178 INFO:teuthology.orchestra.run.smithi132.stdout: "num_blocked_ops": 0 2024-04-18T21:07:22.178 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:07:22.192 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:07:22.259 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:22.258+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:22.322 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:07:22.322 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 20, 2024-04-18T21:07:22.322 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 600, 2024-04-18T21:07:22.322 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [ 2024-04-18T21:07:22.322 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.322 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:22.322 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:07:22.322 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 136.702423138, 2024-04-18T21:07:22.322 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043581898000000001, 2024-04-18T21:07:22.322 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:22.322 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:22.323 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:22.323 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:22.323 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.323 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:22.323 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:07:22.323 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:22.323 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.323 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.323 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:22.323 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:07:22.323 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:22.323 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.323 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.323 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:22.324 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616641+0000", 2024-04-18T21:07:22.324 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:07:22.324 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.324 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.324 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:22.324 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616648+0000", 2024-04-18T21:07:22.324 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3860000000000001e-06 2024-04-18T21:07:22.324 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.324 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.324 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:22.324 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616666+0000", 2024-04-18T21:07:22.324 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7583000000000001e-05 2024-04-18T21:07:22.324 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.324 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.325 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:22.325 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616679+0000", 2024-04-18T21:07:22.325 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3322999999999999e-05 2024-04-18T21:07:22.325 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.325 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.325 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:22.325 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630373+0000", 2024-04-18T21:07:22.325 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013694207999999999 2024-04-18T21:07:22.325 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.325 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.325 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:22.325 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630545+0000", 2024-04-18T21:07:22.326 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000171683 2024-04-18T21:07:22.326 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.326 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.326 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:22.326 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630728+0000", 2024-04-18T21:07:22.326 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000182599 2024-04-18T21:07:22.326 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.326 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.326 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:22.326 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640600+0000", 2024-04-18T21:07:22.326 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0098726119999999994 2024-04-18T21:07:22.326 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.326 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.327 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:22.327 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659927+0000", 2024-04-18T21:07:22.327 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019326724999999999 2024-04-18T21:07:22.327 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.327 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.327 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:22.327 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660112+0000", 2024-04-18T21:07:22.327 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000185203 2024-04-18T21:07:22.327 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.327 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.327 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:22.327 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660222+0000", 2024-04-18T21:07:22.327 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109343 2024-04-18T21:07:22.327 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:22.327 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:22.327 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:22.328 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.328 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.328 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11357 4.38 4:1d691e75:::1000000312c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T21:07:22.328 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:58.595279+0000", 2024-04-18T21:07:22.328 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 23.723784228, 2024-04-18T21:07:22.328 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.045901399000000002, 2024-04-18T21:07:22.328 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:22.328 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:22.328 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:22.328 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:22.328 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:22.328 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:22.328 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11357 2024-04-18T21:07:22.328 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.328 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:22.329 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.329 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:22.329 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.595279+0000", 2024-04-18T21:07:22.329 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:22.329 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.329 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.329 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:22.329 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.595279+0000", 2024-04-18T21:07:22.329 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:22.329 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.329 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.329 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:22.329 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.595280+0000", 2024-04-18T21:07:22.329 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.079e-06 2024-04-18T21:07:22.329 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.330 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.330 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:22.330 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600237+0000", 2024-04-18T21:07:22.330 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0049569089999999998 2024-04-18T21:07:22.330 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.330 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.330 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:22.330 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600254+0000", 2024-04-18T21:07:22.330 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7399000000000001e-05 2024-04-18T21:07:22.330 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.330 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.330 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:22.330 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600262+0000", 2024-04-18T21:07:22.330 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.174e-06 2024-04-18T21:07:22.330 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.331 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.331 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:22.331 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600359+0000", 2024-04-18T21:07:22.331 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.6358000000000001e-05 2024-04-18T21:07:22.331 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.331 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.331 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:22.331 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600507+0000", 2024-04-18T21:07:22.331 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014854199999999999 2024-04-18T21:07:22.331 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.331 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.331 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:22.331 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600748+0000", 2024-04-18T21:07:22.331 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000241361 2024-04-18T21:07:22.332 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.332 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.332 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:22.332 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.615590+0000", 2024-04-18T21:07:22.332 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.014841851 2024-04-18T21:07:22.332 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.332 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.332 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:22.332 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.639817+0000", 2024-04-18T21:07:22.332 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024226527000000001 2024-04-18T21:07:22.332 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.332 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.332 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:22.333 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.640962+0000", 2024-04-18T21:07:22.333 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001145561 2024-04-18T21:07:22.333 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.333 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.333 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:22.333 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.641180+0000", 2024-04-18T21:07:22.333 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00021763800000000001 2024-04-18T21:07:22.333 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:22.333 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:22.333 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:22.333 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.333 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.334 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11443 4.38 4:1d691e75:::1000000312c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T21:07:22.334 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:58.744218+0000", 2024-04-18T21:07:22.334 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 23.574844561999999, 2024-04-18T21:07:22.334 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.051074359999999999, 2024-04-18T21:07:22.334 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:22.334 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:22.334 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:22.334 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:22.334 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:22.334 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:22.334 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11443 2024-04-18T21:07:22.334 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.334 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:22.335 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.335 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:22.335 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.744218+0000", 2024-04-18T21:07:22.335 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:22.335 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.335 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.335 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:22.335 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.744218+0000", 2024-04-18T21:07:22.335 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:22.335 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.335 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.335 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:22.335 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.744221+0000", 2024-04-18T21:07:22.335 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.3580000000000001e-06 2024-04-18T21:07:22.335 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.336 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.336 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:22.336 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753328+0000", 2024-04-18T21:07:22.336 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0091071339999999994 2024-04-18T21:07:22.336 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.336 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.336 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:22.336 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753351+0000", 2024-04-18T21:07:22.336 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.3479999999999999e-05 2024-04-18T21:07:22.336 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.336 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.336 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:22.336 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753363+0000", 2024-04-18T21:07:22.336 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1345000000000001e-05 2024-04-18T21:07:22.336 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.337 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.337 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:22.337 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753416+0000", 2024-04-18T21:07:22.337 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.2849999999999997e-05 2024-04-18T21:07:22.337 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.337 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.337 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:22.337 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753471+0000", 2024-04-18T21:07:22.337 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5717999999999997e-05 2024-04-18T21:07:22.337 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.337 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.337 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:22.337 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753560+0000", 2024-04-18T21:07:22.337 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8777999999999996e-05 2024-04-18T21:07:22.337 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.337 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.338 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:22.338 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.760182+0000", 2024-04-18T21:07:22.338 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0066216299999999999 2024-04-18T21:07:22.338 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.338 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.338 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:22.338 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.795094+0000", 2024-04-18T21:07:22.338 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.034912334000000003 2024-04-18T21:07:22.338 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.338 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.338 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:22.338 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.795221+0000", 2024-04-18T21:07:22.338 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012745899999999999 2024-04-18T21:07:22.339 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.339 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.339 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:22.339 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.795293+0000", 2024-04-18T21:07:22.339 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.1273999999999996e-05 2024-04-18T21:07:22.339 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:22.339 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:22.339 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:22.339 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.339 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.339 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11511 4.18 4:184fae4a:::1000000316d.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:22.339 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:58.838500+0000", 2024-04-18T21:07:22.339 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 23.480562681999999, 2024-04-18T21:07:22.339 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.044451537999999999, 2024-04-18T21:07:22.339 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:22.340 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:22.340 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:22.340 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:22.340 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:22.340 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:22.340 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11511 2024-04-18T21:07:22.340 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.340 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:22.340 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.340 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:22.340 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.838500+0000", 2024-04-18T21:07:22.340 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:22.340 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.340 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.341 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:22.341 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.838500+0000", 2024-04-18T21:07:22.341 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:22.341 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.341 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.341 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:22.341 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.838501+0000", 2024-04-18T21:07:22.341 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.4799999999999997e-07 2024-04-18T21:07:22.341 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.341 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.341 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:22.341 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.847806+0000", 2024-04-18T21:07:22.341 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0093054250000000008 2024-04-18T21:07:22.341 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.341 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.341 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:22.341 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.847834+0000", 2024-04-18T21:07:22.342 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7161999999999998e-05 2024-04-18T21:07:22.342 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.342 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.342 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:22.342 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.847849+0000", 2024-04-18T21:07:22.342 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5217e-05 2024-04-18T21:07:22.342 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.342 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.342 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:22.342 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.847917+0000", 2024-04-18T21:07:22.342 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7896000000000002e-05 2024-04-18T21:07:22.342 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.342 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.342 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:22.342 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.848080+0000", 2024-04-18T21:07:22.343 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016328299999999999 2024-04-18T21:07:22.343 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.343 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.343 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:22.343 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.848348+0000", 2024-04-18T21:07:22.343 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00026766099999999998 2024-04-18T21:07:22.343 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.343 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.343 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:22.343 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.863288+0000", 2024-04-18T21:07:22.343 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.014940301 2024-04-18T21:07:22.343 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.343 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.344 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:22.344 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.882854+0000", 2024-04-18T21:07:22.344 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019566456999999999 2024-04-18T21:07:22.344 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.344 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.344 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:22.344 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.882904+0000", 2024-04-18T21:07:22.344 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.9620999999999998e-05 2024-04-18T21:07:22.344 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.344 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.344 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:22.344 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.882952+0000", 2024-04-18T21:07:22.344 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.7766999999999999e-05 2024-04-18T21:07:22.344 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:22.345 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:22.345 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:22.345 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.345 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.345 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11728 4.39 4:9dcc5ecf:::1000000316e.00000000:head [write 0~4194304 [2@1720266]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:22.345 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.088728+0000", 2024-04-18T21:07:22.345 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 23.230334814999999, 2024-04-18T21:07:22.345 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.047519835000000003, 2024-04-18T21:07:22.345 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:22.345 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:22.345 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:22.345 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:22.345 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:22.345 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:22.345 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11728 2024-04-18T21:07:22.346 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.346 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:22.346 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.346 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:22.346 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.088728+0000", 2024-04-18T21:07:22.346 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:22.346 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.346 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.346 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:22.346 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.088728+0000", 2024-04-18T21:07:22.346 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:22.346 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.346 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.347 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:22.347 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.088729+0000", 2024-04-18T21:07:22.347 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1000000000000001e-06 2024-04-18T21:07:22.347 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.347 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.347 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:22.347 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094322+0000", 2024-04-18T21:07:22.347 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0055931349999999999 2024-04-18T21:07:22.347 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.347 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.347 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:22.347 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094334+0000", 2024-04-18T21:07:22.347 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1894e-05 2024-04-18T21:07:22.347 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.347 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.347 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:22.348 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094340+0000", 2024-04-18T21:07:22.348 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.8780000000000003e-06 2024-04-18T21:07:22.348 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.348 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.348 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:22.348 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094393+0000", 2024-04-18T21:07:22.348 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3275000000000001e-05 2024-04-18T21:07:22.348 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.348 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.348 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:22.348 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094479+0000", 2024-04-18T21:07:22.348 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5222999999999994e-05 2024-04-18T21:07:22.348 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.348 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.349 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:22.349 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094629+0000", 2024-04-18T21:07:22.349 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00015021699999999999 2024-04-18T21:07:22.349 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.349 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.349 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:22.349 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.102975+0000", 2024-04-18T21:07:22.349 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0083464460000000004 2024-04-18T21:07:22.349 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.349 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.349 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:22.349 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136142+0000", 2024-04-18T21:07:22.349 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.033166432000000003 2024-04-18T21:07:22.350 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.350 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.350 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:22.350 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136207+0000", 2024-04-18T21:07:22.350 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.5032999999999999e-05 2024-04-18T21:07:22.350 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.350 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.350 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:22.350 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136248+0000", 2024-04-18T21:07:22.350 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.1202000000000003e-05 2024-04-18T21:07:22.350 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:22.350 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:22.350 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:22.350 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.350 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.351 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11847 4.a 4:51f063b7:::100000032b5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:22.351 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.229180+0000", 2024-04-18T21:07:22.351 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 23.089882759000002, 2024-04-18T21:07:22.351 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.048001033999999998, 2024-04-18T21:07:22.351 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:22.351 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:22.351 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:22.351 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:22.351 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:22.351 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:22.351 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11847 2024-04-18T21:07:22.351 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.351 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:22.351 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.352 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:22.352 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.229180+0000", 2024-04-18T21:07:22.352 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:22.352 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.352 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.352 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:22.352 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.229180+0000", 2024-04-18T21:07:22.352 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:22.352 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.352 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.352 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:22.352 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.229181+0000", 2024-04-18T21:07:22.352 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.119e-06 2024-04-18T21:07:22.353 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.353 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.353 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:22.353 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.235951+0000", 2024-04-18T21:07:22.353 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0067702370000000001 2024-04-18T21:07:22.353 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.353 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.353 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:22.353 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.235965+0000", 2024-04-18T21:07:22.353 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3202e-05 2024-04-18T21:07:22.353 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.353 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.353 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:22.354 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.235973+0000", 2024-04-18T21:07:22.354 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8630000000000008e-06 2024-04-18T21:07:22.354 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.354 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.354 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:22.354 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.236047+0000", 2024-04-18T21:07:22.354 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.4453e-05 2024-04-18T21:07:22.354 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.354 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.354 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:22.354 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.236137+0000", 2024-04-18T21:07:22.354 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.9751000000000002e-05 2024-04-18T21:07:22.355 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.355 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.355 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:22.355 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.236266+0000", 2024-04-18T21:07:22.355 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000129257 2024-04-18T21:07:22.355 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.355 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.355 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:22.355 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.244520+0000", 2024-04-18T21:07:22.355 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0082538190000000008 2024-04-18T21:07:22.355 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.355 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.355 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:22.355 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.277093+0000", 2024-04-18T21:07:22.356 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.032573405999999999 2024-04-18T21:07:22.356 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.356 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.356 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:22.356 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.277144+0000", 2024-04-18T21:07:22.356 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.0553000000000002e-05 2024-04-18T21:07:22.356 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.356 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.356 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:22.356 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.277181+0000", 2024-04-18T21:07:22.356 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.7373999999999998e-05 2024-04-18T21:07:22.356 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:22.356 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:22.357 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:22.357 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.357 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.357 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11949 4.2b 4:d50cc3c5:::100000031c6.00000000:head [write 0~3145728] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:22.357 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.338113+0000", 2024-04-18T21:07:22.357 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 22.980949883000001, 2024-04-18T21:07:22.357 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.046907847000000003, 2024-04-18T21:07:22.357 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:22.357 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:22.357 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:22.357 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:22.357 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:22.357 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:22.357 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11949 2024-04-18T21:07:22.357 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.357 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:22.358 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.358 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:22.358 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.338113+0000", 2024-04-18T21:07:22.358 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:22.358 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.358 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.358 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:22.358 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.338113+0000", 2024-04-18T21:07:22.358 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:22.358 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.358 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.358 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:22.358 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.338115+0000", 2024-04-18T21:07:22.358 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5659999999999999e-06 2024-04-18T21:07:22.358 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.358 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.359 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:22.359 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344146+0000", 2024-04-18T21:07:22.359 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0060309339999999999 2024-04-18T21:07:22.359 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.359 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.359 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:22.359 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344163+0000", 2024-04-18T21:07:22.359 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6994999999999999e-05 2024-04-18T21:07:22.359 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.359 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.359 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:22.359 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344171+0000", 2024-04-18T21:07:22.359 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5520000000000005e-06 2024-04-18T21:07:22.360 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.360 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.360 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:22.360 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344604+0000", 2024-04-18T21:07:22.360 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00043326299999999997 2024-04-18T21:07:22.360 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.360 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.360 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:22.360 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344687+0000", 2024-04-18T21:07:22.360 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.2952000000000001e-05 2024-04-18T21:07:22.360 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.360 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.360 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:22.360 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344792+0000", 2024-04-18T21:07:22.361 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000104635 2024-04-18T21:07:22.361 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.361 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.361 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:22.361 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.361867+0000", 2024-04-18T21:07:22.361 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017075245999999999 2024-04-18T21:07:22.361 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.361 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.361 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:22.361 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.384879+0000", 2024-04-18T21:07:22.361 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023011474000000001 2024-04-18T21:07:22.361 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.361 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.361 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:22.362 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.384976+0000", 2024-04-18T21:07:22.362 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.7399999999999996e-05 2024-04-18T21:07:22.362 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.362 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.362 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:22.362 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.385021+0000", 2024-04-18T21:07:22.362 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.4830000000000003e-05 2024-04-18T21:07:22.362 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:22.362 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:22.362 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:22.362 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.362 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.362 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:12041 4.38 4:1c8d9fef:::100000033ed.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:22.362 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.446812+0000", 2024-04-18T21:07:22.363 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 22.872250642000001, 2024-04-18T21:07:22.363 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.044749606999999997, 2024-04-18T21:07:22.363 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:22.363 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:22.363 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:22.363 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:22.363 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:22.363 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:22.363 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 12041 2024-04-18T21:07:22.363 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.363 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:22.363 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.363 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:22.363 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.446812+0000", 2024-04-18T21:07:22.363 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:22.363 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.364 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.364 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:22.364 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.446812+0000", 2024-04-18T21:07:22.364 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:22.364 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.364 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.364 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:22.364 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.446814+0000", 2024-04-18T21:07:22.364 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5099999999999999e-06 2024-04-18T21:07:22.364 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.364 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.364 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:22.364 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.452583+0000", 2024-04-18T21:07:22.364 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0057696379999999997 2024-04-18T21:07:22.364 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.365 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.365 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:22.365 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.452599+0000", 2024-04-18T21:07:22.365 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5701000000000001e-05 2024-04-18T21:07:22.365 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.365 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.365 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:22.365 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.452607+0000", 2024-04-18T21:07:22.365 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.7100000000000007e-06 2024-04-18T21:07:22.365 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.365 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.365 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:22.365 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.452718+0000", 2024-04-18T21:07:22.365 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000111257 2024-04-18T21:07:22.365 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.366 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.366 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:22.366 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.452924+0000", 2024-04-18T21:07:22.366 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000206066 2024-04-18T21:07:22.366 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.366 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.366 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:22.366 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.453088+0000", 2024-04-18T21:07:22.366 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016336700000000001 2024-04-18T21:07:22.366 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.366 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.366 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:22.366 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.469818+0000", 2024-04-18T21:07:22.366 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016730248999999999 2024-04-18T21:07:22.367 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.367 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.367 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:22.367 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.491505+0000", 2024-04-18T21:07:22.367 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021687366 2024-04-18T21:07:22.367 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.367 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.367 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:22.367 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.491537+0000", 2024-04-18T21:07:22.367 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.1888999999999999e-05 2024-04-18T21:07:22.367 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.367 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.367 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:22.367 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.491562+0000", 2024-04-18T21:07:22.367 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.4854e-05 2024-04-18T21:07:22.368 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:22.368 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:22.368 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:22.368 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.368 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.368 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_repop(client.4534.0:12689 4.26 e58/16 4:64a7f444:::100000033e5.00000000:head v 58'205, mlcod=58'203)", 2024-04-18T21:07:22.368 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:00.217785+0000", 2024-04-18T21:07:22.368 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 22.101277846999999, 2024-04-18T21:07:22.368 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.052245469000000003, 2024-04-18T21:07:22.368 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:22.368 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:22.368 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:22.368 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:22.368 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.369 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:22.369 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.217785+0000", 2024-04-18T21:07:22.369 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:22.369 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.369 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.369 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:22.369 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.217785+0000", 2024-04-18T21:07:22.369 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:22.369 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.369 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.369 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:22.369 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.217786+0000", 2024-04-18T21:07:22.369 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6700000000000002e-07 2024-04-18T21:07:22.369 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.369 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.370 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:22.370 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225111+0000", 2024-04-18T21:07:22.370 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0073251119999999999 2024-04-18T21:07:22.370 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.370 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.370 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:22.370 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225126+0000", 2024-04-18T21:07:22.370 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.541e-05 2024-04-18T21:07:22.370 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.370 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.370 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:22.370 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225137+0000", 2024-04-18T21:07:22.370 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0890000000000001e-05 2024-04-18T21:07:22.370 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.371 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.371 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:22.371 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225244+0000", 2024-04-18T21:07:22.371 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000106555 2024-04-18T21:07:22.371 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.371 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.371 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:22.371 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225276+0000", 2024-04-18T21:07:22.371 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.2574999999999999e-05 2024-04-18T21:07:22.371 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.371 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.371 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:22.371 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.269985+0000", 2024-04-18T21:07:22.371 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.044708422999999997 2024-04-18T21:07:22.371 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.371 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.372 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:22.372 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.270031+0000", 2024-04-18T21:07:22.372 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.5636999999999997e-05 2024-04-18T21:07:22.372 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:22.372 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:22.372 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:22.372 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.372 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.372 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:12692 4.3a 4:5c788ec1:::100000032ff.00000000:head [write 0~4194304 [2@945974]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:22.372 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:00.225134+0000", 2024-04-18T21:07:22.372 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 22.093928792, 2024-04-18T21:07:22.372 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.048311640000000003, 2024-04-18T21:07:22.372 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:22.372 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:22.372 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:22.372 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:22.373 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:22.373 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:22.373 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 12692 2024-04-18T21:07:22.373 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.373 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:22.373 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.373 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:22.373 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225134+0000", 2024-04-18T21:07:22.373 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:22.373 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.373 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.373 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:22.373 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225134+0000", 2024-04-18T21:07:22.373 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:22.373 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.373 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.373 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:22.374 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225136+0000", 2024-04-18T21:07:22.374 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4160000000000001e-06 2024-04-18T21:07:22.374 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.374 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.374 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:22.374 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231408+0000", 2024-04-18T21:07:22.374 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.006272517 2024-04-18T21:07:22.374 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.374 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.374 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:22.374 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231437+0000", 2024-04-18T21:07:22.374 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.9119e-05 2024-04-18T21:07:22.374 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.374 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.374 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:22.375 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231456+0000", 2024-04-18T21:07:22.375 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8544999999999999e-05 2024-04-18T21:07:22.375 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.375 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.375 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:22.375 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231579+0000", 2024-04-18T21:07:22.375 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000123762 2024-04-18T21:07:22.375 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.375 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.375 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:22.375 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231690+0000", 2024-04-18T21:07:22.375 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000110349 2024-04-18T21:07:22.375 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.375 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.375 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:22.375 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231903+0000", 2024-04-18T21:07:22.376 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000212695 2024-04-18T21:07:22.376 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.376 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.376 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:22.376 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.253911+0000", 2024-04-18T21:07:22.376 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.022008706999999999 2024-04-18T21:07:22.376 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.376 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.376 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:22.376 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.273383+0000", 2024-04-18T21:07:22.376 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019471568000000002 2024-04-18T21:07:22.376 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.376 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.376 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:22.376 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.273418+0000", 2024-04-18T21:07:22.376 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.5265999999999997e-05 2024-04-18T21:07:22.377 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.377 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.377 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:22.377 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.273446+0000", 2024-04-18T21:07:22.377 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7696e-05 2024-04-18T21:07:22.377 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:22.377 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:22.377 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:22.377 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.377 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.377 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:15094 4.c 4:32870457:::10000003692.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-18T21:07:22.377 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:03.107374+0000", 2024-04-18T21:07:22.377 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 19.211688467999998, 2024-04-18T21:07:22.377 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.061575983000000001, 2024-04-18T21:07:22.378 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:22.378 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:22.378 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:22.378 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:22.378 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:22.378 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:22.378 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 15094 2024-04-18T21:07:22.378 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.378 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:22.378 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.378 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:22.378 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.107374+0000", 2024-04-18T21:07:22.378 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:22.379 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.379 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.379 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:22.379 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.107374+0000", 2024-04-18T21:07:22.379 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:22.379 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.379 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.379 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:22.379 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.107376+0000", 2024-04-18T21:07:22.379 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3969999999999999e-06 2024-04-18T21:07:22.379 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.379 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.379 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:22.380 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115698+0000", 2024-04-18T21:07:22.380 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0083223989999999994 2024-04-18T21:07:22.380 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.380 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.380 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:22.380 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115713+0000", 2024-04-18T21:07:22.380 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4385e-05 2024-04-18T21:07:22.380 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.380 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.380 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:22.380 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115722+0000", 2024-04-18T21:07:22.380 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0759999999999992e-06 2024-04-18T21:07:22.380 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.381 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.381 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:22.381 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115784+0000", 2024-04-18T21:07:22.381 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.2348999999999995e-05 2024-04-18T21:07:22.381 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.381 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.381 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:22.381 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115849+0000", 2024-04-18T21:07:22.381 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.4964999999999999e-05 2024-04-18T21:07:22.381 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.381 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.381 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:22.381 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.116054+0000", 2024-04-18T21:07:22.382 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020483400000000001 2024-04-18T21:07:22.382 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.382 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.382 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:22.382 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.125769+0000", 2024-04-18T21:07:22.382 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0097153340000000008 2024-04-18T21:07:22.382 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.382 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.382 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:22.382 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.168834+0000", 2024-04-18T21:07:22.382 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043064527999999998 2024-04-18T21:07:22.382 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.383 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.383 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:22.383 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.168882+0000", 2024-04-18T21:07:22.383 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.7919e-05 2024-04-18T21:07:22.383 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.383 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.383 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:22.383 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.168950+0000", 2024-04-18T21:07:22.383 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.8796999999999999e-05 2024-04-18T21:07:22.383 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:22.383 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:22.383 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:22.383 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.384 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.384 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:15133 4.38 4:1c73eb83:::1000000398c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-18T21:07:22.384 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:03.155031+0000", 2024-04-18T21:07:22.384 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 19.164031927, 2024-04-18T21:07:22.384 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.044078787000000001, 2024-04-18T21:07:22.384 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:22.384 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:22.384 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:22.384 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:22.384 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:22.384 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:22.384 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 15133 2024-04-18T21:07:22.384 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.385 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:22.385 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.385 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:22.385 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.155031+0000", 2024-04-18T21:07:22.385 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:22.385 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.385 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.385 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:22.385 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.155031+0000", 2024-04-18T21:07:22.385 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:22.385 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.385 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.385 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:22.385 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.155033+0000", 2024-04-18T21:07:22.386 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.84e-06 2024-04-18T21:07:22.386 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.386 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.386 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:22.386 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.161994+0000", 2024-04-18T21:07:22.386 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0069607779999999999 2024-04-18T21:07:22.386 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.386 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.386 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:22.386 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.162008+0000", 2024-04-18T21:07:22.386 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4399000000000001e-05 2024-04-18T21:07:22.386 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.387 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.387 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:22.387 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.162018+0000", 2024-04-18T21:07:22.387 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.7149999999999993e-06 2024-04-18T21:07:22.387 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.387 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.387 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:22.387 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.162073+0000", 2024-04-18T21:07:22.387 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4803999999999999e-05 2024-04-18T21:07:22.387 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.387 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.387 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:22.387 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.162215+0000", 2024-04-18T21:07:22.387 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014222900000000001 2024-04-18T21:07:22.388 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.388 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.388 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:22.388 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.162341+0000", 2024-04-18T21:07:22.388 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012579400000000001 2024-04-18T21:07:22.388 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.388 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.388 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:22.388 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.169445+0000", 2024-04-18T21:07:22.388 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0071040360000000002 2024-04-18T21:07:22.388 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.388 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.388 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:22.388 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.199046+0000", 2024-04-18T21:07:22.388 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.029601639999999999 2024-04-18T21:07:22.389 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.389 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.389 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:22.389 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.199082+0000", 2024-04-18T21:07:22.389 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.6134999999999999e-05 2024-04-18T21:07:22.389 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.389 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.389 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:22.389 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.199110+0000", 2024-04-18T21:07:22.389 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7416999999999999e-05 2024-04-18T21:07:22.389 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:22.389 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:22.389 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:22.389 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.390 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.390 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7616 4.d 4:b1f7eab6:::10000001d5f.00000000:head [delete] snapc 1=[] RETRY=2 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:22.390 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882522+0000", 2024-04-18T21:07:22.390 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 10.436540576000001, 2024-04-18T21:07:22.390 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.086006255, 2024-04-18T21:07:22.390 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:22.390 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:22.390 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "reached pg", 2024-04-18T21:07:22.390 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:22.390 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.390 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:22.390 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882522+0000", 2024-04-18T21:07:22.390 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:22.390 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.391 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.391 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:22.391 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882522+0000", 2024-04-18T21:07:22.391 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:22.391 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.391 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.391 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:22.391 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882524+0000", 2024-04-18T21:07:22.391 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4720000000000001e-06 2024-04-18T21:07:22.391 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.391 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.391 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:22.391 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882531+0000", 2024-04-18T21:07:22.391 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7830000000000001e-06 2024-04-18T21:07:22.392 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.392 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.392 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:22.392 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882549+0000", 2024-04-18T21:07:22.392 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8765000000000001e-05 2024-04-18T21:07:22.392 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.392 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.392 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:22.392 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882562+0000", 2024-04-18T21:07:22.392 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3117e-05 2024-04-18T21:07:22.392 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.392 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.392 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:22.392 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882690+0000", 2024-04-18T21:07:22.392 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012794799999999999 2024-04-18T21:07:22.393 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.393 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.393 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op must wait for map", 2024-04-18T21:07:22.393 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882701+0000", 2024-04-18T21:07:22.393 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0215e-05 2024-04-18T21:07:22.393 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.393 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.393 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:22.393 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.891964+0000", 2024-04-18T21:07:22.393 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0092636130000000004 2024-04-18T21:07:22.393 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.393 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.393 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:22.393 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.891976+0000", 2024-04-18T21:07:22.393 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1973e-05 2024-04-18T21:07:22.394 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.394 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.394 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:22.394 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.959520+0000", 2024-04-18T21:07:22.394 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0675436009999999 2024-04-18T21:07:22.394 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.394 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.394 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for missing object", 2024-04-18T21:07:22.394 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.959662+0000", 2024-04-18T21:07:22.394 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014253000000000001 2024-04-18T21:07:22.394 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.394 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.394 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:22.394 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.968480+0000", 2024-04-18T21:07:22.395 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0088178409999999999 2024-04-18T21:07:22.395 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.395 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.395 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:22.395 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.968529+0000", 2024-04-18T21:07:22.395 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8396999999999998e-05 2024-04-18T21:07:22.395 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:22.395 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:22.395 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:22.395 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.395 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.395 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7628 4.31 4:8c97f9cd:::10000001d6c.00000000:head [delete] snapc 1=[] RETRY=2 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:22.395 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882610+0000", 2024-04-18T21:07:22.395 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 10.436452846, 2024-04-18T21:07:22.396 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.08538018, 2024-04-18T21:07:22.396 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:22.396 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:22.396 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "reached pg", 2024-04-18T21:07:22.396 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:22.396 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.396 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:22.396 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882610+0000", 2024-04-18T21:07:22.396 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:22.396 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.396 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.396 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:22.396 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882610+0000", 2024-04-18T21:07:22.396 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:22.396 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.396 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.397 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:22.397 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882611+0000", 2024-04-18T21:07:22.397 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.4199999999999995e-07 2024-04-18T21:07:22.397 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.397 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.397 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:22.397 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882614+0000", 2024-04-18T21:07:22.397 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.4300000000000002e-06 2024-04-18T21:07:22.397 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.397 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.397 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:22.397 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882623+0000", 2024-04-18T21:07:22.397 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8740000000000001e-06 2024-04-18T21:07:22.397 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.397 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.397 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:22.398 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882629+0000", 2024-04-18T21:07:22.398 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.4330000000000001e-06 2024-04-18T21:07:22.398 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.398 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.398 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:22.398 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882706+0000", 2024-04-18T21:07:22.398 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.6280999999999997e-05 2024-04-18T21:07:22.398 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.398 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.398 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op must wait for map", 2024-04-18T21:07:22.398 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882715+0000", 2024-04-18T21:07:22.398 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.1679999999999993e-06 2024-04-18T21:07:22.398 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.398 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.399 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:22.399 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.889481+0000", 2024-04-18T21:07:22.399 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0067656979999999997 2024-04-18T21:07:22.399 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.399 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.399 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:22.399 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.889493+0000", 2024-04-18T21:07:22.399 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2451e-05 2024-04-18T21:07:22.399 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.399 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.399 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:22.399 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.940942+0000", 2024-04-18T21:07:22.399 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0514491720000001 2024-04-18T21:07:22.400 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.400 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.400 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for missing object", 2024-04-18T21:07:22.400 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.941134+0000", 2024-04-18T21:07:22.400 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019150600000000001 2024-04-18T21:07:22.400 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.400 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.400 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:22.400 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.967914+0000", 2024-04-18T21:07:22.400 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026780202999999999 2024-04-18T21:07:22.400 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.400 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.400 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:22.400 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.967990+0000", 2024-04-18T21:07:22.400 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.6322000000000006e-05 2024-04-18T21:07:22.400 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:22.401 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:22.401 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:22.401 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.401 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.401 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7630 4.d 4:b022c802:::10000001d6e.00000000:head [delete] snapc 1=[] RETRY=2 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:22.401 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882645+0000", 2024-04-18T21:07:22.401 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 10.436417562000001, 2024-04-18T21:07:22.401 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0858072780000001, 2024-04-18T21:07:22.401 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:22.401 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:22.401 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "reached pg", 2024-04-18T21:07:22.401 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:22.401 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.401 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:22.401 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882645+0000", 2024-04-18T21:07:22.401 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:22.402 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.402 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.402 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:22.402 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882645+0000", 2024-04-18T21:07:22.402 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:22.402 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.402 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.402 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:22.402 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882646+0000", 2024-04-18T21:07:22.402 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.3599999999999999e-07 2024-04-18T21:07:22.402 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.402 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.402 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:22.402 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882648+0000", 2024-04-18T21:07:22.403 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.5809999999999999e-06 2024-04-18T21:07:22.403 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.403 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.403 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:22.403 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882655+0000", 2024-04-18T21:07:22.403 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7909999999999999e-06 2024-04-18T21:07:22.403 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.403 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.403 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:22.403 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882661+0000", 2024-04-18T21:07:22.403 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3920000000000002e-06 2024-04-18T21:07:22.403 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.403 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.403 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:22.403 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882825+0000", 2024-04-18T21:07:22.403 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016480100000000001 2024-04-18T21:07:22.404 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.404 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.404 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:07:22.404 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882840+0000", 2024-04-18T21:07:22.404 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4656e-05 2024-04-18T21:07:22.404 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.404 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.404 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:22.404 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.892020+0000", 2024-04-18T21:07:22.404 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0091804680000000007 2024-04-18T21:07:22.404 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.404 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.404 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:22.404 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.892026+0000", 2024-04-18T21:07:22.404 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4580000000000001e-06 2024-04-18T21:07:22.404 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.405 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.405 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:22.405 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.959913+0000", 2024-04-18T21:07:22.405 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.067887289 2024-04-18T21:07:22.405 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.405 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.405 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for missing object", 2024-04-18T21:07:22.405 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.960034+0000", 2024-04-18T21:07:22.405 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000120445 2024-04-18T21:07:22.405 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.405 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.405 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:22.405 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.968407+0000", 2024-04-18T21:07:22.405 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0083734010000000008 2024-04-18T21:07:22.405 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.405 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.406 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:22.406 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.968453+0000", 2024-04-18T21:07:22.406 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.5559999999999997e-05 2024-04-18T21:07:22.406 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:22.406 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:22.406 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:22.406 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.406 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.406 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7651 4.13 4:c9951bc5:::10000001e1b.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:22.406 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882696+0000", 2024-04-18T21:07:22.406 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 10.436367149000001, 2024-04-18T21:07:22.406 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.088382095, 2024-04-18T21:07:22.406 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:22.406 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:22.407 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:22.407 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:22.407 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.407 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:22.407 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882696+0000", 2024-04-18T21:07:22.407 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:22.407 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.407 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.407 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:22.407 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882696+0000", 2024-04-18T21:07:22.407 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:22.407 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.407 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.407 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:22.407 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882696+0000", 2024-04-18T21:07:22.408 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.06e-07 2024-04-18T21:07:22.408 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.408 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.408 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:22.408 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882699+0000", 2024-04-18T21:07:22.408 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.1039999999999998e-06 2024-04-18T21:07:22.408 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.408 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.408 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:22.408 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882707+0000", 2024-04-18T21:07:22.408 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.593e-06 2024-04-18T21:07:22.408 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.408 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.408 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:22.408 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882712+0000", 2024-04-18T21:07:22.409 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.541e-06 2024-04-18T21:07:22.409 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.409 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.409 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:22.409 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882870+0000", 2024-04-18T21:07:22.409 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000157999 2024-04-18T21:07:22.409 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.409 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.409 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op must wait for map", 2024-04-18T21:07:22.409 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882885+0000", 2024-04-18T21:07:22.409 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4989e-05 2024-04-18T21:07:22.409 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.409 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.410 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:22.410 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.891447+0000", 2024-04-18T21:07:22.410 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0085618540000000007 2024-04-18T21:07:22.410 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.410 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.410 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:22.410 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.891457+0000", 2024-04-18T21:07:22.410 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.6399999999999992e-06 2024-04-18T21:07:22.410 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.410 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.410 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:22.410 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.964840+0000", 2024-04-18T21:07:22.410 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.073383279 2024-04-18T21:07:22.411 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.411 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.411 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:22.411 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.965078+0000", 2024-04-18T21:07:22.411 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000237581 2024-04-18T21:07:22.411 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.411 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.411 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:22.411 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.965299+0000", 2024-04-18T21:07:22.411 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00022087699999999999 2024-04-18T21:07:22.411 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.411 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.411 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:22.411 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.969505+0000", 2024-04-18T21:07:22.411 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.004206123 2024-04-18T21:07:22.412 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.412 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.412 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:22.412 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.970898+0000", 2024-04-18T21:07:22.412 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001393434 2024-04-18T21:07:22.412 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.412 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.412 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:22.412 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.970936+0000", 2024-04-18T21:07:22.412 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.7647000000000001e-05 2024-04-18T21:07:22.412 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.412 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.412 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:22.413 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.971078+0000", 2024-04-18T21:07:22.413 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014192799999999999 2024-04-18T21:07:22.413 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:22.413 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:22.413 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:22.413 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.413 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.413 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7671 4.31 4:8c95a1b7:::10000001e2f.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:22.413 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882728+0000", 2024-04-18T21:07:22.413 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 10.436335314000001, 2024-04-18T21:07:22.413 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.084467606, 2024-04-18T21:07:22.413 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:22.413 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:22.414 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:22.414 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:22.414 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.414 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:22.414 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882728+0000", 2024-04-18T21:07:22.414 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:22.414 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.414 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.414 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:22.414 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882728+0000", 2024-04-18T21:07:22.414 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:22.414 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.415 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.415 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:22.415 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882728+0000", 2024-04-18T21:07:22.415 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.0399999999999996e-07 2024-04-18T21:07:22.415 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.415 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.415 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:22.415 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882731+0000", 2024-04-18T21:07:22.415 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.5239999999999999e-06 2024-04-18T21:07:22.415 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.415 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.415 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:22.415 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882739+0000", 2024-04-18T21:07:22.415 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4020000000000002e-06 2024-04-18T21:07:22.416 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.416 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.416 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:22.416 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882744+0000", 2024-04-18T21:07:22.416 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.1410000000000004e-06 2024-04-18T21:07:22.416 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.416 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.416 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:22.416 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882836+0000", 2024-04-18T21:07:22.416 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.2094000000000003e-05 2024-04-18T21:07:22.416 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.416 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.416 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:07:22.416 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882849+0000", 2024-04-18T21:07:22.416 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3087e-05 2024-04-18T21:07:22.417 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.417 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.417 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:22.417 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.889522+0000", 2024-04-18T21:07:22.417 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0066730950000000004 2024-04-18T21:07:22.417 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.417 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.417 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:22.417 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.889530+0000", 2024-04-18T21:07:22.417 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8699999999999992e-06 2024-04-18T21:07:22.417 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.417 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.417 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:22.417 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.941173+0000", 2024-04-18T21:07:22.417 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.051642658 2024-04-18T21:07:22.417 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.418 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.418 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:22.418 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.941392+0000", 2024-04-18T21:07:22.418 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00021854099999999999 2024-04-18T21:07:22.418 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.418 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.418 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:22.418 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.941618+0000", 2024-04-18T21:07:22.418 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0002265 2024-04-18T21:07:22.418 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.418 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.418 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:22.418 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.945390+0000", 2024-04-18T21:07:22.418 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0037723460000000002 2024-04-18T21:07:22.419 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.419 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.419 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:22.419 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.966905+0000", 2024-04-18T21:07:22.419 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021514559999999999 2024-04-18T21:07:22.419 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.419 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.419 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:22.419 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.966972+0000", 2024-04-18T21:07:22.419 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.6740000000000001e-05 2024-04-18T21:07:22.419 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.419 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.419 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:22.419 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.967195+0000", 2024-04-18T21:07:22.420 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000223544 2024-04-18T21:07:22.420 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:22.420 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:22.420 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:22.420 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.420 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.420 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7691 4.d 4:b0345396:::10000001e43.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:22.420 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882753+0000", 2024-04-18T21:07:22.420 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 10.436310335, 2024-04-18T21:07:22.420 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.085135618, 2024-04-18T21:07:22.420 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:22.420 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:22.421 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:22.421 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:22.421 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.421 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:22.421 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882753+0000", 2024-04-18T21:07:22.421 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:22.421 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.421 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.421 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:22.421 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882753+0000", 2024-04-18T21:07:22.421 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:22.421 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.421 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.421 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:22.421 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882753+0000", 2024-04-18T21:07:22.421 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.9000000000000002e-07 2024-04-18T21:07:22.422 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.422 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.422 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:22.422 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882755+0000", 2024-04-18T21:07:22.422 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.4040000000000002e-06 2024-04-18T21:07:22.422 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.422 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.422 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:22.422 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882762+0000", 2024-04-18T21:07:22.422 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.6229999999999999e-06 2024-04-18T21:07:22.422 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.422 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.422 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:22.422 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882769+0000", 2024-04-18T21:07:22.423 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.1559999999999998e-06 2024-04-18T21:07:22.423 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.423 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.423 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:22.423 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882875+0000", 2024-04-18T21:07:22.423 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000105491 2024-04-18T21:07:22.423 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.423 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.423 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:07:22.423 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882879+0000", 2024-04-18T21:07:22.423 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.9999999999999998e-06 2024-04-18T21:07:22.423 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.423 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.423 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:22.424 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.892072+0000", 2024-04-18T21:07:22.424 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0091930989999999997 2024-04-18T21:07:22.424 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.424 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.424 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:22.424 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.892083+0000", 2024-04-18T21:07:22.424 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1070000000000001e-05 2024-04-18T21:07:22.424 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.424 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.424 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:22.424 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.960162+0000", 2024-04-18T21:07:22.424 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0680791869999999 2024-04-18T21:07:22.424 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.424 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.424 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:22.425 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.960314+0000", 2024-04-18T21:07:22.425 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000152139 2024-04-18T21:07:22.425 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.425 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.425 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:22.425 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.960469+0000", 2024-04-18T21:07:22.425 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000154444 2024-04-18T21:07:22.425 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.425 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.425 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:22.425 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.964018+0000", 2024-04-18T21:07:22.425 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035494179999999999 2024-04-18T21:07:22.425 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.425 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.425 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:22.425 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.967680+0000", 2024-04-18T21:07:22.426 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.003662046 2024-04-18T21:07:22.426 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.426 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.426 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:22.426 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.967738+0000", 2024-04-18T21:07:22.426 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.7946999999999999e-05 2024-04-18T21:07:22.426 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.426 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.426 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:22.426 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.967888+0000", 2024-04-18T21:07:22.426 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000150204 2024-04-18T21:07:22.426 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:22.426 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:22.427 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:22.427 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.427 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.427 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:17090 4.39 4:9d5d3d9b:::100000020cf.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e69)", 2024-04-18T21:07:22.427 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:20.889261+0000", 2024-04-18T21:07:22.427 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 1.4298023469999999, 2024-04-18T21:07:22.427 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043495370999999998, 2024-04-18T21:07:22.427 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:22.427 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:22.427 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:22.427 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:22.427 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.427 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:22.427 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889261+0000", 2024-04-18T21:07:22.428 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:22.428 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.428 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.428 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:22.428 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889261+0000", 2024-04-18T21:07:22.428 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:22.428 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.428 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.428 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:22.428 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889261+0000", 2024-04-18T21:07:22.428 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.0500000000000003e-07 2024-04-18T21:07:22.428 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.428 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.428 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:22.428 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889264+0000", 2024-04-18T21:07:22.428 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.0570000000000001e-06 2024-04-18T21:07:22.429 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.429 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.429 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:22.429 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889273+0000", 2024-04-18T21:07:22.429 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6500000000000002e-06 2024-04-18T21:07:22.429 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.429 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.429 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:22.429 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889279+0000", 2024-04-18T21:07:22.429 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.5629999999999997e-06 2024-04-18T21:07:22.429 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.429 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.429 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:22.429 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889329+0000", 2024-04-18T21:07:22.430 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.9929000000000003e-05 2024-04-18T21:07:22.430 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.430 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.430 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:22.430 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889448+0000", 2024-04-18T21:07:22.430 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011830800000000001 2024-04-18T21:07:22.430 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.430 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.430 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:22.430 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889557+0000", 2024-04-18T21:07:22.430 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000108923 2024-04-18T21:07:22.430 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.430 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.430 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:22.430 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.890930+0000", 2024-04-18T21:07:22.431 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001372938 2024-04-18T21:07:22.431 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.431 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.431 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:22.431 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.932626+0000", 2024-04-18T21:07:22.431 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.041696735999999998 2024-04-18T21:07:22.431 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.431 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.431 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:22.431 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.932692+0000", 2024-04-18T21:07:22.431 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.6177e-05 2024-04-18T21:07:22.431 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.431 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.431 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:22.432 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.932756+0000", 2024-04-18T21:07:22.432 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.3485000000000006e-05 2024-04-18T21:07:22.432 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:22.432 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:22.432 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:22.432 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.432 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.432 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:17096 4.3c 4:3d6bd5a0:::100000020d5.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e69)", 2024-04-18T21:07:22.432 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:20.889704+0000", 2024-04-18T21:07:22.432 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 1.429359391, 2024-04-18T21:07:22.432 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043604966000000002, 2024-04-18T21:07:22.432 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:22.432 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:22.432 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:22.432 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:22.432 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.433 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:22.433 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889704+0000", 2024-04-18T21:07:22.433 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:22.433 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.433 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.433 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:22.433 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889704+0000", 2024-04-18T21:07:22.433 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:22.433 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.433 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.433 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:22.433 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889704+0000", 2024-04-18T21:07:22.433 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.0699999999999996e-07 2024-04-18T21:07:22.433 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.433 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.434 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:22.434 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889708+0000", 2024-04-18T21:07:22.434 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.1509999999999997e-06 2024-04-18T21:07:22.434 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.434 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.434 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:22.434 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889718+0000", 2024-04-18T21:07:22.434 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0929999999999992e-06 2024-04-18T21:07:22.434 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.434 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.434 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:22.434 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889724+0000", 2024-04-18T21:07:22.434 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.883e-06 2024-04-18T21:07:22.434 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.434 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.434 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:22.435 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889783+0000", 2024-04-18T21:07:22.435 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.8217000000000002e-05 2024-04-18T21:07:22.435 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.435 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.435 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:22.435 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889877+0000", 2024-04-18T21:07:22.435 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.4494999999999996e-05 2024-04-18T21:07:22.435 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.435 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.435 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:22.435 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889947+0000", 2024-04-18T21:07:22.435 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.9702000000000005e-05 2024-04-18T21:07:22.435 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.435 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.435 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:22.435 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.890981+0000", 2024-04-18T21:07:22.436 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0010340659999999999 2024-04-18T21:07:22.436 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.436 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.436 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:22.436 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.933196+0000", 2024-04-18T21:07:22.436 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.042215036999999997 2024-04-18T21:07:22.436 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.436 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.436 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:22.436 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.933252+0000", 2024-04-18T21:07:22.436 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.6029999999999997e-05 2024-04-18T21:07:22.436 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:22.436 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:22.436 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:22.436 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.933308+0000", 2024-04-18T21:07:22.436 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.6484999999999999e-05 2024-04-18T21:07:22.437 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:22.437 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:22.437 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:22.437 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:22.437 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:22.437 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:07:22.438 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:07:22.438 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:07:22.439 INFO:teuthology.orchestra.run.smithi078.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-18T21:07:22.439 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:07:22.439 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:07:22.440 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-18T21:07:22.440 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:07:22.441 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-18T21:07:22.441 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:07:22.441 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":69,"fsid":"dc017990-0393-4ab0-b604-5e7052fdc7bd","created":"2024-04-18T21:04:43.507538+0000","modified":"2024-04-18T21:07:19.450330+0000","last_up_change":"2024-04-18T21:06:56.781166+0000","last_in_change":"2024-04-18T21:04:44.402191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T21:04:52.538153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":3.0299999713897705,"score_stable":3.0299999713897705,"optimal_score":0.33000001311302185,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":0.86374413967132568,"average_primary_affinity":0.86000001430511475,"average_primary_affinity_weighted":0.86000001430511475}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T21:04:58.673793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.2400000095367432,"score_stable":2.2400000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.86374413967132568,"average_primary_affinity":0.86000001430511475,"average_primary_affinity_weighted":0.86000001430511475}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T21:05:03.314171+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.1500000953674316,"score_stable":2.1500000953674316,"optimal_score":0.67000001668930054,"raw_score_acting":1.440000057220459,"raw_score_stable":1.440000057220459,"primary_affinity_weighted":0.86374413967132568,"average_primary_affinity":0.86000001430511475,"average_primary_affinity_weighted":0.86000001430511475}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T21:05:03.931699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8700000047683716,"score_stable":1.8700000047683716,"optimal_score":0.67000001668930054,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":0.86374413967132568,"average_primary_affinity":0.86000001430511475,"average_primary_affinity_weighted":0.86000001430511475}}],"osds":[{"osd":0,"uuid":"1854d737-3a67-416a-8c88-0f126505a0f2","up":1,"in":1,"weight":0.562286376953125,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6801","nonce":1948809768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6803","nonce":1948809768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6807","nonce":1948809768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6805","nonce":1948809768}]},"public_addr":"172.21.15.132:6801/1948809768","cluster_addr":"172.21.15.132:6803/1948809768","heartbeat_back_addr":"172.21.15.132:6807/1948809768","heartbeat_front_addr":"172.21.15.132:6805/1948809768","state":["exists","up"]},{"osd":1,"uuid":"dfeae661-3f8a-4d41-b287-7eb02c16b91a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":32,"down_at":56,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":2040503167},{"type":"v1","addr":"172.21.15.150:6801","nonce":2040503167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":2040503167},{"type":"v1","addr":"172.21.15.150:6803","nonce":2040503167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":2040503167},{"type":"v1","addr":"172.21.15.150:6807","nonce":2040503167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":2040503167},{"type":"v1","addr":"172.21.15.150:6805","nonce":2040503167}]},"public_addr":"172.21.15.150:6801/2040503167","cluster_addr":"172.21.15.150:6803/2040503167","heartbeat_back_addr":"172.21.15.150:6807/2040503167","heartbeat_front_addr":"172.21.15.150:6805/2040503167","state":["exists"]},{"osd":2,"uuid":"56a34021-e2dc-41ff-822c-7ec123466f25","up":1,"in":1,"weight":1,"primary_affinity":0.5912322998046875,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6801","nonce":429896900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6803","nonce":429896900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6807","nonce":429896900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6805","nonce":429896900}]},"public_addr":"172.21.15.187:6801/429896900","cluster_addr":"172.21.15.187:6803/429896900","heartbeat_back_addr":"172.21.15.187:6807/429896900","heartbeat_front_addr":"172.21.15.187:6805/429896900","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:49.804359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:49.790978+0000","dead_epoch":55},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:49.762943+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"1.0","osds":[2,0]},{"pgid":"2.3","osds":[2,0]},{"pgid":"2.7","osds":[2,0]},{"pgid":"3.5","osds":[2,0]},{"pgid":"3.6","osds":[2,0]},{"pgid":"3.9","osds":[2,0]},{"pgid":"3.b","osds":[2,0]},{"pgid":"3.d","osds":[2,0]},{"pgid":"3.e","osds":[2,0]},{"pgid":"3.f","osds":[2,0]},{"pgid":"3.10","osds":[2,0]},{"pgid":"3.12","osds":[2,0]},{"pgid":"3.14","osds":[2,0]},{"pgid":"3.16","osds":[2,0]},{"pgid":"3.19","osds":[2,0]},{"pgid":"3.1b","osds":[2,0]},{"pgid":"3.1c","osds":[2,0]},{"pgid":"3.1f","osds":[2,0]},{"pgid":"4.0","osds":[2,0]},{"pgid":"4.a","osds":[2,0]},{"pgid":"4.c","osds":[2,0]},{"pgid":"4.d","osds":[2,0]},{"pgid":"4.13","osds":[2,0]},{"pgid":"4.16","osds":[2,0]},{"pgid":"4.17","osds":[2,0]},{"pgid":"4.18","osds":[2,0]},{"pgid":"4.20","osds":[2,0]},{"pgid":"4.29","osds":[2,0]},{"pgid":"4.31","osds":[2,0]},{"pgid":"4.35","osds":[2,0]},{"pgid":"4.38","osds":[2,0]},{"pgid":"4.3a","osds":[2,0]}],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T21:07:22.442 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T21:04:52.538153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 3.0299999713897705, 'score_stable': 3.0299999713897705, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 0.8637441396713257, 'average_primary_affinity': 0.8600000143051147, 'average_primary_affinity_weighted': 0.8600000143051147}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-18T21:04:58.673793+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.240000009536743, 'score_stable': 2.240000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.8637441396713257, 'average_primary_affinity': 0.8600000143051147, 'average_primary_affinity_weighted': 0.8600000143051147}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T21:05:03.314171+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.1500000953674316, 'score_stable': 2.1500000953674316, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.440000057220459, 'raw_score_stable': 1.440000057220459, 'primary_affinity_weighted': 0.8637441396713257, 'average_primary_affinity': 0.8600000143051147, 'average_primary_affinity_weighted': 0.8600000143051147}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T21:05:03.931699+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8700000047683716, 'score_stable': 1.8700000047683716, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 0.8637441396713257, 'average_primary_affinity': 0.8600000143051147, 'average_primary_affinity_weighted': 0.8600000143051147}}] 2024-04-18T21:07:22.443 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T21:07:22.443 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:22.438+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:22.472 INFO:teuthology.orchestra.run.smithi078.stderr:noscrub is set 2024-04-18T21:07:22.540 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:22.541+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:22.574 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:22.574 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:22.588 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:07:22.640 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:22.638+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:22.708 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:22.708 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:22.722 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:22.747 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2024-04-18T21:07:22.765 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:22.766+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:22.767 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-18T21:07:22.842 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:22.841+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:22.923 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:22.923 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:22.942 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:22.942+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:22.949 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:07:23.043 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:23.045+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:23.067 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:23.067 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:23.081 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:07:23.085 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2024-04-18T21:07:23.104 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-18T21:07:23.167 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:23.169+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:23.241 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:23.241 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:23.244 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:23.242+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:23.255 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:07:23.345 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:23.346+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:23.391 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2024-04-18T21:07:23.409 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-18T21:07:23.416 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:23.416 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:23.430 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:07:23.477 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:23.478+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:23.547 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:23.546+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:23.563 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:23.563 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:23.578 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:07:23.648 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:23.649+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:23.693 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2024-04-18T21:07:23.712 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-18T21:07:23.743 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:23.744 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:23.749 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:23.749+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:23.759 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:23.850 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:23.849+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:23.906 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:23.906 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:23.927 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:07:23.950 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:23.950+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:24.012 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2024-04-18T21:07:24.030 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-04-18T21:07:24.030 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-18T21:07:24.036 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T21:07:24.050 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:24.050 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:24.051 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:24.053+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:24.064 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:07:24.159 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:24.161+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:24.230 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:24.230 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:24.246 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:07:24.287 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:24.289+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:24.352 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:24.353+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:24.366 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:07:24.367 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":70,"fsid":"dc017990-0393-4ab0-b604-5e7052fdc7bd","created":"2024-04-18T21:04:43.507538+0000","modified":"2024-04-18T21:07:22.462341+0000","last_up_change":"2024-04-18T21:06:56.781166+0000","last_in_change":"2024-04-18T21:04:44.402191+0000","flags":"noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5801984,"flags_set":["noscrub","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T21:04:52.538153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":3.0299999713897705,"score_stable":3.0299999713897705,"optimal_score":0.33000001311302185,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":0.86374413967132568,"average_primary_affinity":0.86000001430511475,"average_primary_affinity_weighted":0.86000001430511475}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T21:04:58.673793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.2400000095367432,"score_stable":2.2400000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.86374413967132568,"average_primary_affinity":0.86000001430511475,"average_primary_affinity_weighted":0.86000001430511475}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T21:05:03.314171+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.1500000953674316,"score_stable":2.1500000953674316,"optimal_score":0.67000001668930054,"raw_score_acting":1.440000057220459,"raw_score_stable":1.440000057220459,"primary_affinity_weighted":0.86374413967132568,"average_primary_affinity":0.86000001430511475,"average_primary_affinity_weighted":0.86000001430511475}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T21:05:03.931699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8700000047683716,"score_stable":1.8700000047683716,"optimal_score":0.67000001668930054,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":0.86374413967132568,"average_primary_affinity":0.86000001430511475,"average_primary_affinity_weighted":0.86000001430511475}}],"osds":[{"osd":0,"uuid":"1854d737-3a67-416a-8c88-0f126505a0f2","up":1,"in":1,"weight":0.562286376953125,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6801","nonce":1948809768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6803","nonce":1948809768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6807","nonce":1948809768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6805","nonce":1948809768}]},"public_addr":"172.21.15.132:6801/1948809768","cluster_addr":"172.21.15.132:6803/1948809768","heartbeat_back_addr":"172.21.15.132:6807/1948809768","heartbeat_front_addr":"172.21.15.132:6805/1948809768","state":["exists","up"]},{"osd":1,"uuid":"dfeae661-3f8a-4d41-b287-7eb02c16b91a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":32,"down_at":56,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":2040503167},{"type":"v1","addr":"172.21.15.150:6801","nonce":2040503167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":2040503167},{"type":"v1","addr":"172.21.15.150:6803","nonce":2040503167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":2040503167},{"type":"v1","addr":"172.21.15.150:6807","nonce":2040503167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":2040503167},{"type":"v1","addr":"172.21.15.150:6805","nonce":2040503167}]},"public_addr":"172.21.15.150:6801/2040503167","cluster_addr":"172.21.15.150:6803/2040503167","heartbeat_back_addr":"172.21.15.150:6807/2040503167","heartbeat_front_addr":"172.21.15.150:6805/2040503167","state":["exists"]},{"osd":2,"uuid":"56a34021-e2dc-41ff-822c-7ec123466f25","up":1,"in":1,"weight":1,"primary_affinity":0.5912322998046875,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6801","nonce":429896900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6803","nonce":429896900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6807","nonce":429896900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6805","nonce":429896900}]},"public_addr":"172.21.15.187:6801/429896900","cluster_addr":"172.21.15.187:6803/429896900","heartbeat_back_addr":"172.21.15.187:6807/429896900","heartbeat_front_addr":"172.21.15.187:6805/429896900","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:49.804359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:49.790978+0000","dead_epoch":55},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:49.762943+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"1.0","osds":[2,0]},{"pgid":"2.3","osds":[2,0]},{"pgid":"2.7","osds":[2,0]},{"pgid":"3.5","osds":[2,0]},{"pgid":"3.6","osds":[2,0]},{"pgid":"3.9","osds":[2,0]},{"pgid":"3.b","osds":[2,0]},{"pgid":"3.d","osds":[2,0]},{"pgid":"3.e","osds":[2,0]},{"pgid":"3.f","osds":[2,0]},{"pgid":"3.10","osds":[2,0]},{"pgid":"3.12","osds":[2,0]},{"pgid":"3.14","osds":[2,0]},{"pgid":"3.16","osds":[2,0]},{"pgid":"3.19","osds":[2,0]},{"pgid":"3.1b","osds":[2,0]},{"pgid":"3.1c","osds":[2,0]},{"pgid":"3.1f","osds":[2,0]},{"pgid":"4.0","osds":[2,0]},{"pgid":"4.a","osds":[2,0]},{"pgid":"4.c","osds":[2,0]},{"pgid":"4.d","osds":[2,0]},{"pgid":"4.13","osds":[2,0]},{"pgid":"4.16","osds":[2,0]},{"pgid":"4.17","osds":[2,0]},{"pgid":"4.18","osds":[2,0]},{"pgid":"4.20","osds":[2,0]},{"pgid":"4.29","osds":[2,0]},{"pgid":"4.31","osds":[2,0]},{"pgid":"4.35","osds":[2,0]},{"pgid":"4.38","osds":[2,0]},{"pgid":"4.3a","osds":[2,0]}],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T21:07:24.385 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T21:04:52.538153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 3.0299999713897705, 'score_stable': 3.0299999713897705, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 0.8637441396713257, 'average_primary_affinity': 0.8600000143051147, 'average_primary_affinity_weighted': 0.8600000143051147}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-18T21:04:58.673793+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.240000009536743, 'score_stable': 2.240000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.8637441396713257, 'average_primary_affinity': 0.8600000143051147, 'average_primary_affinity_weighted': 0.8600000143051147}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T21:05:03.314171+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.1500000953674316, 'score_stable': 2.1500000953674316, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.440000057220459, 'raw_score_stable': 1.440000057220459, 'primary_affinity_weighted': 0.8637441396713257, 'average_primary_affinity': 0.8600000143051147, 'average_primary_affinity_weighted': 0.8600000143051147}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T21:05:03.931699+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8700000047683716, 'score_stable': 1.8700000047683716, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 0.8637441396713257, 'average_primary_affinity': 0.8600000143051147, 'average_primary_affinity_weighted': 0.8600000143051147}}] 2024-04-18T21:07:24.386 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T21:07:24.412 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:24.412 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:24.428 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:07:24.442 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:07:24.471 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:24.473+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:24.493 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-18T21:07:24.555 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:24.554+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:24.560 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:24.560 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:24.575 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:07:24.590 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:07:24.591 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:07:24.591 INFO:teuthology.orchestra.run.smithi078.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-18T21:07:24.611 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:07:24.611 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:07:24.614 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-18T21:07:24.614 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-18T21:07:24.661 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:24.662+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:24.699 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2024-04-18T21:07:24.717 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-18T21:07:24.741 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:07:24.741 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:07:24.741 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-18T21:07:24.741 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-18T21:07:24.742 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:07:24.755 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:24.757 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:24.757+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:24.858 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:24.858+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:24.927 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:07:24.927 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-18T21:07:24.927 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-18T21:07:24.927 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:07:24.927 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.928 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:108 3.1f 3:f83d65d8:::200.00000004:head [write 326287~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:24.928 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:07:24.929 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 39.166494182000001, 2024-04-18T21:07:24.929 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056616183, 2024-04-18T21:07:24.929 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:24.929 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:24.929 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:24.929 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:24.929 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.929 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:24.929 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:07:24.929 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:24.929 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.929 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.929 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:24.930 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:07:24.930 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:24.930 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.930 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.930 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:24.930 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758084+0000", 2024-04-18T21:07:24.930 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.124e-06 2024-04-18T21:07:24.930 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.930 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.930 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:24.930 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758100+0000", 2024-04-18T21:07:24.930 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6246e-05 2024-04-18T21:07:24.930 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.930 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.931 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:24.931 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758118+0000", 2024-04-18T21:07:24.931 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8267e-05 2024-04-18T21:07:24.931 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.931 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.931 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:24.931 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758134+0000", 2024-04-18T21:07:24.931 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5950000000000001e-05 2024-04-18T21:07:24.931 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.931 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.931 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:24.931 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803949+0000", 2024-04-18T21:07:24.931 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045815349999999998 2024-04-18T21:07:24.931 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.932 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.932 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:24.932 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804011+0000", 2024-04-18T21:07:24.932 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1044999999999996e-05 2024-04-18T21:07:24.932 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.932 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.932 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:24.932 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804128+0000", 2024-04-18T21:07:24.932 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117148 2024-04-18T21:07:24.932 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.932 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.932 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:24.933 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806794+0000", 2024-04-18T21:07:24.933 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002666692 2024-04-18T21:07:24.933 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.933 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.933 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:24.933 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814645+0000", 2024-04-18T21:07:24.933 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0078508880000000003 2024-04-18T21:07:24.933 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.933 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.933 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:24.933 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814678+0000", 2024-04-18T21:07:24.933 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3188999999999997e-05 2024-04-18T21:07:24.934 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.934 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.934 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:24.934 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814699+0000", 2024-04-18T21:07:24.934 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0284000000000001e-05 2024-04-18T21:07:24.934 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:24.934 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:24.934 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:24.934 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.934 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.934 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:109 3.1f 3:f83d65d8:::200.00000004:head [write 327693~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:24.934 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:07:24.934 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 39.166424814999999, 2024-04-18T21:07:24.935 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056621036999999999, 2024-04-18T21:07:24.935 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:24.935 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:24.935 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:24.935 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:24.935 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.935 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:24.935 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:07:24.935 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:24.935 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.935 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.935 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:24.935 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:07:24.935 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:24.935 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.936 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.936 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:24.936 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758153+0000", 2024-04-18T21:07:24.936 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1459999999999999e-06 2024-04-18T21:07:24.936 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.936 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.936 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:24.936 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758161+0000", 2024-04-18T21:07:24.936 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7999999999999999e-06 2024-04-18T21:07:24.936 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.936 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.936 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:24.936 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758179+0000", 2024-04-18T21:07:24.936 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7949999999999999e-05 2024-04-18T21:07:24.936 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.937 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.937 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:24.937 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758193+0000", 2024-04-18T21:07:24.937 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3773e-05 2024-04-18T21:07:24.937 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.937 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.937 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:24.937 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804632+0000", 2024-04-18T21:07:24.937 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.046439469999999997 2024-04-18T21:07:24.937 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.937 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.937 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:24.937 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804790+0000", 2024-04-18T21:07:24.937 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015784300000000001 2024-04-18T21:07:24.937 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.938 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.938 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:24.938 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805056+0000", 2024-04-18T21:07:24.938 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026652400000000003 2024-04-18T21:07:24.938 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.938 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.938 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:24.938 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.808959+0000", 2024-04-18T21:07:24.938 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003903077 2024-04-18T21:07:24.938 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.938 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.938 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:24.938 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814728+0000", 2024-04-18T21:07:24.939 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0057682489999999996 2024-04-18T21:07:24.939 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.939 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.939 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:24.939 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814754+0000", 2024-04-18T21:07:24.939 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6673999999999999e-05 2024-04-18T21:07:24.939 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.939 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.939 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:24.939 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814773+0000", 2024-04-18T21:07:24.939 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8530999999999999e-05 2024-04-18T21:07:24.939 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:24.939 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:24.940 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:24.940 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.940 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.940 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:110 3.1f 3:f83d65d8:::200.00000004:head [write 329098~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:24.940 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:07:24.940 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 39.166366406000002, 2024-04-18T21:07:24.940 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056669113, 2024-04-18T21:07:24.940 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:24.940 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:24.940 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:24.940 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:24.940 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.940 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:24.940 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:07:24.941 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:24.941 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.941 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.941 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:24.941 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:07:24.941 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:24.941 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.941 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.941 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:24.941 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758212+0000", 2024-04-18T21:07:24.941 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:07:24.941 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.941 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.941 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:24.941 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758219+0000", 2024-04-18T21:07:24.942 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4229999999999999e-06 2024-04-18T21:07:24.942 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.942 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.942 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:24.942 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758237+0000", 2024-04-18T21:07:24.942 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7966999999999999e-05 2024-04-18T21:07:24.942 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.942 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.942 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:24.942 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758252+0000", 2024-04-18T21:07:24.942 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5322999999999999e-05 2024-04-18T21:07:24.942 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.942 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.943 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:24.943 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805536+0000", 2024-04-18T21:07:24.943 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.047283861000000003 2024-04-18T21:07:24.943 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.943 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.943 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:24.943 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805579+0000", 2024-04-18T21:07:24.943 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2738999999999999e-05 2024-04-18T21:07:24.943 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.943 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.943 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:24.943 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805649+0000", 2024-04-18T21:07:24.943 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0213e-05 2024-04-18T21:07:24.944 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.944 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.944 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:24.944 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.808966+0000", 2024-04-18T21:07:24.944 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033166129999999999 2024-04-18T21:07:24.944 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.944 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.944 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:24.944 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814812+0000", 2024-04-18T21:07:24.944 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0058463589999999998 2024-04-18T21:07:24.944 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.944 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.945 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:24.945 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814854+0000", 2024-04-18T21:07:24.945 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1618e-05 2024-04-18T21:07:24.945 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.945 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.945 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:24.945 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814879+0000", 2024-04-18T21:07:24.945 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5754000000000001e-05 2024-04-18T21:07:24.945 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:24.945 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:24.945 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:24.945 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.945 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.945 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:111 3.1f 3:f83d65d8:::200.00000004:head [write 330499~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:24.945 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:07:24.945 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 39.166305430000001, 2024-04-18T21:07:24.946 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058693793000000001, 2024-04-18T21:07:24.946 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:24.946 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:24.946 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:24.946 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:24.946 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.946 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:24.946 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:07:24.946 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:24.946 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.946 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.946 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:24.946 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:07:24.946 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:24.947 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.947 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.947 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:24.947 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758272+0000", 2024-04-18T21:07:24.947 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1200000000000001e-06 2024-04-18T21:07:24.947 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.947 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.947 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:24.947 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758287+0000", 2024-04-18T21:07:24.947 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5017e-05 2024-04-18T21:07:24.947 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.947 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.947 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:24.948 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758309+0000", 2024-04-18T21:07:24.948 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1866e-05 2024-04-18T21:07:24.948 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.948 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.948 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:24.948 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758323+0000", 2024-04-18T21:07:24.948 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3606e-05 2024-04-18T21:07:24.948 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.948 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.948 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:24.948 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806279+0000", 2024-04-18T21:07:24.949 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.047956061000000001 2024-04-18T21:07:24.949 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.949 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.949 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:24.949 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806350+0000", 2024-04-18T21:07:24.949 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1070999999999998e-05 2024-04-18T21:07:24.949 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.949 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.949 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:24.949 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806459+0000", 2024-04-18T21:07:24.949 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000108606 2024-04-18T21:07:24.949 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.949 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.950 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:24.950 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.809774+0000", 2024-04-18T21:07:24.950 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003314881 2024-04-18T21:07:24.950 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.950 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.950 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:24.950 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816910+0000", 2024-04-18T21:07:24.950 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0071367760000000001 2024-04-18T21:07:24.950 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.950 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.950 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:24.950 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816941+0000", 2024-04-18T21:07:24.950 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0846000000000002e-05 2024-04-18T21:07:24.950 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.950 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.951 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:24.951 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816965+0000", 2024-04-18T21:07:24.951 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3943000000000001e-05 2024-04-18T21:07:24.951 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:24.951 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:24.951 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:24.951 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.951 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.951 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:12689 4.26 4:64a7f444:::100000033e5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:24.951 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:00.208067+0000", 2024-04-18T21:07:24.951 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 24.716510014000001, 2024-04-18T21:07:24.952 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066681457, 2024-04-18T21:07:24.952 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:24.952 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:24.952 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:24.952 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:07:24.952 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:07:24.952 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:24.952 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 12689 2024-04-18T21:07:24.952 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.952 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:24.952 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.952 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:24.952 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.208067+0000", 2024-04-18T21:07:24.952 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:24.953 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.953 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.953 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:24.953 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.208067+0000", 2024-04-18T21:07:24.953 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:24.953 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.953 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.953 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:24.953 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.208069+0000", 2024-04-18T21:07:24.953 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1500000000000002e-06 2024-04-18T21:07:24.953 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.953 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.953 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:24.953 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216162+0000", 2024-04-18T21:07:24.954 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0080933159999999997 2024-04-18T21:07:24.954 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.954 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.954 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:24.954 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216181+0000", 2024-04-18T21:07:24.954 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8573e-05 2024-04-18T21:07:24.954 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.954 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.954 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:24.954 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216192+0000", 2024-04-18T21:07:24.954 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0767999999999999e-05 2024-04-18T21:07:24.954 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.955 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.955 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:24.955 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216259+0000", 2024-04-18T21:07:24.955 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7977000000000003e-05 2024-04-18T21:07:24.955 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.955 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.955 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:24.955 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216635+0000", 2024-04-18T21:07:24.955 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00037591300000000002 2024-04-18T21:07:24.955 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.955 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.955 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:24.955 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216929+0000", 2024-04-18T21:07:24.955 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00029314800000000002 2024-04-18T21:07:24.955 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.956 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.956 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:24.956 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.232918+0000", 2024-04-18T21:07:24.956 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015989903 2024-04-18T21:07:24.956 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.956 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.956 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:24.956 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.274643+0000", 2024-04-18T21:07:24.956 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.041724281000000002 2024-04-18T21:07:24.956 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.956 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.956 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:24.956 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.274701+0000", 2024-04-18T21:07:24.957 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8304999999999998e-05 2024-04-18T21:07:24.957 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.957 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.957 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:24.957 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.274748+0000", 2024-04-18T21:07:24.957 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7123000000000003e-05 2024-04-18T21:07:24.957 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:24.957 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:24.957 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:24.957 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.957 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.957 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:7694 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-18T21:07:24.957 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:11.672522+0000", 2024-04-18T21:07:24.957 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.252054974, 2024-04-18T21:07:24.957 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2954970370000001, 2024-04-18T21:07:24.958 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:24.958 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:24.958 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:24.958 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:24.958 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.958 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:24.958 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672522+0000", 2024-04-18T21:07:24.958 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:24.958 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.958 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.958 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:24.958 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672522+0000", 2024-04-18T21:07:24.958 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:24.959 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.959 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.959 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:24.959 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672525+0000", 2024-04-18T21:07:24.959 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.366e-06 2024-04-18T21:07:24.959 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.959 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.959 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:24.959 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672540+0000", 2024-04-18T21:07:24.959 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4949999999999999e-05 2024-04-18T21:07:24.959 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.959 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.959 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:24.960 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672569+0000", 2024-04-18T21:07:24.960 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8714999999999999e-05 2024-04-18T21:07:24.960 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.960 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.960 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:24.960 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672581+0000", 2024-04-18T21:07:24.960 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1949e-05 2024-04-18T21:07:24.960 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.960 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.960 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:24.960 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672704+0000", 2024-04-18T21:07:24.960 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000122915 2024-04-18T21:07:24.961 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.961 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.961 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:24.961 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672714+0000", 2024-04-18T21:07:24.961 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0698e-05 2024-04-18T21:07:24.961 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.961 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.961 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:24.961 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.910993+0000", 2024-04-18T21:07:24.961 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.23827911199999999 2024-04-18T21:07:24.961 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.961 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.962 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:24.962 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.911017+0000", 2024-04-18T21:07:24.962 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3419999999999999e-05 2024-04-18T21:07:24.962 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.962 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.962 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:24.962 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.952146+0000", 2024-04-18T21:07:24.962 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0411288869999999 2024-04-18T21:07:24.962 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.962 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.962 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:24.962 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.952467+0000", 2024-04-18T21:07:24.962 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00032165399999999999 2024-04-18T21:07:24.963 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.963 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.963 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:24.963 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.954086+0000", 2024-04-18T21:07:24.963 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0016184820000000001 2024-04-18T21:07:24.963 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.963 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.963 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:24.963 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.960573+0000", 2024-04-18T21:07:24.963 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064874240000000003 2024-04-18T21:07:24.963 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.963 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.963 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:24.963 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.967786+0000", 2024-04-18T21:07:24.964 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0072125069999999999 2024-04-18T21:07:24.964 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.964 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.964 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:24.964 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.967897+0000", 2024-04-18T21:07:24.964 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111679 2024-04-18T21:07:24.964 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.964 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.964 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:24.964 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.968019+0000", 2024-04-18T21:07:24.965 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000121279 2024-04-18T21:07:24.965 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:24.965 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:24.965 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:24.965 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.965 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.965 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:7696 3.f 3:f376ae95:::200.00000016:head [write 3681546~512758 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:24.965 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:12.760706+0000", 2024-04-18T21:07:24.965 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 12.163870572, 2024-04-18T21:07:24.965 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.24998282899999999, 2024-04-18T21:07:24.966 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:24.966 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:24.966 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:24.966 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:24.966 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.966 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:24.966 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.760706+0000", 2024-04-18T21:07:24.966 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:24.966 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.966 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.966 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:24.966 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.760706+0000", 2024-04-18T21:07:24.966 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:24.967 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.967 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.967 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:24.967 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.760710+0000", 2024-04-18T21:07:24.967 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2100000000000003e-06 2024-04-18T21:07:24.967 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.967 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.967 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:24.967 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.761972+0000", 2024-04-18T21:07:24.967 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0012615689999999999 2024-04-18T21:07:24.967 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.967 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.968 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:24.968 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762012+0000", 2024-04-18T21:07:24.968 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0145999999999998e-05 2024-04-18T21:07:24.968 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.968 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.968 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:24.968 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762030+0000", 2024-04-18T21:07:24.968 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8312999999999999e-05 2024-04-18T21:07:24.968 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.968 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.968 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:24.968 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762158+0000", 2024-04-18T21:07:24.968 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012805600000000001 2024-04-18T21:07:24.969 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.969 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.969 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:24.969 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762174+0000", 2024-04-18T21:07:24.969 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5645999999999999e-05 2024-04-18T21:07:24.969 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.969 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.969 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:24.969 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.926080+0000", 2024-04-18T21:07:24.969 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.16390581900000001 2024-04-18T21:07:24.969 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.969 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.969 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for missing object", 2024-04-18T21:07:24.969 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.926149+0000", 2024-04-18T21:07:24.969 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9172999999999997e-05 2024-04-18T21:07:24.970 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.970 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.970 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:24.970 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.002156+0000", 2024-04-18T21:07:24.970 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.076006972000000006 2024-04-18T21:07:24.970 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.970 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.970 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for rw locks", 2024-04-18T21:07:24.970 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.002294+0000", 2024-04-18T21:07:24.970 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000138011 2024-04-18T21:07:24.971 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.971 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.971 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:24.971 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.005436+0000", 2024-04-18T21:07:24.971 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031422749999999999 2024-04-18T21:07:24.971 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.971 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.971 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:24.971 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.005577+0000", 2024-04-18T21:07:24.972 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014105399999999999 2024-04-18T21:07:24.972 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.972 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.972 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:24.972 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.005725+0000", 2024-04-18T21:07:24.972 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014721100000000001 2024-04-18T21:07:24.972 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.972 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.972 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:24.972 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.009143+0000", 2024-04-18T21:07:24.972 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0034179380000000001 2024-04-18T21:07:24.972 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.973 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.973 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:24.973 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.010522+0000", 2024-04-18T21:07:24.973 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0013790919999999999 2024-04-18T21:07:24.973 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.973 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.973 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:24.973 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.010586+0000", 2024-04-18T21:07:24.973 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4713000000000002e-05 2024-04-18T21:07:24.973 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.973 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.973 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:24.973 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.010689+0000", 2024-04-18T21:07:24.973 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000102631 2024-04-18T21:07:24.973 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:24.974 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:24.974 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:24.974 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.974 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.974 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:7697 3.16 3:6b6b4f13:::200.0000001c:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:24.974 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:12.762074+0000", 2024-04-18T21:07:24.974 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 12.162502423999999, 2024-04-18T21:07:24.974 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.2056489, 2024-04-18T21:07:24.974 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:24.974 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:24.974 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:07:24.974 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:24.974 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.975 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:24.975 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762074+0000", 2024-04-18T21:07:24.975 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:24.975 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.975 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.975 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:24.975 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762074+0000", 2024-04-18T21:07:24.975 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:24.975 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.975 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.975 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:24.975 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762076+0000", 2024-04-18T21:07:24.975 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.793e-06 2024-04-18T21:07:24.976 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.976 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.976 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:24.976 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762083+0000", 2024-04-18T21:07:24.976 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7129999999999999e-06 2024-04-18T21:07:24.976 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.976 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.976 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:24.976 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762104+0000", 2024-04-18T21:07:24.976 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1480000000000001e-05 2024-04-18T21:07:24.976 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.976 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.976 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:24.976 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762121+0000", 2024-04-18T21:07:24.976 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.632e-05 2024-04-18T21:07:24.977 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.977 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.977 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:24.977 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762224+0000", 2024-04-18T21:07:24.977 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010346800000000001 2024-04-18T21:07:24.977 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.977 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.977 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:24.977 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762238+0000", 2024-04-18T21:07:24.977 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3482999999999999e-05 2024-04-18T21:07:24.977 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.977 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.977 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:24.977 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.946932+0000", 2024-04-18T21:07:24.977 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.18469451000000001 2024-04-18T21:07:24.978 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.978 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.978 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:24.978 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.947261+0000", 2024-04-18T21:07:24.978 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00032857399999999999 2024-04-18T21:07:24.978 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.978 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.978 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:24.978 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.967723+0000", 2024-04-18T21:07:24.978 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020462559000000002 2024-04-18T21:07:24.978 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:24.978 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:24.978 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:24.978 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.979 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.979 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:10831 4.13 4:c948684f:::1000000032e.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:24.979 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.823266+0000", 2024-04-18T21:07:24.979 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.1013110350000002, 2024-04-18T21:07:24.979 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.65275881599999996, 2024-04-18T21:07:24.979 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:24.979 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:24.979 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:24.979 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:24.979 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.979 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:24.979 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823266+0000", 2024-04-18T21:07:24.979 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:24.981 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.981 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.981 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:24.981 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823266+0000", 2024-04-18T21:07:24.981 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:24.981 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.981 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.981 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:24.981 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823266+0000", 2024-04-18T21:07:24.981 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9800000000000004e-07 2024-04-18T21:07:24.982 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.982 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.982 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:24.982 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823269+0000", 2024-04-18T21:07:24.982 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3259999999999998e-06 2024-04-18T21:07:24.982 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.982 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.982 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:24.982 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823274+0000", 2024-04-18T21:07:24.982 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9830000000000001e-06 2024-04-18T21:07:24.982 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.982 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.982 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:24.983 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823280+0000", 2024-04-18T21:07:24.983 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1540000000000001e-06 2024-04-18T21:07:24.983 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.983 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.983 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:24.983 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823313+0000", 2024-04-18T21:07:24.983 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3667000000000001e-05 2024-04-18T21:07:24.983 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.983 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.983 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:24.983 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823321+0000", 2024-04-18T21:07:24.983 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1200000000000002e-06 2024-04-18T21:07:24.983 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.983 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.984 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:24.984 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.470069+0000", 2024-04-18T21:07:24.984 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.64674728999999997 2024-04-18T21:07:24.984 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.984 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.984 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:24.984 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.470457+0000", 2024-04-18T21:07:24.984 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00038800899999999998 2024-04-18T21:07:24.984 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.984 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.984 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:24.984 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.470755+0000", 2024-04-18T21:07:24.984 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00029781399999999998 2024-04-18T21:07:24.984 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.984 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.985 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:24.985 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.474041+0000", 2024-04-18T21:07:24.985 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032860670000000002 2024-04-18T21:07:24.985 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.985 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.985 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:24.985 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.475621+0000", 2024-04-18T21:07:24.985 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001579925 2024-04-18T21:07:24.985 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.985 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.985 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:24.985 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.475750+0000", 2024-04-18T21:07:24.985 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000129002 2024-04-18T21:07:24.985 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.985 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.985 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:24.986 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.476024+0000", 2024-04-18T21:07:24.986 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000274961 2024-04-18T21:07:24.986 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:24.986 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:24.986 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:24.986 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.986 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.986 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11326 4.13 4:cbbbc9f0:::100000010c6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:24.986 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.917113+0000", 2024-04-18T21:07:24.986 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.0074638329999992, 2024-04-18T21:07:24.986 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.56159817899999998, 2024-04-18T21:07:24.986 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:24.986 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:24.986 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:24.986 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:24.987 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.987 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:24.987 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917113+0000", 2024-04-18T21:07:24.987 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:24.987 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.987 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.987 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:24.987 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917113+0000", 2024-04-18T21:07:24.987 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:24.987 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.987 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.987 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:24.987 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917114+0000", 2024-04-18T21:07:24.988 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5099999999999999e-07 2024-04-18T21:07:24.988 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.988 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.988 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:24.988 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917123+0000", 2024-04-18T21:07:24.988 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5859999999999994e-06 2024-04-18T21:07:24.988 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.988 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.988 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:24.988 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917130+0000", 2024-04-18T21:07:24.988 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9800000000000001e-06 2024-04-18T21:07:24.988 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.988 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.988 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:24.988 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917136+0000", 2024-04-18T21:07:24.989 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.502e-06 2024-04-18T21:07:24.989 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.989 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.989 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:24.989 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917239+0000", 2024-04-18T21:07:24.989 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000103286 2024-04-18T21:07:24.989 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.989 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.989 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:24.989 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917247+0000", 2024-04-18T21:07:24.989 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.49e-06 2024-04-18T21:07:24.989 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.989 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.990 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:24.990 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.472462+0000", 2024-04-18T21:07:24.990 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.55521418899999997 2024-04-18T21:07:24.990 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.990 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.990 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:24.990 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.472801+0000", 2024-04-18T21:07:24.990 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00033935600000000002 2024-04-18T21:07:24.990 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.990 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.990 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:24.990 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.473101+0000", 2024-04-18T21:07:24.990 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030031399999999998 2024-04-18T21:07:24.990 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.990 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.991 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:24.991 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.475574+0000", 2024-04-18T21:07:24.991 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0024732310000000002 2024-04-18T21:07:24.991 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.991 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.991 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:24.991 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.478287+0000", 2024-04-18T21:07:24.991 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027122349999999999 2024-04-18T21:07:24.991 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.991 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.991 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:24.991 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.478467+0000", 2024-04-18T21:07:24.991 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000180645 2024-04-18T21:07:24.991 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.991 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.991 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:24.992 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.478711+0000", 2024-04-18T21:07:24.992 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024371399999999999 2024-04-18T21:07:24.992 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:24.992 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:24.992 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:24.992 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.992 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.992 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11394 4.13 4:cb2e645e:::10000001109.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:24.992 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.925453+0000", 2024-04-18T21:07:24.992 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.9991233099999999, 2024-04-18T21:07:24.992 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.55363756900000005, 2024-04-18T21:07:24.992 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:24.992 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:24.992 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:24.992 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:24.993 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.993 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:24.993 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925453+0000", 2024-04-18T21:07:24.993 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:24.993 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.993 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.993 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:24.993 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925453+0000", 2024-04-18T21:07:24.993 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:24.993 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.993 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.993 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:24.993 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925454+0000", 2024-04-18T21:07:24.993 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1699999999999997e-07 2024-04-18T21:07:24.993 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.994 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.994 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:24.994 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925458+0000", 2024-04-18T21:07:24.994 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7280000000000001e-06 2024-04-18T21:07:24.994 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.994 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.994 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:24.994 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925467+0000", 2024-04-18T21:07:24.994 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7169999999999997e-06 2024-04-18T21:07:24.994 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.994 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.994 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:24.994 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925474+0000", 2024-04-18T21:07:24.994 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1350000000000003e-06 2024-04-18T21:07:24.994 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.995 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.995 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:24.995 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925523+0000", 2024-04-18T21:07:24.995 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9616000000000001e-05 2024-04-18T21:07:24.995 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.995 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.995 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:24.995 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925530+0000", 2024-04-18T21:07:24.995 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0099999999999998e-06 2024-04-18T21:07:24.995 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.995 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.995 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:24.995 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.474474+0000", 2024-04-18T21:07:24.995 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.548943242 2024-04-18T21:07:24.996 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.996 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.996 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:24.996 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.474692+0000", 2024-04-18T21:07:24.996 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00021829799999999999 2024-04-18T21:07:24.996 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.996 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.996 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:24.996 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.474879+0000", 2024-04-18T21:07:24.996 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000187095 2024-04-18T21:07:24.996 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.996 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.996 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:24.996 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.478733+0000", 2024-04-18T21:07:24.996 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003853871 2024-04-18T21:07:24.996 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.997 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.997 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:24.997 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.478840+0000", 2024-04-18T21:07:24.997 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000106623 2024-04-18T21:07:24.997 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.997 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.997 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:24.997 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.478919+0000", 2024-04-18T21:07:24.997 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9326000000000006e-05 2024-04-18T21:07:24.997 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.997 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.997 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:24.997 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479091+0000", 2024-04-18T21:07:24.997 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000172091 2024-04-18T21:07:24.997 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:24.997 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:24.998 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:24.998 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.998 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.998 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11417 4.13 4:cae4f303:::1000000111f.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:24.998 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.927998+0000", 2024-04-18T21:07:24.998 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.9965786699999999, 2024-04-18T21:07:24.998 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.55142600900000005, 2024-04-18T21:07:24.998 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:24.998 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:24.998 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:24.998 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:24.998 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.998 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:24.998 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.927998+0000", 2024-04-18T21:07:24.998 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:24.999 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.999 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.999 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:24.999 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.927998+0000", 2024-04-18T21:07:24.999 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:24.999 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.999 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.999 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:24.999 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.927999+0000", 2024-04-18T21:07:24.999 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2800000000000005e-07 2024-04-18T21:07:24.999 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:24.999 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:24.999 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:24.999 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.928003+0000", 2024-04-18T21:07:25.000 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0060000000000003e-06 2024-04-18T21:07:25.000 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.000 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.000 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:25.000 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.928012+0000", 2024-04-18T21:07:25.000 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.4129999999999995e-06 2024-04-18T21:07:25.000 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.000 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.000 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:25.000 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.928019+0000", 2024-04-18T21:07:25.000 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5590000000000002e-06 2024-04-18T21:07:25.000 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.000 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.000 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:25.000 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.928075+0000", 2024-04-18T21:07:25.001 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5927000000000002e-05 2024-04-18T21:07:25.001 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.001 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.001 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:25.001 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.928091+0000", 2024-04-18T21:07:25.001 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5724999999999999e-05 2024-04-18T21:07:25.001 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.001 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.001 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:25.001 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.476117+0000", 2024-04-18T21:07:25.001 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.54802609899999999 2024-04-18T21:07:25.001 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.001 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.001 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:25.001 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.476310+0000", 2024-04-18T21:07:25.002 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019318100000000001 2024-04-18T21:07:25.002 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.002 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.002 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:25.002 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.476469+0000", 2024-04-18T21:07:25.002 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015902599999999999 2024-04-18T21:07:25.002 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.002 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.002 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:25.002 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479198+0000", 2024-04-18T21:07:25.002 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027292010000000001 2024-04-18T21:07:25.002 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.002 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.002 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:25.002 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479225+0000", 2024-04-18T21:07:25.003 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6483e-05 2024-04-18T21:07:25.003 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.003 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.003 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:25.003 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479301+0000", 2024-04-18T21:07:25.003 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5935999999999999e-05 2024-04-18T21:07:25.003 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.003 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.003 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:25.003 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479424+0000", 2024-04-18T21:07:25.003 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012352500000000001 2024-04-18T21:07:25.003 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:25.003 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:25.003 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:25.003 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.004 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.004 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11538 4.13 4:ca7a7383:::10000001196.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:25.004 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.942641+0000", 2024-04-18T21:07:25.004 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.9819359890000001, 2024-04-18T21:07:25.004 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.538204715, 2024-04-18T21:07:25.004 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:25.004 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:25.004 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:25.004 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:25.004 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.004 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:25.004 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942641+0000", 2024-04-18T21:07:25.005 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:25.005 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.005 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.005 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:25.005 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942641+0000", 2024-04-18T21:07:25.005 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:25.005 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.005 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.005 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:25.005 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942641+0000", 2024-04-18T21:07:25.005 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4099999999999998e-07 2024-04-18T21:07:25.005 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.005 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.006 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:25.006 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942645+0000", 2024-04-18T21:07:25.006 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.788e-06 2024-04-18T21:07:25.006 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.006 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.006 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:25.006 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942654+0000", 2024-04-18T21:07:25.006 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2089999999999994e-06 2024-04-18T21:07:25.006 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.006 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.006 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:25.006 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942668+0000", 2024-04-18T21:07:25.006 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3925e-05 2024-04-18T21:07:25.006 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.007 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.007 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:25.007 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942898+0000", 2024-04-18T21:07:25.007 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00022961800000000001 2024-04-18T21:07:25.007 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.007 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.007 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:25.007 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942907+0000", 2024-04-18T21:07:25.007 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6219999999999998e-06 2024-04-18T21:07:25.007 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.007 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.007 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:25.007 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.477120+0000", 2024-04-18T21:07:25.007 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.53421297400000001 2024-04-18T21:07:25.008 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.008 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.008 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:25.008 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.477466+0000", 2024-04-18T21:07:25.008 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00034685899999999998 2024-04-18T21:07:25.008 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.008 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.008 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:25.008 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.477717+0000", 2024-04-18T21:07:25.008 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00025019799999999998 2024-04-18T21:07:25.008 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.008 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.008 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:25.008 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479518+0000", 2024-04-18T21:07:25.009 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00180105 2024-04-18T21:07:25.009 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.009 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.009 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:25.009 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.480481+0000", 2024-04-18T21:07:25.009 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00096356100000000004 2024-04-18T21:07:25.009 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.009 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.009 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:25.009 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.480618+0000", 2024-04-18T21:07:25.009 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013678599999999999 2024-04-18T21:07:25.009 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.009 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.009 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:25.010 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.480845+0000", 2024-04-18T21:07:25.010 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00022738399999999999 2024-04-18T21:07:25.010 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:25.010 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:25.010 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:25.010 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.010 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.010 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11574 4.13 4:c9cea989:::100000011b9.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:25.010 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.947550+0000", 2024-04-18T21:07:25.010 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.9770262479999996, 2024-04-18T21:07:25.010 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.53632730500000003, 2024-04-18T21:07:25.010 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:25.010 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:25.010 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:25.010 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:25.010 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.011 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:25.011 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947550+0000", 2024-04-18T21:07:25.011 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:25.011 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.011 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.011 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:25.011 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947550+0000", 2024-04-18T21:07:25.011 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:25.011 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.011 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.011 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:25.011 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947551+0000", 2024-04-18T21:07:25.011 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6599999999999996e-07 2024-04-18T21:07:25.011 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.011 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.011 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:25.012 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947554+0000", 2024-04-18T21:07:25.012 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6230000000000001e-06 2024-04-18T21:07:25.012 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.012 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.012 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:25.012 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947562+0000", 2024-04-18T21:07:25.012 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2179999999999999e-06 2024-04-18T21:07:25.012 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.012 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.012 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:25.012 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947567+0000", 2024-04-18T21:07:25.012 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3009999999999997e-06 2024-04-18T21:07:25.012 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.012 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.012 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:25.012 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947624+0000", 2024-04-18T21:07:25.013 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6823999999999997e-05 2024-04-18T21:07:25.013 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.013 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.013 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:25.013 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947633+0000", 2024-04-18T21:07:25.013 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9330000000000007e-06 2024-04-18T21:07:25.013 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.013 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.013 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:25.013 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479591+0000", 2024-04-18T21:07:25.013 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.53195765500000003 2024-04-18T21:07:25.013 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.013 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.014 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:25.014 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479781+0000", 2024-04-18T21:07:25.014 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000190034 2024-04-18T21:07:25.014 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.014 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.014 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:25.014 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479936+0000", 2024-04-18T21:07:25.014 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000154959 2024-04-18T21:07:25.014 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.014 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.014 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:25.014 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.483428+0000", 2024-04-18T21:07:25.014 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003492294 2024-04-18T21:07:25.014 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.015 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.015 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:25.015 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.483479+0000", 2024-04-18T21:07:25.015 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0868999999999997e-05 2024-04-18T21:07:25.015 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.015 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.015 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:25.015 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.483594+0000", 2024-04-18T21:07:25.015 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000115499 2024-04-18T21:07:25.015 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.015 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.015 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:25.015 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.483878+0000", 2024-04-18T21:07:25.016 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028352999999999999 2024-04-18T21:07:25.016 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:25.016 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:25.016 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:25.016 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.016 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.016 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11596 4.13 4:c88ce457:::100000011ce.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:25.016 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.955066+0000", 2024-04-18T21:07:25.016 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.9695108389999998, 2024-04-18T21:07:25.016 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.52924763200000002, 2024-04-18T21:07:25.016 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:25.016 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:25.016 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:25.016 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:25.017 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.017 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:25.017 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955066+0000", 2024-04-18T21:07:25.017 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:25.017 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.017 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.017 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:25.017 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955066+0000", 2024-04-18T21:07:25.017 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:25.017 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.017 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.017 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:25.017 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955066+0000", 2024-04-18T21:07:25.018 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4900000000000001e-07 2024-04-18T21:07:25.018 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.018 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.018 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:25.018 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955068+0000", 2024-04-18T21:07:25.018 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0190000000000001e-06 2024-04-18T21:07:25.018 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.018 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.018 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:25.018 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955076+0000", 2024-04-18T21:07:25.018 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.537e-06 2024-04-18T21:07:25.018 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.018 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.018 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:25.018 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955080+0000", 2024-04-18T21:07:25.018 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1760000000000003e-06 2024-04-18T21:07:25.019 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.019 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.019 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:25.019 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955129+0000", 2024-04-18T21:07:25.019 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8480999999999999e-05 2024-04-18T21:07:25.019 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.019 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.019 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:25.019 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955134+0000", 2024-04-18T21:07:25.019 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1610000000000002e-06 2024-04-18T21:07:25.019 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.019 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.019 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:25.020 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.480932+0000", 2024-04-18T21:07:25.020 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.52579809799999999 2024-04-18T21:07:25.020 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.020 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.020 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:25.020 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.481149+0000", 2024-04-18T21:07:25.020 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00021709100000000001 2024-04-18T21:07:25.020 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.020 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.020 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:25.020 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.481303+0000", 2024-04-18T21:07:25.020 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000153752 2024-04-18T21:07:25.020 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.020 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.021 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:25.021 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.483927+0000", 2024-04-18T21:07:25.021 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026241189999999998 2024-04-18T21:07:25.021 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.021 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.021 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:25.021 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.484028+0000", 2024-04-18T21:07:25.021 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010134899999999999 2024-04-18T21:07:25.021 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.021 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.021 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:25.021 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.484138+0000", 2024-04-18T21:07:25.021 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011015599999999999 2024-04-18T21:07:25.021 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.022 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.022 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:25.022 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.484314+0000", 2024-04-18T21:07:25.022 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017524399999999999 2024-04-18T21:07:25.022 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:25.022 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:25.022 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:25.022 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.022 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.022 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11800 4.13 4:cacc00c7:::10000001296.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:25.022 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.989042+0000", 2024-04-18T21:07:25.022 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.9355351709999997, 2024-04-18T21:07:25.022 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.49832004299999999, 2024-04-18T21:07:25.022 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:25.023 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:25.023 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:25.023 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:25.023 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.023 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:25.023 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989042+0000", 2024-04-18T21:07:25.023 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:25.023 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.023 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.023 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:25.023 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989042+0000", 2024-04-18T21:07:25.023 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:25.023 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.023 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.023 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:25.023 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989042+0000", 2024-04-18T21:07:25.024 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5200000000000002e-07 2024-04-18T21:07:25.024 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.024 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.024 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:25.024 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989044+0000", 2024-04-18T21:07:25.024 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2589999999999999e-06 2024-04-18T21:07:25.024 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.024 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.024 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:25.024 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989051+0000", 2024-04-18T21:07:25.024 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6340000000000003e-06 2024-04-18T21:07:25.024 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.024 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.024 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:25.024 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989062+0000", 2024-04-18T21:07:25.025 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1043000000000001e-05 2024-04-18T21:07:25.025 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.025 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.025 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:25.025 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989367+0000", 2024-04-18T21:07:25.025 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000305249 2024-04-18T21:07:25.025 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.025 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.025 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:25.025 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989376+0000", 2024-04-18T21:07:25.025 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4570000000000005e-06 2024-04-18T21:07:25.025 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.025 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.025 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:25.025 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.482011+0000", 2024-04-18T21:07:25.026 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.49263514200000003 2024-04-18T21:07:25.026 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.026 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.026 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:25.026 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.482397+0000", 2024-04-18T21:07:25.026 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000385986 2024-04-18T21:07:25.026 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.026 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.026 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:25.026 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.482689+0000", 2024-04-18T21:07:25.026 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00029179800000000001 2024-04-18T21:07:25.026 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.026 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.027 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:25.027 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.487008+0000", 2024-04-18T21:07:25.027 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043196129999999999 2024-04-18T21:07:25.027 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.027 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.027 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:25.027 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.487113+0000", 2024-04-18T21:07:25.027 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010498899999999999 2024-04-18T21:07:25.027 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.027 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.027 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:25.027 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.487192+0000", 2024-04-18T21:07:25.027 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8778999999999999e-05 2024-04-18T21:07:25.027 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.028 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.028 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:25.028 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.487362+0000", 2024-04-18T21:07:25.028 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016964200000000001 2024-04-18T21:07:25.028 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:25.028 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:25.028 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:25.028 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.028 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.028 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11888 4.13 4:ca460221:::10000002cd3.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:25.028 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:16.002068+0000", 2024-04-18T21:07:25.028 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.9225085110000002, 2024-04-18T21:07:25.028 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.48938242199999998, 2024-04-18T21:07:25.028 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:25.028 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:25.029 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:25.029 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:25.029 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.029 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:25.029 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002068+0000", 2024-04-18T21:07:25.029 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:25.029 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.029 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.029 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:25.029 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002068+0000", 2024-04-18T21:07:25.029 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:25.029 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.029 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.029 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:25.030 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002069+0000", 2024-04-18T21:07:25.030 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7899999999999999e-07 2024-04-18T21:07:25.030 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.030 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.030 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:25.030 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002071+0000", 2024-04-18T21:07:25.030 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.356e-06 2024-04-18T21:07:25.030 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.030 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.030 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:25.030 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002078+0000", 2024-04-18T21:07:25.030 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.562e-06 2024-04-18T21:07:25.030 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.030 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.031 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:25.031 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002083+0000", 2024-04-18T21:07:25.031 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1939999999999997e-06 2024-04-18T21:07:25.031 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.031 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.031 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:25.031 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002125+0000", 2024-04-18T21:07:25.031 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2548e-05 2024-04-18T21:07:25.031 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.031 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.031 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:25.031 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002132+0000", 2024-04-18T21:07:25.031 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9360000000000002e-06 2024-04-18T21:07:25.031 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.031 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.031 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:25.032 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.484392+0000", 2024-04-18T21:07:25.032 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.48225933500000001 2024-04-18T21:07:25.032 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.032 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.032 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:25.032 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.484630+0000", 2024-04-18T21:07:25.032 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023872499999999999 2024-04-18T21:07:25.032 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.032 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.032 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:25.032 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.484812+0000", 2024-04-18T21:07:25.032 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000181232 2024-04-18T21:07:25.032 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.032 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.032 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:25.032 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.490995+0000", 2024-04-18T21:07:25.033 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0061831459999999996 2024-04-18T21:07:25.033 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.033 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.033 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:25.033 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491132+0000", 2024-04-18T21:07:25.033 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000137145 2024-04-18T21:07:25.033 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.033 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.033 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:25.033 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491219+0000", 2024-04-18T21:07:25.033 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7466000000000006e-05 2024-04-18T21:07:25.033 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.033 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.033 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:25.034 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491451+0000", 2024-04-18T21:07:25.034 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023129800000000001 2024-04-18T21:07:25.034 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:25.034 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:25.034 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:25.034 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.034 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.034 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:12057 4.13 4:cacbe4c4:::10000002d77.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:25.034 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:16.028144+0000", 2024-04-18T21:07:25.034 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.8964329000000006, 2024-04-18T21:07:25.034 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.46365036100000001, 2024-04-18T21:07:25.034 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:25.034 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:25.034 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:25.035 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:25.035 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.035 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:25.035 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028144+0000", 2024-04-18T21:07:25.035 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:25.035 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.035 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.035 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:25.035 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028144+0000", 2024-04-18T21:07:25.035 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:25.035 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.035 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.035 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:25.035 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028144+0000", 2024-04-18T21:07:25.035 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9800000000000003e-07 2024-04-18T21:07:25.035 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.036 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.036 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:25.036 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028147+0000", 2024-04-18T21:07:25.036 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.773e-06 2024-04-18T21:07:25.036 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.036 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.036 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:25.036 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028154+0000", 2024-04-18T21:07:25.036 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8940000000000004e-06 2024-04-18T21:07:25.036 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.036 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.036 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:25.036 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028160+0000", 2024-04-18T21:07:25.036 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7219999999999996e-06 2024-04-18T21:07:25.036 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.036 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.037 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:25.037 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028227+0000", 2024-04-18T21:07:25.037 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6711000000000006e-05 2024-04-18T21:07:25.037 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.037 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.037 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:25.037 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028250+0000", 2024-04-18T21:07:25.037 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3010000000000002e-05 2024-04-18T21:07:25.037 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.037 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.037 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:25.037 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.487484+0000", 2024-04-18T21:07:25.037 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.45923466600000001 2024-04-18T21:07:25.037 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.037 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.037 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:25.038 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.487750+0000", 2024-04-18T21:07:25.038 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026618799999999999 2024-04-18T21:07:25.038 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.038 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.038 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:25.038 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.487915+0000", 2024-04-18T21:07:25.038 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016425500000000001 2024-04-18T21:07:25.038 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.038 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.038 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:25.038 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491559+0000", 2024-04-18T21:07:25.038 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003644109 2024-04-18T21:07:25.038 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.038 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.038 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:25.039 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491586+0000", 2024-04-18T21:07:25.039 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.743e-05 2024-04-18T21:07:25.039 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.039 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.039 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:25.039 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491662+0000", 2024-04-18T21:07:25.039 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5978999999999999e-05 2024-04-18T21:07:25.039 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.039 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.039 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:25.039 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491794+0000", 2024-04-18T21:07:25.039 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013202600000000001 2024-04-18T21:07:25.039 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:25.039 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:25.040 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:25.040 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.040 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.040 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:12078 4.13 4:c93107e9:::10000002d8c.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:25.040 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:16.031090+0000", 2024-04-18T21:07:25.040 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.8934870339999996, 2024-04-18T21:07:25.040 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.461078355, 2024-04-18T21:07:25.040 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:25.040 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:25.040 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:25.040 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:25.040 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.040 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:25.040 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031090+0000", 2024-04-18T21:07:25.040 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:25.041 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.041 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.041 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:25.041 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031090+0000", 2024-04-18T21:07:25.041 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:25.041 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.041 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.041 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:25.041 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031090+0000", 2024-04-18T21:07:25.041 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6599999999999996e-07 2024-04-18T21:07:25.041 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.041 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.041 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:25.042 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031093+0000", 2024-04-18T21:07:25.042 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7659999999999999e-06 2024-04-18T21:07:25.042 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.042 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.042 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:25.042 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031099+0000", 2024-04-18T21:07:25.042 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2269999999999998e-06 2024-04-18T21:07:25.042 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.042 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.042 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:25.042 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031103+0000", 2024-04-18T21:07:25.042 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7929999999999999e-06 2024-04-18T21:07:25.042 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.042 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.042 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:25.043 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031147+0000", 2024-04-18T21:07:25.043 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3742000000000002e-05 2024-04-18T21:07:25.043 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.043 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.043 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:25.043 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031154+0000", 2024-04-18T21:07:25.043 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1999999999999997e-06 2024-04-18T21:07:25.043 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.043 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.043 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:25.043 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.488743+0000", 2024-04-18T21:07:25.043 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.45758900200000002 2024-04-18T21:07:25.043 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.043 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.043 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:25.044 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.488980+0000", 2024-04-18T21:07:25.044 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023704499999999999 2024-04-18T21:07:25.044 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.044 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.044 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:25.044 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.489166+0000", 2024-04-18T21:07:25.044 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018544500000000001 2024-04-18T21:07:25.044 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.044 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.044 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:25.044 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491810+0000", 2024-04-18T21:07:25.044 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026448219999999998 2024-04-18T21:07:25.044 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.044 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.044 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:25.045 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491903+0000", 2024-04-18T21:07:25.045 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2305999999999993e-05 2024-04-18T21:07:25.045 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.045 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.045 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:25.045 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491987+0000", 2024-04-18T21:07:25.045 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4581999999999998e-05 2024-04-18T21:07:25.045 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.045 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.045 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:25.045 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.492168+0000", 2024-04-18T21:07:25.045 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018075900000000001 2024-04-18T21:07:25.045 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:25.045 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:25.045 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:25.045 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.046 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.046 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:12081 4.13 4:cafa1dfa:::10000002d8f.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:25.046 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:16.031865+0000", 2024-04-18T21:07:25.046 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.8927119999999995, 2024-04-18T21:07:25.046 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.460588628, 2024-04-18T21:07:25.046 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:25.046 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:25.046 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:25.046 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:25.046 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.046 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:25.046 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031865+0000", 2024-04-18T21:07:25.046 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:25.046 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.046 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.047 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:25.047 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031865+0000", 2024-04-18T21:07:25.047 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:25.047 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.047 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.047 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:25.047 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031865+0000", 2024-04-18T21:07:25.047 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4799999999999998e-07 2024-04-18T21:07:25.047 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.047 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.047 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:25.047 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031868+0000", 2024-04-18T21:07:25.047 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6570000000000001e-06 2024-04-18T21:07:25.047 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.048 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.048 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:25.048 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031874+0000", 2024-04-18T21:07:25.048 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4370000000000004e-06 2024-04-18T21:07:25.048 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.048 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.048 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:25.048 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031879+0000", 2024-04-18T21:07:25.048 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8729999999999998e-06 2024-04-18T21:07:25.048 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.048 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.048 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:25.048 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031924+0000", 2024-04-18T21:07:25.048 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4314999999999998e-05 2024-04-18T21:07:25.049 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.049 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.049 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:25.049 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031929+0000", 2024-04-18T21:07:25.049 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9980000000000003e-06 2024-04-18T21:07:25.049 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.049 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.049 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:25.049 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.489813+0000", 2024-04-18T21:07:25.049 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.45788481800000003 2024-04-18T21:07:25.049 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.049 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.049 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:25.050 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.490188+0000", 2024-04-18T21:07:25.050 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00037420699999999999 2024-04-18T21:07:25.050 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.050 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.050 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:25.050 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.490423+0000", 2024-04-18T21:07:25.050 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023582400000000001 2024-04-18T21:07:25.050 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.050 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.050 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:25.050 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.492238+0000", 2024-04-18T21:07:25.050 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018143930000000001 2024-04-18T21:07:25.050 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.050 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.051 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:25.051 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.492256+0000", 2024-04-18T21:07:25.051 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7706999999999998e-05 2024-04-18T21:07:25.051 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.051 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.051 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:25.051 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.492323+0000", 2024-04-18T21:07:25.051 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7222000000000001e-05 2024-04-18T21:07:25.051 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:25.051 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:25.051 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:25.051 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.492453+0000", 2024-04-18T21:07:25.051 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000130529 2024-04-18T21:07:25.051 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:25.051 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:25.051 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:25.052 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:25.052 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:25.052 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:07:25.055 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2024-04-18T21:07:25.055 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:25.054+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:25.055 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-18T21:07:25.056 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:07:25.155 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:25.157+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:25.186 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:07:25.186 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:07:25.186 INFO:teuthology.orchestra.run.smithi132.stdout: "num_ops": 0 2024-04-18T21:07:25.186 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:07:25.201 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:07:25.256 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:25.254+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:25.341 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2024-04-18T21:07:25.356 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:25.358+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:25.358 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-18T21:07:25.369 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:07:25.369 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:07:25.369 INFO:teuthology.orchestra.run.smithi132.stdout: "complaint_time": 30, 2024-04-18T21:07:25.369 INFO:teuthology.orchestra.run.smithi132.stdout: "num_blocked_ops": 0 2024-04-18T21:07:25.370 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:07:25.385 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:07:25.458 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:25.458+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:25.480 INFO:teuthology.orchestra.run.smithi078.stderr:nodeep-scrub is set 2024-04-18T21:07:25.507 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:07:25.507 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 20, 2024-04-18T21:07:25.507 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 600, 2024-04-18T21:07:25.507 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [ 2024-04-18T21:07:25.507 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.508 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-18T21:07:25.508 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:07:25.508 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 139.88984189000001, 2024-04-18T21:07:25.508 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043581898000000001, 2024-04-18T21:07:25.508 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:25.508 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:25.508 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:25.508 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:25.508 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.508 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:25.508 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:07:25.508 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:25.508 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.509 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.509 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:25.509 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616640+0000", 2024-04-18T21:07:25.509 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:25.509 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.509 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.509 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:25.509 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616641+0000", 2024-04-18T21:07:25.509 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2330000000000001e-06 2024-04-18T21:07:25.509 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.509 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.509 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:25.509 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616648+0000", 2024-04-18T21:07:25.510 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.3860000000000001e-06 2024-04-18T21:07:25.510 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.510 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.510 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:25.510 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616666+0000", 2024-04-18T21:07:25.510 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7583000000000001e-05 2024-04-18T21:07:25.510 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.510 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.510 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:25.510 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.616679+0000", 2024-04-18T21:07:25.510 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3322999999999999e-05 2024-04-18T21:07:25.510 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.510 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.511 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:25.511 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630373+0000", 2024-04-18T21:07:25.511 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.013694207999999999 2024-04-18T21:07:25.511 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.511 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.511 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:25.511 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630545+0000", 2024-04-18T21:07:25.511 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000171683 2024-04-18T21:07:25.511 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.511 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.511 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 1", 2024-04-18T21:07:25.511 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.630728+0000", 2024-04-18T21:07:25.511 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000182599 2024-04-18T21:07:25.511 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.511 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.512 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:25.512 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.640600+0000", 2024-04-18T21:07:25.512 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0098726119999999994 2024-04-18T21:07:25.512 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.512 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.512 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:25.512 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.659927+0000", 2024-04-18T21:07:25.512 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019326724999999999 2024-04-18T21:07:25.512 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.512 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.512 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:25.512 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660112+0000", 2024-04-18T21:07:25.512 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000185203 2024-04-18T21:07:25.512 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.512 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.512 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:25.513 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:05:05.660222+0000", 2024-04-18T21:07:25.513 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000109343 2024-04-18T21:07:25.513 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:25.513 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:25.513 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:25.513 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.513 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.513 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11357 4.38 4:1d691e75:::1000000312c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T21:07:25.513 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:58.595279+0000", 2024-04-18T21:07:25.513 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 26.911202979999999, 2024-04-18T21:07:25.513 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.045901399000000002, 2024-04-18T21:07:25.513 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:25.513 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:25.513 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:25.513 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:25.514 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:25.514 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:25.514 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11357 2024-04-18T21:07:25.514 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.514 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:25.514 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.514 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:25.514 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.595279+0000", 2024-04-18T21:07:25.514 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:25.514 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.514 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.514 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:25.514 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.595279+0000", 2024-04-18T21:07:25.514 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:25.515 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.515 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.515 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:25.515 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.595280+0000", 2024-04-18T21:07:25.515 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.079e-06 2024-04-18T21:07:25.515 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.515 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.515 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:25.515 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600237+0000", 2024-04-18T21:07:25.515 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0049569089999999998 2024-04-18T21:07:25.515 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.515 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.515 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:25.515 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600254+0000", 2024-04-18T21:07:25.515 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7399000000000001e-05 2024-04-18T21:07:25.516 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.516 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.516 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:25.516 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600262+0000", 2024-04-18T21:07:25.516 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.174e-06 2024-04-18T21:07:25.516 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.516 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.516 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:25.516 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600359+0000", 2024-04-18T21:07:25.516 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.6358000000000001e-05 2024-04-18T21:07:25.516 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.517 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.517 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:25.517 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600507+0000", 2024-04-18T21:07:25.517 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014854199999999999 2024-04-18T21:07:25.517 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.517 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.517 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:25.517 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.600748+0000", 2024-04-18T21:07:25.517 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000241361 2024-04-18T21:07:25.517 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.517 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.517 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:25.517 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.615590+0000", 2024-04-18T21:07:25.517 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.014841851 2024-04-18T21:07:25.518 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.518 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.518 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:25.518 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.639817+0000", 2024-04-18T21:07:25.518 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.024226527000000001 2024-04-18T21:07:25.518 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.518 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.518 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:25.518 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.640962+0000", 2024-04-18T21:07:25.518 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001145561 2024-04-18T21:07:25.518 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.518 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.518 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:25.518 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.641180+0000", 2024-04-18T21:07:25.519 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00021763800000000001 2024-04-18T21:07:25.519 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:25.519 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:25.519 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:25.519 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.519 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.519 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11443 4.38 4:1d691e75:::1000000312c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-18T21:07:25.519 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:58.744218+0000", 2024-04-18T21:07:25.519 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 26.762263313999998, 2024-04-18T21:07:25.519 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.051074359999999999, 2024-04-18T21:07:25.519 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:25.519 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:25.519 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:25.519 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:25.519 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:25.520 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:25.520 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11443 2024-04-18T21:07:25.520 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.520 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:25.520 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.520 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:25.520 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.744218+0000", 2024-04-18T21:07:25.520 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:25.520 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.520 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.520 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:25.520 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.744218+0000", 2024-04-18T21:07:25.521 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:25.521 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.521 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.521 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:25.521 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.744221+0000", 2024-04-18T21:07:25.521 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.3580000000000001e-06 2024-04-18T21:07:25.521 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.521 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.521 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:25.521 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753328+0000", 2024-04-18T21:07:25.521 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0091071339999999994 2024-04-18T21:07:25.521 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.521 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.522 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:25.522 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753351+0000", 2024-04-18T21:07:25.522 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.3479999999999999e-05 2024-04-18T21:07:25.522 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.522 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.522 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:25.522 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753363+0000", 2024-04-18T21:07:25.522 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1345000000000001e-05 2024-04-18T21:07:25.522 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.522 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.522 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:25.522 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753416+0000", 2024-04-18T21:07:25.522 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.2849999999999997e-05 2024-04-18T21:07:25.522 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.523 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.523 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:25.523 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753471+0000", 2024-04-18T21:07:25.523 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.5717999999999997e-05 2024-04-18T21:07:25.523 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.523 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.523 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:25.523 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.753560+0000", 2024-04-18T21:07:25.523 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8777999999999996e-05 2024-04-18T21:07:25.523 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.523 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.523 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:25.523 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.760182+0000", 2024-04-18T21:07:25.524 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0066216299999999999 2024-04-18T21:07:25.524 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.524 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.524 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:25.524 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.795094+0000", 2024-04-18T21:07:25.524 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.034912334000000003 2024-04-18T21:07:25.524 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.524 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.524 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:25.524 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.795221+0000", 2024-04-18T21:07:25.524 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012745899999999999 2024-04-18T21:07:25.524 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.524 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.524 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:25.525 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.795293+0000", 2024-04-18T21:07:25.525 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.1273999999999996e-05 2024-04-18T21:07:25.525 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:25.525 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:25.525 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:25.525 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.525 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.525 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11511 4.18 4:184fae4a:::1000000316d.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:25.525 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:58.838500+0000", 2024-04-18T21:07:25.525 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 26.667981434000001, 2024-04-18T21:07:25.525 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.044451537999999999, 2024-04-18T21:07:25.525 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:25.525 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:25.525 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:25.525 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:25.526 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:25.526 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:25.526 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11511 2024-04-18T21:07:25.526 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.526 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:25.526 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.526 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:25.526 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.838500+0000", 2024-04-18T21:07:25.526 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:25.526 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.526 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.526 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:25.526 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.838500+0000", 2024-04-18T21:07:25.527 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:25.527 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.527 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.527 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:25.527 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.838501+0000", 2024-04-18T21:07:25.527 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.4799999999999997e-07 2024-04-18T21:07:25.527 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.527 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.527 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:25.527 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.847806+0000", 2024-04-18T21:07:25.527 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0093054250000000008 2024-04-18T21:07:25.527 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.527 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.527 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:25.528 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.847834+0000", 2024-04-18T21:07:25.528 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7161999999999998e-05 2024-04-18T21:07:25.528 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.528 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.528 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:25.528 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.847849+0000", 2024-04-18T21:07:25.528 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5217e-05 2024-04-18T21:07:25.528 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.528 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.528 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:25.528 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.847917+0000", 2024-04-18T21:07:25.528 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7896000000000002e-05 2024-04-18T21:07:25.528 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.529 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.529 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:25.529 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.848080+0000", 2024-04-18T21:07:25.529 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016328299999999999 2024-04-18T21:07:25.529 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.529 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.529 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:25.529 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.848348+0000", 2024-04-18T21:07:25.529 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00026766099999999998 2024-04-18T21:07:25.529 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.529 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.529 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:25.529 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.863288+0000", 2024-04-18T21:07:25.529 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.014940301 2024-04-18T21:07:25.529 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.530 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.530 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:25.530 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.882854+0000", 2024-04-18T21:07:25.530 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019566456999999999 2024-04-18T21:07:25.530 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.530 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.530 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:25.530 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.882904+0000", 2024-04-18T21:07:25.530 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.9620999999999998e-05 2024-04-18T21:07:25.530 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.530 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.530 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:25.530 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:58.882952+0000", 2024-04-18T21:07:25.530 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.7766999999999999e-05 2024-04-18T21:07:25.531 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:25.531 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:25.531 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:25.531 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.531 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.531 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11728 4.39 4:9dcc5ecf:::1000000316e.00000000:head [write 0~4194304 [2@1720266]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:25.531 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.088728+0000", 2024-04-18T21:07:25.531 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 26.417753566999998, 2024-04-18T21:07:25.531 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.047519835000000003, 2024-04-18T21:07:25.531 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:25.531 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:25.531 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:25.531 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:25.531 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:25.532 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:25.532 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11728 2024-04-18T21:07:25.532 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.532 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:25.532 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.532 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:25.532 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.088728+0000", 2024-04-18T21:07:25.532 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:25.532 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.532 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.532 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:25.532 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.088728+0000", 2024-04-18T21:07:25.532 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:25.532 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.532 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.533 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:25.533 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.088729+0000", 2024-04-18T21:07:25.533 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1000000000000001e-06 2024-04-18T21:07:25.533 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.533 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.533 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:25.533 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094322+0000", 2024-04-18T21:07:25.533 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0055931349999999999 2024-04-18T21:07:25.533 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.533 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.533 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:25.533 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094334+0000", 2024-04-18T21:07:25.533 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1894e-05 2024-04-18T21:07:25.533 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.533 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.534 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:25.534 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094340+0000", 2024-04-18T21:07:25.534 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.8780000000000003e-06 2024-04-18T21:07:25.534 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.534 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.534 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:25.534 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094393+0000", 2024-04-18T21:07:25.534 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3275000000000001e-05 2024-04-18T21:07:25.534 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.534 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.534 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:25.534 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094479+0000", 2024-04-18T21:07:25.534 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5222999999999994e-05 2024-04-18T21:07:25.535 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.535 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.535 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:25.535 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.094629+0000", 2024-04-18T21:07:25.535 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00015021699999999999 2024-04-18T21:07:25.535 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.535 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.535 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:25.535 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.102975+0000", 2024-04-18T21:07:25.535 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0083464460000000004 2024-04-18T21:07:25.535 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.535 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.535 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:25.535 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136142+0000", 2024-04-18T21:07:25.536 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.033166432000000003 2024-04-18T21:07:25.536 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.536 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.536 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:25.536 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136207+0000", 2024-04-18T21:07:25.536 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.5032999999999999e-05 2024-04-18T21:07:25.536 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.536 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.536 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:25.536 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.136248+0000", 2024-04-18T21:07:25.536 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.1202000000000003e-05 2024-04-18T21:07:25.536 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:25.536 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:25.536 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:25.537 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.537 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.537 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11847 4.a 4:51f063b7:::100000032b5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:25.537 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.229180+0000", 2024-04-18T21:07:25.537 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 26.277301511000001, 2024-04-18T21:07:25.537 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.048001033999999998, 2024-04-18T21:07:25.537 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:25.537 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:25.537 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:25.537 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:25.537 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:25.537 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:25.537 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11847 2024-04-18T21:07:25.537 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.537 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:25.538 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.538 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:25.538 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.229180+0000", 2024-04-18T21:07:25.538 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:25.538 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.538 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.538 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:25.538 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.229180+0000", 2024-04-18T21:07:25.538 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:25.538 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.538 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.538 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:25.539 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.229181+0000", 2024-04-18T21:07:25.539 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.119e-06 2024-04-18T21:07:25.539 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.539 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.539 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:25.539 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.235951+0000", 2024-04-18T21:07:25.539 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0067702370000000001 2024-04-18T21:07:25.539 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.539 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.539 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:25.539 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.235965+0000", 2024-04-18T21:07:25.539 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3202e-05 2024-04-18T21:07:25.539 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.539 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.540 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:25.540 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.235973+0000", 2024-04-18T21:07:25.540 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8630000000000008e-06 2024-04-18T21:07:25.540 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.540 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.540 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:25.540 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.236047+0000", 2024-04-18T21:07:25.540 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.4453e-05 2024-04-18T21:07:25.540 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.540 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.540 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:25.540 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.236137+0000", 2024-04-18T21:07:25.540 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.9751000000000002e-05 2024-04-18T21:07:25.540 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.540 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.540 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:25.541 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.236266+0000", 2024-04-18T21:07:25.541 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000129257 2024-04-18T21:07:25.541 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.541 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.541 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:25.541 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.244520+0000", 2024-04-18T21:07:25.541 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0082538190000000008 2024-04-18T21:07:25.541 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.541 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.541 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:25.541 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.277093+0000", 2024-04-18T21:07:25.541 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.032573405999999999 2024-04-18T21:07:25.541 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.541 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.541 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:25.541 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.277144+0000", 2024-04-18T21:07:25.542 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.0553000000000002e-05 2024-04-18T21:07:25.542 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.542 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.542 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:25.542 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.277181+0000", 2024-04-18T21:07:25.542 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.7373999999999998e-05 2024-04-18T21:07:25.542 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:25.542 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:25.542 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:25.542 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.542 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.542 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:11949 4.2b 4:d50cc3c5:::100000031c6.00000000:head [write 0~3145728] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:25.542 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.338113+0000", 2024-04-18T21:07:25.542 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 26.168368635, 2024-04-18T21:07:25.543 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.046907847000000003, 2024-04-18T21:07:25.543 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:25.543 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:25.543 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:25.543 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:25.543 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:25.543 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:25.543 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 11949 2024-04-18T21:07:25.543 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.543 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:25.543 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.543 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:25.543 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.338113+0000", 2024-04-18T21:07:25.543 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:25.543 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.543 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.544 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:25.544 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.338113+0000", 2024-04-18T21:07:25.544 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:25.544 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.544 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.544 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:25.544 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.338115+0000", 2024-04-18T21:07:25.544 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5659999999999999e-06 2024-04-18T21:07:25.544 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.544 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.544 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:25.544 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344146+0000", 2024-04-18T21:07:25.545 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0060309339999999999 2024-04-18T21:07:25.545 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.545 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.545 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:25.545 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344163+0000", 2024-04-18T21:07:25.545 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6994999999999999e-05 2024-04-18T21:07:25.545 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.545 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.545 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:25.545 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344171+0000", 2024-04-18T21:07:25.545 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.5520000000000005e-06 2024-04-18T21:07:25.545 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.545 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.546 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:25.546 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344604+0000", 2024-04-18T21:07:25.546 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00043326299999999997 2024-04-18T21:07:25.546 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.546 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.546 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:25.546 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344687+0000", 2024-04-18T21:07:25.546 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.2952000000000001e-05 2024-04-18T21:07:25.546 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.546 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.546 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:25.546 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.344792+0000", 2024-04-18T21:07:25.546 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000104635 2024-04-18T21:07:25.546 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.547 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.547 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:25.547 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.361867+0000", 2024-04-18T21:07:25.547 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017075245999999999 2024-04-18T21:07:25.547 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.547 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.547 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:25.547 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.384879+0000", 2024-04-18T21:07:25.547 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.023011474000000001 2024-04-18T21:07:25.547 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.547 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.547 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:25.547 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.384976+0000", 2024-04-18T21:07:25.547 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.7399999999999996e-05 2024-04-18T21:07:25.548 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.548 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.548 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:25.548 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.385021+0000", 2024-04-18T21:07:25.548 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.4830000000000003e-05 2024-04-18T21:07:25.548 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:25.548 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:25.548 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:25.548 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.548 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.548 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:12041 4.38 4:1c8d9fef:::100000033ed.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:25.548 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:06:59.446812+0000", 2024-04-18T21:07:25.548 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 26.059669394, 2024-04-18T21:07:25.548 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.044749606999999997, 2024-04-18T21:07:25.549 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:25.549 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:25.549 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:25.549 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:25.549 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:25.549 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:25.549 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 12041 2024-04-18T21:07:25.549 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.549 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:25.549 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.549 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:25.549 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.446812+0000", 2024-04-18T21:07:25.549 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:25.549 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.550 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.550 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:25.550 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.446812+0000", 2024-04-18T21:07:25.550 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:25.550 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.550 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.550 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:25.550 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.446814+0000", 2024-04-18T21:07:25.550 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5099999999999999e-06 2024-04-18T21:07:25.550 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.550 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.550 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:25.550 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.452583+0000", 2024-04-18T21:07:25.551 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0057696379999999997 2024-04-18T21:07:25.551 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.551 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.551 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:25.551 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.452599+0000", 2024-04-18T21:07:25.551 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5701000000000001e-05 2024-04-18T21:07:25.551 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.551 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.551 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:25.551 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.452607+0000", 2024-04-18T21:07:25.551 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.7100000000000007e-06 2024-04-18T21:07:25.551 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.551 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.551 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:25.552 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.452718+0000", 2024-04-18T21:07:25.552 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000111257 2024-04-18T21:07:25.552 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.552 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.552 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:25.552 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.452924+0000", 2024-04-18T21:07:25.552 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000206066 2024-04-18T21:07:25.552 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.552 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.552 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:25.552 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.453088+0000", 2024-04-18T21:07:25.552 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016336700000000001 2024-04-18T21:07:25.552 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.552 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.553 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:25.553 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.469818+0000", 2024-04-18T21:07:25.553 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016730248999999999 2024-04-18T21:07:25.553 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.553 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.553 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:25.553 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.491505+0000", 2024-04-18T21:07:25.553 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021687366 2024-04-18T21:07:25.553 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.553 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.553 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:25.553 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.491537+0000", 2024-04-18T21:07:25.553 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.1888999999999999e-05 2024-04-18T21:07:25.553 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.554 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.554 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:25.554 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:06:59.491562+0000", 2024-04-18T21:07:25.554 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.4854e-05 2024-04-18T21:07:25.554 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:25.554 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:25.554 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:25.554 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.554 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.554 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_repop(client.4534.0:12689 4.26 e58/16 4:64a7f444:::100000033e5.00000000:head v 58'205, mlcod=58'203)", 2024-04-18T21:07:25.554 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:00.217785+0000", 2024-04-18T21:07:25.554 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 25.288696599000001, 2024-04-18T21:07:25.555 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.052245469000000003, 2024-04-18T21:07:25.555 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:25.555 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:25.555 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:25.555 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:25.555 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.555 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:25.555 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.217785+0000", 2024-04-18T21:07:25.555 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:25.555 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.555 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.555 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:25.555 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.217785+0000", 2024-04-18T21:07:25.555 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:25.556 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.556 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.556 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:25.556 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.217786+0000", 2024-04-18T21:07:25.556 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6700000000000002e-07 2024-04-18T21:07:25.556 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.556 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.556 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:25.556 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225111+0000", 2024-04-18T21:07:25.556 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0073251119999999999 2024-04-18T21:07:25.556 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.556 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.556 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:25.556 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225126+0000", 2024-04-18T21:07:25.557 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.541e-05 2024-04-18T21:07:25.557 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.557 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.557 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:25.557 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225137+0000", 2024-04-18T21:07:25.557 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0890000000000001e-05 2024-04-18T21:07:25.557 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.557 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.557 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:25.557 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225244+0000", 2024-04-18T21:07:25.557 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000106555 2024-04-18T21:07:25.557 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.557 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.558 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:25.558 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225276+0000", 2024-04-18T21:07:25.558 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.2574999999999999e-05 2024-04-18T21:07:25.558 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.558 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.558 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:25.558 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.269985+0000", 2024-04-18T21:07:25.558 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.044708422999999997 2024-04-18T21:07:25.558 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.558 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.558 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:25.558 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.270031+0000", 2024-04-18T21:07:25.558 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.5636999999999997e-05 2024-04-18T21:07:25.558 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:25.559 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:25.559 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:25.559 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.559 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.559 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:12692 4.3a 4:5c788ec1:::100000032ff.00000000:head [write 0~4194304 [2@945974]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:25.559 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:00.225134+0000", 2024-04-18T21:07:25.559 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 25.281347543999999, 2024-04-18T21:07:25.559 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.048311640000000003, 2024-04-18T21:07:25.559 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:25.559 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:25.559 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:25.559 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:25.559 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:25.559 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:25.559 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 12692 2024-04-18T21:07:25.560 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.560 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:25.560 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.560 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:25.560 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225134+0000", 2024-04-18T21:07:25.560 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:25.560 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.560 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.560 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:25.560 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225134+0000", 2024-04-18T21:07:25.560 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:25.560 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.560 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.560 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:25.560 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.225136+0000", 2024-04-18T21:07:25.561 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4160000000000001e-06 2024-04-18T21:07:25.561 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.561 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.561 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:25.561 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231408+0000", 2024-04-18T21:07:25.561 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.006272517 2024-04-18T21:07:25.561 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.561 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.561 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:25.561 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231437+0000", 2024-04-18T21:07:25.561 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.9119e-05 2024-04-18T21:07:25.561 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.561 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.561 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:25.561 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231456+0000", 2024-04-18T21:07:25.561 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8544999999999999e-05 2024-04-18T21:07:25.562 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.562 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.562 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:25.562 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231579+0000", 2024-04-18T21:07:25.562 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000123762 2024-04-18T21:07:25.562 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.562 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.562 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:25.562 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231690+0000", 2024-04-18T21:07:25.562 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000110349 2024-04-18T21:07:25.562 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.562 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.563 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:25.563 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.231903+0000", 2024-04-18T21:07:25.563 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000212695 2024-04-18T21:07:25.563 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.563 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.563 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:25.563 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.253911+0000", 2024-04-18T21:07:25.563 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.022008706999999999 2024-04-18T21:07:25.563 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.563 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.563 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:25.563 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.273383+0000", 2024-04-18T21:07:25.563 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.019471568000000002 2024-04-18T21:07:25.563 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.564 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.564 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:25.564 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.273418+0000", 2024-04-18T21:07:25.564 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.5265999999999997e-05 2024-04-18T21:07:25.564 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.564 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.564 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:25.564 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:00.273446+0000", 2024-04-18T21:07:25.564 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7696e-05 2024-04-18T21:07:25.564 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:25.564 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:25.564 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:25.564 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.564 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.564 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:15094 4.c 4:32870457:::10000003692.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-18T21:07:25.565 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:03.107374+0000", 2024-04-18T21:07:25.565 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 22.399107220000001, 2024-04-18T21:07:25.565 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.061575983000000001, 2024-04-18T21:07:25.565 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:25.565 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:25.565 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:25.565 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:25.565 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:25.565 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:25.565 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 15094 2024-04-18T21:07:25.565 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.565 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:25.565 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.565 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:25.565 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.107374+0000", 2024-04-18T21:07:25.566 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:25.566 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.566 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.566 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:25.566 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.107374+0000", 2024-04-18T21:07:25.566 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:25.566 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.566 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.566 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:25.566 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.107376+0000", 2024-04-18T21:07:25.566 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3969999999999999e-06 2024-04-18T21:07:25.566 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.566 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.567 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:25.567 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115698+0000", 2024-04-18T21:07:25.567 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0083223989999999994 2024-04-18T21:07:25.567 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.567 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.567 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:25.567 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115713+0000", 2024-04-18T21:07:25.567 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4385e-05 2024-04-18T21:07:25.567 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.567 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.567 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:25.567 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115722+0000", 2024-04-18T21:07:25.567 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0759999999999992e-06 2024-04-18T21:07:25.568 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.568 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.568 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:25.568 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115784+0000", 2024-04-18T21:07:25.568 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.2348999999999995e-05 2024-04-18T21:07:25.568 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.568 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.568 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:25.568 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115849+0000", 2024-04-18T21:07:25.568 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.4964999999999999e-05 2024-04-18T21:07:25.568 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.568 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.568 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:25.569 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.116054+0000", 2024-04-18T21:07:25.569 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020483400000000001 2024-04-18T21:07:25.569 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.569 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.569 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:25.569 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.125769+0000", 2024-04-18T21:07:25.569 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0097153340000000008 2024-04-18T21:07:25.569 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.569 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.569 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:25.569 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.168834+0000", 2024-04-18T21:07:25.569 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043064527999999998 2024-04-18T21:07:25.570 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.570 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.570 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:25.570 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.168882+0000", 2024-04-18T21:07:25.570 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.7919e-05 2024-04-18T21:07:25.570 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.570 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.570 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:25.570 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.168950+0000", 2024-04-18T21:07:25.570 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.8796999999999999e-05 2024-04-18T21:07:25.570 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:25.570 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:25.570 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:25.571 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.571 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.571 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:15133 4.38 4:1c73eb83:::1000000398c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-18T21:07:25.571 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:03.155031+0000", 2024-04-18T21:07:25.571 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 22.351450678999999, 2024-04-18T21:07:25.571 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.044078787000000001, 2024-04-18T21:07:25.571 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:25.571 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:25.571 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:25.571 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:25.571 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:25.571 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:25.571 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 15133 2024-04-18T21:07:25.572 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.572 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:25.572 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.572 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:25.572 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.155031+0000", 2024-04-18T21:07:25.572 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:25.572 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.572 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.572 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:25.572 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.155031+0000", 2024-04-18T21:07:25.572 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:25.572 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.572 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.573 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:25.573 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.155033+0000", 2024-04-18T21:07:25.573 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.84e-06 2024-04-18T21:07:25.573 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.573 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.573 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:25.573 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.161994+0000", 2024-04-18T21:07:25.573 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0069607779999999999 2024-04-18T21:07:25.573 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.573 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.573 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:25.573 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.162008+0000", 2024-04-18T21:07:25.573 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4399000000000001e-05 2024-04-18T21:07:25.574 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.574 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.574 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:25.574 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.162018+0000", 2024-04-18T21:07:25.574 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.7149999999999993e-06 2024-04-18T21:07:25.574 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.574 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.574 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:25.574 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.162073+0000", 2024-04-18T21:07:25.574 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4803999999999999e-05 2024-04-18T21:07:25.574 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.574 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.574 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:25.574 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.162215+0000", 2024-04-18T21:07:25.574 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014222900000000001 2024-04-18T21:07:25.575 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.575 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.575 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:25.575 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.162341+0000", 2024-04-18T21:07:25.575 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012579400000000001 2024-04-18T21:07:25.575 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.575 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.575 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:25.575 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.169445+0000", 2024-04-18T21:07:25.575 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0071040360000000002 2024-04-18T21:07:25.575 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.575 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.575 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:25.575 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.199046+0000", 2024-04-18T21:07:25.576 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.029601639999999999 2024-04-18T21:07:25.576 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.576 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.576 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:25.576 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.199082+0000", 2024-04-18T21:07:25.576 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.6134999999999999e-05 2024-04-18T21:07:25.576 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.576 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.576 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:25.576 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.199110+0000", 2024-04-18T21:07:25.576 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7416999999999999e-05 2024-04-18T21:07:25.576 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:25.576 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:25.576 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:25.577 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.577 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.577 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7616 4.d 4:b1f7eab6:::10000001d5f.00000000:head [delete] snapc 1=[] RETRY=2 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:25.577 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882522+0000", 2024-04-18T21:07:25.577 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 13.623959328, 2024-04-18T21:07:25.577 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.086006255, 2024-04-18T21:07:25.577 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:25.577 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:25.577 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "reached pg", 2024-04-18T21:07:25.577 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:25.577 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.577 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:25.577 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882522+0000", 2024-04-18T21:07:25.578 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:25.578 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.578 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.578 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:25.578 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882522+0000", 2024-04-18T21:07:25.578 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:25.578 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.578 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.578 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:25.578 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882524+0000", 2024-04-18T21:07:25.578 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4720000000000001e-06 2024-04-18T21:07:25.578 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.578 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.578 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:25.579 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882531+0000", 2024-04-18T21:07:25.579 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7830000000000001e-06 2024-04-18T21:07:25.579 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.579 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.579 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:25.579 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882549+0000", 2024-04-18T21:07:25.579 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8765000000000001e-05 2024-04-18T21:07:25.579 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.579 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.579 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:25.579 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882562+0000", 2024-04-18T21:07:25.579 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3117e-05 2024-04-18T21:07:25.579 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.579 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.580 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:25.580 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882690+0000", 2024-04-18T21:07:25.580 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012794799999999999 2024-04-18T21:07:25.580 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.580 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.580 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op must wait for map", 2024-04-18T21:07:25.580 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882701+0000", 2024-04-18T21:07:25.580 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0215e-05 2024-04-18T21:07:25.580 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.580 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.580 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:25.580 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.891964+0000", 2024-04-18T21:07:25.580 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0092636130000000004 2024-04-18T21:07:25.581 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.581 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.581 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:25.581 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.891976+0000", 2024-04-18T21:07:25.581 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1973e-05 2024-04-18T21:07:25.581 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.581 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.581 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:25.581 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.959520+0000", 2024-04-18T21:07:25.581 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0675436009999999 2024-04-18T21:07:25.581 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.581 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.581 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for missing object", 2024-04-18T21:07:25.581 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.959662+0000", 2024-04-18T21:07:25.582 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014253000000000001 2024-04-18T21:07:25.582 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.582 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.582 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:25.582 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.968480+0000", 2024-04-18T21:07:25.582 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0088178409999999999 2024-04-18T21:07:25.582 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.582 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.582 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:25.582 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.968529+0000", 2024-04-18T21:07:25.582 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8396999999999998e-05 2024-04-18T21:07:25.582 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:25.582 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:25.582 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:25.583 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.583 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.583 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7628 4.31 4:8c97f9cd:::10000001d6c.00000000:head [delete] snapc 1=[] RETRY=2 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:25.583 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882610+0000", 2024-04-18T21:07:25.583 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 13.623871598000001, 2024-04-18T21:07:25.583 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.08538018, 2024-04-18T21:07:25.583 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:25.583 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:25.583 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "reached pg", 2024-04-18T21:07:25.583 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:25.583 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.583 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:25.583 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882610+0000", 2024-04-18T21:07:25.584 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:25.584 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.584 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.584 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:25.584 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882610+0000", 2024-04-18T21:07:25.584 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:25.584 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.584 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.584 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:25.584 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882611+0000", 2024-04-18T21:07:25.584 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.4199999999999995e-07 2024-04-18T21:07:25.584 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.584 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.584 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:25.584 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882614+0000", 2024-04-18T21:07:25.585 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.4300000000000002e-06 2024-04-18T21:07:25.585 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.585 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.585 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:25.585 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882623+0000", 2024-04-18T21:07:25.585 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8740000000000001e-06 2024-04-18T21:07:25.585 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.585 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.585 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:25.585 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882629+0000", 2024-04-18T21:07:25.585 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.4330000000000001e-06 2024-04-18T21:07:25.585 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.585 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.585 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:25.585 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882706+0000", 2024-04-18T21:07:25.586 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.6280999999999997e-05 2024-04-18T21:07:25.586 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.586 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.586 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op must wait for map", 2024-04-18T21:07:25.586 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882715+0000", 2024-04-18T21:07:25.586 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.1679999999999993e-06 2024-04-18T21:07:25.586 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.586 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.586 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:25.586 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.889481+0000", 2024-04-18T21:07:25.586 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0067656979999999997 2024-04-18T21:07:25.586 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.586 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.586 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:25.587 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.889493+0000", 2024-04-18T21:07:25.587 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2451e-05 2024-04-18T21:07:25.587 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.587 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.587 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:25.587 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.940942+0000", 2024-04-18T21:07:25.587 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0514491720000001 2024-04-18T21:07:25.587 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.587 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.587 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for missing object", 2024-04-18T21:07:25.587 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.941134+0000", 2024-04-18T21:07:25.587 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019150600000000001 2024-04-18T21:07:25.587 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.587 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.588 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:25.588 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.967914+0000", 2024-04-18T21:07:25.588 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026780202999999999 2024-04-18T21:07:25.588 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.588 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.588 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:25.588 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.967990+0000", 2024-04-18T21:07:25.588 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.6322000000000006e-05 2024-04-18T21:07:25.588 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:25.588 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:25.588 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:25.588 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.588 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.588 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7630 4.d 4:b022c802:::10000001d6e.00000000:head [delete] snapc 1=[] RETRY=2 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:25.589 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882645+0000", 2024-04-18T21:07:25.589 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 13.623836314, 2024-04-18T21:07:25.589 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0858072780000001, 2024-04-18T21:07:25.589 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:25.589 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:25.589 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "reached pg", 2024-04-18T21:07:25.589 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:25.589 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.589 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:25.589 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882645+0000", 2024-04-18T21:07:25.589 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:25.589 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.589 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.589 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:25.590 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882645+0000", 2024-04-18T21:07:25.590 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:25.590 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.590 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.590 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:25.590 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882646+0000", 2024-04-18T21:07:25.590 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.3599999999999999e-07 2024-04-18T21:07:25.590 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.590 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.590 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:25.590 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882648+0000", 2024-04-18T21:07:25.590 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.5809999999999999e-06 2024-04-18T21:07:25.590 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.590 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.591 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:25.591 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882655+0000", 2024-04-18T21:07:25.591 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7909999999999999e-06 2024-04-18T21:07:25.591 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.591 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.591 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:25.591 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882661+0000", 2024-04-18T21:07:25.591 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3920000000000002e-06 2024-04-18T21:07:25.591 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.591 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.591 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:25.591 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882825+0000", 2024-04-18T21:07:25.591 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016480100000000001 2024-04-18T21:07:25.591 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.592 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.592 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:07:25.592 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882840+0000", 2024-04-18T21:07:25.592 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4656e-05 2024-04-18T21:07:25.592 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.592 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.592 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:25.592 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.892020+0000", 2024-04-18T21:07:25.592 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0091804680000000007 2024-04-18T21:07:25.592 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.592 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.592 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:25.592 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.892026+0000", 2024-04-18T21:07:25.592 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4580000000000001e-06 2024-04-18T21:07:25.593 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.593 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.593 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:25.593 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.959913+0000", 2024-04-18T21:07:25.593 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.067887289 2024-04-18T21:07:25.593 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.593 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.593 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for missing object", 2024-04-18T21:07:25.593 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.960034+0000", 2024-04-18T21:07:25.593 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000120445 2024-04-18T21:07:25.593 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.593 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.593 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:25.593 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.968407+0000", 2024-04-18T21:07:25.593 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0083734010000000008 2024-04-18T21:07:25.594 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.594 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.594 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:25.594 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.968453+0000", 2024-04-18T21:07:25.594 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.5559999999999997e-05 2024-04-18T21:07:25.594 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:25.594 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:25.594 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:25.594 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.594 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.594 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7651 4.13 4:c9951bc5:::10000001e1b.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:25.594 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882696+0000", 2024-04-18T21:07:25.594 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 13.623785901, 2024-04-18T21:07:25.594 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.088382095, 2024-04-18T21:07:25.595 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:25.595 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:25.595 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:25.595 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:25.595 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.595 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:25.595 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882696+0000", 2024-04-18T21:07:25.595 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:25.595 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.595 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.595 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:25.595 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882696+0000", 2024-04-18T21:07:25.595 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:25.595 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.596 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.596 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:25.596 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882696+0000", 2024-04-18T21:07:25.596 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.06e-07 2024-04-18T21:07:25.596 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.596 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.596 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:25.596 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882699+0000", 2024-04-18T21:07:25.596 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.1039999999999998e-06 2024-04-18T21:07:25.596 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.596 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.596 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:25.596 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882707+0000", 2024-04-18T21:07:25.597 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.593e-06 2024-04-18T21:07:25.597 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.597 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.597 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:25.597 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882712+0000", 2024-04-18T21:07:25.597 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.541e-06 2024-04-18T21:07:25.597 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.597 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.597 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:25.597 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882870+0000", 2024-04-18T21:07:25.597 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000157999 2024-04-18T21:07:25.597 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.597 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.598 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op must wait for map", 2024-04-18T21:07:25.598 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882885+0000", 2024-04-18T21:07:25.598 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4989e-05 2024-04-18T21:07:25.598 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.598 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.598 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:25.598 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.891447+0000", 2024-04-18T21:07:25.598 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0085618540000000007 2024-04-18T21:07:25.598 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.598 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.598 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:25.598 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.891457+0000", 2024-04-18T21:07:25.599 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.6399999999999992e-06 2024-04-18T21:07:25.599 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.599 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.599 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:25.599 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.964840+0000", 2024-04-18T21:07:25.599 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.073383279 2024-04-18T21:07:25.599 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.599 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.599 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:25.599 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.965078+0000", 2024-04-18T21:07:25.599 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000237581 2024-04-18T21:07:25.599 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.599 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.599 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:25.599 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.965299+0000", 2024-04-18T21:07:25.600 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00022087699999999999 2024-04-18T21:07:25.600 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.600 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.600 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:25.600 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.969505+0000", 2024-04-18T21:07:25.600 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.004206123 2024-04-18T21:07:25.600 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.600 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.600 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:25.600 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.970898+0000", 2024-04-18T21:07:25.600 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001393434 2024-04-18T21:07:25.600 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.600 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.600 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:25.601 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.970936+0000", 2024-04-18T21:07:25.601 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.7647000000000001e-05 2024-04-18T21:07:25.601 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.601 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.601 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:25.601 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.971078+0000", 2024-04-18T21:07:25.601 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014192799999999999 2024-04-18T21:07:25.601 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:25.601 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:25.601 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:25.601 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.601 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.601 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7671 4.31 4:8c95a1b7:::10000001e2f.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:25.601 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882728+0000", 2024-04-18T21:07:25.602 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 13.623754066, 2024-04-18T21:07:25.602 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.084467606, 2024-04-18T21:07:25.602 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:25.602 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:25.602 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:25.602 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:25.602 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.602 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:25.602 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882728+0000", 2024-04-18T21:07:25.602 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:25.602 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.602 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.602 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:25.603 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882728+0000", 2024-04-18T21:07:25.603 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:25.603 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.603 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.603 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:25.603 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882728+0000", 2024-04-18T21:07:25.603 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.0399999999999996e-07 2024-04-18T21:07:25.603 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.603 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.603 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:25.603 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882731+0000", 2024-04-18T21:07:25.603 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.5239999999999999e-06 2024-04-18T21:07:25.603 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.603 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.604 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:25.604 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882739+0000", 2024-04-18T21:07:25.604 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4020000000000002e-06 2024-04-18T21:07:25.604 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.604 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.604 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:25.604 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882744+0000", 2024-04-18T21:07:25.604 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.1410000000000004e-06 2024-04-18T21:07:25.604 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.604 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.604 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:25.604 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882836+0000", 2024-04-18T21:07:25.604 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.2094000000000003e-05 2024-04-18T21:07:25.604 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.605 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.605 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:07:25.605 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882849+0000", 2024-04-18T21:07:25.605 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3087e-05 2024-04-18T21:07:25.605 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.605 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.605 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:25.605 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.889522+0000", 2024-04-18T21:07:25.605 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0066730950000000004 2024-04-18T21:07:25.605 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.605 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.605 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:25.605 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.889530+0000", 2024-04-18T21:07:25.605 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8699999999999992e-06 2024-04-18T21:07:25.606 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.606 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.606 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:25.606 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.941173+0000", 2024-04-18T21:07:25.606 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.051642658 2024-04-18T21:07:25.606 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.606 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.606 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:25.606 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.941392+0000", 2024-04-18T21:07:25.606 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00021854099999999999 2024-04-18T21:07:25.606 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.606 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.606 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:25.607 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.941618+0000", 2024-04-18T21:07:25.607 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0002265 2024-04-18T21:07:25.607 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.607 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.607 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:25.607 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.945390+0000", 2024-04-18T21:07:25.607 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0037723460000000002 2024-04-18T21:07:25.607 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.607 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.607 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:25.607 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.966905+0000", 2024-04-18T21:07:25.607 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021514559999999999 2024-04-18T21:07:25.607 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.607 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.608 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:25.608 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.966972+0000", 2024-04-18T21:07:25.608 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.6740000000000001e-05 2024-04-18T21:07:25.608 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.608 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.608 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:25.608 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.967195+0000", 2024-04-18T21:07:25.608 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000223544 2024-04-18T21:07:25.608 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:25.608 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:25.608 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:25.608 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.608 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.609 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7691 4.d 4:b0345396:::10000001e43.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:25.609 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882753+0000", 2024-04-18T21:07:25.609 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 13.623729086999999, 2024-04-18T21:07:25.609 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.085135618, 2024-04-18T21:07:25.609 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:25.609 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:25.609 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:25.609 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:25.609 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.609 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:25.609 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882753+0000", 2024-04-18T21:07:25.609 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:25.609 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.609 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.610 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:25.610 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882753+0000", 2024-04-18T21:07:25.610 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:25.610 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.610 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.610 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:25.610 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882753+0000", 2024-04-18T21:07:25.610 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.9000000000000002e-07 2024-04-18T21:07:25.610 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.610 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.610 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:25.610 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882755+0000", 2024-04-18T21:07:25.610 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.4040000000000002e-06 2024-04-18T21:07:25.611 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.611 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.611 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:25.611 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882762+0000", 2024-04-18T21:07:25.611 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.6229999999999999e-06 2024-04-18T21:07:25.611 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.611 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.611 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:25.611 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882769+0000", 2024-04-18T21:07:25.611 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.1559999999999998e-06 2024-04-18T21:07:25.611 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.611 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.611 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:25.611 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882875+0000", 2024-04-18T21:07:25.612 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000105491 2024-04-18T21:07:25.612 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.612 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.612 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:07:25.612 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882879+0000", 2024-04-18T21:07:25.612 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.9999999999999998e-06 2024-04-18T21:07:25.612 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.612 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.612 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:25.612 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.892072+0000", 2024-04-18T21:07:25.612 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0091930989999999997 2024-04-18T21:07:25.612 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.612 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.613 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:25.613 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.892083+0000", 2024-04-18T21:07:25.613 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1070000000000001e-05 2024-04-18T21:07:25.613 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.613 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.613 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:25.613 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.960162+0000", 2024-04-18T21:07:25.613 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0680791869999999 2024-04-18T21:07:25.613 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.613 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.613 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:25.613 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.960314+0000", 2024-04-18T21:07:25.613 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000152139 2024-04-18T21:07:25.614 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.614 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.614 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:25.614 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.960469+0000", 2024-04-18T21:07:25.614 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000154444 2024-04-18T21:07:25.614 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.614 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.614 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:25.614 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.964018+0000", 2024-04-18T21:07:25.614 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035494179999999999 2024-04-18T21:07:25.614 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.614 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.614 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:25.615 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.967680+0000", 2024-04-18T21:07:25.615 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.003662046 2024-04-18T21:07:25.615 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.615 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.615 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:25.615 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.967738+0000", 2024-04-18T21:07:25.615 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.7946999999999999e-05 2024-04-18T21:07:25.615 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.615 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.615 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:25.615 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.967888+0000", 2024-04-18T21:07:25.615 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000150204 2024-04-18T21:07:25.616 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:25.616 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:25.616 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:25.616 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.616 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.616 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:17090 4.39 4:9d5d3d9b:::100000020cf.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e69)", 2024-04-18T21:07:25.616 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:20.889261+0000", 2024-04-18T21:07:25.616 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 4.617221099, 2024-04-18T21:07:25.616 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043495370999999998, 2024-04-18T21:07:25.616 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:25.616 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:25.616 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:25.616 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:25.617 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.617 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:25.617 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889261+0000", 2024-04-18T21:07:25.617 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:25.617 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.617 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.617 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:25.617 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889261+0000", 2024-04-18T21:07:25.617 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:25.617 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.617 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.617 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:25.617 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889261+0000", 2024-04-18T21:07:25.618 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.0500000000000003e-07 2024-04-18T21:07:25.618 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.618 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.618 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:25.618 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889264+0000", 2024-04-18T21:07:25.618 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.0570000000000001e-06 2024-04-18T21:07:25.618 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.618 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.618 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:25.618 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889273+0000", 2024-04-18T21:07:25.618 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.6500000000000002e-06 2024-04-18T21:07:25.618 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.618 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.618 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:25.619 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889279+0000", 2024-04-18T21:07:25.619 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.5629999999999997e-06 2024-04-18T21:07:25.619 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.619 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.619 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:25.619 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889329+0000", 2024-04-18T21:07:25.619 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.9929000000000003e-05 2024-04-18T21:07:25.619 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.619 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.619 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:25.619 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889448+0000", 2024-04-18T21:07:25.619 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00011830800000000001 2024-04-18T21:07:25.619 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.619 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.619 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:25.620 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889557+0000", 2024-04-18T21:07:25.620 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000108923 2024-04-18T21:07:25.620 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.620 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.620 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:25.620 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.890930+0000", 2024-04-18T21:07:25.620 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001372938 2024-04-18T21:07:25.620 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.620 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.620 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:25.620 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.932626+0000", 2024-04-18T21:07:25.620 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.041696735999999998 2024-04-18T21:07:25.620 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.620 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.620 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:25.621 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.932692+0000", 2024-04-18T21:07:25.621 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.6177e-05 2024-04-18T21:07:25.621 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.621 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.621 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:25.621 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.932756+0000", 2024-04-18T21:07:25.621 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.3485000000000006e-05 2024-04-18T21:07:25.621 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:25.621 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:25.621 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:25.621 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.621 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.621 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:17096 4.3c 4:3d6bd5a0:::100000020d5.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e69)", 2024-04-18T21:07:25.622 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:20.889704+0000", 2024-04-18T21:07:25.622 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 4.6167781430000003, 2024-04-18T21:07:25.622 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043604966000000002, 2024-04-18T21:07:25.622 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:25.622 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:25.622 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:25.622 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:25.622 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.622 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:25.622 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889704+0000", 2024-04-18T21:07:25.622 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:25.622 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.622 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.623 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:25.623 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889704+0000", 2024-04-18T21:07:25.623 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:25.623 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.623 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.623 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:25.623 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889704+0000", 2024-04-18T21:07:25.623 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.0699999999999996e-07 2024-04-18T21:07:25.623 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.623 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.623 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:25.623 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889708+0000", 2024-04-18T21:07:25.623 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.1509999999999997e-06 2024-04-18T21:07:25.624 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.624 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.624 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:25.624 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889718+0000", 2024-04-18T21:07:25.624 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0929999999999992e-06 2024-04-18T21:07:25.624 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.624 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.624 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:25.624 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889724+0000", 2024-04-18T21:07:25.624 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.883e-06 2024-04-18T21:07:25.624 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.624 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.624 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:25.624 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889783+0000", 2024-04-18T21:07:25.625 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.8217000000000002e-05 2024-04-18T21:07:25.625 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.625 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.625 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:25.625 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889877+0000", 2024-04-18T21:07:25.625 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.4494999999999996e-05 2024-04-18T21:07:25.625 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.625 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.625 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:25.625 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.889947+0000", 2024-04-18T21:07:25.625 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.9702000000000005e-05 2024-04-18T21:07:25.625 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.625 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.625 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:25.626 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.890981+0000", 2024-04-18T21:07:25.626 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0010340659999999999 2024-04-18T21:07:25.626 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.626 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.626 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:25.626 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.933196+0000", 2024-04-18T21:07:25.626 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.042215036999999997 2024-04-18T21:07:25.626 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.626 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.626 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:25.626 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.933252+0000", 2024-04-18T21:07:25.626 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.6029999999999997e-05 2024-04-18T21:07:25.626 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:25.626 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:25.627 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:25.627 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:20.933308+0000", 2024-04-18T21:07:25.627 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.6484999999999999e-05 2024-04-18T21:07:25.627 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:25.627 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:25.627 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:25.627 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:25.627 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:25.627 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:07:25.629 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:07:25.629 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:25.629+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:25.641 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2024-04-18T21:07:25.658 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-18T21:07:25.729 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:25.729+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:25.759 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:07:25.759 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:07:25.759 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-04-18T21:07:25.759 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:07:25.774 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:07:25.830 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:25.833+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:25.895 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:07:25.895 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:07:25.895 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-18T21:07:25.895 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-18T21:07:25.895 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:07:25.909 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:25.931 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:25.933+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:25.937 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2024-04-18T21:07:25.956 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi078.front.sepia.ceph.com... 2024-04-18T21:07:25.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T21:07:25.956 DEBUG:teuthology.orchestra.run.smithi078:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-18T21:07:25.979 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T21:07:25.980 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi078.stderr:ceph-fuse[22801]: fuse finished with error 0 and tester_r 0 2024-04-18T21:07:26.035 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:26.033+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:26.063 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:07:26.063 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-18T21:07:26.063 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-18T21:07:26.063 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:07:26.063 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.063 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:108 3.1f 3:f83d65d8:::200.00000004:head [write 326287~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:26.063 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:07:26.063 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 40.305082294999998, 2024-04-18T21:07:26.063 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056616183, 2024-04-18T21:07:26.063 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:26.063 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:26.063 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:26.063 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:26.064 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.064 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:26.064 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:07:26.064 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:26.064 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.064 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.064 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:26.064 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758083+0000", 2024-04-18T21:07:26.064 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:26.064 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.064 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.064 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:26.064 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758084+0000", 2024-04-18T21:07:26.064 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.124e-06 2024-04-18T21:07:26.065 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.065 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.065 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:26.065 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758100+0000", 2024-04-18T21:07:26.065 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6246e-05 2024-04-18T21:07:26.065 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.065 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.065 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:26.065 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758118+0000", 2024-04-18T21:07:26.065 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8267e-05 2024-04-18T21:07:26.065 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.065 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.065 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:26.066 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758134+0000", 2024-04-18T21:07:26.066 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5950000000000001e-05 2024-04-18T21:07:26.066 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.066 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.066 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:26.066 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.803949+0000", 2024-04-18T21:07:26.066 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.045815349999999998 2024-04-18T21:07:26.066 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.066 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.066 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:26.066 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804011+0000", 2024-04-18T21:07:26.066 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1044999999999996e-05 2024-04-18T21:07:26.066 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.067 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.067 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:26.067 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804128+0000", 2024-04-18T21:07:26.067 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117148 2024-04-18T21:07:26.067 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.067 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.067 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:26.067 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806794+0000", 2024-04-18T21:07:26.067 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002666692 2024-04-18T21:07:26.067 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.067 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.067 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:26.067 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814645+0000", 2024-04-18T21:07:26.067 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0078508880000000003 2024-04-18T21:07:26.068 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.068 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.068 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:26.068 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814678+0000", 2024-04-18T21:07:26.068 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3188999999999997e-05 2024-04-18T21:07:26.068 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.068 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.068 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:26.068 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814699+0000", 2024-04-18T21:07:26.068 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0284000000000001e-05 2024-04-18T21:07:26.068 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:26.068 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:26.068 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:26.068 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.068 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.068 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:109 3.1f 3:f83d65d8:::200.00000004:head [write 327693~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:26.069 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:07:26.069 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 40.305012927999996, 2024-04-18T21:07:26.069 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056621036999999999, 2024-04-18T21:07:26.069 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:26.069 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:26.069 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:26.069 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:26.069 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.069 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:26.069 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:07:26.069 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:26.069 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.069 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.070 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:26.070 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758152+0000", 2024-04-18T21:07:26.070 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:26.070 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.070 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.070 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:26.070 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758153+0000", 2024-04-18T21:07:26.070 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1459999999999999e-06 2024-04-18T21:07:26.070 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.070 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.070 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:26.070 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758161+0000", 2024-04-18T21:07:26.070 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7999999999999999e-06 2024-04-18T21:07:26.070 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.071 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.071 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:26.071 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758179+0000", 2024-04-18T21:07:26.071 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7949999999999999e-05 2024-04-18T21:07:26.071 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.071 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.071 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:26.071 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758193+0000", 2024-04-18T21:07:26.071 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3773e-05 2024-04-18T21:07:26.071 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.071 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.071 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:26.071 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804632+0000", 2024-04-18T21:07:26.071 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.046439469999999997 2024-04-18T21:07:26.072 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.072 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.072 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:26.072 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.804790+0000", 2024-04-18T21:07:26.072 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015784300000000001 2024-04-18T21:07:26.072 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.072 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.072 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:26.072 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805056+0000", 2024-04-18T21:07:26.072 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026652400000000003 2024-04-18T21:07:26.072 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.072 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.072 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:26.072 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.808959+0000", 2024-04-18T21:07:26.072 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003903077 2024-04-18T21:07:26.073 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.073 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.073 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:26.073 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814728+0000", 2024-04-18T21:07:26.073 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0057682489999999996 2024-04-18T21:07:26.073 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.073 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.073 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:26.073 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814754+0000", 2024-04-18T21:07:26.073 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6673999999999999e-05 2024-04-18T21:07:26.073 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.073 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.073 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:26.073 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814773+0000", 2024-04-18T21:07:26.073 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8530999999999999e-05 2024-04-18T21:07:26.073 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:26.074 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:26.074 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:26.074 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.074 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.074 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:110 3.1f 3:f83d65d8:::200.00000004:head [write 329098~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:26.074 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:07:26.074 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 40.304954518999999, 2024-04-18T21:07:26.074 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056669113, 2024-04-18T21:07:26.074 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:26.074 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:26.074 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:26.074 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:26.074 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.074 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:26.075 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:07:26.075 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:26.075 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.075 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.075 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:26.075 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758210+0000", 2024-04-18T21:07:26.075 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:26.075 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.075 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.075 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:26.075 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758212+0000", 2024-04-18T21:07:26.075 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.243e-06 2024-04-18T21:07:26.076 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.076 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.076 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:26.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758219+0000", 2024-04-18T21:07:26.076 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4229999999999999e-06 2024-04-18T21:07:26.076 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.076 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.076 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:26.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758237+0000", 2024-04-18T21:07:26.076 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7966999999999999e-05 2024-04-18T21:07:26.076 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.076 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.076 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:26.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758252+0000", 2024-04-18T21:07:26.077 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5322999999999999e-05 2024-04-18T21:07:26.077 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.077 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.077 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:26.077 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805536+0000", 2024-04-18T21:07:26.077 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.047283861000000003 2024-04-18T21:07:26.077 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.077 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.077 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:26.077 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805579+0000", 2024-04-18T21:07:26.077 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2738999999999999e-05 2024-04-18T21:07:26.077 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.077 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.077 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:26.078 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.805649+0000", 2024-04-18T21:07:26.078 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0213e-05 2024-04-18T21:07:26.078 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.078 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.078 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:26.078 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.808966+0000", 2024-04-18T21:07:26.078 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033166129999999999 2024-04-18T21:07:26.078 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.078 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.078 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:26.078 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814812+0000", 2024-04-18T21:07:26.078 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0058463589999999998 2024-04-18T21:07:26.078 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.078 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.079 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:26.079 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814854+0000", 2024-04-18T21:07:26.079 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1618e-05 2024-04-18T21:07:26.079 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.079 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.079 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:26.079 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.814879+0000", 2024-04-18T21:07:26.079 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5754000000000001e-05 2024-04-18T21:07:26.079 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:26.079 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:26.079 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:26.079 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.079 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.079 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:111 3.1f 3:f83d65d8:::200.00000004:head [write 330499~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-18T21:07:26.080 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:07:26.080 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 40.304893542999999, 2024-04-18T21:07:26.080 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058693793000000001, 2024-04-18T21:07:26.080 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:26.080 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:26.080 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:26.080 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:26.080 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.080 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:26.080 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:07:26.080 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:26.080 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.080 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.080 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:26.080 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758271+0000", 2024-04-18T21:07:26.081 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:26.081 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.081 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.081 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:26.081 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758272+0000", 2024-04-18T21:07:26.081 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1200000000000001e-06 2024-04-18T21:07:26.081 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.081 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.081 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:26.081 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758287+0000", 2024-04-18T21:07:26.081 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5017e-05 2024-04-18T21:07:26.081 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.081 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.081 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:26.081 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758309+0000", 2024-04-18T21:07:26.082 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1866e-05 2024-04-18T21:07:26.082 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.082 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.082 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:26.082 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.758323+0000", 2024-04-18T21:07:26.082 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3606e-05 2024-04-18T21:07:26.082 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.082 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.082 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:26.082 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806279+0000", 2024-04-18T21:07:26.082 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.047956061000000001 2024-04-18T21:07:26.082 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.082 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.083 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:26.083 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806350+0000", 2024-04-18T21:07:26.083 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1070999999999998e-05 2024-04-18T21:07:26.083 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.083 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.083 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:26.083 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.806459+0000", 2024-04-18T21:07:26.083 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000108606 2024-04-18T21:07:26.083 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.083 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.083 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:26.083 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.809774+0000", 2024-04-18T21:07:26.083 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003314881 2024-04-18T21:07:26.084 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.084 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.084 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:26.084 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816910+0000", 2024-04-18T21:07:26.084 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0071367760000000001 2024-04-18T21:07:26.084 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.084 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.084 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:26.084 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816941+0000", 2024-04-18T21:07:26.084 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0846000000000002e-05 2024-04-18T21:07:26.084 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.084 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.084 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:26.084 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:06:45.816965+0000", 2024-04-18T21:07:26.085 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3943000000000001e-05 2024-04-18T21:07:26.085 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:26.085 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:26.085 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:26.085 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.085 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.085 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:12689 4.26 4:64a7f444:::100000033e5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:26.085 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:00.208067+0000", 2024-04-18T21:07:26.085 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.855098127000002, 2024-04-18T21:07:26.085 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066681457, 2024-04-18T21:07:26.085 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:26.085 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:26.085 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:26.085 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:07:26.086 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:07:26.086 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:26.086 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 12689 2024-04-18T21:07:26.086 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.086 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:26.086 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.086 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:26.086 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.208067+0000", 2024-04-18T21:07:26.086 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:26.086 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.086 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.086 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:26.086 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.208067+0000", 2024-04-18T21:07:26.086 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:26.086 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.087 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:26.087 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.208069+0000", 2024-04-18T21:07:26.087 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1500000000000002e-06 2024-04-18T21:07:26.087 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.087 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:26.087 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216162+0000", 2024-04-18T21:07:26.087 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0080933159999999997 2024-04-18T21:07:26.087 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.087 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:26.087 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216181+0000", 2024-04-18T21:07:26.087 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8573e-05 2024-04-18T21:07:26.087 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.088 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:26.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216192+0000", 2024-04-18T21:07:26.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0767999999999999e-05 2024-04-18T21:07:26.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.088 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:26.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216259+0000", 2024-04-18T21:07:26.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7977000000000003e-05 2024-04-18T21:07:26.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.088 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:26.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216635+0000", 2024-04-18T21:07:26.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00037591300000000002 2024-04-18T21:07:26.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.089 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:26.089 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216929+0000", 2024-04-18T21:07:26.089 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00029314800000000002 2024-04-18T21:07:26.089 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.089 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.089 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:26.089 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.232918+0000", 2024-04-18T21:07:26.089 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015989903 2024-04-18T21:07:26.089 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.089 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.089 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:26.089 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.274643+0000", 2024-04-18T21:07:26.089 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.041724281000000002 2024-04-18T21:07:26.089 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.089 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.090 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:26.090 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.274701+0000", 2024-04-18T21:07:26.090 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8304999999999998e-05 2024-04-18T21:07:26.090 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.090 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.090 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:26.090 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.274748+0000", 2024-04-18T21:07:26.090 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7123000000000003e-05 2024-04-18T21:07:26.090 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:26.090 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:26.090 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:26.090 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.090 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.090 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:7694 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-18T21:07:26.090 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:11.672522+0000", 2024-04-18T21:07:26.091 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 14.390643087000001, 2024-04-18T21:07:26.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2954970370000001, 2024-04-18T21:07:26.091 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:26.091 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:26.091 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:26.091 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:26.091 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.091 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:26.091 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672522+0000", 2024-04-18T21:07:26.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:26.091 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.091 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.091 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:26.091 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672522+0000", 2024-04-18T21:07:26.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:26.091 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.092 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.092 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:26.092 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672525+0000", 2024-04-18T21:07:26.092 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.366e-06 2024-04-18T21:07:26.092 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.092 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.092 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:26.092 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672540+0000", 2024-04-18T21:07:26.092 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4949999999999999e-05 2024-04-18T21:07:26.092 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.092 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.092 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:26.092 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672569+0000", 2024-04-18T21:07:26.092 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8714999999999999e-05 2024-04-18T21:07:26.092 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.092 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.093 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:26.093 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672581+0000", 2024-04-18T21:07:26.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1949e-05 2024-04-18T21:07:26.093 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.093 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:26.093 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672704+0000", 2024-04-18T21:07:26.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000122915 2024-04-18T21:07:26.093 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.093 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:26.093 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672714+0000", 2024-04-18T21:07:26.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0698e-05 2024-04-18T21:07:26.093 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.094 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:26.094 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.910993+0000", 2024-04-18T21:07:26.094 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.23827911199999999 2024-04-18T21:07:26.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.094 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:26.094 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.911017+0000", 2024-04-18T21:07:26.094 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3419999999999999e-05 2024-04-18T21:07:26.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.094 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:26.094 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.952146+0000", 2024-04-18T21:07:26.094 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0411288869999999 2024-04-18T21:07:26.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.094 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:26.095 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.952467+0000", 2024-04-18T21:07:26.095 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00032165399999999999 2024-04-18T21:07:26.095 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.095 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.095 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:26.095 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.954086+0000", 2024-04-18T21:07:26.095 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0016184820000000001 2024-04-18T21:07:26.095 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.095 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.095 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:26.095 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.960573+0000", 2024-04-18T21:07:26.095 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064874240000000003 2024-04-18T21:07:26.095 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.095 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.095 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:26.095 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.967786+0000", 2024-04-18T21:07:26.096 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0072125069999999999 2024-04-18T21:07:26.096 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.096 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.096 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:26.096 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.967897+0000", 2024-04-18T21:07:26.096 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111679 2024-04-18T21:07:26.096 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.096 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.096 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:26.096 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.968019+0000", 2024-04-18T21:07:26.096 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000121279 2024-04-18T21:07:26.096 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:26.096 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:26.096 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:26.096 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.096 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.097 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:7696 3.f 3:f376ae95:::200.00000016:head [write 3681546~512758 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:26.097 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:12.760706+0000", 2024-04-18T21:07:26.097 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.302458685, 2024-04-18T21:07:26.097 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.24998282899999999, 2024-04-18T21:07:26.097 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:26.097 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:26.097 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:26.097 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:26.097 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.097 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:26.097 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.760706+0000", 2024-04-18T21:07:26.097 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:26.098 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.098 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.098 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:26.098 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.760706+0000", 2024-04-18T21:07:26.098 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:26.098 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.098 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.098 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:26.098 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.760710+0000", 2024-04-18T21:07:26.098 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2100000000000003e-06 2024-04-18T21:07:26.098 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.098 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.098 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:26.098 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.761972+0000", 2024-04-18T21:07:26.098 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0012615689999999999 2024-04-18T21:07:26.098 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.099 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.099 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:26.099 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762012+0000", 2024-04-18T21:07:26.099 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0145999999999998e-05 2024-04-18T21:07:26.099 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.099 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.099 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:26.099 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762030+0000", 2024-04-18T21:07:26.099 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8312999999999999e-05 2024-04-18T21:07:26.099 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.099 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.099 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:26.099 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762158+0000", 2024-04-18T21:07:26.099 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012805600000000001 2024-04-18T21:07:26.100 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.100 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.100 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:26.100 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762174+0000", 2024-04-18T21:07:26.100 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5645999999999999e-05 2024-04-18T21:07:26.100 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.100 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.100 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:26.100 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.926080+0000", 2024-04-18T21:07:26.100 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.16390581900000001 2024-04-18T21:07:26.100 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.100 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.100 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for missing object", 2024-04-18T21:07:26.100 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.926149+0000", 2024-04-18T21:07:26.101 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9172999999999997e-05 2024-04-18T21:07:26.101 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.101 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.101 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:26.101 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.002156+0000", 2024-04-18T21:07:26.101 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.076006972000000006 2024-04-18T21:07:26.101 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.101 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.101 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for rw locks", 2024-04-18T21:07:26.101 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.002294+0000", 2024-04-18T21:07:26.101 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000138011 2024-04-18T21:07:26.101 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.101 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.101 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:26.102 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.005436+0000", 2024-04-18T21:07:26.102 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031422749999999999 2024-04-18T21:07:26.102 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.102 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.102 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:26.102 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.005577+0000", 2024-04-18T21:07:26.102 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014105399999999999 2024-04-18T21:07:26.102 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.102 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.102 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:26.102 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.005725+0000", 2024-04-18T21:07:26.102 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014721100000000001 2024-04-18T21:07:26.103 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.103 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.103 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:26.103 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.009143+0000", 2024-04-18T21:07:26.103 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0034179380000000001 2024-04-18T21:07:26.103 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.103 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.103 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:26.103 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.010522+0000", 2024-04-18T21:07:26.103 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0013790919999999999 2024-04-18T21:07:26.103 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.103 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.103 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:26.104 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.010586+0000", 2024-04-18T21:07:26.104 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4713000000000002e-05 2024-04-18T21:07:26.104 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.104 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.104 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:26.104 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.010689+0000", 2024-04-18T21:07:26.104 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000102631 2024-04-18T21:07:26.104 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:26.104 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:26.104 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:26.104 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.104 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.104 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:7697 3.16 3:6b6b4f13:::200.0000001c:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:26.104 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:12.762074+0000", 2024-04-18T21:07:26.105 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.301090537, 2024-04-18T21:07:26.105 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.2056489, 2024-04-18T21:07:26.105 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:26.105 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:26.105 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:07:26.105 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:26.105 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.105 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:26.105 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762074+0000", 2024-04-18T21:07:26.105 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:26.105 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.105 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.105 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:26.105 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762074+0000", 2024-04-18T21:07:26.105 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:26.105 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.106 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.106 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:26.106 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762076+0000", 2024-04-18T21:07:26.106 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.793e-06 2024-04-18T21:07:26.106 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.106 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.106 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:26.106 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762083+0000", 2024-04-18T21:07:26.106 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7129999999999999e-06 2024-04-18T21:07:26.106 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.106 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.106 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:26.106 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762104+0000", 2024-04-18T21:07:26.106 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1480000000000001e-05 2024-04-18T21:07:26.106 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.107 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.107 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:26.107 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762121+0000", 2024-04-18T21:07:26.107 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.632e-05 2024-04-18T21:07:26.107 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.107 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.107 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:26.107 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762224+0000", 2024-04-18T21:07:26.107 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010346800000000001 2024-04-18T21:07:26.107 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.107 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.107 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:26.107 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762238+0000", 2024-04-18T21:07:26.107 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3482999999999999e-05 2024-04-18T21:07:26.107 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.108 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.108 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:26.108 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.946932+0000", 2024-04-18T21:07:26.108 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.18469451000000001 2024-04-18T21:07:26.108 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.108 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.108 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:26.108 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.947261+0000", 2024-04-18T21:07:26.108 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00032857399999999999 2024-04-18T21:07:26.108 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.108 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.108 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:26.108 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.967723+0000", 2024-04-18T21:07:26.108 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020462559000000002 2024-04-18T21:07:26.108 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:26.108 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:26.109 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:26.109 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.109 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.109 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:10831 4.13 4:c948684f:::1000000032e.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:26.109 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.823266+0000", 2024-04-18T21:07:26.109 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 10.239899147999999, 2024-04-18T21:07:26.109 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.65275881599999996, 2024-04-18T21:07:26.109 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:26.109 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:26.109 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:26.109 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:26.109 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.109 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:26.109 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823266+0000", 2024-04-18T21:07:26.109 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:26.110 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.110 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.110 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:26.110 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823266+0000", 2024-04-18T21:07:26.110 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:26.110 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.110 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.110 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:26.110 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823266+0000", 2024-04-18T21:07:26.110 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9800000000000004e-07 2024-04-18T21:07:26.110 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.110 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.110 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:26.110 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823269+0000", 2024-04-18T21:07:26.111 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3259999999999998e-06 2024-04-18T21:07:26.111 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.111 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.111 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:26.111 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823274+0000", 2024-04-18T21:07:26.111 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9830000000000001e-06 2024-04-18T21:07:26.111 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.111 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.111 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:26.111 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823280+0000", 2024-04-18T21:07:26.111 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1540000000000001e-06 2024-04-18T21:07:26.111 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.111 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.111 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:26.111 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823313+0000", 2024-04-18T21:07:26.112 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3667000000000001e-05 2024-04-18T21:07:26.112 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.112 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.112 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:26.112 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823321+0000", 2024-04-18T21:07:26.112 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1200000000000002e-06 2024-04-18T21:07:26.112 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.112 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.112 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:26.112 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.470069+0000", 2024-04-18T21:07:26.112 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.64674728999999997 2024-04-18T21:07:26.112 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.112 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.112 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:26.112 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.470457+0000", 2024-04-18T21:07:26.113 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00038800899999999998 2024-04-18T21:07:26.113 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.113 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.113 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:26.113 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.470755+0000", 2024-04-18T21:07:26.113 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00029781399999999998 2024-04-18T21:07:26.113 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.113 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.113 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:26.113 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.474041+0000", 2024-04-18T21:07:26.113 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032860670000000002 2024-04-18T21:07:26.113 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.113 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.113 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:26.114 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.475621+0000", 2024-04-18T21:07:26.114 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001579925 2024-04-18T21:07:26.114 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.114 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.114 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:26.114 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.475750+0000", 2024-04-18T21:07:26.114 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000129002 2024-04-18T21:07:26.114 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.114 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.114 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:26.114 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.476024+0000", 2024-04-18T21:07:26.114 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000274961 2024-04-18T21:07:26.114 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:26.114 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:26.115 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:26.115 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.115 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.115 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11326 4.13 4:cbbbc9f0:::100000010c6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:26.115 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.917113+0000", 2024-04-18T21:07:26.115 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 10.146051946, 2024-04-18T21:07:26.115 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.56159817899999998, 2024-04-18T21:07:26.115 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:26.115 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:26.115 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:26.115 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:26.115 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.115 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:26.115 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917113+0000", 2024-04-18T21:07:26.115 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:26.116 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.116 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.116 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:26.116 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917113+0000", 2024-04-18T21:07:26.116 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:26.116 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.116 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.116 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:26.116 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917114+0000", 2024-04-18T21:07:26.116 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5099999999999999e-07 2024-04-18T21:07:26.116 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.116 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.116 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:26.116 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917123+0000", 2024-04-18T21:07:26.116 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5859999999999994e-06 2024-04-18T21:07:26.116 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.117 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.117 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:26.117 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917130+0000", 2024-04-18T21:07:26.117 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9800000000000001e-06 2024-04-18T21:07:26.117 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.117 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.117 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:26.117 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917136+0000", 2024-04-18T21:07:26.117 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.502e-06 2024-04-18T21:07:26.117 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.117 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.117 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:26.117 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917239+0000", 2024-04-18T21:07:26.117 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000103286 2024-04-18T21:07:26.118 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.118 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.118 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:26.118 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917247+0000", 2024-04-18T21:07:26.118 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.49e-06 2024-04-18T21:07:26.118 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.118 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.118 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:26.118 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.472462+0000", 2024-04-18T21:07:26.118 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.55521418899999997 2024-04-18T21:07:26.118 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.118 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.118 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:26.118 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.472801+0000", 2024-04-18T21:07:26.119 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00033935600000000002 2024-04-18T21:07:26.119 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.119 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.119 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:26.119 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.473101+0000", 2024-04-18T21:07:26.119 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030031399999999998 2024-04-18T21:07:26.119 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.119 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.119 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:26.119 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.475574+0000", 2024-04-18T21:07:26.119 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0024732310000000002 2024-04-18T21:07:26.119 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.119 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.119 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:26.120 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.478287+0000", 2024-04-18T21:07:26.120 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027122349999999999 2024-04-18T21:07:26.120 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.120 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.120 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:26.120 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.478467+0000", 2024-04-18T21:07:26.120 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000180645 2024-04-18T21:07:26.120 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.120 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.120 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:26.120 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.478711+0000", 2024-04-18T21:07:26.120 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024371399999999999 2024-04-18T21:07:26.120 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:26.120 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:26.120 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:26.120 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.121 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.121 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11394 4.13 4:cb2e645e:::10000001109.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:26.121 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.925453+0000", 2024-04-18T21:07:26.121 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 10.137711423000001, 2024-04-18T21:07:26.121 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.55363756900000005, 2024-04-18T21:07:26.121 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:26.121 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:26.121 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:26.121 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:26.121 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.121 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:26.121 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925453+0000", 2024-04-18T21:07:26.121 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:26.121 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.121 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.121 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:26.122 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925453+0000", 2024-04-18T21:07:26.122 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:26.122 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.122 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.122 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:26.122 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925454+0000", 2024-04-18T21:07:26.122 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1699999999999997e-07 2024-04-18T21:07:26.122 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.122 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.122 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:26.122 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925458+0000", 2024-04-18T21:07:26.122 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7280000000000001e-06 2024-04-18T21:07:26.122 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.122 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.123 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:26.123 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925467+0000", 2024-04-18T21:07:26.123 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7169999999999997e-06 2024-04-18T21:07:26.123 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.123 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.123 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:26.123 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925474+0000", 2024-04-18T21:07:26.123 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1350000000000003e-06 2024-04-18T21:07:26.123 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.123 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.123 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:26.123 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925523+0000", 2024-04-18T21:07:26.123 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9616000000000001e-05 2024-04-18T21:07:26.123 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.124 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.124 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:26.124 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925530+0000", 2024-04-18T21:07:26.124 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0099999999999998e-06 2024-04-18T21:07:26.124 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.124 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.124 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:26.124 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.474474+0000", 2024-04-18T21:07:26.124 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.548943242 2024-04-18T21:07:26.124 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.124 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.124 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:26.124 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.474692+0000", 2024-04-18T21:07:26.125 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00021829799999999999 2024-04-18T21:07:26.125 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.125 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.125 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:26.125 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.474879+0000", 2024-04-18T21:07:26.125 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000187095 2024-04-18T21:07:26.125 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.125 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.125 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:26.125 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.478733+0000", 2024-04-18T21:07:26.125 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003853871 2024-04-18T21:07:26.125 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.125 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.125 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:26.126 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.478840+0000", 2024-04-18T21:07:26.126 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000106623 2024-04-18T21:07:26.126 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.126 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.126 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:26.126 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.478919+0000", 2024-04-18T21:07:26.126 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9326000000000006e-05 2024-04-18T21:07:26.126 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.126 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.126 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:26.126 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479091+0000", 2024-04-18T21:07:26.126 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000172091 2024-04-18T21:07:26.126 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:26.126 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:26.126 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:26.127 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.127 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.127 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11417 4.13 4:cae4f303:::1000000111f.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:26.127 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.927998+0000", 2024-04-18T21:07:26.127 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 10.135166783000001, 2024-04-18T21:07:26.127 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.55142600900000005, 2024-04-18T21:07:26.127 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:26.127 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:26.127 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:26.127 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:26.127 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.127 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:26.127 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.927998+0000", 2024-04-18T21:07:26.127 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:26.127 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.128 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.128 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:26.128 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.927998+0000", 2024-04-18T21:07:26.128 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:26.128 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.128 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.128 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:26.128 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.927999+0000", 2024-04-18T21:07:26.128 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2800000000000005e-07 2024-04-18T21:07:26.128 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.128 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.128 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:26.128 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.928003+0000", 2024-04-18T21:07:26.128 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0060000000000003e-06 2024-04-18T21:07:26.128 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.128 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.129 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:26.129 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.928012+0000", 2024-04-18T21:07:26.129 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.4129999999999995e-06 2024-04-18T21:07:26.129 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.129 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.129 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:26.129 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.928019+0000", 2024-04-18T21:07:26.129 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5590000000000002e-06 2024-04-18T21:07:26.129 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.129 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.129 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:26.129 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.928075+0000", 2024-04-18T21:07:26.129 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5927000000000002e-05 2024-04-18T21:07:26.129 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.130 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.130 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:26.130 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.928091+0000", 2024-04-18T21:07:26.130 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5724999999999999e-05 2024-04-18T21:07:26.130 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.130 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.130 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:26.130 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.476117+0000", 2024-04-18T21:07:26.130 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.54802609899999999 2024-04-18T21:07:26.130 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.130 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.130 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:26.130 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.476310+0000", 2024-04-18T21:07:26.130 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019318100000000001 2024-04-18T21:07:26.130 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.131 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.131 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:26.131 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.476469+0000", 2024-04-18T21:07:26.131 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015902599999999999 2024-04-18T21:07:26.131 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.131 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.131 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:26.131 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479198+0000", 2024-04-18T21:07:26.131 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027292010000000001 2024-04-18T21:07:26.131 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.131 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.131 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:26.131 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479225+0000", 2024-04-18T21:07:26.132 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6483e-05 2024-04-18T21:07:26.132 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.132 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.132 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:26.132 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479301+0000", 2024-04-18T21:07:26.132 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5935999999999999e-05 2024-04-18T21:07:26.132 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.132 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.132 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:26.132 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479424+0000", 2024-04-18T21:07:26.132 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012352500000000001 2024-04-18T21:07:26.132 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:26.132 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:26.132 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:26.133 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.133 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.133 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11538 4.13 4:ca7a7383:::10000001196.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:26.133 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.942641+0000", 2024-04-18T21:07:26.133 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 10.120524101999999, 2024-04-18T21:07:26.133 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.538204715, 2024-04-18T21:07:26.133 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:26.133 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:26.133 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:26.133 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:26.133 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.133 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:26.133 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942641+0000", 2024-04-18T21:07:26.134 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:26.134 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.134 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.134 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:26.134 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942641+0000", 2024-04-18T21:07:26.134 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:26.134 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.134 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.134 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:26.134 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942641+0000", 2024-04-18T21:07:26.134 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4099999999999998e-07 2024-04-18T21:07:26.134 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.134 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.134 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:26.134 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942645+0000", 2024-04-18T21:07:26.135 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.788e-06 2024-04-18T21:07:26.135 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.135 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.135 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:26.135 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942654+0000", 2024-04-18T21:07:26.135 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2089999999999994e-06 2024-04-18T21:07:26.135 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.135 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.135 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:26.135 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942668+0000", 2024-04-18T21:07:26.135 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3925e-05 2024-04-18T21:07:26.135 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.135 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.135 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:26.136 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942898+0000", 2024-04-18T21:07:26.136 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00022961800000000001 2024-04-18T21:07:26.136 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.136 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.136 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:26.136 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942907+0000", 2024-04-18T21:07:26.136 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6219999999999998e-06 2024-04-18T21:07:26.136 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.136 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.136 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:26.136 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.477120+0000", 2024-04-18T21:07:26.136 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.53421297400000001 2024-04-18T21:07:26.136 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.137 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.137 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:26.137 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.477466+0000", 2024-04-18T21:07:26.137 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00034685899999999998 2024-04-18T21:07:26.137 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.137 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.137 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:26.137 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.477717+0000", 2024-04-18T21:07:26.137 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00025019799999999998 2024-04-18T21:07:26.137 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.137 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.137 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:26.137 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479518+0000", 2024-04-18T21:07:26.137 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00180105 2024-04-18T21:07:26.137 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.137 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.138 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:26.138 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.480481+0000", 2024-04-18T21:07:26.138 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00096356100000000004 2024-04-18T21:07:26.138 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.138 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.138 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:26.138 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.480618+0000", 2024-04-18T21:07:26.138 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013678599999999999 2024-04-18T21:07:26.138 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.138 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.138 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:26.138 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.480845+0000", 2024-04-18T21:07:26.138 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00022738399999999999 2024-04-18T21:07:26.138 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:26.139 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:26.139 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:26.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.139 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.139 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11574 4.13 4:c9cea989:::100000011b9.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:26.139 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.947550+0000", 2024-04-18T21:07:26.139 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 10.115614361, 2024-04-18T21:07:26.139 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.53632730500000003, 2024-04-18T21:07:26.139 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:26.139 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:26.139 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:26.139 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:26.139 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.139 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:26.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947550+0000", 2024-04-18T21:07:26.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:26.140 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.140 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.140 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:26.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947550+0000", 2024-04-18T21:07:26.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:26.140 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.140 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.140 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:26.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947551+0000", 2024-04-18T21:07:26.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6599999999999996e-07 2024-04-18T21:07:26.140 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.140 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.140 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:26.141 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947554+0000", 2024-04-18T21:07:26.141 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6230000000000001e-06 2024-04-18T21:07:26.141 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.141 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.141 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:26.141 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947562+0000", 2024-04-18T21:07:26.141 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2179999999999999e-06 2024-04-18T21:07:26.141 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.141 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.141 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:26.141 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947567+0000", 2024-04-18T21:07:26.141 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3009999999999997e-06 2024-04-18T21:07:26.141 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.141 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.142 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:26.142 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947624+0000", 2024-04-18T21:07:26.142 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6823999999999997e-05 2024-04-18T21:07:26.142 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.142 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.142 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:26.142 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947633+0000", 2024-04-18T21:07:26.142 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9330000000000007e-06 2024-04-18T21:07:26.142 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.142 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.142 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:26.142 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479591+0000", 2024-04-18T21:07:26.142 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.53195765500000003 2024-04-18T21:07:26.142 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.142 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.143 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:26.143 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479781+0000", 2024-04-18T21:07:26.143 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000190034 2024-04-18T21:07:26.143 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.143 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:26.143 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479936+0000", 2024-04-18T21:07:26.143 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000154959 2024-04-18T21:07:26.143 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.143 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:26.143 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.483428+0000", 2024-04-18T21:07:26.143 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003492294 2024-04-18T21:07:26.143 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.144 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:26.144 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.483479+0000", 2024-04-18T21:07:26.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0868999999999997e-05 2024-04-18T21:07:26.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.144 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.144 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:26.144 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.483594+0000", 2024-04-18T21:07:26.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000115499 2024-04-18T21:07:26.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.144 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.144 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:26.144 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.483878+0000", 2024-04-18T21:07:26.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028352999999999999 2024-04-18T21:07:26.145 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:26.145 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:26.145 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:26.145 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.145 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11596 4.13 4:c88ce457:::100000011ce.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:26.145 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.955066+0000", 2024-04-18T21:07:26.145 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 10.108098952000001, 2024-04-18T21:07:26.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.52924763200000002, 2024-04-18T21:07:26.145 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:26.145 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:26.145 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:26.145 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:26.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.146 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:26.146 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955066+0000", 2024-04-18T21:07:26.146 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:26.146 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.146 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.146 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:26.146 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955066+0000", 2024-04-18T21:07:26.146 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:26.146 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.146 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.146 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:26.146 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955066+0000", 2024-04-18T21:07:26.146 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4900000000000001e-07 2024-04-18T21:07:26.147 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.147 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.147 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:26.147 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955068+0000", 2024-04-18T21:07:26.147 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0190000000000001e-06 2024-04-18T21:07:26.147 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.147 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.147 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:26.147 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955076+0000", 2024-04-18T21:07:26.147 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.537e-06 2024-04-18T21:07:26.147 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.147 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.147 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:26.147 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955080+0000", 2024-04-18T21:07:26.147 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1760000000000003e-06 2024-04-18T21:07:26.148 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.148 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.148 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:26.148 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955129+0000", 2024-04-18T21:07:26.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8480999999999999e-05 2024-04-18T21:07:26.148 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.148 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.148 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:26.148 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955134+0000", 2024-04-18T21:07:26.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1610000000000002e-06 2024-04-18T21:07:26.148 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.148 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.148 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:26.148 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.480932+0000", 2024-04-18T21:07:26.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.52579809799999999 2024-04-18T21:07:26.148 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.149 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.149 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:26.149 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.481149+0000", 2024-04-18T21:07:26.149 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00021709100000000001 2024-04-18T21:07:26.149 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.149 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.149 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:26.149 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.481303+0000", 2024-04-18T21:07:26.149 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000153752 2024-04-18T21:07:26.149 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.149 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.149 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:26.149 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.483927+0000", 2024-04-18T21:07:26.149 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026241189999999998 2024-04-18T21:07:26.149 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.150 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:26.150 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.484028+0000", 2024-04-18T21:07:26.150 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010134899999999999 2024-04-18T21:07:26.150 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.150 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:26.150 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.484138+0000", 2024-04-18T21:07:26.150 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011015599999999999 2024-04-18T21:07:26.150 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.150 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:26.150 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.484314+0000", 2024-04-18T21:07:26.150 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017524399999999999 2024-04-18T21:07:26.150 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:26.150 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:26.151 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:26.151 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.151 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11800 4.13 4:cacc00c7:::10000001296.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:26.151 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.989042+0000", 2024-04-18T21:07:26.151 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 10.074123284000001, 2024-04-18T21:07:26.151 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.49832004299999999, 2024-04-18T21:07:26.151 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:26.151 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:26.151 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:26.151 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:26.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.151 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:26.151 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989042+0000", 2024-04-18T21:07:26.151 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:26.151 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.152 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:26.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989042+0000", 2024-04-18T21:07:26.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:26.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.152 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:26.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989042+0000", 2024-04-18T21:07:26.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5200000000000002e-07 2024-04-18T21:07:26.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.152 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:26.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989044+0000", 2024-04-18T21:07:26.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2589999999999999e-06 2024-04-18T21:07:26.153 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.153 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.153 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:26.153 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989051+0000", 2024-04-18T21:07:26.153 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6340000000000003e-06 2024-04-18T21:07:26.153 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.153 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.153 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:26.153 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989062+0000", 2024-04-18T21:07:26.153 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1043000000000001e-05 2024-04-18T21:07:26.153 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.153 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.153 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:26.153 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989367+0000", 2024-04-18T21:07:26.153 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000305249 2024-04-18T21:07:26.154 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.154 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:26.154 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989376+0000", 2024-04-18T21:07:26.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4570000000000005e-06 2024-04-18T21:07:26.154 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.154 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:26.154 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.482011+0000", 2024-04-18T21:07:26.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.49263514200000003 2024-04-18T21:07:26.154 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.154 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:26.154 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.482397+0000", 2024-04-18T21:07:26.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000385986 2024-04-18T21:07:26.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:26.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.482689+0000", 2024-04-18T21:07:26.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00029179800000000001 2024-04-18T21:07:26.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:26.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.487008+0000", 2024-04-18T21:07:26.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043196129999999999 2024-04-18T21:07:26.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:26.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.487113+0000", 2024-04-18T21:07:26.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010498899999999999 2024-04-18T21:07:26.156 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.156 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.156 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:26.156 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.487192+0000", 2024-04-18T21:07:26.156 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8778999999999999e-05 2024-04-18T21:07:26.156 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.156 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.156 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:26.156 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.487362+0000", 2024-04-18T21:07:26.156 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016964200000000001 2024-04-18T21:07:26.156 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:26.156 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:26.156 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:26.156 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.156 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.156 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11888 4.13 4:ca460221:::10000002cd3.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:26.157 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:16.002068+0000", 2024-04-18T21:07:26.157 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 10.061096623999999, 2024-04-18T21:07:26.157 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.48938242199999998, 2024-04-18T21:07:26.157 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:26.157 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:26.157 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:26.157 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:26.157 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.157 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:26.157 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002068+0000", 2024-04-18T21:07:26.157 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:26.157 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.157 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.157 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:26.157 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002068+0000", 2024-04-18T21:07:26.157 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:26.158 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.158 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.158 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:26.158 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002069+0000", 2024-04-18T21:07:26.158 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7899999999999999e-07 2024-04-18T21:07:26.158 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.158 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.158 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:26.158 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002071+0000", 2024-04-18T21:07:26.158 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.356e-06 2024-04-18T21:07:26.158 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.158 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.158 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:26.158 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002078+0000", 2024-04-18T21:07:26.158 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.562e-06 2024-04-18T21:07:26.159 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.159 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.159 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:26.159 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002083+0000", 2024-04-18T21:07:26.159 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1939999999999997e-06 2024-04-18T21:07:26.159 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.159 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.159 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:26.159 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002125+0000", 2024-04-18T21:07:26.159 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2548e-05 2024-04-18T21:07:26.159 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.159 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.159 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:26.159 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002132+0000", 2024-04-18T21:07:26.159 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9360000000000002e-06 2024-04-18T21:07:26.160 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.160 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.160 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:26.160 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.484392+0000", 2024-04-18T21:07:26.160 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.48225933500000001 2024-04-18T21:07:26.160 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.160 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.160 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:26.160 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.484630+0000", 2024-04-18T21:07:26.160 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023872499999999999 2024-04-18T21:07:26.160 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.160 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.160 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:26.160 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.484812+0000", 2024-04-18T21:07:26.160 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000181232 2024-04-18T21:07:26.160 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.161 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.161 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:26.161 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.490995+0000", 2024-04-18T21:07:26.161 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0061831459999999996 2024-04-18T21:07:26.161 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.161 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.161 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:26.161 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491132+0000", 2024-04-18T21:07:26.161 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000137145 2024-04-18T21:07:26.161 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.161 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.161 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:26.161 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491219+0000", 2024-04-18T21:07:26.161 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7466000000000006e-05 2024-04-18T21:07:26.161 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.162 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.162 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:26.162 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491451+0000", 2024-04-18T21:07:26.162 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023129800000000001 2024-04-18T21:07:26.162 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:26.162 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:26.162 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:26.162 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.162 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.162 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:12057 4.13 4:cacbe4c4:::10000002d77.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:26.162 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:16.028144+0000", 2024-04-18T21:07:26.162 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 10.035021013, 2024-04-18T21:07:26.162 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.46365036100000001, 2024-04-18T21:07:26.162 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:26.162 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:26.163 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:26.163 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:26.163 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.163 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:26.163 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028144+0000", 2024-04-18T21:07:26.163 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:26.163 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.163 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.163 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:26.163 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028144+0000", 2024-04-18T21:07:26.163 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:26.163 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.163 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.163 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:26.163 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028144+0000", 2024-04-18T21:07:26.163 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9800000000000003e-07 2024-04-18T21:07:26.164 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.164 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.164 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:26.164 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028147+0000", 2024-04-18T21:07:26.164 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.773e-06 2024-04-18T21:07:26.164 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.164 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.164 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:26.164 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028154+0000", 2024-04-18T21:07:26.164 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8940000000000004e-06 2024-04-18T21:07:26.164 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.164 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.164 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:26.164 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028160+0000", 2024-04-18T21:07:26.164 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7219999999999996e-06 2024-04-18T21:07:26.165 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.165 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.165 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:26.165 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028227+0000", 2024-04-18T21:07:26.165 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6711000000000006e-05 2024-04-18T21:07:26.165 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.165 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.165 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:26.165 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028250+0000", 2024-04-18T21:07:26.165 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3010000000000002e-05 2024-04-18T21:07:26.165 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.165 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.165 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:26.165 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.487484+0000", 2024-04-18T21:07:26.165 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.45923466600000001 2024-04-18T21:07:26.166 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.166 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.166 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:26.166 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.487750+0000", 2024-04-18T21:07:26.166 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026618799999999999 2024-04-18T21:07:26.166 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.166 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.166 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:26.166 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.487915+0000", 2024-04-18T21:07:26.166 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016425500000000001 2024-04-18T21:07:26.166 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.166 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.166 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:26.166 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491559+0000", 2024-04-18T21:07:26.167 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003644109 2024-04-18T21:07:26.167 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.167 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.167 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:26.167 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491586+0000", 2024-04-18T21:07:26.167 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.743e-05 2024-04-18T21:07:26.167 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.167 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.167 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:26.167 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491662+0000", 2024-04-18T21:07:26.167 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5978999999999999e-05 2024-04-18T21:07:26.167 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.167 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.167 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:26.168 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491794+0000", 2024-04-18T21:07:26.168 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013202600000000001 2024-04-18T21:07:26.168 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:26.168 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:26.168 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:26.168 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.168 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.168 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:12078 4.13 4:c93107e9:::10000002d8c.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:26.168 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:16.031090+0000", 2024-04-18T21:07:26.168 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 10.032075147, 2024-04-18T21:07:26.168 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.461078355, 2024-04-18T21:07:26.168 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:26.168 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:26.169 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:26.169 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:26.169 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.169 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:26.169 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031090+0000", 2024-04-18T21:07:26.169 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:26.169 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.169 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.169 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:26.169 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031090+0000", 2024-04-18T21:07:26.169 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:26.169 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.169 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.169 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:26.170 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031090+0000", 2024-04-18T21:07:26.170 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6599999999999996e-07 2024-04-18T21:07:26.170 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.170 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.170 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:26.170 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031093+0000", 2024-04-18T21:07:26.170 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7659999999999999e-06 2024-04-18T21:07:26.170 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.170 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.170 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:26.170 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031099+0000", 2024-04-18T21:07:26.170 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2269999999999998e-06 2024-04-18T21:07:26.170 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.170 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.170 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:26.171 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031103+0000", 2024-04-18T21:07:26.171 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7929999999999999e-06 2024-04-18T21:07:26.171 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.171 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.171 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:26.171 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031147+0000", 2024-04-18T21:07:26.171 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3742000000000002e-05 2024-04-18T21:07:26.171 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.171 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.171 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:26.171 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031154+0000", 2024-04-18T21:07:26.171 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1999999999999997e-06 2024-04-18T21:07:26.171 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.171 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.172 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:26.172 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.488743+0000", 2024-04-18T21:07:26.172 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.45758900200000002 2024-04-18T21:07:26.172 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.172 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.172 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:26.172 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.488980+0000", 2024-04-18T21:07:26.172 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023704499999999999 2024-04-18T21:07:26.172 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.172 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.172 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:26.172 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.489166+0000", 2024-04-18T21:07:26.172 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018544500000000001 2024-04-18T21:07:26.172 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.173 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.173 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:26.173 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491810+0000", 2024-04-18T21:07:26.173 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026448219999999998 2024-04-18T21:07:26.173 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.173 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.173 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:26.173 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491903+0000", 2024-04-18T21:07:26.173 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2305999999999993e-05 2024-04-18T21:07:26.173 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.173 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.173 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:26.173 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491987+0000", 2024-04-18T21:07:26.173 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4581999999999998e-05 2024-04-18T21:07:26.174 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.174 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.174 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:26.174 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.492168+0000", 2024-04-18T21:07:26.174 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018075900000000001 2024-04-18T21:07:26.174 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:26.174 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:26.174 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:26.174 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.174 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.174 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:12081 4.13 4:cafa1dfa:::10000002d8f.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:26.174 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:16.031865+0000", 2024-04-18T21:07:26.174 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 10.031300113, 2024-04-18T21:07:26.174 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.460588628, 2024-04-18T21:07:26.175 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:26.175 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:26.175 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:26.175 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:26.175 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.175 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:26.175 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031865+0000", 2024-04-18T21:07:26.175 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:26.175 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.175 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.175 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:26.175 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031865+0000", 2024-04-18T21:07:26.175 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:26.176 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.176 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.176 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:26.176 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031865+0000", 2024-04-18T21:07:26.176 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4799999999999998e-07 2024-04-18T21:07:26.176 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.176 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.176 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:26.176 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031868+0000", 2024-04-18T21:07:26.176 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6570000000000001e-06 2024-04-18T21:07:26.176 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.176 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.176 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:26.176 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031874+0000", 2024-04-18T21:07:26.177 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4370000000000004e-06 2024-04-18T21:07:26.177 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.177 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.177 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:26.177 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031879+0000", 2024-04-18T21:07:26.177 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8729999999999998e-06 2024-04-18T21:07:26.177 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.177 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.177 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:26.177 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031924+0000", 2024-04-18T21:07:26.177 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4314999999999998e-05 2024-04-18T21:07:26.177 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.177 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.177 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:26.177 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031929+0000", 2024-04-18T21:07:26.177 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9980000000000003e-06 2024-04-18T21:07:26.178 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.178 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.178 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:26.178 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.489813+0000", 2024-04-18T21:07:26.178 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.45788481800000003 2024-04-18T21:07:26.178 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.178 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.178 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:26.178 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.490188+0000", 2024-04-18T21:07:26.178 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00037420699999999999 2024-04-18T21:07:26.178 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.178 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.178 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:26.178 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.490423+0000", 2024-04-18T21:07:26.179 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023582400000000001 2024-04-18T21:07:26.179 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.179 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.179 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:26.179 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.492238+0000", 2024-04-18T21:07:26.179 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018143930000000001 2024-04-18T21:07:26.179 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.179 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.179 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:26.179 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.492256+0000", 2024-04-18T21:07:26.179 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7706999999999998e-05 2024-04-18T21:07:26.179 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.179 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.180 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:26.180 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.492323+0000", 2024-04-18T21:07:26.180 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7222000000000001e-05 2024-04-18T21:07:26.180 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:26.180 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:26.180 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:26.180 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.492453+0000", 2024-04-18T21:07:26.180 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000130529 2024-04-18T21:07:26.180 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:26.180 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:26.180 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:26.180 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:26.180 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:26.180 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:07:26.182 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:07:26.183 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:26.181+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:26.282 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:26.281+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:26.314 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:07:26.314 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:07:26.314 INFO:teuthology.orchestra.run.smithi132.stdout: "num_ops": 0 2024-04-18T21:07:26.314 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:07:26.329 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:07:26.383 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:26.382+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:26.484 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:26.486+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:26.495 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:07:26.495 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:07:26.495 INFO:teuthology.orchestra.run.smithi132.stdout: "complaint_time": 30, 2024-04-18T21:07:26.495 INFO:teuthology.orchestra.run.smithi132.stdout: "num_blocked_ops": 0 2024-04-18T21:07:26.495 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:07:26.509 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:07:26.584 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~29s 2024-04-18T21:07:26.585 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:26.586+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:26.615 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:07:26.629 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:07:26.629 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 20, 2024-04-18T21:07:26.629 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 600, 2024-04-18T21:07:26.629 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [ 2024-04-18T21:07:26.629 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.630 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:15094 4.c 4:32870457:::10000003692.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-18T21:07:26.630 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:03.107374+0000", 2024-04-18T21:07:26.630 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 23.521590546999999, 2024-04-18T21:07:26.630 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.061575983000000001, 2024-04-18T21:07:26.630 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:26.630 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:26.630 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:26.630 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:26.630 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:26.630 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:26.630 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 15094 2024-04-18T21:07:26.630 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.630 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:26.630 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.631 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:26.631 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.107374+0000", 2024-04-18T21:07:26.631 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:26.631 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.631 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.631 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:26.631 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.107374+0000", 2024-04-18T21:07:26.631 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:26.631 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.631 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.631 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:26.631 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.107376+0000", 2024-04-18T21:07:26.631 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3969999999999999e-06 2024-04-18T21:07:26.631 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.631 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.632 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:26.632 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115698+0000", 2024-04-18T21:07:26.632 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0083223989999999994 2024-04-18T21:07:26.632 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.632 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.632 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:26.632 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115713+0000", 2024-04-18T21:07:26.632 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4385e-05 2024-04-18T21:07:26.632 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.632 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.632 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:26.632 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115722+0000", 2024-04-18T21:07:26.632 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0759999999999992e-06 2024-04-18T21:07:26.632 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.633 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.633 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:26.633 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115784+0000", 2024-04-18T21:07:26.633 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.2348999999999995e-05 2024-04-18T21:07:26.633 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.633 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.633 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:26.633 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115849+0000", 2024-04-18T21:07:26.633 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.4964999999999999e-05 2024-04-18T21:07:26.633 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.633 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.633 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:26.633 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.116054+0000", 2024-04-18T21:07:26.634 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020483400000000001 2024-04-18T21:07:26.634 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.634 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.634 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:26.634 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.125769+0000", 2024-04-18T21:07:26.634 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0097153340000000008 2024-04-18T21:07:26.634 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.634 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.634 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:26.634 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.168834+0000", 2024-04-18T21:07:26.634 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043064527999999998 2024-04-18T21:07:26.634 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.634 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.635 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:26.635 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.168882+0000", 2024-04-18T21:07:26.635 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.7919e-05 2024-04-18T21:07:26.635 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.635 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.635 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:26.635 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.168950+0000", 2024-04-18T21:07:26.635 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.8796999999999999e-05 2024-04-18T21:07:26.635 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:26.635 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:26.635 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:26.635 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.635 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.635 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7616 4.d 4:b1f7eab6:::10000001d5f.00000000:head [delete] snapc 1=[] RETRY=2 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:26.636 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882522+0000", 2024-04-18T21:07:26.636 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 14.746442654999999, 2024-04-18T21:07:26.636 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.086006255, 2024-04-18T21:07:26.636 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:26.636 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:26.636 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "reached pg", 2024-04-18T21:07:26.636 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:26.636 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.636 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:26.636 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882522+0000", 2024-04-18T21:07:26.636 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:26.636 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.636 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.637 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:26.637 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882522+0000", 2024-04-18T21:07:26.637 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:26.637 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.637 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.637 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:26.637 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882524+0000", 2024-04-18T21:07:26.637 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4720000000000001e-06 2024-04-18T21:07:26.637 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.637 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.637 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:26.637 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882531+0000", 2024-04-18T21:07:26.637 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7830000000000001e-06 2024-04-18T21:07:26.637 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.638 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.638 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:26.638 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882549+0000", 2024-04-18T21:07:26.638 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8765000000000001e-05 2024-04-18T21:07:26.638 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.638 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.638 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:26.638 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882562+0000", 2024-04-18T21:07:26.638 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3117e-05 2024-04-18T21:07:26.638 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.638 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.639 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:26.639 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882690+0000", 2024-04-18T21:07:26.639 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012794799999999999 2024-04-18T21:07:26.639 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.639 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.639 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op must wait for map", 2024-04-18T21:07:26.639 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882701+0000", 2024-04-18T21:07:26.639 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0215e-05 2024-04-18T21:07:26.639 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.639 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.639 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:26.639 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.891964+0000", 2024-04-18T21:07:26.639 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0092636130000000004 2024-04-18T21:07:26.639 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.640 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.640 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:26.640 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.891976+0000", 2024-04-18T21:07:26.640 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1973e-05 2024-04-18T21:07:26.640 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.640 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.640 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:26.640 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.959520+0000", 2024-04-18T21:07:26.640 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0675436009999999 2024-04-18T21:07:26.640 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.640 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.640 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for missing object", 2024-04-18T21:07:26.640 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.959662+0000", 2024-04-18T21:07:26.640 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014253000000000001 2024-04-18T21:07:26.640 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.641 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.641 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:26.641 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.968480+0000", 2024-04-18T21:07:26.641 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0088178409999999999 2024-04-18T21:07:26.641 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.641 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.641 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:26.641 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.968529+0000", 2024-04-18T21:07:26.641 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8396999999999998e-05 2024-04-18T21:07:26.641 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:26.641 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:26.641 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:26.641 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.641 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.641 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7628 4.31 4:8c97f9cd:::10000001d6c.00000000:head [delete] snapc 1=[] RETRY=2 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:26.641 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882610+0000", 2024-04-18T21:07:26.642 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 14.746354925, 2024-04-18T21:07:26.642 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.08538018, 2024-04-18T21:07:26.642 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:26.642 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:26.642 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "reached pg", 2024-04-18T21:07:26.642 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:26.642 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.642 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:26.642 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882610+0000", 2024-04-18T21:07:26.642 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:26.642 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.642 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.642 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:26.642 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882610+0000", 2024-04-18T21:07:26.643 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:26.643 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.643 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.643 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:26.643 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882611+0000", 2024-04-18T21:07:26.643 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.4199999999999995e-07 2024-04-18T21:07:26.643 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.643 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.643 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:26.643 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882614+0000", 2024-04-18T21:07:26.643 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.4300000000000002e-06 2024-04-18T21:07:26.643 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.643 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.643 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:26.643 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882623+0000", 2024-04-18T21:07:26.644 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8740000000000001e-06 2024-04-18T21:07:26.644 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.644 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.644 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:26.644 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882629+0000", 2024-04-18T21:07:26.644 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.4330000000000001e-06 2024-04-18T21:07:26.644 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.644 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.644 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:26.644 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882706+0000", 2024-04-18T21:07:26.644 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.6280999999999997e-05 2024-04-18T21:07:26.644 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.644 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.644 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op must wait for map", 2024-04-18T21:07:26.645 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882715+0000", 2024-04-18T21:07:26.645 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.1679999999999993e-06 2024-04-18T21:07:26.645 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.645 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.645 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:26.645 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.889481+0000", 2024-04-18T21:07:26.645 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0067656979999999997 2024-04-18T21:07:26.645 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.645 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.645 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:26.645 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.889493+0000", 2024-04-18T21:07:26.645 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2451e-05 2024-04-18T21:07:26.646 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.646 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.646 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:26.646 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.940942+0000", 2024-04-18T21:07:26.646 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0514491720000001 2024-04-18T21:07:26.646 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.646 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.646 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for missing object", 2024-04-18T21:07:26.646 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.941134+0000", 2024-04-18T21:07:26.646 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019150600000000001 2024-04-18T21:07:26.646 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.646 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.647 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:26.647 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.967914+0000", 2024-04-18T21:07:26.647 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026780202999999999 2024-04-18T21:07:26.647 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.647 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.647 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:26.647 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.967990+0000", 2024-04-18T21:07:26.647 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.6322000000000006e-05 2024-04-18T21:07:26.647 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:26.647 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:26.647 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:26.647 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.647 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.648 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7630 4.d 4:b022c802:::10000001d6e.00000000:head [delete] snapc 1=[] RETRY=2 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:26.648 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882645+0000", 2024-04-18T21:07:26.648 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 14.746319640999999, 2024-04-18T21:07:26.648 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0858072780000001, 2024-04-18T21:07:26.648 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:26.648 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:26.648 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "reached pg", 2024-04-18T21:07:26.648 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:26.648 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.648 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:26.648 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882645+0000", 2024-04-18T21:07:26.648 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:26.648 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.648 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.648 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:26.649 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882645+0000", 2024-04-18T21:07:26.649 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:26.649 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.649 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.649 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:26.649 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882646+0000", 2024-04-18T21:07:26.649 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.3599999999999999e-07 2024-04-18T21:07:26.649 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.649 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.649 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:26.649 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882648+0000", 2024-04-18T21:07:26.649 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.5809999999999999e-06 2024-04-18T21:07:26.649 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.650 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.650 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:26.650 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882655+0000", 2024-04-18T21:07:26.650 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7909999999999999e-06 2024-04-18T21:07:26.650 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.650 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.650 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:26.650 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882661+0000", 2024-04-18T21:07:26.650 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3920000000000002e-06 2024-04-18T21:07:26.650 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.650 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.650 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:26.650 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882825+0000", 2024-04-18T21:07:26.650 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016480100000000001 2024-04-18T21:07:26.650 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.650 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.651 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:07:26.651 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882840+0000", 2024-04-18T21:07:26.651 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4656e-05 2024-04-18T21:07:26.651 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.651 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.651 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:26.651 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.892020+0000", 2024-04-18T21:07:26.651 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0091804680000000007 2024-04-18T21:07:26.651 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.651 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.651 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:26.651 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.892026+0000", 2024-04-18T21:07:26.651 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4580000000000001e-06 2024-04-18T21:07:26.651 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.652 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.652 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:26.652 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.959913+0000", 2024-04-18T21:07:26.652 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.067887289 2024-04-18T21:07:26.652 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.652 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.652 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for missing object", 2024-04-18T21:07:26.652 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.960034+0000", 2024-04-18T21:07:26.652 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000120445 2024-04-18T21:07:26.652 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.652 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.652 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:26.652 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.968407+0000", 2024-04-18T21:07:26.652 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0083734010000000008 2024-04-18T21:07:26.653 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.653 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.653 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:26.653 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.968453+0000", 2024-04-18T21:07:26.653 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.5559999999999997e-05 2024-04-18T21:07:26.653 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:26.653 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:26.653 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:26.653 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.653 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.653 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7651 4.13 4:c9951bc5:::10000001e1b.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:26.653 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882696+0000", 2024-04-18T21:07:26.653 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 14.746269227999999, 2024-04-18T21:07:26.653 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.088382095, 2024-04-18T21:07:26.653 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:26.654 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:26.654 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:26.654 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:26.654 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.654 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:26.654 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882696+0000", 2024-04-18T21:07:26.654 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:26.654 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.654 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.654 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:26.654 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882696+0000", 2024-04-18T21:07:26.654 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:26.654 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.654 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.654 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:26.655 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882696+0000", 2024-04-18T21:07:26.655 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.06e-07 2024-04-18T21:07:26.655 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.655 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.655 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:26.655 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882699+0000", 2024-04-18T21:07:26.655 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.1039999999999998e-06 2024-04-18T21:07:26.655 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.655 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.655 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:26.655 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882707+0000", 2024-04-18T21:07:26.655 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.593e-06 2024-04-18T21:07:26.655 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.655 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.655 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:26.656 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882712+0000", 2024-04-18T21:07:26.656 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.541e-06 2024-04-18T21:07:26.656 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.656 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.656 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:26.656 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882870+0000", 2024-04-18T21:07:26.656 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000157999 2024-04-18T21:07:26.656 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.656 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.656 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op must wait for map", 2024-04-18T21:07:26.656 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882885+0000", 2024-04-18T21:07:26.656 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4989e-05 2024-04-18T21:07:26.656 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.656 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.656 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:26.656 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.891447+0000", 2024-04-18T21:07:26.657 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0085618540000000007 2024-04-18T21:07:26.657 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.657 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.657 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:26.657 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.891457+0000", 2024-04-18T21:07:26.657 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.6399999999999992e-06 2024-04-18T21:07:26.657 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.657 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.657 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:26.657 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.964840+0000", 2024-04-18T21:07:26.657 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.073383279 2024-04-18T21:07:26.657 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.657 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.657 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:26.657 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.965078+0000", 2024-04-18T21:07:26.658 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000237581 2024-04-18T21:07:26.658 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.658 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.658 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:26.658 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.965299+0000", 2024-04-18T21:07:26.658 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00022087699999999999 2024-04-18T21:07:26.658 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.658 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.658 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:26.658 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.969505+0000", 2024-04-18T21:07:26.658 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.004206123 2024-04-18T21:07:26.658 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.658 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.658 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:26.658 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.970898+0000", 2024-04-18T21:07:26.659 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001393434 2024-04-18T21:07:26.659 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.659 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.659 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:26.659 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.970936+0000", 2024-04-18T21:07:26.659 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.7647000000000001e-05 2024-04-18T21:07:26.659 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.659 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.659 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:26.659 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.971078+0000", 2024-04-18T21:07:26.659 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014192799999999999 2024-04-18T21:07:26.659 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:26.659 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:26.659 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:26.659 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.659 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.660 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7671 4.31 4:8c95a1b7:::10000001e2f.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:26.660 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882728+0000", 2024-04-18T21:07:26.660 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 14.746237392999999, 2024-04-18T21:07:26.660 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.084467606, 2024-04-18T21:07:26.660 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:26.660 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:26.660 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:26.660 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:26.660 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.660 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:26.660 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882728+0000", 2024-04-18T21:07:26.660 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:26.660 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.661 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.661 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:26.661 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882728+0000", 2024-04-18T21:07:26.661 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:26.661 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.661 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.661 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:26.661 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882728+0000", 2024-04-18T21:07:26.661 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.0399999999999996e-07 2024-04-18T21:07:26.661 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.661 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.661 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:26.662 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882731+0000", 2024-04-18T21:07:26.662 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.5239999999999999e-06 2024-04-18T21:07:26.662 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.662 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.662 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:26.662 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882739+0000", 2024-04-18T21:07:26.662 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4020000000000002e-06 2024-04-18T21:07:26.662 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.662 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.662 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:26.662 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882744+0000", 2024-04-18T21:07:26.662 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.1410000000000004e-06 2024-04-18T21:07:26.662 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.662 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.663 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:26.663 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882836+0000", 2024-04-18T21:07:26.663 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.2094000000000003e-05 2024-04-18T21:07:26.663 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.663 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.663 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:07:26.663 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882849+0000", 2024-04-18T21:07:26.663 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3087e-05 2024-04-18T21:07:26.663 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.663 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.663 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:26.663 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.889522+0000", 2024-04-18T21:07:26.663 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0066730950000000004 2024-04-18T21:07:26.663 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.663 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.663 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:26.664 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.889530+0000", 2024-04-18T21:07:26.664 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8699999999999992e-06 2024-04-18T21:07:26.664 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.664 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.664 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:26.664 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.941173+0000", 2024-04-18T21:07:26.664 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.051642658 2024-04-18T21:07:26.664 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.664 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.664 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:26.664 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.941392+0000", 2024-04-18T21:07:26.664 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00021854099999999999 2024-04-18T21:07:26.664 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.664 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.664 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:26.664 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.941618+0000", 2024-04-18T21:07:26.665 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0002265 2024-04-18T21:07:26.665 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.665 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.665 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:26.665 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.945390+0000", 2024-04-18T21:07:26.665 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0037723460000000002 2024-04-18T21:07:26.665 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.665 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.665 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:26.665 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.966905+0000", 2024-04-18T21:07:26.665 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021514559999999999 2024-04-18T21:07:26.665 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.665 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.665 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:26.665 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.966972+0000", 2024-04-18T21:07:26.665 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.6740000000000001e-05 2024-04-18T21:07:26.666 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.666 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.666 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:26.666 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.967195+0000", 2024-04-18T21:07:26.666 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000223544 2024-04-18T21:07:26.666 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:26.666 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:26.666 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:26.666 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.666 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.666 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7691 4.d 4:b0345396:::10000001e43.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:26.666 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882753+0000", 2024-04-18T21:07:26.666 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 14.746212414, 2024-04-18T21:07:26.666 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.085135618, 2024-04-18T21:07:26.666 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:26.667 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:26.667 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:26.667 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:26.667 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.667 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:26.667 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882753+0000", 2024-04-18T21:07:26.667 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:26.667 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.667 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.667 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:26.667 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882753+0000", 2024-04-18T21:07:26.667 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:26.667 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.667 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.667 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:26.667 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882753+0000", 2024-04-18T21:07:26.667 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.9000000000000002e-07 2024-04-18T21:07:26.668 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.668 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.668 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:26.668 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882755+0000", 2024-04-18T21:07:26.668 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.4040000000000002e-06 2024-04-18T21:07:26.668 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.668 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.668 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:26.668 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882762+0000", 2024-04-18T21:07:26.668 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.6229999999999999e-06 2024-04-18T21:07:26.668 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.668 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.668 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:26.668 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882769+0000", 2024-04-18T21:07:26.669 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.1559999999999998e-06 2024-04-18T21:07:26.669 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.669 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.669 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:26.669 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882875+0000", 2024-04-18T21:07:26.669 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000105491 2024-04-18T21:07:26.669 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.669 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.669 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:07:26.669 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882879+0000", 2024-04-18T21:07:26.669 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.9999999999999998e-06 2024-04-18T21:07:26.669 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.669 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.669 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:26.670 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.892072+0000", 2024-04-18T21:07:26.670 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0091930989999999997 2024-04-18T21:07:26.670 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.670 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.670 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:26.670 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.892083+0000", 2024-04-18T21:07:26.670 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1070000000000001e-05 2024-04-18T21:07:26.670 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.670 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.670 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:26.670 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.960162+0000", 2024-04-18T21:07:26.670 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0680791869999999 2024-04-18T21:07:26.670 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.670 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.670 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:26.671 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.960314+0000", 2024-04-18T21:07:26.671 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000152139 2024-04-18T21:07:26.671 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.671 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.671 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:26.671 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.960469+0000", 2024-04-18T21:07:26.671 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000154444 2024-04-18T21:07:26.671 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.671 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.671 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:26.671 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.964018+0000", 2024-04-18T21:07:26.671 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035494179999999999 2024-04-18T21:07:26.671 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.671 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.671 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:26.671 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.967680+0000", 2024-04-18T21:07:26.672 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.003662046 2024-04-18T21:07:26.672 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.672 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.672 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:26.672 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.967738+0000", 2024-04-18T21:07:26.672 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.7946999999999999e-05 2024-04-18T21:07:26.672 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.672 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.672 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:26.672 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.967888+0000", 2024-04-18T21:07:26.672 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000150204 2024-04-18T21:07:26.672 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:26.672 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:26.672 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:26.673 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.673 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.673 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:20010 4.1a 4:5997e84c:::1000000013a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-18T21:07:26.673 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:25.995286+0000", 2024-04-18T21:07:26.673 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.63367874000000002, 2024-04-18T21:07:26.673 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.062172181, 2024-04-18T21:07:26.673 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:26.673 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:26.673 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:07:26.673 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:26.673 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.673 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:26.673 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995286+0000", 2024-04-18T21:07:26.673 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:26.674 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.674 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.674 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:26.674 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995286+0000", 2024-04-18T21:07:26.674 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:26.674 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.674 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.674 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:26.674 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995287+0000", 2024-04-18T21:07:26.674 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.034e-06 2024-04-18T21:07:26.674 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.674 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.674 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:26.675 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995292+0000", 2024-04-18T21:07:26.675 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8029999999999996e-06 2024-04-18T21:07:26.675 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.675 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.675 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:26.675 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995308+0000", 2024-04-18T21:07:26.675 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6113e-05 2024-04-18T21:07:26.675 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.675 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.675 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:26.675 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995321+0000", 2024-04-18T21:07:26.675 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3019e-05 2024-04-18T21:07:26.675 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.675 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.675 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:26.676 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.039546+0000", 2024-04-18T21:07:26.676 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.044224749000000001 2024-04-18T21:07:26.676 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.676 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.676 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:26.676 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.039852+0000", 2024-04-18T21:07:26.676 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00030594699999999999 2024-04-18T21:07:26.676 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.676 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.676 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:26.676 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.057458+0000", 2024-04-18T21:07:26.676 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017606515999999999 2024-04-18T21:07:26.676 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:26.676 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:26.676 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:26.677 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.677 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.677 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:20018 4.1b 4:d9deb994:::10000000142.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-18T21:07:26.677 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:25.995386+0000", 2024-04-18T21:07:26.677 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.63357887499999999, 2024-04-18T21:07:26.677 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.066397342999999998, 2024-04-18T21:07:26.677 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:26.677 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:26.677 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:07:26.677 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:26.677 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.677 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:26.677 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995386+0000", 2024-04-18T21:07:26.677 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:26.677 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.677 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.678 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:26.678 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995386+0000", 2024-04-18T21:07:26.678 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:26.678 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.678 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.678 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:26.678 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995387+0000", 2024-04-18T21:07:26.678 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.7300000000000004e-07 2024-04-18T21:07:26.678 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.678 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.678 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:26.678 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995392+0000", 2024-04-18T21:07:26.679 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.6070000000000001e-06 2024-04-18T21:07:26.679 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.679 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.679 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:26.679 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995408+0000", 2024-04-18T21:07:26.679 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6801999999999999e-05 2024-04-18T21:07:26.679 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.679 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.679 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:26.679 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995424+0000", 2024-04-18T21:07:26.679 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5566999999999999e-05 2024-04-18T21:07:26.679 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.679 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.679 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:26.680 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.025739+0000", 2024-04-18T21:07:26.680 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030314537999999999 2024-04-18T21:07:26.680 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.680 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.680 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:26.680 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.026475+0000", 2024-04-18T21:07:26.680 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00073683699999999995 2024-04-18T21:07:26.680 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.680 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.680 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:26.680 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.061783+0000", 2024-04-18T21:07:26.680 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.035308019000000003 2024-04-18T21:07:26.680 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:26.680 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:26.680 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:26.680 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.681 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.681 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:20021 4.1a 4:587da770:::10000000145.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-18T21:07:26.681 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:25.995439+0000", 2024-04-18T21:07:26.681 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.63352548600000003, 2024-04-18T21:07:26.681 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.062273949000000002, 2024-04-18T21:07:26.681 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:26.681 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:26.681 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:07:26.681 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:26.681 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.681 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:26.682 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995439+0000", 2024-04-18T21:07:26.682 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:26.682 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.682 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.682 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:26.682 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995439+0000", 2024-04-18T21:07:26.682 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:26.682 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.682 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.682 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:26.682 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995440+0000", 2024-04-18T21:07:26.682 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9600000000000008e-07 2024-04-18T21:07:26.682 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.683 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.683 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:26.683 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995445+0000", 2024-04-18T21:07:26.683 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.6569999999999996e-06 2024-04-18T21:07:26.683 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.683 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.683 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:26.683 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995461+0000", 2024-04-18T21:07:26.683 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6089000000000001e-05 2024-04-18T21:07:26.683 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.683 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.683 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:26.683 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995475+0000", 2024-04-18T21:07:26.683 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4174e-05 2024-04-18T21:07:26.683 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.684 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.684 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:26.684 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.040858+0000", 2024-04-18T21:07:26.684 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.045382359999999997 2024-04-18T21:07:26.684 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.684 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.684 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:26.684 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.041187+0000", 2024-04-18T21:07:26.684 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00032946199999999998 2024-04-18T21:07:26.684 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.684 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.684 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:26.684 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.057713+0000", 2024-04-18T21:07:26.684 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016526210999999999 2024-04-18T21:07:26.684 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:26.684 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:26.685 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:26.685 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.685 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.685 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:20050 4.1a 4:581fb947:::10000000162.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-18T21:07:26.685 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:25.996077+0000", 2024-04-18T21:07:26.685 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.63288828799999997, 2024-04-18T21:07:26.685 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.061925185000000001, 2024-04-18T21:07:26.685 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:26.685 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:26.685 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:07:26.685 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:26.685 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.685 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:26.685 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996077+0000", 2024-04-18T21:07:26.685 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:26.685 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.686 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.686 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:26.686 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996077+0000", 2024-04-18T21:07:26.686 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:26.686 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.686 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.686 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:26.686 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996078+0000", 2024-04-18T21:07:26.686 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.046e-06 2024-04-18T21:07:26.686 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.686 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.686 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:26.687 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996083+0000", 2024-04-18T21:07:26.687 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3630000000000002e-06 2024-04-18T21:07:26.687 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.687 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.687 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:26.687 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996100+0000", 2024-04-18T21:07:26.687 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7214000000000002e-05 2024-04-18T21:07:26.687 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.687 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.687 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:26.687 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996114+0000", 2024-04-18T21:07:26.687 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3713000000000001e-05 2024-04-18T21:07:26.687 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.688 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.688 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:26.688 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.045254+0000", 2024-04-18T21:07:26.688 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.049140085 2024-04-18T21:07:26.688 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.688 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.688 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:26.688 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.045399+0000", 2024-04-18T21:07:26.688 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014537 2024-04-18T21:07:26.688 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.688 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.688 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:26.688 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.058002+0000", 2024-04-18T21:07:26.688 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.012602393999999999 2024-04-18T21:07:26.689 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:26.689 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:26.689 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:26.689 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.689 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.689 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:20060 4.2b 4:d4621505:::1000000016c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-18T21:07:26.689 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:25.996311+0000", 2024-04-18T21:07:26.689 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.632654257, 2024-04-18T21:07:26.689 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.065642542999999998, 2024-04-18T21:07:26.689 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:26.689 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:26.689 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:07:26.690 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:26.690 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.690 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:26.690 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996311+0000", 2024-04-18T21:07:26.690 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:26.690 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.690 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.690 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:26.690 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996311+0000", 2024-04-18T21:07:26.690 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:26.690 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.690 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.690 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:26.690 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996313+0000", 2024-04-18T21:07:26.691 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.86e-06 2024-04-18T21:07:26.691 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.691 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.691 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:26.691 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996319+0000", 2024-04-18T21:07:26.691 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.9499999999999998e-06 2024-04-18T21:07:26.691 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.691 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.691 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:26.691 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996340+0000", 2024-04-18T21:07:26.691 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1866e-05 2024-04-18T21:07:26.691 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.691 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.692 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:26.692 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996359+0000", 2024-04-18T21:07:26.692 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8502999999999999e-05 2024-04-18T21:07:26.692 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.692 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.692 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:26.692 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.027528+0000", 2024-04-18T21:07:26.692 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.031168992999999999 2024-04-18T21:07:26.692 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.692 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.692 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:26.692 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.027857+0000", 2024-04-18T21:07:26.692 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00032939200000000002 2024-04-18T21:07:26.692 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.692 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.693 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:26.693 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.061953+0000", 2024-04-18T21:07:26.693 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.034095978999999998 2024-04-18T21:07:26.693 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:26.693 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:26.693 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:26.693 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.693 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.693 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:20072 4.1b 4:d83df968:::10000000178.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-18T21:07:26.693 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:25.996492+0000", 2024-04-18T21:07:26.693 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.63247303799999999, 2024-04-18T21:07:26.693 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.065580346999999997, 2024-04-18T21:07:26.693 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:26.694 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:26.694 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:07:26.694 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:26.694 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.694 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:26.694 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996492+0000", 2024-04-18T21:07:26.694 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:26.694 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.694 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.694 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:26.694 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996492+0000", 2024-04-18T21:07:26.694 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:26.694 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.694 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.694 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:26.695 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996493+0000", 2024-04-18T21:07:26.695 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0130000000000001e-06 2024-04-18T21:07:26.695 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.695 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.695 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:26.695 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996498+0000", 2024-04-18T21:07:26.695 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.7400000000000004e-06 2024-04-18T21:07:26.695 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.695 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.695 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:26.695 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996514+0000", 2024-04-18T21:07:26.695 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6626e-05 2024-04-18T21:07:26.695 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.696 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.696 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:26.696 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996527+0000", 2024-04-18T21:07:26.696 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.289e-05 2024-04-18T21:07:26.696 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.696 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.696 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:26.696 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.028896+0000", 2024-04-18T21:07:26.696 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.032368848999999998 2024-04-18T21:07:26.696 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.696 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.696 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:26.696 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.029266+0000", 2024-04-18T21:07:26.696 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00036995799999999998 2024-04-18T21:07:26.696 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.696 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.697 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:26.697 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.062072+0000", 2024-04-18T21:07:26.697 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.032806270999999998 2024-04-18T21:07:26.697 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:26.697 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:26.697 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:26.697 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.697 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.697 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:20085 4.2b 4:d44b7594:::10000000185.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-18T21:07:26.697 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:25.996650+0000", 2024-04-18T21:07:26.697 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.63231499800000002, 2024-04-18T21:07:26.697 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.065498801999999995, 2024-04-18T21:07:26.697 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:26.697 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:26.698 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:07:26.698 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:26.698 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.698 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:26.698 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996650+0000", 2024-04-18T21:07:26.698 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:26.698 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.698 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.698 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:26.698 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996650+0000", 2024-04-18T21:07:26.698 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:26.698 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.698 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.698 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:26.699 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996651+0000", 2024-04-18T21:07:26.699 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.2600000000000001e-07 2024-04-18T21:07:26.699 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.699 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.699 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:26.699 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996656+0000", 2024-04-18T21:07:26.699 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4299999999999997e-06 2024-04-18T21:07:26.699 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.699 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.699 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:26.699 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996673+0000", 2024-04-18T21:07:26.699 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6520000000000001e-05 2024-04-18T21:07:26.699 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.699 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.700 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:26.700 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996689+0000", 2024-04-18T21:07:26.700 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5676e-05 2024-04-18T21:07:26.700 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.700 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.700 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:26.700 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.030380+0000", 2024-04-18T21:07:26.700 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.033691929000000002 2024-04-18T21:07:26.700 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.700 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.700 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:26.700 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.030753+0000", 2024-04-18T21:07:26.700 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00037218199999999998 2024-04-18T21:07:26.700 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.701 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.701 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:26.701 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.062149+0000", 2024-04-18T21:07:26.701 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.031396139000000003 2024-04-18T21:07:26.701 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:26.701 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:26.701 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:26.701 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.701 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.701 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:20086 4.1b 4:dac0322e:::10000000186.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-18T21:07:26.701 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:25.996705+0000", 2024-04-18T21:07:26.701 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.63225962000000002, 2024-04-18T21:07:26.701 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.065715934000000004, 2024-04-18T21:07:26.701 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:26.701 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:26.702 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:07:26.702 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:26.702 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.702 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:26.702 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996705+0000", 2024-04-18T21:07:26.702 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:26.702 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.702 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.702 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:26.702 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996705+0000", 2024-04-18T21:07:26.702 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:26.702 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.703 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.703 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:26.703 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996706+0000", 2024-04-18T21:07:26.703 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.7699999999999992e-07 2024-04-18T21:07:26.703 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.703 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.703 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:26.703 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996711+0000", 2024-04-18T21:07:26.703 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.1460000000000004e-06 2024-04-18T21:07:26.703 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.703 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.703 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:26.703 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996728+0000", 2024-04-18T21:07:26.703 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.626e-05 2024-04-18T21:07:26.704 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.704 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.704 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:26.704 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996740+0000", 2024-04-18T21:07:26.704 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2343e-05 2024-04-18T21:07:26.704 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.704 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.704 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:26.704 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.042837+0000", 2024-04-18T21:07:26.704 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.046096454000000002 2024-04-18T21:07:26.704 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.704 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.704 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:26.704 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.045179+0000", 2024-04-18T21:07:26.705 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0023421560000000002 2024-04-18T21:07:26.705 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.705 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.705 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:26.705 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.062421+0000", 2024-04-18T21:07:26.705 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017242598000000001 2024-04-18T21:07:26.705 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:26.705 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:26.705 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:26.705 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.705 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.705 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:20101 4.1b 4:d8c655bc:::10000000195.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-18T21:07:26.705 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:25.998732+0000", 2024-04-18T21:07:26.705 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.630233178, 2024-04-18T21:07:26.706 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.063840712999999993, 2024-04-18T21:07:26.706 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:26.706 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:26.706 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:07:26.706 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:26.706 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.706 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:26.706 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.998732+0000", 2024-04-18T21:07:26.706 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:26.706 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.706 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.706 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:26.706 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.998732+0000", 2024-04-18T21:07:26.706 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:26.707 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.707 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.707 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:26.707 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.998734+0000", 2024-04-18T21:07:26.707 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1100000000000001e-06 2024-04-18T21:07:26.707 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.707 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.707 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:26.707 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.998743+0000", 2024-04-18T21:07:26.707 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.1430000000000004e-06 2024-04-18T21:07:26.707 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.707 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.707 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:26.707 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.998770+0000", 2024-04-18T21:07:26.707 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7387000000000001e-05 2024-04-18T21:07:26.708 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.708 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.708 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:26.708 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.998789+0000", 2024-04-18T21:07:26.708 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8932000000000001e-05 2024-04-18T21:07:26.708 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.708 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.708 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:26.708 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.045985+0000", 2024-04-18T21:07:26.708 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.047195537000000003 2024-04-18T21:07:26.708 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.708 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.708 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:26.709 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.046184+0000", 2024-04-18T21:07:26.709 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019923200000000001 2024-04-18T21:07:26.709 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.709 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.709 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:26.709 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.062573+0000", 2024-04-18T21:07:26.709 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016388371999999998 2024-04-18T21:07:26.709 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:26.709 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:26.709 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:26.709 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.709 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.709 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:20104 4.30 4:0cac0e23:::10000000198.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-18T21:07:26.710 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:25.998873+0000", 2024-04-18T21:07:26.710 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.63009160099999995, 2024-04-18T21:07:26.710 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.062446901999999999, 2024-04-18T21:07:26.710 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:26.710 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:26.710 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:07:26.710 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:26.710 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.710 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:26.710 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.998873+0000", 2024-04-18T21:07:26.710 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:26.710 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.710 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.710 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:26.710 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.998873+0000", 2024-04-18T21:07:26.711 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:26.711 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.711 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.711 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:26.711 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.998874+0000", 2024-04-18T21:07:26.711 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:07:26.711 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.711 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.711 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:26.711 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.998879+0000", 2024-04-18T21:07:26.711 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.9830000000000004e-06 2024-04-18T21:07:26.711 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.711 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.711 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:26.711 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.998896+0000", 2024-04-18T21:07:26.712 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6897000000000001e-05 2024-04-18T21:07:26.712 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.712 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.712 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:26.712 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.998909+0000", 2024-04-18T21:07:26.712 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2992e-05 2024-04-18T21:07:26.712 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.712 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.712 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:26.712 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.025919+0000", 2024-04-18T21:07:26.712 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.027009960999999999 2024-04-18T21:07:26.712 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.712 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.712 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:26.712 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.027905+0000", 2024-04-18T21:07:26.713 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0019858639999999999 2024-04-18T21:07:26.713 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.713 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.713 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:26.713 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.061320+0000", 2024-04-18T21:07:26.713 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.033415245000000003 2024-04-18T21:07:26.713 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:26.713 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:26.713 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:26.713 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.713 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.713 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:20117 4.2b 4:d55466b4:::100000001a5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-18T21:07:26.713 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:25.999086+0000", 2024-04-18T21:07:26.713 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.62987897999999998, 2024-04-18T21:07:26.713 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.063616064999999999, 2024-04-18T21:07:26.713 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:26.714 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:26.714 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:07:26.714 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:26.714 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.714 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:26.714 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.999086+0000", 2024-04-18T21:07:26.714 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:26.714 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.714 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.714 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:26.714 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.999086+0000", 2024-04-18T21:07:26.714 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:26.714 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.714 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.715 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:26.715 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.999087+0000", 2024-04-18T21:07:26.715 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.540000000000001e-07 2024-04-18T21:07:26.715 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.715 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.715 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:26.715 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.999092+0000", 2024-04-18T21:07:26.715 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.31e-06 2024-04-18T21:07:26.715 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.715 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.715 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:26.715 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.999109+0000", 2024-04-18T21:07:26.715 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7178999999999999e-05 2024-04-18T21:07:26.715 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.715 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.715 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:26.716 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.999123+0000", 2024-04-18T21:07:26.716 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3203e-05 2024-04-18T21:07:26.716 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.716 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.716 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:26.716 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.045971+0000", 2024-04-18T21:07:26.716 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.046848771999999997 2024-04-18T21:07:26.716 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.716 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.716 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:26.716 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.046266+0000", 2024-04-18T21:07:26.716 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00029410800000000001 2024-04-18T21:07:26.716 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.716 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.716 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:26.716 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.062702+0000", 2024-04-18T21:07:26.717 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016436539 2024-04-18T21:07:26.717 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:26.717 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:26.717 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:26.717 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.717 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.717 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:20179 4.1b 4:da67b4c4:::100000001e3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-18T21:07:26.717 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:26.000403+0000", 2024-04-18T21:07:26.717 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.62856203700000002, 2024-04-18T21:07:26.717 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.062388916000000003, 2024-04-18T21:07:26.717 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:26.717 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:26.717 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:07:26.717 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:26.717 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.717 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:26.718 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.000403+0000", 2024-04-18T21:07:26.718 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:26.718 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.718 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.718 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:26.718 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.000403+0000", 2024-04-18T21:07:26.718 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:26.718 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.718 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.718 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:26.718 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.000404+0000", 2024-04-18T21:07:26.718 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.5300000000000002e-07 2024-04-18T21:07:26.718 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.718 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.718 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:26.718 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.000409+0000", 2024-04-18T21:07:26.719 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.7759999999999997e-06 2024-04-18T21:07:26.719 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.719 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.719 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:26.719 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.000428+0000", 2024-04-18T21:07:26.719 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8980000000000001e-05 2024-04-18T21:07:26.719 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.719 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.719 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:26.719 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.000442+0000", 2024-04-18T21:07:26.719 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3903000000000001e-05 2024-04-18T21:07:26.719 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.719 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.719 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:26.719 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.046711+0000", 2024-04-18T21:07:26.720 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.046269498999999999 2024-04-18T21:07:26.720 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.720 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.720 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:26.720 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.046860+0000", 2024-04-18T21:07:26.720 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014919400000000001 2024-04-18T21:07:26.720 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.720 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.720 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:26.720 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.062792+0000", 2024-04-18T21:07:26.720 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.015931610999999998 2024-04-18T21:07:26.720 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:26.720 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:26.720 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:26.720 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.720 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.721 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:20185 4.30 4:0def042e:::100000001e9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-18T21:07:26.721 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:26.001040+0000", 2024-04-18T21:07:26.721 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 0.62792523300000003, 2024-04-18T21:07:26.721 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.060583056000000003, 2024-04-18T21:07:26.721 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:26.721 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:26.721 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:07:26.721 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:26.721 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.721 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:26.721 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.001040+0000", 2024-04-18T21:07:26.721 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:26.721 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.721 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.721 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:26.722 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.001040+0000", 2024-04-18T21:07:26.722 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:26.722 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.722 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.722 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:26.722 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.001041+0000", 2024-04-18T21:07:26.722 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4100000000000001e-06 2024-04-18T21:07:26.722 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.722 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.722 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:26.722 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.001048+0000", 2024-04-18T21:07:26.722 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.2359999999999998e-06 2024-04-18T21:07:26.722 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.722 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.723 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:26.723 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.006248+0000", 2024-04-18T21:07:26.723 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0051992449999999999 2024-04-18T21:07:26.723 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.723 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.723 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:26.723 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.006274+0000", 2024-04-18T21:07:26.723 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.6696e-05 2024-04-18T21:07:26.723 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.723 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.723 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:26.723 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.032224+0000", 2024-04-18T21:07:26.724 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.025949403999999999 2024-04-18T21:07:26.724 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.724 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.724 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:26.724 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.032533+0000", 2024-04-18T21:07:26.724 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00030930999999999998 2024-04-18T21:07:26.724 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:26.724 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:26.724 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:26.724 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.061623+0000", 2024-04-18T21:07:26.725 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.029089754999999998 2024-04-18T21:07:26.725 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:26.725 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:26.725 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:26.725 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:26.725 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:26.725 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:07:26.726 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:07:26.727 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:26.725+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:26.771 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:07:26.771 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:07:26.771 INFO:teuthology.orchestra.run.smithi078.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-18T21:07:26.790 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:07:26.790 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:07:26.795 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-18T21:07:26.795 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-18T21:07:26.827 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:26.829+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:26.858 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:26.858 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:26.872 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:07:26.928 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:26.926+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:26.993 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:26.993 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:27.007 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:27.016 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2024-04-18T21:07:27.016 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-18T21:07:27.016 INFO:tasks.thrashosds.thrasher:Reviving osd 1 2024-04-18T21:07:27.017 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.1 doing powercycle of ubuntu@smithi150.front.sepia.ceph.com 2024-04-18T21:07:27.017 INFO:teuthology.orchestra.console.smithi150:Power on 2024-04-18T21:07:27.017 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-18T21:07:27.030 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:27.029+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:27.043 DEBUG:teuthology.orchestra.console.smithi150:power on output: Chassis Power Control: Up/On 2024-04-18T21:07:27.044 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T21:07:27.067 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off 2024-04-18T21:07:27.132 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:27.133+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:27.178 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:27.178 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:27.192 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:07:27.233 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:27.234+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:27.323 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:27.323 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:27.334 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:27.334+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:27.337 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:07:27.435 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:27.437+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:27.458 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:27.458 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:27.473 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:07:27.500 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-18T21:07:27.536 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:27.534+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:27.636 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:27.637+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:27.637 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:27.637 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:27.651 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:07:27.737 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:27.737+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:27.782 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:27.782 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:27.796 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:07:27.841 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:27.842+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:27.911 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:27.911 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:27.925 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:27.939 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:27.941+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:28.040 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:28.038+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:28.092 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:28.092 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:28.106 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:07:28.151 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:28.153+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:28.237 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:28.238 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:28.241 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:28.242+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:28.251 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:07:28.342 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:28.341+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:28.418 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:28.418 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:28.433 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:07:28.442 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:28.442+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:28.505 INFO:teuthology.orchestra.run.smithi078.stderr:noscrub is unset 2024-04-18T21:07:28.543 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:28.546+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:28.598 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:28.598 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:28.613 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:07:28.657 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:28.658+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:28.742 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:28.742 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:28.745 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:28.745+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:28.756 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:07:28.796 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-18T21:07:28.845 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:28.845+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:28.921 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:28.921 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:28.935 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:28.951 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:07:28.951 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:07:28.952 INFO:teuthology.orchestra.run.smithi078.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-18T21:07:28.969 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:07:28.969 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:07:28.974 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-18T21:07:28.975 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-18T21:07:28.981 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:28.982+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:29.046 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:29.049+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:29.056 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:07:29.056 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-18T21:07:29.056 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-18T21:07:29.056 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:07:29.056 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.056 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:12689 4.26 4:64a7f444:::100000033e5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:29.056 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:00.208067+0000", 2024-04-18T21:07:29.056 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 28.846465989999999, 2024-04-18T21:07:29.056 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066681457, 2024-04-18T21:07:29.057 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:29.057 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:29.057 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:29.057 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:07:29.057 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:07:29.057 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:29.057 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 12689 2024-04-18T21:07:29.057 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.057 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:29.057 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.057 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:29.057 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.208067+0000", 2024-04-18T21:07:29.057 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:29.057 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.058 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.058 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:29.058 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.208067+0000", 2024-04-18T21:07:29.058 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:29.058 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.058 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.058 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:29.058 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.208069+0000", 2024-04-18T21:07:29.058 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1500000000000002e-06 2024-04-18T21:07:29.058 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.058 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.058 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:29.058 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216162+0000", 2024-04-18T21:07:29.058 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0080933159999999997 2024-04-18T21:07:29.058 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.059 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.059 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:29.059 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216181+0000", 2024-04-18T21:07:29.059 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8573e-05 2024-04-18T21:07:29.059 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.059 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.059 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.059 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216192+0000", 2024-04-18T21:07:29.059 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0767999999999999e-05 2024-04-18T21:07:29.059 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.059 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.059 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:29.059 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216259+0000", 2024-04-18T21:07:29.059 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7977000000000003e-05 2024-04-18T21:07:29.060 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.060 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.060 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:29.060 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216635+0000", 2024-04-18T21:07:29.060 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00037591300000000002 2024-04-18T21:07:29.060 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.060 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.060 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:29.060 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216929+0000", 2024-04-18T21:07:29.060 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00029314800000000002 2024-04-18T21:07:29.060 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.060 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.060 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:29.060 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.232918+0000", 2024-04-18T21:07:29.060 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015989903 2024-04-18T21:07:29.061 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.061 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.061 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:29.061 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.274643+0000", 2024-04-18T21:07:29.061 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.041724281000000002 2024-04-18T21:07:29.061 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.061 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.061 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:29.061 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.274701+0000", 2024-04-18T21:07:29.061 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8304999999999998e-05 2024-04-18T21:07:29.061 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.061 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.061 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:29.062 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.274748+0000", 2024-04-18T21:07:29.062 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7123000000000003e-05 2024-04-18T21:07:29.062 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:29.062 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:29.062 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:29.062 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.062 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.062 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:7694 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-18T21:07:29.062 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:11.672522+0000", 2024-04-18T21:07:29.062 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 17.382010950000002, 2024-04-18T21:07:29.062 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2954970370000001, 2024-04-18T21:07:29.062 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:29.062 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:29.063 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:29.063 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:29.063 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.063 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:29.063 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672522+0000", 2024-04-18T21:07:29.063 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:29.063 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.063 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.063 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:29.063 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672522+0000", 2024-04-18T21:07:29.063 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:29.063 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.063 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.063 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:29.064 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672525+0000", 2024-04-18T21:07:29.064 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.366e-06 2024-04-18T21:07:29.064 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.064 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.064 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:29.064 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672540+0000", 2024-04-18T21:07:29.064 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4949999999999999e-05 2024-04-18T21:07:29.064 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.064 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.064 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:29.064 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672569+0000", 2024-04-18T21:07:29.064 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8714999999999999e-05 2024-04-18T21:07:29.064 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.064 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.065 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.065 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672581+0000", 2024-04-18T21:07:29.065 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1949e-05 2024-04-18T21:07:29.065 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.065 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.065 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:29.065 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672704+0000", 2024-04-18T21:07:29.065 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000122915 2024-04-18T21:07:29.065 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.065 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.065 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:29.065 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672714+0000", 2024-04-18T21:07:29.065 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0698e-05 2024-04-18T21:07:29.065 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.066 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.066 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:29.066 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.910993+0000", 2024-04-18T21:07:29.066 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.23827911199999999 2024-04-18T21:07:29.066 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.066 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.066 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:29.066 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.911017+0000", 2024-04-18T21:07:29.066 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3419999999999999e-05 2024-04-18T21:07:29.066 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.066 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.066 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:29.066 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.952146+0000", 2024-04-18T21:07:29.067 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0411288869999999 2024-04-18T21:07:29.067 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.067 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.067 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:29.067 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.952467+0000", 2024-04-18T21:07:29.067 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00032165399999999999 2024-04-18T21:07:29.067 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.067 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.067 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:29.067 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.954086+0000", 2024-04-18T21:07:29.067 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0016184820000000001 2024-04-18T21:07:29.067 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.067 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.067 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:29.068 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.960573+0000", 2024-04-18T21:07:29.068 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064874240000000003 2024-04-18T21:07:29.068 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.068 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.068 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:29.068 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.967786+0000", 2024-04-18T21:07:29.068 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0072125069999999999 2024-04-18T21:07:29.068 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.068 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.068 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:29.068 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.967897+0000", 2024-04-18T21:07:29.068 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111679 2024-04-18T21:07:29.069 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.069 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.069 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:29.069 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.968019+0000", 2024-04-18T21:07:29.069 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000121279 2024-04-18T21:07:29.069 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:29.069 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:29.069 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:29.069 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.069 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.069 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:7696 3.f 3:f376ae95:::200.00000016:head [write 3681546~512758 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:29.069 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:12.760706+0000", 2024-04-18T21:07:29.069 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 16.293826547999998, 2024-04-18T21:07:29.070 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.24998282899999999, 2024-04-18T21:07:29.070 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:29.070 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:29.070 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:29.070 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:29.070 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.070 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:29.070 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.760706+0000", 2024-04-18T21:07:29.070 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:29.070 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.070 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.070 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:29.070 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.760706+0000", 2024-04-18T21:07:29.071 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:29.071 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.071 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.071 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:29.071 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.760710+0000", 2024-04-18T21:07:29.071 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2100000000000003e-06 2024-04-18T21:07:29.071 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.071 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.071 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:29.071 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.761972+0000", 2024-04-18T21:07:29.071 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0012615689999999999 2024-04-18T21:07:29.071 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.071 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.071 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:29.072 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762012+0000", 2024-04-18T21:07:29.072 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0145999999999998e-05 2024-04-18T21:07:29.072 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.072 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.072 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.072 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762030+0000", 2024-04-18T21:07:29.072 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8312999999999999e-05 2024-04-18T21:07:29.072 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.072 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.072 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:29.072 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762158+0000", 2024-04-18T21:07:29.072 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012805600000000001 2024-04-18T21:07:29.072 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.072 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.072 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:29.073 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762174+0000", 2024-04-18T21:07:29.073 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5645999999999999e-05 2024-04-18T21:07:29.073 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.073 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.073 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:29.073 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.926080+0000", 2024-04-18T21:07:29.073 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.16390581900000001 2024-04-18T21:07:29.073 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.073 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.073 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for missing object", 2024-04-18T21:07:29.073 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.926149+0000", 2024-04-18T21:07:29.073 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9172999999999997e-05 2024-04-18T21:07:29.073 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.073 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.073 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:29.073 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.002156+0000", 2024-04-18T21:07:29.074 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.076006972000000006 2024-04-18T21:07:29.074 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.074 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.074 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for rw locks", 2024-04-18T21:07:29.074 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.002294+0000", 2024-04-18T21:07:29.074 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000138011 2024-04-18T21:07:29.074 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.074 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.074 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:29.074 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.005436+0000", 2024-04-18T21:07:29.074 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031422749999999999 2024-04-18T21:07:29.074 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.074 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.074 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:29.074 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.005577+0000", 2024-04-18T21:07:29.075 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014105399999999999 2024-04-18T21:07:29.075 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.075 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.075 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:29.075 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.005725+0000", 2024-04-18T21:07:29.075 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014721100000000001 2024-04-18T21:07:29.075 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.075 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.075 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:29.075 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.009143+0000", 2024-04-18T21:07:29.075 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0034179380000000001 2024-04-18T21:07:29.075 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.075 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.075 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:29.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.010522+0000", 2024-04-18T21:07:29.076 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0013790919999999999 2024-04-18T21:07:29.076 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.076 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.076 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:29.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.010586+0000", 2024-04-18T21:07:29.076 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4713000000000002e-05 2024-04-18T21:07:29.076 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.076 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.076 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:29.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.010689+0000", 2024-04-18T21:07:29.076 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000102631 2024-04-18T21:07:29.076 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:29.076 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:29.076 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:29.076 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.077 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.077 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:7697 3.16 3:6b6b4f13:::200.0000001c:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:29.077 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:12.762074+0000", 2024-04-18T21:07:29.077 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 16.292458400000001, 2024-04-18T21:07:29.077 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.2056489, 2024-04-18T21:07:29.077 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:29.077 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:29.077 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:07:29.077 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:29.077 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.077 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:29.077 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762074+0000", 2024-04-18T21:07:29.077 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:29.077 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.077 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.077 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:29.078 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762074+0000", 2024-04-18T21:07:29.078 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:29.078 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.078 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.078 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:29.078 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762076+0000", 2024-04-18T21:07:29.078 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.793e-06 2024-04-18T21:07:29.078 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.078 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.078 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:29.078 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762083+0000", 2024-04-18T21:07:29.078 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7129999999999999e-06 2024-04-18T21:07:29.078 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.078 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.078 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:29.079 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762104+0000", 2024-04-18T21:07:29.079 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1480000000000001e-05 2024-04-18T21:07:29.079 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.079 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.079 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.079 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762121+0000", 2024-04-18T21:07:29.079 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.632e-05 2024-04-18T21:07:29.079 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.079 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.079 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:29.079 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762224+0000", 2024-04-18T21:07:29.079 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010346800000000001 2024-04-18T21:07:29.079 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.079 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.080 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:29.080 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762238+0000", 2024-04-18T21:07:29.080 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3482999999999999e-05 2024-04-18T21:07:29.080 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.080 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.080 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:29.080 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.946932+0000", 2024-04-18T21:07:29.080 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.18469451000000001 2024-04-18T21:07:29.080 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.080 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.080 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:29.080 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.947261+0000", 2024-04-18T21:07:29.080 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00032857399999999999 2024-04-18T21:07:29.080 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.081 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.081 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:29.081 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.967723+0000", 2024-04-18T21:07:29.081 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020462559000000002 2024-04-18T21:07:29.081 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:29.081 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:29.081 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:29.081 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.081 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.081 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:10831 4.13 4:c948684f:::1000000032e.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:29.081 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.823266+0000", 2024-04-18T21:07:29.081 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.231267011, 2024-04-18T21:07:29.081 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.65275881599999996, 2024-04-18T21:07:29.081 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:29.081 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:29.082 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:29.082 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:29.082 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.082 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:29.082 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823266+0000", 2024-04-18T21:07:29.082 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:29.082 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.082 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.082 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:29.082 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823266+0000", 2024-04-18T21:07:29.082 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:29.082 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.082 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.083 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:29.083 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823266+0000", 2024-04-18T21:07:29.083 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9800000000000004e-07 2024-04-18T21:07:29.083 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.083 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.083 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:29.083 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823269+0000", 2024-04-18T21:07:29.083 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3259999999999998e-06 2024-04-18T21:07:29.083 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.083 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.083 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:29.083 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823274+0000", 2024-04-18T21:07:29.083 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9830000000000001e-06 2024-04-18T21:07:29.083 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.083 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.084 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.084 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823280+0000", 2024-04-18T21:07:29.084 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1540000000000001e-06 2024-04-18T21:07:29.084 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.084 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.084 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:29.084 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823313+0000", 2024-04-18T21:07:29.084 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3667000000000001e-05 2024-04-18T21:07:29.084 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.084 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.084 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:29.084 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823321+0000", 2024-04-18T21:07:29.084 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1200000000000002e-06 2024-04-18T21:07:29.084 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.084 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.084 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:29.085 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.470069+0000", 2024-04-18T21:07:29.085 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.64674728999999997 2024-04-18T21:07:29.085 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.085 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.085 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:29.085 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.470457+0000", 2024-04-18T21:07:29.085 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00038800899999999998 2024-04-18T21:07:29.085 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.085 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.085 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:29.085 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.470755+0000", 2024-04-18T21:07:29.085 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00029781399999999998 2024-04-18T21:07:29.085 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.085 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.085 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:29.085 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.474041+0000", 2024-04-18T21:07:29.086 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032860670000000002 2024-04-18T21:07:29.086 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.086 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.086 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:29.086 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.475621+0000", 2024-04-18T21:07:29.086 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001579925 2024-04-18T21:07:29.086 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.086 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.086 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:29.086 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.475750+0000", 2024-04-18T21:07:29.086 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000129002 2024-04-18T21:07:29.086 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.086 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.086 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:29.086 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.476024+0000", 2024-04-18T21:07:29.087 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000274961 2024-04-18T21:07:29.087 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:29.087 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:29.087 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:29.087 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.087 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11326 4.13 4:cbbbc9f0:::100000010c6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:29.087 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.917113+0000", 2024-04-18T21:07:29.087 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.137419809000001, 2024-04-18T21:07:29.087 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.56159817899999998, 2024-04-18T21:07:29.087 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:29.087 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:29.087 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:29.087 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:29.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.087 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:29.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917113+0000", 2024-04-18T21:07:29.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:29.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.088 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:29.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917113+0000", 2024-04-18T21:07:29.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:29.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.088 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:29.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917114+0000", 2024-04-18T21:07:29.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5099999999999999e-07 2024-04-18T21:07:29.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.089 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:29.089 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917123+0000", 2024-04-18T21:07:29.089 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5859999999999994e-06 2024-04-18T21:07:29.089 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.089 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.089 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:29.089 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917130+0000", 2024-04-18T21:07:29.089 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9800000000000001e-06 2024-04-18T21:07:29.089 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.089 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.089 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.089 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917136+0000", 2024-04-18T21:07:29.089 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.502e-06 2024-04-18T21:07:29.089 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.089 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.090 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:29.090 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917239+0000", 2024-04-18T21:07:29.090 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000103286 2024-04-18T21:07:29.090 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.090 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.090 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:29.090 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917247+0000", 2024-04-18T21:07:29.090 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.49e-06 2024-04-18T21:07:29.090 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.090 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.090 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:29.090 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.472462+0000", 2024-04-18T21:07:29.090 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.55521418899999997 2024-04-18T21:07:29.090 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.091 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.091 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:29.091 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.472801+0000", 2024-04-18T21:07:29.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00033935600000000002 2024-04-18T21:07:29.091 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.091 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.091 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:29.091 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.473101+0000", 2024-04-18T21:07:29.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030031399999999998 2024-04-18T21:07:29.091 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.091 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.091 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:29.091 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.475574+0000", 2024-04-18T21:07:29.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0024732310000000002 2024-04-18T21:07:29.092 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.092 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.092 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:29.092 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.478287+0000", 2024-04-18T21:07:29.092 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027122349999999999 2024-04-18T21:07:29.092 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.092 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.092 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:29.092 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.478467+0000", 2024-04-18T21:07:29.092 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000180645 2024-04-18T21:07:29.092 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.092 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.092 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:29.092 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.478711+0000", 2024-04-18T21:07:29.092 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024371399999999999 2024-04-18T21:07:29.093 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:29.093 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:29.093 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:29.093 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.093 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11394 4.13 4:cb2e645e:::10000001109.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:29.093 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.925453+0000", 2024-04-18T21:07:29.093 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.129079286, 2024-04-18T21:07:29.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.55363756900000005, 2024-04-18T21:07:29.093 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:29.093 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:29.093 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:29.093 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:29.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.093 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:29.094 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925453+0000", 2024-04-18T21:07:29.094 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:29.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.094 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:29.094 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925453+0000", 2024-04-18T21:07:29.094 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:29.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.094 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:29.094 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925454+0000", 2024-04-18T21:07:29.094 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1699999999999997e-07 2024-04-18T21:07:29.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.095 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:29.095 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925458+0000", 2024-04-18T21:07:29.095 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7280000000000001e-06 2024-04-18T21:07:29.095 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.095 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.095 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:29.095 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925467+0000", 2024-04-18T21:07:29.095 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7169999999999997e-06 2024-04-18T21:07:29.095 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.095 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.095 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.095 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925474+0000", 2024-04-18T21:07:29.095 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1350000000000003e-06 2024-04-18T21:07:29.095 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.096 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.096 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:29.096 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925523+0000", 2024-04-18T21:07:29.096 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9616000000000001e-05 2024-04-18T21:07:29.096 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.096 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.096 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:29.096 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925530+0000", 2024-04-18T21:07:29.096 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0099999999999998e-06 2024-04-18T21:07:29.096 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.096 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.096 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:29.096 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.474474+0000", 2024-04-18T21:07:29.096 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.548943242 2024-04-18T21:07:29.097 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.097 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.097 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:29.097 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.474692+0000", 2024-04-18T21:07:29.097 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00021829799999999999 2024-04-18T21:07:29.097 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.097 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.097 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:29.097 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.474879+0000", 2024-04-18T21:07:29.097 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000187095 2024-04-18T21:07:29.097 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.097 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.097 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:29.097 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.478733+0000", 2024-04-18T21:07:29.097 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003853871 2024-04-18T21:07:29.098 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.098 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.098 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:29.098 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.478840+0000", 2024-04-18T21:07:29.098 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000106623 2024-04-18T21:07:29.098 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.098 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.098 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:29.098 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.478919+0000", 2024-04-18T21:07:29.098 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9326000000000006e-05 2024-04-18T21:07:29.098 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.098 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.098 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:29.098 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479091+0000", 2024-04-18T21:07:29.098 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000172091 2024-04-18T21:07:29.099 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:29.099 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:29.099 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:29.099 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.099 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.099 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11417 4.13 4:cae4f303:::1000000111f.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:29.099 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.927998+0000", 2024-04-18T21:07:29.099 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.126534646, 2024-04-18T21:07:29.099 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.55142600900000005, 2024-04-18T21:07:29.099 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:29.099 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:29.099 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:29.099 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:29.099 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.099 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:29.100 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.927998+0000", 2024-04-18T21:07:29.100 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:29.100 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.100 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.100 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:29.100 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.927998+0000", 2024-04-18T21:07:29.100 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:29.100 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.100 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.100 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:29.100 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.927999+0000", 2024-04-18T21:07:29.100 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2800000000000005e-07 2024-04-18T21:07:29.100 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.100 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.101 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:29.101 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.928003+0000", 2024-04-18T21:07:29.101 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0060000000000003e-06 2024-04-18T21:07:29.101 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.101 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.101 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:29.101 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.928012+0000", 2024-04-18T21:07:29.101 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.4129999999999995e-06 2024-04-18T21:07:29.101 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.101 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.101 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.101 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.928019+0000", 2024-04-18T21:07:29.101 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5590000000000002e-06 2024-04-18T21:07:29.101 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.101 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.102 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:29.102 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.928075+0000", 2024-04-18T21:07:29.102 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5927000000000002e-05 2024-04-18T21:07:29.102 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.102 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.102 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:29.102 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.928091+0000", 2024-04-18T21:07:29.102 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5724999999999999e-05 2024-04-18T21:07:29.102 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.102 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.102 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:29.102 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.476117+0000", 2024-04-18T21:07:29.102 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.54802609899999999 2024-04-18T21:07:29.102 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.103 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.103 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:29.103 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.476310+0000", 2024-04-18T21:07:29.103 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019318100000000001 2024-04-18T21:07:29.103 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.103 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.103 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:29.103 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.476469+0000", 2024-04-18T21:07:29.103 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015902599999999999 2024-04-18T21:07:29.103 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.103 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.103 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:29.103 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479198+0000", 2024-04-18T21:07:29.103 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027292010000000001 2024-04-18T21:07:29.103 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.104 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.104 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:29.104 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479225+0000", 2024-04-18T21:07:29.104 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6483e-05 2024-04-18T21:07:29.104 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.104 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.104 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:29.104 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479301+0000", 2024-04-18T21:07:29.104 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5935999999999999e-05 2024-04-18T21:07:29.104 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.104 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.104 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:29.104 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479424+0000", 2024-04-18T21:07:29.104 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012352500000000001 2024-04-18T21:07:29.104 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:29.105 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:29.105 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:29.105 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.105 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.105 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11538 4.13 4:ca7a7383:::10000001196.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:29.105 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.942641+0000", 2024-04-18T21:07:29.105 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.111891965, 2024-04-18T21:07:29.105 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.538204715, 2024-04-18T21:07:29.105 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:29.105 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:29.105 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:29.105 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:29.105 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.105 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:29.105 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942641+0000", 2024-04-18T21:07:29.106 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:29.106 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.106 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.106 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:29.106 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942641+0000", 2024-04-18T21:07:29.106 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:29.106 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.106 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.106 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:29.106 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942641+0000", 2024-04-18T21:07:29.106 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4099999999999998e-07 2024-04-18T21:07:29.106 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.106 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.106 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:29.107 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942645+0000", 2024-04-18T21:07:29.107 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.788e-06 2024-04-18T21:07:29.107 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.107 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.107 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:29.107 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942654+0000", 2024-04-18T21:07:29.107 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2089999999999994e-06 2024-04-18T21:07:29.107 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.107 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.107 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.107 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942668+0000", 2024-04-18T21:07:29.107 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3925e-05 2024-04-18T21:07:29.107 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.107 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.107 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:29.108 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942898+0000", 2024-04-18T21:07:29.108 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00022961800000000001 2024-04-18T21:07:29.108 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.108 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.108 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:29.108 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942907+0000", 2024-04-18T21:07:29.108 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6219999999999998e-06 2024-04-18T21:07:29.108 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.108 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.108 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:29.108 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.477120+0000", 2024-04-18T21:07:29.108 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.53421297400000001 2024-04-18T21:07:29.108 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.108 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.108 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:29.109 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.477466+0000", 2024-04-18T21:07:29.109 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00034685899999999998 2024-04-18T21:07:29.109 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.109 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.109 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:29.109 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.477717+0000", 2024-04-18T21:07:29.109 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00025019799999999998 2024-04-18T21:07:29.109 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.109 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.109 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:29.109 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479518+0000", 2024-04-18T21:07:29.109 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00180105 2024-04-18T21:07:29.109 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.109 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.110 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:29.110 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.480481+0000", 2024-04-18T21:07:29.110 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00096356100000000004 2024-04-18T21:07:29.110 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.110 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.110 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:29.110 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.480618+0000", 2024-04-18T21:07:29.110 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013678599999999999 2024-04-18T21:07:29.110 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.110 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.110 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:29.110 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.480845+0000", 2024-04-18T21:07:29.110 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00022738399999999999 2024-04-18T21:07:29.110 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:29.111 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:29.111 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:29.111 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.111 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.111 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11574 4.13 4:c9cea989:::100000011b9.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:29.111 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.947550+0000", 2024-04-18T21:07:29.111 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.106982223999999, 2024-04-18T21:07:29.111 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.53632730500000003, 2024-04-18T21:07:29.111 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:29.111 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:29.111 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:29.111 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:29.111 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.111 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:29.111 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947550+0000", 2024-04-18T21:07:29.112 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:29.112 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.112 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.112 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:29.112 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947550+0000", 2024-04-18T21:07:29.112 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:29.112 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.112 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.112 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:29.112 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947551+0000", 2024-04-18T21:07:29.112 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6599999999999996e-07 2024-04-18T21:07:29.112 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.112 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.112 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:29.112 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947554+0000", 2024-04-18T21:07:29.113 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6230000000000001e-06 2024-04-18T21:07:29.113 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.113 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.113 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:29.113 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947562+0000", 2024-04-18T21:07:29.113 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2179999999999999e-06 2024-04-18T21:07:29.113 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.113 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.113 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.113 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947567+0000", 2024-04-18T21:07:29.113 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3009999999999997e-06 2024-04-18T21:07:29.113 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.113 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.113 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:29.113 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947624+0000", 2024-04-18T21:07:29.114 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6823999999999997e-05 2024-04-18T21:07:29.114 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.114 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.114 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:29.114 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947633+0000", 2024-04-18T21:07:29.114 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9330000000000007e-06 2024-04-18T21:07:29.114 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.114 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.114 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:29.114 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479591+0000", 2024-04-18T21:07:29.114 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.53195765500000003 2024-04-18T21:07:29.114 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.114 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.114 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:29.115 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479781+0000", 2024-04-18T21:07:29.115 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000190034 2024-04-18T21:07:29.115 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.115 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.115 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:29.115 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479936+0000", 2024-04-18T21:07:29.115 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000154959 2024-04-18T21:07:29.115 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.115 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.115 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:29.115 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.483428+0000", 2024-04-18T21:07:29.115 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003492294 2024-04-18T21:07:29.115 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.115 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.115 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:29.116 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.483479+0000", 2024-04-18T21:07:29.116 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0868999999999997e-05 2024-04-18T21:07:29.116 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.116 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.116 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:29.116 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.483594+0000", 2024-04-18T21:07:29.116 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000115499 2024-04-18T21:07:29.116 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.116 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.116 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:29.116 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.483878+0000", 2024-04-18T21:07:29.116 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028352999999999999 2024-04-18T21:07:29.116 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:29.116 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:29.116 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:29.117 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.117 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.117 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11596 4.13 4:c88ce457:::100000011ce.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:29.117 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.955066+0000", 2024-04-18T21:07:29.117 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.099466815, 2024-04-18T21:07:29.117 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.52924763200000002, 2024-04-18T21:07:29.117 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:29.117 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:29.117 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:29.117 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:29.117 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.117 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:29.117 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955066+0000", 2024-04-18T21:07:29.117 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:29.117 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.118 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.118 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:29.118 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955066+0000", 2024-04-18T21:07:29.118 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:29.118 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.118 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.118 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:29.118 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955066+0000", 2024-04-18T21:07:29.118 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4900000000000001e-07 2024-04-18T21:07:29.118 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.118 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.118 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:29.118 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955068+0000", 2024-04-18T21:07:29.118 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0190000000000001e-06 2024-04-18T21:07:29.119 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.119 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.119 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:29.119 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955076+0000", 2024-04-18T21:07:29.119 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.537e-06 2024-04-18T21:07:29.119 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.119 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.119 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.119 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955080+0000", 2024-04-18T21:07:29.119 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1760000000000003e-06 2024-04-18T21:07:29.119 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.119 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.119 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:29.119 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955129+0000", 2024-04-18T21:07:29.119 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8480999999999999e-05 2024-04-18T21:07:29.120 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.120 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.120 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:29.120 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955134+0000", 2024-04-18T21:07:29.120 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1610000000000002e-06 2024-04-18T21:07:29.120 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.120 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.120 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:29.120 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.480932+0000", 2024-04-18T21:07:29.120 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.52579809799999999 2024-04-18T21:07:29.120 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.120 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.120 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:29.120 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.481149+0000", 2024-04-18T21:07:29.121 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00021709100000000001 2024-04-18T21:07:29.121 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.121 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.121 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:29.121 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.481303+0000", 2024-04-18T21:07:29.121 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000153752 2024-04-18T21:07:29.121 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.121 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.121 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:29.121 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.483927+0000", 2024-04-18T21:07:29.121 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026241189999999998 2024-04-18T21:07:29.121 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.121 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.121 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:29.121 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.484028+0000", 2024-04-18T21:07:29.121 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010134899999999999 2024-04-18T21:07:29.122 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.122 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.122 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:29.122 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.484138+0000", 2024-04-18T21:07:29.122 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011015599999999999 2024-04-18T21:07:29.122 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.122 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.122 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:29.122 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.484314+0000", 2024-04-18T21:07:29.122 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017524399999999999 2024-04-18T21:07:29.122 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:29.122 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:29.122 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:29.123 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.123 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.123 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11800 4.13 4:cacc00c7:::10000001296.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:29.123 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.989042+0000", 2024-04-18T21:07:29.123 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.065491146999999, 2024-04-18T21:07:29.123 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.49832004299999999, 2024-04-18T21:07:29.123 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:29.123 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:29.123 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:29.123 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:29.123 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.123 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:29.123 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989042+0000", 2024-04-18T21:07:29.123 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:29.123 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.124 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.124 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:29.124 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989042+0000", 2024-04-18T21:07:29.124 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:29.124 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.124 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.124 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:29.124 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989042+0000", 2024-04-18T21:07:29.124 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5200000000000002e-07 2024-04-18T21:07:29.124 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.124 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.124 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:29.124 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989044+0000", 2024-04-18T21:07:29.124 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2589999999999999e-06 2024-04-18T21:07:29.125 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.125 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.125 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:29.125 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989051+0000", 2024-04-18T21:07:29.125 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6340000000000003e-06 2024-04-18T21:07:29.125 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.125 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.125 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.125 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989062+0000", 2024-04-18T21:07:29.125 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1043000000000001e-05 2024-04-18T21:07:29.125 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.125 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.125 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:29.125 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989367+0000", 2024-04-18T21:07:29.125 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000305249 2024-04-18T21:07:29.126 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.126 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.126 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:29.126 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989376+0000", 2024-04-18T21:07:29.126 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4570000000000005e-06 2024-04-18T21:07:29.126 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.126 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.126 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:29.126 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.482011+0000", 2024-04-18T21:07:29.126 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.49263514200000003 2024-04-18T21:07:29.126 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.126 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.126 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:29.126 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.482397+0000", 2024-04-18T21:07:29.127 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000385986 2024-04-18T21:07:29.127 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.127 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.127 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:29.127 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.482689+0000", 2024-04-18T21:07:29.127 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00029179800000000001 2024-04-18T21:07:29.127 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.127 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.127 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:29.127 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.487008+0000", 2024-04-18T21:07:29.127 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043196129999999999 2024-04-18T21:07:29.127 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.127 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.127 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:29.127 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.487113+0000", 2024-04-18T21:07:29.128 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010498899999999999 2024-04-18T21:07:29.128 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.128 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.128 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:29.128 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.487192+0000", 2024-04-18T21:07:29.128 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8778999999999999e-05 2024-04-18T21:07:29.128 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.128 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.128 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:29.128 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.487362+0000", 2024-04-18T21:07:29.128 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016964200000000001 2024-04-18T21:07:29.128 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:29.128 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:29.128 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:29.128 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.129 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.129 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11888 4.13 4:ca460221:::10000002cd3.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:29.129 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:16.002068+0000", 2024-04-18T21:07:29.129 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.052464487, 2024-04-18T21:07:29.129 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.48938242199999998, 2024-04-18T21:07:29.129 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:29.129 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:29.129 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:29.129 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:29.129 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.129 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:29.129 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002068+0000", 2024-04-18T21:07:29.129 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:29.129 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.129 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.130 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:29.130 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002068+0000", 2024-04-18T21:07:29.130 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:29.130 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.130 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.130 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:29.130 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002069+0000", 2024-04-18T21:07:29.130 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7899999999999999e-07 2024-04-18T21:07:29.130 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.130 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.130 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:29.130 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002071+0000", 2024-04-18T21:07:29.130 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.356e-06 2024-04-18T21:07:29.130 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.131 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.131 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:29.131 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002078+0000", 2024-04-18T21:07:29.131 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.562e-06 2024-04-18T21:07:29.131 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.131 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.131 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.131 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002083+0000", 2024-04-18T21:07:29.131 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1939999999999997e-06 2024-04-18T21:07:29.131 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.131 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.131 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:29.131 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002125+0000", 2024-04-18T21:07:29.131 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2548e-05 2024-04-18T21:07:29.131 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.132 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.132 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:29.132 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002132+0000", 2024-04-18T21:07:29.132 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9360000000000002e-06 2024-04-18T21:07:29.132 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.132 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.132 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:29.132 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.484392+0000", 2024-04-18T21:07:29.132 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.48225933500000001 2024-04-18T21:07:29.132 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.132 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.132 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:29.132 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.484630+0000", 2024-04-18T21:07:29.132 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023872499999999999 2024-04-18T21:07:29.133 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.133 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.133 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:29.133 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.484812+0000", 2024-04-18T21:07:29.133 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000181232 2024-04-18T21:07:29.133 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.133 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.133 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:29.133 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.490995+0000", 2024-04-18T21:07:29.133 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0061831459999999996 2024-04-18T21:07:29.133 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.133 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.133 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:29.133 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491132+0000", 2024-04-18T21:07:29.134 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000137145 2024-04-18T21:07:29.134 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.134 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.134 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:29.134 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491219+0000", 2024-04-18T21:07:29.134 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7466000000000006e-05 2024-04-18T21:07:29.134 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.134 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.134 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:29.134 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491451+0000", 2024-04-18T21:07:29.134 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023129800000000001 2024-04-18T21:07:29.134 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:29.134 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:29.134 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:29.135 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.135 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.135 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:12057 4.13 4:cacbe4c4:::10000002d77.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:29.135 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:16.028144+0000", 2024-04-18T21:07:29.135 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.026388876, 2024-04-18T21:07:29.135 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.46365036100000001, 2024-04-18T21:07:29.135 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:29.135 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:29.135 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:29.135 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:29.135 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.135 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:29.135 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028144+0000", 2024-04-18T21:07:29.135 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:29.135 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.136 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.136 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:29.136 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028144+0000", 2024-04-18T21:07:29.136 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:29.136 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.136 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.136 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:29.136 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028144+0000", 2024-04-18T21:07:29.136 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9800000000000003e-07 2024-04-18T21:07:29.136 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.136 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.136 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:29.136 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028147+0000", 2024-04-18T21:07:29.136 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.773e-06 2024-04-18T21:07:29.137 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.137 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.137 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:29.137 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028154+0000", 2024-04-18T21:07:29.137 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8940000000000004e-06 2024-04-18T21:07:29.137 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.137 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.137 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.137 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028160+0000", 2024-04-18T21:07:29.137 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7219999999999996e-06 2024-04-18T21:07:29.137 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.137 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.137 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:29.137 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028227+0000", 2024-04-18T21:07:29.137 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6711000000000006e-05 2024-04-18T21:07:29.138 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.138 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.138 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:29.138 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028250+0000", 2024-04-18T21:07:29.138 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3010000000000002e-05 2024-04-18T21:07:29.138 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.138 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.138 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:29.138 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.487484+0000", 2024-04-18T21:07:29.138 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.45923466600000001 2024-04-18T21:07:29.138 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.138 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.138 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:29.139 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.487750+0000", 2024-04-18T21:07:29.139 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026618799999999999 2024-04-18T21:07:29.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.139 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.139 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:29.139 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.487915+0000", 2024-04-18T21:07:29.139 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016425500000000001 2024-04-18T21:07:29.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.139 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.139 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:29.139 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491559+0000", 2024-04-18T21:07:29.139 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003644109 2024-04-18T21:07:29.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.139 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.140 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:29.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491586+0000", 2024-04-18T21:07:29.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.743e-05 2024-04-18T21:07:29.140 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.140 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.140 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:29.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491662+0000", 2024-04-18T21:07:29.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5978999999999999e-05 2024-04-18T21:07:29.140 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.140 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.140 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:29.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491794+0000", 2024-04-18T21:07:29.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013202600000000001 2024-04-18T21:07:29.140 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:29.141 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:29.141 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:29.141 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.141 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.141 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:12078 4.13 4:c93107e9:::10000002d8c.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:29.141 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:16.031090+0000", 2024-04-18T21:07:29.141 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.023443009999999, 2024-04-18T21:07:29.141 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.461078355, 2024-04-18T21:07:29.141 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:29.141 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:29.141 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:29.142 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:29.142 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.142 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:29.142 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031090+0000", 2024-04-18T21:07:29.142 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:29.142 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.142 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.142 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:29.142 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031090+0000", 2024-04-18T21:07:29.142 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:29.142 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.142 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.142 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:29.142 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031090+0000", 2024-04-18T21:07:29.142 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6599999999999996e-07 2024-04-18T21:07:29.143 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.143 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:29.143 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031093+0000", 2024-04-18T21:07:29.143 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7659999999999999e-06 2024-04-18T21:07:29.143 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.143 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:29.143 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031099+0000", 2024-04-18T21:07:29.143 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2269999999999998e-06 2024-04-18T21:07:29.143 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.143 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.143 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031103+0000", 2024-04-18T21:07:29.143 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7929999999999999e-06 2024-04-18T21:07:29.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.144 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.144 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:29.144 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031147+0000", 2024-04-18T21:07:29.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3742000000000002e-05 2024-04-18T21:07:29.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.144 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.144 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:29.144 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031154+0000", 2024-04-18T21:07:29.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1999999999999997e-06 2024-04-18T21:07:29.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.144 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.144 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:29.144 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.488743+0000", 2024-04-18T21:07:29.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.45758900200000002 2024-04-18T21:07:29.145 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.145 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:29.145 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.488980+0000", 2024-04-18T21:07:29.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023704499999999999 2024-04-18T21:07:29.145 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.145 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:29.145 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.489166+0000", 2024-04-18T21:07:29.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018544500000000001 2024-04-18T21:07:29.145 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.146 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.146 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:29.146 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491810+0000", 2024-04-18T21:07:29.146 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026448219999999998 2024-04-18T21:07:29.146 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.146 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.146 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:29.146 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491903+0000", 2024-04-18T21:07:29.146 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2305999999999993e-05 2024-04-18T21:07:29.146 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.146 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.146 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:29.146 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491987+0000", 2024-04-18T21:07:29.147 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4581999999999998e-05 2024-04-18T21:07:29.147 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.147 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.147 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:29.147 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.492168+0000", 2024-04-18T21:07:29.147 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018075900000000001 2024-04-18T21:07:29.147 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:29.147 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:29.147 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:29.147 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.147 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.147 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:12081 4.13 4:cafa1dfa:::10000002d8f.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:29.147 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:16.031865+0000", 2024-04-18T21:07:29.147 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.022667975999999, 2024-04-18T21:07:29.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.460588628, 2024-04-18T21:07:29.148 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:29.148 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:29.148 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:29.148 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:29.148 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.148 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:29.148 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031865+0000", 2024-04-18T21:07:29.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:29.148 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.148 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.148 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:29.148 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031865+0000", 2024-04-18T21:07:29.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:29.148 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.149 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.149 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:29.149 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031865+0000", 2024-04-18T21:07:29.149 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4799999999999998e-07 2024-04-18T21:07:29.149 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.149 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.149 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:29.149 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031868+0000", 2024-04-18T21:07:29.149 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6570000000000001e-06 2024-04-18T21:07:29.149 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.149 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.149 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:29.149 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031874+0000", 2024-04-18T21:07:29.149 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4370000000000004e-06 2024-04-18T21:07:29.150 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.150 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.150 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031879+0000", 2024-04-18T21:07:29.150 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8729999999999998e-06 2024-04-18T21:07:29.150 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.150 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:29.150 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031924+0000", 2024-04-18T21:07:29.150 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4314999999999998e-05 2024-04-18T21:07:29.150 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.150 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:29.150 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031929+0000", 2024-04-18T21:07:29.151 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9980000000000003e-06 2024-04-18T21:07:29.151 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.151 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:29.151 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.489813+0000", 2024-04-18T21:07:29.151 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.45788481800000003 2024-04-18T21:07:29.151 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.151 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:29.151 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.490188+0000", 2024-04-18T21:07:29.151 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00037420699999999999 2024-04-18T21:07:29.151 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.151 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:29.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.490423+0000", 2024-04-18T21:07:29.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023582400000000001 2024-04-18T21:07:29.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.152 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:29.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.492238+0000", 2024-04-18T21:07:29.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018143930000000001 2024-04-18T21:07:29.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.152 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:29.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.492256+0000", 2024-04-18T21:07:29.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7706999999999998e-05 2024-04-18T21:07:29.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.152 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:29.153 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.492323+0000", 2024-04-18T21:07:29.153 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7222000000000001e-05 2024-04-18T21:07:29.153 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.153 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.153 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:29.153 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.492453+0000", 2024-04-18T21:07:29.153 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000130529 2024-04-18T21:07:29.153 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:29.153 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:29.153 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:29.153 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.153 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.153 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:19730 4.b 4:d2626379:::10000000022.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-18T21:07:29.153 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:25.986635+0000", 2024-04-18T21:07:29.153 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.0678980830000002, 2024-04-18T21:07:29.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066727102999999996, 2024-04-18T21:07:29.154 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:29.154 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:29.154 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:07:29.154 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:29.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.154 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:29.154 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.986635+0000", 2024-04-18T21:07:29.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:29.154 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.154 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:29.154 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.986635+0000", 2024-04-18T21:07:29.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:29.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:29.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.986636+0000", 2024-04-18T21:07:29.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0729999999999999e-06 2024-04-18T21:07:29.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:29.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.986643+0000", 2024-04-18T21:07:29.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4100000000000002e-06 2024-04-18T21:07:29.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:29.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.986661+0000", 2024-04-18T21:07:29.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7547e-05 2024-04-18T21:07:29.156 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.156 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.156 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.156 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.986674+0000", 2024-04-18T21:07:29.156 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3416e-05 2024-04-18T21:07:29.156 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.156 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.156 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:29.156 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.989521+0000", 2024-04-18T21:07:29.156 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002846964 2024-04-18T21:07:29.156 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.156 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.156 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:29.156 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.989673+0000", 2024-04-18T21:07:29.157 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015206099999999999 2024-04-18T21:07:29.157 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.157 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.157 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:29.157 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:26.053362+0000", 2024-04-18T21:07:29.157 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.063688631999999995 2024-04-18T21:07:29.157 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:29.157 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:29.157 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:29.157 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.157 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.157 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:19778 4.b 4:d30f9a54:::10000000052.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-18T21:07:29.157 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:25.988307+0000", 2024-04-18T21:07:29.157 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.0662252159999999, 2024-04-18T21:07:29.158 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066388437999999994, 2024-04-18T21:07:29.158 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:29.158 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:29.158 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:07:29.158 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:29.158 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.158 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:29.158 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.988307+0000", 2024-04-18T21:07:29.158 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:29.158 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.158 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.158 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:29.158 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.988307+0000", 2024-04-18T21:07:29.158 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:29.159 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.159 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.159 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:29.159 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.988308+0000", 2024-04-18T21:07:29.159 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1600000000000002e-07 2024-04-18T21:07:29.159 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.159 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.159 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:29.159 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.988310+0000", 2024-04-18T21:07:29.159 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5799999999999999e-06 2024-04-18T21:07:29.159 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.159 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.159 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:29.159 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.988319+0000", 2024-04-18T21:07:29.160 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2519999999999999e-06 2024-04-18T21:07:29.160 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.160 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.160 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.160 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.988326+0000", 2024-04-18T21:07:29.160 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0489999999999998e-06 2024-04-18T21:07:29.160 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.160 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.160 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:29.160 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.990151+0000", 2024-04-18T21:07:29.160 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018252940000000001 2024-04-18T21:07:29.160 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.160 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.161 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:29.161 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.990290+0000", 2024-04-18T21:07:29.161 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000138455 2024-04-18T21:07:29.161 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.161 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.161 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:29.161 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:26.054696+0000", 2024-04-18T21:07:29.161 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.064406392000000007 2024-04-18T21:07:29.161 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:29.161 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:29.161 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:29.161 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.161 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.161 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:19779 4.16 4:6a23747e:::10000000053.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-18T21:07:29.161 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:25.988334+0000", 2024-04-18T21:07:29.162 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.0661989680000001, 2024-04-18T21:07:29.162 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.064471757000000005, 2024-04-18T21:07:29.162 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:29.162 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:29.162 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:07:29.162 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:29.162 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.162 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:29.162 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.988334+0000", 2024-04-18T21:07:29.162 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:29.162 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.162 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.162 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:29.163 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.988334+0000", 2024-04-18T21:07:29.163 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:29.163 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.163 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.163 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:29.163 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.988334+0000", 2024-04-18T21:07:29.163 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7599999999999997e-07 2024-04-18T21:07:29.163 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.163 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.163 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:29.163 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.988337+0000", 2024-04-18T21:07:29.163 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3159999999999999e-06 2024-04-18T21:07:29.163 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.163 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.163 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:29.164 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.988345+0000", 2024-04-18T21:07:29.164 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.422e-06 2024-04-18T21:07:29.164 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.164 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.164 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.164 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.988354+0000", 2024-04-18T21:07:29.164 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7960000000000001e-06 2024-04-18T21:07:29.164 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.164 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.164 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:29.164 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:26.037820+0000", 2024-04-18T21:07:29.164 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.049466046999999999 2024-04-18T21:07:29.164 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.164 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.165 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:29.165 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:26.037977+0000", 2024-04-18T21:07:29.165 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015769699999999999 2024-04-18T21:07:29.165 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.165 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.165 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:29.165 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:26.052805+0000", 2024-04-18T21:07:29.165 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014828002999999999 2024-04-18T21:07:29.165 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:29.165 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:29.165 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:29.165 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.165 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.165 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:19830 4.2e 4:74218cdb:::10000000086.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-18T21:07:29.166 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:25.991337+0000", 2024-04-18T21:07:29.166 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.0631960660000002, 2024-04-18T21:07:29.166 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.068113884999999999, 2024-04-18T21:07:29.166 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:29.166 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:29.166 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:07:29.166 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:29.166 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.166 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:29.166 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.991337+0000", 2024-04-18T21:07:29.166 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:29.166 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.166 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.166 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:29.167 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.991337+0000", 2024-04-18T21:07:29.167 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:29.167 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.167 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.167 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:29.167 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.991337+0000", 2024-04-18T21:07:29.167 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7199999999999999e-07 2024-04-18T21:07:29.167 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.167 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.167 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:29.167 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.991339+0000", 2024-04-18T21:07:29.167 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1969999999999999e-06 2024-04-18T21:07:29.167 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.167 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.167 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:29.168 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.991347+0000", 2024-04-18T21:07:29.168 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1610000000000003e-06 2024-04-18T21:07:29.168 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.168 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.168 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.168 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.991355+0000", 2024-04-18T21:07:29.168 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3089999999999998e-06 2024-04-18T21:07:29.168 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.168 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.168 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:29.168 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:26.040335+0000", 2024-04-18T21:07:29.168 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.048980193999999998 2024-04-18T21:07:29.168 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.168 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.168 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:29.169 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:26.040471+0000", 2024-04-18T21:07:29.169 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013571300000000001 2024-04-18T21:07:29.169 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:29.169 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:29.169 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:29.169 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:26.059451+0000", 2024-04-18T21:07:29.169 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018979838999999998 2024-04-18T21:07:29.169 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:29.169 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:29.169 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:29.169 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:29.169 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:29.169 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:07:29.171 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:07:29.171 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:29.173+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:29.272 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:29.270+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:29.301 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:07:29.301 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:07:29.302 INFO:teuthology.orchestra.run.smithi132.stdout: "num_ops": 0 2024-04-18T21:07:29.302 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:07:29.315 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:07:29.373 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:29.374+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:29.436 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:07:29.437 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:07:29.437 INFO:teuthology.orchestra.run.smithi132.stdout: "complaint_time": 30, 2024-04-18T21:07:29.437 INFO:teuthology.orchestra.run.smithi132.stdout: "num_blocked_ops": 0 2024-04-18T21:07:29.437 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:07:29.449 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:07:29.495 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:29.497+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:29.575 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:07:29.575 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 20, 2024-04-18T21:07:29.575 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 600, 2024-04-18T21:07:29.575 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [ 2024-04-18T21:07:29.575 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.575 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:15094 4.c 4:32870457:::10000003692.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-18T21:07:29.576 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:03.107374+0000", 2024-04-18T21:07:29.576 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 26.467737969000002, 2024-04-18T21:07:29.576 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.061575983000000001, 2024-04-18T21:07:29.576 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:29.576 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:29.576 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:29.576 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:29.576 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:29.576 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:29.576 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 15094 2024-04-18T21:07:29.576 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.576 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:29.576 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.576 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:29.577 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.107374+0000", 2024-04-18T21:07:29.577 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:29.577 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.577 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.577 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:29.577 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.107374+0000", 2024-04-18T21:07:29.577 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:29.577 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.577 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.577 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:29.577 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.107376+0000", 2024-04-18T21:07:29.577 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3969999999999999e-06 2024-04-18T21:07:29.577 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.578 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.578 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:29.578 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115698+0000", 2024-04-18T21:07:29.578 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0083223989999999994 2024-04-18T21:07:29.578 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.578 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.578 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:29.578 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115713+0000", 2024-04-18T21:07:29.578 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4385e-05 2024-04-18T21:07:29.578 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.578 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.578 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.578 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115722+0000", 2024-04-18T21:07:29.578 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0759999999999992e-06 2024-04-18T21:07:29.579 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.579 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.579 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:29.579 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115784+0000", 2024-04-18T21:07:29.579 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.2348999999999995e-05 2024-04-18T21:07:29.579 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.579 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.579 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:29.579 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115849+0000", 2024-04-18T21:07:29.579 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.4964999999999999e-05 2024-04-18T21:07:29.579 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.579 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.579 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:29.580 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.116054+0000", 2024-04-18T21:07:29.580 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020483400000000001 2024-04-18T21:07:29.580 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.580 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.580 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:29.580 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.125769+0000", 2024-04-18T21:07:29.580 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0097153340000000008 2024-04-18T21:07:29.580 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.580 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.580 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:29.580 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.168834+0000", 2024-04-18T21:07:29.580 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043064527999999998 2024-04-18T21:07:29.581 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.581 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.581 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:29.581 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.168882+0000", 2024-04-18T21:07:29.581 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.7919e-05 2024-04-18T21:07:29.581 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.581 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.581 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:29.581 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.168950+0000", 2024-04-18T21:07:29.581 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.8796999999999999e-05 2024-04-18T21:07:29.581 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:29.581 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:29.581 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:29.581 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.582 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.582 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7616 4.d 4:b1f7eab6:::10000001d5f.00000000:head [delete] snapc 1=[] RETRY=2 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:29.582 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882522+0000", 2024-04-18T21:07:29.582 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 17.692590076999998, 2024-04-18T21:07:29.582 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.086006255, 2024-04-18T21:07:29.582 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:29.582 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:29.582 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "reached pg", 2024-04-18T21:07:29.582 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:29.582 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.582 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:29.582 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882522+0000", 2024-04-18T21:07:29.582 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:29.582 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.583 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.583 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:29.583 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882522+0000", 2024-04-18T21:07:29.583 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:29.583 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.583 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.583 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:29.583 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882524+0000", 2024-04-18T21:07:29.583 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4720000000000001e-06 2024-04-18T21:07:29.583 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.583 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.583 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:29.583 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882531+0000", 2024-04-18T21:07:29.583 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7830000000000001e-06 2024-04-18T21:07:29.583 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.584 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.584 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:29.584 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882549+0000", 2024-04-18T21:07:29.584 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8765000000000001e-05 2024-04-18T21:07:29.584 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.584 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.584 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.584 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882562+0000", 2024-04-18T21:07:29.584 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3117e-05 2024-04-18T21:07:29.584 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.584 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.584 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:29.584 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882690+0000", 2024-04-18T21:07:29.584 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012794799999999999 2024-04-18T21:07:29.585 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.585 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.585 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op must wait for map", 2024-04-18T21:07:29.585 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882701+0000", 2024-04-18T21:07:29.585 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0215e-05 2024-04-18T21:07:29.585 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.585 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.585 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:29.585 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.891964+0000", 2024-04-18T21:07:29.585 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0092636130000000004 2024-04-18T21:07:29.585 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.585 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.585 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:29.586 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.891976+0000", 2024-04-18T21:07:29.586 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1973e-05 2024-04-18T21:07:29.586 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.586 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.586 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:29.586 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.959520+0000", 2024-04-18T21:07:29.586 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0675436009999999 2024-04-18T21:07:29.586 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.586 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.586 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for missing object", 2024-04-18T21:07:29.586 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.959662+0000", 2024-04-18T21:07:29.586 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014253000000000001 2024-04-18T21:07:29.586 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.586 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.586 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:29.587 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.968480+0000", 2024-04-18T21:07:29.587 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0088178409999999999 2024-04-18T21:07:29.587 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.587 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.587 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:29.587 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.968529+0000", 2024-04-18T21:07:29.587 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8396999999999998e-05 2024-04-18T21:07:29.587 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:29.587 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:29.587 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:29.587 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.587 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.587 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7628 4.31 4:8c97f9cd:::10000001d6c.00000000:head [delete] snapc 1=[] RETRY=2 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:29.587 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882610+0000", 2024-04-18T21:07:29.588 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 17.692502347000001, 2024-04-18T21:07:29.588 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.08538018, 2024-04-18T21:07:29.588 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:29.588 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:29.588 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "reached pg", 2024-04-18T21:07:29.588 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:29.588 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.588 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:29.588 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882610+0000", 2024-04-18T21:07:29.588 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:29.588 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.588 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.588 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:29.588 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882610+0000", 2024-04-18T21:07:29.589 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:29.589 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.589 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.589 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:29.589 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882611+0000", 2024-04-18T21:07:29.589 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.4199999999999995e-07 2024-04-18T21:07:29.589 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.589 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.589 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:29.589 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882614+0000", 2024-04-18T21:07:29.589 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.4300000000000002e-06 2024-04-18T21:07:29.589 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.589 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.590 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:29.590 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882623+0000", 2024-04-18T21:07:29.590 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8740000000000001e-06 2024-04-18T21:07:29.590 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.590 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.590 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.590 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882629+0000", 2024-04-18T21:07:29.590 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.4330000000000001e-06 2024-04-18T21:07:29.590 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.590 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.590 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:29.590 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882706+0000", 2024-04-18T21:07:29.590 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.6280999999999997e-05 2024-04-18T21:07:29.590 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.590 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.591 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op must wait for map", 2024-04-18T21:07:29.591 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882715+0000", 2024-04-18T21:07:29.591 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.1679999999999993e-06 2024-04-18T21:07:29.591 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.591 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.591 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:29.591 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.889481+0000", 2024-04-18T21:07:29.591 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0067656979999999997 2024-04-18T21:07:29.591 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.591 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.591 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:29.591 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.889493+0000", 2024-04-18T21:07:29.591 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2451e-05 2024-04-18T21:07:29.591 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.591 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.592 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:29.592 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.940942+0000", 2024-04-18T21:07:29.592 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0514491720000001 2024-04-18T21:07:29.592 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.592 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.592 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for missing object", 2024-04-18T21:07:29.592 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.941134+0000", 2024-04-18T21:07:29.592 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019150600000000001 2024-04-18T21:07:29.592 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.592 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.592 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:29.592 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.967914+0000", 2024-04-18T21:07:29.592 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026780202999999999 2024-04-18T21:07:29.592 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.592 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.592 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:29.592 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.967990+0000", 2024-04-18T21:07:29.593 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.6322000000000006e-05 2024-04-18T21:07:29.593 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:29.593 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:29.593 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:29.593 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.593 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.593 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7630 4.d 4:b022c802:::10000001d6e.00000000:head [delete] snapc 1=[] RETRY=2 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:29.593 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882645+0000", 2024-04-18T21:07:29.593 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 17.692467062999999, 2024-04-18T21:07:29.593 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0858072780000001, 2024-04-18T21:07:29.593 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:29.593 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:29.593 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "reached pg", 2024-04-18T21:07:29.593 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:29.594 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.594 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:29.594 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882645+0000", 2024-04-18T21:07:29.594 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:29.594 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.594 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.594 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:29.594 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882645+0000", 2024-04-18T21:07:29.594 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:29.594 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.594 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.594 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:29.594 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882646+0000", 2024-04-18T21:07:29.594 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.3599999999999999e-07 2024-04-18T21:07:29.595 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.595 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.595 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:29.595 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882648+0000", 2024-04-18T21:07:29.595 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.5809999999999999e-06 2024-04-18T21:07:29.595 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.595 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.595 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:29.595 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882655+0000", 2024-04-18T21:07:29.595 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7909999999999999e-06 2024-04-18T21:07:29.595 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.595 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.595 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.596 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882661+0000", 2024-04-18T21:07:29.596 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3920000000000002e-06 2024-04-18T21:07:29.596 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.596 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.596 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:29.596 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882825+0000", 2024-04-18T21:07:29.596 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016480100000000001 2024-04-18T21:07:29.596 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.596 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.596 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:07:29.596 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882840+0000", 2024-04-18T21:07:29.596 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4656e-05 2024-04-18T21:07:29.596 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.596 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.596 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:29.596 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.892020+0000", 2024-04-18T21:07:29.597 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0091804680000000007 2024-04-18T21:07:29.597 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.597 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.597 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:29.597 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.892026+0000", 2024-04-18T21:07:29.597 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4580000000000001e-06 2024-04-18T21:07:29.597 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.597 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.597 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:29.597 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.959913+0000", 2024-04-18T21:07:29.597 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.067887289 2024-04-18T21:07:29.597 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.597 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.597 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for missing object", 2024-04-18T21:07:29.597 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.960034+0000", 2024-04-18T21:07:29.598 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000120445 2024-04-18T21:07:29.598 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.598 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.598 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:29.598 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.968407+0000", 2024-04-18T21:07:29.598 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0083734010000000008 2024-04-18T21:07:29.598 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.598 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.598 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:29.598 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.968453+0000", 2024-04-18T21:07:29.598 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.5559999999999997e-05 2024-04-18T21:07:29.598 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:29.598 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:29.598 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:29.599 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.599 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.599 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7651 4.13 4:c9951bc5:::10000001e1b.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:29.599 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882696+0000", 2024-04-18T21:07:29.599 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 17.692416649999998, 2024-04-18T21:07:29.599 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.088382095, 2024-04-18T21:07:29.599 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:29.599 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:29.599 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:29.599 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:29.599 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.599 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:29.599 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882696+0000", 2024-04-18T21:07:29.600 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:29.600 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.600 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.600 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:29.600 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882696+0000", 2024-04-18T21:07:29.600 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:29.600 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.600 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.600 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:29.600 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882696+0000", 2024-04-18T21:07:29.600 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.06e-07 2024-04-18T21:07:29.600 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.600 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.600 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:29.600 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882699+0000", 2024-04-18T21:07:29.601 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.1039999999999998e-06 2024-04-18T21:07:29.601 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.601 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.601 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:29.601 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882707+0000", 2024-04-18T21:07:29.601 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.593e-06 2024-04-18T21:07:29.601 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.601 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.601 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.601 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882712+0000", 2024-04-18T21:07:29.601 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.541e-06 2024-04-18T21:07:29.601 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.601 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.601 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:29.602 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882870+0000", 2024-04-18T21:07:29.602 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000157999 2024-04-18T21:07:29.602 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.602 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.602 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op must wait for map", 2024-04-18T21:07:29.602 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882885+0000", 2024-04-18T21:07:29.602 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4989e-05 2024-04-18T21:07:29.602 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.602 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.602 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:29.602 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.891447+0000", 2024-04-18T21:07:29.602 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0085618540000000007 2024-04-18T21:07:29.602 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.603 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.603 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:29.603 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.891457+0000", 2024-04-18T21:07:29.603 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.6399999999999992e-06 2024-04-18T21:07:29.603 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.603 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.603 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:29.603 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.964840+0000", 2024-04-18T21:07:29.603 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.073383279 2024-04-18T21:07:29.603 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.603 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.603 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:29.603 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.965078+0000", 2024-04-18T21:07:29.603 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000237581 2024-04-18T21:07:29.604 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.604 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.604 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:29.604 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.965299+0000", 2024-04-18T21:07:29.604 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00022087699999999999 2024-04-18T21:07:29.604 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.604 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.604 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:29.604 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.969505+0000", 2024-04-18T21:07:29.604 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.004206123 2024-04-18T21:07:29.604 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.604 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.604 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:29.605 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.970898+0000", 2024-04-18T21:07:29.605 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001393434 2024-04-18T21:07:29.605 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.605 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.605 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:29.605 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.970936+0000", 2024-04-18T21:07:29.605 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.7647000000000001e-05 2024-04-18T21:07:29.605 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.605 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.605 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:29.605 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.971078+0000", 2024-04-18T21:07:29.605 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014192799999999999 2024-04-18T21:07:29.605 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:29.606 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:29.606 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:29.606 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.606 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.606 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7671 4.31 4:8c95a1b7:::10000001e2f.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:29.606 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882728+0000", 2024-04-18T21:07:29.606 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 17.692384815, 2024-04-18T21:07:29.606 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.084467606, 2024-04-18T21:07:29.606 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:29.606 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:29.606 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:29.606 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:29.606 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.607 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:29.607 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882728+0000", 2024-04-18T21:07:29.607 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:29.607 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.607 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.607 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:29.607 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882728+0000", 2024-04-18T21:07:29.607 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:29.607 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.607 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.607 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:29.607 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882728+0000", 2024-04-18T21:07:29.607 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.0399999999999996e-07 2024-04-18T21:07:29.607 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.608 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.608 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:29.608 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882731+0000", 2024-04-18T21:07:29.608 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.5239999999999999e-06 2024-04-18T21:07:29.608 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.608 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.608 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:29.608 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882739+0000", 2024-04-18T21:07:29.608 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4020000000000002e-06 2024-04-18T21:07:29.608 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.608 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.608 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.608 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882744+0000", 2024-04-18T21:07:29.608 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.1410000000000004e-06 2024-04-18T21:07:29.608 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.609 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.609 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:29.609 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882836+0000", 2024-04-18T21:07:29.609 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.2094000000000003e-05 2024-04-18T21:07:29.609 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.609 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.609 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:07:29.609 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882849+0000", 2024-04-18T21:07:29.609 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3087e-05 2024-04-18T21:07:29.609 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.609 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.609 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:29.609 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.889522+0000", 2024-04-18T21:07:29.609 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0066730950000000004 2024-04-18T21:07:29.610 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.610 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.610 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:29.610 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.889530+0000", 2024-04-18T21:07:29.610 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8699999999999992e-06 2024-04-18T21:07:29.610 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.610 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.610 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:29.610 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.941173+0000", 2024-04-18T21:07:29.610 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.051642658 2024-04-18T21:07:29.610 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.610 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.610 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:29.611 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.941392+0000", 2024-04-18T21:07:29.611 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00021854099999999999 2024-04-18T21:07:29.611 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.611 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.611 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:29.611 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.941618+0000", 2024-04-18T21:07:29.611 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0002265 2024-04-18T21:07:29.611 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.611 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.611 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:29.611 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.945390+0000", 2024-04-18T21:07:29.611 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0037723460000000002 2024-04-18T21:07:29.611 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.611 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.611 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:29.612 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.966905+0000", 2024-04-18T21:07:29.612 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021514559999999999 2024-04-18T21:07:29.612 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.612 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.612 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:29.612 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.966972+0000", 2024-04-18T21:07:29.612 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.6740000000000001e-05 2024-04-18T21:07:29.612 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.612 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.612 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:29.612 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.967195+0000", 2024-04-18T21:07:29.612 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000223544 2024-04-18T21:07:29.612 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:29.612 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:29.612 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:29.613 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.613 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.613 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7691 4.d 4:b0345396:::10000001e43.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:29.613 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882753+0000", 2024-04-18T21:07:29.613 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 17.692359836000001, 2024-04-18T21:07:29.613 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.085135618, 2024-04-18T21:07:29.613 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:29.613 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:29.613 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:29.613 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:29.613 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.613 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:29.613 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882753+0000", 2024-04-18T21:07:29.613 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:29.614 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.614 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.614 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:29.614 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882753+0000", 2024-04-18T21:07:29.614 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:29.614 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.614 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.614 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:29.614 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882753+0000", 2024-04-18T21:07:29.614 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.9000000000000002e-07 2024-04-18T21:07:29.614 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.614 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.614 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:29.615 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882755+0000", 2024-04-18T21:07:29.615 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.4040000000000002e-06 2024-04-18T21:07:29.615 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.615 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.615 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:29.615 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882762+0000", 2024-04-18T21:07:29.615 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.6229999999999999e-06 2024-04-18T21:07:29.615 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.615 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.615 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.615 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882769+0000", 2024-04-18T21:07:29.615 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.1559999999999998e-06 2024-04-18T21:07:29.615 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.615 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.615 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:29.616 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882875+0000", 2024-04-18T21:07:29.616 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000105491 2024-04-18T21:07:29.616 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.616 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.616 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:07:29.616 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882879+0000", 2024-04-18T21:07:29.616 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.9999999999999998e-06 2024-04-18T21:07:29.616 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.616 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.616 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:29.616 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.892072+0000", 2024-04-18T21:07:29.616 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0091930989999999997 2024-04-18T21:07:29.616 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.616 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.616 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:29.617 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.892083+0000", 2024-04-18T21:07:29.617 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1070000000000001e-05 2024-04-18T21:07:29.617 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.617 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.617 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:29.617 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.960162+0000", 2024-04-18T21:07:29.617 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0680791869999999 2024-04-18T21:07:29.617 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.617 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.617 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:29.617 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.960314+0000", 2024-04-18T21:07:29.617 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000152139 2024-04-18T21:07:29.617 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.617 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.618 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:29.618 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.960469+0000", 2024-04-18T21:07:29.618 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000154444 2024-04-18T21:07:29.618 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.618 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.618 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:29.618 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.964018+0000", 2024-04-18T21:07:29.618 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035494179999999999 2024-04-18T21:07:29.618 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.618 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.618 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:29.618 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.967680+0000", 2024-04-18T21:07:29.618 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.003662046 2024-04-18T21:07:29.618 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.619 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.619 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:29.619 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.967738+0000", 2024-04-18T21:07:29.619 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.7946999999999999e-05 2024-04-18T21:07:29.619 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.619 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.619 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:29.619 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.967888+0000", 2024-04-18T21:07:29.619 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000150204 2024-04-18T21:07:29.619 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:29.619 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:29.619 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:29.619 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.620 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.620 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:20010 4.1a 4:5997e84c:::1000000013a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-18T21:07:29.620 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:25.995286+0000", 2024-04-18T21:07:29.620 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 3.5798261619999998, 2024-04-18T21:07:29.620 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.062172181, 2024-04-18T21:07:29.620 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:29.620 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:29.620 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:07:29.620 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:29.620 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.620 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:29.620 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995286+0000", 2024-04-18T21:07:29.620 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:29.620 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.621 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.621 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:29.621 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995286+0000", 2024-04-18T21:07:29.621 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:29.621 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.621 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.621 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:29.621 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995287+0000", 2024-04-18T21:07:29.621 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.034e-06 2024-04-18T21:07:29.621 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.621 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.621 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:29.621 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995292+0000", 2024-04-18T21:07:29.621 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8029999999999996e-06 2024-04-18T21:07:29.621 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.622 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.622 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:29.622 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995308+0000", 2024-04-18T21:07:29.622 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6113e-05 2024-04-18T21:07:29.622 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.622 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.622 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.622 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995321+0000", 2024-04-18T21:07:29.622 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3019e-05 2024-04-18T21:07:29.622 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.622 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.622 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:29.622 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.039546+0000", 2024-04-18T21:07:29.622 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.044224749000000001 2024-04-18T21:07:29.623 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.623 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.623 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:29.623 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.039852+0000", 2024-04-18T21:07:29.623 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00030594699999999999 2024-04-18T21:07:29.623 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.623 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.623 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:29.623 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.057458+0000", 2024-04-18T21:07:29.623 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017606515999999999 2024-04-18T21:07:29.623 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:29.623 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:29.623 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:29.623 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.623 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.623 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:20018 4.1b 4:d9deb994:::10000000142.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-18T21:07:29.624 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:25.995386+0000", 2024-04-18T21:07:29.624 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 3.5797262970000001, 2024-04-18T21:07:29.624 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.066397342999999998, 2024-04-18T21:07:29.624 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:29.624 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:29.624 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:07:29.624 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:29.624 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.624 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:29.624 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995386+0000", 2024-04-18T21:07:29.624 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:29.624 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.624 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.624 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:29.624 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995386+0000", 2024-04-18T21:07:29.625 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:29.625 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.625 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.625 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:29.625 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995387+0000", 2024-04-18T21:07:29.625 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.7300000000000004e-07 2024-04-18T21:07:29.625 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.625 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.625 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:29.625 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995392+0000", 2024-04-18T21:07:29.625 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.6070000000000001e-06 2024-04-18T21:07:29.625 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.625 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.625 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:29.625 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995408+0000", 2024-04-18T21:07:29.626 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6801999999999999e-05 2024-04-18T21:07:29.626 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.626 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.626 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.626 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995424+0000", 2024-04-18T21:07:29.626 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5566999999999999e-05 2024-04-18T21:07:29.626 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.626 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.626 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:29.626 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.025739+0000", 2024-04-18T21:07:29.626 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030314537999999999 2024-04-18T21:07:29.626 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.626 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.626 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:29.627 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.026475+0000", 2024-04-18T21:07:29.627 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00073683699999999995 2024-04-18T21:07:29.627 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.627 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.627 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:29.627 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.061783+0000", 2024-04-18T21:07:29.627 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.035308019000000003 2024-04-18T21:07:29.627 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:29.627 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:29.627 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:29.627 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.627 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.627 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:20021 4.1a 4:587da770:::10000000145.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-18T21:07:29.627 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:25.995439+0000", 2024-04-18T21:07:29.628 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 3.579672908, 2024-04-18T21:07:29.628 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.062273949000000002, 2024-04-18T21:07:29.628 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:29.628 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:29.628 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:07:29.628 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:29.628 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.628 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:29.628 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995439+0000", 2024-04-18T21:07:29.628 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:29.628 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.628 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.628 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:29.628 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995439+0000", 2024-04-18T21:07:29.629 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:29.629 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.629 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.629 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:29.629 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995440+0000", 2024-04-18T21:07:29.629 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9600000000000008e-07 2024-04-18T21:07:29.629 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.629 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.629 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:29.629 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995445+0000", 2024-04-18T21:07:29.629 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.6569999999999996e-06 2024-04-18T21:07:29.629 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.629 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.629 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:29.630 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995461+0000", 2024-04-18T21:07:29.630 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6089000000000001e-05 2024-04-18T21:07:29.630 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.630 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.630 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.630 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995475+0000", 2024-04-18T21:07:29.630 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4174e-05 2024-04-18T21:07:29.630 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.630 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.630 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:29.630 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.040858+0000", 2024-04-18T21:07:29.630 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.045382359999999997 2024-04-18T21:07:29.630 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.631 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.631 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:29.631 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.041187+0000", 2024-04-18T21:07:29.631 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00032946199999999998 2024-04-18T21:07:29.631 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.631 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.631 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:29.631 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.057713+0000", 2024-04-18T21:07:29.631 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016526210999999999 2024-04-18T21:07:29.631 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:29.631 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:29.631 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:29.631 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.631 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.631 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:20050 4.1a 4:581fb947:::10000000162.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-18T21:07:29.632 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:25.996077+0000", 2024-04-18T21:07:29.632 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 3.5790357099999999, 2024-04-18T21:07:29.632 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.061925185000000001, 2024-04-18T21:07:29.632 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:29.632 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:29.632 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:07:29.632 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:29.632 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.632 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:29.632 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996077+0000", 2024-04-18T21:07:29.632 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:29.632 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.632 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.632 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:29.633 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996077+0000", 2024-04-18T21:07:29.633 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:29.633 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.633 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.633 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:29.633 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996078+0000", 2024-04-18T21:07:29.633 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.046e-06 2024-04-18T21:07:29.633 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.633 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.633 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:29.633 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996083+0000", 2024-04-18T21:07:29.633 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3630000000000002e-06 2024-04-18T21:07:29.633 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.633 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.633 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:29.634 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996100+0000", 2024-04-18T21:07:29.634 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7214000000000002e-05 2024-04-18T21:07:29.634 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.634 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.634 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.634 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996114+0000", 2024-04-18T21:07:29.634 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3713000000000001e-05 2024-04-18T21:07:29.634 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.634 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.634 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:29.634 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.045254+0000", 2024-04-18T21:07:29.634 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.049140085 2024-04-18T21:07:29.634 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.635 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.635 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:29.635 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.045399+0000", 2024-04-18T21:07:29.635 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014537 2024-04-18T21:07:29.635 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.635 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.635 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:29.635 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.058002+0000", 2024-04-18T21:07:29.635 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.012602393999999999 2024-04-18T21:07:29.635 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:29.635 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:29.635 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:29.635 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.635 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.635 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:20060 4.2b 4:d4621505:::1000000016c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-18T21:07:29.636 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:25.996311+0000", 2024-04-18T21:07:29.636 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 3.5788016790000001, 2024-04-18T21:07:29.636 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.065642542999999998, 2024-04-18T21:07:29.636 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:29.636 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:29.636 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:07:29.636 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:29.636 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.636 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:29.636 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996311+0000", 2024-04-18T21:07:29.636 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:29.636 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.636 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.637 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:29.637 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996311+0000", 2024-04-18T21:07:29.637 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:29.637 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.637 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.637 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:29.637 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996313+0000", 2024-04-18T21:07:29.637 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.86e-06 2024-04-18T21:07:29.637 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.637 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.637 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:29.637 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996319+0000", 2024-04-18T21:07:29.637 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.9499999999999998e-06 2024-04-18T21:07:29.637 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.638 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.638 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:29.638 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996340+0000", 2024-04-18T21:07:29.638 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1866e-05 2024-04-18T21:07:29.638 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.638 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.638 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.638 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996359+0000", 2024-04-18T21:07:29.638 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8502999999999999e-05 2024-04-18T21:07:29.638 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.638 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.638 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:29.638 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.027528+0000", 2024-04-18T21:07:29.638 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.031168992999999999 2024-04-18T21:07:29.638 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.639 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.639 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:29.639 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.027857+0000", 2024-04-18T21:07:29.639 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00032939200000000002 2024-04-18T21:07:29.639 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.639 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.639 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:29.639 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.061953+0000", 2024-04-18T21:07:29.639 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.034095978999999998 2024-04-18T21:07:29.639 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:29.639 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:29.639 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:29.639 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.639 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.639 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:20072 4.1b 4:d83df968:::10000000178.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-18T21:07:29.639 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:25.996492+0000", 2024-04-18T21:07:29.640 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 3.5786204599999998, 2024-04-18T21:07:29.640 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.065580346999999997, 2024-04-18T21:07:29.640 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:29.640 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:29.640 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:07:29.640 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:29.640 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.640 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:29.640 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996492+0000", 2024-04-18T21:07:29.640 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:29.640 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.640 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.640 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:29.640 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996492+0000", 2024-04-18T21:07:29.640 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:29.640 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.641 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.641 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:29.641 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996493+0000", 2024-04-18T21:07:29.641 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0130000000000001e-06 2024-04-18T21:07:29.641 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.641 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.641 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:29.641 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996498+0000", 2024-04-18T21:07:29.641 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.7400000000000004e-06 2024-04-18T21:07:29.641 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.641 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.641 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:29.641 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996514+0000", 2024-04-18T21:07:29.641 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6626e-05 2024-04-18T21:07:29.641 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.642 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.642 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.642 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996527+0000", 2024-04-18T21:07:29.642 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.289e-05 2024-04-18T21:07:29.642 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.642 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.642 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:29.642 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.028896+0000", 2024-04-18T21:07:29.642 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.032368848999999998 2024-04-18T21:07:29.642 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.642 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.642 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:29.642 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.029266+0000", 2024-04-18T21:07:29.642 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00036995799999999998 2024-04-18T21:07:29.643 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.643 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.643 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:29.643 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.062072+0000", 2024-04-18T21:07:29.643 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.032806270999999998 2024-04-18T21:07:29.643 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:29.643 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:29.643 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:29.643 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.643 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.643 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:20085 4.2b 4:d44b7594:::10000000185.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-18T21:07:29.643 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:25.996650+0000", 2024-04-18T21:07:29.643 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 3.5784624200000001, 2024-04-18T21:07:29.644 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.065498801999999995, 2024-04-18T21:07:29.644 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:29.644 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:29.644 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:07:29.644 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:29.644 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.644 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:29.644 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996650+0000", 2024-04-18T21:07:29.644 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:29.644 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.644 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.644 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:29.644 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996650+0000", 2024-04-18T21:07:29.644 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:29.645 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.645 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.645 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:29.645 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996651+0000", 2024-04-18T21:07:29.645 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.2600000000000001e-07 2024-04-18T21:07:29.645 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.645 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.645 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:29.645 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996656+0000", 2024-04-18T21:07:29.645 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4299999999999997e-06 2024-04-18T21:07:29.645 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.645 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.645 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:29.645 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996673+0000", 2024-04-18T21:07:29.646 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6520000000000001e-05 2024-04-18T21:07:29.646 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.646 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.646 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.646 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996689+0000", 2024-04-18T21:07:29.646 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5676e-05 2024-04-18T21:07:29.646 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.646 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.646 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:29.646 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.030380+0000", 2024-04-18T21:07:29.646 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.033691929000000002 2024-04-18T21:07:29.646 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.646 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.646 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:29.647 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.030753+0000", 2024-04-18T21:07:29.647 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00037218199999999998 2024-04-18T21:07:29.647 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.647 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.647 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:29.647 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.062149+0000", 2024-04-18T21:07:29.647 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.031396139000000003 2024-04-18T21:07:29.647 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:29.647 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:29.647 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:29.647 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.647 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.647 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:20086 4.1b 4:dac0322e:::10000000186.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-18T21:07:29.648 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:25.996705+0000", 2024-04-18T21:07:29.648 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 3.5784070420000003, 2024-04-18T21:07:29.648 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.065715934000000004, 2024-04-18T21:07:29.648 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:29.648 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:29.648 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:07:29.648 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:29.648 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.648 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:29.648 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996705+0000", 2024-04-18T21:07:29.648 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:29.648 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.648 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.648 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:29.648 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996705+0000", 2024-04-18T21:07:29.649 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:29.649 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.649 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.649 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:29.649 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996706+0000", 2024-04-18T21:07:29.649 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.7699999999999992e-07 2024-04-18T21:07:29.649 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.649 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.649 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:29.649 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996711+0000", 2024-04-18T21:07:29.649 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.1460000000000004e-06 2024-04-18T21:07:29.649 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.649 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.649 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:29.650 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996728+0000", 2024-04-18T21:07:29.650 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.626e-05 2024-04-18T21:07:29.650 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.650 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.650 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.650 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996740+0000", 2024-04-18T21:07:29.650 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2343e-05 2024-04-18T21:07:29.650 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.650 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.650 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:29.650 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.042837+0000", 2024-04-18T21:07:29.650 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.046096454000000002 2024-04-18T21:07:29.650 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.650 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.651 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:29.651 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.045179+0000", 2024-04-18T21:07:29.651 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0023421560000000002 2024-04-18T21:07:29.651 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.651 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.651 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:29.651 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.062421+0000", 2024-04-18T21:07:29.651 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017242598000000001 2024-04-18T21:07:29.651 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:29.651 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:29.651 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:29.651 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.651 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.651 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:20101 4.1b 4:d8c655bc:::10000000195.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-18T21:07:29.652 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:25.998732+0000", 2024-04-18T21:07:29.652 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 3.5763806000000002, 2024-04-18T21:07:29.652 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.063840712999999993, 2024-04-18T21:07:29.652 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:29.652 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:29.652 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:07:29.652 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:29.652 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.652 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:29.652 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.998732+0000", 2024-04-18T21:07:29.652 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:29.652 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.652 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.652 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:29.652 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.998732+0000", 2024-04-18T21:07:29.652 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:29.653 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.653 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.653 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:29.653 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.998734+0000", 2024-04-18T21:07:29.653 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1100000000000001e-06 2024-04-18T21:07:29.653 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.653 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.653 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:29.653 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.998743+0000", 2024-04-18T21:07:29.653 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.1430000000000004e-06 2024-04-18T21:07:29.653 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.653 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.653 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:29.653 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.998770+0000", 2024-04-18T21:07:29.653 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7387000000000001e-05 2024-04-18T21:07:29.654 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.654 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.654 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.654 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.998789+0000", 2024-04-18T21:07:29.654 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8932000000000001e-05 2024-04-18T21:07:29.654 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.654 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.654 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:29.654 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.045985+0000", 2024-04-18T21:07:29.654 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.047195537000000003 2024-04-18T21:07:29.654 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.654 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.654 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:29.654 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.046184+0000", 2024-04-18T21:07:29.655 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019923200000000001 2024-04-18T21:07:29.655 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.655 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.655 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:29.655 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.062573+0000", 2024-04-18T21:07:29.655 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016388371999999998 2024-04-18T21:07:29.655 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:29.655 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:29.655 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:29.655 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.655 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.655 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:20104 4.30 4:0cac0e23:::10000000198.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-18T21:07:29.655 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:25.998873+0000", 2024-04-18T21:07:29.655 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 3.5762390229999999, 2024-04-18T21:07:29.656 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.062446901999999999, 2024-04-18T21:07:29.656 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:29.656 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:29.656 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:07:29.656 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:29.656 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.656 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:29.656 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.998873+0000", 2024-04-18T21:07:29.656 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:29.656 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.656 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.656 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:29.656 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.998873+0000", 2024-04-18T21:07:29.656 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:29.657 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.657 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.657 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:29.657 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.998874+0000", 2024-04-18T21:07:29.657 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:07:29.657 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.657 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.657 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:29.657 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.998879+0000", 2024-04-18T21:07:29.657 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.9830000000000004e-06 2024-04-18T21:07:29.657 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.657 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.658 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:29.658 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.998896+0000", 2024-04-18T21:07:29.658 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6897000000000001e-05 2024-04-18T21:07:29.658 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.658 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.658 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.658 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.998909+0000", 2024-04-18T21:07:29.658 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2992e-05 2024-04-18T21:07:29.658 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.658 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.658 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:29.658 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.025919+0000", 2024-04-18T21:07:29.658 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.027009960999999999 2024-04-18T21:07:29.658 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.659 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.659 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:29.659 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.027905+0000", 2024-04-18T21:07:29.659 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0019858639999999999 2024-04-18T21:07:29.659 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.659 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.659 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:29.659 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.061320+0000", 2024-04-18T21:07:29.659 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.033415245000000003 2024-04-18T21:07:29.659 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:29.659 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:29.659 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:29.659 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.659 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.660 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:20117 4.2b 4:d55466b4:::100000001a5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-18T21:07:29.660 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:25.999086+0000", 2024-04-18T21:07:29.660 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 3.5760264020000001, 2024-04-18T21:07:29.660 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.063616064999999999, 2024-04-18T21:07:29.660 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:29.660 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:29.660 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:07:29.660 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:29.660 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.660 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:29.660 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.999086+0000", 2024-04-18T21:07:29.660 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:29.660 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.660 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.660 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:29.661 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.999086+0000", 2024-04-18T21:07:29.661 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:29.661 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.661 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.661 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:29.661 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.999087+0000", 2024-04-18T21:07:29.661 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.540000000000001e-07 2024-04-18T21:07:29.661 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.661 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.661 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:29.661 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.999092+0000", 2024-04-18T21:07:29.661 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.31e-06 2024-04-18T21:07:29.661 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.661 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.662 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:29.662 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.999109+0000", 2024-04-18T21:07:29.662 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7178999999999999e-05 2024-04-18T21:07:29.662 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.662 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.662 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.662 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.999123+0000", 2024-04-18T21:07:29.662 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3203e-05 2024-04-18T21:07:29.662 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.662 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.662 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:29.662 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.045971+0000", 2024-04-18T21:07:29.662 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.046848771999999997 2024-04-18T21:07:29.662 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.663 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.663 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:29.663 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.046266+0000", 2024-04-18T21:07:29.663 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00029410800000000001 2024-04-18T21:07:29.663 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.663 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.663 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:29.663 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.062702+0000", 2024-04-18T21:07:29.663 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016436539 2024-04-18T21:07:29.663 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:29.663 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:29.663 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:29.663 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.664 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.664 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:20179 4.1b 4:da67b4c4:::100000001e3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-18T21:07:29.664 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:26.000403+0000", 2024-04-18T21:07:29.664 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 3.5747094590000001, 2024-04-18T21:07:29.664 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.062388916000000003, 2024-04-18T21:07:29.664 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:29.664 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:29.664 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:07:29.664 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:29.664 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.664 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:29.664 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.000403+0000", 2024-04-18T21:07:29.664 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:29.664 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.664 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.665 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:29.665 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.000403+0000", 2024-04-18T21:07:29.665 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:29.665 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.665 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.665 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:29.665 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.000404+0000", 2024-04-18T21:07:29.665 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.5300000000000002e-07 2024-04-18T21:07:29.665 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.665 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.665 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:29.665 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.000409+0000", 2024-04-18T21:07:29.665 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.7759999999999997e-06 2024-04-18T21:07:29.665 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.665 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.666 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:29.666 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.000428+0000", 2024-04-18T21:07:29.666 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8980000000000001e-05 2024-04-18T21:07:29.666 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.666 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.666 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.666 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.000442+0000", 2024-04-18T21:07:29.666 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3903000000000001e-05 2024-04-18T21:07:29.666 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.666 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.666 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:29.666 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.046711+0000", 2024-04-18T21:07:29.666 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.046269498999999999 2024-04-18T21:07:29.667 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.667 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.667 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:29.667 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.046860+0000", 2024-04-18T21:07:29.667 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014919400000000001 2024-04-18T21:07:29.667 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.667 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.667 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:29.667 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.062792+0000", 2024-04-18T21:07:29.667 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.015931610999999998 2024-04-18T21:07:29.667 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:29.667 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:29.667 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:29.667 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.667 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.668 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:20185 4.30 4:0def042e:::100000001e9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-18T21:07:29.668 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:26.001040+0000", 2024-04-18T21:07:29.668 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 3.5740726550000002, 2024-04-18T21:07:29.668 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.060583056000000003, 2024-04-18T21:07:29.668 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:29.668 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:29.668 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:07:29.668 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:29.668 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.668 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:29.668 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.001040+0000", 2024-04-18T21:07:29.668 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:29.668 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.668 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.669 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:29.669 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.001040+0000", 2024-04-18T21:07:29.669 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:29.669 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.669 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.669 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:29.669 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.001041+0000", 2024-04-18T21:07:29.669 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4100000000000001e-06 2024-04-18T21:07:29.669 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.669 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.669 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:29.669 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.001048+0000", 2024-04-18T21:07:29.669 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.2359999999999998e-06 2024-04-18T21:07:29.669 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.669 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.670 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:29.670 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.006248+0000", 2024-04-18T21:07:29.670 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0051992449999999999 2024-04-18T21:07:29.670 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.670 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.670 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:29.670 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.006274+0000", 2024-04-18T21:07:29.670 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.6696e-05 2024-04-18T21:07:29.670 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.670 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.670 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:29.670 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.032224+0000", 2024-04-18T21:07:29.670 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.025949403999999999 2024-04-18T21:07:29.670 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.671 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.671 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:29.671 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.032533+0000", 2024-04-18T21:07:29.671 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00030930999999999998 2024-04-18T21:07:29.671 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:29.671 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:29.671 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:29.671 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.061623+0000", 2024-04-18T21:07:29.671 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.029089754999999998 2024-04-18T21:07:29.671 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:29.671 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:29.671 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:29.671 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:29.671 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:29.671 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:07:29.672 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:29.577+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:29.673 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:07:29.676 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:29.674+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:29.776 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:29.774+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:29.804 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:07:29.804 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:07:29.804 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-04-18T21:07:29.804 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:07:29.819 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:07:29.905 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:29.906+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:29.977 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:29.977+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:29.979 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:07:29.980 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:07:29.980 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-18T21:07:29.980 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-18T21:07:29.980 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:07:29.995 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:30.085 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:30.086+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:30.164 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:07:30.164 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-18T21:07:30.164 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-18T21:07:30.164 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-18T21:07:30.164 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.165 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4534.0:12689 4.26 4:64a7f444:::100000033e5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-18T21:07:30.165 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:00.208067+0000", 2024-04-18T21:07:30.165 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 29.956544637, 2024-04-18T21:07:30.165 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066681457, 2024-04-18T21:07:30.165 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:30.165 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:30.165 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:30.165 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-18T21:07:30.165 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4534", 2024-04-18T21:07:30.165 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:30.165 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 12689 2024-04-18T21:07:30.165 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.165 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:30.166 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.166 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:30.166 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.208067+0000", 2024-04-18T21:07:30.166 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:30.166 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.166 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.166 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:30.166 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.208067+0000", 2024-04-18T21:07:30.166 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:30.166 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.166 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.166 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:30.166 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.208069+0000", 2024-04-18T21:07:30.166 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1500000000000002e-06 2024-04-18T21:07:30.167 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.167 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.167 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:30.167 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216162+0000", 2024-04-18T21:07:30.167 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0080933159999999997 2024-04-18T21:07:30.167 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.167 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.167 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:30.167 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216181+0000", 2024-04-18T21:07:30.167 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8573e-05 2024-04-18T21:07:30.167 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.167 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.167 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:30.167 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216192+0000", 2024-04-18T21:07:30.167 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0767999999999999e-05 2024-04-18T21:07:30.168 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.168 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.168 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:30.168 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216259+0000", 2024-04-18T21:07:30.168 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7977000000000003e-05 2024-04-18T21:07:30.168 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.168 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.168 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:30.168 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216635+0000", 2024-04-18T21:07:30.168 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00037591300000000002 2024-04-18T21:07:30.168 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.168 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.168 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:30.168 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.216929+0000", 2024-04-18T21:07:30.168 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00029314800000000002 2024-04-18T21:07:30.169 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.169 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.169 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:30.169 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.232918+0000", 2024-04-18T21:07:30.169 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015989903 2024-04-18T21:07:30.169 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.169 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.169 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:30.169 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.274643+0000", 2024-04-18T21:07:30.169 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.041724281000000002 2024-04-18T21:07:30.169 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.169 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.169 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:30.169 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.274701+0000", 2024-04-18T21:07:30.170 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8304999999999998e-05 2024-04-18T21:07:30.170 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.170 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.170 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:30.170 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:00.274748+0000", 2024-04-18T21:07:30.170 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7123000000000003e-05 2024-04-18T21:07:30.170 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:30.170 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:30.170 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:30.170 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.170 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.170 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:7694 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-18T21:07:30.170 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:11.672522+0000", 2024-04-18T21:07:30.170 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.492089597, 2024-04-18T21:07:30.171 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2954970370000001, 2024-04-18T21:07:30.171 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:30.171 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:30.171 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:30.171 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:30.171 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.171 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:30.171 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672522+0000", 2024-04-18T21:07:30.171 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:30.171 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.171 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.171 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:30.171 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672522+0000", 2024-04-18T21:07:30.171 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:30.172 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.172 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.172 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:30.172 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672525+0000", 2024-04-18T21:07:30.172 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.366e-06 2024-04-18T21:07:30.172 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.172 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.172 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:30.172 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672540+0000", 2024-04-18T21:07:30.172 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4949999999999999e-05 2024-04-18T21:07:30.172 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.172 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.172 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:30.172 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672569+0000", 2024-04-18T21:07:30.173 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8714999999999999e-05 2024-04-18T21:07:30.173 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.173 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.173 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:30.173 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672581+0000", 2024-04-18T21:07:30.173 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1949e-05 2024-04-18T21:07:30.173 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.173 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.173 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:30.173 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672704+0000", 2024-04-18T21:07:30.173 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000122915 2024-04-18T21:07:30.173 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.173 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.173 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:30.174 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.672714+0000", 2024-04-18T21:07:30.174 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0698e-05 2024-04-18T21:07:30.174 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.174 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.174 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:30.174 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.910993+0000", 2024-04-18T21:07:30.174 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.23827911199999999 2024-04-18T21:07:30.174 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.174 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.174 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:30.174 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:11.911017+0000", 2024-04-18T21:07:30.174 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3419999999999999e-05 2024-04-18T21:07:30.174 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.174 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.175 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:30.175 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.952146+0000", 2024-04-18T21:07:30.175 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0411288869999999 2024-04-18T21:07:30.175 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.175 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.175 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:30.175 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.952467+0000", 2024-04-18T21:07:30.175 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00032165399999999999 2024-04-18T21:07:30.175 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.175 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.175 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:30.175 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.954086+0000", 2024-04-18T21:07:30.175 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0016184820000000001 2024-04-18T21:07:30.175 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.175 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.176 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:30.176 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.960573+0000", 2024-04-18T21:07:30.176 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064874240000000003 2024-04-18T21:07:30.176 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.176 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.176 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:30.176 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.967786+0000", 2024-04-18T21:07:30.176 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0072125069999999999 2024-04-18T21:07:30.176 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.176 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.176 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:30.176 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.967897+0000", 2024-04-18T21:07:30.176 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111679 2024-04-18T21:07:30.176 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.177 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.177 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:30.177 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.968019+0000", 2024-04-18T21:07:30.177 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000121279 2024-04-18T21:07:30.177 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:30.177 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:30.177 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:30.177 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.177 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.177 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:7696 3.f 3:f376ae95:::200.00000016:head [write 3681546~512758 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:30.177 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:12.760706+0000", 2024-04-18T21:07:30.177 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 17.403905195, 2024-04-18T21:07:30.177 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.24998282899999999, 2024-04-18T21:07:30.177 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:30.178 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:30.178 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:30.178 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:30.178 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.178 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:30.178 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.760706+0000", 2024-04-18T21:07:30.178 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:30.178 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.178 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.178 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:30.178 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.760706+0000", 2024-04-18T21:07:30.178 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:30.178 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.178 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.179 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:30.179 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.760710+0000", 2024-04-18T21:07:30.179 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2100000000000003e-06 2024-04-18T21:07:30.179 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.179 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.179 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:30.179 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.761972+0000", 2024-04-18T21:07:30.179 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0012615689999999999 2024-04-18T21:07:30.179 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.179 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.179 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:30.179 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762012+0000", 2024-04-18T21:07:30.179 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0145999999999998e-05 2024-04-18T21:07:30.179 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.179 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.180 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:30.180 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762030+0000", 2024-04-18T21:07:30.180 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8312999999999999e-05 2024-04-18T21:07:30.180 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.180 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.180 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:30.180 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762158+0000", 2024-04-18T21:07:30.180 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012805600000000001 2024-04-18T21:07:30.180 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.180 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.180 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:30.180 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762174+0000", 2024-04-18T21:07:30.180 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5645999999999999e-05 2024-04-18T21:07:30.180 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.180 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.181 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:30.181 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.926080+0000", 2024-04-18T21:07:30.181 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.16390581900000001 2024-04-18T21:07:30.181 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.181 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.181 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for missing object", 2024-04-18T21:07:30.181 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.926149+0000", 2024-04-18T21:07:30.181 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9172999999999997e-05 2024-04-18T21:07:30.181 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.181 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.181 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:30.181 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.002156+0000", 2024-04-18T21:07:30.181 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.076006972000000006 2024-04-18T21:07:30.181 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.181 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.182 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for rw locks", 2024-04-18T21:07:30.182 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.002294+0000", 2024-04-18T21:07:30.182 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000138011 2024-04-18T21:07:30.182 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.182 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.182 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:30.182 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.005436+0000", 2024-04-18T21:07:30.182 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031422749999999999 2024-04-18T21:07:30.182 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.182 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.182 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:30.182 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.005577+0000", 2024-04-18T21:07:30.182 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014105399999999999 2024-04-18T21:07:30.182 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.182 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.183 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:30.183 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.005725+0000", 2024-04-18T21:07:30.183 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014721100000000001 2024-04-18T21:07:30.183 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.183 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.183 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:30.183 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.009143+0000", 2024-04-18T21:07:30.183 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0034179380000000001 2024-04-18T21:07:30.183 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.183 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.183 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:30.183 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.010522+0000", 2024-04-18T21:07:30.183 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0013790919999999999 2024-04-18T21:07:30.183 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.184 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.184 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:30.184 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.010586+0000", 2024-04-18T21:07:30.184 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4713000000000002e-05 2024-04-18T21:07:30.184 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.184 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.184 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:30.184 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:13.010689+0000", 2024-04-18T21:07:30.184 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000102631 2024-04-18T21:07:30.184 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:30.184 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:30.184 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:30.184 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.184 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.185 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:7697 3.16 3:6b6b4f13:::200.0000001c:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:30.185 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:12.762074+0000", 2024-04-18T21:07:30.185 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 17.402537046999999, 2024-04-18T21:07:30.185 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.2056489, 2024-04-18T21:07:30.185 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:30.185 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:30.185 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:07:30.185 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:30.185 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.185 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:30.185 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762074+0000", 2024-04-18T21:07:30.185 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:30.185 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.185 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.185 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:30.185 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762074+0000", 2024-04-18T21:07:30.185 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:30.186 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.186 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.186 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:30.186 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762076+0000", 2024-04-18T21:07:30.186 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.793e-06 2024-04-18T21:07:30.186 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.186 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.186 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:30.186 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762083+0000", 2024-04-18T21:07:30.186 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7129999999999999e-06 2024-04-18T21:07:30.186 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.186 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.186 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:30.187 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762104+0000", 2024-04-18T21:07:30.187 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1480000000000001e-05 2024-04-18T21:07:30.187 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.187 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.187 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:30.187 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762121+0000", 2024-04-18T21:07:30.187 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.632e-05 2024-04-18T21:07:30.187 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.187 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.187 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:30.187 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762224+0000", 2024-04-18T21:07:30.187 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010346800000000001 2024-04-18T21:07:30.187 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.187 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.187 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:30.187 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.762238+0000", 2024-04-18T21:07:30.188 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3482999999999999e-05 2024-04-18T21:07:30.188 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.188 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.188 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:30.188 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.946932+0000", 2024-04-18T21:07:30.188 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.18469451000000001 2024-04-18T21:07:30.188 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.188 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.188 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:30.188 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.947261+0000", 2024-04-18T21:07:30.188 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00032857399999999999 2024-04-18T21:07:30.188 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.188 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.188 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:30.188 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:12.967723+0000", 2024-04-18T21:07:30.188 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020462559000000002 2024-04-18T21:07:30.189 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:30.189 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:30.189 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:30.189 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.189 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.189 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:10831 4.13 4:c948684f:::1000000032e.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:30.189 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.823266+0000", 2024-04-18T21:07:30.189 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 14.341345658, 2024-04-18T21:07:30.189 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.65275881599999996, 2024-04-18T21:07:30.189 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:30.189 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:30.189 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:30.189 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:30.189 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.189 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:30.189 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823266+0000", 2024-04-18T21:07:30.190 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:30.190 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.190 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.190 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:30.190 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823266+0000", 2024-04-18T21:07:30.190 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:30.190 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.190 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.190 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:30.190 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823266+0000", 2024-04-18T21:07:30.190 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9800000000000004e-07 2024-04-18T21:07:30.190 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.190 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.190 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:30.191 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823269+0000", 2024-04-18T21:07:30.191 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3259999999999998e-06 2024-04-18T21:07:30.191 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.191 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.191 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:30.191 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823274+0000", 2024-04-18T21:07:30.191 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9830000000000001e-06 2024-04-18T21:07:30.191 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.191 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.191 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:30.191 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823280+0000", 2024-04-18T21:07:30.191 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1540000000000001e-06 2024-04-18T21:07:30.191 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.191 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.191 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:30.192 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823313+0000", 2024-04-18T21:07:30.192 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3667000000000001e-05 2024-04-18T21:07:30.192 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.192 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.192 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:30.192 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.823321+0000", 2024-04-18T21:07:30.192 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1200000000000002e-06 2024-04-18T21:07:30.192 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.192 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.192 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:30.192 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.470069+0000", 2024-04-18T21:07:30.192 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.64674728999999997 2024-04-18T21:07:30.192 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.192 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.192 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:30.193 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.470457+0000", 2024-04-18T21:07:30.193 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00038800899999999998 2024-04-18T21:07:30.193 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.193 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.193 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:30.193 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.470755+0000", 2024-04-18T21:07:30.193 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00029781399999999998 2024-04-18T21:07:30.193 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.193 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.193 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:30.193 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.474041+0000", 2024-04-18T21:07:30.193 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032860670000000002 2024-04-18T21:07:30.193 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.193 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.193 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:30.194 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.475621+0000", 2024-04-18T21:07:30.194 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001579925 2024-04-18T21:07:30.194 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.194 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.194 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:30.194 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.475750+0000", 2024-04-18T21:07:30.194 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000129002 2024-04-18T21:07:30.194 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.194 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.194 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:30.194 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.476024+0000", 2024-04-18T21:07:30.194 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000274961 2024-04-18T21:07:30.194 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:30.194 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:30.194 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:30.195 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.195 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.195 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11326 4.13 4:cbbbc9f0:::100000010c6.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:30.195 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.917113+0000", 2024-04-18T21:07:30.195 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 14.247498456000001, 2024-04-18T21:07:30.195 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.56159817899999998, 2024-04-18T21:07:30.195 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:30.195 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:30.195 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:30.195 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:30.195 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.195 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:30.195 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917113+0000", 2024-04-18T21:07:30.196 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:30.196 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.196 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.196 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:30.196 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917113+0000", 2024-04-18T21:07:30.196 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:30.196 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.196 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.196 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:30.196 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917114+0000", 2024-04-18T21:07:30.196 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5099999999999999e-07 2024-04-18T21:07:30.196 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.196 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.196 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:30.196 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917123+0000", 2024-04-18T21:07:30.197 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5859999999999994e-06 2024-04-18T21:07:30.197 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.197 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.197 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:30.197 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917130+0000", 2024-04-18T21:07:30.197 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9800000000000001e-06 2024-04-18T21:07:30.197 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.197 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.197 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:30.197 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917136+0000", 2024-04-18T21:07:30.197 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.502e-06 2024-04-18T21:07:30.197 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.197 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.197 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:30.198 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917239+0000", 2024-04-18T21:07:30.198 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000103286 2024-04-18T21:07:30.198 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.198 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.198 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:30.198 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.917247+0000", 2024-04-18T21:07:30.198 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.49e-06 2024-04-18T21:07:30.198 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.198 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.198 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:30.198 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.472462+0000", 2024-04-18T21:07:30.198 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.55521418899999997 2024-04-18T21:07:30.198 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.199 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.199 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:30.199 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.472801+0000", 2024-04-18T21:07:30.199 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00033935600000000002 2024-04-18T21:07:30.199 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.199 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.199 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:30.199 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.473101+0000", 2024-04-18T21:07:30.199 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030031399999999998 2024-04-18T21:07:30.199 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.199 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.199 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:30.199 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.475574+0000", 2024-04-18T21:07:30.199 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0024732310000000002 2024-04-18T21:07:30.199 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.199 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.200 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:30.200 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.478287+0000", 2024-04-18T21:07:30.200 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027122349999999999 2024-04-18T21:07:30.200 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.200 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.200 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:30.200 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.478467+0000", 2024-04-18T21:07:30.200 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000180645 2024-04-18T21:07:30.200 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.200 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.200 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:30.200 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.478711+0000", 2024-04-18T21:07:30.200 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024371399999999999 2024-04-18T21:07:30.200 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:30.200 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:30.200 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:30.201 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.201 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.201 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11394 4.13 4:cb2e645e:::10000001109.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:30.201 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.925453+0000", 2024-04-18T21:07:30.201 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 14.239157933, 2024-04-18T21:07:30.201 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.55363756900000005, 2024-04-18T21:07:30.201 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:30.201 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:30.201 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:30.201 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:30.201 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.201 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:30.201 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925453+0000", 2024-04-18T21:07:30.201 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:30.201 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.202 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.202 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:30.202 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925453+0000", 2024-04-18T21:07:30.202 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:30.202 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.202 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.202 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:30.202 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925454+0000", 2024-04-18T21:07:30.202 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1699999999999997e-07 2024-04-18T21:07:30.202 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.202 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.202 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:30.202 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925458+0000", 2024-04-18T21:07:30.202 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7280000000000001e-06 2024-04-18T21:07:30.203 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.203 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.203 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:30.203 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925467+0000", 2024-04-18T21:07:30.203 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7169999999999997e-06 2024-04-18T21:07:30.203 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.203 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.203 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:30.203 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925474+0000", 2024-04-18T21:07:30.203 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1350000000000003e-06 2024-04-18T21:07:30.203 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.203 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.203 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:30.203 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925523+0000", 2024-04-18T21:07:30.204 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9616000000000001e-05 2024-04-18T21:07:30.204 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.204 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.204 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:30.204 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.925530+0000", 2024-04-18T21:07:30.204 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0099999999999998e-06 2024-04-18T21:07:30.204 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.204 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.204 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:30.204 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.474474+0000", 2024-04-18T21:07:30.204 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.548943242 2024-04-18T21:07:30.204 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.204 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.204 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:30.204 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.474692+0000", 2024-04-18T21:07:30.205 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00021829799999999999 2024-04-18T21:07:30.205 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.205 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.205 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:30.205 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.474879+0000", 2024-04-18T21:07:30.205 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000187095 2024-04-18T21:07:30.205 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.205 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.205 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:30.205 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.478733+0000", 2024-04-18T21:07:30.205 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003853871 2024-04-18T21:07:30.205 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.205 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.206 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:30.206 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.478840+0000", 2024-04-18T21:07:30.206 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000106623 2024-04-18T21:07:30.206 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.206 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.206 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:30.206 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.478919+0000", 2024-04-18T21:07:30.206 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9326000000000006e-05 2024-04-18T21:07:30.206 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.206 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.206 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:30.206 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479091+0000", 2024-04-18T21:07:30.206 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000172091 2024-04-18T21:07:30.206 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:30.207 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:30.207 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:30.207 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.207 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.207 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11417 4.13 4:cae4f303:::1000000111f.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:30.207 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.927998+0000", 2024-04-18T21:07:30.207 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 14.236613293, 2024-04-18T21:07:30.207 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.55142600900000005, 2024-04-18T21:07:30.207 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:30.207 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:30.207 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:30.207 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:30.207 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.207 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:30.207 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.927998+0000", 2024-04-18T21:07:30.208 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:30.208 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.208 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.208 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:30.208 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.927998+0000", 2024-04-18T21:07:30.208 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:30.208 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.208 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.208 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:30.208 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.927999+0000", 2024-04-18T21:07:30.208 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2800000000000005e-07 2024-04-18T21:07:30.208 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.208 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.208 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:30.208 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.928003+0000", 2024-04-18T21:07:30.209 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0060000000000003e-06 2024-04-18T21:07:30.209 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.209 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.209 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:30.209 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.928012+0000", 2024-04-18T21:07:30.209 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.4129999999999995e-06 2024-04-18T21:07:30.209 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.209 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.209 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:30.209 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.928019+0000", 2024-04-18T21:07:30.209 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5590000000000002e-06 2024-04-18T21:07:30.209 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.209 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.209 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:30.210 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.928075+0000", 2024-04-18T21:07:30.210 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5927000000000002e-05 2024-04-18T21:07:30.210 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.210 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.210 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:30.210 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.928091+0000", 2024-04-18T21:07:30.210 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5724999999999999e-05 2024-04-18T21:07:30.210 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.210 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.210 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:30.210 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.476117+0000", 2024-04-18T21:07:30.210 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.54802609899999999 2024-04-18T21:07:30.210 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.210 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.211 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:30.211 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.476310+0000", 2024-04-18T21:07:30.211 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019318100000000001 2024-04-18T21:07:30.211 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.211 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.211 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:30.211 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.476469+0000", 2024-04-18T21:07:30.211 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015902599999999999 2024-04-18T21:07:30.211 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.211 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.211 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:30.211 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479198+0000", 2024-04-18T21:07:30.211 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027292010000000001 2024-04-18T21:07:30.211 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.212 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.212 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:30.212 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479225+0000", 2024-04-18T21:07:30.212 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6483e-05 2024-04-18T21:07:30.212 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.212 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.212 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:30.212 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479301+0000", 2024-04-18T21:07:30.212 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5935999999999999e-05 2024-04-18T21:07:30.212 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.212 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.212 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:30.212 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479424+0000", 2024-04-18T21:07:30.212 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012352500000000001 2024-04-18T21:07:30.212 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:30.212 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:30.213 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:30.213 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.213 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.213 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11538 4.13 4:ca7a7383:::10000001196.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:30.213 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.942641+0000", 2024-04-18T21:07:30.213 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 14.221970612, 2024-04-18T21:07:30.213 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.538204715, 2024-04-18T21:07:30.213 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:30.213 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:30.213 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:30.213 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:30.213 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.213 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:30.213 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942641+0000", 2024-04-18T21:07:30.213 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:30.214 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.214 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.214 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:30.214 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942641+0000", 2024-04-18T21:07:30.214 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:30.214 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.214 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.214 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:30.214 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942641+0000", 2024-04-18T21:07:30.214 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4099999999999998e-07 2024-04-18T21:07:30.214 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.214 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.214 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:30.215 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942645+0000", 2024-04-18T21:07:30.215 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.788e-06 2024-04-18T21:07:30.215 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.215 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.215 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:30.215 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942654+0000", 2024-04-18T21:07:30.215 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2089999999999994e-06 2024-04-18T21:07:30.215 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.215 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.215 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:30.215 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942668+0000", 2024-04-18T21:07:30.215 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3925e-05 2024-04-18T21:07:30.215 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.215 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.216 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:30.216 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942898+0000", 2024-04-18T21:07:30.216 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00022961800000000001 2024-04-18T21:07:30.216 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.216 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.216 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:30.216 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.942907+0000", 2024-04-18T21:07:30.216 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6219999999999998e-06 2024-04-18T21:07:30.216 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.216 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.216 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:30.216 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.477120+0000", 2024-04-18T21:07:30.216 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.53421297400000001 2024-04-18T21:07:30.216 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.217 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.217 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:30.217 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.477466+0000", 2024-04-18T21:07:30.217 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00034685899999999998 2024-04-18T21:07:30.217 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.217 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.217 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:30.217 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.477717+0000", 2024-04-18T21:07:30.217 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00025019799999999998 2024-04-18T21:07:30.217 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.217 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.217 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:30.217 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479518+0000", 2024-04-18T21:07:30.217 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00180105 2024-04-18T21:07:30.217 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.218 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.218 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:30.218 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.480481+0000", 2024-04-18T21:07:30.218 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00096356100000000004 2024-04-18T21:07:30.218 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.218 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.218 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:30.218 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.480618+0000", 2024-04-18T21:07:30.218 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013678599999999999 2024-04-18T21:07:30.218 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.218 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.218 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:30.218 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.480845+0000", 2024-04-18T21:07:30.218 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00022738399999999999 2024-04-18T21:07:30.219 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:30.219 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:30.219 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:30.219 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.219 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.219 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11574 4.13 4:c9cea989:::100000011b9.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:30.219 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.947550+0000", 2024-04-18T21:07:30.219 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 14.217060870999999, 2024-04-18T21:07:30.219 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.53632730500000003, 2024-04-18T21:07:30.219 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:30.219 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:30.219 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:30.219 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:30.219 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.219 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:30.220 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947550+0000", 2024-04-18T21:07:30.220 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:30.220 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.220 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.220 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:30.220 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947550+0000", 2024-04-18T21:07:30.220 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:30.220 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.220 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.220 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:30.220 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947551+0000", 2024-04-18T21:07:30.220 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6599999999999996e-07 2024-04-18T21:07:30.220 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.220 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.220 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:30.220 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947554+0000", 2024-04-18T21:07:30.221 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6230000000000001e-06 2024-04-18T21:07:30.221 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.221 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.221 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:30.221 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947562+0000", 2024-04-18T21:07:30.221 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2179999999999999e-06 2024-04-18T21:07:30.221 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.221 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.221 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:30.221 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947567+0000", 2024-04-18T21:07:30.221 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3009999999999997e-06 2024-04-18T21:07:30.221 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.221 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.221 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:30.221 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947624+0000", 2024-04-18T21:07:30.222 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6823999999999997e-05 2024-04-18T21:07:30.222 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.222 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.222 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:30.222 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.947633+0000", 2024-04-18T21:07:30.222 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9330000000000007e-06 2024-04-18T21:07:30.222 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.222 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.222 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:30.222 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479591+0000", 2024-04-18T21:07:30.222 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.53195765500000003 2024-04-18T21:07:30.222 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.222 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.222 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:30.223 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479781+0000", 2024-04-18T21:07:30.223 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000190034 2024-04-18T21:07:30.223 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.223 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.223 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:30.223 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.479936+0000", 2024-04-18T21:07:30.223 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000154959 2024-04-18T21:07:30.223 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.223 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.223 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:30.223 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.483428+0000", 2024-04-18T21:07:30.223 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003492294 2024-04-18T21:07:30.223 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.223 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.223 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:30.224 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.483479+0000", 2024-04-18T21:07:30.224 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0868999999999997e-05 2024-04-18T21:07:30.224 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.224 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.224 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:30.224 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.483594+0000", 2024-04-18T21:07:30.224 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000115499 2024-04-18T21:07:30.224 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.224 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.224 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:30.224 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.483878+0000", 2024-04-18T21:07:30.224 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028352999999999999 2024-04-18T21:07:30.224 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:30.224 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:30.224 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:30.224 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.225 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.225 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11596 4.13 4:c88ce457:::100000011ce.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:30.225 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.955066+0000", 2024-04-18T21:07:30.225 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 14.209545461999999, 2024-04-18T21:07:30.225 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.52924763200000002, 2024-04-18T21:07:30.225 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:30.225 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:30.225 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:30.225 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:30.225 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.225 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:30.225 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955066+0000", 2024-04-18T21:07:30.225 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:30.225 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.225 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.226 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:30.226 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955066+0000", 2024-04-18T21:07:30.226 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:30.226 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.226 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.226 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:30.226 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955066+0000", 2024-04-18T21:07:30.226 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4900000000000001e-07 2024-04-18T21:07:30.226 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.226 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.226 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:30.226 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955068+0000", 2024-04-18T21:07:30.226 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0190000000000001e-06 2024-04-18T21:07:30.226 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.226 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.227 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:30.227 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955076+0000", 2024-04-18T21:07:30.227 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.537e-06 2024-04-18T21:07:30.227 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.227 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.227 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:30.227 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955080+0000", 2024-04-18T21:07:30.227 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1760000000000003e-06 2024-04-18T21:07:30.227 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.227 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.227 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:30.227 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955129+0000", 2024-04-18T21:07:30.227 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8480999999999999e-05 2024-04-18T21:07:30.227 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.227 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.228 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:30.228 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.955134+0000", 2024-04-18T21:07:30.228 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1610000000000002e-06 2024-04-18T21:07:30.228 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.228 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.228 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:30.228 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.480932+0000", 2024-04-18T21:07:30.228 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.52579809799999999 2024-04-18T21:07:30.228 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.228 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.228 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:30.228 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.481149+0000", 2024-04-18T21:07:30.228 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00021709100000000001 2024-04-18T21:07:30.228 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.228 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.229 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:30.229 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.481303+0000", 2024-04-18T21:07:30.229 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000153752 2024-04-18T21:07:30.229 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.229 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.229 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:30.229 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.483927+0000", 2024-04-18T21:07:30.229 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026241189999999998 2024-04-18T21:07:30.229 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.229 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.229 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:30.229 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.484028+0000", 2024-04-18T21:07:30.229 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010134899999999999 2024-04-18T21:07:30.230 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.230 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.230 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:30.230 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.484138+0000", 2024-04-18T21:07:30.230 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011015599999999999 2024-04-18T21:07:30.230 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.230 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.230 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:30.230 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.484314+0000", 2024-04-18T21:07:30.230 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017524399999999999 2024-04-18T21:07:30.230 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:30.230 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:30.230 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:30.231 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.231 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.231 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11800 4.13 4:cacc00c7:::10000001296.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:30.231 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:15.989042+0000", 2024-04-18T21:07:30.231 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 14.175569793999999, 2024-04-18T21:07:30.231 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.49832004299999999, 2024-04-18T21:07:30.231 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:30.231 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:30.231 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:30.231 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:30.231 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.231 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:30.231 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989042+0000", 2024-04-18T21:07:30.231 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:30.232 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.232 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.232 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:30.232 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989042+0000", 2024-04-18T21:07:30.232 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:30.232 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.232 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.232 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:30.232 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989042+0000", 2024-04-18T21:07:30.232 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5200000000000002e-07 2024-04-18T21:07:30.232 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.232 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.232 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:30.232 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989044+0000", 2024-04-18T21:07:30.233 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2589999999999999e-06 2024-04-18T21:07:30.233 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.233 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.233 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:30.233 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989051+0000", 2024-04-18T21:07:30.233 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6340000000000003e-06 2024-04-18T21:07:30.233 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.233 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.233 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:30.233 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989062+0000", 2024-04-18T21:07:30.233 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1043000000000001e-05 2024-04-18T21:07:30.233 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.233 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.233 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:30.233 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989367+0000", 2024-04-18T21:07:30.234 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000305249 2024-04-18T21:07:30.234 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.234 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.234 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:30.234 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:15.989376+0000", 2024-04-18T21:07:30.234 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4570000000000005e-06 2024-04-18T21:07:30.234 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.234 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.234 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:30.234 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.482011+0000", 2024-04-18T21:07:30.234 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.49263514200000003 2024-04-18T21:07:30.234 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.234 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.234 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:30.235 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.482397+0000", 2024-04-18T21:07:30.235 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000385986 2024-04-18T21:07:30.235 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.235 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.235 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:30.235 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.482689+0000", 2024-04-18T21:07:30.235 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00029179800000000001 2024-04-18T21:07:30.235 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.235 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.235 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:30.235 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.487008+0000", 2024-04-18T21:07:30.235 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043196129999999999 2024-04-18T21:07:30.235 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.236 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.236 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:30.236 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.487113+0000", 2024-04-18T21:07:30.236 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010498899999999999 2024-04-18T21:07:30.236 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.236 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.236 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:30.236 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.487192+0000", 2024-04-18T21:07:30.236 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8778999999999999e-05 2024-04-18T21:07:30.236 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.236 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.236 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:30.236 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.487362+0000", 2024-04-18T21:07:30.236 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016964200000000001 2024-04-18T21:07:30.237 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:30.237 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:30.237 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:30.237 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.237 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.237 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:11888 4.13 4:ca460221:::10000002cd3.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:30.237 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:16.002068+0000", 2024-04-18T21:07:30.237 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 14.162543134, 2024-04-18T21:07:30.237 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.48938242199999998, 2024-04-18T21:07:30.237 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:30.237 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:30.237 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:30.237 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:30.237 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.238 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:30.238 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002068+0000", 2024-04-18T21:07:30.238 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:30.238 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.238 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.238 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:30.238 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002068+0000", 2024-04-18T21:07:30.238 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:30.238 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.238 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.238 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:30.238 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002069+0000", 2024-04-18T21:07:30.238 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7899999999999999e-07 2024-04-18T21:07:30.238 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.239 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.239 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:30.239 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002071+0000", 2024-04-18T21:07:30.239 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.356e-06 2024-04-18T21:07:30.239 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.239 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.239 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:30.239 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002078+0000", 2024-04-18T21:07:30.239 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.562e-06 2024-04-18T21:07:30.239 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.239 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.239 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:30.239 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002083+0000", 2024-04-18T21:07:30.239 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1939999999999997e-06 2024-04-18T21:07:30.240 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.240 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.240 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:30.240 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002125+0000", 2024-04-18T21:07:30.240 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2548e-05 2024-04-18T21:07:30.240 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.240 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.240 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:30.240 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.002132+0000", 2024-04-18T21:07:30.240 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9360000000000002e-06 2024-04-18T21:07:30.240 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.240 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.240 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:30.240 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.484392+0000", 2024-04-18T21:07:30.241 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.48225933500000001 2024-04-18T21:07:30.241 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.241 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.241 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:30.241 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.484630+0000", 2024-04-18T21:07:30.241 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023872499999999999 2024-04-18T21:07:30.241 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.241 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.241 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:30.241 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.484812+0000", 2024-04-18T21:07:30.241 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000181232 2024-04-18T21:07:30.241 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.241 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.241 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:30.241 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.490995+0000", 2024-04-18T21:07:30.242 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0061831459999999996 2024-04-18T21:07:30.242 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.242 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.242 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:30.242 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491132+0000", 2024-04-18T21:07:30.242 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000137145 2024-04-18T21:07:30.242 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.242 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.242 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:30.242 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491219+0000", 2024-04-18T21:07:30.242 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7466000000000006e-05 2024-04-18T21:07:30.242 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.242 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.242 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:30.242 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491451+0000", 2024-04-18T21:07:30.243 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023129800000000001 2024-04-18T21:07:30.243 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:30.243 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:30.243 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:30.243 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.243 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.243 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:12057 4.13 4:cacbe4c4:::10000002d77.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:30.243 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:16.028144+0000", 2024-04-18T21:07:30.243 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 14.136467523, 2024-04-18T21:07:30.243 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.46365036100000001, 2024-04-18T21:07:30.243 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:30.243 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:30.243 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:30.243 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:30.243 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.244 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:30.244 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028144+0000", 2024-04-18T21:07:30.244 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:30.244 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.244 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.244 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:30.244 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028144+0000", 2024-04-18T21:07:30.244 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:30.244 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.244 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.244 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:30.244 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028144+0000", 2024-04-18T21:07:30.244 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9800000000000003e-07 2024-04-18T21:07:30.244 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.244 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.245 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:30.245 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028147+0000", 2024-04-18T21:07:30.245 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.773e-06 2024-04-18T21:07:30.245 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.245 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.245 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:30.245 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028154+0000", 2024-04-18T21:07:30.245 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8940000000000004e-06 2024-04-18T21:07:30.245 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.245 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.245 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:30.245 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028160+0000", 2024-04-18T21:07:30.245 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7219999999999996e-06 2024-04-18T21:07:30.245 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.245 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.245 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:30.246 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028227+0000", 2024-04-18T21:07:30.246 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6711000000000006e-05 2024-04-18T21:07:30.246 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.246 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.246 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:30.246 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.028250+0000", 2024-04-18T21:07:30.246 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3010000000000002e-05 2024-04-18T21:07:30.246 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.246 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.246 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:30.246 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.487484+0000", 2024-04-18T21:07:30.246 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.45923466600000001 2024-04-18T21:07:30.246 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.246 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.247 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:30.247 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.487750+0000", 2024-04-18T21:07:30.247 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026618799999999999 2024-04-18T21:07:30.247 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.247 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.247 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:30.247 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.487915+0000", 2024-04-18T21:07:30.247 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016425500000000001 2024-04-18T21:07:30.247 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.247 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.247 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:30.247 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491559+0000", 2024-04-18T21:07:30.247 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003644109 2024-04-18T21:07:30.247 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.247 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.247 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:30.248 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491586+0000", 2024-04-18T21:07:30.248 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.743e-05 2024-04-18T21:07:30.248 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.248 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.248 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:30.248 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491662+0000", 2024-04-18T21:07:30.248 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5978999999999999e-05 2024-04-18T21:07:30.248 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.248 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.248 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:30.248 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491794+0000", 2024-04-18T21:07:30.248 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013202600000000001 2024-04-18T21:07:30.248 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:30.248 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:30.248 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:30.248 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.249 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.249 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:12078 4.13 4:c93107e9:::10000002d8c.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:30.249 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:16.031090+0000", 2024-04-18T21:07:30.249 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 14.133521656999999, 2024-04-18T21:07:30.249 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.461078355, 2024-04-18T21:07:30.249 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:30.249 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:30.249 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:30.249 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:30.249 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.249 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:30.249 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031090+0000", 2024-04-18T21:07:30.249 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:30.249 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.249 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.249 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:30.250 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031090+0000", 2024-04-18T21:07:30.250 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:30.250 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.250 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.250 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:30.250 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031090+0000", 2024-04-18T21:07:30.250 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6599999999999996e-07 2024-04-18T21:07:30.250 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.250 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.250 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:30.250 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031093+0000", 2024-04-18T21:07:30.250 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7659999999999999e-06 2024-04-18T21:07:30.250 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.250 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.250 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:30.251 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031099+0000", 2024-04-18T21:07:30.251 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2269999999999998e-06 2024-04-18T21:07:30.251 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.251 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.251 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:30.251 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031103+0000", 2024-04-18T21:07:30.251 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7929999999999999e-06 2024-04-18T21:07:30.251 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.251 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.251 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:30.251 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031147+0000", 2024-04-18T21:07:30.251 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3742000000000002e-05 2024-04-18T21:07:30.251 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.251 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.251 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:30.251 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031154+0000", 2024-04-18T21:07:30.251 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1999999999999997e-06 2024-04-18T21:07:30.252 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.252 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.252 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:30.252 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.488743+0000", 2024-04-18T21:07:30.252 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.45758900200000002 2024-04-18T21:07:30.252 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.252 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.252 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:30.252 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.488980+0000", 2024-04-18T21:07:30.252 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023704499999999999 2024-04-18T21:07:30.252 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.252 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.252 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:30.252 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.489166+0000", 2024-04-18T21:07:30.253 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018544500000000001 2024-04-18T21:07:30.253 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.253 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.253 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:30.253 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491810+0000", 2024-04-18T21:07:30.253 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026448219999999998 2024-04-18T21:07:30.253 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.253 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.253 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:30.253 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491903+0000", 2024-04-18T21:07:30.253 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2305999999999993e-05 2024-04-18T21:07:30.253 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.253 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.253 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:30.253 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.491987+0000", 2024-04-18T21:07:30.253 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4581999999999998e-05 2024-04-18T21:07:30.253 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.254 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.254 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:30.254 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.492168+0000", 2024-04-18T21:07:30.254 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018075900000000001 2024-04-18T21:07:30.254 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:30.254 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:30.254 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:30.254 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.254 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.254 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:12081 4.13 4:cafa1dfa:::10000002d8f.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-18T21:07:30.254 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:16.031865+0000", 2024-04-18T21:07:30.254 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 14.132746622999999, 2024-04-18T21:07:30.254 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.460588628, 2024-04-18T21:07:30.255 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:30.255 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:30.255 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:30.255 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:30.255 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.255 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:30.255 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031865+0000", 2024-04-18T21:07:30.255 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:30.255 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.255 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.255 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:30.255 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031865+0000", 2024-04-18T21:07:30.255 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:30.255 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.256 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.256 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:30.256 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031865+0000", 2024-04-18T21:07:30.256 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4799999999999998e-07 2024-04-18T21:07:30.256 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.256 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.256 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:30.256 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031868+0000", 2024-04-18T21:07:30.256 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6570000000000001e-06 2024-04-18T21:07:30.256 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.256 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.256 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:30.256 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031874+0000", 2024-04-18T21:07:30.256 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4370000000000004e-06 2024-04-18T21:07:30.257 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.257 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.257 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:30.257 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031879+0000", 2024-04-18T21:07:30.257 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8729999999999998e-06 2024-04-18T21:07:30.257 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.257 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.257 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:30.257 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031924+0000", 2024-04-18T21:07:30.257 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4314999999999998e-05 2024-04-18T21:07:30.257 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.257 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.257 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-04-18T21:07:30.257 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.031929+0000", 2024-04-18T21:07:30.258 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9980000000000003e-06 2024-04-18T21:07:30.258 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.258 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.258 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:30.258 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.489813+0000", 2024-04-18T21:07:30.258 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.45788481800000003 2024-04-18T21:07:30.258 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.258 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.258 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:30.258 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.490188+0000", 2024-04-18T21:07:30.258 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00037420699999999999 2024-04-18T21:07:30.258 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.258 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.259 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-18T21:07:30.259 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.490423+0000", 2024-04-18T21:07:30.259 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023582400000000001 2024-04-18T21:07:30.259 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.259 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.259 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:30.259 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.492238+0000", 2024-04-18T21:07:30.259 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018143930000000001 2024-04-18T21:07:30.259 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.259 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.259 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-18T21:07:30.259 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.492256+0000", 2024-04-18T21:07:30.259 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7706999999999998e-05 2024-04-18T21:07:30.259 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.259 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.259 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-18T21:07:30.260 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.492323+0000", 2024-04-18T21:07:30.260 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7222000000000001e-05 2024-04-18T21:07:30.260 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.260 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.260 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:30.260 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:16.492453+0000", 2024-04-18T21:07:30.260 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000130529 2024-04-18T21:07:30.260 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:30.260 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:30.260 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:30.260 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.260 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.260 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:19730 4.b 4:d2626379:::10000000022.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-18T21:07:30.260 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:25.986635+0000", 2024-04-18T21:07:30.260 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.1779767300000001, 2024-04-18T21:07:30.260 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066727102999999996, 2024-04-18T21:07:30.261 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:30.261 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:30.261 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:07:30.261 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:30.261 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.261 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:30.261 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.986635+0000", 2024-04-18T21:07:30.261 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:30.261 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.261 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.261 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:30.261 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.986635+0000", 2024-04-18T21:07:30.261 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:30.261 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.261 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.261 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:30.261 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.986636+0000", 2024-04-18T21:07:30.262 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0729999999999999e-06 2024-04-18T21:07:30.262 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.262 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.262 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:30.262 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.986643+0000", 2024-04-18T21:07:30.262 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4100000000000002e-06 2024-04-18T21:07:30.262 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.262 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.262 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:30.262 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.986661+0000", 2024-04-18T21:07:30.262 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7547e-05 2024-04-18T21:07:30.262 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.262 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.262 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:30.263 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.986674+0000", 2024-04-18T21:07:30.263 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3416e-05 2024-04-18T21:07:30.263 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.263 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.263 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:30.263 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.989521+0000", 2024-04-18T21:07:30.263 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002846964 2024-04-18T21:07:30.263 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.263 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.263 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:30.263 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.989673+0000", 2024-04-18T21:07:30.263 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015206099999999999 2024-04-18T21:07:30.263 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.263 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.263 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:30.263 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:26.053362+0000", 2024-04-18T21:07:30.264 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.063688631999999995 2024-04-18T21:07:30.264 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:30.264 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:30.264 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:30.264 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.264 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.264 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:19778 4.b 4:d30f9a54:::10000000052.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-18T21:07:30.264 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:25.988307+0000", 2024-04-18T21:07:30.264 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.1763038630000002, 2024-04-18T21:07:30.264 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066388437999999994, 2024-04-18T21:07:30.264 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:30.264 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:30.264 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:07:30.264 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:30.264 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.264 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:30.265 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.988307+0000", 2024-04-18T21:07:30.265 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:30.265 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.265 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.265 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:30.265 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.988307+0000", 2024-04-18T21:07:30.265 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:30.265 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.265 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.265 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:30.265 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.988308+0000", 2024-04-18T21:07:30.265 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1600000000000002e-07 2024-04-18T21:07:30.265 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.265 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.266 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:30.266 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.988310+0000", 2024-04-18T21:07:30.266 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5799999999999999e-06 2024-04-18T21:07:30.266 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.266 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.266 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:30.266 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.988319+0000", 2024-04-18T21:07:30.266 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2519999999999999e-06 2024-04-18T21:07:30.266 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.266 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.266 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:30.266 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.988326+0000", 2024-04-18T21:07:30.266 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0489999999999998e-06 2024-04-18T21:07:30.266 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.267 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.267 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:30.267 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.990151+0000", 2024-04-18T21:07:30.267 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018252940000000001 2024-04-18T21:07:30.267 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.267 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.267 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:30.267 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.990290+0000", 2024-04-18T21:07:30.267 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000138455 2024-04-18T21:07:30.267 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.267 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.267 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:30.267 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:26.054696+0000", 2024-04-18T21:07:30.267 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.064406392000000007 2024-04-18T21:07:30.267 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:30.268 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:30.268 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:30.268 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.268 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.268 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:19779 4.16 4:6a23747e:::10000000053.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-18T21:07:30.268 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:25.988334+0000", 2024-04-18T21:07:30.268 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.1762776150000001, 2024-04-18T21:07:30.268 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.064471757000000005, 2024-04-18T21:07:30.268 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:30.268 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:30.268 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:07:30.268 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:30.268 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.268 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:30.269 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.988334+0000", 2024-04-18T21:07:30.269 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:30.269 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.269 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.269 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:30.269 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.988334+0000", 2024-04-18T21:07:30.269 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:30.269 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.269 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.269 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:30.269 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.988334+0000", 2024-04-18T21:07:30.269 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7599999999999997e-07 2024-04-18T21:07:30.269 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.269 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.269 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:30.269 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.988337+0000", 2024-04-18T21:07:30.270 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3159999999999999e-06 2024-04-18T21:07:30.270 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.270 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.270 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:30.270 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.988345+0000", 2024-04-18T21:07:30.270 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.422e-06 2024-04-18T21:07:30.270 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.270 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.270 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:30.270 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.988354+0000", 2024-04-18T21:07:30.270 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7960000000000001e-06 2024-04-18T21:07:30.270 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.270 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.271 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:30.271 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:26.037820+0000", 2024-04-18T21:07:30.271 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.049466046999999999 2024-04-18T21:07:30.271 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.271 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.271 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:30.271 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:26.037977+0000", 2024-04-18T21:07:30.271 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015769699999999999 2024-04-18T21:07:30.271 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.271 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.271 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:30.271 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:26.052805+0000", 2024-04-18T21:07:30.271 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014828002999999999 2024-04-18T21:07:30.271 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:30.271 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:30.271 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:30.272 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.272 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.272 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:19830 4.2e 4:74218cdb:::10000000086.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-18T21:07:30.272 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-18T21:07:25.991337+0000", 2024-04-18T21:07:30.272 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.1732747129999996, 2024-04-18T21:07:30.272 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.068113884999999999, 2024-04-18T21:07:30.272 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-04-18T21:07:30.272 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-18T21:07:30.272 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-18T21:07:30.272 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-18T21:07:30.272 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.272 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-18T21:07:30.272 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.991337+0000", 2024-04-18T21:07:30.272 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:30.273 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.273 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.273 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-18T21:07:30.273 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.991337+0000", 2024-04-18T21:07:30.273 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-18T21:07:30.273 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.273 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.273 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-18T21:07:30.273 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.991337+0000", 2024-04-18T21:07:30.273 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7199999999999999e-07 2024-04-18T21:07:30.273 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.273 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.273 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-18T21:07:30.273 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.991339+0000", 2024-04-18T21:07:30.274 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1969999999999999e-06 2024-04-18T21:07:30.274 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.274 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.274 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-18T21:07:30.274 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.991347+0000", 2024-04-18T21:07:30.274 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1610000000000003e-06 2024-04-18T21:07:30.274 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.274 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.274 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-18T21:07:30.274 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:25.991355+0000", 2024-04-18T21:07:30.274 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3089999999999998e-06 2024-04-18T21:07:30.274 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.274 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.274 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-18T21:07:30.275 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:26.040335+0000", 2024-04-18T21:07:30.275 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.048980193999999998 2024-04-18T21:07:30.275 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.275 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.275 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-18T21:07:30.275 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:26.040471+0000", 2024-04-18T21:07:30.275 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013571300000000001 2024-04-18T21:07:30.275 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-18T21:07:30.275 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-18T21:07:30.275 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-18T21:07:30.275 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-18T21:07:26.059451+0000", 2024-04-18T21:07:30.275 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018979838999999998 2024-04-18T21:07:30.275 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:30.275 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:30.275 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:30.276 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-18T21:07:30.276 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-18T21:07:30.276 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:07:30.277 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:07:30.278 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:30.277+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:30.378 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:30.378+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:30.409 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:07:30.409 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:07:30.409 INFO:teuthology.orchestra.run.smithi132.stdout: "num_ops": 0 2024-04-18T21:07:30.409 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:07:30.425 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:07:30.479 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:30.482+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:30.528 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-18T21:07:30.547 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:07:30.548 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [], 2024-04-18T21:07:30.548 INFO:teuthology.orchestra.run.smithi132.stdout: "complaint_time": 30, 2024-04-18T21:07:30.548 INFO:teuthology.orchestra.run.smithi132.stdout: "num_blocked_ops": 0 2024-04-18T21:07:30.548 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:07:30.561 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:07:30.580 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:30.578+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:30.681 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-18T21:07:30.681 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 20, 2024-04-18T21:07:30.681 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 600, 2024-04-18T21:07:30.681 INFO:teuthology.orchestra.run.smithi132.stdout: "ops": [ 2024-04-18T21:07:30.681 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.681 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(client.4534.0:15094 4.c 4:32870457:::10000003692.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-18T21:07:30.681 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:03.107374+0000", 2024-04-18T21:07:30.681 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 27.573408101999998, 2024-04-18T21:07:30.682 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.061575983000000001, 2024-04-18T21:07:30.682 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:30.682 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:30.682 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:30.682 INFO:teuthology.orchestra.run.smithi132.stdout: "client_info": { 2024-04-18T21:07:30.682 INFO:teuthology.orchestra.run.smithi132.stdout: "client": "client.4534", 2024-04-18T21:07:30.682 INFO:teuthology.orchestra.run.smithi132.stdout: "client_addr": "192.168.0.1:0/2547679229", 2024-04-18T21:07:30.682 INFO:teuthology.orchestra.run.smithi132.stdout: "tid": 15094 2024-04-18T21:07:30.682 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.682 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:30.682 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.682 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:30.682 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.107374+0000", 2024-04-18T21:07:30.683 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:30.683 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.683 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.683 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:30.683 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.107374+0000", 2024-04-18T21:07:30.683 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:30.683 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.683 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.683 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:30.683 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.107376+0000", 2024-04-18T21:07:30.683 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3969999999999999e-06 2024-04-18T21:07:30.683 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.683 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.684 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:30.684 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115698+0000", 2024-04-18T21:07:30.684 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0083223989999999994 2024-04-18T21:07:30.684 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.684 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.684 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:30.684 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115713+0000", 2024-04-18T21:07:30.684 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4385e-05 2024-04-18T21:07:30.684 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.684 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.685 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:30.685 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115722+0000", 2024-04-18T21:07:30.685 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.0759999999999992e-06 2024-04-18T21:07:30.685 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.685 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.685 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:30.685 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115784+0000", 2024-04-18T21:07:30.685 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.2348999999999995e-05 2024-04-18T21:07:30.685 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.685 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.685 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:30.685 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.115849+0000", 2024-04-18T21:07:30.685 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.4964999999999999e-05 2024-04-18T21:07:30.685 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.686 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.686 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:30.686 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.116054+0000", 2024-04-18T21:07:30.686 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00020483400000000001 2024-04-18T21:07:30.686 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.686 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.686 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:30.686 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.125769+0000", 2024-04-18T21:07:30.686 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0097153340000000008 2024-04-18T21:07:30.686 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.686 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.686 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:30.686 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.168834+0000", 2024-04-18T21:07:30.687 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.043064527999999998 2024-04-18T21:07:30.687 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.687 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.687 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:30.687 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.168882+0000", 2024-04-18T21:07:30.687 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.7919e-05 2024-04-18T21:07:30.687 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.687 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.687 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:30.687 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:03.168950+0000", 2024-04-18T21:07:30.687 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.8796999999999999e-05 2024-04-18T21:07:30.687 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:30.687 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:30.687 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:30.688 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.688 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.688 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7616 4.d 4:b1f7eab6:::10000001d5f.00000000:head [delete] snapc 1=[] RETRY=2 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:30.688 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882522+0000", 2024-04-18T21:07:30.688 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 18.798260209999999, 2024-04-18T21:07:30.688 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.086006255, 2024-04-18T21:07:30.688 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:30.688 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:30.688 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "reached pg", 2024-04-18T21:07:30.688 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:30.688 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.688 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:30.688 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882522+0000", 2024-04-18T21:07:30.689 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:30.689 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.689 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.689 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:30.689 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882522+0000", 2024-04-18T21:07:30.689 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:30.689 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.689 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.689 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:30.689 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882524+0000", 2024-04-18T21:07:30.689 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4720000000000001e-06 2024-04-18T21:07:30.689 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.689 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.689 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:30.690 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882531+0000", 2024-04-18T21:07:30.690 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7830000000000001e-06 2024-04-18T21:07:30.690 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.690 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.690 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:30.690 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882549+0000", 2024-04-18T21:07:30.690 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8765000000000001e-05 2024-04-18T21:07:30.690 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.690 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.690 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:30.690 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882562+0000", 2024-04-18T21:07:30.690 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3117e-05 2024-04-18T21:07:30.690 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.690 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.690 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:30.691 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882690+0000", 2024-04-18T21:07:30.691 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00012794799999999999 2024-04-18T21:07:30.691 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.691 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.691 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op must wait for map", 2024-04-18T21:07:30.691 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882701+0000", 2024-04-18T21:07:30.691 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0215e-05 2024-04-18T21:07:30.691 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.691 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.691 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:30.691 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.891964+0000", 2024-04-18T21:07:30.691 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0092636130000000004 2024-04-18T21:07:30.691 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.691 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.692 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:30.692 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.891976+0000", 2024-04-18T21:07:30.692 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1973e-05 2024-04-18T21:07:30.692 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.692 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.692 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:30.692 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.959520+0000", 2024-04-18T21:07:30.692 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0675436009999999 2024-04-18T21:07:30.692 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.692 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.692 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for missing object", 2024-04-18T21:07:30.692 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.959662+0000", 2024-04-18T21:07:30.692 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014253000000000001 2024-04-18T21:07:30.692 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.692 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.693 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:30.693 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.968480+0000", 2024-04-18T21:07:30.693 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0088178409999999999 2024-04-18T21:07:30.693 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.693 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.693 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:30.693 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.968529+0000", 2024-04-18T21:07:30.693 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8396999999999998e-05 2024-04-18T21:07:30.693 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:30.693 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:30.693 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:30.693 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.693 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.693 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7628 4.31 4:8c97f9cd:::10000001d6c.00000000:head [delete] snapc 1=[] RETRY=2 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:30.694 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882610+0000", 2024-04-18T21:07:30.694 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 18.798172480000002, 2024-04-18T21:07:30.694 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.08538018, 2024-04-18T21:07:30.694 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:30.694 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:30.694 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "reached pg", 2024-04-18T21:07:30.694 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:30.694 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.694 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:30.694 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882610+0000", 2024-04-18T21:07:30.694 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:30.694 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.694 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.694 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:30.694 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882610+0000", 2024-04-18T21:07:30.695 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:30.695 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.695 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.695 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:30.695 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882611+0000", 2024-04-18T21:07:30.695 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.4199999999999995e-07 2024-04-18T21:07:30.695 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.695 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.695 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:30.695 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882614+0000", 2024-04-18T21:07:30.695 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.4300000000000002e-06 2024-04-18T21:07:30.695 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.695 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.696 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:30.696 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882623+0000", 2024-04-18T21:07:30.696 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.8740000000000001e-06 2024-04-18T21:07:30.696 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.696 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.696 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:30.696 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882629+0000", 2024-04-18T21:07:30.696 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.4330000000000001e-06 2024-04-18T21:07:30.696 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.696 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.696 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:30.696 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882706+0000", 2024-04-18T21:07:30.696 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.6280999999999997e-05 2024-04-18T21:07:30.696 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.696 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.697 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op must wait for map", 2024-04-18T21:07:30.697 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882715+0000", 2024-04-18T21:07:30.697 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.1679999999999993e-06 2024-04-18T21:07:30.697 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.697 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.697 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:30.697 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.889481+0000", 2024-04-18T21:07:30.697 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0067656979999999997 2024-04-18T21:07:30.697 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.697 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.697 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:30.697 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.889493+0000", 2024-04-18T21:07:30.697 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2451e-05 2024-04-18T21:07:30.697 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.697 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.697 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:30.698 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.940942+0000", 2024-04-18T21:07:30.698 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0514491720000001 2024-04-18T21:07:30.698 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.698 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.698 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for missing object", 2024-04-18T21:07:30.698 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.941134+0000", 2024-04-18T21:07:30.698 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019150600000000001 2024-04-18T21:07:30.698 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.698 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.698 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:30.698 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.967914+0000", 2024-04-18T21:07:30.698 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.026780202999999999 2024-04-18T21:07:30.698 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.698 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.699 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:30.699 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.967990+0000", 2024-04-18T21:07:30.699 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.6322000000000006e-05 2024-04-18T21:07:30.699 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:30.699 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:30.699 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:30.699 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.699 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.699 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7630 4.d 4:b022c802:::10000001d6e.00000000:head [delete] snapc 1=[] RETRY=2 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:30.699 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882645+0000", 2024-04-18T21:07:30.699 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 18.798137195999999, 2024-04-18T21:07:30.699 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0858072780000001, 2024-04-18T21:07:30.699 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:30.699 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:30.699 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "reached pg", 2024-04-18T21:07:30.700 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:30.700 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.700 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:30.700 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882645+0000", 2024-04-18T21:07:30.700 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:30.700 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.700 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.700 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:30.700 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882645+0000", 2024-04-18T21:07:30.700 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:30.700 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.700 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.700 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:30.700 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882646+0000", 2024-04-18T21:07:30.700 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.3599999999999999e-07 2024-04-18T21:07:30.701 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.701 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.701 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:30.701 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882648+0000", 2024-04-18T21:07:30.701 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.5809999999999999e-06 2024-04-18T21:07:30.701 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.701 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.701 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:30.701 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882655+0000", 2024-04-18T21:07:30.701 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.7909999999999999e-06 2024-04-18T21:07:30.701 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.701 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.701 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:30.702 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882661+0000", 2024-04-18T21:07:30.702 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3920000000000002e-06 2024-04-18T21:07:30.702 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.702 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.702 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:30.702 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882825+0000", 2024-04-18T21:07:30.702 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00016480100000000001 2024-04-18T21:07:30.702 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.702 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.702 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:07:30.702 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882840+0000", 2024-04-18T21:07:30.702 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4656e-05 2024-04-18T21:07:30.702 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.702 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.703 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:30.703 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.892020+0000", 2024-04-18T21:07:30.703 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0091804680000000007 2024-04-18T21:07:30.703 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.703 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.703 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:30.703 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.892026+0000", 2024-04-18T21:07:30.703 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4580000000000001e-06 2024-04-18T21:07:30.703 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.703 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.703 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:30.703 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.959913+0000", 2024-04-18T21:07:30.703 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.067887289 2024-04-18T21:07:30.703 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.703 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.704 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for missing object", 2024-04-18T21:07:30.704 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.960034+0000", 2024-04-18T21:07:30.704 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000120445 2024-04-18T21:07:30.704 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.704 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.704 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:30.704 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.968407+0000", 2024-04-18T21:07:30.704 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0083734010000000008 2024-04-18T21:07:30.704 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.704 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.704 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:30.704 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.968453+0000", 2024-04-18T21:07:30.705 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.5559999999999997e-05 2024-04-18T21:07:30.705 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:30.705 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:30.705 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:30.705 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.705 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.705 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7651 4.13 4:c9951bc5:::10000001e1b.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:30.705 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882696+0000", 2024-04-18T21:07:30.705 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 18.798086782999999, 2024-04-18T21:07:30.705 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.088382095, 2024-04-18T21:07:30.705 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:30.705 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:30.705 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:30.706 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:30.706 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.706 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:30.706 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882696+0000", 2024-04-18T21:07:30.706 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:30.706 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.706 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.706 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:30.706 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882696+0000", 2024-04-18T21:07:30.706 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:30.706 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.706 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.706 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:30.706 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882696+0000", 2024-04-18T21:07:30.707 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.06e-07 2024-04-18T21:07:30.707 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.707 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.707 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:30.707 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882699+0000", 2024-04-18T21:07:30.707 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.1039999999999998e-06 2024-04-18T21:07:30.707 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.707 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.707 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:30.707 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882707+0000", 2024-04-18T21:07:30.707 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.593e-06 2024-04-18T21:07:30.707 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.707 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.707 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:30.708 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882712+0000", 2024-04-18T21:07:30.708 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.541e-06 2024-04-18T21:07:30.708 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.708 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.708 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:30.708 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882870+0000", 2024-04-18T21:07:30.708 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000157999 2024-04-18T21:07:30.708 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.708 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.708 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op must wait for map", 2024-04-18T21:07:30.708 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882885+0000", 2024-04-18T21:07:30.708 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4989e-05 2024-04-18T21:07:30.708 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.709 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.709 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:30.709 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.891447+0000", 2024-04-18T21:07:30.709 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0085618540000000007 2024-04-18T21:07:30.709 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.709 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.709 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:30.709 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.891457+0000", 2024-04-18T21:07:30.709 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.6399999999999992e-06 2024-04-18T21:07:30.709 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.709 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.709 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:30.709 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.964840+0000", 2024-04-18T21:07:30.710 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.073383279 2024-04-18T21:07:30.710 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.710 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.710 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:30.710 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.965078+0000", 2024-04-18T21:07:30.710 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000237581 2024-04-18T21:07:30.710 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.710 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.710 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:30.710 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.965299+0000", 2024-04-18T21:07:30.710 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00022087699999999999 2024-04-18T21:07:30.710 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.710 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.711 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:30.711 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.969505+0000", 2024-04-18T21:07:30.711 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.004206123 2024-04-18T21:07:30.711 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.711 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.711 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:30.711 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.970898+0000", 2024-04-18T21:07:30.711 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.001393434 2024-04-18T21:07:30.711 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.711 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.711 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:30.711 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.970936+0000", 2024-04-18T21:07:30.711 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.7647000000000001e-05 2024-04-18T21:07:30.711 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.711 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.711 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:30.712 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.971078+0000", 2024-04-18T21:07:30.712 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014192799999999999 2024-04-18T21:07:30.712 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:30.712 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:30.712 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:30.712 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.712 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.712 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7671 4.31 4:8c95a1b7:::10000001e2f.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:30.712 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882728+0000", 2024-04-18T21:07:30.712 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 18.798054948000001, 2024-04-18T21:07:30.712 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.084467606, 2024-04-18T21:07:30.712 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:30.712 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:30.712 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:30.713 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:30.713 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.713 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:30.713 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882728+0000", 2024-04-18T21:07:30.713 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:30.713 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.713 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.713 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:30.713 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882728+0000", 2024-04-18T21:07:30.713 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:30.713 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.713 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.713 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:30.714 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882728+0000", 2024-04-18T21:07:30.714 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.0399999999999996e-07 2024-04-18T21:07:30.714 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.714 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.714 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:30.714 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882731+0000", 2024-04-18T21:07:30.714 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.5239999999999999e-06 2024-04-18T21:07:30.714 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.714 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.714 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:30.714 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882739+0000", 2024-04-18T21:07:30.714 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 8.4020000000000002e-06 2024-04-18T21:07:30.714 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.714 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.714 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:30.714 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882744+0000", 2024-04-18T21:07:30.715 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.1410000000000004e-06 2024-04-18T21:07:30.715 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.715 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.715 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:30.715 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882836+0000", 2024-04-18T21:07:30.715 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.2094000000000003e-05 2024-04-18T21:07:30.715 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.715 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.715 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:07:30.715 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882849+0000", 2024-04-18T21:07:30.715 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3087e-05 2024-04-18T21:07:30.715 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.715 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.715 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:30.715 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.889522+0000", 2024-04-18T21:07:30.715 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0066730950000000004 2024-04-18T21:07:30.716 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.716 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.716 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:30.716 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.889530+0000", 2024-04-18T21:07:30.716 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.8699999999999992e-06 2024-04-18T21:07:30.716 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.716 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.716 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:30.716 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.941173+0000", 2024-04-18T21:07:30.716 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.051642658 2024-04-18T21:07:30.716 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.716 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.716 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:30.716 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.941392+0000", 2024-04-18T21:07:30.716 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00021854099999999999 2024-04-18T21:07:30.717 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.717 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.717 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:30.717 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.941618+0000", 2024-04-18T21:07:30.717 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0002265 2024-04-18T21:07:30.717 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.717 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.717 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:30.717 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.945390+0000", 2024-04-18T21:07:30.717 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0037723460000000002 2024-04-18T21:07:30.717 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.717 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.717 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:30.718 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.966905+0000", 2024-04-18T21:07:30.718 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.021514559999999999 2024-04-18T21:07:30.718 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.718 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.718 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:30.718 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.966972+0000", 2024-04-18T21:07:30.718 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.6740000000000001e-05 2024-04-18T21:07:30.718 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.718 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.718 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:30.718 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.967195+0000", 2024-04-18T21:07:30.718 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000223544 2024-04-18T21:07:30.718 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:30.719 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:30.719 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:30.719 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.719 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.719 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:7691 4.d 4:b0345396:::10000001e43.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-18T21:07:30.719 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:11.882753+0000", 2024-04-18T21:07:30.719 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 18.798029969000002, 2024-04-18T21:07:30.719 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.085135618, 2024-04-18T21:07:30.719 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:30.719 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:30.719 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-18T21:07:30.719 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:30.719 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.720 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:30.720 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882753+0000", 2024-04-18T21:07:30.720 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:30.720 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.720 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.720 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:30.720 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882753+0000", 2024-04-18T21:07:30.720 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:30.720 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.720 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.720 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:30.720 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882753+0000", 2024-04-18T21:07:30.720 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.9000000000000002e-07 2024-04-18T21:07:30.720 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.720 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.720 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:30.721 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882755+0000", 2024-04-18T21:07:30.721 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.4040000000000002e-06 2024-04-18T21:07:30.721 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.721 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.721 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:30.721 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882762+0000", 2024-04-18T21:07:30.721 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 6.6229999999999999e-06 2024-04-18T21:07:30.721 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.721 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.721 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:30.721 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882769+0000", 2024-04-18T21:07:30.721 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.1559999999999998e-06 2024-04-18T21:07:30.721 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.721 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.721 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:30.721 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882875+0000", 2024-04-18T21:07:30.722 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000105491 2024-04-18T21:07:30.722 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.722 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.722 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting_for_map not empty", 2024-04-18T21:07:30.722 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.882879+0000", 2024-04-18T21:07:30.722 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 3.9999999999999998e-06 2024-04-18T21:07:30.722 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.722 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.722 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:30.722 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.892072+0000", 2024-04-18T21:07:30.722 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0091930989999999997 2024-04-18T21:07:30.722 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.722 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.723 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for peered", 2024-04-18T21:07:30.723 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:11.892083+0000", 2024-04-18T21:07:30.723 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.1070000000000001e-05 2024-04-18T21:07:30.723 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.723 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.723 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:30.723 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.960162+0000", 2024-04-18T21:07:30.723 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0680791869999999 2024-04-18T21:07:30.723 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.723 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.723 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:30.723 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.960314+0000", 2024-04-18T21:07:30.723 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000152139 2024-04-18T21:07:30.723 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.724 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.724 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "waiting for subops from 2", 2024-04-18T21:07:30.724 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.960469+0000", 2024-04-18T21:07:30.724 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000154444 2024-04-18T21:07:30.724 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.724 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.724 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "op_commit", 2024-04-18T21:07:30.724 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.964018+0000", 2024-04-18T21:07:30.724 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0035494179999999999 2024-04-18T21:07:30.724 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.724 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.724 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "sub_op_commit_rec", 2024-04-18T21:07:30.724 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.967680+0000", 2024-04-18T21:07:30.724 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.003662046 2024-04-18T21:07:30.725 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.725 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.725 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "commit_sent", 2024-04-18T21:07:30.725 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.967738+0000", 2024-04-18T21:07:30.725 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.7946999999999999e-05 2024-04-18T21:07:30.725 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.725 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.725 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:30.725 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:12.967888+0000", 2024-04-18T21:07:30.725 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.000150204 2024-04-18T21:07:30.725 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:30.726 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:30.726 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:30.726 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.726 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.726 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:20010 4.1a 4:5997e84c:::1000000013a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-18T21:07:30.726 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:25.995286+0000", 2024-04-18T21:07:30.726 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 4.6854962950000001, 2024-04-18T21:07:30.726 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.062172181, 2024-04-18T21:07:30.726 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:30.726 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:30.726 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:07:30.726 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:30.726 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.726 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:30.727 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995286+0000", 2024-04-18T21:07:30.727 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:30.727 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.727 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.727 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:30.727 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995286+0000", 2024-04-18T21:07:30.727 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:30.727 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.727 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.727 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:30.727 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995287+0000", 2024-04-18T21:07:30.727 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.034e-06 2024-04-18T21:07:30.727 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.727 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.728 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:30.728 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995292+0000", 2024-04-18T21:07:30.728 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.8029999999999996e-06 2024-04-18T21:07:30.728 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.728 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.728 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:30.728 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995308+0000", 2024-04-18T21:07:30.728 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6113e-05 2024-04-18T21:07:30.728 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.728 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.728 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:30.728 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995321+0000", 2024-04-18T21:07:30.728 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3019e-05 2024-04-18T21:07:30.728 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.729 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.729 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:30.729 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.039546+0000", 2024-04-18T21:07:30.729 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.044224749000000001 2024-04-18T21:07:30.729 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.729 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.729 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:30.729 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.039852+0000", 2024-04-18T21:07:30.729 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00030594699999999999 2024-04-18T21:07:30.729 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.729 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.729 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:30.729 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.057458+0000", 2024-04-18T21:07:30.729 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017606515999999999 2024-04-18T21:07:30.730 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:30.730 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:30.730 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:30.730 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.730 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.730 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:20018 4.1b 4:d9deb994:::10000000142.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-18T21:07:30.730 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:25.995386+0000", 2024-04-18T21:07:30.730 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 4.6853964299999999, 2024-04-18T21:07:30.730 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.066397342999999998, 2024-04-18T21:07:30.730 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:30.730 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:30.730 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:07:30.730 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:30.730 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.731 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:30.731 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995386+0000", 2024-04-18T21:07:30.731 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:30.731 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.731 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.731 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:30.731 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995386+0000", 2024-04-18T21:07:30.731 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:30.731 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.731 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.731 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:30.731 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995387+0000", 2024-04-18T21:07:30.731 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.7300000000000004e-07 2024-04-18T21:07:30.731 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.731 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.732 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:30.732 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995392+0000", 2024-04-18T21:07:30.732 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.6070000000000001e-06 2024-04-18T21:07:30.732 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.732 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.732 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:30.732 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995408+0000", 2024-04-18T21:07:30.732 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6801999999999999e-05 2024-04-18T21:07:30.732 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.732 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.732 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:30.732 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995424+0000", 2024-04-18T21:07:30.732 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5566999999999999e-05 2024-04-18T21:07:30.732 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.732 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.733 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:30.733 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.025739+0000", 2024-04-18T21:07:30.733 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.030314537999999999 2024-04-18T21:07:30.733 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.733 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.733 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:30.733 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.026475+0000", 2024-04-18T21:07:30.733 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00073683699999999995 2024-04-18T21:07:30.733 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.733 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.733 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:30.733 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.061783+0000", 2024-04-18T21:07:30.733 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.035308019000000003 2024-04-18T21:07:30.734 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:30.734 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:30.734 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:30.734 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.734 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.734 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:20021 4.1a 4:587da770:::10000000145.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-18T21:07:30.734 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:25.995439+0000", 2024-04-18T21:07:30.734 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 4.6853430410000003, 2024-04-18T21:07:30.734 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.062273949000000002, 2024-04-18T21:07:30.734 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:30.734 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:30.734 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:07:30.734 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:30.734 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.734 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:30.735 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995439+0000", 2024-04-18T21:07:30.735 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:30.735 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.735 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.735 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:30.735 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995439+0000", 2024-04-18T21:07:30.735 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:30.735 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.735 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.735 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:30.735 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995440+0000", 2024-04-18T21:07:30.735 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.9600000000000008e-07 2024-04-18T21:07:30.735 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.735 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.736 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:30.736 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995445+0000", 2024-04-18T21:07:30.736 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.6569999999999996e-06 2024-04-18T21:07:30.736 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.736 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.736 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:30.736 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995461+0000", 2024-04-18T21:07:30.736 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6089000000000001e-05 2024-04-18T21:07:30.736 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.736 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.736 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:30.736 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.995475+0000", 2024-04-18T21:07:30.736 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4174e-05 2024-04-18T21:07:30.736 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.737 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.737 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:30.737 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.040858+0000", 2024-04-18T21:07:30.737 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.045382359999999997 2024-04-18T21:07:30.737 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.737 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.737 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:30.737 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.041187+0000", 2024-04-18T21:07:30.737 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00032946199999999998 2024-04-18T21:07:30.737 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.737 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.737 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:30.737 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.057713+0000", 2024-04-18T21:07:30.737 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016526210999999999 2024-04-18T21:07:30.738 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:30.738 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:30.738 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:30.738 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.738 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.738 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:20050 4.1a 4:581fb947:::10000000162.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-18T21:07:30.738 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:25.996077+0000", 2024-04-18T21:07:30.738 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 4.6847058429999997, 2024-04-18T21:07:30.738 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.061925185000000001, 2024-04-18T21:07:30.738 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:30.738 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:30.738 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:07:30.738 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:30.738 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.739 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:30.739 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996077+0000", 2024-04-18T21:07:30.739 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:30.739 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.739 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.739 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:30.739 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996077+0000", 2024-04-18T21:07:30.739 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:30.739 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.739 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.739 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:30.739 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996078+0000", 2024-04-18T21:07:30.739 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.046e-06 2024-04-18T21:07:30.739 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.739 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.740 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:30.740 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996083+0000", 2024-04-18T21:07:30.740 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.3630000000000002e-06 2024-04-18T21:07:30.740 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.740 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.740 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:30.740 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996100+0000", 2024-04-18T21:07:30.740 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7214000000000002e-05 2024-04-18T21:07:30.740 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.740 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.740 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:30.740 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996114+0000", 2024-04-18T21:07:30.740 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3713000000000001e-05 2024-04-18T21:07:30.740 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.741 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.741 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:30.741 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.045254+0000", 2024-04-18T21:07:30.741 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.049140085 2024-04-18T21:07:30.741 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.741 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.741 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:30.741 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.045399+0000", 2024-04-18T21:07:30.741 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014537 2024-04-18T21:07:30.741 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.741 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.741 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:30.741 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.058002+0000", 2024-04-18T21:07:30.741 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.012602393999999999 2024-04-18T21:07:30.741 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:30.742 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:30.742 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:30.742 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.742 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.742 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:20060 4.2b 4:d4621505:::1000000016c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-18T21:07:30.742 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:25.996311+0000", 2024-04-18T21:07:30.742 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 4.684471812, 2024-04-18T21:07:30.742 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.065642542999999998, 2024-04-18T21:07:30.742 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:30.742 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:30.742 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:07:30.742 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:30.742 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.742 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:30.743 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996311+0000", 2024-04-18T21:07:30.743 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:30.743 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.743 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.743 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:30.743 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996311+0000", 2024-04-18T21:07:30.743 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:30.743 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.743 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.743 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:30.743 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996313+0000", 2024-04-18T21:07:30.743 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.86e-06 2024-04-18T21:07:30.743 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.743 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.744 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:30.744 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996319+0000", 2024-04-18T21:07:30.744 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.9499999999999998e-06 2024-04-18T21:07:30.744 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.744 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.744 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:30.744 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996340+0000", 2024-04-18T21:07:30.744 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1866e-05 2024-04-18T21:07:30.744 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.744 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.744 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:30.744 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996359+0000", 2024-04-18T21:07:30.744 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8502999999999999e-05 2024-04-18T21:07:30.744 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.745 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.745 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:30.745 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.027528+0000", 2024-04-18T21:07:30.745 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.031168992999999999 2024-04-18T21:07:30.745 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.745 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.745 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:30.745 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.027857+0000", 2024-04-18T21:07:30.745 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00032939200000000002 2024-04-18T21:07:30.745 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.745 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.745 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:30.745 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.061953+0000", 2024-04-18T21:07:30.746 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.034095978999999998 2024-04-18T21:07:30.746 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:30.746 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:30.746 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:30.746 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.746 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.746 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:20072 4.1b 4:d83df968:::10000000178.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-18T21:07:30.746 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:25.996492+0000", 2024-04-18T21:07:30.746 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 4.6842905930000001, 2024-04-18T21:07:30.746 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.065580346999999997, 2024-04-18T21:07:30.746 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:30.746 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:30.746 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:07:30.746 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:30.747 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.747 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:30.747 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996492+0000", 2024-04-18T21:07:30.747 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:30.747 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.747 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.747 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:30.747 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996492+0000", 2024-04-18T21:07:30.747 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:30.747 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.747 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.747 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:30.747 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996493+0000", 2024-04-18T21:07:30.747 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.0130000000000001e-06 2024-04-18T21:07:30.747 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.748 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.748 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:30.748 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996498+0000", 2024-04-18T21:07:30.748 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.7400000000000004e-06 2024-04-18T21:07:30.748 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.748 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.748 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:30.748 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996514+0000", 2024-04-18T21:07:30.748 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6626e-05 2024-04-18T21:07:30.748 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.748 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.748 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:30.748 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996527+0000", 2024-04-18T21:07:30.748 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.289e-05 2024-04-18T21:07:30.749 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.749 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.749 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:30.749 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.028896+0000", 2024-04-18T21:07:30.749 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.032368848999999998 2024-04-18T21:07:30.749 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.749 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.749 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:30.749 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.029266+0000", 2024-04-18T21:07:30.749 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00036995799999999998 2024-04-18T21:07:30.749 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.749 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.749 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:30.749 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.062072+0000", 2024-04-18T21:07:30.749 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.032806270999999998 2024-04-18T21:07:30.750 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:30.750 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:30.750 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:30.750 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.750 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.750 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:20085 4.2b 4:d44b7594:::10000000185.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-18T21:07:30.750 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:25.996650+0000", 2024-04-18T21:07:30.750 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 4.6841325529999995, 2024-04-18T21:07:30.750 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.065498801999999995, 2024-04-18T21:07:30.750 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:30.750 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:30.750 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:07:30.751 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:30.751 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.751 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:30.751 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996650+0000", 2024-04-18T21:07:30.751 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:30.751 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.751 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.751 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:30.751 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996650+0000", 2024-04-18T21:07:30.751 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:30.751 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.751 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.751 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:30.752 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996651+0000", 2024-04-18T21:07:30.752 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.2600000000000001e-07 2024-04-18T21:07:30.752 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.752 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.752 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:30.752 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996656+0000", 2024-04-18T21:07:30.752 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.4299999999999997e-06 2024-04-18T21:07:30.752 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.752 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.752 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:30.752 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996673+0000", 2024-04-18T21:07:30.752 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6520000000000001e-05 2024-04-18T21:07:30.752 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.752 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.753 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:30.753 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996689+0000", 2024-04-18T21:07:30.753 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.5676e-05 2024-04-18T21:07:30.753 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.753 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.753 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:30.753 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.030380+0000", 2024-04-18T21:07:30.753 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.033691929000000002 2024-04-18T21:07:30.753 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.753 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.753 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:30.753 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.030753+0000", 2024-04-18T21:07:30.753 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00037218199999999998 2024-04-18T21:07:30.753 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.753 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.754 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:30.754 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.062149+0000", 2024-04-18T21:07:30.754 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.031396139000000003 2024-04-18T21:07:30.754 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:30.754 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:30.754 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:30.754 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.754 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.754 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:20086 4.1b 4:dac0322e:::10000000186.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-18T21:07:30.754 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:25.996705+0000", 2024-04-18T21:07:30.754 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 4.6840771749999996, 2024-04-18T21:07:30.754 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.065715934000000004, 2024-04-18T21:07:30.754 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:30.754 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:30.755 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:07:30.755 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:30.755 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.755 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:30.755 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996705+0000", 2024-04-18T21:07:30.755 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:30.755 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.755 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.755 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:30.755 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996705+0000", 2024-04-18T21:07:30.755 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:30.755 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.755 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.755 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:30.755 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996706+0000", 2024-04-18T21:07:30.756 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.7699999999999992e-07 2024-04-18T21:07:30.756 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.756 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.756 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:30.756 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996711+0000", 2024-04-18T21:07:30.756 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.1460000000000004e-06 2024-04-18T21:07:30.756 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.756 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.756 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:30.756 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996728+0000", 2024-04-18T21:07:30.756 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.626e-05 2024-04-18T21:07:30.756 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.756 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.756 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:30.756 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.996740+0000", 2024-04-18T21:07:30.756 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2343e-05 2024-04-18T21:07:30.757 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.757 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.757 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:30.757 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.042837+0000", 2024-04-18T21:07:30.757 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.046096454000000002 2024-04-18T21:07:30.757 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.757 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.757 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:30.757 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.045179+0000", 2024-04-18T21:07:30.757 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0023421560000000002 2024-04-18T21:07:30.757 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.757 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.757 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:30.757 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.062421+0000", 2024-04-18T21:07:30.757 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.017242598000000001 2024-04-18T21:07:30.758 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:30.758 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:30.758 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:30.758 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.758 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.758 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:20101 4.1b 4:d8c655bc:::10000000195.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-18T21:07:30.758 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:25.998732+0000", 2024-04-18T21:07:30.758 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 4.6820507329999996, 2024-04-18T21:07:30.758 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.063840712999999993, 2024-04-18T21:07:30.758 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:30.758 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:30.758 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:07:30.758 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:30.758 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.759 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:30.759 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.998732+0000", 2024-04-18T21:07:30.759 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:30.759 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.759 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.759 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:30.759 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.998732+0000", 2024-04-18T21:07:30.759 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:30.759 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.759 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.759 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:30.759 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.998734+0000", 2024-04-18T21:07:30.759 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.1100000000000001e-06 2024-04-18T21:07:30.759 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.759 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.760 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:30.760 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.998743+0000", 2024-04-18T21:07:30.760 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.1430000000000004e-06 2024-04-18T21:07:30.760 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.760 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.760 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:30.760 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.998770+0000", 2024-04-18T21:07:30.760 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.7387000000000001e-05 2024-04-18T21:07:30.760 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.760 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.760 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:30.760 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.998789+0000", 2024-04-18T21:07:30.760 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8932000000000001e-05 2024-04-18T21:07:30.760 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.760 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.761 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:30.761 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.045985+0000", 2024-04-18T21:07:30.761 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.047195537000000003 2024-04-18T21:07:30.761 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.761 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.761 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:30.761 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.046184+0000", 2024-04-18T21:07:30.761 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00019923200000000001 2024-04-18T21:07:30.761 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.761 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.761 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:30.761 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.062573+0000", 2024-04-18T21:07:30.761 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016388371999999998 2024-04-18T21:07:30.761 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:30.761 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:30.762 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:30.762 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.762 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.762 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:20104 4.30 4:0cac0e23:::10000000198.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-18T21:07:30.762 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:25.998873+0000", 2024-04-18T21:07:30.762 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 4.6819091559999997, 2024-04-18T21:07:30.762 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.062446901999999999, 2024-04-18T21:07:30.762 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:30.762 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:30.762 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:07:30.762 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:30.762 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.762 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:30.762 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.998873+0000", 2024-04-18T21:07:30.762 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:30.763 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.763 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.763 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:30.763 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.998873+0000", 2024-04-18T21:07:30.763 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:30.763 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.763 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.763 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:30.763 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.998874+0000", 2024-04-18T21:07:30.763 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.5999999999999991e-07 2024-04-18T21:07:30.763 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.763 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.763 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:30.763 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.998879+0000", 2024-04-18T21:07:30.764 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.9830000000000004e-06 2024-04-18T21:07:30.764 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.764 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.764 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:30.764 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.998896+0000", 2024-04-18T21:07:30.764 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.6897000000000001e-05 2024-04-18T21:07:30.764 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.764 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.764 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:30.764 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.998909+0000", 2024-04-18T21:07:30.764 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.2992e-05 2024-04-18T21:07:30.764 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.764 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.764 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:30.765 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.025919+0000", 2024-04-18T21:07:30.765 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.027009960999999999 2024-04-18T21:07:30.765 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.765 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.765 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:30.765 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.027905+0000", 2024-04-18T21:07:30.765 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0019858639999999999 2024-04-18T21:07:30.765 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.765 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.765 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:30.765 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.061320+0000", 2024-04-18T21:07:30.765 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.033415245000000003 2024-04-18T21:07:30.765 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:30.766 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:30.766 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:30.766 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.766 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.766 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:20117 4.2b 4:d55466b4:::100000001a5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-18T21:07:30.766 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:25.999086+0000", 2024-04-18T21:07:30.766 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 4.6816965350000004, 2024-04-18T21:07:30.766 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.063616064999999999, 2024-04-18T21:07:30.766 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:30.766 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:30.766 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:07:30.766 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:30.766 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.766 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:30.767 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.999086+0000", 2024-04-18T21:07:30.767 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:30.767 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.767 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.767 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:30.767 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.999086+0000", 2024-04-18T21:07:30.767 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:30.767 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.767 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.767 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:30.767 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.999087+0000", 2024-04-18T21:07:30.767 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.540000000000001e-07 2024-04-18T21:07:30.767 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.767 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.767 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:30.768 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.999092+0000", 2024-04-18T21:07:30.768 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 5.31e-06 2024-04-18T21:07:30.768 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.768 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.768 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:30.768 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.999109+0000", 2024-04-18T21:07:30.768 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.7178999999999999e-05 2024-04-18T21:07:30.768 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.768 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.768 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:30.768 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:25.999123+0000", 2024-04-18T21:07:30.768 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3203e-05 2024-04-18T21:07:30.768 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.768 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.768 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:30.769 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.045971+0000", 2024-04-18T21:07:30.769 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.046848771999999997 2024-04-18T21:07:30.769 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.769 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.769 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:30.769 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.046266+0000", 2024-04-18T21:07:30.769 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00029410800000000001 2024-04-18T21:07:30.769 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.769 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.769 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:30.769 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.062702+0000", 2024-04-18T21:07:30.769 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.016436539 2024-04-18T21:07:30.769 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:30.769 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:30.770 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:30.770 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.770 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.770 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:20179 4.1b 4:da67b4c4:::100000001e3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-18T21:07:30.770 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:26.000403+0000", 2024-04-18T21:07:30.770 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 4.6803795919999995, 2024-04-18T21:07:30.770 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.062388916000000003, 2024-04-18T21:07:30.770 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:30.770 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:30.770 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:07:30.770 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:30.770 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.771 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:30.771 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.000403+0000", 2024-04-18T21:07:30.771 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:30.771 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.771 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.771 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:30.771 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.000403+0000", 2024-04-18T21:07:30.771 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:30.771 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.771 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.771 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:30.771 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.000404+0000", 2024-04-18T21:07:30.771 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 9.5300000000000002e-07 2024-04-18T21:07:30.771 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.772 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.772 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:30.772 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.000409+0000", 2024-04-18T21:07:30.772 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 4.7759999999999997e-06 2024-04-18T21:07:30.772 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.772 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.772 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:30.772 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.000428+0000", 2024-04-18T21:07:30.772 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.8980000000000001e-05 2024-04-18T21:07:30.772 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.772 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.772 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:30.772 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.000442+0000", 2024-04-18T21:07:30.772 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.3903000000000001e-05 2024-04-18T21:07:30.773 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.773 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.773 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:30.773 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.046711+0000", 2024-04-18T21:07:30.773 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.046269498999999999 2024-04-18T21:07:30.773 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.773 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.773 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:30.773 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.046860+0000", 2024-04-18T21:07:30.773 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00014919400000000001 2024-04-18T21:07:30.773 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.773 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.773 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:30.773 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.062792+0000", 2024-04-18T21:07:30.774 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.015931610999999998 2024-04-18T21:07:30.774 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:30.774 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:30.774 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:30.774 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.774 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.774 INFO:teuthology.orchestra.run.smithi132.stdout: "description": "osd_op(mds.0.3:20185 4.30 4:0def042e:::100000001e9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-18T21:07:30.774 INFO:teuthology.orchestra.run.smithi132.stdout: "initiated_at": "2024-04-18T21:07:26.001040+0000", 2024-04-18T21:07:30.774 INFO:teuthology.orchestra.run.smithi132.stdout: "age": 4.6797427880000004, 2024-04-18T21:07:30.774 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.060583056000000003, 2024-04-18T21:07:30.774 INFO:teuthology.orchestra.run.smithi132.stdout: "continuous": false, 2024-04-18T21:07:30.774 INFO:teuthology.orchestra.run.smithi132.stdout: "type_data": { 2024-04-18T21:07:30.774 INFO:teuthology.orchestra.run.smithi132.stdout: "flag_point": "started", 2024-04-18T21:07:30.774 INFO:teuthology.orchestra.run.smithi132.stdout: "events": [ 2024-04-18T21:07:30.774 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.775 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "initiated", 2024-04-18T21:07:30.775 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.001040+0000", 2024-04-18T21:07:30.775 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:30.775 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.775 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.775 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "header_read", 2024-04-18T21:07:30.775 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.001040+0000", 2024-04-18T21:07:30.775 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0 2024-04-18T21:07:30.775 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.775 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.775 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "throttled", 2024-04-18T21:07:30.775 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.001041+0000", 2024-04-18T21:07:30.775 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 1.4100000000000001e-06 2024-04-18T21:07:30.775 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.775 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.776 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "all_read", 2024-04-18T21:07:30.776 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.001048+0000", 2024-04-18T21:07:30.776 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 7.2359999999999998e-06 2024-04-18T21:07:30.776 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.776 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.776 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "dispatched", 2024-04-18T21:07:30.776 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.006248+0000", 2024-04-18T21:07:30.776 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.0051992449999999999 2024-04-18T21:07:30.776 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.776 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.776 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "queued_for_pg", 2024-04-18T21:07:30.776 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.006274+0000", 2024-04-18T21:07:30.776 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 2.6696e-05 2024-04-18T21:07:30.776 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.776 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.777 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "reached_pg", 2024-04-18T21:07:30.777 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.032224+0000", 2024-04-18T21:07:30.777 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.025949403999999999 2024-04-18T21:07:30.777 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.777 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.777 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "started", 2024-04-18T21:07:30.777 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.032533+0000", 2024-04-18T21:07:30.777 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.00030930999999999998 2024-04-18T21:07:30.777 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-18T21:07:30.777 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-18T21:07:30.777 INFO:teuthology.orchestra.run.smithi132.stdout: "event": "done", 2024-04-18T21:07:30.777 INFO:teuthology.orchestra.run.smithi132.stdout: "time": "2024-04-18T21:07:26.061623+0000", 2024-04-18T21:07:30.777 INFO:teuthology.orchestra.run.smithi132.stdout: "duration": 0.029089754999999998 2024-04-18T21:07:30.777 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:30.778 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:30.778 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:30.778 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-18T21:07:30.778 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-04-18T21:07:30.778 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-18T21:07:30.778 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:30.682+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:30.779 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:07:30.781 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:30.781+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:30.882 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:30.882+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:30.910 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:07:30.911 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:07:30.911 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-04-18T21:07:30.911 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:07:30.925 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:07:30.976 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-18T21:07:30.982 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:30.981+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:31.069 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T21:07:31.084 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:31.082+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:31.086 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-18T21:07:31.086 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-18T21:07:31.086 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-18T21:07:31.087 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-18T21:07:31.087 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-18T21:07:31.101 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:31.128 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0: {} 2024-04-18T21:07:31.128 INFO:teuthology.orchestra.run.smithi078.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-18T21:07:31.128 INFO:teuthology.orchestra.run.smithi078.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-18T21:07:31.148 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2: {} 2024-04-18T21:07:31.148 INFO:teuthology.orchestra.run.smithi078.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-18T21:07:31.152 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-18T21:07:31.153 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-18T21:07:31.178 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off 2024-04-18T21:07:31.185 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:31.185+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:31.269 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:31.269 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:31.283 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:07:31.285 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:31.285+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:31.386 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:31.386+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:31.414 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:31.415 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:31.429 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:07:31.487 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:31.489+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:31.550 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:31.551 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:31.566 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:07:31.587 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:31.586+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:31.602 INFO:teuthology.orchestra.run.smithi078.stderr:nodeep-scrub is unset 2024-04-18T21:07:31.689 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:31.689+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:31.724 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:31.724 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:31.740 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:07:31.790 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:31.789+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:31.868 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:31.868 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:31.882 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:07:31.890 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:31.893+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:31.991 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:31.993+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:32.004 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:32.004 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:32.018 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:32.092 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:32.090+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:32.140 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:32.140 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:32.154 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-18T21:07:32.181 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi078.front.sepia.ceph.com 2024-04-18T21:07:32.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T21:07:32.182 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-18T21:07:32.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T21:07:32.198 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2024-04-18T21:07:32.199 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:32.201+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:32.245 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-18T21:07:32.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T21:07:32.246 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-18T21:07:32.287 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:32.287 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:32.294 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-18T21:07:32.294+0000 7f35d2bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21736) UID: 0 2024-04-18T21:07:32.301 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-18T21:07:32.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T21:07:32.302 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link delete ceph-brx 2024-04-18T21:07:32.390 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~35s 2024-04-18T21:07:32.395 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-18T21:07:32.397+0000 7f11d63cf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21659) UID: 0 2024-04-18T21:07:32.469 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:32.469 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:32.478 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-04-18T21:07:32.487 INFO:tasks.thrashosds:joining thrashosds 2024-04-18T21:07:32.488 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-18T21:07:32.653 INFO:teuthology.orchestra.run.smithi132.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:32.653 INFO:teuthology.orchestra.run.smithi132.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:32.667 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-18T21:07:32.799 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:32.799 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:32.813 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-18T21:07:32.929 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:32.929 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:32.943 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-18T21:07:33.058 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-18T21:07:33.059 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-18T21:07:33.626 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-18T21:07:34.621 INFO:teuthology.orchestra.run.smithi078.stderr:noscrub is unset 2024-04-18T21:07:34.645 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-18T21:07:35.180 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T21:07:35.290 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on 2024-04-18T21:07:35.391 INFO:teuthology.orchestra.console.smithi150:Power on completed 2024-04-18T21:07:35.492 DEBUG:teuthology.orchestra.console.smithi150:Waiting for login prompt 2024-04-18T21:07:35.492 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi150 2024-04-18T21:07:35.626 INFO:teuthology.orchestra.run.smithi078.stderr:nodeep-scrub is unset 2024-04-18T21:07:38.196 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~41s 2024-04-18T21:07:44.002 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~47s 2024-04-18T21:07:49.808 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~53s 2024-04-18T21:07:55.614 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~58s 2024-04-18T21:08:01.421 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~64s 2024-04-18T21:08:07.228 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~70s 2024-04-18T21:08:13.034 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~76s 2024-04-18T21:08:18.840 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~82s 2024-04-18T21:08:24.647 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~87s 2024-04-18T21:08:30.454 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~93s 2024-04-18T21:08:36.261 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~99s 2024-04-18T21:08:42.068 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~105s 2024-04-18T21:08:47.874 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~111s 2024-04-18T21:08:53.681 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~117s 2024-04-18T21:08:59.487 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~122s 2024-04-18T21:09:05.292 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~128s 2024-04-18T21:09:11.097 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~134s 2024-04-18T21:09:16.904 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~140s 2024-04-18T21:09:22.710 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~146s 2024-04-18T21:09:28.517 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~151s 2024-04-18T21:09:34.323 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~157s 2024-04-18T21:09:40.129 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~163s 2024-04-18T21:09:41.029 DEBUG:teuthology.orchestra.console.smithi150:expect before: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.72 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 88 6E 35 GUID: 00000000 0000 0000 0000 0CC47AD9DABC DHCP.-                    DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./  21.15.150 MAS : 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 95D3:0070, entry point at 95D3:0106  UNDI code segment 95D3:3E70, data segment 8E94:73F0 (570-615kB)  UNDI device is PCI 03:00.1, type DIX+802.3  570kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.150 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:88:6e:35)... Configuring (net0 0c:c4:7a:88:6e:35).... Configuring (net0 0c:c4:7a:88:6e:35)..... Configuring (net0 0c:c4:7a:88:6e:35)...... ok     * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  ******************************************************************************   Use the * and * keys to select which entry is highlighted.  Press enter to boot the selected OS, `e' to edit the commands  before booting or `c' for a command-line.  The highlighted entry will be executed automatically in 5s.  GNU GRUB version 2.04  ******************************************************************************  * Ubuntu *  **Advanced options for Ubuntu *  The highlighted entry will be executed automatically in 4s.  The highlighted entry will be executed automatically in 3s.  The highlighted entry will be executed automatically in 2s.  The highlighted entry will be executed automatically in 1s.                     Loading Linux 5.15.0-102-generic ... [ 0.000000] microcode: microcode updated early to revision 0xb000040, date = 2021-05-19 [ 0.000000] Linux version 5.15.0-102-generic (buildd@lcy02-amd64-080) (gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0, GNU ld (GNU Binutils for Ubuntu) 2.38) #112-Ubuntu SMP Tue Mar 5 16:50:32 UTC 2024 (Ubuntu 5.15.0-102.112-generic 5.15.148) [ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-102-generic root=UUID=7e9e2103-8bb7-4452-b35a-3b1230743254 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.000000] KERNEL supported cpus: [ 0.000000] Intel GenuineIntel [ 0.000000] AMD AuthenticAMD [ 0.000000] Hygon HygonGenuine [ 0.000000] Centaur CentaurHauls [ 0.000000] zhaoxin Shanghai [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008abff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ec5fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f78000-0x00000000798a7fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798a8000-0x0000000079d44fff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d45000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0a 08/02/2016 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.989 MHz processor [ 0.000414] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000595] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.001901] last_pfn = 0x78ec6 max_arch_pfn = 0x400000000 [ 0.008121] found SMP MP-table at [mem 0x000fcd40-0x000fcd4f] [ 0.008135] Using GB pages for direct mapping [ 0.008270] RAMDISK: [mem 0x300cf000-0x3405efff] [ 0.008276] ACPI: Early table checksum verification disabled [ 0.008279] ACPI: RSDP 0x00000000000F05B0 000024 (v02 SUPERM) [ 0.008283] ACPI: XSDT 0x00000000798A80A0 0000BC (v01 01072009 AMI 00010013) [ 0.008288] ACPI: FACP 0x00000000798DB838 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008293] ACPI: DSDT 0x00000000798A81F0 033641 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.008296] ACPI: FACS 0x0000000079D43F80 000040 [ 0.008298] ACPI: APIC 0x00000000798DB948 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008301] ACPI: FPDT 0x00000000798DBA10 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008304] ACPI: FIDT 0x00000000798DBA58 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008307] ACPI: SPMI 0x00000000798DBAF8 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.008310] ACPI: MCFG 0x00000000798DBB38 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.008313] ACPI: UEFI 0x00000000798DBB78 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.008315] ACPI: HPET 0x00000000798DBBC0 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008318] ACPI: WDDT 0x00000000798DBBF8 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.008321] ACPI: SSDT 0x00000000798DBC38 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.008324] ACPI: NITR 0x00000000798F2DB8 000071 (v02 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008327] ACPI: SSDT 0x00000000798F2E30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.008330] ACPI: SSDT 0x00000000798F5480 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.008332] ACPI: PRAD 0x00000000798F54E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.008335] ACPI: DMAR 0x00000000798F55F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008338] ACPI: HEST 0x00000000798F56B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008341] ACPI: BERT 0x00000000798F5930 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008344] ACPI: ERST 0x00000000798F5960 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008347] ACPI: EINJ 0x00000000798F5B90 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008349] ACPI: Reserving FACP table memory at [mem 0x798db838-0x798db943] [ 0.008351] ACPI: Reserving DSDT table memory at [mem 0x798a81f0-0x798db830] [ 0.008352] ACPI: Reserving FACS table memory at [mem 0x79d43f80-0x79d43fbf] [ 0.008353] ACPI: Reserving APIC table memory at [mem 0x798db948-0x798dba0f] [ 0.008354] ACPI: Reserving FPDT table memory at [mem 0x798dba10-0x798dba53] [ 0.008355] ACPI: Reserving FIDT table memory at [mem 0x798dba58-0x798dbaf3] [ 0.008356] ACPI: Reserving SPMI table memory at [mem 0x798dbaf8-0x798dbb37] [ 0.008357] ACPI: Reserving MCFG table memory at [mem 0x798dbb38-0x798dbb73] [ 0.008358] ACPI: Reserving UEFI table memory at [mem 0x798dbb78-0x798dbbb9] [ 0.008359] ACPI: Reserving HPET table memory at [mem 0x798dbbc0-0x798dbbf7] [ 0.008359] ACPI: Reserving WDDT table memory at [mem 0x798dbbf8-0x798dbc37] [ 0.008360] ACPI: Reserving SSDT table memory at [mem 0x798dbc38-0x798f2db6] [ 0.008361] ACPI: Reserving NITR table memory at [mem 0x798f2db8-0x798f2e28] [ 0.008362] ACPI: Reserving SSDT table memory at [mem 0x798f2e30-0x798f547b] [ 0.008363] ACPI: Reserving SSDT table memory at [mem 0x798f5480-0x798f54e3] [ 0.008364] ACPI: Reserving PRAD table memory at [mem 0x798f54e8-0x798f55e9] [ 0.008365] ACPI: Reserving DMAR table memory at [mem 0x798f55f0-0x798f56ab] [ 0.008366] ACPI: Reserving HEST table memory at [mem 0x798f56b0-0x798f592b] [ 0.008367] ACPI: Reserving BERT table memory at [mem 0x798f5930-0x798f595f] [ 0.008368] ACPI: Reserving ERST table memory at [mem 0x798f5960-0x798f5b8f] [ 0.008369] ACPI: Reserving EINJ table memory at [mem 0x798f5b90-0x798f5cbf] [ 0.008464] No NUMA configuration found [ 0.008465] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.008474] NODE_DATA(0) allocated [mem 0x87ffd6000-0x87fffffff] [ 0.008805] Zone ranges: [ 0.008806] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.008808] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.008810] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.008812] Device empty [ 0.008813] Movable zone start for each node [ 0.008815] Early memory node ranges [ 0.008816] node 0: [mem 0x0000000000001000-0x0000000000089fff] [ 0.008817] node 0: [mem 0x0000000000100000-0x0000000078ec5fff] [ 0.008819] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.008823] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.008827] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.008863] On node 0, zone DMA: 118 pages in unavailable ranges [ 0.080444] On node 0, zone Normal: 28986 pages in unavailable ranges [ 0.080558] ACPI: PM-Timer IO Port: 0x408 [ 0.080565] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.080567] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.080568] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.080569] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.080570] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.080571] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.080572] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.080572] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.080582] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.080586] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.080589] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.080590] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.080594] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.080595] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.080599] TSC deadline timer available [ 0.080601] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.080610] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.080612] PM: hibernation: Registered nosave memory: [mem 0x0008a000-0x000dffff] [ 0.080613] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.080615] PM: hibernation: Registered nosave memory: [mem 0x78ec6000-0x78f77fff] [ 0.080616] PM: hibernation: Registered nosave memory: [mem 0x78f78000-0x798a7fff] [ 0.080616] PM: hibernation: Registered nosave memory: [mem 0x798a8000-0x79d44fff] [ 0.080617] PM: hibernation: Registered nosave memory: [mem 0x79d45000-0x8fffffff] [ 0.080618] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.080619] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.080620] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.080621] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.080623] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.080624] Booting paravirtualized kernel on bare hardware [ 0.080626] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns [ 0.080633] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.080847] percpu: Embedded 61 pages/cpu s212992 r8192 d28672 u262144 [ 0.080878] Built 1 zonelists, mobility grouping on. Total pages: 8228746 [ 0.080880] Policy zone: Normal [ 0.080881] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-102-generic root=UUID=7e9e2103-8bb7-4452-b35a-3b1230743254 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.080940] Unknown kernel command line parameters "BOOT_IMAGE=/boot/vmlinuz-5.15.0-102-generic", will be passed to user space. [ 0.083098] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.084246] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.084340] mem auto-init: stack:off, heap alloc:on, heap free:off [ 0.170593] Memory: 32672712K/33438012K available (16393K kernel code, 4395K rwdata, 10948K rodata, 3352K init, 18716K bss, 765040K reserved, 0K cma-reserved) [ 0.170875] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.170890] Kernel/User page tables isolation: enabled [ 0.170922] ftrace: allocating 50694 entries in 199 pages [ 0.190591] ftrace: allocated 199 pages with 5 groups [ 0.190708] rcu: Hierarchical RCU implementation. [ 0.190710] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.190712] Rude variant of Tasks RCU enabled. [ 0.190713] Tracing variant of Tasks RCU enabled. [ 0.190713] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. [ 0.190714] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.194137] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.194336] random: crng init done [ 0.199203] Console: colour VGA+ 80x25 [ 0.210563] printk: console [tty0] enabled [ 1.197408] printk: console [ttyS1] enabled [ 1.201666] ACPI: Core revision 20210730 [ 1.205828] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.215056] APIC: Switch to symmetric I/O mode setup [ 1.220093] DMAR: Host address width 46 [ 1.223996] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.229382] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.238579] DMAR: RMRR base: 0x0000007ba6e000 end: 0x0000007ba7dfff [ 1.244911] DMAR: ATSR flags: 0x0 [ 1.248295] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.254637] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.261057] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.267480] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.272948] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.272949] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.288132] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.293507] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.299799] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.323055] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x327346e9ce8, max_idle_ns: 440795304517 ns [ 1.333668] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.97 BogoMIPS (lpj=13999956) [ 1.337684] CPU0: Thermal monitoring enabled (TM1) [ 1.341719] process: using mwait in idle threads [ 1.345667] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.349666] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.353667] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.357666] Spectre V2 : Mitigation: Retpolines [ 1.361666] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.365666] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.369666] Spectre V2 : Enabling Restricted Speculation for firmware calls [ 1.373666] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier [ 1.377666] Spectre V2 : User space: Mitigation: STIBP via seccomp and prctl [ 1.381666] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp [ 1.385669] MDS: Mitigation: Clear CPU buffers [ 1.389666] TAA: Mitigation: Clear CPU buffers [ 1.393666] MMIO Stale Data: Mitigation: Clear CPU buffers [ 1.397670] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.401666] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.405666] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.409666] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.413666] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.435363] Freeing SMP alternatives memory: 44K [ 1.437666] pid_max: default: 32768 minimum: 301 [ 1.441686] LSM: Security Framework initializing [ 1.445674] landlock: Up and running. [ 1.449666] Yama: becoming mindful. [ 1.453683] AppArmor: AppArmor initialized [ 1.457727] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.461706] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.466022] smpboot: Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.469671] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.473773] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.477667] ... version: 3 [ 1.481666] ... bit width: 48 [ 1.485666] ... generic registers: 4 [ 1.489666] ... value mask: 0000ffffffffffff [ 1.493666] ... max period: 00007fffffffffff [ 1.497666] ... fixed-purpose events: 3 [ 1.501666] ... event mask: 000000070000000f [ 1.505726] signal: max sigframe size: 1776 [ 1.509680] rcu: Hierarchical SRCU implementation. [ 1.514379] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.517730] smp: Bringing up secondary CPUs ... [ 1.521746] x86: Booting SMP configuration: [ 1.525668] .... node #0, CPUs: #1 #2 #3 #4 [ 1.533746] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.541666] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.545666] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.549764] #5 #6 #7 [ 1.550221] smp: Brought up 1 node, 8 CPUs [ 1.557668] smpboot: Max logical packages: 1 [ 1.561666] smpboot: Total of 8 processors activated (55999.82 BogoMIPS) [ 1.569982] devtmpfs: initialized [ 1.573080] x86/mm: Memory block size: 128MB [ 1.575264] ACPI: PM: Registering ACPI NVS region [mem 0x798a8000-0x79d44fff] (4837376 bytes) [ 1.577742] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns [ 1.581676] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.585713] pinctrl core: initialized pinctrl subsystem [ 1.589757] PM: RTC time: 21:09:07, date: 2024-04-18 [ 1.593773] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.597999] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.601965] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.605999] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.609677] audit: initializing netlink subsys (disabled) [ 1.613685] audit: type=2000 audit(1713474545.356:1): state=initialized audit_enabled=0 res=1 [ 1.613783] thermal_sys: Registered thermal governor 'fair_share' [ 1.617668] thermal_sys: Registered thermal governor 'bang_bang' [ 1.621666] thermal_sys: Registered thermal governor 'step_wise' [ 1.625666] thermal_sys: Registered thermal governor 'user_space' [ 1.629666] thermal_sys: Registered thermal governor 'power_allocator' [ 1.633671] EISA bus registered [ 1.640873] cpuidle: using governor ladder [ 1.641668] cpuidle: using governor menu [ 1.645682] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.649667] ACPI: bus type PCI registered [ 1.653667] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.657722] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 1.661667] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 1.665680] PCI: Using configuration type 1 for base access [ 1.670685] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.673682] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 1.677667] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 1.681742] ACPI: Added _OSI(Module Device) [ 1.685668] ACPI: Added _OSI(Processor Device) [ 1.689673] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.693666] ACPI: Added _OSI(Processor Aggregator Device) [ 1.697666] ACPI: Added _OSI(Linux-Dell-Video) [ 1.701666] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.705666] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.754738] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.760992] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.765809] ACPI: Dynamic OEM Table Load: [ 1.795031] ACPI: Interpreter enabled [ 1.797677] ACPI: PM: (supports S0 S4 S5) [ 1.801666] ACPI: Using IOAPIC for interrupt routing [ 1.805688] HEST: Enabling Firmware First mode for corrected errors. [ 1.809744] HEST: Table parsing has been initialized. [ 1.813813] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.817668] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.821666] PCI: Using E820 reservations for host bridge windows [ 1.826354] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.859670] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.865670] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.875604] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.886653] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.893666] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.901701] PCI host bridge to bus 0000:ff [ 1.905667] pci_bus 0000:ff: root bus resource [bus ff] [ 1.909676] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 [ 1.917732] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 [ 1.921719] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 [ 1.929718] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 [ 1.933718] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 [ 1.941718] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 [ 1.949719] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 [ 1.953718] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 [ 1.961722] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 [ 1.965717] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 [ 1.973718] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 [ 1.977718] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 [ 1.985717] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 [ 1.989718] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 [ 1.997722] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 [ 2.001719] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 [ 2.009719] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 [ 2.013718] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 [ 2.021717] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 [ 2.025691] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 [ 2.033729] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 [ 2.037768] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 [ 2.045730] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 [ 2.053731] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 [ 2.057733] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 [ 2.065731] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 [ 2.077730] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 [ 2.085720] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 [ 2.089721] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 [ 2.097732] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 [ 2.101730] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 [ 2.109730] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 [ 2.113732] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 [ 2.121720] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 [ 2.125719] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 [ 2.133719] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 [ 2.137721] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 [ 2.145730] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 [ 2.149730] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 [ 2.157732] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 [ 2.165734] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 [ 2.169723] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 [ 2.177719] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 [ 2.181721] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 [ 2.189722] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 [ 2.193719] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 [ 2.201719] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 [ 2.205719] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 [ 2.213725] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 [ 2.217719] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 [ 2.225718] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 [ 2.229719] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 [ 2.237693] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 [ 2.241720] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 [ 2.249719] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 [ 2.257649] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 2.265669] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 2.273982] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 2.282108] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 2.293666] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 2.301957] PCI host bridge to bus 0000:00 [ 2.305667] pci_bus 0000:00: root bus resource [bus 00-fe] [ 2.309666] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 2.317666] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 2.321666] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 2.329666] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 2.337666] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 2.345667] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 2.353773] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 [ 2.361881] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 [ 2.365732] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 2.373836] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 [ 2.377731] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 2.385831] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 [ 2.389731] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 2.397826] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 [ 2.405686] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 2.409861] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 [ 2.417685] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 2.425858] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 [ 2.429685] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 2.437859] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 [ 2.441685] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 2.449862] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 [ 2.457685] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 2.461862] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 [ 2.469685] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 2.477858] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 [ 2.481685] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 2.489860] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 [ 2.497685] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 2.501811] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 [ 2.509887] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 [ 2.513814] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 [ 2.521837] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 [ 2.525680] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 2.533908] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 2.541957] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 2.545688] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 2.553677] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 2.557677] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 2.561677] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 2.569677] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 2.573677] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 2.581706] pci 0000:00:11.4: PME# supported from D3hot [ 2.585824] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 2.593692] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 2.597742] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 2.605816] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 2.613692] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 2.617743] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 2.625813] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 2.629692] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 2.637743] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 2.645823] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 2.649689] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 2.657771] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 2.661820] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 2.669755] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 2.673828] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 2.681757] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 2.689828] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 2.693757] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 2.701836] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 2.705689] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 2.713770] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 2.717822] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 2.725944] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 2.733685] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 2.737676] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 2.741676] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 2.749676] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 2.753676] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 2.761676] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 2.765700] pci 0000:00:1f.2: PME# supported from D3hot [ 2.773809] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 2.777692] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 2.785697] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 2.789874] acpiphp: Slot [1] registered [ 2.793683] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.801843] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 [ 2.805686] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 2.813708] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 2.817669] pci 0000:02:00.0: enabling Extended Tags [ 2.825768] pci 0000:00:02.0: PCI bridge to [bus 02] [ 2.829668] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 2.837841] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 2.841688] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 2.849675] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 2.857688] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 2.861675] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 2.869707] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 2.877687] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.881666] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.893679] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.901667] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.909829] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 2.917688] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 2.925675] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 2.929688] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 2.937675] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 2.945706] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 2.949683] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.957666] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.969679] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.977666] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.985799] pci 0000:00:03.0: PCI bridge to [bus 03] [ 2.993667] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 2.997667] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 3.005667] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.013696] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 3.017733] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 3.025754] pci 0000:05:00.0: enabling Extended Tags [ 3.029744] pci 0000:05:00.0: supports D1 D2 [ 3.033666] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 3.041770] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 3.045668] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 3.049667] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.057713] pci_bus 0000:06: extended config space not accessible [ 3.065696] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 3.069698] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 3.077683] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 3.081743] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 3.089756] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 3.105668] pci 0000:06:00.0: pci_fixup_video+0x0/0xe0 took 15625 usecs [ 3.113708] pci 0000:06:00.0: supports D1 D2 [ 3.117666] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 3.121778] pci 0000:05:00.0: PCI bridge to [bus 06] [ 3.125673] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 3.129669] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.133765] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 3.137693] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 3.141694] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 3.145680] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 3.149802] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 3.153704] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 3.157666] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 3.161692] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 3.165666] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 3.169842] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 3.173693] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 3.177694] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 3.181680] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 3.185796] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 3.189703] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 3.193666] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 3.197692] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 3.201666] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 3.205822] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 3.209668] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 3.213667] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 3.217669] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 3.222550] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 3.225713] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 3.229712] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 3.233712] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 3.237712] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 3.241666] ACPI: PCI: Interrupt link LNKE disabled [ 3.245711] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 3.249666] ACPI: PCI: Interrupt link LNKF disabled [ 3.253711] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 3.257666] ACPI: PCI: Interrupt link LNKG disabled [ 3.261711] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 3.265666] ACPI: PCI: Interrupt link LNKH disabled [ 3.269858] iommu: Default domain type: Translated [ 3.273667] iommu: DMA domain TLB invalidation policy: lazy mode [ 3.277799] SCSI subsystem initialized [ 3.281676] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 3.285665] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 3.285666] pci 0000:06:00.0: vgaarb: bridge control possible [ 3.289666] vgaarb: loaded [ 3.292444] ACPI: bus type USB registered [ 3.293676] usbcore: registered new interface driver usbfs [ 3.297671] usbcore: registered new interface driver hub [ 3.301670] usbcore: registered new device driver usb [ 3.305680] pps_core: LinuxPPS API ver. 1 registered [ 3.309666] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 3.313669] PTP clock support registered [ 3.317673] EDAC MC: Ver: 3.0.0 [ 3.320974] NetLabel: Initializing [ 3.321667] NetLabel: domain hash size = 128 [ 3.325666] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 3.329678] NetLabel: unlabeled traffic allowed by default [ 3.333675] PCI: Using ACPI for IRQ routing [ 3.342895] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 3.345666] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 3.351705] clocksource: Switched to clocksource tsc-early [ 3.363905] VFS: Disk quotas dquot_6.6.0 [ 3.367908] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 3.374939] AppArmor: AppArmor Filesystem Enabled [ 3.379743] pnp: PnP ACPI init [ 3.383305] system 00:01: [io 0x0500-0x057f] has been reserved [ 3.389298] system 00:01: [io 0x0400-0x047f] has been reserved [ 3.395280] system 00:01: [io 0x0580-0x059f] has been reserved [ 3.401269] system 00:01: [io 0x0600-0x061f] has been reserved [ 3.407258] system 00:01: [io 0x0880-0x0883] has been reserved [ 3.413245] system 00:01: [io 0x0800-0x081f] has been reserved [ 3.419227] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 3.425909] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 3.432593] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 3.439274] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 3.445957] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 3.452640] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 3.459322] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 3.466203] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 3.472191] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 3.478177] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 3.484157] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 3.490138] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 3.497046] pnp: PnP ACPI: found 5 devices [ 3.506567] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 3.515569] NET: Registered PF_INET protocol family [ 3.520686] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.529963] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 3.538785] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 3.546784] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.555187] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 3.562720] TCP: Hash tables configured (established 262144 bind 65536) [ 3.569520] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 3.577299] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.584312] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.591771] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 3.597497] NET: Registered PF_XDP protocol family [ 3.602375] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 3.613951] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 3.621863] pci 0000:00:01.0: PCI bridge to [bus 01] [ 3.626905] pci 0000:00:02.0: PCI bridge to [bus 02] [ 3.631939] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 3.638808] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.646459] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.654460] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.662197] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.670285] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.677938] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.685942] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.693685] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.701776] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.709430] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.717433] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.725171] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.733257] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.740909] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.748911] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.756649] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.764735] pci 0000:00:03.0: PCI bridge to [bus 03] [ 3.769764] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 3.775923] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 3.782780] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.790614] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 3.795662] pci 0000:05:00.0: PCI bridge to [bus 06] [ 3.800689] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 3.806860] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.813733] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 3.819026] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 3.825189] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.832053] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 3.839879] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 3.847794] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 3.855627] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 3.863542] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 3.868574] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 3.874735] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 3.881591] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 3.897076] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 3.903323] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 3.909570] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 3.916505] pci_bus 0000:00: resource 7 [mem 0x90000000-0xfbffbfff window] [ 3.923448] pci_bus 0000:00: resource 8 [mem 0xfedb0000-0xfedb000f window] [ 3.930391] pci_bus 0000:00: resource 9 [mem 0xfedc0000-0xfedc000f window] [ 3.937331] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 3.943668] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 3.949308] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 3.955645] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.962954] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 3.968592] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.974928] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 3.980568] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.986897] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 3.992538] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 3.998864] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 4.006366] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 4.035483] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x160 took 21315 usecs [ 4.067481] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x160 took 23920 usecs [ 4.074982] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 4.081531] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 4.081546] Trying to unpack rootfs image as initramfs... [ 4.088040] software IO TLB: mapped [mem 0x0000000074ec6000-0x0000000078ec6000] (64MB) [ 4.101993] Initialise system trusted keyrings [ 4.106529] Key type blacklist registered [ 4.110646] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 4.118118] zbud: loaded [ 4.120922] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ 4.126977] fuse: init (API version 7.34) [ 4.131203] integrity: Platform Keyring initialized [ 4.144095] Key type asymmetric registered [ 4.148265] Asymmetric key parser 'x509' registered [ 4.153237] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 243) [ 4.160773] io scheduler mq-deadline registered [ 4.165947] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 4.171991] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 4.178011] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 4.183982] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 4.189955] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 4.195915] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 4.201887] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 4.208801] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 4.214691] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 4.223159] ACPI: button: Power Button [PWRB] [ 4.227615] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 4.235132] ACPI: button: Power Button [PWRF] [ 4.240881] ERST: Error Record Serialization Table (ERST) support is initialized. [ 4.248454] pstore: Registered erst as persistent store backend [ 4.254596] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled [ 4.281527] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 4.310461] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 4.320046] Linux agpgart interface v0.103 [ 4.325858] loop: module loaded [ 4.329296] tun: Universal TUN/TAP device driver, 1.6 [ 4.334437] PPP generic driver version 2.4.2 [ 4.338819] VFIO - User Level meta-driver version: 0.3 [ 4.344153] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 4.350757] ehci-pci: EHCI PCI platform driver [ 4.355437] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 4.360738] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 4.368230] ehci-pci 0000:00:1a.0: debug port 2 [ 4.376740] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 4.395371] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 4.401235] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 4.409590] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.416903] usb usb1: Product: EHCI Host Controller [ 4.421852] usb usb1: Manufacturer: Linux 5.15.0-102-generic ehci_hcd [ 4.428364] usb usb1: SerialNumber: 0000:00:1a.0 [ 4.433201] hub 1-0:1.0: USB hub found [ 4.435476] Freeing initrd memory: 65088K [ 4.437031] hub 1-0:1.0: 2 ports detected [ 4.445436] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 4.450734] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2 [ 4.458225] ehci-pci 0000:00:1d.0: debug port 2 [ 4.466724] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 4.487405] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 4.493256] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 4.501601] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.508906] usb usb2: Product: EHCI Host Controller [ 4.513848] usb usb2: Manufacturer: Linux 5.15.0-102-generic ehci_hcd [ 4.520352] usb usb2: SerialNumber: 0000:00:1d.0 [ 4.525151] hub 2-0:1.0: USB hub found [ 4.528966] hub 2-0:1.0: 2 ports detected [ 4.533163] ehci-platform: EHCI generic platform driver [ 4.538469] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 4.544716] ohci-pci: OHCI PCI platform driver [ 4.549245] ohci-platform: OHCI generic platform driver [ 4.554537] uhci_hcd: USB Universal Host Controller Interface driver [ 4.561003] i8042: PNP: No PS/2 controller found. [ 4.565835] mousedev: PS/2 mouse device common for all mice [ 4.571548] rtc_cmos 00:00: RTC can wake from S4 [ 4.576447] rtc_cmos 00:00: registered as rtc0 [ 4.580986] rtc_cmos 00:00: setting system clock to 2024-04-18T21:09:10 UTC (1713474550) [ 4.589180] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 4.595952] i2c_dev: i2c /dev entries driver [ 4.600458] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [ 4.612743] device-mapper: uevent: version 1.0.3 [ 4.617489] device-mapper: ioctl: 4.45.0-ioctl (2021-03-22) initialised: dm-devel@redhat.com [ 4.626034] platform eisa.0: Probing EISA bus 0 [ 4.630635] platform eisa.0: EISA: Cannot allocate resource for mainboard [ 4.637487] platform eisa.0: Cannot allocate resource for EISA slot 1 [ 4.643993] platform eisa.0: Cannot allocate resource for EISA slot 2 [ 4.650500] platform eisa.0: Cannot allocate resource for EISA slot 3 [ 4.657011] platform eisa.0: Cannot allocate resource for EISA slot 4 [ 4.663520] platform eisa.0: Cannot allocate resource for EISA slot 5 [ 4.670029] platform eisa.0: Cannot allocate resource for EISA slot 6 [ 4.676536] platform eisa.0: Cannot allocate resource for EISA slot 7 [ 4.683047] platform eisa.0: Cannot allocate resource for EISA slot 8 [ 4.689555] platform eisa.0: EISA: Detected 0 cards [ 4.694505] intel_pstate: Intel P-state driver initializing [ 4.701208] ledtrig-cpu: registered to indicate activity on CPUs [ 4.707446] drop_monitor: Initializing network drop monitor service [ 4.713894] NET: Registered PF_INET6 protocol family [ 4.726960] Segment Routing with IPv6 [ 4.730700] In-situ OAM (IOAM) with IPv6 [ 4.734721] NET: Registered PF_PACKET protocol family [ 4.739908] Key type dns_resolver registered [ 4.744690] microcode: sig=0x406f1, pf=0x1, revision=0xb000040 [ 4.750688] microcode: Microcode Update Driver: v2.2. [ 4.750772] resctrl: L3 allocation detected [ 4.760133] resctrl: L3 monitoring detected [ 4.764383] IPI shorthand broadcast: enabled [ 4.768729] sched_clock: Marking stable (3705377173, 1063335746)->(5273073816, -504360897) [ 4.777312] registered taskstats version 1 [ 4.779376] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 4.788191] Loading compiled-in X.509 certificates [ 4.793650] Loaded X.509 cert 'Build time autogenerated kernel key: 8dbd8aa72291a99043f1138db79927b696791b59' [ 4.804081] Loaded X.509 cert 'Canonical Ltd. Live Patch Signing: 14df34d1a87cf37625abec039ef2bf521249b969' [ 4.814324] Loaded X.509 cert 'Canonical Ltd. Kernel Module Signing: 88f752e560a1e0737e31163a466ad7b70a850c19' [ 4.824413] blacklist: Loading compiled-in revocation X.509 certificates [ 4.831193] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing: 61482aa2830d0ab2ad5af10b7250da9033ddcef0' [ 4.841113] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2017): 242ade75ac4a15e50d50c84b0d45ff3eae707a03' [ 4.851659] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (ESM 2018): 365188c1d374d6b07c3c8f240f8ef722433d6a8b' [ 4.862539] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2019): c0746fd6c5da3ae827864651ad66ae47fe24b3e8' [ 4.873068] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v1): a8d54bbb3825cfb94fa13c9f8a594a195c107b8d' [ 4.875372] usb 2-1: new high-speed USB device number 2 using ehci-pci [ 4.883877] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v2): 4cf046892d6fd3c9a5b03f98d845f90851dc6a8c' [ 4.901273] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v3): 100437bb6de6e469b581e61cd66bce3ef4ed53af' [ 4.912061] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (Ubuntu Core 2019): c1d57b8f6b743f23ee41f4f7ee292f06eecadfb9' [ 4.923900] zswap: loaded using pool lzo/zbud [ 4.928645] Key type .fscrypt registered [ 4.932639] Key type fscrypt-provisioning registered [ 4.937724] pstore: Using crash dump compression: deflate [ 4.946057] Key type encrypted registered [ 4.950129] AppArmor: AppArmor sha1 policy hashing enabled [ 4.951763] usb 1-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 4.955708] ima: No TPM chip found, activating TPM-bypass! [ 4.971607] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.971782] hub 1-1:1.0: USB hub found [ 4.977162] Loading compiled-in module X.509 certificates [ 4.977575] Loaded X.509 cert 'Build time autogenerated kernel key: 8dbd8aa72291a99043f1138db79927b696791b59' [ 4.984512] hub 1-1:1.0: 6 ports detected [ 4.988183] ima: Allocated hash algorithm: sha1 [ 5.012335] ima: No architecture policies found [ 5.016941] evm: Initialising EVM extended attributes: [ 5.022141] evm: security.selinux [ 5.025518] evm: security.SMACK64 [ 5.028898] evm: security.SMACK64EXEC [ 5.032624] evm: security.SMACK64TRANSMUTE [ 5.036785] evm: security.SMACK64MMAP [ 5.040513] evm: security.apparmor [ 5.043977] evm: security.ima [ 5.047009] evm: security.capability [ 5.050651] evm: HMAC attrs: 0x1 [ 5.054246] PM: Magic number: 4:186:197 [ 5.058387] acpi device:1b4: hash matches [ 5.059765] usb 2-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 5.062500] acpi device:52: hash matches [ 5.070723] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.074722] acpi PNP0100:00: hash matches [ 5.086169] hub 2-1:1.0: USB hub found [ 5.090138] RAS: Correctable Errors collector initialized. [ 5.090139] hub 2-1:1.0: 8 ports detected [ 5.100740] Freeing unused decrypted memory: 2036K [ 5.106082] Freeing unused kernel image (initmem) memory: 3352K [ 5.119404] Write protecting the kernel read-only data: 30720k [ 5.125714] Freeing unused kernel image (text/rodata gap) memory: 2036K [ 5.132404] tsc: Refined TSC clocksource calibration: 3499.997 MHz [ 5.138656] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734e5ebc4, max_idle_ns: 440795265422 ns [ 5.148810] clocksource: Switched to clocksource tsc [ 5.154054] Freeing unused kernel image (rodata/data gap) memory: 1340K [ 5.198787] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.205300] x86/mm: Checking user space page tables [ 5.247147] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.253659] Run /init as init process Loading, please wait... Starting version 249.11-0ubuntu3.6 [ 5.409106] dca service started, version 1.12.1 [ 5.415782] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 5.421230] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 5.428931] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 5.429806] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 5.437121] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 5.454255] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 5.459556] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 5.467039] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 5.473408] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 5.475612] scsi host0: ahci [ 5.481763] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 5.484857] scsi host1: ahci [ 5.492013] usb usb3: Product: xHCI Host Controller [ 5.495066] scsi host2: ahci [ 5.499904] usb usb3: Manufacturer: Linux 5.15.0-102-generic xhci-hcd [ 5.499906] usb usb3: SerialNumber: 0000:00:14.0 [ 5.502964] scsi host3: ahci [ 5.509506] hub 3-0:1.0: USB hub found [ 5.514214] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 33 [ 5.517052] hub 3-0:1.0: 15 ports detected [ 5.520831] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 33 [ 5.530255] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.15 [ 5.532472] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 33 [ 5.532474] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 33 [ 5.532713] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 5.539961] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 5.548316] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 5.555802] usb usb4: Product: xHCI Host Controller [ 5.571638] nvme nvme0: pci function 0000:02:00.0 [ 5.578854] usb usb4: Manufacturer: Linux 5.15.0-102-generic xhci-hcd [ 5.589337] nvme nvme0: 8/0/0 default/read/poll queues [ 5.591455] usb usb4: SerialNumber: 0000:00:14.0 [ 5.596263] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ 5.596386] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 5.597850] i2c i2c-0: 2/8 memory slots populated (from DMI) [ 5.597852] i2c i2c-0: Systems with more than 4 memory slots not supported yet, not instantiating SPD [ 5.602844] hub 4-0:1.0: USB hub found [ 5.607935] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 5.608059] igb: Intel(R) Gigabit Ethernet Network Driver [ 5.612650] hub 4-0:1.0: 6 ports detected [ 5.618788] igb: Copyright (c) 2007-2014 Intel Corporation. [ 5.635857] scsi host4: ahci [ 5.667580] scsi host5: ahci [ 5.670680] scsi host6: ahci [ 5.672502] igb 0000:07:00.0: added PHC on eth0 [ 5.673751] scsi host7: ahci [ 5.678253] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 5.681311] scsi host8: ahci [ 5.688119] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:da:bc [ 5.691203] scsi host9: ahci [ 5.698340] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 5.701266] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 35 [ 5.706419] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.713893] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 35 [ 5.729035] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 35 [ 5.736528] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 35 [ 5.744021] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 35 [ 5.751497] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 35 [ 5.778431] igb 0000:07:00.1: added PHC on eth1 [ 5.783050] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 5.789995] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:da:bd [ 5.797279] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 5.802481] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.846198] ata3: SATA link down (SStatus 0 SControl 300) [ 5.851697] ata1: SATA link down (SStatus 0 SControl 300) [ 5.857194] ata2: SATA link down (SStatus 0 SControl 300) [ 5.862678] ata4: SATA link down (SStatus 0 SControl 300) [ 5.871399] usb 3-12: new high-speed USB device number 2 using xhci_hcd [ 6.023631] usb 3-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 6.032007] usb 3-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 6.039725] hub 3-12:1.0: USB hub found [ 6.043727] hub 3-12:1.0: 4 ports detected [ 6.074132] ata10: SATA link down (SStatus 0 SControl 300) [ 6.079717] ata7: SATA link down (SStatus 0 SControl 300) [ 6.085204] ata9: SATA link down (SStatus 0 SControl 300) [ 6.090712] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 6.097005] ata6: SATA link down (SStatus 0 SControl 300) [ 6.102546] ata8: SATA link down (SStatus 0 SControl 300) [ 6.108040] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 6.114906] ata5.00: NCQ Send/Recv Log not supported [ 6.119960] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 6.128402] ata5.00: NCQ Send/Recv Log not supported [ 6.133458] ata5.00: configured for UDMA/133 [ 6.138046] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 6.146556] sd 4:0:0:0: Attached scsi generic sg0 type 0 [ 6.146681] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 6.159708] sd 4:0:0:0: [sda] Write Protect is off [ 6.164588] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 6.179101] sda: sda1 [ 6.181668] sd 4:0:0:0: [sda] Attached SCSI disk [ 6.190948] igb 0000:07:00.0 eno1: renamed from eth0 [ 6.216164] igb 0000:07:00.1 eno2: renamed from eth1 [ 6.355404] usb 3-12.1: new low-speed USB device number 3 using xhci_hcd [ 6.487762] usb 3-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 6.496312] usb 3-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 6.513103] hid: raw HID events driver (C) Jiri Kosina [ 6.522370] usbcore: registered new interface driver usbhid [ 6.528027] usbhid: USB HID core driver [ 6.534844] i: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.0/0003:0557:2419.0001/input/input2 [ 6.603614] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 6.615724] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.1/0003:0557:2419.0002/input/input3 [ 6.627780] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 6.796187] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.806592] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.815211] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 6.821467] ixgbe 0000:03:00.0: 0c:c4:7a:88:6e:34 [ 6.830028] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 7.000118] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.010520] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.019149] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 7.026274] ixgbe 0000:03:00.1: 0c:c4:7a:88:6e:35 [ 7.034694] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 7.043357] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ 7.068342] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 Begin: Loading essential drivers ... done. Begin: Running /scripts/init-premount ... done. Begin: Mounting root file system ... Begin: Running /scripts/local-top ... done. Begin: Running /scripts/local-premount ... done. Begin: Will now check root file system ... fsck from util-linux 2.37.2 [/usr/sbin/fsck.ext4 (1) -- /dev/sda1] fsck.ext4 -a -C0 /dev/sda1 /dev/sda1: recovering journal /dev/sda1: Clearing orphaned inode 24691 (uid=0, gid=0, mode=0100644, size=4447536) /dev/sda1: clean, 198127/61054976 files, 6545901/244190336 blocks done. [ 14.162870] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null). Quota mode: none. done. Begin: Running /scripts/local-bottom ... done. Begin: Running /scripts/init-bottom ... done. [ 14.997675] systemd[1]: Inserted module 'autofs4' [ 15.093875] systemd[1]: systemd 249.11-0ubuntu3.6 running in system mode (+PAM +AUDIT +SELINUX +APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY -P11KIT -QRENCODE +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 15.143521] systemd[1]: Detected architecture x86-64. Welcome to Ubuntu 22.04.1 LTS! [ 15.188978] systemd[1]: Hostname set to . [ 16.621798] systemd[1]: Queued start job for default target Graphical Interface. [ 16.630536] systemd[1]: Created slice Slice /system/modprobe. [ OK ] Created slice Slice /system/modprobe. [ 16.651816] systemd[1]: Created slice Slice /system/serial-getty. [ OK ] Created slice Slice /system/serial-getty. [ 16.675837] systemd[1]: Created slice User and Session Slice. [ OK ] Created slice User and Session Slice. [ 16.695564] systemd[1]: Started ntp-systemd-netif.path. [ OK ] Started ntp-systemd-netif.path. [ 16.715606] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ OK ] Started Forward Password R…uests to Wall Directory Watch. [ 16.739801] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ OK ] Set up automount Arbitrary…s File System Automount Point. [ 16.767538] systemd[1]: Reached target ceph target allowing to start/stop all ceph-fuse@.service instances at once. [ OK ] Reached target ceph target…se@.service instances at once. [ 16.795526] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ OK ] Reached target ceph target…on@.service instances at once. [ 16.823492] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ OK ] Reached target ceph target…ds@.service instances at once. [ 16.851482] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [ OK ] Reached target ceph target…gr@.service instances at once. [ 16.879482] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ OK ] Reached target ceph target…sd@.service instances at once. [ 16.907485] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ OK ] Reached target ceph target…gw@.service instances at once. [ 16.935579] systemd[1]: Reached target User and Group Name Lookups. [ OK ] Reached target User and Group Name Lookups. [ 16.959528] systemd[1]: Reached target Slice Units. [ OK ] Reached target Slice Units. [ 16.979526] systemd[1]: Reached target Local Verity Protected Volumes. [ OK ] Reached target Local Verity Protected Volumes. [ 17.003622] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on Device-mapper event daemon FIFOs. [ 17.027738] systemd[1]: Listening on LVM2 poll daemon socket. [ OK ] Listening on LVM2 poll daemon socket. [ 17.053151] systemd[1]: Listening on RPCbind Server Activation Socket. [ OK ] Listening on RPCbind Server Activation Socket. [ 17.075736] systemd[1]: Listening on Syslog Socket. [ OK ] Listening on Syslog Socket. [ 17.095733] systemd[1]: Listening on fsck to fsckd communication Socket. [ OK ] Listening on fsck to fsckd communication Socket. [ 17.119600] systemd[1]: Listening on initctl Compatibility Named Pipe. [ OK ] Listening on initctl Compatibility Named Pipe. [ 17.143920] systemd[1]: Listening on Journal Audit Socket. [ OK ] Listening on Journal Audit Socket. [ 17.163748] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 17.187757] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 17.207862] systemd[1]: Listening on Network Service Netlink Socket. [ OK ] Listening on Network Service Netlink Socket. [ 17.231767] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 17.251688] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 17.273194] systemd[1]: Mounting Huge Pages File System... Mounting Huge Pages File System... [ 17.293082] systemd[1]: Mounting POSIX Message Queue File System... Mounting POSIX Message Queue File System... [ 17.316906] systemd[1]: Mounting NFSD configuration filesystem... Mounting NFSD configuration filesystem... [ 17.341150] systemd[1]: Mounting Kernel Debug File System... Mounting Kernel Debug File System... [ 17.361249] systemd[1]: Mounting Kernel Trace File System... Mounting Kernel Trace File System... [ 17.379611] RPC: Registered named UNIX socket transport module. [ 17.385610] RPC: Registered udp transport module. [ 17.390389] RPC: Registered tcp transport module. [ 17.395163] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 17.402394] systemd[1]: Starting Journal Service... Starting Journal Service... [ 17.423589] systemd[1]: Condition check resulted in Kernel Module supporting RPCSEC_GSS being skipped. [ 17.433951] systemd[1]: Starting Set the console keyboard layout... Starting Set the console keyboard layout... [ 17.456457] systemd[1]: Starting Create List of Static Device Nodes... Starting Create List of Static Device Nodes... [ 17.480380] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... Starting Monitoring of LVM…meventd or progress polling... [ 17.512468] systemd[1]: Starting Load Kernel Module chromeos_pstore... Starting Load Kernel Module chromeos_pstore... [ 17.536283] systemd[1]: Starting Load Kernel Module configfs... Starting Load Kernel Module configfs... [ 17.556171] systemd[1]: Starting Load Kernel Module drm... Starting Load Kernel Module drm... [ 17.576172] systemd[1]: Starting Load Kernel Module efi_pstore... Starting Load Kernel Module efi_pstore... [ 17.604288] systemd[1]: Starting Load Kernel Module fuse... Starting Load Kernel Module fuse... [ 17.624301] systemd[1]: Starting Load Kernel Module pstore_blk... Starting Load Kernel Module pstore_blk... [ 17.636311] Installing knfsd (copyright (C) 1996 okir@monad.swb.de). [ 17.648517] systemd[1]: Starting Load Kernel Module pstore_zone... Starting Load Kernel Module pstore_zone... [ 17.676309] systemd[1]: Starting Load Kernel Module ramoops... Starting Load Kernel Module ramoops... [ 17.699422] systemd[1]: Condition check resulted in OpenVSwitch configuration for cleanup being skipped. [ 17.709215] systemd[1]: Condition check resulted in File System Check on Root Device being skipped. [ 17.724390] systemd[1]: Starting Load Kernel Modules... Starting Load Kernel Modules... [ 17.748532] systemd[1]: Starting Remount Root and Kernel File Systems... Starting Remount Root and Kernel File Systems... [ 17.772462] systemd[1]: Starting Coldplug All udev Devices... Starting Coldplug All udev Devices... [ 17.783456] EXT4-fs (sda1): re-mounted. Opts: errors=remount-ro,user_xattr. Quota mode: none. [ 17.793955] systemd[1]: Started Journal Service. [ OK ] Started Journal Service. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ 17.836687] lp: driver loaded but no devices found [ OK ] Mounted NFSD configuration filesystem. [ OK ] Mounted Kernel Debug File System[0[ 17.864987] Loading iSCSI transport class v2.0-870. m. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Set the console keyboard layout. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Monitoring of LVM… dmeventd or progress polling. [ OK ] Finished Load Kernel Module chromeos_pstore. [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Module efi_pstore. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Load Kernel Module pstore_blk. [ OK ] Finished Load Kernel Module pstore_zone. [ OK ] Finished Load Kernel Module ramoops. [ OK ] Finished Load Kernel Modules. [ OK ] Finished Remount Root and Kernel File Systems. Activating swap /swapfile... Mounting FUSE Control File System... [ 18.142268] Adding 2097148k swap on /swapfile. Priority:-2 extents:6 across:2260988k FS Mounting Kernel Configuration File System... Starting Initial Check File System Quotas... Starting Flush Journal to Persistent Storage... [ 18.213199] systemd-journald[367]: Received client request to flush runtime journal. Starting Load/Save Random Seed... Starting Apply Kernel Variables... Starting Create System Users... [ OK ] Activated swap /swapfile. [ OK ] Finished Coldplug All udev Devices. [ OK ] Mounted FUSE Control File System. [ OK ] Mounted Kernel Configuration File System. [ OK ] Reached target Swaps. Starting Helper to synchronize boot up for ifupdown... [ 18.400017] systemd-journald[367]: File /var/log/journal/5896a171b9d64a25b2db7eb12a64f597/system.journal corrupted or uncleanly shut down, renaming and replacing. [ OK ] Finished Load/Save Random Seed. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... [ OK ] Finished Initial Check File System Quotas. [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Load AppArmor profiles... Starting Set console font and keymap... Starting Create final runt…dir for shutdown pivot root... Starting Tell Plymouth To Write Out Runtime Data... Starting QEMU KVM preparation - module, ksm, hugepages... Starting Rule-based Manage…for Device Events and Files... Starting Uncomplicated firewall... [ OK ] Finished Flush Journal to Persistent Storage. [ OK ] Finished Set console font and keymap. [ OK ] Finished Create final runt…e dir for shutdown pivot root. [ OK ] Finished Tell Plymouth To Write Out Runtime Data. [ OK ] Finished Uncomplicated firewall. [ OK ] Reached target Preparation for Network. Starting Create Volatile Files and Directories... [ OK ] Finished Load AppArmor profiles. [ OK ] Finished Create Volatile Files and Directories. Mounting RPC Pipe File System... Starting Load Kernel Module chromeos_pstore... Starting Load Kernel Module efi_pstore... Starting Load Kernel Module pstore_blk... Starting Load Kernel Module pstore_zone... Starting Load Kernel Module ramoops... Starting RPC bind portmap service... Starting Record System Boot/Shutdown in UTMP... [ OK ] Mounted RPC Pipe File System. [ OK ] Finished Load Kernel Module chromeos_pstore. [ OK ] Finished QEMU KVM preparation - module, ksm, hugepages. [ OK ] Finished Load Kernel Module efi_pstore. [ OK ] Finished Load Kernel Module pstore_blk. [ OK ] Finished Load Kernel Module pstore_zone. [ OK ] Finished Load Kernel Module ramoops. [ OK ] Started Rule-based Manager for Device Events and Files. [ OK ] Reached target rpc_pipefs.target. Starting pNFS block layout mapping daemon... Starting NFSv4 ID-name mapping service... Starting NFSv4 Client Tracking Daemon... [ OK ] Started Dispatch Password …ts to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Path Units. [ OK ] Reached target NFS client services. Starting Network Configuration... [ OK ] Started pNFS block layout mapping daemon. [ OK ] Started NFSv4 ID-name mapping service. [ OK ] Finished Record System Boot/Shutdown in UTMP. [ OK ] Started NFSv4 Client Tracking Daemon. [ OK ] Reached target System Initialization. [ OK ] Started Daily apt download activities. [ OK ] Started Daily apt upgrade and clean activities. [ OK ] Started Daily dpkg database backup timer. [ OK ] Started Periodic ext4 Onli…ata Check for All Filesystems. [ OK ] Started Discard unused blocks once a week. [ OK ] Started Daily rotation of log files. [ OK ] Started Daily man-db regeneration. [ OK ] Started Message of the Day. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started Ubuntu Advantage Timer for running repeated jobs. [ OK ] Reached target Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. Starting Docker Socket for the API... [ OK ] Listening on Open-iSCSI iscsid Socket. [ OK ] Listening on UUID daemon activation socket. [ OK ] Listening on Docker Socket for the API. [ OK ] Found device /dev/ttyS1. [ OK ] Created slice Slice /system/lvm2-pvscan. [ OK ] Reached target Socket Units. [ OK ] Reached target Basic System. Starting Accounts Service... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target…h*@.service instances at once. [ OK ] Started D-Bus System Message Bus. [ OK ] Started Save initial kernel messages after boot. Starting Remove Stale Onli…t4 Metadata Check Snapshots... Starting Record successful boot for GRUB... [ OK ] Started irqbalance daemon. [ OK ] Started LTTng session daemon. Starting LVM event activation on device 259:0... Starting Dispatcher daemon for systemd-networkd... [ OK ] Started ntp-systemd-netif.service. Starting System Logging Service... Starting Self Monitoring a…g Technology (SMART) Daemon... Starting User Login Management... [ OK ] Started Network Configuration. [ OK ] Started RPC bind portmap service. [ OK ] Finished Remove Stale Onli…ext4 Metadata Check Snapshots. [ OK ] Finished LVM event activation on device 259:0. [ OK ] Found device /dev/vg_nvme/lv_5. [ OK ] Reached target RPC Port Mapper. [ OK ] Listening on Load/Save RF …itch Status /dev/rfkill Watch. Mounting /var/lib/ceph... [ OK ] Started ifup for enp3s0f1. Starting RPC Remote Quota Server... Starting Wait for Network to be Configured... Starting Network Name Resolution... [ OK ] Started User Login Management. [ OK ] Finished Record successful boot for GRUB. Starting GRUB failed boot detection... [ OK ] Started System Logging Service. [ OK ] Finished GRUB failed boot detection. [ OK ] Mounted /var/lib/ceph. [ OK ] Started RPC Remote Quota Server. [ OK ] Finished Helper to synchronize boot up for ifupdown. Starting Raise network interfaces... [ OK ] Started Network Name Resolution. [ OK ] Reached target Host and Network Name Lookups. [ OK ] Started Self Monitoring an…ing Technology (SMART) Daemon. Starting Authorization Manager... [ OK ] Started Authorization Manager. [ OK ] Started Accounts Service. [ OK ] Started Dispatcher daemon for systemd-networkd. [* ] (1 of 2) A start job is running for…k to be Configured (8s / no limit) M [ OK ] Started ntp-systemd-netif.service. [ OK ] Finished Wait for Network to be Configured. [ OK ] Started ntp-systemd-netif.service. [ OK ] Finished Raise network interfaces. [ OK ] Reached target Network. [ OK ] Reached target Network is Online. Starting containerd container runtime... Starting NFS Mount Daemon... Starting Network Time Service... Starting Connect NVMe-oF s…s automatically during boot... Starting Map RBD devices... Starting /etc/rc.local Compatibility... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' Starting NFS status monitor for NFSv2/3 locking.... Starting OpenBSD Secure Shell server... Starting (i)SCSI target daemon... Starting Ubuntu FAN network setup... [ OK ] Started Unattended Upgrades Shutdown. [ OK ] Started NFS Mount Daemon. [ OK ] Finished Map RBD devices. [ OK ] Finished Availability of block devices. [ OK ] Started NFS status monitor for NFSv2/3 locking.. Starting NFS server and services... + myips=172.21.15.150 + attempts=1 + sleep 1 [ OK ] Started Network Time Service. [ OK ] Finished Connect NVMe-oF s…ems automatically during boot. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting The Apache HTTP Server... Starting LSB: Collectl monitors system performance.... [ OK ] Started Regular background program processing daemon. [ OK ] Started Nagios Remote Plugin Executor. Starting LSB: radosgw RESTful rados gateway... Starting Permit User Sessions... [ OK ] Finished Permit User Sessions. [ OK ] Started OpenBSD Secure Shell server. [ OK ] Finished NFS server and services. Starting Notify NFS peers of a restart... [ OK ] Started Notify NFS peers of a restart. + '[' 172.21.15.150 '!=' '' ']' + set -e + '[' -n 172.21.15.150 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.150 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.150 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' [ OK ] Started LSB: radosgw RESTful rados gateway. [ OK ] Finished Ubuntu FAN network setup. [ OK ] Started (i)SCSI target daemon. [ OK ] Started The Apache HTTP Server. + newhostname=smithi150.front.sepia.ceph.com + '[' -n smithi150.front.sepia.ceph.com ']' + hostname smithi150.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi150 + echo smithi150 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.150 smithi150.front.sepia.ceph.com smithi150/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' '!' -f /etc/ssh/ssh_host_rsa_key ']' + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... [ OK ] Finished Hold until boot process finishes up. [ OK ] Finished Terminate Plymouth Boot Screen. [ OK ] Started Serial Getty on ttyS1. Starting Set console scheme... [ OK ] Finished Set console scheme. [ OK ] Created slice Slice /system/getty. [ OK ] Started Getty on tty1. [ OK ] Reached target Login Prompts. [ OK ] Started containerd container runtime. Starting Docker Application Container Engine... [ OK ] Started LSB: Collectl monitors system performance.. [ OK ] Started Docker Application Container Engine. [ OK ] Reached target Multi-User System. [ OK ] Reached target Graphical Interface. Starting Record Runlevel Change in UTMP... [ OK ] Finished Record Runlevel Change in UTMP. Ubuntu 22.04.1 LTS smithi150.front.sepia.ceph.com ttyS1 2024-04-18T21:09:41.030 DEBUG:teuthology.orchestra.console.smithi150:expect after: smithi150 login: 2024-04-18T21:09:41.083 DEBUG:teuthology.orchestra.console.smithi150:console disconnect output: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.72 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 88 6E 35 GUID: 00000000 0000 0000 0000 0CC47AD9DABC DHCP.-                    DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./  21.15.150 MAS : 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 95D3:0070, entry point at 95D3:0106  UNDI code segment 95D3:3E70, data segment 8E94:73F0 (570-615kB)  UNDI device is PCI 03:00.1, type DIX+802.3  570kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.150 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:88:6e:35)... Configuring (net0 0c:c4:7a:88:6e:35).... Configuring (net0 0c:c4:7a:88:6e:35)..... Configuring (net0 0c:c4:7a:88:6e:35)...... ok     * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  ******************************************************************************   Use the * and * keys to select which entry is highlighted.  Press enter to boot the selected OS, `e' to edit the commands  before booting or `c' for a command-line.  The highlighted entry will be executed automatically in 5s.  GNU GRUB version 2.04  ******************************************************************************  * Ubuntu *  **Advanced options for Ubuntu *  The highlighted entry will be executed automatically in 4s.  The highlighted entry will be executed automatically in 3s.  The highlighted entry will be executed automatically in 2s.  The highlighted entry will be executed automatically in 1s.                     Loading Linux 5.15.0-102-generic ... [ 0.000000] microcode: microcode updated early to revision 0xb000040, date = 2021-05-19 [ 0.000000] Linux version 5.15.0-102-generic (buildd@lcy02-amd64-080) (gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0, GNU ld (GNU Binutils for Ubuntu) 2.38) #112-Ubuntu SMP Tue Mar 5 16:50:32 UTC 2024 (Ubuntu 5.15.0-102.112-generic 5.15.148) [ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-102-generic root=UUID=7e9e2103-8bb7-4452-b35a-3b1230743254 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.000000] KERNEL supported cpus: [ 0.000000] Intel GenuineIntel [ 0.000000] AMD AuthenticAMD [ 0.000000] Hygon HygonGenuine [ 0.000000] Centaur CentaurHauls [ 0.000000] zhaoxin Shanghai [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008abff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ec5fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f78000-0x00000000798a7fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798a8000-0x0000000079d44fff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d45000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0a 08/02/2016 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.989 MHz processor [ 0.000414] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000595] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.001901] last_pfn = 0x78ec6 max_arch_pfn = 0x400000000 [ 0.008121] found SMP MP-table at [mem 0x000fcd40-0x000fcd4f] [ 0.008135] Using GB pages for direct mapping [ 0.008270] RAMDISK: [mem 0x300cf000-0x3405efff] [ 0.008276] ACPI: Early table checksum verification disabled [ 0.008279] ACPI: RSDP 0x00000000000F05B0 000024 (v02 SUPERM) [ 0.008283] ACPI: XSDT 0x00000000798A80A0 0000BC (v01 01072009 AMI 00010013) [ 0.008288] ACPI: FACP 0x00000000798DB838 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008293] ACPI: DSDT 0x00000000798A81F0 033641 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.008296] ACPI: FACS 0x0000000079D43F80 000040 [ 0.008298] ACPI: APIC 0x00000000798DB948 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008301] ACPI: FPDT 0x00000000798DBA10 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008304] ACPI: FIDT 0x00000000798DBA58 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008307] ACPI: SPMI 0x00000000798DBAF8 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.008310] ACPI: MCFG 0x00000000798DBB38 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.008313] ACPI: UEFI 0x00000000798DBB78 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.008315] ACPI: HPET 0x00000000798DBBC0 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008318] ACPI: WDDT 0x00000000798DBBF8 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.008321] ACPI: SSDT 0x00000000798DBC38 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.008324] ACPI: NITR 0x00000000798F2DB8 000071 (v02 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008327] ACPI: SSDT 0x00000000798F2E30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.008330] ACPI: SSDT 0x00000000798F5480 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.008332] ACPI: PRAD 0x00000000798F54E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.008335] ACPI: DMAR 0x00000000798F55F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008338] ACPI: HEST 0x00000000798F56B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008341] ACPI: BERT 0x00000000798F5930 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008344] ACPI: ERST 0x00000000798F5960 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008347] ACPI: EINJ 0x00000000798F5B90 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008349] ACPI: Reserving FACP table memory at [mem 0x798db838-0x798db943] [ 0.008351] ACPI: Reserving DSDT table memory at [mem 0x798a81f0-0x798db830] [ 0.008352] ACPI: Reserving FACS table memory at [mem 0x79d43f80-0x79d43fbf] [ 0.008353] ACPI: Reserving APIC table memory at [mem 0x798db948-0x798dba0f] [ 0.008354] ACPI: Reserving FPDT table memory at [mem 0x798dba10-0x798dba53] [ 0.008355] ACPI: Reserving FIDT table memory at [mem 0x798dba58-0x798dbaf3] [ 0.008356] ACPI: Reserving SPMI table memory at [mem 0x798dbaf8-0x798dbb37] [ 0.008357] ACPI: Reserving MCFG table memory at [mem 0x798dbb38-0x798dbb73] [ 0.008358] ACPI: Reserving UEFI table memory at [mem 0x798dbb78-0x798dbbb9] [ 0.008359] ACPI: Reserving HPET table memory at [mem 0x798dbbc0-0x798dbbf7] [ 0.008359] ACPI: Reserving WDDT table memory at [mem 0x798dbbf8-0x798dbc37] [ 0.008360] ACPI: Reserving SSDT table memory at [mem 0x798dbc38-0x798f2db6] [ 0.008361] ACPI: Reserving NITR table memory at [mem 0x798f2db8-0x798f2e28] [ 0.008362] ACPI: Reserving SSDT table memory at [mem 0x798f2e30-0x798f547b] [ 0.008363] ACPI: Reserving SSDT table memory at [mem 0x798f5480-0x798f54e3] [ 0.008364] ACPI: Reserving PRAD table memory at [mem 0x798f54e8-0x798f55e9] [ 0.008365] ACPI: Reserving DMAR table memory at [mem 0x798f55f0-0x798f56ab] [ 0.008366] ACPI: Reserving HEST table memory at [mem 0x798f56b0-0x798f592b] [ 0.008367] ACPI: Reserving BERT table memory at [mem 0x798f5930-0x798f595f] [ 0.008368] ACPI: Reserving ERST table memory at [mem 0x798f5960-0x798f5b8f] [ 0.008369] ACPI: Reserving EINJ table memory at [mem 0x798f5b90-0x798f5cbf] [ 0.008464] No NUMA configuration found [ 0.008465] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.008474] NODE_DATA(0) allocated [mem 0x87ffd6000-0x87fffffff] [ 0.008805] Zone ranges: [ 0.008806] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.008808] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.008810] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.008812] Device empty [ 0.008813] Movable zone start for each node [ 0.008815] Early memory node ranges [ 0.008816] node 0: [mem 0x0000000000001000-0x0000000000089fff] [ 0.008817] node 0: [mem 0x0000000000100000-0x0000000078ec5fff] [ 0.008819] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.008823] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.008827] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.008863] On node 0, zone DMA: 118 pages in unavailable ranges [ 0.080444] On node 0, zone Normal: 28986 pages in unavailable ranges [ 0.080558] ACPI: PM-Timer IO Port: 0x408 [ 0.080565] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.080567] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.080568] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.080569] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.080570] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.080571] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.080572] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.080572] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.080582] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.080586] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.080589] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.080590] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.080594] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.080595] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.080599] TSC deadline timer available [ 0.080601] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.080610] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.080612] PM: hibernation: Registered nosave memory: [mem 0x0008a000-0x000dffff] [ 0.080613] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.080615] PM: hibernation: Registered nosave memory: [mem 0x78ec6000-0x78f77fff] [ 0.080616] PM: hibernation: Registered nosave memory: [mem 0x78f78000-0x798a7fff] [ 0.080616] PM: hibernation: Registered nosave memory: [mem 0x798a8000-0x79d44fff] [ 0.080617] PM: hibernation: Registered nosave memory: [mem 0x79d45000-0x8fffffff] [ 0.080618] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.080619] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.080620] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.080621] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.080623] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.080624] Booting paravirtualized kernel on bare hardware [ 0.080626] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns [ 0.080633] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.080847] percpu: Embedded 61 pages/cpu s212992 r8192 d28672 u262144 [ 0.080878] Built 1 zonelists, mobility grouping on. Total pages: 8228746 [ 0.080880] Policy zone: Normal [ 0.080881] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-102-generic root=UUID=7e9e2103-8bb7-4452-b35a-3b1230743254 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.080940] Unknown kernel command line parameters "BOOT_IMAGE=/boot/vmlinuz-5.15.0-102-generic", will be passed to user space. [ 0.083098] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.084246] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.084340] mem auto-init: stack:off, heap alloc:on, heap free:off [ 0.170593] Memory: 32672712K/33438012K available (16393K kernel code, 4395K rwdata, 10948K rodata, 3352K init, 18716K bss, 765040K reserved, 0K cma-reserved) [ 0.170875] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.170890] Kernel/User page tables isolation: enabled [ 0.170922] ftrace: allocating 50694 entries in 199 pages [ 0.190591] ftrace: allocated 199 pages with 5 groups [ 0.190708] rcu: Hierarchical RCU implementation. [ 0.190710] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.190712] Rude variant of Tasks RCU enabled. [ 0.190713] Tracing variant of Tasks RCU enabled. [ 0.190713] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. [ 0.190714] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.194137] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.194336] random: crng init done [ 0.199203] Console: colour VGA+ 80x25 [ 0.210563] printk: console [tty0] enabled [ 1.197408] printk: console [ttyS1] enabled [ 1.201666] ACPI: Core revision 20210730 [ 1.205828] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.215056] APIC: Switch to symmetric I/O mode setup [ 1.220093] DMAR: Host address width 46 [ 1.223996] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.229382] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.238579] DMAR: RMRR base: 0x0000007ba6e000 end: 0x0000007ba7dfff [ 1.244911] DMAR: ATSR flags: 0x0 [ 1.248295] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.254637] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.261057] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.267480] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.272948] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.272949] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.288132] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.293507] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.299799] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.323055] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x327346e9ce8, max_idle_ns: 440795304517 ns [ 1.333668] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.97 BogoMIPS (lpj=13999956) [ 1.337684] CPU0: Thermal monitoring enabled (TM1) [ 1.341719] process: using mwait in idle threads [ 1.345667] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.349666] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.353667] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.357666] Spectre V2 : Mitigation: Retpolines [ 1.361666] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.365666] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.369666] Spectre V2 : Enabling Restricted Speculation for firmware calls [ 1.373666] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier [ 1.377666] Spectre V2 : User space: Mitigation: STIBP via seccomp and prctl [ 1.381666] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp [ 1.385669] MDS: Mitigation: Clear CPU buffers [ 1.389666] TAA: Mitigation: Clear CPU buffers [ 1.393666] MMIO Stale Data: Mitigation: Clear CPU buffers [ 1.397670] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.401666] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.405666] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.409666] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.413666] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.435363] Freeing SMP alternatives memory: 44K [ 1.437666] pid_max: default: 32768 minimum: 301 [ 1.441686] LSM: Security Framework initializing [ 1.445674] landlock: Up and running. [ 1.449666] Yama: becoming mindful. [ 1.453683] AppArmor: AppArmor initialized [ 1.457727] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.461706] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.466022] smpboot: Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.469671] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.473773] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.477667] ... version: 3 [ 1.481666] ... bit width: 48 [ 1.485666] ... generic registers: 4 [ 1.489666] ... value mask: 0000ffffffffffff [ 1.493666] ... max period: 00007fffffffffff [ 1.497666] ... fixed-purpose events: 3 [ 1.501666] ... event mask: 000000070000000f [ 1.505726] signal: max sigframe size: 1776 [ 1.509680] rcu: Hierarchical SRCU implementation. [ 1.514379] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.517730] smp: Bringing up secondary CPUs ... [ 1.521746] x86: Booting SMP configuration: [ 1.525668] .... node #0, CPUs: #1 #2 #3 #4 [ 1.533746] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.541666] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.545666] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.549764] #5 #6 #7 [ 1.550221] smp: Brought up 1 node, 8 CPUs [ 1.557668] smpboot: Max logical packages: 1 [ 1.561666] smpboot: Total of 8 processors activated (55999.82 BogoMIPS) [ 1.569982] devtmpfs: initialized [ 1.573080] x86/mm: Memory block size: 128MB [ 1.575264] ACPI: PM: Registering ACPI NVS region [mem 0x798a8000-0x79d44fff] (4837376 bytes) [ 1.577742] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns [ 1.581676] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.585713] pinctrl core: initialized pinctrl subsystem [ 1.589757] PM: RTC time: 21:09:07, date: 2024-04-18 [ 1.593773] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.597999] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.601965] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.605999] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.609677] audit: initializing netlink subsys (disabled) [ 1.613685] audit: type=2000 audit(1713474545.356:1): state=initialized audit_enabled=0 res=1 [ 1.613783] thermal_sys: Registered thermal governor 'fair_share' [ 1.617668] thermal_sys: Registered thermal governor 'bang_bang' [ 1.621666] thermal_sys: Registered thermal governor 'step_wise' [ 1.625666] thermal_sys: Registered thermal governor 'user_space' [ 1.629666] thermal_sys: Registered thermal governor 'power_allocator' [ 1.633671] EISA bus registered [ 1.640873] cpuidle: using governor ladder [ 1.641668] cpuidle: using governor menu [ 1.645682] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.649667] ACPI: bus type PCI registered [ 1.653667] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.657722] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 1.661667] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 1.665680] PCI: Using configuration type 1 for base access [ 1.670685] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.673682] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 1.677667] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 1.681742] ACPI: Added _OSI(Module Device) [ 1.685668] ACPI: Added _OSI(Processor Device) [ 1.689673] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.693666] ACPI: Added _OSI(Processor Aggregator Device) [ 1.697666] ACPI: Added _OSI(Linux-Dell-Video) [ 1.701666] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.705666] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.754738] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.760992] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.765809] ACPI: Dynamic OEM Table Load: [ 1.795031] ACPI: Interpreter enabled [ 1.797677] ACPI: PM: (supports S0 S4 S5) [ 1.801666] ACPI: Using IOAPIC for interrupt routing [ 1.805688] HEST: Enabling Firmware First mode for corrected errors. [ 1.809744] HEST: Table parsing has been initialized. [ 1.813813] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.817668] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.821666] PCI: Using E820 reservations for host bridge windows [ 1.826354] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.859670] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.865670] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.875604] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.886653] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.893666] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.901701] PCI host bridge to bus 0000:ff [ 1.905667] pci_bus 0000:ff: root bus resource [bus ff] [ 1.909676] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 [ 1.917732] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 [ 1.921719] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 [ 1.929718] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 [ 1.933718] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 [ 1.941718] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 [ 1.949719] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 [ 1.953718] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 [ 1.961722] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 [ 1.965717] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 [ 1.973718] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 [ 1.977718] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 [ 1.985717] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 [ 1.989718] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 [ 1.997722] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 [ 2.001719] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 [ 2.009719] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 [ 2.013718] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 [ 2.021717] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 [ 2.025691] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 [ 2.033729] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 [ 2.037768] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 [ 2.045730] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 [ 2.053731] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 [ 2.057733] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 [ 2.065731] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 [ 2.077730] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 [ 2.085720] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 [ 2.089721] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 [ 2.097732] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 [ 2.101730] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 [ 2.109730] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 [ 2.113732] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 [ 2.121720] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 [ 2.125719] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 [ 2.133719] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 [ 2.137721] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 [ 2.145730] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 [ 2.149730] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 [ 2.157732] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 [ 2.165734] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 [ 2.169723] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 [ 2.177719] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 [ 2.181721] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 [ 2.189722] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 [ 2.193719] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 [ 2.201719] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 [ 2.205719] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 [ 2.213725] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 [ 2.217719] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 [ 2.225718] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 [ 2.229719] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 [ 2.237693] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 [ 2.241720] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 [ 2.249719] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 [ 2.257649] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 2.265669] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 2.273982] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 2.282108] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 2.293666] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 2.301957] PCI host bridge to bus 0000:00 [ 2.305667] pci_bus 0000:00: root bus resource [bus 00-fe] [ 2.309666] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 2.317666] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 2.321666] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 2.329666] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 2.337666] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 2.345667] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 2.353773] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 [ 2.361881] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 [ 2.365732] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 2.373836] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 [ 2.377731] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 2.385831] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 [ 2.389731] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 2.397826] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 [ 2.405686] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 2.409861] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 [ 2.417685] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 2.425858] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 [ 2.429685] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 2.437859] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 [ 2.441685] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 2.449862] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 [ 2.457685] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 2.461862] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 [ 2.469685] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 2.477858] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 [ 2.481685] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 2.489860] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 [ 2.497685] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 2.501811] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 [ 2.509887] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 [ 2.513814] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 [ 2.521837] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 [ 2.525680] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 2.533908] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 2.541957] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 2.545688] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 2.553677] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 2.557677] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 2.561677] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 2.569677] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 2.573677] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 2.581706] pci 0000:00:11.4: PME# supported from D3hot [ 2.585824] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 2.593692] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 2.597742] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 2.605816] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 2.613692] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 2.617743] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 2.625813] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 2.629692] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 2.637743] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 2.645823] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 2.649689] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 2.657771] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 2.661820] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 2.669755] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 2.673828] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 2.681757] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 2.689828] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 2.693757] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 2.701836] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 2.705689] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 2.713770] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 2.717822] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 2.725944] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 2.733685] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 2.737676] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 2.741676] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 2.749676] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 2.753676] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 2.761676] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 2.765700] pci 0000:00:1f.2: PME# supported from D3hot [ 2.773809] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 2.777692] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 2.785697] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 2.789874] acpiphp: Slot [1] registered [ 2.793683] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.801843] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 [ 2.805686] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 2.813708] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 2.817669] pci 0000:02:00.0: enabling Extended Tags [ 2.825768] pci 0000:00:02.0: PCI bridge to [bus 02] [ 2.829668] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 2.837841] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 2.841688] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 2.849675] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 2.857688] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 2.861675] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 2.869707] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 2.877687] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.881666] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.893679] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.901667] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.909829] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 2.917688] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 2.925675] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 2.929688] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 2.937675] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 2.945706] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 2.949683] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.957666] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.969679] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.977666] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.985799] pci 0000:00:03.0: PCI bridge to [bus 03] [ 2.993667] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 2.997667] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 3.005667] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.013696] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 3.017733] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 3.025754] pci 0000:05:00.0: enabling Extended Tags [ 3.029744] pci 0000:05:00.0: supports D1 D2 [ 3.033666] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 3.041770] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 3.045668] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 3.049667] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.057713] pci_bus 0000:06: extended config space not accessible [ 3.065696] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 3.069698] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 3.077683] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 3.081743] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 3.089756] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 3.105668] pci 0000:06:00.0: pci_fixup_video+0x0/0xe0 took 15625 usecs [ 3.113708] pci 0000:06:00.0: supports D1 D2 [ 3.117666] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 3.121778] pci 0000:05:00.0: PCI bridge to [bus 06] [ 3.125673] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 3.129669] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.133765] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 3.137693] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 3.141694] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 3.145680] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 3.149802] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 3.153704] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 3.157666] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 3.161692] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 3.165666] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 3.169842] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 3.173693] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 3.177694] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 3.181680] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 3.185796] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 3.189703] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 3.193666] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 3.197692] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 3.201666] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 3.205822] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 3.209668] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 3.213667] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 3.217669] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 3.222550] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 3.225713] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 3.229712] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 3.233712] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 3.237712] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 3.241666] ACPI: PCI: Interrupt link LNKE disabled [ 3.245711] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 3.249666] ACPI: PCI: Interrupt link LNKF disabled [ 3.253711] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 3.257666] ACPI: PCI: Interrupt link LNKG disabled [ 3.261711] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 3.265666] ACPI: PCI: Interrupt link LNKH disabled [ 3.269858] iommu: Default domain type: Translated [ 3.273667] iommu: DMA domain TLB invalidation policy: lazy mode [ 3.277799] SCSI subsystem initialized [ 3.281676] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 3.285665] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 3.285666] pci 0000:06:00.0: vgaarb: bridge control possible [ 3.289666] vgaarb: loaded [ 3.292444] ACPI: bus type USB registered [ 3.293676] usbcore: registered new interface driver usbfs [ 3.297671] usbcore: registered new interface driver hub [ 3.301670] usbcore: registered new device driver usb [ 3.305680] pps_core: LinuxPPS API ver. 1 registered [ 3.309666] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 3.313669] PTP clock support registered [ 3.317673] EDAC MC: Ver: 3.0.0 [ 3.320974] NetLabel: Initializing [ 3.321667] NetLabel: domain hash size = 128 [ 3.325666] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 3.329678] NetLabel: unlabeled traffic allowed by default [ 3.333675] PCI: Using ACPI for IRQ routing [ 3.342895] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 3.345666] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 3.351705] clocksource: Switched to clocksource tsc-early [ 3.363905] VFS: Disk quotas dquot_6.6.0 [ 3.367908] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 3.374939] AppArmor: AppArmor Filesystem Enabled [ 3.379743] pnp: PnP ACPI init [ 3.383305] system 00:01: [io 0x0500-0x057f] has been reserved [ 3.389298] system 00:01: [io 0x0400-0x047f] has been reserved [ 3.395280] system 00:01: [io 0x0580-0x059f] has been reserved [ 3.401269] system 00:01: [io 0x0600-0x061f] has been reserved [ 3.407258] system 00:01: [io 0x0880-0x0883] has been reserved [ 3.413245] system 00:01: [io 0x0800-0x081f] has been reserved [ 3.419227] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 3.425909] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 3.432593] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 3.439274] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 3.445957] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 3.452640] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 3.459322] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 3.466203] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 3.472191] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 3.478177] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 3.484157] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 3.490138] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 3.497046] pnp: PnP ACPI: found 5 devices [ 3.506567] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 3.515569] NET: Registered PF_INET protocol family [ 3.520686] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.529963] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 3.538785] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 3.546784] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.555187] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 3.562720] TCP: Hash tables configured (established 262144 bind 65536) [ 3.569520] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 3.577299] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.584312] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.591771] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 3.597497] NET: Registered PF_XDP protocol family [ 3.602375] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 3.613951] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 3.621863] pci 0000:00:01.0: PCI bridge to [bus 01] [ 3.626905] pci 0000:00:02.0: PCI bridge to [bus 02] [ 3.631939] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 3.638808] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.646459] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.654460] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.662197] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.670285] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.677938] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.685942] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.693685] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.701776] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.709430] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.717433] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.725171] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.733257] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.740909] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.748911] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.756649] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.764735] pci 0000:00:03.0: PCI bridge to [bus 03] [ 3.769764] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 3.775923] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 3.782780] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.790614] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 3.795662] pci 0000:05:00.0: PCI bridge to [bus 06] [ 3.800689] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 3.806860] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.813733] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 3.819026] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 3.825189] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.832053] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 3.839879] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 3.847794] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 3.855627] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 3.863542] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 3.868574] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 3.874735] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 3.881591] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 3.897076] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 3.903323] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 3.909570] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 3.916505] pci_bus 0000:00: resource 7 [mem 0x90000000-0xfbffbfff window] [ 3.923448] pci_bus 0000:00: resource 8 [mem 0xfedb0000-0xfedb000f window] [ 3.930391] pci_bus 0000:00: resource 9 [mem 0xfedc0000-0xfedc000f window] [ 3.937331] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 3.943668] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 3.949308] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 3.955645] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.962954] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 3.968592] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.974928] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 3.980568] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.986897] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 3.992538] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 3.998864] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 4.006366] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 4.035483] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x160 took 21315 usecs [ 4.067481] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x160 took 23920 usecs [ 4.074982] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 4.081531] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 4.081546] Trying to unpack rootfs image as initramfs... [ 4.088040] software IO TLB: mapped [mem 0x0000000074ec6000-0x0000000078ec6000] (64MB) [ 4.101993] Initialise system trusted keyrings [ 4.106529] Key type blacklist registered [ 4.110646] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 4.118118] zbud: loaded [ 4.120922] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ 4.126977] fuse: init (API version 7.34) [ 4.131203] integrity: Platform Keyring initialized [ 4.144095] Key type asymmetric registered [ 4.148265] Asymmetric key parser 'x509' registered [ 4.153237] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 243) [ 4.160773] io scheduler mq-deadline registered [ 4.165947] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 4.171991] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 4.178011] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 4.183982] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 4.189955] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 4.195915] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 4.201887] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 4.208801] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 4.214691] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 4.223159] ACPI: button: Power Button [PWRB] [ 4.227615] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 4.235132] ACPI: button: Power Button [PWRF] [ 4.240881] ERST: Error Record Serialization Table (ERST) support is initialized. [ 4.248454] pstore: Registered erst as persistent store backend [ 4.254596] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled [ 4.281527] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 4.310461] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 4.320046] Linux agpgart interface v0.103 [ 4.325858] loop: module loaded [ 4.329296] tun: Universal TUN/TAP device driver, 1.6 [ 4.334437] PPP generic driver version 2.4.2 [ 4.338819] VFIO - User Level meta-driver version: 0.3 [ 4.344153] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 4.350757] ehci-pci: EHCI PCI platform driver [ 4.355437] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 4.360738] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 4.368230] ehci-pci 0000:00:1a.0: debug port 2 [ 4.376740] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 4.395371] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 4.401235] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 4.409590] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.416903] usb usb1: Product: EHCI Host Controller [ 4.421852] usb usb1: Manufacturer: Linux 5.15.0-102-generic ehci_hcd [ 4.428364] usb usb1: SerialNumber: 0000:00:1a.0 [ 4.433201] hub 1-0:1.0: USB hub found [ 4.435476] Freeing initrd memory: 65088K [ 4.437031] hub 1-0:1.0: 2 ports detected [ 4.445436] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 4.450734] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2 [ 4.458225] ehci-pci 0000:00:1d.0: debug port 2 [ 4.466724] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 4.487405] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 4.493256] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 4.501601] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.508906] usb usb2: Product: EHCI Host Controller [ 4.513848] usb usb2: Manufacturer: Linux 5.15.0-102-generic ehci_hcd [ 4.520352] usb usb2: SerialNumber: 0000:00:1d.0 [ 4.525151] hub 2-0:1.0: USB hub found [ 4.528966] hub 2-0:1.0: 2 ports detected [ 4.533163] ehci-platform: EHCI generic platform driver [ 4.538469] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 4.544716] ohci-pci: OHCI PCI platform driver [ 4.549245] ohci-platform: OHCI generic platform driver [ 4.554537] uhci_hcd: USB Universal Host Controller Interface driver [ 4.561003] i8042: PNP: No PS/2 controller found. [ 4.565835] mousedev: PS/2 mouse device common for all mice [ 4.571548] rtc_cmos 00:00: RTC can wake from S4 [ 4.576447] rtc_cmos 00:00: registered as rtc0 [ 4.580986] rtc_cmos 00:00: setting system clock to 2024-04-18T21:09:10 UTC (1713474550) [ 4.589180] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 4.595952] i2c_dev: i2c /dev entries driver [ 4.600458] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [ 4.612743] device-mapper: uevent: version 1.0.3 [ 4.617489] device-mapper: ioctl: 4.45.0-ioctl (2021-03-22) initialised: dm-devel@redhat.com [ 4.626034] platform eisa.0: Probing EISA bus 0 [ 4.630635] platform eisa.0: EISA: Cannot allocate resource for mainboard [ 4.637487] platform eisa.0: Cannot allocate resource for EISA slot 1 [ 4.643993] platform eisa.0: Cannot allocate resource for EISA slot 2 [ 4.650500] platform eisa.0: Cannot allocate resource for EISA slot 3 [ 4.657011] platform eisa.0: Cannot allocate resource for EISA slot 4 [ 4.663520] platform eisa.0: Cannot allocate resource for EISA slot 5 [ 4.670029] platform eisa.0: Cannot allocate resource for EISA slot 6 [ 4.676536] platform eisa.0: Cannot allocate resource for EISA slot 7 [ 4.683047] platform eisa.0: Cannot allocate resource for EISA slot 8 [ 4.689555] platform eisa.0: EISA: Detected 0 cards [ 4.694505] intel_pstate: Intel P-state driver initializing [ 4.701208] ledtrig-cpu: registered to indicate activity on CPUs [ 4.707446] drop_monitor: Initializing network drop monitor service [ 4.713894] NET: Registered PF_INET6 protocol family [ 4.726960] Segment Routing with IPv6 [ 4.730700] In-situ OAM (IOAM) with IPv6 [ 4.734721] NET: Registered PF_PACKET protocol family [ 4.739908] Key type dns_resolver registered [ 4.744690] microcode: sig=0x406f1, pf=0x1, revision=0xb000040 [ 4.750688] microcode: Microcode Update Driver: v2.2. [ 4.750772] resctrl: L3 allocation detected [ 4.760133] resctrl: L3 monitoring detected [ 4.764383] IPI shorthand broadcast: enabled [ 4.768729] sched_clock: Marking stable (3705377173, 1063335746)->(5273073816, -504360897) [ 4.777312] registered taskstats version 1 [ 4.779376] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 4.788191] Loading compiled-in X.509 certificates [ 4.793650] Loaded X.509 cert 'Build time autogenerated kernel key: 8dbd8aa72291a99043f1138db79927b696791b59' [ 4.804081] Loaded X.509 cert 'Canonical Ltd. Live Patch Signing: 14df34d1a87cf37625abec039ef2bf521249b969' [ 4.814324] Loaded X.509 cert 'Canonical Ltd. Kernel Module Signing: 88f752e560a1e0737e31163a466ad7b70a850c19' [ 4.824413] blacklist: Loading compiled-in revocation X.509 certificates [ 4.831193] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing: 61482aa2830d0ab2ad5af10b7250da9033ddcef0' [ 4.841113] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2017): 242ade75ac4a15e50d50c84b0d45ff3eae707a03' [ 4.851659] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (ESM 2018): 365188c1d374d6b07c3c8f240f8ef722433d6a8b' [ 4.862539] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2019): c0746fd6c5da3ae827864651ad66ae47fe24b3e8' [ 4.873068] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v1): a8d54bbb3825cfb94fa13c9f8a594a195c107b8d' [ 4.875372] usb 2-1: new high-speed USB device number 2 using ehci-pci [ 4.883877] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v2): 4cf046892d6fd3c9a5b03f98d845f90851dc6a8c' [ 4.901273] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v3): 100437bb6de6e469b581e61cd66bce3ef4ed53af' [ 4.912061] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (Ubuntu Core 2019): c1d57b8f6b743f23ee41f4f7ee292f06eecadfb9' [ 4.923900] zswap: loaded using pool lzo/zbud [ 4.928645] Key type .fscrypt registered [ 4.932639] Key type fscrypt-provisioning registered [ 4.937724] pstore: Using crash dump compression: deflate [ 4.946057] Key type encrypted registered [ 4.950129] AppArmor: AppArmor sha1 policy hashing enabled [ 4.951763] usb 1-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 4.955708] ima: No TPM chip found, activating TPM-bypass! [ 4.971607] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.971782] hub 1-1:1.0: USB hub found [ 4.977162] Loading compiled-in module X.509 certificates [ 4.977575] Loaded X.509 cert 'Build time autogenerated kernel key: 8dbd8aa72291a99043f1138db79927b696791b59' [ 4.984512] hub 1-1:1.0: 6 ports detected [ 4.988183] ima: Allocated hash algorithm: sha1 [ 5.012335] ima: No architecture policies found [ 5.016941] evm: Initialising EVM extended attributes: [ 5.022141] evm: security.selinux [ 5.025518] evm: security.SMACK64 [ 5.028898] evm: security.SMACK64EXEC [ 5.032624] evm: security.SMACK64TRANSMUTE [ 5.036785] evm: security.SMACK64MMAP [ 5.040513] evm: security.apparmor [ 5.043977] evm: security.ima [ 5.047009] evm: security.capability [ 5.050651] evm: HMAC attrs: 0x1 [ 5.054246] PM: Magic number: 4:186:197 [ 5.058387] acpi device:1b4: hash matches [ 5.059765] usb 2-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 5.062500] acpi device:52: hash matches [ 5.070723] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.074722] acpi PNP0100:00: hash matches [ 5.086169] hub 2-1:1.0: USB hub found [ 5.090138] RAS: Correctable Errors collector initialized. [ 5.090139] hub 2-1:1.0: 8 ports detected [ 5.100740] Freeing unused decrypted memory: 2036K [ 5.106082] Freeing unused kernel image (initmem) memory: 3352K [ 5.119404] Write protecting the kernel read-only data: 30720k [ 5.125714] Freeing unused kernel image (text/rodata gap) memory: 2036K [ 5.132404] tsc: Refined TSC clocksource calibration: 3499.997 MHz [ 5.138656] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734e5ebc4, max_idle_ns: 440795265422 ns [ 5.148810] clocksource: Switched to clocksource tsc [ 5.154054] Freeing unused kernel image (rodata/data gap) memory: 1340K [ 5.198787] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.205300] x86/mm: Checking user space page tables [ 5.247147] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.253659] Run /init as init process Loading, please wait... Starting version 249.11-0ubuntu3.6 [ 5.409106] dca service started, version 1.12.1 [ 5.415782] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 5.421230] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 5.428931] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 5.429806] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 5.437121] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 5.454255] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 5.459556] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 5.467039] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 5.473408] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 5.475612] scsi host0: ahci [ 5.481763] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 5.484857] scsi host1: ahci [ 5.492013] usb usb3: Product: xHCI Host Controller [ 5.495066] scsi host2: ahci [ 5.499904] usb usb3: Manufacturer: Linux 5.15.0-102-generic xhci-hcd [ 5.499906] usb usb3: SerialNumber: 0000:00:14.0 [ 5.502964] scsi host3: ahci [ 5.509506] hub 3-0:1.0: USB hub found [ 5.514214] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 33 [ 5.517052] hub 3-0:1.0: 15 ports detected [ 5.520831] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 33 [ 5.530255] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.15 [ 5.532472] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 33 [ 5.532474] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 33 [ 5.532713] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 5.539961] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 5.548316] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 5.555802] usb usb4: Product: xHCI Host Controller [ 5.571638] nvme nvme0: pci function 0000:02:00.0 [ 5.578854] usb usb4: Manufacturer: Linux 5.15.0-102-generic xhci-hcd [ 5.589337] nvme nvme0: 8/0/0 default/read/poll queues [ 5.591455] usb usb4: SerialNumber: 0000:00:14.0 [ 5.596263] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ 5.596386] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 5.597850] i2c i2c-0: 2/8 memory slots populated (from DMI) [ 5.597852] i2c i2c-0: Systems with more than 4 memory slots not supported yet, not instantiating SPD [ 5.602844] hub 4-0:1.0: USB hub found [ 5.607935] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 5.608059] igb: Intel(R) Gigabit Ethernet Network Driver [ 5.612650] hub 4-0:1.0: 6 ports detected [ 5.618788] igb: Copyright (c) 2007-2014 Intel Corporation. [ 5.635857] scsi host4: ahci [ 5.667580] scsi host5: ahci [ 5.670680] scsi host6: ahci [ 5.672502] igb 0000:07:00.0: added PHC on eth0 [ 5.673751] scsi host7: ahci [ 5.678253] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 5.681311] scsi host8: ahci [ 5.688119] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:da:bc [ 5.691203] scsi host9: ahci [ 5.698340] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 5.701266] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 35 [ 5.706419] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.713893] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 35 [ 5.729035] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 35 [ 5.736528] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 35 [ 5.744021] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 35 [ 5.751497] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 35 [ 5.778431] igb 0000:07:00.1: added PHC on eth1 [ 5.783050] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 5.789995] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:da:bd [ 5.797279] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 5.802481] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.846198] ata3: SATA link down (SStatus 0 SControl 300) [ 5.851697] ata1: SATA link down (SStatus 0 SControl 300) [ 5.857194] ata2: SATA link down (SStatus 0 SControl 300) [ 5.862678] ata4: SATA link down (SStatus 0 SControl 300) [ 5.871399] usb 3-12: new high-speed USB device number 2 using xhci_hcd [ 6.023631] usb 3-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 6.032007] usb 3-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 6.039725] hub 3-12:1.0: USB hub found [ 6.043727] hub 3-12:1.0: 4 ports detected [ 6.074132] ata10: SATA link down (SStatus 0 SControl 300) [ 6.079717] ata7: SATA link down (SStatus 0 SControl 300) [ 6.085204] ata9: SATA link down (SStatus 0 SControl 300) [ 6.090712] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 6.097005] ata6: SATA link down (SStatus 0 SControl 300) [ 6.102546] ata8: SATA link down (SStatus 0 SControl 300) [ 6.108040] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 6.114906] ata5.00: NCQ Send/Recv Log not supported [ 6.119960] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 6.128402] ata5.00: NCQ Send/Recv Log not supported [ 6.133458] ata5.00: configured for UDMA/133 [ 6.138046] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 6.146556] sd 4:0:0:0: Attached scsi generic sg0 type 0 [ 6.146681] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 6.159708] sd 4:0:0:0: [sda] Write Protect is off [ 6.164588] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 6.179101] sda: sda1 [ 6.181668] sd 4:0:0:0: [sda] Attached SCSI disk [ 6.190948] igb 0000:07:00.0 eno1: renamed from eth0 [ 6.216164] igb 0000:07:00.1 eno2: renamed from eth1 [ 6.355404] usb 3-12.1: new low-speed USB device number 3 using xhci_hcd [ 6.487762] usb 3-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 6.496312] usb 3-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 6.513103] hid: raw HID events driver (C) Jiri Kosina [ 6.522370] usbcore: registered new interface driver usbhid [ 6.528027] usbhid: USB HID core driver [ 6.534844] i: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.0/0003:0557:2419.0001/input/input2 [ 6.603614] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 6.615724] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.1/0003:0557:2419.0002/input/input3 [ 6.627780] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 6.796187] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.806592] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.815211] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 6.821467] ixgbe 0000:03:00.0: 0c:c4:7a:88:6e:34 [ 6.830028] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 7.000118] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.010520] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.019149] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 7.026274] ixgbe 0000:03:00.1: 0c:c4:7a:88:6e:35 [ 7.034694] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 7.043357] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ 7.068342] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 Begin: Loading essential drivers ... done. Begin: Running /scripts/init-premount ... done. Begin: Mounting root file system ... Begin: Running /scripts/local-top ... done. Begin: Running /scripts/local-premount ... done. Begin: Will now check root file system ... fsck from util-linux 2.37.2 [/usr/sbin/fsck.ext4 (1) -- /dev/sda1] fsck.ext4 -a -C0 /dev/sda1 /dev/sda1: recovering journal /dev/sda1: Clearing orphaned inode 24691 (uid=0, gid=0, mode=0100644, size=4447536) /dev/sda1: clean, 198127/61054976 files, 6545901/244190336 blocks done. [ 14.162870] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null). Quota mode: none. done. Begin: Running /scripts/local-bottom ... done. Begin: Running /scripts/init-bottom ... done. [ 14.997675] systemd[1]: Inserted module 'autofs4' [ 15.093875] systemd[1]: systemd 249.11-0ubuntu3.6 running in system mode (+PAM +AUDIT +SELINUX +APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY -P11KIT -QRENCODE +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 15.143521] systemd[1]: Detected architecture x86-64. Welcome to Ubuntu 22.04.1 LTS! [ 15.188978] systemd[1]: Hostname set to . [ 16.621798] systemd[1]: Queued start job for default target Graphical Interface. [ 16.630536] systemd[1]: Created slice Slice /system/modprobe. [ OK ] Created slice Slice /system/modprobe. [ 16.651816] systemd[1]: Created slice Slice /system/serial-getty. [ OK ] Created slice Slice /system/serial-getty. [ 16.675837] systemd[1]: Created slice User and Session Slice. [ OK ] Created slice User and Session Slice. [ 16.695564] systemd[1]: Started ntp-systemd-netif.path. [ OK ] Started ntp-systemd-netif.path. [ 16.715606] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ OK ] Started Forward Password R…uests to Wall Directory Watch. [ 16.739801] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ OK ] Set up automount Arbitrary…s File System Automount Point. [ 16.767538] systemd[1]: Reached target ceph target allowing to start/stop all ceph-fuse@.service instances at once. [ OK ] Reached target ceph target…se@.service instances at once. [ 16.795526] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ OK ] Reached target ceph target…on@.service instances at once. [ 16.823492] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ OK ] Reached target ceph target…ds@.service instances at once. [ 16.851482] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [ OK ] Reached target ceph target…gr@.service instances at once. [ 16.879482] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ OK ] Reached target ceph target…sd@.service instances at once. [ 16.907485] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ OK ] Reached target ceph target…gw@.service instances at once. [ 16.935579] systemd[1]: Reached target User and Group Name Lookups. [ OK ] Reached target User and Group Name Lookups. [ 16.959528] systemd[1]: Reached target Slice Units. [ OK ] Reached target Slice Units. [ 16.979526] systemd[1]: Reached target Local Verity Protected Volumes. [ OK ] Reached target Local Verity Protected Volumes. [ 17.003622] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on Device-mapper event daemon FIFOs. [ 17.027738] systemd[1]: Listening on LVM2 poll daemon socket. [ OK ] Listening on LVM2 poll daemon socket. [ 17.053151] systemd[1]: Listening on RPCbind Server Activation Socket. [ OK ] Listening on RPCbind Server Activation Socket. [ 17.075736] systemd[1]: Listening on Syslog Socket. [ OK ] Listening on Syslog Socket. [ 17.095733] systemd[1]: Listening on fsck to fsckd communication Socket. [ OK ] Listening on fsck to fsckd communication Socket. [ 17.119600] systemd[1]: Listening on initctl Compatibility Named Pipe. [ OK ] Listening on initctl Compatibility Named Pipe. [ 17.143920] systemd[1]: Listening on Journal Audit Socket. [ OK ] Listening on Journal Audit Socket. [ 17.163748] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 17.187757] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 17.207862] systemd[1]: Listening on Network Service Netlink Socket. [ OK ] Listening on Network Service Netlink Socket. [ 17.231767] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 17.251688] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 17.273194] systemd[1]: Mounting Huge Pages File System... Mounting Huge Pages File System... [ 17.293082] systemd[1]: Mounting POSIX Message Queue File System... Mounting POSIX Message Queue File System... [ 17.316906] systemd[1]: Mounting NFSD configuration filesystem... Mounting NFSD configuration filesystem... [ 17.341150] systemd[1]: Mounting Kernel Debug File System... Mounting Kernel Debug File System... [ 17.361249] systemd[1]: Mounting Kernel Trace File System... Mounting Kernel Trace File System... [ 17.379611] RPC: Registered named UNIX socket transport module. [ 17.385610] RPC: Registered udp transport module. [ 17.390389] RPC: Registered tcp transport module. [ 17.395163] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 17.402394] systemd[1]: Starting Journal Service... Starting Journal Service... [ 17.423589] systemd[1]: Condition check resulted in Kernel Module supporting RPCSEC_GSS being skipped. [ 17.433951] systemd[1]: Starting Set the console keyboard layout... Starting Set the console keyboard layout... [ 17.456457] systemd[1]: Starting Create List of Static Device Nodes... Starting Create List of Static Device Nodes... [ 17.480380] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... Starting Monitoring of LVM…meventd or progress polling... [ 17.512468] systemd[1]: Starting Load Kernel Module chromeos_pstore... Starting Load Kernel Module chromeos_pstore... [ 17.536283] systemd[1]: Starting Load Kernel Module configfs... Starting Load Kernel Module configfs... [ 17.556171] systemd[1]: Starting Load Kernel Module drm... Starting Load Kernel Module drm... [ 17.576172] systemd[1]: Starting Load Kernel Module efi_pstore... Starting Load Kernel Module efi_pstore... [ 17.604288] systemd[1]: Starting Load Kernel Module fuse... Starting Load Kernel Module fuse... [ 17.624301] systemd[1]: Starting Load Kernel Module pstore_blk... Starting Load Kernel Module pstore_blk... [ 17.636311] Installing knfsd (copyright (C) 1996 okir@monad.swb.de). [ 17.648517] systemd[1]: Starting Load Kernel Module pstore_zone... Starting Load Kernel Module pstore_zone... [ 17.676309] systemd[1]: Starting Load Kernel Module ramoops... Starting Load Kernel Module ramoops... [ 17.699422] systemd[1]: Condition check resulted in OpenVSwitch configuration for cleanup being skipped. [ 17.709215] systemd[1]: Condition check resulted in File System Check on Root Device being skipped. [ 17.724390] systemd[1]: Starting Load Kernel Modules... Starting Load Kernel Modules... [ 17.748532] systemd[1]: Starting Remount Root and Kernel File Systems... Starting Remount Root and Kernel File Systems... [ 17.772462] systemd[1]: Starting Coldplug All udev Devices... Starting Coldplug All udev Devices... [ 17.783456] EXT4-fs (sda1): re-mounted. Opts: errors=remount-ro,user_xattr. Quota mode: none. [ 17.793955] systemd[1]: Started Journal Service. [ OK ] Started Journal Service. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ 17.836687] lp: driver loaded but no devices found [ OK ] Mounted NFSD configuration filesystem. [ OK ] Mounted Kernel Debug File System[0[ 17.864987] Loading iSCSI transport class v2.0-870. m. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Set the console keyboard layout. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Monitoring of LVM… dmeventd or progress polling. [ OK ] Finished Load Kernel Module chromeos_pstore. [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Module efi_pstore. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Load Kernel Module pstore_blk. [ OK ] Finished Load Kernel Module pstore_zone. [ OK ] Finished Load Kernel Module ramoops. [ OK ] Finished Load Kernel Modules. [ OK ] Finished Remount Root and Kernel File Systems. Activating swap /swapfile... Mounting FUSE Control File System... [ 18.142268] Adding 2097148k swap on /swapfile. Priority:-2 extents:6 across:2260988k FS Mounting Kernel Configuration File System... Starting Initial Check File System Quotas... Starting Flush Journal to Persistent Storage... [ 18.213199] systemd-journald[367]: Received client request to flush runtime journal. Starting Load/Save Random Seed... Starting Apply Kernel Variables... Starting Create System Users... [ OK ] Activated swap /swapfile. [ OK ] Finished Coldplug All udev Devices. [ OK ] Mounted FUSE Control File System. [ OK ] Mounted Kernel Configuration File System. [ OK ] Reached target Swaps. Starting Helper to synchronize boot up for ifupdown... [ 18.400017] systemd-journald[367]: File /var/log/journal/5896a171b9d64a25b2db7eb12a64f597/system.journal corrupted or uncleanly shut down, renaming and replacing. [ OK ] Finished Load/Save Random Seed. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... [ OK ] Finished Initial Check File System Quotas. [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Load AppArmor profiles... Starting Set console font and keymap... Starting Create final runt…dir for shutdown pivot root... Starting Tell Plymouth To Write Out Runtime Data... Starting QEMU KVM preparation - module, ksm, hugepages... Starting Rule-based Manage…for Device Events and Files... Starting Uncomplicated firewall... [ OK ] Finished Flush Journal to Persistent Storage. [ OK ] Finished Set console font and keymap. [ OK ] Finished Create final runt…e dir for shutdown pivot root. [ OK ] Finished Tell Plymouth To Write Out Runtime Data. [ OK ] Finished Uncomplicated firewall. [ OK ] Reached target Preparation for Network. Starting Create Volatile Files and Directories... [ OK ] Finished Load AppArmor profiles. [ OK ] Finished Create Volatile Files and Directories. Mounting RPC Pipe File System... Starting Load Kernel Module chromeos_pstore... Starting Load Kernel Module efi_pstore... Starting Load Kernel Module pstore_blk... Starting Load Kernel Module pstore_zone... Starting Load Kernel Module ramoops... Starting RPC bind portmap service... Starting Record System Boot/Shutdown in UTMP... [ OK ] Mounted RPC Pipe File System. [ OK ] Finished Load Kernel Module chromeos_pstore. [ OK ] Finished QEMU KVM preparation - module, ksm, hugepages. [ OK ] Finished Load Kernel Module efi_pstore. [ OK ] Finished Load Kernel Module pstore_blk. [ OK ] Finished Load Kernel Module pstore_zone. [ OK ] Finished Load Kernel Module ramoops. [ OK ] Started Rule-based Manager for Device Events and Files. [ OK ] Reached target rpc_pipefs.target. Starting pNFS block layout mapping daemon... Starting NFSv4 ID-name mapping service... Starting NFSv4 Client Tracking Daemon... [ OK ] Started Dispatch Password …ts to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Path Units. [ OK ] Reached target NFS client services. Starting Network Configuration... [ OK ] Started pNFS block layout mapping daemon. [ OK ] Started NFSv4 ID-name mapping service. [ OK ] Finished Record System Boot/Shutdown in UTMP. [ OK ] Started NFSv4 Client Tracking Daemon. [ OK ] Reached target System Initialization. [ OK ] Started Daily apt download activities. [ OK ] Started Daily apt upgrade and clean activities. [ OK ] Started Daily dpkg database backup timer. [ OK ] Started Periodic ext4 Onli…ata Check for All Filesystems. [ OK ] Started Discard unused blocks once a week. [ OK ] Started Daily rotation of log files. [ OK ] Started Daily man-db regeneration. [ OK ] Started Message of the Day. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started Ubuntu Advantage Timer for running repeated jobs. [ OK ] Reached target Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. Starting Docker Socket for the API... [ OK ] Listening on Open-iSCSI iscsid Socket. [ OK ] Listening on UUID daemon activation socket. [ OK ] Listening on Docker Socket for the API. [ OK ] Found device /dev/ttyS1. [ OK ] Created slice Slice /system/lvm2-pvscan. [ OK ] Reached target Socket Units. [ OK ] Reached target Basic System. Starting Accounts Service... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target…h*@.service instances at once. [ OK ] Started D-Bus System Message Bus. [ OK ] Started Save initial kernel messages after boot. Starting Remove Stale Onli…t4 Metadata Check Snapshots... Starting Record successful boot for GRUB... [ OK ] Started irqbalance daemon. [ OK ] Started LTTng session daemon. Starting LVM event activation on device 259:0... Starting Dispatcher daemon for systemd-networkd... [ OK ] Started ntp-systemd-netif.service. Starting System Logging Service... Starting Self Monitoring a…g Technology (SMART) Daemon... Starting User Login Management... [ OK ] Started Network Configuration. [ OK ] Started RPC bind portmap service. [ OK ] Finished Remove Stale Onli…ext4 Metadata Check Snapshots. [ OK ] Finished LVM event activation on device 259:0. [ OK ] Found device /dev/vg_nvme/lv_5. [ OK ] Reached target RPC Port Mapper. [ OK ] Listening on Load/Save RF …itch Status /dev/rfkill Watch. Mounting /var/lib/ceph... [ OK ] Started ifup for enp3s0f1. Starting RPC Remote Quota Server... Starting Wait for Network to be Configured... Starting Network Name Resolution... [ OK ] Started User Login Management. [ OK ] Finished Record successful boot for GRUB. Starting GRUB failed boot detection... [ OK ] Started System Logging Service. [ OK ] Finished GRUB failed boot detection. [ OK ] Mounted /var/lib/ceph. [ OK ] Started RPC Remote Quota Server. [ OK ] Finished Helper to synchronize boot up for ifupdown. Starting Raise network interfaces... [ OK ] Started Network Name Resolution. [ OK ] Reached target Host and Network Name Lookups. [ OK ] Started Self Monitoring an…ing Technology (SMART) Daemon. Starting Authorization Manager... [ OK ] Started Authorization Manager. [ OK ] Started Accounts Service. [ OK ] Started Dispatcher daemon for systemd-networkd. [* ] (1 of 2) A start job is running for…k to be Configured (8s / no limit) M [ OK ] Started ntp-systemd-netif.service. [ OK ] Finished Wait for Network to be Configured. [ OK ] Started ntp-systemd-netif.service. [ OK ] Finished Raise network interfaces. [ OK ] Reached target Network. [ OK ] Reached target Network is Online. Starting containerd container runtime... Starting NFS Mount Daemon... Starting Network Time Service... Starting Connect NVMe-oF s…s automatically during boot... Starting Map RBD devices... Starting /etc/rc.local Compatibility... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' Starting NFS status monitor for NFSv2/3 locking.... Starting OpenBSD Secure Shell server... Starting (i)SCSI target daemon... Starting Ubuntu FAN network setup... [ OK ] Started Unattended Upgrades Shutdown. [ OK ] Started NFS Mount Daemon. [ OK ] Finished Map RBD devices. [ OK ] Finished Availability of block devices. [ OK ] Started NFS status monitor for NFSv2/3 locking.. Starting NFS server and services... + myips=172.21.15.150 + attempts=1 + sleep 1 [ OK ] Started Network Time Service. [ OK ] Finished Connect NVMe-oF s…ems automatically during boot. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting The Apache HTTP Server... Starting LSB: Collectl monitors system performance.... [ OK ] Started Regular background program processing daemon. [ OK ] Started Nagios Remote Plugin Executor. Starting LSB: radosgw RESTful rados gateway... Starting Permit User Sessions... [ OK ] Finished Permit User Sessions. [ OK ] Started OpenBSD Secure Shell server. [ OK ] Finished NFS server and services. Starting Notify NFS peers of a restart... [ OK ] Started Notify NFS peers of a restart. + '[' 172.21.15.150 '!=' '' ']' + set -e + '[' -n 172.21.15.150 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.150 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.150 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' [ OK ] Started LSB: radosgw RESTful rados gateway. [ OK ] Finished Ubuntu FAN network setup. [ OK ] Started (i)SCSI target daemon. [ OK ] Started The Apache HTTP Server. + newhostname=smithi150.front.sepia.ceph.com + '[' -n smithi150.front.sepia.ceph.com ']' + hostname smithi150.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi150 + echo smithi150 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.150 smithi150.front.sepia.ceph.com smithi150/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' '!' -f /etc/ssh/ssh_host_rsa_key ']' + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... [ OK ] Finished Hold until boot process finishes up. [ OK ] Finished Terminate Plymouth Boot Screen. [ OK ] Started Serial Getty on ttyS1. Starting Set console scheme... [ OK ] Finished Set console scheme. [ OK ] Created slice Slice /system/getty. [ OK ] Started Getty on tty1. [ OK ] Reached target Login Prompts. [ OK ] Started containerd container runtime. Starting Docker Application Container Engine... [ OK ] Started LSB: Collectl monitors system performance.. [ OK ] Started Docker Application Container Engine. [ OK ] Reached target Multi-User System. [ OK ] Reached target Graphical Interface. Starting Record Runlevel Change in UTMP... [ OK ] Finished Record Runlevel Change in UTMP. Ubuntu 22.04.1 LTS smithi150.front.sepia.ceph.com ttyS1 smithi150 login: [disconnect] 2024-04-18T21:09:41.184 INFO:teuthology.misc:Re-opening connections... 2024-04-18T21:09:41.184 INFO:teuthology.misc:trying to connect to ubuntu@smithi150.front.sepia.ceph.com 2024-04-18T21:09:41.185 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-04-18T21:09:41.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T21:09:41.443 DEBUG:teuthology.orchestra.run.smithi150:> true 2024-04-18T21:09:41.944 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-04-18T21:09:41.944 DEBUG:teuthology.misc:waited 0.7597980499267578 2024-04-18T21:09:42.945 DEBUG:tasks.ceph_manager:Mounting data for osd.1 on ubuntu@smithi150.front.sepia.ceph.com 2024-04-18T21:09:42.945 INFO:tasks.ceph_manager:Mounting osd.1: dev: ubuntu@smithi150.front.sepia.ceph.com, cluster: cephmountpoint: /var/lib/ceph/osd/ceph-1, type: xfs, options: ['noatime'] 2024-04-18T21:09:42.945 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-04-18T21:09:43.043 DEBUG:teuthology.orchestra.run.smithi150:> sudo install -d -m0777 -- /var/run/ceph 2024-04-18T21:09:43.059 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-18T21:09:43.059 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-18T21:09:43.103 INFO:tasks.ceph.osd.1:Started 2024-04-18T21:09:43.104 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:09:43.230 INFO:teuthology.orchestra.run.smithi150.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2024-04-18T21:09:43.233 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-18T21:09:43.234 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2024-04-18T21:09:44.176 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:09:44.235+0000 7f2630d207c0 -1 Falling back to public interface 2024-04-18T21:09:46.033 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-04-18T21:09:48.235 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:09:48.353 INFO:teuthology.orchestra.run.smithi150.stderr:no valid command found; 10 closest matches: 2024-04-18T21:09:48.353 INFO:teuthology.orchestra.run.smithi150.stderr:0 2024-04-18T21:09:48.354 INFO:teuthology.orchestra.run.smithi150.stderr:1 2024-04-18T21:09:48.354 INFO:teuthology.orchestra.run.smithi150.stderr:2 2024-04-18T21:09:48.354 INFO:teuthology.orchestra.run.smithi150.stderr:abort 2024-04-18T21:09:48.354 INFO:teuthology.orchestra.run.smithi150.stderr:assert 2024-04-18T21:09:48.354 INFO:teuthology.orchestra.run.smithi150.stderr:bluefs debug_inject_read_zeros 2024-04-18T21:09:48.354 INFO:teuthology.orchestra.run.smithi150.stderr:bluefs files list 2024-04-18T21:09:48.354 INFO:teuthology.orchestra.run.smithi150.stderr:bluefs stats 2024-04-18T21:09:48.354 INFO:teuthology.orchestra.run.smithi150.stderr:bluestore allocator dump block 2024-04-18T21:09:48.354 INFO:teuthology.orchestra.run.smithi150.stderr:bluestore allocator fragmentation block 2024-04-18T21:09:48.354 INFO:teuthology.orchestra.run.smithi150.stderr:admin_socket: invalid command 2024-04-18T21:09:48.356 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-18T21:09:48.357 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2024-04-18T21:09:48.453 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:09:48.511+0000 7f2630d207c0 -1 osd.1 55 log_to_monitors true 2024-04-18T21:09:48.775 INFO:tasks.ceph.osd.1.smithi150.stderr:2024-04-18T21:09:48.835+0000 7f2624afd640 -1 osd.1 55 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T21:09:53.358 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-18T21:09:53.495 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-04-18T21:09:53.495 INFO:teuthology.orchestra.run.smithi150.stdout: "ops": [ 2024-04-18T21:09:53.495 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:09:53.495 INFO:teuthology.orchestra.run.smithi150.stdout: "description": "MOSDPGRecoveryDelete(4.1c e81,78 4:3ae24826:::10000000af7.00000000:head,68'326)", 2024-04-18T21:09:53.495 INFO:teuthology.orchestra.run.smithi150.stdout: "initiated_at": "2024-04-18T21:09:53.558231+0000", 2024-04-18T21:09:53.496 INFO:teuthology.orchestra.run.smithi150.stdout: "age": 0.00028331100000000001, 2024-04-18T21:09:53.496 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.00030989800000000002, 2024-04-18T21:09:53.496 INFO:teuthology.orchestra.run.smithi150.stdout: "continuous": false, 2024-04-18T21:09:53.496 INFO:teuthology.orchestra.run.smithi150.stdout: "type_data": { 2024-04-18T21:09:53.496 INFO:teuthology.orchestra.run.smithi150.stdout: "flag_point": "started", 2024-04-18T21:09:53.496 INFO:teuthology.orchestra.run.smithi150.stdout: "events": [ 2024-04-18T21:09:53.496 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:09:53.496 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "initiated", 2024-04-18T21:09:53.496 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:09:53.558231+0000", 2024-04-18T21:09:53.497 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:09:53.497 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:09:53.497 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:09:53.497 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "header_read", 2024-04-18T21:09:53.497 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:09:53.558231+0000", 2024-04-18T21:09:53.497 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0 2024-04-18T21:09:53.498 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:09:53.498 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:09:53.498 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "throttled", 2024-04-18T21:09:53.498 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:09:53.558232+0000", 2024-04-18T21:09:53.498 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.5799999999999998e-07 2024-04-18T21:09:53.498 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:09:53.498 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:09:53.498 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "all_read", 2024-04-18T21:09:53.499 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:09:53.558241+0000", 2024-04-18T21:09:53.499 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.1449999999999997e-06 2024-04-18T21:09:53.499 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:09:53.499 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:09:53.499 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "dispatched", 2024-04-18T21:09:53.499 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:09:53.558260+0000", 2024-04-18T21:09:53.499 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.8964e-05 2024-04-18T21:09:53.499 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:09:53.500 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:09:53.500 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "queued_for_pg", 2024-04-18T21:09:53.500 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:09:53.558270+0000", 2024-04-18T21:09:53.500 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 9.9979999999999998e-06 2024-04-18T21:09:53.500 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:09:53.500 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:09:53.500 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "reached_pg", 2024-04-18T21:09:53.500 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:09:53.558386+0000", 2024-04-18T21:09:53.501 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 0.000116461 2024-04-18T21:09:53.501 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-04-18T21:09:53.501 INFO:teuthology.orchestra.run.smithi150.stdout: { 2024-04-18T21:09:53.501 INFO:teuthology.orchestra.run.smithi150.stdout: "event": "started", 2024-04-18T21:09:53.501 INFO:teuthology.orchestra.run.smithi150.stdout: "time": "2024-04-18T21:09:53.558398+0000", 2024-04-18T21:09:53.501 INFO:teuthology.orchestra.run.smithi150.stdout: "duration": 1.1584e-05 2024-04-18T21:09:53.501 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:09:53.501 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-04-18T21:09:53.501 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:09:53.501 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-04-18T21:09:53.502 INFO:teuthology.orchestra.run.smithi150.stdout: ], 2024-04-18T21:09:53.502 INFO:teuthology.orchestra.run.smithi150.stdout: "num_ops": 1 2024-04-18T21:09:53.502 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-04-18T21:09:58.509 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-04-18T21:09:58.655 INFO:teuthology.orchestra.run.smithi078.stdout:mon.a: {} 2024-04-18T21:09:58.656 INFO:teuthology.orchestra.run.smithi078.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-18T21:09:58.664 INFO:teuthology.orchestra.run.smithi078.stdout:mon.b: {} 2024-04-18T21:09:58.664 INFO:teuthology.orchestra.run.smithi078.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-18T21:09:58.674 INFO:teuthology.orchestra.run.smithi078.stdout:mon.c: {} 2024-04-18T21:09:58.674 INFO:teuthology.orchestra.run.smithi078.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-18T21:09:58.690 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-18T21:09:59.460 INFO:teuthology.orchestra.run.smithi078.stderr:reweighted osd.0 to 1 (10000) 2024-04-18T21:09:59.486 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-04-18T21:10:00.469 INFO:teuthology.orchestra.run.smithi078.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-04-18T21:10:00.491 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-18T21:10:01.465 INFO:teuthology.orchestra.run.smithi078.stderr:reweighted osd.2 to 1 (10000) 2024-04-18T21:10:01.493 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-04-18T21:10:02.473 INFO:teuthology.orchestra.run.smithi078.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-04-18T21:10:02.496 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-18T21:10:03.469 INFO:teuthology.orchestra.run.smithi078.stderr:reweighted osd.1 to 1 (10000) 2024-04-18T21:10:03.497 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-04-18T21:10:04.462 INFO:teuthology.orchestra.run.smithi078.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-04-18T21:10:04.486 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-04-18T21:10:04.486 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-04-18T21:10:04.486 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-04-18T21:10:04.486 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-04-18T21:10:04.487 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-18T21:10:04.487 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T21:10:04.786 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:10:04.786 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":92,"fsid":"dc017990-0393-4ab0-b604-5e7052fdc7bd","created":"2024-04-18T21:04:43.507538+0000","modified":"2024-04-18T21:10:04.462870+0000","last_up_change":"2024-04-18T21:09:49.735843+0000","last_in_change":"2024-04-18T21:04:44.402191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T21:04:52.538153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T21:04:58.673793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T21:05:03.314171+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T21:05:03.931699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2699999809265137,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.2699999809265137,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1854d737-3a67-416a-8c88-0f126505a0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6801","nonce":1948809768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6803","nonce":1948809768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6807","nonce":1948809768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6805","nonce":1948809768}]},"public_addr":"172.21.15.132:6801/1948809768","cluster_addr":"172.21.15.132:6803/1948809768","heartbeat_back_addr":"172.21.15.132:6807/1948809768","heartbeat_front_addr":"172.21.15.132:6805/1948809768","state":["exists","up"]},{"osd":1,"uuid":"dfeae661-3f8a-4d41-b287-7eb02c16b91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":55,"up_from":77,"up_thru":90,"down_at":56,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":806525864},{"type":"v1","addr":"172.21.15.150:6801","nonce":806525864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":806525864},{"type":"v1","addr":"172.21.15.150:6803","nonce":806525864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":806525864},{"type":"v1","addr":"172.21.15.150:6807","nonce":806525864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":806525864},{"type":"v1","addr":"172.21.15.150:6805","nonce":806525864}]},"public_addr":"172.21.15.150:6801/806525864","cluster_addr":"172.21.15.150:6803/806525864","heartbeat_back_addr":"172.21.15.150:6807/806525864","heartbeat_front_addr":"172.21.15.150:6805/806525864","state":["exists","up"]},{"osd":2,"uuid":"56a34021-e2dc-41ff-822c-7ec123466f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6801","nonce":429896900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6803","nonce":429896900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6807","nonce":429896900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6805","nonce":429896900}]},"public_addr":"172.21.15.187:6801/429896900","cluster_addr":"172.21.15.187:6803/429896900","heartbeat_back_addr":"172.21.15.187:6807/429896900","heartbeat_front_addr":"172.21.15.187:6805/429896900","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:49.804359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:49.790978+0000","dead_epoch":55},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:49.762943+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"4.2","osds":[0]},{"pgid":"4.6","osds":[2]},{"pgid":"4.7","osds":[2]},{"pgid":"4.8","osds":[0]},{"pgid":"4.9","osds":[2]},{"pgid":"4.d","osds":[0]},{"pgid":"4.f","osds":[2]},{"pgid":"4.10","osds":[2]},{"pgid":"4.13","osds":[0]},{"pgid":"4.15","osds":[2]},{"pgid":"4.19","osds":[2]},{"pgid":"4.1d","osds":[0]},{"pgid":"4.21","osds":[2]},{"pgid":"4.22","osds":[0]},{"pgid":"4.28","osds":[2]},{"pgid":"4.2a","osds":[0]},{"pgid":"4.2d","osds":[2]},{"pgid":"4.2e","osds":[2]},{"pgid":"4.2f","osds":[2]},{"pgid":"4.31","osds":[0]},{"pgid":"4.32","osds":[0]},{"pgid":"4.36","osds":[2]},{"pgid":"4.37","osds":[2]},{"pgid":"4.3f","osds":[2]}],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T21:10:04.806 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-18T21:10:04.806 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T21:10:05.093 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:10:05.094 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":92,"fsid":"dc017990-0393-4ab0-b604-5e7052fdc7bd","created":"2024-04-18T21:04:43.507538+0000","modified":"2024-04-18T21:10:04.462870+0000","last_up_change":"2024-04-18T21:09:49.735843+0000","last_in_change":"2024-04-18T21:04:44.402191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T21:04:52.538153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T21:04:58.673793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T21:05:03.314171+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T21:05:03.931699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2699999809265137,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.2699999809265137,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1854d737-3a67-416a-8c88-0f126505a0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6801","nonce":1948809768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6803","nonce":1948809768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6807","nonce":1948809768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6805","nonce":1948809768}]},"public_addr":"172.21.15.132:6801/1948809768","cluster_addr":"172.21.15.132:6803/1948809768","heartbeat_back_addr":"172.21.15.132:6807/1948809768","heartbeat_front_addr":"172.21.15.132:6805/1948809768","state":["exists","up"]},{"osd":1,"uuid":"dfeae661-3f8a-4d41-b287-7eb02c16b91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":55,"up_from":77,"up_thru":90,"down_at":56,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":806525864},{"type":"v1","addr":"172.21.15.150:6801","nonce":806525864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":806525864},{"type":"v1","addr":"172.21.15.150:6803","nonce":806525864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":806525864},{"type":"v1","addr":"172.21.15.150:6807","nonce":806525864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":806525864},{"type":"v1","addr":"172.21.15.150:6805","nonce":806525864}]},"public_addr":"172.21.15.150:6801/806525864","cluster_addr":"172.21.15.150:6803/806525864","heartbeat_back_addr":"172.21.15.150:6807/806525864","heartbeat_front_addr":"172.21.15.150:6805/806525864","state":["exists","up"]},{"osd":2,"uuid":"56a34021-e2dc-41ff-822c-7ec123466f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6801","nonce":429896900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6803","nonce":429896900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6807","nonce":429896900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6805","nonce":429896900}]},"public_addr":"172.21.15.187:6801/429896900","cluster_addr":"172.21.15.187:6803/429896900","heartbeat_back_addr":"172.21.15.187:6807/429896900","heartbeat_front_addr":"172.21.15.187:6805/429896900","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:49.804359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:49.790978+0000","dead_epoch":55},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:49.762943+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"4.2","osds":[0]},{"pgid":"4.6","osds":[2]},{"pgid":"4.7","osds":[2]},{"pgid":"4.8","osds":[0]},{"pgid":"4.9","osds":[2]},{"pgid":"4.d","osds":[0]},{"pgid":"4.f","osds":[2]},{"pgid":"4.10","osds":[2]},{"pgid":"4.13","osds":[0]},{"pgid":"4.15","osds":[2]},{"pgid":"4.19","osds":[2]},{"pgid":"4.1d","osds":[0]},{"pgid":"4.21","osds":[2]},{"pgid":"4.22","osds":[0]},{"pgid":"4.28","osds":[2]},{"pgid":"4.2a","osds":[0]},{"pgid":"4.2d","osds":[2]},{"pgid":"4.2e","osds":[2]},{"pgid":"4.2f","osds":[2]},{"pgid":"4.31","osds":[0]},{"pgid":"4.32","osds":[0]},{"pgid":"4.36","osds":[2]},{"pgid":"4.37","osds":[2]},{"pgid":"4.3f","osds":[2]}],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T21:10:05.113 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-18T21:10:05.114 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-18T21:10:05.114 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-18T21:10:05.282 INFO:teuthology.orchestra.run.smithi078.stdout:34359738433 2024-04-18T21:10:05.283 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-18T21:10:05.284 INFO:teuthology.orchestra.run.smithi078.stdout:330712481797 2024-04-18T21:10:05.284 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-18T21:10:05.285 INFO:teuthology.orchestra.run.smithi078.stdout:34359738435 2024-04-18T21:10:05.285 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-18T21:10:05.608 INFO:teuthology.orchestra.run.smithi078.stdout:34359738434 2024-04-18T21:10:05.610 INFO:teuthology.orchestra.run.smithi078.stdout:34359738432 2024-04-18T21:10:05.621 INFO:teuthology.orchestra.run.smithi078.stdout:330712481796 2024-04-18T21:10:05.629 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738435 got 34359738434 for osd.2 2024-04-18T21:10:05.631 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738433 got 34359738432 for osd.0 2024-04-18T21:10:05.640 INFO:tasks.ceph.ceph_manager.ceph:need seq 330712481797 got 330712481796 for osd.1 2024-04-18T21:10:06.630 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-18T21:10:06.631 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-18T21:10:06.641 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-18T21:10:06.923 INFO:teuthology.orchestra.run.smithi078.stdout:34359738432 2024-04-18T21:10:06.929 INFO:teuthology.orchestra.run.smithi078.stdout:34359738434 2024-04-18T21:10:06.943 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738433 got 34359738432 for osd.0 2024-04-18T21:10:06.948 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738435 got 34359738434 for osd.2 2024-04-18T21:10:06.977 INFO:teuthology.orchestra.run.smithi078.stdout:330712481796 2024-04-18T21:10:06.994 INFO:tasks.ceph.ceph_manager.ceph:need seq 330712481797 got 330712481796 for osd.1 2024-04-18T21:10:07.944 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-18T21:10:07.949 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-18T21:10:07.995 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-18T21:10:08.251 INFO:teuthology.orchestra.run.smithi078.stdout:34359738433 2024-04-18T21:10:08.268 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738433 got 34359738433 for osd.0 2024-04-18T21:10:08.268 DEBUG:teuthology.parallel:result is None 2024-04-18T21:10:08.282 INFO:teuthology.orchestra.run.smithi078.stdout:34359738435 2024-04-18T21:10:08.299 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738435 got 34359738435 for osd.2 2024-04-18T21:10:08.300 DEBUG:teuthology.parallel:result is None 2024-04-18T21:10:08.322 INFO:teuthology.orchestra.run.smithi078.stdout:330712481797 2024-04-18T21:10:08.338 INFO:tasks.ceph.ceph_manager.ceph:need seq 330712481797 got 330712481797 for osd.1 2024-04-18T21:10:08.339 DEBUG:teuthology.parallel:result is None 2024-04-18T21:10:08.339 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-18T21:10:08.339 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:10:08.672 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:10:08.674 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-04-18T21:10:08.688 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":252,"stamp":"2024-04-18T21:10:08.633564+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127729495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3792,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2722,"num_read_kb":1306172,"num_write":29287,"num_write_kb":4430417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3937,"num_bytes_recovered":97081199,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33091,"ondisk_log_size":33091,"up":210,"acting":187,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":231,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":660944,"kb_used_data":444576,"kb_used_omap":8,"kb_used_meta":216311,"kb_avail":282454576,"statfs":{"total":289910292480,"available":289233485824,"internally_reserved":0,"allocated":455245824,"data_stored":444204239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9194,"internal_metadata":221502486},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-533,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":527,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001295"},"pg_stats":[{"pgid":"4.3f","version":"71'418","reported_seq":633,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.481984+0000","last_change":"2024-04-18T21:09:51.933769+0000","last_active":"2024-04-18T21:10:07.481984+0000","last_peered":"2024-04-18T21:10:07.481984+0000","last_clean":"2024-04-18T21:06:56.295490+0000","last_became_active":"2024-04-18T21:09:51.925977+0000","last_became_peered":"2024-04-18T21:09:51.925977+0000","last_unstale":"2024-04-18T21:10:07.481984+0000","last_undegraded":"2024-04-18T21:09:51.837482+0000","last_fullsized":"2024-04-18T21:09:51.829450+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":19677,"num_write":386,"num_write_kb":87615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"71'417","reported_seq":593,"reported_epoch":92,"state":"peering","last_fresh":"2024-04-18T21:10:04.540237+0000","last_change":"2024-04-18T21:10:04.540237+0000","last_active":"2024-04-18T21:09:50.768414+0000","last_peered":"2024-04-18T21:09:48.745585+0000","last_clean":"2024-04-18T21:06:55.789736+0000","last_became_active":"2024-04-18T21:06:57.811768+0000","last_became_peered":"2024-04-18T21:06:57.811768+0000","last_unstale":"2024-04-18T21:10:04.540237+0000","last_undegraded":"2024-04-18T21:10:04.540237+0000","last_fullsized":"2024-04-18T21:10:04.540237+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":12123,"num_write":387,"num_write_kb":47157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"71'379","reported_seq":914,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.477728+0000","last_change":"2024-04-18T21:09:54.480753+0000","last_active":"2024-04-18T21:10:07.477728+0000","last_peered":"2024-04-18T21:10:07.477728+0000","last_clean":"2024-04-18T21:10:07.477728+0000","last_became_active":"2024-04-18T21:09:54.478020+0000","last_became_peered":"2024-04-18T21:09:54.478020+0000","last_unstale":"2024-04-18T21:10:07.477728+0000","last_undegraded":"2024-04-18T21:10:07.477728+0000","last_fullsized":"2024-04-18T21:10:07.477728+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:24:18.705477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":10040,"num_write":353,"num_write_kb":63202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'372","reported_seq":548,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.477334+0000","last_change":"2024-04-18T21:05:05.629321+0000","last_active":"2024-04-18T21:10:07.477334+0000","last_peered":"2024-04-18T21:10:07.477334+0000","last_clean":"2024-04-18T21:10:07.477334+0000","last_became_active":"2024-04-18T21:05:05.627956+0000","last_became_peered":"2024-04-18T21:05:05.627956+0000","last_unstale":"2024-04-18T21:10:07.477334+0000","last_undegraded":"2024-04-18T21:10:07.477334+0000","last_fullsized":"2024-04-18T21:10:07.477334+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:15:28.458476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2735,"num_write":328,"num_write_kb":22107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"71'416","reported_seq":584,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-18T21:10:04.542079+0000","last_change":"2024-04-18T21:10:00.560644+0000","last_active":"2024-04-18T21:10:04.542079+0000","last_peered":"2024-04-18T21:10:04.542079+0000","last_clean":"2024-04-18T21:10:04.542079+0000","last_became_active":"2024-04-18T21:10:00.553862+0000","last_became_peered":"2024-04-18T21:10:00.553862+0000","last_unstale":"2024-04-18T21:10:04.542079+0000","last_undegraded":"2024-04-18T21:10:04.542079+0000","last_fullsized":"2024-04-18T21:10:04.542079+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:11:49.688538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6533,"num_write":389,"num_write_kb":43666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"71'374","reported_seq":548,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478034+0000","last_change":"2024-04-18T21:10:01.495684+0000","last_active":"2024-04-18T21:10:07.478034+0000","last_peered":"2024-04-18T21:10:07.478034+0000","last_clean":"2024-04-18T21:10:07.478034+0000","last_became_active":"2024-04-18T21:10:01.486640+0000","last_became_peered":"2024-04-18T21:10:01.486640+0000","last_unstale":"2024-04-18T21:10:07.478034+0000","last_undegraded":"2024-04-18T21:10:07.478034+0000","last_fullsized":"2024-04-18T21:10:07.478034+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:39:10.639381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20415,"num_write":354,"num_write_kb":34462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'418","reported_seq":626,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.476770+0000","last_change":"2024-04-18T21:05:05.625047+0000","last_active":"2024-04-18T21:10:07.476770+0000","last_peered":"2024-04-18T21:10:07.476770+0000","last_clean":"2024-04-18T21:10:07.476770+0000","last_became_active":"2024-04-18T21:05:05.622781+0000","last_became_peered":"2024-04-18T21:05:05.622781+0000","last_unstale":"2024-04-18T21:10:07.476770+0000","last_undegraded":"2024-04-18T21:10:07.476770+0000","last_fullsized":"2024-04-18T21:10:07.476770+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:12.944469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21103,"num_write":385,"num_write_kb":50678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"71'399","reported_seq":612,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.476294+0000","last_change":"2024-04-18T21:10:00.495543+0000","last_active":"2024-04-18T21:10:07.476294+0000","last_peered":"2024-04-18T21:10:07.476294+0000","last_clean":"2024-04-18T21:10:07.476294+0000","last_became_active":"2024-04-18T21:10:00.488705+0000","last_became_peered":"2024-04-18T21:10:00.488705+0000","last_unstale":"2024-04-18T21:10:07.476294+0000","last_undegraded":"2024-04-18T21:10:07.476294+0000","last_fullsized":"2024-04-18T21:10:07.476294+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:11.892092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":44692,"num_write":361,"num_write_kb":105170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"71'385","reported_seq":924,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.480990+0000","last_change":"2024-04-18T21:10:06.487113+0000","last_active":"2024-04-18T21:10:07.480990+0000","last_peered":"2024-04-18T21:10:07.480990+0000","last_clean":"2024-04-18T21:10:07.480990+0000","last_became_active":"2024-04-18T21:10:06.482087+0000","last_became_peered":"2024-04-18T21:10:06.482087+0000","last_unstale":"2024-04-18T21:10:07.480990+0000","last_undegraded":"2024-04-18T21:10:07.480990+0000","last_fullsized":"2024-04-18T21:10:07.480990+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:10:51.435131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":994,"num_write":358,"num_write_kb":25964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'409","reported_seq":655,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.480927+0000","last_change":"2024-04-18T21:09:51.933299+0000","last_active":"2024-04-18T21:10:07.480927+0000","last_peered":"2024-04-18T21:10:07.480927+0000","last_clean":"2024-04-18T21:06:56.705266+0000","last_became_active":"2024-04-18T21:09:51.917102+0000","last_became_peered":"2024-04-18T21:09:51.917102+0000","last_unstale":"2024-04-18T21:10:07.480927+0000","last_undegraded":"2024-04-18T21:09:51.819800+0000","last_fullsized":"2024-04-18T21:09:51.800654+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":171,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":26170,"num_write":372,"num_write_kb":83931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"71'366","reported_seq":551,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478059+0000","last_change":"2024-04-18T21:10:01.496068+0000","last_active":"2024-04-18T21:10:07.478059+0000","last_peered":"2024-04-18T21:10:07.478059+0000","last_clean":"2024-04-18T21:10:07.478059+0000","last_became_active":"2024-04-18T21:10:01.488047+0000","last_became_peered":"2024-04-18T21:10:01.488047+0000","last_unstale":"2024-04-18T21:10:07.478059+0000","last_undegraded":"2024-04-18T21:10:07.478059+0000","last_fullsized":"2024-04-18T21:10:07.478059+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:49.957286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":18907,"num_write":347,"num_write_kb":26153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"71'346","reported_seq":517,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-18T21:10:04.541621+0000","last_change":"2024-04-18T21:10:00.560349+0000","last_active":"2024-04-18T21:10:04.541621+0000","last_peered":"2024-04-18T21:10:04.541621+0000","last_clean":"2024-04-18T21:10:04.541621+0000","last_became_active":"2024-04-18T21:10:00.557412+0000","last_became_peered":"2024-04-18T21:10:00.557412+0000","last_unstale":"2024-04-18T21:10:04.541621+0000","last_undegraded":"2024-04-18T21:10:04.541621+0000","last_fullsized":"2024-04-18T21:10:04.541621+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:54:33.428937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":6245,"num_write":324,"num_write_kb":37970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"71'417","reported_seq":606,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-18T21:10:04.542654+0000","last_change":"2024-04-18T21:10:02.555899+0000","last_active":"2024-04-18T21:10:04.542654+0000","last_peered":"2024-04-18T21:10:04.542654+0000","last_clean":"2024-04-18T21:10:04.542654+0000","last_became_active":"2024-04-18T21:10:02.551406+0000","last_became_peered":"2024-04-18T21:10:02.551406+0000","last_unstale":"2024-04-18T21:10:04.542654+0000","last_undegraded":"2024-04-18T21:10:04.542654+0000","last_fullsized":"2024-04-18T21:10:04.542654+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:41:17.455669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":21623,"num_write":381,"num_write_kb":71306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"71'398","reported_seq":580,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.478531+0000","last_change":"2024-04-18T21:09:52.463425+0000","last_active":"2024-04-18T21:10:07.478531+0000","last_peered":"2024-04-18T21:10:07.478531+0000","last_clean":"2024-04-18T21:06:55.780318+0000","last_became_active":"2024-04-18T21:09:51.909652+0000","last_became_peered":"2024-04-18T21:09:51.909652+0000","last_unstale":"2024-04-18T21:10:07.478531+0000","last_undegraded":"2024-04-18T21:09:52.463153+0000","last_fullsized":"2024-04-18T21:09:51.781091+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":369,"num_write_kb":30006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'435","reported_seq":723,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.477128+0000","last_change":"2024-04-18T21:10:01.504091+0000","last_active":"2024-04-18T21:10:07.477128+0000","last_peered":"2024-04-18T21:10:07.477128+0000","last_clean":"2024-04-18T21:09:48.742565+0000","last_became_active":"2024-04-18T21:10:01.499730+0000","last_became_peered":"2024-04-18T21:10:01.499730+0000","last_unstale":"2024-04-18T21:10:07.477128+0000","last_undegraded":"2024-04-18T21:10:01.482937+0000","last_fullsized":"2024-04-18T21:10:01.475971+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":173,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":31523,"num_write":402,"num_write_kb":121466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":410327,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'446","reported_seq":661,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.476315+0000","last_change":"2024-04-18T21:05:05.638203+0000","last_active":"2024-04-18T21:10:07.476315+0000","last_peered":"2024-04-18T21:10:07.476315+0000","last_clean":"2024-04-18T21:10:07.476315+0000","last_became_active":"2024-04-18T21:05:05.637352+0000","last_became_peered":"2024-04-18T21:05:05.637352+0000","last_unstale":"2024-04-18T21:10:07.476315+0000","last_undegraded":"2024-04-18T21:10:07.476315+0000","last_fullsized":"2024-04-18T21:10:07.476315+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":23833,"num_write":418,"num_write_kb":59679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"71'403","reported_seq":565,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.482255+0000","last_change":"2024-04-18T21:10:03.493121+0000","last_active":"2024-04-18T21:10:07.482255+0000","last_peered":"2024-04-18T21:10:07.482255+0000","last_clean":"2024-04-18T21:06:53.394905+0000","last_became_active":"2024-04-18T21:10:03.488943+0000","last_became_peered":"2024-04-18T21:10:03.488943+0000","last_unstale":"2024-04-18T21:10:07.482255+0000","last_undegraded":"2024-04-18T21:10:03.479306+0000","last_fullsized":"2024-04-18T21:10:03.477937+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":7482,"num_write":371,"num_write_kb":25957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'406","reported_seq":613,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.482341+0000","last_change":"2024-04-18T21:09:51.933105+0000","last_active":"2024-04-18T21:10:07.482341+0000","last_peered":"2024-04-18T21:10:07.482341+0000","last_clean":"2024-04-18T21:06:53.408988+0000","last_became_active":"2024-04-18T21:09:51.925620+0000","last_became_peered":"2024-04-18T21:09:51.925620+0000","last_unstale":"2024-04-18T21:10:07.482341+0000","last_undegraded":"2024-04-18T21:09:51.836579+0000","last_fullsized":"2024-04-18T21:09:51.831054+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":173,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":27987,"num_write":365,"num_write_kb":38689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"71'470","reported_seq":733,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.480352+0000","last_change":"2024-04-18T21:09:51.934073+0000","last_active":"2024-04-18T21:10:07.480352+0000","last_peered":"2024-04-18T21:10:07.480352+0000","last_clean":"2024-04-18T21:06:56.724047+0000","last_became_active":"2024-04-18T21:09:51.926836+0000","last_became_peered":"2024-04-18T21:09:51.926836+0000","last_unstale":"2024-04-18T21:10:07.480352+0000","last_undegraded":"2024-04-18T21:09:51.826935+0000","last_fullsized":"2024-04-18T21:09:51.811758+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":188,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":59273,"num_write":432,"num_write_kb":145930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'433","reported_seq":609,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.477460+0000","last_change":"2024-04-18T21:05:05.638338+0000","last_active":"2024-04-18T21:10:07.477460+0000","last_peered":"2024-04-18T21:10:07.477460+0000","last_clean":"2024-04-18T21:10:07.477460+0000","last_became_active":"2024-04-18T21:05:05.637567+0000","last_became_peered":"2024-04-18T21:05:05.637567+0000","last_unstale":"2024-04-18T21:10:07.477460+0000","last_undegraded":"2024-04-18T21:10:07.477460+0000","last_fullsized":"2024-04-18T21:10:07.477460+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5514,"num_write":403,"num_write_kb":26329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"71'418","reported_seq":635,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.477346+0000","last_change":"2024-04-18T21:05:05.643606+0000","last_active":"2024-04-18T21:10:07.477346+0000","last_peered":"2024-04-18T21:10:07.477346+0000","last_clean":"2024-04-18T21:10:07.477346+0000","last_became_active":"2024-04-18T21:05:05.642991+0000","last_became_peered":"2024-04-18T21:05:05.642991+0000","last_unstale":"2024-04-18T21:10:07.477346+0000","last_undegraded":"2024-04-18T21:10:07.477346+0000","last_fullsized":"2024-04-18T21:10:07.477346+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:01.841786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":29097,"num_write":386,"num_write_kb":88262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"71'479","reported_seq":720,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:04.473052+0000","last_change":"2024-04-18T21:09:52.363290+0000","last_active":"2024-04-18T21:10:04.473052+0000","last_peered":"2024-04-18T21:10:04.473052+0000","last_clean":"2024-04-18T21:06:56.736080+0000","last_became_active":"2024-04-18T21:09:51.905565+0000","last_became_peered":"2024-04-18T21:09:51.905565+0000","last_unstale":"2024-04-18T21:10:04.473052+0000","last_undegraded":"2024-04-18T21:09:52.362922+0000","last_fullsized":"2024-04-18T21:09:51.766322+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":193,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":24204,"num_write":452,"num_write_kb":114184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"71'407","reported_seq":611,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478134+0000","last_change":"2024-04-18T21:10:03.487961+0000","last_active":"2024-04-18T21:10:07.478134+0000","last_peered":"2024-04-18T21:10:07.478134+0000","last_clean":"2024-04-18T21:10:07.478134+0000","last_became_active":"2024-04-18T21:10:03.476552+0000","last_became_peered":"2024-04-18T21:10:03.476552+0000","last_unstale":"2024-04-18T21:10:07.478134+0000","last_undegraded":"2024-04-18T21:10:07.478134+0000","last_fullsized":"2024-04-18T21:10:07.478134+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:45:35.774025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":37766,"num_write":374,"num_write_kb":103984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'452","reported_seq":676,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.477807+0000","last_change":"2024-04-18T21:09:51.936910+0000","last_active":"2024-04-18T21:10:07.477807+0000","last_peered":"2024-04-18T21:10:07.477807+0000","last_clean":"2024-04-18T21:06:56.722577+0000","last_became_active":"2024-04-18T21:09:51.915967+0000","last_became_peered":"2024-04-18T21:09:51.915967+0000","last_unstale":"2024-04-18T21:10:07.477807+0000","last_undegraded":"2024-04-18T21:09:51.807076+0000","last_fullsized":"2024-04-18T21:09:51.791818+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":198,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27170,"num_write":421,"num_write_kb":39548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"71'427","reported_seq":602,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-18T21:10:04.542302+0000","last_change":"2024-04-18T21:10:03.544910+0000","last_active":"2024-04-18T21:10:04.542302+0000","last_peered":"2024-04-18T21:10:04.542302+0000","last_clean":"2024-04-18T21:10:04.542302+0000","last_became_active":"2024-04-18T21:10:03.539961+0000","last_became_peered":"2024-04-18T21:10:03.539961+0000","last_unstale":"2024-04-18T21:10:04.542302+0000","last_undegraded":"2024-04-18T21:10:04.542302+0000","last_fullsized":"2024-04-18T21:10:04.542302+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:06:34.839228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":11507,"num_write":407,"num_write_kb":50964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"71'471","reported_seq":671,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.482128+0000","last_change":"2024-04-18T21:05:05.649581+0000","last_active":"2024-04-18T21:10:07.482128+0000","last_peered":"2024-04-18T21:10:07.482128+0000","last_clean":"2024-04-18T21:10:07.482128+0000","last_became_active":"2024-04-18T21:05:05.648233+0000","last_became_peered":"2024-04-18T21:05:05.648233+0000","last_unstale":"2024-04-18T21:10:07.482128+0000","last_undegraded":"2024-04-18T21:10:07.482128+0000","last_fullsized":"2024-04-18T21:10:07.482128+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20857,"num_write":431,"num_write_kb":63677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'378","reported_seq":914,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478370+0000","last_change":"2024-04-18T21:09:55.493655+0000","last_active":"2024-04-18T21:10:07.478370+0000","last_peered":"2024-04-18T21:10:07.478370+0000","last_clean":"2024-04-18T21:10:07.478370+0000","last_became_active":"2024-04-18T21:09:55.490958+0000","last_became_peered":"2024-04-18T21:09:55.490958+0000","last_unstale":"2024-04-18T21:10:07.478370+0000","last_undegraded":"2024-04-18T21:10:07.478370+0000","last_fullsized":"2024-04-18T21:10:07.478370+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:52:16.541697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12573,"num_write":347,"num_write_kb":34434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'410","reported_seq":607,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-18T21:10:04.541451+0000","last_change":"2024-04-18T21:10:01.563947+0000","last_active":"2024-04-18T21:10:04.541451+0000","last_peered":"2024-04-18T21:10:04.541451+0000","last_clean":"2024-04-18T21:10:04.541451+0000","last_became_active":"2024-04-18T21:10:01.555367+0000","last_became_peered":"2024-04-18T21:10:01.555367+0000","last_unstale":"2024-04-18T21:10:04.541451+0000","last_undegraded":"2024-04-18T21:10:04.541451+0000","last_fullsized":"2024-04-18T21:10:04.541451+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:01:09.418419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":16926,"num_write":380,"num_write_kb":112804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"71'410","reported_seq":965,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.479229+0000","last_change":"2024-04-18T21:10:03.490605+0000","last_active":"2024-04-18T21:10:07.479229+0000","last_peered":"2024-04-18T21:10:07.479229+0000","last_clean":"2024-04-18T21:10:07.479229+0000","last_became_active":"2024-04-18T21:10:03.480985+0000","last_became_peered":"2024-04-18T21:10:03.480985+0000","last_unstale":"2024-04-18T21:10:07.479229+0000","last_undegraded":"2024-04-18T21:10:07.479229+0000","last_fullsized":"2024-04-18T21:10:07.479229+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:14:42.076110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":34811,"num_write":378,"num_write_kb":51242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'491","reported_seq":709,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:04.473764+0000","last_change":"2024-04-18T21:09:52.395780+0000","last_active":"2024-04-18T21:10:04.473764+0000","last_peered":"2024-04-18T21:10:04.473764+0000","last_clean":"2024-04-18T21:06:56.708177+0000","last_became_active":"2024-04-18T21:09:51.906206+0000","last_became_peered":"2024-04-18T21:09:51.906206+0000","last_unstale":"2024-04-18T21:10:04.473764+0000","last_undegraded":"2024-04-18T21:09:52.395404+0000","last_fullsized":"2024-04-18T21:09:51.778732+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":209,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":26902,"num_write":456,"num_write_kb":124778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"71'467","reported_seq":662,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.478242+0000","last_change":"2024-04-18T21:10:03.488499+0000","last_active":"2024-04-18T21:10:07.478242+0000","last_peered":"2024-04-18T21:10:07.478242+0000","last_clean":"2024-04-18T21:06:56.506258+0000","last_became_active":"2024-04-18T21:10:03.477945+0000","last_became_peered":"2024-04-18T21:10:03.477945+0000","last_unstale":"2024-04-18T21:10:07.478242+0000","last_undegraded":"2024-04-18T21:10:03.471107+0000","last_fullsized":"2024-04-18T21:10:03.470440+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":192,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":28114,"num_write":434,"num_write_kb":129325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'423","reported_seq":569,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.476609+0000","last_change":"2024-04-18T21:10:01.499421+0000","last_active":"2024-04-18T21:10:07.476609+0000","last_peered":"2024-04-18T21:10:07.476609+0000","last_clean":"2024-04-18T21:10:07.476609+0000","last_became_active":"2024-04-18T21:10:01.487074+0000","last_became_peered":"2024-04-18T21:10:01.487074+0000","last_unstale":"2024-04-18T21:10:07.476609+0000","last_undegraded":"2024-04-18T21:10:07.476609+0000","last_fullsized":"2024-04-18T21:10:07.476609+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:05:34.827814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8244,"num_write":393,"num_write_kb":58692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"71'389","reported_seq":586,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-18T21:10:04.540609+0000","last_change":"2024-04-18T21:09:58.542232+0000","last_active":"2024-04-18T21:10:04.540609+0000","last_peered":"2024-04-18T21:10:04.540609+0000","last_clean":"2024-04-18T21:10:04.540609+0000","last_became_active":"2024-04-18T21:09:58.537723+0000","last_became_peered":"2024-04-18T21:09:58.537723+0000","last_unstale":"2024-04-18T21:10:04.540609+0000","last_undegraded":"2024-04-18T21:10:04.540609+0000","last_fullsized":"2024-04-18T21:10:04.540609+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:26.786170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":24216,"num_write":349,"num_write_kb":43176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"70'425","reported_seq":595,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478429+0000","last_change":"2024-04-18T21:05:04.632748+0000","last_active":"2024-04-18T21:10:07.478429+0000","last_peered":"2024-04-18T21:10:07.478429+0000","last_clean":"2024-04-18T21:10:07.478429+0000","last_became_active":"2024-04-18T21:05:04.628407+0000","last_became_peered":"2024-04-18T21:05:04.628407+0000","last_unstale":"2024-04-18T21:10:07.478429+0000","last_undegraded":"2024-04-18T21:10:07.478429+0000","last_fullsized":"2024-04-18T21:10:07.478429+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:42:45.392908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":375,"num_write_kb":8348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"71'423","reported_seq":638,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.479682+0000","last_change":"2024-04-18T21:09:51.933346+0000","last_active":"2024-04-18T21:10:07.479682+0000","last_peered":"2024-04-18T21:10:07.479682+0000","last_clean":"2024-04-18T21:06:56.697536+0000","last_became_active":"2024-04-18T21:09:51.919893+0000","last_became_peered":"2024-04-18T21:09:51.919893+0000","last_unstale":"2024-04-18T21:10:07.479682+0000","last_undegraded":"2024-04-18T21:09:51.803847+0000","last_fullsized":"2024-04-18T21:09:51.783538+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":170,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":20096,"num_write":381,"num_write_kb":76351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"70'56","reported_seq":238,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478997+0000","last_change":"2024-04-18T21:10:00.500122+0000","last_active":"2024-04-18T21:10:07.478997+0000","last_peered":"2024-04-18T21:10:07.478997+0000","last_clean":"2024-04-18T21:10:07.478997+0000","last_became_active":"2024-04-18T21:10:00.489486+0000","last_became_peered":"2024-04-18T21:10:00.489486+0000","last_unstale":"2024-04-18T21:10:07.478997+0000","last_undegraded":"2024-04-18T21:10:07.478997+0000","last_fullsized":"2024-04-18T21:10:07.478997+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:58:08.269558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'442","reported_seq":1000,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.483286+0000","last_change":"2024-04-18T21:10:03.492109+0000","last_active":"2024-04-18T21:10:07.483286+0000","last_peered":"2024-04-18T21:10:07.483286+0000","last_clean":"2024-04-18T21:10:07.483286+0000","last_became_active":"2024-04-18T21:10:03.483050+0000","last_became_peered":"2024-04-18T21:10:03.483050+0000","last_unstale":"2024-04-18T21:10:07.483286+0000","last_undegraded":"2024-04-18T21:10:07.483286+0000","last_fullsized":"2024-04-18T21:10:07.483286+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:45.388623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13827,"num_write":415,"num_write_kb":79859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"70'62","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-18T21:10:04.541509+0000","last_change":"2024-04-18T21:09:50.868159+0000","last_active":"2024-04-18T21:10:04.541509+0000","last_peered":"2024-04-18T21:10:04.541509+0000","last_clean":"2024-04-18T21:10:04.541509+0000","last_became_active":"2024-04-18T21:09:50.867096+0000","last_became_peered":"2024-04-18T21:09:50.867096+0000","last_unstale":"2024-04-18T21:10:04.541509+0000","last_undegraded":"2024-04-18T21:10:04.541509+0000","last_fullsized":"2024-04-18T21:10:04.541509+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:09:57.047205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"71'398","reported_seq":613,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.481095+0000","last_change":"2024-04-18T21:10:01.498728+0000","last_active":"2024-04-18T21:10:07.481095+0000","last_peered":"2024-04-18T21:10:07.481095+0000","last_clean":"2024-04-18T21:10:07.481095+0000","last_became_active":"2024-04-18T21:10:01.495349+0000","last_became_peered":"2024-04-18T21:10:01.495349+0000","last_unstale":"2024-04-18T21:10:07.481095+0000","last_undegraded":"2024-04-18T21:10:07.481095+0000","last_fullsized":"2024-04-18T21:10:07.481095+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:01:48.618551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":17616,"num_write":360,"num_write_kb":58871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"70'66","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.477157+0000","last_change":"2024-04-18T21:10:00.496701+0000","last_active":"2024-04-18T21:10:07.477157+0000","last_peered":"2024-04-18T21:10:07.477157+0000","last_clean":"2024-04-18T21:10:07.477157+0000","last_became_active":"2024-04-18T21:10:00.495594+0000","last_became_peered":"2024-04-18T21:10:00.495594+0000","last_unstale":"2024-04-18T21:10:07.477157+0000","last_undegraded":"2024-04-18T21:10:07.477157+0000","last_fullsized":"2024-04-18T21:10:07.477157+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:11:32.991308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"70'135","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.479595+0000","last_change":"2024-04-18T21:10:00.493197+0000","last_active":"2024-04-18T21:10:07.479595+0000","last_peered":"2024-04-18T21:10:07.479595+0000","last_clean":"2024-04-18T21:10:07.479595+0000","last_became_active":"2024-04-18T21:10:00.491509+0000","last_became_peered":"2024-04-18T21:10:00.491509+0000","last_unstale":"2024-04-18T21:10:07.479595+0000","last_undegraded":"2024-04-18T21:10:07.479595+0000","last_fullsized":"2024-04-18T21:10:07.479595+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:57:29.595389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":7777508,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'410","reported_seq":962,"reported_epoch":92,"state":"active+undersized+remapped","last_fresh":"2024-04-18T21:10:04.633752+0000","last_change":"2024-04-18T21:10:04.634249+0000","last_active":"2024-04-18T21:10:04.633752+0000","last_peered":"2024-04-18T21:10:04.633752+0000","last_clean":"2024-04-18T21:06:56.729628+0000","last_became_active":"2024-04-18T21:09:51.868769+0000","last_became_peered":"2024-04-18T21:09:51.868769+0000","last_unstale":"2024-04-18T21:10:04.633752+0000","last_undegraded":"2024-04-18T21:10:04.633752+0000","last_fullsized":"2024-04-18T21:09:51.765807+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17055,"num_write":375,"num_write_kb":63331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"70'240","reported_seq":331,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-18T21:10:04.541100+0000","last_change":"2024-04-18T21:10:00.556212+0000","last_active":"2024-04-18T21:10:04.541100+0000","last_peered":"2024-04-18T21:10:04.541100+0000","last_clean":"2024-04-18T21:10:04.541100+0000","last_became_active":"2024-04-18T21:10:00.555486+0000","last_became_peered":"2024-04-18T21:10:00.555486+0000","last_unstale":"2024-04-18T21:10:04.541100+0000","last_undegraded":"2024-04-18T21:10:04.541100+0000","last_fullsized":"2024-04-18T21:10:04.541100+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:11.573984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":4191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"71'501","reported_seq":740,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.478829+0000","last_change":"2024-04-18T21:09:51.935429+0000","last_active":"2024-04-18T21:10:07.478829+0000","last_peered":"2024-04-18T21:10:07.478829+0000","last_clean":"2024-04-18T21:06:56.729630+0000","last_became_active":"2024-04-18T21:09:51.925059+0000","last_became_peered":"2024-04-18T21:09:51.925059+0000","last_unstale":"2024-04-18T21:10:07.478829+0000","last_undegraded":"2024-04-18T21:09:51.823027+0000","last_fullsized":"2024-04-18T21:09:51.807046+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":202,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":37662,"num_write":474,"num_write_kb":167663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"70'429","reported_seq":540,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478970+0000","last_change":"2024-04-18T21:10:00.493325+0000","last_active":"2024-04-18T21:10:07.478970+0000","last_peered":"2024-04-18T21:10:07.478970+0000","last_clean":"2024-04-18T21:10:07.478970+0000","last_became_active":"2024-04-18T21:10:00.491525+0000","last_became_peered":"2024-04-18T21:10:00.491525+0000","last_unstale":"2024-04-18T21:10:07.478970+0000","last_undegraded":"2024-04-18T21:10:07.478970+0000","last_fullsized":"2024-04-18T21:10:07.478970+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:27:59.637974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":377,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388678,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'440","reported_seq":624,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.479664+0000","last_change":"2024-04-18T21:10:01.497932+0000","last_active":"2024-04-18T21:10:07.479664+0000","last_peered":"2024-04-18T21:10:07.479664+0000","last_clean":"2024-04-18T21:10:07.479664+0000","last_became_active":"2024-04-18T21:10:01.486740+0000","last_became_peered":"2024-04-18T21:10:01.486740+0000","last_unstale":"2024-04-18T21:10:07.479664+0000","last_undegraded":"2024-04-18T21:10:07.479664+0000","last_fullsized":"2024-04-18T21:10:07.479664+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:34:43.515471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":42138,"num_write":408,"num_write_kb":96310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"70'59","reported_seq":229,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478177+0000","last_change":"2024-04-18T21:05:04.625520+0000","last_active":"2024-04-18T21:10:07.478177+0000","last_peered":"2024-04-18T21:10:07.478177+0000","last_clean":"2024-04-18T21:10:07.478177+0000","last_became_active":"2024-04-18T21:05:04.624656+0000","last_became_peered":"2024-04-18T21:05:04.624656+0000","last_unstale":"2024-04-18T21:10:07.478177+0000","last_undegraded":"2024-04-18T21:10:07.478177+0000","last_fullsized":"2024-04-18T21:10:07.478177+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:56:05.795125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"71'461","reported_seq":650,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478757+0000","last_change":"2024-04-18T21:05:05.649406+0000","last_active":"2024-04-18T21:10:07.478757+0000","last_peered":"2024-04-18T21:10:07.478757+0000","last_clean":"2024-04-18T21:10:07.478757+0000","last_became_active":"2024-04-18T21:05:05.648380+0000","last_became_peered":"2024-04-18T21:05:05.648380+0000","last_unstale":"2024-04-18T21:10:07.478757+0000","last_undegraded":"2024-04-18T21:10:07.478757+0000","last_fullsized":"2024-04-18T21:10:07.478757+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12852,"num_write":420,"num_write_kb":88506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"70'157","reported_seq":350,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.480178+0000","last_change":"2024-04-18T21:10:00.500141+0000","last_active":"2024-04-18T21:10:07.480178+0000","last_peered":"2024-04-18T21:10:07.480178+0000","last_clean":"2024-04-18T21:10:07.480178+0000","last_became_active":"2024-04-18T21:10:00.494630+0000","last_became_peered":"2024-04-18T21:10:00.494630+0000","last_unstale":"2024-04-18T21:10:07.480178+0000","last_undegraded":"2024-04-18T21:10:07.480178+0000","last_fullsized":"2024-04-18T21:10:07.480178+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:49:43.984354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":8250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'445","reported_seq":609,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.477666+0000","last_change":"2024-04-18T21:10:01.500937+0000","last_active":"2024-04-18T21:10:07.477666+0000","last_peered":"2024-04-18T21:10:07.477666+0000","last_clean":"2024-04-18T21:10:07.477666+0000","last_became_active":"2024-04-18T21:10:01.490691+0000","last_became_peered":"2024-04-18T21:10:01.490691+0000","last_unstale":"2024-04-18T21:10:07.477666+0000","last_undegraded":"2024-04-18T21:10:07.477666+0000","last_fullsized":"2024-04-18T21:10:07.477666+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:59:48.489145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17488,"num_write":410,"num_write_kb":50845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"70'124","reported_seq":294,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.479808+0000","last_change":"2024-04-18T21:05:04.634674+0000","last_active":"2024-04-18T21:10:07.479808+0000","last_peered":"2024-04-18T21:10:07.479808+0000","last_clean":"2024-04-18T21:10:07.479808+0000","last_became_active":"2024-04-18T21:05:04.632284+0000","last_became_peered":"2024-04-18T21:05:04.632284+0000","last_unstale":"2024-04-18T21:10:07.479808+0000","last_undegraded":"2024-04-18T21:10:07.479808+0000","last_fullsized":"2024-04-18T21:10:07.479808+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:09:18.466987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"71'400","reported_seq":559,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.478753+0000","last_change":"2024-04-18T21:10:01.502202+0000","last_active":"2024-04-18T21:10:07.478753+0000","last_peered":"2024-04-18T21:10:07.478753+0000","last_clean":"2024-04-18T21:09:48.744284+0000","last_became_active":"2024-04-18T21:10:01.496176+0000","last_became_peered":"2024-04-18T21:10:01.496176+0000","last_unstale":"2024-04-18T21:10:07.478753+0000","last_undegraded":"2024-04-18T21:10:01.486611+0000","last_fullsized":"2024-04-18T21:10:01.480189+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":175,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12586,"num_write":372,"num_write_kb":58856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":576854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"70'53","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-18T21:10:04.539503+0000","last_change":"2024-04-18T21:10:00.550936+0000","last_active":"2024-04-18T21:10:04.539503+0000","last_peered":"2024-04-18T21:10:04.539503+0000","last_clean":"2024-04-18T21:10:04.539503+0000","last_became_active":"2024-04-18T21:10:00.549987+0000","last_became_peered":"2024-04-18T21:10:00.549987+0000","last_unstale":"2024-04-18T21:10:04.539503+0000","last_undegraded":"2024-04-18T21:10:04.539503+0000","last_fullsized":"2024-04-18T21:10:04.539503+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:53:36.771516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"71'364","reported_seq":917,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478711+0000","last_change":"2024-04-18T21:09:58.478726+0000","last_active":"2024-04-18T21:10:07.478711+0000","last_peered":"2024-04-18T21:10:07.478711+0000","last_clean":"2024-04-18T21:10:07.478711+0000","last_became_active":"2024-04-18T21:09:58.473903+0000","last_became_peered":"2024-04-18T21:09:58.473903+0000","last_unstale":"2024-04-18T21:10:07.478711+0000","last_undegraded":"2024-04-18T21:10:07.478711+0000","last_fullsized":"2024-04-18T21:10:07.478711+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:40.377274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":37938,"num_write":336,"num_write_kb":42513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"70'460","reported_seq":541,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-18T21:10:04.540157+0000","last_change":"2024-04-18T21:09:53.545846+0000","last_active":"2024-04-18T21:10:04.540157+0000","last_peered":"2024-04-18T21:10:04.540157+0000","last_clean":"2024-04-18T21:10:04.540157+0000","last_became_active":"2024-04-18T21:09:53.544355+0000","last_became_peered":"2024-04-18T21:09:53.544355+0000","last_unstale":"2024-04-18T21:10:04.540157+0000","last_undegraded":"2024-04-18T21:10:04.540157+0000","last_fullsized":"2024-04-18T21:10:04.540157+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:34:16.776752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":406,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"71'404","reported_seq":597,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.481372+0000","last_change":"2024-04-18T21:09:51.933464+0000","last_active":"2024-04-18T21:10:07.481372+0000","last_peered":"2024-04-18T21:10:07.481372+0000","last_clean":"2024-04-18T21:06:56.714828+0000","last_became_active":"2024-04-18T21:09:51.918677+0000","last_became_peered":"2024-04-18T21:09:51.918677+0000","last_unstale":"2024-04-18T21:10:07.481372+0000","last_undegraded":"2024-04-18T21:09:51.824330+0000","last_fullsized":"2024-04-18T21:09:51.803729+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":174,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":7075,"num_write":367,"num_write_kb":62738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":357,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.477742+0000","last_change":"2024-04-18T21:10:00.497960+0000","last_active":"2024-04-18T21:10:07.477742+0000","last_peered":"2024-04-18T21:10:07.477742+0000","last_clean":"2024-04-18T21:10:07.477742+0000","last_became_active":"2024-04-18T21:10:00.496373+0000","last_became_peered":"2024-04-18T21:10:00.496373+0000","last_unstale":"2024-04-18T21:10:07.477742+0000","last_undegraded":"2024-04-18T21:10:07.477742+0000","last_fullsized":"2024-04-18T21:10:07.477742+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_clean_scrub_stamp":"2024-04-18T21:04:53.494814+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:56:52.975720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":133,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.479060+0000","last_change":"2024-04-18T21:10:00.487584+0000","last_active":"2024-04-18T21:10:07.479060+0000","last_peered":"2024-04-18T21:10:07.479060+0000","last_clean":"2024-04-18T21:10:07.479060+0000","last_became_active":"2024-04-18T21:10:00.486722+0000","last_became_peered":"2024-04-18T21:10:00.486722+0000","last_unstale":"2024-04-18T21:10:07.479060+0000","last_undegraded":"2024-04-18T21:10:07.479060+0000","last_fullsized":"2024-04-18T21:10:07.479060+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:17:03.176148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"70'595","reported_seq":724,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.479483+0000","last_change":"2024-04-18T21:10:03.488427+0000","last_active":"2024-04-18T21:10:07.479483+0000","last_peered":"2024-04-18T21:10:07.479483+0000","last_clean":"2024-04-18T21:10:07.479483+0000","last_became_active":"2024-04-18T21:10:03.481344+0000","last_became_peered":"2024-04-18T21:10:03.481344+0000","last_unstale":"2024-04-18T21:10:07.479483+0000","last_undegraded":"2024-04-18T21:10:07.479483+0000","last_fullsized":"2024-04-18T21:10:07.479483+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:41.583248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":539,"num_write_kb":8449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4689862,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'443","reported_seq":1063,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478684+0000","last_change":"2024-04-18T21:09:56.496310+0000","last_active":"2024-04-18T21:10:07.478684+0000","last_peered":"2024-04-18T21:10:07.478684+0000","last_clean":"2024-04-18T21:10:07.478684+0000","last_became_active":"2024-04-18T21:09:56.493327+0000","last_became_peered":"2024-04-18T21:09:56.493327+0000","last_unstale":"2024-04-18T21:10:07.478684+0000","last_undegraded":"2024-04-18T21:10:07.478684+0000","last_fullsized":"2024-04-18T21:10:07.478684+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:20:57.340997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":38975,"num_write":404,"num_write_kb":80038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":183,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.477469+0000","last_change":"2024-04-18T21:09:50.817029+0000","last_active":"2024-04-18T21:10:07.477469+0000","last_peered":"2024-04-18T21:10:07.477469+0000","last_clean":"2024-04-18T21:10:07.477469+0000","last_became_active":"2024-04-18T21:09:50.816543+0000","last_became_peered":"2024-04-18T21:09:50.816543+0000","last_unstale":"2024-04-18T21:10:07.477469+0000","last_undegraded":"2024-04-18T21:10:07.477469+0000","last_fullsized":"2024-04-18T21:10:07.477469+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:47:33.047727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"70'129","reported_seq":286,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.479217+0000","last_change":"2024-04-18T21:10:03.489109+0000","last_active":"2024-04-18T21:10:07.479217+0000","last_peered":"2024-04-18T21:10:07.479217+0000","last_clean":"2024-04-18T21:10:07.479217+0000","last_became_active":"2024-04-18T21:10:03.486859+0000","last_became_peered":"2024-04-18T21:10:03.486859+0000","last_unstale":"2024-04-18T21:10:07.479217+0000","last_undegraded":"2024-04-18T21:10:07.479217+0000","last_fullsized":"2024-04-18T21:10:07.479217+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:52:04.172480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466419,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":55,"num_read_kb":1405,"num_write":58,"num_write_kb":1469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'457","reported_seq":880,"reported_epoch":95,"state":"active+recovering+undersized+remapped","last_fresh":"2024-04-18T21:10:07.655492+0000","last_change":"2024-04-18T21:10:07.319036+0000","last_active":"2024-04-18T21:10:07.655492+0000","last_peered":"2024-04-18T21:10:07.655492+0000","last_clean":"2024-04-18T21:06:56.314380+0000","last_became_active":"2024-04-18T21:09:51.907134+0000","last_became_peered":"2024-04-18T21:09:51.907134+0000","last_unstale":"2024-04-18T21:10:07.655492+0000","last_undegraded":"2024-04-18T21:10:07.655492+0000","last_fullsized":"2024-04-18T21:09:51.803481+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":27659,"num_write":426,"num_write_kb":80500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.480273+0000","last_change":"2024-04-18T21:09:50.832624+0000","last_active":"2024-04-18T21:10:07.480273+0000","last_peered":"2024-04-18T21:10:07.480273+0000","last_clean":"2024-04-18T21:10:07.480273+0000","last_became_active":"2024-04-18T21:09:50.831949+0000","last_became_peered":"2024-04-18T21:09:50.831949+0000","last_unstale":"2024-04-18T21:10:07.480273+0000","last_undegraded":"2024-04-18T21:10:07.480273+0000","last_fullsized":"2024-04-18T21:10:07.480273+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:35:45.986029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'170","reported_seq":336,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-18T21:10:04.539385+0000","last_change":"2024-04-18T21:09:53.538615+0000","last_active":"2024-04-18T21:10:04.539385+0000","last_peered":"2024-04-18T21:10:04.539385+0000","last_clean":"2024-04-18T21:10:04.539385+0000","last_became_active":"2024-04-18T21:09:53.537994+0000","last_became_peered":"2024-04-18T21:09:53.537994+0000","last_unstale":"2024-04-18T21:10:04.539385+0000","last_undegraded":"2024-04-18T21:10:04.539385+0000","last_fullsized":"2024-04-18T21:10:04.539385+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:02:34.372453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":8239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"71'346","reported_seq":571,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.481389+0000","last_change":"2024-04-18T21:09:51.933169+0000","last_active":"2024-04-18T21:10:07.481389+0000","last_peered":"2024-04-18T21:10:07.481389+0000","last_clean":"2024-04-18T21:06:56.661266+0000","last_became_active":"2024-04-18T21:09:51.914853+0000","last_became_peered":"2024-04-18T21:09:51.914853+0000","last_unstale":"2024-04-18T21:10:07.481389+0000","last_undegraded":"2024-04-18T21:09:51.829697+0000","last_fullsized":"2024-04-18T21:09:51.816524+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":153,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27042,"num_write":321,"num_write_kb":50693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.479939+0000","last_change":"2024-04-18T21:05:00.576606+0000","last_active":"2024-04-18T21:10:07.479939+0000","last_peered":"2024-04-18T21:10:07.479939+0000","last_clean":"2024-04-18T21:10:07.479939+0000","last_became_active":"2024-04-18T21:05:00.575951+0000","last_became_peered":"2024-04-18T21:05:00.575951+0000","last_unstale":"2024-04-18T21:10:07.479939+0000","last_undegraded":"2024-04-18T21:10:07.479939+0000","last_fullsized":"2024-04-18T21:10:07.479939+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:32:17.612481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"70'63","reported_seq":233,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478716+0000","last_change":"2024-04-18T21:05:04.627296+0000","last_active":"2024-04-18T21:10:07.478716+0000","last_peered":"2024-04-18T21:10:07.478716+0000","last_clean":"2024-04-18T21:10:07.478716+0000","last_became_active":"2024-04-18T21:05:04.626801+0000","last_became_peered":"2024-04-18T21:05:04.626801+0000","last_unstale":"2024-04-18T21:10:07.478716+0000","last_undegraded":"2024-04-18T21:10:07.478716+0000","last_fullsized":"2024-04-18T21:10:07.478716+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:46:36.285416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"71'406","reported_seq":1015,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.480589+0000","last_change":"2024-04-18T21:09:59.495686+0000","last_active":"2024-04-18T21:10:07.480589+0000","last_peered":"2024-04-18T21:10:07.480589+0000","last_clean":"2024-04-18T21:10:07.480589+0000","last_became_active":"2024-04-18T21:09:59.493248+0000","last_became_peered":"2024-04-18T21:09:59.493248+0000","last_unstale":"2024-04-18T21:10:07.480589+0000","last_undegraded":"2024-04-18T21:10:07.480589+0000","last_fullsized":"2024-04-18T21:10:07.480589+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:11:23.853682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":35332,"num_write":370,"num_write_kb":71807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"70'284","reported_seq":289,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.479256+0000","last_change":"2024-04-18T21:10:00.504958+0000","last_active":"2024-04-18T21:10:07.479256+0000","last_peered":"2024-04-18T21:10:07.479256+0000","last_clean":"2024-04-18T21:10:07.479256+0000","last_became_active":"2024-04-18T21:10:00.503851+0000","last_became_peered":"2024-04-18T21:10:00.503851+0000","last_unstale":"2024-04-18T21:10:07.479256+0000","last_undegraded":"2024-04-18T21:10:07.479256+0000","last_fullsized":"2024-04-18T21:10:07.479256+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:10:27.397258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":218,"num_write_kb":4194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.480983+0000","last_change":"2024-04-18T21:10:03.484148+0000","last_active":"2024-04-18T21:10:07.480983+0000","last_peered":"2024-04-18T21:10:07.480983+0000","last_clean":"2024-04-18T21:10:07.480983+0000","last_became_active":"2024-04-18T21:10:03.480071+0000","last_became_peered":"2024-04-18T21:10:03.480071+0000","last_unstale":"2024-04-18T21:10:07.480983+0000","last_undegraded":"2024-04-18T21:10:07.480983+0000","last_fullsized":"2024-04-18T21:10:07.480983+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:50:30.257039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'386","reported_seq":587,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.476568+0000","last_change":"2024-04-18T21:09:52.430978+0000","last_active":"2024-04-18T21:10:07.476568+0000","last_peered":"2024-04-18T21:10:07.476568+0000","last_clean":"2024-04-18T21:06:56.710639+0000","last_became_active":"2024-04-18T21:09:51.908732+0000","last_became_peered":"2024-04-18T21:09:51.908732+0000","last_unstale":"2024-04-18T21:10:07.476568+0000","last_undegraded":"2024-04-18T21:09:52.430630+0000","last_fullsized":"2024-04-18T21:09:51.772520+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":166,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14677,"num_write":355,"num_write_kb":51018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"70'55","reported_seq":231,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.480986+0000","last_change":"2024-04-18T21:09:50.833424+0000","last_active":"2024-04-18T21:10:07.480986+0000","last_peered":"2024-04-18T21:10:07.480986+0000","last_clean":"2024-04-18T21:10:07.480986+0000","last_became_active":"2024-04-18T21:09:50.832752+0000","last_became_peered":"2024-04-18T21:09:50.832752+0000","last_unstale":"2024-04-18T21:10:07.480986+0000","last_undegraded":"2024-04-18T21:10:07.480986+0000","last_fullsized":"2024-04-18T21:10:07.480986+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:48.945329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":133,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-18T21:10:04.542146+0000","last_change":"2024-04-18T21:09:50.900338+0000","last_active":"2024-04-18T21:10:04.542146+0000","last_peered":"2024-04-18T21:10:04.542146+0000","last_clean":"2024-04-18T21:10:04.542146+0000","last_became_active":"2024-04-18T21:09:50.896844+0000","last_became_peered":"2024-04-18T21:09:50.896844+0000","last_unstale":"2024-04-18T21:10:04.542146+0000","last_undegraded":"2024-04-18T21:10:04.542146+0000","last_fullsized":"2024-04-18T21:10:04.542146+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:11:35.543409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"71'402","reported_seq":553,"reported_epoch":92,"state":"peering","last_fresh":"2024-04-18T21:10:04.540261+0000","last_change":"2024-04-18T21:10:04.540261+0000","last_active":"2024-04-18T21:09:50.769501+0000","last_peered":"2024-04-18T21:09:48.744886+0000","last_clean":"2024-04-18T21:06:55.789400+0000","last_became_active":"2024-04-18T21:06:57.810487+0000","last_became_peered":"2024-04-18T21:06:57.810487+0000","last_unstale":"2024-04-18T21:10:04.540261+0000","last_undegraded":"2024-04-18T21:10:04.540261+0000","last_fullsized":"2024-04-18T21:10:04.540261+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12468,"num_write":369,"num_write_kb":67231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"70'60","reported_seq":237,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.482521+0000","last_change":"2024-04-18T21:09:50.832598+0000","last_active":"2024-04-18T21:10:07.482521+0000","last_peered":"2024-04-18T21:10:07.482521+0000","last_clean":"2024-04-18T21:10:07.482521+0000","last_became_active":"2024-04-18T21:09:50.832030+0000","last_became_peered":"2024-04-18T21:09:50.832030+0000","last_unstale":"2024-04-18T21:10:07.482521+0000","last_undegraded":"2024-04-18T21:10:07.482521+0000","last_fullsized":"2024-04-18T21:10:07.482521+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:10:27.397258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.483586+0000","last_change":"2024-04-18T21:10:03.492761+0000","last_active":"2024-04-18T21:10:07.483586+0000","last_peered":"2024-04-18T21:10:07.483586+0000","last_clean":"2024-04-18T21:10:07.483586+0000","last_became_active":"2024-04-18T21:10:03.492145+0000","last_became_peered":"2024-04-18T21:10:03.492145+0000","last_unstale":"2024-04-18T21:10:07.483586+0000","last_undegraded":"2024-04-18T21:10:07.483586+0000","last_fullsized":"2024-04-18T21:10:07.483586+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:20:00.853523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'421","reported_seq":602,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.479646+0000","last_change":"2024-04-18T21:10:03.488774+0000","last_active":"2024-04-18T21:10:07.479646+0000","last_peered":"2024-04-18T21:10:07.479646+0000","last_clean":"2024-04-18T21:10:07.479646+0000","last_became_active":"2024-04-18T21:10:03.479773+0000","last_became_peered":"2024-04-18T21:10:03.479773+0000","last_unstale":"2024-04-18T21:10:07.479646+0000","last_undegraded":"2024-04-18T21:10:07.479646+0000","last_fullsized":"2024-04-18T21:10:07.479646+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:15:12.326904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":16183,"num_write":377,"num_write_kb":50451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"71'110","reported_seq":299,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.483583+0000","last_change":"2024-04-18T21:10:00.497917+0000","last_active":"2024-04-18T21:10:07.483583+0000","last_peered":"2024-04-18T21:10:07.483583+0000","last_clean":"2024-04-18T21:10:07.483583+0000","last_became_active":"2024-04-18T21:10:00.494644+0000","last_became_peered":"2024-04-18T21:10:00.494644+0000","last_unstale":"2024-04-18T21:10:07.483583+0000","last_undegraded":"2024-04-18T21:10:07.483583+0000","last_fullsized":"2024-04-18T21:10:07.483583+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:40:57.347353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":1251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":134,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.479598+0000","last_change":"2024-04-18T21:10:00.493764+0000","last_active":"2024-04-18T21:10:07.479598+0000","last_peered":"2024-04-18T21:10:07.479598+0000","last_clean":"2024-04-18T21:10:07.479598+0000","last_became_active":"2024-04-18T21:10:00.492672+0000","last_became_peered":"2024-04-18T21:10:00.492672+0000","last_unstale":"2024-04-18T21:10:07.479598+0000","last_undegraded":"2024-04-18T21:10:07.479598+0000","last_fullsized":"2024-04-18T21:10:07.479598+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:48:46.709401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'384","reported_seq":565,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-18T21:10:04.540220+0000","last_change":"2024-04-18T21:09:57.572865+0000","last_active":"2024-04-18T21:10:04.540220+0000","last_peered":"2024-04-18T21:10:04.540220+0000","last_clean":"2024-04-18T21:10:04.540220+0000","last_became_active":"2024-04-18T21:09:57.567962+0000","last_became_peered":"2024-04-18T21:09:57.567962+0000","last_unstale":"2024-04-18T21:10:04.540220+0000","last_undegraded":"2024-04-18T21:10:04.540220+0000","last_fullsized":"2024-04-18T21:10:04.540220+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:51:24.627186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":15567,"num_write":351,"num_write_kb":42959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"71'396","reported_seq":549,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.478153+0000","last_change":"2024-04-18T21:10:01.500036+0000","last_active":"2024-04-18T21:10:07.478153+0000","last_peered":"2024-04-18T21:10:07.478153+0000","last_clean":"2024-04-18T21:09:48.743028+0000","last_became_active":"2024-04-18T21:10:01.492175+0000","last_became_peered":"2024-04-18T21:10:01.492175+0000","last_unstale":"2024-04-18T21:10:07.478153+0000","last_undegraded":"2024-04-18T21:10:01.483082+0000","last_fullsized":"2024-04-18T21:10:01.476438+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":171,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12943,"num_write":353,"num_write_kb":35357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":3500882,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"71'277","reported_seq":292,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.477963+0000","last_change":"2024-04-18T21:10:00.495047+0000","last_active":"2024-04-18T21:10:07.477963+0000","last_peered":"2024-04-18T21:10:07.477963+0000","last_clean":"2024-04-18T21:10:07.477963+0000","last_became_active":"2024-04-18T21:10:00.493088+0000","last_became_peered":"2024-04-18T21:10:00.493088+0000","last_unstale":"2024-04-18T21:10:07.477963+0000","last_undegraded":"2024-04-18T21:10:07.477963+0000","last_fullsized":"2024-04-18T21:10:07.477963+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:39:08.263781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":221,"num_write_kb":8303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":8389370,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'411","reported_seq":981,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478348+0000","last_change":"2024-04-18T21:10:04.485332+0000","last_active":"2024-04-18T21:10:07.478348+0000","last_peered":"2024-04-18T21:10:07.478348+0000","last_clean":"2024-04-18T21:10:07.478348+0000","last_became_active":"2024-04-18T21:10:04.482320+0000","last_became_peered":"2024-04-18T21:10:04.482320+0000","last_unstale":"2024-04-18T21:10:07.478348+0000","last_undegraded":"2024-04-18T21:10:07.478348+0000","last_fullsized":"2024-04-18T21:10:07.478348+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:35:57.043682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":17179,"num_write":375,"num_write_kb":38991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"70'85","reported_seq":136,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-18T21:10:04.541699+0000","last_change":"2024-04-18T21:09:50.890616+0000","last_active":"2024-04-18T21:10:04.541699+0000","last_peered":"2024-04-18T21:10:04.541699+0000","last_clean":"2024-04-18T21:10:04.541699+0000","last_became_active":"2024-04-18T21:09:50.874855+0000","last_became_peered":"2024-04-18T21:09:50.874855+0000","last_unstale":"2024-04-18T21:10:04.541699+0000","last_undegraded":"2024-04-18T21:10:04.541699+0000","last_fullsized":"2024-04-18T21:10:04.541699+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:03:54.726282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"70'230","reported_seq":233,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.479167+0000","last_change":"2024-04-18T21:10:00.499373+0000","last_active":"2024-04-18T21:10:07.479167+0000","last_peered":"2024-04-18T21:10:07.479167+0000","last_clean":"2024-04-18T21:10:07.479167+0000","last_became_active":"2024-04-18T21:10:00.498141+0000","last_became_peered":"2024-04-18T21:10:00.498141+0000","last_unstale":"2024-04-18T21:10:07.479167+0000","last_undegraded":"2024-04-18T21:10:07.479167+0000","last_fullsized":"2024-04-18T21:10:07.479167+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:55:01.865593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":4178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"71'493","reported_seq":706,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478522+0000","last_change":"2024-04-18T21:05:05.642793+0000","last_active":"2024-04-18T21:10:07.478522+0000","last_peered":"2024-04-18T21:10:07.478522+0000","last_clean":"2024-04-18T21:10:07.478522+0000","last_became_active":"2024-04-18T21:05:05.641983+0000","last_became_peered":"2024-04-18T21:05:05.641983+0000","last_unstale":"2024-04-18T21:10:07.478522+0000","last_undegraded":"2024-04-18T21:10:07.478522+0000","last_fullsized":"2024-04-18T21:10:07.478522+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:46:36.339289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23833,"num_write":461,"num_write_kb":76873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"70'62","reported_seq":231,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.482063+0000","last_change":"2024-04-18T21:05:04.641445+0000","last_active":"2024-04-18T21:10:07.482063+0000","last_peered":"2024-04-18T21:10:07.482063+0000","last_clean":"2024-04-18T21:10:07.482063+0000","last_became_active":"2024-04-18T21:05:04.640682+0000","last_became_peered":"2024-04-18T21:05:04.640682+0000","last_unstale":"2024-04-18T21:10:07.482063+0000","last_undegraded":"2024-04-18T21:10:07.482063+0000","last_fullsized":"2024-04-18T21:10:07.482063+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:46:36.285416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'436","reported_seq":644,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.478935+0000","last_change":"2024-04-18T21:09:51.937322+0000","last_active":"2024-04-18T21:10:07.478935+0000","last_peered":"2024-04-18T21:10:07.478935+0000","last_clean":"2024-04-18T21:06:56.761407+0000","last_became_active":"2024-04-18T21:09:51.933205+0000","last_became_peered":"2024-04-18T21:09:51.933205+0000","last_unstale":"2024-04-18T21:10:07.478935+0000","last_undegraded":"2024-04-18T21:09:51.833249+0000","last_fullsized":"2024-04-18T21:09:51.824946+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":193,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14561,"num_write":408,"num_write_kb":47462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'369","reported_seq":539,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-18T21:10:04.542468+0000","last_change":"2024-04-18T21:10:02.553999+0000","last_active":"2024-04-18T21:10:04.542468+0000","last_peered":"2024-04-18T21:10:04.542468+0000","last_clean":"2024-04-18T21:10:04.542468+0000","last_became_active":"2024-04-18T21:10:02.549471+0000","last_became_peered":"2024-04-18T21:10:02.549471+0000","last_unstale":"2024-04-18T21:10:04.542468+0000","last_undegraded":"2024-04-18T21:10:04.542468+0000","last_fullsized":"2024-04-18T21:10:04.542468+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:52:14.371235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13619,"num_write":339,"num_write_kb":63086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"70'888","reported_seq":1004,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.480032+0000","last_change":"2024-04-18T21:10:03.486911+0000","last_active":"2024-04-18T21:10:07.480032+0000","last_peered":"2024-04-18T21:10:07.480032+0000","last_clean":"2024-04-18T21:10:07.480032+0000","last_became_active":"2024-04-18T21:10:03.480576+0000","last_became_peered":"2024-04-18T21:10:03.480576+0000","last_unstale":"2024-04-18T21:10:07.480032+0000","last_undegraded":"2024-04-18T21:10:07.480032+0000","last_fullsized":"2024-04-18T21:10:07.480032+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:41:06.632064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":823,"num_write_kb":8582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'398","reported_seq":536,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.481860+0000","last_change":"2024-04-18T21:10:03.491426+0000","last_active":"2024-04-18T21:10:07.481860+0000","last_peered":"2024-04-18T21:10:07.481860+0000","last_clean":"2024-04-18T21:10:07.481860+0000","last_became_active":"2024-04-18T21:10:03.483190+0000","last_became_peered":"2024-04-18T21:10:03.483190+0000","last_unstale":"2024-04-18T21:10:07.481860+0000","last_undegraded":"2024-04-18T21:10:07.481860+0000","last_fullsized":"2024-04-18T21:10:07.481860+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:05:10.611580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14684,"num_write":380,"num_write_kb":88822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"70'169","reported_seq":358,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478915+0000","last_change":"2024-04-18T21:10:00.494974+0000","last_active":"2024-04-18T21:10:07.478915+0000","last_peered":"2024-04-18T21:10:07.478915+0000","last_clean":"2024-04-18T21:10:07.478915+0000","last_became_active":"2024-04-18T21:10:00.492196+0000","last_became_peered":"2024-04-18T21:10:00.492196+0000","last_unstale":"2024-04-18T21:10:07.478915+0000","last_undegraded":"2024-04-18T21:10:07.478915+0000","last_fullsized":"2024-04-18T21:10:07.478915+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:33:51.236211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":4162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'406","reported_seq":644,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.477513+0000","last_change":"2024-04-18T21:09:52.500269+0000","last_active":"2024-04-18T21:10:07.477513+0000","last_peered":"2024-04-18T21:10:07.477513+0000","last_clean":"2024-04-18T21:06:56.583905+0000","last_became_active":"2024-04-18T21:09:51.914607+0000","last_became_peered":"2024-04-18T21:09:51.914607+0000","last_unstale":"2024-04-18T21:10:07.477513+0000","last_undegraded":"2024-04-18T21:09:52.499843+0000","last_fullsized":"2024-04-18T21:09:51.772504+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":165,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27495,"num_write":363,"num_write_kb":89134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"72'192","reported_seq":353,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-18T21:10:04.540703+0000","last_change":"2024-04-18T21:09:53.541766+0000","last_active":"2024-04-18T21:10:04.540703+0000","last_peered":"2024-04-18T21:10:04.540703+0000","last_clean":"2024-04-18T21:10:04.540703+0000","last_became_active":"2024-04-18T21:09:53.541300+0000","last_became_peered":"2024-04-18T21:09:53.541300+0000","last_unstale":"2024-04-18T21:10:04.540703+0000","last_undegraded":"2024-04-18T21:10:04.540703+0000","last_fullsized":"2024-04-18T21:10:04.540703+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:26:14.718922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12425030,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":12201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8230726,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"71'383","reported_seq":585,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-18T21:10:04.541046+0000","last_change":"2024-04-18T21:09:55.555798+0000","last_active":"2024-04-18T21:10:04.541046+0000","last_peered":"2024-04-18T21:10:04.541046+0000","last_clean":"2024-04-18T21:10:04.541046+0000","last_became_active":"2024-04-18T21:09:55.551135+0000","last_became_peered":"2024-04-18T21:09:55.551135+0000","last_unstale":"2024-04-18T21:10:04.541046+0000","last_undegraded":"2024-04-18T21:10:04.541046+0000","last_fullsized":"2024-04-18T21:10:04.541046+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:00:01.739082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21614,"num_write":351,"num_write_kb":79501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"70'66","reported_seq":127,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-18T21:10:04.541717+0000","last_change":"2024-04-18T21:10:00.553114+0000","last_active":"2024-04-18T21:10:04.541717+0000","last_peered":"2024-04-18T21:10:04.541717+0000","last_clean":"2024-04-18T21:10:04.541717+0000","last_became_active":"2024-04-18T21:10:00.552067+0000","last_became_peered":"2024-04-18T21:10:00.552067+0000","last_unstale":"2024-04-18T21:10:04.541717+0000","last_undegraded":"2024-04-18T21:10:04.541717+0000","last_fullsized":"2024-04-18T21:10:04.541717+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:51:32.567297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"71'345","reported_seq":520,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.477790+0000","last_change":"2024-04-18T21:05:05.624840+0000","last_active":"2024-04-18T21:10:07.477790+0000","last_peered":"2024-04-18T21:10:07.477790+0000","last_clean":"2024-04-18T21:10:07.477790+0000","last_became_active":"2024-04-18T21:05:05.622950+0000","last_became_peered":"2024-04-18T21:05:05.622950+0000","last_unstale":"2024-04-18T21:10:07.477790+0000","last_undegraded":"2024-04-18T21:10:07.477790+0000","last_fullsized":"2024-04-18T21:10:07.477790+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:27:17.530889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":317,"num_write_kb":29335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"70'171","reported_seq":260,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.477750+0000","last_change":"2024-04-18T21:10:00.507624+0000","last_active":"2024-04-18T21:10:07.477750+0000","last_peered":"2024-04-18T21:10:07.477750+0000","last_clean":"2024-04-18T21:10:07.477750+0000","last_became_active":"2024-04-18T21:10:00.507132+0000","last_became_peered":"2024-04-18T21:10:00.507132+0000","last_unstale":"2024-04-18T21:10:07.477750+0000","last_undegraded":"2024-04-18T21:10:07.477750+0000","last_fullsized":"2024-04-18T21:10:07.477750+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:35:50.013019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":4154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"71'417","reported_seq":617,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.479514+0000","last_change":"2024-04-18T21:05:05.627962+0000","last_active":"2024-04-18T21:10:07.479514+0000","last_peered":"2024-04-18T21:10:07.479514+0000","last_clean":"2024-04-18T21:10:07.479514+0000","last_became_active":"2024-04-18T21:05:05.626698+0000","last_became_peered":"2024-04-18T21:05:05.626698+0000","last_unstale":"2024-04-18T21:10:07.479514+0000","last_undegraded":"2024-04-18T21:10:07.479514+0000","last_fullsized":"2024-04-18T21:10:07.479514+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:48:48.973087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":17040,"num_write":384,"num_write_kb":83740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"70'276","reported_seq":439,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-18T21:10:04.540480+0000","last_change":"2024-04-18T21:09:53.543611+0000","last_active":"2024-04-18T21:10:04.540480+0000","last_peered":"2024-04-18T21:10:04.540480+0000","last_clean":"2024-04-18T21:10:04.540480+0000","last_became_active":"2024-04-18T21:09:53.542863+0000","last_became_peered":"2024-04-18T21:09:53.542863+0000","last_unstale":"2024-04-18T21:10:04.540480+0000","last_undegraded":"2024-04-18T21:10:04.540480+0000","last_fullsized":"2024-04-18T21:10:04.540480+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:22.582074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":12399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"71'428","reported_seq":634,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:04.475031+0000","last_change":"2024-04-18T21:09:51.930418+0000","last_active":"2024-04-18T21:10:04.475031+0000","last_peered":"2024-04-18T21:10:04.475031+0000","last_clean":"2024-04-18T21:06:56.466371+0000","last_became_active":"2024-04-18T21:09:51.913729+0000","last_became_peered":"2024-04-18T21:09:51.913729+0000","last_unstale":"2024-04-18T21:10:04.475031+0000","last_undegraded":"2024-04-18T21:09:51.830860+0000","last_fullsized":"2024-04-18T21:09:51.824803+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":186,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22548,"num_write":398,"num_write_kb":75972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"70'70","reported_seq":247,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.482404+0000","last_change":"2024-04-18T21:09:50.833350+0000","last_active":"2024-04-18T21:10:07.482404+0000","last_peered":"2024-04-18T21:10:07.482404+0000","last_clean":"2024-04-18T21:10:07.482404+0000","last_became_active":"2024-04-18T21:09:50.832355+0000","last_became_peered":"2024-04-18T21:09:50.832355+0000","last_unstale":"2024-04-18T21:10:07.482404+0000","last_undegraded":"2024-04-18T21:10:07.482404+0000","last_fullsized":"2024-04-18T21:10:07.482404+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:39:09.627425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'459","reported_seq":616,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.476880+0000","last_change":"2024-04-18T21:10:01.503378+0000","last_active":"2024-04-18T21:10:07.476880+0000","last_peered":"2024-04-18T21:10:07.476880+0000","last_clean":"2024-04-18T21:10:07.476880+0000","last_became_active":"2024-04-18T21:10:01.497275+0000","last_became_peered":"2024-04-18T21:10:01.497275+0000","last_unstale":"2024-04-18T21:10:07.476880+0000","last_undegraded":"2024-04-18T21:10:07.476880+0000","last_fullsized":"2024-04-18T21:10:07.476880+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:40:35.832428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13353,"num_write":429,"num_write_kb":88123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"70'113","reported_seq":306,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.481828+0000","last_change":"2024-04-18T21:10:00.499468+0000","last_active":"2024-04-18T21:10:07.481828+0000","last_peered":"2024-04-18T21:10:07.481828+0000","last_clean":"2024-04-18T21:10:07.481828+0000","last_became_active":"2024-04-18T21:10:00.494734+0000","last_became_peered":"2024-04-18T21:10:00.494734+0000","last_unstale":"2024-04-18T21:10:07.481828+0000","last_undegraded":"2024-04-18T21:10:07.481828+0000","last_fullsized":"2024-04-18T21:10:07.481828+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:58:34.790588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194886,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3792,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2531,"num_read_kb":1304649,"num_write":24542,"num_write_kb":4299443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3900,"num_bytes_recovered":4488063,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":169492480,"data_stored":160471692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26603,"ondisk_log_size":26603,"up":128,"acting":105,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127139127,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":55,"num_read_kb":1405,"num_write":4542,"num_write_kb":127514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":92002768,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":279527424,"data_stored":279444842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4409,"internal_metadata":0},"log_size":6331,"ondisk_log_size":6331,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738436,"num_pgs":84,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":208484,"kb_used_data":105176,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94163356,"statfs":{"total":96636764160,"available":96423276544,"internally_reserved":0,"allocated":107700224,"data_stored":107174746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":77,"seq":330712481797,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":292120,"kb_used_data":250440,"kb_used_omap":5,"kb_used_meta":41658,"kb_avail":94079720,"statfs":{"total":96636764160,"available":96337633280,"internally_reserved":0,"allocated":256450560,"data_stored":246469226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6004,"internal_metadata":42657932},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738434,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":160340,"kb_used_data":88960,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94211500,"statfs":{"total":96636764160,"available":96472576000,"internally_reserved":0,"allocated":91095040,"data_stored":90560267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":89579520,"data_stored":89548273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":83750912,"data_stored":83729052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4409,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106196992,"data_stored":106167517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":169492480,"data_stored":160471692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:10:08.693 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:10:09.021 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:10:09.022 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-04-18T21:10:09.037 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":252,"stamp":"2024-04-18T21:10:08.633564+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127729495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3792,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2722,"num_read_kb":1306172,"num_write":29287,"num_write_kb":4430417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3937,"num_bytes_recovered":97081199,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33091,"ondisk_log_size":33091,"up":210,"acting":187,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":231,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":660944,"kb_used_data":444576,"kb_used_omap":8,"kb_used_meta":216311,"kb_avail":282454576,"statfs":{"total":289910292480,"available":289233485824,"internally_reserved":0,"allocated":455245824,"data_stored":444204239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9194,"internal_metadata":221502486},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-533,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":527,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001295"},"pg_stats":[{"pgid":"4.3f","version":"71'418","reported_seq":633,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.481984+0000","last_change":"2024-04-18T21:09:51.933769+0000","last_active":"2024-04-18T21:10:07.481984+0000","last_peered":"2024-04-18T21:10:07.481984+0000","last_clean":"2024-04-18T21:06:56.295490+0000","last_became_active":"2024-04-18T21:09:51.925977+0000","last_became_peered":"2024-04-18T21:09:51.925977+0000","last_unstale":"2024-04-18T21:10:07.481984+0000","last_undegraded":"2024-04-18T21:09:51.837482+0000","last_fullsized":"2024-04-18T21:09:51.829450+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":19677,"num_write":386,"num_write_kb":87615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"71'417","reported_seq":593,"reported_epoch":92,"state":"peering","last_fresh":"2024-04-18T21:10:04.540237+0000","last_change":"2024-04-18T21:10:04.540237+0000","last_active":"2024-04-18T21:09:50.768414+0000","last_peered":"2024-04-18T21:09:48.745585+0000","last_clean":"2024-04-18T21:06:55.789736+0000","last_became_active":"2024-04-18T21:06:57.811768+0000","last_became_peered":"2024-04-18T21:06:57.811768+0000","last_unstale":"2024-04-18T21:10:04.540237+0000","last_undegraded":"2024-04-18T21:10:04.540237+0000","last_fullsized":"2024-04-18T21:10:04.540237+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":12123,"num_write":387,"num_write_kb":47157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"71'379","reported_seq":914,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.477728+0000","last_change":"2024-04-18T21:09:54.480753+0000","last_active":"2024-04-18T21:10:07.477728+0000","last_peered":"2024-04-18T21:10:07.477728+0000","last_clean":"2024-04-18T21:10:07.477728+0000","last_became_active":"2024-04-18T21:09:54.478020+0000","last_became_peered":"2024-04-18T21:09:54.478020+0000","last_unstale":"2024-04-18T21:10:07.477728+0000","last_undegraded":"2024-04-18T21:10:07.477728+0000","last_fullsized":"2024-04-18T21:10:07.477728+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:24:18.705477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":10040,"num_write":353,"num_write_kb":63202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'372","reported_seq":548,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.477334+0000","last_change":"2024-04-18T21:05:05.629321+0000","last_active":"2024-04-18T21:10:07.477334+0000","last_peered":"2024-04-18T21:10:07.477334+0000","last_clean":"2024-04-18T21:10:07.477334+0000","last_became_active":"2024-04-18T21:05:05.627956+0000","last_became_peered":"2024-04-18T21:05:05.627956+0000","last_unstale":"2024-04-18T21:10:07.477334+0000","last_undegraded":"2024-04-18T21:10:07.477334+0000","last_fullsized":"2024-04-18T21:10:07.477334+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:15:28.458476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2735,"num_write":328,"num_write_kb":22107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"71'416","reported_seq":584,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-18T21:10:04.542079+0000","last_change":"2024-04-18T21:10:00.560644+0000","last_active":"2024-04-18T21:10:04.542079+0000","last_peered":"2024-04-18T21:10:04.542079+0000","last_clean":"2024-04-18T21:10:04.542079+0000","last_became_active":"2024-04-18T21:10:00.553862+0000","last_became_peered":"2024-04-18T21:10:00.553862+0000","last_unstale":"2024-04-18T21:10:04.542079+0000","last_undegraded":"2024-04-18T21:10:04.542079+0000","last_fullsized":"2024-04-18T21:10:04.542079+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:11:49.688538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6533,"num_write":389,"num_write_kb":43666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"71'374","reported_seq":548,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478034+0000","last_change":"2024-04-18T21:10:01.495684+0000","last_active":"2024-04-18T21:10:07.478034+0000","last_peered":"2024-04-18T21:10:07.478034+0000","last_clean":"2024-04-18T21:10:07.478034+0000","last_became_active":"2024-04-18T21:10:01.486640+0000","last_became_peered":"2024-04-18T21:10:01.486640+0000","last_unstale":"2024-04-18T21:10:07.478034+0000","last_undegraded":"2024-04-18T21:10:07.478034+0000","last_fullsized":"2024-04-18T21:10:07.478034+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:39:10.639381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20415,"num_write":354,"num_write_kb":34462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'418","reported_seq":626,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.476770+0000","last_change":"2024-04-18T21:05:05.625047+0000","last_active":"2024-04-18T21:10:07.476770+0000","last_peered":"2024-04-18T21:10:07.476770+0000","last_clean":"2024-04-18T21:10:07.476770+0000","last_became_active":"2024-04-18T21:05:05.622781+0000","last_became_peered":"2024-04-18T21:05:05.622781+0000","last_unstale":"2024-04-18T21:10:07.476770+0000","last_undegraded":"2024-04-18T21:10:07.476770+0000","last_fullsized":"2024-04-18T21:10:07.476770+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:12.944469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21103,"num_write":385,"num_write_kb":50678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"71'399","reported_seq":612,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.476294+0000","last_change":"2024-04-18T21:10:00.495543+0000","last_active":"2024-04-18T21:10:07.476294+0000","last_peered":"2024-04-18T21:10:07.476294+0000","last_clean":"2024-04-18T21:10:07.476294+0000","last_became_active":"2024-04-18T21:10:00.488705+0000","last_became_peered":"2024-04-18T21:10:00.488705+0000","last_unstale":"2024-04-18T21:10:07.476294+0000","last_undegraded":"2024-04-18T21:10:07.476294+0000","last_fullsized":"2024-04-18T21:10:07.476294+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:11.892092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":44692,"num_write":361,"num_write_kb":105170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"71'385","reported_seq":924,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.480990+0000","last_change":"2024-04-18T21:10:06.487113+0000","last_active":"2024-04-18T21:10:07.480990+0000","last_peered":"2024-04-18T21:10:07.480990+0000","last_clean":"2024-04-18T21:10:07.480990+0000","last_became_active":"2024-04-18T21:10:06.482087+0000","last_became_peered":"2024-04-18T21:10:06.482087+0000","last_unstale":"2024-04-18T21:10:07.480990+0000","last_undegraded":"2024-04-18T21:10:07.480990+0000","last_fullsized":"2024-04-18T21:10:07.480990+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:10:51.435131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":994,"num_write":358,"num_write_kb":25964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'409","reported_seq":655,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.480927+0000","last_change":"2024-04-18T21:09:51.933299+0000","last_active":"2024-04-18T21:10:07.480927+0000","last_peered":"2024-04-18T21:10:07.480927+0000","last_clean":"2024-04-18T21:06:56.705266+0000","last_became_active":"2024-04-18T21:09:51.917102+0000","last_became_peered":"2024-04-18T21:09:51.917102+0000","last_unstale":"2024-04-18T21:10:07.480927+0000","last_undegraded":"2024-04-18T21:09:51.819800+0000","last_fullsized":"2024-04-18T21:09:51.800654+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":171,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":26170,"num_write":372,"num_write_kb":83931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"71'366","reported_seq":551,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478059+0000","last_change":"2024-04-18T21:10:01.496068+0000","last_active":"2024-04-18T21:10:07.478059+0000","last_peered":"2024-04-18T21:10:07.478059+0000","last_clean":"2024-04-18T21:10:07.478059+0000","last_became_active":"2024-04-18T21:10:01.488047+0000","last_became_peered":"2024-04-18T21:10:01.488047+0000","last_unstale":"2024-04-18T21:10:07.478059+0000","last_undegraded":"2024-04-18T21:10:07.478059+0000","last_fullsized":"2024-04-18T21:10:07.478059+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:49.957286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":18907,"num_write":347,"num_write_kb":26153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"71'346","reported_seq":517,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-18T21:10:04.541621+0000","last_change":"2024-04-18T21:10:00.560349+0000","last_active":"2024-04-18T21:10:04.541621+0000","last_peered":"2024-04-18T21:10:04.541621+0000","last_clean":"2024-04-18T21:10:04.541621+0000","last_became_active":"2024-04-18T21:10:00.557412+0000","last_became_peered":"2024-04-18T21:10:00.557412+0000","last_unstale":"2024-04-18T21:10:04.541621+0000","last_undegraded":"2024-04-18T21:10:04.541621+0000","last_fullsized":"2024-04-18T21:10:04.541621+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:54:33.428937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":6245,"num_write":324,"num_write_kb":37970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"71'417","reported_seq":606,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-18T21:10:04.542654+0000","last_change":"2024-04-18T21:10:02.555899+0000","last_active":"2024-04-18T21:10:04.542654+0000","last_peered":"2024-04-18T21:10:04.542654+0000","last_clean":"2024-04-18T21:10:04.542654+0000","last_became_active":"2024-04-18T21:10:02.551406+0000","last_became_peered":"2024-04-18T21:10:02.551406+0000","last_unstale":"2024-04-18T21:10:04.542654+0000","last_undegraded":"2024-04-18T21:10:04.542654+0000","last_fullsized":"2024-04-18T21:10:04.542654+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:41:17.455669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":21623,"num_write":381,"num_write_kb":71306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"71'398","reported_seq":580,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.478531+0000","last_change":"2024-04-18T21:09:52.463425+0000","last_active":"2024-04-18T21:10:07.478531+0000","last_peered":"2024-04-18T21:10:07.478531+0000","last_clean":"2024-04-18T21:06:55.780318+0000","last_became_active":"2024-04-18T21:09:51.909652+0000","last_became_peered":"2024-04-18T21:09:51.909652+0000","last_unstale":"2024-04-18T21:10:07.478531+0000","last_undegraded":"2024-04-18T21:09:52.463153+0000","last_fullsized":"2024-04-18T21:09:51.781091+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":369,"num_write_kb":30006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'435","reported_seq":723,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.477128+0000","last_change":"2024-04-18T21:10:01.504091+0000","last_active":"2024-04-18T21:10:07.477128+0000","last_peered":"2024-04-18T21:10:07.477128+0000","last_clean":"2024-04-18T21:09:48.742565+0000","last_became_active":"2024-04-18T21:10:01.499730+0000","last_became_peered":"2024-04-18T21:10:01.499730+0000","last_unstale":"2024-04-18T21:10:07.477128+0000","last_undegraded":"2024-04-18T21:10:01.482937+0000","last_fullsized":"2024-04-18T21:10:01.475971+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":173,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":31523,"num_write":402,"num_write_kb":121466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":410327,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'446","reported_seq":661,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.476315+0000","last_change":"2024-04-18T21:05:05.638203+0000","last_active":"2024-04-18T21:10:07.476315+0000","last_peered":"2024-04-18T21:10:07.476315+0000","last_clean":"2024-04-18T21:10:07.476315+0000","last_became_active":"2024-04-18T21:05:05.637352+0000","last_became_peered":"2024-04-18T21:05:05.637352+0000","last_unstale":"2024-04-18T21:10:07.476315+0000","last_undegraded":"2024-04-18T21:10:07.476315+0000","last_fullsized":"2024-04-18T21:10:07.476315+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":23833,"num_write":418,"num_write_kb":59679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"71'403","reported_seq":565,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.482255+0000","last_change":"2024-04-18T21:10:03.493121+0000","last_active":"2024-04-18T21:10:07.482255+0000","last_peered":"2024-04-18T21:10:07.482255+0000","last_clean":"2024-04-18T21:06:53.394905+0000","last_became_active":"2024-04-18T21:10:03.488943+0000","last_became_peered":"2024-04-18T21:10:03.488943+0000","last_unstale":"2024-04-18T21:10:07.482255+0000","last_undegraded":"2024-04-18T21:10:03.479306+0000","last_fullsized":"2024-04-18T21:10:03.477937+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":7482,"num_write":371,"num_write_kb":25957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'406","reported_seq":613,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.482341+0000","last_change":"2024-04-18T21:09:51.933105+0000","last_active":"2024-04-18T21:10:07.482341+0000","last_peered":"2024-04-18T21:10:07.482341+0000","last_clean":"2024-04-18T21:06:53.408988+0000","last_became_active":"2024-04-18T21:09:51.925620+0000","last_became_peered":"2024-04-18T21:09:51.925620+0000","last_unstale":"2024-04-18T21:10:07.482341+0000","last_undegraded":"2024-04-18T21:09:51.836579+0000","last_fullsized":"2024-04-18T21:09:51.831054+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":173,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":27987,"num_write":365,"num_write_kb":38689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"71'470","reported_seq":733,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.480352+0000","last_change":"2024-04-18T21:09:51.934073+0000","last_active":"2024-04-18T21:10:07.480352+0000","last_peered":"2024-04-18T21:10:07.480352+0000","last_clean":"2024-04-18T21:06:56.724047+0000","last_became_active":"2024-04-18T21:09:51.926836+0000","last_became_peered":"2024-04-18T21:09:51.926836+0000","last_unstale":"2024-04-18T21:10:07.480352+0000","last_undegraded":"2024-04-18T21:09:51.826935+0000","last_fullsized":"2024-04-18T21:09:51.811758+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":188,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":59273,"num_write":432,"num_write_kb":145930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'433","reported_seq":609,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.477460+0000","last_change":"2024-04-18T21:05:05.638338+0000","last_active":"2024-04-18T21:10:07.477460+0000","last_peered":"2024-04-18T21:10:07.477460+0000","last_clean":"2024-04-18T21:10:07.477460+0000","last_became_active":"2024-04-18T21:05:05.637567+0000","last_became_peered":"2024-04-18T21:05:05.637567+0000","last_unstale":"2024-04-18T21:10:07.477460+0000","last_undegraded":"2024-04-18T21:10:07.477460+0000","last_fullsized":"2024-04-18T21:10:07.477460+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5514,"num_write":403,"num_write_kb":26329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"71'418","reported_seq":635,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.477346+0000","last_change":"2024-04-18T21:05:05.643606+0000","last_active":"2024-04-18T21:10:07.477346+0000","last_peered":"2024-04-18T21:10:07.477346+0000","last_clean":"2024-04-18T21:10:07.477346+0000","last_became_active":"2024-04-18T21:05:05.642991+0000","last_became_peered":"2024-04-18T21:05:05.642991+0000","last_unstale":"2024-04-18T21:10:07.477346+0000","last_undegraded":"2024-04-18T21:10:07.477346+0000","last_fullsized":"2024-04-18T21:10:07.477346+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:01.841786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":29097,"num_write":386,"num_write_kb":88262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"71'479","reported_seq":720,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:04.473052+0000","last_change":"2024-04-18T21:09:52.363290+0000","last_active":"2024-04-18T21:10:04.473052+0000","last_peered":"2024-04-18T21:10:04.473052+0000","last_clean":"2024-04-18T21:06:56.736080+0000","last_became_active":"2024-04-18T21:09:51.905565+0000","last_became_peered":"2024-04-18T21:09:51.905565+0000","last_unstale":"2024-04-18T21:10:04.473052+0000","last_undegraded":"2024-04-18T21:09:52.362922+0000","last_fullsized":"2024-04-18T21:09:51.766322+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":193,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":24204,"num_write":452,"num_write_kb":114184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"71'407","reported_seq":611,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478134+0000","last_change":"2024-04-18T21:10:03.487961+0000","last_active":"2024-04-18T21:10:07.478134+0000","last_peered":"2024-04-18T21:10:07.478134+0000","last_clean":"2024-04-18T21:10:07.478134+0000","last_became_active":"2024-04-18T21:10:03.476552+0000","last_became_peered":"2024-04-18T21:10:03.476552+0000","last_unstale":"2024-04-18T21:10:07.478134+0000","last_undegraded":"2024-04-18T21:10:07.478134+0000","last_fullsized":"2024-04-18T21:10:07.478134+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:45:35.774025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":37766,"num_write":374,"num_write_kb":103984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'452","reported_seq":676,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.477807+0000","last_change":"2024-04-18T21:09:51.936910+0000","last_active":"2024-04-18T21:10:07.477807+0000","last_peered":"2024-04-18T21:10:07.477807+0000","last_clean":"2024-04-18T21:06:56.722577+0000","last_became_active":"2024-04-18T21:09:51.915967+0000","last_became_peered":"2024-04-18T21:09:51.915967+0000","last_unstale":"2024-04-18T21:10:07.477807+0000","last_undegraded":"2024-04-18T21:09:51.807076+0000","last_fullsized":"2024-04-18T21:09:51.791818+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":198,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27170,"num_write":421,"num_write_kb":39548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"71'427","reported_seq":602,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-18T21:10:04.542302+0000","last_change":"2024-04-18T21:10:03.544910+0000","last_active":"2024-04-18T21:10:04.542302+0000","last_peered":"2024-04-18T21:10:04.542302+0000","last_clean":"2024-04-18T21:10:04.542302+0000","last_became_active":"2024-04-18T21:10:03.539961+0000","last_became_peered":"2024-04-18T21:10:03.539961+0000","last_unstale":"2024-04-18T21:10:04.542302+0000","last_undegraded":"2024-04-18T21:10:04.542302+0000","last_fullsized":"2024-04-18T21:10:04.542302+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:06:34.839228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":11507,"num_write":407,"num_write_kb":50964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"71'471","reported_seq":671,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.482128+0000","last_change":"2024-04-18T21:05:05.649581+0000","last_active":"2024-04-18T21:10:07.482128+0000","last_peered":"2024-04-18T21:10:07.482128+0000","last_clean":"2024-04-18T21:10:07.482128+0000","last_became_active":"2024-04-18T21:05:05.648233+0000","last_became_peered":"2024-04-18T21:05:05.648233+0000","last_unstale":"2024-04-18T21:10:07.482128+0000","last_undegraded":"2024-04-18T21:10:07.482128+0000","last_fullsized":"2024-04-18T21:10:07.482128+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20857,"num_write":431,"num_write_kb":63677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'378","reported_seq":914,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478370+0000","last_change":"2024-04-18T21:09:55.493655+0000","last_active":"2024-04-18T21:10:07.478370+0000","last_peered":"2024-04-18T21:10:07.478370+0000","last_clean":"2024-04-18T21:10:07.478370+0000","last_became_active":"2024-04-18T21:09:55.490958+0000","last_became_peered":"2024-04-18T21:09:55.490958+0000","last_unstale":"2024-04-18T21:10:07.478370+0000","last_undegraded":"2024-04-18T21:10:07.478370+0000","last_fullsized":"2024-04-18T21:10:07.478370+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:52:16.541697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12573,"num_write":347,"num_write_kb":34434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'410","reported_seq":607,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-18T21:10:04.541451+0000","last_change":"2024-04-18T21:10:01.563947+0000","last_active":"2024-04-18T21:10:04.541451+0000","last_peered":"2024-04-18T21:10:04.541451+0000","last_clean":"2024-04-18T21:10:04.541451+0000","last_became_active":"2024-04-18T21:10:01.555367+0000","last_became_peered":"2024-04-18T21:10:01.555367+0000","last_unstale":"2024-04-18T21:10:04.541451+0000","last_undegraded":"2024-04-18T21:10:04.541451+0000","last_fullsized":"2024-04-18T21:10:04.541451+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:01:09.418419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":16926,"num_write":380,"num_write_kb":112804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"71'410","reported_seq":965,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.479229+0000","last_change":"2024-04-18T21:10:03.490605+0000","last_active":"2024-04-18T21:10:07.479229+0000","last_peered":"2024-04-18T21:10:07.479229+0000","last_clean":"2024-04-18T21:10:07.479229+0000","last_became_active":"2024-04-18T21:10:03.480985+0000","last_became_peered":"2024-04-18T21:10:03.480985+0000","last_unstale":"2024-04-18T21:10:07.479229+0000","last_undegraded":"2024-04-18T21:10:07.479229+0000","last_fullsized":"2024-04-18T21:10:07.479229+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:14:42.076110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":34811,"num_write":378,"num_write_kb":51242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'491","reported_seq":709,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:04.473764+0000","last_change":"2024-04-18T21:09:52.395780+0000","last_active":"2024-04-18T21:10:04.473764+0000","last_peered":"2024-04-18T21:10:04.473764+0000","last_clean":"2024-04-18T21:06:56.708177+0000","last_became_active":"2024-04-18T21:09:51.906206+0000","last_became_peered":"2024-04-18T21:09:51.906206+0000","last_unstale":"2024-04-18T21:10:04.473764+0000","last_undegraded":"2024-04-18T21:09:52.395404+0000","last_fullsized":"2024-04-18T21:09:51.778732+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":209,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":26902,"num_write":456,"num_write_kb":124778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"71'467","reported_seq":662,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.478242+0000","last_change":"2024-04-18T21:10:03.488499+0000","last_active":"2024-04-18T21:10:07.478242+0000","last_peered":"2024-04-18T21:10:07.478242+0000","last_clean":"2024-04-18T21:06:56.506258+0000","last_became_active":"2024-04-18T21:10:03.477945+0000","last_became_peered":"2024-04-18T21:10:03.477945+0000","last_unstale":"2024-04-18T21:10:07.478242+0000","last_undegraded":"2024-04-18T21:10:03.471107+0000","last_fullsized":"2024-04-18T21:10:03.470440+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":192,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":28114,"num_write":434,"num_write_kb":129325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'423","reported_seq":569,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.476609+0000","last_change":"2024-04-18T21:10:01.499421+0000","last_active":"2024-04-18T21:10:07.476609+0000","last_peered":"2024-04-18T21:10:07.476609+0000","last_clean":"2024-04-18T21:10:07.476609+0000","last_became_active":"2024-04-18T21:10:01.487074+0000","last_became_peered":"2024-04-18T21:10:01.487074+0000","last_unstale":"2024-04-18T21:10:07.476609+0000","last_undegraded":"2024-04-18T21:10:07.476609+0000","last_fullsized":"2024-04-18T21:10:07.476609+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:05:34.827814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8244,"num_write":393,"num_write_kb":58692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"71'389","reported_seq":586,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-18T21:10:04.540609+0000","last_change":"2024-04-18T21:09:58.542232+0000","last_active":"2024-04-18T21:10:04.540609+0000","last_peered":"2024-04-18T21:10:04.540609+0000","last_clean":"2024-04-18T21:10:04.540609+0000","last_became_active":"2024-04-18T21:09:58.537723+0000","last_became_peered":"2024-04-18T21:09:58.537723+0000","last_unstale":"2024-04-18T21:10:04.540609+0000","last_undegraded":"2024-04-18T21:10:04.540609+0000","last_fullsized":"2024-04-18T21:10:04.540609+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:26.786170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":24216,"num_write":349,"num_write_kb":43176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"70'425","reported_seq":595,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478429+0000","last_change":"2024-04-18T21:05:04.632748+0000","last_active":"2024-04-18T21:10:07.478429+0000","last_peered":"2024-04-18T21:10:07.478429+0000","last_clean":"2024-04-18T21:10:07.478429+0000","last_became_active":"2024-04-18T21:05:04.628407+0000","last_became_peered":"2024-04-18T21:05:04.628407+0000","last_unstale":"2024-04-18T21:10:07.478429+0000","last_undegraded":"2024-04-18T21:10:07.478429+0000","last_fullsized":"2024-04-18T21:10:07.478429+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:42:45.392908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":375,"num_write_kb":8348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"71'423","reported_seq":638,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.479682+0000","last_change":"2024-04-18T21:09:51.933346+0000","last_active":"2024-04-18T21:10:07.479682+0000","last_peered":"2024-04-18T21:10:07.479682+0000","last_clean":"2024-04-18T21:06:56.697536+0000","last_became_active":"2024-04-18T21:09:51.919893+0000","last_became_peered":"2024-04-18T21:09:51.919893+0000","last_unstale":"2024-04-18T21:10:07.479682+0000","last_undegraded":"2024-04-18T21:09:51.803847+0000","last_fullsized":"2024-04-18T21:09:51.783538+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":170,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":20096,"num_write":381,"num_write_kb":76351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"70'56","reported_seq":238,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478997+0000","last_change":"2024-04-18T21:10:00.500122+0000","last_active":"2024-04-18T21:10:07.478997+0000","last_peered":"2024-04-18T21:10:07.478997+0000","last_clean":"2024-04-18T21:10:07.478997+0000","last_became_active":"2024-04-18T21:10:00.489486+0000","last_became_peered":"2024-04-18T21:10:00.489486+0000","last_unstale":"2024-04-18T21:10:07.478997+0000","last_undegraded":"2024-04-18T21:10:07.478997+0000","last_fullsized":"2024-04-18T21:10:07.478997+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:58:08.269558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'442","reported_seq":1000,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.483286+0000","last_change":"2024-04-18T21:10:03.492109+0000","last_active":"2024-04-18T21:10:07.483286+0000","last_peered":"2024-04-18T21:10:07.483286+0000","last_clean":"2024-04-18T21:10:07.483286+0000","last_became_active":"2024-04-18T21:10:03.483050+0000","last_became_peered":"2024-04-18T21:10:03.483050+0000","last_unstale":"2024-04-18T21:10:07.483286+0000","last_undegraded":"2024-04-18T21:10:07.483286+0000","last_fullsized":"2024-04-18T21:10:07.483286+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:45.388623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13827,"num_write":415,"num_write_kb":79859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"70'62","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-18T21:10:04.541509+0000","last_change":"2024-04-18T21:09:50.868159+0000","last_active":"2024-04-18T21:10:04.541509+0000","last_peered":"2024-04-18T21:10:04.541509+0000","last_clean":"2024-04-18T21:10:04.541509+0000","last_became_active":"2024-04-18T21:09:50.867096+0000","last_became_peered":"2024-04-18T21:09:50.867096+0000","last_unstale":"2024-04-18T21:10:04.541509+0000","last_undegraded":"2024-04-18T21:10:04.541509+0000","last_fullsized":"2024-04-18T21:10:04.541509+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:09:57.047205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"71'398","reported_seq":613,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.481095+0000","last_change":"2024-04-18T21:10:01.498728+0000","last_active":"2024-04-18T21:10:07.481095+0000","last_peered":"2024-04-18T21:10:07.481095+0000","last_clean":"2024-04-18T21:10:07.481095+0000","last_became_active":"2024-04-18T21:10:01.495349+0000","last_became_peered":"2024-04-18T21:10:01.495349+0000","last_unstale":"2024-04-18T21:10:07.481095+0000","last_undegraded":"2024-04-18T21:10:07.481095+0000","last_fullsized":"2024-04-18T21:10:07.481095+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:01:48.618551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":17616,"num_write":360,"num_write_kb":58871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"70'66","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.477157+0000","last_change":"2024-04-18T21:10:00.496701+0000","last_active":"2024-04-18T21:10:07.477157+0000","last_peered":"2024-04-18T21:10:07.477157+0000","last_clean":"2024-04-18T21:10:07.477157+0000","last_became_active":"2024-04-18T21:10:00.495594+0000","last_became_peered":"2024-04-18T21:10:00.495594+0000","last_unstale":"2024-04-18T21:10:07.477157+0000","last_undegraded":"2024-04-18T21:10:07.477157+0000","last_fullsized":"2024-04-18T21:10:07.477157+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:11:32.991308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"70'135","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.479595+0000","last_change":"2024-04-18T21:10:00.493197+0000","last_active":"2024-04-18T21:10:07.479595+0000","last_peered":"2024-04-18T21:10:07.479595+0000","last_clean":"2024-04-18T21:10:07.479595+0000","last_became_active":"2024-04-18T21:10:00.491509+0000","last_became_peered":"2024-04-18T21:10:00.491509+0000","last_unstale":"2024-04-18T21:10:07.479595+0000","last_undegraded":"2024-04-18T21:10:07.479595+0000","last_fullsized":"2024-04-18T21:10:07.479595+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:57:29.595389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":7777508,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'410","reported_seq":962,"reported_epoch":92,"state":"active+undersized+remapped","last_fresh":"2024-04-18T21:10:04.633752+0000","last_change":"2024-04-18T21:10:04.634249+0000","last_active":"2024-04-18T21:10:04.633752+0000","last_peered":"2024-04-18T21:10:04.633752+0000","last_clean":"2024-04-18T21:06:56.729628+0000","last_became_active":"2024-04-18T21:09:51.868769+0000","last_became_peered":"2024-04-18T21:09:51.868769+0000","last_unstale":"2024-04-18T21:10:04.633752+0000","last_undegraded":"2024-04-18T21:10:04.633752+0000","last_fullsized":"2024-04-18T21:09:51.765807+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17055,"num_write":375,"num_write_kb":63331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"70'240","reported_seq":331,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-18T21:10:04.541100+0000","last_change":"2024-04-18T21:10:00.556212+0000","last_active":"2024-04-18T21:10:04.541100+0000","last_peered":"2024-04-18T21:10:04.541100+0000","last_clean":"2024-04-18T21:10:04.541100+0000","last_became_active":"2024-04-18T21:10:00.555486+0000","last_became_peered":"2024-04-18T21:10:00.555486+0000","last_unstale":"2024-04-18T21:10:04.541100+0000","last_undegraded":"2024-04-18T21:10:04.541100+0000","last_fullsized":"2024-04-18T21:10:04.541100+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:11.573984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":4191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"71'501","reported_seq":740,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.478829+0000","last_change":"2024-04-18T21:09:51.935429+0000","last_active":"2024-04-18T21:10:07.478829+0000","last_peered":"2024-04-18T21:10:07.478829+0000","last_clean":"2024-04-18T21:06:56.729630+0000","last_became_active":"2024-04-18T21:09:51.925059+0000","last_became_peered":"2024-04-18T21:09:51.925059+0000","last_unstale":"2024-04-18T21:10:07.478829+0000","last_undegraded":"2024-04-18T21:09:51.823027+0000","last_fullsized":"2024-04-18T21:09:51.807046+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":202,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":37662,"num_write":474,"num_write_kb":167663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"70'429","reported_seq":540,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478970+0000","last_change":"2024-04-18T21:10:00.493325+0000","last_active":"2024-04-18T21:10:07.478970+0000","last_peered":"2024-04-18T21:10:07.478970+0000","last_clean":"2024-04-18T21:10:07.478970+0000","last_became_active":"2024-04-18T21:10:00.491525+0000","last_became_peered":"2024-04-18T21:10:00.491525+0000","last_unstale":"2024-04-18T21:10:07.478970+0000","last_undegraded":"2024-04-18T21:10:07.478970+0000","last_fullsized":"2024-04-18T21:10:07.478970+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:27:59.637974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":377,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388678,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'440","reported_seq":624,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.479664+0000","last_change":"2024-04-18T21:10:01.497932+0000","last_active":"2024-04-18T21:10:07.479664+0000","last_peered":"2024-04-18T21:10:07.479664+0000","last_clean":"2024-04-18T21:10:07.479664+0000","last_became_active":"2024-04-18T21:10:01.486740+0000","last_became_peered":"2024-04-18T21:10:01.486740+0000","last_unstale":"2024-04-18T21:10:07.479664+0000","last_undegraded":"2024-04-18T21:10:07.479664+0000","last_fullsized":"2024-04-18T21:10:07.479664+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:34:43.515471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":42138,"num_write":408,"num_write_kb":96310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"70'59","reported_seq":229,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478177+0000","last_change":"2024-04-18T21:05:04.625520+0000","last_active":"2024-04-18T21:10:07.478177+0000","last_peered":"2024-04-18T21:10:07.478177+0000","last_clean":"2024-04-18T21:10:07.478177+0000","last_became_active":"2024-04-18T21:05:04.624656+0000","last_became_peered":"2024-04-18T21:05:04.624656+0000","last_unstale":"2024-04-18T21:10:07.478177+0000","last_undegraded":"2024-04-18T21:10:07.478177+0000","last_fullsized":"2024-04-18T21:10:07.478177+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:56:05.795125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"71'461","reported_seq":650,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478757+0000","last_change":"2024-04-18T21:05:05.649406+0000","last_active":"2024-04-18T21:10:07.478757+0000","last_peered":"2024-04-18T21:10:07.478757+0000","last_clean":"2024-04-18T21:10:07.478757+0000","last_became_active":"2024-04-18T21:05:05.648380+0000","last_became_peered":"2024-04-18T21:05:05.648380+0000","last_unstale":"2024-04-18T21:10:07.478757+0000","last_undegraded":"2024-04-18T21:10:07.478757+0000","last_fullsized":"2024-04-18T21:10:07.478757+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12852,"num_write":420,"num_write_kb":88506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"70'157","reported_seq":350,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.480178+0000","last_change":"2024-04-18T21:10:00.500141+0000","last_active":"2024-04-18T21:10:07.480178+0000","last_peered":"2024-04-18T21:10:07.480178+0000","last_clean":"2024-04-18T21:10:07.480178+0000","last_became_active":"2024-04-18T21:10:00.494630+0000","last_became_peered":"2024-04-18T21:10:00.494630+0000","last_unstale":"2024-04-18T21:10:07.480178+0000","last_undegraded":"2024-04-18T21:10:07.480178+0000","last_fullsized":"2024-04-18T21:10:07.480178+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:49:43.984354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":8250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'445","reported_seq":609,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.477666+0000","last_change":"2024-04-18T21:10:01.500937+0000","last_active":"2024-04-18T21:10:07.477666+0000","last_peered":"2024-04-18T21:10:07.477666+0000","last_clean":"2024-04-18T21:10:07.477666+0000","last_became_active":"2024-04-18T21:10:01.490691+0000","last_became_peered":"2024-04-18T21:10:01.490691+0000","last_unstale":"2024-04-18T21:10:07.477666+0000","last_undegraded":"2024-04-18T21:10:07.477666+0000","last_fullsized":"2024-04-18T21:10:07.477666+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:59:48.489145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17488,"num_write":410,"num_write_kb":50845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"70'124","reported_seq":294,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.479808+0000","last_change":"2024-04-18T21:05:04.634674+0000","last_active":"2024-04-18T21:10:07.479808+0000","last_peered":"2024-04-18T21:10:07.479808+0000","last_clean":"2024-04-18T21:10:07.479808+0000","last_became_active":"2024-04-18T21:05:04.632284+0000","last_became_peered":"2024-04-18T21:05:04.632284+0000","last_unstale":"2024-04-18T21:10:07.479808+0000","last_undegraded":"2024-04-18T21:10:07.479808+0000","last_fullsized":"2024-04-18T21:10:07.479808+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:09:18.466987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"71'400","reported_seq":559,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.478753+0000","last_change":"2024-04-18T21:10:01.502202+0000","last_active":"2024-04-18T21:10:07.478753+0000","last_peered":"2024-04-18T21:10:07.478753+0000","last_clean":"2024-04-18T21:09:48.744284+0000","last_became_active":"2024-04-18T21:10:01.496176+0000","last_became_peered":"2024-04-18T21:10:01.496176+0000","last_unstale":"2024-04-18T21:10:07.478753+0000","last_undegraded":"2024-04-18T21:10:01.486611+0000","last_fullsized":"2024-04-18T21:10:01.480189+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":175,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12586,"num_write":372,"num_write_kb":58856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":576854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"70'53","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-18T21:10:04.539503+0000","last_change":"2024-04-18T21:10:00.550936+0000","last_active":"2024-04-18T21:10:04.539503+0000","last_peered":"2024-04-18T21:10:04.539503+0000","last_clean":"2024-04-18T21:10:04.539503+0000","last_became_active":"2024-04-18T21:10:00.549987+0000","last_became_peered":"2024-04-18T21:10:00.549987+0000","last_unstale":"2024-04-18T21:10:04.539503+0000","last_undegraded":"2024-04-18T21:10:04.539503+0000","last_fullsized":"2024-04-18T21:10:04.539503+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:53:36.771516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"71'364","reported_seq":917,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478711+0000","last_change":"2024-04-18T21:09:58.478726+0000","last_active":"2024-04-18T21:10:07.478711+0000","last_peered":"2024-04-18T21:10:07.478711+0000","last_clean":"2024-04-18T21:10:07.478711+0000","last_became_active":"2024-04-18T21:09:58.473903+0000","last_became_peered":"2024-04-18T21:09:58.473903+0000","last_unstale":"2024-04-18T21:10:07.478711+0000","last_undegraded":"2024-04-18T21:10:07.478711+0000","last_fullsized":"2024-04-18T21:10:07.478711+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:40.377274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":37938,"num_write":336,"num_write_kb":42513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"70'460","reported_seq":541,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-18T21:10:04.540157+0000","last_change":"2024-04-18T21:09:53.545846+0000","last_active":"2024-04-18T21:10:04.540157+0000","last_peered":"2024-04-18T21:10:04.540157+0000","last_clean":"2024-04-18T21:10:04.540157+0000","last_became_active":"2024-04-18T21:09:53.544355+0000","last_became_peered":"2024-04-18T21:09:53.544355+0000","last_unstale":"2024-04-18T21:10:04.540157+0000","last_undegraded":"2024-04-18T21:10:04.540157+0000","last_fullsized":"2024-04-18T21:10:04.540157+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:34:16.776752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":406,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"71'404","reported_seq":597,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.481372+0000","last_change":"2024-04-18T21:09:51.933464+0000","last_active":"2024-04-18T21:10:07.481372+0000","last_peered":"2024-04-18T21:10:07.481372+0000","last_clean":"2024-04-18T21:06:56.714828+0000","last_became_active":"2024-04-18T21:09:51.918677+0000","last_became_peered":"2024-04-18T21:09:51.918677+0000","last_unstale":"2024-04-18T21:10:07.481372+0000","last_undegraded":"2024-04-18T21:09:51.824330+0000","last_fullsized":"2024-04-18T21:09:51.803729+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":174,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":7075,"num_write":367,"num_write_kb":62738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":357,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.477742+0000","last_change":"2024-04-18T21:10:00.497960+0000","last_active":"2024-04-18T21:10:07.477742+0000","last_peered":"2024-04-18T21:10:07.477742+0000","last_clean":"2024-04-18T21:10:07.477742+0000","last_became_active":"2024-04-18T21:10:00.496373+0000","last_became_peered":"2024-04-18T21:10:00.496373+0000","last_unstale":"2024-04-18T21:10:07.477742+0000","last_undegraded":"2024-04-18T21:10:07.477742+0000","last_fullsized":"2024-04-18T21:10:07.477742+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_clean_scrub_stamp":"2024-04-18T21:04:53.494814+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:56:52.975720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":133,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.479060+0000","last_change":"2024-04-18T21:10:00.487584+0000","last_active":"2024-04-18T21:10:07.479060+0000","last_peered":"2024-04-18T21:10:07.479060+0000","last_clean":"2024-04-18T21:10:07.479060+0000","last_became_active":"2024-04-18T21:10:00.486722+0000","last_became_peered":"2024-04-18T21:10:00.486722+0000","last_unstale":"2024-04-18T21:10:07.479060+0000","last_undegraded":"2024-04-18T21:10:07.479060+0000","last_fullsized":"2024-04-18T21:10:07.479060+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:17:03.176148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"70'595","reported_seq":724,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.479483+0000","last_change":"2024-04-18T21:10:03.488427+0000","last_active":"2024-04-18T21:10:07.479483+0000","last_peered":"2024-04-18T21:10:07.479483+0000","last_clean":"2024-04-18T21:10:07.479483+0000","last_became_active":"2024-04-18T21:10:03.481344+0000","last_became_peered":"2024-04-18T21:10:03.481344+0000","last_unstale":"2024-04-18T21:10:07.479483+0000","last_undegraded":"2024-04-18T21:10:07.479483+0000","last_fullsized":"2024-04-18T21:10:07.479483+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:41.583248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":539,"num_write_kb":8449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4689862,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'443","reported_seq":1063,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478684+0000","last_change":"2024-04-18T21:09:56.496310+0000","last_active":"2024-04-18T21:10:07.478684+0000","last_peered":"2024-04-18T21:10:07.478684+0000","last_clean":"2024-04-18T21:10:07.478684+0000","last_became_active":"2024-04-18T21:09:56.493327+0000","last_became_peered":"2024-04-18T21:09:56.493327+0000","last_unstale":"2024-04-18T21:10:07.478684+0000","last_undegraded":"2024-04-18T21:10:07.478684+0000","last_fullsized":"2024-04-18T21:10:07.478684+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:20:57.340997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":38975,"num_write":404,"num_write_kb":80038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":183,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.477469+0000","last_change":"2024-04-18T21:09:50.817029+0000","last_active":"2024-04-18T21:10:07.477469+0000","last_peered":"2024-04-18T21:10:07.477469+0000","last_clean":"2024-04-18T21:10:07.477469+0000","last_became_active":"2024-04-18T21:09:50.816543+0000","last_became_peered":"2024-04-18T21:09:50.816543+0000","last_unstale":"2024-04-18T21:10:07.477469+0000","last_undegraded":"2024-04-18T21:10:07.477469+0000","last_fullsized":"2024-04-18T21:10:07.477469+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:47:33.047727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"70'129","reported_seq":286,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.479217+0000","last_change":"2024-04-18T21:10:03.489109+0000","last_active":"2024-04-18T21:10:07.479217+0000","last_peered":"2024-04-18T21:10:07.479217+0000","last_clean":"2024-04-18T21:10:07.479217+0000","last_became_active":"2024-04-18T21:10:03.486859+0000","last_became_peered":"2024-04-18T21:10:03.486859+0000","last_unstale":"2024-04-18T21:10:07.479217+0000","last_undegraded":"2024-04-18T21:10:07.479217+0000","last_fullsized":"2024-04-18T21:10:07.479217+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:52:04.172480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466419,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":55,"num_read_kb":1405,"num_write":58,"num_write_kb":1469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'457","reported_seq":880,"reported_epoch":95,"state":"active+recovering+undersized+remapped","last_fresh":"2024-04-18T21:10:07.655492+0000","last_change":"2024-04-18T21:10:07.319036+0000","last_active":"2024-04-18T21:10:07.655492+0000","last_peered":"2024-04-18T21:10:07.655492+0000","last_clean":"2024-04-18T21:06:56.314380+0000","last_became_active":"2024-04-18T21:09:51.907134+0000","last_became_peered":"2024-04-18T21:09:51.907134+0000","last_unstale":"2024-04-18T21:10:07.655492+0000","last_undegraded":"2024-04-18T21:10:07.655492+0000","last_fullsized":"2024-04-18T21:09:51.803481+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":27659,"num_write":426,"num_write_kb":80500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.480273+0000","last_change":"2024-04-18T21:09:50.832624+0000","last_active":"2024-04-18T21:10:07.480273+0000","last_peered":"2024-04-18T21:10:07.480273+0000","last_clean":"2024-04-18T21:10:07.480273+0000","last_became_active":"2024-04-18T21:09:50.831949+0000","last_became_peered":"2024-04-18T21:09:50.831949+0000","last_unstale":"2024-04-18T21:10:07.480273+0000","last_undegraded":"2024-04-18T21:10:07.480273+0000","last_fullsized":"2024-04-18T21:10:07.480273+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:35:45.986029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'170","reported_seq":336,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-18T21:10:04.539385+0000","last_change":"2024-04-18T21:09:53.538615+0000","last_active":"2024-04-18T21:10:04.539385+0000","last_peered":"2024-04-18T21:10:04.539385+0000","last_clean":"2024-04-18T21:10:04.539385+0000","last_became_active":"2024-04-18T21:09:53.537994+0000","last_became_peered":"2024-04-18T21:09:53.537994+0000","last_unstale":"2024-04-18T21:10:04.539385+0000","last_undegraded":"2024-04-18T21:10:04.539385+0000","last_fullsized":"2024-04-18T21:10:04.539385+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:02:34.372453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":8239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"71'346","reported_seq":571,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.481389+0000","last_change":"2024-04-18T21:09:51.933169+0000","last_active":"2024-04-18T21:10:07.481389+0000","last_peered":"2024-04-18T21:10:07.481389+0000","last_clean":"2024-04-18T21:06:56.661266+0000","last_became_active":"2024-04-18T21:09:51.914853+0000","last_became_peered":"2024-04-18T21:09:51.914853+0000","last_unstale":"2024-04-18T21:10:07.481389+0000","last_undegraded":"2024-04-18T21:09:51.829697+0000","last_fullsized":"2024-04-18T21:09:51.816524+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":153,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27042,"num_write":321,"num_write_kb":50693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.479939+0000","last_change":"2024-04-18T21:05:00.576606+0000","last_active":"2024-04-18T21:10:07.479939+0000","last_peered":"2024-04-18T21:10:07.479939+0000","last_clean":"2024-04-18T21:10:07.479939+0000","last_became_active":"2024-04-18T21:05:00.575951+0000","last_became_peered":"2024-04-18T21:05:00.575951+0000","last_unstale":"2024-04-18T21:10:07.479939+0000","last_undegraded":"2024-04-18T21:10:07.479939+0000","last_fullsized":"2024-04-18T21:10:07.479939+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:32:17.612481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"70'63","reported_seq":233,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478716+0000","last_change":"2024-04-18T21:05:04.627296+0000","last_active":"2024-04-18T21:10:07.478716+0000","last_peered":"2024-04-18T21:10:07.478716+0000","last_clean":"2024-04-18T21:10:07.478716+0000","last_became_active":"2024-04-18T21:05:04.626801+0000","last_became_peered":"2024-04-18T21:05:04.626801+0000","last_unstale":"2024-04-18T21:10:07.478716+0000","last_undegraded":"2024-04-18T21:10:07.478716+0000","last_fullsized":"2024-04-18T21:10:07.478716+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:46:36.285416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"71'406","reported_seq":1015,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.480589+0000","last_change":"2024-04-18T21:09:59.495686+0000","last_active":"2024-04-18T21:10:07.480589+0000","last_peered":"2024-04-18T21:10:07.480589+0000","last_clean":"2024-04-18T21:10:07.480589+0000","last_became_active":"2024-04-18T21:09:59.493248+0000","last_became_peered":"2024-04-18T21:09:59.493248+0000","last_unstale":"2024-04-18T21:10:07.480589+0000","last_undegraded":"2024-04-18T21:10:07.480589+0000","last_fullsized":"2024-04-18T21:10:07.480589+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:11:23.853682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":35332,"num_write":370,"num_write_kb":71807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"70'284","reported_seq":289,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.479256+0000","last_change":"2024-04-18T21:10:00.504958+0000","last_active":"2024-04-18T21:10:07.479256+0000","last_peered":"2024-04-18T21:10:07.479256+0000","last_clean":"2024-04-18T21:10:07.479256+0000","last_became_active":"2024-04-18T21:10:00.503851+0000","last_became_peered":"2024-04-18T21:10:00.503851+0000","last_unstale":"2024-04-18T21:10:07.479256+0000","last_undegraded":"2024-04-18T21:10:07.479256+0000","last_fullsized":"2024-04-18T21:10:07.479256+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:10:27.397258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":218,"num_write_kb":4194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.480983+0000","last_change":"2024-04-18T21:10:03.484148+0000","last_active":"2024-04-18T21:10:07.480983+0000","last_peered":"2024-04-18T21:10:07.480983+0000","last_clean":"2024-04-18T21:10:07.480983+0000","last_became_active":"2024-04-18T21:10:03.480071+0000","last_became_peered":"2024-04-18T21:10:03.480071+0000","last_unstale":"2024-04-18T21:10:07.480983+0000","last_undegraded":"2024-04-18T21:10:07.480983+0000","last_fullsized":"2024-04-18T21:10:07.480983+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:50:30.257039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'386","reported_seq":587,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.476568+0000","last_change":"2024-04-18T21:09:52.430978+0000","last_active":"2024-04-18T21:10:07.476568+0000","last_peered":"2024-04-18T21:10:07.476568+0000","last_clean":"2024-04-18T21:06:56.710639+0000","last_became_active":"2024-04-18T21:09:51.908732+0000","last_became_peered":"2024-04-18T21:09:51.908732+0000","last_unstale":"2024-04-18T21:10:07.476568+0000","last_undegraded":"2024-04-18T21:09:52.430630+0000","last_fullsized":"2024-04-18T21:09:51.772520+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":166,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14677,"num_write":355,"num_write_kb":51018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"70'55","reported_seq":231,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.480986+0000","last_change":"2024-04-18T21:09:50.833424+0000","last_active":"2024-04-18T21:10:07.480986+0000","last_peered":"2024-04-18T21:10:07.480986+0000","last_clean":"2024-04-18T21:10:07.480986+0000","last_became_active":"2024-04-18T21:09:50.832752+0000","last_became_peered":"2024-04-18T21:09:50.832752+0000","last_unstale":"2024-04-18T21:10:07.480986+0000","last_undegraded":"2024-04-18T21:10:07.480986+0000","last_fullsized":"2024-04-18T21:10:07.480986+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:48.945329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":133,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-18T21:10:04.542146+0000","last_change":"2024-04-18T21:09:50.900338+0000","last_active":"2024-04-18T21:10:04.542146+0000","last_peered":"2024-04-18T21:10:04.542146+0000","last_clean":"2024-04-18T21:10:04.542146+0000","last_became_active":"2024-04-18T21:09:50.896844+0000","last_became_peered":"2024-04-18T21:09:50.896844+0000","last_unstale":"2024-04-18T21:10:04.542146+0000","last_undegraded":"2024-04-18T21:10:04.542146+0000","last_fullsized":"2024-04-18T21:10:04.542146+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:11:35.543409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"71'402","reported_seq":553,"reported_epoch":92,"state":"peering","last_fresh":"2024-04-18T21:10:04.540261+0000","last_change":"2024-04-18T21:10:04.540261+0000","last_active":"2024-04-18T21:09:50.769501+0000","last_peered":"2024-04-18T21:09:48.744886+0000","last_clean":"2024-04-18T21:06:55.789400+0000","last_became_active":"2024-04-18T21:06:57.810487+0000","last_became_peered":"2024-04-18T21:06:57.810487+0000","last_unstale":"2024-04-18T21:10:04.540261+0000","last_undegraded":"2024-04-18T21:10:04.540261+0000","last_fullsized":"2024-04-18T21:10:04.540261+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12468,"num_write":369,"num_write_kb":67231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"70'60","reported_seq":237,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.482521+0000","last_change":"2024-04-18T21:09:50.832598+0000","last_active":"2024-04-18T21:10:07.482521+0000","last_peered":"2024-04-18T21:10:07.482521+0000","last_clean":"2024-04-18T21:10:07.482521+0000","last_became_active":"2024-04-18T21:09:50.832030+0000","last_became_peered":"2024-04-18T21:09:50.832030+0000","last_unstale":"2024-04-18T21:10:07.482521+0000","last_undegraded":"2024-04-18T21:10:07.482521+0000","last_fullsized":"2024-04-18T21:10:07.482521+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:10:27.397258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.483586+0000","last_change":"2024-04-18T21:10:03.492761+0000","last_active":"2024-04-18T21:10:07.483586+0000","last_peered":"2024-04-18T21:10:07.483586+0000","last_clean":"2024-04-18T21:10:07.483586+0000","last_became_active":"2024-04-18T21:10:03.492145+0000","last_became_peered":"2024-04-18T21:10:03.492145+0000","last_unstale":"2024-04-18T21:10:07.483586+0000","last_undegraded":"2024-04-18T21:10:07.483586+0000","last_fullsized":"2024-04-18T21:10:07.483586+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:20:00.853523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'421","reported_seq":602,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.479646+0000","last_change":"2024-04-18T21:10:03.488774+0000","last_active":"2024-04-18T21:10:07.479646+0000","last_peered":"2024-04-18T21:10:07.479646+0000","last_clean":"2024-04-18T21:10:07.479646+0000","last_became_active":"2024-04-18T21:10:03.479773+0000","last_became_peered":"2024-04-18T21:10:03.479773+0000","last_unstale":"2024-04-18T21:10:07.479646+0000","last_undegraded":"2024-04-18T21:10:07.479646+0000","last_fullsized":"2024-04-18T21:10:07.479646+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:15:12.326904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":16183,"num_write":377,"num_write_kb":50451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"71'110","reported_seq":299,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.483583+0000","last_change":"2024-04-18T21:10:00.497917+0000","last_active":"2024-04-18T21:10:07.483583+0000","last_peered":"2024-04-18T21:10:07.483583+0000","last_clean":"2024-04-18T21:10:07.483583+0000","last_became_active":"2024-04-18T21:10:00.494644+0000","last_became_peered":"2024-04-18T21:10:00.494644+0000","last_unstale":"2024-04-18T21:10:07.483583+0000","last_undegraded":"2024-04-18T21:10:07.483583+0000","last_fullsized":"2024-04-18T21:10:07.483583+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:40:57.347353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":1251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":134,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.479598+0000","last_change":"2024-04-18T21:10:00.493764+0000","last_active":"2024-04-18T21:10:07.479598+0000","last_peered":"2024-04-18T21:10:07.479598+0000","last_clean":"2024-04-18T21:10:07.479598+0000","last_became_active":"2024-04-18T21:10:00.492672+0000","last_became_peered":"2024-04-18T21:10:00.492672+0000","last_unstale":"2024-04-18T21:10:07.479598+0000","last_undegraded":"2024-04-18T21:10:07.479598+0000","last_fullsized":"2024-04-18T21:10:07.479598+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:48:46.709401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'384","reported_seq":565,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-18T21:10:04.540220+0000","last_change":"2024-04-18T21:09:57.572865+0000","last_active":"2024-04-18T21:10:04.540220+0000","last_peered":"2024-04-18T21:10:04.540220+0000","last_clean":"2024-04-18T21:10:04.540220+0000","last_became_active":"2024-04-18T21:09:57.567962+0000","last_became_peered":"2024-04-18T21:09:57.567962+0000","last_unstale":"2024-04-18T21:10:04.540220+0000","last_undegraded":"2024-04-18T21:10:04.540220+0000","last_fullsized":"2024-04-18T21:10:04.540220+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:51:24.627186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":15567,"num_write":351,"num_write_kb":42959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"71'396","reported_seq":549,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.478153+0000","last_change":"2024-04-18T21:10:01.500036+0000","last_active":"2024-04-18T21:10:07.478153+0000","last_peered":"2024-04-18T21:10:07.478153+0000","last_clean":"2024-04-18T21:09:48.743028+0000","last_became_active":"2024-04-18T21:10:01.492175+0000","last_became_peered":"2024-04-18T21:10:01.492175+0000","last_unstale":"2024-04-18T21:10:07.478153+0000","last_undegraded":"2024-04-18T21:10:01.483082+0000","last_fullsized":"2024-04-18T21:10:01.476438+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":171,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12943,"num_write":353,"num_write_kb":35357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":3500882,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"71'277","reported_seq":292,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.477963+0000","last_change":"2024-04-18T21:10:00.495047+0000","last_active":"2024-04-18T21:10:07.477963+0000","last_peered":"2024-04-18T21:10:07.477963+0000","last_clean":"2024-04-18T21:10:07.477963+0000","last_became_active":"2024-04-18T21:10:00.493088+0000","last_became_peered":"2024-04-18T21:10:00.493088+0000","last_unstale":"2024-04-18T21:10:07.477963+0000","last_undegraded":"2024-04-18T21:10:07.477963+0000","last_fullsized":"2024-04-18T21:10:07.477963+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:39:08.263781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":221,"num_write_kb":8303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":8389370,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'411","reported_seq":981,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478348+0000","last_change":"2024-04-18T21:10:04.485332+0000","last_active":"2024-04-18T21:10:07.478348+0000","last_peered":"2024-04-18T21:10:07.478348+0000","last_clean":"2024-04-18T21:10:07.478348+0000","last_became_active":"2024-04-18T21:10:04.482320+0000","last_became_peered":"2024-04-18T21:10:04.482320+0000","last_unstale":"2024-04-18T21:10:07.478348+0000","last_undegraded":"2024-04-18T21:10:07.478348+0000","last_fullsized":"2024-04-18T21:10:07.478348+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:35:57.043682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":17179,"num_write":375,"num_write_kb":38991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"70'85","reported_seq":136,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-18T21:10:04.541699+0000","last_change":"2024-04-18T21:09:50.890616+0000","last_active":"2024-04-18T21:10:04.541699+0000","last_peered":"2024-04-18T21:10:04.541699+0000","last_clean":"2024-04-18T21:10:04.541699+0000","last_became_active":"2024-04-18T21:09:50.874855+0000","last_became_peered":"2024-04-18T21:09:50.874855+0000","last_unstale":"2024-04-18T21:10:04.541699+0000","last_undegraded":"2024-04-18T21:10:04.541699+0000","last_fullsized":"2024-04-18T21:10:04.541699+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:03:54.726282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"70'230","reported_seq":233,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.479167+0000","last_change":"2024-04-18T21:10:00.499373+0000","last_active":"2024-04-18T21:10:07.479167+0000","last_peered":"2024-04-18T21:10:07.479167+0000","last_clean":"2024-04-18T21:10:07.479167+0000","last_became_active":"2024-04-18T21:10:00.498141+0000","last_became_peered":"2024-04-18T21:10:00.498141+0000","last_unstale":"2024-04-18T21:10:07.479167+0000","last_undegraded":"2024-04-18T21:10:07.479167+0000","last_fullsized":"2024-04-18T21:10:07.479167+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:55:01.865593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":4178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"71'493","reported_seq":706,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478522+0000","last_change":"2024-04-18T21:05:05.642793+0000","last_active":"2024-04-18T21:10:07.478522+0000","last_peered":"2024-04-18T21:10:07.478522+0000","last_clean":"2024-04-18T21:10:07.478522+0000","last_became_active":"2024-04-18T21:05:05.641983+0000","last_became_peered":"2024-04-18T21:05:05.641983+0000","last_unstale":"2024-04-18T21:10:07.478522+0000","last_undegraded":"2024-04-18T21:10:07.478522+0000","last_fullsized":"2024-04-18T21:10:07.478522+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:46:36.339289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23833,"num_write":461,"num_write_kb":76873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"70'62","reported_seq":231,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.482063+0000","last_change":"2024-04-18T21:05:04.641445+0000","last_active":"2024-04-18T21:10:07.482063+0000","last_peered":"2024-04-18T21:10:07.482063+0000","last_clean":"2024-04-18T21:10:07.482063+0000","last_became_active":"2024-04-18T21:05:04.640682+0000","last_became_peered":"2024-04-18T21:05:04.640682+0000","last_unstale":"2024-04-18T21:10:07.482063+0000","last_undegraded":"2024-04-18T21:10:07.482063+0000","last_fullsized":"2024-04-18T21:10:07.482063+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:46:36.285416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'436","reported_seq":644,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.478935+0000","last_change":"2024-04-18T21:09:51.937322+0000","last_active":"2024-04-18T21:10:07.478935+0000","last_peered":"2024-04-18T21:10:07.478935+0000","last_clean":"2024-04-18T21:06:56.761407+0000","last_became_active":"2024-04-18T21:09:51.933205+0000","last_became_peered":"2024-04-18T21:09:51.933205+0000","last_unstale":"2024-04-18T21:10:07.478935+0000","last_undegraded":"2024-04-18T21:09:51.833249+0000","last_fullsized":"2024-04-18T21:09:51.824946+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":193,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14561,"num_write":408,"num_write_kb":47462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'369","reported_seq":539,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-18T21:10:04.542468+0000","last_change":"2024-04-18T21:10:02.553999+0000","last_active":"2024-04-18T21:10:04.542468+0000","last_peered":"2024-04-18T21:10:04.542468+0000","last_clean":"2024-04-18T21:10:04.542468+0000","last_became_active":"2024-04-18T21:10:02.549471+0000","last_became_peered":"2024-04-18T21:10:02.549471+0000","last_unstale":"2024-04-18T21:10:04.542468+0000","last_undegraded":"2024-04-18T21:10:04.542468+0000","last_fullsized":"2024-04-18T21:10:04.542468+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:52:14.371235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13619,"num_write":339,"num_write_kb":63086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"70'888","reported_seq":1004,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.480032+0000","last_change":"2024-04-18T21:10:03.486911+0000","last_active":"2024-04-18T21:10:07.480032+0000","last_peered":"2024-04-18T21:10:07.480032+0000","last_clean":"2024-04-18T21:10:07.480032+0000","last_became_active":"2024-04-18T21:10:03.480576+0000","last_became_peered":"2024-04-18T21:10:03.480576+0000","last_unstale":"2024-04-18T21:10:07.480032+0000","last_undegraded":"2024-04-18T21:10:07.480032+0000","last_fullsized":"2024-04-18T21:10:07.480032+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:41:06.632064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":823,"num_write_kb":8582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'398","reported_seq":536,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.481860+0000","last_change":"2024-04-18T21:10:03.491426+0000","last_active":"2024-04-18T21:10:07.481860+0000","last_peered":"2024-04-18T21:10:07.481860+0000","last_clean":"2024-04-18T21:10:07.481860+0000","last_became_active":"2024-04-18T21:10:03.483190+0000","last_became_peered":"2024-04-18T21:10:03.483190+0000","last_unstale":"2024-04-18T21:10:07.481860+0000","last_undegraded":"2024-04-18T21:10:07.481860+0000","last_fullsized":"2024-04-18T21:10:07.481860+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:05:10.611580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14684,"num_write":380,"num_write_kb":88822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"70'169","reported_seq":358,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478915+0000","last_change":"2024-04-18T21:10:00.494974+0000","last_active":"2024-04-18T21:10:07.478915+0000","last_peered":"2024-04-18T21:10:07.478915+0000","last_clean":"2024-04-18T21:10:07.478915+0000","last_became_active":"2024-04-18T21:10:00.492196+0000","last_became_peered":"2024-04-18T21:10:00.492196+0000","last_unstale":"2024-04-18T21:10:07.478915+0000","last_undegraded":"2024-04-18T21:10:07.478915+0000","last_fullsized":"2024-04-18T21:10:07.478915+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:33:51.236211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":4162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'406","reported_seq":644,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.477513+0000","last_change":"2024-04-18T21:09:52.500269+0000","last_active":"2024-04-18T21:10:07.477513+0000","last_peered":"2024-04-18T21:10:07.477513+0000","last_clean":"2024-04-18T21:06:56.583905+0000","last_became_active":"2024-04-18T21:09:51.914607+0000","last_became_peered":"2024-04-18T21:09:51.914607+0000","last_unstale":"2024-04-18T21:10:07.477513+0000","last_undegraded":"2024-04-18T21:09:52.499843+0000","last_fullsized":"2024-04-18T21:09:51.772504+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":165,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27495,"num_write":363,"num_write_kb":89134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"72'192","reported_seq":353,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-18T21:10:04.540703+0000","last_change":"2024-04-18T21:09:53.541766+0000","last_active":"2024-04-18T21:10:04.540703+0000","last_peered":"2024-04-18T21:10:04.540703+0000","last_clean":"2024-04-18T21:10:04.540703+0000","last_became_active":"2024-04-18T21:09:53.541300+0000","last_became_peered":"2024-04-18T21:09:53.541300+0000","last_unstale":"2024-04-18T21:10:04.540703+0000","last_undegraded":"2024-04-18T21:10:04.540703+0000","last_fullsized":"2024-04-18T21:10:04.540703+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:26:14.718922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12425030,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":12201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8230726,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"71'383","reported_seq":585,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-18T21:10:04.541046+0000","last_change":"2024-04-18T21:09:55.555798+0000","last_active":"2024-04-18T21:10:04.541046+0000","last_peered":"2024-04-18T21:10:04.541046+0000","last_clean":"2024-04-18T21:10:04.541046+0000","last_became_active":"2024-04-18T21:09:55.551135+0000","last_became_peered":"2024-04-18T21:09:55.551135+0000","last_unstale":"2024-04-18T21:10:04.541046+0000","last_undegraded":"2024-04-18T21:10:04.541046+0000","last_fullsized":"2024-04-18T21:10:04.541046+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:00:01.739082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21614,"num_write":351,"num_write_kb":79501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"70'66","reported_seq":127,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-18T21:10:04.541717+0000","last_change":"2024-04-18T21:10:00.553114+0000","last_active":"2024-04-18T21:10:04.541717+0000","last_peered":"2024-04-18T21:10:04.541717+0000","last_clean":"2024-04-18T21:10:04.541717+0000","last_became_active":"2024-04-18T21:10:00.552067+0000","last_became_peered":"2024-04-18T21:10:00.552067+0000","last_unstale":"2024-04-18T21:10:04.541717+0000","last_undegraded":"2024-04-18T21:10:04.541717+0000","last_fullsized":"2024-04-18T21:10:04.541717+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:51:32.567297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"71'345","reported_seq":520,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.477790+0000","last_change":"2024-04-18T21:05:05.624840+0000","last_active":"2024-04-18T21:10:07.477790+0000","last_peered":"2024-04-18T21:10:07.477790+0000","last_clean":"2024-04-18T21:10:07.477790+0000","last_became_active":"2024-04-18T21:05:05.622950+0000","last_became_peered":"2024-04-18T21:05:05.622950+0000","last_unstale":"2024-04-18T21:10:07.477790+0000","last_undegraded":"2024-04-18T21:10:07.477790+0000","last_fullsized":"2024-04-18T21:10:07.477790+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:27:17.530889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":317,"num_write_kb":29335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"70'171","reported_seq":260,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.477750+0000","last_change":"2024-04-18T21:10:00.507624+0000","last_active":"2024-04-18T21:10:07.477750+0000","last_peered":"2024-04-18T21:10:07.477750+0000","last_clean":"2024-04-18T21:10:07.477750+0000","last_became_active":"2024-04-18T21:10:00.507132+0000","last_became_peered":"2024-04-18T21:10:00.507132+0000","last_unstale":"2024-04-18T21:10:07.477750+0000","last_undegraded":"2024-04-18T21:10:07.477750+0000","last_fullsized":"2024-04-18T21:10:07.477750+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:35:50.013019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":4154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"71'417","reported_seq":617,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.479514+0000","last_change":"2024-04-18T21:05:05.627962+0000","last_active":"2024-04-18T21:10:07.479514+0000","last_peered":"2024-04-18T21:10:07.479514+0000","last_clean":"2024-04-18T21:10:07.479514+0000","last_became_active":"2024-04-18T21:05:05.626698+0000","last_became_peered":"2024-04-18T21:05:05.626698+0000","last_unstale":"2024-04-18T21:10:07.479514+0000","last_undegraded":"2024-04-18T21:10:07.479514+0000","last_fullsized":"2024-04-18T21:10:07.479514+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:48:48.973087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":17040,"num_write":384,"num_write_kb":83740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"70'276","reported_seq":439,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-18T21:10:04.540480+0000","last_change":"2024-04-18T21:09:53.543611+0000","last_active":"2024-04-18T21:10:04.540480+0000","last_peered":"2024-04-18T21:10:04.540480+0000","last_clean":"2024-04-18T21:10:04.540480+0000","last_became_active":"2024-04-18T21:09:53.542863+0000","last_became_peered":"2024-04-18T21:09:53.542863+0000","last_unstale":"2024-04-18T21:10:04.540480+0000","last_undegraded":"2024-04-18T21:10:04.540480+0000","last_fullsized":"2024-04-18T21:10:04.540480+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:22.582074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":12399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"71'428","reported_seq":634,"reported_epoch":92,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:04.475031+0000","last_change":"2024-04-18T21:09:51.930418+0000","last_active":"2024-04-18T21:10:04.475031+0000","last_peered":"2024-04-18T21:10:04.475031+0000","last_clean":"2024-04-18T21:06:56.466371+0000","last_became_active":"2024-04-18T21:09:51.913729+0000","last_became_peered":"2024-04-18T21:09:51.913729+0000","last_unstale":"2024-04-18T21:10:04.475031+0000","last_undegraded":"2024-04-18T21:09:51.830860+0000","last_fullsized":"2024-04-18T21:09:51.824803+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":186,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22548,"num_write":398,"num_write_kb":75972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"70'70","reported_seq":247,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.482404+0000","last_change":"2024-04-18T21:09:50.833350+0000","last_active":"2024-04-18T21:10:07.482404+0000","last_peered":"2024-04-18T21:10:07.482404+0000","last_clean":"2024-04-18T21:10:07.482404+0000","last_became_active":"2024-04-18T21:09:50.832355+0000","last_became_peered":"2024-04-18T21:09:50.832355+0000","last_unstale":"2024-04-18T21:10:07.482404+0000","last_undegraded":"2024-04-18T21:10:07.482404+0000","last_fullsized":"2024-04-18T21:10:07.482404+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:39:09.627425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'459","reported_seq":616,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.476880+0000","last_change":"2024-04-18T21:10:01.503378+0000","last_active":"2024-04-18T21:10:07.476880+0000","last_peered":"2024-04-18T21:10:07.476880+0000","last_clean":"2024-04-18T21:10:07.476880+0000","last_became_active":"2024-04-18T21:10:01.497275+0000","last_became_peered":"2024-04-18T21:10:01.497275+0000","last_unstale":"2024-04-18T21:10:07.476880+0000","last_undegraded":"2024-04-18T21:10:07.476880+0000","last_fullsized":"2024-04-18T21:10:07.476880+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:40:35.832428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13353,"num_write":429,"num_write_kb":88123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"70'113","reported_seq":306,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.481828+0000","last_change":"2024-04-18T21:10:00.499468+0000","last_active":"2024-04-18T21:10:07.481828+0000","last_peered":"2024-04-18T21:10:07.481828+0000","last_clean":"2024-04-18T21:10:07.481828+0000","last_became_active":"2024-04-18T21:10:00.494734+0000","last_became_peered":"2024-04-18T21:10:00.494734+0000","last_unstale":"2024-04-18T21:10:07.481828+0000","last_undegraded":"2024-04-18T21:10:07.481828+0000","last_fullsized":"2024-04-18T21:10:07.481828+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:58:34.790588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194886,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3792,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2531,"num_read_kb":1304649,"num_write":24542,"num_write_kb":4299443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3900,"num_bytes_recovered":4488063,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":169492480,"data_stored":160471692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26603,"ondisk_log_size":26603,"up":128,"acting":105,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127139127,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":55,"num_read_kb":1405,"num_write":4542,"num_write_kb":127514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":92002768,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":279527424,"data_stored":279444842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4409,"internal_metadata":0},"log_size":6331,"ondisk_log_size":6331,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738436,"num_pgs":84,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":208484,"kb_used_data":105176,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94163356,"statfs":{"total":96636764160,"available":96423276544,"internally_reserved":0,"allocated":107700224,"data_stored":107174746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":77,"seq":330712481797,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":292120,"kb_used_data":250440,"kb_used_omap":5,"kb_used_meta":41658,"kb_avail":94079720,"statfs":{"total":96636764160,"available":96337633280,"internally_reserved":0,"allocated":256450560,"data_stored":246469226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6004,"internal_metadata":42657932},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738434,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":160340,"kb_used_data":88960,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94211500,"statfs":{"total":96636764160,"available":96472576000,"internally_reserved":0,"allocated":91095040,"data_stored":90560267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":89579520,"data_stored":89548273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":83750912,"data_stored":83729052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4409,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106196992,"data_stored":106167517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":169492480,"data_stored":160471692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:10:09.041 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-18T21:10:09.431 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:10:09.431 INFO:teuthology.orchestra.run.smithi078.stdout:{"fsid":"dc017990-0393-4ab0-b604-5e7052fdc7bd","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 3985/108 objects degraded (3689.815%), 22 pgs degraded","count":22},"muted":false}},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":325,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":96,"num_osds":3,"num_up_osds":3,"osd_up_since":1713474589,"num_in_osds":3,"osd_in_since":1713474284,"num_remapped_pgs":18},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":79},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":22},{"state_name":"peering","count":2},{"state_name":"active+undersized+remapped","count":1},{"state_name":"active+recovering+undersized+remapped","count":1}],"num_pgs":105,"num_pools":4,"num_objects":54,"data_bytes":127729495,"bytes_used":676732928,"bytes_avail":289233559552,"bytes_total":289910292480,"inactive_pgs_ratio":0.01904761977493763,"degraded_objects":3985,"degraded_total":108,"degraded_ratio":36.898148148148145,"recovering_objects_per_sec":422,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":1690,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4202}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-04-18T21:06:12.521737+0000","services":{}},"progress_events":{}} 2024-04-18T21:10:09.451 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-04-18T21:10:09.451 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:10:09.744 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:10:09.745 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-04-18T21:10:09.760 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":253,"stamp":"2024-04-18T21:10:09.466460+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127729495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3204,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2722,"num_read_kb":1306172,"num_write":29287,"num_write_kb":4430417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4785,"num_bytes_recovered":97081199,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33091,"ondisk_log_size":33091,"up":210,"acting":192,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":222,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":611660,"kb_used_data":399448,"kb_used_omap":8,"kb_used_meta":212151,"kb_avail":282503860,"statfs":{"total":289910292480,"available":289283952640,"internally_reserved":0,"allocated":409034752,"data_stored":400661289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9194,"internal_metadata":217242646},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-781,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":948,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.996300"},"pg_stats":[{"pgid":"4.3f","version":"71'418","reported_seq":633,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.481984+0000","last_change":"2024-04-18T21:09:51.933769+0000","last_active":"2024-04-18T21:10:07.481984+0000","last_peered":"2024-04-18T21:10:07.481984+0000","last_clean":"2024-04-18T21:06:56.295490+0000","last_became_active":"2024-04-18T21:09:51.925977+0000","last_became_peered":"2024-04-18T21:09:51.925977+0000","last_unstale":"2024-04-18T21:10:07.481984+0000","last_undegraded":"2024-04-18T21:09:51.837482+0000","last_fullsized":"2024-04-18T21:09:51.829450+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":19677,"num_write":386,"num_write_kb":87615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"71'417","reported_seq":607,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.534086+0000","last_change":"2024-04-18T21:10:05.546965+0000","last_active":"2024-04-18T21:10:08.534086+0000","last_peered":"2024-04-18T21:10:08.534086+0000","last_clean":"2024-04-18T21:10:08.534086+0000","last_became_active":"2024-04-18T21:10:05.541170+0000","last_became_peered":"2024-04-18T21:10:05.541170+0000","last_unstale":"2024-04-18T21:10:08.534086+0000","last_undegraded":"2024-04-18T21:10:08.534086+0000","last_fullsized":"2024-04-18T21:10:08.534086+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:04:05.630763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":12123,"num_write":387,"num_write_kb":47157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"71'379","reported_seq":914,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.477728+0000","last_change":"2024-04-18T21:09:54.480753+0000","last_active":"2024-04-18T21:10:07.477728+0000","last_peered":"2024-04-18T21:10:07.477728+0000","last_clean":"2024-04-18T21:10:07.477728+0000","last_became_active":"2024-04-18T21:09:54.478020+0000","last_became_peered":"2024-04-18T21:09:54.478020+0000","last_unstale":"2024-04-18T21:10:07.477728+0000","last_undegraded":"2024-04-18T21:10:07.477728+0000","last_fullsized":"2024-04-18T21:10:07.477728+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:24:18.705477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":10040,"num_write":353,"num_write_kb":63202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'372","reported_seq":548,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.477334+0000","last_change":"2024-04-18T21:05:05.629321+0000","last_active":"2024-04-18T21:10:07.477334+0000","last_peered":"2024-04-18T21:10:07.477334+0000","last_clean":"2024-04-18T21:10:07.477334+0000","last_became_active":"2024-04-18T21:05:05.627956+0000","last_became_peered":"2024-04-18T21:05:05.627956+0000","last_unstale":"2024-04-18T21:10:07.477334+0000","last_undegraded":"2024-04-18T21:10:07.477334+0000","last_fullsized":"2024-04-18T21:10:07.477334+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:15:28.458476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2735,"num_write":328,"num_write_kb":22107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"71'416","reported_seq":592,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.533227+0000","last_change":"2024-04-18T21:10:00.560644+0000","last_active":"2024-04-18T21:10:08.533227+0000","last_peered":"2024-04-18T21:10:08.533227+0000","last_clean":"2024-04-18T21:10:08.533227+0000","last_became_active":"2024-04-18T21:10:00.553862+0000","last_became_peered":"2024-04-18T21:10:00.553862+0000","last_unstale":"2024-04-18T21:10:08.533227+0000","last_undegraded":"2024-04-18T21:10:08.533227+0000","last_fullsized":"2024-04-18T21:10:08.533227+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:11:49.688538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6533,"num_write":389,"num_write_kb":43666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"71'374","reported_seq":548,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478034+0000","last_change":"2024-04-18T21:10:01.495684+0000","last_active":"2024-04-18T21:10:07.478034+0000","last_peered":"2024-04-18T21:10:07.478034+0000","last_clean":"2024-04-18T21:10:07.478034+0000","last_became_active":"2024-04-18T21:10:01.486640+0000","last_became_peered":"2024-04-18T21:10:01.486640+0000","last_unstale":"2024-04-18T21:10:07.478034+0000","last_undegraded":"2024-04-18T21:10:07.478034+0000","last_fullsized":"2024-04-18T21:10:07.478034+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:39:10.639381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20415,"num_write":354,"num_write_kb":34462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'418","reported_seq":626,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.476770+0000","last_change":"2024-04-18T21:05:05.625047+0000","last_active":"2024-04-18T21:10:07.476770+0000","last_peered":"2024-04-18T21:10:07.476770+0000","last_clean":"2024-04-18T21:10:07.476770+0000","last_became_active":"2024-04-18T21:05:05.622781+0000","last_became_peered":"2024-04-18T21:05:05.622781+0000","last_unstale":"2024-04-18T21:10:07.476770+0000","last_undegraded":"2024-04-18T21:10:07.476770+0000","last_fullsized":"2024-04-18T21:10:07.476770+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:12.944469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21103,"num_write":385,"num_write_kb":50678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"71'399","reported_seq":612,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.476294+0000","last_change":"2024-04-18T21:10:00.495543+0000","last_active":"2024-04-18T21:10:07.476294+0000","last_peered":"2024-04-18T21:10:07.476294+0000","last_clean":"2024-04-18T21:10:07.476294+0000","last_became_active":"2024-04-18T21:10:00.488705+0000","last_became_peered":"2024-04-18T21:10:00.488705+0000","last_unstale":"2024-04-18T21:10:07.476294+0000","last_undegraded":"2024-04-18T21:10:07.476294+0000","last_fullsized":"2024-04-18T21:10:07.476294+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:11.892092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":44692,"num_write":361,"num_write_kb":105170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"71'385","reported_seq":924,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.480990+0000","last_change":"2024-04-18T21:10:06.487113+0000","last_active":"2024-04-18T21:10:07.480990+0000","last_peered":"2024-04-18T21:10:07.480990+0000","last_clean":"2024-04-18T21:10:07.480990+0000","last_became_active":"2024-04-18T21:10:06.482087+0000","last_became_peered":"2024-04-18T21:10:06.482087+0000","last_unstale":"2024-04-18T21:10:07.480990+0000","last_undegraded":"2024-04-18T21:10:07.480990+0000","last_fullsized":"2024-04-18T21:10:07.480990+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:10:51.435131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":994,"num_write":358,"num_write_kb":25964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'409","reported_seq":655,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.480927+0000","last_change":"2024-04-18T21:09:51.933299+0000","last_active":"2024-04-18T21:10:07.480927+0000","last_peered":"2024-04-18T21:10:07.480927+0000","last_clean":"2024-04-18T21:06:56.705266+0000","last_became_active":"2024-04-18T21:09:51.917102+0000","last_became_peered":"2024-04-18T21:09:51.917102+0000","last_unstale":"2024-04-18T21:10:07.480927+0000","last_undegraded":"2024-04-18T21:09:51.819800+0000","last_fullsized":"2024-04-18T21:09:51.800654+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":171,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":26170,"num_write":372,"num_write_kb":83931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"71'366","reported_seq":551,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478059+0000","last_change":"2024-04-18T21:10:01.496068+0000","last_active":"2024-04-18T21:10:07.478059+0000","last_peered":"2024-04-18T21:10:07.478059+0000","last_clean":"2024-04-18T21:10:07.478059+0000","last_became_active":"2024-04-18T21:10:01.488047+0000","last_became_peered":"2024-04-18T21:10:01.488047+0000","last_unstale":"2024-04-18T21:10:07.478059+0000","last_undegraded":"2024-04-18T21:10:07.478059+0000","last_fullsized":"2024-04-18T21:10:07.478059+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:49.957286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":18907,"num_write":347,"num_write_kb":26153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"71'346","reported_seq":525,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.533271+0000","last_change":"2024-04-18T21:10:00.560349+0000","last_active":"2024-04-18T21:10:08.533271+0000","last_peered":"2024-04-18T21:10:08.533271+0000","last_clean":"2024-04-18T21:10:08.533271+0000","last_became_active":"2024-04-18T21:10:00.557412+0000","last_became_peered":"2024-04-18T21:10:00.557412+0000","last_unstale":"2024-04-18T21:10:08.533271+0000","last_undegraded":"2024-04-18T21:10:08.533271+0000","last_fullsized":"2024-04-18T21:10:08.533271+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:54:33.428937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":6245,"num_write":324,"num_write_kb":37970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"71'417","reported_seq":614,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.533573+0000","last_change":"2024-04-18T21:10:02.555899+0000","last_active":"2024-04-18T21:10:08.533573+0000","last_peered":"2024-04-18T21:10:08.533573+0000","last_clean":"2024-04-18T21:10:08.533573+0000","last_became_active":"2024-04-18T21:10:02.551406+0000","last_became_peered":"2024-04-18T21:10:02.551406+0000","last_unstale":"2024-04-18T21:10:08.533573+0000","last_undegraded":"2024-04-18T21:10:08.533573+0000","last_fullsized":"2024-04-18T21:10:08.533573+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:41:17.455669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":21623,"num_write":381,"num_write_kb":71306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"71'398","reported_seq":580,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.478531+0000","last_change":"2024-04-18T21:09:52.463425+0000","last_active":"2024-04-18T21:10:07.478531+0000","last_peered":"2024-04-18T21:10:07.478531+0000","last_clean":"2024-04-18T21:06:55.780318+0000","last_became_active":"2024-04-18T21:09:51.909652+0000","last_became_peered":"2024-04-18T21:09:51.909652+0000","last_unstale":"2024-04-18T21:10:07.478531+0000","last_undegraded":"2024-04-18T21:09:52.463153+0000","last_fullsized":"2024-04-18T21:09:51.781091+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":369,"num_write_kb":30006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'435","reported_seq":723,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.477128+0000","last_change":"2024-04-18T21:10:01.504091+0000","last_active":"2024-04-18T21:10:07.477128+0000","last_peered":"2024-04-18T21:10:07.477128+0000","last_clean":"2024-04-18T21:09:48.742565+0000","last_became_active":"2024-04-18T21:10:01.499730+0000","last_became_peered":"2024-04-18T21:10:01.499730+0000","last_unstale":"2024-04-18T21:10:07.477128+0000","last_undegraded":"2024-04-18T21:10:01.482937+0000","last_fullsized":"2024-04-18T21:10:01.475971+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":173,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":31523,"num_write":402,"num_write_kb":121466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":410327,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'446","reported_seq":661,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.476315+0000","last_change":"2024-04-18T21:05:05.638203+0000","last_active":"2024-04-18T21:10:07.476315+0000","last_peered":"2024-04-18T21:10:07.476315+0000","last_clean":"2024-04-18T21:10:07.476315+0000","last_became_active":"2024-04-18T21:05:05.637352+0000","last_became_peered":"2024-04-18T21:05:05.637352+0000","last_unstale":"2024-04-18T21:10:07.476315+0000","last_undegraded":"2024-04-18T21:10:07.476315+0000","last_fullsized":"2024-04-18T21:10:07.476315+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":23833,"num_write":418,"num_write_kb":59679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"71'403","reported_seq":565,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.482255+0000","last_change":"2024-04-18T21:10:03.493121+0000","last_active":"2024-04-18T21:10:07.482255+0000","last_peered":"2024-04-18T21:10:07.482255+0000","last_clean":"2024-04-18T21:06:53.394905+0000","last_became_active":"2024-04-18T21:10:03.488943+0000","last_became_peered":"2024-04-18T21:10:03.488943+0000","last_unstale":"2024-04-18T21:10:07.482255+0000","last_undegraded":"2024-04-18T21:10:03.479306+0000","last_fullsized":"2024-04-18T21:10:03.477937+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":7482,"num_write":371,"num_write_kb":25957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'406","reported_seq":613,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.482341+0000","last_change":"2024-04-18T21:09:51.933105+0000","last_active":"2024-04-18T21:10:07.482341+0000","last_peered":"2024-04-18T21:10:07.482341+0000","last_clean":"2024-04-18T21:06:53.408988+0000","last_became_active":"2024-04-18T21:09:51.925620+0000","last_became_peered":"2024-04-18T21:09:51.925620+0000","last_unstale":"2024-04-18T21:10:07.482341+0000","last_undegraded":"2024-04-18T21:09:51.836579+0000","last_fullsized":"2024-04-18T21:09:51.831054+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":173,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":27987,"num_write":365,"num_write_kb":38689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"71'470","reported_seq":733,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.480352+0000","last_change":"2024-04-18T21:09:51.934073+0000","last_active":"2024-04-18T21:10:07.480352+0000","last_peered":"2024-04-18T21:10:07.480352+0000","last_clean":"2024-04-18T21:06:56.724047+0000","last_became_active":"2024-04-18T21:09:51.926836+0000","last_became_peered":"2024-04-18T21:09:51.926836+0000","last_unstale":"2024-04-18T21:10:07.480352+0000","last_undegraded":"2024-04-18T21:09:51.826935+0000","last_fullsized":"2024-04-18T21:09:51.811758+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":188,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":59273,"num_write":432,"num_write_kb":145930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'433","reported_seq":609,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.477460+0000","last_change":"2024-04-18T21:05:05.638338+0000","last_active":"2024-04-18T21:10:07.477460+0000","last_peered":"2024-04-18T21:10:07.477460+0000","last_clean":"2024-04-18T21:10:07.477460+0000","last_became_active":"2024-04-18T21:05:05.637567+0000","last_became_peered":"2024-04-18T21:05:05.637567+0000","last_unstale":"2024-04-18T21:10:07.477460+0000","last_undegraded":"2024-04-18T21:10:07.477460+0000","last_fullsized":"2024-04-18T21:10:07.477460+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5514,"num_write":403,"num_write_kb":26329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"71'418","reported_seq":635,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.477346+0000","last_change":"2024-04-18T21:05:05.643606+0000","last_active":"2024-04-18T21:10:07.477346+0000","last_peered":"2024-04-18T21:10:07.477346+0000","last_clean":"2024-04-18T21:10:07.477346+0000","last_became_active":"2024-04-18T21:05:05.642991+0000","last_became_peered":"2024-04-18T21:05:05.642991+0000","last_unstale":"2024-04-18T21:10:07.477346+0000","last_undegraded":"2024-04-18T21:10:07.477346+0000","last_fullsized":"2024-04-18T21:10:07.477346+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:01.841786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":29097,"num_write":386,"num_write_kb":88262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"71'479","reported_seq":698,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.532595+0000","last_change":"2024-04-18T21:10:07.549995+0000","last_active":"2024-04-18T21:10:08.532595+0000","last_peered":"2024-04-18T21:10:08.532595+0000","last_clean":"2024-04-18T21:10:08.532595+0000","last_became_active":"2024-04-18T21:10:07.544314+0000","last_became_peered":"2024-04-18T21:10:07.544314+0000","last_unstale":"2024-04-18T21:10:08.532595+0000","last_undegraded":"2024-04-18T21:10:08.532595+0000","last_fullsized":"2024-04-18T21:10:08.532595+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:52:34.340348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":24204,"num_write":452,"num_write_kb":114184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"71'407","reported_seq":611,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478134+0000","last_change":"2024-04-18T21:10:03.487961+0000","last_active":"2024-04-18T21:10:07.478134+0000","last_peered":"2024-04-18T21:10:07.478134+0000","last_clean":"2024-04-18T21:10:07.478134+0000","last_became_active":"2024-04-18T21:10:03.476552+0000","last_became_peered":"2024-04-18T21:10:03.476552+0000","last_unstale":"2024-04-18T21:10:07.478134+0000","last_undegraded":"2024-04-18T21:10:07.478134+0000","last_fullsized":"2024-04-18T21:10:07.478134+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:45:35.774025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":37766,"num_write":374,"num_write_kb":103984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'452","reported_seq":676,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.477807+0000","last_change":"2024-04-18T21:09:51.936910+0000","last_active":"2024-04-18T21:10:07.477807+0000","last_peered":"2024-04-18T21:10:07.477807+0000","last_clean":"2024-04-18T21:06:56.722577+0000","last_became_active":"2024-04-18T21:09:51.915967+0000","last_became_peered":"2024-04-18T21:09:51.915967+0000","last_unstale":"2024-04-18T21:10:07.477807+0000","last_undegraded":"2024-04-18T21:09:51.807076+0000","last_fullsized":"2024-04-18T21:09:51.791818+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":198,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27170,"num_write":421,"num_write_kb":39548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"71'427","reported_seq":610,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.534261+0000","last_change":"2024-04-18T21:10:03.544910+0000","last_active":"2024-04-18T21:10:08.534261+0000","last_peered":"2024-04-18T21:10:08.534261+0000","last_clean":"2024-04-18T21:10:08.534261+0000","last_became_active":"2024-04-18T21:10:03.539961+0000","last_became_peered":"2024-04-18T21:10:03.539961+0000","last_unstale":"2024-04-18T21:10:08.534261+0000","last_undegraded":"2024-04-18T21:10:08.534261+0000","last_fullsized":"2024-04-18T21:10:08.534261+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:06:34.839228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":11507,"num_write":407,"num_write_kb":50964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"71'471","reported_seq":671,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.482128+0000","last_change":"2024-04-18T21:05:05.649581+0000","last_active":"2024-04-18T21:10:07.482128+0000","last_peered":"2024-04-18T21:10:07.482128+0000","last_clean":"2024-04-18T21:10:07.482128+0000","last_became_active":"2024-04-18T21:05:05.648233+0000","last_became_peered":"2024-04-18T21:05:05.648233+0000","last_unstale":"2024-04-18T21:10:07.482128+0000","last_undegraded":"2024-04-18T21:10:07.482128+0000","last_fullsized":"2024-04-18T21:10:07.482128+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20857,"num_write":431,"num_write_kb":63677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'378","reported_seq":914,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478370+0000","last_change":"2024-04-18T21:09:55.493655+0000","last_active":"2024-04-18T21:10:07.478370+0000","last_peered":"2024-04-18T21:10:07.478370+0000","last_clean":"2024-04-18T21:10:07.478370+0000","last_became_active":"2024-04-18T21:09:55.490958+0000","last_became_peered":"2024-04-18T21:09:55.490958+0000","last_unstale":"2024-04-18T21:10:07.478370+0000","last_undegraded":"2024-04-18T21:10:07.478370+0000","last_fullsized":"2024-04-18T21:10:07.478370+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:52:16.541697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12573,"num_write":347,"num_write_kb":34434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'410","reported_seq":615,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.533182+0000","last_change":"2024-04-18T21:10:01.563947+0000","last_active":"2024-04-18T21:10:08.533182+0000","last_peered":"2024-04-18T21:10:08.533182+0000","last_clean":"2024-04-18T21:10:08.533182+0000","last_became_active":"2024-04-18T21:10:01.555367+0000","last_became_peered":"2024-04-18T21:10:01.555367+0000","last_unstale":"2024-04-18T21:10:08.533182+0000","last_undegraded":"2024-04-18T21:10:08.533182+0000","last_fullsized":"2024-04-18T21:10:08.533182+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:01:09.418419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":16926,"num_write":380,"num_write_kb":112804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"71'410","reported_seq":965,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.479229+0000","last_change":"2024-04-18T21:10:03.490605+0000","last_active":"2024-04-18T21:10:07.479229+0000","last_peered":"2024-04-18T21:10:07.479229+0000","last_clean":"2024-04-18T21:10:07.479229+0000","last_became_active":"2024-04-18T21:10:03.480985+0000","last_became_peered":"2024-04-18T21:10:03.480985+0000","last_unstale":"2024-04-18T21:10:07.479229+0000","last_undegraded":"2024-04-18T21:10:07.479229+0000","last_fullsized":"2024-04-18T21:10:07.479229+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:14:42.076110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":34811,"num_write":378,"num_write_kb":51242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'491","reported_seq":685,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.546388+0000","last_change":"2024-04-18T21:10:08.546388+0000","last_active":"2024-04-18T21:10:08.546388+0000","last_peered":"2024-04-18T21:10:08.546388+0000","last_clean":"2024-04-18T21:10:08.546388+0000","last_became_active":"2024-04-18T21:10:08.540487+0000","last_became_peered":"2024-04-18T21:10:08.540487+0000","last_unstale":"2024-04-18T21:10:08.546388+0000","last_undegraded":"2024-04-18T21:10:08.546388+0000","last_fullsized":"2024-04-18T21:10:08.546388+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:15:51.120517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":26902,"num_write":456,"num_write_kb":124778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":209,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"71'467","reported_seq":662,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.478242+0000","last_change":"2024-04-18T21:10:03.488499+0000","last_active":"2024-04-18T21:10:07.478242+0000","last_peered":"2024-04-18T21:10:07.478242+0000","last_clean":"2024-04-18T21:06:56.506258+0000","last_became_active":"2024-04-18T21:10:03.477945+0000","last_became_peered":"2024-04-18T21:10:03.477945+0000","last_unstale":"2024-04-18T21:10:07.478242+0000","last_undegraded":"2024-04-18T21:10:03.471107+0000","last_fullsized":"2024-04-18T21:10:03.470440+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":192,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":28114,"num_write":434,"num_write_kb":129325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'423","reported_seq":569,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.476609+0000","last_change":"2024-04-18T21:10:01.499421+0000","last_active":"2024-04-18T21:10:07.476609+0000","last_peered":"2024-04-18T21:10:07.476609+0000","last_clean":"2024-04-18T21:10:07.476609+0000","last_became_active":"2024-04-18T21:10:01.487074+0000","last_became_peered":"2024-04-18T21:10:01.487074+0000","last_unstale":"2024-04-18T21:10:07.476609+0000","last_undegraded":"2024-04-18T21:10:07.476609+0000","last_fullsized":"2024-04-18T21:10:07.476609+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:05:34.827814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8244,"num_write":393,"num_write_kb":58692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"71'389","reported_seq":594,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.532328+0000","last_change":"2024-04-18T21:09:58.542232+0000","last_active":"2024-04-18T21:10:08.532328+0000","last_peered":"2024-04-18T21:10:08.532328+0000","last_clean":"2024-04-18T21:10:08.532328+0000","last_became_active":"2024-04-18T21:09:58.537723+0000","last_became_peered":"2024-04-18T21:09:58.537723+0000","last_unstale":"2024-04-18T21:10:08.532328+0000","last_undegraded":"2024-04-18T21:10:08.532328+0000","last_fullsized":"2024-04-18T21:10:08.532328+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:26.786170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":24216,"num_write":349,"num_write_kb":43176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"70'425","reported_seq":595,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478429+0000","last_change":"2024-04-18T21:05:04.632748+0000","last_active":"2024-04-18T21:10:07.478429+0000","last_peered":"2024-04-18T21:10:07.478429+0000","last_clean":"2024-04-18T21:10:07.478429+0000","last_became_active":"2024-04-18T21:05:04.628407+0000","last_became_peered":"2024-04-18T21:05:04.628407+0000","last_unstale":"2024-04-18T21:10:07.478429+0000","last_undegraded":"2024-04-18T21:10:07.478429+0000","last_fullsized":"2024-04-18T21:10:07.478429+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:42:45.392908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":375,"num_write_kb":8348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"71'423","reported_seq":638,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.479682+0000","last_change":"2024-04-18T21:09:51.933346+0000","last_active":"2024-04-18T21:10:07.479682+0000","last_peered":"2024-04-18T21:10:07.479682+0000","last_clean":"2024-04-18T21:06:56.697536+0000","last_became_active":"2024-04-18T21:09:51.919893+0000","last_became_peered":"2024-04-18T21:09:51.919893+0000","last_unstale":"2024-04-18T21:10:07.479682+0000","last_undegraded":"2024-04-18T21:09:51.803847+0000","last_fullsized":"2024-04-18T21:09:51.783538+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":170,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":20096,"num_write":381,"num_write_kb":76351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"70'56","reported_seq":238,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478997+0000","last_change":"2024-04-18T21:10:00.500122+0000","last_active":"2024-04-18T21:10:07.478997+0000","last_peered":"2024-04-18T21:10:07.478997+0000","last_clean":"2024-04-18T21:10:07.478997+0000","last_became_active":"2024-04-18T21:10:00.489486+0000","last_became_peered":"2024-04-18T21:10:00.489486+0000","last_unstale":"2024-04-18T21:10:07.478997+0000","last_undegraded":"2024-04-18T21:10:07.478997+0000","last_fullsized":"2024-04-18T21:10:07.478997+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:58:08.269558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'442","reported_seq":1000,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.483286+0000","last_change":"2024-04-18T21:10:03.492109+0000","last_active":"2024-04-18T21:10:07.483286+0000","last_peered":"2024-04-18T21:10:07.483286+0000","last_clean":"2024-04-18T21:10:07.483286+0000","last_became_active":"2024-04-18T21:10:03.483050+0000","last_became_peered":"2024-04-18T21:10:03.483050+0000","last_unstale":"2024-04-18T21:10:07.483286+0000","last_undegraded":"2024-04-18T21:10:07.483286+0000","last_fullsized":"2024-04-18T21:10:07.483286+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:45.388623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13827,"num_write":415,"num_write_kb":79859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"70'62","reported_seq":56,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.531679+0000","last_change":"2024-04-18T21:09:50.868159+0000","last_active":"2024-04-18T21:10:08.531679+0000","last_peered":"2024-04-18T21:10:08.531679+0000","last_clean":"2024-04-18T21:10:08.531679+0000","last_became_active":"2024-04-18T21:09:50.867096+0000","last_became_peered":"2024-04-18T21:09:50.867096+0000","last_unstale":"2024-04-18T21:10:08.531679+0000","last_undegraded":"2024-04-18T21:10:08.531679+0000","last_fullsized":"2024-04-18T21:10:08.531679+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:09:57.047205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"71'398","reported_seq":613,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.481095+0000","last_change":"2024-04-18T21:10:01.498728+0000","last_active":"2024-04-18T21:10:07.481095+0000","last_peered":"2024-04-18T21:10:07.481095+0000","last_clean":"2024-04-18T21:10:07.481095+0000","last_became_active":"2024-04-18T21:10:01.495349+0000","last_became_peered":"2024-04-18T21:10:01.495349+0000","last_unstale":"2024-04-18T21:10:07.481095+0000","last_undegraded":"2024-04-18T21:10:07.481095+0000","last_fullsized":"2024-04-18T21:10:07.481095+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:01:48.618551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":17616,"num_write":360,"num_write_kb":58871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"70'66","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.477157+0000","last_change":"2024-04-18T21:10:00.496701+0000","last_active":"2024-04-18T21:10:07.477157+0000","last_peered":"2024-04-18T21:10:07.477157+0000","last_clean":"2024-04-18T21:10:07.477157+0000","last_became_active":"2024-04-18T21:10:00.495594+0000","last_became_peered":"2024-04-18T21:10:00.495594+0000","last_unstale":"2024-04-18T21:10:07.477157+0000","last_undegraded":"2024-04-18T21:10:07.477157+0000","last_fullsized":"2024-04-18T21:10:07.477157+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:11:32.991308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"70'135","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.479595+0000","last_change":"2024-04-18T21:10:00.493197+0000","last_active":"2024-04-18T21:10:07.479595+0000","last_peered":"2024-04-18T21:10:07.479595+0000","last_clean":"2024-04-18T21:10:07.479595+0000","last_became_active":"2024-04-18T21:10:00.491509+0000","last_became_peered":"2024-04-18T21:10:00.491509+0000","last_unstale":"2024-04-18T21:10:07.479595+0000","last_undegraded":"2024-04-18T21:10:07.479595+0000","last_fullsized":"2024-04-18T21:10:07.479595+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:57:29.595389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":7777508,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'410","reported_seq":586,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.531933+0000","last_change":"2024-04-18T21:10:06.553806+0000","last_active":"2024-04-18T21:10:08.531933+0000","last_peered":"2024-04-18T21:10:08.531933+0000","last_clean":"2024-04-18T21:10:08.531933+0000","last_became_active":"2024-04-18T21:10:06.548034+0000","last_became_peered":"2024-04-18T21:10:06.548034+0000","last_unstale":"2024-04-18T21:10:08.531933+0000","last_undegraded":"2024-04-18T21:10:08.531933+0000","last_fullsized":"2024-04-18T21:10:08.531933+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:20:56.265941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17055,"num_write":375,"num_write_kb":63331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"70'240","reported_seq":339,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.532585+0000","last_change":"2024-04-18T21:10:00.556212+0000","last_active":"2024-04-18T21:10:08.532585+0000","last_peered":"2024-04-18T21:10:08.532585+0000","last_clean":"2024-04-18T21:10:08.532585+0000","last_became_active":"2024-04-18T21:10:00.555486+0000","last_became_peered":"2024-04-18T21:10:00.555486+0000","last_unstale":"2024-04-18T21:10:08.532585+0000","last_undegraded":"2024-04-18T21:10:08.532585+0000","last_fullsized":"2024-04-18T21:10:08.532585+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:11.573984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":4191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"71'501","reported_seq":740,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.478829+0000","last_change":"2024-04-18T21:09:51.935429+0000","last_active":"2024-04-18T21:10:07.478829+0000","last_peered":"2024-04-18T21:10:07.478829+0000","last_clean":"2024-04-18T21:06:56.729630+0000","last_became_active":"2024-04-18T21:09:51.925059+0000","last_became_peered":"2024-04-18T21:09:51.925059+0000","last_unstale":"2024-04-18T21:10:07.478829+0000","last_undegraded":"2024-04-18T21:09:51.823027+0000","last_fullsized":"2024-04-18T21:09:51.807046+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":202,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":37662,"num_write":474,"num_write_kb":167663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"70'429","reported_seq":540,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478970+0000","last_change":"2024-04-18T21:10:00.493325+0000","last_active":"2024-04-18T21:10:07.478970+0000","last_peered":"2024-04-18T21:10:07.478970+0000","last_clean":"2024-04-18T21:10:07.478970+0000","last_became_active":"2024-04-18T21:10:00.491525+0000","last_became_peered":"2024-04-18T21:10:00.491525+0000","last_unstale":"2024-04-18T21:10:07.478970+0000","last_undegraded":"2024-04-18T21:10:07.478970+0000","last_fullsized":"2024-04-18T21:10:07.478970+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:27:59.637974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":377,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388678,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'440","reported_seq":624,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.479664+0000","last_change":"2024-04-18T21:10:01.497932+0000","last_active":"2024-04-18T21:10:07.479664+0000","last_peered":"2024-04-18T21:10:07.479664+0000","last_clean":"2024-04-18T21:10:07.479664+0000","last_became_active":"2024-04-18T21:10:01.486740+0000","last_became_peered":"2024-04-18T21:10:01.486740+0000","last_unstale":"2024-04-18T21:10:07.479664+0000","last_undegraded":"2024-04-18T21:10:07.479664+0000","last_fullsized":"2024-04-18T21:10:07.479664+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:34:43.515471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":42138,"num_write":408,"num_write_kb":96310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"70'59","reported_seq":229,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478177+0000","last_change":"2024-04-18T21:05:04.625520+0000","last_active":"2024-04-18T21:10:07.478177+0000","last_peered":"2024-04-18T21:10:07.478177+0000","last_clean":"2024-04-18T21:10:07.478177+0000","last_became_active":"2024-04-18T21:05:04.624656+0000","last_became_peered":"2024-04-18T21:05:04.624656+0000","last_unstale":"2024-04-18T21:10:07.478177+0000","last_undegraded":"2024-04-18T21:10:07.478177+0000","last_fullsized":"2024-04-18T21:10:07.478177+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:56:05.795125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"71'461","reported_seq":650,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478757+0000","last_change":"2024-04-18T21:05:05.649406+0000","last_active":"2024-04-18T21:10:07.478757+0000","last_peered":"2024-04-18T21:10:07.478757+0000","last_clean":"2024-04-18T21:10:07.478757+0000","last_became_active":"2024-04-18T21:05:05.648380+0000","last_became_peered":"2024-04-18T21:05:05.648380+0000","last_unstale":"2024-04-18T21:10:07.478757+0000","last_undegraded":"2024-04-18T21:10:07.478757+0000","last_fullsized":"2024-04-18T21:10:07.478757+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12852,"num_write":420,"num_write_kb":88506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"70'157","reported_seq":350,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.480178+0000","last_change":"2024-04-18T21:10:00.500141+0000","last_active":"2024-04-18T21:10:07.480178+0000","last_peered":"2024-04-18T21:10:07.480178+0000","last_clean":"2024-04-18T21:10:07.480178+0000","last_became_active":"2024-04-18T21:10:00.494630+0000","last_became_peered":"2024-04-18T21:10:00.494630+0000","last_unstale":"2024-04-18T21:10:07.480178+0000","last_undegraded":"2024-04-18T21:10:07.480178+0000","last_fullsized":"2024-04-18T21:10:07.480178+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:49:43.984354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":8250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'445","reported_seq":609,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.477666+0000","last_change":"2024-04-18T21:10:01.500937+0000","last_active":"2024-04-18T21:10:07.477666+0000","last_peered":"2024-04-18T21:10:07.477666+0000","last_clean":"2024-04-18T21:10:07.477666+0000","last_became_active":"2024-04-18T21:10:01.490691+0000","last_became_peered":"2024-04-18T21:10:01.490691+0000","last_unstale":"2024-04-18T21:10:07.477666+0000","last_undegraded":"2024-04-18T21:10:07.477666+0000","last_fullsized":"2024-04-18T21:10:07.477666+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:59:48.489145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17488,"num_write":410,"num_write_kb":50845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"70'124","reported_seq":294,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.479808+0000","last_change":"2024-04-18T21:05:04.634674+0000","last_active":"2024-04-18T21:10:07.479808+0000","last_peered":"2024-04-18T21:10:07.479808+0000","last_clean":"2024-04-18T21:10:07.479808+0000","last_became_active":"2024-04-18T21:05:04.632284+0000","last_became_peered":"2024-04-18T21:05:04.632284+0000","last_unstale":"2024-04-18T21:10:07.479808+0000","last_undegraded":"2024-04-18T21:10:07.479808+0000","last_fullsized":"2024-04-18T21:10:07.479808+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:09:18.466987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"71'400","reported_seq":559,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.478753+0000","last_change":"2024-04-18T21:10:01.502202+0000","last_active":"2024-04-18T21:10:07.478753+0000","last_peered":"2024-04-18T21:10:07.478753+0000","last_clean":"2024-04-18T21:09:48.744284+0000","last_became_active":"2024-04-18T21:10:01.496176+0000","last_became_peered":"2024-04-18T21:10:01.496176+0000","last_unstale":"2024-04-18T21:10:07.478753+0000","last_undegraded":"2024-04-18T21:10:01.486611+0000","last_fullsized":"2024-04-18T21:10:01.480189+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":175,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12586,"num_write":372,"num_write_kb":58856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":576854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"70'53","reported_seq":58,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.531340+0000","last_change":"2024-04-18T21:10:00.550936+0000","last_active":"2024-04-18T21:10:08.531340+0000","last_peered":"2024-04-18T21:10:08.531340+0000","last_clean":"2024-04-18T21:10:08.531340+0000","last_became_active":"2024-04-18T21:10:00.549987+0000","last_became_peered":"2024-04-18T21:10:00.549987+0000","last_unstale":"2024-04-18T21:10:08.531340+0000","last_undegraded":"2024-04-18T21:10:08.531340+0000","last_fullsized":"2024-04-18T21:10:08.531340+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:53:36.771516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"71'364","reported_seq":917,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478711+0000","last_change":"2024-04-18T21:09:58.478726+0000","last_active":"2024-04-18T21:10:07.478711+0000","last_peered":"2024-04-18T21:10:07.478711+0000","last_clean":"2024-04-18T21:10:07.478711+0000","last_became_active":"2024-04-18T21:09:58.473903+0000","last_became_peered":"2024-04-18T21:09:58.473903+0000","last_unstale":"2024-04-18T21:10:07.478711+0000","last_undegraded":"2024-04-18T21:10:07.478711+0000","last_fullsized":"2024-04-18T21:10:07.478711+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:40.377274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":37938,"num_write":336,"num_write_kb":42513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"70'460","reported_seq":549,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.531721+0000","last_change":"2024-04-18T21:09:53.545846+0000","last_active":"2024-04-18T21:10:08.531721+0000","last_peered":"2024-04-18T21:10:08.531721+0000","last_clean":"2024-04-18T21:10:08.531721+0000","last_became_active":"2024-04-18T21:09:53.544355+0000","last_became_peered":"2024-04-18T21:09:53.544355+0000","last_unstale":"2024-04-18T21:10:08.531721+0000","last_undegraded":"2024-04-18T21:10:08.531721+0000","last_fullsized":"2024-04-18T21:10:08.531721+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:34:16.776752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":406,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"71'404","reported_seq":597,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.481372+0000","last_change":"2024-04-18T21:09:51.933464+0000","last_active":"2024-04-18T21:10:07.481372+0000","last_peered":"2024-04-18T21:10:07.481372+0000","last_clean":"2024-04-18T21:06:56.714828+0000","last_became_active":"2024-04-18T21:09:51.918677+0000","last_became_peered":"2024-04-18T21:09:51.918677+0000","last_unstale":"2024-04-18T21:10:07.481372+0000","last_undegraded":"2024-04-18T21:09:51.824330+0000","last_fullsized":"2024-04-18T21:09:51.803729+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":174,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":7075,"num_write":367,"num_write_kb":62738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":357,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.477742+0000","last_change":"2024-04-18T21:10:00.497960+0000","last_active":"2024-04-18T21:10:07.477742+0000","last_peered":"2024-04-18T21:10:07.477742+0000","last_clean":"2024-04-18T21:10:07.477742+0000","last_became_active":"2024-04-18T21:10:00.496373+0000","last_became_peered":"2024-04-18T21:10:00.496373+0000","last_unstale":"2024-04-18T21:10:07.477742+0000","last_undegraded":"2024-04-18T21:10:07.477742+0000","last_fullsized":"2024-04-18T21:10:07.477742+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_clean_scrub_stamp":"2024-04-18T21:04:53.494814+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:56:52.975720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":133,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.479060+0000","last_change":"2024-04-18T21:10:00.487584+0000","last_active":"2024-04-18T21:10:07.479060+0000","last_peered":"2024-04-18T21:10:07.479060+0000","last_clean":"2024-04-18T21:10:07.479060+0000","last_became_active":"2024-04-18T21:10:00.486722+0000","last_became_peered":"2024-04-18T21:10:00.486722+0000","last_unstale":"2024-04-18T21:10:07.479060+0000","last_undegraded":"2024-04-18T21:10:07.479060+0000","last_fullsized":"2024-04-18T21:10:07.479060+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:17:03.176148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"70'595","reported_seq":724,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.479483+0000","last_change":"2024-04-18T21:10:03.488427+0000","last_active":"2024-04-18T21:10:07.479483+0000","last_peered":"2024-04-18T21:10:07.479483+0000","last_clean":"2024-04-18T21:10:07.479483+0000","last_became_active":"2024-04-18T21:10:03.481344+0000","last_became_peered":"2024-04-18T21:10:03.481344+0000","last_unstale":"2024-04-18T21:10:07.479483+0000","last_undegraded":"2024-04-18T21:10:07.479483+0000","last_fullsized":"2024-04-18T21:10:07.479483+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:41.583248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":539,"num_write_kb":8449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4689862,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'443","reported_seq":1063,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478684+0000","last_change":"2024-04-18T21:09:56.496310+0000","last_active":"2024-04-18T21:10:07.478684+0000","last_peered":"2024-04-18T21:10:07.478684+0000","last_clean":"2024-04-18T21:10:07.478684+0000","last_became_active":"2024-04-18T21:09:56.493327+0000","last_became_peered":"2024-04-18T21:09:56.493327+0000","last_unstale":"2024-04-18T21:10:07.478684+0000","last_undegraded":"2024-04-18T21:10:07.478684+0000","last_fullsized":"2024-04-18T21:10:07.478684+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:20:57.340997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":38975,"num_write":404,"num_write_kb":80038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":183,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.477469+0000","last_change":"2024-04-18T21:09:50.817029+0000","last_active":"2024-04-18T21:10:07.477469+0000","last_peered":"2024-04-18T21:10:07.477469+0000","last_clean":"2024-04-18T21:10:07.477469+0000","last_became_active":"2024-04-18T21:09:50.816543+0000","last_became_peered":"2024-04-18T21:09:50.816543+0000","last_unstale":"2024-04-18T21:10:07.477469+0000","last_undegraded":"2024-04-18T21:10:07.477469+0000","last_fullsized":"2024-04-18T21:10:07.477469+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:47:33.047727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"70'129","reported_seq":286,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.479217+0000","last_change":"2024-04-18T21:10:03.489109+0000","last_active":"2024-04-18T21:10:07.479217+0000","last_peered":"2024-04-18T21:10:07.479217+0000","last_clean":"2024-04-18T21:10:07.479217+0000","last_became_active":"2024-04-18T21:10:03.486859+0000","last_became_peered":"2024-04-18T21:10:03.486859+0000","last_unstale":"2024-04-18T21:10:07.479217+0000","last_undegraded":"2024-04-18T21:10:07.479217+0000","last_fullsized":"2024-04-18T21:10:07.479217+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:52:04.172480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466419,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":55,"num_read_kb":1405,"num_write":58,"num_write_kb":1469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'457","reported_seq":650,"reported_epoch":96,"state":"peering","last_fresh":"2024-04-18T21:10:08.535238+0000","last_change":"2024-04-18T21:10:08.535238+0000","last_active":"2024-04-18T21:09:50.773277+0000","last_peered":"2024-04-18T21:09:48.745635+0000","last_clean":"2024-04-18T21:06:56.314380+0000","last_became_active":"2024-04-18T21:06:57.813208+0000","last_became_peered":"2024-04-18T21:06:57.813208+0000","last_unstale":"2024-04-18T21:10:08.535238+0000","last_undegraded":"2024-04-18T21:10:08.535238+0000","last_fullsized":"2024-04-18T21:10:08.535238+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":27659,"num_write":426,"num_write_kb":80500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.480273+0000","last_change":"2024-04-18T21:09:50.832624+0000","last_active":"2024-04-18T21:10:07.480273+0000","last_peered":"2024-04-18T21:10:07.480273+0000","last_clean":"2024-04-18T21:10:07.480273+0000","last_became_active":"2024-04-18T21:09:50.831949+0000","last_became_peered":"2024-04-18T21:09:50.831949+0000","last_unstale":"2024-04-18T21:10:07.480273+0000","last_undegraded":"2024-04-18T21:10:07.480273+0000","last_fullsized":"2024-04-18T21:10:07.480273+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:35:45.986029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'170","reported_seq":344,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.531147+0000","last_change":"2024-04-18T21:09:53.538615+0000","last_active":"2024-04-18T21:10:08.531147+0000","last_peered":"2024-04-18T21:10:08.531147+0000","last_clean":"2024-04-18T21:10:08.531147+0000","last_became_active":"2024-04-18T21:09:53.537994+0000","last_became_peered":"2024-04-18T21:09:53.537994+0000","last_unstale":"2024-04-18T21:10:08.531147+0000","last_undegraded":"2024-04-18T21:10:08.531147+0000","last_fullsized":"2024-04-18T21:10:08.531147+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:02:34.372453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":8239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"71'346","reported_seq":571,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.481389+0000","last_change":"2024-04-18T21:09:51.933169+0000","last_active":"2024-04-18T21:10:07.481389+0000","last_peered":"2024-04-18T21:10:07.481389+0000","last_clean":"2024-04-18T21:06:56.661266+0000","last_became_active":"2024-04-18T21:09:51.914853+0000","last_became_peered":"2024-04-18T21:09:51.914853+0000","last_unstale":"2024-04-18T21:10:07.481389+0000","last_undegraded":"2024-04-18T21:09:51.829697+0000","last_fullsized":"2024-04-18T21:09:51.816524+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":153,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27042,"num_write":321,"num_write_kb":50693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.479939+0000","last_change":"2024-04-18T21:05:00.576606+0000","last_active":"2024-04-18T21:10:07.479939+0000","last_peered":"2024-04-18T21:10:07.479939+0000","last_clean":"2024-04-18T21:10:07.479939+0000","last_became_active":"2024-04-18T21:05:00.575951+0000","last_became_peered":"2024-04-18T21:05:00.575951+0000","last_unstale":"2024-04-18T21:10:07.479939+0000","last_undegraded":"2024-04-18T21:10:07.479939+0000","last_fullsized":"2024-04-18T21:10:07.479939+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:32:17.612481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"70'63","reported_seq":233,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478716+0000","last_change":"2024-04-18T21:05:04.627296+0000","last_active":"2024-04-18T21:10:07.478716+0000","last_peered":"2024-04-18T21:10:07.478716+0000","last_clean":"2024-04-18T21:10:07.478716+0000","last_became_active":"2024-04-18T21:05:04.626801+0000","last_became_peered":"2024-04-18T21:05:04.626801+0000","last_unstale":"2024-04-18T21:10:07.478716+0000","last_undegraded":"2024-04-18T21:10:07.478716+0000","last_fullsized":"2024-04-18T21:10:07.478716+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:46:36.285416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"71'406","reported_seq":1015,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.480589+0000","last_change":"2024-04-18T21:09:59.495686+0000","last_active":"2024-04-18T21:10:07.480589+0000","last_peered":"2024-04-18T21:10:07.480589+0000","last_clean":"2024-04-18T21:10:07.480589+0000","last_became_active":"2024-04-18T21:09:59.493248+0000","last_became_peered":"2024-04-18T21:09:59.493248+0000","last_unstale":"2024-04-18T21:10:07.480589+0000","last_undegraded":"2024-04-18T21:10:07.480589+0000","last_fullsized":"2024-04-18T21:10:07.480589+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:11:23.853682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":35332,"num_write":370,"num_write_kb":71807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"70'284","reported_seq":289,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.479256+0000","last_change":"2024-04-18T21:10:00.504958+0000","last_active":"2024-04-18T21:10:07.479256+0000","last_peered":"2024-04-18T21:10:07.479256+0000","last_clean":"2024-04-18T21:10:07.479256+0000","last_became_active":"2024-04-18T21:10:00.503851+0000","last_became_peered":"2024-04-18T21:10:00.503851+0000","last_unstale":"2024-04-18T21:10:07.479256+0000","last_undegraded":"2024-04-18T21:10:07.479256+0000","last_fullsized":"2024-04-18T21:10:07.479256+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:10:27.397258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":218,"num_write_kb":4194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.480983+0000","last_change":"2024-04-18T21:10:03.484148+0000","last_active":"2024-04-18T21:10:07.480983+0000","last_peered":"2024-04-18T21:10:07.480983+0000","last_clean":"2024-04-18T21:10:07.480983+0000","last_became_active":"2024-04-18T21:10:03.480071+0000","last_became_peered":"2024-04-18T21:10:03.480071+0000","last_unstale":"2024-04-18T21:10:07.480983+0000","last_undegraded":"2024-04-18T21:10:07.480983+0000","last_fullsized":"2024-04-18T21:10:07.480983+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:50:30.257039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'386","reported_seq":587,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.476568+0000","last_change":"2024-04-18T21:09:52.430978+0000","last_active":"2024-04-18T21:10:07.476568+0000","last_peered":"2024-04-18T21:10:07.476568+0000","last_clean":"2024-04-18T21:06:56.710639+0000","last_became_active":"2024-04-18T21:09:51.908732+0000","last_became_peered":"2024-04-18T21:09:51.908732+0000","last_unstale":"2024-04-18T21:10:07.476568+0000","last_undegraded":"2024-04-18T21:09:52.430630+0000","last_fullsized":"2024-04-18T21:09:51.772520+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":166,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14677,"num_write":355,"num_write_kb":51018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"70'55","reported_seq":231,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.480986+0000","last_change":"2024-04-18T21:09:50.833424+0000","last_active":"2024-04-18T21:10:07.480986+0000","last_peered":"2024-04-18T21:10:07.480986+0000","last_clean":"2024-04-18T21:10:07.480986+0000","last_became_active":"2024-04-18T21:09:50.832752+0000","last_became_peered":"2024-04-18T21:09:50.832752+0000","last_unstale":"2024-04-18T21:10:07.480986+0000","last_undegraded":"2024-04-18T21:10:07.480986+0000","last_fullsized":"2024-04-18T21:10:07.480986+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:48.945329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":141,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.533632+0000","last_change":"2024-04-18T21:09:50.900338+0000","last_active":"2024-04-18T21:10:08.533632+0000","last_peered":"2024-04-18T21:10:08.533632+0000","last_clean":"2024-04-18T21:10:08.533632+0000","last_became_active":"2024-04-18T21:09:50.896844+0000","last_became_peered":"2024-04-18T21:09:50.896844+0000","last_unstale":"2024-04-18T21:10:08.533632+0000","last_undegraded":"2024-04-18T21:10:08.533632+0000","last_fullsized":"2024-04-18T21:10:08.533632+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:11:35.543409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"71'402","reported_seq":567,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.532912+0000","last_change":"2024-04-18T21:10:05.542484+0000","last_active":"2024-04-18T21:10:08.532912+0000","last_peered":"2024-04-18T21:10:08.532912+0000","last_clean":"2024-04-18T21:10:08.532912+0000","last_became_active":"2024-04-18T21:10:05.536763+0000","last_became_peered":"2024-04-18T21:10:05.536763+0000","last_unstale":"2024-04-18T21:10:08.532912+0000","last_undegraded":"2024-04-18T21:10:08.532912+0000","last_fullsized":"2024-04-18T21:10:08.532912+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:08:22.367267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12468,"num_write":369,"num_write_kb":67231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"70'60","reported_seq":237,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.482521+0000","last_change":"2024-04-18T21:09:50.832598+0000","last_active":"2024-04-18T21:10:07.482521+0000","last_peered":"2024-04-18T21:10:07.482521+0000","last_clean":"2024-04-18T21:10:07.482521+0000","last_became_active":"2024-04-18T21:09:50.832030+0000","last_became_peered":"2024-04-18T21:09:50.832030+0000","last_unstale":"2024-04-18T21:10:07.482521+0000","last_undegraded":"2024-04-18T21:10:07.482521+0000","last_fullsized":"2024-04-18T21:10:07.482521+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:10:27.397258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.483586+0000","last_change":"2024-04-18T21:10:03.492761+0000","last_active":"2024-04-18T21:10:07.483586+0000","last_peered":"2024-04-18T21:10:07.483586+0000","last_clean":"2024-04-18T21:10:07.483586+0000","last_became_active":"2024-04-18T21:10:03.492145+0000","last_became_peered":"2024-04-18T21:10:03.492145+0000","last_unstale":"2024-04-18T21:10:07.483586+0000","last_undegraded":"2024-04-18T21:10:07.483586+0000","last_fullsized":"2024-04-18T21:10:07.483586+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:20:00.853523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'421","reported_seq":602,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.479646+0000","last_change":"2024-04-18T21:10:03.488774+0000","last_active":"2024-04-18T21:10:07.479646+0000","last_peered":"2024-04-18T21:10:07.479646+0000","last_clean":"2024-04-18T21:10:07.479646+0000","last_became_active":"2024-04-18T21:10:03.479773+0000","last_became_peered":"2024-04-18T21:10:03.479773+0000","last_unstale":"2024-04-18T21:10:07.479646+0000","last_undegraded":"2024-04-18T21:10:07.479646+0000","last_fullsized":"2024-04-18T21:10:07.479646+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:15:12.326904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":16183,"num_write":377,"num_write_kb":50451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"71'110","reported_seq":299,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.483583+0000","last_change":"2024-04-18T21:10:00.497917+0000","last_active":"2024-04-18T21:10:07.483583+0000","last_peered":"2024-04-18T21:10:07.483583+0000","last_clean":"2024-04-18T21:10:07.483583+0000","last_became_active":"2024-04-18T21:10:00.494644+0000","last_became_peered":"2024-04-18T21:10:00.494644+0000","last_unstale":"2024-04-18T21:10:07.483583+0000","last_undegraded":"2024-04-18T21:10:07.483583+0000","last_fullsized":"2024-04-18T21:10:07.483583+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:40:57.347353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":1251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":134,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.479598+0000","last_change":"2024-04-18T21:10:00.493764+0000","last_active":"2024-04-18T21:10:07.479598+0000","last_peered":"2024-04-18T21:10:07.479598+0000","last_clean":"2024-04-18T21:10:07.479598+0000","last_became_active":"2024-04-18T21:10:00.492672+0000","last_became_peered":"2024-04-18T21:10:00.492672+0000","last_unstale":"2024-04-18T21:10:07.479598+0000","last_undegraded":"2024-04-18T21:10:07.479598+0000","last_fullsized":"2024-04-18T21:10:07.479598+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:48:46.709401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'384","reported_seq":573,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.531961+0000","last_change":"2024-04-18T21:09:57.572865+0000","last_active":"2024-04-18T21:10:08.531961+0000","last_peered":"2024-04-18T21:10:08.531961+0000","last_clean":"2024-04-18T21:10:08.531961+0000","last_became_active":"2024-04-18T21:09:57.567962+0000","last_became_peered":"2024-04-18T21:09:57.567962+0000","last_unstale":"2024-04-18T21:10:08.531961+0000","last_undegraded":"2024-04-18T21:10:08.531961+0000","last_fullsized":"2024-04-18T21:10:08.531961+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:51:24.627186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":15567,"num_write":351,"num_write_kb":42959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"71'396","reported_seq":549,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.478153+0000","last_change":"2024-04-18T21:10:01.500036+0000","last_active":"2024-04-18T21:10:07.478153+0000","last_peered":"2024-04-18T21:10:07.478153+0000","last_clean":"2024-04-18T21:09:48.743028+0000","last_became_active":"2024-04-18T21:10:01.492175+0000","last_became_peered":"2024-04-18T21:10:01.492175+0000","last_unstale":"2024-04-18T21:10:07.478153+0000","last_undegraded":"2024-04-18T21:10:01.483082+0000","last_fullsized":"2024-04-18T21:10:01.476438+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":171,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12943,"num_write":353,"num_write_kb":35357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":3500882,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"71'277","reported_seq":292,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.477963+0000","last_change":"2024-04-18T21:10:00.495047+0000","last_active":"2024-04-18T21:10:07.477963+0000","last_peered":"2024-04-18T21:10:07.477963+0000","last_clean":"2024-04-18T21:10:07.477963+0000","last_became_active":"2024-04-18T21:10:00.493088+0000","last_became_peered":"2024-04-18T21:10:00.493088+0000","last_unstale":"2024-04-18T21:10:07.477963+0000","last_undegraded":"2024-04-18T21:10:07.477963+0000","last_fullsized":"2024-04-18T21:10:07.477963+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:39:08.263781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":221,"num_write_kb":8303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":8389370,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'411","reported_seq":981,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478348+0000","last_change":"2024-04-18T21:10:04.485332+0000","last_active":"2024-04-18T21:10:07.478348+0000","last_peered":"2024-04-18T21:10:07.478348+0000","last_clean":"2024-04-18T21:10:07.478348+0000","last_became_active":"2024-04-18T21:10:04.482320+0000","last_became_peered":"2024-04-18T21:10:04.482320+0000","last_unstale":"2024-04-18T21:10:07.478348+0000","last_undegraded":"2024-04-18T21:10:07.478348+0000","last_fullsized":"2024-04-18T21:10:07.478348+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:35:57.043682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":17179,"num_write":375,"num_write_kb":38991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"70'85","reported_seq":144,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.532976+0000","last_change":"2024-04-18T21:09:50.890616+0000","last_active":"2024-04-18T21:10:08.532976+0000","last_peered":"2024-04-18T21:10:08.532976+0000","last_clean":"2024-04-18T21:10:08.532976+0000","last_became_active":"2024-04-18T21:09:50.874855+0000","last_became_peered":"2024-04-18T21:09:50.874855+0000","last_unstale":"2024-04-18T21:10:08.532976+0000","last_undegraded":"2024-04-18T21:10:08.532976+0000","last_fullsized":"2024-04-18T21:10:08.532976+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:03:54.726282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"70'230","reported_seq":233,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.479167+0000","last_change":"2024-04-18T21:10:00.499373+0000","last_active":"2024-04-18T21:10:07.479167+0000","last_peered":"2024-04-18T21:10:07.479167+0000","last_clean":"2024-04-18T21:10:07.479167+0000","last_became_active":"2024-04-18T21:10:00.498141+0000","last_became_peered":"2024-04-18T21:10:00.498141+0000","last_unstale":"2024-04-18T21:10:07.479167+0000","last_undegraded":"2024-04-18T21:10:07.479167+0000","last_fullsized":"2024-04-18T21:10:07.479167+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:55:01.865593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":4178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"71'493","reported_seq":706,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478522+0000","last_change":"2024-04-18T21:05:05.642793+0000","last_active":"2024-04-18T21:10:07.478522+0000","last_peered":"2024-04-18T21:10:07.478522+0000","last_clean":"2024-04-18T21:10:07.478522+0000","last_became_active":"2024-04-18T21:05:05.641983+0000","last_became_peered":"2024-04-18T21:05:05.641983+0000","last_unstale":"2024-04-18T21:10:07.478522+0000","last_undegraded":"2024-04-18T21:10:07.478522+0000","last_fullsized":"2024-04-18T21:10:07.478522+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:46:36.339289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23833,"num_write":461,"num_write_kb":76873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"70'62","reported_seq":231,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.482063+0000","last_change":"2024-04-18T21:05:04.641445+0000","last_active":"2024-04-18T21:10:07.482063+0000","last_peered":"2024-04-18T21:10:07.482063+0000","last_clean":"2024-04-18T21:10:07.482063+0000","last_became_active":"2024-04-18T21:05:04.640682+0000","last_became_peered":"2024-04-18T21:05:04.640682+0000","last_unstale":"2024-04-18T21:10:07.482063+0000","last_undegraded":"2024-04-18T21:10:07.482063+0000","last_fullsized":"2024-04-18T21:10:07.482063+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:46:36.285416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'436","reported_seq":644,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.478935+0000","last_change":"2024-04-18T21:09:51.937322+0000","last_active":"2024-04-18T21:10:07.478935+0000","last_peered":"2024-04-18T21:10:07.478935+0000","last_clean":"2024-04-18T21:06:56.761407+0000","last_became_active":"2024-04-18T21:09:51.933205+0000","last_became_peered":"2024-04-18T21:09:51.933205+0000","last_unstale":"2024-04-18T21:10:07.478935+0000","last_undegraded":"2024-04-18T21:09:51.833249+0000","last_fullsized":"2024-04-18T21:09:51.824946+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":193,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14561,"num_write":408,"num_write_kb":47462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'369","reported_seq":547,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.534205+0000","last_change":"2024-04-18T21:10:02.553999+0000","last_active":"2024-04-18T21:10:08.534205+0000","last_peered":"2024-04-18T21:10:08.534205+0000","last_clean":"2024-04-18T21:10:08.534205+0000","last_became_active":"2024-04-18T21:10:02.549471+0000","last_became_peered":"2024-04-18T21:10:02.549471+0000","last_unstale":"2024-04-18T21:10:08.534205+0000","last_undegraded":"2024-04-18T21:10:08.534205+0000","last_fullsized":"2024-04-18T21:10:08.534205+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:52:14.371235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13619,"num_write":339,"num_write_kb":63086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"70'888","reported_seq":1004,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.480032+0000","last_change":"2024-04-18T21:10:03.486911+0000","last_active":"2024-04-18T21:10:07.480032+0000","last_peered":"2024-04-18T21:10:07.480032+0000","last_clean":"2024-04-18T21:10:07.480032+0000","last_became_active":"2024-04-18T21:10:03.480576+0000","last_became_peered":"2024-04-18T21:10:03.480576+0000","last_unstale":"2024-04-18T21:10:07.480032+0000","last_undegraded":"2024-04-18T21:10:07.480032+0000","last_fullsized":"2024-04-18T21:10:07.480032+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:41:06.632064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":823,"num_write_kb":8582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'398","reported_seq":536,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.481860+0000","last_change":"2024-04-18T21:10:03.491426+0000","last_active":"2024-04-18T21:10:07.481860+0000","last_peered":"2024-04-18T21:10:07.481860+0000","last_clean":"2024-04-18T21:10:07.481860+0000","last_became_active":"2024-04-18T21:10:03.483190+0000","last_became_peered":"2024-04-18T21:10:03.483190+0000","last_unstale":"2024-04-18T21:10:07.481860+0000","last_undegraded":"2024-04-18T21:10:07.481860+0000","last_fullsized":"2024-04-18T21:10:07.481860+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:05:10.611580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14684,"num_write":380,"num_write_kb":88822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"70'169","reported_seq":358,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478915+0000","last_change":"2024-04-18T21:10:00.494974+0000","last_active":"2024-04-18T21:10:07.478915+0000","last_peered":"2024-04-18T21:10:07.478915+0000","last_clean":"2024-04-18T21:10:07.478915+0000","last_became_active":"2024-04-18T21:10:00.492196+0000","last_became_peered":"2024-04-18T21:10:00.492196+0000","last_unstale":"2024-04-18T21:10:07.478915+0000","last_undegraded":"2024-04-18T21:10:07.478915+0000","last_fullsized":"2024-04-18T21:10:07.478915+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:33:51.236211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":4162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'406","reported_seq":644,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.477513+0000","last_change":"2024-04-18T21:09:52.500269+0000","last_active":"2024-04-18T21:10:07.477513+0000","last_peered":"2024-04-18T21:10:07.477513+0000","last_clean":"2024-04-18T21:06:56.583905+0000","last_became_active":"2024-04-18T21:09:51.914607+0000","last_became_peered":"2024-04-18T21:09:51.914607+0000","last_unstale":"2024-04-18T21:10:07.477513+0000","last_undegraded":"2024-04-18T21:09:52.499843+0000","last_fullsized":"2024-04-18T21:09:51.772504+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":165,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27495,"num_write":363,"num_write_kb":89134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"72'192","reported_seq":361,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.532102+0000","last_change":"2024-04-18T21:09:53.541766+0000","last_active":"2024-04-18T21:10:08.532102+0000","last_peered":"2024-04-18T21:10:08.532102+0000","last_clean":"2024-04-18T21:10:08.532102+0000","last_became_active":"2024-04-18T21:09:53.541300+0000","last_became_peered":"2024-04-18T21:09:53.541300+0000","last_unstale":"2024-04-18T21:10:08.532102+0000","last_undegraded":"2024-04-18T21:10:08.532102+0000","last_fullsized":"2024-04-18T21:10:08.532102+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:26:14.718922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12425030,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":12201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8230726,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"71'383","reported_seq":593,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.532957+0000","last_change":"2024-04-18T21:09:55.555798+0000","last_active":"2024-04-18T21:10:08.532957+0000","last_peered":"2024-04-18T21:10:08.532957+0000","last_clean":"2024-04-18T21:10:08.532957+0000","last_became_active":"2024-04-18T21:09:55.551135+0000","last_became_peered":"2024-04-18T21:09:55.551135+0000","last_unstale":"2024-04-18T21:10:08.532957+0000","last_undegraded":"2024-04-18T21:10:08.532957+0000","last_fullsized":"2024-04-18T21:10:08.532957+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:00:01.739082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21614,"num_write":351,"num_write_kb":79501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"70'66","reported_seq":135,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.532968+0000","last_change":"2024-04-18T21:10:00.553114+0000","last_active":"2024-04-18T21:10:08.532968+0000","last_peered":"2024-04-18T21:10:08.532968+0000","last_clean":"2024-04-18T21:10:08.532968+0000","last_became_active":"2024-04-18T21:10:00.552067+0000","last_became_peered":"2024-04-18T21:10:00.552067+0000","last_unstale":"2024-04-18T21:10:08.532968+0000","last_undegraded":"2024-04-18T21:10:08.532968+0000","last_fullsized":"2024-04-18T21:10:08.532968+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:51:32.567297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"71'345","reported_seq":520,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.477790+0000","last_change":"2024-04-18T21:05:05.624840+0000","last_active":"2024-04-18T21:10:07.477790+0000","last_peered":"2024-04-18T21:10:07.477790+0000","last_clean":"2024-04-18T21:10:07.477790+0000","last_became_active":"2024-04-18T21:05:05.622950+0000","last_became_peered":"2024-04-18T21:05:05.622950+0000","last_unstale":"2024-04-18T21:10:07.477790+0000","last_undegraded":"2024-04-18T21:10:07.477790+0000","last_fullsized":"2024-04-18T21:10:07.477790+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:27:17.530889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":317,"num_write_kb":29335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"70'171","reported_seq":260,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.477750+0000","last_change":"2024-04-18T21:10:00.507624+0000","last_active":"2024-04-18T21:10:07.477750+0000","last_peered":"2024-04-18T21:10:07.477750+0000","last_clean":"2024-04-18T21:10:07.477750+0000","last_became_active":"2024-04-18T21:10:00.507132+0000","last_became_peered":"2024-04-18T21:10:00.507132+0000","last_unstale":"2024-04-18T21:10:07.477750+0000","last_undegraded":"2024-04-18T21:10:07.477750+0000","last_fullsized":"2024-04-18T21:10:07.477750+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:35:50.013019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":4154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"71'417","reported_seq":617,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.479514+0000","last_change":"2024-04-18T21:05:05.627962+0000","last_active":"2024-04-18T21:10:07.479514+0000","last_peered":"2024-04-18T21:10:07.479514+0000","last_clean":"2024-04-18T21:10:07.479514+0000","last_became_active":"2024-04-18T21:05:05.626698+0000","last_became_peered":"2024-04-18T21:05:05.626698+0000","last_unstale":"2024-04-18T21:10:07.479514+0000","last_undegraded":"2024-04-18T21:10:07.479514+0000","last_fullsized":"2024-04-18T21:10:07.479514+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:48:48.973087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":17040,"num_write":384,"num_write_kb":83740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"70'276","reported_seq":447,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.532462+0000","last_change":"2024-04-18T21:09:53.543611+0000","last_active":"2024-04-18T21:10:08.532462+0000","last_peered":"2024-04-18T21:10:08.532462+0000","last_clean":"2024-04-18T21:10:08.532462+0000","last_became_active":"2024-04-18T21:09:53.542863+0000","last_became_peered":"2024-04-18T21:09:53.542863+0000","last_unstale":"2024-04-18T21:10:08.532462+0000","last_undegraded":"2024-04-18T21:10:08.532462+0000","last_fullsized":"2024-04-18T21:10:08.532462+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:22.582074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":12399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"71'428","reported_seq":613,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.541152+0000","last_change":"2024-04-18T21:10:08.541152+0000","last_active":"2024-04-18T21:10:08.541152+0000","last_peered":"2024-04-18T21:10:08.541152+0000","last_clean":"2024-04-18T21:10:08.541152+0000","last_became_active":"2024-04-18T21:10:08.536423+0000","last_became_peered":"2024-04-18T21:10:08.536423+0000","last_unstale":"2024-04-18T21:10:08.541152+0000","last_undegraded":"2024-04-18T21:10:08.541152+0000","last_fullsized":"2024-04-18T21:10:08.541152+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:26.666677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22548,"num_write":398,"num_write_kb":75972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"70'70","reported_seq":247,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.482404+0000","last_change":"2024-04-18T21:09:50.833350+0000","last_active":"2024-04-18T21:10:07.482404+0000","last_peered":"2024-04-18T21:10:07.482404+0000","last_clean":"2024-04-18T21:10:07.482404+0000","last_became_active":"2024-04-18T21:09:50.832355+0000","last_became_peered":"2024-04-18T21:09:50.832355+0000","last_unstale":"2024-04-18T21:10:07.482404+0000","last_undegraded":"2024-04-18T21:10:07.482404+0000","last_fullsized":"2024-04-18T21:10:07.482404+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:39:09.627425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'459","reported_seq":616,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.476880+0000","last_change":"2024-04-18T21:10:01.503378+0000","last_active":"2024-04-18T21:10:07.476880+0000","last_peered":"2024-04-18T21:10:07.476880+0000","last_clean":"2024-04-18T21:10:07.476880+0000","last_became_active":"2024-04-18T21:10:01.497275+0000","last_became_peered":"2024-04-18T21:10:01.497275+0000","last_unstale":"2024-04-18T21:10:07.476880+0000","last_undegraded":"2024-04-18T21:10:07.476880+0000","last_fullsized":"2024-04-18T21:10:07.476880+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:40:35.832428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13353,"num_write":429,"num_write_kb":88123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"70'113","reported_seq":306,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.481828+0000","last_change":"2024-04-18T21:10:00.499468+0000","last_active":"2024-04-18T21:10:07.481828+0000","last_peered":"2024-04-18T21:10:07.481828+0000","last_clean":"2024-04-18T21:10:07.481828+0000","last_became_active":"2024-04-18T21:10:00.494734+0000","last_became_peered":"2024-04-18T21:10:00.494734+0000","last_unstale":"2024-04-18T21:10:07.481828+0000","last_undegraded":"2024-04-18T21:10:07.481828+0000","last_fullsized":"2024-04-18T21:10:07.481828+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:58:34.790588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194886,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3204,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2531,"num_read_kb":1304649,"num_write":24542,"num_write_kb":4299443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4748,"num_bytes_recovered":4488063,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":124755968,"data_stored":118078794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26603,"ondisk_log_size":26603,"up":128,"acting":110,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127139127,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":55,"num_read_kb":1405,"num_write":4542,"num_write_kb":127514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":92002768,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":279527424,"data_stored":279444842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4409,"internal_metadata":0},"log_size":6331,"ondisk_log_size":6331,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738436,"num_pgs":84,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":208484,"kb_used_data":105176,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94163356,"statfs":{"total":96636764160,"available":96423276544,"internally_reserved":0,"allocated":107700224,"data_stored":107174746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":77,"seq":330712481798,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":242836,"kb_used_data":205312,"kb_used_omap":5,"kb_used_meta":37498,"kb_avail":94129004,"statfs":{"total":96636764160,"available":96388100096,"internally_reserved":0,"allocated":210239488,"data_stored":202926276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6004,"internal_metadata":38398092},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738434,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":160340,"kb_used_data":88960,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94211500,"statfs":{"total":96636764160,"available":96472576000,"internally_reserved":0,"allocated":91095040,"data_stored":90560267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":89579520,"data_stored":89548273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":83750912,"data_stored":83729052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4409,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106196992,"data_stored":106167517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":124755968,"data_stored":118078794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:10:12.765 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:10:13.075 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:10:13.077 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-04-18T21:10:13.093 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":258,"stamp":"2024-04-18T21:10:12.634904+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127729495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3204,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2722,"num_read_kb":1306172,"num_write":29287,"num_write_kb":4430417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4785,"num_bytes_recovered":97081199,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33091,"ondisk_log_size":33091,"up":210,"acting":192,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":222,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":611660,"kb_used_data":399448,"kb_used_omap":8,"kb_used_meta":212151,"kb_avail":282503860,"statfs":{"total":289910292480,"available":289283952640,"internally_reserved":0,"allocated":409034752,"data_stored":400661289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9194,"internal_metadata":217242646},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-588,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":848,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001340"},"pg_stats":[{"pgid":"4.3f","version":"71'418","reported_seq":633,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.481984+0000","last_change":"2024-04-18T21:09:51.933769+0000","last_active":"2024-04-18T21:10:07.481984+0000","last_peered":"2024-04-18T21:10:07.481984+0000","last_clean":"2024-04-18T21:06:56.295490+0000","last_became_active":"2024-04-18T21:09:51.925977+0000","last_became_peered":"2024-04-18T21:09:51.925977+0000","last_unstale":"2024-04-18T21:10:07.481984+0000","last_undegraded":"2024-04-18T21:09:51.837482+0000","last_fullsized":"2024-04-18T21:09:51.829450+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":19677,"num_write":386,"num_write_kb":87615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"71'417","reported_seq":607,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.534086+0000","last_change":"2024-04-18T21:10:05.546965+0000","last_active":"2024-04-18T21:10:08.534086+0000","last_peered":"2024-04-18T21:10:08.534086+0000","last_clean":"2024-04-18T21:10:08.534086+0000","last_became_active":"2024-04-18T21:10:05.541170+0000","last_became_peered":"2024-04-18T21:10:05.541170+0000","last_unstale":"2024-04-18T21:10:08.534086+0000","last_undegraded":"2024-04-18T21:10:08.534086+0000","last_fullsized":"2024-04-18T21:10:08.534086+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:04:05.630763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":12123,"num_write":387,"num_write_kb":47157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"71'379","reported_seq":914,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.477728+0000","last_change":"2024-04-18T21:09:54.480753+0000","last_active":"2024-04-18T21:10:07.477728+0000","last_peered":"2024-04-18T21:10:07.477728+0000","last_clean":"2024-04-18T21:10:07.477728+0000","last_became_active":"2024-04-18T21:09:54.478020+0000","last_became_peered":"2024-04-18T21:09:54.478020+0000","last_unstale":"2024-04-18T21:10:07.477728+0000","last_undegraded":"2024-04-18T21:10:07.477728+0000","last_fullsized":"2024-04-18T21:10:07.477728+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:24:18.705477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":10040,"num_write":353,"num_write_kb":63202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'372","reported_seq":548,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.477334+0000","last_change":"2024-04-18T21:05:05.629321+0000","last_active":"2024-04-18T21:10:07.477334+0000","last_peered":"2024-04-18T21:10:07.477334+0000","last_clean":"2024-04-18T21:10:07.477334+0000","last_became_active":"2024-04-18T21:05:05.627956+0000","last_became_peered":"2024-04-18T21:05:05.627956+0000","last_unstale":"2024-04-18T21:10:07.477334+0000","last_undegraded":"2024-04-18T21:10:07.477334+0000","last_fullsized":"2024-04-18T21:10:07.477334+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:15:28.458476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2735,"num_write":328,"num_write_kb":22107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"71'416","reported_seq":592,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.533227+0000","last_change":"2024-04-18T21:10:00.560644+0000","last_active":"2024-04-18T21:10:08.533227+0000","last_peered":"2024-04-18T21:10:08.533227+0000","last_clean":"2024-04-18T21:10:08.533227+0000","last_became_active":"2024-04-18T21:10:00.553862+0000","last_became_peered":"2024-04-18T21:10:00.553862+0000","last_unstale":"2024-04-18T21:10:08.533227+0000","last_undegraded":"2024-04-18T21:10:08.533227+0000","last_fullsized":"2024-04-18T21:10:08.533227+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:11:49.688538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6533,"num_write":389,"num_write_kb":43666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"71'374","reported_seq":548,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478034+0000","last_change":"2024-04-18T21:10:01.495684+0000","last_active":"2024-04-18T21:10:07.478034+0000","last_peered":"2024-04-18T21:10:07.478034+0000","last_clean":"2024-04-18T21:10:07.478034+0000","last_became_active":"2024-04-18T21:10:01.486640+0000","last_became_peered":"2024-04-18T21:10:01.486640+0000","last_unstale":"2024-04-18T21:10:07.478034+0000","last_undegraded":"2024-04-18T21:10:07.478034+0000","last_fullsized":"2024-04-18T21:10:07.478034+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:39:10.639381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20415,"num_write":354,"num_write_kb":34462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'418","reported_seq":626,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.476770+0000","last_change":"2024-04-18T21:05:05.625047+0000","last_active":"2024-04-18T21:10:07.476770+0000","last_peered":"2024-04-18T21:10:07.476770+0000","last_clean":"2024-04-18T21:10:07.476770+0000","last_became_active":"2024-04-18T21:05:05.622781+0000","last_became_peered":"2024-04-18T21:05:05.622781+0000","last_unstale":"2024-04-18T21:10:07.476770+0000","last_undegraded":"2024-04-18T21:10:07.476770+0000","last_fullsized":"2024-04-18T21:10:07.476770+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:12.944469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21103,"num_write":385,"num_write_kb":50678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"71'399","reported_seq":612,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.476294+0000","last_change":"2024-04-18T21:10:00.495543+0000","last_active":"2024-04-18T21:10:07.476294+0000","last_peered":"2024-04-18T21:10:07.476294+0000","last_clean":"2024-04-18T21:10:07.476294+0000","last_became_active":"2024-04-18T21:10:00.488705+0000","last_became_peered":"2024-04-18T21:10:00.488705+0000","last_unstale":"2024-04-18T21:10:07.476294+0000","last_undegraded":"2024-04-18T21:10:07.476294+0000","last_fullsized":"2024-04-18T21:10:07.476294+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:11.892092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":44692,"num_write":361,"num_write_kb":105170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"71'385","reported_seq":924,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.480990+0000","last_change":"2024-04-18T21:10:06.487113+0000","last_active":"2024-04-18T21:10:07.480990+0000","last_peered":"2024-04-18T21:10:07.480990+0000","last_clean":"2024-04-18T21:10:07.480990+0000","last_became_active":"2024-04-18T21:10:06.482087+0000","last_became_peered":"2024-04-18T21:10:06.482087+0000","last_unstale":"2024-04-18T21:10:07.480990+0000","last_undegraded":"2024-04-18T21:10:07.480990+0000","last_fullsized":"2024-04-18T21:10:07.480990+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:10:51.435131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":994,"num_write":358,"num_write_kb":25964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'409","reported_seq":655,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.480927+0000","last_change":"2024-04-18T21:09:51.933299+0000","last_active":"2024-04-18T21:10:07.480927+0000","last_peered":"2024-04-18T21:10:07.480927+0000","last_clean":"2024-04-18T21:06:56.705266+0000","last_became_active":"2024-04-18T21:09:51.917102+0000","last_became_peered":"2024-04-18T21:09:51.917102+0000","last_unstale":"2024-04-18T21:10:07.480927+0000","last_undegraded":"2024-04-18T21:09:51.819800+0000","last_fullsized":"2024-04-18T21:09:51.800654+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":171,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":26170,"num_write":372,"num_write_kb":83931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"71'366","reported_seq":551,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478059+0000","last_change":"2024-04-18T21:10:01.496068+0000","last_active":"2024-04-18T21:10:07.478059+0000","last_peered":"2024-04-18T21:10:07.478059+0000","last_clean":"2024-04-18T21:10:07.478059+0000","last_became_active":"2024-04-18T21:10:01.488047+0000","last_became_peered":"2024-04-18T21:10:01.488047+0000","last_unstale":"2024-04-18T21:10:07.478059+0000","last_undegraded":"2024-04-18T21:10:07.478059+0000","last_fullsized":"2024-04-18T21:10:07.478059+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:49.957286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":18907,"num_write":347,"num_write_kb":26153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"71'346","reported_seq":525,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.533271+0000","last_change":"2024-04-18T21:10:00.560349+0000","last_active":"2024-04-18T21:10:08.533271+0000","last_peered":"2024-04-18T21:10:08.533271+0000","last_clean":"2024-04-18T21:10:08.533271+0000","last_became_active":"2024-04-18T21:10:00.557412+0000","last_became_peered":"2024-04-18T21:10:00.557412+0000","last_unstale":"2024-04-18T21:10:08.533271+0000","last_undegraded":"2024-04-18T21:10:08.533271+0000","last_fullsized":"2024-04-18T21:10:08.533271+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:54:33.428937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":6245,"num_write":324,"num_write_kb":37970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"71'417","reported_seq":614,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.533573+0000","last_change":"2024-04-18T21:10:02.555899+0000","last_active":"2024-04-18T21:10:08.533573+0000","last_peered":"2024-04-18T21:10:08.533573+0000","last_clean":"2024-04-18T21:10:08.533573+0000","last_became_active":"2024-04-18T21:10:02.551406+0000","last_became_peered":"2024-04-18T21:10:02.551406+0000","last_unstale":"2024-04-18T21:10:08.533573+0000","last_undegraded":"2024-04-18T21:10:08.533573+0000","last_fullsized":"2024-04-18T21:10:08.533573+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:41:17.455669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":21623,"num_write":381,"num_write_kb":71306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"71'398","reported_seq":580,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.478531+0000","last_change":"2024-04-18T21:09:52.463425+0000","last_active":"2024-04-18T21:10:07.478531+0000","last_peered":"2024-04-18T21:10:07.478531+0000","last_clean":"2024-04-18T21:06:55.780318+0000","last_became_active":"2024-04-18T21:09:51.909652+0000","last_became_peered":"2024-04-18T21:09:51.909652+0000","last_unstale":"2024-04-18T21:10:07.478531+0000","last_undegraded":"2024-04-18T21:09:52.463153+0000","last_fullsized":"2024-04-18T21:09:51.781091+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":369,"num_write_kb":30006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'435","reported_seq":723,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.477128+0000","last_change":"2024-04-18T21:10:01.504091+0000","last_active":"2024-04-18T21:10:07.477128+0000","last_peered":"2024-04-18T21:10:07.477128+0000","last_clean":"2024-04-18T21:09:48.742565+0000","last_became_active":"2024-04-18T21:10:01.499730+0000","last_became_peered":"2024-04-18T21:10:01.499730+0000","last_unstale":"2024-04-18T21:10:07.477128+0000","last_undegraded":"2024-04-18T21:10:01.482937+0000","last_fullsized":"2024-04-18T21:10:01.475971+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":173,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":31523,"num_write":402,"num_write_kb":121466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":410327,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'446","reported_seq":661,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.476315+0000","last_change":"2024-04-18T21:05:05.638203+0000","last_active":"2024-04-18T21:10:07.476315+0000","last_peered":"2024-04-18T21:10:07.476315+0000","last_clean":"2024-04-18T21:10:07.476315+0000","last_became_active":"2024-04-18T21:05:05.637352+0000","last_became_peered":"2024-04-18T21:05:05.637352+0000","last_unstale":"2024-04-18T21:10:07.476315+0000","last_undegraded":"2024-04-18T21:10:07.476315+0000","last_fullsized":"2024-04-18T21:10:07.476315+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":23833,"num_write":418,"num_write_kb":59679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"71'403","reported_seq":565,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.482255+0000","last_change":"2024-04-18T21:10:03.493121+0000","last_active":"2024-04-18T21:10:07.482255+0000","last_peered":"2024-04-18T21:10:07.482255+0000","last_clean":"2024-04-18T21:06:53.394905+0000","last_became_active":"2024-04-18T21:10:03.488943+0000","last_became_peered":"2024-04-18T21:10:03.488943+0000","last_unstale":"2024-04-18T21:10:07.482255+0000","last_undegraded":"2024-04-18T21:10:03.479306+0000","last_fullsized":"2024-04-18T21:10:03.477937+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":7482,"num_write":371,"num_write_kb":25957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'406","reported_seq":613,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.482341+0000","last_change":"2024-04-18T21:09:51.933105+0000","last_active":"2024-04-18T21:10:07.482341+0000","last_peered":"2024-04-18T21:10:07.482341+0000","last_clean":"2024-04-18T21:06:53.408988+0000","last_became_active":"2024-04-18T21:09:51.925620+0000","last_became_peered":"2024-04-18T21:09:51.925620+0000","last_unstale":"2024-04-18T21:10:07.482341+0000","last_undegraded":"2024-04-18T21:09:51.836579+0000","last_fullsized":"2024-04-18T21:09:51.831054+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":173,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":27987,"num_write":365,"num_write_kb":38689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"71'470","reported_seq":733,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.480352+0000","last_change":"2024-04-18T21:09:51.934073+0000","last_active":"2024-04-18T21:10:07.480352+0000","last_peered":"2024-04-18T21:10:07.480352+0000","last_clean":"2024-04-18T21:06:56.724047+0000","last_became_active":"2024-04-18T21:09:51.926836+0000","last_became_peered":"2024-04-18T21:09:51.926836+0000","last_unstale":"2024-04-18T21:10:07.480352+0000","last_undegraded":"2024-04-18T21:09:51.826935+0000","last_fullsized":"2024-04-18T21:09:51.811758+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":188,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":59273,"num_write":432,"num_write_kb":145930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'433","reported_seq":609,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.477460+0000","last_change":"2024-04-18T21:05:05.638338+0000","last_active":"2024-04-18T21:10:07.477460+0000","last_peered":"2024-04-18T21:10:07.477460+0000","last_clean":"2024-04-18T21:10:07.477460+0000","last_became_active":"2024-04-18T21:05:05.637567+0000","last_became_peered":"2024-04-18T21:05:05.637567+0000","last_unstale":"2024-04-18T21:10:07.477460+0000","last_undegraded":"2024-04-18T21:10:07.477460+0000","last_fullsized":"2024-04-18T21:10:07.477460+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5514,"num_write":403,"num_write_kb":26329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"71'418","reported_seq":635,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.477346+0000","last_change":"2024-04-18T21:05:05.643606+0000","last_active":"2024-04-18T21:10:07.477346+0000","last_peered":"2024-04-18T21:10:07.477346+0000","last_clean":"2024-04-18T21:10:07.477346+0000","last_became_active":"2024-04-18T21:05:05.642991+0000","last_became_peered":"2024-04-18T21:05:05.642991+0000","last_unstale":"2024-04-18T21:10:07.477346+0000","last_undegraded":"2024-04-18T21:10:07.477346+0000","last_fullsized":"2024-04-18T21:10:07.477346+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:01.841786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":29097,"num_write":386,"num_write_kb":88262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"71'479","reported_seq":698,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.532595+0000","last_change":"2024-04-18T21:10:07.549995+0000","last_active":"2024-04-18T21:10:08.532595+0000","last_peered":"2024-04-18T21:10:08.532595+0000","last_clean":"2024-04-18T21:10:08.532595+0000","last_became_active":"2024-04-18T21:10:07.544314+0000","last_became_peered":"2024-04-18T21:10:07.544314+0000","last_unstale":"2024-04-18T21:10:08.532595+0000","last_undegraded":"2024-04-18T21:10:08.532595+0000","last_fullsized":"2024-04-18T21:10:08.532595+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:52:34.340348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":24204,"num_write":452,"num_write_kb":114184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"71'407","reported_seq":611,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478134+0000","last_change":"2024-04-18T21:10:03.487961+0000","last_active":"2024-04-18T21:10:07.478134+0000","last_peered":"2024-04-18T21:10:07.478134+0000","last_clean":"2024-04-18T21:10:07.478134+0000","last_became_active":"2024-04-18T21:10:03.476552+0000","last_became_peered":"2024-04-18T21:10:03.476552+0000","last_unstale":"2024-04-18T21:10:07.478134+0000","last_undegraded":"2024-04-18T21:10:07.478134+0000","last_fullsized":"2024-04-18T21:10:07.478134+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:45:35.774025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":37766,"num_write":374,"num_write_kb":103984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'452","reported_seq":676,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.477807+0000","last_change":"2024-04-18T21:09:51.936910+0000","last_active":"2024-04-18T21:10:07.477807+0000","last_peered":"2024-04-18T21:10:07.477807+0000","last_clean":"2024-04-18T21:06:56.722577+0000","last_became_active":"2024-04-18T21:09:51.915967+0000","last_became_peered":"2024-04-18T21:09:51.915967+0000","last_unstale":"2024-04-18T21:10:07.477807+0000","last_undegraded":"2024-04-18T21:09:51.807076+0000","last_fullsized":"2024-04-18T21:09:51.791818+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":198,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27170,"num_write":421,"num_write_kb":39548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"71'427","reported_seq":610,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.534261+0000","last_change":"2024-04-18T21:10:03.544910+0000","last_active":"2024-04-18T21:10:08.534261+0000","last_peered":"2024-04-18T21:10:08.534261+0000","last_clean":"2024-04-18T21:10:08.534261+0000","last_became_active":"2024-04-18T21:10:03.539961+0000","last_became_peered":"2024-04-18T21:10:03.539961+0000","last_unstale":"2024-04-18T21:10:08.534261+0000","last_undegraded":"2024-04-18T21:10:08.534261+0000","last_fullsized":"2024-04-18T21:10:08.534261+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:06:34.839228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":11507,"num_write":407,"num_write_kb":50964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"71'471","reported_seq":671,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.482128+0000","last_change":"2024-04-18T21:05:05.649581+0000","last_active":"2024-04-18T21:10:07.482128+0000","last_peered":"2024-04-18T21:10:07.482128+0000","last_clean":"2024-04-18T21:10:07.482128+0000","last_became_active":"2024-04-18T21:05:05.648233+0000","last_became_peered":"2024-04-18T21:05:05.648233+0000","last_unstale":"2024-04-18T21:10:07.482128+0000","last_undegraded":"2024-04-18T21:10:07.482128+0000","last_fullsized":"2024-04-18T21:10:07.482128+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20857,"num_write":431,"num_write_kb":63677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'378","reported_seq":914,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478370+0000","last_change":"2024-04-18T21:09:55.493655+0000","last_active":"2024-04-18T21:10:07.478370+0000","last_peered":"2024-04-18T21:10:07.478370+0000","last_clean":"2024-04-18T21:10:07.478370+0000","last_became_active":"2024-04-18T21:09:55.490958+0000","last_became_peered":"2024-04-18T21:09:55.490958+0000","last_unstale":"2024-04-18T21:10:07.478370+0000","last_undegraded":"2024-04-18T21:10:07.478370+0000","last_fullsized":"2024-04-18T21:10:07.478370+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:52:16.541697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12573,"num_write":347,"num_write_kb":34434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'410","reported_seq":615,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.533182+0000","last_change":"2024-04-18T21:10:01.563947+0000","last_active":"2024-04-18T21:10:08.533182+0000","last_peered":"2024-04-18T21:10:08.533182+0000","last_clean":"2024-04-18T21:10:08.533182+0000","last_became_active":"2024-04-18T21:10:01.555367+0000","last_became_peered":"2024-04-18T21:10:01.555367+0000","last_unstale":"2024-04-18T21:10:08.533182+0000","last_undegraded":"2024-04-18T21:10:08.533182+0000","last_fullsized":"2024-04-18T21:10:08.533182+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:01:09.418419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":16926,"num_write":380,"num_write_kb":112804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"71'410","reported_seq":965,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.479229+0000","last_change":"2024-04-18T21:10:03.490605+0000","last_active":"2024-04-18T21:10:07.479229+0000","last_peered":"2024-04-18T21:10:07.479229+0000","last_clean":"2024-04-18T21:10:07.479229+0000","last_became_active":"2024-04-18T21:10:03.480985+0000","last_became_peered":"2024-04-18T21:10:03.480985+0000","last_unstale":"2024-04-18T21:10:07.479229+0000","last_undegraded":"2024-04-18T21:10:07.479229+0000","last_fullsized":"2024-04-18T21:10:07.479229+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:14:42.076110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":34811,"num_write":378,"num_write_kb":51242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'491","reported_seq":685,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.546388+0000","last_change":"2024-04-18T21:10:08.546388+0000","last_active":"2024-04-18T21:10:08.546388+0000","last_peered":"2024-04-18T21:10:08.546388+0000","last_clean":"2024-04-18T21:10:08.546388+0000","last_became_active":"2024-04-18T21:10:08.540487+0000","last_became_peered":"2024-04-18T21:10:08.540487+0000","last_unstale":"2024-04-18T21:10:08.546388+0000","last_undegraded":"2024-04-18T21:10:08.546388+0000","last_fullsized":"2024-04-18T21:10:08.546388+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:15:51.120517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":26902,"num_write":456,"num_write_kb":124778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":209,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"71'467","reported_seq":662,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.478242+0000","last_change":"2024-04-18T21:10:03.488499+0000","last_active":"2024-04-18T21:10:07.478242+0000","last_peered":"2024-04-18T21:10:07.478242+0000","last_clean":"2024-04-18T21:06:56.506258+0000","last_became_active":"2024-04-18T21:10:03.477945+0000","last_became_peered":"2024-04-18T21:10:03.477945+0000","last_unstale":"2024-04-18T21:10:07.478242+0000","last_undegraded":"2024-04-18T21:10:03.471107+0000","last_fullsized":"2024-04-18T21:10:03.470440+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":192,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":28114,"num_write":434,"num_write_kb":129325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'423","reported_seq":569,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.476609+0000","last_change":"2024-04-18T21:10:01.499421+0000","last_active":"2024-04-18T21:10:07.476609+0000","last_peered":"2024-04-18T21:10:07.476609+0000","last_clean":"2024-04-18T21:10:07.476609+0000","last_became_active":"2024-04-18T21:10:01.487074+0000","last_became_peered":"2024-04-18T21:10:01.487074+0000","last_unstale":"2024-04-18T21:10:07.476609+0000","last_undegraded":"2024-04-18T21:10:07.476609+0000","last_fullsized":"2024-04-18T21:10:07.476609+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:05:34.827814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8244,"num_write":393,"num_write_kb":58692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"71'389","reported_seq":594,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.532328+0000","last_change":"2024-04-18T21:09:58.542232+0000","last_active":"2024-04-18T21:10:08.532328+0000","last_peered":"2024-04-18T21:10:08.532328+0000","last_clean":"2024-04-18T21:10:08.532328+0000","last_became_active":"2024-04-18T21:09:58.537723+0000","last_became_peered":"2024-04-18T21:09:58.537723+0000","last_unstale":"2024-04-18T21:10:08.532328+0000","last_undegraded":"2024-04-18T21:10:08.532328+0000","last_fullsized":"2024-04-18T21:10:08.532328+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:26.786170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":24216,"num_write":349,"num_write_kb":43176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"70'425","reported_seq":595,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478429+0000","last_change":"2024-04-18T21:05:04.632748+0000","last_active":"2024-04-18T21:10:07.478429+0000","last_peered":"2024-04-18T21:10:07.478429+0000","last_clean":"2024-04-18T21:10:07.478429+0000","last_became_active":"2024-04-18T21:05:04.628407+0000","last_became_peered":"2024-04-18T21:05:04.628407+0000","last_unstale":"2024-04-18T21:10:07.478429+0000","last_undegraded":"2024-04-18T21:10:07.478429+0000","last_fullsized":"2024-04-18T21:10:07.478429+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:42:45.392908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":375,"num_write_kb":8348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"71'423","reported_seq":638,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.479682+0000","last_change":"2024-04-18T21:09:51.933346+0000","last_active":"2024-04-18T21:10:07.479682+0000","last_peered":"2024-04-18T21:10:07.479682+0000","last_clean":"2024-04-18T21:06:56.697536+0000","last_became_active":"2024-04-18T21:09:51.919893+0000","last_became_peered":"2024-04-18T21:09:51.919893+0000","last_unstale":"2024-04-18T21:10:07.479682+0000","last_undegraded":"2024-04-18T21:09:51.803847+0000","last_fullsized":"2024-04-18T21:09:51.783538+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":170,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":20096,"num_write":381,"num_write_kb":76351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"70'56","reported_seq":238,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478997+0000","last_change":"2024-04-18T21:10:00.500122+0000","last_active":"2024-04-18T21:10:07.478997+0000","last_peered":"2024-04-18T21:10:07.478997+0000","last_clean":"2024-04-18T21:10:07.478997+0000","last_became_active":"2024-04-18T21:10:00.489486+0000","last_became_peered":"2024-04-18T21:10:00.489486+0000","last_unstale":"2024-04-18T21:10:07.478997+0000","last_undegraded":"2024-04-18T21:10:07.478997+0000","last_fullsized":"2024-04-18T21:10:07.478997+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:58:08.269558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'442","reported_seq":1000,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.483286+0000","last_change":"2024-04-18T21:10:03.492109+0000","last_active":"2024-04-18T21:10:07.483286+0000","last_peered":"2024-04-18T21:10:07.483286+0000","last_clean":"2024-04-18T21:10:07.483286+0000","last_became_active":"2024-04-18T21:10:03.483050+0000","last_became_peered":"2024-04-18T21:10:03.483050+0000","last_unstale":"2024-04-18T21:10:07.483286+0000","last_undegraded":"2024-04-18T21:10:07.483286+0000","last_fullsized":"2024-04-18T21:10:07.483286+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:45.388623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13827,"num_write":415,"num_write_kb":79859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"70'62","reported_seq":56,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.531679+0000","last_change":"2024-04-18T21:09:50.868159+0000","last_active":"2024-04-18T21:10:08.531679+0000","last_peered":"2024-04-18T21:10:08.531679+0000","last_clean":"2024-04-18T21:10:08.531679+0000","last_became_active":"2024-04-18T21:09:50.867096+0000","last_became_peered":"2024-04-18T21:09:50.867096+0000","last_unstale":"2024-04-18T21:10:08.531679+0000","last_undegraded":"2024-04-18T21:10:08.531679+0000","last_fullsized":"2024-04-18T21:10:08.531679+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:09:57.047205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"71'398","reported_seq":613,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.481095+0000","last_change":"2024-04-18T21:10:01.498728+0000","last_active":"2024-04-18T21:10:07.481095+0000","last_peered":"2024-04-18T21:10:07.481095+0000","last_clean":"2024-04-18T21:10:07.481095+0000","last_became_active":"2024-04-18T21:10:01.495349+0000","last_became_peered":"2024-04-18T21:10:01.495349+0000","last_unstale":"2024-04-18T21:10:07.481095+0000","last_undegraded":"2024-04-18T21:10:07.481095+0000","last_fullsized":"2024-04-18T21:10:07.481095+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:01:48.618551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":17616,"num_write":360,"num_write_kb":58871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"70'66","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.477157+0000","last_change":"2024-04-18T21:10:00.496701+0000","last_active":"2024-04-18T21:10:07.477157+0000","last_peered":"2024-04-18T21:10:07.477157+0000","last_clean":"2024-04-18T21:10:07.477157+0000","last_became_active":"2024-04-18T21:10:00.495594+0000","last_became_peered":"2024-04-18T21:10:00.495594+0000","last_unstale":"2024-04-18T21:10:07.477157+0000","last_undegraded":"2024-04-18T21:10:07.477157+0000","last_fullsized":"2024-04-18T21:10:07.477157+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:11:32.991308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"70'135","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.479595+0000","last_change":"2024-04-18T21:10:00.493197+0000","last_active":"2024-04-18T21:10:07.479595+0000","last_peered":"2024-04-18T21:10:07.479595+0000","last_clean":"2024-04-18T21:10:07.479595+0000","last_became_active":"2024-04-18T21:10:00.491509+0000","last_became_peered":"2024-04-18T21:10:00.491509+0000","last_unstale":"2024-04-18T21:10:07.479595+0000","last_undegraded":"2024-04-18T21:10:07.479595+0000","last_fullsized":"2024-04-18T21:10:07.479595+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:57:29.595389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":7777508,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'410","reported_seq":586,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.531933+0000","last_change":"2024-04-18T21:10:06.553806+0000","last_active":"2024-04-18T21:10:08.531933+0000","last_peered":"2024-04-18T21:10:08.531933+0000","last_clean":"2024-04-18T21:10:08.531933+0000","last_became_active":"2024-04-18T21:10:06.548034+0000","last_became_peered":"2024-04-18T21:10:06.548034+0000","last_unstale":"2024-04-18T21:10:08.531933+0000","last_undegraded":"2024-04-18T21:10:08.531933+0000","last_fullsized":"2024-04-18T21:10:08.531933+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:20:56.265941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17055,"num_write":375,"num_write_kb":63331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"70'240","reported_seq":339,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.532585+0000","last_change":"2024-04-18T21:10:00.556212+0000","last_active":"2024-04-18T21:10:08.532585+0000","last_peered":"2024-04-18T21:10:08.532585+0000","last_clean":"2024-04-18T21:10:08.532585+0000","last_became_active":"2024-04-18T21:10:00.555486+0000","last_became_peered":"2024-04-18T21:10:00.555486+0000","last_unstale":"2024-04-18T21:10:08.532585+0000","last_undegraded":"2024-04-18T21:10:08.532585+0000","last_fullsized":"2024-04-18T21:10:08.532585+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:11.573984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":4191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"71'501","reported_seq":740,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.478829+0000","last_change":"2024-04-18T21:09:51.935429+0000","last_active":"2024-04-18T21:10:07.478829+0000","last_peered":"2024-04-18T21:10:07.478829+0000","last_clean":"2024-04-18T21:06:56.729630+0000","last_became_active":"2024-04-18T21:09:51.925059+0000","last_became_peered":"2024-04-18T21:09:51.925059+0000","last_unstale":"2024-04-18T21:10:07.478829+0000","last_undegraded":"2024-04-18T21:09:51.823027+0000","last_fullsized":"2024-04-18T21:09:51.807046+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":202,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":37662,"num_write":474,"num_write_kb":167663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"70'429","reported_seq":540,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478970+0000","last_change":"2024-04-18T21:10:00.493325+0000","last_active":"2024-04-18T21:10:07.478970+0000","last_peered":"2024-04-18T21:10:07.478970+0000","last_clean":"2024-04-18T21:10:07.478970+0000","last_became_active":"2024-04-18T21:10:00.491525+0000","last_became_peered":"2024-04-18T21:10:00.491525+0000","last_unstale":"2024-04-18T21:10:07.478970+0000","last_undegraded":"2024-04-18T21:10:07.478970+0000","last_fullsized":"2024-04-18T21:10:07.478970+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:27:59.637974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":377,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388678,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'440","reported_seq":624,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.479664+0000","last_change":"2024-04-18T21:10:01.497932+0000","last_active":"2024-04-18T21:10:07.479664+0000","last_peered":"2024-04-18T21:10:07.479664+0000","last_clean":"2024-04-18T21:10:07.479664+0000","last_became_active":"2024-04-18T21:10:01.486740+0000","last_became_peered":"2024-04-18T21:10:01.486740+0000","last_unstale":"2024-04-18T21:10:07.479664+0000","last_undegraded":"2024-04-18T21:10:07.479664+0000","last_fullsized":"2024-04-18T21:10:07.479664+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:34:43.515471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":42138,"num_write":408,"num_write_kb":96310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"70'59","reported_seq":229,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478177+0000","last_change":"2024-04-18T21:05:04.625520+0000","last_active":"2024-04-18T21:10:07.478177+0000","last_peered":"2024-04-18T21:10:07.478177+0000","last_clean":"2024-04-18T21:10:07.478177+0000","last_became_active":"2024-04-18T21:05:04.624656+0000","last_became_peered":"2024-04-18T21:05:04.624656+0000","last_unstale":"2024-04-18T21:10:07.478177+0000","last_undegraded":"2024-04-18T21:10:07.478177+0000","last_fullsized":"2024-04-18T21:10:07.478177+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:56:05.795125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"71'461","reported_seq":650,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478757+0000","last_change":"2024-04-18T21:05:05.649406+0000","last_active":"2024-04-18T21:10:07.478757+0000","last_peered":"2024-04-18T21:10:07.478757+0000","last_clean":"2024-04-18T21:10:07.478757+0000","last_became_active":"2024-04-18T21:05:05.648380+0000","last_became_peered":"2024-04-18T21:05:05.648380+0000","last_unstale":"2024-04-18T21:10:07.478757+0000","last_undegraded":"2024-04-18T21:10:07.478757+0000","last_fullsized":"2024-04-18T21:10:07.478757+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12852,"num_write":420,"num_write_kb":88506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"70'157","reported_seq":350,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.480178+0000","last_change":"2024-04-18T21:10:00.500141+0000","last_active":"2024-04-18T21:10:07.480178+0000","last_peered":"2024-04-18T21:10:07.480178+0000","last_clean":"2024-04-18T21:10:07.480178+0000","last_became_active":"2024-04-18T21:10:00.494630+0000","last_became_peered":"2024-04-18T21:10:00.494630+0000","last_unstale":"2024-04-18T21:10:07.480178+0000","last_undegraded":"2024-04-18T21:10:07.480178+0000","last_fullsized":"2024-04-18T21:10:07.480178+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:49:43.984354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":8250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'445","reported_seq":609,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.477666+0000","last_change":"2024-04-18T21:10:01.500937+0000","last_active":"2024-04-18T21:10:07.477666+0000","last_peered":"2024-04-18T21:10:07.477666+0000","last_clean":"2024-04-18T21:10:07.477666+0000","last_became_active":"2024-04-18T21:10:01.490691+0000","last_became_peered":"2024-04-18T21:10:01.490691+0000","last_unstale":"2024-04-18T21:10:07.477666+0000","last_undegraded":"2024-04-18T21:10:07.477666+0000","last_fullsized":"2024-04-18T21:10:07.477666+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:59:48.489145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17488,"num_write":410,"num_write_kb":50845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"70'124","reported_seq":294,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.479808+0000","last_change":"2024-04-18T21:05:04.634674+0000","last_active":"2024-04-18T21:10:07.479808+0000","last_peered":"2024-04-18T21:10:07.479808+0000","last_clean":"2024-04-18T21:10:07.479808+0000","last_became_active":"2024-04-18T21:05:04.632284+0000","last_became_peered":"2024-04-18T21:05:04.632284+0000","last_unstale":"2024-04-18T21:10:07.479808+0000","last_undegraded":"2024-04-18T21:10:07.479808+0000","last_fullsized":"2024-04-18T21:10:07.479808+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:09:18.466987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"71'400","reported_seq":559,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.478753+0000","last_change":"2024-04-18T21:10:01.502202+0000","last_active":"2024-04-18T21:10:07.478753+0000","last_peered":"2024-04-18T21:10:07.478753+0000","last_clean":"2024-04-18T21:09:48.744284+0000","last_became_active":"2024-04-18T21:10:01.496176+0000","last_became_peered":"2024-04-18T21:10:01.496176+0000","last_unstale":"2024-04-18T21:10:07.478753+0000","last_undegraded":"2024-04-18T21:10:01.486611+0000","last_fullsized":"2024-04-18T21:10:01.480189+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":175,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12586,"num_write":372,"num_write_kb":58856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":576854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"70'53","reported_seq":58,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.531340+0000","last_change":"2024-04-18T21:10:00.550936+0000","last_active":"2024-04-18T21:10:08.531340+0000","last_peered":"2024-04-18T21:10:08.531340+0000","last_clean":"2024-04-18T21:10:08.531340+0000","last_became_active":"2024-04-18T21:10:00.549987+0000","last_became_peered":"2024-04-18T21:10:00.549987+0000","last_unstale":"2024-04-18T21:10:08.531340+0000","last_undegraded":"2024-04-18T21:10:08.531340+0000","last_fullsized":"2024-04-18T21:10:08.531340+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:53:36.771516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"71'364","reported_seq":917,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478711+0000","last_change":"2024-04-18T21:09:58.478726+0000","last_active":"2024-04-18T21:10:07.478711+0000","last_peered":"2024-04-18T21:10:07.478711+0000","last_clean":"2024-04-18T21:10:07.478711+0000","last_became_active":"2024-04-18T21:09:58.473903+0000","last_became_peered":"2024-04-18T21:09:58.473903+0000","last_unstale":"2024-04-18T21:10:07.478711+0000","last_undegraded":"2024-04-18T21:10:07.478711+0000","last_fullsized":"2024-04-18T21:10:07.478711+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:40.377274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":37938,"num_write":336,"num_write_kb":42513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"70'460","reported_seq":549,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.531721+0000","last_change":"2024-04-18T21:09:53.545846+0000","last_active":"2024-04-18T21:10:08.531721+0000","last_peered":"2024-04-18T21:10:08.531721+0000","last_clean":"2024-04-18T21:10:08.531721+0000","last_became_active":"2024-04-18T21:09:53.544355+0000","last_became_peered":"2024-04-18T21:09:53.544355+0000","last_unstale":"2024-04-18T21:10:08.531721+0000","last_undegraded":"2024-04-18T21:10:08.531721+0000","last_fullsized":"2024-04-18T21:10:08.531721+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:34:16.776752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":406,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"71'404","reported_seq":597,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.481372+0000","last_change":"2024-04-18T21:09:51.933464+0000","last_active":"2024-04-18T21:10:07.481372+0000","last_peered":"2024-04-18T21:10:07.481372+0000","last_clean":"2024-04-18T21:06:56.714828+0000","last_became_active":"2024-04-18T21:09:51.918677+0000","last_became_peered":"2024-04-18T21:09:51.918677+0000","last_unstale":"2024-04-18T21:10:07.481372+0000","last_undegraded":"2024-04-18T21:09:51.824330+0000","last_fullsized":"2024-04-18T21:09:51.803729+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":174,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":7075,"num_write":367,"num_write_kb":62738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":357,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.477742+0000","last_change":"2024-04-18T21:10:00.497960+0000","last_active":"2024-04-18T21:10:07.477742+0000","last_peered":"2024-04-18T21:10:07.477742+0000","last_clean":"2024-04-18T21:10:07.477742+0000","last_became_active":"2024-04-18T21:10:00.496373+0000","last_became_peered":"2024-04-18T21:10:00.496373+0000","last_unstale":"2024-04-18T21:10:07.477742+0000","last_undegraded":"2024-04-18T21:10:07.477742+0000","last_fullsized":"2024-04-18T21:10:07.477742+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_clean_scrub_stamp":"2024-04-18T21:04:53.494814+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:56:52.975720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":133,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.479060+0000","last_change":"2024-04-18T21:10:00.487584+0000","last_active":"2024-04-18T21:10:07.479060+0000","last_peered":"2024-04-18T21:10:07.479060+0000","last_clean":"2024-04-18T21:10:07.479060+0000","last_became_active":"2024-04-18T21:10:00.486722+0000","last_became_peered":"2024-04-18T21:10:00.486722+0000","last_unstale":"2024-04-18T21:10:07.479060+0000","last_undegraded":"2024-04-18T21:10:07.479060+0000","last_fullsized":"2024-04-18T21:10:07.479060+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:17:03.176148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"70'595","reported_seq":724,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.479483+0000","last_change":"2024-04-18T21:10:03.488427+0000","last_active":"2024-04-18T21:10:07.479483+0000","last_peered":"2024-04-18T21:10:07.479483+0000","last_clean":"2024-04-18T21:10:07.479483+0000","last_became_active":"2024-04-18T21:10:03.481344+0000","last_became_peered":"2024-04-18T21:10:03.481344+0000","last_unstale":"2024-04-18T21:10:07.479483+0000","last_undegraded":"2024-04-18T21:10:07.479483+0000","last_fullsized":"2024-04-18T21:10:07.479483+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:41.583248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":539,"num_write_kb":8449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4689862,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'443","reported_seq":1063,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478684+0000","last_change":"2024-04-18T21:09:56.496310+0000","last_active":"2024-04-18T21:10:07.478684+0000","last_peered":"2024-04-18T21:10:07.478684+0000","last_clean":"2024-04-18T21:10:07.478684+0000","last_became_active":"2024-04-18T21:09:56.493327+0000","last_became_peered":"2024-04-18T21:09:56.493327+0000","last_unstale":"2024-04-18T21:10:07.478684+0000","last_undegraded":"2024-04-18T21:10:07.478684+0000","last_fullsized":"2024-04-18T21:10:07.478684+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:20:57.340997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":38975,"num_write":404,"num_write_kb":80038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":183,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.477469+0000","last_change":"2024-04-18T21:09:50.817029+0000","last_active":"2024-04-18T21:10:07.477469+0000","last_peered":"2024-04-18T21:10:07.477469+0000","last_clean":"2024-04-18T21:10:07.477469+0000","last_became_active":"2024-04-18T21:09:50.816543+0000","last_became_peered":"2024-04-18T21:09:50.816543+0000","last_unstale":"2024-04-18T21:10:07.477469+0000","last_undegraded":"2024-04-18T21:10:07.477469+0000","last_fullsized":"2024-04-18T21:10:07.477469+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:47:33.047727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"70'129","reported_seq":286,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.479217+0000","last_change":"2024-04-18T21:10:03.489109+0000","last_active":"2024-04-18T21:10:07.479217+0000","last_peered":"2024-04-18T21:10:07.479217+0000","last_clean":"2024-04-18T21:10:07.479217+0000","last_became_active":"2024-04-18T21:10:03.486859+0000","last_became_peered":"2024-04-18T21:10:03.486859+0000","last_unstale":"2024-04-18T21:10:07.479217+0000","last_undegraded":"2024-04-18T21:10:07.479217+0000","last_fullsized":"2024-04-18T21:10:07.479217+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:52:04.172480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466419,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":55,"num_read_kb":1405,"num_write":58,"num_write_kb":1469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'457","reported_seq":650,"reported_epoch":96,"state":"peering","last_fresh":"2024-04-18T21:10:08.535238+0000","last_change":"2024-04-18T21:10:08.535238+0000","last_active":"2024-04-18T21:09:50.773277+0000","last_peered":"2024-04-18T21:09:48.745635+0000","last_clean":"2024-04-18T21:06:56.314380+0000","last_became_active":"2024-04-18T21:06:57.813208+0000","last_became_peered":"2024-04-18T21:06:57.813208+0000","last_unstale":"2024-04-18T21:10:08.535238+0000","last_undegraded":"2024-04-18T21:10:08.535238+0000","last_fullsized":"2024-04-18T21:10:08.535238+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":27659,"num_write":426,"num_write_kb":80500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.480273+0000","last_change":"2024-04-18T21:09:50.832624+0000","last_active":"2024-04-18T21:10:07.480273+0000","last_peered":"2024-04-18T21:10:07.480273+0000","last_clean":"2024-04-18T21:10:07.480273+0000","last_became_active":"2024-04-18T21:09:50.831949+0000","last_became_peered":"2024-04-18T21:09:50.831949+0000","last_unstale":"2024-04-18T21:10:07.480273+0000","last_undegraded":"2024-04-18T21:10:07.480273+0000","last_fullsized":"2024-04-18T21:10:07.480273+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:35:45.986029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'170","reported_seq":344,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.531147+0000","last_change":"2024-04-18T21:09:53.538615+0000","last_active":"2024-04-18T21:10:08.531147+0000","last_peered":"2024-04-18T21:10:08.531147+0000","last_clean":"2024-04-18T21:10:08.531147+0000","last_became_active":"2024-04-18T21:09:53.537994+0000","last_became_peered":"2024-04-18T21:09:53.537994+0000","last_unstale":"2024-04-18T21:10:08.531147+0000","last_undegraded":"2024-04-18T21:10:08.531147+0000","last_fullsized":"2024-04-18T21:10:08.531147+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:02:34.372453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":8239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"71'346","reported_seq":571,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.481389+0000","last_change":"2024-04-18T21:09:51.933169+0000","last_active":"2024-04-18T21:10:07.481389+0000","last_peered":"2024-04-18T21:10:07.481389+0000","last_clean":"2024-04-18T21:06:56.661266+0000","last_became_active":"2024-04-18T21:09:51.914853+0000","last_became_peered":"2024-04-18T21:09:51.914853+0000","last_unstale":"2024-04-18T21:10:07.481389+0000","last_undegraded":"2024-04-18T21:09:51.829697+0000","last_fullsized":"2024-04-18T21:09:51.816524+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":153,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27042,"num_write":321,"num_write_kb":50693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.479939+0000","last_change":"2024-04-18T21:05:00.576606+0000","last_active":"2024-04-18T21:10:07.479939+0000","last_peered":"2024-04-18T21:10:07.479939+0000","last_clean":"2024-04-18T21:10:07.479939+0000","last_became_active":"2024-04-18T21:05:00.575951+0000","last_became_peered":"2024-04-18T21:05:00.575951+0000","last_unstale":"2024-04-18T21:10:07.479939+0000","last_undegraded":"2024-04-18T21:10:07.479939+0000","last_fullsized":"2024-04-18T21:10:07.479939+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:32:17.612481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"70'63","reported_seq":233,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478716+0000","last_change":"2024-04-18T21:05:04.627296+0000","last_active":"2024-04-18T21:10:07.478716+0000","last_peered":"2024-04-18T21:10:07.478716+0000","last_clean":"2024-04-18T21:10:07.478716+0000","last_became_active":"2024-04-18T21:05:04.626801+0000","last_became_peered":"2024-04-18T21:05:04.626801+0000","last_unstale":"2024-04-18T21:10:07.478716+0000","last_undegraded":"2024-04-18T21:10:07.478716+0000","last_fullsized":"2024-04-18T21:10:07.478716+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:46:36.285416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"71'406","reported_seq":1015,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.480589+0000","last_change":"2024-04-18T21:09:59.495686+0000","last_active":"2024-04-18T21:10:07.480589+0000","last_peered":"2024-04-18T21:10:07.480589+0000","last_clean":"2024-04-18T21:10:07.480589+0000","last_became_active":"2024-04-18T21:09:59.493248+0000","last_became_peered":"2024-04-18T21:09:59.493248+0000","last_unstale":"2024-04-18T21:10:07.480589+0000","last_undegraded":"2024-04-18T21:10:07.480589+0000","last_fullsized":"2024-04-18T21:10:07.480589+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:11:23.853682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":35332,"num_write":370,"num_write_kb":71807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"70'284","reported_seq":289,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.479256+0000","last_change":"2024-04-18T21:10:00.504958+0000","last_active":"2024-04-18T21:10:07.479256+0000","last_peered":"2024-04-18T21:10:07.479256+0000","last_clean":"2024-04-18T21:10:07.479256+0000","last_became_active":"2024-04-18T21:10:00.503851+0000","last_became_peered":"2024-04-18T21:10:00.503851+0000","last_unstale":"2024-04-18T21:10:07.479256+0000","last_undegraded":"2024-04-18T21:10:07.479256+0000","last_fullsized":"2024-04-18T21:10:07.479256+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:10:27.397258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":218,"num_write_kb":4194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.480983+0000","last_change":"2024-04-18T21:10:03.484148+0000","last_active":"2024-04-18T21:10:07.480983+0000","last_peered":"2024-04-18T21:10:07.480983+0000","last_clean":"2024-04-18T21:10:07.480983+0000","last_became_active":"2024-04-18T21:10:03.480071+0000","last_became_peered":"2024-04-18T21:10:03.480071+0000","last_unstale":"2024-04-18T21:10:07.480983+0000","last_undegraded":"2024-04-18T21:10:07.480983+0000","last_fullsized":"2024-04-18T21:10:07.480983+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:50:30.257039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'386","reported_seq":587,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.476568+0000","last_change":"2024-04-18T21:09:52.430978+0000","last_active":"2024-04-18T21:10:07.476568+0000","last_peered":"2024-04-18T21:10:07.476568+0000","last_clean":"2024-04-18T21:06:56.710639+0000","last_became_active":"2024-04-18T21:09:51.908732+0000","last_became_peered":"2024-04-18T21:09:51.908732+0000","last_unstale":"2024-04-18T21:10:07.476568+0000","last_undegraded":"2024-04-18T21:09:52.430630+0000","last_fullsized":"2024-04-18T21:09:51.772520+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":166,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14677,"num_write":355,"num_write_kb":51018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"70'55","reported_seq":231,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.480986+0000","last_change":"2024-04-18T21:09:50.833424+0000","last_active":"2024-04-18T21:10:07.480986+0000","last_peered":"2024-04-18T21:10:07.480986+0000","last_clean":"2024-04-18T21:10:07.480986+0000","last_became_active":"2024-04-18T21:09:50.832752+0000","last_became_peered":"2024-04-18T21:09:50.832752+0000","last_unstale":"2024-04-18T21:10:07.480986+0000","last_undegraded":"2024-04-18T21:10:07.480986+0000","last_fullsized":"2024-04-18T21:10:07.480986+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:48.945329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":141,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.533632+0000","last_change":"2024-04-18T21:09:50.900338+0000","last_active":"2024-04-18T21:10:08.533632+0000","last_peered":"2024-04-18T21:10:08.533632+0000","last_clean":"2024-04-18T21:10:08.533632+0000","last_became_active":"2024-04-18T21:09:50.896844+0000","last_became_peered":"2024-04-18T21:09:50.896844+0000","last_unstale":"2024-04-18T21:10:08.533632+0000","last_undegraded":"2024-04-18T21:10:08.533632+0000","last_fullsized":"2024-04-18T21:10:08.533632+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:11:35.543409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"71'402","reported_seq":567,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.532912+0000","last_change":"2024-04-18T21:10:05.542484+0000","last_active":"2024-04-18T21:10:08.532912+0000","last_peered":"2024-04-18T21:10:08.532912+0000","last_clean":"2024-04-18T21:10:08.532912+0000","last_became_active":"2024-04-18T21:10:05.536763+0000","last_became_peered":"2024-04-18T21:10:05.536763+0000","last_unstale":"2024-04-18T21:10:08.532912+0000","last_undegraded":"2024-04-18T21:10:08.532912+0000","last_fullsized":"2024-04-18T21:10:08.532912+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:08:22.367267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12468,"num_write":369,"num_write_kb":67231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"70'60","reported_seq":237,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.482521+0000","last_change":"2024-04-18T21:09:50.832598+0000","last_active":"2024-04-18T21:10:07.482521+0000","last_peered":"2024-04-18T21:10:07.482521+0000","last_clean":"2024-04-18T21:10:07.482521+0000","last_became_active":"2024-04-18T21:09:50.832030+0000","last_became_peered":"2024-04-18T21:09:50.832030+0000","last_unstale":"2024-04-18T21:10:07.482521+0000","last_undegraded":"2024-04-18T21:10:07.482521+0000","last_fullsized":"2024-04-18T21:10:07.482521+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:10:27.397258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.483586+0000","last_change":"2024-04-18T21:10:03.492761+0000","last_active":"2024-04-18T21:10:07.483586+0000","last_peered":"2024-04-18T21:10:07.483586+0000","last_clean":"2024-04-18T21:10:07.483586+0000","last_became_active":"2024-04-18T21:10:03.492145+0000","last_became_peered":"2024-04-18T21:10:03.492145+0000","last_unstale":"2024-04-18T21:10:07.483586+0000","last_undegraded":"2024-04-18T21:10:07.483586+0000","last_fullsized":"2024-04-18T21:10:07.483586+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:20:00.853523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'421","reported_seq":602,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.479646+0000","last_change":"2024-04-18T21:10:03.488774+0000","last_active":"2024-04-18T21:10:07.479646+0000","last_peered":"2024-04-18T21:10:07.479646+0000","last_clean":"2024-04-18T21:10:07.479646+0000","last_became_active":"2024-04-18T21:10:03.479773+0000","last_became_peered":"2024-04-18T21:10:03.479773+0000","last_unstale":"2024-04-18T21:10:07.479646+0000","last_undegraded":"2024-04-18T21:10:07.479646+0000","last_fullsized":"2024-04-18T21:10:07.479646+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:15:12.326904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":16183,"num_write":377,"num_write_kb":50451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"71'110","reported_seq":299,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.483583+0000","last_change":"2024-04-18T21:10:00.497917+0000","last_active":"2024-04-18T21:10:07.483583+0000","last_peered":"2024-04-18T21:10:07.483583+0000","last_clean":"2024-04-18T21:10:07.483583+0000","last_became_active":"2024-04-18T21:10:00.494644+0000","last_became_peered":"2024-04-18T21:10:00.494644+0000","last_unstale":"2024-04-18T21:10:07.483583+0000","last_undegraded":"2024-04-18T21:10:07.483583+0000","last_fullsized":"2024-04-18T21:10:07.483583+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:40:57.347353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":1251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":134,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.479598+0000","last_change":"2024-04-18T21:10:00.493764+0000","last_active":"2024-04-18T21:10:07.479598+0000","last_peered":"2024-04-18T21:10:07.479598+0000","last_clean":"2024-04-18T21:10:07.479598+0000","last_became_active":"2024-04-18T21:10:00.492672+0000","last_became_peered":"2024-04-18T21:10:00.492672+0000","last_unstale":"2024-04-18T21:10:07.479598+0000","last_undegraded":"2024-04-18T21:10:07.479598+0000","last_fullsized":"2024-04-18T21:10:07.479598+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:48:46.709401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'384","reported_seq":573,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.531961+0000","last_change":"2024-04-18T21:09:57.572865+0000","last_active":"2024-04-18T21:10:08.531961+0000","last_peered":"2024-04-18T21:10:08.531961+0000","last_clean":"2024-04-18T21:10:08.531961+0000","last_became_active":"2024-04-18T21:09:57.567962+0000","last_became_peered":"2024-04-18T21:09:57.567962+0000","last_unstale":"2024-04-18T21:10:08.531961+0000","last_undegraded":"2024-04-18T21:10:08.531961+0000","last_fullsized":"2024-04-18T21:10:08.531961+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:51:24.627186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":15567,"num_write":351,"num_write_kb":42959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"71'396","reported_seq":549,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.478153+0000","last_change":"2024-04-18T21:10:01.500036+0000","last_active":"2024-04-18T21:10:07.478153+0000","last_peered":"2024-04-18T21:10:07.478153+0000","last_clean":"2024-04-18T21:09:48.743028+0000","last_became_active":"2024-04-18T21:10:01.492175+0000","last_became_peered":"2024-04-18T21:10:01.492175+0000","last_unstale":"2024-04-18T21:10:07.478153+0000","last_undegraded":"2024-04-18T21:10:01.483082+0000","last_fullsized":"2024-04-18T21:10:01.476438+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":171,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12943,"num_write":353,"num_write_kb":35357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":3500882,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"71'277","reported_seq":292,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.477963+0000","last_change":"2024-04-18T21:10:00.495047+0000","last_active":"2024-04-18T21:10:07.477963+0000","last_peered":"2024-04-18T21:10:07.477963+0000","last_clean":"2024-04-18T21:10:07.477963+0000","last_became_active":"2024-04-18T21:10:00.493088+0000","last_became_peered":"2024-04-18T21:10:00.493088+0000","last_unstale":"2024-04-18T21:10:07.477963+0000","last_undegraded":"2024-04-18T21:10:07.477963+0000","last_fullsized":"2024-04-18T21:10:07.477963+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:39:08.263781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":221,"num_write_kb":8303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":8389370,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'411","reported_seq":981,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478348+0000","last_change":"2024-04-18T21:10:04.485332+0000","last_active":"2024-04-18T21:10:07.478348+0000","last_peered":"2024-04-18T21:10:07.478348+0000","last_clean":"2024-04-18T21:10:07.478348+0000","last_became_active":"2024-04-18T21:10:04.482320+0000","last_became_peered":"2024-04-18T21:10:04.482320+0000","last_unstale":"2024-04-18T21:10:07.478348+0000","last_undegraded":"2024-04-18T21:10:07.478348+0000","last_fullsized":"2024-04-18T21:10:07.478348+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:35:57.043682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":17179,"num_write":375,"num_write_kb":38991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"70'85","reported_seq":144,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.532976+0000","last_change":"2024-04-18T21:09:50.890616+0000","last_active":"2024-04-18T21:10:08.532976+0000","last_peered":"2024-04-18T21:10:08.532976+0000","last_clean":"2024-04-18T21:10:08.532976+0000","last_became_active":"2024-04-18T21:09:50.874855+0000","last_became_peered":"2024-04-18T21:09:50.874855+0000","last_unstale":"2024-04-18T21:10:08.532976+0000","last_undegraded":"2024-04-18T21:10:08.532976+0000","last_fullsized":"2024-04-18T21:10:08.532976+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:03:54.726282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"70'230","reported_seq":233,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.479167+0000","last_change":"2024-04-18T21:10:00.499373+0000","last_active":"2024-04-18T21:10:07.479167+0000","last_peered":"2024-04-18T21:10:07.479167+0000","last_clean":"2024-04-18T21:10:07.479167+0000","last_became_active":"2024-04-18T21:10:00.498141+0000","last_became_peered":"2024-04-18T21:10:00.498141+0000","last_unstale":"2024-04-18T21:10:07.479167+0000","last_undegraded":"2024-04-18T21:10:07.479167+0000","last_fullsized":"2024-04-18T21:10:07.479167+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:55:01.865593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":4178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"71'493","reported_seq":706,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478522+0000","last_change":"2024-04-18T21:05:05.642793+0000","last_active":"2024-04-18T21:10:07.478522+0000","last_peered":"2024-04-18T21:10:07.478522+0000","last_clean":"2024-04-18T21:10:07.478522+0000","last_became_active":"2024-04-18T21:05:05.641983+0000","last_became_peered":"2024-04-18T21:05:05.641983+0000","last_unstale":"2024-04-18T21:10:07.478522+0000","last_undegraded":"2024-04-18T21:10:07.478522+0000","last_fullsized":"2024-04-18T21:10:07.478522+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:46:36.339289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23833,"num_write":461,"num_write_kb":76873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"70'62","reported_seq":231,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.482063+0000","last_change":"2024-04-18T21:05:04.641445+0000","last_active":"2024-04-18T21:10:07.482063+0000","last_peered":"2024-04-18T21:10:07.482063+0000","last_clean":"2024-04-18T21:10:07.482063+0000","last_became_active":"2024-04-18T21:05:04.640682+0000","last_became_peered":"2024-04-18T21:05:04.640682+0000","last_unstale":"2024-04-18T21:10:07.482063+0000","last_undegraded":"2024-04-18T21:10:07.482063+0000","last_fullsized":"2024-04-18T21:10:07.482063+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:46:36.285416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'436","reported_seq":644,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.478935+0000","last_change":"2024-04-18T21:09:51.937322+0000","last_active":"2024-04-18T21:10:07.478935+0000","last_peered":"2024-04-18T21:10:07.478935+0000","last_clean":"2024-04-18T21:06:56.761407+0000","last_became_active":"2024-04-18T21:09:51.933205+0000","last_became_peered":"2024-04-18T21:09:51.933205+0000","last_unstale":"2024-04-18T21:10:07.478935+0000","last_undegraded":"2024-04-18T21:09:51.833249+0000","last_fullsized":"2024-04-18T21:09:51.824946+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":193,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14561,"num_write":408,"num_write_kb":47462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'369","reported_seq":547,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.534205+0000","last_change":"2024-04-18T21:10:02.553999+0000","last_active":"2024-04-18T21:10:08.534205+0000","last_peered":"2024-04-18T21:10:08.534205+0000","last_clean":"2024-04-18T21:10:08.534205+0000","last_became_active":"2024-04-18T21:10:02.549471+0000","last_became_peered":"2024-04-18T21:10:02.549471+0000","last_unstale":"2024-04-18T21:10:08.534205+0000","last_undegraded":"2024-04-18T21:10:08.534205+0000","last_fullsized":"2024-04-18T21:10:08.534205+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:52:14.371235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13619,"num_write":339,"num_write_kb":63086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"70'888","reported_seq":1004,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.480032+0000","last_change":"2024-04-18T21:10:03.486911+0000","last_active":"2024-04-18T21:10:07.480032+0000","last_peered":"2024-04-18T21:10:07.480032+0000","last_clean":"2024-04-18T21:10:07.480032+0000","last_became_active":"2024-04-18T21:10:03.480576+0000","last_became_peered":"2024-04-18T21:10:03.480576+0000","last_unstale":"2024-04-18T21:10:07.480032+0000","last_undegraded":"2024-04-18T21:10:07.480032+0000","last_fullsized":"2024-04-18T21:10:07.480032+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:41:06.632064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":823,"num_write_kb":8582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'398","reported_seq":536,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.481860+0000","last_change":"2024-04-18T21:10:03.491426+0000","last_active":"2024-04-18T21:10:07.481860+0000","last_peered":"2024-04-18T21:10:07.481860+0000","last_clean":"2024-04-18T21:10:07.481860+0000","last_became_active":"2024-04-18T21:10:03.483190+0000","last_became_peered":"2024-04-18T21:10:03.483190+0000","last_unstale":"2024-04-18T21:10:07.481860+0000","last_undegraded":"2024-04-18T21:10:07.481860+0000","last_fullsized":"2024-04-18T21:10:07.481860+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:05:10.611580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14684,"num_write":380,"num_write_kb":88822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"70'169","reported_seq":358,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.478915+0000","last_change":"2024-04-18T21:10:00.494974+0000","last_active":"2024-04-18T21:10:07.478915+0000","last_peered":"2024-04-18T21:10:07.478915+0000","last_clean":"2024-04-18T21:10:07.478915+0000","last_became_active":"2024-04-18T21:10:00.492196+0000","last_became_peered":"2024-04-18T21:10:00.492196+0000","last_unstale":"2024-04-18T21:10:07.478915+0000","last_undegraded":"2024-04-18T21:10:07.478915+0000","last_fullsized":"2024-04-18T21:10:07.478915+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:33:51.236211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":4162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'406","reported_seq":644,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.477513+0000","last_change":"2024-04-18T21:09:52.500269+0000","last_active":"2024-04-18T21:10:07.477513+0000","last_peered":"2024-04-18T21:10:07.477513+0000","last_clean":"2024-04-18T21:06:56.583905+0000","last_became_active":"2024-04-18T21:09:51.914607+0000","last_became_peered":"2024-04-18T21:09:51.914607+0000","last_unstale":"2024-04-18T21:10:07.477513+0000","last_undegraded":"2024-04-18T21:09:52.499843+0000","last_fullsized":"2024-04-18T21:09:51.772504+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":165,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27495,"num_write":363,"num_write_kb":89134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"72'192","reported_seq":361,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.532102+0000","last_change":"2024-04-18T21:09:53.541766+0000","last_active":"2024-04-18T21:10:08.532102+0000","last_peered":"2024-04-18T21:10:08.532102+0000","last_clean":"2024-04-18T21:10:08.532102+0000","last_became_active":"2024-04-18T21:09:53.541300+0000","last_became_peered":"2024-04-18T21:09:53.541300+0000","last_unstale":"2024-04-18T21:10:08.532102+0000","last_undegraded":"2024-04-18T21:10:08.532102+0000","last_fullsized":"2024-04-18T21:10:08.532102+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:26:14.718922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12425030,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":12201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8230726,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"71'383","reported_seq":593,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.532957+0000","last_change":"2024-04-18T21:09:55.555798+0000","last_active":"2024-04-18T21:10:08.532957+0000","last_peered":"2024-04-18T21:10:08.532957+0000","last_clean":"2024-04-18T21:10:08.532957+0000","last_became_active":"2024-04-18T21:09:55.551135+0000","last_became_peered":"2024-04-18T21:09:55.551135+0000","last_unstale":"2024-04-18T21:10:08.532957+0000","last_undegraded":"2024-04-18T21:10:08.532957+0000","last_fullsized":"2024-04-18T21:10:08.532957+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:00:01.739082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21614,"num_write":351,"num_write_kb":79501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"70'66","reported_seq":135,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.532968+0000","last_change":"2024-04-18T21:10:00.553114+0000","last_active":"2024-04-18T21:10:08.532968+0000","last_peered":"2024-04-18T21:10:08.532968+0000","last_clean":"2024-04-18T21:10:08.532968+0000","last_became_active":"2024-04-18T21:10:00.552067+0000","last_became_peered":"2024-04-18T21:10:00.552067+0000","last_unstale":"2024-04-18T21:10:08.532968+0000","last_undegraded":"2024-04-18T21:10:08.532968+0000","last_fullsized":"2024-04-18T21:10:08.532968+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:51:32.567297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"71'345","reported_seq":520,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.477790+0000","last_change":"2024-04-18T21:05:05.624840+0000","last_active":"2024-04-18T21:10:07.477790+0000","last_peered":"2024-04-18T21:10:07.477790+0000","last_clean":"2024-04-18T21:10:07.477790+0000","last_became_active":"2024-04-18T21:05:05.622950+0000","last_became_peered":"2024-04-18T21:05:05.622950+0000","last_unstale":"2024-04-18T21:10:07.477790+0000","last_undegraded":"2024-04-18T21:10:07.477790+0000","last_fullsized":"2024-04-18T21:10:07.477790+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:27:17.530889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":317,"num_write_kb":29335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"70'171","reported_seq":260,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.477750+0000","last_change":"2024-04-18T21:10:00.507624+0000","last_active":"2024-04-18T21:10:07.477750+0000","last_peered":"2024-04-18T21:10:07.477750+0000","last_clean":"2024-04-18T21:10:07.477750+0000","last_became_active":"2024-04-18T21:10:00.507132+0000","last_became_peered":"2024-04-18T21:10:00.507132+0000","last_unstale":"2024-04-18T21:10:07.477750+0000","last_undegraded":"2024-04-18T21:10:07.477750+0000","last_fullsized":"2024-04-18T21:10:07.477750+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:35:50.013019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":4154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"71'417","reported_seq":617,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.479514+0000","last_change":"2024-04-18T21:05:05.627962+0000","last_active":"2024-04-18T21:10:07.479514+0000","last_peered":"2024-04-18T21:10:07.479514+0000","last_clean":"2024-04-18T21:10:07.479514+0000","last_became_active":"2024-04-18T21:05:05.626698+0000","last_became_peered":"2024-04-18T21:05:05.626698+0000","last_unstale":"2024-04-18T21:10:07.479514+0000","last_undegraded":"2024-04-18T21:10:07.479514+0000","last_fullsized":"2024-04-18T21:10:07.479514+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:48:48.973087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":17040,"num_write":384,"num_write_kb":83740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"70'276","reported_seq":447,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.532462+0000","last_change":"2024-04-18T21:09:53.543611+0000","last_active":"2024-04-18T21:10:08.532462+0000","last_peered":"2024-04-18T21:10:08.532462+0000","last_clean":"2024-04-18T21:10:08.532462+0000","last_became_active":"2024-04-18T21:09:53.542863+0000","last_became_peered":"2024-04-18T21:09:53.542863+0000","last_unstale":"2024-04-18T21:10:08.532462+0000","last_undegraded":"2024-04-18T21:10:08.532462+0000","last_fullsized":"2024-04-18T21:10:08.532462+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:22.582074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":12399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"71'428","reported_seq":613,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.541152+0000","last_change":"2024-04-18T21:10:08.541152+0000","last_active":"2024-04-18T21:10:08.541152+0000","last_peered":"2024-04-18T21:10:08.541152+0000","last_clean":"2024-04-18T21:10:08.541152+0000","last_became_active":"2024-04-18T21:10:08.536423+0000","last_became_peered":"2024-04-18T21:10:08.536423+0000","last_unstale":"2024-04-18T21:10:08.541152+0000","last_undegraded":"2024-04-18T21:10:08.541152+0000","last_fullsized":"2024-04-18T21:10:08.541152+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:26.666677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22548,"num_write":398,"num_write_kb":75972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"70'70","reported_seq":247,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.482404+0000","last_change":"2024-04-18T21:09:50.833350+0000","last_active":"2024-04-18T21:10:07.482404+0000","last_peered":"2024-04-18T21:10:07.482404+0000","last_clean":"2024-04-18T21:10:07.482404+0000","last_became_active":"2024-04-18T21:09:50.832355+0000","last_became_peered":"2024-04-18T21:09:50.832355+0000","last_unstale":"2024-04-18T21:10:07.482404+0000","last_undegraded":"2024-04-18T21:10:07.482404+0000","last_fullsized":"2024-04-18T21:10:07.482404+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:39:09.627425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'459","reported_seq":616,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.476880+0000","last_change":"2024-04-18T21:10:01.503378+0000","last_active":"2024-04-18T21:10:07.476880+0000","last_peered":"2024-04-18T21:10:07.476880+0000","last_clean":"2024-04-18T21:10:07.476880+0000","last_became_active":"2024-04-18T21:10:01.497275+0000","last_became_peered":"2024-04-18T21:10:01.497275+0000","last_unstale":"2024-04-18T21:10:07.476880+0000","last_undegraded":"2024-04-18T21:10:07.476880+0000","last_fullsized":"2024-04-18T21:10:07.476880+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:40:35.832428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13353,"num_write":429,"num_write_kb":88123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"70'113","reported_seq":306,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-18T21:10:07.481828+0000","last_change":"2024-04-18T21:10:00.499468+0000","last_active":"2024-04-18T21:10:07.481828+0000","last_peered":"2024-04-18T21:10:07.481828+0000","last_clean":"2024-04-18T21:10:07.481828+0000","last_became_active":"2024-04-18T21:10:00.494734+0000","last_became_peered":"2024-04-18T21:10:00.494734+0000","last_unstale":"2024-04-18T21:10:07.481828+0000","last_undegraded":"2024-04-18T21:10:07.481828+0000","last_fullsized":"2024-04-18T21:10:07.481828+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:58:34.790588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194886,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3204,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2531,"num_read_kb":1304649,"num_write":24542,"num_write_kb":4299443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4748,"num_bytes_recovered":4488063,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":124755968,"data_stored":118078794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26603,"ondisk_log_size":26603,"up":128,"acting":110,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127139127,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":55,"num_read_kb":1405,"num_write":4542,"num_write_kb":127514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":92002768,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":279527424,"data_stored":279444842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4409,"internal_metadata":0},"log_size":6331,"ondisk_log_size":6331,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738436,"num_pgs":84,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":208484,"kb_used_data":105176,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94163356,"statfs":{"total":96636764160,"available":96423276544,"internally_reserved":0,"allocated":107700224,"data_stored":107174746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":77,"seq":330712481798,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":242836,"kb_used_data":205312,"kb_used_omap":5,"kb_used_meta":37498,"kb_avail":94129004,"statfs":{"total":96636764160,"available":96388100096,"internally_reserved":0,"allocated":210239488,"data_stored":202926276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6004,"internal_metadata":38398092},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738434,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":160340,"kb_used_data":88960,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94211500,"statfs":{"total":96636764160,"available":96472576000,"internally_reserved":0,"allocated":91095040,"data_stored":90560267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":89579520,"data_stored":89548273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":83750912,"data_stored":83729052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4409,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106196992,"data_stored":106167517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":124755968,"data_stored":118078794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:10:13.097 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-18T21:10:13.494 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:10:13.494 INFO:teuthology.orchestra.run.smithi078.stdout:{"fsid":"dc017990-0393-4ab0-b604-5e7052fdc7bd","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 3204/108 objects degraded (2966.667%), 18 pgs degraded","count":18},"muted":false}},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":330,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":101,"num_osds":3,"num_up_osds":3,"osd_up_since":1713474589,"num_in_osds":3,"osd_in_since":1713474284,"num_remapped_pgs":9},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":86},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":18},{"state_name":"peering","count":1}],"num_pgs":105,"num_pools":4,"num_objects":54,"data_bytes":127729495,"bytes_used":626339840,"bytes_avail":289283952640,"bytes_total":289910292480,"inactive_pgs_ratio":0.0095238098874688148,"degraded_objects":3204,"degraded_total":108,"degraded_ratio":29.666666666666671,"recovering_objects_per_sec":211,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":848,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4202}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-04-18T21:06:12.521737+0000","services":{}},"progress_events":{}} 2024-04-18T21:10:13.513 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-04-18T21:10:13.513 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:10:13.811 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:10:13.813 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-04-18T21:10:13.829 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":259,"stamp":"2024-04-18T21:10:13.468129+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127729495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2353,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2722,"num_read_kb":1306172,"num_write":29287,"num_write_kb":4430417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5515,"num_bytes_recovered":97081199,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33091,"ondisk_log_size":33091,"up":210,"acting":195,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":222,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":611784,"kb_used_data":399568,"kb_used_omap":8,"kb_used_meta":212151,"kb_avail":282503736,"statfs":{"total":289910292480,"available":289283825664,"internally_reserved":0,"allocated":409157632,"data_stored":400707836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9194,"internal_metadata":217242646},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-851,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":730,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001668"},"pg_stats":[{"pgid":"4.3f","version":"71'418","reported_seq":643,"reported_epoch":100,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:12.481512+0000","last_change":"2024-04-18T21:09:51.933769+0000","last_active":"2024-04-18T21:10:12.481512+0000","last_peered":"2024-04-18T21:10:12.481512+0000","last_clean":"2024-04-18T21:06:56.295490+0000","last_became_active":"2024-04-18T21:09:51.925977+0000","last_became_peered":"2024-04-18T21:09:51.925977+0000","last_unstale":"2024-04-18T21:10:12.481512+0000","last_undegraded":"2024-04-18T21:09:51.837482+0000","last_fullsized":"2024-04-18T21:09:51.829450+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":19677,"num_write":386,"num_write_kb":87615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"71'417","reported_seq":607,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.534086+0000","last_change":"2024-04-18T21:10:05.546965+0000","last_active":"2024-04-18T21:10:08.534086+0000","last_peered":"2024-04-18T21:10:08.534086+0000","last_clean":"2024-04-18T21:10:08.534086+0000","last_became_active":"2024-04-18T21:10:05.541170+0000","last_became_peered":"2024-04-18T21:10:05.541170+0000","last_unstale":"2024-04-18T21:10:08.534086+0000","last_undegraded":"2024-04-18T21:10:08.534086+0000","last_fullsized":"2024-04-18T21:10:08.534086+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:04:05.630763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":12123,"num_write":387,"num_write_kb":47157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"71'379","reported_seq":924,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479418+0000","last_change":"2024-04-18T21:09:54.480753+0000","last_active":"2024-04-18T21:10:12.479418+0000","last_peered":"2024-04-18T21:10:12.479418+0000","last_clean":"2024-04-18T21:10:12.479418+0000","last_became_active":"2024-04-18T21:09:54.478020+0000","last_became_peered":"2024-04-18T21:09:54.478020+0000","last_unstale":"2024-04-18T21:10:12.479418+0000","last_undegraded":"2024-04-18T21:10:12.479418+0000","last_fullsized":"2024-04-18T21:10:12.479418+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:24:18.705477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":10040,"num_write":353,"num_write_kb":63202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'372","reported_seq":558,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479140+0000","last_change":"2024-04-18T21:05:05.629321+0000","last_active":"2024-04-18T21:10:12.479140+0000","last_peered":"2024-04-18T21:10:12.479140+0000","last_clean":"2024-04-18T21:10:12.479140+0000","last_became_active":"2024-04-18T21:05:05.627956+0000","last_became_peered":"2024-04-18T21:05:05.627956+0000","last_unstale":"2024-04-18T21:10:12.479140+0000","last_undegraded":"2024-04-18T21:10:12.479140+0000","last_fullsized":"2024-04-18T21:10:12.479140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:15:28.458476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2735,"num_write":328,"num_write_kb":22107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"71'416","reported_seq":592,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.533227+0000","last_change":"2024-04-18T21:10:00.560644+0000","last_active":"2024-04-18T21:10:08.533227+0000","last_peered":"2024-04-18T21:10:08.533227+0000","last_clean":"2024-04-18T21:10:08.533227+0000","last_became_active":"2024-04-18T21:10:00.553862+0000","last_became_peered":"2024-04-18T21:10:00.553862+0000","last_unstale":"2024-04-18T21:10:08.533227+0000","last_undegraded":"2024-04-18T21:10:08.533227+0000","last_fullsized":"2024-04-18T21:10:08.533227+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:11:49.688538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6533,"num_write":389,"num_write_kb":43666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"71'374","reported_seq":558,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.478818+0000","last_change":"2024-04-18T21:10:01.495684+0000","last_active":"2024-04-18T21:10:12.478818+0000","last_peered":"2024-04-18T21:10:12.478818+0000","last_clean":"2024-04-18T21:10:12.478818+0000","last_became_active":"2024-04-18T21:10:01.486640+0000","last_became_peered":"2024-04-18T21:10:01.486640+0000","last_unstale":"2024-04-18T21:10:12.478818+0000","last_undegraded":"2024-04-18T21:10:12.478818+0000","last_fullsized":"2024-04-18T21:10:12.478818+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:39:10.639381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20415,"num_write":354,"num_write_kb":34462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'418","reported_seq":636,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480689+0000","last_change":"2024-04-18T21:05:05.625047+0000","last_active":"2024-04-18T21:10:12.480689+0000","last_peered":"2024-04-18T21:10:12.480689+0000","last_clean":"2024-04-18T21:10:12.480689+0000","last_became_active":"2024-04-18T21:05:05.622781+0000","last_became_peered":"2024-04-18T21:05:05.622781+0000","last_unstale":"2024-04-18T21:10:12.480689+0000","last_undegraded":"2024-04-18T21:10:12.480689+0000","last_fullsized":"2024-04-18T21:10:12.480689+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:12.944469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21103,"num_write":385,"num_write_kb":50678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"71'399","reported_seq":622,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.478359+0000","last_change":"2024-04-18T21:10:00.495543+0000","last_active":"2024-04-18T21:10:12.478359+0000","last_peered":"2024-04-18T21:10:12.478359+0000","last_clean":"2024-04-18T21:10:12.478359+0000","last_became_active":"2024-04-18T21:10:00.488705+0000","last_became_peered":"2024-04-18T21:10:00.488705+0000","last_unstale":"2024-04-18T21:10:12.478359+0000","last_undegraded":"2024-04-18T21:10:12.478359+0000","last_fullsized":"2024-04-18T21:10:12.478359+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:11.892092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":44692,"num_write":361,"num_write_kb":105170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"71'385","reported_seq":934,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480116+0000","last_change":"2024-04-18T21:10:06.487113+0000","last_active":"2024-04-18T21:10:12.480116+0000","last_peered":"2024-04-18T21:10:12.480116+0000","last_clean":"2024-04-18T21:10:12.480116+0000","last_became_active":"2024-04-18T21:10:06.482087+0000","last_became_peered":"2024-04-18T21:10:06.482087+0000","last_unstale":"2024-04-18T21:10:12.480116+0000","last_undegraded":"2024-04-18T21:10:12.480116+0000","last_fullsized":"2024-04-18T21:10:12.480116+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:10:51.435131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":994,"num_write":358,"num_write_kb":25964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'409","reported_seq":655,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.480927+0000","last_change":"2024-04-18T21:09:51.933299+0000","last_active":"2024-04-18T21:10:07.480927+0000","last_peered":"2024-04-18T21:10:07.480927+0000","last_clean":"2024-04-18T21:06:56.705266+0000","last_became_active":"2024-04-18T21:09:51.917102+0000","last_became_peered":"2024-04-18T21:09:51.917102+0000","last_unstale":"2024-04-18T21:10:07.480927+0000","last_undegraded":"2024-04-18T21:09:51.819800+0000","last_fullsized":"2024-04-18T21:09:51.800654+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":171,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":26170,"num_write":372,"num_write_kb":83931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"71'366","reported_seq":561,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479720+0000","last_change":"2024-04-18T21:10:01.496068+0000","last_active":"2024-04-18T21:10:12.479720+0000","last_peered":"2024-04-18T21:10:12.479720+0000","last_clean":"2024-04-18T21:10:12.479720+0000","last_became_active":"2024-04-18T21:10:01.488047+0000","last_became_peered":"2024-04-18T21:10:01.488047+0000","last_unstale":"2024-04-18T21:10:12.479720+0000","last_undegraded":"2024-04-18T21:10:12.479720+0000","last_fullsized":"2024-04-18T21:10:12.479720+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:49.957286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":18907,"num_write":347,"num_write_kb":26153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"71'346","reported_seq":525,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.533271+0000","last_change":"2024-04-18T21:10:00.560349+0000","last_active":"2024-04-18T21:10:08.533271+0000","last_peered":"2024-04-18T21:10:08.533271+0000","last_clean":"2024-04-18T21:10:08.533271+0000","last_became_active":"2024-04-18T21:10:00.557412+0000","last_became_peered":"2024-04-18T21:10:00.557412+0000","last_unstale":"2024-04-18T21:10:08.533271+0000","last_undegraded":"2024-04-18T21:10:08.533271+0000","last_fullsized":"2024-04-18T21:10:08.533271+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:54:33.428937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":6245,"num_write":324,"num_write_kb":37970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"71'417","reported_seq":614,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.533573+0000","last_change":"2024-04-18T21:10:02.555899+0000","last_active":"2024-04-18T21:10:08.533573+0000","last_peered":"2024-04-18T21:10:08.533573+0000","last_clean":"2024-04-18T21:10:08.533573+0000","last_became_active":"2024-04-18T21:10:02.551406+0000","last_became_peered":"2024-04-18T21:10:02.551406+0000","last_unstale":"2024-04-18T21:10:08.533573+0000","last_undegraded":"2024-04-18T21:10:08.533573+0000","last_fullsized":"2024-04-18T21:10:08.533573+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:41:17.455669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":21623,"num_write":381,"num_write_kb":71306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"71'398","reported_seq":961,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.478944+0000","last_change":"2024-04-18T21:10:11.491565+0000","last_active":"2024-04-18T21:10:12.478944+0000","last_peered":"2024-04-18T21:10:12.478944+0000","last_clean":"2024-04-18T21:10:12.478944+0000","last_became_active":"2024-04-18T21:10:11.486593+0000","last_became_peered":"2024-04-18T21:10:11.486593+0000","last_unstale":"2024-04-18T21:10:12.478944+0000","last_undegraded":"2024-04-18T21:10:12.478944+0000","last_fullsized":"2024-04-18T21:10:12.478944+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:11:23.853682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":369,"num_write_kb":30006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'435","reported_seq":733,"reported_epoch":100,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:12.478786+0000","last_change":"2024-04-18T21:10:01.504091+0000","last_active":"2024-04-18T21:10:12.478786+0000","last_peered":"2024-04-18T21:10:12.478786+0000","last_clean":"2024-04-18T21:09:48.742565+0000","last_became_active":"2024-04-18T21:10:01.499730+0000","last_became_peered":"2024-04-18T21:10:01.499730+0000","last_unstale":"2024-04-18T21:10:12.478786+0000","last_undegraded":"2024-04-18T21:10:01.482937+0000","last_fullsized":"2024-04-18T21:10:01.475971+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":173,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":31523,"num_write":402,"num_write_kb":121466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":410327,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'446","reported_seq":671,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.478353+0000","last_change":"2024-04-18T21:05:05.638203+0000","last_active":"2024-04-18T21:10:12.478353+0000","last_peered":"2024-04-18T21:10:12.478353+0000","last_clean":"2024-04-18T21:10:12.478353+0000","last_became_active":"2024-04-18T21:05:05.637352+0000","last_became_peered":"2024-04-18T21:05:05.637352+0000","last_unstale":"2024-04-18T21:10:12.478353+0000","last_undegraded":"2024-04-18T21:10:12.478353+0000","last_fullsized":"2024-04-18T21:10:12.478353+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":23833,"num_write":418,"num_write_kb":59679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"71'403","reported_seq":575,"reported_epoch":100,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:12.482094+0000","last_change":"2024-04-18T21:10:03.493121+0000","last_active":"2024-04-18T21:10:12.482094+0000","last_peered":"2024-04-18T21:10:12.482094+0000","last_clean":"2024-04-18T21:06:53.394905+0000","last_became_active":"2024-04-18T21:10:03.488943+0000","last_became_peered":"2024-04-18T21:10:03.488943+0000","last_unstale":"2024-04-18T21:10:12.482094+0000","last_undegraded":"2024-04-18T21:10:03.479306+0000","last_fullsized":"2024-04-18T21:10:03.477937+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":7482,"num_write":371,"num_write_kb":25957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'406","reported_seq":613,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.482341+0000","last_change":"2024-04-18T21:09:51.933105+0000","last_active":"2024-04-18T21:10:07.482341+0000","last_peered":"2024-04-18T21:10:07.482341+0000","last_clean":"2024-04-18T21:06:53.408988+0000","last_became_active":"2024-04-18T21:09:51.925620+0000","last_became_peered":"2024-04-18T21:09:51.925620+0000","last_unstale":"2024-04-18T21:10:07.482341+0000","last_undegraded":"2024-04-18T21:09:51.836579+0000","last_fullsized":"2024-04-18T21:09:51.831054+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":173,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":27987,"num_write":365,"num_write_kb":38689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"71'470","reported_seq":743,"reported_epoch":100,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:12.480747+0000","last_change":"2024-04-18T21:09:51.934073+0000","last_active":"2024-04-18T21:10:12.480747+0000","last_peered":"2024-04-18T21:10:12.480747+0000","last_clean":"2024-04-18T21:06:56.724047+0000","last_became_active":"2024-04-18T21:09:51.926836+0000","last_became_peered":"2024-04-18T21:09:51.926836+0000","last_unstale":"2024-04-18T21:10:12.480747+0000","last_undegraded":"2024-04-18T21:09:51.826935+0000","last_fullsized":"2024-04-18T21:09:51.811758+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":188,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":59273,"num_write":432,"num_write_kb":145930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'433","reported_seq":619,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479413+0000","last_change":"2024-04-18T21:05:05.638338+0000","last_active":"2024-04-18T21:10:12.479413+0000","last_peered":"2024-04-18T21:10:12.479413+0000","last_clean":"2024-04-18T21:10:12.479413+0000","last_became_active":"2024-04-18T21:05:05.637567+0000","last_became_peered":"2024-04-18T21:05:05.637567+0000","last_unstale":"2024-04-18T21:10:12.479413+0000","last_undegraded":"2024-04-18T21:10:12.479413+0000","last_fullsized":"2024-04-18T21:10:12.479413+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5514,"num_write":403,"num_write_kb":26329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"71'418","reported_seq":645,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.481188+0000","last_change":"2024-04-18T21:05:05.643606+0000","last_active":"2024-04-18T21:10:12.481188+0000","last_peered":"2024-04-18T21:10:12.481188+0000","last_clean":"2024-04-18T21:10:12.481188+0000","last_became_active":"2024-04-18T21:05:05.642991+0000","last_became_peered":"2024-04-18T21:05:05.642991+0000","last_unstale":"2024-04-18T21:10:12.481188+0000","last_undegraded":"2024-04-18T21:10:12.481188+0000","last_fullsized":"2024-04-18T21:10:12.481188+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:01.841786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":29097,"num_write":386,"num_write_kb":88262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"71'479","reported_seq":698,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.532595+0000","last_change":"2024-04-18T21:10:07.549995+0000","last_active":"2024-04-18T21:10:08.532595+0000","last_peered":"2024-04-18T21:10:08.532595+0000","last_clean":"2024-04-18T21:10:08.532595+0000","last_became_active":"2024-04-18T21:10:07.544314+0000","last_became_peered":"2024-04-18T21:10:07.544314+0000","last_unstale":"2024-04-18T21:10:08.532595+0000","last_undegraded":"2024-04-18T21:10:08.532595+0000","last_fullsized":"2024-04-18T21:10:08.532595+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:52:34.340348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":24204,"num_write":452,"num_write_kb":114184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"71'407","reported_seq":621,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.477929+0000","last_change":"2024-04-18T21:10:03.487961+0000","last_active":"2024-04-18T21:10:12.477929+0000","last_peered":"2024-04-18T21:10:12.477929+0000","last_clean":"2024-04-18T21:10:12.477929+0000","last_became_active":"2024-04-18T21:10:03.476552+0000","last_became_peered":"2024-04-18T21:10:03.476552+0000","last_unstale":"2024-04-18T21:10:12.477929+0000","last_undegraded":"2024-04-18T21:10:12.477929+0000","last_fullsized":"2024-04-18T21:10:12.477929+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:45:35.774025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":37766,"num_write":374,"num_write_kb":103984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'452","reported_seq":686,"reported_epoch":100,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:12.477667+0000","last_change":"2024-04-18T21:09:51.936910+0000","last_active":"2024-04-18T21:10:12.477667+0000","last_peered":"2024-04-18T21:10:12.477667+0000","last_clean":"2024-04-18T21:06:56.722577+0000","last_became_active":"2024-04-18T21:09:51.915967+0000","last_became_peered":"2024-04-18T21:09:51.915967+0000","last_unstale":"2024-04-18T21:10:12.477667+0000","last_undegraded":"2024-04-18T21:09:51.807076+0000","last_fullsized":"2024-04-18T21:09:51.791818+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":198,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27170,"num_write":421,"num_write_kb":39548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"71'427","reported_seq":610,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.534261+0000","last_change":"2024-04-18T21:10:03.544910+0000","last_active":"2024-04-18T21:10:08.534261+0000","last_peered":"2024-04-18T21:10:08.534261+0000","last_clean":"2024-04-18T21:10:08.534261+0000","last_became_active":"2024-04-18T21:10:03.539961+0000","last_became_peered":"2024-04-18T21:10:03.539961+0000","last_unstale":"2024-04-18T21:10:08.534261+0000","last_undegraded":"2024-04-18T21:10:08.534261+0000","last_fullsized":"2024-04-18T21:10:08.534261+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:06:34.839228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":11507,"num_write":407,"num_write_kb":50964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"71'471","reported_seq":681,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480805+0000","last_change":"2024-04-18T21:05:05.649581+0000","last_active":"2024-04-18T21:10:12.480805+0000","last_peered":"2024-04-18T21:10:12.480805+0000","last_clean":"2024-04-18T21:10:12.480805+0000","last_became_active":"2024-04-18T21:05:05.648233+0000","last_became_peered":"2024-04-18T21:05:05.648233+0000","last_unstale":"2024-04-18T21:10:12.480805+0000","last_undegraded":"2024-04-18T21:10:12.480805+0000","last_fullsized":"2024-04-18T21:10:12.480805+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20857,"num_write":431,"num_write_kb":63677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'378","reported_seq":924,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480254+0000","last_change":"2024-04-18T21:09:55.493655+0000","last_active":"2024-04-18T21:10:12.480254+0000","last_peered":"2024-04-18T21:10:12.480254+0000","last_clean":"2024-04-18T21:10:12.480254+0000","last_became_active":"2024-04-18T21:09:55.490958+0000","last_became_peered":"2024-04-18T21:09:55.490958+0000","last_unstale":"2024-04-18T21:10:12.480254+0000","last_undegraded":"2024-04-18T21:10:12.480254+0000","last_fullsized":"2024-04-18T21:10:12.480254+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:52:16.541697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12573,"num_write":347,"num_write_kb":34434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'410","reported_seq":615,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.533182+0000","last_change":"2024-04-18T21:10:01.563947+0000","last_active":"2024-04-18T21:10:08.533182+0000","last_peered":"2024-04-18T21:10:08.533182+0000","last_clean":"2024-04-18T21:10:08.533182+0000","last_became_active":"2024-04-18T21:10:01.555367+0000","last_became_peered":"2024-04-18T21:10:01.555367+0000","last_unstale":"2024-04-18T21:10:08.533182+0000","last_undegraded":"2024-04-18T21:10:08.533182+0000","last_fullsized":"2024-04-18T21:10:08.533182+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:01:09.418419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":16926,"num_write":380,"num_write_kb":112804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"71'410","reported_seq":975,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479546+0000","last_change":"2024-04-18T21:10:03.490605+0000","last_active":"2024-04-18T21:10:12.479546+0000","last_peered":"2024-04-18T21:10:12.479546+0000","last_clean":"2024-04-18T21:10:12.479546+0000","last_became_active":"2024-04-18T21:10:03.480985+0000","last_became_peered":"2024-04-18T21:10:03.480985+0000","last_unstale":"2024-04-18T21:10:12.479546+0000","last_undegraded":"2024-04-18T21:10:12.479546+0000","last_fullsized":"2024-04-18T21:10:12.479546+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:14:42.076110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":34811,"num_write":378,"num_write_kb":51242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'491","reported_seq":685,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.546388+0000","last_change":"2024-04-18T21:10:08.546388+0000","last_active":"2024-04-18T21:10:08.546388+0000","last_peered":"2024-04-18T21:10:08.546388+0000","last_clean":"2024-04-18T21:10:08.546388+0000","last_became_active":"2024-04-18T21:10:08.540487+0000","last_became_peered":"2024-04-18T21:10:08.540487+0000","last_unstale":"2024-04-18T21:10:08.546388+0000","last_undegraded":"2024-04-18T21:10:08.546388+0000","last_fullsized":"2024-04-18T21:10:08.546388+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:15:51.120517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":26902,"num_write":456,"num_write_kb":124778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":209,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"71'467","reported_seq":672,"reported_epoch":100,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:12.477951+0000","last_change":"2024-04-18T21:10:03.488499+0000","last_active":"2024-04-18T21:10:12.477951+0000","last_peered":"2024-04-18T21:10:12.477951+0000","last_clean":"2024-04-18T21:06:56.506258+0000","last_became_active":"2024-04-18T21:10:03.477945+0000","last_became_peered":"2024-04-18T21:10:03.477945+0000","last_unstale":"2024-04-18T21:10:12.477951+0000","last_undegraded":"2024-04-18T21:10:03.471107+0000","last_fullsized":"2024-04-18T21:10:03.470440+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":192,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":28114,"num_write":434,"num_write_kb":129325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'423","reported_seq":579,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479574+0000","last_change":"2024-04-18T21:10:01.499421+0000","last_active":"2024-04-18T21:10:12.479574+0000","last_peered":"2024-04-18T21:10:12.479574+0000","last_clean":"2024-04-18T21:10:12.479574+0000","last_became_active":"2024-04-18T21:10:01.487074+0000","last_became_peered":"2024-04-18T21:10:01.487074+0000","last_unstale":"2024-04-18T21:10:12.479574+0000","last_undegraded":"2024-04-18T21:10:12.479574+0000","last_fullsized":"2024-04-18T21:10:12.479574+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:05:34.827814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8244,"num_write":393,"num_write_kb":58692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"71'389","reported_seq":594,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.532328+0000","last_change":"2024-04-18T21:09:58.542232+0000","last_active":"2024-04-18T21:10:08.532328+0000","last_peered":"2024-04-18T21:10:08.532328+0000","last_clean":"2024-04-18T21:10:08.532328+0000","last_became_active":"2024-04-18T21:09:58.537723+0000","last_became_peered":"2024-04-18T21:09:58.537723+0000","last_unstale":"2024-04-18T21:10:08.532328+0000","last_undegraded":"2024-04-18T21:10:08.532328+0000","last_fullsized":"2024-04-18T21:10:08.532328+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:26.786170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":24216,"num_write":349,"num_write_kb":43176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"70'425","reported_seq":605,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.481588+0000","last_change":"2024-04-18T21:05:04.632748+0000","last_active":"2024-04-18T21:10:12.481588+0000","last_peered":"2024-04-18T21:10:12.481588+0000","last_clean":"2024-04-18T21:10:12.481588+0000","last_became_active":"2024-04-18T21:05:04.628407+0000","last_became_peered":"2024-04-18T21:05:04.628407+0000","last_unstale":"2024-04-18T21:10:12.481588+0000","last_undegraded":"2024-04-18T21:10:12.481588+0000","last_fullsized":"2024-04-18T21:10:12.481588+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:42:45.392908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":375,"num_write_kb":8348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"71'423","reported_seq":990,"reported_epoch":100,"state":"active+undersized+remapped","last_fresh":"2024-04-18T21:10:12.480070+0000","last_change":"2024-04-18T21:10:12.471727+0000","last_active":"2024-04-18T21:10:12.480070+0000","last_peered":"2024-04-18T21:10:12.480070+0000","last_clean":"2024-04-18T21:06:56.697536+0000","last_became_active":"2024-04-18T21:09:51.919893+0000","last_became_peered":"2024-04-18T21:09:51.919893+0000","last_unstale":"2024-04-18T21:10:12.480070+0000","last_undegraded":"2024-04-18T21:10:12.480070+0000","last_fullsized":"2024-04-18T21:09:51.783538+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":20096,"num_write":381,"num_write_kb":76351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"70'56","reported_seq":248,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.478351+0000","last_change":"2024-04-18T21:10:00.500122+0000","last_active":"2024-04-18T21:10:12.478351+0000","last_peered":"2024-04-18T21:10:12.478351+0000","last_clean":"2024-04-18T21:10:12.478351+0000","last_became_active":"2024-04-18T21:10:00.489486+0000","last_became_peered":"2024-04-18T21:10:00.489486+0000","last_unstale":"2024-04-18T21:10:12.478351+0000","last_undegraded":"2024-04-18T21:10:12.478351+0000","last_fullsized":"2024-04-18T21:10:12.478351+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:58:08.269558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'442","reported_seq":1010,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.481507+0000","last_change":"2024-04-18T21:10:03.492109+0000","last_active":"2024-04-18T21:10:12.481507+0000","last_peered":"2024-04-18T21:10:12.481507+0000","last_clean":"2024-04-18T21:10:12.481507+0000","last_became_active":"2024-04-18T21:10:03.483050+0000","last_became_peered":"2024-04-18T21:10:03.483050+0000","last_unstale":"2024-04-18T21:10:12.481507+0000","last_undegraded":"2024-04-18T21:10:12.481507+0000","last_fullsized":"2024-04-18T21:10:12.481507+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:45.388623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13827,"num_write":415,"num_write_kb":79859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"70'62","reported_seq":56,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.531679+0000","last_change":"2024-04-18T21:09:50.868159+0000","last_active":"2024-04-18T21:10:08.531679+0000","last_peered":"2024-04-18T21:10:08.531679+0000","last_clean":"2024-04-18T21:10:08.531679+0000","last_became_active":"2024-04-18T21:09:50.867096+0000","last_became_peered":"2024-04-18T21:09:50.867096+0000","last_unstale":"2024-04-18T21:10:08.531679+0000","last_undegraded":"2024-04-18T21:10:08.531679+0000","last_fullsized":"2024-04-18T21:10:08.531679+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:09:57.047205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"71'398","reported_seq":623,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480249+0000","last_change":"2024-04-18T21:10:01.498728+0000","last_active":"2024-04-18T21:10:12.480249+0000","last_peered":"2024-04-18T21:10:12.480249+0000","last_clean":"2024-04-18T21:10:12.480249+0000","last_became_active":"2024-04-18T21:10:01.495349+0000","last_became_peered":"2024-04-18T21:10:01.495349+0000","last_unstale":"2024-04-18T21:10:12.480249+0000","last_undegraded":"2024-04-18T21:10:12.480249+0000","last_fullsized":"2024-04-18T21:10:12.480249+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:01:48.618551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":17616,"num_write":360,"num_write_kb":58871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"70'66","reported_seq":165,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.478944+0000","last_change":"2024-04-18T21:10:00.496701+0000","last_active":"2024-04-18T21:10:12.478944+0000","last_peered":"2024-04-18T21:10:12.478944+0000","last_clean":"2024-04-18T21:10:12.478944+0000","last_became_active":"2024-04-18T21:10:00.495594+0000","last_became_peered":"2024-04-18T21:10:00.495594+0000","last_unstale":"2024-04-18T21:10:12.478944+0000","last_undegraded":"2024-04-18T21:10:12.478944+0000","last_fullsized":"2024-04-18T21:10:12.478944+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:11:32.991308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"70'135","reported_seq":52,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.481009+0000","last_change":"2024-04-18T21:10:00.493197+0000","last_active":"2024-04-18T21:10:12.481009+0000","last_peered":"2024-04-18T21:10:12.481009+0000","last_clean":"2024-04-18T21:10:12.481009+0000","last_became_active":"2024-04-18T21:10:00.491509+0000","last_became_peered":"2024-04-18T21:10:00.491509+0000","last_unstale":"2024-04-18T21:10:12.481009+0000","last_undegraded":"2024-04-18T21:10:12.481009+0000","last_fullsized":"2024-04-18T21:10:12.481009+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:57:29.595389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":7777508,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'410","reported_seq":586,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.531933+0000","last_change":"2024-04-18T21:10:06.553806+0000","last_active":"2024-04-18T21:10:08.531933+0000","last_peered":"2024-04-18T21:10:08.531933+0000","last_clean":"2024-04-18T21:10:08.531933+0000","last_became_active":"2024-04-18T21:10:06.548034+0000","last_became_peered":"2024-04-18T21:10:06.548034+0000","last_unstale":"2024-04-18T21:10:08.531933+0000","last_undegraded":"2024-04-18T21:10:08.531933+0000","last_fullsized":"2024-04-18T21:10:08.531933+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:20:56.265941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17055,"num_write":375,"num_write_kb":63331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"70'240","reported_seq":339,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.532585+0000","last_change":"2024-04-18T21:10:00.556212+0000","last_active":"2024-04-18T21:10:08.532585+0000","last_peered":"2024-04-18T21:10:08.532585+0000","last_clean":"2024-04-18T21:10:08.532585+0000","last_became_active":"2024-04-18T21:10:00.555486+0000","last_became_peered":"2024-04-18T21:10:00.555486+0000","last_unstale":"2024-04-18T21:10:08.532585+0000","last_undegraded":"2024-04-18T21:10:08.532585+0000","last_fullsized":"2024-04-18T21:10:08.532585+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:11.573984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":4191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"71'501","reported_seq":750,"reported_epoch":100,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:12.478568+0000","last_change":"2024-04-18T21:09:51.935429+0000","last_active":"2024-04-18T21:10:12.478568+0000","last_peered":"2024-04-18T21:10:12.478568+0000","last_clean":"2024-04-18T21:06:56.729630+0000","last_became_active":"2024-04-18T21:09:51.925059+0000","last_became_peered":"2024-04-18T21:09:51.925059+0000","last_unstale":"2024-04-18T21:10:12.478568+0000","last_undegraded":"2024-04-18T21:09:51.823027+0000","last_fullsized":"2024-04-18T21:09:51.807046+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":202,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":37662,"num_write":474,"num_write_kb":167663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"70'429","reported_seq":550,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480893+0000","last_change":"2024-04-18T21:10:00.493325+0000","last_active":"2024-04-18T21:10:12.480893+0000","last_peered":"2024-04-18T21:10:12.480893+0000","last_clean":"2024-04-18T21:10:12.480893+0000","last_became_active":"2024-04-18T21:10:00.491525+0000","last_became_peered":"2024-04-18T21:10:00.491525+0000","last_unstale":"2024-04-18T21:10:12.480893+0000","last_undegraded":"2024-04-18T21:10:12.480893+0000","last_fullsized":"2024-04-18T21:10:12.480893+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:27:59.637974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":377,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388678,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'440","reported_seq":634,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479867+0000","last_change":"2024-04-18T21:10:01.497932+0000","last_active":"2024-04-18T21:10:12.479867+0000","last_peered":"2024-04-18T21:10:12.479867+0000","last_clean":"2024-04-18T21:10:12.479867+0000","last_became_active":"2024-04-18T21:10:01.486740+0000","last_became_peered":"2024-04-18T21:10:01.486740+0000","last_unstale":"2024-04-18T21:10:12.479867+0000","last_undegraded":"2024-04-18T21:10:12.479867+0000","last_fullsized":"2024-04-18T21:10:12.479867+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:34:43.515471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":42138,"num_write":408,"num_write_kb":96310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"70'59","reported_seq":239,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480031+0000","last_change":"2024-04-18T21:05:04.625520+0000","last_active":"2024-04-18T21:10:12.480031+0000","last_peered":"2024-04-18T21:10:12.480031+0000","last_clean":"2024-04-18T21:10:12.480031+0000","last_became_active":"2024-04-18T21:05:04.624656+0000","last_became_peered":"2024-04-18T21:05:04.624656+0000","last_unstale":"2024-04-18T21:10:12.480031+0000","last_undegraded":"2024-04-18T21:10:12.480031+0000","last_fullsized":"2024-04-18T21:10:12.480031+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:56:05.795125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"71'461","reported_seq":660,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479054+0000","last_change":"2024-04-18T21:05:05.649406+0000","last_active":"2024-04-18T21:10:12.479054+0000","last_peered":"2024-04-18T21:10:12.479054+0000","last_clean":"2024-04-18T21:10:12.479054+0000","last_became_active":"2024-04-18T21:05:05.648380+0000","last_became_peered":"2024-04-18T21:05:05.648380+0000","last_unstale":"2024-04-18T21:10:12.479054+0000","last_undegraded":"2024-04-18T21:10:12.479054+0000","last_fullsized":"2024-04-18T21:10:12.479054+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12852,"num_write":420,"num_write_kb":88506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"70'157","reported_seq":360,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480612+0000","last_change":"2024-04-18T21:10:00.500141+0000","last_active":"2024-04-18T21:10:12.480612+0000","last_peered":"2024-04-18T21:10:12.480612+0000","last_clean":"2024-04-18T21:10:12.480612+0000","last_became_active":"2024-04-18T21:10:00.494630+0000","last_became_peered":"2024-04-18T21:10:00.494630+0000","last_unstale":"2024-04-18T21:10:12.480612+0000","last_undegraded":"2024-04-18T21:10:12.480612+0000","last_fullsized":"2024-04-18T21:10:12.480612+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:49:43.984354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":8250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'445","reported_seq":619,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479461+0000","last_change":"2024-04-18T21:10:01.500937+0000","last_active":"2024-04-18T21:10:12.479461+0000","last_peered":"2024-04-18T21:10:12.479461+0000","last_clean":"2024-04-18T21:10:12.479461+0000","last_became_active":"2024-04-18T21:10:01.490691+0000","last_became_peered":"2024-04-18T21:10:01.490691+0000","last_unstale":"2024-04-18T21:10:12.479461+0000","last_undegraded":"2024-04-18T21:10:12.479461+0000","last_fullsized":"2024-04-18T21:10:12.479461+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:59:48.489145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17488,"num_write":410,"num_write_kb":50845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"70'124","reported_seq":304,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480178+0000","last_change":"2024-04-18T21:05:04.634674+0000","last_active":"2024-04-18T21:10:12.480178+0000","last_peered":"2024-04-18T21:10:12.480178+0000","last_clean":"2024-04-18T21:10:12.480178+0000","last_became_active":"2024-04-18T21:05:04.632284+0000","last_became_peered":"2024-04-18T21:05:04.632284+0000","last_unstale":"2024-04-18T21:10:12.480178+0000","last_undegraded":"2024-04-18T21:10:12.480178+0000","last_fullsized":"2024-04-18T21:10:12.480178+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:09:18.466987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"71'400","reported_seq":678,"reported_epoch":100,"state":"active+recovering+undersized+remapped","last_fresh":"2024-04-18T21:10:12.669265+0000","last_change":"2024-04-18T21:10:12.477444+0000","last_active":"2024-04-18T21:10:12.669265+0000","last_peered":"2024-04-18T21:10:12.669265+0000","last_clean":"2024-04-18T21:09:48.744284+0000","last_became_active":"2024-04-18T21:10:01.496176+0000","last_became_peered":"2024-04-18T21:10:01.496176+0000","last_unstale":"2024-04-18T21:10:12.669265+0000","last_undegraded":"2024-04-18T21:10:12.669265+0000","last_fullsized":"2024-04-18T21:10:01.480189+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12586,"num_write":372,"num_write_kb":58856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":229,"num_bytes_recovered":576854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"70'53","reported_seq":58,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.531340+0000","last_change":"2024-04-18T21:10:00.550936+0000","last_active":"2024-04-18T21:10:08.531340+0000","last_peered":"2024-04-18T21:10:08.531340+0000","last_clean":"2024-04-18T21:10:08.531340+0000","last_became_active":"2024-04-18T21:10:00.549987+0000","last_became_peered":"2024-04-18T21:10:00.549987+0000","last_unstale":"2024-04-18T21:10:08.531340+0000","last_undegraded":"2024-04-18T21:10:08.531340+0000","last_fullsized":"2024-04-18T21:10:08.531340+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:53:36.771516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"71'364","reported_seq":927,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480632+0000","last_change":"2024-04-18T21:09:58.478726+0000","last_active":"2024-04-18T21:10:12.480632+0000","last_peered":"2024-04-18T21:10:12.480632+0000","last_clean":"2024-04-18T21:10:12.480632+0000","last_became_active":"2024-04-18T21:09:58.473903+0000","last_became_peered":"2024-04-18T21:09:58.473903+0000","last_unstale":"2024-04-18T21:10:12.480632+0000","last_undegraded":"2024-04-18T21:10:12.480632+0000","last_fullsized":"2024-04-18T21:10:12.480632+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:40.377274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":37938,"num_write":336,"num_write_kb":42513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"70'460","reported_seq":549,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.531721+0000","last_change":"2024-04-18T21:09:53.545846+0000","last_active":"2024-04-18T21:10:08.531721+0000","last_peered":"2024-04-18T21:10:08.531721+0000","last_clean":"2024-04-18T21:10:08.531721+0000","last_became_active":"2024-04-18T21:09:53.544355+0000","last_became_peered":"2024-04-18T21:09:53.544355+0000","last_unstale":"2024-04-18T21:10:08.531721+0000","last_undegraded":"2024-04-18T21:10:08.531721+0000","last_fullsized":"2024-04-18T21:10:08.531721+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:34:16.776752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":406,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"71'404","reported_seq":607,"reported_epoch":100,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:12.480553+0000","last_change":"2024-04-18T21:09:51.933464+0000","last_active":"2024-04-18T21:10:12.480553+0000","last_peered":"2024-04-18T21:10:12.480553+0000","last_clean":"2024-04-18T21:06:56.714828+0000","last_became_active":"2024-04-18T21:09:51.918677+0000","last_became_peered":"2024-04-18T21:09:51.918677+0000","last_unstale":"2024-04-18T21:10:12.480553+0000","last_undegraded":"2024-04-18T21:09:51.824330+0000","last_fullsized":"2024-04-18T21:09:51.803729+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":174,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":7075,"num_write":367,"num_write_kb":62738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":367,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480008+0000","last_change":"2024-04-18T21:10:00.497960+0000","last_active":"2024-04-18T21:10:12.480008+0000","last_peered":"2024-04-18T21:10:12.480008+0000","last_clean":"2024-04-18T21:10:12.480008+0000","last_became_active":"2024-04-18T21:10:00.496373+0000","last_became_peered":"2024-04-18T21:10:00.496373+0000","last_unstale":"2024-04-18T21:10:12.480008+0000","last_undegraded":"2024-04-18T21:10:12.480008+0000","last_fullsized":"2024-04-18T21:10:12.480008+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_clean_scrub_stamp":"2024-04-18T21:04:53.494814+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:56:52.975720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":143,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.482074+0000","last_change":"2024-04-18T21:10:00.487584+0000","last_active":"2024-04-18T21:10:12.482074+0000","last_peered":"2024-04-18T21:10:12.482074+0000","last_clean":"2024-04-18T21:10:12.482074+0000","last_became_active":"2024-04-18T21:10:00.486722+0000","last_became_peered":"2024-04-18T21:10:00.486722+0000","last_unstale":"2024-04-18T21:10:12.482074+0000","last_undegraded":"2024-04-18T21:10:12.482074+0000","last_fullsized":"2024-04-18T21:10:12.482074+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:17:03.176148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"70'595","reported_seq":734,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.478666+0000","last_change":"2024-04-18T21:10:03.488427+0000","last_active":"2024-04-18T21:10:12.478666+0000","last_peered":"2024-04-18T21:10:12.478666+0000","last_clean":"2024-04-18T21:10:12.478666+0000","last_became_active":"2024-04-18T21:10:03.481344+0000","last_became_peered":"2024-04-18T21:10:03.481344+0000","last_unstale":"2024-04-18T21:10:12.478666+0000","last_undegraded":"2024-04-18T21:10:12.478666+0000","last_fullsized":"2024-04-18T21:10:12.478666+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:41.583248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":539,"num_write_kb":8449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4689862,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'443","reported_seq":1073,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480568+0000","last_change":"2024-04-18T21:09:56.496310+0000","last_active":"2024-04-18T21:10:12.480568+0000","last_peered":"2024-04-18T21:10:12.480568+0000","last_clean":"2024-04-18T21:10:12.480568+0000","last_became_active":"2024-04-18T21:09:56.493327+0000","last_became_peered":"2024-04-18T21:09:56.493327+0000","last_unstale":"2024-04-18T21:10:12.480568+0000","last_undegraded":"2024-04-18T21:10:12.480568+0000","last_fullsized":"2024-04-18T21:10:12.480568+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:20:57.340997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":38975,"num_write":404,"num_write_kb":80038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":193,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479647+0000","last_change":"2024-04-18T21:09:50.817029+0000","last_active":"2024-04-18T21:10:12.479647+0000","last_peered":"2024-04-18T21:10:12.479647+0000","last_clean":"2024-04-18T21:10:12.479647+0000","last_became_active":"2024-04-18T21:09:50.816543+0000","last_became_peered":"2024-04-18T21:09:50.816543+0000","last_unstale":"2024-04-18T21:10:12.479647+0000","last_undegraded":"2024-04-18T21:10:12.479647+0000","last_fullsized":"2024-04-18T21:10:12.479647+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:47:33.047727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"70'129","reported_seq":296,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479259+0000","last_change":"2024-04-18T21:10:03.489109+0000","last_active":"2024-04-18T21:10:12.479259+0000","last_peered":"2024-04-18T21:10:12.479259+0000","last_clean":"2024-04-18T21:10:12.479259+0000","last_became_active":"2024-04-18T21:10:03.486859+0000","last_became_peered":"2024-04-18T21:10:03.486859+0000","last_unstale":"2024-04-18T21:10:12.479259+0000","last_undegraded":"2024-04-18T21:10:12.479259+0000","last_fullsized":"2024-04-18T21:10:12.479259+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:52:04.172480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466419,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":55,"num_read_kb":1405,"num_write":58,"num_write_kb":1469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'457","reported_seq":650,"reported_epoch":96,"state":"peering","last_fresh":"2024-04-18T21:10:08.535238+0000","last_change":"2024-04-18T21:10:08.535238+0000","last_active":"2024-04-18T21:09:50.773277+0000","last_peered":"2024-04-18T21:09:48.745635+0000","last_clean":"2024-04-18T21:06:56.314380+0000","last_became_active":"2024-04-18T21:06:57.813208+0000","last_became_peered":"2024-04-18T21:06:57.813208+0000","last_unstale":"2024-04-18T21:10:08.535238+0000","last_undegraded":"2024-04-18T21:10:08.535238+0000","last_fullsized":"2024-04-18T21:10:08.535238+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":27659,"num_write":426,"num_write_kb":80500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":192,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479746+0000","last_change":"2024-04-18T21:09:50.832624+0000","last_active":"2024-04-18T21:10:12.479746+0000","last_peered":"2024-04-18T21:10:12.479746+0000","last_clean":"2024-04-18T21:10:12.479746+0000","last_became_active":"2024-04-18T21:09:50.831949+0000","last_became_peered":"2024-04-18T21:09:50.831949+0000","last_unstale":"2024-04-18T21:10:12.479746+0000","last_undegraded":"2024-04-18T21:10:12.479746+0000","last_fullsized":"2024-04-18T21:10:12.479746+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:35:45.986029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'170","reported_seq":344,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.531147+0000","last_change":"2024-04-18T21:09:53.538615+0000","last_active":"2024-04-18T21:10:08.531147+0000","last_peered":"2024-04-18T21:10:08.531147+0000","last_clean":"2024-04-18T21:10:08.531147+0000","last_became_active":"2024-04-18T21:09:53.537994+0000","last_became_peered":"2024-04-18T21:09:53.537994+0000","last_unstale":"2024-04-18T21:10:08.531147+0000","last_undegraded":"2024-04-18T21:10:08.531147+0000","last_fullsized":"2024-04-18T21:10:08.531147+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:02:34.372453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":8239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"71'346","reported_seq":894,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.481122+0000","last_change":"2024-04-18T21:10:11.487541+0000","last_active":"2024-04-18T21:10:12.481122+0000","last_peered":"2024-04-18T21:10:12.481122+0000","last_clean":"2024-04-18T21:10:12.481122+0000","last_became_active":"2024-04-18T21:10:11.484662+0000","last_became_peered":"2024-04-18T21:10:11.484662+0000","last_unstale":"2024-04-18T21:10:12.481122+0000","last_undegraded":"2024-04-18T21:10:12.481122+0000","last_fullsized":"2024-04-18T21:10:12.481122+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:50:21.491862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27042,"num_write":321,"num_write_kb":50693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":186,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480436+0000","last_change":"2024-04-18T21:05:00.576606+0000","last_active":"2024-04-18T21:10:12.480436+0000","last_peered":"2024-04-18T21:10:12.480436+0000","last_clean":"2024-04-18T21:10:12.480436+0000","last_became_active":"2024-04-18T21:05:00.575951+0000","last_became_peered":"2024-04-18T21:05:00.575951+0000","last_unstale":"2024-04-18T21:10:12.480436+0000","last_undegraded":"2024-04-18T21:10:12.480436+0000","last_fullsized":"2024-04-18T21:10:12.480436+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:32:17.612481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"70'63","reported_seq":243,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.481819+0000","last_change":"2024-04-18T21:05:04.627296+0000","last_active":"2024-04-18T21:10:12.481819+0000","last_peered":"2024-04-18T21:10:12.481819+0000","last_clean":"2024-04-18T21:10:12.481819+0000","last_became_active":"2024-04-18T21:05:04.626801+0000","last_became_peered":"2024-04-18T21:05:04.626801+0000","last_unstale":"2024-04-18T21:10:12.481819+0000","last_undegraded":"2024-04-18T21:10:12.481819+0000","last_fullsized":"2024-04-18T21:10:12.481819+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:46:36.285416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"71'406","reported_seq":1025,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479591+0000","last_change":"2024-04-18T21:09:59.495686+0000","last_active":"2024-04-18T21:10:12.479591+0000","last_peered":"2024-04-18T21:10:12.479591+0000","last_clean":"2024-04-18T21:10:12.479591+0000","last_became_active":"2024-04-18T21:09:59.493248+0000","last_became_peered":"2024-04-18T21:09:59.493248+0000","last_unstale":"2024-04-18T21:10:12.479591+0000","last_undegraded":"2024-04-18T21:10:12.479591+0000","last_fullsized":"2024-04-18T21:10:12.479591+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:11:23.853682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":35332,"num_write":370,"num_write_kb":71807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"70'284","reported_seq":299,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.481194+0000","last_change":"2024-04-18T21:10:00.504958+0000","last_active":"2024-04-18T21:10:12.481194+0000","last_peered":"2024-04-18T21:10:12.481194+0000","last_clean":"2024-04-18T21:10:12.481194+0000","last_became_active":"2024-04-18T21:10:00.503851+0000","last_became_peered":"2024-04-18T21:10:00.503851+0000","last_unstale":"2024-04-18T21:10:12.481194+0000","last_undegraded":"2024-04-18T21:10:12.481194+0000","last_fullsized":"2024-04-18T21:10:12.481194+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:10:27.397258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":218,"num_write_kb":4194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":119,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480118+0000","last_change":"2024-04-18T21:10:03.484148+0000","last_active":"2024-04-18T21:10:12.480118+0000","last_peered":"2024-04-18T21:10:12.480118+0000","last_clean":"2024-04-18T21:10:12.480118+0000","last_became_active":"2024-04-18T21:10:03.480071+0000","last_became_peered":"2024-04-18T21:10:03.480071+0000","last_unstale":"2024-04-18T21:10:12.480118+0000","last_undegraded":"2024-04-18T21:10:12.480118+0000","last_fullsized":"2024-04-18T21:10:12.480118+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:50:30.257039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'386","reported_seq":587,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.476568+0000","last_change":"2024-04-18T21:09:52.430978+0000","last_active":"2024-04-18T21:10:07.476568+0000","last_peered":"2024-04-18T21:10:07.476568+0000","last_clean":"2024-04-18T21:06:56.710639+0000","last_became_active":"2024-04-18T21:09:51.908732+0000","last_became_peered":"2024-04-18T21:09:51.908732+0000","last_unstale":"2024-04-18T21:10:07.476568+0000","last_undegraded":"2024-04-18T21:09:52.430630+0000","last_fullsized":"2024-04-18T21:09:51.772520+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":166,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14677,"num_write":355,"num_write_kb":51018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"70'55","reported_seq":241,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480040+0000","last_change":"2024-04-18T21:09:50.833424+0000","last_active":"2024-04-18T21:10:12.480040+0000","last_peered":"2024-04-18T21:10:12.480040+0000","last_clean":"2024-04-18T21:10:12.480040+0000","last_became_active":"2024-04-18T21:09:50.832752+0000","last_became_peered":"2024-04-18T21:09:50.832752+0000","last_unstale":"2024-04-18T21:10:12.480040+0000","last_undegraded":"2024-04-18T21:10:12.480040+0000","last_fullsized":"2024-04-18T21:10:12.480040+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:48.945329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":141,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.533632+0000","last_change":"2024-04-18T21:09:50.900338+0000","last_active":"2024-04-18T21:10:08.533632+0000","last_peered":"2024-04-18T21:10:08.533632+0000","last_clean":"2024-04-18T21:10:08.533632+0000","last_became_active":"2024-04-18T21:09:50.896844+0000","last_became_peered":"2024-04-18T21:09:50.896844+0000","last_unstale":"2024-04-18T21:10:08.533632+0000","last_undegraded":"2024-04-18T21:10:08.533632+0000","last_fullsized":"2024-04-18T21:10:08.533632+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:11:35.543409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"71'402","reported_seq":567,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.532912+0000","last_change":"2024-04-18T21:10:05.542484+0000","last_active":"2024-04-18T21:10:08.532912+0000","last_peered":"2024-04-18T21:10:08.532912+0000","last_clean":"2024-04-18T21:10:08.532912+0000","last_became_active":"2024-04-18T21:10:05.536763+0000","last_became_peered":"2024-04-18T21:10:05.536763+0000","last_unstale":"2024-04-18T21:10:08.532912+0000","last_undegraded":"2024-04-18T21:10:08.532912+0000","last_fullsized":"2024-04-18T21:10:08.532912+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:08:22.367267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12468,"num_write":369,"num_write_kb":67231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"70'60","reported_seq":247,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.482159+0000","last_change":"2024-04-18T21:09:50.832598+0000","last_active":"2024-04-18T21:10:12.482159+0000","last_peered":"2024-04-18T21:10:12.482159+0000","last_clean":"2024-04-18T21:10:12.482159+0000","last_became_active":"2024-04-18T21:09:50.832030+0000","last_became_peered":"2024-04-18T21:09:50.832030+0000","last_unstale":"2024-04-18T21:10:12.482159+0000","last_undegraded":"2024-04-18T21:10:12.482159+0000","last_fullsized":"2024-04-18T21:10:12.482159+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:10:27.397258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":119,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.481784+0000","last_change":"2024-04-18T21:10:03.492761+0000","last_active":"2024-04-18T21:10:12.481784+0000","last_peered":"2024-04-18T21:10:12.481784+0000","last_clean":"2024-04-18T21:10:12.481784+0000","last_became_active":"2024-04-18T21:10:03.492145+0000","last_became_peered":"2024-04-18T21:10:03.492145+0000","last_unstale":"2024-04-18T21:10:12.481784+0000","last_undegraded":"2024-04-18T21:10:12.481784+0000","last_fullsized":"2024-04-18T21:10:12.481784+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:20:00.853523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'421","reported_seq":612,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479014+0000","last_change":"2024-04-18T21:10:03.488774+0000","last_active":"2024-04-18T21:10:12.479014+0000","last_peered":"2024-04-18T21:10:12.479014+0000","last_clean":"2024-04-18T21:10:12.479014+0000","last_became_active":"2024-04-18T21:10:03.479773+0000","last_became_peered":"2024-04-18T21:10:03.479773+0000","last_unstale":"2024-04-18T21:10:12.479014+0000","last_undegraded":"2024-04-18T21:10:12.479014+0000","last_fullsized":"2024-04-18T21:10:12.479014+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:15:12.326904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":16183,"num_write":377,"num_write_kb":50451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"71'110","reported_seq":309,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.481794+0000","last_change":"2024-04-18T21:10:00.497917+0000","last_active":"2024-04-18T21:10:12.481794+0000","last_peered":"2024-04-18T21:10:12.481794+0000","last_clean":"2024-04-18T21:10:12.481794+0000","last_became_active":"2024-04-18T21:10:00.494644+0000","last_became_peered":"2024-04-18T21:10:00.494644+0000","last_unstale":"2024-04-18T21:10:12.481794+0000","last_undegraded":"2024-04-18T21:10:12.481794+0000","last_fullsized":"2024-04-18T21:10:12.481794+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:40:57.347353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":1251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":144,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480980+0000","last_change":"2024-04-18T21:10:00.493764+0000","last_active":"2024-04-18T21:10:12.480980+0000","last_peered":"2024-04-18T21:10:12.480980+0000","last_clean":"2024-04-18T21:10:12.480980+0000","last_became_active":"2024-04-18T21:10:00.492672+0000","last_became_peered":"2024-04-18T21:10:00.492672+0000","last_unstale":"2024-04-18T21:10:12.480980+0000","last_undegraded":"2024-04-18T21:10:12.480980+0000","last_fullsized":"2024-04-18T21:10:12.480980+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:48:46.709401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'384","reported_seq":573,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.531961+0000","last_change":"2024-04-18T21:09:57.572865+0000","last_active":"2024-04-18T21:10:08.531961+0000","last_peered":"2024-04-18T21:10:08.531961+0000","last_clean":"2024-04-18T21:10:08.531961+0000","last_became_active":"2024-04-18T21:09:57.567962+0000","last_became_peered":"2024-04-18T21:09:57.567962+0000","last_unstale":"2024-04-18T21:10:08.531961+0000","last_undegraded":"2024-04-18T21:10:08.531961+0000","last_fullsized":"2024-04-18T21:10:08.531961+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:51:24.627186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":15567,"num_write":351,"num_write_kb":42959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"71'396","reported_seq":902,"reported_epoch":99,"state":"peering","last_fresh":"2024-04-18T21:10:11.920684+0000","last_change":"2024-04-18T21:10:12.482413+0000","last_active":"2024-04-18T21:10:12.482413+0000","last_peered":"2024-04-18T21:10:11.920684+0000","last_clean":"2024-04-18T21:09:48.743028+0000","last_became_active":"2024-04-18T21:10:01.492175+0000","last_became_peered":"2024-04-18T21:10:01.492175+0000","last_unstale":"2024-04-18T21:10:11.920684+0000","last_undegraded":"2024-04-18T21:10:11.920684+0000","last_fullsized":"2024-04-18T21:10:01.476438+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12943,"num_write":353,"num_write_kb":35357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":342,"num_bytes_recovered":3500882,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"71'277","reported_seq":302,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479820+0000","last_change":"2024-04-18T21:10:00.495047+0000","last_active":"2024-04-18T21:10:12.479820+0000","last_peered":"2024-04-18T21:10:12.479820+0000","last_clean":"2024-04-18T21:10:12.479820+0000","last_became_active":"2024-04-18T21:10:00.493088+0000","last_became_peered":"2024-04-18T21:10:00.493088+0000","last_unstale":"2024-04-18T21:10:12.479820+0000","last_undegraded":"2024-04-18T21:10:12.479820+0000","last_fullsized":"2024-04-18T21:10:12.479820+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:39:08.263781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":221,"num_write_kb":8303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":8389370,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'411","reported_seq":991,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.478217+0000","last_change":"2024-04-18T21:10:04.485332+0000","last_active":"2024-04-18T21:10:12.478217+0000","last_peered":"2024-04-18T21:10:12.478217+0000","last_clean":"2024-04-18T21:10:12.478217+0000","last_became_active":"2024-04-18T21:10:04.482320+0000","last_became_peered":"2024-04-18T21:10:04.482320+0000","last_unstale":"2024-04-18T21:10:12.478217+0000","last_undegraded":"2024-04-18T21:10:12.478217+0000","last_fullsized":"2024-04-18T21:10:12.478217+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:35:57.043682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":17179,"num_write":375,"num_write_kb":38991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"70'85","reported_seq":144,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.532976+0000","last_change":"2024-04-18T21:09:50.890616+0000","last_active":"2024-04-18T21:10:08.532976+0000","last_peered":"2024-04-18T21:10:08.532976+0000","last_clean":"2024-04-18T21:10:08.532976+0000","last_became_active":"2024-04-18T21:09:50.874855+0000","last_became_peered":"2024-04-18T21:09:50.874855+0000","last_unstale":"2024-04-18T21:10:08.532976+0000","last_undegraded":"2024-04-18T21:10:08.532976+0000","last_fullsized":"2024-04-18T21:10:08.532976+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:03:54.726282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"70'230","reported_seq":243,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480921+0000","last_change":"2024-04-18T21:10:00.499373+0000","last_active":"2024-04-18T21:10:12.480921+0000","last_peered":"2024-04-18T21:10:12.480921+0000","last_clean":"2024-04-18T21:10:12.480921+0000","last_became_active":"2024-04-18T21:10:00.498141+0000","last_became_peered":"2024-04-18T21:10:00.498141+0000","last_unstale":"2024-04-18T21:10:12.480921+0000","last_undegraded":"2024-04-18T21:10:12.480921+0000","last_fullsized":"2024-04-18T21:10:12.480921+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:55:01.865593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":4178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"71'493","reported_seq":716,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.478219+0000","last_change":"2024-04-18T21:05:05.642793+0000","last_active":"2024-04-18T21:10:12.478219+0000","last_peered":"2024-04-18T21:10:12.478219+0000","last_clean":"2024-04-18T21:10:12.478219+0000","last_became_active":"2024-04-18T21:05:05.641983+0000","last_became_peered":"2024-04-18T21:05:05.641983+0000","last_unstale":"2024-04-18T21:10:12.478219+0000","last_undegraded":"2024-04-18T21:10:12.478219+0000","last_fullsized":"2024-04-18T21:10:12.478219+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:46:36.339289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23833,"num_write":461,"num_write_kb":76873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"70'62","reported_seq":241,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.481994+0000","last_change":"2024-04-18T21:05:04.641445+0000","last_active":"2024-04-18T21:10:12.481994+0000","last_peered":"2024-04-18T21:10:12.481994+0000","last_clean":"2024-04-18T21:10:12.481994+0000","last_became_active":"2024-04-18T21:05:04.640682+0000","last_became_peered":"2024-04-18T21:05:04.640682+0000","last_unstale":"2024-04-18T21:10:12.481994+0000","last_undegraded":"2024-04-18T21:10:12.481994+0000","last_fullsized":"2024-04-18T21:10:12.481994+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:46:36.285416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'436","reported_seq":654,"reported_epoch":100,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:12.478427+0000","last_change":"2024-04-18T21:09:51.937322+0000","last_active":"2024-04-18T21:10:12.478427+0000","last_peered":"2024-04-18T21:10:12.478427+0000","last_clean":"2024-04-18T21:06:56.761407+0000","last_became_active":"2024-04-18T21:09:51.933205+0000","last_became_peered":"2024-04-18T21:09:51.933205+0000","last_unstale":"2024-04-18T21:10:12.478427+0000","last_undegraded":"2024-04-18T21:09:51.833249+0000","last_fullsized":"2024-04-18T21:09:51.824946+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":193,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14561,"num_write":408,"num_write_kb":47462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'369","reported_seq":547,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.534205+0000","last_change":"2024-04-18T21:10:02.553999+0000","last_active":"2024-04-18T21:10:08.534205+0000","last_peered":"2024-04-18T21:10:08.534205+0000","last_clean":"2024-04-18T21:10:08.534205+0000","last_became_active":"2024-04-18T21:10:02.549471+0000","last_became_peered":"2024-04-18T21:10:02.549471+0000","last_unstale":"2024-04-18T21:10:08.534205+0000","last_undegraded":"2024-04-18T21:10:08.534205+0000","last_fullsized":"2024-04-18T21:10:08.534205+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:52:14.371235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13619,"num_write":339,"num_write_kb":63086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"70'888","reported_seq":1014,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479326+0000","last_change":"2024-04-18T21:10:03.486911+0000","last_active":"2024-04-18T21:10:12.479326+0000","last_peered":"2024-04-18T21:10:12.479326+0000","last_clean":"2024-04-18T21:10:12.479326+0000","last_became_active":"2024-04-18T21:10:03.480576+0000","last_became_peered":"2024-04-18T21:10:03.480576+0000","last_unstale":"2024-04-18T21:10:12.479326+0000","last_undegraded":"2024-04-18T21:10:12.479326+0000","last_fullsized":"2024-04-18T21:10:12.479326+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:41:06.632064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":823,"num_write_kb":8582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'398","reported_seq":546,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480638+0000","last_change":"2024-04-18T21:10:03.491426+0000","last_active":"2024-04-18T21:10:12.480638+0000","last_peered":"2024-04-18T21:10:12.480638+0000","last_clean":"2024-04-18T21:10:12.480638+0000","last_became_active":"2024-04-18T21:10:03.483190+0000","last_became_peered":"2024-04-18T21:10:03.483190+0000","last_unstale":"2024-04-18T21:10:12.480638+0000","last_undegraded":"2024-04-18T21:10:12.480638+0000","last_fullsized":"2024-04-18T21:10:12.480638+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:05:10.611580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14684,"num_write":380,"num_write_kb":88822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"70'169","reported_seq":368,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.478953+0000","last_change":"2024-04-18T21:10:00.494974+0000","last_active":"2024-04-18T21:10:12.478953+0000","last_peered":"2024-04-18T21:10:12.478953+0000","last_clean":"2024-04-18T21:10:12.478953+0000","last_became_active":"2024-04-18T21:10:00.492196+0000","last_became_peered":"2024-04-18T21:10:00.492196+0000","last_unstale":"2024-04-18T21:10:12.478953+0000","last_undegraded":"2024-04-18T21:10:12.478953+0000","last_fullsized":"2024-04-18T21:10:12.478953+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:33:51.236211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":4162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'406","reported_seq":644,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:07.477513+0000","last_change":"2024-04-18T21:09:52.500269+0000","last_active":"2024-04-18T21:10:07.477513+0000","last_peered":"2024-04-18T21:10:07.477513+0000","last_clean":"2024-04-18T21:06:56.583905+0000","last_became_active":"2024-04-18T21:09:51.914607+0000","last_became_peered":"2024-04-18T21:09:51.914607+0000","last_unstale":"2024-04-18T21:10:07.477513+0000","last_undegraded":"2024-04-18T21:09:52.499843+0000","last_fullsized":"2024-04-18T21:09:51.772504+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":165,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27495,"num_write":363,"num_write_kb":89134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"72'192","reported_seq":361,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.532102+0000","last_change":"2024-04-18T21:09:53.541766+0000","last_active":"2024-04-18T21:10:08.532102+0000","last_peered":"2024-04-18T21:10:08.532102+0000","last_clean":"2024-04-18T21:10:08.532102+0000","last_became_active":"2024-04-18T21:09:53.541300+0000","last_became_peered":"2024-04-18T21:09:53.541300+0000","last_unstale":"2024-04-18T21:10:08.532102+0000","last_undegraded":"2024-04-18T21:10:08.532102+0000","last_fullsized":"2024-04-18T21:10:08.532102+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:26:14.718922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12425030,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":12201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8230726,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"71'383","reported_seq":593,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.532957+0000","last_change":"2024-04-18T21:09:55.555798+0000","last_active":"2024-04-18T21:10:08.532957+0000","last_peered":"2024-04-18T21:10:08.532957+0000","last_clean":"2024-04-18T21:10:08.532957+0000","last_became_active":"2024-04-18T21:09:55.551135+0000","last_became_peered":"2024-04-18T21:09:55.551135+0000","last_unstale":"2024-04-18T21:10:08.532957+0000","last_undegraded":"2024-04-18T21:10:08.532957+0000","last_fullsized":"2024-04-18T21:10:08.532957+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:00:01.739082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21614,"num_write":351,"num_write_kb":79501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"70'66","reported_seq":135,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.532968+0000","last_change":"2024-04-18T21:10:00.553114+0000","last_active":"2024-04-18T21:10:08.532968+0000","last_peered":"2024-04-18T21:10:08.532968+0000","last_clean":"2024-04-18T21:10:08.532968+0000","last_became_active":"2024-04-18T21:10:00.552067+0000","last_became_peered":"2024-04-18T21:10:00.552067+0000","last_unstale":"2024-04-18T21:10:08.532968+0000","last_undegraded":"2024-04-18T21:10:08.532968+0000","last_fullsized":"2024-04-18T21:10:08.532968+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:51:32.567297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"71'345","reported_seq":530,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.481398+0000","last_change":"2024-04-18T21:05:05.624840+0000","last_active":"2024-04-18T21:10:12.481398+0000","last_peered":"2024-04-18T21:10:12.481398+0000","last_clean":"2024-04-18T21:10:12.481398+0000","last_became_active":"2024-04-18T21:05:05.622950+0000","last_became_peered":"2024-04-18T21:05:05.622950+0000","last_unstale":"2024-04-18T21:10:12.481398+0000","last_undegraded":"2024-04-18T21:10:12.481398+0000","last_fullsized":"2024-04-18T21:10:12.481398+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:27:17.530889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":317,"num_write_kb":29335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"70'171","reported_seq":270,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479753+0000","last_change":"2024-04-18T21:10:00.507624+0000","last_active":"2024-04-18T21:10:12.479753+0000","last_peered":"2024-04-18T21:10:12.479753+0000","last_clean":"2024-04-18T21:10:12.479753+0000","last_became_active":"2024-04-18T21:10:00.507132+0000","last_became_peered":"2024-04-18T21:10:00.507132+0000","last_unstale":"2024-04-18T21:10:12.479753+0000","last_undegraded":"2024-04-18T21:10:12.479753+0000","last_fullsized":"2024-04-18T21:10:12.479753+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:35:50.013019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":4154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"71'417","reported_seq":627,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479578+0000","last_change":"2024-04-18T21:05:05.627962+0000","last_active":"2024-04-18T21:10:12.479578+0000","last_peered":"2024-04-18T21:10:12.479578+0000","last_clean":"2024-04-18T21:10:12.479578+0000","last_became_active":"2024-04-18T21:05:05.626698+0000","last_became_peered":"2024-04-18T21:05:05.626698+0000","last_unstale":"2024-04-18T21:10:12.479578+0000","last_undegraded":"2024-04-18T21:10:12.479578+0000","last_fullsized":"2024-04-18T21:10:12.479578+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:48:48.973087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":17040,"num_write":384,"num_write_kb":83740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"70'276","reported_seq":447,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.532462+0000","last_change":"2024-04-18T21:09:53.543611+0000","last_active":"2024-04-18T21:10:08.532462+0000","last_peered":"2024-04-18T21:10:08.532462+0000","last_clean":"2024-04-18T21:10:08.532462+0000","last_became_active":"2024-04-18T21:09:53.542863+0000","last_became_peered":"2024-04-18T21:09:53.542863+0000","last_unstale":"2024-04-18T21:10:08.532462+0000","last_undegraded":"2024-04-18T21:10:08.532462+0000","last_fullsized":"2024-04-18T21:10:08.532462+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:22.582074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":12399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"71'428","reported_seq":613,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-18T21:10:08.541152+0000","last_change":"2024-04-18T21:10:08.541152+0000","last_active":"2024-04-18T21:10:08.541152+0000","last_peered":"2024-04-18T21:10:08.541152+0000","last_clean":"2024-04-18T21:10:08.541152+0000","last_became_active":"2024-04-18T21:10:08.536423+0000","last_became_peered":"2024-04-18T21:10:08.536423+0000","last_unstale":"2024-04-18T21:10:08.541152+0000","last_undegraded":"2024-04-18T21:10:08.541152+0000","last_fullsized":"2024-04-18T21:10:08.541152+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:26.666677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22548,"num_write":398,"num_write_kb":75972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"70'70","reported_seq":257,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.481458+0000","last_change":"2024-04-18T21:09:50.833350+0000","last_active":"2024-04-18T21:10:12.481458+0000","last_peered":"2024-04-18T21:10:12.481458+0000","last_clean":"2024-04-18T21:10:12.481458+0000","last_became_active":"2024-04-18T21:09:50.832355+0000","last_became_peered":"2024-04-18T21:09:50.832355+0000","last_unstale":"2024-04-18T21:10:12.481458+0000","last_undegraded":"2024-04-18T21:10:12.481458+0000","last_fullsized":"2024-04-18T21:10:12.481458+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:39:09.627425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'459","reported_seq":626,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479306+0000","last_change":"2024-04-18T21:10:01.503378+0000","last_active":"2024-04-18T21:10:12.479306+0000","last_peered":"2024-04-18T21:10:12.479306+0000","last_clean":"2024-04-18T21:10:12.479306+0000","last_became_active":"2024-04-18T21:10:01.497275+0000","last_became_peered":"2024-04-18T21:10:01.497275+0000","last_unstale":"2024-04-18T21:10:12.479306+0000","last_undegraded":"2024-04-18T21:10:12.479306+0000","last_fullsized":"2024-04-18T21:10:12.479306+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:40:35.832428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13353,"num_write":429,"num_write_kb":88123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"70'113","reported_seq":316,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.481912+0000","last_change":"2024-04-18T21:10:00.499468+0000","last_active":"2024-04-18T21:10:12.481912+0000","last_peered":"2024-04-18T21:10:12.481912+0000","last_clean":"2024-04-18T21:10:12.481912+0000","last_became_active":"2024-04-18T21:10:00.494734+0000","last_became_peered":"2024-04-18T21:10:00.494734+0000","last_unstale":"2024-04-18T21:10:12.481912+0000","last_undegraded":"2024-04-18T21:10:12.481912+0000","last_fullsized":"2024-04-18T21:10:12.481912+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:58:34.790588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194886,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2353,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2531,"num_read_kb":1304649,"num_write":24542,"num_write_kb":4299443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5478,"num_bytes_recovered":4488063,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":124755968,"data_stored":118078794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26603,"ondisk_log_size":26603,"up":128,"acting":113,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127139127,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":55,"num_read_kb":1405,"num_write":4542,"num_write_kb":127514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":92002768,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":279527424,"data_stored":279444842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4409,"internal_metadata":0},"log_size":6331,"ondisk_log_size":6331,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738437,"num_pgs":84,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":208552,"kb_used_data":105236,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94163288,"statfs":{"total":96636764160,"available":96423206912,"internally_reserved":0,"allocated":107761664,"data_stored":107198134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":77,"seq":330712481798,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":242836,"kb_used_data":205312,"kb_used_omap":5,"kb_used_meta":37498,"kb_avail":94129004,"statfs":{"total":96636764160,"available":96388100096,"internally_reserved":0,"allocated":210239488,"data_stored":202926276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6004,"internal_metadata":38398092},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738435,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":160396,"kb_used_data":89020,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94211444,"statfs":{"total":96636764160,"available":96472518656,"internally_reserved":0,"allocated":91156480,"data_stored":90583426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":89579520,"data_stored":89548273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":83750912,"data_stored":83729052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4409,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106196992,"data_stored":106167517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":124755968,"data_stored":118078794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:10:16.834 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:10:17.146 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:10:17.148 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-04-18T21:10:17.161 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":264,"stamp":"2024-04-18T21:10:16.636452+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127729495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1678,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2722,"num_read_kb":1306172,"num_write":29287,"num_write_kb":4430417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6213,"num_bytes_recovered":97081199,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33091,"ondisk_log_size":33091,"up":210,"acting":200,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":222,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":586980,"kb_used_data":360880,"kb_used_omap":8,"kb_used_meta":226039,"kb_avail":282528540,"statfs":{"total":289910292480,"available":289309224960,"internally_reserved":0,"allocated":369541120,"data_stored":364440205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9194,"internal_metadata":231463958},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1526,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1428,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001547"},"pg_stats":[{"pgid":"4.3f","version":"71'418","reported_seq":643,"reported_epoch":100,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:12.481512+0000","last_change":"2024-04-18T21:09:51.933769+0000","last_active":"2024-04-18T21:10:12.481512+0000","last_peered":"2024-04-18T21:10:12.481512+0000","last_clean":"2024-04-18T21:06:56.295490+0000","last_became_active":"2024-04-18T21:09:51.925977+0000","last_became_peered":"2024-04-18T21:09:51.925977+0000","last_unstale":"2024-04-18T21:10:12.481512+0000","last_undegraded":"2024-04-18T21:09:51.837482+0000","last_fullsized":"2024-04-18T21:09:51.829450+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":19677,"num_write":386,"num_write_kb":87615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"71'417","reported_seq":617,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.533326+0000","last_change":"2024-04-18T21:10:05.546965+0000","last_active":"2024-04-18T21:10:13.533326+0000","last_peered":"2024-04-18T21:10:13.533326+0000","last_clean":"2024-04-18T21:10:13.533326+0000","last_became_active":"2024-04-18T21:10:05.541170+0000","last_became_peered":"2024-04-18T21:10:05.541170+0000","last_unstale":"2024-04-18T21:10:13.533326+0000","last_undegraded":"2024-04-18T21:10:13.533326+0000","last_fullsized":"2024-04-18T21:10:13.533326+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:04:05.630763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":12123,"num_write":387,"num_write_kb":47157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"71'379","reported_seq":924,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479418+0000","last_change":"2024-04-18T21:09:54.480753+0000","last_active":"2024-04-18T21:10:12.479418+0000","last_peered":"2024-04-18T21:10:12.479418+0000","last_clean":"2024-04-18T21:10:12.479418+0000","last_became_active":"2024-04-18T21:09:54.478020+0000","last_became_peered":"2024-04-18T21:09:54.478020+0000","last_unstale":"2024-04-18T21:10:12.479418+0000","last_undegraded":"2024-04-18T21:10:12.479418+0000","last_fullsized":"2024-04-18T21:10:12.479418+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:24:18.705477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":10040,"num_write":353,"num_write_kb":63202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'372","reported_seq":558,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479140+0000","last_change":"2024-04-18T21:05:05.629321+0000","last_active":"2024-04-18T21:10:12.479140+0000","last_peered":"2024-04-18T21:10:12.479140+0000","last_clean":"2024-04-18T21:10:12.479140+0000","last_became_active":"2024-04-18T21:05:05.627956+0000","last_became_peered":"2024-04-18T21:05:05.627956+0000","last_unstale":"2024-04-18T21:10:12.479140+0000","last_undegraded":"2024-04-18T21:10:12.479140+0000","last_fullsized":"2024-04-18T21:10:12.479140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:15:28.458476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2735,"num_write":328,"num_write_kb":22107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"71'416","reported_seq":602,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.531330+0000","last_change":"2024-04-18T21:10:00.560644+0000","last_active":"2024-04-18T21:10:13.531330+0000","last_peered":"2024-04-18T21:10:13.531330+0000","last_clean":"2024-04-18T21:10:13.531330+0000","last_became_active":"2024-04-18T21:10:00.553862+0000","last_became_peered":"2024-04-18T21:10:00.553862+0000","last_unstale":"2024-04-18T21:10:13.531330+0000","last_undegraded":"2024-04-18T21:10:13.531330+0000","last_fullsized":"2024-04-18T21:10:13.531330+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:11:49.688538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6533,"num_write":389,"num_write_kb":43666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"71'374","reported_seq":558,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.478818+0000","last_change":"2024-04-18T21:10:01.495684+0000","last_active":"2024-04-18T21:10:12.478818+0000","last_peered":"2024-04-18T21:10:12.478818+0000","last_clean":"2024-04-18T21:10:12.478818+0000","last_became_active":"2024-04-18T21:10:01.486640+0000","last_became_peered":"2024-04-18T21:10:01.486640+0000","last_unstale":"2024-04-18T21:10:12.478818+0000","last_undegraded":"2024-04-18T21:10:12.478818+0000","last_fullsized":"2024-04-18T21:10:12.478818+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:39:10.639381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20415,"num_write":354,"num_write_kb":34462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'418","reported_seq":636,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480689+0000","last_change":"2024-04-18T21:05:05.625047+0000","last_active":"2024-04-18T21:10:12.480689+0000","last_peered":"2024-04-18T21:10:12.480689+0000","last_clean":"2024-04-18T21:10:12.480689+0000","last_became_active":"2024-04-18T21:05:05.622781+0000","last_became_peered":"2024-04-18T21:05:05.622781+0000","last_unstale":"2024-04-18T21:10:12.480689+0000","last_undegraded":"2024-04-18T21:10:12.480689+0000","last_fullsized":"2024-04-18T21:10:12.480689+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:12.944469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21103,"num_write":385,"num_write_kb":50678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"71'399","reported_seq":622,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.478359+0000","last_change":"2024-04-18T21:10:00.495543+0000","last_active":"2024-04-18T21:10:12.478359+0000","last_peered":"2024-04-18T21:10:12.478359+0000","last_clean":"2024-04-18T21:10:12.478359+0000","last_became_active":"2024-04-18T21:10:00.488705+0000","last_became_peered":"2024-04-18T21:10:00.488705+0000","last_unstale":"2024-04-18T21:10:12.478359+0000","last_undegraded":"2024-04-18T21:10:12.478359+0000","last_fullsized":"2024-04-18T21:10:12.478359+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:11.892092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":44692,"num_write":361,"num_write_kb":105170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"71'385","reported_seq":934,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480116+0000","last_change":"2024-04-18T21:10:06.487113+0000","last_active":"2024-04-18T21:10:12.480116+0000","last_peered":"2024-04-18T21:10:12.480116+0000","last_clean":"2024-04-18T21:10:12.480116+0000","last_became_active":"2024-04-18T21:10:06.482087+0000","last_became_peered":"2024-04-18T21:10:06.482087+0000","last_unstale":"2024-04-18T21:10:12.480116+0000","last_undegraded":"2024-04-18T21:10:12.480116+0000","last_fullsized":"2024-04-18T21:10:12.480116+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:10:51.435131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":994,"num_write":358,"num_write_kb":25964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'409","reported_seq":630,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.533255+0000","last_change":"2024-04-18T21:10:12.550697+0000","last_active":"2024-04-18T21:10:13.533255+0000","last_peered":"2024-04-18T21:10:13.533255+0000","last_clean":"2024-04-18T21:10:13.533255+0000","last_became_active":"2024-04-18T21:10:12.546621+0000","last_became_peered":"2024-04-18T21:10:12.546621+0000","last_unstale":"2024-04-18T21:10:13.533255+0000","last_undegraded":"2024-04-18T21:10:13.533255+0000","last_fullsized":"2024-04-18T21:10:13.533255+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:55:30.422126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":26170,"num_write":372,"num_write_kb":83931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"71'366","reported_seq":561,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479720+0000","last_change":"2024-04-18T21:10:01.496068+0000","last_active":"2024-04-18T21:10:12.479720+0000","last_peered":"2024-04-18T21:10:12.479720+0000","last_clean":"2024-04-18T21:10:12.479720+0000","last_became_active":"2024-04-18T21:10:01.488047+0000","last_became_peered":"2024-04-18T21:10:01.488047+0000","last_unstale":"2024-04-18T21:10:12.479720+0000","last_undegraded":"2024-04-18T21:10:12.479720+0000","last_fullsized":"2024-04-18T21:10:12.479720+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:49.957286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":18907,"num_write":347,"num_write_kb":26153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"71'346","reported_seq":535,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.532529+0000","last_change":"2024-04-18T21:10:00.560349+0000","last_active":"2024-04-18T21:10:13.532529+0000","last_peered":"2024-04-18T21:10:13.532529+0000","last_clean":"2024-04-18T21:10:13.532529+0000","last_became_active":"2024-04-18T21:10:00.557412+0000","last_became_peered":"2024-04-18T21:10:00.557412+0000","last_unstale":"2024-04-18T21:10:13.532529+0000","last_undegraded":"2024-04-18T21:10:13.532529+0000","last_fullsized":"2024-04-18T21:10:13.532529+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:54:33.428937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":6245,"num_write":324,"num_write_kb":37970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"71'417","reported_seq":624,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.531829+0000","last_change":"2024-04-18T21:10:02.555899+0000","last_active":"2024-04-18T21:10:13.531829+0000","last_peered":"2024-04-18T21:10:13.531829+0000","last_clean":"2024-04-18T21:10:13.531829+0000","last_became_active":"2024-04-18T21:10:02.551406+0000","last_became_peered":"2024-04-18T21:10:02.551406+0000","last_unstale":"2024-04-18T21:10:13.531829+0000","last_undegraded":"2024-04-18T21:10:13.531829+0000","last_fullsized":"2024-04-18T21:10:13.531829+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:41:17.455669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":21623,"num_write":381,"num_write_kb":71306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"71'398","reported_seq":961,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.478944+0000","last_change":"2024-04-18T21:10:11.491565+0000","last_active":"2024-04-18T21:10:12.478944+0000","last_peered":"2024-04-18T21:10:12.478944+0000","last_clean":"2024-04-18T21:10:12.478944+0000","last_became_active":"2024-04-18T21:10:11.486593+0000","last_became_peered":"2024-04-18T21:10:11.486593+0000","last_unstale":"2024-04-18T21:10:12.478944+0000","last_undegraded":"2024-04-18T21:10:12.478944+0000","last_fullsized":"2024-04-18T21:10:12.478944+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:11:23.853682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":369,"num_write_kb":30006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'435","reported_seq":733,"reported_epoch":100,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:12.478786+0000","last_change":"2024-04-18T21:10:01.504091+0000","last_active":"2024-04-18T21:10:12.478786+0000","last_peered":"2024-04-18T21:10:12.478786+0000","last_clean":"2024-04-18T21:09:48.742565+0000","last_became_active":"2024-04-18T21:10:01.499730+0000","last_became_peered":"2024-04-18T21:10:01.499730+0000","last_unstale":"2024-04-18T21:10:12.478786+0000","last_undegraded":"2024-04-18T21:10:01.482937+0000","last_fullsized":"2024-04-18T21:10:01.475971+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":173,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":31523,"num_write":402,"num_write_kb":121466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":410327,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'446","reported_seq":671,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.478353+0000","last_change":"2024-04-18T21:05:05.638203+0000","last_active":"2024-04-18T21:10:12.478353+0000","last_peered":"2024-04-18T21:10:12.478353+0000","last_clean":"2024-04-18T21:10:12.478353+0000","last_became_active":"2024-04-18T21:05:05.637352+0000","last_became_peered":"2024-04-18T21:05:05.637352+0000","last_unstale":"2024-04-18T21:10:12.478353+0000","last_undegraded":"2024-04-18T21:10:12.478353+0000","last_fullsized":"2024-04-18T21:10:12.478353+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":23833,"num_write":418,"num_write_kb":59679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"71'403","reported_seq":575,"reported_epoch":100,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:12.482094+0000","last_change":"2024-04-18T21:10:03.493121+0000","last_active":"2024-04-18T21:10:12.482094+0000","last_peered":"2024-04-18T21:10:12.482094+0000","last_clean":"2024-04-18T21:06:53.394905+0000","last_became_active":"2024-04-18T21:10:03.488943+0000","last_became_peered":"2024-04-18T21:10:03.488943+0000","last_unstale":"2024-04-18T21:10:12.482094+0000","last_undegraded":"2024-04-18T21:10:03.479306+0000","last_fullsized":"2024-04-18T21:10:03.477937+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":7482,"num_write":371,"num_write_kb":25957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'406","reported_seq":592,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.532977+0000","last_change":"2024-04-18T21:10:10.547457+0000","last_active":"2024-04-18T21:10:13.532977+0000","last_peered":"2024-04-18T21:10:13.532977+0000","last_clean":"2024-04-18T21:10:13.532977+0000","last_became_active":"2024-04-18T21:10:10.542594+0000","last_became_peered":"2024-04-18T21:10:10.542594+0000","last_unstale":"2024-04-18T21:10:13.532977+0000","last_undegraded":"2024-04-18T21:10:13.532977+0000","last_fullsized":"2024-04-18T21:10:13.532977+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:51:58.437990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":27987,"num_write":365,"num_write_kb":38689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"71'470","reported_seq":743,"reported_epoch":100,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:12.480747+0000","last_change":"2024-04-18T21:09:51.934073+0000","last_active":"2024-04-18T21:10:12.480747+0000","last_peered":"2024-04-18T21:10:12.480747+0000","last_clean":"2024-04-18T21:06:56.724047+0000","last_became_active":"2024-04-18T21:09:51.926836+0000","last_became_peered":"2024-04-18T21:09:51.926836+0000","last_unstale":"2024-04-18T21:10:12.480747+0000","last_undegraded":"2024-04-18T21:09:51.826935+0000","last_fullsized":"2024-04-18T21:09:51.811758+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":188,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":59273,"num_write":432,"num_write_kb":145930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'433","reported_seq":619,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479413+0000","last_change":"2024-04-18T21:05:05.638338+0000","last_active":"2024-04-18T21:10:12.479413+0000","last_peered":"2024-04-18T21:10:12.479413+0000","last_clean":"2024-04-18T21:10:12.479413+0000","last_became_active":"2024-04-18T21:05:05.637567+0000","last_became_peered":"2024-04-18T21:05:05.637567+0000","last_unstale":"2024-04-18T21:10:12.479413+0000","last_undegraded":"2024-04-18T21:10:12.479413+0000","last_fullsized":"2024-04-18T21:10:12.479413+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5514,"num_write":403,"num_write_kb":26329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"71'418","reported_seq":645,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.481188+0000","last_change":"2024-04-18T21:05:05.643606+0000","last_active":"2024-04-18T21:10:12.481188+0000","last_peered":"2024-04-18T21:10:12.481188+0000","last_clean":"2024-04-18T21:10:12.481188+0000","last_became_active":"2024-04-18T21:05:05.642991+0000","last_became_peered":"2024-04-18T21:05:05.642991+0000","last_unstale":"2024-04-18T21:10:12.481188+0000","last_undegraded":"2024-04-18T21:10:12.481188+0000","last_fullsized":"2024-04-18T21:10:12.481188+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:01.841786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":29097,"num_write":386,"num_write_kb":88262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"71'479","reported_seq":708,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.532348+0000","last_change":"2024-04-18T21:10:07.549995+0000","last_active":"2024-04-18T21:10:13.532348+0000","last_peered":"2024-04-18T21:10:13.532348+0000","last_clean":"2024-04-18T21:10:13.532348+0000","last_became_active":"2024-04-18T21:10:07.544314+0000","last_became_peered":"2024-04-18T21:10:07.544314+0000","last_unstale":"2024-04-18T21:10:13.532348+0000","last_undegraded":"2024-04-18T21:10:13.532348+0000","last_fullsized":"2024-04-18T21:10:13.532348+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:52:34.340348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":24204,"num_write":452,"num_write_kb":114184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"71'407","reported_seq":621,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.477929+0000","last_change":"2024-04-18T21:10:03.487961+0000","last_active":"2024-04-18T21:10:12.477929+0000","last_peered":"2024-04-18T21:10:12.477929+0000","last_clean":"2024-04-18T21:10:12.477929+0000","last_became_active":"2024-04-18T21:10:03.476552+0000","last_became_peered":"2024-04-18T21:10:03.476552+0000","last_unstale":"2024-04-18T21:10:12.477929+0000","last_undegraded":"2024-04-18T21:10:12.477929+0000","last_fullsized":"2024-04-18T21:10:12.477929+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:45:35.774025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":37766,"num_write":374,"num_write_kb":103984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'452","reported_seq":686,"reported_epoch":100,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:12.477667+0000","last_change":"2024-04-18T21:09:51.936910+0000","last_active":"2024-04-18T21:10:12.477667+0000","last_peered":"2024-04-18T21:10:12.477667+0000","last_clean":"2024-04-18T21:06:56.722577+0000","last_became_active":"2024-04-18T21:09:51.915967+0000","last_became_peered":"2024-04-18T21:09:51.915967+0000","last_unstale":"2024-04-18T21:10:12.477667+0000","last_undegraded":"2024-04-18T21:09:51.807076+0000","last_fullsized":"2024-04-18T21:09:51.791818+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":198,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27170,"num_write":421,"num_write_kb":39548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"71'427","reported_seq":620,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.532023+0000","last_change":"2024-04-18T21:10:03.544910+0000","last_active":"2024-04-18T21:10:13.532023+0000","last_peered":"2024-04-18T21:10:13.532023+0000","last_clean":"2024-04-18T21:10:13.532023+0000","last_became_active":"2024-04-18T21:10:03.539961+0000","last_became_peered":"2024-04-18T21:10:03.539961+0000","last_unstale":"2024-04-18T21:10:13.532023+0000","last_undegraded":"2024-04-18T21:10:13.532023+0000","last_fullsized":"2024-04-18T21:10:13.532023+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:06:34.839228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":11507,"num_write":407,"num_write_kb":50964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"71'471","reported_seq":681,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480805+0000","last_change":"2024-04-18T21:05:05.649581+0000","last_active":"2024-04-18T21:10:12.480805+0000","last_peered":"2024-04-18T21:10:12.480805+0000","last_clean":"2024-04-18T21:10:12.480805+0000","last_became_active":"2024-04-18T21:05:05.648233+0000","last_became_peered":"2024-04-18T21:05:05.648233+0000","last_unstale":"2024-04-18T21:10:12.480805+0000","last_undegraded":"2024-04-18T21:10:12.480805+0000","last_fullsized":"2024-04-18T21:10:12.480805+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20857,"num_write":431,"num_write_kb":63677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'378","reported_seq":924,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480254+0000","last_change":"2024-04-18T21:09:55.493655+0000","last_active":"2024-04-18T21:10:12.480254+0000","last_peered":"2024-04-18T21:10:12.480254+0000","last_clean":"2024-04-18T21:10:12.480254+0000","last_became_active":"2024-04-18T21:09:55.490958+0000","last_became_peered":"2024-04-18T21:09:55.490958+0000","last_unstale":"2024-04-18T21:10:12.480254+0000","last_undegraded":"2024-04-18T21:10:12.480254+0000","last_fullsized":"2024-04-18T21:10:12.480254+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:52:16.541697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12573,"num_write":347,"num_write_kb":34434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'410","reported_seq":625,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.532347+0000","last_change":"2024-04-18T21:10:01.563947+0000","last_active":"2024-04-18T21:10:13.532347+0000","last_peered":"2024-04-18T21:10:13.532347+0000","last_clean":"2024-04-18T21:10:13.532347+0000","last_became_active":"2024-04-18T21:10:01.555367+0000","last_became_peered":"2024-04-18T21:10:01.555367+0000","last_unstale":"2024-04-18T21:10:13.532347+0000","last_undegraded":"2024-04-18T21:10:13.532347+0000","last_fullsized":"2024-04-18T21:10:13.532347+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:01:09.418419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":16926,"num_write":380,"num_write_kb":112804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"71'410","reported_seq":975,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479546+0000","last_change":"2024-04-18T21:10:03.490605+0000","last_active":"2024-04-18T21:10:12.479546+0000","last_peered":"2024-04-18T21:10:12.479546+0000","last_clean":"2024-04-18T21:10:12.479546+0000","last_became_active":"2024-04-18T21:10:03.480985+0000","last_became_peered":"2024-04-18T21:10:03.480985+0000","last_unstale":"2024-04-18T21:10:12.479546+0000","last_undegraded":"2024-04-18T21:10:12.479546+0000","last_fullsized":"2024-04-18T21:10:12.479546+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:14:42.076110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":34811,"num_write":378,"num_write_kb":51242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'491","reported_seq":695,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.531780+0000","last_change":"2024-04-18T21:10:08.546388+0000","last_active":"2024-04-18T21:10:13.531780+0000","last_peered":"2024-04-18T21:10:13.531780+0000","last_clean":"2024-04-18T21:10:13.531780+0000","last_became_active":"2024-04-18T21:10:08.540487+0000","last_became_peered":"2024-04-18T21:10:08.540487+0000","last_unstale":"2024-04-18T21:10:13.531780+0000","last_undegraded":"2024-04-18T21:10:13.531780+0000","last_fullsized":"2024-04-18T21:10:13.531780+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:15:51.120517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":26902,"num_write":456,"num_write_kb":124778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":209,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"71'467","reported_seq":672,"reported_epoch":100,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:12.477951+0000","last_change":"2024-04-18T21:10:03.488499+0000","last_active":"2024-04-18T21:10:12.477951+0000","last_peered":"2024-04-18T21:10:12.477951+0000","last_clean":"2024-04-18T21:06:56.506258+0000","last_became_active":"2024-04-18T21:10:03.477945+0000","last_became_peered":"2024-04-18T21:10:03.477945+0000","last_unstale":"2024-04-18T21:10:12.477951+0000","last_undegraded":"2024-04-18T21:10:03.471107+0000","last_fullsized":"2024-04-18T21:10:03.470440+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":192,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":28114,"num_write":434,"num_write_kb":129325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'423","reported_seq":579,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479574+0000","last_change":"2024-04-18T21:10:01.499421+0000","last_active":"2024-04-18T21:10:12.479574+0000","last_peered":"2024-04-18T21:10:12.479574+0000","last_clean":"2024-04-18T21:10:12.479574+0000","last_became_active":"2024-04-18T21:10:01.487074+0000","last_became_peered":"2024-04-18T21:10:01.487074+0000","last_unstale":"2024-04-18T21:10:12.479574+0000","last_undegraded":"2024-04-18T21:10:12.479574+0000","last_fullsized":"2024-04-18T21:10:12.479574+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:05:34.827814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8244,"num_write":393,"num_write_kb":58692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"71'389","reported_seq":604,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.531573+0000","last_change":"2024-04-18T21:09:58.542232+0000","last_active":"2024-04-18T21:10:13.531573+0000","last_peered":"2024-04-18T21:10:13.531573+0000","last_clean":"2024-04-18T21:10:13.531573+0000","last_became_active":"2024-04-18T21:09:58.537723+0000","last_became_peered":"2024-04-18T21:09:58.537723+0000","last_unstale":"2024-04-18T21:10:13.531573+0000","last_undegraded":"2024-04-18T21:10:13.531573+0000","last_fullsized":"2024-04-18T21:10:13.531573+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:26.786170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":24216,"num_write":349,"num_write_kb":43176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"70'425","reported_seq":605,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.481588+0000","last_change":"2024-04-18T21:05:04.632748+0000","last_active":"2024-04-18T21:10:12.481588+0000","last_peered":"2024-04-18T21:10:12.481588+0000","last_clean":"2024-04-18T21:10:12.481588+0000","last_became_active":"2024-04-18T21:05:04.628407+0000","last_became_peered":"2024-04-18T21:05:04.628407+0000","last_unstale":"2024-04-18T21:10:12.481588+0000","last_undegraded":"2024-04-18T21:10:12.481588+0000","last_fullsized":"2024-04-18T21:10:12.481588+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:42:45.392908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":375,"num_write_kb":8348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"71'423","reported_seq":603,"reported_epoch":101,"state":"peering","last_fresh":"2024-04-18T21:10:13.533183+0000","last_change":"2024-04-18T21:10:13.533183+0000","last_active":"2024-04-18T21:09:50.773535+0000","last_peered":"2024-04-18T21:09:48.748161+0000","last_clean":"2024-04-18T21:06:56.697536+0000","last_became_active":"2024-04-18T21:06:57.814108+0000","last_became_peered":"2024-04-18T21:06:57.814108+0000","last_unstale":"2024-04-18T21:10:13.533183+0000","last_undegraded":"2024-04-18T21:10:13.533183+0000","last_fullsized":"2024-04-18T21:10:13.533183+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":20096,"num_write":381,"num_write_kb":76351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"70'56","reported_seq":248,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.478351+0000","last_change":"2024-04-18T21:10:00.500122+0000","last_active":"2024-04-18T21:10:12.478351+0000","last_peered":"2024-04-18T21:10:12.478351+0000","last_clean":"2024-04-18T21:10:12.478351+0000","last_became_active":"2024-04-18T21:10:00.489486+0000","last_became_peered":"2024-04-18T21:10:00.489486+0000","last_unstale":"2024-04-18T21:10:12.478351+0000","last_undegraded":"2024-04-18T21:10:12.478351+0000","last_fullsized":"2024-04-18T21:10:12.478351+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:58:08.269558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'442","reported_seq":1010,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.481507+0000","last_change":"2024-04-18T21:10:03.492109+0000","last_active":"2024-04-18T21:10:12.481507+0000","last_peered":"2024-04-18T21:10:12.481507+0000","last_clean":"2024-04-18T21:10:12.481507+0000","last_became_active":"2024-04-18T21:10:03.483050+0000","last_became_peered":"2024-04-18T21:10:03.483050+0000","last_unstale":"2024-04-18T21:10:12.481507+0000","last_undegraded":"2024-04-18T21:10:12.481507+0000","last_fullsized":"2024-04-18T21:10:12.481507+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:45.388623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13827,"num_write":415,"num_write_kb":79859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"70'62","reported_seq":66,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.531419+0000","last_change":"2024-04-18T21:09:50.868159+0000","last_active":"2024-04-18T21:10:13.531419+0000","last_peered":"2024-04-18T21:10:13.531419+0000","last_clean":"2024-04-18T21:10:13.531419+0000","last_became_active":"2024-04-18T21:09:50.867096+0000","last_became_peered":"2024-04-18T21:09:50.867096+0000","last_unstale":"2024-04-18T21:10:13.531419+0000","last_undegraded":"2024-04-18T21:10:13.531419+0000","last_fullsized":"2024-04-18T21:10:13.531419+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:09:57.047205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"71'398","reported_seq":623,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480249+0000","last_change":"2024-04-18T21:10:01.498728+0000","last_active":"2024-04-18T21:10:12.480249+0000","last_peered":"2024-04-18T21:10:12.480249+0000","last_clean":"2024-04-18T21:10:12.480249+0000","last_became_active":"2024-04-18T21:10:01.495349+0000","last_became_peered":"2024-04-18T21:10:01.495349+0000","last_unstale":"2024-04-18T21:10:12.480249+0000","last_undegraded":"2024-04-18T21:10:12.480249+0000","last_fullsized":"2024-04-18T21:10:12.480249+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:01:48.618551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":17616,"num_write":360,"num_write_kb":58871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"70'66","reported_seq":165,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.478944+0000","last_change":"2024-04-18T21:10:00.496701+0000","last_active":"2024-04-18T21:10:12.478944+0000","last_peered":"2024-04-18T21:10:12.478944+0000","last_clean":"2024-04-18T21:10:12.478944+0000","last_became_active":"2024-04-18T21:10:00.495594+0000","last_became_peered":"2024-04-18T21:10:00.495594+0000","last_unstale":"2024-04-18T21:10:12.478944+0000","last_undegraded":"2024-04-18T21:10:12.478944+0000","last_fullsized":"2024-04-18T21:10:12.478944+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:11:32.991308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"70'135","reported_seq":52,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.481009+0000","last_change":"2024-04-18T21:10:00.493197+0000","last_active":"2024-04-18T21:10:12.481009+0000","last_peered":"2024-04-18T21:10:12.481009+0000","last_clean":"2024-04-18T21:10:12.481009+0000","last_became_active":"2024-04-18T21:10:00.491509+0000","last_became_peered":"2024-04-18T21:10:00.491509+0000","last_unstale":"2024-04-18T21:10:12.481009+0000","last_undegraded":"2024-04-18T21:10:12.481009+0000","last_fullsized":"2024-04-18T21:10:12.481009+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:57:29.595389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":7777508,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'410","reported_seq":596,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.531577+0000","last_change":"2024-04-18T21:10:06.553806+0000","last_active":"2024-04-18T21:10:13.531577+0000","last_peered":"2024-04-18T21:10:13.531577+0000","last_clean":"2024-04-18T21:10:13.531577+0000","last_became_active":"2024-04-18T21:10:06.548034+0000","last_became_peered":"2024-04-18T21:10:06.548034+0000","last_unstale":"2024-04-18T21:10:13.531577+0000","last_undegraded":"2024-04-18T21:10:13.531577+0000","last_fullsized":"2024-04-18T21:10:13.531577+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:20:56.265941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17055,"num_write":375,"num_write_kb":63331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"70'240","reported_seq":349,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.532368+0000","last_change":"2024-04-18T21:10:00.556212+0000","last_active":"2024-04-18T21:10:13.532368+0000","last_peered":"2024-04-18T21:10:13.532368+0000","last_clean":"2024-04-18T21:10:13.532368+0000","last_became_active":"2024-04-18T21:10:00.555486+0000","last_became_peered":"2024-04-18T21:10:00.555486+0000","last_unstale":"2024-04-18T21:10:13.532368+0000","last_undegraded":"2024-04-18T21:10:13.532368+0000","last_fullsized":"2024-04-18T21:10:13.532368+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:11.573984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":4191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"71'501","reported_seq":750,"reported_epoch":100,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:12.478568+0000","last_change":"2024-04-18T21:09:51.935429+0000","last_active":"2024-04-18T21:10:12.478568+0000","last_peered":"2024-04-18T21:10:12.478568+0000","last_clean":"2024-04-18T21:06:56.729630+0000","last_became_active":"2024-04-18T21:09:51.925059+0000","last_became_peered":"2024-04-18T21:09:51.925059+0000","last_unstale":"2024-04-18T21:10:12.478568+0000","last_undegraded":"2024-04-18T21:09:51.823027+0000","last_fullsized":"2024-04-18T21:09:51.807046+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":202,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":37662,"num_write":474,"num_write_kb":167663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"70'429","reported_seq":550,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480893+0000","last_change":"2024-04-18T21:10:00.493325+0000","last_active":"2024-04-18T21:10:12.480893+0000","last_peered":"2024-04-18T21:10:12.480893+0000","last_clean":"2024-04-18T21:10:12.480893+0000","last_became_active":"2024-04-18T21:10:00.491525+0000","last_became_peered":"2024-04-18T21:10:00.491525+0000","last_unstale":"2024-04-18T21:10:12.480893+0000","last_undegraded":"2024-04-18T21:10:12.480893+0000","last_fullsized":"2024-04-18T21:10:12.480893+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:27:59.637974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":377,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388678,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'440","reported_seq":634,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479867+0000","last_change":"2024-04-18T21:10:01.497932+0000","last_active":"2024-04-18T21:10:12.479867+0000","last_peered":"2024-04-18T21:10:12.479867+0000","last_clean":"2024-04-18T21:10:12.479867+0000","last_became_active":"2024-04-18T21:10:01.486740+0000","last_became_peered":"2024-04-18T21:10:01.486740+0000","last_unstale":"2024-04-18T21:10:12.479867+0000","last_undegraded":"2024-04-18T21:10:12.479867+0000","last_fullsized":"2024-04-18T21:10:12.479867+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:34:43.515471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":42138,"num_write":408,"num_write_kb":96310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"70'59","reported_seq":239,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480031+0000","last_change":"2024-04-18T21:05:04.625520+0000","last_active":"2024-04-18T21:10:12.480031+0000","last_peered":"2024-04-18T21:10:12.480031+0000","last_clean":"2024-04-18T21:10:12.480031+0000","last_became_active":"2024-04-18T21:05:04.624656+0000","last_became_peered":"2024-04-18T21:05:04.624656+0000","last_unstale":"2024-04-18T21:10:12.480031+0000","last_undegraded":"2024-04-18T21:10:12.480031+0000","last_fullsized":"2024-04-18T21:10:12.480031+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:56:05.795125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"71'461","reported_seq":660,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479054+0000","last_change":"2024-04-18T21:05:05.649406+0000","last_active":"2024-04-18T21:10:12.479054+0000","last_peered":"2024-04-18T21:10:12.479054+0000","last_clean":"2024-04-18T21:10:12.479054+0000","last_became_active":"2024-04-18T21:05:05.648380+0000","last_became_peered":"2024-04-18T21:05:05.648380+0000","last_unstale":"2024-04-18T21:10:12.479054+0000","last_undegraded":"2024-04-18T21:10:12.479054+0000","last_fullsized":"2024-04-18T21:10:12.479054+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12852,"num_write":420,"num_write_kb":88506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"70'157","reported_seq":360,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480612+0000","last_change":"2024-04-18T21:10:00.500141+0000","last_active":"2024-04-18T21:10:12.480612+0000","last_peered":"2024-04-18T21:10:12.480612+0000","last_clean":"2024-04-18T21:10:12.480612+0000","last_became_active":"2024-04-18T21:10:00.494630+0000","last_became_peered":"2024-04-18T21:10:00.494630+0000","last_unstale":"2024-04-18T21:10:12.480612+0000","last_undegraded":"2024-04-18T21:10:12.480612+0000","last_fullsized":"2024-04-18T21:10:12.480612+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:49:43.984354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":8250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'445","reported_seq":619,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479461+0000","last_change":"2024-04-18T21:10:01.500937+0000","last_active":"2024-04-18T21:10:12.479461+0000","last_peered":"2024-04-18T21:10:12.479461+0000","last_clean":"2024-04-18T21:10:12.479461+0000","last_became_active":"2024-04-18T21:10:01.490691+0000","last_became_peered":"2024-04-18T21:10:01.490691+0000","last_unstale":"2024-04-18T21:10:12.479461+0000","last_undegraded":"2024-04-18T21:10:12.479461+0000","last_fullsized":"2024-04-18T21:10:12.479461+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:59:48.489145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17488,"num_write":410,"num_write_kb":50845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"70'124","reported_seq":304,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480178+0000","last_change":"2024-04-18T21:05:04.634674+0000","last_active":"2024-04-18T21:10:12.480178+0000","last_peered":"2024-04-18T21:10:12.480178+0000","last_clean":"2024-04-18T21:10:12.480178+0000","last_became_active":"2024-04-18T21:05:04.632284+0000","last_became_peered":"2024-04-18T21:05:04.632284+0000","last_unstale":"2024-04-18T21:10:12.480178+0000","last_undegraded":"2024-04-18T21:10:12.480178+0000","last_fullsized":"2024-04-18T21:10:12.480178+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:09:18.466987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"71'400","reported_seq":678,"reported_epoch":100,"state":"active+recovering+undersized+remapped","last_fresh":"2024-04-18T21:10:12.669265+0000","last_change":"2024-04-18T21:10:12.477444+0000","last_active":"2024-04-18T21:10:12.669265+0000","last_peered":"2024-04-18T21:10:12.669265+0000","last_clean":"2024-04-18T21:09:48.744284+0000","last_became_active":"2024-04-18T21:10:01.496176+0000","last_became_peered":"2024-04-18T21:10:01.496176+0000","last_unstale":"2024-04-18T21:10:12.669265+0000","last_undegraded":"2024-04-18T21:10:12.669265+0000","last_fullsized":"2024-04-18T21:10:01.480189+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12586,"num_write":372,"num_write_kb":58856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":229,"num_bytes_recovered":576854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"70'53","reported_seq":68,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.530764+0000","last_change":"2024-04-18T21:10:00.550936+0000","last_active":"2024-04-18T21:10:13.530764+0000","last_peered":"2024-04-18T21:10:13.530764+0000","last_clean":"2024-04-18T21:10:13.530764+0000","last_became_active":"2024-04-18T21:10:00.549987+0000","last_became_peered":"2024-04-18T21:10:00.549987+0000","last_unstale":"2024-04-18T21:10:13.530764+0000","last_undegraded":"2024-04-18T21:10:13.530764+0000","last_fullsized":"2024-04-18T21:10:13.530764+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:53:36.771516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"71'364","reported_seq":927,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480632+0000","last_change":"2024-04-18T21:09:58.478726+0000","last_active":"2024-04-18T21:10:12.480632+0000","last_peered":"2024-04-18T21:10:12.480632+0000","last_clean":"2024-04-18T21:10:12.480632+0000","last_became_active":"2024-04-18T21:09:58.473903+0000","last_became_peered":"2024-04-18T21:09:58.473903+0000","last_unstale":"2024-04-18T21:10:12.480632+0000","last_undegraded":"2024-04-18T21:10:12.480632+0000","last_fullsized":"2024-04-18T21:10:12.480632+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:40.377274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":37938,"num_write":336,"num_write_kb":42513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"70'460","reported_seq":559,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.530986+0000","last_change":"2024-04-18T21:09:53.545846+0000","last_active":"2024-04-18T21:10:13.530986+0000","last_peered":"2024-04-18T21:10:13.530986+0000","last_clean":"2024-04-18T21:10:13.530986+0000","last_became_active":"2024-04-18T21:09:53.544355+0000","last_became_peered":"2024-04-18T21:09:53.544355+0000","last_unstale":"2024-04-18T21:10:13.530986+0000","last_undegraded":"2024-04-18T21:10:13.530986+0000","last_fullsized":"2024-04-18T21:10:13.530986+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:34:16.776752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":406,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"71'404","reported_seq":607,"reported_epoch":100,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:12.480553+0000","last_change":"2024-04-18T21:09:51.933464+0000","last_active":"2024-04-18T21:10:12.480553+0000","last_peered":"2024-04-18T21:10:12.480553+0000","last_clean":"2024-04-18T21:06:56.714828+0000","last_became_active":"2024-04-18T21:09:51.918677+0000","last_became_peered":"2024-04-18T21:09:51.918677+0000","last_unstale":"2024-04-18T21:10:12.480553+0000","last_undegraded":"2024-04-18T21:09:51.824330+0000","last_fullsized":"2024-04-18T21:09:51.803729+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":174,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":7075,"num_write":367,"num_write_kb":62738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":367,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480008+0000","last_change":"2024-04-18T21:10:00.497960+0000","last_active":"2024-04-18T21:10:12.480008+0000","last_peered":"2024-04-18T21:10:12.480008+0000","last_clean":"2024-04-18T21:10:12.480008+0000","last_became_active":"2024-04-18T21:10:00.496373+0000","last_became_peered":"2024-04-18T21:10:00.496373+0000","last_unstale":"2024-04-18T21:10:12.480008+0000","last_undegraded":"2024-04-18T21:10:12.480008+0000","last_fullsized":"2024-04-18T21:10:12.480008+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_clean_scrub_stamp":"2024-04-18T21:04:53.494814+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:56:52.975720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":143,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.482074+0000","last_change":"2024-04-18T21:10:00.487584+0000","last_active":"2024-04-18T21:10:12.482074+0000","last_peered":"2024-04-18T21:10:12.482074+0000","last_clean":"2024-04-18T21:10:12.482074+0000","last_became_active":"2024-04-18T21:10:00.486722+0000","last_became_peered":"2024-04-18T21:10:00.486722+0000","last_unstale":"2024-04-18T21:10:12.482074+0000","last_undegraded":"2024-04-18T21:10:12.482074+0000","last_fullsized":"2024-04-18T21:10:12.482074+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:17:03.176148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"70'595","reported_seq":734,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.478666+0000","last_change":"2024-04-18T21:10:03.488427+0000","last_active":"2024-04-18T21:10:12.478666+0000","last_peered":"2024-04-18T21:10:12.478666+0000","last_clean":"2024-04-18T21:10:12.478666+0000","last_became_active":"2024-04-18T21:10:03.481344+0000","last_became_peered":"2024-04-18T21:10:03.481344+0000","last_unstale":"2024-04-18T21:10:12.478666+0000","last_undegraded":"2024-04-18T21:10:12.478666+0000","last_fullsized":"2024-04-18T21:10:12.478666+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:41.583248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":539,"num_write_kb":8449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4689862,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'443","reported_seq":1073,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480568+0000","last_change":"2024-04-18T21:09:56.496310+0000","last_active":"2024-04-18T21:10:12.480568+0000","last_peered":"2024-04-18T21:10:12.480568+0000","last_clean":"2024-04-18T21:10:12.480568+0000","last_became_active":"2024-04-18T21:09:56.493327+0000","last_became_peered":"2024-04-18T21:09:56.493327+0000","last_unstale":"2024-04-18T21:10:12.480568+0000","last_undegraded":"2024-04-18T21:10:12.480568+0000","last_fullsized":"2024-04-18T21:10:12.480568+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:20:57.340997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":38975,"num_write":404,"num_write_kb":80038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":193,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479647+0000","last_change":"2024-04-18T21:09:50.817029+0000","last_active":"2024-04-18T21:10:12.479647+0000","last_peered":"2024-04-18T21:10:12.479647+0000","last_clean":"2024-04-18T21:10:12.479647+0000","last_became_active":"2024-04-18T21:09:50.816543+0000","last_became_peered":"2024-04-18T21:09:50.816543+0000","last_unstale":"2024-04-18T21:10:12.479647+0000","last_undegraded":"2024-04-18T21:10:12.479647+0000","last_fullsized":"2024-04-18T21:10:12.479647+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:47:33.047727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"70'129","reported_seq":296,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479259+0000","last_change":"2024-04-18T21:10:03.489109+0000","last_active":"2024-04-18T21:10:12.479259+0000","last_peered":"2024-04-18T21:10:12.479259+0000","last_clean":"2024-04-18T21:10:12.479259+0000","last_became_active":"2024-04-18T21:10:03.486859+0000","last_became_peered":"2024-04-18T21:10:03.486859+0000","last_unstale":"2024-04-18T21:10:12.479259+0000","last_undegraded":"2024-04-18T21:10:12.479259+0000","last_fullsized":"2024-04-18T21:10:12.479259+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:52:04.172480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466419,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":55,"num_read_kb":1405,"num_write":58,"num_write_kb":1469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'457","reported_seq":666,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.533564+0000","last_change":"2024-04-18T21:10:09.543207+0000","last_active":"2024-04-18T21:10:13.533564+0000","last_peered":"2024-04-18T21:10:13.533564+0000","last_clean":"2024-04-18T21:10:13.533564+0000","last_became_active":"2024-04-18T21:10:09.537428+0000","last_became_peered":"2024-04-18T21:10:09.537428+0000","last_unstale":"2024-04-18T21:10:13.533564+0000","last_undegraded":"2024-04-18T21:10:13.533564+0000","last_fullsized":"2024-04-18T21:10:13.533564+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:21.987918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":27659,"num_write":426,"num_write_kb":80500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":192,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479746+0000","last_change":"2024-04-18T21:09:50.832624+0000","last_active":"2024-04-18T21:10:12.479746+0000","last_peered":"2024-04-18T21:10:12.479746+0000","last_clean":"2024-04-18T21:10:12.479746+0000","last_became_active":"2024-04-18T21:09:50.831949+0000","last_became_peered":"2024-04-18T21:09:50.831949+0000","last_unstale":"2024-04-18T21:10:12.479746+0000","last_undegraded":"2024-04-18T21:10:12.479746+0000","last_fullsized":"2024-04-18T21:10:12.479746+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:35:45.986029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'170","reported_seq":354,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.530541+0000","last_change":"2024-04-18T21:09:53.538615+0000","last_active":"2024-04-18T21:10:13.530541+0000","last_peered":"2024-04-18T21:10:13.530541+0000","last_clean":"2024-04-18T21:10:13.530541+0000","last_became_active":"2024-04-18T21:09:53.537994+0000","last_became_peered":"2024-04-18T21:09:53.537994+0000","last_unstale":"2024-04-18T21:10:13.530541+0000","last_undegraded":"2024-04-18T21:10:13.530541+0000","last_fullsized":"2024-04-18T21:10:13.530541+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:02:34.372453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":8239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"71'346","reported_seq":894,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.481122+0000","last_change":"2024-04-18T21:10:11.487541+0000","last_active":"2024-04-18T21:10:12.481122+0000","last_peered":"2024-04-18T21:10:12.481122+0000","last_clean":"2024-04-18T21:10:12.481122+0000","last_became_active":"2024-04-18T21:10:11.484662+0000","last_became_peered":"2024-04-18T21:10:11.484662+0000","last_unstale":"2024-04-18T21:10:12.481122+0000","last_undegraded":"2024-04-18T21:10:12.481122+0000","last_fullsized":"2024-04-18T21:10:12.481122+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:50:21.491862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27042,"num_write":321,"num_write_kb":50693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":186,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480436+0000","last_change":"2024-04-18T21:05:00.576606+0000","last_active":"2024-04-18T21:10:12.480436+0000","last_peered":"2024-04-18T21:10:12.480436+0000","last_clean":"2024-04-18T21:10:12.480436+0000","last_became_active":"2024-04-18T21:05:00.575951+0000","last_became_peered":"2024-04-18T21:05:00.575951+0000","last_unstale":"2024-04-18T21:10:12.480436+0000","last_undegraded":"2024-04-18T21:10:12.480436+0000","last_fullsized":"2024-04-18T21:10:12.480436+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:32:17.612481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"70'63","reported_seq":243,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.481819+0000","last_change":"2024-04-18T21:05:04.627296+0000","last_active":"2024-04-18T21:10:12.481819+0000","last_peered":"2024-04-18T21:10:12.481819+0000","last_clean":"2024-04-18T21:10:12.481819+0000","last_became_active":"2024-04-18T21:05:04.626801+0000","last_became_peered":"2024-04-18T21:05:04.626801+0000","last_unstale":"2024-04-18T21:10:12.481819+0000","last_undegraded":"2024-04-18T21:10:12.481819+0000","last_fullsized":"2024-04-18T21:10:12.481819+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:46:36.285416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"71'406","reported_seq":1025,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479591+0000","last_change":"2024-04-18T21:09:59.495686+0000","last_active":"2024-04-18T21:10:12.479591+0000","last_peered":"2024-04-18T21:10:12.479591+0000","last_clean":"2024-04-18T21:10:12.479591+0000","last_became_active":"2024-04-18T21:09:59.493248+0000","last_became_peered":"2024-04-18T21:09:59.493248+0000","last_unstale":"2024-04-18T21:10:12.479591+0000","last_undegraded":"2024-04-18T21:10:12.479591+0000","last_fullsized":"2024-04-18T21:10:12.479591+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:11:23.853682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":35332,"num_write":370,"num_write_kb":71807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"70'284","reported_seq":299,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.481194+0000","last_change":"2024-04-18T21:10:00.504958+0000","last_active":"2024-04-18T21:10:12.481194+0000","last_peered":"2024-04-18T21:10:12.481194+0000","last_clean":"2024-04-18T21:10:12.481194+0000","last_became_active":"2024-04-18T21:10:00.503851+0000","last_became_peered":"2024-04-18T21:10:00.503851+0000","last_unstale":"2024-04-18T21:10:12.481194+0000","last_undegraded":"2024-04-18T21:10:12.481194+0000","last_fullsized":"2024-04-18T21:10:12.481194+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:10:27.397258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":218,"num_write_kb":4194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":119,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480118+0000","last_change":"2024-04-18T21:10:03.484148+0000","last_active":"2024-04-18T21:10:12.480118+0000","last_peered":"2024-04-18T21:10:12.480118+0000","last_clean":"2024-04-18T21:10:12.480118+0000","last_became_active":"2024-04-18T21:10:03.480071+0000","last_became_peered":"2024-04-18T21:10:03.480071+0000","last_unstale":"2024-04-18T21:10:12.480118+0000","last_undegraded":"2024-04-18T21:10:12.480118+0000","last_fullsized":"2024-04-18T21:10:12.480118+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:50:30.257039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'386","reported_seq":563,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.532066+0000","last_change":"2024-04-18T21:10:10.547885+0000","last_active":"2024-04-18T21:10:13.532066+0000","last_peered":"2024-04-18T21:10:13.532066+0000","last_clean":"2024-04-18T21:10:13.532066+0000","last_became_active":"2024-04-18T21:10:10.542515+0000","last_became_peered":"2024-04-18T21:10:10.542515+0000","last_unstale":"2024-04-18T21:10:13.532066+0000","last_undegraded":"2024-04-18T21:10:13.532066+0000","last_fullsized":"2024-04-18T21:10:13.532066+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:58:24.232536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14677,"num_write":355,"num_write_kb":51018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"70'55","reported_seq":241,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480040+0000","last_change":"2024-04-18T21:09:50.833424+0000","last_active":"2024-04-18T21:10:12.480040+0000","last_peered":"2024-04-18T21:10:12.480040+0000","last_clean":"2024-04-18T21:10:12.480040+0000","last_became_active":"2024-04-18T21:09:50.832752+0000","last_became_peered":"2024-04-18T21:09:50.832752+0000","last_unstale":"2024-04-18T21:10:12.480040+0000","last_undegraded":"2024-04-18T21:10:12.480040+0000","last_fullsized":"2024-04-18T21:10:12.480040+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:48.945329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":151,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.533681+0000","last_change":"2024-04-18T21:09:50.900338+0000","last_active":"2024-04-18T21:10:13.533681+0000","last_peered":"2024-04-18T21:10:13.533681+0000","last_clean":"2024-04-18T21:10:13.533681+0000","last_became_active":"2024-04-18T21:09:50.896844+0000","last_became_peered":"2024-04-18T21:09:50.896844+0000","last_unstale":"2024-04-18T21:10:13.533681+0000","last_undegraded":"2024-04-18T21:10:13.533681+0000","last_fullsized":"2024-04-18T21:10:13.533681+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:11:35.543409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"71'402","reported_seq":577,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.531035+0000","last_change":"2024-04-18T21:10:05.542484+0000","last_active":"2024-04-18T21:10:13.531035+0000","last_peered":"2024-04-18T21:10:13.531035+0000","last_clean":"2024-04-18T21:10:13.531035+0000","last_became_active":"2024-04-18T21:10:05.536763+0000","last_became_peered":"2024-04-18T21:10:05.536763+0000","last_unstale":"2024-04-18T21:10:13.531035+0000","last_undegraded":"2024-04-18T21:10:13.531035+0000","last_fullsized":"2024-04-18T21:10:13.531035+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:08:22.367267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12468,"num_write":369,"num_write_kb":67231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"70'60","reported_seq":247,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.482159+0000","last_change":"2024-04-18T21:09:50.832598+0000","last_active":"2024-04-18T21:10:12.482159+0000","last_peered":"2024-04-18T21:10:12.482159+0000","last_clean":"2024-04-18T21:10:12.482159+0000","last_became_active":"2024-04-18T21:09:50.832030+0000","last_became_peered":"2024-04-18T21:09:50.832030+0000","last_unstale":"2024-04-18T21:10:12.482159+0000","last_undegraded":"2024-04-18T21:10:12.482159+0000","last_fullsized":"2024-04-18T21:10:12.482159+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:10:27.397258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":119,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.481784+0000","last_change":"2024-04-18T21:10:03.492761+0000","last_active":"2024-04-18T21:10:12.481784+0000","last_peered":"2024-04-18T21:10:12.481784+0000","last_clean":"2024-04-18T21:10:12.481784+0000","last_became_active":"2024-04-18T21:10:03.492145+0000","last_became_peered":"2024-04-18T21:10:03.492145+0000","last_unstale":"2024-04-18T21:10:12.481784+0000","last_undegraded":"2024-04-18T21:10:12.481784+0000","last_fullsized":"2024-04-18T21:10:12.481784+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:20:00.853523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'421","reported_seq":612,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479014+0000","last_change":"2024-04-18T21:10:03.488774+0000","last_active":"2024-04-18T21:10:12.479014+0000","last_peered":"2024-04-18T21:10:12.479014+0000","last_clean":"2024-04-18T21:10:12.479014+0000","last_became_active":"2024-04-18T21:10:03.479773+0000","last_became_peered":"2024-04-18T21:10:03.479773+0000","last_unstale":"2024-04-18T21:10:12.479014+0000","last_undegraded":"2024-04-18T21:10:12.479014+0000","last_fullsized":"2024-04-18T21:10:12.479014+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:15:12.326904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":16183,"num_write":377,"num_write_kb":50451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"71'110","reported_seq":309,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.481794+0000","last_change":"2024-04-18T21:10:00.497917+0000","last_active":"2024-04-18T21:10:12.481794+0000","last_peered":"2024-04-18T21:10:12.481794+0000","last_clean":"2024-04-18T21:10:12.481794+0000","last_became_active":"2024-04-18T21:10:00.494644+0000","last_became_peered":"2024-04-18T21:10:00.494644+0000","last_unstale":"2024-04-18T21:10:12.481794+0000","last_undegraded":"2024-04-18T21:10:12.481794+0000","last_fullsized":"2024-04-18T21:10:12.481794+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:40:57.347353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":1251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":144,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480980+0000","last_change":"2024-04-18T21:10:00.493764+0000","last_active":"2024-04-18T21:10:12.480980+0000","last_peered":"2024-04-18T21:10:12.480980+0000","last_clean":"2024-04-18T21:10:12.480980+0000","last_became_active":"2024-04-18T21:10:00.492672+0000","last_became_peered":"2024-04-18T21:10:00.492672+0000","last_unstale":"2024-04-18T21:10:12.480980+0000","last_undegraded":"2024-04-18T21:10:12.480980+0000","last_fullsized":"2024-04-18T21:10:12.480980+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:48:46.709401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'384","reported_seq":583,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.531825+0000","last_change":"2024-04-18T21:09:57.572865+0000","last_active":"2024-04-18T21:10:13.531825+0000","last_peered":"2024-04-18T21:10:13.531825+0000","last_clean":"2024-04-18T21:10:13.531825+0000","last_became_active":"2024-04-18T21:09:57.567962+0000","last_became_peered":"2024-04-18T21:09:57.567962+0000","last_unstale":"2024-04-18T21:10:13.531825+0000","last_undegraded":"2024-04-18T21:10:13.531825+0000","last_fullsized":"2024-04-18T21:10:13.531825+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:51:24.627186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":15567,"num_write":351,"num_write_kb":42959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"71'396","reported_seq":902,"reported_epoch":99,"state":"peering","last_fresh":"2024-04-18T21:10:11.920684+0000","last_change":"2024-04-18T21:10:12.482413+0000","last_active":"2024-04-18T21:10:12.482413+0000","last_peered":"2024-04-18T21:10:11.920684+0000","last_clean":"2024-04-18T21:09:48.743028+0000","last_became_active":"2024-04-18T21:10:01.492175+0000","last_became_peered":"2024-04-18T21:10:01.492175+0000","last_unstale":"2024-04-18T21:10:11.920684+0000","last_undegraded":"2024-04-18T21:10:11.920684+0000","last_fullsized":"2024-04-18T21:10:01.476438+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12943,"num_write":353,"num_write_kb":35357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":342,"num_bytes_recovered":3500882,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"71'277","reported_seq":302,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479820+0000","last_change":"2024-04-18T21:10:00.495047+0000","last_active":"2024-04-18T21:10:12.479820+0000","last_peered":"2024-04-18T21:10:12.479820+0000","last_clean":"2024-04-18T21:10:12.479820+0000","last_became_active":"2024-04-18T21:10:00.493088+0000","last_became_peered":"2024-04-18T21:10:00.493088+0000","last_unstale":"2024-04-18T21:10:12.479820+0000","last_undegraded":"2024-04-18T21:10:12.479820+0000","last_fullsized":"2024-04-18T21:10:12.479820+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:39:08.263781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":221,"num_write_kb":8303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":8389370,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'411","reported_seq":991,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.478217+0000","last_change":"2024-04-18T21:10:04.485332+0000","last_active":"2024-04-18T21:10:12.478217+0000","last_peered":"2024-04-18T21:10:12.478217+0000","last_clean":"2024-04-18T21:10:12.478217+0000","last_became_active":"2024-04-18T21:10:04.482320+0000","last_became_peered":"2024-04-18T21:10:04.482320+0000","last_unstale":"2024-04-18T21:10:12.478217+0000","last_undegraded":"2024-04-18T21:10:12.478217+0000","last_fullsized":"2024-04-18T21:10:12.478217+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:35:57.043682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":17179,"num_write":375,"num_write_kb":38991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"70'85","reported_seq":154,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.532177+0000","last_change":"2024-04-18T21:09:50.890616+0000","last_active":"2024-04-18T21:10:13.532177+0000","last_peered":"2024-04-18T21:10:13.532177+0000","last_clean":"2024-04-18T21:10:13.532177+0000","last_became_active":"2024-04-18T21:09:50.874855+0000","last_became_peered":"2024-04-18T21:09:50.874855+0000","last_unstale":"2024-04-18T21:10:13.532177+0000","last_undegraded":"2024-04-18T21:10:13.532177+0000","last_fullsized":"2024-04-18T21:10:13.532177+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:03:54.726282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"70'230","reported_seq":243,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480921+0000","last_change":"2024-04-18T21:10:00.499373+0000","last_active":"2024-04-18T21:10:12.480921+0000","last_peered":"2024-04-18T21:10:12.480921+0000","last_clean":"2024-04-18T21:10:12.480921+0000","last_became_active":"2024-04-18T21:10:00.498141+0000","last_became_peered":"2024-04-18T21:10:00.498141+0000","last_unstale":"2024-04-18T21:10:12.480921+0000","last_undegraded":"2024-04-18T21:10:12.480921+0000","last_fullsized":"2024-04-18T21:10:12.480921+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:55:01.865593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":4178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"71'493","reported_seq":716,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.478219+0000","last_change":"2024-04-18T21:05:05.642793+0000","last_active":"2024-04-18T21:10:12.478219+0000","last_peered":"2024-04-18T21:10:12.478219+0000","last_clean":"2024-04-18T21:10:12.478219+0000","last_became_active":"2024-04-18T21:05:05.641983+0000","last_became_peered":"2024-04-18T21:05:05.641983+0000","last_unstale":"2024-04-18T21:10:12.478219+0000","last_undegraded":"2024-04-18T21:10:12.478219+0000","last_fullsized":"2024-04-18T21:10:12.478219+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:46:36.339289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23833,"num_write":461,"num_write_kb":76873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"70'62","reported_seq":241,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.481994+0000","last_change":"2024-04-18T21:05:04.641445+0000","last_active":"2024-04-18T21:10:12.481994+0000","last_peered":"2024-04-18T21:10:12.481994+0000","last_clean":"2024-04-18T21:10:12.481994+0000","last_became_active":"2024-04-18T21:05:04.640682+0000","last_became_peered":"2024-04-18T21:05:04.640682+0000","last_unstale":"2024-04-18T21:10:12.481994+0000","last_undegraded":"2024-04-18T21:10:12.481994+0000","last_fullsized":"2024-04-18T21:10:12.481994+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:46:36.285416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'436","reported_seq":654,"reported_epoch":100,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:12.478427+0000","last_change":"2024-04-18T21:09:51.937322+0000","last_active":"2024-04-18T21:10:12.478427+0000","last_peered":"2024-04-18T21:10:12.478427+0000","last_clean":"2024-04-18T21:06:56.761407+0000","last_became_active":"2024-04-18T21:09:51.933205+0000","last_became_peered":"2024-04-18T21:09:51.933205+0000","last_unstale":"2024-04-18T21:10:12.478427+0000","last_undegraded":"2024-04-18T21:09:51.833249+0000","last_fullsized":"2024-04-18T21:09:51.824946+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":193,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14561,"num_write":408,"num_write_kb":47462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'369","reported_seq":557,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.532340+0000","last_change":"2024-04-18T21:10:02.553999+0000","last_active":"2024-04-18T21:10:13.532340+0000","last_peered":"2024-04-18T21:10:13.532340+0000","last_clean":"2024-04-18T21:10:13.532340+0000","last_became_active":"2024-04-18T21:10:02.549471+0000","last_became_peered":"2024-04-18T21:10:02.549471+0000","last_unstale":"2024-04-18T21:10:13.532340+0000","last_undegraded":"2024-04-18T21:10:13.532340+0000","last_fullsized":"2024-04-18T21:10:13.532340+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:52:14.371235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13619,"num_write":339,"num_write_kb":63086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"70'888","reported_seq":1014,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479326+0000","last_change":"2024-04-18T21:10:03.486911+0000","last_active":"2024-04-18T21:10:12.479326+0000","last_peered":"2024-04-18T21:10:12.479326+0000","last_clean":"2024-04-18T21:10:12.479326+0000","last_became_active":"2024-04-18T21:10:03.480576+0000","last_became_peered":"2024-04-18T21:10:03.480576+0000","last_unstale":"2024-04-18T21:10:12.479326+0000","last_undegraded":"2024-04-18T21:10:12.479326+0000","last_fullsized":"2024-04-18T21:10:12.479326+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:41:06.632064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":823,"num_write_kb":8582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'398","reported_seq":546,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480638+0000","last_change":"2024-04-18T21:10:03.491426+0000","last_active":"2024-04-18T21:10:12.480638+0000","last_peered":"2024-04-18T21:10:12.480638+0000","last_clean":"2024-04-18T21:10:12.480638+0000","last_became_active":"2024-04-18T21:10:03.483190+0000","last_became_peered":"2024-04-18T21:10:03.483190+0000","last_unstale":"2024-04-18T21:10:12.480638+0000","last_undegraded":"2024-04-18T21:10:12.480638+0000","last_fullsized":"2024-04-18T21:10:12.480638+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:05:10.611580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14684,"num_write":380,"num_write_kb":88822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"70'169","reported_seq":368,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.478953+0000","last_change":"2024-04-18T21:10:00.494974+0000","last_active":"2024-04-18T21:10:12.478953+0000","last_peered":"2024-04-18T21:10:12.478953+0000","last_clean":"2024-04-18T21:10:12.478953+0000","last_became_active":"2024-04-18T21:10:00.492196+0000","last_became_peered":"2024-04-18T21:10:00.492196+0000","last_unstale":"2024-04-18T21:10:12.478953+0000","last_undegraded":"2024-04-18T21:10:12.478953+0000","last_fullsized":"2024-04-18T21:10:12.478953+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:33:51.236211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":4162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'406","reported_seq":616,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.531926+0000","last_change":"2024-04-18T21:10:12.553754+0000","last_active":"2024-04-18T21:10:13.531926+0000","last_peered":"2024-04-18T21:10:13.531926+0000","last_clean":"2024-04-18T21:10:13.531926+0000","last_became_active":"2024-04-18T21:10:12.546148+0000","last_became_peered":"2024-04-18T21:10:12.546148+0000","last_unstale":"2024-04-18T21:10:13.531926+0000","last_undegraded":"2024-04-18T21:10:13.531926+0000","last_fullsized":"2024-04-18T21:10:13.531926+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:12:37.876185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27495,"num_write":363,"num_write_kb":89134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"72'192","reported_seq":371,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.531472+0000","last_change":"2024-04-18T21:09:53.541766+0000","last_active":"2024-04-18T21:10:13.531472+0000","last_peered":"2024-04-18T21:10:13.531472+0000","last_clean":"2024-04-18T21:10:13.531472+0000","last_became_active":"2024-04-18T21:09:53.541300+0000","last_became_peered":"2024-04-18T21:09:53.541300+0000","last_unstale":"2024-04-18T21:10:13.531472+0000","last_undegraded":"2024-04-18T21:10:13.531472+0000","last_fullsized":"2024-04-18T21:10:13.531472+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:26:14.718922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12425030,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":12201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8230726,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"71'383","reported_seq":603,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.531911+0000","last_change":"2024-04-18T21:09:55.555798+0000","last_active":"2024-04-18T21:10:13.531911+0000","last_peered":"2024-04-18T21:10:13.531911+0000","last_clean":"2024-04-18T21:10:13.531911+0000","last_became_active":"2024-04-18T21:09:55.551135+0000","last_became_peered":"2024-04-18T21:09:55.551135+0000","last_unstale":"2024-04-18T21:10:13.531911+0000","last_undegraded":"2024-04-18T21:10:13.531911+0000","last_fullsized":"2024-04-18T21:10:13.531911+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:00:01.739082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21614,"num_write":351,"num_write_kb":79501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"70'66","reported_seq":145,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.531146+0000","last_change":"2024-04-18T21:10:00.553114+0000","last_active":"2024-04-18T21:10:13.531146+0000","last_peered":"2024-04-18T21:10:13.531146+0000","last_clean":"2024-04-18T21:10:13.531146+0000","last_became_active":"2024-04-18T21:10:00.552067+0000","last_became_peered":"2024-04-18T21:10:00.552067+0000","last_unstale":"2024-04-18T21:10:13.531146+0000","last_undegraded":"2024-04-18T21:10:13.531146+0000","last_fullsized":"2024-04-18T21:10:13.531146+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:51:32.567297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"71'345","reported_seq":530,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.481398+0000","last_change":"2024-04-18T21:05:05.624840+0000","last_active":"2024-04-18T21:10:12.481398+0000","last_peered":"2024-04-18T21:10:12.481398+0000","last_clean":"2024-04-18T21:10:12.481398+0000","last_became_active":"2024-04-18T21:05:05.622950+0000","last_became_peered":"2024-04-18T21:05:05.622950+0000","last_unstale":"2024-04-18T21:10:12.481398+0000","last_undegraded":"2024-04-18T21:10:12.481398+0000","last_fullsized":"2024-04-18T21:10:12.481398+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:27:17.530889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":317,"num_write_kb":29335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"70'171","reported_seq":270,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479753+0000","last_change":"2024-04-18T21:10:00.507624+0000","last_active":"2024-04-18T21:10:12.479753+0000","last_peered":"2024-04-18T21:10:12.479753+0000","last_clean":"2024-04-18T21:10:12.479753+0000","last_became_active":"2024-04-18T21:10:00.507132+0000","last_became_peered":"2024-04-18T21:10:00.507132+0000","last_unstale":"2024-04-18T21:10:12.479753+0000","last_undegraded":"2024-04-18T21:10:12.479753+0000","last_fullsized":"2024-04-18T21:10:12.479753+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:35:50.013019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":4154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"71'417","reported_seq":627,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479578+0000","last_change":"2024-04-18T21:05:05.627962+0000","last_active":"2024-04-18T21:10:12.479578+0000","last_peered":"2024-04-18T21:10:12.479578+0000","last_clean":"2024-04-18T21:10:12.479578+0000","last_became_active":"2024-04-18T21:05:05.626698+0000","last_became_peered":"2024-04-18T21:05:05.626698+0000","last_unstale":"2024-04-18T21:10:12.479578+0000","last_undegraded":"2024-04-18T21:10:12.479578+0000","last_fullsized":"2024-04-18T21:10:12.479578+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:48:48.973087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":17040,"num_write":384,"num_write_kb":83740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"70'276","reported_seq":457,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.531362+0000","last_change":"2024-04-18T21:09:53.543611+0000","last_active":"2024-04-18T21:10:13.531362+0000","last_peered":"2024-04-18T21:10:13.531362+0000","last_clean":"2024-04-18T21:10:13.531362+0000","last_became_active":"2024-04-18T21:09:53.542863+0000","last_became_peered":"2024-04-18T21:09:53.542863+0000","last_unstale":"2024-04-18T21:10:13.531362+0000","last_undegraded":"2024-04-18T21:10:13.531362+0000","last_fullsized":"2024-04-18T21:10:13.531362+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:22.582074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":12399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"71'428","reported_seq":623,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.531115+0000","last_change":"2024-04-18T21:10:08.541152+0000","last_active":"2024-04-18T21:10:13.531115+0000","last_peered":"2024-04-18T21:10:13.531115+0000","last_clean":"2024-04-18T21:10:13.531115+0000","last_became_active":"2024-04-18T21:10:08.536423+0000","last_became_peered":"2024-04-18T21:10:08.536423+0000","last_unstale":"2024-04-18T21:10:13.531115+0000","last_undegraded":"2024-04-18T21:10:13.531115+0000","last_fullsized":"2024-04-18T21:10:13.531115+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:26.666677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22548,"num_write":398,"num_write_kb":75972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"70'70","reported_seq":257,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.481458+0000","last_change":"2024-04-18T21:09:50.833350+0000","last_active":"2024-04-18T21:10:12.481458+0000","last_peered":"2024-04-18T21:10:12.481458+0000","last_clean":"2024-04-18T21:10:12.481458+0000","last_became_active":"2024-04-18T21:09:50.832355+0000","last_became_peered":"2024-04-18T21:09:50.832355+0000","last_unstale":"2024-04-18T21:10:12.481458+0000","last_undegraded":"2024-04-18T21:10:12.481458+0000","last_fullsized":"2024-04-18T21:10:12.481458+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:39:09.627425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'459","reported_seq":626,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479306+0000","last_change":"2024-04-18T21:10:01.503378+0000","last_active":"2024-04-18T21:10:12.479306+0000","last_peered":"2024-04-18T21:10:12.479306+0000","last_clean":"2024-04-18T21:10:12.479306+0000","last_became_active":"2024-04-18T21:10:01.497275+0000","last_became_peered":"2024-04-18T21:10:01.497275+0000","last_unstale":"2024-04-18T21:10:12.479306+0000","last_undegraded":"2024-04-18T21:10:12.479306+0000","last_fullsized":"2024-04-18T21:10:12.479306+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:40:35.832428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13353,"num_write":429,"num_write_kb":88123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"70'113","reported_seq":316,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.481912+0000","last_change":"2024-04-18T21:10:00.499468+0000","last_active":"2024-04-18T21:10:12.481912+0000","last_peered":"2024-04-18T21:10:12.481912+0000","last_clean":"2024-04-18T21:10:12.481912+0000","last_became_active":"2024-04-18T21:10:00.494734+0000","last_became_peered":"2024-04-18T21:10:00.494734+0000","last_unstale":"2024-04-18T21:10:12.481912+0000","last_undegraded":"2024-04-18T21:10:12.481912+0000","last_fullsized":"2024-04-18T21:10:12.481912+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:58:34.790588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194886,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1678,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2531,"num_read_kb":1304649,"num_write":24542,"num_write_kb":4299443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6176,"num_bytes_recovered":4488063,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":76783616,"data_stored":73448243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26603,"ondisk_log_size":26603,"up":128,"acting":118,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127139127,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":55,"num_read_kb":1405,"num_write":4542,"num_write_kb":127514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":92002768,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":279527424,"data_stored":279444842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4409,"internal_metadata":0},"log_size":6331,"ondisk_log_size":6331,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738437,"num_pgs":84,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":208552,"kb_used_data":105236,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94163288,"statfs":{"total":96636764160,"available":96423206912,"internally_reserved":0,"allocated":107761664,"data_stored":107198134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":77,"seq":330712481799,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":218032,"kb_used_data":166624,"kb_used_omap":5,"kb_used_meta":51386,"kb_avail":94153808,"statfs":{"total":96636764160,"available":96413499392,"internally_reserved":0,"allocated":170622976,"data_stored":166658645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6004,"internal_metadata":52619404},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738435,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":160396,"kb_used_data":89020,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94211444,"statfs":{"total":96636764160,"available":96472518656,"internally_reserved":0,"allocated":91156480,"data_stored":90583426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":89579520,"data_stored":89548273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":83750912,"data_stored":83729052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4409,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106196992,"data_stored":106167517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":76783616,"data_stored":73448243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:10:17.165 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-18T21:10:17.548 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:10:17.548 INFO:teuthology.orchestra.run.smithi078.stdout:{"fsid":"dc017990-0393-4ab0-b604-5e7052fdc7bd","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 1678/108 objects degraded (1553.704%), 9 pgs degraded","count":9},"muted":false}},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":334,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":105,"num_osds":3,"num_up_osds":3,"osd_up_since":1713474589,"num_in_osds":3,"osd_in_since":1713474284,"num_remapped_pgs":2},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":93},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":9},{"state_name":"peering","count":2},{"state_name":"active+recovering+undersized+remapped","count":1}],"num_pgs":105,"num_pools":4,"num_objects":54,"data_bytes":127729495,"bytes_used":601067520,"bytes_avail":289309224960,"bytes_total":289910292480,"inactive_pgs_ratio":0.01904761977493763,"degraded_objects":1678,"degraded_total":108,"degraded_ratio":15.537037037037036,"recovering_objects_per_sec":356,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":1428,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4202}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-04-18T21:06:12.521737+0000","services":{}},"progress_events":{}} 2024-04-18T21:10:17.566 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-04-18T21:10:17.566 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:10:17.851 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:10:17.853 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-04-18T21:10:17.868 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":265,"stamp":"2024-04-18T21:10:17.516839+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127729495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1678,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2722,"num_read_kb":1306172,"num_write":29287,"num_write_kb":4430417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6213,"num_bytes_recovered":97081199,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33091,"ondisk_log_size":33091,"up":210,"acting":200,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":222,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":586980,"kb_used_data":360880,"kb_used_omap":8,"kb_used_meta":226039,"kb_avail":282528540,"statfs":{"total":289910292480,"available":289309224960,"internally_reserved":0,"allocated":369541120,"data_stored":364440205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9194,"internal_metadata":231463958},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-675,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":698,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.048710"},"pg_stats":[{"pgid":"4.3f","version":"71'418","reported_seq":643,"reported_epoch":100,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:12.481512+0000","last_change":"2024-04-18T21:09:51.933769+0000","last_active":"2024-04-18T21:10:12.481512+0000","last_peered":"2024-04-18T21:10:12.481512+0000","last_clean":"2024-04-18T21:06:56.295490+0000","last_became_active":"2024-04-18T21:09:51.925977+0000","last_became_peered":"2024-04-18T21:09:51.925977+0000","last_unstale":"2024-04-18T21:10:12.481512+0000","last_undegraded":"2024-04-18T21:09:51.837482+0000","last_fullsized":"2024-04-18T21:09:51.829450+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":19677,"num_write":386,"num_write_kb":87615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"71'417","reported_seq":617,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.533326+0000","last_change":"2024-04-18T21:10:05.546965+0000","last_active":"2024-04-18T21:10:13.533326+0000","last_peered":"2024-04-18T21:10:13.533326+0000","last_clean":"2024-04-18T21:10:13.533326+0000","last_became_active":"2024-04-18T21:10:05.541170+0000","last_became_peered":"2024-04-18T21:10:05.541170+0000","last_unstale":"2024-04-18T21:10:13.533326+0000","last_undegraded":"2024-04-18T21:10:13.533326+0000","last_fullsized":"2024-04-18T21:10:13.533326+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:04:05.630763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":12123,"num_write":387,"num_write_kb":47157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"71'379","reported_seq":924,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479418+0000","last_change":"2024-04-18T21:09:54.480753+0000","last_active":"2024-04-18T21:10:12.479418+0000","last_peered":"2024-04-18T21:10:12.479418+0000","last_clean":"2024-04-18T21:10:12.479418+0000","last_became_active":"2024-04-18T21:09:54.478020+0000","last_became_peered":"2024-04-18T21:09:54.478020+0000","last_unstale":"2024-04-18T21:10:12.479418+0000","last_undegraded":"2024-04-18T21:10:12.479418+0000","last_fullsized":"2024-04-18T21:10:12.479418+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:24:18.705477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":10040,"num_write":353,"num_write_kb":63202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'372","reported_seq":558,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479140+0000","last_change":"2024-04-18T21:05:05.629321+0000","last_active":"2024-04-18T21:10:12.479140+0000","last_peered":"2024-04-18T21:10:12.479140+0000","last_clean":"2024-04-18T21:10:12.479140+0000","last_became_active":"2024-04-18T21:05:05.627956+0000","last_became_peered":"2024-04-18T21:05:05.627956+0000","last_unstale":"2024-04-18T21:10:12.479140+0000","last_undegraded":"2024-04-18T21:10:12.479140+0000","last_fullsized":"2024-04-18T21:10:12.479140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:15:28.458476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2735,"num_write":328,"num_write_kb":22107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"71'416","reported_seq":602,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.531330+0000","last_change":"2024-04-18T21:10:00.560644+0000","last_active":"2024-04-18T21:10:13.531330+0000","last_peered":"2024-04-18T21:10:13.531330+0000","last_clean":"2024-04-18T21:10:13.531330+0000","last_became_active":"2024-04-18T21:10:00.553862+0000","last_became_peered":"2024-04-18T21:10:00.553862+0000","last_unstale":"2024-04-18T21:10:13.531330+0000","last_undegraded":"2024-04-18T21:10:13.531330+0000","last_fullsized":"2024-04-18T21:10:13.531330+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:11:49.688538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6533,"num_write":389,"num_write_kb":43666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"71'374","reported_seq":558,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.478818+0000","last_change":"2024-04-18T21:10:01.495684+0000","last_active":"2024-04-18T21:10:12.478818+0000","last_peered":"2024-04-18T21:10:12.478818+0000","last_clean":"2024-04-18T21:10:12.478818+0000","last_became_active":"2024-04-18T21:10:01.486640+0000","last_became_peered":"2024-04-18T21:10:01.486640+0000","last_unstale":"2024-04-18T21:10:12.478818+0000","last_undegraded":"2024-04-18T21:10:12.478818+0000","last_fullsized":"2024-04-18T21:10:12.478818+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:39:10.639381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20415,"num_write":354,"num_write_kb":34462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'418","reported_seq":636,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480689+0000","last_change":"2024-04-18T21:05:05.625047+0000","last_active":"2024-04-18T21:10:12.480689+0000","last_peered":"2024-04-18T21:10:12.480689+0000","last_clean":"2024-04-18T21:10:12.480689+0000","last_became_active":"2024-04-18T21:05:05.622781+0000","last_became_peered":"2024-04-18T21:05:05.622781+0000","last_unstale":"2024-04-18T21:10:12.480689+0000","last_undegraded":"2024-04-18T21:10:12.480689+0000","last_fullsized":"2024-04-18T21:10:12.480689+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:12.944469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21103,"num_write":385,"num_write_kb":50678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"71'399","reported_seq":622,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.478359+0000","last_change":"2024-04-18T21:10:00.495543+0000","last_active":"2024-04-18T21:10:12.478359+0000","last_peered":"2024-04-18T21:10:12.478359+0000","last_clean":"2024-04-18T21:10:12.478359+0000","last_became_active":"2024-04-18T21:10:00.488705+0000","last_became_peered":"2024-04-18T21:10:00.488705+0000","last_unstale":"2024-04-18T21:10:12.478359+0000","last_undegraded":"2024-04-18T21:10:12.478359+0000","last_fullsized":"2024-04-18T21:10:12.478359+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:11.892092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":44692,"num_write":361,"num_write_kb":105170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"71'385","reported_seq":934,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480116+0000","last_change":"2024-04-18T21:10:06.487113+0000","last_active":"2024-04-18T21:10:12.480116+0000","last_peered":"2024-04-18T21:10:12.480116+0000","last_clean":"2024-04-18T21:10:12.480116+0000","last_became_active":"2024-04-18T21:10:06.482087+0000","last_became_peered":"2024-04-18T21:10:06.482087+0000","last_unstale":"2024-04-18T21:10:12.480116+0000","last_undegraded":"2024-04-18T21:10:12.480116+0000","last_fullsized":"2024-04-18T21:10:12.480116+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:10:51.435131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":994,"num_write":358,"num_write_kb":25964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'409","reported_seq":630,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.533255+0000","last_change":"2024-04-18T21:10:12.550697+0000","last_active":"2024-04-18T21:10:13.533255+0000","last_peered":"2024-04-18T21:10:13.533255+0000","last_clean":"2024-04-18T21:10:13.533255+0000","last_became_active":"2024-04-18T21:10:12.546621+0000","last_became_peered":"2024-04-18T21:10:12.546621+0000","last_unstale":"2024-04-18T21:10:13.533255+0000","last_undegraded":"2024-04-18T21:10:13.533255+0000","last_fullsized":"2024-04-18T21:10:13.533255+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:55:30.422126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":26170,"num_write":372,"num_write_kb":83931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"71'366","reported_seq":561,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479720+0000","last_change":"2024-04-18T21:10:01.496068+0000","last_active":"2024-04-18T21:10:12.479720+0000","last_peered":"2024-04-18T21:10:12.479720+0000","last_clean":"2024-04-18T21:10:12.479720+0000","last_became_active":"2024-04-18T21:10:01.488047+0000","last_became_peered":"2024-04-18T21:10:01.488047+0000","last_unstale":"2024-04-18T21:10:12.479720+0000","last_undegraded":"2024-04-18T21:10:12.479720+0000","last_fullsized":"2024-04-18T21:10:12.479720+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:49.957286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":18907,"num_write":347,"num_write_kb":26153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"71'346","reported_seq":535,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.532529+0000","last_change":"2024-04-18T21:10:00.560349+0000","last_active":"2024-04-18T21:10:13.532529+0000","last_peered":"2024-04-18T21:10:13.532529+0000","last_clean":"2024-04-18T21:10:13.532529+0000","last_became_active":"2024-04-18T21:10:00.557412+0000","last_became_peered":"2024-04-18T21:10:00.557412+0000","last_unstale":"2024-04-18T21:10:13.532529+0000","last_undegraded":"2024-04-18T21:10:13.532529+0000","last_fullsized":"2024-04-18T21:10:13.532529+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:54:33.428937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":6245,"num_write":324,"num_write_kb":37970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"71'417","reported_seq":624,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.531829+0000","last_change":"2024-04-18T21:10:02.555899+0000","last_active":"2024-04-18T21:10:13.531829+0000","last_peered":"2024-04-18T21:10:13.531829+0000","last_clean":"2024-04-18T21:10:13.531829+0000","last_became_active":"2024-04-18T21:10:02.551406+0000","last_became_peered":"2024-04-18T21:10:02.551406+0000","last_unstale":"2024-04-18T21:10:13.531829+0000","last_undegraded":"2024-04-18T21:10:13.531829+0000","last_fullsized":"2024-04-18T21:10:13.531829+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:41:17.455669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":21623,"num_write":381,"num_write_kb":71306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"71'398","reported_seq":961,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.478944+0000","last_change":"2024-04-18T21:10:11.491565+0000","last_active":"2024-04-18T21:10:12.478944+0000","last_peered":"2024-04-18T21:10:12.478944+0000","last_clean":"2024-04-18T21:10:12.478944+0000","last_became_active":"2024-04-18T21:10:11.486593+0000","last_became_peered":"2024-04-18T21:10:11.486593+0000","last_unstale":"2024-04-18T21:10:12.478944+0000","last_undegraded":"2024-04-18T21:10:12.478944+0000","last_fullsized":"2024-04-18T21:10:12.478944+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:11:23.853682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":369,"num_write_kb":30006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'435","reported_seq":733,"reported_epoch":100,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:12.478786+0000","last_change":"2024-04-18T21:10:01.504091+0000","last_active":"2024-04-18T21:10:12.478786+0000","last_peered":"2024-04-18T21:10:12.478786+0000","last_clean":"2024-04-18T21:09:48.742565+0000","last_became_active":"2024-04-18T21:10:01.499730+0000","last_became_peered":"2024-04-18T21:10:01.499730+0000","last_unstale":"2024-04-18T21:10:12.478786+0000","last_undegraded":"2024-04-18T21:10:01.482937+0000","last_fullsized":"2024-04-18T21:10:01.475971+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":173,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":31523,"num_write":402,"num_write_kb":121466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":410327,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'446","reported_seq":671,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.478353+0000","last_change":"2024-04-18T21:05:05.638203+0000","last_active":"2024-04-18T21:10:12.478353+0000","last_peered":"2024-04-18T21:10:12.478353+0000","last_clean":"2024-04-18T21:10:12.478353+0000","last_became_active":"2024-04-18T21:05:05.637352+0000","last_became_peered":"2024-04-18T21:05:05.637352+0000","last_unstale":"2024-04-18T21:10:12.478353+0000","last_undegraded":"2024-04-18T21:10:12.478353+0000","last_fullsized":"2024-04-18T21:10:12.478353+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":23833,"num_write":418,"num_write_kb":59679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"71'403","reported_seq":575,"reported_epoch":100,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:12.482094+0000","last_change":"2024-04-18T21:10:03.493121+0000","last_active":"2024-04-18T21:10:12.482094+0000","last_peered":"2024-04-18T21:10:12.482094+0000","last_clean":"2024-04-18T21:06:53.394905+0000","last_became_active":"2024-04-18T21:10:03.488943+0000","last_became_peered":"2024-04-18T21:10:03.488943+0000","last_unstale":"2024-04-18T21:10:12.482094+0000","last_undegraded":"2024-04-18T21:10:03.479306+0000","last_fullsized":"2024-04-18T21:10:03.477937+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":7482,"num_write":371,"num_write_kb":25957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'406","reported_seq":592,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.532977+0000","last_change":"2024-04-18T21:10:10.547457+0000","last_active":"2024-04-18T21:10:13.532977+0000","last_peered":"2024-04-18T21:10:13.532977+0000","last_clean":"2024-04-18T21:10:13.532977+0000","last_became_active":"2024-04-18T21:10:10.542594+0000","last_became_peered":"2024-04-18T21:10:10.542594+0000","last_unstale":"2024-04-18T21:10:13.532977+0000","last_undegraded":"2024-04-18T21:10:13.532977+0000","last_fullsized":"2024-04-18T21:10:13.532977+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:51:58.437990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":27987,"num_write":365,"num_write_kb":38689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"71'470","reported_seq":743,"reported_epoch":100,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:12.480747+0000","last_change":"2024-04-18T21:09:51.934073+0000","last_active":"2024-04-18T21:10:12.480747+0000","last_peered":"2024-04-18T21:10:12.480747+0000","last_clean":"2024-04-18T21:06:56.724047+0000","last_became_active":"2024-04-18T21:09:51.926836+0000","last_became_peered":"2024-04-18T21:09:51.926836+0000","last_unstale":"2024-04-18T21:10:12.480747+0000","last_undegraded":"2024-04-18T21:09:51.826935+0000","last_fullsized":"2024-04-18T21:09:51.811758+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":188,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":59273,"num_write":432,"num_write_kb":145930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'433","reported_seq":619,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479413+0000","last_change":"2024-04-18T21:05:05.638338+0000","last_active":"2024-04-18T21:10:12.479413+0000","last_peered":"2024-04-18T21:10:12.479413+0000","last_clean":"2024-04-18T21:10:12.479413+0000","last_became_active":"2024-04-18T21:05:05.637567+0000","last_became_peered":"2024-04-18T21:05:05.637567+0000","last_unstale":"2024-04-18T21:10:12.479413+0000","last_undegraded":"2024-04-18T21:10:12.479413+0000","last_fullsized":"2024-04-18T21:10:12.479413+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5514,"num_write":403,"num_write_kb":26329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"71'418","reported_seq":645,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.481188+0000","last_change":"2024-04-18T21:05:05.643606+0000","last_active":"2024-04-18T21:10:12.481188+0000","last_peered":"2024-04-18T21:10:12.481188+0000","last_clean":"2024-04-18T21:10:12.481188+0000","last_became_active":"2024-04-18T21:05:05.642991+0000","last_became_peered":"2024-04-18T21:05:05.642991+0000","last_unstale":"2024-04-18T21:10:12.481188+0000","last_undegraded":"2024-04-18T21:10:12.481188+0000","last_fullsized":"2024-04-18T21:10:12.481188+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:01.841786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":29097,"num_write":386,"num_write_kb":88262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"71'479","reported_seq":708,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.532348+0000","last_change":"2024-04-18T21:10:07.549995+0000","last_active":"2024-04-18T21:10:13.532348+0000","last_peered":"2024-04-18T21:10:13.532348+0000","last_clean":"2024-04-18T21:10:13.532348+0000","last_became_active":"2024-04-18T21:10:07.544314+0000","last_became_peered":"2024-04-18T21:10:07.544314+0000","last_unstale":"2024-04-18T21:10:13.532348+0000","last_undegraded":"2024-04-18T21:10:13.532348+0000","last_fullsized":"2024-04-18T21:10:13.532348+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:52:34.340348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":24204,"num_write":452,"num_write_kb":114184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"71'407","reported_seq":621,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.477929+0000","last_change":"2024-04-18T21:10:03.487961+0000","last_active":"2024-04-18T21:10:12.477929+0000","last_peered":"2024-04-18T21:10:12.477929+0000","last_clean":"2024-04-18T21:10:12.477929+0000","last_became_active":"2024-04-18T21:10:03.476552+0000","last_became_peered":"2024-04-18T21:10:03.476552+0000","last_unstale":"2024-04-18T21:10:12.477929+0000","last_undegraded":"2024-04-18T21:10:12.477929+0000","last_fullsized":"2024-04-18T21:10:12.477929+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:45:35.774025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":37766,"num_write":374,"num_write_kb":103984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'452","reported_seq":686,"reported_epoch":100,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:12.477667+0000","last_change":"2024-04-18T21:09:51.936910+0000","last_active":"2024-04-18T21:10:12.477667+0000","last_peered":"2024-04-18T21:10:12.477667+0000","last_clean":"2024-04-18T21:06:56.722577+0000","last_became_active":"2024-04-18T21:09:51.915967+0000","last_became_peered":"2024-04-18T21:09:51.915967+0000","last_unstale":"2024-04-18T21:10:12.477667+0000","last_undegraded":"2024-04-18T21:09:51.807076+0000","last_fullsized":"2024-04-18T21:09:51.791818+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":198,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27170,"num_write":421,"num_write_kb":39548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"71'427","reported_seq":620,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.532023+0000","last_change":"2024-04-18T21:10:03.544910+0000","last_active":"2024-04-18T21:10:13.532023+0000","last_peered":"2024-04-18T21:10:13.532023+0000","last_clean":"2024-04-18T21:10:13.532023+0000","last_became_active":"2024-04-18T21:10:03.539961+0000","last_became_peered":"2024-04-18T21:10:03.539961+0000","last_unstale":"2024-04-18T21:10:13.532023+0000","last_undegraded":"2024-04-18T21:10:13.532023+0000","last_fullsized":"2024-04-18T21:10:13.532023+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:06:34.839228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":11507,"num_write":407,"num_write_kb":50964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"71'471","reported_seq":681,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480805+0000","last_change":"2024-04-18T21:05:05.649581+0000","last_active":"2024-04-18T21:10:12.480805+0000","last_peered":"2024-04-18T21:10:12.480805+0000","last_clean":"2024-04-18T21:10:12.480805+0000","last_became_active":"2024-04-18T21:05:05.648233+0000","last_became_peered":"2024-04-18T21:05:05.648233+0000","last_unstale":"2024-04-18T21:10:12.480805+0000","last_undegraded":"2024-04-18T21:10:12.480805+0000","last_fullsized":"2024-04-18T21:10:12.480805+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20857,"num_write":431,"num_write_kb":63677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'378","reported_seq":924,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480254+0000","last_change":"2024-04-18T21:09:55.493655+0000","last_active":"2024-04-18T21:10:12.480254+0000","last_peered":"2024-04-18T21:10:12.480254+0000","last_clean":"2024-04-18T21:10:12.480254+0000","last_became_active":"2024-04-18T21:09:55.490958+0000","last_became_peered":"2024-04-18T21:09:55.490958+0000","last_unstale":"2024-04-18T21:10:12.480254+0000","last_undegraded":"2024-04-18T21:10:12.480254+0000","last_fullsized":"2024-04-18T21:10:12.480254+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:52:16.541697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12573,"num_write":347,"num_write_kb":34434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'410","reported_seq":625,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.532347+0000","last_change":"2024-04-18T21:10:01.563947+0000","last_active":"2024-04-18T21:10:13.532347+0000","last_peered":"2024-04-18T21:10:13.532347+0000","last_clean":"2024-04-18T21:10:13.532347+0000","last_became_active":"2024-04-18T21:10:01.555367+0000","last_became_peered":"2024-04-18T21:10:01.555367+0000","last_unstale":"2024-04-18T21:10:13.532347+0000","last_undegraded":"2024-04-18T21:10:13.532347+0000","last_fullsized":"2024-04-18T21:10:13.532347+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:01:09.418419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":16926,"num_write":380,"num_write_kb":112804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"71'410","reported_seq":975,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479546+0000","last_change":"2024-04-18T21:10:03.490605+0000","last_active":"2024-04-18T21:10:12.479546+0000","last_peered":"2024-04-18T21:10:12.479546+0000","last_clean":"2024-04-18T21:10:12.479546+0000","last_became_active":"2024-04-18T21:10:03.480985+0000","last_became_peered":"2024-04-18T21:10:03.480985+0000","last_unstale":"2024-04-18T21:10:12.479546+0000","last_undegraded":"2024-04-18T21:10:12.479546+0000","last_fullsized":"2024-04-18T21:10:12.479546+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:14:42.076110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":34811,"num_write":378,"num_write_kb":51242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'491","reported_seq":695,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.531780+0000","last_change":"2024-04-18T21:10:08.546388+0000","last_active":"2024-04-18T21:10:13.531780+0000","last_peered":"2024-04-18T21:10:13.531780+0000","last_clean":"2024-04-18T21:10:13.531780+0000","last_became_active":"2024-04-18T21:10:08.540487+0000","last_became_peered":"2024-04-18T21:10:08.540487+0000","last_unstale":"2024-04-18T21:10:13.531780+0000","last_undegraded":"2024-04-18T21:10:13.531780+0000","last_fullsized":"2024-04-18T21:10:13.531780+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:15:51.120517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":26902,"num_write":456,"num_write_kb":124778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":209,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"71'467","reported_seq":672,"reported_epoch":100,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:12.477951+0000","last_change":"2024-04-18T21:10:03.488499+0000","last_active":"2024-04-18T21:10:12.477951+0000","last_peered":"2024-04-18T21:10:12.477951+0000","last_clean":"2024-04-18T21:06:56.506258+0000","last_became_active":"2024-04-18T21:10:03.477945+0000","last_became_peered":"2024-04-18T21:10:03.477945+0000","last_unstale":"2024-04-18T21:10:12.477951+0000","last_undegraded":"2024-04-18T21:10:03.471107+0000","last_fullsized":"2024-04-18T21:10:03.470440+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":192,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":28114,"num_write":434,"num_write_kb":129325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'423","reported_seq":579,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479574+0000","last_change":"2024-04-18T21:10:01.499421+0000","last_active":"2024-04-18T21:10:12.479574+0000","last_peered":"2024-04-18T21:10:12.479574+0000","last_clean":"2024-04-18T21:10:12.479574+0000","last_became_active":"2024-04-18T21:10:01.487074+0000","last_became_peered":"2024-04-18T21:10:01.487074+0000","last_unstale":"2024-04-18T21:10:12.479574+0000","last_undegraded":"2024-04-18T21:10:12.479574+0000","last_fullsized":"2024-04-18T21:10:12.479574+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:05:34.827814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8244,"num_write":393,"num_write_kb":58692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"71'389","reported_seq":604,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.531573+0000","last_change":"2024-04-18T21:09:58.542232+0000","last_active":"2024-04-18T21:10:13.531573+0000","last_peered":"2024-04-18T21:10:13.531573+0000","last_clean":"2024-04-18T21:10:13.531573+0000","last_became_active":"2024-04-18T21:09:58.537723+0000","last_became_peered":"2024-04-18T21:09:58.537723+0000","last_unstale":"2024-04-18T21:10:13.531573+0000","last_undegraded":"2024-04-18T21:10:13.531573+0000","last_fullsized":"2024-04-18T21:10:13.531573+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:26.786170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":24216,"num_write":349,"num_write_kb":43176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"70'425","reported_seq":605,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.481588+0000","last_change":"2024-04-18T21:05:04.632748+0000","last_active":"2024-04-18T21:10:12.481588+0000","last_peered":"2024-04-18T21:10:12.481588+0000","last_clean":"2024-04-18T21:10:12.481588+0000","last_became_active":"2024-04-18T21:05:04.628407+0000","last_became_peered":"2024-04-18T21:05:04.628407+0000","last_unstale":"2024-04-18T21:10:12.481588+0000","last_undegraded":"2024-04-18T21:10:12.481588+0000","last_fullsized":"2024-04-18T21:10:12.481588+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:42:45.392908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":375,"num_write_kb":8348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"71'423","reported_seq":603,"reported_epoch":101,"state":"peering","last_fresh":"2024-04-18T21:10:13.533183+0000","last_change":"2024-04-18T21:10:13.533183+0000","last_active":"2024-04-18T21:09:50.773535+0000","last_peered":"2024-04-18T21:09:48.748161+0000","last_clean":"2024-04-18T21:06:56.697536+0000","last_became_active":"2024-04-18T21:06:57.814108+0000","last_became_peered":"2024-04-18T21:06:57.814108+0000","last_unstale":"2024-04-18T21:10:13.533183+0000","last_undegraded":"2024-04-18T21:10:13.533183+0000","last_fullsized":"2024-04-18T21:10:13.533183+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":20096,"num_write":381,"num_write_kb":76351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"70'56","reported_seq":248,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.478351+0000","last_change":"2024-04-18T21:10:00.500122+0000","last_active":"2024-04-18T21:10:12.478351+0000","last_peered":"2024-04-18T21:10:12.478351+0000","last_clean":"2024-04-18T21:10:12.478351+0000","last_became_active":"2024-04-18T21:10:00.489486+0000","last_became_peered":"2024-04-18T21:10:00.489486+0000","last_unstale":"2024-04-18T21:10:12.478351+0000","last_undegraded":"2024-04-18T21:10:12.478351+0000","last_fullsized":"2024-04-18T21:10:12.478351+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:58:08.269558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'442","reported_seq":1010,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.481507+0000","last_change":"2024-04-18T21:10:03.492109+0000","last_active":"2024-04-18T21:10:12.481507+0000","last_peered":"2024-04-18T21:10:12.481507+0000","last_clean":"2024-04-18T21:10:12.481507+0000","last_became_active":"2024-04-18T21:10:03.483050+0000","last_became_peered":"2024-04-18T21:10:03.483050+0000","last_unstale":"2024-04-18T21:10:12.481507+0000","last_undegraded":"2024-04-18T21:10:12.481507+0000","last_fullsized":"2024-04-18T21:10:12.481507+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:45.388623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13827,"num_write":415,"num_write_kb":79859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"70'62","reported_seq":66,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.531419+0000","last_change":"2024-04-18T21:09:50.868159+0000","last_active":"2024-04-18T21:10:13.531419+0000","last_peered":"2024-04-18T21:10:13.531419+0000","last_clean":"2024-04-18T21:10:13.531419+0000","last_became_active":"2024-04-18T21:09:50.867096+0000","last_became_peered":"2024-04-18T21:09:50.867096+0000","last_unstale":"2024-04-18T21:10:13.531419+0000","last_undegraded":"2024-04-18T21:10:13.531419+0000","last_fullsized":"2024-04-18T21:10:13.531419+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:09:57.047205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"71'398","reported_seq":623,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480249+0000","last_change":"2024-04-18T21:10:01.498728+0000","last_active":"2024-04-18T21:10:12.480249+0000","last_peered":"2024-04-18T21:10:12.480249+0000","last_clean":"2024-04-18T21:10:12.480249+0000","last_became_active":"2024-04-18T21:10:01.495349+0000","last_became_peered":"2024-04-18T21:10:01.495349+0000","last_unstale":"2024-04-18T21:10:12.480249+0000","last_undegraded":"2024-04-18T21:10:12.480249+0000","last_fullsized":"2024-04-18T21:10:12.480249+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:01:48.618551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":17616,"num_write":360,"num_write_kb":58871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"70'66","reported_seq":165,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.478944+0000","last_change":"2024-04-18T21:10:00.496701+0000","last_active":"2024-04-18T21:10:12.478944+0000","last_peered":"2024-04-18T21:10:12.478944+0000","last_clean":"2024-04-18T21:10:12.478944+0000","last_became_active":"2024-04-18T21:10:00.495594+0000","last_became_peered":"2024-04-18T21:10:00.495594+0000","last_unstale":"2024-04-18T21:10:12.478944+0000","last_undegraded":"2024-04-18T21:10:12.478944+0000","last_fullsized":"2024-04-18T21:10:12.478944+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:11:32.991308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"70'135","reported_seq":52,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.481009+0000","last_change":"2024-04-18T21:10:00.493197+0000","last_active":"2024-04-18T21:10:12.481009+0000","last_peered":"2024-04-18T21:10:12.481009+0000","last_clean":"2024-04-18T21:10:12.481009+0000","last_became_active":"2024-04-18T21:10:00.491509+0000","last_became_peered":"2024-04-18T21:10:00.491509+0000","last_unstale":"2024-04-18T21:10:12.481009+0000","last_undegraded":"2024-04-18T21:10:12.481009+0000","last_fullsized":"2024-04-18T21:10:12.481009+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:57:29.595389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":7777508,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'410","reported_seq":596,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.531577+0000","last_change":"2024-04-18T21:10:06.553806+0000","last_active":"2024-04-18T21:10:13.531577+0000","last_peered":"2024-04-18T21:10:13.531577+0000","last_clean":"2024-04-18T21:10:13.531577+0000","last_became_active":"2024-04-18T21:10:06.548034+0000","last_became_peered":"2024-04-18T21:10:06.548034+0000","last_unstale":"2024-04-18T21:10:13.531577+0000","last_undegraded":"2024-04-18T21:10:13.531577+0000","last_fullsized":"2024-04-18T21:10:13.531577+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:20:56.265941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17055,"num_write":375,"num_write_kb":63331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"70'240","reported_seq":349,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.532368+0000","last_change":"2024-04-18T21:10:00.556212+0000","last_active":"2024-04-18T21:10:13.532368+0000","last_peered":"2024-04-18T21:10:13.532368+0000","last_clean":"2024-04-18T21:10:13.532368+0000","last_became_active":"2024-04-18T21:10:00.555486+0000","last_became_peered":"2024-04-18T21:10:00.555486+0000","last_unstale":"2024-04-18T21:10:13.532368+0000","last_undegraded":"2024-04-18T21:10:13.532368+0000","last_fullsized":"2024-04-18T21:10:13.532368+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:11.573984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":4191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"71'501","reported_seq":750,"reported_epoch":100,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:12.478568+0000","last_change":"2024-04-18T21:09:51.935429+0000","last_active":"2024-04-18T21:10:12.478568+0000","last_peered":"2024-04-18T21:10:12.478568+0000","last_clean":"2024-04-18T21:06:56.729630+0000","last_became_active":"2024-04-18T21:09:51.925059+0000","last_became_peered":"2024-04-18T21:09:51.925059+0000","last_unstale":"2024-04-18T21:10:12.478568+0000","last_undegraded":"2024-04-18T21:09:51.823027+0000","last_fullsized":"2024-04-18T21:09:51.807046+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":202,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":37662,"num_write":474,"num_write_kb":167663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"70'429","reported_seq":550,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480893+0000","last_change":"2024-04-18T21:10:00.493325+0000","last_active":"2024-04-18T21:10:12.480893+0000","last_peered":"2024-04-18T21:10:12.480893+0000","last_clean":"2024-04-18T21:10:12.480893+0000","last_became_active":"2024-04-18T21:10:00.491525+0000","last_became_peered":"2024-04-18T21:10:00.491525+0000","last_unstale":"2024-04-18T21:10:12.480893+0000","last_undegraded":"2024-04-18T21:10:12.480893+0000","last_fullsized":"2024-04-18T21:10:12.480893+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:27:59.637974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":377,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388678,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'440","reported_seq":634,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479867+0000","last_change":"2024-04-18T21:10:01.497932+0000","last_active":"2024-04-18T21:10:12.479867+0000","last_peered":"2024-04-18T21:10:12.479867+0000","last_clean":"2024-04-18T21:10:12.479867+0000","last_became_active":"2024-04-18T21:10:01.486740+0000","last_became_peered":"2024-04-18T21:10:01.486740+0000","last_unstale":"2024-04-18T21:10:12.479867+0000","last_undegraded":"2024-04-18T21:10:12.479867+0000","last_fullsized":"2024-04-18T21:10:12.479867+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:34:43.515471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":42138,"num_write":408,"num_write_kb":96310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"70'59","reported_seq":239,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480031+0000","last_change":"2024-04-18T21:05:04.625520+0000","last_active":"2024-04-18T21:10:12.480031+0000","last_peered":"2024-04-18T21:10:12.480031+0000","last_clean":"2024-04-18T21:10:12.480031+0000","last_became_active":"2024-04-18T21:05:04.624656+0000","last_became_peered":"2024-04-18T21:05:04.624656+0000","last_unstale":"2024-04-18T21:10:12.480031+0000","last_undegraded":"2024-04-18T21:10:12.480031+0000","last_fullsized":"2024-04-18T21:10:12.480031+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:56:05.795125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"71'461","reported_seq":660,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479054+0000","last_change":"2024-04-18T21:05:05.649406+0000","last_active":"2024-04-18T21:10:12.479054+0000","last_peered":"2024-04-18T21:10:12.479054+0000","last_clean":"2024-04-18T21:10:12.479054+0000","last_became_active":"2024-04-18T21:05:05.648380+0000","last_became_peered":"2024-04-18T21:05:05.648380+0000","last_unstale":"2024-04-18T21:10:12.479054+0000","last_undegraded":"2024-04-18T21:10:12.479054+0000","last_fullsized":"2024-04-18T21:10:12.479054+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12852,"num_write":420,"num_write_kb":88506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"70'157","reported_seq":360,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480612+0000","last_change":"2024-04-18T21:10:00.500141+0000","last_active":"2024-04-18T21:10:12.480612+0000","last_peered":"2024-04-18T21:10:12.480612+0000","last_clean":"2024-04-18T21:10:12.480612+0000","last_became_active":"2024-04-18T21:10:00.494630+0000","last_became_peered":"2024-04-18T21:10:00.494630+0000","last_unstale":"2024-04-18T21:10:12.480612+0000","last_undegraded":"2024-04-18T21:10:12.480612+0000","last_fullsized":"2024-04-18T21:10:12.480612+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:49:43.984354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":8250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'445","reported_seq":619,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479461+0000","last_change":"2024-04-18T21:10:01.500937+0000","last_active":"2024-04-18T21:10:12.479461+0000","last_peered":"2024-04-18T21:10:12.479461+0000","last_clean":"2024-04-18T21:10:12.479461+0000","last_became_active":"2024-04-18T21:10:01.490691+0000","last_became_peered":"2024-04-18T21:10:01.490691+0000","last_unstale":"2024-04-18T21:10:12.479461+0000","last_undegraded":"2024-04-18T21:10:12.479461+0000","last_fullsized":"2024-04-18T21:10:12.479461+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:59:48.489145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17488,"num_write":410,"num_write_kb":50845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"70'124","reported_seq":304,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480178+0000","last_change":"2024-04-18T21:05:04.634674+0000","last_active":"2024-04-18T21:10:12.480178+0000","last_peered":"2024-04-18T21:10:12.480178+0000","last_clean":"2024-04-18T21:10:12.480178+0000","last_became_active":"2024-04-18T21:05:04.632284+0000","last_became_peered":"2024-04-18T21:05:04.632284+0000","last_unstale":"2024-04-18T21:10:12.480178+0000","last_undegraded":"2024-04-18T21:10:12.480178+0000","last_fullsized":"2024-04-18T21:10:12.480178+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:09:18.466987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"71'400","reported_seq":678,"reported_epoch":100,"state":"active+recovering+undersized+remapped","last_fresh":"2024-04-18T21:10:12.669265+0000","last_change":"2024-04-18T21:10:12.477444+0000","last_active":"2024-04-18T21:10:12.669265+0000","last_peered":"2024-04-18T21:10:12.669265+0000","last_clean":"2024-04-18T21:09:48.744284+0000","last_became_active":"2024-04-18T21:10:01.496176+0000","last_became_peered":"2024-04-18T21:10:01.496176+0000","last_unstale":"2024-04-18T21:10:12.669265+0000","last_undegraded":"2024-04-18T21:10:12.669265+0000","last_fullsized":"2024-04-18T21:10:01.480189+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12586,"num_write":372,"num_write_kb":58856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":229,"num_bytes_recovered":576854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"70'53","reported_seq":68,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.530764+0000","last_change":"2024-04-18T21:10:00.550936+0000","last_active":"2024-04-18T21:10:13.530764+0000","last_peered":"2024-04-18T21:10:13.530764+0000","last_clean":"2024-04-18T21:10:13.530764+0000","last_became_active":"2024-04-18T21:10:00.549987+0000","last_became_peered":"2024-04-18T21:10:00.549987+0000","last_unstale":"2024-04-18T21:10:13.530764+0000","last_undegraded":"2024-04-18T21:10:13.530764+0000","last_fullsized":"2024-04-18T21:10:13.530764+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:53:36.771516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"71'364","reported_seq":927,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480632+0000","last_change":"2024-04-18T21:09:58.478726+0000","last_active":"2024-04-18T21:10:12.480632+0000","last_peered":"2024-04-18T21:10:12.480632+0000","last_clean":"2024-04-18T21:10:12.480632+0000","last_became_active":"2024-04-18T21:09:58.473903+0000","last_became_peered":"2024-04-18T21:09:58.473903+0000","last_unstale":"2024-04-18T21:10:12.480632+0000","last_undegraded":"2024-04-18T21:10:12.480632+0000","last_fullsized":"2024-04-18T21:10:12.480632+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:40.377274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":37938,"num_write":336,"num_write_kb":42513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"70'460","reported_seq":559,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.530986+0000","last_change":"2024-04-18T21:09:53.545846+0000","last_active":"2024-04-18T21:10:13.530986+0000","last_peered":"2024-04-18T21:10:13.530986+0000","last_clean":"2024-04-18T21:10:13.530986+0000","last_became_active":"2024-04-18T21:09:53.544355+0000","last_became_peered":"2024-04-18T21:09:53.544355+0000","last_unstale":"2024-04-18T21:10:13.530986+0000","last_undegraded":"2024-04-18T21:10:13.530986+0000","last_fullsized":"2024-04-18T21:10:13.530986+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:34:16.776752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":406,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"71'404","reported_seq":607,"reported_epoch":100,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:12.480553+0000","last_change":"2024-04-18T21:09:51.933464+0000","last_active":"2024-04-18T21:10:12.480553+0000","last_peered":"2024-04-18T21:10:12.480553+0000","last_clean":"2024-04-18T21:06:56.714828+0000","last_became_active":"2024-04-18T21:09:51.918677+0000","last_became_peered":"2024-04-18T21:09:51.918677+0000","last_unstale":"2024-04-18T21:10:12.480553+0000","last_undegraded":"2024-04-18T21:09:51.824330+0000","last_fullsized":"2024-04-18T21:09:51.803729+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":174,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":7075,"num_write":367,"num_write_kb":62738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":367,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480008+0000","last_change":"2024-04-18T21:10:00.497960+0000","last_active":"2024-04-18T21:10:12.480008+0000","last_peered":"2024-04-18T21:10:12.480008+0000","last_clean":"2024-04-18T21:10:12.480008+0000","last_became_active":"2024-04-18T21:10:00.496373+0000","last_became_peered":"2024-04-18T21:10:00.496373+0000","last_unstale":"2024-04-18T21:10:12.480008+0000","last_undegraded":"2024-04-18T21:10:12.480008+0000","last_fullsized":"2024-04-18T21:10:12.480008+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_clean_scrub_stamp":"2024-04-18T21:04:53.494814+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:56:52.975720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":143,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.482074+0000","last_change":"2024-04-18T21:10:00.487584+0000","last_active":"2024-04-18T21:10:12.482074+0000","last_peered":"2024-04-18T21:10:12.482074+0000","last_clean":"2024-04-18T21:10:12.482074+0000","last_became_active":"2024-04-18T21:10:00.486722+0000","last_became_peered":"2024-04-18T21:10:00.486722+0000","last_unstale":"2024-04-18T21:10:12.482074+0000","last_undegraded":"2024-04-18T21:10:12.482074+0000","last_fullsized":"2024-04-18T21:10:12.482074+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:17:03.176148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"70'595","reported_seq":734,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.478666+0000","last_change":"2024-04-18T21:10:03.488427+0000","last_active":"2024-04-18T21:10:12.478666+0000","last_peered":"2024-04-18T21:10:12.478666+0000","last_clean":"2024-04-18T21:10:12.478666+0000","last_became_active":"2024-04-18T21:10:03.481344+0000","last_became_peered":"2024-04-18T21:10:03.481344+0000","last_unstale":"2024-04-18T21:10:12.478666+0000","last_undegraded":"2024-04-18T21:10:12.478666+0000","last_fullsized":"2024-04-18T21:10:12.478666+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:41.583248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":539,"num_write_kb":8449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4689862,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'443","reported_seq":1073,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480568+0000","last_change":"2024-04-18T21:09:56.496310+0000","last_active":"2024-04-18T21:10:12.480568+0000","last_peered":"2024-04-18T21:10:12.480568+0000","last_clean":"2024-04-18T21:10:12.480568+0000","last_became_active":"2024-04-18T21:09:56.493327+0000","last_became_peered":"2024-04-18T21:09:56.493327+0000","last_unstale":"2024-04-18T21:10:12.480568+0000","last_undegraded":"2024-04-18T21:10:12.480568+0000","last_fullsized":"2024-04-18T21:10:12.480568+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:20:57.340997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":38975,"num_write":404,"num_write_kb":80038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":193,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479647+0000","last_change":"2024-04-18T21:09:50.817029+0000","last_active":"2024-04-18T21:10:12.479647+0000","last_peered":"2024-04-18T21:10:12.479647+0000","last_clean":"2024-04-18T21:10:12.479647+0000","last_became_active":"2024-04-18T21:09:50.816543+0000","last_became_peered":"2024-04-18T21:09:50.816543+0000","last_unstale":"2024-04-18T21:10:12.479647+0000","last_undegraded":"2024-04-18T21:10:12.479647+0000","last_fullsized":"2024-04-18T21:10:12.479647+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:47:33.047727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"70'129","reported_seq":296,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479259+0000","last_change":"2024-04-18T21:10:03.489109+0000","last_active":"2024-04-18T21:10:12.479259+0000","last_peered":"2024-04-18T21:10:12.479259+0000","last_clean":"2024-04-18T21:10:12.479259+0000","last_became_active":"2024-04-18T21:10:03.486859+0000","last_became_peered":"2024-04-18T21:10:03.486859+0000","last_unstale":"2024-04-18T21:10:12.479259+0000","last_undegraded":"2024-04-18T21:10:12.479259+0000","last_fullsized":"2024-04-18T21:10:12.479259+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:52:04.172480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466419,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":55,"num_read_kb":1405,"num_write":58,"num_write_kb":1469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'457","reported_seq":666,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.533564+0000","last_change":"2024-04-18T21:10:09.543207+0000","last_active":"2024-04-18T21:10:13.533564+0000","last_peered":"2024-04-18T21:10:13.533564+0000","last_clean":"2024-04-18T21:10:13.533564+0000","last_became_active":"2024-04-18T21:10:09.537428+0000","last_became_peered":"2024-04-18T21:10:09.537428+0000","last_unstale":"2024-04-18T21:10:13.533564+0000","last_undegraded":"2024-04-18T21:10:13.533564+0000","last_fullsized":"2024-04-18T21:10:13.533564+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:21.987918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":27659,"num_write":426,"num_write_kb":80500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":192,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479746+0000","last_change":"2024-04-18T21:09:50.832624+0000","last_active":"2024-04-18T21:10:12.479746+0000","last_peered":"2024-04-18T21:10:12.479746+0000","last_clean":"2024-04-18T21:10:12.479746+0000","last_became_active":"2024-04-18T21:09:50.831949+0000","last_became_peered":"2024-04-18T21:09:50.831949+0000","last_unstale":"2024-04-18T21:10:12.479746+0000","last_undegraded":"2024-04-18T21:10:12.479746+0000","last_fullsized":"2024-04-18T21:10:12.479746+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:35:45.986029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'170","reported_seq":354,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.530541+0000","last_change":"2024-04-18T21:09:53.538615+0000","last_active":"2024-04-18T21:10:13.530541+0000","last_peered":"2024-04-18T21:10:13.530541+0000","last_clean":"2024-04-18T21:10:13.530541+0000","last_became_active":"2024-04-18T21:09:53.537994+0000","last_became_peered":"2024-04-18T21:09:53.537994+0000","last_unstale":"2024-04-18T21:10:13.530541+0000","last_undegraded":"2024-04-18T21:10:13.530541+0000","last_fullsized":"2024-04-18T21:10:13.530541+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:02:34.372453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":8239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"71'346","reported_seq":894,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.481122+0000","last_change":"2024-04-18T21:10:11.487541+0000","last_active":"2024-04-18T21:10:12.481122+0000","last_peered":"2024-04-18T21:10:12.481122+0000","last_clean":"2024-04-18T21:10:12.481122+0000","last_became_active":"2024-04-18T21:10:11.484662+0000","last_became_peered":"2024-04-18T21:10:11.484662+0000","last_unstale":"2024-04-18T21:10:12.481122+0000","last_undegraded":"2024-04-18T21:10:12.481122+0000","last_fullsized":"2024-04-18T21:10:12.481122+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:50:21.491862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27042,"num_write":321,"num_write_kb":50693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":186,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480436+0000","last_change":"2024-04-18T21:05:00.576606+0000","last_active":"2024-04-18T21:10:12.480436+0000","last_peered":"2024-04-18T21:10:12.480436+0000","last_clean":"2024-04-18T21:10:12.480436+0000","last_became_active":"2024-04-18T21:05:00.575951+0000","last_became_peered":"2024-04-18T21:05:00.575951+0000","last_unstale":"2024-04-18T21:10:12.480436+0000","last_undegraded":"2024-04-18T21:10:12.480436+0000","last_fullsized":"2024-04-18T21:10:12.480436+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:32:17.612481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"70'63","reported_seq":243,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.481819+0000","last_change":"2024-04-18T21:05:04.627296+0000","last_active":"2024-04-18T21:10:12.481819+0000","last_peered":"2024-04-18T21:10:12.481819+0000","last_clean":"2024-04-18T21:10:12.481819+0000","last_became_active":"2024-04-18T21:05:04.626801+0000","last_became_peered":"2024-04-18T21:05:04.626801+0000","last_unstale":"2024-04-18T21:10:12.481819+0000","last_undegraded":"2024-04-18T21:10:12.481819+0000","last_fullsized":"2024-04-18T21:10:12.481819+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:46:36.285416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"71'406","reported_seq":1025,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479591+0000","last_change":"2024-04-18T21:09:59.495686+0000","last_active":"2024-04-18T21:10:12.479591+0000","last_peered":"2024-04-18T21:10:12.479591+0000","last_clean":"2024-04-18T21:10:12.479591+0000","last_became_active":"2024-04-18T21:09:59.493248+0000","last_became_peered":"2024-04-18T21:09:59.493248+0000","last_unstale":"2024-04-18T21:10:12.479591+0000","last_undegraded":"2024-04-18T21:10:12.479591+0000","last_fullsized":"2024-04-18T21:10:12.479591+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:11:23.853682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":35332,"num_write":370,"num_write_kb":71807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"70'284","reported_seq":299,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.481194+0000","last_change":"2024-04-18T21:10:00.504958+0000","last_active":"2024-04-18T21:10:12.481194+0000","last_peered":"2024-04-18T21:10:12.481194+0000","last_clean":"2024-04-18T21:10:12.481194+0000","last_became_active":"2024-04-18T21:10:00.503851+0000","last_became_peered":"2024-04-18T21:10:00.503851+0000","last_unstale":"2024-04-18T21:10:12.481194+0000","last_undegraded":"2024-04-18T21:10:12.481194+0000","last_fullsized":"2024-04-18T21:10:12.481194+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:10:27.397258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":218,"num_write_kb":4194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":119,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480118+0000","last_change":"2024-04-18T21:10:03.484148+0000","last_active":"2024-04-18T21:10:12.480118+0000","last_peered":"2024-04-18T21:10:12.480118+0000","last_clean":"2024-04-18T21:10:12.480118+0000","last_became_active":"2024-04-18T21:10:03.480071+0000","last_became_peered":"2024-04-18T21:10:03.480071+0000","last_unstale":"2024-04-18T21:10:12.480118+0000","last_undegraded":"2024-04-18T21:10:12.480118+0000","last_fullsized":"2024-04-18T21:10:12.480118+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:50:30.257039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'386","reported_seq":563,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.532066+0000","last_change":"2024-04-18T21:10:10.547885+0000","last_active":"2024-04-18T21:10:13.532066+0000","last_peered":"2024-04-18T21:10:13.532066+0000","last_clean":"2024-04-18T21:10:13.532066+0000","last_became_active":"2024-04-18T21:10:10.542515+0000","last_became_peered":"2024-04-18T21:10:10.542515+0000","last_unstale":"2024-04-18T21:10:13.532066+0000","last_undegraded":"2024-04-18T21:10:13.532066+0000","last_fullsized":"2024-04-18T21:10:13.532066+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:58:24.232536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14677,"num_write":355,"num_write_kb":51018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"70'55","reported_seq":241,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480040+0000","last_change":"2024-04-18T21:09:50.833424+0000","last_active":"2024-04-18T21:10:12.480040+0000","last_peered":"2024-04-18T21:10:12.480040+0000","last_clean":"2024-04-18T21:10:12.480040+0000","last_became_active":"2024-04-18T21:09:50.832752+0000","last_became_peered":"2024-04-18T21:09:50.832752+0000","last_unstale":"2024-04-18T21:10:12.480040+0000","last_undegraded":"2024-04-18T21:10:12.480040+0000","last_fullsized":"2024-04-18T21:10:12.480040+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:48.945329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":151,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.533681+0000","last_change":"2024-04-18T21:09:50.900338+0000","last_active":"2024-04-18T21:10:13.533681+0000","last_peered":"2024-04-18T21:10:13.533681+0000","last_clean":"2024-04-18T21:10:13.533681+0000","last_became_active":"2024-04-18T21:09:50.896844+0000","last_became_peered":"2024-04-18T21:09:50.896844+0000","last_unstale":"2024-04-18T21:10:13.533681+0000","last_undegraded":"2024-04-18T21:10:13.533681+0000","last_fullsized":"2024-04-18T21:10:13.533681+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:11:35.543409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"71'402","reported_seq":577,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.531035+0000","last_change":"2024-04-18T21:10:05.542484+0000","last_active":"2024-04-18T21:10:13.531035+0000","last_peered":"2024-04-18T21:10:13.531035+0000","last_clean":"2024-04-18T21:10:13.531035+0000","last_became_active":"2024-04-18T21:10:05.536763+0000","last_became_peered":"2024-04-18T21:10:05.536763+0000","last_unstale":"2024-04-18T21:10:13.531035+0000","last_undegraded":"2024-04-18T21:10:13.531035+0000","last_fullsized":"2024-04-18T21:10:13.531035+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:08:22.367267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12468,"num_write":369,"num_write_kb":67231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"70'60","reported_seq":247,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.482159+0000","last_change":"2024-04-18T21:09:50.832598+0000","last_active":"2024-04-18T21:10:12.482159+0000","last_peered":"2024-04-18T21:10:12.482159+0000","last_clean":"2024-04-18T21:10:12.482159+0000","last_became_active":"2024-04-18T21:09:50.832030+0000","last_became_peered":"2024-04-18T21:09:50.832030+0000","last_unstale":"2024-04-18T21:10:12.482159+0000","last_undegraded":"2024-04-18T21:10:12.482159+0000","last_fullsized":"2024-04-18T21:10:12.482159+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:10:27.397258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":119,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.481784+0000","last_change":"2024-04-18T21:10:03.492761+0000","last_active":"2024-04-18T21:10:12.481784+0000","last_peered":"2024-04-18T21:10:12.481784+0000","last_clean":"2024-04-18T21:10:12.481784+0000","last_became_active":"2024-04-18T21:10:03.492145+0000","last_became_peered":"2024-04-18T21:10:03.492145+0000","last_unstale":"2024-04-18T21:10:12.481784+0000","last_undegraded":"2024-04-18T21:10:12.481784+0000","last_fullsized":"2024-04-18T21:10:12.481784+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:20:00.853523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'421","reported_seq":612,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479014+0000","last_change":"2024-04-18T21:10:03.488774+0000","last_active":"2024-04-18T21:10:12.479014+0000","last_peered":"2024-04-18T21:10:12.479014+0000","last_clean":"2024-04-18T21:10:12.479014+0000","last_became_active":"2024-04-18T21:10:03.479773+0000","last_became_peered":"2024-04-18T21:10:03.479773+0000","last_unstale":"2024-04-18T21:10:12.479014+0000","last_undegraded":"2024-04-18T21:10:12.479014+0000","last_fullsized":"2024-04-18T21:10:12.479014+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:15:12.326904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":16183,"num_write":377,"num_write_kb":50451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"71'110","reported_seq":309,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.481794+0000","last_change":"2024-04-18T21:10:00.497917+0000","last_active":"2024-04-18T21:10:12.481794+0000","last_peered":"2024-04-18T21:10:12.481794+0000","last_clean":"2024-04-18T21:10:12.481794+0000","last_became_active":"2024-04-18T21:10:00.494644+0000","last_became_peered":"2024-04-18T21:10:00.494644+0000","last_unstale":"2024-04-18T21:10:12.481794+0000","last_undegraded":"2024-04-18T21:10:12.481794+0000","last_fullsized":"2024-04-18T21:10:12.481794+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:40:57.347353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":1251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":144,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480980+0000","last_change":"2024-04-18T21:10:00.493764+0000","last_active":"2024-04-18T21:10:12.480980+0000","last_peered":"2024-04-18T21:10:12.480980+0000","last_clean":"2024-04-18T21:10:12.480980+0000","last_became_active":"2024-04-18T21:10:00.492672+0000","last_became_peered":"2024-04-18T21:10:00.492672+0000","last_unstale":"2024-04-18T21:10:12.480980+0000","last_undegraded":"2024-04-18T21:10:12.480980+0000","last_fullsized":"2024-04-18T21:10:12.480980+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:48:46.709401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'384","reported_seq":583,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.531825+0000","last_change":"2024-04-18T21:09:57.572865+0000","last_active":"2024-04-18T21:10:13.531825+0000","last_peered":"2024-04-18T21:10:13.531825+0000","last_clean":"2024-04-18T21:10:13.531825+0000","last_became_active":"2024-04-18T21:09:57.567962+0000","last_became_peered":"2024-04-18T21:09:57.567962+0000","last_unstale":"2024-04-18T21:10:13.531825+0000","last_undegraded":"2024-04-18T21:10:13.531825+0000","last_fullsized":"2024-04-18T21:10:13.531825+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:51:24.627186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":15567,"num_write":351,"num_write_kb":42959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"71'396","reported_seq":902,"reported_epoch":99,"state":"peering","last_fresh":"2024-04-18T21:10:11.920684+0000","last_change":"2024-04-18T21:10:12.482413+0000","last_active":"2024-04-18T21:10:12.482413+0000","last_peered":"2024-04-18T21:10:11.920684+0000","last_clean":"2024-04-18T21:09:48.743028+0000","last_became_active":"2024-04-18T21:10:01.492175+0000","last_became_peered":"2024-04-18T21:10:01.492175+0000","last_unstale":"2024-04-18T21:10:11.920684+0000","last_undegraded":"2024-04-18T21:10:11.920684+0000","last_fullsized":"2024-04-18T21:10:01.476438+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12943,"num_write":353,"num_write_kb":35357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":342,"num_bytes_recovered":3500882,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"71'277","reported_seq":302,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479820+0000","last_change":"2024-04-18T21:10:00.495047+0000","last_active":"2024-04-18T21:10:12.479820+0000","last_peered":"2024-04-18T21:10:12.479820+0000","last_clean":"2024-04-18T21:10:12.479820+0000","last_became_active":"2024-04-18T21:10:00.493088+0000","last_became_peered":"2024-04-18T21:10:00.493088+0000","last_unstale":"2024-04-18T21:10:12.479820+0000","last_undegraded":"2024-04-18T21:10:12.479820+0000","last_fullsized":"2024-04-18T21:10:12.479820+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:39:08.263781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":221,"num_write_kb":8303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":8389370,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'411","reported_seq":991,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.478217+0000","last_change":"2024-04-18T21:10:04.485332+0000","last_active":"2024-04-18T21:10:12.478217+0000","last_peered":"2024-04-18T21:10:12.478217+0000","last_clean":"2024-04-18T21:10:12.478217+0000","last_became_active":"2024-04-18T21:10:04.482320+0000","last_became_peered":"2024-04-18T21:10:04.482320+0000","last_unstale":"2024-04-18T21:10:12.478217+0000","last_undegraded":"2024-04-18T21:10:12.478217+0000","last_fullsized":"2024-04-18T21:10:12.478217+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:35:57.043682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":17179,"num_write":375,"num_write_kb":38991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"70'85","reported_seq":154,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.532177+0000","last_change":"2024-04-18T21:09:50.890616+0000","last_active":"2024-04-18T21:10:13.532177+0000","last_peered":"2024-04-18T21:10:13.532177+0000","last_clean":"2024-04-18T21:10:13.532177+0000","last_became_active":"2024-04-18T21:09:50.874855+0000","last_became_peered":"2024-04-18T21:09:50.874855+0000","last_unstale":"2024-04-18T21:10:13.532177+0000","last_undegraded":"2024-04-18T21:10:13.532177+0000","last_fullsized":"2024-04-18T21:10:13.532177+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:03:54.726282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"70'230","reported_seq":243,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480921+0000","last_change":"2024-04-18T21:10:00.499373+0000","last_active":"2024-04-18T21:10:12.480921+0000","last_peered":"2024-04-18T21:10:12.480921+0000","last_clean":"2024-04-18T21:10:12.480921+0000","last_became_active":"2024-04-18T21:10:00.498141+0000","last_became_peered":"2024-04-18T21:10:00.498141+0000","last_unstale":"2024-04-18T21:10:12.480921+0000","last_undegraded":"2024-04-18T21:10:12.480921+0000","last_fullsized":"2024-04-18T21:10:12.480921+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:55:01.865593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":4178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"71'493","reported_seq":716,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.478219+0000","last_change":"2024-04-18T21:05:05.642793+0000","last_active":"2024-04-18T21:10:12.478219+0000","last_peered":"2024-04-18T21:10:12.478219+0000","last_clean":"2024-04-18T21:10:12.478219+0000","last_became_active":"2024-04-18T21:05:05.641983+0000","last_became_peered":"2024-04-18T21:05:05.641983+0000","last_unstale":"2024-04-18T21:10:12.478219+0000","last_undegraded":"2024-04-18T21:10:12.478219+0000","last_fullsized":"2024-04-18T21:10:12.478219+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:46:36.339289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23833,"num_write":461,"num_write_kb":76873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"70'62","reported_seq":241,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.481994+0000","last_change":"2024-04-18T21:05:04.641445+0000","last_active":"2024-04-18T21:10:12.481994+0000","last_peered":"2024-04-18T21:10:12.481994+0000","last_clean":"2024-04-18T21:10:12.481994+0000","last_became_active":"2024-04-18T21:05:04.640682+0000","last_became_peered":"2024-04-18T21:05:04.640682+0000","last_unstale":"2024-04-18T21:10:12.481994+0000","last_undegraded":"2024-04-18T21:10:12.481994+0000","last_fullsized":"2024-04-18T21:10:12.481994+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:46:36.285416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'436","reported_seq":654,"reported_epoch":100,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:12.478427+0000","last_change":"2024-04-18T21:09:51.937322+0000","last_active":"2024-04-18T21:10:12.478427+0000","last_peered":"2024-04-18T21:10:12.478427+0000","last_clean":"2024-04-18T21:06:56.761407+0000","last_became_active":"2024-04-18T21:09:51.933205+0000","last_became_peered":"2024-04-18T21:09:51.933205+0000","last_unstale":"2024-04-18T21:10:12.478427+0000","last_undegraded":"2024-04-18T21:09:51.833249+0000","last_fullsized":"2024-04-18T21:09:51.824946+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":193,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14561,"num_write":408,"num_write_kb":47462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'369","reported_seq":557,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.532340+0000","last_change":"2024-04-18T21:10:02.553999+0000","last_active":"2024-04-18T21:10:13.532340+0000","last_peered":"2024-04-18T21:10:13.532340+0000","last_clean":"2024-04-18T21:10:13.532340+0000","last_became_active":"2024-04-18T21:10:02.549471+0000","last_became_peered":"2024-04-18T21:10:02.549471+0000","last_unstale":"2024-04-18T21:10:13.532340+0000","last_undegraded":"2024-04-18T21:10:13.532340+0000","last_fullsized":"2024-04-18T21:10:13.532340+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:52:14.371235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13619,"num_write":339,"num_write_kb":63086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"70'888","reported_seq":1014,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479326+0000","last_change":"2024-04-18T21:10:03.486911+0000","last_active":"2024-04-18T21:10:12.479326+0000","last_peered":"2024-04-18T21:10:12.479326+0000","last_clean":"2024-04-18T21:10:12.479326+0000","last_became_active":"2024-04-18T21:10:03.480576+0000","last_became_peered":"2024-04-18T21:10:03.480576+0000","last_unstale":"2024-04-18T21:10:12.479326+0000","last_undegraded":"2024-04-18T21:10:12.479326+0000","last_fullsized":"2024-04-18T21:10:12.479326+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:41:06.632064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":823,"num_write_kb":8582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'398","reported_seq":546,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.480638+0000","last_change":"2024-04-18T21:10:03.491426+0000","last_active":"2024-04-18T21:10:12.480638+0000","last_peered":"2024-04-18T21:10:12.480638+0000","last_clean":"2024-04-18T21:10:12.480638+0000","last_became_active":"2024-04-18T21:10:03.483190+0000","last_became_peered":"2024-04-18T21:10:03.483190+0000","last_unstale":"2024-04-18T21:10:12.480638+0000","last_undegraded":"2024-04-18T21:10:12.480638+0000","last_fullsized":"2024-04-18T21:10:12.480638+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:05:10.611580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14684,"num_write":380,"num_write_kb":88822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"70'169","reported_seq":368,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.478953+0000","last_change":"2024-04-18T21:10:00.494974+0000","last_active":"2024-04-18T21:10:12.478953+0000","last_peered":"2024-04-18T21:10:12.478953+0000","last_clean":"2024-04-18T21:10:12.478953+0000","last_became_active":"2024-04-18T21:10:00.492196+0000","last_became_peered":"2024-04-18T21:10:00.492196+0000","last_unstale":"2024-04-18T21:10:12.478953+0000","last_undegraded":"2024-04-18T21:10:12.478953+0000","last_fullsized":"2024-04-18T21:10:12.478953+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:33:51.236211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":4162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'406","reported_seq":616,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.531926+0000","last_change":"2024-04-18T21:10:12.553754+0000","last_active":"2024-04-18T21:10:13.531926+0000","last_peered":"2024-04-18T21:10:13.531926+0000","last_clean":"2024-04-18T21:10:13.531926+0000","last_became_active":"2024-04-18T21:10:12.546148+0000","last_became_peered":"2024-04-18T21:10:12.546148+0000","last_unstale":"2024-04-18T21:10:13.531926+0000","last_undegraded":"2024-04-18T21:10:13.531926+0000","last_fullsized":"2024-04-18T21:10:13.531926+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:12:37.876185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27495,"num_write":363,"num_write_kb":89134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"72'192","reported_seq":371,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.531472+0000","last_change":"2024-04-18T21:09:53.541766+0000","last_active":"2024-04-18T21:10:13.531472+0000","last_peered":"2024-04-18T21:10:13.531472+0000","last_clean":"2024-04-18T21:10:13.531472+0000","last_became_active":"2024-04-18T21:09:53.541300+0000","last_became_peered":"2024-04-18T21:09:53.541300+0000","last_unstale":"2024-04-18T21:10:13.531472+0000","last_undegraded":"2024-04-18T21:10:13.531472+0000","last_fullsized":"2024-04-18T21:10:13.531472+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:26:14.718922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12425030,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":12201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8230726,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"71'383","reported_seq":603,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.531911+0000","last_change":"2024-04-18T21:09:55.555798+0000","last_active":"2024-04-18T21:10:13.531911+0000","last_peered":"2024-04-18T21:10:13.531911+0000","last_clean":"2024-04-18T21:10:13.531911+0000","last_became_active":"2024-04-18T21:09:55.551135+0000","last_became_peered":"2024-04-18T21:09:55.551135+0000","last_unstale":"2024-04-18T21:10:13.531911+0000","last_undegraded":"2024-04-18T21:10:13.531911+0000","last_fullsized":"2024-04-18T21:10:13.531911+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:00:01.739082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21614,"num_write":351,"num_write_kb":79501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"70'66","reported_seq":145,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.531146+0000","last_change":"2024-04-18T21:10:00.553114+0000","last_active":"2024-04-18T21:10:13.531146+0000","last_peered":"2024-04-18T21:10:13.531146+0000","last_clean":"2024-04-18T21:10:13.531146+0000","last_became_active":"2024-04-18T21:10:00.552067+0000","last_became_peered":"2024-04-18T21:10:00.552067+0000","last_unstale":"2024-04-18T21:10:13.531146+0000","last_undegraded":"2024-04-18T21:10:13.531146+0000","last_fullsized":"2024-04-18T21:10:13.531146+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:51:32.567297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"71'345","reported_seq":530,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.481398+0000","last_change":"2024-04-18T21:05:05.624840+0000","last_active":"2024-04-18T21:10:12.481398+0000","last_peered":"2024-04-18T21:10:12.481398+0000","last_clean":"2024-04-18T21:10:12.481398+0000","last_became_active":"2024-04-18T21:05:05.622950+0000","last_became_peered":"2024-04-18T21:05:05.622950+0000","last_unstale":"2024-04-18T21:10:12.481398+0000","last_undegraded":"2024-04-18T21:10:12.481398+0000","last_fullsized":"2024-04-18T21:10:12.481398+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:27:17.530889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":317,"num_write_kb":29335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"70'171","reported_seq":270,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479753+0000","last_change":"2024-04-18T21:10:00.507624+0000","last_active":"2024-04-18T21:10:12.479753+0000","last_peered":"2024-04-18T21:10:12.479753+0000","last_clean":"2024-04-18T21:10:12.479753+0000","last_became_active":"2024-04-18T21:10:00.507132+0000","last_became_peered":"2024-04-18T21:10:00.507132+0000","last_unstale":"2024-04-18T21:10:12.479753+0000","last_undegraded":"2024-04-18T21:10:12.479753+0000","last_fullsized":"2024-04-18T21:10:12.479753+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:35:50.013019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":4154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"71'417","reported_seq":627,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479578+0000","last_change":"2024-04-18T21:05:05.627962+0000","last_active":"2024-04-18T21:10:12.479578+0000","last_peered":"2024-04-18T21:10:12.479578+0000","last_clean":"2024-04-18T21:10:12.479578+0000","last_became_active":"2024-04-18T21:05:05.626698+0000","last_became_peered":"2024-04-18T21:05:05.626698+0000","last_unstale":"2024-04-18T21:10:12.479578+0000","last_undegraded":"2024-04-18T21:10:12.479578+0000","last_fullsized":"2024-04-18T21:10:12.479578+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:48:48.973087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":17040,"num_write":384,"num_write_kb":83740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"70'276","reported_seq":457,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.531362+0000","last_change":"2024-04-18T21:09:53.543611+0000","last_active":"2024-04-18T21:10:13.531362+0000","last_peered":"2024-04-18T21:10:13.531362+0000","last_clean":"2024-04-18T21:10:13.531362+0000","last_became_active":"2024-04-18T21:09:53.542863+0000","last_became_peered":"2024-04-18T21:09:53.542863+0000","last_unstale":"2024-04-18T21:10:13.531362+0000","last_undegraded":"2024-04-18T21:10:13.531362+0000","last_fullsized":"2024-04-18T21:10:13.531362+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:22.582074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":12399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"71'428","reported_seq":623,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-18T21:10:13.531115+0000","last_change":"2024-04-18T21:10:08.541152+0000","last_active":"2024-04-18T21:10:13.531115+0000","last_peered":"2024-04-18T21:10:13.531115+0000","last_clean":"2024-04-18T21:10:13.531115+0000","last_became_active":"2024-04-18T21:10:08.536423+0000","last_became_peered":"2024-04-18T21:10:08.536423+0000","last_unstale":"2024-04-18T21:10:13.531115+0000","last_undegraded":"2024-04-18T21:10:13.531115+0000","last_fullsized":"2024-04-18T21:10:13.531115+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:26.666677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22548,"num_write":398,"num_write_kb":75972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"70'70","reported_seq":257,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.481458+0000","last_change":"2024-04-18T21:09:50.833350+0000","last_active":"2024-04-18T21:10:12.481458+0000","last_peered":"2024-04-18T21:10:12.481458+0000","last_clean":"2024-04-18T21:10:12.481458+0000","last_became_active":"2024-04-18T21:09:50.832355+0000","last_became_peered":"2024-04-18T21:09:50.832355+0000","last_unstale":"2024-04-18T21:10:12.481458+0000","last_undegraded":"2024-04-18T21:10:12.481458+0000","last_fullsized":"2024-04-18T21:10:12.481458+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:39:09.627425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'459","reported_seq":626,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.479306+0000","last_change":"2024-04-18T21:10:01.503378+0000","last_active":"2024-04-18T21:10:12.479306+0000","last_peered":"2024-04-18T21:10:12.479306+0000","last_clean":"2024-04-18T21:10:12.479306+0000","last_became_active":"2024-04-18T21:10:01.497275+0000","last_became_peered":"2024-04-18T21:10:01.497275+0000","last_unstale":"2024-04-18T21:10:12.479306+0000","last_undegraded":"2024-04-18T21:10:12.479306+0000","last_fullsized":"2024-04-18T21:10:12.479306+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:40:35.832428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13353,"num_write":429,"num_write_kb":88123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"70'113","reported_seq":316,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-18T21:10:12.481912+0000","last_change":"2024-04-18T21:10:00.499468+0000","last_active":"2024-04-18T21:10:12.481912+0000","last_peered":"2024-04-18T21:10:12.481912+0000","last_clean":"2024-04-18T21:10:12.481912+0000","last_became_active":"2024-04-18T21:10:00.494734+0000","last_became_peered":"2024-04-18T21:10:00.494734+0000","last_unstale":"2024-04-18T21:10:12.481912+0000","last_undegraded":"2024-04-18T21:10:12.481912+0000","last_fullsized":"2024-04-18T21:10:12.481912+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:58:34.790588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194886,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1678,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2531,"num_read_kb":1304649,"num_write":24542,"num_write_kb":4299443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6176,"num_bytes_recovered":4488063,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":76783616,"data_stored":73448243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26603,"ondisk_log_size":26603,"up":128,"acting":118,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127139127,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":55,"num_read_kb":1405,"num_write":4542,"num_write_kb":127514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":92002768,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":279527424,"data_stored":279444842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4409,"internal_metadata":0},"log_size":6331,"ondisk_log_size":6331,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738437,"num_pgs":84,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":208552,"kb_used_data":105236,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94163288,"statfs":{"total":96636764160,"available":96423206912,"internally_reserved":0,"allocated":107761664,"data_stored":107198134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":77,"seq":330712481799,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":218032,"kb_used_data":166624,"kb_used_omap":5,"kb_used_meta":51386,"kb_avail":94153808,"statfs":{"total":96636764160,"available":96413499392,"internally_reserved":0,"allocated":170622976,"data_stored":166658645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6004,"internal_metadata":52619404},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738435,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":160396,"kb_used_data":89020,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94211444,"statfs":{"total":96636764160,"available":96472518656,"internally_reserved":0,"allocated":91156480,"data_stored":90583426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":89579520,"data_stored":89548273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":83750912,"data_stored":83729052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4409,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106196992,"data_stored":106167517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":76783616,"data_stored":73448243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:10:20.872 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:10:21.191 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:10:21.193 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-04-18T21:10:21.211 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":270,"stamp":"2024-04-18T21:10:20.637892+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127729495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2722,"num_read_kb":1306172,"num_write":29287,"num_write_kb":4430417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7877,"num_bytes_recovered":97081199,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33091,"ondisk_log_size":33091,"up":210,"acting":208,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":222,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":516592,"kb_used_data":278024,"kb_used_omap":8,"kb_used_meta":238519,"kb_avail":282598928,"statfs":{"total":289910292480,"available":289381302272,"internally_reserved":0,"allocated":284696576,"data_stored":282817062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9194,"internal_metadata":244243478},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1499,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1664,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001440"},"pg_stats":[{"pgid":"4.3f","version":"71'418","reported_seq":610,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.541680+0000","last_change":"2024-04-18T21:10:16.576720+0000","last_active":"2024-04-18T21:10:18.541680+0000","last_peered":"2024-04-18T21:10:18.541680+0000","last_clean":"2024-04-18T21:10:18.541680+0000","last_became_active":"2024-04-18T21:10:16.571985+0000","last_became_peered":"2024-04-18T21:10:16.571985+0000","last_unstale":"2024-04-18T21:10:18.541680+0000","last_undegraded":"2024-04-18T21:10:18.541680+0000","last_fullsized":"2024-04-18T21:10:18.541680+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:28:48.196628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":19677,"num_write":386,"num_write_kb":87615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"71'417","reported_seq":627,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.540606+0000","last_change":"2024-04-18T21:10:05.546965+0000","last_active":"2024-04-18T21:10:18.540606+0000","last_peered":"2024-04-18T21:10:18.540606+0000","last_clean":"2024-04-18T21:10:18.540606+0000","last_became_active":"2024-04-18T21:10:05.541170+0000","last_became_peered":"2024-04-18T21:10:05.541170+0000","last_unstale":"2024-04-18T21:10:18.540606+0000","last_undegraded":"2024-04-18T21:10:18.540606+0000","last_fullsized":"2024-04-18T21:10:18.540606+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:04:05.630763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":12123,"num_write":387,"num_write_kb":47157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"71'379","reported_seq":934,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.521961+0000","last_change":"2024-04-18T21:09:54.480753+0000","last_active":"2024-04-18T21:10:17.521961+0000","last_peered":"2024-04-18T21:10:17.521961+0000","last_clean":"2024-04-18T21:10:17.521961+0000","last_became_active":"2024-04-18T21:09:54.478020+0000","last_became_peered":"2024-04-18T21:09:54.478020+0000","last_unstale":"2024-04-18T21:10:17.521961+0000","last_undegraded":"2024-04-18T21:10:17.521961+0000","last_fullsized":"2024-04-18T21:10:17.521961+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:24:18.705477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":10040,"num_write":353,"num_write_kb":63202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'372","reported_seq":568,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.521023+0000","last_change":"2024-04-18T21:05:05.629321+0000","last_active":"2024-04-18T21:10:17.521023+0000","last_peered":"2024-04-18T21:10:17.521023+0000","last_clean":"2024-04-18T21:10:17.521023+0000","last_became_active":"2024-04-18T21:05:05.627956+0000","last_became_peered":"2024-04-18T21:05:05.627956+0000","last_unstale":"2024-04-18T21:10:17.521023+0000","last_undegraded":"2024-04-18T21:10:17.521023+0000","last_fullsized":"2024-04-18T21:10:17.521023+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:15:28.458476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2735,"num_write":328,"num_write_kb":22107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"71'416","reported_seq":612,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.539828+0000","last_change":"2024-04-18T21:10:00.560644+0000","last_active":"2024-04-18T21:10:18.539828+0000","last_peered":"2024-04-18T21:10:18.539828+0000","last_clean":"2024-04-18T21:10:18.539828+0000","last_became_active":"2024-04-18T21:10:00.553862+0000","last_became_peered":"2024-04-18T21:10:00.553862+0000","last_unstale":"2024-04-18T21:10:18.539828+0000","last_undegraded":"2024-04-18T21:10:18.539828+0000","last_fullsized":"2024-04-18T21:10:18.539828+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:11:49.688538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6533,"num_write":389,"num_write_kb":43666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"71'374","reported_seq":568,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.520588+0000","last_change":"2024-04-18T21:10:01.495684+0000","last_active":"2024-04-18T21:10:17.520588+0000","last_peered":"2024-04-18T21:10:17.520588+0000","last_clean":"2024-04-18T21:10:17.520588+0000","last_became_active":"2024-04-18T21:10:01.486640+0000","last_became_peered":"2024-04-18T21:10:01.486640+0000","last_unstale":"2024-04-18T21:10:17.520588+0000","last_undegraded":"2024-04-18T21:10:17.520588+0000","last_fullsized":"2024-04-18T21:10:17.520588+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:39:10.639381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20415,"num_write":354,"num_write_kb":34462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'418","reported_seq":646,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.520396+0000","last_change":"2024-04-18T21:05:05.625047+0000","last_active":"2024-04-18T21:10:17.520396+0000","last_peered":"2024-04-18T21:10:17.520396+0000","last_clean":"2024-04-18T21:10:17.520396+0000","last_became_active":"2024-04-18T21:05:05.622781+0000","last_became_peered":"2024-04-18T21:05:05.622781+0000","last_unstale":"2024-04-18T21:10:17.520396+0000","last_undegraded":"2024-04-18T21:10:17.520396+0000","last_fullsized":"2024-04-18T21:10:17.520396+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:12.944469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21103,"num_write":385,"num_write_kb":50678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"71'399","reported_seq":632,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.520086+0000","last_change":"2024-04-18T21:10:00.495543+0000","last_active":"2024-04-18T21:10:17.520086+0000","last_peered":"2024-04-18T21:10:17.520086+0000","last_clean":"2024-04-18T21:10:17.520086+0000","last_became_active":"2024-04-18T21:10:00.488705+0000","last_became_peered":"2024-04-18T21:10:00.488705+0000","last_unstale":"2024-04-18T21:10:17.520086+0000","last_undegraded":"2024-04-18T21:10:17.520086+0000","last_fullsized":"2024-04-18T21:10:17.520086+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:11.892092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":44692,"num_write":361,"num_write_kb":105170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"71'385","reported_seq":944,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.521807+0000","last_change":"2024-04-18T21:10:06.487113+0000","last_active":"2024-04-18T21:10:17.521807+0000","last_peered":"2024-04-18T21:10:17.521807+0000","last_clean":"2024-04-18T21:10:17.521807+0000","last_became_active":"2024-04-18T21:10:06.482087+0000","last_became_peered":"2024-04-18T21:10:06.482087+0000","last_unstale":"2024-04-18T21:10:17.521807+0000","last_undegraded":"2024-04-18T21:10:17.521807+0000","last_fullsized":"2024-04-18T21:10:17.521807+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:10:51.435131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":994,"num_write":358,"num_write_kb":25964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'409","reported_seq":640,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.540363+0000","last_change":"2024-04-18T21:10:12.550697+0000","last_active":"2024-04-18T21:10:18.540363+0000","last_peered":"2024-04-18T21:10:18.540363+0000","last_clean":"2024-04-18T21:10:18.540363+0000","last_became_active":"2024-04-18T21:10:12.546621+0000","last_became_peered":"2024-04-18T21:10:12.546621+0000","last_unstale":"2024-04-18T21:10:18.540363+0000","last_undegraded":"2024-04-18T21:10:18.540363+0000","last_fullsized":"2024-04-18T21:10:18.540363+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:55:30.422126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":26170,"num_write":372,"num_write_kb":83931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"71'366","reported_seq":571,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.522289+0000","last_change":"2024-04-18T21:10:01.496068+0000","last_active":"2024-04-18T21:10:17.522289+0000","last_peered":"2024-04-18T21:10:17.522289+0000","last_clean":"2024-04-18T21:10:17.522289+0000","last_became_active":"2024-04-18T21:10:01.488047+0000","last_became_peered":"2024-04-18T21:10:01.488047+0000","last_unstale":"2024-04-18T21:10:17.522289+0000","last_undegraded":"2024-04-18T21:10:17.522289+0000","last_fullsized":"2024-04-18T21:10:17.522289+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:49.957286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":18907,"num_write":347,"num_write_kb":26153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"71'346","reported_seq":545,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.542227+0000","last_change":"2024-04-18T21:10:00.560349+0000","last_active":"2024-04-18T21:10:18.542227+0000","last_peered":"2024-04-18T21:10:18.542227+0000","last_clean":"2024-04-18T21:10:18.542227+0000","last_became_active":"2024-04-18T21:10:00.557412+0000","last_became_peered":"2024-04-18T21:10:00.557412+0000","last_unstale":"2024-04-18T21:10:18.542227+0000","last_undegraded":"2024-04-18T21:10:18.542227+0000","last_fullsized":"2024-04-18T21:10:18.542227+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:54:33.428937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":6245,"num_write":324,"num_write_kb":37970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"71'417","reported_seq":634,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.540038+0000","last_change":"2024-04-18T21:10:02.555899+0000","last_active":"2024-04-18T21:10:18.540038+0000","last_peered":"2024-04-18T21:10:18.540038+0000","last_clean":"2024-04-18T21:10:18.540038+0000","last_became_active":"2024-04-18T21:10:02.551406+0000","last_became_peered":"2024-04-18T21:10:02.551406+0000","last_unstale":"2024-04-18T21:10:18.540038+0000","last_undegraded":"2024-04-18T21:10:18.540038+0000","last_fullsized":"2024-04-18T21:10:18.540038+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:41:17.455669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":21623,"num_write":381,"num_write_kb":71306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"71'398","reported_seq":971,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.520707+0000","last_change":"2024-04-18T21:10:11.491565+0000","last_active":"2024-04-18T21:10:17.520707+0000","last_peered":"2024-04-18T21:10:17.520707+0000","last_clean":"2024-04-18T21:10:17.520707+0000","last_became_active":"2024-04-18T21:10:11.486593+0000","last_became_peered":"2024-04-18T21:10:11.486593+0000","last_unstale":"2024-04-18T21:10:17.520707+0000","last_undegraded":"2024-04-18T21:10:17.520707+0000","last_fullsized":"2024-04-18T21:10:17.520707+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:11:23.853682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":369,"num_write_kb":30006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'435","reported_seq":1096,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.520522+0000","last_change":"2024-04-18T21:10:15.509238+0000","last_active":"2024-04-18T21:10:17.520522+0000","last_peered":"2024-04-18T21:10:17.520522+0000","last_clean":"2024-04-18T21:10:17.520522+0000","last_became_active":"2024-04-18T21:10:15.506328+0000","last_became_peered":"2024-04-18T21:10:15.506328+0000","last_unstale":"2024-04-18T21:10:17.520522+0000","last_undegraded":"2024-04-18T21:10:17.520522+0000","last_fullsized":"2024-04-18T21:10:17.520522+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:49:44.996311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":31523,"num_write":402,"num_write_kb":121466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":346,"num_bytes_recovered":410327,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'446","reported_seq":681,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.520100+0000","last_change":"2024-04-18T21:05:05.638203+0000","last_active":"2024-04-18T21:10:17.520100+0000","last_peered":"2024-04-18T21:10:17.520100+0000","last_clean":"2024-04-18T21:10:17.520100+0000","last_became_active":"2024-04-18T21:05:05.637352+0000","last_became_peered":"2024-04-18T21:05:05.637352+0000","last_unstale":"2024-04-18T21:10:17.520100+0000","last_undegraded":"2024-04-18T21:10:17.520100+0000","last_fullsized":"2024-04-18T21:10:17.520100+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":23833,"num_write":418,"num_write_kb":59679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"71'403","reported_seq":585,"reported_epoch":105,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:17.522930+0000","last_change":"2024-04-18T21:10:03.493121+0000","last_active":"2024-04-18T21:10:17.522930+0000","last_peered":"2024-04-18T21:10:17.522930+0000","last_clean":"2024-04-18T21:06:53.394905+0000","last_became_active":"2024-04-18T21:10:03.488943+0000","last_became_peered":"2024-04-18T21:10:03.488943+0000","last_unstale":"2024-04-18T21:10:17.522930+0000","last_undegraded":"2024-04-18T21:10:03.479306+0000","last_fullsized":"2024-04-18T21:10:03.477937+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":7482,"num_write":371,"num_write_kb":25957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'406","reported_seq":602,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.540300+0000","last_change":"2024-04-18T21:10:10.547457+0000","last_active":"2024-04-18T21:10:18.540300+0000","last_peered":"2024-04-18T21:10:18.540300+0000","last_clean":"2024-04-18T21:10:18.540300+0000","last_became_active":"2024-04-18T21:10:10.542594+0000","last_became_peered":"2024-04-18T21:10:10.542594+0000","last_unstale":"2024-04-18T21:10:18.540300+0000","last_undegraded":"2024-04-18T21:10:18.540300+0000","last_fullsized":"2024-04-18T21:10:18.540300+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:51:58.437990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":27987,"num_write":365,"num_write_kb":38689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"71'470","reported_seq":1136,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.535574+0000","last_change":"2024-04-18T21:10:17.535574+0000","last_active":"2024-04-18T21:10:17.535574+0000","last_peered":"2024-04-18T21:10:17.535574+0000","last_clean":"2024-04-18T21:10:17.535574+0000","last_became_active":"2024-04-18T21:10:17.529957+0000","last_became_peered":"2024-04-18T21:10:17.529957+0000","last_unstale":"2024-04-18T21:10:17.535574+0000","last_undegraded":"2024-04-18T21:10:17.535574+0000","last_fullsized":"2024-04-18T21:10:17.535574+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:06:00.648089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":59273,"num_write":432,"num_write_kb":145930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'433","reported_seq":629,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.521099+0000","last_change":"2024-04-18T21:05:05.638338+0000","last_active":"2024-04-18T21:10:17.521099+0000","last_peered":"2024-04-18T21:10:17.521099+0000","last_clean":"2024-04-18T21:10:17.521099+0000","last_became_active":"2024-04-18T21:05:05.637567+0000","last_became_peered":"2024-04-18T21:05:05.637567+0000","last_unstale":"2024-04-18T21:10:17.521099+0000","last_undegraded":"2024-04-18T21:10:17.521099+0000","last_fullsized":"2024-04-18T21:10:17.521099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5514,"num_write":403,"num_write_kb":26329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"71'418","reported_seq":655,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.522402+0000","last_change":"2024-04-18T21:05:05.643606+0000","last_active":"2024-04-18T21:10:17.522402+0000","last_peered":"2024-04-18T21:10:17.522402+0000","last_clean":"2024-04-18T21:10:17.522402+0000","last_became_active":"2024-04-18T21:05:05.642991+0000","last_became_peered":"2024-04-18T21:05:05.642991+0000","last_unstale":"2024-04-18T21:10:17.522402+0000","last_undegraded":"2024-04-18T21:10:17.522402+0000","last_fullsized":"2024-04-18T21:10:17.522402+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:01.841786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":29097,"num_write":386,"num_write_kb":88262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"71'479","reported_seq":718,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.539646+0000","last_change":"2024-04-18T21:10:07.549995+0000","last_active":"2024-04-18T21:10:18.539646+0000","last_peered":"2024-04-18T21:10:18.539646+0000","last_clean":"2024-04-18T21:10:18.539646+0000","last_became_active":"2024-04-18T21:10:07.544314+0000","last_became_peered":"2024-04-18T21:10:07.544314+0000","last_unstale":"2024-04-18T21:10:18.539646+0000","last_undegraded":"2024-04-18T21:10:18.539646+0000","last_fullsized":"2024-04-18T21:10:18.539646+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:52:34.340348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":24204,"num_write":452,"num_write_kb":114184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"71'407","reported_seq":631,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.519152+0000","last_change":"2024-04-18T21:10:03.487961+0000","last_active":"2024-04-18T21:10:17.519152+0000","last_peered":"2024-04-18T21:10:17.519152+0000","last_clean":"2024-04-18T21:10:17.519152+0000","last_became_active":"2024-04-18T21:10:03.476552+0000","last_became_peered":"2024-04-18T21:10:03.476552+0000","last_unstale":"2024-04-18T21:10:17.519152+0000","last_undegraded":"2024-04-18T21:10:17.519152+0000","last_fullsized":"2024-04-18T21:10:17.519152+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:45:35.774025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":37766,"num_write":374,"num_write_kb":103984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'452","reported_seq":649,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.547982+0000","last_change":"2024-04-18T21:10:18.547982+0000","last_active":"2024-04-18T21:10:18.547982+0000","last_peered":"2024-04-18T21:10:18.547982+0000","last_clean":"2024-04-18T21:10:18.547982+0000","last_became_active":"2024-04-18T21:10:18.542189+0000","last_became_peered":"2024-04-18T21:10:18.542189+0000","last_unstale":"2024-04-18T21:10:18.547982+0000","last_undegraded":"2024-04-18T21:10:18.547982+0000","last_fullsized":"2024-04-18T21:10:18.547982+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:49.761650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27170,"num_write":421,"num_write_kb":39548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"71'427","reported_seq":630,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.540955+0000","last_change":"2024-04-18T21:10:03.544910+0000","last_active":"2024-04-18T21:10:18.540955+0000","last_peered":"2024-04-18T21:10:18.540955+0000","last_clean":"2024-04-18T21:10:18.540955+0000","last_became_active":"2024-04-18T21:10:03.539961+0000","last_became_peered":"2024-04-18T21:10:03.539961+0000","last_unstale":"2024-04-18T21:10:18.540955+0000","last_undegraded":"2024-04-18T21:10:18.540955+0000","last_fullsized":"2024-04-18T21:10:18.540955+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:06:34.839228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":11507,"num_write":407,"num_write_kb":50964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"71'471","reported_seq":691,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.522980+0000","last_change":"2024-04-18T21:05:05.649581+0000","last_active":"2024-04-18T21:10:17.522980+0000","last_peered":"2024-04-18T21:10:17.522980+0000","last_clean":"2024-04-18T21:10:17.522980+0000","last_became_active":"2024-04-18T21:05:05.648233+0000","last_became_peered":"2024-04-18T21:05:05.648233+0000","last_unstale":"2024-04-18T21:10:17.522980+0000","last_undegraded":"2024-04-18T21:10:17.522980+0000","last_fullsized":"2024-04-18T21:10:17.522980+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20857,"num_write":431,"num_write_kb":63677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'378","reported_seq":934,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.522468+0000","last_change":"2024-04-18T21:09:55.493655+0000","last_active":"2024-04-18T21:10:17.522468+0000","last_peered":"2024-04-18T21:10:17.522468+0000","last_clean":"2024-04-18T21:10:17.522468+0000","last_became_active":"2024-04-18T21:09:55.490958+0000","last_became_peered":"2024-04-18T21:09:55.490958+0000","last_unstale":"2024-04-18T21:10:17.522468+0000","last_undegraded":"2024-04-18T21:10:17.522468+0000","last_fullsized":"2024-04-18T21:10:17.522468+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:52:16.541697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12573,"num_write":347,"num_write_kb":34434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'410","reported_seq":635,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.540020+0000","last_change":"2024-04-18T21:10:01.563947+0000","last_active":"2024-04-18T21:10:18.540020+0000","last_peered":"2024-04-18T21:10:18.540020+0000","last_clean":"2024-04-18T21:10:18.540020+0000","last_became_active":"2024-04-18T21:10:01.555367+0000","last_became_peered":"2024-04-18T21:10:01.555367+0000","last_unstale":"2024-04-18T21:10:18.540020+0000","last_undegraded":"2024-04-18T21:10:18.540020+0000","last_fullsized":"2024-04-18T21:10:18.540020+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:01:09.418419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":16926,"num_write":380,"num_write_kb":112804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"71'410","reported_seq":985,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.520763+0000","last_change":"2024-04-18T21:10:03.490605+0000","last_active":"2024-04-18T21:10:17.520763+0000","last_peered":"2024-04-18T21:10:17.520763+0000","last_clean":"2024-04-18T21:10:17.520763+0000","last_became_active":"2024-04-18T21:10:03.480985+0000","last_became_peered":"2024-04-18T21:10:03.480985+0000","last_unstale":"2024-04-18T21:10:17.520763+0000","last_undegraded":"2024-04-18T21:10:17.520763+0000","last_fullsized":"2024-04-18T21:10:17.520763+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:14:42.076110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":34811,"num_write":378,"num_write_kb":51242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'491","reported_seq":705,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.538808+0000","last_change":"2024-04-18T21:10:08.546388+0000","last_active":"2024-04-18T21:10:18.538808+0000","last_peered":"2024-04-18T21:10:18.538808+0000","last_clean":"2024-04-18T21:10:18.538808+0000","last_became_active":"2024-04-18T21:10:08.540487+0000","last_became_peered":"2024-04-18T21:10:08.540487+0000","last_unstale":"2024-04-18T21:10:18.538808+0000","last_undegraded":"2024-04-18T21:10:18.538808+0000","last_fullsized":"2024-04-18T21:10:18.538808+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:15:51.120517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":26902,"num_write":456,"num_write_kb":124778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":209,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"71'467","reported_seq":815,"reported_epoch":105,"state":"active+recovering+undersized+remapped","last_fresh":"2024-04-18T21:10:17.657506+0000","last_change":"2024-04-18T21:10:17.417104+0000","last_active":"2024-04-18T21:10:17.657506+0000","last_peered":"2024-04-18T21:10:17.657506+0000","last_clean":"2024-04-18T21:06:56.506258+0000","last_became_active":"2024-04-18T21:10:03.477945+0000","last_became_peered":"2024-04-18T21:10:03.477945+0000","last_unstale":"2024-04-18T21:10:17.657506+0000","last_undegraded":"2024-04-18T21:10:17.657506+0000","last_fullsized":"2024-04-18T21:10:03.470440+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":28114,"num_write":434,"num_write_kb":129325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":66,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'423","reported_seq":589,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.520445+0000","last_change":"2024-04-18T21:10:01.499421+0000","last_active":"2024-04-18T21:10:17.520445+0000","last_peered":"2024-04-18T21:10:17.520445+0000","last_clean":"2024-04-18T21:10:17.520445+0000","last_became_active":"2024-04-18T21:10:01.487074+0000","last_became_peered":"2024-04-18T21:10:01.487074+0000","last_unstale":"2024-04-18T21:10:17.520445+0000","last_undegraded":"2024-04-18T21:10:17.520445+0000","last_fullsized":"2024-04-18T21:10:17.520445+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:05:34.827814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8244,"num_write":393,"num_write_kb":58692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"71'389","reported_seq":614,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.538812+0000","last_change":"2024-04-18T21:09:58.542232+0000","last_active":"2024-04-18T21:10:18.538812+0000","last_peered":"2024-04-18T21:10:18.538812+0000","last_clean":"2024-04-18T21:10:18.538812+0000","last_became_active":"2024-04-18T21:09:58.537723+0000","last_became_peered":"2024-04-18T21:09:58.537723+0000","last_unstale":"2024-04-18T21:10:18.538812+0000","last_undegraded":"2024-04-18T21:10:18.538812+0000","last_fullsized":"2024-04-18T21:10:18.538812+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:26.786170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":24216,"num_write":349,"num_write_kb":43176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"70'425","reported_seq":615,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.522697+0000","last_change":"2024-04-18T21:05:04.632748+0000","last_active":"2024-04-18T21:10:17.522697+0000","last_peered":"2024-04-18T21:10:17.522697+0000","last_clean":"2024-04-18T21:10:17.522697+0000","last_became_active":"2024-04-18T21:05:04.628407+0000","last_became_peered":"2024-04-18T21:05:04.628407+0000","last_unstale":"2024-04-18T21:10:17.522697+0000","last_undegraded":"2024-04-18T21:10:17.522697+0000","last_fullsized":"2024-04-18T21:10:17.522697+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:42:45.392908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":375,"num_write_kb":8348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"71'423","reported_seq":619,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.539069+0000","last_change":"2024-04-18T21:10:14.556066+0000","last_active":"2024-04-18T21:10:18.539069+0000","last_peered":"2024-04-18T21:10:18.539069+0000","last_clean":"2024-04-18T21:10:18.539069+0000","last_became_active":"2024-04-18T21:10:14.551249+0000","last_became_peered":"2024-04-18T21:10:14.551249+0000","last_unstale":"2024-04-18T21:10:18.539069+0000","last_undegraded":"2024-04-18T21:10:18.539069+0000","last_fullsized":"2024-04-18T21:10:18.539069+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:06:06.045278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":20096,"num_write":381,"num_write_kb":76351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"70'56","reported_seq":258,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.519699+0000","last_change":"2024-04-18T21:10:00.500122+0000","last_active":"2024-04-18T21:10:17.519699+0000","last_peered":"2024-04-18T21:10:17.519699+0000","last_clean":"2024-04-18T21:10:17.519699+0000","last_became_active":"2024-04-18T21:10:00.489486+0000","last_became_peered":"2024-04-18T21:10:00.489486+0000","last_unstale":"2024-04-18T21:10:17.519699+0000","last_undegraded":"2024-04-18T21:10:17.519699+0000","last_fullsized":"2024-04-18T21:10:17.519699+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:58:08.269558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'442","reported_seq":1020,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.523282+0000","last_change":"2024-04-18T21:10:03.492109+0000","last_active":"2024-04-18T21:10:17.523282+0000","last_peered":"2024-04-18T21:10:17.523282+0000","last_clean":"2024-04-18T21:10:17.523282+0000","last_became_active":"2024-04-18T21:10:03.483050+0000","last_became_peered":"2024-04-18T21:10:03.483050+0000","last_unstale":"2024-04-18T21:10:17.523282+0000","last_undegraded":"2024-04-18T21:10:17.523282+0000","last_fullsized":"2024-04-18T21:10:17.523282+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:45.388623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13827,"num_write":415,"num_write_kb":79859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"70'62","reported_seq":76,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.538404+0000","last_change":"2024-04-18T21:09:50.868159+0000","last_active":"2024-04-18T21:10:18.538404+0000","last_peered":"2024-04-18T21:10:18.538404+0000","last_clean":"2024-04-18T21:10:18.538404+0000","last_became_active":"2024-04-18T21:09:50.867096+0000","last_became_peered":"2024-04-18T21:09:50.867096+0000","last_unstale":"2024-04-18T21:10:18.538404+0000","last_undegraded":"2024-04-18T21:10:18.538404+0000","last_fullsized":"2024-04-18T21:10:18.538404+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:09:57.047205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"71'398","reported_seq":633,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.521853+0000","last_change":"2024-04-18T21:10:01.498728+0000","last_active":"2024-04-18T21:10:17.521853+0000","last_peered":"2024-04-18T21:10:17.521853+0000","last_clean":"2024-04-18T21:10:17.521853+0000","last_became_active":"2024-04-18T21:10:01.495349+0000","last_became_peered":"2024-04-18T21:10:01.495349+0000","last_unstale":"2024-04-18T21:10:17.521853+0000","last_undegraded":"2024-04-18T21:10:17.521853+0000","last_fullsized":"2024-04-18T21:10:17.521853+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:01:48.618551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":17616,"num_write":360,"num_write_kb":58871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"70'66","reported_seq":175,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.520637+0000","last_change":"2024-04-18T21:10:00.496701+0000","last_active":"2024-04-18T21:10:17.520637+0000","last_peered":"2024-04-18T21:10:17.520637+0000","last_clean":"2024-04-18T21:10:17.520637+0000","last_became_active":"2024-04-18T21:10:00.495594+0000","last_became_peered":"2024-04-18T21:10:00.495594+0000","last_unstale":"2024-04-18T21:10:17.520637+0000","last_undegraded":"2024-04-18T21:10:17.520637+0000","last_fullsized":"2024-04-18T21:10:17.520637+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:11:32.991308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"70'135","reported_seq":62,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.522019+0000","last_change":"2024-04-18T21:10:00.493197+0000","last_active":"2024-04-18T21:10:17.522019+0000","last_peered":"2024-04-18T21:10:17.522019+0000","last_clean":"2024-04-18T21:10:17.522019+0000","last_became_active":"2024-04-18T21:10:00.491509+0000","last_became_peered":"2024-04-18T21:10:00.491509+0000","last_unstale":"2024-04-18T21:10:17.522019+0000","last_undegraded":"2024-04-18T21:10:17.522019+0000","last_fullsized":"2024-04-18T21:10:17.522019+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:57:29.595389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":7777508,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'410","reported_seq":606,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.539033+0000","last_change":"2024-04-18T21:10:06.553806+0000","last_active":"2024-04-18T21:10:18.539033+0000","last_peered":"2024-04-18T21:10:18.539033+0000","last_clean":"2024-04-18T21:10:18.539033+0000","last_became_active":"2024-04-18T21:10:06.548034+0000","last_became_peered":"2024-04-18T21:10:06.548034+0000","last_unstale":"2024-04-18T21:10:18.539033+0000","last_undegraded":"2024-04-18T21:10:18.539033+0000","last_fullsized":"2024-04-18T21:10:18.539033+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:20:56.265941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17055,"num_write":375,"num_write_kb":63331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"70'240","reported_seq":359,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.539203+0000","last_change":"2024-04-18T21:10:00.556212+0000","last_active":"2024-04-18T21:10:18.539203+0000","last_peered":"2024-04-18T21:10:18.539203+0000","last_clean":"2024-04-18T21:10:18.539203+0000","last_became_active":"2024-04-18T21:10:00.555486+0000","last_became_peered":"2024-04-18T21:10:00.555486+0000","last_unstale":"2024-04-18T21:10:18.539203+0000","last_undegraded":"2024-04-18T21:10:18.539203+0000","last_fullsized":"2024-04-18T21:10:18.539203+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:11.573984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":4191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"71'501","reported_seq":715,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.537988+0000","last_change":"2024-04-18T21:10:17.593530+0000","last_active":"2024-04-18T21:10:18.537988+0000","last_peered":"2024-04-18T21:10:18.537988+0000","last_clean":"2024-04-18T21:10:18.537988+0000","last_became_active":"2024-04-18T21:10:17.588391+0000","last_became_peered":"2024-04-18T21:10:17.588391+0000","last_unstale":"2024-04-18T21:10:18.537988+0000","last_undegraded":"2024-04-18T21:10:18.537988+0000","last_fullsized":"2024-04-18T21:10:18.537988+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:26.079610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":37662,"num_write":474,"num_write_kb":167663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"70'429","reported_seq":560,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.523014+0000","last_change":"2024-04-18T21:10:00.493325+0000","last_active":"2024-04-18T21:10:17.523014+0000","last_peered":"2024-04-18T21:10:17.523014+0000","last_clean":"2024-04-18T21:10:17.523014+0000","last_became_active":"2024-04-18T21:10:00.491525+0000","last_became_peered":"2024-04-18T21:10:00.491525+0000","last_unstale":"2024-04-18T21:10:17.523014+0000","last_undegraded":"2024-04-18T21:10:17.523014+0000","last_fullsized":"2024-04-18T21:10:17.523014+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:27:59.637974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":377,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388678,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'440","reported_seq":644,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.521311+0000","last_change":"2024-04-18T21:10:01.497932+0000","last_active":"2024-04-18T21:10:17.521311+0000","last_peered":"2024-04-18T21:10:17.521311+0000","last_clean":"2024-04-18T21:10:17.521311+0000","last_became_active":"2024-04-18T21:10:01.486740+0000","last_became_peered":"2024-04-18T21:10:01.486740+0000","last_unstale":"2024-04-18T21:10:17.521311+0000","last_undegraded":"2024-04-18T21:10:17.521311+0000","last_fullsized":"2024-04-18T21:10:17.521311+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:34:43.515471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":42138,"num_write":408,"num_write_kb":96310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"70'59","reported_seq":249,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.521667+0000","last_change":"2024-04-18T21:05:04.625520+0000","last_active":"2024-04-18T21:10:17.521667+0000","last_peered":"2024-04-18T21:10:17.521667+0000","last_clean":"2024-04-18T21:10:17.521667+0000","last_became_active":"2024-04-18T21:05:04.624656+0000","last_became_peered":"2024-04-18T21:05:04.624656+0000","last_unstale":"2024-04-18T21:10:17.521667+0000","last_undegraded":"2024-04-18T21:10:17.521667+0000","last_fullsized":"2024-04-18T21:10:17.521667+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:56:05.795125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"71'461","reported_seq":670,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.520200+0000","last_change":"2024-04-18T21:05:05.649406+0000","last_active":"2024-04-18T21:10:17.520200+0000","last_peered":"2024-04-18T21:10:17.520200+0000","last_clean":"2024-04-18T21:10:17.520200+0000","last_became_active":"2024-04-18T21:05:05.648380+0000","last_became_peered":"2024-04-18T21:05:05.648380+0000","last_unstale":"2024-04-18T21:10:17.520200+0000","last_undegraded":"2024-04-18T21:10:17.520200+0000","last_fullsized":"2024-04-18T21:10:17.520200+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12852,"num_write":420,"num_write_kb":88506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"70'157","reported_seq":370,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.521244+0000","last_change":"2024-04-18T21:10:00.500141+0000","last_active":"2024-04-18T21:10:17.521244+0000","last_peered":"2024-04-18T21:10:17.521244+0000","last_clean":"2024-04-18T21:10:17.521244+0000","last_became_active":"2024-04-18T21:10:00.494630+0000","last_became_peered":"2024-04-18T21:10:00.494630+0000","last_unstale":"2024-04-18T21:10:17.521244+0000","last_undegraded":"2024-04-18T21:10:17.521244+0000","last_fullsized":"2024-04-18T21:10:17.521244+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:49:43.984354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":8250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'445","reported_seq":629,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.521309+0000","last_change":"2024-04-18T21:10:01.500937+0000","last_active":"2024-04-18T21:10:17.521309+0000","last_peered":"2024-04-18T21:10:17.521309+0000","last_clean":"2024-04-18T21:10:17.521309+0000","last_became_active":"2024-04-18T21:10:01.490691+0000","last_became_peered":"2024-04-18T21:10:01.490691+0000","last_unstale":"2024-04-18T21:10:17.521309+0000","last_undegraded":"2024-04-18T21:10:17.521309+0000","last_fullsized":"2024-04-18T21:10:17.521309+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:59:48.489145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17488,"num_write":410,"num_write_kb":50845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"70'124","reported_seq":314,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.521745+0000","last_change":"2024-04-18T21:05:04.634674+0000","last_active":"2024-04-18T21:10:17.521745+0000","last_peered":"2024-04-18T21:10:17.521745+0000","last_clean":"2024-04-18T21:10:17.521745+0000","last_became_active":"2024-04-18T21:05:04.632284+0000","last_became_peered":"2024-04-18T21:05:04.632284+0000","last_unstale":"2024-04-18T21:10:17.521745+0000","last_undegraded":"2024-04-18T21:10:17.521745+0000","last_fullsized":"2024-04-18T21:10:17.521745+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:09:18.466987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"71'400","reported_seq":936,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.522770+0000","last_change":"2024-04-18T21:10:14.495223+0000","last_active":"2024-04-18T21:10:17.522770+0000","last_peered":"2024-04-18T21:10:17.522770+0000","last_clean":"2024-04-18T21:10:17.522770+0000","last_became_active":"2024-04-18T21:10:14.492039+0000","last_became_peered":"2024-04-18T21:10:14.492039+0000","last_unstale":"2024-04-18T21:10:17.522770+0000","last_undegraded":"2024-04-18T21:10:17.522770+0000","last_fullsized":"2024-04-18T21:10:17.522770+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:58:35.802545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12586,"num_write":372,"num_write_kb":58856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":350,"num_bytes_recovered":576854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"70'53","reported_seq":78,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.537948+0000","last_change":"2024-04-18T21:10:00.550936+0000","last_active":"2024-04-18T21:10:18.537948+0000","last_peered":"2024-04-18T21:10:18.537948+0000","last_clean":"2024-04-18T21:10:18.537948+0000","last_became_active":"2024-04-18T21:10:00.549987+0000","last_became_peered":"2024-04-18T21:10:00.549987+0000","last_unstale":"2024-04-18T21:10:18.537948+0000","last_undegraded":"2024-04-18T21:10:18.537948+0000","last_fullsized":"2024-04-18T21:10:18.537948+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:53:36.771516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"71'364","reported_seq":937,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.521557+0000","last_change":"2024-04-18T21:09:58.478726+0000","last_active":"2024-04-18T21:10:17.521557+0000","last_peered":"2024-04-18T21:10:17.521557+0000","last_clean":"2024-04-18T21:10:17.521557+0000","last_became_active":"2024-04-18T21:09:58.473903+0000","last_became_peered":"2024-04-18T21:09:58.473903+0000","last_unstale":"2024-04-18T21:10:17.521557+0000","last_undegraded":"2024-04-18T21:10:17.521557+0000","last_fullsized":"2024-04-18T21:10:17.521557+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:40.377274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":37938,"num_write":336,"num_write_kb":42513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"70'460","reported_seq":569,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.538139+0000","last_change":"2024-04-18T21:09:53.545846+0000","last_active":"2024-04-18T21:10:18.538139+0000","last_peered":"2024-04-18T21:10:18.538139+0000","last_clean":"2024-04-18T21:10:18.538139+0000","last_became_active":"2024-04-18T21:09:53.544355+0000","last_became_peered":"2024-04-18T21:09:53.544355+0000","last_unstale":"2024-04-18T21:10:18.538139+0000","last_undegraded":"2024-04-18T21:10:18.538139+0000","last_fullsized":"2024-04-18T21:10:18.538139+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:34:16.776752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":406,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"71'404","reported_seq":972,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.522072+0000","last_change":"2024-04-18T21:10:15.507332+0000","last_active":"2024-04-18T21:10:17.522072+0000","last_peered":"2024-04-18T21:10:17.522072+0000","last_clean":"2024-04-18T21:10:17.522072+0000","last_became_active":"2024-04-18T21:10:15.504379+0000","last_became_peered":"2024-04-18T21:10:15.504379+0000","last_unstale":"2024-04-18T21:10:17.522072+0000","last_undegraded":"2024-04-18T21:10:17.522072+0000","last_fullsized":"2024-04-18T21:10:17.522072+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:33:14.728553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":7075,"num_write":367,"num_write_kb":62738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":377,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.521047+0000","last_change":"2024-04-18T21:10:00.497960+0000","last_active":"2024-04-18T21:10:17.521047+0000","last_peered":"2024-04-18T21:10:17.521047+0000","last_clean":"2024-04-18T21:10:17.521047+0000","last_became_active":"2024-04-18T21:10:00.496373+0000","last_became_peered":"2024-04-18T21:10:00.496373+0000","last_unstale":"2024-04-18T21:10:17.521047+0000","last_undegraded":"2024-04-18T21:10:17.521047+0000","last_fullsized":"2024-04-18T21:10:17.521047+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_clean_scrub_stamp":"2024-04-18T21:04:53.494814+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:56:52.975720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":153,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.522842+0000","last_change":"2024-04-18T21:10:00.487584+0000","last_active":"2024-04-18T21:10:17.522842+0000","last_peered":"2024-04-18T21:10:17.522842+0000","last_clean":"2024-04-18T21:10:17.522842+0000","last_became_active":"2024-04-18T21:10:00.486722+0000","last_became_peered":"2024-04-18T21:10:00.486722+0000","last_unstale":"2024-04-18T21:10:17.522842+0000","last_undegraded":"2024-04-18T21:10:17.522842+0000","last_fullsized":"2024-04-18T21:10:17.522842+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:17:03.176148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"70'595","reported_seq":744,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.520006+0000","last_change":"2024-04-18T21:10:03.488427+0000","last_active":"2024-04-18T21:10:17.520006+0000","last_peered":"2024-04-18T21:10:17.520006+0000","last_clean":"2024-04-18T21:10:17.520006+0000","last_became_active":"2024-04-18T21:10:03.481344+0000","last_became_peered":"2024-04-18T21:10:03.481344+0000","last_unstale":"2024-04-18T21:10:17.520006+0000","last_undegraded":"2024-04-18T21:10:17.520006+0000","last_fullsized":"2024-04-18T21:10:17.520006+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:41.583248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":539,"num_write_kb":8449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4689862,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'443","reported_seq":1083,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.522826+0000","last_change":"2024-04-18T21:09:56.496310+0000","last_active":"2024-04-18T21:10:17.522826+0000","last_peered":"2024-04-18T21:10:17.522826+0000","last_clean":"2024-04-18T21:10:17.522826+0000","last_became_active":"2024-04-18T21:09:56.493327+0000","last_became_peered":"2024-04-18T21:09:56.493327+0000","last_unstale":"2024-04-18T21:10:17.522826+0000","last_undegraded":"2024-04-18T21:10:17.522826+0000","last_fullsized":"2024-04-18T21:10:17.522826+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:20:57.340997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":38975,"num_write":404,"num_write_kb":80038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":203,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.520962+0000","last_change":"2024-04-18T21:09:50.817029+0000","last_active":"2024-04-18T21:10:17.520962+0000","last_peered":"2024-04-18T21:10:17.520962+0000","last_clean":"2024-04-18T21:10:17.520962+0000","last_became_active":"2024-04-18T21:09:50.816543+0000","last_became_peered":"2024-04-18T21:09:50.816543+0000","last_unstale":"2024-04-18T21:10:17.520962+0000","last_undegraded":"2024-04-18T21:10:17.520962+0000","last_fullsized":"2024-04-18T21:10:17.520962+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:47:33.047727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"70'129","reported_seq":306,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.520242+0000","last_change":"2024-04-18T21:10:03.489109+0000","last_active":"2024-04-18T21:10:17.520242+0000","last_peered":"2024-04-18T21:10:17.520242+0000","last_clean":"2024-04-18T21:10:17.520242+0000","last_became_active":"2024-04-18T21:10:03.486859+0000","last_became_peered":"2024-04-18T21:10:03.486859+0000","last_unstale":"2024-04-18T21:10:17.520242+0000","last_undegraded":"2024-04-18T21:10:17.520242+0000","last_fullsized":"2024-04-18T21:10:17.520242+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:52:04.172480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466419,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":55,"num_read_kb":1405,"num_write":58,"num_write_kb":1469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'457","reported_seq":676,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.540899+0000","last_change":"2024-04-18T21:10:09.543207+0000","last_active":"2024-04-18T21:10:18.540899+0000","last_peered":"2024-04-18T21:10:18.540899+0000","last_clean":"2024-04-18T21:10:18.540899+0000","last_became_active":"2024-04-18T21:10:09.537428+0000","last_became_peered":"2024-04-18T21:10:09.537428+0000","last_unstale":"2024-04-18T21:10:18.540899+0000","last_undegraded":"2024-04-18T21:10:18.540899+0000","last_fullsized":"2024-04-18T21:10:18.540899+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:21.987918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":27659,"num_write":426,"num_write_kb":80500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":202,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.520547+0000","last_change":"2024-04-18T21:09:50.832624+0000","last_active":"2024-04-18T21:10:17.520547+0000","last_peered":"2024-04-18T21:10:17.520547+0000","last_clean":"2024-04-18T21:10:17.520547+0000","last_became_active":"2024-04-18T21:09:50.831949+0000","last_became_peered":"2024-04-18T21:09:50.831949+0000","last_unstale":"2024-04-18T21:10:17.520547+0000","last_undegraded":"2024-04-18T21:10:17.520547+0000","last_fullsized":"2024-04-18T21:10:17.520547+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:35:45.986029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'170","reported_seq":364,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.537753+0000","last_change":"2024-04-18T21:09:53.538615+0000","last_active":"2024-04-18T21:10:18.537753+0000","last_peered":"2024-04-18T21:10:18.537753+0000","last_clean":"2024-04-18T21:10:18.537753+0000","last_became_active":"2024-04-18T21:09:53.537994+0000","last_became_peered":"2024-04-18T21:09:53.537994+0000","last_unstale":"2024-04-18T21:10:18.537753+0000","last_undegraded":"2024-04-18T21:10:18.537753+0000","last_fullsized":"2024-04-18T21:10:18.537753+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:02:34.372453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":8239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"71'346","reported_seq":904,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.522140+0000","last_change":"2024-04-18T21:10:11.487541+0000","last_active":"2024-04-18T21:10:17.522140+0000","last_peered":"2024-04-18T21:10:17.522140+0000","last_clean":"2024-04-18T21:10:17.522140+0000","last_became_active":"2024-04-18T21:10:11.484662+0000","last_became_peered":"2024-04-18T21:10:11.484662+0000","last_unstale":"2024-04-18T21:10:17.522140+0000","last_undegraded":"2024-04-18T21:10:17.522140+0000","last_fullsized":"2024-04-18T21:10:17.522140+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:50:21.491862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27042,"num_write":321,"num_write_kb":50693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":196,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.521738+0000","last_change":"2024-04-18T21:05:00.576606+0000","last_active":"2024-04-18T21:10:17.521738+0000","last_peered":"2024-04-18T21:10:17.521738+0000","last_clean":"2024-04-18T21:10:17.521738+0000","last_became_active":"2024-04-18T21:05:00.575951+0000","last_became_peered":"2024-04-18T21:05:00.575951+0000","last_unstale":"2024-04-18T21:10:17.521738+0000","last_undegraded":"2024-04-18T21:10:17.521738+0000","last_fullsized":"2024-04-18T21:10:17.521738+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:32:17.612481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"70'63","reported_seq":253,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.522790+0000","last_change":"2024-04-18T21:05:04.627296+0000","last_active":"2024-04-18T21:10:17.522790+0000","last_peered":"2024-04-18T21:10:17.522790+0000","last_clean":"2024-04-18T21:10:17.522790+0000","last_became_active":"2024-04-18T21:05:04.626801+0000","last_became_peered":"2024-04-18T21:05:04.626801+0000","last_unstale":"2024-04-18T21:10:17.522790+0000","last_undegraded":"2024-04-18T21:10:17.522790+0000","last_fullsized":"2024-04-18T21:10:17.522790+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:46:36.285416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"71'406","reported_seq":1035,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.521560+0000","last_change":"2024-04-18T21:09:59.495686+0000","last_active":"2024-04-18T21:10:17.521560+0000","last_peered":"2024-04-18T21:10:17.521560+0000","last_clean":"2024-04-18T21:10:17.521560+0000","last_became_active":"2024-04-18T21:09:59.493248+0000","last_became_peered":"2024-04-18T21:09:59.493248+0000","last_unstale":"2024-04-18T21:10:17.521560+0000","last_undegraded":"2024-04-18T21:10:17.521560+0000","last_fullsized":"2024-04-18T21:10:17.521560+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:11:23.853682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":35332,"num_write":370,"num_write_kb":71807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"70'284","reported_seq":309,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.523101+0000","last_change":"2024-04-18T21:10:00.504958+0000","last_active":"2024-04-18T21:10:17.523101+0000","last_peered":"2024-04-18T21:10:17.523101+0000","last_clean":"2024-04-18T21:10:17.523101+0000","last_became_active":"2024-04-18T21:10:00.503851+0000","last_became_peered":"2024-04-18T21:10:00.503851+0000","last_unstale":"2024-04-18T21:10:17.523101+0000","last_undegraded":"2024-04-18T21:10:17.523101+0000","last_fullsized":"2024-04-18T21:10:17.523101+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:10:27.397258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":218,"num_write_kb":4194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":129,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.522553+0000","last_change":"2024-04-18T21:10:03.484148+0000","last_active":"2024-04-18T21:10:17.522553+0000","last_peered":"2024-04-18T21:10:17.522553+0000","last_clean":"2024-04-18T21:10:17.522553+0000","last_became_active":"2024-04-18T21:10:03.480071+0000","last_became_peered":"2024-04-18T21:10:03.480071+0000","last_unstale":"2024-04-18T21:10:17.522553+0000","last_undegraded":"2024-04-18T21:10:17.522553+0000","last_fullsized":"2024-04-18T21:10:17.522553+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:50:30.257039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'386","reported_seq":573,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.539387+0000","last_change":"2024-04-18T21:10:10.547885+0000","last_active":"2024-04-18T21:10:18.539387+0000","last_peered":"2024-04-18T21:10:18.539387+0000","last_clean":"2024-04-18T21:10:18.539387+0000","last_became_active":"2024-04-18T21:10:10.542515+0000","last_became_peered":"2024-04-18T21:10:10.542515+0000","last_unstale":"2024-04-18T21:10:18.539387+0000","last_undegraded":"2024-04-18T21:10:18.539387+0000","last_fullsized":"2024-04-18T21:10:18.539387+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:58:24.232536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14677,"num_write":355,"num_write_kb":51018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"70'55","reported_seq":251,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.522093+0000","last_change":"2024-04-18T21:09:50.833424+0000","last_active":"2024-04-18T21:10:17.522093+0000","last_peered":"2024-04-18T21:10:17.522093+0000","last_clean":"2024-04-18T21:10:17.522093+0000","last_became_active":"2024-04-18T21:09:50.832752+0000","last_became_peered":"2024-04-18T21:09:50.832752+0000","last_unstale":"2024-04-18T21:10:17.522093+0000","last_undegraded":"2024-04-18T21:10:17.522093+0000","last_fullsized":"2024-04-18T21:10:17.522093+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:48.945329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":161,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.541278+0000","last_change":"2024-04-18T21:09:50.900338+0000","last_active":"2024-04-18T21:10:18.541278+0000","last_peered":"2024-04-18T21:10:18.541278+0000","last_clean":"2024-04-18T21:10:18.541278+0000","last_became_active":"2024-04-18T21:09:50.896844+0000","last_became_peered":"2024-04-18T21:09:50.896844+0000","last_unstale":"2024-04-18T21:10:18.541278+0000","last_undegraded":"2024-04-18T21:10:18.541278+0000","last_fullsized":"2024-04-18T21:10:18.541278+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:11:35.543409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"71'402","reported_seq":587,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.538498+0000","last_change":"2024-04-18T21:10:05.542484+0000","last_active":"2024-04-18T21:10:18.538498+0000","last_peered":"2024-04-18T21:10:18.538498+0000","last_clean":"2024-04-18T21:10:18.538498+0000","last_became_active":"2024-04-18T21:10:05.536763+0000","last_became_peered":"2024-04-18T21:10:05.536763+0000","last_unstale":"2024-04-18T21:10:18.538498+0000","last_undegraded":"2024-04-18T21:10:18.538498+0000","last_fullsized":"2024-04-18T21:10:18.538498+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:08:22.367267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12468,"num_write":369,"num_write_kb":67231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"70'60","reported_seq":257,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.523122+0000","last_change":"2024-04-18T21:09:50.832598+0000","last_active":"2024-04-18T21:10:17.523122+0000","last_peered":"2024-04-18T21:10:17.523122+0000","last_clean":"2024-04-18T21:10:17.523122+0000","last_became_active":"2024-04-18T21:09:50.832030+0000","last_became_peered":"2024-04-18T21:09:50.832030+0000","last_unstale":"2024-04-18T21:10:17.523122+0000","last_undegraded":"2024-04-18T21:10:17.523122+0000","last_fullsized":"2024-04-18T21:10:17.523122+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:10:27.397258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":129,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.523594+0000","last_change":"2024-04-18T21:10:03.492761+0000","last_active":"2024-04-18T21:10:17.523594+0000","last_peered":"2024-04-18T21:10:17.523594+0000","last_clean":"2024-04-18T21:10:17.523594+0000","last_became_active":"2024-04-18T21:10:03.492145+0000","last_became_peered":"2024-04-18T21:10:03.492145+0000","last_unstale":"2024-04-18T21:10:17.523594+0000","last_undegraded":"2024-04-18T21:10:17.523594+0000","last_fullsized":"2024-04-18T21:10:17.523594+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:20:00.853523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'421","reported_seq":622,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.520624+0000","last_change":"2024-04-18T21:10:03.488774+0000","last_active":"2024-04-18T21:10:17.520624+0000","last_peered":"2024-04-18T21:10:17.520624+0000","last_clean":"2024-04-18T21:10:17.520624+0000","last_became_active":"2024-04-18T21:10:03.479773+0000","last_became_peered":"2024-04-18T21:10:03.479773+0000","last_unstale":"2024-04-18T21:10:17.520624+0000","last_undegraded":"2024-04-18T21:10:17.520624+0000","last_fullsized":"2024-04-18T21:10:17.520624+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:15:12.326904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":16183,"num_write":377,"num_write_kb":50451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"71'110","reported_seq":319,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.523574+0000","last_change":"2024-04-18T21:10:00.497917+0000","last_active":"2024-04-18T21:10:17.523574+0000","last_peered":"2024-04-18T21:10:17.523574+0000","last_clean":"2024-04-18T21:10:17.523574+0000","last_became_active":"2024-04-18T21:10:00.494644+0000","last_became_peered":"2024-04-18T21:10:00.494644+0000","last_unstale":"2024-04-18T21:10:17.523574+0000","last_undegraded":"2024-04-18T21:10:17.523574+0000","last_fullsized":"2024-04-18T21:10:17.523574+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:40:57.347353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":1251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":154,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.522264+0000","last_change":"2024-04-18T21:10:00.493764+0000","last_active":"2024-04-18T21:10:17.522264+0000","last_peered":"2024-04-18T21:10:17.522264+0000","last_clean":"2024-04-18T21:10:17.522264+0000","last_became_active":"2024-04-18T21:10:00.492672+0000","last_became_peered":"2024-04-18T21:10:00.492672+0000","last_unstale":"2024-04-18T21:10:17.522264+0000","last_undegraded":"2024-04-18T21:10:17.522264+0000","last_fullsized":"2024-04-18T21:10:17.522264+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:48:46.709401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'384","reported_seq":593,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.538664+0000","last_change":"2024-04-18T21:09:57.572865+0000","last_active":"2024-04-18T21:10:18.538664+0000","last_peered":"2024-04-18T21:10:18.538664+0000","last_clean":"2024-04-18T21:10:18.538664+0000","last_became_active":"2024-04-18T21:09:57.567962+0000","last_became_peered":"2024-04-18T21:09:57.567962+0000","last_unstale":"2024-04-18T21:10:18.538664+0000","last_undegraded":"2024-04-18T21:10:18.538664+0000","last_fullsized":"2024-04-18T21:10:18.538664+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:51:24.627186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":15567,"num_write":351,"num_write_kb":42959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"71'396","reported_seq":918,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.522547+0000","last_change":"2024-04-18T21:10:13.482151+0000","last_active":"2024-04-18T21:10:17.522547+0000","last_peered":"2024-04-18T21:10:17.522547+0000","last_clean":"2024-04-18T21:10:17.522547+0000","last_became_active":"2024-04-18T21:10:13.479320+0000","last_became_peered":"2024-04-18T21:10:13.479320+0000","last_unstale":"2024-04-18T21:10:17.522547+0000","last_undegraded":"2024-04-18T21:10:17.522547+0000","last_fullsized":"2024-04-18T21:10:17.522547+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:33:52.248167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12943,"num_write":353,"num_write_kb":35357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":342,"num_bytes_recovered":3500882,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"71'277","reported_seq":312,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.521617+0000","last_change":"2024-04-18T21:10:00.495047+0000","last_active":"2024-04-18T21:10:17.521617+0000","last_peered":"2024-04-18T21:10:17.521617+0000","last_clean":"2024-04-18T21:10:17.521617+0000","last_became_active":"2024-04-18T21:10:00.493088+0000","last_became_peered":"2024-04-18T21:10:00.493088+0000","last_unstale":"2024-04-18T21:10:17.521617+0000","last_undegraded":"2024-04-18T21:10:17.521617+0000","last_fullsized":"2024-04-18T21:10:17.521617+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:39:08.263781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":221,"num_write_kb":8303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":8389370,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'411","reported_seq":1001,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.519404+0000","last_change":"2024-04-18T21:10:04.485332+0000","last_active":"2024-04-18T21:10:17.519404+0000","last_peered":"2024-04-18T21:10:17.519404+0000","last_clean":"2024-04-18T21:10:17.519404+0000","last_became_active":"2024-04-18T21:10:04.482320+0000","last_became_peered":"2024-04-18T21:10:04.482320+0000","last_unstale":"2024-04-18T21:10:17.519404+0000","last_undegraded":"2024-04-18T21:10:17.519404+0000","last_fullsized":"2024-04-18T21:10:17.519404+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:35:57.043682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":17179,"num_write":375,"num_write_kb":38991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"70'85","reported_seq":164,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.540462+0000","last_change":"2024-04-18T21:09:50.890616+0000","last_active":"2024-04-18T21:10:18.540462+0000","last_peered":"2024-04-18T21:10:18.540462+0000","last_clean":"2024-04-18T21:10:18.540462+0000","last_became_active":"2024-04-18T21:09:50.874855+0000","last_became_peered":"2024-04-18T21:09:50.874855+0000","last_unstale":"2024-04-18T21:10:18.540462+0000","last_undegraded":"2024-04-18T21:10:18.540462+0000","last_fullsized":"2024-04-18T21:10:18.540462+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:03:54.726282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"70'230","reported_seq":253,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.521857+0000","last_change":"2024-04-18T21:10:00.499373+0000","last_active":"2024-04-18T21:10:17.521857+0000","last_peered":"2024-04-18T21:10:17.521857+0000","last_clean":"2024-04-18T21:10:17.521857+0000","last_became_active":"2024-04-18T21:10:00.498141+0000","last_became_peered":"2024-04-18T21:10:00.498141+0000","last_unstale":"2024-04-18T21:10:17.521857+0000","last_undegraded":"2024-04-18T21:10:17.521857+0000","last_fullsized":"2024-04-18T21:10:17.521857+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:55:01.865593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":4178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"71'493","reported_seq":726,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.519501+0000","last_change":"2024-04-18T21:05:05.642793+0000","last_active":"2024-04-18T21:10:17.519501+0000","last_peered":"2024-04-18T21:10:17.519501+0000","last_clean":"2024-04-18T21:10:17.519501+0000","last_became_active":"2024-04-18T21:05:05.641983+0000","last_became_peered":"2024-04-18T21:05:05.641983+0000","last_unstale":"2024-04-18T21:10:17.519501+0000","last_undegraded":"2024-04-18T21:10:17.519501+0000","last_fullsized":"2024-04-18T21:10:17.519501+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:46:36.339289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23833,"num_write":461,"num_write_kb":76873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"70'62","reported_seq":251,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.522828+0000","last_change":"2024-04-18T21:05:04.641445+0000","last_active":"2024-04-18T21:10:17.522828+0000","last_peered":"2024-04-18T21:10:17.522828+0000","last_clean":"2024-04-18T21:10:17.522828+0000","last_became_active":"2024-04-18T21:05:04.640682+0000","last_became_peered":"2024-04-18T21:05:04.640682+0000","last_unstale":"2024-04-18T21:10:17.522828+0000","last_undegraded":"2024-04-18T21:10:17.522828+0000","last_fullsized":"2024-04-18T21:10:17.522828+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:46:36.285416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'436","reported_seq":1051,"reported_epoch":104,"state":"peering","last_fresh":"2024-04-18T21:10:17.412395+0000","last_change":"2024-04-18T21:10:17.521279+0000","last_active":"2024-04-18T21:10:17.521279+0000","last_peered":"2024-04-18T21:10:17.412395+0000","last_clean":"2024-04-18T21:06:56.761407+0000","last_became_active":"2024-04-18T21:09:51.933205+0000","last_became_peered":"2024-04-18T21:09:51.933205+0000","last_unstale":"2024-04-18T21:10:17.412395+0000","last_undegraded":"2024-04-18T21:10:17.412395+0000","last_fullsized":"2024-04-18T21:09:51.824946+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14561,"num_write":408,"num_write_kb":47462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'369","reported_seq":567,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.540957+0000","last_change":"2024-04-18T21:10:02.553999+0000","last_active":"2024-04-18T21:10:18.540957+0000","last_peered":"2024-04-18T21:10:18.540957+0000","last_clean":"2024-04-18T21:10:18.540957+0000","last_became_active":"2024-04-18T21:10:02.549471+0000","last_became_peered":"2024-04-18T21:10:02.549471+0000","last_unstale":"2024-04-18T21:10:18.540957+0000","last_undegraded":"2024-04-18T21:10:18.540957+0000","last_fullsized":"2024-04-18T21:10:18.540957+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:52:14.371235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13619,"num_write":339,"num_write_kb":63086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"70'888","reported_seq":1024,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.521100+0000","last_change":"2024-04-18T21:10:03.486911+0000","last_active":"2024-04-18T21:10:17.521100+0000","last_peered":"2024-04-18T21:10:17.521100+0000","last_clean":"2024-04-18T21:10:17.521100+0000","last_became_active":"2024-04-18T21:10:03.480576+0000","last_became_peered":"2024-04-18T21:10:03.480576+0000","last_unstale":"2024-04-18T21:10:17.521100+0000","last_undegraded":"2024-04-18T21:10:17.521100+0000","last_fullsized":"2024-04-18T21:10:17.521100+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:41:06.632064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":823,"num_write_kb":8582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'398","reported_seq":556,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.522054+0000","last_change":"2024-04-18T21:10:03.491426+0000","last_active":"2024-04-18T21:10:17.522054+0000","last_peered":"2024-04-18T21:10:17.522054+0000","last_clean":"2024-04-18T21:10:17.522054+0000","last_became_active":"2024-04-18T21:10:03.483190+0000","last_became_peered":"2024-04-18T21:10:03.483190+0000","last_unstale":"2024-04-18T21:10:17.522054+0000","last_undegraded":"2024-04-18T21:10:17.522054+0000","last_fullsized":"2024-04-18T21:10:17.522054+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:05:10.611580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14684,"num_write":380,"num_write_kb":88822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"70'169","reported_seq":378,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.520136+0000","last_change":"2024-04-18T21:10:00.494974+0000","last_active":"2024-04-18T21:10:17.520136+0000","last_peered":"2024-04-18T21:10:17.520136+0000","last_clean":"2024-04-18T21:10:17.520136+0000","last_became_active":"2024-04-18T21:10:00.492196+0000","last_became_peered":"2024-04-18T21:10:00.492196+0000","last_unstale":"2024-04-18T21:10:17.520136+0000","last_undegraded":"2024-04-18T21:10:17.520136+0000","last_fullsized":"2024-04-18T21:10:17.520136+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:33:51.236211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":4162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'406","reported_seq":626,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.539943+0000","last_change":"2024-04-18T21:10:12.553754+0000","last_active":"2024-04-18T21:10:18.539943+0000","last_peered":"2024-04-18T21:10:18.539943+0000","last_clean":"2024-04-18T21:10:18.539943+0000","last_became_active":"2024-04-18T21:10:12.546148+0000","last_became_peered":"2024-04-18T21:10:12.546148+0000","last_unstale":"2024-04-18T21:10:18.539943+0000","last_undegraded":"2024-04-18T21:10:18.539943+0000","last_fullsized":"2024-04-18T21:10:18.539943+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:12:37.876185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27495,"num_write":363,"num_write_kb":89134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"72'192","reported_seq":381,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.538549+0000","last_change":"2024-04-18T21:09:53.541766+0000","last_active":"2024-04-18T21:10:18.538549+0000","last_peered":"2024-04-18T21:10:18.538549+0000","last_clean":"2024-04-18T21:10:18.538549+0000","last_became_active":"2024-04-18T21:09:53.541300+0000","last_became_peered":"2024-04-18T21:09:53.541300+0000","last_unstale":"2024-04-18T21:10:18.538549+0000","last_undegraded":"2024-04-18T21:10:18.538549+0000","last_fullsized":"2024-04-18T21:10:18.538549+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:26:14.718922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12425030,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":12201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8230726,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"71'383","reported_seq":613,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.539045+0000","last_change":"2024-04-18T21:09:55.555798+0000","last_active":"2024-04-18T21:10:18.539045+0000","last_peered":"2024-04-18T21:10:18.539045+0000","last_clean":"2024-04-18T21:10:18.539045+0000","last_became_active":"2024-04-18T21:09:55.551135+0000","last_became_peered":"2024-04-18T21:09:55.551135+0000","last_unstale":"2024-04-18T21:10:18.539045+0000","last_undegraded":"2024-04-18T21:10:18.539045+0000","last_fullsized":"2024-04-18T21:10:18.539045+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:00:01.739082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21614,"num_write":351,"num_write_kb":79501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"70'66","reported_seq":155,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.538721+0000","last_change":"2024-04-18T21:10:00.553114+0000","last_active":"2024-04-18T21:10:18.538721+0000","last_peered":"2024-04-18T21:10:18.538721+0000","last_clean":"2024-04-18T21:10:18.538721+0000","last_became_active":"2024-04-18T21:10:00.552067+0000","last_became_peered":"2024-04-18T21:10:00.552067+0000","last_unstale":"2024-04-18T21:10:18.538721+0000","last_undegraded":"2024-04-18T21:10:18.538721+0000","last_fullsized":"2024-04-18T21:10:18.538721+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:51:32.567297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"71'345","reported_seq":540,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.522506+0000","last_change":"2024-04-18T21:05:05.624840+0000","last_active":"2024-04-18T21:10:17.522506+0000","last_peered":"2024-04-18T21:10:17.522506+0000","last_clean":"2024-04-18T21:10:17.522506+0000","last_became_active":"2024-04-18T21:05:05.622950+0000","last_became_peered":"2024-04-18T21:05:05.622950+0000","last_unstale":"2024-04-18T21:10:17.522506+0000","last_undegraded":"2024-04-18T21:10:17.522506+0000","last_fullsized":"2024-04-18T21:10:17.522506+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:27:17.530889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":317,"num_write_kb":29335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"70'171","reported_seq":280,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.521368+0000","last_change":"2024-04-18T21:10:00.507624+0000","last_active":"2024-04-18T21:10:17.521368+0000","last_peered":"2024-04-18T21:10:17.521368+0000","last_clean":"2024-04-18T21:10:17.521368+0000","last_became_active":"2024-04-18T21:10:00.507132+0000","last_became_peered":"2024-04-18T21:10:00.507132+0000","last_unstale":"2024-04-18T21:10:17.521368+0000","last_undegraded":"2024-04-18T21:10:17.521368+0000","last_fullsized":"2024-04-18T21:10:17.521368+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:35:50.013019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":4154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"71'417","reported_seq":637,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.521019+0000","last_change":"2024-04-18T21:05:05.627962+0000","last_active":"2024-04-18T21:10:17.521019+0000","last_peered":"2024-04-18T21:10:17.521019+0000","last_clean":"2024-04-18T21:10:17.521019+0000","last_became_active":"2024-04-18T21:05:05.626698+0000","last_became_peered":"2024-04-18T21:05:05.626698+0000","last_unstale":"2024-04-18T21:10:17.521019+0000","last_undegraded":"2024-04-18T21:10:17.521019+0000","last_fullsized":"2024-04-18T21:10:17.521019+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:48:48.973087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":17040,"num_write":384,"num_write_kb":83740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"70'276","reported_seq":467,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.538991+0000","last_change":"2024-04-18T21:09:53.543611+0000","last_active":"2024-04-18T21:10:18.538991+0000","last_peered":"2024-04-18T21:10:18.538991+0000","last_clean":"2024-04-18T21:10:18.538991+0000","last_became_active":"2024-04-18T21:09:53.542863+0000","last_became_peered":"2024-04-18T21:09:53.542863+0000","last_unstale":"2024-04-18T21:10:18.538991+0000","last_undegraded":"2024-04-18T21:10:18.538991+0000","last_fullsized":"2024-04-18T21:10:18.538991+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:22.582074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":12399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"71'428","reported_seq":633,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.538378+0000","last_change":"2024-04-18T21:10:08.541152+0000","last_active":"2024-04-18T21:10:18.538378+0000","last_peered":"2024-04-18T21:10:18.538378+0000","last_clean":"2024-04-18T21:10:18.538378+0000","last_became_active":"2024-04-18T21:10:08.536423+0000","last_became_peered":"2024-04-18T21:10:08.536423+0000","last_unstale":"2024-04-18T21:10:18.538378+0000","last_undegraded":"2024-04-18T21:10:18.538378+0000","last_fullsized":"2024-04-18T21:10:18.538378+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:26.666677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22548,"num_write":398,"num_write_kb":75972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"70'70","reported_seq":267,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.523265+0000","last_change":"2024-04-18T21:09:50.833350+0000","last_active":"2024-04-18T21:10:17.523265+0000","last_peered":"2024-04-18T21:10:17.523265+0000","last_clean":"2024-04-18T21:10:17.523265+0000","last_became_active":"2024-04-18T21:09:50.832355+0000","last_became_peered":"2024-04-18T21:09:50.832355+0000","last_unstale":"2024-04-18T21:10:17.523265+0000","last_undegraded":"2024-04-18T21:10:17.523265+0000","last_fullsized":"2024-04-18T21:10:17.523265+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:39:09.627425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'459","reported_seq":636,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.520752+0000","last_change":"2024-04-18T21:10:01.503378+0000","last_active":"2024-04-18T21:10:17.520752+0000","last_peered":"2024-04-18T21:10:17.520752+0000","last_clean":"2024-04-18T21:10:17.520752+0000","last_became_active":"2024-04-18T21:10:01.497275+0000","last_became_peered":"2024-04-18T21:10:01.497275+0000","last_unstale":"2024-04-18T21:10:17.520752+0000","last_undegraded":"2024-04-18T21:10:17.520752+0000","last_fullsized":"2024-04-18T21:10:17.520752+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:40:35.832428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13353,"num_write":429,"num_write_kb":88123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"70'113","reported_seq":326,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.522452+0000","last_change":"2024-04-18T21:10:00.499468+0000","last_active":"2024-04-18T21:10:17.522452+0000","last_peered":"2024-04-18T21:10:17.522452+0000","last_clean":"2024-04-18T21:10:17.522452+0000","last_became_active":"2024-04-18T21:10:00.494734+0000","last_became_peered":"2024-04-18T21:10:00.494734+0000","last_unstale":"2024-04-18T21:10:17.522452+0000","last_undegraded":"2024-04-18T21:10:17.522452+0000","last_fullsized":"2024-04-18T21:10:17.522452+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:58:34.790588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194886,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2531,"num_read_kb":1304649,"num_write":24542,"num_write_kb":4299443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7840,"num_bytes_recovered":4488063,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26603,"ondisk_log_size":26603,"up":128,"acting":126,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127139127,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":55,"num_read_kb":1405,"num_write":4542,"num_write_kb":127514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":92002768,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":279527424,"data_stored":279444842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4409,"internal_metadata":0},"log_size":6331,"ondisk_log_size":6331,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738438,"num_pgs":84,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":208604,"kb_used_data":105292,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94163236,"statfs":{"total":96636764160,"available":96423153664,"internally_reserved":0,"allocated":107819008,"data_stored":107220435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":77,"seq":330712481800,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":147544,"kb_used_data":83660,"kb_used_omap":5,"kb_used_meta":63866,"kb_avail":94224296,"statfs":{"total":96636764160,"available":96485679104,"internally_reserved":0,"allocated":85667840,"data_stored":84991104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6004,"internal_metadata":65398924},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738436,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":160444,"kb_used_data":89072,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94211396,"statfs":{"total":96636764160,"available":96472469504,"internally_reserved":0,"allocated":91209728,"data_stored":90605523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":89579520,"data_stored":89548273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":83750912,"data_stored":83729052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4409,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106196992,"data_stored":106167517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:10:21.217 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-18T21:10:21.609 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:10:21.609 INFO:teuthology.orchestra.run.smithi078.stdout:{"fsid":"dc017990-0393-4ab0-b604-5e7052fdc7bd","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 179/108 objects degraded (165.741%), 1 pg degraded","count":1},"muted":false}},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":338,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":108,"num_osds":3,"num_up_osds":3,"osd_up_since":1713474589,"num_in_osds":3,"osd_in_since":1713474284,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":102},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":1},{"state_name":"peering","count":1},{"state_name":"active+recovering+undersized+remapped","count":1}],"num_pgs":105,"num_pools":4,"num_objects":54,"data_bytes":127729495,"bytes_used":528990208,"bytes_avail":289381302272,"bytes_total":289910292480,"inactive_pgs_ratio":0.0095238098874688148,"degraded_objects":179,"degraded_total":108,"degraded_ratio":1.6574074074074074,"recovering_objects_per_sec":415,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":1664,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4202}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-04-18T21:06:12.521737+0000","services":{}},"progress_events":{}} 2024-04-18T21:10:21.629 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-04-18T21:10:21.629 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:10:21.928 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:10:21.930 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-04-18T21:10:21.945 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":270,"stamp":"2024-04-18T21:10:20.637892+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127729495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2722,"num_read_kb":1306172,"num_write":29287,"num_write_kb":4430417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7877,"num_bytes_recovered":97081199,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33091,"ondisk_log_size":33091,"up":210,"acting":208,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":222,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":516592,"kb_used_data":278024,"kb_used_omap":8,"kb_used_meta":238519,"kb_avail":282598928,"statfs":{"total":289910292480,"available":289381302272,"internally_reserved":0,"allocated":284696576,"data_stored":282817062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9194,"internal_metadata":244243478},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1499,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1664,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001440"},"pg_stats":[{"pgid":"4.3f","version":"71'418","reported_seq":610,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.541680+0000","last_change":"2024-04-18T21:10:16.576720+0000","last_active":"2024-04-18T21:10:18.541680+0000","last_peered":"2024-04-18T21:10:18.541680+0000","last_clean":"2024-04-18T21:10:18.541680+0000","last_became_active":"2024-04-18T21:10:16.571985+0000","last_became_peered":"2024-04-18T21:10:16.571985+0000","last_unstale":"2024-04-18T21:10:18.541680+0000","last_undegraded":"2024-04-18T21:10:18.541680+0000","last_fullsized":"2024-04-18T21:10:18.541680+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:28:48.196628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":19677,"num_write":386,"num_write_kb":87615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"71'417","reported_seq":627,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.540606+0000","last_change":"2024-04-18T21:10:05.546965+0000","last_active":"2024-04-18T21:10:18.540606+0000","last_peered":"2024-04-18T21:10:18.540606+0000","last_clean":"2024-04-18T21:10:18.540606+0000","last_became_active":"2024-04-18T21:10:05.541170+0000","last_became_peered":"2024-04-18T21:10:05.541170+0000","last_unstale":"2024-04-18T21:10:18.540606+0000","last_undegraded":"2024-04-18T21:10:18.540606+0000","last_fullsized":"2024-04-18T21:10:18.540606+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:04:05.630763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":12123,"num_write":387,"num_write_kb":47157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"71'379","reported_seq":934,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.521961+0000","last_change":"2024-04-18T21:09:54.480753+0000","last_active":"2024-04-18T21:10:17.521961+0000","last_peered":"2024-04-18T21:10:17.521961+0000","last_clean":"2024-04-18T21:10:17.521961+0000","last_became_active":"2024-04-18T21:09:54.478020+0000","last_became_peered":"2024-04-18T21:09:54.478020+0000","last_unstale":"2024-04-18T21:10:17.521961+0000","last_undegraded":"2024-04-18T21:10:17.521961+0000","last_fullsized":"2024-04-18T21:10:17.521961+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:24:18.705477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":10040,"num_write":353,"num_write_kb":63202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'372","reported_seq":568,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.521023+0000","last_change":"2024-04-18T21:05:05.629321+0000","last_active":"2024-04-18T21:10:17.521023+0000","last_peered":"2024-04-18T21:10:17.521023+0000","last_clean":"2024-04-18T21:10:17.521023+0000","last_became_active":"2024-04-18T21:05:05.627956+0000","last_became_peered":"2024-04-18T21:05:05.627956+0000","last_unstale":"2024-04-18T21:10:17.521023+0000","last_undegraded":"2024-04-18T21:10:17.521023+0000","last_fullsized":"2024-04-18T21:10:17.521023+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:15:28.458476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2735,"num_write":328,"num_write_kb":22107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"71'416","reported_seq":612,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.539828+0000","last_change":"2024-04-18T21:10:00.560644+0000","last_active":"2024-04-18T21:10:18.539828+0000","last_peered":"2024-04-18T21:10:18.539828+0000","last_clean":"2024-04-18T21:10:18.539828+0000","last_became_active":"2024-04-18T21:10:00.553862+0000","last_became_peered":"2024-04-18T21:10:00.553862+0000","last_unstale":"2024-04-18T21:10:18.539828+0000","last_undegraded":"2024-04-18T21:10:18.539828+0000","last_fullsized":"2024-04-18T21:10:18.539828+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:11:49.688538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6533,"num_write":389,"num_write_kb":43666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"71'374","reported_seq":568,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.520588+0000","last_change":"2024-04-18T21:10:01.495684+0000","last_active":"2024-04-18T21:10:17.520588+0000","last_peered":"2024-04-18T21:10:17.520588+0000","last_clean":"2024-04-18T21:10:17.520588+0000","last_became_active":"2024-04-18T21:10:01.486640+0000","last_became_peered":"2024-04-18T21:10:01.486640+0000","last_unstale":"2024-04-18T21:10:17.520588+0000","last_undegraded":"2024-04-18T21:10:17.520588+0000","last_fullsized":"2024-04-18T21:10:17.520588+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:39:10.639381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20415,"num_write":354,"num_write_kb":34462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'418","reported_seq":646,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.520396+0000","last_change":"2024-04-18T21:05:05.625047+0000","last_active":"2024-04-18T21:10:17.520396+0000","last_peered":"2024-04-18T21:10:17.520396+0000","last_clean":"2024-04-18T21:10:17.520396+0000","last_became_active":"2024-04-18T21:05:05.622781+0000","last_became_peered":"2024-04-18T21:05:05.622781+0000","last_unstale":"2024-04-18T21:10:17.520396+0000","last_undegraded":"2024-04-18T21:10:17.520396+0000","last_fullsized":"2024-04-18T21:10:17.520396+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:12.944469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21103,"num_write":385,"num_write_kb":50678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"71'399","reported_seq":632,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.520086+0000","last_change":"2024-04-18T21:10:00.495543+0000","last_active":"2024-04-18T21:10:17.520086+0000","last_peered":"2024-04-18T21:10:17.520086+0000","last_clean":"2024-04-18T21:10:17.520086+0000","last_became_active":"2024-04-18T21:10:00.488705+0000","last_became_peered":"2024-04-18T21:10:00.488705+0000","last_unstale":"2024-04-18T21:10:17.520086+0000","last_undegraded":"2024-04-18T21:10:17.520086+0000","last_fullsized":"2024-04-18T21:10:17.520086+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:11.892092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":44692,"num_write":361,"num_write_kb":105170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"71'385","reported_seq":944,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.521807+0000","last_change":"2024-04-18T21:10:06.487113+0000","last_active":"2024-04-18T21:10:17.521807+0000","last_peered":"2024-04-18T21:10:17.521807+0000","last_clean":"2024-04-18T21:10:17.521807+0000","last_became_active":"2024-04-18T21:10:06.482087+0000","last_became_peered":"2024-04-18T21:10:06.482087+0000","last_unstale":"2024-04-18T21:10:17.521807+0000","last_undegraded":"2024-04-18T21:10:17.521807+0000","last_fullsized":"2024-04-18T21:10:17.521807+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:10:51.435131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":994,"num_write":358,"num_write_kb":25964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'409","reported_seq":640,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.540363+0000","last_change":"2024-04-18T21:10:12.550697+0000","last_active":"2024-04-18T21:10:18.540363+0000","last_peered":"2024-04-18T21:10:18.540363+0000","last_clean":"2024-04-18T21:10:18.540363+0000","last_became_active":"2024-04-18T21:10:12.546621+0000","last_became_peered":"2024-04-18T21:10:12.546621+0000","last_unstale":"2024-04-18T21:10:18.540363+0000","last_undegraded":"2024-04-18T21:10:18.540363+0000","last_fullsized":"2024-04-18T21:10:18.540363+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:55:30.422126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":26170,"num_write":372,"num_write_kb":83931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"71'366","reported_seq":571,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.522289+0000","last_change":"2024-04-18T21:10:01.496068+0000","last_active":"2024-04-18T21:10:17.522289+0000","last_peered":"2024-04-18T21:10:17.522289+0000","last_clean":"2024-04-18T21:10:17.522289+0000","last_became_active":"2024-04-18T21:10:01.488047+0000","last_became_peered":"2024-04-18T21:10:01.488047+0000","last_unstale":"2024-04-18T21:10:17.522289+0000","last_undegraded":"2024-04-18T21:10:17.522289+0000","last_fullsized":"2024-04-18T21:10:17.522289+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:49.957286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":18907,"num_write":347,"num_write_kb":26153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"71'346","reported_seq":545,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.542227+0000","last_change":"2024-04-18T21:10:00.560349+0000","last_active":"2024-04-18T21:10:18.542227+0000","last_peered":"2024-04-18T21:10:18.542227+0000","last_clean":"2024-04-18T21:10:18.542227+0000","last_became_active":"2024-04-18T21:10:00.557412+0000","last_became_peered":"2024-04-18T21:10:00.557412+0000","last_unstale":"2024-04-18T21:10:18.542227+0000","last_undegraded":"2024-04-18T21:10:18.542227+0000","last_fullsized":"2024-04-18T21:10:18.542227+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:54:33.428937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":6245,"num_write":324,"num_write_kb":37970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"71'417","reported_seq":634,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.540038+0000","last_change":"2024-04-18T21:10:02.555899+0000","last_active":"2024-04-18T21:10:18.540038+0000","last_peered":"2024-04-18T21:10:18.540038+0000","last_clean":"2024-04-18T21:10:18.540038+0000","last_became_active":"2024-04-18T21:10:02.551406+0000","last_became_peered":"2024-04-18T21:10:02.551406+0000","last_unstale":"2024-04-18T21:10:18.540038+0000","last_undegraded":"2024-04-18T21:10:18.540038+0000","last_fullsized":"2024-04-18T21:10:18.540038+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:41:17.455669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":21623,"num_write":381,"num_write_kb":71306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"71'398","reported_seq":971,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.520707+0000","last_change":"2024-04-18T21:10:11.491565+0000","last_active":"2024-04-18T21:10:17.520707+0000","last_peered":"2024-04-18T21:10:17.520707+0000","last_clean":"2024-04-18T21:10:17.520707+0000","last_became_active":"2024-04-18T21:10:11.486593+0000","last_became_peered":"2024-04-18T21:10:11.486593+0000","last_unstale":"2024-04-18T21:10:17.520707+0000","last_undegraded":"2024-04-18T21:10:17.520707+0000","last_fullsized":"2024-04-18T21:10:17.520707+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:11:23.853682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":369,"num_write_kb":30006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'435","reported_seq":1096,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.520522+0000","last_change":"2024-04-18T21:10:15.509238+0000","last_active":"2024-04-18T21:10:17.520522+0000","last_peered":"2024-04-18T21:10:17.520522+0000","last_clean":"2024-04-18T21:10:17.520522+0000","last_became_active":"2024-04-18T21:10:15.506328+0000","last_became_peered":"2024-04-18T21:10:15.506328+0000","last_unstale":"2024-04-18T21:10:17.520522+0000","last_undegraded":"2024-04-18T21:10:17.520522+0000","last_fullsized":"2024-04-18T21:10:17.520522+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:49:44.996311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":31523,"num_write":402,"num_write_kb":121466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":346,"num_bytes_recovered":410327,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'446","reported_seq":681,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.520100+0000","last_change":"2024-04-18T21:05:05.638203+0000","last_active":"2024-04-18T21:10:17.520100+0000","last_peered":"2024-04-18T21:10:17.520100+0000","last_clean":"2024-04-18T21:10:17.520100+0000","last_became_active":"2024-04-18T21:05:05.637352+0000","last_became_peered":"2024-04-18T21:05:05.637352+0000","last_unstale":"2024-04-18T21:10:17.520100+0000","last_undegraded":"2024-04-18T21:10:17.520100+0000","last_fullsized":"2024-04-18T21:10:17.520100+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":23833,"num_write":418,"num_write_kb":59679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"71'403","reported_seq":585,"reported_epoch":105,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-18T21:10:17.522930+0000","last_change":"2024-04-18T21:10:03.493121+0000","last_active":"2024-04-18T21:10:17.522930+0000","last_peered":"2024-04-18T21:10:17.522930+0000","last_clean":"2024-04-18T21:06:53.394905+0000","last_became_active":"2024-04-18T21:10:03.488943+0000","last_became_peered":"2024-04-18T21:10:03.488943+0000","last_unstale":"2024-04-18T21:10:17.522930+0000","last_undegraded":"2024-04-18T21:10:03.479306+0000","last_fullsized":"2024-04-18T21:10:03.477937+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":7482,"num_write":371,"num_write_kb":25957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'406","reported_seq":602,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.540300+0000","last_change":"2024-04-18T21:10:10.547457+0000","last_active":"2024-04-18T21:10:18.540300+0000","last_peered":"2024-04-18T21:10:18.540300+0000","last_clean":"2024-04-18T21:10:18.540300+0000","last_became_active":"2024-04-18T21:10:10.542594+0000","last_became_peered":"2024-04-18T21:10:10.542594+0000","last_unstale":"2024-04-18T21:10:18.540300+0000","last_undegraded":"2024-04-18T21:10:18.540300+0000","last_fullsized":"2024-04-18T21:10:18.540300+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:51:58.437990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":27987,"num_write":365,"num_write_kb":38689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"71'470","reported_seq":1136,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.535574+0000","last_change":"2024-04-18T21:10:17.535574+0000","last_active":"2024-04-18T21:10:17.535574+0000","last_peered":"2024-04-18T21:10:17.535574+0000","last_clean":"2024-04-18T21:10:17.535574+0000","last_became_active":"2024-04-18T21:10:17.529957+0000","last_became_peered":"2024-04-18T21:10:17.529957+0000","last_unstale":"2024-04-18T21:10:17.535574+0000","last_undegraded":"2024-04-18T21:10:17.535574+0000","last_fullsized":"2024-04-18T21:10:17.535574+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:06:00.648089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":59273,"num_write":432,"num_write_kb":145930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'433","reported_seq":629,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.521099+0000","last_change":"2024-04-18T21:05:05.638338+0000","last_active":"2024-04-18T21:10:17.521099+0000","last_peered":"2024-04-18T21:10:17.521099+0000","last_clean":"2024-04-18T21:10:17.521099+0000","last_became_active":"2024-04-18T21:05:05.637567+0000","last_became_peered":"2024-04-18T21:05:05.637567+0000","last_unstale":"2024-04-18T21:10:17.521099+0000","last_undegraded":"2024-04-18T21:10:17.521099+0000","last_fullsized":"2024-04-18T21:10:17.521099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5514,"num_write":403,"num_write_kb":26329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"71'418","reported_seq":655,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.522402+0000","last_change":"2024-04-18T21:05:05.643606+0000","last_active":"2024-04-18T21:10:17.522402+0000","last_peered":"2024-04-18T21:10:17.522402+0000","last_clean":"2024-04-18T21:10:17.522402+0000","last_became_active":"2024-04-18T21:05:05.642991+0000","last_became_peered":"2024-04-18T21:05:05.642991+0000","last_unstale":"2024-04-18T21:10:17.522402+0000","last_undegraded":"2024-04-18T21:10:17.522402+0000","last_fullsized":"2024-04-18T21:10:17.522402+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:01.841786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":29097,"num_write":386,"num_write_kb":88262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"71'479","reported_seq":718,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.539646+0000","last_change":"2024-04-18T21:10:07.549995+0000","last_active":"2024-04-18T21:10:18.539646+0000","last_peered":"2024-04-18T21:10:18.539646+0000","last_clean":"2024-04-18T21:10:18.539646+0000","last_became_active":"2024-04-18T21:10:07.544314+0000","last_became_peered":"2024-04-18T21:10:07.544314+0000","last_unstale":"2024-04-18T21:10:18.539646+0000","last_undegraded":"2024-04-18T21:10:18.539646+0000","last_fullsized":"2024-04-18T21:10:18.539646+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:52:34.340348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":24204,"num_write":452,"num_write_kb":114184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"71'407","reported_seq":631,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.519152+0000","last_change":"2024-04-18T21:10:03.487961+0000","last_active":"2024-04-18T21:10:17.519152+0000","last_peered":"2024-04-18T21:10:17.519152+0000","last_clean":"2024-04-18T21:10:17.519152+0000","last_became_active":"2024-04-18T21:10:03.476552+0000","last_became_peered":"2024-04-18T21:10:03.476552+0000","last_unstale":"2024-04-18T21:10:17.519152+0000","last_undegraded":"2024-04-18T21:10:17.519152+0000","last_fullsized":"2024-04-18T21:10:17.519152+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:45:35.774025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":37766,"num_write":374,"num_write_kb":103984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'452","reported_seq":649,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.547982+0000","last_change":"2024-04-18T21:10:18.547982+0000","last_active":"2024-04-18T21:10:18.547982+0000","last_peered":"2024-04-18T21:10:18.547982+0000","last_clean":"2024-04-18T21:10:18.547982+0000","last_became_active":"2024-04-18T21:10:18.542189+0000","last_became_peered":"2024-04-18T21:10:18.542189+0000","last_unstale":"2024-04-18T21:10:18.547982+0000","last_undegraded":"2024-04-18T21:10:18.547982+0000","last_fullsized":"2024-04-18T21:10:18.547982+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:49.761650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27170,"num_write":421,"num_write_kb":39548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"71'427","reported_seq":630,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.540955+0000","last_change":"2024-04-18T21:10:03.544910+0000","last_active":"2024-04-18T21:10:18.540955+0000","last_peered":"2024-04-18T21:10:18.540955+0000","last_clean":"2024-04-18T21:10:18.540955+0000","last_became_active":"2024-04-18T21:10:03.539961+0000","last_became_peered":"2024-04-18T21:10:03.539961+0000","last_unstale":"2024-04-18T21:10:18.540955+0000","last_undegraded":"2024-04-18T21:10:18.540955+0000","last_fullsized":"2024-04-18T21:10:18.540955+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:06:34.839228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":11507,"num_write":407,"num_write_kb":50964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"71'471","reported_seq":691,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.522980+0000","last_change":"2024-04-18T21:05:05.649581+0000","last_active":"2024-04-18T21:10:17.522980+0000","last_peered":"2024-04-18T21:10:17.522980+0000","last_clean":"2024-04-18T21:10:17.522980+0000","last_became_active":"2024-04-18T21:05:05.648233+0000","last_became_peered":"2024-04-18T21:05:05.648233+0000","last_unstale":"2024-04-18T21:10:17.522980+0000","last_undegraded":"2024-04-18T21:10:17.522980+0000","last_fullsized":"2024-04-18T21:10:17.522980+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20857,"num_write":431,"num_write_kb":63677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'378","reported_seq":934,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.522468+0000","last_change":"2024-04-18T21:09:55.493655+0000","last_active":"2024-04-18T21:10:17.522468+0000","last_peered":"2024-04-18T21:10:17.522468+0000","last_clean":"2024-04-18T21:10:17.522468+0000","last_became_active":"2024-04-18T21:09:55.490958+0000","last_became_peered":"2024-04-18T21:09:55.490958+0000","last_unstale":"2024-04-18T21:10:17.522468+0000","last_undegraded":"2024-04-18T21:10:17.522468+0000","last_fullsized":"2024-04-18T21:10:17.522468+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:52:16.541697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12573,"num_write":347,"num_write_kb":34434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'410","reported_seq":635,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.540020+0000","last_change":"2024-04-18T21:10:01.563947+0000","last_active":"2024-04-18T21:10:18.540020+0000","last_peered":"2024-04-18T21:10:18.540020+0000","last_clean":"2024-04-18T21:10:18.540020+0000","last_became_active":"2024-04-18T21:10:01.555367+0000","last_became_peered":"2024-04-18T21:10:01.555367+0000","last_unstale":"2024-04-18T21:10:18.540020+0000","last_undegraded":"2024-04-18T21:10:18.540020+0000","last_fullsized":"2024-04-18T21:10:18.540020+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:01:09.418419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":16926,"num_write":380,"num_write_kb":112804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"71'410","reported_seq":985,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.520763+0000","last_change":"2024-04-18T21:10:03.490605+0000","last_active":"2024-04-18T21:10:17.520763+0000","last_peered":"2024-04-18T21:10:17.520763+0000","last_clean":"2024-04-18T21:10:17.520763+0000","last_became_active":"2024-04-18T21:10:03.480985+0000","last_became_peered":"2024-04-18T21:10:03.480985+0000","last_unstale":"2024-04-18T21:10:17.520763+0000","last_undegraded":"2024-04-18T21:10:17.520763+0000","last_fullsized":"2024-04-18T21:10:17.520763+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:14:42.076110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":34811,"num_write":378,"num_write_kb":51242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'491","reported_seq":705,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.538808+0000","last_change":"2024-04-18T21:10:08.546388+0000","last_active":"2024-04-18T21:10:18.538808+0000","last_peered":"2024-04-18T21:10:18.538808+0000","last_clean":"2024-04-18T21:10:18.538808+0000","last_became_active":"2024-04-18T21:10:08.540487+0000","last_became_peered":"2024-04-18T21:10:08.540487+0000","last_unstale":"2024-04-18T21:10:18.538808+0000","last_undegraded":"2024-04-18T21:10:18.538808+0000","last_fullsized":"2024-04-18T21:10:18.538808+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:15:51.120517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":26902,"num_write":456,"num_write_kb":124778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":209,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"71'467","reported_seq":815,"reported_epoch":105,"state":"active+recovering+undersized+remapped","last_fresh":"2024-04-18T21:10:17.657506+0000","last_change":"2024-04-18T21:10:17.417104+0000","last_active":"2024-04-18T21:10:17.657506+0000","last_peered":"2024-04-18T21:10:17.657506+0000","last_clean":"2024-04-18T21:06:56.506258+0000","last_became_active":"2024-04-18T21:10:03.477945+0000","last_became_peered":"2024-04-18T21:10:03.477945+0000","last_unstale":"2024-04-18T21:10:17.657506+0000","last_undegraded":"2024-04-18T21:10:17.657506+0000","last_fullsized":"2024-04-18T21:10:03.470440+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":28114,"num_write":434,"num_write_kb":129325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":66,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'423","reported_seq":589,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.520445+0000","last_change":"2024-04-18T21:10:01.499421+0000","last_active":"2024-04-18T21:10:17.520445+0000","last_peered":"2024-04-18T21:10:17.520445+0000","last_clean":"2024-04-18T21:10:17.520445+0000","last_became_active":"2024-04-18T21:10:01.487074+0000","last_became_peered":"2024-04-18T21:10:01.487074+0000","last_unstale":"2024-04-18T21:10:17.520445+0000","last_undegraded":"2024-04-18T21:10:17.520445+0000","last_fullsized":"2024-04-18T21:10:17.520445+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:05:34.827814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8244,"num_write":393,"num_write_kb":58692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"71'389","reported_seq":614,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.538812+0000","last_change":"2024-04-18T21:09:58.542232+0000","last_active":"2024-04-18T21:10:18.538812+0000","last_peered":"2024-04-18T21:10:18.538812+0000","last_clean":"2024-04-18T21:10:18.538812+0000","last_became_active":"2024-04-18T21:09:58.537723+0000","last_became_peered":"2024-04-18T21:09:58.537723+0000","last_unstale":"2024-04-18T21:10:18.538812+0000","last_undegraded":"2024-04-18T21:10:18.538812+0000","last_fullsized":"2024-04-18T21:10:18.538812+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:26.786170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":24216,"num_write":349,"num_write_kb":43176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"70'425","reported_seq":615,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.522697+0000","last_change":"2024-04-18T21:05:04.632748+0000","last_active":"2024-04-18T21:10:17.522697+0000","last_peered":"2024-04-18T21:10:17.522697+0000","last_clean":"2024-04-18T21:10:17.522697+0000","last_became_active":"2024-04-18T21:05:04.628407+0000","last_became_peered":"2024-04-18T21:05:04.628407+0000","last_unstale":"2024-04-18T21:10:17.522697+0000","last_undegraded":"2024-04-18T21:10:17.522697+0000","last_fullsized":"2024-04-18T21:10:17.522697+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:42:45.392908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":375,"num_write_kb":8348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"71'423","reported_seq":619,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.539069+0000","last_change":"2024-04-18T21:10:14.556066+0000","last_active":"2024-04-18T21:10:18.539069+0000","last_peered":"2024-04-18T21:10:18.539069+0000","last_clean":"2024-04-18T21:10:18.539069+0000","last_became_active":"2024-04-18T21:10:14.551249+0000","last_became_peered":"2024-04-18T21:10:14.551249+0000","last_unstale":"2024-04-18T21:10:18.539069+0000","last_undegraded":"2024-04-18T21:10:18.539069+0000","last_fullsized":"2024-04-18T21:10:18.539069+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:06:06.045278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":20096,"num_write":381,"num_write_kb":76351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"70'56","reported_seq":258,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.519699+0000","last_change":"2024-04-18T21:10:00.500122+0000","last_active":"2024-04-18T21:10:17.519699+0000","last_peered":"2024-04-18T21:10:17.519699+0000","last_clean":"2024-04-18T21:10:17.519699+0000","last_became_active":"2024-04-18T21:10:00.489486+0000","last_became_peered":"2024-04-18T21:10:00.489486+0000","last_unstale":"2024-04-18T21:10:17.519699+0000","last_undegraded":"2024-04-18T21:10:17.519699+0000","last_fullsized":"2024-04-18T21:10:17.519699+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:58:08.269558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'442","reported_seq":1020,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.523282+0000","last_change":"2024-04-18T21:10:03.492109+0000","last_active":"2024-04-18T21:10:17.523282+0000","last_peered":"2024-04-18T21:10:17.523282+0000","last_clean":"2024-04-18T21:10:17.523282+0000","last_became_active":"2024-04-18T21:10:03.483050+0000","last_became_peered":"2024-04-18T21:10:03.483050+0000","last_unstale":"2024-04-18T21:10:17.523282+0000","last_undegraded":"2024-04-18T21:10:17.523282+0000","last_fullsized":"2024-04-18T21:10:17.523282+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:45.388623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13827,"num_write":415,"num_write_kb":79859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"70'62","reported_seq":76,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.538404+0000","last_change":"2024-04-18T21:09:50.868159+0000","last_active":"2024-04-18T21:10:18.538404+0000","last_peered":"2024-04-18T21:10:18.538404+0000","last_clean":"2024-04-18T21:10:18.538404+0000","last_became_active":"2024-04-18T21:09:50.867096+0000","last_became_peered":"2024-04-18T21:09:50.867096+0000","last_unstale":"2024-04-18T21:10:18.538404+0000","last_undegraded":"2024-04-18T21:10:18.538404+0000","last_fullsized":"2024-04-18T21:10:18.538404+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:09:57.047205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"71'398","reported_seq":633,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.521853+0000","last_change":"2024-04-18T21:10:01.498728+0000","last_active":"2024-04-18T21:10:17.521853+0000","last_peered":"2024-04-18T21:10:17.521853+0000","last_clean":"2024-04-18T21:10:17.521853+0000","last_became_active":"2024-04-18T21:10:01.495349+0000","last_became_peered":"2024-04-18T21:10:01.495349+0000","last_unstale":"2024-04-18T21:10:17.521853+0000","last_undegraded":"2024-04-18T21:10:17.521853+0000","last_fullsized":"2024-04-18T21:10:17.521853+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:01:48.618551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":17616,"num_write":360,"num_write_kb":58871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"70'66","reported_seq":175,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.520637+0000","last_change":"2024-04-18T21:10:00.496701+0000","last_active":"2024-04-18T21:10:17.520637+0000","last_peered":"2024-04-18T21:10:17.520637+0000","last_clean":"2024-04-18T21:10:17.520637+0000","last_became_active":"2024-04-18T21:10:00.495594+0000","last_became_peered":"2024-04-18T21:10:00.495594+0000","last_unstale":"2024-04-18T21:10:17.520637+0000","last_undegraded":"2024-04-18T21:10:17.520637+0000","last_fullsized":"2024-04-18T21:10:17.520637+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:11:32.991308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"70'135","reported_seq":62,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.522019+0000","last_change":"2024-04-18T21:10:00.493197+0000","last_active":"2024-04-18T21:10:17.522019+0000","last_peered":"2024-04-18T21:10:17.522019+0000","last_clean":"2024-04-18T21:10:17.522019+0000","last_became_active":"2024-04-18T21:10:00.491509+0000","last_became_peered":"2024-04-18T21:10:00.491509+0000","last_unstale":"2024-04-18T21:10:17.522019+0000","last_undegraded":"2024-04-18T21:10:17.522019+0000","last_fullsized":"2024-04-18T21:10:17.522019+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:57:29.595389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":7777508,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'410","reported_seq":606,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.539033+0000","last_change":"2024-04-18T21:10:06.553806+0000","last_active":"2024-04-18T21:10:18.539033+0000","last_peered":"2024-04-18T21:10:18.539033+0000","last_clean":"2024-04-18T21:10:18.539033+0000","last_became_active":"2024-04-18T21:10:06.548034+0000","last_became_peered":"2024-04-18T21:10:06.548034+0000","last_unstale":"2024-04-18T21:10:18.539033+0000","last_undegraded":"2024-04-18T21:10:18.539033+0000","last_fullsized":"2024-04-18T21:10:18.539033+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:20:56.265941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17055,"num_write":375,"num_write_kb":63331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"70'240","reported_seq":359,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.539203+0000","last_change":"2024-04-18T21:10:00.556212+0000","last_active":"2024-04-18T21:10:18.539203+0000","last_peered":"2024-04-18T21:10:18.539203+0000","last_clean":"2024-04-18T21:10:18.539203+0000","last_became_active":"2024-04-18T21:10:00.555486+0000","last_became_peered":"2024-04-18T21:10:00.555486+0000","last_unstale":"2024-04-18T21:10:18.539203+0000","last_undegraded":"2024-04-18T21:10:18.539203+0000","last_fullsized":"2024-04-18T21:10:18.539203+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:11.573984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":4191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"71'501","reported_seq":715,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.537988+0000","last_change":"2024-04-18T21:10:17.593530+0000","last_active":"2024-04-18T21:10:18.537988+0000","last_peered":"2024-04-18T21:10:18.537988+0000","last_clean":"2024-04-18T21:10:18.537988+0000","last_became_active":"2024-04-18T21:10:17.588391+0000","last_became_peered":"2024-04-18T21:10:17.588391+0000","last_unstale":"2024-04-18T21:10:18.537988+0000","last_undegraded":"2024-04-18T21:10:18.537988+0000","last_fullsized":"2024-04-18T21:10:18.537988+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:26.079610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":37662,"num_write":474,"num_write_kb":167663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"70'429","reported_seq":560,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.523014+0000","last_change":"2024-04-18T21:10:00.493325+0000","last_active":"2024-04-18T21:10:17.523014+0000","last_peered":"2024-04-18T21:10:17.523014+0000","last_clean":"2024-04-18T21:10:17.523014+0000","last_became_active":"2024-04-18T21:10:00.491525+0000","last_became_peered":"2024-04-18T21:10:00.491525+0000","last_unstale":"2024-04-18T21:10:17.523014+0000","last_undegraded":"2024-04-18T21:10:17.523014+0000","last_fullsized":"2024-04-18T21:10:17.523014+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:27:59.637974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":377,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388678,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'440","reported_seq":644,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.521311+0000","last_change":"2024-04-18T21:10:01.497932+0000","last_active":"2024-04-18T21:10:17.521311+0000","last_peered":"2024-04-18T21:10:17.521311+0000","last_clean":"2024-04-18T21:10:17.521311+0000","last_became_active":"2024-04-18T21:10:01.486740+0000","last_became_peered":"2024-04-18T21:10:01.486740+0000","last_unstale":"2024-04-18T21:10:17.521311+0000","last_undegraded":"2024-04-18T21:10:17.521311+0000","last_fullsized":"2024-04-18T21:10:17.521311+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:34:43.515471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":42138,"num_write":408,"num_write_kb":96310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"70'59","reported_seq":249,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.521667+0000","last_change":"2024-04-18T21:05:04.625520+0000","last_active":"2024-04-18T21:10:17.521667+0000","last_peered":"2024-04-18T21:10:17.521667+0000","last_clean":"2024-04-18T21:10:17.521667+0000","last_became_active":"2024-04-18T21:05:04.624656+0000","last_became_peered":"2024-04-18T21:05:04.624656+0000","last_unstale":"2024-04-18T21:10:17.521667+0000","last_undegraded":"2024-04-18T21:10:17.521667+0000","last_fullsized":"2024-04-18T21:10:17.521667+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:56:05.795125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"71'461","reported_seq":670,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.520200+0000","last_change":"2024-04-18T21:05:05.649406+0000","last_active":"2024-04-18T21:10:17.520200+0000","last_peered":"2024-04-18T21:10:17.520200+0000","last_clean":"2024-04-18T21:10:17.520200+0000","last_became_active":"2024-04-18T21:05:05.648380+0000","last_became_peered":"2024-04-18T21:05:05.648380+0000","last_unstale":"2024-04-18T21:10:17.520200+0000","last_undegraded":"2024-04-18T21:10:17.520200+0000","last_fullsized":"2024-04-18T21:10:17.520200+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12852,"num_write":420,"num_write_kb":88506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"70'157","reported_seq":370,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.521244+0000","last_change":"2024-04-18T21:10:00.500141+0000","last_active":"2024-04-18T21:10:17.521244+0000","last_peered":"2024-04-18T21:10:17.521244+0000","last_clean":"2024-04-18T21:10:17.521244+0000","last_became_active":"2024-04-18T21:10:00.494630+0000","last_became_peered":"2024-04-18T21:10:00.494630+0000","last_unstale":"2024-04-18T21:10:17.521244+0000","last_undegraded":"2024-04-18T21:10:17.521244+0000","last_fullsized":"2024-04-18T21:10:17.521244+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:49:43.984354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":8250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'445","reported_seq":629,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.521309+0000","last_change":"2024-04-18T21:10:01.500937+0000","last_active":"2024-04-18T21:10:17.521309+0000","last_peered":"2024-04-18T21:10:17.521309+0000","last_clean":"2024-04-18T21:10:17.521309+0000","last_became_active":"2024-04-18T21:10:01.490691+0000","last_became_peered":"2024-04-18T21:10:01.490691+0000","last_unstale":"2024-04-18T21:10:17.521309+0000","last_undegraded":"2024-04-18T21:10:17.521309+0000","last_fullsized":"2024-04-18T21:10:17.521309+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:59:48.489145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17488,"num_write":410,"num_write_kb":50845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"70'124","reported_seq":314,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.521745+0000","last_change":"2024-04-18T21:05:04.634674+0000","last_active":"2024-04-18T21:10:17.521745+0000","last_peered":"2024-04-18T21:10:17.521745+0000","last_clean":"2024-04-18T21:10:17.521745+0000","last_became_active":"2024-04-18T21:05:04.632284+0000","last_became_peered":"2024-04-18T21:05:04.632284+0000","last_unstale":"2024-04-18T21:10:17.521745+0000","last_undegraded":"2024-04-18T21:10:17.521745+0000","last_fullsized":"2024-04-18T21:10:17.521745+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:09:18.466987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"71'400","reported_seq":936,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.522770+0000","last_change":"2024-04-18T21:10:14.495223+0000","last_active":"2024-04-18T21:10:17.522770+0000","last_peered":"2024-04-18T21:10:17.522770+0000","last_clean":"2024-04-18T21:10:17.522770+0000","last_became_active":"2024-04-18T21:10:14.492039+0000","last_became_peered":"2024-04-18T21:10:14.492039+0000","last_unstale":"2024-04-18T21:10:17.522770+0000","last_undegraded":"2024-04-18T21:10:17.522770+0000","last_fullsized":"2024-04-18T21:10:17.522770+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:58:35.802545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12586,"num_write":372,"num_write_kb":58856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":350,"num_bytes_recovered":576854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"70'53","reported_seq":78,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.537948+0000","last_change":"2024-04-18T21:10:00.550936+0000","last_active":"2024-04-18T21:10:18.537948+0000","last_peered":"2024-04-18T21:10:18.537948+0000","last_clean":"2024-04-18T21:10:18.537948+0000","last_became_active":"2024-04-18T21:10:00.549987+0000","last_became_peered":"2024-04-18T21:10:00.549987+0000","last_unstale":"2024-04-18T21:10:18.537948+0000","last_undegraded":"2024-04-18T21:10:18.537948+0000","last_fullsized":"2024-04-18T21:10:18.537948+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:53:36.771516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"71'364","reported_seq":937,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.521557+0000","last_change":"2024-04-18T21:09:58.478726+0000","last_active":"2024-04-18T21:10:17.521557+0000","last_peered":"2024-04-18T21:10:17.521557+0000","last_clean":"2024-04-18T21:10:17.521557+0000","last_became_active":"2024-04-18T21:09:58.473903+0000","last_became_peered":"2024-04-18T21:09:58.473903+0000","last_unstale":"2024-04-18T21:10:17.521557+0000","last_undegraded":"2024-04-18T21:10:17.521557+0000","last_fullsized":"2024-04-18T21:10:17.521557+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:40.377274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":37938,"num_write":336,"num_write_kb":42513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"70'460","reported_seq":569,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.538139+0000","last_change":"2024-04-18T21:09:53.545846+0000","last_active":"2024-04-18T21:10:18.538139+0000","last_peered":"2024-04-18T21:10:18.538139+0000","last_clean":"2024-04-18T21:10:18.538139+0000","last_became_active":"2024-04-18T21:09:53.544355+0000","last_became_peered":"2024-04-18T21:09:53.544355+0000","last_unstale":"2024-04-18T21:10:18.538139+0000","last_undegraded":"2024-04-18T21:10:18.538139+0000","last_fullsized":"2024-04-18T21:10:18.538139+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:34:16.776752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":406,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"71'404","reported_seq":972,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.522072+0000","last_change":"2024-04-18T21:10:15.507332+0000","last_active":"2024-04-18T21:10:17.522072+0000","last_peered":"2024-04-18T21:10:17.522072+0000","last_clean":"2024-04-18T21:10:17.522072+0000","last_became_active":"2024-04-18T21:10:15.504379+0000","last_became_peered":"2024-04-18T21:10:15.504379+0000","last_unstale":"2024-04-18T21:10:17.522072+0000","last_undegraded":"2024-04-18T21:10:17.522072+0000","last_fullsized":"2024-04-18T21:10:17.522072+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:33:14.728553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":7075,"num_write":367,"num_write_kb":62738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":377,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.521047+0000","last_change":"2024-04-18T21:10:00.497960+0000","last_active":"2024-04-18T21:10:17.521047+0000","last_peered":"2024-04-18T21:10:17.521047+0000","last_clean":"2024-04-18T21:10:17.521047+0000","last_became_active":"2024-04-18T21:10:00.496373+0000","last_became_peered":"2024-04-18T21:10:00.496373+0000","last_unstale":"2024-04-18T21:10:17.521047+0000","last_undegraded":"2024-04-18T21:10:17.521047+0000","last_fullsized":"2024-04-18T21:10:17.521047+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_clean_scrub_stamp":"2024-04-18T21:04:53.494814+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:56:52.975720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":153,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.522842+0000","last_change":"2024-04-18T21:10:00.487584+0000","last_active":"2024-04-18T21:10:17.522842+0000","last_peered":"2024-04-18T21:10:17.522842+0000","last_clean":"2024-04-18T21:10:17.522842+0000","last_became_active":"2024-04-18T21:10:00.486722+0000","last_became_peered":"2024-04-18T21:10:00.486722+0000","last_unstale":"2024-04-18T21:10:17.522842+0000","last_undegraded":"2024-04-18T21:10:17.522842+0000","last_fullsized":"2024-04-18T21:10:17.522842+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:17:03.176148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"70'595","reported_seq":744,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.520006+0000","last_change":"2024-04-18T21:10:03.488427+0000","last_active":"2024-04-18T21:10:17.520006+0000","last_peered":"2024-04-18T21:10:17.520006+0000","last_clean":"2024-04-18T21:10:17.520006+0000","last_became_active":"2024-04-18T21:10:03.481344+0000","last_became_peered":"2024-04-18T21:10:03.481344+0000","last_unstale":"2024-04-18T21:10:17.520006+0000","last_undegraded":"2024-04-18T21:10:17.520006+0000","last_fullsized":"2024-04-18T21:10:17.520006+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:41.583248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":539,"num_write_kb":8449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4689862,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'443","reported_seq":1083,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.522826+0000","last_change":"2024-04-18T21:09:56.496310+0000","last_active":"2024-04-18T21:10:17.522826+0000","last_peered":"2024-04-18T21:10:17.522826+0000","last_clean":"2024-04-18T21:10:17.522826+0000","last_became_active":"2024-04-18T21:09:56.493327+0000","last_became_peered":"2024-04-18T21:09:56.493327+0000","last_unstale":"2024-04-18T21:10:17.522826+0000","last_undegraded":"2024-04-18T21:10:17.522826+0000","last_fullsized":"2024-04-18T21:10:17.522826+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:20:57.340997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":38975,"num_write":404,"num_write_kb":80038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":203,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.520962+0000","last_change":"2024-04-18T21:09:50.817029+0000","last_active":"2024-04-18T21:10:17.520962+0000","last_peered":"2024-04-18T21:10:17.520962+0000","last_clean":"2024-04-18T21:10:17.520962+0000","last_became_active":"2024-04-18T21:09:50.816543+0000","last_became_peered":"2024-04-18T21:09:50.816543+0000","last_unstale":"2024-04-18T21:10:17.520962+0000","last_undegraded":"2024-04-18T21:10:17.520962+0000","last_fullsized":"2024-04-18T21:10:17.520962+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:47:33.047727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"70'129","reported_seq":306,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.520242+0000","last_change":"2024-04-18T21:10:03.489109+0000","last_active":"2024-04-18T21:10:17.520242+0000","last_peered":"2024-04-18T21:10:17.520242+0000","last_clean":"2024-04-18T21:10:17.520242+0000","last_became_active":"2024-04-18T21:10:03.486859+0000","last_became_peered":"2024-04-18T21:10:03.486859+0000","last_unstale":"2024-04-18T21:10:17.520242+0000","last_undegraded":"2024-04-18T21:10:17.520242+0000","last_fullsized":"2024-04-18T21:10:17.520242+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:52:04.172480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466419,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":55,"num_read_kb":1405,"num_write":58,"num_write_kb":1469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'457","reported_seq":676,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.540899+0000","last_change":"2024-04-18T21:10:09.543207+0000","last_active":"2024-04-18T21:10:18.540899+0000","last_peered":"2024-04-18T21:10:18.540899+0000","last_clean":"2024-04-18T21:10:18.540899+0000","last_became_active":"2024-04-18T21:10:09.537428+0000","last_became_peered":"2024-04-18T21:10:09.537428+0000","last_unstale":"2024-04-18T21:10:18.540899+0000","last_undegraded":"2024-04-18T21:10:18.540899+0000","last_fullsized":"2024-04-18T21:10:18.540899+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:21.987918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":27659,"num_write":426,"num_write_kb":80500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":202,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.520547+0000","last_change":"2024-04-18T21:09:50.832624+0000","last_active":"2024-04-18T21:10:17.520547+0000","last_peered":"2024-04-18T21:10:17.520547+0000","last_clean":"2024-04-18T21:10:17.520547+0000","last_became_active":"2024-04-18T21:09:50.831949+0000","last_became_peered":"2024-04-18T21:09:50.831949+0000","last_unstale":"2024-04-18T21:10:17.520547+0000","last_undegraded":"2024-04-18T21:10:17.520547+0000","last_fullsized":"2024-04-18T21:10:17.520547+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:35:45.986029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'170","reported_seq":364,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.537753+0000","last_change":"2024-04-18T21:09:53.538615+0000","last_active":"2024-04-18T21:10:18.537753+0000","last_peered":"2024-04-18T21:10:18.537753+0000","last_clean":"2024-04-18T21:10:18.537753+0000","last_became_active":"2024-04-18T21:09:53.537994+0000","last_became_peered":"2024-04-18T21:09:53.537994+0000","last_unstale":"2024-04-18T21:10:18.537753+0000","last_undegraded":"2024-04-18T21:10:18.537753+0000","last_fullsized":"2024-04-18T21:10:18.537753+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:02:34.372453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":8239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"71'346","reported_seq":904,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.522140+0000","last_change":"2024-04-18T21:10:11.487541+0000","last_active":"2024-04-18T21:10:17.522140+0000","last_peered":"2024-04-18T21:10:17.522140+0000","last_clean":"2024-04-18T21:10:17.522140+0000","last_became_active":"2024-04-18T21:10:11.484662+0000","last_became_peered":"2024-04-18T21:10:11.484662+0000","last_unstale":"2024-04-18T21:10:17.522140+0000","last_undegraded":"2024-04-18T21:10:17.522140+0000","last_fullsized":"2024-04-18T21:10:17.522140+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:50:21.491862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27042,"num_write":321,"num_write_kb":50693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":196,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.521738+0000","last_change":"2024-04-18T21:05:00.576606+0000","last_active":"2024-04-18T21:10:17.521738+0000","last_peered":"2024-04-18T21:10:17.521738+0000","last_clean":"2024-04-18T21:10:17.521738+0000","last_became_active":"2024-04-18T21:05:00.575951+0000","last_became_peered":"2024-04-18T21:05:00.575951+0000","last_unstale":"2024-04-18T21:10:17.521738+0000","last_undegraded":"2024-04-18T21:10:17.521738+0000","last_fullsized":"2024-04-18T21:10:17.521738+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:32:17.612481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"70'63","reported_seq":253,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.522790+0000","last_change":"2024-04-18T21:05:04.627296+0000","last_active":"2024-04-18T21:10:17.522790+0000","last_peered":"2024-04-18T21:10:17.522790+0000","last_clean":"2024-04-18T21:10:17.522790+0000","last_became_active":"2024-04-18T21:05:04.626801+0000","last_became_peered":"2024-04-18T21:05:04.626801+0000","last_unstale":"2024-04-18T21:10:17.522790+0000","last_undegraded":"2024-04-18T21:10:17.522790+0000","last_fullsized":"2024-04-18T21:10:17.522790+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:46:36.285416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"71'406","reported_seq":1035,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.521560+0000","last_change":"2024-04-18T21:09:59.495686+0000","last_active":"2024-04-18T21:10:17.521560+0000","last_peered":"2024-04-18T21:10:17.521560+0000","last_clean":"2024-04-18T21:10:17.521560+0000","last_became_active":"2024-04-18T21:09:59.493248+0000","last_became_peered":"2024-04-18T21:09:59.493248+0000","last_unstale":"2024-04-18T21:10:17.521560+0000","last_undegraded":"2024-04-18T21:10:17.521560+0000","last_fullsized":"2024-04-18T21:10:17.521560+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:11:23.853682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":35332,"num_write":370,"num_write_kb":71807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"70'284","reported_seq":309,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.523101+0000","last_change":"2024-04-18T21:10:00.504958+0000","last_active":"2024-04-18T21:10:17.523101+0000","last_peered":"2024-04-18T21:10:17.523101+0000","last_clean":"2024-04-18T21:10:17.523101+0000","last_became_active":"2024-04-18T21:10:00.503851+0000","last_became_peered":"2024-04-18T21:10:00.503851+0000","last_unstale":"2024-04-18T21:10:17.523101+0000","last_undegraded":"2024-04-18T21:10:17.523101+0000","last_fullsized":"2024-04-18T21:10:17.523101+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:10:27.397258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":218,"num_write_kb":4194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":129,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.522553+0000","last_change":"2024-04-18T21:10:03.484148+0000","last_active":"2024-04-18T21:10:17.522553+0000","last_peered":"2024-04-18T21:10:17.522553+0000","last_clean":"2024-04-18T21:10:17.522553+0000","last_became_active":"2024-04-18T21:10:03.480071+0000","last_became_peered":"2024-04-18T21:10:03.480071+0000","last_unstale":"2024-04-18T21:10:17.522553+0000","last_undegraded":"2024-04-18T21:10:17.522553+0000","last_fullsized":"2024-04-18T21:10:17.522553+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:50:30.257039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'386","reported_seq":573,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.539387+0000","last_change":"2024-04-18T21:10:10.547885+0000","last_active":"2024-04-18T21:10:18.539387+0000","last_peered":"2024-04-18T21:10:18.539387+0000","last_clean":"2024-04-18T21:10:18.539387+0000","last_became_active":"2024-04-18T21:10:10.542515+0000","last_became_peered":"2024-04-18T21:10:10.542515+0000","last_unstale":"2024-04-18T21:10:18.539387+0000","last_undegraded":"2024-04-18T21:10:18.539387+0000","last_fullsized":"2024-04-18T21:10:18.539387+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:58:24.232536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14677,"num_write":355,"num_write_kb":51018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"70'55","reported_seq":251,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.522093+0000","last_change":"2024-04-18T21:09:50.833424+0000","last_active":"2024-04-18T21:10:17.522093+0000","last_peered":"2024-04-18T21:10:17.522093+0000","last_clean":"2024-04-18T21:10:17.522093+0000","last_became_active":"2024-04-18T21:09:50.832752+0000","last_became_peered":"2024-04-18T21:09:50.832752+0000","last_unstale":"2024-04-18T21:10:17.522093+0000","last_undegraded":"2024-04-18T21:10:17.522093+0000","last_fullsized":"2024-04-18T21:10:17.522093+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:48.945329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":161,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.541278+0000","last_change":"2024-04-18T21:09:50.900338+0000","last_active":"2024-04-18T21:10:18.541278+0000","last_peered":"2024-04-18T21:10:18.541278+0000","last_clean":"2024-04-18T21:10:18.541278+0000","last_became_active":"2024-04-18T21:09:50.896844+0000","last_became_peered":"2024-04-18T21:09:50.896844+0000","last_unstale":"2024-04-18T21:10:18.541278+0000","last_undegraded":"2024-04-18T21:10:18.541278+0000","last_fullsized":"2024-04-18T21:10:18.541278+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:11:35.543409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"71'402","reported_seq":587,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.538498+0000","last_change":"2024-04-18T21:10:05.542484+0000","last_active":"2024-04-18T21:10:18.538498+0000","last_peered":"2024-04-18T21:10:18.538498+0000","last_clean":"2024-04-18T21:10:18.538498+0000","last_became_active":"2024-04-18T21:10:05.536763+0000","last_became_peered":"2024-04-18T21:10:05.536763+0000","last_unstale":"2024-04-18T21:10:18.538498+0000","last_undegraded":"2024-04-18T21:10:18.538498+0000","last_fullsized":"2024-04-18T21:10:18.538498+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:08:22.367267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12468,"num_write":369,"num_write_kb":67231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"70'60","reported_seq":257,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.523122+0000","last_change":"2024-04-18T21:09:50.832598+0000","last_active":"2024-04-18T21:10:17.523122+0000","last_peered":"2024-04-18T21:10:17.523122+0000","last_clean":"2024-04-18T21:10:17.523122+0000","last_became_active":"2024-04-18T21:09:50.832030+0000","last_became_peered":"2024-04-18T21:09:50.832030+0000","last_unstale":"2024-04-18T21:10:17.523122+0000","last_undegraded":"2024-04-18T21:10:17.523122+0000","last_fullsized":"2024-04-18T21:10:17.523122+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:10:27.397258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":129,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.523594+0000","last_change":"2024-04-18T21:10:03.492761+0000","last_active":"2024-04-18T21:10:17.523594+0000","last_peered":"2024-04-18T21:10:17.523594+0000","last_clean":"2024-04-18T21:10:17.523594+0000","last_became_active":"2024-04-18T21:10:03.492145+0000","last_became_peered":"2024-04-18T21:10:03.492145+0000","last_unstale":"2024-04-18T21:10:17.523594+0000","last_undegraded":"2024-04-18T21:10:17.523594+0000","last_fullsized":"2024-04-18T21:10:17.523594+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:20:00.853523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'421","reported_seq":622,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.520624+0000","last_change":"2024-04-18T21:10:03.488774+0000","last_active":"2024-04-18T21:10:17.520624+0000","last_peered":"2024-04-18T21:10:17.520624+0000","last_clean":"2024-04-18T21:10:17.520624+0000","last_became_active":"2024-04-18T21:10:03.479773+0000","last_became_peered":"2024-04-18T21:10:03.479773+0000","last_unstale":"2024-04-18T21:10:17.520624+0000","last_undegraded":"2024-04-18T21:10:17.520624+0000","last_fullsized":"2024-04-18T21:10:17.520624+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:15:12.326904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":16183,"num_write":377,"num_write_kb":50451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"71'110","reported_seq":319,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.523574+0000","last_change":"2024-04-18T21:10:00.497917+0000","last_active":"2024-04-18T21:10:17.523574+0000","last_peered":"2024-04-18T21:10:17.523574+0000","last_clean":"2024-04-18T21:10:17.523574+0000","last_became_active":"2024-04-18T21:10:00.494644+0000","last_became_peered":"2024-04-18T21:10:00.494644+0000","last_unstale":"2024-04-18T21:10:17.523574+0000","last_undegraded":"2024-04-18T21:10:17.523574+0000","last_fullsized":"2024-04-18T21:10:17.523574+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:40:57.347353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":1251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":154,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.522264+0000","last_change":"2024-04-18T21:10:00.493764+0000","last_active":"2024-04-18T21:10:17.522264+0000","last_peered":"2024-04-18T21:10:17.522264+0000","last_clean":"2024-04-18T21:10:17.522264+0000","last_became_active":"2024-04-18T21:10:00.492672+0000","last_became_peered":"2024-04-18T21:10:00.492672+0000","last_unstale":"2024-04-18T21:10:17.522264+0000","last_undegraded":"2024-04-18T21:10:17.522264+0000","last_fullsized":"2024-04-18T21:10:17.522264+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:48:46.709401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'384","reported_seq":593,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.538664+0000","last_change":"2024-04-18T21:09:57.572865+0000","last_active":"2024-04-18T21:10:18.538664+0000","last_peered":"2024-04-18T21:10:18.538664+0000","last_clean":"2024-04-18T21:10:18.538664+0000","last_became_active":"2024-04-18T21:09:57.567962+0000","last_became_peered":"2024-04-18T21:09:57.567962+0000","last_unstale":"2024-04-18T21:10:18.538664+0000","last_undegraded":"2024-04-18T21:10:18.538664+0000","last_fullsized":"2024-04-18T21:10:18.538664+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:51:24.627186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":15567,"num_write":351,"num_write_kb":42959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"71'396","reported_seq":918,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.522547+0000","last_change":"2024-04-18T21:10:13.482151+0000","last_active":"2024-04-18T21:10:17.522547+0000","last_peered":"2024-04-18T21:10:17.522547+0000","last_clean":"2024-04-18T21:10:17.522547+0000","last_became_active":"2024-04-18T21:10:13.479320+0000","last_became_peered":"2024-04-18T21:10:13.479320+0000","last_unstale":"2024-04-18T21:10:17.522547+0000","last_undegraded":"2024-04-18T21:10:17.522547+0000","last_fullsized":"2024-04-18T21:10:17.522547+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:33:52.248167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12943,"num_write":353,"num_write_kb":35357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":342,"num_bytes_recovered":3500882,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"71'277","reported_seq":312,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.521617+0000","last_change":"2024-04-18T21:10:00.495047+0000","last_active":"2024-04-18T21:10:17.521617+0000","last_peered":"2024-04-18T21:10:17.521617+0000","last_clean":"2024-04-18T21:10:17.521617+0000","last_became_active":"2024-04-18T21:10:00.493088+0000","last_became_peered":"2024-04-18T21:10:00.493088+0000","last_unstale":"2024-04-18T21:10:17.521617+0000","last_undegraded":"2024-04-18T21:10:17.521617+0000","last_fullsized":"2024-04-18T21:10:17.521617+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:39:08.263781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":221,"num_write_kb":8303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":8389370,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'411","reported_seq":1001,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.519404+0000","last_change":"2024-04-18T21:10:04.485332+0000","last_active":"2024-04-18T21:10:17.519404+0000","last_peered":"2024-04-18T21:10:17.519404+0000","last_clean":"2024-04-18T21:10:17.519404+0000","last_became_active":"2024-04-18T21:10:04.482320+0000","last_became_peered":"2024-04-18T21:10:04.482320+0000","last_unstale":"2024-04-18T21:10:17.519404+0000","last_undegraded":"2024-04-18T21:10:17.519404+0000","last_fullsized":"2024-04-18T21:10:17.519404+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:35:57.043682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":17179,"num_write":375,"num_write_kb":38991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"70'85","reported_seq":164,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.540462+0000","last_change":"2024-04-18T21:09:50.890616+0000","last_active":"2024-04-18T21:10:18.540462+0000","last_peered":"2024-04-18T21:10:18.540462+0000","last_clean":"2024-04-18T21:10:18.540462+0000","last_became_active":"2024-04-18T21:09:50.874855+0000","last_became_peered":"2024-04-18T21:09:50.874855+0000","last_unstale":"2024-04-18T21:10:18.540462+0000","last_undegraded":"2024-04-18T21:10:18.540462+0000","last_fullsized":"2024-04-18T21:10:18.540462+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:03:54.726282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"70'230","reported_seq":253,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.521857+0000","last_change":"2024-04-18T21:10:00.499373+0000","last_active":"2024-04-18T21:10:17.521857+0000","last_peered":"2024-04-18T21:10:17.521857+0000","last_clean":"2024-04-18T21:10:17.521857+0000","last_became_active":"2024-04-18T21:10:00.498141+0000","last_became_peered":"2024-04-18T21:10:00.498141+0000","last_unstale":"2024-04-18T21:10:17.521857+0000","last_undegraded":"2024-04-18T21:10:17.521857+0000","last_fullsized":"2024-04-18T21:10:17.521857+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:55:01.865593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":4178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"71'493","reported_seq":726,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.519501+0000","last_change":"2024-04-18T21:05:05.642793+0000","last_active":"2024-04-18T21:10:17.519501+0000","last_peered":"2024-04-18T21:10:17.519501+0000","last_clean":"2024-04-18T21:10:17.519501+0000","last_became_active":"2024-04-18T21:05:05.641983+0000","last_became_peered":"2024-04-18T21:05:05.641983+0000","last_unstale":"2024-04-18T21:10:17.519501+0000","last_undegraded":"2024-04-18T21:10:17.519501+0000","last_fullsized":"2024-04-18T21:10:17.519501+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:46:36.339289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23833,"num_write":461,"num_write_kb":76873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"70'62","reported_seq":251,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.522828+0000","last_change":"2024-04-18T21:05:04.641445+0000","last_active":"2024-04-18T21:10:17.522828+0000","last_peered":"2024-04-18T21:10:17.522828+0000","last_clean":"2024-04-18T21:10:17.522828+0000","last_became_active":"2024-04-18T21:05:04.640682+0000","last_became_peered":"2024-04-18T21:05:04.640682+0000","last_unstale":"2024-04-18T21:10:17.522828+0000","last_undegraded":"2024-04-18T21:10:17.522828+0000","last_fullsized":"2024-04-18T21:10:17.522828+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:46:36.285416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'436","reported_seq":1051,"reported_epoch":104,"state":"peering","last_fresh":"2024-04-18T21:10:17.412395+0000","last_change":"2024-04-18T21:10:17.521279+0000","last_active":"2024-04-18T21:10:17.521279+0000","last_peered":"2024-04-18T21:10:17.412395+0000","last_clean":"2024-04-18T21:06:56.761407+0000","last_became_active":"2024-04-18T21:09:51.933205+0000","last_became_peered":"2024-04-18T21:09:51.933205+0000","last_unstale":"2024-04-18T21:10:17.412395+0000","last_undegraded":"2024-04-18T21:10:17.412395+0000","last_fullsized":"2024-04-18T21:09:51.824946+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14561,"num_write":408,"num_write_kb":47462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'369","reported_seq":567,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.540957+0000","last_change":"2024-04-18T21:10:02.553999+0000","last_active":"2024-04-18T21:10:18.540957+0000","last_peered":"2024-04-18T21:10:18.540957+0000","last_clean":"2024-04-18T21:10:18.540957+0000","last_became_active":"2024-04-18T21:10:02.549471+0000","last_became_peered":"2024-04-18T21:10:02.549471+0000","last_unstale":"2024-04-18T21:10:18.540957+0000","last_undegraded":"2024-04-18T21:10:18.540957+0000","last_fullsized":"2024-04-18T21:10:18.540957+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:52:14.371235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13619,"num_write":339,"num_write_kb":63086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"70'888","reported_seq":1024,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.521100+0000","last_change":"2024-04-18T21:10:03.486911+0000","last_active":"2024-04-18T21:10:17.521100+0000","last_peered":"2024-04-18T21:10:17.521100+0000","last_clean":"2024-04-18T21:10:17.521100+0000","last_became_active":"2024-04-18T21:10:03.480576+0000","last_became_peered":"2024-04-18T21:10:03.480576+0000","last_unstale":"2024-04-18T21:10:17.521100+0000","last_undegraded":"2024-04-18T21:10:17.521100+0000","last_fullsized":"2024-04-18T21:10:17.521100+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:41:06.632064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":823,"num_write_kb":8582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'398","reported_seq":556,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.522054+0000","last_change":"2024-04-18T21:10:03.491426+0000","last_active":"2024-04-18T21:10:17.522054+0000","last_peered":"2024-04-18T21:10:17.522054+0000","last_clean":"2024-04-18T21:10:17.522054+0000","last_became_active":"2024-04-18T21:10:03.483190+0000","last_became_peered":"2024-04-18T21:10:03.483190+0000","last_unstale":"2024-04-18T21:10:17.522054+0000","last_undegraded":"2024-04-18T21:10:17.522054+0000","last_fullsized":"2024-04-18T21:10:17.522054+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:05:10.611580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14684,"num_write":380,"num_write_kb":88822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"70'169","reported_seq":378,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.520136+0000","last_change":"2024-04-18T21:10:00.494974+0000","last_active":"2024-04-18T21:10:17.520136+0000","last_peered":"2024-04-18T21:10:17.520136+0000","last_clean":"2024-04-18T21:10:17.520136+0000","last_became_active":"2024-04-18T21:10:00.492196+0000","last_became_peered":"2024-04-18T21:10:00.492196+0000","last_unstale":"2024-04-18T21:10:17.520136+0000","last_undegraded":"2024-04-18T21:10:17.520136+0000","last_fullsized":"2024-04-18T21:10:17.520136+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:33:51.236211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":4162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'406","reported_seq":626,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.539943+0000","last_change":"2024-04-18T21:10:12.553754+0000","last_active":"2024-04-18T21:10:18.539943+0000","last_peered":"2024-04-18T21:10:18.539943+0000","last_clean":"2024-04-18T21:10:18.539943+0000","last_became_active":"2024-04-18T21:10:12.546148+0000","last_became_peered":"2024-04-18T21:10:12.546148+0000","last_unstale":"2024-04-18T21:10:18.539943+0000","last_undegraded":"2024-04-18T21:10:18.539943+0000","last_fullsized":"2024-04-18T21:10:18.539943+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:12:37.876185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27495,"num_write":363,"num_write_kb":89134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"72'192","reported_seq":381,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.538549+0000","last_change":"2024-04-18T21:09:53.541766+0000","last_active":"2024-04-18T21:10:18.538549+0000","last_peered":"2024-04-18T21:10:18.538549+0000","last_clean":"2024-04-18T21:10:18.538549+0000","last_became_active":"2024-04-18T21:09:53.541300+0000","last_became_peered":"2024-04-18T21:09:53.541300+0000","last_unstale":"2024-04-18T21:10:18.538549+0000","last_undegraded":"2024-04-18T21:10:18.538549+0000","last_fullsized":"2024-04-18T21:10:18.538549+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:26:14.718922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12425030,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":12201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8230726,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"71'383","reported_seq":613,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.539045+0000","last_change":"2024-04-18T21:09:55.555798+0000","last_active":"2024-04-18T21:10:18.539045+0000","last_peered":"2024-04-18T21:10:18.539045+0000","last_clean":"2024-04-18T21:10:18.539045+0000","last_became_active":"2024-04-18T21:09:55.551135+0000","last_became_peered":"2024-04-18T21:09:55.551135+0000","last_unstale":"2024-04-18T21:10:18.539045+0000","last_undegraded":"2024-04-18T21:10:18.539045+0000","last_fullsized":"2024-04-18T21:10:18.539045+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:00:01.739082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21614,"num_write":351,"num_write_kb":79501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"70'66","reported_seq":155,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.538721+0000","last_change":"2024-04-18T21:10:00.553114+0000","last_active":"2024-04-18T21:10:18.538721+0000","last_peered":"2024-04-18T21:10:18.538721+0000","last_clean":"2024-04-18T21:10:18.538721+0000","last_became_active":"2024-04-18T21:10:00.552067+0000","last_became_peered":"2024-04-18T21:10:00.552067+0000","last_unstale":"2024-04-18T21:10:18.538721+0000","last_undegraded":"2024-04-18T21:10:18.538721+0000","last_fullsized":"2024-04-18T21:10:18.538721+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:51:32.567297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"71'345","reported_seq":540,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.522506+0000","last_change":"2024-04-18T21:05:05.624840+0000","last_active":"2024-04-18T21:10:17.522506+0000","last_peered":"2024-04-18T21:10:17.522506+0000","last_clean":"2024-04-18T21:10:17.522506+0000","last_became_active":"2024-04-18T21:05:05.622950+0000","last_became_peered":"2024-04-18T21:05:05.622950+0000","last_unstale":"2024-04-18T21:10:17.522506+0000","last_undegraded":"2024-04-18T21:10:17.522506+0000","last_fullsized":"2024-04-18T21:10:17.522506+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:27:17.530889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":317,"num_write_kb":29335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"70'171","reported_seq":280,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.521368+0000","last_change":"2024-04-18T21:10:00.507624+0000","last_active":"2024-04-18T21:10:17.521368+0000","last_peered":"2024-04-18T21:10:17.521368+0000","last_clean":"2024-04-18T21:10:17.521368+0000","last_became_active":"2024-04-18T21:10:00.507132+0000","last_became_peered":"2024-04-18T21:10:00.507132+0000","last_unstale":"2024-04-18T21:10:17.521368+0000","last_undegraded":"2024-04-18T21:10:17.521368+0000","last_fullsized":"2024-04-18T21:10:17.521368+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:35:50.013019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":4154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"71'417","reported_seq":637,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.521019+0000","last_change":"2024-04-18T21:05:05.627962+0000","last_active":"2024-04-18T21:10:17.521019+0000","last_peered":"2024-04-18T21:10:17.521019+0000","last_clean":"2024-04-18T21:10:17.521019+0000","last_became_active":"2024-04-18T21:05:05.626698+0000","last_became_peered":"2024-04-18T21:05:05.626698+0000","last_unstale":"2024-04-18T21:10:17.521019+0000","last_undegraded":"2024-04-18T21:10:17.521019+0000","last_fullsized":"2024-04-18T21:10:17.521019+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:48:48.973087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":17040,"num_write":384,"num_write_kb":83740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"70'276","reported_seq":467,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.538991+0000","last_change":"2024-04-18T21:09:53.543611+0000","last_active":"2024-04-18T21:10:18.538991+0000","last_peered":"2024-04-18T21:10:18.538991+0000","last_clean":"2024-04-18T21:10:18.538991+0000","last_became_active":"2024-04-18T21:09:53.542863+0000","last_became_peered":"2024-04-18T21:09:53.542863+0000","last_unstale":"2024-04-18T21:10:18.538991+0000","last_undegraded":"2024-04-18T21:10:18.538991+0000","last_fullsized":"2024-04-18T21:10:18.538991+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:22.582074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":12399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"71'428","reported_seq":633,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-18T21:10:18.538378+0000","last_change":"2024-04-18T21:10:08.541152+0000","last_active":"2024-04-18T21:10:18.538378+0000","last_peered":"2024-04-18T21:10:18.538378+0000","last_clean":"2024-04-18T21:10:18.538378+0000","last_became_active":"2024-04-18T21:10:08.536423+0000","last_became_peered":"2024-04-18T21:10:08.536423+0000","last_unstale":"2024-04-18T21:10:18.538378+0000","last_undegraded":"2024-04-18T21:10:18.538378+0000","last_fullsized":"2024-04-18T21:10:18.538378+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:26.666677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22548,"num_write":398,"num_write_kb":75972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"70'70","reported_seq":267,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.523265+0000","last_change":"2024-04-18T21:09:50.833350+0000","last_active":"2024-04-18T21:10:17.523265+0000","last_peered":"2024-04-18T21:10:17.523265+0000","last_clean":"2024-04-18T21:10:17.523265+0000","last_became_active":"2024-04-18T21:09:50.832355+0000","last_became_peered":"2024-04-18T21:09:50.832355+0000","last_unstale":"2024-04-18T21:10:17.523265+0000","last_undegraded":"2024-04-18T21:10:17.523265+0000","last_fullsized":"2024-04-18T21:10:17.523265+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:39:09.627425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'459","reported_seq":636,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.520752+0000","last_change":"2024-04-18T21:10:01.503378+0000","last_active":"2024-04-18T21:10:17.520752+0000","last_peered":"2024-04-18T21:10:17.520752+0000","last_clean":"2024-04-18T21:10:17.520752+0000","last_became_active":"2024-04-18T21:10:01.497275+0000","last_became_peered":"2024-04-18T21:10:01.497275+0000","last_unstale":"2024-04-18T21:10:17.520752+0000","last_undegraded":"2024-04-18T21:10:17.520752+0000","last_fullsized":"2024-04-18T21:10:17.520752+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:40:35.832428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13353,"num_write":429,"num_write_kb":88123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"70'113","reported_seq":326,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-18T21:10:17.522452+0000","last_change":"2024-04-18T21:10:00.499468+0000","last_active":"2024-04-18T21:10:17.522452+0000","last_peered":"2024-04-18T21:10:17.522452+0000","last_clean":"2024-04-18T21:10:17.522452+0000","last_became_active":"2024-04-18T21:10:00.494734+0000","last_became_peered":"2024-04-18T21:10:00.494734+0000","last_unstale":"2024-04-18T21:10:17.522452+0000","last_undegraded":"2024-04-18T21:10:17.522452+0000","last_fullsized":"2024-04-18T21:10:17.522452+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:58:34.790588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194886,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2531,"num_read_kb":1304649,"num_write":24542,"num_write_kb":4299443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7840,"num_bytes_recovered":4488063,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26603,"ondisk_log_size":26603,"up":128,"acting":126,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127139127,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":55,"num_read_kb":1405,"num_write":4542,"num_write_kb":127514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":92002768,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":279527424,"data_stored":279444842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4409,"internal_metadata":0},"log_size":6331,"ondisk_log_size":6331,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738438,"num_pgs":84,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":208604,"kb_used_data":105292,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94163236,"statfs":{"total":96636764160,"available":96423153664,"internally_reserved":0,"allocated":107819008,"data_stored":107220435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":77,"seq":330712481800,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":147544,"kb_used_data":83660,"kb_used_omap":5,"kb_used_meta":63866,"kb_avail":94224296,"statfs":{"total":96636764160,"available":96485679104,"internally_reserved":0,"allocated":85667840,"data_stored":84991104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6004,"internal_metadata":65398924},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738436,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":160444,"kb_used_data":89072,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94211396,"statfs":{"total":96636764160,"available":96472469504,"internally_reserved":0,"allocated":91209728,"data_stored":90605523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":89579520,"data_stored":89548273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":83750912,"data_stored":83729052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4409,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106196992,"data_stored":106167517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:10:24.950 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:10:25.272 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:10:25.273 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-04-18T21:10:25.288 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":272,"stamp":"2024-04-18T21:10:24.639147+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127729495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2722,"num_read_kb":1306172,"num_write":29287,"num_write_kb":4430417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8182,"num_bytes_recovered":97081199,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33091,"ondisk_log_size":33091,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":495392,"kb_used_data":252652,"kb_used_omap":8,"kb_used_meta":242679,"kb_avail":282620128,"statfs":{"total":289910292480,"available":289403011072,"internally_reserved":0,"allocated":258715648,"data_stored":256897949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9194,"internal_metadata":248503318},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-758,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1054,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.165240"},"pg_stats":[{"pgid":"4.3f","version":"71'418","reported_seq":614,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.548813+0000","last_change":"2024-04-18T21:10:16.576720+0000","last_active":"2024-04-18T21:10:20.548813+0000","last_peered":"2024-04-18T21:10:20.548813+0000","last_clean":"2024-04-18T21:10:20.548813+0000","last_became_active":"2024-04-18T21:10:16.571985+0000","last_became_peered":"2024-04-18T21:10:16.571985+0000","last_unstale":"2024-04-18T21:10:20.548813+0000","last_undegraded":"2024-04-18T21:10:20.548813+0000","last_fullsized":"2024-04-18T21:10:20.548813+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:28:48.196628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":19677,"num_write":386,"num_write_kb":87615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"71'417","reported_seq":631,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.548242+0000","last_change":"2024-04-18T21:10:05.546965+0000","last_active":"2024-04-18T21:10:20.548242+0000","last_peered":"2024-04-18T21:10:20.548242+0000","last_clean":"2024-04-18T21:10:20.548242+0000","last_became_active":"2024-04-18T21:10:05.541170+0000","last_became_peered":"2024-04-18T21:10:05.541170+0000","last_unstale":"2024-04-18T21:10:20.548242+0000","last_undegraded":"2024-04-18T21:10:20.548242+0000","last_fullsized":"2024-04-18T21:10:20.548242+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:04:05.630763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":12123,"num_write":387,"num_write_kb":47157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"71'379","reported_seq":940,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483812+0000","last_change":"2024-04-18T21:09:54.480753+0000","last_active":"2024-04-18T21:10:20.483812+0000","last_peered":"2024-04-18T21:10:20.483812+0000","last_clean":"2024-04-18T21:10:20.483812+0000","last_became_active":"2024-04-18T21:09:54.478020+0000","last_became_peered":"2024-04-18T21:09:54.478020+0000","last_unstale":"2024-04-18T21:10:20.483812+0000","last_undegraded":"2024-04-18T21:10:20.483812+0000","last_fullsized":"2024-04-18T21:10:20.483812+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:24:18.705477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":10040,"num_write":353,"num_write_kb":63202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'372","reported_seq":574,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483063+0000","last_change":"2024-04-18T21:05:05.629321+0000","last_active":"2024-04-18T21:10:20.483063+0000","last_peered":"2024-04-18T21:10:20.483063+0000","last_clean":"2024-04-18T21:10:20.483063+0000","last_became_active":"2024-04-18T21:05:05.627956+0000","last_became_peered":"2024-04-18T21:05:05.627956+0000","last_unstale":"2024-04-18T21:10:20.483063+0000","last_undegraded":"2024-04-18T21:10:20.483063+0000","last_fullsized":"2024-04-18T21:10:20.483063+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:15:28.458476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2735,"num_write":328,"num_write_kb":22107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"71'416","reported_seq":616,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546812+0000","last_change":"2024-04-18T21:10:00.560644+0000","last_active":"2024-04-18T21:10:20.546812+0000","last_peered":"2024-04-18T21:10:20.546812+0000","last_clean":"2024-04-18T21:10:20.546812+0000","last_became_active":"2024-04-18T21:10:00.553862+0000","last_became_peered":"2024-04-18T21:10:00.553862+0000","last_unstale":"2024-04-18T21:10:20.546812+0000","last_undegraded":"2024-04-18T21:10:20.546812+0000","last_fullsized":"2024-04-18T21:10:20.546812+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:11:49.688538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6533,"num_write":389,"num_write_kb":43666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"71'374","reported_seq":574,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482584+0000","last_change":"2024-04-18T21:10:01.495684+0000","last_active":"2024-04-18T21:10:20.482584+0000","last_peered":"2024-04-18T21:10:20.482584+0000","last_clean":"2024-04-18T21:10:20.482584+0000","last_became_active":"2024-04-18T21:10:01.486640+0000","last_became_peered":"2024-04-18T21:10:01.486640+0000","last_unstale":"2024-04-18T21:10:20.482584+0000","last_undegraded":"2024-04-18T21:10:20.482584+0000","last_fullsized":"2024-04-18T21:10:20.482584+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:39:10.639381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20415,"num_write":354,"num_write_kb":34462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'418","reported_seq":652,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482999+0000","last_change":"2024-04-18T21:05:05.625047+0000","last_active":"2024-04-18T21:10:20.482999+0000","last_peered":"2024-04-18T21:10:20.482999+0000","last_clean":"2024-04-18T21:10:20.482999+0000","last_became_active":"2024-04-18T21:05:05.622781+0000","last_became_peered":"2024-04-18T21:05:05.622781+0000","last_unstale":"2024-04-18T21:10:20.482999+0000","last_undegraded":"2024-04-18T21:10:20.482999+0000","last_fullsized":"2024-04-18T21:10:20.482999+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:12.944469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21103,"num_write":385,"num_write_kb":50678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"71'399","reported_seq":638,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.481939+0000","last_change":"2024-04-18T21:10:00.495543+0000","last_active":"2024-04-18T21:10:20.481939+0000","last_peered":"2024-04-18T21:10:20.481939+0000","last_clean":"2024-04-18T21:10:20.481939+0000","last_became_active":"2024-04-18T21:10:00.488705+0000","last_became_peered":"2024-04-18T21:10:00.488705+0000","last_unstale":"2024-04-18T21:10:20.481939+0000","last_undegraded":"2024-04-18T21:10:20.481939+0000","last_fullsized":"2024-04-18T21:10:20.481939+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:11.892092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":44692,"num_write":361,"num_write_kb":105170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"71'385","reported_seq":950,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.479921+0000","last_change":"2024-04-18T21:10:06.487113+0000","last_active":"2024-04-18T21:10:20.479921+0000","last_peered":"2024-04-18T21:10:20.479921+0000","last_clean":"2024-04-18T21:10:20.479921+0000","last_became_active":"2024-04-18T21:10:06.482087+0000","last_became_peered":"2024-04-18T21:10:06.482087+0000","last_unstale":"2024-04-18T21:10:20.479921+0000","last_undegraded":"2024-04-18T21:10:20.479921+0000","last_fullsized":"2024-04-18T21:10:20.479921+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:10:51.435131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":994,"num_write":358,"num_write_kb":25964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'409","reported_seq":644,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546781+0000","last_change":"2024-04-18T21:10:12.550697+0000","last_active":"2024-04-18T21:10:20.546781+0000","last_peered":"2024-04-18T21:10:20.546781+0000","last_clean":"2024-04-18T21:10:20.546781+0000","last_became_active":"2024-04-18T21:10:12.546621+0000","last_became_peered":"2024-04-18T21:10:12.546621+0000","last_unstale":"2024-04-18T21:10:20.546781+0000","last_undegraded":"2024-04-18T21:10:20.546781+0000","last_fullsized":"2024-04-18T21:10:20.546781+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:55:30.422126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":26170,"num_write":372,"num_write_kb":83931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"71'366","reported_seq":577,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483819+0000","last_change":"2024-04-18T21:10:01.496068+0000","last_active":"2024-04-18T21:10:20.483819+0000","last_peered":"2024-04-18T21:10:20.483819+0000","last_clean":"2024-04-18T21:10:20.483819+0000","last_became_active":"2024-04-18T21:10:01.488047+0000","last_became_peered":"2024-04-18T21:10:01.488047+0000","last_unstale":"2024-04-18T21:10:20.483819+0000","last_undegraded":"2024-04-18T21:10:20.483819+0000","last_fullsized":"2024-04-18T21:10:20.483819+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:49.957286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":18907,"num_write":347,"num_write_kb":26153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"71'346","reported_seq":549,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547957+0000","last_change":"2024-04-18T21:10:00.560349+0000","last_active":"2024-04-18T21:10:20.547957+0000","last_peered":"2024-04-18T21:10:20.547957+0000","last_clean":"2024-04-18T21:10:20.547957+0000","last_became_active":"2024-04-18T21:10:00.557412+0000","last_became_peered":"2024-04-18T21:10:00.557412+0000","last_unstale":"2024-04-18T21:10:20.547957+0000","last_undegraded":"2024-04-18T21:10:20.547957+0000","last_fullsized":"2024-04-18T21:10:20.547957+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:54:33.428937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":6245,"num_write":324,"num_write_kb":37970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"71'417","reported_seq":638,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547313+0000","last_change":"2024-04-18T21:10:02.555899+0000","last_active":"2024-04-18T21:10:20.547313+0000","last_peered":"2024-04-18T21:10:20.547313+0000","last_clean":"2024-04-18T21:10:20.547313+0000","last_became_active":"2024-04-18T21:10:02.551406+0000","last_became_peered":"2024-04-18T21:10:02.551406+0000","last_unstale":"2024-04-18T21:10:20.547313+0000","last_undegraded":"2024-04-18T21:10:20.547313+0000","last_fullsized":"2024-04-18T21:10:20.547313+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:41:17.455669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":21623,"num_write":381,"num_write_kb":71306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"71'398","reported_seq":977,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482881+0000","last_change":"2024-04-18T21:10:11.491565+0000","last_active":"2024-04-18T21:10:20.482881+0000","last_peered":"2024-04-18T21:10:20.482881+0000","last_clean":"2024-04-18T21:10:20.482881+0000","last_became_active":"2024-04-18T21:10:11.486593+0000","last_became_peered":"2024-04-18T21:10:11.486593+0000","last_unstale":"2024-04-18T21:10:20.482881+0000","last_undegraded":"2024-04-18T21:10:20.482881+0000","last_fullsized":"2024-04-18T21:10:20.482881+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:11:23.853682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":369,"num_write_kb":30006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'435","reported_seq":1102,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482470+0000","last_change":"2024-04-18T21:10:15.509238+0000","last_active":"2024-04-18T21:10:20.482470+0000","last_peered":"2024-04-18T21:10:20.482470+0000","last_clean":"2024-04-18T21:10:20.482470+0000","last_became_active":"2024-04-18T21:10:15.506328+0000","last_became_peered":"2024-04-18T21:10:15.506328+0000","last_unstale":"2024-04-18T21:10:20.482470+0000","last_undegraded":"2024-04-18T21:10:20.482470+0000","last_fullsized":"2024-04-18T21:10:20.482470+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:49:44.996311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":31523,"num_write":402,"num_write_kb":121466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":346,"num_bytes_recovered":410327,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'446","reported_seq":687,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482015+0000","last_change":"2024-04-18T21:05:05.638203+0000","last_active":"2024-04-18T21:10:20.482015+0000","last_peered":"2024-04-18T21:10:20.482015+0000","last_clean":"2024-04-18T21:10:20.482015+0000","last_became_active":"2024-04-18T21:05:05.637352+0000","last_became_peered":"2024-04-18T21:05:05.637352+0000","last_unstale":"2024-04-18T21:10:20.482015+0000","last_undegraded":"2024-04-18T21:10:20.482015+0000","last_fullsized":"2024-04-18T21:10:20.482015+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":23833,"num_write":418,"num_write_kb":59679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"71'403","reported_seq":956,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.490427+0000","last_change":"2024-04-18T21:10:20.490427+0000","last_active":"2024-04-18T21:10:20.490427+0000","last_peered":"2024-04-18T21:10:20.490427+0000","last_clean":"2024-04-18T21:10:20.490427+0000","last_became_active":"2024-04-18T21:10:20.487409+0000","last_became_peered":"2024-04-18T21:10:20.487409+0000","last_unstale":"2024-04-18T21:10:20.490427+0000","last_undegraded":"2024-04-18T21:10:20.490427+0000","last_fullsized":"2024-04-18T21:10:20.490427+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:22:40.301941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":7482,"num_write":371,"num_write_kb":25957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'406","reported_seq":606,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.548073+0000","last_change":"2024-04-18T21:10:10.547457+0000","last_active":"2024-04-18T21:10:20.548073+0000","last_peered":"2024-04-18T21:10:20.548073+0000","last_clean":"2024-04-18T21:10:20.548073+0000","last_became_active":"2024-04-18T21:10:10.542594+0000","last_became_peered":"2024-04-18T21:10:10.542594+0000","last_unstale":"2024-04-18T21:10:20.548073+0000","last_undegraded":"2024-04-18T21:10:20.548073+0000","last_fullsized":"2024-04-18T21:10:20.548073+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:51:58.437990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":27987,"num_write":365,"num_write_kb":38689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"71'470","reported_seq":1142,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.479779+0000","last_change":"2024-04-18T21:10:17.535574+0000","last_active":"2024-04-18T21:10:20.479779+0000","last_peered":"2024-04-18T21:10:20.479779+0000","last_clean":"2024-04-18T21:10:20.479779+0000","last_became_active":"2024-04-18T21:10:17.529957+0000","last_became_peered":"2024-04-18T21:10:17.529957+0000","last_unstale":"2024-04-18T21:10:20.479779+0000","last_undegraded":"2024-04-18T21:10:20.479779+0000","last_fullsized":"2024-04-18T21:10:20.479779+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:06:00.648089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":59273,"num_write":432,"num_write_kb":145930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'433","reported_seq":635,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483362+0000","last_change":"2024-04-18T21:05:05.638338+0000","last_active":"2024-04-18T21:10:20.483362+0000","last_peered":"2024-04-18T21:10:20.483362+0000","last_clean":"2024-04-18T21:10:20.483362+0000","last_became_active":"2024-04-18T21:05:05.637567+0000","last_became_peered":"2024-04-18T21:05:05.637567+0000","last_unstale":"2024-04-18T21:10:20.483362+0000","last_undegraded":"2024-04-18T21:10:20.483362+0000","last_fullsized":"2024-04-18T21:10:20.483362+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5514,"num_write":403,"num_write_kb":26329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"71'418","reported_seq":661,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482880+0000","last_change":"2024-04-18T21:05:05.643606+0000","last_active":"2024-04-18T21:10:20.482880+0000","last_peered":"2024-04-18T21:10:20.482880+0000","last_clean":"2024-04-18T21:10:20.482880+0000","last_became_active":"2024-04-18T21:05:05.642991+0000","last_became_peered":"2024-04-18T21:05:05.642991+0000","last_unstale":"2024-04-18T21:10:20.482880+0000","last_undegraded":"2024-04-18T21:10:20.482880+0000","last_fullsized":"2024-04-18T21:10:20.482880+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:01.841786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":29097,"num_write":386,"num_write_kb":88262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"71'479","reported_seq":722,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546721+0000","last_change":"2024-04-18T21:10:07.549995+0000","last_active":"2024-04-18T21:10:20.546721+0000","last_peered":"2024-04-18T21:10:20.546721+0000","last_clean":"2024-04-18T21:10:20.546721+0000","last_became_active":"2024-04-18T21:10:07.544314+0000","last_became_peered":"2024-04-18T21:10:07.544314+0000","last_unstale":"2024-04-18T21:10:20.546721+0000","last_undegraded":"2024-04-18T21:10:20.546721+0000","last_fullsized":"2024-04-18T21:10:20.546721+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:52:34.340348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":24204,"num_write":452,"num_write_kb":114184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"71'407","reported_seq":637,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.477533+0000","last_change":"2024-04-18T21:10:03.487961+0000","last_active":"2024-04-18T21:10:20.477533+0000","last_peered":"2024-04-18T21:10:20.477533+0000","last_clean":"2024-04-18T21:10:20.477533+0000","last_became_active":"2024-04-18T21:10:03.476552+0000","last_became_peered":"2024-04-18T21:10:03.476552+0000","last_unstale":"2024-04-18T21:10:20.477533+0000","last_undegraded":"2024-04-18T21:10:20.477533+0000","last_fullsized":"2024-04-18T21:10:20.477533+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:45:35.774025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":37766,"num_write":374,"num_write_kb":103984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'452","reported_seq":653,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546024+0000","last_change":"2024-04-18T21:10:18.547982+0000","last_active":"2024-04-18T21:10:20.546024+0000","last_peered":"2024-04-18T21:10:20.546024+0000","last_clean":"2024-04-18T21:10:20.546024+0000","last_became_active":"2024-04-18T21:10:18.542189+0000","last_became_peered":"2024-04-18T21:10:18.542189+0000","last_unstale":"2024-04-18T21:10:20.546024+0000","last_undegraded":"2024-04-18T21:10:20.546024+0000","last_fullsized":"2024-04-18T21:10:20.546024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:49.761650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27170,"num_write":421,"num_write_kb":39548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"71'427","reported_seq":634,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.548342+0000","last_change":"2024-04-18T21:10:03.544910+0000","last_active":"2024-04-18T21:10:20.548342+0000","last_peered":"2024-04-18T21:10:20.548342+0000","last_clean":"2024-04-18T21:10:20.548342+0000","last_became_active":"2024-04-18T21:10:03.539961+0000","last_became_peered":"2024-04-18T21:10:03.539961+0000","last_unstale":"2024-04-18T21:10:20.548342+0000","last_undegraded":"2024-04-18T21:10:20.548342+0000","last_fullsized":"2024-04-18T21:10:20.548342+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:06:34.839228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":11507,"num_write":407,"num_write_kb":50964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"71'471","reported_seq":697,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.479964+0000","last_change":"2024-04-18T21:05:05.649581+0000","last_active":"2024-04-18T21:10:20.479964+0000","last_peered":"2024-04-18T21:10:20.479964+0000","last_clean":"2024-04-18T21:10:20.479964+0000","last_became_active":"2024-04-18T21:05:05.648233+0000","last_became_peered":"2024-04-18T21:05:05.648233+0000","last_unstale":"2024-04-18T21:10:20.479964+0000","last_undegraded":"2024-04-18T21:10:20.479964+0000","last_fullsized":"2024-04-18T21:10:20.479964+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20857,"num_write":431,"num_write_kb":63677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'378","reported_seq":940,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.484277+0000","last_change":"2024-04-18T21:09:55.493655+0000","last_active":"2024-04-18T21:10:20.484277+0000","last_peered":"2024-04-18T21:10:20.484277+0000","last_clean":"2024-04-18T21:10:20.484277+0000","last_became_active":"2024-04-18T21:09:55.490958+0000","last_became_peered":"2024-04-18T21:09:55.490958+0000","last_unstale":"2024-04-18T21:10:20.484277+0000","last_undegraded":"2024-04-18T21:10:20.484277+0000","last_fullsized":"2024-04-18T21:10:20.484277+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:52:16.541697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12573,"num_write":347,"num_write_kb":34434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'410","reported_seq":639,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547904+0000","last_change":"2024-04-18T21:10:01.563947+0000","last_active":"2024-04-18T21:10:20.547904+0000","last_peered":"2024-04-18T21:10:20.547904+0000","last_clean":"2024-04-18T21:10:20.547904+0000","last_became_active":"2024-04-18T21:10:01.555367+0000","last_became_peered":"2024-04-18T21:10:01.555367+0000","last_unstale":"2024-04-18T21:10:20.547904+0000","last_undegraded":"2024-04-18T21:10:20.547904+0000","last_fullsized":"2024-04-18T21:10:20.547904+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:01:09.418419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":16926,"num_write":380,"num_write_kb":112804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"71'410","reported_seq":991,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.478607+0000","last_change":"2024-04-18T21:10:03.490605+0000","last_active":"2024-04-18T21:10:20.478607+0000","last_peered":"2024-04-18T21:10:20.478607+0000","last_clean":"2024-04-18T21:10:20.478607+0000","last_became_active":"2024-04-18T21:10:03.480985+0000","last_became_peered":"2024-04-18T21:10:03.480985+0000","last_unstale":"2024-04-18T21:10:20.478607+0000","last_undegraded":"2024-04-18T21:10:20.478607+0000","last_fullsized":"2024-04-18T21:10:20.478607+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:14:42.076110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":34811,"num_write":378,"num_write_kb":51242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'491","reported_seq":709,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546384+0000","last_change":"2024-04-18T21:10:08.546388+0000","last_active":"2024-04-18T21:10:20.546384+0000","last_peered":"2024-04-18T21:10:20.546384+0000","last_clean":"2024-04-18T21:10:20.546384+0000","last_became_active":"2024-04-18T21:10:08.540487+0000","last_became_peered":"2024-04-18T21:10:08.540487+0000","last_unstale":"2024-04-18T21:10:20.546384+0000","last_undegraded":"2024-04-18T21:10:20.546384+0000","last_fullsized":"2024-04-18T21:10:20.546384+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:15:51.120517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":26902,"num_write":456,"num_write_kb":124778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":209,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"71'467","reported_seq":1079,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.477750+0000","last_change":"2024-04-18T21:10:19.483012+0000","last_active":"2024-04-18T21:10:20.477750+0000","last_peered":"2024-04-18T21:10:20.477750+0000","last_clean":"2024-04-18T21:10:20.477750+0000","last_became_active":"2024-04-18T21:10:19.480002+0000","last_became_peered":"2024-04-18T21:10:19.480002+0000","last_unstale":"2024-04-18T21:10:20.477750+0000","last_undegraded":"2024-04-18T21:10:20.477750+0000","last_fullsized":"2024-04-18T21:10:20.477750+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:51:24.488873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":28114,"num_write":434,"num_write_kb":129325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'423","reported_seq":595,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482361+0000","last_change":"2024-04-18T21:10:01.499421+0000","last_active":"2024-04-18T21:10:20.482361+0000","last_peered":"2024-04-18T21:10:20.482361+0000","last_clean":"2024-04-18T21:10:20.482361+0000","last_became_active":"2024-04-18T21:10:01.487074+0000","last_became_peered":"2024-04-18T21:10:01.487074+0000","last_unstale":"2024-04-18T21:10:20.482361+0000","last_undegraded":"2024-04-18T21:10:20.482361+0000","last_fullsized":"2024-04-18T21:10:20.482361+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:05:34.827814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8244,"num_write":393,"num_write_kb":58692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"71'389","reported_seq":618,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547175+0000","last_change":"2024-04-18T21:09:58.542232+0000","last_active":"2024-04-18T21:10:20.547175+0000","last_peered":"2024-04-18T21:10:20.547175+0000","last_clean":"2024-04-18T21:10:20.547175+0000","last_became_active":"2024-04-18T21:09:58.537723+0000","last_became_peered":"2024-04-18T21:09:58.537723+0000","last_unstale":"2024-04-18T21:10:20.547175+0000","last_undegraded":"2024-04-18T21:10:20.547175+0000","last_fullsized":"2024-04-18T21:10:20.547175+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:26.786170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":24216,"num_write":349,"num_write_kb":43176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"70'425","reported_seq":621,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483524+0000","last_change":"2024-04-18T21:05:04.632748+0000","last_active":"2024-04-18T21:10:20.483524+0000","last_peered":"2024-04-18T21:10:20.483524+0000","last_clean":"2024-04-18T21:10:20.483524+0000","last_became_active":"2024-04-18T21:05:04.628407+0000","last_became_peered":"2024-04-18T21:05:04.628407+0000","last_unstale":"2024-04-18T21:10:20.483524+0000","last_undegraded":"2024-04-18T21:10:20.483524+0000","last_fullsized":"2024-04-18T21:10:20.483524+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:42:45.392908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":375,"num_write_kb":8348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"71'423","reported_seq":623,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547197+0000","last_change":"2024-04-18T21:10:14.556066+0000","last_active":"2024-04-18T21:10:20.547197+0000","last_peered":"2024-04-18T21:10:20.547197+0000","last_clean":"2024-04-18T21:10:20.547197+0000","last_became_active":"2024-04-18T21:10:14.551249+0000","last_became_peered":"2024-04-18T21:10:14.551249+0000","last_unstale":"2024-04-18T21:10:20.547197+0000","last_undegraded":"2024-04-18T21:10:20.547197+0000","last_fullsized":"2024-04-18T21:10:20.547197+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:06:06.045278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":20096,"num_write":381,"num_write_kb":76351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"70'56","reported_seq":264,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.478297+0000","last_change":"2024-04-18T21:10:00.500122+0000","last_active":"2024-04-18T21:10:20.478297+0000","last_peered":"2024-04-18T21:10:20.478297+0000","last_clean":"2024-04-18T21:10:20.478297+0000","last_became_active":"2024-04-18T21:10:00.489486+0000","last_became_peered":"2024-04-18T21:10:00.489486+0000","last_unstale":"2024-04-18T21:10:20.478297+0000","last_undegraded":"2024-04-18T21:10:20.478297+0000","last_fullsized":"2024-04-18T21:10:20.478297+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:58:08.269558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'442","reported_seq":1026,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.480431+0000","last_change":"2024-04-18T21:10:03.492109+0000","last_active":"2024-04-18T21:10:20.480431+0000","last_peered":"2024-04-18T21:10:20.480431+0000","last_clean":"2024-04-18T21:10:20.480431+0000","last_became_active":"2024-04-18T21:10:03.483050+0000","last_became_peered":"2024-04-18T21:10:03.483050+0000","last_unstale":"2024-04-18T21:10:20.480431+0000","last_undegraded":"2024-04-18T21:10:20.480431+0000","last_fullsized":"2024-04-18T21:10:20.480431+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:45.388623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13827,"num_write":415,"num_write_kb":79859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"70'62","reported_seq":80,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546613+0000","last_change":"2024-04-18T21:09:50.868159+0000","last_active":"2024-04-18T21:10:20.546613+0000","last_peered":"2024-04-18T21:10:20.546613+0000","last_clean":"2024-04-18T21:10:20.546613+0000","last_became_active":"2024-04-18T21:09:50.867096+0000","last_became_peered":"2024-04-18T21:09:50.867096+0000","last_unstale":"2024-04-18T21:10:20.546613+0000","last_undegraded":"2024-04-18T21:10:20.546613+0000","last_fullsized":"2024-04-18T21:10:20.546613+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:09:57.047205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"71'398","reported_seq":639,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.479991+0000","last_change":"2024-04-18T21:10:01.498728+0000","last_active":"2024-04-18T21:10:20.479991+0000","last_peered":"2024-04-18T21:10:20.479991+0000","last_clean":"2024-04-18T21:10:20.479991+0000","last_became_active":"2024-04-18T21:10:01.495349+0000","last_became_peered":"2024-04-18T21:10:01.495349+0000","last_unstale":"2024-04-18T21:10:20.479991+0000","last_undegraded":"2024-04-18T21:10:20.479991+0000","last_fullsized":"2024-04-18T21:10:20.479991+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:01:48.618551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":17616,"num_write":360,"num_write_kb":58871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"70'66","reported_seq":181,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482413+0000","last_change":"2024-04-18T21:10:00.496701+0000","last_active":"2024-04-18T21:10:20.482413+0000","last_peered":"2024-04-18T21:10:20.482413+0000","last_clean":"2024-04-18T21:10:20.482413+0000","last_became_active":"2024-04-18T21:10:00.495594+0000","last_became_peered":"2024-04-18T21:10:00.495594+0000","last_unstale":"2024-04-18T21:10:20.482413+0000","last_undegraded":"2024-04-18T21:10:20.482413+0000","last_fullsized":"2024-04-18T21:10:20.482413+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:11:32.991308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"70'135","reported_seq":68,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.484770+0000","last_change":"2024-04-18T21:10:00.493197+0000","last_active":"2024-04-18T21:10:20.484770+0000","last_peered":"2024-04-18T21:10:20.484770+0000","last_clean":"2024-04-18T21:10:20.484770+0000","last_became_active":"2024-04-18T21:10:00.491509+0000","last_became_peered":"2024-04-18T21:10:00.491509+0000","last_unstale":"2024-04-18T21:10:20.484770+0000","last_undegraded":"2024-04-18T21:10:20.484770+0000","last_fullsized":"2024-04-18T21:10:20.484770+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:57:29.595389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":7777508,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'410","reported_seq":610,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547176+0000","last_change":"2024-04-18T21:10:06.553806+0000","last_active":"2024-04-18T21:10:20.547176+0000","last_peered":"2024-04-18T21:10:20.547176+0000","last_clean":"2024-04-18T21:10:20.547176+0000","last_became_active":"2024-04-18T21:10:06.548034+0000","last_became_peered":"2024-04-18T21:10:06.548034+0000","last_unstale":"2024-04-18T21:10:20.547176+0000","last_undegraded":"2024-04-18T21:10:20.547176+0000","last_fullsized":"2024-04-18T21:10:20.547176+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:20:56.265941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17055,"num_write":375,"num_write_kb":63331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"70'240","reported_seq":363,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547788+0000","last_change":"2024-04-18T21:10:00.556212+0000","last_active":"2024-04-18T21:10:20.547788+0000","last_peered":"2024-04-18T21:10:20.547788+0000","last_clean":"2024-04-18T21:10:20.547788+0000","last_became_active":"2024-04-18T21:10:00.555486+0000","last_became_peered":"2024-04-18T21:10:00.555486+0000","last_unstale":"2024-04-18T21:10:20.547788+0000","last_undegraded":"2024-04-18T21:10:20.547788+0000","last_fullsized":"2024-04-18T21:10:20.547788+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:11.573984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":4191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"71'501","reported_seq":719,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.545865+0000","last_change":"2024-04-18T21:10:17.593530+0000","last_active":"2024-04-18T21:10:20.545865+0000","last_peered":"2024-04-18T21:10:20.545865+0000","last_clean":"2024-04-18T21:10:20.545865+0000","last_became_active":"2024-04-18T21:10:17.588391+0000","last_became_peered":"2024-04-18T21:10:17.588391+0000","last_unstale":"2024-04-18T21:10:20.545865+0000","last_undegraded":"2024-04-18T21:10:20.545865+0000","last_fullsized":"2024-04-18T21:10:20.545865+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:26.079610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":37662,"num_write":474,"num_write_kb":167663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"70'429","reported_seq":566,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.484708+0000","last_change":"2024-04-18T21:10:00.493325+0000","last_active":"2024-04-18T21:10:20.484708+0000","last_peered":"2024-04-18T21:10:20.484708+0000","last_clean":"2024-04-18T21:10:20.484708+0000","last_became_active":"2024-04-18T21:10:00.491525+0000","last_became_peered":"2024-04-18T21:10:00.491525+0000","last_unstale":"2024-04-18T21:10:20.484708+0000","last_undegraded":"2024-04-18T21:10:20.484708+0000","last_fullsized":"2024-04-18T21:10:20.484708+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:27:59.637974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":377,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388678,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'440","reported_seq":650,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483219+0000","last_change":"2024-04-18T21:10:01.497932+0000","last_active":"2024-04-18T21:10:20.483219+0000","last_peered":"2024-04-18T21:10:20.483219+0000","last_clean":"2024-04-18T21:10:20.483219+0000","last_became_active":"2024-04-18T21:10:01.486740+0000","last_became_peered":"2024-04-18T21:10:01.486740+0000","last_unstale":"2024-04-18T21:10:20.483219+0000","last_undegraded":"2024-04-18T21:10:20.483219+0000","last_fullsized":"2024-04-18T21:10:20.483219+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:34:43.515471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":42138,"num_write":408,"num_write_kb":96310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"70'59","reported_seq":255,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.484055+0000","last_change":"2024-04-18T21:05:04.625520+0000","last_active":"2024-04-18T21:10:20.484055+0000","last_peered":"2024-04-18T21:10:20.484055+0000","last_clean":"2024-04-18T21:10:20.484055+0000","last_became_active":"2024-04-18T21:05:04.624656+0000","last_became_peered":"2024-04-18T21:05:04.624656+0000","last_unstale":"2024-04-18T21:10:20.484055+0000","last_undegraded":"2024-04-18T21:10:20.484055+0000","last_fullsized":"2024-04-18T21:10:20.484055+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:56:05.795125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"71'461","reported_seq":676,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.478291+0000","last_change":"2024-04-18T21:05:05.649406+0000","last_active":"2024-04-18T21:10:20.478291+0000","last_peered":"2024-04-18T21:10:20.478291+0000","last_clean":"2024-04-18T21:10:20.478291+0000","last_became_active":"2024-04-18T21:05:05.648380+0000","last_became_peered":"2024-04-18T21:05:05.648380+0000","last_unstale":"2024-04-18T21:10:20.478291+0000","last_undegraded":"2024-04-18T21:10:20.478291+0000","last_fullsized":"2024-04-18T21:10:20.478291+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12852,"num_write":420,"num_write_kb":88506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"70'157","reported_seq":376,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.478945+0000","last_change":"2024-04-18T21:10:00.500141+0000","last_active":"2024-04-18T21:10:20.478945+0000","last_peered":"2024-04-18T21:10:20.478945+0000","last_clean":"2024-04-18T21:10:20.478945+0000","last_became_active":"2024-04-18T21:10:00.494630+0000","last_became_peered":"2024-04-18T21:10:00.494630+0000","last_unstale":"2024-04-18T21:10:20.478945+0000","last_undegraded":"2024-04-18T21:10:20.478945+0000","last_fullsized":"2024-04-18T21:10:20.478945+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:49:43.984354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":8250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'445","reported_seq":635,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483682+0000","last_change":"2024-04-18T21:10:01.500937+0000","last_active":"2024-04-18T21:10:20.483682+0000","last_peered":"2024-04-18T21:10:20.483682+0000","last_clean":"2024-04-18T21:10:20.483682+0000","last_became_active":"2024-04-18T21:10:01.490691+0000","last_became_peered":"2024-04-18T21:10:01.490691+0000","last_unstale":"2024-04-18T21:10:20.483682+0000","last_undegraded":"2024-04-18T21:10:20.483682+0000","last_fullsized":"2024-04-18T21:10:20.483682+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:59:48.489145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17488,"num_write":410,"num_write_kb":50845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"70'124","reported_seq":320,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483416+0000","last_change":"2024-04-18T21:05:04.634674+0000","last_active":"2024-04-18T21:10:20.483416+0000","last_peered":"2024-04-18T21:10:20.483416+0000","last_clean":"2024-04-18T21:10:20.483416+0000","last_became_active":"2024-04-18T21:05:04.632284+0000","last_became_peered":"2024-04-18T21:05:04.632284+0000","last_unstale":"2024-04-18T21:10:20.483416+0000","last_undegraded":"2024-04-18T21:10:20.483416+0000","last_fullsized":"2024-04-18T21:10:20.483416+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:09:18.466987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"71'400","reported_seq":942,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.484448+0000","last_change":"2024-04-18T21:10:14.495223+0000","last_active":"2024-04-18T21:10:20.484448+0000","last_peered":"2024-04-18T21:10:20.484448+0000","last_clean":"2024-04-18T21:10:20.484448+0000","last_became_active":"2024-04-18T21:10:14.492039+0000","last_became_peered":"2024-04-18T21:10:14.492039+0000","last_unstale":"2024-04-18T21:10:20.484448+0000","last_undegraded":"2024-04-18T21:10:20.484448+0000","last_fullsized":"2024-04-18T21:10:20.484448+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:58:35.802545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12586,"num_write":372,"num_write_kb":58856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":350,"num_bytes_recovered":576854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"70'53","reported_seq":82,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.545791+0000","last_change":"2024-04-18T21:10:00.550936+0000","last_active":"2024-04-18T21:10:20.545791+0000","last_peered":"2024-04-18T21:10:20.545791+0000","last_clean":"2024-04-18T21:10:20.545791+0000","last_became_active":"2024-04-18T21:10:00.549987+0000","last_became_peered":"2024-04-18T21:10:00.549987+0000","last_unstale":"2024-04-18T21:10:20.545791+0000","last_undegraded":"2024-04-18T21:10:20.545791+0000","last_fullsized":"2024-04-18T21:10:20.545791+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:53:36.771516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"71'364","reported_seq":943,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.484401+0000","last_change":"2024-04-18T21:09:58.478726+0000","last_active":"2024-04-18T21:10:20.484401+0000","last_peered":"2024-04-18T21:10:20.484401+0000","last_clean":"2024-04-18T21:10:20.484401+0000","last_became_active":"2024-04-18T21:09:58.473903+0000","last_became_peered":"2024-04-18T21:09:58.473903+0000","last_unstale":"2024-04-18T21:10:20.484401+0000","last_undegraded":"2024-04-18T21:10:20.484401+0000","last_fullsized":"2024-04-18T21:10:20.484401+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:40.377274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":37938,"num_write":336,"num_write_kb":42513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"70'460","reported_seq":573,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546197+0000","last_change":"2024-04-18T21:09:53.545846+0000","last_active":"2024-04-18T21:10:20.546197+0000","last_peered":"2024-04-18T21:10:20.546197+0000","last_clean":"2024-04-18T21:10:20.546197+0000","last_became_active":"2024-04-18T21:09:53.544355+0000","last_became_peered":"2024-04-18T21:09:53.544355+0000","last_unstale":"2024-04-18T21:10:20.546197+0000","last_undegraded":"2024-04-18T21:10:20.546197+0000","last_fullsized":"2024-04-18T21:10:20.546197+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:34:16.776752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":406,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"71'404","reported_seq":978,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.480186+0000","last_change":"2024-04-18T21:10:15.507332+0000","last_active":"2024-04-18T21:10:20.480186+0000","last_peered":"2024-04-18T21:10:20.480186+0000","last_clean":"2024-04-18T21:10:20.480186+0000","last_became_active":"2024-04-18T21:10:15.504379+0000","last_became_peered":"2024-04-18T21:10:15.504379+0000","last_unstale":"2024-04-18T21:10:20.480186+0000","last_undegraded":"2024-04-18T21:10:20.480186+0000","last_fullsized":"2024-04-18T21:10:20.480186+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:33:14.728553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":7075,"num_write":367,"num_write_kb":62738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":383,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482924+0000","last_change":"2024-04-18T21:10:00.497960+0000","last_active":"2024-04-18T21:10:20.482924+0000","last_peered":"2024-04-18T21:10:20.482924+0000","last_clean":"2024-04-18T21:10:20.482924+0000","last_became_active":"2024-04-18T21:10:00.496373+0000","last_became_peered":"2024-04-18T21:10:00.496373+0000","last_unstale":"2024-04-18T21:10:20.482924+0000","last_undegraded":"2024-04-18T21:10:20.482924+0000","last_fullsized":"2024-04-18T21:10:20.482924+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_clean_scrub_stamp":"2024-04-18T21:04:53.494814+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:56:52.975720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":159,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483821+0000","last_change":"2024-04-18T21:10:00.487584+0000","last_active":"2024-04-18T21:10:20.483821+0000","last_peered":"2024-04-18T21:10:20.483821+0000","last_clean":"2024-04-18T21:10:20.483821+0000","last_became_active":"2024-04-18T21:10:00.486722+0000","last_became_peered":"2024-04-18T21:10:00.486722+0000","last_unstale":"2024-04-18T21:10:20.483821+0000","last_undegraded":"2024-04-18T21:10:20.483821+0000","last_fullsized":"2024-04-18T21:10:20.483821+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:17:03.176148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"70'595","reported_seq":750,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.478616+0000","last_change":"2024-04-18T21:10:03.488427+0000","last_active":"2024-04-18T21:10:20.478616+0000","last_peered":"2024-04-18T21:10:20.478616+0000","last_clean":"2024-04-18T21:10:20.478616+0000","last_became_active":"2024-04-18T21:10:03.481344+0000","last_became_peered":"2024-04-18T21:10:03.481344+0000","last_unstale":"2024-04-18T21:10:20.478616+0000","last_undegraded":"2024-04-18T21:10:20.478616+0000","last_fullsized":"2024-04-18T21:10:20.478616+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:41.583248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":539,"num_write_kb":8449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4689862,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'443","reported_seq":1089,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.484583+0000","last_change":"2024-04-18T21:09:56.496310+0000","last_active":"2024-04-18T21:10:20.484583+0000","last_peered":"2024-04-18T21:10:20.484583+0000","last_clean":"2024-04-18T21:10:20.484583+0000","last_became_active":"2024-04-18T21:09:56.493327+0000","last_became_peered":"2024-04-18T21:09:56.493327+0000","last_unstale":"2024-04-18T21:10:20.484583+0000","last_undegraded":"2024-04-18T21:10:20.484583+0000","last_fullsized":"2024-04-18T21:10:20.484583+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:20:57.340997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":38975,"num_write":404,"num_write_kb":80038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":209,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482719+0000","last_change":"2024-04-18T21:09:50.817029+0000","last_active":"2024-04-18T21:10:20.482719+0000","last_peered":"2024-04-18T21:10:20.482719+0000","last_clean":"2024-04-18T21:10:20.482719+0000","last_became_active":"2024-04-18T21:09:50.816543+0000","last_became_peered":"2024-04-18T21:09:50.816543+0000","last_unstale":"2024-04-18T21:10:20.482719+0000","last_undegraded":"2024-04-18T21:10:20.482719+0000","last_fullsized":"2024-04-18T21:10:20.482719+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:47:33.047727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"70'129","reported_seq":312,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.478205+0000","last_change":"2024-04-18T21:10:03.489109+0000","last_active":"2024-04-18T21:10:20.478205+0000","last_peered":"2024-04-18T21:10:20.478205+0000","last_clean":"2024-04-18T21:10:20.478205+0000","last_became_active":"2024-04-18T21:10:03.486859+0000","last_became_peered":"2024-04-18T21:10:03.486859+0000","last_unstale":"2024-04-18T21:10:20.478205+0000","last_undegraded":"2024-04-18T21:10:20.478205+0000","last_fullsized":"2024-04-18T21:10:20.478205+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:52:04.172480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466419,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":55,"num_read_kb":1405,"num_write":58,"num_write_kb":1469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'457","reported_seq":680,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.548347+0000","last_change":"2024-04-18T21:10:09.543207+0000","last_active":"2024-04-18T21:10:20.548347+0000","last_peered":"2024-04-18T21:10:20.548347+0000","last_clean":"2024-04-18T21:10:20.548347+0000","last_became_active":"2024-04-18T21:10:09.537428+0000","last_became_peered":"2024-04-18T21:10:09.537428+0000","last_unstale":"2024-04-18T21:10:20.548347+0000","last_undegraded":"2024-04-18T21:10:20.548347+0000","last_fullsized":"2024-04-18T21:10:20.548347+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:21.987918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":27659,"num_write":426,"num_write_kb":80500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":208,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.478812+0000","last_change":"2024-04-18T21:09:50.832624+0000","last_active":"2024-04-18T21:10:20.478812+0000","last_peered":"2024-04-18T21:10:20.478812+0000","last_clean":"2024-04-18T21:10:20.478812+0000","last_became_active":"2024-04-18T21:09:50.831949+0000","last_became_peered":"2024-04-18T21:09:50.831949+0000","last_unstale":"2024-04-18T21:10:20.478812+0000","last_undegraded":"2024-04-18T21:10:20.478812+0000","last_fullsized":"2024-04-18T21:10:20.478812+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:35:45.986029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'170","reported_seq":368,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.545538+0000","last_change":"2024-04-18T21:09:53.538615+0000","last_active":"2024-04-18T21:10:20.545538+0000","last_peered":"2024-04-18T21:10:20.545538+0000","last_clean":"2024-04-18T21:10:20.545538+0000","last_became_active":"2024-04-18T21:09:53.537994+0000","last_became_peered":"2024-04-18T21:09:53.537994+0000","last_unstale":"2024-04-18T21:10:20.545538+0000","last_undegraded":"2024-04-18T21:10:20.545538+0000","last_fullsized":"2024-04-18T21:10:20.545538+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:02:34.372453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":8239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"71'346","reported_seq":910,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.480273+0000","last_change":"2024-04-18T21:10:11.487541+0000","last_active":"2024-04-18T21:10:20.480273+0000","last_peered":"2024-04-18T21:10:20.480273+0000","last_clean":"2024-04-18T21:10:20.480273+0000","last_became_active":"2024-04-18T21:10:11.484662+0000","last_became_peered":"2024-04-18T21:10:11.484662+0000","last_unstale":"2024-04-18T21:10:20.480273+0000","last_undegraded":"2024-04-18T21:10:20.480273+0000","last_fullsized":"2024-04-18T21:10:20.480273+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:50:21.491862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27042,"num_write":321,"num_write_kb":50693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":202,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483512+0000","last_change":"2024-04-18T21:05:00.576606+0000","last_active":"2024-04-18T21:10:20.483512+0000","last_peered":"2024-04-18T21:10:20.483512+0000","last_clean":"2024-04-18T21:10:20.483512+0000","last_became_active":"2024-04-18T21:05:00.575951+0000","last_became_peered":"2024-04-18T21:05:00.575951+0000","last_unstale":"2024-04-18T21:10:20.483512+0000","last_undegraded":"2024-04-18T21:10:20.483512+0000","last_fullsized":"2024-04-18T21:10:20.483512+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:32:17.612481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"70'63","reported_seq":259,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483817+0000","last_change":"2024-04-18T21:05:04.627296+0000","last_active":"2024-04-18T21:10:20.483817+0000","last_peered":"2024-04-18T21:10:20.483817+0000","last_clean":"2024-04-18T21:10:20.483817+0000","last_became_active":"2024-04-18T21:05:04.626801+0000","last_became_peered":"2024-04-18T21:05:04.626801+0000","last_unstale":"2024-04-18T21:10:20.483817+0000","last_undegraded":"2024-04-18T21:10:20.483817+0000","last_fullsized":"2024-04-18T21:10:20.483817+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:46:36.285416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"71'406","reported_seq":1041,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.479242+0000","last_change":"2024-04-18T21:09:59.495686+0000","last_active":"2024-04-18T21:10:20.479242+0000","last_peered":"2024-04-18T21:10:20.479242+0000","last_clean":"2024-04-18T21:10:20.479242+0000","last_became_active":"2024-04-18T21:09:59.493248+0000","last_became_peered":"2024-04-18T21:09:59.493248+0000","last_unstale":"2024-04-18T21:10:20.479242+0000","last_undegraded":"2024-04-18T21:10:20.479242+0000","last_fullsized":"2024-04-18T21:10:20.479242+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:11:23.853682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":35332,"num_write":370,"num_write_kb":71807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"70'284","reported_seq":315,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.484852+0000","last_change":"2024-04-18T21:10:00.504958+0000","last_active":"2024-04-18T21:10:20.484852+0000","last_peered":"2024-04-18T21:10:20.484852+0000","last_clean":"2024-04-18T21:10:20.484852+0000","last_became_active":"2024-04-18T21:10:00.503851+0000","last_became_peered":"2024-04-18T21:10:00.503851+0000","last_unstale":"2024-04-18T21:10:20.484852+0000","last_undegraded":"2024-04-18T21:10:20.484852+0000","last_fullsized":"2024-04-18T21:10:20.484852+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:10:27.397258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":218,"num_write_kb":4194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":135,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.479497+0000","last_change":"2024-04-18T21:10:03.484148+0000","last_active":"2024-04-18T21:10:20.479497+0000","last_peered":"2024-04-18T21:10:20.479497+0000","last_clean":"2024-04-18T21:10:20.479497+0000","last_became_active":"2024-04-18T21:10:03.480071+0000","last_became_peered":"2024-04-18T21:10:03.480071+0000","last_unstale":"2024-04-18T21:10:20.479497+0000","last_undegraded":"2024-04-18T21:10:20.479497+0000","last_fullsized":"2024-04-18T21:10:20.479497+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:50:30.257039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'386","reported_seq":577,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546997+0000","last_change":"2024-04-18T21:10:10.547885+0000","last_active":"2024-04-18T21:10:20.546997+0000","last_peered":"2024-04-18T21:10:20.546997+0000","last_clean":"2024-04-18T21:10:20.546997+0000","last_became_active":"2024-04-18T21:10:10.542515+0000","last_became_peered":"2024-04-18T21:10:10.542515+0000","last_unstale":"2024-04-18T21:10:20.546997+0000","last_undegraded":"2024-04-18T21:10:20.546997+0000","last_fullsized":"2024-04-18T21:10:20.546997+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:58:24.232536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14677,"num_write":355,"num_write_kb":51018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"70'55","reported_seq":257,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.479390+0000","last_change":"2024-04-18T21:09:50.833424+0000","last_active":"2024-04-18T21:10:20.479390+0000","last_peered":"2024-04-18T21:10:20.479390+0000","last_clean":"2024-04-18T21:10:20.479390+0000","last_became_active":"2024-04-18T21:09:50.832752+0000","last_became_peered":"2024-04-18T21:09:50.832752+0000","last_unstale":"2024-04-18T21:10:20.479390+0000","last_undegraded":"2024-04-18T21:10:20.479390+0000","last_fullsized":"2024-04-18T21:10:20.479390+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:48.945329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":165,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.548117+0000","last_change":"2024-04-18T21:09:50.900338+0000","last_active":"2024-04-18T21:10:20.548117+0000","last_peered":"2024-04-18T21:10:20.548117+0000","last_clean":"2024-04-18T21:10:20.548117+0000","last_became_active":"2024-04-18T21:09:50.896844+0000","last_became_peered":"2024-04-18T21:09:50.896844+0000","last_unstale":"2024-04-18T21:10:20.548117+0000","last_undegraded":"2024-04-18T21:10:20.548117+0000","last_fullsized":"2024-04-18T21:10:20.548117+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:11:35.543409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"71'402","reported_seq":591,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546209+0000","last_change":"2024-04-18T21:10:05.542484+0000","last_active":"2024-04-18T21:10:20.546209+0000","last_peered":"2024-04-18T21:10:20.546209+0000","last_clean":"2024-04-18T21:10:20.546209+0000","last_became_active":"2024-04-18T21:10:05.536763+0000","last_became_peered":"2024-04-18T21:10:05.536763+0000","last_unstale":"2024-04-18T21:10:20.546209+0000","last_undegraded":"2024-04-18T21:10:20.546209+0000","last_fullsized":"2024-04-18T21:10:20.546209+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:08:22.367267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12468,"num_write":369,"num_write_kb":67231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"70'60","reported_seq":263,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.480741+0000","last_change":"2024-04-18T21:09:50.832598+0000","last_active":"2024-04-18T21:10:20.480741+0000","last_peered":"2024-04-18T21:10:20.480741+0000","last_clean":"2024-04-18T21:10:20.480741+0000","last_became_active":"2024-04-18T21:09:50.832030+0000","last_became_peered":"2024-04-18T21:09:50.832030+0000","last_unstale":"2024-04-18T21:10:20.480741+0000","last_undegraded":"2024-04-18T21:10:20.480741+0000","last_fullsized":"2024-04-18T21:10:20.480741+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:10:27.397258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":135,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.480666+0000","last_change":"2024-04-18T21:10:03.492761+0000","last_active":"2024-04-18T21:10:20.480666+0000","last_peered":"2024-04-18T21:10:20.480666+0000","last_clean":"2024-04-18T21:10:20.480666+0000","last_became_active":"2024-04-18T21:10:03.492145+0000","last_became_peered":"2024-04-18T21:10:03.492145+0000","last_unstale":"2024-04-18T21:10:20.480666+0000","last_undegraded":"2024-04-18T21:10:20.480666+0000","last_fullsized":"2024-04-18T21:10:20.480666+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:20:00.853523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'421","reported_seq":628,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.477954+0000","last_change":"2024-04-18T21:10:03.488774+0000","last_active":"2024-04-18T21:10:20.477954+0000","last_peered":"2024-04-18T21:10:20.477954+0000","last_clean":"2024-04-18T21:10:20.477954+0000","last_became_active":"2024-04-18T21:10:03.479773+0000","last_became_peered":"2024-04-18T21:10:03.479773+0000","last_unstale":"2024-04-18T21:10:20.477954+0000","last_undegraded":"2024-04-18T21:10:20.477954+0000","last_fullsized":"2024-04-18T21:10:20.477954+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:15:12.326904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":16183,"num_write":377,"num_write_kb":50451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"71'110","reported_seq":325,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.480498+0000","last_change":"2024-04-18T21:10:00.497917+0000","last_active":"2024-04-18T21:10:20.480498+0000","last_peered":"2024-04-18T21:10:20.480498+0000","last_clean":"2024-04-18T21:10:20.480498+0000","last_became_active":"2024-04-18T21:10:00.494644+0000","last_became_peered":"2024-04-18T21:10:00.494644+0000","last_unstale":"2024-04-18T21:10:20.480498+0000","last_undegraded":"2024-04-18T21:10:20.480498+0000","last_fullsized":"2024-04-18T21:10:20.480498+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:40:57.347353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":1251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":160,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.484841+0000","last_change":"2024-04-18T21:10:00.493764+0000","last_active":"2024-04-18T21:10:20.484841+0000","last_peered":"2024-04-18T21:10:20.484841+0000","last_clean":"2024-04-18T21:10:20.484841+0000","last_became_active":"2024-04-18T21:10:00.492672+0000","last_became_peered":"2024-04-18T21:10:00.492672+0000","last_unstale":"2024-04-18T21:10:20.484841+0000","last_undegraded":"2024-04-18T21:10:20.484841+0000","last_fullsized":"2024-04-18T21:10:20.484841+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:48:46.709401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'384","reported_seq":597,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546833+0000","last_change":"2024-04-18T21:09:57.572865+0000","last_active":"2024-04-18T21:10:20.546833+0000","last_peered":"2024-04-18T21:10:20.546833+0000","last_clean":"2024-04-18T21:10:20.546833+0000","last_became_active":"2024-04-18T21:09:57.567962+0000","last_became_peered":"2024-04-18T21:09:57.567962+0000","last_unstale":"2024-04-18T21:10:20.546833+0000","last_undegraded":"2024-04-18T21:10:20.546833+0000","last_fullsized":"2024-04-18T21:10:20.546833+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:51:24.627186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":15567,"num_write":351,"num_write_kb":42959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"71'396","reported_seq":924,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483421+0000","last_change":"2024-04-18T21:10:13.482151+0000","last_active":"2024-04-18T21:10:20.483421+0000","last_peered":"2024-04-18T21:10:20.483421+0000","last_clean":"2024-04-18T21:10:20.483421+0000","last_became_active":"2024-04-18T21:10:13.479320+0000","last_became_peered":"2024-04-18T21:10:13.479320+0000","last_unstale":"2024-04-18T21:10:20.483421+0000","last_undegraded":"2024-04-18T21:10:20.483421+0000","last_fullsized":"2024-04-18T21:10:20.483421+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:33:52.248167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12943,"num_write":353,"num_write_kb":35357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":342,"num_bytes_recovered":3500882,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"71'277","reported_seq":318,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483992+0000","last_change":"2024-04-18T21:10:00.495047+0000","last_active":"2024-04-18T21:10:20.483992+0000","last_peered":"2024-04-18T21:10:20.483992+0000","last_clean":"2024-04-18T21:10:20.483992+0000","last_became_active":"2024-04-18T21:10:00.493088+0000","last_became_peered":"2024-04-18T21:10:00.493088+0000","last_unstale":"2024-04-18T21:10:20.483992+0000","last_undegraded":"2024-04-18T21:10:20.483992+0000","last_fullsized":"2024-04-18T21:10:20.483992+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:39:08.263781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":221,"num_write_kb":8303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":8389370,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'411","reported_seq":1007,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.477964+0000","last_change":"2024-04-18T21:10:04.485332+0000","last_active":"2024-04-18T21:10:20.477964+0000","last_peered":"2024-04-18T21:10:20.477964+0000","last_clean":"2024-04-18T21:10:20.477964+0000","last_became_active":"2024-04-18T21:10:04.482320+0000","last_became_peered":"2024-04-18T21:10:04.482320+0000","last_unstale":"2024-04-18T21:10:20.477964+0000","last_undegraded":"2024-04-18T21:10:20.477964+0000","last_fullsized":"2024-04-18T21:10:20.477964+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:35:57.043682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":17179,"num_write":375,"num_write_kb":38991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"70'85","reported_seq":168,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547812+0000","last_change":"2024-04-18T21:09:50.890616+0000","last_active":"2024-04-18T21:10:20.547812+0000","last_peered":"2024-04-18T21:10:20.547812+0000","last_clean":"2024-04-18T21:10:20.547812+0000","last_became_active":"2024-04-18T21:09:50.874855+0000","last_became_peered":"2024-04-18T21:09:50.874855+0000","last_unstale":"2024-04-18T21:10:20.547812+0000","last_undegraded":"2024-04-18T21:10:20.547812+0000","last_fullsized":"2024-04-18T21:10:20.547812+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:03:54.726282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"70'230","reported_seq":259,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.484617+0000","last_change":"2024-04-18T21:10:00.499373+0000","last_active":"2024-04-18T21:10:20.484617+0000","last_peered":"2024-04-18T21:10:20.484617+0000","last_clean":"2024-04-18T21:10:20.484617+0000","last_became_active":"2024-04-18T21:10:00.498141+0000","last_became_peered":"2024-04-18T21:10:00.498141+0000","last_unstale":"2024-04-18T21:10:20.484617+0000","last_undegraded":"2024-04-18T21:10:20.484617+0000","last_fullsized":"2024-04-18T21:10:20.484617+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:55:01.865593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":4178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"71'493","reported_seq":732,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.477822+0000","last_change":"2024-04-18T21:05:05.642793+0000","last_active":"2024-04-18T21:10:20.477822+0000","last_peered":"2024-04-18T21:10:20.477822+0000","last_clean":"2024-04-18T21:10:20.477822+0000","last_became_active":"2024-04-18T21:05:05.641983+0000","last_became_peered":"2024-04-18T21:05:05.641983+0000","last_unstale":"2024-04-18T21:10:20.477822+0000","last_undegraded":"2024-04-18T21:10:20.477822+0000","last_fullsized":"2024-04-18T21:10:20.477822+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:46:36.339289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23833,"num_write":461,"num_write_kb":76873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"70'62","reported_seq":257,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.480547+0000","last_change":"2024-04-18T21:05:04.641445+0000","last_active":"2024-04-18T21:10:20.480547+0000","last_peered":"2024-04-18T21:10:20.480547+0000","last_clean":"2024-04-18T21:10:20.480547+0000","last_became_active":"2024-04-18T21:05:04.640682+0000","last_became_peered":"2024-04-18T21:05:04.640682+0000","last_unstale":"2024-04-18T21:10:20.480547+0000","last_undegraded":"2024-04-18T21:10:20.480547+0000","last_fullsized":"2024-04-18T21:10:20.480547+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:46:36.285416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'436","reported_seq":1063,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.477947+0000","last_change":"2024-04-18T21:10:18.490900+0000","last_active":"2024-04-18T21:10:20.477947+0000","last_peered":"2024-04-18T21:10:20.477947+0000","last_clean":"2024-04-18T21:10:20.477947+0000","last_became_active":"2024-04-18T21:10:18.487788+0000","last_became_peered":"2024-04-18T21:10:18.487788+0000","last_unstale":"2024-04-18T21:10:20.477947+0000","last_undegraded":"2024-04-18T21:10:20.477947+0000","last_fullsized":"2024-04-18T21:10:20.477947+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:57:00.495580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14561,"num_write":408,"num_write_kb":47462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'369","reported_seq":571,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.548399+0000","last_change":"2024-04-18T21:10:02.553999+0000","last_active":"2024-04-18T21:10:20.548399+0000","last_peered":"2024-04-18T21:10:20.548399+0000","last_clean":"2024-04-18T21:10:20.548399+0000","last_became_active":"2024-04-18T21:10:02.549471+0000","last_became_peered":"2024-04-18T21:10:02.549471+0000","last_unstale":"2024-04-18T21:10:20.548399+0000","last_undegraded":"2024-04-18T21:10:20.548399+0000","last_fullsized":"2024-04-18T21:10:20.548399+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:52:14.371235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13619,"num_write":339,"num_write_kb":63086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"70'888","reported_seq":1030,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.478410+0000","last_change":"2024-04-18T21:10:03.486911+0000","last_active":"2024-04-18T21:10:20.478410+0000","last_peered":"2024-04-18T21:10:20.478410+0000","last_clean":"2024-04-18T21:10:20.478410+0000","last_became_active":"2024-04-18T21:10:03.480576+0000","last_became_peered":"2024-04-18T21:10:03.480576+0000","last_unstale":"2024-04-18T21:10:20.478410+0000","last_undegraded":"2024-04-18T21:10:20.478410+0000","last_fullsized":"2024-04-18T21:10:20.478410+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:41:06.632064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":823,"num_write_kb":8582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'398","reported_seq":562,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.479937+0000","last_change":"2024-04-18T21:10:03.491426+0000","last_active":"2024-04-18T21:10:20.479937+0000","last_peered":"2024-04-18T21:10:20.479937+0000","last_clean":"2024-04-18T21:10:20.479937+0000","last_became_active":"2024-04-18T21:10:03.483190+0000","last_became_peered":"2024-04-18T21:10:03.483190+0000","last_unstale":"2024-04-18T21:10:20.479937+0000","last_undegraded":"2024-04-18T21:10:20.479937+0000","last_fullsized":"2024-04-18T21:10:20.479937+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:05:10.611580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14684,"num_write":380,"num_write_kb":88822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"70'169","reported_seq":384,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.478144+0000","last_change":"2024-04-18T21:10:00.494974+0000","last_active":"2024-04-18T21:10:20.478144+0000","last_peered":"2024-04-18T21:10:20.478144+0000","last_clean":"2024-04-18T21:10:20.478144+0000","last_became_active":"2024-04-18T21:10:00.492196+0000","last_became_peered":"2024-04-18T21:10:00.492196+0000","last_unstale":"2024-04-18T21:10:20.478144+0000","last_undegraded":"2024-04-18T21:10:20.478144+0000","last_fullsized":"2024-04-18T21:10:20.478144+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:33:51.236211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":4162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'406","reported_seq":630,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546278+0000","last_change":"2024-04-18T21:10:12.553754+0000","last_active":"2024-04-18T21:10:20.546278+0000","last_peered":"2024-04-18T21:10:20.546278+0000","last_clean":"2024-04-18T21:10:20.546278+0000","last_became_active":"2024-04-18T21:10:12.546148+0000","last_became_peered":"2024-04-18T21:10:12.546148+0000","last_unstale":"2024-04-18T21:10:20.546278+0000","last_undegraded":"2024-04-18T21:10:20.546278+0000","last_fullsized":"2024-04-18T21:10:20.546278+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:12:37.876185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27495,"num_write":363,"num_write_kb":89134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"72'192","reported_seq":385,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546350+0000","last_change":"2024-04-18T21:09:53.541766+0000","last_active":"2024-04-18T21:10:20.546350+0000","last_peered":"2024-04-18T21:10:20.546350+0000","last_clean":"2024-04-18T21:10:20.546350+0000","last_became_active":"2024-04-18T21:09:53.541300+0000","last_became_peered":"2024-04-18T21:09:53.541300+0000","last_unstale":"2024-04-18T21:10:20.546350+0000","last_undegraded":"2024-04-18T21:10:20.546350+0000","last_fullsized":"2024-04-18T21:10:20.546350+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:26:14.718922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12425030,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":12201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8230726,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"71'383","reported_seq":617,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547547+0000","last_change":"2024-04-18T21:09:55.555798+0000","last_active":"2024-04-18T21:10:20.547547+0000","last_peered":"2024-04-18T21:10:20.547547+0000","last_clean":"2024-04-18T21:10:20.547547+0000","last_became_active":"2024-04-18T21:09:55.551135+0000","last_became_peered":"2024-04-18T21:09:55.551135+0000","last_unstale":"2024-04-18T21:10:20.547547+0000","last_undegraded":"2024-04-18T21:10:20.547547+0000","last_fullsized":"2024-04-18T21:10:20.547547+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:00:01.739082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21614,"num_write":351,"num_write_kb":79501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"70'66","reported_seq":159,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546526+0000","last_change":"2024-04-18T21:10:00.553114+0000","last_active":"2024-04-18T21:10:20.546526+0000","last_peered":"2024-04-18T21:10:20.546526+0000","last_clean":"2024-04-18T21:10:20.546526+0000","last_became_active":"2024-04-18T21:10:00.552067+0000","last_became_peered":"2024-04-18T21:10:00.552067+0000","last_unstale":"2024-04-18T21:10:20.546526+0000","last_undegraded":"2024-04-18T21:10:20.546526+0000","last_fullsized":"2024-04-18T21:10:20.546526+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:51:32.567297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"71'345","reported_seq":546,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483218+0000","last_change":"2024-04-18T21:05:05.624840+0000","last_active":"2024-04-18T21:10:20.483218+0000","last_peered":"2024-04-18T21:10:20.483218+0000","last_clean":"2024-04-18T21:10:20.483218+0000","last_became_active":"2024-04-18T21:05:05.622950+0000","last_became_peered":"2024-04-18T21:05:05.622950+0000","last_unstale":"2024-04-18T21:10:20.483218+0000","last_undegraded":"2024-04-18T21:10:20.483218+0000","last_fullsized":"2024-04-18T21:10:20.483218+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:27:17.530889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":317,"num_write_kb":29335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"70'171","reported_seq":286,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483766+0000","last_change":"2024-04-18T21:10:00.507624+0000","last_active":"2024-04-18T21:10:20.483766+0000","last_peered":"2024-04-18T21:10:20.483766+0000","last_clean":"2024-04-18T21:10:20.483766+0000","last_became_active":"2024-04-18T21:10:00.507132+0000","last_became_peered":"2024-04-18T21:10:00.507132+0000","last_unstale":"2024-04-18T21:10:20.483766+0000","last_undegraded":"2024-04-18T21:10:20.483766+0000","last_fullsized":"2024-04-18T21:10:20.483766+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:35:50.013019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":4154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"71'417","reported_seq":643,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483150+0000","last_change":"2024-04-18T21:05:05.627962+0000","last_active":"2024-04-18T21:10:20.483150+0000","last_peered":"2024-04-18T21:10:20.483150+0000","last_clean":"2024-04-18T21:10:20.483150+0000","last_became_active":"2024-04-18T21:05:05.626698+0000","last_became_peered":"2024-04-18T21:05:05.626698+0000","last_unstale":"2024-04-18T21:10:20.483150+0000","last_undegraded":"2024-04-18T21:10:20.483150+0000","last_fullsized":"2024-04-18T21:10:20.483150+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:48:48.973087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":17040,"num_write":384,"num_write_kb":83740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"70'276","reported_seq":471,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547237+0000","last_change":"2024-04-18T21:09:53.543611+0000","last_active":"2024-04-18T21:10:20.547237+0000","last_peered":"2024-04-18T21:10:20.547237+0000","last_clean":"2024-04-18T21:10:20.547237+0000","last_became_active":"2024-04-18T21:09:53.542863+0000","last_became_peered":"2024-04-18T21:09:53.542863+0000","last_unstale":"2024-04-18T21:10:20.547237+0000","last_undegraded":"2024-04-18T21:10:20.547237+0000","last_fullsized":"2024-04-18T21:10:20.547237+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:22.582074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":12399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"71'428","reported_seq":637,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546271+0000","last_change":"2024-04-18T21:10:08.541152+0000","last_active":"2024-04-18T21:10:20.546271+0000","last_peered":"2024-04-18T21:10:20.546271+0000","last_clean":"2024-04-18T21:10:20.546271+0000","last_became_active":"2024-04-18T21:10:08.536423+0000","last_became_peered":"2024-04-18T21:10:08.536423+0000","last_unstale":"2024-04-18T21:10:20.546271+0000","last_undegraded":"2024-04-18T21:10:20.546271+0000","last_fullsized":"2024-04-18T21:10:20.546271+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:26.666677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22548,"num_write":398,"num_write_kb":75972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"70'70","reported_seq":273,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.480343+0000","last_change":"2024-04-18T21:09:50.833350+0000","last_active":"2024-04-18T21:10:20.480343+0000","last_peered":"2024-04-18T21:10:20.480343+0000","last_clean":"2024-04-18T21:10:20.480343+0000","last_became_active":"2024-04-18T21:09:50.832355+0000","last_became_peered":"2024-04-18T21:09:50.832355+0000","last_unstale":"2024-04-18T21:10:20.480343+0000","last_undegraded":"2024-04-18T21:10:20.480343+0000","last_fullsized":"2024-04-18T21:10:20.480343+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:39:09.627425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'459","reported_seq":642,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482639+0000","last_change":"2024-04-18T21:10:01.503378+0000","last_active":"2024-04-18T21:10:20.482639+0000","last_peered":"2024-04-18T21:10:20.482639+0000","last_clean":"2024-04-18T21:10:20.482639+0000","last_became_active":"2024-04-18T21:10:01.497275+0000","last_became_peered":"2024-04-18T21:10:01.497275+0000","last_unstale":"2024-04-18T21:10:20.482639+0000","last_undegraded":"2024-04-18T21:10:20.482639+0000","last_fullsized":"2024-04-18T21:10:20.482639+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:40:35.832428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13353,"num_write":429,"num_write_kb":88123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"70'113","reported_seq":332,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.480338+0000","last_change":"2024-04-18T21:10:00.499468+0000","last_active":"2024-04-18T21:10:20.480338+0000","last_peered":"2024-04-18T21:10:20.480338+0000","last_clean":"2024-04-18T21:10:20.480338+0000","last_became_active":"2024-04-18T21:10:00.494734+0000","last_became_peered":"2024-04-18T21:10:00.494734+0000","last_unstale":"2024-04-18T21:10:20.480338+0000","last_undegraded":"2024-04-18T21:10:20.480338+0000","last_fullsized":"2024-04-18T21:10:20.480338+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:58:34.790588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194886,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2531,"num_read_kb":1304649,"num_write":24542,"num_write_kb":4299443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8145,"num_bytes_recovered":4488063,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26603,"ondisk_log_size":26603,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127139127,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":55,"num_read_kb":1405,"num_write":4542,"num_write_kb":127514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":92002768,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254345216,"data_stored":254278254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4409,"internal_metadata":0},"log_size":6331,"ondisk_log_size":6331,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738439,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":187628,"kb_used_data":80152,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94184212,"statfs":{"total":96636764160,"available":96444633088,"internally_reserved":0,"allocated":82075648,"data_stored":81480582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110033349},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":77,"seq":330712481801,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":147296,"kb_used_data":83404,"kb_used_omap":5,"kb_used_meta":63866,"kb_avail":94224544,"statfs":{"total":96636764160,"available":96485933056,"internally_reserved":0,"allocated":85405696,"data_stored":84799073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6004,"internal_metadata":65398924},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738437,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":160468,"kb_used_data":89096,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94211372,"statfs":{"total":96636764160,"available":96472444928,"internally_reserved":0,"allocated":91234304,"data_stored":90618294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":89579520,"data_stored":89548273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":83750912,"data_stored":83729052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4409,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81014784,"data_stored":81000929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:10:25.292 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-18T21:10:25.292 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-04-18T21:10:25.640 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-18T21:10:25.652 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-18T21:10:25.652 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:10:25.940 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:10:25.942 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-04-18T21:10:25.957 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":272,"stamp":"2024-04-18T21:10:24.639147+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127729495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2722,"num_read_kb":1306172,"num_write":29287,"num_write_kb":4430417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8182,"num_bytes_recovered":97081199,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33091,"ondisk_log_size":33091,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":495392,"kb_used_data":252652,"kb_used_omap":8,"kb_used_meta":242679,"kb_avail":282620128,"statfs":{"total":289910292480,"available":289403011072,"internally_reserved":0,"allocated":258715648,"data_stored":256897949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9194,"internal_metadata":248503318},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-758,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1054,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.165240"},"pg_stats":[{"pgid":"4.3f","version":"71'418","reported_seq":614,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.548813+0000","last_change":"2024-04-18T21:10:16.576720+0000","last_active":"2024-04-18T21:10:20.548813+0000","last_peered":"2024-04-18T21:10:20.548813+0000","last_clean":"2024-04-18T21:10:20.548813+0000","last_became_active":"2024-04-18T21:10:16.571985+0000","last_became_peered":"2024-04-18T21:10:16.571985+0000","last_unstale":"2024-04-18T21:10:20.548813+0000","last_undegraded":"2024-04-18T21:10:20.548813+0000","last_fullsized":"2024-04-18T21:10:20.548813+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:28:48.196628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":19677,"num_write":386,"num_write_kb":87615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"71'417","reported_seq":631,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.548242+0000","last_change":"2024-04-18T21:10:05.546965+0000","last_active":"2024-04-18T21:10:20.548242+0000","last_peered":"2024-04-18T21:10:20.548242+0000","last_clean":"2024-04-18T21:10:20.548242+0000","last_became_active":"2024-04-18T21:10:05.541170+0000","last_became_peered":"2024-04-18T21:10:05.541170+0000","last_unstale":"2024-04-18T21:10:20.548242+0000","last_undegraded":"2024-04-18T21:10:20.548242+0000","last_fullsized":"2024-04-18T21:10:20.548242+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:04:05.630763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":12123,"num_write":387,"num_write_kb":47157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"71'379","reported_seq":940,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483812+0000","last_change":"2024-04-18T21:09:54.480753+0000","last_active":"2024-04-18T21:10:20.483812+0000","last_peered":"2024-04-18T21:10:20.483812+0000","last_clean":"2024-04-18T21:10:20.483812+0000","last_became_active":"2024-04-18T21:09:54.478020+0000","last_became_peered":"2024-04-18T21:09:54.478020+0000","last_unstale":"2024-04-18T21:10:20.483812+0000","last_undegraded":"2024-04-18T21:10:20.483812+0000","last_fullsized":"2024-04-18T21:10:20.483812+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:24:18.705477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":10040,"num_write":353,"num_write_kb":63202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'372","reported_seq":574,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483063+0000","last_change":"2024-04-18T21:05:05.629321+0000","last_active":"2024-04-18T21:10:20.483063+0000","last_peered":"2024-04-18T21:10:20.483063+0000","last_clean":"2024-04-18T21:10:20.483063+0000","last_became_active":"2024-04-18T21:05:05.627956+0000","last_became_peered":"2024-04-18T21:05:05.627956+0000","last_unstale":"2024-04-18T21:10:20.483063+0000","last_undegraded":"2024-04-18T21:10:20.483063+0000","last_fullsized":"2024-04-18T21:10:20.483063+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:15:28.458476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2735,"num_write":328,"num_write_kb":22107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"71'416","reported_seq":616,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546812+0000","last_change":"2024-04-18T21:10:00.560644+0000","last_active":"2024-04-18T21:10:20.546812+0000","last_peered":"2024-04-18T21:10:20.546812+0000","last_clean":"2024-04-18T21:10:20.546812+0000","last_became_active":"2024-04-18T21:10:00.553862+0000","last_became_peered":"2024-04-18T21:10:00.553862+0000","last_unstale":"2024-04-18T21:10:20.546812+0000","last_undegraded":"2024-04-18T21:10:20.546812+0000","last_fullsized":"2024-04-18T21:10:20.546812+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:11:49.688538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6533,"num_write":389,"num_write_kb":43666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"71'374","reported_seq":574,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482584+0000","last_change":"2024-04-18T21:10:01.495684+0000","last_active":"2024-04-18T21:10:20.482584+0000","last_peered":"2024-04-18T21:10:20.482584+0000","last_clean":"2024-04-18T21:10:20.482584+0000","last_became_active":"2024-04-18T21:10:01.486640+0000","last_became_peered":"2024-04-18T21:10:01.486640+0000","last_unstale":"2024-04-18T21:10:20.482584+0000","last_undegraded":"2024-04-18T21:10:20.482584+0000","last_fullsized":"2024-04-18T21:10:20.482584+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:39:10.639381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20415,"num_write":354,"num_write_kb":34462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'418","reported_seq":652,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482999+0000","last_change":"2024-04-18T21:05:05.625047+0000","last_active":"2024-04-18T21:10:20.482999+0000","last_peered":"2024-04-18T21:10:20.482999+0000","last_clean":"2024-04-18T21:10:20.482999+0000","last_became_active":"2024-04-18T21:05:05.622781+0000","last_became_peered":"2024-04-18T21:05:05.622781+0000","last_unstale":"2024-04-18T21:10:20.482999+0000","last_undegraded":"2024-04-18T21:10:20.482999+0000","last_fullsized":"2024-04-18T21:10:20.482999+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:12.944469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21103,"num_write":385,"num_write_kb":50678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"71'399","reported_seq":638,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.481939+0000","last_change":"2024-04-18T21:10:00.495543+0000","last_active":"2024-04-18T21:10:20.481939+0000","last_peered":"2024-04-18T21:10:20.481939+0000","last_clean":"2024-04-18T21:10:20.481939+0000","last_became_active":"2024-04-18T21:10:00.488705+0000","last_became_peered":"2024-04-18T21:10:00.488705+0000","last_unstale":"2024-04-18T21:10:20.481939+0000","last_undegraded":"2024-04-18T21:10:20.481939+0000","last_fullsized":"2024-04-18T21:10:20.481939+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:11.892092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":44692,"num_write":361,"num_write_kb":105170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"71'385","reported_seq":950,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.479921+0000","last_change":"2024-04-18T21:10:06.487113+0000","last_active":"2024-04-18T21:10:20.479921+0000","last_peered":"2024-04-18T21:10:20.479921+0000","last_clean":"2024-04-18T21:10:20.479921+0000","last_became_active":"2024-04-18T21:10:06.482087+0000","last_became_peered":"2024-04-18T21:10:06.482087+0000","last_unstale":"2024-04-18T21:10:20.479921+0000","last_undegraded":"2024-04-18T21:10:20.479921+0000","last_fullsized":"2024-04-18T21:10:20.479921+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:10:51.435131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":994,"num_write":358,"num_write_kb":25964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'409","reported_seq":644,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546781+0000","last_change":"2024-04-18T21:10:12.550697+0000","last_active":"2024-04-18T21:10:20.546781+0000","last_peered":"2024-04-18T21:10:20.546781+0000","last_clean":"2024-04-18T21:10:20.546781+0000","last_became_active":"2024-04-18T21:10:12.546621+0000","last_became_peered":"2024-04-18T21:10:12.546621+0000","last_unstale":"2024-04-18T21:10:20.546781+0000","last_undegraded":"2024-04-18T21:10:20.546781+0000","last_fullsized":"2024-04-18T21:10:20.546781+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:55:30.422126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":26170,"num_write":372,"num_write_kb":83931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"71'366","reported_seq":577,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483819+0000","last_change":"2024-04-18T21:10:01.496068+0000","last_active":"2024-04-18T21:10:20.483819+0000","last_peered":"2024-04-18T21:10:20.483819+0000","last_clean":"2024-04-18T21:10:20.483819+0000","last_became_active":"2024-04-18T21:10:01.488047+0000","last_became_peered":"2024-04-18T21:10:01.488047+0000","last_unstale":"2024-04-18T21:10:20.483819+0000","last_undegraded":"2024-04-18T21:10:20.483819+0000","last_fullsized":"2024-04-18T21:10:20.483819+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:49.957286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":18907,"num_write":347,"num_write_kb":26153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"71'346","reported_seq":549,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547957+0000","last_change":"2024-04-18T21:10:00.560349+0000","last_active":"2024-04-18T21:10:20.547957+0000","last_peered":"2024-04-18T21:10:20.547957+0000","last_clean":"2024-04-18T21:10:20.547957+0000","last_became_active":"2024-04-18T21:10:00.557412+0000","last_became_peered":"2024-04-18T21:10:00.557412+0000","last_unstale":"2024-04-18T21:10:20.547957+0000","last_undegraded":"2024-04-18T21:10:20.547957+0000","last_fullsized":"2024-04-18T21:10:20.547957+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:54:33.428937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":6245,"num_write":324,"num_write_kb":37970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"71'417","reported_seq":638,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547313+0000","last_change":"2024-04-18T21:10:02.555899+0000","last_active":"2024-04-18T21:10:20.547313+0000","last_peered":"2024-04-18T21:10:20.547313+0000","last_clean":"2024-04-18T21:10:20.547313+0000","last_became_active":"2024-04-18T21:10:02.551406+0000","last_became_peered":"2024-04-18T21:10:02.551406+0000","last_unstale":"2024-04-18T21:10:20.547313+0000","last_undegraded":"2024-04-18T21:10:20.547313+0000","last_fullsized":"2024-04-18T21:10:20.547313+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:41:17.455669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":21623,"num_write":381,"num_write_kb":71306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"71'398","reported_seq":977,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482881+0000","last_change":"2024-04-18T21:10:11.491565+0000","last_active":"2024-04-18T21:10:20.482881+0000","last_peered":"2024-04-18T21:10:20.482881+0000","last_clean":"2024-04-18T21:10:20.482881+0000","last_became_active":"2024-04-18T21:10:11.486593+0000","last_became_peered":"2024-04-18T21:10:11.486593+0000","last_unstale":"2024-04-18T21:10:20.482881+0000","last_undegraded":"2024-04-18T21:10:20.482881+0000","last_fullsized":"2024-04-18T21:10:20.482881+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:11:23.853682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":369,"num_write_kb":30006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'435","reported_seq":1102,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482470+0000","last_change":"2024-04-18T21:10:15.509238+0000","last_active":"2024-04-18T21:10:20.482470+0000","last_peered":"2024-04-18T21:10:20.482470+0000","last_clean":"2024-04-18T21:10:20.482470+0000","last_became_active":"2024-04-18T21:10:15.506328+0000","last_became_peered":"2024-04-18T21:10:15.506328+0000","last_unstale":"2024-04-18T21:10:20.482470+0000","last_undegraded":"2024-04-18T21:10:20.482470+0000","last_fullsized":"2024-04-18T21:10:20.482470+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:49:44.996311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":31523,"num_write":402,"num_write_kb":121466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":346,"num_bytes_recovered":410327,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'446","reported_seq":687,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482015+0000","last_change":"2024-04-18T21:05:05.638203+0000","last_active":"2024-04-18T21:10:20.482015+0000","last_peered":"2024-04-18T21:10:20.482015+0000","last_clean":"2024-04-18T21:10:20.482015+0000","last_became_active":"2024-04-18T21:05:05.637352+0000","last_became_peered":"2024-04-18T21:05:05.637352+0000","last_unstale":"2024-04-18T21:10:20.482015+0000","last_undegraded":"2024-04-18T21:10:20.482015+0000","last_fullsized":"2024-04-18T21:10:20.482015+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":23833,"num_write":418,"num_write_kb":59679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"71'403","reported_seq":956,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.490427+0000","last_change":"2024-04-18T21:10:20.490427+0000","last_active":"2024-04-18T21:10:20.490427+0000","last_peered":"2024-04-18T21:10:20.490427+0000","last_clean":"2024-04-18T21:10:20.490427+0000","last_became_active":"2024-04-18T21:10:20.487409+0000","last_became_peered":"2024-04-18T21:10:20.487409+0000","last_unstale":"2024-04-18T21:10:20.490427+0000","last_undegraded":"2024-04-18T21:10:20.490427+0000","last_fullsized":"2024-04-18T21:10:20.490427+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:22:40.301941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":7482,"num_write":371,"num_write_kb":25957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'406","reported_seq":606,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.548073+0000","last_change":"2024-04-18T21:10:10.547457+0000","last_active":"2024-04-18T21:10:20.548073+0000","last_peered":"2024-04-18T21:10:20.548073+0000","last_clean":"2024-04-18T21:10:20.548073+0000","last_became_active":"2024-04-18T21:10:10.542594+0000","last_became_peered":"2024-04-18T21:10:10.542594+0000","last_unstale":"2024-04-18T21:10:20.548073+0000","last_undegraded":"2024-04-18T21:10:20.548073+0000","last_fullsized":"2024-04-18T21:10:20.548073+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:51:58.437990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":27987,"num_write":365,"num_write_kb":38689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"71'470","reported_seq":1142,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.479779+0000","last_change":"2024-04-18T21:10:17.535574+0000","last_active":"2024-04-18T21:10:20.479779+0000","last_peered":"2024-04-18T21:10:20.479779+0000","last_clean":"2024-04-18T21:10:20.479779+0000","last_became_active":"2024-04-18T21:10:17.529957+0000","last_became_peered":"2024-04-18T21:10:17.529957+0000","last_unstale":"2024-04-18T21:10:20.479779+0000","last_undegraded":"2024-04-18T21:10:20.479779+0000","last_fullsized":"2024-04-18T21:10:20.479779+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:06:00.648089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":59273,"num_write":432,"num_write_kb":145930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'433","reported_seq":635,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483362+0000","last_change":"2024-04-18T21:05:05.638338+0000","last_active":"2024-04-18T21:10:20.483362+0000","last_peered":"2024-04-18T21:10:20.483362+0000","last_clean":"2024-04-18T21:10:20.483362+0000","last_became_active":"2024-04-18T21:05:05.637567+0000","last_became_peered":"2024-04-18T21:05:05.637567+0000","last_unstale":"2024-04-18T21:10:20.483362+0000","last_undegraded":"2024-04-18T21:10:20.483362+0000","last_fullsized":"2024-04-18T21:10:20.483362+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5514,"num_write":403,"num_write_kb":26329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"71'418","reported_seq":661,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482880+0000","last_change":"2024-04-18T21:05:05.643606+0000","last_active":"2024-04-18T21:10:20.482880+0000","last_peered":"2024-04-18T21:10:20.482880+0000","last_clean":"2024-04-18T21:10:20.482880+0000","last_became_active":"2024-04-18T21:05:05.642991+0000","last_became_peered":"2024-04-18T21:05:05.642991+0000","last_unstale":"2024-04-18T21:10:20.482880+0000","last_undegraded":"2024-04-18T21:10:20.482880+0000","last_fullsized":"2024-04-18T21:10:20.482880+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:01.841786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":29097,"num_write":386,"num_write_kb":88262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"71'479","reported_seq":722,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546721+0000","last_change":"2024-04-18T21:10:07.549995+0000","last_active":"2024-04-18T21:10:20.546721+0000","last_peered":"2024-04-18T21:10:20.546721+0000","last_clean":"2024-04-18T21:10:20.546721+0000","last_became_active":"2024-04-18T21:10:07.544314+0000","last_became_peered":"2024-04-18T21:10:07.544314+0000","last_unstale":"2024-04-18T21:10:20.546721+0000","last_undegraded":"2024-04-18T21:10:20.546721+0000","last_fullsized":"2024-04-18T21:10:20.546721+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:52:34.340348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":24204,"num_write":452,"num_write_kb":114184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"71'407","reported_seq":637,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.477533+0000","last_change":"2024-04-18T21:10:03.487961+0000","last_active":"2024-04-18T21:10:20.477533+0000","last_peered":"2024-04-18T21:10:20.477533+0000","last_clean":"2024-04-18T21:10:20.477533+0000","last_became_active":"2024-04-18T21:10:03.476552+0000","last_became_peered":"2024-04-18T21:10:03.476552+0000","last_unstale":"2024-04-18T21:10:20.477533+0000","last_undegraded":"2024-04-18T21:10:20.477533+0000","last_fullsized":"2024-04-18T21:10:20.477533+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:45:35.774025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":37766,"num_write":374,"num_write_kb":103984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'452","reported_seq":653,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546024+0000","last_change":"2024-04-18T21:10:18.547982+0000","last_active":"2024-04-18T21:10:20.546024+0000","last_peered":"2024-04-18T21:10:20.546024+0000","last_clean":"2024-04-18T21:10:20.546024+0000","last_became_active":"2024-04-18T21:10:18.542189+0000","last_became_peered":"2024-04-18T21:10:18.542189+0000","last_unstale":"2024-04-18T21:10:20.546024+0000","last_undegraded":"2024-04-18T21:10:20.546024+0000","last_fullsized":"2024-04-18T21:10:20.546024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:49.761650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27170,"num_write":421,"num_write_kb":39548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"71'427","reported_seq":634,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.548342+0000","last_change":"2024-04-18T21:10:03.544910+0000","last_active":"2024-04-18T21:10:20.548342+0000","last_peered":"2024-04-18T21:10:20.548342+0000","last_clean":"2024-04-18T21:10:20.548342+0000","last_became_active":"2024-04-18T21:10:03.539961+0000","last_became_peered":"2024-04-18T21:10:03.539961+0000","last_unstale":"2024-04-18T21:10:20.548342+0000","last_undegraded":"2024-04-18T21:10:20.548342+0000","last_fullsized":"2024-04-18T21:10:20.548342+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:06:34.839228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":11507,"num_write":407,"num_write_kb":50964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"71'471","reported_seq":697,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.479964+0000","last_change":"2024-04-18T21:05:05.649581+0000","last_active":"2024-04-18T21:10:20.479964+0000","last_peered":"2024-04-18T21:10:20.479964+0000","last_clean":"2024-04-18T21:10:20.479964+0000","last_became_active":"2024-04-18T21:05:05.648233+0000","last_became_peered":"2024-04-18T21:05:05.648233+0000","last_unstale":"2024-04-18T21:10:20.479964+0000","last_undegraded":"2024-04-18T21:10:20.479964+0000","last_fullsized":"2024-04-18T21:10:20.479964+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20857,"num_write":431,"num_write_kb":63677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'378","reported_seq":940,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.484277+0000","last_change":"2024-04-18T21:09:55.493655+0000","last_active":"2024-04-18T21:10:20.484277+0000","last_peered":"2024-04-18T21:10:20.484277+0000","last_clean":"2024-04-18T21:10:20.484277+0000","last_became_active":"2024-04-18T21:09:55.490958+0000","last_became_peered":"2024-04-18T21:09:55.490958+0000","last_unstale":"2024-04-18T21:10:20.484277+0000","last_undegraded":"2024-04-18T21:10:20.484277+0000","last_fullsized":"2024-04-18T21:10:20.484277+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:52:16.541697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12573,"num_write":347,"num_write_kb":34434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'410","reported_seq":639,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547904+0000","last_change":"2024-04-18T21:10:01.563947+0000","last_active":"2024-04-18T21:10:20.547904+0000","last_peered":"2024-04-18T21:10:20.547904+0000","last_clean":"2024-04-18T21:10:20.547904+0000","last_became_active":"2024-04-18T21:10:01.555367+0000","last_became_peered":"2024-04-18T21:10:01.555367+0000","last_unstale":"2024-04-18T21:10:20.547904+0000","last_undegraded":"2024-04-18T21:10:20.547904+0000","last_fullsized":"2024-04-18T21:10:20.547904+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:01:09.418419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":16926,"num_write":380,"num_write_kb":112804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"71'410","reported_seq":991,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.478607+0000","last_change":"2024-04-18T21:10:03.490605+0000","last_active":"2024-04-18T21:10:20.478607+0000","last_peered":"2024-04-18T21:10:20.478607+0000","last_clean":"2024-04-18T21:10:20.478607+0000","last_became_active":"2024-04-18T21:10:03.480985+0000","last_became_peered":"2024-04-18T21:10:03.480985+0000","last_unstale":"2024-04-18T21:10:20.478607+0000","last_undegraded":"2024-04-18T21:10:20.478607+0000","last_fullsized":"2024-04-18T21:10:20.478607+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:14:42.076110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":34811,"num_write":378,"num_write_kb":51242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'491","reported_seq":709,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546384+0000","last_change":"2024-04-18T21:10:08.546388+0000","last_active":"2024-04-18T21:10:20.546384+0000","last_peered":"2024-04-18T21:10:20.546384+0000","last_clean":"2024-04-18T21:10:20.546384+0000","last_became_active":"2024-04-18T21:10:08.540487+0000","last_became_peered":"2024-04-18T21:10:08.540487+0000","last_unstale":"2024-04-18T21:10:20.546384+0000","last_undegraded":"2024-04-18T21:10:20.546384+0000","last_fullsized":"2024-04-18T21:10:20.546384+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:15:51.120517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":26902,"num_write":456,"num_write_kb":124778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":209,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"71'467","reported_seq":1079,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.477750+0000","last_change":"2024-04-18T21:10:19.483012+0000","last_active":"2024-04-18T21:10:20.477750+0000","last_peered":"2024-04-18T21:10:20.477750+0000","last_clean":"2024-04-18T21:10:20.477750+0000","last_became_active":"2024-04-18T21:10:19.480002+0000","last_became_peered":"2024-04-18T21:10:19.480002+0000","last_unstale":"2024-04-18T21:10:20.477750+0000","last_undegraded":"2024-04-18T21:10:20.477750+0000","last_fullsized":"2024-04-18T21:10:20.477750+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:51:24.488873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":28114,"num_write":434,"num_write_kb":129325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'423","reported_seq":595,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482361+0000","last_change":"2024-04-18T21:10:01.499421+0000","last_active":"2024-04-18T21:10:20.482361+0000","last_peered":"2024-04-18T21:10:20.482361+0000","last_clean":"2024-04-18T21:10:20.482361+0000","last_became_active":"2024-04-18T21:10:01.487074+0000","last_became_peered":"2024-04-18T21:10:01.487074+0000","last_unstale":"2024-04-18T21:10:20.482361+0000","last_undegraded":"2024-04-18T21:10:20.482361+0000","last_fullsized":"2024-04-18T21:10:20.482361+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:05:34.827814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8244,"num_write":393,"num_write_kb":58692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"71'389","reported_seq":618,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547175+0000","last_change":"2024-04-18T21:09:58.542232+0000","last_active":"2024-04-18T21:10:20.547175+0000","last_peered":"2024-04-18T21:10:20.547175+0000","last_clean":"2024-04-18T21:10:20.547175+0000","last_became_active":"2024-04-18T21:09:58.537723+0000","last_became_peered":"2024-04-18T21:09:58.537723+0000","last_unstale":"2024-04-18T21:10:20.547175+0000","last_undegraded":"2024-04-18T21:10:20.547175+0000","last_fullsized":"2024-04-18T21:10:20.547175+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:26.786170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":24216,"num_write":349,"num_write_kb":43176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"70'425","reported_seq":621,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483524+0000","last_change":"2024-04-18T21:05:04.632748+0000","last_active":"2024-04-18T21:10:20.483524+0000","last_peered":"2024-04-18T21:10:20.483524+0000","last_clean":"2024-04-18T21:10:20.483524+0000","last_became_active":"2024-04-18T21:05:04.628407+0000","last_became_peered":"2024-04-18T21:05:04.628407+0000","last_unstale":"2024-04-18T21:10:20.483524+0000","last_undegraded":"2024-04-18T21:10:20.483524+0000","last_fullsized":"2024-04-18T21:10:20.483524+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:42:45.392908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":375,"num_write_kb":8348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"71'423","reported_seq":623,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547197+0000","last_change":"2024-04-18T21:10:14.556066+0000","last_active":"2024-04-18T21:10:20.547197+0000","last_peered":"2024-04-18T21:10:20.547197+0000","last_clean":"2024-04-18T21:10:20.547197+0000","last_became_active":"2024-04-18T21:10:14.551249+0000","last_became_peered":"2024-04-18T21:10:14.551249+0000","last_unstale":"2024-04-18T21:10:20.547197+0000","last_undegraded":"2024-04-18T21:10:20.547197+0000","last_fullsized":"2024-04-18T21:10:20.547197+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:06:06.045278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":20096,"num_write":381,"num_write_kb":76351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"70'56","reported_seq":264,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.478297+0000","last_change":"2024-04-18T21:10:00.500122+0000","last_active":"2024-04-18T21:10:20.478297+0000","last_peered":"2024-04-18T21:10:20.478297+0000","last_clean":"2024-04-18T21:10:20.478297+0000","last_became_active":"2024-04-18T21:10:00.489486+0000","last_became_peered":"2024-04-18T21:10:00.489486+0000","last_unstale":"2024-04-18T21:10:20.478297+0000","last_undegraded":"2024-04-18T21:10:20.478297+0000","last_fullsized":"2024-04-18T21:10:20.478297+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:58:08.269558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'442","reported_seq":1026,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.480431+0000","last_change":"2024-04-18T21:10:03.492109+0000","last_active":"2024-04-18T21:10:20.480431+0000","last_peered":"2024-04-18T21:10:20.480431+0000","last_clean":"2024-04-18T21:10:20.480431+0000","last_became_active":"2024-04-18T21:10:03.483050+0000","last_became_peered":"2024-04-18T21:10:03.483050+0000","last_unstale":"2024-04-18T21:10:20.480431+0000","last_undegraded":"2024-04-18T21:10:20.480431+0000","last_fullsized":"2024-04-18T21:10:20.480431+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:45.388623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13827,"num_write":415,"num_write_kb":79859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"70'62","reported_seq":80,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546613+0000","last_change":"2024-04-18T21:09:50.868159+0000","last_active":"2024-04-18T21:10:20.546613+0000","last_peered":"2024-04-18T21:10:20.546613+0000","last_clean":"2024-04-18T21:10:20.546613+0000","last_became_active":"2024-04-18T21:09:50.867096+0000","last_became_peered":"2024-04-18T21:09:50.867096+0000","last_unstale":"2024-04-18T21:10:20.546613+0000","last_undegraded":"2024-04-18T21:10:20.546613+0000","last_fullsized":"2024-04-18T21:10:20.546613+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:09:57.047205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"71'398","reported_seq":639,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.479991+0000","last_change":"2024-04-18T21:10:01.498728+0000","last_active":"2024-04-18T21:10:20.479991+0000","last_peered":"2024-04-18T21:10:20.479991+0000","last_clean":"2024-04-18T21:10:20.479991+0000","last_became_active":"2024-04-18T21:10:01.495349+0000","last_became_peered":"2024-04-18T21:10:01.495349+0000","last_unstale":"2024-04-18T21:10:20.479991+0000","last_undegraded":"2024-04-18T21:10:20.479991+0000","last_fullsized":"2024-04-18T21:10:20.479991+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:01:48.618551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":17616,"num_write":360,"num_write_kb":58871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"70'66","reported_seq":181,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482413+0000","last_change":"2024-04-18T21:10:00.496701+0000","last_active":"2024-04-18T21:10:20.482413+0000","last_peered":"2024-04-18T21:10:20.482413+0000","last_clean":"2024-04-18T21:10:20.482413+0000","last_became_active":"2024-04-18T21:10:00.495594+0000","last_became_peered":"2024-04-18T21:10:00.495594+0000","last_unstale":"2024-04-18T21:10:20.482413+0000","last_undegraded":"2024-04-18T21:10:20.482413+0000","last_fullsized":"2024-04-18T21:10:20.482413+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:11:32.991308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"70'135","reported_seq":68,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.484770+0000","last_change":"2024-04-18T21:10:00.493197+0000","last_active":"2024-04-18T21:10:20.484770+0000","last_peered":"2024-04-18T21:10:20.484770+0000","last_clean":"2024-04-18T21:10:20.484770+0000","last_became_active":"2024-04-18T21:10:00.491509+0000","last_became_peered":"2024-04-18T21:10:00.491509+0000","last_unstale":"2024-04-18T21:10:20.484770+0000","last_undegraded":"2024-04-18T21:10:20.484770+0000","last_fullsized":"2024-04-18T21:10:20.484770+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:57:29.595389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":7777508,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'410","reported_seq":610,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547176+0000","last_change":"2024-04-18T21:10:06.553806+0000","last_active":"2024-04-18T21:10:20.547176+0000","last_peered":"2024-04-18T21:10:20.547176+0000","last_clean":"2024-04-18T21:10:20.547176+0000","last_became_active":"2024-04-18T21:10:06.548034+0000","last_became_peered":"2024-04-18T21:10:06.548034+0000","last_unstale":"2024-04-18T21:10:20.547176+0000","last_undegraded":"2024-04-18T21:10:20.547176+0000","last_fullsized":"2024-04-18T21:10:20.547176+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:20:56.265941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17055,"num_write":375,"num_write_kb":63331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"70'240","reported_seq":363,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547788+0000","last_change":"2024-04-18T21:10:00.556212+0000","last_active":"2024-04-18T21:10:20.547788+0000","last_peered":"2024-04-18T21:10:20.547788+0000","last_clean":"2024-04-18T21:10:20.547788+0000","last_became_active":"2024-04-18T21:10:00.555486+0000","last_became_peered":"2024-04-18T21:10:00.555486+0000","last_unstale":"2024-04-18T21:10:20.547788+0000","last_undegraded":"2024-04-18T21:10:20.547788+0000","last_fullsized":"2024-04-18T21:10:20.547788+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:11.573984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":4191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"71'501","reported_seq":719,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.545865+0000","last_change":"2024-04-18T21:10:17.593530+0000","last_active":"2024-04-18T21:10:20.545865+0000","last_peered":"2024-04-18T21:10:20.545865+0000","last_clean":"2024-04-18T21:10:20.545865+0000","last_became_active":"2024-04-18T21:10:17.588391+0000","last_became_peered":"2024-04-18T21:10:17.588391+0000","last_unstale":"2024-04-18T21:10:20.545865+0000","last_undegraded":"2024-04-18T21:10:20.545865+0000","last_fullsized":"2024-04-18T21:10:20.545865+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:26.079610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":37662,"num_write":474,"num_write_kb":167663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"70'429","reported_seq":566,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.484708+0000","last_change":"2024-04-18T21:10:00.493325+0000","last_active":"2024-04-18T21:10:20.484708+0000","last_peered":"2024-04-18T21:10:20.484708+0000","last_clean":"2024-04-18T21:10:20.484708+0000","last_became_active":"2024-04-18T21:10:00.491525+0000","last_became_peered":"2024-04-18T21:10:00.491525+0000","last_unstale":"2024-04-18T21:10:20.484708+0000","last_undegraded":"2024-04-18T21:10:20.484708+0000","last_fullsized":"2024-04-18T21:10:20.484708+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:27:59.637974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":377,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388678,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'440","reported_seq":650,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483219+0000","last_change":"2024-04-18T21:10:01.497932+0000","last_active":"2024-04-18T21:10:20.483219+0000","last_peered":"2024-04-18T21:10:20.483219+0000","last_clean":"2024-04-18T21:10:20.483219+0000","last_became_active":"2024-04-18T21:10:01.486740+0000","last_became_peered":"2024-04-18T21:10:01.486740+0000","last_unstale":"2024-04-18T21:10:20.483219+0000","last_undegraded":"2024-04-18T21:10:20.483219+0000","last_fullsized":"2024-04-18T21:10:20.483219+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:34:43.515471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":42138,"num_write":408,"num_write_kb":96310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"70'59","reported_seq":255,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.484055+0000","last_change":"2024-04-18T21:05:04.625520+0000","last_active":"2024-04-18T21:10:20.484055+0000","last_peered":"2024-04-18T21:10:20.484055+0000","last_clean":"2024-04-18T21:10:20.484055+0000","last_became_active":"2024-04-18T21:05:04.624656+0000","last_became_peered":"2024-04-18T21:05:04.624656+0000","last_unstale":"2024-04-18T21:10:20.484055+0000","last_undegraded":"2024-04-18T21:10:20.484055+0000","last_fullsized":"2024-04-18T21:10:20.484055+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:56:05.795125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"71'461","reported_seq":676,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.478291+0000","last_change":"2024-04-18T21:05:05.649406+0000","last_active":"2024-04-18T21:10:20.478291+0000","last_peered":"2024-04-18T21:10:20.478291+0000","last_clean":"2024-04-18T21:10:20.478291+0000","last_became_active":"2024-04-18T21:05:05.648380+0000","last_became_peered":"2024-04-18T21:05:05.648380+0000","last_unstale":"2024-04-18T21:10:20.478291+0000","last_undegraded":"2024-04-18T21:10:20.478291+0000","last_fullsized":"2024-04-18T21:10:20.478291+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12852,"num_write":420,"num_write_kb":88506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"70'157","reported_seq":376,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.478945+0000","last_change":"2024-04-18T21:10:00.500141+0000","last_active":"2024-04-18T21:10:20.478945+0000","last_peered":"2024-04-18T21:10:20.478945+0000","last_clean":"2024-04-18T21:10:20.478945+0000","last_became_active":"2024-04-18T21:10:00.494630+0000","last_became_peered":"2024-04-18T21:10:00.494630+0000","last_unstale":"2024-04-18T21:10:20.478945+0000","last_undegraded":"2024-04-18T21:10:20.478945+0000","last_fullsized":"2024-04-18T21:10:20.478945+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:49:43.984354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":8250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'445","reported_seq":635,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483682+0000","last_change":"2024-04-18T21:10:01.500937+0000","last_active":"2024-04-18T21:10:20.483682+0000","last_peered":"2024-04-18T21:10:20.483682+0000","last_clean":"2024-04-18T21:10:20.483682+0000","last_became_active":"2024-04-18T21:10:01.490691+0000","last_became_peered":"2024-04-18T21:10:01.490691+0000","last_unstale":"2024-04-18T21:10:20.483682+0000","last_undegraded":"2024-04-18T21:10:20.483682+0000","last_fullsized":"2024-04-18T21:10:20.483682+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:59:48.489145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17488,"num_write":410,"num_write_kb":50845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"70'124","reported_seq":320,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483416+0000","last_change":"2024-04-18T21:05:04.634674+0000","last_active":"2024-04-18T21:10:20.483416+0000","last_peered":"2024-04-18T21:10:20.483416+0000","last_clean":"2024-04-18T21:10:20.483416+0000","last_became_active":"2024-04-18T21:05:04.632284+0000","last_became_peered":"2024-04-18T21:05:04.632284+0000","last_unstale":"2024-04-18T21:10:20.483416+0000","last_undegraded":"2024-04-18T21:10:20.483416+0000","last_fullsized":"2024-04-18T21:10:20.483416+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:09:18.466987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"71'400","reported_seq":942,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.484448+0000","last_change":"2024-04-18T21:10:14.495223+0000","last_active":"2024-04-18T21:10:20.484448+0000","last_peered":"2024-04-18T21:10:20.484448+0000","last_clean":"2024-04-18T21:10:20.484448+0000","last_became_active":"2024-04-18T21:10:14.492039+0000","last_became_peered":"2024-04-18T21:10:14.492039+0000","last_unstale":"2024-04-18T21:10:20.484448+0000","last_undegraded":"2024-04-18T21:10:20.484448+0000","last_fullsized":"2024-04-18T21:10:20.484448+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:58:35.802545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12586,"num_write":372,"num_write_kb":58856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":350,"num_bytes_recovered":576854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"70'53","reported_seq":82,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.545791+0000","last_change":"2024-04-18T21:10:00.550936+0000","last_active":"2024-04-18T21:10:20.545791+0000","last_peered":"2024-04-18T21:10:20.545791+0000","last_clean":"2024-04-18T21:10:20.545791+0000","last_became_active":"2024-04-18T21:10:00.549987+0000","last_became_peered":"2024-04-18T21:10:00.549987+0000","last_unstale":"2024-04-18T21:10:20.545791+0000","last_undegraded":"2024-04-18T21:10:20.545791+0000","last_fullsized":"2024-04-18T21:10:20.545791+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:53:36.771516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"71'364","reported_seq":943,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.484401+0000","last_change":"2024-04-18T21:09:58.478726+0000","last_active":"2024-04-18T21:10:20.484401+0000","last_peered":"2024-04-18T21:10:20.484401+0000","last_clean":"2024-04-18T21:10:20.484401+0000","last_became_active":"2024-04-18T21:09:58.473903+0000","last_became_peered":"2024-04-18T21:09:58.473903+0000","last_unstale":"2024-04-18T21:10:20.484401+0000","last_undegraded":"2024-04-18T21:10:20.484401+0000","last_fullsized":"2024-04-18T21:10:20.484401+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:40.377274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":37938,"num_write":336,"num_write_kb":42513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"70'460","reported_seq":573,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546197+0000","last_change":"2024-04-18T21:09:53.545846+0000","last_active":"2024-04-18T21:10:20.546197+0000","last_peered":"2024-04-18T21:10:20.546197+0000","last_clean":"2024-04-18T21:10:20.546197+0000","last_became_active":"2024-04-18T21:09:53.544355+0000","last_became_peered":"2024-04-18T21:09:53.544355+0000","last_unstale":"2024-04-18T21:10:20.546197+0000","last_undegraded":"2024-04-18T21:10:20.546197+0000","last_fullsized":"2024-04-18T21:10:20.546197+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:34:16.776752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":406,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"71'404","reported_seq":978,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.480186+0000","last_change":"2024-04-18T21:10:15.507332+0000","last_active":"2024-04-18T21:10:20.480186+0000","last_peered":"2024-04-18T21:10:20.480186+0000","last_clean":"2024-04-18T21:10:20.480186+0000","last_became_active":"2024-04-18T21:10:15.504379+0000","last_became_peered":"2024-04-18T21:10:15.504379+0000","last_unstale":"2024-04-18T21:10:20.480186+0000","last_undegraded":"2024-04-18T21:10:20.480186+0000","last_fullsized":"2024-04-18T21:10:20.480186+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:33:14.728553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":7075,"num_write":367,"num_write_kb":62738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":383,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482924+0000","last_change":"2024-04-18T21:10:00.497960+0000","last_active":"2024-04-18T21:10:20.482924+0000","last_peered":"2024-04-18T21:10:20.482924+0000","last_clean":"2024-04-18T21:10:20.482924+0000","last_became_active":"2024-04-18T21:10:00.496373+0000","last_became_peered":"2024-04-18T21:10:00.496373+0000","last_unstale":"2024-04-18T21:10:20.482924+0000","last_undegraded":"2024-04-18T21:10:20.482924+0000","last_fullsized":"2024-04-18T21:10:20.482924+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_clean_scrub_stamp":"2024-04-18T21:04:53.494814+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:56:52.975720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":159,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483821+0000","last_change":"2024-04-18T21:10:00.487584+0000","last_active":"2024-04-18T21:10:20.483821+0000","last_peered":"2024-04-18T21:10:20.483821+0000","last_clean":"2024-04-18T21:10:20.483821+0000","last_became_active":"2024-04-18T21:10:00.486722+0000","last_became_peered":"2024-04-18T21:10:00.486722+0000","last_unstale":"2024-04-18T21:10:20.483821+0000","last_undegraded":"2024-04-18T21:10:20.483821+0000","last_fullsized":"2024-04-18T21:10:20.483821+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:17:03.176148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"70'595","reported_seq":750,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.478616+0000","last_change":"2024-04-18T21:10:03.488427+0000","last_active":"2024-04-18T21:10:20.478616+0000","last_peered":"2024-04-18T21:10:20.478616+0000","last_clean":"2024-04-18T21:10:20.478616+0000","last_became_active":"2024-04-18T21:10:03.481344+0000","last_became_peered":"2024-04-18T21:10:03.481344+0000","last_unstale":"2024-04-18T21:10:20.478616+0000","last_undegraded":"2024-04-18T21:10:20.478616+0000","last_fullsized":"2024-04-18T21:10:20.478616+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:41.583248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":539,"num_write_kb":8449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4689862,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'443","reported_seq":1089,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.484583+0000","last_change":"2024-04-18T21:09:56.496310+0000","last_active":"2024-04-18T21:10:20.484583+0000","last_peered":"2024-04-18T21:10:20.484583+0000","last_clean":"2024-04-18T21:10:20.484583+0000","last_became_active":"2024-04-18T21:09:56.493327+0000","last_became_peered":"2024-04-18T21:09:56.493327+0000","last_unstale":"2024-04-18T21:10:20.484583+0000","last_undegraded":"2024-04-18T21:10:20.484583+0000","last_fullsized":"2024-04-18T21:10:20.484583+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:20:57.340997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":38975,"num_write":404,"num_write_kb":80038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":209,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482719+0000","last_change":"2024-04-18T21:09:50.817029+0000","last_active":"2024-04-18T21:10:20.482719+0000","last_peered":"2024-04-18T21:10:20.482719+0000","last_clean":"2024-04-18T21:10:20.482719+0000","last_became_active":"2024-04-18T21:09:50.816543+0000","last_became_peered":"2024-04-18T21:09:50.816543+0000","last_unstale":"2024-04-18T21:10:20.482719+0000","last_undegraded":"2024-04-18T21:10:20.482719+0000","last_fullsized":"2024-04-18T21:10:20.482719+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:47:33.047727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"70'129","reported_seq":312,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.478205+0000","last_change":"2024-04-18T21:10:03.489109+0000","last_active":"2024-04-18T21:10:20.478205+0000","last_peered":"2024-04-18T21:10:20.478205+0000","last_clean":"2024-04-18T21:10:20.478205+0000","last_became_active":"2024-04-18T21:10:03.486859+0000","last_became_peered":"2024-04-18T21:10:03.486859+0000","last_unstale":"2024-04-18T21:10:20.478205+0000","last_undegraded":"2024-04-18T21:10:20.478205+0000","last_fullsized":"2024-04-18T21:10:20.478205+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:52:04.172480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466419,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":55,"num_read_kb":1405,"num_write":58,"num_write_kb":1469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'457","reported_seq":680,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.548347+0000","last_change":"2024-04-18T21:10:09.543207+0000","last_active":"2024-04-18T21:10:20.548347+0000","last_peered":"2024-04-18T21:10:20.548347+0000","last_clean":"2024-04-18T21:10:20.548347+0000","last_became_active":"2024-04-18T21:10:09.537428+0000","last_became_peered":"2024-04-18T21:10:09.537428+0000","last_unstale":"2024-04-18T21:10:20.548347+0000","last_undegraded":"2024-04-18T21:10:20.548347+0000","last_fullsized":"2024-04-18T21:10:20.548347+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:21.987918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":27659,"num_write":426,"num_write_kb":80500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":208,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.478812+0000","last_change":"2024-04-18T21:09:50.832624+0000","last_active":"2024-04-18T21:10:20.478812+0000","last_peered":"2024-04-18T21:10:20.478812+0000","last_clean":"2024-04-18T21:10:20.478812+0000","last_became_active":"2024-04-18T21:09:50.831949+0000","last_became_peered":"2024-04-18T21:09:50.831949+0000","last_unstale":"2024-04-18T21:10:20.478812+0000","last_undegraded":"2024-04-18T21:10:20.478812+0000","last_fullsized":"2024-04-18T21:10:20.478812+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:35:45.986029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'170","reported_seq":368,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.545538+0000","last_change":"2024-04-18T21:09:53.538615+0000","last_active":"2024-04-18T21:10:20.545538+0000","last_peered":"2024-04-18T21:10:20.545538+0000","last_clean":"2024-04-18T21:10:20.545538+0000","last_became_active":"2024-04-18T21:09:53.537994+0000","last_became_peered":"2024-04-18T21:09:53.537994+0000","last_unstale":"2024-04-18T21:10:20.545538+0000","last_undegraded":"2024-04-18T21:10:20.545538+0000","last_fullsized":"2024-04-18T21:10:20.545538+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:02:34.372453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":8239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"71'346","reported_seq":910,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.480273+0000","last_change":"2024-04-18T21:10:11.487541+0000","last_active":"2024-04-18T21:10:20.480273+0000","last_peered":"2024-04-18T21:10:20.480273+0000","last_clean":"2024-04-18T21:10:20.480273+0000","last_became_active":"2024-04-18T21:10:11.484662+0000","last_became_peered":"2024-04-18T21:10:11.484662+0000","last_unstale":"2024-04-18T21:10:20.480273+0000","last_undegraded":"2024-04-18T21:10:20.480273+0000","last_fullsized":"2024-04-18T21:10:20.480273+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:50:21.491862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27042,"num_write":321,"num_write_kb":50693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":202,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483512+0000","last_change":"2024-04-18T21:05:00.576606+0000","last_active":"2024-04-18T21:10:20.483512+0000","last_peered":"2024-04-18T21:10:20.483512+0000","last_clean":"2024-04-18T21:10:20.483512+0000","last_became_active":"2024-04-18T21:05:00.575951+0000","last_became_peered":"2024-04-18T21:05:00.575951+0000","last_unstale":"2024-04-18T21:10:20.483512+0000","last_undegraded":"2024-04-18T21:10:20.483512+0000","last_fullsized":"2024-04-18T21:10:20.483512+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:32:17.612481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"70'63","reported_seq":259,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483817+0000","last_change":"2024-04-18T21:05:04.627296+0000","last_active":"2024-04-18T21:10:20.483817+0000","last_peered":"2024-04-18T21:10:20.483817+0000","last_clean":"2024-04-18T21:10:20.483817+0000","last_became_active":"2024-04-18T21:05:04.626801+0000","last_became_peered":"2024-04-18T21:05:04.626801+0000","last_unstale":"2024-04-18T21:10:20.483817+0000","last_undegraded":"2024-04-18T21:10:20.483817+0000","last_fullsized":"2024-04-18T21:10:20.483817+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:46:36.285416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"71'406","reported_seq":1041,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.479242+0000","last_change":"2024-04-18T21:09:59.495686+0000","last_active":"2024-04-18T21:10:20.479242+0000","last_peered":"2024-04-18T21:10:20.479242+0000","last_clean":"2024-04-18T21:10:20.479242+0000","last_became_active":"2024-04-18T21:09:59.493248+0000","last_became_peered":"2024-04-18T21:09:59.493248+0000","last_unstale":"2024-04-18T21:10:20.479242+0000","last_undegraded":"2024-04-18T21:10:20.479242+0000","last_fullsized":"2024-04-18T21:10:20.479242+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:11:23.853682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":35332,"num_write":370,"num_write_kb":71807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"70'284","reported_seq":315,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.484852+0000","last_change":"2024-04-18T21:10:00.504958+0000","last_active":"2024-04-18T21:10:20.484852+0000","last_peered":"2024-04-18T21:10:20.484852+0000","last_clean":"2024-04-18T21:10:20.484852+0000","last_became_active":"2024-04-18T21:10:00.503851+0000","last_became_peered":"2024-04-18T21:10:00.503851+0000","last_unstale":"2024-04-18T21:10:20.484852+0000","last_undegraded":"2024-04-18T21:10:20.484852+0000","last_fullsized":"2024-04-18T21:10:20.484852+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:10:27.397258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":218,"num_write_kb":4194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":135,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.479497+0000","last_change":"2024-04-18T21:10:03.484148+0000","last_active":"2024-04-18T21:10:20.479497+0000","last_peered":"2024-04-18T21:10:20.479497+0000","last_clean":"2024-04-18T21:10:20.479497+0000","last_became_active":"2024-04-18T21:10:03.480071+0000","last_became_peered":"2024-04-18T21:10:03.480071+0000","last_unstale":"2024-04-18T21:10:20.479497+0000","last_undegraded":"2024-04-18T21:10:20.479497+0000","last_fullsized":"2024-04-18T21:10:20.479497+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:50:30.257039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'386","reported_seq":577,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546997+0000","last_change":"2024-04-18T21:10:10.547885+0000","last_active":"2024-04-18T21:10:20.546997+0000","last_peered":"2024-04-18T21:10:20.546997+0000","last_clean":"2024-04-18T21:10:20.546997+0000","last_became_active":"2024-04-18T21:10:10.542515+0000","last_became_peered":"2024-04-18T21:10:10.542515+0000","last_unstale":"2024-04-18T21:10:20.546997+0000","last_undegraded":"2024-04-18T21:10:20.546997+0000","last_fullsized":"2024-04-18T21:10:20.546997+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:58:24.232536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14677,"num_write":355,"num_write_kb":51018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"70'55","reported_seq":257,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.479390+0000","last_change":"2024-04-18T21:09:50.833424+0000","last_active":"2024-04-18T21:10:20.479390+0000","last_peered":"2024-04-18T21:10:20.479390+0000","last_clean":"2024-04-18T21:10:20.479390+0000","last_became_active":"2024-04-18T21:09:50.832752+0000","last_became_peered":"2024-04-18T21:09:50.832752+0000","last_unstale":"2024-04-18T21:10:20.479390+0000","last_undegraded":"2024-04-18T21:10:20.479390+0000","last_fullsized":"2024-04-18T21:10:20.479390+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:48.945329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":165,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.548117+0000","last_change":"2024-04-18T21:09:50.900338+0000","last_active":"2024-04-18T21:10:20.548117+0000","last_peered":"2024-04-18T21:10:20.548117+0000","last_clean":"2024-04-18T21:10:20.548117+0000","last_became_active":"2024-04-18T21:09:50.896844+0000","last_became_peered":"2024-04-18T21:09:50.896844+0000","last_unstale":"2024-04-18T21:10:20.548117+0000","last_undegraded":"2024-04-18T21:10:20.548117+0000","last_fullsized":"2024-04-18T21:10:20.548117+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:11:35.543409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"71'402","reported_seq":591,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546209+0000","last_change":"2024-04-18T21:10:05.542484+0000","last_active":"2024-04-18T21:10:20.546209+0000","last_peered":"2024-04-18T21:10:20.546209+0000","last_clean":"2024-04-18T21:10:20.546209+0000","last_became_active":"2024-04-18T21:10:05.536763+0000","last_became_peered":"2024-04-18T21:10:05.536763+0000","last_unstale":"2024-04-18T21:10:20.546209+0000","last_undegraded":"2024-04-18T21:10:20.546209+0000","last_fullsized":"2024-04-18T21:10:20.546209+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:08:22.367267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12468,"num_write":369,"num_write_kb":67231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"70'60","reported_seq":263,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.480741+0000","last_change":"2024-04-18T21:09:50.832598+0000","last_active":"2024-04-18T21:10:20.480741+0000","last_peered":"2024-04-18T21:10:20.480741+0000","last_clean":"2024-04-18T21:10:20.480741+0000","last_became_active":"2024-04-18T21:09:50.832030+0000","last_became_peered":"2024-04-18T21:09:50.832030+0000","last_unstale":"2024-04-18T21:10:20.480741+0000","last_undegraded":"2024-04-18T21:10:20.480741+0000","last_fullsized":"2024-04-18T21:10:20.480741+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:10:27.397258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":135,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.480666+0000","last_change":"2024-04-18T21:10:03.492761+0000","last_active":"2024-04-18T21:10:20.480666+0000","last_peered":"2024-04-18T21:10:20.480666+0000","last_clean":"2024-04-18T21:10:20.480666+0000","last_became_active":"2024-04-18T21:10:03.492145+0000","last_became_peered":"2024-04-18T21:10:03.492145+0000","last_unstale":"2024-04-18T21:10:20.480666+0000","last_undegraded":"2024-04-18T21:10:20.480666+0000","last_fullsized":"2024-04-18T21:10:20.480666+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:20:00.853523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'421","reported_seq":628,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.477954+0000","last_change":"2024-04-18T21:10:03.488774+0000","last_active":"2024-04-18T21:10:20.477954+0000","last_peered":"2024-04-18T21:10:20.477954+0000","last_clean":"2024-04-18T21:10:20.477954+0000","last_became_active":"2024-04-18T21:10:03.479773+0000","last_became_peered":"2024-04-18T21:10:03.479773+0000","last_unstale":"2024-04-18T21:10:20.477954+0000","last_undegraded":"2024-04-18T21:10:20.477954+0000","last_fullsized":"2024-04-18T21:10:20.477954+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:15:12.326904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":16183,"num_write":377,"num_write_kb":50451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"71'110","reported_seq":325,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.480498+0000","last_change":"2024-04-18T21:10:00.497917+0000","last_active":"2024-04-18T21:10:20.480498+0000","last_peered":"2024-04-18T21:10:20.480498+0000","last_clean":"2024-04-18T21:10:20.480498+0000","last_became_active":"2024-04-18T21:10:00.494644+0000","last_became_peered":"2024-04-18T21:10:00.494644+0000","last_unstale":"2024-04-18T21:10:20.480498+0000","last_undegraded":"2024-04-18T21:10:20.480498+0000","last_fullsized":"2024-04-18T21:10:20.480498+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:40:57.347353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":1251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":160,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.484841+0000","last_change":"2024-04-18T21:10:00.493764+0000","last_active":"2024-04-18T21:10:20.484841+0000","last_peered":"2024-04-18T21:10:20.484841+0000","last_clean":"2024-04-18T21:10:20.484841+0000","last_became_active":"2024-04-18T21:10:00.492672+0000","last_became_peered":"2024-04-18T21:10:00.492672+0000","last_unstale":"2024-04-18T21:10:20.484841+0000","last_undegraded":"2024-04-18T21:10:20.484841+0000","last_fullsized":"2024-04-18T21:10:20.484841+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:48:46.709401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'384","reported_seq":597,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546833+0000","last_change":"2024-04-18T21:09:57.572865+0000","last_active":"2024-04-18T21:10:20.546833+0000","last_peered":"2024-04-18T21:10:20.546833+0000","last_clean":"2024-04-18T21:10:20.546833+0000","last_became_active":"2024-04-18T21:09:57.567962+0000","last_became_peered":"2024-04-18T21:09:57.567962+0000","last_unstale":"2024-04-18T21:10:20.546833+0000","last_undegraded":"2024-04-18T21:10:20.546833+0000","last_fullsized":"2024-04-18T21:10:20.546833+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:51:24.627186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":15567,"num_write":351,"num_write_kb":42959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"71'396","reported_seq":924,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483421+0000","last_change":"2024-04-18T21:10:13.482151+0000","last_active":"2024-04-18T21:10:20.483421+0000","last_peered":"2024-04-18T21:10:20.483421+0000","last_clean":"2024-04-18T21:10:20.483421+0000","last_became_active":"2024-04-18T21:10:13.479320+0000","last_became_peered":"2024-04-18T21:10:13.479320+0000","last_unstale":"2024-04-18T21:10:20.483421+0000","last_undegraded":"2024-04-18T21:10:20.483421+0000","last_fullsized":"2024-04-18T21:10:20.483421+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:33:52.248167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12943,"num_write":353,"num_write_kb":35357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":342,"num_bytes_recovered":3500882,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"71'277","reported_seq":318,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483992+0000","last_change":"2024-04-18T21:10:00.495047+0000","last_active":"2024-04-18T21:10:20.483992+0000","last_peered":"2024-04-18T21:10:20.483992+0000","last_clean":"2024-04-18T21:10:20.483992+0000","last_became_active":"2024-04-18T21:10:00.493088+0000","last_became_peered":"2024-04-18T21:10:00.493088+0000","last_unstale":"2024-04-18T21:10:20.483992+0000","last_undegraded":"2024-04-18T21:10:20.483992+0000","last_fullsized":"2024-04-18T21:10:20.483992+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:39:08.263781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":221,"num_write_kb":8303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":8389370,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'411","reported_seq":1007,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.477964+0000","last_change":"2024-04-18T21:10:04.485332+0000","last_active":"2024-04-18T21:10:20.477964+0000","last_peered":"2024-04-18T21:10:20.477964+0000","last_clean":"2024-04-18T21:10:20.477964+0000","last_became_active":"2024-04-18T21:10:04.482320+0000","last_became_peered":"2024-04-18T21:10:04.482320+0000","last_unstale":"2024-04-18T21:10:20.477964+0000","last_undegraded":"2024-04-18T21:10:20.477964+0000","last_fullsized":"2024-04-18T21:10:20.477964+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:35:57.043682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":17179,"num_write":375,"num_write_kb":38991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"70'85","reported_seq":168,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547812+0000","last_change":"2024-04-18T21:09:50.890616+0000","last_active":"2024-04-18T21:10:20.547812+0000","last_peered":"2024-04-18T21:10:20.547812+0000","last_clean":"2024-04-18T21:10:20.547812+0000","last_became_active":"2024-04-18T21:09:50.874855+0000","last_became_peered":"2024-04-18T21:09:50.874855+0000","last_unstale":"2024-04-18T21:10:20.547812+0000","last_undegraded":"2024-04-18T21:10:20.547812+0000","last_fullsized":"2024-04-18T21:10:20.547812+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:03:54.726282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"70'230","reported_seq":259,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.484617+0000","last_change":"2024-04-18T21:10:00.499373+0000","last_active":"2024-04-18T21:10:20.484617+0000","last_peered":"2024-04-18T21:10:20.484617+0000","last_clean":"2024-04-18T21:10:20.484617+0000","last_became_active":"2024-04-18T21:10:00.498141+0000","last_became_peered":"2024-04-18T21:10:00.498141+0000","last_unstale":"2024-04-18T21:10:20.484617+0000","last_undegraded":"2024-04-18T21:10:20.484617+0000","last_fullsized":"2024-04-18T21:10:20.484617+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:55:01.865593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":4178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"71'493","reported_seq":732,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.477822+0000","last_change":"2024-04-18T21:05:05.642793+0000","last_active":"2024-04-18T21:10:20.477822+0000","last_peered":"2024-04-18T21:10:20.477822+0000","last_clean":"2024-04-18T21:10:20.477822+0000","last_became_active":"2024-04-18T21:05:05.641983+0000","last_became_peered":"2024-04-18T21:05:05.641983+0000","last_unstale":"2024-04-18T21:10:20.477822+0000","last_undegraded":"2024-04-18T21:10:20.477822+0000","last_fullsized":"2024-04-18T21:10:20.477822+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:46:36.339289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23833,"num_write":461,"num_write_kb":76873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"70'62","reported_seq":257,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.480547+0000","last_change":"2024-04-18T21:05:04.641445+0000","last_active":"2024-04-18T21:10:20.480547+0000","last_peered":"2024-04-18T21:10:20.480547+0000","last_clean":"2024-04-18T21:10:20.480547+0000","last_became_active":"2024-04-18T21:05:04.640682+0000","last_became_peered":"2024-04-18T21:05:04.640682+0000","last_unstale":"2024-04-18T21:10:20.480547+0000","last_undegraded":"2024-04-18T21:10:20.480547+0000","last_fullsized":"2024-04-18T21:10:20.480547+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:46:36.285416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'436","reported_seq":1063,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.477947+0000","last_change":"2024-04-18T21:10:18.490900+0000","last_active":"2024-04-18T21:10:20.477947+0000","last_peered":"2024-04-18T21:10:20.477947+0000","last_clean":"2024-04-18T21:10:20.477947+0000","last_became_active":"2024-04-18T21:10:18.487788+0000","last_became_peered":"2024-04-18T21:10:18.487788+0000","last_unstale":"2024-04-18T21:10:20.477947+0000","last_undegraded":"2024-04-18T21:10:20.477947+0000","last_fullsized":"2024-04-18T21:10:20.477947+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:57:00.495580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14561,"num_write":408,"num_write_kb":47462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'369","reported_seq":571,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.548399+0000","last_change":"2024-04-18T21:10:02.553999+0000","last_active":"2024-04-18T21:10:20.548399+0000","last_peered":"2024-04-18T21:10:20.548399+0000","last_clean":"2024-04-18T21:10:20.548399+0000","last_became_active":"2024-04-18T21:10:02.549471+0000","last_became_peered":"2024-04-18T21:10:02.549471+0000","last_unstale":"2024-04-18T21:10:20.548399+0000","last_undegraded":"2024-04-18T21:10:20.548399+0000","last_fullsized":"2024-04-18T21:10:20.548399+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:52:14.371235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13619,"num_write":339,"num_write_kb":63086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"70'888","reported_seq":1030,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.478410+0000","last_change":"2024-04-18T21:10:03.486911+0000","last_active":"2024-04-18T21:10:20.478410+0000","last_peered":"2024-04-18T21:10:20.478410+0000","last_clean":"2024-04-18T21:10:20.478410+0000","last_became_active":"2024-04-18T21:10:03.480576+0000","last_became_peered":"2024-04-18T21:10:03.480576+0000","last_unstale":"2024-04-18T21:10:20.478410+0000","last_undegraded":"2024-04-18T21:10:20.478410+0000","last_fullsized":"2024-04-18T21:10:20.478410+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:41:06.632064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":823,"num_write_kb":8582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'398","reported_seq":562,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.479937+0000","last_change":"2024-04-18T21:10:03.491426+0000","last_active":"2024-04-18T21:10:20.479937+0000","last_peered":"2024-04-18T21:10:20.479937+0000","last_clean":"2024-04-18T21:10:20.479937+0000","last_became_active":"2024-04-18T21:10:03.483190+0000","last_became_peered":"2024-04-18T21:10:03.483190+0000","last_unstale":"2024-04-18T21:10:20.479937+0000","last_undegraded":"2024-04-18T21:10:20.479937+0000","last_fullsized":"2024-04-18T21:10:20.479937+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:05:10.611580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14684,"num_write":380,"num_write_kb":88822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"70'169","reported_seq":384,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.478144+0000","last_change":"2024-04-18T21:10:00.494974+0000","last_active":"2024-04-18T21:10:20.478144+0000","last_peered":"2024-04-18T21:10:20.478144+0000","last_clean":"2024-04-18T21:10:20.478144+0000","last_became_active":"2024-04-18T21:10:00.492196+0000","last_became_peered":"2024-04-18T21:10:00.492196+0000","last_unstale":"2024-04-18T21:10:20.478144+0000","last_undegraded":"2024-04-18T21:10:20.478144+0000","last_fullsized":"2024-04-18T21:10:20.478144+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:33:51.236211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":4162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'406","reported_seq":630,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546278+0000","last_change":"2024-04-18T21:10:12.553754+0000","last_active":"2024-04-18T21:10:20.546278+0000","last_peered":"2024-04-18T21:10:20.546278+0000","last_clean":"2024-04-18T21:10:20.546278+0000","last_became_active":"2024-04-18T21:10:12.546148+0000","last_became_peered":"2024-04-18T21:10:12.546148+0000","last_unstale":"2024-04-18T21:10:20.546278+0000","last_undegraded":"2024-04-18T21:10:20.546278+0000","last_fullsized":"2024-04-18T21:10:20.546278+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:12:37.876185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27495,"num_write":363,"num_write_kb":89134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"72'192","reported_seq":385,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546350+0000","last_change":"2024-04-18T21:09:53.541766+0000","last_active":"2024-04-18T21:10:20.546350+0000","last_peered":"2024-04-18T21:10:20.546350+0000","last_clean":"2024-04-18T21:10:20.546350+0000","last_became_active":"2024-04-18T21:09:53.541300+0000","last_became_peered":"2024-04-18T21:09:53.541300+0000","last_unstale":"2024-04-18T21:10:20.546350+0000","last_undegraded":"2024-04-18T21:10:20.546350+0000","last_fullsized":"2024-04-18T21:10:20.546350+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:26:14.718922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12425030,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":12201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8230726,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"71'383","reported_seq":617,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547547+0000","last_change":"2024-04-18T21:09:55.555798+0000","last_active":"2024-04-18T21:10:20.547547+0000","last_peered":"2024-04-18T21:10:20.547547+0000","last_clean":"2024-04-18T21:10:20.547547+0000","last_became_active":"2024-04-18T21:09:55.551135+0000","last_became_peered":"2024-04-18T21:09:55.551135+0000","last_unstale":"2024-04-18T21:10:20.547547+0000","last_undegraded":"2024-04-18T21:10:20.547547+0000","last_fullsized":"2024-04-18T21:10:20.547547+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:00:01.739082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21614,"num_write":351,"num_write_kb":79501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"70'66","reported_seq":159,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546526+0000","last_change":"2024-04-18T21:10:00.553114+0000","last_active":"2024-04-18T21:10:20.546526+0000","last_peered":"2024-04-18T21:10:20.546526+0000","last_clean":"2024-04-18T21:10:20.546526+0000","last_became_active":"2024-04-18T21:10:00.552067+0000","last_became_peered":"2024-04-18T21:10:00.552067+0000","last_unstale":"2024-04-18T21:10:20.546526+0000","last_undegraded":"2024-04-18T21:10:20.546526+0000","last_fullsized":"2024-04-18T21:10:20.546526+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:51:32.567297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"71'345","reported_seq":546,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483218+0000","last_change":"2024-04-18T21:05:05.624840+0000","last_active":"2024-04-18T21:10:20.483218+0000","last_peered":"2024-04-18T21:10:20.483218+0000","last_clean":"2024-04-18T21:10:20.483218+0000","last_became_active":"2024-04-18T21:05:05.622950+0000","last_became_peered":"2024-04-18T21:05:05.622950+0000","last_unstale":"2024-04-18T21:10:20.483218+0000","last_undegraded":"2024-04-18T21:10:20.483218+0000","last_fullsized":"2024-04-18T21:10:20.483218+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:27:17.530889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":317,"num_write_kb":29335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"70'171","reported_seq":286,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483766+0000","last_change":"2024-04-18T21:10:00.507624+0000","last_active":"2024-04-18T21:10:20.483766+0000","last_peered":"2024-04-18T21:10:20.483766+0000","last_clean":"2024-04-18T21:10:20.483766+0000","last_became_active":"2024-04-18T21:10:00.507132+0000","last_became_peered":"2024-04-18T21:10:00.507132+0000","last_unstale":"2024-04-18T21:10:20.483766+0000","last_undegraded":"2024-04-18T21:10:20.483766+0000","last_fullsized":"2024-04-18T21:10:20.483766+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:35:50.013019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":4154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"71'417","reported_seq":643,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483150+0000","last_change":"2024-04-18T21:05:05.627962+0000","last_active":"2024-04-18T21:10:20.483150+0000","last_peered":"2024-04-18T21:10:20.483150+0000","last_clean":"2024-04-18T21:10:20.483150+0000","last_became_active":"2024-04-18T21:05:05.626698+0000","last_became_peered":"2024-04-18T21:05:05.626698+0000","last_unstale":"2024-04-18T21:10:20.483150+0000","last_undegraded":"2024-04-18T21:10:20.483150+0000","last_fullsized":"2024-04-18T21:10:20.483150+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:48:48.973087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":17040,"num_write":384,"num_write_kb":83740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"70'276","reported_seq":471,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547237+0000","last_change":"2024-04-18T21:09:53.543611+0000","last_active":"2024-04-18T21:10:20.547237+0000","last_peered":"2024-04-18T21:10:20.547237+0000","last_clean":"2024-04-18T21:10:20.547237+0000","last_became_active":"2024-04-18T21:09:53.542863+0000","last_became_peered":"2024-04-18T21:09:53.542863+0000","last_unstale":"2024-04-18T21:10:20.547237+0000","last_undegraded":"2024-04-18T21:10:20.547237+0000","last_fullsized":"2024-04-18T21:10:20.547237+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:22.582074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":12399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"71'428","reported_seq":637,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546271+0000","last_change":"2024-04-18T21:10:08.541152+0000","last_active":"2024-04-18T21:10:20.546271+0000","last_peered":"2024-04-18T21:10:20.546271+0000","last_clean":"2024-04-18T21:10:20.546271+0000","last_became_active":"2024-04-18T21:10:08.536423+0000","last_became_peered":"2024-04-18T21:10:08.536423+0000","last_unstale":"2024-04-18T21:10:20.546271+0000","last_undegraded":"2024-04-18T21:10:20.546271+0000","last_fullsized":"2024-04-18T21:10:20.546271+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:26.666677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22548,"num_write":398,"num_write_kb":75972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"70'70","reported_seq":273,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.480343+0000","last_change":"2024-04-18T21:09:50.833350+0000","last_active":"2024-04-18T21:10:20.480343+0000","last_peered":"2024-04-18T21:10:20.480343+0000","last_clean":"2024-04-18T21:10:20.480343+0000","last_became_active":"2024-04-18T21:09:50.832355+0000","last_became_peered":"2024-04-18T21:09:50.832355+0000","last_unstale":"2024-04-18T21:10:20.480343+0000","last_undegraded":"2024-04-18T21:10:20.480343+0000","last_fullsized":"2024-04-18T21:10:20.480343+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:39:09.627425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'459","reported_seq":642,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482639+0000","last_change":"2024-04-18T21:10:01.503378+0000","last_active":"2024-04-18T21:10:20.482639+0000","last_peered":"2024-04-18T21:10:20.482639+0000","last_clean":"2024-04-18T21:10:20.482639+0000","last_became_active":"2024-04-18T21:10:01.497275+0000","last_became_peered":"2024-04-18T21:10:01.497275+0000","last_unstale":"2024-04-18T21:10:20.482639+0000","last_undegraded":"2024-04-18T21:10:20.482639+0000","last_fullsized":"2024-04-18T21:10:20.482639+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:40:35.832428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13353,"num_write":429,"num_write_kb":88123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"70'113","reported_seq":332,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.480338+0000","last_change":"2024-04-18T21:10:00.499468+0000","last_active":"2024-04-18T21:10:20.480338+0000","last_peered":"2024-04-18T21:10:20.480338+0000","last_clean":"2024-04-18T21:10:20.480338+0000","last_became_active":"2024-04-18T21:10:00.494734+0000","last_became_peered":"2024-04-18T21:10:00.494734+0000","last_unstale":"2024-04-18T21:10:20.480338+0000","last_undegraded":"2024-04-18T21:10:20.480338+0000","last_fullsized":"2024-04-18T21:10:20.480338+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:58:34.790588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194886,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2531,"num_read_kb":1304649,"num_write":24542,"num_write_kb":4299443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8145,"num_bytes_recovered":4488063,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26603,"ondisk_log_size":26603,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127139127,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":55,"num_read_kb":1405,"num_write":4542,"num_write_kb":127514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":92002768,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254345216,"data_stored":254278254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4409,"internal_metadata":0},"log_size":6331,"ondisk_log_size":6331,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738439,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":187628,"kb_used_data":80152,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94184212,"statfs":{"total":96636764160,"available":96444633088,"internally_reserved":0,"allocated":82075648,"data_stored":81480582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110033349},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":77,"seq":330712481801,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":147296,"kb_used_data":83404,"kb_used_omap":5,"kb_used_meta":63866,"kb_avail":94224544,"statfs":{"total":96636764160,"available":96485933056,"internally_reserved":0,"allocated":85405696,"data_stored":84799073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6004,"internal_metadata":65398924},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738437,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":160468,"kb_used_data":89096,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94211372,"statfs":{"total":96636764160,"available":96472444928,"internally_reserved":0,"allocated":91234304,"data_stored":90618294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":89579520,"data_stored":89548273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":83750912,"data_stored":83729052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4409,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81014784,"data_stored":81000929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:10:25.961 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:10:26.281 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:10:26.283 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-04-18T21:10:26.299 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":272,"stamp":"2024-04-18T21:10:24.639147+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127729495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2722,"num_read_kb":1306172,"num_write":29287,"num_write_kb":4430417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8182,"num_bytes_recovered":97081199,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33091,"ondisk_log_size":33091,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":495392,"kb_used_data":252652,"kb_used_omap":8,"kb_used_meta":242679,"kb_avail":282620128,"statfs":{"total":289910292480,"available":289403011072,"internally_reserved":0,"allocated":258715648,"data_stored":256897949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9194,"internal_metadata":248503318},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-758,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1054,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.165240"},"pg_stats":[{"pgid":"4.3f","version":"71'418","reported_seq":614,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.548813+0000","last_change":"2024-04-18T21:10:16.576720+0000","last_active":"2024-04-18T21:10:20.548813+0000","last_peered":"2024-04-18T21:10:20.548813+0000","last_clean":"2024-04-18T21:10:20.548813+0000","last_became_active":"2024-04-18T21:10:16.571985+0000","last_became_peered":"2024-04-18T21:10:16.571985+0000","last_unstale":"2024-04-18T21:10:20.548813+0000","last_undegraded":"2024-04-18T21:10:20.548813+0000","last_fullsized":"2024-04-18T21:10:20.548813+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:28:48.196628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":19677,"num_write":386,"num_write_kb":87615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"71'417","reported_seq":631,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.548242+0000","last_change":"2024-04-18T21:10:05.546965+0000","last_active":"2024-04-18T21:10:20.548242+0000","last_peered":"2024-04-18T21:10:20.548242+0000","last_clean":"2024-04-18T21:10:20.548242+0000","last_became_active":"2024-04-18T21:10:05.541170+0000","last_became_peered":"2024-04-18T21:10:05.541170+0000","last_unstale":"2024-04-18T21:10:20.548242+0000","last_undegraded":"2024-04-18T21:10:20.548242+0000","last_fullsized":"2024-04-18T21:10:20.548242+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:04:05.630763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":12123,"num_write":387,"num_write_kb":47157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"71'379","reported_seq":940,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483812+0000","last_change":"2024-04-18T21:09:54.480753+0000","last_active":"2024-04-18T21:10:20.483812+0000","last_peered":"2024-04-18T21:10:20.483812+0000","last_clean":"2024-04-18T21:10:20.483812+0000","last_became_active":"2024-04-18T21:09:54.478020+0000","last_became_peered":"2024-04-18T21:09:54.478020+0000","last_unstale":"2024-04-18T21:10:20.483812+0000","last_undegraded":"2024-04-18T21:10:20.483812+0000","last_fullsized":"2024-04-18T21:10:20.483812+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:24:18.705477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":10040,"num_write":353,"num_write_kb":63202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'372","reported_seq":574,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483063+0000","last_change":"2024-04-18T21:05:05.629321+0000","last_active":"2024-04-18T21:10:20.483063+0000","last_peered":"2024-04-18T21:10:20.483063+0000","last_clean":"2024-04-18T21:10:20.483063+0000","last_became_active":"2024-04-18T21:05:05.627956+0000","last_became_peered":"2024-04-18T21:05:05.627956+0000","last_unstale":"2024-04-18T21:10:20.483063+0000","last_undegraded":"2024-04-18T21:10:20.483063+0000","last_fullsized":"2024-04-18T21:10:20.483063+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:15:28.458476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2735,"num_write":328,"num_write_kb":22107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"71'416","reported_seq":616,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546812+0000","last_change":"2024-04-18T21:10:00.560644+0000","last_active":"2024-04-18T21:10:20.546812+0000","last_peered":"2024-04-18T21:10:20.546812+0000","last_clean":"2024-04-18T21:10:20.546812+0000","last_became_active":"2024-04-18T21:10:00.553862+0000","last_became_peered":"2024-04-18T21:10:00.553862+0000","last_unstale":"2024-04-18T21:10:20.546812+0000","last_undegraded":"2024-04-18T21:10:20.546812+0000","last_fullsized":"2024-04-18T21:10:20.546812+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:11:49.688538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6533,"num_write":389,"num_write_kb":43666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"71'374","reported_seq":574,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482584+0000","last_change":"2024-04-18T21:10:01.495684+0000","last_active":"2024-04-18T21:10:20.482584+0000","last_peered":"2024-04-18T21:10:20.482584+0000","last_clean":"2024-04-18T21:10:20.482584+0000","last_became_active":"2024-04-18T21:10:01.486640+0000","last_became_peered":"2024-04-18T21:10:01.486640+0000","last_unstale":"2024-04-18T21:10:20.482584+0000","last_undegraded":"2024-04-18T21:10:20.482584+0000","last_fullsized":"2024-04-18T21:10:20.482584+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:39:10.639381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20415,"num_write":354,"num_write_kb":34462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'418","reported_seq":652,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482999+0000","last_change":"2024-04-18T21:05:05.625047+0000","last_active":"2024-04-18T21:10:20.482999+0000","last_peered":"2024-04-18T21:10:20.482999+0000","last_clean":"2024-04-18T21:10:20.482999+0000","last_became_active":"2024-04-18T21:05:05.622781+0000","last_became_peered":"2024-04-18T21:05:05.622781+0000","last_unstale":"2024-04-18T21:10:20.482999+0000","last_undegraded":"2024-04-18T21:10:20.482999+0000","last_fullsized":"2024-04-18T21:10:20.482999+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:12.944469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21103,"num_write":385,"num_write_kb":50678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"71'399","reported_seq":638,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.481939+0000","last_change":"2024-04-18T21:10:00.495543+0000","last_active":"2024-04-18T21:10:20.481939+0000","last_peered":"2024-04-18T21:10:20.481939+0000","last_clean":"2024-04-18T21:10:20.481939+0000","last_became_active":"2024-04-18T21:10:00.488705+0000","last_became_peered":"2024-04-18T21:10:00.488705+0000","last_unstale":"2024-04-18T21:10:20.481939+0000","last_undegraded":"2024-04-18T21:10:20.481939+0000","last_fullsized":"2024-04-18T21:10:20.481939+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:11.892092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":44692,"num_write":361,"num_write_kb":105170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"71'385","reported_seq":950,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.479921+0000","last_change":"2024-04-18T21:10:06.487113+0000","last_active":"2024-04-18T21:10:20.479921+0000","last_peered":"2024-04-18T21:10:20.479921+0000","last_clean":"2024-04-18T21:10:20.479921+0000","last_became_active":"2024-04-18T21:10:06.482087+0000","last_became_peered":"2024-04-18T21:10:06.482087+0000","last_unstale":"2024-04-18T21:10:20.479921+0000","last_undegraded":"2024-04-18T21:10:20.479921+0000","last_fullsized":"2024-04-18T21:10:20.479921+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:10:51.435131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":994,"num_write":358,"num_write_kb":25964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'409","reported_seq":644,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546781+0000","last_change":"2024-04-18T21:10:12.550697+0000","last_active":"2024-04-18T21:10:20.546781+0000","last_peered":"2024-04-18T21:10:20.546781+0000","last_clean":"2024-04-18T21:10:20.546781+0000","last_became_active":"2024-04-18T21:10:12.546621+0000","last_became_peered":"2024-04-18T21:10:12.546621+0000","last_unstale":"2024-04-18T21:10:20.546781+0000","last_undegraded":"2024-04-18T21:10:20.546781+0000","last_fullsized":"2024-04-18T21:10:20.546781+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:55:30.422126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":26170,"num_write":372,"num_write_kb":83931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"71'366","reported_seq":577,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483819+0000","last_change":"2024-04-18T21:10:01.496068+0000","last_active":"2024-04-18T21:10:20.483819+0000","last_peered":"2024-04-18T21:10:20.483819+0000","last_clean":"2024-04-18T21:10:20.483819+0000","last_became_active":"2024-04-18T21:10:01.488047+0000","last_became_peered":"2024-04-18T21:10:01.488047+0000","last_unstale":"2024-04-18T21:10:20.483819+0000","last_undegraded":"2024-04-18T21:10:20.483819+0000","last_fullsized":"2024-04-18T21:10:20.483819+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:49.957286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":18907,"num_write":347,"num_write_kb":26153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"71'346","reported_seq":549,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547957+0000","last_change":"2024-04-18T21:10:00.560349+0000","last_active":"2024-04-18T21:10:20.547957+0000","last_peered":"2024-04-18T21:10:20.547957+0000","last_clean":"2024-04-18T21:10:20.547957+0000","last_became_active":"2024-04-18T21:10:00.557412+0000","last_became_peered":"2024-04-18T21:10:00.557412+0000","last_unstale":"2024-04-18T21:10:20.547957+0000","last_undegraded":"2024-04-18T21:10:20.547957+0000","last_fullsized":"2024-04-18T21:10:20.547957+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:54:33.428937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":6245,"num_write":324,"num_write_kb":37970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"71'417","reported_seq":638,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547313+0000","last_change":"2024-04-18T21:10:02.555899+0000","last_active":"2024-04-18T21:10:20.547313+0000","last_peered":"2024-04-18T21:10:20.547313+0000","last_clean":"2024-04-18T21:10:20.547313+0000","last_became_active":"2024-04-18T21:10:02.551406+0000","last_became_peered":"2024-04-18T21:10:02.551406+0000","last_unstale":"2024-04-18T21:10:20.547313+0000","last_undegraded":"2024-04-18T21:10:20.547313+0000","last_fullsized":"2024-04-18T21:10:20.547313+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:41:17.455669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":21623,"num_write":381,"num_write_kb":71306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"71'398","reported_seq":977,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482881+0000","last_change":"2024-04-18T21:10:11.491565+0000","last_active":"2024-04-18T21:10:20.482881+0000","last_peered":"2024-04-18T21:10:20.482881+0000","last_clean":"2024-04-18T21:10:20.482881+0000","last_became_active":"2024-04-18T21:10:11.486593+0000","last_became_peered":"2024-04-18T21:10:11.486593+0000","last_unstale":"2024-04-18T21:10:20.482881+0000","last_undegraded":"2024-04-18T21:10:20.482881+0000","last_fullsized":"2024-04-18T21:10:20.482881+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:11:23.853682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":369,"num_write_kb":30006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'435","reported_seq":1102,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482470+0000","last_change":"2024-04-18T21:10:15.509238+0000","last_active":"2024-04-18T21:10:20.482470+0000","last_peered":"2024-04-18T21:10:20.482470+0000","last_clean":"2024-04-18T21:10:20.482470+0000","last_became_active":"2024-04-18T21:10:15.506328+0000","last_became_peered":"2024-04-18T21:10:15.506328+0000","last_unstale":"2024-04-18T21:10:20.482470+0000","last_undegraded":"2024-04-18T21:10:20.482470+0000","last_fullsized":"2024-04-18T21:10:20.482470+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:49:44.996311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":31523,"num_write":402,"num_write_kb":121466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":346,"num_bytes_recovered":410327,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'446","reported_seq":687,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482015+0000","last_change":"2024-04-18T21:05:05.638203+0000","last_active":"2024-04-18T21:10:20.482015+0000","last_peered":"2024-04-18T21:10:20.482015+0000","last_clean":"2024-04-18T21:10:20.482015+0000","last_became_active":"2024-04-18T21:05:05.637352+0000","last_became_peered":"2024-04-18T21:05:05.637352+0000","last_unstale":"2024-04-18T21:10:20.482015+0000","last_undegraded":"2024-04-18T21:10:20.482015+0000","last_fullsized":"2024-04-18T21:10:20.482015+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":23833,"num_write":418,"num_write_kb":59679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"71'403","reported_seq":956,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.490427+0000","last_change":"2024-04-18T21:10:20.490427+0000","last_active":"2024-04-18T21:10:20.490427+0000","last_peered":"2024-04-18T21:10:20.490427+0000","last_clean":"2024-04-18T21:10:20.490427+0000","last_became_active":"2024-04-18T21:10:20.487409+0000","last_became_peered":"2024-04-18T21:10:20.487409+0000","last_unstale":"2024-04-18T21:10:20.490427+0000","last_undegraded":"2024-04-18T21:10:20.490427+0000","last_fullsized":"2024-04-18T21:10:20.490427+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:22:40.301941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":7482,"num_write":371,"num_write_kb":25957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'406","reported_seq":606,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.548073+0000","last_change":"2024-04-18T21:10:10.547457+0000","last_active":"2024-04-18T21:10:20.548073+0000","last_peered":"2024-04-18T21:10:20.548073+0000","last_clean":"2024-04-18T21:10:20.548073+0000","last_became_active":"2024-04-18T21:10:10.542594+0000","last_became_peered":"2024-04-18T21:10:10.542594+0000","last_unstale":"2024-04-18T21:10:20.548073+0000","last_undegraded":"2024-04-18T21:10:20.548073+0000","last_fullsized":"2024-04-18T21:10:20.548073+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:51:58.437990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":27987,"num_write":365,"num_write_kb":38689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"71'470","reported_seq":1142,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.479779+0000","last_change":"2024-04-18T21:10:17.535574+0000","last_active":"2024-04-18T21:10:20.479779+0000","last_peered":"2024-04-18T21:10:20.479779+0000","last_clean":"2024-04-18T21:10:20.479779+0000","last_became_active":"2024-04-18T21:10:17.529957+0000","last_became_peered":"2024-04-18T21:10:17.529957+0000","last_unstale":"2024-04-18T21:10:20.479779+0000","last_undegraded":"2024-04-18T21:10:20.479779+0000","last_fullsized":"2024-04-18T21:10:20.479779+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:06:00.648089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":59273,"num_write":432,"num_write_kb":145930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'433","reported_seq":635,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483362+0000","last_change":"2024-04-18T21:05:05.638338+0000","last_active":"2024-04-18T21:10:20.483362+0000","last_peered":"2024-04-18T21:10:20.483362+0000","last_clean":"2024-04-18T21:10:20.483362+0000","last_became_active":"2024-04-18T21:05:05.637567+0000","last_became_peered":"2024-04-18T21:05:05.637567+0000","last_unstale":"2024-04-18T21:10:20.483362+0000","last_undegraded":"2024-04-18T21:10:20.483362+0000","last_fullsized":"2024-04-18T21:10:20.483362+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5514,"num_write":403,"num_write_kb":26329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"71'418","reported_seq":661,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482880+0000","last_change":"2024-04-18T21:05:05.643606+0000","last_active":"2024-04-18T21:10:20.482880+0000","last_peered":"2024-04-18T21:10:20.482880+0000","last_clean":"2024-04-18T21:10:20.482880+0000","last_became_active":"2024-04-18T21:05:05.642991+0000","last_became_peered":"2024-04-18T21:05:05.642991+0000","last_unstale":"2024-04-18T21:10:20.482880+0000","last_undegraded":"2024-04-18T21:10:20.482880+0000","last_fullsized":"2024-04-18T21:10:20.482880+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:01.841786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":29097,"num_write":386,"num_write_kb":88262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"71'479","reported_seq":722,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546721+0000","last_change":"2024-04-18T21:10:07.549995+0000","last_active":"2024-04-18T21:10:20.546721+0000","last_peered":"2024-04-18T21:10:20.546721+0000","last_clean":"2024-04-18T21:10:20.546721+0000","last_became_active":"2024-04-18T21:10:07.544314+0000","last_became_peered":"2024-04-18T21:10:07.544314+0000","last_unstale":"2024-04-18T21:10:20.546721+0000","last_undegraded":"2024-04-18T21:10:20.546721+0000","last_fullsized":"2024-04-18T21:10:20.546721+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:52:34.340348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":24204,"num_write":452,"num_write_kb":114184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"71'407","reported_seq":637,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.477533+0000","last_change":"2024-04-18T21:10:03.487961+0000","last_active":"2024-04-18T21:10:20.477533+0000","last_peered":"2024-04-18T21:10:20.477533+0000","last_clean":"2024-04-18T21:10:20.477533+0000","last_became_active":"2024-04-18T21:10:03.476552+0000","last_became_peered":"2024-04-18T21:10:03.476552+0000","last_unstale":"2024-04-18T21:10:20.477533+0000","last_undegraded":"2024-04-18T21:10:20.477533+0000","last_fullsized":"2024-04-18T21:10:20.477533+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:45:35.774025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":37766,"num_write":374,"num_write_kb":103984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'452","reported_seq":653,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546024+0000","last_change":"2024-04-18T21:10:18.547982+0000","last_active":"2024-04-18T21:10:20.546024+0000","last_peered":"2024-04-18T21:10:20.546024+0000","last_clean":"2024-04-18T21:10:20.546024+0000","last_became_active":"2024-04-18T21:10:18.542189+0000","last_became_peered":"2024-04-18T21:10:18.542189+0000","last_unstale":"2024-04-18T21:10:20.546024+0000","last_undegraded":"2024-04-18T21:10:20.546024+0000","last_fullsized":"2024-04-18T21:10:20.546024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:49.761650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27170,"num_write":421,"num_write_kb":39548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"71'427","reported_seq":634,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.548342+0000","last_change":"2024-04-18T21:10:03.544910+0000","last_active":"2024-04-18T21:10:20.548342+0000","last_peered":"2024-04-18T21:10:20.548342+0000","last_clean":"2024-04-18T21:10:20.548342+0000","last_became_active":"2024-04-18T21:10:03.539961+0000","last_became_peered":"2024-04-18T21:10:03.539961+0000","last_unstale":"2024-04-18T21:10:20.548342+0000","last_undegraded":"2024-04-18T21:10:20.548342+0000","last_fullsized":"2024-04-18T21:10:20.548342+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:06:34.839228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":11507,"num_write":407,"num_write_kb":50964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"71'471","reported_seq":697,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.479964+0000","last_change":"2024-04-18T21:05:05.649581+0000","last_active":"2024-04-18T21:10:20.479964+0000","last_peered":"2024-04-18T21:10:20.479964+0000","last_clean":"2024-04-18T21:10:20.479964+0000","last_became_active":"2024-04-18T21:05:05.648233+0000","last_became_peered":"2024-04-18T21:05:05.648233+0000","last_unstale":"2024-04-18T21:10:20.479964+0000","last_undegraded":"2024-04-18T21:10:20.479964+0000","last_fullsized":"2024-04-18T21:10:20.479964+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20857,"num_write":431,"num_write_kb":63677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'378","reported_seq":940,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.484277+0000","last_change":"2024-04-18T21:09:55.493655+0000","last_active":"2024-04-18T21:10:20.484277+0000","last_peered":"2024-04-18T21:10:20.484277+0000","last_clean":"2024-04-18T21:10:20.484277+0000","last_became_active":"2024-04-18T21:09:55.490958+0000","last_became_peered":"2024-04-18T21:09:55.490958+0000","last_unstale":"2024-04-18T21:10:20.484277+0000","last_undegraded":"2024-04-18T21:10:20.484277+0000","last_fullsized":"2024-04-18T21:10:20.484277+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:52:16.541697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12573,"num_write":347,"num_write_kb":34434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'410","reported_seq":639,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547904+0000","last_change":"2024-04-18T21:10:01.563947+0000","last_active":"2024-04-18T21:10:20.547904+0000","last_peered":"2024-04-18T21:10:20.547904+0000","last_clean":"2024-04-18T21:10:20.547904+0000","last_became_active":"2024-04-18T21:10:01.555367+0000","last_became_peered":"2024-04-18T21:10:01.555367+0000","last_unstale":"2024-04-18T21:10:20.547904+0000","last_undegraded":"2024-04-18T21:10:20.547904+0000","last_fullsized":"2024-04-18T21:10:20.547904+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:01:09.418419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":16926,"num_write":380,"num_write_kb":112804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"71'410","reported_seq":991,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.478607+0000","last_change":"2024-04-18T21:10:03.490605+0000","last_active":"2024-04-18T21:10:20.478607+0000","last_peered":"2024-04-18T21:10:20.478607+0000","last_clean":"2024-04-18T21:10:20.478607+0000","last_became_active":"2024-04-18T21:10:03.480985+0000","last_became_peered":"2024-04-18T21:10:03.480985+0000","last_unstale":"2024-04-18T21:10:20.478607+0000","last_undegraded":"2024-04-18T21:10:20.478607+0000","last_fullsized":"2024-04-18T21:10:20.478607+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:14:42.076110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":34811,"num_write":378,"num_write_kb":51242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'491","reported_seq":709,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546384+0000","last_change":"2024-04-18T21:10:08.546388+0000","last_active":"2024-04-18T21:10:20.546384+0000","last_peered":"2024-04-18T21:10:20.546384+0000","last_clean":"2024-04-18T21:10:20.546384+0000","last_became_active":"2024-04-18T21:10:08.540487+0000","last_became_peered":"2024-04-18T21:10:08.540487+0000","last_unstale":"2024-04-18T21:10:20.546384+0000","last_undegraded":"2024-04-18T21:10:20.546384+0000","last_fullsized":"2024-04-18T21:10:20.546384+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:15:51.120517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":26902,"num_write":456,"num_write_kb":124778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":209,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"71'467","reported_seq":1079,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.477750+0000","last_change":"2024-04-18T21:10:19.483012+0000","last_active":"2024-04-18T21:10:20.477750+0000","last_peered":"2024-04-18T21:10:20.477750+0000","last_clean":"2024-04-18T21:10:20.477750+0000","last_became_active":"2024-04-18T21:10:19.480002+0000","last_became_peered":"2024-04-18T21:10:19.480002+0000","last_unstale":"2024-04-18T21:10:20.477750+0000","last_undegraded":"2024-04-18T21:10:20.477750+0000","last_fullsized":"2024-04-18T21:10:20.477750+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:51:24.488873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":28114,"num_write":434,"num_write_kb":129325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'423","reported_seq":595,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482361+0000","last_change":"2024-04-18T21:10:01.499421+0000","last_active":"2024-04-18T21:10:20.482361+0000","last_peered":"2024-04-18T21:10:20.482361+0000","last_clean":"2024-04-18T21:10:20.482361+0000","last_became_active":"2024-04-18T21:10:01.487074+0000","last_became_peered":"2024-04-18T21:10:01.487074+0000","last_unstale":"2024-04-18T21:10:20.482361+0000","last_undegraded":"2024-04-18T21:10:20.482361+0000","last_fullsized":"2024-04-18T21:10:20.482361+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:05:34.827814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8244,"num_write":393,"num_write_kb":58692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"71'389","reported_seq":618,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547175+0000","last_change":"2024-04-18T21:09:58.542232+0000","last_active":"2024-04-18T21:10:20.547175+0000","last_peered":"2024-04-18T21:10:20.547175+0000","last_clean":"2024-04-18T21:10:20.547175+0000","last_became_active":"2024-04-18T21:09:58.537723+0000","last_became_peered":"2024-04-18T21:09:58.537723+0000","last_unstale":"2024-04-18T21:10:20.547175+0000","last_undegraded":"2024-04-18T21:10:20.547175+0000","last_fullsized":"2024-04-18T21:10:20.547175+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:26.786170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":24216,"num_write":349,"num_write_kb":43176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"70'425","reported_seq":621,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483524+0000","last_change":"2024-04-18T21:05:04.632748+0000","last_active":"2024-04-18T21:10:20.483524+0000","last_peered":"2024-04-18T21:10:20.483524+0000","last_clean":"2024-04-18T21:10:20.483524+0000","last_became_active":"2024-04-18T21:05:04.628407+0000","last_became_peered":"2024-04-18T21:05:04.628407+0000","last_unstale":"2024-04-18T21:10:20.483524+0000","last_undegraded":"2024-04-18T21:10:20.483524+0000","last_fullsized":"2024-04-18T21:10:20.483524+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:42:45.392908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":375,"num_write_kb":8348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"71'423","reported_seq":623,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547197+0000","last_change":"2024-04-18T21:10:14.556066+0000","last_active":"2024-04-18T21:10:20.547197+0000","last_peered":"2024-04-18T21:10:20.547197+0000","last_clean":"2024-04-18T21:10:20.547197+0000","last_became_active":"2024-04-18T21:10:14.551249+0000","last_became_peered":"2024-04-18T21:10:14.551249+0000","last_unstale":"2024-04-18T21:10:20.547197+0000","last_undegraded":"2024-04-18T21:10:20.547197+0000","last_fullsized":"2024-04-18T21:10:20.547197+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:06:06.045278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":20096,"num_write":381,"num_write_kb":76351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"70'56","reported_seq":264,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.478297+0000","last_change":"2024-04-18T21:10:00.500122+0000","last_active":"2024-04-18T21:10:20.478297+0000","last_peered":"2024-04-18T21:10:20.478297+0000","last_clean":"2024-04-18T21:10:20.478297+0000","last_became_active":"2024-04-18T21:10:00.489486+0000","last_became_peered":"2024-04-18T21:10:00.489486+0000","last_unstale":"2024-04-18T21:10:20.478297+0000","last_undegraded":"2024-04-18T21:10:20.478297+0000","last_fullsized":"2024-04-18T21:10:20.478297+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:58:08.269558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'442","reported_seq":1026,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.480431+0000","last_change":"2024-04-18T21:10:03.492109+0000","last_active":"2024-04-18T21:10:20.480431+0000","last_peered":"2024-04-18T21:10:20.480431+0000","last_clean":"2024-04-18T21:10:20.480431+0000","last_became_active":"2024-04-18T21:10:03.483050+0000","last_became_peered":"2024-04-18T21:10:03.483050+0000","last_unstale":"2024-04-18T21:10:20.480431+0000","last_undegraded":"2024-04-18T21:10:20.480431+0000","last_fullsized":"2024-04-18T21:10:20.480431+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:45.388623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13827,"num_write":415,"num_write_kb":79859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"70'62","reported_seq":80,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546613+0000","last_change":"2024-04-18T21:09:50.868159+0000","last_active":"2024-04-18T21:10:20.546613+0000","last_peered":"2024-04-18T21:10:20.546613+0000","last_clean":"2024-04-18T21:10:20.546613+0000","last_became_active":"2024-04-18T21:09:50.867096+0000","last_became_peered":"2024-04-18T21:09:50.867096+0000","last_unstale":"2024-04-18T21:10:20.546613+0000","last_undegraded":"2024-04-18T21:10:20.546613+0000","last_fullsized":"2024-04-18T21:10:20.546613+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:09:57.047205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"71'398","reported_seq":639,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.479991+0000","last_change":"2024-04-18T21:10:01.498728+0000","last_active":"2024-04-18T21:10:20.479991+0000","last_peered":"2024-04-18T21:10:20.479991+0000","last_clean":"2024-04-18T21:10:20.479991+0000","last_became_active":"2024-04-18T21:10:01.495349+0000","last_became_peered":"2024-04-18T21:10:01.495349+0000","last_unstale":"2024-04-18T21:10:20.479991+0000","last_undegraded":"2024-04-18T21:10:20.479991+0000","last_fullsized":"2024-04-18T21:10:20.479991+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:01:48.618551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":17616,"num_write":360,"num_write_kb":58871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"70'66","reported_seq":181,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482413+0000","last_change":"2024-04-18T21:10:00.496701+0000","last_active":"2024-04-18T21:10:20.482413+0000","last_peered":"2024-04-18T21:10:20.482413+0000","last_clean":"2024-04-18T21:10:20.482413+0000","last_became_active":"2024-04-18T21:10:00.495594+0000","last_became_peered":"2024-04-18T21:10:00.495594+0000","last_unstale":"2024-04-18T21:10:20.482413+0000","last_undegraded":"2024-04-18T21:10:20.482413+0000","last_fullsized":"2024-04-18T21:10:20.482413+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:11:32.991308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"70'135","reported_seq":68,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.484770+0000","last_change":"2024-04-18T21:10:00.493197+0000","last_active":"2024-04-18T21:10:20.484770+0000","last_peered":"2024-04-18T21:10:20.484770+0000","last_clean":"2024-04-18T21:10:20.484770+0000","last_became_active":"2024-04-18T21:10:00.491509+0000","last_became_peered":"2024-04-18T21:10:00.491509+0000","last_unstale":"2024-04-18T21:10:20.484770+0000","last_undegraded":"2024-04-18T21:10:20.484770+0000","last_fullsized":"2024-04-18T21:10:20.484770+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:57:29.595389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":7777508,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'410","reported_seq":610,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547176+0000","last_change":"2024-04-18T21:10:06.553806+0000","last_active":"2024-04-18T21:10:20.547176+0000","last_peered":"2024-04-18T21:10:20.547176+0000","last_clean":"2024-04-18T21:10:20.547176+0000","last_became_active":"2024-04-18T21:10:06.548034+0000","last_became_peered":"2024-04-18T21:10:06.548034+0000","last_unstale":"2024-04-18T21:10:20.547176+0000","last_undegraded":"2024-04-18T21:10:20.547176+0000","last_fullsized":"2024-04-18T21:10:20.547176+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:20:56.265941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17055,"num_write":375,"num_write_kb":63331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"70'240","reported_seq":363,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547788+0000","last_change":"2024-04-18T21:10:00.556212+0000","last_active":"2024-04-18T21:10:20.547788+0000","last_peered":"2024-04-18T21:10:20.547788+0000","last_clean":"2024-04-18T21:10:20.547788+0000","last_became_active":"2024-04-18T21:10:00.555486+0000","last_became_peered":"2024-04-18T21:10:00.555486+0000","last_unstale":"2024-04-18T21:10:20.547788+0000","last_undegraded":"2024-04-18T21:10:20.547788+0000","last_fullsized":"2024-04-18T21:10:20.547788+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:11.573984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":4191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"71'501","reported_seq":719,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.545865+0000","last_change":"2024-04-18T21:10:17.593530+0000","last_active":"2024-04-18T21:10:20.545865+0000","last_peered":"2024-04-18T21:10:20.545865+0000","last_clean":"2024-04-18T21:10:20.545865+0000","last_became_active":"2024-04-18T21:10:17.588391+0000","last_became_peered":"2024-04-18T21:10:17.588391+0000","last_unstale":"2024-04-18T21:10:20.545865+0000","last_undegraded":"2024-04-18T21:10:20.545865+0000","last_fullsized":"2024-04-18T21:10:20.545865+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:26.079610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":37662,"num_write":474,"num_write_kb":167663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"70'429","reported_seq":566,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.484708+0000","last_change":"2024-04-18T21:10:00.493325+0000","last_active":"2024-04-18T21:10:20.484708+0000","last_peered":"2024-04-18T21:10:20.484708+0000","last_clean":"2024-04-18T21:10:20.484708+0000","last_became_active":"2024-04-18T21:10:00.491525+0000","last_became_peered":"2024-04-18T21:10:00.491525+0000","last_unstale":"2024-04-18T21:10:20.484708+0000","last_undegraded":"2024-04-18T21:10:20.484708+0000","last_fullsized":"2024-04-18T21:10:20.484708+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:27:59.637974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":377,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388678,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'440","reported_seq":650,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483219+0000","last_change":"2024-04-18T21:10:01.497932+0000","last_active":"2024-04-18T21:10:20.483219+0000","last_peered":"2024-04-18T21:10:20.483219+0000","last_clean":"2024-04-18T21:10:20.483219+0000","last_became_active":"2024-04-18T21:10:01.486740+0000","last_became_peered":"2024-04-18T21:10:01.486740+0000","last_unstale":"2024-04-18T21:10:20.483219+0000","last_undegraded":"2024-04-18T21:10:20.483219+0000","last_fullsized":"2024-04-18T21:10:20.483219+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:34:43.515471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":42138,"num_write":408,"num_write_kb":96310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"70'59","reported_seq":255,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.484055+0000","last_change":"2024-04-18T21:05:04.625520+0000","last_active":"2024-04-18T21:10:20.484055+0000","last_peered":"2024-04-18T21:10:20.484055+0000","last_clean":"2024-04-18T21:10:20.484055+0000","last_became_active":"2024-04-18T21:05:04.624656+0000","last_became_peered":"2024-04-18T21:05:04.624656+0000","last_unstale":"2024-04-18T21:10:20.484055+0000","last_undegraded":"2024-04-18T21:10:20.484055+0000","last_fullsized":"2024-04-18T21:10:20.484055+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:56:05.795125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"71'461","reported_seq":676,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.478291+0000","last_change":"2024-04-18T21:05:05.649406+0000","last_active":"2024-04-18T21:10:20.478291+0000","last_peered":"2024-04-18T21:10:20.478291+0000","last_clean":"2024-04-18T21:10:20.478291+0000","last_became_active":"2024-04-18T21:05:05.648380+0000","last_became_peered":"2024-04-18T21:05:05.648380+0000","last_unstale":"2024-04-18T21:10:20.478291+0000","last_undegraded":"2024-04-18T21:10:20.478291+0000","last_fullsized":"2024-04-18T21:10:20.478291+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12852,"num_write":420,"num_write_kb":88506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"70'157","reported_seq":376,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.478945+0000","last_change":"2024-04-18T21:10:00.500141+0000","last_active":"2024-04-18T21:10:20.478945+0000","last_peered":"2024-04-18T21:10:20.478945+0000","last_clean":"2024-04-18T21:10:20.478945+0000","last_became_active":"2024-04-18T21:10:00.494630+0000","last_became_peered":"2024-04-18T21:10:00.494630+0000","last_unstale":"2024-04-18T21:10:20.478945+0000","last_undegraded":"2024-04-18T21:10:20.478945+0000","last_fullsized":"2024-04-18T21:10:20.478945+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:49:43.984354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":8250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'445","reported_seq":635,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483682+0000","last_change":"2024-04-18T21:10:01.500937+0000","last_active":"2024-04-18T21:10:20.483682+0000","last_peered":"2024-04-18T21:10:20.483682+0000","last_clean":"2024-04-18T21:10:20.483682+0000","last_became_active":"2024-04-18T21:10:01.490691+0000","last_became_peered":"2024-04-18T21:10:01.490691+0000","last_unstale":"2024-04-18T21:10:20.483682+0000","last_undegraded":"2024-04-18T21:10:20.483682+0000","last_fullsized":"2024-04-18T21:10:20.483682+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:59:48.489145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17488,"num_write":410,"num_write_kb":50845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"70'124","reported_seq":320,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483416+0000","last_change":"2024-04-18T21:05:04.634674+0000","last_active":"2024-04-18T21:10:20.483416+0000","last_peered":"2024-04-18T21:10:20.483416+0000","last_clean":"2024-04-18T21:10:20.483416+0000","last_became_active":"2024-04-18T21:05:04.632284+0000","last_became_peered":"2024-04-18T21:05:04.632284+0000","last_unstale":"2024-04-18T21:10:20.483416+0000","last_undegraded":"2024-04-18T21:10:20.483416+0000","last_fullsized":"2024-04-18T21:10:20.483416+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:09:18.466987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"71'400","reported_seq":942,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.484448+0000","last_change":"2024-04-18T21:10:14.495223+0000","last_active":"2024-04-18T21:10:20.484448+0000","last_peered":"2024-04-18T21:10:20.484448+0000","last_clean":"2024-04-18T21:10:20.484448+0000","last_became_active":"2024-04-18T21:10:14.492039+0000","last_became_peered":"2024-04-18T21:10:14.492039+0000","last_unstale":"2024-04-18T21:10:20.484448+0000","last_undegraded":"2024-04-18T21:10:20.484448+0000","last_fullsized":"2024-04-18T21:10:20.484448+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:58:35.802545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12586,"num_write":372,"num_write_kb":58856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":350,"num_bytes_recovered":576854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"70'53","reported_seq":82,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.545791+0000","last_change":"2024-04-18T21:10:00.550936+0000","last_active":"2024-04-18T21:10:20.545791+0000","last_peered":"2024-04-18T21:10:20.545791+0000","last_clean":"2024-04-18T21:10:20.545791+0000","last_became_active":"2024-04-18T21:10:00.549987+0000","last_became_peered":"2024-04-18T21:10:00.549987+0000","last_unstale":"2024-04-18T21:10:20.545791+0000","last_undegraded":"2024-04-18T21:10:20.545791+0000","last_fullsized":"2024-04-18T21:10:20.545791+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:53:36.771516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"71'364","reported_seq":943,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.484401+0000","last_change":"2024-04-18T21:09:58.478726+0000","last_active":"2024-04-18T21:10:20.484401+0000","last_peered":"2024-04-18T21:10:20.484401+0000","last_clean":"2024-04-18T21:10:20.484401+0000","last_became_active":"2024-04-18T21:09:58.473903+0000","last_became_peered":"2024-04-18T21:09:58.473903+0000","last_unstale":"2024-04-18T21:10:20.484401+0000","last_undegraded":"2024-04-18T21:10:20.484401+0000","last_fullsized":"2024-04-18T21:10:20.484401+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:40.377274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":37938,"num_write":336,"num_write_kb":42513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"70'460","reported_seq":573,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546197+0000","last_change":"2024-04-18T21:09:53.545846+0000","last_active":"2024-04-18T21:10:20.546197+0000","last_peered":"2024-04-18T21:10:20.546197+0000","last_clean":"2024-04-18T21:10:20.546197+0000","last_became_active":"2024-04-18T21:09:53.544355+0000","last_became_peered":"2024-04-18T21:09:53.544355+0000","last_unstale":"2024-04-18T21:10:20.546197+0000","last_undegraded":"2024-04-18T21:10:20.546197+0000","last_fullsized":"2024-04-18T21:10:20.546197+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:34:16.776752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":406,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"71'404","reported_seq":978,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.480186+0000","last_change":"2024-04-18T21:10:15.507332+0000","last_active":"2024-04-18T21:10:20.480186+0000","last_peered":"2024-04-18T21:10:20.480186+0000","last_clean":"2024-04-18T21:10:20.480186+0000","last_became_active":"2024-04-18T21:10:15.504379+0000","last_became_peered":"2024-04-18T21:10:15.504379+0000","last_unstale":"2024-04-18T21:10:20.480186+0000","last_undegraded":"2024-04-18T21:10:20.480186+0000","last_fullsized":"2024-04-18T21:10:20.480186+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:33:14.728553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":7075,"num_write":367,"num_write_kb":62738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":383,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482924+0000","last_change":"2024-04-18T21:10:00.497960+0000","last_active":"2024-04-18T21:10:20.482924+0000","last_peered":"2024-04-18T21:10:20.482924+0000","last_clean":"2024-04-18T21:10:20.482924+0000","last_became_active":"2024-04-18T21:10:00.496373+0000","last_became_peered":"2024-04-18T21:10:00.496373+0000","last_unstale":"2024-04-18T21:10:20.482924+0000","last_undegraded":"2024-04-18T21:10:20.482924+0000","last_fullsized":"2024-04-18T21:10:20.482924+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_clean_scrub_stamp":"2024-04-18T21:04:53.494814+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:56:52.975720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":159,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483821+0000","last_change":"2024-04-18T21:10:00.487584+0000","last_active":"2024-04-18T21:10:20.483821+0000","last_peered":"2024-04-18T21:10:20.483821+0000","last_clean":"2024-04-18T21:10:20.483821+0000","last_became_active":"2024-04-18T21:10:00.486722+0000","last_became_peered":"2024-04-18T21:10:00.486722+0000","last_unstale":"2024-04-18T21:10:20.483821+0000","last_undegraded":"2024-04-18T21:10:20.483821+0000","last_fullsized":"2024-04-18T21:10:20.483821+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:17:03.176148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"70'595","reported_seq":750,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.478616+0000","last_change":"2024-04-18T21:10:03.488427+0000","last_active":"2024-04-18T21:10:20.478616+0000","last_peered":"2024-04-18T21:10:20.478616+0000","last_clean":"2024-04-18T21:10:20.478616+0000","last_became_active":"2024-04-18T21:10:03.481344+0000","last_became_peered":"2024-04-18T21:10:03.481344+0000","last_unstale":"2024-04-18T21:10:20.478616+0000","last_undegraded":"2024-04-18T21:10:20.478616+0000","last_fullsized":"2024-04-18T21:10:20.478616+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:41.583248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":539,"num_write_kb":8449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4689862,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'443","reported_seq":1089,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.484583+0000","last_change":"2024-04-18T21:09:56.496310+0000","last_active":"2024-04-18T21:10:20.484583+0000","last_peered":"2024-04-18T21:10:20.484583+0000","last_clean":"2024-04-18T21:10:20.484583+0000","last_became_active":"2024-04-18T21:09:56.493327+0000","last_became_peered":"2024-04-18T21:09:56.493327+0000","last_unstale":"2024-04-18T21:10:20.484583+0000","last_undegraded":"2024-04-18T21:10:20.484583+0000","last_fullsized":"2024-04-18T21:10:20.484583+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:20:57.340997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":38975,"num_write":404,"num_write_kb":80038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":209,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482719+0000","last_change":"2024-04-18T21:09:50.817029+0000","last_active":"2024-04-18T21:10:20.482719+0000","last_peered":"2024-04-18T21:10:20.482719+0000","last_clean":"2024-04-18T21:10:20.482719+0000","last_became_active":"2024-04-18T21:09:50.816543+0000","last_became_peered":"2024-04-18T21:09:50.816543+0000","last_unstale":"2024-04-18T21:10:20.482719+0000","last_undegraded":"2024-04-18T21:10:20.482719+0000","last_fullsized":"2024-04-18T21:10:20.482719+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:47:33.047727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"70'129","reported_seq":312,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.478205+0000","last_change":"2024-04-18T21:10:03.489109+0000","last_active":"2024-04-18T21:10:20.478205+0000","last_peered":"2024-04-18T21:10:20.478205+0000","last_clean":"2024-04-18T21:10:20.478205+0000","last_became_active":"2024-04-18T21:10:03.486859+0000","last_became_peered":"2024-04-18T21:10:03.486859+0000","last_unstale":"2024-04-18T21:10:20.478205+0000","last_undegraded":"2024-04-18T21:10:20.478205+0000","last_fullsized":"2024-04-18T21:10:20.478205+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:52:04.172480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466419,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":55,"num_read_kb":1405,"num_write":58,"num_write_kb":1469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'457","reported_seq":680,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.548347+0000","last_change":"2024-04-18T21:10:09.543207+0000","last_active":"2024-04-18T21:10:20.548347+0000","last_peered":"2024-04-18T21:10:20.548347+0000","last_clean":"2024-04-18T21:10:20.548347+0000","last_became_active":"2024-04-18T21:10:09.537428+0000","last_became_peered":"2024-04-18T21:10:09.537428+0000","last_unstale":"2024-04-18T21:10:20.548347+0000","last_undegraded":"2024-04-18T21:10:20.548347+0000","last_fullsized":"2024-04-18T21:10:20.548347+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:21.987918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":27659,"num_write":426,"num_write_kb":80500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":208,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.478812+0000","last_change":"2024-04-18T21:09:50.832624+0000","last_active":"2024-04-18T21:10:20.478812+0000","last_peered":"2024-04-18T21:10:20.478812+0000","last_clean":"2024-04-18T21:10:20.478812+0000","last_became_active":"2024-04-18T21:09:50.831949+0000","last_became_peered":"2024-04-18T21:09:50.831949+0000","last_unstale":"2024-04-18T21:10:20.478812+0000","last_undegraded":"2024-04-18T21:10:20.478812+0000","last_fullsized":"2024-04-18T21:10:20.478812+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:35:45.986029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'170","reported_seq":368,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.545538+0000","last_change":"2024-04-18T21:09:53.538615+0000","last_active":"2024-04-18T21:10:20.545538+0000","last_peered":"2024-04-18T21:10:20.545538+0000","last_clean":"2024-04-18T21:10:20.545538+0000","last_became_active":"2024-04-18T21:09:53.537994+0000","last_became_peered":"2024-04-18T21:09:53.537994+0000","last_unstale":"2024-04-18T21:10:20.545538+0000","last_undegraded":"2024-04-18T21:10:20.545538+0000","last_fullsized":"2024-04-18T21:10:20.545538+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:02:34.372453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":8239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"71'346","reported_seq":910,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.480273+0000","last_change":"2024-04-18T21:10:11.487541+0000","last_active":"2024-04-18T21:10:20.480273+0000","last_peered":"2024-04-18T21:10:20.480273+0000","last_clean":"2024-04-18T21:10:20.480273+0000","last_became_active":"2024-04-18T21:10:11.484662+0000","last_became_peered":"2024-04-18T21:10:11.484662+0000","last_unstale":"2024-04-18T21:10:20.480273+0000","last_undegraded":"2024-04-18T21:10:20.480273+0000","last_fullsized":"2024-04-18T21:10:20.480273+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:50:21.491862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27042,"num_write":321,"num_write_kb":50693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":202,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483512+0000","last_change":"2024-04-18T21:05:00.576606+0000","last_active":"2024-04-18T21:10:20.483512+0000","last_peered":"2024-04-18T21:10:20.483512+0000","last_clean":"2024-04-18T21:10:20.483512+0000","last_became_active":"2024-04-18T21:05:00.575951+0000","last_became_peered":"2024-04-18T21:05:00.575951+0000","last_unstale":"2024-04-18T21:10:20.483512+0000","last_undegraded":"2024-04-18T21:10:20.483512+0000","last_fullsized":"2024-04-18T21:10:20.483512+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:32:17.612481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"70'63","reported_seq":259,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483817+0000","last_change":"2024-04-18T21:05:04.627296+0000","last_active":"2024-04-18T21:10:20.483817+0000","last_peered":"2024-04-18T21:10:20.483817+0000","last_clean":"2024-04-18T21:10:20.483817+0000","last_became_active":"2024-04-18T21:05:04.626801+0000","last_became_peered":"2024-04-18T21:05:04.626801+0000","last_unstale":"2024-04-18T21:10:20.483817+0000","last_undegraded":"2024-04-18T21:10:20.483817+0000","last_fullsized":"2024-04-18T21:10:20.483817+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:46:36.285416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"71'406","reported_seq":1041,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.479242+0000","last_change":"2024-04-18T21:09:59.495686+0000","last_active":"2024-04-18T21:10:20.479242+0000","last_peered":"2024-04-18T21:10:20.479242+0000","last_clean":"2024-04-18T21:10:20.479242+0000","last_became_active":"2024-04-18T21:09:59.493248+0000","last_became_peered":"2024-04-18T21:09:59.493248+0000","last_unstale":"2024-04-18T21:10:20.479242+0000","last_undegraded":"2024-04-18T21:10:20.479242+0000","last_fullsized":"2024-04-18T21:10:20.479242+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:11:23.853682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":35332,"num_write":370,"num_write_kb":71807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"70'284","reported_seq":315,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.484852+0000","last_change":"2024-04-18T21:10:00.504958+0000","last_active":"2024-04-18T21:10:20.484852+0000","last_peered":"2024-04-18T21:10:20.484852+0000","last_clean":"2024-04-18T21:10:20.484852+0000","last_became_active":"2024-04-18T21:10:00.503851+0000","last_became_peered":"2024-04-18T21:10:00.503851+0000","last_unstale":"2024-04-18T21:10:20.484852+0000","last_undegraded":"2024-04-18T21:10:20.484852+0000","last_fullsized":"2024-04-18T21:10:20.484852+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:10:27.397258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":218,"num_write_kb":4194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":135,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.479497+0000","last_change":"2024-04-18T21:10:03.484148+0000","last_active":"2024-04-18T21:10:20.479497+0000","last_peered":"2024-04-18T21:10:20.479497+0000","last_clean":"2024-04-18T21:10:20.479497+0000","last_became_active":"2024-04-18T21:10:03.480071+0000","last_became_peered":"2024-04-18T21:10:03.480071+0000","last_unstale":"2024-04-18T21:10:20.479497+0000","last_undegraded":"2024-04-18T21:10:20.479497+0000","last_fullsized":"2024-04-18T21:10:20.479497+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:50:30.257039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'386","reported_seq":577,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546997+0000","last_change":"2024-04-18T21:10:10.547885+0000","last_active":"2024-04-18T21:10:20.546997+0000","last_peered":"2024-04-18T21:10:20.546997+0000","last_clean":"2024-04-18T21:10:20.546997+0000","last_became_active":"2024-04-18T21:10:10.542515+0000","last_became_peered":"2024-04-18T21:10:10.542515+0000","last_unstale":"2024-04-18T21:10:20.546997+0000","last_undegraded":"2024-04-18T21:10:20.546997+0000","last_fullsized":"2024-04-18T21:10:20.546997+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:58:24.232536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14677,"num_write":355,"num_write_kb":51018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"70'55","reported_seq":257,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.479390+0000","last_change":"2024-04-18T21:09:50.833424+0000","last_active":"2024-04-18T21:10:20.479390+0000","last_peered":"2024-04-18T21:10:20.479390+0000","last_clean":"2024-04-18T21:10:20.479390+0000","last_became_active":"2024-04-18T21:09:50.832752+0000","last_became_peered":"2024-04-18T21:09:50.832752+0000","last_unstale":"2024-04-18T21:10:20.479390+0000","last_undegraded":"2024-04-18T21:10:20.479390+0000","last_fullsized":"2024-04-18T21:10:20.479390+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:48.945329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":165,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.548117+0000","last_change":"2024-04-18T21:09:50.900338+0000","last_active":"2024-04-18T21:10:20.548117+0000","last_peered":"2024-04-18T21:10:20.548117+0000","last_clean":"2024-04-18T21:10:20.548117+0000","last_became_active":"2024-04-18T21:09:50.896844+0000","last_became_peered":"2024-04-18T21:09:50.896844+0000","last_unstale":"2024-04-18T21:10:20.548117+0000","last_undegraded":"2024-04-18T21:10:20.548117+0000","last_fullsized":"2024-04-18T21:10:20.548117+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:11:35.543409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"71'402","reported_seq":591,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546209+0000","last_change":"2024-04-18T21:10:05.542484+0000","last_active":"2024-04-18T21:10:20.546209+0000","last_peered":"2024-04-18T21:10:20.546209+0000","last_clean":"2024-04-18T21:10:20.546209+0000","last_became_active":"2024-04-18T21:10:05.536763+0000","last_became_peered":"2024-04-18T21:10:05.536763+0000","last_unstale":"2024-04-18T21:10:20.546209+0000","last_undegraded":"2024-04-18T21:10:20.546209+0000","last_fullsized":"2024-04-18T21:10:20.546209+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:08:22.367267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12468,"num_write":369,"num_write_kb":67231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"70'60","reported_seq":263,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.480741+0000","last_change":"2024-04-18T21:09:50.832598+0000","last_active":"2024-04-18T21:10:20.480741+0000","last_peered":"2024-04-18T21:10:20.480741+0000","last_clean":"2024-04-18T21:10:20.480741+0000","last_became_active":"2024-04-18T21:09:50.832030+0000","last_became_peered":"2024-04-18T21:09:50.832030+0000","last_unstale":"2024-04-18T21:10:20.480741+0000","last_undegraded":"2024-04-18T21:10:20.480741+0000","last_fullsized":"2024-04-18T21:10:20.480741+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:10:27.397258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":135,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.480666+0000","last_change":"2024-04-18T21:10:03.492761+0000","last_active":"2024-04-18T21:10:20.480666+0000","last_peered":"2024-04-18T21:10:20.480666+0000","last_clean":"2024-04-18T21:10:20.480666+0000","last_became_active":"2024-04-18T21:10:03.492145+0000","last_became_peered":"2024-04-18T21:10:03.492145+0000","last_unstale":"2024-04-18T21:10:20.480666+0000","last_undegraded":"2024-04-18T21:10:20.480666+0000","last_fullsized":"2024-04-18T21:10:20.480666+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:20:00.853523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'421","reported_seq":628,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.477954+0000","last_change":"2024-04-18T21:10:03.488774+0000","last_active":"2024-04-18T21:10:20.477954+0000","last_peered":"2024-04-18T21:10:20.477954+0000","last_clean":"2024-04-18T21:10:20.477954+0000","last_became_active":"2024-04-18T21:10:03.479773+0000","last_became_peered":"2024-04-18T21:10:03.479773+0000","last_unstale":"2024-04-18T21:10:20.477954+0000","last_undegraded":"2024-04-18T21:10:20.477954+0000","last_fullsized":"2024-04-18T21:10:20.477954+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:15:12.326904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":16183,"num_write":377,"num_write_kb":50451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"71'110","reported_seq":325,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.480498+0000","last_change":"2024-04-18T21:10:00.497917+0000","last_active":"2024-04-18T21:10:20.480498+0000","last_peered":"2024-04-18T21:10:20.480498+0000","last_clean":"2024-04-18T21:10:20.480498+0000","last_became_active":"2024-04-18T21:10:00.494644+0000","last_became_peered":"2024-04-18T21:10:00.494644+0000","last_unstale":"2024-04-18T21:10:20.480498+0000","last_undegraded":"2024-04-18T21:10:20.480498+0000","last_fullsized":"2024-04-18T21:10:20.480498+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:40:57.347353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":1251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":160,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.484841+0000","last_change":"2024-04-18T21:10:00.493764+0000","last_active":"2024-04-18T21:10:20.484841+0000","last_peered":"2024-04-18T21:10:20.484841+0000","last_clean":"2024-04-18T21:10:20.484841+0000","last_became_active":"2024-04-18T21:10:00.492672+0000","last_became_peered":"2024-04-18T21:10:00.492672+0000","last_unstale":"2024-04-18T21:10:20.484841+0000","last_undegraded":"2024-04-18T21:10:20.484841+0000","last_fullsized":"2024-04-18T21:10:20.484841+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:48:46.709401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'384","reported_seq":597,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546833+0000","last_change":"2024-04-18T21:09:57.572865+0000","last_active":"2024-04-18T21:10:20.546833+0000","last_peered":"2024-04-18T21:10:20.546833+0000","last_clean":"2024-04-18T21:10:20.546833+0000","last_became_active":"2024-04-18T21:09:57.567962+0000","last_became_peered":"2024-04-18T21:09:57.567962+0000","last_unstale":"2024-04-18T21:10:20.546833+0000","last_undegraded":"2024-04-18T21:10:20.546833+0000","last_fullsized":"2024-04-18T21:10:20.546833+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:51:24.627186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":15567,"num_write":351,"num_write_kb":42959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"71'396","reported_seq":924,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483421+0000","last_change":"2024-04-18T21:10:13.482151+0000","last_active":"2024-04-18T21:10:20.483421+0000","last_peered":"2024-04-18T21:10:20.483421+0000","last_clean":"2024-04-18T21:10:20.483421+0000","last_became_active":"2024-04-18T21:10:13.479320+0000","last_became_peered":"2024-04-18T21:10:13.479320+0000","last_unstale":"2024-04-18T21:10:20.483421+0000","last_undegraded":"2024-04-18T21:10:20.483421+0000","last_fullsized":"2024-04-18T21:10:20.483421+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:33:52.248167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12943,"num_write":353,"num_write_kb":35357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":342,"num_bytes_recovered":3500882,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"71'277","reported_seq":318,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483992+0000","last_change":"2024-04-18T21:10:00.495047+0000","last_active":"2024-04-18T21:10:20.483992+0000","last_peered":"2024-04-18T21:10:20.483992+0000","last_clean":"2024-04-18T21:10:20.483992+0000","last_became_active":"2024-04-18T21:10:00.493088+0000","last_became_peered":"2024-04-18T21:10:00.493088+0000","last_unstale":"2024-04-18T21:10:20.483992+0000","last_undegraded":"2024-04-18T21:10:20.483992+0000","last_fullsized":"2024-04-18T21:10:20.483992+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:39:08.263781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":221,"num_write_kb":8303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":8389370,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'411","reported_seq":1007,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.477964+0000","last_change":"2024-04-18T21:10:04.485332+0000","last_active":"2024-04-18T21:10:20.477964+0000","last_peered":"2024-04-18T21:10:20.477964+0000","last_clean":"2024-04-18T21:10:20.477964+0000","last_became_active":"2024-04-18T21:10:04.482320+0000","last_became_peered":"2024-04-18T21:10:04.482320+0000","last_unstale":"2024-04-18T21:10:20.477964+0000","last_undegraded":"2024-04-18T21:10:20.477964+0000","last_fullsized":"2024-04-18T21:10:20.477964+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:35:57.043682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":17179,"num_write":375,"num_write_kb":38991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"70'85","reported_seq":168,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547812+0000","last_change":"2024-04-18T21:09:50.890616+0000","last_active":"2024-04-18T21:10:20.547812+0000","last_peered":"2024-04-18T21:10:20.547812+0000","last_clean":"2024-04-18T21:10:20.547812+0000","last_became_active":"2024-04-18T21:09:50.874855+0000","last_became_peered":"2024-04-18T21:09:50.874855+0000","last_unstale":"2024-04-18T21:10:20.547812+0000","last_undegraded":"2024-04-18T21:10:20.547812+0000","last_fullsized":"2024-04-18T21:10:20.547812+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:03:54.726282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"70'230","reported_seq":259,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.484617+0000","last_change":"2024-04-18T21:10:00.499373+0000","last_active":"2024-04-18T21:10:20.484617+0000","last_peered":"2024-04-18T21:10:20.484617+0000","last_clean":"2024-04-18T21:10:20.484617+0000","last_became_active":"2024-04-18T21:10:00.498141+0000","last_became_peered":"2024-04-18T21:10:00.498141+0000","last_unstale":"2024-04-18T21:10:20.484617+0000","last_undegraded":"2024-04-18T21:10:20.484617+0000","last_fullsized":"2024-04-18T21:10:20.484617+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:55:01.865593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":4178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"71'493","reported_seq":732,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.477822+0000","last_change":"2024-04-18T21:05:05.642793+0000","last_active":"2024-04-18T21:10:20.477822+0000","last_peered":"2024-04-18T21:10:20.477822+0000","last_clean":"2024-04-18T21:10:20.477822+0000","last_became_active":"2024-04-18T21:05:05.641983+0000","last_became_peered":"2024-04-18T21:05:05.641983+0000","last_unstale":"2024-04-18T21:10:20.477822+0000","last_undegraded":"2024-04-18T21:10:20.477822+0000","last_fullsized":"2024-04-18T21:10:20.477822+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:46:36.339289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23833,"num_write":461,"num_write_kb":76873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"70'62","reported_seq":257,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.480547+0000","last_change":"2024-04-18T21:05:04.641445+0000","last_active":"2024-04-18T21:10:20.480547+0000","last_peered":"2024-04-18T21:10:20.480547+0000","last_clean":"2024-04-18T21:10:20.480547+0000","last_became_active":"2024-04-18T21:05:04.640682+0000","last_became_peered":"2024-04-18T21:05:04.640682+0000","last_unstale":"2024-04-18T21:10:20.480547+0000","last_undegraded":"2024-04-18T21:10:20.480547+0000","last_fullsized":"2024-04-18T21:10:20.480547+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:46:36.285416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'436","reported_seq":1063,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.477947+0000","last_change":"2024-04-18T21:10:18.490900+0000","last_active":"2024-04-18T21:10:20.477947+0000","last_peered":"2024-04-18T21:10:20.477947+0000","last_clean":"2024-04-18T21:10:20.477947+0000","last_became_active":"2024-04-18T21:10:18.487788+0000","last_became_peered":"2024-04-18T21:10:18.487788+0000","last_unstale":"2024-04-18T21:10:20.477947+0000","last_undegraded":"2024-04-18T21:10:20.477947+0000","last_fullsized":"2024-04-18T21:10:20.477947+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:57:00.495580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14561,"num_write":408,"num_write_kb":47462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'369","reported_seq":571,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.548399+0000","last_change":"2024-04-18T21:10:02.553999+0000","last_active":"2024-04-18T21:10:20.548399+0000","last_peered":"2024-04-18T21:10:20.548399+0000","last_clean":"2024-04-18T21:10:20.548399+0000","last_became_active":"2024-04-18T21:10:02.549471+0000","last_became_peered":"2024-04-18T21:10:02.549471+0000","last_unstale":"2024-04-18T21:10:20.548399+0000","last_undegraded":"2024-04-18T21:10:20.548399+0000","last_fullsized":"2024-04-18T21:10:20.548399+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:52:14.371235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13619,"num_write":339,"num_write_kb":63086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"70'888","reported_seq":1030,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.478410+0000","last_change":"2024-04-18T21:10:03.486911+0000","last_active":"2024-04-18T21:10:20.478410+0000","last_peered":"2024-04-18T21:10:20.478410+0000","last_clean":"2024-04-18T21:10:20.478410+0000","last_became_active":"2024-04-18T21:10:03.480576+0000","last_became_peered":"2024-04-18T21:10:03.480576+0000","last_unstale":"2024-04-18T21:10:20.478410+0000","last_undegraded":"2024-04-18T21:10:20.478410+0000","last_fullsized":"2024-04-18T21:10:20.478410+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:41:06.632064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":823,"num_write_kb":8582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'398","reported_seq":562,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.479937+0000","last_change":"2024-04-18T21:10:03.491426+0000","last_active":"2024-04-18T21:10:20.479937+0000","last_peered":"2024-04-18T21:10:20.479937+0000","last_clean":"2024-04-18T21:10:20.479937+0000","last_became_active":"2024-04-18T21:10:03.483190+0000","last_became_peered":"2024-04-18T21:10:03.483190+0000","last_unstale":"2024-04-18T21:10:20.479937+0000","last_undegraded":"2024-04-18T21:10:20.479937+0000","last_fullsized":"2024-04-18T21:10:20.479937+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:05:10.611580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14684,"num_write":380,"num_write_kb":88822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"70'169","reported_seq":384,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.478144+0000","last_change":"2024-04-18T21:10:00.494974+0000","last_active":"2024-04-18T21:10:20.478144+0000","last_peered":"2024-04-18T21:10:20.478144+0000","last_clean":"2024-04-18T21:10:20.478144+0000","last_became_active":"2024-04-18T21:10:00.492196+0000","last_became_peered":"2024-04-18T21:10:00.492196+0000","last_unstale":"2024-04-18T21:10:20.478144+0000","last_undegraded":"2024-04-18T21:10:20.478144+0000","last_fullsized":"2024-04-18T21:10:20.478144+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:33:51.236211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":4162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'406","reported_seq":630,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546278+0000","last_change":"2024-04-18T21:10:12.553754+0000","last_active":"2024-04-18T21:10:20.546278+0000","last_peered":"2024-04-18T21:10:20.546278+0000","last_clean":"2024-04-18T21:10:20.546278+0000","last_became_active":"2024-04-18T21:10:12.546148+0000","last_became_peered":"2024-04-18T21:10:12.546148+0000","last_unstale":"2024-04-18T21:10:20.546278+0000","last_undegraded":"2024-04-18T21:10:20.546278+0000","last_fullsized":"2024-04-18T21:10:20.546278+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:12:37.876185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27495,"num_write":363,"num_write_kb":89134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"72'192","reported_seq":385,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546350+0000","last_change":"2024-04-18T21:09:53.541766+0000","last_active":"2024-04-18T21:10:20.546350+0000","last_peered":"2024-04-18T21:10:20.546350+0000","last_clean":"2024-04-18T21:10:20.546350+0000","last_became_active":"2024-04-18T21:09:53.541300+0000","last_became_peered":"2024-04-18T21:09:53.541300+0000","last_unstale":"2024-04-18T21:10:20.546350+0000","last_undegraded":"2024-04-18T21:10:20.546350+0000","last_fullsized":"2024-04-18T21:10:20.546350+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:26:14.718922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12425030,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":12201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8230726,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"71'383","reported_seq":617,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547547+0000","last_change":"2024-04-18T21:09:55.555798+0000","last_active":"2024-04-18T21:10:20.547547+0000","last_peered":"2024-04-18T21:10:20.547547+0000","last_clean":"2024-04-18T21:10:20.547547+0000","last_became_active":"2024-04-18T21:09:55.551135+0000","last_became_peered":"2024-04-18T21:09:55.551135+0000","last_unstale":"2024-04-18T21:10:20.547547+0000","last_undegraded":"2024-04-18T21:10:20.547547+0000","last_fullsized":"2024-04-18T21:10:20.547547+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:00:01.739082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21614,"num_write":351,"num_write_kb":79501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"70'66","reported_seq":159,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546526+0000","last_change":"2024-04-18T21:10:00.553114+0000","last_active":"2024-04-18T21:10:20.546526+0000","last_peered":"2024-04-18T21:10:20.546526+0000","last_clean":"2024-04-18T21:10:20.546526+0000","last_became_active":"2024-04-18T21:10:00.552067+0000","last_became_peered":"2024-04-18T21:10:00.552067+0000","last_unstale":"2024-04-18T21:10:20.546526+0000","last_undegraded":"2024-04-18T21:10:20.546526+0000","last_fullsized":"2024-04-18T21:10:20.546526+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:51:32.567297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"71'345","reported_seq":546,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483218+0000","last_change":"2024-04-18T21:05:05.624840+0000","last_active":"2024-04-18T21:10:20.483218+0000","last_peered":"2024-04-18T21:10:20.483218+0000","last_clean":"2024-04-18T21:10:20.483218+0000","last_became_active":"2024-04-18T21:05:05.622950+0000","last_became_peered":"2024-04-18T21:05:05.622950+0000","last_unstale":"2024-04-18T21:10:20.483218+0000","last_undegraded":"2024-04-18T21:10:20.483218+0000","last_fullsized":"2024-04-18T21:10:20.483218+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:27:17.530889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":317,"num_write_kb":29335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"70'171","reported_seq":286,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483766+0000","last_change":"2024-04-18T21:10:00.507624+0000","last_active":"2024-04-18T21:10:20.483766+0000","last_peered":"2024-04-18T21:10:20.483766+0000","last_clean":"2024-04-18T21:10:20.483766+0000","last_became_active":"2024-04-18T21:10:00.507132+0000","last_became_peered":"2024-04-18T21:10:00.507132+0000","last_unstale":"2024-04-18T21:10:20.483766+0000","last_undegraded":"2024-04-18T21:10:20.483766+0000","last_fullsized":"2024-04-18T21:10:20.483766+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:35:50.013019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":4154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"71'417","reported_seq":643,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483150+0000","last_change":"2024-04-18T21:05:05.627962+0000","last_active":"2024-04-18T21:10:20.483150+0000","last_peered":"2024-04-18T21:10:20.483150+0000","last_clean":"2024-04-18T21:10:20.483150+0000","last_became_active":"2024-04-18T21:05:05.626698+0000","last_became_peered":"2024-04-18T21:05:05.626698+0000","last_unstale":"2024-04-18T21:10:20.483150+0000","last_undegraded":"2024-04-18T21:10:20.483150+0000","last_fullsized":"2024-04-18T21:10:20.483150+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:48:48.973087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":17040,"num_write":384,"num_write_kb":83740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"70'276","reported_seq":471,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547237+0000","last_change":"2024-04-18T21:09:53.543611+0000","last_active":"2024-04-18T21:10:20.547237+0000","last_peered":"2024-04-18T21:10:20.547237+0000","last_clean":"2024-04-18T21:10:20.547237+0000","last_became_active":"2024-04-18T21:09:53.542863+0000","last_became_peered":"2024-04-18T21:09:53.542863+0000","last_unstale":"2024-04-18T21:10:20.547237+0000","last_undegraded":"2024-04-18T21:10:20.547237+0000","last_fullsized":"2024-04-18T21:10:20.547237+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:22.582074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":12399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"71'428","reported_seq":637,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546271+0000","last_change":"2024-04-18T21:10:08.541152+0000","last_active":"2024-04-18T21:10:20.546271+0000","last_peered":"2024-04-18T21:10:20.546271+0000","last_clean":"2024-04-18T21:10:20.546271+0000","last_became_active":"2024-04-18T21:10:08.536423+0000","last_became_peered":"2024-04-18T21:10:08.536423+0000","last_unstale":"2024-04-18T21:10:20.546271+0000","last_undegraded":"2024-04-18T21:10:20.546271+0000","last_fullsized":"2024-04-18T21:10:20.546271+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:26.666677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22548,"num_write":398,"num_write_kb":75972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"70'70","reported_seq":273,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.480343+0000","last_change":"2024-04-18T21:09:50.833350+0000","last_active":"2024-04-18T21:10:20.480343+0000","last_peered":"2024-04-18T21:10:20.480343+0000","last_clean":"2024-04-18T21:10:20.480343+0000","last_became_active":"2024-04-18T21:09:50.832355+0000","last_became_peered":"2024-04-18T21:09:50.832355+0000","last_unstale":"2024-04-18T21:10:20.480343+0000","last_undegraded":"2024-04-18T21:10:20.480343+0000","last_fullsized":"2024-04-18T21:10:20.480343+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:39:09.627425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'459","reported_seq":642,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482639+0000","last_change":"2024-04-18T21:10:01.503378+0000","last_active":"2024-04-18T21:10:20.482639+0000","last_peered":"2024-04-18T21:10:20.482639+0000","last_clean":"2024-04-18T21:10:20.482639+0000","last_became_active":"2024-04-18T21:10:01.497275+0000","last_became_peered":"2024-04-18T21:10:01.497275+0000","last_unstale":"2024-04-18T21:10:20.482639+0000","last_undegraded":"2024-04-18T21:10:20.482639+0000","last_fullsized":"2024-04-18T21:10:20.482639+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:40:35.832428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13353,"num_write":429,"num_write_kb":88123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"70'113","reported_seq":332,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.480338+0000","last_change":"2024-04-18T21:10:00.499468+0000","last_active":"2024-04-18T21:10:20.480338+0000","last_peered":"2024-04-18T21:10:20.480338+0000","last_clean":"2024-04-18T21:10:20.480338+0000","last_became_active":"2024-04-18T21:10:00.494734+0000","last_became_peered":"2024-04-18T21:10:00.494734+0000","last_unstale":"2024-04-18T21:10:20.480338+0000","last_undegraded":"2024-04-18T21:10:20.480338+0000","last_fullsized":"2024-04-18T21:10:20.480338+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:58:34.790588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194886,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2531,"num_read_kb":1304649,"num_write":24542,"num_write_kb":4299443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8145,"num_bytes_recovered":4488063,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26603,"ondisk_log_size":26603,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127139127,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":55,"num_read_kb":1405,"num_write":4542,"num_write_kb":127514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":92002768,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254345216,"data_stored":254278254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4409,"internal_metadata":0},"log_size":6331,"ondisk_log_size":6331,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738439,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":187628,"kb_used_data":80152,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94184212,"statfs":{"total":96636764160,"available":96444633088,"internally_reserved":0,"allocated":82075648,"data_stored":81480582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110033349},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":77,"seq":330712481801,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":147296,"kb_used_data":83404,"kb_used_omap":5,"kb_used_meta":63866,"kb_avail":94224544,"statfs":{"total":96636764160,"available":96485933056,"internally_reserved":0,"allocated":85405696,"data_stored":84799073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6004,"internal_metadata":65398924},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738437,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":160468,"kb_used_data":89096,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94211372,"statfs":{"total":96636764160,"available":96472444928,"internally_reserved":0,"allocated":91234304,"data_stored":90618294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":89579520,"data_stored":89548273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":83750912,"data_stored":83729052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4409,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81014784,"data_stored":81000929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:10:26.303 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-18T21:10:26.304 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:10:26.645 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:10:26.648 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-04-18T21:10:26.665 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":272,"stamp":"2024-04-18T21:10:24.639147+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127729495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2722,"num_read_kb":1306172,"num_write":29287,"num_write_kb":4430417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8182,"num_bytes_recovered":97081199,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33091,"ondisk_log_size":33091,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":495392,"kb_used_data":252652,"kb_used_omap":8,"kb_used_meta":242679,"kb_avail":282620128,"statfs":{"total":289910292480,"available":289403011072,"internally_reserved":0,"allocated":258715648,"data_stored":256897949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9194,"internal_metadata":248503318},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-758,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1054,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.165240"},"pg_stats":[{"pgid":"4.3f","version":"71'418","reported_seq":614,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.548813+0000","last_change":"2024-04-18T21:10:16.576720+0000","last_active":"2024-04-18T21:10:20.548813+0000","last_peered":"2024-04-18T21:10:20.548813+0000","last_clean":"2024-04-18T21:10:20.548813+0000","last_became_active":"2024-04-18T21:10:16.571985+0000","last_became_peered":"2024-04-18T21:10:16.571985+0000","last_unstale":"2024-04-18T21:10:20.548813+0000","last_undegraded":"2024-04-18T21:10:20.548813+0000","last_fullsized":"2024-04-18T21:10:20.548813+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:28:48.196628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":19677,"num_write":386,"num_write_kb":87615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"71'417","reported_seq":631,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.548242+0000","last_change":"2024-04-18T21:10:05.546965+0000","last_active":"2024-04-18T21:10:20.548242+0000","last_peered":"2024-04-18T21:10:20.548242+0000","last_clean":"2024-04-18T21:10:20.548242+0000","last_became_active":"2024-04-18T21:10:05.541170+0000","last_became_peered":"2024-04-18T21:10:05.541170+0000","last_unstale":"2024-04-18T21:10:20.548242+0000","last_undegraded":"2024-04-18T21:10:20.548242+0000","last_fullsized":"2024-04-18T21:10:20.548242+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:04:05.630763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":12123,"num_write":387,"num_write_kb":47157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"71'379","reported_seq":940,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483812+0000","last_change":"2024-04-18T21:09:54.480753+0000","last_active":"2024-04-18T21:10:20.483812+0000","last_peered":"2024-04-18T21:10:20.483812+0000","last_clean":"2024-04-18T21:10:20.483812+0000","last_became_active":"2024-04-18T21:09:54.478020+0000","last_became_peered":"2024-04-18T21:09:54.478020+0000","last_unstale":"2024-04-18T21:10:20.483812+0000","last_undegraded":"2024-04-18T21:10:20.483812+0000","last_fullsized":"2024-04-18T21:10:20.483812+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:24:18.705477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":10040,"num_write":353,"num_write_kb":63202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'372","reported_seq":574,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483063+0000","last_change":"2024-04-18T21:05:05.629321+0000","last_active":"2024-04-18T21:10:20.483063+0000","last_peered":"2024-04-18T21:10:20.483063+0000","last_clean":"2024-04-18T21:10:20.483063+0000","last_became_active":"2024-04-18T21:05:05.627956+0000","last_became_peered":"2024-04-18T21:05:05.627956+0000","last_unstale":"2024-04-18T21:10:20.483063+0000","last_undegraded":"2024-04-18T21:10:20.483063+0000","last_fullsized":"2024-04-18T21:10:20.483063+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:15:28.458476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2735,"num_write":328,"num_write_kb":22107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"71'416","reported_seq":616,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546812+0000","last_change":"2024-04-18T21:10:00.560644+0000","last_active":"2024-04-18T21:10:20.546812+0000","last_peered":"2024-04-18T21:10:20.546812+0000","last_clean":"2024-04-18T21:10:20.546812+0000","last_became_active":"2024-04-18T21:10:00.553862+0000","last_became_peered":"2024-04-18T21:10:00.553862+0000","last_unstale":"2024-04-18T21:10:20.546812+0000","last_undegraded":"2024-04-18T21:10:20.546812+0000","last_fullsized":"2024-04-18T21:10:20.546812+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:11:49.688538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6533,"num_write":389,"num_write_kb":43666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"71'374","reported_seq":574,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482584+0000","last_change":"2024-04-18T21:10:01.495684+0000","last_active":"2024-04-18T21:10:20.482584+0000","last_peered":"2024-04-18T21:10:20.482584+0000","last_clean":"2024-04-18T21:10:20.482584+0000","last_became_active":"2024-04-18T21:10:01.486640+0000","last_became_peered":"2024-04-18T21:10:01.486640+0000","last_unstale":"2024-04-18T21:10:20.482584+0000","last_undegraded":"2024-04-18T21:10:20.482584+0000","last_fullsized":"2024-04-18T21:10:20.482584+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:39:10.639381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20415,"num_write":354,"num_write_kb":34462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'418","reported_seq":652,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482999+0000","last_change":"2024-04-18T21:05:05.625047+0000","last_active":"2024-04-18T21:10:20.482999+0000","last_peered":"2024-04-18T21:10:20.482999+0000","last_clean":"2024-04-18T21:10:20.482999+0000","last_became_active":"2024-04-18T21:05:05.622781+0000","last_became_peered":"2024-04-18T21:05:05.622781+0000","last_unstale":"2024-04-18T21:10:20.482999+0000","last_undegraded":"2024-04-18T21:10:20.482999+0000","last_fullsized":"2024-04-18T21:10:20.482999+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:12.944469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21103,"num_write":385,"num_write_kb":50678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"71'399","reported_seq":638,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.481939+0000","last_change":"2024-04-18T21:10:00.495543+0000","last_active":"2024-04-18T21:10:20.481939+0000","last_peered":"2024-04-18T21:10:20.481939+0000","last_clean":"2024-04-18T21:10:20.481939+0000","last_became_active":"2024-04-18T21:10:00.488705+0000","last_became_peered":"2024-04-18T21:10:00.488705+0000","last_unstale":"2024-04-18T21:10:20.481939+0000","last_undegraded":"2024-04-18T21:10:20.481939+0000","last_fullsized":"2024-04-18T21:10:20.481939+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:11.892092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":44692,"num_write":361,"num_write_kb":105170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"71'385","reported_seq":950,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.479921+0000","last_change":"2024-04-18T21:10:06.487113+0000","last_active":"2024-04-18T21:10:20.479921+0000","last_peered":"2024-04-18T21:10:20.479921+0000","last_clean":"2024-04-18T21:10:20.479921+0000","last_became_active":"2024-04-18T21:10:06.482087+0000","last_became_peered":"2024-04-18T21:10:06.482087+0000","last_unstale":"2024-04-18T21:10:20.479921+0000","last_undegraded":"2024-04-18T21:10:20.479921+0000","last_fullsized":"2024-04-18T21:10:20.479921+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:10:51.435131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":994,"num_write":358,"num_write_kb":25964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'409","reported_seq":644,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546781+0000","last_change":"2024-04-18T21:10:12.550697+0000","last_active":"2024-04-18T21:10:20.546781+0000","last_peered":"2024-04-18T21:10:20.546781+0000","last_clean":"2024-04-18T21:10:20.546781+0000","last_became_active":"2024-04-18T21:10:12.546621+0000","last_became_peered":"2024-04-18T21:10:12.546621+0000","last_unstale":"2024-04-18T21:10:20.546781+0000","last_undegraded":"2024-04-18T21:10:20.546781+0000","last_fullsized":"2024-04-18T21:10:20.546781+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:55:30.422126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":26170,"num_write":372,"num_write_kb":83931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"71'366","reported_seq":577,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483819+0000","last_change":"2024-04-18T21:10:01.496068+0000","last_active":"2024-04-18T21:10:20.483819+0000","last_peered":"2024-04-18T21:10:20.483819+0000","last_clean":"2024-04-18T21:10:20.483819+0000","last_became_active":"2024-04-18T21:10:01.488047+0000","last_became_peered":"2024-04-18T21:10:01.488047+0000","last_unstale":"2024-04-18T21:10:20.483819+0000","last_undegraded":"2024-04-18T21:10:20.483819+0000","last_fullsized":"2024-04-18T21:10:20.483819+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:49.957286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":18907,"num_write":347,"num_write_kb":26153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"71'346","reported_seq":549,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547957+0000","last_change":"2024-04-18T21:10:00.560349+0000","last_active":"2024-04-18T21:10:20.547957+0000","last_peered":"2024-04-18T21:10:20.547957+0000","last_clean":"2024-04-18T21:10:20.547957+0000","last_became_active":"2024-04-18T21:10:00.557412+0000","last_became_peered":"2024-04-18T21:10:00.557412+0000","last_unstale":"2024-04-18T21:10:20.547957+0000","last_undegraded":"2024-04-18T21:10:20.547957+0000","last_fullsized":"2024-04-18T21:10:20.547957+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:54:33.428937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":6245,"num_write":324,"num_write_kb":37970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"71'417","reported_seq":638,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547313+0000","last_change":"2024-04-18T21:10:02.555899+0000","last_active":"2024-04-18T21:10:20.547313+0000","last_peered":"2024-04-18T21:10:20.547313+0000","last_clean":"2024-04-18T21:10:20.547313+0000","last_became_active":"2024-04-18T21:10:02.551406+0000","last_became_peered":"2024-04-18T21:10:02.551406+0000","last_unstale":"2024-04-18T21:10:20.547313+0000","last_undegraded":"2024-04-18T21:10:20.547313+0000","last_fullsized":"2024-04-18T21:10:20.547313+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:41:17.455669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":21623,"num_write":381,"num_write_kb":71306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"71'398","reported_seq":977,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482881+0000","last_change":"2024-04-18T21:10:11.491565+0000","last_active":"2024-04-18T21:10:20.482881+0000","last_peered":"2024-04-18T21:10:20.482881+0000","last_clean":"2024-04-18T21:10:20.482881+0000","last_became_active":"2024-04-18T21:10:11.486593+0000","last_became_peered":"2024-04-18T21:10:11.486593+0000","last_unstale":"2024-04-18T21:10:20.482881+0000","last_undegraded":"2024-04-18T21:10:20.482881+0000","last_fullsized":"2024-04-18T21:10:20.482881+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:11:23.853682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":369,"num_write_kb":30006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'435","reported_seq":1102,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482470+0000","last_change":"2024-04-18T21:10:15.509238+0000","last_active":"2024-04-18T21:10:20.482470+0000","last_peered":"2024-04-18T21:10:20.482470+0000","last_clean":"2024-04-18T21:10:20.482470+0000","last_became_active":"2024-04-18T21:10:15.506328+0000","last_became_peered":"2024-04-18T21:10:15.506328+0000","last_unstale":"2024-04-18T21:10:20.482470+0000","last_undegraded":"2024-04-18T21:10:20.482470+0000","last_fullsized":"2024-04-18T21:10:20.482470+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:49:44.996311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":31523,"num_write":402,"num_write_kb":121466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":346,"num_bytes_recovered":410327,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'446","reported_seq":687,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482015+0000","last_change":"2024-04-18T21:05:05.638203+0000","last_active":"2024-04-18T21:10:20.482015+0000","last_peered":"2024-04-18T21:10:20.482015+0000","last_clean":"2024-04-18T21:10:20.482015+0000","last_became_active":"2024-04-18T21:05:05.637352+0000","last_became_peered":"2024-04-18T21:05:05.637352+0000","last_unstale":"2024-04-18T21:10:20.482015+0000","last_undegraded":"2024-04-18T21:10:20.482015+0000","last_fullsized":"2024-04-18T21:10:20.482015+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":23833,"num_write":418,"num_write_kb":59679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"71'403","reported_seq":956,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.490427+0000","last_change":"2024-04-18T21:10:20.490427+0000","last_active":"2024-04-18T21:10:20.490427+0000","last_peered":"2024-04-18T21:10:20.490427+0000","last_clean":"2024-04-18T21:10:20.490427+0000","last_became_active":"2024-04-18T21:10:20.487409+0000","last_became_peered":"2024-04-18T21:10:20.487409+0000","last_unstale":"2024-04-18T21:10:20.490427+0000","last_undegraded":"2024-04-18T21:10:20.490427+0000","last_fullsized":"2024-04-18T21:10:20.490427+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:22:40.301941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":7482,"num_write":371,"num_write_kb":25957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'406","reported_seq":606,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.548073+0000","last_change":"2024-04-18T21:10:10.547457+0000","last_active":"2024-04-18T21:10:20.548073+0000","last_peered":"2024-04-18T21:10:20.548073+0000","last_clean":"2024-04-18T21:10:20.548073+0000","last_became_active":"2024-04-18T21:10:10.542594+0000","last_became_peered":"2024-04-18T21:10:10.542594+0000","last_unstale":"2024-04-18T21:10:20.548073+0000","last_undegraded":"2024-04-18T21:10:20.548073+0000","last_fullsized":"2024-04-18T21:10:20.548073+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:51:58.437990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":27987,"num_write":365,"num_write_kb":38689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"71'470","reported_seq":1142,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.479779+0000","last_change":"2024-04-18T21:10:17.535574+0000","last_active":"2024-04-18T21:10:20.479779+0000","last_peered":"2024-04-18T21:10:20.479779+0000","last_clean":"2024-04-18T21:10:20.479779+0000","last_became_active":"2024-04-18T21:10:17.529957+0000","last_became_peered":"2024-04-18T21:10:17.529957+0000","last_unstale":"2024-04-18T21:10:20.479779+0000","last_undegraded":"2024-04-18T21:10:20.479779+0000","last_fullsized":"2024-04-18T21:10:20.479779+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:06:00.648089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":59273,"num_write":432,"num_write_kb":145930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'433","reported_seq":635,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483362+0000","last_change":"2024-04-18T21:05:05.638338+0000","last_active":"2024-04-18T21:10:20.483362+0000","last_peered":"2024-04-18T21:10:20.483362+0000","last_clean":"2024-04-18T21:10:20.483362+0000","last_became_active":"2024-04-18T21:05:05.637567+0000","last_became_peered":"2024-04-18T21:05:05.637567+0000","last_unstale":"2024-04-18T21:10:20.483362+0000","last_undegraded":"2024-04-18T21:10:20.483362+0000","last_fullsized":"2024-04-18T21:10:20.483362+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5514,"num_write":403,"num_write_kb":26329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"71'418","reported_seq":661,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482880+0000","last_change":"2024-04-18T21:05:05.643606+0000","last_active":"2024-04-18T21:10:20.482880+0000","last_peered":"2024-04-18T21:10:20.482880+0000","last_clean":"2024-04-18T21:10:20.482880+0000","last_became_active":"2024-04-18T21:05:05.642991+0000","last_became_peered":"2024-04-18T21:05:05.642991+0000","last_unstale":"2024-04-18T21:10:20.482880+0000","last_undegraded":"2024-04-18T21:10:20.482880+0000","last_fullsized":"2024-04-18T21:10:20.482880+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:01.841786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":29097,"num_write":386,"num_write_kb":88262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"71'479","reported_seq":722,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546721+0000","last_change":"2024-04-18T21:10:07.549995+0000","last_active":"2024-04-18T21:10:20.546721+0000","last_peered":"2024-04-18T21:10:20.546721+0000","last_clean":"2024-04-18T21:10:20.546721+0000","last_became_active":"2024-04-18T21:10:07.544314+0000","last_became_peered":"2024-04-18T21:10:07.544314+0000","last_unstale":"2024-04-18T21:10:20.546721+0000","last_undegraded":"2024-04-18T21:10:20.546721+0000","last_fullsized":"2024-04-18T21:10:20.546721+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:52:34.340348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":24204,"num_write":452,"num_write_kb":114184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"71'407","reported_seq":637,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.477533+0000","last_change":"2024-04-18T21:10:03.487961+0000","last_active":"2024-04-18T21:10:20.477533+0000","last_peered":"2024-04-18T21:10:20.477533+0000","last_clean":"2024-04-18T21:10:20.477533+0000","last_became_active":"2024-04-18T21:10:03.476552+0000","last_became_peered":"2024-04-18T21:10:03.476552+0000","last_unstale":"2024-04-18T21:10:20.477533+0000","last_undegraded":"2024-04-18T21:10:20.477533+0000","last_fullsized":"2024-04-18T21:10:20.477533+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:45:35.774025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":37766,"num_write":374,"num_write_kb":103984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'452","reported_seq":653,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546024+0000","last_change":"2024-04-18T21:10:18.547982+0000","last_active":"2024-04-18T21:10:20.546024+0000","last_peered":"2024-04-18T21:10:20.546024+0000","last_clean":"2024-04-18T21:10:20.546024+0000","last_became_active":"2024-04-18T21:10:18.542189+0000","last_became_peered":"2024-04-18T21:10:18.542189+0000","last_unstale":"2024-04-18T21:10:20.546024+0000","last_undegraded":"2024-04-18T21:10:20.546024+0000","last_fullsized":"2024-04-18T21:10:20.546024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:49.761650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27170,"num_write":421,"num_write_kb":39548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"71'427","reported_seq":634,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.548342+0000","last_change":"2024-04-18T21:10:03.544910+0000","last_active":"2024-04-18T21:10:20.548342+0000","last_peered":"2024-04-18T21:10:20.548342+0000","last_clean":"2024-04-18T21:10:20.548342+0000","last_became_active":"2024-04-18T21:10:03.539961+0000","last_became_peered":"2024-04-18T21:10:03.539961+0000","last_unstale":"2024-04-18T21:10:20.548342+0000","last_undegraded":"2024-04-18T21:10:20.548342+0000","last_fullsized":"2024-04-18T21:10:20.548342+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:06:34.839228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":11507,"num_write":407,"num_write_kb":50964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"71'471","reported_seq":697,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.479964+0000","last_change":"2024-04-18T21:05:05.649581+0000","last_active":"2024-04-18T21:10:20.479964+0000","last_peered":"2024-04-18T21:10:20.479964+0000","last_clean":"2024-04-18T21:10:20.479964+0000","last_became_active":"2024-04-18T21:05:05.648233+0000","last_became_peered":"2024-04-18T21:05:05.648233+0000","last_unstale":"2024-04-18T21:10:20.479964+0000","last_undegraded":"2024-04-18T21:10:20.479964+0000","last_fullsized":"2024-04-18T21:10:20.479964+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20857,"num_write":431,"num_write_kb":63677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'378","reported_seq":940,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.484277+0000","last_change":"2024-04-18T21:09:55.493655+0000","last_active":"2024-04-18T21:10:20.484277+0000","last_peered":"2024-04-18T21:10:20.484277+0000","last_clean":"2024-04-18T21:10:20.484277+0000","last_became_active":"2024-04-18T21:09:55.490958+0000","last_became_peered":"2024-04-18T21:09:55.490958+0000","last_unstale":"2024-04-18T21:10:20.484277+0000","last_undegraded":"2024-04-18T21:10:20.484277+0000","last_fullsized":"2024-04-18T21:10:20.484277+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:52:16.541697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12573,"num_write":347,"num_write_kb":34434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'410","reported_seq":639,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547904+0000","last_change":"2024-04-18T21:10:01.563947+0000","last_active":"2024-04-18T21:10:20.547904+0000","last_peered":"2024-04-18T21:10:20.547904+0000","last_clean":"2024-04-18T21:10:20.547904+0000","last_became_active":"2024-04-18T21:10:01.555367+0000","last_became_peered":"2024-04-18T21:10:01.555367+0000","last_unstale":"2024-04-18T21:10:20.547904+0000","last_undegraded":"2024-04-18T21:10:20.547904+0000","last_fullsized":"2024-04-18T21:10:20.547904+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:01:09.418419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":16926,"num_write":380,"num_write_kb":112804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"71'410","reported_seq":991,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.478607+0000","last_change":"2024-04-18T21:10:03.490605+0000","last_active":"2024-04-18T21:10:20.478607+0000","last_peered":"2024-04-18T21:10:20.478607+0000","last_clean":"2024-04-18T21:10:20.478607+0000","last_became_active":"2024-04-18T21:10:03.480985+0000","last_became_peered":"2024-04-18T21:10:03.480985+0000","last_unstale":"2024-04-18T21:10:20.478607+0000","last_undegraded":"2024-04-18T21:10:20.478607+0000","last_fullsized":"2024-04-18T21:10:20.478607+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:14:42.076110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":34811,"num_write":378,"num_write_kb":51242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'491","reported_seq":709,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546384+0000","last_change":"2024-04-18T21:10:08.546388+0000","last_active":"2024-04-18T21:10:20.546384+0000","last_peered":"2024-04-18T21:10:20.546384+0000","last_clean":"2024-04-18T21:10:20.546384+0000","last_became_active":"2024-04-18T21:10:08.540487+0000","last_became_peered":"2024-04-18T21:10:08.540487+0000","last_unstale":"2024-04-18T21:10:20.546384+0000","last_undegraded":"2024-04-18T21:10:20.546384+0000","last_fullsized":"2024-04-18T21:10:20.546384+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:15:51.120517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":26902,"num_write":456,"num_write_kb":124778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":209,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"71'467","reported_seq":1079,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.477750+0000","last_change":"2024-04-18T21:10:19.483012+0000","last_active":"2024-04-18T21:10:20.477750+0000","last_peered":"2024-04-18T21:10:20.477750+0000","last_clean":"2024-04-18T21:10:20.477750+0000","last_became_active":"2024-04-18T21:10:19.480002+0000","last_became_peered":"2024-04-18T21:10:19.480002+0000","last_unstale":"2024-04-18T21:10:20.477750+0000","last_undegraded":"2024-04-18T21:10:20.477750+0000","last_fullsized":"2024-04-18T21:10:20.477750+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:51:24.488873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":28114,"num_write":434,"num_write_kb":129325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'423","reported_seq":595,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482361+0000","last_change":"2024-04-18T21:10:01.499421+0000","last_active":"2024-04-18T21:10:20.482361+0000","last_peered":"2024-04-18T21:10:20.482361+0000","last_clean":"2024-04-18T21:10:20.482361+0000","last_became_active":"2024-04-18T21:10:01.487074+0000","last_became_peered":"2024-04-18T21:10:01.487074+0000","last_unstale":"2024-04-18T21:10:20.482361+0000","last_undegraded":"2024-04-18T21:10:20.482361+0000","last_fullsized":"2024-04-18T21:10:20.482361+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:05:34.827814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8244,"num_write":393,"num_write_kb":58692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"71'389","reported_seq":618,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547175+0000","last_change":"2024-04-18T21:09:58.542232+0000","last_active":"2024-04-18T21:10:20.547175+0000","last_peered":"2024-04-18T21:10:20.547175+0000","last_clean":"2024-04-18T21:10:20.547175+0000","last_became_active":"2024-04-18T21:09:58.537723+0000","last_became_peered":"2024-04-18T21:09:58.537723+0000","last_unstale":"2024-04-18T21:10:20.547175+0000","last_undegraded":"2024-04-18T21:10:20.547175+0000","last_fullsized":"2024-04-18T21:10:20.547175+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:26.786170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":24216,"num_write":349,"num_write_kb":43176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"70'425","reported_seq":621,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483524+0000","last_change":"2024-04-18T21:05:04.632748+0000","last_active":"2024-04-18T21:10:20.483524+0000","last_peered":"2024-04-18T21:10:20.483524+0000","last_clean":"2024-04-18T21:10:20.483524+0000","last_became_active":"2024-04-18T21:05:04.628407+0000","last_became_peered":"2024-04-18T21:05:04.628407+0000","last_unstale":"2024-04-18T21:10:20.483524+0000","last_undegraded":"2024-04-18T21:10:20.483524+0000","last_fullsized":"2024-04-18T21:10:20.483524+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:42:45.392908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":375,"num_write_kb":8348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"71'423","reported_seq":623,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547197+0000","last_change":"2024-04-18T21:10:14.556066+0000","last_active":"2024-04-18T21:10:20.547197+0000","last_peered":"2024-04-18T21:10:20.547197+0000","last_clean":"2024-04-18T21:10:20.547197+0000","last_became_active":"2024-04-18T21:10:14.551249+0000","last_became_peered":"2024-04-18T21:10:14.551249+0000","last_unstale":"2024-04-18T21:10:20.547197+0000","last_undegraded":"2024-04-18T21:10:20.547197+0000","last_fullsized":"2024-04-18T21:10:20.547197+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:06:06.045278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":20096,"num_write":381,"num_write_kb":76351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"70'56","reported_seq":264,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.478297+0000","last_change":"2024-04-18T21:10:00.500122+0000","last_active":"2024-04-18T21:10:20.478297+0000","last_peered":"2024-04-18T21:10:20.478297+0000","last_clean":"2024-04-18T21:10:20.478297+0000","last_became_active":"2024-04-18T21:10:00.489486+0000","last_became_peered":"2024-04-18T21:10:00.489486+0000","last_unstale":"2024-04-18T21:10:20.478297+0000","last_undegraded":"2024-04-18T21:10:20.478297+0000","last_fullsized":"2024-04-18T21:10:20.478297+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:58:08.269558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'442","reported_seq":1026,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.480431+0000","last_change":"2024-04-18T21:10:03.492109+0000","last_active":"2024-04-18T21:10:20.480431+0000","last_peered":"2024-04-18T21:10:20.480431+0000","last_clean":"2024-04-18T21:10:20.480431+0000","last_became_active":"2024-04-18T21:10:03.483050+0000","last_became_peered":"2024-04-18T21:10:03.483050+0000","last_unstale":"2024-04-18T21:10:20.480431+0000","last_undegraded":"2024-04-18T21:10:20.480431+0000","last_fullsized":"2024-04-18T21:10:20.480431+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:45.388623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13827,"num_write":415,"num_write_kb":79859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"70'62","reported_seq":80,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546613+0000","last_change":"2024-04-18T21:09:50.868159+0000","last_active":"2024-04-18T21:10:20.546613+0000","last_peered":"2024-04-18T21:10:20.546613+0000","last_clean":"2024-04-18T21:10:20.546613+0000","last_became_active":"2024-04-18T21:09:50.867096+0000","last_became_peered":"2024-04-18T21:09:50.867096+0000","last_unstale":"2024-04-18T21:10:20.546613+0000","last_undegraded":"2024-04-18T21:10:20.546613+0000","last_fullsized":"2024-04-18T21:10:20.546613+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:09:57.047205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"71'398","reported_seq":639,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.479991+0000","last_change":"2024-04-18T21:10:01.498728+0000","last_active":"2024-04-18T21:10:20.479991+0000","last_peered":"2024-04-18T21:10:20.479991+0000","last_clean":"2024-04-18T21:10:20.479991+0000","last_became_active":"2024-04-18T21:10:01.495349+0000","last_became_peered":"2024-04-18T21:10:01.495349+0000","last_unstale":"2024-04-18T21:10:20.479991+0000","last_undegraded":"2024-04-18T21:10:20.479991+0000","last_fullsized":"2024-04-18T21:10:20.479991+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:01:48.618551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":17616,"num_write":360,"num_write_kb":58871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"70'66","reported_seq":181,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482413+0000","last_change":"2024-04-18T21:10:00.496701+0000","last_active":"2024-04-18T21:10:20.482413+0000","last_peered":"2024-04-18T21:10:20.482413+0000","last_clean":"2024-04-18T21:10:20.482413+0000","last_became_active":"2024-04-18T21:10:00.495594+0000","last_became_peered":"2024-04-18T21:10:00.495594+0000","last_unstale":"2024-04-18T21:10:20.482413+0000","last_undegraded":"2024-04-18T21:10:20.482413+0000","last_fullsized":"2024-04-18T21:10:20.482413+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:11:32.991308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"70'135","reported_seq":68,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.484770+0000","last_change":"2024-04-18T21:10:00.493197+0000","last_active":"2024-04-18T21:10:20.484770+0000","last_peered":"2024-04-18T21:10:20.484770+0000","last_clean":"2024-04-18T21:10:20.484770+0000","last_became_active":"2024-04-18T21:10:00.491509+0000","last_became_peered":"2024-04-18T21:10:00.491509+0000","last_unstale":"2024-04-18T21:10:20.484770+0000","last_undegraded":"2024-04-18T21:10:20.484770+0000","last_fullsized":"2024-04-18T21:10:20.484770+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:57:29.595389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":7777508,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'410","reported_seq":610,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547176+0000","last_change":"2024-04-18T21:10:06.553806+0000","last_active":"2024-04-18T21:10:20.547176+0000","last_peered":"2024-04-18T21:10:20.547176+0000","last_clean":"2024-04-18T21:10:20.547176+0000","last_became_active":"2024-04-18T21:10:06.548034+0000","last_became_peered":"2024-04-18T21:10:06.548034+0000","last_unstale":"2024-04-18T21:10:20.547176+0000","last_undegraded":"2024-04-18T21:10:20.547176+0000","last_fullsized":"2024-04-18T21:10:20.547176+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:20:56.265941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17055,"num_write":375,"num_write_kb":63331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"70'240","reported_seq":363,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547788+0000","last_change":"2024-04-18T21:10:00.556212+0000","last_active":"2024-04-18T21:10:20.547788+0000","last_peered":"2024-04-18T21:10:20.547788+0000","last_clean":"2024-04-18T21:10:20.547788+0000","last_became_active":"2024-04-18T21:10:00.555486+0000","last_became_peered":"2024-04-18T21:10:00.555486+0000","last_unstale":"2024-04-18T21:10:20.547788+0000","last_undegraded":"2024-04-18T21:10:20.547788+0000","last_fullsized":"2024-04-18T21:10:20.547788+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:11.573984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":4191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"71'501","reported_seq":719,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.545865+0000","last_change":"2024-04-18T21:10:17.593530+0000","last_active":"2024-04-18T21:10:20.545865+0000","last_peered":"2024-04-18T21:10:20.545865+0000","last_clean":"2024-04-18T21:10:20.545865+0000","last_became_active":"2024-04-18T21:10:17.588391+0000","last_became_peered":"2024-04-18T21:10:17.588391+0000","last_unstale":"2024-04-18T21:10:20.545865+0000","last_undegraded":"2024-04-18T21:10:20.545865+0000","last_fullsized":"2024-04-18T21:10:20.545865+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:26.079610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":37662,"num_write":474,"num_write_kb":167663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"70'429","reported_seq":566,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.484708+0000","last_change":"2024-04-18T21:10:00.493325+0000","last_active":"2024-04-18T21:10:20.484708+0000","last_peered":"2024-04-18T21:10:20.484708+0000","last_clean":"2024-04-18T21:10:20.484708+0000","last_became_active":"2024-04-18T21:10:00.491525+0000","last_became_peered":"2024-04-18T21:10:00.491525+0000","last_unstale":"2024-04-18T21:10:20.484708+0000","last_undegraded":"2024-04-18T21:10:20.484708+0000","last_fullsized":"2024-04-18T21:10:20.484708+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:27:59.637974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":377,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388678,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'440","reported_seq":650,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483219+0000","last_change":"2024-04-18T21:10:01.497932+0000","last_active":"2024-04-18T21:10:20.483219+0000","last_peered":"2024-04-18T21:10:20.483219+0000","last_clean":"2024-04-18T21:10:20.483219+0000","last_became_active":"2024-04-18T21:10:01.486740+0000","last_became_peered":"2024-04-18T21:10:01.486740+0000","last_unstale":"2024-04-18T21:10:20.483219+0000","last_undegraded":"2024-04-18T21:10:20.483219+0000","last_fullsized":"2024-04-18T21:10:20.483219+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:34:43.515471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":42138,"num_write":408,"num_write_kb":96310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"70'59","reported_seq":255,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.484055+0000","last_change":"2024-04-18T21:05:04.625520+0000","last_active":"2024-04-18T21:10:20.484055+0000","last_peered":"2024-04-18T21:10:20.484055+0000","last_clean":"2024-04-18T21:10:20.484055+0000","last_became_active":"2024-04-18T21:05:04.624656+0000","last_became_peered":"2024-04-18T21:05:04.624656+0000","last_unstale":"2024-04-18T21:10:20.484055+0000","last_undegraded":"2024-04-18T21:10:20.484055+0000","last_fullsized":"2024-04-18T21:10:20.484055+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:56:05.795125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"71'461","reported_seq":676,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.478291+0000","last_change":"2024-04-18T21:05:05.649406+0000","last_active":"2024-04-18T21:10:20.478291+0000","last_peered":"2024-04-18T21:10:20.478291+0000","last_clean":"2024-04-18T21:10:20.478291+0000","last_became_active":"2024-04-18T21:05:05.648380+0000","last_became_peered":"2024-04-18T21:05:05.648380+0000","last_unstale":"2024-04-18T21:10:20.478291+0000","last_undegraded":"2024-04-18T21:10:20.478291+0000","last_fullsized":"2024-04-18T21:10:20.478291+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12852,"num_write":420,"num_write_kb":88506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"70'157","reported_seq":376,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.478945+0000","last_change":"2024-04-18T21:10:00.500141+0000","last_active":"2024-04-18T21:10:20.478945+0000","last_peered":"2024-04-18T21:10:20.478945+0000","last_clean":"2024-04-18T21:10:20.478945+0000","last_became_active":"2024-04-18T21:10:00.494630+0000","last_became_peered":"2024-04-18T21:10:00.494630+0000","last_unstale":"2024-04-18T21:10:20.478945+0000","last_undegraded":"2024-04-18T21:10:20.478945+0000","last_fullsized":"2024-04-18T21:10:20.478945+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:49:43.984354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":8250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'445","reported_seq":635,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483682+0000","last_change":"2024-04-18T21:10:01.500937+0000","last_active":"2024-04-18T21:10:20.483682+0000","last_peered":"2024-04-18T21:10:20.483682+0000","last_clean":"2024-04-18T21:10:20.483682+0000","last_became_active":"2024-04-18T21:10:01.490691+0000","last_became_peered":"2024-04-18T21:10:01.490691+0000","last_unstale":"2024-04-18T21:10:20.483682+0000","last_undegraded":"2024-04-18T21:10:20.483682+0000","last_fullsized":"2024-04-18T21:10:20.483682+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:59:48.489145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17488,"num_write":410,"num_write_kb":50845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"70'124","reported_seq":320,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483416+0000","last_change":"2024-04-18T21:05:04.634674+0000","last_active":"2024-04-18T21:10:20.483416+0000","last_peered":"2024-04-18T21:10:20.483416+0000","last_clean":"2024-04-18T21:10:20.483416+0000","last_became_active":"2024-04-18T21:05:04.632284+0000","last_became_peered":"2024-04-18T21:05:04.632284+0000","last_unstale":"2024-04-18T21:10:20.483416+0000","last_undegraded":"2024-04-18T21:10:20.483416+0000","last_fullsized":"2024-04-18T21:10:20.483416+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:09:18.466987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"71'400","reported_seq":942,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.484448+0000","last_change":"2024-04-18T21:10:14.495223+0000","last_active":"2024-04-18T21:10:20.484448+0000","last_peered":"2024-04-18T21:10:20.484448+0000","last_clean":"2024-04-18T21:10:20.484448+0000","last_became_active":"2024-04-18T21:10:14.492039+0000","last_became_peered":"2024-04-18T21:10:14.492039+0000","last_unstale":"2024-04-18T21:10:20.484448+0000","last_undegraded":"2024-04-18T21:10:20.484448+0000","last_fullsized":"2024-04-18T21:10:20.484448+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:58:35.802545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12586,"num_write":372,"num_write_kb":58856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":350,"num_bytes_recovered":576854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"70'53","reported_seq":82,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.545791+0000","last_change":"2024-04-18T21:10:00.550936+0000","last_active":"2024-04-18T21:10:20.545791+0000","last_peered":"2024-04-18T21:10:20.545791+0000","last_clean":"2024-04-18T21:10:20.545791+0000","last_became_active":"2024-04-18T21:10:00.549987+0000","last_became_peered":"2024-04-18T21:10:00.549987+0000","last_unstale":"2024-04-18T21:10:20.545791+0000","last_undegraded":"2024-04-18T21:10:20.545791+0000","last_fullsized":"2024-04-18T21:10:20.545791+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:53:36.771516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"71'364","reported_seq":943,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.484401+0000","last_change":"2024-04-18T21:09:58.478726+0000","last_active":"2024-04-18T21:10:20.484401+0000","last_peered":"2024-04-18T21:10:20.484401+0000","last_clean":"2024-04-18T21:10:20.484401+0000","last_became_active":"2024-04-18T21:09:58.473903+0000","last_became_peered":"2024-04-18T21:09:58.473903+0000","last_unstale":"2024-04-18T21:10:20.484401+0000","last_undegraded":"2024-04-18T21:10:20.484401+0000","last_fullsized":"2024-04-18T21:10:20.484401+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:40.377274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":37938,"num_write":336,"num_write_kb":42513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"70'460","reported_seq":573,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546197+0000","last_change":"2024-04-18T21:09:53.545846+0000","last_active":"2024-04-18T21:10:20.546197+0000","last_peered":"2024-04-18T21:10:20.546197+0000","last_clean":"2024-04-18T21:10:20.546197+0000","last_became_active":"2024-04-18T21:09:53.544355+0000","last_became_peered":"2024-04-18T21:09:53.544355+0000","last_unstale":"2024-04-18T21:10:20.546197+0000","last_undegraded":"2024-04-18T21:10:20.546197+0000","last_fullsized":"2024-04-18T21:10:20.546197+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:34:16.776752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":406,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"71'404","reported_seq":978,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.480186+0000","last_change":"2024-04-18T21:10:15.507332+0000","last_active":"2024-04-18T21:10:20.480186+0000","last_peered":"2024-04-18T21:10:20.480186+0000","last_clean":"2024-04-18T21:10:20.480186+0000","last_became_active":"2024-04-18T21:10:15.504379+0000","last_became_peered":"2024-04-18T21:10:15.504379+0000","last_unstale":"2024-04-18T21:10:20.480186+0000","last_undegraded":"2024-04-18T21:10:20.480186+0000","last_fullsized":"2024-04-18T21:10:20.480186+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:33:14.728553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":7075,"num_write":367,"num_write_kb":62738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":383,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482924+0000","last_change":"2024-04-18T21:10:00.497960+0000","last_active":"2024-04-18T21:10:20.482924+0000","last_peered":"2024-04-18T21:10:20.482924+0000","last_clean":"2024-04-18T21:10:20.482924+0000","last_became_active":"2024-04-18T21:10:00.496373+0000","last_became_peered":"2024-04-18T21:10:00.496373+0000","last_unstale":"2024-04-18T21:10:20.482924+0000","last_undegraded":"2024-04-18T21:10:20.482924+0000","last_fullsized":"2024-04-18T21:10:20.482924+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_clean_scrub_stamp":"2024-04-18T21:04:53.494814+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:56:52.975720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":159,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483821+0000","last_change":"2024-04-18T21:10:00.487584+0000","last_active":"2024-04-18T21:10:20.483821+0000","last_peered":"2024-04-18T21:10:20.483821+0000","last_clean":"2024-04-18T21:10:20.483821+0000","last_became_active":"2024-04-18T21:10:00.486722+0000","last_became_peered":"2024-04-18T21:10:00.486722+0000","last_unstale":"2024-04-18T21:10:20.483821+0000","last_undegraded":"2024-04-18T21:10:20.483821+0000","last_fullsized":"2024-04-18T21:10:20.483821+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:17:03.176148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"70'595","reported_seq":750,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.478616+0000","last_change":"2024-04-18T21:10:03.488427+0000","last_active":"2024-04-18T21:10:20.478616+0000","last_peered":"2024-04-18T21:10:20.478616+0000","last_clean":"2024-04-18T21:10:20.478616+0000","last_became_active":"2024-04-18T21:10:03.481344+0000","last_became_peered":"2024-04-18T21:10:03.481344+0000","last_unstale":"2024-04-18T21:10:20.478616+0000","last_undegraded":"2024-04-18T21:10:20.478616+0000","last_fullsized":"2024-04-18T21:10:20.478616+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:41.583248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":539,"num_write_kb":8449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4689862,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'443","reported_seq":1089,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.484583+0000","last_change":"2024-04-18T21:09:56.496310+0000","last_active":"2024-04-18T21:10:20.484583+0000","last_peered":"2024-04-18T21:10:20.484583+0000","last_clean":"2024-04-18T21:10:20.484583+0000","last_became_active":"2024-04-18T21:09:56.493327+0000","last_became_peered":"2024-04-18T21:09:56.493327+0000","last_unstale":"2024-04-18T21:10:20.484583+0000","last_undegraded":"2024-04-18T21:10:20.484583+0000","last_fullsized":"2024-04-18T21:10:20.484583+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:20:57.340997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":38975,"num_write":404,"num_write_kb":80038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":209,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482719+0000","last_change":"2024-04-18T21:09:50.817029+0000","last_active":"2024-04-18T21:10:20.482719+0000","last_peered":"2024-04-18T21:10:20.482719+0000","last_clean":"2024-04-18T21:10:20.482719+0000","last_became_active":"2024-04-18T21:09:50.816543+0000","last_became_peered":"2024-04-18T21:09:50.816543+0000","last_unstale":"2024-04-18T21:10:20.482719+0000","last_undegraded":"2024-04-18T21:10:20.482719+0000","last_fullsized":"2024-04-18T21:10:20.482719+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:47:33.047727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"70'129","reported_seq":312,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.478205+0000","last_change":"2024-04-18T21:10:03.489109+0000","last_active":"2024-04-18T21:10:20.478205+0000","last_peered":"2024-04-18T21:10:20.478205+0000","last_clean":"2024-04-18T21:10:20.478205+0000","last_became_active":"2024-04-18T21:10:03.486859+0000","last_became_peered":"2024-04-18T21:10:03.486859+0000","last_unstale":"2024-04-18T21:10:20.478205+0000","last_undegraded":"2024-04-18T21:10:20.478205+0000","last_fullsized":"2024-04-18T21:10:20.478205+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:52:04.172480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466419,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":55,"num_read_kb":1405,"num_write":58,"num_write_kb":1469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'457","reported_seq":680,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.548347+0000","last_change":"2024-04-18T21:10:09.543207+0000","last_active":"2024-04-18T21:10:20.548347+0000","last_peered":"2024-04-18T21:10:20.548347+0000","last_clean":"2024-04-18T21:10:20.548347+0000","last_became_active":"2024-04-18T21:10:09.537428+0000","last_became_peered":"2024-04-18T21:10:09.537428+0000","last_unstale":"2024-04-18T21:10:20.548347+0000","last_undegraded":"2024-04-18T21:10:20.548347+0000","last_fullsized":"2024-04-18T21:10:20.548347+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:21.987918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":27659,"num_write":426,"num_write_kb":80500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":208,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.478812+0000","last_change":"2024-04-18T21:09:50.832624+0000","last_active":"2024-04-18T21:10:20.478812+0000","last_peered":"2024-04-18T21:10:20.478812+0000","last_clean":"2024-04-18T21:10:20.478812+0000","last_became_active":"2024-04-18T21:09:50.831949+0000","last_became_peered":"2024-04-18T21:09:50.831949+0000","last_unstale":"2024-04-18T21:10:20.478812+0000","last_undegraded":"2024-04-18T21:10:20.478812+0000","last_fullsized":"2024-04-18T21:10:20.478812+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:35:45.986029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'170","reported_seq":368,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.545538+0000","last_change":"2024-04-18T21:09:53.538615+0000","last_active":"2024-04-18T21:10:20.545538+0000","last_peered":"2024-04-18T21:10:20.545538+0000","last_clean":"2024-04-18T21:10:20.545538+0000","last_became_active":"2024-04-18T21:09:53.537994+0000","last_became_peered":"2024-04-18T21:09:53.537994+0000","last_unstale":"2024-04-18T21:10:20.545538+0000","last_undegraded":"2024-04-18T21:10:20.545538+0000","last_fullsized":"2024-04-18T21:10:20.545538+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:02:34.372453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":8239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"71'346","reported_seq":910,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.480273+0000","last_change":"2024-04-18T21:10:11.487541+0000","last_active":"2024-04-18T21:10:20.480273+0000","last_peered":"2024-04-18T21:10:20.480273+0000","last_clean":"2024-04-18T21:10:20.480273+0000","last_became_active":"2024-04-18T21:10:11.484662+0000","last_became_peered":"2024-04-18T21:10:11.484662+0000","last_unstale":"2024-04-18T21:10:20.480273+0000","last_undegraded":"2024-04-18T21:10:20.480273+0000","last_fullsized":"2024-04-18T21:10:20.480273+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:50:21.491862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27042,"num_write":321,"num_write_kb":50693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":202,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483512+0000","last_change":"2024-04-18T21:05:00.576606+0000","last_active":"2024-04-18T21:10:20.483512+0000","last_peered":"2024-04-18T21:10:20.483512+0000","last_clean":"2024-04-18T21:10:20.483512+0000","last_became_active":"2024-04-18T21:05:00.575951+0000","last_became_peered":"2024-04-18T21:05:00.575951+0000","last_unstale":"2024-04-18T21:10:20.483512+0000","last_undegraded":"2024-04-18T21:10:20.483512+0000","last_fullsized":"2024-04-18T21:10:20.483512+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:32:17.612481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"70'63","reported_seq":259,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483817+0000","last_change":"2024-04-18T21:05:04.627296+0000","last_active":"2024-04-18T21:10:20.483817+0000","last_peered":"2024-04-18T21:10:20.483817+0000","last_clean":"2024-04-18T21:10:20.483817+0000","last_became_active":"2024-04-18T21:05:04.626801+0000","last_became_peered":"2024-04-18T21:05:04.626801+0000","last_unstale":"2024-04-18T21:10:20.483817+0000","last_undegraded":"2024-04-18T21:10:20.483817+0000","last_fullsized":"2024-04-18T21:10:20.483817+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:46:36.285416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"71'406","reported_seq":1041,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.479242+0000","last_change":"2024-04-18T21:09:59.495686+0000","last_active":"2024-04-18T21:10:20.479242+0000","last_peered":"2024-04-18T21:10:20.479242+0000","last_clean":"2024-04-18T21:10:20.479242+0000","last_became_active":"2024-04-18T21:09:59.493248+0000","last_became_peered":"2024-04-18T21:09:59.493248+0000","last_unstale":"2024-04-18T21:10:20.479242+0000","last_undegraded":"2024-04-18T21:10:20.479242+0000","last_fullsized":"2024-04-18T21:10:20.479242+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:11:23.853682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":35332,"num_write":370,"num_write_kb":71807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"70'284","reported_seq":315,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.484852+0000","last_change":"2024-04-18T21:10:00.504958+0000","last_active":"2024-04-18T21:10:20.484852+0000","last_peered":"2024-04-18T21:10:20.484852+0000","last_clean":"2024-04-18T21:10:20.484852+0000","last_became_active":"2024-04-18T21:10:00.503851+0000","last_became_peered":"2024-04-18T21:10:00.503851+0000","last_unstale":"2024-04-18T21:10:20.484852+0000","last_undegraded":"2024-04-18T21:10:20.484852+0000","last_fullsized":"2024-04-18T21:10:20.484852+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:10:27.397258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":218,"num_write_kb":4194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":135,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.479497+0000","last_change":"2024-04-18T21:10:03.484148+0000","last_active":"2024-04-18T21:10:20.479497+0000","last_peered":"2024-04-18T21:10:20.479497+0000","last_clean":"2024-04-18T21:10:20.479497+0000","last_became_active":"2024-04-18T21:10:03.480071+0000","last_became_peered":"2024-04-18T21:10:03.480071+0000","last_unstale":"2024-04-18T21:10:20.479497+0000","last_undegraded":"2024-04-18T21:10:20.479497+0000","last_fullsized":"2024-04-18T21:10:20.479497+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:50:30.257039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'386","reported_seq":577,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546997+0000","last_change":"2024-04-18T21:10:10.547885+0000","last_active":"2024-04-18T21:10:20.546997+0000","last_peered":"2024-04-18T21:10:20.546997+0000","last_clean":"2024-04-18T21:10:20.546997+0000","last_became_active":"2024-04-18T21:10:10.542515+0000","last_became_peered":"2024-04-18T21:10:10.542515+0000","last_unstale":"2024-04-18T21:10:20.546997+0000","last_undegraded":"2024-04-18T21:10:20.546997+0000","last_fullsized":"2024-04-18T21:10:20.546997+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:58:24.232536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14677,"num_write":355,"num_write_kb":51018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"70'55","reported_seq":257,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.479390+0000","last_change":"2024-04-18T21:09:50.833424+0000","last_active":"2024-04-18T21:10:20.479390+0000","last_peered":"2024-04-18T21:10:20.479390+0000","last_clean":"2024-04-18T21:10:20.479390+0000","last_became_active":"2024-04-18T21:09:50.832752+0000","last_became_peered":"2024-04-18T21:09:50.832752+0000","last_unstale":"2024-04-18T21:10:20.479390+0000","last_undegraded":"2024-04-18T21:10:20.479390+0000","last_fullsized":"2024-04-18T21:10:20.479390+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:48.945329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":165,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.548117+0000","last_change":"2024-04-18T21:09:50.900338+0000","last_active":"2024-04-18T21:10:20.548117+0000","last_peered":"2024-04-18T21:10:20.548117+0000","last_clean":"2024-04-18T21:10:20.548117+0000","last_became_active":"2024-04-18T21:09:50.896844+0000","last_became_peered":"2024-04-18T21:09:50.896844+0000","last_unstale":"2024-04-18T21:10:20.548117+0000","last_undegraded":"2024-04-18T21:10:20.548117+0000","last_fullsized":"2024-04-18T21:10:20.548117+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:11:35.543409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"71'402","reported_seq":591,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546209+0000","last_change":"2024-04-18T21:10:05.542484+0000","last_active":"2024-04-18T21:10:20.546209+0000","last_peered":"2024-04-18T21:10:20.546209+0000","last_clean":"2024-04-18T21:10:20.546209+0000","last_became_active":"2024-04-18T21:10:05.536763+0000","last_became_peered":"2024-04-18T21:10:05.536763+0000","last_unstale":"2024-04-18T21:10:20.546209+0000","last_undegraded":"2024-04-18T21:10:20.546209+0000","last_fullsized":"2024-04-18T21:10:20.546209+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:08:22.367267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12468,"num_write":369,"num_write_kb":67231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"70'60","reported_seq":263,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.480741+0000","last_change":"2024-04-18T21:09:50.832598+0000","last_active":"2024-04-18T21:10:20.480741+0000","last_peered":"2024-04-18T21:10:20.480741+0000","last_clean":"2024-04-18T21:10:20.480741+0000","last_became_active":"2024-04-18T21:09:50.832030+0000","last_became_peered":"2024-04-18T21:09:50.832030+0000","last_unstale":"2024-04-18T21:10:20.480741+0000","last_undegraded":"2024-04-18T21:10:20.480741+0000","last_fullsized":"2024-04-18T21:10:20.480741+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:10:27.397258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":135,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.480666+0000","last_change":"2024-04-18T21:10:03.492761+0000","last_active":"2024-04-18T21:10:20.480666+0000","last_peered":"2024-04-18T21:10:20.480666+0000","last_clean":"2024-04-18T21:10:20.480666+0000","last_became_active":"2024-04-18T21:10:03.492145+0000","last_became_peered":"2024-04-18T21:10:03.492145+0000","last_unstale":"2024-04-18T21:10:20.480666+0000","last_undegraded":"2024-04-18T21:10:20.480666+0000","last_fullsized":"2024-04-18T21:10:20.480666+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:20:00.853523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'421","reported_seq":628,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.477954+0000","last_change":"2024-04-18T21:10:03.488774+0000","last_active":"2024-04-18T21:10:20.477954+0000","last_peered":"2024-04-18T21:10:20.477954+0000","last_clean":"2024-04-18T21:10:20.477954+0000","last_became_active":"2024-04-18T21:10:03.479773+0000","last_became_peered":"2024-04-18T21:10:03.479773+0000","last_unstale":"2024-04-18T21:10:20.477954+0000","last_undegraded":"2024-04-18T21:10:20.477954+0000","last_fullsized":"2024-04-18T21:10:20.477954+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:15:12.326904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":16183,"num_write":377,"num_write_kb":50451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"71'110","reported_seq":325,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.480498+0000","last_change":"2024-04-18T21:10:00.497917+0000","last_active":"2024-04-18T21:10:20.480498+0000","last_peered":"2024-04-18T21:10:20.480498+0000","last_clean":"2024-04-18T21:10:20.480498+0000","last_became_active":"2024-04-18T21:10:00.494644+0000","last_became_peered":"2024-04-18T21:10:00.494644+0000","last_unstale":"2024-04-18T21:10:20.480498+0000","last_undegraded":"2024-04-18T21:10:20.480498+0000","last_fullsized":"2024-04-18T21:10:20.480498+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:40:57.347353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":1251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":160,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.484841+0000","last_change":"2024-04-18T21:10:00.493764+0000","last_active":"2024-04-18T21:10:20.484841+0000","last_peered":"2024-04-18T21:10:20.484841+0000","last_clean":"2024-04-18T21:10:20.484841+0000","last_became_active":"2024-04-18T21:10:00.492672+0000","last_became_peered":"2024-04-18T21:10:00.492672+0000","last_unstale":"2024-04-18T21:10:20.484841+0000","last_undegraded":"2024-04-18T21:10:20.484841+0000","last_fullsized":"2024-04-18T21:10:20.484841+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:48:46.709401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'384","reported_seq":597,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546833+0000","last_change":"2024-04-18T21:09:57.572865+0000","last_active":"2024-04-18T21:10:20.546833+0000","last_peered":"2024-04-18T21:10:20.546833+0000","last_clean":"2024-04-18T21:10:20.546833+0000","last_became_active":"2024-04-18T21:09:57.567962+0000","last_became_peered":"2024-04-18T21:09:57.567962+0000","last_unstale":"2024-04-18T21:10:20.546833+0000","last_undegraded":"2024-04-18T21:10:20.546833+0000","last_fullsized":"2024-04-18T21:10:20.546833+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:51:24.627186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":15567,"num_write":351,"num_write_kb":42959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"71'396","reported_seq":924,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483421+0000","last_change":"2024-04-18T21:10:13.482151+0000","last_active":"2024-04-18T21:10:20.483421+0000","last_peered":"2024-04-18T21:10:20.483421+0000","last_clean":"2024-04-18T21:10:20.483421+0000","last_became_active":"2024-04-18T21:10:13.479320+0000","last_became_peered":"2024-04-18T21:10:13.479320+0000","last_unstale":"2024-04-18T21:10:20.483421+0000","last_undegraded":"2024-04-18T21:10:20.483421+0000","last_fullsized":"2024-04-18T21:10:20.483421+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:33:52.248167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12943,"num_write":353,"num_write_kb":35357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":342,"num_bytes_recovered":3500882,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"71'277","reported_seq":318,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483992+0000","last_change":"2024-04-18T21:10:00.495047+0000","last_active":"2024-04-18T21:10:20.483992+0000","last_peered":"2024-04-18T21:10:20.483992+0000","last_clean":"2024-04-18T21:10:20.483992+0000","last_became_active":"2024-04-18T21:10:00.493088+0000","last_became_peered":"2024-04-18T21:10:00.493088+0000","last_unstale":"2024-04-18T21:10:20.483992+0000","last_undegraded":"2024-04-18T21:10:20.483992+0000","last_fullsized":"2024-04-18T21:10:20.483992+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:39:08.263781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":221,"num_write_kb":8303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":8389370,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'411","reported_seq":1007,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.477964+0000","last_change":"2024-04-18T21:10:04.485332+0000","last_active":"2024-04-18T21:10:20.477964+0000","last_peered":"2024-04-18T21:10:20.477964+0000","last_clean":"2024-04-18T21:10:20.477964+0000","last_became_active":"2024-04-18T21:10:04.482320+0000","last_became_peered":"2024-04-18T21:10:04.482320+0000","last_unstale":"2024-04-18T21:10:20.477964+0000","last_undegraded":"2024-04-18T21:10:20.477964+0000","last_fullsized":"2024-04-18T21:10:20.477964+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:35:57.043682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":17179,"num_write":375,"num_write_kb":38991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"70'85","reported_seq":168,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547812+0000","last_change":"2024-04-18T21:09:50.890616+0000","last_active":"2024-04-18T21:10:20.547812+0000","last_peered":"2024-04-18T21:10:20.547812+0000","last_clean":"2024-04-18T21:10:20.547812+0000","last_became_active":"2024-04-18T21:09:50.874855+0000","last_became_peered":"2024-04-18T21:09:50.874855+0000","last_unstale":"2024-04-18T21:10:20.547812+0000","last_undegraded":"2024-04-18T21:10:20.547812+0000","last_fullsized":"2024-04-18T21:10:20.547812+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:03:54.726282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"70'230","reported_seq":259,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.484617+0000","last_change":"2024-04-18T21:10:00.499373+0000","last_active":"2024-04-18T21:10:20.484617+0000","last_peered":"2024-04-18T21:10:20.484617+0000","last_clean":"2024-04-18T21:10:20.484617+0000","last_became_active":"2024-04-18T21:10:00.498141+0000","last_became_peered":"2024-04-18T21:10:00.498141+0000","last_unstale":"2024-04-18T21:10:20.484617+0000","last_undegraded":"2024-04-18T21:10:20.484617+0000","last_fullsized":"2024-04-18T21:10:20.484617+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:55:01.865593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":4178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"71'493","reported_seq":732,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.477822+0000","last_change":"2024-04-18T21:05:05.642793+0000","last_active":"2024-04-18T21:10:20.477822+0000","last_peered":"2024-04-18T21:10:20.477822+0000","last_clean":"2024-04-18T21:10:20.477822+0000","last_became_active":"2024-04-18T21:05:05.641983+0000","last_became_peered":"2024-04-18T21:05:05.641983+0000","last_unstale":"2024-04-18T21:10:20.477822+0000","last_undegraded":"2024-04-18T21:10:20.477822+0000","last_fullsized":"2024-04-18T21:10:20.477822+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:46:36.339289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23833,"num_write":461,"num_write_kb":76873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"70'62","reported_seq":257,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.480547+0000","last_change":"2024-04-18T21:05:04.641445+0000","last_active":"2024-04-18T21:10:20.480547+0000","last_peered":"2024-04-18T21:10:20.480547+0000","last_clean":"2024-04-18T21:10:20.480547+0000","last_became_active":"2024-04-18T21:05:04.640682+0000","last_became_peered":"2024-04-18T21:05:04.640682+0000","last_unstale":"2024-04-18T21:10:20.480547+0000","last_undegraded":"2024-04-18T21:10:20.480547+0000","last_fullsized":"2024-04-18T21:10:20.480547+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:46:36.285416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'436","reported_seq":1063,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.477947+0000","last_change":"2024-04-18T21:10:18.490900+0000","last_active":"2024-04-18T21:10:20.477947+0000","last_peered":"2024-04-18T21:10:20.477947+0000","last_clean":"2024-04-18T21:10:20.477947+0000","last_became_active":"2024-04-18T21:10:18.487788+0000","last_became_peered":"2024-04-18T21:10:18.487788+0000","last_unstale":"2024-04-18T21:10:20.477947+0000","last_undegraded":"2024-04-18T21:10:20.477947+0000","last_fullsized":"2024-04-18T21:10:20.477947+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:57:00.495580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14561,"num_write":408,"num_write_kb":47462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'369","reported_seq":571,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.548399+0000","last_change":"2024-04-18T21:10:02.553999+0000","last_active":"2024-04-18T21:10:20.548399+0000","last_peered":"2024-04-18T21:10:20.548399+0000","last_clean":"2024-04-18T21:10:20.548399+0000","last_became_active":"2024-04-18T21:10:02.549471+0000","last_became_peered":"2024-04-18T21:10:02.549471+0000","last_unstale":"2024-04-18T21:10:20.548399+0000","last_undegraded":"2024-04-18T21:10:20.548399+0000","last_fullsized":"2024-04-18T21:10:20.548399+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:52:14.371235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13619,"num_write":339,"num_write_kb":63086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"70'888","reported_seq":1030,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.478410+0000","last_change":"2024-04-18T21:10:03.486911+0000","last_active":"2024-04-18T21:10:20.478410+0000","last_peered":"2024-04-18T21:10:20.478410+0000","last_clean":"2024-04-18T21:10:20.478410+0000","last_became_active":"2024-04-18T21:10:03.480576+0000","last_became_peered":"2024-04-18T21:10:03.480576+0000","last_unstale":"2024-04-18T21:10:20.478410+0000","last_undegraded":"2024-04-18T21:10:20.478410+0000","last_fullsized":"2024-04-18T21:10:20.478410+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:41:06.632064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":823,"num_write_kb":8582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'398","reported_seq":562,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.479937+0000","last_change":"2024-04-18T21:10:03.491426+0000","last_active":"2024-04-18T21:10:20.479937+0000","last_peered":"2024-04-18T21:10:20.479937+0000","last_clean":"2024-04-18T21:10:20.479937+0000","last_became_active":"2024-04-18T21:10:03.483190+0000","last_became_peered":"2024-04-18T21:10:03.483190+0000","last_unstale":"2024-04-18T21:10:20.479937+0000","last_undegraded":"2024-04-18T21:10:20.479937+0000","last_fullsized":"2024-04-18T21:10:20.479937+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:05:10.611580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14684,"num_write":380,"num_write_kb":88822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"70'169","reported_seq":384,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.478144+0000","last_change":"2024-04-18T21:10:00.494974+0000","last_active":"2024-04-18T21:10:20.478144+0000","last_peered":"2024-04-18T21:10:20.478144+0000","last_clean":"2024-04-18T21:10:20.478144+0000","last_became_active":"2024-04-18T21:10:00.492196+0000","last_became_peered":"2024-04-18T21:10:00.492196+0000","last_unstale":"2024-04-18T21:10:20.478144+0000","last_undegraded":"2024-04-18T21:10:20.478144+0000","last_fullsized":"2024-04-18T21:10:20.478144+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:33:51.236211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":4162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'406","reported_seq":630,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546278+0000","last_change":"2024-04-18T21:10:12.553754+0000","last_active":"2024-04-18T21:10:20.546278+0000","last_peered":"2024-04-18T21:10:20.546278+0000","last_clean":"2024-04-18T21:10:20.546278+0000","last_became_active":"2024-04-18T21:10:12.546148+0000","last_became_peered":"2024-04-18T21:10:12.546148+0000","last_unstale":"2024-04-18T21:10:20.546278+0000","last_undegraded":"2024-04-18T21:10:20.546278+0000","last_fullsized":"2024-04-18T21:10:20.546278+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:12:37.876185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27495,"num_write":363,"num_write_kb":89134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"72'192","reported_seq":385,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546350+0000","last_change":"2024-04-18T21:09:53.541766+0000","last_active":"2024-04-18T21:10:20.546350+0000","last_peered":"2024-04-18T21:10:20.546350+0000","last_clean":"2024-04-18T21:10:20.546350+0000","last_became_active":"2024-04-18T21:09:53.541300+0000","last_became_peered":"2024-04-18T21:09:53.541300+0000","last_unstale":"2024-04-18T21:10:20.546350+0000","last_undegraded":"2024-04-18T21:10:20.546350+0000","last_fullsized":"2024-04-18T21:10:20.546350+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:26:14.718922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12425030,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":12201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8230726,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"71'383","reported_seq":617,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547547+0000","last_change":"2024-04-18T21:09:55.555798+0000","last_active":"2024-04-18T21:10:20.547547+0000","last_peered":"2024-04-18T21:10:20.547547+0000","last_clean":"2024-04-18T21:10:20.547547+0000","last_became_active":"2024-04-18T21:09:55.551135+0000","last_became_peered":"2024-04-18T21:09:55.551135+0000","last_unstale":"2024-04-18T21:10:20.547547+0000","last_undegraded":"2024-04-18T21:10:20.547547+0000","last_fullsized":"2024-04-18T21:10:20.547547+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:00:01.739082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21614,"num_write":351,"num_write_kb":79501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"70'66","reported_seq":159,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546526+0000","last_change":"2024-04-18T21:10:00.553114+0000","last_active":"2024-04-18T21:10:20.546526+0000","last_peered":"2024-04-18T21:10:20.546526+0000","last_clean":"2024-04-18T21:10:20.546526+0000","last_became_active":"2024-04-18T21:10:00.552067+0000","last_became_peered":"2024-04-18T21:10:00.552067+0000","last_unstale":"2024-04-18T21:10:20.546526+0000","last_undegraded":"2024-04-18T21:10:20.546526+0000","last_fullsized":"2024-04-18T21:10:20.546526+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:51:32.567297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"71'345","reported_seq":546,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483218+0000","last_change":"2024-04-18T21:05:05.624840+0000","last_active":"2024-04-18T21:10:20.483218+0000","last_peered":"2024-04-18T21:10:20.483218+0000","last_clean":"2024-04-18T21:10:20.483218+0000","last_became_active":"2024-04-18T21:05:05.622950+0000","last_became_peered":"2024-04-18T21:05:05.622950+0000","last_unstale":"2024-04-18T21:10:20.483218+0000","last_undegraded":"2024-04-18T21:10:20.483218+0000","last_fullsized":"2024-04-18T21:10:20.483218+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:27:17.530889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":317,"num_write_kb":29335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"70'171","reported_seq":286,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483766+0000","last_change":"2024-04-18T21:10:00.507624+0000","last_active":"2024-04-18T21:10:20.483766+0000","last_peered":"2024-04-18T21:10:20.483766+0000","last_clean":"2024-04-18T21:10:20.483766+0000","last_became_active":"2024-04-18T21:10:00.507132+0000","last_became_peered":"2024-04-18T21:10:00.507132+0000","last_unstale":"2024-04-18T21:10:20.483766+0000","last_undegraded":"2024-04-18T21:10:20.483766+0000","last_fullsized":"2024-04-18T21:10:20.483766+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:35:50.013019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":4154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"71'417","reported_seq":643,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483150+0000","last_change":"2024-04-18T21:05:05.627962+0000","last_active":"2024-04-18T21:10:20.483150+0000","last_peered":"2024-04-18T21:10:20.483150+0000","last_clean":"2024-04-18T21:10:20.483150+0000","last_became_active":"2024-04-18T21:05:05.626698+0000","last_became_peered":"2024-04-18T21:05:05.626698+0000","last_unstale":"2024-04-18T21:10:20.483150+0000","last_undegraded":"2024-04-18T21:10:20.483150+0000","last_fullsized":"2024-04-18T21:10:20.483150+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:48:48.973087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":17040,"num_write":384,"num_write_kb":83740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"70'276","reported_seq":471,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547237+0000","last_change":"2024-04-18T21:09:53.543611+0000","last_active":"2024-04-18T21:10:20.547237+0000","last_peered":"2024-04-18T21:10:20.547237+0000","last_clean":"2024-04-18T21:10:20.547237+0000","last_became_active":"2024-04-18T21:09:53.542863+0000","last_became_peered":"2024-04-18T21:09:53.542863+0000","last_unstale":"2024-04-18T21:10:20.547237+0000","last_undegraded":"2024-04-18T21:10:20.547237+0000","last_fullsized":"2024-04-18T21:10:20.547237+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:22.582074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":12399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"71'428","reported_seq":637,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546271+0000","last_change":"2024-04-18T21:10:08.541152+0000","last_active":"2024-04-18T21:10:20.546271+0000","last_peered":"2024-04-18T21:10:20.546271+0000","last_clean":"2024-04-18T21:10:20.546271+0000","last_became_active":"2024-04-18T21:10:08.536423+0000","last_became_peered":"2024-04-18T21:10:08.536423+0000","last_unstale":"2024-04-18T21:10:20.546271+0000","last_undegraded":"2024-04-18T21:10:20.546271+0000","last_fullsized":"2024-04-18T21:10:20.546271+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:26.666677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22548,"num_write":398,"num_write_kb":75972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"70'70","reported_seq":273,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.480343+0000","last_change":"2024-04-18T21:09:50.833350+0000","last_active":"2024-04-18T21:10:20.480343+0000","last_peered":"2024-04-18T21:10:20.480343+0000","last_clean":"2024-04-18T21:10:20.480343+0000","last_became_active":"2024-04-18T21:09:50.832355+0000","last_became_peered":"2024-04-18T21:09:50.832355+0000","last_unstale":"2024-04-18T21:10:20.480343+0000","last_undegraded":"2024-04-18T21:10:20.480343+0000","last_fullsized":"2024-04-18T21:10:20.480343+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:39:09.627425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'459","reported_seq":642,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482639+0000","last_change":"2024-04-18T21:10:01.503378+0000","last_active":"2024-04-18T21:10:20.482639+0000","last_peered":"2024-04-18T21:10:20.482639+0000","last_clean":"2024-04-18T21:10:20.482639+0000","last_became_active":"2024-04-18T21:10:01.497275+0000","last_became_peered":"2024-04-18T21:10:01.497275+0000","last_unstale":"2024-04-18T21:10:20.482639+0000","last_undegraded":"2024-04-18T21:10:20.482639+0000","last_fullsized":"2024-04-18T21:10:20.482639+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:40:35.832428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13353,"num_write":429,"num_write_kb":88123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"70'113","reported_seq":332,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.480338+0000","last_change":"2024-04-18T21:10:00.499468+0000","last_active":"2024-04-18T21:10:20.480338+0000","last_peered":"2024-04-18T21:10:20.480338+0000","last_clean":"2024-04-18T21:10:20.480338+0000","last_became_active":"2024-04-18T21:10:00.494734+0000","last_became_peered":"2024-04-18T21:10:00.494734+0000","last_unstale":"2024-04-18T21:10:20.480338+0000","last_undegraded":"2024-04-18T21:10:20.480338+0000","last_fullsized":"2024-04-18T21:10:20.480338+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:58:34.790588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194886,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2531,"num_read_kb":1304649,"num_write":24542,"num_write_kb":4299443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8145,"num_bytes_recovered":4488063,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26603,"ondisk_log_size":26603,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127139127,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":55,"num_read_kb":1405,"num_write":4542,"num_write_kb":127514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":92002768,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254345216,"data_stored":254278254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4409,"internal_metadata":0},"log_size":6331,"ondisk_log_size":6331,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738439,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":187628,"kb_used_data":80152,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94184212,"statfs":{"total":96636764160,"available":96444633088,"internally_reserved":0,"allocated":82075648,"data_stored":81480582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110033349},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":77,"seq":330712481801,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":147296,"kb_used_data":83404,"kb_used_omap":5,"kb_used_meta":63866,"kb_avail":94224544,"statfs":{"total":96636764160,"available":96485933056,"internally_reserved":0,"allocated":85405696,"data_stored":84799073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6004,"internal_metadata":65398924},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738437,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":160468,"kb_used_data":89096,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94211372,"statfs":{"total":96636764160,"available":96472444928,"internally_reserved":0,"allocated":91234304,"data_stored":90618294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":89579520,"data_stored":89548273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":83750912,"data_stored":83729052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4409,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81014784,"data_stored":81000929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:10:26.669 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T21:10:26.998 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:10:26.998 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":108,"fsid":"dc017990-0393-4ab0-b604-5e7052fdc7bd","created":"2024-04-18T21:04:43.507538+0000","modified":"2024-04-18T21:10:20.469805+0000","last_up_change":"2024-04-18T21:09:49.735843+0000","last_in_change":"2024-04-18T21:04:44.402191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T21:04:52.538153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T21:04:58.673793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T21:05:03.314171+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T21:05:03.931699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1854d737-3a67-416a-8c88-0f126505a0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6801","nonce":1948809768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6803","nonce":1948809768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6807","nonce":1948809768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6805","nonce":1948809768}]},"public_addr":"172.21.15.132:6801/1948809768","cluster_addr":"172.21.15.132:6803/1948809768","heartbeat_back_addr":"172.21.15.132:6807/1948809768","heartbeat_front_addr":"172.21.15.132:6805/1948809768","state":["exists","up"]},{"osd":1,"uuid":"dfeae661-3f8a-4d41-b287-7eb02c16b91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":55,"up_from":77,"up_thru":105,"down_at":56,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":806525864},{"type":"v1","addr":"172.21.15.150:6801","nonce":806525864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":806525864},{"type":"v1","addr":"172.21.15.150:6803","nonce":806525864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":806525864},{"type":"v1","addr":"172.21.15.150:6807","nonce":806525864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":806525864},{"type":"v1","addr":"172.21.15.150:6805","nonce":806525864}]},"public_addr":"172.21.15.150:6801/806525864","cluster_addr":"172.21.15.150:6803/806525864","heartbeat_back_addr":"172.21.15.150:6807/806525864","heartbeat_front_addr":"172.21.15.150:6805/806525864","state":["exists","up"]},{"osd":2,"uuid":"56a34021-e2dc-41ff-822c-7ec123466f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6801","nonce":429896900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6803","nonce":429896900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6807","nonce":429896900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6805","nonce":429896900}]},"public_addr":"172.21.15.187:6801/429896900","cluster_addr":"172.21.15.187:6803/429896900","heartbeat_back_addr":"172.21.15.187:6807/429896900","heartbeat_front_addr":"172.21.15.187:6805/429896900","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:49.804359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:49.790978+0000","dead_epoch":55},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:49.762943+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T21:10:28.016 INFO:tasks.ceph:Scrubbing osd.0 2024-04-18T21:10:28.017 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-18T21:10:28.175 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-04-18T21:10:28.177 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-18T21:10:28.177 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-04-18T21:10:28.192 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-18T21:10:28.474 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 0 to deep-scrub 2024-04-18T21:10:28.494 INFO:tasks.ceph:Scrubbing osd.1 2024-04-18T21:10:28.494 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-18T21:10:28.643 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-04-18T21:10:28.643 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-04-18T21:10:28.643 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-04-18T21:10:28.660 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-18T21:10:28.934 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 1 to deep-scrub 2024-04-18T21:10:28.952 INFO:tasks.ceph:Scrubbing osd.2 2024-04-18T21:10:28.952 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-18T21:10:29.085 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-04-18T21:10:29.085 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-18T21:10:29.085 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-04-18T21:10:29.099 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-18T21:10:29.372 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 2 to deep-scrub 2024-04-18T21:10:29.391 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:10:29.675 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:10:29.677 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-04-18T21:10:29.691 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":274,"stamp":"2024-04-18T21:10:28.645549+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127729495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2722,"num_read_kb":1306172,"num_write":29287,"num_write_kb":4430417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8182,"num_bytes_recovered":97081199,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33091,"ondisk_log_size":33091,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":495392,"kb_used_data":252652,"kb_used_omap":8,"kb_used_meta":242679,"kb_avail":282620128,"statfs":{"total":289910292480,"available":289403011072,"internally_reserved":0,"allocated":258715648,"data_stored":256897949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9194,"internal_metadata":248503318},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":305,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.171663"},"pg_stats":[{"pgid":"4.3f","version":"71'418","reported_seq":614,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.548813+0000","last_change":"2024-04-18T21:10:16.576720+0000","last_active":"2024-04-18T21:10:20.548813+0000","last_peered":"2024-04-18T21:10:20.548813+0000","last_clean":"2024-04-18T21:10:20.548813+0000","last_became_active":"2024-04-18T21:10:16.571985+0000","last_became_peered":"2024-04-18T21:10:16.571985+0000","last_unstale":"2024-04-18T21:10:20.548813+0000","last_undegraded":"2024-04-18T21:10:20.548813+0000","last_fullsized":"2024-04-18T21:10:20.548813+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:28:48.196628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":19677,"num_write":386,"num_write_kb":87615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"71'417","reported_seq":631,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.548242+0000","last_change":"2024-04-18T21:10:05.546965+0000","last_active":"2024-04-18T21:10:20.548242+0000","last_peered":"2024-04-18T21:10:20.548242+0000","last_clean":"2024-04-18T21:10:20.548242+0000","last_became_active":"2024-04-18T21:10:05.541170+0000","last_became_peered":"2024-04-18T21:10:05.541170+0000","last_unstale":"2024-04-18T21:10:20.548242+0000","last_undegraded":"2024-04-18T21:10:20.548242+0000","last_fullsized":"2024-04-18T21:10:20.548242+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:04:05.630763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":12123,"num_write":387,"num_write_kb":47157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"71'379","reported_seq":940,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483812+0000","last_change":"2024-04-18T21:09:54.480753+0000","last_active":"2024-04-18T21:10:20.483812+0000","last_peered":"2024-04-18T21:10:20.483812+0000","last_clean":"2024-04-18T21:10:20.483812+0000","last_became_active":"2024-04-18T21:09:54.478020+0000","last_became_peered":"2024-04-18T21:09:54.478020+0000","last_unstale":"2024-04-18T21:10:20.483812+0000","last_undegraded":"2024-04-18T21:10:20.483812+0000","last_fullsized":"2024-04-18T21:10:20.483812+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:24:18.705477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":10040,"num_write":353,"num_write_kb":63202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'372","reported_seq":574,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483063+0000","last_change":"2024-04-18T21:05:05.629321+0000","last_active":"2024-04-18T21:10:20.483063+0000","last_peered":"2024-04-18T21:10:20.483063+0000","last_clean":"2024-04-18T21:10:20.483063+0000","last_became_active":"2024-04-18T21:05:05.627956+0000","last_became_peered":"2024-04-18T21:05:05.627956+0000","last_unstale":"2024-04-18T21:10:20.483063+0000","last_undegraded":"2024-04-18T21:10:20.483063+0000","last_fullsized":"2024-04-18T21:10:20.483063+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:15:28.458476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2735,"num_write":328,"num_write_kb":22107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"71'416","reported_seq":616,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546812+0000","last_change":"2024-04-18T21:10:00.560644+0000","last_active":"2024-04-18T21:10:20.546812+0000","last_peered":"2024-04-18T21:10:20.546812+0000","last_clean":"2024-04-18T21:10:20.546812+0000","last_became_active":"2024-04-18T21:10:00.553862+0000","last_became_peered":"2024-04-18T21:10:00.553862+0000","last_unstale":"2024-04-18T21:10:20.546812+0000","last_undegraded":"2024-04-18T21:10:20.546812+0000","last_fullsized":"2024-04-18T21:10:20.546812+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:11:49.688538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6533,"num_write":389,"num_write_kb":43666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"71'374","reported_seq":574,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482584+0000","last_change":"2024-04-18T21:10:01.495684+0000","last_active":"2024-04-18T21:10:20.482584+0000","last_peered":"2024-04-18T21:10:20.482584+0000","last_clean":"2024-04-18T21:10:20.482584+0000","last_became_active":"2024-04-18T21:10:01.486640+0000","last_became_peered":"2024-04-18T21:10:01.486640+0000","last_unstale":"2024-04-18T21:10:20.482584+0000","last_undegraded":"2024-04-18T21:10:20.482584+0000","last_fullsized":"2024-04-18T21:10:20.482584+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:39:10.639381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20415,"num_write":354,"num_write_kb":34462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'418","reported_seq":652,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482999+0000","last_change":"2024-04-18T21:05:05.625047+0000","last_active":"2024-04-18T21:10:20.482999+0000","last_peered":"2024-04-18T21:10:20.482999+0000","last_clean":"2024-04-18T21:10:20.482999+0000","last_became_active":"2024-04-18T21:05:05.622781+0000","last_became_peered":"2024-04-18T21:05:05.622781+0000","last_unstale":"2024-04-18T21:10:20.482999+0000","last_undegraded":"2024-04-18T21:10:20.482999+0000","last_fullsized":"2024-04-18T21:10:20.482999+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:12:12.944469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21103,"num_write":385,"num_write_kb":50678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"71'399","reported_seq":638,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.481939+0000","last_change":"2024-04-18T21:10:00.495543+0000","last_active":"2024-04-18T21:10:20.481939+0000","last_peered":"2024-04-18T21:10:20.481939+0000","last_clean":"2024-04-18T21:10:20.481939+0000","last_became_active":"2024-04-18T21:10:00.488705+0000","last_became_peered":"2024-04-18T21:10:00.488705+0000","last_unstale":"2024-04-18T21:10:20.481939+0000","last_undegraded":"2024-04-18T21:10:20.481939+0000","last_fullsized":"2024-04-18T21:10:20.481939+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:11.892092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":44692,"num_write":361,"num_write_kb":105170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"71'385","reported_seq":950,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.479921+0000","last_change":"2024-04-18T21:10:06.487113+0000","last_active":"2024-04-18T21:10:20.479921+0000","last_peered":"2024-04-18T21:10:20.479921+0000","last_clean":"2024-04-18T21:10:20.479921+0000","last_became_active":"2024-04-18T21:10:06.482087+0000","last_became_peered":"2024-04-18T21:10:06.482087+0000","last_unstale":"2024-04-18T21:10:20.479921+0000","last_undegraded":"2024-04-18T21:10:20.479921+0000","last_fullsized":"2024-04-18T21:10:20.479921+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:10:51.435131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":994,"num_write":358,"num_write_kb":25964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'409","reported_seq":644,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546781+0000","last_change":"2024-04-18T21:10:12.550697+0000","last_active":"2024-04-18T21:10:20.546781+0000","last_peered":"2024-04-18T21:10:20.546781+0000","last_clean":"2024-04-18T21:10:20.546781+0000","last_became_active":"2024-04-18T21:10:12.546621+0000","last_became_peered":"2024-04-18T21:10:12.546621+0000","last_unstale":"2024-04-18T21:10:20.546781+0000","last_undegraded":"2024-04-18T21:10:20.546781+0000","last_fullsized":"2024-04-18T21:10:20.546781+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:55:30.422126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":26170,"num_write":372,"num_write_kb":83931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"71'366","reported_seq":577,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483819+0000","last_change":"2024-04-18T21:10:01.496068+0000","last_active":"2024-04-18T21:10:20.483819+0000","last_peered":"2024-04-18T21:10:20.483819+0000","last_clean":"2024-04-18T21:10:20.483819+0000","last_became_active":"2024-04-18T21:10:01.488047+0000","last_became_peered":"2024-04-18T21:10:01.488047+0000","last_unstale":"2024-04-18T21:10:20.483819+0000","last_undegraded":"2024-04-18T21:10:20.483819+0000","last_fullsized":"2024-04-18T21:10:20.483819+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:49.957286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":18907,"num_write":347,"num_write_kb":26153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"71'346","reported_seq":549,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547957+0000","last_change":"2024-04-18T21:10:00.560349+0000","last_active":"2024-04-18T21:10:20.547957+0000","last_peered":"2024-04-18T21:10:20.547957+0000","last_clean":"2024-04-18T21:10:20.547957+0000","last_became_active":"2024-04-18T21:10:00.557412+0000","last_became_peered":"2024-04-18T21:10:00.557412+0000","last_unstale":"2024-04-18T21:10:20.547957+0000","last_undegraded":"2024-04-18T21:10:20.547957+0000","last_fullsized":"2024-04-18T21:10:20.547957+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:54:33.428937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":6245,"num_write":324,"num_write_kb":37970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"71'417","reported_seq":638,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547313+0000","last_change":"2024-04-18T21:10:02.555899+0000","last_active":"2024-04-18T21:10:20.547313+0000","last_peered":"2024-04-18T21:10:20.547313+0000","last_clean":"2024-04-18T21:10:20.547313+0000","last_became_active":"2024-04-18T21:10:02.551406+0000","last_became_peered":"2024-04-18T21:10:02.551406+0000","last_unstale":"2024-04-18T21:10:20.547313+0000","last_undegraded":"2024-04-18T21:10:20.547313+0000","last_fullsized":"2024-04-18T21:10:20.547313+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:41:17.455669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":21623,"num_write":381,"num_write_kb":71306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"71'398","reported_seq":977,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482881+0000","last_change":"2024-04-18T21:10:11.491565+0000","last_active":"2024-04-18T21:10:20.482881+0000","last_peered":"2024-04-18T21:10:20.482881+0000","last_clean":"2024-04-18T21:10:20.482881+0000","last_became_active":"2024-04-18T21:10:11.486593+0000","last_became_peered":"2024-04-18T21:10:11.486593+0000","last_unstale":"2024-04-18T21:10:20.482881+0000","last_undegraded":"2024-04-18T21:10:20.482881+0000","last_fullsized":"2024-04-18T21:10:20.482881+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:11:23.853682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":369,"num_write_kb":30006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'435","reported_seq":1102,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482470+0000","last_change":"2024-04-18T21:10:15.509238+0000","last_active":"2024-04-18T21:10:20.482470+0000","last_peered":"2024-04-18T21:10:20.482470+0000","last_clean":"2024-04-18T21:10:20.482470+0000","last_became_active":"2024-04-18T21:10:15.506328+0000","last_became_peered":"2024-04-18T21:10:15.506328+0000","last_unstale":"2024-04-18T21:10:20.482470+0000","last_undegraded":"2024-04-18T21:10:20.482470+0000","last_fullsized":"2024-04-18T21:10:20.482470+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:49:44.996311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":31523,"num_write":402,"num_write_kb":121466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":346,"num_bytes_recovered":410327,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'446","reported_seq":687,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482015+0000","last_change":"2024-04-18T21:05:05.638203+0000","last_active":"2024-04-18T21:10:20.482015+0000","last_peered":"2024-04-18T21:10:20.482015+0000","last_clean":"2024-04-18T21:10:20.482015+0000","last_became_active":"2024-04-18T21:05:05.637352+0000","last_became_peered":"2024-04-18T21:05:05.637352+0000","last_unstale":"2024-04-18T21:10:20.482015+0000","last_undegraded":"2024-04-18T21:10:20.482015+0000","last_fullsized":"2024-04-18T21:10:20.482015+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":23833,"num_write":418,"num_write_kb":59679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"71'403","reported_seq":956,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.490427+0000","last_change":"2024-04-18T21:10:20.490427+0000","last_active":"2024-04-18T21:10:20.490427+0000","last_peered":"2024-04-18T21:10:20.490427+0000","last_clean":"2024-04-18T21:10:20.490427+0000","last_became_active":"2024-04-18T21:10:20.487409+0000","last_became_peered":"2024-04-18T21:10:20.487409+0000","last_unstale":"2024-04-18T21:10:20.490427+0000","last_undegraded":"2024-04-18T21:10:20.490427+0000","last_fullsized":"2024-04-18T21:10:20.490427+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:22:40.301941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":7482,"num_write":371,"num_write_kb":25957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'406","reported_seq":606,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.548073+0000","last_change":"2024-04-18T21:10:10.547457+0000","last_active":"2024-04-18T21:10:20.548073+0000","last_peered":"2024-04-18T21:10:20.548073+0000","last_clean":"2024-04-18T21:10:20.548073+0000","last_became_active":"2024-04-18T21:10:10.542594+0000","last_became_peered":"2024-04-18T21:10:10.542594+0000","last_unstale":"2024-04-18T21:10:20.548073+0000","last_undegraded":"2024-04-18T21:10:20.548073+0000","last_fullsized":"2024-04-18T21:10:20.548073+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:51:58.437990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":27987,"num_write":365,"num_write_kb":38689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"71'470","reported_seq":1142,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.479779+0000","last_change":"2024-04-18T21:10:17.535574+0000","last_active":"2024-04-18T21:10:20.479779+0000","last_peered":"2024-04-18T21:10:20.479779+0000","last_clean":"2024-04-18T21:10:20.479779+0000","last_became_active":"2024-04-18T21:10:17.529957+0000","last_became_peered":"2024-04-18T21:10:17.529957+0000","last_unstale":"2024-04-18T21:10:20.479779+0000","last_undegraded":"2024-04-18T21:10:20.479779+0000","last_fullsized":"2024-04-18T21:10:20.479779+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:06:00.648089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":59273,"num_write":432,"num_write_kb":145930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'433","reported_seq":635,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483362+0000","last_change":"2024-04-18T21:05:05.638338+0000","last_active":"2024-04-18T21:10:20.483362+0000","last_peered":"2024-04-18T21:10:20.483362+0000","last_clean":"2024-04-18T21:10:20.483362+0000","last_became_active":"2024-04-18T21:05:05.637567+0000","last_became_peered":"2024-04-18T21:05:05.637567+0000","last_unstale":"2024-04-18T21:10:20.483362+0000","last_undegraded":"2024-04-18T21:10:20.483362+0000","last_fullsized":"2024-04-18T21:10:20.483362+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5514,"num_write":403,"num_write_kb":26329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"71'418","reported_seq":661,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482880+0000","last_change":"2024-04-18T21:05:05.643606+0000","last_active":"2024-04-18T21:10:20.482880+0000","last_peered":"2024-04-18T21:10:20.482880+0000","last_clean":"2024-04-18T21:10:20.482880+0000","last_became_active":"2024-04-18T21:05:05.642991+0000","last_became_peered":"2024-04-18T21:05:05.642991+0000","last_unstale":"2024-04-18T21:10:20.482880+0000","last_undegraded":"2024-04-18T21:10:20.482880+0000","last_fullsized":"2024-04-18T21:10:20.482880+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:39:01.841786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":29097,"num_write":386,"num_write_kb":88262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"71'479","reported_seq":722,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546721+0000","last_change":"2024-04-18T21:10:07.549995+0000","last_active":"2024-04-18T21:10:20.546721+0000","last_peered":"2024-04-18T21:10:20.546721+0000","last_clean":"2024-04-18T21:10:20.546721+0000","last_became_active":"2024-04-18T21:10:07.544314+0000","last_became_peered":"2024-04-18T21:10:07.544314+0000","last_unstale":"2024-04-18T21:10:20.546721+0000","last_undegraded":"2024-04-18T21:10:20.546721+0000","last_fullsized":"2024-04-18T21:10:20.546721+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:52:34.340348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":24204,"num_write":452,"num_write_kb":114184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"71'407","reported_seq":637,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.477533+0000","last_change":"2024-04-18T21:10:03.487961+0000","last_active":"2024-04-18T21:10:20.477533+0000","last_peered":"2024-04-18T21:10:20.477533+0000","last_clean":"2024-04-18T21:10:20.477533+0000","last_became_active":"2024-04-18T21:10:03.476552+0000","last_became_peered":"2024-04-18T21:10:03.476552+0000","last_unstale":"2024-04-18T21:10:20.477533+0000","last_undegraded":"2024-04-18T21:10:20.477533+0000","last_fullsized":"2024-04-18T21:10:20.477533+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:45:35.774025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":37766,"num_write":374,"num_write_kb":103984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'452","reported_seq":653,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546024+0000","last_change":"2024-04-18T21:10:18.547982+0000","last_active":"2024-04-18T21:10:20.546024+0000","last_peered":"2024-04-18T21:10:20.546024+0000","last_clean":"2024-04-18T21:10:20.546024+0000","last_became_active":"2024-04-18T21:10:18.542189+0000","last_became_peered":"2024-04-18T21:10:18.542189+0000","last_unstale":"2024-04-18T21:10:20.546024+0000","last_undegraded":"2024-04-18T21:10:20.546024+0000","last_fullsized":"2024-04-18T21:10:20.546024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:17:49.761650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27170,"num_write":421,"num_write_kb":39548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"71'427","reported_seq":634,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.548342+0000","last_change":"2024-04-18T21:10:03.544910+0000","last_active":"2024-04-18T21:10:20.548342+0000","last_peered":"2024-04-18T21:10:20.548342+0000","last_clean":"2024-04-18T21:10:20.548342+0000","last_became_active":"2024-04-18T21:10:03.539961+0000","last_became_peered":"2024-04-18T21:10:03.539961+0000","last_unstale":"2024-04-18T21:10:20.548342+0000","last_undegraded":"2024-04-18T21:10:20.548342+0000","last_fullsized":"2024-04-18T21:10:20.548342+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:06:34.839228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":11507,"num_write":407,"num_write_kb":50964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"71'471","reported_seq":697,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.479964+0000","last_change":"2024-04-18T21:05:05.649581+0000","last_active":"2024-04-18T21:10:20.479964+0000","last_peered":"2024-04-18T21:10:20.479964+0000","last_clean":"2024-04-18T21:10:20.479964+0000","last_became_active":"2024-04-18T21:05:05.648233+0000","last_became_peered":"2024-04-18T21:05:05.648233+0000","last_unstale":"2024-04-18T21:10:20.479964+0000","last_undegraded":"2024-04-18T21:10:20.479964+0000","last_fullsized":"2024-04-18T21:10:20.479964+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:12.832990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20857,"num_write":431,"num_write_kb":63677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'378","reported_seq":940,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.484277+0000","last_change":"2024-04-18T21:09:55.493655+0000","last_active":"2024-04-18T21:10:20.484277+0000","last_peered":"2024-04-18T21:10:20.484277+0000","last_clean":"2024-04-18T21:10:20.484277+0000","last_became_active":"2024-04-18T21:09:55.490958+0000","last_became_peered":"2024-04-18T21:09:55.490958+0000","last_unstale":"2024-04-18T21:10:20.484277+0000","last_undegraded":"2024-04-18T21:10:20.484277+0000","last_fullsized":"2024-04-18T21:10:20.484277+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:52:16.541697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12573,"num_write":347,"num_write_kb":34434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'410","reported_seq":639,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547904+0000","last_change":"2024-04-18T21:10:01.563947+0000","last_active":"2024-04-18T21:10:20.547904+0000","last_peered":"2024-04-18T21:10:20.547904+0000","last_clean":"2024-04-18T21:10:20.547904+0000","last_became_active":"2024-04-18T21:10:01.555367+0000","last_became_peered":"2024-04-18T21:10:01.555367+0000","last_unstale":"2024-04-18T21:10:20.547904+0000","last_undegraded":"2024-04-18T21:10:20.547904+0000","last_fullsized":"2024-04-18T21:10:20.547904+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:01:09.418419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":16926,"num_write":380,"num_write_kb":112804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"71'410","reported_seq":991,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.478607+0000","last_change":"2024-04-18T21:10:03.490605+0000","last_active":"2024-04-18T21:10:20.478607+0000","last_peered":"2024-04-18T21:10:20.478607+0000","last_clean":"2024-04-18T21:10:20.478607+0000","last_became_active":"2024-04-18T21:10:03.480985+0000","last_became_peered":"2024-04-18T21:10:03.480985+0000","last_unstale":"2024-04-18T21:10:20.478607+0000","last_undegraded":"2024-04-18T21:10:20.478607+0000","last_fullsized":"2024-04-18T21:10:20.478607+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:14:42.076110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":34811,"num_write":378,"num_write_kb":51242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'491","reported_seq":709,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546384+0000","last_change":"2024-04-18T21:10:08.546388+0000","last_active":"2024-04-18T21:10:20.546384+0000","last_peered":"2024-04-18T21:10:20.546384+0000","last_clean":"2024-04-18T21:10:20.546384+0000","last_became_active":"2024-04-18T21:10:08.540487+0000","last_became_peered":"2024-04-18T21:10:08.540487+0000","last_unstale":"2024-04-18T21:10:20.546384+0000","last_undegraded":"2024-04-18T21:10:20.546384+0000","last_fullsized":"2024-04-18T21:10:20.546384+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:15:51.120517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":26902,"num_write":456,"num_write_kb":124778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":209,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"71'467","reported_seq":1079,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.477750+0000","last_change":"2024-04-18T21:10:19.483012+0000","last_active":"2024-04-18T21:10:20.477750+0000","last_peered":"2024-04-18T21:10:20.477750+0000","last_clean":"2024-04-18T21:10:20.477750+0000","last_became_active":"2024-04-18T21:10:19.480002+0000","last_became_peered":"2024-04-18T21:10:19.480002+0000","last_unstale":"2024-04-18T21:10:20.477750+0000","last_undegraded":"2024-04-18T21:10:20.477750+0000","last_fullsized":"2024-04-18T21:10:20.477750+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:51:24.488873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":28114,"num_write":434,"num_write_kb":129325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'423","reported_seq":595,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482361+0000","last_change":"2024-04-18T21:10:01.499421+0000","last_active":"2024-04-18T21:10:20.482361+0000","last_peered":"2024-04-18T21:10:20.482361+0000","last_clean":"2024-04-18T21:10:20.482361+0000","last_became_active":"2024-04-18T21:10:01.487074+0000","last_became_peered":"2024-04-18T21:10:01.487074+0000","last_unstale":"2024-04-18T21:10:20.482361+0000","last_undegraded":"2024-04-18T21:10:20.482361+0000","last_fullsized":"2024-04-18T21:10:20.482361+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:05:34.827814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8244,"num_write":393,"num_write_kb":58692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"71'389","reported_seq":618,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547175+0000","last_change":"2024-04-18T21:09:58.542232+0000","last_active":"2024-04-18T21:10:20.547175+0000","last_peered":"2024-04-18T21:10:20.547175+0000","last_clean":"2024-04-18T21:10:20.547175+0000","last_became_active":"2024-04-18T21:09:58.537723+0000","last_became_peered":"2024-04-18T21:09:58.537723+0000","last_unstale":"2024-04-18T21:10:20.547175+0000","last_undegraded":"2024-04-18T21:10:20.547175+0000","last_fullsized":"2024-04-18T21:10:20.547175+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:26.786170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":24216,"num_write":349,"num_write_kb":43176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"70'425","reported_seq":621,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483524+0000","last_change":"2024-04-18T21:05:04.632748+0000","last_active":"2024-04-18T21:10:20.483524+0000","last_peered":"2024-04-18T21:10:20.483524+0000","last_clean":"2024-04-18T21:10:20.483524+0000","last_became_active":"2024-04-18T21:05:04.628407+0000","last_became_peered":"2024-04-18T21:05:04.628407+0000","last_unstale":"2024-04-18T21:10:20.483524+0000","last_undegraded":"2024-04-18T21:10:20.483524+0000","last_fullsized":"2024-04-18T21:10:20.483524+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:42:45.392908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":375,"num_write_kb":8348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"71'423","reported_seq":623,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547197+0000","last_change":"2024-04-18T21:10:14.556066+0000","last_active":"2024-04-18T21:10:20.547197+0000","last_peered":"2024-04-18T21:10:20.547197+0000","last_clean":"2024-04-18T21:10:20.547197+0000","last_became_active":"2024-04-18T21:10:14.551249+0000","last_became_peered":"2024-04-18T21:10:14.551249+0000","last_unstale":"2024-04-18T21:10:20.547197+0000","last_undegraded":"2024-04-18T21:10:20.547197+0000","last_fullsized":"2024-04-18T21:10:20.547197+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:06:06.045278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":20096,"num_write":381,"num_write_kb":76351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"70'56","reported_seq":264,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.478297+0000","last_change":"2024-04-18T21:10:00.500122+0000","last_active":"2024-04-18T21:10:20.478297+0000","last_peered":"2024-04-18T21:10:20.478297+0000","last_clean":"2024-04-18T21:10:20.478297+0000","last_became_active":"2024-04-18T21:10:00.489486+0000","last_became_peered":"2024-04-18T21:10:00.489486+0000","last_unstale":"2024-04-18T21:10:20.478297+0000","last_undegraded":"2024-04-18T21:10:20.478297+0000","last_fullsized":"2024-04-18T21:10:20.478297+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:58:08.269558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'442","reported_seq":1026,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.480431+0000","last_change":"2024-04-18T21:10:03.492109+0000","last_active":"2024-04-18T21:10:20.480431+0000","last_peered":"2024-04-18T21:10:20.480431+0000","last_clean":"2024-04-18T21:10:20.480431+0000","last_became_active":"2024-04-18T21:10:03.483050+0000","last_became_peered":"2024-04-18T21:10:03.483050+0000","last_unstale":"2024-04-18T21:10:20.480431+0000","last_undegraded":"2024-04-18T21:10:20.480431+0000","last_fullsized":"2024-04-18T21:10:20.480431+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:36:45.388623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13827,"num_write":415,"num_write_kb":79859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"70'62","reported_seq":80,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546613+0000","last_change":"2024-04-18T21:09:50.868159+0000","last_active":"2024-04-18T21:10:20.546613+0000","last_peered":"2024-04-18T21:10:20.546613+0000","last_clean":"2024-04-18T21:10:20.546613+0000","last_became_active":"2024-04-18T21:09:50.867096+0000","last_became_peered":"2024-04-18T21:09:50.867096+0000","last_unstale":"2024-04-18T21:10:20.546613+0000","last_undegraded":"2024-04-18T21:10:20.546613+0000","last_fullsized":"2024-04-18T21:10:20.546613+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:09:57.047205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"71'398","reported_seq":639,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.479991+0000","last_change":"2024-04-18T21:10:01.498728+0000","last_active":"2024-04-18T21:10:20.479991+0000","last_peered":"2024-04-18T21:10:20.479991+0000","last_clean":"2024-04-18T21:10:20.479991+0000","last_became_active":"2024-04-18T21:10:01.495349+0000","last_became_peered":"2024-04-18T21:10:01.495349+0000","last_unstale":"2024-04-18T21:10:20.479991+0000","last_undegraded":"2024-04-18T21:10:20.479991+0000","last_fullsized":"2024-04-18T21:10:20.479991+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:01:48.618551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":17616,"num_write":360,"num_write_kb":58871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"70'66","reported_seq":181,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482413+0000","last_change":"2024-04-18T21:10:00.496701+0000","last_active":"2024-04-18T21:10:20.482413+0000","last_peered":"2024-04-18T21:10:20.482413+0000","last_clean":"2024-04-18T21:10:20.482413+0000","last_became_active":"2024-04-18T21:10:00.495594+0000","last_became_peered":"2024-04-18T21:10:00.495594+0000","last_unstale":"2024-04-18T21:10:20.482413+0000","last_undegraded":"2024-04-18T21:10:20.482413+0000","last_fullsized":"2024-04-18T21:10:20.482413+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:11:32.991308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"70'135","reported_seq":68,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.484770+0000","last_change":"2024-04-18T21:10:00.493197+0000","last_active":"2024-04-18T21:10:20.484770+0000","last_peered":"2024-04-18T21:10:20.484770+0000","last_clean":"2024-04-18T21:10:20.484770+0000","last_became_active":"2024-04-18T21:10:00.491509+0000","last_became_peered":"2024-04-18T21:10:00.491509+0000","last_unstale":"2024-04-18T21:10:20.484770+0000","last_undegraded":"2024-04-18T21:10:20.484770+0000","last_fullsized":"2024-04-18T21:10:20.484770+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:57:29.595389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":7777508,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'410","reported_seq":610,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547176+0000","last_change":"2024-04-18T21:10:06.553806+0000","last_active":"2024-04-18T21:10:20.547176+0000","last_peered":"2024-04-18T21:10:20.547176+0000","last_clean":"2024-04-18T21:10:20.547176+0000","last_became_active":"2024-04-18T21:10:06.548034+0000","last_became_peered":"2024-04-18T21:10:06.548034+0000","last_unstale":"2024-04-18T21:10:20.547176+0000","last_undegraded":"2024-04-18T21:10:20.547176+0000","last_fullsized":"2024-04-18T21:10:20.547176+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:20:56.265941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17055,"num_write":375,"num_write_kb":63331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"70'240","reported_seq":363,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547788+0000","last_change":"2024-04-18T21:10:00.556212+0000","last_active":"2024-04-18T21:10:20.547788+0000","last_peered":"2024-04-18T21:10:20.547788+0000","last_clean":"2024-04-18T21:10:20.547788+0000","last_became_active":"2024-04-18T21:10:00.555486+0000","last_became_peered":"2024-04-18T21:10:00.555486+0000","last_unstale":"2024-04-18T21:10:20.547788+0000","last_undegraded":"2024-04-18T21:10:20.547788+0000","last_fullsized":"2024-04-18T21:10:20.547788+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:11.573984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":4191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"71'501","reported_seq":719,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.545865+0000","last_change":"2024-04-18T21:10:17.593530+0000","last_active":"2024-04-18T21:10:20.545865+0000","last_peered":"2024-04-18T21:10:20.545865+0000","last_clean":"2024-04-18T21:10:20.545865+0000","last_became_active":"2024-04-18T21:10:17.588391+0000","last_became_peered":"2024-04-18T21:10:17.588391+0000","last_unstale":"2024-04-18T21:10:20.545865+0000","last_undegraded":"2024-04-18T21:10:20.545865+0000","last_fullsized":"2024-04-18T21:10:20.545865+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:26.079610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":37662,"num_write":474,"num_write_kb":167663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"70'429","reported_seq":566,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.484708+0000","last_change":"2024-04-18T21:10:00.493325+0000","last_active":"2024-04-18T21:10:20.484708+0000","last_peered":"2024-04-18T21:10:20.484708+0000","last_clean":"2024-04-18T21:10:20.484708+0000","last_became_active":"2024-04-18T21:10:00.491525+0000","last_became_peered":"2024-04-18T21:10:00.491525+0000","last_unstale":"2024-04-18T21:10:20.484708+0000","last_undegraded":"2024-04-18T21:10:20.484708+0000","last_fullsized":"2024-04-18T21:10:20.484708+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:27:59.637974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":377,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388678,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'440","reported_seq":650,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483219+0000","last_change":"2024-04-18T21:10:01.497932+0000","last_active":"2024-04-18T21:10:20.483219+0000","last_peered":"2024-04-18T21:10:20.483219+0000","last_clean":"2024-04-18T21:10:20.483219+0000","last_became_active":"2024-04-18T21:10:01.486740+0000","last_became_peered":"2024-04-18T21:10:01.486740+0000","last_unstale":"2024-04-18T21:10:20.483219+0000","last_undegraded":"2024-04-18T21:10:20.483219+0000","last_fullsized":"2024-04-18T21:10:20.483219+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:34:43.515471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":42138,"num_write":408,"num_write_kb":96310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"70'59","reported_seq":255,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.484055+0000","last_change":"2024-04-18T21:05:04.625520+0000","last_active":"2024-04-18T21:10:20.484055+0000","last_peered":"2024-04-18T21:10:20.484055+0000","last_clean":"2024-04-18T21:10:20.484055+0000","last_became_active":"2024-04-18T21:05:04.624656+0000","last_became_peered":"2024-04-18T21:05:04.624656+0000","last_unstale":"2024-04-18T21:10:20.484055+0000","last_undegraded":"2024-04-18T21:10:20.484055+0000","last_fullsized":"2024-04-18T21:10:20.484055+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:56:05.795125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"71'461","reported_seq":676,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.478291+0000","last_change":"2024-04-18T21:05:05.649406+0000","last_active":"2024-04-18T21:10:20.478291+0000","last_peered":"2024-04-18T21:10:20.478291+0000","last_clean":"2024-04-18T21:10:20.478291+0000","last_became_active":"2024-04-18T21:05:05.648380+0000","last_became_peered":"2024-04-18T21:05:05.648380+0000","last_unstale":"2024-04-18T21:10:20.478291+0000","last_undegraded":"2024-04-18T21:10:20.478291+0000","last_fullsized":"2024-04-18T21:10:20.478291+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:29:43.724296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12852,"num_write":420,"num_write_kb":88506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"70'157","reported_seq":376,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.478945+0000","last_change":"2024-04-18T21:10:00.500141+0000","last_active":"2024-04-18T21:10:20.478945+0000","last_peered":"2024-04-18T21:10:20.478945+0000","last_clean":"2024-04-18T21:10:20.478945+0000","last_became_active":"2024-04-18T21:10:00.494630+0000","last_became_peered":"2024-04-18T21:10:00.494630+0000","last_unstale":"2024-04-18T21:10:20.478945+0000","last_undegraded":"2024-04-18T21:10:20.478945+0000","last_fullsized":"2024-04-18T21:10:20.478945+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:49:43.984354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":8250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'445","reported_seq":635,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483682+0000","last_change":"2024-04-18T21:10:01.500937+0000","last_active":"2024-04-18T21:10:20.483682+0000","last_peered":"2024-04-18T21:10:20.483682+0000","last_clean":"2024-04-18T21:10:20.483682+0000","last_became_active":"2024-04-18T21:10:01.490691+0000","last_became_peered":"2024-04-18T21:10:01.490691+0000","last_unstale":"2024-04-18T21:10:20.483682+0000","last_undegraded":"2024-04-18T21:10:20.483682+0000","last_fullsized":"2024-04-18T21:10:20.483682+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:59:48.489145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17488,"num_write":410,"num_write_kb":50845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"70'124","reported_seq":320,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483416+0000","last_change":"2024-04-18T21:05:04.634674+0000","last_active":"2024-04-18T21:10:20.483416+0000","last_peered":"2024-04-18T21:10:20.483416+0000","last_clean":"2024-04-18T21:10:20.483416+0000","last_became_active":"2024-04-18T21:05:04.632284+0000","last_became_peered":"2024-04-18T21:05:04.632284+0000","last_unstale":"2024-04-18T21:10:20.483416+0000","last_undegraded":"2024-04-18T21:10:20.483416+0000","last_fullsized":"2024-04-18T21:10:20.483416+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:09:18.466987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"71'400","reported_seq":942,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.484448+0000","last_change":"2024-04-18T21:10:14.495223+0000","last_active":"2024-04-18T21:10:20.484448+0000","last_peered":"2024-04-18T21:10:20.484448+0000","last_clean":"2024-04-18T21:10:20.484448+0000","last_became_active":"2024-04-18T21:10:14.492039+0000","last_became_peered":"2024-04-18T21:10:14.492039+0000","last_unstale":"2024-04-18T21:10:20.484448+0000","last_undegraded":"2024-04-18T21:10:20.484448+0000","last_fullsized":"2024-04-18T21:10:20.484448+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:58:35.802545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12586,"num_write":372,"num_write_kb":58856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":350,"num_bytes_recovered":576854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"70'53","reported_seq":82,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.545791+0000","last_change":"2024-04-18T21:10:00.550936+0000","last_active":"2024-04-18T21:10:20.545791+0000","last_peered":"2024-04-18T21:10:20.545791+0000","last_clean":"2024-04-18T21:10:20.545791+0000","last_became_active":"2024-04-18T21:10:00.549987+0000","last_became_peered":"2024-04-18T21:10:00.549987+0000","last_unstale":"2024-04-18T21:10:20.545791+0000","last_undegraded":"2024-04-18T21:10:20.545791+0000","last_fullsized":"2024-04-18T21:10:20.545791+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:53:36.771516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"71'364","reported_seq":943,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.484401+0000","last_change":"2024-04-18T21:09:58.478726+0000","last_active":"2024-04-18T21:10:20.484401+0000","last_peered":"2024-04-18T21:10:20.484401+0000","last_clean":"2024-04-18T21:10:20.484401+0000","last_became_active":"2024-04-18T21:09:58.473903+0000","last_became_peered":"2024-04-18T21:09:58.473903+0000","last_unstale":"2024-04-18T21:10:20.484401+0000","last_undegraded":"2024-04-18T21:10:20.484401+0000","last_fullsized":"2024-04-18T21:10:20.484401+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:24:40.377274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":37938,"num_write":336,"num_write_kb":42513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"70'460","reported_seq":573,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546197+0000","last_change":"2024-04-18T21:09:53.545846+0000","last_active":"2024-04-18T21:10:20.546197+0000","last_peered":"2024-04-18T21:10:20.546197+0000","last_clean":"2024-04-18T21:10:20.546197+0000","last_became_active":"2024-04-18T21:09:53.544355+0000","last_became_peered":"2024-04-18T21:09:53.544355+0000","last_unstale":"2024-04-18T21:10:20.546197+0000","last_undegraded":"2024-04-18T21:10:20.546197+0000","last_fullsized":"2024-04-18T21:10:20.546197+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:34:16.776752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":406,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"71'404","reported_seq":978,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.480186+0000","last_change":"2024-04-18T21:10:15.507332+0000","last_active":"2024-04-18T21:10:20.480186+0000","last_peered":"2024-04-18T21:10:20.480186+0000","last_clean":"2024-04-18T21:10:20.480186+0000","last_became_active":"2024-04-18T21:10:15.504379+0000","last_became_peered":"2024-04-18T21:10:15.504379+0000","last_unstale":"2024-04-18T21:10:20.480186+0000","last_undegraded":"2024-04-18T21:10:20.480186+0000","last_fullsized":"2024-04-18T21:10:20.480186+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:33:14.728553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":7075,"num_write":367,"num_write_kb":62738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":383,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482924+0000","last_change":"2024-04-18T21:10:00.497960+0000","last_active":"2024-04-18T21:10:20.482924+0000","last_peered":"2024-04-18T21:10:20.482924+0000","last_clean":"2024-04-18T21:10:20.482924+0000","last_became_active":"2024-04-18T21:10:00.496373+0000","last_became_peered":"2024-04-18T21:10:00.496373+0000","last_unstale":"2024-04-18T21:10:20.482924+0000","last_undegraded":"2024-04-18T21:10:20.482924+0000","last_fullsized":"2024-04-18T21:10:20.482924+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_clean_scrub_stamp":"2024-04-18T21:04:53.494814+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:56:52.975720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":159,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483821+0000","last_change":"2024-04-18T21:10:00.487584+0000","last_active":"2024-04-18T21:10:20.483821+0000","last_peered":"2024-04-18T21:10:20.483821+0000","last_clean":"2024-04-18T21:10:20.483821+0000","last_became_active":"2024-04-18T21:10:00.486722+0000","last_became_peered":"2024-04-18T21:10:00.486722+0000","last_unstale":"2024-04-18T21:10:20.483821+0000","last_undegraded":"2024-04-18T21:10:20.483821+0000","last_fullsized":"2024-04-18T21:10:20.483821+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:17:03.176148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"70'595","reported_seq":750,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.478616+0000","last_change":"2024-04-18T21:10:03.488427+0000","last_active":"2024-04-18T21:10:20.478616+0000","last_peered":"2024-04-18T21:10:20.478616+0000","last_clean":"2024-04-18T21:10:20.478616+0000","last_became_active":"2024-04-18T21:10:03.481344+0000","last_became_peered":"2024-04-18T21:10:03.481344+0000","last_unstale":"2024-04-18T21:10:20.478616+0000","last_undegraded":"2024-04-18T21:10:20.478616+0000","last_fullsized":"2024-04-18T21:10:20.478616+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:22:41.583248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":539,"num_write_kb":8449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4689862,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'443","reported_seq":1089,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.484583+0000","last_change":"2024-04-18T21:09:56.496310+0000","last_active":"2024-04-18T21:10:20.484583+0000","last_peered":"2024-04-18T21:10:20.484583+0000","last_clean":"2024-04-18T21:10:20.484583+0000","last_became_active":"2024-04-18T21:09:56.493327+0000","last_became_peered":"2024-04-18T21:09:56.493327+0000","last_unstale":"2024-04-18T21:10:20.484583+0000","last_undegraded":"2024-04-18T21:10:20.484583+0000","last_fullsized":"2024-04-18T21:10:20.484583+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:20:57.340997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":38975,"num_write":404,"num_write_kb":80038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":209,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482719+0000","last_change":"2024-04-18T21:09:50.817029+0000","last_active":"2024-04-18T21:10:20.482719+0000","last_peered":"2024-04-18T21:10:20.482719+0000","last_clean":"2024-04-18T21:10:20.482719+0000","last_became_active":"2024-04-18T21:09:50.816543+0000","last_became_peered":"2024-04-18T21:09:50.816543+0000","last_unstale":"2024-04-18T21:10:20.482719+0000","last_undegraded":"2024-04-18T21:10:20.482719+0000","last_fullsized":"2024-04-18T21:10:20.482719+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:47:33.047727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"70'129","reported_seq":312,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.478205+0000","last_change":"2024-04-18T21:10:03.489109+0000","last_active":"2024-04-18T21:10:20.478205+0000","last_peered":"2024-04-18T21:10:20.478205+0000","last_clean":"2024-04-18T21:10:20.478205+0000","last_became_active":"2024-04-18T21:10:03.486859+0000","last_became_peered":"2024-04-18T21:10:03.486859+0000","last_unstale":"2024-04-18T21:10:20.478205+0000","last_undegraded":"2024-04-18T21:10:20.478205+0000","last_fullsized":"2024-04-18T21:10:20.478205+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:52:04.172480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466419,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":55,"num_read_kb":1405,"num_write":58,"num_write_kb":1469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'457","reported_seq":680,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.548347+0000","last_change":"2024-04-18T21:10:09.543207+0000","last_active":"2024-04-18T21:10:20.548347+0000","last_peered":"2024-04-18T21:10:20.548347+0000","last_clean":"2024-04-18T21:10:20.548347+0000","last_became_active":"2024-04-18T21:10:09.537428+0000","last_became_peered":"2024-04-18T21:10:09.537428+0000","last_unstale":"2024-04-18T21:10:20.548347+0000","last_undegraded":"2024-04-18T21:10:20.548347+0000","last_fullsized":"2024-04-18T21:10:20.548347+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:21.987918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":27659,"num_write":426,"num_write_kb":80500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":208,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.478812+0000","last_change":"2024-04-18T21:09:50.832624+0000","last_active":"2024-04-18T21:10:20.478812+0000","last_peered":"2024-04-18T21:10:20.478812+0000","last_clean":"2024-04-18T21:10:20.478812+0000","last_became_active":"2024-04-18T21:09:50.831949+0000","last_became_peered":"2024-04-18T21:09:50.831949+0000","last_unstale":"2024-04-18T21:10:20.478812+0000","last_undegraded":"2024-04-18T21:10:20.478812+0000","last_fullsized":"2024-04-18T21:10:20.478812+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:35:45.986029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'170","reported_seq":368,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.545538+0000","last_change":"2024-04-18T21:09:53.538615+0000","last_active":"2024-04-18T21:10:20.545538+0000","last_peered":"2024-04-18T21:10:20.545538+0000","last_clean":"2024-04-18T21:10:20.545538+0000","last_became_active":"2024-04-18T21:09:53.537994+0000","last_became_peered":"2024-04-18T21:09:53.537994+0000","last_unstale":"2024-04-18T21:10:20.545538+0000","last_undegraded":"2024-04-18T21:10:20.545538+0000","last_fullsized":"2024-04-18T21:10:20.545538+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:02:34.372453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":8239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"71'346","reported_seq":910,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.480273+0000","last_change":"2024-04-18T21:10:11.487541+0000","last_active":"2024-04-18T21:10:20.480273+0000","last_peered":"2024-04-18T21:10:20.480273+0000","last_clean":"2024-04-18T21:10:20.480273+0000","last_became_active":"2024-04-18T21:10:11.484662+0000","last_became_peered":"2024-04-18T21:10:11.484662+0000","last_unstale":"2024-04-18T21:10:20.480273+0000","last_undegraded":"2024-04-18T21:10:20.480273+0000","last_fullsized":"2024-04-18T21:10:20.480273+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:50:21.491862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27042,"num_write":321,"num_write_kb":50693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":202,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483512+0000","last_change":"2024-04-18T21:05:00.576606+0000","last_active":"2024-04-18T21:10:20.483512+0000","last_peered":"2024-04-18T21:10:20.483512+0000","last_clean":"2024-04-18T21:10:20.483512+0000","last_became_active":"2024-04-18T21:05:00.575951+0000","last_became_peered":"2024-04-18T21:05:00.575951+0000","last_unstale":"2024-04-18T21:10:20.483512+0000","last_undegraded":"2024-04-18T21:10:20.483512+0000","last_fullsized":"2024-04-18T21:10:20.483512+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:32:17.612481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"70'63","reported_seq":259,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483817+0000","last_change":"2024-04-18T21:05:04.627296+0000","last_active":"2024-04-18T21:10:20.483817+0000","last_peered":"2024-04-18T21:10:20.483817+0000","last_clean":"2024-04-18T21:10:20.483817+0000","last_became_active":"2024-04-18T21:05:04.626801+0000","last_became_peered":"2024-04-18T21:05:04.626801+0000","last_unstale":"2024-04-18T21:10:20.483817+0000","last_undegraded":"2024-04-18T21:10:20.483817+0000","last_fullsized":"2024-04-18T21:10:20.483817+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:46:36.285416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"71'406","reported_seq":1041,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.479242+0000","last_change":"2024-04-18T21:09:59.495686+0000","last_active":"2024-04-18T21:10:20.479242+0000","last_peered":"2024-04-18T21:10:20.479242+0000","last_clean":"2024-04-18T21:10:20.479242+0000","last_became_active":"2024-04-18T21:09:59.493248+0000","last_became_peered":"2024-04-18T21:09:59.493248+0000","last_unstale":"2024-04-18T21:10:20.479242+0000","last_undegraded":"2024-04-18T21:10:20.479242+0000","last_fullsized":"2024-04-18T21:10:20.479242+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:11:23.853682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":35332,"num_write":370,"num_write_kb":71807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"70'284","reported_seq":315,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.484852+0000","last_change":"2024-04-18T21:10:00.504958+0000","last_active":"2024-04-18T21:10:20.484852+0000","last_peered":"2024-04-18T21:10:20.484852+0000","last_clean":"2024-04-18T21:10:20.484852+0000","last_became_active":"2024-04-18T21:10:00.503851+0000","last_became_peered":"2024-04-18T21:10:00.503851+0000","last_unstale":"2024-04-18T21:10:20.484852+0000","last_undegraded":"2024-04-18T21:10:20.484852+0000","last_fullsized":"2024-04-18T21:10:20.484852+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:10:27.397258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":218,"num_write_kb":4194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":135,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.479497+0000","last_change":"2024-04-18T21:10:03.484148+0000","last_active":"2024-04-18T21:10:20.479497+0000","last_peered":"2024-04-18T21:10:20.479497+0000","last_clean":"2024-04-18T21:10:20.479497+0000","last_became_active":"2024-04-18T21:10:03.480071+0000","last_became_peered":"2024-04-18T21:10:03.480071+0000","last_unstale":"2024-04-18T21:10:20.479497+0000","last_undegraded":"2024-04-18T21:10:20.479497+0000","last_fullsized":"2024-04-18T21:10:20.479497+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:50:30.257039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'386","reported_seq":577,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546997+0000","last_change":"2024-04-18T21:10:10.547885+0000","last_active":"2024-04-18T21:10:20.546997+0000","last_peered":"2024-04-18T21:10:20.546997+0000","last_clean":"2024-04-18T21:10:20.546997+0000","last_became_active":"2024-04-18T21:10:10.542515+0000","last_became_peered":"2024-04-18T21:10:10.542515+0000","last_unstale":"2024-04-18T21:10:20.546997+0000","last_undegraded":"2024-04-18T21:10:20.546997+0000","last_fullsized":"2024-04-18T21:10:20.546997+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:58:24.232536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14677,"num_write":355,"num_write_kb":51018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"70'55","reported_seq":257,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.479390+0000","last_change":"2024-04-18T21:09:50.833424+0000","last_active":"2024-04-18T21:10:20.479390+0000","last_peered":"2024-04-18T21:10:20.479390+0000","last_clean":"2024-04-18T21:10:20.479390+0000","last_became_active":"2024-04-18T21:09:50.832752+0000","last_became_peered":"2024-04-18T21:09:50.832752+0000","last_unstale":"2024-04-18T21:10:20.479390+0000","last_undegraded":"2024-04-18T21:10:20.479390+0000","last_fullsized":"2024-04-18T21:10:20.479390+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:34:48.945329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":165,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.548117+0000","last_change":"2024-04-18T21:09:50.900338+0000","last_active":"2024-04-18T21:10:20.548117+0000","last_peered":"2024-04-18T21:10:20.548117+0000","last_clean":"2024-04-18T21:10:20.548117+0000","last_became_active":"2024-04-18T21:09:50.896844+0000","last_became_peered":"2024-04-18T21:09:50.896844+0000","last_unstale":"2024-04-18T21:10:20.548117+0000","last_undegraded":"2024-04-18T21:10:20.548117+0000","last_fullsized":"2024-04-18T21:10:20.548117+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:11:35.543409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"71'402","reported_seq":591,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546209+0000","last_change":"2024-04-18T21:10:05.542484+0000","last_active":"2024-04-18T21:10:20.546209+0000","last_peered":"2024-04-18T21:10:20.546209+0000","last_clean":"2024-04-18T21:10:20.546209+0000","last_became_active":"2024-04-18T21:10:05.536763+0000","last_became_peered":"2024-04-18T21:10:05.536763+0000","last_unstale":"2024-04-18T21:10:20.546209+0000","last_undegraded":"2024-04-18T21:10:20.546209+0000","last_fullsized":"2024-04-18T21:10:20.546209+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:08:22.367267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12468,"num_write":369,"num_write_kb":67231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"70'60","reported_seq":263,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.480741+0000","last_change":"2024-04-18T21:09:50.832598+0000","last_active":"2024-04-18T21:10:20.480741+0000","last_peered":"2024-04-18T21:10:20.480741+0000","last_clean":"2024-04-18T21:10:20.480741+0000","last_became_active":"2024-04-18T21:09:50.832030+0000","last_became_peered":"2024-04-18T21:09:50.832030+0000","last_unstale":"2024-04-18T21:10:20.480741+0000","last_undegraded":"2024-04-18T21:10:20.480741+0000","last_fullsized":"2024-04-18T21:10:20.480741+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:10:27.397258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":135,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.480666+0000","last_change":"2024-04-18T21:10:03.492761+0000","last_active":"2024-04-18T21:10:20.480666+0000","last_peered":"2024-04-18T21:10:20.480666+0000","last_clean":"2024-04-18T21:10:20.480666+0000","last_became_active":"2024-04-18T21:10:03.492145+0000","last_became_peered":"2024-04-18T21:10:03.492145+0000","last_unstale":"2024-04-18T21:10:20.480666+0000","last_undegraded":"2024-04-18T21:10:20.480666+0000","last_fullsized":"2024-04-18T21:10:20.480666+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:20:00.853523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'421","reported_seq":628,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.477954+0000","last_change":"2024-04-18T21:10:03.488774+0000","last_active":"2024-04-18T21:10:20.477954+0000","last_peered":"2024-04-18T21:10:20.477954+0000","last_clean":"2024-04-18T21:10:20.477954+0000","last_became_active":"2024-04-18T21:10:03.479773+0000","last_became_peered":"2024-04-18T21:10:03.479773+0000","last_unstale":"2024-04-18T21:10:20.477954+0000","last_undegraded":"2024-04-18T21:10:20.477954+0000","last_fullsized":"2024-04-18T21:10:20.477954+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:15:12.326904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":16183,"num_write":377,"num_write_kb":50451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"71'110","reported_seq":325,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.480498+0000","last_change":"2024-04-18T21:10:00.497917+0000","last_active":"2024-04-18T21:10:20.480498+0000","last_peered":"2024-04-18T21:10:20.480498+0000","last_clean":"2024-04-18T21:10:20.480498+0000","last_became_active":"2024-04-18T21:10:00.494644+0000","last_became_peered":"2024-04-18T21:10:00.494644+0000","last_unstale":"2024-04-18T21:10:20.480498+0000","last_undegraded":"2024-04-18T21:10:20.480498+0000","last_fullsized":"2024-04-18T21:10:20.480498+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:40:57.347353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":1251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":160,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.484841+0000","last_change":"2024-04-18T21:10:00.493764+0000","last_active":"2024-04-18T21:10:20.484841+0000","last_peered":"2024-04-18T21:10:20.484841+0000","last_clean":"2024-04-18T21:10:20.484841+0000","last_became_active":"2024-04-18T21:10:00.492672+0000","last_became_peered":"2024-04-18T21:10:00.492672+0000","last_unstale":"2024-04-18T21:10:20.484841+0000","last_undegraded":"2024-04-18T21:10:20.484841+0000","last_fullsized":"2024-04-18T21:10:20.484841+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:48:46.709401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'384","reported_seq":597,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546833+0000","last_change":"2024-04-18T21:09:57.572865+0000","last_active":"2024-04-18T21:10:20.546833+0000","last_peered":"2024-04-18T21:10:20.546833+0000","last_clean":"2024-04-18T21:10:20.546833+0000","last_became_active":"2024-04-18T21:09:57.567962+0000","last_became_peered":"2024-04-18T21:09:57.567962+0000","last_unstale":"2024-04-18T21:10:20.546833+0000","last_undegraded":"2024-04-18T21:10:20.546833+0000","last_fullsized":"2024-04-18T21:10:20.546833+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:51:24.627186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":15567,"num_write":351,"num_write_kb":42959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"71'396","reported_seq":924,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483421+0000","last_change":"2024-04-18T21:10:13.482151+0000","last_active":"2024-04-18T21:10:20.483421+0000","last_peered":"2024-04-18T21:10:20.483421+0000","last_clean":"2024-04-18T21:10:20.483421+0000","last_became_active":"2024-04-18T21:10:13.479320+0000","last_became_peered":"2024-04-18T21:10:13.479320+0000","last_unstale":"2024-04-18T21:10:20.483421+0000","last_undegraded":"2024-04-18T21:10:20.483421+0000","last_fullsized":"2024-04-18T21:10:20.483421+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:33:52.248167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12943,"num_write":353,"num_write_kb":35357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":342,"num_bytes_recovered":3500882,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"71'277","reported_seq":318,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483992+0000","last_change":"2024-04-18T21:10:00.495047+0000","last_active":"2024-04-18T21:10:20.483992+0000","last_peered":"2024-04-18T21:10:20.483992+0000","last_clean":"2024-04-18T21:10:20.483992+0000","last_became_active":"2024-04-18T21:10:00.493088+0000","last_became_peered":"2024-04-18T21:10:00.493088+0000","last_unstale":"2024-04-18T21:10:20.483992+0000","last_undegraded":"2024-04-18T21:10:20.483992+0000","last_fullsized":"2024-04-18T21:10:20.483992+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:39:08.263781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":221,"num_write_kb":8303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":8389370,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'411","reported_seq":1007,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.477964+0000","last_change":"2024-04-18T21:10:04.485332+0000","last_active":"2024-04-18T21:10:20.477964+0000","last_peered":"2024-04-18T21:10:20.477964+0000","last_clean":"2024-04-18T21:10:20.477964+0000","last_became_active":"2024-04-18T21:10:04.482320+0000","last_became_peered":"2024-04-18T21:10:04.482320+0000","last_unstale":"2024-04-18T21:10:20.477964+0000","last_undegraded":"2024-04-18T21:10:20.477964+0000","last_fullsized":"2024-04-18T21:10:20.477964+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:35:57.043682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":17179,"num_write":375,"num_write_kb":38991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"70'85","reported_seq":168,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547812+0000","last_change":"2024-04-18T21:09:50.890616+0000","last_active":"2024-04-18T21:10:20.547812+0000","last_peered":"2024-04-18T21:10:20.547812+0000","last_clean":"2024-04-18T21:10:20.547812+0000","last_became_active":"2024-04-18T21:09:50.874855+0000","last_became_peered":"2024-04-18T21:09:50.874855+0000","last_unstale":"2024-04-18T21:10:20.547812+0000","last_undegraded":"2024-04-18T21:10:20.547812+0000","last_fullsized":"2024-04-18T21:10:20.547812+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:03:54.726282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"70'230","reported_seq":259,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.484617+0000","last_change":"2024-04-18T21:10:00.499373+0000","last_active":"2024-04-18T21:10:20.484617+0000","last_peered":"2024-04-18T21:10:20.484617+0000","last_clean":"2024-04-18T21:10:20.484617+0000","last_became_active":"2024-04-18T21:10:00.498141+0000","last_became_peered":"2024-04-18T21:10:00.498141+0000","last_unstale":"2024-04-18T21:10:20.484617+0000","last_undegraded":"2024-04-18T21:10:20.484617+0000","last_fullsized":"2024-04-18T21:10:20.484617+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:55:01.865593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":4178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"71'493","reported_seq":732,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.477822+0000","last_change":"2024-04-18T21:05:05.642793+0000","last_active":"2024-04-18T21:10:20.477822+0000","last_peered":"2024-04-18T21:10:20.477822+0000","last_clean":"2024-04-18T21:10:20.477822+0000","last_became_active":"2024-04-18T21:05:05.641983+0000","last_became_peered":"2024-04-18T21:05:05.641983+0000","last_unstale":"2024-04-18T21:10:20.477822+0000","last_undegraded":"2024-04-18T21:10:20.477822+0000","last_fullsized":"2024-04-18T21:10:20.477822+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:46:36.339289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23833,"num_write":461,"num_write_kb":76873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"70'62","reported_seq":257,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.480547+0000","last_change":"2024-04-18T21:05:04.641445+0000","last_active":"2024-04-18T21:10:20.480547+0000","last_peered":"2024-04-18T21:10:20.480547+0000","last_clean":"2024-04-18T21:10:20.480547+0000","last_became_active":"2024-04-18T21:05:04.640682+0000","last_became_peered":"2024-04-18T21:05:04.640682+0000","last_unstale":"2024-04-18T21:10:20.480547+0000","last_undegraded":"2024-04-18T21:10:20.480547+0000","last_fullsized":"2024-04-18T21:10:20.480547+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:46:36.285416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'436","reported_seq":1063,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.477947+0000","last_change":"2024-04-18T21:10:18.490900+0000","last_active":"2024-04-18T21:10:20.477947+0000","last_peered":"2024-04-18T21:10:20.477947+0000","last_clean":"2024-04-18T21:10:20.477947+0000","last_became_active":"2024-04-18T21:10:18.487788+0000","last_became_peered":"2024-04-18T21:10:18.487788+0000","last_unstale":"2024-04-18T21:10:20.477947+0000","last_undegraded":"2024-04-18T21:10:20.477947+0000","last_fullsized":"2024-04-18T21:10:20.477947+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:57:00.495580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14561,"num_write":408,"num_write_kb":47462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'369","reported_seq":571,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.548399+0000","last_change":"2024-04-18T21:10:02.553999+0000","last_active":"2024-04-18T21:10:20.548399+0000","last_peered":"2024-04-18T21:10:20.548399+0000","last_clean":"2024-04-18T21:10:20.548399+0000","last_became_active":"2024-04-18T21:10:02.549471+0000","last_became_peered":"2024-04-18T21:10:02.549471+0000","last_unstale":"2024-04-18T21:10:20.548399+0000","last_undegraded":"2024-04-18T21:10:20.548399+0000","last_fullsized":"2024-04-18T21:10:20.548399+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:52:14.371235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13619,"num_write":339,"num_write_kb":63086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"70'888","reported_seq":1030,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.478410+0000","last_change":"2024-04-18T21:10:03.486911+0000","last_active":"2024-04-18T21:10:20.478410+0000","last_peered":"2024-04-18T21:10:20.478410+0000","last_clean":"2024-04-18T21:10:20.478410+0000","last_became_active":"2024-04-18T21:10:03.480576+0000","last_became_peered":"2024-04-18T21:10:03.480576+0000","last_unstale":"2024-04-18T21:10:20.478410+0000","last_undegraded":"2024-04-18T21:10:20.478410+0000","last_fullsized":"2024-04-18T21:10:20.478410+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:41:06.632064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":823,"num_write_kb":8582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'398","reported_seq":562,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.479937+0000","last_change":"2024-04-18T21:10:03.491426+0000","last_active":"2024-04-18T21:10:20.479937+0000","last_peered":"2024-04-18T21:10:20.479937+0000","last_clean":"2024-04-18T21:10:20.479937+0000","last_became_active":"2024-04-18T21:10:03.483190+0000","last_became_peered":"2024-04-18T21:10:03.483190+0000","last_unstale":"2024-04-18T21:10:20.479937+0000","last_undegraded":"2024-04-18T21:10:20.479937+0000","last_fullsized":"2024-04-18T21:10:20.479937+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:05:10.611580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14684,"num_write":380,"num_write_kb":88822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"70'169","reported_seq":384,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.478144+0000","last_change":"2024-04-18T21:10:00.494974+0000","last_active":"2024-04-18T21:10:20.478144+0000","last_peered":"2024-04-18T21:10:20.478144+0000","last_clean":"2024-04-18T21:10:20.478144+0000","last_became_active":"2024-04-18T21:10:00.492196+0000","last_became_peered":"2024-04-18T21:10:00.492196+0000","last_unstale":"2024-04-18T21:10:20.478144+0000","last_undegraded":"2024-04-18T21:10:20.478144+0000","last_fullsized":"2024-04-18T21:10:20.478144+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:33:51.236211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":4162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'406","reported_seq":630,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546278+0000","last_change":"2024-04-18T21:10:12.553754+0000","last_active":"2024-04-18T21:10:20.546278+0000","last_peered":"2024-04-18T21:10:20.546278+0000","last_clean":"2024-04-18T21:10:20.546278+0000","last_became_active":"2024-04-18T21:10:12.546148+0000","last_became_peered":"2024-04-18T21:10:12.546148+0000","last_unstale":"2024-04-18T21:10:20.546278+0000","last_undegraded":"2024-04-18T21:10:20.546278+0000","last_fullsized":"2024-04-18T21:10:20.546278+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:12:37.876185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27495,"num_write":363,"num_write_kb":89134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"72'192","reported_seq":385,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546350+0000","last_change":"2024-04-18T21:09:53.541766+0000","last_active":"2024-04-18T21:10:20.546350+0000","last_peered":"2024-04-18T21:10:20.546350+0000","last_clean":"2024-04-18T21:10:20.546350+0000","last_became_active":"2024-04-18T21:09:53.541300+0000","last_became_peered":"2024-04-18T21:09:53.541300+0000","last_unstale":"2024-04-18T21:10:20.546350+0000","last_undegraded":"2024-04-18T21:10:20.546350+0000","last_fullsized":"2024-04-18T21:10:20.546350+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:26:14.718922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12425030,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":12201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8230726,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"71'383","reported_seq":617,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547547+0000","last_change":"2024-04-18T21:09:55.555798+0000","last_active":"2024-04-18T21:10:20.547547+0000","last_peered":"2024-04-18T21:10:20.547547+0000","last_clean":"2024-04-18T21:10:20.547547+0000","last_became_active":"2024-04-18T21:09:55.551135+0000","last_became_peered":"2024-04-18T21:09:55.551135+0000","last_unstale":"2024-04-18T21:10:20.547547+0000","last_undegraded":"2024-04-18T21:10:20.547547+0000","last_fullsized":"2024-04-18T21:10:20.547547+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:00:01.739082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21614,"num_write":351,"num_write_kb":79501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"70'66","reported_seq":159,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546526+0000","last_change":"2024-04-18T21:10:00.553114+0000","last_active":"2024-04-18T21:10:20.546526+0000","last_peered":"2024-04-18T21:10:20.546526+0000","last_clean":"2024-04-18T21:10:20.546526+0000","last_became_active":"2024-04-18T21:10:00.552067+0000","last_became_peered":"2024-04-18T21:10:00.552067+0000","last_unstale":"2024-04-18T21:10:20.546526+0000","last_undegraded":"2024-04-18T21:10:20.546526+0000","last_fullsized":"2024-04-18T21:10:20.546526+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:51:32.567297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"71'345","reported_seq":546,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483218+0000","last_change":"2024-04-18T21:05:05.624840+0000","last_active":"2024-04-18T21:10:20.483218+0000","last_peered":"2024-04-18T21:10:20.483218+0000","last_clean":"2024-04-18T21:10:20.483218+0000","last_became_active":"2024-04-18T21:05:05.622950+0000","last_became_peered":"2024-04-18T21:05:05.622950+0000","last_unstale":"2024-04-18T21:10:20.483218+0000","last_undegraded":"2024-04-18T21:10:20.483218+0000","last_fullsized":"2024-04-18T21:10:20.483218+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:27:17.530889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":317,"num_write_kb":29335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"70'171","reported_seq":286,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483766+0000","last_change":"2024-04-18T21:10:00.507624+0000","last_active":"2024-04-18T21:10:20.483766+0000","last_peered":"2024-04-18T21:10:20.483766+0000","last_clean":"2024-04-18T21:10:20.483766+0000","last_became_active":"2024-04-18T21:10:00.507132+0000","last_became_peered":"2024-04-18T21:10:00.507132+0000","last_unstale":"2024-04-18T21:10:20.483766+0000","last_undegraded":"2024-04-18T21:10:20.483766+0000","last_fullsized":"2024-04-18T21:10:20.483766+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:35:50.013019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":4154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"71'417","reported_seq":643,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483150+0000","last_change":"2024-04-18T21:05:05.627962+0000","last_active":"2024-04-18T21:10:20.483150+0000","last_peered":"2024-04-18T21:10:20.483150+0000","last_clean":"2024-04-18T21:10:20.483150+0000","last_became_active":"2024-04-18T21:05:05.626698+0000","last_became_peered":"2024-04-18T21:05:05.626698+0000","last_unstale":"2024-04-18T21:10:20.483150+0000","last_undegraded":"2024-04-18T21:10:20.483150+0000","last_fullsized":"2024-04-18T21:10:20.483150+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:48:48.973087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":17040,"num_write":384,"num_write_kb":83740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"70'276","reported_seq":471,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547237+0000","last_change":"2024-04-18T21:09:53.543611+0000","last_active":"2024-04-18T21:10:20.547237+0000","last_peered":"2024-04-18T21:10:20.547237+0000","last_clean":"2024-04-18T21:10:20.547237+0000","last_became_active":"2024-04-18T21:09:53.542863+0000","last_became_peered":"2024-04-18T21:09:53.542863+0000","last_unstale":"2024-04-18T21:10:20.547237+0000","last_undegraded":"2024-04-18T21:10:20.547237+0000","last_fullsized":"2024-04-18T21:10:20.547237+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:22.582074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":12399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"71'428","reported_seq":637,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546271+0000","last_change":"2024-04-18T21:10:08.541152+0000","last_active":"2024-04-18T21:10:20.546271+0000","last_peered":"2024-04-18T21:10:20.546271+0000","last_clean":"2024-04-18T21:10:20.546271+0000","last_became_active":"2024-04-18T21:10:08.536423+0000","last_became_peered":"2024-04-18T21:10:08.536423+0000","last_unstale":"2024-04-18T21:10:20.546271+0000","last_undegraded":"2024-04-18T21:10:20.546271+0000","last_fullsized":"2024-04-18T21:10:20.546271+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:26.666677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22548,"num_write":398,"num_write_kb":75972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"70'70","reported_seq":273,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.480343+0000","last_change":"2024-04-18T21:09:50.833350+0000","last_active":"2024-04-18T21:10:20.480343+0000","last_peered":"2024-04-18T21:10:20.480343+0000","last_clean":"2024-04-18T21:10:20.480343+0000","last_became_active":"2024-04-18T21:09:50.832355+0000","last_became_peered":"2024-04-18T21:09:50.832355+0000","last_unstale":"2024-04-18T21:10:20.480343+0000","last_undegraded":"2024-04-18T21:10:20.480343+0000","last_fullsized":"2024-04-18T21:10:20.480343+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:39:09.627425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'459","reported_seq":642,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482639+0000","last_change":"2024-04-18T21:10:01.503378+0000","last_active":"2024-04-18T21:10:20.482639+0000","last_peered":"2024-04-18T21:10:20.482639+0000","last_clean":"2024-04-18T21:10:20.482639+0000","last_became_active":"2024-04-18T21:10:01.497275+0000","last_became_peered":"2024-04-18T21:10:01.497275+0000","last_unstale":"2024-04-18T21:10:20.482639+0000","last_undegraded":"2024-04-18T21:10:20.482639+0000","last_fullsized":"2024-04-18T21:10:20.482639+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:40:35.832428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13353,"num_write":429,"num_write_kb":88123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"70'113","reported_seq":332,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.480338+0000","last_change":"2024-04-18T21:10:00.499468+0000","last_active":"2024-04-18T21:10:20.480338+0000","last_peered":"2024-04-18T21:10:20.480338+0000","last_clean":"2024-04-18T21:10:20.480338+0000","last_became_active":"2024-04-18T21:10:00.494734+0000","last_became_peered":"2024-04-18T21:10:00.494734+0000","last_unstale":"2024-04-18T21:10:20.480338+0000","last_undegraded":"2024-04-18T21:10:20.480338+0000","last_fullsized":"2024-04-18T21:10:20.480338+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:58:34.790588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194886,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2531,"num_read_kb":1304649,"num_write":24542,"num_write_kb":4299443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8145,"num_bytes_recovered":4488063,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26603,"ondisk_log_size":26603,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127139127,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":55,"num_read_kb":1405,"num_write":4542,"num_write_kb":127514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":92002768,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254345216,"data_stored":254278254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4409,"internal_metadata":0},"log_size":6331,"ondisk_log_size":6331,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738440,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":187628,"kb_used_data":80152,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94184212,"statfs":{"total":96636764160,"available":96444633088,"internally_reserved":0,"allocated":82075648,"data_stored":81480582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110033349},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":77,"seq":330712481801,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":147296,"kb_used_data":83404,"kb_used_omap":5,"kb_used_meta":63866,"kb_avail":94224544,"statfs":{"total":96636764160,"available":96485933056,"internally_reserved":0,"allocated":85405696,"data_stored":84799073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6004,"internal_metadata":65398924},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738438,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":160468,"kb_used_data":89096,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94211372,"statfs":{"total":96636764160,"available":96472444928,"internally_reserved":0,"allocated":91234304,"data_stored":90618294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":89579520,"data_stored":89548273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":83750912,"data_stored":83729052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4409,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81014784,"data_stored":81000929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:10:29.698 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.699 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.699 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.699 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.699 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.699 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.699 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.699 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.699 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.700 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.700 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.700 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.700 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.700 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.700 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.700 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.700 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.701 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.701 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.701 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.701 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.701 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.701 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.701 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.701 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.701 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.702 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.702 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.702 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.702 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.702 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.702 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.702 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.702 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-18T21:05:03.580897+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=3, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.703 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.703 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-18T21:05:03.580897+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=3, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.703 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.703 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-18T21:05:03.580897+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=3, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.703 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.703 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-18T21:05:03.580897+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=3, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.703 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-18T21:05:03.580897+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=3, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.703 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.704 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-18T21:05:03.580897+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=3, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.704 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.704 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-18T21:05:03.580897+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=3, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.704 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.704 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-18T21:05:03.580897+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=3, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.704 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.704 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-18T21:05:03.580897+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=3, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.704 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.704 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-18T21:05:03.580897+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=3, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.705 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.705 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-18T21:05:03.580897+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=3, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.705 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.705 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-18T21:05:03.580897+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=3, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.705 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.705 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-18T21:04:53.494814+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=4, tm_sec=53, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.705 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-18T21:04:59.553907+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=4, tm_sec=59, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.705 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-18T21:05:03.580897+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=3, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.705 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.705 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-18T21:04:59.553907+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=4, tm_sec=59, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.706 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-18T21:05:03.580897+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=3, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.706 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.706 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-18T21:04:59.553907+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=4, tm_sec=59, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.706 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-18T21:05:03.580897+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=3, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.706 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.706 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-18T21:04:59.553907+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=4, tm_sec=59, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.706 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-18T21:05:03.580897+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=3, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.706 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.706 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-18T21:05:03.580897+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=3, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.707 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-18T21:04:59.553907+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=4, tm_sec=59, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.707 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.707 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-18T21:05:03.580897+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=3, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.707 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-18T21:04:59.553907+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=4, tm_sec=59, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.707 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.707 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-18T21:05:03.580897+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=3, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.707 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-18T21:04:59.553907+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=4, tm_sec=59, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.707 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.707 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-18T21:05:03.580897+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=3, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.708 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-18T21:04:59.553907+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=4, tm_sec=59, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.708 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.708 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.708 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-18T21:05:03.580897+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=3, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.708 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.708 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-18T21:05:03.580897+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=3, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.708 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-18T21:05:03.580897+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=3, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.708 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.709 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-18T21:05:03.580897+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=3, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.709 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.709 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.709 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-18T21:05:03.580897+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=3, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.709 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.709 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-18T21:05:03.580897+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=3, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.709 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.709 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-18T21:05:03.580897+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=3, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.710 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.710 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-18T21:05:03.580897+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=3, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.710 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.710 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-18T21:05:03.580897+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=3, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.710 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.710 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-18T21:05:03.580897+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=3, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.710 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.710 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-18T21:05:03.580897+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=3, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.710 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.711 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-18T21:05:03.580897+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=3, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:29.711 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-18T21:10:49.711 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:10:50.028 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:10:50.030 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-04-18T21:10:50.045 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":284,"stamp":"2024-04-18T21:10:48.652417+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127729495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2722,"num_read_kb":1306172,"num_write":29287,"num_write_kb":4430417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8182,"num_bytes_recovered":97081199,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33120,"ondisk_log_size":33120,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":495364,"kb_used_data":252652,"kb_used_omap":8,"kb_used_meta":242679,"kb_avail":282620156,"statfs":{"total":289910292480,"available":289403039744,"internally_reserved":0,"allocated":258715648,"data_stored":256897949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9194,"internal_metadata":248503318},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004126"},"pg_stats":[{"pgid":"4.3f","version":"71'418","reported_seq":615,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.548882+0000","last_change":"2024-04-18T21:10:16.576720+0000","last_active":"2024-04-18T21:10:20.548882+0000","last_peered":"2024-04-18T21:10:20.548882+0000","last_clean":"2024-04-18T21:10:20.548882+0000","last_became_active":"2024-04-18T21:10:16.571985+0000","last_became_peered":"2024-04-18T21:10:16.571985+0000","last_unstale":"2024-04-18T21:10:20.548882+0000","last_undegraded":"2024-04-18T21:10:20.548882+0000","last_fullsized":"2024-04-18T21:10:20.548882+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":19677,"num_write":386,"num_write_kb":87615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"71'417","reported_seq":640,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:39.579914+0000","last_change":"2024-04-18T21:10:39.579977+0000","last_active":"2024-04-18T21:10:39.579914+0000","last_peered":"2024-04-18T21:10:39.579914+0000","last_clean":"2024-04-18T21:10:39.579914+0000","last_became_active":"2024-04-18T21:10:05.541170+0000","last_became_peered":"2024-04-18T21:10:05.541170+0000","last_unstale":"2024-04-18T21:10:39.579914+0000","last_undegraded":"2024-04-18T21:10:39.579914+0000","last_fullsized":"2024-04-18T21:10:39.579914+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'417","last_scrub_stamp":"2024-04-18T21:10:39.579723+0000","last_deep_scrub":"71'417","last_deep_scrub_stamp":"2024-04-18T21:10:39.579723+0000","last_clean_scrub_stamp":"2024-04-18T21:10:39.579723+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:18:49.950190+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":12123,"num_write":387,"num_write_kb":47157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"71'379","reported_seq":949,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:39.471567+0000","last_change":"2024-04-18T21:10:39.471632+0000","last_active":"2024-04-18T21:10:39.471567+0000","last_peered":"2024-04-18T21:10:39.471567+0000","last_clean":"2024-04-18T21:10:39.471567+0000","last_became_active":"2024-04-18T21:09:54.478020+0000","last_became_peered":"2024-04-18T21:09:54.478020+0000","last_unstale":"2024-04-18T21:10:39.471567+0000","last_undegraded":"2024-04-18T21:10:39.471567+0000","last_fullsized":"2024-04-18T21:10:39.471567+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'379","last_scrub_stamp":"2024-04-18T21:10:39.471370+0000","last_deep_scrub":"71'379","last_deep_scrub_stamp":"2024-04-18T21:10:39.471370+0000","last_clean_scrub_stamp":"2024-04-18T21:10:39.471370+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:02:25.844614+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":10040,"num_write":353,"num_write_kb":63202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'372","reported_seq":575,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483206+0000","last_change":"2024-04-18T21:05:05.629321+0000","last_active":"2024-04-18T21:10:20.483206+0000","last_peered":"2024-04-18T21:10:20.483206+0000","last_clean":"2024-04-18T21:10:20.483206+0000","last_became_active":"2024-04-18T21:05:05.627956+0000","last_became_peered":"2024-04-18T21:05:05.627956+0000","last_unstale":"2024-04-18T21:10:20.483206+0000","last_undegraded":"2024-04-18T21:10:20.483206+0000","last_fullsized":"2024-04-18T21:10:20.483206+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2735,"num_write":328,"num_write_kb":22107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"71'416","reported_seq":625,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:34.578130+0000","last_change":"2024-04-18T21:10:34.578187+0000","last_active":"2024-04-18T21:10:34.578130+0000","last_peered":"2024-04-18T21:10:34.578130+0000","last_clean":"2024-04-18T21:10:34.578130+0000","last_became_active":"2024-04-18T21:10:00.553862+0000","last_became_peered":"2024-04-18T21:10:00.553862+0000","last_unstale":"2024-04-18T21:10:34.578130+0000","last_undegraded":"2024-04-18T21:10:34.578130+0000","last_fullsized":"2024-04-18T21:10:34.578130+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'416","last_scrub_stamp":"2024-04-18T21:10:34.577938+0000","last_deep_scrub":"71'416","last_deep_scrub_stamp":"2024-04-18T21:10:34.577938+0000","last_clean_scrub_stamp":"2024-04-18T21:10:34.577938+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:43:54.240250+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6533,"num_write":389,"num_write_kb":43666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"71'374","reported_seq":583,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:29.492761+0000","last_change":"2024-04-18T21:10:29.492876+0000","last_active":"2024-04-18T21:10:29.492761+0000","last_peered":"2024-04-18T21:10:29.492761+0000","last_clean":"2024-04-18T21:10:29.492761+0000","last_became_active":"2024-04-18T21:10:01.486640+0000","last_became_peered":"2024-04-18T21:10:01.486640+0000","last_unstale":"2024-04-18T21:10:29.492761+0000","last_undegraded":"2024-04-18T21:10:29.492761+0000","last_fullsized":"2024-04-18T21:10:29.492761+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'374","last_scrub_stamp":"2024-04-18T21:10:29.492531+0000","last_deep_scrub":"71'374","last_deep_scrub_stamp":"2024-04-18T21:10:29.492531+0000","last_clean_scrub_stamp":"2024-04-18T21:10:29.492531+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:28:07.494881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20415,"num_write":354,"num_write_kb":34462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'418","reported_seq":653,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483138+0000","last_change":"2024-04-18T21:05:05.625047+0000","last_active":"2024-04-18T21:10:20.483138+0000","last_peered":"2024-04-18T21:10:20.483138+0000","last_clean":"2024-04-18T21:10:20.483138+0000","last_became_active":"2024-04-18T21:05:05.622781+0000","last_became_peered":"2024-04-18T21:05:05.622781+0000","last_unstale":"2024-04-18T21:10:20.483138+0000","last_undegraded":"2024-04-18T21:10:20.483138+0000","last_fullsized":"2024-04-18T21:10:20.483138+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21103,"num_write":385,"num_write_kb":50678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"71'399","reported_seq":647,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:44.421079+0000","last_change":"2024-04-18T21:10:44.421141+0000","last_active":"2024-04-18T21:10:44.421079+0000","last_peered":"2024-04-18T21:10:44.421079+0000","last_clean":"2024-04-18T21:10:44.421079+0000","last_became_active":"2024-04-18T21:10:00.488705+0000","last_became_peered":"2024-04-18T21:10:00.488705+0000","last_unstale":"2024-04-18T21:10:44.421079+0000","last_undegraded":"2024-04-18T21:10:44.421079+0000","last_fullsized":"2024-04-18T21:10:44.421079+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'399","last_scrub_stamp":"2024-04-18T21:10:44.420891+0000","last_deep_scrub":"71'399","last_deep_scrub_stamp":"2024-04-18T21:10:44.420891+0000","last_clean_scrub_stamp":"2024-04-18T21:10:44.420891+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:01:54.592149+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":44692,"num_write":361,"num_write_kb":105170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"71'385","reported_seq":951,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.480053+0000","last_change":"2024-04-18T21:10:06.487113+0000","last_active":"2024-04-18T21:10:20.480053+0000","last_peered":"2024-04-18T21:10:20.480053+0000","last_clean":"2024-04-18T21:10:20.480053+0000","last_became_active":"2024-04-18T21:10:06.482087+0000","last_became_peered":"2024-04-18T21:10:06.482087+0000","last_unstale":"2024-04-18T21:10:20.480053+0000","last_undegraded":"2024-04-18T21:10:20.480053+0000","last_fullsized":"2024-04-18T21:10:20.480053+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":994,"num_write":358,"num_write_kb":25964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'409","reported_seq":645,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546924+0000","last_change":"2024-04-18T21:10:12.550697+0000","last_active":"2024-04-18T21:10:20.546924+0000","last_peered":"2024-04-18T21:10:20.546924+0000","last_clean":"2024-04-18T21:10:20.546924+0000","last_became_active":"2024-04-18T21:10:12.546621+0000","last_became_peered":"2024-04-18T21:10:12.546621+0000","last_unstale":"2024-04-18T21:10:20.546924+0000","last_undegraded":"2024-04-18T21:10:20.546924+0000","last_fullsized":"2024-04-18T21:10:20.546924+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":26170,"num_write":372,"num_write_kb":83931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"71'366","reported_seq":586,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:28.529191+0000","last_change":"2024-04-18T21:10:28.529255+0000","last_active":"2024-04-18T21:10:28.529191+0000","last_peered":"2024-04-18T21:10:28.529191+0000","last_clean":"2024-04-18T21:10:28.529191+0000","last_became_active":"2024-04-18T21:10:01.488047+0000","last_became_peered":"2024-04-18T21:10:01.488047+0000","last_unstale":"2024-04-18T21:10:28.529191+0000","last_undegraded":"2024-04-18T21:10:28.529191+0000","last_fullsized":"2024-04-18T21:10:28.529191+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'366","last_scrub_stamp":"2024-04-18T21:10:28.528999+0000","last_deep_scrub":"71'366","last_deep_scrub_stamp":"2024-04-18T21:10:28.528999+0000","last_clean_scrub_stamp":"2024-04-18T21:10:28.528999+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:55:59.232131+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":18907,"num_write":347,"num_write_kb":26153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"71'346","reported_seq":558,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:36.568825+0000","last_change":"2024-04-18T21:10:36.568890+0000","last_active":"2024-04-18T21:10:36.568825+0000","last_peered":"2024-04-18T21:10:36.568825+0000","last_clean":"2024-04-18T21:10:36.568825+0000","last_became_active":"2024-04-18T21:10:00.557412+0000","last_became_peered":"2024-04-18T21:10:00.557412+0000","last_unstale":"2024-04-18T21:10:36.568825+0000","last_undegraded":"2024-04-18T21:10:36.568825+0000","last_fullsized":"2024-04-18T21:10:36.568825+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'346","last_scrub_stamp":"2024-04-18T21:10:36.568625+0000","last_deep_scrub":"71'346","last_deep_scrub_stamp":"2024-04-18T21:10:36.568625+0000","last_clean_scrub_stamp":"2024-04-18T21:10:36.568625+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:47:39.400310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":6245,"num_write":324,"num_write_kb":37970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"71'417","reported_seq":647,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:33.619809+0000","last_change":"2024-04-18T21:10:33.619928+0000","last_active":"2024-04-18T21:10:33.619809+0000","last_peered":"2024-04-18T21:10:33.619809+0000","last_clean":"2024-04-18T21:10:33.619809+0000","last_became_active":"2024-04-18T21:10:02.551406+0000","last_became_peered":"2024-04-18T21:10:02.551406+0000","last_unstale":"2024-04-18T21:10:33.619809+0000","last_undegraded":"2024-04-18T21:10:33.619809+0000","last_fullsized":"2024-04-18T21:10:33.619809+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'417","last_scrub_stamp":"2024-04-18T21:10:33.619581+0000","last_deep_scrub":"71'417","last_deep_scrub_stamp":"2024-04-18T21:10:33.619581+0000","last_clean_scrub_stamp":"2024-04-18T21:10:33.619581+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:32:33.242827+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":21623,"num_write":381,"num_write_kb":71306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"71'398","reported_seq":978,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483057+0000","last_change":"2024-04-18T21:10:11.491565+0000","last_active":"2024-04-18T21:10:20.483057+0000","last_peered":"2024-04-18T21:10:20.483057+0000","last_clean":"2024-04-18T21:10:20.483057+0000","last_became_active":"2024-04-18T21:10:11.486593+0000","last_became_peered":"2024-04-18T21:10:11.486593+0000","last_unstale":"2024-04-18T21:10:20.483057+0000","last_undegraded":"2024-04-18T21:10:20.483057+0000","last_fullsized":"2024-04-18T21:10:20.483057+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":369,"num_write_kb":30006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'435","reported_seq":1103,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482603+0000","last_change":"2024-04-18T21:10:15.509238+0000","last_active":"2024-04-18T21:10:20.482603+0000","last_peered":"2024-04-18T21:10:20.482603+0000","last_clean":"2024-04-18T21:10:20.482603+0000","last_became_active":"2024-04-18T21:10:15.506328+0000","last_became_peered":"2024-04-18T21:10:15.506328+0000","last_unstale":"2024-04-18T21:10:20.482603+0000","last_undegraded":"2024-04-18T21:10:20.482603+0000","last_fullsized":"2024-04-18T21:10:20.482603+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":31523,"num_write":402,"num_write_kb":121466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":346,"num_bytes_recovered":410327,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'446","reported_seq":696,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:47.428251+0000","last_change":"2024-04-18T21:10:47.428309+0000","last_active":"2024-04-18T21:10:47.428251+0000","last_peered":"2024-04-18T21:10:47.428251+0000","last_clean":"2024-04-18T21:10:47.428251+0000","last_became_active":"2024-04-18T21:05:05.637352+0000","last_became_peered":"2024-04-18T21:05:05.637352+0000","last_unstale":"2024-04-18T21:10:47.428251+0000","last_undegraded":"2024-04-18T21:10:47.428251+0000","last_fullsized":"2024-04-18T21:10:47.428251+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'446","last_scrub_stamp":"2024-04-18T21:10:47.428048+0000","last_deep_scrub":"71'446","last_deep_scrub_stamp":"2024-04-18T21:10:47.428048+0000","last_clean_scrub_stamp":"2024-04-18T21:10:47.428048+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:45:45.058681+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":23833,"num_write":418,"num_write_kb":59679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"71'403","reported_seq":957,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.491410+0000","last_change":"2024-04-18T21:10:20.490427+0000","last_active":"2024-04-18T21:10:20.491410+0000","last_peered":"2024-04-18T21:10:20.491410+0000","last_clean":"2024-04-18T21:10:20.491410+0000","last_became_active":"2024-04-18T21:10:20.487409+0000","last_became_peered":"2024-04-18T21:10:20.487409+0000","last_unstale":"2024-04-18T21:10:20.491410+0000","last_undegraded":"2024-04-18T21:10:20.491410+0000","last_fullsized":"2024-04-18T21:10:20.491410+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":7482,"num_write":371,"num_write_kb":25957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'406","reported_seq":615,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:29.723746+0000","last_change":"2024-04-18T21:10:29.723886+0000","last_active":"2024-04-18T21:10:29.723746+0000","last_peered":"2024-04-18T21:10:29.723746+0000","last_clean":"2024-04-18T21:10:29.723746+0000","last_became_active":"2024-04-18T21:10:10.542594+0000","last_became_peered":"2024-04-18T21:10:10.542594+0000","last_unstale":"2024-04-18T21:10:29.723746+0000","last_undegraded":"2024-04-18T21:10:29.723746+0000","last_fullsized":"2024-04-18T21:10:29.723746+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'406","last_scrub_stamp":"2024-04-18T21:10:29.723436+0000","last_deep_scrub":"71'406","last_deep_scrub_stamp":"2024-04-18T21:10:29.723436+0000","last_clean_scrub_stamp":"2024-04-18T21:10:29.723436+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:35:53.236874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":27987,"num_write":365,"num_write_kb":38689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"71'470","reported_seq":1143,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.479891+0000","last_change":"2024-04-18T21:10:17.535574+0000","last_active":"2024-04-18T21:10:20.479891+0000","last_peered":"2024-04-18T21:10:20.479891+0000","last_clean":"2024-04-18T21:10:20.479891+0000","last_became_active":"2024-04-18T21:10:17.529957+0000","last_became_peered":"2024-04-18T21:10:17.529957+0000","last_unstale":"2024-04-18T21:10:20.479891+0000","last_undegraded":"2024-04-18T21:10:20.479891+0000","last_fullsized":"2024-04-18T21:10:20.479891+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":59273,"num_write":432,"num_write_kb":145930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'433","reported_seq":644,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:45.442117+0000","last_change":"2024-04-18T21:10:45.442240+0000","last_active":"2024-04-18T21:10:45.442117+0000","last_peered":"2024-04-18T21:10:45.442117+0000","last_clean":"2024-04-18T21:10:45.442117+0000","last_became_active":"2024-04-18T21:05:05.637567+0000","last_became_peered":"2024-04-18T21:05:05.637567+0000","last_unstale":"2024-04-18T21:10:45.442117+0000","last_undegraded":"2024-04-18T21:10:45.442117+0000","last_fullsized":"2024-04-18T21:10:45.442117+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'433","last_scrub_stamp":"2024-04-18T21:10:45.441810+0000","last_deep_scrub":"71'433","last_deep_scrub_stamp":"2024-04-18T21:10:45.441810+0000","last_clean_scrub_stamp":"2024-04-18T21:10:45.441810+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:25:07.094327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5514,"num_write":403,"num_write_kb":26329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"71'418","reported_seq":670,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:43.470000+0000","last_change":"2024-04-18T21:10:43.470064+0000","last_active":"2024-04-18T21:10:43.470000+0000","last_peered":"2024-04-18T21:10:43.470000+0000","last_clean":"2024-04-18T21:10:43.470000+0000","last_became_active":"2024-04-18T21:05:05.642991+0000","last_became_peered":"2024-04-18T21:05:05.642991+0000","last_unstale":"2024-04-18T21:10:43.470000+0000","last_undegraded":"2024-04-18T21:10:43.470000+0000","last_fullsized":"2024-04-18T21:10:43.470000+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'418","last_scrub_stamp":"2024-04-18T21:10:43.469805+0000","last_deep_scrub":"71'418","last_deep_scrub_stamp":"2024-04-18T21:10:43.469805+0000","last_clean_scrub_stamp":"2024-04-18T21:10:43.469805+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:34:47.223005+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":29097,"num_write":386,"num_write_kb":88262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"71'479","reported_seq":731,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:43.601031+0000","last_change":"2024-04-18T21:10:43.601163+0000","last_active":"2024-04-18T21:10:43.601031+0000","last_peered":"2024-04-18T21:10:43.601031+0000","last_clean":"2024-04-18T21:10:43.601031+0000","last_became_active":"2024-04-18T21:10:07.544314+0000","last_became_peered":"2024-04-18T21:10:07.544314+0000","last_unstale":"2024-04-18T21:10:43.601031+0000","last_undegraded":"2024-04-18T21:10:43.601031+0000","last_fullsized":"2024-04-18T21:10:43.601031+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'479","last_scrub_stamp":"2024-04-18T21:10:43.600798+0000","last_deep_scrub":"71'479","last_deep_scrub_stamp":"2024-04-18T21:10:43.600798+0000","last_clean_scrub_stamp":"2024-04-18T21:10:43.600798+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:17:09.198734+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":24204,"num_write":452,"num_write_kb":114184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"71'407","reported_seq":646,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:33.445333+0000","last_change":"2024-04-18T21:10:33.445390+0000","last_active":"2024-04-18T21:10:33.445333+0000","last_peered":"2024-04-18T21:10:33.445333+0000","last_clean":"2024-04-18T21:10:33.445333+0000","last_became_active":"2024-04-18T21:10:03.476552+0000","last_became_peered":"2024-04-18T21:10:03.476552+0000","last_unstale":"2024-04-18T21:10:33.445333+0000","last_undegraded":"2024-04-18T21:10:33.445333+0000","last_fullsized":"2024-04-18T21:10:33.445333+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'407","last_scrub_stamp":"2024-04-18T21:10:33.445126+0000","last_deep_scrub":"71'407","last_deep_scrub_stamp":"2024-04-18T21:10:33.445126+0000","last_clean_scrub_stamp":"2024-04-18T21:10:33.445126+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:01:37.597658+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":37766,"num_write":374,"num_write_kb":103984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'452","reported_seq":654,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547134+0000","last_change":"2024-04-18T21:10:18.547982+0000","last_active":"2024-04-18T21:10:20.547134+0000","last_peered":"2024-04-18T21:10:20.547134+0000","last_clean":"2024-04-18T21:10:20.547134+0000","last_became_active":"2024-04-18T21:10:18.542189+0000","last_became_peered":"2024-04-18T21:10:18.542189+0000","last_unstale":"2024-04-18T21:10:20.547134+0000","last_undegraded":"2024-04-18T21:10:20.547134+0000","last_fullsized":"2024-04-18T21:10:20.547134+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27170,"num_write":421,"num_write_kb":39548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"71'427","reported_seq":643,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:35.610080+0000","last_change":"2024-04-18T21:10:35.610142+0000","last_active":"2024-04-18T21:10:35.610080+0000","last_peered":"2024-04-18T21:10:35.610080+0000","last_clean":"2024-04-18T21:10:35.610080+0000","last_became_active":"2024-04-18T21:10:03.539961+0000","last_became_peered":"2024-04-18T21:10:03.539961+0000","last_unstale":"2024-04-18T21:10:35.610080+0000","last_undegraded":"2024-04-18T21:10:35.610080+0000","last_fullsized":"2024-04-18T21:10:35.610080+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'427","last_scrub_stamp":"2024-04-18T21:10:35.609881+0000","last_deep_scrub":"71'427","last_deep_scrub_stamp":"2024-04-18T21:10:35.609881+0000","last_clean_scrub_stamp":"2024-04-18T21:10:35.609881+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:56:03.330499+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":11507,"num_write":407,"num_write_kb":50964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"71'471","reported_seq":698,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.480078+0000","last_change":"2024-04-18T21:05:05.649581+0000","last_active":"2024-04-18T21:10:20.480078+0000","last_peered":"2024-04-18T21:10:20.480078+0000","last_clean":"2024-04-18T21:10:20.480078+0000","last_became_active":"2024-04-18T21:05:05.648233+0000","last_became_peered":"2024-04-18T21:05:05.648233+0000","last_unstale":"2024-04-18T21:10:20.480078+0000","last_undegraded":"2024-04-18T21:10:20.480078+0000","last_fullsized":"2024-04-18T21:10:20.480078+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20857,"num_write":431,"num_write_kb":63677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'378","reported_seq":949,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:37.477427+0000","last_change":"2024-04-18T21:10:37.477561+0000","last_active":"2024-04-18T21:10:37.477427+0000","last_peered":"2024-04-18T21:10:37.477427+0000","last_clean":"2024-04-18T21:10:37.477427+0000","last_became_active":"2024-04-18T21:09:55.490958+0000","last_became_peered":"2024-04-18T21:09:55.490958+0000","last_unstale":"2024-04-18T21:10:37.477427+0000","last_undegraded":"2024-04-18T21:10:37.477427+0000","last_fullsized":"2024-04-18T21:10:37.477427+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'378","last_scrub_stamp":"2024-04-18T21:10:37.477124+0000","last_deep_scrub":"71'378","last_deep_scrub_stamp":"2024-04-18T21:10:37.477124+0000","last_clean_scrub_stamp":"2024-04-18T21:10:37.477124+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:56:57.373143+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12573,"num_write":347,"num_write_kb":34434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'410","reported_seq":648,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:32.644853+0000","last_change":"2024-04-18T21:10:32.644917+0000","last_active":"2024-04-18T21:10:32.644853+0000","last_peered":"2024-04-18T21:10:32.644853+0000","last_clean":"2024-04-18T21:10:32.644853+0000","last_became_active":"2024-04-18T21:10:01.555367+0000","last_became_peered":"2024-04-18T21:10:01.555367+0000","last_unstale":"2024-04-18T21:10:32.644853+0000","last_undegraded":"2024-04-18T21:10:32.644853+0000","last_fullsized":"2024-04-18T21:10:32.644853+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'410","last_scrub_stamp":"2024-04-18T21:10:32.644659+0000","last_deep_scrub":"71'410","last_deep_scrub_stamp":"2024-04-18T21:10:32.644659+0000","last_clean_scrub_stamp":"2024-04-18T21:10:32.644659+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:58:22.209002+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":16926,"num_write":380,"num_write_kb":112804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"71'410","reported_seq":1000,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:41.515893+0000","last_change":"2024-04-18T21:10:41.515954+0000","last_active":"2024-04-18T21:10:41.515893+0000","last_peered":"2024-04-18T21:10:41.515893+0000","last_clean":"2024-04-18T21:10:41.515893+0000","last_became_active":"2024-04-18T21:10:03.480985+0000","last_became_peered":"2024-04-18T21:10:03.480985+0000","last_unstale":"2024-04-18T21:10:41.515893+0000","last_undegraded":"2024-04-18T21:10:41.515893+0000","last_fullsized":"2024-04-18T21:10:41.515893+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'410","last_scrub_stamp":"2024-04-18T21:10:41.515701+0000","last_deep_scrub":"71'410","last_deep_scrub_stamp":"2024-04-18T21:10:41.515701+0000","last_clean_scrub_stamp":"2024-04-18T21:10:41.515701+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:17:22.317167+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":34811,"num_write":378,"num_write_kb":51242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'491","reported_seq":710,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546554+0000","last_change":"2024-04-18T21:10:08.546388+0000","last_active":"2024-04-18T21:10:20.546554+0000","last_peered":"2024-04-18T21:10:20.546554+0000","last_clean":"2024-04-18T21:10:20.546554+0000","last_became_active":"2024-04-18T21:10:08.540487+0000","last_became_peered":"2024-04-18T21:10:08.540487+0000","last_unstale":"2024-04-18T21:10:20.546554+0000","last_undegraded":"2024-04-18T21:10:20.546554+0000","last_fullsized":"2024-04-18T21:10:20.546554+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":26902,"num_write":456,"num_write_kb":124778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":209,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"71'467","reported_seq":1080,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.477893+0000","last_change":"2024-04-18T21:10:19.483012+0000","last_active":"2024-04-18T21:10:20.477893+0000","last_peered":"2024-04-18T21:10:20.477893+0000","last_clean":"2024-04-18T21:10:20.477893+0000","last_became_active":"2024-04-18T21:10:19.480002+0000","last_became_peered":"2024-04-18T21:10:19.480002+0000","last_unstale":"2024-04-18T21:10:20.477893+0000","last_undegraded":"2024-04-18T21:10:20.477893+0000","last_fullsized":"2024-04-18T21:10:20.477893+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":28114,"num_write":434,"num_write_kb":129325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'423","reported_seq":596,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482485+0000","last_change":"2024-04-18T21:10:01.499421+0000","last_active":"2024-04-18T21:10:20.482485+0000","last_peered":"2024-04-18T21:10:20.482485+0000","last_clean":"2024-04-18T21:10:20.482485+0000","last_became_active":"2024-04-18T21:10:01.487074+0000","last_became_peered":"2024-04-18T21:10:01.487074+0000","last_unstale":"2024-04-18T21:10:20.482485+0000","last_undegraded":"2024-04-18T21:10:20.482485+0000","last_fullsized":"2024-04-18T21:10:20.482485+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8244,"num_write":393,"num_write_kb":58692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"71'389","reported_seq":619,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547340+0000","last_change":"2024-04-18T21:09:58.542232+0000","last_active":"2024-04-18T21:10:20.547340+0000","last_peered":"2024-04-18T21:10:20.547340+0000","last_clean":"2024-04-18T21:10:20.547340+0000","last_became_active":"2024-04-18T21:09:58.537723+0000","last_became_peered":"2024-04-18T21:09:58.537723+0000","last_unstale":"2024-04-18T21:10:20.547340+0000","last_undegraded":"2024-04-18T21:10:20.547340+0000","last_fullsized":"2024-04-18T21:10:20.547340+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":24216,"num_write":349,"num_write_kb":43176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"70'425","reported_seq":622,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483667+0000","last_change":"2024-04-18T21:05:04.632748+0000","last_active":"2024-04-18T21:10:20.483667+0000","last_peered":"2024-04-18T21:10:20.483667+0000","last_clean":"2024-04-18T21:10:20.483667+0000","last_became_active":"2024-04-18T21:05:04.628407+0000","last_became_peered":"2024-04-18T21:05:04.628407+0000","last_unstale":"2024-04-18T21:10:20.483667+0000","last_undegraded":"2024-04-18T21:10:20.483667+0000","last_fullsized":"2024-04-18T21:10:20.483667+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":375,"num_write_kb":8348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"71'423","reported_seq":624,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547336+0000","last_change":"2024-04-18T21:10:14.556066+0000","last_active":"2024-04-18T21:10:20.547336+0000","last_peered":"2024-04-18T21:10:20.547336+0000","last_clean":"2024-04-18T21:10:20.547336+0000","last_became_active":"2024-04-18T21:10:14.551249+0000","last_became_peered":"2024-04-18T21:10:14.551249+0000","last_unstale":"2024-04-18T21:10:20.547336+0000","last_undegraded":"2024-04-18T21:10:20.547336+0000","last_fullsized":"2024-04-18T21:10:20.547336+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":20096,"num_write":381,"num_write_kb":76351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"70'56","reported_seq":273,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:36.494604+0000","last_change":"2024-04-18T21:10:36.494662+0000","last_active":"2024-04-18T21:10:36.494604+0000","last_peered":"2024-04-18T21:10:36.494604+0000","last_clean":"2024-04-18T21:10:36.494604+0000","last_became_active":"2024-04-18T21:10:00.489486+0000","last_became_peered":"2024-04-18T21:10:00.489486+0000","last_unstale":"2024-04-18T21:10:36.494604+0000","last_undegraded":"2024-04-18T21:10:36.494604+0000","last_fullsized":"2024-04-18T21:10:36.494604+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'56","last_scrub_stamp":"2024-04-18T21:10:36.494405+0000","last_deep_scrub":"70'56","last_deep_scrub_stamp":"2024-04-18T21:10:36.494405+0000","last_clean_scrub_stamp":"2024-04-18T21:10:36.494405+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:33:10.489937+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'442","reported_seq":1035,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:45.552829+0000","last_change":"2024-04-18T21:10:45.552889+0000","last_active":"2024-04-18T21:10:45.552829+0000","last_peered":"2024-04-18T21:10:45.552829+0000","last_clean":"2024-04-18T21:10:45.552829+0000","last_became_active":"2024-04-18T21:10:03.483050+0000","last_became_peered":"2024-04-18T21:10:03.483050+0000","last_unstale":"2024-04-18T21:10:45.552829+0000","last_undegraded":"2024-04-18T21:10:45.552829+0000","last_fullsized":"2024-04-18T21:10:45.552829+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'442","last_scrub_stamp":"2024-04-18T21:10:45.552620+0000","last_deep_scrub":"71'442","last_deep_scrub_stamp":"2024-04-18T21:10:45.552620+0000","last_clean_scrub_stamp":"2024-04-18T21:10:45.552620+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:50:44.224177+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13827,"num_write":415,"num_write_kb":79859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"70'62","reported_seq":81,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546776+0000","last_change":"2024-04-18T21:09:50.868159+0000","last_active":"2024-04-18T21:10:20.546776+0000","last_peered":"2024-04-18T21:10:20.546776+0000","last_clean":"2024-04-18T21:10:20.546776+0000","last_became_active":"2024-04-18T21:09:50.867096+0000","last_became_peered":"2024-04-18T21:09:50.867096+0000","last_unstale":"2024-04-18T21:10:20.546776+0000","last_undegraded":"2024-04-18T21:10:20.546776+0000","last_fullsized":"2024-04-18T21:10:20.546776+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"71'398","reported_seq":648,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:34.474342+0000","last_change":"2024-04-18T21:10:34.474403+0000","last_active":"2024-04-18T21:10:34.474342+0000","last_peered":"2024-04-18T21:10:34.474342+0000","last_clean":"2024-04-18T21:10:34.474342+0000","last_became_active":"2024-04-18T21:10:01.495349+0000","last_became_peered":"2024-04-18T21:10:01.495349+0000","last_unstale":"2024-04-18T21:10:34.474342+0000","last_undegraded":"2024-04-18T21:10:34.474342+0000","last_fullsized":"2024-04-18T21:10:34.474342+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'398","last_scrub_stamp":"2024-04-18T21:10:34.474141+0000","last_deep_scrub":"71'398","last_deep_scrub_stamp":"2024-04-18T21:10:34.474141+0000","last_clean_scrub_stamp":"2024-04-18T21:10:34.474141+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:01:44.645400+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":17616,"num_write":360,"num_write_kb":58871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"70'66","reported_seq":182,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482546+0000","last_change":"2024-04-18T21:10:00.496701+0000","last_active":"2024-04-18T21:10:20.482546+0000","last_peered":"2024-04-18T21:10:20.482546+0000","last_clean":"2024-04-18T21:10:20.482546+0000","last_became_active":"2024-04-18T21:10:00.495594+0000","last_became_peered":"2024-04-18T21:10:00.495594+0000","last_unstale":"2024-04-18T21:10:20.482546+0000","last_undegraded":"2024-04-18T21:10:20.482546+0000","last_fullsized":"2024-04-18T21:10:20.482546+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"108'137","reported_seq":79,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:38.537294+0000","last_change":"2024-04-18T21:10:38.537363+0000","last_active":"2024-04-18T21:10:38.537294+0000","last_peered":"2024-04-18T21:10:38.537294+0000","last_clean":"2024-04-18T21:10:38.537294+0000","last_became_active":"2024-04-18T21:10:00.491509+0000","last_became_peered":"2024-04-18T21:10:00.491509+0000","last_unstale":"2024-04-18T21:10:38.537294+0000","last_undegraded":"2024-04-18T21:10:38.537294+0000","last_fullsized":"2024-04-18T21:10:38.537294+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'137","last_scrub_stamp":"2024-04-18T21:10:38.537083+0000","last_deep_scrub":"108'137","last_deep_scrub_stamp":"2024-04-18T21:10:38.537083+0000","last_clean_scrub_stamp":"2024-04-18T21:10:38.537083+0000","objects_scrubbed":2,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:08:53.700658+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":7777508,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'410","reported_seq":619,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:41.636377+0000","last_change":"2024-04-18T21:10:41.636493+0000","last_active":"2024-04-18T21:10:41.636377+0000","last_peered":"2024-04-18T21:10:41.636377+0000","last_clean":"2024-04-18T21:10:41.636377+0000","last_became_active":"2024-04-18T21:10:06.548034+0000","last_became_peered":"2024-04-18T21:10:06.548034+0000","last_unstale":"2024-04-18T21:10:41.636377+0000","last_undegraded":"2024-04-18T21:10:41.636377+0000","last_fullsized":"2024-04-18T21:10:41.636377+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'410","last_scrub_stamp":"2024-04-18T21:10:41.636098+0000","last_deep_scrub":"71'410","last_deep_scrub_stamp":"2024-04-18T21:10:41.636098+0000","last_clean_scrub_stamp":"2024-04-18T21:10:41.636098+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:22.483374+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17055,"num_write":375,"num_write_kb":63331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"108'242","reported_seq":374,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:38.593936+0000","last_change":"2024-04-18T21:10:38.594005+0000","last_active":"2024-04-18T21:10:38.593936+0000","last_peered":"2024-04-18T21:10:38.593936+0000","last_clean":"2024-04-18T21:10:38.593936+0000","last_became_active":"2024-04-18T21:10:00.555486+0000","last_became_peered":"2024-04-18T21:10:00.555486+0000","last_unstale":"2024-04-18T21:10:38.593936+0000","last_undegraded":"2024-04-18T21:10:38.593936+0000","last_fullsized":"2024-04-18T21:10:38.593936+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'242","last_scrub_stamp":"2024-04-18T21:10:38.593741+0000","last_deep_scrub":"108'242","last_deep_scrub_stamp":"2024-04-18T21:10:38.593741+0000","last_clean_scrub_stamp":"2024-04-18T21:10:38.593741+0000","objects_scrubbed":2,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:33:25.988727+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":4191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"71'501","reported_seq":720,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546019+0000","last_change":"2024-04-18T21:10:17.593530+0000","last_active":"2024-04-18T21:10:20.546019+0000","last_peered":"2024-04-18T21:10:20.546019+0000","last_clean":"2024-04-18T21:10:20.546019+0000","last_became_active":"2024-04-18T21:10:17.588391+0000","last_became_peered":"2024-04-18T21:10:17.588391+0000","last_unstale":"2024-04-18T21:10:20.546019+0000","last_undegraded":"2024-04-18T21:10:20.546019+0000","last_fullsized":"2024-04-18T21:10:20.546019+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":37662,"num_write":474,"num_write_kb":167663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"108'431","reported_seq":577,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:40.518750+0000","last_change":"2024-04-18T21:10:40.518847+0000","last_active":"2024-04-18T21:10:40.518750+0000","last_peered":"2024-04-18T21:10:40.518750+0000","last_clean":"2024-04-18T21:10:40.518750+0000","last_became_active":"2024-04-18T21:10:00.491525+0000","last_became_peered":"2024-04-18T21:10:00.491525+0000","last_unstale":"2024-04-18T21:10:40.518750+0000","last_undegraded":"2024-04-18T21:10:40.518750+0000","last_fullsized":"2024-04-18T21:10:40.518750+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'431","last_scrub_stamp":"2024-04-18T21:10:40.518479+0000","last_deep_scrub":"108'431","last_deep_scrub_stamp":"2024-04-18T21:10:40.518479+0000","last_clean_scrub_stamp":"2024-04-18T21:10:40.518479+0000","objects_scrubbed":2,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:15:33.885815+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":377,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388678,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'440","reported_seq":659,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:32.560566+0000","last_change":"2024-04-18T21:10:32.560626+0000","last_active":"2024-04-18T21:10:32.560566+0000","last_peered":"2024-04-18T21:10:32.560566+0000","last_clean":"2024-04-18T21:10:32.560566+0000","last_became_active":"2024-04-18T21:10:01.486740+0000","last_became_peered":"2024-04-18T21:10:01.486740+0000","last_unstale":"2024-04-18T21:10:32.560566+0000","last_undegraded":"2024-04-18T21:10:32.560566+0000","last_fullsized":"2024-04-18T21:10:32.560566+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'440","last_scrub_stamp":"2024-04-18T21:10:32.560375+0000","last_deep_scrub":"71'440","last_deep_scrub_stamp":"2024-04-18T21:10:32.560375+0000","last_clean_scrub_stamp":"2024-04-18T21:10:32.560375+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:25:33.859991+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":42138,"num_write":408,"num_write_kb":96310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"70'59","reported_seq":256,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.484192+0000","last_change":"2024-04-18T21:05:04.625520+0000","last_active":"2024-04-18T21:10:20.484192+0000","last_peered":"2024-04-18T21:10:20.484192+0000","last_clean":"2024-04-18T21:10:20.484192+0000","last_became_active":"2024-04-18T21:05:04.624656+0000","last_became_peered":"2024-04-18T21:05:04.624656+0000","last_unstale":"2024-04-18T21:10:20.484192+0000","last_undegraded":"2024-04-18T21:10:20.484192+0000","last_fullsized":"2024-04-18T21:10:20.484192+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"71'461","reported_seq":677,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.478465+0000","last_change":"2024-04-18T21:05:05.649406+0000","last_active":"2024-04-18T21:10:20.478465+0000","last_peered":"2024-04-18T21:10:20.478465+0000","last_clean":"2024-04-18T21:10:20.478465+0000","last_became_active":"2024-04-18T21:05:05.648380+0000","last_became_peered":"2024-04-18T21:05:05.648380+0000","last_unstale":"2024-04-18T21:10:20.478465+0000","last_undegraded":"2024-04-18T21:10:20.478465+0000","last_fullsized":"2024-04-18T21:10:20.478465+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12852,"num_write":420,"num_write_kb":88506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"108'160","reported_seq":388,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:38.540108+0000","last_change":"2024-04-18T21:10:38.540182+0000","last_active":"2024-04-18T21:10:38.540108+0000","last_peered":"2024-04-18T21:10:38.540108+0000","last_clean":"2024-04-18T21:10:38.540108+0000","last_became_active":"2024-04-18T21:10:00.494630+0000","last_became_peered":"2024-04-18T21:10:00.494630+0000","last_unstale":"2024-04-18T21:10:38.540108+0000","last_undegraded":"2024-04-18T21:10:38.540108+0000","last_fullsized":"2024-04-18T21:10:38.540108+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'160","last_scrub_stamp":"2024-04-18T21:10:38.539887+0000","last_deep_scrub":"108'160","last_deep_scrub_stamp":"2024-04-18T21:10:38.539887+0000","last_clean_scrub_stamp":"2024-04-18T21:10:38.539887+0000","objects_scrubbed":3,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:13:46.306220+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":8250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'445","reported_seq":636,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483834+0000","last_change":"2024-04-18T21:10:01.500937+0000","last_active":"2024-04-18T21:10:20.483834+0000","last_peered":"2024-04-18T21:10:20.483834+0000","last_clean":"2024-04-18T21:10:20.483834+0000","last_became_active":"2024-04-18T21:10:01.490691+0000","last_became_peered":"2024-04-18T21:10:01.490691+0000","last_unstale":"2024-04-18T21:10:20.483834+0000","last_undegraded":"2024-04-18T21:10:20.483834+0000","last_fullsized":"2024-04-18T21:10:20.483834+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17488,"num_write":410,"num_write_kb":50845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"70'124","reported_seq":321,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483528+0000","last_change":"2024-04-18T21:05:04.634674+0000","last_active":"2024-04-18T21:10:20.483528+0000","last_peered":"2024-04-18T21:10:20.483528+0000","last_clean":"2024-04-18T21:10:20.483528+0000","last_became_active":"2024-04-18T21:05:04.632284+0000","last_became_peered":"2024-04-18T21:05:04.632284+0000","last_unstale":"2024-04-18T21:10:20.483528+0000","last_undegraded":"2024-04-18T21:10:20.483528+0000","last_fullsized":"2024-04-18T21:10:20.483528+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"71'400","reported_seq":943,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.484590+0000","last_change":"2024-04-18T21:10:14.495223+0000","last_active":"2024-04-18T21:10:20.484590+0000","last_peered":"2024-04-18T21:10:20.484590+0000","last_clean":"2024-04-18T21:10:20.484590+0000","last_became_active":"2024-04-18T21:10:14.492039+0000","last_became_peered":"2024-04-18T21:10:14.492039+0000","last_unstale":"2024-04-18T21:10:20.484590+0000","last_undegraded":"2024-04-18T21:10:20.484590+0000","last_fullsized":"2024-04-18T21:10:20.484590+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12586,"num_write":372,"num_write_kb":58856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":350,"num_bytes_recovered":576854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"70'53","reported_seq":91,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:42.601858+0000","last_change":"2024-04-18T21:10:42.601923+0000","last_active":"2024-04-18T21:10:42.601858+0000","last_peered":"2024-04-18T21:10:42.601858+0000","last_clean":"2024-04-18T21:10:42.601858+0000","last_became_active":"2024-04-18T21:10:00.549987+0000","last_became_peered":"2024-04-18T21:10:00.549987+0000","last_unstale":"2024-04-18T21:10:42.601858+0000","last_undegraded":"2024-04-18T21:10:42.601858+0000","last_fullsized":"2024-04-18T21:10:42.601858+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'53","last_scrub_stamp":"2024-04-18T21:10:42.601641+0000","last_deep_scrub":"70'53","last_deep_scrub_stamp":"2024-04-18T21:10:42.601641+0000","last_clean_scrub_stamp":"2024-04-18T21:10:42.601641+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:30:52.296080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"71'364","reported_seq":952,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:34.489083+0000","last_change":"2024-04-18T21:10:34.489140+0000","last_active":"2024-04-18T21:10:34.489083+0000","last_peered":"2024-04-18T21:10:34.489083+0000","last_clean":"2024-04-18T21:10:34.489083+0000","last_became_active":"2024-04-18T21:09:58.473903+0000","last_became_peered":"2024-04-18T21:09:58.473903+0000","last_unstale":"2024-04-18T21:10:34.489083+0000","last_undegraded":"2024-04-18T21:10:34.489083+0000","last_fullsized":"2024-04-18T21:10:34.489083+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'364","last_scrub_stamp":"2024-04-18T21:10:34.488895+0000","last_deep_scrub":"71'364","last_deep_scrub_stamp":"2024-04-18T21:10:34.488895+0000","last_clean_scrub_stamp":"2024-04-18T21:10:34.488895+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:11:05.862340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":37938,"num_write":336,"num_write_kb":42513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"70'460","reported_seq":574,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546394+0000","last_change":"2024-04-18T21:09:53.545846+0000","last_active":"2024-04-18T21:10:20.546394+0000","last_peered":"2024-04-18T21:10:20.546394+0000","last_clean":"2024-04-18T21:10:20.546394+0000","last_became_active":"2024-04-18T21:09:53.544355+0000","last_became_peered":"2024-04-18T21:09:53.544355+0000","last_unstale":"2024-04-18T21:10:20.546394+0000","last_undegraded":"2024-04-18T21:10:20.546394+0000","last_fullsized":"2024-04-18T21:10:20.546394+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":406,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"71'404","reported_seq":979,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.480260+0000","last_change":"2024-04-18T21:10:15.507332+0000","last_active":"2024-04-18T21:10:20.480260+0000","last_peered":"2024-04-18T21:10:20.480260+0000","last_clean":"2024-04-18T21:10:20.480260+0000","last_became_active":"2024-04-18T21:10:15.504379+0000","last_became_peered":"2024-04-18T21:10:15.504379+0000","last_unstale":"2024-04-18T21:10:20.480260+0000","last_undegraded":"2024-04-18T21:10:20.480260+0000","last_fullsized":"2024-04-18T21:10:20.480260+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":7075,"num_write":367,"num_write_kb":62738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":384,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483065+0000","last_change":"2024-04-18T21:10:00.497960+0000","last_active":"2024-04-18T21:10:20.483065+0000","last_peered":"2024-04-18T21:10:20.483065+0000","last_clean":"2024-04-18T21:10:20.483065+0000","last_became_active":"2024-04-18T21:10:00.496373+0000","last_became_peered":"2024-04-18T21:10:00.496373+0000","last_unstale":"2024-04-18T21:10:20.483065+0000","last_undegraded":"2024-04-18T21:10:20.483065+0000","last_fullsized":"2024-04-18T21:10:20.483065+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:53.494814+0000","last_clean_scrub_stamp":"2024-04-18T21:04:53.494814+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":168,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:36.510603+0000","last_change":"2024-04-18T21:10:36.510657+0000","last_active":"2024-04-18T21:10:36.510603+0000","last_peered":"2024-04-18T21:10:36.510603+0000","last_clean":"2024-04-18T21:10:36.510603+0000","last_became_active":"2024-04-18T21:10:00.486722+0000","last_became_peered":"2024-04-18T21:10:00.486722+0000","last_unstale":"2024-04-18T21:10:36.510603+0000","last_undegraded":"2024-04-18T21:10:36.510603+0000","last_fullsized":"2024-04-18T21:10:36.510603+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:10:36.510287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:10:36.510287+0000","last_clean_scrub_stamp":"2024-04-18T21:10:36.510287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:31:24.648869+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"108'597","reported_seq":761,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:35.556401+0000","last_change":"2024-04-18T21:10:35.556468+0000","last_active":"2024-04-18T21:10:35.556401+0000","last_peered":"2024-04-18T21:10:35.556401+0000","last_clean":"2024-04-18T21:10:35.556401+0000","last_became_active":"2024-04-18T21:10:03.481344+0000","last_became_peered":"2024-04-18T21:10:03.481344+0000","last_unstale":"2024-04-18T21:10:35.556401+0000","last_undegraded":"2024-04-18T21:10:35.556401+0000","last_fullsized":"2024-04-18T21:10:35.556401+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'597","last_scrub_stamp":"2024-04-18T21:10:35.556222+0000","last_deep_scrub":"108'597","last_deep_scrub_stamp":"2024-04-18T21:10:35.556222+0000","last_clean_scrub_stamp":"2024-04-18T21:10:35.556222+0000","objects_scrubbed":2,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:38.178309+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":539,"num_write_kb":8449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4689862,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'443","reported_seq":1098,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:35.495143+0000","last_change":"2024-04-18T21:10:35.495203+0000","last_active":"2024-04-18T21:10:35.495143+0000","last_peered":"2024-04-18T21:10:35.495143+0000","last_clean":"2024-04-18T21:10:35.495143+0000","last_became_active":"2024-04-18T21:09:56.493327+0000","last_became_peered":"2024-04-18T21:09:56.493327+0000","last_unstale":"2024-04-18T21:10:35.495143+0000","last_undegraded":"2024-04-18T21:10:35.495143+0000","last_fullsized":"2024-04-18T21:10:35.495143+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'443","last_scrub_stamp":"2024-04-18T21:10:35.494948+0000","last_deep_scrub":"71'443","last_deep_scrub_stamp":"2024-04-18T21:10:35.494948+0000","last_clean_scrub_stamp":"2024-04-18T21:10:35.494948+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:07:37.030049+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":38975,"num_write":404,"num_write_kb":80038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":218,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:41.517221+0000","last_change":"2024-04-18T21:10:41.517281+0000","last_active":"2024-04-18T21:10:41.517221+0000","last_peered":"2024-04-18T21:10:41.517221+0000","last_clean":"2024-04-18T21:10:41.517221+0000","last_became_active":"2024-04-18T21:09:50.816543+0000","last_became_peered":"2024-04-18T21:09:50.816543+0000","last_unstale":"2024-04-18T21:10:41.517221+0000","last_undegraded":"2024-04-18T21:10:41.517221+0000","last_fullsized":"2024-04-18T21:10:41.517221+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:10:41.517027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:10:41.517027+0000","last_clean_scrub_stamp":"2024-04-18T21:10:41.517027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:42:46.384341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"108'130","reported_seq":322,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:39.518628+0000","last_change":"2024-04-18T21:10:39.518694+0000","last_active":"2024-04-18T21:10:39.518628+0000","last_peered":"2024-04-18T21:10:39.518628+0000","last_clean":"2024-04-18T21:10:39.518628+0000","last_became_active":"2024-04-18T21:10:03.486859+0000","last_became_peered":"2024-04-18T21:10:03.486859+0000","last_unstale":"2024-04-18T21:10:39.518628+0000","last_undegraded":"2024-04-18T21:10:39.518628+0000","last_fullsized":"2024-04-18T21:10:39.518628+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'130","last_scrub_stamp":"2024-04-18T21:10:39.518437+0000","last_deep_scrub":"108'130","last_deep_scrub_stamp":"2024-04-18T21:10:39.518437+0000","last_clean_scrub_stamp":"2024-04-18T21:10:39.518437+0000","objects_scrubbed":1,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:31:11.104305+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466419,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":55,"num_read_kb":1405,"num_write":58,"num_write_kb":1469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'457","reported_seq":689,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:30.679943+0000","last_change":"2024-04-18T21:10:30.680122+0000","last_active":"2024-04-18T21:10:30.679943+0000","last_peered":"2024-04-18T21:10:30.679943+0000","last_clean":"2024-04-18T21:10:30.679943+0000","last_became_active":"2024-04-18T21:10:09.537428+0000","last_became_peered":"2024-04-18T21:10:09.537428+0000","last_unstale":"2024-04-18T21:10:30.679943+0000","last_undegraded":"2024-04-18T21:10:30.679943+0000","last_fullsized":"2024-04-18T21:10:30.679943+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'457","last_scrub_stamp":"2024-04-18T21:10:30.679714+0000","last_deep_scrub":"71'457","last_deep_scrub_stamp":"2024-04-18T21:10:30.679714+0000","last_clean_scrub_stamp":"2024-04-18T21:10:30.679714+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:40:35.941807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":27659,"num_write":426,"num_write_kb":80500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":209,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.478923+0000","last_change":"2024-04-18T21:09:50.832624+0000","last_active":"2024-04-18T21:10:20.478923+0000","last_peered":"2024-04-18T21:10:20.478923+0000","last_clean":"2024-04-18T21:10:20.478923+0000","last_became_active":"2024-04-18T21:09:50.831949+0000","last_became_peered":"2024-04-18T21:09:50.831949+0000","last_unstale":"2024-04-18T21:10:20.478923+0000","last_undegraded":"2024-04-18T21:10:20.478923+0000","last_fullsized":"2024-04-18T21:10:20.478923+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'170","reported_seq":369,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.545653+0000","last_change":"2024-04-18T21:09:53.538615+0000","last_active":"2024-04-18T21:10:20.545653+0000","last_peered":"2024-04-18T21:10:20.545653+0000","last_clean":"2024-04-18T21:10:20.545653+0000","last_became_active":"2024-04-18T21:09:53.537994+0000","last_became_peered":"2024-04-18T21:09:53.537994+0000","last_unstale":"2024-04-18T21:10:20.545653+0000","last_undegraded":"2024-04-18T21:10:20.545653+0000","last_fullsized":"2024-04-18T21:10:20.545653+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":8239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"71'346","reported_seq":911,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.480403+0000","last_change":"2024-04-18T21:10:11.487541+0000","last_active":"2024-04-18T21:10:20.480403+0000","last_peered":"2024-04-18T21:10:20.480403+0000","last_clean":"2024-04-18T21:10:20.480403+0000","last_became_active":"2024-04-18T21:10:11.484662+0000","last_became_peered":"2024-04-18T21:10:11.484662+0000","last_unstale":"2024-04-18T21:10:20.480403+0000","last_undegraded":"2024-04-18T21:10:20.480403+0000","last_fullsized":"2024-04-18T21:10:20.480403+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27042,"num_write":321,"num_write_kb":50693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":203,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483616+0000","last_change":"2024-04-18T21:05:00.576606+0000","last_active":"2024-04-18T21:10:20.483616+0000","last_peered":"2024-04-18T21:10:20.483616+0000","last_clean":"2024-04-18T21:10:20.483616+0000","last_became_active":"2024-04-18T21:05:00.575951+0000","last_became_peered":"2024-04-18T21:05:00.575951+0000","last_unstale":"2024-04-18T21:10:20.483616+0000","last_undegraded":"2024-04-18T21:10:20.483616+0000","last_fullsized":"2024-04-18T21:10:20.483616+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"70'63","reported_seq":260,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483992+0000","last_change":"2024-04-18T21:05:04.627296+0000","last_active":"2024-04-18T21:10:20.483992+0000","last_peered":"2024-04-18T21:10:20.483992+0000","last_clean":"2024-04-18T21:10:20.483992+0000","last_became_active":"2024-04-18T21:05:04.626801+0000","last_became_peered":"2024-04-18T21:05:04.626801+0000","last_unstale":"2024-04-18T21:10:20.483992+0000","last_undegraded":"2024-04-18T21:10:20.483992+0000","last_fullsized":"2024-04-18T21:10:20.483992+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"71'406","reported_seq":1050,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:46.571370+0000","last_change":"2024-04-18T21:10:46.571429+0000","last_active":"2024-04-18T21:10:46.571370+0000","last_peered":"2024-04-18T21:10:46.571370+0000","last_clean":"2024-04-18T21:10:46.571370+0000","last_became_active":"2024-04-18T21:09:59.493248+0000","last_became_peered":"2024-04-18T21:09:59.493248+0000","last_unstale":"2024-04-18T21:10:46.571370+0000","last_undegraded":"2024-04-18T21:10:46.571370+0000","last_fullsized":"2024-04-18T21:10:46.571370+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'406","last_scrub_stamp":"2024-04-18T21:10:46.571174+0000","last_deep_scrub":"71'406","last_deep_scrub_stamp":"2024-04-18T21:10:46.571174+0000","last_clean_scrub_stamp":"2024-04-18T21:10:46.571174+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:14:54.222674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":35332,"num_write":370,"num_write_kb":71807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"108'285","reported_seq":325,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:31.552483+0000","last_change":"2024-04-18T21:10:31.552548+0000","last_active":"2024-04-18T21:10:31.552483+0000","last_peered":"2024-04-18T21:10:31.552483+0000","last_clean":"2024-04-18T21:10:31.552483+0000","last_became_active":"2024-04-18T21:10:00.503851+0000","last_became_peered":"2024-04-18T21:10:00.503851+0000","last_unstale":"2024-04-18T21:10:31.552483+0000","last_undegraded":"2024-04-18T21:10:31.552483+0000","last_fullsized":"2024-04-18T21:10:31.552483+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'285","last_scrub_stamp":"2024-04-18T21:10:31.552295+0000","last_deep_scrub":"108'285","last_deep_scrub_stamp":"2024-04-18T21:10:31.552295+0000","last_clean_scrub_stamp":"2024-04-18T21:10:31.552295+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:10:37.571022+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":218,"num_write_kb":4194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":144,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:32.452332+0000","last_change":"2024-04-18T21:10:32.452386+0000","last_active":"2024-04-18T21:10:32.452332+0000","last_peered":"2024-04-18T21:10:32.452332+0000","last_clean":"2024-04-18T21:10:32.452332+0000","last_became_active":"2024-04-18T21:10:03.480071+0000","last_became_peered":"2024-04-18T21:10:03.480071+0000","last_unstale":"2024-04-18T21:10:32.452332+0000","last_undegraded":"2024-04-18T21:10:32.452332+0000","last_fullsized":"2024-04-18T21:10:32.452332+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:10:32.451773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:10:32.451773+0000","last_clean_scrub_stamp":"2024-04-18T21:10:32.451773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:47:35.613391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'386","reported_seq":578,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547357+0000","last_change":"2024-04-18T21:10:10.547885+0000","last_active":"2024-04-18T21:10:20.547357+0000","last_peered":"2024-04-18T21:10:20.547357+0000","last_clean":"2024-04-18T21:10:20.547357+0000","last_became_active":"2024-04-18T21:10:10.542515+0000","last_became_peered":"2024-04-18T21:10:10.542515+0000","last_unstale":"2024-04-18T21:10:20.547357+0000","last_undegraded":"2024-04-18T21:10:20.547357+0000","last_fullsized":"2024-04-18T21:10:20.547357+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14677,"num_write":355,"num_write_kb":51018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"70'55","reported_seq":258,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.479457+0000","last_change":"2024-04-18T21:09:50.833424+0000","last_active":"2024-04-18T21:10:20.479457+0000","last_peered":"2024-04-18T21:10:20.479457+0000","last_clean":"2024-04-18T21:10:20.479457+0000","last_became_active":"2024-04-18T21:09:50.832752+0000","last_became_peered":"2024-04-18T21:09:50.832752+0000","last_unstale":"2024-04-18T21:10:20.479457+0000","last_undegraded":"2024-04-18T21:10:20.479457+0000","last_fullsized":"2024-04-18T21:10:20.479457+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":166,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.548227+0000","last_change":"2024-04-18T21:09:50.900338+0000","last_active":"2024-04-18T21:10:20.548227+0000","last_peered":"2024-04-18T21:10:20.548227+0000","last_clean":"2024-04-18T21:10:20.548227+0000","last_became_active":"2024-04-18T21:09:50.896844+0000","last_became_peered":"2024-04-18T21:09:50.896844+0000","last_unstale":"2024-04-18T21:10:20.548227+0000","last_undegraded":"2024-04-18T21:10:20.548227+0000","last_fullsized":"2024-04-18T21:10:20.548227+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"71'402","reported_seq":600,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:37.588272+0000","last_change":"2024-04-18T21:10:37.588332+0000","last_active":"2024-04-18T21:10:37.588272+0000","last_peered":"2024-04-18T21:10:37.588272+0000","last_clean":"2024-04-18T21:10:37.588272+0000","last_became_active":"2024-04-18T21:10:05.536763+0000","last_became_peered":"2024-04-18T21:10:05.536763+0000","last_unstale":"2024-04-18T21:10:37.588272+0000","last_undegraded":"2024-04-18T21:10:37.588272+0000","last_fullsized":"2024-04-18T21:10:37.588272+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'402","last_scrub_stamp":"2024-04-18T21:10:37.588074+0000","last_deep_scrub":"71'402","last_deep_scrub_stamp":"2024-04-18T21:10:37.588074+0000","last_clean_scrub_stamp":"2024-04-18T21:10:37.588074+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:48:03.417731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12468,"num_write":369,"num_write_kb":67231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"70'60","reported_seq":264,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.480810+0000","last_change":"2024-04-18T21:09:50.832598+0000","last_active":"2024-04-18T21:10:20.480810+0000","last_peered":"2024-04-18T21:10:20.480810+0000","last_clean":"2024-04-18T21:10:20.480810+0000","last_became_active":"2024-04-18T21:09:50.832030+0000","last_became_peered":"2024-04-18T21:09:50.832030+0000","last_unstale":"2024-04-18T21:10:20.480810+0000","last_undegraded":"2024-04-18T21:10:20.480810+0000","last_fullsized":"2024-04-18T21:10:20.480810+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":136,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.480719+0000","last_change":"2024-04-18T21:10:03.492761+0000","last_active":"2024-04-18T21:10:20.480719+0000","last_peered":"2024-04-18T21:10:20.480719+0000","last_clean":"2024-04-18T21:10:20.480719+0000","last_became_active":"2024-04-18T21:10:03.492145+0000","last_became_peered":"2024-04-18T21:10:03.492145+0000","last_unstale":"2024-04-18T21:10:20.480719+0000","last_undegraded":"2024-04-18T21:10:20.480719+0000","last_fullsized":"2024-04-18T21:10:20.480719+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:04:59.553907+0000","last_clean_scrub_stamp":"2024-04-18T21:04:59.553907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'421","reported_seq":637,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:37.499392+0000","last_change":"2024-04-18T21:10:37.499454+0000","last_active":"2024-04-18T21:10:37.499392+0000","last_peered":"2024-04-18T21:10:37.499392+0000","last_clean":"2024-04-18T21:10:37.499392+0000","last_became_active":"2024-04-18T21:10:03.479773+0000","last_became_peered":"2024-04-18T21:10:03.479773+0000","last_unstale":"2024-04-18T21:10:37.499392+0000","last_undegraded":"2024-04-18T21:10:37.499392+0000","last_fullsized":"2024-04-18T21:10:37.499392+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'421","last_scrub_stamp":"2024-04-18T21:10:37.499184+0000","last_deep_scrub":"71'421","last_deep_scrub_stamp":"2024-04-18T21:10:37.499184+0000","last_clean_scrub_stamp":"2024-04-18T21:10:37.499184+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:55:02.714736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":16183,"num_write":377,"num_write_kb":50451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"108'111","reported_seq":335,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:42.525443+0000","last_change":"2024-04-18T21:10:42.525590+0000","last_active":"2024-04-18T21:10:42.525443+0000","last_peered":"2024-04-18T21:10:42.525443+0000","last_clean":"2024-04-18T21:10:42.525443+0000","last_became_active":"2024-04-18T21:10:00.494644+0000","last_became_peered":"2024-04-18T21:10:00.494644+0000","last_unstale":"2024-04-18T21:10:42.525443+0000","last_undegraded":"2024-04-18T21:10:42.525443+0000","last_fullsized":"2024-04-18T21:10:42.525443+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'111","last_scrub_stamp":"2024-04-18T21:10:42.525221+0000","last_deep_scrub":"108'111","last_deep_scrub_stamp":"2024-04-18T21:10:42.525221+0000","last_clean_scrub_stamp":"2024-04-18T21:10:42.525221+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:55:47.731058+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":1251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":169,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:42.508084+0000","last_change":"2024-04-18T21:10:42.508194+0000","last_active":"2024-04-18T21:10:42.508084+0000","last_peered":"2024-04-18T21:10:42.508084+0000","last_clean":"2024-04-18T21:10:42.508084+0000","last_became_active":"2024-04-18T21:10:00.492672+0000","last_became_peered":"2024-04-18T21:10:00.492672+0000","last_unstale":"2024-04-18T21:10:42.508084+0000","last_undegraded":"2024-04-18T21:10:42.508084+0000","last_fullsized":"2024-04-18T21:10:42.508084+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:10:42.507852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:10:42.507852+0000","last_clean_scrub_stamp":"2024-04-18T21:10:42.507852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:00:25.377497+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'384","reported_seq":598,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546987+0000","last_change":"2024-04-18T21:09:57.572865+0000","last_active":"2024-04-18T21:10:20.546987+0000","last_peered":"2024-04-18T21:10:20.546987+0000","last_clean":"2024-04-18T21:10:20.546987+0000","last_became_active":"2024-04-18T21:09:57.567962+0000","last_became_peered":"2024-04-18T21:09:57.567962+0000","last_unstale":"2024-04-18T21:10:20.546987+0000","last_undegraded":"2024-04-18T21:10:20.546987+0000","last_fullsized":"2024-04-18T21:10:20.546987+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":15567,"num_write":351,"num_write_kb":42959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"71'396","reported_seq":925,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483639+0000","last_change":"2024-04-18T21:10:13.482151+0000","last_active":"2024-04-18T21:10:20.483639+0000","last_peered":"2024-04-18T21:10:20.483639+0000","last_clean":"2024-04-18T21:10:20.483639+0000","last_became_active":"2024-04-18T21:10:13.479320+0000","last_became_peered":"2024-04-18T21:10:13.479320+0000","last_unstale":"2024-04-18T21:10:20.483639+0000","last_undegraded":"2024-04-18T21:10:20.483639+0000","last_fullsized":"2024-04-18T21:10:20.483639+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12943,"num_write":353,"num_write_kb":35357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":342,"num_bytes_recovered":3500882,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"108'282","reported_seq":332,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:46.468674+0000","last_change":"2024-04-18T21:10:46.468762+0000","last_active":"2024-04-18T21:10:46.468674+0000","last_peered":"2024-04-18T21:10:46.468674+0000","last_clean":"2024-04-18T21:10:46.468674+0000","last_became_active":"2024-04-18T21:10:00.493088+0000","last_became_peered":"2024-04-18T21:10:00.493088+0000","last_unstale":"2024-04-18T21:10:46.468674+0000","last_undegraded":"2024-04-18T21:10:46.468674+0000","last_fullsized":"2024-04-18T21:10:46.468674+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'282","last_scrub_stamp":"2024-04-18T21:10:46.468484+0000","last_deep_scrub":"108'282","last_deep_scrub_stamp":"2024-04-18T21:10:46.468484+0000","last_clean_scrub_stamp":"2024-04-18T21:10:46.468484+0000","objects_scrubbed":5,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:54.785029+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":221,"num_write_kb":8303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":8389370,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'411","reported_seq":1016,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:30.429216+0000","last_change":"2024-04-18T21:10:30.429275+0000","last_active":"2024-04-18T21:10:30.429216+0000","last_peered":"2024-04-18T21:10:30.429216+0000","last_clean":"2024-04-18T21:10:30.429216+0000","last_became_active":"2024-04-18T21:10:04.482320+0000","last_became_peered":"2024-04-18T21:10:04.482320+0000","last_unstale":"2024-04-18T21:10:30.429216+0000","last_undegraded":"2024-04-18T21:10:30.429216+0000","last_fullsized":"2024-04-18T21:10:30.429216+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'411","last_scrub_stamp":"2024-04-18T21:10:30.429014+0000","last_deep_scrub":"71'411","last_deep_scrub_stamp":"2024-04-18T21:10:30.429014+0000","last_clean_scrub_stamp":"2024-04-18T21:10:30.429014+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:57:04.593176+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":17179,"num_write":375,"num_write_kb":38991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"70'85","reported_seq":169,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547937+0000","last_change":"2024-04-18T21:09:50.890616+0000","last_active":"2024-04-18T21:10:20.547937+0000","last_peered":"2024-04-18T21:10:20.547937+0000","last_clean":"2024-04-18T21:10:20.547937+0000","last_became_active":"2024-04-18T21:09:50.874855+0000","last_became_peered":"2024-04-18T21:09:50.874855+0000","last_unstale":"2024-04-18T21:10:20.547937+0000","last_undegraded":"2024-04-18T21:10:20.547937+0000","last_fullsized":"2024-04-18T21:10:20.547937+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"108'231","reported_seq":269,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:33.533141+0000","last_change":"2024-04-18T21:10:33.533202+0000","last_active":"2024-04-18T21:10:33.533141+0000","last_peered":"2024-04-18T21:10:33.533141+0000","last_clean":"2024-04-18T21:10:33.533141+0000","last_became_active":"2024-04-18T21:10:00.498141+0000","last_became_peered":"2024-04-18T21:10:00.498141+0000","last_unstale":"2024-04-18T21:10:33.533141+0000","last_undegraded":"2024-04-18T21:10:33.533141+0000","last_fullsized":"2024-04-18T21:10:33.533141+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'231","last_scrub_stamp":"2024-04-18T21:10:33.532968+0000","last_deep_scrub":"108'231","last_deep_scrub_stamp":"2024-04-18T21:10:33.532968+0000","last_clean_scrub_stamp":"2024-04-18T21:10:33.532968+0000","objects_scrubbed":1,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:16:20.375244+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":4178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"71'493","reported_seq":733,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.477955+0000","last_change":"2024-04-18T21:05:05.642793+0000","last_active":"2024-04-18T21:10:20.477955+0000","last_peered":"2024-04-18T21:10:20.477955+0000","last_clean":"2024-04-18T21:10:20.477955+0000","last_became_active":"2024-04-18T21:05:05.641983+0000","last_became_peered":"2024-04-18T21:05:05.641983+0000","last_unstale":"2024-04-18T21:10:20.477955+0000","last_undegraded":"2024-04-18T21:10:20.477955+0000","last_fullsized":"2024-04-18T21:10:20.477955+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23833,"num_write":461,"num_write_kb":76873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"70'62","reported_seq":266,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:47.555859+0000","last_change":"2024-04-18T21:10:47.555993+0000","last_active":"2024-04-18T21:10:47.555859+0000","last_peered":"2024-04-18T21:10:47.555859+0000","last_clean":"2024-04-18T21:10:47.555859+0000","last_became_active":"2024-04-18T21:05:04.640682+0000","last_became_peered":"2024-04-18T21:05:04.640682+0000","last_unstale":"2024-04-18T21:10:47.555859+0000","last_undegraded":"2024-04-18T21:10:47.555859+0000","last_fullsized":"2024-04-18T21:10:47.555859+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'62","last_scrub_stamp":"2024-04-18T21:10:47.555640+0000","last_deep_scrub":"70'62","last_deep_scrub_stamp":"2024-04-18T21:10:47.555640+0000","last_clean_scrub_stamp":"2024-04-18T21:10:47.555640+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:23:56.871085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'436","reported_seq":1064,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.479036+0000","last_change":"2024-04-18T21:10:18.490900+0000","last_active":"2024-04-18T21:10:20.479036+0000","last_peered":"2024-04-18T21:10:20.479036+0000","last_clean":"2024-04-18T21:10:20.479036+0000","last_became_active":"2024-04-18T21:10:18.487788+0000","last_became_peered":"2024-04-18T21:10:18.487788+0000","last_unstale":"2024-04-18T21:10:20.479036+0000","last_undegraded":"2024-04-18T21:10:20.479036+0000","last_fullsized":"2024-04-18T21:10:20.479036+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14561,"num_write":408,"num_write_kb":47462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'369","reported_seq":580,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:31.654504+0000","last_change":"2024-04-18T21:10:31.654562+0000","last_active":"2024-04-18T21:10:31.654504+0000","last_peered":"2024-04-18T21:10:31.654504+0000","last_clean":"2024-04-18T21:10:31.654504+0000","last_became_active":"2024-04-18T21:10:02.549471+0000","last_became_peered":"2024-04-18T21:10:02.549471+0000","last_unstale":"2024-04-18T21:10:31.654504+0000","last_undegraded":"2024-04-18T21:10:31.654504+0000","last_fullsized":"2024-04-18T21:10:31.654504+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'369","last_scrub_stamp":"2024-04-18T21:10:31.654287+0000","last_deep_scrub":"71'369","last_deep_scrub_stamp":"2024-04-18T21:10:31.654287+0000","last_clean_scrub_stamp":"2024-04-18T21:10:31.654287+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:16:49.779174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13619,"num_write":339,"num_write_kb":63086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"108'890","reported_seq":1041,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:31.491964+0000","last_change":"2024-04-18T21:10:31.492036+0000","last_active":"2024-04-18T21:10:31.491964+0000","last_peered":"2024-04-18T21:10:31.491964+0000","last_clean":"2024-04-18T21:10:31.491964+0000","last_became_active":"2024-04-18T21:10:03.480576+0000","last_became_peered":"2024-04-18T21:10:03.480576+0000","last_unstale":"2024-04-18T21:10:31.491964+0000","last_undegraded":"2024-04-18T21:10:31.491964+0000","last_fullsized":"2024-04-18T21:10:31.491964+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'890","last_scrub_stamp":"2024-04-18T21:10:31.491761+0000","last_deep_scrub":"108'890","last_deep_scrub_stamp":"2024-04-18T21:10:31.491761+0000","last_clean_scrub_stamp":"2024-04-18T21:10:31.491761+0000","objects_scrubbed":2,"log_size":890,"log_dups_size":0,"ondisk_log_size":890,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:42:36.359076+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":823,"num_write_kb":8582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'398","reported_seq":571,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:43.534709+0000","last_change":"2024-04-18T21:10:43.534842+0000","last_active":"2024-04-18T21:10:43.534709+0000","last_peered":"2024-04-18T21:10:43.534709+0000","last_clean":"2024-04-18T21:10:43.534709+0000","last_became_active":"2024-04-18T21:10:03.483190+0000","last_became_peered":"2024-04-18T21:10:03.483190+0000","last_unstale":"2024-04-18T21:10:43.534709+0000","last_undegraded":"2024-04-18T21:10:43.534709+0000","last_fullsized":"2024-04-18T21:10:43.534709+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'398","last_scrub_stamp":"2024-04-18T21:10:43.534459+0000","last_deep_scrub":"71'398","last_deep_scrub_stamp":"2024-04-18T21:10:43.534459+0000","last_clean_scrub_stamp":"2024-04-18T21:10:43.534459+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:28:54.469077+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14684,"num_write":380,"num_write_kb":88822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"108'170","reported_seq":394,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:44.551586+0000","last_change":"2024-04-18T21:10:44.551659+0000","last_active":"2024-04-18T21:10:44.551586+0000","last_peered":"2024-04-18T21:10:44.551586+0000","last_clean":"2024-04-18T21:10:44.551586+0000","last_became_active":"2024-04-18T21:10:00.492196+0000","last_became_peered":"2024-04-18T21:10:00.492196+0000","last_unstale":"2024-04-18T21:10:44.551586+0000","last_undegraded":"2024-04-18T21:10:44.551586+0000","last_fullsized":"2024-04-18T21:10:44.551586+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'170","last_scrub_stamp":"2024-04-18T21:10:44.551394+0000","last_deep_scrub":"108'170","last_deep_scrub_stamp":"2024-04-18T21:10:44.551394+0000","last_clean_scrub_stamp":"2024-04-18T21:10:44.551394+0000","objects_scrubbed":1,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:01:00.353327+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":4162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'406","reported_seq":631,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546433+0000","last_change":"2024-04-18T21:10:12.553754+0000","last_active":"2024-04-18T21:10:20.546433+0000","last_peered":"2024-04-18T21:10:20.546433+0000","last_clean":"2024-04-18T21:10:20.546433+0000","last_became_active":"2024-04-18T21:10:12.546148+0000","last_became_peered":"2024-04-18T21:10:12.546148+0000","last_unstale":"2024-04-18T21:10:20.546433+0000","last_undegraded":"2024-04-18T21:10:20.546433+0000","last_fullsized":"2024-04-18T21:10:20.546433+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27495,"num_write":363,"num_write_kb":89134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"72'192","reported_seq":386,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546515+0000","last_change":"2024-04-18T21:09:53.541766+0000","last_active":"2024-04-18T21:10:20.546515+0000","last_peered":"2024-04-18T21:10:20.546515+0000","last_clean":"2024-04-18T21:10:20.546515+0000","last_became_active":"2024-04-18T21:09:53.541300+0000","last_became_peered":"2024-04-18T21:09:53.541300+0000","last_unstale":"2024-04-18T21:10:20.546515+0000","last_undegraded":"2024-04-18T21:10:20.546515+0000","last_fullsized":"2024-04-18T21:10:20.546515+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12425030,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":12201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8230726,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"71'383","reported_seq":618,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547726+0000","last_change":"2024-04-18T21:09:55.555798+0000","last_active":"2024-04-18T21:10:20.547726+0000","last_peered":"2024-04-18T21:10:20.547726+0000","last_clean":"2024-04-18T21:10:20.547726+0000","last_became_active":"2024-04-18T21:09:55.551135+0000","last_became_peered":"2024-04-18T21:09:55.551135+0000","last_unstale":"2024-04-18T21:10:20.547726+0000","last_undegraded":"2024-04-18T21:10:20.547726+0000","last_fullsized":"2024-04-18T21:10:20.547726+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21614,"num_write":351,"num_write_kb":79501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"108'67","reported_seq":169,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:40.597558+0000","last_change":"2024-04-18T21:10:40.597631+0000","last_active":"2024-04-18T21:10:40.597558+0000","last_peered":"2024-04-18T21:10:40.597558+0000","last_clean":"2024-04-18T21:10:40.597558+0000","last_became_active":"2024-04-18T21:10:00.552067+0000","last_became_peered":"2024-04-18T21:10:00.552067+0000","last_unstale":"2024-04-18T21:10:40.597558+0000","last_undegraded":"2024-04-18T21:10:40.597558+0000","last_fullsized":"2024-04-18T21:10:40.597558+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'67","last_scrub_stamp":"2024-04-18T21:10:40.597370+0000","last_deep_scrub":"108'67","last_deep_scrub_stamp":"2024-04-18T21:10:40.597370+0000","last_clean_scrub_stamp":"2024-04-18T21:10:40.597370+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:15:48.004532+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"71'345","reported_seq":547,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483363+0000","last_change":"2024-04-18T21:05:05.624840+0000","last_active":"2024-04-18T21:10:20.483363+0000","last_peered":"2024-04-18T21:10:20.483363+0000","last_clean":"2024-04-18T21:10:20.483363+0000","last_became_active":"2024-04-18T21:05:05.622950+0000","last_became_peered":"2024-04-18T21:05:05.622950+0000","last_unstale":"2024-04-18T21:10:20.483363+0000","last_undegraded":"2024-04-18T21:10:20.483363+0000","last_fullsized":"2024-04-18T21:10:20.483363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":317,"num_write_kb":29335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"108'173","reported_seq":297,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:30.553140+0000","last_change":"2024-04-18T21:10:30.553214+0000","last_active":"2024-04-18T21:10:30.553140+0000","last_peered":"2024-04-18T21:10:30.553140+0000","last_clean":"2024-04-18T21:10:30.553140+0000","last_became_active":"2024-04-18T21:10:00.507132+0000","last_became_peered":"2024-04-18T21:10:00.507132+0000","last_unstale":"2024-04-18T21:10:30.553140+0000","last_undegraded":"2024-04-18T21:10:30.553140+0000","last_fullsized":"2024-04-18T21:10:30.553140+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'173","last_scrub_stamp":"2024-04-18T21:10:30.552952+0000","last_deep_scrub":"108'173","last_deep_scrub_stamp":"2024-04-18T21:10:30.552952+0000","last_clean_scrub_stamp":"2024-04-18T21:10:30.552952+0000","objects_scrubbed":2,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:57:31.144534+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":4154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"71'417","reported_seq":644,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.483288+0000","last_change":"2024-04-18T21:05:05.627962+0000","last_active":"2024-04-18T21:10:20.483288+0000","last_peered":"2024-04-18T21:10:20.483288+0000","last_clean":"2024-04-18T21:10:20.483288+0000","last_became_active":"2024-04-18T21:05:05.626698+0000","last_became_peered":"2024-04-18T21:05:05.626698+0000","last_unstale":"2024-04-18T21:10:20.483288+0000","last_undegraded":"2024-04-18T21:10:20.483288+0000","last_fullsized":"2024-04-18T21:10:20.483288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":17040,"num_write":384,"num_write_kb":83740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"70'276","reported_seq":472,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.547373+0000","last_change":"2024-04-18T21:09:53.543611+0000","last_active":"2024-04-18T21:10:20.547373+0000","last_peered":"2024-04-18T21:10:20.547373+0000","last_clean":"2024-04-18T21:10:20.547373+0000","last_became_active":"2024-04-18T21:09:53.542863+0000","last_became_peered":"2024-04-18T21:09:53.542863+0000","last_unstale":"2024-04-18T21:10:20.547373+0000","last_undegraded":"2024-04-18T21:10:20.547373+0000","last_fullsized":"2024-04-18T21:10:20.547373+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":12399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"71'428","reported_seq":638,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.546424+0000","last_change":"2024-04-18T21:10:08.541152+0000","last_active":"2024-04-18T21:10:20.546424+0000","last_peered":"2024-04-18T21:10:20.546424+0000","last_clean":"2024-04-18T21:10:20.546424+0000","last_became_active":"2024-04-18T21:10:08.536423+0000","last_became_peered":"2024-04-18T21:10:08.536423+0000","last_unstale":"2024-04-18T21:10:20.546424+0000","last_undegraded":"2024-04-18T21:10:20.546424+0000","last_fullsized":"2024-04-18T21:10:20.546424+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22548,"num_write":398,"num_write_kb":75972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"70'70","reported_seq":274,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.480416+0000","last_change":"2024-04-18T21:09:50.833350+0000","last_active":"2024-04-18T21:10:20.480416+0000","last_peered":"2024-04-18T21:10:20.480416+0000","last_clean":"2024-04-18T21:10:20.480416+0000","last_became_active":"2024-04-18T21:09:50.832355+0000","last_became_peered":"2024-04-18T21:09:50.832355+0000","last_unstale":"2024-04-18T21:10:20.480416+0000","last_undegraded":"2024-04-18T21:10:20.480416+0000","last_fullsized":"2024-04-18T21:10:20.480416+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:03.580897+0000","last_clean_scrub_stamp":"2024-04-18T21:05:03.580897+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'459","reported_seq":643,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:20.482786+0000","last_change":"2024-04-18T21:10:01.503378+0000","last_active":"2024-04-18T21:10:20.482786+0000","last_peered":"2024-04-18T21:10:20.482786+0000","last_clean":"2024-04-18T21:10:20.482786+0000","last_became_active":"2024-04-18T21:10:01.497275+0000","last_became_peered":"2024-04-18T21:10:01.497275+0000","last_unstale":"2024-04-18T21:10:20.482786+0000","last_undegraded":"2024-04-18T21:10:20.482786+0000","last_fullsized":"2024-04-18T21:10:20.482786+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:05:04.592854+0000","last_clean_scrub_stamp":"2024-04-18T21:05:04.592854+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13353,"num_write":429,"num_write_kb":88123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"108'116","reported_seq":344,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:40.518272+0000","last_change":"2024-04-18T21:10:40.518341+0000","last_active":"2024-04-18T21:10:40.518272+0000","last_peered":"2024-04-18T21:10:40.518272+0000","last_clean":"2024-04-18T21:10:40.518272+0000","last_became_active":"2024-04-18T21:10:00.494734+0000","last_became_peered":"2024-04-18T21:10:00.494734+0000","last_unstale":"2024-04-18T21:10:40.518272+0000","last_undegraded":"2024-04-18T21:10:40.518272+0000","last_fullsized":"2024-04-18T21:10:40.518272+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'116","last_scrub_stamp":"2024-04-18T21:10:40.518067+0000","last_deep_scrub":"108'116","last_deep_scrub_stamp":"2024-04-18T21:10:40.518067+0000","last_clean_scrub_stamp":"2024-04-18T21:10:40.518067+0000","objects_scrubbed":3,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:48:47.813001+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194886,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2531,"num_read_kb":1304649,"num_write":24542,"num_write_kb":4299443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8145,"num_bytes_recovered":4488063,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26603,"ondisk_log_size":26603,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127139127,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":55,"num_read_kb":1405,"num_write":4542,"num_write_kb":127514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":92002768,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254345216,"data_stored":254278254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4409,"internal_metadata":0},"log_size":6360,"ondisk_log_size":6360,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738444,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":187616,"kb_used_data":80152,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94184224,"statfs":{"total":96636764160,"available":96444645376,"internally_reserved":0,"allocated":82075648,"data_stored":81480582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110033349},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":77,"seq":330712481805,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":147284,"kb_used_data":83404,"kb_used_omap":5,"kb_used_meta":63866,"kb_avail":94224556,"statfs":{"total":96636764160,"available":96485945344,"internally_reserved":0,"allocated":85405696,"data_stored":84799073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6004,"internal_metadata":65398924},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738442,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":160464,"kb_used_data":89096,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94211376,"statfs":{"total":96636764160,"available":96472449024,"internally_reserved":0,"allocated":91234304,"data_stored":90618294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":89579520,"data_stored":89548273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":83750912,"data_stored":83729052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4409,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81014784,"data_stored":81000929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:10:50.049 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:50.050 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:50.050 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:50.050 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:50.050 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:50.050 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:50.050 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:50.050 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:50.050 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:50.051 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:50.051 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:50.051 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:50.051 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:50.051 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:50.051 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:50.051 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-18T21:05:03.580897+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=3, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:50.051 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:50.052 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-18T21:05:03.580897+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=3, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:50.052 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-18T21:05:03.580897+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=3, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:50.052 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:50.052 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-18T21:05:03.580897+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=3, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:50.052 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:50.052 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:50.052 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-18T21:05:03.580897+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=3, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:50.052 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:50.052 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-18T21:05:03.580897+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=3, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:50.053 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:50.053 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-18T21:04:53.494814+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=4, tm_sec=53, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:50.053 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-18T21:04:59.553907+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=4, tm_sec=59, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:50.053 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-18T21:05:03.580897+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=3, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:50.053 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:50.053 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-18T21:04:59.553907+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=4, tm_sec=59, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:50.054 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-18T21:05:03.580897+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=3, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:50.054 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:50.054 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-18T21:05:03.580897+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=3, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:50.054 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-18T21:04:59.553907+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=4, tm_sec=59, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:50.054 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-18T21:05:03.580897+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=3, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:50.054 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-18T21:04:59.553907+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=4, tm_sec=59, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:50.054 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:50.054 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:50.055 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-18T21:05:03.580897+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=3, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:50.055 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:50.055 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:50.055 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:50.055 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-18T21:05:03.580897+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=3, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:50.055 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:50.055 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:50.055 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:50.056 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-18T21:05:03.580897+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=3, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:50.056 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:50.056 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-18T21:05:03.580897+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=3, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:50.056 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-18T21:05:04.592854+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=5, tm_sec=4, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=21, tm_min=10, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T21:10:50.056 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-18T21:11:10.057 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T21:11:10.382 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:11:10.384 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-04-18T21:11:10.402 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":294,"stamp":"2024-04-18T21:11:08.659498+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127729495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2722,"num_read_kb":1306172,"num_write":29287,"num_write_kb":4430417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8182,"num_bytes_recovered":97081199,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33145,"ondisk_log_size":33145,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":478724,"kb_used_data":252652,"kb_used_omap":8,"kb_used_meta":226039,"kb_avail":282636796,"statfs":{"total":289910292480,"available":289420079104,"internally_reserved":0,"allocated":258715648,"data_stored":256897949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9194,"internal_metadata":231463958},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004142"},"pg_stats":[{"pgid":"4.3f","version":"71'418","reported_seq":623,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:11:00.489226+0000","last_change":"2024-04-18T21:11:00.489288+0000","last_active":"2024-04-18T21:11:00.489226+0000","last_peered":"2024-04-18T21:11:00.489226+0000","last_clean":"2024-04-18T21:11:00.489226+0000","last_became_active":"2024-04-18T21:10:16.571985+0000","last_became_peered":"2024-04-18T21:10:16.571985+0000","last_unstale":"2024-04-18T21:11:00.489226+0000","last_undegraded":"2024-04-18T21:11:00.489226+0000","last_fullsized":"2024-04-18T21:11:00.489226+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'418","last_scrub_stamp":"2024-04-18T21:11:00.489029+0000","last_deep_scrub":"71'418","last_deep_scrub_stamp":"2024-04-18T21:11:00.489029+0000","last_clean_scrub_stamp":"2024-04-18T21:11:00.489029+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:26:07.913556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":19677,"num_write":386,"num_write_kb":87615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"71'417","reported_seq":640,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:39.579914+0000","last_change":"2024-04-18T21:10:39.579977+0000","last_active":"2024-04-18T21:10:39.579914+0000","last_peered":"2024-04-18T21:10:39.579914+0000","last_clean":"2024-04-18T21:10:39.579914+0000","last_became_active":"2024-04-18T21:10:05.541170+0000","last_became_peered":"2024-04-18T21:10:05.541170+0000","last_unstale":"2024-04-18T21:10:39.579914+0000","last_undegraded":"2024-04-18T21:10:39.579914+0000","last_fullsized":"2024-04-18T21:10:39.579914+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'417","last_scrub_stamp":"2024-04-18T21:10:39.579723+0000","last_deep_scrub":"71'417","last_deep_scrub_stamp":"2024-04-18T21:10:39.579723+0000","last_clean_scrub_stamp":"2024-04-18T21:10:39.579723+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:18:49.950190+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":12123,"num_write":387,"num_write_kb":47157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"71'379","reported_seq":949,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:39.471567+0000","last_change":"2024-04-18T21:10:39.471632+0000","last_active":"2024-04-18T21:10:39.471567+0000","last_peered":"2024-04-18T21:10:39.471567+0000","last_clean":"2024-04-18T21:10:39.471567+0000","last_became_active":"2024-04-18T21:09:54.478020+0000","last_became_peered":"2024-04-18T21:09:54.478020+0000","last_unstale":"2024-04-18T21:10:39.471567+0000","last_undegraded":"2024-04-18T21:10:39.471567+0000","last_fullsized":"2024-04-18T21:10:39.471567+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'379","last_scrub_stamp":"2024-04-18T21:10:39.471370+0000","last_deep_scrub":"71'379","last_deep_scrub_stamp":"2024-04-18T21:10:39.471370+0000","last_clean_scrub_stamp":"2024-04-18T21:10:39.471370+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:02:25.844614+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":10040,"num_write":353,"num_write_kb":63202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'372","reported_seq":584,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:49.420893+0000","last_change":"2024-04-18T21:10:49.420893+0000","last_active":"2024-04-18T21:10:49.420893+0000","last_peered":"2024-04-18T21:10:49.420893+0000","last_clean":"2024-04-18T21:10:49.420893+0000","last_became_active":"2024-04-18T21:05:05.627956+0000","last_became_peered":"2024-04-18T21:05:05.627956+0000","last_unstale":"2024-04-18T21:10:49.420893+0000","last_undegraded":"2024-04-18T21:10:49.420893+0000","last_fullsized":"2024-04-18T21:10:49.420893+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'372","last_scrub_stamp":"2024-04-18T21:10:49.420633+0000","last_deep_scrub":"71'372","last_deep_scrub_stamp":"2024-04-18T21:10:49.420633+0000","last_clean_scrub_stamp":"2024-04-18T21:10:49.420633+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:31:21.006500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2735,"num_write":328,"num_write_kb":22107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"71'416","reported_seq":625,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:34.578130+0000","last_change":"2024-04-18T21:10:34.578187+0000","last_active":"2024-04-18T21:10:34.578130+0000","last_peered":"2024-04-18T21:10:34.578130+0000","last_clean":"2024-04-18T21:10:34.578130+0000","last_became_active":"2024-04-18T21:10:00.553862+0000","last_became_peered":"2024-04-18T21:10:00.553862+0000","last_unstale":"2024-04-18T21:10:34.578130+0000","last_undegraded":"2024-04-18T21:10:34.578130+0000","last_fullsized":"2024-04-18T21:10:34.578130+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'416","last_scrub_stamp":"2024-04-18T21:10:34.577938+0000","last_deep_scrub":"71'416","last_deep_scrub_stamp":"2024-04-18T21:10:34.577938+0000","last_clean_scrub_stamp":"2024-04-18T21:10:34.577938+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:43:54.240250+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6533,"num_write":389,"num_write_kb":43666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"71'374","reported_seq":583,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:29.492761+0000","last_change":"2024-04-18T21:10:29.492876+0000","last_active":"2024-04-18T21:10:29.492761+0000","last_peered":"2024-04-18T21:10:29.492761+0000","last_clean":"2024-04-18T21:10:29.492761+0000","last_became_active":"2024-04-18T21:10:01.486640+0000","last_became_peered":"2024-04-18T21:10:01.486640+0000","last_unstale":"2024-04-18T21:10:29.492761+0000","last_undegraded":"2024-04-18T21:10:29.492761+0000","last_fullsized":"2024-04-18T21:10:29.492761+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'374","last_scrub_stamp":"2024-04-18T21:10:29.492531+0000","last_deep_scrub":"71'374","last_deep_scrub_stamp":"2024-04-18T21:10:29.492531+0000","last_clean_scrub_stamp":"2024-04-18T21:10:29.492531+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:28:07.494881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20415,"num_write":354,"num_write_kb":34462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'418","reported_seq":661,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:56.461925+0000","last_change":"2024-04-18T21:10:56.461990+0000","last_active":"2024-04-18T21:10:56.461925+0000","last_peered":"2024-04-18T21:10:56.461925+0000","last_clean":"2024-04-18T21:10:56.461925+0000","last_became_active":"2024-04-18T21:05:05.622781+0000","last_became_peered":"2024-04-18T21:05:05.622781+0000","last_unstale":"2024-04-18T21:10:56.461925+0000","last_undegraded":"2024-04-18T21:10:56.461925+0000","last_fullsized":"2024-04-18T21:10:56.461925+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'418","last_scrub_stamp":"2024-04-18T21:10:56.461733+0000","last_deep_scrub":"71'418","last_deep_scrub_stamp":"2024-04-18T21:10:56.461733+0000","last_clean_scrub_stamp":"2024-04-18T21:10:56.461733+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:32:55.605920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21103,"num_write":385,"num_write_kb":50678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"71'399","reported_seq":647,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:44.421079+0000","last_change":"2024-04-18T21:10:44.421141+0000","last_active":"2024-04-18T21:10:44.421079+0000","last_peered":"2024-04-18T21:10:44.421079+0000","last_clean":"2024-04-18T21:10:44.421079+0000","last_became_active":"2024-04-18T21:10:00.488705+0000","last_became_peered":"2024-04-18T21:10:00.488705+0000","last_unstale":"2024-04-18T21:10:44.421079+0000","last_undegraded":"2024-04-18T21:10:44.421079+0000","last_fullsized":"2024-04-18T21:10:44.421079+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'399","last_scrub_stamp":"2024-04-18T21:10:44.420891+0000","last_deep_scrub":"71'399","last_deep_scrub_stamp":"2024-04-18T21:10:44.420891+0000","last_clean_scrub_stamp":"2024-04-18T21:10:44.420891+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:01:54.592149+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":44692,"num_write":361,"num_write_kb":105170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"71'385","reported_seq":959,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:56.523859+0000","last_change":"2024-04-18T21:10:56.523918+0000","last_active":"2024-04-18T21:10:56.523859+0000","last_peered":"2024-04-18T21:10:56.523859+0000","last_clean":"2024-04-18T21:10:56.523859+0000","last_became_active":"2024-04-18T21:10:06.482087+0000","last_became_peered":"2024-04-18T21:10:06.482087+0000","last_unstale":"2024-04-18T21:10:56.523859+0000","last_undegraded":"2024-04-18T21:10:56.523859+0000","last_fullsized":"2024-04-18T21:10:56.523859+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'385","last_scrub_stamp":"2024-04-18T21:10:56.523667+0000","last_deep_scrub":"71'385","last_deep_scrub_stamp":"2024-04-18T21:10:56.523667+0000","last_clean_scrub_stamp":"2024-04-18T21:10:56.523667+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:13:51.792969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":994,"num_write":358,"num_write_kb":25964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'409","reported_seq":653,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:57.563436+0000","last_change":"2024-04-18T21:10:57.563496+0000","last_active":"2024-04-18T21:10:57.563436+0000","last_peered":"2024-04-18T21:10:57.563436+0000","last_clean":"2024-04-18T21:10:57.563436+0000","last_became_active":"2024-04-18T21:10:12.546621+0000","last_became_peered":"2024-04-18T21:10:12.546621+0000","last_unstale":"2024-04-18T21:10:57.563436+0000","last_undegraded":"2024-04-18T21:10:57.563436+0000","last_fullsized":"2024-04-18T21:10:57.563436+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'409","last_scrub_stamp":"2024-04-18T21:10:57.563238+0000","last_deep_scrub":"71'409","last_deep_scrub_stamp":"2024-04-18T21:10:57.563238+0000","last_clean_scrub_stamp":"2024-04-18T21:10:57.563238+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:29:34.022777+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":26170,"num_write":372,"num_write_kb":83931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"71'366","reported_seq":586,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:28.529191+0000","last_change":"2024-04-18T21:10:28.529255+0000","last_active":"2024-04-18T21:10:28.529191+0000","last_peered":"2024-04-18T21:10:28.529191+0000","last_clean":"2024-04-18T21:10:28.529191+0000","last_became_active":"2024-04-18T21:10:01.488047+0000","last_became_peered":"2024-04-18T21:10:01.488047+0000","last_unstale":"2024-04-18T21:10:28.529191+0000","last_undegraded":"2024-04-18T21:10:28.529191+0000","last_fullsized":"2024-04-18T21:10:28.529191+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'366","last_scrub_stamp":"2024-04-18T21:10:28.528999+0000","last_deep_scrub":"71'366","last_deep_scrub_stamp":"2024-04-18T21:10:28.528999+0000","last_clean_scrub_stamp":"2024-04-18T21:10:28.528999+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:55:59.232131+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":18907,"num_write":347,"num_write_kb":26153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"71'346","reported_seq":558,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:36.568825+0000","last_change":"2024-04-18T21:10:36.568890+0000","last_active":"2024-04-18T21:10:36.568825+0000","last_peered":"2024-04-18T21:10:36.568825+0000","last_clean":"2024-04-18T21:10:36.568825+0000","last_became_active":"2024-04-18T21:10:00.557412+0000","last_became_peered":"2024-04-18T21:10:00.557412+0000","last_unstale":"2024-04-18T21:10:36.568825+0000","last_undegraded":"2024-04-18T21:10:36.568825+0000","last_fullsized":"2024-04-18T21:10:36.568825+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'346","last_scrub_stamp":"2024-04-18T21:10:36.568625+0000","last_deep_scrub":"71'346","last_deep_scrub_stamp":"2024-04-18T21:10:36.568625+0000","last_clean_scrub_stamp":"2024-04-18T21:10:36.568625+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:47:39.400310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":6245,"num_write":324,"num_write_kb":37970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"71'417","reported_seq":647,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:33.619809+0000","last_change":"2024-04-18T21:10:33.619928+0000","last_active":"2024-04-18T21:10:33.619809+0000","last_peered":"2024-04-18T21:10:33.619809+0000","last_clean":"2024-04-18T21:10:33.619809+0000","last_became_active":"2024-04-18T21:10:02.551406+0000","last_became_peered":"2024-04-18T21:10:02.551406+0000","last_unstale":"2024-04-18T21:10:33.619809+0000","last_undegraded":"2024-04-18T21:10:33.619809+0000","last_fullsized":"2024-04-18T21:10:33.619809+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'417","last_scrub_stamp":"2024-04-18T21:10:33.619581+0000","last_deep_scrub":"71'417","last_deep_scrub_stamp":"2024-04-18T21:10:33.619581+0000","last_clean_scrub_stamp":"2024-04-18T21:10:33.619581+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:32:33.242827+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":21623,"num_write":381,"num_write_kb":71306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"71'398","reported_seq":986,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:11:02.420340+0000","last_change":"2024-04-18T21:11:02.420398+0000","last_active":"2024-04-18T21:11:02.420340+0000","last_peered":"2024-04-18T21:11:02.420340+0000","last_clean":"2024-04-18T21:11:02.420340+0000","last_became_active":"2024-04-18T21:10:11.486593+0000","last_became_peered":"2024-04-18T21:10:11.486593+0000","last_unstale":"2024-04-18T21:11:02.420340+0000","last_undegraded":"2024-04-18T21:11:02.420340+0000","last_fullsized":"2024-04-18T21:11:02.420340+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'398","last_scrub_stamp":"2024-04-18T21:11:02.420138+0000","last_deep_scrub":"71'398","last_deep_scrub_stamp":"2024-04-18T21:11:02.420138+0000","last_clean_scrub_stamp":"2024-04-18T21:11:02.420138+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:48:55.469660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":369,"num_write_kb":30006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'435","reported_seq":1111,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:11:05.437715+0000","last_change":"2024-04-18T21:11:05.437775+0000","last_active":"2024-04-18T21:11:05.437715+0000","last_peered":"2024-04-18T21:11:05.437715+0000","last_clean":"2024-04-18T21:11:05.437715+0000","last_became_active":"2024-04-18T21:10:15.506328+0000","last_became_peered":"2024-04-18T21:10:15.506328+0000","last_unstale":"2024-04-18T21:11:05.437715+0000","last_undegraded":"2024-04-18T21:11:05.437715+0000","last_fullsized":"2024-04-18T21:11:05.437715+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'435","last_scrub_stamp":"2024-04-18T21:11:05.437520+0000","last_deep_scrub":"71'435","last_deep_scrub_stamp":"2024-04-18T21:11:05.437520+0000","last_clean_scrub_stamp":"2024-04-18T21:11:05.437520+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:58:42.552432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":31523,"num_write":402,"num_write_kb":121466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":346,"num_bytes_recovered":410327,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'446","reported_seq":696,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:47.428251+0000","last_change":"2024-04-18T21:10:47.428309+0000","last_active":"2024-04-18T21:10:47.428251+0000","last_peered":"2024-04-18T21:10:47.428251+0000","last_clean":"2024-04-18T21:10:47.428251+0000","last_became_active":"2024-04-18T21:05:05.637352+0000","last_became_peered":"2024-04-18T21:05:05.637352+0000","last_unstale":"2024-04-18T21:10:47.428251+0000","last_undegraded":"2024-04-18T21:10:47.428251+0000","last_fullsized":"2024-04-18T21:10:47.428251+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'446","last_scrub_stamp":"2024-04-18T21:10:47.428048+0000","last_deep_scrub":"71'446","last_deep_scrub_stamp":"2024-04-18T21:10:47.428048+0000","last_clean_scrub_stamp":"2024-04-18T21:10:47.428048+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:45:45.058681+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":23833,"num_write":418,"num_write_kb":59679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"71'403","reported_seq":965,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:11:02.586064+0000","last_change":"2024-04-18T21:11:02.586133+0000","last_active":"2024-04-18T21:11:02.586064+0000","last_peered":"2024-04-18T21:11:02.586064+0000","last_clean":"2024-04-18T21:11:02.586064+0000","last_became_active":"2024-04-18T21:10:20.487409+0000","last_became_peered":"2024-04-18T21:10:20.487409+0000","last_unstale":"2024-04-18T21:11:02.586064+0000","last_undegraded":"2024-04-18T21:11:02.586064+0000","last_fullsized":"2024-04-18T21:11:02.586064+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'403","last_scrub_stamp":"2024-04-18T21:11:02.585880+0000","last_deep_scrub":"71'403","last_deep_scrub_stamp":"2024-04-18T21:11:02.585880+0000","last_clean_scrub_stamp":"2024-04-18T21:11:02.585880+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:46:41.035507+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":7482,"num_write":371,"num_write_kb":25957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'406","reported_seq":615,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:29.723746+0000","last_change":"2024-04-18T21:10:29.723886+0000","last_active":"2024-04-18T21:10:29.723746+0000","last_peered":"2024-04-18T21:10:29.723746+0000","last_clean":"2024-04-18T21:10:29.723746+0000","last_became_active":"2024-04-18T21:10:10.542594+0000","last_became_peered":"2024-04-18T21:10:10.542594+0000","last_unstale":"2024-04-18T21:10:29.723746+0000","last_undegraded":"2024-04-18T21:10:29.723746+0000","last_fullsized":"2024-04-18T21:10:29.723746+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'406","last_scrub_stamp":"2024-04-18T21:10:29.723436+0000","last_deep_scrub":"71'406","last_deep_scrub_stamp":"2024-04-18T21:10:29.723436+0000","last_clean_scrub_stamp":"2024-04-18T21:10:29.723436+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:35:53.236874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":27987,"num_write":365,"num_write_kb":38689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"71'470","reported_seq":1151,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:59.563155+0000","last_change":"2024-04-18T21:10:59.563222+0000","last_active":"2024-04-18T21:10:59.563155+0000","last_peered":"2024-04-18T21:10:59.563155+0000","last_clean":"2024-04-18T21:10:59.563155+0000","last_became_active":"2024-04-18T21:10:17.529957+0000","last_became_peered":"2024-04-18T21:10:17.529957+0000","last_unstale":"2024-04-18T21:10:59.563155+0000","last_undegraded":"2024-04-18T21:10:59.563155+0000","last_fullsized":"2024-04-18T21:10:59.563155+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'470","last_scrub_stamp":"2024-04-18T21:10:59.562926+0000","last_deep_scrub":"71'470","last_deep_scrub_stamp":"2024-04-18T21:10:59.562926+0000","last_clean_scrub_stamp":"2024-04-18T21:10:59.562926+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:06:48.968029+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":59273,"num_write":432,"num_write_kb":145930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'433","reported_seq":644,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:45.442117+0000","last_change":"2024-04-18T21:10:45.442240+0000","last_active":"2024-04-18T21:10:45.442117+0000","last_peered":"2024-04-18T21:10:45.442117+0000","last_clean":"2024-04-18T21:10:45.442117+0000","last_became_active":"2024-04-18T21:05:05.637567+0000","last_became_peered":"2024-04-18T21:05:05.637567+0000","last_unstale":"2024-04-18T21:10:45.442117+0000","last_undegraded":"2024-04-18T21:10:45.442117+0000","last_fullsized":"2024-04-18T21:10:45.442117+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'433","last_scrub_stamp":"2024-04-18T21:10:45.441810+0000","last_deep_scrub":"71'433","last_deep_scrub_stamp":"2024-04-18T21:10:45.441810+0000","last_clean_scrub_stamp":"2024-04-18T21:10:45.441810+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:25:07.094327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5514,"num_write":403,"num_write_kb":26329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"71'418","reported_seq":670,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:43.470000+0000","last_change":"2024-04-18T21:10:43.470064+0000","last_active":"2024-04-18T21:10:43.470000+0000","last_peered":"2024-04-18T21:10:43.470000+0000","last_clean":"2024-04-18T21:10:43.470000+0000","last_became_active":"2024-04-18T21:05:05.642991+0000","last_became_peered":"2024-04-18T21:05:05.642991+0000","last_unstale":"2024-04-18T21:10:43.470000+0000","last_undegraded":"2024-04-18T21:10:43.470000+0000","last_fullsized":"2024-04-18T21:10:43.470000+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'418","last_scrub_stamp":"2024-04-18T21:10:43.469805+0000","last_deep_scrub":"71'418","last_deep_scrub_stamp":"2024-04-18T21:10:43.469805+0000","last_clean_scrub_stamp":"2024-04-18T21:10:43.469805+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:34:47.223005+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":29097,"num_write":386,"num_write_kb":88262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"71'479","reported_seq":731,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:43.601031+0000","last_change":"2024-04-18T21:10:43.601163+0000","last_active":"2024-04-18T21:10:43.601031+0000","last_peered":"2024-04-18T21:10:43.601031+0000","last_clean":"2024-04-18T21:10:43.601031+0000","last_became_active":"2024-04-18T21:10:07.544314+0000","last_became_peered":"2024-04-18T21:10:07.544314+0000","last_unstale":"2024-04-18T21:10:43.601031+0000","last_undegraded":"2024-04-18T21:10:43.601031+0000","last_fullsized":"2024-04-18T21:10:43.601031+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'479","last_scrub_stamp":"2024-04-18T21:10:43.600798+0000","last_deep_scrub":"71'479","last_deep_scrub_stamp":"2024-04-18T21:10:43.600798+0000","last_clean_scrub_stamp":"2024-04-18T21:10:43.600798+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:17:09.198734+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":24204,"num_write":452,"num_write_kb":114184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"71'407","reported_seq":646,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:33.445333+0000","last_change":"2024-04-18T21:10:33.445390+0000","last_active":"2024-04-18T21:10:33.445333+0000","last_peered":"2024-04-18T21:10:33.445333+0000","last_clean":"2024-04-18T21:10:33.445333+0000","last_became_active":"2024-04-18T21:10:03.476552+0000","last_became_peered":"2024-04-18T21:10:03.476552+0000","last_unstale":"2024-04-18T21:10:33.445333+0000","last_undegraded":"2024-04-18T21:10:33.445333+0000","last_fullsized":"2024-04-18T21:10:33.445333+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'407","last_scrub_stamp":"2024-04-18T21:10:33.445126+0000","last_deep_scrub":"71'407","last_deep_scrub_stamp":"2024-04-18T21:10:33.445126+0000","last_clean_scrub_stamp":"2024-04-18T21:10:33.445126+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:01:37.597658+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":37766,"num_write":374,"num_write_kb":103984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'452","reported_seq":662,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:11:02.522257+0000","last_change":"2024-04-18T21:11:02.522389+0000","last_active":"2024-04-18T21:11:02.522257+0000","last_peered":"2024-04-18T21:11:02.522257+0000","last_clean":"2024-04-18T21:11:02.522257+0000","last_became_active":"2024-04-18T21:10:18.542189+0000","last_became_peered":"2024-04-18T21:10:18.542189+0000","last_unstale":"2024-04-18T21:11:02.522257+0000","last_undegraded":"2024-04-18T21:11:02.522257+0000","last_fullsized":"2024-04-18T21:11:02.522257+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'452","last_scrub_stamp":"2024-04-18T21:11:02.521978+0000","last_deep_scrub":"71'452","last_deep_scrub_stamp":"2024-04-18T21:11:02.521978+0000","last_clean_scrub_stamp":"2024-04-18T21:11:02.521978+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:49:53.454872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27170,"num_write":421,"num_write_kb":39548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"71'427","reported_seq":643,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:35.610080+0000","last_change":"2024-04-18T21:10:35.610142+0000","last_active":"2024-04-18T21:10:35.610080+0000","last_peered":"2024-04-18T21:10:35.610080+0000","last_clean":"2024-04-18T21:10:35.610080+0000","last_became_active":"2024-04-18T21:10:03.539961+0000","last_became_peered":"2024-04-18T21:10:03.539961+0000","last_unstale":"2024-04-18T21:10:35.610080+0000","last_undegraded":"2024-04-18T21:10:35.610080+0000","last_fullsized":"2024-04-18T21:10:35.610080+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'427","last_scrub_stamp":"2024-04-18T21:10:35.609881+0000","last_deep_scrub":"71'427","last_deep_scrub_stamp":"2024-04-18T21:10:35.609881+0000","last_clean_scrub_stamp":"2024-04-18T21:10:35.609881+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:56:03.330499+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":11507,"num_write":407,"num_write_kb":50964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"71'471","reported_seq":706,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:50.496827+0000","last_change":"2024-04-18T21:10:50.496886+0000","last_active":"2024-04-18T21:10:50.496827+0000","last_peered":"2024-04-18T21:10:50.496827+0000","last_clean":"2024-04-18T21:10:50.496827+0000","last_became_active":"2024-04-18T21:05:05.648233+0000","last_became_peered":"2024-04-18T21:05:05.648233+0000","last_unstale":"2024-04-18T21:10:50.496827+0000","last_undegraded":"2024-04-18T21:10:50.496827+0000","last_fullsized":"2024-04-18T21:10:50.496827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'471","last_scrub_stamp":"2024-04-18T21:10:50.496633+0000","last_deep_scrub":"71'471","last_deep_scrub_stamp":"2024-04-18T21:10:50.496633+0000","last_clean_scrub_stamp":"2024-04-18T21:10:50.496633+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:47:11.718963+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20857,"num_write":431,"num_write_kb":63677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'378","reported_seq":949,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:37.477427+0000","last_change":"2024-04-18T21:10:37.477561+0000","last_active":"2024-04-18T21:10:37.477427+0000","last_peered":"2024-04-18T21:10:37.477427+0000","last_clean":"2024-04-18T21:10:37.477427+0000","last_became_active":"2024-04-18T21:09:55.490958+0000","last_became_peered":"2024-04-18T21:09:55.490958+0000","last_unstale":"2024-04-18T21:10:37.477427+0000","last_undegraded":"2024-04-18T21:10:37.477427+0000","last_fullsized":"2024-04-18T21:10:37.477427+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'378","last_scrub_stamp":"2024-04-18T21:10:37.477124+0000","last_deep_scrub":"71'378","last_deep_scrub_stamp":"2024-04-18T21:10:37.477124+0000","last_clean_scrub_stamp":"2024-04-18T21:10:37.477124+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:56:57.373143+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12573,"num_write":347,"num_write_kb":34434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'410","reported_seq":648,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:32.644853+0000","last_change":"2024-04-18T21:10:32.644917+0000","last_active":"2024-04-18T21:10:32.644853+0000","last_peered":"2024-04-18T21:10:32.644853+0000","last_clean":"2024-04-18T21:10:32.644853+0000","last_became_active":"2024-04-18T21:10:01.555367+0000","last_became_peered":"2024-04-18T21:10:01.555367+0000","last_unstale":"2024-04-18T21:10:32.644853+0000","last_undegraded":"2024-04-18T21:10:32.644853+0000","last_fullsized":"2024-04-18T21:10:32.644853+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'410","last_scrub_stamp":"2024-04-18T21:10:32.644659+0000","last_deep_scrub":"71'410","last_deep_scrub_stamp":"2024-04-18T21:10:32.644659+0000","last_clean_scrub_stamp":"2024-04-18T21:10:32.644659+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:58:22.209002+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":16926,"num_write":380,"num_write_kb":112804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"71'410","reported_seq":1000,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:41.515893+0000","last_change":"2024-04-18T21:10:41.515954+0000","last_active":"2024-04-18T21:10:41.515893+0000","last_peered":"2024-04-18T21:10:41.515893+0000","last_clean":"2024-04-18T21:10:41.515893+0000","last_became_active":"2024-04-18T21:10:03.480985+0000","last_became_peered":"2024-04-18T21:10:03.480985+0000","last_unstale":"2024-04-18T21:10:41.515893+0000","last_undegraded":"2024-04-18T21:10:41.515893+0000","last_fullsized":"2024-04-18T21:10:41.515893+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'410","last_scrub_stamp":"2024-04-18T21:10:41.515701+0000","last_deep_scrub":"71'410","last_deep_scrub_stamp":"2024-04-18T21:10:41.515701+0000","last_clean_scrub_stamp":"2024-04-18T21:10:41.515701+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:17:22.317167+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":34811,"num_write":378,"num_write_kb":51242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'491","reported_seq":718,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:55.641875+0000","last_change":"2024-04-18T21:10:55.641998+0000","last_active":"2024-04-18T21:10:55.641875+0000","last_peered":"2024-04-18T21:10:55.641875+0000","last_clean":"2024-04-18T21:10:55.641875+0000","last_became_active":"2024-04-18T21:10:08.540487+0000","last_became_peered":"2024-04-18T21:10:08.540487+0000","last_unstale":"2024-04-18T21:10:55.641875+0000","last_undegraded":"2024-04-18T21:10:55.641875+0000","last_fullsized":"2024-04-18T21:10:55.641875+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'491","last_scrub_stamp":"2024-04-18T21:10:55.641583+0000","last_deep_scrub":"71'491","last_deep_scrub_stamp":"2024-04-18T21:10:55.641583+0000","last_clean_scrub_stamp":"2024-04-18T21:10:55.641583+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:02:49.116830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":26902,"num_write":456,"num_write_kb":124778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":209,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"71'467","reported_seq":1088,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:11:01.563989+0000","last_change":"2024-04-18T21:11:01.564047+0000","last_active":"2024-04-18T21:11:01.563989+0000","last_peered":"2024-04-18T21:11:01.563989+0000","last_clean":"2024-04-18T21:11:01.563989+0000","last_became_active":"2024-04-18T21:10:19.480002+0000","last_became_peered":"2024-04-18T21:10:19.480002+0000","last_unstale":"2024-04-18T21:11:01.563989+0000","last_undegraded":"2024-04-18T21:11:01.563989+0000","last_fullsized":"2024-04-18T21:11:01.563989+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'467","last_scrub_stamp":"2024-04-18T21:11:01.563791+0000","last_deep_scrub":"71'467","last_deep_scrub_stamp":"2024-04-18T21:11:01.563791+0000","last_clean_scrub_stamp":"2024-04-18T21:11:01.563791+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:20:03.788205+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":28114,"num_write":434,"num_write_kb":129325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'423","reported_seq":604,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:59.394295+0000","last_change":"2024-04-18T21:10:59.394353+0000","last_active":"2024-04-18T21:10:59.394295+0000","last_peered":"2024-04-18T21:10:59.394295+0000","last_clean":"2024-04-18T21:10:59.394295+0000","last_became_active":"2024-04-18T21:10:01.487074+0000","last_became_peered":"2024-04-18T21:10:01.487074+0000","last_unstale":"2024-04-18T21:10:59.394295+0000","last_undegraded":"2024-04-18T21:10:59.394295+0000","last_fullsized":"2024-04-18T21:10:59.394295+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'423","last_scrub_stamp":"2024-04-18T21:10:59.394076+0000","last_deep_scrub":"71'423","last_deep_scrub_stamp":"2024-04-18T21:10:59.394076+0000","last_clean_scrub_stamp":"2024-04-18T21:10:59.394076+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:12:22.985773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8244,"num_write":393,"num_write_kb":58692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"71'389","reported_seq":627,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:44.556195+0000","last_change":"2024-04-18T21:10:44.556357+0000","last_active":"2024-04-18T21:10:44.556195+0000","last_peered":"2024-04-18T21:10:44.556195+0000","last_clean":"2024-04-18T21:10:44.556195+0000","last_became_active":"2024-04-18T21:09:58.537723+0000","last_became_peered":"2024-04-18T21:09:58.537723+0000","last_unstale":"2024-04-18T21:10:44.556195+0000","last_undegraded":"2024-04-18T21:10:44.556195+0000","last_fullsized":"2024-04-18T21:10:44.556195+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'389","last_scrub_stamp":"2024-04-18T21:10:44.555942+0000","last_deep_scrub":"71'389","last_deep_scrub_stamp":"2024-04-18T21:10:44.555942+0000","last_clean_scrub_stamp":"2024-04-18T21:10:44.555942+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:38.492860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":24216,"num_write":349,"num_write_kb":43176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"108'429","reported_seq":634,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:53.432856+0000","last_change":"2024-04-18T21:10:53.432935+0000","last_active":"2024-04-18T21:10:53.432856+0000","last_peered":"2024-04-18T21:10:53.432856+0000","last_clean":"2024-04-18T21:10:53.432856+0000","last_became_active":"2024-04-18T21:05:04.628407+0000","last_became_peered":"2024-04-18T21:05:04.628407+0000","last_unstale":"2024-04-18T21:10:53.432856+0000","last_undegraded":"2024-04-18T21:10:53.432856+0000","last_fullsized":"2024-04-18T21:10:53.432856+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'429","last_scrub_stamp":"2024-04-18T21:10:53.432676+0000","last_deep_scrub":"108'429","last_deep_scrub_stamp":"2024-04-18T21:10:53.432676+0000","last_clean_scrub_stamp":"2024-04-18T21:10:53.432676+0000","objects_scrubbed":4,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:29:04.367295+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":375,"num_write_kb":8348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"71'423","reported_seq":632,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:59.532924+0000","last_change":"2024-04-18T21:10:59.533033+0000","last_active":"2024-04-18T21:10:59.532924+0000","last_peered":"2024-04-18T21:10:59.532924+0000","last_clean":"2024-04-18T21:10:59.532924+0000","last_became_active":"2024-04-18T21:10:14.551249+0000","last_became_peered":"2024-04-18T21:10:14.551249+0000","last_unstale":"2024-04-18T21:10:59.532924+0000","last_undegraded":"2024-04-18T21:10:59.532924+0000","last_fullsized":"2024-04-18T21:10:59.532924+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'423","last_scrub_stamp":"2024-04-18T21:10:59.532636+0000","last_deep_scrub":"71'423","last_deep_scrub_stamp":"2024-04-18T21:10:59.532636+0000","last_clean_scrub_stamp":"2024-04-18T21:10:59.532636+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:51:41.855865+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":20096,"num_write":381,"num_write_kb":76351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"70'56","reported_seq":273,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:36.494604+0000","last_change":"2024-04-18T21:10:36.494662+0000","last_active":"2024-04-18T21:10:36.494604+0000","last_peered":"2024-04-18T21:10:36.494604+0000","last_clean":"2024-04-18T21:10:36.494604+0000","last_became_active":"2024-04-18T21:10:00.489486+0000","last_became_peered":"2024-04-18T21:10:00.489486+0000","last_unstale":"2024-04-18T21:10:36.494604+0000","last_undegraded":"2024-04-18T21:10:36.494604+0000","last_fullsized":"2024-04-18T21:10:36.494604+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'56","last_scrub_stamp":"2024-04-18T21:10:36.494405+0000","last_deep_scrub":"70'56","last_deep_scrub_stamp":"2024-04-18T21:10:36.494405+0000","last_clean_scrub_stamp":"2024-04-18T21:10:36.494405+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:33:10.489937+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'442","reported_seq":1035,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:45.552829+0000","last_change":"2024-04-18T21:10:45.552889+0000","last_active":"2024-04-18T21:10:45.552829+0000","last_peered":"2024-04-18T21:10:45.552829+0000","last_clean":"2024-04-18T21:10:45.552829+0000","last_became_active":"2024-04-18T21:10:03.483050+0000","last_became_peered":"2024-04-18T21:10:03.483050+0000","last_unstale":"2024-04-18T21:10:45.552829+0000","last_undegraded":"2024-04-18T21:10:45.552829+0000","last_fullsized":"2024-04-18T21:10:45.552829+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'442","last_scrub_stamp":"2024-04-18T21:10:45.552620+0000","last_deep_scrub":"71'442","last_deep_scrub_stamp":"2024-04-18T21:10:45.552620+0000","last_clean_scrub_stamp":"2024-04-18T21:10:45.552620+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:50:44.224177+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":13827,"num_write":415,"num_write_kb":79859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"70'62","reported_seq":89,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:47.665695+0000","last_change":"2024-04-18T21:10:47.665754+0000","last_active":"2024-04-18T21:10:47.665695+0000","last_peered":"2024-04-18T21:10:47.665695+0000","last_clean":"2024-04-18T21:10:47.665695+0000","last_became_active":"2024-04-18T21:09:50.867096+0000","last_became_peered":"2024-04-18T21:09:50.867096+0000","last_unstale":"2024-04-18T21:10:47.665695+0000","last_undegraded":"2024-04-18T21:10:47.665695+0000","last_fullsized":"2024-04-18T21:10:47.665695+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'62","last_scrub_stamp":"2024-04-18T21:10:47.665495+0000","last_deep_scrub":"70'62","last_deep_scrub_stamp":"2024-04-18T21:10:47.665495+0000","last_clean_scrub_stamp":"2024-04-18T21:10:47.665495+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:52:39.569446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"71'398","reported_seq":648,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:34.474342+0000","last_change":"2024-04-18T21:10:34.474403+0000","last_active":"2024-04-18T21:10:34.474342+0000","last_peered":"2024-04-18T21:10:34.474342+0000","last_clean":"2024-04-18T21:10:34.474342+0000","last_became_active":"2024-04-18T21:10:01.495349+0000","last_became_peered":"2024-04-18T21:10:01.495349+0000","last_unstale":"2024-04-18T21:10:34.474342+0000","last_undegraded":"2024-04-18T21:10:34.474342+0000","last_fullsized":"2024-04-18T21:10:34.474342+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'398","last_scrub_stamp":"2024-04-18T21:10:34.474141+0000","last_deep_scrub":"71'398","last_deep_scrub_stamp":"2024-04-18T21:10:34.474141+0000","last_clean_scrub_stamp":"2024-04-18T21:10:34.474141+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:01:44.645400+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":17616,"num_write":360,"num_write_kb":58871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"108'70","reported_seq":194,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:48.460047+0000","last_change":"2024-04-18T21:10:48.460118+0000","last_active":"2024-04-18T21:10:48.460047+0000","last_peered":"2024-04-18T21:10:48.460047+0000","last_clean":"2024-04-18T21:10:48.460047+0000","last_became_active":"2024-04-18T21:10:00.495594+0000","last_became_peered":"2024-04-18T21:10:00.495594+0000","last_unstale":"2024-04-18T21:10:48.460047+0000","last_undegraded":"2024-04-18T21:10:48.460047+0000","last_fullsized":"2024-04-18T21:10:48.460047+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'70","last_scrub_stamp":"2024-04-18T21:10:48.459862+0000","last_deep_scrub":"108'70","last_deep_scrub_stamp":"2024-04-18T21:10:48.459862+0000","last_clean_scrub_stamp":"2024-04-18T21:10:48.459862+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:13:56.226194+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"108'137","reported_seq":79,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:38.537294+0000","last_change":"2024-04-18T21:10:38.537363+0000","last_active":"2024-04-18T21:10:38.537294+0000","last_peered":"2024-04-18T21:10:38.537294+0000","last_clean":"2024-04-18T21:10:38.537294+0000","last_became_active":"2024-04-18T21:10:00.491509+0000","last_became_peered":"2024-04-18T21:10:00.491509+0000","last_unstale":"2024-04-18T21:10:38.537294+0000","last_undegraded":"2024-04-18T21:10:38.537294+0000","last_fullsized":"2024-04-18T21:10:38.537294+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'137","last_scrub_stamp":"2024-04-18T21:10:38.537083+0000","last_deep_scrub":"108'137","last_deep_scrub_stamp":"2024-04-18T21:10:38.537083+0000","last_clean_scrub_stamp":"2024-04-18T21:10:38.537083+0000","objects_scrubbed":2,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:08:53.700658+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":7777508,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'410","reported_seq":619,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:41.636377+0000","last_change":"2024-04-18T21:10:41.636493+0000","last_active":"2024-04-18T21:10:41.636377+0000","last_peered":"2024-04-18T21:10:41.636377+0000","last_clean":"2024-04-18T21:10:41.636377+0000","last_became_active":"2024-04-18T21:10:06.548034+0000","last_became_peered":"2024-04-18T21:10:06.548034+0000","last_unstale":"2024-04-18T21:10:41.636377+0000","last_undegraded":"2024-04-18T21:10:41.636377+0000","last_fullsized":"2024-04-18T21:10:41.636377+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'410","last_scrub_stamp":"2024-04-18T21:10:41.636098+0000","last_deep_scrub":"71'410","last_deep_scrub_stamp":"2024-04-18T21:10:41.636098+0000","last_clean_scrub_stamp":"2024-04-18T21:10:41.636098+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:22.483374+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17055,"num_write":375,"num_write_kb":63331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"108'242","reported_seq":374,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:38.593936+0000","last_change":"2024-04-18T21:10:38.594005+0000","last_active":"2024-04-18T21:10:38.593936+0000","last_peered":"2024-04-18T21:10:38.593936+0000","last_clean":"2024-04-18T21:10:38.593936+0000","last_became_active":"2024-04-18T21:10:00.555486+0000","last_became_peered":"2024-04-18T21:10:00.555486+0000","last_unstale":"2024-04-18T21:10:38.593936+0000","last_undegraded":"2024-04-18T21:10:38.593936+0000","last_fullsized":"2024-04-18T21:10:38.593936+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'242","last_scrub_stamp":"2024-04-18T21:10:38.593741+0000","last_deep_scrub":"108'242","last_deep_scrub_stamp":"2024-04-18T21:10:38.593741+0000","last_clean_scrub_stamp":"2024-04-18T21:10:38.593741+0000","objects_scrubbed":2,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:33:25.988727+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":4191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"71'501","reported_seq":728,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:11:01.507534+0000","last_change":"2024-04-18T21:11:01.507650+0000","last_active":"2024-04-18T21:11:01.507534+0000","last_peered":"2024-04-18T21:11:01.507534+0000","last_clean":"2024-04-18T21:11:01.507534+0000","last_became_active":"2024-04-18T21:10:17.588391+0000","last_became_peered":"2024-04-18T21:10:17.588391+0000","last_unstale":"2024-04-18T21:11:01.507534+0000","last_undegraded":"2024-04-18T21:11:01.507534+0000","last_fullsized":"2024-04-18T21:11:01.507534+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'501","last_scrub_stamp":"2024-04-18T21:11:01.507231+0000","last_deep_scrub":"71'501","last_deep_scrub_stamp":"2024-04-18T21:11:01.507231+0000","last_clean_scrub_stamp":"2024-04-18T21:11:01.507231+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:19:34.442337+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":37662,"num_write":474,"num_write_kb":167663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"108'431","reported_seq":577,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:40.518750+0000","last_change":"2024-04-18T21:10:40.518847+0000","last_active":"2024-04-18T21:10:40.518750+0000","last_peered":"2024-04-18T21:10:40.518750+0000","last_clean":"2024-04-18T21:10:40.518750+0000","last_became_active":"2024-04-18T21:10:00.491525+0000","last_became_peered":"2024-04-18T21:10:00.491525+0000","last_unstale":"2024-04-18T21:10:40.518750+0000","last_undegraded":"2024-04-18T21:10:40.518750+0000","last_fullsized":"2024-04-18T21:10:40.518750+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'431","last_scrub_stamp":"2024-04-18T21:10:40.518479+0000","last_deep_scrub":"108'431","last_deep_scrub_stamp":"2024-04-18T21:10:40.518479+0000","last_clean_scrub_stamp":"2024-04-18T21:10:40.518479+0000","objects_scrubbed":2,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:15:33.885815+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":377,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388678,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'440","reported_seq":659,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:32.560566+0000","last_change":"2024-04-18T21:10:32.560626+0000","last_active":"2024-04-18T21:10:32.560566+0000","last_peered":"2024-04-18T21:10:32.560566+0000","last_clean":"2024-04-18T21:10:32.560566+0000","last_became_active":"2024-04-18T21:10:01.486740+0000","last_became_peered":"2024-04-18T21:10:01.486740+0000","last_unstale":"2024-04-18T21:10:32.560566+0000","last_undegraded":"2024-04-18T21:10:32.560566+0000","last_fullsized":"2024-04-18T21:10:32.560566+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'440","last_scrub_stamp":"2024-04-18T21:10:32.560375+0000","last_deep_scrub":"71'440","last_deep_scrub_stamp":"2024-04-18T21:10:32.560375+0000","last_clean_scrub_stamp":"2024-04-18T21:10:32.560375+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:25:33.859991+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":42138,"num_write":408,"num_write_kb":96310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"70'59","reported_seq":264,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:51.417629+0000","last_change":"2024-04-18T21:10:51.417690+0000","last_active":"2024-04-18T21:10:51.417629+0000","last_peered":"2024-04-18T21:10:51.417629+0000","last_clean":"2024-04-18T21:10:51.417629+0000","last_became_active":"2024-04-18T21:05:04.624656+0000","last_became_peered":"2024-04-18T21:05:04.624656+0000","last_unstale":"2024-04-18T21:10:51.417629+0000","last_undegraded":"2024-04-18T21:10:51.417629+0000","last_fullsized":"2024-04-18T21:10:51.417629+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'59","last_scrub_stamp":"2024-04-18T21:10:51.417433+0000","last_deep_scrub":"70'59","last_deep_scrub_stamp":"2024-04-18T21:10:51.417433+0000","last_clean_scrub_stamp":"2024-04-18T21:10:51.417433+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:04:10.250045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"71'461","reported_seq":685,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:49.520017+0000","last_change":"2024-04-18T21:10:49.520076+0000","last_active":"2024-04-18T21:10:49.520017+0000","last_peered":"2024-04-18T21:10:49.520017+0000","last_clean":"2024-04-18T21:10:49.520017+0000","last_became_active":"2024-04-18T21:05:05.648380+0000","last_became_peered":"2024-04-18T21:05:05.648380+0000","last_unstale":"2024-04-18T21:10:49.520017+0000","last_undegraded":"2024-04-18T21:10:49.520017+0000","last_fullsized":"2024-04-18T21:10:49.520017+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'461","last_scrub_stamp":"2024-04-18T21:10:49.519603+0000","last_deep_scrub":"71'461","last_deep_scrub_stamp":"2024-04-18T21:10:49.519603+0000","last_clean_scrub_stamp":"2024-04-18T21:10:49.519603+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:03:38.513123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12852,"num_write":420,"num_write_kb":88506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"108'160","reported_seq":388,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:38.540108+0000","last_change":"2024-04-18T21:10:38.540182+0000","last_active":"2024-04-18T21:10:38.540108+0000","last_peered":"2024-04-18T21:10:38.540108+0000","last_clean":"2024-04-18T21:10:38.540108+0000","last_became_active":"2024-04-18T21:10:00.494630+0000","last_became_peered":"2024-04-18T21:10:00.494630+0000","last_unstale":"2024-04-18T21:10:38.540108+0000","last_undegraded":"2024-04-18T21:10:38.540108+0000","last_fullsized":"2024-04-18T21:10:38.540108+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'160","last_scrub_stamp":"2024-04-18T21:10:38.539887+0000","last_deep_scrub":"108'160","last_deep_scrub_stamp":"2024-04-18T21:10:38.539887+0000","last_clean_scrub_stamp":"2024-04-18T21:10:38.539887+0000","objects_scrubbed":3,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:13:46.306220+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":8250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'445","reported_seq":644,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:11:00.356763+0000","last_change":"2024-04-18T21:11:00.356893+0000","last_active":"2024-04-18T21:11:00.356763+0000","last_peered":"2024-04-18T21:11:00.356763+0000","last_clean":"2024-04-18T21:11:00.356763+0000","last_became_active":"2024-04-18T21:10:01.490691+0000","last_became_peered":"2024-04-18T21:10:01.490691+0000","last_unstale":"2024-04-18T21:11:00.356763+0000","last_undegraded":"2024-04-18T21:11:00.356763+0000","last_fullsized":"2024-04-18T21:11:00.356763+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'445","last_scrub_stamp":"2024-04-18T21:11:00.356518+0000","last_deep_scrub":"71'445","last_deep_scrub_stamp":"2024-04-18T21:11:00.356518+0000","last_clean_scrub_stamp":"2024-04-18T21:11:00.356518+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:47:21.578847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17488,"num_write":410,"num_write_kb":50845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"108'125","reported_seq":330,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:54.465762+0000","last_change":"2024-04-18T21:10:54.465825+0000","last_active":"2024-04-18T21:10:54.465762+0000","last_peered":"2024-04-18T21:10:54.465762+0000","last_clean":"2024-04-18T21:10:54.465762+0000","last_became_active":"2024-04-18T21:05:04.632284+0000","last_became_peered":"2024-04-18T21:05:04.632284+0000","last_unstale":"2024-04-18T21:10:54.465762+0000","last_undegraded":"2024-04-18T21:10:54.465762+0000","last_fullsized":"2024-04-18T21:10:54.465762+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'125","last_scrub_stamp":"2024-04-18T21:10:54.465566+0000","last_deep_scrub":"108'125","last_deep_scrub_stamp":"2024-04-18T21:10:54.465566+0000","last_clean_scrub_stamp":"2024-04-18T21:10:54.465566+0000","objects_scrubbed":1,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:13:55.202248+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"71'400","reported_seq":951,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:11:04.433031+0000","last_change":"2024-04-18T21:11:04.433143+0000","last_active":"2024-04-18T21:11:04.433031+0000","last_peered":"2024-04-18T21:11:04.433031+0000","last_clean":"2024-04-18T21:11:04.433031+0000","last_became_active":"2024-04-18T21:10:14.492039+0000","last_became_peered":"2024-04-18T21:10:14.492039+0000","last_unstale":"2024-04-18T21:11:04.433031+0000","last_undegraded":"2024-04-18T21:11:04.433031+0000","last_fullsized":"2024-04-18T21:11:04.433031+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'400","last_scrub_stamp":"2024-04-18T21:11:04.432656+0000","last_deep_scrub":"71'400","last_deep_scrub_stamp":"2024-04-18T21:11:04.432656+0000","last_clean_scrub_stamp":"2024-04-18T21:11:04.432656+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:38:55.922969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12586,"num_write":372,"num_write_kb":58856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":350,"num_bytes_recovered":576854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"70'53","reported_seq":91,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:42.601858+0000","last_change":"2024-04-18T21:10:42.601923+0000","last_active":"2024-04-18T21:10:42.601858+0000","last_peered":"2024-04-18T21:10:42.601858+0000","last_clean":"2024-04-18T21:10:42.601858+0000","last_became_active":"2024-04-18T21:10:00.549987+0000","last_became_peered":"2024-04-18T21:10:00.549987+0000","last_unstale":"2024-04-18T21:10:42.601858+0000","last_undegraded":"2024-04-18T21:10:42.601858+0000","last_fullsized":"2024-04-18T21:10:42.601858+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'53","last_scrub_stamp":"2024-04-18T21:10:42.601641+0000","last_deep_scrub":"70'53","last_deep_scrub_stamp":"2024-04-18T21:10:42.601641+0000","last_clean_scrub_stamp":"2024-04-18T21:10:42.601641+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:30:52.296080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"71'364","reported_seq":952,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:34.489083+0000","last_change":"2024-04-18T21:10:34.489140+0000","last_active":"2024-04-18T21:10:34.489083+0000","last_peered":"2024-04-18T21:10:34.489083+0000","last_clean":"2024-04-18T21:10:34.489083+0000","last_became_active":"2024-04-18T21:09:58.473903+0000","last_became_peered":"2024-04-18T21:09:58.473903+0000","last_unstale":"2024-04-18T21:10:34.489083+0000","last_undegraded":"2024-04-18T21:10:34.489083+0000","last_fullsized":"2024-04-18T21:10:34.489083+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'364","last_scrub_stamp":"2024-04-18T21:10:34.488895+0000","last_deep_scrub":"71'364","last_deep_scrub_stamp":"2024-04-18T21:10:34.488895+0000","last_clean_scrub_stamp":"2024-04-18T21:10:34.488895+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:11:05.862340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":37938,"num_write":336,"num_write_kb":42513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"108'461","reported_seq":583,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:53.687417+0000","last_change":"2024-04-18T21:10:53.687577+0000","last_active":"2024-04-18T21:10:53.687417+0000","last_peered":"2024-04-18T21:10:53.687417+0000","last_clean":"2024-04-18T21:10:53.687417+0000","last_became_active":"2024-04-18T21:09:53.544355+0000","last_became_peered":"2024-04-18T21:09:53.544355+0000","last_unstale":"2024-04-18T21:10:53.687417+0000","last_undegraded":"2024-04-18T21:10:53.687417+0000","last_fullsized":"2024-04-18T21:10:53.687417+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'461","last_scrub_stamp":"2024-04-18T21:10:53.687199+0000","last_deep_scrub":"108'461","last_deep_scrub_stamp":"2024-04-18T21:10:53.687199+0000","last_clean_scrub_stamp":"2024-04-18T21:10:53.687199+0000","objects_scrubbed":1,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:02:28.182157+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":406,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"71'404","reported_seq":987,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:58.585412+0000","last_change":"2024-04-18T21:10:58.585472+0000","last_active":"2024-04-18T21:10:58.585412+0000","last_peered":"2024-04-18T21:10:58.585412+0000","last_clean":"2024-04-18T21:10:58.585412+0000","last_became_active":"2024-04-18T21:10:15.504379+0000","last_became_peered":"2024-04-18T21:10:15.504379+0000","last_unstale":"2024-04-18T21:10:58.585412+0000","last_undegraded":"2024-04-18T21:10:58.585412+0000","last_fullsized":"2024-04-18T21:10:58.585412+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'404","last_scrub_stamp":"2024-04-18T21:10:58.585209+0000","last_deep_scrub":"71'404","last_deep_scrub_stamp":"2024-04-18T21:10:58.585209+0000","last_clean_scrub_stamp":"2024-04-18T21:10:58.585209+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:41:13.591170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":7075,"num_write":367,"num_write_kb":62738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"108'159","reported_seq":394,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:58.414505+0000","last_change":"2024-04-18T21:10:58.414583+0000","last_active":"2024-04-18T21:10:58.414505+0000","last_peered":"2024-04-18T21:10:58.414505+0000","last_clean":"2024-04-18T21:10:58.414505+0000","last_became_active":"2024-04-18T21:10:00.496373+0000","last_became_peered":"2024-04-18T21:10:00.496373+0000","last_unstale":"2024-04-18T21:10:58.414505+0000","last_undegraded":"2024-04-18T21:10:58.414505+0000","last_fullsized":"2024-04-18T21:10:58.414505+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'159","last_scrub_stamp":"2024-04-18T21:10:58.414320+0000","last_deep_scrub":"108'159","last_deep_scrub_stamp":"2024-04-18T21:10:58.414320+0000","last_clean_scrub_stamp":"2024-04-18T21:10:58.414320+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:04:39.091296+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":168,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:36.510603+0000","last_change":"2024-04-18T21:10:36.510657+0000","last_active":"2024-04-18T21:10:36.510603+0000","last_peered":"2024-04-18T21:10:36.510603+0000","last_clean":"2024-04-18T21:10:36.510603+0000","last_became_active":"2024-04-18T21:10:00.486722+0000","last_became_peered":"2024-04-18T21:10:00.486722+0000","last_unstale":"2024-04-18T21:10:36.510603+0000","last_undegraded":"2024-04-18T21:10:36.510603+0000","last_fullsized":"2024-04-18T21:10:36.510603+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:10:36.510287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:10:36.510287+0000","last_clean_scrub_stamp":"2024-04-18T21:10:36.510287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:31:24.648869+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"108'597","reported_seq":761,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:35.556401+0000","last_change":"2024-04-18T21:10:35.556468+0000","last_active":"2024-04-18T21:10:35.556401+0000","last_peered":"2024-04-18T21:10:35.556401+0000","last_clean":"2024-04-18T21:10:35.556401+0000","last_became_active":"2024-04-18T21:10:03.481344+0000","last_became_peered":"2024-04-18T21:10:03.481344+0000","last_unstale":"2024-04-18T21:10:35.556401+0000","last_undegraded":"2024-04-18T21:10:35.556401+0000","last_fullsized":"2024-04-18T21:10:35.556401+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'597","last_scrub_stamp":"2024-04-18T21:10:35.556222+0000","last_deep_scrub":"108'597","last_deep_scrub_stamp":"2024-04-18T21:10:35.556222+0000","last_clean_scrub_stamp":"2024-04-18T21:10:35.556222+0000","objects_scrubbed":2,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:32:38.178309+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":539,"num_write_kb":8449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4689862,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'443","reported_seq":1098,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:35.495143+0000","last_change":"2024-04-18T21:10:35.495203+0000","last_active":"2024-04-18T21:10:35.495143+0000","last_peered":"2024-04-18T21:10:35.495143+0000","last_clean":"2024-04-18T21:10:35.495143+0000","last_became_active":"2024-04-18T21:09:56.493327+0000","last_became_peered":"2024-04-18T21:09:56.493327+0000","last_unstale":"2024-04-18T21:10:35.495143+0000","last_undegraded":"2024-04-18T21:10:35.495143+0000","last_fullsized":"2024-04-18T21:10:35.495143+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'443","last_scrub_stamp":"2024-04-18T21:10:35.494948+0000","last_deep_scrub":"71'443","last_deep_scrub_stamp":"2024-04-18T21:10:35.494948+0000","last_clean_scrub_stamp":"2024-04-18T21:10:35.494948+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:07:37.030049+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":38975,"num_write":404,"num_write_kb":80038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":219,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:41.517281+0000","last_change":"2024-04-18T21:10:41.517281+0000","last_active":"2024-04-18T21:10:41.517281+0000","last_peered":"2024-04-18T21:10:41.517281+0000","last_clean":"2024-04-18T21:10:41.517281+0000","last_became_active":"2024-04-18T21:09:50.816543+0000","last_became_peered":"2024-04-18T21:09:50.816543+0000","last_unstale":"2024-04-18T21:10:41.517281+0000","last_undegraded":"2024-04-18T21:10:41.517281+0000","last_fullsized":"2024-04-18T21:10:41.517281+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:10:41.517027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:10:41.517027+0000","last_clean_scrub_stamp":"2024-04-18T21:10:41.517027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:42:46.384341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"108'130","reported_seq":322,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:39.518628+0000","last_change":"2024-04-18T21:10:39.518694+0000","last_active":"2024-04-18T21:10:39.518628+0000","last_peered":"2024-04-18T21:10:39.518628+0000","last_clean":"2024-04-18T21:10:39.518628+0000","last_became_active":"2024-04-18T21:10:03.486859+0000","last_became_peered":"2024-04-18T21:10:03.486859+0000","last_unstale":"2024-04-18T21:10:39.518628+0000","last_undegraded":"2024-04-18T21:10:39.518628+0000","last_fullsized":"2024-04-18T21:10:39.518628+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'130","last_scrub_stamp":"2024-04-18T21:10:39.518437+0000","last_deep_scrub":"108'130","last_deep_scrub_stamp":"2024-04-18T21:10:39.518437+0000","last_clean_scrub_stamp":"2024-04-18T21:10:39.518437+0000","objects_scrubbed":1,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:31:11.104305+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1466419,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":55,"num_read_kb":1405,"num_write":58,"num_write_kb":1469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'457","reported_seq":689,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:30.679943+0000","last_change":"2024-04-18T21:10:30.680122+0000","last_active":"2024-04-18T21:10:30.679943+0000","last_peered":"2024-04-18T21:10:30.679943+0000","last_clean":"2024-04-18T21:10:30.679943+0000","last_became_active":"2024-04-18T21:10:09.537428+0000","last_became_peered":"2024-04-18T21:10:09.537428+0000","last_unstale":"2024-04-18T21:10:30.679943+0000","last_undegraded":"2024-04-18T21:10:30.679943+0000","last_fullsized":"2024-04-18T21:10:30.679943+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'457","last_scrub_stamp":"2024-04-18T21:10:30.679714+0000","last_deep_scrub":"71'457","last_deep_scrub_stamp":"2024-04-18T21:10:30.679714+0000","last_clean_scrub_stamp":"2024-04-18T21:10:30.679714+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:40:35.941807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":27659,"num_write":426,"num_write_kb":80500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":217,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:52.585883+0000","last_change":"2024-04-18T21:10:52.585939+0000","last_active":"2024-04-18T21:10:52.585883+0000","last_peered":"2024-04-18T21:10:52.585883+0000","last_clean":"2024-04-18T21:10:52.585883+0000","last_became_active":"2024-04-18T21:09:50.831949+0000","last_became_peered":"2024-04-18T21:09:50.831949+0000","last_unstale":"2024-04-18T21:10:52.585883+0000","last_undegraded":"2024-04-18T21:10:52.585883+0000","last_fullsized":"2024-04-18T21:10:52.585883+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:10:52.585688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:10:52.585688+0000","last_clean_scrub_stamp":"2024-04-18T21:10:52.585688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:53:20.148874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"108'172","reported_seq":379,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:50.682122+0000","last_change":"2024-04-18T21:10:50.682197+0000","last_active":"2024-04-18T21:10:50.682122+0000","last_peered":"2024-04-18T21:10:50.682122+0000","last_clean":"2024-04-18T21:10:50.682122+0000","last_became_active":"2024-04-18T21:09:53.537994+0000","last_became_peered":"2024-04-18T21:09:53.537994+0000","last_unstale":"2024-04-18T21:10:50.682122+0000","last_undegraded":"2024-04-18T21:10:50.682122+0000","last_fullsized":"2024-04-18T21:10:50.682122+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'172","last_scrub_stamp":"2024-04-18T21:10:50.681908+0000","last_deep_scrub":"108'172","last_deep_scrub_stamp":"2024-04-18T21:10:50.681908+0000","last_clean_scrub_stamp":"2024-04-18T21:10:50.681908+0000","objects_scrubbed":2,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:18:34.509332+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":8239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"71'346","reported_seq":919,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:57.557965+0000","last_change":"2024-04-18T21:10:57.558025+0000","last_active":"2024-04-18T21:10:57.557965+0000","last_peered":"2024-04-18T21:10:57.557965+0000","last_clean":"2024-04-18T21:10:57.557965+0000","last_became_active":"2024-04-18T21:10:11.484662+0000","last_became_peered":"2024-04-18T21:10:11.484662+0000","last_unstale":"2024-04-18T21:10:57.557965+0000","last_undegraded":"2024-04-18T21:10:57.557965+0000","last_fullsized":"2024-04-18T21:10:57.557965+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'346","last_scrub_stamp":"2024-04-18T21:10:57.557770+0000","last_deep_scrub":"71'346","last_deep_scrub_stamp":"2024-04-18T21:10:57.557770+0000","last_clean_scrub_stamp":"2024-04-18T21:10:57.557770+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:07:01.409213+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27042,"num_write":321,"num_write_kb":50693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":211,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:50.422006+0000","last_change":"2024-04-18T21:10:50.422058+0000","last_active":"2024-04-18T21:10:50.422006+0000","last_peered":"2024-04-18T21:10:50.422006+0000","last_clean":"2024-04-18T21:10:50.422006+0000","last_became_active":"2024-04-18T21:05:00.575951+0000","last_became_peered":"2024-04-18T21:05:00.575951+0000","last_unstale":"2024-04-18T21:10:50.422006+0000","last_undegraded":"2024-04-18T21:10:50.422006+0000","last_fullsized":"2024-04-18T21:10:50.422006+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:10:50.421816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:10:50.421816+0000","last_clean_scrub_stamp":"2024-04-18T21:10:50.421816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:02:23.671949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"70'63","reported_seq":268,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:52.426179+0000","last_change":"2024-04-18T21:10:52.426237+0000","last_active":"2024-04-18T21:10:52.426179+0000","last_peered":"2024-04-18T21:10:52.426179+0000","last_clean":"2024-04-18T21:10:52.426179+0000","last_became_active":"2024-04-18T21:05:04.626801+0000","last_became_peered":"2024-04-18T21:05:04.626801+0000","last_unstale":"2024-04-18T21:10:52.426179+0000","last_undegraded":"2024-04-18T21:10:52.426179+0000","last_fullsized":"2024-04-18T21:10:52.426179+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'63","last_scrub_stamp":"2024-04-18T21:10:52.425963+0000","last_deep_scrub":"70'63","last_deep_scrub_stamp":"2024-04-18T21:10:52.425963+0000","last_clean_scrub_stamp":"2024-04-18T21:10:52.425963+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:42:29.196419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"71'406","reported_seq":1050,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:46.571370+0000","last_change":"2024-04-18T21:10:46.571429+0000","last_active":"2024-04-18T21:10:46.571370+0000","last_peered":"2024-04-18T21:10:46.571370+0000","last_clean":"2024-04-18T21:10:46.571370+0000","last_became_active":"2024-04-18T21:09:59.493248+0000","last_became_peered":"2024-04-18T21:09:59.493248+0000","last_unstale":"2024-04-18T21:10:46.571370+0000","last_undegraded":"2024-04-18T21:10:46.571370+0000","last_fullsized":"2024-04-18T21:10:46.571370+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'406","last_scrub_stamp":"2024-04-18T21:10:46.571174+0000","last_deep_scrub":"71'406","last_deep_scrub_stamp":"2024-04-18T21:10:46.571174+0000","last_clean_scrub_stamp":"2024-04-18T21:10:46.571174+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:14:54.222674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":35332,"num_write":370,"num_write_kb":71807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"108'285","reported_seq":325,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:31.552483+0000","last_change":"2024-04-18T21:10:31.552548+0000","last_active":"2024-04-18T21:10:31.552483+0000","last_peered":"2024-04-18T21:10:31.552483+0000","last_clean":"2024-04-18T21:10:31.552483+0000","last_became_active":"2024-04-18T21:10:00.503851+0000","last_became_peered":"2024-04-18T21:10:00.503851+0000","last_unstale":"2024-04-18T21:10:31.552483+0000","last_undegraded":"2024-04-18T21:10:31.552483+0000","last_fullsized":"2024-04-18T21:10:31.552483+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'285","last_scrub_stamp":"2024-04-18T21:10:31.552295+0000","last_deep_scrub":"108'285","last_deep_scrub_stamp":"2024-04-18T21:10:31.552295+0000","last_clean_scrub_stamp":"2024-04-18T21:10:31.552295+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:10:37.571022+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":218,"num_write_kb":4194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":144,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:32.452332+0000","last_change":"2024-04-18T21:10:32.452386+0000","last_active":"2024-04-18T21:10:32.452332+0000","last_peered":"2024-04-18T21:10:32.452332+0000","last_clean":"2024-04-18T21:10:32.452332+0000","last_became_active":"2024-04-18T21:10:03.480071+0000","last_became_peered":"2024-04-18T21:10:03.480071+0000","last_unstale":"2024-04-18T21:10:32.452332+0000","last_undegraded":"2024-04-18T21:10:32.452332+0000","last_fullsized":"2024-04-18T21:10:32.452332+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:10:32.451773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:10:32.451773+0000","last_clean_scrub_stamp":"2024-04-18T21:10:32.451773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:47:35.613391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'386","reported_seq":586,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:56.609261+0000","last_change":"2024-04-18T21:10:56.609382+0000","last_active":"2024-04-18T21:10:56.609261+0000","last_peered":"2024-04-18T21:10:56.609261+0000","last_clean":"2024-04-18T21:10:56.609261+0000","last_became_active":"2024-04-18T21:10:10.542515+0000","last_became_peered":"2024-04-18T21:10:10.542515+0000","last_unstale":"2024-04-18T21:10:56.609261+0000","last_undegraded":"2024-04-18T21:10:56.609261+0000","last_fullsized":"2024-04-18T21:10:56.609261+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'386","last_scrub_stamp":"2024-04-18T21:10:56.609008+0000","last_deep_scrub":"71'386","last_deep_scrub_stamp":"2024-04-18T21:10:56.609008+0000","last_clean_scrub_stamp":"2024-04-18T21:10:56.609008+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:48:49.743743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14677,"num_write":355,"num_write_kb":51018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"70'55","reported_seq":266,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:54.547330+0000","last_change":"2024-04-18T21:10:54.547465+0000","last_active":"2024-04-18T21:10:54.547330+0000","last_peered":"2024-04-18T21:10:54.547330+0000","last_clean":"2024-04-18T21:10:54.547330+0000","last_became_active":"2024-04-18T21:09:50.832752+0000","last_became_peered":"2024-04-18T21:09:50.832752+0000","last_unstale":"2024-04-18T21:10:54.547330+0000","last_undegraded":"2024-04-18T21:10:54.547330+0000","last_fullsized":"2024-04-18T21:10:54.547330+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'55","last_scrub_stamp":"2024-04-18T21:10:54.547094+0000","last_deep_scrub":"70'55","last_deep_scrub_stamp":"2024-04-18T21:10:54.547094+0000","last_clean_scrub_stamp":"2024-04-18T21:10:54.547094+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:38:46.037407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":174,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:49.632042+0000","last_change":"2024-04-18T21:10:49.632095+0000","last_active":"2024-04-18T21:10:49.632042+0000","last_peered":"2024-04-18T21:10:49.632042+0000","last_clean":"2024-04-18T21:10:49.632042+0000","last_became_active":"2024-04-18T21:09:50.896844+0000","last_became_peered":"2024-04-18T21:09:50.896844+0000","last_unstale":"2024-04-18T21:10:49.632042+0000","last_undegraded":"2024-04-18T21:10:49.632042+0000","last_fullsized":"2024-04-18T21:10:49.632042+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:10:49.631847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:10:49.631847+0000","last_clean_scrub_stamp":"2024-04-18T21:10:49.631847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:34:26.676445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"71'402","reported_seq":600,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:37.588272+0000","last_change":"2024-04-18T21:10:37.588332+0000","last_active":"2024-04-18T21:10:37.588272+0000","last_peered":"2024-04-18T21:10:37.588272+0000","last_clean":"2024-04-18T21:10:37.588272+0000","last_became_active":"2024-04-18T21:10:05.536763+0000","last_became_peered":"2024-04-18T21:10:05.536763+0000","last_unstale":"2024-04-18T21:10:37.588272+0000","last_undegraded":"2024-04-18T21:10:37.588272+0000","last_fullsized":"2024-04-18T21:10:37.588272+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'402","last_scrub_stamp":"2024-04-18T21:10:37.588074+0000","last_deep_scrub":"71'402","last_deep_scrub_stamp":"2024-04-18T21:10:37.588074+0000","last_clean_scrub_stamp":"2024-04-18T21:10:37.588074+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:48:03.417731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12468,"num_write":369,"num_write_kb":67231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"108'61","reported_seq":273,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:51.544435+0000","last_change":"2024-04-18T21:10:51.544501+0000","last_active":"2024-04-18T21:10:51.544435+0000","last_peered":"2024-04-18T21:10:51.544435+0000","last_clean":"2024-04-18T21:10:51.544435+0000","last_became_active":"2024-04-18T21:09:50.832030+0000","last_became_peered":"2024-04-18T21:09:50.832030+0000","last_unstale":"2024-04-18T21:10:51.544435+0000","last_undegraded":"2024-04-18T21:10:51.544435+0000","last_fullsized":"2024-04-18T21:10:51.544435+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'61","last_scrub_stamp":"2024-04-18T21:10:51.544243+0000","last_deep_scrub":"108'61","last_deep_scrub_stamp":"2024-04-18T21:10:51.544243+0000","last_clean_scrub_stamp":"2024-04-18T21:10:51.544243+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:28:13.007898+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":144,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:55.502354+0000","last_change":"2024-04-18T21:10:55.502407+0000","last_active":"2024-04-18T21:10:55.502354+0000","last_peered":"2024-04-18T21:10:55.502354+0000","last_clean":"2024-04-18T21:10:55.502354+0000","last_became_active":"2024-04-18T21:10:03.492145+0000","last_became_peered":"2024-04-18T21:10:03.492145+0000","last_unstale":"2024-04-18T21:10:55.502354+0000","last_undegraded":"2024-04-18T21:10:55.502354+0000","last_fullsized":"2024-04-18T21:10:55.502354+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:10:55.502154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:10:55.502154+0000","last_clean_scrub_stamp":"2024-04-18T21:10:55.502154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:58:05.873154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'421","reported_seq":637,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:37.499392+0000","last_change":"2024-04-18T21:10:37.499454+0000","last_active":"2024-04-18T21:10:37.499392+0000","last_peered":"2024-04-18T21:10:37.499392+0000","last_clean":"2024-04-18T21:10:37.499392+0000","last_became_active":"2024-04-18T21:10:03.479773+0000","last_became_peered":"2024-04-18T21:10:03.479773+0000","last_unstale":"2024-04-18T21:10:37.499392+0000","last_undegraded":"2024-04-18T21:10:37.499392+0000","last_fullsized":"2024-04-18T21:10:37.499392+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'421","last_scrub_stamp":"2024-04-18T21:10:37.499184+0000","last_deep_scrub":"71'421","last_deep_scrub_stamp":"2024-04-18T21:10:37.499184+0000","last_clean_scrub_stamp":"2024-04-18T21:10:37.499184+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:55:02.714736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":16183,"num_write":377,"num_write_kb":50451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"108'111","reported_seq":335,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:42.525443+0000","last_change":"2024-04-18T21:10:42.525590+0000","last_active":"2024-04-18T21:10:42.525443+0000","last_peered":"2024-04-18T21:10:42.525443+0000","last_clean":"2024-04-18T21:10:42.525443+0000","last_became_active":"2024-04-18T21:10:00.494644+0000","last_became_peered":"2024-04-18T21:10:00.494644+0000","last_unstale":"2024-04-18T21:10:42.525443+0000","last_undegraded":"2024-04-18T21:10:42.525443+0000","last_fullsized":"2024-04-18T21:10:42.525443+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'111","last_scrub_stamp":"2024-04-18T21:10:42.525221+0000","last_deep_scrub":"108'111","last_deep_scrub_stamp":"2024-04-18T21:10:42.525221+0000","last_clean_scrub_stamp":"2024-04-18T21:10:42.525221+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:55:47.731058+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":1251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":169,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:42.508084+0000","last_change":"2024-04-18T21:10:42.508194+0000","last_active":"2024-04-18T21:10:42.508084+0000","last_peered":"2024-04-18T21:10:42.508084+0000","last_clean":"2024-04-18T21:10:42.508084+0000","last_became_active":"2024-04-18T21:10:00.492672+0000","last_became_peered":"2024-04-18T21:10:00.492672+0000","last_unstale":"2024-04-18T21:10:42.508084+0000","last_undegraded":"2024-04-18T21:10:42.508084+0000","last_fullsized":"2024-04-18T21:10:42.508084+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T21:10:42.507852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T21:10:42.507852+0000","last_clean_scrub_stamp":"2024-04-18T21:10:42.507852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:00:25.377497+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'384","reported_seq":606,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:46.632734+0000","last_change":"2024-04-18T21:10:46.632868+0000","last_active":"2024-04-18T21:10:46.632734+0000","last_peered":"2024-04-18T21:10:46.632734+0000","last_clean":"2024-04-18T21:10:46.632734+0000","last_became_active":"2024-04-18T21:09:57.567962+0000","last_became_peered":"2024-04-18T21:09:57.567962+0000","last_unstale":"2024-04-18T21:10:46.632734+0000","last_undegraded":"2024-04-18T21:10:46.632734+0000","last_fullsized":"2024-04-18T21:10:46.632734+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'384","last_scrub_stamp":"2024-04-18T21:10:46.632444+0000","last_deep_scrub":"71'384","last_deep_scrub_stamp":"2024-04-18T21:10:46.632444+0000","last_clean_scrub_stamp":"2024-04-18T21:10:46.632444+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:55:32.889601+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":15567,"num_write":351,"num_write_kb":42959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"71'396","reported_seq":933,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:11:03.438782+0000","last_change":"2024-04-18T21:11:03.438845+0000","last_active":"2024-04-18T21:11:03.438782+0000","last_peered":"2024-04-18T21:11:03.438782+0000","last_clean":"2024-04-18T21:11:03.438782+0000","last_became_active":"2024-04-18T21:10:13.479320+0000","last_became_peered":"2024-04-18T21:10:13.479320+0000","last_unstale":"2024-04-18T21:11:03.438782+0000","last_undegraded":"2024-04-18T21:11:03.438782+0000","last_fullsized":"2024-04-18T21:11:03.438782+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'396","last_scrub_stamp":"2024-04-18T21:11:03.438558+0000","last_deep_scrub":"71'396","last_deep_scrub_stamp":"2024-04-18T21:11:03.438558+0000","last_clean_scrub_stamp":"2024-04-18T21:11:03.438558+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:45:04.251878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12943,"num_write":353,"num_write_kb":35357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":342,"num_bytes_recovered":3500882,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"108'282","reported_seq":332,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:46.468674+0000","last_change":"2024-04-18T21:10:46.468762+0000","last_active":"2024-04-18T21:10:46.468674+0000","last_peered":"2024-04-18T21:10:46.468674+0000","last_clean":"2024-04-18T21:10:46.468674+0000","last_became_active":"2024-04-18T21:10:00.493088+0000","last_became_peered":"2024-04-18T21:10:00.493088+0000","last_unstale":"2024-04-18T21:10:46.468674+0000","last_undegraded":"2024-04-18T21:10:46.468674+0000","last_fullsized":"2024-04-18T21:10:46.468674+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'282","last_scrub_stamp":"2024-04-18T21:10:46.468484+0000","last_deep_scrub":"108'282","last_deep_scrub_stamp":"2024-04-18T21:10:46.468484+0000","last_clean_scrub_stamp":"2024-04-18T21:10:46.468484+0000","objects_scrubbed":5,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:09:54.785029+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":221,"num_write_kb":8303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":8389370,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'411","reported_seq":1016,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:30.429216+0000","last_change":"2024-04-18T21:10:30.429275+0000","last_active":"2024-04-18T21:10:30.429216+0000","last_peered":"2024-04-18T21:10:30.429216+0000","last_clean":"2024-04-18T21:10:30.429216+0000","last_became_active":"2024-04-18T21:10:04.482320+0000","last_became_peered":"2024-04-18T21:10:04.482320+0000","last_unstale":"2024-04-18T21:10:30.429216+0000","last_undegraded":"2024-04-18T21:10:30.429216+0000","last_fullsized":"2024-04-18T21:10:30.429216+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'411","last_scrub_stamp":"2024-04-18T21:10:30.429014+0000","last_deep_scrub":"71'411","last_deep_scrub_stamp":"2024-04-18T21:10:30.429014+0000","last_clean_scrub_stamp":"2024-04-18T21:10:30.429014+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:57:04.593176+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":17179,"num_write":375,"num_write_kb":38991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"108'87","reported_seq":179,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:48.623347+0000","last_change":"2024-04-18T21:10:48.623414+0000","last_active":"2024-04-18T21:10:48.623347+0000","last_peered":"2024-04-18T21:10:48.623347+0000","last_clean":"2024-04-18T21:10:48.623347+0000","last_became_active":"2024-04-18T21:09:50.874855+0000","last_became_peered":"2024-04-18T21:09:50.874855+0000","last_unstale":"2024-04-18T21:10:48.623347+0000","last_undegraded":"2024-04-18T21:10:48.623347+0000","last_fullsized":"2024-04-18T21:10:48.623347+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'87","last_scrub_stamp":"2024-04-18T21:10:48.623177+0000","last_deep_scrub":"108'87","last_deep_scrub_stamp":"2024-04-18T21:10:48.623177+0000","last_clean_scrub_stamp":"2024-04-18T21:10:48.623177+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:38:08.247727+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"108'231","reported_seq":269,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:33.533141+0000","last_change":"2024-04-18T21:10:33.533202+0000","last_active":"2024-04-18T21:10:33.533141+0000","last_peered":"2024-04-18T21:10:33.533141+0000","last_clean":"2024-04-18T21:10:33.533141+0000","last_became_active":"2024-04-18T21:10:00.498141+0000","last_became_peered":"2024-04-18T21:10:00.498141+0000","last_unstale":"2024-04-18T21:10:33.533141+0000","last_undegraded":"2024-04-18T21:10:33.533141+0000","last_fullsized":"2024-04-18T21:10:33.533141+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'231","last_scrub_stamp":"2024-04-18T21:10:33.532968+0000","last_deep_scrub":"108'231","last_deep_scrub_stamp":"2024-04-18T21:10:33.532968+0000","last_clean_scrub_stamp":"2024-04-18T21:10:33.532968+0000","objects_scrubbed":1,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:16:20.375244+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":4178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"71'493","reported_seq":741,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:48.557724+0000","last_change":"2024-04-18T21:10:48.557787+0000","last_active":"2024-04-18T21:10:48.557724+0000","last_peered":"2024-04-18T21:10:48.557724+0000","last_clean":"2024-04-18T21:10:48.557724+0000","last_became_active":"2024-04-18T21:05:05.641983+0000","last_became_peered":"2024-04-18T21:05:05.641983+0000","last_unstale":"2024-04-18T21:10:48.557724+0000","last_undegraded":"2024-04-18T21:10:48.557724+0000","last_fullsized":"2024-04-18T21:10:48.557724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'493","last_scrub_stamp":"2024-04-18T21:10:48.557463+0000","last_deep_scrub":"71'493","last_deep_scrub_stamp":"2024-04-18T21:10:48.557463+0000","last_clean_scrub_stamp":"2024-04-18T21:10:48.557463+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:04:29.234438+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23833,"num_write":461,"num_write_kb":76873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"70'62","reported_seq":266,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:47.555859+0000","last_change":"2024-04-18T21:10:47.555993+0000","last_active":"2024-04-18T21:10:47.555859+0000","last_peered":"2024-04-18T21:10:47.555859+0000","last_clean":"2024-04-18T21:10:47.555859+0000","last_became_active":"2024-04-18T21:05:04.640682+0000","last_became_peered":"2024-04-18T21:05:04.640682+0000","last_unstale":"2024-04-18T21:10:47.555859+0000","last_undegraded":"2024-04-18T21:10:47.555859+0000","last_fullsized":"2024-04-18T21:10:47.555859+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'62","last_scrub_stamp":"2024-04-18T21:10:47.555640+0000","last_deep_scrub":"70'62","last_deep_scrub_stamp":"2024-04-18T21:10:47.555640+0000","last_clean_scrub_stamp":"2024-04-18T21:10:47.555640+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:23:56.871085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'436","reported_seq":1072,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:11:00.528198+0000","last_change":"2024-04-18T21:11:00.528257+0000","last_active":"2024-04-18T21:11:00.528198+0000","last_peered":"2024-04-18T21:11:00.528198+0000","last_clean":"2024-04-18T21:11:00.528198+0000","last_became_active":"2024-04-18T21:10:18.487788+0000","last_became_peered":"2024-04-18T21:10:18.487788+0000","last_unstale":"2024-04-18T21:11:00.528198+0000","last_undegraded":"2024-04-18T21:11:00.528198+0000","last_fullsized":"2024-04-18T21:11:00.528198+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'436","last_scrub_stamp":"2024-04-18T21:11:00.527969+0000","last_deep_scrub":"71'436","last_deep_scrub_stamp":"2024-04-18T21:11:00.527969+0000","last_clean_scrub_stamp":"2024-04-18T21:11:00.527969+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:26:22.075429+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14561,"num_write":408,"num_write_kb":47462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'369","reported_seq":580,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:31.654504+0000","last_change":"2024-04-18T21:10:31.654562+0000","last_active":"2024-04-18T21:10:31.654504+0000","last_peered":"2024-04-18T21:10:31.654504+0000","last_clean":"2024-04-18T21:10:31.654504+0000","last_became_active":"2024-04-18T21:10:02.549471+0000","last_became_peered":"2024-04-18T21:10:02.549471+0000","last_unstale":"2024-04-18T21:10:31.654504+0000","last_undegraded":"2024-04-18T21:10:31.654504+0000","last_fullsized":"2024-04-18T21:10:31.654504+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'369","last_scrub_stamp":"2024-04-18T21:10:31.654287+0000","last_deep_scrub":"71'369","last_deep_scrub_stamp":"2024-04-18T21:10:31.654287+0000","last_clean_scrub_stamp":"2024-04-18T21:10:31.654287+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:16:49.779174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13619,"num_write":339,"num_write_kb":63086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"108'890","reported_seq":1041,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:31.491964+0000","last_change":"2024-04-18T21:10:31.492036+0000","last_active":"2024-04-18T21:10:31.491964+0000","last_peered":"2024-04-18T21:10:31.491964+0000","last_clean":"2024-04-18T21:10:31.491964+0000","last_became_active":"2024-04-18T21:10:03.480576+0000","last_became_peered":"2024-04-18T21:10:03.480576+0000","last_unstale":"2024-04-18T21:10:31.491964+0000","last_undegraded":"2024-04-18T21:10:31.491964+0000","last_fullsized":"2024-04-18T21:10:31.491964+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'890","last_scrub_stamp":"2024-04-18T21:10:31.491761+0000","last_deep_scrub":"108'890","last_deep_scrub_stamp":"2024-04-18T21:10:31.491761+0000","last_clean_scrub_stamp":"2024-04-18T21:10:31.491761+0000","objects_scrubbed":2,"log_size":890,"log_dups_size":0,"ondisk_log_size":890,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:42:36.359076+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":823,"num_write_kb":8582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'398","reported_seq":571,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:43.534709+0000","last_change":"2024-04-18T21:10:43.534842+0000","last_active":"2024-04-18T21:10:43.534709+0000","last_peered":"2024-04-18T21:10:43.534709+0000","last_clean":"2024-04-18T21:10:43.534709+0000","last_became_active":"2024-04-18T21:10:03.483190+0000","last_became_peered":"2024-04-18T21:10:03.483190+0000","last_unstale":"2024-04-18T21:10:43.534709+0000","last_undegraded":"2024-04-18T21:10:43.534709+0000","last_fullsized":"2024-04-18T21:10:43.534709+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'398","last_scrub_stamp":"2024-04-18T21:10:43.534459+0000","last_deep_scrub":"71'398","last_deep_scrub_stamp":"2024-04-18T21:10:43.534459+0000","last_clean_scrub_stamp":"2024-04-18T21:10:43.534459+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:28:54.469077+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14684,"num_write":380,"num_write_kb":88822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"108'170","reported_seq":394,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:44.551586+0000","last_change":"2024-04-18T21:10:44.551659+0000","last_active":"2024-04-18T21:10:44.551586+0000","last_peered":"2024-04-18T21:10:44.551586+0000","last_clean":"2024-04-18T21:10:44.551586+0000","last_became_active":"2024-04-18T21:10:00.492196+0000","last_became_peered":"2024-04-18T21:10:00.492196+0000","last_unstale":"2024-04-18T21:10:44.551586+0000","last_undegraded":"2024-04-18T21:10:44.551586+0000","last_fullsized":"2024-04-18T21:10:44.551586+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'170","last_scrub_stamp":"2024-04-18T21:10:44.551394+0000","last_deep_scrub":"108'170","last_deep_scrub_stamp":"2024-04-18T21:10:44.551394+0000","last_clean_scrub_stamp":"2024-04-18T21:10:44.551394+0000","objects_scrubbed":1,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:01:00.353327+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":4162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'406","reported_seq":639,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:58.552343+0000","last_change":"2024-04-18T21:10:58.552405+0000","last_active":"2024-04-18T21:10:58.552343+0000","last_peered":"2024-04-18T21:10:58.552343+0000","last_clean":"2024-04-18T21:10:58.552343+0000","last_became_active":"2024-04-18T21:10:12.546148+0000","last_became_peered":"2024-04-18T21:10:12.546148+0000","last_unstale":"2024-04-18T21:10:58.552343+0000","last_undegraded":"2024-04-18T21:10:58.552343+0000","last_fullsized":"2024-04-18T21:10:58.552343+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'406","last_scrub_stamp":"2024-04-18T21:10:58.552115+0000","last_deep_scrub":"71'406","last_deep_scrub_stamp":"2024-04-18T21:10:58.552115+0000","last_clean_scrub_stamp":"2024-04-18T21:10:58.552115+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:06:54.618187+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27495,"num_write":363,"num_write_kb":89134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"108'195","reported_seq":397,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:51.714447+0000","last_change":"2024-04-18T21:10:51.714608+0000","last_active":"2024-04-18T21:10:51.714447+0000","last_peered":"2024-04-18T21:10:51.714447+0000","last_clean":"2024-04-18T21:10:51.714447+0000","last_became_active":"2024-04-18T21:09:53.541300+0000","last_became_peered":"2024-04-18T21:09:53.541300+0000","last_unstale":"2024-04-18T21:10:51.714447+0000","last_undegraded":"2024-04-18T21:10:51.714447+0000","last_fullsized":"2024-04-18T21:10:51.714447+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'195","last_scrub_stamp":"2024-04-18T21:10:51.714203+0000","last_deep_scrub":"108'195","last_deep_scrub_stamp":"2024-04-18T21:10:51.714203+0000","last_clean_scrub_stamp":"2024-04-18T21:10:51.714203+0000","objects_scrubbed":3,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:33:20.299473+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12425030,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":12201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8230726,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"71'383","reported_seq":626,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:54.628357+0000","last_change":"2024-04-18T21:10:54.628447+0000","last_active":"2024-04-18T21:10:54.628357+0000","last_peered":"2024-04-18T21:10:54.628357+0000","last_clean":"2024-04-18T21:10:54.628357+0000","last_became_active":"2024-04-18T21:09:55.551135+0000","last_became_peered":"2024-04-18T21:09:55.551135+0000","last_unstale":"2024-04-18T21:10:54.628357+0000","last_undegraded":"2024-04-18T21:10:54.628357+0000","last_fullsized":"2024-04-18T21:10:54.628357+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'383","last_scrub_stamp":"2024-04-18T21:10:54.628157+0000","last_deep_scrub":"71'383","last_deep_scrub_stamp":"2024-04-18T21:10:54.628157+0000","last_clean_scrub_stamp":"2024-04-18T21:10:54.628157+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:55:11.552842+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21614,"num_write":351,"num_write_kb":79501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"108'67","reported_seq":169,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:40.597558+0000","last_change":"2024-04-18T21:10:40.597631+0000","last_active":"2024-04-18T21:10:40.597558+0000","last_peered":"2024-04-18T21:10:40.597558+0000","last_clean":"2024-04-18T21:10:40.597558+0000","last_became_active":"2024-04-18T21:10:00.552067+0000","last_became_peered":"2024-04-18T21:10:00.552067+0000","last_unstale":"2024-04-18T21:10:40.597558+0000","last_undegraded":"2024-04-18T21:10:40.597558+0000","last_fullsized":"2024-04-18T21:10:40.597558+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'67","last_scrub_stamp":"2024-04-18T21:10:40.597370+0000","last_deep_scrub":"108'67","last_deep_scrub_stamp":"2024-04-18T21:10:40.597370+0000","last_clean_scrub_stamp":"2024-04-18T21:10:40.597370+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:15:48.004532+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"71'345","reported_seq":555,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:55.422310+0000","last_change":"2024-04-18T21:10:55.422370+0000","last_active":"2024-04-18T21:10:55.422310+0000","last_peered":"2024-04-18T21:10:55.422310+0000","last_clean":"2024-04-18T21:10:55.422310+0000","last_became_active":"2024-04-18T21:05:05.622950+0000","last_became_peered":"2024-04-18T21:05:05.622950+0000","last_unstale":"2024-04-18T21:10:55.422310+0000","last_undegraded":"2024-04-18T21:10:55.422310+0000","last_fullsized":"2024-04-18T21:10:55.422310+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'345","last_scrub_stamp":"2024-04-18T21:10:55.422077+0000","last_deep_scrub":"71'345","last_deep_scrub_stamp":"2024-04-18T21:10:55.422077+0000","last_clean_scrub_stamp":"2024-04-18T21:10:55.422077+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T00:41:50.413711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":317,"num_write_kb":29335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"108'173","reported_seq":297,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:30.553140+0000","last_change":"2024-04-18T21:10:30.553214+0000","last_active":"2024-04-18T21:10:30.553140+0000","last_peered":"2024-04-18T21:10:30.553140+0000","last_clean":"2024-04-18T21:10:30.553140+0000","last_became_active":"2024-04-18T21:10:00.507132+0000","last_became_peered":"2024-04-18T21:10:00.507132+0000","last_unstale":"2024-04-18T21:10:30.553140+0000","last_undegraded":"2024-04-18T21:10:30.553140+0000","last_fullsized":"2024-04-18T21:10:30.553140+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'173","last_scrub_stamp":"2024-04-18T21:10:30.552952+0000","last_deep_scrub":"108'173","last_deep_scrub_stamp":"2024-04-18T21:10:30.552952+0000","last_clean_scrub_stamp":"2024-04-18T21:10:30.552952+0000","objects_scrubbed":2,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:57:31.144534+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":4154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"71'417","reported_seq":652,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:57.432668+0000","last_change":"2024-04-18T21:10:57.432732+0000","last_active":"2024-04-18T21:10:57.432668+0000","last_peered":"2024-04-18T21:10:57.432668+0000","last_clean":"2024-04-18T21:10:57.432668+0000","last_became_active":"2024-04-18T21:05:05.626698+0000","last_became_peered":"2024-04-18T21:05:05.626698+0000","last_unstale":"2024-04-18T21:10:57.432668+0000","last_undegraded":"2024-04-18T21:10:57.432668+0000","last_fullsized":"2024-04-18T21:10:57.432668+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'417","last_scrub_stamp":"2024-04-18T21:10:57.432466+0000","last_deep_scrub":"71'417","last_deep_scrub_stamp":"2024-04-18T21:10:57.432466+0000","last_clean_scrub_stamp":"2024-04-18T21:10:57.432466+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:24:06.747911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":17040,"num_write":384,"num_write_kb":83740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"108'280","reported_seq":484,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:52.720341+0000","last_change":"2024-04-18T21:10:52.720510+0000","last_active":"2024-04-18T21:10:52.720341+0000","last_peered":"2024-04-18T21:10:52.720341+0000","last_clean":"2024-04-18T21:10:52.720341+0000","last_became_active":"2024-04-18T21:09:53.542863+0000","last_became_peered":"2024-04-18T21:09:53.542863+0000","last_unstale":"2024-04-18T21:10:52.720341+0000","last_undegraded":"2024-04-18T21:10:52.720341+0000","last_fullsized":"2024-04-18T21:10:52.720341+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'280","last_scrub_stamp":"2024-04-18T21:10:52.720095+0000","last_deep_scrub":"108'280","last_deep_scrub_stamp":"2024-04-18T21:10:52.720095+0000","last_clean_scrub_stamp":"2024-04-18T21:10:52.720095+0000","objects_scrubbed":4,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:41:31.675811+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":12399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"71'428","reported_seq":646,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:45.601257+0000","last_change":"2024-04-18T21:10:45.601323+0000","last_active":"2024-04-18T21:10:45.601257+0000","last_peered":"2024-04-18T21:10:45.601257+0000","last_clean":"2024-04-18T21:10:45.601257+0000","last_became_active":"2024-04-18T21:10:08.536423+0000","last_became_peered":"2024-04-18T21:10:08.536423+0000","last_unstale":"2024-04-18T21:10:45.601257+0000","last_undegraded":"2024-04-18T21:10:45.601257+0000","last_fullsized":"2024-04-18T21:10:45.601257+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'428","last_scrub_stamp":"2024-04-18T21:10:45.601066+0000","last_deep_scrub":"71'428","last_deep_scrub_stamp":"2024-04-18T21:10:45.601066+0000","last_clean_scrub_stamp":"2024-04-18T21:10:45.601066+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T01:01:38.123320+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22548,"num_write":398,"num_write_kb":75972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"108'71","reported_seq":284,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:53.550449+0000","last_change":"2024-04-18T21:10:53.550449+0000","last_active":"2024-04-18T21:10:53.550449+0000","last_peered":"2024-04-18T21:10:53.550449+0000","last_clean":"2024-04-18T21:10:53.550449+0000","last_became_active":"2024-04-18T21:09:50.832355+0000","last_became_peered":"2024-04-18T21:09:50.832355+0000","last_unstale":"2024-04-18T21:10:53.550449+0000","last_undegraded":"2024-04-18T21:10:53.550449+0000","last_fullsized":"2024-04-18T21:10:53.550449+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'71","last_scrub_stamp":"2024-04-18T21:10:53.550189+0000","last_deep_scrub":"108'71","last_deep_scrub_stamp":"2024-04-18T21:10:53.550189+0000","last_clean_scrub_stamp":"2024-04-18T21:10:53.550189+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:44:54.363509+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'459","reported_seq":651,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:11:01.389589+0000","last_change":"2024-04-18T21:11:01.389652+0000","last_active":"2024-04-18T21:11:01.389589+0000","last_peered":"2024-04-18T21:11:01.389589+0000","last_clean":"2024-04-18T21:11:01.389589+0000","last_became_active":"2024-04-18T21:10:01.497275+0000","last_became_peered":"2024-04-18T21:10:01.497275+0000","last_unstale":"2024-04-18T21:11:01.389589+0000","last_undegraded":"2024-04-18T21:11:01.389589+0000","last_fullsized":"2024-04-18T21:11:01.389589+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'459","last_scrub_stamp":"2024-04-18T21:11:01.389367+0000","last_deep_scrub":"71'459","last_deep_scrub_stamp":"2024-04-18T21:11:01.389367+0000","last_clean_scrub_stamp":"2024-04-18T21:11:01.389367+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T02:28:22.853022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13353,"num_write":429,"num_write_kb":88123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"108'116","reported_seq":344,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-18T21:10:40.518272+0000","last_change":"2024-04-18T21:10:40.518341+0000","last_active":"2024-04-18T21:10:40.518272+0000","last_peered":"2024-04-18T21:10:40.518272+0000","last_clean":"2024-04-18T21:10:40.518272+0000","last_became_active":"2024-04-18T21:10:00.494734+0000","last_became_peered":"2024-04-18T21:10:00.494734+0000","last_unstale":"2024-04-18T21:10:40.518272+0000","last_undegraded":"2024-04-18T21:10:40.518272+0000","last_fullsized":"2024-04-18T21:10:40.518272+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"108'116","last_scrub_stamp":"2024-04-18T21:10:40.518067+0000","last_deep_scrub":"108'116","last_deep_scrub_stamp":"2024-04-18T21:10:40.518067+0000","last_clean_scrub_stamp":"2024-04-18T21:10:40.518067+0000","objects_scrubbed":3,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T23:48:47.813001+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194886,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2531,"num_read_kb":1304649,"num_write":24542,"num_write_kb":4299443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8145,"num_bytes_recovered":4488063,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26603,"ondisk_log_size":26603,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127139127,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":55,"num_read_kb":1405,"num_write":4542,"num_write_kb":127514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":92002768,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254345216,"data_stored":254278254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4409,"internal_metadata":0},"log_size":6383,"ondisk_log_size":6383,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738448,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":187616,"kb_used_data":80152,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94184224,"statfs":{"total":96636764160,"available":96444645376,"internally_reserved":0,"allocated":82075648,"data_stored":81480582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110033349},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":77,"seq":330712481809,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":130644,"kb_used_data":83404,"kb_used_omap":5,"kb_used_meta":47226,"kb_avail":94241196,"statfs":{"total":96636764160,"available":96502984704,"internally_reserved":0,"allocated":85405696,"data_stored":84799073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6004,"internal_metadata":48359564},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738446,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":160464,"kb_used_data":89096,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94211376,"statfs":{"total":96636764160,"available":96472449024,"internally_reserved":0,"allocated":91234304,"data_stored":90618294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":89579520,"data_stored":89548273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":83750912,"data_stored":83729052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4409,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81014784,"data_stored":81000929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T21:11:10.409 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-18T21:11:10.771 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-18T21:11:10.771 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T21:11:11.081 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:11:11.081 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T21:05:04.973678+0000","modified":"2024-04-18T21:05:06.980882+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4202},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4202":{"gid":4202,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6803/1197504751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1197504751},{"type":"v1","addr":"172.21.15.78:6803","nonce":1197504751}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4202,"qdb_cluster":[4202]},"id":1}]} 2024-04-18T21:11:11.082 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 5 2024-04-18T21:11:11.099 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T21:11:11.398 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:11:11.398 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T21:05:04.973678+0000","modified":"2024-04-18T21:05:06.980882+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4202},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4202":{"gid":4202,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6803/1197504751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1197504751},{"type":"v1","addr":"172.21.15.78:6803","nonce":1197504751}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4202,"qdb_cluster":[4202]},"id":1}]} 2024-04-18T21:11:11.399 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 5 2024-04-18T21:11:11.416 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T21:11:11.712 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-18T21:11:11.712 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":108,"fsid":"dc017990-0393-4ab0-b604-5e7052fdc7bd","created":"2024-04-18T21:04:43.507538+0000","modified":"2024-04-18T21:10:20.469805+0000","last_up_change":"2024-04-18T21:09:49.735843+0000","last_in_change":"2024-04-18T21:04:44.402191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T21:04:52.538153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T21:04:58.673793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T21:05:03.314171+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T21:05:03.931699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1854d737-3a67-416a-8c88-0f126505a0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6801","nonce":1948809768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6803","nonce":1948809768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6807","nonce":1948809768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1948809768},{"type":"v1","addr":"172.21.15.132:6805","nonce":1948809768}]},"public_addr":"172.21.15.132:6801/1948809768","cluster_addr":"172.21.15.132:6803/1948809768","heartbeat_back_addr":"172.21.15.132:6807/1948809768","heartbeat_front_addr":"172.21.15.132:6805/1948809768","state":["exists","up"]},{"osd":1,"uuid":"dfeae661-3f8a-4d41-b287-7eb02c16b91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":55,"up_from":77,"up_thru":105,"down_at":56,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":806525864},{"type":"v1","addr":"172.21.15.150:6801","nonce":806525864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":806525864},{"type":"v1","addr":"172.21.15.150:6803","nonce":806525864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":806525864},{"type":"v1","addr":"172.21.15.150:6807","nonce":806525864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":806525864},{"type":"v1","addr":"172.21.15.150:6805","nonce":806525864}]},"public_addr":"172.21.15.150:6801/806525864","cluster_addr":"172.21.15.150:6803/806525864","heartbeat_back_addr":"172.21.15.150:6807/806525864","heartbeat_front_addr":"172.21.15.150:6805/806525864","state":["exists","up"]},{"osd":2,"uuid":"56a34021-e2dc-41ff-822c-7ec123466f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6801","nonce":429896900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6803","nonce":429896900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6807","nonce":429896900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":429896900},{"type":"v1","addr":"172.21.15.187:6805","nonce":429896900}]},"public_addr":"172.21.15.187:6801/429896900","cluster_addr":"172.21.15.187:6803/429896900","heartbeat_back_addr":"172.21.15.187:6807/429896900","heartbeat_front_addr":"172.21.15.187:6805/429896900","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:49.804359+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:49.790978+0000","dead_epoch":55},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T21:04:49.762943+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T21:11:11.731 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-18T21:11:12.042 INFO:teuthology.orchestra.run.smithi078.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-18T21:11:12.067 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-18T21:11:12.090 INFO:tasks.ceph.mds.a.smithi078.stdout:starting mds.a at 2024-04-18T21:11:13.076 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-18T21:11:14.054 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' removed 2024-04-18T21:11:14.078 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-18T21:11:15.063 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' removed 2024-04-18T21:11:15.085 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-18T21:11:15.085 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-18T21:11:15.085 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T21:11:15.096 INFO:tasks.ceph.mds.a:Stopped 2024-04-18T21:11:15.096 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-18T21:11:15.096 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-18T21:11:15.096 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T21:11:15.180 INFO:tasks.ceph.osd.0:Stopped 2024-04-18T21:11:15.180 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-18T21:11:15.180 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T21:11:15.267 INFO:tasks.ceph.osd.1:Stopped 2024-04-18T21:11:15.267 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-18T21:11:15.267 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T21:11:20.151 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-04-18T21:11:21.369 INFO:tasks.ceph.osd.2:Stopped 2024-04-18T21:11:21.369 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-18T21:11:21.370 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-18T21:11:21.370 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T21:11:21.397 INFO:tasks.ceph.mgr.x:Stopped 2024-04-18T21:11:21.398 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-18T21:11:21.398 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T21:11:21.469 INFO:tasks.ceph.mgr.y:Stopped 2024-04-18T21:11:21.469 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-18T21:11:21.469 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-18T21:11:21.470 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T21:11:21.528 INFO:tasks.ceph.mon.a:Stopped 2024-04-18T21:11:21.528 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-18T21:11:21.529 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T21:11:21.590 INFO:tasks.ceph.mon.b:Stopped 2024-04-18T21:11:21.590 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-18T21:11:21.590 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T21:11:21.646 INFO:tasks.ceph.mon.c:Stopped 2024-04-18T21:11:21.646 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-18T21:11:21.647 DEBUG:teuthology.orchestra.run.smithi078:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MDS_TRIM\)' | egrep -v '\(MDS_SLOW_REQUEST\)' | egrep -v MDS_SLOW_METADATA_IO | egrep -v 'Behind on trimming' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | head -n 1 2024-04-18T21:11:21.709 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi132.front.sepia.ceph.com 2024-04-18T21:11:21.709 DEBUG:teuthology.orchestra.run.smithi132:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-18T21:11:21.806 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi150.front.sepia.ceph.com 2024-04-18T21:11:21.806 DEBUG:teuthology.orchestra.run.smithi150:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-18T21:11:22.033 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi187.front.sepia.ceph.com 2024-04-18T21:11:22.034 DEBUG:teuthology.orchestra.run.smithi187:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-18T21:11:22.198 INFO:tasks.ceph:Archiving mon data... 2024-04-18T21:11:22.202 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-04-18_20:32:14-powercycle-main-distro-default-smithi/7662458/data/mon.a.tgz 2024-04-18T21:11:22.202 DEBUG:teuthology.orchestra.run.smithi078:> mktemp 2024-04-18T21:11:22.208 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.SWZBZpQ3BR 2024-04-18T21:11:22.208 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.SWZBZpQ3BR 2024-04-18T21:11:22.354 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.SWZBZpQ3BR 2024-04-18T21:11:22.416 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.SWZBZpQ3BR is 418KB 2024-04-18T21:11:22.479 DEBUG:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.SWZBZpQ3BR 2024-04-18T21:11:22.485 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-04-18_20:32:14-powercycle-main-distro-default-smithi/7662458/data/mon.b.tgz 2024-04-18T21:11:22.485 DEBUG:teuthology.orchestra.run.smithi078:> mktemp 2024-04-18T21:11:22.533 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.8KwgUfNzHm 2024-04-18T21:11:22.534 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.8KwgUfNzHm 2024-04-18T21:11:22.719 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.8KwgUfNzHm 2024-04-18T21:11:22.781 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.8KwgUfNzHm is 579KB 2024-04-18T21:11:22.844 DEBUG:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.8KwgUfNzHm 2024-04-18T21:11:22.849 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-04-18_20:32:14-powercycle-main-distro-default-smithi/7662458/data/mon.c.tgz 2024-04-18T21:11:22.849 DEBUG:teuthology.orchestra.run.smithi078:> mktemp 2024-04-18T21:11:22.899 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.TXTkDSTX1m 2024-04-18T21:11:22.899 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.TXTkDSTX1m 2024-04-18T21:11:23.080 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.TXTkDSTX1m 2024-04-18T21:11:23.141 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.TXTkDSTX1m is 578KB 2024-04-18T21:11:23.207 DEBUG:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.TXTkDSTX1m 2024-04-18T21:11:23.212 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-18T21:11:23.212 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-18T21:11:23.256 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-18T21:11:23.259 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-18T21:11:23.261 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-18T21:11:23.365 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-18T21:11:23.371 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-18T21:11:23.399 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-18T21:11:23.406 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-18T21:11:23.406 INFO:tasks.ceph:Archiving crash dumps... 2024-04-18T21:11:23.407 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-18_20:32:14-powercycle-main-distro-default-smithi/7662458/remote/smithi078/crash 2024-04-18T21:11:23.408 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-18T21:11:23.422 DEBUG:teuthology.misc:Transferring archived files from smithi132:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-18_20:32:14-powercycle-main-distro-default-smithi/7662458/remote/smithi132/crash 2024-04-18T21:11:23.423 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-18T21:11:23.438 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-18_20:32:14-powercycle-main-distro-default-smithi/7662458/remote/smithi150/crash 2024-04-18T21:11:23.439 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-18T21:11:23.469 DEBUG:teuthology.misc:Transferring archived files from smithi187:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-18_20:32:14-powercycle-main-distro-default-smithi/7662458/remote/smithi187/crash 2024-04-18T21:11:23.471 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-18T21:11:23.485 INFO:tasks.ceph:Compressing logs... 2024-04-18T21:11:23.485 DEBUG:teuthology.orchestra.run.smithi078:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-18T21:11:23.492 DEBUG:teuthology.orchestra.run.smithi132:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-18T21:11:23.495 DEBUG:teuthology.orchestra.run.smithi150:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-18T21:11:23.515 DEBUG:teuthology.orchestra.run.smithi187:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-18T21:11:23.519 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23986.log 2024-04-18T21:11:23.520 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21710.log 2024-04-18T21:11:23.520 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.23986.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23986.log.gz 2024-04-18T21:11:23.520 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28349.log 2024-04-18T21:11:23.535 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-18T21:11:23.535 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.741.log 2024-04-18T21:11:23.535 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.741.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.741.log.gz 2024-04-18T21:11:23.587 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-18T21:11:23.611 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-18T21:11:23.611 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21664.log 2024-04-18T21:11:23.612 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21688.log 2024-04-18T21:11:23.612 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.21664.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21664.log.gz 2024-04-18T21:11:23.612 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21712.log 2024-04-18T21:11:23.612 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.21688.log: /var/log/ceph/ceph-client.admin.21712.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21712.log.gz 2024-04-18T21:11:23.612 INFO:teuthology.orchestra.run.smithi187.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21688.log.gz 2024-04-18T21:11:23.648 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.21710.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21710.log.gz 2024-04-18T21:11:23.648 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25799.log 2024-04-18T21:11:23.648 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27198.log 2024-04-18T21:11:23.648 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.28349.log: /var/log/ceph/ceph-client.admin.25799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21196.log 2024-04-18T21:11:23.648 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25799.log.gz 2024-04-18T21:11:23.648 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28349.log.gz 2024-04-18T21:11:23.648 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.27198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27359.log 2024-04-18T21:11:23.648 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27198.log.gz 2024-04-18T21:11:23.648 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.21196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21044.log 2024-04-18T21:11:23.648 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21196.log.gz 2024-04-18T21:11:23.648 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.27359.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27359.log.gz 2024-04-18T21:11:23.649 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21528.log 2024-04-18T21:11:23.649 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23955.log 2024-04-18T21:11:23.649 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.21044.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21044.log.gz 2024-04-18T21:11:23.649 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.21528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24529.log 2024-04-18T21:11:23.649 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21528.log.gz 2024-04-18T21:11:23.649 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.23955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24389.log 2024-04-18T21:11:23.649 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23955.log.gz 2024-04-18T21:11:23.649 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.24529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21606.log 2024-04-18T21:11:23.649 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24529.log.gz 2024-04-18T21:11:23.649 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.24389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21225.log 2024-04-18T21:11:23.649 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24389.log.gz 2024-04-18T21:11:23.649 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.21606.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21606.log.gz 2024-04-18T21:11:23.650 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-18T21:11:23.650 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27229.log 2024-04-18T21:11:23.650 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.21225.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21225.log.gz 2024-04-18T21:11:23.650 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27100.log 2024-04-18T21:11:23.650 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.27229.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.27229.log.gz 2024-04-18T21:11:23.650 INFO:teuthology.orchestra.run.smithi078.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.23193.log 2024-04-18T21:11:23.650 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23219.log 2024-04-18T21:11:23.650 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.27100.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27100.log.gz 2024-04-18T21:11:23.650 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.23193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26813.log 2024-04-18T21:11:23.650 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23193.log.gz 2024-04-18T21:11:23.651 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.23219.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23219.log.gz 2024-04-18T21:11:23.651 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24658.log 2024-04-18T21:11:23.651 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24584.log 2024-04-18T21:11:23.651 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.26813.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26813.log.gz 2024-04-18T21:11:23.651 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.24658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27907.log 2024-04-18T21:11:23.651 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24658.log.gz 2024-04-18T21:11:23.651 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.24584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28555.log 2024-04-18T21:11:23.651 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24584.log.gz 2024-04-18T21:11:23.651 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.27907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26750.log 2024-04-18T21:11:23.651 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27907.log.gz 2024-04-18T21:11:23.651 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.28555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26310.log 2024-04-18T21:11:23.651 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28555.log.gz 2024-04-18T21:11:23.652 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.26750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27075.log 2024-04-18T21:11:23.652 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26750.log.gz 2024-04-18T21:11:23.652 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.26310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24358.log 2024-04-18T21:11:23.652 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26310.log.gz 2024-04-18T21:11:23.652 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.27075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22362.log 2024-04-18T21:11:23.652 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27075.log.gz 2024-04-18T21:11:23.652 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.24358.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.28193.log 2024-04-18T21:11:23.652 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.24358.log.gz 2024-04-18T21:11:23.652 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.22362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21498.log 2024-04-18T21:11:23.652 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22362.log.gz 2024-04-18T21:11:23.652 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.28193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27522.log 2024-04-18T21:11:23.652 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28193.log.gz 2024-04-18T21:11:23.653 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.21498.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.21498.log.gz 2024-04-18T21:11:23.653 INFO:teuthology.orchestra.run.smithi078.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.24183.log 2024-04-18T21:11:23.653 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.27522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24151.log 2024-04-18T21:11:23.653 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27522.log.gz 2024-04-18T21:11:23.653 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.24183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23872.log 2024-04-18T21:11:23.653 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24183.log.gz 2024-04-18T21:11:23.653 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.24151.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24151.log.gz 2024-04-18T21:11:23.653 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26284.log 2024-04-18T21:11:23.653 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.23872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21580.log 2024-04-18T21:11:23.653 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23872.log.gz 2024-04-18T21:11:23.653 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.26284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21742.log 2024-04-18T21:11:23.653 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26284.log.gz 2024-04-18T21:11:23.653 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.21580.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.21580.log.gz 2024-04-18T21:11:23.654 INFO:teuthology.orchestra.run.smithi078.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.21472.log 2024-04-18T21:11:23.654 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.21742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22972.log 2024-04-18T21:11:23.654 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21742.log.gz 2024-04-18T21:11:23.654 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.21472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23078.log 2024-04-18T21:11:23.654 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21472.log.gz 2024-04-18T21:11:23.654 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.22972.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22972.log.gz 2024-04-18T21:11:23.654 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26559.log 2024-04-18T21:11:23.654 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.23078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26180.log 2024-04-18T21:11:23.654 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23078.log.gz 2024-04-18T21:11:23.654 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.26559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26098.log 2024-04-18T21:11:23.654 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26559.log.gz 2024-04-18T21:11:23.654 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.26180.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26180.log.gz 2024-04-18T21:11:23.654 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27679.log 2024-04-18T21:11:23.655 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.26098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26803.log 2024-04-18T21:11:23.655 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26098.log.gz 2024-04-18T21:11:23.655 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.27679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26807.log 2024-04-18T21:11:23.655 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27679.log.gz 2024-04-18T21:11:23.655 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.26803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27775.log 2024-04-18T21:11:23.655 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26803.log.gz 2024-04-18T21:11:23.655 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.26807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23843.log 2024-04-18T21:11:23.655 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26807.log.gz 2024-04-18T21:11:23.655 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.27775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28503.log 2024-04-18T21:11:23.655 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27775.log.gz 2024-04-18T21:11:23.655 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.23843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24268.log 2024-04-18T21:11:23.656 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23843.log.gz 2024-04-18T21:11:23.656 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.28503.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28503.log.gz 2024-04-18T21:11:23.656 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20868.log 2024-04-18T21:11:23.656 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.24268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21329.log 2024-04-18T21:11:23.656 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24268.log.gz 2024-04-18T21:11:23.656 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27521.log 2024-04-18T21:11:23.656 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.20868.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20868.log.gz 2024-04-18T21:11:23.656 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.21329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26039.log 2024-04-18T21:11:23.656 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21329.log.gz 2024-04-18T21:11:23.656 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.27521.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27521.log.gz 2024-04-18T21:11:23.656 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26935.log 2024-04-18T21:11:23.656 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.26039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21251.log 2024-04-18T21:11:23.656 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26039.log.gz 2024-04-18T21:11:23.656 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.26935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26094.log 2024-04-18T21:11:23.657 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26935.log.gz 2024-04-18T21:11:23.657 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.21251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28652.log 2024-04-18T21:11:23.657 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21251.log.gz 2024-04-18T21:11:23.657 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.26094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23364.log 2024-04-18T21:11:23.657 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26094.log.gz 2024-04-18T21:11:23.657 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.28652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23000.log 2024-04-18T21:11:23.657 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28652.log.gz 2024-04-18T21:11:23.657 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.23364.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.23364.log.gz -5 2024-04-18T21:11:23.657 INFO:teuthology.orchestra.run.smithi078.stderr: --verbose -- /var/log/ceph/ceph-client.admin.26256.log 2024-04-18T21:11:23.657 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.23000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23929.log 2024-04-18T21:11:23.657 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23000.log.gz 2024-04-18T21:11:23.657 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.26256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27411.log 2024-04-18T21:11:23.657 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26256.log.gz 2024-04-18T21:11:23.657 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.23929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25738.log 2024-04-18T21:11:23.658 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23929.log.gz 2024-04-18T21:11:23.658 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.27411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21996.log 2024-04-18T21:11:23.658 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27411.log.gz 2024-04-18T21:11:23.658 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.25738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27985.log 2024-04-18T21:11:23.658 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25738.log.gz 2024-04-18T21:11:23.658 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.21996.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21996.log.gz 2024-04-18T21:11:23.659 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23276.log 2024-04-18T21:11:23.659 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.27985.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-18T21:11:23.659 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27985.log.gz 2024-04-18T21:11:23.659 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.23276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28063.log 2024-04-18T21:11:23.659 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23276.log.gz 2024-04-18T21:11:23.659 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28245.log 2024-04-18T21:11:23.659 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.28063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25906.log 2024-04-18T21:11:23.660 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28063.log.gz 2024-04-18T21:11:23.660 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.28245.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28245.log.gz 2024-04-18T21:11:23.660 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25015.log 2024-04-18T21:11:23.660 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.25906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26909.log 2024-04-18T21:11:23.660 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25906.log.gz 2024-04-18T21:11:23.660 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.25015.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25015.log.gz 2024-04-18T21:11:23.661 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26590.log 2024-04-18T21:11:23.661 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.26909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24068.log 2024-04-18T21:11:23.661 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26909.log.gz 2024-04-18T21:11:23.661 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.26590.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26590.log.gz 2024-04-18T21:11:23.661 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22284.log 2024-04-18T21:11:23.661 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.24068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27385.log 2024-04-18T21:11:23.661 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24068.log.gz 2024-04-18T21:11:23.662 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.22284.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22284.log.gz 2024-04-18T21:11:23.662 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26672.log 2024-04-18T21:11:23.662 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.27385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27801.log 2024-04-18T21:11:23.662 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27385.log.gz 2024-04-18T21:11:23.662 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.26672.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26672.log.gz 2024-04-18T21:11:23.662 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28219.log 2024-04-18T21:11:23.663 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.27801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21896.log 2024-04-18T21:11:23.663 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27801.log.gz 2024-04-18T21:11:23.663 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.28219.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28219.log.gz 2024-04-18T21:11:23.663 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25315.log 2024-04-18T21:11:23.663 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.21896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26777.log 2024-04-18T21:11:23.663 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21896.log.gz 2024-04-18T21:11:23.663 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.25315.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25315.log.gz 2024-04-18T21:11:23.664 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24855.log 2024-04-18T21:11:23.664 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.26777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27601.log 2024-04-18T21:11:23.664 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26777.log.gz 2024-04-18T21:11:23.664 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.24855.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24855.log.gz 2024-04-18T21:11:23.664 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28089.log 2024-04-18T21:11:23.664 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.27601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26365.log 2024-04-18T21:11:23.664 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27601.log.gz 2024-04-18T21:11:23.664 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.28089.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28089.log.gz 2024-04-18T21:11:23.664 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28141.log 2024-04-18T21:11:23.665 INFO:teuthology.orchestra.run.smithi078.stderr:gzip/var/log/ceph/ceph-client.admin.26365.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.26504.log 2024-04-18T21:11:23.665 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26365.log.gz 2024-04-18T21:11:23.665 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.28141.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28141.log.gz -5 2024-04-18T21:11:23.665 INFO:teuthology.orchestra.run.smithi078.stderr: --verbose -- /var/log/ceph/ceph-client.admin.22468.log 2024-04-18T21:11:23.665 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.26504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24209.log 2024-04-18T21:11:23.665 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26504.log.gz 2024-04-18T21:11:23.665 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.22468.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22468.log.gz 2024-04-18T21:11:23.665 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28375.log 2024-04-18T21:11:23.665 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.24209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23782.log 2024-04-18T21:11:23.665 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24209.log.gz 2024-04-18T21:11:23.665 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.28375.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28375.log.gz 2024-04-18T21:11:23.665 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25713.log 2024-04-18T21:11:23.665 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.23782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23162.log 2024-04-18T21:11:23.665 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23782.log.gz 2024-04-18T21:11:23.666 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.25713.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25713.log.gz 2024-04-18T21:11:23.666 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21095.log 2024-04-18T21:11:23.666 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.23162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23543.log 2024-04-18T21:11:23.666 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23162.log.gz 2024-04-18T21:11:23.666 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.21095.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21095.log.gz 2024-04-18T21:11:23.666 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22154.log 2024-04-18T21:11:23.666 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.23543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26991.log 2024-04-18T21:11:23.666 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23543.log.gz 2024-04-18T21:11:23.666 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.22154.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22154.log.gz 2024-04-18T21:11:23.666 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22022.log 2024-04-18T21:11:23.666 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.26991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24608.log 2024-04-18T21:11:23.666 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26991.log.gz 2024-04-18T21:11:23.666 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.22022.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.22022.log.gz 2024-04-18T21:11:23.667 INFO:teuthology.orchestra.run.smithi078.stderr: --verbose -- /var/log/ceph/ceph-client.admin.22388.log 2024-04-18T21:11:23.667 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.24608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22996.log 2024-04-18T21:11:23.667 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24608.log.gz 2024-04-18T21:11:23.667 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.22388.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22388.log.gz 2024-04-18T21:11:23.667 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27827.log 2024-04-18T21:11:23.667 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.22996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24301.log 2024-04-18T21:11:23.667 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22996.log.gz 2024-04-18T21:11:23.667 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.27827.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27827.log.gz 2024-04-18T21:11:23.667 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25628.log 2024-04-18T21:11:23.667 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.24301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21814.log 2024-04-18T21:11:23.667 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24301.log.gz 2024-04-18T21:11:23.667 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.25628.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25628.log.gz 2024-04-18T21:11:23.667 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25398.log 2024-04-18T21:11:23.667 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.21814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27597.log 2024-04-18T21:11:23.667 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21814.log.gz 2024-04-18T21:11:23.668 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.25398.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25398.log.gz 2024-04-18T21:11:23.668 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24962.log 2024-04-18T21:11:23.668 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.27597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21901.log 2024-04-18T21:11:23.668 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27597.log.gz 2024-04-18T21:11:23.668 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.24962.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24962.log.gz 2024-04-18T21:11:23.668 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24780.log 2024-04-18T21:11:23.668 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.21901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22258.log 2024-04-18T21:11:23.668 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21901.log.gz 2024-04-18T21:11:23.668 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.24780.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24780.log.gz 2024-04-18T21:11:23.668 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25068.log 2024-04-18T21:11:23.668 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.22258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26230.log 2024-04-18T21:11:23.668 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22258.log.gz 2024-04-18T21:11:23.668 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.25068.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25068.log.gz 2024-04-18T21:11:23.668 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22102.log 2024-04-18T21:11:23.669 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.26230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22076.log 2024-04-18T21:11:23.669 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26230.log.gz 2024-04-18T21:11:23.669 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.22102.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22102.log.gz 2024-04-18T21:11:23.669 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22414.log 2024-04-18T21:11:23.669 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.22076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22206.log 2024-04-18T21:11:23.669 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22076.log.gz 2024-04-18T21:11:23.669 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.22414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27144.log 2024-04-18T21:11:23.669 INFO:teuthology.orchestra.run.smithi078.stderr: 48.6% -- replaced with /var/log/ceph/ceph-client.admin.22414.log.gz 2024-04-18T21:11:23.669 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.22206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22232.log 2024-04-18T21:11:23.669 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22206.log.gz 2024-04-18T21:11:23.669 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.27144.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27144.log.gz 2024-04-18T21:11:23.669 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28401.log 2024-04-18T21:11:23.669 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.22232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26314.log 2024-04-18T21:11:23.669 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22232.log.gz 2024-04-18T21:11:23.669 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.28401.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28401.log.gz 2024-04-18T21:11:23.670 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21383.log 2024-04-18T21:11:23.670 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.26314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21554.log 2024-04-18T21:11:23.670 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26314.log.gz 2024-04-18T21:11:23.670 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.21383.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21383.log.gz 2024-04-18T21:11:23.670 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23538.log 2024-04-18T21:11:23.670 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.21554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21970.log 2024-04-18T21:11:23.670 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21554.log.gz 2024-04-18T21:11:23.670 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.23538.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23538.log.gz 2024-04-18T21:11:23.670 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21124.log 2024-04-18T21:11:23.670 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.21970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22868.log 2024-04-18T21:11:23.670 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21970.log.gz 2024-04-18T21:11:23.670 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.21124.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21124.log.gz 2024-04-18T21:11:23.670 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21303.log 2024-04-18T21:11:23.670 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.22868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21684.log 2024-04-18T21:11:23.670 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22868.log.gz 2024-04-18T21:11:23.671 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.21303.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21303.log.gz 2024-04-18T21:11:23.671 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21411.log 2024-04-18T21:11:23.671 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.21684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23307.log 2024-04-18T21:11:23.671 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21684.log.gz 2024-04-18T21:11:23.671 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.21411.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21411.log.gz 2024-04-18T21:11:23.671 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26530.log 2024-04-18T21:11:23.671 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.23307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28427.log 2024-04-18T21:11:23.671 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23307.log.gz 2024-04-18T21:11:23.671 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.26530.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26530.log.gz 2024-04-18T21:11:23.671 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25803.log 2024-04-18T21:11:23.671 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.28427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23312.log 2024-04-18T21:11:23.671 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28427.log.gz 2024-04-18T21:11:23.671 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.25803.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25803.log.gz 2024-04-18T21:11:23.671 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22612.log 2024-04-18T21:11:23.672 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27671.log 2024-04-18T21:11:23.672 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.23312.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23312.log.gz 2024-04-18T21:11:23.672 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.22612.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22612.log.gz 2024-04-18T21:11:23.672 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21632.log 2024-04-18T21:11:23.672 INFO:teuthology.orchestra.run.smithi078.stderr:gzip/var/log/ceph/ceph-client.admin.27671.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.24907.log 2024-04-18T21:11:23.672 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27671.log.gz 2024-04-18T21:11:23.672 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.21632.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21632.log.gz 2024-04-18T21:11:23.672 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24499.log 2024-04-18T21:11:23.672 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.24907.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24907.log.gz 2024-04-18T21:11:23.672 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27281.log 2024-04-18T21:11:23.672 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.24499.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24499.log.gz 2024-04-18T21:11:23.672 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28011.log 2024-04-18T21:11:23.672 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.27281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25540.log 2024-04-18T21:11:23.672 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27281.log.gz 2024-04-18T21:11:23.673 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.28011.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28011.log.gz 2024-04-18T21:11:23.673 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21821.log 2024-04-18T21:11:23.673 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.25540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25992.log 2024-04-18T21:11:23.673 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25540.log.gz 2024-04-18T21:11:23.673 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.21821.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21821.log.gz 2024-04-18T21:11:23.673 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25261.log 2024-04-18T21:11:23.673 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.25992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25479.log 2024-04-18T21:11:23.673 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25992.log.gz 2024-04-18T21:11:23.673 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.25261.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25261.log.gz 2024-04-18T21:11:23.673 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28297.log 2024-04-18T21:11:23.673 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.25479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21355.log 2024-04-18T21:11:23.673 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25479.log.gz 2024-04-18T21:11:23.673 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.28297.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28297.log.gz 2024-04-18T21:11:23.673 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25341.log 2024-04-18T21:11:23.674 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.21355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28323.log 2024-04-18T21:11:23.674 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21355.log.gz 2024-04-18T21:11:23.674 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.25341.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25341.log.gz 2024-04-18T21:11:23.674 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24746.log 2024-04-18T21:11:23.674 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.28323.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-18T21:11:23.674 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28323.log.gz 2024-04-18T21:11:23.674 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.24746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23643.log 2024-04-18T21:11:23.674 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24746.log.gz 2024-04-18T21:11:23.674 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28607.log 2024-04-18T21:11:23.674 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.23643.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23643.log.gz 2024-04-18T21:11:23.674 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23815.log 2024-04-18T21:11:23.674 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22128.log 2024-04-18T21:11:23.674 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.28607.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28607.log.gz 2024-04-18T21:11:23.674 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.23815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25145.log 2024-04-18T21:11:23.674 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23815.log.gz 2024-04-18T21:11:23.675 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.22128.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-18T21:11:23.675 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22128.log.gz 2024-04-18T21:11:23.675 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25597.log 2024-04-18T21:11:23.675 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.25145.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25145.log.gz 2024-04-18T21:11:23.675 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26151.log 2024-04-18T21:11:23.675 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.25597.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.25597.log.gz 2024-04-18T21:11:23.675 INFO:teuthology.orchestra.run.smithi078.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.28477.log 2024-04-18T21:11:23.675 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24533.log 2024-04-18T21:11:23.675 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.26151.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26151.log.gz 2024-04-18T21:11:23.675 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.28477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24881.log 2024-04-18T21:11:23.675 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28477.log.gz 2024-04-18T21:11:23.675 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23250.log 2024-04-18T21:11:23.675 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.24533.log: /var/log/ceph/ceph-client.admin.24881.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24533.log.gz 2024-04-18T21:11:23.675 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.24632.log 2024-04-18T21:11:23.676 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.24881.log.gz 2024-04-18T21:11:23.676 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.23250.log: /var/log/ceph/ceph-client.admin.21744.log 2024-04-18T21:11:23.676 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23250.log.gz 2024-04-18T21:11:23.676 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.24632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26420.log 2024-04-18T21:11:23.676 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24632.log.gz 2024-04-18T21:11:23.676 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.21744.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21892.log 2024-04-18T21:11:23.676 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.21744.log.gz 2024-04-18T21:11:23.676 INFO:teuthology.orchestra.run.smithi078.stderr: 94.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-18T21:11:23.676 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26475.log 2024-04-18T21:11:23.676 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.26420.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26420.log.gz 2024-04-18T21:11:23.676 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26962.log 2024-04-18T21:11:23.676 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.21892.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21892.log.gz 2024-04-18T21:11:23.676 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.26475.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26475.log.gz 2024-04-18T21:11:23.676 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28167.log 2024-04-18T21:11:23.676 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23757.log 2024-04-18T21:11:23.677 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.26962.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26962.log.gz 2024-04-18T21:11:23.677 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.28167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23047.log 2024-04-18T21:11:23.677 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28167.log.gz 2024-04-18T21:11:23.677 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.23757.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23757.log.gz 2024-04-18T21:11:23.677 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22050.log 2024-04-18T21:11:23.677 INFO:teuthology.orchestra.run.smithi078.stderr: 93.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-18T21:11:23.677 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24332.log 2024-04-18T21:11:23.677 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.23047.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23047.log.gz 2024-04-18T21:11:23.677 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.22050.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22050.log.gz 2024-04-18T21:11:23.677 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23509.log 2024-04-18T21:11:23.677 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.24332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27749.log 2024-04-18T21:11:23.677 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24332.log.gz 2024-04-18T21:11:23.677 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24689.log 2024-04-18T21:11:23.677 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.23509.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23509.log.gz 2024-04-18T21:11:23.677 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.27749.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27749.log.gz 2024-04-18T21:11:23.678 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27333.log 2024-04-18T21:11:23.678 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.24689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22494.log 2024-04-18T21:11:23.678 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24689.log.gz 2024-04-18T21:11:23.678 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.27333.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27333.log.gz 2024-04-18T21:11:23.678 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26064.log 2024-04-18T21:11:23.678 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.22494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26724.log 2024-04-18T21:11:23.678 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22494.log.gz 2024-04-18T21:11:23.678 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.26064.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26064.log.gz 2024-04-18T21:11:23.678 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25654.log 2024-04-18T21:11:23.678 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22310.log 2024-04-18T21:11:23.678 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.26724.log: /var/log/ceph/ceph-client.admin.25654.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26724.log.gz 2024-04-18T21:11:23.678 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25654.log.gz 2024-04-18T21:11:23.678 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24776.log 2024-04-18T21:11:23.678 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.22310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26594.log 2024-04-18T21:11:23.678 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22310.log.gz 2024-04-18T21:11:23.679 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.24776.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24776.log.gzgzip 2024-04-18T21:11:23.679 INFO:teuthology.orchestra.run.smithi078.stderr: -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-18T21:11:23.679 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.26594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22180.log 2024-04-18T21:11:23.679 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26594.log.gz 2024-04-18T21:11:23.679 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25424.log 2024-04-18T21:11:23.679 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.22180.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.22180.log.gz 2024-04-18T21:11:23.679 INFO:teuthology.orchestra.run.smithi078.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.22546.log 2024-04-18T21:11:23.679 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24043.log 2024-04-18T21:11:23.679 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.25424.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25424.log.gz 2024-04-18T21:11:23.679 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.22546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27933.log 2024-04-18T21:11:23.679 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22546.log.gz 2024-04-18T21:11:23.679 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.24043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27020.log 2024-04-18T21:11:23.679 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24043.log.gz 2024-04-18T21:11:23.679 INFO:teuthology.orchestra.run.smithi078.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-18T21:11:23.680 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.27933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27881.log 2024-04-18T21:11:23.680 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27933.log.gz 2024-04-18T21:11:23.680 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.27020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23421.log 2024-04-18T21:11:23.680 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27020.log.gz 2024-04-18T21:11:23.680 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.27881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26882.log 2024-04-18T21:11:23.680 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27881.log.gz 2024-04-18T21:11:23.680 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.23421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23876.log 2024-04-18T21:11:23.680 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23421.log.gz 2024-04-18T21:11:23.680 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.26882.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26882.log.gz 2024-04-18T21:11:23.680 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22611.log 2024-04-18T21:11:23.680 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27523.log 2024-04-18T21:11:23.680 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.23876.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23876.log.gz 2024-04-18T21:11:23.680 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.22611.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22611.log.gz 2024-04-18T21:11:23.680 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25455.log 2024-04-18T21:11:23.680 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.27523.log: /var/log/ceph/ceph-client.admin.23136.log 2024-04-18T21:11:23.681 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27523.log.gz 2024-04-18T21:11:23.681 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20987.log 2024-04-18T21:11:23.681 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.25455.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25455.log.gz 2024-04-18T21:11:23.681 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.23136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24472.log 2024-04-18T21:11:23.681 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23136.log.gz 2024-04-18T21:11:23.681 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.20987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24011.log 2024-04-18T21:11:23.681 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20987.log.gz 2024-04-18T21:11:23.681 INFO:teuthology.orchestra.run.smithi078.stderr:gzip/var/log/ceph/ceph-client.admin.24472.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.28115.log 2024-04-18T21:11:23.681 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24472.log.gz 2024-04-18T21:11:23.681 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.24011.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24011.log.gz 2024-04-18T21:11:23.681 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25943.log 2024-04-18T21:11:23.681 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23731.log/var/log/ceph/ceph-client.admin.28115.log: 2024-04-18T21:11:23.681 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28115.log.gz 2024-04-18T21:11:23.681 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.25943.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25943.log.gz 2024-04-18T21:11:23.681 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24714.log 2024-04-18T21:11:23.682 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24440.log 2024-04-18T21:11:23.682 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.23731.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23731.log.gz 2024-04-18T21:11:23.682 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.24714.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24714.log.gz 2024-04-18T21:11:23.682 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-18T21:11:23.682 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26645.log 2024-04-18T21:11:23.682 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.24440.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24440.log.gz 2024-04-18T21:11:23.682 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-18T21:11:23.682 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.26645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27445.log 2024-04-18T21:11:23.682 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26645.log.gz 2024-04-18T21:11:23.682 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21822.log 2024-04-18T21:11:23.682 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.27445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24911.log 2024-04-18T21:11:23.682 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27445.log.gz 2024-04-18T21:11:23.682 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.21822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22336.log 0.0% 2024-04-18T21:11:23.682 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.21822.log.gz 2024-04-18T21:11:23.683 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.24911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20845.log 2024-04-18T21:11:23.683 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24911.log.gz 2024-04-18T21:11:23.683 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.22336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28453.log 2024-04-18T21:11:23.683 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22336.log.gz 2024-04-18T21:11:23.683 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.20845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26698.log 2024-04-18T21:11:23.683 INFO:teuthology.orchestra.run.smithi078.stderr: 95.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-18T21:11:23.683 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20845.log.gz 2024-04-18T21:11:23.683 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.28453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27853.log 2024-04-18T21:11:23.683 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28453.log.gz 2024-04-18T21:11:23.683 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.26698.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26698.log.gz 2024-04-18T21:11:23.683 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24244.log 2024-04-18T21:11:23.683 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25505.log 2024-04-18T21:11:23.683 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.27853.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27853.log.gz 2024-04-18T21:11:23.683 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.24244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.22801.log 2024-04-18T21:11:23.683 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24244.log.gz 2024-04-18T21:11:23.684 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.25505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28581.log 2024-04-18T21:11:23.684 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25505.log.gz 2024-04-18T21:11:23.684 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23477.log 2024-04-18T21:11:23.684 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.22801.log: 33.3% -- replaced with /var/log/ceph/ceph-client.0.22801.log.gz 2024-04-18T21:11:23.684 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.28581.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.28581.log.gz --verbose 2024-04-18T21:11:23.684 INFO:teuthology.orchestra.run.smithi078.stderr: -- /var/log/ceph/ceph-client.admin.27596.log 2024-04-18T21:11:23.684 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.23477.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.23477.log.gz 2024-04-18T21:11:23.684 INFO:teuthology.orchestra.run.smithi078.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.22948.log 2024-04-18T21:11:23.684 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22576.log 2024-04-18T21:11:23.684 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.27596.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27596.log.gz 2024-04-18T21:11:23.684 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.22948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27255.log 2024-04-18T21:11:23.684 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22948.log.gz 2024-04-18T21:11:23.684 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.22576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26206.log 2024-04-18T21:11:23.684 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22576.log.gz 2024-04-18T21:11:23.684 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25367.log 2024-04-18T21:11:23.685 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.27255.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27255.log.gz 2024-04-18T21:11:23.685 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.26206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25544.log 2024-04-18T21:11:23.685 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26206.log.gz 2024-04-18T21:11:23.685 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.25367.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.25367.log.gz 2024-04-18T21:11:23.685 INFO:teuthology.orchestra.run.smithi078.stderr: /var/log/ceph/ceph-client.admin.27444.log 2024-04-18T21:11:23.685 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21446.log 2024-04-18T21:11:23.685 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.25544.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25544.log.gz 2024-04-18T21:11:23.685 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.27444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26444.log 2024-04-18T21:11:23.685 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27444.log.gz 2024-04-18T21:11:23.685 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.21446.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21446.log.gzgzip 2024-04-18T21:11:23.685 INFO:teuthology.orchestra.run.smithi078.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.21069.log 2024-04-18T21:11:23.685 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27307.log 2024-04-18T21:11:23.685 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.26444.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26444.log.gz 2024-04-18T21:11:23.685 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.21069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21743.log 2024-04-18T21:11:23.686 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21069.log.gz 2024-04-18T21:11:23.686 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.27307.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.27307.log.gz 2024-04-18T21:11:23.686 INFO:teuthology.orchestra.run.smithi078.stderr: /var/log/ceph/ceph-client.admin.24413.log 2024-04-18T21:11:23.686 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.20450.log 2024-04-18T21:11:23.686 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.21743.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21743.log.gz 2024-04-18T21:11:23.686 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.24413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23542.log 2024-04-18T21:11:23.686 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24413.log.gz 2024-04-18T21:11:23.686 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph.tmp-client.admin.20450.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.26391.log 2024-04-18T21:11:23.686 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph.tmp-client.admin.20450.log.gz 2024-04-18T21:11:23.686 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.23542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21658.log 2024-04-18T21:11:23.686 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23542.log.gz 2024-04-18T21:11:23.686 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.26391.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.23617.log 2024-04-18T21:11:23.686 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.26391.log.gz 2024-04-18T21:11:23.686 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.21658.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.21658.log.gz 2024-04-18T21:11:23.687 INFO:teuthology.orchestra.run.smithi078.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.27046.log 2024-04-18T21:11:23.687 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-18T21:11:23.687 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.23617.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23617.log.gz 2024-04-18T21:11:23.687 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.27046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22659.log 2024-04-18T21:11:23.687 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27046.log.gz 2024-04-18T21:11:23.687 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24772.log 2024-04-18T21:11:23.687 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.22659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25233.log 2024-04-18T21:11:23.687 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22659.log.gz 2024-04-18T21:11:23.687 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.24772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23452.log 2024-04-18T21:11:23.687 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24772.log.gz 2024-04-18T21:11:23.687 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.25233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27443.log 2024-04-18T21:11:23.687 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25233.log.gz 2024-04-18T21:11:23.687 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.23452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21170.log 2024-04-18T21:11:23.687 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23452.log.gz 2024-04-18T21:11:23.687 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.27443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23674.log 2024-04-18T21:11:23.688 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27443.log.gz 2024-04-18T21:11:23.688 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.21170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28529.log 2024-04-18T21:11:23.688 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21170.log.gz 2024-04-18T21:11:23.688 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.23674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27959.log 2024-04-18T21:11:23.688 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23674.log.gz 2024-04-18T21:11:23.688 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.28529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28271.log 2024-04-18T21:11:23.688 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28529.log.gz 2024-04-18T21:11:23.688 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.27959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22837.log 2024-04-18T21:11:23.688 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27959.log.gz 2024-04-18T21:11:23.688 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.28271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22917.log 2024-04-18T21:11:23.688 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28271.log.gz 2024-04-18T21:11:23.688 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.22837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28037.log 2024-04-18T21:11:23.688 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22837.log.gz 2024-04-18T21:11:23.688 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.22917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23104.log 2024-04-18T21:11:23.688 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22917.log.gz 2024-04-18T21:11:23.689 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.28037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25247.log 2024-04-18T21:11:23.689 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28037.log.gz 2024-04-18T21:11:23.689 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.23104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23395.log 2024-04-18T21:11:23.689 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23104.log.gz 2024-04-18T21:11:23.689 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.25247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27675.log 2024-04-18T21:11:23.689 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25247.log.gz 2024-04-18T21:11:23.689 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.23395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25197.log 2024-04-18T21:11:23.689 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23395.log.gz 2024-04-18T21:11:23.689 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.27675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23700.log 2024-04-18T21:11:23.689 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27675.log.gz 2024-04-18T21:11:23.689 INFO:teuthology.orchestra.run.smithi078.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-18T21:11:23.689 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.25197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20650.log 2024-04-18T21:11:23.689 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25197.log.gz 2024-04-18T21:11:23.689 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.23700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24100.log 2024-04-18T21:11:23.689 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23700.log.gz 2024-04-18T21:11:23.689 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.20650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21277.log 2024-04-18T21:11:23.690 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20650.log.gz 2024-04-18T21:11:23.690 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.24100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28678.log 2024-04-18T21:11:23.690 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24100.log.gz 2024-04-18T21:11:23.690 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.21277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24126.log 2024-04-18T21:11:23.690 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21277.log.gz 2024-04-18T21:11:23.690 INFO:teuthology.orchestra.run.smithi078.stderr:gzip/var/log/ceph/ceph-client.admin.28678.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.22520.log 2024-04-18T21:11:23.690 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28678.log.gz 2024-04-18T21:11:23.690 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.24126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25041.log 2024-04-18T21:11:23.690 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24126.log.gz 2024-04-18T21:11:23.690 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.22520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27170.log 2024-04-18T21:11:23.690 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22520.log.gz 2024-04-18T21:11:23.690 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24968.log 2024-04-18T21:11:23.690 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.25041.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25041.log.gz 2024-04-18T21:11:23.690 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.27170.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27170.log.gz 2024-04-18T21:11:23.691 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.24968.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24968.log.gz 2024-04-18T21:11:23.735 INFO:teuthology.orchestra.run.smithi078.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-18T21:11:23.758 INFO:teuthology.orchestra.run.smithi078.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-18T21:11:23.849 INFO:teuthology.orchestra.run.smithi078.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-18T21:11:23.851 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-04-18T21:11:23.851 INFO:teuthology.orchestra.run.smithi078.stderr:real 0m0.357s 2024-04-18T21:11:23.851 INFO:teuthology.orchestra.run.smithi078.stderr:user 0m0.887s 2024-04-18T21:11:23.851 INFO:teuthology.orchestra.run.smithi078.stderr:sys 0m0.084s 2024-04-18T21:11:25.151 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-04-18T21:11:25.782 INFO:teuthology.orchestra.run.smithi150.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-18T21:11:25.784 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-04-18T21:11:25.784 INFO:teuthology.orchestra.run.smithi150.stderr:real 0m2.266s 2024-04-18T21:11:25.784 INFO:teuthology.orchestra.run.smithi150.stderr:user 0m2.119s 2024-04-18T21:11:25.784 INFO:teuthology.orchestra.run.smithi150.stderr:sys 0m0.099s 2024-04-18T21:11:28.553 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-osd.0.log: 93.4% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-18T21:11:28.554 INFO:teuthology.orchestra.run.smithi132.stderr: 2024-04-18T21:11:28.554 INFO:teuthology.orchestra.run.smithi132.stderr:real 0m5.057s 2024-04-18T21:11:28.554 INFO:teuthology.orchestra.run.smithi132.stderr:user 0m4.805s 2024-04-18T21:11:28.554 INFO:teuthology.orchestra.run.smithi132.stderr:sys 0m0.185s 2024-04-18T21:11:29.368 INFO:teuthology.orchestra.run.smithi187.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-18T21:11:29.370 INFO:teuthology.orchestra.run.smithi187.stderr: 2024-04-18T21:11:29.370 INFO:teuthology.orchestra.run.smithi187.stderr:real 0m5.833s 2024-04-18T21:11:29.371 INFO:teuthology.orchestra.run.smithi187.stderr:user 0m5.618s 2024-04-18T21:11:29.371 INFO:teuthology.orchestra.run.smithi187.stderr:sys 0m0.169s 2024-04-18T21:11:29.371 INFO:tasks.ceph:Archiving logs... 2024-04-18T21:11:29.371 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-18_20:32:14-powercycle-main-distro-default-smithi/7662458/remote/smithi078/log 2024-04-18T21:11:29.372 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-18T21:11:29.761 DEBUG:teuthology.misc:Transferring archived files from smithi132:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-18_20:32:14-powercycle-main-distro-default-smithi/7662458/remote/smithi132/log 2024-04-18T21:11:29.762 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-18T21:11:30.528 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-18_20:32:14-powercycle-main-distro-default-smithi/7662458/remote/smithi150/log 2024-04-18T21:11:30.529 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-18T21:11:30.853 DEBUG:teuthology.misc:Transferring archived files from smithi187:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-18_20:32:14-powercycle-main-distro-default-smithi/7662458/remote/smithi187/log 2024-04-18T21:11:30.854 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-18T21:11:31.655 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-18T21:11:31.664 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-18T21:11:31.664 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-18T21:11:31.666 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-18T21:11:31.671 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-18T21:11:31.675 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-18T21:11:31.793 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-18T21:11:31.804 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-18T21:11:31.804 DEBUG:teuthology.orchestra.run.smithi078:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-18T21:11:31.825 DEBUG:teuthology.orchestra.run.smithi132:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-18T21:11:31.827 INFO:teuthology.orchestra.run.smithi078.stdout: remote refid st t when poll reach delay offset jitter 2024-04-18T21:11:31.827 INFO:teuthology.orchestra.run.smithi078.stdout:============================================================================== 2024-04-18T21:11:31.827 INFO:teuthology.orchestra.run.smithi078.stdout:*hv01.front.sepi 67.205.162.81 3 u 9 64 377 0.072 -1.718 0.681 2024-04-18T21:11:31.827 INFO:teuthology.orchestra.run.smithi078.stdout:+hv02.front.sepi 63.231.80.2 3 u 13 64 377 0.077 -1.782 0.639 2024-04-18T21:11:31.827 INFO:teuthology.orchestra.run.smithi078.stdout:+hv03.front.sepi 74.6.168.72 3 u 3 64 377 0.094 -1.912 0.567 2024-04-18T21:11:31.827 INFO:teuthology.orchestra.run.smithi078.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2024-04-18T21:11:31.834 DEBUG:teuthology.orchestra.run.smithi150:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-18T21:11:31.837 DEBUG:teuthology.orchestra.run.smithi187:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-18T21:11:31.841 INFO:teuthology.orchestra.run.smithi132.stdout: remote refid st t when poll reach delay offset jitter 2024-04-18T21:11:31.841 INFO:teuthology.orchestra.run.smithi132.stdout:============================================================================== 2024-04-18T21:11:31.841 INFO:teuthology.orchestra.run.smithi132.stdout:+hv01.front.sepi 67.205.162.81 3 u 9 64 377 0.108 -3.628 2.088 2024-04-18T21:11:31.841 INFO:teuthology.orchestra.run.smithi132.stdout:+hv02.front.sepi 63.231.80.2 3 u 4 64 377 0.059 +0.004 2.226 2024-04-18T21:11:31.841 INFO:teuthology.orchestra.run.smithi132.stdout:*hv03.front.sepi 74.6.168.72 3 u 3 64 377 0.086 -1.982 1.345 2024-04-18T21:11:31.842 INFO:teuthology.orchestra.run.smithi132.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2024-04-18T21:11:31.853 INFO:teuthology.orchestra.run.smithi187.stdout: remote refid st t when poll reach delay offset jitter 2024-04-18T21:11:31.853 INFO:teuthology.orchestra.run.smithi187.stdout:============================================================================== 2024-04-18T21:11:31.853 INFO:teuthology.orchestra.run.smithi187.stdout:*hv01.front.sepi 67.205.162.81 3 u 2 64 377 0.083 -0.971 0.833 2024-04-18T21:11:31.853 INFO:teuthology.orchestra.run.smithi187.stdout:+hv02.front.sepi 63.231.80.2 3 u 5 64 377 0.068 -0.351 0.828 2024-04-18T21:11:31.853 INFO:teuthology.orchestra.run.smithi187.stdout:+hv03.front.sepi 74.6.168.72 3 u 4 64 377 0.092 -0.920 0.841 2024-04-18T21:11:31.853 INFO:teuthology.orchestra.run.smithi187.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2024-04-18T21:11:31.931 INFO:teuthology.orchestra.run.smithi150.stdout: remote refid st t when poll reach delay offset jitter 2024-04-18T21:11:31.932 INFO:teuthology.orchestra.run.smithi150.stdout:============================================================================== 2024-04-18T21:11:31.932 INFO:teuthology.orchestra.run.smithi150.stdout: hv01.front.sepi 67.205.162.81 3 u 47 64 3 0.205 -63.746 0.849 2024-04-18T21:11:31.932 INFO:teuthology.orchestra.run.smithi150.stdout: hv02.front.sepi 63.231.80.2 3 u 47 64 3 0.132 -63.104 0.772 2024-04-18T21:11:31.932 INFO:teuthology.orchestra.run.smithi150.stdout: hv03.front.sepi 74.6.168.72 3 u 52 64 3 0.198 -63.619 0.700 2024-04-18T21:11:31.933 INFO:teuthology.orchestra.run.smithi150.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T21:11:31.934 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-18T21:11:31.944 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-18T21:11:31.944 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-18T21:11:31.955 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-18T21:11:31.966 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-18T21:11:31.976 INFO:teuthology.task.internal:Duration was 1226.081624 seconds 2024-04-18T21:11:31.976 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-18T21:11:31.987 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-18T21:11:31.987 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-18T21:11:31.991 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-18T21:11:31.995 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-18T21:11:31.998 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-18T21:11:32.052 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-18T21:11:32.052 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi078.front.sepia.ceph.com 2024-04-18T21:11:32.052 DEBUG:teuthology.orchestra.run.smithi078:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-18T21:11:32.062 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi132.front.sepia.ceph.com 2024-04-18T21:11:32.063 DEBUG:teuthology.orchestra.run.smithi132:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-18T21:11:32.086 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi150.front.sepia.ceph.com 2024-04-18T21:11:32.087 DEBUG:teuthology.orchestra.run.smithi150:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-18T21:11:32.098 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi187.front.sepia.ceph.com 2024-04-18T21:11:32.098 DEBUG:teuthology.orchestra.run.smithi187:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-18T21:11:32.108 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-18T21:11:32.108 DEBUG:teuthology.orchestra.run.smithi078:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-18T21:11:32.111 DEBUG:teuthology.orchestra.run.smithi132:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-18T21:11:32.134 DEBUG:teuthology.orchestra.run.smithi150:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-18T21:11:32.143 DEBUG:teuthology.orchestra.run.smithi187:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-18T21:11:32.236 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-18T21:11:32.236 DEBUG:teuthology.orchestra.run.smithi078:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-18T21:11:32.238 DEBUG:teuthology.orchestra.run.smithi132:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-18T21:11:32.241 DEBUG:teuthology.orchestra.run.smithi150:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-18T21:11:32.243 DEBUG:teuthology.orchestra.run.smithi187:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-18T21:11:32.339 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-18T21:11:32.350 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-18T21:11:32.350 DEBUG:teuthology.orchestra.run.smithi078:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-18T21:11:32.365 DEBUG:teuthology.orchestra.run.smithi132:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-18T21:11:32.380 DEBUG:teuthology.orchestra.run.smithi150:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-18T21:11:32.395 DEBUG:teuthology.orchestra.run.smithi187:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-18T21:11:32.411 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-18T21:11:32.421 DEBUG:teuthology.orchestra.run.smithi078:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-18T21:11:32.423 DEBUG:teuthology.orchestra.run.smithi132:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-18T21:11:32.425 DEBUG:teuthology.orchestra.run.smithi150:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-18T21:11:32.433 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern = core 2024-04-18T21:11:32.434 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern = core 2024-04-18T21:11:32.439 DEBUG:teuthology.orchestra.run.smithi187:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-18T21:11:32.456 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern = core 2024-04-18T21:11:32.473 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern = core 2024-04-18T21:11:32.642 DEBUG:teuthology.orchestra.run.smithi078:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-18T21:11:32.647 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T21:11:32.648 DEBUG:teuthology.orchestra.run.smithi132:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-18T21:11:32.652 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T21:11:32.653 DEBUG:teuthology.orchestra.run.smithi150:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-18T21:11:32.657 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T21:11:32.658 DEBUG:teuthology.orchestra.run.smithi187:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-18T21:11:32.689 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T21:11:32.690 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-18T21:11:32.701 INFO:teuthology.task.internal:Transferring archived files... 2024-04-18T21:11:32.702 DEBUG:teuthology.misc:Transferring archived files from smithi078:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-18_20:32:14-powercycle-main-distro-default-smithi/7662458/remote/smithi078 2024-04-18T21:11:32.702 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-18T21:11:32.739 DEBUG:teuthology.misc:Transferring archived files from smithi132:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-18_20:32:14-powercycle-main-distro-default-smithi/7662458/remote/smithi132 2024-04-18T21:11:32.739 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-18T21:11:32.761 DEBUG:teuthology.misc:Transferring archived files from smithi150:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-18_20:32:14-powercycle-main-distro-default-smithi/7662458/remote/smithi150 2024-04-18T21:11:32.761 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-18T21:11:32.781 DEBUG:teuthology.misc:Transferring archived files from smithi187:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-18_20:32:14-powercycle-main-distro-default-smithi/7662458/remote/smithi187 2024-04-18T21:11:32.782 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-18T21:11:32.803 INFO:teuthology.task.internal:Removing archive directory... 2024-04-18T21:11:32.804 DEBUG:teuthology.orchestra.run.smithi078:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-18T21:11:32.806 DEBUG:teuthology.orchestra.run.smithi132:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-18T21:11:32.808 DEBUG:teuthology.orchestra.run.smithi150:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-18T21:11:32.825 DEBUG:teuthology.orchestra.run.smithi187:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-18T21:11:32.846 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-18T21:11:32.856 INFO:teuthology.task.internal:Not uploading archives. 2024-04-18T21:11:32.856 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-18T21:11:32.868 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-18T21:11:32.868 DEBUG:teuthology.orchestra.run.smithi078:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-18T21:11:32.871 DEBUG:teuthology.orchestra.run.smithi132:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-18T21:11:32.874 DEBUG:teuthology.orchestra.run.smithi150:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-18T21:11:32.875 INFO:teuthology.orchestra.run.smithi078.stdout: 658616 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 18 21:11 /home/ubuntu/cephtest 2024-04-18T21:11:32.880 INFO:teuthology.orchestra.run.smithi132.stdout: 658467 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 18 21:11 /home/ubuntu/cephtest 2024-04-18T21:11:32.881 DEBUG:teuthology.orchestra.run.smithi187:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-18T21:11:32.884 INFO:teuthology.orchestra.run.smithi150.stdout: 658624 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 18 21:11 /home/ubuntu/cephtest 2024-04-18T21:11:32.896 INFO:teuthology.orchestra.run.smithi187.stdout: 658641 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 18 21:11 /home/ubuntu/cephtest 2024-04-18T21:11:32.898 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-18T21:11:32.914 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-18T21:11:32.939 INFO:teuthology.run:Summary data: description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-bitmap powercycle/default supported-distros/ubuntu_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health} duration: 1226.081624031067 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-04-18T21:11:32.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T21:11:33.025 INFO:teuthology.run:pass